Nov 21 11:50:39 crc systemd[1]: Starting Kubernetes Kubelet... Nov 21 11:50:39 crc restorecon[4680]: Relabeled /var/lib/kubelet/config.json from system_u:object_r:unlabeled_t:s0 to system_u:object_r:container_var_lib_t:s0 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/device-plugins not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/device-plugins/kubelet.sock not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/volumes/kubernetes.io~configmap/nginx-conf/..2025_02_23_05_40_35.4114275528/nginx.conf not reset as customized by admin to system_u:object_r:container_file_t:s0:c15,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c15,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/containers/networking-console-plugin/22e96971 not reset as customized by admin to system_u:object_r:container_file_t:s0:c15,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/containers/networking-console-plugin/21c98286 not reset as customized by admin to system_u:object_r:container_file_t:s0:c15,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/containers/networking-console-plugin/0f1869e1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c15,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c215,c682 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/setup/46889d52 not reset as customized by admin to system_u:object_r:container_file_t:s0:c225,c458 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/setup/5b6a5969 not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c963 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/setup/6c7921f5 not reset as customized by admin to system_u:object_r:container_file_t:s0:c215,c682 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/kube-rbac-proxy-crio/4804f443 not reset as customized by admin to system_u:object_r:container_file_t:s0:c225,c458 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/kube-rbac-proxy-crio/2a46b283 not reset as customized by admin to system_u:object_r:container_file_t:s0:c225,c458 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/kube-rbac-proxy-crio/a6b5573e not reset as customized by admin to system_u:object_r:container_file_t:s0:c225,c458 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/kube-rbac-proxy-crio/4f88ee5b not reset as customized by admin to system_u:object_r:container_file_t:s0:c225,c458 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/kube-rbac-proxy-crio/5a4eee4b not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c963 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/d1b160f5dda77d281dd8e69ec8d817f9/containers/kube-rbac-proxy-crio/cd87c521 not reset as customized by admin to system_u:object_r:container_file_t:s0:c215,c682 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/volumes/kubernetes.io~configmap/service-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/volumes/kubernetes.io~configmap/service-ca-bundle/..2025_02_23_05_33_42.2574241751 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/volumes/kubernetes.io~configmap/service-ca-bundle/..2025_02_23_05_33_42.2574241751/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/volumes/kubernetes.io~configmap/service-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/volumes/kubernetes.io~configmap/service-ca-bundle/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/38602af4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/1483b002 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/0346718b not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/d3ed4ada not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/3bb473a5 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/8cd075a9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/00ab4760 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/containers/router/54a21c09 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/37a5e44f-9a88-4405-be8a-b645485e7312/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c589,c726 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/37a5e44f-9a88-4405-be8a-b645485e7312/containers/network-operator/70478888 not reset as customized by admin to system_u:object_r:container_file_t:s0:c176,c499 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/37a5e44f-9a88-4405-be8a-b645485e7312/containers/network-operator/43802770 not reset as customized by admin to system_u:object_r:container_file_t:s0:c176,c499 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/37a5e44f-9a88-4405-be8a-b645485e7312/containers/network-operator/955a0edc not reset as customized by admin to system_u:object_r:container_file_t:s0:c176,c499 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/37a5e44f-9a88-4405-be8a-b645485e7312/containers/network-operator/bca2d009 not reset as customized by admin to system_u:object_r:container_file_t:s0:c140,c1009 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/37a5e44f-9a88-4405-be8a-b645485e7312/containers/network-operator/b295f9bd not reset as customized by admin to system_u:object_r:container_file_t:s0:c589,c726 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-binary-copy not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-binary-copy/..2025_02_23_05_21_22.3617465230 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-binary-copy/..2025_02_23_05_21_22.3617465230/cnibincopy.sh not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-binary-copy/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-binary-copy/cnibincopy.sh not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-sysctl-allowlist not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-sysctl-allowlist/..2025_02_23_05_21_22.2050650026 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-sysctl-allowlist/..2025_02_23_05_21_22.2050650026/allowlist.conf not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-sysctl-allowlist/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes/kubernetes.io~configmap/cni-sysctl-allowlist/allowlist.conf not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/egress-router-binary-copy/bc46ea27 not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/egress-router-binary-copy/5731fc1b not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/egress-router-binary-copy/5e1b2a3c not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/cni-plugins/943f0936 not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/cni-plugins/3f764ee4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/cni-plugins/8695e3f9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/bond-cni-plugin/aed7aa86 not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/bond-cni-plugin/c64d7448 not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/bond-cni-plugin/0ba16bd2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/routeoverride-cni/207a939f not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/routeoverride-cni/54aa8cdb not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/routeoverride-cni/1f5fa595 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/whereabouts-cni-bincopy/bf9c8153 not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/whereabouts-cni-bincopy/47fba4ea not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/whereabouts-cni-bincopy/7ae55ce9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/whereabouts-cni/7906a268 not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/whereabouts-cni/ce43fa69 not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/whereabouts-cni/7fc7ea3a not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/kube-multus-additional-cni-plugins/d8c38b7d not reset as customized by admin to system_u:object_r:container_file_t:s0:c203,c924 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/kube-multus-additional-cni-plugins/9ef015fb not reset as customized by admin to system_u:object_r:container_file_t:s0:c138,c778 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/containers/kube-multus-additional-cni-plugins/b9db6a41 not reset as customized by admin to system_u:object_r:container_file_t:s0:c574,c582 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c432,c991 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/containers/network-metrics-daemon/b1733d79 not reset as customized by admin to system_u:object_r:container_file_t:s0:c476,c820 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/containers/network-metrics-daemon/afccd338 not reset as customized by admin to system_u:object_r:container_file_t:s0:c272,c818 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/containers/network-metrics-daemon/9df0a185 not reset as customized by admin to system_u:object_r:container_file_t:s0:c432,c991 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/containers/kube-rbac-proxy/18938cf8 not reset as customized by admin to system_u:object_r:container_file_t:s0:c476,c820 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/containers/kube-rbac-proxy/7ab4eb23 not reset as customized by admin to system_u:object_r:container_file_t:s0:c272,c818 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/containers/kube-rbac-proxy/56930be6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c432,c991 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/env-overrides not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/env-overrides/..2025_02_23_05_21_35.630010865 not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/env-overrides/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/ovnkube-config not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/ovnkube-config/..2025_02_23_05_21_35.1088506337 not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/ovnkube-config/..2025_02_23_05_21_35.1088506337/ovnkube.conf not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/ovnkube-config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes/kubernetes.io~configmap/ovnkube-config/ovnkube.conf not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/kube-rbac-proxy/0d8e3722 not reset as customized by admin to system_u:object_r:container_file_t:s0:c89,c211 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/kube-rbac-proxy/d22b2e76 not reset as customized by admin to system_u:object_r:container_file_t:s0:c382,c850 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/kube-rbac-proxy/e036759f not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/ovnkube-cluster-manager/2734c483 not reset as customized by admin to system_u:object_r:container_file_t:s0:c89,c211 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/ovnkube-cluster-manager/57878fe7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c89,c211 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/ovnkube-cluster-manager/3f3c2e58 not reset as customized by admin to system_u:object_r:container_file_t:s0:c89,c211 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/ovnkube-cluster-manager/375bec3e not reset as customized by admin to system_u:object_r:container_file_t:s0:c382,c850 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/containers/ovnkube-cluster-manager/7bc41e08 not reset as customized by admin to system_u:object_r:container_file_t:s0:c440,c975 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d/containers/download-server/48c7a72d not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d/containers/download-server/4b66701f not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d/containers/download-server/a5a1c202 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm/..2025_02_23_05_21_40.3350632666 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm/..2025_02_23_05_21_40.3350632666/additional-cert-acceptance-cond.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm/..2025_02_23_05_21_40.3350632666/additional-pod-admission-cond.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm/additional-cert-acceptance-cond.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/ovnkube-identity-cm/additional-pod-admission-cond.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/env-overrides not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/env-overrides/..2025_02_23_05_21_40.1388695756 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/volumes/kubernetes.io~configmap/env-overrides/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/webhook/26f3df5b not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/webhook/6d8fb21d not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/webhook/50e94777 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/approver/208473b3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/approver/ec9e08ba not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/approver/3b787c39 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/approver/208eaed5 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/approver/93aa3a2b not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/ef543e1b-8068-4ea3-b32a-61027b32e95d/containers/approver/3c697968 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3b6479f0-333b-4a96-9adf-2099afdc2447/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3b6479f0-333b-4a96-9adf-2099afdc2447/containers/network-check-target-container/ba950ec9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3b6479f0-333b-4a96-9adf-2099afdc2447/containers/network-check-target-container/cb5cdb37 not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3b6479f0-333b-4a96-9adf-2099afdc2447/containers/network-check-target-container/f2df9827 not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/images not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/images/..2025_02_23_05_22_30.473230615 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/images/..2025_02_23_05_22_30.473230615/images.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/images/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/images/images.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/auth-proxy-config not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/auth-proxy-config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/auth-proxy-config/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/auth-proxy-config/..2025_02_24_06_22_02.1904938450 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes/kubernetes.io~configmap/auth-proxy-config/..2025_02_24_06_22_02.1904938450/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/containers/machine-config-operator/fedaa673 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/containers/machine-config-operator/9ca2df95 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/containers/machine-config-operator/b2d7460e not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/containers/kube-rbac-proxy/2207853c not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/containers/kube-rbac-proxy/241c1c29 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/containers/kube-rbac-proxy/2d910eaf not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-ca/..2025_02_23_05_23_49.3726007728 not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-ca/..2025_02_23_05_23_49.3726007728/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-ca/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-service-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-service-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-service-ca/..2025_02_23_05_23_49.841175008 not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-service-ca/..2025_02_23_05_23_49.841175008/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/etcd-service-ca/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.843437178 not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.843437178/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/containers/etcd-operator/c6c0f2e7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c263,c871 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/containers/etcd-operator/399edc97 not reset as customized by admin to system_u:object_r:container_file_t:s0:c263,c871 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/containers/etcd-operator/8049f7cc not reset as customized by admin to system_u:object_r:container_file_t:s0:c263,c871 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/containers/etcd-operator/0cec5484 not reset as customized by admin to system_u:object_r:container_file_t:s0:c263,c871 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/containers/etcd-operator/312446d0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c406,c828 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/containers/etcd-operator/8e56a35d not reset as customized by admin to system_u:object_r:container_file_t:s0:c84,c419 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.133159589 not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.133159589/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/containers/kube-controller-manager-operator/2d30ddb9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c380,c909 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/containers/kube-controller-manager-operator/eca8053d not reset as customized by admin to system_u:object_r:container_file_t:s0:c380,c909 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/containers/kube-controller-manager-operator/c3a25c9a not reset as customized by admin to system_u:object_r:container_file_t:s0:c168,c522 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/containers/kube-controller-manager-operator/b9609c22 not reset as customized by admin to system_u:object_r:container_file_t:s0:c108,c511 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c968,c969 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/containers/dns-operator/e8b0eca9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c106,c418 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/containers/dns-operator/b36a9c3f not reset as customized by admin to system_u:object_r:container_file_t:s0:c529,c711 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/containers/dns-operator/38af7b07 not reset as customized by admin to system_u:object_r:container_file_t:s0:c968,c969 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/containers/kube-rbac-proxy/ae821620 not reset as customized by admin to system_u:object_r:container_file_t:s0:c106,c418 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/containers/kube-rbac-proxy/baa23338 not reset as customized by admin to system_u:object_r:container_file_t:s0:c529,c711 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/containers/kube-rbac-proxy/2c534809 not reset as customized by admin to system_u:object_r:container_file_t:s0:c968,c969 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.3532625537 not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.3532625537/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/containers/kube-scheduler-operator-container/59b29eae not reset as customized by admin to system_u:object_r:container_file_t:s0:c338,c381 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/containers/kube-scheduler-operator-container/c91a8e4f not reset as customized by admin to system_u:object_r:container_file_t:s0:c338,c381 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/containers/kube-scheduler-operator-container/4d87494a not reset as customized by admin to system_u:object_r:container_file_t:s0:c442,c857 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/containers/kube-scheduler-operator-container/1e33ca63 not reset as customized by admin to system_u:object_r:container_file_t:s0:c661,c999 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/containers/kube-rbac-proxy/8dea7be2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/containers/kube-rbac-proxy/d0b04a99 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/containers/kube-rbac-proxy/d84f01e7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/containers/package-server-manager/4109059b not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/containers/package-server-manager/a7258a3e not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/containers/package-server-manager/05bdf2b6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/containers/control-plane-machine-set-operator/f3261b51 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/containers/control-plane-machine-set-operator/315d045e not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/containers/control-plane-machine-set-operator/5fdcf278 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/containers/control-plane-machine-set-operator/d053f757 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/containers/control-plane-machine-set-operator/c2850dc7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/volumes/kubernetes.io~configmap/marketplace-trusted-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/volumes/kubernetes.io~configmap/marketplace-trusted-ca/..2025_02_23_05_22_30.2390596521 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/volumes/kubernetes.io~configmap/marketplace-trusted-ca/..2025_02_23_05_22_30.2390596521/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/volumes/kubernetes.io~configmap/marketplace-trusted-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/volumes/kubernetes.io~configmap/marketplace-trusted-ca/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/fcfb0b2b not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/c7ac9b7d not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/fa0c0d52 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/c609b6ba not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/2be6c296 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/89a32653 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/4eb9afeb not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/containers/marketplace-operator/13af6efa not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6312bbd-5731-4ea0-a20f-81d5a57df44a/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6312bbd-5731-4ea0-a20f-81d5a57df44a/containers/olm-operator/b03f9724 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6312bbd-5731-4ea0-a20f-81d5a57df44a/containers/olm-operator/e3d105cc not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/b6312bbd-5731-4ea0-a20f-81d5a57df44a/containers/olm-operator/3aed4d83 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.1906041176 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.1906041176/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/containers/kube-storage-version-migrator-operator/0765fa6e not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/containers/kube-storage-version-migrator-operator/2cefc627 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/containers/kube-storage-version-migrator-operator/3dcc6345 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/containers/kube-storage-version-migrator-operator/365af391 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates/featureGate-SelfManagedHA-Default.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates/featureGate-SelfManagedHA-TechPreviewNoUpgrade.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates/featureGate-SelfManagedHA-DevPreviewNoUpgrade.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates/featureGate-Hypershift-TechPreviewNoUpgrade.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates/featureGate-Hypershift-DevPreviewNoUpgrade.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes/kubernetes.io~empty-dir/available-featuregates/featureGate-Hypershift-Default.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-api/b1130c0f not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-api/236a5913 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-api/b9432e26 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-config-operator/5ddb0e3f not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-config-operator/986dc4fd not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-config-operator/8a23ff9a not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-config-operator/9728ae68 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/containers/openshift-config-operator/665f31d0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c12 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.1255385357 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.1255385357/operator-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/config/operator-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/service-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/service-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/service-ca-bundle/..2025_02_23_05_23_57.573792656 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/service-ca-bundle/..2025_02_23_05_23_57.573792656/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/service-ca-bundle/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/trusted-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_23_05_22_30.3254245399 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_23_05_22_30.3254245399/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/trusted-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes/kubernetes.io~configmap/trusted-ca-bundle/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/containers/authentication-operator/136c9b42 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/containers/authentication-operator/98a1575b not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/containers/authentication-operator/cac69136 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/containers/authentication-operator/5deb77a7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/containers/authentication-operator/2ae53400 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.3608339744 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.3608339744/operator-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/volumes/kubernetes.io~configmap/config/operator-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/containers/service-ca-operator/e46f2326 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/containers/service-ca-operator/dc688d3c not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/containers/service-ca-operator/3497c3cd not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/containers/service-ca-operator/177eb008 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.3819292994 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.3819292994/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/containers/openshift-apiserver-operator/af5a2afa not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/containers/openshift-apiserver-operator/d780cb1f not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/containers/openshift-apiserver-operator/49b0f374 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/containers/openshift-apiserver-operator/26fbb125 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/volumes/kubernetes.io~configmap/trusted-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_23_05_22_30.3244779536 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_23_05_22_30.3244779536/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/volumes/kubernetes.io~configmap/trusted-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/volumes/kubernetes.io~configmap/trusted-ca/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/cf14125a not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/b7f86972 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/e51d739c not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/88ba6a69 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/669a9acf not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/5cd51231 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/75349ec7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/15c26839 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/45023dcd not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/ingress-operator/2bb66a50 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/kube-rbac-proxy/64d03bdd not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/kube-rbac-proxy/ab8e7ca0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/containers/kube-rbac-proxy/bb9be25f not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c11 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/volumes/kubernetes.io~configmap/trusted-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_23_05_22_30.2034221258 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_23_05_22_30.2034221258/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/volumes/kubernetes.io~configmap/trusted-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/volumes/kubernetes.io~configmap/trusted-ca/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/containers/cluster-image-registry-operator/9a0b61d3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/containers/cluster-image-registry-operator/d471b9d2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/containers/cluster-image-registry-operator/8cb76b8e not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9/containers/catalog-operator/11a00840 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9/containers/catalog-operator/ec355a92 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9/containers/catalog-operator/992f735e not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.1782968797 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/volumes/kubernetes.io~configmap/config/..2025_02_23_05_22_30.1782968797/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/containers/openshift-controller-manager-operator/d59cdbbc not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/containers/openshift-controller-manager-operator/72133ff0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/containers/openshift-controller-manager-operator/c56c834c not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/containers/openshift-controller-manager-operator/d13724c7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/containers/openshift-controller-manager-operator/0a498258 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c14 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe579f8-e8a6-4643-bce5-a661393c4dde/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe579f8-e8a6-4643-bce5-a661393c4dde/containers/machine-config-server/fa471982 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe579f8-e8a6-4643-bce5-a661393c4dde/containers/machine-config-server/fc900d92 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/5fe579f8-e8a6-4643-bce5-a661393c4dde/containers/machine-config-server/fa7d68da not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/containers/migrator/4bacf9b4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/containers/migrator/424021b1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/containers/migrator/fc2e31a3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/containers/graceful-termination/f51eefac not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/containers/graceful-termination/c8997f2f not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/containers/graceful-termination/7481f599 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/volumes/kubernetes.io~configmap/signing-cabundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/volumes/kubernetes.io~configmap/signing-cabundle/..2025_02_23_05_22_49.2255460704 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/volumes/kubernetes.io~configmap/signing-cabundle/..2025_02_23_05_22_49.2255460704/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/volumes/kubernetes.io~configmap/signing-cabundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/volumes/kubernetes.io~configmap/signing-cabundle/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/containers/service-ca-controller/fdafea19 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/containers/service-ca-controller/d0e1c571 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/containers/service-ca-controller/ee398915 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/containers/service-ca-controller/682bb6b8 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c22 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/setup/a3e67855 not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/setup/a989f289 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/setup/915431bd not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-ensure-env-vars/7796fdab not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-ensure-env-vars/dcdb5f19 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-ensure-env-vars/a3aaa88c not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-resources-copy/5508e3e6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-resources-copy/160585de not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-resources-copy/e99f8da3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcdctl/8bc85570 not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcdctl/a5861c91 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcdctl/84db1135 not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd/9e1a6043 not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd/c1aba1c2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd/d55ccd6d not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-metrics/971cc9f6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-metrics/8f2e3dcf not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-metrics/ceb35e9c not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-readyz/1c192745 not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-readyz/5209e501 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-readyz/f83de4df not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-rev/e7b978ac not reset as customized by admin to system_u:object_r:container_file_t:s0:c294,c884 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-rev/c64304a1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c1016 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/2139d3e2895fc6797b9c76a1b4c9886d/containers/etcd-rev/5384386b not reset as customized by admin to system_u:object_r:container_file_t:s0:c666,c920 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/efdd0498-1daa-4136-9a4a-3b948c2293fc/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c268,c620 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/efdd0498-1daa-4136-9a4a-3b948c2293fc/containers/multus-admission-controller/cce3e3ff not reset as customized by admin to system_u:object_r:container_file_t:s0:c435,c756 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/efdd0498-1daa-4136-9a4a-3b948c2293fc/containers/multus-admission-controller/8fb75465 not reset as customized by admin to system_u:object_r:container_file_t:s0:c268,c620 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/efdd0498-1daa-4136-9a4a-3b948c2293fc/containers/kube-rbac-proxy/740f573e not reset as customized by admin to system_u:object_r:container_file_t:s0:c435,c756 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/efdd0498-1daa-4136-9a4a-3b948c2293fc/containers/kube-rbac-proxy/32fd1134 not reset as customized by admin to system_u:object_r:container_file_t:s0:c268,c620 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/20b0d48f-5fd6-431c-a545-e3c800c7b866/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/20b0d48f-5fd6-431c-a545-e3c800c7b866/containers/serve-healthcheck-canary/0a861bd3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/20b0d48f-5fd6-431c-a545-e3c800c7b866/containers/serve-healthcheck-canary/80363026 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/20b0d48f-5fd6-431c-a545-e3c800c7b866/containers/serve-healthcheck-canary/bfa952a8 not reset as customized by admin to system_u:object_r:container_file_t:s0:c19,c24 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/auth-proxy-config not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/auth-proxy-config/..2025_02_23_05_33_31.2122464563 not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/auth-proxy-config/..2025_02_23_05_33_31.2122464563/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/auth-proxy-config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/auth-proxy-config/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/config/..2025_02_23_05_33_31.333075221 not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/kube-rbac-proxy/793bf43d not reset as customized by admin to system_u:object_r:container_file_t:s0:c381,c387 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/kube-rbac-proxy/7db1bb6e not reset as customized by admin to system_u:object_r:container_file_t:s0:c142,c438 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/kube-rbac-proxy/4f6a0368 not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/machine-approver-controller/c12c7d86 not reset as customized by admin to system_u:object_r:container_file_t:s0:c381,c387 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/machine-approver-controller/36c4a773 not reset as customized by admin to system_u:object_r:container_file_t:s0:c142,c438 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/machine-approver-controller/4c1e98ae not reset as customized by admin to system_u:object_r:container_file_t:s0:c142,c438 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/containers/machine-approver-controller/a4c8115c not reset as customized by admin to system_u:object_r:container_file_t:s0:c129,c158 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/containers/setup/7db1802e not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/containers/kube-apiserver/a008a7ab not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/containers/kube-apiserver-cert-syncer/2c836bac not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/containers/kube-apiserver-cert-regeneration-controller/0ce62299 not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/containers/kube-apiserver-insecure-readyz/945d2457 not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/f4b27818a5e8e43d0dc095d08835c792/containers/kube-apiserver-check-endpoints/7d5c1dd8 not reset as customized by admin to system_u:object_r:container_file_t:s0:c97,c980 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/utilities not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/utilities/copy-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/3scale-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/3scale-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/advanced-cluster-management not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/advanced-cluster-management/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-broker-rhel8 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-broker-rhel8/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-online not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-online/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-streams not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-streams/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-streams-console not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq-streams-console/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq7-interconnect-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amq7-interconnect-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ansible-automation-platform-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ansible-automation-platform-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ansible-cloud-addons-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ansible-cloud-addons-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicast-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicast-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurio-registry-3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurio-registry-3/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/authorino-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/authorino-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aws-load-balancer-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aws-load-balancer-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bamoe-businessautomation-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bamoe-businessautomation-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bamoe-kogito-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bamoe-kogito-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bpfman-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bpfman-operator/index.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/businessautomation-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/businessautomation-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cephcsi-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cephcsi-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cincinnati-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cincinnati-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-kube-descheduler-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-kube-descheduler-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-logging not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-logging/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-observability-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-observability-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/compliance-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/compliance-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/container-security-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/container-security-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/costmanagement-metrics-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/costmanagement-metrics-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cryostat-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cryostat-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datagrid not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datagrid/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/devspaces not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/devspaces/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/devworkspace-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/devworkspace-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dpu-network-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dpu-network-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eap not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eap/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/elasticsearch-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/elasticsearch-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/external-dns-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/external-dns-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fence-agents-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fence-agents-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/file-integrity-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/file-integrity-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fuse-apicurito not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fuse-apicurito/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fuse-console not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fuse-console/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fuse-online not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fuse-online/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/gatekeeper-operator-product not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/gatekeeper-operator-product/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/jaeger-product not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/jaeger-product/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/jws-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/jws-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kernel-module-management not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kernel-module-management/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kernel-module-management-hub not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kernel-module-management-hub/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kiali-ossm not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kiali-ossm/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubevirt-hyperconverged not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubevirt-hyperconverged/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/logic-operator-rhel8 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/logic-operator-rhel8/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/loki-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/loki-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lvms-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lvms-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/machine-deletion-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/machine-deletion-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mcg-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mcg-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mta-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mta-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mtc-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mtc-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mtr-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mtr-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mtv-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mtv-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multicluster-engine not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multicluster-engine/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netobserv-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netobserv-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-healthcheck-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-healthcheck-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-maintenance-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-maintenance-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-observability-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-observability-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ocs-client-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ocs-client-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ocs-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ocs-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-csi-addons-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-csi-addons-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-multicluster-orchestrator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-multicluster-orchestrator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-prometheus-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odf-prometheus-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odr-cluster-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odr-cluster-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odr-hub-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odr-hub-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-cert-manager-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-cert-manager-operator/bundle-v1.15.0.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-cert-manager-operator/channel.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-cert-manager-operator/package.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-custom-metrics-autoscaler-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-custom-metrics-autoscaler-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-gitops-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-gitops-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-pipelines-operator-rh not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-pipelines-operator-rh/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-secondary-scheduler-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-secondary-scheduler-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/opentelemetry-product not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/opentelemetry-product/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/quay-bridge-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/quay-bridge-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/quay-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/quay-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/recipe not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/recipe/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/red-hat-camel-k not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/red-hat-camel-k/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/red-hat-hawtio-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/red-hat-hawtio-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redhat-oadp-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redhat-oadp-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rh-service-binding-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rh-service-binding-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhacs-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhacs-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhbk-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhbk-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhdh not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhdh/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhods-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhods-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhods-prometheus-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhods-prometheus-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhpam-kogito-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhpam-kogito-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhsso-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhsso-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rook-ceph-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rook-ceph-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/run-once-duration-override-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/run-once-duration-override-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sandboxed-containers-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sandboxed-containers-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/security-profiles-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/security-profiles-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/self-node-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/self-node-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/serverless-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/serverless-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/service-registry-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/service-registry-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/servicemeshoperator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/servicemeshoperator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/servicemeshoperator3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/servicemeshoperator3/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/skupper-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/skupper-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/submariner not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/submariner/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tang-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tang-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tempo-product not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tempo-product/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/trustee-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/trustee-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/volsync-product not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/volsync-product/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/web-terminal not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/catalog/web-terminal/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/db.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/index.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/main.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/overflow.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/digest not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/extract-utilities/bc8d0691 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/extract-utilities/6b76097a not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/extract-utilities/34d1af30 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/extract-content/312ba61c not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/extract-content/645d5dd1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/extract-content/16e825f0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:39 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/registry-server/4cf51fc9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/registry-server/2a23d348 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/containers/registry-server/075dbd49 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/..2025_02_24_06_09_13.3521195566 not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/..2025_02_24_06_09_13.3521195566/image-registry.openshift-image-registry.svc..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/..2025_02_24_06_09_13.3521195566/image-registry.openshift-image-registry.svc.cluster.local..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/..2025_02_24_06_09_13.3521195566/default-route-openshift-image-registry.apps-crc.testing not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/default-route-openshift-image-registry.apps-crc.testing not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/image-registry.openshift-image-registry.svc..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes/kubernetes.io~configmap/serviceca/image-registry.openshift-image-registry.svc.cluster.local..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/containers/node-ca/dd585ddd not reset as customized by admin to system_u:object_r:container_file_t:s0:c377,c642 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/containers/node-ca/17ebd0ab not reset as customized by admin to system_u:object_r:container_file_t:s0:c338,c343 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/containers/node-ca/005579f4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c842,c986 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/etcd-serving-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/etcd-serving-ca/..2025_02_23_05_23_11.449897510 not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/etcd-serving-ca/..2025_02_23_05_23_11.449897510/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/etcd-serving-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/etcd-serving-ca/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/trusted-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_23_05_23_11.1287037894 not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/trusted-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/audit-policies not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/audit-policies/..2025_02_23_05_23_11.1301053334 not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/audit-policies/..2025_02_23_05_23_11.1301053334/policy.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/audit-policies/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes/kubernetes.io~configmap/audit-policies/policy.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/containers/fix-audit-permissions/bf5f3b9c not reset as customized by admin to system_u:object_r:container_file_t:s0:c49,c263 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/containers/fix-audit-permissions/af276eb7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c701 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/containers/fix-audit-permissions/ea28e322 not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/containers/oauth-apiserver/692e6683 not reset as customized by admin to system_u:object_r:container_file_t:s0:c49,c263 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/containers/oauth-apiserver/871746a7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c701 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/containers/oauth-apiserver/4eb2e958 not reset as customized by admin to system_u:object_r:container_file_t:s0:c764,c897 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/console-config not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/console-config/..2025_02_24_06_09_06.2875086261 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/console-config/..2025_02_24_06_09_06.2875086261/console-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/console-config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/console-config/console-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/trusted-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_24_06_09_06.286118152 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_24_06_09_06.286118152/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/trusted-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/trusted-ca-bundle/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/oauth-serving-cert not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/oauth-serving-cert/..2025_02_24_06_09_06.3865795478 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/oauth-serving-cert/..2025_02_24_06_09_06.3865795478/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/oauth-serving-cert/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/oauth-serving-cert/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/service-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/service-ca/..2025_02_24_06_09_06.584414814 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/service-ca/..2025_02_24_06_09_06.584414814/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/service-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes/kubernetes.io~configmap/service-ca/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/containers/console/ca9b62da not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/containers/console/0edd6fce not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.2406383837 not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.2406383837/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.2406383837/openshift-controller-manager.client-ca.configmap not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.2406383837/openshift-controller-manager.openshift-global-ca.configmap not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.2406383837/openshift-controller-manager.serving-cert.secret not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/openshift-controller-manager.client-ca.configmap not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/openshift-controller-manager.openshift-global-ca.configmap not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/config/openshift-controller-manager.serving-cert.secret not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/client-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/client-ca/..2025_02_24_06_20_07.1071801880 not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/client-ca/..2025_02_24_06_20_07.1071801880/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/client-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/client-ca/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/proxy-ca-bundles not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/proxy-ca-bundles/..2025_02_24_06_20_07.2494444877 not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/proxy-ca-bundles/..2025_02_24_06_20_07.2494444877/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/proxy-ca-bundles/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes/kubernetes.io~configmap/proxy-ca-bundles/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/containers/controller-manager/89b4555f not reset as customized by admin to system_u:object_r:container_file_t:s0:c14,c22 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/volumes/kubernetes.io~configmap/config-volume not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/volumes/kubernetes.io~configmap/config-volume/..2025_02_23_05_23_22.4071100442 not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/volumes/kubernetes.io~configmap/config-volume/..2025_02_23_05_23_22.4071100442/Corefile not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/volumes/kubernetes.io~configmap/config-volume/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/volumes/kubernetes.io~configmap/config-volume/Corefile not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/containers/dns/655fcd71 not reset as customized by admin to system_u:object_r:container_file_t:s0:c457,c841 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/containers/dns/0d43c002 not reset as customized by admin to system_u:object_r:container_file_t:s0:c55,c1022 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/containers/dns/e68efd17 not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/containers/kube-rbac-proxy/9acf9b65 not reset as customized by admin to system_u:object_r:container_file_t:s0:c457,c841 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/containers/kube-rbac-proxy/5ae3ff11 not reset as customized by admin to system_u:object_r:container_file_t:s0:c55,c1022 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/containers/kube-rbac-proxy/1e59206a not reset as customized by admin to system_u:object_r:container_file_t:s0:c466,c972 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/44663579-783b-4372-86d6-acf235a62d72/containers/dns-node-resolver/27af16d1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c304,c1017 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/44663579-783b-4372-86d6-acf235a62d72/containers/dns-node-resolver/7918e729 not reset as customized by admin to system_u:object_r:container_file_t:s0:c853,c893 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/44663579-783b-4372-86d6-acf235a62d72/containers/dns-node-resolver/5d976d0e not reset as customized by admin to system_u:object_r:container_file_t:s0:c585,c981 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/config/..2025_02_23_05_38_56.1112187283 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/config/..2025_02_23_05_38_56.1112187283/controller-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/config/controller-config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/trusted-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_23_05_38_56.2839772658 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_23_05_38_56.2839772658/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/trusted-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes/kubernetes.io~configmap/trusted-ca/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/containers/console-operator/d7f55cbb not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/containers/console-operator/f0812073 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/containers/console-operator/1a56cbeb not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/containers/console-operator/7fdd437e not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/containers/console-operator/cdfb5652 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c25 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/etcd-serving-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/etcd-serving-ca/..2025_02_24_06_17_29.3844392896 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/etcd-serving-ca/..2025_02_24_06_17_29.3844392896/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/etcd-serving-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/etcd-serving-ca/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/config/..2025_02_24_06_17_29.848549803 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/config/..2025_02_24_06_17_29.848549803/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/audit not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/audit/..2025_02_24_06_17_29.780046231 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/audit/..2025_02_24_06_17_29.780046231/policy.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/audit/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/audit/policy.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/..2025_02_24_06_17_29.2926008347 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/..2025_02_24_06_17_29.2926008347/image-registry.openshift-image-registry.svc..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/..2025_02_24_06_17_29.2926008347/image-registry.openshift-image-registry.svc.cluster.local..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/..2025_02_24_06_17_29.2926008347/default-route-openshift-image-registry.apps-crc.testing not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/image-registry.openshift-image-registry.svc..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/image-registry.openshift-image-registry.svc.cluster.local..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/image-import-ca/default-route-openshift-image-registry.apps-crc.testing not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/trusted-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_24_06_17_29.2729721485 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/trusted-ca-bundle/..2025_02_24_06_17_29.2729721485/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/trusted-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes/kubernetes.io~configmap/trusted-ca-bundle/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/containers/fix-audit-permissions/fb93119e not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/containers/openshift-apiserver/f1e8fc0e not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/containers/openshift-apiserver-check-endpoints/218511f3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c336,c787 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/volumes/kubernetes.io~empty-dir/tmpfs not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/volumes/kubernetes.io~empty-dir/tmpfs/k8s-webhook-server not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/volumes/kubernetes.io~empty-dir/tmpfs/k8s-webhook-server/serving-certs not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/containers/packageserver/ca8af7b3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/containers/packageserver/72cc8a75 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/containers/packageserver/6e8a3760 not reset as customized by admin to system_u:object_r:container_file_t:s0:c12,c18 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/volumes/kubernetes.io~configmap/service-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/volumes/kubernetes.io~configmap/service-ca/..2025_02_23_05_27_30.557428972 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/volumes/kubernetes.io~configmap/service-ca/..2025_02_23_05_27_30.557428972/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/volumes/kubernetes.io~configmap/service-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/volumes/kubernetes.io~configmap/service-ca/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/containers/cluster-version-operator/4c3455c0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/containers/cluster-version-operator/2278acb0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/containers/cluster-version-operator/4b453e4f not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/containers/cluster-version-operator/3ec09bda not reset as customized by admin to system_u:object_r:container_file_t:s0:c5,c6 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/trusted-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_24_06_25_03.422633132 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_24_06_25_03.422633132/anchors not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/trusted-ca/..2025_02_24_06_25_03.422633132/anchors/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/trusted-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/trusted-ca/anchors not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/..2025_02_24_06_25_03.3594477318 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/..2025_02_24_06_25_03.3594477318/image-registry.openshift-image-registry.svc..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/..2025_02_24_06_25_03.3594477318/image-registry.openshift-image-registry.svc.cluster.local..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/..2025_02_24_06_25_03.3594477318/default-route-openshift-image-registry.apps-crc.testing not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/image-registry.openshift-image-registry.svc..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/image-registry.openshift-image-registry.svc.cluster.local..5000 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~configmap/registry-certificates/default-route-openshift-image-registry.apps-crc.testing not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/edk2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/edk2/cacerts.bin not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/java not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/java/cacerts not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/openssl not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/openssl/ca-bundle.trust.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/tls-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/email-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/objsign-ca-bundle.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2ae6433e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fde84897.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/75680d2e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/openshift-service-serving-signer_1740288168.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/facfc4fa.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8f5a969c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/CFCA_EV_ROOT.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9ef4a08a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ingress-operator_1740288202.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2f332aed.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/248c8271.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8d10a21f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ACCVRAIZ1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a94d09e5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3c9a4d3b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/40193066.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AC_RAIZ_FNMT-RCM.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cd8c0d63.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b936d1c6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/CA_Disig_Root_R2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4fd49c6c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AC_RAIZ_FNMT-RCM_SERVIDORES_SEGUROS.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b81b93f0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5f9a69fa.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certigna.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b30d5fda.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ANF_Secure_Server_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b433981b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/93851c9e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9282e51c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e7dd1bc4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Actalis_Authentication_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/930ac5d2.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5f47b495.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e113c810.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5931b5bc.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AffirmTrust_Commercial.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2b349938.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e48193cf.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/302904dd.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a716d4ed.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AffirmTrust_Networking.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/93bc0acc.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/86212b19.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certigna_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AffirmTrust_Premium.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b727005e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/dbc54cab.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f51bb24c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c28a8a30.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AffirmTrust_Premium_ECC.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9c8dfbd4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ccc52f49.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cb1c3204.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Amazon_Root_CA_1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ce5e74ef.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fd08c599.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certum_Trusted_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Amazon_Root_CA_2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6d41d539.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fb5fa911.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e35234b1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Amazon_Root_CA_3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8cb5ee0f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7a7c655d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f8fc53da.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Amazon_Root_CA_4.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/de6d66f3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d41b5e2a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/41a3f684.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1df5a75f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Atos_TrustedRoot_2011.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e36a6752.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b872f2b4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9576d26b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/228f89db.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Atos_TrustedRoot_Root_CA_ECC_TLS_2021.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fb717492.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2d21b73c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0b1b94ef.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/595e996b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Atos_TrustedRoot_Root_CA_RSA_TLS_2021.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9b46e03d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/128f4b91.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Buypass_Class_3_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/81f2d2b1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Autoridad_de_Certificacion_Firmaprofesional_CIF_A62634068.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3bde41ac.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d16a5865.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certum_EC-384_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/BJCA_Global_Root_CA1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0179095f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ffa7f1eb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9482e63a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d4dae3dd.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/BJCA_Global_Root_CA2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3e359ba6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7e067d03.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/95aff9e3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d7746a63.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Baltimore_CyberTrust_Root.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/653b494a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3ad48a91.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certum_Trusted_Network_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Buypass_Class_2_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/54657681.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/82223c44.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e8de2f56.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2d9dafe4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d96b65e2.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ee64a828.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/COMODO_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/40547a79.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5a3f0ff8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7a780d93.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/34d996fb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/COMODO_ECC_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/eed8c118.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/89c02a45.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certainly_Root_R1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b1159c4c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/COMODO_RSA_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d6325660.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d4c339cb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8312c4c1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certainly_Root_E1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8508e720.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5fdd185d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/48bec511.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/69105f4f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign.1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0b9bc432.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Certum_Trusted_Network_CA_2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GTS_Root_R3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/32888f65.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/CommScope_Public_Trust_ECC_Root-01.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6b03dec0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/219d9499.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/CommScope_Public_Trust_ECC_Root-02.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5acf816d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cbf06781.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/CommScope_Public_Trust_RSA_Root-01.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GTS_Root_R4.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/dc99f41e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/CommScope_Public_Trust_RSA_Root-02.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign.3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/AAA_Certificate_Services.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/985c1f52.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8794b4e3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/D-TRUST_BR_Root_CA_1_2020.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e7c037b4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ef954a4e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/D-TRUST_EV_Root_CA_1_2020.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2add47b6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/90c5a3c8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/D-TRUST_Root_Class_3_CA_2_2009.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b0f3e76e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/53a1b57a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/D-TRUST_Root_Class_3_CA_2_EV_2009.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Assured_ID_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5ad8a5d6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/68dd7389.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Assured_ID_Root_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9d04f354.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8d6437c3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/062cdee6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/bd43e1dd.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Assured_ID_Root_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7f3d5d1d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c491639e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign_Root_E46.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Global_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3513523f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/399e7759.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/feffd413.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d18e9066.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Global_Root_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/607986c7.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c90bc37d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1b0f7e5c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1e08bfd1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Global_Root_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/dd8e9d41.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ed39abd0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a3418fda.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/bc3f2570.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_High_Assurance_EV_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/244b5494.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/81b9768f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign.2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4be590e0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_TLS_ECC_P384_Root_G5.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9846683b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/252252d2.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1e8e7201.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ISRG_Root_X1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_TLS_RSA4096_Root_G5.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d52c538d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c44cc0c0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign_Root_R46.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/DigiCert_Trusted_Root_G4.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/75d1b2ed.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a2c66da8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GTS_Root_R2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ecccd8db.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Entrust.net_Certification_Authority__2048_.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/aee5f10d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3e7271e8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b0e59380.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4c3982f2.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Entrust_Root_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6b99d060.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/bf64f35b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0a775a30.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/002c0b4f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cc450945.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Entrust_Root_Certification_Authority_-_EC1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/106f3e4d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b3fb433b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GlobalSign.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4042bcee.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Entrust_Root_Certification_Authority_-_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/02265526.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/455f1b52.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0d69c7e1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9f727ac7.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Entrust_Root_Certification_Authority_-_G4.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5e98733a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f0cd152c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/dc4d6a89.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6187b673.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/FIRMAPROFESIONAL_CA_ROOT-A_WEB.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ba8887ce.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/068570d1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f081611a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/48a195d8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GDCA_TrustAUTH_R5_ROOT.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0f6fa695.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ab59055e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b92fd57f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GLOBALTRUST_2020.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fa5da96b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1ec40989.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7719f463.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/GTS_Root_R1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1001acf7.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f013ecaf.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/626dceaf.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c559d742.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1d3472b9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9479c8c3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a81e292b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4bfab552.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Go_Daddy_Class_2_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Sectigo_Public_Server_Authentication_Root_E46.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Go_Daddy_Root_Certificate_Authority_-_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e071171e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/57bcb2da.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/HARICA_TLS_ECC_Root_CA_2021.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ab5346f4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5046c355.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/HARICA_TLS_RSA_Root_CA_2021.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/865fbdf9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/da0cfd1d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/85cde254.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Hellenic_Academic_and_Research_Institutions_ECC_RootCA_2015.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cbb3f32b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SecureSign_RootCA11.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Hellenic_Academic_and_Research_Institutions_RootCA_2015.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5860aaa6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/31188b5e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/HiPKI_Root_CA_-_G1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c7f1359b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5f15c80c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Hongkong_Post_Root_CA_3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/09789157.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ISRG_Root_X2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/18856ac4.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1e09d511.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/IdenTrust_Commercial_Root_CA_1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cf701eeb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d06393bb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/IdenTrust_Public_Sector_Root_CA_1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/10531352.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Izenpe.com.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SecureTrust_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b0ed035a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Microsec_e-Szigno_Root_CA_2009.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8160b96c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e8651083.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2c63f966.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Security_Communication_RootCA2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Microsoft_ECC_Root_Certificate_Authority_2017.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8d89cda1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/01419da9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SSL.com_TLS_RSA_Root_CA_2022.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b7a5b843.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Microsoft_RSA_Root_Certificate_Authority_2017.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/bf53fb88.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9591a472.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3afde786.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SwissSign_Gold_CA_-_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/NAVER_Global_Root_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3fb36b73.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d39b0a2c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a89d74c2.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/cd58d51e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b7db1890.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/NetLock_Arany__Class_Gold__F__tan__s__tv__ny.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/988a38cb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/60afe812.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f39fc864.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5443e9e3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/OISTE_WISeKey_Global_Root_GB_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e73d606e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/dfc0fe80.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b66938e9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1e1eab7c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/OISTE_WISeKey_Global_Root_GC_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/773e07ad.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3c899c73.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d59297b8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ddcda989.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/QuoVadis_Root_CA_1_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/749e9e03.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/52b525c7.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Security_Communication_RootCA3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/QuoVadis_Root_CA_2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d7e8dc79.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7a819ef2.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/08063a00.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6b483515.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/QuoVadis_Root_CA_2_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/064e0aa9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1f58a078.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6f7454b3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7fa05551.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/QuoVadis_Root_CA_3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/76faf6c0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9339512a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f387163d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ee37c333.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/QuoVadis_Root_CA_3_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e18bfb83.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e442e424.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fe8a2cd8.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/23f4c490.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5cd81ad7.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SSL.com_EV_Root_Certification_Authority_ECC.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f0c70a8d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7892ad52.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SZAFIR_ROOT_CA2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4f316efb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SSL.com_EV_Root_Certification_Authority_RSA_R2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/06dc52d5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/583d0756.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Sectigo_Public_Server_Authentication_Root_R46.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SSL.com_Root_Certification_Authority_ECC.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0bf05006.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/88950faa.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9046744a.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/3c860d51.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SSL.com_Root_Certification_Authority_RSA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/6fa5da56.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/33ee480d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Secure_Global_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/63a2c897.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SSL.com_TLS_ECC_Root_CA_2022.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/bdacca6f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ff34af3f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/dbff3a01.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Security_Communication_ECC_RootCA1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/emSign_Root_CA_-_C1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Starfield_Class_2_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/406c9bb1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Starfield_Root_Certificate_Authority_-_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/emSign_ECC_Root_CA_-_C3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Starfield_Services_Root_Certificate_Authority_-_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/SwissSign_Silver_CA_-_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/99e1b953.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/T-TeleSec_GlobalRoot_Class_2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/vTrus_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/T-TeleSec_GlobalRoot_Class_3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/14bc7599.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TUBITAK_Kamu_SM_SSL_Kok_Sertifikasi_-_Surum_1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TWCA_Global_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/7a3adc42.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TWCA_Root_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f459871d.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Telekom_Security_TLS_ECC_Root_2020.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/emSign_Root_CA_-_G1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Telekom_Security_TLS_RSA_Root_2023.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TeliaSonera_Root_CA_v1.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Telia_Root_CA_v2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8f103249.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f058632f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ca-certificates.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TrustAsia_Global_Root_CA_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9bf03295.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/98aaf404.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TrustAsia_Global_Root_CA_G4.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1cef98f5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/073bfcc5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/2923b3f9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Trustwave_Global_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f249de83.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/edcbddb5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/emSign_ECC_Root_CA_-_G3.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Trustwave_Global_ECC_P256_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9b5697b0.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/1ae85e5e.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/b74d2bd5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/Trustwave_Global_ECC_P384_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/d887a5bb.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9aef356c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/TunTrust_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fd64f3fc.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e13665f9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/UCA_Extended_Validation_Root.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/0f5dc4f3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/da7377f6.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/UCA_Global_G2_Root.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/c01eb047.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/304d27c3.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ed858448.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/USERTrust_ECC_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/f30dd6ad.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/04f60c28.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/vTrus_ECC_Root_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/USERTrust_RSA_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/fc5a8f99.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/35105088.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ee532fd5.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/XRamp_Global_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/706f604c.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/76579174.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/certSIGN_ROOT_CA.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/8d86cdd1.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/882de061.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/certSIGN_ROOT_CA_G2.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/5f618aec.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/a9d40e02.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e-Szigno_Root_CA_2017.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/e868b802.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/83e9984f.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ePKI_Root_Certification_Authority.pem not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/ca6e4ad9.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/9d6523ce.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/4b718d9b.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes/kubernetes.io~empty-dir/ca-trust-extracted/pem/directory-hash/869fbf79.0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/containers/registry/f8d22bdb not reset as customized by admin to system_u:object_r:container_file_t:s0:c10,c16 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/containers/cluster-samples-operator/6e8bbfac not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/containers/cluster-samples-operator/54dd7996 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/containers/cluster-samples-operator/a4f1bb05 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/containers/cluster-samples-operator-watch/207129da not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/containers/cluster-samples-operator-watch/c1df39e1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/containers/cluster-samples-operator-watch/15b8f1cd not reset as customized by admin to system_u:object_r:container_file_t:s0:c9,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/config/..2025_02_23_05_27_49.3523263858 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/config/..2025_02_23_05_27_49.3523263858/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/config/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/images not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/images/..2025_02_23_05_27_49.3256605594 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/images/..2025_02_23_05_27_49.3256605594/images.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/images/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes/kubernetes.io~configmap/images/images.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/containers/kube-rbac-proxy/77bd6913 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/containers/kube-rbac-proxy/2382c1b1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/containers/kube-rbac-proxy/704ce128 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/containers/machine-api-operator/70d16fe0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/containers/machine-api-operator/bfb95535 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/containers/machine-api-operator/57a8e8e2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c0,c15 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/volumes/kubernetes.io~configmap/config/..2025_02_23_05_27_49.3413793711 not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/volumes/kubernetes.io~configmap/config/..2025_02_23_05_27_49.3413793711/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/containers/kube-apiserver-operator/1b9d3e5e not reset as customized by admin to system_u:object_r:container_file_t:s0:c107,c917 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/containers/kube-apiserver-operator/fddb173c not reset as customized by admin to system_u:object_r:container_file_t:s0:c202,c983 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/containers/kube-apiserver-operator/95d3c6c4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c219,c404 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d751cbb-f2e2-430d-9754-c882a5e924a5/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d751cbb-f2e2-430d-9754-c882a5e924a5/containers/check-endpoints/bfb5fff5 not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d751cbb-f2e2-430d-9754-c882a5e924a5/containers/check-endpoints/2aef40aa not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/9d751cbb-f2e2-430d-9754-c882a5e924a5/containers/check-endpoints/c0391cad not reset as customized by admin to system_u:object_r:container_file_t:s0:c20,c21 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c214,c928 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager/1119e69d not reset as customized by admin to system_u:object_r:container_file_t:s0:c776,c1007 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager/660608b4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c214,c928 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager/8220bd53 not reset as customized by admin to system_u:object_r:container_file_t:s0:c214,c928 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/cluster-policy-controller/85f99d5c not reset as customized by admin to system_u:object_r:container_file_t:s0:c776,c1007 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/cluster-policy-controller/4b0225f6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c214,c928 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager-cert-syncer/9c2a3394 not reset as customized by admin to system_u:object_r:container_file_t:s0:c776,c1007 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager-cert-syncer/e820b243 not reset as customized by admin to system_u:object_r:container_file_t:s0:c214,c928 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager-recovery-controller/1ca52ea0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c776,c1007 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/f614b9022728cf315e60c057852e563e/containers/kube-controller-manager-recovery-controller/e6988e45 not reset as customized by admin to system_u:object_r:container_file_t:s0:c214,c928 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/volumes/kubernetes.io~configmap/mcc-auth-proxy-config not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/volumes/kubernetes.io~configmap/mcc-auth-proxy-config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/volumes/kubernetes.io~configmap/mcc-auth-proxy-config/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/volumes/kubernetes.io~configmap/mcc-auth-proxy-config/..2025_02_24_06_09_21.2517297950 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/volumes/kubernetes.io~configmap/mcc-auth-proxy-config/..2025_02_24_06_09_21.2517297950/config-file.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/containers/machine-config-controller/6655f00b not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/containers/machine-config-controller/98bc3986 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/containers/machine-config-controller/08e3458a not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/containers/kube-rbac-proxy/2a191cb0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/containers/kube-rbac-proxy/6c4eeefb not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/containers/kube-rbac-proxy/f61a549c not reset as customized by admin to system_u:object_r:container_file_t:s0:c4,c17 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c318,c553 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/containers/hostpath-provisioner/24891863 not reset as customized by admin to system_u:object_r:container_file_t:s0:c37,c572 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/containers/hostpath-provisioner/fbdfd89c not reset as customized by admin to system_u:object_r:container_file_t:s0:c318,c553 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/containers/liveness-probe/9b63b3bc not reset as customized by admin to system_u:object_r:container_file_t:s0:c37,c572 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/containers/liveness-probe/8acde6d6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c318,c553 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/containers/node-driver-registrar/59ecbba3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c318,c553 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/containers/csi-provisioner/685d4be3 not reset as customized by admin to system_u:object_r:container_file_t:s0:c318,c553 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.341639300 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.341639300/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.341639300/openshift-route-controller-manager.client-ca.configmap not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/..2025_02_24_06_20_07.341639300/openshift-route-controller-manager.serving-cert.secret not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/config.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/openshift-route-controller-manager.client-ca.configmap not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/config/openshift-route-controller-manager.serving-cert.secret not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/client-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/client-ca/..2025_02_24_06_20_07.2950937851 not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/client-ca/..2025_02_24_06_20_07.2950937851/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/client-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes/kubernetes.io~configmap/client-ca/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/containers/route-controller-manager/feaea55e not reset as customized by admin to system_u:object_r:container_file_t:s0:c2,c23 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/abinitio-runtime-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/abinitio-runtime-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/accuknox-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/accuknox-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aci-containers-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aci-containers-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aikit-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aikit-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/airlock-microgateway not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/airlock-microgateway/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ako-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ako-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/alloy not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/alloy/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anchore-engine not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anchore-engine/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzo-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzo-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzograph-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzograph-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzounstructured-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzounstructured-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/appdynamics-cloud-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/appdynamics-cloud-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/appdynamics-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/appdynamics-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aqua-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aqua-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cass-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cass-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ccm-node-agent-dcap-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ccm-node-agent-dcap-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ccm-node-agent-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ccm-node-agent-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cfm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cfm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cilium not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cilium/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cilium-enterprise not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cilium-enterprise/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloud-native-postgresql not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloud-native-postgresql/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudbees-ci not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudbees-ci/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudera-streams-messaging-kubernetes-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudera-streams-messaging-kubernetes-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudnative-pg not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudnative-pg/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cnfv-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cnfv-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cockroachdb-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cockroachdb-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/conjur-follower-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/conjur-follower-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/coroot-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/coroot-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/crunchy-postgres-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/crunchy-postgres-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cte-k8s-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cte-k8s-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datadog-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datadog-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dell-csm-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dell-csm-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/digitalai-deploy-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/digitalai-deploy-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/digitalai-release-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/digitalai-release-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dynatrace-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dynatrace-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/edb-hcp-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/edb-hcp-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eginnovations-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eginnovations-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/elasticsearch-eck-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/elasticsearch-eck-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/falcon-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/falcon-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/federatorai-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/federatorai-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fujitsu-enterprise-postgres-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fujitsu-enterprise-postgres-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/function-mesh not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/function-mesh/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/harness-gitops-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/harness-gitops-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hazelcast-platform-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hazelcast-platform-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hcp-terraform-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hcp-terraform-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hpe-ezmeral-csi-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hpe-ezmeral-csi-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-application-gateway-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-application-gateway-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-block-csi-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-block-csi-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-access-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-access-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-directory-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-directory-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infoscale-dr-manager not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infoscale-dr-manager/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infoscale-licensing-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infoscale-licensing-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infoscale-sds-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infoscale-sds-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infrastructure-asset-orchestrator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infrastructure-asset-orchestrator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/instana-agent-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/instana-agent-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/intel-device-plugins-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/intel-device-plugins-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/intel-kubernetes-power-manager not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/intel-kubernetes-power-manager/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/iomesh-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/iomesh-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx8-openshift-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx8-openshift-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx8-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx8-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k8s-triliovault not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k8s-triliovault/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-ati-updates not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-ati-updates/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-framework not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-framework/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-ingress not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-ingress/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-licensing not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-licensing/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-sso not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-kcos-sso/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-keycloak-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-keycloak-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-load-core not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-load-core/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-loadcore-agents not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-loadcore-agents/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-nats-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-nats-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-nimbusmosaic-dusim not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-nimbusmosaic-dusim/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-rest-api-browser-v1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-rest-api-browser-v1/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-appsec not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-appsec/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-core not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-core/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-db not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-db/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-diagnostics not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-diagnostics/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-logging not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-logging/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-migration not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-migration/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-msg-broker not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-msg-broker/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-notifications not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-notifications/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-stats-dashboards not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-stats-dashboards/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-storage not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-storage/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-test-core not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-test-core/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-ui not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-wap-ui/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-websocket-service not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keysight-websocket-service/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kong-gateway-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kong-gateway-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubearmor-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubearmor-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubecost-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubecost-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubemq-operator-marketplace not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubemq-operator-marketplace/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubeturbo-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubeturbo-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lenovo-locd-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lenovo-locd-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/marketplace-games-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/marketplace-games-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/memcached-operator-ogaye not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/memcached-operator-ogaye/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/memory-machine-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/memory-machine-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/model-builder-for-vision-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/model-builder-for-vision-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-atlas-kubernetes not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-atlas-kubernetes/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-enterprise not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-enterprise/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netapp-spark-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netapp-spark-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netscaler-adm-agent-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netscaler-adm-agent-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netscaler-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netscaler-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/neuvector-certified-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/neuvector-certified-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nexus-repository-ha-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nexus-repository-ha-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nginx-ingress-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nginx-ingress-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pcc-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pcc-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nim-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nim-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nxiq-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nxiq-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nxrm-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nxrm-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odigos-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odigos-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/open-liberty-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/open-liberty-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshiftartifactoryha-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshiftartifactoryha-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshiftxray-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshiftxray-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/operator-certification-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/operator-certification-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ovms-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ovms-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pachyderm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pachyderm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pmem-csi-operator-os not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pmem-csi-operator-os/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/portworx-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/portworx-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometurbo-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometurbo-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pubsubplus-eventbroker-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pubsubplus-eventbroker-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redis-enterprise-operator-cert not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redis-enterprise-operator-cert/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/runtime-component-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/runtime-component-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/runtime-fabric-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/runtime-fabric-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sanstoragecsi-operator-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sanstoragecsi-operator-bundle/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/silicom-sts-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/silicom-sts-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/smilecdr-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/smilecdr-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sriov-fec not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sriov-fec/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stackable-commons-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stackable-commons-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stackable-zookeeper-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stackable-zookeeper-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c-tsc-client-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c-tsc-client-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tawon-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tawon-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tigera-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tigera-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/timemachine-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/timemachine-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vault-secrets-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vault-secrets-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vcp-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vcp-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/webotx-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/webotx-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/xcrypt-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/xcrypt-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/zabbix-operator-certified not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/catalog/zabbix-operator-certified/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/db.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/index.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/main.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/overflow.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/digest not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/utilities not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes/kubernetes.io~empty-dir/utilities/copy-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/extract-utilities/63709497 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/extract-utilities/d966b7fd not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/extract-utilities/f5773757 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/extract-content/81c9edb9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/extract-content/57bf57ee not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/extract-content/86f5e6aa not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/registry-server/0aabe31d not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/registry-server/d2af85c2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/containers/registry-server/09d157d9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/db.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/index.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/main.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/overflow.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/digest not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/3scale-community-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/3scale-community-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-acm-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-acm-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-acmpca-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-acmpca-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-apigateway-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-apigateway-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-apigatewayv2-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-apigatewayv2-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-applicationautoscaling-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-applicationautoscaling-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-athena-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-athena-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudfront-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudfront-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudtrail-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudtrail-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudwatch-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudwatch-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudwatchlogs-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-cloudwatchlogs-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-documentdb-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-documentdb-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-dynamodb-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-dynamodb-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ec2-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ec2-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ecr-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ecr-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ecs-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ecs-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-efs-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-efs-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-eks-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-eks-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-elasticache-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-elasticache-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-elbv2-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-elbv2-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-emrcontainers-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-emrcontainers-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-eventbridge-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-eventbridge-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-iam-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-iam-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-kafka-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-kafka-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-keyspaces-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-keyspaces-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-kinesis-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-kinesis-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-kms-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-kms-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-lambda-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-lambda-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-memorydb-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-memorydb-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-mq-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-mq-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-networkfirewall-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-networkfirewall-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-opensearchservice-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-opensearchservice-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-organizations-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-organizations-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-pipes-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-pipes-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-prometheusservice-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-prometheusservice-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-rds-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-rds-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-recyclebin-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-recyclebin-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-route53-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-route53-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-route53resolver-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-route53resolver-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-s3-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-s3-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sagemaker-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sagemaker-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-secretsmanager-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-secretsmanager-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ses-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ses-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sfn-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sfn-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sns-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sns-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sqs-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-sqs-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ssm-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-ssm-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-wafv2-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ack-wafv2-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aerospike-kubernetes-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aerospike-kubernetes-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/airflow-helm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/airflow-helm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/alloydb-omni-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/alloydb-omni-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/alvearie-imaging-ingestion not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/alvearie-imaging-ingestion/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amd-gpu-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/amd-gpu-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/analytics-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/analytics-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/annotationlab not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/annotationlab/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicast-community-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicast-community-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurio-api-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurio-api-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurio-registry not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurio-registry/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurito not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apicurito/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apimatic-kubernetes-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/apimatic-kubernetes-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/application-services-metering-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/application-services-metering-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aqua not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aqua/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/argocd-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/argocd-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/assisted-service-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/assisted-service-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/authorino-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/authorino-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/automotive-infra not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/automotive-infra/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aws-efs-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aws-efs-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/awss3-operator-registry not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/awss3-operator-registry/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/azure-service-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/azure-service-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/beegfs-csi-driver-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/beegfs-csi-driver-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bpfman-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/bpfman-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/camel-k not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/camel-k/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/camel-karavan-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/camel-karavan-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cass-operator-community not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cass-operator-community/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cert-manager not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cert-manager/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cert-utils-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cert-utils-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-aas-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-aas-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-impairment-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-impairment-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-manager not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cluster-manager/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cockroachdb not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cockroachdb/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/codeflare-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/codeflare-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/community-kubevirt-hyperconverged not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/community-kubevirt-hyperconverged/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/community-trivy-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/community-trivy-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/community-windows-machine-config-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/community-windows-machine-config-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/customized-user-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/customized-user-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cxl-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cxl-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dapr-kubernetes-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dapr-kubernetes-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datadog-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datadog-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datatrucker-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datatrucker-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dbaas-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dbaas-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/debezium-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/debezium-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dell-csm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dell-csm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/deployment-validation-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/deployment-validation-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/devopsinabox not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/devopsinabox/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dns-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dns-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dynatrace-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dynatrace-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eclipse-amlen-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eclipse-amlen-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eclipse-che not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eclipse-che/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ecr-secret-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ecr-secret-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/edp-keycloak-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/edp-keycloak-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eginnovations-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eginnovations-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/egressip-ipam-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/egressip-ipam-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ember-csi-community-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ember-csi-community-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/etcd not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/etcd/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eventing-kogito not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/eventing-kogito/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/external-secrets-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/external-secrets-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/falcon-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/falcon-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fence-agents-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fence-agents-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/flink-kubernetes-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/flink-kubernetes-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/flux not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/flux/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k8gb not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k8gb/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fossul-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/fossul-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/github-arc-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/github-arc-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/gitops-primer not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/gitops-primer/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/gitwebhook-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/gitwebhook-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/global-load-balancer-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/global-load-balancer-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/grafana-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/grafana-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/group-sync-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/group-sync-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hawtio-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hawtio-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hazelcast-platform-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hazelcast-platform-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hedvig-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hedvig-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hive-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hive-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/horreum-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/horreum-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hyperfoil-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/hyperfoil-bundle/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-block-csi-operator-community not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-block-csi-operator-community/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-access-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-security-verify-access-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-spectrum-scale-csi-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibm-spectrum-scale-csi-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibmcloud-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ibmcloud-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infinispan not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/infinispan/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/integrity-shield-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/integrity-shield-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ipfs-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ipfs-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/istio-workspace-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/istio-workspace-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/jaeger not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/jaeger/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kaoto-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kaoto-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keda not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keda/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keepalived-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keepalived-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keycloak-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keycloak-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keycloak-permissions-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/keycloak-permissions-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/klusterlet not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/klusterlet/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kogito-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kogito-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/koku-metrics-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/koku-metrics-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/konveyor-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/konveyor-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/korrel8r not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/korrel8r/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kuadrant-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kuadrant-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kube-green not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kube-green/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubecost not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubecost/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubernetes-imagepuller-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubernetes-imagepuller-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubeturbo not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubeturbo/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/l5-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/l5-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/layer7-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/layer7-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lbconfig-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lbconfig-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lib-bucket-provisioner not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/lib-bucket-provisioner/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/limitador-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/limitador-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/logging-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/logging-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/loki-helm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/loki-helm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/loki-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/loki-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/machine-deletion-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/machine-deletion-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mariadb-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mariadb-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/marin3r not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/marin3r/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mercury-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mercury-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/microcks not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/microcks/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-atlas-kubernetes not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-atlas-kubernetes/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/mongodb-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/move2kube-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/move2kube-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multi-nic-cni-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multi-nic-cni-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multicluster-global-hub-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multicluster-global-hub-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multicluster-operators-subscription not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/multicluster-operators-subscription/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/must-gather-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/must-gather-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/namespace-configuration-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/namespace-configuration-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ncn-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ncn-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ndmspc-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ndmspc-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netobserv-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/netobserv-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/neuvector-community-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/neuvector-community-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nexus-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nexus-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nexus-operator-m88i not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nexus-operator-m88i/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nfs-provisioner-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nfs-provisioner-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nlp-server not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nlp-server/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-discovery-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-discovery-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-healthcheck-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-healthcheck-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-maintenance-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/node-maintenance-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nsm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/nsm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/oadp-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/oadp-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/observability-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/observability-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/oci-ccm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/oci-ccm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ocm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ocm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odoo-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/odoo-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/opendatahub-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/opendatahub-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openebs not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openebs/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-nfd-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-nfd-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-node-upgrade-mutex-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-node-upgrade-mutex-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-qiskit-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/openshift-qiskit-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/opentelemetry-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/opentelemetry-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/patch-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/patch-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/patterns-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/patterns-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pcc-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pcc-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pelorus-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pelorus-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/percona-xtradb-cluster-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/percona-xtradb-cluster-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/portworx-essentials not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/portworx-essentials/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/postgresql not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/postgresql/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/proactive-node-scaling-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/proactive-node-scaling-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/project-quay not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/project-quay/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometheus not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometheus/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometheus-exporter-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometheus-exporter-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometurbo not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/prometurbo/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pubsubplus-eventbroker-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pubsubplus-eventbroker-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pulp-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pulp-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rabbitmq-cluster-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rabbitmq-cluster-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rabbitmq-messaging-topology-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rabbitmq-messaging-topology-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redis-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redis-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/reportportal-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/reportportal-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/resource-locker-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/resource-locker-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhoas-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/rhoas-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ripsaw not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ripsaw/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sailoperator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sailoperator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sap-commerce-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sap-commerce-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sap-data-intelligence-observer-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sap-data-intelligence-observer-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sap-hana-express-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sap-hana-express-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/seldon-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/seldon-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/self-node-remediation not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/self-node-remediation/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/service-binding-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/service-binding-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/shipwright-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/shipwright-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sigstore-helm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sigstore-helm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/silicom-sts-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/silicom-sts-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/skupper-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/skupper-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/snapscheduler not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/snapscheduler/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/snyk-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/snyk-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/socmmd not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/socmmd/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sonar-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sonar-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sosivio not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sosivio/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sonataflow-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sonataflow-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sosreport-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/sosreport-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/spark-helm-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/spark-helm-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/special-resource-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/special-resource-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stolostron not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stolostron/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stolostron-engine not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/stolostron-engine/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/strimzi-kafka-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/strimzi-kafka-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/syndesis not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/syndesis/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tagger not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tagger/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tempo-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tempo-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tf-controller not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tf-controller/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tidb-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/tidb-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/trident-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/trident-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/trustify-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/trustify-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ucs-ci-solutions-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ucs-ci-solutions-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/universal-crossplane not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/universal-crossplane/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/varnish-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/varnish-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vault-config-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vault-config-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/verticadb-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/verticadb-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/volume-expander-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/volume-expander-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/wandb-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/wandb-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/windup-operator not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/windup-operator/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/yaks not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/catalog-content/catalog/yaks/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/utilities not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes/kubernetes.io~empty-dir/utilities/copy-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/extract-utilities/c0fe7256 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/extract-utilities/c30319e4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/extract-utilities/e6b1dd45 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/extract-content/2bb643f0 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/extract-content/920de426 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/extract-content/70fa1e87 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/registry-server/a1c12a2f not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/registry-server/9442e6c7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/containers/registry-server/5b45ec72 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/abot-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/abot-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aerospike-kubernetes-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aerospike-kubernetes-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aikit-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/aikit-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzo-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzo-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzograph-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzograph-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzounstructured-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/anzounstructured-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudbees-ci-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cloudbees-ci-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cockroachdb-certified-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/cockroachdb-certified-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/crunchy-postgres-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/crunchy-postgres-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datadog-operator-certified-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/datadog-operator-certified-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dynatrace-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/dynatrace-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/entando-k8s-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/entando-k8s-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/flux not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/flux/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/instana-agent-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/instana-agent-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/iomesh-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/iomesh-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx8-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/joget-dx8-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k10-kasten-operator-paygo-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k10-kasten-operator-paygo-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k10-kasten-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k10-kasten-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k10-kasten-operator-term-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/k10-kasten-operator-term-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubemq-operator-marketplace-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubemq-operator-marketplace-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubeturbo-certified-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/kubeturbo-certified-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/linstor-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/linstor-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/marketplace-games-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/marketplace-games-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/model-builder-for-vision-certified-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/model-builder-for-vision-certified-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/neuvector-certified-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/neuvector-certified-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ovms-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/ovms-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pachyderm-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/pachyderm-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redis-enterprise-operator-cert-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/redis-enterprise-operator-cert-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/seldon-deploy-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/seldon-deploy-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/starburst-enterprise-helm-operator-paygo-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/starburst-enterprise-helm-operator-paygo-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/starburst-enterprise-helm-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/starburst-enterprise-helm-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c-certified-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/t8c-certified-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/timemachine-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/timemachine-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vfunction-server-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/vfunction-server-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/xcrypt-operator-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/xcrypt-operator-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/yugabyte-platform-operator-bundle-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/yugabyte-platform-operator-bundle-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/zabbix-operator-certified-rhmp not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/catalog/zabbix-operator-certified-rhmp/catalog.json not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/00000-1.psg.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/db.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/index.pmt not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/main.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/db/overflow.pix not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/catalog-content/cache/pogreb.v1/digest not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/utilities not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes/kubernetes.io~empty-dir/utilities/copy-content not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/extract-utilities/3c9f3a59 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/extract-utilities/1091c11b not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/extract-utilities/9a6821c6 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/extract-content/ec0c35e2 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/extract-content/517f37e7 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/extract-content/6214fe78 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/registry-server/ba189c8b not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/registry-server/351e4f31 not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/containers/registry-server/c0f219ff not reset as customized by admin to system_u:object_r:container_file_t:s0:c7,c13 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c247,c522 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/wait-for-host-port/8069f607 not reset as customized by admin to system_u:object_r:container_file_t:s0:c378,c723 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/wait-for-host-port/559c3d82 not reset as customized by admin to system_u:object_r:container_file_t:s0:c133,c223 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/wait-for-host-port/605ad488 not reset as customized by admin to system_u:object_r:container_file_t:s0:c247,c522 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler/148df488 not reset as customized by admin to system_u:object_r:container_file_t:s0:c378,c723 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler/3bf6dcb4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c133,c223 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler/022a2feb not reset as customized by admin to system_u:object_r:container_file_t:s0:c247,c522 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler-cert-syncer/938c3924 not reset as customized by admin to system_u:object_r:container_file_t:s0:c378,c723 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler-cert-syncer/729fe23e not reset as customized by admin to system_u:object_r:container_file_t:s0:c133,c223 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler-cert-syncer/1fd5cbd4 not reset as customized by admin to system_u:object_r:container_file_t:s0:c247,c522 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler-recovery-controller/a96697e1 not reset as customized by admin to system_u:object_r:container_file_t:s0:c378,c723 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler-recovery-controller/e155ddca not reset as customized by admin to system_u:object_r:container_file_t:s0:c133,c223 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/3dcd261975c3d6b9a6ad6367fd4facd3/containers/kube-scheduler-recovery-controller/10dd0e0f not reset as customized by admin to system_u:object_r:container_file_t:s0:c247,c522 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-trusted-ca-bundle not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-trusted-ca-bundle/..2025_02_24_06_09_35.3018472960 not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-trusted-ca-bundle/..2025_02_24_06_09_35.3018472960/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-trusted-ca-bundle/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-trusted-ca-bundle/ca-bundle.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/audit-policies not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/audit-policies/..2025_02_24_06_09_35.4262376737 not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/audit-policies/..2025_02_24_06_09_35.4262376737/audit.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/audit-policies/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/audit-policies/audit.yaml not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-cliconfig not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-cliconfig/..2025_02_24_06_09_35.2630275752 not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-cliconfig/..2025_02_24_06_09_35.2630275752/v4-0-config-system-cliconfig not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-cliconfig/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-cliconfig/v4-0-config-system-cliconfig not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-service-ca not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-service-ca/..2025_02_24_06_09_35.2376963788 not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-service-ca/..2025_02_24_06_09_35.2376963788/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-service-ca/..data not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes/kubernetes.io~configmap/v4-0-config-system-service-ca/service-ca.crt not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/etc-hosts not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/containers/oauth-openshift/6f2c8392 not reset as customized by admin to system_u:object_r:container_file_t:s0:c267,c588 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/containers/oauth-openshift/bd241ad9 not reset as customized by admin to system_u:object_r:container_file_t:s0:c682,c947 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/plugins not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/plugins/csi-hostpath not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/plugins/csi-hostpath/csi.sock not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:40 crc restorecon[4680]: /var/lib/kubelet/plugins/kubernetes.io not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: /var/lib/kubelet/plugins/kubernetes.io/csi not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: /var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: /var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/1f4776af88835e41c12b831b4c9fed40233456d14189815a54dbe7f892fc1983 not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: /var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/1f4776af88835e41c12b831b4c9fed40233456d14189815a54dbe7f892fc1983/globalmount not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: /var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/1f4776af88835e41c12b831b4c9fed40233456d14189815a54dbe7f892fc1983/vol_data.json not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: /var/lib/kubelet/plugins_registry not reset as customized by admin to system_u:object_r:container_file_t:s0 Nov 21 11:50:41 crc restorecon[4680]: Relabeled /var/usrlocal/bin/kubenswrapper from system_u:object_r:bin_t:s0 to system_u:object_r:kubelet_exec_t:s0 Nov 21 11:50:42 crc kubenswrapper[4769]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 21 11:50:42 crc kubenswrapper[4769]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 21 11:50:42 crc kubenswrapper[4769]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 21 11:50:42 crc kubenswrapper[4769]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 21 11:50:42 crc kubenswrapper[4769]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Nov 21 11:50:42 crc kubenswrapper[4769]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.883342 4769 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890871 4769 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890903 4769 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890913 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890923 4769 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890934 4769 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890944 4769 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890954 4769 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890963 4769 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890972 4769 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890980 4769 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890988 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.890997 4769 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891006 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891014 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891037 4769 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891046 4769 feature_gate.go:330] unrecognized feature gate: NewOLM Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891055 4769 feature_gate.go:330] unrecognized feature gate: GatewayAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891063 4769 feature_gate.go:330] unrecognized feature gate: OVNObservability Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891071 4769 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891080 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891088 4769 feature_gate.go:330] unrecognized feature gate: SignatureStores Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891100 4769 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891111 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891121 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891133 4769 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891144 4769 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891155 4769 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891164 4769 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891174 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891185 4769 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891219 4769 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891227 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891238 4769 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891249 4769 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891257 4769 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891266 4769 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891274 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891282 4769 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891290 4769 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891298 4769 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891308 4769 feature_gate.go:330] unrecognized feature gate: Example Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891316 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891324 4769 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891332 4769 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891340 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891349 4769 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891357 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891365 4769 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891373 4769 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891381 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891404 4769 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891412 4769 feature_gate.go:330] unrecognized feature gate: PlatformOperators Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891421 4769 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891429 4769 feature_gate.go:330] unrecognized feature gate: PinnedImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891437 4769 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891445 4769 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891453 4769 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891461 4769 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891469 4769 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891477 4769 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891486 4769 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891495 4769 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891503 4769 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891511 4769 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891519 4769 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891534 4769 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891575 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891586 4769 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891596 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891605 4769 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.891613 4769 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891808 4769 flags.go:64] FLAG: --address="0.0.0.0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891854 4769 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891881 4769 flags.go:64] FLAG: --anonymous-auth="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891897 4769 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891910 4769 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891920 4769 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891933 4769 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891944 4769 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891954 4769 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891964 4769 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891974 4769 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891985 4769 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.891995 4769 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892004 4769 flags.go:64] FLAG: --cgroup-root="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892014 4769 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892038 4769 flags.go:64] FLAG: --client-ca-file="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892048 4769 flags.go:64] FLAG: --cloud-config="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892058 4769 flags.go:64] FLAG: --cloud-provider="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892067 4769 flags.go:64] FLAG: --cluster-dns="[]" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892085 4769 flags.go:64] FLAG: --cluster-domain="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892095 4769 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892106 4769 flags.go:64] FLAG: --config-dir="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892115 4769 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892125 4769 flags.go:64] FLAG: --container-log-max-files="5" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892137 4769 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892148 4769 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892159 4769 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892170 4769 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892179 4769 flags.go:64] FLAG: --contention-profiling="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892240 4769 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892251 4769 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892262 4769 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892271 4769 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892283 4769 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892293 4769 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892303 4769 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892312 4769 flags.go:64] FLAG: --enable-load-reader="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892323 4769 flags.go:64] FLAG: --enable-server="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892332 4769 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892351 4769 flags.go:64] FLAG: --event-burst="100" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892361 4769 flags.go:64] FLAG: --event-qps="50" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892370 4769 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892380 4769 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892390 4769 flags.go:64] FLAG: --eviction-hard="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892401 4769 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892410 4769 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892420 4769 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892430 4769 flags.go:64] FLAG: --eviction-soft="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892440 4769 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892449 4769 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892459 4769 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892481 4769 flags.go:64] FLAG: --experimental-mounter-path="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892492 4769 flags.go:64] FLAG: --fail-cgroupv1="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892501 4769 flags.go:64] FLAG: --fail-swap-on="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892511 4769 flags.go:64] FLAG: --feature-gates="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892522 4769 flags.go:64] FLAG: --file-check-frequency="20s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892532 4769 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892543 4769 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892554 4769 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892564 4769 flags.go:64] FLAG: --healthz-port="10248" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892574 4769 flags.go:64] FLAG: --help="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892584 4769 flags.go:64] FLAG: --hostname-override="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892593 4769 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892603 4769 flags.go:64] FLAG: --http-check-frequency="20s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892613 4769 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892624 4769 flags.go:64] FLAG: --image-credential-provider-config="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892633 4769 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892642 4769 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892652 4769 flags.go:64] FLAG: --image-service-endpoint="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892662 4769 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892671 4769 flags.go:64] FLAG: --kube-api-burst="100" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892681 4769 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892690 4769 flags.go:64] FLAG: --kube-api-qps="50" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892699 4769 flags.go:64] FLAG: --kube-reserved="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892708 4769 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892716 4769 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892725 4769 flags.go:64] FLAG: --kubelet-cgroups="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892734 4769 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892743 4769 flags.go:64] FLAG: --lock-file="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892751 4769 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892760 4769 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892769 4769 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892782 4769 flags.go:64] FLAG: --log-json-split-stream="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892791 4769 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892800 4769 flags.go:64] FLAG: --log-text-split-stream="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892808 4769 flags.go:64] FLAG: --logging-format="text" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892817 4769 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892840 4769 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892849 4769 flags.go:64] FLAG: --manifest-url="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892859 4769 flags.go:64] FLAG: --manifest-url-header="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892871 4769 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892881 4769 flags.go:64] FLAG: --max-open-files="1000000" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892891 4769 flags.go:64] FLAG: --max-pods="110" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892900 4769 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892909 4769 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892918 4769 flags.go:64] FLAG: --memory-manager-policy="None" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892927 4769 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892936 4769 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892944 4769 flags.go:64] FLAG: --node-ip="192.168.126.11" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892954 4769 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892972 4769 flags.go:64] FLAG: --node-status-max-images="50" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892981 4769 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892990 4769 flags.go:64] FLAG: --oom-score-adj="-999" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.892999 4769 flags.go:64] FLAG: --pod-cidr="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893007 4769 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:33549946e22a9ffa738fd94b1345f90921bc8f92fa6137784cb33c77ad806f9d" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893020 4769 flags.go:64] FLAG: --pod-manifest-path="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893029 4769 flags.go:64] FLAG: --pod-max-pids="-1" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893038 4769 flags.go:64] FLAG: --pods-per-core="0" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893046 4769 flags.go:64] FLAG: --port="10250" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893056 4769 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893064 4769 flags.go:64] FLAG: --provider-id="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893073 4769 flags.go:64] FLAG: --qos-reserved="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893082 4769 flags.go:64] FLAG: --read-only-port="10255" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893091 4769 flags.go:64] FLAG: --register-node="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893100 4769 flags.go:64] FLAG: --register-schedulable="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893108 4769 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893122 4769 flags.go:64] FLAG: --registry-burst="10" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893131 4769 flags.go:64] FLAG: --registry-qps="5" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893139 4769 flags.go:64] FLAG: --reserved-cpus="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893147 4769 flags.go:64] FLAG: --reserved-memory="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893158 4769 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893169 4769 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893181 4769 flags.go:64] FLAG: --rotate-certificates="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893240 4769 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893253 4769 flags.go:64] FLAG: --runonce="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893264 4769 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893276 4769 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893287 4769 flags.go:64] FLAG: --seccomp-default="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893297 4769 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893305 4769 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893315 4769 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893324 4769 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893333 4769 flags.go:64] FLAG: --storage-driver-password="root" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893342 4769 flags.go:64] FLAG: --storage-driver-secure="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893351 4769 flags.go:64] FLAG: --storage-driver-table="stats" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893360 4769 flags.go:64] FLAG: --storage-driver-user="root" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893369 4769 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893380 4769 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893391 4769 flags.go:64] FLAG: --system-cgroups="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893402 4769 flags.go:64] FLAG: --system-reserved="cpu=200m,ephemeral-storage=350Mi,memory=350Mi" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893424 4769 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893436 4769 flags.go:64] FLAG: --tls-cert-file="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893451 4769 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893480 4769 flags.go:64] FLAG: --tls-min-version="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893491 4769 flags.go:64] FLAG: --tls-private-key-file="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893502 4769 flags.go:64] FLAG: --topology-manager-policy="none" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893513 4769 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893524 4769 flags.go:64] FLAG: --topology-manager-scope="container" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893535 4769 flags.go:64] FLAG: --v="2" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893549 4769 flags.go:64] FLAG: --version="false" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893562 4769 flags.go:64] FLAG: --vmodule="" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893576 4769 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.893587 4769 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893849 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893866 4769 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893875 4769 feature_gate.go:330] unrecognized feature gate: NewOLM Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893884 4769 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893892 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893904 4769 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893927 4769 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893937 4769 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893946 4769 feature_gate.go:330] unrecognized feature gate: PlatformOperators Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893955 4769 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893965 4769 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893977 4769 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893987 4769 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.893997 4769 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894006 4769 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894014 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894022 4769 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894030 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894037 4769 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894046 4769 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894053 4769 feature_gate.go:330] unrecognized feature gate: PinnedImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894061 4769 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894069 4769 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894076 4769 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894084 4769 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894092 4769 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894099 4769 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894107 4769 feature_gate.go:330] unrecognized feature gate: OVNObservability Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894114 4769 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894122 4769 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894133 4769 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894143 4769 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894153 4769 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894166 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894175 4769 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894184 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894228 4769 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894236 4769 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894243 4769 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894251 4769 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894259 4769 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894266 4769 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894288 4769 feature_gate.go:330] unrecognized feature gate: SignatureStores Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894297 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894304 4769 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894312 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894319 4769 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894327 4769 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894335 4769 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894345 4769 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894354 4769 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894362 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894369 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894377 4769 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894384 4769 feature_gate.go:330] unrecognized feature gate: Example Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894392 4769 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894400 4769 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894408 4769 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894415 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894423 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894431 4769 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894438 4769 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894446 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894453 4769 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894461 4769 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894472 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894479 4769 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894487 4769 feature_gate.go:330] unrecognized feature gate: GatewayAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894495 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894502 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.894510 4769 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.895624 4769 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.912301 4769 server.go:491] "Kubelet version" kubeletVersion="v1.31.5" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.912379 4769 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912538 4769 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912555 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912566 4769 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912575 4769 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912583 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912590 4769 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912599 4769 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912608 4769 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912616 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912625 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912633 4769 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912641 4769 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912650 4769 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912659 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912668 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912679 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912688 4769 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912696 4769 feature_gate.go:330] unrecognized feature gate: Example Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912705 4769 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912713 4769 feature_gate.go:330] unrecognized feature gate: OVNObservability Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912721 4769 feature_gate.go:330] unrecognized feature gate: SignatureStores Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912729 4769 feature_gate.go:330] unrecognized feature gate: PinnedImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912736 4769 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912748 4769 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912759 4769 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912770 4769 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912780 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912789 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912797 4769 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912806 4769 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912814 4769 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912823 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912836 4769 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912850 4769 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912858 4769 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912867 4769 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912876 4769 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912885 4769 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912893 4769 feature_gate.go:330] unrecognized feature gate: GatewayAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912901 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912909 4769 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912916 4769 feature_gate.go:330] unrecognized feature gate: PlatformOperators Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912924 4769 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912932 4769 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912939 4769 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912947 4769 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912955 4769 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912964 4769 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912972 4769 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912981 4769 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912989 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.912997 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913005 4769 feature_gate.go:330] unrecognized feature gate: NewOLM Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913014 4769 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913023 4769 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913031 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913040 4769 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913048 4769 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913056 4769 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913064 4769 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913072 4769 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913083 4769 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913094 4769 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913107 4769 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913117 4769 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913126 4769 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913138 4769 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913147 4769 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913156 4769 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913166 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913174 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.913214 4769 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913469 4769 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913488 4769 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913500 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913510 4769 feature_gate.go:330] unrecognized feature gate: PinnedImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913519 4769 feature_gate.go:330] unrecognized feature gate: OVNObservability Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913527 4769 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913539 4769 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913549 4769 feature_gate.go:330] unrecognized feature gate: GatewayAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913558 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913568 4769 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913578 4769 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913588 4769 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913597 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913605 4769 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913614 4769 feature_gate.go:330] unrecognized feature gate: PlatformOperators Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913623 4769 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913631 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913640 4769 feature_gate.go:330] unrecognized feature gate: NewOLM Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913647 4769 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913655 4769 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913663 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913670 4769 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913679 4769 feature_gate.go:330] unrecognized feature gate: SignatureStores Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913686 4769 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913695 4769 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913702 4769 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913710 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913718 4769 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913726 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913736 4769 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913745 4769 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913754 4769 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913764 4769 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913772 4769 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913780 4769 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913788 4769 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913796 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913804 4769 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913812 4769 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913820 4769 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913828 4769 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913836 4769 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913844 4769 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913853 4769 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913862 4769 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913870 4769 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913878 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfig Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913888 4769 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913896 4769 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913904 4769 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913913 4769 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913921 4769 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913929 4769 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913938 4769 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913945 4769 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913953 4769 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913961 4769 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913968 4769 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913979 4769 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913988 4769 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.913996 4769 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914004 4769 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914011 4769 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914019 4769 feature_gate.go:330] unrecognized feature gate: Example Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914027 4769 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914035 4769 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914043 4769 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914050 4769 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914058 4769 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914066 4769 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Nov 21 11:50:42 crc kubenswrapper[4769]: W1121 11:50:42.914074 4769 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.914087 4769 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.920568 4769 server.go:940] "Client rotation is on, will bootstrap in background" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.928281 4769 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.928497 4769 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.931043 4769 server.go:997] "Starting client certificate rotation" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.931101 4769 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.931310 4769 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2026-02-24 05:52:08 +0000 UTC, rotation deadline is 2025-12-30 08:04:45.79540066 +0000 UTC Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.931463 4769 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 932h14m2.863944689s for next certificate rotation Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.993156 4769 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 21 11:50:42 crc kubenswrapper[4769]: I1121 11:50:42.999240 4769 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.033474 4769 log.go:25] "Validated CRI v1 runtime API" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.093357 4769 log.go:25] "Validated CRI v1 image API" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.095165 4769 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.121321 4769 fs.go:133] Filesystem UUIDs: map[0b076daa-c26a-46d2-b3a6-72a8dbc6e257:/dev/vda4 2025-11-21-11-46-02-00:/dev/sr0 7B77-95E7:/dev/vda2 de0497b0-db1b-465a-b278-03db02455c71:/dev/vda3] Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.121375 4769 fs.go:134] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/user/1000:{mountpoint:/run/user/1000 major:0 minor:41 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} /var/lib/etcd:{mountpoint:/var/lib/etcd major:0 minor:43 fsType:tmpfs blockSize:0}] Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.159530 4769 manager.go:217] Machine: {Timestamp:2025-11-21 11:50:43.152645526 +0000 UTC m=+1.853307454 CPUVendorID:AuthenticAMD NumCores:12 NumPhysicalCores:1 NumSockets:12 CpuFrequency:2800000 MemoryCapacity:33654128640 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:21801e6708c44f15b81395eb736a7cec SystemUUID:cce39ffe-98cc-4d59-a766-47c2111d53dc BootID:df162963-d1b4-4a8f-afa4-e5fb25dbdbde Filesystems:[{Device:/var/lib/etcd DeviceMajor:0 DeviceMinor:43 Capacity:1073741824 Type:vfs Inodes:4108170 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16827064320 Type:vfs Inodes:4108170 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6730825728 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:85292941312 Type:vfs Inodes:41679680 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:16827064320 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/user/1000 DeviceMajor:0 DeviceMinor:41 Capacity:3365412864 Type:vfs Inodes:821634 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:fa:16:3e:75:b5:e9 Speed:0 Mtu:1500} {Name:br-int MacAddress:d6:39:55:2e:22:71 Speed:0 Mtu:1400} {Name:ens3 MacAddress:fa:16:3e:75:b5:e9 Speed:-1 Mtu:1500} {Name:ens7 MacAddress:fa:16:3e:7d:5f:8b Speed:-1 Mtu:1500} {Name:ens7.20 MacAddress:52:54:00:61:7f:78 Speed:-1 Mtu:1496} {Name:ens7.21 MacAddress:52:54:00:e7:f5:0d Speed:-1 Mtu:1496} {Name:ens7.22 MacAddress:52:54:00:8a:48:f0 Speed:-1 Mtu:1496} {Name:eth10 MacAddress:32:03:82:bd:8f:24 Speed:0 Mtu:1500} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:d9:00:02 Speed:0 Mtu:1400} {Name:ovs-system MacAddress:c6:45:2d:2d:6d:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33654128640 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.160025 4769 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.160290 4769 manager.go:233] Version: {KernelVersion:5.14.0-427.50.2.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202502100215-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.161241 4769 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.161545 4769 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.161609 4769 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"crc","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"200m","ephemeral-storage":"350Mi","memory":"350Mi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.161962 4769 topology_manager.go:138] "Creating topology manager with none policy" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.161979 4769 container_manager_linux.go:303] "Creating device plugin manager" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.162690 4769 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.162749 4769 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.163830 4769 state_mem.go:36] "Initialized new in-memory state store" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.163980 4769 server.go:1245] "Using root directory" path="/var/lib/kubelet" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.172856 4769 kubelet.go:418] "Attempting to sync node with API server" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.172892 4769 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.172919 4769 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.172940 4769 kubelet.go:324] "Adding apiserver pod source" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.172960 4769 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 21 11:50:43 crc kubenswrapper[4769]: W1121 11:50:43.179673 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:43 crc kubenswrapper[4769]: W1121 11:50:43.179675 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.179833 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.179842 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.184516 4769 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.5-4.rhaos4.18.gitdad78d5.el9" apiVersion="v1" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.185987 4769 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-server-current.pem". Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.187371 4769 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189401 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189424 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189431 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189437 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189448 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189455 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189462 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189473 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189482 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189491 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189500 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.189508 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.193783 4769 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.194305 4769 server.go:1280] "Started kubelet" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.194592 4769 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.194888 4769 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.196054 4769 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 21 11:50:43 crc systemd[1]: Started Kubernetes Kubelet. Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.198503 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.199785 4769 server.go:460] "Adding debug handlers to kubelet server" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201301 4769 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201347 4769 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201495 4769 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2026-02-24 05:53:03 +0000 UTC, rotation deadline is 2025-11-28 23:17:17.847281228 +0000 UTC Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201553 4769 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 179h26m34.645733012s for next certificate rotation Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.201643 4769 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"crc\" not found" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201763 4769 volume_manager.go:287] "The desired_state_of_world populator starts" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201776 4769 volume_manager.go:289] "Starting Kubelet Volume Manager" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.201928 4769 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 21 11:50:43 crc kubenswrapper[4769]: W1121 11:50:43.202654 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.202733 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.205159 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.227:6443: connect: connection refused" interval="200ms" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.208660 4769 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/default/events\": dial tcp 38.102.83.227:6443: connect: connection refused" event="&Event{ObjectMeta:{crc.187a034f4cc54f0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2025-11-21 11:50:43.194269451 +0000 UTC m=+1.894931269,LastTimestamp:2025-11-21 11:50:43.194269451 +0000 UTC m=+1.894931269,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217045 4769 factory.go:153] Registering CRI-O factory Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217095 4769 factory.go:221] Registration of the crio container factory successfully Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217238 4769 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217254 4769 factory.go:55] Registering systemd factory Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217268 4769 factory.go:221] Registration of the systemd container factory successfully Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217296 4769 factory.go:103] Registering Raw factory Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.217320 4769 manager.go:1196] Started watching for new ooms in manager Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.218776 4769 manager.go:319] Starting recovery of all containers Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229760 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6509e943-70c6-444c-bc41-48a544e36fbd" volumeName="kubernetes.io/secret/6509e943-70c6-444c-bc41-48a544e36fbd-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229849 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" volumeName="kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-catalog-content" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229880 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31d8b7a1-420e-4252-a5b7-eebe8a111292" volumeName="kubernetes.io/secret/31d8b7a1-420e-4252-a5b7-eebe8a111292-proxy-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229902 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" volumeName="kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-webhook-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229923 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="37a5e44f-9a88-4405-be8a-b645485e7312" volumeName="kubernetes.io/projected/37a5e44f-9a88-4405-be8a-b645485e7312-kube-api-access-rdwmf" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229946 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="37a5e44f-9a88-4405-be8a-b645485e7312" volumeName="kubernetes.io/secret/37a5e44f-9a88-4405-be8a-b645485e7312-metrics-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229967 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="925f1c65-6136-48ba-85aa-3a3b50560753" volumeName="kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-ovnkube-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.229989 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09efc573-dbb6-4249-bd59-9b87aba8dd28" volumeName="kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-client" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230016 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bb08738-c794-4ee8-9972-3a62ca171029" volumeName="kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-sysctl-allowlist" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230037 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" volumeName="kubernetes.io/projected/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-kube-api-access-w4xd4" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230057 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fda69060-fa79-4696-b1a6-7980f124bf7c" volumeName="kubernetes.io/projected/fda69060-fa79-4696-b1a6-7980f124bf7c-kube-api-access-xcgwh" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230083 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-session" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230105 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/projected/43509403-f426-496e-be36-56cef71462f5-kube-api-access-qg5z5" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230137 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="44663579-783b-4372-86d6-acf235a62d72" volumeName="kubernetes.io/projected/44663579-783b-4372-86d6-acf235a62d72-kube-api-access-vt5rc" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230183 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-ocp-branding-template" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230280 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bb40260-dbaa-4fb0-84df-5e680505d512" volumeName="kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-cni-binary-copy" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230321 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d4552c7-cd75-42dd-8880-30dd377c49a4" volumeName="kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230382 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0128f3a-b052-44ed-a84e-c4c8aaf17c13" volumeName="kubernetes.io/secret/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-samples-operator-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230414 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d75a4c96-2883-4a0b-bab2-0fab2b6c0b49" volumeName="kubernetes.io/configmap/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-iptables-alerter-script" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230444 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-encryption-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230478 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09efc573-dbb6-4249-bd59-9b87aba8dd28" volumeName="kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230510 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-audit-policies" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230589 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5441d097-087c-4d9a-baa8-b210afa90fc9" volumeName="kubernetes.io/projected/5441d097-087c-4d9a-baa8-b210afa90fc9-kube-api-access-2d4wz" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230614 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bb08738-c794-4ee8-9972-3a62ca171029" volumeName="kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-binary-copy" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230637 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09efc573-dbb6-4249-bd59-9b87aba8dd28" volumeName="kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230660 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6731426b-95fe-49ff-bb5f-40441049fde2" volumeName="kubernetes.io/projected/6731426b-95fe-49ff-bb5f-40441049fde2-kube-api-access-x7zkh" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230684 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a31745f5-9847-4afe-82a5-3161cc66ca93" volumeName="kubernetes.io/secret/a31745f5-9847-4afe-82a5-3161cc66ca93-metrics-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230707 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="25e176fe-21b4-4974-b1ed-c8b94f112a7f" volumeName="kubernetes.io/secret/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-key" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230729 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="22c825df-677d-4ca6-82db-3454ed06e783" volumeName="kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-auth-proxy-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230753 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b88f790-22fa-440e-b583-365168c0b23d" volumeName="kubernetes.io/projected/5b88f790-22fa-440e-b583-365168c0b23d-kube-api-access-jkwtn" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230798 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d4552c7-cd75-42dd-8880-30dd377c49a4" volumeName="kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-trusted-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230818 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" volumeName="kubernetes.io/projected/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-kube-api-access-x4zgh" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230875 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c03ee662-fb2f-4fc4-a2c1-af487c19d254" volumeName="kubernetes.io/projected/c03ee662-fb2f-4fc4-a2c1-af487c19d254-kube-api-access-v47cf" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230901 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-client" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230925 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/projected/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-kube-api-access-zkvpv" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230948 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5225d0e4-402f-4861-b410-819f433b1803" volumeName="kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-catalog-content" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230973 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ea678ab-3438-413e-bfe3-290ae7725660" volumeName="kubernetes.io/secret/6ea678ab-3438-413e-bfe3-290ae7725660-ovn-node-metrics-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.230994 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="925f1c65-6136-48ba-85aa-3a3b50560753" volumeName="kubernetes.io/secret/925f1c65-6136-48ba-85aa-3a3b50560753-ovn-control-plane-metrics-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231034 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-audit-policies" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231467 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5441d097-087c-4d9a-baa8-b210afa90fc9" volumeName="kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231507 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d4552c7-cd75-42dd-8880-30dd377c49a4" volumeName="kubernetes.io/projected/9d4552c7-cd75-42dd-8880-30dd377c49a4-kube-api-access-pcxfs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231531 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d" volumeName="kubernetes.io/projected/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d-kube-api-access-x2m85" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231611 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" volumeName="kubernetes.io/projected/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-kube-api-access-dbsvg" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231634 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-idp-0-file-data" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231661 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="57a731c4-ef35-47a8-b875-bfb08a7f8011" volumeName="kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-catalog-content" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231684 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6402fda4-df10-493c-b4e5-d0569419652d" volumeName="kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231727 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6509e943-70c6-444c-bc41-48a544e36fbd" volumeName="kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231749 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7539238d-5fe0-46ed-884e-1c3b566537ec" volumeName="kubernetes.io/secret/7539238d-5fe0-46ed-884e-1c3b566537ec-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231771 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6cd30de-2eeb-49a2-ab40-9167f4560ff5" volumeName="kubernetes.io/secret/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-operator-metrics" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231876 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" volumeName="kubernetes.io/secret/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231900 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c03ee662-fb2f-4fc4-a2c1-af487c19d254" volumeName="kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-stats-auth" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231926 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="496e6271-fb68-4057-954e-a0d97a4afa3f" volumeName="kubernetes.io/projected/496e6271-fb68-4057-954e-a0d97a4afa3f-kube-api-access" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.231973 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7e6199b-1264-4501-8953-767f51328d08" volumeName="kubernetes.io/secret/e7e6199b-1264-4501-8953-767f51328d08-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232000 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d611f23-29be-4491-8495-bee1670e935f" volumeName="kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-utilities" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232032 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-console-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232055 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/empty-dir/8f668bae-612b-4b75-9490-919e737c6a3b-ca-trust-extracted" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232078 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d4552c7-cd75-42dd-8880-30dd377c49a4" volumeName="kubernetes.io/secret/9d4552c7-cd75-42dd-8880-30dd377c49a4-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232099 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" volumeName="kubernetes.io/empty-dir/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-available-featuregates" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232121 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef543e1b-8068-4ea3-b32a-61027b32e95d" volumeName="kubernetes.io/projected/ef543e1b-8068-4ea3-b32a-61027b32e95d-kube-api-access-s2kz5" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232141 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="efdd0498-1daa-4136-9a4a-3b948c2293fc" volumeName="kubernetes.io/projected/efdd0498-1daa-4136-9a4a-3b948c2293fc-kube-api-access-fqsjt" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232161 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01ab3dd5-8196-46d0-ad33-122e2ca51def" volumeName="kubernetes.io/secret/01ab3dd5-8196-46d0-ad33-122e2ca51def-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232243 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232300 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6509e943-70c6-444c-bc41-48a544e36fbd" volumeName="kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-trusted-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232322 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7bb08738-c794-4ee8-9972-3a62ca171029" volumeName="kubernetes.io/projected/7bb08738-c794-4ee8-9972-3a62ca171029-kube-api-access-279lb" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232343 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a31745f5-9847-4afe-82a5-3161cc66ca93" volumeName="kubernetes.io/configmap/a31745f5-9847-4afe-82a5-3161cc66ca93-trusted-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232376 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7e6199b-1264-4501-8953-767f51328d08" volumeName="kubernetes.io/projected/e7e6199b-1264-4501-8953-767f51328d08-kube-api-access" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232396 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-client" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232416 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31d8b7a1-420e-4252-a5b7-eebe8a111292" volumeName="kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-images" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232439 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b6479f0-333b-4a96-9adf-2099afdc2447" volumeName="kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232485 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232511 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd23aa5c-e532-4e53-bccf-e79f130c5ae8" volumeName="kubernetes.io/projected/bd23aa5c-e532-4e53-bccf-e79f130c5ae8-kube-api-access-jhbk2" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232533 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="25e176fe-21b4-4974-b1ed-c8b94f112a7f" volumeName="kubernetes.io/configmap/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-cabundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232553 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d751cbb-f2e2-430d-9754-c882a5e924a5" volumeName="kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232573 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-registry-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232594 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" volumeName="kubernetes.io/secret/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232614 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31d8b7a1-420e-4252-a5b7-eebe8a111292" volumeName="kubernetes.io/projected/31d8b7a1-420e-4252-a5b7-eebe8a111292-kube-api-access-zgdk5" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232635 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-login" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232655 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-trusted-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232682 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-kube-api-access-kfwg7" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232702 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fda69060-fa79-4696-b1a6-7980f124bf7c" volumeName="kubernetes.io/secret/fda69060-fa79-4696-b1a6-7980f124bf7c-proxy-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232722 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01ab3dd5-8196-46d0-ad33-122e2ca51def" volumeName="kubernetes.io/projected/01ab3dd5-8196-46d0-ad33-122e2ca51def-kube-api-access-w7l8j" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232743 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cb93b32-e0ae-4377-b9c8-fdb9842c6d59" volumeName="kubernetes.io/projected/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-kube-api-access-wxkg8" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232764 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-cliconfig" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232786 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5441d097-087c-4d9a-baa8-b210afa90fc9" volumeName="kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-client-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232807 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="57a731c4-ef35-47a8-b875-bfb08a7f8011" volumeName="kubernetes.io/projected/57a731c4-ef35-47a8-b875-bfb08a7f8011-kube-api-access-cfbct" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232828 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31d8b7a1-420e-4252-a5b7-eebe8a111292" volumeName="kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-auth-proxy-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232858 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1386a44e-36a2-460c-96d0-0359d2b6f0f5" volumeName="kubernetes.io/secret/1386a44e-36a2-460c-96d0-0359d2b6f0f5-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232882 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ea678ab-3438-413e-bfe3-290ae7725660" volumeName="kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-script-lib" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232904 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-registry-certificates" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232923 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-bound-sa-token" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232943 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/secret/8f668bae-612b-4b75-9490-919e737c6a3b-installation-pull-secrets" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232963 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="925f1c65-6136-48ba-85aa-3a3b50560753" volumeName="kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-env-overrides" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.232983 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" volumeName="kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-utilities" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233003 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1386a44e-36a2-460c-96d0-0359d2b6f0f5" volumeName="kubernetes.io/projected/1386a44e-36a2-460c-96d0-0359d2b6f0f5-kube-api-access" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233032 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6cd30de-2eeb-49a2-ab40-9167f4560ff5" volumeName="kubernetes.io/projected/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-kube-api-access-pj782" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233051 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c03ee662-fb2f-4fc4-a2c1-af487c19d254" volumeName="kubernetes.io/configmap/c03ee662-fb2f-4fc4-a2c1-af487c19d254-service-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233071 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6312bbd-5731-4ea0-a20f-81d5a57df44a" volumeName="kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-profile-collector-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233092 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09efc573-dbb6-4249-bd59-9b87aba8dd28" volumeName="kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233112 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1386a44e-36a2-460c-96d0-0359d2b6f0f5" volumeName="kubernetes.io/configmap/1386a44e-36a2-460c-96d0-0359d2b6f0f5-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233133 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d611f23-29be-4491-8495-bee1670e935f" volumeName="kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-catalog-content" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233157 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/projected/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-kube-api-access-ngvvp" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233179 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b88f790-22fa-440e-b583-365168c0b23d" volumeName="kubernetes.io/secret/5b88f790-22fa-440e-b583-365168c0b23d-metrics-certs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233249 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b93a3a-6083-4aea-8eab-fe1aa8245ad9" volumeName="kubernetes.io/secret/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-metrics-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233289 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef543e1b-8068-4ea3-b32a-61027b32e95d" volumeName="kubernetes.io/secret/ef543e1b-8068-4ea3-b32a-61027b32e95d-webhook-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233338 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09efc573-dbb6-4249-bd59-9b87aba8dd28" volumeName="kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-service-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233361 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" volumeName="kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-profile-collector-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233384 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ea678ab-3438-413e-bfe3-290ae7725660" volumeName="kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233411 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7583ce53-e0fe-4a16-9e4d-50516596a136" volumeName="kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-client-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233436 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87cf06ed-a83f-41a7-828d-70653580a8cb" volumeName="kubernetes.io/configmap/87cf06ed-a83f-41a7-828d-70653580a8cb-config-volume" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233457 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fda69060-fa79-4696-b1a6-7980f124bf7c" volumeName="kubernetes.io/configmap/fda69060-fa79-4696-b1a6-7980f124bf7c-mcd-auth-proxy-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233494 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe579f8-e8a6-4643-bce5-a661393c4dde" volumeName="kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-node-bootstrap-token" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233516 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b78653f-4ff9-4508-8672-245ed9b561e3" volumeName="kubernetes.io/configmap/0b78653f-4ff9-4508-8672-245ed9b561e3-service-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233540 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-audit" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233561 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="22c825df-677d-4ca6-82db-3454ed06e783" volumeName="kubernetes.io/projected/22c825df-677d-4ca6-82db-3454ed06e783-kube-api-access-7c4vf" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233580 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" volumeName="kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-apiservice-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233602 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="496e6271-fb68-4057-954e-a0d97a4afa3f" volumeName="kubernetes.io/configmap/496e6271-fb68-4057-954e-a0d97a4afa3f-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233624 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7539238d-5fe0-46ed-884e-1c3b566537ec" volumeName="kubernetes.io/configmap/7539238d-5fe0-46ed-884e-1c3b566537ec-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233645 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7583ce53-e0fe-4a16-9e4d-50516596a136" volumeName="kubernetes.io/secret/7583ce53-e0fe-4a16-9e4d-50516596a136-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233671 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b574797-001e-440a-8f4e-c0be86edad0f" volumeName="kubernetes.io/secret/0b574797-001e-440a-8f4e-c0be86edad0f-proxy-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233692 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf126b07-da06-4140-9a57-dfd54fc6b486" volumeName="kubernetes.io/configmap/bf126b07-da06-4140-9a57-dfd54fc6b486-trusted-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233713 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0128f3a-b052-44ed-a84e-c4c8aaf17c13" volumeName="kubernetes.io/projected/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-kube-api-access-gf66m" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233734 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b78653f-4ff9-4508-8672-245ed9b561e3" volumeName="kubernetes.io/secret/0b78653f-4ff9-4508-8672-245ed9b561e3-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233755 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-trusted-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233776 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" volumeName="kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233796 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6402fda4-df10-493c-b4e5-d0569419652d" volumeName="kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-images" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233815 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" volumeName="kubernetes.io/secret/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233853 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a31745f5-9847-4afe-82a5-3161cc66ca93" volumeName="kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-kube-api-access-lz9wn" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233875 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b574797-001e-440a-8f4e-c0be86edad0f" volumeName="kubernetes.io/configmap/0b574797-001e-440a-8f4e-c0be86edad0f-mcc-auth-proxy-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233895 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="22c825df-677d-4ca6-82db-3454ed06e783" volumeName="kubernetes.io/secret/22c825df-677d-4ca6-82db-3454ed06e783-machine-approver-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233914 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" volumeName="kubernetes.io/projected/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-kube-api-access-6ccd8" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233935 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-provider-selection" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233957 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bb40260-dbaa-4fb0-84df-5e680505d512" volumeName="kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-multus-daemon-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.233980 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" volumeName="kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234000 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ea678ab-3438-413e-bfe3-290ae7725660" volumeName="kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-env-overrides" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234052 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7583ce53-e0fe-4a16-9e4d-50516596a136" volumeName="kubernetes.io/projected/7583ce53-e0fe-4a16-9e4d-50516596a136-kube-api-access-xcphl" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234072 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20b0d48f-5fd6-431c-a545-e3c800c7b866" volumeName="kubernetes.io/projected/20b0d48f-5fd6-431c-a545-e3c800c7b866-kube-api-access-w9rds" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234108 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7e6199b-1264-4501-8953-767f51328d08" volumeName="kubernetes.io/configmap/e7e6199b-1264-4501-8953-767f51328d08-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234127 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef543e1b-8068-4ea3-b32a-61027b32e95d" volumeName="kubernetes.io/configmap/ef543e1b-8068-4ea3-b32a-61027b32e95d-env-overrides" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234149 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c03ee662-fb2f-4fc4-a2c1-af487c19d254" volumeName="kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-default-certificate" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234172 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234224 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-oauth-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234383 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" volumeName="kubernetes.io/configmap/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234429 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b93a3a-6083-4aea-8eab-fe1aa8245ad9" volumeName="kubernetes.io/projected/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-kube-api-access-nzwt7" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234451 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6312bbd-5731-4ea0-a20f-81d5a57df44a" volumeName="kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-srv-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234473 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b78653f-4ff9-4508-8672-245ed9b561e3" volumeName="kubernetes.io/projected/0b78653f-4ff9-4508-8672-245ed9b561e3-kube-api-access" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234494 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-router-certs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234515 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6509e943-70c6-444c-bc41-48a544e36fbd" volumeName="kubernetes.io/projected/6509e943-70c6-444c-bc41-48a544e36fbd-kube-api-access-6g6sz" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234535 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7539238d-5fe0-46ed-884e-1c3b566537ec" volumeName="kubernetes.io/projected/7539238d-5fe0-46ed-884e-1c3b566537ec-kube-api-access-tk88c" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234555 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf126b07-da06-4140-9a57-dfd54fc6b486" volumeName="kubernetes.io/secret/bf126b07-da06-4140-9a57-dfd54fc6b486-image-registry-operator-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234576 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-error" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234637 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-image-import-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234657 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="25e176fe-21b4-4974-b1ed-c8b94f112a7f" volumeName="kubernetes.io/projected/25e176fe-21b4-4974-b1ed-c8b94f112a7f-kube-api-access-d4lsv" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234686 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-service-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234707 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-trusted-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234729 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5225d0e4-402f-4861-b410-819f433b1803" volumeName="kubernetes.io/projected/5225d0e4-402f-4861-b410-819f433b1803-kube-api-access-9xfj7" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.234749 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f668bae-612b-4b75-9490-919e737c6a3b" volumeName="kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240001 4769 reconstruct.go:144] "Volume is marked device as uncertain and added into the actual state" volumeName="kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" deviceMountPath="/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/1f4776af88835e41c12b831b4c9fed40233456d14189815a54dbe7f892fc1983/globalmount" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240050 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="efdd0498-1daa-4136-9a4a-3b948c2293fc" volumeName="kubernetes.io/secret/efdd0498-1daa-4136-9a4a-3b948c2293fc-webhook-certs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240173 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09efc573-dbb6-4249-bd59-9b87aba8dd28" volumeName="kubernetes.io/projected/09efc573-dbb6-4249-bd59-9b87aba8dd28-kube-api-access-8tdtz" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240225 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" volumeName="kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-srv-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240246 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-encryption-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240266 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" volumeName="kubernetes.io/configmap/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240322 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" volumeName="kubernetes.io/projected/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-kube-api-access-qs4fp" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240343 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cb93b32-e0ae-4377-b9c8-fdb9842c6d59" volumeName="kubernetes.io/configmap/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-serviceca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240363 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe579f8-e8a6-4643-bce5-a661393c4dde" volumeName="kubernetes.io/projected/5fe579f8-e8a6-4643-bce5-a661393c4dde-kube-api-access-fcqwp" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240382 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6731426b-95fe-49ff-bb5f-40441049fde2" volumeName="kubernetes.io/secret/6731426b-95fe-49ff-bb5f-40441049fde2-control-plane-machine-set-operator-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240437 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ea678ab-3438-413e-bfe3-290ae7725660" volumeName="kubernetes.io/projected/6ea678ab-3438-413e-bfe3-290ae7725660-kube-api-access-htfz6" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240485 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240505 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6312bbd-5731-4ea0-a20f-81d5a57df44a" volumeName="kubernetes.io/projected/b6312bbd-5731-4ea0-a20f-81d5a57df44a-kube-api-access-249nr" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240524 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-trusted-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240544 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" volumeName="kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-service-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240563 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="49ef4625-1d3a-4a9f-b595-c2433d32326d" volumeName="kubernetes.io/projected/49ef4625-1d3a-4a9f-b595-c2433d32326d-kube-api-access-pjr6v" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240583 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bb40260-dbaa-4fb0-84df-5e680505d512" volumeName="kubernetes.io/projected/4bb40260-dbaa-4fb0-84df-5e680505d512-kube-api-access-2w9zh" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240622 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5225d0e4-402f-4861-b410-819f433b1803" volumeName="kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-utilities" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240664 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7583ce53-e0fe-4a16-9e4d-50516596a136" volumeName="kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240685 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7583ce53-e0fe-4a16-9e4d-50516596a136" volumeName="kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-proxy-ca-bundles" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240704 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-serving-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240721 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" volumeName="kubernetes.io/projected/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-kube-api-access-mnrrd" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240739 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ab1a177-2de0-46d9-b765-d0d0649bb42e" volumeName="kubernetes.io/secret/3ab1a177-2de0-46d9-b765-d0d0649bb42e-package-server-manager-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240806 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-oauth-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240829 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5441d097-087c-4d9a-baa8-b210afa90fc9" volumeName="kubernetes.io/secret/5441d097-087c-4d9a-baa8-b210afa90fc9-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240849 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a31745f5-9847-4afe-82a5-3161cc66ca93" volumeName="kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-bound-sa-token" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240947 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6cd30de-2eeb-49a2-ab40-9167f4560ff5" volumeName="kubernetes.io/configmap/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-trusted-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240970 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf126b07-da06-4140-9a57-dfd54fc6b486" volumeName="kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-kube-api-access-rnphk" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.240989 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf126b07-da06-4140-9a57-dfd54fc6b486" volumeName="kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-bound-sa-token" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241009 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="22c825df-677d-4ca6-82db-3454ed06e783" volumeName="kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241027 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef543e1b-8068-4ea3-b32a-61027b32e95d" volumeName="kubernetes.io/configmap/ef543e1b-8068-4ea3-b32a-61027b32e95d-ovnkube-identity-cm" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241048 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="496e6271-fb68-4057-954e-a0d97a4afa3f" volumeName="kubernetes.io/secret/496e6271-fb68-4057-954e-a0d97a4afa3f-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241067 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d75a4c96-2883-4a0b-bab2-0fab2b6c0b49" volumeName="kubernetes.io/projected/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-kube-api-access-rczfb" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241087 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" volumeName="kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-trusted-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241164 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b574797-001e-440a-8f4e-c0be86edad0f" volumeName="kubernetes.io/projected/0b574797-001e-440a-8f4e-c0be86edad0f-kube-api-access-lzf88" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241211 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-serving-ca" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241230 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20b0d48f-5fd6-431c-a545-e3c800c7b866" volumeName="kubernetes.io/secret/20b0d48f-5fd6-431c-a545-e3c800c7b866-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241249 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ab1a177-2de0-46d9-b765-d0d0649bb42e" volumeName="kubernetes.io/projected/3ab1a177-2de0-46d9-b765-d0d0649bb42e-kube-api-access-4d4hj" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241269 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="57a731c4-ef35-47a8-b875-bfb08a7f8011" volumeName="kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-utilities" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241288 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fe579f8-e8a6-4643-bce5-a661393c4dde" volumeName="kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-certs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241308 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6402fda4-df10-493c-b4e5-d0569419652d" volumeName="kubernetes.io/secret/6402fda4-df10-493c-b4e5-d0569419652d-machine-api-operator-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241328 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01ab3dd5-8196-46d0-ad33-122e2ca51def" volumeName="kubernetes.io/configmap/01ab3dd5-8196-46d0-ad33-122e2ca51def-config" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241394 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="925f1c65-6136-48ba-85aa-3a3b50560753" volumeName="kubernetes.io/projected/925f1c65-6136-48ba-85aa-3a3b50560753-kube-api-access-s4n52" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241434 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87cf06ed-a83f-41a7-828d-70653580a8cb" volumeName="kubernetes.io/secret/87cf06ed-a83f-41a7-828d-70653580a8cb-metrics-tls" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241453 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c03ee662-fb2f-4fc4-a2c1-af487c19d254" volumeName="kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-metrics-certs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241471 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d611f23-29be-4491-8495-bee1670e935f" volumeName="kubernetes.io/projected/1d611f23-29be-4491-8495-bee1670e935f-kube-api-access-bf2bz" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241490 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" volumeName="kubernetes.io/empty-dir/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-tmpfs" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241508 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="43509403-f426-496e-be36-56cef71462f5" volumeName="kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-serving-cert" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241528 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6402fda4-df10-493c-b4e5-d0569419652d" volumeName="kubernetes.io/projected/6402fda4-df10-493c-b4e5-d0569419652d-kube-api-access-mg5zb" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241547 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6509e943-70c6-444c-bc41-48a544e36fbd" volumeName="kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-service-ca-bundle" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241596 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="87cf06ed-a83f-41a7-828d-70653580a8cb" volumeName="kubernetes.io/projected/87cf06ed-a83f-41a7-828d-70653580a8cb-kube-api-access-d6qdx" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241616 4769 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bf7eb37-55a3-4c65-b768-a94c82151e69" volumeName="kubernetes.io/projected/1bf7eb37-55a3-4c65-b768-a94c82151e69-kube-api-access-sb6h7" seLinuxMountContext="" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241633 4769 reconstruct.go:97] "Volume reconstruction finished" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.241646 4769 reconciler.go:26] "Reconciler: start to sync state" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.259110 4769 manager.go:324] Recovery completed Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.270098 4769 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.270499 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.272633 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.272669 4769 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.272687 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.272703 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.272707 4769 status_manager.go:217] "Starting to sync pod status with apiserver" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.272736 4769 kubelet.go:2335] "Starting kubelet main sync loop" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.273397 4769 kubelet.go:2359] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.273812 4769 cpu_manager.go:225] "Starting CPU manager" policy="none" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.273886 4769 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.273955 4769 state_mem.go:36] "Initialized new in-memory state store" Nov 21 11:50:43 crc kubenswrapper[4769]: W1121 11:50:43.274424 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.274543 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.302315 4769 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"crc\" not found" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.374965 4769 kubelet.go:2359] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.380869 4769 policy_none.go:49] "None policy: Start" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.382836 4769 memory_manager.go:170] "Starting memorymanager" policy="None" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.382905 4769 state_mem.go:35] "Initializing new in-memory state store" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.403359 4769 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"crc\" not found" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.406531 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.227:6443: connect: connection refused" interval="400ms" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.459966 4769 manager.go:334] "Starting Device Plugin manager" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.460075 4769 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.460092 4769 server.go:79] "Starting device plugin registration server" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.460674 4769 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.460696 4769 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.460856 4769 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.461014 4769 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.461030 4769 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.472134 4769 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.560997 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.562215 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.562305 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.562319 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.562379 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.563275 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.227:6443: connect: connection refused" node="crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.575398 4769 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-crc","openshift-kube-apiserver/kube-apiserver-crc","openshift-kube-controller-manager/kube-controller-manager-crc","openshift-kube-scheduler/openshift-kube-scheduler-crc","openshift-machine-config-operator/kube-rbac-proxy-crio-crc"] Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.575580 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.576738 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.576854 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.576951 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.577207 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.577559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.577602 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.577927 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.577948 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.577956 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578054 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578510 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578539 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578548 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578604 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578792 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578876 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.578948 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.579116 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.579308 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.579360 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580173 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580248 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580306 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580307 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580332 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580318 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580514 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580589 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580610 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580820 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580840 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.580849 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581168 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581203 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581212 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581477 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581583 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581684 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.581918 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.582031 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.582945 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.582982 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.582995 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.649859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-resource-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.649933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-data-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.649962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.649985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-cert-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-usr-local-bin\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1b160f5dda77d281dd8e69ec8d817f9-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"d1b160f5dda77d281dd8e69ec8d817f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b160f5dda77d281dd8e69ec8d817f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"d1b160f5dda77d281dd8e69ec8d817f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-static-pod-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f614b9022728cf315e60c057852e563e-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"f614b9022728cf315e60c057852e563e\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3dcd261975c3d6b9a6ad6367fd4facd3-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"3dcd261975c3d6b9a6ad6367fd4facd3\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3dcd261975c3d6b9a6ad6367fd4facd3-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"3dcd261975c3d6b9a6ad6367fd4facd3\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-log-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.650372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f614b9022728cf315e60c057852e563e-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"f614b9022728cf315e60c057852e563e\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-log-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-log-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f614b9022728cf315e60c057852e563e-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"f614b9022728cf315e60c057852e563e\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f614b9022728cf315e60c057852e563e-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"f614b9022728cf315e60c057852e563e\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f614b9022728cf315e60c057852e563e-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"f614b9022728cf315e60c057852e563e\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3dcd261975c3d6b9a6ad6367fd4facd3-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"3dcd261975c3d6b9a6ad6367fd4facd3\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f614b9022728cf315e60c057852e563e-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"f614b9022728cf315e60c057852e563e\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.752954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3dcd261975c3d6b9a6ad6367fd4facd3-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"3dcd261975c3d6b9a6ad6367fd4facd3\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3dcd261975c3d6b9a6ad6367fd4facd3-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"3dcd261975c3d6b9a6ad6367fd4facd3\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-resource-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-data-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-cert-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-usr-local-bin\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753183 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-static-pod-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3dcd261975c3d6b9a6ad6367fd4facd3-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"3dcd261975c3d6b9a6ad6367fd4facd3\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1b160f5dda77d281dd8e69ec8d817f9-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"d1b160f5dda77d281dd8e69ec8d817f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-static-pod-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b160f5dda77d281dd8e69ec8d817f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"d1b160f5dda77d281dd8e69ec8d817f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753449 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1b160f5dda77d281dd8e69ec8d817f9-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"d1b160f5dda77d281dd8e69ec8d817f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-data-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-usr-local-bin\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753542 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-cert-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/2139d3e2895fc6797b9c76a1b4c9886d-resource-dir\") pod \"etcd-crc\" (UID: \"2139d3e2895fc6797b9c76a1b4c9886d\") " pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f4b27818a5e8e43d0dc095d08835c792-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"f4b27818a5e8e43d0dc095d08835c792\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.753641 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b160f5dda77d281dd8e69ec8d817f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"d1b160f5dda77d281dd8e69ec8d817f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.764216 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.765594 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.765656 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.765669 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.765706 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.766383 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.227:6443: connect: connection refused" node="crc" Nov 21 11:50:43 crc kubenswrapper[4769]: E1121 11:50:43.807306 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.227:6443: connect: connection refused" interval="800ms" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.911294 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.927307 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.947720 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.958802 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:43 crc kubenswrapper[4769]: I1121 11:50:43.966156 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.002144 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2139d3e2895fc6797b9c76a1b4c9886d.slice/crio-89b77d5322d0218f34498fff8477ac2ca8b057988cd07998bacff943963bc7f5 WatchSource:0}: Error finding container 89b77d5322d0218f34498fff8477ac2ca8b057988cd07998bacff943963bc7f5: Status 404 returned error can't find the container with id 89b77d5322d0218f34498fff8477ac2ca8b057988cd07998bacff943963bc7f5 Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.002614 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b27818a5e8e43d0dc095d08835c792.slice/crio-13e3d29fb77bffa70505390565624f0abe7346bfd576e09990d342bfb92975bb WatchSource:0}: Error finding container 13e3d29fb77bffa70505390565624f0abe7346bfd576e09990d342bfb92975bb: Status 404 returned error can't find the container with id 13e3d29fb77bffa70505390565624f0abe7346bfd576e09990d342bfb92975bb Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.024066 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b160f5dda77d281dd8e69ec8d817f9.slice/crio-ccec97176d395ed6ca3fc8dd075cb2a93eac859a3095ca48b5ebcc9cea3f8ebb WatchSource:0}: Error finding container ccec97176d395ed6ca3fc8dd075cb2a93eac859a3095ca48b5ebcc9cea3f8ebb: Status 404 returned error can't find the container with id ccec97176d395ed6ca3fc8dd075cb2a93eac859a3095ca48b5ebcc9cea3f8ebb Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.066958 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.067148 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.166867 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.168593 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.168635 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.168646 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.168674 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.169244 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.227:6443: connect: connection refused" node="crc" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.199355 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.277037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"f614b9022728cf315e60c057852e563e","Type":"ContainerStarted","Data":"5b7c056573d2e81ca13e909fed0701155a09156a876590e01643df366fa589be"} Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.277772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"13e3d29fb77bffa70505390565624f0abe7346bfd576e09990d342bfb92975bb"} Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.278730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerStarted","Data":"89b77d5322d0218f34498fff8477ac2ca8b057988cd07998bacff943963bc7f5"} Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.279348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"d1b160f5dda77d281dd8e69ec8d817f9","Type":"ContainerStarted","Data":"ccec97176d395ed6ca3fc8dd075cb2a93eac859a3095ca48b5ebcc9cea3f8ebb"} Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.280036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"3dcd261975c3d6b9a6ad6367fd4facd3","Type":"ContainerStarted","Data":"85c9c4b39e61d2d9d99269985c4f39cdc4b526edd08121b5d0e1841d0c38d106"} Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.608535 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.227:6443: connect: connection refused" interval="1.6s" Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.766214 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.766290 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.766281 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.766415 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:44 crc kubenswrapper[4769]: W1121 11:50:44.789609 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.789699 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.970245 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.971395 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.971429 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.971440 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:44 crc kubenswrapper[4769]: I1121 11:50:44.971464 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:44 crc kubenswrapper[4769]: E1121 11:50:44.971751 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.227:6443: connect: connection refused" node="crc" Nov 21 11:50:45 crc kubenswrapper[4769]: I1121 11:50:45.199944 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.199700 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:46 crc kubenswrapper[4769]: E1121 11:50:46.209471 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.227:6443: connect: connection refused" interval="3.2s" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.288745 4769 generic.go:334] "Generic (PLEG): container finished" podID="d1b160f5dda77d281dd8e69ec8d817f9" containerID="df78c6637a964a9a75b1cde5b4e600a7d797edbbb1737c315e3ee87d53be8be6" exitCode=0 Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.288798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"d1b160f5dda77d281dd8e69ec8d817f9","Type":"ContainerDied","Data":"df78c6637a964a9a75b1cde5b4e600a7d797edbbb1737c315e3ee87d53be8be6"} Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.288855 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.290029 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.290079 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.290094 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.290562 4769 generic.go:334] "Generic (PLEG): container finished" podID="3dcd261975c3d6b9a6ad6367fd4facd3" containerID="ff39cc7e5013cbc2519f3f149c4be110e0149dd9568235b80e9d56a68c2b3d85" exitCode=0 Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.290634 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.290658 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"3dcd261975c3d6b9a6ad6367fd4facd3","Type":"ContainerDied","Data":"ff39cc7e5013cbc2519f3f149c4be110e0149dd9568235b80e9d56a68c2b3d85"} Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.291434 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.291467 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.291479 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.293864 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"f614b9022728cf315e60c057852e563e","Type":"ContainerStarted","Data":"25e825f642c95f8c820ac7fbe8c52ae0bf4793ac5e79bfb411ea3b6295567da1"} Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.297022 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4b27818a5e8e43d0dc095d08835c792" containerID="e9097d0792c62d0120d763586c350c703d9ff04b9abfab6bb2a6b7e067ca851e" exitCode=0 Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.297076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerDied","Data":"e9097d0792c62d0120d763586c350c703d9ff04b9abfab6bb2a6b7e067ca851e"} Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.297136 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.298296 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.298331 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.298345 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.299466 4769 generic.go:334] "Generic (PLEG): container finished" podID="2139d3e2895fc6797b9c76a1b4c9886d" containerID="2ac2fe77dc0e0f0e1a6983fcc0a99b815a45acebe6675a89b162a3ac8f577e75" exitCode=0 Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.299500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerDied","Data":"2ac2fe77dc0e0f0e1a6983fcc0a99b815a45acebe6675a89b162a3ac8f577e75"} Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.299557 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.300081 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.300433 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.300477 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.300490 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.301124 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.301162 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.301173 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:46 crc kubenswrapper[4769]: W1121 11:50:46.384640 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:46 crc kubenswrapper[4769]: E1121 11:50:46.384710 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.572458 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.574169 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.574247 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.574264 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:46 crc kubenswrapper[4769]: I1121 11:50:46.574298 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:46 crc kubenswrapper[4769]: E1121 11:50:46.574836 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.227:6443: connect: connection refused" node="crc" Nov 21 11:50:46 crc kubenswrapper[4769]: W1121 11:50:46.616410 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:46 crc kubenswrapper[4769]: E1121 11:50:46.616494 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:46 crc kubenswrapper[4769]: W1121 11:50:46.944516 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:46 crc kubenswrapper[4769]: E1121 11:50:46.944684 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.199206 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.305249 4769 generic.go:334] "Generic (PLEG): container finished" podID="2139d3e2895fc6797b9c76a1b4c9886d" containerID="40ac6416e0ce6fd7dbef3f79ddeef6586b47807cf96d452e552b60917484276f" exitCode=0 Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.305300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerDied","Data":"40ac6416e0ce6fd7dbef3f79ddeef6586b47807cf96d452e552b60917484276f"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.305531 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.307599 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.307638 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.307649 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.307677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"d1b160f5dda77d281dd8e69ec8d817f9","Type":"ContainerStarted","Data":"8389b52ff9077c402e266166b27efa04055d85e3c7cb2a9d39fed4a6d481fbae"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.307723 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.309048 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.309096 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.309108 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.311380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"3dcd261975c3d6b9a6ad6367fd4facd3","Type":"ContainerStarted","Data":"b6c258561f468aff29984a34a4771c0bc015834ee1e4e39bd0f71beb80e2527a"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.311404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"3dcd261975c3d6b9a6ad6367fd4facd3","Type":"ContainerStarted","Data":"223667a3a37a0f044afabe798a0b1e166d39105b4cb9d31bbd9aacafce180f2d"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.313447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"f614b9022728cf315e60c057852e563e","Type":"ContainerStarted","Data":"960acc72b630ff2d1abe112d66ccfe0ebc61cb766891c548808fc7b1e0ae7636"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.313503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"f614b9022728cf315e60c057852e563e","Type":"ContainerStarted","Data":"f448ef58a0fd2b24b645e7031b1200632b93e2daf59cf95081707fa39e0a2aee"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.315502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"4234f048c6ee520b76ed0b33f2846debcf09ec7bdc39faa90a7af74d1629f67d"} Nov 21 11:50:47 crc kubenswrapper[4769]: I1121 11:50:47.315535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"5a98ecd71e100ba56b4fd5bf5c16df94d7ac43d3aa4b3cbfff9e118372583b63"} Nov 21 11:50:47 crc kubenswrapper[4769]: W1121 11:50:47.892321 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:47 crc kubenswrapper[4769]: E1121 11:50:47.892447 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.200134 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.329041 4769 generic.go:334] "Generic (PLEG): container finished" podID="2139d3e2895fc6797b9c76a1b4c9886d" containerID="eb5a8ca5ece1a76f4d616c3e91161277b1c3aeebb5ad57cd08ab266438e46bf9" exitCode=0 Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.329146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerDied","Data":"eb5a8ca5ece1a76f4d616c3e91161277b1c3aeebb5ad57cd08ab266438e46bf9"} Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.329206 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.330043 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.330070 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.330081 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.333883 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.334415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"3dcd261975c3d6b9a6ad6367fd4facd3","Type":"ContainerStarted","Data":"7ed559242cc8f62d9dad5de59dd49261788209bd610c7e215727323a09fd383d"} Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.334900 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.334932 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.334942 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.337571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"f614b9022728cf315e60c057852e563e","Type":"ContainerStarted","Data":"31e2da7b9f51e05a12c1a40c9ea12651c177540dfe7d800040dee19d9794cda3"} Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.337695 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.338539 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.338561 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.338571 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.342177 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.342292 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.342637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"0441f46dde55998964cc19179a282828449c667450c4f02da0eecf84ade9bfcd"} Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.342667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"f980a59136d2511b845f758f1dfe01b9d50201bf455cd80ef42b7bcadb83e955"} Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.342682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"39becd5597224db006e3185e3932e2508a6d147b8785e4b77468e2b950d9175d"} Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.343225 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.343250 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.343261 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.343635 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.343657 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:48 crc kubenswrapper[4769]: I1121 11:50:48.343667 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.159692 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.199996 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.345904 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/0.log" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.347830 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4b27818a5e8e43d0dc095d08835c792" containerID="0441f46dde55998964cc19179a282828449c667450c4f02da0eecf84ade9bfcd" exitCode=255 Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.347903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerDied","Data":"0441f46dde55998964cc19179a282828449c667450c4f02da0eecf84ade9bfcd"} Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.347937 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.349606 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.349656 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.349670 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.350378 4769 scope.go:117] "RemoveContainer" containerID="0441f46dde55998964cc19179a282828449c667450c4f02da0eecf84ade9bfcd" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.354279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerStarted","Data":"3f786d3c7b0d719b26590e09a88361bf0b5ce1762ccff43d37ce293ca62038aa"} Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.354334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerStarted","Data":"b860ea6b22f417fca19afe6d9bab47dd00680d60cf471341fbbd727e392b2b43"} Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.354360 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.354381 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.354438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.355369 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.355398 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.355411 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.355520 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.355566 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.355578 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:49 crc kubenswrapper[4769]: E1121 11:50:49.411167 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 38.102.83.227:6443: connect: connection refused" interval="6.4s" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.706666 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.775802 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.777329 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.777398 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.777425 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:49 crc kubenswrapper[4769]: I1121 11:50:49.777466 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:49 crc kubenswrapper[4769]: E1121 11:50:49.778001 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 38.102.83.227:6443: connect: connection refused" node="crc" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.097316 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.199220 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.253532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.360829 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/0.log" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.363951 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.364040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972"} Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.364263 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.364355 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.365715 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.365761 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.365774 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.366460 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.366532 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.366541 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.366546 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.366576 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.366603 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.680506 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.681113 4769 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="Get \"https://192.168.126.11:6443/livez\": dial tcp 192.168.126.11:6443: connect: connection refused" start-of-body= Nov 21 11:50:50 crc kubenswrapper[4769]: I1121 11:50:50.681225 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" containerName="kube-apiserver" probeResult="failure" output="Get \"https://192.168.126.11:6443/livez\": dial tcp 192.168.126.11:6443: connect: connection refused" Nov 21 11:50:50 crc kubenswrapper[4769]: W1121 11:50:50.942953 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:50 crc kubenswrapper[4769]: E1121 11:50:50.943148 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.044922 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.200628 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.372716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerStarted","Data":"44a9279ea5a6279c77a000bcfcb9244a7a564f10d4b10e0a1e6dc561cd32398a"} Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.372905 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.372959 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.373434 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.374458 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.374515 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.374537 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.375152 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.375216 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:51 crc kubenswrapper[4769]: I1121 11:50:51.375229 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:51 crc kubenswrapper[4769]: E1121 11:50:51.454710 4769 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/default/events\": dial tcp 38.102.83.227:6443: connect: connection refused" event="&Event{ObjectMeta:{crc.187a034f4cc54f0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2025-11-21 11:50:43.194269451 +0000 UTC m=+1.894931269,LastTimestamp:2025-11-21 11:50:43.194269451 +0000 UTC m=+1.894931269,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.199488 4769 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.332566 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.381118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerStarted","Data":"adcf136c7a2bc9cebdf30ed709030b95a623bfaaa04093600439decb4c6d3e25"} Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.383557 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/1.log" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.384274 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/0.log" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.387240 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4b27818a5e8e43d0dc095d08835c792" containerID="63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972" exitCode=255 Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.387341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerDied","Data":"63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972"} Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.387395 4769 scope.go:117] "RemoveContainer" containerID="0441f46dde55998964cc19179a282828449c667450c4f02da0eecf84ade9bfcd" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.387486 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.387496 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.388830 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.388861 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.388871 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.388973 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.389008 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.389020 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:52 crc kubenswrapper[4769]: I1121 11:50:52.389572 4769 scope.go:117] "RemoveContainer" containerID="63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972" Nov 21 11:50:52 crc kubenswrapper[4769]: E1121 11:50:52.389754 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:50:52 crc kubenswrapper[4769]: W1121 11:50:52.756617 4769 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0": dial tcp 38.102.83.227:6443: connect: connection refused Nov 21 11:50:52 crc kubenswrapper[4769]: E1121 11:50:52.756756 4769 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 38.102.83.227:6443: connect: connection refused" logger="UnhandledError" Nov 21 11:50:53 crc kubenswrapper[4769]: I1121 11:50:53.392456 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/1.log" Nov 21 11:50:53 crc kubenswrapper[4769]: I1121 11:50:53.394431 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:53 crc kubenswrapper[4769]: I1121 11:50:53.395404 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:53 crc kubenswrapper[4769]: I1121 11:50:53.395440 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:53 crc kubenswrapper[4769]: I1121 11:50:53.395449 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:53 crc kubenswrapper[4769]: I1121 11:50:53.395931 4769 scope.go:117] "RemoveContainer" containerID="63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972" Nov 21 11:50:53 crc kubenswrapper[4769]: E1121 11:50:53.396082 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:50:53 crc kubenswrapper[4769]: E1121 11:50:53.472556 4769 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Nov 21 11:50:55 crc kubenswrapper[4769]: I1121 11:50:55.405510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"2139d3e2895fc6797b9c76a1b4c9886d","Type":"ContainerStarted","Data":"c3627af25f0f8a37bb97c2a0a0dcf1fdd46ef7323a279076cad910b4d6d9eb2b"} Nov 21 11:50:55 crc kubenswrapper[4769]: I1121 11:50:55.405656 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:55 crc kubenswrapper[4769]: I1121 11:50:55.406802 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:55 crc kubenswrapper[4769]: I1121 11:50:55.406853 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:55 crc kubenswrapper[4769]: I1121 11:50:55.406867 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:55 crc kubenswrapper[4769]: I1121 11:50:55.487629 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-crc" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.178108 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.179289 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.179325 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.179337 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.179359 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.408339 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.409328 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.409398 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.409415 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.577441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.577729 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.579267 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.579320 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.579332 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:56 crc kubenswrapper[4769]: I1121 11:50:56.582644 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.411664 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.411724 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.413375 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.413426 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.413444 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.413613 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.413665 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:57 crc kubenswrapper[4769]: I1121 11:50:57.413682 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.507823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-crc" Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.508096 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.509776 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.509810 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.509821 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.577862 4769 patch_prober.go:28] interesting pod/kube-controller-manager-crc container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://192.168.126.11:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 21 11:50:59 crc kubenswrapper[4769]: I1121 11:50:59.577970 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-crc" podUID="f614b9022728cf315e60c057852e563e" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://192.168.126.11:10357/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 11:51:00 crc kubenswrapper[4769]: I1121 11:51:00.974410 4769 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Nov 21 11:51:00 crc kubenswrapper[4769]: I1121 11:51:00.974507 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 403" Nov 21 11:51:00 crc kubenswrapper[4769]: I1121 11:51:00.982945 4769 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Nov 21 11:51:00 crc kubenswrapper[4769]: I1121 11:51:00.983021 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 403" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.247494 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.247990 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.254428 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.254475 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.254488 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.255235 4769 scope.go:117] "RemoveContainer" containerID="63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972" Nov 21 11:51:02 crc kubenswrapper[4769]: I1121 11:51:02.923278 4769 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.429726 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/2.log" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.430857 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/1.log" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.433079 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4b27818a5e8e43d0dc095d08835c792" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" exitCode=255 Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.433142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerDied","Data":"8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052"} Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.433227 4769 scope.go:117] "RemoveContainer" containerID="63ad678e9b277c68642c9951acfa8797da655c7ae4dbd548177d4a803e6d0972" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.433491 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.434869 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.434906 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.434918 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:03 crc kubenswrapper[4769]: I1121 11:51:03.435610 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:03 crc kubenswrapper[4769]: E1121 11:51:03.435830 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:03 crc kubenswrapper[4769]: E1121 11:51:03.472729 4769 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Nov 21 11:51:04 crc kubenswrapper[4769]: I1121 11:51:04.438336 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/2.log" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.529268 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-crc" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.529659 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.531474 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.531529 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.531542 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.543042 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-crc" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.688736 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.688996 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.690760 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.690813 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.690826 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.691478 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:05 crc kubenswrapper[4769]: E1121 11:51:05.691657 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.694174 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:05 crc kubenswrapper[4769]: E1121 11:51:05.970763 4769 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": context deadline exceeded" interval="7s" Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.972990 4769 trace.go:236] Trace[984230032]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (21-Nov-2025 11:50:52.945) (total time: 13027ms): Nov 21 11:51:05 crc kubenswrapper[4769]: Trace[984230032]: ---"Objects listed" error: 13027ms (11:51:05.972) Nov 21 11:51:05 crc kubenswrapper[4769]: Trace[984230032]: [13.027331638s] [13.027331638s] END Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.973043 4769 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.973290 4769 trace.go:236] Trace[1589718481]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (21-Nov-2025 11:50:53.398) (total time: 12574ms): Nov 21 11:51:05 crc kubenswrapper[4769]: Trace[1589718481]: ---"Objects listed" error: 12574ms (11:51:05.973) Nov 21 11:51:05 crc kubenswrapper[4769]: Trace[1589718481]: [12.5746683s] [12.5746683s] END Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.973326 4769 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Nov 21 11:51:05 crc kubenswrapper[4769]: I1121 11:51:05.976518 4769 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 21 11:51:05 crc kubenswrapper[4769]: E1121 11:51:05.978055 4769 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes \"crc\" is forbidden: autoscaling.openshift.io/ManagedNode infra config cache not synchronized" node="crc" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.445614 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.445628 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447038 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447075 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447088 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447388 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447421 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447432 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.447912 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:06 crc kubenswrapper[4769]: E1121 11:51:06.448057 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.581280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.581507 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.582638 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.582705 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.582722 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:06 crc kubenswrapper[4769]: I1121 11:51:06.586836 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.006455 4769 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.186963 4769 apiserver.go:52] "Watching apiserver" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.190484 4769 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.190964 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-85b44fc459-gdk6g","openshift-network-diagnostics/network-check-source-55646444c4-trplf","openshift-network-diagnostics/network-check-target-xd92c","openshift-network-node-identity/network-node-identity-vrzqb","openshift-network-operator/iptables-alerter-4ln5h","openshift-network-operator/network-operator-58b4c7f79c-55gtf"] Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.191553 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.191717 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.191871 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.191885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.191972 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.192132 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.192905 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.192149 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.192142 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.196052 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.196692 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.196692 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.197079 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.198162 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.202845 4769 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.226953 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"metrics-tls" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.228078 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.228150 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.228454 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.250764 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37a5e44f-9a88-4405-be8a-b645485e7312\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rdwmf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-58b4c7f79c-55gtf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.284099 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d751cbb-f2e2-430d-9754-c882a5e924a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2dwl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-55646444c4-trplf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302544 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqsjt\" (UniqueName: \"kubernetes.io/projected/efdd0498-1daa-4136-9a4a-3b948c2293fc-kube-api-access-fqsjt\") pod \"efdd0498-1daa-4136-9a4a-3b948c2293fc\" (UID: \"efdd0498-1daa-4136-9a4a-3b948c2293fc\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1386a44e-36a2-460c-96d0-0359d2b6f0f5-config\") pod \"1386a44e-36a2-460c-96d0-0359d2b6f0f5\" (UID: \"1386a44e-36a2-460c-96d0-0359d2b6f0f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302694 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-catalog-content\") pod \"1d611f23-29be-4491-8495-bee1670e935f\" (UID: \"1d611f23-29be-4491-8495-bee1670e935f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302734 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcqwp\" (UniqueName: \"kubernetes.io/projected/5fe579f8-e8a6-4643-bce5-a661393c4dde-kube-api-access-fcqwp\") pod \"5fe579f8-e8a6-4643-bce5-a661393c4dde\" (UID: \"5fe579f8-e8a6-4643-bce5-a661393c4dde\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20b0d48f-5fd6-431c-a545-e3c800c7b866-cert\") pod \"20b0d48f-5fd6-431c-a545-e3c800c7b866\" (UID: \"20b0d48f-5fd6-431c-a545-e3c800c7b866\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-binary-copy\") pod \"7bb08738-c794-4ee8-9972-3a62ca171029\" (UID: \"7bb08738-c794-4ee8-9972-3a62ca171029\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-ca\") pod \"09efc573-dbb6-4249-bd59-9b87aba8dd28\" (UID: \"09efc573-dbb6-4249-bd59-9b87aba8dd28\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-client-ca\") pod \"5441d097-087c-4d9a-baa8-b210afa90fc9\" (UID: \"5441d097-087c-4d9a-baa8-b210afa90fc9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302907 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-auth-proxy-config\") pod \"31d8b7a1-420e-4252-a5b7-eebe8a111292\" (UID: \"31d8b7a1-420e-4252-a5b7-eebe8a111292\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/22c825df-677d-4ca6-82db-3454ed06e783-machine-approver-tls\") pod \"22c825df-677d-4ca6-82db-3454ed06e783\" (UID: \"22c825df-677d-4ca6-82db-3454ed06e783\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.302983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d4wz\" (UniqueName: \"kubernetes.io/projected/5441d097-087c-4d9a-baa8-b210afa90fc9-kube-api-access-2d4wz\") pod \"5441d097-087c-4d9a-baa8-b210afa90fc9\" (UID: \"5441d097-087c-4d9a-baa8-b210afa90fc9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-trusted-ca-bundle\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-oauth-serving-cert\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-trusted-ca\") pod \"9d4552c7-cd75-42dd-8880-30dd377c49a4\" (UID: \"9d4552c7-cd75-42dd-8880-30dd377c49a4\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcxfs\" (UniqueName: \"kubernetes.io/projected/9d4552c7-cd75-42dd-8880-30dd377c49a4-kube-api-access-pcxfs\") pod \"9d4552c7-cd75-42dd-8880-30dd377c49a4\" (UID: \"9d4552c7-cd75-42dd-8880-30dd377c49a4\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-catalog-content\") pod \"57a731c4-ef35-47a8-b875-bfb08a7f8011\" (UID: \"57a731c4-ef35-47a8-b875-bfb08a7f8011\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-config\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a31745f5-9847-4afe-82a5-3161cc66ca93-metrics-tls\") pod \"a31745f5-9847-4afe-82a5-3161cc66ca93\" (UID: \"a31745f5-9847-4afe-82a5-3161cc66ca93\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303313 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-cni-binary-copy\") pod \"4bb40260-dbaa-4fb0-84df-5e680505d512\" (UID: \"4bb40260-dbaa-4fb0-84df-5e680505d512\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-login\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-default-certificate\") pod \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\" (UID: \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-serving-cert\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/496e6271-fb68-4057-954e-a0d97a4afa3f-serving-cert\") pod \"496e6271-fb68-4057-954e-a0d97a4afa3f\" (UID: \"496e6271-fb68-4057-954e-a0d97a4afa3f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-idp-0-file-data\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7539238d-5fe0-46ed-884e-1c3b566537ec-config\") pod \"7539238d-5fe0-46ed-884e-1c3b566537ec\" (UID: \"7539238d-5fe0-46ed-884e-1c3b566537ec\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/0b574797-001e-440a-8f4e-c0be86edad0f-mcc-auth-proxy-config\") pod \"0b574797-001e-440a-8f4e-c0be86edad0f\" (UID: \"0b574797-001e-440a-8f4e-c0be86edad0f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-trusted-ca-bundle\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnrrd\" (UniqueName: \"kubernetes.io/projected/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-kube-api-access-mnrrd\") pod \"bc5039c0-ea34-426b-a2b7-fbbc87b49a6d\" (UID: \"bc5039c0-ea34-426b-a2b7-fbbc87b49a6d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzf88\" (UniqueName: \"kubernetes.io/projected/0b574797-001e-440a-8f4e-c0be86edad0f-kube-api-access-lzf88\") pod \"0b574797-001e-440a-8f4e-c0be86edad0f\" (UID: \"0b574797-001e-440a-8f4e-c0be86edad0f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-config\") pod \"22c825df-677d-4ca6-82db-3454ed06e783\" (UID: \"22c825df-677d-4ca6-82db-3454ed06e783\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20b0d48f-5fd6-431c-a545-e3c800c7b866-cert" (OuterVolumeSpecName: "cert") pod "20b0d48f-5fd6-431c-a545-e3c800c7b866" (UID: "20b0d48f-5fd6-431c-a545-e3c800c7b866"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ea678ab-3438-413e-bfe3-290ae7725660-ovn-node-metrics-cert\") pod \"6ea678ab-3438-413e-bfe3-290ae7725660\" (UID: \"6ea678ab-3438-413e-bfe3-290ae7725660\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303924 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1386a44e-36a2-460c-96d0-0359d2b6f0f5-kube-api-access\") pod \"1386a44e-36a2-460c-96d0-0359d2b6f0f5\" (UID: \"1386a44e-36a2-460c-96d0-0359d2b6f0f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d4552c7-cd75-42dd-8880-30dd377c49a4-kube-api-access-pcxfs" (OuterVolumeSpecName: "kube-api-access-pcxfs") pod "9d4552c7-cd75-42dd-8880-30dd377c49a4" (UID: "9d4552c7-cd75-42dd-8880-30dd377c49a4"). InnerVolumeSpecName "kube-api-access-pcxfs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.303985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj782\" (UniqueName: \"kubernetes.io/projected/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-kube-api-access-pj782\") pod \"b6cd30de-2eeb-49a2-ab40-9167f4560ff5\" (UID: \"b6cd30de-2eeb-49a2-ab40-9167f4560ff5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.304220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1386a44e-36a2-460c-96d0-0359d2b6f0f5-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "1386a44e-36a2-460c-96d0-0359d2b6f0f5" (UID: "1386a44e-36a2-460c-96d0-0359d2b6f0f5"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.304249 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22c825df-677d-4ca6-82db-3454ed06e783-machine-approver-tls" (OuterVolumeSpecName: "machine-approver-tls") pod "22c825df-677d-4ca6-82db-3454ed06e783" (UID: "22c825df-677d-4ca6-82db-3454ed06e783"). InnerVolumeSpecName "machine-approver-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.304595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efdd0498-1daa-4136-9a4a-3b948c2293fc-kube-api-access-fqsjt" (OuterVolumeSpecName: "kube-api-access-fqsjt") pod "efdd0498-1daa-4136-9a4a-3b948c2293fc" (UID: "efdd0498-1daa-4136-9a4a-3b948c2293fc"). InnerVolumeSpecName "kube-api-access-fqsjt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.304673 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-kube-api-access-pj782" (OuterVolumeSpecName: "kube-api-access-pj782") pod "b6cd30de-2eeb-49a2-ab40-9167f4560ff5" (UID: "b6cd30de-2eeb-49a2-ab40-9167f4560ff5"). InnerVolumeSpecName "kube-api-access-pj782". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.305627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-idp-0-file-data" (OuterVolumeSpecName: "v4-0-config-user-idp-0-file-data") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-user-idp-0-file-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.305647 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-kube-api-access-mnrrd" (OuterVolumeSpecName: "kube-api-access-mnrrd") pod "bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" (UID: "bc5039c0-ea34-426b-a2b7-fbbc87b49a6d"). InnerVolumeSpecName "kube-api-access-mnrrd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7539238d-5fe0-46ed-884e-1c3b566537ec-config" (OuterVolumeSpecName: "config") pod "7539238d-5fe0-46ed-884e-1c3b566537ec" (UID: "7539238d-5fe0-46ed-884e-1c3b566537ec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-ca" (OuterVolumeSpecName: "etcd-ca") pod "09efc573-dbb6-4249-bd59-9b87aba8dd28" (UID: "09efc573-dbb6-4249-bd59-9b87aba8dd28"). InnerVolumeSpecName "etcd-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306528 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9d4552c7-cd75-42dd-8880-30dd377c49a4" (UID: "9d4552c7-cd75-42dd-8880-30dd377c49a4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-config" (OuterVolumeSpecName: "config") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306821 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.306988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "31d8b7a1-420e-4252-a5b7-eebe8a111292" (UID: "31d8b7a1-420e-4252-a5b7-eebe8a111292"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.308951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309151 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-client-ca" (OuterVolumeSpecName: "client-ca") pod "5441d097-087c-4d9a-baa8-b210afa90fc9" (UID: "5441d097-087c-4d9a-baa8-b210afa90fc9"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309208 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-binary-copy" (OuterVolumeSpecName: "cni-binary-copy") pod "7bb08738-c794-4ee8-9972-3a62ca171029" (UID: "7bb08738-c794-4ee8-9972-3a62ca171029"). InnerVolumeSpecName "cni-binary-copy". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1386a44e-36a2-460c-96d0-0359d2b6f0f5-config" (OuterVolumeSpecName: "config") pod "1386a44e-36a2-460c-96d0-0359d2b6f0f5" (UID: "1386a44e-36a2-460c-96d0-0359d2b6f0f5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-default-certificate" (OuterVolumeSpecName: "default-certificate") pod "c03ee662-fb2f-4fc4-a2c1-af487c19d254" (UID: "c03ee662-fb2f-4fc4-a2c1-af487c19d254"). InnerVolumeSpecName "default-certificate". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-config" (OuterVolumeSpecName: "config") pod "22c825df-677d-4ca6-82db-3454ed06e783" (UID: "22c825df-677d-4ca6-82db-3454ed06e783"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b574797-001e-440a-8f4e-c0be86edad0f-kube-api-access-lzf88" (OuterVolumeSpecName: "kube-api-access-lzf88") pod "0b574797-001e-440a-8f4e-c0be86edad0f" (UID: "0b574797-001e-440a-8f4e-c0be86edad0f"). InnerVolumeSpecName "kube-api-access-lzf88". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf126b07-da06-4140-9a57-dfd54fc6b486-trusted-ca\") pod \"bf126b07-da06-4140-9a57-dfd54fc6b486\" (UID: \"bf126b07-da06-4140-9a57-dfd54fc6b486\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea678ab-3438-413e-bfe3-290ae7725660-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "6ea678ab-3438-413e-bfe3-290ae7725660" (UID: "6ea678ab-3438-413e-bfe3-290ae7725660"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-config\") pod \"8cea82b4-6893-4ddc-af9f-1bb5ae425c5b\" (UID: \"8cea82b4-6893-4ddc-af9f-1bb5ae425c5b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.309951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-router-certs\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496e6271-fb68-4057-954e-a0d97a4afa3f-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "496e6271-fb68-4057-954e-a0d97a4afa3f" (UID: "496e6271-fb68-4057-954e-a0d97a4afa3f"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-cni-binary-copy" (OuterVolumeSpecName: "cni-binary-copy") pod "4bb40260-dbaa-4fb0-84df-5e680505d512" (UID: "4bb40260-dbaa-4fb0-84df-5e680505d512"). InnerVolumeSpecName "cni-binary-copy". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310213 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-error\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e6199b-1264-4501-8953-767f51328d08-serving-cert\") pod \"e7e6199b-1264-4501-8953-767f51328d08\" (UID: \"e7e6199b-1264-4501-8953-767f51328d08\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf126b07-da06-4140-9a57-dfd54fc6b486-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bf126b07-da06-4140-9a57-dfd54fc6b486" (UID: "bf126b07-da06-4140-9a57-dfd54fc6b486"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c4vf\" (UniqueName: \"kubernetes.io/projected/22c825df-677d-4ca6-82db-3454ed06e783-kube-api-access-7c4vf\") pod \"22c825df-677d-4ca6-82db-3454ed06e783\" (UID: \"22c825df-677d-4ca6-82db-3454ed06e783\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-webhook-cert\") pod \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\" (UID: \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310599 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e6199b-1264-4501-8953-767f51328d08-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "e7e6199b-1264-4501-8953-767f51328d08" (UID: "e7e6199b-1264-4501-8953-767f51328d08"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7539238d-5fe0-46ed-884e-1c3b566537ec-serving-cert\") pod \"7539238d-5fe0-46ed-884e-1c3b566537ec\" (UID: \"7539238d-5fe0-46ed-884e-1c3b566537ec\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-config" (OuterVolumeSpecName: "config") pod "8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" (UID: "8cea82b4-6893-4ddc-af9f-1bb5ae425c5b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22c825df-677d-4ca6-82db-3454ed06e783-kube-api-access-7c4vf" (OuterVolumeSpecName: "kube-api-access-7c4vf") pod "22c825df-677d-4ca6-82db-3454ed06e783" (UID: "22c825df-677d-4ca6-82db-3454ed06e783"). InnerVolumeSpecName "kube-api-access-7c4vf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310721 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a31745f5-9847-4afe-82a5-3161cc66ca93-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "a31745f5-9847-4afe-82a5-3161cc66ca93" (UID: "a31745f5-9847-4afe-82a5-3161cc66ca93"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-available-featuregates\") pod \"bc5039c0-ea34-426b-a2b7-fbbc87b49a6d\" (UID: \"bc5039c0-ea34-426b-a2b7-fbbc87b49a6d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1386a44e-36a2-460c-96d0-0359d2b6f0f5-serving-cert\") pod \"1386a44e-36a2-460c-96d0-0359d2b6f0f5\" (UID: \"1386a44e-36a2-460c-96d0-0359d2b6f0f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.310985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01ab3dd5-8196-46d0-ad33-122e2ca51def-config\") pod \"01ab3dd5-8196-46d0-ad33-122e2ca51def\" (UID: \"01ab3dd5-8196-46d0-ad33-122e2ca51def\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311008 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf2bz\" (UniqueName: \"kubernetes.io/projected/1d611f23-29be-4491-8495-bee1670e935f-kube-api-access-bf2bz\") pod \"1d611f23-29be-4491-8495-bee1670e935f\" (UID: \"1d611f23-29be-4491-8495-bee1670e935f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7539238d-5fe0-46ed-884e-1c3b566537ec-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "7539238d-5fe0-46ed-884e-1c3b566537ec" (UID: "7539238d-5fe0-46ed-884e-1c3b566537ec"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-service-ca\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-config\") pod \"6ea678ab-3438-413e-bfe3-290ae7725660\" (UID: \"6ea678ab-3438-413e-bfe3-290ae7725660\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-provider-selection\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-bound-sa-token\") pod \"bf126b07-da06-4140-9a57-dfd54fc6b486\" (UID: \"bf126b07-da06-4140-9a57-dfd54fc6b486\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-utilities\") pod \"57a731c4-ef35-47a8-b875-bfb08a7f8011\" (UID: \"57a731c4-ef35-47a8-b875-bfb08a7f8011\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-ocp-branding-template\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-cliconfig\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-profile-collector-cert\") pod \"f88749ec-7931-4ee7-b3fc-1ec5e11f92e9\" (UID: \"f88749ec-7931-4ee7-b3fc-1ec5e11f92e9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311243 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fda69060-fa79-4696-b1a6-7980f124bf7c-mcd-auth-proxy-config\") pod \"fda69060-fa79-4696-b1a6-7980f124bf7c\" (UID: \"fda69060-fa79-4696-b1a6-7980f124bf7c\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-audit\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-apiservice-cert\") pod \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\" (UID: \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-serving-cert\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/496e6271-fb68-4057-954e-a0d97a4afa3f-kube-api-access\") pod \"496e6271-fb68-4057-954e-a0d97a4afa3f\" (UID: \"496e6271-fb68-4057-954e-a0d97a4afa3f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-serving-cert\") pod \"8cea82b4-6893-4ddc-af9f-1bb5ae425c5b\" (UID: \"8cea82b4-6893-4ddc-af9f-1bb5ae425c5b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b574797-001e-440a-8f4e-c0be86edad0f-mcc-auth-proxy-config" (OuterVolumeSpecName: "mcc-auth-proxy-config") pod "0b574797-001e-440a-8f4e-c0be86edad0f" (UID: "0b574797-001e-440a-8f4e-c0be86edad0f"). InnerVolumeSpecName "mcc-auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-config\") pod \"7583ce53-e0fe-4a16-9e4d-50516596a136\" (UID: \"7583ce53-e0fe-4a16-9e4d-50516596a136\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" (UID: "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4xd4\" (UniqueName: \"kubernetes.io/projected/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-kube-api-access-w4xd4\") pod \"8cea82b4-6893-4ddc-af9f-1bb5ae425c5b\" (UID: \"8cea82b4-6893-4ddc-af9f-1bb5ae425c5b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe579f8-e8a6-4643-bce5-a661393c4dde-kube-api-access-fcqwp" (OuterVolumeSpecName: "kube-api-access-fcqwp") pod "5fe579f8-e8a6-4643-bce5-a661393c4dde" (UID: "5fe579f8-e8a6-4643-bce5-a661393c4dde"). InnerVolumeSpecName "kube-api-access-fcqwp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311459 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt5rc\" (UniqueName: \"kubernetes.io/projected/44663579-783b-4372-86d6-acf235a62d72-kube-api-access-vt5rc\") pod \"44663579-783b-4372-86d6-acf235a62d72\" (UID: \"44663579-783b-4372-86d6-acf235a62d72\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-stats-auth\") pod \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\" (UID: \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311532 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d4hj\" (UniqueName: \"kubernetes.io/projected/3ab1a177-2de0-46d9-b765-d0d0649bb42e-kube-api-access-4d4hj\") pod \"3ab1a177-2de0-46d9-b765-d0d0649bb42e\" (UID: \"3ab1a177-2de0-46d9-b765-d0d0649bb42e\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2m85\" (UniqueName: \"kubernetes.io/projected/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d-kube-api-access-x2m85\") pod \"cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d\" (UID: \"cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-utilities\") pod \"b11524ee-3fca-4b1b-9cdf-6da289fdbc7d\" (UID: \"b11524ee-3fca-4b1b-9cdf-6da289fdbc7d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311600 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-service-ca\") pod \"09efc573-dbb6-4249-bd59-9b87aba8dd28\" (UID: \"09efc573-dbb6-4249-bd59-9b87aba8dd28\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-utilities\") pod \"5225d0e4-402f-4861-b410-819f433b1803\" (UID: \"5225d0e4-402f-4861-b410-819f433b1803\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-images\") pod \"31d8b7a1-420e-4252-a5b7-eebe8a111292\" (UID: \"31d8b7a1-420e-4252-a5b7-eebe8a111292\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f668bae-612b-4b75-9490-919e737c6a3b-installation-pull-secrets\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tdtz\" (UniqueName: \"kubernetes.io/projected/09efc573-dbb6-4249-bd59-9b87aba8dd28-kube-api-access-8tdtz\") pod \"09efc573-dbb6-4249-bd59-9b87aba8dd28\" (UID: \"09efc573-dbb6-4249-bd59-9b87aba8dd28\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311697 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" (UID: "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-kube-api-access-w4xd4" (OuterVolumeSpecName: "kube-api-access-w4xd4") pod "8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" (UID: "8cea82b4-6893-4ddc-af9f-1bb5ae425c5b"). InnerVolumeSpecName "kube-api-access-w4xd4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-client\") pod \"09efc573-dbb6-4249-bd59-9b87aba8dd28\" (UID: \"09efc573-dbb6-4249-bd59-9b87aba8dd28\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0b78653f-4ff9-4508-8672-245ed9b561e3-kube-api-access\") pod \"0b78653f-4ff9-4508-8672-245ed9b561e3\" (UID: \"0b78653f-4ff9-4508-8672-245ed9b561e3\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-tmpfs\") pod \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\" (UID: \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311791 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496e6271-fb68-4057-954e-a0d97a4afa3f-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "496e6271-fb68-4057-954e-a0d97a4afa3f" (UID: "496e6271-fb68-4057-954e-a0d97a4afa3f"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-config\") pod \"6402fda4-df10-493c-b4e5-d0569419652d\" (UID: \"6402fda4-df10-493c-b4e5-d0569419652d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-available-featuregates" (OuterVolumeSpecName: "available-featuregates") pod "bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" (UID: "bc5039c0-ea34-426b-a2b7-fbbc87b49a6d"). InnerVolumeSpecName "available-featuregates". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01ab3dd5-8196-46d0-ad33-122e2ca51def-serving-cert\") pod \"01ab3dd5-8196-46d0-ad33-122e2ca51def\" (UID: \"01ab3dd5-8196-46d0-ad33-122e2ca51def\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311861 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-bound-sa-token\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b78653f-4ff9-4508-8672-245ed9b561e3-service-ca\") pod \"0b78653f-4ff9-4508-8672-245ed9b561e3\" (UID: \"0b78653f-4ff9-4508-8672-245ed9b561e3\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "09efc573-dbb6-4249-bd59-9b87aba8dd28" (UID: "09efc573-dbb6-4249-bd59-9b87aba8dd28"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-trusted-ca\") pod \"b6cd30de-2eeb-49a2-ab40-9167f4560ff5\" (UID: \"b6cd30de-2eeb-49a2-ab40-9167f4560ff5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.311996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-key\") pod \"25e176fe-21b4-4974-b1ed-c8b94f112a7f\" (UID: \"25e176fe-21b4-4974-b1ed-c8b94f112a7f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" (UID: "f88749ec-7931-4ee7-b3fc-1ec5e11f92e9"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-certs\") pod \"5fe579f8-e8a6-4643-bce5-a661393c4dde\" (UID: \"5fe579f8-e8a6-4643-bce5-a661393c4dde\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b574797-001e-440a-8f4e-c0be86edad0f-proxy-tls\") pod \"0b574797-001e-440a-8f4e-c0be86edad0f\" (UID: \"0b574797-001e-440a-8f4e-c0be86edad0f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxkg8\" (UniqueName: \"kubernetes.io/projected/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-kube-api-access-wxkg8\") pod \"3cb93b32-e0ae-4377-b9c8-fdb9842c6d59\" (UID: \"3cb93b32-e0ae-4377-b9c8-fdb9842c6d59\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w9zh\" (UniqueName: \"kubernetes.io/projected/4bb40260-dbaa-4fb0-84df-5e680505d512-kube-api-access-2w9zh\") pod \"4bb40260-dbaa-4fb0-84df-5e680505d512\" (UID: \"4bb40260-dbaa-4fb0-84df-5e680505d512\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-serving-cert\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44663579-783b-4372-86d6-acf235a62d72-kube-api-access-vt5rc" (OuterVolumeSpecName: "kube-api-access-vt5rc") pod "44663579-783b-4372-86d6-acf235a62d72" (UID: "44663579-783b-4372-86d6-acf235a62d72"). InnerVolumeSpecName "kube-api-access-vt5rc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-multus-daemon-config\") pod \"4bb40260-dbaa-4fb0-84df-5e680505d512\" (UID: \"4bb40260-dbaa-4fb0-84df-5e680505d512\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-oauth-config\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-249nr\" (UniqueName: \"kubernetes.io/projected/b6312bbd-5731-4ea0-a20f-81d5a57df44a-kube-api-access-249nr\") pod \"b6312bbd-5731-4ea0-a20f-81d5a57df44a\" (UID: \"b6312bbd-5731-4ea0-a20f-81d5a57df44a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7583ce53-e0fe-4a16-9e4d-50516596a136-serving-cert\") pod \"7583ce53-e0fe-4a16-9e4d-50516596a136\" (UID: \"7583ce53-e0fe-4a16-9e4d-50516596a136\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d611f23-29be-4491-8495-bee1670e935f-kube-api-access-bf2bz" (OuterVolumeSpecName: "kube-api-access-bf2bz") pod "1d611f23-29be-4491-8495-bee1670e935f" (UID: "1d611f23-29be-4491-8495-bee1670e935f"). InnerVolumeSpecName "kube-api-access-bf2bz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ccd8\" (UniqueName: \"kubernetes.io/projected/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-kube-api-access-6ccd8\") pod \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\" (UID: \"308be0ea-9f5f-4b29-aeb1-5abd31a0b17b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xfj7\" (UniqueName: \"kubernetes.io/projected/5225d0e4-402f-4861-b410-819f433b1803-kube-api-access-9xfj7\") pod \"5225d0e4-402f-4861-b410-819f433b1803\" (UID: \"5225d0e4-402f-4861-b410-819f433b1803\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-metrics-certs\") pod \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\" (UID: \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkwtn\" (UniqueName: \"kubernetes.io/projected/5b88f790-22fa-440e-b583-365168c0b23d-kube-api-access-jkwtn\") pod \"5b88f790-22fa-440e-b583-365168c0b23d\" (UID: \"5b88f790-22fa-440e-b583-365168c0b23d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-stats-auth" (OuterVolumeSpecName: "stats-auth") pod "c03ee662-fb2f-4fc4-a2c1-af487c19d254" (UID: "c03ee662-fb2f-4fc4-a2c1-af487c19d254"). InnerVolumeSpecName "stats-auth". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-serving-cert\") pod \"bc5039c0-ea34-426b-a2b7-fbbc87b49a6d\" (UID: \"bc5039c0-ea34-426b-a2b7-fbbc87b49a6d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7e6199b-1264-4501-8953-767f51328d08-kube-api-access\") pod \"e7e6199b-1264-4501-8953-767f51328d08\" (UID: \"e7e6199b-1264-4501-8953-767f51328d08\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9rds\" (UniqueName: \"kubernetes.io/projected/20b0d48f-5fd6-431c-a545-e3c800c7b866-kube-api-access-w9rds\") pod \"20b0d48f-5fd6-431c-a545-e3c800c7b866\" (UID: \"20b0d48f-5fd6-431c-a545-e3c800c7b866\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6509e943-70c6-444c-bc41-48a544e36fbd-serving-cert\") pod \"6509e943-70c6-444c-bc41-48a544e36fbd\" (UID: \"6509e943-70c6-444c-bc41-48a544e36fbd\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab1a177-2de0-46d9-b765-d0d0649bb42e-kube-api-access-4d4hj" (OuterVolumeSpecName: "kube-api-access-4d4hj") pod "3ab1a177-2de0-46d9-b765-d0d0649bb42e" (UID: "3ab1a177-2de0-46d9-b765-d0d0649bb42e"). InnerVolumeSpecName "kube-api-access-4d4hj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-config\") pod \"09efc573-dbb6-4249-bd59-9b87aba8dd28\" (UID: \"09efc573-dbb6-4249-bd59-9b87aba8dd28\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzwt7\" (UniqueName: \"kubernetes.io/projected/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-kube-api-access-nzwt7\") pod \"96b93a3a-6083-4aea-8eab-fe1aa8245ad9\" (UID: \"96b93a3a-6083-4aea-8eab-fe1aa8245ad9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bf126b07-da06-4140-9a57-dfd54fc6b486" (UID: "bf126b07-da06-4140-9a57-dfd54fc6b486"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda69060-fa79-4696-b1a6-7980f124bf7c-mcd-auth-proxy-config" (OuterVolumeSpecName: "mcd-auth-proxy-config") pod "fda69060-fa79-4696-b1a6-7980f124bf7c" (UID: "fda69060-fa79-4696-b1a6-7980f124bf7c"). InnerVolumeSpecName "mcd-auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" (UID: "bc5039c0-ea34-426b-a2b7-fbbc87b49a6d"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d-kube-api-access-x2m85" (OuterVolumeSpecName: "kube-api-access-x2m85") pod "cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d" (UID: "cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d"). InnerVolumeSpecName "kube-api-access-x2m85". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313033 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" (UID: "8cea82b4-6893-4ddc-af9f-1bb5ae425c5b"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-utilities" (OuterVolumeSpecName: "utilities") pod "57a731c4-ef35-47a8-b875-bfb08a7f8011" (UID: "57a731c4-ef35-47a8-b875-bfb08a7f8011"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.313036 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:07.813007311 +0000 UTC m=+26.513669139 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-utilities" (OuterVolumeSpecName: "utilities") pod "b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" (UID: "b11524ee-3fca-4b1b-9cdf-6da289fdbc7d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313244 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-audit" (OuterVolumeSpecName: "audit") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "audit". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.312842 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs4fp\" (UniqueName: \"kubernetes.io/projected/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-kube-api-access-qs4fp\") pod \"210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c\" (UID: \"210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-catalog-content\") pod \"5225d0e4-402f-4861-b410-819f433b1803\" (UID: \"5225d0e4-402f-4861-b410-819f433b1803\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-script-lib\") pod \"6ea678ab-3438-413e-bfe3-290ae7725660\" (UID: \"6ea678ab-3438-413e-bfe3-290ae7725660\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6qdx\" (UniqueName: \"kubernetes.io/projected/87cf06ed-a83f-41a7-828d-70653580a8cb-kube-api-access-d6qdx\") pod \"87cf06ed-a83f-41a7-828d-70653580a8cb\" (UID: \"87cf06ed-a83f-41a7-828d-70653580a8cb\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-env-overrides\") pod \"925f1c65-6136-48ba-85aa-3a3b50560753\" (UID: \"925f1c65-6136-48ba-85aa-3a3b50560753\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313500 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4lsv\" (UniqueName: \"kubernetes.io/projected/25e176fe-21b4-4974-b1ed-c8b94f112a7f-kube-api-access-d4lsv\") pod \"25e176fe-21b4-4974-b1ed-c8b94f112a7f\" (UID: \"25e176fe-21b4-4974-b1ed-c8b94f112a7f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-serviceca\") pod \"3cb93b32-e0ae-4377-b9c8-fdb9842c6d59\" (UID: \"3cb93b32-e0ae-4377-b9c8-fdb9842c6d59\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkvpv\" (UniqueName: \"kubernetes.io/projected/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-kube-api-access-zkvpv\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-client-ca\") pod \"7583ce53-e0fe-4a16-9e4d-50516596a136\" (UID: \"7583ce53-e0fe-4a16-9e4d-50516596a136\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/6731426b-95fe-49ff-bb5f-40441049fde2-control-plane-machine-set-operator-tls\") pod \"6731426b-95fe-49ff-bb5f-40441049fde2\" (UID: \"6731426b-95fe-49ff-bb5f-40441049fde2\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31d8b7a1-420e-4252-a5b7-eebe8a111292-proxy-tls\") pod \"31d8b7a1-420e-4252-a5b7-eebe8a111292\" (UID: \"31d8b7a1-420e-4252-a5b7-eebe8a111292\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-ovnkube-config\") pod \"925f1c65-6136-48ba-85aa-3a3b50560753\" (UID: \"925f1c65-6136-48ba-85aa-3a3b50560753\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-client\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e6199b-1264-4501-8953-767f51328d08-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "e7e6199b-1264-4501-8953-767f51328d08" (UID: "e7e6199b-1264-4501-8953-767f51328d08"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-serving-cert\") pod \"09efc573-dbb6-4249-bd59-9b87aba8dd28\" (UID: \"09efc573-dbb6-4249-bd59-9b87aba8dd28\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-metrics-tls\") pod \"96b93a3a-6083-4aea-8eab-fe1aa8245ad9\" (UID: \"96b93a3a-6083-4aea-8eab-fe1aa8245ad9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313873 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-trusted-ca-bundle\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/925f1c65-6136-48ba-85aa-3a3b50560753-ovn-control-plane-metrics-cert\") pod \"925f1c65-6136-48ba-85aa-3a3b50560753\" (UID: \"925f1c65-6136-48ba-85aa-3a3b50560753\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c03ee662-fb2f-4fc4-a2c1-af487c19d254-service-ca-bundle\") pod \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\" (UID: \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/6402fda4-df10-493c-b4e5-d0569419652d-machine-api-operator-tls\") pod \"6402fda4-df10-493c-b4e5-d0569419652d\" (UID: \"6402fda4-df10-493c-b4e5-d0569419652d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-console-config\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.313987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-node-bootstrap-token\") pod \"5fe579f8-e8a6-4643-bce5-a661393c4dde\" (UID: \"5fe579f8-e8a6-4643-bce5-a661393c4dde\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314008 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7e6199b-1264-4501-8953-767f51328d08-config\") pod \"e7e6199b-1264-4501-8953-767f51328d08\" (UID: \"e7e6199b-1264-4501-8953-767f51328d08\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-srv-cert\") pod \"f88749ec-7931-4ee7-b3fc-1ec5e11f92e9\" (UID: \"f88749ec-7931-4ee7-b3fc-1ec5e11f92e9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-encryption-config\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-serving-ca\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-image-import-ca\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/efdd0498-1daa-4136-9a4a-3b948c2293fc-webhook-certs\") pod \"efdd0498-1daa-4136-9a4a-3b948c2293fc\" (UID: \"efdd0498-1daa-4136-9a4a-3b948c2293fc\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-service-ca-bundle\") pod \"6509e943-70c6-444c-bc41-48a544e36fbd\" (UID: \"6509e943-70c6-444c-bc41-48a544e36fbd\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcgwh\" (UniqueName: \"kubernetes.io/projected/fda69060-fa79-4696-b1a6-7980f124bf7c-kube-api-access-xcgwh\") pod \"fda69060-fa79-4696-b1a6-7980f124bf7c\" (UID: \"fda69060-fa79-4696-b1a6-7980f124bf7c\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgdk5\" (UniqueName: \"kubernetes.io/projected/31d8b7a1-420e-4252-a5b7-eebe8a111292-kube-api-access-zgdk5\") pod \"31d8b7a1-420e-4252-a5b7-eebe8a111292\" (UID: \"31d8b7a1-420e-4252-a5b7-eebe8a111292\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314236 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjr6v\" (UniqueName: \"kubernetes.io/projected/49ef4625-1d3a-4a9f-b595-c2433d32326d-kube-api-access-pjr6v\") pod \"49ef4625-1d3a-4a9f-b595-c2433d32326d\" (UID: \"49ef4625-1d3a-4a9f-b595-c2433d32326d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-session\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f668bae-612b-4b75-9490-919e737c6a3b-ca-trust-extracted\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-service-ca" (OuterVolumeSpecName: "etcd-service-ca") pod "09efc573-dbb6-4249-bd59-9b87aba8dd28" (UID: "09efc573-dbb6-4249-bd59-9b87aba8dd28"). InnerVolumeSpecName "etcd-service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-client\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20b0d48f-5fd6-431c-a545-e3c800c7b866-kube-api-access-w9rds" (OuterVolumeSpecName: "kube-api-access-w9rds") pod "20b0d48f-5fd6-431c-a545-e3c800c7b866" (UID: "20b0d48f-5fd6-431c-a545-e3c800c7b866"). InnerVolumeSpecName "kube-api-access-w9rds". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g6sz\" (UniqueName: \"kubernetes.io/projected/6509e943-70c6-444c-bc41-48a544e36fbd-kube-api-access-6g6sz\") pod \"6509e943-70c6-444c-bc41-48a544e36fbd\" (UID: \"6509e943-70c6-444c-bc41-48a544e36fbd\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-config" (OuterVolumeSpecName: "config") pod "7583ce53-e0fe-4a16-9e4d-50516596a136" (UID: "7583ce53-e0fe-4a16-9e4d-50516596a136"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-trusted-ca-bundle\") pod \"6509e943-70c6-444c-bc41-48a544e36fbd\" (UID: \"6509e943-70c6-444c-bc41-48a544e36fbd\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314396 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "925f1c65-6136-48ba-85aa-3a3b50560753" (UID: "925f1c65-6136-48ba-85aa-3a3b50560753"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-trusted-ca\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-config\") pod \"6509e943-70c6-444c-bc41-48a544e36fbd\" (UID: \"6509e943-70c6-444c-bc41-48a544e36fbd\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-registry-tls\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314599 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6509e943-70c6-444c-bc41-48a544e36fbd-kube-api-access-6g6sz" (OuterVolumeSpecName: "kube-api-access-6g6sz") pod "6509e943-70c6-444c-bc41-48a544e36fbd" (UID: "6509e943-70c6-444c-bc41-48a544e36fbd"). InnerVolumeSpecName "kube-api-access-6g6sz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-registry-certificates\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314659 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-config\") pod \"9d4552c7-cd75-42dd-8880-30dd377c49a4\" (UID: \"9d4552c7-cd75-42dd-8880-30dd377c49a4\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-utilities" (OuterVolumeSpecName: "utilities") pod "5225d0e4-402f-4861-b410-819f433b1803" (UID: "5225d0e4-402f-4861-b410-819f433b1803"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-samples-operator-tls\") pod \"a0128f3a-b052-44ed-a84e-c4c8aaf17c13\" (UID: \"a0128f3a-b052-44ed-a84e-c4c8aaf17c13\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v47cf\" (UniqueName: \"kubernetes.io/projected/c03ee662-fb2f-4fc4-a2c1-af487c19d254-kube-api-access-v47cf\") pod \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\" (UID: \"c03ee662-fb2f-4fc4-a2c1-af487c19d254\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-audit-policies\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-config\") pod \"5441d097-087c-4d9a-baa8-b210afa90fc9\" (UID: \"5441d097-087c-4d9a-baa8-b210afa90fc9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-kube-api-access-wxkg8" (OuterVolumeSpecName: "kube-api-access-wxkg8") pod "3cb93b32-e0ae-4377-b9c8-fdb9842c6d59" (UID: "3cb93b32-e0ae-4377-b9c8-fdb9842c6d59"). InnerVolumeSpecName "kube-api-access-wxkg8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-env-overrides\") pod \"6ea678ab-3438-413e-bfe3-290ae7725660\" (UID: \"6ea678ab-3438-413e-bfe3-290ae7725660\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-kube-api-access-qs4fp" (OuterVolumeSpecName: "kube-api-access-qs4fp") pod "210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" (UID: "210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c"). InnerVolumeSpecName "kube-api-access-qs4fp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb40260-dbaa-4fb0-84df-5e680505d512-kube-api-access-2w9zh" (OuterVolumeSpecName: "kube-api-access-2w9zh") pod "4bb40260-dbaa-4fb0-84df-5e680505d512" (UID: "4bb40260-dbaa-4fb0-84df-5e680505d512"). InnerVolumeSpecName "kube-api-access-2w9zh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "09efc573-dbb6-4249-bd59-9b87aba8dd28" (UID: "09efc573-dbb6-4249-bd59-9b87aba8dd28"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-images" (OuterVolumeSpecName: "images") pod "31d8b7a1-420e-4252-a5b7-eebe8a111292" (UID: "31d8b7a1-420e-4252-a5b7-eebe8a111292"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "96b93a3a-6083-4aea-8eab-fe1aa8245ad9" (UID: "96b93a3a-6083-4aea-8eab-fe1aa8245ad9"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f668bae-612b-4b75-9490-919e737c6a3b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "22c825df-677d-4ca6-82db-3454ed06e783" (UID: "22c825df-677d-4ca6-82db-3454ed06e783"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.315975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.316105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09efc573-dbb6-4249-bd59-9b87aba8dd28-kube-api-access-8tdtz" (OuterVolumeSpecName: "kube-api-access-8tdtz") pod "09efc573-dbb6-4249-bd59-9b87aba8dd28" (UID: "09efc573-dbb6-4249-bd59-9b87aba8dd28"). InnerVolumeSpecName "kube-api-access-8tdtz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.316178 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-multus-daemon-config" (OuterVolumeSpecName: "multus-daemon-config") pod "4bb40260-dbaa-4fb0-84df-5e680505d512" (UID: "4bb40260-dbaa-4fb0-84df-5e680505d512"). InnerVolumeSpecName "multus-daemon-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.316431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/925f1c65-6136-48ba-85aa-3a3b50560753-ovn-control-plane-metrics-cert" (OuterVolumeSpecName: "ovn-control-plane-metrics-cert") pod "925f1c65-6136-48ba-85aa-3a3b50560753" (UID: "925f1c65-6136-48ba-85aa-3a3b50560753"). InnerVolumeSpecName "ovn-control-plane-metrics-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.316856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5441d097-087c-4d9a-baa8-b210afa90fc9-kube-api-access-2d4wz" (OuterVolumeSpecName: "kube-api-access-2d4wz") pod "5441d097-087c-4d9a-baa8-b210afa90fc9" (UID: "5441d097-087c-4d9a-baa8-b210afa90fc9"). InnerVolumeSpecName "kube-api-access-2d4wz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.317045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b574797-001e-440a-8f4e-c0be86edad0f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0b574797-001e-440a-8f4e-c0be86edad0f" (UID: "0b574797-001e-440a-8f4e-c0be86edad0f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.317495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6509e943-70c6-444c-bc41-48a544e36fbd-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "6509e943-70c6-444c-bc41-48a544e36fbd" (UID: "6509e943-70c6-444c-bc41-48a544e36fbd"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.317542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "6ea678ab-3438-413e-bfe3-290ae7725660" (UID: "6ea678ab-3438-413e-bfe3-290ae7725660"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.317749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-kube-api-access-6ccd8" (OuterVolumeSpecName: "kube-api-access-6ccd8") pod "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" (UID: "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b"). InnerVolumeSpecName "kube-api-access-6ccd8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.319216 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.319236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1386a44e-36a2-460c-96d0-0359d2b6f0f5-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "1386a44e-36a2-460c-96d0-0359d2b6f0f5" (UID: "1386a44e-36a2-460c-96d0-0359d2b6f0f5"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.319511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7583ce53-e0fe-4a16-9e4d-50516596a136-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "7583ce53-e0fe-4a16-9e4d-50516596a136" (UID: "7583ce53-e0fe-4a16-9e4d-50516596a136"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.319540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5225d0e4-402f-4861-b410-819f433b1803-kube-api-access-9xfj7" (OuterVolumeSpecName: "kube-api-access-9xfj7") pod "5225d0e4-402f-4861-b410-819f433b1803" (UID: "5225d0e4-402f-4861-b410-819f433b1803"). InnerVolumeSpecName "kube-api-access-9xfj7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.319872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-config" (OuterVolumeSpecName: "config") pod "9d4552c7-cd75-42dd-8880-30dd377c49a4" (UID: "9d4552c7-cd75-42dd-8880-30dd377c49a4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.320122 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-kube-api-access-zkvpv" (OuterVolumeSpecName: "kube-api-access-zkvpv") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "kube-api-access-zkvpv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.320752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdd0498-1daa-4136-9a4a-3b948c2293fc-webhook-certs" (OuterVolumeSpecName: "webhook-certs") pod "efdd0498-1daa-4136-9a4a-3b948c2293fc" (UID: "efdd0498-1daa-4136-9a4a-3b948c2293fc"). InnerVolumeSpecName "webhook-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b88f790-22fa-440e-b583-365168c0b23d-kube-api-access-jkwtn" (OuterVolumeSpecName: "kube-api-access-jkwtn") pod "5b88f790-22fa-440e-b583-365168c0b23d" (UID: "5b88f790-22fa-440e-b583-365168c0b23d"). InnerVolumeSpecName "kube-api-access-jkwtn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03ee662-fb2f-4fc4-a2c1-af487c19d254-kube-api-access-v47cf" (OuterVolumeSpecName: "kube-api-access-v47cf") pod "c03ee662-fb2f-4fc4-a2c1-af487c19d254" (UID: "c03ee662-fb2f-4fc4-a2c1-af487c19d254"). InnerVolumeSpecName "kube-api-access-v47cf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87cf06ed-a83f-41a7-828d-70653580a8cb-kube-api-access-d6qdx" (OuterVolumeSpecName: "kube-api-access-d6qdx") pod "87cf06ed-a83f-41a7-828d-70653580a8cb" (UID: "87cf06ed-a83f-41a7-828d-70653580a8cb"). InnerVolumeSpecName "kube-api-access-d6qdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda69060-fa79-4696-b1a6-7980f124bf7c-kube-api-access-xcgwh" (OuterVolumeSpecName: "kube-api-access-xcgwh") pod "fda69060-fa79-4696-b1a6-7980f124bf7c" (UID: "fda69060-fa79-4696-b1a6-7980f124bf7c"). InnerVolumeSpecName "kube-api-access-xcgwh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c03ee662-fb2f-4fc4-a2c1-af487c19d254" (UID: "c03ee662-fb2f-4fc4-a2c1-af487c19d254"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" (UID: "308be0ea-9f5f-4b29-aeb1-5abd31a0b17b"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321642 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-node-bootstrap-token" (OuterVolumeSpecName: "node-bootstrap-token") pod "5fe579f8-e8a6-4643-bce5-a661393c4dde" (UID: "5fe579f8-e8a6-4643-bce5-a661393c4dde"). InnerVolumeSpecName "node-bootstrap-token". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.314857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-auth-proxy-config\") pod \"22c825df-677d-4ca6-82db-3454ed06e783\" (UID: \"22c825df-677d-4ca6-82db-3454ed06e783\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/496e6271-fb68-4057-954e-a0d97a4afa3f-config\") pod \"496e6271-fb68-4057-954e-a0d97a4afa3f\" (UID: \"496e6271-fb68-4057-954e-a0d97a4afa3f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321956 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf66m\" (UniqueName: \"kubernetes.io/projected/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-kube-api-access-gf66m\") pod \"a0128f3a-b052-44ed-a84e-c4c8aaf17c13\" (UID: \"a0128f3a-b052-44ed-a84e-c4c8aaf17c13\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.321981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a31745f5-9847-4afe-82a5-3161cc66ca93-trusted-ca\") pod \"a31745f5-9847-4afe-82a5-3161cc66ca93\" (UID: \"a31745f5-9847-4afe-82a5-3161cc66ca93\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-serving-cert\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-service-ca\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87cf06ed-a83f-41a7-828d-70653580a8cb-metrics-tls\") pod \"87cf06ed-a83f-41a7-828d-70653580a8cb\" (UID: \"87cf06ed-a83f-41a7-828d-70653580a8cb\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-images\") pod \"6402fda4-df10-493c-b4e5-d0569419652d\" (UID: \"6402fda4-df10-493c-b4e5-d0569419652d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322099 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk88c\" (UniqueName: \"kubernetes.io/projected/7539238d-5fe0-46ed-884e-1c3b566537ec-kube-api-access-tk88c\") pod \"7539238d-5fe0-46ed-884e-1c3b566537ec\" (UID: \"7539238d-5fe0-46ed-884e-1c3b566537ec\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-trusted-ca-bundle\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbsvg\" (UniqueName: \"kubernetes.io/projected/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-kube-api-access-dbsvg\") pod \"f88749ec-7931-4ee7-b3fc-1ec5e11f92e9\" (UID: \"f88749ec-7931-4ee7-b3fc-1ec5e11f92e9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-cabundle\") pod \"25e176fe-21b4-4974-b1ed-c8b94f112a7f\" (UID: \"25e176fe-21b4-4974-b1ed-c8b94f112a7f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322235 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfbct\" (UniqueName: \"kubernetes.io/projected/57a731c4-ef35-47a8-b875-bfb08a7f8011-kube-api-access-cfbct\") pod \"57a731c4-ef35-47a8-b875-bfb08a7f8011\" (UID: \"57a731c4-ef35-47a8-b875-bfb08a7f8011\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-profile-collector-cert\") pod \"b6312bbd-5731-4ea0-a20f-81d5a57df44a\" (UID: \"b6312bbd-5731-4ea0-a20f-81d5a57df44a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87cf06ed-a83f-41a7-828d-70653580a8cb-config-volume\") pod \"87cf06ed-a83f-41a7-828d-70653580a8cb\" (UID: \"87cf06ed-a83f-41a7-828d-70653580a8cb\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b78653f-4ff9-4508-8672-245ed9b561e3-serving-cert\") pod \"0b78653f-4ff9-4508-8672-245ed9b561e3\" (UID: \"0b78653f-4ff9-4508-8672-245ed9b561e3\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htfz6\" (UniqueName: \"kubernetes.io/projected/6ea678ab-3438-413e-bfe3-290ae7725660-kube-api-access-htfz6\") pod \"6ea678ab-3438-413e-bfe3-290ae7725660\" (UID: \"6ea678ab-3438-413e-bfe3-290ae7725660\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-audit-policies\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcphl\" (UniqueName: \"kubernetes.io/projected/7583ce53-e0fe-4a16-9e4d-50516596a136-kube-api-access-xcphl\") pod \"7583ce53-e0fe-4a16-9e4d-50516596a136\" (UID: \"7583ce53-e0fe-4a16-9e4d-50516596a136\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-proxy-ca-bundles\") pod \"7583ce53-e0fe-4a16-9e4d-50516596a136\" (UID: \"7583ce53-e0fe-4a16-9e4d-50516596a136\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5441d097-087c-4d9a-baa8-b210afa90fc9-serving-cert\") pod \"5441d097-087c-4d9a-baa8-b210afa90fc9\" (UID: \"5441d097-087c-4d9a-baa8-b210afa90fc9\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-encryption-config\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4zgh\" (UniqueName: \"kubernetes.io/projected/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-kube-api-access-x4zgh\") pod \"b11524ee-3fca-4b1b-9cdf-6da289fdbc7d\" (UID: \"b11524ee-3fca-4b1b-9cdf-6da289fdbc7d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322483 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhbk2\" (UniqueName: \"kubernetes.io/projected/bd23aa5c-e532-4e53-bccf-e79f130c5ae8-kube-api-access-jhbk2\") pod \"bd23aa5c-e532-4e53-bccf-e79f130c5ae8\" (UID: \"bd23aa5c-e532-4e53-bccf-e79f130c5ae8\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-catalog-content\") pod \"b11524ee-3fca-4b1b-9cdf-6da289fdbc7d\" (UID: \"b11524ee-3fca-4b1b-9cdf-6da289fdbc7d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7l8j\" (UniqueName: \"kubernetes.io/projected/01ab3dd5-8196-46d0-ad33-122e2ca51def-kube-api-access-w7l8j\") pod \"01ab3dd5-8196-46d0-ad33-122e2ca51def\" (UID: \"01ab3dd5-8196-46d0-ad33-122e2ca51def\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-config\") pod \"210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c\" (UID: \"210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnphk\" (UniqueName: \"kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-kube-api-access-rnphk\") pod \"bf126b07-da06-4140-9a57-dfd54fc6b486\" (UID: \"bf126b07-da06-4140-9a57-dfd54fc6b486\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4n52\" (UniqueName: \"kubernetes.io/projected/925f1c65-6136-48ba-85aa-3a3b50560753-kube-api-access-s4n52\") pod \"925f1c65-6136-48ba-85aa-3a3b50560753\" (UID: \"925f1c65-6136-48ba-85aa-3a3b50560753\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-279lb\" (UniqueName: \"kubernetes.io/projected/7bb08738-c794-4ee8-9972-3a62ca171029-kube-api-access-279lb\") pod \"7bb08738-c794-4ee8-9972-3a62ca171029\" (UID: \"7bb08738-c794-4ee8-9972-3a62ca171029\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fda69060-fa79-4696-b1a6-7980f124bf7c-proxy-tls\") pod \"fda69060-fa79-4696-b1a6-7980f124bf7c\" (UID: \"fda69060-fa79-4696-b1a6-7980f124bf7c\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-sysctl-allowlist\") pod \"7bb08738-c794-4ee8-9972-3a62ca171029\" (UID: \"7bb08738-c794-4ee8-9972-3a62ca171029\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7zkh\" (UniqueName: \"kubernetes.io/projected/6731426b-95fe-49ff-bb5f-40441049fde2-kube-api-access-x7zkh\") pod \"6731426b-95fe-49ff-bb5f-40441049fde2\" (UID: \"6731426b-95fe-49ff-bb5f-40441049fde2\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d4552c7-cd75-42dd-8880-30dd377c49a4-serving-cert\") pod \"9d4552c7-cd75-42dd-8880-30dd377c49a4\" (UID: \"9d4552c7-cd75-42dd-8880-30dd377c49a4\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfwg7\" (UniqueName: \"kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-kube-api-access-kfwg7\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg5zb\" (UniqueName: \"kubernetes.io/projected/6402fda4-df10-493c-b4e5-d0569419652d-kube-api-access-mg5zb\") pod \"6402fda4-df10-493c-b4e5-d0569419652d\" (UID: \"6402fda4-df10-493c-b4e5-d0569419652d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b88f790-22fa-440e-b583-365168c0b23d-metrics-certs\") pod \"5b88f790-22fa-440e-b583-365168c0b23d\" (UID: \"5b88f790-22fa-440e-b583-365168c0b23d\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz9wn\" (UniqueName: \"kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-kube-api-access-lz9wn\") pod \"a31745f5-9847-4afe-82a5-3161cc66ca93\" (UID: \"a31745f5-9847-4afe-82a5-3161cc66ca93\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb6h7\" (UniqueName: \"kubernetes.io/projected/1bf7eb37-55a3-4c65-b768-a94c82151e69-kube-api-access-sb6h7\") pod \"1bf7eb37-55a3-4c65-b768-a94c82151e69\" (UID: \"1bf7eb37-55a3-4c65-b768-a94c82151e69\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngvvp\" (UniqueName: \"kubernetes.io/projected/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-kube-api-access-ngvvp\") pod \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\" (UID: \"49c341d1-5089-4bc2-86a0-a5e165cfcc6b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg5z5\" (UniqueName: \"kubernetes.io/projected/43509403-f426-496e-be36-56cef71462f5-kube-api-access-qg5z5\") pod \"43509403-f426-496e-be36-56cef71462f5\" (UID: \"43509403-f426-496e-be36-56cef71462f5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-srv-cert\") pod \"b6312bbd-5731-4ea0-a20f-81d5a57df44a\" (UID: \"b6312bbd-5731-4ea0-a20f-81d5a57df44a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf126b07-da06-4140-9a57-dfd54fc6b486-image-registry-operator-tls\") pod \"bf126b07-da06-4140-9a57-dfd54fc6b486\" (UID: \"bf126b07-da06-4140-9a57-dfd54fc6b486\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322999 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-serving-cert\") pod \"210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c\" (UID: \"210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-serving-ca\") pod \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\" (UID: \"09ae3b1a-e8e7-4524-b54b-61eab6f9239a\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-bound-sa-token\") pod \"a31745f5-9847-4afe-82a5-3161cc66ca93\" (UID: \"a31745f5-9847-4afe-82a5-3161cc66ca93\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-operator-metrics\") pod \"b6cd30de-2eeb-49a2-ab40-9167f4560ff5\" (UID: \"b6cd30de-2eeb-49a2-ab40-9167f4560ff5\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-utilities\") pod \"1d611f23-29be-4491-8495-bee1670e935f\" (UID: \"1d611f23-29be-4491-8495-bee1670e935f\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ab1a177-2de0-46d9-b765-d0d0649bb42e-package-server-manager-serving-cert\") pod \"3ab1a177-2de0-46d9-b765-d0d0649bb42e\" (UID: \"3ab1a177-2de0-46d9-b765-d0d0649bb42e\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323178 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-host-slash\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-iptables-alerter-script\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef543e1b-8068-4ea3-b32a-61027b32e95d-webhook-cert\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rczfb\" (UniqueName: \"kubernetes.io/projected/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-kube-api-access-rczfb\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323325 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/37a5e44f-9a88-4405-be8a-b645485e7312-host-etc-kube\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323377 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2kz5\" (UniqueName: \"kubernetes.io/projected/ef543e1b-8068-4ea3-b32a-61027b32e95d-kube-api-access-s2kz5\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a5e44f-9a88-4405-be8a-b645485e7312-metrics-tls\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/ef543e1b-8068-4ea3-b32a-61027b32e95d-ovnkube-identity-cm\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef543e1b-8068-4ea3-b32a-61027b32e95d-env-overrides\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rdwmf\" (UniqueName: \"kubernetes.io/projected/37a5e44f-9a88-4405-be8a-b645485e7312-kube-api-access-rdwmf\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323605 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7c4vf\" (UniqueName: \"kubernetes.io/projected/22c825df-677d-4ca6-82db-3454ed06e783-kube-api-access-7c4vf\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323622 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7e6199b-1264-4501-8953-767f51328d08-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323634 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7539238d-5fe0-46ed-884e-1c3b566537ec-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323647 4769 reconciler_common.go:293] "Volume detached for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-available-featuregates\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323659 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1386a44e-36a2-460c-96d0-0359d2b6f0f5-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323672 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bf2bz\" (UniqueName: \"kubernetes.io/projected/1d611f23-29be-4491-8495-bee1670e935f-kube-api-access-bf2bz\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323705 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323718 4769 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-service-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323731 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-provider-selection\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323701 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-4ln5h" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35512335ac39aed0f55b7f799f416f4f6445c20c1b19888cf2bb72bb276703f2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rczfb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-4ln5h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323745 4769 reconciler_common.go:293] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-bound-sa-token\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323935 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323957 4769 reconciler_common.go:293] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323974 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-cliconfig\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.323990 4769 reconciler_common.go:293] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324009 4769 reconciler_common.go:293] "Volume detached for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fda69060-fa79-4696-b1a6-7980f124bf7c-mcd-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324027 4769 reconciler_common.go:293] "Volume detached for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-audit\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324043 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324061 4769 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324079 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-ocp-branding-template\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324097 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/496e6271-fb68-4057-954e-a0d97a4afa3f-kube-api-access\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324114 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324131 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324147 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w4xd4\" (UniqueName: \"kubernetes.io/projected/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-kube-api-access-w4xd4\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324165 4769 reconciler_common.go:293] "Volume detached for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-stats-auth\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324183 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4d4hj\" (UniqueName: \"kubernetes.io/projected/3ab1a177-2de0-46d9-b765-d0d0649bb42e-kube-api-access-4d4hj\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324227 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vt5rc\" (UniqueName: \"kubernetes.io/projected/44663579-783b-4372-86d6-acf235a62d72-kube-api-access-vt5rc\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324244 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324348 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-service-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324367 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324386 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x2m85\" (UniqueName: \"kubernetes.io/projected/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d-kube-api-access-x2m85\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324403 4769 reconciler_common.go:293] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-images\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324419 4769 reconciler_common.go:293] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f668bae-612b-4b75-9490-919e737c6a3b-installation-pull-secrets\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324436 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8tdtz\" (UniqueName: \"kubernetes.io/projected/09efc573-dbb6-4249-bd59-9b87aba8dd28-kube-api-access-8tdtz\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324452 4769 reconciler_common.go:293] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-tmpfs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324467 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-client\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324482 4769 reconciler_common.go:293] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b574797-001e-440a-8f4e-c0be86edad0f-proxy-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324498 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2w9zh\" (UniqueName: \"kubernetes.io/projected/4bb40260-dbaa-4fb0-84df-5e680505d512-kube-api-access-2w9zh\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324515 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wxkg8\" (UniqueName: \"kubernetes.io/projected/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-kube-api-access-wxkg8\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324530 4769 reconciler_common.go:293] "Volume detached for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-multus-daemon-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324554 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324571 4769 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43509403-f426-496e-be36-56cef71462f5-console-oauth-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324590 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6ccd8\" (UniqueName: \"kubernetes.io/projected/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b-kube-api-access-6ccd8\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324606 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9xfj7\" (UniqueName: \"kubernetes.io/projected/5225d0e4-402f-4861-b410-819f433b1803-kube-api-access-9xfj7\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324625 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-metrics-certs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324640 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7583ce53-e0fe-4a16-9e4d-50516596a136-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324656 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325058 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e7e6199b-1264-4501-8953-767f51328d08-kube-api-access\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325080 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w9rds\" (UniqueName: \"kubernetes.io/projected/20b0d48f-5fd6-431c-a545-e3c800c7b866-kube-api-access-w9rds\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325096 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jkwtn\" (UniqueName: \"kubernetes.io/projected/5b88f790-22fa-440e-b583-365168c0b23d-kube-api-access-jkwtn\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326484 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qs4fp\" (UniqueName: \"kubernetes.io/projected/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-kube-api-access-qs4fp\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326512 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6509e943-70c6-444c-bc41-48a544e36fbd-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326545 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d6qdx\" (UniqueName: \"kubernetes.io/projected/87cf06ed-a83f-41a7-828d-70653580a8cb-kube-api-access-d6qdx\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326564 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zkvpv\" (UniqueName: \"kubernetes.io/projected/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-kube-api-access-zkvpv\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326581 4769 reconciler_common.go:293] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-ovnkube-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326597 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-client\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326614 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09efc573-dbb6-4249-bd59-9b87aba8dd28-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326631 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-metrics-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326647 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326743 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/925f1c65-6136-48ba-85aa-3a3b50560753-ovn-control-plane-metrics-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327386 4769 reconciler_common.go:293] "Volume detached for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-node-bootstrap-token\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327579 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/efdd0498-1daa-4136-9a4a-3b948c2293fc-webhook-certs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327598 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xcgwh\" (UniqueName: \"kubernetes.io/projected/fda69060-fa79-4696-b1a6-7980f124bf7c-kube-api-access-xcgwh\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327613 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6g6sz\" (UniqueName: \"kubernetes.io/projected/6509e943-70c6-444c-bc41-48a544e36fbd-kube-api-access-6g6sz\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327627 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v47cf\" (UniqueName: \"kubernetes.io/projected/c03ee662-fb2f-4fc4-a2c1-af487c19d254-kube-api-access-v47cf\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327639 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327652 4769 reconciler_common.go:293] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327664 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1386a44e-36a2-460c-96d0-0359d2b6f0f5-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327677 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fcqwp\" (UniqueName: \"kubernetes.io/projected/5fe579f8-e8a6-4643-bce5-a661393c4dde-kube-api-access-fcqwp\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327693 4769 reconciler_common.go:293] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20b0d48f-5fd6-431c-a545-e3c800c7b866-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327712 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fqsjt\" (UniqueName: \"kubernetes.io/projected/efdd0498-1daa-4136-9a4a-3b948c2293fc-kube-api-access-fqsjt\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327729 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-etcd-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327744 4769 reconciler_common.go:293] "Volume detached for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-binary-copy\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328623 4769 reconciler_common.go:293] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/31d8b7a1-420e-4252-a5b7-eebe8a111292-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328751 4769 reconciler_common.go:293] "Volume detached for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/22c825df-677d-4ca6-82db-3454ed06e783-machine-approver-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328771 4769 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-client-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328864 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328886 4769 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-oauth-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328967 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2d4wz\" (UniqueName: \"kubernetes.io/projected/5441d097-087c-4d9a-baa8-b210afa90fc9-kube-api-access-2d4wz\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328987 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pcxfs\" (UniqueName: \"kubernetes.io/projected/9d4552c7-cd75-42dd-8880-30dd377c49a4-kube-api-access-pcxfs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329005 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329021 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d4552c7-cd75-42dd-8880-30dd377c49a4-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329037 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a31745f5-9847-4afe-82a5-3161cc66ca93-metrics-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329057 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-login\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329074 4769 reconciler_common.go:293] "Volume detached for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c03ee662-fb2f-4fc4-a2c1-af487c19d254-default-certificate\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329093 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329110 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/496e6271-fb68-4057-954e-a0d97a4afa3f-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329126 4769 reconciler_common.go:293] "Volume detached for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bb40260-dbaa-4fb0-84df-5e680505d512-cni-binary-copy\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329154 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7539238d-5fe0-46ed-884e-1c3b566537ec-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329173 4769 reconciler_common.go:293] "Volume detached for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/0b574797-001e-440a-8f4e-c0be86edad0f-mcc-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329234 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329255 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mnrrd\" (UniqueName: \"kubernetes.io/projected/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d-kube-api-access-mnrrd\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329274 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lzf88\" (UniqueName: \"kubernetes.io/projected/0b574797-001e-440a-8f4e-c0be86edad0f-kube-api-access-lzf88\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329286 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-idp-0-file-data\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329299 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1386a44e-36a2-460c-96d0-0359d2b6f0f5-kube-api-access\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329312 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pj782\" (UniqueName: \"kubernetes.io/projected/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-kube-api-access-pj782\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329325 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf126b07-da06-4140-9a57-dfd54fc6b486-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329337 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329353 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-router-certs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329365 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-user-template-error\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329378 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22c825df-677d-4ca6-82db-3454ed06e783-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329392 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ea678ab-3438-413e-bfe3-290ae7725660-ovn-node-metrics-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef543e1b-8068-4ea3-b32a-61027b32e95d-env-overrides\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c03ee662-fb2f-4fc4-a2c1-af487c19d254-service-ca-bundle" (OuterVolumeSpecName: "service-ca-bundle") pod "c03ee662-fb2f-4fc4-a2c1-af487c19d254" (UID: "c03ee662-fb2f-4fc4-a2c1-af487c19d254"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-certs" (OuterVolumeSpecName: "certs") pod "5fe579f8-e8a6-4643-bce5-a661393c4dde" (UID: "5fe579f8-e8a6-4643-bce5-a661393c4dde"). InnerVolumeSpecName "certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ab3dd5-8196-46d0-ad33-122e2ca51def-config" (OuterVolumeSpecName: "config") pod "01ab3dd5-8196-46d0-ad33-122e2ca51def" (UID: "01ab3dd5-8196-46d0-ad33-122e2ca51def"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-config" (OuterVolumeSpecName: "config") pod "09efc573-dbb6-4249-bd59-9b87aba8dd28" (UID: "09efc573-dbb6-4249-bd59-9b87aba8dd28"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322763 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ab3dd5-8196-46d0-ad33-122e2ca51def-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "01ab3dd5-8196-46d0-ad33-122e2ca51def" (UID: "01ab3dd5-8196-46d0-ad33-122e2ca51def"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.322910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-console-config" (OuterVolumeSpecName: "console-config") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6402fda4-df10-493c-b4e5-d0569419652d-kube-api-access-mg5zb" (OuterVolumeSpecName: "kube-api-access-mg5zb") pod "6402fda4-df10-493c-b4e5-d0569419652d" (UID: "6402fda4-df10-493c-b4e5-d0569419652d"). InnerVolumeSpecName "kube-api-access-mg5zb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.324231 4769 secret.go:188] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324621 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b78653f-4ff9-4508-8672-245ed9b561e3-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "0b78653f-4ff9-4508-8672-245ed9b561e3" (UID: "0b78653f-4ff9-4508-8672-245ed9b561e3"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325088 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" (UID: "f88749ec-7931-4ee7-b3fc-1ec5e11f92e9"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325147 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6312bbd-5731-4ea0-a20f-81d5a57df44a-kube-api-access-249nr" (OuterVolumeSpecName: "kube-api-access-249nr") pod "b6312bbd-5731-4ea0-a20f-81d5a57df44a" (UID: "b6312bbd-5731-4ea0-a20f-81d5a57df44a"). InnerVolumeSpecName "kube-api-access-249nr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.332534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-iptables-alerter-script\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325269 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-samples-operator-tls" (OuterVolumeSpecName: "samples-operator-tls") pod "a0128f3a-b052-44ed-a84e-c4c8aaf17c13" (UID: "a0128f3a-b052-44ed-a84e-c4c8aaf17c13"). InnerVolumeSpecName "samples-operator-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326131 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "925f1c65-6136-48ba-85aa-3a3b50560753" (UID: "925f1c65-6136-48ba-85aa-3a3b50560753"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-service-ca-bundle" (OuterVolumeSpecName: "service-ca-bundle") pod "6509e943-70c6-444c-bc41-48a544e36fbd" (UID: "6509e943-70c6-444c-bc41-48a544e36fbd"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326163 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6402fda4-df10-493c-b4e5-d0569419652d-machine-api-operator-tls" (OuterVolumeSpecName: "machine-api-operator-tls") pod "6402fda4-df10-493c-b4e5-d0569419652d" (UID: "6402fda4-df10-493c-b4e5-d0569419652d"). InnerVolumeSpecName "machine-api-operator-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326207 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ef4625-1d3a-4a9f-b595-c2433d32326d-kube-api-access-pjr6v" (OuterVolumeSpecName: "kube-api-access-pjr6v") pod "49ef4625-1d3a-4a9f-b595-c2433d32326d" (UID: "49ef4625-1d3a-4a9f-b595-c2433d32326d"). InnerVolumeSpecName "kube-api-access-pjr6v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.325635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e176fe-21b4-4974-b1ed-c8b94f112a7f-kube-api-access-d4lsv" (OuterVolumeSpecName: "kube-api-access-d4lsv") pod "25e176fe-21b4-4974-b1ed-c8b94f112a7f" (UID: "25e176fe-21b4-4974-b1ed-c8b94f112a7f"). InnerVolumeSpecName "kube-api-access-d4lsv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.324831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-kube-api-access-nzwt7" (OuterVolumeSpecName: "kube-api-access-nzwt7") pod "96b93a3a-6083-4aea-8eab-fe1aa8245ad9" (UID: "96b93a3a-6083-4aea-8eab-fe1aa8245ad9"). InnerVolumeSpecName "kube-api-access-nzwt7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326615 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b78653f-4ff9-4508-8672-245ed9b561e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b78653f-4ff9-4508-8672-245ed9b561e3" (UID: "0b78653f-4ff9-4508-8672-245ed9b561e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.326745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6731426b-95fe-49ff-bb5f-40441049fde2-control-plane-machine-set-operator-tls" (OuterVolumeSpecName: "control-plane-machine-set-operator-tls") pod "6731426b-95fe-49ff-bb5f-40441049fde2" (UID: "6731426b-95fe-49ff-bb5f-40441049fde2"). InnerVolumeSpecName "control-plane-machine-set-operator-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" (UID: "210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "6ea678ab-3438-413e-bfe3-290ae7725660" (UID: "6ea678ab-3438-413e-bfe3-290ae7725660"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d8b7a1-420e-4252-a5b7-eebe8a111292-kube-api-access-zgdk5" (OuterVolumeSpecName: "kube-api-access-zgdk5") pod "31d8b7a1-420e-4252-a5b7-eebe8a111292" (UID: "31d8b7a1-420e-4252-a5b7-eebe8a111292"). InnerVolumeSpecName "kube-api-access-zgdk5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.327279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-image-import-ca" (OuterVolumeSpecName: "image-import-ca") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "image-import-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31d8b7a1-420e-4252-a5b7-eebe8a111292-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "31d8b7a1-420e-4252-a5b7-eebe8a111292" (UID: "31d8b7a1-420e-4252-a5b7-eebe8a111292"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.328931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "6ea678ab-3438-413e-bfe3-290ae7725660" (UID: "6ea678ab-3438-413e-bfe3-290ae7725660"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329636 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.329953 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ab1a177-2de0-46d9-b765-d0d0649bb42e-package-server-manager-serving-cert" (OuterVolumeSpecName: "package-server-manager-serving-cert") pod "3ab1a177-2de0-46d9-b765-d0d0649bb42e" (UID: "3ab1a177-2de0-46d9-b765-d0d0649bb42e"). InnerVolumeSpecName "package-server-manager-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "b6312bbd-5731-4ea0-a20f-81d5a57df44a" (UID: "b6312bbd-5731-4ea0-a20f-81d5a57df44a"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-key" (OuterVolumeSpecName: "signing-key") pod "25e176fe-21b4-4974-b1ed-c8b94f112a7f" (UID: "25e176fe-21b4-4974-b1ed-c8b94f112a7f"). InnerVolumeSpecName "signing-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57a731c4-ef35-47a8-b875-bfb08a7f8011-kube-api-access-cfbct" (OuterVolumeSpecName: "kube-api-access-cfbct") pod "57a731c4-ef35-47a8-b875-bfb08a7f8011" (UID: "57a731c4-ef35-47a8-b875-bfb08a7f8011"). InnerVolumeSpecName "kube-api-access-cfbct". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330694 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-kube-api-access-gf66m" (OuterVolumeSpecName: "kube-api-access-gf66m") pod "a0128f3a-b052-44ed-a84e-c4c8aaf17c13" (UID: "a0128f3a-b052-44ed-a84e-c4c8aaf17c13"). InnerVolumeSpecName "kube-api-access-gf66m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330791 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e6199b-1264-4501-8953-767f51328d08-config" (OuterVolumeSpecName: "config") pod "e7e6199b-1264-4501-8953-767f51328d08" (UID: "e7e6199b-1264-4501-8953-767f51328d08"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.330889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-config" (OuterVolumeSpecName: "config") pod "6509e943-70c6-444c-bc41-48a544e36fbd" (UID: "6509e943-70c6-444c-bc41-48a544e36fbd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-kube-api-access-dbsvg" (OuterVolumeSpecName: "kube-api-access-dbsvg") pod "f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" (UID: "f88749ec-7931-4ee7-b3fc-1ec5e11f92e9"). InnerVolumeSpecName "kube-api-access-dbsvg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b78653f-4ff9-4508-8672-245ed9b561e3-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "0b78653f-4ff9-4508-8672-245ed9b561e3" (UID: "0b78653f-4ff9-4508-8672-245ed9b561e3"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf126b07-da06-4140-9a57-dfd54fc6b486-image-registry-operator-tls" (OuterVolumeSpecName: "image-registry-operator-tls") pod "bf126b07-da06-4140-9a57-dfd54fc6b486" (UID: "bf126b07-da06-4140-9a57-dfd54fc6b486"). InnerVolumeSpecName "image-registry-operator-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-images" (OuterVolumeSpecName: "images") pod "6402fda4-df10-493c-b4e5-d0569419652d" (UID: "6402fda4-df10-493c-b4e5-d0569419652d"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.331389 4769 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-cabundle" (OuterVolumeSpecName: "signing-cabundle") pod "25e176fe-21b4-4974-b1ed-c8b94f112a7f" (UID: "25e176fe-21b4-4974-b1ed-c8b94f112a7f"). InnerVolumeSpecName "signing-cabundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7539238d-5fe0-46ed-884e-1c3b566537ec-kube-api-access-tk88c" (OuterVolumeSpecName: "kube-api-access-tk88c") pod "7539238d-5fe0-46ed-884e-1c3b566537ec" (UID: "7539238d-5fe0-46ed-884e-1c3b566537ec"). InnerVolumeSpecName "kube-api-access-tk88c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.331761 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:07.831739037 +0000 UTC m=+26.532400865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.331789 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5441d097-087c-4d9a-baa8-b210afa90fc9-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "5441d097-087c-4d9a-baa8-b210afa90fc9" (UID: "5441d097-087c-4d9a-baa8-b210afa90fc9"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.332518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "7bb08738-c794-4ee8-9972-3a62ca171029" (UID: "7bb08738-c794-4ee8-9972-3a62ca171029"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.332674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "7583ce53-e0fe-4a16-9e4d-50516596a136" (UID: "7583ce53-e0fe-4a16-9e4d-50516596a136"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.333025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d4552c7-cd75-42dd-8880-30dd377c49a4-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "9d4552c7-cd75-42dd-8880-30dd377c49a4" (UID: "9d4552c7-cd75-42dd-8880-30dd377c49a4"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.333153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.333309 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:07.833283599 +0000 UTC m=+26.533945517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.333401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-config" (OuterVolumeSpecName: "config") pod "6402fda4-df10-493c-b4e5-d0569419652d" (UID: "6402fda4-df10-493c-b4e5-d0569419652d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.333424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb08738-c794-4ee8-9972-3a62ca171029-kube-api-access-279lb" (OuterVolumeSpecName: "kube-api-access-279lb") pod "7bb08738-c794-4ee8-9972-3a62ca171029" (UID: "7bb08738-c794-4ee8-9972-3a62ca171029"). InnerVolumeSpecName "kube-api-access-279lb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-config" (OuterVolumeSpecName: "config") pod "5441d097-087c-4d9a-baa8-b210afa90fc9" (UID: "5441d097-087c-4d9a-baa8-b210afa90fc9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/ef543e1b-8068-4ea3-b32a-61027b32e95d-ovnkube-identity-cm\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334475 4769 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-serviceca" (OuterVolumeSpecName: "serviceca") pod "3cb93b32-e0ae-4377-b9c8-fdb9842c6d59" (UID: "3cb93b32-e0ae-4377-b9c8-fdb9842c6d59"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334720 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-kube-api-access-lz9wn" (OuterVolumeSpecName: "kube-api-access-lz9wn") pod "a31745f5-9847-4afe-82a5-3161cc66ca93" (UID: "a31745f5-9847-4afe-82a5-3161cc66ca93"). InnerVolumeSpecName "kube-api-access-lz9wn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.334779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a31745f5-9847-4afe-82a5-3161cc66ca93" (UID: "a31745f5-9847-4afe-82a5-3161cc66ca93"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335144 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a31745f5-9847-4afe-82a5-3161cc66ca93-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a31745f5-9847-4afe-82a5-3161cc66ca93" (UID: "a31745f5-9847-4afe-82a5-3161cc66ca93"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b88f790-22fa-440e-b583-365168c0b23d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5b88f790-22fa-440e-b583-365168c0b23d" (UID: "5b88f790-22fa-440e-b583-365168c0b23d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-trusted-ca" (OuterVolumeSpecName: "marketplace-trusted-ca") pod "b6cd30de-2eeb-49a2-ab40-9167f4560ff5" (UID: "b6cd30de-2eeb-49a2-ab40-9167f4560ff5"). InnerVolumeSpecName "marketplace-trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-kube-api-access-rnphk" (OuterVolumeSpecName: "kube-api-access-rnphk") pod "bf126b07-da06-4140-9a57-dfd54fc6b486" (UID: "bf126b07-da06-4140-9a57-dfd54fc6b486"). InnerVolumeSpecName "kube-api-access-rnphk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925f1c65-6136-48ba-85aa-3a3b50560753-kube-api-access-s4n52" (OuterVolumeSpecName: "kube-api-access-s4n52") pod "925f1c65-6136-48ba-85aa-3a3b50560753" (UID: "925f1c65-6136-48ba-85aa-3a3b50560753"). InnerVolumeSpecName "kube-api-access-s4n52". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.335241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6731426b-95fe-49ff-bb5f-40441049fde2-kube-api-access-x7zkh" (OuterVolumeSpecName: "kube-api-access-x7zkh") pod "6731426b-95fe-49ff-bb5f-40441049fde2" (UID: "6731426b-95fe-49ff-bb5f-40441049fde2"). InnerVolumeSpecName "kube-api-access-x7zkh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.337816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda69060-fa79-4696-b1a6-7980f124bf7c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fda69060-fa79-4696-b1a6-7980f124bf7c" (UID: "fda69060-fa79-4696-b1a6-7980f124bf7c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.338881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87cf06ed-a83f-41a7-828d-70653580a8cb-config-volume" (OuterVolumeSpecName: "config-volume") pod "87cf06ed-a83f-41a7-828d-70653580a8cb" (UID: "87cf06ed-a83f-41a7-828d-70653580a8cb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.340536 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87cf06ed-a83f-41a7-828d-70653580a8cb-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "87cf06ed-a83f-41a7-828d-70653580a8cb" (UID: "87cf06ed-a83f-41a7-828d-70653580a8cb"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.340640 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ef543e1b-8068-4ea3-b32a-61027b32e95d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-vrzqb\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.342136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf7eb37-55a3-4c65-b768-a94c82151e69-kube-api-access-sb6h7" (OuterVolumeSpecName: "kube-api-access-sb6h7") pod "1bf7eb37-55a3-4c65-b768-a94c82151e69" (UID: "1bf7eb37-55a3-4c65-b768-a94c82151e69"). InnerVolumeSpecName "kube-api-access-sb6h7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.345112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-client-ca" (OuterVolumeSpecName: "client-ca") pod "7583ce53-e0fe-4a16-9e4d-50516596a136" (UID: "7583ce53-e0fe-4a16-9e4d-50516596a136"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.349475 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.349511 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.349531 4769 projected.go:194] Error preparing data for projected volume kube-api-access-s2dwl for pod openshift-network-diagnostics/network-check-source-55646444c4-trplf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.349542 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2kz5\" (UniqueName: \"kubernetes.io/projected/ef543e1b-8068-4ea3-b32a-61027b32e95d-kube-api-access-s2kz5\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.349626 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl podName:9d751cbb-f2e2-430d-9754-c882a5e924a5 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:07.849588998 +0000 UTC m=+26.550250826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dwl" (UniqueName: "kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl") pod "network-check-source-55646444c4-trplf" (UID: "9d751cbb-f2e2-430d-9754-c882a5e924a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.349669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ab3dd5-8196-46d0-ad33-122e2ca51def-kube-api-access-w7l8j" (OuterVolumeSpecName: "kube-api-access-w7l8j") pod "01ab3dd5-8196-46d0-ad33-122e2ca51def" (UID: "01ab3dd5-8196-46d0-ad33-122e2ca51def"). InnerVolumeSpecName "kube-api-access-w7l8j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.350205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a5e44f-9a88-4405-be8a-b645485e7312-metrics-tls\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.351243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43509403-f426-496e-be36-56cef71462f5-kube-api-access-qg5z5" (OuterVolumeSpecName: "kube-api-access-qg5z5") pod "43509403-f426-496e-be36-56cef71462f5" (UID: "43509403-f426-496e-be36-56cef71462f5"). InnerVolumeSpecName "kube-api-access-qg5z5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.351250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6509e943-70c6-444c-bc41-48a544e36fbd" (UID: "6509e943-70c6-444c-bc41-48a544e36fbd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.351539 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-utilities" (OuterVolumeSpecName: "utilities") pod "1d611f23-29be-4491-8495-bee1670e935f" (UID: "1d611f23-29be-4491-8495-bee1670e935f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.351674 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.351698 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.351712 4769 projected.go:194] Error preparing data for projected volume kube-api-access-cqllr for pod openshift-network-diagnostics/network-check-target-xd92c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.351780 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr podName:3b6479f0-333b-4a96-9adf-2099afdc2447 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:07.851753487 +0000 UTC m=+26.552415315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cqllr" (UniqueName: "kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr") pod "network-check-target-xd92c" (UID: "3b6479f0-333b-4a96-9adf-2099afdc2447") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.351920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-operator-metrics" (OuterVolumeSpecName: "marketplace-operator-metrics") pod "b6cd30de-2eeb-49a2-ab40-9167f4560ff5" (UID: "b6cd30de-2eeb-49a2-ab40-9167f4560ff5"). InnerVolumeSpecName "marketplace-operator-metrics". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.352166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.352792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1d611f23-29be-4491-8495-bee1670e935f" (UID: "1d611f23-29be-4491-8495-bee1670e935f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.353404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.353554 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "b6312bbd-5731-4ea0-a20f-81d5a57df44a" (UID: "b6312bbd-5731-4ea0-a20f-81d5a57df44a"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.353543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef543e1b-8068-4ea3-b32a-61027b32e95d-webhook-cert\") pod \"network-node-identity-vrzqb\" (UID: \"ef543e1b-8068-4ea3-b32a-61027b32e95d\") " pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.353259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.353983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-config" (OuterVolumeSpecName: "config") pod "210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" (UID: "210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.354691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea678ab-3438-413e-bfe3-290ae7725660-kube-api-access-htfz6" (OuterVolumeSpecName: "kube-api-access-htfz6") pod "6ea678ab-3438-413e-bfe3-290ae7725660" (UID: "6ea678ab-3438-413e-bfe3-290ae7725660"). InnerVolumeSpecName "kube-api-access-htfz6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.356224 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37a5e44f-9a88-4405-be8a-b645485e7312\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rdwmf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-58b4c7f79c-55gtf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.356459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdwmf\" (UniqueName: \"kubernetes.io/projected/37a5e44f-9a88-4405-be8a-b645485e7312-kube-api-access-rdwmf\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.356622 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.356692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.357229 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-kube-api-access-ngvvp" (OuterVolumeSpecName: "kube-api-access-ngvvp") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "kube-api-access-ngvvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.357458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-kube-api-access-kfwg7" (OuterVolumeSpecName: "kube-api-access-kfwg7") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "kube-api-access-kfwg7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.357475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.358380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/496e6271-fb68-4057-954e-a0d97a4afa3f-config" (OuterVolumeSpecName: "config") pod "496e6271-fb68-4057-954e-a0d97a4afa3f" (UID: "496e6271-fb68-4057-954e-a0d97a4afa3f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.358521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-kube-api-access-x4zgh" (OuterVolumeSpecName: "kube-api-access-x4zgh") pod "b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" (UID: "b11524ee-3fca-4b1b-9cdf-6da289fdbc7d"). InnerVolumeSpecName "kube-api-access-x4zgh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.358673 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "49c341d1-5089-4bc2-86a0-a5e165cfcc6b" (UID: "49c341d1-5089-4bc2-86a0-a5e165cfcc6b"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.359241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7583ce53-e0fe-4a16-9e4d-50516596a136-kube-api-access-xcphl" (OuterVolumeSpecName: "kube-api-access-xcphl") pod "7583ce53-e0fe-4a16-9e4d-50516596a136" (UID: "7583ce53-e0fe-4a16-9e4d-50516596a136"). InnerVolumeSpecName "kube-api-access-xcphl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.359439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd23aa5c-e532-4e53-bccf-e79f130c5ae8-kube-api-access-jhbk2" (OuterVolumeSpecName: "kube-api-access-jhbk2") pod "bd23aa5c-e532-4e53-bccf-e79f130c5ae8" (UID: "bd23aa5c-e532-4e53-bccf-e79f130c5ae8"). InnerVolumeSpecName "kube-api-access-jhbk2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.360339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rczfb\" (UniqueName: \"kubernetes.io/projected/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-kube-api-access-rczfb\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.365989 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.366101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09ae3b1a-e8e7-4524-b54b-61eab6f9239a" (UID: "09ae3b1a-e8e7-4524-b54b-61eab6f9239a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.369064 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d751cbb-f2e2-430d-9754-c882a5e924a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2dwl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-55646444c4-trplf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.381378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "57a731c4-ef35-47a8-b875-bfb08a7f8011" (UID: "57a731c4-ef35-47a8-b875-bfb08a7f8011"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.382058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" (UID: "b11524ee-3fca-4b1b-9cdf-6da289fdbc7d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.385363 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b6479f0-333b-4a96-9adf-2099afdc2447\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-cqllr\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-xd92c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.388691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f668bae-612b-4b75-9490-919e737c6a3b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.396171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "5225d0e4-402f-4861-b410-819f433b1803" (UID: "5225d0e4-402f-4861-b410-819f433b1803"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.396741 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae647598ec35cda5766806d3d44a91e3b9d4dee48ff154f3d8490165399873fd\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-85b44fc459-gdk6g\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-host-slash\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d75a4c96-2883-4a0b-bab2-0fab2b6c0b49-host-slash\") pod \"iptables-alerter-4ln5h\" (UID: \"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\") " pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/37a5e44f-9a88-4405-be8a-b645485e7312-host-etc-kube\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430345 4769 reconciler_common.go:293] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c03ee662-fb2f-4fc4-a2c1-af487c19d254-service-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430363 4769 reconciler_common.go:293] "Volume detached for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/6402fda4-df10-493c-b4e5-d0569419652d-machine-api-operator-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430376 4769 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43509403-f426-496e-be36-56cef71462f5-console-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430388 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7e6199b-1264-4501-8953-767f51328d08-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430400 4769 reconciler_common.go:293] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-srv-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430409 4769 reconciler_common.go:293] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/1bf7eb37-55a3-4c65-b768-a94c82151e69-encryption-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430417 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-etcd-serving-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430426 4769 reconciler_common.go:293] "Volume detached for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/1bf7eb37-55a3-4c65-b768-a94c82151e69-image-import-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430435 4769 reconciler_common.go:293] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-service-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430444 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zgdk5\" (UniqueName: \"kubernetes.io/projected/31d8b7a1-420e-4252-a5b7-eebe8a111292-kube-api-access-zgdk5\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430453 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pjr6v\" (UniqueName: \"kubernetes.io/projected/49ef4625-1d3a-4a9f-b595-c2433d32326d-kube-api-access-pjr6v\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430462 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-session\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430472 4769 reconciler_common.go:293] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f668bae-612b-4b75-9490-919e737c6a3b-ca-trust-extracted\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430481 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-client\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430492 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430505 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430516 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6509e943-70c6-444c-bc41-48a544e36fbd-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430527 4769 reconciler_common.go:293] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-registry-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430539 4769 reconciler_common.go:293] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f668bae-612b-4b75-9490-919e737c6a3b-registry-certificates\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/37a5e44f-9a88-4405-be8a-b645485e7312-host-etc-kube\") pod \"network-operator-58b4c7f79c-55gtf\" (UID: \"37a5e44f-9a88-4405-be8a-b645485e7312\") " pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430550 4769 reconciler_common.go:293] "Volume detached for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-samples-operator-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430621 4769 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-audit-policies\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430632 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5441d097-087c-4d9a-baa8-b210afa90fc9-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430643 4769 reconciler_common.go:293] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-env-overrides\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430652 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/496e6271-fb68-4057-954e-a0d97a4afa3f-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430662 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gf66m\" (UniqueName: \"kubernetes.io/projected/a0128f3a-b052-44ed-a84e-c4c8aaf17c13-kube-api-access-gf66m\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430674 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a31745f5-9847-4afe-82a5-3161cc66ca93-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430682 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430691 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-v4-0-config-system-service-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430701 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87cf06ed-a83f-41a7-828d-70653580a8cb-metrics-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430711 4769 reconciler_common.go:293] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-images\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430719 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tk88c\" (UniqueName: \"kubernetes.io/projected/7539238d-5fe0-46ed-884e-1c3b566537ec-kube-api-access-tk88c\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430729 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430738 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dbsvg\" (UniqueName: \"kubernetes.io/projected/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9-kube-api-access-dbsvg\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430753 4769 reconciler_common.go:293] "Volume detached for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-cabundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430762 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cfbct\" (UniqueName: \"kubernetes.io/projected/57a731c4-ef35-47a8-b875-bfb08a7f8011-kube-api-access-cfbct\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430771 4769 reconciler_common.go:293] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430779 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87cf06ed-a83f-41a7-828d-70653580a8cb-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430787 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b78653f-4ff9-4508-8672-245ed9b561e3-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430796 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-htfz6\" (UniqueName: \"kubernetes.io/projected/6ea678ab-3438-413e-bfe3-290ae7725660-kube-api-access-htfz6\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430805 4769 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-audit-policies\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430813 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xcphl\" (UniqueName: \"kubernetes.io/projected/7583ce53-e0fe-4a16-9e4d-50516596a136-kube-api-access-xcphl\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430822 4769 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430831 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5441d097-087c-4d9a-baa8-b210afa90fc9-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430840 4769 reconciler_common.go:293] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-encryption-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430849 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x4zgh\" (UniqueName: \"kubernetes.io/projected/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-kube-api-access-x4zgh\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430859 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jhbk2\" (UniqueName: \"kubernetes.io/projected/bd23aa5c-e532-4e53-bccf-e79f130c5ae8-kube-api-access-jhbk2\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430868 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430876 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w7l8j\" (UniqueName: \"kubernetes.io/projected/01ab3dd5-8196-46d0-ad33-122e2ca51def-kube-api-access-w7l8j\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430884 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430892 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rnphk\" (UniqueName: \"kubernetes.io/projected/bf126b07-da06-4140-9a57-dfd54fc6b486-kube-api-access-rnphk\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430901 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s4n52\" (UniqueName: \"kubernetes.io/projected/925f1c65-6136-48ba-85aa-3a3b50560753-kube-api-access-s4n52\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430911 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-279lb\" (UniqueName: \"kubernetes.io/projected/7bb08738-c794-4ee8-9972-3a62ca171029-kube-api-access-279lb\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430920 4769 reconciler_common.go:293] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fda69060-fa79-4696-b1a6-7980f124bf7c-proxy-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430928 4769 reconciler_common.go:293] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb08738-c794-4ee8-9972-3a62ca171029-cni-sysctl-allowlist\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430937 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x7zkh\" (UniqueName: \"kubernetes.io/projected/6731426b-95fe-49ff-bb5f-40441049fde2-kube-api-access-x7zkh\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430945 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d4552c7-cd75-42dd-8880-30dd377c49a4-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430954 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kfwg7\" (UniqueName: \"kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-kube-api-access-kfwg7\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430962 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mg5zb\" (UniqueName: \"kubernetes.io/projected/6402fda4-df10-493c-b4e5-d0569419652d-kube-api-access-mg5zb\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430971 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b88f790-22fa-440e-b583-365168c0b23d-metrics-certs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430979 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lz9wn\" (UniqueName: \"kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-kube-api-access-lz9wn\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430988 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sb6h7\" (UniqueName: \"kubernetes.io/projected/1bf7eb37-55a3-4c65-b768-a94c82151e69-kube-api-access-sb6h7\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.430997 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ngvvp\" (UniqueName: \"kubernetes.io/projected/49c341d1-5089-4bc2-86a0-a5e165cfcc6b-kube-api-access-ngvvp\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431005 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qg5z5\" (UniqueName: \"kubernetes.io/projected/43509403-f426-496e-be36-56cef71462f5-kube-api-access-qg5z5\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431013 4769 reconciler_common.go:293] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/b6312bbd-5731-4ea0-a20f-81d5a57df44a-srv-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431021 4769 reconciler_common.go:293] "Volume detached for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf126b07-da06-4140-9a57-dfd54fc6b486-image-registry-operator-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431029 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431037 4769 reconciler_common.go:293] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/09ae3b1a-e8e7-4524-b54b-61eab6f9239a-etcd-serving-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431045 4769 reconciler_common.go:293] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a31745f5-9847-4afe-82a5-3161cc66ca93-bound-sa-token\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431053 4769 reconciler_common.go:293] "Volume detached for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-operator-metrics\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431061 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431070 4769 reconciler_common.go:293] "Volume detached for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ab1a177-2de0-46d9-b765-d0d0649bb42e-package-server-manager-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431078 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1d611f23-29be-4491-8495-bee1670e935f-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431086 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/57a731c4-ef35-47a8-b875-bfb08a7f8011-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431096 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01ab3dd5-8196-46d0-ad33-122e2ca51def-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431104 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/0b78653f-4ff9-4508-8672-245ed9b561e3-kube-api-access\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431112 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6402fda4-df10-493c-b4e5-d0569419652d-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431119 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01ab3dd5-8196-46d0-ad33-122e2ca51def-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431127 4769 reconciler_common.go:293] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f668bae-612b-4b75-9490-919e737c6a3b-bound-sa-token\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431135 4769 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b78653f-4ff9-4508-8672-245ed9b561e3-service-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431143 4769 reconciler_common.go:293] "Volume detached for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6cd30de-2eeb-49a2-ab40-9167f4560ff5-marketplace-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431150 4769 reconciler_common.go:293] "Volume detached for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/25e176fe-21b4-4974-b1ed-c8b94f112a7f-signing-key\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431158 4769 reconciler_common.go:293] "Volume detached for volume \"certs\" (UniqueName: \"kubernetes.io/secret/5fe579f8-e8a6-4643-bce5-a661393c4dde-certs\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431166 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-249nr\" (UniqueName: \"kubernetes.io/projected/b6312bbd-5731-4ea0-a20f-81d5a57df44a-kube-api-access-249nr\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431177 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09efc573-dbb6-4249-bd59-9b87aba8dd28-config\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431185 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzwt7\" (UniqueName: \"kubernetes.io/projected/96b93a3a-6083-4aea-8eab-fe1aa8245ad9-kube-api-access-nzwt7\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431216 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5225d0e4-402f-4861-b410-819f433b1803-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431224 4769 reconciler_common.go:293] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ea678ab-3438-413e-bfe3-290ae7725660-ovnkube-script-lib\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431233 4769 reconciler_common.go:293] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/925f1c65-6136-48ba-85aa-3a3b50560753-env-overrides\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431243 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d4lsv\" (UniqueName: \"kubernetes.io/projected/25e176fe-21b4-4974-b1ed-c8b94f112a7f-kube-api-access-d4lsv\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431251 4769 reconciler_common.go:293] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59-serviceca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431258 4769 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/7583ce53-e0fe-4a16-9e4d-50516596a136-client-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431266 4769 reconciler_common.go:293] "Volume detached for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/6731426b-95fe-49ff-bb5f-40441049fde2-control-plane-machine-set-operator-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.431290 4769 reconciler_common.go:293] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31d8b7a1-420e-4252-a5b7-eebe8a111292-proxy-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.480396 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-crc"] Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.514049 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.529244 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4ln5h" Nov 21 11:51:07 crc kubenswrapper[4769]: W1121 11:51:07.532955 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a5e44f_9a88_4405_be8a_b645485e7312.slice/crio-e1b004ce20537f722ca5b5c452d38a51d1c4a6481710b84d53b2d35a20a45a98 WatchSource:0}: Error finding container e1b004ce20537f722ca5b5c452d38a51d1c4a6481710b84d53b2d35a20a45a98: Status 404 returned error can't find the container with id e1b004ce20537f722ca5b5c452d38a51d1c4a6481710b84d53b2d35a20a45a98 Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.537202 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-vrzqb" Nov 21 11:51:07 crc kubenswrapper[4769]: W1121 11:51:07.543996 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75a4c96_2883_4a0b_bab2_0fab2b6c0b49.slice/crio-08b1472c8efea15ffea71e211ad518de3de5242f7ab5858523b9a51396b7426a WatchSource:0}: Error finding container 08b1472c8efea15ffea71e211ad518de3de5242f7ab5858523b9a51396b7426a: Status 404 returned error can't find the container with id 08b1472c8efea15ffea71e211ad518de3de5242f7ab5858523b9a51396b7426a Nov 21 11:51:07 crc kubenswrapper[4769]: W1121 11:51:07.607830 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef543e1b_8068_4ea3_b32a_61027b32e95d.slice/crio-09f357770842f765d49f863bbfce04ee935b860b74b0f8450b4f5f0ee4593f04 WatchSource:0}: Error finding container 09f357770842f765d49f863bbfce04ee935b860b74b0f8450b4f5f0ee4593f04: Status 404 returned error can't find the container with id 09f357770842f765d49f863bbfce04ee935b860b74b0f8450b4f5f0ee4593f04 Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.836486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.836645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.836729 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:08.836683011 +0000 UTC m=+27.537344829 (durationBeforeRetry 1s). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.836814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.836843 4769 secret.go:188] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.836956 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:08.836920857 +0000 UTC m=+27.537582675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.836957 4769 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.837032 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:08.83702255 +0000 UTC m=+27.537684628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.938259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:07 crc kubenswrapper[4769]: I1121 11:51:07.938330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.938466 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.938485 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.938498 4769 projected.go:194] Error preparing data for projected volume kube-api-access-cqllr for pod openshift-network-diagnostics/network-check-target-xd92c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.938546 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr podName:3b6479f0-333b-4a96-9adf-2099afdc2447 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:08.938530109 +0000 UTC m=+27.639191927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqllr" (UniqueName: "kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr") pod "network-check-target-xd92c" (UID: "3b6479f0-333b-4a96-9adf-2099afdc2447") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.939035 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.939051 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.939060 4769 projected.go:194] Error preparing data for projected volume kube-api-access-s2dwl for pod openshift-network-diagnostics/network-check-source-55646444c4-trplf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:07 crc kubenswrapper[4769]: E1121 11:51:07.939127 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl podName:9d751cbb-f2e2-430d-9754-c882a5e924a5 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:08.939117085 +0000 UTC m=+27.639778903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dwl" (UniqueName: "kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl") pod "network-check-source-55646444c4-trplf" (UID: "9d751cbb-f2e2-430d-9754-c882a5e924a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.273656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.273829 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.453657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" event={"ID":"ef543e1b-8068-4ea3-b32a-61027b32e95d","Type":"ContainerStarted","Data":"2e77b86d1a1139320b0dbab63c02442d2684970f8de15711bc94091026c39d52"} Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.453761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" event={"ID":"ef543e1b-8068-4ea3-b32a-61027b32e95d","Type":"ContainerStarted","Data":"09f357770842f765d49f863bbfce04ee935b860b74b0f8450b4f5f0ee4593f04"} Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.455252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4ln5h" event={"ID":"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49","Type":"ContainerStarted","Data":"08b1472c8efea15ffea71e211ad518de3de5242f7ab5858523b9a51396b7426a"} Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.456844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" event={"ID":"37a5e44f-9a88-4405-be8a-b645485e7312","Type":"ContainerStarted","Data":"ef1652d870b1803f3ba94803c6edb12605e99d38de583b240dc91cd952af8673"} Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.456947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" event={"ID":"37a5e44f-9a88-4405-be8a-b645485e7312","Type":"ContainerStarted","Data":"e1b004ce20537f722ca5b5c452d38a51d1c4a6481710b84d53b2d35a20a45a98"} Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.471244 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"766dac16-6160-4f35-b231-811c398f6154\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:48Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://f448ef58a0fd2b24b645e7031b1200632b93e2daf59cf95081707fa39e0a2aee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://25e825f642c95f8c820ac7fbe8c52ae0bf4793ac5e79bfb411ea3b6295567da1\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://960acc72b630ff2d1abe112d66ccfe0ebc61cb766891c548808fc7b1e0ae7636\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://31e2da7b9f51e05a12c1a40c9ea12651c177540dfe7d800040dee19d9794cda3\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:50:43Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.484405 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37a5e44f-9a88-4405-be8a-b645485e7312\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://ef1652d870b1803f3ba94803c6edb12605e99d38de583b240dc91cd952af8673\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rdwmf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-58b4c7f79c-55gtf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.494667 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d751cbb-f2e2-430d-9754-c882a5e924a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2dwl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-55646444c4-trplf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.505050 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b6479f0-333b-4a96-9adf-2099afdc2447\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-cqllr\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-xd92c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.513622 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae647598ec35cda5766806d3d44a91e3b9d4dee48ff154f3d8490165399873fd\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-85b44fc459-gdk6g\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.522647 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-4ln5h" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35512335ac39aed0f55b7f799f416f4f6445c20c1b19888cf2bb72bb276703f2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rczfb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-4ln5h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.534724 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ef543e1b-8068-4ea3-b32a-61027b32e95d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-vrzqb\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.848340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.848470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.848520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.848633 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:10.848577213 +0000 UTC m=+29.549239071 (durationBeforeRetry 2s). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.848791 4769 secret.go:188] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.848704 4769 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.848887 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:10.848862351 +0000 UTC m=+29.549524349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.849002 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:10.848984054 +0000 UTC m=+29.549645902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.949491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:08 crc kubenswrapper[4769]: I1121 11:51:08.949572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.949781 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.949805 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.949819 4769 projected.go:194] Error preparing data for projected volume kube-api-access-s2dwl for pod openshift-network-diagnostics/network-check-source-55646444c4-trplf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.949891 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl podName:9d751cbb-f2e2-430d-9754-c882a5e924a5 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:10.949865326 +0000 UTC m=+29.650527164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dwl" (UniqueName: "kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl") pod "network-check-source-55646444c4-trplf" (UID: "9d751cbb-f2e2-430d-9754-c882a5e924a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.950169 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.950239 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.950257 4769 projected.go:194] Error preparing data for projected volume kube-api-access-cqllr for pod openshift-network-diagnostics/network-check-target-xd92c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:08 crc kubenswrapper[4769]: E1121 11:51:08.950310 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr podName:3b6479f0-333b-4a96-9adf-2099afdc2447 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:10.950294027 +0000 UTC m=+29.650955865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqllr" (UniqueName: "kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr") pod "network-check-target-xd92c" (UID: "3b6479f0-333b-4a96-9adf-2099afdc2447") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.159951 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.176866 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.177308 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:09 crc kubenswrapper[4769]: E1121 11:51:09.177540 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.273159 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.273250 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:09 crc kubenswrapper[4769]: E1121 11:51:09.273327 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:09 crc kubenswrapper[4769]: E1121 11:51:09.273378 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.281532 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ab3dd5-8196-46d0-ad33-122e2ca51def" path="/var/lib/kubelet/pods/01ab3dd5-8196-46d0-ad33-122e2ca51def/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.283526 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ae3b1a-e8e7-4524-b54b-61eab6f9239a" path="/var/lib/kubelet/pods/09ae3b1a-e8e7-4524-b54b-61eab6f9239a/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.285426 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09efc573-dbb6-4249-bd59-9b87aba8dd28" path="/var/lib/kubelet/pods/09efc573-dbb6-4249-bd59-9b87aba8dd28/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.286685 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b574797-001e-440a-8f4e-c0be86edad0f" path="/var/lib/kubelet/pods/0b574797-001e-440a-8f4e-c0be86edad0f/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.287479 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b78653f-4ff9-4508-8672-245ed9b561e3" path="/var/lib/kubelet/pods/0b78653f-4ff9-4508-8672-245ed9b561e3/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.288504 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1386a44e-36a2-460c-96d0-0359d2b6f0f5" path="/var/lib/kubelet/pods/1386a44e-36a2-460c-96d0-0359d2b6f0f5/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.289174 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bf7eb37-55a3-4c65-b768-a94c82151e69" path="/var/lib/kubelet/pods/1bf7eb37-55a3-4c65-b768-a94c82151e69/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.289880 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d611f23-29be-4491-8495-bee1670e935f" path="/var/lib/kubelet/pods/1d611f23-29be-4491-8495-bee1670e935f/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.290612 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20b0d48f-5fd6-431c-a545-e3c800c7b866" path="/var/lib/kubelet/pods/20b0d48f-5fd6-431c-a545-e3c800c7b866/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.291251 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c" path="/var/lib/kubelet/pods/210d8245-ebfc-4e3b-ac4a-e21ce76f9a7c/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.291838 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22c825df-677d-4ca6-82db-3454ed06e783" path="/var/lib/kubelet/pods/22c825df-677d-4ca6-82db-3454ed06e783/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.292720 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e176fe-21b4-4974-b1ed-c8b94f112a7f" path="/var/lib/kubelet/pods/25e176fe-21b4-4974-b1ed-c8b94f112a7f/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.293328 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308be0ea-9f5f-4b29-aeb1-5abd31a0b17b" path="/var/lib/kubelet/pods/308be0ea-9f5f-4b29-aeb1-5abd31a0b17b/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.293881 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d8b7a1-420e-4252-a5b7-eebe8a111292" path="/var/lib/kubelet/pods/31d8b7a1-420e-4252-a5b7-eebe8a111292/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.294487 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab1a177-2de0-46d9-b765-d0d0649bb42e" path="/var/lib/kubelet/pods/3ab1a177-2de0-46d9-b765-d0d0649bb42e/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.295080 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cb93b32-e0ae-4377-b9c8-fdb9842c6d59" path="/var/lib/kubelet/pods/3cb93b32-e0ae-4377-b9c8-fdb9842c6d59/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.298508 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43509403-f426-496e-be36-56cef71462f5" path="/var/lib/kubelet/pods/43509403-f426-496e-be36-56cef71462f5/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.299052 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44663579-783b-4372-86d6-acf235a62d72" path="/var/lib/kubelet/pods/44663579-783b-4372-86d6-acf235a62d72/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.300268 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="496e6271-fb68-4057-954e-a0d97a4afa3f" path="/var/lib/kubelet/pods/496e6271-fb68-4057-954e-a0d97a4afa3f/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.300968 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c341d1-5089-4bc2-86a0-a5e165cfcc6b" path="/var/lib/kubelet/pods/49c341d1-5089-4bc2-86a0-a5e165cfcc6b/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.301562 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ef4625-1d3a-4a9f-b595-c2433d32326d" path="/var/lib/kubelet/pods/49ef4625-1d3a-4a9f-b595-c2433d32326d/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.302828 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb40260-dbaa-4fb0-84df-5e680505d512" path="/var/lib/kubelet/pods/4bb40260-dbaa-4fb0-84df-5e680505d512/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.303492 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5225d0e4-402f-4861-b410-819f433b1803" path="/var/lib/kubelet/pods/5225d0e4-402f-4861-b410-819f433b1803/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.304784 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5441d097-087c-4d9a-baa8-b210afa90fc9" path="/var/lib/kubelet/pods/5441d097-087c-4d9a-baa8-b210afa90fc9/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.305292 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57a731c4-ef35-47a8-b875-bfb08a7f8011" path="/var/lib/kubelet/pods/57a731c4-ef35-47a8-b875-bfb08a7f8011/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.306687 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b88f790-22fa-440e-b583-365168c0b23d" path="/var/lib/kubelet/pods/5b88f790-22fa-440e-b583-365168c0b23d/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.307517 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe579f8-e8a6-4643-bce5-a661393c4dde" path="/var/lib/kubelet/pods/5fe579f8-e8a6-4643-bce5-a661393c4dde/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.308017 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6402fda4-df10-493c-b4e5-d0569419652d" path="/var/lib/kubelet/pods/6402fda4-df10-493c-b4e5-d0569419652d/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.308951 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6509e943-70c6-444c-bc41-48a544e36fbd" path="/var/lib/kubelet/pods/6509e943-70c6-444c-bc41-48a544e36fbd/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.309548 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6731426b-95fe-49ff-bb5f-40441049fde2" path="/var/lib/kubelet/pods/6731426b-95fe-49ff-bb5f-40441049fde2/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.310512 4769 kubelet_volumes.go:152] "Cleaned up orphaned volume subpath from pod" podUID="6ea678ab-3438-413e-bfe3-290ae7725660" path="/var/lib/kubelet/pods/6ea678ab-3438-413e-bfe3-290ae7725660/volume-subpaths/run-systemd/ovnkube-controller/6" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.310619 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea678ab-3438-413e-bfe3-290ae7725660" path="/var/lib/kubelet/pods/6ea678ab-3438-413e-bfe3-290ae7725660/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.312512 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7539238d-5fe0-46ed-884e-1c3b566537ec" path="/var/lib/kubelet/pods/7539238d-5fe0-46ed-884e-1c3b566537ec/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.313504 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7583ce53-e0fe-4a16-9e4d-50516596a136" path="/var/lib/kubelet/pods/7583ce53-e0fe-4a16-9e4d-50516596a136/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.313981 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bb08738-c794-4ee8-9972-3a62ca171029" path="/var/lib/kubelet/pods/7bb08738-c794-4ee8-9972-3a62ca171029/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.317567 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87cf06ed-a83f-41a7-828d-70653580a8cb" path="/var/lib/kubelet/pods/87cf06ed-a83f-41a7-828d-70653580a8cb/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.318281 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cea82b4-6893-4ddc-af9f-1bb5ae425c5b" path="/var/lib/kubelet/pods/8cea82b4-6893-4ddc-af9f-1bb5ae425c5b/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.319271 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="925f1c65-6136-48ba-85aa-3a3b50560753" path="/var/lib/kubelet/pods/925f1c65-6136-48ba-85aa-3a3b50560753/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.319885 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b93a3a-6083-4aea-8eab-fe1aa8245ad9" path="/var/lib/kubelet/pods/96b93a3a-6083-4aea-8eab-fe1aa8245ad9/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.320902 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d4552c7-cd75-42dd-8880-30dd377c49a4" path="/var/lib/kubelet/pods/9d4552c7-cd75-42dd-8880-30dd377c49a4/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.321449 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0128f3a-b052-44ed-a84e-c4c8aaf17c13" path="/var/lib/kubelet/pods/a0128f3a-b052-44ed-a84e-c4c8aaf17c13/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.322045 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31745f5-9847-4afe-82a5-3161cc66ca93" path="/var/lib/kubelet/pods/a31745f5-9847-4afe-82a5-3161cc66ca93/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.323103 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b11524ee-3fca-4b1b-9cdf-6da289fdbc7d" path="/var/lib/kubelet/pods/b11524ee-3fca-4b1b-9cdf-6da289fdbc7d/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.324103 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6312bbd-5731-4ea0-a20f-81d5a57df44a" path="/var/lib/kubelet/pods/b6312bbd-5731-4ea0-a20f-81d5a57df44a/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.324601 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6cd30de-2eeb-49a2-ab40-9167f4560ff5" path="/var/lib/kubelet/pods/b6cd30de-2eeb-49a2-ab40-9167f4560ff5/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.325567 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc5039c0-ea34-426b-a2b7-fbbc87b49a6d" path="/var/lib/kubelet/pods/bc5039c0-ea34-426b-a2b7-fbbc87b49a6d/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.326069 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd23aa5c-e532-4e53-bccf-e79f130c5ae8" path="/var/lib/kubelet/pods/bd23aa5c-e532-4e53-bccf-e79f130c5ae8/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.327157 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf126b07-da06-4140-9a57-dfd54fc6b486" path="/var/lib/kubelet/pods/bf126b07-da06-4140-9a57-dfd54fc6b486/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.327662 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c03ee662-fb2f-4fc4-a2c1-af487c19d254" path="/var/lib/kubelet/pods/c03ee662-fb2f-4fc4-a2c1-af487c19d254/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.328584 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d" path="/var/lib/kubelet/pods/cd70aa09-68dd-4d64-bd6f-156fe6d1dc6d/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.329027 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e6199b-1264-4501-8953-767f51328d08" path="/var/lib/kubelet/pods/e7e6199b-1264-4501-8953-767f51328d08/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.329563 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efdd0498-1daa-4136-9a4a-3b948c2293fc" path="/var/lib/kubelet/pods/efdd0498-1daa-4136-9a4a-3b948c2293fc/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.330493 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88749ec-7931-4ee7-b3fc-1ec5e11f92e9" path="/var/lib/kubelet/pods/f88749ec-7931-4ee7-b3fc-1ec5e11f92e9/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.330967 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda69060-fa79-4696-b1a6-7980f124bf7c" path="/var/lib/kubelet/pods/fda69060-fa79-4696-b1a6-7980f124bf7c/volumes" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.461472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" event={"ID":"ef543e1b-8068-4ea3-b32a-61027b32e95d","Type":"ContainerStarted","Data":"e987fb8fda13a96f3abd56cc2dab419f4ec35ef0e70e814225ecf68bad54c184"} Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.462146 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:09 crc kubenswrapper[4769]: E1121 11:51:09.462360 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.478645 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"95e6a81c-0a32-4f23-95a4-a5441b25ce58\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:46Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:46Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://5a98ecd71e100ba56b4fd5bf5c16df94d7ac43d3aa4b3cbfff9e118372583b63\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://39becd5597224db006e3185e3932e2508a6d147b8785e4b77468e2b950d9175d\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://4234f048c6ee520b76ed0b33f2846debcf09ec7bdc39faa90a7af74d1629f67d\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2025-11-21T11:51:03Z\\\",\\\"message\\\":\\\"00\\\\nI1121 11:51:03.367322 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI1121 11:51:03.367329 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI1121 11:51:03.376925 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW1121 11:51:03.376960 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW1121 11:51:03.376965 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW1121 11:51:03.376969 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW1121 11:51:03.376973 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW1121 11:51:03.376977 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW1121 11:51:03.376981 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nI1121 11:51:03.377009 1 genericapiserver.go:533] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nI1121 11:51:03.380923 1 requestheader_controller.go:172] Starting RequestHeaderAuthRequestController\\\\nI1121 11:51:03.380955 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController\\\\nI1121 11:51:03.381004 1 configmap_cafile_content.go:205] \\\\\\\"Starting controller\\\\\\\" name=\\\\\\\"client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file\\\\\\\"\\\\nI1121 11:51:03.381041 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file\\\\nF1121 11:51:03.381061 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI1121 11:51:03.381095 1 envvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"WatchListClient\\\\\\\" enabled=false\\\\nI1121 11:51:03.382165 1 envvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InformerResourceVersion\\\\\\\" enabled=false\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2025-11-21T11:51:02Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":2,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://f980a59136d2511b845f758f1dfe01b9d50201bf455cd80ef42b7bcadb83e955\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://e9097d0792c62d0120d763586c350c703d9ff04b9abfab6bb2a6b7e067ca851e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://e9097d0792c62d0120d763586c350c703d9ff04b9abfab6bb2a6b7e067ca851e\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2025-11-21T11:50:46Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:50:43Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.492742 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-4ln5h" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35512335ac39aed0f55b7f799f416f4f6445c20c1b19888cf2bb72bb276703f2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rczfb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-4ln5h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.505974 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ef543e1b-8068-4ea3-b32a-61027b32e95d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:09Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:09Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:09Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://e987fb8fda13a96f3abd56cc2dab419f4ec35ef0e70e814225ecf68bad54c184\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://2e77b86d1a1139320b0dbab63c02442d2684970f8de15711bc94091026c39d52\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-vrzqb\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.521176 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"766dac16-6160-4f35-b231-811c398f6154\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:48Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://f448ef58a0fd2b24b645e7031b1200632b93e2daf59cf95081707fa39e0a2aee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://25e825f642c95f8c820ac7fbe8c52ae0bf4793ac5e79bfb411ea3b6295567da1\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://960acc72b630ff2d1abe112d66ccfe0ebc61cb766891c548808fc7b1e0ae7636\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://31e2da7b9f51e05a12c1a40c9ea12651c177540dfe7d800040dee19d9794cda3\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:50:43Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.537651 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37a5e44f-9a88-4405-be8a-b645485e7312\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://ef1652d870b1803f3ba94803c6edb12605e99d38de583b240dc91cd952af8673\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rdwmf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-58b4c7f79c-55gtf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.551141 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d751cbb-f2e2-430d-9754-c882a5e924a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2dwl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-55646444c4-trplf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.566294 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b6479f0-333b-4a96-9adf-2099afdc2447\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-cqllr\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-xd92c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:09 crc kubenswrapper[4769]: I1121 11:51:09.581813 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae647598ec35cda5766806d3d44a91e3b9d4dee48ff154f3d8490165399873fd\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-85b44fc459-gdk6g\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:09Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.182295 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-svbck"] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.182590 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: W1121 11:51:10.186325 4769 reflector.go:561] object-"openshift-image-registry"/"image-registry-certificates": failed to list *v1.ConfigMap: configmaps "image-registry-certificates" is forbidden: User "system:node:crc" cannot list resource "configmaps" in API group "" in the namespace "openshift-image-registry": no relationship found between node 'crc' and this object Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.186361 4769 reflector.go:158] "Unhandled Error" err="object-\"openshift-image-registry\"/\"image-registry-certificates\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"image-registry-certificates\" is forbidden: User \"system:node:crc\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.187936 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.188353 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-4777p" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.192257 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.221184 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"95e6a81c-0a32-4f23-95a4-a5441b25ce58\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:46Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:46Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://5a98ecd71e100ba56b4fd5bf5c16df94d7ac43d3aa4b3cbfff9e118372583b63\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://39becd5597224db006e3185e3932e2508a6d147b8785e4b77468e2b950d9175d\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://4234f048c6ee520b76ed0b33f2846debcf09ec7bdc39faa90a7af74d1629f67d\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2025-11-21T11:51:03Z\\\",\\\"message\\\":\\\"00\\\\nI1121 11:51:03.367322 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI1121 11:51:03.367329 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI1121 11:51:03.376925 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW1121 11:51:03.376960 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW1121 11:51:03.376965 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW1121 11:51:03.376969 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW1121 11:51:03.376973 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW1121 11:51:03.376977 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW1121 11:51:03.376981 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nI1121 11:51:03.377009 1 genericapiserver.go:533] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nI1121 11:51:03.380923 1 requestheader_controller.go:172] Starting RequestHeaderAuthRequestController\\\\nI1121 11:51:03.380955 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController\\\\nI1121 11:51:03.381004 1 configmap_cafile_content.go:205] \\\\\\\"Starting controller\\\\\\\" name=\\\\\\\"client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file\\\\\\\"\\\\nI1121 11:51:03.381041 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file\\\\nF1121 11:51:03.381061 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI1121 11:51:03.381095 1 envvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"WatchListClient\\\\\\\" enabled=false\\\\nI1121 11:51:03.382165 1 envvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InformerResourceVersion\\\\\\\" enabled=false\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2025-11-21T11:51:02Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":2,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://f980a59136d2511b845f758f1dfe01b9d50201bf455cd80ef42b7bcadb83e955\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:9f36dc276e27753fc478274c7f7814a4f8945c987117ee1ea3b8e6355e6d7462\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://e9097d0792c62d0120d763586c350c703d9ff04b9abfab6bb2a6b7e067ca851e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://e9097d0792c62d0120d763586c350c703d9ff04b9abfab6bb2a6b7e067ca851e\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2025-11-21T11:50:46Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:50:43Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.242684 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-4ln5h" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35512335ac39aed0f55b7f799f416f4f6445c20c1b19888cf2bb72bb276703f2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rczfb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-4ln5h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.260697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e6b0faf-3981-481e-9654-56e987cc8230-host\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.260766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e6b0faf-3981-481e-9654-56e987cc8230-serviceca\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.260792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt979\" (UniqueName: \"kubernetes.io/projected/5e6b0faf-3981-481e-9654-56e987cc8230-kube-api-access-lt979\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.267518 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-vrzqb" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ef543e1b-8068-4ea3-b32a-61027b32e95d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:09Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:09Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:09Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://e987fb8fda13a96f3abd56cc2dab419f4ec35ef0e70e814225ecf68bad54c184\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://2e77b86d1a1139320b0dbab63c02442d2684970f8de15711bc94091026c39d52\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174f36cdd47ef0d1d2099482919d773257453265a2af0b17b154edc32fa41ac2\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2kz5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-vrzqb\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.273080 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.273499 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.293126 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-image-registry/node-ca-svbck" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5e6b0faf-3981-481e-9654-56e987cc8230\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:10Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:10Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:10Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:10Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9fa29d188c85a8b1e1bd15c9c18e96f1b235da9bd4a45dbc086a4a69520ed63f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lt979\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:51:10Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-svbck\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.311302 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37a5e44f-9a88-4405-be8a-b645485e7312\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://ef1652d870b1803f3ba94803c6edb12605e99d38de583b240dc91cd952af8673\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rdwmf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-58b4c7f79c-55gtf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.327321 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d751cbb-f2e2-430d-9754-c882a5e924a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2dwl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-55646444c4-trplf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.343138 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b6479f0-333b-4a96-9adf-2099afdc2447\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-cqllr\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-xd92c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.359754 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae647598ec35cda5766806d3d44a91e3b9d4dee48ff154f3d8490165399873fd\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-85b44fc459-gdk6g\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.362083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e6b0faf-3981-481e-9654-56e987cc8230-host\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.362167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e6b0faf-3981-481e-9654-56e987cc8230-serviceca\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.362216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e6b0faf-3981-481e-9654-56e987cc8230-host\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.362231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lt979\" (UniqueName: \"kubernetes.io/projected/5e6b0faf-3981-481e-9654-56e987cc8230-kube-api-access-lt979\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.378324 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"766dac16-6160-4f35-b231-811c398f6154\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:48Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://f448ef58a0fd2b24b645e7031b1200632b93e2daf59cf95081707fa39e0a2aee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://25e825f642c95f8c820ac7fbe8c52ae0bf4793ac5e79bfb411ea3b6295567da1\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://960acc72b630ff2d1abe112d66ccfe0ebc61cb766891c548808fc7b1e0ae7636\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://31e2da7b9f51e05a12c1a40c9ea12651c177540dfe7d800040dee19d9794cda3\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:50:43Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.383760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt979\" (UniqueName: \"kubernetes.io/projected/5e6b0faf-3981-481e-9654-56e987cc8230-kube-api-access-lt979\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.465898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4ln5h" event={"ID":"d75a4c96-2883-4a0b-bab2-0fab2b6c0b49","Type":"ContainerStarted","Data":"bea6c16c3e7442ed432f9ddb4c3d81cac9dc01880b1c6124879503a13b6aec61"} Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.493513 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-operator/network-operator-58b4c7f79c-55gtf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"37a5e44f-9a88-4405-be8a-b645485e7312\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:08Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://ef1652d870b1803f3ba94803c6edb12605e99d38de583b240dc91cd952af8673\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:51:08Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rdwmf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-58b4c7f79c-55gtf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.517480 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d751cbb-f2e2-430d-9754-c882a5e924a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s2dwl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-55646444c4-trplf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.534339 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3b6479f0-333b-4a96-9adf-2099afdc2447\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1baa38811c04bd8909e01a1f3be7421a1cb99d608d3dc4cf86d95b17de2ab8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-cqllr\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-xd92c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.548433 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:07Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae647598ec35cda5766806d3d44a91e3b9d4dee48ff154f3d8490165399873fd\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-85b44fc459-gdk6g\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.566930 4769 status_manager.go:875] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"766dac16-6160-4f35-b231-811c398f6154\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:48Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:51:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T11:50:43Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://f448ef58a0fd2b24b645e7031b1200632b93e2daf59cf95081707fa39e0a2aee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f9da410c07372b6c9ad6a79379b491cd10fdee88051c026b084652d85aed21\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://25e825f642c95f8c820ac7fbe8c52ae0bf4793ac5e79bfb411ea3b6295567da1\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06bc35825771aee1220d34720243b89c4ba8a8b335e6de2597126bd791fd90d4\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://960acc72b630ff2d1abe112d66ccfe0ebc61cb766891c548808fc7b1e0ae7636\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:46Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"containerID\\\":\\\"cri-o://31e2da7b9f51e05a12c1a40c9ea12651c177540dfe7d800040dee19d9794cda3\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:8506ce0a578bc18fac117eb2b82799488ffac0bed08287faaf92edaf5d17ab95\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2025-11-21T11:50:47Z\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T11:50:43Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2025-11-21T11:51:10Z is after 2025-08-24T17:21:41Z" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.603437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-daemon-fm7pk"] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.603777 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.604818 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qbbd2"] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.605009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.605534 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-r5tcq" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.606289 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.607876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.607950 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.608124 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"node-resolver-dockercfg-kz9s7" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.608134 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.608762 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.609216 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.648343 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-t78n2"] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.648712 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.653100 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.653668 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.658315 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.658353 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.659341 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-fd5m2"] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.660495 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.661115 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"default-dockercfg-2q5b6" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.662879 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.664434 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ancillary-tools-dockercfg-vnmsz" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.666956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-mcd-auth-proxy-config\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.667006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c74cd56-61e2-4621-aa07-73fce155a7c8-hosts-file\") pod \"node-resolver-qbbd2\" (UID: \"3c74cd56-61e2-4621-aa07-73fce155a7c8\") " pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.667027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9sx\" (UniqueName: \"kubernetes.io/projected/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-kube-api-access-gm9sx\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.667254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-rootfs\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.667278 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-proxy-tls\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.667314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjg8s\" (UniqueName: \"kubernetes.io/projected/3c74cd56-61e2-4621-aa07-73fce155a7c8-kube-api-access-rjg8s\") pod \"node-resolver-qbbd2\" (UID: \"3c74cd56-61e2-4621-aa07-73fce155a7c8\") " pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.685055 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ttpjb"] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.686052 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: W1121 11:51:10.700107 4769 reflector.go:561] object-"openshift-ovn-kubernetes"/"ovnkube-config": failed to list *v1.ConfigMap: configmaps "ovnkube-config" is forbidden: User "system:node:crc" cannot list resource "configmaps" in API group "" in the namespace "openshift-ovn-kubernetes": no relationship found between node 'crc' and this object Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.700159 4769 reflector.go:158] "Unhandled Error" err="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"ovnkube-config\" is forbidden: User \"system:node:crc\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ovn-kubernetes\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.700748 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Nov 21 11:51:10 crc kubenswrapper[4769]: W1121 11:51:10.700773 4769 reflector.go:561] object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert": failed to list *v1.Secret: secrets "ovn-node-metrics-cert" is forbidden: User "system:node:crc" cannot list resource "secrets" in API group "" in the namespace "openshift-ovn-kubernetes": no relationship found between node 'crc' and this object Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.700833 4769 reflector.go:158] "Unhandled Error" err="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"ovn-node-metrics-cert\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ovn-kubernetes\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.700782 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.701218 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.701671 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.702836 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-kubernetes-node-dockercfg-pwtwl" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-cnibin\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768521 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-etc-kubernetes\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-system-cni-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-os-release\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-netns\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-cni-multus\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-mcd-auth-proxy-config\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-kubelet\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-log-socket\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-cni-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-hostroot\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-daemon-config\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-proxy-tls\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768971 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-slash\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-systemd\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.768998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-socket-dir-parent\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-script-lib\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-os-release\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jhjm\" (UniqueName: \"kubernetes.io/projected/830d33b5-95d8-4991-afc9-489b2e4a51c2-kube-api-access-2jhjm\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-cni-binary-copy\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-kubelet\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-ovn\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-etc-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpvql\" (UniqueName: \"kubernetes.io/projected/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-kube-api-access-wpvql\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-k8s-cni-cncf-io\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-systemd-units\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-cni-bin\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-conf-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769239 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7rf\" (UniqueName: \"kubernetes.io/projected/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-kube-api-access-xt7rf\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-bin\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-netd\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-var-lib-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-node-log\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769346 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c74cd56-61e2-4621-aa07-73fce155a7c8-hosts-file\") pod \"node-resolver-qbbd2\" (UID: \"3c74cd56-61e2-4621-aa07-73fce155a7c8\") " pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9sx\" (UniqueName: \"kubernetes.io/projected/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-kube-api-access-gm9sx\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830d33b5-95d8-4991-afc9-489b2e4a51c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-rootfs\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-system-cni-dir\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-cnibin\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-netns\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-env-overrides\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rjg8s\" (UniqueName: \"kubernetes.io/projected/3c74cd56-61e2-4621-aa07-73fce155a7c8-kube-api-access-rjg8s\") pod \"node-resolver-qbbd2\" (UID: \"3c74cd56-61e2-4621-aa07-73fce155a7c8\") " pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/830d33b5-95d8-4991-afc9-489b2e4a51c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-multus-certs\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-mcd-auth-proxy-config\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.769843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c74cd56-61e2-4621-aa07-73fce155a7c8-hosts-file\") pod \"node-resolver-qbbd2\" (UID: \"3c74cd56-61e2-4621-aa07-73fce155a7c8\") " pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.770025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-rootfs\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.773114 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-proxy-tls\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.793658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjg8s\" (UniqueName: \"kubernetes.io/projected/3c74cd56-61e2-4621-aa07-73fce155a7c8-kube-api-access-rjg8s\") pod \"node-resolver-qbbd2\" (UID: \"3c74cd56-61e2-4621-aa07-73fce155a7c8\") " pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.794224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9sx\" (UniqueName: \"kubernetes.io/projected/ac6c170d-36f7-482f-816d-9bc6b2a6bca0-kube-api-access-gm9sx\") pod \"machine-config-daemon-fm7pk\" (UID: \"ac6c170d-36f7-482f-816d-9bc6b2a6bca0\") " pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-kubelet\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.870662 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:14.87063314 +0000 UTC m=+33.571294958 (durationBeforeRetry 4s). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-kubelet\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-ovn\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-etc-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wpvql\" (UniqueName: \"kubernetes.io/projected/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-kube-api-access-wpvql\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-k8s-cni-cncf-io\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-systemd-units\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-ovn\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870849 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-etc-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-k8s-cni-cncf-io\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-cni-bin\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-conf-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7rf\" (UniqueName: \"kubernetes.io/projected/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-kube-api-access-xt7rf\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870960 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-bin\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-netd\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871006 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-var-lib-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-node-log\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830d33b5-95d8-4991-afc9-489b2e4a51c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-cnibin\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871201 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-systemd-units\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871230 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-system-cni-dir\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.870850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-cni-bin\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-conf-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-netd\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.871373 4769 secret.go:188] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871203 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-system-cni-dir\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.871414 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:14.87140376 +0000 UTC m=+33.572065628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871445 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-multus-certs\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-netns\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-env-overrides\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/830d33b5-95d8-4991-afc9-489b2e4a51c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-cnibin\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-etc-kubernetes\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-system-cni-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-os-release\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-netns\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-cni-multus\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-var-lib-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-kubelet\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-node-log\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871767 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871787 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-daemon-config\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-log-socket\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-cni-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-hostroot\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871922 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-slash\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871943 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-systemd\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-cni-binary-copy\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-socket-dir-parent\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-script-lib\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-os-release\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2jhjm\" (UniqueName: \"kubernetes.io/projected/830d33b5-95d8-4991-afc9-489b2e4a51c2-kube-api-access-2jhjm\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-multus-certs\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830d33b5-95d8-4991-afc9-489b2e4a51c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872349 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-cnibin\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-netns\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871162 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-bin\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872377 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-openvswitch\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-env-overrides\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/830d33b5-95d8-4991-afc9-489b2e4a51c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.872968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-log-socket\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-daemon-config\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873241 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-cni-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-cnibin\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-hostroot\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-multus-socket-dir-parent\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-system-cni-dir\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873327 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-slash\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-systemd\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-os-release\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-run-netns\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-cni-multus\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873429 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-host-var-lib-kubelet\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-os-release\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.871749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.873581 4769 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-etc-kubernetes\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.873711 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:14.873701462 +0000 UTC m=+33.574363280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.873881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-cni-binary-copy\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.874056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830d33b5-95d8-4991-afc9-489b2e4a51c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.874122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-script-lib\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.892836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7rf\" (UniqueName: \"kubernetes.io/projected/ac430206-6dc1-40e3-829c-e7d9b2cd5fc0-kube-api-access-xt7rf\") pod \"multus-t78n2\" (UID: \"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0\") " pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.897476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpvql\" (UniqueName: \"kubernetes.io/projected/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-kube-api-access-wpvql\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.903440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jhjm\" (UniqueName: \"kubernetes.io/projected/830d33b5-95d8-4991-afc9-489b2e4a51c2-kube-api-access-2jhjm\") pod \"multus-additional-cni-plugins-fd5m2\" (UID: \"830d33b5-95d8-4991-afc9-489b2e4a51c2\") " pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.918445 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.925798 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbbd2" Nov 21 11:51:10 crc kubenswrapper[4769]: W1121 11:51:10.929304 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6c170d_36f7_482f_816d_9bc6b2a6bca0.slice/crio-0996f9d121d6178658be88199232030e6f27a8bf4b1d1c486b3a3f93cc652d0e WatchSource:0}: Error finding container 0996f9d121d6178658be88199232030e6f27a8bf4b1d1c486b3a3f93cc652d0e: Status 404 returned error can't find the container with id 0996f9d121d6178658be88199232030e6f27a8bf4b1d1c486b3a3f93cc652d0e Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.933502 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-crc" podStartSLOduration=3.933485405 podStartE2EDuration="3.933485405s" podCreationTimestamp="2025-11-21 11:51:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:10.931738618 +0000 UTC m=+29.632400446" watchObservedRunningTime="2025-11-21 11:51:10.933485405 +0000 UTC m=+29.634147223" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.968545 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t78n2" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.973956 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.974036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974278 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974315 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974332 4769 projected.go:194] Error preparing data for projected volume kube-api-access-cqllr for pod openshift-network-diagnostics/network-check-target-xd92c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974406 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr podName:3b6479f0-333b-4a96-9adf-2099afdc2447 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:14.974381879 +0000 UTC m=+33.675043697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqllr" (UniqueName: "kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr") pod "network-check-target-xd92c" (UID: "3b6479f0-333b-4a96-9adf-2099afdc2447") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974671 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974779 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.974859 4769 projected.go:194] Error preparing data for projected volume kube-api-access-s2dwl for pod openshift-network-diagnostics/network-check-source-55646444c4-trplf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:10 crc kubenswrapper[4769]: E1121 11:51:10.977003 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl podName:9d751cbb-f2e2-430d-9754-c882a5e924a5 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:14.976977769 +0000 UTC m=+33.677639587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dwl" (UniqueName: "kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl") pod "network-check-source-55646444c4-trplf" (UID: "9d751cbb-f2e2-430d-9754-c882a5e924a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:10 crc kubenswrapper[4769]: I1121 11:51:10.978559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" Nov 21 11:51:11 crc kubenswrapper[4769]: W1121 11:51:11.001145 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac430206_6dc1_40e3_829c_e7d9b2cd5fc0.slice/crio-7655526b4a71a4ae0a4d6f57691f5ca8d8ef1c335498ff501463953bc4548edc WatchSource:0}: Error finding container 7655526b4a71a4ae0a4d6f57691f5ca8d8ef1c335498ff501463953bc4548edc: Status 404 returned error can't find the container with id 7655526b4a71a4ae0a4d6f57691f5ca8d8ef1c335498ff501463953bc4548edc Nov 21 11:51:11 crc kubenswrapper[4769]: W1121 11:51:11.003863 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830d33b5_95d8_4991_afc9_489b2e4a51c2.slice/crio-acb3ec8f1d34d7ca92aa0c6e778c32659f2e6e24c1f841bb56f31927583d3e3a WatchSource:0}: Error finding container acb3ec8f1d34d7ca92aa0c6e778c32659f2e6e24c1f841bb56f31927583d3e3a: Status 404 returned error can't find the container with id acb3ec8f1d34d7ca92aa0c6e778c32659f2e6e24c1f841bb56f31927583d3e3a Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.200173 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv"] Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.200604 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.203136 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-kubernetes-control-plane-dockercfg-gs7dd" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.203591 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-control-plane-metrics-cert" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.245601 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-64jk8"] Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.246015 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.246074 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.273650 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.273670 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.273845 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.273981 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.277244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad70e756-f0ef-478c-b80a-451fbad35055-env-overrides\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.277371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad70e756-f0ef-478c-b80a-451fbad35055-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.277554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad70e756-f0ef-478c-b80a-451fbad35055-ovnkube-config\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.277619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpnrp\" (UniqueName: \"kubernetes.io/projected/ad70e756-f0ef-478c-b80a-451fbad35055-kube-api-access-vpnrp\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.362695 4769 configmap.go:193] Couldn't get configMap openshift-image-registry/image-registry-certificates: failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.362802 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e6b0faf-3981-481e-9654-56e987cc8230-serviceca podName:5e6b0faf-3981-481e-9654-56e987cc8230 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:11.862781849 +0000 UTC m=+30.563443667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serviceca" (UniqueName: "kubernetes.io/configmap/5e6b0faf-3981-481e-9654-56e987cc8230-serviceca") pod "node-ca-svbck" (UID: "5e6b0faf-3981-481e-9654-56e987cc8230") : failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.378923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad70e756-f0ef-478c-b80a-451fbad35055-env-overrides\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.378969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad70e756-f0ef-478c-b80a-451fbad35055-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.379011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdfqc\" (UniqueName: \"kubernetes.io/projected/e18361a9-a58b-479a-9eb3-81ea8bab35c9-kube-api-access-qdfqc\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.379040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad70e756-f0ef-478c-b80a-451fbad35055-ovnkube-config\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.379066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vpnrp\" (UniqueName: \"kubernetes.io/projected/ad70e756-f0ef-478c-b80a-451fbad35055-kube-api-access-vpnrp\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.379254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.379553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad70e756-f0ef-478c-b80a-451fbad35055-env-overrides\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.384725 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad70e756-f0ef-478c-b80a-451fbad35055-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.403440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpnrp\" (UniqueName: \"kubernetes.io/projected/ad70e756-f0ef-478c-b80a-451fbad35055-kube-api-access-vpnrp\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.429824 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"image-registry-certificates" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.474221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerStarted","Data":"3f686269ce20838281728778101bafe5d3e57976d013dcb92ac675bb4e258d86"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.474324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerStarted","Data":"acb3ec8f1d34d7ca92aa0c6e778c32659f2e6e24c1f841bb56f31927583d3e3a"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.476068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbbd2" event={"ID":"3c74cd56-61e2-4621-aa07-73fce155a7c8","Type":"ContainerStarted","Data":"953ebfdf82adcee656abc8675075224377658b2ff00d871084e788e6968668c7"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.476117 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbbd2" event={"ID":"3c74cd56-61e2-4621-aa07-73fce155a7c8","Type":"ContainerStarted","Data":"3dcb9fc3ee0d482e672d982179dbc8818678eb04d557bbc5c7e65f694aa4a2a3"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.478065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"d15957e680ae5678b446f4ac9a0bb70f8cd0a79ba402a64e91e3793b62b4c628"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.478125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"097a41de05c8052f314ccd1f8c67cc1f8da280b99d567fe1bb61400ff6720929"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.478138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"0996f9d121d6178658be88199232030e6f27a8bf4b1d1c486b3a3f93cc652d0e"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.480158 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.480303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qdfqc\" (UniqueName: \"kubernetes.io/projected/e18361a9-a58b-479a-9eb3-81ea8bab35c9-kube-api-access-qdfqc\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.480321 4769 secret.go:188] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.480362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t78n2" event={"ID":"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0","Type":"ContainerStarted","Data":"6991a02e6c39470c98e11845cbefb9cdf2eccbc0d201d30f7af27fab782f40af"} Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.480389 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs podName:e18361a9-a58b-479a-9eb3-81ea8bab35c9 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:11.980369061 +0000 UTC m=+30.681030879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs") pod "network-metrics-daemon-64jk8" (UID: "e18361a9-a58b-479a-9eb3-81ea8bab35c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.480399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t78n2" event={"ID":"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0","Type":"ContainerStarted","Data":"7655526b4a71a4ae0a4d6f57691f5ca8d8ef1c335498ff501463953bc4548edc"} Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.513381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdfqc\" (UniqueName: \"kubernetes.io/projected/e18361a9-a58b-479a-9eb3-81ea8bab35c9-kube-api-access-qdfqc\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.560979 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t78n2" podStartSLOduration=1.5609552450000002 podStartE2EDuration="1.560955245s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:11.537852482 +0000 UTC m=+30.238514310" watchObservedRunningTime="2025-11-21 11:51:11.560955245 +0000 UTC m=+30.261617063" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.561573 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podStartSLOduration=1.561568082 podStartE2EDuration="1.561568082s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:11.560318208 +0000 UTC m=+30.260980046" watchObservedRunningTime="2025-11-21 11:51:11.561568082 +0000 UTC m=+30.262229900" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.586741 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qbbd2" podStartSLOduration=1.5867203810000001 podStartE2EDuration="1.586720381s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:11.585983091 +0000 UTC m=+30.286644929" watchObservedRunningTime="2025-11-21 11:51:11.586720381 +0000 UTC m=+30.287382199" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.873614 4769 secret.go:188] Couldn't get secret openshift-ovn-kubernetes/ovn-node-metrics-cert: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.873709 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert podName:a4af5aab-f4cc-4735-a602-fcf7ab2108f6 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:12.373689113 +0000 UTC m=+31.074350931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovn-node-metrics-cert" (UniqueName: "kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert") pod "ovnkube-node-ttpjb" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.873913 4769 configmap.go:193] Couldn't get configMap openshift-ovn-kubernetes/ovnkube-config: failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.874013 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config podName:a4af5aab-f4cc-4735-a602-fcf7ab2108f6 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:12.373990371 +0000 UTC m=+31.074652189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovnkube-config" (UniqueName: "kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config") pod "ovnkube-node-ttpjb" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6") : failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.884219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e6b0faf-3981-481e-9654-56e987cc8230-serviceca\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.885058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e6b0faf-3981-481e-9654-56e987cc8230-serviceca\") pod \"node-ca-svbck\" (UID: \"5e6b0faf-3981-481e-9654-56e987cc8230\") " pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.985238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.985393 4769 secret.go:188] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:11 crc kubenswrapper[4769]: E1121 11:51:11.985491 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs podName:e18361a9-a58b-479a-9eb3-81ea8bab35c9 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:12.985469029 +0000 UTC m=+31.686130907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs") pod "network-metrics-daemon-64jk8" (UID: "e18361a9-a58b-479a-9eb3-81ea8bab35c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.995971 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-svbck" Nov 21 11:51:11 crc kubenswrapper[4769]: I1121 11:51:11.998069 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.200004 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.210594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad70e756-f0ef-478c-b80a-451fbad35055-ovnkube-config\") pod \"ovnkube-control-plane-749d76644c-jw6tv\" (UID: \"ad70e756-f0ef-478c-b80a-451fbad35055\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.247065 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.247782 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:12 crc kubenswrapper[4769]: E1121 11:51:12.248004 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.272922 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:12 crc kubenswrapper[4769]: E1121 11:51:12.273280 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.389353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.389394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.390069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.392966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert\") pod \"ovnkube-node-ttpjb\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.424651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" Nov 21 11:51:12 crc kubenswrapper[4769]: W1121 11:51:12.436166 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad70e756_f0ef_478c_b80a_451fbad35055.slice/crio-9d883741522fe88c2e6b8d129447759de529a4c39a78791a43648743e3f62564 WatchSource:0}: Error finding container 9d883741522fe88c2e6b8d129447759de529a4c39a78791a43648743e3f62564: Status 404 returned error can't find the container with id 9d883741522fe88c2e6b8d129447759de529a4c39a78791a43648743e3f62564 Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.485523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-svbck" event={"ID":"5e6b0faf-3981-481e-9654-56e987cc8230","Type":"ContainerStarted","Data":"7d93b4722cd20339c95cac6f556660946e886a903ccac96618c9bd7aaa89a6f3"} Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.485595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-svbck" event={"ID":"5e6b0faf-3981-481e-9654-56e987cc8230","Type":"ContainerStarted","Data":"04234d53e641b75f866d6051231c8781c7d7b28f6f8cece1d8efd58bb166ed90"} Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.487937 4769 generic.go:334] "Generic (PLEG): container finished" podID="830d33b5-95d8-4991-afc9-489b2e4a51c2" containerID="3f686269ce20838281728778101bafe5d3e57976d013dcb92ac675bb4e258d86" exitCode=0 Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.488008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerDied","Data":"3f686269ce20838281728778101bafe5d3e57976d013dcb92ac675bb4e258d86"} Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.492150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" event={"ID":"ad70e756-f0ef-478c-b80a-451fbad35055","Type":"ContainerStarted","Data":"9d883741522fe88c2e6b8d129447759de529a4c39a78791a43648743e3f62564"} Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.498093 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.505033 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-svbck" podStartSLOduration=2.504995267 podStartE2EDuration="2.504995267s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:12.497807263 +0000 UTC m=+31.198469081" watchObservedRunningTime="2025-11-21 11:51:12.504995267 +0000 UTC m=+31.205657095" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.978331 4769 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.980609 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.980644 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.980653 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.980755 4769 kubelet_node_status.go:76] "Attempting to register node" node="crc" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.988680 4769 kubelet_node_status.go:115] "Node was previously registered" node="crc" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.988936 4769 kubelet_node_status.go:79] "Successfully registered node" node="crc" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.989973 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.990036 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.990046 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.990067 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeNotReady" Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.990081 4769 setters.go:603] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2025-11-21T11:51:12Z","lastTransitionTime":"2025-11-21T11:51:12Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Nov 21 11:51:12 crc kubenswrapper[4769]: I1121 11:51:12.996037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:12 crc kubenswrapper[4769]: E1121 11:51:12.996227 4769 secret.go:188] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:12 crc kubenswrapper[4769]: E1121 11:51:12.996332 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs podName:e18361a9-a58b-479a-9eb3-81ea8bab35c9 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:14.996307593 +0000 UTC m=+33.696969411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs") pod "network-metrics-daemon-64jk8" (UID: "e18361a9-a58b-479a-9eb3-81ea8bab35c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.011266 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.011306 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.011315 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.011332 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeNotReady" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.011360 4769 setters.go:603] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2025-11-21T11:51:13Z","lastTransitionTime":"2025-11-21T11:51:13Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.041600 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf"] Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.041954 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.044219 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"kube-root-ca.crt" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.044475 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"default-dockercfg-gxtc4" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.044525 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-version"/"cluster-version-operator-serving-cert" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.045076 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-version"/"openshift-service-ca.crt" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.097272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/37cf8181-5ef9-4827-956a-1388f972d0b9-kube-api-access\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.097317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37cf8181-5ef9-4827-956a-1388f972d0b9-serving-cert\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.097336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37cf8181-5ef9-4827-956a-1388f972d0b9-service-ca\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.097398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/37cf8181-5ef9-4827-956a-1388f972d0b9-etc-cvo-updatepayloads\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.097558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/37cf8181-5ef9-4827-956a-1388f972d0b9-etc-ssl-certs\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37cf8181-5ef9-4827-956a-1388f972d0b9-service-ca\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/37cf8181-5ef9-4827-956a-1388f972d0b9-etc-cvo-updatepayloads\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/37cf8181-5ef9-4827-956a-1388f972d0b9-etc-ssl-certs\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/37cf8181-5ef9-4827-956a-1388f972d0b9-kube-api-access\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37cf8181-5ef9-4827-956a-1388f972d0b9-serving-cert\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/37cf8181-5ef9-4827-956a-1388f972d0b9-etc-cvo-updatepayloads\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.199839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/37cf8181-5ef9-4827-956a-1388f972d0b9-etc-ssl-certs\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.200006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37cf8181-5ef9-4827-956a-1388f972d0b9-service-ca\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.208672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37cf8181-5ef9-4827-956a-1388f972d0b9-serving-cert\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.218671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/37cf8181-5ef9-4827-956a-1388f972d0b9-kube-api-access\") pod \"cluster-version-operator-5c965bbfc6-q28zf\" (UID: \"37cf8181-5ef9-4827-956a-1388f972d0b9\") " pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.243530 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" Nov 21 11:51:13 crc kubenswrapper[4769]: W1121 11:51:13.258737 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cf8181_5ef9_4827_956a_1388f972d0b9.slice/crio-4c8b48a3a5e09ca8e5ad618d841e6eb3c1a6d4bc5e212a4767640592d2ba845c WatchSource:0}: Error finding container 4c8b48a3a5e09ca8e5ad618d841e6eb3c1a6d4bc5e212a4767640592d2ba845c: Status 404 returned error can't find the container with id 4c8b48a3a5e09ca8e5ad618d841e6eb3c1a6d4bc5e212a4767640592d2ba845c Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.273263 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:13 crc kubenswrapper[4769]: E1121 11:51:13.274730 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.274787 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.274892 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:13 crc kubenswrapper[4769]: E1121 11:51:13.275083 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:13 crc kubenswrapper[4769]: E1121 11:51:13.275281 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.495961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" event={"ID":"37cf8181-5ef9-4827-956a-1388f972d0b9","Type":"ContainerStarted","Data":"4c8b48a3a5e09ca8e5ad618d841e6eb3c1a6d4bc5e212a4767640592d2ba845c"} Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.500695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" event={"ID":"ad70e756-f0ef-478c-b80a-451fbad35055","Type":"ContainerStarted","Data":"e0fbeee75c7594049f04f2b1ba4ce72e5ff1a679c39280f4f73853ea4713aa31"} Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.501970 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" exitCode=0 Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.502007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} Nov 21 11:51:13 crc kubenswrapper[4769]: I1121 11:51:13.502027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"b53479502155e88e4704a022f3ad959bdc5c0cffe27e1996aa8f2b57c0b0b17d"} Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.273676 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:14 crc kubenswrapper[4769]: E1121 11:51:14.274559 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.508871 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" event={"ID":"37cf8181-5ef9-4827-956a-1388f972d0b9","Type":"ContainerStarted","Data":"f1311930782a8c390eba81ff86942390637cd6a05b7973fd1abe9f9dec7ee415"} Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.511896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerStarted","Data":"fd65faa5f13da074ad7299bcbf8e2cd23f74e503867381d59df4192ef4770e4b"} Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.514539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" event={"ID":"ad70e756-f0ef-478c-b80a-451fbad35055","Type":"ContainerStarted","Data":"d2008ed033ba9b76e7dd23ffaeec7fee77b184eb12d77167b7e1c211f8d93f4d"} Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.516615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.516650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.532957 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-version/cluster-version-operator-5c965bbfc6-q28zf" podStartSLOduration=4.532928642 podStartE2EDuration="4.532928642s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:14.531858823 +0000 UTC m=+33.232520701" watchObservedRunningTime="2025-11-21 11:51:14.532928642 +0000 UTC m=+33.233590500" Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.557831 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-749d76644c-jw6tv" podStartSLOduration=4.557803773 podStartE2EDuration="4.557803773s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:14.557068324 +0000 UTC m=+33.257730172" watchObservedRunningTime="2025-11-21 11:51:14.557803773 +0000 UTC m=+33.258465621" Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.920087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:14 crc kubenswrapper[4769]: E1121 11:51:14.920294 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:22.920260393 +0000 UTC m=+41.620922231 (durationBeforeRetry 8s). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.920785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:14 crc kubenswrapper[4769]: I1121 11:51:14.920878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:14 crc kubenswrapper[4769]: E1121 11:51:14.920930 4769 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:14 crc kubenswrapper[4769]: E1121 11:51:14.920998 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:22.920980352 +0000 UTC m=+41.621642180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:14 crc kubenswrapper[4769]: E1121 11:51:14.921076 4769 secret.go:188] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:14 crc kubenswrapper[4769]: E1121 11:51:14.921136 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:22.921124236 +0000 UTC m=+41.621786064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.021938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.021988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.022019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022117 4769 secret.go:188] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022127 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022152 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022170 4769 projected.go:194] Error preparing data for projected volume kube-api-access-s2dwl for pod openshift-network-diagnostics/network-check-source-55646444c4-trplf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022231 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs podName:e18361a9-a58b-479a-9eb3-81ea8bab35c9 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:19.022214184 +0000 UTC m=+37.722876012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs") pod "network-metrics-daemon-64jk8" (UID: "e18361a9-a58b-479a-9eb3-81ea8bab35c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022251 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl podName:9d751cbb-f2e2-430d-9754-c882a5e924a5 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:23.022242335 +0000 UTC m=+41.722904163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dwl" (UniqueName: "kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl") pod "network-check-source-55646444c4-trplf" (UID: "9d751cbb-f2e2-430d-9754-c882a5e924a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022679 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022714 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022728 4769 projected.go:194] Error preparing data for projected volume kube-api-access-cqllr for pod openshift-network-diagnostics/network-check-target-xd92c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.022819 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr podName:3b6479f0-333b-4a96-9adf-2099afdc2447 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:23.02280097 +0000 UTC m=+41.723462798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqllr" (UniqueName: "kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr") pod "network-check-target-xd92c" (UID: "3b6479f0-333b-4a96-9adf-2099afdc2447") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.273145 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.273287 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.273383 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.273429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.273487 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:15 crc kubenswrapper[4769]: E1121 11:51:15.273598 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.529305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.529352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.529364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.529374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.531593 4769 generic.go:334] "Generic (PLEG): container finished" podID="830d33b5-95d8-4991-afc9-489b2e4a51c2" containerID="fd65faa5f13da074ad7299bcbf8e2cd23f74e503867381d59df4192ef4770e4b" exitCode=0 Nov 21 11:51:15 crc kubenswrapper[4769]: I1121 11:51:15.531689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerDied","Data":"fd65faa5f13da074ad7299bcbf8e2cd23f74e503867381d59df4192ef4770e4b"} Nov 21 11:51:16 crc kubenswrapper[4769]: I1121 11:51:16.273294 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:16 crc kubenswrapper[4769]: E1121 11:51:16.273406 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:16 crc kubenswrapper[4769]: I1121 11:51:16.546512 4769 generic.go:334] "Generic (PLEG): container finished" podID="830d33b5-95d8-4991-afc9-489b2e4a51c2" containerID="326b432a70b8583c6d4fc5312c96336074426de8017b37d763a106e87a220ffa" exitCode=0 Nov 21 11:51:16 crc kubenswrapper[4769]: I1121 11:51:16.546565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerDied","Data":"326b432a70b8583c6d4fc5312c96336074426de8017b37d763a106e87a220ffa"} Nov 21 11:51:17 crc kubenswrapper[4769]: I1121 11:51:17.273038 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:17 crc kubenswrapper[4769]: I1121 11:51:17.273456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:17 crc kubenswrapper[4769]: E1121 11:51:17.273658 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:17 crc kubenswrapper[4769]: I1121 11:51:17.273815 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:17 crc kubenswrapper[4769]: E1121 11:51:17.274095 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:17 crc kubenswrapper[4769]: E1121 11:51:17.274318 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:18 crc kubenswrapper[4769]: I1121 11:51:18.273952 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:18 crc kubenswrapper[4769]: E1121 11:51:18.274103 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:18 crc kubenswrapper[4769]: I1121 11:51:18.558209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} Nov 21 11:51:18 crc kubenswrapper[4769]: I1121 11:51:18.560954 4769 generic.go:334] "Generic (PLEG): container finished" podID="830d33b5-95d8-4991-afc9-489b2e4a51c2" containerID="c1c4b83eb3ea885637c11efbabaf19160684c9c202d158d938acd4f48b4e8a3f" exitCode=0 Nov 21 11:51:18 crc kubenswrapper[4769]: I1121 11:51:18.560988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerDied","Data":"c1c4b83eb3ea885637c11efbabaf19160684c9c202d158d938acd4f48b4e8a3f"} Nov 21 11:51:19 crc kubenswrapper[4769]: I1121 11:51:19.067789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:19 crc kubenswrapper[4769]: E1121 11:51:19.067897 4769 secret.go:188] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:19 crc kubenswrapper[4769]: E1121 11:51:19.067948 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs podName:e18361a9-a58b-479a-9eb3-81ea8bab35c9 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:27.067933782 +0000 UTC m=+45.768595590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs") pod "network-metrics-daemon-64jk8" (UID: "e18361a9-a58b-479a-9eb3-81ea8bab35c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:19 crc kubenswrapper[4769]: I1121 11:51:19.273551 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:19 crc kubenswrapper[4769]: I1121 11:51:19.273592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:19 crc kubenswrapper[4769]: E1121 11:51:19.273720 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:19 crc kubenswrapper[4769]: I1121 11:51:19.273828 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:19 crc kubenswrapper[4769]: E1121 11:51:19.273907 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:19 crc kubenswrapper[4769]: E1121 11:51:19.274027 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:19 crc kubenswrapper[4769]: I1121 11:51:19.572260 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerStarted","Data":"ffc7465647522925e2f35c69f946888438de0133f9fe8715329128ab14668f2e"} Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.273953 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:20 crc kubenswrapper[4769]: E1121 11:51:20.274373 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.579476 4769 generic.go:334] "Generic (PLEG): container finished" podID="830d33b5-95d8-4991-afc9-489b2e4a51c2" containerID="ffc7465647522925e2f35c69f946888438de0133f9fe8715329128ab14668f2e" exitCode=0 Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.579536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerDied","Data":"ffc7465647522925e2f35c69f946888438de0133f9fe8715329128ab14668f2e"} Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.589391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerStarted","Data":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.589888 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.633011 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:20 crc kubenswrapper[4769]: I1121 11:51:20.637124 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podStartSLOduration=10.63709999 podStartE2EDuration="10.63709999s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:20.63598421 +0000 UTC m=+39.336646088" watchObservedRunningTime="2025-11-21 11:51:20.63709999 +0000 UTC m=+39.337761818" Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.273594 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.273594 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:21 crc kubenswrapper[4769]: E1121 11:51:21.273733 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.273607 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:21 crc kubenswrapper[4769]: E1121 11:51:21.273844 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:21 crc kubenswrapper[4769]: E1121 11:51:21.274022 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.599799 4769 generic.go:334] "Generic (PLEG): container finished" podID="830d33b5-95d8-4991-afc9-489b2e4a51c2" containerID="03274fe2159f1eca67891b3f590b94187aa7b77781daa83ce5f166e4668f8c78" exitCode=0 Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.599880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerDied","Data":"03274fe2159f1eca67891b3f590b94187aa7b77781daa83ce5f166e4668f8c78"} Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.599957 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.600421 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:21 crc kubenswrapper[4769]: I1121 11:51:21.671264 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:22 crc kubenswrapper[4769]: I1121 11:51:22.274041 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:22 crc kubenswrapper[4769]: E1121 11:51:22.274552 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:22 crc kubenswrapper[4769]: I1121 11:51:22.603112 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.008838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.008988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.009044 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.009006016 +0000 UTC m=+57.709667864 (durationBeforeRetry 16s). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.009073 4769 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.009111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.009169 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.00915321 +0000 UTC m=+57.709815038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.009367 4769 secret.go:188] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.009463 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert podName:5fe485a1-e14f-4c09-b5b9-f252bc42b7e8 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.009443577 +0000 UTC m=+57.710105435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert") pod "networking-console-plugin-85b44fc459-gdk6g" (UID: "5fe485a1-e14f-4c09-b5b9-f252bc42b7e8") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.110566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.110639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110771 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110790 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110804 4769 projected.go:194] Error preparing data for projected volume kube-api-access-s2dwl for pod openshift-network-diagnostics/network-check-source-55646444c4-trplf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110847 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110893 4769 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110910 4769 projected.go:194] Error preparing data for projected volume kube-api-access-cqllr for pod openshift-network-diagnostics/network-check-target-xd92c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.110863 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl podName:9d751cbb-f2e2-430d-9754-c882a5e924a5 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.110847794 +0000 UTC m=+57.811509622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dwl" (UniqueName: "kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl") pod "network-check-source-55646444c4-trplf" (UID: "9d751cbb-f2e2-430d-9754-c882a5e924a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.111001 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr podName:3b6479f0-333b-4a96-9adf-2099afdc2447 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.110977747 +0000 UTC m=+57.811639605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cqllr" (UniqueName: "kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr") pod "network-check-target-xd92c" (UID: "3b6479f0-333b-4a96-9adf-2099afdc2447") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.273922 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.274097 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.274140 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.274035 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.275282 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.275500 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.276411 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:23 crc kubenswrapper[4769]: E1121 11:51:23.276691 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(f4b27818a5e8e43d0dc095d08835c792)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="f4b27818a5e8e43d0dc095d08835c792" Nov 21 11:51:23 crc kubenswrapper[4769]: I1121 11:51:23.606334 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 11:51:24 crc kubenswrapper[4769]: I1121 11:51:24.016729 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:24 crc kubenswrapper[4769]: I1121 11:51:24.273792 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:24 crc kubenswrapper[4769]: E1121 11:51:24.273981 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:24 crc kubenswrapper[4769]: I1121 11:51:24.616705 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" event={"ID":"830d33b5-95d8-4991-afc9-489b2e4a51c2","Type":"ContainerStarted","Data":"66dc1d98210e82fea5b17f0058596d6d1858dc122286e8c94cff8c137dd9cbd6"} Nov 21 11:51:25 crc kubenswrapper[4769]: I1121 11:51:25.273887 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:25 crc kubenswrapper[4769]: I1121 11:51:25.274100 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:25 crc kubenswrapper[4769]: E1121 11:51:25.274387 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:25 crc kubenswrapper[4769]: E1121 11:51:25.274521 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:25 crc kubenswrapper[4769]: I1121 11:51:25.274730 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:25 crc kubenswrapper[4769]: E1121 11:51:25.274896 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:26 crc kubenswrapper[4769]: I1121 11:51:26.273436 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:26 crc kubenswrapper[4769]: E1121 11:51:26.273579 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:27 crc kubenswrapper[4769]: I1121 11:51:27.157795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:27 crc kubenswrapper[4769]: E1121 11:51:27.157919 4769 secret.go:188] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:27 crc kubenswrapper[4769]: E1121 11:51:27.158220 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs podName:e18361a9-a58b-479a-9eb3-81ea8bab35c9 nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.158180175 +0000 UTC m=+61.858841993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs") pod "network-metrics-daemon-64jk8" (UID: "e18361a9-a58b-479a-9eb3-81ea8bab35c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 21 11:51:27 crc kubenswrapper[4769]: I1121 11:51:27.273036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:27 crc kubenswrapper[4769]: I1121 11:51:27.273082 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:27 crc kubenswrapper[4769]: I1121 11:51:27.273036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:27 crc kubenswrapper[4769]: E1121 11:51:27.273173 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:27 crc kubenswrapper[4769]: E1121 11:51:27.273287 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:27 crc kubenswrapper[4769]: E1121 11:51:27.273381 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:28 crc kubenswrapper[4769]: I1121 11:51:28.151324 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fd5m2" podStartSLOduration=18.151303221 podStartE2EDuration="18.151303221s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:25.647297609 +0000 UTC m=+44.347959427" watchObservedRunningTime="2025-11-21 11:51:28.151303221 +0000 UTC m=+46.851965049" Nov 21 11:51:28 crc kubenswrapper[4769]: I1121 11:51:28.152029 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64jk8"] Nov 21 11:51:28 crc kubenswrapper[4769]: I1121 11:51:28.152157 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:28 crc kubenswrapper[4769]: E1121 11:51:28.152356 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:28 crc kubenswrapper[4769]: I1121 11:51:28.272878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:28 crc kubenswrapper[4769]: E1121 11:51:28.272994 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:29 crc kubenswrapper[4769]: I1121 11:51:29.273959 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:29 crc kubenswrapper[4769]: I1121 11:51:29.274092 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:29 crc kubenswrapper[4769]: E1121 11:51:29.274271 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd92c" podUID="3b6479f0-333b-4a96-9adf-2099afdc2447" Nov 21 11:51:29 crc kubenswrapper[4769]: E1121 11:51:29.274306 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" podUID="9d751cbb-f2e2-430d-9754-c882a5e924a5" Nov 21 11:51:30 crc kubenswrapper[4769]: I1121 11:51:30.273452 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:30 crc kubenswrapper[4769]: I1121 11:51:30.273487 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:30 crc kubenswrapper[4769]: E1121 11:51:30.274164 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" podUID="5fe485a1-e14f-4c09-b5b9-f252bc42b7e8" Nov 21 11:51:30 crc kubenswrapper[4769]: E1121 11:51:30.273999 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64jk8" podUID="e18361a9-a58b-479a-9eb3-81ea8bab35c9" Nov 21 11:51:30 crc kubenswrapper[4769]: I1121 11:51:30.987154 4769 kubelet_node_status.go:724] "Recording event message for node" node="crc" event="NodeReady" Nov 21 11:51:30 crc kubenswrapper[4769]: I1121 11:51:30.987448 4769 kubelet_node_status.go:538] "Fast updating node status as it just became ready" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.035403 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.036281 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.036940 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.037886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.038886 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-879f6c89f-2shtf"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.039521 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.040352 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-76f77b778f-m7dv8"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.041253 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.042586 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.043022 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.044031 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.044272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-dockercfg-xtcjv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.044334 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-h2zr2" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.044350 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication-operator/authentication-operator-69f744f599-thwj6"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.044738 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.045315 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.045839 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.046569 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.046862 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.047278 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.060912 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.061596 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.061617 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.061617 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.061839 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.062352 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.062411 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.064144 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.064790 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.065721 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.065809 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/machine-api-operator-5694c8668f-5sbdz"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.066299 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.067934 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.068333 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"service-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.070944 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-config-operator/openshift-config-operator-7777fb866f-9r5br"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.071878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.075806 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7954f5f757-74pvb"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.080874 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.081577 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.094287 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.094659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.094835 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095010 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095053 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095377 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"openshift-apiserver-sa-dockercfg-djjff" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095432 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095458 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-msq4c" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095501 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095522 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095560 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095702 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-rbac-proxy" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095749 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver-operator"/"openshift-apiserver-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095792 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication-operator"/"authentication-operator-dockercfg-mz9bj" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.095880 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.096424 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.096559 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.096849 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.096935 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"machine-api-operator-images" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.097036 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9d7485db-9vb2t"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.097504 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.098133 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.098241 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.098413 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.098870 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-api"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.098972 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.099119 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.099693 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100043 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"config-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100161 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"machine-approver-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100234 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-config-operator"/"openshift-config-operator-dockercfg-7pc5z" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100359 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"authentication-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100573 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100501 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"oauth-apiserver-sa-dockercfg-6r2bq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100849 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-machine-approver"/"kube-rbac-proxy" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.100899 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.101102 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.101168 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-sa-dockercfg-nl2j4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.101212 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.103391 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-config-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.104536 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication-operator"/"trusted-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.104816 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.104942 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.105143 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"cluster-samples-operator-dockercfg-xpp9w" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.105496 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-58897d9998-6wlsh"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.105709 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.105851 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-697d97f7c8-4h62k"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.105950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-samples-operator"/"samples-operator-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.106128 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.106255 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-samples-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.106785 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"machine-api-operator-dockercfg-mfbb7" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.106874 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.107165 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.107527 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.107544 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-machine-approver"/"machine-approver-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.112311 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.112930 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.113641 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.113683 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"cluster-image-registry-operator-dockercfg-m4qtx" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.113890 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-service-ca-bundle\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dgb4\" (UniqueName: \"kubernetes.io/projected/6f9a6875-27c1-409b-af5d-6a482243959d-kube-api-access-2dgb4\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-config\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnr4\" (UniqueName: \"kubernetes.io/projected/cbbb83ea-d851-41e9-9e1a-e55ef7994ef4-kube-api-access-9cnr4\") pod \"cluster-samples-operator-665b6dd947-q86d5\" (UID: \"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114411 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/e64f0532-628a-4fa4-a78d-8afb135e2b23-available-featuregates\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xstz\" (UniqueName: \"kubernetes.io/projected/44effadb-9e4b-4a98-ba7c-880e36bd66d2-kube-api-access-9xstz\") pod \"downloads-7954f5f757-74pvb\" (UID: \"44effadb-9e4b-4a98-ba7c-880e36bd66d2\") " pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-client-ca\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84f6eedd-0af4-4772-9b12-5df36fe8f469-serving-cert\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/6f9a6875-27c1-409b-af5d-6a482243959d-machine-approver-tls\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.114883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5t7w\" (UniqueName: \"kubernetes.io/projected/e64f0532-628a-4fa4-a78d-8afb135e2b23-kube-api-access-d5t7w\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115115 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/6f9a6875-27c1-409b-af5d-6a482243959d-auth-proxy-config\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115075 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-operator-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2jk8\" (UniqueName: \"kubernetes.io/projected/84f6eedd-0af4-4772-9b12-5df36fe8f469-kube-api-access-v2jk8\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115212 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-proxy-ca-bundles\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-config\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f9a6875-27c1-409b-af5d-6a482243959d-config\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbgn\" (UniqueName: \"kubernetes.io/projected/fbd1960b-a86a-4f6b-88da-bd98023c6b25-kube-api-access-psbgn\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115138 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"default-dockercfg-chnjx" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-trusted-ca-bundle\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbbb83ea-d851-41e9-9e1a-e55ef7994ef4-samples-operator-tls\") pod \"cluster-samples-operator-665b6dd947-q86d5\" (UID: \"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbd1960b-a86a-4f6b-88da-bd98023c6b25-serving-cert\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.115526 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f0532-628a-4fa4-a78d-8afb135e2b23-serving-cert\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.117227 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.117875 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.118097 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns-operator/dns-operator-744455d44c-9mb4n"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.118176 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.118711 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.118902 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.118962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.119954 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.120389 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-558db77b4-dppfh"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.120769 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.121574 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd-operator/etcd-operator-b45778765-vs5vn"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.122091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.122392 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.122763 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-f62pw" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.122812 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"console-operator-dockercfg-4xjcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123051 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123251 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"registry-dockercfg-kzzsd" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123520 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"installation-pull-secrets" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123612 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123681 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123826 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"image-registry-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.123956 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-dockercfg-vw8fw" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.136662 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.138103 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.139179 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console-operator"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.140165 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"console-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.141304 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"metrics-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.142259 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mcc-proxy-tls" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.142373 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.144015 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns-operator"/"dns-operator-dockercfg-9mqw5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.159893 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-controller-dockercfg-c2lfx" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.161316 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.161765 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.161946 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager-operator"/"openshift-controller-manager-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.162169 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.163301 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.164572 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.164889 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.165165 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.165312 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.165507 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.165860 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.171411 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-idp-0-file-data" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.172003 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"trusted-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.173626 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.174795 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.175318 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.175673 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.175878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.177011 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console-operator"/"trusted-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.177278 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-admission-controller-857f4d67dd-qks2k"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.178052 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-t6l7h"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.178054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.178752 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.179389 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.186339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.186560 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-znhcc" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.188484 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.188672 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.189294 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.189904 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.189301 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.190443 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.190836 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.192866 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-777779d784-tnn76"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.193226 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-9c57cc56f-r2rmv"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.193529 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.193591 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.193989 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.201950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f9a6875-27c1-409b-af5d-6a482243959d-config\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-psbgn\" (UniqueName: \"kubernetes.io/projected/fbd1960b-a86a-4f6b-88da-bd98023c6b25-kube-api-access-psbgn\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-trusted-ca-bundle\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbbb83ea-d851-41e9-9e1a-e55ef7994ef4-samples-operator-tls\") pod \"cluster-samples-operator-665b6dd947-q86d5\" (UID: \"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbd1960b-a86a-4f6b-88da-bd98023c6b25-serving-cert\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f0532-628a-4fa4-a78d-8afb135e2b23-serving-cert\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-service-ca-bundle\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2dgb4\" (UniqueName: \"kubernetes.io/projected/6f9a6875-27c1-409b-af5d-6a482243959d-kube-api-access-2dgb4\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-config\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnr4\" (UniqueName: \"kubernetes.io/projected/cbbb83ea-d851-41e9-9e1a-e55ef7994ef4-kube-api-access-9cnr4\") pod \"cluster-samples-operator-665b6dd947-q86d5\" (UID: \"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/e64f0532-628a-4fa4-a78d-8afb135e2b23-available-featuregates\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9xstz\" (UniqueName: \"kubernetes.io/projected/44effadb-9e4b-4a98-ba7c-880e36bd66d2-kube-api-access-9xstz\") pod \"downloads-7954f5f757-74pvb\" (UID: \"44effadb-9e4b-4a98-ba7c-880e36bd66d2\") " pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-client-ca\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84f6eedd-0af4-4772-9b12-5df36fe8f469-serving-cert\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/6f9a6875-27c1-409b-af5d-6a482243959d-machine-approver-tls\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d5t7w\" (UniqueName: \"kubernetes.io/projected/e64f0532-628a-4fa4-a78d-8afb135e2b23-kube-api-access-d5t7w\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.216990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/6f9a6875-27c1-409b-af5d-6a482243959d-auth-proxy-config\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.217011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v2jk8\" (UniqueName: \"kubernetes.io/projected/84f6eedd-0af4-4772-9b12-5df36fe8f469-kube-api-access-v2jk8\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.217031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-proxy-ca-bundles\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.217066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-config\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.217837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-config\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.218259 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f9a6875-27c1-409b-af5d-6a482243959d-config\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.219071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-trusted-ca-bundle\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.224742 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.225634 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.227276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-client-ca\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.228170 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-69f744f599-thwj6"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.228643 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.228878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.229490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e64f0532-628a-4fa4-a78d-8afb135e2b23-serving-cert\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.230054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84f6eedd-0af4-4772-9b12-5df36fe8f469-service-ca-bundle\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.230719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/e64f0532-628a-4fa4-a78d-8afb135e2b23-available-featuregates\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.230923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/6f9a6875-27c1-409b-af5d-6a482243959d-auth-proxy-config\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.231515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-config\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.231739 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.234933 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.235003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-proxy-ca-bundles\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.235067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84f6eedd-0af4-4772-9b12-5df36fe8f469-serving-cert\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.235238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbd1960b-a86a-4f6b-88da-bd98023c6b25-serving-cert\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.236204 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.236784 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.237004 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.237260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-76f77b778f-m7dv8"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.237776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbbb83ea-d851-41e9-9e1a-e55ef7994ef4-samples-operator-tls\") pod \"cluster-samples-operator-665b6dd947-q86d5\" (UID: \"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.238681 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5444994796-g9x6j"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.240662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/6f9a6875-27c1-409b-af5d-6a482243959d-machine-approver-tls\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.241728 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.242649 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xxl8f"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.242769 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.244564 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-7777fb866f-9r5br"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.244824 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-zd8jq"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.245538 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-server-n8dcr"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.245843 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.245903 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.244796 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.246225 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.246470 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7954f5f757-74pvb"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.247014 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-h2c4x"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.247713 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.248399 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.249714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.252990 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.254411 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.256270 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.257760 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.258325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-697d97f7c8-4h62k"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.259218 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.261274 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-879f6c89f-2shtf"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.263934 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-5694c8668f-5sbdz"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.265707 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.266884 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.268626 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-857f4d67dd-qks2k"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.270957 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-744455d44c-9mb4n"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.272169 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-558db77b4-dppfh"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.274571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.275264 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.278009 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.279223 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.279246 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-58897d9998-6wlsh"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.279258 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-b45778765-vs5vn"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.279269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-777779d784-tnn76"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.279688 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-t6l7h"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.281054 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.282099 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.283867 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.285260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.286678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.288017 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-9c57cc56f-r2rmv"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.289139 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9d7485db-9vb2t"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.290747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.291784 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wp29s"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.292587 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.292816 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.300565 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"audit" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.300800 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wp29s"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.301843 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxl8f"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.307834 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-zd8jq"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.308403 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn"] Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.318676 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-cliconfig" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.338629 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-service-ca" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.364308 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-trusted-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.378542 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-service-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.398342 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.419013 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.438783 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"etcd-ca-bundle" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.458737 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.479272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.499394 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-client" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.519687 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd-operator"/"etcd-operator-dockercfg-r9srn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.559035 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"kube-storage-version-migrator-operator-dockercfg-2bh8d" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.579226 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator-operator"/"serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.600222 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.620409 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.621943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-config\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32b03c4b-e544-42ae-b008-12a99bb25c51-config\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-client-ca\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8xjc\" (UniqueName: \"kubernetes.io/projected/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-kube-api-access-v8xjc\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8kc\" (UniqueName: \"kubernetes.io/projected/9b4852c7-e609-43fd-83b4-6c57ced3cab8-kube-api-access-zz8kc\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/280b6f07-4e22-4201-821b-28b2d3a49615-config\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4m9w\" (UniqueName: \"kubernetes.io/projected/ac331b1e-3f0e-45cd-9a87-c969ae716d44-kube-api-access-h4m9w\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-oauth-config\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac331b1e-3f0e-45cd-9a87-c969ae716d44-image-registry-operator-tls\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/27b60de2-5292-4da6-a3e9-925ba06bb813-machine-api-operator-tls\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-encryption-config\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-audit-dir\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-trusted-ca\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac331b1e-3f0e-45cd-9a87-c969ae716d44-trusted-ca\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-trusted-ca-bundle\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-service-ca\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622752 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-serving-cert\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622813 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27b60de2-5292-4da6-a3e9-925ba06bb813-config\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmzc\" (UniqueName: \"kubernetes.io/projected/280b6f07-4e22-4201-821b-28b2d3a49615-kube-api-access-dqmzc\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-oauth-serving-cert\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.622932 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-config\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-config\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-serving-cert\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623114 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32b03c4b-e544-42ae-b008-12a99bb25c51-serving-cert\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-etcd-serving-ca\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjc68\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-kube-api-access-zjc68\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623290 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-etcd-client\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v9qt\" (UniqueName: \"kubernetes.io/projected/a1473b4e-7238-4995-8b16-8722cba79ccd-kube-api-access-8v9qt\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/9b4852c7-e609-43fd-83b4-6c57ced3cab8-node-pullsecrets\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-audit\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-etcd-serving-ca\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623386 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-encryption-config\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/250e4b5d-38a4-4026-bd4e-2532f525067b-installation-pull-secrets\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-trusted-ca-bundle\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-console-config\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-244ft\" (UniqueName: \"kubernetes.io/projected/32b03c4b-e544-42ae-b008-12a99bb25c51-kube-api-access-244ft\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-trusted-ca\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/250e4b5d-38a4-4026-bd4e-2532f525067b-ca-trust-extracted\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-serving-cert\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-serving-cert\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-tls\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-audit-policies\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-trusted-ca-bundle\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623701 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-certificates\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-bound-sa-token\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bb2q\" (UniqueName: \"kubernetes.io/projected/27b60de2-5292-4da6-a3e9-925ba06bb813-kube-api-access-5bb2q\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n95\" (UniqueName: \"kubernetes.io/projected/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-kube-api-access-24n95\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac331b1e-3f0e-45cd-9a87-c969ae716d44-bound-sa-token\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-etcd-client\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623909 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/280b6f07-4e22-4201-821b-28b2d3a49615-serving-cert\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.623970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-image-import-ca\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.623995 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.123981127 +0000 UTC m=+50.824642945 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.624016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/9b4852c7-e609-43fd-83b4-6c57ced3cab8-audit-dir\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.624040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/27b60de2-5292-4da6-a3e9-925ba06bb813-images\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.624062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-serving-cert\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.624077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgpvn\" (UniqueName: \"kubernetes.io/projected/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-kube-api-access-cgpvn\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.638559 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator-operator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.659722 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-dockercfg-x57mr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.679772 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.699609 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-apiserver-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.720389 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.724978 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.725165 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.225132477 +0000 UTC m=+50.925794285 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/250e4b5d-38a4-4026-bd4e-2532f525067b-ca-trust-extracted\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-config\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/12723c70-e8e8-435b-954c-ab5d30700449-srv-cert\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpbcw\" (UniqueName: \"kubernetes.io/projected/5da2aac0-e8eb-4269-a189-320b9a714edd-kube-api-access-gpbcw\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwvb\" (UniqueName: \"kubernetes.io/projected/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-kube-api-access-rkwvb\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725506 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-trusted-ca\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/217395e4-4832-4c0d-a79f-1c2fa644b90e-serving-cert\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.725859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqz4q\" (UniqueName: \"kubernetes.io/projected/2c02946d-09e7-4074-90f9-9440a6c0136b-kube-api-access-dqz4q\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.725993 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.22598525 +0000 UTC m=+50.926647068 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-etcd-client\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/280b6f07-4e22-4201-821b-28b2d3a49615-serving-cert\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxq7h\" (UniqueName: \"kubernetes.io/projected/f9370e66-09f6-4083-9b6a-d926c1d9e03f-kube-api-access-fxq7h\") pod \"multus-admission-controller-857f4d67dd-qks2k\" (UID: \"f9370e66-09f6-4083-9b6a-d926c1d9e03f\") " pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-image-import-ca\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/9b4852c7-e609-43fd-83b4-6c57ced3cab8-audit-dir\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726171 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/27b60de2-5292-4da6-a3e9-925ba06bb813-images\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41825801-cb10-436f-ad81-3e65407237f7-bound-sa-token\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cgpvn\" (UniqueName: \"kubernetes.io/projected/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-kube-api-access-cgpvn\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/c62e3b58-f29e-4192-bfc8-b51fcb438f95-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-78cbb6b69f-c2gx5\" (UID: \"c62e3b58-f29e-4192-bfc8-b51fcb438f95\") " pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32b03c4b-e544-42ae-b008-12a99bb25c51-config\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/07fe6b0d-5538-4523-8477-f0e02a2925d2-kube-api-access\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726349 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/9b4852c7-e609-43fd-83b4-6c57ced3cab8-audit-dir\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-default-certificate\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/280b6f07-4e22-4201-821b-28b2d3a49615-config\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m29n5\" (UniqueName: \"kubernetes.io/projected/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-kube-api-access-m29n5\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.726998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-operator-metrics\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41825801-cb10-436f-ad81-3e65407237f7-trusted-ca\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32b03c4b-e544-42ae-b008-12a99bb25c51-config\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-metrics-certs\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/250e4b5d-38a4-4026-bd4e-2532f525067b-ca-trust-extracted\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac331b1e-3f0e-45cd-9a87-c969ae716d44-image-registry-operator-tls\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-serving-cert\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89d45255-b595-4f0a-8f76-75883503c09d-proxy-tls\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/280b6f07-4e22-4201-821b-28b2d3a49615-config\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/27b60de2-5292-4da6-a3e9-925ba06bb813-images\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.727616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-audit-dir\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.728831 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-mountpoint-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.728915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-audit-dir\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-plugins-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/f9370e66-09f6-4083-9b6a-d926c1d9e03f-webhook-certs\") pod \"multus-admission-controller-857f4d67dd-qks2k\" (UID: \"f9370e66-09f6-4083-9b6a-d926c1d9e03f\") " pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-client\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac331b1e-3f0e-45cd-9a87-c969ae716d44-trusted-ca\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729408 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-profile-collector-cert\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xctg\" (UniqueName: \"kubernetes.io/projected/f266b0c1-8875-49ea-a2ae-27bea5f767ed-kube-api-access-4xctg\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9dcb3e-0040-4ed8-b695-17487f0eca03-metrics-tls\") pod \"dns-operator-744455d44c-9mb4n\" (UID: \"6e9dcb3e-0040-4ed8-b695-17487f0eca03\") " pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjth8\" (UniqueName: \"kubernetes.io/projected/89d45255-b595-4f0a-8f76-75883503c09d-kube-api-access-fjth8\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-serving-cert\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-socket-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9630fd-9719-44c6-b527-a909d4a0ce2b-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27b60de2-5292-4da6-a3e9-925ba06bb813-config\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmzc\" (UniqueName: \"kubernetes.io/projected/280b6f07-4e22-4201-821b-28b2d3a49615-kube-api-access-dqmzc\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2c82641-a99e-414a-8d6e-df8f79896a5f-webhook-cert\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730282 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-config\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07fe6b0d-5538-4523-8477-f0e02a2925d2-config\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/89d45255-b595-4f0a-8f76-75883503c09d-mcc-auth-proxy-config\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730382 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/05bac206-a644-40c0-98fd-f7de5869bec1-audit-dir\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-config\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218a7fed-53ee-4ea6-9095-c499af80df24-config\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-service-ca-bundle\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-stats-auth\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-certs\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da2aac0-e8eb-4269-a189-320b9a714edd-cert\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxrmt\" (UniqueName: \"kubernetes.io/projected/1cf2d137-129b-470b-aed3-8c92b0fd8441-kube-api-access-kxrmt\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-config\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-cliconfig\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-service-ca\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-audit\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-encryption-config\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-registration-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.730903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/250e4b5d-38a4-4026-bd4e-2532f525067b-installation-pull-secrets\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.729528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-image-import-ca\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.732236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-audit\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.732373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac331b1e-3f0e-45cd-9a87-c969ae716d44-trusted-ca\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.732719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-config\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.732871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac331b1e-3f0e-45cd-9a87-c969ae716d44-image-registry-operator-tls\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.733423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-etcd-client\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.733421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27b60de2-5292-4da6-a3e9-925ba06bb813-config\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.731617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-serving-cert\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.735164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-trusted-ca-bundle\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.733922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-config\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.735232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-login\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.734822 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/280b6f07-4e22-4201-821b-28b2d3a49615-serving-cert\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.735739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-kube-api-access\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.735803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93f414a5-14a5-4856-bcd9-71f9abd9569c-config-volume\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.735829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.736388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-serving-cert\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.736804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-trusted-ca\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.737328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/250e4b5d-38a4-4026-bd4e-2532f525067b-installation-pull-secrets\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.736877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41825801-cb10-436f-ad81-3e65407237f7-metrics-tls\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.737509 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxfkg\" (UniqueName: \"kubernetes.io/projected/218a7fed-53ee-4ea6-9095-c499af80df24-kube-api-access-wxfkg\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.737625 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-node-bootstrap-token\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.737729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/b2c82641-a99e-414a-8d6e-df8f79896a5f-tmpfs\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.737906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-serving-cert\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.737974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-encryption-config\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.738144 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-trusted-ca\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.738521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-trusted-ca-bundle\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.738760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-serving-cert\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.738962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93f414a5-14a5-4856-bcd9-71f9abd9569c-metrics-tls\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-tls\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-srv-cert\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6zz\" (UniqueName: \"kubernetes.io/projected/fd38336f-cc4b-4953-83ee-91bd6566e43b-kube-api-access-rf6zz\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-audit-policies\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-certificates\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-trusted-ca-bundle\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6vsh\" (UniqueName: \"kubernetes.io/projected/d980fc96-9282-4f81-8bea-57d074eb8b05-kube-api-access-h6vsh\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.739943 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-bound-sa-token\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740107 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdql\" (UniqueName: \"kubernetes.io/projected/93f414a5-14a5-4856-bcd9-71f9abd9569c-kube-api-access-mmdql\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740162 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5bb2q\" (UniqueName: \"kubernetes.io/projected/27b60de2-5292-4da6-a3e9-925ba06bb813-kube-api-access-5bb2q\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hdv\" (UniqueName: \"kubernetes.io/projected/c62e3b58-f29e-4192-bfc8-b51fcb438f95-kube-api-access-v5hdv\") pod \"control-plane-machine-set-operator-78cbb6b69f-c2gx5\" (UID: \"c62e3b58-f29e-4192-bfc8-b51fcb438f95\") " pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-config-volume\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740441 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-trusted-ca-bundle\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-24n95\" (UniqueName: \"kubernetes.io/projected/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-kube-api-access-24n95\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2c02946d-09e7-4074-90f9-9440a6c0136b-auth-proxy-config\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b300dfd-e20c-48ce-8094-3cac376d7d05-package-server-manager-serving-cert\") pod \"package-server-manager-789f6589d5-58fdn\" (UID: \"8b300dfd-e20c-48ce-8094-3cac376d7d05\") " pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcs6d\" (UniqueName: \"kubernetes.io/projected/12723c70-e8e8-435b-954c-ab5d30700449-kube-api-access-qcs6d\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-config\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac331b1e-3f0e-45cd-9a87-c969ae716d44-bound-sa-token\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/217395e4-4832-4c0d-a79f-1c2fa644b90e-config\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9jk8\" (UniqueName: \"kubernetes.io/projected/b2c82641-a99e-414a-8d6e-df8f79896a5f-kube-api-access-f9jk8\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-audit-policies\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.740989 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-audit-policies\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.741185 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-serving-cert\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.741378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/4c9630fd-9719-44c6-b527-a909d4a0ce2b-kube-api-access-fz8xx\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.741502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-config\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.741763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-client-ca\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.741899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v8xjc\" (UniqueName: \"kubernetes.io/projected/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-kube-api-access-v8xjc\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-config\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742094 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/2c02946d-09e7-4074-90f9-9440a6c0136b-images\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742281 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-csi-data-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsx45\" (UniqueName: \"kubernetes.io/projected/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-kube-api-access-bsx45\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8kc\" (UniqueName: \"kubernetes.io/projected/9b4852c7-e609-43fd-83b4-6c57ced3cab8-kube-api-access-zz8kc\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnglq\" (UniqueName: \"kubernetes.io/projected/41825801-cb10-436f-ad81-3e65407237f7-kube-api-access-xnglq\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218a7fed-53ee-4ea6-9095-c499af80df24-serving-cert\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h4m9w\" (UniqueName: \"kubernetes.io/projected/ac331b1e-3f0e-45cd-9a87-c969ae716d44-kube-api-access-h4m9w\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-oauth-config\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-serving-cert\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742717 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpvzk\" (UniqueName: \"kubernetes.io/projected/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-kube-api-access-hpvzk\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/27b60de2-5292-4da6-a3e9-925ba06bb813-machine-api-operator-tls\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-encryption-config\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-trusted-ca\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6qt\" (UniqueName: \"kubernetes.io/projected/05bac206-a644-40c0-98fd-f7de5869bec1-kube-api-access-zt6qt\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mkb\" (UniqueName: \"kubernetes.io/projected/217395e4-4832-4c0d-a79f-1c2fa644b90e-kube-api-access-q9mkb\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.742965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-trusted-ca-bundle\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rszbp\" (UniqueName: \"kubernetes.io/projected/6e9dcb3e-0040-4ed8-b695-17487f0eca03-kube-api-access-rszbp\") pod \"dns-operator-744455d44c-9mb4n\" (UID: \"6e9dcb3e-0040-4ed8-b695-17487f0eca03\") " pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-certificates\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-router-certs\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743286 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-client-ca\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-secret-volume\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-service-ca\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.743734 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07fe6b0d-5538-4523-8477-f0e02a2925d2-serving-cert\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-serving-cert\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-trusted-ca-bundle\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-kube-api-access\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-tls\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/12723c70-e8e8-435b-954c-ab5d30700449-profile-collector-cert\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-oauth-serving-cert\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744941 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-service-ca\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.744986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-error\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1cf2d137-129b-470b-aed3-8c92b0fd8441-signing-cabundle\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-service-ca\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-serving-cert\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32b03c4b-e544-42ae-b008-12a99bb25c51-serving-cert\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-etcd-serving-ca\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjc68\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-kube-api-access-zjc68\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-session\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/4c9630fd-9719-44c6-b527-a909d4a0ce2b-ready\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-etcd-client\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c02946d-09e7-4074-90f9-9440a6c0136b-proxy-tls\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2c82641-a99e-414a-8d6e-df8f79896a5f-apiservice-cert\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1cf2d137-129b-470b-aed3-8c92b0fd8441-signing-key\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745576 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/9b4852c7-e609-43fd-83b4-6c57ced3cab8-node-pullsecrets\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745610 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-etcd-serving-ca\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745642 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8v9qt\" (UniqueName: \"kubernetes.io/projected/a1473b4e-7238-4995-8b16-8722cba79ccd-kube-api-access-8v9qt\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-console-config\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745783 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-244ft\" (UniqueName: \"kubernetes.io/projected/32b03c4b-e544-42ae-b008-12a99bb25c51-kube-api-access-244ft\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvw5l\" (UniqueName: \"kubernetes.io/projected/8b300dfd-e20c-48ce-8094-3cac376d7d05-kube-api-access-wvw5l\") pod \"package-server-manager-789f6589d5-58fdn\" (UID: \"8b300dfd-e20c-48ce-8094-3cac376d7d05\") " pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl7hd\" (UniqueName: \"kubernetes.io/projected/60317e6f-441a-43f1-b8eb-749db23aaee6-kube-api-access-fl7hd\") pod \"migrator-59844c95c7-djw5n\" (UID: \"60317e6f-441a-43f1-b8eb-749db23aaee6\") " pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-ca\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.745970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-serving-cert\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.746240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-oauth-serving-cert\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.746353 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/9b4852c7-e609-43fd-83b4-6c57ced3cab8-node-pullsecrets\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.746402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-serving-cert\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.747314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-serving-cert\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.747449 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/9b4852c7-e609-43fd-83b4-6c57ced3cab8-encryption-config\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.747473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/9b4852c7-e609-43fd-83b4-6c57ced3cab8-etcd-serving-ca\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.747715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-console-config\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.748103 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-etcd-serving-ca\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.750548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32b03c4b-e544-42ae-b008-12a99bb25c51-serving-cert\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.750931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-oauth-config\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.752183 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-serving-cert\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.752727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-etcd-client\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.754745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/27b60de2-5292-4da6-a3e9-925ba06bb813-machine-api-operator-tls\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.759623 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-dockercfg-qt55r" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.774901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-trusted-ca\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.779833 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler-operator"/"kube-scheduler-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.798845 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler-operator"/"openshift-kube-scheduler-operator-config" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.819032 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.839475 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-storage-version-migrator"/"kube-storage-version-migrator-sa-dockercfg-5xfcg" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.846743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.847033 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.346985704 +0000 UTC m=+51.047647522 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.847143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-cliconfig\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.847997 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-service-ca\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-registration-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-serving-cert\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-login\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-kube-api-access\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848184 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93f414a5-14a5-4856-bcd9-71f9abd9569c-config-volume\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wxfkg\" (UniqueName: \"kubernetes.io/projected/218a7fed-53ee-4ea6-9095-c499af80df24-kube-api-access-wxfkg\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41825801-cb10-436f-ad81-3e65407237f7-metrics-tls\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-node-bootstrap-token\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848334 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/b2c82641-a99e-414a-8d6e-df8f79896a5f-tmpfs\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848382 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93f414a5-14a5-4856-bcd9-71f9abd9569c-metrics-tls\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-srv-cert\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6zz\" (UniqueName: \"kubernetes.io/projected/fd38336f-cc4b-4953-83ee-91bd6566e43b-kube-api-access-rf6zz\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6vsh\" (UniqueName: \"kubernetes.io/projected/d980fc96-9282-4f81-8bea-57d074eb8b05-kube-api-access-h6vsh\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-config-volume\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdql\" (UniqueName: \"kubernetes.io/projected/93f414a5-14a5-4856-bcd9-71f9abd9569c-kube-api-access-mmdql\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hdv\" (UniqueName: \"kubernetes.io/projected/c62e3b58-f29e-4192-bfc8-b51fcb438f95-kube-api-access-v5hdv\") pod \"control-plane-machine-set-operator-78cbb6b69f-c2gx5\" (UID: \"c62e3b58-f29e-4192-bfc8-b51fcb438f95\") " pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qcs6d\" (UniqueName: \"kubernetes.io/projected/12723c70-e8e8-435b-954c-ab5d30700449-kube-api-access-qcs6d\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2c02946d-09e7-4074-90f9-9440a6c0136b-auth-proxy-config\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848633 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-service-ca\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848641 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-cliconfig\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b300dfd-e20c-48ce-8094-3cac376d7d05-package-server-manager-serving-cert\") pod \"package-server-manager-789f6589d5-58fdn\" (UID: \"8b300dfd-e20c-48ce-8094-3cac376d7d05\") " pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-config\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f9jk8\" (UniqueName: \"kubernetes.io/projected/b2c82641-a99e-414a-8d6e-df8f79896a5f-kube-api-access-f9jk8\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/217395e4-4832-4c0d-a79f-1c2fa644b90e-config\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-audit-policies\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/4c9630fd-9719-44c6-b527-a909d4a0ce2b-kube-api-access-fz8xx\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bsx45\" (UniqueName: \"kubernetes.io/projected/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-kube-api-access-bsx45\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/2c02946d-09e7-4074-90f9-9440a6c0136b-images\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-csi-data-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xnglq\" (UniqueName: \"kubernetes.io/projected/41825801-cb10-436f-ad81-3e65407237f7-kube-api-access-xnglq\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.848986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218a7fed-53ee-4ea6-9095-c499af80df24-serving-cert\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-registration-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/b2c82641-a99e-414a-8d6e-df8f79896a5f-tmpfs\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849012 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvzk\" (UniqueName: \"kubernetes.io/projected/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-kube-api-access-hpvzk\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-serving-cert\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849830 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6qt\" (UniqueName: \"kubernetes.io/projected/05bac206-a644-40c0-98fd-f7de5869bec1-kube-api-access-zt6qt\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mkb\" (UniqueName: \"kubernetes.io/projected/217395e4-4832-4c0d-a79f-1c2fa644b90e-kube-api-access-q9mkb\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.849967 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rszbp\" (UniqueName: \"kubernetes.io/projected/6e9dcb3e-0040-4ed8-b695-17487f0eca03-kube-api-access-rszbp\") pod \"dns-operator-744455d44c-9mb4n\" (UID: \"6e9dcb3e-0040-4ed8-b695-17487f0eca03\") " pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07fe6b0d-5538-4523-8477-f0e02a2925d2-serving-cert\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-router-certs\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-secret-volume\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-kube-api-access\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/12723c70-e8e8-435b-954c-ab5d30700449-profile-collector-cert\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-service-ca\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-error\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1cf2d137-129b-470b-aed3-8c92b0fd8441-signing-cabundle\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-session\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/4c9630fd-9719-44c6-b527-a909d4a0ce2b-ready\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-csi-data-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2c02946d-09e7-4074-90f9-9440a6c0136b-auth-proxy-config\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1cf2d137-129b-470b-aed3-8c92b0fd8441-signing-key\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c02946d-09e7-4074-90f9-9440a6c0136b-proxy-tls\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.850728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2c82641-a99e-414a-8d6e-df8f79896a5f-apiservice-cert\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-config\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851533 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/4c9630fd-9719-44c6-b527-a909d4a0ce2b-ready\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-service-ca\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-ca\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851887 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw5l\" (UniqueName: \"kubernetes.io/projected/8b300dfd-e20c-48ce-8094-3cac376d7d05-kube-api-access-wvw5l\") pod \"package-server-manager-789f6589d5-58fdn\" (UID: \"8b300dfd-e20c-48ce-8094-3cac376d7d05\") " pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fl7hd\" (UniqueName: \"kubernetes.io/projected/60317e6f-441a-43f1-b8eb-749db23aaee6-kube-api-access-fl7hd\") pod \"migrator-59844c95c7-djw5n\" (UID: \"60317e6f-441a-43f1-b8eb-749db23aaee6\") " pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.851980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-serving-cert\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-config\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/12723c70-e8e8-435b-954c-ab5d30700449-srv-cert\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/217395e4-4832-4c0d-a79f-1c2fa644b90e-config\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gpbcw\" (UniqueName: \"kubernetes.io/projected/5da2aac0-e8eb-4269-a189-320b9a714edd-kube-api-access-gpbcw\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwvb\" (UniqueName: \"kubernetes.io/projected/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-kube-api-access-rkwvb\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-trusted-ca\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dqz4q\" (UniqueName: \"kubernetes.io/projected/2c02946d-09e7-4074-90f9-9440a6c0136b-kube-api-access-dqz4q\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/217395e4-4832-4c0d-a79f-1c2fa644b90e-serving-cert\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fxq7h\" (UniqueName: \"kubernetes.io/projected/f9370e66-09f6-4083-9b6a-d926c1d9e03f-kube-api-access-fxq7h\") pod \"multus-admission-controller-857f4d67dd-qks2k\" (UID: \"f9370e66-09f6-4083-9b6a-d926c1d9e03f\") " pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41825801-cb10-436f-ad81-3e65407237f7-bound-sa-token\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/c62e3b58-f29e-4192-bfc8-b51fcb438f95-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-78cbb6b69f-c2gx5\" (UID: \"c62e3b58-f29e-4192-bfc8-b51fcb438f95\") " pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/07fe6b0d-5538-4523-8477-f0e02a2925d2-kube-api-access\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-default-certificate\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-audit-policies\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m29n5\" (UniqueName: \"kubernetes.io/projected/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-kube-api-access-m29n5\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.852921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-operator-metrics\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-error\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.853485 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.353455039 +0000 UTC m=+51.054116907 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41825801-cb10-436f-ad81-3e65407237f7-trusted-ca\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-metrics-certs\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853698 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-serving-cert\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89d45255-b595-4f0a-8f76-75883503c09d-proxy-tls\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-mountpoint-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-client\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-plugins-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/f9370e66-09f6-4083-9b6a-d926c1d9e03f-webhook-certs\") pod \"multus-admission-controller-857f4d67dd-qks2k\" (UID: \"f9370e66-09f6-4083-9b6a-d926c1d9e03f\") " pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853876 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-profile-collector-cert\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4xctg\" (UniqueName: \"kubernetes.io/projected/f266b0c1-8875-49ea-a2ae-27bea5f767ed-kube-api-access-4xctg\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9dcb3e-0040-4ed8-b695-17487f0eca03-metrics-tls\") pod \"dns-operator-744455d44c-9mb4n\" (UID: \"6e9dcb3e-0040-4ed8-b695-17487f0eca03\") " pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fjth8\" (UniqueName: \"kubernetes.io/projected/89d45255-b595-4f0a-8f76-75883503c09d-kube-api-access-fjth8\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853967 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2c82641-a99e-414a-8d6e-df8f79896a5f-webhook-cert\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-socket-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.853991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-login\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9630fd-9719-44c6-b527-a909d4a0ce2b-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854065 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07fe6b0d-5538-4523-8477-f0e02a2925d2-config\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/89d45255-b595-4f0a-8f76-75883503c09d-mcc-auth-proxy-config\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-mountpoint-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/05bac206-a644-40c0-98fd-f7de5869bec1-audit-dir\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218a7fed-53ee-4ea6-9095-c499af80df24-config\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-socket-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9630fd-9719-44c6-b527-a909d4a0ce2b-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-service-ca-bundle\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-stats-auth\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/05bac206-a644-40c0-98fd-f7de5869bec1-audit-dir\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-config\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-serving-cert\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d980fc96-9282-4f81-8bea-57d074eb8b05-plugins-dir\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-certs\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.855016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da2aac0-e8eb-4269-a189-320b9a714edd-cert\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.855076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kxrmt\" (UniqueName: \"kubernetes.io/projected/1cf2d137-129b-470b-aed3-8c92b0fd8441-kube-api-access-kxrmt\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.855173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-config\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.855650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-serving-cert\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.856511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.856636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.854283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-session\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.857041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-config\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.857054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-router-certs\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.857509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/89d45255-b595-4f0a-8f76-75883503c09d-mcc-auth-proxy-config\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.857996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-serving-cert\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.857492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.858265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-ca\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.858506 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-storage-version-migrator"/"kube-root-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.858605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-etcd-client\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.858783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/217395e4-4832-4c0d-a79f-1c2fa644b90e-serving-cert\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.861100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e9dcb3e-0040-4ed8-b695-17487f0eca03-metrics-tls\") pod \"dns-operator-744455d44c-9mb4n\" (UID: \"6e9dcb3e-0040-4ed8-b695-17487f0eca03\") " pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.862020 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89d45255-b595-4f0a-8f76-75883503c09d-proxy-tls\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.862346 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-serving-cert\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.899410 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"openshift-service-ca.crt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.919668 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"pprof-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.925657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-secret-volume\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.926071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/12723c70-e8e8-435b-954c-ab5d30700449-profile-collector-cert\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.928984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-profile-collector-cert\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.939762 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serviceaccount-dockercfg-rq7zk" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.955669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.955865 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.455823811 +0000 UTC m=+51.156485649 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.957347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:31 crc kubenswrapper[4769]: E1121 11:51:31.957841 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.457817725 +0000 UTC m=+51.158479583 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.958683 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"catalog-operator-serving-cert" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.968375 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/12723c70-e8e8-435b-954c-ab5d30700449-srv-cert\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:31 crc kubenswrapper[4769]: I1121 11:51:31.980256 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.000121 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.018521 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"ingress-operator-dockercfg-7lnqk" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.039836 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-operator"/"metrics-tls" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.054284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41825801-cb10-436f-ad81-3e65407237f7-metrics-tls\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.058610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.058942 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.558896172 +0000 UTC m=+51.259557990 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.059804 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"openshift-service-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.060040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.060636 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.560614078 +0000 UTC m=+51.261275936 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.087544 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-operator"/"trusted-ca" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.096511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41825801-cb10-436f-ad81-3e65407237f7-trusted-ca\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.098575 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-admission-controller-secret" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.110082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/f9370e66-09f6-4083-9b6a-d926c1d9e03f-webhook-certs\") pod \"multus-admission-controller-857f4d67dd-qks2k\" (UID: \"f9370e66-09f6-4083-9b6a-d926c1d9e03f\") " pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.118706 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ac-dockercfg-9lkdf" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.140450 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-metrics" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.150573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-operator-metrics\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.159101 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"marketplace-operator-dockercfg-5nsgg" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.160623 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.160945 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.660912365 +0000 UTC m=+51.361574223 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.161141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.161643 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.661624844 +0000 UTC m=+51.362286692 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.179261 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.197425 4769 request.go:700] Waited for 1.018257364s due to client-side throttling, not priority and fairness, request: GET:https://api-int.crc.testing:6443/api/v1/namespaces/openshift-marketplace/configmaps?fieldSelector=metadata.name%3Dopenshift-service-ca.crt&limit=500&resourceVersion=0 Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.199731 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"openshift-service-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.229281 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-marketplace"/"marketplace-trusted-ca" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.235126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-trusted-ca\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.238801 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-operator-dockercfg-98p87" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.259428 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"packageserver-service-cert" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.263168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.263317 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.763290436 +0000 UTC m=+51.463952284 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.264266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.265037 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.765009582 +0000 UTC m=+51.465671430 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.266886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2c82641-a99e-414a-8d6e-df8f79896a5f-apiservice-cert\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.270120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2c82641-a99e-414a-8d6e-df8f79896a5f-webhook-cert\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.273547 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.273563 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.279228 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"mco-proxy-tls" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.286112 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2c02946d-09e7-4074-90f9-9440a6c0136b-proxy-tls\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.300087 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"machine-config-operator-images" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.301668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/2c02946d-09e7-4074-90f9-9440a6c0136b-images\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.319717 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.330674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-config-volume\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.340041 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.359431 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.366023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.366902 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.86684041 +0000 UTC m=+51.567502278 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.367367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.369143 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.869130182 +0000 UTC m=+51.569792010 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.379212 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.400071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"service-ca-dockercfg-pn86c" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.419463 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca"/"signing-key" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.425834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1cf2d137-129b-470b-aed3-8c92b0fd8441-signing-key\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.438602 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"openshift-service-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.458327 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca"/"signing-cabundle" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.461930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1cf2d137-129b-470b-aed3-8c92b0fd8441-signing-cabundle\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.468770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.469135 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.969111509 +0000 UTC m=+51.669773337 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.469319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.469749 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:32.969730316 +0000 UTC m=+51.670392144 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.479636 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"serving-cert" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.485169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218a7fed-53ee-4ea6-9095-c499af80df24-serving-cert\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.499392 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"openshift-service-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.519098 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-service-ca-operator"/"service-ca-operator-dockercfg-rg9jl" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.539759 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-service-ca-operator"/"service-ca-operator-config" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.545691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218a7fed-53ee-4ea6-9095-c499af80df24-config\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.571221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.571385 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.071351358 +0000 UTC m=+51.772013196 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.571924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.572364 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.072347775 +0000 UTC m=+51.773009603 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.579082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbgn\" (UniqueName: \"kubernetes.io/projected/fbd1960b-a86a-4f6b-88da-bd98023c6b25-kube-api-access-psbgn\") pod \"controller-manager-879f6c89f-2shtf\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.598891 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xstz\" (UniqueName: \"kubernetes.io/projected/44effadb-9e4b-4a98-ba7c-880e36bd66d2-kube-api-access-9xstz\") pod \"downloads-7954f5f757-74pvb\" (UID: \"44effadb-9e4b-4a98-ba7c-880e36bd66d2\") " pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.603484 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.616714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5t7w\" (UniqueName: \"kubernetes.io/projected/e64f0532-628a-4fa4-a78d-8afb135e2b23-kube-api-access-d5t7w\") pod \"openshift-config-operator-7777fb866f-9r5br\" (UID: \"e64f0532-628a-4fa4-a78d-8afb135e2b23\") " pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.618930 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"olm-operator-serving-cert" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.632875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-srv-cert\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.639779 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.658392 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-dockercfg-gkqpw" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.673879 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.674360 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.174323476 +0000 UTC m=+51.874985344 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.674758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.675448 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.175420006 +0000 UTC m=+51.876081854 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.679389 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-serving-cert" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.685851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07fe6b0d-5538-4523-8477-f0e02a2925d2-serving-cert\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.700173 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager-operator"/"kube-controller-manager-operator-config" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.706008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07fe6b0d-5538-4523-8477-f0e02a2925d2-config\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.751839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dgb4\" (UniqueName: \"kubernetes.io/projected/6f9a6875-27c1-409b-af5d-6a482243959d-kube-api-access-2dgb4\") pod \"machine-approver-56656f9798-95gxs\" (UID: \"6f9a6875-27c1-409b-af5d-6a482243959d\") " pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.752336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2jk8\" (UniqueName: \"kubernetes.io/projected/84f6eedd-0af4-4772-9b12-5df36fe8f469-kube-api-access-v2jk8\") pod \"authentication-operator-69f744f599-thwj6\" (UID: \"84f6eedd-0af4-4772-9b12-5df36fe8f469\") " pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.752655 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.768164 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.777405 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.778001 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.277907091 +0000 UTC m=+51.978568929 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.778364 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.778830 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.278808275 +0000 UTC m=+51.979470093 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.779071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"package-server-manager-serving-cert" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.779803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnr4\" (UniqueName: \"kubernetes.io/projected/cbbb83ea-d851-41e9-9e1a-e55ef7994ef4-kube-api-access-9cnr4\") pod \"cluster-samples-operator-665b6dd947-q86d5\" (UID: \"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.784906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b300dfd-e20c-48ce-8094-3cac376d7d05-package-server-manager-serving-cert\") pod \"package-server-manager-789f6589d5-58fdn\" (UID: \"8b300dfd-e20c-48ce-8094-3cac376d7d05\") " pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.801539 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-tls" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.809112 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/c62e3b58-f29e-4192-bfc8-b51fcb438f95-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-78cbb6b69f-c2gx5\" (UID: \"c62e3b58-f29e-4192-bfc8-b51fcb438f95\") " pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.818618 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-api"/"control-plane-machine-set-operator-dockercfg-k9rxt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.839722 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-stats-default" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849386 4769 secret.go:188] Couldn't get secret openshift-dns/dns-default-metrics-tls: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849479 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f414a5-14a5-4856-bcd9-71f9abd9569c-metrics-tls podName:93f414a5-14a5-4856-bcd9-71f9abd9569c nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.349451381 +0000 UTC m=+52.050113199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93f414a5-14a5-4856-bcd9-71f9abd9569c-metrics-tls") pod "dns-default-xxl8f" (UID: "93f414a5-14a5-4856-bcd9-71f9abd9569c") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849516 4769 secret.go:188] Couldn't get secret openshift-machine-config-operator/node-bootstrapper-token: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849582 4769 configmap.go:193] Couldn't get configMap openshift-multus/cni-sysctl-allowlist: failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849547 4769 configmap.go:193] Couldn't get configMap openshift-dns/dns-default: failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849690 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-node-bootstrap-token podName:f266b0c1-8875-49ea-a2ae-27bea5f767ed nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.349650087 +0000 UTC m=+52.050311945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-bootstrap-token" (UniqueName: "kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-node-bootstrap-token") pod "machine-config-server-n8dcr" (UID: "f266b0c1-8875-49ea-a2ae-27bea5f767ed") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849722 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f414a5-14a5-4856-bcd9-71f9abd9569c-config-volume podName:93f414a5-14a5-4856-bcd9-71f9abd9569c nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.349707698 +0000 UTC m=+52.050369526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/93f414a5-14a5-4856-bcd9-71f9abd9569c-config-volume") pod "dns-default-xxl8f" (UID: "93f414a5-14a5-4856-bcd9-71f9abd9569c") : failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.849742 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist podName:4c9630fd-9719-44c6-b527-a909d4a0ce2b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.349733929 +0000 UTC m=+52.050395767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cni-sysctl-allowlist" (UniqueName: "kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist") pod "cni-sysctl-allowlist-ds-h2c4x" (UID: "4c9630fd-9719-44c6-b527-a909d4a0ce2b") : failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.849794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-stats-auth\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855390 4769 secret.go:188] Couldn't get secret openshift-ingress/router-metrics-certs-default: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855434 4769 secret.go:188] Couldn't get secret openshift-ingress/router-certs-default: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855405 4769 configmap.go:193] Couldn't get configMap openshift-ingress/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855497 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-metrics-certs podName:00a56ef7-97e4-4bf8-97b9-8b8df884a29b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.355453083 +0000 UTC m=+52.056114901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-metrics-certs") pod "router-default-5444994796-g9x6j" (UID: "00a56ef7-97e4-4bf8-97b9-8b8df884a29b") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855521 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-service-ca-bundle podName:00a56ef7-97e4-4bf8-97b9-8b8df884a29b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.355505205 +0000 UTC m=+52.056167233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-service-ca-bundle") pod "router-default-5444994796-g9x6j" (UID: "00a56ef7-97e4-4bf8-97b9-8b8df884a29b") : failed to sync configmap cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855540 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-default-certificate podName:00a56ef7-97e4-4bf8-97b9-8b8df884a29b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.355532155 +0000 UTC m=+52.056194223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "default-certificate" (UniqueName: "kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-default-certificate") pod "router-default-5444994796-g9x6j" (UID: "00a56ef7-97e4-4bf8-97b9-8b8df884a29b") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855533 4769 secret.go:188] Couldn't get secret openshift-machine-config-operator/machine-config-server-tls: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855585 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-certs podName:f266b0c1-8875-49ea-a2ae-27bea5f767ed nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.355578477 +0000 UTC m=+52.056240295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certs" (UniqueName: "kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-certs") pod "machine-config-server-n8dcr" (UID: "f266b0c1-8875-49ea-a2ae-27bea5f767ed") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855682 4769 secret.go:188] Couldn't get secret openshift-ingress-canary/canary-serving-cert: failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.855733 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5da2aac0-e8eb-4269-a189-320b9a714edd-cert podName:5da2aac0-e8eb-4269-a189-320b9a714edd nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.35572082 +0000 UTC m=+52.056382648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5da2aac0-e8eb-4269-a189-320b9a714edd-cert") pod "ingress-canary-wp29s" (UID: "5da2aac0-e8eb-4269-a189-320b9a714edd") : failed to sync secret cache: timed out waiting for the condition Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.862762 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"service-ca-bundle" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.880594 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-dockercfg-zdk86" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.881874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.881918 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.381889106 +0000 UTC m=+52.082550954 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.882562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.883067 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.383051758 +0000 UTC m=+52.083713576 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.898596 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-metrics-certs-default" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.918839 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress"/"router-certs-default" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.919574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-879f6c89f-2shtf"] Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.942042 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"kube-root-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.943120 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.954949 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-7777fb866f-9r5br"] Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.956062 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7954f5f757-74pvb"] Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.958357 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress"/"openshift-service-ca.crt" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.963290 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.978652 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.983514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:32 crc kubenswrapper[4769]: E1121 11:51:32.983870 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.483836227 +0000 UTC m=+52.184498055 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:32 crc kubenswrapper[4769]: W1121 11:51:32.999150 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9a6875_27c1_409b_af5d_6a482243959d.slice/crio-c664aaff3bf737b9050b20036cdd1e8ddee975757b31d1708b6a73893a9cac54 WatchSource:0}: Error finding container c664aaff3bf737b9050b20036cdd1e8ddee975757b31d1708b6a73893a9cac54: Status 404 returned error can't find the container with id c664aaff3bf737b9050b20036cdd1e8ddee975757b31d1708b6a73893a9cac54 Nov 21 11:51:32 crc kubenswrapper[4769]: I1121 11:51:32.999485 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.018745 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"hostpath-provisioner"/"openshift-service-ca.crt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.041895 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-qx5rd" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.060952 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.061434 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.081175 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-dockercfg-jwfmh" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.088159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.088627 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.588614704 +0000 UTC m=+52.289276522 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.099269 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.120177 4769 reflector.go:368] Caches populated for *v1.Secret from object-"hostpath-provisioner"/"csi-hostpath-provisioner-sa-dockercfg-qd74k" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.139523 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"hostpath-provisioner"/"kube-root-ca.crt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.159087 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-sysctl-allowlist" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.159636 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-69f744f599-thwj6"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.179058 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.191726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.191876 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.69185372 +0000 UTC m=+52.392515528 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.192072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.192508 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.692496457 +0000 UTC m=+52.393158275 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.197531 4769 request.go:700] Waited for 1.922750477s due to client-side throttling, not priority and fairness, request: GET:https://api-int.crc.testing:6443/api/v1/namespaces/openshift-network-diagnostics/configmaps?fieldSelector=metadata.name%3Dkube-root-ca.crt&limit=500&resourceVersion=0 Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.200013 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.218799 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.239166 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.258918 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.278125 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-2llfx" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.288567 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.293456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.293620 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.793598165 +0000 UTC m=+52.494259983 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.294032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.294751 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.794722725 +0000 UTC m=+52.495384533 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.315648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgpvn\" (UniqueName: \"kubernetes.io/projected/2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e-kube-api-access-cgpvn\") pod \"apiserver-7bbb656c7d-9nmkb\" (UID: \"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e\") " pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.333547 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmzc\" (UniqueName: \"kubernetes.io/projected/280b6f07-4e22-4201-821b-28b2d3a49615-kube-api-access-dqmzc\") pod \"openshift-apiserver-operator-796bbdcf4f-w6vg4\" (UID: \"280b6f07-4e22-4201-821b-28b2d3a49615\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.354388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-bound-sa-token\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.376302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bb2q\" (UniqueName: \"kubernetes.io/projected/27b60de2-5292-4da6-a3e9-925ba06bb813-kube-api-access-5bb2q\") pod \"machine-api-operator-5694c8668f-5sbdz\" (UID: \"27b60de2-5292-4da6-a3e9-925ba06bb813\") " pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.394040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n95\" (UniqueName: \"kubernetes.io/projected/cfd3ffc1-29ac-441d-a334-0cfc790b49c4-kube-api-access-24n95\") pod \"console-operator-58897d9998-6wlsh\" (UID: \"cfd3ffc1-29ac-441d-a334-0cfc790b49c4\") " pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.395796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.395954 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.895921876 +0000 UTC m=+52.596583714 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.398679 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.398872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-default-certificate\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.398923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-metrics-certs\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-service-ca-bundle\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-certs\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da2aac0-e8eb-4269-a189-320b9a714edd-cert\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93f414a5-14a5-4856-bcd9-71f9abd9569c-config-volume\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-node-bootstrap-token\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.399350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93f414a5-14a5-4856-bcd9-71f9abd9569c-metrics-tls\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.399396 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:33.899381679 +0000 UTC m=+52.600043507 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.401339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-service-ca-bundle\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.401796 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.401816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93f414a5-14a5-4856-bcd9-71f9abd9569c-config-volume\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.402754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.403778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-metrics-certs\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.403811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93f414a5-14a5-4856-bcd9-71f9abd9569c-metrics-tls\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.403947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5da2aac0-e8eb-4269-a189-320b9a714edd-cert\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.403960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-certs\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.405177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/f266b0c1-8875-49ea-a2ae-27bea5f767ed-node-bootstrap-token\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.405366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-default-certificate\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.415744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac331b1e-3f0e-45cd-9a87-c969ae716d44-bound-sa-token\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.444913 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8xjc\" (UniqueName: \"kubernetes.io/projected/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-kube-api-access-v8xjc\") pod \"route-controller-manager-6576b87f9c-vmgf6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.455393 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8kc\" (UniqueName: \"kubernetes.io/projected/9b4852c7-e609-43fd-83b4-6c57ced3cab8-kube-api-access-zz8kc\") pod \"apiserver-76f77b778f-m7dv8\" (UID: \"9b4852c7-e609-43fd-83b4-6c57ced3cab8\") " pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.467656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.481655 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.492266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4m9w\" (UniqueName: \"kubernetes.io/projected/ac331b1e-3f0e-45cd-9a87-c969ae716d44-kube-api-access-h4m9w\") pod \"cluster-image-registry-operator-dc59b4c8b-bgp9q\" (UID: \"ac331b1e-3f0e-45cd-9a87-c969ae716d44\") " pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.500878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.501422 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.001406452 +0000 UTC m=+52.702068270 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.505692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjc68\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-kube-api-access-zjc68\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.514268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-244ft\" (UniqueName: \"kubernetes.io/projected/32b03c4b-e544-42ae-b008-12a99bb25c51-kube-api-access-244ft\") pod \"openshift-controller-manager-operator-756b6f6bc6-6p8sv\" (UID: \"32b03c4b-e544-42ae-b008-12a99bb25c51\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.519175 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.545290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v9qt\" (UniqueName: \"kubernetes.io/projected/a1473b4e-7238-4995-8b16-8722cba79ccd-kube-api-access-8v9qt\") pod \"console-f9d7485db-9vb2t\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.558345 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/5e41c9d1-4935-4bbb-86f6-3c24c5b5a915-kube-api-access\") pod \"openshift-kube-scheduler-operator-5fdd9b5758-8bjbp\" (UID: \"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.575986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxfkg\" (UniqueName: \"kubernetes.io/projected/218a7fed-53ee-4ea6-9095-c499af80df24-kube-api-access-wxfkg\") pod \"service-ca-operator-777779d784-tnn76\" (UID: \"218a7fed-53ee-4ea6-9095-c499af80df24\") " pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.596510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.599482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hdv\" (UniqueName: \"kubernetes.io/projected/c62e3b58-f29e-4192-bfc8-b51fcb438f95-kube-api-access-v5hdv\") pod \"control-plane-machine-set-operator-78cbb6b69f-c2gx5\" (UID: \"c62e3b58-f29e-4192-bfc8-b51fcb438f95\") " pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.602648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.602931 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.102918741 +0000 UTC m=+52.803580559 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.608077 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-58897d9998-6wlsh"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.610414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.621446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6zz\" (UniqueName: \"kubernetes.io/projected/fd38336f-cc4b-4953-83ee-91bd6566e43b-kube-api-access-rf6zz\") pod \"marketplace-operator-79b997595-t6l7h\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.635512 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6vsh\" (UniqueName: \"kubernetes.io/projected/d980fc96-9282-4f81-8bea-57d074eb8b05-kube-api-access-h6vsh\") pod \"csi-hostpathplugin-zd8jq\" (UID: \"d980fc96-9282-4f81-8bea-57d074eb8b05\") " pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.650804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" event={"ID":"6f9a6875-27c1-409b-af5d-6a482243959d","Type":"ContainerStarted","Data":"b872bb26796adabee06cde04a6ed3aa7711fa325ed69ccf2559cab785ce91796"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.650893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" event={"ID":"6f9a6875-27c1-409b-af5d-6a482243959d","Type":"ContainerStarted","Data":"c664aaff3bf737b9050b20036cdd1e8ddee975757b31d1708b6a73893a9cac54"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.652152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" event={"ID":"e64f0532-628a-4fa4-a78d-8afb135e2b23","Type":"ContainerStarted","Data":"43460ad93a27b19a1a64e91353469240e2839a353cbcfb81e26eb7174fd0e549"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.652179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" event={"ID":"e64f0532-628a-4fa4-a78d-8afb135e2b23","Type":"ContainerStarted","Data":"48b9e3d130f18da17f9c13471f79e543e76dc837f76731f2afe709e96d5e7588"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.652760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdql\" (UniqueName: \"kubernetes.io/projected/93f414a5-14a5-4856-bcd9-71f9abd9569c-kube-api-access-mmdql\") pod \"dns-default-xxl8f\" (UID: \"93f414a5-14a5-4856-bcd9-71f9abd9569c\") " pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.655680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" event={"ID":"fbd1960b-a86a-4f6b-88da-bd98023c6b25","Type":"ContainerStarted","Data":"c13ffd0d764305417e1b095293243dcad4fec3843fc9b617f176b36c25c5328b"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.655704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" event={"ID":"fbd1960b-a86a-4f6b-88da-bd98023c6b25","Type":"ContainerStarted","Data":"1a674eeb1db97d983b963fa8bd02976a48ef7599840949bae36157f3c12d96a5"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.656026 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.657028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" event={"ID":"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4","Type":"ContainerStarted","Data":"50787150deb88553cf392271ebd11a58c5cfcbf187ed1a0bc98ab4e82c71c3bc"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.657417 4769 patch_prober.go:28] interesting pod/controller-manager-879f6c89f-2shtf container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.12:8443/healthz\": dial tcp 10.217.0.12:8443: connect: connection refused" start-of-body= Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.657458 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerName="controller-manager" probeResult="failure" output="Get \"https://10.217.0.12:8443/healthz\": dial tcp 10.217.0.12:8443: connect: connection refused" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.660910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" event={"ID":"84f6eedd-0af4-4772-9b12-5df36fe8f469","Type":"ContainerStarted","Data":"e082d1007b0e4bac285b03214a086d1d6bfe57a0f77686da2a32beb13b28034b"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.660950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" event={"ID":"84f6eedd-0af4-4772-9b12-5df36fe8f469","Type":"ContainerStarted","Data":"b8a80226d5b70a3283aac676637949f1de931038a6283bca84b0339dd458bb6d"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.671020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7954f5f757-74pvb" event={"ID":"44effadb-9e4b-4a98-ba7c-880e36bd66d2","Type":"ContainerStarted","Data":"f96d25b41787899dcfb58eefeab632ccf0fa6fe18f8620edd12da53c528a709c"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.671096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7954f5f757-74pvb" event={"ID":"44effadb-9e4b-4a98-ba7c-880e36bd66d2","Type":"ContainerStarted","Data":"c1bd6223372e4f4fbb14ea1e402bd928b8e4359b9bcf72e415f29ec2ec9fa151"} Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.671232 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.673730 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.674593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82-kube-api-access\") pod \"kube-apiserver-operator-766d6c64bb-cvbfs\" (UID: \"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.676675 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.676906 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.680420 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.699889 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.700625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6qt\" (UniqueName: \"kubernetes.io/projected/05bac206-a644-40c0-98fd-f7de5869bec1-kube-api-access-zt6qt\") pod \"oauth-openshift-558db77b4-dppfh\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.704639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.704854 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.204832451 +0000 UTC m=+52.905494279 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.704972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.706458 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.206443114 +0000 UTC m=+52.907104932 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.728846 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.731148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mkb\" (UniqueName: \"kubernetes.io/projected/217395e4-4832-4c0d-a79f-1c2fa644b90e-kube-api-access-q9mkb\") pod \"kube-storage-version-migrator-operator-b67b599dd-sv68k\" (UID: \"217395e4-4832-4c0d-a79f-1c2fa644b90e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.742042 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.743902 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.756001 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.757614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rszbp\" (UniqueName: \"kubernetes.io/projected/6e9dcb3e-0040-4ed8-b695-17487f0eca03-kube-api-access-rszbp\") pod \"dns-operator-744455d44c-9mb4n\" (UID: \"6e9dcb3e-0040-4ed8-b695-17487f0eca03\") " pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.763603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcs6d\" (UniqueName: \"kubernetes.io/projected/12723c70-e8e8-435b-954c-ab5d30700449-kube-api-access-qcs6d\") pod \"catalog-operator-68c6474976-jrvmp\" (UID: \"12723c70-e8e8-435b-954c-ab5d30700449\") " pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.770608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnglq\" (UniqueName: \"kubernetes.io/projected/41825801-cb10-436f-ad81-3e65407237f7-kube-api-access-xnglq\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.770883 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.772311 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-76f77b778f-m7dv8"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.792858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9jk8\" (UniqueName: \"kubernetes.io/projected/b2c82641-a99e-414a-8d6e-df8f79896a5f-kube-api-access-f9jk8\") pod \"packageserver-d55dfcdfc-vhgqt\" (UID: \"b2c82641-a99e-414a-8d6e-df8f79896a5f\") " pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.793410 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.806597 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.806720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.806853 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.306832343 +0000 UTC m=+53.007494161 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.806957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.807335 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.307323166 +0000 UTC m=+53.007984984 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.820335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/4c9630fd-9719-44c6-b527-a909d4a0ce2b-kube-api-access-fz8xx\") pod \"cni-sysctl-allowlist-ds-h2c4x\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:33 crc kubenswrapper[4769]: W1121 11:51:33.826709 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4852c7_e609_43fd_83b4_6c57ced3cab8.slice/crio-39a6617e1a86966098ca793d52f0979a21b86b31cb798e73d6adc47ec72facb6 WatchSource:0}: Error finding container 39a6617e1a86966098ca793d52f0979a21b86b31cb798e73d6adc47ec72facb6: Status 404 returned error can't find the container with id 39a6617e1a86966098ca793d52f0979a21b86b31cb798e73d6adc47ec72facb6 Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.828056 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.835909 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpvzk\" (UniqueName: \"kubernetes.io/projected/bc33f66b-69b2-43b1-9fb0-9daf24892fa2-kube-api-access-hpvzk\") pod \"etcd-operator-b45778765-vs5vn\" (UID: \"bc33f66b-69b2-43b1-9fb0-9daf24892fa2\") " pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.845846 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.855771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl7hd\" (UniqueName: \"kubernetes.io/projected/60317e6f-441a-43f1-b8eb-749db23aaee6-kube-api-access-fl7hd\") pod \"migrator-59844c95c7-djw5n\" (UID: \"60317e6f-441a-43f1-b8eb-749db23aaee6\") " pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.859949 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.878130 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.886734 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.894292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvw5l\" (UniqueName: \"kubernetes.io/projected/8b300dfd-e20c-48ce-8094-3cac376d7d05-kube-api-access-wvw5l\") pod \"package-server-manager-789f6589d5-58fdn\" (UID: \"8b300dfd-e20c-48ce-8094-3cac376d7d05\") " pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.898115 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-5694c8668f-5sbdz"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.899548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpbcw\" (UniqueName: \"kubernetes.io/projected/5da2aac0-e8eb-4269-a189-320b9a714edd-kube-api-access-gpbcw\") pod \"ingress-canary-wp29s\" (UID: \"5da2aac0-e8eb-4269-a189-320b9a714edd\") " pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.908248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.915943 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.920385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwvb\" (UniqueName: \"kubernetes.io/projected/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-kube-api-access-rkwvb\") pod \"collect-profiles-29395425-kqgtz\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.923697 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:33 crc kubenswrapper[4769]: E1121 11:51:33.924537 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.424496468 +0000 UTC m=+53.125158296 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.938639 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsx45\" (UniqueName: \"kubernetes.io/projected/00a56ef7-97e4-4bf8-97b9-8b8df884a29b-kube-api-access-bsx45\") pod \"router-default-5444994796-g9x6j\" (UID: \"00a56ef7-97e4-4bf8-97b9-8b8df884a29b\") " pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.943479 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wp29s" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.943584 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.959770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m29n5\" (UniqueName: \"kubernetes.io/projected/f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77-kube-api-access-m29n5\") pod \"olm-operator-6b444d44fb-2k8wt\" (UID: \"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77\") " pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.974432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q"] Nov 21 11:51:33 crc kubenswrapper[4769]: I1121 11:51:33.982267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqz4q\" (UniqueName: \"kubernetes.io/projected/2c02946d-09e7-4074-90f9-9440a6c0136b-kube-api-access-dqz4q\") pod \"machine-config-operator-74547568cd-w4tzm\" (UID: \"2c02946d-09e7-4074-90f9-9440a6c0136b\") " pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:33 crc kubenswrapper[4769]: W1121 11:51:33.990614 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b60de2_5292_4da6_a3e9_925ba06bb813.slice/crio-bb5a973ac5cdf273aae780fedbab484ec520228bc8009994e8c30f6ce64119fd WatchSource:0}: Error finding container bb5a973ac5cdf273aae780fedbab484ec520228bc8009994e8c30f6ce64119fd: Status 404 returned error can't find the container with id bb5a973ac5cdf273aae780fedbab484ec520228bc8009994e8c30f6ce64119fd Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.002708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxq7h\" (UniqueName: \"kubernetes.io/projected/f9370e66-09f6-4083-9b6a-d926c1d9e03f-kube-api-access-fxq7h\") pod \"multus-admission-controller-857f4d67dd-qks2k\" (UID: \"f9370e66-09f6-4083-9b6a-d926c1d9e03f\") " pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.011627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.012858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41825801-cb10-436f-ad81-3e65407237f7-bound-sa-token\") pod \"ingress-operator-5b745b69d9-k8qv6\" (UID: \"41825801-cb10-436f-ad81-3e65407237f7\") " pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.017077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.017546 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.517512998 +0000 UTC m=+53.218174816 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.035070 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.046023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/07fe6b0d-5538-4523-8477-f0e02a2925d2-kube-api-access\") pod \"kube-controller-manager-operator-78b949d7b-pm6xv\" (UID: \"07fe6b0d-5538-4523-8477-f0e02a2925d2\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.052751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xctg\" (UniqueName: \"kubernetes.io/projected/f266b0c1-8875-49ea-a2ae-27bea5f767ed-kube-api-access-4xctg\") pod \"machine-config-server-n8dcr\" (UID: \"f266b0c1-8875-49ea-a2ae-27bea5f767ed\") " pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.063167 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.075101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxrmt\" (UniqueName: \"kubernetes.io/projected/1cf2d137-129b-470b-aed3-8c92b0fd8441-kube-api-access-kxrmt\") pod \"service-ca-9c57cc56f-r2rmv\" (UID: \"1cf2d137-129b-470b-aed3-8c92b0fd8441\") " pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.081001 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.087383 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.096771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjth8\" (UniqueName: \"kubernetes.io/projected/89d45255-b595-4f0a-8f76-75883503c09d-kube-api-access-fjth8\") pod \"machine-config-controller-84d6567774-rcwsb\" (UID: \"89d45255-b595-4f0a-8f76-75883503c09d\") " pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.108110 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.115353 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.118200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.118357 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.618327098 +0000 UTC m=+53.318988916 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.118450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.118685 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.119276 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.619261943 +0000 UTC m=+53.319923761 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.122531 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.134973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.138539 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-sa-dockercfg-d427c" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.142306 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.150517 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.159698 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-console"/"networking-console-plugin-cert" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.160956 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.166556 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.173218 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-n8dcr" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.190206 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-console"/"networking-console-plugin" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.221670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.221837 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.72181295 +0000 UTC m=+53.422474768 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.221998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.222381 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.722366075 +0000 UTC m=+53.423027903 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.235552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.258848 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9d7485db-9vb2t"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.282616 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.295967 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-t6l7h"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.319587 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.323378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.323710 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.823693289 +0000 UTC m=+53.524355107 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.329245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp"] Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.336697 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ee2779_b9c7_4d5f_b42d_c4ca3836bf82.slice/crio-aedbf43f4803e12a17daf3b06c8136d07e0f37830adbbfb24fe5910231e61bc3 WatchSource:0}: Error finding container aedbf43f4803e12a17daf3b06c8136d07e0f37830adbbfb24fe5910231e61bc3: Status 404 returned error can't find the container with id aedbf43f4803e12a17daf3b06c8136d07e0f37830adbbfb24fe5910231e61bc3 Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.340125 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9630fd_9719_44c6_b527_a909d4a0ce2b.slice/crio-36049945933e30eceb081c7c73c31037ef6d9a417c23f572a7675be62087a9fb WatchSource:0}: Error finding container 36049945933e30eceb081c7c73c31037ef6d9a417c23f572a7675be62087a9fb: Status 404 returned error can't find the container with id 36049945933e30eceb081c7c73c31037ef6d9a417c23f572a7675be62087a9fb Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.343576 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c82641_a99e_414a_8d6e_df8f79896a5f.slice/crio-856c78d3e184d91939ec5635c4f2c72c20d1aa8115d36366f07d00eec6f974f7 WatchSource:0}: Error finding container 856c78d3e184d91939ec5635c4f2c72c20d1aa8115d36366f07d00eec6f974f7: Status 404 returned error can't find the container with id 856c78d3e184d91939ec5635c4f2c72c20d1aa8115d36366f07d00eec6f974f7 Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.346354 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1473b4e_7238_4995_8b16_8722cba79ccd.slice/crio-316c13685c8cb017831db6086b6c2a7136b623f898e9cfae982f3f55d6bfface WatchSource:0}: Error finding container 316c13685c8cb017831db6086b6c2a7136b623f898e9cfae982f3f55d6bfface: Status 404 returned error can't find the container with id 316c13685c8cb017831db6086b6c2a7136b623f898e9cfae982f3f55d6bfface Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.389070 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.390094 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-558db77b4-dppfh"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.424792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.425227 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:34.925213268 +0000 UTC m=+53.625875086 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.526137 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.526535 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.026517541 +0000 UTC m=+53.727179359 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.627470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.627997 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.127978159 +0000 UTC m=+53.828639977 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.631569 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bac206_a644_40c0_98fd_f7de5869bec1.slice/crio-5f0b0ae7dae2e8d87d24b31d89bda32c545496cff5aea885a4084fde07ec19be WatchSource:0}: Error finding container 5f0b0ae7dae2e8d87d24b31d89bda32c545496cff5aea885a4084fde07ec19be: Status 404 returned error can't find the container with id 5f0b0ae7dae2e8d87d24b31d89bda32c545496cff5aea885a4084fde07ec19be Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.695475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" event={"ID":"05bac206-a644-40c0-98fd-f7de5869bec1","Type":"ContainerStarted","Data":"5f0b0ae7dae2e8d87d24b31d89bda32c545496cff5aea885a4084fde07ec19be"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.696298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" event={"ID":"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e","Type":"ContainerStarted","Data":"d635931daade62065ab2841f8cecc078f00b0b4e10fddf79a49d49cbe468d362"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.697064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" event={"ID":"9b4852c7-e609-43fd-83b4-6c57ced3cab8","Type":"ContainerStarted","Data":"39a6617e1a86966098ca793d52f0979a21b86b31cb798e73d6adc47ec72facb6"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.698765 4769 generic.go:334] "Generic (PLEG): container finished" podID="e64f0532-628a-4fa4-a78d-8afb135e2b23" containerID="43460ad93a27b19a1a64e91353469240e2839a353cbcfb81e26eb7174fd0e549" exitCode=0 Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.698907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" event={"ID":"e64f0532-628a-4fa4-a78d-8afb135e2b23","Type":"ContainerDied","Data":"43460ad93a27b19a1a64e91353469240e2839a353cbcfb81e26eb7174fd0e549"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.700751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" event={"ID":"12723c70-e8e8-435b-954c-ab5d30700449","Type":"ContainerStarted","Data":"2d768b8b95f2a4c689d31e7b5aeec168fcfd84c518cd2eef64b021c41894acf9"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.705114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" event={"ID":"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4","Type":"ContainerStarted","Data":"4cb6b53a2105beb209f3a8d5af8cb9199e337eee06c2b979b85faacf26eaee61"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.705969 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxl8f"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.710205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" event={"ID":"b2c82641-a99e-414a-8d6e-df8f79896a5f","Type":"ContainerStarted","Data":"856c78d3e184d91939ec5635c4f2c72c20d1aa8115d36366f07d00eec6f974f7"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.715083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" event={"ID":"32b03c4b-e544-42ae-b008-12a99bb25c51","Type":"ContainerStarted","Data":"97c6ec338f31976d499e5c4b84fd43e14ab66d197ede1dfef6160784882d5aa8"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.716030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" event={"ID":"4c9630fd-9719-44c6-b527-a909d4a0ce2b","Type":"ContainerStarted","Data":"36049945933e30eceb081c7c73c31037ef6d9a417c23f572a7675be62087a9fb"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.717213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" event={"ID":"cfd3ffc1-29ac-441d-a334-0cfc790b49c4","Type":"ContainerStarted","Data":"ce48dc9e73c3516fa366d64175259facb0393564bd8ad8a267a2e7f57dae0930"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.717240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" event={"ID":"cfd3ffc1-29ac-441d-a334-0cfc790b49c4","Type":"ContainerStarted","Data":"aa73487d4b545438c94e578d0c5dfa45027f0922dd2f5c606b83f161f07bf689"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.717882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" event={"ID":"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82","Type":"ContainerStarted","Data":"aedbf43f4803e12a17daf3b06c8136d07e0f37830adbbfb24fe5910231e61bc3"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.720052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" event={"ID":"fd38336f-cc4b-4953-83ee-91bd6566e43b","Type":"ContainerStarted","Data":"75b7b163db64b66c506fff383b4eb53f039c2f52f5214391617e286769a434da"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.721854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" event={"ID":"6f9a6875-27c1-409b-af5d-6a482243959d","Type":"ContainerStarted","Data":"6df78a170cc6d89a794e6d0cf7f49e0e9d558c3029845d98e47fa71543b945f7"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.723057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" event={"ID":"280b6f07-4e22-4201-821b-28b2d3a49615","Type":"ContainerStarted","Data":"49b6481694a8070fa97e51b31100cd94565a6de6c27a51c09ee4d90a2aa18be4"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.723081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" event={"ID":"280b6f07-4e22-4201-821b-28b2d3a49615","Type":"ContainerStarted","Data":"186826998c56c38552dc394eb73e0e54b5337a23e3fb430c657a7256bd256a3a"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.723922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" event={"ID":"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915","Type":"ContainerStarted","Data":"473baf19a70601d5e71f26233caf819bf40aeb36ec04799b193ba17691cf21eb"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.724879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d7485db-9vb2t" event={"ID":"a1473b4e-7238-4995-8b16-8722cba79ccd","Type":"ContainerStarted","Data":"316c13685c8cb017831db6086b6c2a7136b623f898e9cfae982f3f55d6bfface"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.725643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" event={"ID":"27b60de2-5292-4da6-a3e9-925ba06bb813","Type":"ContainerStarted","Data":"bb5a973ac5cdf273aae780fedbab484ec520228bc8009994e8c30f6ce64119fd"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.726398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" event={"ID":"b038a4c1-8138-4fe7-8363-cb3319e5e9f6","Type":"ContainerStarted","Data":"c1d62150d573b4afc03a4347da720287bd6784fb407e6d1559b641c641e280f5"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.727368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" event={"ID":"ac331b1e-3f0e-45cd-9a87-c969ae716d44","Type":"ContainerStarted","Data":"93a7b267a83c1139c97508f622b5948de94d923711e90ebfacaabf5fc8978c34"} Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.727847 4769 patch_prober.go:28] interesting pod/controller-manager-879f6c89f-2shtf container/controller-manager namespace/openshift-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.12:8443/healthz\": dial tcp 10.217.0.12:8443: connect: connection refused" start-of-body= Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.727871 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.727877 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerName="controller-manager" probeResult="failure" output="Get \"https://10.217.0.12:8443/healthz\": dial tcp 10.217.0.12:8443: connect: connection refused" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.727903 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.728088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.728370 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.228347707 +0000 UTC m=+53.929009525 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.728537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.728811 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.228804649 +0000 UTC m=+53.929466467 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.760810 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-b45778765-vs5vn"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.767748 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-777779d784-tnn76"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.773413 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.830026 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.830606 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.330580755 +0000 UTC m=+54.031242573 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.841733 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.887682 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-zd8jq"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.931820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:34 crc kubenswrapper[4769]: E1121 11:51:34.932153 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.432141416 +0000 UTC m=+54.132803234 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.933223 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-744455d44c-9mb4n"] Nov 21 11:51:34 crc kubenswrapper[4769]: I1121 11:51:34.955117 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6"] Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.961503 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f414a5_14a5_4856_bcd9_71f9abd9569c.slice/crio-a3859c1390778841d58e2ca884fbe85fc7c0b1ca37180e829c74ca3b956193c7 WatchSource:0}: Error finding container a3859c1390778841d58e2ca884fbe85fc7c0b1ca37180e829c74ca3b956193c7: Status 404 returned error can't find the container with id a3859c1390778841d58e2ca884fbe85fc7c0b1ca37180e829c74ca3b956193c7 Nov 21 11:51:34 crc kubenswrapper[4769]: W1121 11:51:34.987016 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217395e4_4832_4c0d_a79f_1c2fa644b90e.slice/crio-71ddaf06781042d80c46597114d942c63442ea00252f6583a93060c459bbeb0f WatchSource:0}: Error finding container 71ddaf06781042d80c46597114d942c63442ea00252f6583a93060c459bbeb0f: Status 404 returned error can't find the container with id 71ddaf06781042d80c46597114d942c63442ea00252f6583a93060c459bbeb0f Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.012473 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62e3b58_f29e_4192_bfc8_b51fcb438f95.slice/crio-d164ac376e1a5caaa3b0f080556419310515bc84857d366d14852b4b01f68f95 WatchSource:0}: Error finding container d164ac376e1a5caaa3b0f080556419310515bc84857d366d14852b4b01f68f95: Status 404 returned error can't find the container with id d164ac376e1a5caaa3b0f080556419310515bc84857d366d14852b4b01f68f95 Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.032614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.032859 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.532825502 +0000 UTC m=+54.233487320 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.033198 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.033547 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.533537012 +0000 UTC m=+54.234198830 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.040771 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9dcb3e_0040_4ed8_b695_17487f0eca03.slice/crio-492310a551a396d30d80e60a401fa9b6bf33fbec76133a2fdf445ac500d120d6 WatchSource:0}: Error finding container 492310a551a396d30d80e60a401fa9b6bf33fbec76133a2fdf445ac500d120d6: Status 404 returned error can't find the container with id 492310a551a396d30d80e60a401fa9b6bf33fbec76133a2fdf445ac500d120d6 Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.043080 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wp29s"] Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.052358 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41825801_cb10_436f_ad81_3e65407237f7.slice/crio-25db5057f5c3e2027121a53e72d69a28fbade778eea880246cb5a71efc109132 WatchSource:0}: Error finding container 25db5057f5c3e2027121a53e72d69a28fbade778eea880246cb5a71efc109132: Status 404 returned error can't find the container with id 25db5057f5c3e2027121a53e72d69a28fbade778eea880246cb5a71efc109132 Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.124506 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf266b0c1_8875_49ea_a2ae_27bea5f767ed.slice/crio-a81303dd6bd18f2d7bb8bba8f89ba004bc7bf4d1a7b2f7fee77edf9545c2592d WatchSource:0}: Error finding container a81303dd6bd18f2d7bb8bba8f89ba004bc7bf4d1a7b2f7fee77edf9545c2592d: Status 404 returned error can't find the container with id a81303dd6bd18f2d7bb8bba8f89ba004bc7bf4d1a7b2f7fee77edf9545c2592d Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.134558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.134926 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.634910387 +0000 UTC m=+54.335572195 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.163062 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd980fc96_9282_4f81_8bea_57d074eb8b05.slice/crio-74d19f976d09b9f968bc27bf5f3f4c82b79bb0d37f580258ec2d64e41cf82e86 WatchSource:0}: Error finding container 74d19f976d09b9f968bc27bf5f3f4c82b79bb0d37f580258ec2d64e41cf82e86: Status 404 returned error can't find the container with id 74d19f976d09b9f968bc27bf5f3f4c82b79bb0d37f580258ec2d64e41cf82e86 Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.235797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.236180 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.736167779 +0000 UTC m=+54.436829587 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.288220 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.304530 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.314966 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication-operator/authentication-operator-69f744f599-thwj6" podStartSLOduration=25.314936354 podStartE2EDuration="25.314936354s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:35.314624986 +0000 UTC m=+54.015286804" watchObservedRunningTime="2025-11-21 11:51:35.314936354 +0000 UTC m=+54.015598172" Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.333928 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-crc"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.336583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.336723 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.836695851 +0000 UTC m=+54.537357659 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.337218 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.337591 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.837583945 +0000 UTC m=+54.538245753 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.371986 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-7954f5f757-74pvb" podStartSLOduration=25.371957793 podStartE2EDuration="25.371957793s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:35.370791701 +0000 UTC m=+54.071453519" watchObservedRunningTime="2025-11-21 11:51:35.371957793 +0000 UTC m=+54.072619611" Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.443302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.443764 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:35.94374324 +0000 UTC m=+54.644405058 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.467386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.470511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.545357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.545653 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.045642069 +0000 UTC m=+54.746303887 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.609119 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" podStartSLOduration=25.609100361 podStartE2EDuration="25.609100361s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:35.569804711 +0000 UTC m=+54.270466529" watchObservedRunningTime="2025-11-21 11:51:35.609100361 +0000 UTC m=+54.309762179" Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.616659 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fe6b0d_5538_4523_8477_f0e02a2925d2.slice/crio-74be036b87c249eeed8712aaff4aa8bb0d0cbffe08788818a02b700571c16261 WatchSource:0}: Error finding container 74be036b87c249eeed8712aaff4aa8bb0d0cbffe08788818a02b700571c16261: Status 404 returned error can't find the container with id 74be036b87c249eeed8712aaff4aa8bb0d0cbffe08788818a02b700571c16261 Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.623388 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c689c8_f5f7_4d08_ba2b_61c3d9b14e77.slice/crio-a4e5147869deee73f681a8d4fac651e7edeb6c081bc967943e33492f9d4d1067 WatchSource:0}: Error finding container a4e5147869deee73f681a8d4fac651e7edeb6c081bc967943e33492f9d4d1067: Status 404 returned error can't find the container with id a4e5147869deee73f681a8d4fac651e7edeb6c081bc967943e33492f9d4d1067 Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.646527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.646890 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.146754747 +0000 UTC m=+54.847416565 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.647316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.647945 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.147933749 +0000 UTC m=+54.848595617 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.736900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wp29s" event={"ID":"5da2aac0-e8eb-4269-a189-320b9a714edd","Type":"ContainerStarted","Data":"b9556e15eb353f97790d48dfa21d3052b19e61fd2214aa71f5384133ddecb596"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.740477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" event={"ID":"bc33f66b-69b2-43b1-9fb0-9daf24892fa2","Type":"ContainerStarted","Data":"4ff02be2e4503b2d4608147e517d95e9ce098fc946377d19dedbe11673d70ae5"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.741899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5444994796-g9x6j" event={"ID":"00a56ef7-97e4-4bf8-97b9-8b8df884a29b","Type":"ContainerStarted","Data":"6363564e134eb710126438825277181d9b7edd71cbc3c9d22974e1e271fc264c"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.743299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" event={"ID":"07fe6b0d-5538-4523-8477-f0e02a2925d2","Type":"ContainerStarted","Data":"74be036b87c249eeed8712aaff4aa8bb0d0cbffe08788818a02b700571c16261"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.744393 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" event={"ID":"d980fc96-9282-4f81-8bea-57d074eb8b05","Type":"ContainerStarted","Data":"74d19f976d09b9f968bc27bf5f3f4c82b79bb0d37f580258ec2d64e41cf82e86"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.745659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" event={"ID":"41825801-cb10-436f-ad81-3e65407237f7","Type":"ContainerStarted","Data":"25db5057f5c3e2027121a53e72d69a28fbade778eea880246cb5a71efc109132"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.747160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-n8dcr" event={"ID":"f266b0c1-8875-49ea-a2ae-27bea5f767ed","Type":"ContainerStarted","Data":"a81303dd6bd18f2d7bb8bba8f89ba004bc7bf4d1a7b2f7fee77edf9545c2592d"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.748853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.749060 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.249034087 +0000 UTC m=+54.949695915 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.749750 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.750437 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.250425184 +0000 UTC m=+54.951087012 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.757986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" event={"ID":"60317e6f-441a-43f1-b8eb-749db23aaee6","Type":"ContainerStarted","Data":"9c15cae9416d81e11415f7dc3129965e0ffa92a9c853bf7b834397087d48bc67"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.762249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" event={"ID":"218a7fed-53ee-4ea6-9095-c499af80df24","Type":"ContainerStarted","Data":"b3914011b257cb9f0fbec8ffee6305e2667e8ffecfa96bc11fc6807aec65c7f1"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.762663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" event={"ID":"6e9dcb3e-0040-4ed8-b695-17487f0eca03","Type":"ContainerStarted","Data":"492310a551a396d30d80e60a401fa9b6bf33fbec76133a2fdf445ac500d120d6"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.775569 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" event={"ID":"c62e3b58-f29e-4192-bfc8-b51fcb438f95","Type":"ContainerStarted","Data":"d164ac376e1a5caaa3b0f080556419310515bc84857d366d14852b4b01f68f95"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.779559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxl8f" event={"ID":"93f414a5-14a5-4856-bcd9-71f9abd9569c","Type":"ContainerStarted","Data":"a3859c1390778841d58e2ca884fbe85fc7c0b1ca37180e829c74ca3b956193c7"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.782646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" event={"ID":"217395e4-4832-4c0d-a79f-1c2fa644b90e","Type":"ContainerStarted","Data":"71ddaf06781042d80c46597114d942c63442ea00252f6583a93060c459bbeb0f"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.789304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.790202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" event={"ID":"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77","Type":"ContainerStarted","Data":"a4e5147869deee73f681a8d4fac651e7edeb6c081bc967943e33492f9d4d1067"} Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.791418 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.797382 4769 patch_prober.go:28] interesting pod/console-operator-58897d9998-6wlsh container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.217.0.29:8443/readyz\": dial tcp 10.217.0.29:8443: connect: connection refused" start-of-body= Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.797517 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" podUID="cfd3ffc1-29ac-441d-a334-0cfc790b49c4" containerName="console-operator" probeResult="failure" output="Get \"https://10.217.0.29:8443/readyz\": dial tcp 10.217.0.29:8443: connect: connection refused" Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.812359 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.825294 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.828554 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.830387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-9c57cc56f-r2rmv"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.832079 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-857f4d67dd-qks2k"] Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.851462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.851631 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.351588523 +0000 UTC m=+55.052250341 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.851952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.853106 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.353081083 +0000 UTC m=+55.053742901 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.911687 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea6c139_4d7c_49b5_bff1_3cc20a6e1b9a.slice/crio-17a31553ff2c5f596f277d3eaf59465ad743fbb2bf035cfa60cf1fe9df2edb89 WatchSource:0}: Error finding container 17a31553ff2c5f596f277d3eaf59465ad743fbb2bf035cfa60cf1fe9df2edb89: Status 404 returned error can't find the container with id 17a31553ff2c5f596f277d3eaf59465ad743fbb2bf035cfa60cf1fe9df2edb89 Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.917142 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c02946d_09e7_4074_90f9_9440a6c0136b.slice/crio-f6297a581115a0ccbd63fcd8edb2a91f70f57f6564a96be21dac2ab2e2ef5f45 WatchSource:0}: Error finding container f6297a581115a0ccbd63fcd8edb2a91f70f57f6564a96be21dac2ab2e2ef5f45: Status 404 returned error can't find the container with id f6297a581115a0ccbd63fcd8edb2a91f70f57f6564a96be21dac2ab2e2ef5f45 Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.937581 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9370e66_09f6_4083_9b6a_d926c1d9e03f.slice/crio-c2863d05e9b480edf70f8eee616bcfb9b854d7fcf570a696fc3d629f95c46c63 WatchSource:0}: Error finding container c2863d05e9b480edf70f8eee616bcfb9b854d7fcf570a696fc3d629f95c46c63: Status 404 returned error can't find the container with id c2863d05e9b480edf70f8eee616bcfb9b854d7fcf570a696fc3d629f95c46c63 Nov 21 11:51:35 crc kubenswrapper[4769]: W1121 11:51:35.938927 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf2d137_129b_470b_aed3_8c92b0fd8441.slice/crio-d0591847df960febeab483334725dd47852b33bc74326d0494b3709e26eea44b WatchSource:0}: Error finding container d0591847df960febeab483334725dd47852b33bc74326d0494b3709e26eea44b: Status 404 returned error can't find the container with id d0591847df960febeab483334725dd47852b33bc74326d0494b3709e26eea44b Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.953444 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.953655 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.453633306 +0000 UTC m=+55.154295134 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:35 crc kubenswrapper[4769]: I1121 11:51:35.953971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:35 crc kubenswrapper[4769]: E1121 11:51:35.954377 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.454367846 +0000 UTC m=+55.155029664 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.057504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.058450 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.558422833 +0000 UTC m=+55.259084661 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.058751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.059123 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.559111162 +0000 UTC m=+55.259773000 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.129318 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-56656f9798-95gxs" podStartSLOduration=26.129299536 podStartE2EDuration="26.129299536s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:36.128292279 +0000 UTC m=+54.828954097" watchObservedRunningTime="2025-11-21 11:51:36.129299536 +0000 UTC m=+54.829961354" Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.159507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.159937 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.659921892 +0000 UTC m=+55.360583710 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.260883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.261200 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.761173034 +0000 UTC m=+55.461834852 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.363246 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.363405 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.863382062 +0000 UTC m=+55.564043880 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.363718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.364152 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.864143472 +0000 UTC m=+55.564805280 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.372267 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" podStartSLOduration=26.372245551 podStartE2EDuration="26.372245551s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:36.369923928 +0000 UTC m=+55.070585756" watchObservedRunningTime="2025-11-21 11:51:36.372245551 +0000 UTC m=+55.072907369" Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.467987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.468695 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:36.968678313 +0000 UTC m=+55.669340131 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.497556 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver-operator/openshift-apiserver-operator-796bbdcf4f-w6vg4" podStartSLOduration=26.497528821 podStartE2EDuration="26.497528821s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:36.496635507 +0000 UTC m=+55.197297325" watchObservedRunningTime="2025-11-21 11:51:36.497528821 +0000 UTC m=+55.198190639" Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.573528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.574148 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.074135518 +0000 UTC m=+55.774797336 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.610991 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" podStartSLOduration=1.610975452 podStartE2EDuration="1.610975452s" podCreationTimestamp="2025-11-21 11:51:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:36.609026879 +0000 UTC m=+55.309688687" watchObservedRunningTime="2025-11-21 11:51:36.610975452 +0000 UTC m=+55.311637260" Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.675510 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.675938 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.175888674 +0000 UTC m=+55.876550492 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.676428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.677076 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.177057145 +0000 UTC m=+55.877718963 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.777912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.778350 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.278294987 +0000 UTC m=+55.978956835 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.798587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" event={"ID":"27b60de2-5292-4da6-a3e9-925ba06bb813","Type":"ContainerStarted","Data":"c7565146b80aef7dc002298030b2399c85200cfd450d9e02afb9872f1e028f62"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.800337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" event={"ID":"b038a4c1-8138-4fe7-8363-cb3319e5e9f6","Type":"ContainerStarted","Data":"ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.801588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" event={"ID":"89d45255-b595-4f0a-8f76-75883503c09d","Type":"ContainerStarted","Data":"a30ec7f385bca339c4921f41a81bccb477aa8f1553c734fe4c463bdf301aae96"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.803302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d7485db-9vb2t" event={"ID":"a1473b4e-7238-4995-8b16-8722cba79ccd","Type":"ContainerStarted","Data":"eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.804797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" event={"ID":"1cf2d137-129b-470b-aed3-8c92b0fd8441","Type":"ContainerStarted","Data":"d0591847df960febeab483334725dd47852b33bc74326d0494b3709e26eea44b"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.806262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" event={"ID":"12723c70-e8e8-435b-954c-ab5d30700449","Type":"ContainerStarted","Data":"de8a8769d239b86749c13465267da50df078d9f7e96be40fdf4c39e1fbed5060"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.807993 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" event={"ID":"f9370e66-09f6-4083-9b6a-d926c1d9e03f","Type":"ContainerStarted","Data":"c2863d05e9b480edf70f8eee616bcfb9b854d7fcf570a696fc3d629f95c46c63"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.808968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" event={"ID":"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a","Type":"ContainerStarted","Data":"17a31553ff2c5f596f277d3eaf59465ad743fbb2bf035cfa60cf1fe9df2edb89"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.810118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" event={"ID":"fd38336f-cc4b-4953-83ee-91bd6566e43b","Type":"ContainerStarted","Data":"88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.811457 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" event={"ID":"b2c82641-a99e-414a-8d6e-df8f79896a5f","Type":"ContainerStarted","Data":"cfe62131540fe9628c0c600932115eb8309d1f532d314c5bcfadf8caa9d21dfa"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.813678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-n8dcr" event={"ID":"f266b0c1-8875-49ea-a2ae-27bea5f767ed","Type":"ContainerStarted","Data":"b4b9c76e2184ca7bc9c97dcbe20bc045c999775daf76eee2d2e89ed81a2e2272"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.815382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" event={"ID":"2c02946d-09e7-4074-90f9-9440a6c0136b","Type":"ContainerStarted","Data":"f6297a581115a0ccbd63fcd8edb2a91f70f57f6564a96be21dac2ab2e2ef5f45"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.816773 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b4852c7-e609-43fd-83b4-6c57ced3cab8" containerID="a7bedf2a7ebb357dc5481c67dbec642e05ebeb3fa8fd94d0eabcbb23066e5fc6" exitCode=0 Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.816821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" event={"ID":"9b4852c7-e609-43fd-83b4-6c57ced3cab8","Type":"ContainerDied","Data":"a7bedf2a7ebb357dc5481c67dbec642e05ebeb3fa8fd94d0eabcbb23066e5fc6"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.818176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" event={"ID":"8b300dfd-e20c-48ce-8094-3cac376d7d05","Type":"ContainerStarted","Data":"153cfb9006da886f547bf61ef8a8198d4895afee664912fb5ef5230519c47074"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.820436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" event={"ID":"5e41c9d1-4935-4bbb-86f6-3c24c5b5a915","Type":"ContainerStarted","Data":"8fdfcebe90d1151187b61523dc4a2eb6d4533e2f132354c62f5ccd93961e09bf"} Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.820586 4769 patch_prober.go:28] interesting pod/console-operator-58897d9998-6wlsh container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.217.0.29:8443/readyz\": dial tcp 10.217.0.29:8443: connect: connection refused" start-of-body= Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.820633 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" podUID="cfd3ffc1-29ac-441d-a334-0cfc790b49c4" containerName="console-operator" probeResult="failure" output="Get \"https://10.217.0.29:8443/readyz\": dial tcp 10.217.0.29:8443: connect: connection refused" Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.879181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.879474 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.379463096 +0000 UTC m=+56.080124914 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.980656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.981035 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.481006866 +0000 UTC m=+56.181668674 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:36 crc kubenswrapper[4769]: I1121 11:51:36.981148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:36 crc kubenswrapper[4769]: E1121 11:51:36.981634 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.481617082 +0000 UTC m=+56.182278900 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.082059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.082304 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.582269348 +0000 UTC m=+56.282931176 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.082561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.082930 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.582914546 +0000 UTC m=+56.283576374 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.183821 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.184086 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.684044874 +0000 UTC m=+56.384706712 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.184391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.184836 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.684818685 +0000 UTC m=+56.385480683 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.286004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.286171 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.786141319 +0000 UTC m=+56.486803147 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.286799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.287314 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.78730124 +0000 UTC m=+56.487963058 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.388755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.389021 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.888985904 +0000 UTC m=+56.589647722 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.389310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.389783 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.889764395 +0000 UTC m=+56.590426213 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.491234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.491385 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.991364776 +0000 UTC m=+56.692026604 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.491660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.492001 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:37.991992073 +0000 UTC m=+56.692653891 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.593307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.593571 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.093523832 +0000 UTC m=+56.794185650 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.593746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.594256 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.09417595 +0000 UTC m=+56.794837768 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.695016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.695274 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.195233717 +0000 UTC m=+56.895895535 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.695599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.696024 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.196016168 +0000 UTC m=+56.896677986 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.797115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.797329 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.297297981 +0000 UTC m=+56.997959809 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.797535 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.798118 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.298101342 +0000 UTC m=+56.998763160 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.827221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5444994796-g9x6j" event={"ID":"00a56ef7-97e4-4bf8-97b9-8b8df884a29b","Type":"ContainerStarted","Data":"371256e5886d7e357473700cd56ca3c6bb31a09af365829af9b11b7f921ae899"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.828239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" event={"ID":"4c9630fd-9719-44c6-b527-a909d4a0ce2b","Type":"ContainerStarted","Data":"dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.829094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" event={"ID":"89d45255-b595-4f0a-8f76-75883503c09d","Type":"ContainerStarted","Data":"377953c312ae2e74541d50709399dbb667c5f9365986dfd92f5c968112094e5b"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.830342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" event={"ID":"bc33f66b-69b2-43b1-9fb0-9daf24892fa2","Type":"ContainerStarted","Data":"628ef8669b855388fb1669a906499f0d3226495817fa88bb66210da13f2815a3"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.831652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" event={"ID":"c62e3b58-f29e-4192-bfc8-b51fcb438f95","Type":"ContainerStarted","Data":"33cd05ea88a1554cdfad07619aa33a431301e6aa118c8782e29efd42c249546f"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.833522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" event={"ID":"ac331b1e-3f0e-45cd-9a87-c969ae716d44","Type":"ContainerStarted","Data":"ec9cb589b483a58c3ba7cf9b04a3c2c0c6a956d105ae5057616497e57c3d3caf"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.835381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" event={"ID":"217395e4-4832-4c0d-a79f-1c2fa644b90e","Type":"ContainerStarted","Data":"9ba726f218b295e96cc896b9550ef1f70badb53aefccda1bab4eec12a6089c38"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.836908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" event={"ID":"32b03c4b-e544-42ae-b008-12a99bb25c51","Type":"ContainerStarted","Data":"35c4b7bf5cef83bf980396b4b34da66b8f2bfdcb9fdc7d16a36b959a6e2b9bbb"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.839163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wp29s" event={"ID":"5da2aac0-e8eb-4269-a189-320b9a714edd","Type":"ContainerStarted","Data":"640e8b749cf0ef345d351be106521e75823e0ce5367b3ba76391c986393124f5"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.840883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxl8f" event={"ID":"93f414a5-14a5-4856-bcd9-71f9abd9569c","Type":"ContainerStarted","Data":"fb2da4c86049877839157c99e5dd09db986bcbf0e717d191d94c19722d3734a6"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.842993 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" event={"ID":"8b300dfd-e20c-48ce-8094-3cac376d7d05","Type":"ContainerStarted","Data":"407ffa44cecb8946dbd0643e54fcfadee55d304d1b687d563411b034d9bc8924"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.846936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" event={"ID":"07fe6b0d-5538-4523-8477-f0e02a2925d2","Type":"ContainerStarted","Data":"3687c6a4fa1143cffea423dfc8b4c88ddc2f18e3493d9b753e421094cd068c66"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.849493 4769 generic.go:334] "Generic (PLEG): container finished" podID="2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e" containerID="f41c215786ee6eecb660a34173518c0d93ccf8befa730cb434345b8a77ff01c4" exitCode=0 Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.849555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" event={"ID":"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e","Type":"ContainerDied","Data":"f41c215786ee6eecb660a34173518c0d93ccf8befa730cb434345b8a77ff01c4"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.854943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" event={"ID":"60317e6f-441a-43f1-b8eb-749db23aaee6","Type":"ContainerStarted","Data":"bc53590551d54cf3936f2fe4fb3baa161bbe6607b99bf8c4362634657a293508"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.862366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" event={"ID":"218a7fed-53ee-4ea6-9095-c499af80df24","Type":"ContainerStarted","Data":"c26704e115c02e4eadeeef76232e54a0ba78b33f4f0f05bdb910915554550f7f"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.864541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" event={"ID":"05bac206-a644-40c0-98fd-f7de5869bec1","Type":"ContainerStarted","Data":"8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.865356 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.868545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" event={"ID":"41825801-cb10-436f-ad81-3e65407237f7","Type":"ContainerStarted","Data":"7c1bfb04462e92215b20cdd0780532f0ba8256aa81237a7f282a578641f8c6ca"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.869767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" event={"ID":"e64f0532-628a-4fa4-a78d-8afb135e2b23","Type":"ContainerStarted","Data":"a38933758ffb016cd1f4740a42f8ca1f287f2ec93ad5c03357125e2dc5edfee9"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.870632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" event={"ID":"f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77","Type":"ContainerStarted","Data":"1b24f976d839a027c35177a83b3758216bca0a8634f622a66781f5e621a48ab3"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.871497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" event={"ID":"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a","Type":"ContainerStarted","Data":"fc213c3113290e183989f2c397c80e29407464b8b8ca867dc9a187fd5b4b132e"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.871954 4769 patch_prober.go:28] interesting pod/oauth-openshift-558db77b4-dppfh container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" start-of-body= Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.871988 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.876562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" event={"ID":"6e9dcb3e-0040-4ed8-b695-17487f0eca03","Type":"ContainerStarted","Data":"efd5bd7ad0af40f38adf195011f2fe0a393da02918d479b1d838d887c763f6cd"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.877632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" event={"ID":"cbbb83ea-d851-41e9-9e1a-e55ef7994ef4","Type":"ContainerStarted","Data":"ded7207251f0b0dddb34be7509c14c8bc6b2faff2c3d4b73fda3f22579d5ff83"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.879957 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/cluster-image-registry-operator-dc59b4c8b-bgp9q" podStartSLOduration=27.87994658 podStartE2EDuration="27.87994658s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:37.861994096 +0000 UTC m=+56.562655914" watchObservedRunningTime="2025-11-21 11:51:37.87994658 +0000 UTC m=+56.580608398" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.882654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" event={"ID":"1cf2d137-129b-470b-aed3-8c92b0fd8441","Type":"ContainerStarted","Data":"5ccfc39b38e852f337a0fa3a77e2e8788144a952b75b402c442e9f798d1804d6"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.885119 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" event={"ID":"f9370e66-09f6-4083-9b6a-d926c1d9e03f","Type":"ContainerStarted","Data":"54deabe9deb5861db2231c47289eb769bb3879ab69f77d5293c3d83013755764"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.886073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" event={"ID":"a7ee2779-b9c7-4d5f-b42d-c4ca3836bf82","Type":"ContainerStarted","Data":"8d3b0180186fe246128f8d7b411e1d0e1b1709974a6831178ff41c36201100d1"} Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.886751 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.887358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.887379 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.889599 4769 patch_prober.go:28] interesting pod/route-controller-manager-6576b87f9c-vmgf6 container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.5:8443/healthz\": dial tcp 10.217.0.5:8443: connect: connection refused" start-of-body= Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.889618 4769 patch_prober.go:28] interesting pod/marketplace-operator-79b997595-t6l7h container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" start-of-body= Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.889648 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.217.0.5:8443/healthz\": dial tcp 10.217.0.5:8443: connect: connection refused" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.889666 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.889618 4769 patch_prober.go:28] interesting pod/catalog-operator-68c6474976-jrvmp container/catalog-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.22:8443/healthz\": dial tcp 10.217.0.22:8443: connect: connection refused" start-of-body= Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.889706 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" podUID="12723c70-e8e8-435b-954c-ab5d30700449" containerName="catalog-operator" probeResult="failure" output="Get \"https://10.217.0.22:8443/healthz\": dial tcp 10.217.0.22:8443: connect: connection refused" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.898323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.898453 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.398423079 +0000 UTC m=+57.099084907 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.898506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:37 crc kubenswrapper[4769]: E1121 11:51:37.912387 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.412353875 +0000 UTC m=+57.113015693 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.913944 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-665b6dd947-q86d5" podStartSLOduration=27.913908707 podStartE2EDuration="27.913908707s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:37.904612256 +0000 UTC m=+56.605274074" watchObservedRunningTime="2025-11-21 11:51:37.913908707 +0000 UTC m=+56.614570525" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.937745 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" podStartSLOduration=27.937712889 podStartE2EDuration="27.937712889s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:37.936951448 +0000 UTC m=+56.637613266" watchObservedRunningTime="2025-11-21 11:51:37.937712889 +0000 UTC m=+56.638374707" Nov 21 11:51:37 crc kubenswrapper[4769]: I1121 11:51:37.982913 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-766d6c64bb-cvbfs" podStartSLOduration=27.982878918 podStartE2EDuration="27.982878918s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:37.961792139 +0000 UTC m=+56.662453957" watchObservedRunningTime="2025-11-21 11:51:37.982878918 +0000 UTC m=+56.683540726" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.000994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.001329 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.501301245 +0000 UTC m=+57.201963063 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.001933 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.003430 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.503416362 +0000 UTC m=+57.204078380 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.010352 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" podStartSLOduration=28.010324108 podStartE2EDuration="28.010324108s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:37.985619912 +0000 UTC m=+56.686281730" watchObservedRunningTime="2025-11-21 11:51:38.010324108 +0000 UTC m=+56.710985926" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.029066 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f9d7485db-9vb2t" podStartSLOduration=28.029048143 podStartE2EDuration="28.029048143s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.02706663 +0000 UTC m=+56.727728448" watchObservedRunningTime="2025-11-21 11:51:38.029048143 +0000 UTC m=+56.729709981" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.032294 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" podStartSLOduration=28.032284971 podStartE2EDuration="28.032284971s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.008489129 +0000 UTC m=+56.709150947" watchObservedRunningTime="2025-11-21 11:51:38.032284971 +0000 UTC m=+56.732946779" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.054804 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-server-n8dcr" podStartSLOduration=7.054779658 podStartE2EDuration="7.054779658s" podCreationTimestamp="2025-11-21 11:51:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.053489433 +0000 UTC m=+56.754151251" watchObservedRunningTime="2025-11-21 11:51:38.054779658 +0000 UTC m=+56.755441466" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.067865 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-5fdd9b5758-8bjbp" podStartSLOduration=28.06784123 podStartE2EDuration="28.06784123s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.066066762 +0000 UTC m=+56.766728600" watchObservedRunningTime="2025-11-21 11:51:38.06784123 +0000 UTC m=+56.768503048" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.103339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.103484 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.603460361 +0000 UTC m=+57.304122179 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.103626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.103941 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.603930334 +0000 UTC m=+57.304592152 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.108130 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" podStartSLOduration=28.108104056 podStartE2EDuration="28.108104056s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.107608573 +0000 UTC m=+56.808270401" watchObservedRunningTime="2025-11-21 11:51:38.108104056 +0000 UTC m=+56.808765874" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.134485 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" podStartSLOduration=28.134448277 podStartE2EDuration="28.134448277s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.124813407 +0000 UTC m=+56.825475225" watchObservedRunningTime="2025-11-21 11:51:38.134448277 +0000 UTC m=+56.835110095" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.204912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.205438 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.705414062 +0000 UTC m=+57.406075880 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.273481 4769 scope.go:117] "RemoveContainer" containerID="8dd711d02a1ff9747e8b1826ae7bc0b0f36670c5cefb35aec7405d97619bf052" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.306338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.306907 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.8068767 +0000 UTC m=+57.507538518 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.407989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.408144 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.908112091 +0000 UTC m=+57.608773909 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.408663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.409071 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:38.909062857 +0000 UTC m=+57.609724675 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.509953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.510166 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.010130714 +0000 UTC m=+57.710792532 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.510252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.518490 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.018455838 +0000 UTC m=+57.719117656 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.611416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.611632 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.111591181 +0000 UTC m=+57.812253039 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.611796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.612242 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.112226178 +0000 UTC m=+57.812888026 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.713070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.713284 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.213248254 +0000 UTC m=+57.913910082 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.713621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.713998 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.213983194 +0000 UTC m=+57.914645022 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.815318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.815722 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.315674188 +0000 UTC m=+58.016336006 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.898796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" event={"ID":"27b60de2-5292-4da6-a3e9-925ba06bb813","Type":"ContainerStarted","Data":"85fc719d5c26f2c6d838fdfc3abb1498c49c468c97e3f29ca6fa92f3ad8863f3"} Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.902835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" event={"ID":"2c02946d-09e7-4074-90f9-9440a6c0136b","Type":"ContainerStarted","Data":"a2a6717e737395edc9f6590e47a31d9aaa182518faca1dd34eca5b771ad832cb"} Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.903564 4769 patch_prober.go:28] interesting pod/oauth-openshift-558db77b4-dppfh container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" start-of-body= Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.903623 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.904077 4769 patch_prober.go:28] interesting pod/marketplace-operator-79b997595-t6l7h container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" start-of-body= Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.904120 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.27:8080/healthz\": dial tcp 10.217.0.27:8080: connect: connection refused" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.904259 4769 patch_prober.go:28] interesting pod/route-controller-manager-6576b87f9c-vmgf6 container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.5:8443/healthz\": dial tcp 10.217.0.5:8443: connect: connection refused" start-of-body= Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.904329 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.217.0.5:8443/healthz\": dial tcp 10.217.0.5:8443: connect: connection refused" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.904724 4769 patch_prober.go:28] interesting pod/catalog-operator-68c6474976-jrvmp container/catalog-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.22:8443/healthz\": dial tcp 10.217.0.22:8443: connect: connection refused" start-of-body= Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.904880 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" podUID="12723c70-e8e8-435b-954c-ab5d30700449" containerName="catalog-operator" probeResult="failure" output="Get \"https://10.217.0.22:8443/healthz\": dial tcp 10.217.0.22:8443: connect: connection refused" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.917141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:38 crc kubenswrapper[4769]: E1121 11:51:38.917627 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.417584717 +0000 UTC m=+58.118246545 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.954589 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5444994796-g9x6j" podStartSLOduration=28.954558815 podStartE2EDuration="28.954558815s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.937006421 +0000 UTC m=+57.637668269" watchObservedRunningTime="2025-11-21 11:51:38.954558815 +0000 UTC m=+57.655220683" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.983979 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd-operator/etcd-operator-b45778765-vs5vn" podStartSLOduration=28.983962488 podStartE2EDuration="28.983962488s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.98255088 +0000 UTC m=+57.683212698" watchObservedRunningTime="2025-11-21 11:51:38.983962488 +0000 UTC m=+57.684624306" Nov 21 11:51:38 crc kubenswrapper[4769]: I1121 11:51:38.984888 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/control-plane-machine-set-operator-78cbb6b69f-c2gx5" podStartSLOduration=28.984880203 podStartE2EDuration="28.984880203s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:38.95956291 +0000 UTC m=+57.660224748" watchObservedRunningTime="2025-11-21 11:51:38.984880203 +0000 UTC m=+57.685542031" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.006137 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podStartSLOduration=8.006117376 podStartE2EDuration="8.006117376s" podCreationTimestamp="2025-11-21 11:51:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.004111542 +0000 UTC m=+57.704773400" watchObservedRunningTime="2025-11-21 11:51:39.006117376 +0000 UTC m=+57.706779224" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.018593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.019076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.019423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.021303 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.521278405 +0000 UTC m=+58.221940313 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.027822 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-777779d784-tnn76" podStartSLOduration=29.027800911 podStartE2EDuration="29.027800911s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.02626809 +0000 UTC m=+57.726929918" watchObservedRunningTime="2025-11-21 11:51:39.027800911 +0000 UTC m=+57.728462729" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.035335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-networking-console-plugin-cert\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.060014 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" podStartSLOduration=29.05999185 podStartE2EDuration="29.05999185s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.054479711 +0000 UTC m=+57.755141529" watchObservedRunningTime="2025-11-21 11:51:39.05999185 +0000 UTC m=+57.760653668" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.073492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5fe485a1-e14f-4c09-b5b9-f252bc42b7e8-nginx-conf\") pod \"networking-console-plugin-85b44fc459-gdk6g\" (UID: \"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8\") " pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.078924 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-756b6f6bc6-6p8sv" podStartSLOduration=29.07890951 podStartE2EDuration="29.07890951s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.07743639 +0000 UTC m=+57.778098198" watchObservedRunningTime="2025-11-21 11:51:39.07890951 +0000 UTC m=+57.779571328" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.092608 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-b67b599dd-sv68k" podStartSLOduration=29.092589019 podStartE2EDuration="29.092589019s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.092365773 +0000 UTC m=+57.793027601" watchObservedRunningTime="2025-11-21 11:51:39.092589019 +0000 UTC m=+57.793250837" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.122265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.122359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.122423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.122914 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.622895337 +0000 UTC m=+58.323557155 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.138595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqllr\" (UniqueName: \"kubernetes.io/projected/3b6479f0-333b-4a96-9adf-2099afdc2447-kube-api-access-cqllr\") pod \"network-check-target-xd92c\" (UID: \"3b6479f0-333b-4a96-9adf-2099afdc2447\") " pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.139598 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wp29s" podStartSLOduration=8.139576917 podStartE2EDuration="8.139576917s" podCreationTimestamp="2025-11-21 11:51:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.113334779 +0000 UTC m=+57.813996607" watchObservedRunningTime="2025-11-21 11:51:39.139576917 +0000 UTC m=+57.840238735" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.140861 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" podStartSLOduration=29.140852951 podStartE2EDuration="29.140852951s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.13895337 +0000 UTC m=+57.839615188" watchObservedRunningTime="2025-11-21 11:51:39.140852951 +0000 UTC m=+57.841514769" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.142769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2dwl\" (UniqueName: \"kubernetes.io/projected/9d751cbb-f2e2-430d-9754-c882a5e924a5-kube-api-access-s2dwl\") pod \"network-check-source-55646444c4-trplf\" (UID: \"9d751cbb-f2e2-430d-9754-c882a5e924a5\") " pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.164381 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-78b949d7b-pm6xv" podStartSLOduration=29.164357076 podStartE2EDuration="29.164357076s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.161092887 +0000 UTC m=+57.861754705" watchObservedRunningTime="2025-11-21 11:51:39.164357076 +0000 UTC m=+57.865018884" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.168109 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.171173 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" start-of-body= Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.171237 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.223075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.223232 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.723207643 +0000 UTC m=+58.423869461 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.223370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.223697 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.723688506 +0000 UTC m=+58.424350324 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.227142 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.324827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.325016 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.8249903 +0000 UTC m=+58.525652118 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.325147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.325483 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.825474863 +0000 UTC m=+58.526136681 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.331158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.335747 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.426487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.426636 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.92659723 +0000 UTC m=+58.627259048 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.427666 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.428161 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:39.928150622 +0000 UTC m=+58.628812440 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.530126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.530299 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.030263237 +0000 UTC m=+58.730925055 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.530350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.530802 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.030785831 +0000 UTC m=+58.731447649 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.633658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.634320 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.134291504 +0000 UTC m=+58.834953322 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.734969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.735437 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.235417893 +0000 UTC m=+58.936079711 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.835554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.835872 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.335857173 +0000 UTC m=+59.036518991 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.922145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" event={"ID":"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8","Type":"ContainerStarted","Data":"0ea4c322f249abce9c068c953aac3b45a7e0735def1c8de144fc28471a000c01"} Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.924249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" event={"ID":"3b6479f0-333b-4a96-9adf-2099afdc2447","Type":"ContainerStarted","Data":"3baddf1acabdc40c784bf2903ee3c50fa4d49910d74a035b08081fca1fe368ad"} Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.925490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" event={"ID":"9d751cbb-f2e2-430d-9754-c882a5e924a5","Type":"ContainerStarted","Data":"e606dd0d9c40c1ce1c1150856a132dcf7df54e5a8b79a40b26eeaf3c86c48129"} Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.926433 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.926546 4769 patch_prober.go:28] interesting pod/oauth-openshift-558db77b4-dppfh container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" start-of-body= Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.926616 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.931820 4769 patch_prober.go:28] interesting pod/olm-operator-6b444d44fb-2k8wt container/olm-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" start-of-body= Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.931869 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" podUID="f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77" containerName="olm-operator" probeResult="failure" output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.937072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:39 crc kubenswrapper[4769]: E1121 11:51:39.937650 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.437633429 +0000 UTC m=+59.138295247 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.941444 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" podStartSLOduration=29.941421291 podStartE2EDuration="29.941421291s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.939306244 +0000 UTC m=+58.639968062" watchObservedRunningTime="2025-11-21 11:51:39.941421291 +0000 UTC m=+58.642083109" Nov 21 11:51:39 crc kubenswrapper[4769]: I1121 11:51:39.958873 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-9c57cc56f-r2rmv" podStartSLOduration=29.958849411 podStartE2EDuration="29.958849411s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:39.955865941 +0000 UTC m=+58.656527779" watchObservedRunningTime="2025-11-21 11:51:39.958849411 +0000 UTC m=+58.659511229" Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.038074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.039175 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.539160948 +0000 UTC m=+59.239822766 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.140320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.141000 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.640979025 +0000 UTC m=+59.341640883 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.169464 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" start-of-body= Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.169524 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.241903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.242520 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.742494084 +0000 UTC m=+59.443155942 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.343850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.344116 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.844104456 +0000 UTC m=+59.544766274 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.444733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.444961 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.944931536 +0000 UTC m=+59.645593374 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.445153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.445515 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:40.945498891 +0000 UTC m=+59.646160719 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.546903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.547061 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.047032801 +0000 UTC m=+59.747694629 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.547179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.547572 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.047562265 +0000 UTC m=+59.748224093 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.653428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.653907 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.153829883 +0000 UTC m=+59.854491721 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.653972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.654951 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.154913602 +0000 UTC m=+59.855575450 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.755653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.755913 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.255860855 +0000 UTC m=+59.956522683 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.756035 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.756576 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.256551174 +0000 UTC m=+59.957213002 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.857236 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.857821 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.357793046 +0000 UTC m=+60.058454874 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.933600 4769 patch_prober.go:28] interesting pod/olm-operator-6b444d44fb-2k8wt container/olm-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" start-of-body= Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.934222 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" podUID="f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77" containerName="olm-operator" probeResult="failure" output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" Nov 21 11:51:40 crc kubenswrapper[4769]: I1121 11:51:40.960022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:40 crc kubenswrapper[4769]: E1121 11:51:40.960613 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.460584449 +0000 UTC m=+60.161246297 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.061206 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.061910 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.561891683 +0000 UTC m=+60.262553501 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.163033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.163441 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.663409722 +0000 UTC m=+60.364071540 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.168722 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" start-of-body= Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.168813 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.264034 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.264313 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.764277843 +0000 UTC m=+60.464939661 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.264391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.264799 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.764787687 +0000 UTC m=+60.465449515 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.366001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.366305 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.866289956 +0000 UTC m=+60.566951774 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.467638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.467944 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:41.967932818 +0000 UTC m=+60.668594636 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.568233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.568656 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.068604554 +0000 UTC m=+60.769266382 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.670028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.670377 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.17036032 +0000 UTC m=+60.871022148 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.753393 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.754973 4769 patch_prober.go:28] interesting pod/openshift-config-operator-7777fb866f-9r5br container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.217.0.9:8443/healthz\": dial tcp 10.217.0.9:8443: connect: connection refused" start-of-body= Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.755031 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" podUID="e64f0532-628a-4fa4-a78d-8afb135e2b23" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/healthz\": dial tcp 10.217.0.9:8443: connect: connection refused" Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.754984 4769 patch_prober.go:28] interesting pod/openshift-config-operator-7777fb866f-9r5br container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.217.0.9:8443/healthz\": dial tcp 10.217.0.9:8443: connect: connection refused" start-of-body= Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.755129 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" podUID="e64f0532-628a-4fa4-a78d-8afb135e2b23" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/healthz\": dial tcp 10.217.0.9:8443: connect: connection refused" Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.755531 4769 patch_prober.go:28] interesting pod/openshift-config-operator-7777fb866f-9r5br container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.217.0.9:8443/healthz\": dial tcp 10.217.0.9:8443: connect: connection refused" start-of-body= Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.755556 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" podUID="e64f0532-628a-4fa4-a78d-8afb135e2b23" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/healthz\": dial tcp 10.217.0.9:8443: connect: connection refused" Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.771129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.771264 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.271249372 +0000 UTC m=+60.971911190 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.771314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.771629 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.271618542 +0000 UTC m=+60.972280360 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.872624 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.872901 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.372848243 +0000 UTC m=+61.073510091 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.873090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.873701 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.373668325 +0000 UTC m=+61.074330143 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.941832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" event={"ID":"2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e","Type":"ContainerStarted","Data":"ee0ada52c260d2ba44fad841aea4eb734df395935ae606b253b733135c0411f3"} Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.945255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" event={"ID":"9b4852c7-e609-43fd-83b4-6c57ced3cab8","Type":"ContainerStarted","Data":"1f4bf0f1d6f281681b00d1cabba2aa547ff41d89230e0c54397f82ca43c32c56"} Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.947167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" event={"ID":"60317e6f-441a-43f1-b8eb-749db23aaee6","Type":"ContainerStarted","Data":"32434e945f7c6ca431971f32d0927d8787f2a974d63a36b9f44be5f7c12d207c"} Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.949381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxl8f" event={"ID":"93f414a5-14a5-4856-bcd9-71f9abd9569c","Type":"ContainerStarted","Data":"32012b73a89078ad53a61ca17b5973f60229d054af27f76bb23a802022970cab"} Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.973978 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/machine-api-operator-5694c8668f-5sbdz" podStartSLOduration=31.973947441 podStartE2EDuration="31.973947441s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:41.969957983 +0000 UTC m=+60.670619811" watchObservedRunningTime="2025-11-21 11:51:41.973947441 +0000 UTC m=+60.674609259" Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.974710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.974914 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.474886746 +0000 UTC m=+61.175548564 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:41 crc kubenswrapper[4769]: I1121 11:51:41.974957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:41 crc kubenswrapper[4769]: E1121 11:51:41.975311 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.475303538 +0000 UTC m=+61.175965356 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.076522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.077383 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.57733405 +0000 UTC m=+61.277995878 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.169303 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" start-of-body= Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.169387 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.178262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.178597 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.678578762 +0000 UTC m=+61.379240580 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.279708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.279993 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.779946867 +0000 UTC m=+61.480608685 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.381277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.381828 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.881801555 +0000 UTC m=+61.582463363 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.482702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.482847 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.982816481 +0000 UTC m=+61.683478299 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.483229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.483608 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:42.983598832 +0000 UTC m=+61.684260650 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.585356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.585748 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.085718357 +0000 UTC m=+61.786380165 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.638371 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.687043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.688079 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.188049738 +0000 UTC m=+61.888711556 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.769965 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.770548 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.770454 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.770947 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.788129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.788596 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.288577241 +0000 UTC m=+61.989239059 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.890423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.890911 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.390888161 +0000 UTC m=+62.091549979 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.977414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" event={"ID":"6e9dcb3e-0040-4ed8-b695-17487f0eca03","Type":"ContainerStarted","Data":"904a01b0be2d49dc72c385d3f93f2fcab19f3d81ee2e3c5c14d1489aa00b66f3"} Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.987534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" event={"ID":"89d45255-b595-4f0a-8f76-75883503c09d","Type":"ContainerStarted","Data":"3ad78bd6adbf7a833c210e0a6fff642be879a1c43ccd5df4ac8a43f124dcf364"} Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.992736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:42 crc kubenswrapper[4769]: E1121 11:51:42.993210 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.493171231 +0000 UTC m=+62.193833049 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:42 crc kubenswrapper[4769]: I1121 11:51:42.996832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" event={"ID":"41825801-cb10-436f-ad81-3e65407237f7","Type":"ContainerStarted","Data":"03987c62971524a11fdf143f8cc262be57859c1041f33de6377a6311ca77b865"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.004232 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns-operator/dns-operator-744455d44c-9mb4n" podStartSLOduration=33.004210258 podStartE2EDuration="33.004210258s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:42.997759234 +0000 UTC m=+61.698421052" watchObservedRunningTime="2025-11-21 11:51:43.004210258 +0000 UTC m=+61.704872086" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.007293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-55646444c4-trplf" event={"ID":"9d751cbb-f2e2-430d-9754-c882a5e924a5","Type":"ContainerStarted","Data":"4c2c331edf249c7ec91107696b2736c00397f66336030686d8b303c20002da2e"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.023720 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/2.log" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.030271 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-operator/ingress-operator-5b745b69d9-k8qv6" podStartSLOduration=33.03025329 podStartE2EDuration="33.03025329s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.028283407 +0000 UTC m=+61.728945235" watchObservedRunningTime="2025-11-21 11:51:43.03025329 +0000 UTC m=+61.730915108" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.042582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"f4b27818a5e8e43d0dc095d08835c792","Type":"ContainerStarted","Data":"11648468ba0c31420aebc6298d9e43172f75347e576b96582cd548f68eadef4c"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.043461 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.060408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" event={"ID":"f9370e66-09f6-4083-9b6a-d926c1d9e03f","Type":"ContainerStarted","Data":"f4f2634de6df21f14ed028e3cac3f68ebb099368dd852aab5ead50b44eda81cf"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.063686 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-controller-84d6567774-rcwsb" podStartSLOduration=33.063657032 podStartE2EDuration="33.063657032s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.060408594 +0000 UTC m=+61.761070412" watchObservedRunningTime="2025-11-21 11:51:43.063657032 +0000 UTC m=+61.764318850" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.084721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xd92c" event={"ID":"3b6479f0-333b-4a96-9adf-2099afdc2447","Type":"ContainerStarted","Data":"212d0ee95efb019f4ca182a3adc4d49bad527428d9b1317ed60bdba64916d9ca"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.085373 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.094757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.096776 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.596757285 +0000 UTC m=+62.297419263 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.117362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" event={"ID":"8b300dfd-e20c-48ce-8094-3cac376d7d05","Type":"ContainerStarted","Data":"dc835dda64a965cead0afa5bdd4ad2bb9dcd6986fd62a6ea23e5ce3907d22d49"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.118060 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.127898 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-crc" podStartSLOduration=34.127881194 podStartE2EDuration="34.127881194s" podCreationTimestamp="2025-11-21 11:51:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.127028272 +0000 UTC m=+61.827690090" watchObservedRunningTime="2025-11-21 11:51:43.127881194 +0000 UTC m=+61.828543072" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.136029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-85b44fc459-gdk6g" event={"ID":"5fe485a1-e14f-4c09-b5b9-f252bc42b7e8","Type":"ContainerStarted","Data":"d6d2873ad5e303ce225866dfad0a7298f31694650b733926202d7d984f6c3ab4"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.149723 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-admission-controller-857f4d67dd-qks2k" podStartSLOduration=33.149702383 podStartE2EDuration="33.149702383s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.147771881 +0000 UTC m=+61.848433699" watchObservedRunningTime="2025-11-21 11:51:43.149702383 +0000 UTC m=+61.850364201" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.150021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" event={"ID":"2c02946d-09e7-4074-90f9-9440a6c0136b","Type":"ContainerStarted","Data":"f084f74f28ad61b6c1f650b0d4d42e44df4a1837244aa9c95fcd2ab0ff1c1de0"} Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.150065 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.189215 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" start-of-body= Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.189275 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz/ready\": dial tcp [::1]:1936: connect: connection refused" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.199373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.199599 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.699564609 +0000 UTC m=+62.400226427 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.199886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.199917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.204277 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.704268065 +0000 UTC m=+62.404929883 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.274498 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.278652 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" podStartSLOduration=33.278611251 podStartE2EDuration="33.278611251s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.271227902 +0000 UTC m=+61.971889720" watchObservedRunningTime="2025-11-21 11:51:43.278611251 +0000 UTC m=+61.979273069" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.300959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.301425 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.801408956 +0000 UTC m=+62.502070774 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.349735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e18361a9-a58b-479a-9eb3-81ea8bab35c9-metrics-certs\") pod \"network-metrics-daemon-64jk8\" (UID: \"e18361a9-a58b-479a-9eb3-81ea8bab35c9\") " pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.402482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.402805 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:43.902764721 +0000 UTC m=+62.603426539 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.431602 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-sa-dockercfg-d427c" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.432304 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64jk8" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.459001 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-operator-74547568cd-w4tzm" podStartSLOduration=33.458980938 podStartE2EDuration="33.458980938s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.458707061 +0000 UTC m=+62.159368889" watchObservedRunningTime="2025-11-21 11:51:43.458980938 +0000 UTC m=+62.159642756" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.462020 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-59844c95c7-djw5n" podStartSLOduration=33.46201101 podStartE2EDuration="33.46201101s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.400606863 +0000 UTC m=+62.101268681" watchObservedRunningTime="2025-11-21 11:51:43.46201101 +0000 UTC m=+62.162672828" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.506967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.507351 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.007334583 +0000 UTC m=+62.707996401 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.602750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.602798 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.603937 4769 patch_prober.go:28] interesting pod/apiserver-7bbb656c7d-9nmkb container/oauth-apiserver namespace/openshift-oauth-apiserver: Startup probe status=failure output="Get \"https://10.217.0.14:8443/livez\": dial tcp 10.217.0.14:8443: connect: connection refused" start-of-body= Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.603992 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" podUID="2100b4b1-bd4d-44e6-8d9a-bf567b7f0e4e" containerName="oauth-apiserver" probeResult="failure" output="Get \"https://10.217.0.14:8443/livez\": dial tcp 10.217.0.14:8443: connect: connection refused" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.610475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.610893 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.110880426 +0000 UTC m=+62.811542244 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.671744 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xxl8f" podStartSLOduration=12.671726898 podStartE2EDuration="12.671726898s" podCreationTimestamp="2025-11-21 11:51:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.615560983 +0000 UTC m=+62.316222811" watchObservedRunningTime="2025-11-21 11:51:43.671726898 +0000 UTC m=+62.372388716" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.682560 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.682615 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.683451 4769 patch_prober.go:28] interesting pod/console-f9d7485db-9vb2t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.217.0.28:8443/health\": dial tcp 10.217.0.28:8443: connect: connection refused" start-of-body= Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.683523 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-f9d7485db-9vb2t" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" probeResult="failure" output="Get \"https://10.217.0.28:8443/health\": dial tcp 10.217.0.28:8443: connect: connection refused" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.711819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.713602 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.213572797 +0000 UTC m=+62.914234615 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.734741 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.734969 4769 patch_prober.go:28] interesting pod/oauth-openshift-558db77b4-dppfh container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" start-of-body= Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.735034 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.23:6443/healthz\": dial tcp 10.217.0.23:6443: connect: connection refused" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.760047 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" podStartSLOduration=33.760023561 podStartE2EDuration="33.760023561s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:43.671572774 +0000 UTC m=+62.372234592" watchObservedRunningTime="2025-11-21 11:51:43.760023561 +0000 UTC m=+62.460685379" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.779739 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-68c6474976-jrvmp" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.807901 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.822566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.823836 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.323822862 +0000 UTC m=+63.024484680 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.843104 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.928495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.925848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.932804 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.432777472 +0000 UTC m=+63.133439290 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.935251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:43 crc kubenswrapper[4769]: E1121 11:51:43.941688 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.441665392 +0000 UTC m=+63.142327210 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:43 crc kubenswrapper[4769]: I1121 11:51:43.960151 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.038876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.039254 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.539237404 +0000 UTC m=+63.239899222 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.142978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.143379 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.643367104 +0000 UTC m=+63.344028922 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.143857 4769 patch_prober.go:28] interesting pod/olm-operator-6b444d44fb-2k8wt container/olm-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" start-of-body= Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.143880 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" podUID="f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77" containerName="olm-operator" probeResult="failure" output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.143940 4769 patch_prober.go:28] interesting pod/olm-operator-6b444d44fb-2k8wt container/olm-operator namespace/openshift-operator-lifecycle-manager: Liveness probe status=failure output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" start-of-body= Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.143994 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" podUID="f4c689c8-f5f7-4d08-ba2b-61c3d9b14e77" containerName="olm-operator" probeResult="failure" output="Get \"https://10.217.0.30:8443/healthz\": dial tcp 10.217.0.30:8443: connect: connection refused" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.170252 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.173999 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:44 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:44 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:44 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.174270 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.199602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" event={"ID":"d980fc96-9282-4f81-8bea-57d074eb8b05","Type":"ContainerStarted","Data":"f53579e13ed316db2b135056f95dd15f2a7fa2bc951b0514cb5234eadb8d2b6f"} Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.227402 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64jk8"] Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.230168 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-58897d9998-6wlsh" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.232439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" event={"ID":"9b4852c7-e609-43fd-83b4-6c57ced3cab8","Type":"ContainerStarted","Data":"ff74e078f9c3ca3d100614c118e39176b149238460daf8d93788caa70c79ad78"} Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.244445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.244849 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.744825521 +0000 UTC m=+63.445487339 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.250256 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/revision-pruner-9-crc"] Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.255628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.281852 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.281896 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-kjl2n" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.286986 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/revision-pruner-9-crc"] Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.335324 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" podStartSLOduration=34.335300672 podStartE2EDuration="34.335300672s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:44.327331167 +0000 UTC m=+63.027992985" watchObservedRunningTime="2025-11-21 11:51:44.335300672 +0000 UTC m=+63.035962490" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.347413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.360392 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.860364719 +0000 UTC m=+63.561026747 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.449692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.449864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kube-api-access\") pod \"revision-pruner-9-crc\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.449918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kubelet-dir\") pod \"revision-pruner-9-crc\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.450005 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:44.949989717 +0000 UTC m=+63.650651535 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.479282 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-d55dfcdfc-vhgqt" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.550836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kube-api-access\") pod \"revision-pruner-9-crc\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.550889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.550925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kubelet-dir\") pod \"revision-pruner-9-crc\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.551029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kubelet-dir\") pod \"revision-pruner-9-crc\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.551503 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.051492205 +0000 UTC m=+63.752154023 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.591017 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kube-api-access\") pod \"revision-pruner-9-crc\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.613447 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.652238 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.653029 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.153000674 +0000 UTC m=+63.853662672 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.754345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.754903 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.254885323 +0000 UTC m=+63.955547141 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.855457 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.855734 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.355708534 +0000 UTC m=+64.056370352 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.856684 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.856955 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.356947867 +0000 UTC m=+64.057609685 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:44 crc kubenswrapper[4769]: I1121 11:51:44.958068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:44 crc kubenswrapper[4769]: E1121 11:51:44.958527 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.458509737 +0000 UTC m=+64.159171555 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.006415 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-h2c4x"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.063057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.063362 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.563348386 +0000 UTC m=+64.264010214 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.158223 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-5qxd8"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.159601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.165340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.165510 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-4rs5g" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.165767 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.665743379 +0000 UTC m=+64.366405197 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.168923 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/revision-pruner-9-crc"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.171025 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:45 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:45 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:45 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.171080 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.179294 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-5qxd8"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.250849 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" containerID="fc213c3113290e183989f2c397c80e29407464b8b8ca867dc9a187fd5b4b132e" exitCode=0 Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.250925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" event={"ID":"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a","Type":"ContainerDied","Data":"fc213c3113290e183989f2c397c80e29407464b8b8ca867dc9a187fd5b4b132e"} Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.267116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-catalog-content\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.267311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4fh8\" (UniqueName: \"kubernetes.io/projected/3ea4516e-4916-48c4-9464-95603adf2b8a-kube-api-access-q4fh8\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.267349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-utilities\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.267419 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.267948 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.767925856 +0000 UTC m=+64.468587674 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.275453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64jk8" event={"ID":"e18361a9-a58b-479a-9eb3-81ea8bab35c9","Type":"ContainerStarted","Data":"d9e6b1e921fc40113cf5a1f6f1cbb45efbb6cfb6bcc3229560ef2f1602c012d2"} Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.275512 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64jk8" event={"ID":"e18361a9-a58b-479a-9eb3-81ea8bab35c9","Type":"ContainerStarted","Data":"42e07beb62a6277a314d7cd7c2757cba5b949572e0ef782401e45ba9805152fb"} Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.282473 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" containerID="cri-o://dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" gracePeriod=30 Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.317939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/revision-pruner-9-crc" event={"ID":"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8","Type":"ContainerStarted","Data":"0767667ee014b15e43788971df1bd1efd76d9341bc03de98d60ab247edd51cd4"} Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.339283 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-z7px2"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.340557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.352049 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-dmngl" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.366134 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-z7px2"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.369197 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.369406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-catalog-content\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.369519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fh8\" (UniqueName: \"kubernetes.io/projected/3ea4516e-4916-48c4-9464-95603adf2b8a-kube-api-access-q4fh8\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.369540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-utilities\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.370906 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.870884994 +0000 UTC m=+64.571546812 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.371091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-catalog-content\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.371787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-utilities\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.400165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fh8\" (UniqueName: \"kubernetes.io/projected/3ea4516e-4916-48c4-9464-95603adf2b8a-kube-api-access-q4fh8\") pod \"certified-operators-5qxd8\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.471124 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnbrg\" (UniqueName: \"kubernetes.io/projected/024c57c4-ef5a-4c59-b67d-d9340284d9b1-kube-api-access-lnbrg\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.471633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-catalog-content\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.471665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.471693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-utilities\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.471988 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:45.971975921 +0000 UTC m=+64.672637739 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.501528 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.532545 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-8ldcx"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.533439 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.575809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.575966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-utilities\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.576020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lnbrg\" (UniqueName: \"kubernetes.io/projected/024c57c4-ef5a-4c59-b67d-d9340284d9b1-kube-api-access-lnbrg\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.576058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-catalog-content\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.576589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-catalog-content\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.576660 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.076644555 +0000 UTC m=+64.777306373 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.576856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-utilities\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.578477 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-8ldcx"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.631610 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnbrg\" (UniqueName: \"kubernetes.io/projected/024c57c4-ef5a-4c59-b67d-d9340284d9b1-kube-api-access-lnbrg\") pod \"community-operators-z7px2\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.672545 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.689846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-utilities\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.689886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbfvj\" (UniqueName: \"kubernetes.io/projected/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-kube-api-access-mbfvj\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.689904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-catalog-content\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.689932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.690288 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.190275611 +0000 UTC m=+64.890937429 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.739622 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-xg5mk"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.748757 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.756683 4769 patch_prober.go:28] interesting pod/openshift-config-operator-7777fb866f-9r5br container/openshift-config-operator namespace/openshift-config-operator: Readiness probe status=failure output="Get \"https://10.217.0.9:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.756749 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" podUID="e64f0532-628a-4fa4-a78d-8afb135e2b23" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.757181 4769 patch_prober.go:28] interesting pod/openshift-config-operator-7777fb866f-9r5br container/openshift-config-operator namespace/openshift-config-operator: Liveness probe status=failure output="Get \"https://10.217.0.9:8443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.757271 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" podUID="e64f0532-628a-4fa4-a78d-8afb135e2b23" containerName="openshift-config-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.792586 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.792968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-utilities\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.792998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mbfvj\" (UniqueName: \"kubernetes.io/projected/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-kube-api-access-mbfvj\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.793025 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-catalog-content\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.793538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-catalog-content\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.794078 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.294057441 +0000 UTC m=+64.994719259 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.794332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-utilities\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.836253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-xg5mk"] Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.871246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbfvj\" (UniqueName: \"kubernetes.io/projected/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-kube-api-access-mbfvj\") pod \"certified-operators-8ldcx\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.890032 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.895637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-catalog-content\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.895683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b64pb\" (UniqueName: \"kubernetes.io/projected/ad4ba254-1627-4fcc-9353-2a2188dfcc90-kube-api-access-b64pb\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.895715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-utilities\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.895758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.896206 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.396174057 +0000 UTC m=+65.096835875 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.996844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.997003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-catalog-content\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.997039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b64pb\" (UniqueName: \"kubernetes.io/projected/ad4ba254-1627-4fcc-9353-2a2188dfcc90-kube-api-access-b64pb\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.997065 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-utilities\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.998047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-utilities\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: I1121 11:51:45.998520 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-catalog-content\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:45 crc kubenswrapper[4769]: E1121 11:51:45.998585 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.498569439 +0000 UTC m=+65.199231257 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.081356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b64pb\" (UniqueName: \"kubernetes.io/projected/ad4ba254-1627-4fcc-9353-2a2188dfcc90-kube-api-access-b64pb\") pod \"community-operators-xg5mk\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.093331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/revision-pruner-8-crc"] Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.094430 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.095615 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.098120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.098519 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.598501426 +0000 UTC m=+65.299163244 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.100090 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-8-crc"] Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.103801 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.106087 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-5pr6n" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.195734 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:46 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:46 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:46 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.195814 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.198771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.199063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kubelet-dir\") pod \"revision-pruner-8-crc\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.199112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kube-api-access\") pod \"revision-pruner-8-crc\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.199261 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.699246024 +0000 UTC m=+65.399907832 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.300410 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.300850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kubelet-dir\") pod \"revision-pruner-8-crc\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.300924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kube-api-access\") pod \"revision-pruner-8-crc\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.301559 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.801544954 +0000 UTC m=+65.502206772 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.301614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kubelet-dir\") pod \"revision-pruner-8-crc\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.322982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64jk8" event={"ID":"e18361a9-a58b-479a-9eb3-81ea8bab35c9","Type":"ContainerStarted","Data":"1fad7e51e7996b7ec1c89655c90c7144ba84f831beee64fe554d36cea9034bd0"} Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.325667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/revision-pruner-9-crc" event={"ID":"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8","Type":"ContainerStarted","Data":"09f066386d32584fa4edd7aa2a8e1383e53938b8f67f245c6155dbe5726022a9"} Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.384933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kube-api-access\") pod \"revision-pruner-8-crc\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.393518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-5qxd8"] Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.407642 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-64jk8" podStartSLOduration=36.407616056 podStartE2EDuration="36.407616056s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:46.405794397 +0000 UTC m=+65.106456215" watchObservedRunningTime="2025-11-21 11:51:46.407616056 +0000 UTC m=+65.108277874" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.411010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.412551 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:46.912528419 +0000 UTC m=+65.613190237 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: W1121 11:51:46.417171 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea4516e_4916_48c4_9464_95603adf2b8a.slice/crio-7ef7d6766f551a5160d02c097bb0849efc94982494a9c2f4988a19280cdbde79 WatchSource:0}: Error finding container 7ef7d6766f551a5160d02c097bb0849efc94982494a9c2f4988a19280cdbde79: Status 404 returned error can't find the container with id 7ef7d6766f551a5160d02c097bb0849efc94982494a9c2f4988a19280cdbde79 Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.418822 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.437747 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/revision-pruner-9-crc" podStartSLOduration=2.4377107479999998 podStartE2EDuration="2.437710748s" podCreationTimestamp="2025-11-21 11:51:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:46.435713604 +0000 UTC m=+65.136375432" watchObservedRunningTime="2025-11-21 11:51:46.437710748 +0000 UTC m=+65.138372566" Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.513287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.513826 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.013809341 +0000 UTC m=+65.714471159 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.624441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.624971 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.124942169 +0000 UTC m=+65.825603977 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.625322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.625947 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.125928375 +0000 UTC m=+65.826590193 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.628695 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-z7px2"] Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.726728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.727035 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.227021183 +0000 UTC m=+65.927682991 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.790142 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-8ldcx"] Nov 21 11:51:46 crc kubenswrapper[4769]: W1121 11:51:46.819475 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf97f97_a786_49a8_8ed8_c209cb9b1c08.slice/crio-52e46ccd7c8f3dcf7ec325367452b86b10ff95efb71582232ab8d5e5a114f4f9 WatchSource:0}: Error finding container 52e46ccd7c8f3dcf7ec325367452b86b10ff95efb71582232ab8d5e5a114f4f9: Status 404 returned error can't find the container with id 52e46ccd7c8f3dcf7ec325367452b86b10ff95efb71582232ab8d5e5a114f4f9 Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.828942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.829266 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.329254661 +0000 UTC m=+66.029916469 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.931797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:46 crc kubenswrapper[4769]: E1121 11:51:46.932287 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.432267941 +0000 UTC m=+66.132929759 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:46 crc kubenswrapper[4769]: I1121 11:51:46.957594 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-xg5mk"] Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.033361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.033672 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.533660196 +0000 UTC m=+66.234322014 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.135268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.135725 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.6357017 +0000 UTC m=+66.336363518 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.141157 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-8-crc"] Nov 21 11:51:47 crc kubenswrapper[4769]: W1121 11:51:47.151801 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd3cdd0b7_024c_47b8_a4bf_e29a2bef8128.slice/crio-bc125245329f8e9dc06a796b7d6f478830cdd2fe2d3915be2704d46a30625a22 WatchSource:0}: Error finding container bc125245329f8e9dc06a796b7d6f478830cdd2fe2d3915be2704d46a30625a22: Status 404 returned error can't find the container with id bc125245329f8e9dc06a796b7d6f478830cdd2fe2d3915be2704d46a30625a22 Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.160652 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.175405 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:47 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:47 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:47 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.175484 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.236298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-config-volume\") pod \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.236437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkwvb\" (UniqueName: \"kubernetes.io/projected/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-kube-api-access-rkwvb\") pod \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.236640 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-secret-volume\") pod \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\" (UID: \"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a\") " Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.236928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.237361 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.737343182 +0000 UTC m=+66.438005000 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.238706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-config-volume" (OuterVolumeSpecName: "config-volume") pod "1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" (UID: "1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.246652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" (UID: "1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.267326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-kube-api-access-rkwvb" (OuterVolumeSpecName: "kube-api-access-rkwvb") pod "1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" (UID: "1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a"). InnerVolumeSpecName "kube-api-access-rkwvb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.333379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" event={"ID":"1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a","Type":"ContainerDied","Data":"17a31553ff2c5f596f277d3eaf59465ad743fbb2bf035cfa60cf1fe9df2edb89"} Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.333423 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17a31553ff2c5f596f277d3eaf59465ad743fbb2bf035cfa60cf1fe9df2edb89" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.333393 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.337141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerStarted","Data":"52e46ccd7c8f3dcf7ec325367452b86b10ff95efb71582232ab8d5e5a114f4f9"} Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.337951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.338158 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.838128741 +0000 UTC m=+66.538790559 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.338272 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.338310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerStarted","Data":"41976eeaf3cc9ad430a7cac85638d9486ed595cae026bbce18f019e6f400f3dc"} Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.338332 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.338347 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rkwvb\" (UniqueName: \"kubernetes.io/projected/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-kube-api-access-rkwvb\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.338361 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.338707 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.838692867 +0000 UTC m=+66.539354685 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.340351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerStarted","Data":"7ef7d6766f551a5160d02c097bb0849efc94982494a9c2f4988a19280cdbde79"} Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.341359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-8-crc" event={"ID":"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128","Type":"ContainerStarted","Data":"bc125245329f8e9dc06a796b7d6f478830cdd2fe2d3915be2704d46a30625a22"} Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.342140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-xg5mk" event={"ID":"ad4ba254-1627-4fcc-9353-2a2188dfcc90","Type":"ContainerStarted","Data":"a20ffacb3ed6e9cd98ab81b864f794f7e745a055de8903398ea4936e6010358d"} Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.347523 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-p6wjz"] Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.347756 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" containerName="collect-profiles" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.347774 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" containerName="collect-profiles" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.347883 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" containerName="collect-profiles" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.348663 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.350896 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-x2ctb" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.351275 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-p6wjz"] Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.439933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.440129 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.940106863 +0000 UTC m=+66.640768681 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.440182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.440234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-utilities\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.440350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6w6d\" (UniqueName: \"kubernetes.io/projected/dda8d6e2-0463-4846-b24e-1eef19c5cef9-kube-api-access-n6w6d\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.440456 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:47.940444042 +0000 UTC m=+66.641105860 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.440487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-catalog-content\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.541687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.541900 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.041862308 +0000 UTC m=+66.742524126 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.541976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.542010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-utilities\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.542057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6w6d\" (UniqueName: \"kubernetes.io/projected/dda8d6e2-0463-4846-b24e-1eef19c5cef9-kube-api-access-n6w6d\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.542105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-catalog-content\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.542338 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.042329191 +0000 UTC m=+66.742990999 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.542565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-utilities\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.542660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-catalog-content\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.563054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6w6d\" (UniqueName: \"kubernetes.io/projected/dda8d6e2-0463-4846-b24e-1eef19c5cef9-kube-api-access-n6w6d\") pod \"redhat-marketplace-p6wjz\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.643420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.643570 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.143546102 +0000 UTC m=+66.844207920 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.643994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.644280 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.144271762 +0000 UTC m=+66.844933580 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.680446 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.726692 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-hp82p"] Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.727987 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.745307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.745451 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-hp82p"] Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.745652 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.245626416 +0000 UTC m=+66.946288234 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.745992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.746461 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.246441778 +0000 UTC m=+66.947103606 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.759856 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-7777fb866f-9r5br" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.847072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.847256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bfkl\" (UniqueName: \"kubernetes.io/projected/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-kube-api-access-5bfkl\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.847293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-utilities\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.847390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-catalog-content\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.847485 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.347469834 +0000 UTC m=+67.048131652 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.916298 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-p6wjz"] Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.949502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:47 crc kubenswrapper[4769]: E1121 11:51:47.949556 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.449511517 +0000 UTC m=+67.150173335 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.949635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-catalog-content\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.949712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5bfkl\" (UniqueName: \"kubernetes.io/projected/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-kube-api-access-5bfkl\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.949752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-utilities\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.950137 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-catalog-content\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.950468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-utilities\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:47 crc kubenswrapper[4769]: I1121 11:51:47.973541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bfkl\" (UniqueName: \"kubernetes.io/projected/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-kube-api-access-5bfkl\") pod \"redhat-marketplace-hp82p\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.051706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.052260 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.552235339 +0000 UTC m=+67.252897147 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.060738 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.155482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.155907 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.655893776 +0000 UTC m=+67.356555594 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.171111 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:48 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:48 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:48 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.171168 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.258113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.258351 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.758289229 +0000 UTC m=+67.458951047 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.258508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.258903 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.758895305 +0000 UTC m=+67.459557113 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.322306 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-bsmrv"] Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.323601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.327724 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-ct8rh" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.337925 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-bsmrv"] Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.352483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerStarted","Data":"8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0"} Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.354736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerStarted","Data":"8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486"} Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.358269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p6wjz" event={"ID":"dda8d6e2-0463-4846-b24e-1eef19c5cef9","Type":"ContainerStarted","Data":"bd139d290e5db966f6a8c19836da5db6a2313932a67cd4fae1f4e4ac0f606d6e"} Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.359318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.359621 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.859604812 +0000 UTC m=+67.560266630 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.362126 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8" containerID="09f066386d32584fa4edd7aa2a8e1383e53938b8f67f245c6155dbe5726022a9" exitCode=0 Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.362257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/revision-pruner-9-crc" event={"ID":"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8","Type":"ContainerDied","Data":"09f066386d32584fa4edd7aa2a8e1383e53938b8f67f245c6155dbe5726022a9"} Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.365781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerStarted","Data":"d71e3b8e54a7c449d164ba480f925da2514d28544c85550b99c7077a87e709f8"} Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.447541 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-hp82p"] Nov 21 11:51:48 crc kubenswrapper[4769]: W1121 11:51:48.455573 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f6ac60_f039_44aa_a5c4_f85b4b8d8bb2.slice/crio-a4be47dd93939a21ebbc1e6bdff8313c3431282127a2a3ff65c29787e9aa8333 WatchSource:0}: Error finding container a4be47dd93939a21ebbc1e6bdff8313c3431282127a2a3ff65c29787e9aa8333: Status 404 returned error can't find the container with id a4be47dd93939a21ebbc1e6bdff8313c3431282127a2a3ff65c29787e9aa8333 Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.460759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-catalog-content\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.460851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-utilities\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.460888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gfl\" (UniqueName: \"kubernetes.io/projected/ce51b215-4923-4c0e-8a29-fe6af3a303d4-kube-api-access-j2gfl\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.460923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.461909 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:48.961874582 +0000 UTC m=+67.662536440 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.520656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.520718 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.522446 4769 patch_prober.go:28] interesting pod/apiserver-76f77b778f-m7dv8 container/openshift-apiserver namespace/openshift-apiserver: Startup probe status=failure output="Get \"https://10.217.0.7:8443/livez\": dial tcp 10.217.0.7:8443: connect: connection refused" start-of-body= Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.522499 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" podUID="9b4852c7-e609-43fd-83b4-6c57ced3cab8" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.217.0.7:8443/livez\": dial tcp 10.217.0.7:8443: connect: connection refused" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.563046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.563209 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.063160684 +0000 UTC m=+67.763822512 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.563360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-catalog-content\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.563447 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-utilities\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.563497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gfl\" (UniqueName: \"kubernetes.io/projected/ce51b215-4923-4c0e-8a29-fe6af3a303d4-kube-api-access-j2gfl\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.563533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.563883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-catalog-content\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.563922 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.063903795 +0000 UTC m=+67.764565623 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.564327 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-utilities\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.583832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gfl\" (UniqueName: \"kubernetes.io/projected/ce51b215-4923-4c0e-8a29-fe6af3a303d4-kube-api-access-j2gfl\") pod \"redhat-operators-bsmrv\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.603280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.611364 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-7bbb656c7d-9nmkb" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.642597 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.665199 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.665316 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.16529145 +0000 UTC m=+67.865953268 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.665583 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.665941 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.165906047 +0000 UTC m=+67.866567855 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.735522 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-2vwvq"] Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.736507 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.751511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-2vwvq"] Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.766764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.767762 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.267747404 +0000 UTC m=+67.968409222 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.868871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.868934 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-utilities\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.868963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z5gh\" (UniqueName: \"kubernetes.io/projected/b8d840b3-3cff-4982-b862-653d85206551-kube-api-access-6z5gh\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.868993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-catalog-content\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.869300 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.369287664 +0000 UTC m=+68.069949472 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.908256 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xxl8f" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.971528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.971658 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.471639496 +0000 UTC m=+68.172301314 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.972002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.972057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-utilities\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.972159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6z5gh\" (UniqueName: \"kubernetes.io/projected/b8d840b3-3cff-4982-b862-653d85206551-kube-api-access-6z5gh\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: E1121 11:51:48.972353 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.472345145 +0000 UTC m=+68.173006963 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.972376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-catalog-content\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.972506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-utilities\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.972791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-catalog-content\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:48 crc kubenswrapper[4769]: I1121 11:51:48.997977 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-bsmrv"] Nov 21 11:51:49 crc kubenswrapper[4769]: W1121 11:51:49.009278 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce51b215_4923_4c0e_8a29_fe6af3a303d4.slice/crio-3006846c423f24aad95e416783daadbb45211848631c8fc4f7e63524d7705280 WatchSource:0}: Error finding container 3006846c423f24aad95e416783daadbb45211848631c8fc4f7e63524d7705280: Status 404 returned error can't find the container with id 3006846c423f24aad95e416783daadbb45211848631c8fc4f7e63524d7705280 Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.016425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z5gh\" (UniqueName: \"kubernetes.io/projected/b8d840b3-3cff-4982-b862-653d85206551-kube-api-access-6z5gh\") pod \"redhat-operators-2vwvq\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.058902 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.074041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.074791 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.574757838 +0000 UTC m=+68.275419696 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.171316 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:49 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:49 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:49 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.171392 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.175963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.176442 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.676420761 +0000 UTC m=+68.377082579 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.270626 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-2vwvq"] Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.278603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.278920 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.778881646 +0000 UTC m=+68.479543464 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: W1121 11:51:49.280147 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d840b3_3cff_4982_b862_653d85206551.slice/crio-7073fc1cfce942eb3f97cbaa664d009fd2cffa59377689fd78d92c566e1fd332 WatchSource:0}: Error finding container 7073fc1cfce942eb3f97cbaa664d009fd2cffa59377689fd78d92c566e1fd332: Status 404 returned error can't find the container with id 7073fc1cfce942eb3f97cbaa664d009fd2cffa59377689fd78d92c566e1fd332 Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.280304 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.281046 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.781029674 +0000 UTC m=+68.481691492 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.374673 4769 generic.go:334] "Generic (PLEG): container finished" podID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerID="8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0" exitCode=0 Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.374759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerDied","Data":"8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.377849 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.378376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-hp82p" event={"ID":"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2","Type":"ContainerStarted","Data":"a4be47dd93939a21ebbc1e6bdff8313c3431282127a2a3ff65c29787e9aa8333"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.380773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.382482 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.882416079 +0000 UTC m=+68.583077937 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.394456 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerID="8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486" exitCode=0 Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.394604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerDied","Data":"8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.400020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerStarted","Data":"7073fc1cfce942eb3f97cbaa664d009fd2cffa59377689fd78d92c566e1fd332"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.424520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-8-crc" event={"ID":"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128","Type":"ContainerStarted","Data":"f5b4f09e286e9f3c1e4bb56c5a6684a1c570c1e26e589ac5744ce666eeecccc8"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.426720 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerID="2f22abd6184c4c8f5d26d4f7350bae58351006228f49c723404240f54739285c" exitCode=0 Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.426789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-xg5mk" event={"ID":"ad4ba254-1627-4fcc-9353-2a2188dfcc90","Type":"ContainerDied","Data":"2f22abd6184c4c8f5d26d4f7350bae58351006228f49c723404240f54739285c"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.430642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerStarted","Data":"3006846c423f24aad95e416783daadbb45211848631c8fc4f7e63524d7705280"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.436304 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerID="d71e3b8e54a7c449d164ba480f925da2514d28544c85550b99c7077a87e709f8" exitCode=0 Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.437343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerDied","Data":"d71e3b8e54a7c449d164ba480f925da2514d28544c85550b99c7077a87e709f8"} Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.484295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.484664 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:49.984647687 +0000 UTC m=+68.685309505 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.586617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.586814 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.086779903 +0000 UTC m=+68.787441721 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.587058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.588764 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.088740476 +0000 UTC m=+68.789402494 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.688114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.688336 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.188308493 +0000 UTC m=+68.888970311 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.688401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.688768 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.188756085 +0000 UTC m=+68.889417903 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.708944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.789488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.789608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kube-api-access\") pod \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.789662 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kubelet-dir\") pod \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\" (UID: \"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8\") " Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.789819 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.28975941 +0000 UTC m=+68.990421228 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.789856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8" (UID: "8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.789947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.790376 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.290366936 +0000 UTC m=+68.991028754 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.797050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8" (UID: "8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.891378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.891620 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kube-api-access\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.891709 4769 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8-kubelet-dir\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.891710 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.391670059 +0000 UTC m=+69.092331877 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:49 crc kubenswrapper[4769]: I1121 11:51:49.993580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:49 crc kubenswrapper[4769]: E1121 11:51:49.994346 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.494291558 +0000 UTC m=+69.194953416 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.095525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.095812 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.595763936 +0000 UTC m=+69.296425764 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.095923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.096751 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.596721232 +0000 UTC m=+69.297383080 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.170990 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:50 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:50 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:50 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.171063 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.197664 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.197865 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.697837199 +0000 UTC m=+69.398499017 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.198006 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.198346 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.698339003 +0000 UTC m=+69.399000821 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.299487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.299626 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.799606365 +0000 UTC m=+69.500268193 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.299843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.300122 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.800109899 +0000 UTC m=+69.500771717 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.400864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.401023 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.901002661 +0000 UTC m=+69.601664479 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.401330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.401616 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:50.901607927 +0000 UTC m=+69.602269745 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.452724 4769 generic.go:334] "Generic (PLEG): container finished" podID="d3cdd0b7-024c-47b8-a4bf-e29a2bef8128" containerID="f5b4f09e286e9f3c1e4bb56c5a6684a1c570c1e26e589ac5744ce666eeecccc8" exitCode=0 Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.452810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-8-crc" event={"ID":"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128","Type":"ContainerDied","Data":"f5b4f09e286e9f3c1e4bb56c5a6684a1c570c1e26e589ac5744ce666eeecccc8"} Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.455330 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerID="f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6" exitCode=0 Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.455403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerDied","Data":"f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6"} Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.464548 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/revision-pruner-9-crc" Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.465346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/revision-pruner-9-crc" event={"ID":"8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8","Type":"ContainerDied","Data":"0767667ee014b15e43788971df1bd1efd76d9341bc03de98d60ab247edd51cd4"} Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.465381 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0767667ee014b15e43788971df1bd1efd76d9341bc03de98d60ab247edd51cd4" Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.467538 4769 generic.go:334] "Generic (PLEG): container finished" podID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerID="a32bb0edfdd21b08a18489634c9c502d08777b5c39da27770b3493e59280e243" exitCode=0 Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.467582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-hp82p" event={"ID":"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2","Type":"ContainerDied","Data":"a32bb0edfdd21b08a18489634c9c502d08777b5c39da27770b3493e59280e243"} Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.477119 4769 generic.go:334] "Generic (PLEG): container finished" podID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerID="3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae" exitCode=0 Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.477396 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p6wjz" event={"ID":"dda8d6e2-0463-4846-b24e-1eef19c5cef9","Type":"ContainerDied","Data":"3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae"} Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.487938 4769 generic.go:334] "Generic (PLEG): container finished" podID="b8d840b3-3cff-4982-b862-653d85206551" containerID="19d394ecbcff7a34ef6b1c75207e416d9348eaa57436fec60eebac4d21bc95c6" exitCode=0 Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.487991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerDied","Data":"19d394ecbcff7a34ef6b1c75207e416d9348eaa57436fec60eebac4d21bc95c6"} Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.502442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.502617 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.002578872 +0000 UTC m=+69.703240690 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.502836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.503247 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.003226589 +0000 UTC m=+69.703888407 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.604309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.604815 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.104770269 +0000 UTC m=+69.805432097 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.706518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.706855 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.206834163 +0000 UTC m=+69.907495981 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.807082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.807326 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.307282733 +0000 UTC m=+70.007944551 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.807451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.807767 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.307748825 +0000 UTC m=+70.008410643 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:50 crc kubenswrapper[4769]: I1121 11:51:50.908893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:50 crc kubenswrapper[4769]: E1121 11:51:50.909233 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.409217293 +0000 UTC m=+70.109879111 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.011007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.011361 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.511346179 +0000 UTC m=+70.212007997 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.112484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.112880 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.612862288 +0000 UTC m=+70.313524106 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.169545 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:51 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:51 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:51 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.169602 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.214240 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.714223013 +0000 UTC m=+70.414884831 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.214396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.316986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.317641 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.817610602 +0000 UTC m=+70.518272420 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.422068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.422457 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:51.922445721 +0000 UTC m=+70.623107539 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.497787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" event={"ID":"d980fc96-9282-4f81-8bea-57d074eb8b05","Type":"ContainerStarted","Data":"e6f51dad9f434ca120adf27497efaf7840c004ea55bfe93191d37713ef1cce2e"} Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.523363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.523699 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.023620781 +0000 UTC m=+70.724282599 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.523824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.524276 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.024266708 +0000 UTC m=+70.724928526 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.625621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.626175 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.126150717 +0000 UTC m=+70.826812535 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.727331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.727687 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.227675906 +0000 UTC m=+70.928337724 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.837421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.838322 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.338286811 +0000 UTC m=+71.038948649 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.878005 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:51 crc kubenswrapper[4769]: I1121 11:51:51.939809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:51 crc kubenswrapper[4769]: E1121 11:51:51.940240 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.440227231 +0000 UTC m=+71.140889049 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.041345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.041461 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kube-api-access\") pod \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.041584 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.541541035 +0000 UTC m=+71.242202893 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.041679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kubelet-dir\") pod \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\" (UID: \"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128\") " Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.041828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "d3cdd0b7-024c-47b8-a4bf-e29a2bef8128" (UID: "d3cdd0b7-024c-47b8-a4bf-e29a2bef8128"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.042087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.042496 4769 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kubelet-dir\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.042589 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.542554542 +0000 UTC m=+71.243216540 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.069561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "d3cdd0b7-024c-47b8-a4bf-e29a2bef8128" (UID: "d3cdd0b7-024c-47b8-a4bf-e29a2bef8128"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.143700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.144266 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.644248486 +0000 UTC m=+71.344910304 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.144400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.144446 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d3cdd0b7-024c-47b8-a4bf-e29a2bef8128-kube-api-access\") on node \"crc\" DevicePath \"\"" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.144683 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.644675117 +0000 UTC m=+71.345336935 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.171788 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:52 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:52 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:52 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.171934 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.245396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.245786 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.745770455 +0000 UTC m=+71.446432273 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.346851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.347353 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.847326125 +0000 UTC m=+71.547987933 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.448421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.448671 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.948636049 +0000 UTC m=+71.649297867 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.448784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.449202 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:52.949176463 +0000 UTC m=+71.649838281 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.512380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-8-crc" event={"ID":"d3cdd0b7-024c-47b8-a4bf-e29a2bef8128","Type":"ContainerDied","Data":"bc125245329f8e9dc06a796b7d6f478830cdd2fe2d3915be2704d46a30625a22"} Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.512456 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc125245329f8e9dc06a796b7d6f478830cdd2fe2d3915be2704d46a30625a22" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.512538 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-8-crc" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.550570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.550748 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.050724013 +0000 UTC m=+71.751385831 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.550801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.551138 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.051130984 +0000 UTC m=+71.751792802 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.653029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.653237 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.153183158 +0000 UTC m=+71.853844976 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.653398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.653744 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.153725292 +0000 UTC m=+71.854387120 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.754111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.754387 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.254347247 +0000 UTC m=+71.955009055 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.754671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.755693 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.255666033 +0000 UTC m=+71.956327851 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.770451 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.770528 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.771356 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.771429 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.856006 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.355978709 +0000 UTC m=+72.056640527 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.855885 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.856170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.856544 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.356538024 +0000 UTC m=+72.057199842 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.957799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:52 crc kubenswrapper[4769]: E1121 11:51:52.958096 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.458078814 +0000 UTC m=+72.158740622 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:52 crc kubenswrapper[4769]: I1121 11:51:52.997430 4769 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/kubevirt.io.hostpath-provisioner-reg.sock" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.059798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.061989 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.561955237 +0000 UTC m=+72.262617055 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.160896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.161076 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.66104834 +0000 UTC m=+72.361710158 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.161494 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.161835 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.661827211 +0000 UTC m=+72.362489029 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.170961 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:53 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:53 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:53 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.171022 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.262054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.262452 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.762408735 +0000 UTC m=+72.463070553 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.262678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.263345 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.76333601 +0000 UTC m=+72.463997828 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.308985 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-crc"] Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.363238 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.363374 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName:8f668bae-612b-4b75-9490-919e737c6a3b nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.863357709 +0000 UTC m=+72.564019527 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.465115 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.465603 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8 podName: nodeName:}" failed. No retries permitted until 2025-11-21 11:51:53.965586407 +0000 UTC m=+72.666248225 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "image-registry-697d97f7c8-4h62k" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.511341 4769 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/kubevirt.io.hostpath-provisioner-reg.sock","Timestamp":"2025-11-21T11:51:52.997467157Z","Handler":null,"Name":""} Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.518399 4769 csi_plugin.go:100] kubernetes.io/csi: Trying to validate a new CSI Driver with name: kubevirt.io.hostpath-provisioner endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock versions: 1.0.0 Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.518448 4769 csi_plugin.go:113] kubernetes.io/csi: Register new plugin with name: kubevirt.io.hostpath-provisioner at endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.524415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" event={"ID":"d980fc96-9282-4f81-8bea-57d074eb8b05","Type":"ContainerStarted","Data":"d57d7801224740d6c8eebf39dfca4eaf1a0567f76adeae83e11cc78ebcfe2df4"} Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.526377 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.530946 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-76f77b778f-m7dv8" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.564250 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" podStartSLOduration=0.564232369 podStartE2EDuration="564.232369ms" podCreationTimestamp="2025-11-21 11:51:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:53.561753372 +0000 UTC m=+72.262415190" watchObservedRunningTime="2025-11-21 11:51:53.564232369 +0000 UTC m=+72.264894187" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.568042 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"8f668bae-612b-4b75-9490-919e737c6a3b\" (UID: \"8f668bae-612b-4b75-9490-919e737c6a3b\") " Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.573113 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (OuterVolumeSpecName: "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8") pod "8f668bae-612b-4b75-9490-919e737c6a3b" (UID: "8f668bae-612b-4b75-9490-919e737c6a3b"). InnerVolumeSpecName "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8". PluginName "kubernetes.io/csi", VolumeGidValue "" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.670950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.687068 4769 patch_prober.go:28] interesting pod/console-f9d7485db-9vb2t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.217.0.28:8443/health\": dial tcp 10.217.0.28:8443: connect: connection refused" start-of-body= Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.687137 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-f9d7485db-9vb2t" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" probeResult="failure" output="Get \"https://10.217.0.28:8443/health\": dial tcp 10.217.0.28:8443: connect: connection refused" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.772670 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.864310 4769 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Nov 21 11:51:53 crc kubenswrapper[4769]: I1121 11:51:53.864383 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/1f4776af88835e41c12b831b4c9fed40233456d14189815a54dbe7f892fc1983/globalmount\"" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.939228 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.944509 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.948829 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:51:53 crc kubenswrapper[4769]: E1121 11:51:53.948894 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.094609 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.154010 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-6b444d44fb-2k8wt" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.169771 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:54 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:54 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:54 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.169870 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.274519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-697d97f7c8-4h62k\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.389096 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"registry-dockercfg-kzzsd" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.397964 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.536163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" event={"ID":"d980fc96-9282-4f81-8bea-57d074eb8b05","Type":"ContainerStarted","Data":"fb288d810fcc42fefeaded53f8a281f84682617339b11f48dfb8187845f2e7f1"} Nov 21 11:51:54 crc kubenswrapper[4769]: I1121 11:51:54.651041 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-697d97f7c8-4h62k"] Nov 21 11:51:54 crc kubenswrapper[4769]: W1121 11:51:54.668169 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250e4b5d_38a4_4026_bd4e_2532f525067b.slice/crio-e4487849cc339b5622a52d092887233d1773db6fae9e7303111523f939823d61 WatchSource:0}: Error finding container e4487849cc339b5622a52d092887233d1773db6fae9e7303111523f939823d61: Status 404 returned error can't find the container with id e4487849cc339b5622a52d092887233d1773db6fae9e7303111523f939823d61 Nov 21 11:51:55 crc kubenswrapper[4769]: I1121 11:51:55.172418 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:55 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:55 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:55 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:55 crc kubenswrapper[4769]: I1121 11:51:55.172820 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:55 crc kubenswrapper[4769]: I1121 11:51:55.281339 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f668bae-612b-4b75-9490-919e737c6a3b" path="/var/lib/kubelet/pods/8f668bae-612b-4b75-9490-919e737c6a3b/volumes" Nov 21 11:51:55 crc kubenswrapper[4769]: I1121 11:51:55.545601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" event={"ID":"250e4b5d-38a4-4026-bd4e-2532f525067b","Type":"ContainerStarted","Data":"e4487849cc339b5622a52d092887233d1773db6fae9e7303111523f939823d61"} Nov 21 11:51:55 crc kubenswrapper[4769]: I1121 11:51:55.566704 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="hostpath-provisioner/csi-hostpathplugin-zd8jq" podStartSLOduration=24.566685467 podStartE2EDuration="24.566685467s" podCreationTimestamp="2025-11-21 11:51:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:55.562892544 +0000 UTC m=+74.263554362" watchObservedRunningTime="2025-11-21 11:51:55.566685467 +0000 UTC m=+74.267347295" Nov 21 11:51:56 crc kubenswrapper[4769]: I1121 11:51:56.169955 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:56 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:56 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:56 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:56 crc kubenswrapper[4769]: I1121 11:51:56.170017 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:56 crc kubenswrapper[4769]: I1121 11:51:56.562054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" event={"ID":"250e4b5d-38a4-4026-bd4e-2532f525067b","Type":"ContainerStarted","Data":"9f5fb96db9727b03973c0c2989f8d3219bb1302ef29dc531bc64c3768aee71d4"} Nov 21 11:51:56 crc kubenswrapper[4769]: I1121 11:51:56.562431 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:51:56 crc kubenswrapper[4769]: I1121 11:51:56.590928 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" podStartSLOduration=46.59083796 podStartE2EDuration="46.59083796s" podCreationTimestamp="2025-11-21 11:51:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:51:56.588002393 +0000 UTC m=+75.288664221" watchObservedRunningTime="2025-11-21 11:51:56.59083796 +0000 UTC m=+75.291499778" Nov 21 11:51:57 crc kubenswrapper[4769]: I1121 11:51:57.170690 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:57 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:57 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:57 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:57 crc kubenswrapper[4769]: I1121 11:51:57.170752 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:58 crc kubenswrapper[4769]: I1121 11:51:58.171300 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:58 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:58 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:58 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:58 crc kubenswrapper[4769]: I1121 11:51:58.171692 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:51:59 crc kubenswrapper[4769]: I1121 11:51:59.163827 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Nov 21 11:51:59 crc kubenswrapper[4769]: I1121 11:51:59.170424 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:51:59 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:51:59 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:51:59 crc kubenswrapper[4769]: healthz check failed Nov 21 11:51:59 crc kubenswrapper[4769]: I1121 11:51:59.170478 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:52:00 crc kubenswrapper[4769]: I1121 11:52:00.169830 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:52:00 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:52:00 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:52:00 crc kubenswrapper[4769]: healthz check failed Nov 21 11:52:00 crc kubenswrapper[4769]: I1121 11:52:00.169896 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:52:01 crc kubenswrapper[4769]: I1121 11:52:01.175582 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:52:01 crc kubenswrapper[4769]: [-]has-synced failed: reason withheld Nov 21 11:52:01 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:52:01 crc kubenswrapper[4769]: healthz check failed Nov 21 11:52:01 crc kubenswrapper[4769]: I1121 11:52:01.175651 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.169976 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Nov 21 11:52:02 crc kubenswrapper[4769]: [+]has-synced ok Nov 21 11:52:02 crc kubenswrapper[4769]: [+]process-running ok Nov 21 11:52:02 crc kubenswrapper[4769]: healthz check failed Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.170468 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.770642 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.770711 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.771242 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.771266 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.771299 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.771894 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="download-server" containerStatusID={"Type":"cri-o","ID":"f96d25b41787899dcfb58eefeab632ccf0fa6fe18f8620edd12da53c528a709c"} pod="openshift-console/downloads-7954f5f757-74pvb" containerMessage="Container download-server failed liveness probe, will be restarted" Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.771991 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" containerID="cri-o://f96d25b41787899dcfb58eefeab632ccf0fa6fe18f8620edd12da53c528a709c" gracePeriod=2 Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.772528 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:02 crc kubenswrapper[4769]: I1121 11:52:02.772574 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:03 crc kubenswrapper[4769]: I1121 11:52:03.171099 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:52:03 crc kubenswrapper[4769]: I1121 11:52:03.175761 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5444994796-g9x6j" Nov 21 11:52:03 crc kubenswrapper[4769]: I1121 11:52:03.681936 4769 patch_prober.go:28] interesting pod/console-f9d7485db-9vb2t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.217.0.28:8443/health\": dial tcp 10.217.0.28:8443: connect: connection refused" start-of-body= Nov 21 11:52:03 crc kubenswrapper[4769]: I1121 11:52:03.682010 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-f9d7485db-9vb2t" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" probeResult="failure" output="Get \"https://10.217.0.28:8443/health\": dial tcp 10.217.0.28:8443: connect: connection refused" Nov 21 11:52:03 crc kubenswrapper[4769]: E1121 11:52:03.927833 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:03 crc kubenswrapper[4769]: E1121 11:52:03.931872 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:03 crc kubenswrapper[4769]: E1121 11:52:03.934439 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:03 crc kubenswrapper[4769]: E1121 11:52:03.934552 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:52:04 crc kubenswrapper[4769]: I1121 11:52:04.620780 4769 generic.go:334] "Generic (PLEG): container finished" podID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerID="f96d25b41787899dcfb58eefeab632ccf0fa6fe18f8620edd12da53c528a709c" exitCode=0 Nov 21 11:52:04 crc kubenswrapper[4769]: I1121 11:52:04.620869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7954f5f757-74pvb" event={"ID":"44effadb-9e4b-4a98-ba7c-880e36bd66d2","Type":"ContainerDied","Data":"f96d25b41787899dcfb58eefeab632ccf0fa6fe18f8620edd12da53c528a709c"} Nov 21 11:52:12 crc kubenswrapper[4769]: I1121 11:52:12.772298 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:12 crc kubenswrapper[4769]: I1121 11:52:12.772940 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:13 crc kubenswrapper[4769]: I1121 11:52:13.686771 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:52:13 crc kubenswrapper[4769]: I1121 11:52:13.692231 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 11:52:13 crc kubenswrapper[4769]: E1121 11:52:13.926657 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:13 crc kubenswrapper[4769]: E1121 11:52:13.928957 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:13 crc kubenswrapper[4769]: E1121 11:52:13.930640 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:13 crc kubenswrapper[4769]: E1121 11:52:13.930719 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:52:14 crc kubenswrapper[4769]: I1121 11:52:14.156837 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-789f6589d5-58fdn" Nov 21 11:52:14 crc kubenswrapper[4769]: I1121 11:52:14.406986 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:52:16 crc kubenswrapper[4769]: I1121 11:52:16.698463 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-h2c4x_4c9630fd-9719-44c6-b527-a909d4a0ce2b/kube-multus-additional-cni-plugins/0.log" Nov 21 11:52:16 crc kubenswrapper[4769]: I1121 11:52:16.700958 4769 generic.go:334] "Generic (PLEG): container finished" podID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" exitCode=137 Nov 21 11:52:16 crc kubenswrapper[4769]: I1121 11:52:16.701095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" event={"ID":"4c9630fd-9719-44c6-b527-a909d4a0ce2b","Type":"ContainerDied","Data":"dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2"} Nov 21 11:52:17 crc kubenswrapper[4769]: I1121 11:52:17.297772 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-crc"] Nov 21 11:52:19 crc kubenswrapper[4769]: I1121 11:52:19.411760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xd92c" Nov 21 11:52:19 crc kubenswrapper[4769]: I1121 11:52:19.452519 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-crc" podStartSLOduration=2.452500582 podStartE2EDuration="2.452500582s" podCreationTimestamp="2025-11-21 11:52:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:52:19.450993061 +0000 UTC m=+98.151654899" watchObservedRunningTime="2025-11-21 11:52:19.452500582 +0000 UTC m=+98.153162400" Nov 21 11:52:22 crc kubenswrapper[4769]: E1121 11:52:22.308668 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/redhat-marketplace-index:v4.18" Nov 21 11:52:22 crc kubenswrapper[4769]: E1121 11:52:22.309323 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/redhat-marketplace-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-5bfkl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod redhat-marketplace-hp82p_openshift-marketplace(a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:22 crc kubenswrapper[4769]: E1121 11:52:22.310493 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/redhat-marketplace-hp82p" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" Nov 21 11:52:22 crc kubenswrapper[4769]: I1121 11:52:22.773311 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:22 crc kubenswrapper[4769]: I1121 11:52:22.773413 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:23 crc kubenswrapper[4769]: E1121 11:52:23.925926 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:23 crc kubenswrapper[4769]: E1121 11:52:23.926501 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:23 crc kubenswrapper[4769]: E1121 11:52:23.927006 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:23 crc kubenswrapper[4769]: E1121 11:52:23.927072 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:52:24 crc kubenswrapper[4769]: E1121 11:52:24.578733 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.18\\\"\"" pod="openshift-marketplace/redhat-marketplace-hp82p" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" Nov 21 11:52:32 crc kubenswrapper[4769]: E1121 11:52:32.340348 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/community-operator-index:v4.18" Nov 21 11:52:32 crc kubenswrapper[4769]: E1121 11:52:32.341396 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/community-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-b64pb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod community-operators-xg5mk_openshift-marketplace(ad4ba254-1627-4fcc-9353-2a2188dfcc90): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:32 crc kubenswrapper[4769]: E1121 11:52:32.342692 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/community-operators-xg5mk" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" Nov 21 11:52:32 crc kubenswrapper[4769]: I1121 11:52:32.769747 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:32 crc kubenswrapper[4769]: I1121 11:52:32.770069 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:33 crc kubenswrapper[4769]: E1121 11:52:33.925901 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:33 crc kubenswrapper[4769]: E1121 11:52:33.927061 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:33 crc kubenswrapper[4769]: E1121 11:52:33.927507 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:33 crc kubenswrapper[4769]: E1121 11:52:33.927618 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:52:42 crc kubenswrapper[4769]: I1121 11:52:42.770270 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:42 crc kubenswrapper[4769]: I1121 11:52:42.771001 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:43 crc kubenswrapper[4769]: E1121 11:52:43.925636 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:43 crc kubenswrapper[4769]: E1121 11:52:43.926406 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:43 crc kubenswrapper[4769]: E1121 11:52:43.926991 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:43 crc kubenswrapper[4769]: E1121 11:52:43.927068 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:52:47 crc kubenswrapper[4769]: E1121 11:52:47.844077 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/redhat-operator-index:v4.18" Nov 21 11:52:47 crc kubenswrapper[4769]: E1121 11:52:47.844845 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/redhat-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-6z5gh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod redhat-operators-2vwvq_openshift-marketplace(b8d840b3-3cff-4982-b862-653d85206551): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:47 crc kubenswrapper[4769]: E1121 11:52:47.847156 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/redhat-operators-2vwvq" podUID="b8d840b3-3cff-4982-b862-653d85206551" Nov 21 11:52:52 crc kubenswrapper[4769]: I1121 11:52:52.769668 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:52 crc kubenswrapper[4769]: I1121 11:52:52.770059 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.084162 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"\"" pod="openshift-marketplace/redhat-operators-2vwvq" podUID="b8d840b3-3cff-4982-b862-653d85206551" Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.128677 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/redhat-operator-index:v4.18" Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.129154 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/redhat-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-j2gfl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod redhat-operators-bsmrv_openshift-marketplace(ce51b215-4923-4c0e-8a29-fe6af3a303d4): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.130653 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/redhat-operators-bsmrv" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.925350 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.925938 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.926468 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" cmd=["/bin/bash","-c","test -f /ready/ready"] Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.926541 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2 is running failed: container process not found" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:52:53 crc kubenswrapper[4769]: E1121 11:52:53.945544 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/redhat/redhat-operator-index:v4.18\\\"\"" pod="openshift-marketplace/redhat-operators-bsmrv" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.921893 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-h2c4x_4c9630fd-9719-44c6-b527-a909d4a0ce2b/kube-multus-additional-cni-plugins/0.log" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.922379 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.955475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7954f5f757-74pvb" event={"ID":"44effadb-9e4b-4a98-ba7c-880e36bd66d2","Type":"ContainerStarted","Data":"f93987e3610a94cb76d524d3e18bac3bd76ef7a7a7494e40eab41d1498198e5b"} Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.957664 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-h2c4x_4c9630fd-9719-44c6-b527-a909d4a0ce2b/kube-multus-additional-cni-plugins/0.log" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.957711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" event={"ID":"4c9630fd-9719-44c6-b527-a909d4a0ce2b","Type":"ContainerDied","Data":"36049945933e30eceb081c7c73c31037ef6d9a417c23f572a7675be62087a9fb"} Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.957736 4769 scope.go:117] "RemoveContainer" containerID="dfb65c72338d58b6cb77b1e48d01f137c09bb6983f2529c3c24465b29881e7d2" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.957779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-h2c4x" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.996501 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/4c9630fd-9719-44c6-b527-a909d4a0ce2b-ready\") pod \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.996629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/4c9630fd-9719-44c6-b527-a909d4a0ce2b-kube-api-access-fz8xx\") pod \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.996747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9630fd-9719-44c6-b527-a909d4a0ce2b-tuning-conf-dir\") pod \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.996803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist\") pod \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\" (UID: \"4c9630fd-9719-44c6-b527-a909d4a0ce2b\") " Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.997941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4c9630fd-9719-44c6-b527-a909d4a0ce2b-tuning-conf-dir" (OuterVolumeSpecName: "tuning-conf-dir") pod "4c9630fd-9719-44c6-b527-a909d4a0ce2b" (UID: "4c9630fd-9719-44c6-b527-a909d4a0ce2b"). InnerVolumeSpecName "tuning-conf-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.999356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "4c9630fd-9719-44c6-b527-a909d4a0ce2b" (UID: "4c9630fd-9719-44c6-b527-a909d4a0ce2b"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:52:55 crc kubenswrapper[4769]: I1121 11:52:55.999848 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c9630fd-9719-44c6-b527-a909d4a0ce2b-ready" (OuterVolumeSpecName: "ready") pod "4c9630fd-9719-44c6-b527-a909d4a0ce2b" (UID: "4c9630fd-9719-44c6-b527-a909d4a0ce2b"). InnerVolumeSpecName "ready". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.006164 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c9630fd-9719-44c6-b527-a909d4a0ce2b-kube-api-access-fz8xx" (OuterVolumeSpecName: "kube-api-access-fz8xx") pod "4c9630fd-9719-44c6-b527-a909d4a0ce2b" (UID: "4c9630fd-9719-44c6-b527-a909d4a0ce2b"). InnerVolumeSpecName "kube-api-access-fz8xx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.098327 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fz8xx\" (UniqueName: \"kubernetes.io/projected/4c9630fd-9719-44c6-b527-a909d4a0ce2b-kube-api-access-fz8xx\") on node \"crc\" DevicePath \"\"" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.098384 4769 reconciler_common.go:293] "Volume detached for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9630fd-9719-44c6-b527-a909d4a0ce2b-tuning-conf-dir\") on node \"crc\" DevicePath \"\"" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.098398 4769 reconciler_common.go:293] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9630fd-9719-44c6-b527-a909d4a0ce2b-cni-sysctl-allowlist\") on node \"crc\" DevicePath \"\"" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.098410 4769 reconciler_common.go:293] "Volume detached for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/4c9630fd-9719-44c6-b527-a909d4a0ce2b-ready\") on node \"crc\" DevicePath \"\"" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.285748 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-h2c4x"] Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.289548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-h2c4x"] Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.980600 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.981352 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:56 crc kubenswrapper[4769]: I1121 11:52:56.981396 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:57 crc kubenswrapper[4769]: I1121 11:52:57.285502 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" path="/var/lib/kubelet/pods/4c9630fd-9719-44c6-b527-a909d4a0ce2b/volumes" Nov 21 11:52:57 crc kubenswrapper[4769]: E1121 11:52:57.331874 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/certified-operator-index:v4.18" Nov 21 11:52:57 crc kubenswrapper[4769]: E1121 11:52:57.332083 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/certified-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mbfvj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod certified-operators-8ldcx_openshift-marketplace(2bf97f97-a786-49a8-8ed8-c209cb9b1c08): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:57 crc kubenswrapper[4769]: E1121 11:52:57.333778 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/certified-operators-8ldcx" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" Nov 21 11:52:57 crc kubenswrapper[4769]: I1121 11:52:57.985413 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:52:57 crc kubenswrapper[4769]: I1121 11:52:57.985558 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:52:57 crc kubenswrapper[4769]: E1121 11:52:57.986182 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"\"" pod="openshift-marketplace/certified-operators-8ldcx" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" Nov 21 11:52:58 crc kubenswrapper[4769]: E1121 11:52:58.164868 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/community-operator-index:v4.18" Nov 21 11:52:58 crc kubenswrapper[4769]: E1121 11:52:58.165090 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/community-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lnbrg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod community-operators-z7px2_openshift-marketplace(024c57c4-ef5a-4c59-b67d-d9340284d9b1): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:58 crc kubenswrapper[4769]: E1121 11:52:58.166290 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/community-operators-z7px2" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" Nov 21 11:52:58 crc kubenswrapper[4769]: E1121 11:52:58.169995 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/certified-operator-index:v4.18" Nov 21 11:52:58 crc kubenswrapper[4769]: E1121 11:52:58.170248 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/certified-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-q4fh8,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod certified-operators-5qxd8_openshift-marketplace(3ea4516e-4916-48c4-9464-95603adf2b8a): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:52:58 crc kubenswrapper[4769]: E1121 11:52:58.171460 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/certified-operators-5qxd8" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" Nov 21 11:53:00 crc kubenswrapper[4769]: E1121 11:53:00.570823 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.redhat.io/redhat/redhat-marketplace-index:v4.18" Nov 21 11:53:00 crc kubenswrapper[4769]: E1121 11:53:00.572883 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/redhat-marketplace-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-n6w6d,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod redhat-marketplace-p6wjz_openshift-marketplace(dda8d6e2-0463-4846-b24e-1eef19c5cef9): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 11:53:00 crc kubenswrapper[4769]: E1121 11:53:00.574427 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openshift-marketplace/redhat-marketplace-p6wjz" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" Nov 21 11:53:02 crc kubenswrapper[4769]: I1121 11:53:02.769508 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:02 crc kubenswrapper[4769]: I1121 11:53:02.770117 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:02 crc kubenswrapper[4769]: I1121 11:53:02.769554 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:02 crc kubenswrapper[4769]: I1121 11:53:02.770312 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:11 crc kubenswrapper[4769]: I1121 11:53:11.325744 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 11:53:11 crc kubenswrapper[4769]: I1121 11:53:11.326505 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 11:53:12 crc kubenswrapper[4769]: I1121 11:53:12.770021 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:12 crc kubenswrapper[4769]: I1121 11:53:12.770105 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:12 crc kubenswrapper[4769]: I1121 11:53:12.770120 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:12 crc kubenswrapper[4769]: I1121 11:53:12.770202 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.770309 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.771417 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.771478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.770497 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.771630 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.772360 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="download-server" containerStatusID={"Type":"cri-o","ID":"f93987e3610a94cb76d524d3e18bac3bd76ef7a7a7494e40eab41d1498198e5b"} pod="openshift-console/downloads-7954f5f757-74pvb" containerMessage="Container download-server failed liveness probe, will be restarted" Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.772410 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" containerID="cri-o://f93987e3610a94cb76d524d3e18bac3bd76ef7a7a7494e40eab41d1498198e5b" gracePeriod=2 Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.773425 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:22 crc kubenswrapper[4769]: I1121 11:53:22.773467 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:25 crc kubenswrapper[4769]: I1121 11:53:25.184509 4769 generic.go:334] "Generic (PLEG): container finished" podID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerID="f93987e3610a94cb76d524d3e18bac3bd76ef7a7a7494e40eab41d1498198e5b" exitCode=0 Nov 21 11:53:25 crc kubenswrapper[4769]: I1121 11:53:25.184605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7954f5f757-74pvb" event={"ID":"44effadb-9e4b-4a98-ba7c-880e36bd66d2","Type":"ContainerDied","Data":"f93987e3610a94cb76d524d3e18bac3bd76ef7a7a7494e40eab41d1498198e5b"} Nov 21 11:53:25 crc kubenswrapper[4769]: I1121 11:53:25.185120 4769 scope.go:117] "RemoveContainer" containerID="f96d25b41787899dcfb58eefeab632ccf0fa6fe18f8620edd12da53c528a709c" Nov 21 11:53:32 crc kubenswrapper[4769]: I1121 11:53:32.770158 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:32 crc kubenswrapper[4769]: I1121 11:53:32.771157 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.258384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7954f5f757-74pvb" event={"ID":"44effadb-9e4b-4a98-ba7c-880e36bd66d2","Type":"ContainerStarted","Data":"af71dc15bca28dc2d62cee8870b87f0944ef01fcf1867adcfc07b51511584514"} Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.258977 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.259467 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.259536 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.265073 4769 generic.go:334] "Generic (PLEG): container finished" podID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerID="888f6e10d6beeec0035598966afbb5bcf6565265f5ef3b1e4324217640a25c55" exitCode=0 Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.265144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-hp82p" event={"ID":"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2","Type":"ContainerDied","Data":"888f6e10d6beeec0035598966afbb5bcf6565265f5ef3b1e4324217640a25c55"} Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.268237 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerID="335d77be1009125cd5c7338915424190f872f8b1c949420e3338b45772dc1aa3" exitCode=0 Nov 21 11:53:34 crc kubenswrapper[4769]: I1121 11:53:34.268283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-xg5mk" event={"ID":"ad4ba254-1627-4fcc-9353-2a2188dfcc90","Type":"ContainerDied","Data":"335d77be1009125cd5c7338915424190f872f8b1c949420e3338b45772dc1aa3"} Nov 21 11:53:35 crc kubenswrapper[4769]: I1121 11:53:35.276450 4769 patch_prober.go:28] interesting pod/downloads-7954f5f757-74pvb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" start-of-body= Nov 21 11:53:35 crc kubenswrapper[4769]: I1121 11:53:35.277230 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7954f5f757-74pvb" podUID="44effadb-9e4b-4a98-ba7c-880e36bd66d2" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.10:8080/\": dial tcp 10.217.0.10:8080: connect: connection refused" Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.284809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerStarted","Data":"502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.286474 4769 generic.go:334] "Generic (PLEG): container finished" podID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerID="2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4" exitCode=0 Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.286546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p6wjz" event={"ID":"dda8d6e2-0463-4846-b24e-1eef19c5cef9","Type":"ContainerDied","Data":"2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.288438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerStarted","Data":"08bed6b87cf922ede62c30dbbe212e0ce5d7da3242c2bcdd1a6555708e61f7a6"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.292361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-xg5mk" event={"ID":"ad4ba254-1627-4fcc-9353-2a2188dfcc90","Type":"ContainerStarted","Data":"5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.301892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerStarted","Data":"c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.305411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerStarted","Data":"5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.311830 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerID="a72cf238ab9be27d70c9c1720e29171f00cf2517aaa3c607dd924a00b06d0a93" exitCode=0 Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.311898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerDied","Data":"a72cf238ab9be27d70c9c1720e29171f00cf2517aaa3c607dd924a00b06d0a93"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.316545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-hp82p" event={"ID":"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2","Type":"ContainerStarted","Data":"d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6"} Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.370437 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-xg5mk" podStartSLOduration=6.796406171 podStartE2EDuration="1m52.370413593s" podCreationTimestamp="2025-11-21 11:51:45 +0000 UTC" firstStartedPulling="2025-11-21 11:51:50.493393204 +0000 UTC m=+69.194055022" lastFinishedPulling="2025-11-21 11:53:36.067400626 +0000 UTC m=+174.768062444" observedRunningTime="2025-11-21 11:53:37.343758884 +0000 UTC m=+176.044420702" watchObservedRunningTime="2025-11-21 11:53:37.370413593 +0000 UTC m=+176.071075411" Nov 21 11:53:37 crc kubenswrapper[4769]: I1121 11:53:37.457616 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-hp82p" podStartSLOduration=4.865821733 podStartE2EDuration="1m50.457588255s" podCreationTimestamp="2025-11-21 11:51:47 +0000 UTC" firstStartedPulling="2025-11-21 11:51:50.477258908 +0000 UTC m=+69.177920726" lastFinishedPulling="2025-11-21 11:53:36.06902543 +0000 UTC m=+174.769687248" observedRunningTime="2025-11-21 11:53:37.455804397 +0000 UTC m=+176.156466245" watchObservedRunningTime="2025-11-21 11:53:37.457588255 +0000 UTC m=+176.158250063" Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.061800 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.062370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.326243 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerID="502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa" exitCode=0 Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.326440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerDied","Data":"502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa"} Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.328741 4769 generic.go:334] "Generic (PLEG): container finished" podID="b8d840b3-3cff-4982-b862-653d85206551" containerID="08bed6b87cf922ede62c30dbbe212e0ce5d7da3242c2bcdd1a6555708e61f7a6" exitCode=0 Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.328792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerDied","Data":"08bed6b87cf922ede62c30dbbe212e0ce5d7da3242c2bcdd1a6555708e61f7a6"} Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.331542 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerID="c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf" exitCode=0 Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.331612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerDied","Data":"c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf"} Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.337946 4769 generic.go:334] "Generic (PLEG): container finished" podID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerID="5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970" exitCode=0 Nov 21 11:53:38 crc kubenswrapper[4769]: I1121 11:53:38.338090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerDied","Data":"5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970"} Nov 21 11:53:39 crc kubenswrapper[4769]: I1121 11:53:39.522081 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-marketplace-hp82p" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="registry-server" probeResult="failure" output=< Nov 21 11:53:39 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 11:53:39 crc kubenswrapper[4769]: > Nov 21 11:53:41 crc kubenswrapper[4769]: I1121 11:53:41.325497 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 11:53:41 crc kubenswrapper[4769]: I1121 11:53:41.325600 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 11:53:42 crc kubenswrapper[4769]: I1121 11:53:42.784869 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7954f5f757-74pvb" Nov 21 11:53:46 crc kubenswrapper[4769]: I1121 11:53:46.096806 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:53:46 crc kubenswrapper[4769]: I1121 11:53:46.097286 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:53:46 crc kubenswrapper[4769]: I1121 11:53:46.194277 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:53:46 crc kubenswrapper[4769]: I1121 11:53:46.460468 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:53:46 crc kubenswrapper[4769]: I1121 11:53:46.812296 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-xg5mk"] Nov 21 11:53:48 crc kubenswrapper[4769]: I1121 11:53:48.108809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:53:48 crc kubenswrapper[4769]: I1121 11:53:48.144923 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:53:48 crc kubenswrapper[4769]: I1121 11:53:48.400219 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-xg5mk" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="registry-server" containerID="cri-o://5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639" gracePeriod=2 Nov 21 11:53:50 crc kubenswrapper[4769]: I1121 11:53:50.011029 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-hp82p"] Nov 21 11:53:50 crc kubenswrapper[4769]: I1121 11:53:50.011582 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-hp82p" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="registry-server" containerID="cri-o://d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6" gracePeriod=2 Nov 21 11:53:50 crc kubenswrapper[4769]: I1121 11:53:50.413158 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerID="5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639" exitCode=0 Nov 21 11:53:50 crc kubenswrapper[4769]: I1121 11:53:50.413260 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-xg5mk" event={"ID":"ad4ba254-1627-4fcc-9353-2a2188dfcc90","Type":"ContainerDied","Data":"5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639"} Nov 21 11:53:52 crc kubenswrapper[4769]: I1121 11:53:52.429452 4769 generic.go:334] "Generic (PLEG): container finished" podID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerID="d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6" exitCode=0 Nov 21 11:53:52 crc kubenswrapper[4769]: I1121 11:53:52.429981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-hp82p" event={"ID":"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2","Type":"ContainerDied","Data":"d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6"} Nov 21 11:53:56 crc kubenswrapper[4769]: E1121 11:53:56.097742 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639 is running failed: container process not found" containerID="5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 11:53:56 crc kubenswrapper[4769]: E1121 11:53:56.098709 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639 is running failed: container process not found" containerID="5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 11:53:56 crc kubenswrapper[4769]: E1121 11:53:56.099462 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639 is running failed: container process not found" containerID="5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 11:53:56 crc kubenswrapper[4769]: E1121 11:53:56.099551 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639 is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-xg5mk" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="registry-server" Nov 21 11:53:58 crc kubenswrapper[4769]: E1121 11:53:58.062770 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6 is running failed: container process not found" containerID="d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 11:53:58 crc kubenswrapper[4769]: E1121 11:53:58.064225 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6 is running failed: container process not found" containerID="d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 11:53:58 crc kubenswrapper[4769]: E1121 11:53:58.064851 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6 is running failed: container process not found" containerID="d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 11:53:58 crc kubenswrapper[4769]: E1121 11:53:58.064927 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6 is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/redhat-marketplace-hp82p" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="registry-server" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.024039 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.029787 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.141670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bfkl\" (UniqueName: \"kubernetes.io/projected/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-kube-api-access-5bfkl\") pod \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.141759 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-catalog-content\") pod \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.141865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b64pb\" (UniqueName: \"kubernetes.io/projected/ad4ba254-1627-4fcc-9353-2a2188dfcc90-kube-api-access-b64pb\") pod \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.141906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-utilities\") pod \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\" (UID: \"ad4ba254-1627-4fcc-9353-2a2188dfcc90\") " Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.141966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-utilities\") pod \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.142098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-catalog-content\") pod \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\" (UID: \"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2\") " Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.142751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-utilities" (OuterVolumeSpecName: "utilities") pod "ad4ba254-1627-4fcc-9353-2a2188dfcc90" (UID: "ad4ba254-1627-4fcc-9353-2a2188dfcc90"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.142934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-utilities" (OuterVolumeSpecName: "utilities") pod "a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" (UID: "a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.151275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4ba254-1627-4fcc-9353-2a2188dfcc90-kube-api-access-b64pb" (OuterVolumeSpecName: "kube-api-access-b64pb") pod "ad4ba254-1627-4fcc-9353-2a2188dfcc90" (UID: "ad4ba254-1627-4fcc-9353-2a2188dfcc90"). InnerVolumeSpecName "kube-api-access-b64pb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.151584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-kube-api-access-5bfkl" (OuterVolumeSpecName: "kube-api-access-5bfkl") pod "a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" (UID: "a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2"). InnerVolumeSpecName "kube-api-access-5bfkl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.176447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" (UID: "a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.243715 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.243767 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5bfkl\" (UniqueName: \"kubernetes.io/projected/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-kube-api-access-5bfkl\") on node \"crc\" DevicePath \"\"" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.243788 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b64pb\" (UniqueName: \"kubernetes.io/projected/ad4ba254-1627-4fcc-9353-2a2188dfcc90-kube-api-access-b64pb\") on node \"crc\" DevicePath \"\"" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.243806 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.243821 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.327060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ad4ba254-1627-4fcc-9353-2a2188dfcc90" (UID: "ad4ba254-1627-4fcc-9353-2a2188dfcc90"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.345536 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ad4ba254-1627-4fcc-9353-2a2188dfcc90-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.480625 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-hp82p" event={"ID":"a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2","Type":"ContainerDied","Data":"a4be47dd93939a21ebbc1e6bdff8313c3431282127a2a3ff65c29787e9aa8333"} Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.480708 4769 scope.go:117] "RemoveContainer" containerID="d59b0dde4ec79d82843461b5a0df91fdf4baefbf41de054692454d8eceaec9a6" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.480857 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-hp82p" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.485914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-xg5mk" event={"ID":"ad4ba254-1627-4fcc-9353-2a2188dfcc90","Type":"ContainerDied","Data":"a20ffacb3ed6e9cd98ab81b864f794f7e745a055de8903398ea4936e6010358d"} Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.486148 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-xg5mk" Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.519495 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-hp82p"] Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.526746 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-hp82p"] Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.541312 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-xg5mk"] Nov 21 11:53:59 crc kubenswrapper[4769]: I1121 11:53:59.544982 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-xg5mk"] Nov 21 11:54:01 crc kubenswrapper[4769]: I1121 11:54:01.282555 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" path="/var/lib/kubelet/pods/a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2/volumes" Nov 21 11:54:01 crc kubenswrapper[4769]: I1121 11:54:01.284651 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" path="/var/lib/kubelet/pods/ad4ba254-1627-4fcc-9353-2a2188dfcc90/volumes" Nov 21 11:54:04 crc kubenswrapper[4769]: I1121 11:54:04.036977 4769 scope.go:117] "RemoveContainer" containerID="888f6e10d6beeec0035598966afbb5bcf6565265f5ef3b1e4324217640a25c55" Nov 21 11:54:11 crc kubenswrapper[4769]: I1121 11:54:11.325597 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 11:54:11 crc kubenswrapper[4769]: I1121 11:54:11.326556 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 11:54:11 crc kubenswrapper[4769]: I1121 11:54:11.326638 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:54:11 crc kubenswrapper[4769]: I1121 11:54:11.327750 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"097a41de05c8052f314ccd1f8c67cc1f8da280b99d567fe1bb61400ff6720929"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 11:54:11 crc kubenswrapper[4769]: I1121 11:54:11.327856 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://097a41de05c8052f314ccd1f8c67cc1f8da280b99d567fe1bb61400ff6720929" gracePeriod=600 Nov 21 11:54:12 crc kubenswrapper[4769]: I1121 11:54:12.600828 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="097a41de05c8052f314ccd1f8c67cc1f8da280b99d567fe1bb61400ff6720929" exitCode=0 Nov 21 11:54:12 crc kubenswrapper[4769]: I1121 11:54:12.600984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"097a41de05c8052f314ccd1f8c67cc1f8da280b99d567fe1bb61400ff6720929"} Nov 21 11:54:13 crc kubenswrapper[4769]: I1121 11:54:13.807731 4769 scope.go:117] "RemoveContainer" containerID="a32bb0edfdd21b08a18489634c9c502d08777b5c39da27770b3493e59280e243" Nov 21 11:54:13 crc kubenswrapper[4769]: I1121 11:54:13.856225 4769 scope.go:117] "RemoveContainer" containerID="5ccf65aca5d1e68074a998a2454bdcbcf80dcb1212e38d1c22f377d281302639" Nov 21 11:54:13 crc kubenswrapper[4769]: I1121 11:54:13.916603 4769 scope.go:117] "RemoveContainer" containerID="335d77be1009125cd5c7338915424190f872f8b1c949420e3338b45772dc1aa3" Nov 21 11:54:13 crc kubenswrapper[4769]: I1121 11:54:13.954870 4769 scope.go:117] "RemoveContainer" containerID="2f22abd6184c4c8f5d26d4f7350bae58351006228f49c723404240f54739285c" Nov 21 11:54:17 crc kubenswrapper[4769]: I1121 11:54:17.655009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerStarted","Data":"455eef3bf9d303c2d04cbae26f2f96c6c379d6b10bcf7849e73404ed381c9d88"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.663940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerStarted","Data":"94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.666808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p6wjz" event={"ID":"dda8d6e2-0463-4846-b24e-1eef19c5cef9","Type":"ContainerStarted","Data":"14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.668823 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerStarted","Data":"6557c850150b1fb5199b5459e2bbb4f91ca6b757ba0541cca358f92f7c9142ac"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.671271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerStarted","Data":"7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.673744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"8167935c0ed9841b8ce33f0385a5fe567b3f53dcd4f2f34d0bf81b0f17ca696f"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.675736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerStarted","Data":"9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02"} Nov 21 11:54:18 crc kubenswrapper[4769]: I1121 11:54:18.695118 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-8ldcx" podStartSLOduration=9.321673699 podStartE2EDuration="2m33.695088141s" podCreationTimestamp="2025-11-21 11:51:45 +0000 UTC" firstStartedPulling="2025-11-21 11:51:49.441090282 +0000 UTC m=+68.141752100" lastFinishedPulling="2025-11-21 11:54:13.814504684 +0000 UTC m=+212.515166542" observedRunningTime="2025-11-21 11:54:18.693159738 +0000 UTC m=+217.393821566" watchObservedRunningTime="2025-11-21 11:54:18.695088141 +0000 UTC m=+217.395749969" Nov 21 11:54:19 crc kubenswrapper[4769]: I1121 11:54:19.703018 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-bsmrv" podStartSLOduration=8.356926459 podStartE2EDuration="2m31.702992313s" podCreationTimestamp="2025-11-21 11:51:48 +0000 UTC" firstStartedPulling="2025-11-21 11:51:50.461656937 +0000 UTC m=+69.162318755" lastFinishedPulling="2025-11-21 11:54:13.807722761 +0000 UTC m=+212.508384609" observedRunningTime="2025-11-21 11:54:19.699100817 +0000 UTC m=+218.399762645" watchObservedRunningTime="2025-11-21 11:54:19.702992313 +0000 UTC m=+218.403654141" Nov 21 11:54:20 crc kubenswrapper[4769]: I1121 11:54:20.732355 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-z7px2" podStartSLOduration=11.295341147 podStartE2EDuration="2m35.732317154s" podCreationTimestamp="2025-11-21 11:51:45 +0000 UTC" firstStartedPulling="2025-11-21 11:51:49.377550568 +0000 UTC m=+68.078212386" lastFinishedPulling="2025-11-21 11:54:13.814526535 +0000 UTC m=+212.515188393" observedRunningTime="2025-11-21 11:54:20.731698847 +0000 UTC m=+219.432360665" watchObservedRunningTime="2025-11-21 11:54:20.732317154 +0000 UTC m=+219.432978992" Nov 21 11:54:20 crc kubenswrapper[4769]: I1121 11:54:20.775397 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-2vwvq" podStartSLOduration=21.001571555 podStartE2EDuration="2m32.775369549s" podCreationTimestamp="2025-11-21 11:51:48 +0000 UTC" firstStartedPulling="2025-11-21 11:51:50.493875167 +0000 UTC m=+69.194536985" lastFinishedPulling="2025-11-21 11:54:02.267673141 +0000 UTC m=+200.968334979" observedRunningTime="2025-11-21 11:54:20.752897591 +0000 UTC m=+219.453559409" watchObservedRunningTime="2025-11-21 11:54:20.775369549 +0000 UTC m=+219.476031367" Nov 21 11:54:20 crc kubenswrapper[4769]: I1121 11:54:20.799565 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-p6wjz" podStartSLOduration=17.777501678 podStartE2EDuration="2m33.799531054s" podCreationTimestamp="2025-11-21 11:51:47 +0000 UTC" firstStartedPulling="2025-11-21 11:51:50.479967701 +0000 UTC m=+69.180629509" lastFinishedPulling="2025-11-21 11:54:06.501997027 +0000 UTC m=+205.202658885" observedRunningTime="2025-11-21 11:54:20.796534913 +0000 UTC m=+219.497196741" watchObservedRunningTime="2025-11-21 11:54:20.799531054 +0000 UTC m=+219.500192872" Nov 21 11:54:20 crc kubenswrapper[4769]: I1121 11:54:20.832838 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-5qxd8" podStartSLOduration=16.677924912 podStartE2EDuration="2m35.832809345s" podCreationTimestamp="2025-11-21 11:51:45 +0000 UTC" firstStartedPulling="2025-11-21 11:51:49.398138853 +0000 UTC m=+68.098800681" lastFinishedPulling="2025-11-21 11:54:08.553023286 +0000 UTC m=+207.253685114" observedRunningTime="2025-11-21 11:54:20.822271609 +0000 UTC m=+219.522933457" watchObservedRunningTime="2025-11-21 11:54:20.832809345 +0000 UTC m=+219.533471193" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.502782 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.503947 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.564851 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.673075 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.673621 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.729539 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.792547 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.798578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.891477 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.891564 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:54:25 crc kubenswrapper[4769]: I1121 11:54:25.999872 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:54:26 crc kubenswrapper[4769]: I1121 11:54:26.806018 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:54:27 crc kubenswrapper[4769]: I1121 11:54:27.681699 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:54:27 crc kubenswrapper[4769]: I1121 11:54:27.681803 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:54:27 crc kubenswrapper[4769]: I1121 11:54:27.746408 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:54:27 crc kubenswrapper[4769]: I1121 11:54:27.799383 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:54:27 crc kubenswrapper[4769]: I1121 11:54:27.942668 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-8ldcx"] Nov 21 11:54:28 crc kubenswrapper[4769]: I1121 11:54:28.643824 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:54:28 crc kubenswrapper[4769]: I1121 11:54:28.643931 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:54:28 crc kubenswrapper[4769]: I1121 11:54:28.698770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:54:28 crc kubenswrapper[4769]: I1121 11:54:28.744056 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-8ldcx" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="registry-server" containerID="cri-o://455eef3bf9d303c2d04cbae26f2f96c6c379d6b10bcf7849e73404ed381c9d88" gracePeriod=2 Nov 21 11:54:28 crc kubenswrapper[4769]: I1121 11:54:28.804293 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:54:29 crc kubenswrapper[4769]: I1121 11:54:29.059816 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:54:29 crc kubenswrapper[4769]: I1121 11:54:29.060351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:54:29 crc kubenswrapper[4769]: I1121 11:54:29.117180 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:54:29 crc kubenswrapper[4769]: I1121 11:54:29.802307 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:54:30 crc kubenswrapper[4769]: I1121 11:54:30.763719 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerID="455eef3bf9d303c2d04cbae26f2f96c6c379d6b10bcf7849e73404ed381c9d88" exitCode=0 Nov 21 11:54:30 crc kubenswrapper[4769]: I1121 11:54:30.763785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerDied","Data":"455eef3bf9d303c2d04cbae26f2f96c6c379d6b10bcf7849e73404ed381c9d88"} Nov 21 11:54:32 crc kubenswrapper[4769]: I1121 11:54:32.141828 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-2vwvq"] Nov 21 11:54:32 crc kubenswrapper[4769]: I1121 11:54:32.142384 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-2vwvq" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="registry-server" containerID="cri-o://6557c850150b1fb5199b5459e2bbb4f91ca6b757ba0541cca358f92f7c9142ac" gracePeriod=2 Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.448397 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.633076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-catalog-content\") pod \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.633271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-utilities\") pod \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.633461 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbfvj\" (UniqueName: \"kubernetes.io/projected/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-kube-api-access-mbfvj\") pod \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\" (UID: \"2bf97f97-a786-49a8-8ed8-c209cb9b1c08\") " Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.634788 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-utilities" (OuterVolumeSpecName: "utilities") pod "2bf97f97-a786-49a8-8ed8-c209cb9b1c08" (UID: "2bf97f97-a786-49a8-8ed8-c209cb9b1c08"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.646886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-kube-api-access-mbfvj" (OuterVolumeSpecName: "kube-api-access-mbfvj") pod "2bf97f97-a786-49a8-8ed8-c209cb9b1c08" (UID: "2bf97f97-a786-49a8-8ed8-c209cb9b1c08"). InnerVolumeSpecName "kube-api-access-mbfvj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.735548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2bf97f97-a786-49a8-8ed8-c209cb9b1c08" (UID: "2bf97f97-a786-49a8-8ed8-c209cb9b1c08"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.736296 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mbfvj\" (UniqueName: \"kubernetes.io/projected/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-kube-api-access-mbfvj\") on node \"crc\" DevicePath \"\"" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.736353 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.736378 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2bf97f97-a786-49a8-8ed8-c209cb9b1c08-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.804883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8ldcx" event={"ID":"2bf97f97-a786-49a8-8ed8-c209cb9b1c08","Type":"ContainerDied","Data":"52e46ccd7c8f3dcf7ec325367452b86b10ff95efb71582232ab8d5e5a114f4f9"} Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.805572 4769 scope.go:117] "RemoveContainer" containerID="455eef3bf9d303c2d04cbae26f2f96c6c379d6b10bcf7849e73404ed381c9d88" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.805323 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8ldcx" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.837252 4769 scope.go:117] "RemoveContainer" containerID="a72cf238ab9be27d70c9c1720e29171f00cf2517aaa3c607dd924a00b06d0a93" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.866177 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-8ldcx"] Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.866460 4769 scope.go:117] "RemoveContainer" containerID="d71e3b8e54a7c449d164ba480f925da2514d28544c85550b99c7077a87e709f8" Nov 21 11:54:33 crc kubenswrapper[4769]: I1121 11:54:33.872324 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-8ldcx"] Nov 21 11:54:34 crc kubenswrapper[4769]: I1121 11:54:34.816713 4769 generic.go:334] "Generic (PLEG): container finished" podID="b8d840b3-3cff-4982-b862-653d85206551" containerID="6557c850150b1fb5199b5459e2bbb4f91ca6b757ba0541cca358f92f7c9142ac" exitCode=0 Nov 21 11:54:34 crc kubenswrapper[4769]: I1121 11:54:34.816766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerDied","Data":"6557c850150b1fb5199b5459e2bbb4f91ca6b757ba0541cca358f92f7c9142ac"} Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.287314 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" path="/var/lib/kubelet/pods/2bf97f97-a786-49a8-8ed8-c209cb9b1c08/volumes" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.596736 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.770708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z5gh\" (UniqueName: \"kubernetes.io/projected/b8d840b3-3cff-4982-b862-653d85206551-kube-api-access-6z5gh\") pod \"b8d840b3-3cff-4982-b862-653d85206551\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.770807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-catalog-content\") pod \"b8d840b3-3cff-4982-b862-653d85206551\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.770852 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-utilities\") pod \"b8d840b3-3cff-4982-b862-653d85206551\" (UID: \"b8d840b3-3cff-4982-b862-653d85206551\") " Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.772217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-utilities" (OuterVolumeSpecName: "utilities") pod "b8d840b3-3cff-4982-b862-653d85206551" (UID: "b8d840b3-3cff-4982-b862-653d85206551"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.779512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8d840b3-3cff-4982-b862-653d85206551-kube-api-access-6z5gh" (OuterVolumeSpecName: "kube-api-access-6z5gh") pod "b8d840b3-3cff-4982-b862-653d85206551" (UID: "b8d840b3-3cff-4982-b862-653d85206551"). InnerVolumeSpecName "kube-api-access-6z5gh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.823668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2vwvq" event={"ID":"b8d840b3-3cff-4982-b862-653d85206551","Type":"ContainerDied","Data":"7073fc1cfce942eb3f97cbaa664d009fd2cffa59377689fd78d92c566e1fd332"} Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.823722 4769 scope.go:117] "RemoveContainer" containerID="6557c850150b1fb5199b5459e2bbb4f91ca6b757ba0541cca358f92f7c9142ac" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.824329 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2vwvq" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.843406 4769 scope.go:117] "RemoveContainer" containerID="08bed6b87cf922ede62c30dbbe212e0ce5d7da3242c2bcdd1a6555708e61f7a6" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.858768 4769 scope.go:117] "RemoveContainer" containerID="19d394ecbcff7a34ef6b1c75207e416d9348eaa57436fec60eebac4d21bc95c6" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.872937 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.872973 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6z5gh\" (UniqueName: \"kubernetes.io/projected/b8d840b3-3cff-4982-b862-653d85206551-kube-api-access-6z5gh\") on node \"crc\" DevicePath \"\"" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.875698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b8d840b3-3cff-4982-b862-653d85206551" (UID: "b8d840b3-3cff-4982-b862-653d85206551"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:54:35 crc kubenswrapper[4769]: I1121 11:54:35.973956 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b8d840b3-3cff-4982-b862-653d85206551-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:54:36 crc kubenswrapper[4769]: I1121 11:54:36.160609 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-2vwvq"] Nov 21 11:54:36 crc kubenswrapper[4769]: I1121 11:54:36.163758 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-2vwvq"] Nov 21 11:54:37 crc kubenswrapper[4769]: I1121 11:54:37.286004 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8d840b3-3cff-4982-b862-653d85206551" path="/var/lib/kubelet/pods/b8d840b3-3cff-4982-b862-653d85206551/volumes" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.586724 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-5qxd8"] Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.587654 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-5qxd8" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="registry-server" containerID="cri-o://94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3" gracePeriod=30 Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.602269 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-z7px2"] Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.602600 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-z7px2" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="registry-server" containerID="cri-o://9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02" gracePeriod=30 Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.603314 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-t6l7h"] Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.603537 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerName="marketplace-operator" containerID="cri-o://88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a" gracePeriod=30 Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.607541 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-p6wjz"] Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.609539 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-p6wjz" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="registry-server" containerID="cri-o://14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1" gracePeriod=30 Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618399 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-l6b4c"] Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618609 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618620 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618630 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618636 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618648 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618654 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618662 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618669 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618684 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d3cdd0b7-024c-47b8-a4bf-e29a2bef8128" containerName="pruner" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618691 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cdd0b7-024c-47b8-a4bf-e29a2bef8128" containerName="pruner" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618698 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618704 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618714 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618721 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618728 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618734 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618740 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618746 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="extract-utilities" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618752 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618758 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618766 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8" containerName="pruner" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618772 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8" containerName="pruner" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618779 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618785 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618794 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618800 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618809 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618815 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="extract-content" Nov 21 11:55:40 crc kubenswrapper[4769]: E1121 11:55:40.618823 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618828 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618912 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4c9630fd-9719-44c6-b527-a909d4a0ce2b" containerName="kube-multus-additional-cni-plugins" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618919 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b8d840b3-3cff-4982-b862-653d85206551" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618932 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d628f9e-a832-4c28-a3a1-cb8b0dd1a2c8" containerName="pruner" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618941 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d3cdd0b7-024c-47b8-a4bf-e29a2bef8128" containerName="pruner" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618949 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bf97f97-a786-49a8-8ed8-c209cb9b1c08" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618959 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a5f6ac60-f039-44aa-a5c4-f85b4b8d8bb2" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.618969 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad4ba254-1627-4fcc-9353-2a2188dfcc90" containerName="registry-server" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.619355 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.628810 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-bsmrv"] Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.629132 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-bsmrv" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="registry-server" containerID="cri-o://7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee" gracePeriod=30 Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.641123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-l6b4c"] Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.759898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhq8d\" (UniqueName: \"kubernetes.io/projected/eb549305-cb07-46b1-aeee-be030a5c2fc2-kube-api-access-hhq8d\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.759955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/eb549305-cb07-46b1-aeee-be030a5c2fc2-marketplace-operator-metrics\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.760341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb549305-cb07-46b1-aeee-be030a5c2fc2-marketplace-trusted-ca\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.862016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb549305-cb07-46b1-aeee-be030a5c2fc2-marketplace-trusted-ca\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.862518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hhq8d\" (UniqueName: \"kubernetes.io/projected/eb549305-cb07-46b1-aeee-be030a5c2fc2-kube-api-access-hhq8d\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.862575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/eb549305-cb07-46b1-aeee-be030a5c2fc2-marketplace-operator-metrics\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.863542 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb549305-cb07-46b1-aeee-be030a5c2fc2-marketplace-trusted-ca\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.870268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/eb549305-cb07-46b1-aeee-be030a5c2fc2-marketplace-operator-metrics\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.890124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhq8d\" (UniqueName: \"kubernetes.io/projected/eb549305-cb07-46b1-aeee-be030a5c2fc2-kube-api-access-hhq8d\") pod \"marketplace-operator-79b997595-l6b4c\" (UID: \"eb549305-cb07-46b1-aeee-be030a5c2fc2\") " pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:40 crc kubenswrapper[4769]: I1121 11:55:40.941289 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.053349 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.060718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.065524 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.084329 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.118886 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.165728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-catalog-content\") pod \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.165939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2gfl\" (UniqueName: \"kubernetes.io/projected/ce51b215-4923-4c0e-8a29-fe6af3a303d4-kube-api-access-j2gfl\") pod \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-utilities\") pod \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\" (UID: \"ce51b215-4923-4c0e-8a29-fe6af3a303d4\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf6zz\" (UniqueName: \"kubernetes.io/projected/fd38336f-cc4b-4953-83ee-91bd6566e43b-kube-api-access-rf6zz\") pod \"fd38336f-cc4b-4953-83ee-91bd6566e43b\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-catalog-content\") pod \"3ea4516e-4916-48c4-9464-95603adf2b8a\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166165 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-operator-metrics\") pod \"fd38336f-cc4b-4953-83ee-91bd6566e43b\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnbrg\" (UniqueName: \"kubernetes.io/projected/024c57c4-ef5a-4c59-b67d-d9340284d9b1-kube-api-access-lnbrg\") pod \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-utilities\") pod \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4fh8\" (UniqueName: \"kubernetes.io/projected/3ea4516e-4916-48c4-9464-95603adf2b8a-kube-api-access-q4fh8\") pod \"3ea4516e-4916-48c4-9464-95603adf2b8a\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-utilities\") pod \"3ea4516e-4916-48c4-9464-95603adf2b8a\" (UID: \"3ea4516e-4916-48c4-9464-95603adf2b8a\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-catalog-content\") pod \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\" (UID: \"024c57c4-ef5a-4c59-b67d-d9340284d9b1\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.166494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-trusted-ca\") pod \"fd38336f-cc4b-4953-83ee-91bd6566e43b\" (UID: \"fd38336f-cc4b-4953-83ee-91bd6566e43b\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.168371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-trusted-ca" (OuterVolumeSpecName: "marketplace-trusted-ca") pod "fd38336f-cc4b-4953-83ee-91bd6566e43b" (UID: "fd38336f-cc4b-4953-83ee-91bd6566e43b"). InnerVolumeSpecName "marketplace-trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.169987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-utilities" (OuterVolumeSpecName: "utilities") pod "ce51b215-4923-4c0e-8a29-fe6af3a303d4" (UID: "ce51b215-4923-4c0e-8a29-fe6af3a303d4"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.170918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-utilities" (OuterVolumeSpecName: "utilities") pod "024c57c4-ef5a-4c59-b67d-d9340284d9b1" (UID: "024c57c4-ef5a-4c59-b67d-d9340284d9b1"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.171542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-utilities" (OuterVolumeSpecName: "utilities") pod "3ea4516e-4916-48c4-9464-95603adf2b8a" (UID: "3ea4516e-4916-48c4-9464-95603adf2b8a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.175140 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea4516e-4916-48c4-9464-95603adf2b8a-kube-api-access-q4fh8" (OuterVolumeSpecName: "kube-api-access-q4fh8") pod "3ea4516e-4916-48c4-9464-95603adf2b8a" (UID: "3ea4516e-4916-48c4-9464-95603adf2b8a"). InnerVolumeSpecName "kube-api-access-q4fh8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.176112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-operator-metrics" (OuterVolumeSpecName: "marketplace-operator-metrics") pod "fd38336f-cc4b-4953-83ee-91bd6566e43b" (UID: "fd38336f-cc4b-4953-83ee-91bd6566e43b"). InnerVolumeSpecName "marketplace-operator-metrics". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.177002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd38336f-cc4b-4953-83ee-91bd6566e43b-kube-api-access-rf6zz" (OuterVolumeSpecName: "kube-api-access-rf6zz") pod "fd38336f-cc4b-4953-83ee-91bd6566e43b" (UID: "fd38336f-cc4b-4953-83ee-91bd6566e43b"). InnerVolumeSpecName "kube-api-access-rf6zz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.179040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce51b215-4923-4c0e-8a29-fe6af3a303d4-kube-api-access-j2gfl" (OuterVolumeSpecName: "kube-api-access-j2gfl") pod "ce51b215-4923-4c0e-8a29-fe6af3a303d4" (UID: "ce51b215-4923-4c0e-8a29-fe6af3a303d4"). InnerVolumeSpecName "kube-api-access-j2gfl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.180090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/024c57c4-ef5a-4c59-b67d-d9340284d9b1-kube-api-access-lnbrg" (OuterVolumeSpecName: "kube-api-access-lnbrg") pod "024c57c4-ef5a-4c59-b67d-d9340284d9b1" (UID: "024c57c4-ef5a-4c59-b67d-d9340284d9b1"). InnerVolumeSpecName "kube-api-access-lnbrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.237652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "024c57c4-ef5a-4c59-b67d-d9340284d9b1" (UID: "024c57c4-ef5a-4c59-b67d-d9340284d9b1"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.246124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "3ea4516e-4916-48c4-9464-95603adf2b8a" (UID: "3ea4516e-4916-48c4-9464-95603adf2b8a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6w6d\" (UniqueName: \"kubernetes.io/projected/dda8d6e2-0463-4846-b24e-1eef19c5cef9-kube-api-access-n6w6d\") pod \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-utilities\") pod \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268332 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-catalog-content\") pod \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\" (UID: \"dda8d6e2-0463-4846-b24e-1eef19c5cef9\") " Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268620 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j2gfl\" (UniqueName: \"kubernetes.io/projected/ce51b215-4923-4c0e-8a29-fe6af3a303d4-kube-api-access-j2gfl\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268643 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268656 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rf6zz\" (UniqueName: \"kubernetes.io/projected/fd38336f-cc4b-4953-83ee-91bd6566e43b-kube-api-access-rf6zz\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268668 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268681 4769 reconciler_common.go:293] "Volume detached for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-operator-metrics\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268697 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lnbrg\" (UniqueName: \"kubernetes.io/projected/024c57c4-ef5a-4c59-b67d-d9340284d9b1-kube-api-access-lnbrg\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268709 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268721 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q4fh8\" (UniqueName: \"kubernetes.io/projected/3ea4516e-4916-48c4-9464-95603adf2b8a-kube-api-access-q4fh8\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268731 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3ea4516e-4916-48c4-9464-95603adf2b8a-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268742 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/024c57c4-ef5a-4c59-b67d-d9340284d9b1-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.268782 4769 reconciler_common.go:293] "Volume detached for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd38336f-cc4b-4953-83ee-91bd6566e43b-marketplace-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.269158 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-utilities" (OuterVolumeSpecName: "utilities") pod "dda8d6e2-0463-4846-b24e-1eef19c5cef9" (UID: "dda8d6e2-0463-4846-b24e-1eef19c5cef9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.271166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda8d6e2-0463-4846-b24e-1eef19c5cef9-kube-api-access-n6w6d" (OuterVolumeSpecName: "kube-api-access-n6w6d") pod "dda8d6e2-0463-4846-b24e-1eef19c5cef9" (UID: "dda8d6e2-0463-4846-b24e-1eef19c5cef9"). InnerVolumeSpecName "kube-api-access-n6w6d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.282831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ce51b215-4923-4c0e-8a29-fe6af3a303d4" (UID: "ce51b215-4923-4c0e-8a29-fe6af3a303d4"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.289130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "dda8d6e2-0463-4846-b24e-1eef19c5cef9" (UID: "dda8d6e2-0463-4846-b24e-1eef19c5cef9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.369794 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n6w6d\" (UniqueName: \"kubernetes.io/projected/dda8d6e2-0463-4846-b24e-1eef19c5cef9-kube-api-access-n6w6d\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.369829 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.369841 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ce51b215-4923-4c0e-8a29-fe6af3a303d4-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.369849 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dda8d6e2-0463-4846-b24e-1eef19c5cef9-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.414386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-l6b4c"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.612592 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerID="7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee" exitCode=0 Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.612745 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-bsmrv" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.612714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerDied","Data":"7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.613333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-bsmrv" event={"ID":"ce51b215-4923-4c0e-8a29-fe6af3a303d4","Type":"ContainerDied","Data":"3006846c423f24aad95e416783daadbb45211848631c8fc4f7e63524d7705280"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.613362 4769 scope.go:117] "RemoveContainer" containerID="7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.616106 4769 generic.go:334] "Generic (PLEG): container finished" podID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerID="9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02" exitCode=0 Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.616178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerDied","Data":"9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.616222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-z7px2" event={"ID":"024c57c4-ef5a-4c59-b67d-d9340284d9b1","Type":"ContainerDied","Data":"41976eeaf3cc9ad430a7cac85638d9486ed595cae026bbce18f019e6f400f3dc"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.616317 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-z7px2" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.619764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" event={"ID":"eb549305-cb07-46b1-aeee-be030a5c2fc2","Type":"ContainerStarted","Data":"2a1dc94af2e3ac1e83e9ae1b8c00831d3e535ff89969688b416d657913b15df0"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.619819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" event={"ID":"eb549305-cb07-46b1-aeee-be030a5c2fc2","Type":"ContainerStarted","Data":"5f83e8952140d0f7a3fac75b8cb8dd93822b772b628da71d6a85eb9d8f7186bb"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.619965 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.621577 4769 patch_prober.go:28] interesting pod/marketplace-operator-79b997595-l6b4c container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.54:8080/healthz\": dial tcp 10.217.0.54:8080: connect: connection refused" start-of-body= Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.621641 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" podUID="eb549305-cb07-46b1-aeee-be030a5c2fc2" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.54:8080/healthz\": dial tcp 10.217.0.54:8080: connect: connection refused" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.622403 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerID="88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a" exitCode=0 Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.622462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" event={"ID":"fd38336f-cc4b-4953-83ee-91bd6566e43b","Type":"ContainerDied","Data":"88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.622484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" event={"ID":"fd38336f-cc4b-4953-83ee-91bd6566e43b","Type":"ContainerDied","Data":"75b7b163db64b66c506fff383b4eb53f039c2f52f5214391617e286769a434da"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.622559 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-79b997595-t6l7h" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.628214 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerID="94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3" exitCode=0 Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.628306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerDied","Data":"94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.628360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5qxd8" event={"ID":"3ea4516e-4916-48c4-9464-95603adf2b8a","Type":"ContainerDied","Data":"7ef7d6766f551a5160d02c097bb0849efc94982494a9c2f4988a19280cdbde79"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.628370 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5qxd8" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.632340 4769 generic.go:334] "Generic (PLEG): container finished" podID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerID="14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1" exitCode=0 Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.632394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p6wjz" event={"ID":"dda8d6e2-0463-4846-b24e-1eef19c5cef9","Type":"ContainerDied","Data":"14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.632431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-p6wjz" event={"ID":"dda8d6e2-0463-4846-b24e-1eef19c5cef9","Type":"ContainerDied","Data":"bd139d290e5db966f6a8c19836da5db6a2313932a67cd4fae1f4e4ac0f606d6e"} Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.632540 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-p6wjz" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.640807 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-z7px2"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.642961 4769 scope.go:117] "RemoveContainer" containerID="c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.645989 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-z7px2"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.662562 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" podStartSLOduration=1.662539599 podStartE2EDuration="1.662539599s" podCreationTimestamp="2025-11-21 11:55:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:55:41.658715145 +0000 UTC m=+300.359376963" watchObservedRunningTime="2025-11-21 11:55:41.662539599 +0000 UTC m=+300.363201407" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.676795 4769 scope.go:117] "RemoveContainer" containerID="f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.680088 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-p6wjz"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.687235 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-p6wjz"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.690598 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-5qxd8"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.698527 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-5qxd8"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.702584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-bsmrv"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.705681 4769 scope.go:117] "RemoveContainer" containerID="7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.707322 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee\": container with ID starting with 7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee not found: ID does not exist" containerID="7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.707366 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee"} err="failed to get container status \"7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee\": rpc error: code = NotFound desc = could not find container \"7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee\": container with ID starting with 7f5fed5fd9311d0fcd3196bc117f2e86f0934a80ba780fae8b5a7760383306ee not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.707397 4769 scope.go:117] "RemoveContainer" containerID="c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.708868 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf\": container with ID starting with c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf not found: ID does not exist" containerID="c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.708912 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf"} err="failed to get container status \"c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf\": rpc error: code = NotFound desc = could not find container \"c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf\": container with ID starting with c601553a7554cf23c42277ab015e1240c134d5328d92e7dd9422d95567a66abf not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.708941 4769 scope.go:117] "RemoveContainer" containerID="f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.710098 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-bsmrv"] Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.710151 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6\": container with ID starting with f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6 not found: ID does not exist" containerID="f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.710219 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6"} err="failed to get container status \"f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6\": rpc error: code = NotFound desc = could not find container \"f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6\": container with ID starting with f07b6d2f00cd289bfaa6d6dc119d9eb165dc715580aa811d53aed50edd3b9ea6 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.710258 4769 scope.go:117] "RemoveContainer" containerID="9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.715374 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-t6l7h"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.718069 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/marketplace-operator-79b997595-t6l7h"] Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.767734 4769 scope.go:117] "RemoveContainer" containerID="5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.785048 4769 scope.go:117] "RemoveContainer" containerID="8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.808385 4769 scope.go:117] "RemoveContainer" containerID="9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.808930 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02\": container with ID starting with 9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02 not found: ID does not exist" containerID="9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.808998 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02"} err="failed to get container status \"9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02\": rpc error: code = NotFound desc = could not find container \"9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02\": container with ID starting with 9ce646c79ce4406529035e5deb8e54ca8f6e60798c64bf50caae0be152105d02 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.809036 4769 scope.go:117] "RemoveContainer" containerID="5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.809509 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970\": container with ID starting with 5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970 not found: ID does not exist" containerID="5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.809544 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970"} err="failed to get container status \"5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970\": rpc error: code = NotFound desc = could not find container \"5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970\": container with ID starting with 5cda87a8293eabbcb3a1fb2c33e6e3cc4a4ece859bbed3910908eacd9157d970 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.809565 4769 scope.go:117] "RemoveContainer" containerID="8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.809943 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0\": container with ID starting with 8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0 not found: ID does not exist" containerID="8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.809978 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0"} err="failed to get container status \"8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0\": rpc error: code = NotFound desc = could not find container \"8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0\": container with ID starting with 8969c5903a4b9559875095db3f2e4117a975d4fb6a523879c4b3c57de19d4fc0 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.810007 4769 scope.go:117] "RemoveContainer" containerID="88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.825885 4769 scope.go:117] "RemoveContainer" containerID="88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.826391 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a\": container with ID starting with 88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a not found: ID does not exist" containerID="88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.826427 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a"} err="failed to get container status \"88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a\": rpc error: code = NotFound desc = could not find container \"88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a\": container with ID starting with 88fefddbd89fefdab70f73270e144b4f36a665c621e017986993ff959a331a6a not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.826458 4769 scope.go:117] "RemoveContainer" containerID="94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.847086 4769 scope.go:117] "RemoveContainer" containerID="502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.861854 4769 scope.go:117] "RemoveContainer" containerID="8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.880159 4769 scope.go:117] "RemoveContainer" containerID="94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.880756 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3\": container with ID starting with 94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3 not found: ID does not exist" containerID="94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.880818 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3"} err="failed to get container status \"94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3\": rpc error: code = NotFound desc = could not find container \"94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3\": container with ID starting with 94e68297ed8d3d37a84c64dfa411e8c6c41166b6ae1ac97f3b49c112e9ec82a3 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.880859 4769 scope.go:117] "RemoveContainer" containerID="502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.881347 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa\": container with ID starting with 502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa not found: ID does not exist" containerID="502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.881387 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa"} err="failed to get container status \"502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa\": rpc error: code = NotFound desc = could not find container \"502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa\": container with ID starting with 502dc82bb304de92e004c43e673c9ff1f10f3632fb92b94ad6a0a0651ce79baa not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.881437 4769 scope.go:117] "RemoveContainer" containerID="8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.882080 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486\": container with ID starting with 8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486 not found: ID does not exist" containerID="8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.882119 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486"} err="failed to get container status \"8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486\": rpc error: code = NotFound desc = could not find container \"8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486\": container with ID starting with 8b1367f5560b3abfb6ebedcb75b225edecdb5c79841a1fee2372d8a0d73a1486 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.882135 4769 scope.go:117] "RemoveContainer" containerID="14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.897407 4769 scope.go:117] "RemoveContainer" containerID="2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.913461 4769 scope.go:117] "RemoveContainer" containerID="3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.932017 4769 scope.go:117] "RemoveContainer" containerID="14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.932574 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1\": container with ID starting with 14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1 not found: ID does not exist" containerID="14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.932612 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1"} err="failed to get container status \"14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1\": rpc error: code = NotFound desc = could not find container \"14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1\": container with ID starting with 14788a1066a8969ebff1111e7cf42e58d86f77a820d63ecb09143912dbf6dbe1 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.932645 4769 scope.go:117] "RemoveContainer" containerID="2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.933031 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4\": container with ID starting with 2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4 not found: ID does not exist" containerID="2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.933060 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4"} err="failed to get container status \"2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4\": rpc error: code = NotFound desc = could not find container \"2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4\": container with ID starting with 2e993f18721fa5b7445b13383759cd9ebdda300261fd68c43a20707a8d75a3e4 not found: ID does not exist" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.933081 4769 scope.go:117] "RemoveContainer" containerID="3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae" Nov 21 11:55:41 crc kubenswrapper[4769]: E1121 11:55:41.933399 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae\": container with ID starting with 3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae not found: ID does not exist" containerID="3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae" Nov 21 11:55:41 crc kubenswrapper[4769]: I1121 11:55:41.933427 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae"} err="failed to get container status \"3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae\": rpc error: code = NotFound desc = could not find container \"3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae\": container with ID starting with 3abf593a1c4da2baff53412ce011563afcf7f50474c50b473559bd788f62f8ae not found: ID does not exist" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.208582 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-558db77b4-dppfh"] Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.647198 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-79b997595-l6b4c" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802070 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-znfxh"] Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802304 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802318 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802331 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802338 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802364 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802370 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802380 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802387 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802410 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802417 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802426 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802433 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802442 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802448 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802456 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802461 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802471 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802477 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="extract-content" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802485 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802491 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="extract-utilities" Nov 21 11:55:42 crc kubenswrapper[4769]: E1121 11:55:42.802499 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerName="marketplace-operator" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802505 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerName="marketplace-operator" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802595 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802606 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802615 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802623 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" containerName="registry-server" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.802630 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" containerName="marketplace-operator" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.803599 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.805699 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-marketplace-dockercfg-x2ctb" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.811312 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-znfxh"] Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.892961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/919dc4e0-b891-4dfa-a383-4b9105f36da3-utilities\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.893014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/919dc4e0-b891-4dfa-a383-4b9105f36da3-catalog-content\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.893054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn8bw\" (UniqueName: \"kubernetes.io/projected/919dc4e0-b891-4dfa-a383-4b9105f36da3-kube-api-access-vn8bw\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.994777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/919dc4e0-b891-4dfa-a383-4b9105f36da3-catalog-content\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.994933 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vn8bw\" (UniqueName: \"kubernetes.io/projected/919dc4e0-b891-4dfa-a383-4b9105f36da3-kube-api-access-vn8bw\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.995050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/919dc4e0-b891-4dfa-a383-4b9105f36da3-utilities\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.995769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/919dc4e0-b891-4dfa-a383-4b9105f36da3-catalog-content\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.995984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/919dc4e0-b891-4dfa-a383-4b9105f36da3-utilities\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.997745 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-jljwh"] Nov 21 11:55:42 crc kubenswrapper[4769]: I1121 11:55:42.998822 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.001716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-dmngl" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.011117 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-jljwh"] Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.023110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn8bw\" (UniqueName: \"kubernetes.io/projected/919dc4e0-b891-4dfa-a383-4b9105f36da3-kube-api-access-vn8bw\") pod \"redhat-marketplace-znfxh\" (UID: \"919dc4e0-b891-4dfa-a383-4b9105f36da3\") " pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.096072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-utilities\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.096109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjhrg\" (UniqueName: \"kubernetes.io/projected/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-kube-api-access-xjhrg\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.096138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-catalog-content\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.121143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.197442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-utilities\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.197486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xjhrg\" (UniqueName: \"kubernetes.io/projected/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-kube-api-access-xjhrg\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.197511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-catalog-content\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.198280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-catalog-content\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.198301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-utilities\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.221329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjhrg\" (UniqueName: \"kubernetes.io/projected/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-kube-api-access-xjhrg\") pod \"community-operators-jljwh\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.280892 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="024c57c4-ef5a-4c59-b67d-d9340284d9b1" path="/var/lib/kubelet/pods/024c57c4-ef5a-4c59-b67d-d9340284d9b1/volumes" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.281821 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea4516e-4916-48c4-9464-95603adf2b8a" path="/var/lib/kubelet/pods/3ea4516e-4916-48c4-9464-95603adf2b8a/volumes" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.282444 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce51b215-4923-4c0e-8a29-fe6af3a303d4" path="/var/lib/kubelet/pods/ce51b215-4923-4c0e-8a29-fe6af3a303d4/volumes" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.283592 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda8d6e2-0463-4846-b24e-1eef19c5cef9" path="/var/lib/kubelet/pods/dda8d6e2-0463-4846-b24e-1eef19c5cef9/volumes" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.284397 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd38336f-cc4b-4953-83ee-91bd6566e43b" path="/var/lib/kubelet/pods/fd38336f-cc4b-4953-83ee-91bd6566e43b/volumes" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.324725 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"community-operators-dockercfg-dmngl" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.333597 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.525836 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-znfxh"] Nov 21 11:55:43 crc kubenswrapper[4769]: W1121 11:55:43.544769 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919dc4e0_b891_4dfa_a383_4b9105f36da3.slice/crio-22d7e22143718b475b2d24edd9a6fc6646fc4f844fedbd022456cf3674aaef2a WatchSource:0}: Error finding container 22d7e22143718b475b2d24edd9a6fc6646fc4f844fedbd022456cf3674aaef2a: Status 404 returned error can't find the container with id 22d7e22143718b475b2d24edd9a6fc6646fc4f844fedbd022456cf3674aaef2a Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.614789 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-jljwh"] Nov 21 11:55:43 crc kubenswrapper[4769]: W1121 11:55:43.617749 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90a4f95_d023_4f03_b7d6_e58fc5d67bcf.slice/crio-db56f6f7b0e36d7eb6f2bd523d81679bb8904b72faf680048a32a283d93b08b4 WatchSource:0}: Error finding container db56f6f7b0e36d7eb6f2bd523d81679bb8904b72faf680048a32a283d93b08b4: Status 404 returned error can't find the container with id db56f6f7b0e36d7eb6f2bd523d81679bb8904b72faf680048a32a283d93b08b4 Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.647894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-znfxh" event={"ID":"919dc4e0-b891-4dfa-a383-4b9105f36da3","Type":"ContainerStarted","Data":"22d7e22143718b475b2d24edd9a6fc6646fc4f844fedbd022456cf3674aaef2a"} Nov 21 11:55:43 crc kubenswrapper[4769]: I1121 11:55:43.650532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jljwh" event={"ID":"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf","Type":"ContainerStarted","Data":"db56f6f7b0e36d7eb6f2bd523d81679bb8904b72faf680048a32a283d93b08b4"} Nov 21 11:55:44 crc kubenswrapper[4769]: I1121 11:55:44.659897 4769 generic.go:334] "Generic (PLEG): container finished" podID="919dc4e0-b891-4dfa-a383-4b9105f36da3" containerID="3f195a870ba3721f1f84b5178c1de6f8047bfc3829e1a22f73ecb26ae6202be9" exitCode=0 Nov 21 11:55:44 crc kubenswrapper[4769]: I1121 11:55:44.660006 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-znfxh" event={"ID":"919dc4e0-b891-4dfa-a383-4b9105f36da3","Type":"ContainerDied","Data":"3f195a870ba3721f1f84b5178c1de6f8047bfc3829e1a22f73ecb26ae6202be9"} Nov 21 11:55:44 crc kubenswrapper[4769]: I1121 11:55:44.664473 4769 generic.go:334] "Generic (PLEG): container finished" podID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerID="3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f" exitCode=0 Nov 21 11:55:44 crc kubenswrapper[4769]: I1121 11:55:44.664526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jljwh" event={"ID":"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf","Type":"ContainerDied","Data":"3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f"} Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.199906 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-cntr5"] Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.201634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.204250 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"redhat-operators-dockercfg-ct8rh" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.221279 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cntr5"] Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.330120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2c9\" (UniqueName: \"kubernetes.io/projected/e638ef75-a4f8-445f-91f1-2d47eb693038-kube-api-access-hr2c9\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.330385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e638ef75-a4f8-445f-91f1-2d47eb693038-utilities\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.330589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e638ef75-a4f8-445f-91f1-2d47eb693038-catalog-content\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.400949 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-qhsnf"] Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.402350 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.404525 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"certified-operators-dockercfg-4rs5g" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.418813 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-qhsnf"] Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.434819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e638ef75-a4f8-445f-91f1-2d47eb693038-utilities\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.434903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e638ef75-a4f8-445f-91f1-2d47eb693038-catalog-content\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.434981 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2c9\" (UniqueName: \"kubernetes.io/projected/e638ef75-a4f8-445f-91f1-2d47eb693038-kube-api-access-hr2c9\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.435506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e638ef75-a4f8-445f-91f1-2d47eb693038-utilities\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.435522 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e638ef75-a4f8-445f-91f1-2d47eb693038-catalog-content\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.458408 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2c9\" (UniqueName: \"kubernetes.io/projected/e638ef75-a4f8-445f-91f1-2d47eb693038-kube-api-access-hr2c9\") pod \"redhat-operators-cntr5\" (UID: \"e638ef75-a4f8-445f-91f1-2d47eb693038\") " pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.532882 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.536744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3254b787-2dd3-457f-8e6e-a03f04d6c5af-catalog-content\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.536793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3254b787-2dd3-457f-8e6e-a03f04d6c5af-utilities\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.536845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9n72\" (UniqueName: \"kubernetes.io/projected/3254b787-2dd3-457f-8e6e-a03f04d6c5af-kube-api-access-k9n72\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.638565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9n72\" (UniqueName: \"kubernetes.io/projected/3254b787-2dd3-457f-8e6e-a03f04d6c5af-kube-api-access-k9n72\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.644953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3254b787-2dd3-457f-8e6e-a03f04d6c5af-catalog-content\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.645019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3254b787-2dd3-457f-8e6e-a03f04d6c5af-utilities\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.645497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/3254b787-2dd3-457f-8e6e-a03f04d6c5af-utilities\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.645688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/3254b787-2dd3-457f-8e6e-a03f04d6c5af-catalog-content\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.663409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9n72\" (UniqueName: \"kubernetes.io/projected/3254b787-2dd3-457f-8e6e-a03f04d6c5af-kube-api-access-k9n72\") pod \"certified-operators-qhsnf\" (UID: \"3254b787-2dd3-457f-8e6e-a03f04d6c5af\") " pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.723622 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.780388 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cntr5"] Nov 21 11:55:45 crc kubenswrapper[4769]: W1121 11:55:45.790654 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode638ef75_a4f8_445f_91f1_2d47eb693038.slice/crio-3e2fb8b16adf2ce9e70a711d8614c0384b45fe7de8b0446575e1b43de87ecc78 WatchSource:0}: Error finding container 3e2fb8b16adf2ce9e70a711d8614c0384b45fe7de8b0446575e1b43de87ecc78: Status 404 returned error can't find the container with id 3e2fb8b16adf2ce9e70a711d8614c0384b45fe7de8b0446575e1b43de87ecc78 Nov 21 11:55:45 crc kubenswrapper[4769]: I1121 11:55:45.919958 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-qhsnf"] Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.684615 4769 generic.go:334] "Generic (PLEG): container finished" podID="919dc4e0-b891-4dfa-a383-4b9105f36da3" containerID="c6c8102041230e04ef19fb455146f9e46f21c7d3619d08fb7c02aafaf05826b7" exitCode=0 Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.685027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-znfxh" event={"ID":"919dc4e0-b891-4dfa-a383-4b9105f36da3","Type":"ContainerDied","Data":"c6c8102041230e04ef19fb455146f9e46f21c7d3619d08fb7c02aafaf05826b7"} Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.689525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jljwh" event={"ID":"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf","Type":"ContainerDied","Data":"cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b"} Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.689577 4769 generic.go:334] "Generic (PLEG): container finished" podID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerID="cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b" exitCode=0 Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.694944 4769 generic.go:334] "Generic (PLEG): container finished" podID="3254b787-2dd3-457f-8e6e-a03f04d6c5af" containerID="f1707873f39c5a9bf585f2448c136a5c2791439d0a157dbed6199c83e546a8af" exitCode=0 Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.695021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-qhsnf" event={"ID":"3254b787-2dd3-457f-8e6e-a03f04d6c5af","Type":"ContainerDied","Data":"f1707873f39c5a9bf585f2448c136a5c2791439d0a157dbed6199c83e546a8af"} Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.695049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-qhsnf" event={"ID":"3254b787-2dd3-457f-8e6e-a03f04d6c5af","Type":"ContainerStarted","Data":"a9978d7ab705f08186a25a890496151eaac602a06a52ccc55226eb4c0400d68d"} Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.699075 4769 generic.go:334] "Generic (PLEG): container finished" podID="e638ef75-a4f8-445f-91f1-2d47eb693038" containerID="15d0e05e829a4d0e84a20425cf37eb112d30fae365571b842cab35b2b18530c7" exitCode=0 Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.699120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cntr5" event={"ID":"e638ef75-a4f8-445f-91f1-2d47eb693038","Type":"ContainerDied","Data":"15d0e05e829a4d0e84a20425cf37eb112d30fae365571b842cab35b2b18530c7"} Nov 21 11:55:46 crc kubenswrapper[4769]: I1121 11:55:46.699163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cntr5" event={"ID":"e638ef75-a4f8-445f-91f1-2d47eb693038","Type":"ContainerStarted","Data":"3e2fb8b16adf2ce9e70a711d8614c0384b45fe7de8b0446575e1b43de87ecc78"} Nov 21 11:55:48 crc kubenswrapper[4769]: I1121 11:55:48.710057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cntr5" event={"ID":"e638ef75-a4f8-445f-91f1-2d47eb693038","Type":"ContainerStarted","Data":"ac8025b5624525957e41256c0d982a9df8965a3adda370c7c25315b14486d8ad"} Nov 21 11:55:48 crc kubenswrapper[4769]: I1121 11:55:48.713494 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-znfxh" event={"ID":"919dc4e0-b891-4dfa-a383-4b9105f36da3","Type":"ContainerStarted","Data":"e7396ea6ef773a6969581f3a365bcbc5068324b89178247d5caa35b11b4dc03d"} Nov 21 11:55:48 crc kubenswrapper[4769]: I1121 11:55:48.740764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jljwh" event={"ID":"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf","Type":"ContainerStarted","Data":"5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b"} Nov 21 11:55:48 crc kubenswrapper[4769]: I1121 11:55:48.759053 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-znfxh" podStartSLOduration=3.87271362 podStartE2EDuration="6.759028245s" podCreationTimestamp="2025-11-21 11:55:42 +0000 UTC" firstStartedPulling="2025-11-21 11:55:44.662264204 +0000 UTC m=+303.362926052" lastFinishedPulling="2025-11-21 11:55:47.548578859 +0000 UTC m=+306.249240677" observedRunningTime="2025-11-21 11:55:48.755080588 +0000 UTC m=+307.455742406" watchObservedRunningTime="2025-11-21 11:55:48.759028245 +0000 UTC m=+307.459690063" Nov 21 11:55:48 crc kubenswrapper[4769]: I1121 11:55:48.780251 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-jljwh" podStartSLOduration=3.516502155 podStartE2EDuration="6.780228849s" podCreationTimestamp="2025-11-21 11:55:42 +0000 UTC" firstStartedPulling="2025-11-21 11:55:44.666265262 +0000 UTC m=+303.366927090" lastFinishedPulling="2025-11-21 11:55:47.929991966 +0000 UTC m=+306.630653784" observedRunningTime="2025-11-21 11:55:48.779672474 +0000 UTC m=+307.480334292" watchObservedRunningTime="2025-11-21 11:55:48.780228849 +0000 UTC m=+307.480890667" Nov 21 11:55:49 crc kubenswrapper[4769]: I1121 11:55:49.747982 4769 generic.go:334] "Generic (PLEG): container finished" podID="3254b787-2dd3-457f-8e6e-a03f04d6c5af" containerID="102eded5e2f4644fe16327681ed85542c968e97638beeb72dac38c52839de8c0" exitCode=0 Nov 21 11:55:49 crc kubenswrapper[4769]: I1121 11:55:49.748252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-qhsnf" event={"ID":"3254b787-2dd3-457f-8e6e-a03f04d6c5af","Type":"ContainerDied","Data":"102eded5e2f4644fe16327681ed85542c968e97638beeb72dac38c52839de8c0"} Nov 21 11:55:49 crc kubenswrapper[4769]: I1121 11:55:49.751301 4769 generic.go:334] "Generic (PLEG): container finished" podID="e638ef75-a4f8-445f-91f1-2d47eb693038" containerID="ac8025b5624525957e41256c0d982a9df8965a3adda370c7c25315b14486d8ad" exitCode=0 Nov 21 11:55:49 crc kubenswrapper[4769]: I1121 11:55:49.752460 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cntr5" event={"ID":"e638ef75-a4f8-445f-91f1-2d47eb693038","Type":"ContainerDied","Data":"ac8025b5624525957e41256c0d982a9df8965a3adda370c7c25315b14486d8ad"} Nov 21 11:55:50 crc kubenswrapper[4769]: I1121 11:55:50.762432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-qhsnf" event={"ID":"3254b787-2dd3-457f-8e6e-a03f04d6c5af","Type":"ContainerStarted","Data":"3f725882b96bb69c9c5efab14b77ebb05f710d867da42b4a8c3ab5e70add6073"} Nov 21 11:55:50 crc kubenswrapper[4769]: I1121 11:55:50.778432 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-qhsnf" podStartSLOduration=2.3393124419999998 podStartE2EDuration="5.778400044s" podCreationTimestamp="2025-11-21 11:55:45 +0000 UTC" firstStartedPulling="2025-11-21 11:55:46.696425914 +0000 UTC m=+305.397087732" lastFinishedPulling="2025-11-21 11:55:50.135513516 +0000 UTC m=+308.836175334" observedRunningTime="2025-11-21 11:55:50.777292414 +0000 UTC m=+309.477954232" watchObservedRunningTime="2025-11-21 11:55:50.778400044 +0000 UTC m=+309.479061862" Nov 21 11:55:51 crc kubenswrapper[4769]: I1121 11:55:51.770477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cntr5" event={"ID":"e638ef75-a4f8-445f-91f1-2d47eb693038","Type":"ContainerStarted","Data":"375bae4b2e8aa363c6da75cd78da469408705115cdbe7afe73db57f6b6bc3546"} Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.109815 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-cntr5" podStartSLOduration=4.059033788 podStartE2EDuration="8.109799533s" podCreationTimestamp="2025-11-21 11:55:45 +0000 UTC" firstStartedPulling="2025-11-21 11:55:46.702108468 +0000 UTC m=+305.402770286" lastFinishedPulling="2025-11-21 11:55:50.752874213 +0000 UTC m=+309.453536031" observedRunningTime="2025-11-21 11:55:51.78976922 +0000 UTC m=+310.490431038" watchObservedRunningTime="2025-11-21 11:55:53.109799533 +0000 UTC m=+311.810461351" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.110318 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66df7c8f76-pqwkh"] Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.110951 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.121649 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.122496 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.129685 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66df7c8f76-pqwkh"] Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.173503 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.281863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160e146d-4572-410c-a64f-0c130b15e52f-installation-pull-secrets\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160e146d-4572-410c-a64f-0c130b15e52f-registry-certificates\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-registry-tls\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn85j\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-kube-api-access-tn85j\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-bound-sa-token\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160e146d-4572-410c-a64f-0c130b15e52f-ca-trust-extracted\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.282319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160e146d-4572-410c-a64f-0c130b15e52f-trusted-ca\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.303673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.334601 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.335727 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.371817 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.383493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-bound-sa-token\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.383563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160e146d-4572-410c-a64f-0c130b15e52f-ca-trust-extracted\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.383615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160e146d-4572-410c-a64f-0c130b15e52f-trusted-ca\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.383649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160e146d-4572-410c-a64f-0c130b15e52f-installation-pull-secrets\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.383708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160e146d-4572-410c-a64f-0c130b15e52f-registry-certificates\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.383735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-registry-tls\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.384883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160e146d-4572-410c-a64f-0c130b15e52f-ca-trust-extracted\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.385687 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tn85j\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-kube-api-access-tn85j\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.386998 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160e146d-4572-410c-a64f-0c130b15e52f-registry-certificates\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.387515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160e146d-4572-410c-a64f-0c130b15e52f-trusted-ca\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.393570 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-registry-tls\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.393669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160e146d-4572-410c-a64f-0c130b15e52f-installation-pull-secrets\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.403782 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-bound-sa-token\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.414688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn85j\" (UniqueName: \"kubernetes.io/projected/160e146d-4572-410c-a64f-0c130b15e52f-kube-api-access-tn85j\") pod \"image-registry-66df7c8f76-pqwkh\" (UID: \"160e146d-4572-410c-a64f-0c130b15e52f\") " pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.425437 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.631439 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66df7c8f76-pqwkh"] Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.782556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" event={"ID":"160e146d-4572-410c-a64f-0c130b15e52f","Type":"ContainerStarted","Data":"7225f7bfc0addb59ccb7dad703913f9da39160916e8d7257862a650fddd1d5d8"} Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.831818 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-jljwh" Nov 21 11:55:53 crc kubenswrapper[4769]: I1121 11:55:53.841383 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-znfxh" Nov 21 11:55:54 crc kubenswrapper[4769]: I1121 11:55:54.790374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" event={"ID":"160e146d-4572-410c-a64f-0c130b15e52f","Type":"ContainerStarted","Data":"2a27aceceb3d03c93b49d6a8d34509359cbad2cf80fda8219129213e7ef6c9e8"} Nov 21 11:55:54 crc kubenswrapper[4769]: I1121 11:55:54.793138 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:55:54 crc kubenswrapper[4769]: I1121 11:55:54.817810 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" podStartSLOduration=1.817780941 podStartE2EDuration="1.817780941s" podCreationTimestamp="2025-11-21 11:55:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:55:54.814581365 +0000 UTC m=+313.515243183" watchObservedRunningTime="2025-11-21 11:55:54.817780941 +0000 UTC m=+313.518442759" Nov 21 11:55:55 crc kubenswrapper[4769]: I1121 11:55:55.534112 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:55 crc kubenswrapper[4769]: I1121 11:55:55.534526 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:55:55 crc kubenswrapper[4769]: I1121 11:55:55.723940 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:55 crc kubenswrapper[4769]: I1121 11:55:55.723990 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:55 crc kubenswrapper[4769]: I1121 11:55:55.762905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:55 crc kubenswrapper[4769]: I1121 11:55:55.851676 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-qhsnf" Nov 21 11:55:56 crc kubenswrapper[4769]: I1121 11:55:56.583074 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-cntr5" podUID="e638ef75-a4f8-445f-91f1-2d47eb693038" containerName="registry-server" probeResult="failure" output=< Nov 21 11:55:56 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 11:55:56 crc kubenswrapper[4769]: > Nov 21 11:56:05 crc kubenswrapper[4769]: I1121 11:56:05.600835 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:56:05 crc kubenswrapper[4769]: I1121 11:56:05.649736 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-cntr5" Nov 21 11:56:07 crc kubenswrapper[4769]: I1121 11:56:07.251259 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" containerID="cri-o://8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb" gracePeriod=15 Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.569730 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603586 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/05bac206-a644-40c0-98fd-f7de5869bec1-audit-dir\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603661 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-service-ca\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603704 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-session\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-trusted-ca-bundle\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-router-certs\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-error\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-login\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-cliconfig\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-ocp-branding-template\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-provider-selection\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-audit-policies\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-serving-cert\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.603984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt6qt\" (UniqueName: \"kubernetes.io/projected/05bac206-a644-40c0-98fd-f7de5869bec1-kube-api-access-zt6qt\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.604003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-idp-0-file-data\") pod \"05bac206-a644-40c0-98fd-f7de5869bec1\" (UID: \"05bac206-a644-40c0-98fd-f7de5869bec1\") " Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.605526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.605813 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.606161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/05bac206-a644-40c0-98fd-f7de5869bec1-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.606596 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.608279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.614130 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q"] Nov 21 11:56:09 crc kubenswrapper[4769]: E1121 11:56:09.614436 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.614450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.614587 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" containerName="oauth-openshift" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.615354 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.617492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.618097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.622496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05bac206-a644-40c0-98fd-f7de5869bec1-kube-api-access-zt6qt" (OuterVolumeSpecName: "kube-api-access-zt6qt") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "kube-api-access-zt6qt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.626849 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.628761 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.635771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.639611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q"] Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.641078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.641422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-idp-0-file-data" (OuterVolumeSpecName: "v4-0-config-user-idp-0-file-data") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-user-idp-0-file-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.649651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "05bac206-a644-40c0-98fd-f7de5869bec1" (UID: "05bac206-a644-40c0-98fd-f7de5869bec1"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-login\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-serving-cert\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-error\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rggsc\" (UniqueName: \"kubernetes.io/projected/d52f163f-fe64-449c-b8e2-10cd13db5a8b-kube-api-access-rggsc\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.707984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-audit-policies\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d52f163f-fe64-449c-b8e2-10cd13db5a8b-audit-dir\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-router-certs\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-cliconfig\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-session\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-service-ca\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708712 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-cliconfig\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708755 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-ocp-branding-template\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708773 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-provider-selection\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708789 4769 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-audit-policies\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708823 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708840 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zt6qt\" (UniqueName: \"kubernetes.io/projected/05bac206-a644-40c0-98fd-f7de5869bec1-kube-api-access-zt6qt\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708851 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-idp-0-file-data\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708864 4769 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/05bac206-a644-40c0-98fd-f7de5869bec1-audit-dir\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708893 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-service-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708908 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-session\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708923 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708936 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-system-router-certs\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708949 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-error\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.708980 4769 reconciler_common.go:293] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/05bac206-a644-40c0-98fd-f7de5869bec1-v4-0-config-user-template-login\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-error\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rggsc\" (UniqueName: \"kubernetes.io/projected/d52f163f-fe64-449c-b8e2-10cd13db5a8b-kube-api-access-rggsc\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-audit-policies\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d52f163f-fe64-449c-b8e2-10cd13db5a8b-audit-dir\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-router-certs\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-cliconfig\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810750 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-session\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-service-ca\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810876 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810940 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810967 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-login\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.810992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-serving-cert\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.811721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d52f163f-fe64-449c-b8e2-10cd13db5a8b-audit-dir\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.811741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-audit-policies\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.811869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-cliconfig\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.811890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-service-ca\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.813384 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.814373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.814412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-error\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.819597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.819780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-session\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.819969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-user-template-login\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.820058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-serving-cert\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.820650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.820989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/d52f163f-fe64-449c-b8e2-10cd13db5a8b-v4-0-config-system-router-certs\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.833949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rggsc\" (UniqueName: \"kubernetes.io/projected/d52f163f-fe64-449c-b8e2-10cd13db5a8b-kube-api-access-rggsc\") pod \"oauth-openshift-7fdcdd74b7-2gk8q\" (UID: \"d52f163f-fe64-449c-b8e2-10cd13db5a8b\") " pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.888494 4769 generic.go:334] "Generic (PLEG): container finished" podID="05bac206-a644-40c0-98fd-f7de5869bec1" containerID="8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb" exitCode=0 Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.888547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" event={"ID":"05bac206-a644-40c0-98fd-f7de5869bec1","Type":"ContainerDied","Data":"8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb"} Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.888589 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" event={"ID":"05bac206-a644-40c0-98fd-f7de5869bec1","Type":"ContainerDied","Data":"5f0b0ae7dae2e8d87d24b31d89bda32c545496cff5aea885a4084fde07ec19be"} Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.888608 4769 scope.go:117] "RemoveContainer" containerID="8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.888762 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-558db77b4-dppfh" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.917213 4769 scope.go:117] "RemoveContainer" containerID="8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb" Nov 21 11:56:09 crc kubenswrapper[4769]: E1121 11:56:09.917658 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb\": container with ID starting with 8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb not found: ID does not exist" containerID="8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.917685 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb"} err="failed to get container status \"8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb\": rpc error: code = NotFound desc = could not find container \"8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb\": container with ID starting with 8a830dcd812c8103f6f11718bc45d602fe76ba03aab6344beb10f1db1ec844eb not found: ID does not exist" Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.926489 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-558db77b4-dppfh"] Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.930803 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-authentication/oauth-openshift-558db77b4-dppfh"] Nov 21 11:56:09 crc kubenswrapper[4769]: I1121 11:56:09.997341 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.236835 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q"] Nov 21 11:56:10 crc kubenswrapper[4769]: W1121 11:56:10.244522 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52f163f_fe64_449c_b8e2_10cd13db5a8b.slice/crio-b6cd38401b884b5ab026a29318387881b48c26882ca281c2b826681afd6c5ba3 WatchSource:0}: Error finding container b6cd38401b884b5ab026a29318387881b48c26882ca281c2b826681afd6c5ba3: Status 404 returned error can't find the container with id b6cd38401b884b5ab026a29318387881b48c26882ca281c2b826681afd6c5ba3 Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.898563 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" event={"ID":"d52f163f-fe64-449c-b8e2-10cd13db5a8b","Type":"ContainerStarted","Data":"d6f237c03d97dd5f5e956893543dc551359b2fee1516e8a2af3a700ba09d3422"} Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.899327 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.899341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" event={"ID":"d52f163f-fe64-449c-b8e2-10cd13db5a8b","Type":"ContainerStarted","Data":"b6cd38401b884b5ab026a29318387881b48c26882ca281c2b826681afd6c5ba3"} Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.901498 4769 patch_prober.go:28] interesting pod/oauth-openshift-7fdcdd74b7-2gk8q container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.217.0.61:6443/healthz\": dial tcp 10.217.0.61:6443: connect: connection refused" start-of-body= Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.901567 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" podUID="d52f163f-fe64-449c-b8e2-10cd13db5a8b" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.217.0.61:6443/healthz\": dial tcp 10.217.0.61:6443: connect: connection refused" Nov 21 11:56:10 crc kubenswrapper[4769]: I1121 11:56:10.923434 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" podStartSLOduration=28.923398734 podStartE2EDuration="28.923398734s" podCreationTimestamp="2025-11-21 11:55:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 11:56:10.918939323 +0000 UTC m=+329.619601161" watchObservedRunningTime="2025-11-21 11:56:10.923398734 +0000 UTC m=+329.624060572" Nov 21 11:56:11 crc kubenswrapper[4769]: I1121 11:56:11.281253 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05bac206-a644-40c0-98fd-f7de5869bec1" path="/var/lib/kubelet/pods/05bac206-a644-40c0-98fd-f7de5869bec1/volumes" Nov 21 11:56:11 crc kubenswrapper[4769]: I1121 11:56:11.910833 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-7fdcdd74b7-2gk8q" Nov 21 11:56:13 crc kubenswrapper[4769]: I1121 11:56:13.433649 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66df7c8f76-pqwkh" Nov 21 11:56:13 crc kubenswrapper[4769]: I1121 11:56:13.495384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-697d97f7c8-4h62k"] Nov 21 11:56:38 crc kubenswrapper[4769]: I1121 11:56:38.537205 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" podUID="250e4b5d-38a4-4026-bd4e-2532f525067b" containerName="registry" containerID="cri-o://9f5fb96db9727b03973c0c2989f8d3219bb1302ef29dc531bc64c3768aee71d4" gracePeriod=30 Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.101303 4769 generic.go:334] "Generic (PLEG): container finished" podID="250e4b5d-38a4-4026-bd4e-2532f525067b" containerID="9f5fb96db9727b03973c0c2989f8d3219bb1302ef29dc531bc64c3768aee71d4" exitCode=0 Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.101373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" event={"ID":"250e4b5d-38a4-4026-bd4e-2532f525067b","Type":"ContainerDied","Data":"9f5fb96db9727b03973c0c2989f8d3219bb1302ef29dc531bc64c3768aee71d4"} Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.528647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.630935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjc68\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-kube-api-access-zjc68\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-bound-sa-token\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/250e4b5d-38a4-4026-bd4e-2532f525067b-installation-pull-secrets\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/250e4b5d-38a4-4026-bd4e-2532f525067b-ca-trust-extracted\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-certificates\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-trusted-ca\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"registry-storage\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.631919 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-tls\") pod \"250e4b5d-38a4-4026-bd4e-2532f525067b\" (UID: \"250e4b5d-38a4-4026-bd4e-2532f525067b\") " Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.632256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.632317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.632679 4769 reconciler_common.go:293] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-certificates\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.632701 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/250e4b5d-38a4-4026-bd4e-2532f525067b-trusted-ca\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.640403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-kube-api-access-zjc68" (OuterVolumeSpecName: "kube-api-access-zjc68") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "kube-api-access-zjc68". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.640822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250e4b5d-38a4-4026-bd4e-2532f525067b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.648438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250e4b5d-38a4-4026-bd4e-2532f525067b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.648617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.648828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.650072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8" (OuterVolumeSpecName: "registry-storage") pod "250e4b5d-38a4-4026-bd4e-2532f525067b" (UID: "250e4b5d-38a4-4026-bd4e-2532f525067b"). InnerVolumeSpecName "pvc-657094db-63f1-4ba8-9a24-edca0e80b7a8". PluginName "kubernetes.io/csi", VolumeGidValue "" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.734001 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zjc68\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-kube-api-access-zjc68\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.734079 4769 reconciler_common.go:293] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-bound-sa-token\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.734093 4769 reconciler_common.go:293] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/250e4b5d-38a4-4026-bd4e-2532f525067b-installation-pull-secrets\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.734104 4769 reconciler_common.go:293] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/250e4b5d-38a4-4026-bd4e-2532f525067b-ca-trust-extracted\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:39 crc kubenswrapper[4769]: I1121 11:56:39.734153 4769 reconciler_common.go:293] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/250e4b5d-38a4-4026-bd4e-2532f525067b-registry-tls\") on node \"crc\" DevicePath \"\"" Nov 21 11:56:40 crc kubenswrapper[4769]: I1121 11:56:40.110875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" event={"ID":"250e4b5d-38a4-4026-bd4e-2532f525067b","Type":"ContainerDied","Data":"e4487849cc339b5622a52d092887233d1773db6fae9e7303111523f939823d61"} Nov 21 11:56:40 crc kubenswrapper[4769]: I1121 11:56:40.110967 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697d97f7c8-4h62k" Nov 21 11:56:40 crc kubenswrapper[4769]: I1121 11:56:40.110973 4769 scope.go:117] "RemoveContainer" containerID="9f5fb96db9727b03973c0c2989f8d3219bb1302ef29dc531bc64c3768aee71d4" Nov 21 11:56:40 crc kubenswrapper[4769]: I1121 11:56:40.160871 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-697d97f7c8-4h62k"] Nov 21 11:56:40 crc kubenswrapper[4769]: I1121 11:56:40.164698 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-697d97f7c8-4h62k"] Nov 21 11:56:41 crc kubenswrapper[4769]: I1121 11:56:41.288661 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="250e4b5d-38a4-4026-bd4e-2532f525067b" path="/var/lib/kubelet/pods/250e4b5d-38a4-4026-bd4e-2532f525067b/volumes" Nov 21 11:56:41 crc kubenswrapper[4769]: I1121 11:56:41.325610 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 11:56:41 crc kubenswrapper[4769]: I1121 11:56:41.325758 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 11:57:11 crc kubenswrapper[4769]: I1121 11:57:11.325856 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 11:57:11 crc kubenswrapper[4769]: I1121 11:57:11.326903 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.325749 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.328028 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.328699 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.330344 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"8167935c0ed9841b8ce33f0385a5fe567b3f53dcd4f2f34d0bf81b0f17ca696f"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.330664 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://8167935c0ed9841b8ce33f0385a5fe567b3f53dcd4f2f34d0bf81b0f17ca696f" gracePeriod=600 Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.552978 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="8167935c0ed9841b8ce33f0385a5fe567b3f53dcd4f2f34d0bf81b0f17ca696f" exitCode=0 Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.553178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"8167935c0ed9841b8ce33f0385a5fe567b3f53dcd4f2f34d0bf81b0f17ca696f"} Nov 21 11:57:41 crc kubenswrapper[4769]: I1121 11:57:41.554261 4769 scope.go:117] "RemoveContainer" containerID="097a41de05c8052f314ccd1f8c67cc1f8da280b99d567fe1bb61400ff6720929" Nov 21 11:57:42 crc kubenswrapper[4769]: I1121 11:57:42.583052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"887f5564b40c73de7979d3f3ddd12d3f7f7ef6835c010b75f11f1469313c5c6f"} Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.154696 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5"] Nov 21 12:00:00 crc kubenswrapper[4769]: E1121 12:00:00.155825 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="250e4b5d-38a4-4026-bd4e-2532f525067b" containerName="registry" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.155845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="250e4b5d-38a4-4026-bd4e-2532f525067b" containerName="registry" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.155995 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="250e4b5d-38a4-4026-bd4e-2532f525067b" containerName="registry" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.156501 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.158577 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.158770 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.174205 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5"] Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.251174 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvt4p\" (UniqueName: \"kubernetes.io/projected/7507241b-946d-4fce-8c24-7088de77f34f-kube-api-access-vvt4p\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.251315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7507241b-946d-4fce-8c24-7088de77f34f-secret-volume\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.251348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7507241b-946d-4fce-8c24-7088de77f34f-config-volume\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.353007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vvt4p\" (UniqueName: \"kubernetes.io/projected/7507241b-946d-4fce-8c24-7088de77f34f-kube-api-access-vvt4p\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.353087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7507241b-946d-4fce-8c24-7088de77f34f-secret-volume\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.353116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7507241b-946d-4fce-8c24-7088de77f34f-config-volume\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.354068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7507241b-946d-4fce-8c24-7088de77f34f-config-volume\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.360915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7507241b-946d-4fce-8c24-7088de77f34f-secret-volume\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.372341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvt4p\" (UniqueName: \"kubernetes.io/projected/7507241b-946d-4fce-8c24-7088de77f34f-kube-api-access-vvt4p\") pod \"collect-profiles-29395440-dgkf5\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.495756 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:00 crc kubenswrapper[4769]: I1121 12:00:00.702992 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5"] Nov 21 12:00:01 crc kubenswrapper[4769]: I1121 12:00:01.597165 4769 generic.go:334] "Generic (PLEG): container finished" podID="7507241b-946d-4fce-8c24-7088de77f34f" containerID="2fd2f37a46a5fa04eaa37bc9029917dc693b30eadcddce8516bf8400cb58ab6d" exitCode=0 Nov 21 12:00:01 crc kubenswrapper[4769]: I1121 12:00:01.597292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" event={"ID":"7507241b-946d-4fce-8c24-7088de77f34f","Type":"ContainerDied","Data":"2fd2f37a46a5fa04eaa37bc9029917dc693b30eadcddce8516bf8400cb58ab6d"} Nov 21 12:00:01 crc kubenswrapper[4769]: I1121 12:00:01.597636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" event={"ID":"7507241b-946d-4fce-8c24-7088de77f34f","Type":"ContainerStarted","Data":"48ae2f1a9303ca361924f518577e91d202e172c383f888ffe27874802149a9df"} Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.852956 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.988329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvt4p\" (UniqueName: \"kubernetes.io/projected/7507241b-946d-4fce-8c24-7088de77f34f-kube-api-access-vvt4p\") pod \"7507241b-946d-4fce-8c24-7088de77f34f\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.988417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7507241b-946d-4fce-8c24-7088de77f34f-secret-volume\") pod \"7507241b-946d-4fce-8c24-7088de77f34f\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.988445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7507241b-946d-4fce-8c24-7088de77f34f-config-volume\") pod \"7507241b-946d-4fce-8c24-7088de77f34f\" (UID: \"7507241b-946d-4fce-8c24-7088de77f34f\") " Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.989633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7507241b-946d-4fce-8c24-7088de77f34f-config-volume" (OuterVolumeSpecName: "config-volume") pod "7507241b-946d-4fce-8c24-7088de77f34f" (UID: "7507241b-946d-4fce-8c24-7088de77f34f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.996557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7507241b-946d-4fce-8c24-7088de77f34f-kube-api-access-vvt4p" (OuterVolumeSpecName: "kube-api-access-vvt4p") pod "7507241b-946d-4fce-8c24-7088de77f34f" (UID: "7507241b-946d-4fce-8c24-7088de77f34f"). InnerVolumeSpecName "kube-api-access-vvt4p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:00:02 crc kubenswrapper[4769]: I1121 12:00:02.996980 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7507241b-946d-4fce-8c24-7088de77f34f-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "7507241b-946d-4fce-8c24-7088de77f34f" (UID: "7507241b-946d-4fce-8c24-7088de77f34f"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:00:03 crc kubenswrapper[4769]: I1121 12:00:03.090137 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vvt4p\" (UniqueName: \"kubernetes.io/projected/7507241b-946d-4fce-8c24-7088de77f34f-kube-api-access-vvt4p\") on node \"crc\" DevicePath \"\"" Nov 21 12:00:03 crc kubenswrapper[4769]: I1121 12:00:03.090181 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/7507241b-946d-4fce-8c24-7088de77f34f-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:00:03 crc kubenswrapper[4769]: I1121 12:00:03.090203 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7507241b-946d-4fce-8c24-7088de77f34f-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:00:03 crc kubenswrapper[4769]: I1121 12:00:03.612028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" event={"ID":"7507241b-946d-4fce-8c24-7088de77f34f","Type":"ContainerDied","Data":"48ae2f1a9303ca361924f518577e91d202e172c383f888ffe27874802149a9df"} Nov 21 12:00:03 crc kubenswrapper[4769]: I1121 12:00:03.612078 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48ae2f1a9303ca361924f518577e91d202e172c383f888ffe27874802149a9df" Nov 21 12:00:03 crc kubenswrapper[4769]: I1121 12:00:03.612146 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5" Nov 21 12:00:11 crc kubenswrapper[4769]: I1121 12:00:11.325773 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:00:11 crc kubenswrapper[4769]: I1121 12:00:11.326580 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:00:41 crc kubenswrapper[4769]: I1121 12:00:41.325407 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:00:41 crc kubenswrapper[4769]: I1121 12:00:41.326006 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:01:11 crc kubenswrapper[4769]: I1121 12:01:11.326018 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:01:11 crc kubenswrapper[4769]: I1121 12:01:11.326961 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:01:11 crc kubenswrapper[4769]: I1121 12:01:11.327040 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:01:11 crc kubenswrapper[4769]: I1121 12:01:11.328010 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"887f5564b40c73de7979d3f3ddd12d3f7f7ef6835c010b75f11f1469313c5c6f"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:01:11 crc kubenswrapper[4769]: I1121 12:01:11.328123 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://887f5564b40c73de7979d3f3ddd12d3f7f7ef6835c010b75f11f1469313c5c6f" gracePeriod=600 Nov 21 12:01:12 crc kubenswrapper[4769]: I1121 12:01:12.109270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"887f5564b40c73de7979d3f3ddd12d3f7f7ef6835c010b75f11f1469313c5c6f"} Nov 21 12:01:12 crc kubenswrapper[4769]: I1121 12:01:12.109229 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="887f5564b40c73de7979d3f3ddd12d3f7f7ef6835c010b75f11f1469313c5c6f" exitCode=0 Nov 21 12:01:12 crc kubenswrapper[4769]: I1121 12:01:12.109626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"e5789956c423cd2670b5d2eab5d80c7e96e666ff7427886e39b71bbafc7c2c2d"} Nov 21 12:01:12 crc kubenswrapper[4769]: I1121 12:01:12.110013 4769 scope.go:117] "RemoveContainer" containerID="8167935c0ed9841b8ce33f0385a5fe567b3f53dcd4f2f34d0bf81b0f17ca696f" Nov 21 12:01:46 crc kubenswrapper[4769]: I1121 12:01:46.678385 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-879f6c89f-2shtf"] Nov 21 12:01:46 crc kubenswrapper[4769]: I1121 12:01:46.679599 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerName="controller-manager" containerID="cri-o://c13ffd0d764305417e1b095293243dcad4fec3843fc9b617f176b36c25c5328b" gracePeriod=30 Nov 21 12:01:46 crc kubenswrapper[4769]: I1121 12:01:46.790320 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6"] Nov 21 12:01:46 crc kubenswrapper[4769]: I1121 12:01:46.791115 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerName="route-controller-manager" containerID="cri-o://ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848" gracePeriod=30 Nov 21 12:01:46 crc kubenswrapper[4769]: I1121 12:01:46.847614 4769 generic.go:334] "Generic (PLEG): container finished" podID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerID="c13ffd0d764305417e1b095293243dcad4fec3843fc9b617f176b36c25c5328b" exitCode=0 Nov 21 12:01:46 crc kubenswrapper[4769]: I1121 12:01:46.847705 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" event={"ID":"fbd1960b-a86a-4f6b-88da-bd98023c6b25","Type":"ContainerDied","Data":"c13ffd0d764305417e1b095293243dcad4fec3843fc9b617f176b36c25c5328b"} Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.161304 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.196310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-config\") pod \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.196355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psbgn\" (UniqueName: \"kubernetes.io/projected/fbd1960b-a86a-4f6b-88da-bd98023c6b25-kube-api-access-psbgn\") pod \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.196396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-client-ca\") pod \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.196464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbd1960b-a86a-4f6b-88da-bd98023c6b25-serving-cert\") pod \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.196484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-proxy-ca-bundles\") pod \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\" (UID: \"fbd1960b-a86a-4f6b-88da-bd98023c6b25\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.197626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "fbd1960b-a86a-4f6b-88da-bd98023c6b25" (UID: "fbd1960b-a86a-4f6b-88da-bd98023c6b25"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.197723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-client-ca" (OuterVolumeSpecName: "client-ca") pod "fbd1960b-a86a-4f6b-88da-bd98023c6b25" (UID: "fbd1960b-a86a-4f6b-88da-bd98023c6b25"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.197763 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-config" (OuterVolumeSpecName: "config") pod "fbd1960b-a86a-4f6b-88da-bd98023c6b25" (UID: "fbd1960b-a86a-4f6b-88da-bd98023c6b25"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.204792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbd1960b-a86a-4f6b-88da-bd98023c6b25-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "fbd1960b-a86a-4f6b-88da-bd98023c6b25" (UID: "fbd1960b-a86a-4f6b-88da-bd98023c6b25"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.205475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd1960b-a86a-4f6b-88da-bd98023c6b25-kube-api-access-psbgn" (OuterVolumeSpecName: "kube-api-access-psbgn") pod "fbd1960b-a86a-4f6b-88da-bd98023c6b25" (UID: "fbd1960b-a86a-4f6b-88da-bd98023c6b25"). InnerVolumeSpecName "kube-api-access-psbgn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.219638 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8xjc\" (UniqueName: \"kubernetes.io/projected/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-kube-api-access-v8xjc\") pod \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298250 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-client-ca\") pod \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-config\") pod \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-serving-cert\") pod \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\" (UID: \"b038a4c1-8138-4fe7-8363-cb3319e5e9f6\") " Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298740 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbd1960b-a86a-4f6b-88da-bd98023c6b25-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298760 4769 reconciler_common.go:293] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298772 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298783 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-psbgn\" (UniqueName: \"kubernetes.io/projected/fbd1960b-a86a-4f6b-88da-bd98023c6b25-kube-api-access-psbgn\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.298793 4769 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/fbd1960b-a86a-4f6b-88da-bd98023c6b25-client-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.299283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-client-ca" (OuterVolumeSpecName: "client-ca") pod "b038a4c1-8138-4fe7-8363-cb3319e5e9f6" (UID: "b038a4c1-8138-4fe7-8363-cb3319e5e9f6"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.299427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-config" (OuterVolumeSpecName: "config") pod "b038a4c1-8138-4fe7-8363-cb3319e5e9f6" (UID: "b038a4c1-8138-4fe7-8363-cb3319e5e9f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.303111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-kube-api-access-v8xjc" (OuterVolumeSpecName: "kube-api-access-v8xjc") pod "b038a4c1-8138-4fe7-8363-cb3319e5e9f6" (UID: "b038a4c1-8138-4fe7-8363-cb3319e5e9f6"). InnerVolumeSpecName "kube-api-access-v8xjc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.303243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "b038a4c1-8138-4fe7-8363-cb3319e5e9f6" (UID: "b038a4c1-8138-4fe7-8363-cb3319e5e9f6"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.400100 4769 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.400149 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v8xjc\" (UniqueName: \"kubernetes.io/projected/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-kube-api-access-v8xjc\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.400163 4769 reconciler_common.go:293] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-client-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.400173 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b038a4c1-8138-4fe7-8363-cb3319e5e9f6-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.855619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" event={"ID":"fbd1960b-a86a-4f6b-88da-bd98023c6b25","Type":"ContainerDied","Data":"1a674eeb1db97d983b963fa8bd02976a48ef7599840949bae36157f3c12d96a5"} Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.855678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-879f6c89f-2shtf" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.855718 4769 scope.go:117] "RemoveContainer" containerID="c13ffd0d764305417e1b095293243dcad4fec3843fc9b617f176b36c25c5328b" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.858654 4769 generic.go:334] "Generic (PLEG): container finished" podID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerID="ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848" exitCode=0 Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.858746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" event={"ID":"b038a4c1-8138-4fe7-8363-cb3319e5e9f6","Type":"ContainerDied","Data":"ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848"} Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.858813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" event={"ID":"b038a4c1-8138-4fe7-8363-cb3319e5e9f6","Type":"ContainerDied","Data":"c1d62150d573b4afc03a4347da720287bd6784fb407e6d1559b641c641e280f5"} Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.858941 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.890019 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-879f6c89f-2shtf"] Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.891946 4769 scope.go:117] "RemoveContainer" containerID="ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.898085 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-879f6c89f-2shtf"] Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.912954 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6"] Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.916106 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-6576b87f9c-vmgf6"] Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.920704 4769 scope.go:117] "RemoveContainer" containerID="ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848" Nov 21 12:01:47 crc kubenswrapper[4769]: E1121 12:01:47.921514 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848\": container with ID starting with ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848 not found: ID does not exist" containerID="ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848" Nov 21 12:01:47 crc kubenswrapper[4769]: I1121 12:01:47.921566 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848"} err="failed to get container status \"ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848\": rpc error: code = NotFound desc = could not find container \"ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848\": container with ID starting with ec1f5a394c19f76eb5411eaa2324224e9df5bd458b212f77202056cba55b4848 not found: ID does not exist" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.740912 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf"] Nov 21 12:01:48 crc kubenswrapper[4769]: E1121 12:01:48.741418 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerName="route-controller-manager" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.741442 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerName="route-controller-manager" Nov 21 12:01:48 crc kubenswrapper[4769]: E1121 12:01:48.741469 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7507241b-946d-4fce-8c24-7088de77f34f" containerName="collect-profiles" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.741483 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7507241b-946d-4fce-8c24-7088de77f34f" containerName="collect-profiles" Nov 21 12:01:48 crc kubenswrapper[4769]: E1121 12:01:48.741502 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerName="controller-manager" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.741516 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerName="controller-manager" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.741713 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" containerName="controller-manager" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.741734 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" containerName="route-controller-manager" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.741760 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7507241b-946d-4fce-8c24-7088de77f34f" containerName="collect-profiles" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.742624 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.743348 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh"] Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.744225 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.745697 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.747516 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.747809 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.748160 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.748548 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.748577 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-msq4c" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.748860 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.750808 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.751335 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.751739 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-h2zr2" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.752570 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.753351 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.759482 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh"] Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.762376 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.772601 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf"] Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.927496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ea889d-a63b-4630-b24e-f539d4668a53-client-ca\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.927552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-488qm\" (UniqueName: \"kubernetes.io/projected/a1ea889d-a63b-4630-b24e-f539d4668a53-kube-api-access-488qm\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.927643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ea889d-a63b-4630-b24e-f539d4668a53-serving-cert\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.927678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ggr\" (UniqueName: \"kubernetes.io/projected/d63baba9-067c-4fb9-af8f-b04359d146ab-kube-api-access-f8ggr\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.927708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-proxy-ca-bundles\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.927743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1ea889d-a63b-4630-b24e-f539d4668a53-config\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.928080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-client-ca\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.928219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d63baba9-067c-4fb9-af8f-b04359d146ab-serving-cert\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:48 crc kubenswrapper[4769]: I1121 12:01:48.928405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-config\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030559 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-config\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ea889d-a63b-4630-b24e-f539d4668a53-client-ca\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-488qm\" (UniqueName: \"kubernetes.io/projected/a1ea889d-a63b-4630-b24e-f539d4668a53-kube-api-access-488qm\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ea889d-a63b-4630-b24e-f539d4668a53-serving-cert\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ggr\" (UniqueName: \"kubernetes.io/projected/d63baba9-067c-4fb9-af8f-b04359d146ab-kube-api-access-f8ggr\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-proxy-ca-bundles\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1ea889d-a63b-4630-b24e-f539d4668a53-config\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.030968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-client-ca\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.031006 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d63baba9-067c-4fb9-af8f-b04359d146ab-serving-cert\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.032734 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-config\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.034269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ea889d-a63b-4630-b24e-f539d4668a53-client-ca\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.035268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-client-ca\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.035467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1ea889d-a63b-4630-b24e-f539d4668a53-config\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.035630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/d63baba9-067c-4fb9-af8f-b04359d146ab-proxy-ca-bundles\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.039375 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d63baba9-067c-4fb9-af8f-b04359d146ab-serving-cert\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.040261 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1ea889d-a63b-4630-b24e-f539d4668a53-serving-cert\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.052573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-488qm\" (UniqueName: \"kubernetes.io/projected/a1ea889d-a63b-4630-b24e-f539d4668a53-kube-api-access-488qm\") pod \"route-controller-manager-df45cbcff-98zgf\" (UID: \"a1ea889d-a63b-4630-b24e-f539d4668a53\") " pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.064423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ggr\" (UniqueName: \"kubernetes.io/projected/d63baba9-067c-4fb9-af8f-b04359d146ab-kube-api-access-f8ggr\") pod \"controller-manager-85fbd89bb6-8xzgh\" (UID: \"d63baba9-067c-4fb9-af8f-b04359d146ab\") " pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.080023 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.098891 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.289330 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b038a4c1-8138-4fe7-8363-cb3319e5e9f6" path="/var/lib/kubelet/pods/b038a4c1-8138-4fe7-8363-cb3319e5e9f6/volumes" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.290676 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd1960b-a86a-4f6b-88da-bd98023c6b25" path="/var/lib/kubelet/pods/fbd1960b-a86a-4f6b-88da-bd98023c6b25/volumes" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.305131 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf"] Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.353914 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh"] Nov 21 12:01:49 crc kubenswrapper[4769]: W1121 12:01:49.365346 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63baba9_067c_4fb9_af8f_b04359d146ab.slice/crio-101a5aac9bc7b44cf5217ac18830a75b9cefb813856fecc2f3300b4341d1f900 WatchSource:0}: Error finding container 101a5aac9bc7b44cf5217ac18830a75b9cefb813856fecc2f3300b4341d1f900: Status 404 returned error can't find the container with id 101a5aac9bc7b44cf5217ac18830a75b9cefb813856fecc2f3300b4341d1f900 Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.879120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" event={"ID":"a1ea889d-a63b-4630-b24e-f539d4668a53","Type":"ContainerStarted","Data":"20f7d2a5520649d7b8a40926fc2279fff7f5e1d85a578f9c44c379b97d1c1b7b"} Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.879640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" event={"ID":"a1ea889d-a63b-4630-b24e-f539d4668a53","Type":"ContainerStarted","Data":"1b06c7ef50aba2387d242543b63214b2ac4c9c0afecf396d4284c27a7a4be32f"} Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.882103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" event={"ID":"d63baba9-067c-4fb9-af8f-b04359d146ab","Type":"ContainerStarted","Data":"43c1bc1d378a2120f623a8649348e8548ae8bd9c58ca3d87f81d7c44e717f486"} Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.882174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" event={"ID":"d63baba9-067c-4fb9-af8f-b04359d146ab","Type":"ContainerStarted","Data":"101a5aac9bc7b44cf5217ac18830a75b9cefb813856fecc2f3300b4341d1f900"} Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.882454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.890734 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.901158 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" podStartSLOduration=3.901133087 podStartE2EDuration="3.901133087s" podCreationTimestamp="2025-11-21 12:01:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:01:49.900642044 +0000 UTC m=+668.601303882" watchObservedRunningTime="2025-11-21 12:01:49.901133087 +0000 UTC m=+668.601794905" Nov 21 12:01:49 crc kubenswrapper[4769]: I1121 12:01:49.924856 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-85fbd89bb6-8xzgh" podStartSLOduration=3.924832309 podStartE2EDuration="3.924832309s" podCreationTimestamp="2025-11-21 12:01:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:01:49.919348728 +0000 UTC m=+668.620010546" watchObservedRunningTime="2025-11-21 12:01:49.924832309 +0000 UTC m=+668.625494127" Nov 21 12:01:50 crc kubenswrapper[4769]: I1121 12:01:50.888959 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:50 crc kubenswrapper[4769]: I1121 12:01:50.895393 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-df45cbcff-98zgf" Nov 21 12:01:53 crc kubenswrapper[4769]: I1121 12:01:53.389532 4769 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.371820 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ttpjb"] Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373272 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-controller" containerID="cri-o://f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373406 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="nbdb" containerID="cri-o://886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373511 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-node" containerID="cri-o://b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373480 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="northd" containerID="cri-o://13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373601 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-acl-logging" containerID="cri-o://08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.373526 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="sbdb" containerID="cri-o://30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: I1121 12:02:12.431197 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovnkube-controller" containerID="cri-o://64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" gracePeriod=30 Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.509330 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.509480 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.514985 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.515060 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.516492 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"] Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.516539 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="nbdb" Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.516727 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"] Nov 21 12:02:12 crc kubenswrapper[4769]: E1121 12:02:12.516864 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="sbdb" Nov 21 12:02:13 crc kubenswrapper[4769]: I1121 12:02:13.033800 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttpjb_a4af5aab-f4cc-4735-a602-fcf7ab2108f6/ovn-acl-logging/0.log" Nov 21 12:02:13 crc kubenswrapper[4769]: I1121 12:02:13.034975 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" exitCode=143 Nov 21 12:02:13 crc kubenswrapper[4769]: I1121 12:02:13.035044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} Nov 21 12:02:13 crc kubenswrapper[4769]: I1121 12:02:13.935380 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttpjb_a4af5aab-f4cc-4735-a602-fcf7ab2108f6/ovn-acl-logging/0.log" Nov 21 12:02:13 crc kubenswrapper[4769]: I1121 12:02:13.936436 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttpjb_a4af5aab-f4cc-4735-a602-fcf7ab2108f6/ovn-controller/0.log" Nov 21 12:02:13 crc kubenswrapper[4769]: I1121 12:02:13.937035 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.006760 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-lhpbq"] Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007038 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="nbdb" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007058 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="nbdb" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007076 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-acl-logging" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007083 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-acl-logging" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007091 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovnkube-controller" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovnkube-controller" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007114 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kubecfg-setup" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007121 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kubecfg-setup" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007133 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-node" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007141 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-node" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007151 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-controller" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007159 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-controller" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="sbdb" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007175 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="sbdb" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007205 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="northd" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="northd" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.007222 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-ovn-metrics" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007230 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-ovn-metrics" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007355 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-acl-logging" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007369 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="sbdb" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007383 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovnkube-controller" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007395 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-node" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007404 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="ovn-controller" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007412 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="nbdb" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007423 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="northd" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.007432 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerName="kube-rbac-proxy-ovn-metrics" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.010054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-log-socket\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-etc-openvswitch\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-var-lib-openvswitch\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-ovn\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpvql\" (UniqueName: \"kubernetes.io/projected/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-kube-api-access-wpvql\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.012971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-slash\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-script-lib\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-netd\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-bin\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-systemd\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-node-log\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013281 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-kubelet\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-systemd-units\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-openvswitch\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-ovn-kubernetes\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-slash" (OuterVolumeSpecName: "host-slash") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-netns\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013461 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-env-overrides\") pod \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\" (UID: \"a4af5aab-f4cc-4735-a602-fcf7ab2108f6\") " Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013780 4769 reconciler_common.go:293] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-slash\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013805 4769 reconciler_common.go:293] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-netd\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.013832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.014359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.014413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.015584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.015635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-node-log" (OuterVolumeSpecName: "node-log") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-log-socket" (OuterVolumeSpecName: "log-socket") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.016481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.021431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.025949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-kube-api-access-wpvql" (OuterVolumeSpecName: "kube-api-access-wpvql") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "kube-api-access-wpvql". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.045437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "a4af5aab-f4cc-4735-a602-fcf7ab2108f6" (UID: "a4af5aab-f4cc-4735-a602-fcf7ab2108f6"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.046990 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttpjb_a4af5aab-f4cc-4735-a602-fcf7ab2108f6/ovn-acl-logging/0.log" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047402 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttpjb_a4af5aab-f4cc-4735-a602-fcf7ab2108f6/ovn-controller/0.log" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047670 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" exitCode=0 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047698 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" exitCode=0 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047705 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" exitCode=0 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047713 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" exitCode=0 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047719 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" exitCode=0 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047727 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" exitCode=0 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047734 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" exitCode=143 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047851 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047862 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047868 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047890 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047896 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047902 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047907 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047914 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047919 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047925 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047930 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047936 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" event={"ID":"a4af5aab-f4cc-4735-a602-fcf7ab2108f6","Type":"ContainerDied","Data":"b53479502155e88e4704a022f3ad959bdc5c0cffe27e1996aa8f2b57c0b0b17d"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047951 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047957 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047963 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047967 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047973 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047977 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047983 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047988 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.047993 4769 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.048007 4769 scope.go:117] "RemoveContainer" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.048138 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttpjb" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.057391 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t78n2_ac430206-6dc1-40e3-829c-e7d9b2cd5fc0/kube-multus/0.log" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.057471 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac430206-6dc1-40e3-829c-e7d9b2cd5fc0" containerID="6991a02e6c39470c98e11845cbefb9cdf2eccbc0d201d30f7af27fab782f40af" exitCode=2 Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.057527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t78n2" event={"ID":"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0","Type":"ContainerDied","Data":"6991a02e6c39470c98e11845cbefb9cdf2eccbc0d201d30f7af27fab782f40af"} Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.058247 4769 scope.go:117] "RemoveContainer" containerID="6991a02e6c39470c98e11845cbefb9cdf2eccbc0d201d30f7af27fab782f40af" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.090111 4769 scope.go:117] "RemoveContainer" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.103858 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ttpjb"] Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-cni-bin\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-log-socket\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovn-node-metrics-cert\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnf59\" (UniqueName: \"kubernetes.io/projected/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-kube-api-access-nnf59\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-kubelet\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-ovn\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-cni-netd\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovnkube-script-lib\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.116970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-systemd\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-run-netns\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-systemd-units\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-node-log\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-env-overrides\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117165 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-etc-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117211 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovnkube-config\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-slash\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-var-lib-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117332 4769 reconciler_common.go:293] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-log-socket\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117352 4769 reconciler_common.go:293] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-var-lib-cni-networks-ovn-kubernetes\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117366 4769 reconciler_common.go:293] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-etc-openvswitch\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117380 4769 reconciler_common.go:293] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-var-lib-openvswitch\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117395 4769 reconciler_common.go:293] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117408 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wpvql\" (UniqueName: \"kubernetes.io/projected/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-kube-api-access-wpvql\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117422 4769 reconciler_common.go:293] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-script-lib\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117435 4769 reconciler_common.go:293] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-cni-bin\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117447 4769 reconciler_common.go:293] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-systemd\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117461 4769 reconciler_common.go:293] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-node-log\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117475 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovn-node-metrics-cert\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117488 4769 reconciler_common.go:293] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-kubelet\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117504 4769 reconciler_common.go:293] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-ovnkube-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117518 4769 reconciler_common.go:293] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-systemd-units\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117531 4769 reconciler_common.go:293] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-run-openvswitch\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117545 4769 reconciler_common.go:293] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-ovn-kubernetes\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117557 4769 reconciler_common.go:293] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-host-run-netns\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.117569 4769 reconciler_common.go:293] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4af5aab-f4cc-4735-a602-fcf7ab2108f6-env-overrides\") on node \"crc\" DevicePath \"\"" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.120439 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ttpjb"] Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.129105 4769 scope.go:117] "RemoveContainer" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.150295 4769 scope.go:117] "RemoveContainer" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.174067 4769 scope.go:117] "RemoveContainer" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.190112 4769 scope.go:117] "RemoveContainer" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.204002 4769 scope.go:117] "RemoveContainer" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.217906 4769 scope.go:117] "RemoveContainer" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-kubelet\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-ovn\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-cni-netd\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovnkube-script-lib\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-systemd\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-ovn\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218378 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-run-netns\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-systemd-units\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-cni-netd\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-node-log\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-run-netns\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-env-overrides\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-etc-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovnkube-config\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-slash\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-etc-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-var-lib-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-kubelet\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-systemd-units\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-node-log\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-systemd\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-var-lib-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-slash\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-cni-bin\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.218989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-run-openvswitch\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-log-socket\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-log-socket\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-cni-bin\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovn-node-metrics-cert\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nnf59\" (UniqueName: \"kubernetes.io/projected/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-kube-api-access-nnf59\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.219650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-env-overrides\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.220203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovnkube-config\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.220281 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovnkube-script-lib\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.228140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-ovn-node-metrics-cert\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.237126 4769 scope.go:117] "RemoveContainer" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.237515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnf59\" (UniqueName: \"kubernetes.io/projected/5ed086a0-2e2c-4f7e-9d03-e68c07b6932c-kube-api-access-nnf59\") pod \"ovnkube-node-lhpbq\" (UID: \"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.254351 4769 scope.go:117] "RemoveContainer" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.255061 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": container with ID starting with 64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6 not found: ID does not exist" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.255145 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} err="failed to get container status \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": rpc error: code = NotFound desc = could not find container \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": container with ID starting with 64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.255210 4769 scope.go:117] "RemoveContainer" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.255734 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": container with ID starting with 30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60 not found: ID does not exist" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.255760 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} err="failed to get container status \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": rpc error: code = NotFound desc = could not find container \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": container with ID starting with 30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.255774 4769 scope.go:117] "RemoveContainer" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.256327 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": container with ID starting with 886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b not found: ID does not exist" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.256350 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} err="failed to get container status \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": rpc error: code = NotFound desc = could not find container \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": container with ID starting with 886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.256363 4769 scope.go:117] "RemoveContainer" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.256702 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": container with ID starting with 13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6 not found: ID does not exist" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.256795 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} err="failed to get container status \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": rpc error: code = NotFound desc = could not find container \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": container with ID starting with 13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.256866 4769 scope.go:117] "RemoveContainer" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.257615 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": container with ID starting with eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11 not found: ID does not exist" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.257645 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} err="failed to get container status \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": rpc error: code = NotFound desc = could not find container \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": container with ID starting with eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.257662 4769 scope.go:117] "RemoveContainer" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.257985 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": container with ID starting with b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90 not found: ID does not exist" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.258025 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} err="failed to get container status \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": rpc error: code = NotFound desc = could not find container \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": container with ID starting with b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.258056 4769 scope.go:117] "RemoveContainer" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.258478 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": container with ID starting with 08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8 not found: ID does not exist" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.258544 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} err="failed to get container status \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": rpc error: code = NotFound desc = could not find container \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": container with ID starting with 08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.258582 4769 scope.go:117] "RemoveContainer" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.259002 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": container with ID starting with f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5 not found: ID does not exist" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.259034 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} err="failed to get container status \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": rpc error: code = NotFound desc = could not find container \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": container with ID starting with f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.259063 4769 scope.go:117] "RemoveContainer" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" Nov 21 12:02:14 crc kubenswrapper[4769]: E1121 12:02:14.259436 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": container with ID starting with 7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda not found: ID does not exist" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.259472 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} err="failed to get container status \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": rpc error: code = NotFound desc = could not find container \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": container with ID starting with 7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.259497 4769 scope.go:117] "RemoveContainer" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.259802 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} err="failed to get container status \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": rpc error: code = NotFound desc = could not find container \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": container with ID starting with 64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.259832 4769 scope.go:117] "RemoveContainer" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.260143 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} err="failed to get container status \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": rpc error: code = NotFound desc = could not find container \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": container with ID starting with 30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.260168 4769 scope.go:117] "RemoveContainer" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.260550 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} err="failed to get container status \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": rpc error: code = NotFound desc = could not find container \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": container with ID starting with 886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.260580 4769 scope.go:117] "RemoveContainer" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.260893 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} err="failed to get container status \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": rpc error: code = NotFound desc = could not find container \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": container with ID starting with 13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.260943 4769 scope.go:117] "RemoveContainer" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.261338 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} err="failed to get container status \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": rpc error: code = NotFound desc = could not find container \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": container with ID starting with eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.261359 4769 scope.go:117] "RemoveContainer" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.261691 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} err="failed to get container status \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": rpc error: code = NotFound desc = could not find container \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": container with ID starting with b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.261738 4769 scope.go:117] "RemoveContainer" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.262127 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} err="failed to get container status \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": rpc error: code = NotFound desc = could not find container \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": container with ID starting with 08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.262151 4769 scope.go:117] "RemoveContainer" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.262752 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} err="failed to get container status \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": rpc error: code = NotFound desc = could not find container \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": container with ID starting with f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.262778 4769 scope.go:117] "RemoveContainer" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.263163 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} err="failed to get container status \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": rpc error: code = NotFound desc = could not find container \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": container with ID starting with 7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.263332 4769 scope.go:117] "RemoveContainer" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.263750 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} err="failed to get container status \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": rpc error: code = NotFound desc = could not find container \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": container with ID starting with 64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.263774 4769 scope.go:117] "RemoveContainer" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.264573 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} err="failed to get container status \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": rpc error: code = NotFound desc = could not find container \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": container with ID starting with 30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.264631 4769 scope.go:117] "RemoveContainer" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.265124 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} err="failed to get container status \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": rpc error: code = NotFound desc = could not find container \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": container with ID starting with 886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.265180 4769 scope.go:117] "RemoveContainer" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.265621 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} err="failed to get container status \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": rpc error: code = NotFound desc = could not find container \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": container with ID starting with 13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.265650 4769 scope.go:117] "RemoveContainer" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.266002 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} err="failed to get container status \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": rpc error: code = NotFound desc = could not find container \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": container with ID starting with eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.266058 4769 scope.go:117] "RemoveContainer" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.266406 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} err="failed to get container status \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": rpc error: code = NotFound desc = could not find container \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": container with ID starting with b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.266445 4769 scope.go:117] "RemoveContainer" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.266838 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} err="failed to get container status \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": rpc error: code = NotFound desc = could not find container \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": container with ID starting with 08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.266921 4769 scope.go:117] "RemoveContainer" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.267331 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} err="failed to get container status \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": rpc error: code = NotFound desc = could not find container \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": container with ID starting with f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.267358 4769 scope.go:117] "RemoveContainer" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.267718 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} err="failed to get container status \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": rpc error: code = NotFound desc = could not find container \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": container with ID starting with 7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.267742 4769 scope.go:117] "RemoveContainer" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.268031 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} err="failed to get container status \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": rpc error: code = NotFound desc = could not find container \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": container with ID starting with 64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.268071 4769 scope.go:117] "RemoveContainer" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.268563 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} err="failed to get container status \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": rpc error: code = NotFound desc = could not find container \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": container with ID starting with 30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.268611 4769 scope.go:117] "RemoveContainer" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.269021 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} err="failed to get container status \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": rpc error: code = NotFound desc = could not find container \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": container with ID starting with 886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.269051 4769 scope.go:117] "RemoveContainer" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.269382 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} err="failed to get container status \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": rpc error: code = NotFound desc = could not find container \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": container with ID starting with 13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.269414 4769 scope.go:117] "RemoveContainer" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.270063 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} err="failed to get container status \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": rpc error: code = NotFound desc = could not find container \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": container with ID starting with eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.270093 4769 scope.go:117] "RemoveContainer" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.270486 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} err="failed to get container status \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": rpc error: code = NotFound desc = could not find container \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": container with ID starting with b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.270545 4769 scope.go:117] "RemoveContainer" containerID="08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.270966 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8"} err="failed to get container status \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": rpc error: code = NotFound desc = could not find container \"08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8\": container with ID starting with 08426a1d1b2742f9f8078d8e2422473a23dda46a8386d4e54eef4786cb900ba8 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.271025 4769 scope.go:117] "RemoveContainer" containerID="f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.271452 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5"} err="failed to get container status \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": rpc error: code = NotFound desc = could not find container \"f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5\": container with ID starting with f9a801903ce3d8aef0c96b18fcad8483574818ae64ebfe3d51485ec34c9e46c5 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.271482 4769 scope.go:117] "RemoveContainer" containerID="7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.272061 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda"} err="failed to get container status \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": rpc error: code = NotFound desc = could not find container \"7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda\": container with ID starting with 7a500e31b6eebd5d30c260b6b83b378f0a74e512934776f71e6a6f7fe9b03eda not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.272103 4769 scope.go:117] "RemoveContainer" containerID="64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.272557 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6"} err="failed to get container status \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": rpc error: code = NotFound desc = could not find container \"64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6\": container with ID starting with 64b537209722c17005956b339093b7dea55334e7fb991481053e0f4f278b88b6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.272598 4769 scope.go:117] "RemoveContainer" containerID="30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.273131 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60"} err="failed to get container status \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": rpc error: code = NotFound desc = could not find container \"30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60\": container with ID starting with 30b49cc1cd20154cca2d9861209d4ea9945200f1209e8bdf56623892ec98ec60 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.273169 4769 scope.go:117] "RemoveContainer" containerID="886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.273522 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b"} err="failed to get container status \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": rpc error: code = NotFound desc = could not find container \"886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b\": container with ID starting with 886c6a047587f2f408f6e61ccc3d162cb9814a7cecdfde4817d62c8ecb1d2c1b not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.273563 4769 scope.go:117] "RemoveContainer" containerID="13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.274066 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6"} err="failed to get container status \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": rpc error: code = NotFound desc = could not find container \"13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6\": container with ID starting with 13e0fbec64f33933371ba2b09b37953c6f671b405289e9ac1cfd6f2eb2e6f9e6 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.274099 4769 scope.go:117] "RemoveContainer" containerID="eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.274480 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11"} err="failed to get container status \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": rpc error: code = NotFound desc = could not find container \"eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11\": container with ID starting with eb30f95ea2b505d307929bebd47122d86537003ea28836ae0ee77fc6975cec11 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.274514 4769 scope.go:117] "RemoveContainer" containerID="b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.274828 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90"} err="failed to get container status \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": rpc error: code = NotFound desc = could not find container \"b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90\": container with ID starting with b172931bb6bda7d411f5327bb5ba68860f170afd9861c378d5c73469b0722b90 not found: ID does not exist" Nov 21 12:02:14 crc kubenswrapper[4769]: I1121 12:02:14.389800 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:14 crc kubenswrapper[4769]: W1121 12:02:14.410314 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed086a0_2e2c_4f7e_9d03_e68c07b6932c.slice/crio-b050e631e2a599a8ce21274a06e45befc8e866cc036ae95ecc73e04c3a2585e3 WatchSource:0}: Error finding container b050e631e2a599a8ce21274a06e45befc8e866cc036ae95ecc73e04c3a2585e3: Status 404 returned error can't find the container with id b050e631e2a599a8ce21274a06e45befc8e866cc036ae95ecc73e04c3a2585e3 Nov 21 12:02:15 crc kubenswrapper[4769]: I1121 12:02:15.067945 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t78n2_ac430206-6dc1-40e3-829c-e7d9b2cd5fc0/kube-multus/0.log" Nov 21 12:02:15 crc kubenswrapper[4769]: I1121 12:02:15.068123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t78n2" event={"ID":"ac430206-6dc1-40e3-829c-e7d9b2cd5fc0","Type":"ContainerStarted","Data":"71695ea4d9da73b926b36cfe82fbacf70b27085474ab051e2f7d19daebd29e8d"} Nov 21 12:02:15 crc kubenswrapper[4769]: I1121 12:02:15.073528 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ed086a0-2e2c-4f7e-9d03-e68c07b6932c" containerID="6395468fd90d823d6a4fa6c7ef875187f09e3404cbf88b27aa10b7473d613499" exitCode=0 Nov 21 12:02:15 crc kubenswrapper[4769]: I1121 12:02:15.073595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerDied","Data":"6395468fd90d823d6a4fa6c7ef875187f09e3404cbf88b27aa10b7473d613499"} Nov 21 12:02:15 crc kubenswrapper[4769]: I1121 12:02:15.073640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"b050e631e2a599a8ce21274a06e45befc8e866cc036ae95ecc73e04c3a2585e3"} Nov 21 12:02:15 crc kubenswrapper[4769]: I1121 12:02:15.286840 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4af5aab-f4cc-4735-a602-fcf7ab2108f6" path="/var/lib/kubelet/pods/a4af5aab-f4cc-4735-a602-fcf7ab2108f6/volumes" Nov 21 12:02:16 crc kubenswrapper[4769]: I1121 12:02:16.081053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"42628dc409fd5f14f1fc7d1a0836e960f76f409c19772d8fa5a2cc22b583f653"} Nov 21 12:02:17 crc kubenswrapper[4769]: I1121 12:02:17.095048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"a1ee089b97219bb8b9165f914a842cb876a48b3daa7ca192e20c40439e1dff29"} Nov 21 12:02:17 crc kubenswrapper[4769]: I1121 12:02:17.095608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"c8be7eaa8e1f04a26f3950a64408872cae514f873efa14b94c80976c637383ce"} Nov 21 12:02:18 crc kubenswrapper[4769]: I1121 12:02:18.105059 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"bc55e13d0d135baae540d510ab7fa3d5568126e4d284bc91d79c25f994f92ea3"} Nov 21 12:02:18 crc kubenswrapper[4769]: I1121 12:02:18.105109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"fc2e80e200f7c0ad65b7625aa5051bb6da93b29ef5c4ad3393ae8c04a13353bd"} Nov 21 12:02:19 crc kubenswrapper[4769]: I1121 12:02:19.118663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"1dedbf95bb6f56d4c432d80b19e7a201cda72e17b2384223f761bcfab07c380b"} Nov 21 12:02:23 crc kubenswrapper[4769]: I1121 12:02:23.151808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"5213d9bc26ba9bac23abf8ba896f3d0f98e051a7dfdc1ba89124fb76a0167b33"} Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.177659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" event={"ID":"5ed086a0-2e2c-4f7e-9d03-e68c07b6932c","Type":"ContainerStarted","Data":"f8fbde617616d4da88b776a4e570a616cde493bb6029c3cad7da36e7f12b4ab6"} Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.180562 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.180584 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.180596 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.213654 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" podStartSLOduration=13.213632697 podStartE2EDuration="13.213632697s" podCreationTimestamp="2025-11-21 12:02:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:02:26.207784316 +0000 UTC m=+704.908446154" watchObservedRunningTime="2025-11-21 12:02:26.213632697 +0000 UTC m=+704.914294525" Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.214920 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:26 crc kubenswrapper[4769]: I1121 12:02:26.220020 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:44 crc kubenswrapper[4769]: I1121 12:02:44.471088 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhpbq" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.432837 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5"] Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.435535 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.437982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-vmwhc" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.443814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5"] Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.633644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-util\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.633765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-bundle\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.634619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh478\" (UniqueName: \"kubernetes.io/projected/8aeae799-2b20-4621-b9fb-d8b86ec76109-kube-api-access-wh478\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.736311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wh478\" (UniqueName: \"kubernetes.io/projected/8aeae799-2b20-4621-b9fb-d8b86ec76109-kube-api-access-wh478\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.736486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-util\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.736587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-bundle\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.737525 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-util\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.738821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-bundle\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:58 crc kubenswrapper[4769]: I1121 12:02:58.772065 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh478\" (UniqueName: \"kubernetes.io/projected/8aeae799-2b20-4621-b9fb-d8b86ec76109-kube-api-access-wh478\") pod \"5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:59 crc kubenswrapper[4769]: I1121 12:02:59.056846 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:02:59 crc kubenswrapper[4769]: I1121 12:02:59.557762 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5"] Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.414498 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" event={"ID":"8aeae799-2b20-4621-b9fb-d8b86ec76109","Type":"ContainerStarted","Data":"5a2d1e4dbfeafa82c4f69c3e5f61d9156872915dc01fa5c13c94fb71f6f743d9"} Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.414568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" event={"ID":"8aeae799-2b20-4621-b9fb-d8b86ec76109","Type":"ContainerStarted","Data":"e84fe4fe5a4dfbd5cc99cfd31e7fc087bf7f50fa991748c94ab75bef5de115ec"} Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.698620 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-wfjpk"] Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.700777 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.715409 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wfjpk"] Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.871228 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-utilities\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.871311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-catalog-content\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.871421 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9ch\" (UniqueName: \"kubernetes.io/projected/8bbaa46d-1213-4951-aa9d-7447dbc05db2-kube-api-access-5x9ch\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.972375 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-utilities\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.972430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-catalog-content\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.972464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9ch\" (UniqueName: \"kubernetes.io/projected/8bbaa46d-1213-4951-aa9d-7447dbc05db2-kube-api-access-5x9ch\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.973250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-utilities\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.973299 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-catalog-content\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:00 crc kubenswrapper[4769]: I1121 12:03:00.992911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9ch\" (UniqueName: \"kubernetes.io/projected/8bbaa46d-1213-4951-aa9d-7447dbc05db2-kube-api-access-5x9ch\") pod \"redhat-operators-wfjpk\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:01 crc kubenswrapper[4769]: I1121 12:03:01.035943 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:01 crc kubenswrapper[4769]: W1121 12:03:01.245593 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbaa46d_1213_4951_aa9d_7447dbc05db2.slice/crio-8e6eca6b3b75650829952be39820ebd1a1ede731e3115134ab7f86fa83c2ef19 WatchSource:0}: Error finding container 8e6eca6b3b75650829952be39820ebd1a1ede731e3115134ab7f86fa83c2ef19: Status 404 returned error can't find the container with id 8e6eca6b3b75650829952be39820ebd1a1ede731e3115134ab7f86fa83c2ef19 Nov 21 12:03:01 crc kubenswrapper[4769]: I1121 12:03:01.245927 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wfjpk"] Nov 21 12:03:01 crc kubenswrapper[4769]: I1121 12:03:01.421934 4769 generic.go:334] "Generic (PLEG): container finished" podID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerID="5a2d1e4dbfeafa82c4f69c3e5f61d9156872915dc01fa5c13c94fb71f6f743d9" exitCode=0 Nov 21 12:03:01 crc kubenswrapper[4769]: I1121 12:03:01.422069 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" event={"ID":"8aeae799-2b20-4621-b9fb-d8b86ec76109","Type":"ContainerDied","Data":"5a2d1e4dbfeafa82c4f69c3e5f61d9156872915dc01fa5c13c94fb71f6f743d9"} Nov 21 12:03:01 crc kubenswrapper[4769]: I1121 12:03:01.424329 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:03:01 crc kubenswrapper[4769]: I1121 12:03:01.424913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfjpk" event={"ID":"8bbaa46d-1213-4951-aa9d-7447dbc05db2","Type":"ContainerStarted","Data":"8e6eca6b3b75650829952be39820ebd1a1ede731e3115134ab7f86fa83c2ef19"} Nov 21 12:03:02 crc kubenswrapper[4769]: I1121 12:03:02.432314 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerID="dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d" exitCode=0 Nov 21 12:03:02 crc kubenswrapper[4769]: I1121 12:03:02.432488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfjpk" event={"ID":"8bbaa46d-1213-4951-aa9d-7447dbc05db2","Type":"ContainerDied","Data":"dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d"} Nov 21 12:03:03 crc kubenswrapper[4769]: I1121 12:03:03.441802 4769 generic.go:334] "Generic (PLEG): container finished" podID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerID="a47d3c00cde08cf22cb8fe287500440895435bb621277a39cdc59f5c6de497f8" exitCode=0 Nov 21 12:03:03 crc kubenswrapper[4769]: I1121 12:03:03.441869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" event={"ID":"8aeae799-2b20-4621-b9fb-d8b86ec76109","Type":"ContainerDied","Data":"a47d3c00cde08cf22cb8fe287500440895435bb621277a39cdc59f5c6de497f8"} Nov 21 12:03:04 crc kubenswrapper[4769]: I1121 12:03:04.451081 4769 generic.go:334] "Generic (PLEG): container finished" podID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerID="c96462184e1840be701e0bd6ea963af7662f9ab8b8a0bb21796e7f91d7289b90" exitCode=0 Nov 21 12:03:04 crc kubenswrapper[4769]: I1121 12:03:04.451175 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" event={"ID":"8aeae799-2b20-4621-b9fb-d8b86ec76109","Type":"ContainerDied","Data":"c96462184e1840be701e0bd6ea963af7662f9ab8b8a0bb21796e7f91d7289b90"} Nov 21 12:03:04 crc kubenswrapper[4769]: I1121 12:03:04.453677 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerID="87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f" exitCode=0 Nov 21 12:03:04 crc kubenswrapper[4769]: I1121 12:03:04.453730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfjpk" event={"ID":"8bbaa46d-1213-4951-aa9d-7447dbc05db2","Type":"ContainerDied","Data":"87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f"} Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.713129 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.844748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh478\" (UniqueName: \"kubernetes.io/projected/8aeae799-2b20-4621-b9fb-d8b86ec76109-kube-api-access-wh478\") pod \"8aeae799-2b20-4621-b9fb-d8b86ec76109\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.845266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-bundle\") pod \"8aeae799-2b20-4621-b9fb-d8b86ec76109\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.845434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-util\") pod \"8aeae799-2b20-4621-b9fb-d8b86ec76109\" (UID: \"8aeae799-2b20-4621-b9fb-d8b86ec76109\") " Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.846299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-bundle" (OuterVolumeSpecName: "bundle") pod "8aeae799-2b20-4621-b9fb-d8b86ec76109" (UID: "8aeae799-2b20-4621-b9fb-d8b86ec76109"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.852267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aeae799-2b20-4621-b9fb-d8b86ec76109-kube-api-access-wh478" (OuterVolumeSpecName: "kube-api-access-wh478") pod "8aeae799-2b20-4621-b9fb-d8b86ec76109" (UID: "8aeae799-2b20-4621-b9fb-d8b86ec76109"). InnerVolumeSpecName "kube-api-access-wh478". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.855994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-util" (OuterVolumeSpecName: "util") pod "8aeae799-2b20-4621-b9fb-d8b86ec76109" (UID: "8aeae799-2b20-4621-b9fb-d8b86ec76109"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.946952 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-util\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.947001 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wh478\" (UniqueName: \"kubernetes.io/projected/8aeae799-2b20-4621-b9fb-d8b86ec76109-kube-api-access-wh478\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:05 crc kubenswrapper[4769]: I1121 12:03:05.947014 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aeae799-2b20-4621-b9fb-d8b86ec76109-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:06 crc kubenswrapper[4769]: I1121 12:03:06.475362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" event={"ID":"8aeae799-2b20-4621-b9fb-d8b86ec76109","Type":"ContainerDied","Data":"e84fe4fe5a4dfbd5cc99cfd31e7fc087bf7f50fa991748c94ab75bef5de115ec"} Nov 21 12:03:06 crc kubenswrapper[4769]: I1121 12:03:06.475748 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e84fe4fe5a4dfbd5cc99cfd31e7fc087bf7f50fa991748c94ab75bef5de115ec" Nov 21 12:03:06 crc kubenswrapper[4769]: I1121 12:03:06.475445 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5c796334424b8139919e908729ac8fe5c1f6e7b6bc33540f00b4f8772eptcn5" Nov 21 12:03:07 crc kubenswrapper[4769]: I1121 12:03:07.487643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfjpk" event={"ID":"8bbaa46d-1213-4951-aa9d-7447dbc05db2","Type":"ContainerStarted","Data":"00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44"} Nov 21 12:03:07 crc kubenswrapper[4769]: I1121 12:03:07.513429 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-wfjpk" podStartSLOduration=3.677031151 podStartE2EDuration="7.513394139s" podCreationTimestamp="2025-11-21 12:03:00 +0000 UTC" firstStartedPulling="2025-11-21 12:03:02.44733377 +0000 UTC m=+741.147995588" lastFinishedPulling="2025-11-21 12:03:06.283696748 +0000 UTC m=+744.984358576" observedRunningTime="2025-11-21 12:03:07.509926653 +0000 UTC m=+746.210588511" watchObservedRunningTime="2025-11-21 12:03:07.513394139 +0000 UTC m=+746.214055957" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.224709 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-operator-557fdffb88-b6m5z"] Nov 21 12:03:08 crc kubenswrapper[4769]: E1121 12:03:08.224968 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="pull" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.224984 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="pull" Nov 21 12:03:08 crc kubenswrapper[4769]: E1121 12:03:08.225003 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="util" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.225011 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="util" Nov 21 12:03:08 crc kubenswrapper[4769]: E1121 12:03:08.225028 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="extract" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.225034 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="extract" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.225137 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8aeae799-2b20-4621-b9fb-d8b86ec76109" containerName="extract" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.225618 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.228104 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"nmstate-operator-dockercfg-2ctj2" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.234560 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"kube-root-ca.crt" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.234629 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"openshift-service-ca.crt" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.239938 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-557fdffb88-b6m5z"] Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.283338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7ch\" (UniqueName: \"kubernetes.io/projected/a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14-kube-api-access-dk7ch\") pod \"nmstate-operator-557fdffb88-b6m5z\" (UID: \"a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14\") " pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.384298 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7ch\" (UniqueName: \"kubernetes.io/projected/a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14-kube-api-access-dk7ch\") pod \"nmstate-operator-557fdffb88-b6m5z\" (UID: \"a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14\") " pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.408315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7ch\" (UniqueName: \"kubernetes.io/projected/a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14-kube-api-access-dk7ch\") pod \"nmstate-operator-557fdffb88-b6m5z\" (UID: \"a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14\") " pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" Nov 21 12:03:08 crc kubenswrapper[4769]: I1121 12:03:08.543099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" Nov 21 12:03:09 crc kubenswrapper[4769]: I1121 12:03:09.015553 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-557fdffb88-b6m5z"] Nov 21 12:03:09 crc kubenswrapper[4769]: W1121 12:03:09.036877 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08d7794_7b31_4ad8_8ff6_13e0c1fc0c14.slice/crio-b8cb2cdc85ed306b22dcede8c3f304e6788b67c3ede3b4a30005b3e6f831e6a6 WatchSource:0}: Error finding container b8cb2cdc85ed306b22dcede8c3f304e6788b67c3ede3b4a30005b3e6f831e6a6: Status 404 returned error can't find the container with id b8cb2cdc85ed306b22dcede8c3f304e6788b67c3ede3b4a30005b3e6f831e6a6 Nov 21 12:03:09 crc kubenswrapper[4769]: I1121 12:03:09.512539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" event={"ID":"a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14","Type":"ContainerStarted","Data":"b8cb2cdc85ed306b22dcede8c3f304e6788b67c3ede3b4a30005b3e6f831e6a6"} Nov 21 12:03:11 crc kubenswrapper[4769]: I1121 12:03:11.036770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:11 crc kubenswrapper[4769]: I1121 12:03:11.038578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:11 crc kubenswrapper[4769]: I1121 12:03:11.325872 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:03:11 crc kubenswrapper[4769]: I1121 12:03:11.325975 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:03:12 crc kubenswrapper[4769]: I1121 12:03:12.085902 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-wfjpk" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="registry-server" probeResult="failure" output=< Nov 21 12:03:12 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:03:12 crc kubenswrapper[4769]: > Nov 21 12:03:14 crc kubenswrapper[4769]: I1121 12:03:14.538485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" event={"ID":"a08d7794-7b31-4ad8-8ff6-13e0c1fc0c14","Type":"ContainerStarted","Data":"ca1975bece9cab497ced1f89c0f662d16f3ad40558614a4404faf3b46e08b15b"} Nov 21 12:03:15 crc kubenswrapper[4769]: I1121 12:03:15.572918 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-operator-557fdffb88-b6m5z" podStartSLOduration=2.256959605 podStartE2EDuration="7.572886082s" podCreationTimestamp="2025-11-21 12:03:08 +0000 UTC" firstStartedPulling="2025-11-21 12:03:09.039716076 +0000 UTC m=+747.740377894" lastFinishedPulling="2025-11-21 12:03:14.355642553 +0000 UTC m=+753.056304371" observedRunningTime="2025-11-21 12:03:15.572656135 +0000 UTC m=+754.273317993" watchObservedRunningTime="2025-11-21 12:03:15.572886082 +0000 UTC m=+754.273547940" Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.884894 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk"] Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.886976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.889847 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"nmstate-handler-dockercfg-mzn26" Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.891869 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk"] Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.893336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.896589 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk"] Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.900183 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"openshift-nmstate-webhook" Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.906781 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-handler-n55zp"] Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.923975 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:18 crc kubenswrapper[4769]: I1121 12:03:18.964314 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk"] Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.010387 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj"] Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.011473 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.017307 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"nginx-conf" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.017478 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"plugin-serving-cert" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.017322 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"default-dockercfg-xlqjn" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.032183 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj"] Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043218 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-ovs-socket\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prcpx\" (UniqueName: \"kubernetes.io/projected/59918c99-f792-475c-ac40-9ab74164c450-kube-api-access-prcpx\") pod \"nmstate-metrics-5dcf9c57c5-tbvdk\" (UID: \"59918c99-f792-475c-ac40-9ab74164c450\") " pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-dbus-socket\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043351 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab523f85-5168-4a96-8b7a-45cad2227f32-tls-key-pair\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043408 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-nmstate-lock\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5c9z\" (UniqueName: \"kubernetes.io/projected/ab523f85-5168-4a96-8b7a-45cad2227f32-kube-api-access-s5c9z\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.043483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blh8x\" (UniqueName: \"kubernetes.io/projected/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-kube-api-access-blh8x\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s5c9z\" (UniqueName: \"kubernetes.io/projected/ab523f85-5168-4a96-8b7a-45cad2227f32-kube-api-access-s5c9z\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42792a66-cbe1-47bb-b509-6d2101496881-plugin-serving-cert\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-blh8x\" (UniqueName: \"kubernetes.io/projected/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-kube-api-access-blh8x\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6j69\" (UniqueName: \"kubernetes.io/projected/42792a66-cbe1-47bb-b509-6d2101496881-kube-api-access-m6j69\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-ovs-socket\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-prcpx\" (UniqueName: \"kubernetes.io/projected/59918c99-f792-475c-ac40-9ab74164c450-kube-api-access-prcpx\") pod \"nmstate-metrics-5dcf9c57c5-tbvdk\" (UID: \"59918c99-f792-475c-ac40-9ab74164c450\") " pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-dbus-socket\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab523f85-5168-4a96-8b7a-45cad2227f32-tls-key-pair\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-ovs-socket\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-nmstate-lock\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-nmstate-lock\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.144836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42792a66-cbe1-47bb-b509-6d2101496881-nginx-conf\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: E1121 12:03:19.144965 4769 secret.go:188] Couldn't get secret openshift-nmstate/openshift-nmstate-webhook: secret "openshift-nmstate-webhook" not found Nov 21 12:03:19 crc kubenswrapper[4769]: E1121 12:03:19.145020 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab523f85-5168-4a96-8b7a-45cad2227f32-tls-key-pair podName:ab523f85-5168-4a96-8b7a-45cad2227f32 nodeName:}" failed. No retries permitted until 2025-11-21 12:03:19.645002404 +0000 UTC m=+758.345664222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-key-pair" (UniqueName: "kubernetes.io/secret/ab523f85-5168-4a96-8b7a-45cad2227f32-tls-key-pair") pod "nmstate-webhook-6b89b748d8-hg7wk" (UID: "ab523f85-5168-4a96-8b7a-45cad2227f32") : secret "openshift-nmstate-webhook" not found Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.145044 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-dbus-socket\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.162204 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5c9z\" (UniqueName: \"kubernetes.io/projected/ab523f85-5168-4a96-8b7a-45cad2227f32-kube-api-access-s5c9z\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.163793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-blh8x\" (UniqueName: \"kubernetes.io/projected/9c03b6ad-92f6-48e6-be54-6a1ed65682f6-kube-api-access-blh8x\") pod \"nmstate-handler-n55zp\" (UID: \"9c03b6ad-92f6-48e6-be54-6a1ed65682f6\") " pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.168386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-prcpx\" (UniqueName: \"kubernetes.io/projected/59918c99-f792-475c-ac40-9ab74164c450-kube-api-access-prcpx\") pod \"nmstate-metrics-5dcf9c57c5-tbvdk\" (UID: \"59918c99-f792-475c-ac40-9ab74164c450\") " pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.196880 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-db8dd7775-j4twd"] Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.197937 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.205486 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.212115 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8dd7775-j4twd"] Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.244109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.245837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42792a66-cbe1-47bb-b509-6d2101496881-nginx-conf\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.245911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42792a66-cbe1-47bb-b509-6d2101496881-plugin-serving-cert\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.245950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m6j69\" (UniqueName: \"kubernetes.io/projected/42792a66-cbe1-47bb-b509-6d2101496881-kube-api-access-m6j69\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.247170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42792a66-cbe1-47bb-b509-6d2101496881-nginx-conf\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.251390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42792a66-cbe1-47bb-b509-6d2101496881-plugin-serving-cert\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.269907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6j69\" (UniqueName: \"kubernetes.io/projected/42792a66-cbe1-47bb-b509-6d2101496881-kube-api-access-m6j69\") pod \"nmstate-console-plugin-5874bd7bc5-zv5mj\" (UID: \"42792a66-cbe1-47bb-b509-6d2101496881\") " pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: W1121 12:03:19.283431 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c03b6ad_92f6_48e6_be54_6a1ed65682f6.slice/crio-027f29938651203b3b00cf1f45d93279728a1eeae22beb19aebe485b53f5d59b WatchSource:0}: Error finding container 027f29938651203b3b00cf1f45d93279728a1eeae22beb19aebe485b53f5d59b: Status 404 returned error can't find the container with id 027f29938651203b3b00cf1f45d93279728a1eeae22beb19aebe485b53f5d59b Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.330939 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-oauth-serving-cert\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-oauth-config\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-service-ca\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqt5\" (UniqueName: \"kubernetes.io/projected/0b8c9b75-09cf-4a59-b23e-5832e044657f-kube-api-access-skqt5\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-trusted-ca-bundle\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-serving-cert\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.347650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-config\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.448850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-trusted-ca-bundle\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.448915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-serving-cert\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.448936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-config\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.448965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-oauth-serving-cert\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.448993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-oauth-config\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.449038 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-service-ca\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.449057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-skqt5\" (UniqueName: \"kubernetes.io/projected/0b8c9b75-09cf-4a59-b23e-5832e044657f-kube-api-access-skqt5\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.450475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-trusted-ca-bundle\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.451034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-oauth-serving-cert\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.451174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-config\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.451650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8c9b75-09cf-4a59-b23e-5832e044657f-service-ca\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.455858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-serving-cert\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.457712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8c9b75-09cf-4a59-b23e-5832e044657f-console-oauth-config\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.467970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqt5\" (UniqueName: \"kubernetes.io/projected/0b8c9b75-09cf-4a59-b23e-5832e044657f-kube-api-access-skqt5\") pod \"console-db8dd7775-j4twd\" (UID: \"0b8c9b75-09cf-4a59-b23e-5832e044657f\") " pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.567397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-n55zp" event={"ID":"9c03b6ad-92f6-48e6-be54-6a1ed65682f6","Type":"ContainerStarted","Data":"027f29938651203b3b00cf1f45d93279728a1eeae22beb19aebe485b53f5d59b"} Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.577878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.653032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab523f85-5168-4a96-8b7a-45cad2227f32-tls-key-pair\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.653230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk"] Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.658270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab523f85-5168-4a96-8b7a-45cad2227f32-tls-key-pair\") pod \"nmstate-webhook-6b89b748d8-hg7wk\" (UID: \"ab523f85-5168-4a96-8b7a-45cad2227f32\") " pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: W1121 12:03:19.660322 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59918c99_f792_475c_ac40_9ab74164c450.slice/crio-21e7372ac1aa33db36d9d70d74995c1ff122c98acda33897e27d8e6c309bb649 WatchSource:0}: Error finding container 21e7372ac1aa33db36d9d70d74995c1ff122c98acda33897e27d8e6c309bb649: Status 404 returned error can't find the container with id 21e7372ac1aa33db36d9d70d74995c1ff122c98acda33897e27d8e6c309bb649 Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.755155 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj"] Nov 21 12:03:19 crc kubenswrapper[4769]: W1121 12:03:19.761931 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42792a66_cbe1_47bb_b509_6d2101496881.slice/crio-d89375ecf36d43bdddf1947c1650d8ae07d56a65171ce5125d9685ec9d207b07 WatchSource:0}: Error finding container d89375ecf36d43bdddf1947c1650d8ae07d56a65171ce5125d9685ec9d207b07: Status 404 returned error can't find the container with id d89375ecf36d43bdddf1947c1650d8ae07d56a65171ce5125d9685ec9d207b07 Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.826109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:19 crc kubenswrapper[4769]: I1121 12:03:19.996680 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8dd7775-j4twd"] Nov 21 12:03:20 crc kubenswrapper[4769]: W1121 12:03:20.001396 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8c9b75_09cf_4a59_b23e_5832e044657f.slice/crio-0b49167a29c4a866af82ddf405e680a6ad08a8410d75914f317b9ddaf4935178 WatchSource:0}: Error finding container 0b49167a29c4a866af82ddf405e680a6ad08a8410d75914f317b9ddaf4935178: Status 404 returned error can't find the container with id 0b49167a29c4a866af82ddf405e680a6ad08a8410d75914f317b9ddaf4935178 Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.264653 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk"] Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.576374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" event={"ID":"59918c99-f792-475c-ac40-9ab74164c450","Type":"ContainerStarted","Data":"21e7372ac1aa33db36d9d70d74995c1ff122c98acda33897e27d8e6c309bb649"} Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.577592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" event={"ID":"ab523f85-5168-4a96-8b7a-45cad2227f32","Type":"ContainerStarted","Data":"df6a8f18572e013b3db4e98dd62c9f4b0023d5cea7e206f7eae2633a8b2d6eae"} Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.580284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8dd7775-j4twd" event={"ID":"0b8c9b75-09cf-4a59-b23e-5832e044657f","Type":"ContainerStarted","Data":"9be664014cb2d0c9b73b1fcada0354b8fbe5eb7031b8c234eb5e69104afade41"} Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.580350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8dd7775-j4twd" event={"ID":"0b8c9b75-09cf-4a59-b23e-5832e044657f","Type":"ContainerStarted","Data":"0b49167a29c4a866af82ddf405e680a6ad08a8410d75914f317b9ddaf4935178"} Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.582533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" event={"ID":"42792a66-cbe1-47bb-b509-6d2101496881","Type":"ContainerStarted","Data":"d89375ecf36d43bdddf1947c1650d8ae07d56a65171ce5125d9685ec9d207b07"} Nov 21 12:03:20 crc kubenswrapper[4769]: I1121 12:03:20.606591 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-db8dd7775-j4twd" podStartSLOduration=1.606552148 podStartE2EDuration="1.606552148s" podCreationTimestamp="2025-11-21 12:03:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:03:20.600859921 +0000 UTC m=+759.301521759" watchObservedRunningTime="2025-11-21 12:03:20.606552148 +0000 UTC m=+759.307214006" Nov 21 12:03:21 crc kubenswrapper[4769]: I1121 12:03:21.085604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:21 crc kubenswrapper[4769]: I1121 12:03:21.133407 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:21 crc kubenswrapper[4769]: I1121 12:03:21.319751 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wfjpk"] Nov 21 12:03:22 crc kubenswrapper[4769]: I1121 12:03:22.602390 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-wfjpk" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="registry-server" containerID="cri-o://00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44" gracePeriod=2 Nov 21 12:03:22 crc kubenswrapper[4769]: I1121 12:03:22.971881 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.114490 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-utilities\") pod \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.114564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-catalog-content\") pod \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.114658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x9ch\" (UniqueName: \"kubernetes.io/projected/8bbaa46d-1213-4951-aa9d-7447dbc05db2-kube-api-access-5x9ch\") pod \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\" (UID: \"8bbaa46d-1213-4951-aa9d-7447dbc05db2\") " Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.116458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-utilities" (OuterVolumeSpecName: "utilities") pod "8bbaa46d-1213-4951-aa9d-7447dbc05db2" (UID: "8bbaa46d-1213-4951-aa9d-7447dbc05db2"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.124330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bbaa46d-1213-4951-aa9d-7447dbc05db2-kube-api-access-5x9ch" (OuterVolumeSpecName: "kube-api-access-5x9ch") pod "8bbaa46d-1213-4951-aa9d-7447dbc05db2" (UID: "8bbaa46d-1213-4951-aa9d-7447dbc05db2"). InnerVolumeSpecName "kube-api-access-5x9ch". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.217346 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.217781 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5x9ch\" (UniqueName: \"kubernetes.io/projected/8bbaa46d-1213-4951-aa9d-7447dbc05db2-kube-api-access-5x9ch\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.219491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "8bbaa46d-1213-4951-aa9d-7447dbc05db2" (UID: "8bbaa46d-1213-4951-aa9d-7447dbc05db2"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.319593 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bbaa46d-1213-4951-aa9d-7447dbc05db2-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.613879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" event={"ID":"42792a66-cbe1-47bb-b509-6d2101496881","Type":"ContainerStarted","Data":"3fd9d5b57f5e0731ead3b958484373ef11ea7e00e25539ae29e7c5492dd28139"} Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.615866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-n55zp" event={"ID":"9c03b6ad-92f6-48e6-be54-6a1ed65682f6","Type":"ContainerStarted","Data":"2713f17e88014cd709835d0fffd27dc04a2d575d5a97ccb568478da1615c65aa"} Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.616032 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.619067 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerID="00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44" exitCode=0 Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.619144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfjpk" event={"ID":"8bbaa46d-1213-4951-aa9d-7447dbc05db2","Type":"ContainerDied","Data":"00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44"} Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.619145 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wfjpk" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.619178 4769 scope.go:117] "RemoveContainer" containerID="00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.619165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wfjpk" event={"ID":"8bbaa46d-1213-4951-aa9d-7447dbc05db2","Type":"ContainerDied","Data":"8e6eca6b3b75650829952be39820ebd1a1ede731e3115134ab7f86fa83c2ef19"} Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.621317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" event={"ID":"59918c99-f792-475c-ac40-9ab74164c450","Type":"ContainerStarted","Data":"a068e496090ab9c98532a870e52ccba0ecebbbf6cdc582777731171b2d917dde"} Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.622870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" event={"ID":"ab523f85-5168-4a96-8b7a-45cad2227f32","Type":"ContainerStarted","Data":"695b2fd851bc91bbe11f6f612ee1407f3f96a04a63c2fdbe522d1cc9c305aa2f"} Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.623814 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.639047 4769 scope.go:117] "RemoveContainer" containerID="87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.639637 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-console-plugin-5874bd7bc5-zv5mj" podStartSLOduration=2.838693189 podStartE2EDuration="5.639599782s" podCreationTimestamp="2025-11-21 12:03:18 +0000 UTC" firstStartedPulling="2025-11-21 12:03:19.764247991 +0000 UTC m=+758.464909809" lastFinishedPulling="2025-11-21 12:03:22.565154574 +0000 UTC m=+761.265816402" observedRunningTime="2025-11-21 12:03:23.635775287 +0000 UTC m=+762.336437105" watchObservedRunningTime="2025-11-21 12:03:23.639599782 +0000 UTC m=+762.340261620" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.671887 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" podStartSLOduration=3.378468028 podStartE2EDuration="5.6718521s" podCreationTimestamp="2025-11-21 12:03:18 +0000 UTC" firstStartedPulling="2025-11-21 12:03:20.271789753 +0000 UTC m=+758.972451571" lastFinishedPulling="2025-11-21 12:03:22.565173795 +0000 UTC m=+761.265835643" observedRunningTime="2025-11-21 12:03:23.668916679 +0000 UTC m=+762.369578517" watchObservedRunningTime="2025-11-21 12:03:23.6718521 +0000 UTC m=+762.372513918" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.691660 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wfjpk"] Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.694526 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-wfjpk"] Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.703427 4769 scope.go:117] "RemoveContainer" containerID="dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.705692 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-handler-n55zp" podStartSLOduration=2.433449383 podStartE2EDuration="5.705672681s" podCreationTimestamp="2025-11-21 12:03:18 +0000 UTC" firstStartedPulling="2025-11-21 12:03:19.289521392 +0000 UTC m=+757.990183210" lastFinishedPulling="2025-11-21 12:03:22.56174468 +0000 UTC m=+761.262406508" observedRunningTime="2025-11-21 12:03:23.704041386 +0000 UTC m=+762.404703224" watchObservedRunningTime="2025-11-21 12:03:23.705672681 +0000 UTC m=+762.406334489" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.737295 4769 scope.go:117] "RemoveContainer" containerID="00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44" Nov 21 12:03:23 crc kubenswrapper[4769]: E1121 12:03:23.737939 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44\": container with ID starting with 00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44 not found: ID does not exist" containerID="00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.737973 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44"} err="failed to get container status \"00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44\": rpc error: code = NotFound desc = could not find container \"00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44\": container with ID starting with 00c9b32e994404d22b3b03eeba7d32fcf8e2bfe13e4cd6cd12b051cff1485f44 not found: ID does not exist" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.737999 4769 scope.go:117] "RemoveContainer" containerID="87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f" Nov 21 12:03:23 crc kubenswrapper[4769]: E1121 12:03:23.738909 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f\": container with ID starting with 87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f not found: ID does not exist" containerID="87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.738985 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f"} err="failed to get container status \"87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f\": rpc error: code = NotFound desc = could not find container \"87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f\": container with ID starting with 87719aa4d7cee9f8c6dace7e67ca8741b1105bfcc12a9d7ffff639e562c2414f not found: ID does not exist" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.739040 4769 scope.go:117] "RemoveContainer" containerID="dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d" Nov 21 12:03:23 crc kubenswrapper[4769]: E1121 12:03:23.739551 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d\": container with ID starting with dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d not found: ID does not exist" containerID="dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d" Nov 21 12:03:23 crc kubenswrapper[4769]: I1121 12:03:23.739606 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d"} err="failed to get container status \"dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d\": rpc error: code = NotFound desc = could not find container \"dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d\": container with ID starting with dfe9622e20aadf63894da98acdbed582c6299bb8532885a9914a5f1947d77a4d not found: ID does not exist" Nov 21 12:03:25 crc kubenswrapper[4769]: I1121 12:03:25.284529 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" path="/var/lib/kubelet/pods/8bbaa46d-1213-4951-aa9d-7447dbc05db2/volumes" Nov 21 12:03:25 crc kubenswrapper[4769]: I1121 12:03:25.642244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" event={"ID":"59918c99-f792-475c-ac40-9ab74164c450","Type":"ContainerStarted","Data":"b2cb55f68280d0dcebceb07076e2f1fe1feea75e835a21621bd77990e125f2b6"} Nov 21 12:03:25 crc kubenswrapper[4769]: I1121 12:03:25.665633 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-metrics-5dcf9c57c5-tbvdk" podStartSLOduration=2.343760384 podStartE2EDuration="7.665616684s" podCreationTimestamp="2025-11-21 12:03:18 +0000 UTC" firstStartedPulling="2025-11-21 12:03:19.664837004 +0000 UTC m=+758.365498832" lastFinishedPulling="2025-11-21 12:03:24.986693314 +0000 UTC m=+763.687355132" observedRunningTime="2025-11-21 12:03:25.665277074 +0000 UTC m=+764.365938912" watchObservedRunningTime="2025-11-21 12:03:25.665616684 +0000 UTC m=+764.366278492" Nov 21 12:03:29 crc kubenswrapper[4769]: I1121 12:03:29.299573 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-handler-n55zp" Nov 21 12:03:29 crc kubenswrapper[4769]: I1121 12:03:29.578370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:29 crc kubenswrapper[4769]: I1121 12:03:29.578512 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:29 crc kubenswrapper[4769]: I1121 12:03:29.584663 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:29 crc kubenswrapper[4769]: I1121 12:03:29.672253 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db8dd7775-j4twd" Nov 21 12:03:29 crc kubenswrapper[4769]: I1121 12:03:29.737556 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9d7485db-9vb2t"] Nov 21 12:03:39 crc kubenswrapper[4769]: I1121 12:03:39.834361 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-webhook-6b89b748d8-hg7wk" Nov 21 12:03:41 crc kubenswrapper[4769]: I1121 12:03:41.325639 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:03:41 crc kubenswrapper[4769]: I1121 12:03:41.326036 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.385943 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl"] Nov 21 12:03:53 crc kubenswrapper[4769]: E1121 12:03:53.387614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="extract-utilities" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.387642 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="extract-utilities" Nov 21 12:03:53 crc kubenswrapper[4769]: E1121 12:03:53.387662 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="registry-server" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.387679 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="registry-server" Nov 21 12:03:53 crc kubenswrapper[4769]: E1121 12:03:53.387737 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="extract-content" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.387751 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="extract-content" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.387940 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8bbaa46d-1213-4951-aa9d-7447dbc05db2" containerName="registry-server" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.389516 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.392069 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-vmwhc" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.399231 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl"] Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.420101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w287c\" (UniqueName: \"kubernetes.io/projected/e52206cb-ce53-42c6-888e-7464281b9ddd-kube-api-access-w287c\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.420231 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-util\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.420304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-bundle\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.521625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-bundle\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.521765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w287c\" (UniqueName: \"kubernetes.io/projected/e52206cb-ce53-42c6-888e-7464281b9ddd-kube-api-access-w287c\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.521815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-util\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.522616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-bundle\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.522635 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-util\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.550368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w287c\" (UniqueName: \"kubernetes.io/projected/e52206cb-ce53-42c6-888e-7464281b9ddd-kube-api-access-w287c\") pod \"e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.718143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:03:53 crc kubenswrapper[4769]: I1121 12:03:53.976501 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl"] Nov 21 12:03:54 crc kubenswrapper[4769]: I1121 12:03:54.789261 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-f9d7485db-9vb2t" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" containerID="cri-o://eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972" gracePeriod=15 Nov 21 12:03:54 crc kubenswrapper[4769]: I1121 12:03:54.827217 4769 generic.go:334] "Generic (PLEG): container finished" podID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerID="369c9f9ae608aa14d61a1667bf3046eb28bb5c13a07fdc39a4695bc489c88bda" exitCode=0 Nov 21 12:03:54 crc kubenswrapper[4769]: I1121 12:03:54.827473 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" event={"ID":"e52206cb-ce53-42c6-888e-7464281b9ddd","Type":"ContainerDied","Data":"369c9f9ae608aa14d61a1667bf3046eb28bb5c13a07fdc39a4695bc489c88bda"} Nov 21 12:03:54 crc kubenswrapper[4769]: I1121 12:03:54.827790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" event={"ID":"e52206cb-ce53-42c6-888e-7464281b9ddd","Type":"ContainerStarted","Data":"af5a8277806661e40f0a1a16c9bff34e2f4d7224056d4e16d4d80b39e7ec6d27"} Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.238286 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f9d7485db-9vb2t_a1473b4e-7238-4995-8b16-8722cba79ccd/console/0.log" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.238415 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.256527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-serving-cert\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.256666 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-oauth-serving-cert\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.256723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-console-config\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.256784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-oauth-config\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.256910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-trusted-ca-bundle\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.256969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v9qt\" (UniqueName: \"kubernetes.io/projected/a1473b4e-7238-4995-8b16-8722cba79ccd-kube-api-access-8v9qt\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.257015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-service-ca\") pod \"a1473b4e-7238-4995-8b16-8722cba79ccd\" (UID: \"a1473b4e-7238-4995-8b16-8722cba79ccd\") " Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.258146 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-console-config" (OuterVolumeSpecName: "console-config") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.258271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.258334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.258354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.270712 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.276264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1473b4e-7238-4995-8b16-8722cba79ccd-kube-api-access-8v9qt" (OuterVolumeSpecName: "kube-api-access-8v9qt") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "kube-api-access-8v9qt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.276655 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1473b4e-7238-4995-8b16-8722cba79ccd" (UID: "a1473b4e-7238-4995-8b16-8722cba79ccd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358623 4769 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358665 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8v9qt\" (UniqueName: \"kubernetes.io/projected/a1473b4e-7238-4995-8b16-8722cba79ccd-kube-api-access-8v9qt\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358678 4769 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-service-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358688 4769 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358698 4769 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-oauth-serving-cert\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358708 4769 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1473b4e-7238-4995-8b16-8722cba79ccd-console-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.358719 4769 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1473b4e-7238-4995-8b16-8722cba79ccd-console-oauth-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.837143 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f9d7485db-9vb2t_a1473b4e-7238-4995-8b16-8722cba79ccd/console/0.log" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.837682 4769 generic.go:334] "Generic (PLEG): container finished" podID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerID="eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972" exitCode=2 Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.837769 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9d7485db-9vb2t" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.837766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d7485db-9vb2t" event={"ID":"a1473b4e-7238-4995-8b16-8722cba79ccd","Type":"ContainerDied","Data":"eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972"} Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.837855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9d7485db-9vb2t" event={"ID":"a1473b4e-7238-4995-8b16-8722cba79ccd","Type":"ContainerDied","Data":"316c13685c8cb017831db6086b6c2a7136b623f898e9cfae982f3f55d6bfface"} Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.837878 4769 scope.go:117] "RemoveContainer" containerID="eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.862285 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9d7485db-9vb2t"] Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.863224 4769 scope.go:117] "RemoveContainer" containerID="eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972" Nov 21 12:03:55 crc kubenswrapper[4769]: E1121 12:03:55.863893 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972\": container with ID starting with eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972 not found: ID does not exist" containerID="eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.863934 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972"} err="failed to get container status \"eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972\": rpc error: code = NotFound desc = could not find container \"eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972\": container with ID starting with eab8cd481df92727708a655a293a945bf6f769abf6792857abfaa281c0a99972 not found: ID does not exist" Nov 21 12:03:55 crc kubenswrapper[4769]: I1121 12:03:55.869310 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f9d7485db-9vb2t"] Nov 21 12:03:57 crc kubenswrapper[4769]: I1121 12:03:57.287912 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" path="/var/lib/kubelet/pods/a1473b4e-7238-4995-8b16-8722cba79ccd/volumes" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.137492 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-p9dtc"] Nov 21 12:03:58 crc kubenswrapper[4769]: E1121 12:03:58.138274 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.138292 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.138425 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a1473b4e-7238-4995-8b16-8722cba79ccd" containerName="console" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.139365 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.147183 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-p9dtc"] Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.201996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-utilities\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.202142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skndc\" (UniqueName: \"kubernetes.io/projected/dffe5471-4e27-4404-80df-14f5e4ac56ae-kube-api-access-skndc\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.202231 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-catalog-content\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.303910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-catalog-content\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.303970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-utilities\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.304035 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-skndc\" (UniqueName: \"kubernetes.io/projected/dffe5471-4e27-4404-80df-14f5e4ac56ae-kube-api-access-skndc\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.304570 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-catalog-content\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.304615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-utilities\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.328470 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-skndc\" (UniqueName: \"kubernetes.io/projected/dffe5471-4e27-4404-80df-14f5e4ac56ae-kube-api-access-skndc\") pod \"certified-operators-p9dtc\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.461280 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.721438 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-p9dtc"] Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.859877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerStarted","Data":"9efe48ba17666f488ad6e1dd558ad1fa853cc144e0306bcf418b248855c7e9ed"} Nov 21 12:03:58 crc kubenswrapper[4769]: I1121 12:03:58.863479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" event={"ID":"e52206cb-ce53-42c6-888e-7464281b9ddd","Type":"ContainerStarted","Data":"287a56dee7b84be5bc0f022c5760b7934dd1d3a54d0d5c1d045d6646d4fadc28"} Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.136111 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-lmr6h"] Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.138719 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.142159 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-lmr6h"] Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.229240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-utilities\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.229295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-catalog-content\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.229362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zqll\" (UniqueName: \"kubernetes.io/projected/e35c3c07-4bd6-48a0-82a4-c208ae92931f-kube-api-access-8zqll\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.331265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8zqll\" (UniqueName: \"kubernetes.io/projected/e35c3c07-4bd6-48a0-82a4-c208ae92931f-kube-api-access-8zqll\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.332915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-utilities\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.333067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-catalog-content\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.333798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-utilities\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.333874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-catalog-content\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.356862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zqll\" (UniqueName: \"kubernetes.io/projected/e35c3c07-4bd6-48a0-82a4-c208ae92931f-kube-api-access-8zqll\") pod \"redhat-marketplace-lmr6h\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.460031 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.869294 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-lmr6h"] Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.871485 4769 generic.go:334] "Generic (PLEG): container finished" podID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerID="287a56dee7b84be5bc0f022c5760b7934dd1d3a54d0d5c1d045d6646d4fadc28" exitCode=0 Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.871555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" event={"ID":"e52206cb-ce53-42c6-888e-7464281b9ddd","Type":"ContainerDied","Data":"287a56dee7b84be5bc0f022c5760b7934dd1d3a54d0d5c1d045d6646d4fadc28"} Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.874289 4769 generic.go:334] "Generic (PLEG): container finished" podID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerID="328410489bcfc7c925d0f49cba6498798cc9230601cd4dde76dacf37621c3648" exitCode=0 Nov 21 12:03:59 crc kubenswrapper[4769]: I1121 12:03:59.874316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerDied","Data":"328410489bcfc7c925d0f49cba6498798cc9230601cd4dde76dacf37621c3648"} Nov 21 12:04:00 crc kubenswrapper[4769]: I1121 12:04:00.882809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lmr6h" event={"ID":"e35c3c07-4bd6-48a0-82a4-c208ae92931f","Type":"ContainerStarted","Data":"63013fd5f52949ca921733b66bc62cb373feaf330c9532bd0cb5c56a25043978"} Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.741462 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-4hw5c"] Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.744852 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.751445 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4hw5c"] Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.874105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdth8\" (UniqueName: \"kubernetes.io/projected/24031c06-8ed3-4d10-916a-b940bbe3aa44-kube-api-access-fdth8\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.874264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-catalog-content\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.874336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-utilities\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.890263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerStarted","Data":"6331b5f0648d8e8f281dc6395753a035ada872a3f982a7f9fe22c089b4077205"} Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.892478 4769 generic.go:334] "Generic (PLEG): container finished" podID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerID="c1b582d0e90e424a69a29056f7b638f8369c84f5b3d941fa0f2d936a736bf630" exitCode=0 Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.892512 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" event={"ID":"e52206cb-ce53-42c6-888e-7464281b9ddd","Type":"ContainerDied","Data":"c1b582d0e90e424a69a29056f7b638f8369c84f5b3d941fa0f2d936a736bf630"} Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.894050 4769 generic.go:334] "Generic (PLEG): container finished" podID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerID="cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024" exitCode=0 Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.894077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lmr6h" event={"ID":"e35c3c07-4bd6-48a0-82a4-c208ae92931f","Type":"ContainerDied","Data":"cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024"} Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.975846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-catalog-content\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.975918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-utilities\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.976015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fdth8\" (UniqueName: \"kubernetes.io/projected/24031c06-8ed3-4d10-916a-b940bbe3aa44-kube-api-access-fdth8\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.976492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-catalog-content\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.977169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-utilities\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:01 crc kubenswrapper[4769]: I1121 12:04:01.995787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdth8\" (UniqueName: \"kubernetes.io/projected/24031c06-8ed3-4d10-916a-b940bbe3aa44-kube-api-access-fdth8\") pod \"community-operators-4hw5c\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.077390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.339486 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4hw5c"] Nov 21 12:04:02 crc kubenswrapper[4769]: W1121 12:04:02.344963 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24031c06_8ed3_4d10_916a_b940bbe3aa44.slice/crio-0f5a3b4bb34cacd7fd0f754823f3c07130e06dc2fa0dcb6ac69e0e8c39f7df41 WatchSource:0}: Error finding container 0f5a3b4bb34cacd7fd0f754823f3c07130e06dc2fa0dcb6ac69e0e8c39f7df41: Status 404 returned error can't find the container with id 0f5a3b4bb34cacd7fd0f754823f3c07130e06dc2fa0dcb6ac69e0e8c39f7df41 Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.903755 4769 generic.go:334] "Generic (PLEG): container finished" podID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerID="6331b5f0648d8e8f281dc6395753a035ada872a3f982a7f9fe22c089b4077205" exitCode=0 Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.903896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerDied","Data":"6331b5f0648d8e8f281dc6395753a035ada872a3f982a7f9fe22c089b4077205"} Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.906687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4hw5c" event={"ID":"24031c06-8ed3-4d10-916a-b940bbe3aa44","Type":"ContainerDied","Data":"b2403b330ed1934adebb094a7fb91513195c5f8c7b4c9438764f618c66ddba94"} Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.906965 4769 generic.go:334] "Generic (PLEG): container finished" podID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerID="b2403b330ed1934adebb094a7fb91513195c5f8c7b4c9438764f618c66ddba94" exitCode=0 Nov 21 12:04:02 crc kubenswrapper[4769]: I1121 12:04:02.910525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4hw5c" event={"ID":"24031c06-8ed3-4d10-916a-b940bbe3aa44","Type":"ContainerStarted","Data":"0f5a3b4bb34cacd7fd0f754823f3c07130e06dc2fa0dcb6ac69e0e8c39f7df41"} Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.214365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.292758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-bundle\") pod \"e52206cb-ce53-42c6-888e-7464281b9ddd\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.292858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w287c\" (UniqueName: \"kubernetes.io/projected/e52206cb-ce53-42c6-888e-7464281b9ddd-kube-api-access-w287c\") pod \"e52206cb-ce53-42c6-888e-7464281b9ddd\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.292895 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-util\") pod \"e52206cb-ce53-42c6-888e-7464281b9ddd\" (UID: \"e52206cb-ce53-42c6-888e-7464281b9ddd\") " Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.294574 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-bundle" (OuterVolumeSpecName: "bundle") pod "e52206cb-ce53-42c6-888e-7464281b9ddd" (UID: "e52206cb-ce53-42c6-888e-7464281b9ddd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.299506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e52206cb-ce53-42c6-888e-7464281b9ddd-kube-api-access-w287c" (OuterVolumeSpecName: "kube-api-access-w287c") pod "e52206cb-ce53-42c6-888e-7464281b9ddd" (UID: "e52206cb-ce53-42c6-888e-7464281b9ddd"). InnerVolumeSpecName "kube-api-access-w287c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.304964 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-util" (OuterVolumeSpecName: "util") pod "e52206cb-ce53-42c6-888e-7464281b9ddd" (UID: "e52206cb-ce53-42c6-888e-7464281b9ddd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.394142 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.394177 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w287c\" (UniqueName: \"kubernetes.io/projected/e52206cb-ce53-42c6-888e-7464281b9ddd-kube-api-access-w287c\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.394214 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e52206cb-ce53-42c6-888e-7464281b9ddd-util\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.920684 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerStarted","Data":"f0e80f3cf3537a4a262cd558df85600726e5888769ea4c8d6563adf107d0f1ec"} Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.924225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" event={"ID":"e52206cb-ce53-42c6-888e-7464281b9ddd","Type":"ContainerDied","Data":"af5a8277806661e40f0a1a16c9bff34e2f4d7224056d4e16d4d80b39e7ec6d27"} Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.924274 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e8527aae5664f20f24bf3bbb3fd2981ba838928a8a47ce599ee258e4c69qfdl" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.924290 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af5a8277806661e40f0a1a16c9bff34e2f4d7224056d4e16d4d80b39e7ec6d27" Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.933871 4769 generic.go:334] "Generic (PLEG): container finished" podID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerID="5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b" exitCode=0 Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.933931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lmr6h" event={"ID":"e35c3c07-4bd6-48a0-82a4-c208ae92931f","Type":"ContainerDied","Data":"5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b"} Nov 21 12:04:03 crc kubenswrapper[4769]: I1121 12:04:03.940922 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-p9dtc" podStartSLOduration=2.436637213 podStartE2EDuration="5.940904189s" podCreationTimestamp="2025-11-21 12:03:58 +0000 UTC" firstStartedPulling="2025-11-21 12:03:59.875844946 +0000 UTC m=+798.576506764" lastFinishedPulling="2025-11-21 12:04:03.380111882 +0000 UTC m=+802.080773740" observedRunningTime="2025-11-21 12:04:03.938175523 +0000 UTC m=+802.638837341" watchObservedRunningTime="2025-11-21 12:04:03.940904189 +0000 UTC m=+802.641566007" Nov 21 12:04:04 crc kubenswrapper[4769]: E1121 12:04:04.309211 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24031c06_8ed3_4d10_916a_b940bbe3aa44.slice/crio-2f0c9a5757b406a8f7b9dce39281d74aa7859275aa8549a8e8f6dc90c43d6d98.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24031c06_8ed3_4d10_916a_b940bbe3aa44.slice/crio-conmon-2f0c9a5757b406a8f7b9dce39281d74aa7859275aa8549a8e8f6dc90c43d6d98.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:04:04 crc kubenswrapper[4769]: I1121 12:04:04.944141 4769 generic.go:334] "Generic (PLEG): container finished" podID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerID="2f0c9a5757b406a8f7b9dce39281d74aa7859275aa8549a8e8f6dc90c43d6d98" exitCode=0 Nov 21 12:04:04 crc kubenswrapper[4769]: I1121 12:04:04.944330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4hw5c" event={"ID":"24031c06-8ed3-4d10-916a-b940bbe3aa44","Type":"ContainerDied","Data":"2f0c9a5757b406a8f7b9dce39281d74aa7859275aa8549a8e8f6dc90c43d6d98"} Nov 21 12:04:05 crc kubenswrapper[4769]: I1121 12:04:05.955962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lmr6h" event={"ID":"e35c3c07-4bd6-48a0-82a4-c208ae92931f","Type":"ContainerStarted","Data":"dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1"} Nov 21 12:04:05 crc kubenswrapper[4769]: I1121 12:04:05.983669 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-lmr6h" podStartSLOduration=4.147481978 podStartE2EDuration="6.983651132s" podCreationTimestamp="2025-11-21 12:03:59 +0000 UTC" firstStartedPulling="2025-11-21 12:04:01.8953959 +0000 UTC m=+800.596057728" lastFinishedPulling="2025-11-21 12:04:04.731565054 +0000 UTC m=+803.432226882" observedRunningTime="2025-11-21 12:04:05.982348266 +0000 UTC m=+804.683010084" watchObservedRunningTime="2025-11-21 12:04:05.983651132 +0000 UTC m=+804.684312950" Nov 21 12:04:06 crc kubenswrapper[4769]: I1121 12:04:06.967277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4hw5c" event={"ID":"24031c06-8ed3-4d10-916a-b940bbe3aa44","Type":"ContainerStarted","Data":"d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e"} Nov 21 12:04:07 crc kubenswrapper[4769]: I1121 12:04:07.000521 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-4hw5c" podStartSLOduration=2.8077054930000003 podStartE2EDuration="6.000488364s" podCreationTimestamp="2025-11-21 12:04:01 +0000 UTC" firstStartedPulling="2025-11-21 12:04:02.908399926 +0000 UTC m=+801.609061744" lastFinishedPulling="2025-11-21 12:04:06.101182797 +0000 UTC m=+804.801844615" observedRunningTime="2025-11-21 12:04:06.997779279 +0000 UTC m=+805.698441097" watchObservedRunningTime="2025-11-21 12:04:07.000488364 +0000 UTC m=+805.701150182" Nov 21 12:04:08 crc kubenswrapper[4769]: I1121 12:04:08.461397 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:04:08 crc kubenswrapper[4769]: I1121 12:04:08.461456 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:04:08 crc kubenswrapper[4769]: I1121 12:04:08.505343 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:04:09 crc kubenswrapper[4769]: I1121 12:04:09.044650 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:04:09 crc kubenswrapper[4769]: I1121 12:04:09.461344 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:04:09 crc kubenswrapper[4769]: I1121 12:04:09.461431 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:04:09 crc kubenswrapper[4769]: I1121 12:04:09.504330 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:04:10 crc kubenswrapper[4769]: I1121 12:04:10.035453 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:04:10 crc kubenswrapper[4769]: I1121 12:04:10.923452 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-p9dtc"] Nov 21 12:04:10 crc kubenswrapper[4769]: I1121 12:04:10.991590 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-p9dtc" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="registry-server" containerID="cri-o://f0e80f3cf3537a4a262cd558df85600726e5888769ea4c8d6563adf107d0f1ec" gracePeriod=2 Nov 21 12:04:11 crc kubenswrapper[4769]: I1121 12:04:11.323639 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-lmr6h"] Nov 21 12:04:11 crc kubenswrapper[4769]: I1121 12:04:11.325806 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:04:11 crc kubenswrapper[4769]: I1121 12:04:11.325870 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:04:11 crc kubenswrapper[4769]: I1121 12:04:11.325911 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:04:11 crc kubenswrapper[4769]: I1121 12:04:11.326535 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"e5789956c423cd2670b5d2eab5d80c7e96e666ff7427886e39b71bbafc7c2c2d"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:04:11 crc kubenswrapper[4769]: I1121 12:04:11.326598 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://e5789956c423cd2670b5d2eab5d80c7e96e666ff7427886e39b71bbafc7c2c2d" gracePeriod=600 Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.006379 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="e5789956c423cd2670b5d2eab5d80c7e96e666ff7427886e39b71bbafc7c2c2d" exitCode=0 Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.006833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"e5789956c423cd2670b5d2eab5d80c7e96e666ff7427886e39b71bbafc7c2c2d"} Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.006878 4769 scope.go:117] "RemoveContainer" containerID="887f5564b40c73de7979d3f3ddd12d3f7f7ef6835c010b75f11f1469313c5c6f" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.028081 4769 generic.go:334] "Generic (PLEG): container finished" podID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerID="f0e80f3cf3537a4a262cd558df85600726e5888769ea4c8d6563adf107d0f1ec" exitCode=0 Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.028372 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-lmr6h" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="registry-server" containerID="cri-o://dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1" gracePeriod=2 Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.028485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerDied","Data":"f0e80f3cf3537a4a262cd558df85600726e5888769ea4c8d6563adf107d0f1ec"} Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.078404 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.079489 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.155686 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.200282 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm"] Nov 21 12:04:12 crc kubenswrapper[4769]: E1121 12:04:12.200537 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="util" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.200550 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="util" Nov 21 12:04:12 crc kubenswrapper[4769]: E1121 12:04:12.200561 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="pull" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.200567 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="pull" Nov 21 12:04:12 crc kubenswrapper[4769]: E1121 12:04:12.200573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="extract" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.200581 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="extract" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.200678 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e52206cb-ce53-42c6-888e-7464281b9ddd" containerName="extract" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.201101 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.203082 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"kube-root-ca.crt" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.203440 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-cert" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.207372 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-controller-manager-service-cert" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.207573 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"manager-account-dockercfg-wkvjc" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.207635 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"openshift-service-ca.crt" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.228156 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm"] Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.324918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qr6\" (UniqueName: \"kubernetes.io/projected/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-kube-api-access-58qr6\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.324986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-apiservice-cert\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.325026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-webhook-cert\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.426868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58qr6\" (UniqueName: \"kubernetes.io/projected/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-kube-api-access-58qr6\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.426956 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-apiservice-cert\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.427411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-webhook-cert\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.468318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-apiservice-cert\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.468350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-webhook-cert\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.472543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qr6\" (UniqueName: \"kubernetes.io/projected/be27ed08-546a-4be4-b61a-5f2f0f9fe9ab-kube-api-access-58qr6\") pod \"metallb-operator-controller-manager-57985f9bb9-p6skm\" (UID: \"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab\") " pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.523265 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.577375 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk"] Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.578300 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.581829 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-service-cert" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.582694 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"controller-dockercfg-v9zrk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.582863 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.600086 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk"] Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.605090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.608360 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.630103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-webhook-cert\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.630171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcq7n\" (UniqueName: \"kubernetes.io/projected/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-kube-api-access-wcq7n\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.630246 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-apiservice-cert\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.731767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-utilities\") pod \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skndc\" (UniqueName: \"kubernetes.io/projected/dffe5471-4e27-4404-80df-14f5e4ac56ae-kube-api-access-skndc\") pod \"dffe5471-4e27-4404-80df-14f5e4ac56ae\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-utilities\") pod \"dffe5471-4e27-4404-80df-14f5e4ac56ae\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zqll\" (UniqueName: \"kubernetes.io/projected/e35c3c07-4bd6-48a0-82a4-c208ae92931f-kube-api-access-8zqll\") pod \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-catalog-content\") pod \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\" (UID: \"e35c3c07-4bd6-48a0-82a4-c208ae92931f\") " Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-catalog-content\") pod \"dffe5471-4e27-4404-80df-14f5e4ac56ae\" (UID: \"dffe5471-4e27-4404-80df-14f5e4ac56ae\") " Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wcq7n\" (UniqueName: \"kubernetes.io/projected/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-kube-api-access-wcq7n\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-apiservice-cert\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.732927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-webhook-cert\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.733020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-utilities" (OuterVolumeSpecName: "utilities") pod "e35c3c07-4bd6-48a0-82a4-c208ae92931f" (UID: "e35c3c07-4bd6-48a0-82a4-c208ae92931f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.733956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-utilities" (OuterVolumeSpecName: "utilities") pod "dffe5471-4e27-4404-80df-14f5e4ac56ae" (UID: "dffe5471-4e27-4404-80df-14f5e4ac56ae"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.742053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-webhook-cert\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.742851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-apiservice-cert\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.743085 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35c3c07-4bd6-48a0-82a4-c208ae92931f-kube-api-access-8zqll" (OuterVolumeSpecName: "kube-api-access-8zqll") pod "e35c3c07-4bd6-48a0-82a4-c208ae92931f" (UID: "e35c3c07-4bd6-48a0-82a4-c208ae92931f"). InnerVolumeSpecName "kube-api-access-8zqll". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.743276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dffe5471-4e27-4404-80df-14f5e4ac56ae-kube-api-access-skndc" (OuterVolumeSpecName: "kube-api-access-skndc") pod "dffe5471-4e27-4404-80df-14f5e4ac56ae" (UID: "dffe5471-4e27-4404-80df-14f5e4ac56ae"). InnerVolumeSpecName "kube-api-access-skndc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.772633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e35c3c07-4bd6-48a0-82a4-c208ae92931f" (UID: "e35c3c07-4bd6-48a0-82a4-c208ae92931f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.804264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcq7n\" (UniqueName: \"kubernetes.io/projected/77e12cb4-8ef1-4ec2-93c8-7e443f5381ff-kube-api-access-wcq7n\") pod \"metallb-operator-webhook-server-65b9c4cfd9-j4wzk\" (UID: \"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff\") " pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.837156 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8zqll\" (UniqueName: \"kubernetes.io/projected/e35c3c07-4bd6-48a0-82a4-c208ae92931f-kube-api-access-8zqll\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.837220 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.837235 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e35c3c07-4bd6-48a0-82a4-c208ae92931f-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.837248 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-skndc\" (UniqueName: \"kubernetes.io/projected/dffe5471-4e27-4404-80df-14f5e4ac56ae-kube-api-access-skndc\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.837261 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:12 crc kubenswrapper[4769]: I1121 12:04:12.925842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.062346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"183b431de75db756057a9fd21f82b3dcfbe60ed8b081d37c7fb533b6c556dab7"} Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.078091 4769 generic.go:334] "Generic (PLEG): container finished" podID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerID="dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1" exitCode=0 Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.078207 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lmr6h" event={"ID":"e35c3c07-4bd6-48a0-82a4-c208ae92931f","Type":"ContainerDied","Data":"dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1"} Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.078250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-lmr6h" event={"ID":"e35c3c07-4bd6-48a0-82a4-c208ae92931f","Type":"ContainerDied","Data":"63013fd5f52949ca921733b66bc62cb373feaf330c9532bd0cb5c56a25043978"} Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.078286 4769 scope.go:117] "RemoveContainer" containerID="dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.078488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-lmr6h" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.091648 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-p9dtc" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.092219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-p9dtc" event={"ID":"dffe5471-4e27-4404-80df-14f5e4ac56ae","Type":"ContainerDied","Data":"9efe48ba17666f488ad6e1dd558ad1fa853cc144e0306bcf418b248855c7e9ed"} Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.119114 4769 scope.go:117] "RemoveContainer" containerID="5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.119631 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm"] Nov 21 12:04:13 crc kubenswrapper[4769]: W1121 12:04:13.164415 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe27ed08_546a_4be4_b61a_5f2f0f9fe9ab.slice/crio-40c7b28a5e255606ab017055d3279dc755347436c58ab045d876955d7ac47c8e WatchSource:0}: Error finding container 40c7b28a5e255606ab017055d3279dc755347436c58ab045d876955d7ac47c8e: Status 404 returned error can't find the container with id 40c7b28a5e255606ab017055d3279dc755347436c58ab045d876955d7ac47c8e Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.173659 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-lmr6h"] Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.180319 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-lmr6h"] Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.194560 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.196490 4769 scope.go:117] "RemoveContainer" containerID="cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.227026 4769 scope.go:117] "RemoveContainer" containerID="dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1" Nov 21 12:04:13 crc kubenswrapper[4769]: E1121 12:04:13.227661 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1\": container with ID starting with dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1 not found: ID does not exist" containerID="dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.227692 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1"} err="failed to get container status \"dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1\": rpc error: code = NotFound desc = could not find container \"dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1\": container with ID starting with dea7b8d474c866e022ba944ecfb14c0365b19da49083e86918036321b8064dc1 not found: ID does not exist" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.227717 4769 scope.go:117] "RemoveContainer" containerID="5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b" Nov 21 12:04:13 crc kubenswrapper[4769]: E1121 12:04:13.231479 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b\": container with ID starting with 5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b not found: ID does not exist" containerID="5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.231921 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b"} err="failed to get container status \"5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b\": rpc error: code = NotFound desc = could not find container \"5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b\": container with ID starting with 5e980c3e9d01c120917e8446525a1b8ef67f8f2737e8ede687068149edfe6e5b not found: ID does not exist" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.232008 4769 scope.go:117] "RemoveContainer" containerID="cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024" Nov 21 12:04:13 crc kubenswrapper[4769]: E1121 12:04:13.238307 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024\": container with ID starting with cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024 not found: ID does not exist" containerID="cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.238371 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024"} err="failed to get container status \"cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024\": rpc error: code = NotFound desc = could not find container \"cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024\": container with ID starting with cb462ad2d54c963748764f974e3761b44c0a9a68bac34556057f8dad9a511024 not found: ID does not exist" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.238410 4769 scope.go:117] "RemoveContainer" containerID="f0e80f3cf3537a4a262cd558df85600726e5888769ea4c8d6563adf107d0f1ec" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.243800 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk"] Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.257865 4769 scope.go:117] "RemoveContainer" containerID="6331b5f0648d8e8f281dc6395753a035ada872a3f982a7f9fe22c089b4077205" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.277504 4769 scope.go:117] "RemoveContainer" containerID="328410489bcfc7c925d0f49cba6498798cc9230601cd4dde76dacf37621c3648" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.281720 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" path="/var/lib/kubelet/pods/e35c3c07-4bd6-48a0-82a4-c208ae92931f/volumes" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.315982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "dffe5471-4e27-4404-80df-14f5e4ac56ae" (UID: "dffe5471-4e27-4404-80df-14f5e4ac56ae"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.349119 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dffe5471-4e27-4404-80df-14f5e4ac56ae-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.428004 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-p9dtc"] Nov 21 12:04:13 crc kubenswrapper[4769]: I1121 12:04:13.431046 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-p9dtc"] Nov 21 12:04:14 crc kubenswrapper[4769]: I1121 12:04:14.100231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" event={"ID":"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff","Type":"ContainerStarted","Data":"5cd642bc5f0674ec019b590fba6c2b15f1ca87a1da6efe6da96f26fc4e046f98"} Nov 21 12:04:14 crc kubenswrapper[4769]: I1121 12:04:14.101685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" event={"ID":"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab","Type":"ContainerStarted","Data":"40c7b28a5e255606ab017055d3279dc755347436c58ab045d876955d7ac47c8e"} Nov 21 12:04:14 crc kubenswrapper[4769]: I1121 12:04:14.724434 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4hw5c"] Nov 21 12:04:15 crc kubenswrapper[4769]: I1121 12:04:15.289553 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" path="/var/lib/kubelet/pods/dffe5471-4e27-4404-80df-14f5e4ac56ae/volumes" Nov 21 12:04:16 crc kubenswrapper[4769]: I1121 12:04:16.116985 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-4hw5c" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="registry-server" containerID="cri-o://d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e" gracePeriod=2 Nov 21 12:04:17 crc kubenswrapper[4769]: I1121 12:04:17.128326 4769 generic.go:334] "Generic (PLEG): container finished" podID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerID="d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e" exitCode=0 Nov 21 12:04:17 crc kubenswrapper[4769]: I1121 12:04:17.128401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4hw5c" event={"ID":"24031c06-8ed3-4d10-916a-b940bbe3aa44","Type":"ContainerDied","Data":"d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e"} Nov 21 12:04:22 crc kubenswrapper[4769]: E1121 12:04:22.078787 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e is running failed: container process not found" containerID="d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 12:04:22 crc kubenswrapper[4769]: E1121 12:04:22.081905 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e is running failed: container process not found" containerID="d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 12:04:22 crc kubenswrapper[4769]: E1121 12:04:22.082671 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e is running failed: container process not found" containerID="d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 12:04:22 crc kubenswrapper[4769]: E1121 12:04:22.082729 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-4hw5c" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="registry-server" Nov 21 12:04:22 crc kubenswrapper[4769]: I1121 12:04:22.929542 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.036379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdth8\" (UniqueName: \"kubernetes.io/projected/24031c06-8ed3-4d10-916a-b940bbe3aa44-kube-api-access-fdth8\") pod \"24031c06-8ed3-4d10-916a-b940bbe3aa44\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.036606 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-utilities\") pod \"24031c06-8ed3-4d10-916a-b940bbe3aa44\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.036725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-catalog-content\") pod \"24031c06-8ed3-4d10-916a-b940bbe3aa44\" (UID: \"24031c06-8ed3-4d10-916a-b940bbe3aa44\") " Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.037719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-utilities" (OuterVolumeSpecName: "utilities") pod "24031c06-8ed3-4d10-916a-b940bbe3aa44" (UID: "24031c06-8ed3-4d10-916a-b940bbe3aa44"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.043310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24031c06-8ed3-4d10-916a-b940bbe3aa44-kube-api-access-fdth8" (OuterVolumeSpecName: "kube-api-access-fdth8") pod "24031c06-8ed3-4d10-916a-b940bbe3aa44" (UID: "24031c06-8ed3-4d10-916a-b940bbe3aa44"). InnerVolumeSpecName "kube-api-access-fdth8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.090425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "24031c06-8ed3-4d10-916a-b940bbe3aa44" (UID: "24031c06-8ed3-4d10-916a-b940bbe3aa44"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.140117 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.140252 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fdth8\" (UniqueName: \"kubernetes.io/projected/24031c06-8ed3-4d10-916a-b940bbe3aa44-kube-api-access-fdth8\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.140276 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/24031c06-8ed3-4d10-916a-b940bbe3aa44-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.182253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4hw5c" event={"ID":"24031c06-8ed3-4d10-916a-b940bbe3aa44","Type":"ContainerDied","Data":"0f5a3b4bb34cacd7fd0f754823f3c07130e06dc2fa0dcb6ac69e0e8c39f7df41"} Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.182311 4769 scope.go:117] "RemoveContainer" containerID="d457bba1668cf03d633c859ccc2cc0d27c7f9c835a88383484082bb7f0aa8b2e" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.182369 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4hw5c" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.217153 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4hw5c"] Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.221568 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-4hw5c"] Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.288398 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" path="/var/lib/kubelet/pods/24031c06-8ed3-4d10-916a-b940bbe3aa44/volumes" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.703991 4769 scope.go:117] "RemoveContainer" containerID="2f0c9a5757b406a8f7b9dce39281d74aa7859275aa8549a8e8f6dc90c43d6d98" Nov 21 12:04:23 crc kubenswrapper[4769]: I1121 12:04:23.736012 4769 scope.go:117] "RemoveContainer" containerID="b2403b330ed1934adebb094a7fb91513195c5f8c7b4c9438764f618c66ddba94" Nov 21 12:04:24 crc kubenswrapper[4769]: I1121 12:04:24.193507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" event={"ID":"77e12cb4-8ef1-4ec2-93c8-7e443f5381ff","Type":"ContainerStarted","Data":"423a29cc1f03a6eb92b0d806e90a3fb436b72e0b316078ca45fa10a2ff17aa60"} Nov 21 12:04:24 crc kubenswrapper[4769]: I1121 12:04:24.193971 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:04:24 crc kubenswrapper[4769]: I1121 12:04:24.198897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" event={"ID":"be27ed08-546a-4be4-b61a-5f2f0f9fe9ab","Type":"ContainerStarted","Data":"019e28162f930577435e0da5d6d8086b0ab91ccb736d48cf61df9c844575c059"} Nov 21 12:04:24 crc kubenswrapper[4769]: I1121 12:04:24.199351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:04:24 crc kubenswrapper[4769]: I1121 12:04:24.218256 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" podStartSLOduration=1.732562494 podStartE2EDuration="12.218233015s" podCreationTimestamp="2025-11-21 12:04:12 +0000 UTC" firstStartedPulling="2025-11-21 12:04:13.25907097 +0000 UTC m=+811.959732788" lastFinishedPulling="2025-11-21 12:04:23.744741471 +0000 UTC m=+822.445403309" observedRunningTime="2025-11-21 12:04:24.213379452 +0000 UTC m=+822.914041300" watchObservedRunningTime="2025-11-21 12:04:24.218233015 +0000 UTC m=+822.918894833" Nov 21 12:04:24 crc kubenswrapper[4769]: I1121 12:04:24.247296 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" podStartSLOduration=1.738432647 podStartE2EDuration="12.247280315s" podCreationTimestamp="2025-11-21 12:04:12 +0000 UTC" firstStartedPulling="2025-11-21 12:04:13.196460827 +0000 UTC m=+811.897122645" lastFinishedPulling="2025-11-21 12:04:23.705308485 +0000 UTC m=+822.405970313" observedRunningTime="2025-11-21 12:04:24.243682076 +0000 UTC m=+822.944343904" watchObservedRunningTime="2025-11-21 12:04:24.247280315 +0000 UTC m=+822.947942133" Nov 21 12:04:42 crc kubenswrapper[4769]: I1121 12:04:42.932103 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-webhook-server-65b9c4cfd9-j4wzk" Nov 21 12:05:02 crc kubenswrapper[4769]: I1121 12:05:02.526574 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-57985f9bb9-p6skm" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320494 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-srjg2"] Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320731 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320743 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320757 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="extract-utilities" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320766 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="extract-utilities" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320776 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320781 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320791 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="extract-content" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="extract-content" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320807 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="extract-content" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="extract-content" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320821 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="extract-content" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320828 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="extract-content" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320839 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="extract-utilities" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320848 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="extract-utilities" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320860 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320867 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.320876 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="extract-utilities" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320881 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="extract-utilities" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320985 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dffe5471-4e27-4404-80df-14f5e4ac56ae" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.320993 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e35c3c07-4bd6-48a0-82a4-c208ae92931f" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.321007 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="24031c06-8ed3-4d10-916a-b940bbe3aa44" containerName="registry-server" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.322973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.325470 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-certs-secret" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.325514 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"frr-startup" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.325757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-daemon-dockercfg-82ps6" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.331237 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2"] Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.332170 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.339361 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-webhook-server-cert" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.343115 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2"] Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.347896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzsmr\" (UniqueName: \"kubernetes.io/projected/809ea66e-033e-45d2-b2a1-d34b209472fc-kube-api-access-mzsmr\") pod \"frr-k8s-webhook-server-6998585d5-cxcz2\" (UID: \"809ea66e-033e-45d2-b2a1-d34b209472fc\") " pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.347938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-startup\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.347959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-reloader\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.347977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz6dm\" (UniqueName: \"kubernetes.io/projected/e6d6db81-198f-4e45-bbda-40430ea673fd-kube-api-access-xz6dm\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.348007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-conf\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.348050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/809ea66e-033e-45d2-b2a1-d34b209472fc-cert\") pod \"frr-k8s-webhook-server-6998585d5-cxcz2\" (UID: \"809ea66e-033e-45d2-b2a1-d34b209472fc\") " pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.348107 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-sockets\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.348122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.348153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics-certs\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.425077 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/speaker-tp6px"] Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.428513 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.431181 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"metallb-excludel2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.431379 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"speaker-certs-secret" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.433036 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/controller-6c7b4b5f48-8zv8h"] Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.434068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.436169 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-memberlist" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.436645 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"speaker-dockercfg-8ztqq" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.439287 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"controller-certs-secret" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.446027 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-6c7b4b5f48-8zv8h"] Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24l5c\" (UniqueName: \"kubernetes.io/projected/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-kube-api-access-24l5c\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-sockets\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-cert\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics-certs\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-metrics-certs\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzkf\" (UniqueName: \"kubernetes.io/projected/bcfa8924-271c-4289-aabc-17df5c1a3c8b-kube-api-access-6nzkf\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mzsmr\" (UniqueName: \"kubernetes.io/projected/809ea66e-033e-45d2-b2a1-d34b209472fc-kube-api-access-mzsmr\") pod \"frr-k8s-webhook-server-6998585d5-cxcz2\" (UID: \"809ea66e-033e-45d2-b2a1-d34b209472fc\") " pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-startup\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-reloader\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xz6dm\" (UniqueName: \"kubernetes.io/projected/e6d6db81-198f-4e45-bbda-40430ea673fd-kube-api-access-xz6dm\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.450952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-conf\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.451009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/809ea66e-033e-45d2-b2a1-d34b209472fc-cert\") pod \"frr-k8s-webhook-server-6998585d5-cxcz2\" (UID: \"809ea66e-033e-45d2-b2a1-d34b209472fc\") " pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.451061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metrics-certs\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.451106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metallb-excludel2\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.452705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-startup\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.452979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-reloader\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.453262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-conf\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.453532 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.453784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/e6d6db81-198f-4e45-bbda-40430ea673fd-frr-sockets\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.453914 4769 secret.go:188] Couldn't get secret metallb-system/frr-k8s-certs-secret: secret "frr-k8s-certs-secret" not found Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.453977 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics-certs podName:e6d6db81-198f-4e45-bbda-40430ea673fd nodeName:}" failed. No retries permitted until 2025-11-21 12:05:03.953956959 +0000 UTC m=+862.654618777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics-certs") pod "frr-k8s-srjg2" (UID: "e6d6db81-198f-4e45-bbda-40430ea673fd") : secret "frr-k8s-certs-secret" not found Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.461662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/809ea66e-033e-45d2-b2a1-d34b209472fc-cert\") pod \"frr-k8s-webhook-server-6998585d5-cxcz2\" (UID: \"809ea66e-033e-45d2-b2a1-d34b209472fc\") " pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.475576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz6dm\" (UniqueName: \"kubernetes.io/projected/e6d6db81-198f-4e45-bbda-40430ea673fd-kube-api-access-xz6dm\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.486284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzsmr\" (UniqueName: \"kubernetes.io/projected/809ea66e-033e-45d2-b2a1-d34b209472fc-kube-api-access-mzsmr\") pod \"frr-k8s-webhook-server-6998585d5-cxcz2\" (UID: \"809ea66e-033e-45d2-b2a1-d34b209472fc\") " pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.552956 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metrics-certs\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metallb-excludel2\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553025 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-24l5c\" (UniqueName: \"kubernetes.io/projected/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-kube-api-access-24l5c\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-cert\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-metrics-certs\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzkf\" (UniqueName: \"kubernetes.io/projected/bcfa8924-271c-4289-aabc-17df5c1a3c8b-kube-api-access-6nzkf\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.553183 4769 secret.go:188] Couldn't get secret metallb-system/speaker-certs-secret: secret "speaker-certs-secret" not found Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.553289 4769 secret.go:188] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.553335 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metrics-certs podName:6cafa23d-16ee-4a04-8c3c-6a1af03fea93 nodeName:}" failed. No retries permitted until 2025-11-21 12:05:04.053312727 +0000 UTC m=+862.753974545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metrics-certs") pod "speaker-tp6px" (UID: "6cafa23d-16ee-4a04-8c3c-6a1af03fea93") : secret "speaker-certs-secret" not found Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.553361 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist podName:6cafa23d-16ee-4a04-8c3c-6a1af03fea93 nodeName:}" failed. No retries permitted until 2025-11-21 12:05:04.053349018 +0000 UTC m=+862.754010836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist") pod "speaker-tp6px" (UID: "6cafa23d-16ee-4a04-8c3c-6a1af03fea93") : secret "metallb-memberlist" not found Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.553549 4769 secret.go:188] Couldn't get secret metallb-system/controller-certs-secret: secret "controller-certs-secret" not found Nov 21 12:05:03 crc kubenswrapper[4769]: E1121 12:05:03.553587 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-metrics-certs podName:bcfa8924-271c-4289-aabc-17df5c1a3c8b nodeName:}" failed. No retries permitted until 2025-11-21 12:05:04.053578664 +0000 UTC m=+862.754240592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-metrics-certs") pod "controller-6c7b4b5f48-8zv8h" (UID: "bcfa8924-271c-4289-aabc-17df5c1a3c8b") : secret "controller-certs-secret" not found Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.553721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metallb-excludel2\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.556256 4769 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.573125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-cert\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.578915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-24l5c\" (UniqueName: \"kubernetes.io/projected/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-kube-api-access-24l5c\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.583091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzkf\" (UniqueName: \"kubernetes.io/projected/bcfa8924-271c-4289-aabc-17df5c1a3c8b-kube-api-access-6nzkf\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.660967 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.938389 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2"] Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.958829 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics-certs\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:03 crc kubenswrapper[4769]: I1121 12:05:03.963936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6d6db81-198f-4e45-bbda-40430ea673fd-metrics-certs\") pod \"frr-k8s-srjg2\" (UID: \"e6d6db81-198f-4e45-bbda-40430ea673fd\") " pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.060482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-metrics-certs\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.060607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.060650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metrics-certs\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:04 crc kubenswrapper[4769]: E1121 12:05:04.060729 4769 secret.go:188] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Nov 21 12:05:04 crc kubenswrapper[4769]: E1121 12:05:04.060824 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist podName:6cafa23d-16ee-4a04-8c3c-6a1af03fea93 nodeName:}" failed. No retries permitted until 2025-11-21 12:05:05.060801435 +0000 UTC m=+863.761463283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist") pod "speaker-tp6px" (UID: "6cafa23d-16ee-4a04-8c3c-6a1af03fea93") : secret "metallb-memberlist" not found Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.063865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-metrics-certs\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.066180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcfa8924-271c-4289-aabc-17df5c1a3c8b-metrics-certs\") pod \"controller-6c7b4b5f48-8zv8h\" (UID: \"bcfa8924-271c-4289-aabc-17df5c1a3c8b\") " pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.116295 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.249139 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.324120 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-6c7b4b5f48-8zv8h"] Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.491272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"47cce16bc86db27434cd29028e0cc29f392edf4ced96c58dbcf219b7d0577b95"} Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.506271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" event={"ID":"809ea66e-033e-45d2-b2a1-d34b209472fc","Type":"ContainerStarted","Data":"74c47cc7f4c35397eeb92cbd2a31c7d56334e441474f5fb3b395133470781b05"} Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.508955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-6c7b4b5f48-8zv8h" event={"ID":"bcfa8924-271c-4289-aabc-17df5c1a3c8b","Type":"ContainerStarted","Data":"c213148434bba114ae68ccb7c74c0b8bd4e525140cdcf21ccafdc8b23376113b"} Nov 21 12:05:04 crc kubenswrapper[4769]: I1121 12:05:04.509016 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-6c7b4b5f48-8zv8h" event={"ID":"bcfa8924-271c-4289-aabc-17df5c1a3c8b","Type":"ContainerStarted","Data":"a9f76877c335b119d9982941505459b16cda2fb98ec025e0edc3aaee5fa00e24"} Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.075565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.084141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/6cafa23d-16ee-4a04-8c3c-6a1af03fea93-memberlist\") pod \"speaker-tp6px\" (UID: \"6cafa23d-16ee-4a04-8c3c-6a1af03fea93\") " pod="metallb-system/speaker-tp6px" Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.251798 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-tp6px" Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.529965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-6c7b4b5f48-8zv8h" event={"ID":"bcfa8924-271c-4289-aabc-17df5c1a3c8b","Type":"ContainerStarted","Data":"f100abcca90014e27de0a4dbc31a7ded8db932381a61f643d05567dfa4c295d1"} Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.531768 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.538340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-tp6px" event={"ID":"6cafa23d-16ee-4a04-8c3c-6a1af03fea93","Type":"ContainerStarted","Data":"4a28763ef0e8db1022026fb839866ccdfc5c0c5adbb09d24fdeabd8ebab52277"} Nov 21 12:05:05 crc kubenswrapper[4769]: I1121 12:05:05.563272 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/controller-6c7b4b5f48-8zv8h" podStartSLOduration=2.563248104 podStartE2EDuration="2.563248104s" podCreationTimestamp="2025-11-21 12:05:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:05:05.559077034 +0000 UTC m=+864.259738872" watchObservedRunningTime="2025-11-21 12:05:05.563248104 +0000 UTC m=+864.263909922" Nov 21 12:05:06 crc kubenswrapper[4769]: I1121 12:05:06.565576 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-tp6px" event={"ID":"6cafa23d-16ee-4a04-8c3c-6a1af03fea93","Type":"ContainerStarted","Data":"9213da7a02be9a7eaf18d7f22cfe7c68bb7405d23ccfc46c496bd624d1bcb793"} Nov 21 12:05:06 crc kubenswrapper[4769]: I1121 12:05:06.565962 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/speaker-tp6px" Nov 21 12:05:06 crc kubenswrapper[4769]: I1121 12:05:06.565976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-tp6px" event={"ID":"6cafa23d-16ee-4a04-8c3c-6a1af03fea93","Type":"ContainerStarted","Data":"74b2c9702d77ee7810a504f0ac15f8a056a96457b2295060e2c83d17e75b176c"} Nov 21 12:05:06 crc kubenswrapper[4769]: I1121 12:05:06.585497 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/speaker-tp6px" podStartSLOduration=3.585478551 podStartE2EDuration="3.585478551s" podCreationTimestamp="2025-11-21 12:05:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:05:06.583828547 +0000 UTC m=+865.284490365" watchObservedRunningTime="2025-11-21 12:05:06.585478551 +0000 UTC m=+865.286140369" Nov 21 12:05:13 crc kubenswrapper[4769]: I1121 12:05:13.617579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" event={"ID":"809ea66e-033e-45d2-b2a1-d34b209472fc","Type":"ContainerStarted","Data":"0bf1021b72f918953b7f9093d3fde3354c9af62c9929f1f76f5b5b8b7daf6d0e"} Nov 21 12:05:13 crc kubenswrapper[4769]: I1121 12:05:13.619771 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6d6db81-198f-4e45-bbda-40430ea673fd" containerID="b973b77cef40251002c0b063638071d9b72e613c490fb2c25e88abeb99d63c09" exitCode=0 Nov 21 12:05:13 crc kubenswrapper[4769]: I1121 12:05:13.619828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerDied","Data":"b973b77cef40251002c0b063638071d9b72e613c490fb2c25e88abeb99d63c09"} Nov 21 12:05:14 crc kubenswrapper[4769]: I1121 12:05:14.122981 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/controller-6c7b4b5f48-8zv8h" Nov 21 12:05:14 crc kubenswrapper[4769]: I1121 12:05:14.626599 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:14 crc kubenswrapper[4769]: I1121 12:05:14.674860 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" podStartSLOduration=2.584846101 podStartE2EDuration="11.674842973s" podCreationTimestamp="2025-11-21 12:05:03 +0000 UTC" firstStartedPulling="2025-11-21 12:05:03.945670863 +0000 UTC m=+862.646332681" lastFinishedPulling="2025-11-21 12:05:13.035667725 +0000 UTC m=+871.736329553" observedRunningTime="2025-11-21 12:05:14.671776863 +0000 UTC m=+873.372438701" watchObservedRunningTime="2025-11-21 12:05:14.674842973 +0000 UTC m=+873.375504791" Nov 21 12:05:15 crc kubenswrapper[4769]: I1121 12:05:15.257593 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/speaker-tp6px" Nov 21 12:05:15 crc kubenswrapper[4769]: I1121 12:05:15.633035 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6d6db81-198f-4e45-bbda-40430ea673fd" containerID="5c62925c964a31544860d1b8f6c6868e21d5d9700467d7285b6acbb9a48683ba" exitCode=0 Nov 21 12:05:15 crc kubenswrapper[4769]: I1121 12:05:15.633127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerDied","Data":"5c62925c964a31544860d1b8f6c6868e21d5d9700467d7285b6acbb9a48683ba"} Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.655376 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6d6db81-198f-4e45-bbda-40430ea673fd" containerID="bfa3e9a6997a9c424d070aae8d97b2ccf9d8c5177ed91194bfc5eb96c85e4e5a" exitCode=0 Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.655436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerDied","Data":"bfa3e9a6997a9c424d070aae8d97b2ccf9d8c5177ed91194bfc5eb96c85e4e5a"} Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.795257 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh"] Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.796696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.799352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-vmwhc" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.810338 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh"] Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.891003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9z5\" (UniqueName: \"kubernetes.io/projected/6025e273-0a64-4aba-8b02-8270c078f598-kube-api-access-4q9z5\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.891118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.891149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.992767 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.992821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.992867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9z5\" (UniqueName: \"kubernetes.io/projected/6025e273-0a64-4aba-8b02-8270c078f598-kube-api-access-4q9z5\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.993343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-util\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:16 crc kubenswrapper[4769]: I1121 12:05:16.993548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-bundle\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.022284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9z5\" (UniqueName: \"kubernetes.io/projected/6025e273-0a64-4aba-8b02-8270c078f598-kube-api-access-4q9z5\") pod \"1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.111330 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.546372 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh"] Nov 21 12:05:17 crc kubenswrapper[4769]: W1121 12:05:17.552204 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6025e273_0a64_4aba_8b02_8270c078f598.slice/crio-9e8e1157f7ae6da1e2f6595ad40bf0ec89526f8c07b19140d8f98cb6449678e1 WatchSource:0}: Error finding container 9e8e1157f7ae6da1e2f6595ad40bf0ec89526f8c07b19140d8f98cb6449678e1: Status 404 returned error can't find the container with id 9e8e1157f7ae6da1e2f6595ad40bf0ec89526f8c07b19140d8f98cb6449678e1 Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.713071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" event={"ID":"6025e273-0a64-4aba-8b02-8270c078f598","Type":"ContainerStarted","Data":"9e8e1157f7ae6da1e2f6595ad40bf0ec89526f8c07b19140d8f98cb6449678e1"} Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.720095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"ef2582d886dd086881ce798762146d21b39dffe7541c441137b360708b454bef"} Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.720138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"b365c9d03248de9d9b2edfedcdf0e1d5df6c21a20db323ffe625ba79fd432439"} Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.720149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"7ee9428ceffe3e3295a8203884731e25735797ba81c04c452b3e0b116286e3d1"} Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.720159 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"fd9b2feb445e7d03638abfa2d6c529ca5a238f09f11df069a6277ab28df78450"} Nov 21 12:05:17 crc kubenswrapper[4769]: I1121 12:05:17.720167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"80008e8435ca0d0f2cc6158e9345d7bd44ca550f6dcd42bd91fe2b16e5a82f06"} Nov 21 12:05:18 crc kubenswrapper[4769]: I1121 12:05:18.728267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-srjg2" event={"ID":"e6d6db81-198f-4e45-bbda-40430ea673fd","Type":"ContainerStarted","Data":"e706f863436c3402d337b06dee1db4f0cb67890074a4882c984d3a5340f68977"} Nov 21 12:05:18 crc kubenswrapper[4769]: I1121 12:05:18.729942 4769 generic.go:334] "Generic (PLEG): container finished" podID="6025e273-0a64-4aba-8b02-8270c078f598" containerID="631d13d55d7b60085aec819277fdb86bd9fa8f9af85c1b48daee9b3fc4227b0d" exitCode=0 Nov 21 12:05:18 crc kubenswrapper[4769]: I1121 12:05:18.730006 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" event={"ID":"6025e273-0a64-4aba-8b02-8270c078f598","Type":"ContainerDied","Data":"631d13d55d7b60085aec819277fdb86bd9fa8f9af85c1b48daee9b3fc4227b0d"} Nov 21 12:05:18 crc kubenswrapper[4769]: I1121 12:05:18.759298 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-srjg2" podStartSLOduration=7.06476624 podStartE2EDuration="15.759276363s" podCreationTimestamp="2025-11-21 12:05:03 +0000 UTC" firstStartedPulling="2025-11-21 12:05:04.375506944 +0000 UTC m=+863.076168752" lastFinishedPulling="2025-11-21 12:05:13.070017007 +0000 UTC m=+871.770678875" observedRunningTime="2025-11-21 12:05:18.755638687 +0000 UTC m=+877.456300525" watchObservedRunningTime="2025-11-21 12:05:18.759276363 +0000 UTC m=+877.459938181" Nov 21 12:05:19 crc kubenswrapper[4769]: I1121 12:05:19.250094 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:19 crc kubenswrapper[4769]: I1121 12:05:19.306566 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:19 crc kubenswrapper[4769]: I1121 12:05:19.735398 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:22 crc kubenswrapper[4769]: I1121 12:05:22.764081 4769 generic.go:334] "Generic (PLEG): container finished" podID="6025e273-0a64-4aba-8b02-8270c078f598" containerID="ac8d889e882b04deb657fa1e0d69849200cebf76cbfd1f89d2352f4d45c71181" exitCode=0 Nov 21 12:05:22 crc kubenswrapper[4769]: I1121 12:05:22.764207 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" event={"ID":"6025e273-0a64-4aba-8b02-8270c078f598","Type":"ContainerDied","Data":"ac8d889e882b04deb657fa1e0d69849200cebf76cbfd1f89d2352f4d45c71181"} Nov 21 12:05:23 crc kubenswrapper[4769]: I1121 12:05:23.666860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-webhook-server-6998585d5-cxcz2" Nov 21 12:05:23 crc kubenswrapper[4769]: I1121 12:05:23.779993 4769 generic.go:334] "Generic (PLEG): container finished" podID="6025e273-0a64-4aba-8b02-8270c078f598" containerID="a335aa635e5046b43b290fa9b20795d106069c3c13ab5f2ad88f1e15fdc2ad64" exitCode=0 Nov 21 12:05:23 crc kubenswrapper[4769]: I1121 12:05:23.780037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" event={"ID":"6025e273-0a64-4aba-8b02-8270c078f598","Type":"ContainerDied","Data":"a335aa635e5046b43b290fa9b20795d106069c3c13ab5f2ad88f1e15fdc2ad64"} Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.184964 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.227723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-bundle\") pod \"6025e273-0a64-4aba-8b02-8270c078f598\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.227903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-util\") pod \"6025e273-0a64-4aba-8b02-8270c078f598\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.227949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9z5\" (UniqueName: \"kubernetes.io/projected/6025e273-0a64-4aba-8b02-8270c078f598-kube-api-access-4q9z5\") pod \"6025e273-0a64-4aba-8b02-8270c078f598\" (UID: \"6025e273-0a64-4aba-8b02-8270c078f598\") " Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.228675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-bundle" (OuterVolumeSpecName: "bundle") pod "6025e273-0a64-4aba-8b02-8270c078f598" (UID: "6025e273-0a64-4aba-8b02-8270c078f598"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.235541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6025e273-0a64-4aba-8b02-8270c078f598-kube-api-access-4q9z5" (OuterVolumeSpecName: "kube-api-access-4q9z5") pod "6025e273-0a64-4aba-8b02-8270c078f598" (UID: "6025e273-0a64-4aba-8b02-8270c078f598"). InnerVolumeSpecName "kube-api-access-4q9z5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.246211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-util" (OuterVolumeSpecName: "util") pod "6025e273-0a64-4aba-8b02-8270c078f598" (UID: "6025e273-0a64-4aba-8b02-8270c078f598"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.329409 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.329449 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6025e273-0a64-4aba-8b02-8270c078f598-util\") on node \"crc\" DevicePath \"\"" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.329460 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4q9z5\" (UniqueName: \"kubernetes.io/projected/6025e273-0a64-4aba-8b02-8270c078f598-kube-api-access-4q9z5\") on node \"crc\" DevicePath \"\"" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.798763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" event={"ID":"6025e273-0a64-4aba-8b02-8270c078f598","Type":"ContainerDied","Data":"9e8e1157f7ae6da1e2f6595ad40bf0ec89526f8c07b19140d8f98cb6449678e1"} Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.799407 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e8e1157f7ae6da1e2f6595ad40bf0ec89526f8c07b19140d8f98cb6449678e1" Nov 21 12:05:25 crc kubenswrapper[4769]: I1121 12:05:25.798831 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1f59f640c8a0eb1a7b0f26c81382bbdde784d03eb439a940bb8da3931apw6dh" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.780284 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2"] Nov 21 12:05:29 crc kubenswrapper[4769]: E1121 12:05:29.780886 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="util" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.780900 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="util" Nov 21 12:05:29 crc kubenswrapper[4769]: E1121 12:05:29.780914 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="pull" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.780919 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="pull" Nov 21 12:05:29 crc kubenswrapper[4769]: E1121 12:05:29.780930 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="extract" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.780937 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="extract" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.781033 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6025e273-0a64-4aba-8b02-8270c078f598" containerName="extract" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.781469 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.785101 4769 reflector.go:368] Caches populated for *v1.Secret from object-"cert-manager-operator"/"cert-manager-operator-controller-manager-dockercfg-dqdlp" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.789680 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"openshift-service-ca.crt" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.789702 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"kube-root-ca.crt" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.801990 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2"] Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.907020 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ece8efa-fc6c-4289-907f-5f97e7297ea1-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-52nm2\" (UID: \"8ece8efa-fc6c-4289-907f-5f97e7297ea1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:29 crc kubenswrapper[4769]: I1121 12:05:29.907077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgxpc\" (UniqueName: \"kubernetes.io/projected/8ece8efa-fc6c-4289-907f-5f97e7297ea1-kube-api-access-kgxpc\") pod \"cert-manager-operator-controller-manager-64cf6dff88-52nm2\" (UID: \"8ece8efa-fc6c-4289-907f-5f97e7297ea1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.008944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ece8efa-fc6c-4289-907f-5f97e7297ea1-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-52nm2\" (UID: \"8ece8efa-fc6c-4289-907f-5f97e7297ea1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.009004 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kgxpc\" (UniqueName: \"kubernetes.io/projected/8ece8efa-fc6c-4289-907f-5f97e7297ea1-kube-api-access-kgxpc\") pod \"cert-manager-operator-controller-manager-64cf6dff88-52nm2\" (UID: \"8ece8efa-fc6c-4289-907f-5f97e7297ea1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.009726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ece8efa-fc6c-4289-907f-5f97e7297ea1-tmp\") pod \"cert-manager-operator-controller-manager-64cf6dff88-52nm2\" (UID: \"8ece8efa-fc6c-4289-907f-5f97e7297ea1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.040234 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgxpc\" (UniqueName: \"kubernetes.io/projected/8ece8efa-fc6c-4289-907f-5f97e7297ea1-kube-api-access-kgxpc\") pod \"cert-manager-operator-controller-manager-64cf6dff88-52nm2\" (UID: \"8ece8efa-fc6c-4289-907f-5f97e7297ea1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.102929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.625900 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2"] Nov 21 12:05:30 crc kubenswrapper[4769]: W1121 12:05:30.636490 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ece8efa_fc6c_4289_907f_5f97e7297ea1.slice/crio-5aa2b3891ee0b87e032ac490b05c9e53eaaa7daf73f2f2840313566b238f4895 WatchSource:0}: Error finding container 5aa2b3891ee0b87e032ac490b05c9e53eaaa7daf73f2f2840313566b238f4895: Status 404 returned error can't find the container with id 5aa2b3891ee0b87e032ac490b05c9e53eaaa7daf73f2f2840313566b238f4895 Nov 21 12:05:30 crc kubenswrapper[4769]: I1121 12:05:30.837568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" event={"ID":"8ece8efa-fc6c-4289-907f-5f97e7297ea1","Type":"ContainerStarted","Data":"5aa2b3891ee0b87e032ac490b05c9e53eaaa7daf73f2f2840313566b238f4895"} Nov 21 12:05:34 crc kubenswrapper[4769]: I1121 12:05:34.253422 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-srjg2" Nov 21 12:05:43 crc kubenswrapper[4769]: I1121 12:05:43.939055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" event={"ID":"8ece8efa-fc6c-4289-907f-5f97e7297ea1","Type":"ContainerStarted","Data":"6d0d1fcf0a0dbd9d5e24b7ac0ded6e7245eaddf5d190bde1cfbfedff016aadf2"} Nov 21 12:05:43 crc kubenswrapper[4769]: I1121 12:05:43.973299 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-64cf6dff88-52nm2" podStartSLOduration=2.654961358 podStartE2EDuration="14.973264065s" podCreationTimestamp="2025-11-21 12:05:29 +0000 UTC" firstStartedPulling="2025-11-21 12:05:30.640064024 +0000 UTC m=+889.340725842" lastFinishedPulling="2025-11-21 12:05:42.958366721 +0000 UTC m=+901.659028549" observedRunningTime="2025-11-21 12:05:43.968158301 +0000 UTC m=+902.668820119" watchObservedRunningTime="2025-11-21 12:05:43.973264065 +0000 UTC m=+902.673925893" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.408031 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-4h962"] Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.409426 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.413532 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"kube-root-ca.crt" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.413788 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"openshift-service-ca.crt" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.417334 4769 reflector.go:368] Caches populated for *v1.Secret from object-"cert-manager"/"cert-manager-webhook-dockercfg-2zdrg" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.429276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-4h962"] Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.501986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0c9b7b4-5a35-4780-8719-77d4d7609d2d-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-4h962\" (UID: \"c0c9b7b4-5a35-4780-8719-77d4d7609d2d\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.502111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42bw6\" (UniqueName: \"kubernetes.io/projected/c0c9b7b4-5a35-4780-8719-77d4d7609d2d-kube-api-access-42bw6\") pod \"cert-manager-webhook-f4fb5df64-4h962\" (UID: \"c0c9b7b4-5a35-4780-8719-77d4d7609d2d\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.603724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-42bw6\" (UniqueName: \"kubernetes.io/projected/c0c9b7b4-5a35-4780-8719-77d4d7609d2d-kube-api-access-42bw6\") pod \"cert-manager-webhook-f4fb5df64-4h962\" (UID: \"c0c9b7b4-5a35-4780-8719-77d4d7609d2d\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.603853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0c9b7b4-5a35-4780-8719-77d4d7609d2d-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-4h962\" (UID: \"c0c9b7b4-5a35-4780-8719-77d4d7609d2d\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.626014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-42bw6\" (UniqueName: \"kubernetes.io/projected/c0c9b7b4-5a35-4780-8719-77d4d7609d2d-kube-api-access-42bw6\") pod \"cert-manager-webhook-f4fb5df64-4h962\" (UID: \"c0c9b7b4-5a35-4780-8719-77d4d7609d2d\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.637789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0c9b7b4-5a35-4780-8719-77d4d7609d2d-bound-sa-token\") pod \"cert-manager-webhook-f4fb5df64-4h962\" (UID: \"c0c9b7b4-5a35-4780-8719-77d4d7609d2d\") " pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:46 crc kubenswrapper[4769]: I1121 12:05:46.736973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:47 crc kubenswrapper[4769]: I1121 12:05:47.024228 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-f4fb5df64-4h962"] Nov 21 12:05:47 crc kubenswrapper[4769]: W1121 12:05:47.038341 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0c9b7b4_5a35_4780_8719_77d4d7609d2d.slice/crio-b05e63a37f08215487748719387c6ef835a14dcf14571a488d57f9dbbf657826 WatchSource:0}: Error finding container b05e63a37f08215487748719387c6ef835a14dcf14571a488d57f9dbbf657826: Status 404 returned error can't find the container with id b05e63a37f08215487748719387c6ef835a14dcf14571a488d57f9dbbf657826 Nov 21 12:05:47 crc kubenswrapper[4769]: I1121 12:05:47.965736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" event={"ID":"c0c9b7b4-5a35-4780-8719-77d4d7609d2d","Type":"ContainerStarted","Data":"b05e63a37f08215487748719387c6ef835a14dcf14571a488d57f9dbbf657826"} Nov 21 12:05:48 crc kubenswrapper[4769]: I1121 12:05:48.769876 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h"] Nov 21 12:05:48 crc kubenswrapper[4769]: I1121 12:05:48.771787 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:48 crc kubenswrapper[4769]: I1121 12:05:48.777620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"cert-manager"/"cert-manager-cainjector-dockercfg-fbm4k" Nov 21 12:05:48 crc kubenswrapper[4769]: I1121 12:05:48.781102 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h"] Nov 21 12:05:48 crc kubenswrapper[4769]: I1121 12:05:48.949212 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvk6s\" (UniqueName: \"kubernetes.io/projected/027948d5-c131-4632-bdf0-fc267288e0f4-kube-api-access-hvk6s\") pod \"cert-manager-cainjector-855d9ccff4-nzk4h\" (UID: \"027948d5-c131-4632-bdf0-fc267288e0f4\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:48 crc kubenswrapper[4769]: I1121 12:05:48.949300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/027948d5-c131-4632-bdf0-fc267288e0f4-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-nzk4h\" (UID: \"027948d5-c131-4632-bdf0-fc267288e0f4\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.050999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hvk6s\" (UniqueName: \"kubernetes.io/projected/027948d5-c131-4632-bdf0-fc267288e0f4-kube-api-access-hvk6s\") pod \"cert-manager-cainjector-855d9ccff4-nzk4h\" (UID: \"027948d5-c131-4632-bdf0-fc267288e0f4\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.051090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/027948d5-c131-4632-bdf0-fc267288e0f4-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-nzk4h\" (UID: \"027948d5-c131-4632-bdf0-fc267288e0f4\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.073954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/027948d5-c131-4632-bdf0-fc267288e0f4-bound-sa-token\") pod \"cert-manager-cainjector-855d9ccff4-nzk4h\" (UID: \"027948d5-c131-4632-bdf0-fc267288e0f4\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.075778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvk6s\" (UniqueName: \"kubernetes.io/projected/027948d5-c131-4632-bdf0-fc267288e0f4-kube-api-access-hvk6s\") pod \"cert-manager-cainjector-855d9ccff4-nzk4h\" (UID: \"027948d5-c131-4632-bdf0-fc267288e0f4\") " pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.100994 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.497305 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h"] Nov 21 12:05:49 crc kubenswrapper[4769]: I1121 12:05:49.982793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" event={"ID":"027948d5-c131-4632-bdf0-fc267288e0f4","Type":"ContainerStarted","Data":"eecff42bfa7d1c06e7acd97f924a43be06ed7c9390d8d7da43c2f704d8306157"} Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.384676 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-86cb77c54b-jgnqv"] Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.388177 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.400694 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-86cb77c54b-jgnqv"] Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.435273 4769 reflector.go:368] Caches populated for *v1.Secret from object-"cert-manager"/"cert-manager-dockercfg-8t58k" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.538181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzstt\" (UniqueName: \"kubernetes.io/projected/0e9bd78f-eb5c-417e-86c4-57267859b89a-kube-api-access-dzstt\") pod \"cert-manager-86cb77c54b-jgnqv\" (UID: \"0e9bd78f-eb5c-417e-86c4-57267859b89a\") " pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.538328 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9bd78f-eb5c-417e-86c4-57267859b89a-bound-sa-token\") pod \"cert-manager-86cb77c54b-jgnqv\" (UID: \"0e9bd78f-eb5c-417e-86c4-57267859b89a\") " pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.640478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9bd78f-eb5c-417e-86c4-57267859b89a-bound-sa-token\") pod \"cert-manager-86cb77c54b-jgnqv\" (UID: \"0e9bd78f-eb5c-417e-86c4-57267859b89a\") " pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.640670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dzstt\" (UniqueName: \"kubernetes.io/projected/0e9bd78f-eb5c-417e-86c4-57267859b89a-kube-api-access-dzstt\") pod \"cert-manager-86cb77c54b-jgnqv\" (UID: \"0e9bd78f-eb5c-417e-86c4-57267859b89a\") " pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.669824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzstt\" (UniqueName: \"kubernetes.io/projected/0e9bd78f-eb5c-417e-86c4-57267859b89a-kube-api-access-dzstt\") pod \"cert-manager-86cb77c54b-jgnqv\" (UID: \"0e9bd78f-eb5c-417e-86c4-57267859b89a\") " pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.670133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e9bd78f-eb5c-417e-86c4-57267859b89a-bound-sa-token\") pod \"cert-manager-86cb77c54b-jgnqv\" (UID: \"0e9bd78f-eb5c-417e-86c4-57267859b89a\") " pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:56 crc kubenswrapper[4769]: I1121 12:05:56.760838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-86cb77c54b-jgnqv" Nov 21 12:05:58 crc kubenswrapper[4769]: I1121 12:05:58.153062 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-86cb77c54b-jgnqv"] Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.059365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" event={"ID":"027948d5-c131-4632-bdf0-fc267288e0f4","Type":"ContainerStarted","Data":"7af8f62960530a954f43f34877832d783736c8f86b017d912c00d6fb668b72e8"} Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.061495 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" event={"ID":"c0c9b7b4-5a35-4780-8719-77d4d7609d2d","Type":"ContainerStarted","Data":"13f14552a608da46b643c614e1bdba0c58e2487ef5cd81c4b5161ca27e52edf5"} Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.061628 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.063672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-86cb77c54b-jgnqv" event={"ID":"0e9bd78f-eb5c-417e-86c4-57267859b89a","Type":"ContainerStarted","Data":"b80d63ecc2dcd05fb07c99559d226b2ec91e07208ceeb808125aba3b538669f0"} Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.063707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-86cb77c54b-jgnqv" event={"ID":"0e9bd78f-eb5c-417e-86c4-57267859b89a","Type":"ContainerStarted","Data":"2bb32fd62174899f4608c4d0e30d238c7be21fb400dcb602157743a00a39d891"} Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.084334 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-855d9ccff4-nzk4h" podStartSLOduration=2.485170779 podStartE2EDuration="11.084311569s" podCreationTimestamp="2025-11-21 12:05:48 +0000 UTC" firstStartedPulling="2025-11-21 12:05:49.522176337 +0000 UTC m=+908.222838155" lastFinishedPulling="2025-11-21 12:05:58.121317117 +0000 UTC m=+916.821978945" observedRunningTime="2025-11-21 12:05:59.080655543 +0000 UTC m=+917.781317381" watchObservedRunningTime="2025-11-21 12:05:59.084311569 +0000 UTC m=+917.784973407" Nov 21 12:05:59 crc kubenswrapper[4769]: I1121 12:05:59.105423 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" podStartSLOduration=2.060106127 podStartE2EDuration="13.105398032s" podCreationTimestamp="2025-11-21 12:05:46 +0000 UTC" firstStartedPulling="2025-11-21 12:05:47.041042454 +0000 UTC m=+905.741704272" lastFinishedPulling="2025-11-21 12:05:58.086334339 +0000 UTC m=+916.786996177" observedRunningTime="2025-11-21 12:05:59.103703918 +0000 UTC m=+917.804365736" watchObservedRunningTime="2025-11-21 12:05:59.105398032 +0000 UTC m=+917.806059870" Nov 21 12:06:06 crc kubenswrapper[4769]: I1121 12:06:06.741701 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-f4fb5df64-4h962" Nov 21 12:06:06 crc kubenswrapper[4769]: I1121 12:06:06.774749 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-86cb77c54b-jgnqv" podStartSLOduration=10.774707711 podStartE2EDuration="10.774707711s" podCreationTimestamp="2025-11-21 12:05:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:05:59.131346933 +0000 UTC m=+917.832008791" watchObservedRunningTime="2025-11-21 12:06:06.774707711 +0000 UTC m=+925.475369569" Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.880448 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-svjxd"] Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.882457 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.885383 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-operator-index-dockercfg-bl2mz" Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.886993 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.887340 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.949053 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-svjxd"] Nov 21 12:06:09 crc kubenswrapper[4769]: I1121 12:06:09.957948 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jszss\" (UniqueName: \"kubernetes.io/projected/39f90e3d-0721-4a1f-9a3e-9c3464938fa9-kube-api-access-jszss\") pod \"openstack-operator-index-svjxd\" (UID: \"39f90e3d-0721-4a1f-9a3e-9c3464938fa9\") " pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:10 crc kubenswrapper[4769]: I1121 12:06:10.059349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jszss\" (UniqueName: \"kubernetes.io/projected/39f90e3d-0721-4a1f-9a3e-9c3464938fa9-kube-api-access-jszss\") pod \"openstack-operator-index-svjxd\" (UID: \"39f90e3d-0721-4a1f-9a3e-9c3464938fa9\") " pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:10 crc kubenswrapper[4769]: I1121 12:06:10.085699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jszss\" (UniqueName: \"kubernetes.io/projected/39f90e3d-0721-4a1f-9a3e-9c3464938fa9-kube-api-access-jszss\") pod \"openstack-operator-index-svjxd\" (UID: \"39f90e3d-0721-4a1f-9a3e-9c3464938fa9\") " pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:10 crc kubenswrapper[4769]: I1121 12:06:10.204590 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:10 crc kubenswrapper[4769]: I1121 12:06:10.658070 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-svjxd"] Nov 21 12:06:11 crc kubenswrapper[4769]: I1121 12:06:11.154425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-svjxd" event={"ID":"39f90e3d-0721-4a1f-9a3e-9c3464938fa9","Type":"ContainerStarted","Data":"977b25a037d3ec2ca5130497eeb516152b76d539eb80e14bd354a5d688cb64e0"} Nov 21 12:06:13 crc kubenswrapper[4769]: I1121 12:06:13.170362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-svjxd" event={"ID":"39f90e3d-0721-4a1f-9a3e-9c3464938fa9","Type":"ContainerStarted","Data":"a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3"} Nov 21 12:06:13 crc kubenswrapper[4769]: I1121 12:06:13.189801 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-svjxd" podStartSLOduration=2.461786955 podStartE2EDuration="4.189775604s" podCreationTimestamp="2025-11-21 12:06:09 +0000 UTC" firstStartedPulling="2025-11-21 12:06:10.657123719 +0000 UTC m=+929.357785547" lastFinishedPulling="2025-11-21 12:06:12.385112378 +0000 UTC m=+931.085774196" observedRunningTime="2025-11-21 12:06:13.188136051 +0000 UTC m=+931.888797909" watchObservedRunningTime="2025-11-21 12:06:13.189775604 +0000 UTC m=+931.890437422" Nov 21 12:06:13 crc kubenswrapper[4769]: I1121 12:06:13.244550 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-svjxd"] Nov 21 12:06:13 crc kubenswrapper[4769]: I1121 12:06:13.868675 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-ttf49"] Nov 21 12:06:13 crc kubenswrapper[4769]: I1121 12:06:13.912828 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-ttf49"] Nov 21 12:06:13 crc kubenswrapper[4769]: I1121 12:06:13.912968 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:14 crc kubenswrapper[4769]: I1121 12:06:14.025151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqd8n\" (UniqueName: \"kubernetes.io/projected/848e8062-b068-4fc7-9b2b-092937683caa-kube-api-access-jqd8n\") pod \"openstack-operator-index-ttf49\" (UID: \"848e8062-b068-4fc7-9b2b-092937683caa\") " pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:14 crc kubenswrapper[4769]: I1121 12:06:14.126990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jqd8n\" (UniqueName: \"kubernetes.io/projected/848e8062-b068-4fc7-9b2b-092937683caa-kube-api-access-jqd8n\") pod \"openstack-operator-index-ttf49\" (UID: \"848e8062-b068-4fc7-9b2b-092937683caa\") " pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:14 crc kubenswrapper[4769]: I1121 12:06:14.164483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqd8n\" (UniqueName: \"kubernetes.io/projected/848e8062-b068-4fc7-9b2b-092937683caa-kube-api-access-jqd8n\") pod \"openstack-operator-index-ttf49\" (UID: \"848e8062-b068-4fc7-9b2b-092937683caa\") " pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:14 crc kubenswrapper[4769]: I1121 12:06:14.238840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:14 crc kubenswrapper[4769]: I1121 12:06:14.680819 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-ttf49"] Nov 21 12:06:15 crc kubenswrapper[4769]: I1121 12:06:15.202451 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-index-svjxd" podUID="39f90e3d-0721-4a1f-9a3e-9c3464938fa9" containerName="registry-server" containerID="cri-o://a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3" gracePeriod=2 Nov 21 12:06:15 crc kubenswrapper[4769]: I1121 12:06:15.203060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ttf49" event={"ID":"848e8062-b068-4fc7-9b2b-092937683caa","Type":"ContainerStarted","Data":"0bfaae16f16e5301628b78d891d37234aaef14a91c117e8b84d652fb01f97c6d"} Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.178169 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.214662 4769 generic.go:334] "Generic (PLEG): container finished" podID="39f90e3d-0721-4a1f-9a3e-9c3464938fa9" containerID="a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3" exitCode=0 Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.214727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-svjxd" event={"ID":"39f90e3d-0721-4a1f-9a3e-9c3464938fa9","Type":"ContainerDied","Data":"a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3"} Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.214742 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-svjxd" Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.214760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-svjxd" event={"ID":"39f90e3d-0721-4a1f-9a3e-9c3464938fa9","Type":"ContainerDied","Data":"977b25a037d3ec2ca5130497eeb516152b76d539eb80e14bd354a5d688cb64e0"} Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.214783 4769 scope.go:117] "RemoveContainer" containerID="a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3" Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.264909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jszss\" (UniqueName: \"kubernetes.io/projected/39f90e3d-0721-4a1f-9a3e-9c3464938fa9-kube-api-access-jszss\") pod \"39f90e3d-0721-4a1f-9a3e-9c3464938fa9\" (UID: \"39f90e3d-0721-4a1f-9a3e-9c3464938fa9\") " Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.274444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f90e3d-0721-4a1f-9a3e-9c3464938fa9-kube-api-access-jszss" (OuterVolumeSpecName: "kube-api-access-jszss") pod "39f90e3d-0721-4a1f-9a3e-9c3464938fa9" (UID: "39f90e3d-0721-4a1f-9a3e-9c3464938fa9"). InnerVolumeSpecName "kube-api-access-jszss". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.367208 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jszss\" (UniqueName: \"kubernetes.io/projected/39f90e3d-0721-4a1f-9a3e-9c3464938fa9-kube-api-access-jszss\") on node \"crc\" DevicePath \"\"" Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.546347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-svjxd"] Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.549625 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-index-svjxd"] Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.850627 4769 scope.go:117] "RemoveContainer" containerID="a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3" Nov 21 12:06:16 crc kubenswrapper[4769]: E1121 12:06:16.851326 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3\": container with ID starting with a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3 not found: ID does not exist" containerID="a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3" Nov 21 12:06:16 crc kubenswrapper[4769]: I1121 12:06:16.851393 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3"} err="failed to get container status \"a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3\": rpc error: code = NotFound desc = could not find container \"a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3\": container with ID starting with a061d5199bce1d80c0031f8e3bfafaa8aa03fee47fbbee6965690a58b531c2a3 not found: ID does not exist" Nov 21 12:06:17 crc kubenswrapper[4769]: I1121 12:06:17.285102 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f90e3d-0721-4a1f-9a3e-9c3464938fa9" path="/var/lib/kubelet/pods/39f90e3d-0721-4a1f-9a3e-9c3464938fa9/volumes" Nov 21 12:06:18 crc kubenswrapper[4769]: I1121 12:06:18.237584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ttf49" event={"ID":"848e8062-b068-4fc7-9b2b-092937683caa","Type":"ContainerStarted","Data":"2cf033c69500dfbcfb5b9cbab0acb3e0f4718409f87cf757654b7991228fcc62"} Nov 21 12:06:18 crc kubenswrapper[4769]: I1121 12:06:18.272345 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-ttf49" podStartSLOduration=2.731473697 podStartE2EDuration="5.272294387s" podCreationTimestamp="2025-11-21 12:06:13 +0000 UTC" firstStartedPulling="2025-11-21 12:06:14.694244247 +0000 UTC m=+933.394906075" lastFinishedPulling="2025-11-21 12:06:17.235064947 +0000 UTC m=+935.935726765" observedRunningTime="2025-11-21 12:06:18.261159005 +0000 UTC m=+936.961820853" watchObservedRunningTime="2025-11-21 12:06:18.272294387 +0000 UTC m=+936.972956225" Nov 21 12:06:24 crc kubenswrapper[4769]: I1121 12:06:24.239201 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:24 crc kubenswrapper[4769]: I1121 12:06:24.240510 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:24 crc kubenswrapper[4769]: I1121 12:06:24.281891 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:24 crc kubenswrapper[4769]: I1121 12:06:24.343085 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.516591 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd"] Nov 21 12:06:25 crc kubenswrapper[4769]: E1121 12:06:25.516988 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="39f90e3d-0721-4a1f-9a3e-9c3464938fa9" containerName="registry-server" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.517010 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f90e3d-0721-4a1f-9a3e-9c3464938fa9" containerName="registry-server" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.517155 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="39f90e3d-0721-4a1f-9a3e-9c3464938fa9" containerName="registry-server" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.518430 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.523134 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.536364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd"] Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.638721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fg94\" (UniqueName: \"kubernetes.io/projected/966766ef-ada6-45ba-b284-0b92bf3ee41a-kube-api-access-6fg94\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.639234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-util\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.639377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-bundle\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.740978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-util\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.741055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-bundle\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.741112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6fg94\" (UniqueName: \"kubernetes.io/projected/966766ef-ada6-45ba-b284-0b92bf3ee41a-kube-api-access-6fg94\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.741716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-bundle\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.741716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-util\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.766872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fg94\" (UniqueName: \"kubernetes.io/projected/966766ef-ada6-45ba-b284-0b92bf3ee41a-kube-api-access-6fg94\") pod \"2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:25 crc kubenswrapper[4769]: I1121 12:06:25.838727 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:06:26 crc kubenswrapper[4769]: I1121 12:06:26.276786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd"] Nov 21 12:06:26 crc kubenswrapper[4769]: I1121 12:06:26.316571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" event={"ID":"966766ef-ada6-45ba-b284-0b92bf3ee41a","Type":"ContainerStarted","Data":"5f56ab4a5bdf498622362be4840329b210e94fc64963df55b7e7e2d3a5fd74a5"} Nov 21 12:06:27 crc kubenswrapper[4769]: I1121 12:06:27.328407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" event={"ID":"966766ef-ada6-45ba-b284-0b92bf3ee41a","Type":"ContainerStarted","Data":"1fcf24f5868eed5ff067fccc6161f7f04dd567bed3715094de7e6394c181ce6c"} Nov 21 12:06:28 crc kubenswrapper[4769]: I1121 12:06:28.398511 4769 generic.go:334] "Generic (PLEG): container finished" podID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerID="1fcf24f5868eed5ff067fccc6161f7f04dd567bed3715094de7e6394c181ce6c" exitCode=0 Nov 21 12:06:28 crc kubenswrapper[4769]: I1121 12:06:28.398579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" event={"ID":"966766ef-ada6-45ba-b284-0b92bf3ee41a","Type":"ContainerDied","Data":"1fcf24f5868eed5ff067fccc6161f7f04dd567bed3715094de7e6394c181ce6c"} Nov 21 12:06:41 crc kubenswrapper[4769]: I1121 12:06:41.325526 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:06:41 crc kubenswrapper[4769]: I1121 12:06:41.326450 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:06:42 crc kubenswrapper[4769]: E1121 12:06:42.061322 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/openstack-k8s-operators/openstack-operator-bundle:c4e96a71e428d7c5823322ddd472aa400f9dbc56" Nov 21 12:06:42 crc kubenswrapper[4769]: E1121 12:06:42.061585 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:pull,Image:quay.io/openstack-k8s-operators/openstack-operator-bundle:c4e96a71e428d7c5823322ddd472aa400f9dbc56,Command:[/util/cpb /bundle],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:bundle,ReadOnly:false,MountPath:/bundle,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:util,ReadOnly:false,MountPath:/util,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-6fg94,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod 2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd_openstack-operators(966766ef-ada6-45ba-b284-0b92bf3ee41a): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:06:42 crc kubenswrapper[4769]: E1121 12:06:42.063279 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" Nov 21 12:06:42 crc kubenswrapper[4769]: E1121 12:06:42.514704 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/openstack-operator-bundle:c4e96a71e428d7c5823322ddd472aa400f9dbc56\\\"\"" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" Nov 21 12:06:57 crc kubenswrapper[4769]: E1121 12:06:57.060579 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966766ef_ada6_45ba_b284_0b92bf3ee41a.slice/crio-conmon-d850fe2c311f1f361d33b997795c74fa5d0773520e4c2dc6c1fd0f1b18d0e9fa.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:06:57 crc kubenswrapper[4769]: I1121 12:06:57.633058 4769 generic.go:334] "Generic (PLEG): container finished" podID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerID="d850fe2c311f1f361d33b997795c74fa5d0773520e4c2dc6c1fd0f1b18d0e9fa" exitCode=0 Nov 21 12:06:57 crc kubenswrapper[4769]: I1121 12:06:57.633432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" event={"ID":"966766ef-ada6-45ba-b284-0b92bf3ee41a","Type":"ContainerDied","Data":"d850fe2c311f1f361d33b997795c74fa5d0773520e4c2dc6c1fd0f1b18d0e9fa"} Nov 21 12:06:58 crc kubenswrapper[4769]: I1121 12:06:58.642851 4769 generic.go:334] "Generic (PLEG): container finished" podID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerID="eb14ad2835742688f894fb0a17e31ae5f38570c0b37d544867c47e03a0f2e5fa" exitCode=0 Nov 21 12:06:58 crc kubenswrapper[4769]: I1121 12:06:58.642888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" event={"ID":"966766ef-ada6-45ba-b284-0b92bf3ee41a","Type":"ContainerDied","Data":"eb14ad2835742688f894fb0a17e31ae5f38570c0b37d544867c47e03a0f2e5fa"} Nov 21 12:06:59 crc kubenswrapper[4769]: I1121 12:06:59.910637 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.023329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fg94\" (UniqueName: \"kubernetes.io/projected/966766ef-ada6-45ba-b284-0b92bf3ee41a-kube-api-access-6fg94\") pod \"966766ef-ada6-45ba-b284-0b92bf3ee41a\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.023425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-util\") pod \"966766ef-ada6-45ba-b284-0b92bf3ee41a\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.023625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-bundle\") pod \"966766ef-ada6-45ba-b284-0b92bf3ee41a\" (UID: \"966766ef-ada6-45ba-b284-0b92bf3ee41a\") " Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.024775 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-bundle" (OuterVolumeSpecName: "bundle") pod "966766ef-ada6-45ba-b284-0b92bf3ee41a" (UID: "966766ef-ada6-45ba-b284-0b92bf3ee41a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.031049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966766ef-ada6-45ba-b284-0b92bf3ee41a-kube-api-access-6fg94" (OuterVolumeSpecName: "kube-api-access-6fg94") pod "966766ef-ada6-45ba-b284-0b92bf3ee41a" (UID: "966766ef-ada6-45ba-b284-0b92bf3ee41a"). InnerVolumeSpecName "kube-api-access-6fg94". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.039410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-util" (OuterVolumeSpecName: "util") pod "966766ef-ada6-45ba-b284-0b92bf3ee41a" (UID: "966766ef-ada6-45ba-b284-0b92bf3ee41a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.126206 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6fg94\" (UniqueName: \"kubernetes.io/projected/966766ef-ada6-45ba-b284-0b92bf3ee41a-kube-api-access-6fg94\") on node \"crc\" DevicePath \"\"" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.126248 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-util\") on node \"crc\" DevicePath \"\"" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.126258 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/966766ef-ada6-45ba-b284-0b92bf3ee41a-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.656966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" event={"ID":"966766ef-ada6-45ba-b284-0b92bf3ee41a","Type":"ContainerDied","Data":"5f56ab4a5bdf498622362be4840329b210e94fc64963df55b7e7e2d3a5fd74a5"} Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.657010 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f56ab4a5bdf498622362be4840329b210e94fc64963df55b7e7e2d3a5fd74a5" Nov 21 12:07:00 crc kubenswrapper[4769]: I1121 12:07:00.657023 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.081123 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb"] Nov 21 12:07:08 crc kubenswrapper[4769]: E1121 12:07:08.082349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="pull" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.082366 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="pull" Nov 21 12:07:08 crc kubenswrapper[4769]: E1121 12:07:08.082384 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="util" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.082389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="util" Nov 21 12:07:08 crc kubenswrapper[4769]: E1121 12:07:08.082400 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="extract" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.082407 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="extract" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.082528 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" containerName="extract" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.083292 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.091163 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-operator-controller-operator-dockercfg-qrwxp" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.106793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb"] Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.247305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8t79\" (UniqueName: \"kubernetes.io/projected/cad6c628-2097-4624-838e-1ebc9683235e-kube-api-access-n8t79\") pod \"openstack-operator-controller-operator-77c7f689f5-xczwb\" (UID: \"cad6c628-2097-4624-838e-1ebc9683235e\") " pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.348710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n8t79\" (UniqueName: \"kubernetes.io/projected/cad6c628-2097-4624-838e-1ebc9683235e-kube-api-access-n8t79\") pod \"openstack-operator-controller-operator-77c7f689f5-xczwb\" (UID: \"cad6c628-2097-4624-838e-1ebc9683235e\") " pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.371924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8t79\" (UniqueName: \"kubernetes.io/projected/cad6c628-2097-4624-838e-1ebc9683235e-kube-api-access-n8t79\") pod \"openstack-operator-controller-operator-77c7f689f5-xczwb\" (UID: \"cad6c628-2097-4624-838e-1ebc9683235e\") " pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.411801 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:08 crc kubenswrapper[4769]: I1121 12:07:08.816550 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb"] Nov 21 12:07:09 crc kubenswrapper[4769]: I1121 12:07:09.717497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" event={"ID":"cad6c628-2097-4624-838e-1ebc9683235e","Type":"ContainerStarted","Data":"82182d682aab90b0ba2e2f7d55caa591186dbae57beb8ea88f6fa2ad0882686d"} Nov 21 12:07:11 crc kubenswrapper[4769]: I1121 12:07:11.326024 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:07:11 crc kubenswrapper[4769]: I1121 12:07:11.326625 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:07:14 crc kubenswrapper[4769]: I1121 12:07:14.755996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" event={"ID":"cad6c628-2097-4624-838e-1ebc9683235e","Type":"ContainerStarted","Data":"d9fd678815071ac1384473e06fe9926758e3f035627a5575e93a09b4890a131e"} Nov 21 12:07:19 crc kubenswrapper[4769]: I1121 12:07:19.794489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" event={"ID":"cad6c628-2097-4624-838e-1ebc9683235e","Type":"ContainerStarted","Data":"e0e9cea61b7b998373f3b4bb0e0d47e3eb867d8e2daeca55ef6edf1eeff4a124"} Nov 21 12:07:19 crc kubenswrapper[4769]: I1121 12:07:19.799860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:19 crc kubenswrapper[4769]: I1121 12:07:19.817553 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 12:07:19 crc kubenswrapper[4769]: I1121 12:07:19.859956 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" podStartSLOduration=1.484954388 podStartE2EDuration="11.859937403s" podCreationTimestamp="2025-11-21 12:07:08 +0000 UTC" firstStartedPulling="2025-11-21 12:07:08.836157082 +0000 UTC m=+987.536818900" lastFinishedPulling="2025-11-21 12:07:19.211140097 +0000 UTC m=+997.911801915" observedRunningTime="2025-11-21 12:07:19.859584674 +0000 UTC m=+998.560246492" watchObservedRunningTime="2025-11-21 12:07:19.859937403 +0000 UTC m=+998.560599221" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.217999 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.219904 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.222259 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"barbican-operator-controller-manager-dockercfg-v25h9" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.231495 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.232763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.235096 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"cinder-operator-controller-manager-dockercfg-9qdgf" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.240646 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.255714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.274310 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.275482 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.278546 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.290927 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"designate-operator-controller-manager-dockercfg-bpxzx" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.293660 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.296778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"glance-operator-controller-manager-dockercfg-jcxxz" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.303066 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.315567 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.336930 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.359847 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.366122 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"heat-operator-controller-manager-dockercfg-hh5c2" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.379867 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.382389 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.395662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"horizon-operator-controller-manager-dockercfg-twmk6" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.425002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mqm4\" (UniqueName: \"kubernetes.io/projected/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58-kube-api-access-7mqm4\") pod \"barbican-operator-controller-manager-7768f8c84f-mmfz8\" (UID: \"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58\") " pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.425067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9lm\" (UniqueName: \"kubernetes.io/projected/c947192b-fa60-475c-8485-d5b89b68db04-kube-api-access-cx9lm\") pod \"glance-operator-controller-manager-8667fbf6f6-hrl62\" (UID: \"c947192b-fa60-475c-8485-d5b89b68db04\") " pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.425133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xknhk\" (UniqueName: \"kubernetes.io/projected/f769fe9e-e5a5-4954-9d27-6786c130674d-kube-api-access-xknhk\") pod \"heat-operator-controller-manager-bf4c6585d-2j628\" (UID: \"f769fe9e-e5a5-4954-9d27-6786c130674d\") " pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.425248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh7hz\" (UniqueName: \"kubernetes.io/projected/bcf991ab-cf17-4dfe-89ca-364c2361278d-kube-api-access-mh7hz\") pod \"cinder-operator-controller-manager-6d8fd67bf7-8zh6g\" (UID: \"bcf991ab-cf17-4dfe-89ca-364c2361278d\") " pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.425275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvlmj\" (UniqueName: \"kubernetes.io/projected/e4ba6f52-4d8e-4337-bff6-83de22056bf2-kube-api-access-xvlmj\") pod \"designate-operator-controller-manager-56dfb6b67f-6628r\" (UID: \"e4ba6f52-4d8e-4337-bff6-83de22056bf2\") " pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.478408 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.498937 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.518953 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.520463 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.524174 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-webhook-server-cert" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.524512 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-dockercfg-dzfr8" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.527074 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mh7hz\" (UniqueName: \"kubernetes.io/projected/bcf991ab-cf17-4dfe-89ca-364c2361278d-kube-api-access-mh7hz\") pod \"cinder-operator-controller-manager-6d8fd67bf7-8zh6g\" (UID: \"bcf991ab-cf17-4dfe-89ca-364c2361278d\") " pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.527116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvlmj\" (UniqueName: \"kubernetes.io/projected/e4ba6f52-4d8e-4337-bff6-83de22056bf2-kube-api-access-xvlmj\") pod \"designate-operator-controller-manager-56dfb6b67f-6628r\" (UID: \"e4ba6f52-4d8e-4337-bff6-83de22056bf2\") " pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.527178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mqm4\" (UniqueName: \"kubernetes.io/projected/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58-kube-api-access-7mqm4\") pod \"barbican-operator-controller-manager-7768f8c84f-mmfz8\" (UID: \"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58\") " pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.527250 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9lm\" (UniqueName: \"kubernetes.io/projected/c947192b-fa60-475c-8485-d5b89b68db04-kube-api-access-cx9lm\") pod \"glance-operator-controller-manager-8667fbf6f6-hrl62\" (UID: \"c947192b-fa60-475c-8485-d5b89b68db04\") " pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.527342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xknhk\" (UniqueName: \"kubernetes.io/projected/f769fe9e-e5a5-4954-9d27-6786c130674d-kube-api-access-xknhk\") pod \"heat-operator-controller-manager-bf4c6585d-2j628\" (UID: \"f769fe9e-e5a5-4954-9d27-6786c130674d\") " pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.531176 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64zxg\" (UniqueName: \"kubernetes.io/projected/300d1793-527a-4e93-8753-460f9390a9f0-kube-api-access-64zxg\") pod \"horizon-operator-controller-manager-5d86b44686-v4gqp\" (UID: \"300d1793-527a-4e93-8753-460f9390a9f0\") " pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.552642 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.562238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvlmj\" (UniqueName: \"kubernetes.io/projected/e4ba6f52-4d8e-4337-bff6-83de22056bf2-kube-api-access-xvlmj\") pod \"designate-operator-controller-manager-56dfb6b67f-6628r\" (UID: \"e4ba6f52-4d8e-4337-bff6-83de22056bf2\") " pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.568422 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.569642 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.576172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh7hz\" (UniqueName: \"kubernetes.io/projected/bcf991ab-cf17-4dfe-89ca-364c2361278d-kube-api-access-mh7hz\") pod \"cinder-operator-controller-manager-6d8fd67bf7-8zh6g\" (UID: \"bcf991ab-cf17-4dfe-89ca-364c2361278d\") " pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.576760 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"ironic-operator-controller-manager-dockercfg-8tc6r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.595973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xknhk\" (UniqueName: \"kubernetes.io/projected/f769fe9e-e5a5-4954-9d27-6786c130674d-kube-api-access-xknhk\") pod \"heat-operator-controller-manager-bf4c6585d-2j628\" (UID: \"f769fe9e-e5a5-4954-9d27-6786c130674d\") " pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.601363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9lm\" (UniqueName: \"kubernetes.io/projected/c947192b-fa60-475c-8485-d5b89b68db04-kube-api-access-cx9lm\") pod \"glance-operator-controller-manager-8667fbf6f6-hrl62\" (UID: \"c947192b-fa60-475c-8485-d5b89b68db04\") " pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.609435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.611107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mqm4\" (UniqueName: \"kubernetes.io/projected/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58-kube-api-access-7mqm4\") pod \"barbican-operator-controller-manager-7768f8c84f-mmfz8\" (UID: \"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58\") " pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.620775 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.633788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.634052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv48n\" (UniqueName: \"kubernetes.io/projected/3c4f2848-d13a-4646-bd9c-cf691f1c1099-kube-api-access-wv48n\") pod \"ironic-operator-controller-manager-5c75d7c94b-qkslz\" (UID: \"3c4f2848-d13a-4646-bd9c-cf691f1c1099\") " pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.634146 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-64zxg\" (UniqueName: \"kubernetes.io/projected/300d1793-527a-4e93-8753-460f9390a9f0-kube-api-access-64zxg\") pod \"horizon-operator-controller-manager-5d86b44686-v4gqp\" (UID: \"300d1793-527a-4e93-8753-460f9390a9f0\") " pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.634316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdmhr\" (UniqueName: \"kubernetes.io/projected/ca12a419-f80c-4f1c-8f23-1f72e4e07121-kube-api-access-xdmhr\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.638102 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.639795 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.644588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-dockercfg-xc2lx" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.651352 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.659060 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.660528 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.665006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"manila-operator-controller-manager-dockercfg-fw4vr" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.691004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-64zxg\" (UniqueName: \"kubernetes.io/projected/300d1793-527a-4e93-8753-460f9390a9f0-kube-api-access-64zxg\") pod \"horizon-operator-controller-manager-5d86b44686-v4gqp\" (UID: \"300d1793-527a-4e93-8753-460f9390a9f0\") " pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.718136 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.731762 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.733126 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.734697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbpjr\" (UniqueName: \"kubernetes.io/projected/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3-kube-api-access-tbpjr\") pod \"keystone-operator-controller-manager-7879fb76fd-2lpxb\" (UID: \"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3\") " pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.734781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.734803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnk85\" (UniqueName: \"kubernetes.io/projected/73a1d48f-8d98-4b78-bac7-00e1ffa04b82-kube-api-access-qnk85\") pod \"manila-operator-controller-manager-7bb88cb858-nf9vh\" (UID: \"73a1d48f-8d98-4b78-bac7-00e1ffa04b82\") " pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.734830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhlrk\" (UniqueName: \"kubernetes.io/projected/7da40971-cf3f-40a1-b8ca-cccc0b21c801-kube-api-access-xhlrk\") pod \"mariadb-operator-controller-manager-6f8c5b86cb-29xtg\" (UID: \"7da40971-cf3f-40a1-b8ca-cccc0b21c801\") " pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.734866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wv48n\" (UniqueName: \"kubernetes.io/projected/3c4f2848-d13a-4646-bd9c-cf691f1c1099-kube-api-access-wv48n\") pod \"ironic-operator-controller-manager-5c75d7c94b-qkslz\" (UID: \"3c4f2848-d13a-4646-bd9c-cf691f1c1099\") " pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.734906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xdmhr\" (UniqueName: \"kubernetes.io/projected/ca12a419-f80c-4f1c-8f23-1f72e4e07121-kube-api-access-xdmhr\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:34 crc kubenswrapper[4769]: E1121 12:07:34.734932 4769 secret.go:188] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Nov 21 12:07:34 crc kubenswrapper[4769]: E1121 12:07:34.734983 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert podName:ca12a419-f80c-4f1c-8f23-1f72e4e07121 nodeName:}" failed. No retries permitted until 2025-11-21 12:07:35.234965335 +0000 UTC m=+1013.935627153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert") pod "infra-operator-controller-manager-769d9c7585-q5j8k" (UID: "ca12a419-f80c-4f1c-8f23-1f72e4e07121") : secret "infra-operator-webhook-server-cert" not found Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.738372 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-dockercfg-q55pn" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.752430 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.768454 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.771184 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv48n\" (UniqueName: \"kubernetes.io/projected/3c4f2848-d13a-4646-bd9c-cf691f1c1099-kube-api-access-wv48n\") pod \"ironic-operator-controller-manager-5c75d7c94b-qkslz\" (UID: \"3c4f2848-d13a-4646-bd9c-cf691f1c1099\") " pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.774530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdmhr\" (UniqueName: \"kubernetes.io/projected/ca12a419-f80c-4f1c-8f23-1f72e4e07121-kube-api-access-xdmhr\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.775108 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.789056 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.804700 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.806242 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.817923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.818997 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"nova-operator-controller-manager-dockercfg-9lx9r" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.830553 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.832336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.836210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nv49\" (UniqueName: \"kubernetes.io/projected/884af2cd-b59a-4583-818e-f6ff7b8b4fc7-kube-api-access-7nv49\") pod \"nova-operator-controller-manager-86d796d84d-chvl5\" (UID: \"884af2cd-b59a-4583-818e-f6ff7b8b4fc7\") " pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.836264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xhlrk\" (UniqueName: \"kubernetes.io/projected/7da40971-cf3f-40a1-b8ca-cccc0b21c801-kube-api-access-xhlrk\") pod \"mariadb-operator-controller-manager-6f8c5b86cb-29xtg\" (UID: \"7da40971-cf3f-40a1-b8ca-cccc0b21c801\") " pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.836299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hk4\" (UniqueName: \"kubernetes.io/projected/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd-kube-api-access-49hk4\") pod \"neutron-operator-controller-manager-66b7d6f598-b2ggh\" (UID: \"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd\") " pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.836367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tbpjr\" (UniqueName: \"kubernetes.io/projected/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3-kube-api-access-tbpjr\") pod \"keystone-operator-controller-manager-7879fb76fd-2lpxb\" (UID: \"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3\") " pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.836437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qnk85\" (UniqueName: \"kubernetes.io/projected/73a1d48f-8d98-4b78-bac7-00e1ffa04b82-kube-api-access-qnk85\") pod \"manila-operator-controller-manager-7bb88cb858-nf9vh\" (UID: \"73a1d48f-8d98-4b78-bac7-00e1ffa04b82\") " pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.837250 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.838555 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.839318 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"neutron-operator-controller-manager-dockercfg-wks5x" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.852314 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.860000 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"octavia-operator-controller-manager-dockercfg-8r6q9" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.864304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.867213 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.881862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbpjr\" (UniqueName: \"kubernetes.io/projected/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3-kube-api-access-tbpjr\") pod \"keystone-operator-controller-manager-7879fb76fd-2lpxb\" (UID: \"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3\") " pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.890880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhlrk\" (UniqueName: \"kubernetes.io/projected/7da40971-cf3f-40a1-b8ca-cccc0b21c801-kube-api-access-xhlrk\") pod \"mariadb-operator-controller-manager-6f8c5b86cb-29xtg\" (UID: \"7da40971-cf3f-40a1-b8ca-cccc0b21c801\") " pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.906450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.941150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7nv49\" (UniqueName: \"kubernetes.io/projected/884af2cd-b59a-4583-818e-f6ff7b8b4fc7-kube-api-access-7nv49\") pod \"nova-operator-controller-manager-86d796d84d-chvl5\" (UID: \"884af2cd-b59a-4583-818e-f6ff7b8b4fc7\") " pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.941269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-49hk4\" (UniqueName: \"kubernetes.io/projected/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd-kube-api-access-49hk4\") pod \"neutron-operator-controller-manager-66b7d6f598-b2ggh\" (UID: \"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd\") " pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.945394 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnk85\" (UniqueName: \"kubernetes.io/projected/73a1d48f-8d98-4b78-bac7-00e1ffa04b82-kube-api-access-qnk85\") pod \"manila-operator-controller-manager-7bb88cb858-nf9vh\" (UID: \"73a1d48f-8d98-4b78-bac7-00e1ffa04b82\") " pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.946951 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.956024 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.991145 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk"] Nov 21 12:07:34 crc kubenswrapper[4769]: I1121 12:07:34.996227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:34.999835 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.001672 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-baremetal-operator-controller-manager-dockercfg-4tfv6" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.002116 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-baremetal-operator-webhook-server-cert" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.011753 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.037795 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"ovn-operator-controller-manager-dockercfg-m9hvk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.049760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.049823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xf6k\" (UniqueName: \"kubernetes.io/projected/5244ed83-c201-493d-9c35-20102cd07696-kube-api-access-7xf6k\") pod \"octavia-operator-controller-manager-6fdc856c5d-rp8zk\" (UID: \"5244ed83-c201-493d-9c35-20102cd07696\") " pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.049870 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzvkl\" (UniqueName: \"kubernetes.io/projected/6bbca42b-c781-4106-851f-ab9bb4fac793-kube-api-access-qzvkl\") pod \"ovn-operator-controller-manager-5bdf4f7f7f-frhh2\" (UID: \"6bbca42b-c781-4106-851f-ab9bb4fac793\") " pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.049893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf7sj\" (UniqueName: \"kubernetes.io/projected/3d74755b-a923-42e2-b1cb-f68b956325f8-kube-api-access-mf7sj\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.057004 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.067422 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.083893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hk4\" (UniqueName: \"kubernetes.io/projected/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd-kube-api-access-49hk4\") pod \"neutron-operator-controller-manager-66b7d6f598-b2ggh\" (UID: \"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd\") " pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.086250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nv49\" (UniqueName: \"kubernetes.io/projected/884af2cd-b59a-4583-818e-f6ff7b8b4fc7-kube-api-access-7nv49\") pod \"nova-operator-controller-manager-86d796d84d-chvl5\" (UID: \"884af2cd-b59a-4583-818e-f6ff7b8b4fc7\") " pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.101274 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.103274 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.114961 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"placement-operator-controller-manager-dockercfg-kwzzh" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.115138 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.149967 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.157735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7xf6k\" (UniqueName: \"kubernetes.io/projected/5244ed83-c201-493d-9c35-20102cd07696-kube-api-access-7xf6k\") pod \"octavia-operator-controller-manager-6fdc856c5d-rp8zk\" (UID: \"5244ed83-c201-493d-9c35-20102cd07696\") " pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.167685 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.168951 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.169541 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.157930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qzvkl\" (UniqueName: \"kubernetes.io/projected/6bbca42b-c781-4106-851f-ab9bb4fac793-kube-api-access-qzvkl\") pod \"ovn-operator-controller-manager-5bdf4f7f7f-frhh2\" (UID: \"6bbca42b-c781-4106-851f-ab9bb4fac793\") " pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.171116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mf7sj\" (UniqueName: \"kubernetes.io/projected/3d74755b-a923-42e2-b1cb-f68b956325f8-kube-api-access-mf7sj\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.171519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: E1121 12:07:35.172150 4769 secret.go:188] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Nov 21 12:07:35 crc kubenswrapper[4769]: E1121 12:07:35.173386 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert podName:3d74755b-a923-42e2-b1cb-f68b956325f8 nodeName:}" failed. No retries permitted until 2025-11-21 12:07:35.673363529 +0000 UTC m=+1014.374025347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert") pod "openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" (UID: "3d74755b-a923-42e2-b1cb-f68b956325f8") : secret "openstack-baremetal-operator-webhook-server-cert" not found Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.185244 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"swift-operator-controller-manager-dockercfg-vhtp7" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.210456 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.213518 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.215718 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.218241 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"telemetry-operator-controller-manager-dockercfg-7wbh6" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.229997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf7sj\" (UniqueName: \"kubernetes.io/projected/3d74755b-a923-42e2-b1cb-f68b956325f8-kube-api-access-mf7sj\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.250707 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/test-operator-controller-manager-8464cf66df-rlz94"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.252414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.257146 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"test-operator-controller-manager-dockercfg-qzdmv" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.260559 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.263368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzvkl\" (UniqueName: \"kubernetes.io/projected/6bbca42b-c781-4106-851f-ab9bb4fac793-kube-api-access-qzvkl\") pod \"ovn-operator-controller-manager-5bdf4f7f7f-frhh2\" (UID: \"6bbca42b-c781-4106-851f-ab9bb4fac793\") " pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.263432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xf6k\" (UniqueName: \"kubernetes.io/projected/5244ed83-c201-493d-9c35-20102cd07696-kube-api-access-7xf6k\") pod \"octavia-operator-controller-manager-6fdc856c5d-rp8zk\" (UID: \"5244ed83-c201-493d-9c35-20102cd07696\") " pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.273397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf8x8\" (UniqueName: \"kubernetes.io/projected/ebaca59c-611f-4c55-85df-3a788dab93d2-kube-api-access-lf8x8\") pod \"swift-operator-controller-manager-799cb6ffd6-kshc8\" (UID: \"ebaca59c-611f-4c55-85df-3a788dab93d2\") " pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.273458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.273674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk8dt\" (UniqueName: \"kubernetes.io/projected/48bcc67d-6c8c-49c5-8b60-1ed8a583c885-kube-api-access-gk8dt\") pod \"placement-operator-controller-manager-6dc664666c-2cmz5\" (UID: \"48bcc67d-6c8c-49c5-8b60-1ed8a583c885\") " pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.277983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert\") pod \"infra-operator-controller-manager-769d9c7585-q5j8k\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.319676 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.322450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.333686 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-8464cf66df-rlz94"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.333729 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.334802 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.334896 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.337683 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"watcher-operator-controller-manager-dockercfg-vml28" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.343264 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.366595 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.376220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lf8x8\" (UniqueName: \"kubernetes.io/projected/ebaca59c-611f-4c55-85df-3a788dab93d2-kube-api-access-lf8x8\") pod \"swift-operator-controller-manager-799cb6ffd6-kshc8\" (UID: \"ebaca59c-611f-4c55-85df-3a788dab93d2\") " pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.376287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fk8m\" (UniqueName: \"kubernetes.io/projected/0bc3144e-ffee-4056-960b-c0144d0f0a14-kube-api-access-9fk8m\") pod \"telemetry-operator-controller-manager-7798859c74-c99pr\" (UID: \"0bc3144e-ffee-4056-960b-c0144d0f0a14\") " pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.376362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gk8dt\" (UniqueName: \"kubernetes.io/projected/48bcc67d-6c8c-49c5-8b60-1ed8a583c885-kube-api-access-gk8dt\") pod \"placement-operator-controller-manager-6dc664666c-2cmz5\" (UID: \"48bcc67d-6c8c-49c5-8b60-1ed8a583c885\") " pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.376443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwtz\" (UniqueName: \"kubernetes.io/projected/b1424001-64e8-4892-b403-4284096261ba-kube-api-access-2rwtz\") pod \"test-operator-controller-manager-8464cf66df-rlz94\" (UID: \"b1424001-64e8-4892-b403-4284096261ba\") " pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.381673 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.383262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.387687 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"openstack-operator-controller-manager-dockercfg-5mb6b" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.387870 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"webhook-server-cert" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.405677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk8dt\" (UniqueName: \"kubernetes.io/projected/48bcc67d-6c8c-49c5-8b60-1ed8a583c885-kube-api-access-gk8dt\") pod \"placement-operator-controller-manager-6dc664666c-2cmz5\" (UID: \"48bcc67d-6c8c-49c5-8b60-1ed8a583c885\") " pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.418487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf8x8\" (UniqueName: \"kubernetes.io/projected/ebaca59c-611f-4c55-85df-3a788dab93d2-kube-api-access-lf8x8\") pod \"swift-operator-controller-manager-799cb6ffd6-kshc8\" (UID: \"ebaca59c-611f-4c55-85df-3a788dab93d2\") " pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.439935 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.445992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.446471 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.452642 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.498837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwtz\" (UniqueName: \"kubernetes.io/projected/b1424001-64e8-4892-b403-4284096261ba-kube-api-access-2rwtz\") pod \"test-operator-controller-manager-8464cf66df-rlz94\" (UID: \"b1424001-64e8-4892-b403-4284096261ba\") " pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.499940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.500010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9fk8m\" (UniqueName: \"kubernetes.io/projected/0bc3144e-ffee-4056-960b-c0144d0f0a14-kube-api-access-9fk8m\") pod \"telemetry-operator-controller-manager-7798859c74-c99pr\" (UID: \"0bc3144e-ffee-4056-960b-c0144d0f0a14\") " pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.500069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gw42\" (UniqueName: \"kubernetes.io/projected/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f-kube-api-access-5gw42\") pod \"watcher-operator-controller-manager-7cd4fb6f79-9j2qz\" (UID: \"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f\") " pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.500171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-247bs\" (UniqueName: \"kubernetes.io/projected/5c4b5619-0a5f-4363-985d-99182730024d-kube-api-access-247bs\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.527513 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.540976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.545781 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-controller-manager-dockercfg-9dpxj" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.546602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fk8m\" (UniqueName: \"kubernetes.io/projected/0bc3144e-ffee-4056-960b-c0144d0f0a14-kube-api-access-9fk8m\") pod \"telemetry-operator-controller-manager-7798859c74-c99pr\" (UID: \"0bc3144e-ffee-4056-960b-c0144d0f0a14\") " pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.561597 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw"] Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.562876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwtz\" (UniqueName: \"kubernetes.io/projected/b1424001-64e8-4892-b403-4284096261ba-kube-api-access-2rwtz\") pod \"test-operator-controller-manager-8464cf66df-rlz94\" (UID: \"b1424001-64e8-4892-b403-4284096261ba\") " pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.603778 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-247bs\" (UniqueName: \"kubernetes.io/projected/5c4b5619-0a5f-4363-985d-99182730024d-kube-api-access-247bs\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.603872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.603953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5gw42\" (UniqueName: \"kubernetes.io/projected/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f-kube-api-access-5gw42\") pod \"watcher-operator-controller-manager-7cd4fb6f79-9j2qz\" (UID: \"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f\") " pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:07:35 crc kubenswrapper[4769]: E1121 12:07:35.604947 4769 secret.go:188] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Nov 21 12:07:35 crc kubenswrapper[4769]: E1121 12:07:35.605014 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert podName:5c4b5619-0a5f-4363-985d-99182730024d nodeName:}" failed. No retries permitted until 2025-11-21 12:07:36.104992987 +0000 UTC m=+1014.805654795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert") pod "openstack-operator-controller-manager-7755d5f8cc-sk7hz" (UID: "5c4b5619-0a5f-4363-985d-99182730024d") : secret "webhook-server-cert" not found Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.656928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-247bs\" (UniqueName: \"kubernetes.io/projected/5c4b5619-0a5f-4363-985d-99182730024d-kube-api-access-247bs\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.663410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gw42\" (UniqueName: \"kubernetes.io/projected/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f-kube-api-access-5gw42\") pod \"watcher-operator-controller-manager-7cd4fb6f79-9j2qz\" (UID: \"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f\") " pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.705139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qf69\" (UniqueName: \"kubernetes.io/projected/5f0da7e0-0d50-4ec6-8320-a1994e79e38c-kube-api-access-6qf69\") pod \"rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw\" (UID: \"5f0da7e0-0d50-4ec6-8320-a1994e79e38c\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.705219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.714302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert\") pod \"openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.788933 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.796840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.806149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6qf69\" (UniqueName: \"kubernetes.io/projected/5f0da7e0-0d50-4ec6-8320-a1994e79e38c-kube-api-access-6qf69\") pod \"rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw\" (UID: \"5f0da7e0-0d50-4ec6-8320-a1994e79e38c\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.826603 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:07:35 crc kubenswrapper[4769]: I1121 12:07:35.834492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qf69\" (UniqueName: \"kubernetes.io/projected/5f0da7e0-0d50-4ec6-8320-a1994e79e38c-kube-api-access-6qf69\") pod \"rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw\" (UID: \"5f0da7e0-0d50-4ec6-8320-a1994e79e38c\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.000763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.071972 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.103744 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.111300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.111497 4769 secret.go:188] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.111575 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert podName:5c4b5619-0a5f-4363-985d-99182730024d nodeName:}" failed. No retries permitted until 2025-11-21 12:07:37.1115501 +0000 UTC m=+1015.812211908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert") pod "openstack-operator-controller-manager-7755d5f8cc-sk7hz" (UID: "5c4b5619-0a5f-4363-985d-99182730024d") : secret "webhook-server-cert" not found Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.117880 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.120540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628"] Nov 21 12:07:36 crc kubenswrapper[4769]: W1121 12:07:36.204300 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf769fe9e_e5a5_4954_9d27_6786c130674d.slice/crio-e9552a0e4ef5e64a69da57cd6a769a7f675326c29224ac57f4db6e49fe21e94d WatchSource:0}: Error finding container e9552a0e4ef5e64a69da57cd6a769a7f675326c29224ac57f4db6e49fe21e94d: Status 404 returned error can't find the container with id e9552a0e4ef5e64a69da57cd6a769a7f675326c29224ac57f4db6e49fe21e94d Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.345202 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp"] Nov 21 12:07:36 crc kubenswrapper[4769]: W1121 12:07:36.351703 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300d1793_527a_4e93_8753_460f9390a9f0.slice/crio-96113baa6e8ad68cf8b367c4088feff397d9e446eeb936a3f882360ca35dddc9 WatchSource:0}: Error finding container 96113baa6e8ad68cf8b367c4088feff397d9e446eeb936a3f882360ca35dddc9: Status 404 returned error can't find the container with id 96113baa6e8ad68cf8b367c4088feff397d9e446eeb936a3f882360ca35dddc9 Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.366598 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.584541 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.591953 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.596902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.617414 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.651292 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.789138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.800407 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.829014 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.878720 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.886169 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5"] Nov 21 12:07:36 crc kubenswrapper[4769]: W1121 12:07:36.888431 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc3144e_ffee_4056_960b_c0144d0f0a14.slice/crio-6e339a2d762f69a8bb4d30a69615431904f2f9f51e1cfa61ba848ab732e2feba WatchSource:0}: Error finding container 6e339a2d762f69a8bb4d30a69615431904f2f9f51e1cfa61ba848ab732e2feba: Status 404 returned error can't find the container with id 6e339a2d762f69a8bb4d30a69615431904f2f9f51e1cfa61ba848ab732e2feba Nov 21 12:07:36 crc kubenswrapper[4769]: W1121 12:07:36.889661 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b794f9_ecfe_4fa8_b810_d2d17c9e039f.slice/crio-e2402847b0ca8adcd2fb7b7e5cda0034428c562b0bc967f89e086a96607d0d8a WatchSource:0}: Error finding container e2402847b0ca8adcd2fb7b7e5cda0034428c562b0bc967f89e086a96607d0d8a: Status 404 returned error can't find the container with id e2402847b0ca8adcd2fb7b7e5cda0034428c562b0bc967f89e086a96607d0d8a Nov 21 12:07:36 crc kubenswrapper[4769]: W1121 12:07:36.890856 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaca59c_611f_4c55_85df_3a788dab93d2.slice/crio-2add25ed4529f10f701e44cf5aaa5312870718e052f75bfb159a46f81f38d743 WatchSource:0}: Error finding container 2add25ed4529f10f701e44cf5aaa5312870718e052f75bfb159a46f81f38d743: Status 404 returned error can't find the container with id 2add25ed4529f10f701e44cf5aaa5312870718e052f75bfb159a46f81f38d743 Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.896621 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/watcher-operator@sha256:4838402d41d42c56613d43dc5041aae475a2b18e6172491d6c4d4a78a580697f,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-5gw42,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-7cd4fb6f79-9j2qz_openstack-operators(d4b794f9-ecfe-4fa8-b810-d2d17c9e039f): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.896731 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/telemetry-operator@sha256:5324a6d2f76fc3041023b0cbd09a733ef2b59f310d390e4d6483d219eb96494f,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-9fk8m,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod telemetry-operator-controller-manager-7798859c74-c99pr_openstack-operators(0bc3144e-ffee-4056-960b-c0144d0f0a14): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.896819 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/placement-operator@sha256:4094e7fc11a33e8e2b6768a053cafaf5b122446d23f9113d43d520cb64e9776c,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-gk8dt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-operator-controller-manager-6dc664666c-2cmz5_openstack-operators(48bcc67d-6c8c-49c5-8b60-1ed8a583c885): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.896928 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/infra-operator@sha256:86df58f744c1d23233cc98f6ea17c8d6da637c50003d0fc8c100045594aa9894,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{600 -3} {} 600m DecimalSI},memory: {{2147483648 0} {} 2Gi BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{536870912 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cert,ReadOnly:true,MountPath:/tmp/k8s-webhook-server/serving-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-xdmhr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod infra-operator-controller-manager-769d9c7585-q5j8k_openstack-operators(ca12a419-f80c-4f1c-8f23-1f72e4e07121): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.897912 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/swift-operator@sha256:c0b5f124a37c1538042c0e63f0978429572e2a851d7f3a6eb80de09b86d755a0,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-lf8x8,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod swift-operator-controller-manager-799cb6ffd6-kshc8_openstack-operators(ebaca59c-611f-4c55-85df-3a788dab93d2): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.898550 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8"] Nov 21 12:07:36 crc kubenswrapper[4769]: E1121 12:07:36.908735 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/ovn-operator@sha256:5d49d4594c66eda7b151746cc6e1d3c67c0129b4503eeb043a64ae8ec2da6a1b,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-qzvkl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovn-operator-controller-manager-5bdf4f7f7f-frhh2_openstack-operators(6bbca42b-c781-4106-851f-ab9bb4fac793): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.916371 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.923588 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.938590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2"] Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.942014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" event={"ID":"f769fe9e-e5a5-4954-9d27-6786c130674d","Type":"ContainerStarted","Data":"e9552a0e4ef5e64a69da57cd6a769a7f675326c29224ac57f4db6e49fe21e94d"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.943736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" event={"ID":"e4ba6f52-4d8e-4337-bff6-83de22056bf2","Type":"ContainerStarted","Data":"b13e0736069bb766813154f7ce8d8d6bf051feb7bc8e2206b6e2a99e9f20c771"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.945924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" event={"ID":"5244ed83-c201-493d-9c35-20102cd07696","Type":"ContainerStarted","Data":"791e51714a4f4d6368d7fe980e51607dbbc94a40076fd9802b5d8f2279df384d"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.947126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" event={"ID":"300d1793-527a-4e93-8753-460f9390a9f0","Type":"ContainerStarted","Data":"96113baa6e8ad68cf8b367c4088feff397d9e446eeb936a3f882360ca35dddc9"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.949668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" event={"ID":"bcf991ab-cf17-4dfe-89ca-364c2361278d","Type":"ContainerStarted","Data":"e74014ea487ee86673e8b5135ad0babe1807becd0239b14258d9d33678b51ea4"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.951777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" event={"ID":"3c4f2848-d13a-4646-bd9c-cf691f1c1099","Type":"ContainerStarted","Data":"81e7e0a297656e5647f40a075d937c40fb15aa2e18ea7c6247252d858ae9fe55"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.954430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" event={"ID":"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58","Type":"ContainerStarted","Data":"3b888839a1462b890fc784ec6fa2770736b6c3e735792b61a1c4d41aed83ba47"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.971860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" event={"ID":"884af2cd-b59a-4583-818e-f6ff7b8b4fc7","Type":"ContainerStarted","Data":"5f8c3ca69948491aab4e8941188a80eef0c469e9e6e13194d5982543b83c9533"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.974136 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" event={"ID":"7da40971-cf3f-40a1-b8ca-cccc0b21c801","Type":"ContainerStarted","Data":"a600a30b94a103520335d88d570978002880f655d9e55b6b06912fac217d9814"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.979010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" event={"ID":"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3","Type":"ContainerStarted","Data":"d190098b8fc7ece72c7c76c80c6fe9eafdb831110056b10a1aff49f2db198cfb"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.984225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" event={"ID":"ebaca59c-611f-4c55-85df-3a788dab93d2","Type":"ContainerStarted","Data":"2add25ed4529f10f701e44cf5aaa5312870718e052f75bfb159a46f81f38d743"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.989237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" event={"ID":"73a1d48f-8d98-4b78-bac7-00e1ffa04b82","Type":"ContainerStarted","Data":"6a96a338911c595b04b7bd6ff384471b198388bfcfd1028a05b04956e0ecc39e"} Nov 21 12:07:36 crc kubenswrapper[4769]: I1121 12:07:36.991119 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" event={"ID":"ca12a419-f80c-4f1c-8f23-1f72e4e07121","Type":"ContainerStarted","Data":"95e66c9e456247ef90f53adbb5e068b8b65670d67541c7b05f3f455587130ccc"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.000004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" event={"ID":"6bbca42b-c781-4106-851f-ab9bb4fac793","Type":"ContainerStarted","Data":"2123761f3a313d5890b2bacb33da3c7b0b0d9a5d48c9fe8e6b61c1e90b291261"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.002048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" event={"ID":"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd","Type":"ContainerStarted","Data":"b32d5986523c3c37e75df8cf80f170da6d7dbbc3d5ee70fb338680142c832500"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.009773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" event={"ID":"0bc3144e-ffee-4056-960b-c0144d0f0a14","Type":"ContainerStarted","Data":"6e339a2d762f69a8bb4d30a69615431904f2f9f51e1cfa61ba848ab732e2feba"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.020111 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" event={"ID":"c947192b-fa60-475c-8485-d5b89b68db04","Type":"ContainerStarted","Data":"b94d54ca5e6667b5c68473b24ae71d64ff2453c3976d55ad0b0e8fc8e9c99a10"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.023488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" event={"ID":"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f","Type":"ContainerStarted","Data":"e2402847b0ca8adcd2fb7b7e5cda0034428c562b0bc967f89e086a96607d0d8a"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.031148 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-8464cf66df-rlz94"] Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.038660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" event={"ID":"48bcc67d-6c8c-49c5-8b60-1ed8a583c885","Type":"ContainerStarted","Data":"156b3d183f6f293bc526a565b6d8298e57a8bbc458e9a93ec5aa2c127fdff83f"} Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.073099 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw"] Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.080138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk"] Nov 21 12:07:37 crc kubenswrapper[4769]: W1121 12:07:37.091434 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d74755b_a923_42e2_b1cb_f68b956325f8.slice/crio-6f8fc26313373b9ec84c5c9f891ae65b11b9fdea3179bff701519bbc82030b5f WatchSource:0}: Error finding container 6f8fc26313373b9ec84c5c9f891ae65b11b9fdea3179bff701519bbc82030b5f: Status 404 returned error can't find the container with id 6f8fc26313373b9ec84c5c9f891ae65b11b9fdea3179bff701519bbc82030b5f Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.104450 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/openstack-baremetal-operator@sha256:78852f8ba332a5756c1551c126157f735279101a0fc3277ba4aa4db3478789dd,Command:[/manager],Args:[--health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080 --leader-elect],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:true,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/openstack-k8s-operators/openstack-baremetal-operator-agent@sha256:7dbadf7b98f2f305f9f1382f55a084c8ca404f4263f76b28e56bd0dc437e2192,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_ANSIBLEEE_IMAGE_URL_DEFAULT,Value:quay.io/openstack-k8s-operators/openstack-ansibleee-runner@sha256:0473ff9eec0da231e2d0a10bf1abbe1dfa1a0f95b8f619e3a07605386951449a,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_AODH_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-aodh-api@sha256:0b01822660d01c348c5dfb2514e36d18ee8e62af93b3701022d7a1da1292f523,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_AODH_EVALUATOR_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-aodh-evaluator@sha256:6abb4f939a264a8d5dae90605b987d623e84aef9dfe8656534314747d4aba5bc,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_AODH_LISTENER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-aodh-listener@sha256:4af3a62ffa4399d44c9bb3e8a92df4e926b45a471afbd6603d3246ed28ae72da,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_AODH_NOTIFIER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-aodh-notifier@sha256:bd19a2bf617202a6cec41dc2ad770731503c9586b1bd80baf05a40ffbc4bc80f,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_APACHE_IMAGE_URL_DEFAULT,Value:registry.redhat.io/ubi9/httpd-24@sha256:8536169e5537fe6c330eba814248abdcf39cdd8f7e7336034d74e6fda9544050,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_BARBICAN_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:09513b0e7384092548dd654fa2356d64e243315cf59fa8857bd6c4a3ae4037c4,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_BARBICAN_KEYSTONE_LISTENER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-barbican-keystone-listener@sha256:45be724bad0edfc2b4ee1b1e73b36ae03e43058f3efd984ac5baba5f94c71416,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_BARBICAN_WORKER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-barbican-worker@sha256:8072bd781b1bebf89ae6b24b81175c11090d1996aab86767ffd6b25bae57df99,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CEILOMETER_CENTRAL_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ceilometer-central@sha256:7b50597c6dbca671784fa98d7317a18980f1a1ac729254460e6d769d70dfefc5,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CEILOMETER_COMPUTE_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ceilometer-compute@sha256:31b63255661d23eb7478c8a22f357e1da5a25a62d92ec47f9adab2d0ac52fac9,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CEILOMETER_IPMI_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ceilometer-ipmi@sha256:c0a2e0a3f7f2bdf7eec1c7c3e73f874c159a9857e25861f575c0ad1ddf5d8823,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CEILOMETER_MYSQLD_EXPORTER_IMAGE_URL_DEFAULT,Value:quay.io/prometheus/mysqld-exporter@sha256:7211a617ec657701ca819aa0ba28e1d5750f5bf2c1391b755cc4a48cc360b0fa,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CEILOMETER_NOTIFICATION_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ceilometer-notification@sha256:cb7b59ee26e63eba841543d716424cd69b3ba4f0fc27b208d3ab3d315e4feac5,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CEILOMETER_SGCORE_IMAGE_URL_DEFAULT,Value:quay.io/openstack-k8s-operators/sg-core@sha256:09b5017c95d7697e66b9c64846bc48ef5826a009cba89b956ec54561e5f4a2d1,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CINDER_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-cinder-api@sha256:25d0e71e0464df9502ad8bd3af0f73caeaca1bae11d89b4b5992b4fe712eda3a,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CINDER_BACKUP_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-cinder-backup@sha256:0e8588aca751bde5059e3840ffbdf64ce88f4b039896b269ab43984df33813dd,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CINDER_SCHEDULER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-cinder-scheduler@sha256:9e907091034575b4133799eff52b662f28e9ef2a0dd0dbabb45f1ae37d5d53a0,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CINDER_VOLUME_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-cinder-volume@sha256:33dfd28630aefc6c4445c4b88545604d693e42948077a1d82d25ad0681945f5b,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CLOUDKITTY_API_IMAGE_URL_DEFAULT,Value:quay.rdoproject.org/podified-master-centos10/openstack-cloudkitty-api@sha256:de480b9a8fc7987d8b604bd1ea6ec0dc067f29b9adf4a059c3de5d05c5723e6c,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_CLOUDKITTY_PROC_IMAGE_URL_DEFAULT,Value:quay.rdoproject.org/podified-master-centos10/openstack-cloudkitty-processor@sha256:5ec051551190526b71903c6f8d3350bf7b3534f8de3a5d3e14526c9a13d2d31d,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-designate-api@sha256:d8a3a65a802c32ab522af42eb014d769aa1a8fcfaae2a290a4b2e7273f854a3b,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_BACKENDBIND9_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-designate-backend-bind9@sha256:4eb6ce54f9ac730022d656df8811d5f3b378492b7bd834ce0c3b87d8298196e2,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_CENTRAL_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-designate-central@sha256:edc1e595520c8343ca4f7dc0d82989e9c71c40d30ffb3b2ea9b55dc6bc3b58c9,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_MDNS_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-designate-mdns@sha256:b885e03262ed683f50147a1d608e00490b456fdc9549f98ff7ab2fb1ad6f3ba2,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_PRODUCER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-designate-producer@sha256:e15a8afdcde5ea2a062367d8050379614380becdb0aa12259a6b40a35d3f549e,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_UNBOUND_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-unbound@sha256:ae8454dd413dad333e842c0d0c65cd002e626fc0b83d2bd73b499277b6f7b2ca,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_DESIGNATE_WORKER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-designate-worker@sha256:e2f9bdb51e014e7539d4e256a18f6cb0057dedcf58618b7f15eadd10aa89d333,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_FRR_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-frr@sha256:b6a3181c148a034c61a9cfa66350f2099f3a3059b6efcc294cad3f5baf3ca7f4,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_ISCSID_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-iscsid@sha256:2ca2f0d178f7e6b6fbdb87f728faf6a2e41a3104a5631dd38ffe7712da6734c8,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_KEPLER_IMAGE_URL_DEFAULT,Value:quay.io/sustainable_computing_io/kepler@sha256:581b65b646301e0fcb07582150ba63438f1353a85bf9acf1eb2acb4ce71c58bd,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_LOGROTATE_CROND_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-cron@sha256:280e747514c209448fea075c0dc18176ae7f616e11a9241c0eb5fa75af318cf2,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_MULTIPATHD_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-multipathd@sha256:70a380cf725ccf6987fd10b44dd8d8807e200b16b8aac2a842f5b370cdd58df7,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_NEUTRON_DHCP_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-neutron-dhcp-agent@sha256:f3d5ecc50e8bc5739fbe7d38d56eb2a0cf3581eef3fa5c8dcd698edb1b73121d,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_NEUTRON_METADATA_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-neutron-metadata-agent-ovn@sha256:6eebf6cf424c5301641247c897052de8ef7493ba2f01e275090f8d9e6313b9d3,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_NEUTRON_OVN_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-neutron-ovn-agent@sha256:2cb4f9d22ddf7067a8d840c9b2c34000e8b0a148a20731ea41ea039e18d8caf0,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_NEUTRON_SRIOV_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-neutron-sriov-agent@sha256:80a14ed2cb8189891feda53680b05c64aea7725416b7271317652de1470e3f10,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_NODE_EXPORTER_IMAGE_URL_DEFAULT,Value:quay.io/prometheus/node-exporter@sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_OVN_BGP_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ovn-bgp-agent@sha256:4ec37c32887a63b65e29eea74af1d12a563307e13c889983e1242f681832c108,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_EDPM_PODMAN_EXPORTER_IMAGE_URL_DEFAULT,Value:quay.io/navidys/prometheus-podman-exporter@sha256:d339ba049bbd1adccb795962bf163f5b22fd84dea865d88b9eb525e46247d6bd,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_GLANCE_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-glance-api@sha256:8c7ecaaf282fb3dd419c02a3e017d5f190e1e0831965f1ce366b9763700b4e4a,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_HEAT_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-heat-api@sha256:14a9575be32d7d8c7bf233a8d7cdf5e0067b2a7944c46b97c09c1f835a73902a,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_HEAT_CFNAPI_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-heat-api-cfn@sha256:8cdabbe1caabd5eee32a6b0ca37bc80f0cbdabe7621031d9e60193e4ca0e9a05,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_HEAT_ENGINE_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-heat-engine@sha256:c7e57e8bde805b8943714bfa0c98b2fdf77ecd02311dd7d3be8edeee11311cd6,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_HORIZON_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-horizon@sha256:52247334a2f9162f9b7a78302447e80deb93fa7c4025375012f59fa49bb767a6,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_INFRA_MEMCACHED_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_INFRA_REDIS_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-redis@sha256:7ee23e0d3c8de6e852cc4ec33e4ed7946cea345e8fc68dfc9d17ba2c3ee55fd0,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_IRONIC_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ironic-api@sha256:88d396276e4eee9b965504b60aa0d192aa5b72012f438dfc057ff4ac9d2b42f4,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_IRONIC_CONDUCTOR_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ironic-conductor@sha256:ab6ca66e487c2473042dd263a2deecad6520dde8c2f592ca7e0d74754155935b,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_IRONIC_INSPECTOR_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ironic-inspector@sha256:2fe6e08337666e2d35ac5b5cac35b0bab0eee274105b1febba4de4441ae30883,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_IRONIC_NEUTRON_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ironic-neutron-agent@sha256:15057dd1b30deb9fe992e6df65b3a10e3c4f6e041582a82de40ba4fb14a6b2f4,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_IRONIC_PXE_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ironic-pxe@sha256:0e643ca2a5a61a2e8155d2e2ac5f43c8b7114c238b2f6728453b8ddd95872ea9,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_IRONIC_PYTHON_AGENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/ironic-python-agent@sha256:73b164a8d974d2acd052690f5ce36387b9c6603cc5531ef47edc636d250483d7,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_KEYSTONE_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-keystone@sha256:c54b00fd39e9221423904356e54d25937102cee6eab40ffcbe9be50c3211c998,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_KSM_IMAGE_URL_DEFAULT,Value:registry.k8s.io/kube-state-metrics/kube-state-metrics@sha256:db384bf43222b066c378e77027a675d4cd9911107adba46c2922b3a55e10d6fb,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_MANILA_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-manila-api@sha256:5ee35f3a2d86632c1c5faa090cc2adbbaf97a11f57f9112217f07e718f70dfa2,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_MANILA_SCHEDULER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-manila-scheduler@sha256:e4df658fe3853c3b3307f5b4770344234954751bff03d9b2e1972bef7f6816c2,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_MANILA_SHARE_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-manila-share@sha256:27525b2fd15a6454106116fa33af54a8f81dea3af61ad3305f22d4b2ebc9f768,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_MARIADB_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NET_UTILS_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-netutils@sha256:0ae27dc0d5ffd5933936f4f42d332bc7f4b870ebd03fec10f6d03fae88650a30,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NEUTRON_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:a0e6062f505fbc848d62675995abc3806bc5c12530d3d41ed16066e07f71b2d3,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NOVA_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-nova-api@sha256:c204f18c5ff6657cd13b59be40476c4b6791c74592aafbc480c974e9a6de9c5f,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NOVA_COMPUTE_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-nova-compute@sha256:5cdaeb65c87876031aef31dd91bea0d05ff3c6d00085809f94cce6a7469a6934,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NOVA_CONDUCTOR_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-nova-conductor@sha256:fed8bb29eb85284462a99cb1013100f375ae83e1d68ef0954dbc3c2d7074f911,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NOVA_NOVNC_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-nova-novncproxy@sha256:a6fb0cb1412380c623aaeafa5cb1d016b831fc9d68f21f187b3728f1c40b02ed,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_NOVA_SCHEDULER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-nova-scheduler@sha256:d316f6e58667b3a319be82ed594bffdd76df221be07ce686a634383a68d8fbb7,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OCTAVIA_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-octavia-api@sha256:ab7f58d75373e26c020d12fc845c30b64ba0f236a163efd1880c523a3321054c,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OCTAVIA_HEALTHMANAGER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-octavia-health-manager@sha256:37c702f09d13273b414b7dd87f9ea08bc78dbc4c8bda9a83597d68d41276be68,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OCTAVIA_HOUSEKEEPING_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-octavia-housekeeping@sha256:f1bbe5a8199a7c1839b00b475f562506797b980a019649b116eea4e071751ce7,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OCTAVIA_RSYSLOG_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-rsyslog@sha256:f2928dddda751a404f5c5b7c73f04c0229a293773ef20165d9861cf02d54fc0c,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OCTAVIA_WORKER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-octavia-worker@sha256:865faa8b740748e2675dd7efeaa31b210e681fa04cc0a7abb69256746019dca3,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OPENSTACK_CLIENT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-openstackclient@sha256:fed8e34e2c12b6bae77e207c0620bf237aee86c22f0e5e8dc5a39d1920d422cb,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OPENSTACK_MUST_GATHER_DEFAULT,Value:quay.io/openstack-k8s-operators/openstack-must-gather@sha256:0a98e8f5c83522ca6c8e40c5e9561f6628d2d5e69f0e8a64279c541c989d3d8b,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OPENSTACK_NETWORK_EXPORTER_IMAGE_URL_DEFAULT,Value:quay.io/openstack-k8s-operators/openstack-network-exporter@sha256:ecd56e6733c475f2d441344fd98f288c3eac0261ba113695fec7520a954ccbc7,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OS_CONTAINER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/edpm-hardened-uefi@sha256:48e0946c24a3f577a2f4e894e10ebba7301e2adc3c8a6139e6ba52d2b37f13e1,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OVN_CONTROLLER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ovn-controller@sha256:88aa29318415550987bdf3847f0d60e53f13b34fa029fd2b1f429622b5fa5528,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OVN_CONTROLLER_OVS_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ovn-base@sha256:ff4e61688bf3998015f81f1b91e53dfd48de83bb3192d6563689eb32e088c2eb,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OVN_NB_DBCLUSTER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ovn-nb-db-server@sha256:df1a26ffbe6152e142cfeed2500ca85782319d0cb4ec058b5b4e2f3145492e77,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OVN_NORTHD_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ovn-northd@sha256:b50791356d119186382dcc1928e509b4e306ad808a66ff6a694e89fc04f18bcd,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_OVN_SB_DBCLUSTER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-ovn-sb-db-server@sha256:e2de6853508fca6f1e6442757834a66baec36a9cf5f92450dd293fb507aef0c5,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_PLACEMENT_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-placement-api@sha256:ce8908c54afc567e5791f2940656436928afa6f135ebae31274e5283cf13f448,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_RABBITMQ_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_SWIFT_ACCOUNT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-swift-account@sha256:b2edf73a93d944944a1b4cfea9a707f786255f279f0fe618462184f45a1c07be,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_SWIFT_CONTAINER_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-swift-container@sha256:ac05f3bb94183e19aff696b4108e5302d45de1e84c1eea736c14bbdffb66467b,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_SWIFT_OBJECT_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-swift-object@sha256:2736a99c1da01339d4da3a3697fa1e845651dd1c246b75cf6e0de62e6763fb23,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_SWIFT_PROXY_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-swift-proxy-server@sha256:5d3268a6af8e505ab901049cb8d643a6f3de7e4d7b1cb4820255c11eff9a7bd0,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_TEST_TEMPEST_IMAGE_URL_DEFAULT,Value:quay.io/podified-antelope-centos9/openstack-tempest-all@sha256:e256f776486dd11e186b847ee547d7fc0ac452b72aeb5d00bc0073e70b929e03,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_WATCHER_API_IMAGE_URL_DEFAULT,Value:quay.io/podified-master-centos9/openstack-watcher-api@sha256:e697d287395c2f4261f846c6818c1a2c999ab84640baa57c695bc17ee332cead,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_WATCHER_APPLIER_IMAGE_URL_DEFAULT,Value:quay.io/podified-master-centos9/openstack-watcher-applier@sha256:3b2f9a900e35cb2ae7a56dd52c0cc44866bb0083bc8bc984fb61ed2440145e3f,ValueFrom:nil,},EnvVar{Name:RELATED_IMAGE_WATCHER_DECISION_ENGINE_IMAGE_URL_DEFAULT,Value:quay.io/podified-master-centos9/openstack-watcher-decision-engine@sha256:3deb7d37852add64cf3bb636ea77265cb58242fde18650d30b5a6755ae259ee8,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cert,ReadOnly:true,MountPath:/tmp/k8s-webhook-server/serving-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mf7sj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk_openstack-operators(3d74755b-a923-42e2-b1cb-f68b956325f8): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:37 crc kubenswrapper[4769]: W1121 12:07:37.114686 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0da7e0_0d50_4ec6_8320_a1994e79e38c.slice/crio-f4e59008b3c2d22df1d1fbdc43bc2c55c64d875623f1d1fe5e425752f5278eb1 WatchSource:0}: Error finding container f4e59008b3c2d22df1d1fbdc43bc2c55c64d875623f1d1fe5e425752f5278eb1: Status 404 returned error can't find the container with id f4e59008b3c2d22df1d1fbdc43bc2c55c64d875623f1d1fe5e425752f5278eb1 Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.131651 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:operator,Image:quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2,Command:[/manager],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:0,ContainerPort:9782,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:OPERATOR_NAMESPACE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{524288000 0} {} 500Mi BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-6qf69,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw_openstack-operators(5f0da7e0-0d50-4ec6-8320-a1994e79e38c): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.132780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.134381 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.142372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") pod \"openstack-operator-controller-manager-7755d5f8cc-sk7hz\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.366087 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.684744 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.694813 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.694970 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.696061 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.696702 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.699057 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" Nov 21 12:07:37 crc kubenswrapper[4769]: E1121 12:07:37.702763 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" Nov 21 12:07:37 crc kubenswrapper[4769]: I1121 12:07:37.951892 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz"] Nov 21 12:07:37 crc kubenswrapper[4769]: W1121 12:07:37.967293 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4b5619_0a5f_4363_985d_99182730024d.slice/crio-8603dd0aabd68ac237e32ad20d82800289629528fbbb6e8df61c0d5857fd54a0 WatchSource:0}: Error finding container 8603dd0aabd68ac237e32ad20d82800289629528fbbb6e8df61c0d5857fd54a0: Status 404 returned error can't find the container with id 8603dd0aabd68ac237e32ad20d82800289629528fbbb6e8df61c0d5857fd54a0 Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.067095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" event={"ID":"0bc3144e-ffee-4056-960b-c0144d0f0a14","Type":"ContainerStarted","Data":"5c8347a693dfa211efed9bbe4b780160870ba4380606caa9ce739f6bb65e1b03"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.070311 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/telemetry-operator@sha256:5324a6d2f76fc3041023b0cbd09a733ef2b59f310d390e4d6483d219eb96494f\\\"\"" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.076243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" event={"ID":"5c4b5619-0a5f-4363-985d-99182730024d","Type":"ContainerStarted","Data":"8603dd0aabd68ac237e32ad20d82800289629528fbbb6e8df61c0d5857fd54a0"} Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.098401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" event={"ID":"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f","Type":"ContainerStarted","Data":"db28119909fa7b28c44812d7184901321e739f42d3230070a418722047a5bdf3"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.104978 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:4838402d41d42c56613d43dc5041aae475a2b18e6172491d6c4d4a78a580697f\\\"\"" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.107642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" event={"ID":"5f0da7e0-0d50-4ec6-8320-a1994e79e38c","Type":"ContainerStarted","Data":"f4e59008b3c2d22df1d1fbdc43bc2c55c64d875623f1d1fe5e425752f5278eb1"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.110178 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2\\\"\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.115071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" event={"ID":"48bcc67d-6c8c-49c5-8b60-1ed8a583c885","Type":"ContainerStarted","Data":"a61b429862ef2a8daa1141a25b2ea4b51ff4c0daf48fdc7fa3fc2c8c4da6810c"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.117880 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/placement-operator@sha256:4094e7fc11a33e8e2b6768a053cafaf5b122446d23f9113d43d520cb64e9776c\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.121663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" event={"ID":"b1424001-64e8-4892-b403-4284096261ba","Type":"ContainerStarted","Data":"9cc7c6a214f57c6e9ac68ddd9b93c327aef383bb1a40b0328bf7aa2310a35707"} Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.143107 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" event={"ID":"6bbca42b-c781-4106-851f-ab9bb4fac793","Type":"ContainerStarted","Data":"8d868e6a04fc23686196f3767dd9ad9ef9a278e8d8f934e18f5d16b1d5cc06f3"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.148074 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/ovn-operator@sha256:5d49d4594c66eda7b151746cc6e1d3c67c0129b4503eeb043a64ae8ec2da6a1b\\\"\"" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.170617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" event={"ID":"3d74755b-a923-42e2-b1cb-f68b956325f8","Type":"ContainerStarted","Data":"1217b335749f9401e86fb4f1c162afd849feaa1f8e55cb7cab3479bab48fe16d"} Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.170729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" event={"ID":"3d74755b-a923-42e2-b1cb-f68b956325f8","Type":"ContainerStarted","Data":"6f8fc26313373b9ec84c5c9f891ae65b11b9fdea3179bff701519bbc82030b5f"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.186588 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/openstack-baremetal-operator@sha256:78852f8ba332a5756c1551c126157f735279101a0fc3277ba4aa4db3478789dd\\\"\"" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.194844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" event={"ID":"ca12a419-f80c-4f1c-8f23-1f72e4e07121","Type":"ContainerStarted","Data":"7fbc88a3b3c1936b9597119e2724b5f6bc70cc4472a304dfb9f35650fd3611df"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.200585 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/infra-operator@sha256:86df58f744c1d23233cc98f6ea17c8d6da637c50003d0fc8c100045594aa9894\\\"\"" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" Nov 21 12:07:38 crc kubenswrapper[4769]: I1121 12:07:38.202380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" event={"ID":"ebaca59c-611f-4c55-85df-3a788dab93d2","Type":"ContainerStarted","Data":"465af80035a015eb6e543fbd5be14d8295a5281dc24073b5fd78db8705568160"} Nov 21 12:07:38 crc kubenswrapper[4769]: E1121 12:07:38.205089 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/swift-operator@sha256:c0b5f124a37c1538042c0e63f0978429572e2a851d7f3a6eb80de09b86d755a0\\\"\"" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" Nov 21 12:07:39 crc kubenswrapper[4769]: I1121 12:07:39.255680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" event={"ID":"5c4b5619-0a5f-4363-985d-99182730024d","Type":"ContainerStarted","Data":"7ab81a190f7145ab19be918722a255c3e182600639baf55f41cb667365a8162a"} Nov 21 12:07:39 crc kubenswrapper[4769]: I1121 12:07:39.255732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" event={"ID":"5c4b5619-0a5f-4363-985d-99182730024d","Type":"ContainerStarted","Data":"478fb18fc3332ba4f29b0d6b5fcd459e36b484739473c376efd5a28b520e4044"} Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.257641 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:4838402d41d42c56613d43dc5041aae475a2b18e6172491d6c4d4a78a580697f\\\"\"" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.258071 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/openstack-baremetal-operator@sha256:78852f8ba332a5756c1551c126157f735279101a0fc3277ba4aa4db3478789dd\\\"\"" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.258135 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/placement-operator@sha256:4094e7fc11a33e8e2b6768a053cafaf5b122446d23f9113d43d520cb64e9776c\\\"\"" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.263457 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2\\\"\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.263496 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/ovn-operator@sha256:5d49d4594c66eda7b151746cc6e1d3c67c0129b4503eeb043a64ae8ec2da6a1b\\\"\"" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.263538 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/infra-operator@sha256:86df58f744c1d23233cc98f6ea17c8d6da637c50003d0fc8c100045594aa9894\\\"\"" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.263555 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/telemetry-operator@sha256:5324a6d2f76fc3041023b0cbd09a733ef2b59f310d390e4d6483d219eb96494f\\\"\"" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" Nov 21 12:07:39 crc kubenswrapper[4769]: E1121 12:07:39.263646 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/swift-operator@sha256:c0b5f124a37c1538042c0e63f0978429572e2a851d7f3a6eb80de09b86d755a0\\\"\"" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" Nov 21 12:07:39 crc kubenswrapper[4769]: I1121 12:07:39.431369 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" podStartSLOduration=4.431349413 podStartE2EDuration="4.431349413s" podCreationTimestamp="2025-11-21 12:07:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:07:39.428379845 +0000 UTC m=+1018.129041673" watchObservedRunningTime="2025-11-21 12:07:39.431349413 +0000 UTC m=+1018.132011221" Nov 21 12:07:40 crc kubenswrapper[4769]: I1121 12:07:40.271392 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:41 crc kubenswrapper[4769]: I1121 12:07:41.324972 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:07:41 crc kubenswrapper[4769]: I1121 12:07:41.325032 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:07:41 crc kubenswrapper[4769]: I1121 12:07:41.325077 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:07:41 crc kubenswrapper[4769]: I1121 12:07:41.325714 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"183b431de75db756057a9fd21f82b3dcfbe60ed8b081d37c7fb533b6c556dab7"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:07:41 crc kubenswrapper[4769]: I1121 12:07:41.325765 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://183b431de75db756057a9fd21f82b3dcfbe60ed8b081d37c7fb533b6c556dab7" gracePeriod=600 Nov 21 12:07:42 crc kubenswrapper[4769]: I1121 12:07:42.296086 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="183b431de75db756057a9fd21f82b3dcfbe60ed8b081d37c7fb533b6c556dab7" exitCode=0 Nov 21 12:07:42 crc kubenswrapper[4769]: I1121 12:07:42.296164 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"183b431de75db756057a9fd21f82b3dcfbe60ed8b081d37c7fb533b6c556dab7"} Nov 21 12:07:42 crc kubenswrapper[4769]: I1121 12:07:42.296576 4769 scope.go:117] "RemoveContainer" containerID="e5789956c423cd2670b5d2eab5d80c7e96e666ff7427886e39b71bbafc7c2c2d" Nov 21 12:07:47 crc kubenswrapper[4769]: I1121 12:07:47.381314 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.531432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" event={"ID":"bcf991ab-cf17-4dfe-89ca-364c2361278d","Type":"ContainerStarted","Data":"664f44399e6c5308e54048bd384ad3d2f66fb021e2fe3a72d410af31bdc50a4e"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.546618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" event={"ID":"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3","Type":"ContainerStarted","Data":"d4f8428dd5414db367dbc67de16d8be669be1224a6cac81927bb2bca0fffddf4"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.565945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"77b95337a8fb1bea6740223d306fd9fa3ee4382d0abe34fe326b929ca3a9c906"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.597426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" event={"ID":"e4ba6f52-4d8e-4337-bff6-83de22056bf2","Type":"ContainerStarted","Data":"05e828f53e4434f6884067d1fc85e9d9f85822183babf29cc9f029da2e568e8c"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.597482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" event={"ID":"e4ba6f52-4d8e-4337-bff6-83de22056bf2","Type":"ContainerStarted","Data":"7bbd995fe48422294a34544184d6dff7dcb9cb328b3addf52269afa18a42a330"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.598259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.628499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" event={"ID":"3c4f2848-d13a-4646-bd9c-cf691f1c1099","Type":"ContainerStarted","Data":"4302ed47c9a6350e7222fbd12311f7b707b9713cd07f2dc2f854b1fb08478cc9"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.628861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" event={"ID":"3c4f2848-d13a-4646-bd9c-cf691f1c1099","Type":"ContainerStarted","Data":"b6aff44fb28d02f6fc1817970a17b9ded2f2579fbd8c4fca71b7fb1357cc4255"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.629734 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.643025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" event={"ID":"c947192b-fa60-475c-8485-d5b89b68db04","Type":"ContainerStarted","Data":"0e06f8a29ffe2d8596643312ae610a1cf815694f75382219618ad21413838164"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.655076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" event={"ID":"7da40971-cf3f-40a1-b8ca-cccc0b21c801","Type":"ContainerStarted","Data":"495665c86c27acc6143afe39073e804f682726439e71e688495d915ce8911500"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.666638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" event={"ID":"b1424001-64e8-4892-b403-4284096261ba","Type":"ContainerStarted","Data":"8aafeae1041add0e486c419c7fd17c32af98840183d02cc9979704f665626ead"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.692018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" event={"ID":"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd","Type":"ContainerStarted","Data":"bf29ee92d59dd39d5692b2f21c812db3f86b966c2fcb5b007de6ea3da2fbb791"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.693579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" event={"ID":"884af2cd-b59a-4583-818e-f6ff7b8b4fc7","Type":"ContainerStarted","Data":"9c3cc17a5c6e3a2e9193f2093c15f4de540b0b1cd9ea2087e6c8eb886ba175c3"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.696736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" event={"ID":"f769fe9e-e5a5-4954-9d27-6786c130674d","Type":"ContainerStarted","Data":"149bcf102175b79f59006c0a114f30b2078eeba9534f17f7826903ff09f663e3"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.697484 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.698605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" event={"ID":"5244ed83-c201-493d-9c35-20102cd07696","Type":"ContainerStarted","Data":"e346bbc29cbe0559ebb51dd5a671c10b450ece5a9b11c62a20934e8159facf50"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.699524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" event={"ID":"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58","Type":"ContainerStarted","Data":"cba58951ed8f97777242e8f4f3065a904368ca8ff449e950a599427bc8738eb9"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.705284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" event={"ID":"73a1d48f-8d98-4b78-bac7-00e1ffa04b82","Type":"ContainerStarted","Data":"3620ff9f616e0a12fef6dc00e7e0cc4df886f9ed2c4fff0f46cb8954dc0feb81"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.705874 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" podStartSLOduration=3.444368478 podStartE2EDuration="16.705859104s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.14811954 +0000 UTC m=+1014.848781358" lastFinishedPulling="2025-11-21 12:07:49.409610166 +0000 UTC m=+1028.110271984" observedRunningTime="2025-11-21 12:07:50.646100346 +0000 UTC m=+1029.346762194" watchObservedRunningTime="2025-11-21 12:07:50.705859104 +0000 UTC m=+1029.406520922" Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.737818 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" podStartSLOduration=3.6921071 podStartE2EDuration="16.737797813s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.371870872 +0000 UTC m=+1015.072532690" lastFinishedPulling="2025-11-21 12:07:49.417561585 +0000 UTC m=+1028.118223403" observedRunningTime="2025-11-21 12:07:50.716230507 +0000 UTC m=+1029.416892325" watchObservedRunningTime="2025-11-21 12:07:50.737797813 +0000 UTC m=+1029.438459631" Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.760046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" event={"ID":"300d1793-527a-4e93-8753-460f9390a9f0","Type":"ContainerStarted","Data":"9c02c139770ec2d26051b4aa5f27e890cd157c667ac3935ab804dd292a5deae9"} Nov 21 12:07:50 crc kubenswrapper[4769]: I1121 12:07:50.823321 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" podStartSLOduration=3.619595466 podStartE2EDuration="16.823300436s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.210586709 +0000 UTC m=+1014.911248527" lastFinishedPulling="2025-11-21 12:07:49.414291679 +0000 UTC m=+1028.114953497" observedRunningTime="2025-11-21 12:07:50.819723113 +0000 UTC m=+1029.520384931" watchObservedRunningTime="2025-11-21 12:07:50.823300436 +0000 UTC m=+1029.523962244" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.773649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" event={"ID":"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58","Type":"ContainerStarted","Data":"4eac292042724ce058ecf3b3134ad96463fdebf3203317509bf46fcd779646a3"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.774107 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.788810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" event={"ID":"bcf991ab-cf17-4dfe-89ca-364c2361278d","Type":"ContainerStarted","Data":"c3bd0e428c0efbb264a317c62d1f2b9b26e235d1f3658b2cd045af505d8561a5"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.789789 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.792484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" event={"ID":"73a1d48f-8d98-4b78-bac7-00e1ffa04b82","Type":"ContainerStarted","Data":"9b538ada4b5e7656a174202cd35d4e50b7aad3730cbd8213daffe1d65d635877"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.793115 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.795308 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" event={"ID":"300d1793-527a-4e93-8753-460f9390a9f0","Type":"ContainerStarted","Data":"5facb6143fa98ce5583569e3b26176ecbbfe8467c6dee1738d0b29b8dd1b7b32"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.795731 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.807537 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" event={"ID":"c947192b-fa60-475c-8485-d5b89b68db04","Type":"ContainerStarted","Data":"21da28b118326d5395e720618736da04fed81b4879e718b60cfe4709588e759f"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.807887 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.809550 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" podStartSLOduration=5.029662543 podStartE2EDuration="17.809523759s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.635433179 +0000 UTC m=+1015.336094997" lastFinishedPulling="2025-11-21 12:07:49.415294395 +0000 UTC m=+1028.115956213" observedRunningTime="2025-11-21 12:07:51.808077551 +0000 UTC m=+1030.508739369" watchObservedRunningTime="2025-11-21 12:07:51.809523759 +0000 UTC m=+1030.510185577" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.826701 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" event={"ID":"7da40971-cf3f-40a1-b8ca-cccc0b21c801","Type":"ContainerStarted","Data":"bc53fca0eca528cea270c1e119736ca93e18ca8fd4227514f717fd0de44d1f58"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.827795 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.835317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" event={"ID":"b1424001-64e8-4892-b403-4284096261ba","Type":"ContainerStarted","Data":"c26f7c9aa2914a8f6801fd98ac42edb8bbc0471d7738942c92027ebbb3ff6c98"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.835775 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.843610 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" podStartSLOduration=4.566681933 podStartE2EDuration="17.843594573s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.132634104 +0000 UTC m=+1014.833295922" lastFinishedPulling="2025-11-21 12:07:49.409546744 +0000 UTC m=+1028.110208562" observedRunningTime="2025-11-21 12:07:51.832231335 +0000 UTC m=+1030.532893153" watchObservedRunningTime="2025-11-21 12:07:51.843594573 +0000 UTC m=+1030.544256391" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.845392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" event={"ID":"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3","Type":"ContainerStarted","Data":"1316aab7df7fc6324fcd638c3657cb8a3cec872ebf05bdccec83727bb411875d"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.845696 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.849065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" event={"ID":"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd","Type":"ContainerStarted","Data":"f3b9261a14c0c306233cca1c21257862ceabd1789ed170ed4f8d708155596af6"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.849576 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.852848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" event={"ID":"5244ed83-c201-493d-9c35-20102cd07696","Type":"ContainerStarted","Data":"8073ebd1c6b07e27a697d597db234cfc37862d83735a37077713855ed3811e0a"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.853378 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.855883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" event={"ID":"884af2cd-b59a-4583-818e-f6ff7b8b4fc7","Type":"ContainerStarted","Data":"77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.856400 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.859387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" event={"ID":"f769fe9e-e5a5-4954-9d27-6786c130674d","Type":"ContainerStarted","Data":"ee6015ca258ee6b5ce1301776f76cd081fabad0d139968bc670160748d442344"} Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.902682 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" podStartSLOduration=5.093652153 podStartE2EDuration="17.902645673s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.615147857 +0000 UTC m=+1015.315809675" lastFinishedPulling="2025-11-21 12:07:49.424141377 +0000 UTC m=+1028.124803195" observedRunningTime="2025-11-21 12:07:51.873537149 +0000 UTC m=+1030.574198977" watchObservedRunningTime="2025-11-21 12:07:51.902645673 +0000 UTC m=+1030.603307491" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.903715 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" podStartSLOduration=4.83754517 podStartE2EDuration="17.90370576s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.358387108 +0000 UTC m=+1015.059048926" lastFinishedPulling="2025-11-21 12:07:49.424547698 +0000 UTC m=+1028.125209516" observedRunningTime="2025-11-21 12:07:51.893454451 +0000 UTC m=+1030.594116269" watchObservedRunningTime="2025-11-21 12:07:51.90370576 +0000 UTC m=+1030.604367588" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.929891 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" podStartSLOduration=5.160920688 podStartE2EDuration="17.929864477s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.640605045 +0000 UTC m=+1015.341266863" lastFinishedPulling="2025-11-21 12:07:49.409548834 +0000 UTC m=+1028.110210652" observedRunningTime="2025-11-21 12:07:51.928921382 +0000 UTC m=+1030.629583200" watchObservedRunningTime="2025-11-21 12:07:51.929864477 +0000 UTC m=+1030.630526295" Nov 21 12:07:51 crc kubenswrapper[4769]: I1121 12:07:51.954965 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" podStartSLOduration=5.332543811 podStartE2EDuration="17.954940545s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.797299577 +0000 UTC m=+1015.497961405" lastFinishedPulling="2025-11-21 12:07:49.419696321 +0000 UTC m=+1028.120358139" observedRunningTime="2025-11-21 12:07:51.946038921 +0000 UTC m=+1030.646700729" watchObservedRunningTime="2025-11-21 12:07:51.954940545 +0000 UTC m=+1030.655602363" Nov 21 12:07:52 crc kubenswrapper[4769]: I1121 12:07:52.007872 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" podStartSLOduration=5.40414839 podStartE2EDuration="18.007849443s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.816534012 +0000 UTC m=+1015.517195830" lastFinishedPulling="2025-11-21 12:07:49.420235065 +0000 UTC m=+1028.120896883" observedRunningTime="2025-11-21 12:07:51.974837177 +0000 UTC m=+1030.675498995" watchObservedRunningTime="2025-11-21 12:07:52.007849443 +0000 UTC m=+1030.708511271" Nov 21 12:07:52 crc kubenswrapper[4769]: I1121 12:07:52.012914 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" podStartSLOduration=5.473687645 podStartE2EDuration="18.012899126s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.877697097 +0000 UTC m=+1015.578358915" lastFinishedPulling="2025-11-21 12:07:49.416908578 +0000 UTC m=+1028.117570396" observedRunningTime="2025-11-21 12:07:52.004094975 +0000 UTC m=+1030.704756803" watchObservedRunningTime="2025-11-21 12:07:52.012899126 +0000 UTC m=+1030.713560954" Nov 21 12:07:52 crc kubenswrapper[4769]: I1121 12:07:52.042829 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" podStartSLOduration=5.238470023 podStartE2EDuration="18.042810871s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.618544506 +0000 UTC m=+1015.319206314" lastFinishedPulling="2025-11-21 12:07:49.422885354 +0000 UTC m=+1028.123547162" observedRunningTime="2025-11-21 12:07:52.031877524 +0000 UTC m=+1030.732539342" watchObservedRunningTime="2025-11-21 12:07:52.042810871 +0000 UTC m=+1030.743472689" Nov 21 12:07:52 crc kubenswrapper[4769]: I1121 12:07:52.054204 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" podStartSLOduration=5.681274673 podStartE2EDuration="18.054168369s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:37.047848162 +0000 UTC m=+1015.748509980" lastFinishedPulling="2025-11-21 12:07:49.420741848 +0000 UTC m=+1028.121403676" observedRunningTime="2025-11-21 12:07:52.049852536 +0000 UTC m=+1030.750514364" watchObservedRunningTime="2025-11-21 12:07:52.054168369 +0000 UTC m=+1030.754830197" Nov 21 12:07:52 crc kubenswrapper[4769]: I1121 12:07:52.079819 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" podStartSLOduration=5.278820831 podStartE2EDuration="18.079797492s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.617071667 +0000 UTC m=+1015.317733485" lastFinishedPulling="2025-11-21 12:07:49.418048328 +0000 UTC m=+1028.118710146" observedRunningTime="2025-11-21 12:07:52.075041287 +0000 UTC m=+1030.775703105" watchObservedRunningTime="2025-11-21 12:07:52.079797492 +0000 UTC m=+1030.780459310" Nov 21 12:07:54 crc kubenswrapper[4769]: I1121 12:07:54.627658 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 12:07:54 crc kubenswrapper[4769]: I1121 12:07:54.667970 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 12:07:54 crc kubenswrapper[4769]: I1121 12:07:54.756506 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 12:07:54 crc kubenswrapper[4769]: I1121 12:07:54.827451 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 12:07:55 crc kubenswrapper[4769]: I1121 12:07:55.174556 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 12:07:55 crc kubenswrapper[4769]: I1121 12:07:55.221575 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 12:07:55 crc kubenswrapper[4769]: I1121 12:07:55.323051 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 12:07:55 crc kubenswrapper[4769]: I1121 12:07:55.330276 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 12:07:55 crc kubenswrapper[4769]: I1121 12:07:55.359727 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 12:07:55 crc kubenswrapper[4769]: I1121 12:07:55.802968 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 12:08:01 crc kubenswrapper[4769]: I1121 12:08:01.986165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" event={"ID":"48bcc67d-6c8c-49c5-8b60-1ed8a583c885","Type":"ContainerStarted","Data":"42f881e43dc736f6bf238d9cfa131e449db41847556c165bb59a9f0e9a1e875e"} Nov 21 12:08:01 crc kubenswrapper[4769]: I1121 12:08:01.989292 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.003753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" event={"ID":"6bbca42b-c781-4106-851f-ab9bb4fac793","Type":"ContainerStarted","Data":"bf5a6c30d09e75eb03f2720daf0cbda1be4c561977c7b3cdfe4809428a9b34de"} Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.004387 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.008748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" event={"ID":"3d74755b-a923-42e2-b1cb-f68b956325f8","Type":"ContainerStarted","Data":"9754745f9a00287fa86e89b74e0e2566fa28c15d4fbe9ffbb4ff59569b381ed7"} Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.009002 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.014875 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" podStartSLOduration=3.3254547580000002 podStartE2EDuration="28.014854951s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.896739447 +0000 UTC m=+1015.597401265" lastFinishedPulling="2025-11-21 12:08:01.58613964 +0000 UTC m=+1040.286801458" observedRunningTime="2025-11-21 12:08:02.010764993 +0000 UTC m=+1040.711426821" watchObservedRunningTime="2025-11-21 12:08:02.014854951 +0000 UTC m=+1040.715516769" Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.038925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" podStartSLOduration=3.316736788 podStartE2EDuration="28.038905912s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.908545596 +0000 UTC m=+1015.609207414" lastFinishedPulling="2025-11-21 12:08:01.63071472 +0000 UTC m=+1040.331376538" observedRunningTime="2025-11-21 12:08:02.030989624 +0000 UTC m=+1040.731651442" watchObservedRunningTime="2025-11-21 12:08:02.038905912 +0000 UTC m=+1040.739567730" Nov 21 12:08:02 crc kubenswrapper[4769]: I1121 12:08:02.069549 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" podStartSLOduration=3.5442565 podStartE2EDuration="28.069531246s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:37.103157454 +0000 UTC m=+1015.803819272" lastFinishedPulling="2025-11-21 12:08:01.6284322 +0000 UTC m=+1040.329094018" observedRunningTime="2025-11-21 12:08:02.062252465 +0000 UTC m=+1040.762914303" watchObservedRunningTime="2025-11-21 12:08:02.069531246 +0000 UTC m=+1040.770193064" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.018893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" event={"ID":"0bc3144e-ffee-4056-960b-c0144d0f0a14","Type":"ContainerStarted","Data":"ecac01db0828cac6541f262c83e55c1e7a591f42926cc3ec8ebef9b8b227faa5"} Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.019261 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.021634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" event={"ID":"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f","Type":"ContainerStarted","Data":"c3dccda292760178da96b95423da3f0986bed4c9b7cc165579e3b87ea035c99c"} Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.021864 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.023156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" event={"ID":"5f0da7e0-0d50-4ec6-8320-a1994e79e38c","Type":"ContainerStarted","Data":"bbe0e4466cfd8b3bdd075f4f164368b6a29c6dda6a76ee68499d29adcc3d7a27"} Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.024846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" event={"ID":"ca12a419-f80c-4f1c-8f23-1f72e4e07121","Type":"ContainerStarted","Data":"bd46dd8c9731a36be3f0e9694dbe037636ce2ea5c0d064b7f4c047b06f2d416c"} Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.025065 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.026995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" event={"ID":"ebaca59c-611f-4c55-85df-3a788dab93d2","Type":"ContainerStarted","Data":"a521933d00da2ecf0a7d7df2dbf6c8982eb4d2672a060bd2efc800d8bedd39c2"} Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.045598 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" podStartSLOduration=5.241080981 podStartE2EDuration="29.045577761s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.89649811 +0000 UTC m=+1015.597159928" lastFinishedPulling="2025-11-21 12:08:00.70099489 +0000 UTC m=+1039.401656708" observedRunningTime="2025-11-21 12:08:03.04022849 +0000 UTC m=+1041.740890318" watchObservedRunningTime="2025-11-21 12:08:03.045577761 +0000 UTC m=+1041.746239589" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.067493 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" podStartSLOduration=5.263311214 podStartE2EDuration="29.067470695s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.89686918 +0000 UTC m=+1015.597530998" lastFinishedPulling="2025-11-21 12:08:00.701028661 +0000 UTC m=+1039.401690479" observedRunningTime="2025-11-21 12:08:03.060534703 +0000 UTC m=+1041.761196541" watchObservedRunningTime="2025-11-21 12:08:03.067470695 +0000 UTC m=+1041.768132523" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.083993 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" podStartSLOduration=4.3677251 podStartE2EDuration="29.083972018s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.896453179 +0000 UTC m=+1015.597114997" lastFinishedPulling="2025-11-21 12:08:01.612700107 +0000 UTC m=+1040.313361915" observedRunningTime="2025-11-21 12:08:03.076931373 +0000 UTC m=+1041.777593201" watchObservedRunningTime="2025-11-21 12:08:03.083972018 +0000 UTC m=+1041.784633836" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.120504 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" podStartSLOduration=3.5845811210000003 podStartE2EDuration="28.120481866s" podCreationTimestamp="2025-11-21 12:07:35 +0000 UTC" firstStartedPulling="2025-11-21 12:07:37.131433846 +0000 UTC m=+1015.832095664" lastFinishedPulling="2025-11-21 12:08:01.667334591 +0000 UTC m=+1040.367996409" observedRunningTime="2025-11-21 12:08:03.103759608 +0000 UTC m=+1041.804421426" watchObservedRunningTime="2025-11-21 12:08:03.120481866 +0000 UTC m=+1041.821143684" Nov 21 12:08:03 crc kubenswrapper[4769]: I1121 12:08:03.121786 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" podStartSLOduration=4.369057065 podStartE2EDuration="29.12177603s" podCreationTimestamp="2025-11-21 12:07:34 +0000 UTC" firstStartedPulling="2025-11-21 12:07:36.896819739 +0000 UTC m=+1015.597481557" lastFinishedPulling="2025-11-21 12:08:01.649538704 +0000 UTC m=+1040.350200522" observedRunningTime="2025-11-21 12:08:03.118099224 +0000 UTC m=+1041.818761042" watchObservedRunningTime="2025-11-21 12:08:03.12177603 +0000 UTC m=+1041.822437848" Nov 21 12:08:04 crc kubenswrapper[4769]: I1121 12:08:04.777928 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 12:08:04 crc kubenswrapper[4769]: I1121 12:08:04.855386 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 12:08:04 crc kubenswrapper[4769]: I1121 12:08:04.878738 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 12:08:04 crc kubenswrapper[4769]: I1121 12:08:04.959043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 12:08:05 crc kubenswrapper[4769]: I1121 12:08:05.447548 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:08:06 crc kubenswrapper[4769]: I1121 12:08:06.008133 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 12:08:15 crc kubenswrapper[4769]: I1121 12:08:15.370735 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 12:08:15 crc kubenswrapper[4769]: I1121 12:08:15.449621 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 12:08:15 crc kubenswrapper[4769]: I1121 12:08:15.451259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 12:08:15 crc kubenswrapper[4769]: I1121 12:08:15.457988 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 12:08:15 crc kubenswrapper[4769]: I1121 12:08:15.794796 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 12:08:15 crc kubenswrapper[4769]: I1121 12:08:15.829376 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.804661 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-wmgzp"] Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.806357 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.810544 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.811295 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.811574 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.811973 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.826553 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-wmgzp"] Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.925032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-node-mnt\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.925135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4nsv\" (UniqueName: \"kubernetes.io/projected/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-kube-api-access-b4nsv\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:22 crc kubenswrapper[4769]: I1121 12:08:22.925244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-crc-storage\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.026820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b4nsv\" (UniqueName: \"kubernetes.io/projected/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-kube-api-access-b4nsv\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.026906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-crc-storage\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.026989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-node-mnt\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.027445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-node-mnt\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.028556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-crc-storage\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.059987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4nsv\" (UniqueName: \"kubernetes.io/projected/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-kube-api-access-b4nsv\") pod \"crc-storage-crc-wmgzp\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.184824 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.671308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-wmgzp"] Nov 21 12:08:23 crc kubenswrapper[4769]: I1121 12:08:23.687860 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:08:24 crc kubenswrapper[4769]: I1121 12:08:24.210954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-wmgzp" event={"ID":"9e8e2741-0ab6-431d-bf5e-799e21aa90bd","Type":"ContainerStarted","Data":"49833b87995f7f3ce591ab4fb2cb173768a0bf52cdb052dd30a7deba8da49e0a"} Nov 21 12:08:35 crc kubenswrapper[4769]: I1121 12:08:35.319941 4769 generic.go:334] "Generic (PLEG): container finished" podID="9e8e2741-0ab6-431d-bf5e-799e21aa90bd" containerID="5c5c6caca3d65edbaf3ec0742b672ffd411cb65ef8e3637fc4efabb8cdd6f03d" exitCode=0 Nov 21 12:08:35 crc kubenswrapper[4769]: I1121 12:08:35.320018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-wmgzp" event={"ID":"9e8e2741-0ab6-431d-bf5e-799e21aa90bd","Type":"ContainerDied","Data":"5c5c6caca3d65edbaf3ec0742b672ffd411cb65ef8e3637fc4efabb8cdd6f03d"} Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.608309 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.653558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-crc-storage\") pod \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.653656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-node-mnt\") pod \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.653798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4nsv\" (UniqueName: \"kubernetes.io/projected/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-kube-api-access-b4nsv\") pod \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\" (UID: \"9e8e2741-0ab6-431d-bf5e-799e21aa90bd\") " Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.653806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "9e8e2741-0ab6-431d-bf5e-799e21aa90bd" (UID: "9e8e2741-0ab6-431d-bf5e-799e21aa90bd"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.654214 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.660534 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-kube-api-access-b4nsv" (OuterVolumeSpecName: "kube-api-access-b4nsv") pod "9e8e2741-0ab6-431d-bf5e-799e21aa90bd" (UID: "9e8e2741-0ab6-431d-bf5e-799e21aa90bd"). InnerVolumeSpecName "kube-api-access-b4nsv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.677702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "9e8e2741-0ab6-431d-bf5e-799e21aa90bd" (UID: "9e8e2741-0ab6-431d-bf5e-799e21aa90bd"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.755456 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:08:36 crc kubenswrapper[4769]: I1121 12:08:36.755494 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b4nsv\" (UniqueName: \"kubernetes.io/projected/9e8e2741-0ab6-431d-bf5e-799e21aa90bd-kube-api-access-b4nsv\") on node \"crc\" DevicePath \"\"" Nov 21 12:08:37 crc kubenswrapper[4769]: I1121 12:08:37.335290 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-wmgzp" event={"ID":"9e8e2741-0ab6-431d-bf5e-799e21aa90bd","Type":"ContainerDied","Data":"49833b87995f7f3ce591ab4fb2cb173768a0bf52cdb052dd30a7deba8da49e0a"} Nov 21 12:08:37 crc kubenswrapper[4769]: I1121 12:08:37.335329 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49833b87995f7f3ce591ab4fb2cb173768a0bf52cdb052dd30a7deba8da49e0a" Nov 21 12:08:37 crc kubenswrapper[4769]: I1121 12:08:37.335357 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-wmgzp" Nov 21 12:08:40 crc kubenswrapper[4769]: I1121 12:08:40.938645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-wmgzp"] Nov 21 12:08:40 crc kubenswrapper[4769]: I1121 12:08:40.944153 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-wmgzp"] Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.066263 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-llx8x"] Nov 21 12:08:41 crc kubenswrapper[4769]: E1121 12:08:41.066722 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e8e2741-0ab6-431d-bf5e-799e21aa90bd" containerName="storage" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.066772 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e8e2741-0ab6-431d-bf5e-799e21aa90bd" containerName="storage" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.066950 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e8e2741-0ab6-431d-bf5e-799e21aa90bd" containerName="storage" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.067604 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.071631 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.072134 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.072471 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.077522 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-llx8x"] Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.078186 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.127143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1ced98bb-10b9-46dc-b611-cd9ead5d2018-crc-storage\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.127287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1ced98bb-10b9-46dc-b611-cd9ead5d2018-node-mnt\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.127352 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j26xz\" (UniqueName: \"kubernetes.io/projected/1ced98bb-10b9-46dc-b611-cd9ead5d2018-kube-api-access-j26xz\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.228721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j26xz\" (UniqueName: \"kubernetes.io/projected/1ced98bb-10b9-46dc-b611-cd9ead5d2018-kube-api-access-j26xz\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.228843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1ced98bb-10b9-46dc-b611-cd9ead5d2018-crc-storage\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.228887 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1ced98bb-10b9-46dc-b611-cd9ead5d2018-node-mnt\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.229312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1ced98bb-10b9-46dc-b611-cd9ead5d2018-node-mnt\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.229980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1ced98bb-10b9-46dc-b611-cd9ead5d2018-crc-storage\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.252708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j26xz\" (UniqueName: \"kubernetes.io/projected/1ced98bb-10b9-46dc-b611-cd9ead5d2018-kube-api-access-j26xz\") pod \"crc-storage-crc-llx8x\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.284461 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e8e2741-0ab6-431d-bf5e-799e21aa90bd" path="/var/lib/kubelet/pods/9e8e2741-0ab6-431d-bf5e-799e21aa90bd/volumes" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.393253 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:41 crc kubenswrapper[4769]: I1121 12:08:41.839028 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-llx8x"] Nov 21 12:08:42 crc kubenswrapper[4769]: I1121 12:08:42.378628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-llx8x" event={"ID":"1ced98bb-10b9-46dc-b611-cd9ead5d2018","Type":"ContainerStarted","Data":"425567a18ac28b18a6b27161b2b2633b20704db0d26be12018458c57816c6cd9"} Nov 21 12:08:44 crc kubenswrapper[4769]: I1121 12:08:44.404580 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ced98bb-10b9-46dc-b611-cd9ead5d2018" containerID="90ffa51c15db3acc914d73fb4054a7679c5162bf625f365b2265997eebe2e976" exitCode=0 Nov 21 12:08:44 crc kubenswrapper[4769]: I1121 12:08:44.405470 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-llx8x" event={"ID":"1ced98bb-10b9-46dc-b611-cd9ead5d2018","Type":"ContainerDied","Data":"90ffa51c15db3acc914d73fb4054a7679c5162bf625f365b2265997eebe2e976"} Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.764105 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.902859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1ced98bb-10b9-46dc-b611-cd9ead5d2018-node-mnt\") pod \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.902925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j26xz\" (UniqueName: \"kubernetes.io/projected/1ced98bb-10b9-46dc-b611-cd9ead5d2018-kube-api-access-j26xz\") pod \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.903080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1ced98bb-10b9-46dc-b611-cd9ead5d2018-crc-storage\") pod \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\" (UID: \"1ced98bb-10b9-46dc-b611-cd9ead5d2018\") " Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.903061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1ced98bb-10b9-46dc-b611-cd9ead5d2018-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "1ced98bb-10b9-46dc-b611-cd9ead5d2018" (UID: "1ced98bb-10b9-46dc-b611-cd9ead5d2018"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.903495 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1ced98bb-10b9-46dc-b611-cd9ead5d2018-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.913516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ced98bb-10b9-46dc-b611-cd9ead5d2018-kube-api-access-j26xz" (OuterVolumeSpecName: "kube-api-access-j26xz") pod "1ced98bb-10b9-46dc-b611-cd9ead5d2018" (UID: "1ced98bb-10b9-46dc-b611-cd9ead5d2018"). InnerVolumeSpecName "kube-api-access-j26xz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:08:45 crc kubenswrapper[4769]: I1121 12:08:45.932140 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ced98bb-10b9-46dc-b611-cd9ead5d2018-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "1ced98bb-10b9-46dc-b611-cd9ead5d2018" (UID: "1ced98bb-10b9-46dc-b611-cd9ead5d2018"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:08:46 crc kubenswrapper[4769]: I1121 12:08:46.005532 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1ced98bb-10b9-46dc-b611-cd9ead5d2018-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:08:46 crc kubenswrapper[4769]: I1121 12:08:46.005583 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j26xz\" (UniqueName: \"kubernetes.io/projected/1ced98bb-10b9-46dc-b611-cd9ead5d2018-kube-api-access-j26xz\") on node \"crc\" DevicePath \"\"" Nov 21 12:08:46 crc kubenswrapper[4769]: I1121 12:08:46.429432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-llx8x" event={"ID":"1ced98bb-10b9-46dc-b611-cd9ead5d2018","Type":"ContainerDied","Data":"425567a18ac28b18a6b27161b2b2633b20704db0d26be12018458c57816c6cd9"} Nov 21 12:08:46 crc kubenswrapper[4769]: I1121 12:08:46.429508 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="425567a18ac28b18a6b27161b2b2633b20704db0d26be12018458c57816c6cd9" Nov 21 12:08:46 crc kubenswrapper[4769]: I1121 12:08:46.429550 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-llx8x" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.110509 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh"] Nov 21 12:08:50 crc kubenswrapper[4769]: E1121 12:08:50.111290 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ced98bb-10b9-46dc-b611-cd9ead5d2018" containerName="storage" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.111306 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ced98bb-10b9-46dc-b611-cd9ead5d2018" containerName="storage" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.111544 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ced98bb-10b9-46dc-b611-cd9ead5d2018" containerName="storage" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.112357 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.114884 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dnsmasq-dnsmasq-dockercfg-44f97" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.118764 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openshift-service-ca.crt" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.119060 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dnsmasq" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.119238 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"kube-root-ca.crt" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.133602 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh"] Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.171574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84c7d\" (UniqueName: \"kubernetes.io/projected/2e2e0cc8-277e-4a52-842e-e1c8067821e8-kube-api-access-84c7d\") pod \"dnsmasq-dnsmasq-f5849d7b9-vscvh\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.171741 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e2e0cc8-277e-4a52-842e-e1c8067821e8-config\") pod \"dnsmasq-dnsmasq-f5849d7b9-vscvh\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.241694 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h"] Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.242994 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.245753 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dnsmasq-svc" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.254995 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h"] Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.273105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-84c7d\" (UniqueName: \"kubernetes.io/projected/2e2e0cc8-277e-4a52-842e-e1c8067821e8-kube-api-access-84c7d\") pod \"dnsmasq-dnsmasq-f5849d7b9-vscvh\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.273213 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e2e0cc8-277e-4a52-842e-e1c8067821e8-config\") pod \"dnsmasq-dnsmasq-f5849d7b9-vscvh\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.274088 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e2e0cc8-277e-4a52-842e-e1c8067821e8-config\") pod \"dnsmasq-dnsmasq-f5849d7b9-vscvh\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.296848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-84c7d\" (UniqueName: \"kubernetes.io/projected/2e2e0cc8-277e-4a52-842e-e1c8067821e8-kube-api-access-84c7d\") pod \"dnsmasq-dnsmasq-f5849d7b9-vscvh\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.375200 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldh8g\" (UniqueName: \"kubernetes.io/projected/c1fa6f07-b51c-43ba-8737-db22b3df730c-kube-api-access-ldh8g\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.375776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.375819 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.430629 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.478342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ldh8g\" (UniqueName: \"kubernetes.io/projected/c1fa6f07-b51c-43ba-8737-db22b3df730c-kube-api-access-ldh8g\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.478438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.478492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.479863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.480552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.500918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldh8g\" (UniqueName: \"kubernetes.io/projected/c1fa6f07-b51c-43ba-8737-db22b3df730c-kube-api-access-ldh8g\") pod \"dnsmasq-dnsmasq-84b9f45d47-drv8h\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.565123 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.821964 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h"] Nov 21 12:08:50 crc kubenswrapper[4769]: I1121 12:08:50.959442 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh"] Nov 21 12:08:51 crc kubenswrapper[4769]: I1121 12:08:51.473969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" event={"ID":"2e2e0cc8-277e-4a52-842e-e1c8067821e8","Type":"ContainerStarted","Data":"bf63518712ce5e8fe964eb45a47cae7764a150ab60b7c6568374de530a0f9c6f"} Nov 21 12:08:51 crc kubenswrapper[4769]: I1121 12:08:51.476176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" event={"ID":"c1fa6f07-b51c-43ba-8737-db22b3df730c","Type":"ContainerStarted","Data":"b4dd6d02a248707edab087316114144662d26fe37396a4f5647fc5aa243645bc"} Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.802002 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.803976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.807120 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.807501 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.807784 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.808035 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.808557 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-kgsfc" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.808809 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.810034 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.825133 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tjr4\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-kube-api-access-6tjr4\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07035577-c371-41ab-b492-4d943dace285-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07035577-c371-41ab-b492-4d943dace285-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983942 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:00 crc kubenswrapper[4769]: I1121 12:09:00.983973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.073705 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.075075 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.077665 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.077739 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-qvb6l" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.078673 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.078917 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.079091 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.079775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.081366 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.085902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07035577-c371-41ab-b492-4d943dace285-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.085952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.085993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07035577-c371-41ab-b492-4d943dace285-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6tjr4\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-kube-api-access-6tjr4\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.086843 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.087330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.087344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.087629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.087689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.088483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.093099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07035577-c371-41ab-b492-4d943dace285-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.111419 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.114850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.114891 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07035577-c371-41ab-b492-4d943dace285-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.117442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tjr4\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-kube-api-access-6tjr4\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.127228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.150874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.188921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.189077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.189132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.189226 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7mtg\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-kube-api-access-j7mtg\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j7mtg\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-kube-api-access-j7mtg\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290325 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.290478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.291676 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.294451 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.294751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.294845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.295102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.295119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.297376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-server-conf\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.298423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-pod-info\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.299223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.303333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.315966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7mtg\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-kube-api-access-j7mtg\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.336557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-server-0\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.439061 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:09:01 crc kubenswrapper[4769]: I1121 12:09:01.487684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.372496 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.374567 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.376960 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.379302 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.379573 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.379924 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-jlgq8" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.410275 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.412086 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-default\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-kolla-config\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsfpn\" (UniqueName: \"kubernetes.io/projected/4b6385ef-77f7-4187-abae-725f7c9c6090-kube-api-access-nsfpn\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.513983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-default\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-kolla-config\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nsfpn\" (UniqueName: \"kubernetes.io/projected/4b6385ef-77f7-4187-abae-725f7c9c6090-kube-api-access-nsfpn\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.615523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.616173 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.616750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-kolla-config\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.616761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.617664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-default\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.619102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.626481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.627062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.645831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.657332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsfpn\" (UniqueName: \"kubernetes.io/projected/4b6385ef-77f7-4187-abae-725f7c9c6090-kube-api-access-nsfpn\") pod \"openstack-galera-0\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:02 crc kubenswrapper[4769]: I1121 12:09:02.729268 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.758749 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.761807 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.766687 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.766857 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.767047 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.770306 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-vgg9p" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.776388 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837184 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjb4\" (UniqueName: \"kubernetes.io/projected/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kube-api-access-dxjb4\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.837812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.938893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.938948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.938992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.939020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.939056 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.939078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.939097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.939114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjb4\" (UniqueName: \"kubernetes.io/projected/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kube-api-access-dxjb4\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:03 crc kubenswrapper[4769]: I1121 12:09:03.939578 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.096850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.098206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.102785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.103414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.103651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.104022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.104131 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.104506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjb4\" (UniqueName: \"kubernetes.io/projected/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kube-api-access-dxjb4\") pod \"openstack-cell1-galera-0\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.202156 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.203346 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.206160 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.206705 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.207853 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-jhqjp" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.218922 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.246391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-kolla-config\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.246921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-memcached-tls-certs\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.247105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-combined-ca-bundle\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.247260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzqxd\" (UniqueName: \"kubernetes.io/projected/4be7b12a-19d5-476f-b806-41eb24d461ac-kube-api-access-vzqxd\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.247373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-config-data\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.349626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-combined-ca-bundle\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.349700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vzqxd\" (UniqueName: \"kubernetes.io/projected/4be7b12a-19d5-476f-b806-41eb24d461ac-kube-api-access-vzqxd\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.349728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-config-data\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.349795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-kolla-config\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.349952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-memcached-tls-certs\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.379538 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.622597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-kolla-config\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.623300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-config-data\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.629062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-memcached-tls-certs\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.631750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-combined-ca-bundle\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.631764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzqxd\" (UniqueName: \"kubernetes.io/projected/4be7b12a-19d5-476f-b806-41eb24d461ac-kube-api-access-vzqxd\") pod \"memcached-0\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:04 crc kubenswrapper[4769]: I1121 12:09:04.922984 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.699627 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.700783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.703144 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-v5rfm" Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.712506 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.776655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qt5m\" (UniqueName: \"kubernetes.io/projected/fddc5cda-eae9-43a0-afd5-c99a76904b8e-kube-api-access-2qt5m\") pod \"kube-state-metrics-0\" (UID: \"fddc5cda-eae9-43a0-afd5-c99a76904b8e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.878320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt5m\" (UniqueName: \"kubernetes.io/projected/fddc5cda-eae9-43a0-afd5-c99a76904b8e-kube-api-access-2qt5m\") pod \"kube-state-metrics-0\" (UID: \"fddc5cda-eae9-43a0-afd5-c99a76904b8e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:09:05 crc kubenswrapper[4769]: I1121 12:09:05.897025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qt5m\" (UniqueName: \"kubernetes.io/projected/fddc5cda-eae9-43a0-afd5-c99a76904b8e-kube-api-access-2qt5m\") pod \"kube-state-metrics-0\" (UID: \"fddc5cda-eae9-43a0-afd5-c99a76904b8e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:09:06 crc kubenswrapper[4769]: I1121 12:09:06.029392 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.646526 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.649028 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.652027 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.652607 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.652938 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.653118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-c7nqh" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.653316 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.667476 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.731119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.731602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-config\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.731784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.731934 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k88j\" (UniqueName: \"kubernetes.io/projected/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-kube-api-access-9k88j\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.732091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.732290 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.732352 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.732560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.834318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.834790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.835074 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.835371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.835640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-config\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.835148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.835862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.836049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9k88j\" (UniqueName: \"kubernetes.io/projected/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-kube-api-access-9k88j\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.836237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.836982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.837108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-config\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.837308 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.841023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.841475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.856223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.856757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k88j\" (UniqueName: \"kubernetes.io/projected/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-kube-api-access-9k88j\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.878240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"ovsdbserver-nb-0\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:08 crc kubenswrapper[4769]: I1121 12:09:08.985624 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.238798 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.242313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.245181 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.245623 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.246044 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.246243 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-thfhf" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.258094 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.298931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.298995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.299037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.299109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.299164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.299233 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs6qp\" (UniqueName: \"kubernetes.io/projected/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-kube-api-access-vs6qp\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.299265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-config\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.299327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.401458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.401631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.401873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vs6qp\" (UniqueName: \"kubernetes.io/projected/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-kube-api-access-vs6qp\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.402650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-config\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.402717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.402769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.402797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.402838 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.403151 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.404170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-config\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.404218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.404447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.409314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.410806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.411068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.424271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs6qp\" (UniqueName: \"kubernetes.io/projected/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-kube-api-access-vs6qp\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.428450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:12 crc kubenswrapper[4769]: I1121 12:09:12.578541 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.244098 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified" Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.244784 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:init,Image:quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries --test],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n56bh585hb8hf5h5f4h7fh658hc6h549h8fh595h58bh4h5d6h66ch544h5c6hdh586h7dh59hb7h67h675h648h547h557h576h59bh5bdh5c4h5cbq,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dnsmasq,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-84c7d,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dnsmasq-f5849d7b9-vscvh_openstack-kuttl-tests(2e2e0cc8-277e-4a52-842e-e1c8067821e8): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.247416 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.728579 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified\\\"\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" Nov 21 12:09:20 crc kubenswrapper[4769]: I1121 12:09:20.788690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:09:20 crc kubenswrapper[4769]: I1121 12:09:20.799346 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.817970 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified" Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.818663 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:init,Image:quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries --test],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n689h697h5cbh9dh679h79hc8hb8h688h68h54fh5cbh88h67dh565h5cfh5ddh688h677h68ch64h67ch566h79h5h5b9h58h59ch568h68fh596h65dq,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dnsmasq,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dnsmasq-svc,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dnsmasq-svc,SubPath:dnsmasq-svc,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-ldh8g,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dnsmasq-84b9f45d47-drv8h_openstack-kuttl-tests(c1fa6f07-b51c-43ba-8737-db22b3df730c): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:09:20 crc kubenswrapper[4769]: E1121 12:09:20.820399 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:20.999986 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:09:21 crc kubenswrapper[4769]: W1121 12:09:21.043797 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfddc5cda_eae9_43a0_afd5_c99a76904b8e.slice/crio-e61299b4f2dd1114372611de8130a83f37de47fda5490020219d47bea3f74a0e WatchSource:0}: Error finding container e61299b4f2dd1114372611de8130a83f37de47fda5490020219d47bea3f74a0e: Status 404 returned error can't find the container with id e61299b4f2dd1114372611de8130a83f37de47fda5490020219d47bea3f74a0e Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.053213 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.093153 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.119674 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.131319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.137572 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.749570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5","Type":"ContainerStarted","Data":"4b4cc736cd67fe5141d34a0ee0178a181e2fe01b4c0ea154809c3a1679486d63"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.752872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"b249afc8-1e7a-4537-8778-fc1e56c2afdc","Type":"ContainerStarted","Data":"422333d39139dcf503dad953d5de00e9bb2cc3af39db6805ad1d6cbcde877b97"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.755713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b6385ef-77f7-4187-abae-725f7c9c6090","Type":"ContainerStarted","Data":"8ea67472f31c4ec099e9f3ca549349f971f8b8b76f1226b261650e546f20f82b"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.758709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"fddc5cda-eae9-43a0-afd5-c99a76904b8e","Type":"ContainerStarted","Data":"e61299b4f2dd1114372611de8130a83f37de47fda5490020219d47bea3f74a0e"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.762790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1bfd0ec1-9312-4ce3-8b5f-8a9340736062","Type":"ContainerStarted","Data":"0448cbe8b636819c8fb8e88138eb2dc38f1b8a814a957c64aece2f9f257c3d71"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.777755 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"4be7b12a-19d5-476f-b806-41eb24d461ac","Type":"ContainerStarted","Data":"769b9e9be241238dbcb10c0be85b55830fbd7cab94b99ee75afd45a2598e4eb0"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.782046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9d9e9e8e-52d3-4601-be5f-84b9ac61697b","Type":"ContainerStarted","Data":"f2626eb6d6cad5639a5f8b36ebe7ee35eefc975c370b189f10971b870e42e5ea"} Nov 21 12:09:21 crc kubenswrapper[4769]: I1121 12:09:21.789472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"07035577-c371-41ab-b492-4d943dace285","Type":"ContainerStarted","Data":"da55c8c54ea4527fb96051b38bca5b7a8a3141916752d432e4b51439e0e3936e"} Nov 21 12:09:21 crc kubenswrapper[4769]: E1121 12:09:21.791861 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified\\\"\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" Nov 21 12:09:34 crc kubenswrapper[4769]: E1121 12:09:34.012175 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015" Nov 21 12:09:34 crc kubenswrapper[4769]: E1121 12:09:34.013158 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:memcached,Image:quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015,Command:[/usr/bin/dumb-init -- /usr/local/bin/kolla_start],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:memcached,HostPort:0,ContainerPort:11211,Protocol:TCP,HostIP:,},ContainerPort{Name:memcached-tls,HostPort:0,ContainerPort:11212,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},EnvVar{Name:POD_IPS,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIPs,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:CONFIG_HASH,Value:n679h56chfbhdbh89h75hfh588h54bh58fh6ch565h5cfh699hcfhcch96h74h76h5dbh555h5cdh66ch655h98h59dh559hcch5d4h644h544h7bq,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/src,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kolla-config,ReadOnly:true,MountPath:/var/lib/kolla/config_files,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:memcached-tls-certs,ReadOnly:true,MountPath:/var/lib/config-data/tls/certs/memcached.crt,SubPath:tls.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:memcached-tls-certs,ReadOnly:true,MountPath:/var/lib/config-data/tls/private/memcached.key,SubPath:tls.key,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-vzqxd,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 11211 },Host:,},GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 11211 },Host:,},GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42457,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:*42457,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod memcached-0_openstack-kuttl-tests(4be7b12a-19d5-476f-b806-41eb24d461ac): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:09:34 crc kubenswrapper[4769]: E1121 12:09:34.014345 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"memcached\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/memcached-0" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" Nov 21 12:09:34 crc kubenswrapper[4769]: E1121 12:09:34.245736 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"memcached\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015\\\"\"" pod="openstack-kuttl-tests/memcached-0" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" Nov 21 12:09:39 crc kubenswrapper[4769]: E1121 12:09:39.098749 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90" Nov 21 12:09:39 crc kubenswrapper[4769]: E1121 12:09:39.099744 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:setup-container,Image:quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90,Command:[sh -c cp /tmp/erlang-cookie-secret/.erlang.cookie /var/lib/rabbitmq/.erlang.cookie && chmod 600 /var/lib/rabbitmq/.erlang.cookie ; cp /tmp/rabbitmq-plugins/enabled_plugins /operator/enabled_plugins ; echo '[default]' > /var/lib/rabbitmq/.rabbitmqadmin.conf && sed -e 's/default_user/username/' -e 's/default_pass/password/' /tmp/default_user.conf >> /var/lib/rabbitmq/.rabbitmqadmin.conf && chmod 600 /var/lib/rabbitmq/.rabbitmqadmin.conf ; sleep 30],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{67108864 0} {} BinarySI},},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:plugins-conf,ReadOnly:false,MountPath:/tmp/rabbitmq-plugins/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-erlang-cookie,ReadOnly:false,MountPath:/var/lib/rabbitmq/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:erlang-cookie-secret,ReadOnly:false,MountPath:/tmp/erlang-cookie-secret/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-plugins,ReadOnly:false,MountPath:/operator,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:persistence,ReadOnly:false,MountPath:/var/lib/rabbitmq/mnesia/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-confd,ReadOnly:false,MountPath:/tmp/default_user.conf,SubPath:default_user.conf,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-j7mtg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod rabbitmq-server-0_openstack-kuttl-tests(4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:09:39 crc kubenswrapper[4769]: E1121 12:09:39.101549 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup-container\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" Nov 21 12:09:39 crc kubenswrapper[4769]: E1121 12:09:39.304569 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup-container\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90\\\"\"" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" Nov 21 12:09:49 crc kubenswrapper[4769]: E1121 12:09:49.361652 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90" Nov 21 12:09:49 crc kubenswrapper[4769]: E1121 12:09:49.362560 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:setup-container,Image:quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90,Command:[sh -c cp /tmp/erlang-cookie-secret/.erlang.cookie /var/lib/rabbitmq/.erlang.cookie && chmod 600 /var/lib/rabbitmq/.erlang.cookie ; cp /tmp/rabbitmq-plugins/enabled_plugins /operator/enabled_plugins ; echo '[default]' > /var/lib/rabbitmq/.rabbitmqadmin.conf && sed -e 's/default_user/username/' -e 's/default_pass/password/' /tmp/default_user.conf >> /var/lib/rabbitmq/.rabbitmqadmin.conf && chmod 600 /var/lib/rabbitmq/.rabbitmqadmin.conf ; sleep 30],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{67108864 0} {} BinarySI},},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:plugins-conf,ReadOnly:false,MountPath:/tmp/rabbitmq-plugins/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-erlang-cookie,ReadOnly:false,MountPath:/var/lib/rabbitmq/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:erlang-cookie-secret,ReadOnly:false,MountPath:/tmp/erlang-cookie-secret/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-plugins,ReadOnly:false,MountPath:/operator,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:persistence,ReadOnly:false,MountPath:/var/lib/rabbitmq/mnesia/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-confd,ReadOnly:false,MountPath:/tmp/default_user.conf,SubPath:default_user.conf,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-6tjr4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod rabbitmq-cell1-server-0_openstack-kuttl-tests(07035577-c371-41ab-b492-4d943dace285): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:09:49 crc kubenswrapper[4769]: E1121 12:09:49.363771 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup-container\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="07035577-c371-41ab-b492-4d943dace285" Nov 21 12:09:49 crc kubenswrapper[4769]: E1121 12:09:49.393257 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup-container\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90\\\"\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="07035577-c371-41ab-b492-4d943dace285" Nov 21 12:10:00 crc kubenswrapper[4769]: E1121 12:10:00.047796 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a" Nov 21 12:10:00 crc kubenswrapper[4769]: E1121 12:10:00.048602 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:mysql-bootstrap,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a,Command:[bash /var/lib/operator-scripts/mysql_bootstrap.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:True,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:mysql-db,ReadOnly:false,MountPath:/var/lib/mysql,SubPath:mysql,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data-default,ReadOnly:true,MountPath:/var/lib/config-data/default,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data-generated,ReadOnly:false,MountPath:/var/lib/config-data/generated,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:operator-scripts,ReadOnly:true,MountPath:/var/lib/operator-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kolla-config,ReadOnly:true,MountPath:/var/lib/kolla/config_files,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-nsfpn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod openstack-galera-0_openstack-kuttl-tests(4b6385ef-77f7-4187-abae-725f7c9c6090): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:00 crc kubenswrapper[4769]: E1121 12:10:00.050332 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql-bootstrap\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/openstack-galera-0" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" Nov 21 12:10:00 crc kubenswrapper[4769]: E1121 12:10:00.498221 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql-bootstrap\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a\\\"\"" pod="openstack-kuttl-tests/openstack-galera-0" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" Nov 21 12:10:02 crc kubenswrapper[4769]: E1121 12:10:02.440134 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a" Nov 21 12:10:02 crc kubenswrapper[4769]: E1121 12:10:02.440848 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:mysql-bootstrap,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a,Command:[bash /var/lib/operator-scripts/mysql_bootstrap.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:True,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:mysql-db,ReadOnly:false,MountPath:/var/lib/mysql,SubPath:mysql,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data-default,ReadOnly:true,MountPath:/var/lib/config-data/default,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data-generated,ReadOnly:false,MountPath:/var/lib/config-data/generated,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:operator-scripts,ReadOnly:true,MountPath:/var/lib/operator-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kolla-config,ReadOnly:true,MountPath:/var/lib/kolla/config_files,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dxjb4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod openstack-cell1-galera-0_openstack-kuttl-tests(b249afc8-1e7a-4537-8778-fc1e56c2afdc): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:02 crc kubenswrapper[4769]: E1121 12:10:02.442085 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql-bootstrap\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" Nov 21 12:10:02 crc kubenswrapper[4769]: E1121 12:10:02.517877 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql-bootstrap\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-mariadb@sha256:3db27fbfc3fabe2f62c68ab1b9f24383a73554f2d6d1f178147088832619013a\\\"\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" Nov 21 12:10:09 crc kubenswrapper[4769]: E1121 12:10:09.782973 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-ovn-sb-db-server@sha256:e2de6853508fca6f1e6442757834a66baec36a9cf5f92450dd293fb507aef0c5" Nov 21 12:10:09 crc kubenswrapper[4769]: E1121 12:10:09.783793 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:ovsdbserver-sb,Image:quay.io/podified-antelope-centos9/openstack-ovn-sb-db-server@sha256:e2de6853508fca6f1e6442757834a66baec36a9cf5f92450dd293fb507aef0c5,Command:[/usr/bin/dumb-init],Args:[/usr/local/bin/container-scripts/setup.sh],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:nbfhc8h659h659h79h594h674h5bbh578h54bh658h5d7h689h58dh67dhdbh77hb8h5ffh645h68dhb5h84h5ffhb9h7ch66fh55fh5f5h64dh9bh67fq,ValueFrom:nil,},EnvVar{Name:OVN_LOGDIR,Value:/tmp,ValueFrom:nil,},EnvVar{Name:OVN_RUNDIR,Value:/tmp,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/usr/local/bin/container-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovndbcluster-sb-etc-ovn,ReadOnly:false,MountPath:/etc/ovn,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdb-rundir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-sb-tls-certs,ReadOnly:true,MountPath:/etc/pki/tls/certs/ovndb.crt,SubPath:tls.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-sb-tls-certs,ReadOnly:true,MountPath:/etc/pki/tls/private/ovndb.key,SubPath:tls.key,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-sb-tls-certs,ReadOnly:true,MountPath:/etc/pki/tls/certs/ovndbca.crt,SubPath:ca.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-vs6qp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/pidof ovsdb-server],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/pidof ovsdb-server],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:&Lifecycle{PostStart:nil,PreStop:&LifecycleHandler{Exec:&ExecAction{Command:[/usr/local/bin/container-scripts/cleanup.sh],},HTTPGet:nil,TCPSocket:nil,Sleep:nil,},},TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/pidof ovsdb-server],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:20,TerminationGracePeriodSeconds:nil,},ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovsdbserver-sb-0_openstack-kuttl-tests(9d9e9e8e-52d3-4601-be5f-84b9ac61697b): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:11 crc kubenswrapper[4769]: E1121 12:10:11.011912 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015" Nov 21 12:10:11 crc kubenswrapper[4769]: E1121 12:10:11.012121 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:memcached,Image:quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015,Command:[/usr/bin/dumb-init -- /usr/local/bin/kolla_start],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:memcached,HostPort:0,ContainerPort:11211,Protocol:TCP,HostIP:,},ContainerPort{Name:memcached-tls,HostPort:0,ContainerPort:11212,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},EnvVar{Name:POD_IPS,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIPs,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:CONFIG_HASH,Value:n679h56chfbhdbh89h75hfh588h54bh58fh6ch565h5cfh699hcfhcch96h74h76h5dbh555h5cdh66ch655h98h59dh559hcch5d4h644h544h7bq,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/src,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kolla-config,ReadOnly:true,MountPath:/var/lib/kolla/config_files,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:memcached-tls-certs,ReadOnly:true,MountPath:/var/lib/config-data/tls/certs/memcached.crt,SubPath:tls.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:memcached-tls-certs,ReadOnly:true,MountPath:/var/lib/config-data/tls/private/memcached.key,SubPath:tls.key,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-vzqxd,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 11211 },Host:,},GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 11211 },Host:,},GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42457,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:*42457,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod memcached-0_openstack-kuttl-tests(4be7b12a-19d5-476f-b806-41eb24d461ac): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:11 crc kubenswrapper[4769]: E1121 12:10:11.013321 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"memcached\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/memcached-0" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" Nov 21 12:10:11 crc kubenswrapper[4769]: I1121 12:10:11.325791 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:10:11 crc kubenswrapper[4769]: I1121 12:10:11.325855 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:10:14 crc kubenswrapper[4769]: E1121 12:10:14.530816 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-ovn-nb-db-server@sha256:df1a26ffbe6152e142cfeed2500ca85782319d0cb4ec058b5b4e2f3145492e77" Nov 21 12:10:14 crc kubenswrapper[4769]: E1121 12:10:14.532124 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:ovsdbserver-nb,Image:quay.io/podified-antelope-centos9/openstack-ovn-nb-db-server@sha256:df1a26ffbe6152e142cfeed2500ca85782319d0cb4ec058b5b4e2f3145492e77,Command:[/usr/bin/dumb-init],Args:[/usr/local/bin/container-scripts/setup.sh],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n664h69h59bh64h5c9h644h677h5b9hf8h68bh5f4h596h5dh667h9dh547h96h557h5f4h689h58hc6h675h8h668hcchd5h584hd9h68bh7ch64q,ValueFrom:nil,},EnvVar{Name:OVN_LOGDIR,Value:/tmp,ValueFrom:nil,},EnvVar{Name:OVN_RUNDIR,Value:/tmp,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/usr/local/bin/container-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovndbcluster-nb-etc-ovn,ReadOnly:false,MountPath:/etc/ovn,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdb-rundir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-nb-tls-certs,ReadOnly:true,MountPath:/etc/pki/tls/certs/ovndb.crt,SubPath:tls.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-nb-tls-certs,ReadOnly:true,MountPath:/etc/pki/tls/private/ovndb.key,SubPath:tls.key,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-nb-tls-certs,ReadOnly:true,MountPath:/etc/pki/tls/certs/ovndbca.crt,SubPath:ca.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-9k88j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/pidof ovsdb-server],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/pidof ovsdb-server],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:&Lifecycle{PostStart:nil,PreStop:&LifecycleHandler{Exec:&ExecAction{Command:[/usr/local/bin/container-scripts/cleanup.sh],},HTTPGet:nil,TCPSocket:nil,Sleep:nil,},},TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/pidof ovsdb-server],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:20,TerminationGracePeriodSeconds:nil,},ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovsdbserver-nb-0_openstack-kuttl-tests(1bfd0ec1-9312-4ce3-8b5f-8a9340736062): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.305909 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.306120 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:setup-container,Image:quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90,Command:[sh -c cp /tmp/erlang-cookie-secret/.erlang.cookie /var/lib/rabbitmq/.erlang.cookie && chmod 600 /var/lib/rabbitmq/.erlang.cookie ; cp /tmp/rabbitmq-plugins/enabled_plugins /operator/enabled_plugins ; echo '[default]' > /var/lib/rabbitmq/.rabbitmqadmin.conf && sed -e 's/default_user/username/' -e 's/default_pass/password/' /tmp/default_user.conf >> /var/lib/rabbitmq/.rabbitmqadmin.conf && chmod 600 /var/lib/rabbitmq/.rabbitmqadmin.conf ; sleep 30],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{67108864 0} {} BinarySI},},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:plugins-conf,ReadOnly:false,MountPath:/tmp/rabbitmq-plugins/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-erlang-cookie,ReadOnly:false,MountPath:/var/lib/rabbitmq/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:erlang-cookie-secret,ReadOnly:false,MountPath:/tmp/erlang-cookie-secret/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-plugins,ReadOnly:false,MountPath:/operator,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:persistence,ReadOnly:false,MountPath:/var/lib/rabbitmq/mnesia/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:rabbitmq-confd,ReadOnly:false,MountPath:/tmp/default_user.conf,SubPath:default_user.conf,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-j7mtg,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod rabbitmq-server-0_openstack-kuttl-tests(4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.307107 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.307297 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:init,Image:quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries --test],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n689h697h5cbh9dh679h79hc8hb8h688h68h54fh5cbh88h67dh565h5cfh5ddh688h677h68ch64h67ch566h79h5h5b9h58h59ch568h68fh596h65dq,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dnsmasq,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dnsmasq-svc,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dnsmasq-svc,SubPath:dnsmasq-svc,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-ldh8g,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dnsmasq-84b9f45d47-drv8h_openstack-kuttl-tests(c1fa6f07-b51c-43ba-8737-db22b3df730c): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.307343 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup-container\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.308130 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.308298 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:init,Image:quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries --test],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n56bh585hb8hf5h5f4h7fh658hc6h549h8fh595h58bh4h5d6h66ch544h5c6hdh586h7dh59hb7h67h675h648h547h557h576h59bh5bdh5c4h5cbq,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dnsmasq,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-84c7d,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dnsmasq-f5849d7b9-vscvh_openstack-kuttl-tests(2e2e0cc8-277e-4a52-842e-e1c8067821e8): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.308368 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" Nov 21 12:10:15 crc kubenswrapper[4769]: E1121 12:10:15.310335 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" Nov 21 12:10:23 crc kubenswrapper[4769]: E1121 12:10:23.303247 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.k8s.io/kube-state-metrics/kube-state-metrics@sha256:db384bf43222b066c378e77027a675d4cd9911107adba46c2922b3a55e10d6fb" Nov 21 12:10:23 crc kubenswrapper[4769]: E1121 12:10:23.303921 4769 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" image="registry.k8s.io/kube-state-metrics/kube-state-metrics@sha256:db384bf43222b066c378e77027a675d4cd9911107adba46c2922b3a55e10d6fb" Nov 21 12:10:23 crc kubenswrapper[4769]: E1121 12:10:23.304124 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:kube-state-metrics,Image:registry.k8s.io/kube-state-metrics/kube-state-metrics@sha256:db384bf43222b066c378e77027a675d4cd9911107adba46c2922b3a55e10d6fb,Command:[],Args:[--resources=pods --namespaces=openstack-kuttl-tests],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:http-metrics,HostPort:0,ContainerPort:8080,Protocol:TCP,HostIP:,},ContainerPort{Name:telemetry,HostPort:0,ContainerPort:8081,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-2qt5m,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{0 8080 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000680000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-state-metrics-0_openstack-kuttl-tests(fddc5cda-eae9-43a0-afd5-c99a76904b8e): ErrImagePull: rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled" logger="UnhandledError" Nov 21 12:10:23 crc kubenswrapper[4769]: E1121 12:10:23.305411 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-state-metrics\" with ErrImagePull: \"rpc error: code = Canceled desc = copying system image from manifest list: copying config: context canceled\"" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" Nov 21 12:10:29 crc kubenswrapper[4769]: E1121 12:10:29.139931 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"memcached\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-memcached@sha256:0b7651290cfea3b21b9232a1343849a0fbfe605e1aa85e22c5090a38139d6015\\\"\"" pod="openstack-kuttl-tests/memcached-0" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" Nov 21 12:10:29 crc kubenswrapper[4769]: E1121 12:10:29.168213 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"setup-container\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-rabbitmq@sha256:8f8ade19bc904e0b06eaa2d55539cdebb1df40512845962a7aa672223332df90\\\"\"" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" Nov 21 12:10:29 crc kubenswrapper[4769]: E1121 12:10:29.168932 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-state-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.k8s.io/kube-state-metrics/kube-state-metrics@sha256:db384bf43222b066c378e77027a675d4cd9911107adba46c2922b3a55e10d6fb\\\"\"" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" Nov 21 12:10:29 crc kubenswrapper[4769]: E1121 12:10:29.275426 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified\\\"\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" Nov 21 12:10:29 crc kubenswrapper[4769]: E1121 12:10:29.276072 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-neutron-server:current-podified\\\"\"" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" Nov 21 12:10:31 crc kubenswrapper[4769]: I1121 12:10:31.747723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"b249afc8-1e7a-4537-8778-fc1e56c2afdc","Type":"ContainerStarted","Data":"35b6ccfcae71cb4eee7522a0e3f906a1f43378dd3da429331d001e8b00a66449"} Nov 21 12:10:31 crc kubenswrapper[4769]: I1121 12:10:31.751530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b6385ef-77f7-4187-abae-725f7c9c6090","Type":"ContainerStarted","Data":"c342ef116883b40c3ca2418b93d8035e76c5ff1be5f248e21e62dc3188d5fcae"} Nov 21 12:10:32 crc kubenswrapper[4769]: I1121 12:10:32.765514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"07035577-c371-41ab-b492-4d943dace285","Type":"ContainerStarted","Data":"13b30d5ba32fd94fb4b51fd7cfa042d53251f175f92af53d61a459939b13989d"} Nov 21 12:10:33 crc kubenswrapper[4769]: E1121 12:10:33.081252 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ovsdbserver-nb\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" Nov 21 12:10:33 crc kubenswrapper[4769]: E1121 12:10:33.086853 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"ovsdbserver-sb\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" Nov 21 12:10:33 crc kubenswrapper[4769]: I1121 12:10:33.776144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9d9e9e8e-52d3-4601-be5f-84b9ac61697b","Type":"ContainerStarted","Data":"90be29082cb701cd689eeebe3c521f1cf3d923eb3e6440edd4fb00553b4da038"} Nov 21 12:10:33 crc kubenswrapper[4769]: I1121 12:10:33.783471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1bfd0ec1-9312-4ce3-8b5f-8a9340736062","Type":"ContainerStarted","Data":"bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91"} Nov 21 12:10:36 crc kubenswrapper[4769]: I1121 12:10:36.814011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1bfd0ec1-9312-4ce3-8b5f-8a9340736062","Type":"ContainerStarted","Data":"302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660"} Nov 21 12:10:36 crc kubenswrapper[4769]: I1121 12:10:36.817004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9d9e9e8e-52d3-4601-be5f-84b9ac61697b","Type":"ContainerStarted","Data":"f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa"} Nov 21 12:10:36 crc kubenswrapper[4769]: I1121 12:10:36.852349 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=14.551501438 podStartE2EDuration="1m29.85232884s" podCreationTimestamp="2025-11-21 12:09:07 +0000 UTC" firstStartedPulling="2025-11-21 12:09:21.121673933 +0000 UTC m=+1119.822335751" lastFinishedPulling="2025-11-21 12:10:36.422501335 +0000 UTC m=+1195.123163153" observedRunningTime="2025-11-21 12:10:36.847136297 +0000 UTC m=+1195.547798135" watchObservedRunningTime="2025-11-21 12:10:36.85232884 +0000 UTC m=+1195.552990668" Nov 21 12:10:36 crc kubenswrapper[4769]: I1121 12:10:36.869608 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=10.458788981 podStartE2EDuration="1m25.869591144s" podCreationTimestamp="2025-11-21 12:09:11 +0000 UTC" firstStartedPulling="2025-11-21 12:09:21.009961104 +0000 UTC m=+1119.710622922" lastFinishedPulling="2025-11-21 12:10:36.420763267 +0000 UTC m=+1195.121425085" observedRunningTime="2025-11-21 12:10:36.867708983 +0000 UTC m=+1195.568370811" watchObservedRunningTime="2025-11-21 12:10:36.869591144 +0000 UTC m=+1195.570252962" Nov 21 12:10:37 crc kubenswrapper[4769]: I1121 12:10:37.578763 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:10:38 crc kubenswrapper[4769]: I1121 12:10:38.986133 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:10:38 crc kubenswrapper[4769]: I1121 12:10:38.986219 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:10:39 crc kubenswrapper[4769]: I1121 12:10:39.578802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:10:39 crc kubenswrapper[4769]: I1121 12:10:39.615529 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.324828 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.325365 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:10:41 crc kubenswrapper[4769]: E1121 12:10:41.381660 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b6385ef_77f7_4187_abae_725f7c9c6090.slice/crio-conmon-c342ef116883b40c3ca2418b93d8035e76c5ff1be5f248e21e62dc3188d5fcae.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1fa6f07_b51c_43ba_8737_db22b3df730c.slice/crio-a2d85cf0d3bbf13a5818655c08bdc2f52d21fa2b08503aa3651bded36e7ed286.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb249afc8_1e7a_4537_8778_fc1e56c2afdc.slice/crio-conmon-35b6ccfcae71cb4eee7522a0e3f906a1f43378dd3da429331d001e8b00a66449.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.865073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"4be7b12a-19d5-476f-b806-41eb24d461ac","Type":"ContainerStarted","Data":"11e4b09a040543deb8702b191dd7655481edc71f1af6c4504a2f4e4b95887c0b"} Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.867259 4769 generic.go:334] "Generic (PLEG): container finished" podID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerID="a2d85cf0d3bbf13a5818655c08bdc2f52d21fa2b08503aa3651bded36e7ed286" exitCode=0 Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.867342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" event={"ID":"c1fa6f07-b51c-43ba-8737-db22b3df730c","Type":"ContainerDied","Data":"a2d85cf0d3bbf13a5818655c08bdc2f52d21fa2b08503aa3651bded36e7ed286"} Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.869131 4769 generic.go:334] "Generic (PLEG): container finished" podID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerID="35b6ccfcae71cb4eee7522a0e3f906a1f43378dd3da429331d001e8b00a66449" exitCode=0 Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.869181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"b249afc8-1e7a-4537-8778-fc1e56c2afdc","Type":"ContainerDied","Data":"35b6ccfcae71cb4eee7522a0e3f906a1f43378dd3da429331d001e8b00a66449"} Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.871227 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerID="c342ef116883b40c3ca2418b93d8035e76c5ff1be5f248e21e62dc3188d5fcae" exitCode=0 Nov 21 12:10:41 crc kubenswrapper[4769]: I1121 12:10:41.871264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b6385ef-77f7-4187-abae-725f7c9c6090","Type":"ContainerDied","Data":"c342ef116883b40c3ca2418b93d8035e76c5ff1be5f248e21e62dc3188d5fcae"} Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.030221 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.078272 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.621562 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.770545 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.772162 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.774138 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.774377 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.775021 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.778864 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-4nw8f" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.783943 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/602f0862-0d09-482c-90ae-750628c4ab13-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-config\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816245 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29grc\" (UniqueName: \"kubernetes.io/projected/602f0862-0d09-482c-90ae-750628c4ab13-kube-api-access-29grc\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-scripts\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.816312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.881609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b6385ef-77f7-4187-abae-725f7c9c6090","Type":"ContainerStarted","Data":"016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f"} Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.883816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" event={"ID":"c1fa6f07-b51c-43ba-8737-db22b3df730c","Type":"ContainerStarted","Data":"c840523455eab51055a4a752bfeeef285916f63bc9aa4082fd4352a476ec7df1"} Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.884114 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.886244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"b249afc8-1e7a-4537-8778-fc1e56c2afdc","Type":"ContainerStarted","Data":"17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9"} Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.908052 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=32.113789578 podStartE2EDuration="1m41.908033929s" podCreationTimestamp="2025-11-21 12:09:01 +0000 UTC" firstStartedPulling="2025-11-21 12:09:20.795868198 +0000 UTC m=+1119.496530026" lastFinishedPulling="2025-11-21 12:10:30.590112529 +0000 UTC m=+1189.290774377" observedRunningTime="2025-11-21 12:10:42.901344439 +0000 UTC m=+1201.602006257" watchObservedRunningTime="2025-11-21 12:10:42.908033929 +0000 UTC m=+1201.608695747" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.917717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.917811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-29grc\" (UniqueName: \"kubernetes.io/projected/602f0862-0d09-482c-90ae-750628c4ab13-kube-api-access-29grc\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.917883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-scripts\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.917915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.918600 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/602f0862-0d09-482c-90ae-750628c4ab13-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.918658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-config\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.918675 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.919206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/602f0862-0d09-482c-90ae-750628c4ab13-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.919569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-scripts\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.919616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-config\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.922889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.923912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.924043 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" podStartSLOduration=2.772819254 podStartE2EDuration="1m52.924031557s" podCreationTimestamp="2025-11-21 12:08:50 +0000 UTC" firstStartedPulling="2025-11-21 12:08:50.829069427 +0000 UTC m=+1089.529731245" lastFinishedPulling="2025-11-21 12:10:40.98028173 +0000 UTC m=+1199.680943548" observedRunningTime="2025-11-21 12:10:42.921706244 +0000 UTC m=+1201.622368062" watchObservedRunningTime="2025-11-21 12:10:42.924031557 +0000 UTC m=+1201.624693375" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.944407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.945197 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-29grc\" (UniqueName: \"kubernetes.io/projected/602f0862-0d09-482c-90ae-750628c4ab13-kube-api-access-29grc\") pod \"ovn-northd-0\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.946097 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=18.434629259 podStartE2EDuration="1m38.946078507s" podCreationTimestamp="2025-11-21 12:09:04 +0000 UTC" firstStartedPulling="2025-11-21 12:09:20.996254413 +0000 UTC m=+1119.696916231" lastFinishedPulling="2025-11-21 12:10:41.507703661 +0000 UTC m=+1200.208365479" observedRunningTime="2025-11-21 12:10:42.944753611 +0000 UTC m=+1201.645415439" watchObservedRunningTime="2025-11-21 12:10:42.946078507 +0000 UTC m=+1201.646740325" Nov 21 12:10:42 crc kubenswrapper[4769]: I1121 12:10:42.963366 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=30.626711922 podStartE2EDuration="1m40.963350679s" podCreationTimestamp="2025-11-21 12:09:02 +0000 UTC" firstStartedPulling="2025-11-21 12:09:21.038129314 +0000 UTC m=+1119.738791132" lastFinishedPulling="2025-11-21 12:10:31.374768071 +0000 UTC m=+1190.075429889" observedRunningTime="2025-11-21 12:10:42.962343822 +0000 UTC m=+1201.663005640" watchObservedRunningTime="2025-11-21 12:10:42.963350679 +0000 UTC m=+1201.664012497" Nov 21 12:10:43 crc kubenswrapper[4769]: I1121 12:10:43.093462 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:43 crc kubenswrapper[4769]: I1121 12:10:43.644524 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:10:43 crc kubenswrapper[4769]: I1121 12:10:43.897630 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerID="dba15d27541dde4416c4c50a753fa2fc0598b80702f897e84b27a3b69ae40b02" exitCode=0 Nov 21 12:10:43 crc kubenswrapper[4769]: I1121 12:10:43.897718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" event={"ID":"2e2e0cc8-277e-4a52-842e-e1c8067821e8","Type":"ContainerDied","Data":"dba15d27541dde4416c4c50a753fa2fc0598b80702f897e84b27a3b69ae40b02"} Nov 21 12:10:44 crc kubenswrapper[4769]: W1121 12:10:44.068885 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod602f0862_0d09_482c_90ae_750628c4ab13.slice/crio-e3331697f166a19a20ca1fc1b48f3c4eca9a3611fb15d4017ff5b3f434023168 WatchSource:0}: Error finding container e3331697f166a19a20ca1fc1b48f3c4eca9a3611fb15d4017ff5b3f434023168: Status 404 returned error can't find the container with id e3331697f166a19a20ca1fc1b48f3c4eca9a3611fb15d4017ff5b3f434023168 Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.380371 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.380528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.908661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"fddc5cda-eae9-43a0-afd5-c99a76904b8e","Type":"ContainerStarted","Data":"3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0"} Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.909234 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.909683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"602f0862-0d09-482c-90ae-750628c4ab13","Type":"ContainerStarted","Data":"e3331697f166a19a20ca1fc1b48f3c4eca9a3611fb15d4017ff5b3f434023168"} Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.911139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5","Type":"ContainerStarted","Data":"28313ef7b4949eacfe9c9ca5becf7da9ef29f43e75ac8130e5c645312f4b158c"} Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.912927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" event={"ID":"2e2e0cc8-277e-4a52-842e-e1c8067821e8","Type":"ContainerStarted","Data":"ea2f682514c1d3d962848b19a279e1e2b834c66ce464fc8dc9ab976e6987c566"} Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.913269 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.923447 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.929815 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=16.871234047 podStartE2EDuration="1m39.929794159s" podCreationTimestamp="2025-11-21 12:09:05 +0000 UTC" firstStartedPulling="2025-11-21 12:09:21.077482653 +0000 UTC m=+1119.778144471" lastFinishedPulling="2025-11-21 12:10:44.136042765 +0000 UTC m=+1202.836704583" observedRunningTime="2025-11-21 12:10:44.92312485 +0000 UTC m=+1203.623786668" watchObservedRunningTime="2025-11-21 12:10:44.929794159 +0000 UTC m=+1203.630455997" Nov 21 12:10:44 crc kubenswrapper[4769]: I1121 12:10:44.943230 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" podStartSLOduration=-9223371921.911581 podStartE2EDuration="1m54.943194197s" podCreationTimestamp="2025-11-21 12:08:50 +0000 UTC" firstStartedPulling="2025-11-21 12:08:50.961446206 +0000 UTC m=+1089.662108024" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:10:44.937516905 +0000 UTC m=+1203.638178733" watchObservedRunningTime="2025-11-21 12:10:44.943194197 +0000 UTC m=+1203.643856015" Nov 21 12:10:49 crc kubenswrapper[4769]: I1121 12:10:49.924181 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:10:50 crc kubenswrapper[4769]: I1121 12:10:50.432399 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:10:50 crc kubenswrapper[4769]: I1121 12:10:50.567435 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:10:50 crc kubenswrapper[4769]: I1121 12:10:50.617379 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh"] Nov 21 12:10:50 crc kubenswrapper[4769]: I1121 12:10:50.977781 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerName="dnsmasq-dns" containerID="cri-o://ea2f682514c1d3d962848b19a279e1e2b834c66ce464fc8dc9ab976e6987c566" gracePeriod=10 Nov 21 12:10:51 crc kubenswrapper[4769]: I1121 12:10:51.989439 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerID="ea2f682514c1d3d962848b19a279e1e2b834c66ce464fc8dc9ab976e6987c566" exitCode=0 Nov 21 12:10:51 crc kubenswrapper[4769]: I1121 12:10:51.989544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" event={"ID":"2e2e0cc8-277e-4a52-842e-e1c8067821e8","Type":"ContainerDied","Data":"ea2f682514c1d3d962848b19a279e1e2b834c66ce464fc8dc9ab976e6987c566"} Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.695403 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.729795 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.729841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.798892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84c7d\" (UniqueName: \"kubernetes.io/projected/2e2e0cc8-277e-4a52-842e-e1c8067821e8-kube-api-access-84c7d\") pod \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.799017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e2e0cc8-277e-4a52-842e-e1c8067821e8-config\") pod \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\" (UID: \"2e2e0cc8-277e-4a52-842e-e1c8067821e8\") " Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.799054 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.805300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2e0cc8-277e-4a52-842e-e1c8067821e8-kube-api-access-84c7d" (OuterVolumeSpecName: "kube-api-access-84c7d") pod "2e2e0cc8-277e-4a52-842e-e1c8067821e8" (UID: "2e2e0cc8-277e-4a52-842e-e1c8067821e8"). InnerVolumeSpecName "kube-api-access-84c7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.841389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e2e0cc8-277e-4a52-842e-e1c8067821e8-config" (OuterVolumeSpecName: "config") pod "2e2e0cc8-277e-4a52-842e-e1c8067821e8" (UID: "2e2e0cc8-277e-4a52-842e-e1c8067821e8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.901130 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e2e0cc8-277e-4a52-842e-e1c8067821e8-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:52 crc kubenswrapper[4769]: I1121 12:10:52.901181 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-84c7d\" (UniqueName: \"kubernetes.io/projected/2e2e0cc8-277e-4a52-842e-e1c8067821e8-kube-api-access-84c7d\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.000745 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" event={"ID":"2e2e0cc8-277e-4a52-842e-e1c8067821e8","Type":"ContainerDied","Data":"bf63518712ce5e8fe964eb45a47cae7764a150ab60b7c6568374de530a0f9c6f"} Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.000779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh" Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.000838 4769 scope.go:117] "RemoveContainer" containerID="ea2f682514c1d3d962848b19a279e1e2b834c66ce464fc8dc9ab976e6987c566" Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.041389 4769 scope.go:117] "RemoveContainer" containerID="dba15d27541dde4416c4c50a753fa2fc0598b80702f897e84b27a3b69ae40b02" Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.058946 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh"] Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.069026 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-f5849d7b9-vscvh"] Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.119148 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:10:53 crc kubenswrapper[4769]: I1121 12:10:53.289891 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" path="/var/lib/kubelet/pods/2e2e0cc8-277e-4a52-842e-e1c8067821e8/volumes" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.120006 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-4e23-account-create-r7nb6"] Nov 21 12:10:54 crc kubenswrapper[4769]: E1121 12:10:54.120500 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerName="dnsmasq-dns" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.120515 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerName="dnsmasq-dns" Nov 21 12:10:54 crc kubenswrapper[4769]: E1121 12:10:54.120537 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerName="init" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.120545 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerName="init" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.120731 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e2e0cc8-277e-4a52-842e-e1c8067821e8" containerName="dnsmasq-dns" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.121379 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.130143 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-4e23-account-create-r7nb6"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.145014 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.214001 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-fgktm"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.222902 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.223890 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-fgktm"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.234379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzwsh\" (UniqueName: \"kubernetes.io/projected/f2c089ca-2a3c-419c-9096-ecc827a54255-kube-api-access-dzwsh\") pod \"keystone-4e23-account-create-r7nb6\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.234620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f2c089ca-2a3c-419c-9096-ecc827a54255-operator-scripts\") pod \"keystone-4e23-account-create-r7nb6\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.335711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-operator-scripts\") pod \"keystone-db-create-fgktm\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.336095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dzwsh\" (UniqueName: \"kubernetes.io/projected/f2c089ca-2a3c-419c-9096-ecc827a54255-kube-api-access-dzwsh\") pod \"keystone-4e23-account-create-r7nb6\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.336178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f2c089ca-2a3c-419c-9096-ecc827a54255-operator-scripts\") pod \"keystone-4e23-account-create-r7nb6\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.336244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cnht\" (UniqueName: \"kubernetes.io/projected/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-kube-api-access-2cnht\") pod \"keystone-db-create-fgktm\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.337067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f2c089ca-2a3c-419c-9096-ecc827a54255-operator-scripts\") pod \"keystone-4e23-account-create-r7nb6\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.358293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzwsh\" (UniqueName: \"kubernetes.io/projected/f2c089ca-2a3c-419c-9096-ecc827a54255-kube-api-access-dzwsh\") pod \"keystone-4e23-account-create-r7nb6\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.382568 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-g6d54"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.384465 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.388640 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-g6d54"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.438000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2cnht\" (UniqueName: \"kubernetes.io/projected/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-kube-api-access-2cnht\") pod \"keystone-db-create-fgktm\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.438062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-operator-scripts\") pod \"keystone-db-create-fgktm\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.438842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-operator-scripts\") pod \"keystone-db-create-fgktm\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.457028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cnht\" (UniqueName: \"kubernetes.io/projected/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-kube-api-access-2cnht\") pod \"keystone-db-create-fgktm\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.482786 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-ecac-account-create-j4bjc"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.483855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.488369 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.495378 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-ecac-account-create-j4bjc"] Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.540870 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xcsn\" (UniqueName: \"kubernetes.io/projected/ad94a70c-4882-4641-928f-bfb6690c7dd9-kube-api-access-2xcsn\") pod \"placement-db-create-g6d54\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.540924 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad94a70c-4882-4641-928f-bfb6690c7dd9-operator-scripts\") pod \"placement-db-create-g6d54\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.589711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.618994 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.642708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2xcsn\" (UniqueName: \"kubernetes.io/projected/ad94a70c-4882-4641-928f-bfb6690c7dd9-kube-api-access-2xcsn\") pod \"placement-db-create-g6d54\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.642757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad94a70c-4882-4641-928f-bfb6690c7dd9-operator-scripts\") pod \"placement-db-create-g6d54\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.642790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srxtm\" (UniqueName: \"kubernetes.io/projected/0e9ed887-de46-48bc-b63e-dd92b455648e-kube-api-access-srxtm\") pod \"placement-ecac-account-create-j4bjc\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.642825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e9ed887-de46-48bc-b63e-dd92b455648e-operator-scripts\") pod \"placement-ecac-account-create-j4bjc\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.643397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad94a70c-4882-4641-928f-bfb6690c7dd9-operator-scripts\") pod \"placement-db-create-g6d54\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.658847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xcsn\" (UniqueName: \"kubernetes.io/projected/ad94a70c-4882-4641-928f-bfb6690c7dd9-kube-api-access-2xcsn\") pod \"placement-db-create-g6d54\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.712367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.745128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srxtm\" (UniqueName: \"kubernetes.io/projected/0e9ed887-de46-48bc-b63e-dd92b455648e-kube-api-access-srxtm\") pod \"placement-ecac-account-create-j4bjc\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.745224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e9ed887-de46-48bc-b63e-dd92b455648e-operator-scripts\") pod \"placement-ecac-account-create-j4bjc\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.746150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e9ed887-de46-48bc-b63e-dd92b455648e-operator-scripts\") pod \"placement-ecac-account-create-j4bjc\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.769047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srxtm\" (UniqueName: \"kubernetes.io/projected/0e9ed887-de46-48bc-b63e-dd92b455648e-kube-api-access-srxtm\") pod \"placement-ecac-account-create-j4bjc\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:54 crc kubenswrapper[4769]: I1121 12:10:54.798578 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.024284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"602f0862-0d09-482c-90ae-750628c4ab13","Type":"ContainerStarted","Data":"5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389"} Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.061120 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-g6d54"] Nov 21 12:10:55 crc kubenswrapper[4769]: W1121 12:10:55.063166 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad94a70c_4882_4641_928f_bfb6690c7dd9.slice/crio-c59a2f61ca5eb97edcafe2c8b2278f7d42164f6ca841223a53275a4fea1f6ed1 WatchSource:0}: Error finding container c59a2f61ca5eb97edcafe2c8b2278f7d42164f6ca841223a53275a4fea1f6ed1: Status 404 returned error can't find the container with id c59a2f61ca5eb97edcafe2c8b2278f7d42164f6ca841223a53275a4fea1f6ed1 Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.107833 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-4e23-account-create-r7nb6"] Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.131119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-fgktm"] Nov 21 12:10:55 crc kubenswrapper[4769]: W1121 12:10:55.138799 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2f7720a_03a0_4a8a_b9fc_8dc0d80618a0.slice/crio-8ef54c1407f647abb3dff65b7f82e6c8a5763eea0b10f5549b1376fd03e99a3a WatchSource:0}: Error finding container 8ef54c1407f647abb3dff65b7f82e6c8a5763eea0b10f5549b1376fd03e99a3a: Status 404 returned error can't find the container with id 8ef54c1407f647abb3dff65b7f82e6c8a5763eea0b10f5549b1376fd03e99a3a Nov 21 12:10:55 crc kubenswrapper[4769]: W1121 12:10:55.338249 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e9ed887_de46_48bc_b63e_dd92b455648e.slice/crio-4ffb1980580515010d7ad7b8808638ef34de43ece302c0771dc5cdab1bece9cb WatchSource:0}: Error finding container 4ffb1980580515010d7ad7b8808638ef34de43ece302c0771dc5cdab1bece9cb: Status 404 returned error can't find the container with id 4ffb1980580515010d7ad7b8808638ef34de43ece302c0771dc5cdab1bece9cb Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.340300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-ecac-account-create-j4bjc"] Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.704769 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:10:55 crc kubenswrapper[4769]: I1121 12:10:55.800449 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="galera" probeResult="failure" output=< Nov 21 12:10:55 crc kubenswrapper[4769]: wsrep_local_state_comment (Joined) differs from Synced Nov 21 12:10:55 crc kubenswrapper[4769]: > Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.059627 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.081466 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e9ed887-de46-48bc-b63e-dd92b455648e" containerID="d99f8925d5c910a83754d1a8d8b323b0532341d48d10f847db113db733e4c417" exitCode=0 Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.081584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" event={"ID":"0e9ed887-de46-48bc-b63e-dd92b455648e","Type":"ContainerDied","Data":"d99f8925d5c910a83754d1a8d8b323b0532341d48d10f847db113db733e4c417"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.081631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" event={"ID":"0e9ed887-de46-48bc-b63e-dd92b455648e","Type":"ContainerStarted","Data":"4ffb1980580515010d7ad7b8808638ef34de43ece302c0771dc5cdab1bece9cb"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.096049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"602f0862-0d09-482c-90ae-750628c4ab13","Type":"ContainerStarted","Data":"23ab80415e281eb82c83446934d5b669e6b9a0e1961147c213fc61b2446c084d"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.096333 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.104038 4769 generic.go:334] "Generic (PLEG): container finished" podID="f2c089ca-2a3c-419c-9096-ecc827a54255" containerID="7590d1d2a0754d15b540c74bc2ef401106a69fc9caa8db2f69bbd3c3fde3bb51" exitCode=0 Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.104124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" event={"ID":"f2c089ca-2a3c-419c-9096-ecc827a54255","Type":"ContainerDied","Data":"7590d1d2a0754d15b540c74bc2ef401106a69fc9caa8db2f69bbd3c3fde3bb51"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.104163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" event={"ID":"f2c089ca-2a3c-419c-9096-ecc827a54255","Type":"ContainerStarted","Data":"bb2abb7140d71fd99731e3fae40739a36ef1e952971d7a37fa75a02280920645"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.111208 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad94a70c-4882-4641-928f-bfb6690c7dd9" containerID="e59c511ceaf471a346e731573e14b55126ffa06818ce22bc3e28e5e0d2ca97c3" exitCode=0 Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.111289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-g6d54" event={"ID":"ad94a70c-4882-4641-928f-bfb6690c7dd9","Type":"ContainerDied","Data":"e59c511ceaf471a346e731573e14b55126ffa06818ce22bc3e28e5e0d2ca97c3"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.111324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-g6d54" event={"ID":"ad94a70c-4882-4641-928f-bfb6690c7dd9","Type":"ContainerStarted","Data":"c59a2f61ca5eb97edcafe2c8b2278f7d42164f6ca841223a53275a4fea1f6ed1"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.116602 4769 generic.go:334] "Generic (PLEG): container finished" podID="c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" containerID="4b5fcaf70fd6f4542043e8e63c687594153cd20444770960a53dc1d92905b3f0" exitCode=0 Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.116659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-fgktm" event={"ID":"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0","Type":"ContainerDied","Data":"4b5fcaf70fd6f4542043e8e63c687594153cd20444770960a53dc1d92905b3f0"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.116691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-fgktm" event={"ID":"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0","Type":"ContainerStarted","Data":"8ef54c1407f647abb3dff65b7f82e6c8a5763eea0b10f5549b1376fd03e99a3a"} Nov 21 12:10:56 crc kubenswrapper[4769]: I1121 12:10:56.175661 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=4.150631942 podStartE2EDuration="14.175643922s" podCreationTimestamp="2025-11-21 12:10:42 +0000 UTC" firstStartedPulling="2025-11-21 12:10:44.127972259 +0000 UTC m=+1202.828634077" lastFinishedPulling="2025-11-21 12:10:54.152984239 +0000 UTC m=+1212.853646057" observedRunningTime="2025-11-21 12:10:56.172770206 +0000 UTC m=+1214.873432044" watchObservedRunningTime="2025-11-21 12:10:56.175643922 +0000 UTC m=+1214.876305740" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.140470 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.155022 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.161252 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.161281 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.161350 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-djq25" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.161263 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.161984 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.296078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-kube-api-access-sg7xz\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.296337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-lock\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.296400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.296445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.296502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-cache\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.390225 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-8nw95"] Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.397852 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.398573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.398657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: E1121 12:10:57.398828 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:10:57 crc kubenswrapper[4769]: E1121 12:10:57.398843 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:10:57 crc kubenswrapper[4769]: E1121 12:10:57.398907 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:10:57.898875812 +0000 UTC m=+1216.599537630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.400215 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.401473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-cache\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.401709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-kube-api-access-sg7xz\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.402118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-lock\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.402728 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-cache\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.402862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-lock\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.403909 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.404244 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.404709 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.409664 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-8nw95"] Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.447140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-kube-api-access-sg7xz\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.448490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-scripts\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-swiftconf\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-dispersionconf\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/bfa6871b-dd1a-4709-88d1-82a8fe102771-etc-swift\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-combined-ca-bundle\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm2k8\" (UniqueName: \"kubernetes.io/projected/bfa6871b-dd1a-4709-88d1-82a8fe102771-kube-api-access-qm2k8\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.508715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-ring-data-devices\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.557998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-swiftconf\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-dispersionconf\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/bfa6871b-dd1a-4709-88d1-82a8fe102771-etc-swift\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-combined-ca-bundle\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qm2k8\" (UniqueName: \"kubernetes.io/projected/bfa6871b-dd1a-4709-88d1-82a8fe102771-kube-api-access-qm2k8\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-ring-data-devices\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.610598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-scripts\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.611421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-scripts\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.622800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-combined-ca-bundle\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.623167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/bfa6871b-dd1a-4709-88d1-82a8fe102771-etc-swift\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.623699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-ring-data-devices\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.639668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-dispersionconf\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.645243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-swiftconf\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.659429 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm2k8\" (UniqueName: \"kubernetes.io/projected/bfa6871b-dd1a-4709-88d1-82a8fe102771-kube-api-access-qm2k8\") pod \"swift-ring-rebalance-8nw95\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.714757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cnht\" (UniqueName: \"kubernetes.io/projected/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-kube-api-access-2cnht\") pod \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.714880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-operator-scripts\") pod \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\" (UID: \"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.716036 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" (UID: "c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.733050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-kube-api-access-2cnht" (OuterVolumeSpecName: "kube-api-access-2cnht") pod "c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" (UID: "c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0"). InnerVolumeSpecName "kube-api-access-2cnht". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.752228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.779958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.785890 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.820400 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.820437 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2cnht\" (UniqueName: \"kubernetes.io/projected/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0-kube-api-access-2cnht\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.820717 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.921789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f2c089ca-2a3c-419c-9096-ecc827a54255-operator-scripts\") pod \"f2c089ca-2a3c-419c-9096-ecc827a54255\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.922027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzwsh\" (UniqueName: \"kubernetes.io/projected/f2c089ca-2a3c-419c-9096-ecc827a54255-kube-api-access-dzwsh\") pod \"f2c089ca-2a3c-419c-9096-ecc827a54255\" (UID: \"f2c089ca-2a3c-419c-9096-ecc827a54255\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.922052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xcsn\" (UniqueName: \"kubernetes.io/projected/ad94a70c-4882-4641-928f-bfb6690c7dd9-kube-api-access-2xcsn\") pod \"ad94a70c-4882-4641-928f-bfb6690c7dd9\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.922319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srxtm\" (UniqueName: \"kubernetes.io/projected/0e9ed887-de46-48bc-b63e-dd92b455648e-kube-api-access-srxtm\") pod \"0e9ed887-de46-48bc-b63e-dd92b455648e\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.922355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad94a70c-4882-4641-928f-bfb6690c7dd9-operator-scripts\") pod \"ad94a70c-4882-4641-928f-bfb6690c7dd9\" (UID: \"ad94a70c-4882-4641-928f-bfb6690c7dd9\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.922414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e9ed887-de46-48bc-b63e-dd92b455648e-operator-scripts\") pod \"0e9ed887-de46-48bc-b63e-dd92b455648e\" (UID: \"0e9ed887-de46-48bc-b63e-dd92b455648e\") " Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.922741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c089ca-2a3c-419c-9096-ecc827a54255-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f2c089ca-2a3c-419c-9096-ecc827a54255" (UID: "f2c089ca-2a3c-419c-9096-ecc827a54255"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.923039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.923071 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad94a70c-4882-4641-928f-bfb6690c7dd9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ad94a70c-4882-4641-928f-bfb6690c7dd9" (UID: "ad94a70c-4882-4641-928f-bfb6690c7dd9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: E1121 12:10:57.923231 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:10:57 crc kubenswrapper[4769]: E1121 12:10:57.923249 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.923231 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f2c089ca-2a3c-419c-9096-ecc827a54255-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:57 crc kubenswrapper[4769]: E1121 12:10:57.923304 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:10:58.923282887 +0000 UTC m=+1217.623944765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.923330 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad94a70c-4882-4641-928f-bfb6690c7dd9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.923330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9ed887-de46-48bc-b63e-dd92b455648e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0e9ed887-de46-48bc-b63e-dd92b455648e" (UID: "0e9ed887-de46-48bc-b63e-dd92b455648e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.928313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c089ca-2a3c-419c-9096-ecc827a54255-kube-api-access-dzwsh" (OuterVolumeSpecName: "kube-api-access-dzwsh") pod "f2c089ca-2a3c-419c-9096-ecc827a54255" (UID: "f2c089ca-2a3c-419c-9096-ecc827a54255"). InnerVolumeSpecName "kube-api-access-dzwsh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.928361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9ed887-de46-48bc-b63e-dd92b455648e-kube-api-access-srxtm" (OuterVolumeSpecName: "kube-api-access-srxtm") pod "0e9ed887-de46-48bc-b63e-dd92b455648e" (UID: "0e9ed887-de46-48bc-b63e-dd92b455648e"). InnerVolumeSpecName "kube-api-access-srxtm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:10:57 crc kubenswrapper[4769]: I1121 12:10:57.928689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad94a70c-4882-4641-928f-bfb6690c7dd9-kube-api-access-2xcsn" (OuterVolumeSpecName: "kube-api-access-2xcsn") pod "ad94a70c-4882-4641-928f-bfb6690c7dd9" (UID: "ad94a70c-4882-4641-928f-bfb6690c7dd9"). InnerVolumeSpecName "kube-api-access-2xcsn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.027808 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e9ed887-de46-48bc-b63e-dd92b455648e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.027869 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dzwsh\" (UniqueName: \"kubernetes.io/projected/f2c089ca-2a3c-419c-9096-ecc827a54255-kube-api-access-dzwsh\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.027886 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2xcsn\" (UniqueName: \"kubernetes.io/projected/ad94a70c-4882-4641-928f-bfb6690c7dd9-kube-api-access-2xcsn\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.027896 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srxtm\" (UniqueName: \"kubernetes.io/projected/0e9ed887-de46-48bc-b63e-dd92b455648e-kube-api-access-srxtm\") on node \"crc\" DevicePath \"\"" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.132913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-fgktm" event={"ID":"c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0","Type":"ContainerDied","Data":"8ef54c1407f647abb3dff65b7f82e6c8a5763eea0b10f5549b1376fd03e99a3a"} Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.132944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-fgktm" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.132956 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ef54c1407f647abb3dff65b7f82e6c8a5763eea0b10f5549b1376fd03e99a3a" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.134365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.134382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ecac-account-create-j4bjc" event={"ID":"0e9ed887-de46-48bc-b63e-dd92b455648e","Type":"ContainerDied","Data":"4ffb1980580515010d7ad7b8808638ef34de43ece302c0771dc5cdab1bece9cb"} Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.134431 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ffb1980580515010d7ad7b8808638ef34de43ece302c0771dc5cdab1bece9cb" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.135726 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.135721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-4e23-account-create-r7nb6" event={"ID":"f2c089ca-2a3c-419c-9096-ecc827a54255","Type":"ContainerDied","Data":"bb2abb7140d71fd99731e3fae40739a36ef1e952971d7a37fa75a02280920645"} Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.135828 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb2abb7140d71fd99731e3fae40739a36ef1e952971d7a37fa75a02280920645" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.137018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-g6d54" event={"ID":"ad94a70c-4882-4641-928f-bfb6690c7dd9","Type":"ContainerDied","Data":"c59a2f61ca5eb97edcafe2c8b2278f7d42164f6ca841223a53275a4fea1f6ed1"} Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.137101 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-g6d54" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.143225 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c59a2f61ca5eb97edcafe2c8b2278f7d42164f6ca841223a53275a4fea1f6ed1" Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.239369 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-8nw95"] Nov 21 12:10:58 crc kubenswrapper[4769]: W1121 12:10:58.243052 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfa6871b_dd1a_4709_88d1_82a8fe102771.slice/crio-6faf20d78e309c5fbafcc8a480a1778ba95a219f0df959c87efdd3a312c0eb63 WatchSource:0}: Error finding container 6faf20d78e309c5fbafcc8a480a1778ba95a219f0df959c87efdd3a312c0eb63: Status 404 returned error can't find the container with id 6faf20d78e309c5fbafcc8a480a1778ba95a219f0df959c87efdd3a312c0eb63 Nov 21 12:10:58 crc kubenswrapper[4769]: I1121 12:10:58.944939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:10:58 crc kubenswrapper[4769]: E1121 12:10:58.945173 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:10:58 crc kubenswrapper[4769]: E1121 12:10:58.945426 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:10:58 crc kubenswrapper[4769]: E1121 12:10:58.945503 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:11:00.945478796 +0000 UTC m=+1219.646140614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:10:59 crc kubenswrapper[4769]: I1121 12:10:59.146995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" event={"ID":"bfa6871b-dd1a-4709-88d1-82a8fe102771","Type":"ContainerStarted","Data":"6faf20d78e309c5fbafcc8a480a1778ba95a219f0df959c87efdd3a312c0eb63"} Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.127809 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-f5bnz"] Nov 21 12:11:00 crc kubenswrapper[4769]: E1121 12:11:00.128217 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad94a70c-4882-4641-928f-bfb6690c7dd9" containerName="mariadb-database-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128235 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad94a70c-4882-4641-928f-bfb6690c7dd9" containerName="mariadb-database-create" Nov 21 12:11:00 crc kubenswrapper[4769]: E1121 12:11:00.128246 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" containerName="mariadb-database-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128253 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" containerName="mariadb-database-create" Nov 21 12:11:00 crc kubenswrapper[4769]: E1121 12:11:00.128270 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f2c089ca-2a3c-419c-9096-ecc827a54255" containerName="mariadb-account-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128279 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c089ca-2a3c-419c-9096-ecc827a54255" containerName="mariadb-account-create" Nov 21 12:11:00 crc kubenswrapper[4769]: E1121 12:11:00.128303 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e9ed887-de46-48bc-b63e-dd92b455648e" containerName="mariadb-account-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128312 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9ed887-de46-48bc-b63e-dd92b455648e" containerName="mariadb-account-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128492 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f2c089ca-2a3c-419c-9096-ecc827a54255" containerName="mariadb-account-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128504 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e9ed887-de46-48bc-b63e-dd92b455648e" containerName="mariadb-account-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128518 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad94a70c-4882-4641-928f-bfb6690c7dd9" containerName="mariadb-database-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.128535 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" containerName="mariadb-database-create" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.129209 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.194123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-f5bnz"] Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.243365 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-ce7b-account-create-dch75"] Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.244908 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.247259 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.249512 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ce7b-account-create-dch75"] Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.288642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143a02da-24a6-41aa-91ba-21acfb688994-operator-scripts\") pod \"glance-db-create-f5bnz\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.288702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7qfl\" (UniqueName: \"kubernetes.io/projected/143a02da-24a6-41aa-91ba-21acfb688994-kube-api-access-p7qfl\") pod \"glance-db-create-f5bnz\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.390497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143a02da-24a6-41aa-91ba-21acfb688994-operator-scripts\") pod \"glance-db-create-f5bnz\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.390556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p7qfl\" (UniqueName: \"kubernetes.io/projected/143a02da-24a6-41aa-91ba-21acfb688994-kube-api-access-p7qfl\") pod \"glance-db-create-f5bnz\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.390605 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c570fccc-0d70-42a9-b6ef-a4d5047dee75-operator-scripts\") pod \"glance-ce7b-account-create-dch75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.391615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143a02da-24a6-41aa-91ba-21acfb688994-operator-scripts\") pod \"glance-db-create-f5bnz\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.391778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjm5x\" (UniqueName: \"kubernetes.io/projected/c570fccc-0d70-42a9-b6ef-a4d5047dee75-kube-api-access-tjm5x\") pod \"glance-ce7b-account-create-dch75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.418797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7qfl\" (UniqueName: \"kubernetes.io/projected/143a02da-24a6-41aa-91ba-21acfb688994-kube-api-access-p7qfl\") pod \"glance-db-create-f5bnz\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.493542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c570fccc-0d70-42a9-b6ef-a4d5047dee75-operator-scripts\") pod \"glance-ce7b-account-create-dch75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.493685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tjm5x\" (UniqueName: \"kubernetes.io/projected/c570fccc-0d70-42a9-b6ef-a4d5047dee75-kube-api-access-tjm5x\") pod \"glance-ce7b-account-create-dch75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.494739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c570fccc-0d70-42a9-b6ef-a4d5047dee75-operator-scripts\") pod \"glance-ce7b-account-create-dch75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.508699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjm5x\" (UniqueName: \"kubernetes.io/projected/c570fccc-0d70-42a9-b6ef-a4d5047dee75-kube-api-access-tjm5x\") pod \"glance-ce7b-account-create-dch75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.521865 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.564891 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:00 crc kubenswrapper[4769]: I1121 12:11:00.983704 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-f5bnz"] Nov 21 12:11:00 crc kubenswrapper[4769]: W1121 12:11:00.995582 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod143a02da_24a6_41aa_91ba_21acfb688994.slice/crio-5682f6cafe95c0c93d4d15e910d411689f8df64617d6cde7b660601a3bc65b40 WatchSource:0}: Error finding container 5682f6cafe95c0c93d4d15e910d411689f8df64617d6cde7b660601a3bc65b40: Status 404 returned error can't find the container with id 5682f6cafe95c0c93d4d15e910d411689f8df64617d6cde7b660601a3bc65b40 Nov 21 12:11:01 crc kubenswrapper[4769]: I1121 12:11:01.003256 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:11:01 crc kubenswrapper[4769]: E1121 12:11:01.003414 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:11:01 crc kubenswrapper[4769]: E1121 12:11:01.003437 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:11:01 crc kubenswrapper[4769]: E1121 12:11:01.003497 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:11:05.003475066 +0000 UTC m=+1223.704136884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:11:01 crc kubenswrapper[4769]: I1121 12:11:01.071946 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ce7b-account-create-dch75"] Nov 21 12:11:01 crc kubenswrapper[4769]: W1121 12:11:01.085163 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc570fccc_0d70_42a9_b6ef_a4d5047dee75.slice/crio-29a1971f67b8a028717f62e8fff3a0f636fecf08004e1693b3c62dc7682561ef WatchSource:0}: Error finding container 29a1971f67b8a028717f62e8fff3a0f636fecf08004e1693b3c62dc7682561ef: Status 404 returned error can't find the container with id 29a1971f67b8a028717f62e8fff3a0f636fecf08004e1693b3c62dc7682561ef Nov 21 12:11:01 crc kubenswrapper[4769]: I1121 12:11:01.220041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" event={"ID":"c570fccc-0d70-42a9-b6ef-a4d5047dee75","Type":"ContainerStarted","Data":"29a1971f67b8a028717f62e8fff3a0f636fecf08004e1693b3c62dc7682561ef"} Nov 21 12:11:01 crc kubenswrapper[4769]: I1121 12:11:01.221212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-f5bnz" event={"ID":"143a02da-24a6-41aa-91ba-21acfb688994","Type":"ContainerStarted","Data":"5682f6cafe95c0c93d4d15e910d411689f8df64617d6cde7b660601a3bc65b40"} Nov 21 12:11:04 crc kubenswrapper[4769]: I1121 12:11:04.477049 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:11:05 crc kubenswrapper[4769]: I1121 12:11:05.082039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:11:05 crc kubenswrapper[4769]: E1121 12:11:05.082508 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:11:05 crc kubenswrapper[4769]: E1121 12:11:05.082575 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:11:05 crc kubenswrapper[4769]: E1121 12:11:05.082725 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:11:13.082677672 +0000 UTC m=+1231.783339530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:11:05 crc kubenswrapper[4769]: I1121 12:11:05.269983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-f5bnz" event={"ID":"143a02da-24a6-41aa-91ba-21acfb688994","Type":"ContainerStarted","Data":"1c1554009b63c920b2c5916f776a49264fbde763a4e4001ddb1f3b664c851bde"} Nov 21 12:11:05 crc kubenswrapper[4769]: I1121 12:11:05.272596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" event={"ID":"c570fccc-0d70-42a9-b6ef-a4d5047dee75","Type":"ContainerStarted","Data":"b0dbd23fedb5b8fcce1d89ad9f3dcafbe5c4db7a046356f8b02cdbdfc66c7567"} Nov 21 12:11:05 crc kubenswrapper[4769]: I1121 12:11:05.298547 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-f5bnz" podStartSLOduration=5.298523929 podStartE2EDuration="5.298523929s" podCreationTimestamp="2025-11-21 12:11:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:11:05.296000972 +0000 UTC m=+1223.996662800" watchObservedRunningTime="2025-11-21 12:11:05.298523929 +0000 UTC m=+1223.999185757" Nov 21 12:11:05 crc kubenswrapper[4769]: I1121 12:11:05.322316 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" podStartSLOduration=5.322297556 podStartE2EDuration="5.322297556s" podCreationTimestamp="2025-11-21 12:11:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:11:05.315224906 +0000 UTC m=+1224.015886724" watchObservedRunningTime="2025-11-21 12:11:05.322297556 +0000 UTC m=+1224.022959364" Nov 21 12:11:06 crc kubenswrapper[4769]: I1121 12:11:06.288303 4769 generic.go:334] "Generic (PLEG): container finished" podID="07035577-c371-41ab-b492-4d943dace285" containerID="13b30d5ba32fd94fb4b51fd7cfa042d53251f175f92af53d61a459939b13989d" exitCode=0 Nov 21 12:11:06 crc kubenswrapper[4769]: I1121 12:11:06.289035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"07035577-c371-41ab-b492-4d943dace285","Type":"ContainerDied","Data":"13b30d5ba32fd94fb4b51fd7cfa042d53251f175f92af53d61a459939b13989d"} Nov 21 12:11:08 crc kubenswrapper[4769]: I1121 12:11:08.186891 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:11:11 crc kubenswrapper[4769]: I1121 12:11:11.325058 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:11:11 crc kubenswrapper[4769]: I1121 12:11:11.325511 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:11:11 crc kubenswrapper[4769]: I1121 12:11:11.325583 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:11:11 crc kubenswrapper[4769]: I1121 12:11:11.328007 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"77b95337a8fb1bea6740223d306fd9fa3ee4382d0abe34fe326b929ca3a9c906"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:11:11 crc kubenswrapper[4769]: I1121 12:11:11.328223 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://77b95337a8fb1bea6740223d306fd9fa3ee4382d0abe34fe326b929ca3a9c906" gracePeriod=600 Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.156654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:11:13 crc kubenswrapper[4769]: E1121 12:11:13.156875 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:11:13 crc kubenswrapper[4769]: E1121 12:11:13.157214 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:11:13 crc kubenswrapper[4769]: E1121 12:11:13.157297 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:11:29.157275241 +0000 UTC m=+1247.857937059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.374806 4769 generic.go:334] "Generic (PLEG): container finished" podID="143a02da-24a6-41aa-91ba-21acfb688994" containerID="1c1554009b63c920b2c5916f776a49264fbde763a4e4001ddb1f3b664c851bde" exitCode=0 Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.374876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-f5bnz" event={"ID":"143a02da-24a6-41aa-91ba-21acfb688994","Type":"ContainerDied","Data":"1c1554009b63c920b2c5916f776a49264fbde763a4e4001ddb1f3b664c851bde"} Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.376941 4769 generic.go:334] "Generic (PLEG): container finished" podID="c570fccc-0d70-42a9-b6ef-a4d5047dee75" containerID="b0dbd23fedb5b8fcce1d89ad9f3dcafbe5c4db7a046356f8b02cdbdfc66c7567" exitCode=0 Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.377014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" event={"ID":"c570fccc-0d70-42a9-b6ef-a4d5047dee75","Type":"ContainerDied","Data":"b0dbd23fedb5b8fcce1d89ad9f3dcafbe5c4db7a046356f8b02cdbdfc66c7567"} Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.380881 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="77b95337a8fb1bea6740223d306fd9fa3ee4382d0abe34fe326b929ca3a9c906" exitCode=0 Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.380912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"77b95337a8fb1bea6740223d306fd9fa3ee4382d0abe34fe326b929ca3a9c906"} Nov 21 12:11:13 crc kubenswrapper[4769]: I1121 12:11:13.380935 4769 scope.go:117] "RemoveContainer" containerID="183b431de75db756057a9fd21f82b3dcfbe60ed8b081d37c7fb533b6c556dab7" Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.408596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-f5bnz" event={"ID":"143a02da-24a6-41aa-91ba-21acfb688994","Type":"ContainerDied","Data":"5682f6cafe95c0c93d4d15e910d411689f8df64617d6cde7b660601a3bc65b40"} Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.408997 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5682f6cafe95c0c93d4d15e910d411689f8df64617d6cde7b660601a3bc65b40" Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.413047 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.436314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143a02da-24a6-41aa-91ba-21acfb688994-operator-scripts\") pod \"143a02da-24a6-41aa-91ba-21acfb688994\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.436462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7qfl\" (UniqueName: \"kubernetes.io/projected/143a02da-24a6-41aa-91ba-21acfb688994-kube-api-access-p7qfl\") pod \"143a02da-24a6-41aa-91ba-21acfb688994\" (UID: \"143a02da-24a6-41aa-91ba-21acfb688994\") " Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.437337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/143a02da-24a6-41aa-91ba-21acfb688994-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "143a02da-24a6-41aa-91ba-21acfb688994" (UID: "143a02da-24a6-41aa-91ba-21acfb688994"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.442042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143a02da-24a6-41aa-91ba-21acfb688994-kube-api-access-p7qfl" (OuterVolumeSpecName: "kube-api-access-p7qfl") pod "143a02da-24a6-41aa-91ba-21acfb688994" (UID: "143a02da-24a6-41aa-91ba-21acfb688994"). InnerVolumeSpecName "kube-api-access-p7qfl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.539106 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p7qfl\" (UniqueName: \"kubernetes.io/projected/143a02da-24a6-41aa-91ba-21acfb688994-kube-api-access-p7qfl\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:15 crc kubenswrapper[4769]: I1121 12:11:15.539166 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/143a02da-24a6-41aa-91ba-21acfb688994-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:16 crc kubenswrapper[4769]: I1121 12:11:16.420101 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerID="28313ef7b4949eacfe9c9ca5becf7da9ef29f43e75ac8130e5c645312f4b158c" exitCode=0 Nov 21 12:11:16 crc kubenswrapper[4769]: I1121 12:11:16.420156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5","Type":"ContainerDied","Data":"28313ef7b4949eacfe9c9ca5becf7da9ef29f43e75ac8130e5c645312f4b158c"} Nov 21 12:11:16 crc kubenswrapper[4769]: I1121 12:11:16.420562 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-f5bnz" Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.717757 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.892553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c570fccc-0d70-42a9-b6ef-a4d5047dee75-operator-scripts\") pod \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.892941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjm5x\" (UniqueName: \"kubernetes.io/projected/c570fccc-0d70-42a9-b6ef-a4d5047dee75-kube-api-access-tjm5x\") pod \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\" (UID: \"c570fccc-0d70-42a9-b6ef-a4d5047dee75\") " Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.895097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c570fccc-0d70-42a9-b6ef-a4d5047dee75-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c570fccc-0d70-42a9-b6ef-a4d5047dee75" (UID: "c570fccc-0d70-42a9-b6ef-a4d5047dee75"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.898457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c570fccc-0d70-42a9-b6ef-a4d5047dee75-kube-api-access-tjm5x" (OuterVolumeSpecName: "kube-api-access-tjm5x") pod "c570fccc-0d70-42a9-b6ef-a4d5047dee75" (UID: "c570fccc-0d70-42a9-b6ef-a4d5047dee75"). InnerVolumeSpecName "kube-api-access-tjm5x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.996968 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c570fccc-0d70-42a9-b6ef-a4d5047dee75-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:17 crc kubenswrapper[4769]: I1121 12:11:17.997037 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tjm5x\" (UniqueName: \"kubernetes.io/projected/c570fccc-0d70-42a9-b6ef-a4d5047dee75-kube-api-access-tjm5x\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:18 crc kubenswrapper[4769]: I1121 12:11:18.441519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" event={"ID":"c570fccc-0d70-42a9-b6ef-a4d5047dee75","Type":"ContainerDied","Data":"29a1971f67b8a028717f62e8fff3a0f636fecf08004e1693b3c62dc7682561ef"} Nov 21 12:11:18 crc kubenswrapper[4769]: I1121 12:11:18.441928 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29a1971f67b8a028717f62e8fff3a0f636fecf08004e1693b3c62dc7682561ef" Nov 21 12:11:18 crc kubenswrapper[4769]: I1121 12:11:18.441540 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ce7b-account-create-dch75" Nov 21 12:11:18 crc kubenswrapper[4769]: I1121 12:11:18.444257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"6e8df9d28b4dbd9830a4c8bbe1d15cc740f5f6d0ab87fac63ea00477540fb9ba"} Nov 21 12:11:18 crc kubenswrapper[4769]: I1121 12:11:18.446124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"07035577-c371-41ab-b492-4d943dace285","Type":"ContainerStarted","Data":"5e7d206d799633d2293ea1c3e7fd6b27165e4608e8d950efc6bb43320c259bb3"} Nov 21 12:11:18 crc kubenswrapper[4769]: I1121 12:11:18.447806 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5","Type":"ContainerStarted","Data":"39a6f77204e9dd9b8eccd52e8103882ae2194706b6b1bddbb9ff9c2215a8432f"} Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.508380 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-xb74v"] Nov 21 12:11:20 crc kubenswrapper[4769]: E1121 12:11:20.509546 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="143a02da-24a6-41aa-91ba-21acfb688994" containerName="mariadb-database-create" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.509585 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="143a02da-24a6-41aa-91ba-21acfb688994" containerName="mariadb-database-create" Nov 21 12:11:20 crc kubenswrapper[4769]: E1121 12:11:20.509626 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c570fccc-0d70-42a9-b6ef-a4d5047dee75" containerName="mariadb-account-create" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.509637 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c570fccc-0d70-42a9-b6ef-a4d5047dee75" containerName="mariadb-account-create" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.509905 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c570fccc-0d70-42a9-b6ef-a4d5047dee75" containerName="mariadb-account-create" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.509931 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="143a02da-24a6-41aa-91ba-21acfb688994" containerName="mariadb-database-create" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.510842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.513183 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-b87t4" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.513965 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.519803 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-xb74v"] Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.545910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwvgt\" (UniqueName: \"kubernetes.io/projected/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-kube-api-access-vwvgt\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.545993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-combined-ca-bundle\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.546035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-config-data\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.546081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-db-sync-config-data\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.647823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-combined-ca-bundle\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.647914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-config-data\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.647971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-db-sync-config-data\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.648116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vwvgt\" (UniqueName: \"kubernetes.io/projected/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-kube-api-access-vwvgt\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.657109 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-config-data\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.660442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-db-sync-config-data\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.668689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-combined-ca-bundle\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.671358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwvgt\" (UniqueName: \"kubernetes.io/projected/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-kube-api-access-vwvgt\") pod \"glance-db-sync-xb74v\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:20 crc kubenswrapper[4769]: I1121 12:11:20.844503 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:22 crc kubenswrapper[4769]: I1121 12:11:22.805818 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-xb74v"] Nov 21 12:11:23 crc kubenswrapper[4769]: E1121 12:11:23.408513 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-swift-proxy-server@sha256:5d3268a6af8e505ab901049cb8d643a6f3de7e4d7b1cb4820255c11eff9a7bd0" Nov 21 12:11:23 crc kubenswrapper[4769]: E1121 12:11:23.409123 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:swift-ring-rebalance,Image:quay.io/podified-antelope-centos9/openstack-swift-proxy-server@sha256:5d3268a6af8e505ab901049cb8d643a6f3de7e4d7b1cb4820255c11eff9a7bd0,Command:[/usr/local/bin/swift-ring-tool all],Args:[],WorkingDir:/etc/swift,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CM_NAME,Value:swift-ring-files,ValueFrom:nil,},EnvVar{Name:NAMESPACE,Value:openstack-kuttl-tests,ValueFrom:nil,},EnvVar{Name:OWNER_APIVERSION,Value:swift.openstack.org/v1beta1,ValueFrom:nil,},EnvVar{Name:OWNER_KIND,Value:SwiftRing,ValueFrom:nil,},EnvVar{Name:OWNER_NAME,Value:swift-ring,ValueFrom:nil,},EnvVar{Name:OWNER_UID,Value:6d1cdad4-d64a-4651-a38f-045761c1f985,ValueFrom:nil,},EnvVar{Name:SWIFT_MIN_PART_HOURS,Value:1,ValueFrom:nil,},EnvVar{Name:SWIFT_PART_POWER,Value:10,ValueFrom:nil,},EnvVar{Name:SWIFT_REPLICAS,Value:1,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/usr/local/bin/swift-ring-tool,SubPath:swift-ring-tool,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:swiftconf,ReadOnly:true,MountPath:/etc/swift/swift.conf,SubPath:swift.conf,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:etc-swift,ReadOnly:false,MountPath:/etc/swift,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ring-data-devices,ReadOnly:true,MountPath:/var/lib/config-data/ring-devices,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dispersionconf,ReadOnly:true,MountPath:/etc/swift/dispersion.conf,SubPath:dispersion.conf,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qm2k8,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42445,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod swift-ring-rebalance-8nw95_openstack-kuttl-tests(bfa6871b-dd1a-4709-88d1-82a8fe102771): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:11:23 crc kubenswrapper[4769]: E1121 12:11:23.410323 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"swift-ring-rebalance\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" podUID="bfa6871b-dd1a-4709-88d1-82a8fe102771" Nov 21 12:11:23 crc kubenswrapper[4769]: I1121 12:11:23.501623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-xb74v" event={"ID":"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12","Type":"ContainerStarted","Data":"f9f3d426cbcba3466a016835998075b9ef3b60de28c989b199ac0ebceace9fef"} Nov 21 12:11:23 crc kubenswrapper[4769]: I1121 12:11:23.502214 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:11:23 crc kubenswrapper[4769]: E1121 12:11:23.503928 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"swift-ring-rebalance\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-swift-proxy-server@sha256:5d3268a6af8e505ab901049cb8d643a6f3de7e4d7b1cb4820255c11eff9a7bd0\\\"\"" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" podUID="bfa6871b-dd1a-4709-88d1-82a8fe102771" Nov 21 12:11:23 crc kubenswrapper[4769]: I1121 12:11:23.547220 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=-9223371893.307602 podStartE2EDuration="2m23.547173888s" podCreationTimestamp="2025-11-21 12:09:00 +0000 UTC" firstStartedPulling="2025-11-21 12:09:21.085528454 +0000 UTC m=+1119.786190272" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:11:23.544850816 +0000 UTC m=+1242.245512634" watchObservedRunningTime="2025-11-21 12:11:23.547173888 +0000 UTC m=+1242.247835706" Nov 21 12:11:23 crc kubenswrapper[4769]: I1121 12:11:23.578890 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=74.51106233 podStartE2EDuration="2m24.578869417s" podCreationTimestamp="2025-11-21 12:08:59 +0000 UTC" firstStartedPulling="2025-11-21 12:09:20.795462907 +0000 UTC m=+1119.496124735" lastFinishedPulling="2025-11-21 12:10:30.863269994 +0000 UTC m=+1189.563931822" observedRunningTime="2025-11-21 12:11:23.569503106 +0000 UTC m=+1242.270164934" watchObservedRunningTime="2025-11-21 12:11:23.578869417 +0000 UTC m=+1242.279531235" Nov 21 12:11:29 crc kubenswrapper[4769]: I1121 12:11:29.223345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:11:29 crc kubenswrapper[4769]: E1121 12:11:29.223645 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:11:29 crc kubenswrapper[4769]: E1121 12:11:29.224100 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:11:29 crc kubenswrapper[4769]: E1121 12:11:29.224299 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift podName:3080b259-18ef-4c43-a7e9-f79d35c4a910 nodeName:}" failed. No retries permitted until 2025-11-21 12:12:01.22426474 +0000 UTC m=+1279.924926598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift") pod "swift-storage-0" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910") : configmap "swift-ring-files" not found Nov 21 12:11:31 crc kubenswrapper[4769]: I1121 12:11:31.442174 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.100:5671: connect: connection refused" Nov 21 12:11:31 crc kubenswrapper[4769]: I1121 12:11:31.488119 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:11:31 crc kubenswrapper[4769]: I1121 12:11:31.490253 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.101:5671: connect: connection refused" Nov 21 12:11:31 crc kubenswrapper[4769]: I1121 12:11:31.490804 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.101:5671: connect: connection refused" Nov 21 12:11:36 crc kubenswrapper[4769]: I1121 12:11:36.634821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" event={"ID":"bfa6871b-dd1a-4709-88d1-82a8fe102771","Type":"ContainerStarted","Data":"5a4aa70f4fba22db17e561409a167be76a9d0852043bbb448bc271b11df4a18f"} Nov 21 12:11:36 crc kubenswrapper[4769]: I1121 12:11:36.659089 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" podStartSLOduration=1.72777413 podStartE2EDuration="39.659070066s" podCreationTimestamp="2025-11-21 12:10:57 +0000 UTC" firstStartedPulling="2025-11-21 12:10:58.246111578 +0000 UTC m=+1216.946773396" lastFinishedPulling="2025-11-21 12:11:36.177407524 +0000 UTC m=+1254.878069332" observedRunningTime="2025-11-21 12:11:36.658155781 +0000 UTC m=+1255.358817599" watchObservedRunningTime="2025-11-21 12:11:36.659070066 +0000 UTC m=+1255.359731884" Nov 21 12:11:37 crc kubenswrapper[4769]: I1121 12:11:37.677172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-xb74v" event={"ID":"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12","Type":"ContainerStarted","Data":"0c4da3ffea16b594dd3d4d115d32f42d562182ce9229a2fc7861062af357208f"} Nov 21 12:11:37 crc kubenswrapper[4769]: I1121 12:11:37.699917 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-xb74v" podStartSLOduration=4.298063925 podStartE2EDuration="17.699896393s" podCreationTimestamp="2025-11-21 12:11:20 +0000 UTC" firstStartedPulling="2025-11-21 12:11:22.822326328 +0000 UTC m=+1241.522988136" lastFinishedPulling="2025-11-21 12:11:36.224158786 +0000 UTC m=+1254.924820604" observedRunningTime="2025-11-21 12:11:37.697014686 +0000 UTC m=+1256.397676524" watchObservedRunningTime="2025-11-21 12:11:37.699896393 +0000 UTC m=+1256.400558211" Nov 21 12:11:41 crc kubenswrapper[4769]: I1121 12:11:41.444468 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:11:41 crc kubenswrapper[4769]: I1121 12:11:41.491401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.486283 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bd78p"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.488388 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.506299 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-9405-account-create-bqkzz"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.507929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.516580 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.516770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bd78p"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.551866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-9405-account-create-bqkzz"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.581213 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-lrkl8"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.582667 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.605727 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-lrkl8"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.607577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpf76\" (UniqueName: \"kubernetes.io/projected/e07a0768-f1e7-47aa-a73e-c856a641c621-kube-api-access-xpf76\") pod \"cinder-9405-account-create-bqkzz\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.607738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e07a0768-f1e7-47aa-a73e-c856a641c621-operator-scripts\") pod \"cinder-9405-account-create-bqkzz\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.608313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc5fa9b0-6546-4c9d-82af-04a085249145-operator-scripts\") pod \"cinder-db-create-bd78p\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.608474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqt7n\" (UniqueName: \"kubernetes.io/projected/cc5fa9b0-6546-4c9d-82af-04a085249145-kube-api-access-mqt7n\") pod \"cinder-db-create-bd78p\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.672719 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-251c-account-create-fzhbb"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.674061 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.680491 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.683362 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-251c-account-create-fzhbb"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.710768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xpf76\" (UniqueName: \"kubernetes.io/projected/e07a0768-f1e7-47aa-a73e-c856a641c621-kube-api-access-xpf76\") pod \"cinder-9405-account-create-bqkzz\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.710822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e07a0768-f1e7-47aa-a73e-c856a641c621-operator-scripts\") pod \"cinder-9405-account-create-bqkzz\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.710858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm9pv\" (UniqueName: \"kubernetes.io/projected/69bf973c-6676-43f5-b866-9932164c3793-kube-api-access-rm9pv\") pod \"barbican-db-create-lrkl8\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.710910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc5fa9b0-6546-4c9d-82af-04a085249145-operator-scripts\") pod \"cinder-db-create-bd78p\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.710935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69bf973c-6676-43f5-b866-9932164c3793-operator-scripts\") pod \"barbican-db-create-lrkl8\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.711010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mqt7n\" (UniqueName: \"kubernetes.io/projected/cc5fa9b0-6546-4c9d-82af-04a085249145-kube-api-access-mqt7n\") pod \"cinder-db-create-bd78p\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.712334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc5fa9b0-6546-4c9d-82af-04a085249145-operator-scripts\") pod \"cinder-db-create-bd78p\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.712534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e07a0768-f1e7-47aa-a73e-c856a641c621-operator-scripts\") pod \"cinder-9405-account-create-bqkzz\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.734960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqt7n\" (UniqueName: \"kubernetes.io/projected/cc5fa9b0-6546-4c9d-82af-04a085249145-kube-api-access-mqt7n\") pod \"cinder-db-create-bd78p\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.737239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpf76\" (UniqueName: \"kubernetes.io/projected/e07a0768-f1e7-47aa-a73e-c856a641c621-kube-api-access-xpf76\") pod \"cinder-9405-account-create-bqkzz\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.772610 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-n6jck"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.773791 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.807702 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-n6jck"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.812783 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rm9pv\" (UniqueName: \"kubernetes.io/projected/69bf973c-6676-43f5-b866-9932164c3793-kube-api-access-rm9pv\") pod \"barbican-db-create-lrkl8\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.812873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69bf973c-6676-43f5-b866-9932164c3793-operator-scripts\") pod \"barbican-db-create-lrkl8\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.812903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-operator-scripts\") pod \"neutron-251c-account-create-fzhbb\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.812960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvjt\" (UniqueName: \"kubernetes.io/projected/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-kube-api-access-2tvjt\") pod \"neutron-251c-account-create-fzhbb\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.813290 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.814066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69bf973c-6676-43f5-b866-9932164c3793-operator-scripts\") pod \"barbican-db-create-lrkl8\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.837938 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-2945-account-create-pqcv9"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.839571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.850138 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.850636 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.872792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm9pv\" (UniqueName: \"kubernetes.io/projected/69bf973c-6676-43f5-b866-9932164c3793-kube-api-access-rm9pv\") pod \"barbican-db-create-lrkl8\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.880509 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-2945-account-create-pqcv9"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.916390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.925716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvjt\" (UniqueName: \"kubernetes.io/projected/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-kube-api-access-2tvjt\") pod \"neutron-251c-account-create-fzhbb\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.926347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5778d34a-8bd2-4869-b078-46c8131756c3-operator-scripts\") pod \"barbican-2945-account-create-pqcv9\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.926384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-operator-scripts\") pod \"neutron-251c-account-create-fzhbb\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.926412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de487392-74bb-41d7-bdad-637781c45a34-operator-scripts\") pod \"neutron-db-create-n6jck\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.926432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pbf\" (UniqueName: \"kubernetes.io/projected/5778d34a-8bd2-4869-b078-46c8131756c3-kube-api-access-l5pbf\") pod \"barbican-2945-account-create-pqcv9\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.926455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5z8x\" (UniqueName: \"kubernetes.io/projected/de487392-74bb-41d7-bdad-637781c45a34-kube-api-access-v5z8x\") pod \"neutron-db-create-n6jck\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.927420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-operator-scripts\") pod \"neutron-251c-account-create-fzhbb\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.957908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvjt\" (UniqueName: \"kubernetes.io/projected/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-kube-api-access-2tvjt\") pod \"neutron-251c-account-create-fzhbb\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.963670 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-zpzck"] Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.965596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.969779 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-ccsfx" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.970905 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.971105 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.971551 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:11:43 crc kubenswrapper[4769]: I1121 12:11:43.981596 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-zpzck"] Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.000225 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.029364 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5778d34a-8bd2-4869-b078-46c8131756c3-operator-scripts\") pod \"barbican-2945-account-create-pqcv9\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.029649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de487392-74bb-41d7-bdad-637781c45a34-operator-scripts\") pod \"neutron-db-create-n6jck\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.029692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pbf\" (UniqueName: \"kubernetes.io/projected/5778d34a-8bd2-4869-b078-46c8131756c3-kube-api-access-l5pbf\") pod \"barbican-2945-account-create-pqcv9\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.029723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v5z8x\" (UniqueName: \"kubernetes.io/projected/de487392-74bb-41d7-bdad-637781c45a34-kube-api-access-v5z8x\") pod \"neutron-db-create-n6jck\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.031301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de487392-74bb-41d7-bdad-637781c45a34-operator-scripts\") pod \"neutron-db-create-n6jck\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.031609 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5778d34a-8bd2-4869-b078-46c8131756c3-operator-scripts\") pod \"barbican-2945-account-create-pqcv9\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.056897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5z8x\" (UniqueName: \"kubernetes.io/projected/de487392-74bb-41d7-bdad-637781c45a34-kube-api-access-v5z8x\") pod \"neutron-db-create-n6jck\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.060706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pbf\" (UniqueName: \"kubernetes.io/projected/5778d34a-8bd2-4869-b078-46c8131756c3-kube-api-access-l5pbf\") pod \"barbican-2945-account-create-pqcv9\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.131725 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-config-data\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.131874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-combined-ca-bundle\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.131965 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxgf\" (UniqueName: \"kubernetes.io/projected/3f91bd88-e10d-4afc-8719-7a0f28279581-kube-api-access-fdxgf\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.234047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-combined-ca-bundle\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.234118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxgf\" (UniqueName: \"kubernetes.io/projected/3f91bd88-e10d-4afc-8719-7a0f28279581-kube-api-access-fdxgf\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.234150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-config-data\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.241367 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-combined-ca-bundle\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.243613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-config-data\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.278749 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.287167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxgf\" (UniqueName: \"kubernetes.io/projected/3f91bd88-e10d-4afc-8719-7a0f28279581-kube-api-access-fdxgf\") pod \"keystone-db-sync-zpzck\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.306057 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.328335 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.475974 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bd78p"] Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.491880 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-9405-account-create-bqkzz"] Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.706515 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-251c-account-create-fzhbb"] Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.768731 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfa6871b-dd1a-4709-88d1-82a8fe102771" containerID="5a4aa70f4fba22db17e561409a167be76a9d0852043bbb448bc271b11df4a18f" exitCode=0 Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.768846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" event={"ID":"bfa6871b-dd1a-4709-88d1-82a8fe102771","Type":"ContainerDied","Data":"5a4aa70f4fba22db17e561409a167be76a9d0852043bbb448bc271b11df4a18f"} Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.786658 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bd78p" event={"ID":"cc5fa9b0-6546-4c9d-82af-04a085249145","Type":"ContainerStarted","Data":"9a16667a2b2877eae855fa817b1165858bb1856291073f9a72cee8da571fa7a4"} Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.794812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" event={"ID":"e07a0768-f1e7-47aa-a73e-c856a641c621","Type":"ContainerStarted","Data":"16c2ed66ebdcd09dc34be54f79e9256f5abf7b0dda4cf240de8291844965d895"} Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.800692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" event={"ID":"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9","Type":"ContainerStarted","Data":"e53b17935d2dd807f9a9db1b27c5af02337fbe9cab1051f49c5e56b3569c4d13"} Nov 21 12:11:44 crc kubenswrapper[4769]: I1121 12:11:44.864596 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-lrkl8"] Nov 21 12:11:44 crc kubenswrapper[4769]: W1121 12:11:44.876886 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69bf973c_6676_43f5_b866_9932164c3793.slice/crio-389ae879649e36b6acf4d82dcae9d125d4906076b28ea7cda286b062a28d1554 WatchSource:0}: Error finding container 389ae879649e36b6acf4d82dcae9d125d4906076b28ea7cda286b062a28d1554: Status 404 returned error can't find the container with id 389ae879649e36b6acf4d82dcae9d125d4906076b28ea7cda286b062a28d1554 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.051754 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-zpzck"] Nov 21 12:11:45 crc kubenswrapper[4769]: W1121 12:11:45.059840 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f91bd88_e10d_4afc_8719_7a0f28279581.slice/crio-90f9999988b84bcc5366f1b2b8bf16ebfc12ecc5697eb8d421962daa1b17fc66 WatchSource:0}: Error finding container 90f9999988b84bcc5366f1b2b8bf16ebfc12ecc5697eb8d421962daa1b17fc66: Status 404 returned error can't find the container with id 90f9999988b84bcc5366f1b2b8bf16ebfc12ecc5697eb8d421962daa1b17fc66 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.241494 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-n6jck"] Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.271136 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-2945-account-create-pqcv9"] Nov 21 12:11:45 crc kubenswrapper[4769]: W1121 12:11:45.276397 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5778d34a_8bd2_4869_b078_46c8131756c3.slice/crio-9e54a4b27b436c291463c72b87b522e4a5ff7ae1e86f4f8014258de05186a5f5 WatchSource:0}: Error finding container 9e54a4b27b436c291463c72b87b522e4a5ff7ae1e86f4f8014258de05186a5f5: Status 404 returned error can't find the container with id 9e54a4b27b436c291463c72b87b522e4a5ff7ae1e86f4f8014258de05186a5f5 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.822373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-n6jck" event={"ID":"de487392-74bb-41d7-bdad-637781c45a34","Type":"ContainerStarted","Data":"95d2424b68eed99b942747e13339acb7c2625656f84a8a1298fd9d21bb4b2964"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.822903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-n6jck" event={"ID":"de487392-74bb-41d7-bdad-637781c45a34","Type":"ContainerStarted","Data":"f57af43024a2e7bf00bab2040203fc42260ca65ea836f70fa7755d4ef5335d82"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.838973 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc5fa9b0-6546-4c9d-82af-04a085249145" containerID="6191f422b7618242b60d8366c1eb7390b51b04db2d6a9f111f868b735d95ac0b" exitCode=0 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.839064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bd78p" event={"ID":"cc5fa9b0-6546-4c9d-82af-04a085249145","Type":"ContainerDied","Data":"6191f422b7618242b60d8366c1eb7390b51b04db2d6a9f111f868b735d95ac0b"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.844376 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-n6jck" podStartSLOduration=2.844355652 podStartE2EDuration="2.844355652s" podCreationTimestamp="2025-11-21 12:11:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:11:45.840842648 +0000 UTC m=+1264.541504466" watchObservedRunningTime="2025-11-21 12:11:45.844355652 +0000 UTC m=+1264.545017470" Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.845095 4769 generic.go:334] "Generic (PLEG): container finished" podID="e07a0768-f1e7-47aa-a73e-c856a641c621" containerID="dee31fe2775b1e34830fe9986dc8616114feab0d34df42f2a91357a77200ee03" exitCode=0 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.845219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" event={"ID":"e07a0768-f1e7-47aa-a73e-c856a641c621","Type":"ContainerDied","Data":"dee31fe2775b1e34830fe9986dc8616114feab0d34df42f2a91357a77200ee03"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.850789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" event={"ID":"5778d34a-8bd2-4869-b078-46c8131756c3","Type":"ContainerStarted","Data":"5f7b3218f8211f27057d494c150e5c9636162f92765d5df7789425e3e877974c"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.850865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" event={"ID":"5778d34a-8bd2-4869-b078-46c8131756c3","Type":"ContainerStarted","Data":"9e54a4b27b436c291463c72b87b522e4a5ff7ae1e86f4f8014258de05186a5f5"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.860507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" event={"ID":"69bf973c-6676-43f5-b866-9932164c3793","Type":"ContainerDied","Data":"487d6e4c85f1536f074426ff6e4b51472bc80c7be9c35ef956e4c16837aa77df"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.860612 4769 generic.go:334] "Generic (PLEG): container finished" podID="69bf973c-6676-43f5-b866-9932164c3793" containerID="487d6e4c85f1536f074426ff6e4b51472bc80c7be9c35ef956e4c16837aa77df" exitCode=0 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.860790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" event={"ID":"69bf973c-6676-43f5-b866-9932164c3793","Type":"ContainerStarted","Data":"389ae879649e36b6acf4d82dcae9d125d4906076b28ea7cda286b062a28d1554"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.864610 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" containerID="b0ddacd8106b94f439abf6e29c46f39ea5cfc8dab85696d86af333984b62b792" exitCode=0 Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.864788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" event={"ID":"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9","Type":"ContainerDied","Data":"b0ddacd8106b94f439abf6e29c46f39ea5cfc8dab85696d86af333984b62b792"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.868005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" event={"ID":"3f91bd88-e10d-4afc-8719-7a0f28279581","Type":"ContainerStarted","Data":"90f9999988b84bcc5366f1b2b8bf16ebfc12ecc5697eb8d421962daa1b17fc66"} Nov 21 12:11:45 crc kubenswrapper[4769]: I1121 12:11:45.903507 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" podStartSLOduration=2.9034830940000003 podStartE2EDuration="2.903483094s" podCreationTimestamp="2025-11-21 12:11:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:11:45.897488514 +0000 UTC m=+1264.598150332" watchObservedRunningTime="2025-11-21 12:11:45.903483094 +0000 UTC m=+1264.604144912" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.264262 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.425929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-dispersionconf\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.426154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-combined-ca-bundle\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.426200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm2k8\" (UniqueName: \"kubernetes.io/projected/bfa6871b-dd1a-4709-88d1-82a8fe102771-kube-api-access-qm2k8\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.426276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-swiftconf\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.426323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/bfa6871b-dd1a-4709-88d1-82a8fe102771-etc-swift\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.426392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-ring-data-devices\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.426418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-scripts\") pod \"bfa6871b-dd1a-4709-88d1-82a8fe102771\" (UID: \"bfa6871b-dd1a-4709-88d1-82a8fe102771\") " Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.428245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa6871b-dd1a-4709-88d1-82a8fe102771-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.433632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.434788 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa6871b-dd1a-4709-88d1-82a8fe102771-kube-api-access-qm2k8" (OuterVolumeSpecName: "kube-api-access-qm2k8") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "kube-api-access-qm2k8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.444576 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.457680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.463383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-scripts" (OuterVolumeSpecName: "scripts") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.473805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "bfa6871b-dd1a-4709-88d1-82a8fe102771" (UID: "bfa6871b-dd1a-4709-88d1-82a8fe102771"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.530909 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.530946 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/bfa6871b-dd1a-4709-88d1-82a8fe102771-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.530956 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.530970 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bfa6871b-dd1a-4709-88d1-82a8fe102771-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.530980 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.530990 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfa6871b-dd1a-4709-88d1-82a8fe102771-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.531001 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qm2k8\" (UniqueName: \"kubernetes.io/projected/bfa6871b-dd1a-4709-88d1-82a8fe102771-kube-api-access-qm2k8\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.891937 4769 generic.go:334] "Generic (PLEG): container finished" podID="de487392-74bb-41d7-bdad-637781c45a34" containerID="95d2424b68eed99b942747e13339acb7c2625656f84a8a1298fd9d21bb4b2964" exitCode=0 Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.892097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-n6jck" event={"ID":"de487392-74bb-41d7-bdad-637781c45a34","Type":"ContainerDied","Data":"95d2424b68eed99b942747e13339acb7c2625656f84a8a1298fd9d21bb4b2964"} Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.904503 4769 generic.go:334] "Generic (PLEG): container finished" podID="5778d34a-8bd2-4869-b078-46c8131756c3" containerID="5f7b3218f8211f27057d494c150e5c9636162f92765d5df7789425e3e877974c" exitCode=0 Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.904616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" event={"ID":"5778d34a-8bd2-4869-b078-46c8131756c3","Type":"ContainerDied","Data":"5f7b3218f8211f27057d494c150e5c9636162f92765d5df7789425e3e877974c"} Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.921602 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.921821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-8nw95" event={"ID":"bfa6871b-dd1a-4709-88d1-82a8fe102771","Type":"ContainerDied","Data":"6faf20d78e309c5fbafcc8a480a1778ba95a219f0df959c87efdd3a312c0eb63"} Nov 21 12:11:46 crc kubenswrapper[4769]: I1121 12:11:46.922108 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6faf20d78e309c5fbafcc8a480a1778ba95a219f0df959c87efdd3a312c0eb63" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.351690 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.456605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69bf973c-6676-43f5-b866-9932164c3793-operator-scripts\") pod \"69bf973c-6676-43f5-b866-9932164c3793\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.456713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm9pv\" (UniqueName: \"kubernetes.io/projected/69bf973c-6676-43f5-b866-9932164c3793-kube-api-access-rm9pv\") pod \"69bf973c-6676-43f5-b866-9932164c3793\" (UID: \"69bf973c-6676-43f5-b866-9932164c3793\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.457642 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69bf973c-6676-43f5-b866-9932164c3793-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "69bf973c-6676-43f5-b866-9932164c3793" (UID: "69bf973c-6676-43f5-b866-9932164c3793"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.464482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69bf973c-6676-43f5-b866-9932164c3793-kube-api-access-rm9pv" (OuterVolumeSpecName: "kube-api-access-rm9pv") pod "69bf973c-6676-43f5-b866-9932164c3793" (UID: "69bf973c-6676-43f5-b866-9932164c3793"). InnerVolumeSpecName "kube-api-access-rm9pv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.559933 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69bf973c-6676-43f5-b866-9932164c3793-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.559969 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rm9pv\" (UniqueName: \"kubernetes.io/projected/69bf973c-6676-43f5-b866-9932164c3793-kube-api-access-rm9pv\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.676798 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.698150 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.702113 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.763186 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tvjt\" (UniqueName: \"kubernetes.io/projected/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-kube-api-access-2tvjt\") pod \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.763324 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e07a0768-f1e7-47aa-a73e-c856a641c621-operator-scripts\") pod \"e07a0768-f1e7-47aa-a73e-c856a641c621\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.763355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqt7n\" (UniqueName: \"kubernetes.io/projected/cc5fa9b0-6546-4c9d-82af-04a085249145-kube-api-access-mqt7n\") pod \"cc5fa9b0-6546-4c9d-82af-04a085249145\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.763403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpf76\" (UniqueName: \"kubernetes.io/projected/e07a0768-f1e7-47aa-a73e-c856a641c621-kube-api-access-xpf76\") pod \"e07a0768-f1e7-47aa-a73e-c856a641c621\" (UID: \"e07a0768-f1e7-47aa-a73e-c856a641c621\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.763467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-operator-scripts\") pod \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\" (UID: \"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.763830 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07a0768-f1e7-47aa-a73e-c856a641c621-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e07a0768-f1e7-47aa-a73e-c856a641c621" (UID: "e07a0768-f1e7-47aa-a73e-c856a641c621"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.764114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc5fa9b0-6546-4c9d-82af-04a085249145-operator-scripts\") pod \"cc5fa9b0-6546-4c9d-82af-04a085249145\" (UID: \"cc5fa9b0-6546-4c9d-82af-04a085249145\") " Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.764834 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e07a0768-f1e7-47aa-a73e-c856a641c621-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.765306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5fa9b0-6546-4c9d-82af-04a085249145-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cc5fa9b0-6546-4c9d-82af-04a085249145" (UID: "cc5fa9b0-6546-4c9d-82af-04a085249145"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.766114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" (UID: "5ecbc593-a1f2-412e-b4b7-f1a3d486daa9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.766925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5fa9b0-6546-4c9d-82af-04a085249145-kube-api-access-mqt7n" (OuterVolumeSpecName: "kube-api-access-mqt7n") pod "cc5fa9b0-6546-4c9d-82af-04a085249145" (UID: "cc5fa9b0-6546-4c9d-82af-04a085249145"). InnerVolumeSpecName "kube-api-access-mqt7n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.768036 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-kube-api-access-2tvjt" (OuterVolumeSpecName: "kube-api-access-2tvjt") pod "5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" (UID: "5ecbc593-a1f2-412e-b4b7-f1a3d486daa9"). InnerVolumeSpecName "kube-api-access-2tvjt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.768111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07a0768-f1e7-47aa-a73e-c856a641c621-kube-api-access-xpf76" (OuterVolumeSpecName: "kube-api-access-xpf76") pod "e07a0768-f1e7-47aa-a73e-c856a641c621" (UID: "e07a0768-f1e7-47aa-a73e-c856a641c621"). InnerVolumeSpecName "kube-api-access-xpf76". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.866908 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2tvjt\" (UniqueName: \"kubernetes.io/projected/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-kube-api-access-2tvjt\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.867227 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mqt7n\" (UniqueName: \"kubernetes.io/projected/cc5fa9b0-6546-4c9d-82af-04a085249145-kube-api-access-mqt7n\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.867237 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xpf76\" (UniqueName: \"kubernetes.io/projected/e07a0768-f1e7-47aa-a73e-c856a641c621-kube-api-access-xpf76\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.867248 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.867260 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc5fa9b0-6546-4c9d-82af-04a085249145-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.932376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" event={"ID":"69bf973c-6676-43f5-b866-9932164c3793","Type":"ContainerDied","Data":"389ae879649e36b6acf4d82dcae9d125d4906076b28ea7cda286b062a28d1554"} Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.932431 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="389ae879649e36b6acf4d82dcae9d125d4906076b28ea7cda286b062a28d1554" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.932400 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-lrkl8" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.938057 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.938065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-251c-account-create-fzhbb" event={"ID":"5ecbc593-a1f2-412e-b4b7-f1a3d486daa9","Type":"ContainerDied","Data":"e53b17935d2dd807f9a9db1b27c5af02337fbe9cab1051f49c5e56b3569c4d13"} Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.938100 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e53b17935d2dd807f9a9db1b27c5af02337fbe9cab1051f49c5e56b3569c4d13" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.940078 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" containerID="0c4da3ffea16b594dd3d4d115d32f42d562182ce9229a2fc7861062af357208f" exitCode=0 Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.940162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-xb74v" event={"ID":"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12","Type":"ContainerDied","Data":"0c4da3ffea16b594dd3d4d115d32f42d562182ce9229a2fc7861062af357208f"} Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.943069 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bd78p" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.943625 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bd78p" event={"ID":"cc5fa9b0-6546-4c9d-82af-04a085249145","Type":"ContainerDied","Data":"9a16667a2b2877eae855fa817b1165858bb1856291073f9a72cee8da571fa7a4"} Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.943685 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a16667a2b2877eae855fa817b1165858bb1856291073f9a72cee8da571fa7a4" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.947309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" event={"ID":"e07a0768-f1e7-47aa-a73e-c856a641c621","Type":"ContainerDied","Data":"16c2ed66ebdcd09dc34be54f79e9256f5abf7b0dda4cf240de8291844965d895"} Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.947370 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16c2ed66ebdcd09dc34be54f79e9256f5abf7b0dda4cf240de8291844965d895" Nov 21 12:11:47 crc kubenswrapper[4769]: I1121 12:11:47.947466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-9405-account-create-bqkzz" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.878735 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.888868 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.903694 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971574 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5z8x\" (UniqueName: \"kubernetes.io/projected/de487392-74bb-41d7-bdad-637781c45a34-kube-api-access-v5z8x\") pod \"de487392-74bb-41d7-bdad-637781c45a34\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5pbf\" (UniqueName: \"kubernetes.io/projected/5778d34a-8bd2-4869-b078-46c8131756c3-kube-api-access-l5pbf\") pod \"5778d34a-8bd2-4869-b078-46c8131756c3\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5778d34a-8bd2-4869-b078-46c8131756c3-operator-scripts\") pod \"5778d34a-8bd2-4869-b078-46c8131756c3\" (UID: \"5778d34a-8bd2-4869-b078-46c8131756c3\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-config-data\") pod \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de487392-74bb-41d7-bdad-637781c45a34-operator-scripts\") pod \"de487392-74bb-41d7-bdad-637781c45a34\" (UID: \"de487392-74bb-41d7-bdad-637781c45a34\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-db-sync-config-data\") pod \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwvgt\" (UniqueName: \"kubernetes.io/projected/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-kube-api-access-vwvgt\") pod \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.971985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-combined-ca-bundle\") pod \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\" (UID: \"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12\") " Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.973604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5778d34a-8bd2-4869-b078-46c8131756c3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5778d34a-8bd2-4869-b078-46c8131756c3" (UID: "5778d34a-8bd2-4869-b078-46c8131756c3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.974039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de487392-74bb-41d7-bdad-637781c45a34-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "de487392-74bb-41d7-bdad-637781c45a34" (UID: "de487392-74bb-41d7-bdad-637781c45a34"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.979836 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de487392-74bb-41d7-bdad-637781c45a34-kube-api-access-v5z8x" (OuterVolumeSpecName: "kube-api-access-v5z8x") pod "de487392-74bb-41d7-bdad-637781c45a34" (UID: "de487392-74bb-41d7-bdad-637781c45a34"). InnerVolumeSpecName "kube-api-access-v5z8x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.980222 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5778d34a-8bd2-4869-b078-46c8131756c3-kube-api-access-l5pbf" (OuterVolumeSpecName: "kube-api-access-l5pbf") pod "5778d34a-8bd2-4869-b078-46c8131756c3" (UID: "5778d34a-8bd2-4869-b078-46c8131756c3"). InnerVolumeSpecName "kube-api-access-l5pbf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.982545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-kube-api-access-vwvgt" (OuterVolumeSpecName: "kube-api-access-vwvgt") pod "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" (UID: "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12"). InnerVolumeSpecName "kube-api-access-vwvgt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:11:52 crc kubenswrapper[4769]: I1121 12:11:52.984376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" (UID: "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.000947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-n6jck" event={"ID":"de487392-74bb-41d7-bdad-637781c45a34","Type":"ContainerDied","Data":"f57af43024a2e7bf00bab2040203fc42260ca65ea836f70fa7755d4ef5335d82"} Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.000979 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-n6jck" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.001007 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f57af43024a2e7bf00bab2040203fc42260ca65ea836f70fa7755d4ef5335d82" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.002811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-xb74v" event={"ID":"8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12","Type":"ContainerDied","Data":"f9f3d426cbcba3466a016835998075b9ef3b60de28c989b199ac0ebceace9fef"} Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.002838 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9f3d426cbcba3466a016835998075b9ef3b60de28c989b199ac0ebceace9fef" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.002916 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-xb74v" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.005677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" event={"ID":"5778d34a-8bd2-4869-b078-46c8131756c3","Type":"ContainerDied","Data":"9e54a4b27b436c291463c72b87b522e4a5ff7ae1e86f4f8014258de05186a5f5"} Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.005715 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e54a4b27b436c291463c72b87b522e4a5ff7ae1e86f4f8014258de05186a5f5" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.005762 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-2945-account-create-pqcv9" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.009296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" (UID: "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.034062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-config-data" (OuterVolumeSpecName: "config-data") pod "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" (UID: "8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073743 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073800 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de487392-74bb-41d7-bdad-637781c45a34-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073821 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073838 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vwvgt\" (UniqueName: \"kubernetes.io/projected/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-kube-api-access-vwvgt\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073855 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073874 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v5z8x\" (UniqueName: \"kubernetes.io/projected/de487392-74bb-41d7-bdad-637781c45a34-kube-api-access-v5z8x\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073891 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l5pbf\" (UniqueName: \"kubernetes.io/projected/5778d34a-8bd2-4869-b078-46c8131756c3-kube-api-access-l5pbf\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:53 crc kubenswrapper[4769]: I1121 12:11:53.073903 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5778d34a-8bd2-4869-b078-46c8131756c3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:11:55 crc kubenswrapper[4769]: I1121 12:11:55.023493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" event={"ID":"3f91bd88-e10d-4afc-8719-7a0f28279581","Type":"ContainerStarted","Data":"54afa3d44db3172825ebd6b27ef97095e76608384e8c8c50abf829b5940612e4"} Nov 21 12:11:55 crc kubenswrapper[4769]: I1121 12:11:55.054179 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" podStartSLOduration=2.622528096 podStartE2EDuration="12.054161355s" podCreationTimestamp="2025-11-21 12:11:43 +0000 UTC" firstStartedPulling="2025-11-21 12:11:45.062649241 +0000 UTC m=+1263.763311059" lastFinishedPulling="2025-11-21 12:11:54.49428249 +0000 UTC m=+1273.194944318" observedRunningTime="2025-11-21 12:11:55.0487464 +0000 UTC m=+1273.749408248" watchObservedRunningTime="2025-11-21 12:11:55.054161355 +0000 UTC m=+1273.754823173" Nov 21 12:11:59 crc kubenswrapper[4769]: I1121 12:11:59.058357 4769 generic.go:334] "Generic (PLEG): container finished" podID="3f91bd88-e10d-4afc-8719-7a0f28279581" containerID="54afa3d44db3172825ebd6b27ef97095e76608384e8c8c50abf829b5940612e4" exitCode=0 Nov 21 12:11:59 crc kubenswrapper[4769]: I1121 12:11:59.058488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" event={"ID":"3f91bd88-e10d-4afc-8719-7a0f28279581","Type":"ContainerDied","Data":"54afa3d44db3172825ebd6b27ef97095e76608384e8c8c50abf829b5940612e4"} Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.456043 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.514383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-config-data\") pod \"3f91bd88-e10d-4afc-8719-7a0f28279581\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.514602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-combined-ca-bundle\") pod \"3f91bd88-e10d-4afc-8719-7a0f28279581\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.514723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdxgf\" (UniqueName: \"kubernetes.io/projected/3f91bd88-e10d-4afc-8719-7a0f28279581-kube-api-access-fdxgf\") pod \"3f91bd88-e10d-4afc-8719-7a0f28279581\" (UID: \"3f91bd88-e10d-4afc-8719-7a0f28279581\") " Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.522996 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f91bd88-e10d-4afc-8719-7a0f28279581-kube-api-access-fdxgf" (OuterVolumeSpecName: "kube-api-access-fdxgf") pod "3f91bd88-e10d-4afc-8719-7a0f28279581" (UID: "3f91bd88-e10d-4afc-8719-7a0f28279581"). InnerVolumeSpecName "kube-api-access-fdxgf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.544183 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f91bd88-e10d-4afc-8719-7a0f28279581" (UID: "3f91bd88-e10d-4afc-8719-7a0f28279581"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.567023 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-config-data" (OuterVolumeSpecName: "config-data") pod "3f91bd88-e10d-4afc-8719-7a0f28279581" (UID: "3f91bd88-e10d-4afc-8719-7a0f28279581"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.617058 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.617129 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fdxgf\" (UniqueName: \"kubernetes.io/projected/3f91bd88-e10d-4afc-8719-7a0f28279581-kube-api-access-fdxgf\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:00 crc kubenswrapper[4769]: I1121 12:12:00.617145 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f91bd88-e10d-4afc-8719-7a0f28279581-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.082184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" event={"ID":"3f91bd88-e10d-4afc-8719-7a0f28279581","Type":"ContainerDied","Data":"90f9999988b84bcc5366f1b2b8bf16ebfc12ecc5697eb8d421962daa1b17fc66"} Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.082289 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90f9999988b84bcc5366f1b2b8bf16ebfc12ecc5697eb8d421962daa1b17fc66" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.082420 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-zpzck" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.228994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.234853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"swift-storage-0\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.374405 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-hq8w2"] Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.374955 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de487392-74bb-41d7-bdad-637781c45a34" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.374983 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de487392-74bb-41d7-bdad-637781c45a34" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375045 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e07a0768-f1e7-47aa-a73e-c856a641c621" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375057 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07a0768-f1e7-47aa-a73e-c856a641c621" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375079 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5778d34a-8bd2-4869-b078-46c8131756c3" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375092 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5778d34a-8bd2-4869-b078-46c8131756c3" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375116 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" containerName="glance-db-sync" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375127 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" containerName="glance-db-sync" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375151 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfa6871b-dd1a-4709-88d1-82a8fe102771" containerName="swift-ring-rebalance" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375165 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa6871b-dd1a-4709-88d1-82a8fe102771" containerName="swift-ring-rebalance" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375180 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="69bf973c-6676-43f5-b866-9932164c3793" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375222 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bf973c-6676-43f5-b866-9932164c3793" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375252 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375263 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375287 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3f91bd88-e10d-4afc-8719-7a0f28279581" containerName="keystone-db-sync" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375298 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f91bd88-e10d-4afc-8719-7a0f28279581" containerName="keystone-db-sync" Nov 21 12:12:01 crc kubenswrapper[4769]: E1121 12:12:01.375311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc5fa9b0-6546-4c9d-82af-04a085249145" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375321 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5fa9b0-6546-4c9d-82af-04a085249145" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375619 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc5fa9b0-6546-4c9d-82af-04a085249145" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375658 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfa6871b-dd1a-4709-88d1-82a8fe102771" containerName="swift-ring-rebalance" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375708 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e07a0768-f1e7-47aa-a73e-c856a641c621" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375743 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de487392-74bb-41d7-bdad-637781c45a34" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375785 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" containerName="glance-db-sync" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375807 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3f91bd88-e10d-4afc-8719-7a0f28279581" containerName="keystone-db-sync" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375837 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5778d34a-8bd2-4869-b078-46c8131756c3" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375864 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="69bf973c-6676-43f5-b866-9932164c3793" containerName="mariadb-database-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.375879 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" containerName="mariadb-account-create" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.376652 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.380692 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.381129 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.381541 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.381997 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.382659 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-ccsfx" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.382987 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.403294 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-hq8w2"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.449389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-credential-keys\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.449447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-config-data\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.449565 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srnvp\" (UniqueName: \"kubernetes.io/projected/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-kube-api-access-srnvp\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.449716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-fernet-keys\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.449805 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-combined-ca-bundle\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.449836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-scripts\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.553501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-credential-keys\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.553549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-config-data\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.553575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srnvp\" (UniqueName: \"kubernetes.io/projected/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-kube-api-access-srnvp\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.553598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-fernet-keys\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.553618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-combined-ca-bundle\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.553636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-scripts\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.561214 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-scripts\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.561675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-config-data\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.567179 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-combined-ca-bundle\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.570415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-fernet-keys\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.581732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-credential-keys\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.606005 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-xplxh"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.607443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.612399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-bl75q" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.612419 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.613770 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.624583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srnvp\" (UniqueName: \"kubernetes.io/projected/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-kube-api-access-srnvp\") pod \"keystone-bootstrap-hq8w2\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.652631 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-vv5ns"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.654321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.659946 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-ggz8t" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.660273 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.660414 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.666087 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zfsv\" (UniqueName: \"kubernetes.io/projected/7a39442e-588a-4512-a91d-d5a1daa8ea1b-kube-api-access-4zfsv\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.666432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-combined-ca-bundle\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.666576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-config\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.695350 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-xplxh"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.744593 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-vv5ns"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.764755 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hd8sk"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.766027 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.767969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-scripts\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.768019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4zfsv\" (UniqueName: \"kubernetes.io/projected/7a39442e-588a-4512-a91d-d5a1daa8ea1b-kube-api-access-4zfsv\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.768088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c03136-58e9-4dc8-b4db-7ba52267e180-logs\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.768123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-combined-ca-bundle\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.768155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-combined-ca-bundle\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.768277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-config\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.773103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh989\" (UniqueName: \"kubernetes.io/projected/78c03136-58e9-4dc8-b4db-7ba52267e180-kube-api-access-vh989\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.773225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-config-data\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.773503 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-ccd7b" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.774076 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.780930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-config\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.792677 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.795374 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hd8sk"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.795545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-combined-ca-bundle\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.799097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zfsv\" (UniqueName: \"kubernetes.io/projected/7a39442e-588a-4512-a91d-d5a1daa8ea1b-kube-api-access-4zfsv\") pod \"neutron-db-sync-xplxh\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.805627 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.811109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.813460 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.817296 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.820481 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-jmrp4"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.821862 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.824596 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-j82mn" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.825111 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.839385 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.849949 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-jmrp4"] Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.856767 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.885480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-config-data\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.885559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-scripts\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.885590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-scripts\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2mgj\" (UniqueName: \"kubernetes.io/projected/0b11a06d-8213-4627-9c7d-f293782167ef-kube-api-access-h2mgj\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c03136-58e9-4dc8-b4db-7ba52267e180-logs\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0b11a06d-8213-4627-9c7d-f293782167ef-etc-machine-id\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-combined-ca-bundle\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-combined-ca-bundle\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890800 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-db-sync-config-data\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-combined-ca-bundle\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.890895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-config-data\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.891385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlqr\" (UniqueName: \"kubernetes.io/projected/684fb2d3-5048-4358-9a86-defc40bc3f98-kube-api-access-2vlqr\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.891437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-log-httpd\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.892201 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqxc\" (UniqueName: \"kubernetes.io/projected/34633895-031b-4601-beec-01aa64870afb-kube-api-access-mtqxc\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.892268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vh989\" (UniqueName: \"kubernetes.io/projected/78c03136-58e9-4dc8-b4db-7ba52267e180-kube-api-access-vh989\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.892307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-config-data\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.892368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-db-sync-config-data\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.892448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-run-httpd\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.892497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-scripts\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.897034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c03136-58e9-4dc8-b4db-7ba52267e180-logs\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.908968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-scripts\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.919404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-combined-ca-bundle\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.919811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-config-data\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.924104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh989\" (UniqueName: \"kubernetes.io/projected/78c03136-58e9-4dc8-b4db-7ba52267e180-kube-api-access-vh989\") pod \"placement-db-sync-vv5ns\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.983010 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.994860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-config-data\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.994948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-scripts\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.994979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-scripts\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h2mgj\" (UniqueName: \"kubernetes.io/projected/0b11a06d-8213-4627-9c7d-f293782167ef-kube-api-access-h2mgj\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0b11a06d-8213-4627-9c7d-f293782167ef-etc-machine-id\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995183 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-combined-ca-bundle\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-db-sync-config-data\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-combined-ca-bundle\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995306 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-config-data\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlqr\" (UniqueName: \"kubernetes.io/projected/684fb2d3-5048-4358-9a86-defc40bc3f98-kube-api-access-2vlqr\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995372 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-log-httpd\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqxc\" (UniqueName: \"kubernetes.io/projected/34633895-031b-4601-beec-01aa64870afb-kube-api-access-mtqxc\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-db-sync-config-data\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.995506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-run-httpd\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.996081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-run-httpd\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.996378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-log-httpd\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:01 crc kubenswrapper[4769]: I1121 12:12:01.998367 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0b11a06d-8213-4627-9c7d-f293782167ef-etc-machine-id\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.001849 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-config-data\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.002581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-combined-ca-bundle\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.003541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-config-data\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.003699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-db-sync-config-data\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.006707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.006735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-combined-ca-bundle\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.007042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-scripts\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.011229 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-scripts\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.012811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.015726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlqr\" (UniqueName: \"kubernetes.io/projected/684fb2d3-5048-4358-9a86-defc40bc3f98-kube-api-access-2vlqr\") pod \"barbican-db-sync-jmrp4\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.015780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-db-sync-config-data\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.023046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2mgj\" (UniqueName: \"kubernetes.io/projected/0b11a06d-8213-4627-9c7d-f293782167ef-kube-api-access-h2mgj\") pod \"cinder-db-sync-hd8sk\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.023495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqxc\" (UniqueName: \"kubernetes.io/projected/34633895-031b-4601-beec-01aa64870afb-kube-api-access-mtqxc\") pod \"ceilometer-0\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.040264 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.092108 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.162811 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.172302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.220559 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.424703 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-hq8w2"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.562963 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.565462 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.570052 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.570457 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.570601 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-b87t4" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.618591 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.628056 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.645259 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-xplxh"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.650416 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.660085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.675239 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.675814 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.688450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.727458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.727993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-config-data\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.728053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.728090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-scripts\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.728120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-logs\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.728148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.728172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.728319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxv2\" (UniqueName: \"kubernetes.io/projected/4465fead-86cc-429d-827c-dfd4fbfaf85e-kube-api-access-xkxv2\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68jls\" (UniqueName: \"kubernetes.io/projected/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-kube-api-access-68jls\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-config-data\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.830967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-logs\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-scripts\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-logs\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.831240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxv2\" (UniqueName: \"kubernetes.io/projected/4465fead-86cc-429d-827c-dfd4fbfaf85e-kube-api-access-xkxv2\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.832633 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-logs\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.833077 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.834706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.842839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-config-data\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.845759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.846396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.846951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-scripts\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.855837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxv2\" (UniqueName: \"kubernetes.io/projected/4465fead-86cc-429d-827c-dfd4fbfaf85e-kube-api-access-xkxv2\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.875320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.913046 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936559 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-logs\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.936769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68jls\" (UniqueName: \"kubernetes.io/projected/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-kube-api-access-68jls\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.938681 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.938819 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.939668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-logs\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.942605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.943395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.947421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.948102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.957967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68jls\" (UniqueName: \"kubernetes.io/projected/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-kube-api-access-68jls\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.990840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:02 crc kubenswrapper[4769]: I1121 12:12:02.992475 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:12:03 crc kubenswrapper[4769]: W1121 12:12:03.012534 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34633895_031b_4601_beec_01aa64870afb.slice/crio-2e9746743b2af8780a75c0c35e7024b6ae8eadb86c29ec29d89eb8fb99bc979d WatchSource:0}: Error finding container 2e9746743b2af8780a75c0c35e7024b6ae8eadb86c29ec29d89eb8fb99bc979d: Status 404 returned error can't find the container with id 2e9746743b2af8780a75c0c35e7024b6ae8eadb86c29ec29d89eb8fb99bc979d Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.012619 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.046749 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-vv5ns"] Nov 21 12:12:03 crc kubenswrapper[4769]: W1121 12:12:03.096893 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78c03136_58e9_4dc8_b4db_7ba52267e180.slice/crio-c725241aa0a6464b2e38786e2e112899c2ff1b80045dfa5065d9e4ed7cc2c938 WatchSource:0}: Error finding container c725241aa0a6464b2e38786e2e112899c2ff1b80045dfa5065d9e4ed7cc2c938: Status 404 returned error can't find the container with id c725241aa0a6464b2e38786e2e112899c2ff1b80045dfa5065d9e4ed7cc2c938 Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.132818 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" event={"ID":"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e","Type":"ContainerStarted","Data":"8899cb309299ed0ffc914aa64f5109bc9d73d1d18f55832df91c441f6295c6ee"} Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.132893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" event={"ID":"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e","Type":"ContainerStarted","Data":"7e3a75cb4c76b68666d8b043207670f777404d2b8ecff8e0374b62e31e381295"} Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.147772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"34633895-031b-4601-beec-01aa64870afb","Type":"ContainerStarted","Data":"2e9746743b2af8780a75c0c35e7024b6ae8eadb86c29ec29d89eb8fb99bc979d"} Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.150748 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hd8sk"] Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.152158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"141eb42a42c521c78bfdd39e6959c40da53d213814cf190885ccec6f03c5819a"} Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.160901 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" podStartSLOduration=2.160885145 podStartE2EDuration="2.160885145s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:03.15846191 +0000 UTC m=+1281.859123738" watchObservedRunningTime="2025-11-21 12:12:03.160885145 +0000 UTC m=+1281.861546963" Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.161370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" event={"ID":"7a39442e-588a-4512-a91d-d5a1daa8ea1b","Type":"ContainerStarted","Data":"ae9a9c9bd0648abb77ecc56e9aae7fe4d68bfcb89ff19bceb5249de90841994e"} Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.166357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" event={"ID":"78c03136-58e9-4dc8-b4db-7ba52267e180","Type":"ContainerStarted","Data":"c725241aa0a6464b2e38786e2e112899c2ff1b80045dfa5065d9e4ed7cc2c938"} Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.257352 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-jmrp4"] Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.523999 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:03 crc kubenswrapper[4769]: I1121 12:12:03.844875 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:04 crc kubenswrapper[4769]: I1121 12:12:04.180950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" event={"ID":"684fb2d3-5048-4358-9a86-defc40bc3f98","Type":"ContainerStarted","Data":"c5c58ca7a1ab2d5cfc1bd1db0400f0646350777e34e2b21cae210d4a831ded00"} Nov 21 12:12:04 crc kubenswrapper[4769]: I1121 12:12:04.183102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4465fead-86cc-429d-827c-dfd4fbfaf85e","Type":"ContainerStarted","Data":"55a5bae87f1591ce4a6ef71277c185a7561ab7219632aaaf8479b72f2726a688"} Nov 21 12:12:04 crc kubenswrapper[4769]: I1121 12:12:04.186335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" event={"ID":"0b11a06d-8213-4627-9c7d-f293782167ef","Type":"ContainerStarted","Data":"a68d5e0bad6280acbf5838bf266ddef93ad44a6effa28c2d857cc0e3d1f44e1a"} Nov 21 12:12:04 crc kubenswrapper[4769]: I1121 12:12:04.688875 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:04 crc kubenswrapper[4769]: I1121 12:12:04.753992 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:12:04 crc kubenswrapper[4769]: I1121 12:12:04.786273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:05 crc kubenswrapper[4769]: I1121 12:12:05.210746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4465fead-86cc-429d-827c-dfd4fbfaf85e","Type":"ContainerStarted","Data":"fd7a929ede5f1cd1a8a8ed11c7347be9c9e29bb6c3617408e0ec6f74cfbd01bc"} Nov 21 12:12:05 crc kubenswrapper[4769]: I1121 12:12:05.219224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"945c32e350c847e0aa9da2e6f054178271e0c145ed13e0c0fe29a4c6ea33fdac"} Nov 21 12:12:05 crc kubenswrapper[4769]: I1121 12:12:05.222817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ca0d8f35-9d0d-47e2-8864-7af45d771a6d","Type":"ContainerStarted","Data":"59c277a93d7d285e001c01bd23c951e7af3fd0403b071ade875c82454ddea742"} Nov 21 12:12:06 crc kubenswrapper[4769]: I1121 12:12:06.236716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"5af4e4a2d044d5cb850f805f8996194bff8c44a4651a70d9a5dd2a8bd18805e3"} Nov 21 12:12:06 crc kubenswrapper[4769]: I1121 12:12:06.239001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ca0d8f35-9d0d-47e2-8864-7af45d771a6d","Type":"ContainerStarted","Data":"3dd3cb5e4088ae744f5813ec412e79c13bbfe0b4a0f526ce07f3acc826664722"} Nov 21 12:12:06 crc kubenswrapper[4769]: I1121 12:12:06.241861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4465fead-86cc-429d-827c-dfd4fbfaf85e","Type":"ContainerStarted","Data":"28411ca64b27f68b288e03c9decf3e87b14ee552bd900c55d27cdefbe32468fb"} Nov 21 12:12:08 crc kubenswrapper[4769]: I1121 12:12:08.278537 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-log" containerID="cri-o://fd7a929ede5f1cd1a8a8ed11c7347be9c9e29bb6c3617408e0ec6f74cfbd01bc" gracePeriod=30 Nov 21 12:12:08 crc kubenswrapper[4769]: I1121 12:12:08.279099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"ca6b15428291fe150460b7d7882eebf311cbba0fcecfb1f7d9f74590dc5fe81b"} Nov 21 12:12:08 crc kubenswrapper[4769]: I1121 12:12:08.279250 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-httpd" containerID="cri-o://28411ca64b27f68b288e03c9decf3e87b14ee552bd900c55d27cdefbe32468fb" gracePeriod=30 Nov 21 12:12:08 crc kubenswrapper[4769]: I1121 12:12:08.308637 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=7.308598749 podStartE2EDuration="7.308598749s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:08.301374085 +0000 UTC m=+1287.002035903" watchObservedRunningTime="2025-11-21 12:12:08.308598749 +0000 UTC m=+1287.009260567" Nov 21 12:12:09 crc kubenswrapper[4769]: I1121 12:12:09.291047 4769 generic.go:334] "Generic (PLEG): container finished" podID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerID="28411ca64b27f68b288e03c9decf3e87b14ee552bd900c55d27cdefbe32468fb" exitCode=0 Nov 21 12:12:09 crc kubenswrapper[4769]: I1121 12:12:09.291548 4769 generic.go:334] "Generic (PLEG): container finished" podID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerID="fd7a929ede5f1cd1a8a8ed11c7347be9c9e29bb6c3617408e0ec6f74cfbd01bc" exitCode=143 Nov 21 12:12:09 crc kubenswrapper[4769]: I1121 12:12:09.291152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4465fead-86cc-429d-827c-dfd4fbfaf85e","Type":"ContainerDied","Data":"28411ca64b27f68b288e03c9decf3e87b14ee552bd900c55d27cdefbe32468fb"} Nov 21 12:12:09 crc kubenswrapper[4769]: I1121 12:12:09.291643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4465fead-86cc-429d-827c-dfd4fbfaf85e","Type":"ContainerDied","Data":"fd7a929ede5f1cd1a8a8ed11c7347be9c9e29bb6c3617408e0ec6f74cfbd01bc"} Nov 21 12:12:09 crc kubenswrapper[4769]: I1121 12:12:09.295711 4769 generic.go:334] "Generic (PLEG): container finished" podID="b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" containerID="8899cb309299ed0ffc914aa64f5109bc9d73d1d18f55832df91c441f6295c6ee" exitCode=0 Nov 21 12:12:09 crc kubenswrapper[4769]: I1121 12:12:09.295768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" event={"ID":"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e","Type":"ContainerDied","Data":"8899cb309299ed0ffc914aa64f5109bc9d73d1d18f55832df91c441f6295c6ee"} Nov 21 12:12:10 crc kubenswrapper[4769]: I1121 12:12:10.312518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ca0d8f35-9d0d-47e2-8864-7af45d771a6d","Type":"ContainerStarted","Data":"cb439fb98eb73c2b6beb05200ed03f39c0b8799e1f52f19c25b93a7b2f635b88"} Nov 21 12:12:10 crc kubenswrapper[4769]: I1121 12:12:10.312811 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-httpd" containerID="cri-o://cb439fb98eb73c2b6beb05200ed03f39c0b8799e1f52f19c25b93a7b2f635b88" gracePeriod=30 Nov 21 12:12:10 crc kubenswrapper[4769]: I1121 12:12:10.312858 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-log" containerID="cri-o://3dd3cb5e4088ae744f5813ec412e79c13bbfe0b4a0f526ce07f3acc826664722" gracePeriod=30 Nov 21 12:12:10 crc kubenswrapper[4769]: I1121 12:12:10.349016 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=9.348989928 podStartE2EDuration="9.348989928s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:10.343719307 +0000 UTC m=+1289.044381135" watchObservedRunningTime="2025-11-21 12:12:10.348989928 +0000 UTC m=+1289.049651746" Nov 21 12:12:11 crc kubenswrapper[4769]: I1121 12:12:11.323031 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerID="cb439fb98eb73c2b6beb05200ed03f39c0b8799e1f52f19c25b93a7b2f635b88" exitCode=0 Nov 21 12:12:11 crc kubenswrapper[4769]: I1121 12:12:11.323066 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerID="3dd3cb5e4088ae744f5813ec412e79c13bbfe0b4a0f526ce07f3acc826664722" exitCode=143 Nov 21 12:12:11 crc kubenswrapper[4769]: I1121 12:12:11.323085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ca0d8f35-9d0d-47e2-8864-7af45d771a6d","Type":"ContainerDied","Data":"cb439fb98eb73c2b6beb05200ed03f39c0b8799e1f52f19c25b93a7b2f635b88"} Nov 21 12:12:11 crc kubenswrapper[4769]: I1121 12:12:11.323110 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ca0d8f35-9d0d-47e2-8864-7af45d771a6d","Type":"ContainerDied","Data":"3dd3cb5e4088ae744f5813ec412e79c13bbfe0b4a0f526ce07f3acc826664722"} Nov 21 12:12:22 crc kubenswrapper[4769]: E1121 12:12:22.701493 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-placement-api@sha256:ce8908c54afc567e5791f2940656436928afa6f135ebae31274e5283cf13f448" Nov 21 12:12:22 crc kubenswrapper[4769]: E1121 12:12:22.702332 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:placement-db-sync,Image:quay.io/podified-antelope-centos9/openstack-placement-api@sha256:ce8908c54afc567e5791f2940656436928afa6f135ebae31274e5283cf13f448,Command:[/bin/bash],Args:[-c /usr/local/bin/kolla_start],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:true,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/usr/local/bin/container-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:logs,ReadOnly:false,MountPath:/var/log/placement,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:false,MountPath:/var/lib/openstack/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/config.json,SubPath:placement-dbsync-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-vh989,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42482,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod placement-db-sync-vv5ns_openstack-kuttl-tests(78c03136-58e9-4dc8-b4db-7ba52267e180): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:12:22 crc kubenswrapper[4769]: E1121 12:12:22.703611 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-db-sync\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" podUID="78c03136-58e9-4dc8-b4db-7ba52267e180" Nov 21 12:12:23 crc kubenswrapper[4769]: E1121 12:12:23.045783 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-ceilometer-central@sha256:7b50597c6dbca671784fa98d7317a18980f1a1ac729254460e6d769d70dfefc5" Nov 21 12:12:23 crc kubenswrapper[4769]: E1121 12:12:23.046013 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:ceilometer-central-agent,Image:quay.io/podified-antelope-centos9/openstack-ceilometer-central@sha256:7b50597c6dbca671784fa98d7317a18980f1a1ac729254460e6d769d70dfefc5,Command:[/bin/bash],Args:[-c /usr/local/bin/kolla_start],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n548h68ch5ddh664hdh7bhfdh64dhf5h6h584h4h9ch5d5h569h654h75h676h5bh55bhbbh7dh646h56hch95h75h574hf8h59fh67h577q,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/var/lib/openstack/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/openstack/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/config.json,SubPath:ceilometer-central-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mtqxc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/python3 /var/lib/openstack/bin/centralhealth.py],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:300,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ceilometer-0_openstack-kuttl-tests(34633895-031b-4601-beec-01aa64870afb): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.461943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"dc7dea0d6dbeaa8c46b2065ff344204b8df21cb9810f401cf24d17ae7ca6afaf"} Nov 21 12:12:23 crc kubenswrapper[4769]: E1121 12:12:23.463305 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-db-sync\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-placement-api@sha256:ce8908c54afc567e5791f2940656436928afa6f135ebae31274e5283cf13f448\\\"\"" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" podUID="78c03136-58e9-4dc8-b4db-7ba52267e180" Nov 21 12:12:23 crc kubenswrapper[4769]: E1121 12:12:23.598867 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:09513b0e7384092548dd654fa2356d64e243315cf59fa8857bd6c4a3ae4037c4" Nov 21 12:12:23 crc kubenswrapper[4769]: E1121 12:12:23.599125 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:barbican-db-sync,Image:quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:09513b0e7384092548dd654fa2356d64e243315cf59fa8857bd6c4a3ae4037c4,Command:[/bin/bash],Args:[-c barbican-manage db upgrade],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:TRUE,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:db-sync-config-data,ReadOnly:true,MountPath:/etc/barbican/barbican.conf.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2vlqr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42403,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:*42403,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod barbican-db-sync-jmrp4_openstack-kuttl-tests(684fb2d3-5048-4358-9a86-defc40bc3f98): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:12:23 crc kubenswrapper[4769]: E1121 12:12:23.600548 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"barbican-db-sync\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" podUID="684fb2d3-5048-4358-9a86-defc40bc3f98" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.706669 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.716463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.792626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-scripts\") pod \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.792719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-combined-ca-bundle\") pod \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.793171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-scripts\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.793292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.793370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-credential-keys\") pod \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.793497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-config-data\") pod \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.793545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-fernet-keys\") pod \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-httpd-run\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-combined-ca-bundle\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-config-data\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-public-tls-certs\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkxv2\" (UniqueName: \"kubernetes.io/projected/4465fead-86cc-429d-827c-dfd4fbfaf85e-kube-api-access-xkxv2\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srnvp\" (UniqueName: \"kubernetes.io/projected/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-kube-api-access-srnvp\") pod \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\" (UID: \"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.794921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-logs\") pod \"4465fead-86cc-429d-827c-dfd4fbfaf85e\" (UID: \"4465fead-86cc-429d-827c-dfd4fbfaf85e\") " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.795459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.796048 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.804808 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4465fead-86cc-429d-827c-dfd4fbfaf85e-kube-api-access-xkxv2" (OuterVolumeSpecName: "kube-api-access-xkxv2") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "kube-api-access-xkxv2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.805143 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-logs" (OuterVolumeSpecName: "logs") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.806549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" (UID: "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.807210 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.807328 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-scripts" (OuterVolumeSpecName: "scripts") pod "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" (UID: "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.807226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-scripts" (OuterVolumeSpecName: "scripts") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.808441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-kube-api-access-srnvp" (OuterVolumeSpecName: "kube-api-access-srnvp") pod "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" (UID: "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e"). InnerVolumeSpecName "kube-api-access-srnvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.821789 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" (UID: "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.839436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.852601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-config-data" (OuterVolumeSpecName: "config-data") pod "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" (UID: "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.876343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" (UID: "b189ff18-55cf-4d3f-9492-d6bcb0f1b17e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.877745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.880814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-config-data" (OuterVolumeSpecName: "config-data") pod "4465fead-86cc-429d-827c-dfd4fbfaf85e" (UID: "4465fead-86cc-429d-827c-dfd4fbfaf85e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.897440 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.897855 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.897942 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898002 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xkxv2\" (UniqueName: \"kubernetes.io/projected/4465fead-86cc-429d-827c-dfd4fbfaf85e-kube-api-access-xkxv2\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898076 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srnvp\" (UniqueName: \"kubernetes.io/projected/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-kube-api-access-srnvp\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898134 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4465fead-86cc-429d-827c-dfd4fbfaf85e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898221 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898307 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898375 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4465fead-86cc-429d-827c-dfd4fbfaf85e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898664 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898800 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.898915 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.899009 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:23 crc kubenswrapper[4769]: I1121 12:12:23.920863 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.001511 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.472856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4465fead-86cc-429d-827c-dfd4fbfaf85e","Type":"ContainerDied","Data":"55a5bae87f1591ce4a6ef71277c185a7561ab7219632aaaf8479b72f2726a688"} Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.473326 4769 scope.go:117] "RemoveContainer" containerID="28411ca64b27f68b288e03c9decf3e87b14ee552bd900c55d27cdefbe32468fb" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.472907 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.474096 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.476326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-hq8w2" event={"ID":"b189ff18-55cf-4d3f-9492-d6bcb0f1b17e","Type":"ContainerDied","Data":"7e3a75cb4c76b68666d8b043207670f777404d2b8ecff8e0374b62e31e381295"} Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.476375 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e3a75cb4c76b68666d8b043207670f777404d2b8ecff8e0374b62e31e381295" Nov 21 12:12:24 crc kubenswrapper[4769]: E1121 12:12:24.486944 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"barbican-db-sync\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:09513b0e7384092548dd654fa2356d64e243315cf59fa8857bd6c4a3ae4037c4\\\"\"" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" podUID="684fb2d3-5048-4358-9a86-defc40bc3f98" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.525018 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.534157 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.557089 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:24 crc kubenswrapper[4769]: E1121 12:12:24.558042 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" containerName="keystone-bootstrap" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.558062 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" containerName="keystone-bootstrap" Nov 21 12:12:24 crc kubenswrapper[4769]: E1121 12:12:24.558082 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-log" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.558089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-log" Nov 21 12:12:24 crc kubenswrapper[4769]: E1121 12:12:24.558104 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-httpd" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.558110 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-httpd" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.558369 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-log" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.558406 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" containerName="glance-httpd" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.558421 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" containerName="keystone-bootstrap" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.560325 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.566616 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.566729 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.573928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.622773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-scripts\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.622913 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dczlx\" (UniqueName: \"kubernetes.io/projected/e9fa1f98-7950-4476-b2b2-a0474c19aae1-kube-api-access-dczlx\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.623005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.623053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.623122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.623244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.623276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-config-data\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.623702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-logs\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.725995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.726095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.726139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.726162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-config-data\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.726296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-logs\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.726737 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.726902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.727652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-logs\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.727704 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-scripts\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.727743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dczlx\" (UniqueName: \"kubernetes.io/projected/e9fa1f98-7950-4476-b2b2-a0474c19aae1-kube-api-access-dczlx\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.727789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.735944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.737448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-config-data\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.745212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.745258 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-scripts\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.751658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dczlx\" (UniqueName: \"kubernetes.io/projected/e9fa1f98-7950-4476-b2b2-a0474c19aae1-kube-api-access-dczlx\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.766882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.893522 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.901033 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-hq8w2"] Nov 21 12:12:24 crc kubenswrapper[4769]: I1121 12:12:24.907669 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-hq8w2"] Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.041701 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lxd68"] Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.042865 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.044984 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.045077 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.045489 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.047251 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.051776 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-ccsfx" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.056780 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lxd68"] Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.135609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-scripts\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.135689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-combined-ca-bundle\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.135750 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-credential-keys\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.135877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-config-data\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.135960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-fernet-keys\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.136138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpph\" (UniqueName: \"kubernetes.io/projected/78f8e740-e416-47dd-98c9-05569f6de12a-kube-api-access-qkpph\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.238041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-scripts\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.238149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-combined-ca-bundle\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.238180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-credential-keys\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.238228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-config-data\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.239041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-fernet-keys\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.239095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpph\" (UniqueName: \"kubernetes.io/projected/78f8e740-e416-47dd-98c9-05569f6de12a-kube-api-access-qkpph\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.242557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-scripts\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.242843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-combined-ca-bundle\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.244945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-fernet-keys\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.245701 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-credential-keys\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.259901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-config-data\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.262540 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpph\" (UniqueName: \"kubernetes.io/projected/78f8e740-e416-47dd-98c9-05569f6de12a-kube-api-access-qkpph\") pod \"keystone-bootstrap-lxd68\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.318956 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4465fead-86cc-429d-827c-dfd4fbfaf85e" path="/var/lib/kubelet/pods/4465fead-86cc-429d-827c-dfd4fbfaf85e/volumes" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.320368 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b189ff18-55cf-4d3f-9492-d6bcb0f1b17e" path="/var/lib/kubelet/pods/b189ff18-55cf-4d3f-9492-d6bcb0f1b17e/volumes" Nov 21 12:12:25 crc kubenswrapper[4769]: I1121 12:12:25.363115 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:33 crc kubenswrapper[4769]: I1121 12:12:33.013438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:33 crc kubenswrapper[4769]: I1121 12:12:33.014003 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.743546 4769 scope.go:117] "RemoveContainer" containerID="fd7a929ede5f1cd1a8a8ed11c7347be9c9e29bb6c3617408e0ec6f74cfbd01bc" Nov 21 12:12:40 crc kubenswrapper[4769]: E1121 12:12:40.751954 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:a0e6062f505fbc848d62675995abc3806bc5c12530d3d41ed16066e07f71b2d3" Nov 21 12:12:40 crc kubenswrapper[4769]: E1121 12:12:40.752383 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:neutron-db-sync,Image:quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:a0e6062f505fbc848d62675995abc3806bc5c12530d3d41ed16066e07f71b2d3,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/var/lib/config-data/default,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config,ReadOnly:true,MountPath:/var/lib/kolla/config_files/config.json,SubPath:db-sync-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4zfsv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42435,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:*42435,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod neutron-db-sync-xplxh_openstack-kuttl-tests(7a39442e-588a-4512-a91d-d5a1daa8ea1b): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:12:40 crc kubenswrapper[4769]: E1121 12:12:40.754309 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"neutron-db-sync\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" podUID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.841384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.895762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-config-data\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.895871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68jls\" (UniqueName: \"kubernetes.io/projected/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-kube-api-access-68jls\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.895908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.895958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-internal-tls-certs\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.896010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-scripts\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.896098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-httpd-run\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.896148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-logs\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.896274 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-combined-ca-bundle\") pod \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\" (UID: \"ca0d8f35-9d0d-47e2-8864-7af45d771a6d\") " Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.899618 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.900024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-logs" (OuterVolumeSpecName: "logs") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.902754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-scripts" (OuterVolumeSpecName: "scripts") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.904907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-kube-api-access-68jls" (OuterVolumeSpecName: "kube-api-access-68jls") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "kube-api-access-68jls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.906396 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.935185 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.957078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-config-data" (OuterVolumeSpecName: "config-data") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.957704 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ca0d8f35-9d0d-47e2-8864-7af45d771a6d" (UID: "ca0d8f35-9d0d-47e2-8864-7af45d771a6d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998556 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998592 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998601 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998611 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998620 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998628 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998637 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68jls\" (UniqueName: \"kubernetes.io/projected/ca0d8f35-9d0d-47e2-8864-7af45d771a6d-kube-api-access-68jls\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:40 crc kubenswrapper[4769]: I1121 12:12:40.998673 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.015171 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.100001 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.661203 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.661246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"ca0d8f35-9d0d-47e2-8864-7af45d771a6d","Type":"ContainerDied","Data":"59c277a93d7d285e001c01bd23c951e7af3fd0403b071ade875c82454ddea742"} Nov 21 12:12:41 crc kubenswrapper[4769]: E1121 12:12:41.673635 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"neutron-db-sync\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:a0e6062f505fbc848d62675995abc3806bc5c12530d3d41ed16066e07f71b2d3\\\"\"" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" podUID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.693432 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.698799 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.732759 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:41 crc kubenswrapper[4769]: E1121 12:12:41.733851 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-log" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.737553 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-log" Nov 21 12:12:41 crc kubenswrapper[4769]: E1121 12:12:41.740537 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-httpd" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.740747 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-httpd" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.741471 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-log" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.741672 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" containerName="glance-httpd" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.743459 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.743621 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.746669 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.747290 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-logs\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsm8h\" (UniqueName: \"kubernetes.io/projected/bdf7e54e-3075-4900-96c5-45ea9213e5b7-kube-api-access-tsm8h\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.817708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.919870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.919994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.920030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-logs\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.920054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.920074 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.920099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.920118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tsm8h\" (UniqueName: \"kubernetes.io/projected/bdf7e54e-3075-4900-96c5-45ea9213e5b7-kube-api-access-tsm8h\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.920137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.922781 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.923231 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.923163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-logs\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.925711 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.925967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.927548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.929004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.941647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsm8h\" (UniqueName: \"kubernetes.io/projected/bdf7e54e-3075-4900-96c5-45ea9213e5b7-kube-api-access-tsm8h\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:41 crc kubenswrapper[4769]: I1121 12:12:41.957235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:42 crc kubenswrapper[4769]: I1121 12:12:42.067519 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:42 crc kubenswrapper[4769]: E1121 12:12:42.331431 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-cinder-api@sha256:25d0e71e0464df9502ad8bd3af0f73caeaca1bae11d89b4b5992b4fe712eda3a" Nov 21 12:12:42 crc kubenswrapper[4769]: E1121 12:12:42.331660 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:cinder-db-sync,Image:quay.io/podified-antelope-centos9/openstack-cinder-api@sha256:25d0e71e0464df9502ad8bd3af0f73caeaca1bae11d89b4b5992b4fe712eda3a,Command:[/bin/bash],Args:[-c /usr/local/bin/kolla_set_configs && /usr/local/bin/kolla_start],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:TRUE,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:etc-machine-id,ReadOnly:true,MountPath:/etc/machine-id,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:scripts,ReadOnly:true,MountPath:/usr/local/bin/container-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/config-data/merged,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/etc/my.cnf,SubPath:my.cnf,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:db-sync-config-data,ReadOnly:true,MountPath:/etc/cinder/cinder.conf.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/config.json,SubPath:db-sync-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-h2mgj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod cinder-db-sync-hd8sk_openstack-kuttl-tests(0b11a06d-8213-4627-9c7d-f293782167ef): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:12:42 crc kubenswrapper[4769]: E1121 12:12:42.334350 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cinder-db-sync\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" podUID="0b11a06d-8213-4627-9c7d-f293782167ef" Nov 21 12:12:42 crc kubenswrapper[4769]: E1121 12:12:42.700414 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cinder-db-sync\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-cinder-api@sha256:25d0e71e0464df9502ad8bd3af0f73caeaca1bae11d89b4b5992b4fe712eda3a\\\"\"" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" podUID="0b11a06d-8213-4627-9c7d-f293782167ef" Nov 21 12:12:42 crc kubenswrapper[4769]: E1121 12:12:42.783612 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-ceilometer-notification@sha256:cb7b59ee26e63eba841543d716424cd69b3ba4f0fc27b208d3ab3d315e4feac5" Nov 21 12:12:42 crc kubenswrapper[4769]: E1121 12:12:42.783784 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:ceilometer-notification-agent,Image:quay.io/podified-antelope-centos9/openstack-ceilometer-notification@sha256:cb7b59ee26e63eba841543d716424cd69b3ba4f0fc27b208d3ab3d315e4feac5,Command:[/bin/bash],Args:[-c /usr/local/bin/kolla_start],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n548h68ch5ddh664hdh7bhfdh64dhf5h6h584h4h9ch5d5h569h654h75h676h5bh55bhbbh7dh646h56hch95h75h574hf8h59fh67h577q,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/var/lib/openstack/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/openstack/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/config.json,SubPath:ceilometer-notification-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mtqxc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/python3 /var/lib/openstack/bin/notificationhealth.py],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:300,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ceilometer-0_openstack-kuttl-tests(34633895-031b-4601-beec-01aa64870afb): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:12:43 crc kubenswrapper[4769]: I1121 12:12:43.001639 4769 scope.go:117] "RemoveContainer" containerID="cb439fb98eb73c2b6beb05200ed03f39c0b8799e1f52f19c25b93a7b2f635b88" Nov 21 12:12:43 crc kubenswrapper[4769]: I1121 12:12:43.344110 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0d8f35-9d0d-47e2-8864-7af45d771a6d" path="/var/lib/kubelet/pods/ca0d8f35-9d0d-47e2-8864-7af45d771a6d/volumes" Nov 21 12:12:43 crc kubenswrapper[4769]: I1121 12:12:43.507104 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lxd68"] Nov 21 12:12:43 crc kubenswrapper[4769]: I1121 12:12:43.544095 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.261264 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.291939 4769 scope.go:117] "RemoveContainer" containerID="3dd3cb5e4088ae744f5813ec412e79c13bbfe0b4a0f526ce07f3acc826664722" Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.583167 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.733848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" event={"ID":"78c03136-58e9-4dc8-b4db-7ba52267e180","Type":"ContainerStarted","Data":"1ca3529a2680a180fe7c8e8051b29355f57d5a0d8e59f002423a6b86cd1b63c4"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.740438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" event={"ID":"684fb2d3-5048-4358-9a86-defc40bc3f98","Type":"ContainerStarted","Data":"9b3090c3e9bec06093493025ef37a3a49c21061803cffc8e2863ef33018fd8a3"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.750803 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"203e48f965912ad353abee711526bb792bbb4e47a16ecc867448217e54b56e0c"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.756768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" event={"ID":"78f8e740-e416-47dd-98c9-05569f6de12a","Type":"ContainerStarted","Data":"c295520ea0823d005ee4bacef81248d05a52bdb4b6dd4d80526c7b3f2b3e4792"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.756817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" event={"ID":"78f8e740-e416-47dd-98c9-05569f6de12a","Type":"ContainerStarted","Data":"f1d9df6c8e2e6904fd1689e5f509f4e163c74ec4afe15e7ebad473863590d130"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.761950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bdf7e54e-3075-4900-96c5-45ea9213e5b7","Type":"ContainerStarted","Data":"e4ddccc5694de142e355d423a5e86474196a9dc025288f5823ddb35623cb03cd"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.766700 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" podStartSLOduration=2.606426019 podStartE2EDuration="43.766657235s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="2025-11-21 12:12:03.097220671 +0000 UTC m=+1281.797882489" lastFinishedPulling="2025-11-21 12:12:44.257451887 +0000 UTC m=+1322.958113705" observedRunningTime="2025-11-21 12:12:44.747521223 +0000 UTC m=+1323.448183041" watchObservedRunningTime="2025-11-21 12:12:44.766657235 +0000 UTC m=+1323.467319053" Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.775360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e9fa1f98-7950-4476-b2b2-a0474c19aae1","Type":"ContainerStarted","Data":"7a6306654453fbd1bbf0a28b75bc07fdbc0d3d84796887e31fab35117080a837"} Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.818464 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" podStartSLOduration=2.903425599 podStartE2EDuration="43.818421581s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="2025-11-21 12:12:03.380171034 +0000 UTC m=+1282.080832852" lastFinishedPulling="2025-11-21 12:12:44.295167016 +0000 UTC m=+1322.995828834" observedRunningTime="2025-11-21 12:12:44.770781976 +0000 UTC m=+1323.471443794" watchObservedRunningTime="2025-11-21 12:12:44.818421581 +0000 UTC m=+1323.519083399" Nov 21 12:12:44 crc kubenswrapper[4769]: I1121 12:12:44.824153 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" podStartSLOduration=20.824130383 podStartE2EDuration="20.824130383s" podCreationTimestamp="2025-11-21 12:12:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:44.801994311 +0000 UTC m=+1323.502656129" watchObservedRunningTime="2025-11-21 12:12:44.824130383 +0000 UTC m=+1323.524792201" Nov 21 12:12:45 crc kubenswrapper[4769]: I1121 12:12:45.799223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bdf7e54e-3075-4900-96c5-45ea9213e5b7","Type":"ContainerStarted","Data":"91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48"} Nov 21 12:12:45 crc kubenswrapper[4769]: I1121 12:12:45.806102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e9fa1f98-7950-4476-b2b2-a0474c19aae1","Type":"ContainerStarted","Data":"8010a32238c4c714a25a07ea26d96f39a7c3bb44253b28de64b4918ae5279a1e"} Nov 21 12:12:45 crc kubenswrapper[4769]: I1121 12:12:45.812702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"27958e395e51d689bcbd2990abea2442025674f51da66c5dd8d41c22845b6a7e"} Nov 21 12:12:45 crc kubenswrapper[4769]: I1121 12:12:45.812750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"45f365205135ce2e01bbfee57ada2f110cd242b7e9e71f898a4ac35789747421"} Nov 21 12:12:45 crc kubenswrapper[4769]: I1121 12:12:45.812764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"0d588eda24d0241fbab0826491cc028433f6f2f32fdf6cd4d8affd66af104a68"} Nov 21 12:12:46 crc kubenswrapper[4769]: I1121 12:12:46.826163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bdf7e54e-3075-4900-96c5-45ea9213e5b7","Type":"ContainerStarted","Data":"c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126"} Nov 21 12:12:46 crc kubenswrapper[4769]: I1121 12:12:46.831352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e9fa1f98-7950-4476-b2b2-a0474c19aae1","Type":"ContainerStarted","Data":"ca31439b9c6021c7f29318fb618a81c655f3e2af772d73a473e19cea5a02fd47"} Nov 21 12:12:46 crc kubenswrapper[4769]: I1121 12:12:46.860593 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=22.860568046 podStartE2EDuration="22.860568046s" podCreationTimestamp="2025-11-21 12:12:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:46.85060472 +0000 UTC m=+1325.551266548" watchObservedRunningTime="2025-11-21 12:12:46.860568046 +0000 UTC m=+1325.561229864" Nov 21 12:12:47 crc kubenswrapper[4769]: I1121 12:12:47.862003 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.861982768 podStartE2EDuration="6.861982768s" podCreationTimestamp="2025-11-21 12:12:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:47.856613975 +0000 UTC m=+1326.557275793" watchObservedRunningTime="2025-11-21 12:12:47.861982768 +0000 UTC m=+1326.562644586" Nov 21 12:12:48 crc kubenswrapper[4769]: I1121 12:12:48.855956 4769 generic.go:334] "Generic (PLEG): container finished" podID="78f8e740-e416-47dd-98c9-05569f6de12a" containerID="c295520ea0823d005ee4bacef81248d05a52bdb4b6dd4d80526c7b3f2b3e4792" exitCode=0 Nov 21 12:12:48 crc kubenswrapper[4769]: I1121 12:12:48.856044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" event={"ID":"78f8e740-e416-47dd-98c9-05569f6de12a","Type":"ContainerDied","Data":"c295520ea0823d005ee4bacef81248d05a52bdb4b6dd4d80526c7b3f2b3e4792"} Nov 21 12:12:50 crc kubenswrapper[4769]: I1121 12:12:50.877395 4769 generic.go:334] "Generic (PLEG): container finished" podID="78c03136-58e9-4dc8-b4db-7ba52267e180" containerID="1ca3529a2680a180fe7c8e8051b29355f57d5a0d8e59f002423a6b86cd1b63c4" exitCode=0 Nov 21 12:12:50 crc kubenswrapper[4769]: I1121 12:12:50.877451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" event={"ID":"78c03136-58e9-4dc8-b4db-7ba52267e180","Type":"ContainerDied","Data":"1ca3529a2680a180fe7c8e8051b29355f57d5a0d8e59f002423a6b86cd1b63c4"} Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.198427 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.374581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkpph\" (UniqueName: \"kubernetes.io/projected/78f8e740-e416-47dd-98c9-05569f6de12a-kube-api-access-qkpph\") pod \"78f8e740-e416-47dd-98c9-05569f6de12a\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.374944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-combined-ca-bundle\") pod \"78f8e740-e416-47dd-98c9-05569f6de12a\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.375044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-credential-keys\") pod \"78f8e740-e416-47dd-98c9-05569f6de12a\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.375079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-scripts\") pod \"78f8e740-e416-47dd-98c9-05569f6de12a\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.375136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-fernet-keys\") pod \"78f8e740-e416-47dd-98c9-05569f6de12a\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.375160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-config-data\") pod \"78f8e740-e416-47dd-98c9-05569f6de12a\" (UID: \"78f8e740-e416-47dd-98c9-05569f6de12a\") " Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.381949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "78f8e740-e416-47dd-98c9-05569f6de12a" (UID: "78f8e740-e416-47dd-98c9-05569f6de12a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.382002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-scripts" (OuterVolumeSpecName: "scripts") pod "78f8e740-e416-47dd-98c9-05569f6de12a" (UID: "78f8e740-e416-47dd-98c9-05569f6de12a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.382236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "78f8e740-e416-47dd-98c9-05569f6de12a" (UID: "78f8e740-e416-47dd-98c9-05569f6de12a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.384415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f8e740-e416-47dd-98c9-05569f6de12a-kube-api-access-qkpph" (OuterVolumeSpecName: "kube-api-access-qkpph") pod "78f8e740-e416-47dd-98c9-05569f6de12a" (UID: "78f8e740-e416-47dd-98c9-05569f6de12a"). InnerVolumeSpecName "kube-api-access-qkpph". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.401804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "78f8e740-e416-47dd-98c9-05569f6de12a" (UID: "78f8e740-e416-47dd-98c9-05569f6de12a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.411074 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-config-data" (OuterVolumeSpecName: "config-data") pod "78f8e740-e416-47dd-98c9-05569f6de12a" (UID: "78f8e740-e416-47dd-98c9-05569f6de12a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.477084 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.477147 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.477166 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.477180 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qkpph\" (UniqueName: \"kubernetes.io/projected/78f8e740-e416-47dd-98c9-05569f6de12a-kube-api-access-qkpph\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.477245 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.477264 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/78f8e740-e416-47dd-98c9-05569f6de12a-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.888796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"34633895-031b-4601-beec-01aa64870afb","Type":"ContainerStarted","Data":"39c580120a547fe1f6223efbbbb1ab63b5d92735f057221612c72f360aca42c3"} Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.895169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"388db589345d573a520830181a6ba64b6bc1cdbade81b8d62c71195efd4ef1c4"} Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.895231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"3a14f3d66cae931eea76270308d88fb7ea2a243e0a7122714ca90e92a4890871"} Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.895243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"25e1a54d26ddfb9a829a245940bfcaf7070e32fe5f4ddfcfb2d6f6aeb4ead557"} Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.896889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" event={"ID":"78f8e740-e416-47dd-98c9-05569f6de12a","Type":"ContainerDied","Data":"f1d9df6c8e2e6904fd1689e5f509f4e163c74ec4afe15e7ebad473863590d130"} Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.896928 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1d9df6c8e2e6904fd1689e5f509f4e163c74ec4afe15e7ebad473863590d130" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.896957 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lxd68" Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.899039 4769 generic.go:334] "Generic (PLEG): container finished" podID="684fb2d3-5048-4358-9a86-defc40bc3f98" containerID="9b3090c3e9bec06093493025ef37a3a49c21061803cffc8e2863ef33018fd8a3" exitCode=0 Nov 21 12:12:51 crc kubenswrapper[4769]: I1121 12:12:51.899136 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" event={"ID":"684fb2d3-5048-4358-9a86-defc40bc3f98","Type":"ContainerDied","Data":"9b3090c3e9bec06093493025ef37a3a49c21061803cffc8e2863ef33018fd8a3"} Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.071555 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.071612 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.120868 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.145308 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.255926 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.395540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c03136-58e9-4dc8-b4db-7ba52267e180-logs\") pod \"78c03136-58e9-4dc8-b4db-7ba52267e180\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.395627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-combined-ca-bundle\") pod \"78c03136-58e9-4dc8-b4db-7ba52267e180\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.395695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-scripts\") pod \"78c03136-58e9-4dc8-b4db-7ba52267e180\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.395719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-config-data\") pod \"78c03136-58e9-4dc8-b4db-7ba52267e180\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.396035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh989\" (UniqueName: \"kubernetes.io/projected/78c03136-58e9-4dc8-b4db-7ba52267e180-kube-api-access-vh989\") pod \"78c03136-58e9-4dc8-b4db-7ba52267e180\" (UID: \"78c03136-58e9-4dc8-b4db-7ba52267e180\") " Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.397888 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78c03136-58e9-4dc8-b4db-7ba52267e180-logs" (OuterVolumeSpecName: "logs") pod "78c03136-58e9-4dc8-b4db-7ba52267e180" (UID: "78c03136-58e9-4dc8-b4db-7ba52267e180"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.411818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-scripts" (OuterVolumeSpecName: "scripts") pod "78c03136-58e9-4dc8-b4db-7ba52267e180" (UID: "78c03136-58e9-4dc8-b4db-7ba52267e180"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.414677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c03136-58e9-4dc8-b4db-7ba52267e180-kube-api-access-vh989" (OuterVolumeSpecName: "kube-api-access-vh989") pod "78c03136-58e9-4dc8-b4db-7ba52267e180" (UID: "78c03136-58e9-4dc8-b4db-7ba52267e180"). InnerVolumeSpecName "kube-api-access-vh989". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.416966 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-86b49c8d88-lq6lx"] Nov 21 12:12:52 crc kubenswrapper[4769]: E1121 12:12:52.417362 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78c03136-58e9-4dc8-b4db-7ba52267e180" containerName="placement-db-sync" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.417375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c03136-58e9-4dc8-b4db-7ba52267e180" containerName="placement-db-sync" Nov 21 12:12:52 crc kubenswrapper[4769]: E1121 12:12:52.417400 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78f8e740-e416-47dd-98c9-05569f6de12a" containerName="keystone-bootstrap" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.417406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f8e740-e416-47dd-98c9-05569f6de12a" containerName="keystone-bootstrap" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.417588 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78c03136-58e9-4dc8-b4db-7ba52267e180" containerName="placement-db-sync" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.417610 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78f8e740-e416-47dd-98c9-05569f6de12a" containerName="keystone-bootstrap" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.419717 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.427285 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-ccsfx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.427666 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.427951 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.428271 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.429393 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.432988 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.459220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "78c03136-58e9-4dc8-b4db-7ba52267e180" (UID: "78c03136-58e9-4dc8-b4db-7ba52267e180"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.459304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-86b49c8d88-lq6lx"] Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.459315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-config-data" (OuterVolumeSpecName: "config-data") pod "78c03136-58e9-4dc8-b4db-7ba52267e180" (UID: "78c03136-58e9-4dc8-b4db-7ba52267e180"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.520259 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c03136-58e9-4dc8-b4db-7ba52267e180-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.520308 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.520321 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.520330 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c03136-58e9-4dc8-b4db-7ba52267e180-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.520345 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vh989\" (UniqueName: \"kubernetes.io/projected/78c03136-58e9-4dc8-b4db-7ba52267e180-kube-api-access-vh989\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.622353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-combined-ca-bundle\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.622972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tpzb\" (UniqueName: \"kubernetes.io/projected/54bead83-c56d-4882-82a2-9188f98b2d79-kube-api-access-5tpzb\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.623083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-config-data\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.623179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-scripts\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.623303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-credential-keys\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.623394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-fernet-keys\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.623496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-internal-tls-certs\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.623674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-public-tls-certs\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.724848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-combined-ca-bundle\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5tpzb\" (UniqueName: \"kubernetes.io/projected/54bead83-c56d-4882-82a2-9188f98b2d79-kube-api-access-5tpzb\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-config-data\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-scripts\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-credential-keys\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-fernet-keys\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-internal-tls-certs\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.725796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-public-tls-certs\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.730124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-combined-ca-bundle\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.730303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-internal-tls-certs\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.730560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-credential-keys\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.730679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-fernet-keys\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.731876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-scripts\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.732150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-config-data\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.742903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-public-tls-certs\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.749595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tpzb\" (UniqueName: \"kubernetes.io/projected/54bead83-c56d-4882-82a2-9188f98b2d79-kube-api-access-5tpzb\") pod \"keystone-86b49c8d88-lq6lx\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.870617 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.924656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"e2808bd868aeae017a04132a01b7d2e857719666bf85d95a642328026416cf97"} Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.924711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"0a0d51356029320c9a583d23c45807d7f2663d7ff6c65f47a67e084309bbcd66"} Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.930398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" event={"ID":"78c03136-58e9-4dc8-b4db-7ba52267e180","Type":"ContainerDied","Data":"c725241aa0a6464b2e38786e2e112899c2ff1b80045dfa5065d9e4ed7cc2c938"} Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.930461 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c725241aa0a6464b2e38786e2e112899c2ff1b80045dfa5065d9e4ed7cc2c938" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.930491 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.930597 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-vv5ns" Nov 21 12:12:52 crc kubenswrapper[4769]: I1121 12:12:52.932256 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.071662 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-884df8874-pjgwg"] Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.074022 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.078164 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.078360 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.078578 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-ggz8t" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.078734 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.078847 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.189074 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-884df8874-pjgwg"] Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-scripts\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-public-tls-certs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-combined-ca-bundle\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235741 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-logs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-internal-tls-certs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjhh\" (UniqueName: \"kubernetes.io/projected/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-kube-api-access-7cjhh\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.235916 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-config-data\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.342714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjhh\" (UniqueName: \"kubernetes.io/projected/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-kube-api-access-7cjhh\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.342817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-config-data\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.342905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-scripts\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.342944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-public-tls-certs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.342999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-combined-ca-bundle\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.343028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-logs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.343081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-internal-tls-certs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.358365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-combined-ca-bundle\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.361579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-logs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.362096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-scripts\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.363599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-config-data\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.368322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-public-tls-certs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.378274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-internal-tls-certs\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.378641 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjhh\" (UniqueName: \"kubernetes.io/projected/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-kube-api-access-7cjhh\") pod \"placement-884df8874-pjgwg\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.428178 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.544493 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.653650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-db-sync-config-data\") pod \"684fb2d3-5048-4358-9a86-defc40bc3f98\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.653876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-combined-ca-bundle\") pod \"684fb2d3-5048-4358-9a86-defc40bc3f98\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.653944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vlqr\" (UniqueName: \"kubernetes.io/projected/684fb2d3-5048-4358-9a86-defc40bc3f98-kube-api-access-2vlqr\") pod \"684fb2d3-5048-4358-9a86-defc40bc3f98\" (UID: \"684fb2d3-5048-4358-9a86-defc40bc3f98\") " Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.658538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "684fb2d3-5048-4358-9a86-defc40bc3f98" (UID: "684fb2d3-5048-4358-9a86-defc40bc3f98"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.658905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/684fb2d3-5048-4358-9a86-defc40bc3f98-kube-api-access-2vlqr" (OuterVolumeSpecName: "kube-api-access-2vlqr") pod "684fb2d3-5048-4358-9a86-defc40bc3f98" (UID: "684fb2d3-5048-4358-9a86-defc40bc3f98"). InnerVolumeSpecName "kube-api-access-2vlqr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.685299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "684fb2d3-5048-4358-9a86-defc40bc3f98" (UID: "684fb2d3-5048-4358-9a86-defc40bc3f98"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:12:53 crc kubenswrapper[4769]: I1121 12:12:53.736806 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-86b49c8d88-lq6lx"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.756662 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2vlqr\" (UniqueName: \"kubernetes.io/projected/684fb2d3-5048-4358-9a86-defc40bc3f98-kube-api-access-2vlqr\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.756707 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.756717 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/684fb2d3-5048-4358-9a86-defc40bc3f98-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.966926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" event={"ID":"684fb2d3-5048-4358-9a86-defc40bc3f98","Type":"ContainerDied","Data":"c5c58ca7a1ab2d5cfc1bd1db0400f0646350777e34e2b21cae210d4a831ded00"} Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.966991 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5c58ca7a1ab2d5cfc1bd1db0400f0646350777e34e2b21cae210d4a831ded00" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.966954 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-jmrp4" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.973615 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-884df8874-pjgwg"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.980804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"be39754759fd17a18f604f2728a7893626e52c3515f6214cd5e5e54fef183452"} Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:53.984075 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" event={"ID":"54bead83-c56d-4882-82a2-9188f98b2d79","Type":"ContainerStarted","Data":"b8328603cef602872a0af5499a04e3c2eaad46562d75ae9c4f2d19477f4a6f8d"} Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.171490 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb"] Nov 21 12:12:55 crc kubenswrapper[4769]: E1121 12:12:54.172334 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="684fb2d3-5048-4358-9a86-defc40bc3f98" containerName="barbican-db-sync" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.172348 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="684fb2d3-5048-4358-9a86-defc40bc3f98" containerName="barbican-db-sync" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.172533 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="684fb2d3-5048-4358-9a86-defc40bc3f98" containerName="barbican-db-sync" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.173455 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.198350 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.198620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.198789 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-j82mn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.223458 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.224948 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.244918 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.250800 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.252463 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.297548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-combined-ca-bundle\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.297649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-logs\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.303203 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thl8w\" (UniqueName: \"kubernetes.io/projected/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-kube-api-access-thl8w\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.303578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data-custom\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.303669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data-custom\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.305024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.305101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/da4c93fc-884b-4701-b589-da46434544d4-logs\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.305214 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.305252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-combined-ca-bundle\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.305406 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrbx\" (UniqueName: \"kubernetes.io/projected/da4c93fc-884b-4701-b589-da46434544d4-kube-api-access-zqrbx\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.348338 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-bc64cb676-548nf"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.349934 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.357578 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-bc64cb676-548nf"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.361640 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrbx\" (UniqueName: \"kubernetes.io/projected/da4c93fc-884b-4701-b589-da46434544d4-kube-api-access-zqrbx\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-combined-ca-bundle\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-logs\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-thl8w\" (UniqueName: \"kubernetes.io/projected/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-kube-api-access-thl8w\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data-custom\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data-custom\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/da4c93fc-884b-4701-b589-da46434544d4-logs\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.408689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-combined-ca-bundle\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.411672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-logs\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.414043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/da4c93fc-884b-4701-b589-da46434544d4-logs\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.424889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-combined-ca-bundle\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.426339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data-custom\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.429636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-combined-ca-bundle\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.431524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data-custom\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.437886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.437932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.438591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrbx\" (UniqueName: \"kubernetes.io/projected/da4c93fc-884b-4701-b589-da46434544d4-kube-api-access-zqrbx\") pod \"barbican-worker-79cf49bbf5-kwrfb\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.446118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-thl8w\" (UniqueName: \"kubernetes.io/projected/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-kube-api-access-thl8w\") pod \"barbican-keystone-listener-6c9b87b494-jct8s\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.513328 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data-custom\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.515347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.515436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-combined-ca-bundle\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.515626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snxm5\" (UniqueName: \"kubernetes.io/projected/e882f9ba-cb1d-4240-8fb2-587474e72ad1-kube-api-access-snxm5\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.515885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e882f9ba-cb1d-4240-8fb2-587474e72ad1-logs\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.617514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e882f9ba-cb1d-4240-8fb2-587474e72ad1-logs\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.617641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data-custom\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.617671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.617711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-combined-ca-bundle\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.617740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-snxm5\" (UniqueName: \"kubernetes.io/projected/e882f9ba-cb1d-4240-8fb2-587474e72ad1-kube-api-access-snxm5\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.617921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e882f9ba-cb1d-4240-8fb2-587474e72ad1-logs\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.624794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.624934 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data-custom\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.636215 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-combined-ca-bundle\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.645223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-snxm5\" (UniqueName: \"kubernetes.io/projected/e882f9ba-cb1d-4240-8fb2-587474e72ad1-kube-api-access-snxm5\") pod \"barbican-api-bc64cb676-548nf\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.677303 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.707319 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.829862 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.895442 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.896778 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.896826 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.896842 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.959449 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:54.965250 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.010324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" event={"ID":"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35","Type":"ContainerStarted","Data":"b403934044941318e6651375f51ecc36e5f81e00ee82f2ad2b8339c2ccc34436"} Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.010377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" event={"ID":"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35","Type":"ContainerStarted","Data":"129bd4c88baad5fbd65e85755df594e98f006c628c2f2ecaedeefb433e262e15"} Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.023127 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.023152 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.024161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerStarted","Data":"cf82826193b6f45df71d06ed96b204d0c5b80c81545d2459bde6c09873109e25"} Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.082444 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=70.185495015 podStartE2EDuration="1m59.082414027s" podCreationTimestamp="2025-11-21 12:10:56 +0000 UTC" firstStartedPulling="2025-11-21 12:12:02.263429275 +0000 UTC m=+1280.964091103" lastFinishedPulling="2025-11-21 12:12:51.160348297 +0000 UTC m=+1329.861010115" observedRunningTime="2025-11-21 12:12:55.066538352 +0000 UTC m=+1333.767200170" watchObservedRunningTime="2025-11-21 12:12:55.082414027 +0000 UTC m=+1333.783075845" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.314064 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.315933 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.318507 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.336111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.336344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcb7\" (UniqueName: \"kubernetes.io/projected/1dcf57ba-14a9-4960-8108-7c66aad9a866-kube-api-access-ghcb7\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.336371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.336671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-config\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.344210 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn"] Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.438114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-config\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.438165 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.438250 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcb7\" (UniqueName: \"kubernetes.io/projected/1dcf57ba-14a9-4960-8108-7c66aad9a866-kube-api-access-ghcb7\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.438271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.439205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.439752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-config\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.440305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.474631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcb7\" (UniqueName: \"kubernetes.io/projected/1dcf57ba-14a9-4960-8108-7c66aad9a866-kube-api-access-ghcb7\") pod \"dnsmasq-dnsmasq-84fc46597c-hrcbn\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:55 crc kubenswrapper[4769]: I1121 12:12:55.647378 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.052249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" event={"ID":"54bead83-c56d-4882-82a2-9188f98b2d79","Type":"ContainerStarted","Data":"fbafc96e6d3dce2d6bffff2fa908082675370a3d13436e13d7b8e6068abcdcb7"} Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.052432 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.058162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" event={"ID":"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35","Type":"ContainerStarted","Data":"fb6193feb007cf67b31316497282420398830761390868d037e92991fc17586b"} Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.058365 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.058415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.086544 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" podStartSLOduration=4.086516941 podStartE2EDuration="4.086516941s" podCreationTimestamp="2025-11-21 12:12:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:56.083279245 +0000 UTC m=+1334.783941073" watchObservedRunningTime="2025-11-21 12:12:56.086516941 +0000 UTC m=+1334.787178769" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.126083 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" podStartSLOduration=3.12605152 podStartE2EDuration="3.12605152s" podCreationTimestamp="2025-11-21 12:12:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:56.105109909 +0000 UTC m=+1334.805771727" watchObservedRunningTime="2025-11-21 12:12:56.12605152 +0000 UTC m=+1334.826713368" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.260814 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.260894 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.362397 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.471047 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-bc64cb676-548nf"] Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.488322 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s"] Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.524698 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn"] Nov 21 12:12:56 crc kubenswrapper[4769]: I1121 12:12:56.570529 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb"] Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.074400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" event={"ID":"e882f9ba-cb1d-4240-8fb2-587474e72ad1","Type":"ContainerStarted","Data":"4d0b574943bb2cdb0599744a72223e83f5a44151de74db20c9e12c547a59e09d"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.074961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" event={"ID":"e882f9ba-cb1d-4240-8fb2-587474e72ad1","Type":"ContainerStarted","Data":"25a15d142c1b4c5af03d47238ecb91c56994dfd2498a67c41cd775ea9f3bca44"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.074980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" event={"ID":"e882f9ba-cb1d-4240-8fb2-587474e72ad1","Type":"ContainerStarted","Data":"440db48348279677f049ea2a499c11ca7c748abf709c2b04dd6aa766a6cf8515"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.075063 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.075100 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.080160 4769 generic.go:334] "Generic (PLEG): container finished" podID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerID="8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40" exitCode=0 Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.080282 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" event={"ID":"1dcf57ba-14a9-4960-8108-7c66aad9a866","Type":"ContainerDied","Data":"8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.080338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" event={"ID":"1dcf57ba-14a9-4960-8108-7c66aad9a866","Type":"ContainerStarted","Data":"3b6206a7d4cd791272f5cc1660d00b20e97f5533a45c9dc4d437cdad01e97a07"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.090533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" event={"ID":"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd","Type":"ContainerStarted","Data":"28f9f51b019992be0afbdcbcc82020564f709e0d1a448603b5159941f981e55a"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.112560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" event={"ID":"7a39442e-588a-4512-a91d-d5a1daa8ea1b","Type":"ContainerStarted","Data":"e2af434dc306232267147efe73828515c9bba9485dca4c0bd7eec9d66aac63c1"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.118940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" event={"ID":"da4c93fc-884b-4701-b589-da46434544d4","Type":"ContainerStarted","Data":"14bc557e29737507143657deac22f3327bc01dc92dca6104838ae7e667090637"} Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.121062 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" podStartSLOduration=3.12103442 podStartE2EDuration="3.12103442s" podCreationTimestamp="2025-11-21 12:12:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:57.108317659 +0000 UTC m=+1335.808979497" watchObservedRunningTime="2025-11-21 12:12:57.12103442 +0000 UTC m=+1335.821696238" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.178502 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" podStartSLOduration=3.135747866 podStartE2EDuration="56.178482967s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="2025-11-21 12:12:02.720495028 +0000 UTC m=+1281.421156846" lastFinishedPulling="2025-11-21 12:12:55.763230129 +0000 UTC m=+1334.463891947" observedRunningTime="2025-11-21 12:12:57.168177911 +0000 UTC m=+1335.868839739" watchObservedRunningTime="2025-11-21 12:12:57.178482967 +0000 UTC m=+1335.879144785" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.220424 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c"] Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.223428 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.231505 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.232998 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-internal-tls-certs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-logs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkn28\" (UniqueName: \"kubernetes.io/projected/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-kube-api-access-fkn28\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data-custom\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-public-tls-certs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.299283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-combined-ca-bundle\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.326881 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c"] Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-combined-ca-bundle\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-internal-tls-certs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-logs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fkn28\" (UniqueName: \"kubernetes.io/projected/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-kube-api-access-fkn28\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data-custom\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.401620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-public-tls-certs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.403975 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-logs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.422050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-internal-tls-certs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.422075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-public-tls-certs\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.422626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data-custom\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.422676 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-combined-ca-bundle\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.423809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.426998 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkn28\" (UniqueName: \"kubernetes.io/projected/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-kube-api-access-fkn28\") pod \"barbican-api-74c78d6cbd-7f94c\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.628510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.677694 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.677828 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:12:57 crc kubenswrapper[4769]: I1121 12:12:57.793834 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:12:58 crc kubenswrapper[4769]: I1121 12:12:58.184972 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c"] Nov 21 12:12:58 crc kubenswrapper[4769]: W1121 12:12:58.187577 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2825ea3d_77e9_4cf1_8d50_c772fe89bc30.slice/crio-5629f4695cf8212645a59f2e0ebb6ce8c4726561f15b7e65e5482ab1623936a0 WatchSource:0}: Error finding container 5629f4695cf8212645a59f2e0ebb6ce8c4726561f15b7e65e5482ab1623936a0: Status 404 returned error can't find the container with id 5629f4695cf8212645a59f2e0ebb6ce8c4726561f15b7e65e5482ab1623936a0 Nov 21 12:12:59 crc kubenswrapper[4769]: I1121 12:12:59.141094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" event={"ID":"1dcf57ba-14a9-4960-8108-7c66aad9a866","Type":"ContainerStarted","Data":"813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee"} Nov 21 12:12:59 crc kubenswrapper[4769]: I1121 12:12:59.141737 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:12:59 crc kubenswrapper[4769]: I1121 12:12:59.155179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" event={"ID":"2825ea3d-77e9-4cf1-8d50-c772fe89bc30","Type":"ContainerStarted","Data":"a19f4af7a3c8aa8c9c2ae885914cd7399f4163b4393cdbd396bc5759a3350ca6"} Nov 21 12:12:59 crc kubenswrapper[4769]: I1121 12:12:59.155244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" event={"ID":"2825ea3d-77e9-4cf1-8d50-c772fe89bc30","Type":"ContainerStarted","Data":"5629f4695cf8212645a59f2e0ebb6ce8c4726561f15b7e65e5482ab1623936a0"} Nov 21 12:12:59 crc kubenswrapper[4769]: I1121 12:12:59.165158 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" podStartSLOduration=4.165138398 podStartE2EDuration="4.165138398s" podCreationTimestamp="2025-11-21 12:12:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:12:59.16258001 +0000 UTC m=+1337.863241828" watchObservedRunningTime="2025-11-21 12:12:59.165138398 +0000 UTC m=+1337.865800216" Nov 21 12:13:03 crc kubenswrapper[4769]: E1121 12:13:03.555556 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ceilometer-central-agent\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\", failed to \"StartContainer\" for \"ceilometer-notification-agent\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"]" pod="openstack-kuttl-tests/ceilometer-0" podUID="34633895-031b-4601-beec-01aa64870afb" Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.219236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" event={"ID":"da4c93fc-884b-4701-b589-da46434544d4","Type":"ContainerStarted","Data":"9d29b00738ee00debbe64c58fd28c69fdbf8efc91ce206a05e709e30b7fcbaca"} Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.219714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" event={"ID":"da4c93fc-884b-4701-b589-da46434544d4","Type":"ContainerStarted","Data":"2b55bae3a63d3f831b3a08b94885ec33ff4c786ace9e23aaaba0da7b74ddf29e"} Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.222585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" event={"ID":"2825ea3d-77e9-4cf1-8d50-c772fe89bc30","Type":"ContainerStarted","Data":"c8ff59c06e10b72de9bf6a2f468f8a098c670c930fd78d9dd5beaf6ef3f19137"} Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.223463 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.223490 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.227360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"34633895-031b-4601-beec-01aa64870afb","Type":"ContainerStarted","Data":"0e7bab5bc5a27f3413f305a7ced71a182ae8afe81096382f2ca7009eaf02922d"} Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.227476 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="sg-core" containerID="cri-o://39c580120a547fe1f6223efbbbb1ab63b5d92735f057221612c72f360aca42c3" gracePeriod=30 Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.227730 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.227776 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="proxy-httpd" containerID="cri-o://0e7bab5bc5a27f3413f305a7ced71a182ae8afe81096382f2ca7009eaf02922d" gracePeriod=30 Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.282167 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" podStartSLOduration=3.6792689 podStartE2EDuration="10.282148041s" podCreationTimestamp="2025-11-21 12:12:54 +0000 UTC" firstStartedPulling="2025-11-21 12:12:56.528892871 +0000 UTC m=+1335.229554689" lastFinishedPulling="2025-11-21 12:13:03.131772012 +0000 UTC m=+1341.832433830" observedRunningTime="2025-11-21 12:13:04.280777304 +0000 UTC m=+1342.981439152" watchObservedRunningTime="2025-11-21 12:13:04.282148041 +0000 UTC m=+1342.982809869" Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.285468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" event={"ID":"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd","Type":"ContainerStarted","Data":"e19ea74af62eb79c61648d2fffb4a2f02b7aa934083f7aa2451ae2edceb04ec8"} Nov 21 12:13:04 crc kubenswrapper[4769]: I1121 12:13:04.454396 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" podStartSLOduration=7.454363179 podStartE2EDuration="7.454363179s" podCreationTimestamp="2025-11-21 12:12:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:04.413738422 +0000 UTC m=+1343.114400240" watchObservedRunningTime="2025-11-21 12:13:04.454363179 +0000 UTC m=+1343.155024997" Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.299010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" event={"ID":"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd","Type":"ContainerStarted","Data":"da4697819a0b98c949b52673594747ae7b4e374dc77098740107d6b34c0a4dfc"} Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.302382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" event={"ID":"0b11a06d-8213-4627-9c7d-f293782167ef","Type":"ContainerStarted","Data":"e6c51f5f51aadac314cb671e020efafa42e3dcda60b4752ee3291249844eadbe"} Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.305238 4769 generic.go:334] "Generic (PLEG): container finished" podID="34633895-031b-4601-beec-01aa64870afb" containerID="0e7bab5bc5a27f3413f305a7ced71a182ae8afe81096382f2ca7009eaf02922d" exitCode=0 Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.305306 4769 generic.go:334] "Generic (PLEG): container finished" podID="34633895-031b-4601-beec-01aa64870afb" containerID="39c580120a547fe1f6223efbbbb1ab63b5d92735f057221612c72f360aca42c3" exitCode=2 Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.305332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"34633895-031b-4601-beec-01aa64870afb","Type":"ContainerDied","Data":"0e7bab5bc5a27f3413f305a7ced71a182ae8afe81096382f2ca7009eaf02922d"} Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.305384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"34633895-031b-4601-beec-01aa64870afb","Type":"ContainerDied","Data":"39c580120a547fe1f6223efbbbb1ab63b5d92735f057221612c72f360aca42c3"} Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.319364 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" podStartSLOduration=4.718188645 podStartE2EDuration="11.319335619s" podCreationTimestamp="2025-11-21 12:12:54 +0000 UTC" firstStartedPulling="2025-11-21 12:12:56.525752307 +0000 UTC m=+1335.226414125" lastFinishedPulling="2025-11-21 12:13:03.126899281 +0000 UTC m=+1341.827561099" observedRunningTime="2025-11-21 12:13:05.318771364 +0000 UTC m=+1344.019433182" watchObservedRunningTime="2025-11-21 12:13:05.319335619 +0000 UTC m=+1344.019997427" Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.339835 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" podStartSLOduration=4.296169124 podStartE2EDuration="1m4.339813738s" podCreationTimestamp="2025-11-21 12:12:01 +0000 UTC" firstStartedPulling="2025-11-21 12:12:03.222510494 +0000 UTC m=+1281.923172302" lastFinishedPulling="2025-11-21 12:13:03.266155098 +0000 UTC m=+1341.966816916" observedRunningTime="2025-11-21 12:13:05.339772166 +0000 UTC m=+1344.040433984" watchObservedRunningTime="2025-11-21 12:13:05.339813738 +0000 UTC m=+1344.040475556" Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.670128 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.740432 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h"] Nov 21 12:13:05 crc kubenswrapper[4769]: I1121 12:13:05.740661 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerName="dnsmasq-dns" containerID="cri-o://c840523455eab51055a4a752bfeeef285916f63bc9aa4082fd4352a476ec7df1" gracePeriod=10 Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.042095 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.221770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-combined-ca-bundle\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.221860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtqxc\" (UniqueName: \"kubernetes.io/projected/34633895-031b-4601-beec-01aa64870afb-kube-api-access-mtqxc\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.221909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-scripts\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.221982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-config-data\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.222070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-log-httpd\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.222243 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-run-httpd\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.222287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-sg-core-conf-yaml\") pod \"34633895-031b-4601-beec-01aa64870afb\" (UID: \"34633895-031b-4601-beec-01aa64870afb\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.224239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.224976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.236024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-scripts" (OuterVolumeSpecName: "scripts") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.244445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34633895-031b-4601-beec-01aa64870afb-kube-api-access-mtqxc" (OuterVolumeSpecName: "kube-api-access-mtqxc") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "kube-api-access-mtqxc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.256614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.282390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.304903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-config-data" (OuterVolumeSpecName: "config-data") pod "34633895-031b-4601-beec-01aa64870afb" (UID: "34633895-031b-4601-beec-01aa64870afb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.319023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"34633895-031b-4601-beec-01aa64870afb","Type":"ContainerDied","Data":"2e9746743b2af8780a75c0c35e7024b6ae8eadb86c29ec29d89eb8fb99bc979d"} Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.319102 4769 scope.go:117] "RemoveContainer" containerID="0e7bab5bc5a27f3413f305a7ced71a182ae8afe81096382f2ca7009eaf02922d" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.319036 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.321360 4769 generic.go:334] "Generic (PLEG): container finished" podID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerID="c840523455eab51055a4a752bfeeef285916f63bc9aa4082fd4352a476ec7df1" exitCode=0 Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.322603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" event={"ID":"c1fa6f07-b51c-43ba-8737-db22b3df730c","Type":"ContainerDied","Data":"c840523455eab51055a4a752bfeeef285916f63bc9aa4082fd4352a476ec7df1"} Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.324648 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.325233 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.325387 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.325480 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/34633895-031b-4601-beec-01aa64870afb-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.325600 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.325701 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34633895-031b-4601-beec-01aa64870afb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.325771 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mtqxc\" (UniqueName: \"kubernetes.io/projected/34633895-031b-4601-beec-01aa64870afb-kube-api-access-mtqxc\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.344639 4769 scope.go:117] "RemoveContainer" containerID="39c580120a547fe1f6223efbbbb1ab63b5d92735f057221612c72f360aca42c3" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.395473 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.424002 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.437960 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.445550 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:06 crc kubenswrapper[4769]: E1121 12:13:06.446521 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="proxy-httpd" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446538 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="proxy-httpd" Nov 21 12:13:06 crc kubenswrapper[4769]: E1121 12:13:06.446553 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerName="init" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446560 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerName="init" Nov 21 12:13:06 crc kubenswrapper[4769]: E1121 12:13:06.446571 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="sg-core" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446578 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="sg-core" Nov 21 12:13:06 crc kubenswrapper[4769]: E1121 12:13:06.446598 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerName="dnsmasq-dns" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446605 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerName="dnsmasq-dns" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446834 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" containerName="dnsmasq-dns" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446852 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="sg-core" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.446868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34633895-031b-4601-beec-01aa64870afb" containerName="proxy-httpd" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.448996 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.462391 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.465041 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.464680 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.484616 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.537842 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldh8g\" (UniqueName: \"kubernetes.io/projected/c1fa6f07-b51c-43ba-8737-db22b3df730c-kube-api-access-ldh8g\") pod \"c1fa6f07-b51c-43ba-8737-db22b3df730c\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.537971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-dnsmasq-svc\") pod \"c1fa6f07-b51c-43ba-8737-db22b3df730c\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.538114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-config\") pod \"c1fa6f07-b51c-43ba-8737-db22b3df730c\" (UID: \"c1fa6f07-b51c-43ba-8737-db22b3df730c\") " Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.543884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1fa6f07-b51c-43ba-8737-db22b3df730c-kube-api-access-ldh8g" (OuterVolumeSpecName: "kube-api-access-ldh8g") pod "c1fa6f07-b51c-43ba-8737-db22b3df730c" (UID: "c1fa6f07-b51c-43ba-8737-db22b3df730c"). InnerVolumeSpecName "kube-api-access-ldh8g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.579293 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-config" (OuterVolumeSpecName: "config") pod "c1fa6f07-b51c-43ba-8737-db22b3df730c" (UID: "c1fa6f07-b51c-43ba-8737-db22b3df730c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.583066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "c1fa6f07-b51c-43ba-8737-db22b3df730c" (UID: "c1fa6f07-b51c-43ba-8737-db22b3df730c"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-config-data\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640606 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-log-httpd\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-scripts\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640764 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-run-httpd\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslcn\" (UniqueName: \"kubernetes.io/projected/7922ec6c-2fc5-4708-837f-4910f9d28133-kube-api-access-zslcn\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.640953 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ldh8g\" (UniqueName: \"kubernetes.io/projected/c1fa6f07-b51c-43ba-8737-db22b3df730c-kube-api-access-ldh8g\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.641047 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.641127 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1fa6f07-b51c-43ba-8737-db22b3df730c-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-run-httpd\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zslcn\" (UniqueName: \"kubernetes.io/projected/7922ec6c-2fc5-4708-837f-4910f9d28133-kube-api-access-zslcn\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-config-data\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-log-httpd\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.743673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-scripts\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.744679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-run-httpd\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.745098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-log-httpd\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.748528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.750245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-scripts\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.751122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.751236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-config-data\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.767481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslcn\" (UniqueName: \"kubernetes.io/projected/7922ec6c-2fc5-4708-837f-4910f9d28133-kube-api-access-zslcn\") pod \"ceilometer-0\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.794537 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.797635 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:06 crc kubenswrapper[4769]: I1121 12:13:06.827274 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.286759 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34633895-031b-4601-beec-01aa64870afb" path="/var/lib/kubelet/pods/34633895-031b-4601-beec-01aa64870afb/volumes" Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.336381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" event={"ID":"c1fa6f07-b51c-43ba-8737-db22b3df730c","Type":"ContainerDied","Data":"b4dd6d02a248707edab087316114144662d26fe37396a4f5647fc5aa243645bc"} Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.336461 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h" Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.336476 4769 scope.go:117] "RemoveContainer" containerID="c840523455eab51055a4a752bfeeef285916f63bc9aa4082fd4352a476ec7df1" Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.365458 4769 scope.go:117] "RemoveContainer" containerID="a2d85cf0d3bbf13a5818655c08bdc2f52d21fa2b08503aa3651bded36e7ed286" Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.385559 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h"] Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.393432 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-drv8h"] Nov 21 12:13:07 crc kubenswrapper[4769]: I1121 12:13:07.504009 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:08 crc kubenswrapper[4769]: I1121 12:13:08.349853 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerStarted","Data":"67664d69e9e00093319e8683fdf0b9ce0aa7a77b93d182205a38a4a017d5b0a3"} Nov 21 12:13:09 crc kubenswrapper[4769]: I1121 12:13:09.286586 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1fa6f07-b51c-43ba-8737-db22b3df730c" path="/var/lib/kubelet/pods/c1fa6f07-b51c-43ba-8737-db22b3df730c/volumes" Nov 21 12:13:10 crc kubenswrapper[4769]: I1121 12:13:10.375327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerStarted","Data":"394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73"} Nov 21 12:13:12 crc kubenswrapper[4769]: I1121 12:13:12.658100 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:13:12 crc kubenswrapper[4769]: I1121 12:13:12.741923 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-bc64cb676-548nf"] Nov 21 12:13:12 crc kubenswrapper[4769]: I1121 12:13:12.742227 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api-log" containerID="cri-o://25a15d142c1b4c5af03d47238ecb91c56994dfd2498a67c41cd775ea9f3bca44" gracePeriod=30 Nov 21 12:13:12 crc kubenswrapper[4769]: I1121 12:13:12.742756 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api" containerID="cri-o://4d0b574943bb2cdb0599744a72223e83f5a44151de74db20c9e12c547a59e09d" gracePeriod=30 Nov 21 12:13:14 crc kubenswrapper[4769]: I1121 12:13:14.433162 4769 generic.go:334] "Generic (PLEG): container finished" podID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerID="25a15d142c1b4c5af03d47238ecb91c56994dfd2498a67c41cd775ea9f3bca44" exitCode=143 Nov 21 12:13:14 crc kubenswrapper[4769]: I1121 12:13:14.433535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" event={"ID":"e882f9ba-cb1d-4240-8fb2-587474e72ad1","Type":"ContainerDied","Data":"25a15d142c1b4c5af03d47238ecb91c56994dfd2498a67c41cd775ea9f3bca44"} Nov 21 12:13:15 crc kubenswrapper[4769]: I1121 12:13:15.909934 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.140:9311/healthcheck\": read tcp 10.217.0.2:55036->10.217.0.140:9311: read: connection reset by peer" Nov 21 12:13:15 crc kubenswrapper[4769]: I1121 12:13:15.909983 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.140:9311/healthcheck\": read tcp 10.217.0.2:55050->10.217.0.140:9311: read: connection reset by peer" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.458560 4769 generic.go:334] "Generic (PLEG): container finished" podID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerID="4d0b574943bb2cdb0599744a72223e83f5a44151de74db20c9e12c547a59e09d" exitCode=0 Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.458646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" event={"ID":"e882f9ba-cb1d-4240-8fb2-587474e72ad1","Type":"ContainerDied","Data":"4d0b574943bb2cdb0599744a72223e83f5a44151de74db20c9e12c547a59e09d"} Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.526463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.672273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snxm5\" (UniqueName: \"kubernetes.io/projected/e882f9ba-cb1d-4240-8fb2-587474e72ad1-kube-api-access-snxm5\") pod \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.672456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data\") pod \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.672536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e882f9ba-cb1d-4240-8fb2-587474e72ad1-logs\") pod \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.672565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-combined-ca-bundle\") pod \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.672673 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data-custom\") pod \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\" (UID: \"e882f9ba-cb1d-4240-8fb2-587474e72ad1\") " Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.673468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e882f9ba-cb1d-4240-8fb2-587474e72ad1-logs" (OuterVolumeSpecName: "logs") pod "e882f9ba-cb1d-4240-8fb2-587474e72ad1" (UID: "e882f9ba-cb1d-4240-8fb2-587474e72ad1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.679044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e882f9ba-cb1d-4240-8fb2-587474e72ad1" (UID: "e882f9ba-cb1d-4240-8fb2-587474e72ad1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.679093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e882f9ba-cb1d-4240-8fb2-587474e72ad1-kube-api-access-snxm5" (OuterVolumeSpecName: "kube-api-access-snxm5") pod "e882f9ba-cb1d-4240-8fb2-587474e72ad1" (UID: "e882f9ba-cb1d-4240-8fb2-587474e72ad1"). InnerVolumeSpecName "kube-api-access-snxm5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.701529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e882f9ba-cb1d-4240-8fb2-587474e72ad1" (UID: "e882f9ba-cb1d-4240-8fb2-587474e72ad1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.719951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data" (OuterVolumeSpecName: "config-data") pod "e882f9ba-cb1d-4240-8fb2-587474e72ad1" (UID: "e882f9ba-cb1d-4240-8fb2-587474e72ad1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.785489 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.785535 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-snxm5\" (UniqueName: \"kubernetes.io/projected/e882f9ba-cb1d-4240-8fb2-587474e72ad1-kube-api-access-snxm5\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.785561 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.785574 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e882f9ba-cb1d-4240-8fb2-587474e72ad1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:16 crc kubenswrapper[4769]: I1121 12:13:16.785591 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e882f9ba-cb1d-4240-8fb2-587474e72ad1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.469293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerStarted","Data":"5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e"} Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.472876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" event={"ID":"e882f9ba-cb1d-4240-8fb2-587474e72ad1","Type":"ContainerDied","Data":"440db48348279677f049ea2a499c11ca7c748abf709c2b04dd6aa766a6cf8515"} Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.472930 4769 scope.go:117] "RemoveContainer" containerID="4d0b574943bb2cdb0599744a72223e83f5a44151de74db20c9e12c547a59e09d" Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.473119 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-bc64cb676-548nf" Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.500104 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-bc64cb676-548nf"] Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.508166 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-bc64cb676-548nf"] Nov 21 12:13:17 crc kubenswrapper[4769]: I1121 12:13:17.574042 4769 scope.go:117] "RemoveContainer" containerID="25a15d142c1b4c5af03d47238ecb91c56994dfd2498a67c41cd775ea9f3bca44" Nov 21 12:13:18 crc kubenswrapper[4769]: I1121 12:13:18.486618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerStarted","Data":"5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a"} Nov 21 12:13:19 crc kubenswrapper[4769]: I1121 12:13:19.292763 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" path="/var/lib/kubelet/pods/e882f9ba-cb1d-4240-8fb2-587474e72ad1/volumes" Nov 21 12:13:20 crc kubenswrapper[4769]: I1121 12:13:20.514914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerStarted","Data":"e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7"} Nov 21 12:13:20 crc kubenswrapper[4769]: I1121 12:13:20.515485 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:20 crc kubenswrapper[4769]: I1121 12:13:20.539918 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.623597136 podStartE2EDuration="14.539888165s" podCreationTimestamp="2025-11-21 12:13:06 +0000 UTC" firstStartedPulling="2025-11-21 12:13:07.50807536 +0000 UTC m=+1346.208737188" lastFinishedPulling="2025-11-21 12:13:19.424366359 +0000 UTC m=+1358.125028217" observedRunningTime="2025-11-21 12:13:20.539725421 +0000 UTC m=+1359.240387239" watchObservedRunningTime="2025-11-21 12:13:20.539888165 +0000 UTC m=+1359.240549993" Nov 21 12:13:24 crc kubenswrapper[4769]: I1121 12:13:24.667967 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:13:24 crc kubenswrapper[4769]: I1121 12:13:24.695794 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:13:24 crc kubenswrapper[4769]: I1121 12:13:24.696472 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.481757 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:13:25 crc kubenswrapper[4769]: E1121 12:13:25.488326 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api-log" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.488375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api-log" Nov 21 12:13:25 crc kubenswrapper[4769]: E1121 12:13:25.488399 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.488406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.506354 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api-log" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.506469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e882f9ba-cb1d-4240-8fb2-587474e72ad1" containerName="barbican-api" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.507705 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.513772 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.513796 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.513863 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-f2gmc" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.520920 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.571985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config-secret\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.572624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.572732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868h8\" (UniqueName: \"kubernetes.io/projected/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-kube-api-access-868h8\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.572833 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-combined-ca-bundle\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.674984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.675088 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-868h8\" (UniqueName: \"kubernetes.io/projected/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-kube-api-access-868h8\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.675158 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-combined-ca-bundle\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.675257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config-secret\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.677702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.683081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-combined-ca-bundle\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.692365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config-secret\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.705253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-868h8\" (UniqueName: \"kubernetes.io/projected/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-kube-api-access-868h8\") pod \"openstackclient\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:25 crc kubenswrapper[4769]: I1121 12:13:25.836088 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:13:26 crc kubenswrapper[4769]: I1121 12:13:26.377030 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:13:26 crc kubenswrapper[4769]: I1121 12:13:26.386059 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:13:26 crc kubenswrapper[4769]: I1121 12:13:26.586382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"8870a8ea-8869-4eb6-befb-ca059ee3bfd7","Type":"ContainerStarted","Data":"c3210bc13ecd454884319541f79764c1350dff1f04f2c5f926a507be8f3363b6"} Nov 21 12:13:27 crc kubenswrapper[4769]: I1121 12:13:27.605377 4769 generic.go:334] "Generic (PLEG): container finished" podID="0b11a06d-8213-4627-9c7d-f293782167ef" containerID="e6c51f5f51aadac314cb671e020efafa42e3dcda60b4752ee3291249844eadbe" exitCode=0 Nov 21 12:13:27 crc kubenswrapper[4769]: I1121 12:13:27.605440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" event={"ID":"0b11a06d-8213-4627-9c7d-f293782167ef","Type":"ContainerDied","Data":"e6c51f5f51aadac314cb671e020efafa42e3dcda60b4752ee3291249844eadbe"} Nov 21 12:13:28 crc kubenswrapper[4769]: I1121 12:13:28.976614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-scripts\") pod \"0b11a06d-8213-4627-9c7d-f293782167ef\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0b11a06d-8213-4627-9c7d-f293782167ef-etc-machine-id\") pod \"0b11a06d-8213-4627-9c7d-f293782167ef\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-db-sync-config-data\") pod \"0b11a06d-8213-4627-9c7d-f293782167ef\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2mgj\" (UniqueName: \"kubernetes.io/projected/0b11a06d-8213-4627-9c7d-f293782167ef-kube-api-access-h2mgj\") pod \"0b11a06d-8213-4627-9c7d-f293782167ef\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068549 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-combined-ca-bundle\") pod \"0b11a06d-8213-4627-9c7d-f293782167ef\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0b11a06d-8213-4627-9c7d-f293782167ef-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0b11a06d-8213-4627-9c7d-f293782167ef" (UID: "0b11a06d-8213-4627-9c7d-f293782167ef"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.068746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-config-data\") pod \"0b11a06d-8213-4627-9c7d-f293782167ef\" (UID: \"0b11a06d-8213-4627-9c7d-f293782167ef\") " Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.069262 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0b11a06d-8213-4627-9c7d-f293782167ef-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.080388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0b11a06d-8213-4627-9c7d-f293782167ef" (UID: "0b11a06d-8213-4627-9c7d-f293782167ef"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.092798 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b11a06d-8213-4627-9c7d-f293782167ef-kube-api-access-h2mgj" (OuterVolumeSpecName: "kube-api-access-h2mgj") pod "0b11a06d-8213-4627-9c7d-f293782167ef" (UID: "0b11a06d-8213-4627-9c7d-f293782167ef"). InnerVolumeSpecName "kube-api-access-h2mgj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.114974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-scripts" (OuterVolumeSpecName: "scripts") pod "0b11a06d-8213-4627-9c7d-f293782167ef" (UID: "0b11a06d-8213-4627-9c7d-f293782167ef"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.115008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0b11a06d-8213-4627-9c7d-f293782167ef" (UID: "0b11a06d-8213-4627-9c7d-f293782167ef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.145500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-config-data" (OuterVolumeSpecName: "config-data") pod "0b11a06d-8213-4627-9c7d-f293782167ef" (UID: "0b11a06d-8213-4627-9c7d-f293782167ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.171513 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.171598 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.171610 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.171621 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h2mgj\" (UniqueName: \"kubernetes.io/projected/0b11a06d-8213-4627-9c7d-f293782167ef-kube-api-access-h2mgj\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.171633 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b11a06d-8213-4627-9c7d-f293782167ef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.632292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" event={"ID":"0b11a06d-8213-4627-9c7d-f293782167ef","Type":"ContainerDied","Data":"a68d5e0bad6280acbf5838bf266ddef93ad44a6effa28c2d857cc0e3d1f44e1a"} Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.632343 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a68d5e0bad6280acbf5838bf266ddef93ad44a6effa28c2d857cc0e3d1f44e1a" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.632452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hd8sk" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.943208 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:29 crc kubenswrapper[4769]: E1121 12:13:29.945939 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0b11a06d-8213-4627-9c7d-f293782167ef" containerName="cinder-db-sync" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.946079 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b11a06d-8213-4627-9c7d-f293782167ef" containerName="cinder-db-sync" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.946939 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0b11a06d-8213-4627-9c7d-f293782167ef" containerName="cinder-db-sync" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.950551 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.956412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.958354 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.959892 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-ccd7b" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.960341 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:13:29 crc kubenswrapper[4769]: I1121 12:13:29.960758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.059102 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.067488 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.071377 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.093473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.104907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.104986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.105052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9bwt\" (UniqueName: \"kubernetes.io/projected/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-kube-api-access-v9bwt\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.105074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-scripts\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.105093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.105111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data-custom\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v9bwt\" (UniqueName: \"kubernetes.io/projected/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-kube-api-access-v9bwt\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-scripts\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207513 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207741 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-logs\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.207912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-scripts\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.208025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qzh\" (UniqueName: \"kubernetes.io/projected/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-kube-api-access-67qzh\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.208111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.208130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.208181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.208336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.212871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-scripts\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.213349 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.213399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.214021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.234619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9bwt\" (UniqueName: \"kubernetes.io/projected/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-kube-api-access-v9bwt\") pod \"cinder-scheduler-0\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.287652 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.309801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-logs\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.309885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-scripts\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.309941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-67qzh\" (UniqueName: \"kubernetes.io/projected/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-kube-api-access-67qzh\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.309983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.310051 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.310292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data-custom\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.310359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.311680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.312350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-logs\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.316675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.317704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-scripts\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.325304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.333959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data-custom\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.338836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qzh\" (UniqueName: \"kubernetes.io/projected/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-kube-api-access-67qzh\") pod \"cinder-api-0\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:30 crc kubenswrapper[4769]: I1121 12:13:30.394568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:31 crc kubenswrapper[4769]: I1121 12:13:31.239718 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:31 crc kubenswrapper[4769]: I1121 12:13:31.313772 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:32 crc kubenswrapper[4769]: I1121 12:13:32.251030 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:36 crc kubenswrapper[4769]: I1121 12:13:36.805887 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:37 crc kubenswrapper[4769]: I1121 12:13:37.736255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54","Type":"ContainerStarted","Data":"6e635e2b905c9363def6f35e4c45691b9f30676aea6581f0d23736789c8b7570"} Nov 21 12:13:37 crc kubenswrapper[4769]: I1121 12:13:37.738382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d","Type":"ContainerStarted","Data":"cf7735a1abb97ea754eef70697fada7365e10107a03bfabca11cc182cd3948f8"} Nov 21 12:13:38 crc kubenswrapper[4769]: I1121 12:13:38.776113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54","Type":"ContainerStarted","Data":"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96"} Nov 21 12:13:38 crc kubenswrapper[4769]: I1121 12:13:38.778203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"8870a8ea-8869-4eb6-befb-ca059ee3bfd7","Type":"ContainerStarted","Data":"ae272d0fc0aca11c58d180f73f6c556e1437c8a601c3234e216a6373e3952aa4"} Nov 21 12:13:38 crc kubenswrapper[4769]: I1121 12:13:38.803516 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.433349026 podStartE2EDuration="13.803474351s" podCreationTimestamp="2025-11-21 12:13:25 +0000 UTC" firstStartedPulling="2025-11-21 12:13:26.38587054 +0000 UTC m=+1365.086532358" lastFinishedPulling="2025-11-21 12:13:37.755995865 +0000 UTC m=+1376.456657683" observedRunningTime="2025-11-21 12:13:38.795674459 +0000 UTC m=+1377.496336287" watchObservedRunningTime="2025-11-21 12:13:38.803474351 +0000 UTC m=+1377.504136169" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.461078 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7fc58899d-l4892"] Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.463132 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.469858 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.470073 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.470073 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.486913 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7fc58899d-l4892"] Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-public-tls-certs\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-internal-tls-certs\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-run-httpd\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-config-data\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-log-httpd\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522751 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-etc-swift\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-combined-ca-bundle\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.522791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkm9\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-kube-api-access-spkm9\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.624906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-log-httpd\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-etc-swift\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-combined-ca-bundle\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-spkm9\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-kube-api-access-spkm9\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-public-tls-certs\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-internal-tls-certs\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-run-httpd\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625374 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-log-httpd\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.625391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-config-data\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.626643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-run-httpd\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.635022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-public-tls-certs\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.635147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-config-data\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.636379 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-combined-ca-bundle\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.638980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-internal-tls-certs\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.640688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-etc-swift\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.644747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkm9\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-kube-api-access-spkm9\") pod \"swift-proxy-7fc58899d-l4892\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.829345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54","Type":"ContainerStarted","Data":"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef"} Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.829567 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api-log" containerID="cri-o://f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96" gracePeriod=30 Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.829861 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.830177 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api" containerID="cri-o://f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef" gracePeriod=30 Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.838006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.855846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d","Type":"ContainerStarted","Data":"0aa96edeca3b1aa346f8a1c20dd97fce10a07b285881ccf8bb665ccd698bdbd7"} Nov 21 12:13:39 crc kubenswrapper[4769]: I1121 12:13:39.858479 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=9.858459432 podStartE2EDuration="9.858459432s" podCreationTimestamp="2025-11-21 12:13:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:39.85763627 +0000 UTC m=+1378.558298098" watchObservedRunningTime="2025-11-21 12:13:39.858459432 +0000 UTC m=+1378.559121250" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.311423 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.318290 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-central-agent" containerID="cri-o://394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73" gracePeriod=30 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.318745 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="proxy-httpd" containerID="cri-o://e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7" gracePeriod=30 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.318790 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="sg-core" containerID="cri-o://5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a" gracePeriod=30 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.318831 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-notification-agent" containerID="cri-o://5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e" gracePeriod=30 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.629223 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7fc58899d-l4892"] Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.899570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d","Type":"ContainerStarted","Data":"26524f7c7fc85ed7e844fab7e7a0ee87bb1fd7cc9578ba6c3a6aa957e24f37a9"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.900745 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.902662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" event={"ID":"d14bc1fc-4621-423c-9dd3-36ea104d0c9f","Type":"ContainerStarted","Data":"b7409e6ff55a99bd8121c4d07a60823a465a4605e8880ea133157a277b130175"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.908910 4769 generic.go:334] "Generic (PLEG): container finished" podID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerID="e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7" exitCode=0 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.908971 4769 generic.go:334] "Generic (PLEG): container finished" podID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerID="5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a" exitCode=2 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.909070 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerDied","Data":"e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.909113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerDied","Data":"5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.911907 4769 generic.go:334] "Generic (PLEG): container finished" podID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerID="f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef" exitCode=0 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.911950 4769 generic.go:334] "Generic (PLEG): container finished" podID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerID="f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96" exitCode=143 Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.911980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54","Type":"ContainerDied","Data":"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.911998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.912022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54","Type":"ContainerDied","Data":"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.912064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54","Type":"ContainerDied","Data":"6e635e2b905c9363def6f35e4c45691b9f30676aea6581f0d23736789c8b7570"} Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.912090 4769 scope.go:117] "RemoveContainer" containerID="f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.973628 4769 scope.go:117] "RemoveContainer" containerID="f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.974119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data-custom\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.974168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.974256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-scripts\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.983125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-scripts" (OuterVolumeSpecName: "scripts") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.988375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.990628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-logs\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.990689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67qzh\" (UniqueName: \"kubernetes.io/projected/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-kube-api-access-67qzh\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.990816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-combined-ca-bundle\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.990999 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-etc-machine-id\") pod \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\" (UID: \"0fd5f0dd-4c5f-437d-8042-c0ae30a30a54\") " Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.991101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.991198 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-logs" (OuterVolumeSpecName: "logs") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.992077 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.992113 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.992131 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.992145 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:40 crc kubenswrapper[4769]: I1121 12:13:40.994719 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=10.931390089 podStartE2EDuration="11.994688366s" podCreationTimestamp="2025-11-21 12:13:29 +0000 UTC" firstStartedPulling="2025-11-21 12:13:37.670214668 +0000 UTC m=+1376.370876486" lastFinishedPulling="2025-11-21 12:13:38.733512945 +0000 UTC m=+1377.434174763" observedRunningTime="2025-11-21 12:13:40.954000527 +0000 UTC m=+1379.654662355" watchObservedRunningTime="2025-11-21 12:13:40.994688366 +0000 UTC m=+1379.695350194" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.015885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-kube-api-access-67qzh" (OuterVolumeSpecName: "kube-api-access-67qzh") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "kube-api-access-67qzh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.038796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.095369 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-67qzh\" (UniqueName: \"kubernetes.io/projected/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-kube-api-access-67qzh\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.095416 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.114316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data" (OuterVolumeSpecName: "config-data") pod "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" (UID: "0fd5f0dd-4c5f-437d-8042-c0ae30a30a54"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.117865 4769 scope.go:117] "RemoveContainer" containerID="f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef" Nov 21 12:13:41 crc kubenswrapper[4769]: E1121 12:13:41.118254 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef\": container with ID starting with f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef not found: ID does not exist" containerID="f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.118293 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef"} err="failed to get container status \"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef\": rpc error: code = NotFound desc = could not find container \"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef\": container with ID starting with f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef not found: ID does not exist" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.118315 4769 scope.go:117] "RemoveContainer" containerID="f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96" Nov 21 12:13:41 crc kubenswrapper[4769]: E1121 12:13:41.118835 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96\": container with ID starting with f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96 not found: ID does not exist" containerID="f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.118863 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96"} err="failed to get container status \"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96\": rpc error: code = NotFound desc = could not find container \"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96\": container with ID starting with f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96 not found: ID does not exist" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.118879 4769 scope.go:117] "RemoveContainer" containerID="f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.119690 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef"} err="failed to get container status \"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef\": rpc error: code = NotFound desc = could not find container \"f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef\": container with ID starting with f16779c0e07b58c0d1593b44a38a9f20abca453e460c88e555b7a88668b903ef not found: ID does not exist" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.119715 4769 scope.go:117] "RemoveContainer" containerID="f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.120067 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96"} err="failed to get container status \"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96\": rpc error: code = NotFound desc = could not find container \"f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96\": container with ID starting with f96f0fc05d0ac09b63c35a55a718292e9ce4fafe0145763c62ee8102bcd7ea96 not found: ID does not exist" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.197283 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.249155 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.258012 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.288829 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" path="/var/lib/kubelet/pods/0fd5f0dd-4c5f-437d-8042-c0ae30a30a54/volumes" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.289984 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:41 crc kubenswrapper[4769]: E1121 12:13:41.290436 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api-log" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.290464 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api-log" Nov 21 12:13:41 crc kubenswrapper[4769]: E1121 12:13:41.290501 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.290511 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.290794 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api-log" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.290833 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0fd5f0dd-4c5f-437d-8042-c0ae30a30a54" containerName="cinder-api" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.295988 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.298437 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.306566 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.306955 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.315565 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.325566 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.325633 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-public-tls-certs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5gs\" (UniqueName: \"kubernetes.io/projected/41f05d9d-6645-4531-bca1-e94840a5bc88-kube-api-access-8z5gs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-scripts\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41f05d9d-6645-4531-bca1-e94840a5bc88-etc-machine-id\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/41f05d9d-6645-4531-bca1-e94840a5bc88-logs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.401926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.402024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data-custom\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/41f05d9d-6645-4531-bca1-e94840a5bc88-logs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504304 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data-custom\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-public-tls-certs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5gs\" (UniqueName: \"kubernetes.io/projected/41f05d9d-6645-4531-bca1-e94840a5bc88-kube-api-access-8z5gs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-scripts\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41f05d9d-6645-4531-bca1-e94840a5bc88-etc-machine-id\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.504714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/41f05d9d-6645-4531-bca1-e94840a5bc88-logs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.506117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41f05d9d-6645-4531-bca1-e94840a5bc88-etc-machine-id\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.509328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.509750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-scripts\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.511156 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-public-tls-certs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.512603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.512783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.514460 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data-custom\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.528631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5gs\" (UniqueName: \"kubernetes.io/projected/41f05d9d-6645-4531-bca1-e94840a5bc88-kube-api-access-8z5gs\") pod \"cinder-api-0\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.625300 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.926466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" event={"ID":"d14bc1fc-4621-423c-9dd3-36ea104d0c9f","Type":"ContainerStarted","Data":"337739d7c6d68e563dbc1168d422c8896ff321520b12a745cb41f2efcbf22a32"} Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.926970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" event={"ID":"d14bc1fc-4621-423c-9dd3-36ea104d0c9f","Type":"ContainerStarted","Data":"e69a0f0ed22436a34cabf3ecae6cabee67d0e8b122d3a32b210fb84c9c1543b8"} Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.928421 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.928449 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.935328 4769 generic.go:334] "Generic (PLEG): container finished" podID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerID="394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73" exitCode=0 Nov 21 12:13:41 crc kubenswrapper[4769]: I1121 12:13:41.935441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerDied","Data":"394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73"} Nov 21 12:13:42 crc kubenswrapper[4769]: I1121 12:13:42.114296 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podStartSLOduration=3.114274287 podStartE2EDuration="3.114274287s" podCreationTimestamp="2025-11-21 12:13:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:41.961464494 +0000 UTC m=+1380.662126322" watchObservedRunningTime="2025-11-21 12:13:42.114274287 +0000 UTC m=+1380.814936105" Nov 21 12:13:42 crc kubenswrapper[4769]: I1121 12:13:42.116510 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:13:42 crc kubenswrapper[4769]: I1121 12:13:42.954762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"41f05d9d-6645-4531-bca1-e94840a5bc88","Type":"ContainerStarted","Data":"f567395d75936121013d9336600af062b6f6f14dfc4ee8d5c7616466811f6ba7"} Nov 21 12:13:42 crc kubenswrapper[4769]: I1121 12:13:42.955269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"41f05d9d-6645-4531-bca1-e94840a5bc88","Type":"ContainerStarted","Data":"befed93acbfe9a9bbdd04ef15887b847a8dfd06fb93dac40bf5629f91ce9503a"} Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.681984 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.773997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-config-data\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.774070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-log-httpd\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.774114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-run-httpd\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.774182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zslcn\" (UniqueName: \"kubernetes.io/projected/7922ec6c-2fc5-4708-837f-4910f9d28133-kube-api-access-zslcn\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.774228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-combined-ca-bundle\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.774307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-sg-core-conf-yaml\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.774337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-scripts\") pod \"7922ec6c-2fc5-4708-837f-4910f9d28133\" (UID: \"7922ec6c-2fc5-4708-837f-4910f9d28133\") " Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.775562 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.775779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.780965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-scripts" (OuterVolumeSpecName: "scripts") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.782333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7922ec6c-2fc5-4708-837f-4910f9d28133-kube-api-access-zslcn" (OuterVolumeSpecName: "kube-api-access-zslcn") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "kube-api-access-zslcn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.814284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.864802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.878539 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.878572 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7922ec6c-2fc5-4708-837f-4910f9d28133-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.878582 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zslcn\" (UniqueName: \"kubernetes.io/projected/7922ec6c-2fc5-4708-837f-4910f9d28133-kube-api-access-zslcn\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.878592 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.878608 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.878616 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.894681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-config-data" (OuterVolumeSpecName: "config-data") pod "7922ec6c-2fc5-4708-837f-4910f9d28133" (UID: "7922ec6c-2fc5-4708-837f-4910f9d28133"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.967816 4769 generic.go:334] "Generic (PLEG): container finished" podID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerID="5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e" exitCode=0 Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.967927 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.967918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerDied","Data":"5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e"} Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.968630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7922ec6c-2fc5-4708-837f-4910f9d28133","Type":"ContainerDied","Data":"67664d69e9e00093319e8683fdf0b9ce0aa7a77b93d182205a38a4a017d5b0a3"} Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.968655 4769 scope.go:117] "RemoveContainer" containerID="e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.974024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"41f05d9d-6645-4531-bca1-e94840a5bc88","Type":"ContainerStarted","Data":"0f58a7d093708947f264330141cef846704d32a8005d80f147ef2f2cd05b2330"} Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.975715 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:43 crc kubenswrapper[4769]: I1121 12:13:43.980542 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7922ec6c-2fc5-4708-837f-4910f9d28133-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.014160 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.014135094 podStartE2EDuration="3.014135094s" podCreationTimestamp="2025-11-21 12:13:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:44.002799145 +0000 UTC m=+1382.703460993" watchObservedRunningTime="2025-11-21 12:13:44.014135094 +0000 UTC m=+1382.714796912" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.033326 4769 scope.go:117] "RemoveContainer" containerID="5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.047821 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.066004 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.079092 4769 scope.go:117] "RemoveContainer" containerID="5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.081676 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.082221 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-notification-agent" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082245 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-notification-agent" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.082263 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-central-agent" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082271 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-central-agent" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.082303 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="sg-core" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082313 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="sg-core" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.082329 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="proxy-httpd" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082338 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="proxy-httpd" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082606 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-central-agent" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082660 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="proxy-httpd" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082681 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="ceilometer-notification-agent" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.082697 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" containerName="sg-core" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.084988 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.091212 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.092269 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.093175 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.131182 4769 scope.go:117] "RemoveContainer" containerID="394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.164104 4769 scope.go:117] "RemoveContainer" containerID="e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.164690 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7\": container with ID starting with e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7 not found: ID does not exist" containerID="e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.164756 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7"} err="failed to get container status \"e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7\": rpc error: code = NotFound desc = could not find container \"e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7\": container with ID starting with e4de0b2a47f0d11db179ad14437d118fb5b63c0f41cb954a6fd80e0119ac2aa7 not found: ID does not exist" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.164799 4769 scope.go:117] "RemoveContainer" containerID="5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.165452 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a\": container with ID starting with 5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a not found: ID does not exist" containerID="5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.165511 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a"} err="failed to get container status \"5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a\": rpc error: code = NotFound desc = could not find container \"5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a\": container with ID starting with 5db93eeaa09fcd73bac22fc0f94b2ce7a2b2c1f2a3b398159eb87d662411f25a not found: ID does not exist" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.165549 4769 scope.go:117] "RemoveContainer" containerID="5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.166115 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e\": container with ID starting with 5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e not found: ID does not exist" containerID="5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.166163 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e"} err="failed to get container status \"5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e\": rpc error: code = NotFound desc = could not find container \"5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e\": container with ID starting with 5fe16d611afee577df7b0af8bb0212315fb68dda409741f6bc7802bad2b1828e not found: ID does not exist" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.166212 4769 scope.go:117] "RemoveContainer" containerID="394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73" Nov 21 12:13:44 crc kubenswrapper[4769]: E1121 12:13:44.166427 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73\": container with ID starting with 394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73 not found: ID does not exist" containerID="394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.166459 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73"} err="failed to get container status \"394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73\": rpc error: code = NotFound desc = could not find container \"394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73\": container with ID starting with 394f086c29d0fb4a6e2801b8224915542e40067d8268aed1888a6ac392544c73 not found: ID does not exist" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.193453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-scripts\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.193529 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-run-httpd\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.193678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-log-httpd\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.193789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whgv\" (UniqueName: \"kubernetes.io/projected/e0af6dea-9629-4de1-9654-00bd64643b93-kube-api-access-6whgv\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.193866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.193981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.194033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-config-data\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.296177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.296280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-config-data\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.296407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-scripts\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.296458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-run-httpd\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.296501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-log-httpd\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.296546 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6whgv\" (UniqueName: \"kubernetes.io/projected/e0af6dea-9629-4de1-9654-00bd64643b93-kube-api-access-6whgv\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.297095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.297211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-run-httpd\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.297309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-log-httpd\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.304348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-config-data\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.304615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.319290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-scripts\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.320077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.325737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whgv\" (UniqueName: \"kubernetes.io/projected/e0af6dea-9629-4de1-9654-00bd64643b93-kube-api-access-6whgv\") pod \"ceilometer-0\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.406280 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:44 crc kubenswrapper[4769]: W1121 12:13:44.767898 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0af6dea_9629_4de1_9654_00bd64643b93.slice/crio-a4bee4ef99274ff3ebafd425886e88e94cd35d9a71066c4e3c4a293550fdd73d WatchSource:0}: Error finding container a4bee4ef99274ff3ebafd425886e88e94cd35d9a71066c4e3c4a293550fdd73d: Status 404 returned error can't find the container with id a4bee4ef99274ff3ebafd425886e88e94cd35d9a71066c4e3c4a293550fdd73d Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.768089 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:13:44 crc kubenswrapper[4769]: I1121 12:13:44.988501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerStarted","Data":"a4bee4ef99274ff3ebafd425886e88e94cd35d9a71066c4e3c4a293550fdd73d"} Nov 21 12:13:45 crc kubenswrapper[4769]: I1121 12:13:45.291022 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7922ec6c-2fc5-4708-837f-4910f9d28133" path="/var/lib/kubelet/pods/7922ec6c-2fc5-4708-837f-4910f9d28133/volumes" Nov 21 12:13:45 crc kubenswrapper[4769]: I1121 12:13:45.292766 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:45 crc kubenswrapper[4769]: I1121 12:13:45.741492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:45 crc kubenswrapper[4769]: I1121 12:13:45.997789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerStarted","Data":"00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2"} Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.044401 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.528218 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-2qcvq"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.530664 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.569476 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-2qcvq"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.619103 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-bknpf"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.621580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.631098 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.632645 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.635952 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.659678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.667639 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4g8c\" (UniqueName: \"kubernetes.io/projected/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-kube-api-access-m4g8c\") pod \"nova-api-db-create-2qcvq\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.667798 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-operator-scripts\") pod \"nova-api-db-create-2qcvq\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.669601 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-bknpf"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.711708 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-82h5b"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.713465 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.724050 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-82h5b"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.769172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m4g8c\" (UniqueName: \"kubernetes.io/projected/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-kube-api-access-m4g8c\") pod \"nova-api-db-create-2qcvq\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.769437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-operator-scripts\") pod \"nova-api-db-create-2qcvq\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.769519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtxr\" (UniqueName: \"kubernetes.io/projected/13eb83d2-1076-4627-8f43-1c6972e0f779-kube-api-access-5wtxr\") pod \"nova-api-2ea5-account-create-fswnr\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.769596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrm78\" (UniqueName: \"kubernetes.io/projected/00bef931-fe95-4aab-bd14-1f8778a37b34-kube-api-access-wrm78\") pod \"nova-cell0-db-create-bknpf\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.769700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/00bef931-fe95-4aab-bd14-1f8778a37b34-operator-scripts\") pod \"nova-cell0-db-create-bknpf\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.769882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13eb83d2-1076-4627-8f43-1c6972e0f779-operator-scripts\") pod \"nova-api-2ea5-account-create-fswnr\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.771654 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-operator-scripts\") pod \"nova-api-db-create-2qcvq\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.794831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4g8c\" (UniqueName: \"kubernetes.io/projected/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-kube-api-access-m4g8c\") pod \"nova-api-db-create-2qcvq\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.814893 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.816616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.819215 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.840529 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.872138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wrm78\" (UniqueName: \"kubernetes.io/projected/00bef931-fe95-4aab-bd14-1f8778a37b34-kube-api-access-wrm78\") pod \"nova-cell0-db-create-bknpf\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.872221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq77q\" (UniqueName: \"kubernetes.io/projected/72219b79-7832-4690-973e-ef63273d47b7-kube-api-access-xq77q\") pod \"nova-cell1-db-create-82h5b\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.872275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/00bef931-fe95-4aab-bd14-1f8778a37b34-operator-scripts\") pod \"nova-cell0-db-create-bknpf\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.872756 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72219b79-7832-4690-973e-ef63273d47b7-operator-scripts\") pod \"nova-cell1-db-create-82h5b\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.873077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13eb83d2-1076-4627-8f43-1c6972e0f779-operator-scripts\") pod \"nova-api-2ea5-account-create-fswnr\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.873298 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtxr\" (UniqueName: \"kubernetes.io/projected/13eb83d2-1076-4627-8f43-1c6972e0f779-kube-api-access-5wtxr\") pod \"nova-api-2ea5-account-create-fswnr\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.873572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/00bef931-fe95-4aab-bd14-1f8778a37b34-operator-scripts\") pod \"nova-cell0-db-create-bknpf\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.874013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13eb83d2-1076-4627-8f43-1c6972e0f779-operator-scripts\") pod \"nova-api-2ea5-account-create-fswnr\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.893307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrm78\" (UniqueName: \"kubernetes.io/projected/00bef931-fe95-4aab-bd14-1f8778a37b34-kube-api-access-wrm78\") pod \"nova-cell0-db-create-bknpf\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.895609 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtxr\" (UniqueName: \"kubernetes.io/projected/13eb83d2-1076-4627-8f43-1c6972e0f779-kube-api-access-5wtxr\") pod \"nova-api-2ea5-account-create-fswnr\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.928555 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.929855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.932139 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.940112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.945995 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr"] Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.976882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ckd\" (UniqueName: \"kubernetes.io/projected/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-kube-api-access-l5ckd\") pod \"nova-cell0-d8c4-account-create-8fwmk\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.976987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72219b79-7832-4690-973e-ef63273d47b7-operator-scripts\") pod \"nova-cell1-db-create-82h5b\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.977109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-operator-scripts\") pod \"nova-cell0-d8c4-account-create-8fwmk\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.977159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xq77q\" (UniqueName: \"kubernetes.io/projected/72219b79-7832-4690-973e-ef63273d47b7-kube-api-access-xq77q\") pod \"nova-cell1-db-create-82h5b\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.978399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72219b79-7832-4690-973e-ef63273d47b7-operator-scripts\") pod \"nova-cell1-db-create-82h5b\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.998313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:46 crc kubenswrapper[4769]: I1121 12:13:46.998656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.003366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq77q\" (UniqueName: \"kubernetes.io/projected/72219b79-7832-4690-973e-ef63273d47b7-kube-api-access-xq77q\") pod \"nova-cell1-db-create-82h5b\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.024734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerStarted","Data":"3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf"} Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.024928 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="cinder-scheduler" containerID="cri-o://0aa96edeca3b1aa346f8a1c20dd97fce10a07b285881ccf8bb665ccd698bdbd7" gracePeriod=30 Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.025018 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="probe" containerID="cri-o://26524f7c7fc85ed7e844fab7e7a0ee87bb1fd7cc9578ba6c3a6aa957e24f37a9" gracePeriod=30 Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.035888 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.083176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ckd\" (UniqueName: \"kubernetes.io/projected/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-kube-api-access-l5ckd\") pod \"nova-cell0-d8c4-account-create-8fwmk\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.083769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e1c225c-80d6-4815-a568-84586f607c18-operator-scripts\") pod \"nova-cell1-60f3-account-create-xnblr\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.083824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-operator-scripts\") pod \"nova-cell0-d8c4-account-create-8fwmk\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.083920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stw69\" (UniqueName: \"kubernetes.io/projected/3e1c225c-80d6-4815-a568-84586f607c18-kube-api-access-stw69\") pod \"nova-cell1-60f3-account-create-xnblr\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.093169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-operator-scripts\") pod \"nova-cell0-d8c4-account-create-8fwmk\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.115148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ckd\" (UniqueName: \"kubernetes.io/projected/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-kube-api-access-l5ckd\") pod \"nova-cell0-d8c4-account-create-8fwmk\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.159107 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.185815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e1c225c-80d6-4815-a568-84586f607c18-operator-scripts\") pod \"nova-cell1-60f3-account-create-xnblr\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.185927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-stw69\" (UniqueName: \"kubernetes.io/projected/3e1c225c-80d6-4815-a568-84586f607c18-kube-api-access-stw69\") pod \"nova-cell1-60f3-account-create-xnblr\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.187173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e1c225c-80d6-4815-a568-84586f607c18-operator-scripts\") pod \"nova-cell1-60f3-account-create-xnblr\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.214761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-stw69\" (UniqueName: \"kubernetes.io/projected/3e1c225c-80d6-4815-a568-84586f607c18-kube-api-access-stw69\") pod \"nova-cell1-60f3-account-create-xnblr\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.268657 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.500796 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-2qcvq"] Nov 21 12:13:47 crc kubenswrapper[4769]: W1121 12:13:47.518319 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1865ea5b_bdb8_4d52_a805_30f4a0a870a1.slice/crio-9ed287e71540f4dedb9c77af4340c6f12992a8857462e5fde6eb69132c777c8d WatchSource:0}: Error finding container 9ed287e71540f4dedb9c77af4340c6f12992a8857462e5fde6eb69132c777c8d: Status 404 returned error can't find the container with id 9ed287e71540f4dedb9c77af4340c6f12992a8857462e5fde6eb69132c777c8d Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.637736 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr"] Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.807809 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-bknpf"] Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.824517 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-82h5b"] Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.917572 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk"] Nov 21 12:13:47 crc kubenswrapper[4769]: I1121 12:13:47.970686 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr"] Nov 21 12:13:47 crc kubenswrapper[4769]: W1121 12:13:47.997994 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e1c225c_80d6_4815_a568_84586f607c18.slice/crio-c858da334c5fbffb2b6245087ae81fe698e641a3b73013743c52d8ecd911bb5c WatchSource:0}: Error finding container c858da334c5fbffb2b6245087ae81fe698e641a3b73013743c52d8ecd911bb5c: Status 404 returned error can't find the container with id c858da334c5fbffb2b6245087ae81fe698e641a3b73013743c52d8ecd911bb5c Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.042131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" event={"ID":"13eb83d2-1076-4627-8f43-1c6972e0f779","Type":"ContainerStarted","Data":"b7da1286a0b1a8ad11eaff91b4c41c751369e8b838270b461ceb8a7911c1d8a7"} Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.048436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" event={"ID":"72219b79-7832-4690-973e-ef63273d47b7","Type":"ContainerStarted","Data":"7cffcd4577a66181a0121bec55e92e88eefa6eb890a91776b93bba4006d334ec"} Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.051022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" event={"ID":"00bef931-fe95-4aab-bd14-1f8778a37b34","Type":"ContainerStarted","Data":"2cfa2d9260dd0ea74f196f913ec875ccbb2c53e0c81333a7b6010956b732cca1"} Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.052589 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" event={"ID":"5bc07ccc-96e2-45fd-a7df-2f659e62a28c","Type":"ContainerStarted","Data":"95ee65270f74d1ae1e56e3df2746ace2434181fa43cc618a59eb96f5c9b660f2"} Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.059421 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerID="26524f7c7fc85ed7e844fab7e7a0ee87bb1fd7cc9578ba6c3a6aa957e24f37a9" exitCode=0 Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.059504 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d","Type":"ContainerDied","Data":"26524f7c7fc85ed7e844fab7e7a0ee87bb1fd7cc9578ba6c3a6aa957e24f37a9"} Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.061330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" event={"ID":"1865ea5b-bdb8-4d52-a805-30f4a0a870a1","Type":"ContainerStarted","Data":"9ed287e71540f4dedb9c77af4340c6f12992a8857462e5fde6eb69132c777c8d"} Nov 21 12:13:48 crc kubenswrapper[4769]: I1121 12:13:48.062638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" event={"ID":"3e1c225c-80d6-4815-a568-84586f607c18","Type":"ContainerStarted","Data":"c858da334c5fbffb2b6245087ae81fe698e641a3b73013743c52d8ecd911bb5c"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.086957 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" event={"ID":"3e1c225c-80d6-4815-a568-84586f607c18","Type":"ContainerStarted","Data":"08dd1479e2aca203dc5fc7ddbe94e087322ff19616b2eac4eaec1b860695c9df"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.089313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerStarted","Data":"56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.093553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" event={"ID":"13eb83d2-1076-4627-8f43-1c6972e0f779","Type":"ContainerStarted","Data":"df69af6335fbc2ae6e047325ced14ef0bd4a272ac2738237c8359371a2f471fe"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.098307 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" event={"ID":"72219b79-7832-4690-973e-ef63273d47b7","Type":"ContainerStarted","Data":"0f48367076d95c5b7b37b3d211fe0e2acd8c96859d43ead15c023207dab160f3"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.106960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" event={"ID":"00bef931-fe95-4aab-bd14-1f8778a37b34","Type":"ContainerStarted","Data":"825404bc8ce92279a7a5d401738064f06529617a29ca5bd0b3a4deb729da83e9"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.114740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" event={"ID":"5bc07ccc-96e2-45fd-a7df-2f659e62a28c","Type":"ContainerStarted","Data":"3280ce84ae2e0c5d3285a21265201bb2afe0ddd3d315a640fcf8a796827408e9"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.116922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" event={"ID":"1865ea5b-bdb8-4d52-a805-30f4a0a870a1","Type":"ContainerStarted","Data":"9ea8205172aeb3a656e89536efe402a8749679f702d232cc9123f84aa05720ff"} Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.150554 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" podStartSLOduration=3.150530184 podStartE2EDuration="3.150530184s" podCreationTimestamp="2025-11-21 12:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:49.132238666 +0000 UTC m=+1387.832900484" watchObservedRunningTime="2025-11-21 12:13:49.150530184 +0000 UTC m=+1387.851192012" Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.150679 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" podStartSLOduration=3.150671638 podStartE2EDuration="3.150671638s" podCreationTimestamp="2025-11-21 12:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:49.111690206 +0000 UTC m=+1387.812352024" watchObservedRunningTime="2025-11-21 12:13:49.150671638 +0000 UTC m=+1387.851333466" Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.845439 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:49 crc kubenswrapper[4769]: I1121 12:13:49.872265 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:13:50 crc kubenswrapper[4769]: I1121 12:13:50.149984 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" podStartSLOduration=4.149955882 podStartE2EDuration="4.149955882s" podCreationTimestamp="2025-11-21 12:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:50.148247915 +0000 UTC m=+1388.848909783" watchObservedRunningTime="2025-11-21 12:13:50.149955882 +0000 UTC m=+1388.850617700" Nov 21 12:13:50 crc kubenswrapper[4769]: I1121 12:13:50.174744 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" podStartSLOduration=4.174725496 podStartE2EDuration="4.174725496s" podCreationTimestamp="2025-11-21 12:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:50.162486833 +0000 UTC m=+1388.863148651" watchObservedRunningTime="2025-11-21 12:13:50.174725496 +0000 UTC m=+1388.875387314" Nov 21 12:13:50 crc kubenswrapper[4769]: I1121 12:13:50.189634 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" podStartSLOduration=4.189614692 podStartE2EDuration="4.189614692s" podCreationTimestamp="2025-11-21 12:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:50.181025608 +0000 UTC m=+1388.881687436" watchObservedRunningTime="2025-11-21 12:13:50.189614692 +0000 UTC m=+1388.890276520" Nov 21 12:13:50 crc kubenswrapper[4769]: I1121 12:13:50.213057 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" podStartSLOduration=4.21302049 podStartE2EDuration="4.21302049s" podCreationTimestamp="2025-11-21 12:13:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:50.201593178 +0000 UTC m=+1388.902254996" watchObservedRunningTime="2025-11-21 12:13:50.21302049 +0000 UTC m=+1388.913682348" Nov 21 12:13:52 crc kubenswrapper[4769]: I1121 12:13:52.148901 4769 generic.go:334] "Generic (PLEG): container finished" podID="72219b79-7832-4690-973e-ef63273d47b7" containerID="0f48367076d95c5b7b37b3d211fe0e2acd8c96859d43ead15c023207dab160f3" exitCode=0 Nov 21 12:13:52 crc kubenswrapper[4769]: I1121 12:13:52.149072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" event={"ID":"72219b79-7832-4690-973e-ef63273d47b7","Type":"ContainerDied","Data":"0f48367076d95c5b7b37b3d211fe0e2acd8c96859d43ead15c023207dab160f3"} Nov 21 12:13:52 crc kubenswrapper[4769]: I1121 12:13:52.152318 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerID="0aa96edeca3b1aa346f8a1c20dd97fce10a07b285881ccf8bb665ccd698bdbd7" exitCode=0 Nov 21 12:13:52 crc kubenswrapper[4769]: I1121 12:13:52.152352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d","Type":"ContainerDied","Data":"0aa96edeca3b1aa346f8a1c20dd97fce10a07b285881ccf8bb665ccd698bdbd7"} Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.174395 4769 generic.go:334] "Generic (PLEG): container finished" podID="3e1c225c-80d6-4815-a568-84586f607c18" containerID="08dd1479e2aca203dc5fc7ddbe94e087322ff19616b2eac4eaec1b860695c9df" exitCode=0 Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.174852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" event={"ID":"3e1c225c-80d6-4815-a568-84586f607c18","Type":"ContainerDied","Data":"08dd1479e2aca203dc5fc7ddbe94e087322ff19616b2eac4eaec1b860695c9df"} Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.454220 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.529382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data-custom\") pod \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.529547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9bwt\" (UniqueName: \"kubernetes.io/projected/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-kube-api-access-v9bwt\") pod \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.529653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-combined-ca-bundle\") pod \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.529757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-scripts\") pod \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.529779 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data\") pod \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.529808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-etc-machine-id\") pod \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\" (UID: \"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.530877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" (UID: "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.538463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-kube-api-access-v9bwt" (OuterVolumeSpecName: "kube-api-access-v9bwt") pod "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" (UID: "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d"). InnerVolumeSpecName "kube-api-access-v9bwt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.539878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-scripts" (OuterVolumeSpecName: "scripts") pod "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" (UID: "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.541300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" (UID: "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.582870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" (UID: "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.632458 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.632495 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v9bwt\" (UniqueName: \"kubernetes.io/projected/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-kube-api-access-v9bwt\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.632510 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.632521 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.632532 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.647750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data" (OuterVolumeSpecName: "config-data") pod "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" (UID: "dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.664768 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.734056 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.835048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72219b79-7832-4690-973e-ef63273d47b7-operator-scripts\") pod \"72219b79-7832-4690-973e-ef63273d47b7\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.835279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq77q\" (UniqueName: \"kubernetes.io/projected/72219b79-7832-4690-973e-ef63273d47b7-kube-api-access-xq77q\") pod \"72219b79-7832-4690-973e-ef63273d47b7\" (UID: \"72219b79-7832-4690-973e-ef63273d47b7\") " Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.836426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72219b79-7832-4690-973e-ef63273d47b7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "72219b79-7832-4690-973e-ef63273d47b7" (UID: "72219b79-7832-4690-973e-ef63273d47b7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.836796 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/72219b79-7832-4690-973e-ef63273d47b7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.841517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72219b79-7832-4690-973e-ef63273d47b7-kube-api-access-xq77q" (OuterVolumeSpecName: "kube-api-access-xq77q") pod "72219b79-7832-4690-973e-ef63273d47b7" (UID: "72219b79-7832-4690-973e-ef63273d47b7"). InnerVolumeSpecName "kube-api-access-xq77q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:53 crc kubenswrapper[4769]: I1121 12:13:53.938910 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xq77q\" (UniqueName: \"kubernetes.io/projected/72219b79-7832-4690-973e-ef63273d47b7-kube-api-access-xq77q\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.121434 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.197047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d","Type":"ContainerDied","Data":"cf7735a1abb97ea754eef70697fada7365e10107a03bfabca11cc182cd3948f8"} Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.197126 4769 scope.go:117] "RemoveContainer" containerID="26524f7c7fc85ed7e844fab7e7a0ee87bb1fd7cc9578ba6c3a6aa957e24f37a9" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.197410 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.229219 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.229811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-82h5b" event={"ID":"72219b79-7832-4690-973e-ef63273d47b7","Type":"ContainerDied","Data":"7cffcd4577a66181a0121bec55e92e88eefa6eb890a91776b93bba4006d334ec"} Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.229847 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cffcd4577a66181a0121bec55e92e88eefa6eb890a91776b93bba4006d334ec" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.289369 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.346039 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.378354 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:54 crc kubenswrapper[4769]: E1121 12:13:54.379109 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="cinder-scheduler" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.379128 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="cinder-scheduler" Nov 21 12:13:54 crc kubenswrapper[4769]: E1121 12:13:54.379177 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72219b79-7832-4690-973e-ef63273d47b7" containerName="mariadb-database-create" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.379197 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="72219b79-7832-4690-973e-ef63273d47b7" containerName="mariadb-database-create" Nov 21 12:13:54 crc kubenswrapper[4769]: E1121 12:13:54.379219 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="probe" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.379224 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="probe" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.388040 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="probe" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.388146 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" containerName="cinder-scheduler" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.388316 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="72219b79-7832-4690-973e-ef63273d47b7" containerName="mariadb-database-create" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.396304 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.399506 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.412924 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.573534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-scripts\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.573796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c5b897fd-dde5-489a-a738-88aa63a4f806-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.573878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97lf\" (UniqueName: \"kubernetes.io/projected/c5b897fd-dde5-489a-a738-88aa63a4f806-kube-api-access-j97lf\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.574025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.574053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.574115 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c5b897fd-dde5-489a-a738-88aa63a4f806-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j97lf\" (UniqueName: \"kubernetes.io/projected/c5b897fd-dde5-489a-a738-88aa63a4f806-kube-api-access-j97lf\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c5b897fd-dde5-489a-a738-88aa63a4f806-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.676649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-scripts\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.684384 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.684662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-scripts\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.684876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.684969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.698274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97lf\" (UniqueName: \"kubernetes.io/projected/c5b897fd-dde5-489a-a738-88aa63a4f806-kube-api-access-j97lf\") pod \"cinder-scheduler-0\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.720818 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.796007 4769 scope.go:117] "RemoveContainer" containerID="0aa96edeca3b1aa346f8a1c20dd97fce10a07b285881ccf8bb665ccd698bdbd7" Nov 21 12:13:54 crc kubenswrapper[4769]: I1121 12:13:54.968535 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.088844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stw69\" (UniqueName: \"kubernetes.io/projected/3e1c225c-80d6-4815-a568-84586f607c18-kube-api-access-stw69\") pod \"3e1c225c-80d6-4815-a568-84586f607c18\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.089460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e1c225c-80d6-4815-a568-84586f607c18-operator-scripts\") pod \"3e1c225c-80d6-4815-a568-84586f607c18\" (UID: \"3e1c225c-80d6-4815-a568-84586f607c18\") " Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.091035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e1c225c-80d6-4815-a568-84586f607c18-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3e1c225c-80d6-4815-a568-84586f607c18" (UID: "3e1c225c-80d6-4815-a568-84586f607c18"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.126415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e1c225c-80d6-4815-a568-84586f607c18-kube-api-access-stw69" (OuterVolumeSpecName: "kube-api-access-stw69") pod "3e1c225c-80d6-4815-a568-84586f607c18" (UID: "3e1c225c-80d6-4815-a568-84586f607c18"). InnerVolumeSpecName "kube-api-access-stw69". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.192360 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-stw69\" (UniqueName: \"kubernetes.io/projected/3e1c225c-80d6-4815-a568-84586f607c18-kube-api-access-stw69\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.192406 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e1c225c-80d6-4815-a568-84586f607c18-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.269833 4769 generic.go:334] "Generic (PLEG): container finished" podID="00bef931-fe95-4aab-bd14-1f8778a37b34" containerID="825404bc8ce92279a7a5d401738064f06529617a29ca5bd0b3a4deb729da83e9" exitCode=0 Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.269982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" event={"ID":"00bef931-fe95-4aab-bd14-1f8778a37b34","Type":"ContainerDied","Data":"825404bc8ce92279a7a5d401738064f06529617a29ca5bd0b3a4deb729da83e9"} Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.304265 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bc07ccc-96e2-45fd-a7df-2f659e62a28c" containerID="3280ce84ae2e0c5d3285a21265201bb2afe0ddd3d315a640fcf8a796827408e9" exitCode=0 Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.311678 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d" path="/var/lib/kubelet/pods/dc12d173-4be3-4ec9-bfd6-a8ab15b01e6d/volumes" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.312833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" event={"ID":"5bc07ccc-96e2-45fd-a7df-2f659e62a28c","Type":"ContainerDied","Data":"3280ce84ae2e0c5d3285a21265201bb2afe0ddd3d315a640fcf8a796827408e9"} Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.326559 4769 generic.go:334] "Generic (PLEG): container finished" podID="1865ea5b-bdb8-4d52-a805-30f4a0a870a1" containerID="9ea8205172aeb3a656e89536efe402a8749679f702d232cc9123f84aa05720ff" exitCode=0 Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.326700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" event={"ID":"1865ea5b-bdb8-4d52-a805-30f4a0a870a1","Type":"ContainerDied","Data":"9ea8205172aeb3a656e89536efe402a8749679f702d232cc9123f84aa05720ff"} Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.332575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" event={"ID":"3e1c225c-80d6-4815-a568-84586f607c18","Type":"ContainerDied","Data":"c858da334c5fbffb2b6245087ae81fe698e641a3b73013743c52d8ecd911bb5c"} Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.332626 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c858da334c5fbffb2b6245087ae81fe698e641a3b73013743c52d8ecd911bb5c" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.332683 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.354519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerStarted","Data":"cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813"} Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.354801 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.369151 4769 generic.go:334] "Generic (PLEG): container finished" podID="13eb83d2-1076-4627-8f43-1c6972e0f779" containerID="df69af6335fbc2ae6e047325ced14ef0bd4a272ac2738237c8359371a2f471fe" exitCode=0 Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.369243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" event={"ID":"13eb83d2-1076-4627-8f43-1c6972e0f779","Type":"ContainerDied","Data":"df69af6335fbc2ae6e047325ced14ef0bd4a272ac2738237c8359371a2f471fe"} Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.414887 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.32444366 podStartE2EDuration="11.414867802s" podCreationTimestamp="2025-11-21 12:13:44 +0000 UTC" firstStartedPulling="2025-11-21 12:13:44.771666611 +0000 UTC m=+1383.472328429" lastFinishedPulling="2025-11-21 12:13:54.862090753 +0000 UTC m=+1393.562752571" observedRunningTime="2025-11-21 12:13:55.411401128 +0000 UTC m=+1394.112062946" watchObservedRunningTime="2025-11-21 12:13:55.414867802 +0000 UTC m=+1394.115529620" Nov 21 12:13:55 crc kubenswrapper[4769]: I1121 12:13:55.494126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:13:55 crc kubenswrapper[4769]: W1121 12:13:55.498579 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5b897fd_dde5_489a_a738_88aa63a4f806.slice/crio-340972b90372bca15c04b434cbd36a53f4c451187b9be9aa9e6137974eded67c WatchSource:0}: Error finding container 340972b90372bca15c04b434cbd36a53f4c451187b9be9aa9e6137974eded67c: Status 404 returned error can't find the container with id 340972b90372bca15c04b434cbd36a53f4c451187b9be9aa9e6137974eded67c Nov 21 12:13:56 crc kubenswrapper[4769]: I1121 12:13:56.386420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c5b897fd-dde5-489a-a738-88aa63a4f806","Type":"ContainerStarted","Data":"01a9779ef2ef2b9e782ee5a92d2cd4be9bf6b0bab2fd76223a9ab8b419219d67"} Nov 21 12:13:56 crc kubenswrapper[4769]: I1121 12:13:56.387003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c5b897fd-dde5-489a-a738-88aa63a4f806","Type":"ContainerStarted","Data":"340972b90372bca15c04b434cbd36a53f4c451187b9be9aa9e6137974eded67c"} Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.098277 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.242047 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.243055 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.250451 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.251561 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wtxr\" (UniqueName: \"kubernetes.io/projected/13eb83d2-1076-4627-8f43-1c6972e0f779-kube-api-access-5wtxr\") pod \"13eb83d2-1076-4627-8f43-1c6972e0f779\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.251894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13eb83d2-1076-4627-8f43-1c6972e0f779-operator-scripts\") pod \"13eb83d2-1076-4627-8f43-1c6972e0f779\" (UID: \"13eb83d2-1076-4627-8f43-1c6972e0f779\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.253173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13eb83d2-1076-4627-8f43-1c6972e0f779-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "13eb83d2-1076-4627-8f43-1c6972e0f779" (UID: "13eb83d2-1076-4627-8f43-1c6972e0f779"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.277511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13eb83d2-1076-4627-8f43-1c6972e0f779-kube-api-access-5wtxr" (OuterVolumeSpecName: "kube-api-access-5wtxr") pod "13eb83d2-1076-4627-8f43-1c6972e0f779" (UID: "13eb83d2-1076-4627-8f43-1c6972e0f779"). InnerVolumeSpecName "kube-api-access-5wtxr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.358776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/00bef931-fe95-4aab-bd14-1f8778a37b34-operator-scripts\") pod \"00bef931-fe95-4aab-bd14-1f8778a37b34\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.358849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-operator-scripts\") pod \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.358953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrm78\" (UniqueName: \"kubernetes.io/projected/00bef931-fe95-4aab-bd14-1f8778a37b34-kube-api-access-wrm78\") pod \"00bef931-fe95-4aab-bd14-1f8778a37b34\" (UID: \"00bef931-fe95-4aab-bd14-1f8778a37b34\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.359007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4g8c\" (UniqueName: \"kubernetes.io/projected/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-kube-api-access-m4g8c\") pod \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\" (UID: \"1865ea5b-bdb8-4d52-a805-30f4a0a870a1\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.359032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5ckd\" (UniqueName: \"kubernetes.io/projected/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-kube-api-access-l5ckd\") pod \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.359112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-operator-scripts\") pod \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\" (UID: \"5bc07ccc-96e2-45fd-a7df-2f659e62a28c\") " Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.359871 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/13eb83d2-1076-4627-8f43-1c6972e0f779-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.359897 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5wtxr\" (UniqueName: \"kubernetes.io/projected/13eb83d2-1076-4627-8f43-1c6972e0f779-kube-api-access-5wtxr\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.361827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1865ea5b-bdb8-4d52-a805-30f4a0a870a1" (UID: "1865ea5b-bdb8-4d52-a805-30f4a0a870a1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.362991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bef931-fe95-4aab-bd14-1f8778a37b34-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "00bef931-fe95-4aab-bd14-1f8778a37b34" (UID: "00bef931-fe95-4aab-bd14-1f8778a37b34"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.364912 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5bc07ccc-96e2-45fd-a7df-2f659e62a28c" (UID: "5bc07ccc-96e2-45fd-a7df-2f659e62a28c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.370629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-kube-api-access-m4g8c" (OuterVolumeSpecName: "kube-api-access-m4g8c") pod "1865ea5b-bdb8-4d52-a805-30f4a0a870a1" (UID: "1865ea5b-bdb8-4d52-a805-30f4a0a870a1"). InnerVolumeSpecName "kube-api-access-m4g8c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.381663 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-kube-api-access-l5ckd" (OuterVolumeSpecName: "kube-api-access-l5ckd") pod "5bc07ccc-96e2-45fd-a7df-2f659e62a28c" (UID: "5bc07ccc-96e2-45fd-a7df-2f659e62a28c"). InnerVolumeSpecName "kube-api-access-l5ckd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.391107 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bef931-fe95-4aab-bd14-1f8778a37b34-kube-api-access-wrm78" (OuterVolumeSpecName: "kube-api-access-wrm78") pod "00bef931-fe95-4aab-bd14-1f8778a37b34" (UID: "00bef931-fe95-4aab-bd14-1f8778a37b34"). InnerVolumeSpecName "kube-api-access-wrm78". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.416064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" event={"ID":"5bc07ccc-96e2-45fd-a7df-2f659e62a28c","Type":"ContainerDied","Data":"95ee65270f74d1ae1e56e3df2746ace2434181fa43cc618a59eb96f5c9b660f2"} Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.416109 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95ee65270f74d1ae1e56e3df2746ace2434181fa43cc618a59eb96f5c9b660f2" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.416173 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.428156 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.428450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-2qcvq" event={"ID":"1865ea5b-bdb8-4d52-a805-30f4a0a870a1","Type":"ContainerDied","Data":"9ed287e71540f4dedb9c77af4340c6f12992a8857462e5fde6eb69132c777c8d"} Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.428491 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ed287e71540f4dedb9c77af4340c6f12992a8857462e5fde6eb69132c777c8d" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.432669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" event={"ID":"13eb83d2-1076-4627-8f43-1c6972e0f779","Type":"ContainerDied","Data":"b7da1286a0b1a8ad11eaff91b4c41c751369e8b838270b461ceb8a7911c1d8a7"} Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.432708 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7da1286a0b1a8ad11eaff91b4c41c751369e8b838270b461ceb8a7911c1d8a7" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.432797 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.437650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" event={"ID":"00bef931-fe95-4aab-bd14-1f8778a37b34","Type":"ContainerDied","Data":"2cfa2d9260dd0ea74f196f913ec875ccbb2c53e0c81333a7b6010956b732cca1"} Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.437694 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cfa2d9260dd0ea74f196f913ec875ccbb2c53e0c81333a7b6010956b732cca1" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.437952 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-bknpf" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.470156 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.470271 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/00bef931-fe95-4aab-bd14-1f8778a37b34-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.470290 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.470303 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wrm78\" (UniqueName: \"kubernetes.io/projected/00bef931-fe95-4aab-bd14-1f8778a37b34-kube-api-access-wrm78\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.470315 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m4g8c\" (UniqueName: \"kubernetes.io/projected/1865ea5b-bdb8-4d52-a805-30f4a0a870a1-kube-api-access-m4g8c\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:57 crc kubenswrapper[4769]: I1121 12:13:57.470329 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l5ckd\" (UniqueName: \"kubernetes.io/projected/5bc07ccc-96e2-45fd-a7df-2f659e62a28c-kube-api-access-l5ckd\") on node \"crc\" DevicePath \"\"" Nov 21 12:13:58 crc kubenswrapper[4769]: I1121 12:13:58.448636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c5b897fd-dde5-489a-a738-88aa63a4f806","Type":"ContainerStarted","Data":"d9c15d507687b3db340748a9183bb730d5f0a9ea2d81a9506226846bfa031318"} Nov 21 12:13:59 crc kubenswrapper[4769]: I1121 12:13:59.721571 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.734377 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=6.73435387 podStartE2EDuration="6.73435387s" podCreationTimestamp="2025-11-21 12:13:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:13:58.495393955 +0000 UTC m=+1397.196055773" watchObservedRunningTime="2025-11-21 12:14:00.73435387 +0000 UTC m=+1399.435015688" Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.738138 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.738474 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-central-agent" containerID="cri-o://00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2" gracePeriod=30 Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.738562 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="sg-core" containerID="cri-o://56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584" gracePeriod=30 Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.738584 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="proxy-httpd" containerID="cri-o://cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813" gracePeriod=30 Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.738624 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-notification-agent" containerID="cri-o://3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf" gracePeriod=30 Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.916276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.917103 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-log" containerID="cri-o://8010a32238c4c714a25a07ea26d96f39a7c3bb44253b28de64b4918ae5279a1e" gracePeriod=30 Nov 21 12:14:00 crc kubenswrapper[4769]: I1121 12:14:00.917720 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-httpd" containerID="cri-o://ca31439b9c6021c7f29318fb618a81c655f3e2af772d73a473e19cea5a02fd47" gracePeriod=30 Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.505239 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerID="8010a32238c4c714a25a07ea26d96f39a7c3bb44253b28de64b4918ae5279a1e" exitCode=143 Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.505329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e9fa1f98-7950-4476-b2b2-a0474c19aae1","Type":"ContainerDied","Data":"8010a32238c4c714a25a07ea26d96f39a7c3bb44253b28de64b4918ae5279a1e"} Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.520922 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0af6dea-9629-4de1-9654-00bd64643b93" containerID="cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813" exitCode=0 Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.521169 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0af6dea-9629-4de1-9654-00bd64643b93" containerID="56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584" exitCode=2 Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.521256 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0af6dea-9629-4de1-9654-00bd64643b93" containerID="00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2" exitCode=0 Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.521007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerDied","Data":"cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813"} Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.521387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerDied","Data":"56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584"} Nov 21 12:14:01 crc kubenswrapper[4769]: I1121 12:14:01.521446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerDied","Data":"00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2"} Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.188990 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs"] Nov 21 12:14:02 crc kubenswrapper[4769]: E1121 12:14:02.189474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="00bef931-fe95-4aab-bd14-1f8778a37b34" containerName="mariadb-database-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="00bef931-fe95-4aab-bd14-1f8778a37b34" containerName="mariadb-database-create" Nov 21 12:14:02 crc kubenswrapper[4769]: E1121 12:14:02.189511 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13eb83d2-1076-4627-8f43-1c6972e0f779" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="13eb83d2-1076-4627-8f43-1c6972e0f779" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: E1121 12:14:02.189542 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e1c225c-80d6-4815-a568-84586f607c18" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189550 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e1c225c-80d6-4815-a568-84586f607c18" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: E1121 12:14:02.189563 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bc07ccc-96e2-45fd-a7df-2f659e62a28c" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189571 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc07ccc-96e2-45fd-a7df-2f659e62a28c" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: E1121 12:14:02.189589 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1865ea5b-bdb8-4d52-a805-30f4a0a870a1" containerName="mariadb-database-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189596 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1865ea5b-bdb8-4d52-a805-30f4a0a870a1" containerName="mariadb-database-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189807 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1865ea5b-bdb8-4d52-a805-30f4a0a870a1" containerName="mariadb-database-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189831 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="00bef931-fe95-4aab-bd14-1f8778a37b34" containerName="mariadb-database-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189848 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="13eb83d2-1076-4627-8f43-1c6972e0f779" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189860 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bc07ccc-96e2-45fd-a7df-2f659e62a28c" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.189878 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e1c225c-80d6-4815-a568-84586f607c18" containerName="mariadb-account-create" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.190527 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.193239 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.193241 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-sqbt2" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.201893 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs"] Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.204442 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.265830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.265904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-scripts\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.265973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-config-data\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.266256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75kwd\" (UniqueName: \"kubernetes.io/projected/7f54dca9-53ea-40ef-bfba-6603c5294daf-kube-api-access-75kwd\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.368355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75kwd\" (UniqueName: \"kubernetes.io/projected/7f54dca9-53ea-40ef-bfba-6603c5294daf-kube-api-access-75kwd\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.368753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.368977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-scripts\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.369282 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-config-data\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.377523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-scripts\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.379066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.380434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-config-data\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.403959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75kwd\" (UniqueName: \"kubernetes.io/projected/7f54dca9-53ea-40ef-bfba-6603c5294daf-kube-api-access-75kwd\") pod \"nova-cell0-conductor-db-sync-gqqcs\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.499362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.499796 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-log" containerID="cri-o://91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48" gracePeriod=30 Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.500546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-httpd" containerID="cri-o://c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126" gracePeriod=30 Nov 21 12:14:02 crc kubenswrapper[4769]: I1121 12:14:02.516333 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.040082 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs"] Nov 21 12:14:03 crc kubenswrapper[4769]: W1121 12:14:03.044570 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f54dca9_53ea_40ef_bfba_6603c5294daf.slice/crio-ebf307b0f8c2669c712175556a08723dfb193931946d003eea43991f82377314 WatchSource:0}: Error finding container ebf307b0f8c2669c712175556a08723dfb193931946d003eea43991f82377314: Status 404 returned error can't find the container with id ebf307b0f8c2669c712175556a08723dfb193931946d003eea43991f82377314 Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.440755 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-7gwlw"] Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.444723 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.453081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-7gwlw"] Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.544013 4769 generic.go:334] "Generic (PLEG): container finished" podID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerID="91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48" exitCode=143 Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.544159 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bdf7e54e-3075-4900-96c5-45ea9213e5b7","Type":"ContainerDied","Data":"91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48"} Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.546094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" event={"ID":"7f54dca9-53ea-40ef-bfba-6603c5294daf","Type":"ContainerStarted","Data":"ebf307b0f8c2669c712175556a08723dfb193931946d003eea43991f82377314"} Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.600347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-utilities\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.600572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwr6c\" (UniqueName: \"kubernetes.io/projected/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-kube-api-access-dwr6c\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.600658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-catalog-content\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.702645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-catalog-content\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.702751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-utilities\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.702850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dwr6c\" (UniqueName: \"kubernetes.io/projected/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-kube-api-access-dwr6c\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.703248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-utilities\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.703511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-catalog-content\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.732671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwr6c\" (UniqueName: \"kubernetes.io/projected/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-kube-api-access-dwr6c\") pod \"redhat-operators-7gwlw\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:03 crc kubenswrapper[4769]: I1121 12:14:03.778907 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:04 crc kubenswrapper[4769]: I1121 12:14:04.398435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-7gwlw"] Nov 21 12:14:04 crc kubenswrapper[4769]: W1121 12:14:04.420872 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ebbf01_fb5c_4d92_b0c0_acedcb4cc2c3.slice/crio-7ae21b0cfe24b80b4ce31e0c902d8e718d659390db99787f146f1577917caec4 WatchSource:0}: Error finding container 7ae21b0cfe24b80b4ce31e0c902d8e718d659390db99787f146f1577917caec4: Status 404 returned error can't find the container with id 7ae21b0cfe24b80b4ce31e0c902d8e718d659390db99787f146f1577917caec4 Nov 21 12:14:04 crc kubenswrapper[4769]: I1121 12:14:04.581018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7gwlw" event={"ID":"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3","Type":"ContainerStarted","Data":"7ae21b0cfe24b80b4ce31e0c902d8e718d659390db99787f146f1577917caec4"} Nov 21 12:14:04 crc kubenswrapper[4769]: I1121 12:14:04.591181 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerID="ca31439b9c6021c7f29318fb618a81c655f3e2af772d73a473e19cea5a02fd47" exitCode=0 Nov 21 12:14:04 crc kubenswrapper[4769]: I1121 12:14:04.591250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e9fa1f98-7950-4476-b2b2-a0474c19aae1","Type":"ContainerDied","Data":"ca31439b9c6021c7f29318fb618a81c655f3e2af772d73a473e19cea5a02fd47"} Nov 21 12:14:04 crc kubenswrapper[4769]: I1121 12:14:04.976626 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.056183 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.070659 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-httpd-run\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.071071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-public-tls-certs\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.071292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.071584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-combined-ca-bundle\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.071731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-config-data\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.071862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-scripts\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.072024 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-logs\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.072110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dczlx\" (UniqueName: \"kubernetes.io/projected/e9fa1f98-7950-4476-b2b2-a0474c19aae1-kube-api-access-dczlx\") pod \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\" (UID: \"e9fa1f98-7950-4476-b2b2-a0474c19aae1\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.072682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.073072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-logs" (OuterVolumeSpecName: "logs") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.082912 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-scripts" (OuterVolumeSpecName: "scripts") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.090571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.103131 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9fa1f98-7950-4476-b2b2-a0474c19aae1-kube-api-access-dczlx" (OuterVolumeSpecName: "kube-api-access-dczlx") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "kube-api-access-dczlx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.153546 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.173509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174276 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174318 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174333 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174344 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174357 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174368 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dczlx\" (UniqueName: \"kubernetes.io/projected/e9fa1f98-7950-4476-b2b2-a0474c19aae1-kube-api-access-dczlx\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.174382 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e9fa1f98-7950-4476-b2b2-a0474c19aae1-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.194803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-config-data" (OuterVolumeSpecName: "config-data") pod "e9fa1f98-7950-4476-b2b2-a0474c19aae1" (UID: "e9fa1f98-7950-4476-b2b2-a0474c19aae1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.232867 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.278517 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9fa1f98-7950-4476-b2b2-a0474c19aae1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.279724 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.332238 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484269 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-scripts\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6whgv\" (UniqueName: \"kubernetes.io/projected/e0af6dea-9629-4de1-9654-00bd64643b93-kube-api-access-6whgv\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-combined-ca-bundle\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-config-data\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-log-httpd\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484787 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-sg-core-conf-yaml\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.484905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-run-httpd\") pod \"e0af6dea-9629-4de1-9654-00bd64643b93\" (UID: \"e0af6dea-9629-4de1-9654-00bd64643b93\") " Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.485536 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.486130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.490396 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.490454 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0af6dea-9629-4de1-9654-00bd64643b93-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.502597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0af6dea-9629-4de1-9654-00bd64643b93-kube-api-access-6whgv" (OuterVolumeSpecName: "kube-api-access-6whgv") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "kube-api-access-6whgv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.507560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-scripts" (OuterVolumeSpecName: "scripts") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.533679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.593044 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.593109 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.593125 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6whgv\" (UniqueName: \"kubernetes.io/projected/e0af6dea-9629-4de1-9654-00bd64643b93-kube-api-access-6whgv\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.653639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.656111 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerID="3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f" exitCode=0 Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.656268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7gwlw" event={"ID":"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3","Type":"ContainerDied","Data":"3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f"} Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.660453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-config-data" (OuterVolumeSpecName: "config-data") pod "e0af6dea-9629-4de1-9654-00bd64643b93" (UID: "e0af6dea-9629-4de1-9654-00bd64643b93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.672758 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0af6dea-9629-4de1-9654-00bd64643b93" containerID="3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf" exitCode=0 Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.672867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerDied","Data":"3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf"} Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.672934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0af6dea-9629-4de1-9654-00bd64643b93","Type":"ContainerDied","Data":"a4bee4ef99274ff3ebafd425886e88e94cd35d9a71066c4e3c4a293550fdd73d"} Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.672957 4769 scope.go:117] "RemoveContainer" containerID="cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.673266 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.689558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e9fa1f98-7950-4476-b2b2-a0474c19aae1","Type":"ContainerDied","Data":"7a6306654453fbd1bbf0a28b75bc07fdbc0d3d84796887e31fab35117080a837"} Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.689878 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.694741 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.694779 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0af6dea-9629-4de1-9654-00bd64643b93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.704696 4769 scope.go:117] "RemoveContainer" containerID="56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.733424 4769 scope.go:117] "RemoveContainer" containerID="3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.756775 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.773081 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.791495 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.818412 4769 scope.go:117] "RemoveContainer" containerID="00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.824882 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.836664 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.837254 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-log" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837293 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-log" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.837310 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-central-agent" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837317 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-central-agent" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.837331 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-notification-agent" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837339 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-notification-agent" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.837354 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="sg-core" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837363 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="sg-core" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.837383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="proxy-httpd" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837390 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="proxy-httpd" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.837407 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-httpd" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837414 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-httpd" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837607 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-central-agent" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837628 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="ceilometer-notification-agent" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837638 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-log" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837656 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="sg-core" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837669 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" containerName="proxy-httpd" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.837678 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" containerName="glance-httpd" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.839471 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.847744 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.851854 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.853339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.860046 4769 scope.go:117] "RemoveContainer" containerID="cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.861950 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813\": container with ID starting with cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813 not found: ID does not exist" containerID="cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.862081 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813"} err="failed to get container status \"cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813\": rpc error: code = NotFound desc = could not find container \"cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813\": container with ID starting with cdc419e56debe135084dc8f993ccf17199d5a98ceecaa69845a47d68677d5813 not found: ID does not exist" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.862220 4769 scope.go:117] "RemoveContainer" containerID="56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.862906 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584\": container with ID starting with 56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584 not found: ID does not exist" containerID="56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.862965 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584"} err="failed to get container status \"56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584\": rpc error: code = NotFound desc = could not find container \"56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584\": container with ID starting with 56340cf7e846013d4c5f6461a57a757600e95cf51fc156d2ac0df1d8f35cc584 not found: ID does not exist" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.862999 4769 scope.go:117] "RemoveContainer" containerID="3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.863661 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf\": container with ID starting with 3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf not found: ID does not exist" containerID="3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.863736 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf"} err="failed to get container status \"3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf\": rpc error: code = NotFound desc = could not find container \"3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf\": container with ID starting with 3b670c89e7234da1cc97d21d482687902a701261ca51465ac1925071f6ed9ddf not found: ID does not exist" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.863783 4769 scope.go:117] "RemoveContainer" containerID="00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2" Nov 21 12:14:05 crc kubenswrapper[4769]: E1121 12:14:05.872349 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2\": container with ID starting with 00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2 not found: ID does not exist" containerID="00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.872424 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2"} err="failed to get container status \"00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2\": rpc error: code = NotFound desc = could not find container \"00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2\": container with ID starting with 00bcd92d5523c566253a584a69a83025ff18d186d3de58039bcf91000c675bb2 not found: ID does not exist" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.872466 4769 scope.go:117] "RemoveContainer" containerID="ca31439b9c6021c7f29318fb618a81c655f3e2af772d73a473e19cea5a02fd47" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.902581 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.904313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.911639 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.911901 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:14:05 crc kubenswrapper[4769]: I1121 12:14:05.926991 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.000244 4769 scope.go:117] "RemoveContainer" containerID="8010a32238c4c714a25a07ea26d96f39a7c3bb44253b28de64b4918ae5279a1e" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.003730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-config-data\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.003805 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.003902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-config-data\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.003997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-run-httpd\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.004047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.004076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-scripts\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.004123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.004502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-logs\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.004689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.004801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-scripts\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.005065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.005136 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pwq7\" (UniqueName: \"kubernetes.io/projected/4102714b-0752-4ddf-84aa-64d9384e64b9-kube-api-access-7pwq7\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.005346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zwss\" (UniqueName: \"kubernetes.io/projected/db2d38dd-f72e-42d3-b681-674040ed92ba-kube-api-access-5zwss\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.005515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.007072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-log-httpd\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.062037 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: E1121 12:14:06.064360 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-7pwq7 log-httpd run-httpd scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="4102714b-0752-4ddf-84aa-64d9384e64b9" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.110867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-config-data\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.110945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-run-httpd\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.110972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.110994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-scripts\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-logs\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-scripts\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7pwq7\" (UniqueName: \"kubernetes.io/projected/4102714b-0752-4ddf-84aa-64d9384e64b9-kube-api-access-7pwq7\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5zwss\" (UniqueName: \"kubernetes.io/projected/db2d38dd-f72e-42d3-b681-674040ed92ba-kube-api-access-5zwss\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111272 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-log-httpd\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-config-data\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.111328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.112421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-run-httpd\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.112754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.113009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-logs\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.113748 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-log-httpd\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.113779 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.118764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.121467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.121941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-scripts\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.123649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-config-data\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.132749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-config-data\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.137459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-scripts\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.139475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.144602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.148983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zwss\" (UniqueName: \"kubernetes.io/projected/db2d38dd-f72e-42d3-b681-674040ed92ba-kube-api-access-5zwss\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.150334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pwq7\" (UniqueName: \"kubernetes.io/projected/4102714b-0752-4ddf-84aa-64d9384e64b9-kube-api-access-7pwq7\") pod \"ceilometer-0\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.154707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.284557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.292328 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.429555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-scripts\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-config-data\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-logs\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-combined-ca-bundle\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-internal-tls-certs\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsm8h\" (UniqueName: \"kubernetes.io/projected/bdf7e54e-3075-4900-96c5-45ea9213e5b7-kube-api-access-tsm8h\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-httpd-run\") pod \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\" (UID: \"bdf7e54e-3075-4900-96c5-45ea9213e5b7\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.430772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-logs" (OuterVolumeSpecName: "logs") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.431673 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.433079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.441452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf7e54e-3075-4900-96c5-45ea9213e5b7-kube-api-access-tsm8h" (OuterVolumeSpecName: "kube-api-access-tsm8h") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "kube-api-access-tsm8h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.441570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.443723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-scripts" (OuterVolumeSpecName: "scripts") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.532391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.534084 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.534113 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.534125 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tsm8h\" (UniqueName: \"kubernetes.io/projected/bdf7e54e-3075-4900-96c5-45ea9213e5b7-kube-api-access-tsm8h\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.534137 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bdf7e54e-3075-4900-96c5-45ea9213e5b7-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.534146 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.582747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-config-data" (OuterVolumeSpecName: "config-data") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.636315 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.697694 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.723369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bdf7e54e-3075-4900-96c5-45ea9213e5b7" (UID: "bdf7e54e-3075-4900-96c5-45ea9213e5b7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.737630 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.737858 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf7e54e-3075-4900-96c5-45ea9213e5b7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.742868 4769 generic.go:334] "Generic (PLEG): container finished" podID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerID="c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126" exitCode=0 Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.743076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bdf7e54e-3075-4900-96c5-45ea9213e5b7","Type":"ContainerDied","Data":"c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126"} Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.743151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"bdf7e54e-3075-4900-96c5-45ea9213e5b7","Type":"ContainerDied","Data":"e4ddccc5694de142e355d423a5e86474196a9dc025288f5823ddb35623cb03cd"} Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.743174 4769 scope.go:117] "RemoveContainer" containerID="c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.743370 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.756736 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.793510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.832511 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.839500 4769 scope.go:117] "RemoveContainer" containerID="91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.839683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-log-httpd\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.839997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.840301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-sg-core-conf-yaml\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.840389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pwq7\" (UniqueName: \"kubernetes.io/projected/4102714b-0752-4ddf-84aa-64d9384e64b9-kube-api-access-7pwq7\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.840407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-combined-ca-bundle\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.840576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-config-data\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.840680 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-run-httpd\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.840702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-scripts\") pod \"4102714b-0752-4ddf-84aa-64d9384e64b9\" (UID: \"4102714b-0752-4ddf-84aa-64d9384e64b9\") " Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.842438 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.842762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.848106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.848135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.848319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4102714b-0752-4ddf-84aa-64d9384e64b9-kube-api-access-7pwq7" (OuterVolumeSpecName: "kube-api-access-7pwq7") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "kube-api-access-7pwq7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.850571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-scripts" (OuterVolumeSpecName: "scripts") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.850979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-config-data" (OuterVolumeSpecName: "config-data") pod "4102714b-0752-4ddf-84aa-64d9384e64b9" (UID: "4102714b-0752-4ddf-84aa-64d9384e64b9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.866688 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.899097 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: E1121 12:14:06.899608 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-log" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.899620 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-log" Nov 21 12:14:06 crc kubenswrapper[4769]: E1121 12:14:06.899661 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-httpd" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.899666 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-httpd" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.899851 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-log" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.899864 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" containerName="glance-httpd" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.900973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.905314 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.905516 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.905715 4769 scope.go:117] "RemoveContainer" containerID="c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126" Nov 21 12:14:06 crc kubenswrapper[4769]: E1121 12:14:06.910785 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126\": container with ID starting with c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126 not found: ID does not exist" containerID="c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.911248 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126"} err="failed to get container status \"c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126\": rpc error: code = NotFound desc = could not find container \"c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126\": container with ID starting with c1f124dd9bcb57c7689d4c14a95b87305297819109f5e2d3468b04b13453f126 not found: ID does not exist" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.911370 4769 scope.go:117] "RemoveContainer" containerID="91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48" Nov 21 12:14:06 crc kubenswrapper[4769]: E1121 12:14:06.911808 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48\": container with ID starting with 91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48 not found: ID does not exist" containerID="91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.911846 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48"} err="failed to get container status \"91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48\": rpc error: code = NotFound desc = could not find container \"91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48\": container with ID starting with 91df1327611751a2e8ed02515a0c4ac5ab198236da3449ac6c5ea3e5a5cd4d48 not found: ID does not exist" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.913843 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: E1121 12:14:06.934534 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdf7e54e_3075_4900_96c5_45ea9213e5b7.slice\": RecentStats: unable to find data in memory cache]" Nov 21 12:14:06 crc kubenswrapper[4769]: W1121 12:14:06.939942 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb2d38dd_f72e_42d3_b681_674040ed92ba.slice/crio-ccdcecbef6f0c2fe210b903c2c8d36a3518ac655a6e59ca4ed3d0ff916452bca WatchSource:0}: Error finding container ccdcecbef6f0c2fe210b903c2c8d36a3518ac655a6e59ca4ed3d0ff916452bca: Status 404 returned error can't find the container with id ccdcecbef6f0c2fe210b903c2c8d36a3518ac655a6e59ca4ed3d0ff916452bca Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.940044 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sxlg\" (UniqueName: \"kubernetes.io/projected/8537fa74-d045-48de-b59b-59d7cab6d5fb-kube-api-access-2sxlg\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-logs\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947616 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.947909 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.948226 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7pwq7\" (UniqueName: \"kubernetes.io/projected/4102714b-0752-4ddf-84aa-64d9384e64b9-kube-api-access-7pwq7\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.948249 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.948263 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.948369 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4102714b-0752-4ddf-84aa-64d9384e64b9-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:06 crc kubenswrapper[4769]: I1121 12:14:06.948406 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4102714b-0752-4ddf-84aa-64d9384e64b9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.049926 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2sxlg\" (UniqueName: \"kubernetes.io/projected/8537fa74-d045-48de-b59b-59d7cab6d5fb-kube-api-access-2sxlg\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.049992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.050041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.050070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.050101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.050123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.050141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-logs\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.050173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.055480 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.056026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-logs\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.056066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.056707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.060110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.063607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.066587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.083060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sxlg\" (UniqueName: \"kubernetes.io/projected/8537fa74-d045-48de-b59b-59d7cab6d5fb-kube-api-access-2sxlg\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.101013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.233893 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.320146 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdf7e54e-3075-4900-96c5-45ea9213e5b7" path="/var/lib/kubelet/pods/bdf7e54e-3075-4900-96c5-45ea9213e5b7/volumes" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.321330 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0af6dea-9629-4de1-9654-00bd64643b93" path="/var/lib/kubelet/pods/e0af6dea-9629-4de1-9654-00bd64643b93/volumes" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.322798 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9fa1f98-7950-4476-b2b2-a0474c19aae1" path="/var/lib/kubelet/pods/e9fa1f98-7950-4476-b2b2-a0474c19aae1/volumes" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.772603 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerID="876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab" exitCode=0 Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.772660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7gwlw" event={"ID":"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3","Type":"ContainerDied","Data":"876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab"} Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.779463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db2d38dd-f72e-42d3-b681-674040ed92ba","Type":"ContainerStarted","Data":"ccdcecbef6f0c2fe210b903c2c8d36a3518ac655a6e59ca4ed3d0ff916452bca"} Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.781250 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.859498 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.893539 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.910989 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:07 crc kubenswrapper[4769]: W1121 12:14:07.914113 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8537fa74_d045_48de_b59b_59d7cab6d5fb.slice/crio-57fee683ae8d697600a73d3837c230c8456cc313f6be6863543327a7a587230d WatchSource:0}: Error finding container 57fee683ae8d697600a73d3837c230c8456cc313f6be6863543327a7a587230d: Status 404 returned error can't find the container with id 57fee683ae8d697600a73d3837c230c8456cc313f6be6863543327a7a587230d Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.928779 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.958992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.960957 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.964458 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.969146 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-run-httpd\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-log-httpd\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-config-data\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-scripts\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:07 crc kubenswrapper[4769]: I1121 12:14:07.993767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phd94\" (UniqueName: \"kubernetes.io/projected/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-kube-api-access-phd94\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-config-data\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-scripts\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095732 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-phd94\" (UniqueName: \"kubernetes.io/projected/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-kube-api-access-phd94\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-run-httpd\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.095875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-log-httpd\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.096489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-log-httpd\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.096613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-run-httpd\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.102894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-config-data\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.109779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.110724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-scripts\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.110842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.118774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-phd94\" (UniqueName: \"kubernetes.io/projected/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-kube-api-access-phd94\") pod \"ceilometer-0\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.383539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.796322 4769 generic.go:334] "Generic (PLEG): container finished" podID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" containerID="e2af434dc306232267147efe73828515c9bba9485dca4c0bd7eec9d66aac63c1" exitCode=0 Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.796786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" event={"ID":"7a39442e-588a-4512-a91d-d5a1daa8ea1b","Type":"ContainerDied","Data":"e2af434dc306232267147efe73828515c9bba9485dca4c0bd7eec9d66aac63c1"} Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.805667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8537fa74-d045-48de-b59b-59d7cab6d5fb","Type":"ContainerStarted","Data":"f38c68a26a6082c216ef8f5ce34bc0d7488bef446b4b98446e94c3122164b79e"} Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.805895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8537fa74-d045-48de-b59b-59d7cab6d5fb","Type":"ContainerStarted","Data":"57fee683ae8d697600a73d3837c230c8456cc313f6be6863543327a7a587230d"} Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.863367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7gwlw" event={"ID":"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3","Type":"ContainerStarted","Data":"00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900"} Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.872619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db2d38dd-f72e-42d3-b681-674040ed92ba","Type":"ContainerStarted","Data":"b986a002729503566a1f574b72c6b7e1fa44dbbb3a87e0d0ec923adad2d82a83"} Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.887077 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-7gwlw" podStartSLOduration=3.340719732 podStartE2EDuration="5.887055941s" podCreationTimestamp="2025-11-21 12:14:03 +0000 UTC" firstStartedPulling="2025-11-21 12:14:05.665481007 +0000 UTC m=+1404.366142825" lastFinishedPulling="2025-11-21 12:14:08.211817206 +0000 UTC m=+1406.912479034" observedRunningTime="2025-11-21 12:14:08.882811105 +0000 UTC m=+1407.583472943" watchObservedRunningTime="2025-11-21 12:14:08.887055941 +0000 UTC m=+1407.587717759" Nov 21 12:14:08 crc kubenswrapper[4769]: I1121 12:14:08.918276 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.918254391 podStartE2EDuration="3.918254391s" podCreationTimestamp="2025-11-21 12:14:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:14:08.909100912 +0000 UTC m=+1407.609762740" watchObservedRunningTime="2025-11-21 12:14:08.918254391 +0000 UTC m=+1407.618916209" Nov 21 12:14:09 crc kubenswrapper[4769]: I1121 12:14:09.047909 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:09 crc kubenswrapper[4769]: I1121 12:14:09.287129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4102714b-0752-4ddf-84aa-64d9384e64b9" path="/var/lib/kubelet/pods/4102714b-0752-4ddf-84aa-64d9384e64b9/volumes" Nov 21 12:14:09 crc kubenswrapper[4769]: I1121 12:14:09.884915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8537fa74-d045-48de-b59b-59d7cab6d5fb","Type":"ContainerStarted","Data":"fc34b5b9c89a734a1ca3b777eca08363f055fb209f9d86edd65ba622fa71c3fa"} Nov 21 12:14:09 crc kubenswrapper[4769]: I1121 12:14:09.888760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db2d38dd-f72e-42d3-b681-674040ed92ba","Type":"ContainerStarted","Data":"89a9a58d2361e0be72d982129d25a0f205081e5dcb8c3c89106166f9b5c55d15"} Nov 21 12:14:09 crc kubenswrapper[4769]: I1121 12:14:09.892136 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerStarted","Data":"543fb6e1d5449dbaff5d338c37cdb16a5e17c5cd930833c3398f632363bb247d"} Nov 21 12:14:09 crc kubenswrapper[4769]: I1121 12:14:09.913418 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.913396642 podStartE2EDuration="3.913396642s" podCreationTimestamp="2025-11-21 12:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:14:09.905647141 +0000 UTC m=+1408.606308959" watchObservedRunningTime="2025-11-21 12:14:09.913396642 +0000 UTC m=+1408.614058460" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.267869 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.381092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-config\") pod \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.381537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-combined-ca-bundle\") pod \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.381617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zfsv\" (UniqueName: \"kubernetes.io/projected/7a39442e-588a-4512-a91d-d5a1daa8ea1b-kube-api-access-4zfsv\") pod \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\" (UID: \"7a39442e-588a-4512-a91d-d5a1daa8ea1b\") " Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.390471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a39442e-588a-4512-a91d-d5a1daa8ea1b-kube-api-access-4zfsv" (OuterVolumeSpecName: "kube-api-access-4zfsv") pod "7a39442e-588a-4512-a91d-d5a1daa8ea1b" (UID: "7a39442e-588a-4512-a91d-d5a1daa8ea1b"). InnerVolumeSpecName "kube-api-access-4zfsv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.411172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a39442e-588a-4512-a91d-d5a1daa8ea1b" (UID: "7a39442e-588a-4512-a91d-d5a1daa8ea1b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.436346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-config" (OuterVolumeSpecName: "config") pod "7a39442e-588a-4512-a91d-d5a1daa8ea1b" (UID: "7a39442e-588a-4512-a91d-d5a1daa8ea1b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.484114 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.484182 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a39442e-588a-4512-a91d-d5a1daa8ea1b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.484214 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4zfsv\" (UniqueName: \"kubernetes.io/projected/7a39442e-588a-4512-a91d-d5a1daa8ea1b-kube-api-access-4zfsv\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.906018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerStarted","Data":"c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c"} Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.912435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.914624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-xplxh" event={"ID":"7a39442e-588a-4512-a91d-d5a1daa8ea1b","Type":"ContainerDied","Data":"ae9a9c9bd0648abb77ecc56e9aae7fe4d68bfcb89ff19bceb5249de90841994e"} Nov 21 12:14:10 crc kubenswrapper[4769]: I1121 12:14:10.914696 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae9a9c9bd0648abb77ecc56e9aae7fe4d68bfcb89ff19bceb5249de90841994e" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.211541 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd"] Nov 21 12:14:11 crc kubenswrapper[4769]: E1121 12:14:11.211900 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" containerName="neutron-db-sync" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.211916 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" containerName="neutron-db-sync" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.212104 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" containerName="neutron-db-sync" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.216759 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.220577 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.221532 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.221894 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-bl75q" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.224211 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd"] Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.238081 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.326126 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.326267 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.332131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-config\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.332209 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-combined-ca-bundle\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.332373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-httpd-config\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.332517 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-ovndb-tls-certs\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.332589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6g4p\" (UniqueName: \"kubernetes.io/projected/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-kube-api-access-x6g4p\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.435550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x6g4p\" (UniqueName: \"kubernetes.io/projected/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-kube-api-access-x6g4p\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.435741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-config\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.435776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-combined-ca-bundle\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.435862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-httpd-config\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.435988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-ovndb-tls-certs\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.443872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-httpd-config\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.444050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-ovndb-tls-certs\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.448014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-combined-ca-bundle\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.464638 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6g4p\" (UniqueName: \"kubernetes.io/projected/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-kube-api-access-x6g4p\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.465252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-config\") pod \"neutron-5b4cfbf57-4nxdd\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.547648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:11 crc kubenswrapper[4769]: I1121 12:14:11.923147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerStarted","Data":"f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab"} Nov 21 12:14:13 crc kubenswrapper[4769]: I1121 12:14:13.779607 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:13 crc kubenswrapper[4769]: I1121 12:14:13.779963 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.717038 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7d95c8c454-8fh7j"] Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.719422 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.726629 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.726897 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.735160 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7d95c8c454-8fh7j"] Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804406 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-combined-ca-bundle\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-httpd-config\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-public-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxfjl\" (UniqueName: \"kubernetes.io/projected/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-kube-api-access-pxfjl\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-ovndb-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-config\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.804655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-internal-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.833755 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-7gwlw" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="registry-server" probeResult="failure" output=< Nov 21 12:14:14 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:14:14 crc kubenswrapper[4769]: > Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-public-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pxfjl\" (UniqueName: \"kubernetes.io/projected/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-kube-api-access-pxfjl\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906183 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-ovndb-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-config\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-internal-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-combined-ca-bundle\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.906431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-httpd-config\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.913391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-internal-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.913486 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-public-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.915165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-ovndb-tls-certs\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.922308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-combined-ca-bundle\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.926443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-config\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.926894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxfjl\" (UniqueName: \"kubernetes.io/projected/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-kube-api-access-pxfjl\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:14 crc kubenswrapper[4769]: I1121 12:14:14.927216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-httpd-config\") pod \"neutron-7d95c8c454-8fh7j\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:15 crc kubenswrapper[4769]: I1121 12:14:15.052950 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:16 crc kubenswrapper[4769]: I1121 12:14:16.285445 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:16 crc kubenswrapper[4769]: I1121 12:14:16.285515 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:16 crc kubenswrapper[4769]: I1121 12:14:16.327717 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:16 crc kubenswrapper[4769]: I1121 12:14:16.340642 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:16 crc kubenswrapper[4769]: I1121 12:14:16.986494 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:16 crc kubenswrapper[4769]: I1121 12:14:16.986984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:17 crc kubenswrapper[4769]: I1121 12:14:17.234752 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:17 crc kubenswrapper[4769]: I1121 12:14:17.234860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:17 crc kubenswrapper[4769]: I1121 12:14:17.285579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:17 crc kubenswrapper[4769]: I1121 12:14:17.301400 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:18 crc kubenswrapper[4769]: I1121 12:14:17.998094 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:18 crc kubenswrapper[4769]: I1121 12:14:17.998538 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:19 crc kubenswrapper[4769]: I1121 12:14:19.099261 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:19 crc kubenswrapper[4769]: I1121 12:14:19.099366 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:14:19 crc kubenswrapper[4769]: I1121 12:14:19.132637 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:14:20 crc kubenswrapper[4769]: I1121 12:14:20.017578 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:14:20 crc kubenswrapper[4769]: I1121 12:14:20.017961 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:14:20 crc kubenswrapper[4769]: I1121 12:14:20.483770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:20 crc kubenswrapper[4769]: I1121 12:14:20.485045 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:14:23 crc kubenswrapper[4769]: I1121 12:14:23.834639 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:23 crc kubenswrapper[4769]: I1121 12:14:23.896798 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:24 crc kubenswrapper[4769]: I1121 12:14:24.084538 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-7gwlw"] Nov 21 12:14:25 crc kubenswrapper[4769]: I1121 12:14:25.083076 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-7gwlw" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="registry-server" containerID="cri-o://00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900" gracePeriod=2 Nov 21 12:14:25 crc kubenswrapper[4769]: E1121 12:14:25.646497 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-nova-conductor@sha256:fed8bb29eb85284462a99cb1013100f375ae83e1d68ef0954dbc3c2d7074f911" Nov 21 12:14:25 crc kubenswrapper[4769]: E1121 12:14:25.647016 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:nova-cell0-conductor-db-sync,Image:quay.io/podified-antelope-centos9/openstack-nova-conductor@sha256:fed8bb29eb85284462a99cb1013100f375ae83e1d68ef0954dbc3c2d7074f911,Command:[/bin/bash],Args:[-c /usr/local/bin/kolla_start],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CELL_NAME,Value:cell0,ValueFrom:nil,},EnvVar{Name:KOLLA_BOOTSTRAP,Value:true,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config-data,ReadOnly:false,MountPath:/var/lib/openstack/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:scripts,ReadOnly:false,MountPath:/var/lib/openstack/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:false,MountPath:/var/lib/kolla/config_files/config.json,SubPath:nova-conductor-dbsync-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-75kwd,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42436,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod nova-cell0-conductor-db-sync-gqqcs_openstack-kuttl-tests(7f54dca9-53ea-40ef-bfba-6603c5294daf): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 12:14:25 crc kubenswrapper[4769]: E1121 12:14:25.648506 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-db-sync\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" podUID="7f54dca9-53ea-40ef-bfba-6603c5294daf" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.029071 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.102481 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerID="00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900" exitCode=0 Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.102550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7gwlw" event={"ID":"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3","Type":"ContainerDied","Data":"00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900"} Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.102644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-7gwlw" event={"ID":"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3","Type":"ContainerDied","Data":"7ae21b0cfe24b80b4ce31e0c902d8e718d659390db99787f146f1577917caec4"} Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.102700 4769 scope.go:117] "RemoveContainer" containerID="00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.102564 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-7gwlw" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.112353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerStarted","Data":"6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c"} Nov 21 12:14:26 crc kubenswrapper[4769]: E1121 12:14:26.133686 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-db-sync\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-nova-conductor@sha256:fed8bb29eb85284462a99cb1013100f375ae83e1d68ef0954dbc3c2d7074f911\\\"\"" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" podUID="7f54dca9-53ea-40ef-bfba-6603c5294daf" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.133754 4769 scope.go:117] "RemoveContainer" containerID="876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.148529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-catalog-content\") pod \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.148883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwr6c\" (UniqueName: \"kubernetes.io/projected/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-kube-api-access-dwr6c\") pod \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.149087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-utilities\") pod \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\" (UID: \"a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3\") " Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.149692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-utilities" (OuterVolumeSpecName: "utilities") pod "a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" (UID: "a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.149896 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.156626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-kube-api-access-dwr6c" (OuterVolumeSpecName: "kube-api-access-dwr6c") pod "a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" (UID: "a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3"). InnerVolumeSpecName "kube-api-access-dwr6c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.162571 4769 scope.go:117] "RemoveContainer" containerID="3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.187069 4769 scope.go:117] "RemoveContainer" containerID="00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900" Nov 21 12:14:26 crc kubenswrapper[4769]: E1121 12:14:26.187759 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900\": container with ID starting with 00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900 not found: ID does not exist" containerID="00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.187817 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900"} err="failed to get container status \"00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900\": rpc error: code = NotFound desc = could not find container \"00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900\": container with ID starting with 00e0afeeaadb82bbb4553abb135c2cd1548c3746638adc3bee0bcdd5576b8900 not found: ID does not exist" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.187857 4769 scope.go:117] "RemoveContainer" containerID="876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab" Nov 21 12:14:26 crc kubenswrapper[4769]: E1121 12:14:26.188631 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab\": container with ID starting with 876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab not found: ID does not exist" containerID="876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.188688 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab"} err="failed to get container status \"876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab\": rpc error: code = NotFound desc = could not find container \"876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab\": container with ID starting with 876c51f8c0c81ee8874a966b3e09f0b6ef88fb99bf77c5b388ad6fb7c025d4ab not found: ID does not exist" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.188734 4769 scope.go:117] "RemoveContainer" containerID="3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f" Nov 21 12:14:26 crc kubenswrapper[4769]: E1121 12:14:26.189126 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f\": container with ID starting with 3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f not found: ID does not exist" containerID="3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.189158 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f"} err="failed to get container status \"3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f\": rpc error: code = NotFound desc = could not find container \"3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f\": container with ID starting with 3e34df46464929528172e82c163c8c26f8657794ef0ef066629d1776b781048f not found: ID does not exist" Nov 21 12:14:26 crc kubenswrapper[4769]: W1121 12:14:26.221994 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06ddf5d7_4d61_4f18_9d64_f99b7a0d236a.slice/crio-25c05323ea28b7c41545cb8ab0edffc5904e649344d577108c394ae07d9c3445 WatchSource:0}: Error finding container 25c05323ea28b7c41545cb8ab0edffc5904e649344d577108c394ae07d9c3445: Status 404 returned error can't find the container with id 25c05323ea28b7c41545cb8ab0edffc5904e649344d577108c394ae07d9c3445 Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.225360 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7d95c8c454-8fh7j"] Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.239843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" (UID: "a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.251479 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dwr6c\" (UniqueName: \"kubernetes.io/projected/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-kube-api-access-dwr6c\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.251717 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.286415 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd"] Nov 21 12:14:26 crc kubenswrapper[4769]: W1121 12:14:26.291070 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f6a3bbb_04b6_4f9f_9c02_dd0b322cddfe.slice/crio-a305f249ff1983b3666bdfc38a635042ae802c609ed5caabd45550dc52ed434e WatchSource:0}: Error finding container a305f249ff1983b3666bdfc38a635042ae802c609ed5caabd45550dc52ed434e: Status 404 returned error can't find the container with id a305f249ff1983b3666bdfc38a635042ae802c609ed5caabd45550dc52ed434e Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.468584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-7gwlw"] Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.483728 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-7gwlw"] Nov 21 12:14:26 crc kubenswrapper[4769]: I1121 12:14:26.620449 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.125088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" event={"ID":"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a","Type":"ContainerStarted","Data":"c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007"} Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.125135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" event={"ID":"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a","Type":"ContainerStarted","Data":"ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca"} Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.125147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" event={"ID":"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a","Type":"ContainerStarted","Data":"25c05323ea28b7c41545cb8ab0edffc5904e649344d577108c394ae07d9c3445"} Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.126165 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.137254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" event={"ID":"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe","Type":"ContainerStarted","Data":"ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6"} Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.137349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" event={"ID":"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe","Type":"ContainerStarted","Data":"2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a"} Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.137367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" event={"ID":"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe","Type":"ContainerStarted","Data":"a305f249ff1983b3666bdfc38a635042ae802c609ed5caabd45550dc52ed434e"} Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.137389 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.156727 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" podStartSLOduration=13.156701197 podStartE2EDuration="13.156701197s" podCreationTimestamp="2025-11-21 12:14:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:14:27.146988123 +0000 UTC m=+1425.847649941" watchObservedRunningTime="2025-11-21 12:14:27.156701197 +0000 UTC m=+1425.857363015" Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.180595 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" podStartSLOduration=16.180576718 podStartE2EDuration="16.180576718s" podCreationTimestamp="2025-11-21 12:14:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:14:27.179899339 +0000 UTC m=+1425.880561177" watchObservedRunningTime="2025-11-21 12:14:27.180576718 +0000 UTC m=+1425.881238536" Nov 21 12:14:27 crc kubenswrapper[4769]: I1121 12:14:27.297032 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" path="/var/lib/kubelet/pods/a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3/volumes" Nov 21 12:14:28 crc kubenswrapper[4769]: I1121 12:14:28.159497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerStarted","Data":"6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb"} Nov 21 12:14:28 crc kubenswrapper[4769]: I1121 12:14:28.160020 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-central-agent" containerID="cri-o://c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c" gracePeriod=30 Nov 21 12:14:28 crc kubenswrapper[4769]: I1121 12:14:28.160144 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-notification-agent" containerID="cri-o://f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab" gracePeriod=30 Nov 21 12:14:28 crc kubenswrapper[4769]: I1121 12:14:28.160170 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="sg-core" containerID="cri-o://6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c" gracePeriod=30 Nov 21 12:14:28 crc kubenswrapper[4769]: I1121 12:14:28.160348 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="proxy-httpd" containerID="cri-o://6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb" gracePeriod=30 Nov 21 12:14:28 crc kubenswrapper[4769]: I1121 12:14:28.194347 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.280594974 podStartE2EDuration="21.194325705s" podCreationTimestamp="2025-11-21 12:14:07 +0000 UTC" firstStartedPulling="2025-11-21 12:14:09.107785964 +0000 UTC m=+1407.808447782" lastFinishedPulling="2025-11-21 12:14:27.021516695 +0000 UTC m=+1425.722178513" observedRunningTime="2025-11-21 12:14:28.188544188 +0000 UTC m=+1426.889206006" watchObservedRunningTime="2025-11-21 12:14:28.194325705 +0000 UTC m=+1426.894987523" Nov 21 12:14:29 crc kubenswrapper[4769]: I1121 12:14:29.175531 4769 generic.go:334] "Generic (PLEG): container finished" podID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerID="6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb" exitCode=0 Nov 21 12:14:29 crc kubenswrapper[4769]: I1121 12:14:29.175963 4769 generic.go:334] "Generic (PLEG): container finished" podID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerID="6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c" exitCode=2 Nov 21 12:14:29 crc kubenswrapper[4769]: I1121 12:14:29.175973 4769 generic.go:334] "Generic (PLEG): container finished" podID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerID="c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c" exitCode=0 Nov 21 12:14:29 crc kubenswrapper[4769]: I1121 12:14:29.175615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerDied","Data":"6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb"} Nov 21 12:14:29 crc kubenswrapper[4769]: I1121 12:14:29.176107 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerDied","Data":"6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c"} Nov 21 12:14:29 crc kubenswrapper[4769]: I1121 12:14:29.176124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerDied","Data":"c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c"} Nov 21 12:14:33 crc kubenswrapper[4769]: I1121 12:14:33.955210 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.034863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-config-data\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.034995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-combined-ca-bundle\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.035037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-run-httpd\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.035193 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-scripts\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.035358 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-log-httpd\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.035408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-sg-core-conf-yaml\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.035489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phd94\" (UniqueName: \"kubernetes.io/projected/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-kube-api-access-phd94\") pod \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\" (UID: \"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9\") " Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.036066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.036584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.045617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-scripts" (OuterVolumeSpecName: "scripts") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.045634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-kube-api-access-phd94" (OuterVolumeSpecName: "kube-api-access-phd94") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "kube-api-access-phd94". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.071503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.139218 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.139247 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.139258 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.139268 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.139281 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-phd94\" (UniqueName: \"kubernetes.io/projected/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-kube-api-access-phd94\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.155347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.162556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-config-data" (OuterVolumeSpecName: "config-data") pod "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" (UID: "83f29ef2-71cd-4751-a731-bc6e9ab2dbb9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.236356 4769 generic.go:334] "Generic (PLEG): container finished" podID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerID="f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab" exitCode=0 Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.236401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerDied","Data":"f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab"} Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.236431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"83f29ef2-71cd-4751-a731-bc6e9ab2dbb9","Type":"ContainerDied","Data":"543fb6e1d5449dbaff5d338c37cdb16a5e17c5cd930833c3398f632363bb247d"} Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.236453 4769 scope.go:117] "RemoveContainer" containerID="6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.236512 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.241007 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.241051 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.270543 4769 scope.go:117] "RemoveContainer" containerID="6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.282133 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.291649 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311440 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311804 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="proxy-httpd" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311822 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="proxy-httpd" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311838 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="sg-core" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311844 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="sg-core" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311858 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="extract-content" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311865 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="extract-content" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311872 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-notification-agent" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311877 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-notification-agent" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311886 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="extract-utilities" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311892 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="extract-utilities" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311913 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="registry-server" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311920 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="registry-server" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.311932 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-central-agent" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.311938 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-central-agent" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.312097 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="proxy-httpd" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.312109 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0ebbf01-fb5c-4d92-b0c0-acedcb4cc2c3" containerName="registry-server" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.312135 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-central-agent" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.312149 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="ceilometer-notification-agent" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.312159 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" containerName="sg-core" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.316000 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.326711 4769 scope.go:117] "RemoveContainer" containerID="f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.327501 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.327700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.327759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.411502 4769 scope.go:117] "RemoveContainer" containerID="c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmlz\" (UniqueName: \"kubernetes.io/projected/ac185ea5-426c-49b9-aac4-bacad190e1e2-kube-api-access-xwmlz\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-run-httpd\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-log-httpd\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444588 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-scripts\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.444609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-config-data\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.454295 4769 scope.go:117] "RemoveContainer" containerID="6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.454822 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb\": container with ID starting with 6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb not found: ID does not exist" containerID="6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.454867 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb"} err="failed to get container status \"6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb\": rpc error: code = NotFound desc = could not find container \"6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb\": container with ID starting with 6c0711435920bc1ff1f721330f902f1e260fb809d8e1fabb8c5ba739309d1feb not found: ID does not exist" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.454897 4769 scope.go:117] "RemoveContainer" containerID="6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.455270 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c\": container with ID starting with 6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c not found: ID does not exist" containerID="6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.455304 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c"} err="failed to get container status \"6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c\": rpc error: code = NotFound desc = could not find container \"6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c\": container with ID starting with 6f65a3edc0fc57fa5897850f17dabe2b07cf101dcb660c13c97aeddf67067c2c not found: ID does not exist" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.455323 4769 scope.go:117] "RemoveContainer" containerID="f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.457527 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab\": container with ID starting with f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab not found: ID does not exist" containerID="f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.457556 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab"} err="failed to get container status \"f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab\": rpc error: code = NotFound desc = could not find container \"f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab\": container with ID starting with f55b87d5f412926f6bea71ddea2e508096a66402a59c114192a31c8fed1064ab not found: ID does not exist" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.457577 4769 scope.go:117] "RemoveContainer" containerID="c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c" Nov 21 12:14:34 crc kubenswrapper[4769]: E1121 12:14:34.457971 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c\": container with ID starting with c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c not found: ID does not exist" containerID="c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.457997 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c"} err="failed to get container status \"c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c\": rpc error: code = NotFound desc = could not find container \"c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c\": container with ID starting with c79c07395730501a1a314c861c4552474016650c00452e2290a556d530aa327c not found: ID does not exist" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.546550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.546885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-scripts\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.546914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-config-data\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.547000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.547030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmlz\" (UniqueName: \"kubernetes.io/projected/ac185ea5-426c-49b9-aac4-bacad190e1e2-kube-api-access-xwmlz\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.547074 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-run-httpd\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.547099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-log-httpd\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.547684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-log-httpd\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.548050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-run-httpd\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.552985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-scripts\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.553701 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.554062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-config-data\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.554490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.571310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmlz\" (UniqueName: \"kubernetes.io/projected/ac185ea5-426c-49b9-aac4-bacad190e1e2-kube-api-access-xwmlz\") pod \"ceilometer-0\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:34 crc kubenswrapper[4769]: I1121 12:14:34.657236 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:35 crc kubenswrapper[4769]: I1121 12:14:35.135784 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:35 crc kubenswrapper[4769]: I1121 12:14:35.249402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerStarted","Data":"5aa6919c06d8f1331cf5f9665dead6bb37b307754f9bf5f834e2e12965c9dae6"} Nov 21 12:14:35 crc kubenswrapper[4769]: I1121 12:14:35.286381 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83f29ef2-71cd-4751-a731-bc6e9ab2dbb9" path="/var/lib/kubelet/pods/83f29ef2-71cd-4751-a731-bc6e9ab2dbb9/volumes" Nov 21 12:14:36 crc kubenswrapper[4769]: I1121 12:14:36.263381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerStarted","Data":"e5317ecf4e4af903a327255b6a0e4b38f271663be2f04b0782a785ec35ef7528"} Nov 21 12:14:37 crc kubenswrapper[4769]: I1121 12:14:37.299396 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerStarted","Data":"b0320a433d81fb94a3b8ec2ebb222c8aca7ba1cb3c037ce639a53c30c38f2ce8"} Nov 21 12:14:38 crc kubenswrapper[4769]: I1121 12:14:38.288974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerStarted","Data":"415db0ac723709a0db96db32fd5abd9829cb1177579cf99ada745ee5e6ae24e6"} Nov 21 12:14:40 crc kubenswrapper[4769]: I1121 12:14:40.312489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerStarted","Data":"9aeb9399cd1f5da2bd6da8d9f65bd2975eba63fb9a5c41140b2dc72f1db332f7"} Nov 21 12:14:40 crc kubenswrapper[4769]: I1121 12:14:40.313363 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:40 crc kubenswrapper[4769]: I1121 12:14:40.334661 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.111093611 podStartE2EDuration="6.334642452s" podCreationTimestamp="2025-11-21 12:14:34 +0000 UTC" firstStartedPulling="2025-11-21 12:14:35.146673707 +0000 UTC m=+1433.847335525" lastFinishedPulling="2025-11-21 12:14:39.370222548 +0000 UTC m=+1438.070884366" observedRunningTime="2025-11-21 12:14:40.332300318 +0000 UTC m=+1439.032962136" watchObservedRunningTime="2025-11-21 12:14:40.334642452 +0000 UTC m=+1439.035304270" Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.325314 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.325403 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.325470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.326593 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"6e8df9d28b4dbd9830a4c8bbe1d15cc740f5f6d0ab87fac63ea00477540fb9ba"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.326688 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://6e8df9d28b4dbd9830a4c8bbe1d15cc740f5f6d0ab87fac63ea00477540fb9ba" gracePeriod=600 Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.475846 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:41 crc kubenswrapper[4769]: I1121 12:14:41.557779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.334402 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="6e8df9d28b4dbd9830a4c8bbe1d15cc740f5f6d0ab87fac63ea00477540fb9ba" exitCode=0 Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.334446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"6e8df9d28b4dbd9830a4c8bbe1d15cc740f5f6d0ab87fac63ea00477540fb9ba"} Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.334999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00"} Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.335061 4769 scope.go:117] "RemoveContainer" containerID="77b95337a8fb1bea6740223d306fd9fa3ee4382d0abe34fe326b929ca3a9c906" Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.338258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" event={"ID":"7f54dca9-53ea-40ef-bfba-6603c5294daf","Type":"ContainerStarted","Data":"bc3160c6a457be2c16dc7b665615dd53c042c229de2b9ee436e6c7fcdccd8818"} Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.338498 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-central-agent" containerID="cri-o://e5317ecf4e4af903a327255b6a0e4b38f271663be2f04b0782a785ec35ef7528" gracePeriod=30 Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.338653 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-notification-agent" containerID="cri-o://b0320a433d81fb94a3b8ec2ebb222c8aca7ba1cb3c037ce639a53c30c38f2ce8" gracePeriod=30 Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.338645 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="sg-core" containerID="cri-o://415db0ac723709a0db96db32fd5abd9829cb1177579cf99ada745ee5e6ae24e6" gracePeriod=30 Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.338708 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="proxy-httpd" containerID="cri-o://9aeb9399cd1f5da2bd6da8d9f65bd2975eba63fb9a5c41140b2dc72f1db332f7" gracePeriod=30 Nov 21 12:14:42 crc kubenswrapper[4769]: I1121 12:14:42.394394 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" podStartSLOduration=1.7480113400000001 podStartE2EDuration="40.394372145s" podCreationTimestamp="2025-11-21 12:14:02 +0000 UTC" firstStartedPulling="2025-11-21 12:14:03.047151356 +0000 UTC m=+1401.747813184" lastFinishedPulling="2025-11-21 12:14:41.693512171 +0000 UTC m=+1440.394173989" observedRunningTime="2025-11-21 12:14:42.38722614 +0000 UTC m=+1441.087887958" watchObservedRunningTime="2025-11-21 12:14:42.394372145 +0000 UTC m=+1441.095033953" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.360833 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerID="9aeb9399cd1f5da2bd6da8d9f65bd2975eba63fb9a5c41140b2dc72f1db332f7" exitCode=0 Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361635 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerID="415db0ac723709a0db96db32fd5abd9829cb1177579cf99ada745ee5e6ae24e6" exitCode=2 Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361647 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerID="b0320a433d81fb94a3b8ec2ebb222c8aca7ba1cb3c037ce639a53c30c38f2ce8" exitCode=0 Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361655 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerID="e5317ecf4e4af903a327255b6a0e4b38f271663be2f04b0782a785ec35ef7528" exitCode=0 Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361070 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerDied","Data":"9aeb9399cd1f5da2bd6da8d9f65bd2975eba63fb9a5c41140b2dc72f1db332f7"} Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerDied","Data":"415db0ac723709a0db96db32fd5abd9829cb1177579cf99ada745ee5e6ae24e6"} Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361726 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerDied","Data":"b0320a433d81fb94a3b8ec2ebb222c8aca7ba1cb3c037ce639a53c30c38f2ce8"} Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.361736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerDied","Data":"e5317ecf4e4af903a327255b6a0e4b38f271663be2f04b0782a785ec35ef7528"} Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.425013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.596035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-sg-core-conf-yaml\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.596686 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-log-httpd\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.596768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-config-data\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.596929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-scripts\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.596996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwmlz\" (UniqueName: \"kubernetes.io/projected/ac185ea5-426c-49b9-aac4-bacad190e1e2-kube-api-access-xwmlz\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.597041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-combined-ca-bundle\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.597100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-run-httpd\") pod \"ac185ea5-426c-49b9-aac4-bacad190e1e2\" (UID: \"ac185ea5-426c-49b9-aac4-bacad190e1e2\") " Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.597546 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.597739 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.597922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.606347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac185ea5-426c-49b9-aac4-bacad190e1e2-kube-api-access-xwmlz" (OuterVolumeSpecName: "kube-api-access-xwmlz") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "kube-api-access-xwmlz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.608857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-scripts" (OuterVolumeSpecName: "scripts") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.634351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.695694 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.700455 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.700500 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xwmlz\" (UniqueName: \"kubernetes.io/projected/ac185ea5-426c-49b9-aac4-bacad190e1e2-kube-api-access-xwmlz\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.700518 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.700530 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac185ea5-426c-49b9-aac4-bacad190e1e2-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.700541 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.712413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-config-data" (OuterVolumeSpecName: "config-data") pod "ac185ea5-426c-49b9-aac4-bacad190e1e2" (UID: "ac185ea5-426c-49b9-aac4-bacad190e1e2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:43 crc kubenswrapper[4769]: I1121 12:14:43.802458 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac185ea5-426c-49b9-aac4-bacad190e1e2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.380546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac185ea5-426c-49b9-aac4-bacad190e1e2","Type":"ContainerDied","Data":"5aa6919c06d8f1331cf5f9665dead6bb37b307754f9bf5f834e2e12965c9dae6"} Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.380628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.380971 4769 scope.go:117] "RemoveContainer" containerID="9aeb9399cd1f5da2bd6da8d9f65bd2975eba63fb9a5c41140b2dc72f1db332f7" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.418950 4769 scope.go:117] "RemoveContainer" containerID="415db0ac723709a0db96db32fd5abd9829cb1177579cf99ada745ee5e6ae24e6" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.423761 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.445133 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.460333 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:44 crc kubenswrapper[4769]: E1121 12:14:44.460982 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-central-agent" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461006 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-central-agent" Nov 21 12:14:44 crc kubenswrapper[4769]: E1121 12:14:44.461024 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-notification-agent" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461031 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-notification-agent" Nov 21 12:14:44 crc kubenswrapper[4769]: E1121 12:14:44.461069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="sg-core" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461076 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="sg-core" Nov 21 12:14:44 crc kubenswrapper[4769]: E1121 12:14:44.461095 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="proxy-httpd" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461101 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="proxy-httpd" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461340 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="sg-core" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461357 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="proxy-httpd" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461368 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-central-agent" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.461381 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" containerName="ceilometer-notification-agent" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.463568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.468845 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.471868 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.472330 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.478058 4769 scope.go:117] "RemoveContainer" containerID="5c5c6caca3d65edbaf3ec0742b672ffd411cb65ef8e3637fc4efabb8cdd6f03d" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.506597 4769 scope.go:117] "RemoveContainer" containerID="b0320a433d81fb94a3b8ec2ebb222c8aca7ba1cb3c037ce639a53c30c38f2ce8" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.564501 4769 scope.go:117] "RemoveContainer" containerID="e5317ecf4e4af903a327255b6a0e4b38f271663be2f04b0782a785ec35ef7528" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.625694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-run-httpd\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.625790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.625823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-log-httpd\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.625892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-config-data\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.625959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-scripts\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.626007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfzjr\" (UniqueName: \"kubernetes.io/projected/9573d9d4-9862-4168-9179-fe1d79caa092-kube-api-access-sfzjr\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.626037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-log-httpd\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728136 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-config-data\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728206 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-scripts\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728250 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sfzjr\" (UniqueName: \"kubernetes.io/projected/9573d9d4-9862-4168-9179-fe1d79caa092-kube-api-access-sfzjr\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-run-httpd\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.728649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-run-httpd\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.729824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-log-httpd\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.735027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-scripts\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.735052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-config-data\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.735062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.735883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.744087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfzjr\" (UniqueName: \"kubernetes.io/projected/9573d9d4-9862-4168-9179-fe1d79caa092-kube-api-access-sfzjr\") pod \"ceilometer-0\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:44 crc kubenswrapper[4769]: I1121 12:14:44.808402 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.065777 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.135773 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd"] Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.136370 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-api" containerID="cri-o://2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a" gracePeriod=30 Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.136524 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-httpd" containerID="cri-o://ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6" gracePeriod=30 Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.237270 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:14:45 crc kubenswrapper[4769]: W1121 12:14:45.240695 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9573d9d4_9862_4168_9179_fe1d79caa092.slice/crio-bcb49ccc4ec05a91c066d06edfcaaa703c30652f1374d10423587906d1f9e2df WatchSource:0}: Error finding container bcb49ccc4ec05a91c066d06edfcaaa703c30652f1374d10423587906d1f9e2df: Status 404 returned error can't find the container with id bcb49ccc4ec05a91c066d06edfcaaa703c30652f1374d10423587906d1f9e2df Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.292299 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac185ea5-426c-49b9-aac4-bacad190e1e2" path="/var/lib/kubelet/pods/ac185ea5-426c-49b9-aac4-bacad190e1e2/volumes" Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.394269 4769 generic.go:334] "Generic (PLEG): container finished" podID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerID="ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6" exitCode=0 Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.394350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" event={"ID":"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe","Type":"ContainerDied","Data":"ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6"} Nov 21 12:14:45 crc kubenswrapper[4769]: I1121 12:14:45.397438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerStarted","Data":"bcb49ccc4ec05a91c066d06edfcaaa703c30652f1374d10423587906d1f9e2df"} Nov 21 12:14:46 crc kubenswrapper[4769]: I1121 12:14:46.414973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerStarted","Data":"50dec56698c2c9541cc9251f6d971ffd86e901ad590de59678f8c3a378ab0771"} Nov 21 12:14:47 crc kubenswrapper[4769]: I1121 12:14:47.426102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerStarted","Data":"e0612457c3d7563df3a8d3abc3aad429a57c37541d27a4b2f4e5735bafab11b5"} Nov 21 12:14:48 crc kubenswrapper[4769]: I1121 12:14:48.439208 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerStarted","Data":"a5361106354ada0dbadfd1a00f4fbf3a52fac99dcf64776d26f3261df4875e9c"} Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.458223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerStarted","Data":"ad9d867a426f47b9f176c6c2a777c3980b6d17fd81e9d613a8c14dbf2c017f42"} Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.458871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.510282 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.059314318 podStartE2EDuration="5.510264422s" podCreationTimestamp="2025-11-21 12:14:44 +0000 UTC" firstStartedPulling="2025-11-21 12:14:45.24486688 +0000 UTC m=+1443.945528698" lastFinishedPulling="2025-11-21 12:14:48.695816984 +0000 UTC m=+1447.396478802" observedRunningTime="2025-11-21 12:14:49.504570497 +0000 UTC m=+1448.205232325" watchObservedRunningTime="2025-11-21 12:14:49.510264422 +0000 UTC m=+1448.210926240" Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.875820 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.940755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-httpd-config\") pod \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.940939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6g4p\" (UniqueName: \"kubernetes.io/projected/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-kube-api-access-x6g4p\") pod \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.940986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-combined-ca-bundle\") pod \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.941115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-config\") pod \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.941336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-ovndb-tls-certs\") pod \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\" (UID: \"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe\") " Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.948141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" (UID: "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:49 crc kubenswrapper[4769]: I1121 12:14:49.951420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-kube-api-access-x6g4p" (OuterVolumeSpecName: "kube-api-access-x6g4p") pod "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" (UID: "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe"). InnerVolumeSpecName "kube-api-access-x6g4p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.011142 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-config" (OuterVolumeSpecName: "config") pod "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" (UID: "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.014640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" (UID: "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.031440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" (UID: "7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.044613 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.044661 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.044677 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x6g4p\" (UniqueName: \"kubernetes.io/projected/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-kube-api-access-x6g4p\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.044694 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.044708 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.472896 4769 generic.go:334] "Generic (PLEG): container finished" podID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerID="2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a" exitCode=0 Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.473030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" event={"ID":"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe","Type":"ContainerDied","Data":"2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a"} Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.473090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" event={"ID":"7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe","Type":"ContainerDied","Data":"a305f249ff1983b3666bdfc38a635042ae802c609ed5caabd45550dc52ed434e"} Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.473093 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.473113 4769 scope.go:117] "RemoveContainer" containerID="ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.515150 4769 scope.go:117] "RemoveContainer" containerID="2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.519781 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd"] Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.532299 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5b4cfbf57-4nxdd"] Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.540201 4769 scope.go:117] "RemoveContainer" containerID="ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6" Nov 21 12:14:50 crc kubenswrapper[4769]: E1121 12:14:50.541269 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6\": container with ID starting with ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6 not found: ID does not exist" containerID="ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.541310 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6"} err="failed to get container status \"ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6\": rpc error: code = NotFound desc = could not find container \"ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6\": container with ID starting with ad7cf7a3f427c400417acc6dae4441226232c09518010ae1d02ab1a6431d84a6 not found: ID does not exist" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.541343 4769 scope.go:117] "RemoveContainer" containerID="2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a" Nov 21 12:14:50 crc kubenswrapper[4769]: E1121 12:14:50.542159 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a\": container with ID starting with 2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a not found: ID does not exist" containerID="2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a" Nov 21 12:14:50 crc kubenswrapper[4769]: I1121 12:14:50.542283 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a"} err="failed to get container status \"2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a\": rpc error: code = NotFound desc = could not find container \"2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a\": container with ID starting with 2ad564bf5e9d91d41c22e29ad9e127fb9bfaa0a64eb2dd8ed2c1bf8788b67a9a not found: ID does not exist" Nov 21 12:14:51 crc kubenswrapper[4769]: I1121 12:14:51.284857 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" path="/var/lib/kubelet/pods/7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe/volumes" Nov 21 12:14:57 crc kubenswrapper[4769]: I1121 12:14:57.550915 4769 generic.go:334] "Generic (PLEG): container finished" podID="7f54dca9-53ea-40ef-bfba-6603c5294daf" containerID="bc3160c6a457be2c16dc7b665615dd53c042c229de2b9ee436e6c7fcdccd8818" exitCode=0 Nov 21 12:14:57 crc kubenswrapper[4769]: I1121 12:14:57.551040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" event={"ID":"7f54dca9-53ea-40ef-bfba-6603c5294daf","Type":"ContainerDied","Data":"bc3160c6a457be2c16dc7b665615dd53c042c229de2b9ee436e6c7fcdccd8818"} Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.630172 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-cfz5l"] Nov 21 12:14:58 crc kubenswrapper[4769]: E1121 12:14:58.631097 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-api" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.631112 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-api" Nov 21 12:14:58 crc kubenswrapper[4769]: E1121 12:14:58.631146 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-httpd" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.631153 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-httpd" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.631361 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-httpd" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.631384 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f6a3bbb-04b6-4f9f-9c02-dd0b322cddfe" containerName="neutron-api" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.632971 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.648768 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-cfz5l"] Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.744298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-catalog-content\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.744424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-utilities\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.744451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sff78\" (UniqueName: \"kubernetes.io/projected/b24b0c62-5a11-400f-80dd-3ac370fbdd58-kube-api-access-sff78\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.846924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-catalog-content\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.847069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-utilities\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.847097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sff78\" (UniqueName: \"kubernetes.io/projected/b24b0c62-5a11-400f-80dd-3ac370fbdd58-kube-api-access-sff78\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.847531 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-catalog-content\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.847895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-utilities\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.872999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sff78\" (UniqueName: \"kubernetes.io/projected/b24b0c62-5a11-400f-80dd-3ac370fbdd58-kube-api-access-sff78\") pod \"community-operators-cfz5l\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.952478 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:58 crc kubenswrapper[4769]: I1121 12:14:58.961653 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.049863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-config-data\") pod \"7f54dca9-53ea-40ef-bfba-6603c5294daf\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.050515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-combined-ca-bundle\") pod \"7f54dca9-53ea-40ef-bfba-6603c5294daf\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.050583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75kwd\" (UniqueName: \"kubernetes.io/projected/7f54dca9-53ea-40ef-bfba-6603c5294daf-kube-api-access-75kwd\") pod \"7f54dca9-53ea-40ef-bfba-6603c5294daf\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.050690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-scripts\") pod \"7f54dca9-53ea-40ef-bfba-6603c5294daf\" (UID: \"7f54dca9-53ea-40ef-bfba-6603c5294daf\") " Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.075351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f54dca9-53ea-40ef-bfba-6603c5294daf-kube-api-access-75kwd" (OuterVolumeSpecName: "kube-api-access-75kwd") pod "7f54dca9-53ea-40ef-bfba-6603c5294daf" (UID: "7f54dca9-53ea-40ef-bfba-6603c5294daf"). InnerVolumeSpecName "kube-api-access-75kwd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.112555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-scripts" (OuterVolumeSpecName: "scripts") pod "7f54dca9-53ea-40ef-bfba-6603c5294daf" (UID: "7f54dca9-53ea-40ef-bfba-6603c5294daf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.148391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f54dca9-53ea-40ef-bfba-6603c5294daf" (UID: "7f54dca9-53ea-40ef-bfba-6603c5294daf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.154369 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.154416 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75kwd\" (UniqueName: \"kubernetes.io/projected/7f54dca9-53ea-40ef-bfba-6603c5294daf-kube-api-access-75kwd\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.154433 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.199323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-config-data" (OuterVolumeSpecName: "config-data") pod "7f54dca9-53ea-40ef-bfba-6603c5294daf" (UID: "7f54dca9-53ea-40ef-bfba-6603c5294daf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.261093 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f54dca9-53ea-40ef-bfba-6603c5294daf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.570511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" event={"ID":"7f54dca9-53ea-40ef-bfba-6603c5294daf","Type":"ContainerDied","Data":"ebf307b0f8c2669c712175556a08723dfb193931946d003eea43991f82377314"} Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.570989 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebf307b0f8c2669c712175556a08723dfb193931946d003eea43991f82377314" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.570592 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.591851 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-cfz5l"] Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.715556 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:14:59 crc kubenswrapper[4769]: E1121 12:14:59.717371 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f54dca9-53ea-40ef-bfba-6603c5294daf" containerName="nova-cell0-conductor-db-sync" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.717393 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f54dca9-53ea-40ef-bfba-6603c5294daf" containerName="nova-cell0-conductor-db-sync" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.717662 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f54dca9-53ea-40ef-bfba-6603c5294daf" containerName="nova-cell0-conductor-db-sync" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.718867 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.722213 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-sqbt2" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.722428 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.736065 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.873850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.874495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.874531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tgw7\" (UniqueName: \"kubernetes.io/projected/2f4e5e5e-6d6e-416a-9457-66f197b04835-kube-api-access-5tgw7\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.976735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.976782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5tgw7\" (UniqueName: \"kubernetes.io/projected/2f4e5e5e-6d6e-416a-9457-66f197b04835-kube-api-access-5tgw7\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.976880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.983472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.983533 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:14:59 crc kubenswrapper[4769]: I1121 12:14:59.995295 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tgw7\" (UniqueName: \"kubernetes.io/projected/2f4e5e5e-6d6e-416a-9457-66f197b04835-kube-api-access-5tgw7\") pod \"nova-cell0-conductor-0\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.037970 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.155385 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597"] Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.157488 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.160329 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.160390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.176411 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597"] Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.281342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1b124023-c81d-4e7e-a144-50f4fb1d1d67-secret-volume\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.281475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b124023-c81d-4e7e-a144-50f4fb1d1d67-config-volume\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.281503 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9k5x\" (UniqueName: \"kubernetes.io/projected/1b124023-c81d-4e7e-a144-50f4fb1d1d67-kube-api-access-v9k5x\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.383467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1b124023-c81d-4e7e-a144-50f4fb1d1d67-secret-volume\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.383565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b124023-c81d-4e7e-a144-50f4fb1d1d67-config-volume\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.383595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v9k5x\" (UniqueName: \"kubernetes.io/projected/1b124023-c81d-4e7e-a144-50f4fb1d1d67-kube-api-access-v9k5x\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.385804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b124023-c81d-4e7e-a144-50f4fb1d1d67-config-volume\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.390898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1b124023-c81d-4e7e-a144-50f4fb1d1d67-secret-volume\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.407644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9k5x\" (UniqueName: \"kubernetes.io/projected/1b124023-c81d-4e7e-a144-50f4fb1d1d67-kube-api-access-v9k5x\") pod \"collect-profiles-29395455-x4597\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.486120 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:00 crc kubenswrapper[4769]: W1121 12:15:00.535433 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f4e5e5e_6d6e_416a_9457_66f197b04835.slice/crio-6edf60b70be43ea0bd340af5af093b9c997e6be254c417416570915271e84d07 WatchSource:0}: Error finding container 6edf60b70be43ea0bd340af5af093b9c997e6be254c417416570915271e84d07: Status 404 returned error can't find the container with id 6edf60b70be43ea0bd340af5af093b9c997e6be254c417416570915271e84d07 Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.536724 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.592870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2f4e5e5e-6d6e-416a-9457-66f197b04835","Type":"ContainerStarted","Data":"6edf60b70be43ea0bd340af5af093b9c997e6be254c417416570915271e84d07"} Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.595871 4769 generic.go:334] "Generic (PLEG): container finished" podID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerID="ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d" exitCode=0 Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.595923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerDied","Data":"ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d"} Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.595949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerStarted","Data":"323f0fa507d1852ae8fa97e391c3a4436944a22d98837ed8b19f3b024b3e5db2"} Nov 21 12:15:00 crc kubenswrapper[4769]: I1121 12:15:00.965717 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597"] Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.628170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2f4e5e5e-6d6e-416a-9457-66f197b04835","Type":"ContainerStarted","Data":"8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c"} Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.628356 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.631516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerStarted","Data":"5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae"} Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.633281 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b124023-c81d-4e7e-a144-50f4fb1d1d67" containerID="02cc1f796dfba269f92633364bb02dd8fd9b9eea72f6f9f4591e92bd0e8de721" exitCode=0 Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.633324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" event={"ID":"1b124023-c81d-4e7e-a144-50f4fb1d1d67","Type":"ContainerDied","Data":"02cc1f796dfba269f92633364bb02dd8fd9b9eea72f6f9f4591e92bd0e8de721"} Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.633348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" event={"ID":"1b124023-c81d-4e7e-a144-50f4fb1d1d67","Type":"ContainerStarted","Data":"8925973e0c2a4ffecc9fdc2f0748c2b36fcd3085a70f1814bc6795bbfe90a571"} Nov 21 12:15:01 crc kubenswrapper[4769]: I1121 12:15:01.652658 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.652634844 podStartE2EDuration="2.652634844s" podCreationTimestamp="2025-11-21 12:14:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:01.645360786 +0000 UTC m=+1460.346022704" watchObservedRunningTime="2025-11-21 12:15:01.652634844 +0000 UTC m=+1460.353296652" Nov 21 12:15:02 crc kubenswrapper[4769]: I1121 12:15:02.650892 4769 generic.go:334] "Generic (PLEG): container finished" podID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerID="5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae" exitCode=0 Nov 21 12:15:02 crc kubenswrapper[4769]: I1121 12:15:02.650973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerDied","Data":"5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae"} Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.043048 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.175055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9k5x\" (UniqueName: \"kubernetes.io/projected/1b124023-c81d-4e7e-a144-50f4fb1d1d67-kube-api-access-v9k5x\") pod \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.175147 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1b124023-c81d-4e7e-a144-50f4fb1d1d67-secret-volume\") pod \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.175228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b124023-c81d-4e7e-a144-50f4fb1d1d67-config-volume\") pod \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\" (UID: \"1b124023-c81d-4e7e-a144-50f4fb1d1d67\") " Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.176715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b124023-c81d-4e7e-a144-50f4fb1d1d67-config-volume" (OuterVolumeSpecName: "config-volume") pod "1b124023-c81d-4e7e-a144-50f4fb1d1d67" (UID: "1b124023-c81d-4e7e-a144-50f4fb1d1d67"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.183482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b124023-c81d-4e7e-a144-50f4fb1d1d67-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "1b124023-c81d-4e7e-a144-50f4fb1d1d67" (UID: "1b124023-c81d-4e7e-a144-50f4fb1d1d67"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.183489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b124023-c81d-4e7e-a144-50f4fb1d1d67-kube-api-access-v9k5x" (OuterVolumeSpecName: "kube-api-access-v9k5x") pod "1b124023-c81d-4e7e-a144-50f4fb1d1d67" (UID: "1b124023-c81d-4e7e-a144-50f4fb1d1d67"). InnerVolumeSpecName "kube-api-access-v9k5x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.277300 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/1b124023-c81d-4e7e-a144-50f4fb1d1d67-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.277354 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b124023-c81d-4e7e-a144-50f4fb1d1d67-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.277369 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v9k5x\" (UniqueName: \"kubernetes.io/projected/1b124023-c81d-4e7e-a144-50f4fb1d1d67-kube-api-access-v9k5x\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.678511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" event={"ID":"1b124023-c81d-4e7e-a144-50f4fb1d1d67","Type":"ContainerDied","Data":"8925973e0c2a4ffecc9fdc2f0748c2b36fcd3085a70f1814bc6795bbfe90a571"} Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.678573 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8925973e0c2a4ffecc9fdc2f0748c2b36fcd3085a70f1814bc6795bbfe90a571" Nov 21 12:15:03 crc kubenswrapper[4769]: I1121 12:15:03.678651 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597" Nov 21 12:15:04 crc kubenswrapper[4769]: I1121 12:15:04.689627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerStarted","Data":"2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa"} Nov 21 12:15:04 crc kubenswrapper[4769]: I1121 12:15:04.759785 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-cfz5l" podStartSLOduration=4.094486802 podStartE2EDuration="6.759766021s" podCreationTimestamp="2025-11-21 12:14:58 +0000 UTC" firstStartedPulling="2025-11-21 12:15:00.598395224 +0000 UTC m=+1459.299057042" lastFinishedPulling="2025-11-21 12:15:03.263674443 +0000 UTC m=+1461.964336261" observedRunningTime="2025-11-21 12:15:04.756142433 +0000 UTC m=+1463.456804241" watchObservedRunningTime="2025-11-21 12:15:04.759766021 +0000 UTC m=+1463.460427839" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.070598 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.663900 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd"] Nov 21 12:15:05 crc kubenswrapper[4769]: E1121 12:15:05.664408 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b124023-c81d-4e7e-a144-50f4fb1d1d67" containerName="collect-profiles" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.664432 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b124023-c81d-4e7e-a144-50f4fb1d1d67" containerName="collect-profiles" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.664658 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b124023-c81d-4e7e-a144-50f4fb1d1d67" containerName="collect-profiles" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.665454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.670144 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.671753 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.683428 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd"] Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.859820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-scripts\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.859890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-config-data\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.859945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.860067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749kp\" (UniqueName: \"kubernetes.io/projected/f93ebecc-25df-4792-833d-ea6b48e54ed6-kube-api-access-749kp\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.913900 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.915579 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.924905 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.933682 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.940998 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.946257 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.960965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkdks\" (UniqueName: \"kubernetes.io/projected/6e17fd08-5569-4991-8fe8-606260cec6c7-kube-api-access-pkdks\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961114 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6hsp\" (UniqueName: \"kubernetes.io/projected/8df81975-c6f5-4dbe-97fe-3f43a2af199e-kube-api-access-k6hsp\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961427 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-749kp\" (UniqueName: \"kubernetes.io/projected/f93ebecc-25df-4792-833d-ea6b48e54ed6-kube-api-access-749kp\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-config-data\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961642 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-scripts\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961681 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df81975-c6f5-4dbe-97fe-3f43a2af199e-logs\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-config-data\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.961736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.963251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.980159 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.983889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.984154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-config-data\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.990285 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:05 crc kubenswrapper[4769]: I1121 12:15:05.991951 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.000983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-scripts\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.001507 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.005062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-749kp\" (UniqueName: \"kubernetes.io/projected/f93ebecc-25df-4792-833d-ea6b48e54ed6-kube-api-access-749kp\") pod \"nova-cell0-cell-mapping-fv7wd\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.024569 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.065567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pkdks\" (UniqueName: \"kubernetes.io/projected/6e17fd08-5569-4991-8fe8-606260cec6c7-kube-api-access-pkdks\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066010 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvqk\" (UniqueName: \"kubernetes.io/projected/02eb0820-318f-46ac-97aa-33c4edd3c321-kube-api-access-rnvqk\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6hsp\" (UniqueName: \"kubernetes.io/projected/8df81975-c6f5-4dbe-97fe-3f43a2af199e-kube-api-access-k6hsp\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066158 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-config-data\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066290 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df81975-c6f5-4dbe-97fe-3f43a2af199e-logs\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.066356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-config-data\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.069440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df81975-c6f5-4dbe-97fe-3f43a2af199e-logs\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.082392 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.083239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.083978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.095836 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.104325 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.106109 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-config-data\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.106820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkdks\" (UniqueName: \"kubernetes.io/projected/6e17fd08-5569-4991-8fe8-606260cec6c7-kube-api-access-pkdks\") pod \"nova-cell1-novncproxy-0\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.107276 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.124546 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6hsp\" (UniqueName: \"kubernetes.io/projected/8df81975-c6f5-4dbe-97fe-3f43a2af199e-kube-api-access-k6hsp\") pod \"nova-api-0\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.136578 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.169786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-config-data\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.169876 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.169905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvqk\" (UniqueName: \"kubernetes.io/projected/02eb0820-318f-46ac-97aa-33c4edd3c321-kube-api-access-rnvqk\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.181007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-config-data\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.198380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.201508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvqk\" (UniqueName: \"kubernetes.io/projected/02eb0820-318f-46ac-97aa-33c4edd3c321-kube-api-access-rnvqk\") pod \"nova-scheduler-0\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.203297 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.240174 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.264467 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.272627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.272702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czhqg\" (UniqueName: \"kubernetes.io/projected/cc10210a-5108-4e94-abad-88377c82037c-kube-api-access-czhqg\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.272749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-config-data\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.272801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc10210a-5108-4e94-abad-88377c82037c-logs\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.283601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.383239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.383738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-czhqg\" (UniqueName: \"kubernetes.io/projected/cc10210a-5108-4e94-abad-88377c82037c-kube-api-access-czhqg\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.383777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-config-data\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.383850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc10210a-5108-4e94-abad-88377c82037c-logs\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.384974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc10210a-5108-4e94-abad-88377c82037c-logs\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.390840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-config-data\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.396193 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.404257 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-czhqg\" (UniqueName: \"kubernetes.io/projected/cc10210a-5108-4e94-abad-88377c82037c-kube-api-access-czhqg\") pod \"nova-metadata-0\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.514881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.756665 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.901566 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:06 crc kubenswrapper[4769]: I1121 12:15:06.914061 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.063481 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd"] Nov 21 12:15:07 crc kubenswrapper[4769]: W1121 12:15:07.064775 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf93ebecc_25df_4792_833d_ea6b48e54ed6.slice/crio-99659f5433bbd90ce4b5a51e2d70da1548768a299d19e47a5d879f56bd66b7f5 WatchSource:0}: Error finding container 99659f5433bbd90ce4b5a51e2d70da1548768a299d19e47a5d879f56bd66b7f5: Status 404 returned error can't find the container with id 99659f5433bbd90ce4b5a51e2d70da1548768a299d19e47a5d879f56bd66b7f5 Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.132366 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c"] Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.134496 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.138652 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.138822 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.143670 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c"] Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.229442 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.310676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-config-data\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.311149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.311983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-scripts\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.312744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smd5h\" (UniqueName: \"kubernetes.io/projected/02a119cb-174d-44e0-9e8c-1522fd897a83-kube-api-access-smd5h\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.414292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-smd5h\" (UniqueName: \"kubernetes.io/projected/02a119cb-174d-44e0-9e8c-1522fd897a83-kube-api-access-smd5h\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.414465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-config-data\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.414509 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.414587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-scripts\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.421757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-config-data\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.422026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.423212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-scripts\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.434967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-smd5h\" (UniqueName: \"kubernetes.io/projected/02a119cb-174d-44e0-9e8c-1522fd897a83-kube-api-access-smd5h\") pod \"nova-cell1-conductor-db-sync-2hs2c\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.458118 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.753074 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" event={"ID":"f93ebecc-25df-4792-833d-ea6b48e54ed6","Type":"ContainerStarted","Data":"77bd7be7315f1a74c08eda80e545ccae22c5e936cf27112438ce6e3a3e860545"} Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.753143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" event={"ID":"f93ebecc-25df-4792-833d-ea6b48e54ed6","Type":"ContainerStarted","Data":"99659f5433bbd90ce4b5a51e2d70da1548768a299d19e47a5d879f56bd66b7f5"} Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.754622 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c"] Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.757771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cc10210a-5108-4e94-abad-88377c82037c","Type":"ContainerStarted","Data":"4bd21fa67600f4cf682b14e3fab1877c3f4d60ba0dabdcf789888a7806194bfe"} Nov 21 12:15:07 crc kubenswrapper[4769]: W1121 12:15:07.757965 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02a119cb_174d_44e0_9e8c_1522fd897a83.slice/crio-2df750aa8baa25d69f8f11502efa6e3a49e6e7e01b9576c5a7f1326481477594 WatchSource:0}: Error finding container 2df750aa8baa25d69f8f11502efa6e3a49e6e7e01b9576c5a7f1326481477594: Status 404 returned error can't find the container with id 2df750aa8baa25d69f8f11502efa6e3a49e6e7e01b9576c5a7f1326481477594 Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.759633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6e17fd08-5569-4991-8fe8-606260cec6c7","Type":"ContainerStarted","Data":"88bc6c72e6d5a519290e8202ca93b8d64c9c8ab4564165d3fb18f3467bb828ce"} Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.769068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eb0820-318f-46ac-97aa-33c4edd3c321","Type":"ContainerStarted","Data":"8d32dcbec489903a5566ce20effd0759fff23eed9b539c10c126bd96b2003570"} Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.771409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8df81975-c6f5-4dbe-97fe-3f43a2af199e","Type":"ContainerStarted","Data":"ecefa40ae99cdfbb4c002b510b9166c09d6dcab26296e9be1cd29e581faf5013"} Nov 21 12:15:07 crc kubenswrapper[4769]: I1121 12:15:07.791246 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" podStartSLOduration=2.791211126 podStartE2EDuration="2.791211126s" podCreationTimestamp="2025-11-21 12:15:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:07.789993203 +0000 UTC m=+1466.490655021" watchObservedRunningTime="2025-11-21 12:15:07.791211126 +0000 UTC m=+1466.491872944" Nov 21 12:15:08 crc kubenswrapper[4769]: I1121 12:15:08.798400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" event={"ID":"02a119cb-174d-44e0-9e8c-1522fd897a83","Type":"ContainerStarted","Data":"612b0514da42992de0ad2ef47696f733ca98f09832a95934c7ed0dc9de461197"} Nov 21 12:15:08 crc kubenswrapper[4769]: I1121 12:15:08.799040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" event={"ID":"02a119cb-174d-44e0-9e8c-1522fd897a83","Type":"ContainerStarted","Data":"2df750aa8baa25d69f8f11502efa6e3a49e6e7e01b9576c5a7f1326481477594"} Nov 21 12:15:08 crc kubenswrapper[4769]: I1121 12:15:08.820426 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" podStartSLOduration=1.820403675 podStartE2EDuration="1.820403675s" podCreationTimestamp="2025-11-21 12:15:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:08.815764908 +0000 UTC m=+1467.516426726" watchObservedRunningTime="2025-11-21 12:15:08.820403675 +0000 UTC m=+1467.521065493" Nov 21 12:15:08 crc kubenswrapper[4769]: I1121 12:15:08.961994 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:15:08 crc kubenswrapper[4769]: I1121 12:15:08.969437 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:15:09 crc kubenswrapper[4769]: I1121 12:15:09.042648 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:15:09 crc kubenswrapper[4769]: I1121 12:15:09.878366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:15:09 crc kubenswrapper[4769]: I1121 12:15:09.956667 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-cfz5l"] Nov 21 12:15:10 crc kubenswrapper[4769]: I1121 12:15:10.127966 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:10 crc kubenswrapper[4769]: I1121 12:15:10.153177 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.872354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6e17fd08-5569-4991-8fe8-606260cec6c7","Type":"ContainerStarted","Data":"82819600c58a2bcf5dc9aff4f2203a869968a5924885e1835b462d6e5884871d"} Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.872528 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="6e17fd08-5569-4991-8fe8-606260cec6c7" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://82819600c58a2bcf5dc9aff4f2203a869968a5924885e1835b462d6e5884871d" gracePeriod=30 Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.875363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eb0820-318f-46ac-97aa-33c4edd3c321","Type":"ContainerStarted","Data":"176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51"} Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.879251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8df81975-c6f5-4dbe-97fe-3f43a2af199e","Type":"ContainerStarted","Data":"651f3d85ab313fdc41bd9e2e4176c5eb34fdb50d1f004b0c86918d522579ea6b"} Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.879310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8df81975-c6f5-4dbe-97fe-3f43a2af199e","Type":"ContainerStarted","Data":"5b9b9408ca76beed8063bc405070ece5fe4cd62486bf0ef0f46ab5d2808d473d"} Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.883216 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-cfz5l" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="registry-server" containerID="cri-o://2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa" gracePeriod=2 Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.883290 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cc10210a-5108-4e94-abad-88377c82037c","Type":"ContainerStarted","Data":"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e"} Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.883375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cc10210a-5108-4e94-abad-88377c82037c","Type":"ContainerStarted","Data":"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6"} Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.883524 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-log" containerID="cri-o://fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6" gracePeriod=30 Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.883558 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-metadata" containerID="cri-o://f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e" gracePeriod=30 Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.908625 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.9521296599999998 podStartE2EDuration="6.908602456s" podCreationTimestamp="2025-11-21 12:15:05 +0000 UTC" firstStartedPulling="2025-11-21 12:15:06.937024655 +0000 UTC m=+1465.637686473" lastFinishedPulling="2025-11-21 12:15:10.893497451 +0000 UTC m=+1469.594159269" observedRunningTime="2025-11-21 12:15:11.896902027 +0000 UTC m=+1470.597563845" watchObservedRunningTime="2025-11-21 12:15:11.908602456 +0000 UTC m=+1470.609264274" Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.934666 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.938372685 podStartE2EDuration="6.934632715s" podCreationTimestamp="2025-11-21 12:15:05 +0000 UTC" firstStartedPulling="2025-11-21 12:15:06.913005111 +0000 UTC m=+1465.613666929" lastFinishedPulling="2025-11-21 12:15:10.909265141 +0000 UTC m=+1469.609926959" observedRunningTime="2025-11-21 12:15:11.931702605 +0000 UTC m=+1470.632364433" watchObservedRunningTime="2025-11-21 12:15:11.934632715 +0000 UTC m=+1470.635294523" Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.961039 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.316337412 podStartE2EDuration="5.961007323s" podCreationTimestamp="2025-11-21 12:15:06 +0000 UTC" firstStartedPulling="2025-11-21 12:15:07.264135217 +0000 UTC m=+1465.964797035" lastFinishedPulling="2025-11-21 12:15:10.908805138 +0000 UTC m=+1469.609466946" observedRunningTime="2025-11-21 12:15:11.955159244 +0000 UTC m=+1470.655821062" watchObservedRunningTime="2025-11-21 12:15:11.961007323 +0000 UTC m=+1470.661669141" Nov 21 12:15:11 crc kubenswrapper[4769]: I1121 12:15:11.980373 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.8566299280000003 podStartE2EDuration="6.98034948s" podCreationTimestamp="2025-11-21 12:15:05 +0000 UTC" firstStartedPulling="2025-11-21 12:15:06.770583401 +0000 UTC m=+1465.471245219" lastFinishedPulling="2025-11-21 12:15:10.894302953 +0000 UTC m=+1469.594964771" observedRunningTime="2025-11-21 12:15:11.976146526 +0000 UTC m=+1470.676808344" watchObservedRunningTime="2025-11-21 12:15:11.98034948 +0000 UTC m=+1470.681011298" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.450412 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.567410 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.641582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sff78\" (UniqueName: \"kubernetes.io/projected/b24b0c62-5a11-400f-80dd-3ac370fbdd58-kube-api-access-sff78\") pod \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.642049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-catalog-content\") pod \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.642160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-utilities\") pod \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\" (UID: \"b24b0c62-5a11-400f-80dd-3ac370fbdd58\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.644493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-utilities" (OuterVolumeSpecName: "utilities") pod "b24b0c62-5a11-400f-80dd-3ac370fbdd58" (UID: "b24b0c62-5a11-400f-80dd-3ac370fbdd58"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.675990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24b0c62-5a11-400f-80dd-3ac370fbdd58-kube-api-access-sff78" (OuterVolumeSpecName: "kube-api-access-sff78") pod "b24b0c62-5a11-400f-80dd-3ac370fbdd58" (UID: "b24b0c62-5a11-400f-80dd-3ac370fbdd58"). InnerVolumeSpecName "kube-api-access-sff78". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.717518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b24b0c62-5a11-400f-80dd-3ac370fbdd58" (UID: "b24b0c62-5a11-400f-80dd-3ac370fbdd58"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.745919 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-combined-ca-bundle\") pod \"cc10210a-5108-4e94-abad-88377c82037c\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.746144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-config-data\") pod \"cc10210a-5108-4e94-abad-88377c82037c\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.746261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czhqg\" (UniqueName: \"kubernetes.io/projected/cc10210a-5108-4e94-abad-88377c82037c-kube-api-access-czhqg\") pod \"cc10210a-5108-4e94-abad-88377c82037c\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.746366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc10210a-5108-4e94-abad-88377c82037c-logs\") pod \"cc10210a-5108-4e94-abad-88377c82037c\" (UID: \"cc10210a-5108-4e94-abad-88377c82037c\") " Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.746743 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sff78\" (UniqueName: \"kubernetes.io/projected/b24b0c62-5a11-400f-80dd-3ac370fbdd58-kube-api-access-sff78\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.746767 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.746781 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b24b0c62-5a11-400f-80dd-3ac370fbdd58-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.747130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc10210a-5108-4e94-abad-88377c82037c-logs" (OuterVolumeSpecName: "logs") pod "cc10210a-5108-4e94-abad-88377c82037c" (UID: "cc10210a-5108-4e94-abad-88377c82037c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.756872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc10210a-5108-4e94-abad-88377c82037c-kube-api-access-czhqg" (OuterVolumeSpecName: "kube-api-access-czhqg") pod "cc10210a-5108-4e94-abad-88377c82037c" (UID: "cc10210a-5108-4e94-abad-88377c82037c"). InnerVolumeSpecName "kube-api-access-czhqg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.780228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-config-data" (OuterVolumeSpecName: "config-data") pod "cc10210a-5108-4e94-abad-88377c82037c" (UID: "cc10210a-5108-4e94-abad-88377c82037c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.802691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc10210a-5108-4e94-abad-88377c82037c" (UID: "cc10210a-5108-4e94-abad-88377c82037c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.848026 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc10210a-5108-4e94-abad-88377c82037c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.848055 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.848066 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc10210a-5108-4e94-abad-88377c82037c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.848076 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-czhqg\" (UniqueName: \"kubernetes.io/projected/cc10210a-5108-4e94-abad-88377c82037c-kube-api-access-czhqg\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894508 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc10210a-5108-4e94-abad-88377c82037c" containerID="f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e" exitCode=0 Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894541 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc10210a-5108-4e94-abad-88377c82037c" containerID="fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6" exitCode=143 Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cc10210a-5108-4e94-abad-88377c82037c","Type":"ContainerDied","Data":"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e"} Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cc10210a-5108-4e94-abad-88377c82037c","Type":"ContainerDied","Data":"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6"} Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cc10210a-5108-4e94-abad-88377c82037c","Type":"ContainerDied","Data":"4bd21fa67600f4cf682b14e3fab1877c3f4d60ba0dabdcf789888a7806194bfe"} Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894646 4769 scope.go:117] "RemoveContainer" containerID="f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.894785 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.906219 4769 generic.go:334] "Generic (PLEG): container finished" podID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerID="2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa" exitCode=0 Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.906342 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cfz5l" Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.906356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerDied","Data":"2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa"} Nov 21 12:15:12 crc kubenswrapper[4769]: I1121 12:15:12.906445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cfz5l" event={"ID":"b24b0c62-5a11-400f-80dd-3ac370fbdd58","Type":"ContainerDied","Data":"323f0fa507d1852ae8fa97e391c3a4436944a22d98837ed8b19f3b024b3e5db2"} Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.001029 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.012465 4769 scope.go:117] "RemoveContainer" containerID="fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.018648 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.027426 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-cfz5l"] Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.038282 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-cfz5l"] Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.049663 4769 scope.go:117] "RemoveContainer" containerID="f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.050127 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e\": container with ID starting with f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e not found: ID does not exist" containerID="f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.050159 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e"} err="failed to get container status \"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e\": rpc error: code = NotFound desc = could not find container \"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e\": container with ID starting with f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.050180 4769 scope.go:117] "RemoveContainer" containerID="fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.067930 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6\": container with ID starting with fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6 not found: ID does not exist" containerID="fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.068015 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6"} err="failed to get container status \"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6\": rpc error: code = NotFound desc = could not find container \"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6\": container with ID starting with fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6 not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.068053 4769 scope.go:117] "RemoveContainer" containerID="f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.069055 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e"} err="failed to get container status \"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e\": rpc error: code = NotFound desc = could not find container \"f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e\": container with ID starting with f29b1fa08b2b86f77c63c00cbfe47a68ae12f0395958b1a207e236902844f83e not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.069092 4769 scope.go:117] "RemoveContainer" containerID="fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.071466 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6"} err="failed to get container status \"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6\": rpc error: code = NotFound desc = could not find container \"fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6\": container with ID starting with fa5ce4e6102a0439c8d0607cd8be45c8b203bcff2ca5dc379c68beb049ceace6 not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.071497 4769 scope.go:117] "RemoveContainer" containerID="2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.077755 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.084260 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="registry-server" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.084526 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="registry-server" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.084639 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="extract-content" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.084712 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="extract-content" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.084809 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-log" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.084883 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-log" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.084991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="extract-utilities" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.085478 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="extract-utilities" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.085638 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-metadata" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.086390 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-metadata" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.087374 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-log" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.087429 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" containerName="registry-server" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.087445 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc10210a-5108-4e94-abad-88377c82037c" containerName="nova-metadata-metadata" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.100619 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.100780 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.107403 4769 scope.go:117] "RemoveContainer" containerID="5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.107713 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.107813 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.156527 4769 scope.go:117] "RemoveContainer" containerID="ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.186646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhb4g\" (UniqueName: \"kubernetes.io/projected/a850752f-e1b6-41a2-bd22-cc480a6142d9-kube-api-access-zhb4g\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.187354 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a850752f-e1b6-41a2-bd22-cc480a6142d9-logs\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.187413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.187495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-config-data\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.187559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.195854 4769 scope.go:117] "RemoveContainer" containerID="2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.196603 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa\": container with ID starting with 2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa not found: ID does not exist" containerID="2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.196643 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa"} err="failed to get container status \"2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa\": rpc error: code = NotFound desc = could not find container \"2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa\": container with ID starting with 2b5b976c9c218163b4d6b489cdc4d616bdbc3cca920d14f9ef0f29ab1b1041aa not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.196670 4769 scope.go:117] "RemoveContainer" containerID="5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.197160 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae\": container with ID starting with 5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae not found: ID does not exist" containerID="5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.197273 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae"} err="failed to get container status \"5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae\": rpc error: code = NotFound desc = could not find container \"5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae\": container with ID starting with 5b3bc02af0d26b95d2ecf58b23e301dbd7dec7efa003ab60956f7f6ba5a625ae not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.197313 4769 scope.go:117] "RemoveContainer" containerID="ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d" Nov 21 12:15:13 crc kubenswrapper[4769]: E1121 12:15:13.197776 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d\": container with ID starting with ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d not found: ID does not exist" containerID="ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.197858 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d"} err="failed to get container status \"ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d\": rpc error: code = NotFound desc = could not find container \"ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d\": container with ID starting with ff6bc8d2465417cc8b22179e956d53894a34e54dc50cf8b91ce5409d941f255d not found: ID does not exist" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.285658 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b24b0c62-5a11-400f-80dd-3ac370fbdd58" path="/var/lib/kubelet/pods/b24b0c62-5a11-400f-80dd-3ac370fbdd58/volumes" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.286481 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc10210a-5108-4e94-abad-88377c82037c" path="/var/lib/kubelet/pods/cc10210a-5108-4e94-abad-88377c82037c/volumes" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.289895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a850752f-e1b6-41a2-bd22-cc480a6142d9-logs\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.290119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.290313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-config-data\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.290442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.290598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zhb4g\" (UniqueName: \"kubernetes.io/projected/a850752f-e1b6-41a2-bd22-cc480a6142d9-kube-api-access-zhb4g\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.290627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a850752f-e1b6-41a2-bd22-cc480a6142d9-logs\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.297326 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.297514 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.297637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-config-data\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.311153 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhb4g\" (UniqueName: \"kubernetes.io/projected/a850752f-e1b6-41a2-bd22-cc480a6142d9-kube-api-access-zhb4g\") pod \"nova-metadata-0\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:13 crc kubenswrapper[4769]: I1121 12:15:13.526386 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:14 crc kubenswrapper[4769]: I1121 12:15:14.021140 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:14 crc kubenswrapper[4769]: I1121 12:15:14.813710 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:14 crc kubenswrapper[4769]: I1121 12:15:14.947685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a850752f-e1b6-41a2-bd22-cc480a6142d9","Type":"ContainerStarted","Data":"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c"} Nov 21 12:15:14 crc kubenswrapper[4769]: I1121 12:15:14.948127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a850752f-e1b6-41a2-bd22-cc480a6142d9","Type":"ContainerStarted","Data":"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99"} Nov 21 12:15:14 crc kubenswrapper[4769]: I1121 12:15:14.948139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a850752f-e1b6-41a2-bd22-cc480a6142d9","Type":"ContainerStarted","Data":"e14ec63f86faef4a4bc41a0c7301625d390fc43d36995a3f97eb9710bfabc77f"} Nov 21 12:15:14 crc kubenswrapper[4769]: I1121 12:15:14.971602 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.97158391 podStartE2EDuration="2.97158391s" podCreationTimestamp="2025-11-21 12:15:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:14.968733282 +0000 UTC m=+1473.669395120" watchObservedRunningTime="2025-11-21 12:15:14.97158391 +0000 UTC m=+1473.672245728" Nov 21 12:15:15 crc kubenswrapper[4769]: I1121 12:15:15.958589 4769 generic.go:334] "Generic (PLEG): container finished" podID="f93ebecc-25df-4792-833d-ea6b48e54ed6" containerID="77bd7be7315f1a74c08eda80e545ccae22c5e936cf27112438ce6e3a3e860545" exitCode=0 Nov 21 12:15:15 crc kubenswrapper[4769]: I1121 12:15:15.958699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" event={"ID":"f93ebecc-25df-4792-833d-ea6b48e54ed6","Type":"ContainerDied","Data":"77bd7be7315f1a74c08eda80e545ccae22c5e936cf27112438ce6e3a3e860545"} Nov 21 12:15:16 crc kubenswrapper[4769]: I1121 12:15:16.203535 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:16 crc kubenswrapper[4769]: I1121 12:15:16.203807 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:16 crc kubenswrapper[4769]: I1121 12:15:16.241217 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:16 crc kubenswrapper[4769]: I1121 12:15:16.242627 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:16 crc kubenswrapper[4769]: I1121 12:15:16.266512 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:16 crc kubenswrapper[4769]: I1121 12:15:16.266575 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.015356 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.352383 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.172:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.352404 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.172:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.419837 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.482469 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-749kp\" (UniqueName: \"kubernetes.io/projected/f93ebecc-25df-4792-833d-ea6b48e54ed6-kube-api-access-749kp\") pod \"f93ebecc-25df-4792-833d-ea6b48e54ed6\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.482517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-config-data\") pod \"f93ebecc-25df-4792-833d-ea6b48e54ed6\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.482678 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-combined-ca-bundle\") pod \"f93ebecc-25df-4792-833d-ea6b48e54ed6\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.482730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-scripts\") pod \"f93ebecc-25df-4792-833d-ea6b48e54ed6\" (UID: \"f93ebecc-25df-4792-833d-ea6b48e54ed6\") " Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.499010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-scripts" (OuterVolumeSpecName: "scripts") pod "f93ebecc-25df-4792-833d-ea6b48e54ed6" (UID: "f93ebecc-25df-4792-833d-ea6b48e54ed6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.501376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93ebecc-25df-4792-833d-ea6b48e54ed6-kube-api-access-749kp" (OuterVolumeSpecName: "kube-api-access-749kp") pod "f93ebecc-25df-4792-833d-ea6b48e54ed6" (UID: "f93ebecc-25df-4792-833d-ea6b48e54ed6"). InnerVolumeSpecName "kube-api-access-749kp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.524361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f93ebecc-25df-4792-833d-ea6b48e54ed6" (UID: "f93ebecc-25df-4792-833d-ea6b48e54ed6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.538343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-config-data" (OuterVolumeSpecName: "config-data") pod "f93ebecc-25df-4792-833d-ea6b48e54ed6" (UID: "f93ebecc-25df-4792-833d-ea6b48e54ed6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.584828 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.585065 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.585137 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-749kp\" (UniqueName: \"kubernetes.io/projected/f93ebecc-25df-4792-833d-ea6b48e54ed6-kube-api-access-749kp\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.585264 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f93ebecc-25df-4792-833d-ea6b48e54ed6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.978602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" event={"ID":"f93ebecc-25df-4792-833d-ea6b48e54ed6","Type":"ContainerDied","Data":"99659f5433bbd90ce4b5a51e2d70da1548768a299d19e47a5d879f56bd66b7f5"} Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.978654 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99659f5433bbd90ce4b5a51e2d70da1548768a299d19e47a5d879f56bd66b7f5" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.978678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd" Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.980641 4769 generic.go:334] "Generic (PLEG): container finished" podID="02a119cb-174d-44e0-9e8c-1522fd897a83" containerID="612b0514da42992de0ad2ef47696f733ca98f09832a95934c7ed0dc9de461197" exitCode=0 Nov 21 12:15:17 crc kubenswrapper[4769]: I1121 12:15:17.980776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" event={"ID":"02a119cb-174d-44e0-9e8c-1522fd897a83","Type":"ContainerDied","Data":"612b0514da42992de0ad2ef47696f733ca98f09832a95934c7ed0dc9de461197"} Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.133854 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.145833 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.146142 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-log" containerID="cri-o://5b9b9408ca76beed8063bc405070ece5fe4cd62486bf0ef0f46ab5d2808d473d" gracePeriod=30 Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.146630 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-api" containerID="cri-o://651f3d85ab313fdc41bd9e2e4176c5eb34fdb50d1f004b0c86918d522579ea6b" gracePeriod=30 Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.160926 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.161407 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-log" containerID="cri-o://66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99" gracePeriod=30 Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.161885 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-metadata" containerID="cri-o://655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c" gracePeriod=30 Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.526765 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.527510 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.780444 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.813216 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-nova-metadata-tls-certs\") pod \"a850752f-e1b6-41a2-bd22-cc480a6142d9\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.813352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhb4g\" (UniqueName: \"kubernetes.io/projected/a850752f-e1b6-41a2-bd22-cc480a6142d9-kube-api-access-zhb4g\") pod \"a850752f-e1b6-41a2-bd22-cc480a6142d9\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.813443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-combined-ca-bundle\") pod \"a850752f-e1b6-41a2-bd22-cc480a6142d9\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.813534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a850752f-e1b6-41a2-bd22-cc480a6142d9-logs\") pod \"a850752f-e1b6-41a2-bd22-cc480a6142d9\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.813565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-config-data\") pod \"a850752f-e1b6-41a2-bd22-cc480a6142d9\" (UID: \"a850752f-e1b6-41a2-bd22-cc480a6142d9\") " Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.814935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a850752f-e1b6-41a2-bd22-cc480a6142d9-logs" (OuterVolumeSpecName: "logs") pod "a850752f-e1b6-41a2-bd22-cc480a6142d9" (UID: "a850752f-e1b6-41a2-bd22-cc480a6142d9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.820109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a850752f-e1b6-41a2-bd22-cc480a6142d9-kube-api-access-zhb4g" (OuterVolumeSpecName: "kube-api-access-zhb4g") pod "a850752f-e1b6-41a2-bd22-cc480a6142d9" (UID: "a850752f-e1b6-41a2-bd22-cc480a6142d9"). InnerVolumeSpecName "kube-api-access-zhb4g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.850779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-config-data" (OuterVolumeSpecName: "config-data") pod "a850752f-e1b6-41a2-bd22-cc480a6142d9" (UID: "a850752f-e1b6-41a2-bd22-cc480a6142d9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.855542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a850752f-e1b6-41a2-bd22-cc480a6142d9" (UID: "a850752f-e1b6-41a2-bd22-cc480a6142d9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.881901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "a850752f-e1b6-41a2-bd22-cc480a6142d9" (UID: "a850752f-e1b6-41a2-bd22-cc480a6142d9"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.915377 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zhb4g\" (UniqueName: \"kubernetes.io/projected/a850752f-e1b6-41a2-bd22-cc480a6142d9-kube-api-access-zhb4g\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.915416 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.915431 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a850752f-e1b6-41a2-bd22-cc480a6142d9-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.915444 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:18 crc kubenswrapper[4769]: I1121 12:15:18.915460 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/a850752f-e1b6-41a2-bd22-cc480a6142d9-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.022212 4769 generic.go:334] "Generic (PLEG): container finished" podID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerID="655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c" exitCode=0 Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.022285 4769 generic.go:334] "Generic (PLEG): container finished" podID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerID="66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99" exitCode=143 Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.022389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a850752f-e1b6-41a2-bd22-cc480a6142d9","Type":"ContainerDied","Data":"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c"} Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.022476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a850752f-e1b6-41a2-bd22-cc480a6142d9","Type":"ContainerDied","Data":"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99"} Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.022513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a850752f-e1b6-41a2-bd22-cc480a6142d9","Type":"ContainerDied","Data":"e14ec63f86faef4a4bc41a0c7301625d390fc43d36995a3f97eb9710bfabc77f"} Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.022537 4769 scope.go:117] "RemoveContainer" containerID="655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.025253 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.030374 4769 generic.go:334] "Generic (PLEG): container finished" podID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerID="5b9b9408ca76beed8063bc405070ece5fe4cd62486bf0ef0f46ab5d2808d473d" exitCode=143 Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.031270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8df81975-c6f5-4dbe-97fe-3f43a2af199e","Type":"ContainerDied","Data":"5b9b9408ca76beed8063bc405070ece5fe4cd62486bf0ef0f46ab5d2808d473d"} Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.109865 4769 scope.go:117] "RemoveContainer" containerID="66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.156243 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.182772 4769 scope.go:117] "RemoveContainer" containerID="655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c" Nov 21 12:15:19 crc kubenswrapper[4769]: E1121 12:15:19.183443 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c\": container with ID starting with 655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c not found: ID does not exist" containerID="655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.183474 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c"} err="failed to get container status \"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c\": rpc error: code = NotFound desc = could not find container \"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c\": container with ID starting with 655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c not found: ID does not exist" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.183496 4769 scope.go:117] "RemoveContainer" containerID="66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99" Nov 21 12:15:19 crc kubenswrapper[4769]: E1121 12:15:19.183885 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99\": container with ID starting with 66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99 not found: ID does not exist" containerID="66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.183915 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99"} err="failed to get container status \"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99\": rpc error: code = NotFound desc = could not find container \"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99\": container with ID starting with 66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99 not found: ID does not exist" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.184057 4769 scope.go:117] "RemoveContainer" containerID="655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.184350 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c"} err="failed to get container status \"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c\": rpc error: code = NotFound desc = could not find container \"655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c\": container with ID starting with 655f7922ec201f5b2e8ff4af2d3fb8c8d4827c3148e27e878924ffa41aca5d6c not found: ID does not exist" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.184367 4769 scope.go:117] "RemoveContainer" containerID="66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.184673 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99"} err="failed to get container status \"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99\": rpc error: code = NotFound desc = could not find container \"66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99\": container with ID starting with 66cc4254bf8571ea503e047c77e7a14c8a894c0cbb4749755b16b4028c15bd99 not found: ID does not exist" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.190082 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.204981 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:19 crc kubenswrapper[4769]: E1121 12:15:19.205832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f93ebecc-25df-4792-833d-ea6b48e54ed6" containerName="nova-manage" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.205858 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93ebecc-25df-4792-833d-ea6b48e54ed6" containerName="nova-manage" Nov 21 12:15:19 crc kubenswrapper[4769]: E1121 12:15:19.205869 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-log" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.205877 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-log" Nov 21 12:15:19 crc kubenswrapper[4769]: E1121 12:15:19.205923 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-metadata" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.205929 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-metadata" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.206104 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-metadata" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.206126 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" containerName="nova-metadata-log" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.206140 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f93ebecc-25df-4792-833d-ea6b48e54ed6" containerName="nova-manage" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.207232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.217047 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.217568 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.227288 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.230371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-config-data\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.230658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-logs\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.230806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.230962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54kk5\" (UniqueName: \"kubernetes.io/projected/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-kube-api-access-54kk5\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.231219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.299347 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a850752f-e1b6-41a2-bd22-cc480a6142d9" path="/var/lib/kubelet/pods/a850752f-e1b6-41a2-bd22-cc480a6142d9/volumes" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.334315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.334354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-54kk5\" (UniqueName: \"kubernetes.io/projected/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-kube-api-access-54kk5\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.334401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.334504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-config-data\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.334558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-logs\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.334953 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-logs\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.341912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-config-data\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.342494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.342643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.353653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-54kk5\" (UniqueName: \"kubernetes.io/projected/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-kube-api-access-54kk5\") pod \"nova-metadata-0\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.462457 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.462713 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" containerName="kube-state-metrics" containerID="cri-o://3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0" gracePeriod=30 Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.538440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.694490 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.844740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smd5h\" (UniqueName: \"kubernetes.io/projected/02a119cb-174d-44e0-9e8c-1522fd897a83-kube-api-access-smd5h\") pod \"02a119cb-174d-44e0-9e8c-1522fd897a83\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.844844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-scripts\") pod \"02a119cb-174d-44e0-9e8c-1522fd897a83\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.844945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-config-data\") pod \"02a119cb-174d-44e0-9e8c-1522fd897a83\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.845039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-combined-ca-bundle\") pod \"02a119cb-174d-44e0-9e8c-1522fd897a83\" (UID: \"02a119cb-174d-44e0-9e8c-1522fd897a83\") " Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.851635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-scripts" (OuterVolumeSpecName: "scripts") pod "02a119cb-174d-44e0-9e8c-1522fd897a83" (UID: "02a119cb-174d-44e0-9e8c-1522fd897a83"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.852485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a119cb-174d-44e0-9e8c-1522fd897a83-kube-api-access-smd5h" (OuterVolumeSpecName: "kube-api-access-smd5h") pod "02a119cb-174d-44e0-9e8c-1522fd897a83" (UID: "02a119cb-174d-44e0-9e8c-1522fd897a83"). InnerVolumeSpecName "kube-api-access-smd5h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.887503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-config-data" (OuterVolumeSpecName: "config-data") pod "02a119cb-174d-44e0-9e8c-1522fd897a83" (UID: "02a119cb-174d-44e0-9e8c-1522fd897a83"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.902435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "02a119cb-174d-44e0-9e8c-1522fd897a83" (UID: "02a119cb-174d-44e0-9e8c-1522fd897a83"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.947472 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.947509 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.947521 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-smd5h\" (UniqueName: \"kubernetes.io/projected/02a119cb-174d-44e0-9e8c-1522fd897a83-kube-api-access-smd5h\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.947529 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/02a119cb-174d-44e0-9e8c-1522fd897a83-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:19 crc kubenswrapper[4769]: I1121 12:15:19.954817 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.049907 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.049937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c" event={"ID":"02a119cb-174d-44e0-9e8c-1522fd897a83","Type":"ContainerDied","Data":"2df750aa8baa25d69f8f11502efa6e3a49e6e7e01b9576c5a7f1326481477594"} Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.049988 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2df750aa8baa25d69f8f11502efa6e3a49e6e7e01b9576c5a7f1326481477594" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.061656 4769 generic.go:334] "Generic (PLEG): container finished" podID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" containerID="3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0" exitCode=2 Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.061780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"fddc5cda-eae9-43a0-afd5-c99a76904b8e","Type":"ContainerDied","Data":"3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0"} Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.061830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"fddc5cda-eae9-43a0-afd5-c99a76904b8e","Type":"ContainerDied","Data":"e61299b4f2dd1114372611de8130a83f37de47fda5490020219d47bea3f74a0e"} Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.061861 4769 scope.go:117] "RemoveContainer" containerID="3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.062040 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.068050 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="02eb0820-318f-46ac-97aa-33c4edd3c321" containerName="nova-scheduler-scheduler" containerID="cri-o://176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" gracePeriod=30 Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.089531 4769 scope.go:117] "RemoveContainer" containerID="3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0" Nov 21 12:15:20 crc kubenswrapper[4769]: E1121 12:15:20.093135 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0\": container with ID starting with 3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0 not found: ID does not exist" containerID="3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.093211 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0"} err="failed to get container status \"3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0\": rpc error: code = NotFound desc = could not find container \"3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0\": container with ID starting with 3ebbdfeeb4da1f3da4b09045f4155869f3e085456787af51aa70629373eb4bc0 not found: ID does not exist" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.110478 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: E1121 12:15:20.111073 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02a119cb-174d-44e0-9e8c-1522fd897a83" containerName="nova-cell1-conductor-db-sync" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.111093 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a119cb-174d-44e0-9e8c-1522fd897a83" containerName="nova-cell1-conductor-db-sync" Nov 21 12:15:20 crc kubenswrapper[4769]: E1121 12:15:20.111109 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" containerName="kube-state-metrics" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.111117 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" containerName="kube-state-metrics" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.113149 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" containerName="kube-state-metrics" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.113237 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="02a119cb-174d-44e0-9e8c-1522fd897a83" containerName="nova-cell1-conductor-db-sync" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.114163 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.117917 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.145945 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.150413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qt5m\" (UniqueName: \"kubernetes.io/projected/fddc5cda-eae9-43a0-afd5-c99a76904b8e-kube-api-access-2qt5m\") pod \"fddc5cda-eae9-43a0-afd5-c99a76904b8e\" (UID: \"fddc5cda-eae9-43a0-afd5-c99a76904b8e\") " Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.157414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fddc5cda-eae9-43a0-afd5-c99a76904b8e-kube-api-access-2qt5m" (OuterVolumeSpecName: "kube-api-access-2qt5m") pod "fddc5cda-eae9-43a0-afd5-c99a76904b8e" (UID: "fddc5cda-eae9-43a0-afd5-c99a76904b8e"). InnerVolumeSpecName "kube-api-access-2qt5m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.187017 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: W1121 12:15:20.191130 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b874256_f8fb_4023_83a1_f3ed5fcf8ab3.slice/crio-c82dc437864da95c4640fb94662e2399437bff8b411ba85ed0cc90969b1dbffe WatchSource:0}: Error finding container c82dc437864da95c4640fb94662e2399437bff8b411ba85ed0cc90969b1dbffe: Status 404 returned error can't find the container with id c82dc437864da95c4640fb94662e2399437bff8b411ba85ed0cc90969b1dbffe Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.253908 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.253999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.254166 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs5lx\" (UniqueName: \"kubernetes.io/projected/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-kube-api-access-rs5lx\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.254260 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2qt5m\" (UniqueName: \"kubernetes.io/projected/fddc5cda-eae9-43a0-afd5-c99a76904b8e-kube-api-access-2qt5m\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.356567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rs5lx\" (UniqueName: \"kubernetes.io/projected/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-kube-api-access-rs5lx\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.356657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.356698 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.360051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.362121 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.376830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs5lx\" (UniqueName: \"kubernetes.io/projected/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-kube-api-access-rs5lx\") pod \"nova-cell1-conductor-0\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.434697 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.577372 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.587868 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.600256 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.601869 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.606279 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.606635 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.622540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.765454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.765609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.765636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.766020 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szh5h\" (UniqueName: \"kubernetes.io/projected/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-api-access-szh5h\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.868125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-szh5h\" (UniqueName: \"kubernetes.io/projected/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-api-access-szh5h\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.868225 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.868323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.868358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.876336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.876799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.893874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.895143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-szh5h\" (UniqueName: \"kubernetes.io/projected/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-api-access-szh5h\") pod \"kube-state-metrics-0\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.932082 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:15:20 crc kubenswrapper[4769]: W1121 12:15:20.933079 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod801dd535_e22a_4d31_85b8_c8cdb0c2bed2.slice/crio-d8613a9252ebb6738af2ef2135ba771ceb48a9ecb0217abbd802cf2e5e72f83e WatchSource:0}: Error finding container d8613a9252ebb6738af2ef2135ba771ceb48a9ecb0217abbd802cf2e5e72f83e: Status 404 returned error can't find the container with id d8613a9252ebb6738af2ef2135ba771ceb48a9ecb0217abbd802cf2e5e72f83e Nov 21 12:15:20 crc kubenswrapper[4769]: I1121 12:15:20.935921 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.079970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"801dd535-e22a-4d31-85b8-c8cdb0c2bed2","Type":"ContainerStarted","Data":"d8613a9252ebb6738af2ef2135ba771ceb48a9ecb0217abbd802cf2e5e72f83e"} Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.081566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3","Type":"ContainerStarted","Data":"ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f"} Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.081607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3","Type":"ContainerStarted","Data":"0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff"} Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.081617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3","Type":"ContainerStarted","Data":"c82dc437864da95c4640fb94662e2399437bff8b411ba85ed0cc90969b1dbffe"} Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.107797 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.107774846 podStartE2EDuration="2.107774846s" podCreationTimestamp="2025-11-21 12:15:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:21.099638275 +0000 UTC m=+1479.800300093" watchObservedRunningTime="2025-11-21 12:15:21.107774846 +0000 UTC m=+1479.808436664" Nov 21 12:15:21 crc kubenswrapper[4769]: E1121 12:15:21.207526 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:15:21 crc kubenswrapper[4769]: E1121 12:15:21.211377 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:15:21 crc kubenswrapper[4769]: E1121 12:15:21.214373 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:15:21 crc kubenswrapper[4769]: E1121 12:15:21.214461 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="02eb0820-318f-46ac-97aa-33c4edd3c321" containerName="nova-scheduler-scheduler" Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.285695 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fddc5cda-eae9-43a0-afd5-c99a76904b8e" path="/var/lib/kubelet/pods/fddc5cda-eae9-43a0-afd5-c99a76904b8e/volumes" Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.434423 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.585141 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.585632 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-central-agent" containerID="cri-o://50dec56698c2c9541cc9251f6d971ffd86e901ad590de59678f8c3a378ab0771" gracePeriod=30 Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.586546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="proxy-httpd" containerID="cri-o://ad9d867a426f47b9f176c6c2a777c3980b6d17fd81e9d613a8c14dbf2c017f42" gracePeriod=30 Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.586646 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-notification-agent" containerID="cri-o://e0612457c3d7563df3a8d3abc3aad429a57c37541d27a4b2f4e5735bafab11b5" gracePeriod=30 Nov 21 12:15:21 crc kubenswrapper[4769]: I1121 12:15:21.586725 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="sg-core" containerID="cri-o://a5361106354ada0dbadfd1a00f4fbf3a52fac99dcf64776d26f3261df4875e9c" gracePeriod=30 Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.096722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"82bc46a0-92fc-4db5-a7db-08ac6812d117","Type":"ContainerStarted","Data":"47b1c77150aabf5d5318458370bf0cc629b177d9fa2edb1c30499e6ac7d8c4ee"} Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.104897 4769 generic.go:334] "Generic (PLEG): container finished" podID="9573d9d4-9862-4168-9179-fe1d79caa092" containerID="ad9d867a426f47b9f176c6c2a777c3980b6d17fd81e9d613a8c14dbf2c017f42" exitCode=0 Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.104954 4769 generic.go:334] "Generic (PLEG): container finished" podID="9573d9d4-9862-4168-9179-fe1d79caa092" containerID="a5361106354ada0dbadfd1a00f4fbf3a52fac99dcf64776d26f3261df4875e9c" exitCode=2 Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.104988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerDied","Data":"ad9d867a426f47b9f176c6c2a777c3980b6d17fd81e9d613a8c14dbf2c017f42"} Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.105035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerDied","Data":"a5361106354ada0dbadfd1a00f4fbf3a52fac99dcf64776d26f3261df4875e9c"} Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.107328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"801dd535-e22a-4d31-85b8-c8cdb0c2bed2","Type":"ContainerStarted","Data":"c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf"} Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.107528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:22 crc kubenswrapper[4769]: I1121 12:15:22.129057 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.129035059 podStartE2EDuration="2.129035059s" podCreationTimestamp="2025-11-21 12:15:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:22.125846012 +0000 UTC m=+1480.826507830" watchObservedRunningTime="2025-11-21 12:15:22.129035059 +0000 UTC m=+1480.829696877" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.166069 4769 generic.go:334] "Generic (PLEG): container finished" podID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerID="651f3d85ab313fdc41bd9e2e4176c5eb34fdb50d1f004b0c86918d522579ea6b" exitCode=0 Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.166379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8df81975-c6f5-4dbe-97fe-3f43a2af199e","Type":"ContainerDied","Data":"651f3d85ab313fdc41bd9e2e4176c5eb34fdb50d1f004b0c86918d522579ea6b"} Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.178995 4769 generic.go:334] "Generic (PLEG): container finished" podID="9573d9d4-9862-4168-9179-fe1d79caa092" containerID="e0612457c3d7563df3a8d3abc3aad429a57c37541d27a4b2f4e5735bafab11b5" exitCode=0 Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.179035 4769 generic.go:334] "Generic (PLEG): container finished" podID="9573d9d4-9862-4168-9179-fe1d79caa092" containerID="50dec56698c2c9541cc9251f6d971ffd86e901ad590de59678f8c3a378ab0771" exitCode=0 Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.179090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerDied","Data":"e0612457c3d7563df3a8d3abc3aad429a57c37541d27a4b2f4e5735bafab11b5"} Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.179123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerDied","Data":"50dec56698c2c9541cc9251f6d971ffd86e901ad590de59678f8c3a378ab0771"} Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.179137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9573d9d4-9862-4168-9179-fe1d79caa092","Type":"ContainerDied","Data":"bcb49ccc4ec05a91c066d06edfcaaa703c30652f1374d10423587906d1f9e2df"} Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.179150 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcb49ccc4ec05a91c066d06edfcaaa703c30652f1374d10423587906d1f9e2df" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.185441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"82bc46a0-92fc-4db5-a7db-08ac6812d117","Type":"ContainerStarted","Data":"785eebb05575318089d30427f0a14b802279fa7dfe4562c35ee0ba8ec167d96f"} Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.185497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.200435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.221513 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.8697838190000002 podStartE2EDuration="3.221492421s" podCreationTimestamp="2025-11-21 12:15:20 +0000 UTC" firstStartedPulling="2025-11-21 12:15:21.430645552 +0000 UTC m=+1480.131307370" lastFinishedPulling="2025-11-21 12:15:21.782354154 +0000 UTC m=+1480.483015972" observedRunningTime="2025-11-21 12:15:23.220577036 +0000 UTC m=+1481.921238854" watchObservedRunningTime="2025-11-21 12:15:23.221492421 +0000 UTC m=+1481.922154229" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.287860 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfzjr\" (UniqueName: \"kubernetes.io/projected/9573d9d4-9862-4168-9179-fe1d79caa092-kube-api-access-sfzjr\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-config-data\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-log-httpd\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-scripts\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-run-httpd\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-sg-core-conf-yaml\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.329643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-combined-ca-bundle\") pod \"9573d9d4-9862-4168-9179-fe1d79caa092\" (UID: \"9573d9d4-9862-4168-9179-fe1d79caa092\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.330360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.331269 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.338455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-scripts" (OuterVolumeSpecName: "scripts") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.340722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9573d9d4-9862-4168-9179-fe1d79caa092-kube-api-access-sfzjr" (OuterVolumeSpecName: "kube-api-access-sfzjr") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "kube-api-access-sfzjr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.369602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-combined-ca-bundle\") pod \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df81975-c6f5-4dbe-97fe-3f43a2af199e-logs\") pod \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-config-data\") pod \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6hsp\" (UniqueName: \"kubernetes.io/projected/8df81975-c6f5-4dbe-97fe-3f43a2af199e-kube-api-access-k6hsp\") pod \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\" (UID: \"8df81975-c6f5-4dbe-97fe-3f43a2af199e\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431898 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sfzjr\" (UniqueName: \"kubernetes.io/projected/9573d9d4-9862-4168-9179-fe1d79caa092-kube-api-access-sfzjr\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431915 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431925 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431934 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9573d9d4-9862-4168-9179-fe1d79caa092-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.431942 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.433553 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8df81975-c6f5-4dbe-97fe-3f43a2af199e-logs" (OuterVolumeSpecName: "logs") pod "8df81975-c6f5-4dbe-97fe-3f43a2af199e" (UID: "8df81975-c6f5-4dbe-97fe-3f43a2af199e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.438508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df81975-c6f5-4dbe-97fe-3f43a2af199e-kube-api-access-k6hsp" (OuterVolumeSpecName: "kube-api-access-k6hsp") pod "8df81975-c6f5-4dbe-97fe-3f43a2af199e" (UID: "8df81975-c6f5-4dbe-97fe-3f43a2af199e"). InnerVolumeSpecName "kube-api-access-k6hsp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.469400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-config-data" (OuterVolumeSpecName: "config-data") pod "8df81975-c6f5-4dbe-97fe-3f43a2af199e" (UID: "8df81975-c6f5-4dbe-97fe-3f43a2af199e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.470394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.476585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-config-data" (OuterVolumeSpecName: "config-data") pod "9573d9d4-9862-4168-9179-fe1d79caa092" (UID: "9573d9d4-9862-4168-9179-fe1d79caa092"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.479068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8df81975-c6f5-4dbe-97fe-3f43a2af199e" (UID: "8df81975-c6f5-4dbe-97fe-3f43a2af199e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.533514 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.533985 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8df81975-c6f5-4dbe-97fe-3f43a2af199e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.534001 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.534015 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8df81975-c6f5-4dbe-97fe-3f43a2af199e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.534029 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9573d9d4-9862-4168-9179-fe1d79caa092-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.534041 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6hsp\" (UniqueName: \"kubernetes.io/projected/8df81975-c6f5-4dbe-97fe-3f43a2af199e-kube-api-access-k6hsp\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.791145 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.943942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnvqk\" (UniqueName: \"kubernetes.io/projected/02eb0820-318f-46ac-97aa-33c4edd3c321-kube-api-access-rnvqk\") pod \"02eb0820-318f-46ac-97aa-33c4edd3c321\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.944023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-config-data\") pod \"02eb0820-318f-46ac-97aa-33c4edd3c321\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.944128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-combined-ca-bundle\") pod \"02eb0820-318f-46ac-97aa-33c4edd3c321\" (UID: \"02eb0820-318f-46ac-97aa-33c4edd3c321\") " Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.950570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02eb0820-318f-46ac-97aa-33c4edd3c321-kube-api-access-rnvqk" (OuterVolumeSpecName: "kube-api-access-rnvqk") pod "02eb0820-318f-46ac-97aa-33c4edd3c321" (UID: "02eb0820-318f-46ac-97aa-33c4edd3c321"). InnerVolumeSpecName "kube-api-access-rnvqk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.972079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "02eb0820-318f-46ac-97aa-33c4edd3c321" (UID: "02eb0820-318f-46ac-97aa-33c4edd3c321"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:23 crc kubenswrapper[4769]: I1121 12:15:23.975395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-config-data" (OuterVolumeSpecName: "config-data") pod "02eb0820-318f-46ac-97aa-33c4edd3c321" (UID: "02eb0820-318f-46ac-97aa-33c4edd3c321"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.046163 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.046226 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eb0820-318f-46ac-97aa-33c4edd3c321-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.046245 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rnvqk\" (UniqueName: \"kubernetes.io/projected/02eb0820-318f-46ac-97aa-33c4edd3c321-kube-api-access-rnvqk\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.192801 4769 generic.go:334] "Generic (PLEG): container finished" podID="02eb0820-318f-46ac-97aa-33c4edd3c321" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" exitCode=0 Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.192866 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.192870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eb0820-318f-46ac-97aa-33c4edd3c321","Type":"ContainerDied","Data":"176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51"} Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.193032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eb0820-318f-46ac-97aa-33c4edd3c321","Type":"ContainerDied","Data":"8d32dcbec489903a5566ce20effd0759fff23eed9b539c10c126bd96b2003570"} Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.193068 4769 scope.go:117] "RemoveContainer" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.196481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8df81975-c6f5-4dbe-97fe-3f43a2af199e","Type":"ContainerDied","Data":"ecefa40ae99cdfbb4c002b510b9166c09d6dcab26296e9be1cd29e581faf5013"} Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.196585 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.196649 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.227916 4769 scope.go:117] "RemoveContainer" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.228251 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51\": container with ID starting with 176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51 not found: ID does not exist" containerID="176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.228301 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51"} err="failed to get container status \"176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51\": rpc error: code = NotFound desc = could not find container \"176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51\": container with ID starting with 176f5db5a4e62a0298a05261679da637372e21107f9e282a2def03fabf36ff51 not found: ID does not exist" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.228330 4769 scope.go:117] "RemoveContainer" containerID="651f3d85ab313fdc41bd9e2e4176c5eb34fdb50d1f004b0c86918d522579ea6b" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.277554 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.277779 4769 scope.go:117] "RemoveContainer" containerID="5b9b9408ca76beed8063bc405070ece5fe4cd62486bf0ef0f46ab5d2808d473d" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.365150 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.381889 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.393634 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.406895 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407635 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-central-agent" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407670 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-central-agent" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407702 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-log" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407712 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-log" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407720 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02eb0820-318f-46ac-97aa-33c4edd3c321" containerName="nova-scheduler-scheduler" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407729 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02eb0820-318f-46ac-97aa-33c4edd3c321" containerName="nova-scheduler-scheduler" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407753 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-api" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-api" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407782 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-notification-agent" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407789 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-notification-agent" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407800 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="sg-core" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407805 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="sg-core" Nov 21 12:15:24 crc kubenswrapper[4769]: E1121 12:15:24.407830 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="proxy-httpd" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.407836 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="proxy-httpd" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408076 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="sg-core" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408090 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-central-agent" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408107 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-log" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408120 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="ceilometer-notification-agent" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408128 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" containerName="proxy-httpd" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408134 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" containerName="nova-api-api" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.408144 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="02eb0820-318f-46ac-97aa-33c4edd3c321" containerName="nova-scheduler-scheduler" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.410489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.417657 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.417858 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.417999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.421603 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.432526 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.434305 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.436676 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.444180 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.457661 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-run-httpd\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-scripts\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/881886fa-d96e-4389-96e4-ebb8d5f1e838-logs\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-config-data\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-log-httpd\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxv6\" (UniqueName: \"kubernetes.io/projected/0f653701-930c-406d-a859-6fc376da33d0-kube-api-access-mlxv6\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxqkk\" (UniqueName: \"kubernetes.io/projected/881886fa-d96e-4389-96e4-ebb8d5f1e838-kube-api-access-qxqkk\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-config-data\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.468770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.477367 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.479414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.482121 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.489345 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.539632 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.539725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qxqkk\" (UniqueName: \"kubernetes.io/projected/881886fa-d96e-4389-96e4-ebb8d5f1e838-kube-api-access-qxqkk\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-config-data\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-run-httpd\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-scripts\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570637 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/881886fa-d96e-4389-96e4-ebb8d5f1e838-logs\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570652 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-config-data\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570675 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-log-httpd\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-config-data\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxv6\" (UniqueName: \"kubernetes.io/projected/0f653701-930c-406d-a859-6fc376da33d0-kube-api-access-mlxv6\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.570809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46vt\" (UniqueName: \"kubernetes.io/projected/3132aad7-de3d-4b2c-b661-9dadc7149047-kube-api-access-r46vt\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.571127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-run-httpd\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.571283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/881886fa-d96e-4389-96e4-ebb8d5f1e838-logs\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.571464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-log-httpd\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.575239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-config-data\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.584523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.584724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-scripts\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.584811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.585306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-config-data\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.586322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.589572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.591531 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxqkk\" (UniqueName: \"kubernetes.io/projected/881886fa-d96e-4389-96e4-ebb8d5f1e838-kube-api-access-qxqkk\") pod \"nova-api-0\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.592626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxv6\" (UniqueName: \"kubernetes.io/projected/0f653701-930c-406d-a859-6fc376da33d0-kube-api-access-mlxv6\") pod \"ceilometer-0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.672592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-config-data\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.672633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.672681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r46vt\" (UniqueName: \"kubernetes.io/projected/3132aad7-de3d-4b2c-b661-9dadc7149047-kube-api-access-r46vt\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.676048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.676298 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-config-data\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.688702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46vt\" (UniqueName: \"kubernetes.io/projected/3132aad7-de3d-4b2c-b661-9dadc7149047-kube-api-access-r46vt\") pod \"nova-scheduler-0\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.781704 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.802616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:24 crc kubenswrapper[4769]: I1121 12:15:24.807503 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:25 crc kubenswrapper[4769]: I1121 12:15:25.291231 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02eb0820-318f-46ac-97aa-33c4edd3c321" path="/var/lib/kubelet/pods/02eb0820-318f-46ac-97aa-33c4edd3c321/volumes" Nov 21 12:15:25 crc kubenswrapper[4769]: I1121 12:15:25.292749 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df81975-c6f5-4dbe-97fe-3f43a2af199e" path="/var/lib/kubelet/pods/8df81975-c6f5-4dbe-97fe-3f43a2af199e/volumes" Nov 21 12:15:25 crc kubenswrapper[4769]: I1121 12:15:25.293574 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9573d9d4-9862-4168-9179-fe1d79caa092" path="/var/lib/kubelet/pods/9573d9d4-9862-4168-9179-fe1d79caa092/volumes" Nov 21 12:15:25 crc kubenswrapper[4769]: I1121 12:15:25.334644 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:25 crc kubenswrapper[4769]: W1121 12:15:25.335761 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f653701_930c_406d_a859_6fc376da33d0.slice/crio-9f76210797c61801831debd9e89af786184956f11fed24a39ee87da354931917 WatchSource:0}: Error finding container 9f76210797c61801831debd9e89af786184956f11fed24a39ee87da354931917: Status 404 returned error can't find the container with id 9f76210797c61801831debd9e89af786184956f11fed24a39ee87da354931917 Nov 21 12:15:25 crc kubenswrapper[4769]: I1121 12:15:25.397354 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:15:25 crc kubenswrapper[4769]: I1121 12:15:25.407396 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:25 crc kubenswrapper[4769]: W1121 12:15:25.409119 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod881886fa_d96e_4389_96e4_ebb8d5f1e838.slice/crio-c864e6961c2bee7a79c261e0c4e1840bb4461e4028641f5ba29ea3b6cd02d60c WatchSource:0}: Error finding container c864e6961c2bee7a79c261e0c4e1840bb4461e4028641f5ba29ea3b6cd02d60c: Status 404 returned error can't find the container with id c864e6961c2bee7a79c261e0c4e1840bb4461e4028641f5ba29ea3b6cd02d60c Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.224223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerStarted","Data":"245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.224700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerStarted","Data":"9f76210797c61801831debd9e89af786184956f11fed24a39ee87da354931917"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.227128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3132aad7-de3d-4b2c-b661-9dadc7149047","Type":"ContainerStarted","Data":"e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.227154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3132aad7-de3d-4b2c-b661-9dadc7149047","Type":"ContainerStarted","Data":"5450f21577d3a2f3a93db036027e2bb0e19e1e4592e8bf2cf45ed49f46c94c7d"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.250067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"881886fa-d96e-4389-96e4-ebb8d5f1e838","Type":"ContainerStarted","Data":"b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.250123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"881886fa-d96e-4389-96e4-ebb8d5f1e838","Type":"ContainerStarted","Data":"2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.250136 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"881886fa-d96e-4389-96e4-ebb8d5f1e838","Type":"ContainerStarted","Data":"c864e6961c2bee7a79c261e0c4e1840bb4461e4028641f5ba29ea3b6cd02d60c"} Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.291783 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.291749913 podStartE2EDuration="2.291749913s" podCreationTimestamp="2025-11-21 12:15:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:26.263512284 +0000 UTC m=+1484.964174102" watchObservedRunningTime="2025-11-21 12:15:26.291749913 +0000 UTC m=+1484.992411731" Nov 21 12:15:26 crc kubenswrapper[4769]: I1121 12:15:26.313055 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.313027773 podStartE2EDuration="2.313027773s" podCreationTimestamp="2025-11-21 12:15:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:26.289385319 +0000 UTC m=+1484.990047137" watchObservedRunningTime="2025-11-21 12:15:26.313027773 +0000 UTC m=+1485.013689591" Nov 21 12:15:27 crc kubenswrapper[4769]: I1121 12:15:27.264072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerStarted","Data":"ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952"} Nov 21 12:15:28 crc kubenswrapper[4769]: I1121 12:15:28.275182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerStarted","Data":"6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482"} Nov 21 12:15:29 crc kubenswrapper[4769]: I1121 12:15:29.539460 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:29 crc kubenswrapper[4769]: I1121 12:15:29.546448 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:29 crc kubenswrapper[4769]: I1121 12:15:29.808295 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.316506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerStarted","Data":"fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55"} Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.319298 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.341403 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.8396432969999998 podStartE2EDuration="6.341377834s" podCreationTimestamp="2025-11-21 12:15:24 +0000 UTC" firstStartedPulling="2025-11-21 12:15:25.339890422 +0000 UTC m=+1484.040552240" lastFinishedPulling="2025-11-21 12:15:29.841624959 +0000 UTC m=+1488.542286777" observedRunningTime="2025-11-21 12:15:30.339335149 +0000 UTC m=+1489.039996967" watchObservedRunningTime="2025-11-21 12:15:30.341377834 +0000 UTC m=+1489.042039662" Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.469865 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.551424 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.177:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.551571 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.177:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:15:30 crc kubenswrapper[4769]: I1121 12:15:30.954680 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:15:34 crc kubenswrapper[4769]: I1121 12:15:34.804016 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:34 crc kubenswrapper[4769]: I1121 12:15:34.804615 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:34 crc kubenswrapper[4769]: I1121 12:15:34.807904 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:34 crc kubenswrapper[4769]: I1121 12:15:34.841286 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:35 crc kubenswrapper[4769]: I1121 12:15:35.384571 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:15:35 crc kubenswrapper[4769]: I1121 12:15:35.885477 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.181:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:15:35 crc kubenswrapper[4769]: I1121 12:15:35.885625 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.181:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:15:39 crc kubenswrapper[4769]: I1121 12:15:39.545331 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:39 crc kubenswrapper[4769]: I1121 12:15:39.547160 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:39 crc kubenswrapper[4769]: I1121 12:15:39.553992 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:40 crc kubenswrapper[4769]: I1121 12:15:40.417980 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:15:42 crc kubenswrapper[4769]: I1121 12:15:42.438603 4769 generic.go:334] "Generic (PLEG): container finished" podID="6e17fd08-5569-4991-8fe8-606260cec6c7" containerID="82819600c58a2bcf5dc9aff4f2203a869968a5924885e1835b462d6e5884871d" exitCode=137 Nov 21 12:15:42 crc kubenswrapper[4769]: I1121 12:15:42.438696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6e17fd08-5569-4991-8fe8-606260cec6c7","Type":"ContainerDied","Data":"82819600c58a2bcf5dc9aff4f2203a869968a5924885e1835b462d6e5884871d"} Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.182181 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.375293 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-config-data\") pod \"6e17fd08-5569-4991-8fe8-606260cec6c7\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.376006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-combined-ca-bundle\") pod \"6e17fd08-5569-4991-8fe8-606260cec6c7\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.376164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkdks\" (UniqueName: \"kubernetes.io/projected/6e17fd08-5569-4991-8fe8-606260cec6c7-kube-api-access-pkdks\") pod \"6e17fd08-5569-4991-8fe8-606260cec6c7\" (UID: \"6e17fd08-5569-4991-8fe8-606260cec6c7\") " Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.381090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e17fd08-5569-4991-8fe8-606260cec6c7-kube-api-access-pkdks" (OuterVolumeSpecName: "kube-api-access-pkdks") pod "6e17fd08-5569-4991-8fe8-606260cec6c7" (UID: "6e17fd08-5569-4991-8fe8-606260cec6c7"). InnerVolumeSpecName "kube-api-access-pkdks". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.401803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-config-data" (OuterVolumeSpecName: "config-data") pod "6e17fd08-5569-4991-8fe8-606260cec6c7" (UID: "6e17fd08-5569-4991-8fe8-606260cec6c7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.402727 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e17fd08-5569-4991-8fe8-606260cec6c7" (UID: "6e17fd08-5569-4991-8fe8-606260cec6c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.452084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"6e17fd08-5569-4991-8fe8-606260cec6c7","Type":"ContainerDied","Data":"88bc6c72e6d5a519290e8202ca93b8d64c9c8ab4564165d3fb18f3467bb828ce"} Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.452143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.452159 4769 scope.go:117] "RemoveContainer" containerID="82819600c58a2bcf5dc9aff4f2203a869968a5924885e1835b462d6e5884871d" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.479061 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.479127 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pkdks\" (UniqueName: \"kubernetes.io/projected/6e17fd08-5569-4991-8fe8-606260cec6c7-kube-api-access-pkdks\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.479148 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e17fd08-5569-4991-8fe8-606260cec6c7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.508461 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.523641 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.542438 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:43 crc kubenswrapper[4769]: E1121 12:15:43.543051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e17fd08-5569-4991-8fe8-606260cec6c7" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.543070 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e17fd08-5569-4991-8fe8-606260cec6c7" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.543314 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e17fd08-5569-4991-8fe8-606260cec6c7" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.544230 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.549142 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.549291 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.550629 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.551262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.682840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.682915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.683011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hjm\" (UniqueName: \"kubernetes.io/projected/4bac9dbe-2e92-4161-94cf-5f11f3762e00-kube-api-access-68hjm\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.683057 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.683082 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.785032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68hjm\" (UniqueName: \"kubernetes.io/projected/4bac9dbe-2e92-4161-94cf-5f11f3762e00-kube-api-access-68hjm\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.785105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.785142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.785233 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.785274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.790302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.790312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.790685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.793473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.810326 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hjm\" (UniqueName: \"kubernetes.io/projected/4bac9dbe-2e92-4161-94cf-5f11f3762e00-kube-api-access-68hjm\") pod \"nova-cell1-novncproxy-0\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:43 crc kubenswrapper[4769]: I1121 12:15:43.868516 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:44 crc kubenswrapper[4769]: I1121 12:15:44.358684 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:15:44 crc kubenswrapper[4769]: I1121 12:15:44.469161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bac9dbe-2e92-4161-94cf-5f11f3762e00","Type":"ContainerStarted","Data":"7b8f715d4018c20a42727ca0d430abd233e5731d817b85fed71d6eb938b42325"} Nov 21 12:15:44 crc kubenswrapper[4769]: I1121 12:15:44.809321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:44 crc kubenswrapper[4769]: I1121 12:15:44.810008 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:44 crc kubenswrapper[4769]: I1121 12:15:44.810822 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:44 crc kubenswrapper[4769]: I1121 12:15:44.817537 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:45 crc kubenswrapper[4769]: I1121 12:15:45.287084 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e17fd08-5569-4991-8fe8-606260cec6c7" path="/var/lib/kubelet/pods/6e17fd08-5569-4991-8fe8-606260cec6c7/volumes" Nov 21 12:15:45 crc kubenswrapper[4769]: I1121 12:15:45.486615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bac9dbe-2e92-4161-94cf-5f11f3762e00","Type":"ContainerStarted","Data":"1c992025fa044e59a758248ad17a279a740364afa4ded1df7466a7f0844e4282"} Nov 21 12:15:45 crc kubenswrapper[4769]: I1121 12:15:45.487315 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:45 crc kubenswrapper[4769]: I1121 12:15:45.492047 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:45 crc kubenswrapper[4769]: I1121 12:15:45.515791 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.515754393 podStartE2EDuration="2.515754393s" podCreationTimestamp="2025-11-21 12:15:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:45.503787101 +0000 UTC m=+1504.204448929" watchObservedRunningTime="2025-11-21 12:15:45.515754393 +0000 UTC m=+1504.216416231" Nov 21 12:15:47 crc kubenswrapper[4769]: I1121 12:15:47.441694 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:47 crc kubenswrapper[4769]: I1121 12:15:47.442596 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-central-agent" containerID="cri-o://245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca" gracePeriod=30 Nov 21 12:15:47 crc kubenswrapper[4769]: I1121 12:15:47.442756 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="proxy-httpd" containerID="cri-o://fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55" gracePeriod=30 Nov 21 12:15:47 crc kubenswrapper[4769]: I1121 12:15:47.442797 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="sg-core" containerID="cri-o://6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482" gracePeriod=30 Nov 21 12:15:47 crc kubenswrapper[4769]: I1121 12:15:47.442834 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-notification-agent" containerID="cri-o://ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952" gracePeriod=30 Nov 21 12:15:47 crc kubenswrapper[4769]: I1121 12:15:47.449096 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.180:3000/\": EOF" Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.415667 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.519693 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f653701-930c-406d-a859-6fc376da33d0" containerID="fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55" exitCode=0 Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.519753 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f653701-930c-406d-a859-6fc376da33d0" containerID="6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482" exitCode=2 Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.519769 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f653701-930c-406d-a859-6fc376da33d0" containerID="245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca" exitCode=0 Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.519793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerDied","Data":"fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55"} Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.519867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerDied","Data":"6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482"} Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.519880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerDied","Data":"245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca"} Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.520077 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-log" containerID="cri-o://2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103" gracePeriod=30 Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.520290 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-api" containerID="cri-o://b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59" gracePeriod=30 Nov 21 12:15:48 crc kubenswrapper[4769]: I1121 12:15:48.869505 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:49 crc kubenswrapper[4769]: I1121 12:15:49.530413 4769 generic.go:334] "Generic (PLEG): container finished" podID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerID="2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103" exitCode=143 Nov 21 12:15:49 crc kubenswrapper[4769]: I1121 12:15:49.530654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"881886fa-d96e-4389-96e4-ebb8d5f1e838","Type":"ContainerDied","Data":"2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103"} Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.414220 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.561836 4769 generic.go:334] "Generic (PLEG): container finished" podID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerID="b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59" exitCode=0 Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.561905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"881886fa-d96e-4389-96e4-ebb8d5f1e838","Type":"ContainerDied","Data":"b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59"} Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.562166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"881886fa-d96e-4389-96e4-ebb8d5f1e838","Type":"ContainerDied","Data":"c864e6961c2bee7a79c261e0c4e1840bb4461e4028641f5ba29ea3b6cd02d60c"} Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.561963 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.562291 4769 scope.go:117] "RemoveContainer" containerID="b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.578386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-config-data\") pod \"881886fa-d96e-4389-96e4-ebb8d5f1e838\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.578797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-combined-ca-bundle\") pod \"881886fa-d96e-4389-96e4-ebb8d5f1e838\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.578931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxqkk\" (UniqueName: \"kubernetes.io/projected/881886fa-d96e-4389-96e4-ebb8d5f1e838-kube-api-access-qxqkk\") pod \"881886fa-d96e-4389-96e4-ebb8d5f1e838\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.579060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/881886fa-d96e-4389-96e4-ebb8d5f1e838-logs\") pod \"881886fa-d96e-4389-96e4-ebb8d5f1e838\" (UID: \"881886fa-d96e-4389-96e4-ebb8d5f1e838\") " Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.579486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881886fa-d96e-4389-96e4-ebb8d5f1e838-logs" (OuterVolumeSpecName: "logs") pod "881886fa-d96e-4389-96e4-ebb8d5f1e838" (UID: "881886fa-d96e-4389-96e4-ebb8d5f1e838"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.590229 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881886fa-d96e-4389-96e4-ebb8d5f1e838-kube-api-access-qxqkk" (OuterVolumeSpecName: "kube-api-access-qxqkk") pod "881886fa-d96e-4389-96e4-ebb8d5f1e838" (UID: "881886fa-d96e-4389-96e4-ebb8d5f1e838"). InnerVolumeSpecName "kube-api-access-qxqkk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.592631 4769 scope.go:117] "RemoveContainer" containerID="2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.607355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "881886fa-d96e-4389-96e4-ebb8d5f1e838" (UID: "881886fa-d96e-4389-96e4-ebb8d5f1e838"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.617062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-config-data" (OuterVolumeSpecName: "config-data") pod "881886fa-d96e-4389-96e4-ebb8d5f1e838" (UID: "881886fa-d96e-4389-96e4-ebb8d5f1e838"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.675441 4769 scope.go:117] "RemoveContainer" containerID="b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59" Nov 21 12:15:52 crc kubenswrapper[4769]: E1121 12:15:52.676008 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59\": container with ID starting with b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59 not found: ID does not exist" containerID="b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.676072 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59"} err="failed to get container status \"b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59\": rpc error: code = NotFound desc = could not find container \"b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59\": container with ID starting with b364aa50cdc4f4aeca7d49b5f8335df152026786256b68f35d540ded2f50eb59 not found: ID does not exist" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.676110 4769 scope.go:117] "RemoveContainer" containerID="2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103" Nov 21 12:15:52 crc kubenswrapper[4769]: E1121 12:15:52.676561 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103\": container with ID starting with 2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103 not found: ID does not exist" containerID="2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.676603 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103"} err="failed to get container status \"2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103\": rpc error: code = NotFound desc = could not find container \"2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103\": container with ID starting with 2e7a3331a07522feda0ec5e09a872093121ce7c5399bb06e14d4df067b812103 not found: ID does not exist" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.680999 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qxqkk\" (UniqueName: \"kubernetes.io/projected/881886fa-d96e-4389-96e4-ebb8d5f1e838-kube-api-access-qxqkk\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.681036 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/881886fa-d96e-4389-96e4-ebb8d5f1e838-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.681052 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.681065 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/881886fa-d96e-4389-96e4-ebb8d5f1e838-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.922793 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.959404 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.979890 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:52 crc kubenswrapper[4769]: E1121 12:15:52.982116 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-api" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.982316 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-api" Nov 21 12:15:52 crc kubenswrapper[4769]: E1121 12:15:52.983703 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-log" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.983738 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-log" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.984546 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-api" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.984583 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" containerName="nova-api-log" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.985797 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.989716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.989873 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:15:52 crc kubenswrapper[4769]: I1121 12:15:52.990006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.022339 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.086415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-config-data\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.086553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25caa86e-b566-4ca9-b573-45fedb43a879-logs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.086632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-internal-tls-certs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.086676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-public-tls-certs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.086718 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9vtw\" (UniqueName: \"kubernetes.io/projected/25caa86e-b566-4ca9-b573-45fedb43a879-kube-api-access-q9vtw\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.086756 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.181604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.187889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-internal-tls-certs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.187941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-public-tls-certs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.187993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q9vtw\" (UniqueName: \"kubernetes.io/projected/25caa86e-b566-4ca9-b573-45fedb43a879-kube-api-access-q9vtw\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.189168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.189242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-config-data\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.189318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25caa86e-b566-4ca9-b573-45fedb43a879-logs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.189717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25caa86e-b566-4ca9-b573-45fedb43a879-logs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.193559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-public-tls-certs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.195451 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.195567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-internal-tls-certs\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.196302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-config-data\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.208811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9vtw\" (UniqueName: \"kubernetes.io/projected/25caa86e-b566-4ca9-b573-45fedb43a879-kube-api-access-q9vtw\") pod \"nova-api-0\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-config-data\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlxv6\" (UniqueName: \"kubernetes.io/projected/0f653701-930c-406d-a859-6fc376da33d0-kube-api-access-mlxv6\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-sg-core-conf-yaml\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-log-httpd\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-combined-ca-bundle\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-ceilometer-tls-certs\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-scripts\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.290568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-run-httpd\") pod \"0f653701-930c-406d-a859-6fc376da33d0\" (UID: \"0f653701-930c-406d-a859-6fc376da33d0\") " Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.291565 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="881886fa-d96e-4389-96e4-ebb8d5f1e838" path="/var/lib/kubelet/pods/881886fa-d96e-4389-96e4-ebb8d5f1e838/volumes" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.291741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.293068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.300613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f653701-930c-406d-a859-6fc376da33d0-kube-api-access-mlxv6" (OuterVolumeSpecName: "kube-api-access-mlxv6") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "kube-api-access-mlxv6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.305944 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.309504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-scripts" (OuterVolumeSpecName: "scripts") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.326345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.364212 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.396433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397395 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397427 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397437 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397473 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397485 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mlxv6\" (UniqueName: \"kubernetes.io/projected/0f653701-930c-406d-a859-6fc376da33d0-kube-api-access-mlxv6\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397499 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.397507 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0f653701-930c-406d-a859-6fc376da33d0-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.411101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-config-data" (OuterVolumeSpecName: "config-data") pod "0f653701-930c-406d-a859-6fc376da33d0" (UID: "0f653701-930c-406d-a859-6fc376da33d0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.499898 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f653701-930c-406d-a859-6fc376da33d0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.573739 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f653701-930c-406d-a859-6fc376da33d0" containerID="ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952" exitCode=0 Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.573805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerDied","Data":"ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952"} Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.573834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0f653701-930c-406d-a859-6fc376da33d0","Type":"ContainerDied","Data":"9f76210797c61801831debd9e89af786184956f11fed24a39ee87da354931917"} Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.573852 4769 scope.go:117] "RemoveContainer" containerID="fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.573976 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.618846 4769 scope.go:117] "RemoveContainer" containerID="6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.624159 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.643546 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.655920 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.656383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="sg-core" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656399 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="sg-core" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.656416 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="proxy-httpd" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656424 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="proxy-httpd" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.656446 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-notification-agent" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656453 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-notification-agent" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.656468 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-central-agent" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656474 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-central-agent" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656648 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="sg-core" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656668 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="proxy-httpd" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656683 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-notification-agent" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.656693 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f653701-930c-406d-a859-6fc376da33d0" containerName="ceilometer-central-agent" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.658755 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.660775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.667010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.667449 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.668112 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.670107 4769 scope.go:117] "RemoveContainer" containerID="ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.704642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-scripts\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.704719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.704766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-config-data\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.704800 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-log-httpd\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.704843 4769 scope.go:117] "RemoveContainer" containerID="245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.705131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.705372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.705515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-run-httpd\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.705637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kjm6\" (UniqueName: \"kubernetes.io/projected/b122f86f-b55d-4234-a61e-de0aabcf6760-kube-api-access-7kjm6\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.738858 4769 scope.go:117] "RemoveContainer" containerID="fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.740062 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55\": container with ID starting with fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55 not found: ID does not exist" containerID="fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.740122 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55"} err="failed to get container status \"fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55\": rpc error: code = NotFound desc = could not find container \"fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55\": container with ID starting with fe1068d512a94c6d06a7473f79afc49b2b3f9da19bdca7d068cf040f84a50c55 not found: ID does not exist" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.740167 4769 scope.go:117] "RemoveContainer" containerID="6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.740725 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482\": container with ID starting with 6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482 not found: ID does not exist" containerID="6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.740771 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482"} err="failed to get container status \"6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482\": rpc error: code = NotFound desc = could not find container \"6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482\": container with ID starting with 6c72ca6083ce6932d8697d41bf076a1c24e5b230f8a386231a57cefcae1d1482 not found: ID does not exist" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.740800 4769 scope.go:117] "RemoveContainer" containerID="ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.741212 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952\": container with ID starting with ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952 not found: ID does not exist" containerID="ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.741266 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952"} err="failed to get container status \"ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952\": rpc error: code = NotFound desc = could not find container \"ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952\": container with ID starting with ab59d4f7684a0f9ce990f47d367ac6d1a74b8c22277882923bac01a8d09b7952 not found: ID does not exist" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.741329 4769 scope.go:117] "RemoveContainer" containerID="245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca" Nov 21 12:15:53 crc kubenswrapper[4769]: E1121 12:15:53.741853 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca\": container with ID starting with 245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca not found: ID does not exist" containerID="245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.741882 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca"} err="failed to get container status \"245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca\": rpc error: code = NotFound desc = could not find container \"245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca\": container with ID starting with 245290a39b24d1be6aab895979b98d31f9ac1b4b215ef31976f6314447083aca not found: ID does not exist" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.758561 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-config-data\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-log-httpd\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-run-httpd\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807652 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7kjm6\" (UniqueName: \"kubernetes.io/projected/b122f86f-b55d-4234-a61e-de0aabcf6760-kube-api-access-7kjm6\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-scripts\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.807700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.808124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-log-httpd\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.808437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-run-httpd\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.812339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.813280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.813349 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.813949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-config-data\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.814900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-scripts\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.823577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kjm6\" (UniqueName: \"kubernetes.io/projected/b122f86f-b55d-4234-a61e-de0aabcf6760-kube-api-access-7kjm6\") pod \"ceilometer-0\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.869170 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.889180 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:53 crc kubenswrapper[4769]: I1121 12:15:53.979733 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.458712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.605353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerStarted","Data":"41a9c7d9650adaf65d5bf5b970e26502c2564e4f029c5f297cce95a3d00ae100"} Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.608258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"25caa86e-b566-4ca9-b573-45fedb43a879","Type":"ContainerStarted","Data":"48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a"} Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.608287 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"25caa86e-b566-4ca9-b573-45fedb43a879","Type":"ContainerStarted","Data":"9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169"} Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.608296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"25caa86e-b566-4ca9-b573-45fedb43a879","Type":"ContainerStarted","Data":"b317cd3d6d3c4a552a0f267bac7c20cfa050cadab97866229c6c902b44b1f3da"} Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.629226 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.638821 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.638795478 podStartE2EDuration="2.638795478s" podCreationTimestamp="2025-11-21 12:15:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:54.626696482 +0000 UTC m=+1513.327358300" watchObservedRunningTime="2025-11-21 12:15:54.638795478 +0000 UTC m=+1513.339457296" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.785642 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5"] Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.787109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.792697 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.792969 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.794511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5"] Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.828578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbr2\" (UniqueName: \"kubernetes.io/projected/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-kube-api-access-8xbr2\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.828881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.828986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-config-data\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.829071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-scripts\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.931498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbr2\" (UniqueName: \"kubernetes.io/projected/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-kube-api-access-8xbr2\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.931832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.931994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-scripts\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.932130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-config-data\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.939419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.942266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-scripts\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.952469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbr2\" (UniqueName: \"kubernetes.io/projected/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-kube-api-access-8xbr2\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:54 crc kubenswrapper[4769]: I1121 12:15:54.974374 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-config-data\") pod \"nova-cell1-cell-mapping-w88t5\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:55 crc kubenswrapper[4769]: I1121 12:15:55.112680 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:15:55 crc kubenswrapper[4769]: I1121 12:15:55.285259 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f653701-930c-406d-a859-6fc376da33d0" path="/var/lib/kubelet/pods/0f653701-930c-406d-a859-6fc376da33d0/volumes" Nov 21 12:15:55 crc kubenswrapper[4769]: I1121 12:15:55.610415 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5"] Nov 21 12:15:55 crc kubenswrapper[4769]: I1121 12:15:55.627105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerStarted","Data":"a2645245eb3ee3eebdf7c967d355d80fe90f95b6d3b5e5b4e4c366cab3e140c3"} Nov 21 12:15:56 crc kubenswrapper[4769]: I1121 12:15:56.644082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" event={"ID":"64f9d792-e28f-47fd-bcaf-8ed581a0aae8","Type":"ContainerStarted","Data":"7d04a33c5515df3289f8f6e5eddc0c23b7dfac2466f8dc59d4916be90bc70c65"} Nov 21 12:15:56 crc kubenswrapper[4769]: I1121 12:15:56.645247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" event={"ID":"64f9d792-e28f-47fd-bcaf-8ed581a0aae8","Type":"ContainerStarted","Data":"148f462ac202c7c68ffb5d59e5f17c1649669f0ebdbbc9d1cfd6538081431aa2"} Nov 21 12:15:56 crc kubenswrapper[4769]: I1121 12:15:56.669630 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" podStartSLOduration=2.669601774 podStartE2EDuration="2.669601774s" podCreationTimestamp="2025-11-21 12:15:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:15:56.665546485 +0000 UTC m=+1515.366208303" watchObservedRunningTime="2025-11-21 12:15:56.669601774 +0000 UTC m=+1515.370263602" Nov 21 12:15:57 crc kubenswrapper[4769]: I1121 12:15:57.656804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerStarted","Data":"ac2bffbc71c179a071c576298ebb8e06f11415663fce8e4cbe16de16a4e9665d"} Nov 21 12:15:58 crc kubenswrapper[4769]: I1121 12:15:58.668617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerStarted","Data":"b8b1acb6c3837a3eeb08810f5cd171240f04d4f58c7587bda8aac26e5ee43320"} Nov 21 12:16:00 crc kubenswrapper[4769]: I1121 12:16:00.692383 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerStarted","Data":"39455312801fe2617009399cff2130cf65149aad9326305623cf98c6a2b3a752"} Nov 21 12:16:00 crc kubenswrapper[4769]: I1121 12:16:00.693177 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:16:00 crc kubenswrapper[4769]: I1121 12:16:00.714714 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.069691231 podStartE2EDuration="7.714690482s" podCreationTimestamp="2025-11-21 12:15:53 +0000 UTC" firstStartedPulling="2025-11-21 12:15:54.476382731 +0000 UTC m=+1513.177044549" lastFinishedPulling="2025-11-21 12:16:00.121381982 +0000 UTC m=+1518.822043800" observedRunningTime="2025-11-21 12:16:00.712206856 +0000 UTC m=+1519.412868674" watchObservedRunningTime="2025-11-21 12:16:00.714690482 +0000 UTC m=+1519.415352310" Nov 21 12:16:01 crc kubenswrapper[4769]: I1121 12:16:01.702888 4769 generic.go:334] "Generic (PLEG): container finished" podID="64f9d792-e28f-47fd-bcaf-8ed581a0aae8" containerID="7d04a33c5515df3289f8f6e5eddc0c23b7dfac2466f8dc59d4916be90bc70c65" exitCode=0 Nov 21 12:16:01 crc kubenswrapper[4769]: I1121 12:16:01.704027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" event={"ID":"64f9d792-e28f-47fd-bcaf-8ed581a0aae8","Type":"ContainerDied","Data":"7d04a33c5515df3289f8f6e5eddc0c23b7dfac2466f8dc59d4916be90bc70c65"} Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.185081 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.207547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-config-data\") pod \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.207792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-combined-ca-bundle\") pod \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.207863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xbr2\" (UniqueName: \"kubernetes.io/projected/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-kube-api-access-8xbr2\") pod \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.207909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-scripts\") pod \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\" (UID: \"64f9d792-e28f-47fd-bcaf-8ed581a0aae8\") " Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.215014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-kube-api-access-8xbr2" (OuterVolumeSpecName: "kube-api-access-8xbr2") pod "64f9d792-e28f-47fd-bcaf-8ed581a0aae8" (UID: "64f9d792-e28f-47fd-bcaf-8ed581a0aae8"). InnerVolumeSpecName "kube-api-access-8xbr2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.229230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-scripts" (OuterVolumeSpecName: "scripts") pod "64f9d792-e28f-47fd-bcaf-8ed581a0aae8" (UID: "64f9d792-e28f-47fd-bcaf-8ed581a0aae8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.240495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "64f9d792-e28f-47fd-bcaf-8ed581a0aae8" (UID: "64f9d792-e28f-47fd-bcaf-8ed581a0aae8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.243409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-config-data" (OuterVolumeSpecName: "config-data") pod "64f9d792-e28f-47fd-bcaf-8ed581a0aae8" (UID: "64f9d792-e28f-47fd-bcaf-8ed581a0aae8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.307052 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.307112 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.311681 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.311912 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.311925 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8xbr2\" (UniqueName: \"kubernetes.io/projected/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-kube-api-access-8xbr2\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.311936 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/64f9d792-e28f-47fd-bcaf-8ed581a0aae8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.729818 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" event={"ID":"64f9d792-e28f-47fd-bcaf-8ed581a0aae8","Type":"ContainerDied","Data":"148f462ac202c7c68ffb5d59e5f17c1649669f0ebdbbc9d1cfd6538081431aa2"} Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.729877 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="148f462ac202c7c68ffb5d59e5f17c1649669f0ebdbbc9d1cfd6538081431aa2" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.729975 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.930342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.930676 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3132aad7-de3d-4b2c-b661-9dadc7149047" containerName="nova-scheduler-scheduler" containerID="cri-o://e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" gracePeriod=30 Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.940978 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.941264 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-log" containerID="cri-o://9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169" gracePeriod=30 Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.941425 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-api" containerID="cri-o://48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a" gracePeriod=30 Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.954457 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.184:8774/\": EOF" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.954491 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.184:8774/\": EOF" Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.967330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.967704 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-log" containerID="cri-o://0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff" gracePeriod=30 Nov 21 12:16:03 crc kubenswrapper[4769]: I1121 12:16:03.967750 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-metadata" containerID="cri-o://ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f" gracePeriod=30 Nov 21 12:16:04 crc kubenswrapper[4769]: I1121 12:16:04.741067 4769 generic.go:334] "Generic (PLEG): container finished" podID="25caa86e-b566-4ca9-b573-45fedb43a879" containerID="9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169" exitCode=143 Nov 21 12:16:04 crc kubenswrapper[4769]: I1121 12:16:04.741129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"25caa86e-b566-4ca9-b573-45fedb43a879","Type":"ContainerDied","Data":"9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169"} Nov 21 12:16:04 crc kubenswrapper[4769]: I1121 12:16:04.743045 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerID="0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff" exitCode=143 Nov 21 12:16:04 crc kubenswrapper[4769]: I1121 12:16:04.743093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3","Type":"ContainerDied","Data":"0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff"} Nov 21 12:16:04 crc kubenswrapper[4769]: E1121 12:16:04.809301 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:04 crc kubenswrapper[4769]: E1121 12:16:04.812049 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:04 crc kubenswrapper[4769]: E1121 12:16:04.813994 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:04 crc kubenswrapper[4769]: E1121 12:16:04.814077 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3132aad7-de3d-4b2c-b661-9dadc7149047" containerName="nova-scheduler-scheduler" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.534690 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-mcm8s"] Nov 21 12:16:05 crc kubenswrapper[4769]: E1121 12:16:05.535147 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64f9d792-e28f-47fd-bcaf-8ed581a0aae8" containerName="nova-manage" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.535166 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f9d792-e28f-47fd-bcaf-8ed581a0aae8" containerName="nova-manage" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.535388 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64f9d792-e28f-47fd-bcaf-8ed581a0aae8" containerName="nova-manage" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.536790 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.553002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-catalog-content\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.553103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-utilities\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.553482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr68n\" (UniqueName: \"kubernetes.io/projected/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-kube-api-access-kr68n\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.561253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-mcm8s"] Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.657242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kr68n\" (UniqueName: \"kubernetes.io/projected/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-kube-api-access-kr68n\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.657408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-catalog-content\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.657552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-utilities\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.658357 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-utilities\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.659171 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-catalog-content\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.709803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr68n\" (UniqueName: \"kubernetes.io/projected/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-kube-api-access-kr68n\") pod \"redhat-marketplace-mcm8s\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:05 crc kubenswrapper[4769]: I1121 12:16:05.873901 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:06 crc kubenswrapper[4769]: I1121 12:16:06.425895 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-mcm8s"] Nov 21 12:16:06 crc kubenswrapper[4769]: I1121 12:16:06.770662 4769 generic.go:334] "Generic (PLEG): container finished" podID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerID="5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563" exitCode=0 Nov 21 12:16:06 crc kubenswrapper[4769]: I1121 12:16:06.770712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mcm8s" event={"ID":"2d299f4a-8c85-4ca1-9a89-d113b3fb306a","Type":"ContainerDied","Data":"5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563"} Nov 21 12:16:06 crc kubenswrapper[4769]: I1121 12:16:06.770761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mcm8s" event={"ID":"2d299f4a-8c85-4ca1-9a89-d113b3fb306a","Type":"ContainerStarted","Data":"71f6968a4b7667b08ce3bb28eb28e5f729f1d3a22201c24ce25fe85f1805dda5"} Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.109716 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.177:8775/\": read tcp 10.217.0.2:44170->10.217.0.177:8775: read: connection reset by peer" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.109739 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.177:8775/\": read tcp 10.217.0.2:44168->10.217.0.177:8775: read: connection reset by peer" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.600990 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.703455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-config-data\") pod \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.703549 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-combined-ca-bundle\") pod \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.703654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54kk5\" (UniqueName: \"kubernetes.io/projected/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-kube-api-access-54kk5\") pod \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.703840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-logs\") pod \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.703901 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-nova-metadata-tls-certs\") pod \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\" (UID: \"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3\") " Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.704633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-logs" (OuterVolumeSpecName: "logs") pod "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" (UID: "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.711877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-kube-api-access-54kk5" (OuterVolumeSpecName: "kube-api-access-54kk5") pod "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" (UID: "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3"). InnerVolumeSpecName "kube-api-access-54kk5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.736858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" (UID: "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.737581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-config-data" (OuterVolumeSpecName: "config-data") pod "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" (UID: "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.759625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" (UID: "9b874256-f8fb-4023-83a1-f3ed5fcf8ab3"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.787131 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerID="ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f" exitCode=0 Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.787299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3","Type":"ContainerDied","Data":"ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f"} Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.787351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9b874256-f8fb-4023-83a1-f3ed5fcf8ab3","Type":"ContainerDied","Data":"c82dc437864da95c4640fb94662e2399437bff8b411ba85ed0cc90969b1dbffe"} Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.787440 4769 scope.go:117] "RemoveContainer" containerID="ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.787773 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.797658 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mcm8s" event={"ID":"2d299f4a-8c85-4ca1-9a89-d113b3fb306a","Type":"ContainerDied","Data":"55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c"} Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.797866 4769 generic.go:334] "Generic (PLEG): container finished" podID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerID="55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c" exitCode=0 Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.806729 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.806774 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.806791 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.806804 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.806818 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-54kk5\" (UniqueName: \"kubernetes.io/projected/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3-kube-api-access-54kk5\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.826308 4769 scope.go:117] "RemoveContainer" containerID="0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.842712 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.851889 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.856512 4769 scope.go:117] "RemoveContainer" containerID="ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f" Nov 21 12:16:07 crc kubenswrapper[4769]: E1121 12:16:07.856996 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f\": container with ID starting with ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f not found: ID does not exist" containerID="ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.857034 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f"} err="failed to get container status \"ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f\": rpc error: code = NotFound desc = could not find container \"ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f\": container with ID starting with ee7ecb2c194274c7e19547b59d15cae5c73fb1ead93784fbc95b14b87426cc8f not found: ID does not exist" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.857062 4769 scope.go:117] "RemoveContainer" containerID="0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff" Nov 21 12:16:07 crc kubenswrapper[4769]: E1121 12:16:07.862144 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff\": container with ID starting with 0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff not found: ID does not exist" containerID="0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.862427 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff"} err="failed to get container status \"0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff\": rpc error: code = NotFound desc = could not find container \"0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff\": container with ID starting with 0c27859b64dc1e7904fb68398a5c2be6f40efec2c91c7cd663283969012811ff not found: ID does not exist" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.877422 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:07 crc kubenswrapper[4769]: E1121 12:16:07.878113 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-log" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.878140 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-log" Nov 21 12:16:07 crc kubenswrapper[4769]: E1121 12:16:07.878173 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-metadata" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.878182 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-metadata" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.880296 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-metadata" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.880318 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" containerName="nova-metadata-log" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.881942 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.884781 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.885278 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.894625 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.917721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.917813 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9419c5db-b98d-44e8-a7f5-852229976f84-logs\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.917857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-config-data\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.917911 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.917951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-959j2\" (UniqueName: \"kubernetes.io/projected/9419c5db-b98d-44e8-a7f5-852229976f84-kube-api-access-959j2\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.955767 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-tmdd8"] Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.958375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:07 crc kubenswrapper[4769]: I1121 12:16:07.969927 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-tmdd8"] Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvkm6\" (UniqueName: \"kubernetes.io/projected/01a80d77-12ee-415e-8472-0ad9e6a5611f-kube-api-access-kvkm6\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9419c5db-b98d-44e8-a7f5-852229976f84-logs\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-config-data\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-959j2\" (UniqueName: \"kubernetes.io/projected/9419c5db-b98d-44e8-a7f5-852229976f84-kube-api-access-959j2\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-catalog-content\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-utilities\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.020388 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.021220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9419c5db-b98d-44e8-a7f5-852229976f84-logs\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.025361 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.025632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.026278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-config-data\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.038094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-959j2\" (UniqueName: \"kubernetes.io/projected/9419c5db-b98d-44e8-a7f5-852229976f84-kube-api-access-959j2\") pod \"nova-metadata-0\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.123132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-catalog-content\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.123668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-utilities\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.123786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvkm6\" (UniqueName: \"kubernetes.io/projected/01a80d77-12ee-415e-8472-0ad9e6a5611f-kube-api-access-kvkm6\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.124383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-utilities\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.126226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-catalog-content\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.143404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvkm6\" (UniqueName: \"kubernetes.io/projected/01a80d77-12ee-415e-8472-0ad9e6a5611f-kube-api-access-kvkm6\") pod \"certified-operators-tmdd8\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.225423 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.277506 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.808878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mcm8s" event={"ID":"2d299f4a-8c85-4ca1-9a89-d113b3fb306a","Type":"ContainerStarted","Data":"a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b"} Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.834855 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-mcm8s" podStartSLOduration=2.3880668 podStartE2EDuration="3.834835395s" podCreationTimestamp="2025-11-21 12:16:05 +0000 UTC" firstStartedPulling="2025-11-21 12:16:06.77280592 +0000 UTC m=+1525.473467738" lastFinishedPulling="2025-11-21 12:16:08.219574515 +0000 UTC m=+1526.920236333" observedRunningTime="2025-11-21 12:16:08.82684079 +0000 UTC m=+1527.527502608" watchObservedRunningTime="2025-11-21 12:16:08.834835395 +0000 UTC m=+1527.535497213" Nov 21 12:16:08 crc kubenswrapper[4769]: W1121 12:16:08.841331 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9419c5db_b98d_44e8_a7f5_852229976f84.slice/crio-da82e76dd7554e8e3d1e0435d59e6b0cc052ae998aedf26f5ee5d0d942152866 WatchSource:0}: Error finding container da82e76dd7554e8e3d1e0435d59e6b0cc052ae998aedf26f5ee5d0d942152866: Status 404 returned error can't find the container with id da82e76dd7554e8e3d1e0435d59e6b0cc052ae998aedf26f5ee5d0d942152866 Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.848363 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:08 crc kubenswrapper[4769]: I1121 12:16:08.945892 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-tmdd8"] Nov 21 12:16:08 crc kubenswrapper[4769]: W1121 12:16:08.955868 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a80d77_12ee_415e_8472_0ad9e6a5611f.slice/crio-078225ba473f2f87b54e6030a23aee939e22df1c3e2f1fb0e0a7de97a10e1ca1 WatchSource:0}: Error finding container 078225ba473f2f87b54e6030a23aee939e22df1c3e2f1fb0e0a7de97a10e1ca1: Status 404 returned error can't find the container with id 078225ba473f2f87b54e6030a23aee939e22df1c3e2f1fb0e0a7de97a10e1ca1 Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.289062 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b874256-f8fb-4023-83a1-f3ed5fcf8ab3" path="/var/lib/kubelet/pods/9b874256-f8fb-4023-83a1-f3ed5fcf8ab3/volumes" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.472372 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.653516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r46vt\" (UniqueName: \"kubernetes.io/projected/3132aad7-de3d-4b2c-b661-9dadc7149047-kube-api-access-r46vt\") pod \"3132aad7-de3d-4b2c-b661-9dadc7149047\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.653611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-combined-ca-bundle\") pod \"3132aad7-de3d-4b2c-b661-9dadc7149047\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.653635 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-config-data\") pod \"3132aad7-de3d-4b2c-b661-9dadc7149047\" (UID: \"3132aad7-de3d-4b2c-b661-9dadc7149047\") " Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.661017 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3132aad7-de3d-4b2c-b661-9dadc7149047-kube-api-access-r46vt" (OuterVolumeSpecName: "kube-api-access-r46vt") pod "3132aad7-de3d-4b2c-b661-9dadc7149047" (UID: "3132aad7-de3d-4b2c-b661-9dadc7149047"). InnerVolumeSpecName "kube-api-access-r46vt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.687248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3132aad7-de3d-4b2c-b661-9dadc7149047" (UID: "3132aad7-de3d-4b2c-b661-9dadc7149047"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.704309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-config-data" (OuterVolumeSpecName: "config-data") pod "3132aad7-de3d-4b2c-b661-9dadc7149047" (UID: "3132aad7-de3d-4b2c-b661-9dadc7149047"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.755555 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r46vt\" (UniqueName: \"kubernetes.io/projected/3132aad7-de3d-4b2c-b661-9dadc7149047-kube-api-access-r46vt\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.755601 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.755620 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3132aad7-de3d-4b2c-b661-9dadc7149047-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.818443 4769 generic.go:334] "Generic (PLEG): container finished" podID="3132aad7-de3d-4b2c-b661-9dadc7149047" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" exitCode=0 Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.818495 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.818490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3132aad7-de3d-4b2c-b661-9dadc7149047","Type":"ContainerDied","Data":"e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.818668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3132aad7-de3d-4b2c-b661-9dadc7149047","Type":"ContainerDied","Data":"5450f21577d3a2f3a93db036027e2bb0e19e1e4592e8bf2cf45ed49f46c94c7d"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.818715 4769 scope.go:117] "RemoveContainer" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.821251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9419c5db-b98d-44e8-a7f5-852229976f84","Type":"ContainerStarted","Data":"71bd808cf3109c1c57b0c47ebd57d285135d128165fac4321818df4e0501aba3"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.821294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9419c5db-b98d-44e8-a7f5-852229976f84","Type":"ContainerStarted","Data":"f7d252944da608511b8a454df97267561b5e6a9bdda0ea69140ef1eebb7bda82"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.821306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9419c5db-b98d-44e8-a7f5-852229976f84","Type":"ContainerStarted","Data":"da82e76dd7554e8e3d1e0435d59e6b0cc052ae998aedf26f5ee5d0d942152866"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.824742 4769 generic.go:334] "Generic (PLEG): container finished" podID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerID="b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84" exitCode=0 Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.824835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerDied","Data":"b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.824869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerStarted","Data":"078225ba473f2f87b54e6030a23aee939e22df1c3e2f1fb0e0a7de97a10e1ca1"} Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.850787 4769 scope.go:117] "RemoveContainer" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.850938 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.850914952 podStartE2EDuration="2.850914952s" podCreationTimestamp="2025-11-21 12:16:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:09.842693091 +0000 UTC m=+1528.543354929" watchObservedRunningTime="2025-11-21 12:16:09.850914952 +0000 UTC m=+1528.551576770" Nov 21 12:16:09 crc kubenswrapper[4769]: E1121 12:16:09.852409 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574\": container with ID starting with e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574 not found: ID does not exist" containerID="e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.852457 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574"} err="failed to get container status \"e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574\": rpc error: code = NotFound desc = could not find container \"e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574\": container with ID starting with e162113baad6669993cab7e71aec8eab8dfb0a77e5188c97098718f3d33df574 not found: ID does not exist" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.871235 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.881782 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.893737 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:09 crc kubenswrapper[4769]: E1121 12:16:09.894271 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3132aad7-de3d-4b2c-b661-9dadc7149047" containerName="nova-scheduler-scheduler" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.894289 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3132aad7-de3d-4b2c-b661-9dadc7149047" containerName="nova-scheduler-scheduler" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.894515 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3132aad7-de3d-4b2c-b661-9dadc7149047" containerName="nova-scheduler-scheduler" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.895235 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.897698 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.921233 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.960133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.960276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29tdg\" (UniqueName: \"kubernetes.io/projected/56388344-0941-4937-a249-fe91e7e0e0c6-kube-api-access-29tdg\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:09 crc kubenswrapper[4769]: I1121 12:16:09.960451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-config-data\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.061860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-29tdg\" (UniqueName: \"kubernetes.io/projected/56388344-0941-4937-a249-fe91e7e0e0c6-kube-api-access-29tdg\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.061978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-config-data\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.062033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.066491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.066590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-config-data\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.080064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-29tdg\" (UniqueName: \"kubernetes.io/projected/56388344-0941-4937-a249-fe91e7e0e0c6-kube-api-access-29tdg\") pod \"nova-scheduler-0\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.213575 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:10 crc kubenswrapper[4769]: E1121 12:16:10.629532 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25caa86e_b566_4ca9_b573_45fedb43a879.slice/crio-conmon-48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25caa86e_b566_4ca9_b573_45fedb43a879.slice/crio-48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.696332 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:10 crc kubenswrapper[4769]: W1121 12:16:10.696933 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56388344_0941_4937_a249_fe91e7e0e0c6.slice/crio-5ffbc1f8a607ee27d0fc1b1981f3f05a592a1b9a8d14adf0cb2a7abecb98ed79 WatchSource:0}: Error finding container 5ffbc1f8a607ee27d0fc1b1981f3f05a592a1b9a8d14adf0cb2a7abecb98ed79: Status 404 returned error can't find the container with id 5ffbc1f8a607ee27d0fc1b1981f3f05a592a1b9a8d14adf0cb2a7abecb98ed79 Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.760874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25caa86e-b566-4ca9-b573-45fedb43a879-logs\") pod \"25caa86e-b566-4ca9-b573-45fedb43a879\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778359 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-public-tls-certs\") pod \"25caa86e-b566-4ca9-b573-45fedb43a879\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-internal-tls-certs\") pod \"25caa86e-b566-4ca9-b573-45fedb43a879\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-config-data\") pod \"25caa86e-b566-4ca9-b573-45fedb43a879\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-combined-ca-bundle\") pod \"25caa86e-b566-4ca9-b573-45fedb43a879\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25caa86e-b566-4ca9-b573-45fedb43a879-logs" (OuterVolumeSpecName: "logs") pod "25caa86e-b566-4ca9-b573-45fedb43a879" (UID: "25caa86e-b566-4ca9-b573-45fedb43a879"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.778924 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9vtw\" (UniqueName: \"kubernetes.io/projected/25caa86e-b566-4ca9-b573-45fedb43a879-kube-api-access-q9vtw\") pod \"25caa86e-b566-4ca9-b573-45fedb43a879\" (UID: \"25caa86e-b566-4ca9-b573-45fedb43a879\") " Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.779972 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25caa86e-b566-4ca9-b573-45fedb43a879-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.786224 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25caa86e-b566-4ca9-b573-45fedb43a879-kube-api-access-q9vtw" (OuterVolumeSpecName: "kube-api-access-q9vtw") pod "25caa86e-b566-4ca9-b573-45fedb43a879" (UID: "25caa86e-b566-4ca9-b573-45fedb43a879"). InnerVolumeSpecName "kube-api-access-q9vtw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.814094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25caa86e-b566-4ca9-b573-45fedb43a879" (UID: "25caa86e-b566-4ca9-b573-45fedb43a879"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.835486 4769 generic.go:334] "Generic (PLEG): container finished" podID="25caa86e-b566-4ca9-b573-45fedb43a879" containerID="48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a" exitCode=0 Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.835618 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.835778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"25caa86e-b566-4ca9-b573-45fedb43a879","Type":"ContainerDied","Data":"48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a"} Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.835893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"25caa86e-b566-4ca9-b573-45fedb43a879","Type":"ContainerDied","Data":"b317cd3d6d3c4a552a0f267bac7c20cfa050cadab97866229c6c902b44b1f3da"} Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.835987 4769 scope.go:117] "RemoveContainer" containerID="48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.839558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-config-data" (OuterVolumeSpecName: "config-data") pod "25caa86e-b566-4ca9-b573-45fedb43a879" (UID: "25caa86e-b566-4ca9-b573-45fedb43a879"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.841086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerStarted","Data":"672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5"} Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.843446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"56388344-0941-4937-a249-fe91e7e0e0c6","Type":"ContainerStarted","Data":"5ffbc1f8a607ee27d0fc1b1981f3f05a592a1b9a8d14adf0cb2a7abecb98ed79"} Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.848661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "25caa86e-b566-4ca9-b573-45fedb43a879" (UID: "25caa86e-b566-4ca9-b573-45fedb43a879"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.864126 4769 scope.go:117] "RemoveContainer" containerID="9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.888041 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.888500 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.888569 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.888632 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q9vtw\" (UniqueName: \"kubernetes.io/projected/25caa86e-b566-4ca9-b573-45fedb43a879-kube-api-access-q9vtw\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.905983 4769 scope.go:117] "RemoveContainer" containerID="48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a" Nov 21 12:16:10 crc kubenswrapper[4769]: E1121 12:16:10.906768 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a\": container with ID starting with 48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a not found: ID does not exist" containerID="48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.906867 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a"} err="failed to get container status \"48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a\": rpc error: code = NotFound desc = could not find container \"48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a\": container with ID starting with 48ca8096a52d70692d15c164c5ec4b99e225b7870dafd5e4d7d2a518b336221a not found: ID does not exist" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.906897 4769 scope.go:117] "RemoveContainer" containerID="9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169" Nov 21 12:16:10 crc kubenswrapper[4769]: E1121 12:16:10.907617 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169\": container with ID starting with 9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169 not found: ID does not exist" containerID="9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.907646 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169"} err="failed to get container status \"9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169\": rpc error: code = NotFound desc = could not find container \"9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169\": container with ID starting with 9d2a226b5fe024aaae9b8443dc8ef99af2019dd74533d4e80aee4c18a338e169 not found: ID does not exist" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.919490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "25caa86e-b566-4ca9-b573-45fedb43a879" (UID: "25caa86e-b566-4ca9-b573-45fedb43a879"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:10 crc kubenswrapper[4769]: I1121 12:16:10.990660 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/25caa86e-b566-4ca9-b573-45fedb43a879-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.180521 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.188809 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.205294 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:11 crc kubenswrapper[4769]: E1121 12:16:11.206071 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-api" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.206100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-api" Nov 21 12:16:11 crc kubenswrapper[4769]: E1121 12:16:11.206120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-log" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.206129 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-log" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.206403 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-log" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.206425 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" containerName="nova-api-api" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.208008 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.213681 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.213778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.213950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.220315 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.286347 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25caa86e-b566-4ca9-b573-45fedb43a879" path="/var/lib/kubelet/pods/25caa86e-b566-4ca9-b573-45fedb43a879/volumes" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.287380 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3132aad7-de3d-4b2c-b661-9dadc7149047" path="/var/lib/kubelet/pods/3132aad7-de3d-4b2c-b661-9dadc7149047/volumes" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.295627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbcr5\" (UniqueName: \"kubernetes.io/projected/5ed7ff37-6da9-471e-977d-ed0086cbcc42-kube-api-access-qbcr5\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.295761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.295833 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ed7ff37-6da9-471e-977d-ed0086cbcc42-logs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.295875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-public-tls-certs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.296064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-config-data\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.296318 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.398156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-config-data\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.398265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.398363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qbcr5\" (UniqueName: \"kubernetes.io/projected/5ed7ff37-6da9-471e-977d-ed0086cbcc42-kube-api-access-qbcr5\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.398397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.398788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ed7ff37-6da9-471e-977d-ed0086cbcc42-logs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.399392 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ed7ff37-6da9-471e-977d-ed0086cbcc42-logs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.399502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-public-tls-certs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.404123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.404493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-config-data\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.404631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.411416 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-public-tls-certs\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.422786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbcr5\" (UniqueName: \"kubernetes.io/projected/5ed7ff37-6da9-471e-977d-ed0086cbcc42-kube-api-access-qbcr5\") pod \"nova-api-0\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.580870 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.861789 4769 generic.go:334] "Generic (PLEG): container finished" podID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerID="672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5" exitCode=0 Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.861903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerDied","Data":"672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5"} Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.865799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"56388344-0941-4937-a249-fe91e7e0e0c6","Type":"ContainerStarted","Data":"98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3"} Nov 21 12:16:11 crc kubenswrapper[4769]: I1121 12:16:11.907727 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.907706367 podStartE2EDuration="2.907706367s" podCreationTimestamp="2025-11-21 12:16:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:11.903701919 +0000 UTC m=+1530.604363737" watchObservedRunningTime="2025-11-21 12:16:11.907706367 +0000 UTC m=+1530.608368185" Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.046377 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.878402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5ed7ff37-6da9-471e-977d-ed0086cbcc42","Type":"ContainerStarted","Data":"bb886765c75dd9fc578ff60a2d8b798cf9f7750dff79b940b8b756cb6765a457"} Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.878881 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5ed7ff37-6da9-471e-977d-ed0086cbcc42","Type":"ContainerStarted","Data":"75036f47f265df500dc97655322726e51a94570f3c85731591e2720cade34995"} Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.878895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5ed7ff37-6da9-471e-977d-ed0086cbcc42","Type":"ContainerStarted","Data":"ff312e343ae570204feb5392894510072021d4c1637a755463bb8774a12d5afd"} Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.883547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerStarted","Data":"e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09"} Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.906129 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.9061045380000001 podStartE2EDuration="1.906104538s" podCreationTimestamp="2025-11-21 12:16:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:12.899790888 +0000 UTC m=+1531.600452706" watchObservedRunningTime="2025-11-21 12:16:12.906104538 +0000 UTC m=+1531.606766356" Nov 21 12:16:12 crc kubenswrapper[4769]: I1121 12:16:12.930952 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-tmdd8" podStartSLOduration=3.451030716 podStartE2EDuration="5.930929545s" podCreationTimestamp="2025-11-21 12:16:07 +0000 UTC" firstStartedPulling="2025-11-21 12:16:09.826797574 +0000 UTC m=+1528.527459382" lastFinishedPulling="2025-11-21 12:16:12.306696393 +0000 UTC m=+1531.007358211" observedRunningTime="2025-11-21 12:16:12.924176234 +0000 UTC m=+1531.624838062" watchObservedRunningTime="2025-11-21 12:16:12.930929545 +0000 UTC m=+1531.631591363" Nov 21 12:16:13 crc kubenswrapper[4769]: I1121 12:16:13.226346 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:13 crc kubenswrapper[4769]: I1121 12:16:13.226860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:15 crc kubenswrapper[4769]: I1121 12:16:15.213685 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:15 crc kubenswrapper[4769]: I1121 12:16:15.874251 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:15 crc kubenswrapper[4769]: I1121 12:16:15.874838 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:15 crc kubenswrapper[4769]: I1121 12:16:15.954956 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:16 crc kubenswrapper[4769]: I1121 12:16:16.996004 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:17 crc kubenswrapper[4769]: I1121 12:16:17.049554 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-mcm8s"] Nov 21 12:16:18 crc kubenswrapper[4769]: I1121 12:16:18.226147 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:18 crc kubenswrapper[4769]: I1121 12:16:18.226235 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:18 crc kubenswrapper[4769]: I1121 12:16:18.278105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:18 crc kubenswrapper[4769]: I1121 12:16:18.278204 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:18 crc kubenswrapper[4769]: I1121 12:16:18.324247 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:18 crc kubenswrapper[4769]: I1121 12:16:18.942858 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-mcm8s" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="registry-server" containerID="cri-o://a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b" gracePeriod=2 Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.016902 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.240428 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.188:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.242347 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.188:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.724126 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-tmdd8"] Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.928824 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.955853 4769 generic.go:334] "Generic (PLEG): container finished" podID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerID="a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b" exitCode=0 Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.955918 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mcm8s" Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.956000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mcm8s" event={"ID":"2d299f4a-8c85-4ca1-9a89-d113b3fb306a","Type":"ContainerDied","Data":"a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b"} Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.956065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mcm8s" event={"ID":"2d299f4a-8c85-4ca1-9a89-d113b3fb306a","Type":"ContainerDied","Data":"71f6968a4b7667b08ce3bb28eb28e5f729f1d3a22201c24ce25fe85f1805dda5"} Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.956089 4769 scope.go:117] "RemoveContainer" containerID="a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b" Nov 21 12:16:19 crc kubenswrapper[4769]: I1121 12:16:19.982243 4769 scope.go:117] "RemoveContainer" containerID="55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.005899 4769 scope.go:117] "RemoveContainer" containerID="5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.065509 4769 scope.go:117] "RemoveContainer" containerID="a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b" Nov 21 12:16:20 crc kubenswrapper[4769]: E1121 12:16:20.066276 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b\": container with ID starting with a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b not found: ID does not exist" containerID="a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.066341 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b"} err="failed to get container status \"a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b\": rpc error: code = NotFound desc = could not find container \"a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b\": container with ID starting with a80ac50d5dfc389c884060e6d978c190e3ffb41bb4b2726bd1ff0f266329cb2b not found: ID does not exist" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.066379 4769 scope.go:117] "RemoveContainer" containerID="55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c" Nov 21 12:16:20 crc kubenswrapper[4769]: E1121 12:16:20.066674 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c\": container with ID starting with 55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c not found: ID does not exist" containerID="55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.066705 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c"} err="failed to get container status \"55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c\": rpc error: code = NotFound desc = could not find container \"55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c\": container with ID starting with 55fe4eec5a582abca275e5284d9452f9c58d3561593787c00f0a701b3d1f1c2c not found: ID does not exist" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.066726 4769 scope.go:117] "RemoveContainer" containerID="5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563" Nov 21 12:16:20 crc kubenswrapper[4769]: E1121 12:16:20.067117 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563\": container with ID starting with 5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563 not found: ID does not exist" containerID="5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.067159 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563"} err="failed to get container status \"5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563\": rpc error: code = NotFound desc = could not find container \"5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563\": container with ID starting with 5a0a576b545f8a02154f1e13503ef3e9c0f9fe1e9c9d1854c21253c1cba0a563 not found: ID does not exist" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.077400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr68n\" (UniqueName: \"kubernetes.io/projected/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-kube-api-access-kr68n\") pod \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.077675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-utilities\") pod \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.077806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-catalog-content\") pod \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\" (UID: \"2d299f4a-8c85-4ca1-9a89-d113b3fb306a\") " Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.081362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-utilities" (OuterVolumeSpecName: "utilities") pod "2d299f4a-8c85-4ca1-9a89-d113b3fb306a" (UID: "2d299f4a-8c85-4ca1-9a89-d113b3fb306a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.088296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-kube-api-access-kr68n" (OuterVolumeSpecName: "kube-api-access-kr68n") pod "2d299f4a-8c85-4ca1-9a89-d113b3fb306a" (UID: "2d299f4a-8c85-4ca1-9a89-d113b3fb306a"). InnerVolumeSpecName "kube-api-access-kr68n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.101024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2d299f4a-8c85-4ca1-9a89-d113b3fb306a" (UID: "2d299f4a-8c85-4ca1-9a89-d113b3fb306a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.179390 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kr68n\" (UniqueName: \"kubernetes.io/projected/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-kube-api-access-kr68n\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.179441 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.179457 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2d299f4a-8c85-4ca1-9a89-d113b3fb306a-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.214287 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.247601 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.321164 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-mcm8s"] Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.342199 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-mcm8s"] Nov 21 12:16:20 crc kubenswrapper[4769]: I1121 12:16:20.970181 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-tmdd8" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="registry-server" containerID="cri-o://e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09" gracePeriod=2 Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.009102 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.290412 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" path="/var/lib/kubelet/pods/2d299f4a-8c85-4ca1-9a89-d113b3fb306a/volumes" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.448969 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.582374 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.582510 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.629093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-utilities\") pod \"01a80d77-12ee-415e-8472-0ad9e6a5611f\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.629310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvkm6\" (UniqueName: \"kubernetes.io/projected/01a80d77-12ee-415e-8472-0ad9e6a5611f-kube-api-access-kvkm6\") pod \"01a80d77-12ee-415e-8472-0ad9e6a5611f\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.629356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-catalog-content\") pod \"01a80d77-12ee-415e-8472-0ad9e6a5611f\" (UID: \"01a80d77-12ee-415e-8472-0ad9e6a5611f\") " Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.630166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-utilities" (OuterVolumeSpecName: "utilities") pod "01a80d77-12ee-415e-8472-0ad9e6a5611f" (UID: "01a80d77-12ee-415e-8472-0ad9e6a5611f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.630662 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.641924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a80d77-12ee-415e-8472-0ad9e6a5611f-kube-api-access-kvkm6" (OuterVolumeSpecName: "kube-api-access-kvkm6") pod "01a80d77-12ee-415e-8472-0ad9e6a5611f" (UID: "01a80d77-12ee-415e-8472-0ad9e6a5611f"). InnerVolumeSpecName "kube-api-access-kvkm6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:21 crc kubenswrapper[4769]: I1121 12:16:21.733558 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kvkm6\" (UniqueName: \"kubernetes.io/projected/01a80d77-12ee-415e-8472-0ad9e6a5611f-kube-api-access-kvkm6\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.002457 4769 generic.go:334] "Generic (PLEG): container finished" podID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerID="e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09" exitCode=0 Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.003991 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tmdd8" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.004475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerDied","Data":"e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09"} Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.004556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tmdd8" event={"ID":"01a80d77-12ee-415e-8472-0ad9e6a5611f","Type":"ContainerDied","Data":"078225ba473f2f87b54e6030a23aee939e22df1c3e2f1fb0e0a7de97a10e1ca1"} Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.004582 4769 scope.go:117] "RemoveContainer" containerID="e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.033779 4769 scope.go:117] "RemoveContainer" containerID="672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.058334 4769 scope.go:117] "RemoveContainer" containerID="b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.116518 4769 scope.go:117] "RemoveContainer" containerID="e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09" Nov 21 12:16:22 crc kubenswrapper[4769]: E1121 12:16:22.118168 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09\": container with ID starting with e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09 not found: ID does not exist" containerID="e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.118240 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09"} err="failed to get container status \"e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09\": rpc error: code = NotFound desc = could not find container \"e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09\": container with ID starting with e17522166cce0461a97497bf766d96798b6142324015eeccbc9014720ca04d09 not found: ID does not exist" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.118271 4769 scope.go:117] "RemoveContainer" containerID="672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5" Nov 21 12:16:22 crc kubenswrapper[4769]: E1121 12:16:22.120122 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5\": container with ID starting with 672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5 not found: ID does not exist" containerID="672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.120172 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5"} err="failed to get container status \"672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5\": rpc error: code = NotFound desc = could not find container \"672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5\": container with ID starting with 672822d8ca67b26d274089f93f9481d26867081139a13e028716470982b563f5 not found: ID does not exist" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.120244 4769 scope.go:117] "RemoveContainer" containerID="b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84" Nov 21 12:16:22 crc kubenswrapper[4769]: E1121 12:16:22.120539 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84\": container with ID starting with b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84 not found: ID does not exist" containerID="b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.120558 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84"} err="failed to get container status \"b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84\": rpc error: code = NotFound desc = could not find container \"b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84\": container with ID starting with b10a543e73b6c8aa2023c8234070e6b1b2f8b5facc172cc43c18f082e307ab84 not found: ID does not exist" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.294157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "01a80d77-12ee-415e-8472-0ad9e6a5611f" (UID: "01a80d77-12ee-415e-8472-0ad9e6a5611f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.347467 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-tmdd8"] Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.354026 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/01a80d77-12ee-415e-8472-0ad9e6a5611f-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.359686 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-tmdd8"] Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.595383 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.191:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:22 crc kubenswrapper[4769]: I1121 12:16:22.595426 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.191:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:23 crc kubenswrapper[4769]: I1121 12:16:23.291473 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" path="/var/lib/kubelet/pods/01a80d77-12ee-415e-8472-0ad9e6a5611f/volumes" Nov 21 12:16:23 crc kubenswrapper[4769]: I1121 12:16:23.991209 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:16:28 crc kubenswrapper[4769]: I1121 12:16:28.231579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:28 crc kubenswrapper[4769]: I1121 12:16:28.232498 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:28 crc kubenswrapper[4769]: I1121 12:16:28.250343 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:28 crc kubenswrapper[4769]: I1121 12:16:28.252270 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:31 crc kubenswrapper[4769]: I1121 12:16:31.591284 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:31 crc kubenswrapper[4769]: I1121 12:16:31.592479 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:31 crc kubenswrapper[4769]: I1121 12:16:31.595924 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:31 crc kubenswrapper[4769]: I1121 12:16:31.600225 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:32 crc kubenswrapper[4769]: I1121 12:16:32.138259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:32 crc kubenswrapper[4769]: I1121 12:16:32.167716 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.160003 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.160947 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="openstack-network-exporter" containerID="cri-o://bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91" gracePeriod=300 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.174689 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.175023 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" containerName="openstackclient" containerID="cri-o://ae272d0fc0aca11c58d180f73f6c556e1437c8a601c3234e216a6373e3952aa4" gracePeriod=2 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.238573 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.259833 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.270817 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" containerID="cri-o://5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.271068 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="openstack-network-exporter" containerID="cri-o://23ab80415e281eb82c83446934d5b669e6b9a0e1961147c213fc61b2446c084d" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422372 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz"] Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422787 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="registry-server" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422801 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="registry-server" Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422830 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="extract-content" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422836 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="extract-content" Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422847 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="extract-utilities" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422854 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="extract-utilities" Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422868 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="extract-content" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422877 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="extract-content" Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" containerName="openstackclient" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" containerName="openstackclient" Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422916 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="extract-utilities" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422922 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="extract-utilities" Nov 21 12:16:39 crc kubenswrapper[4769]: E1121 12:16:39.422932 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="registry-server" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.422938 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="registry-server" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.423143 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2d299f4a-8c85-4ca1-9a89-d113b3fb306a" containerName="registry-server" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.423164 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="01a80d77-12ee-415e-8472-0ad9e6a5611f" containerName="registry-server" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.423177 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" containerName="openstackclient" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.441823 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.443726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.444313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mf4\" (UniqueName: \"kubernetes.io/projected/d5856314-1efb-4026-84a0-f18d4420682e-kube-api-access-l7mf4\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lwxb\" (UniqueName: \"kubernetes.io/projected/ddf92e36-0f72-42e5-9a43-a4c62def4273-kube-api-access-6lwxb\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data-custom\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-combined-ca-bundle\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471734 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5856314-1efb-4026-84a0-f18d4420682e-logs\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.471817 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddf92e36-0f72-42e5-9a43-a4c62def4273-logs\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.487272 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.527948 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-combined-ca-bundle\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5856314-1efb-4026-84a0-f18d4420682e-logs\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddf92e36-0f72-42e5-9a43-a4c62def4273-logs\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mf4\" (UniqueName: \"kubernetes.io/projected/d5856314-1efb-4026-84a0-f18d4420682e-kube-api-access-l7mf4\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6lwxb\" (UniqueName: \"kubernetes.io/projected/ddf92e36-0f72-42e5-9a43-a4c62def4273-kube-api-access-6lwxb\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.573669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data-custom\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.575805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddf92e36-0f72-42e5-9a43-a4c62def4273-logs\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.583714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5856314-1efb-4026-84a0-f18d4420682e-logs\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.585851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.586076 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" containerName="memcached" containerID="cri-o://11e4b09a040543deb8702b191dd7655481edc71f1af6c4504a2f4e4b95887c0b" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.587590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-combined-ca-bundle\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.588844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.592135 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.593401 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data-custom\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.602936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.622263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.642498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.642755 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="cinder-scheduler" containerID="cri-o://01a9779ef2ef2b9e782ee5a92d2cd4be9bf6b0bab2fd76223a9ab8b419219d67" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.642904 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="probe" containerID="cri-o://d9c15d507687b3db340748a9183bb730d5f0a9ea2d81a9506226846bfa031318" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.670822 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lwxb\" (UniqueName: \"kubernetes.io/projected/ddf92e36-0f72-42e5-9a43-a4c62def4273-kube-api-access-6lwxb\") pod \"barbican-worker-5bd7985695-kll6p\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.708290 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.708650 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-log" containerID="cri-o://f7d252944da608511b8a454df97267561b5e6a9bdda0ea69140ef1eebb7bda82" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.708821 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-metadata" containerID="cri-o://71bd808cf3109c1c57b0c47ebd57d285135d128165fac4321818df4e0501aba3" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.720306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mf4\" (UniqueName: \"kubernetes.io/projected/d5856314-1efb-4026-84a0-f18d4420682e-kube-api-access-l7mf4\") pod \"barbican-keystone-listener-77fb7c74c6-5kzvz\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.733065 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.758497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-log" containerID="cri-o://b986a002729503566a1f574b72c6b7e1fa44dbbb3a87e0d0ec923adad2d82a83" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.759444 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-httpd" containerID="cri-o://89a9a58d2361e0be72d982129d25a0f205081e5dcb8c3c89106166f9b5c55d15" gracePeriod=30 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.766281 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-667d678888-ggtgm"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.769213 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.803550 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-79dbc96794-9llmc"] Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.807628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.850394 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.863539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.868045 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="ovsdbserver-nb" containerID="cri-o://302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660" gracePeriod=300 Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.908592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-public-tls-certs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.913673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-config-data\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.913793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-internal-tls-certs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.913828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-public-tls-certs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.913893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-scripts\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.913937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klhzn\" (UniqueName: \"kubernetes.io/projected/4ff3caad-9d87-4e02-abd3-e6148084a692-kube-api-access-klhzn\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.913968 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba7fad1-0c38-4270-8742-6bf0646009cc-logs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8tq\" (UniqueName: \"kubernetes.io/projected/0ba7fad1-0c38-4270-8742-6bf0646009cc-kube-api-access-5m8tq\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ff3caad-9d87-4e02-abd3-e6148084a692-logs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914098 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-combined-ca-bundle\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914128 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-internal-tls-certs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data-custom\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914194 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.914237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-combined-ca-bundle\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:39 crc kubenswrapper[4769]: I1121 12:16:39.957322 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d678888-ggtgm"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.008312 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-79dbc96794-9llmc"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-scripts\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-klhzn\" (UniqueName: \"kubernetes.io/projected/4ff3caad-9d87-4e02-abd3-e6148084a692-kube-api-access-klhzn\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba7fad1-0c38-4270-8742-6bf0646009cc-logs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8tq\" (UniqueName: \"kubernetes.io/projected/0ba7fad1-0c38-4270-8742-6bf0646009cc-kube-api-access-5m8tq\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ff3caad-9d87-4e02-abd3-e6148084a692-logs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-combined-ca-bundle\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-internal-tls-certs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018956 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data-custom\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.018986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.019012 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-combined-ca-bundle\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.019102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-public-tls-certs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.019132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-config-data\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.019189 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-internal-tls-certs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.019293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-public-tls-certs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.026921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba7fad1-0c38-4270-8742-6bf0646009cc-logs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.027781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ff3caad-9d87-4e02-abd3-e6148084a692-logs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.041694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-config-data\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.042125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-public-tls-certs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.068100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.076556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-public-tls-certs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.078498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-combined-ca-bundle\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.080876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-internal-tls-certs\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.085241 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data-custom\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.085369 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.085788 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api-log" containerID="cri-o://f567395d75936121013d9336600af062b6f6f14dfc4ee8d5c7616466811f6ba7" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.086035 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api" containerID="cri-o://0f58a7d093708947f264330141cef846704d32a8005d80f147ef2f2cd05b2330" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.092661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-scripts\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.093085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-internal-tls-certs\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.093320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-combined-ca-bundle\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.106425 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.122087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8tq\" (UniqueName: \"kubernetes.io/projected/0ba7fad1-0c38-4270-8742-6bf0646009cc-kube-api-access-5m8tq\") pod \"placement-79dbc96794-9llmc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.125380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-klhzn\" (UniqueName: \"kubernetes.io/projected/4ff3caad-9d87-4e02-abd3-e6148084a692-kube-api-access-klhzn\") pod \"barbican-api-667d678888-ggtgm\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.149347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.149750 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" containerName="nova-scheduler-scheduler" containerID="cri-o://98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.150562 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.193689 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.193898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerName="nova-cell0-conductor-conductor" containerID="cri-o://8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.237912 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.238194 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="openstack-network-exporter" containerID="cri-o://90be29082cb701cd689eeebe3c521f1cf3d923eb3e6440edd4fb00553b4da038" gracePeriod=300 Nov 21 12:16:40 crc kubenswrapper[4769]: E1121 12:16:40.258820 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.359371 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.359804 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1c992025fa044e59a758248ad17a279a740364afa4ded1df7466a7f0844e4282" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: E1121 12:16:40.373008 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:40 crc kubenswrapper[4769]: E1121 12:16:40.388855 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:40 crc kubenswrapper[4769]: E1121 12:16:40.388942 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" containerName="nova-scheduler-scheduler" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.390834 4769 generic.go:334] "Generic (PLEG): container finished" podID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerID="bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91" exitCode=2 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.390920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1bfd0ec1-9312-4ce3-8b5f-8a9340736062","Type":"ContainerDied","Data":"bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91"} Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.434506 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.444926 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.447387 4769 generic.go:334] "Generic (PLEG): container finished" podID="602f0862-0d09-482c-90ae-750628c4ab13" containerID="23ab80415e281eb82c83446934d5b669e6b9a0e1961147c213fc61b2446c084d" exitCode=2 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.447434 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"602f0862-0d09-482c-90ae-750628c4ab13","Type":"ContainerDied","Data":"23ab80415e281eb82c83446934d5b669e6b9a0e1961147c213fc61b2446c084d"} Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.492464 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-886bdb4f7-fq2hm"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.493714 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.557258 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.573611 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.574998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-public-tls-certs\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.575103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-combined-ca-bundle\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.575150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-credential-keys\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.575173 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg28w\" (UniqueName: \"kubernetes.io/projected/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-kube-api-access-zg28w\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.575939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-scripts\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.576047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-internal-tls-certs\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.576090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-fernet-keys\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.576136 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-config-data\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.581427 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="ovsdbserver-sb" containerID="cri-o://f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa" gracePeriod=300 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.592361 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-886bdb4f7-fq2hm"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.609758 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.610367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-log" containerID="cri-o://75036f47f265df500dc97655322726e51a94570f3c85731591e2720cade34995" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.612423 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-api" containerID="cri-o://bb886765c75dd9fc578ff60a2d8b798cf9f7750dff79b940b8b756cb6765a457" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.622157 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.636332 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.636693 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-log" containerID="cri-o://f38c68a26a6082c216ef8f5ce34bc0d7488bef446b4b98446e94c3122164b79e" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.637175 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-httpd" containerID="cri-o://fc34b5b9c89a734a1ca3b777eca08363f055fb209f9d86edd65ba622fa71c3fa" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.724735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-public-tls-certs\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-combined-ca-bundle\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-credential-keys\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zg28w\" (UniqueName: \"kubernetes.io/projected/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-kube-api-access-zg28w\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-combined-ca-bundle\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-internal-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdw64\" (UniqueName: \"kubernetes.io/projected/75af4712-517b-45d9-981e-30e251a28bb0-kube-api-access-fdw64\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-ovndb-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-scripts\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-config\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-public-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-httpd-config\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-internal-tls-certs\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-fernet-keys\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.725808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-config-data\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.731489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-internal-tls-certs\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.731929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-scripts\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.734307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-combined-ca-bundle\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.737170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-config-data\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.740384 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-public-tls-certs\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.743465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-fernet-keys\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.748968 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="galera" containerID="cri-o://016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f" gracePeriod=30 Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.763902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-credential-keys\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.764474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg28w\" (UniqueName: \"kubernetes.io/projected/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-kube-api-access-zg28w\") pod \"keystone-886bdb4f7-fq2hm\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.779873 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.840898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-combined-ca-bundle\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.840959 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-internal-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.840999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fdw64\" (UniqueName: \"kubernetes.io/projected/75af4712-517b-45d9-981e-30e251a28bb0-kube-api-access-fdw64\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.841037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-ovndb-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.841068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-config\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.841089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-public-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.841112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-httpd-config\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.851586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-combined-ca-bundle\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.853530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-internal-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.856067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-public-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.860451 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-httpd-config\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.862866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p"] Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.867180 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.867933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-ovndb-tls-certs\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.870290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdw64\" (UniqueName: \"kubernetes.io/projected/75af4712-517b-45d9-981e-30e251a28bb0-kube-api-access-fdw64\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.873350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-config\") pod \"neutron-5b6f78b9d-v4x2t\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:40 crc kubenswrapper[4769]: I1121 12:16:40.885082 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="galera" containerID="cri-o://17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9" gracePeriod=30 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.108693 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.222567 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-79dbc96794-9llmc"] Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.265960 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.266244 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerName="nova-cell1-conductor-conductor" containerID="cri-o://c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" gracePeriod=30 Nov 21 12:16:41 crc kubenswrapper[4769]: W1121 12:16:41.308165 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ba7fad1_0c38_4270_8742_6bf0646009cc.slice/crio-68f0c872f2aede1b11ef58743570794166236285199dc632726328e6050d3031 WatchSource:0}: Error finding container 68f0c872f2aede1b11ef58743570794166236285199dc632726328e6050d3031: Status 404 returned error can't find the container with id 68f0c872f2aede1b11ef58743570794166236285199dc632726328e6050d3031 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.329374 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.329445 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.644903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" event={"ID":"0ba7fad1-0c38-4270-8742-6bf0646009cc","Type":"ContainerStarted","Data":"68f0c872f2aede1b11ef58743570794166236285199dc632726328e6050d3031"} Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.694076 4769 generic.go:334] "Generic (PLEG): container finished" podID="9419c5db-b98d-44e8-a7f5-852229976f84" containerID="f7d252944da608511b8a454df97267561b5e6a9bdda0ea69140ef1eebb7bda82" exitCode=143 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.694764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9419c5db-b98d-44e8-a7f5-852229976f84","Type":"ContainerDied","Data":"f7d252944da608511b8a454df97267561b5e6a9bdda0ea69140ef1eebb7bda82"} Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.755912 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9d9e9e8e-52d3-4601-be5f-84b9ac61697b/ovsdbserver-sb/0.log" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.756176 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1bfd0ec1-9312-4ce3-8b5f-8a9340736062/ovsdbserver-nb/0.log" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.760946 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerID="f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa" exitCode=143 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.760981 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerID="90be29082cb701cd689eeebe3c521f1cf3d923eb3e6440edd4fb00553b4da038" exitCode=2 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.761048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9d9e9e8e-52d3-4601-be5f-84b9ac61697b","Type":"ContainerDied","Data":"f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa"} Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.761081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9d9e9e8e-52d3-4601-be5f-84b9ac61697b","Type":"ContainerDied","Data":"90be29082cb701cd689eeebe3c521f1cf3d923eb3e6440edd4fb00553b4da038"} Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.761232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.779883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdbserver-nb-tls-certs\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdb-rundir\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-scripts\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-config\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-metrics-certs-tls-certs\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780473 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-combined-ca-bundle\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.780505 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k88j\" (UniqueName: \"kubernetes.io/projected/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-kube-api-access-9k88j\") pod \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\" (UID: \"1bfd0ec1-9312-4ce3-8b5f-8a9340736062\") " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.783824 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-scripts" (OuterVolumeSpecName: "scripts") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.790847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.793753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-config" (OuterVolumeSpecName: "config") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.834347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-kube-api-access-9k88j" (OuterVolumeSpecName: "kube-api-access-9k88j") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "kube-api-access-9k88j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.853056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.871627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" event={"ID":"d5856314-1efb-4026-84a0-f18d4420682e","Type":"ContainerStarted","Data":"e3ef8320c869efe4c4ed4bc5b63b4e28dcc11671dfd124c32a85b3b944e65ce5"} Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.886122 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9k88j\" (UniqueName: \"kubernetes.io/projected/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-kube-api-access-9k88j\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.886174 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.886190 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.886246 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.886260 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.958250 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerID="75036f47f265df500dc97655322726e51a94570f3c85731591e2720cade34995" exitCode=143 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.958416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5ed7ff37-6da9-471e-977d-ed0086cbcc42","Type":"ContainerDied","Data":"75036f47f265df500dc97655322726e51a94570f3c85731591e2720cade34995"} Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.994499 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerID="d9c15d507687b3db340748a9183bb730d5f0a9ea2d81a9506226846bfa031318" exitCode=0 Nov 21 12:16:41 crc kubenswrapper[4769]: I1121 12:16:41.994645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c5b897fd-dde5-489a-a738-88aa63a4f806","Type":"ContainerDied","Data":"d9c15d507687b3db340748a9183bb730d5f0a9ea2d81a9506226846bfa031318"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.070620 4769 generic.go:334] "Generic (PLEG): container finished" podID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerID="f38c68a26a6082c216ef8f5ce34bc0d7488bef446b4b98446e94c3122164b79e" exitCode=143 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.070740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8537fa74-d045-48de-b59b-59d7cab6d5fb","Type":"ContainerDied","Data":"f38c68a26a6082c216ef8f5ce34bc0d7488bef446b4b98446e94c3122164b79e"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.086308 4769 generic.go:334] "Generic (PLEG): container finished" podID="4be7b12a-19d5-476f-b806-41eb24d461ac" containerID="11e4b09a040543deb8702b191dd7655481edc71f1af6c4504a2f4e4b95887c0b" exitCode=0 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.086459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"4be7b12a-19d5-476f-b806-41eb24d461ac","Type":"ContainerDied","Data":"11e4b09a040543deb8702b191dd7655481edc71f1af6c4504a2f4e4b95887c0b"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.147834 4769 generic.go:334] "Generic (PLEG): container finished" podID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerID="f567395d75936121013d9336600af062b6f6f14dfc4ee8d5c7616466811f6ba7" exitCode=143 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.147966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"41f05d9d-6645-4531-bca1-e94840a5bc88","Type":"ContainerDied","Data":"f567395d75936121013d9336600af062b6f6f14dfc4ee8d5c7616466811f6ba7"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.169799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.176630 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-886bdb4f7-fq2hm"] Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.213505 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.253430 4769 generic.go:334] "Generic (PLEG): container finished" podID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerID="b986a002729503566a1f574b72c6b7e1fa44dbbb3a87e0d0ec923adad2d82a83" exitCode=143 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.253528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db2d38dd-f72e-42d3-b681-674040ed92ba","Type":"ContainerDied","Data":"b986a002729503566a1f574b72c6b7e1fa44dbbb3a87e0d0ec923adad2d82a83"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.382752 4769 generic.go:334] "Generic (PLEG): container finished" podID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" containerID="ae272d0fc0aca11c58d180f73f6c556e1437c8a601c3234e216a6373e3952aa4" exitCode=137 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.441710 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.475954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" event={"ID":"ddf92e36-0f72-42e5-9a43-a4c62def4273","Type":"ContainerStarted","Data":"3f1d9ff66a4f267a1e501608714e446d707ed4aa16d6435ff3da97a23b90624a"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.523856 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d678888-ggtgm"] Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.546387 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.560928 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_1bfd0ec1-9312-4ce3-8b5f-8a9340736062/ovsdbserver-nb/0.log" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.574661 4769 generic.go:334] "Generic (PLEG): container finished" podID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerID="302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660" exitCode=143 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.574734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1bfd0ec1-9312-4ce3-8b5f-8a9340736062","Type":"ContainerDied","Data":"302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.574776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"1bfd0ec1-9312-4ce3-8b5f-8a9340736062","Type":"ContainerDied","Data":"0448cbe8b636819c8fb8e88138eb2dc38f1b8a814a957c64aece2f9f257c3d71"} Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.574800 4769 scope.go:117] "RemoveContainer" containerID="302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.575043 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.593309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.601841 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa is running failed: container process not found" containerID="f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.607100 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa is running failed: container process not found" containerID="f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.613041 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.621038 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa is running failed: container process not found" containerID="f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.621888 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="ovsdbserver-sb" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.624094 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.624558 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-central-agent" containerID="cri-o://a2645245eb3ee3eebdf7c967d355d80fe90f95b6d3b5e5b4e4c366cab3e140c3" gracePeriod=30 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.624732 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="sg-core" containerID="cri-o://b8b1acb6c3837a3eeb08810f5cd171240f04d4f58c7587bda8aac26e5ee43320" gracePeriod=30 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.624965 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="proxy-httpd" containerID="cri-o://39455312801fe2617009399cff2130cf65149aad9326305623cf98c6a2b3a752" gracePeriod=30 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.625091 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-notification-agent" containerID="cri-o://ac2bffbc71c179a071c576298ebb8e06f11415663fce8e4cbe16de16a4e9665d" gracePeriod=30 Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.647923 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.717030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "1bfd0ec1-9312-4ce3-8b5f-8a9340736062" (UID: "1bfd0ec1-9312-4ce3-8b5f-8a9340736062"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.752104 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1bfd0ec1-9312-4ce3-8b5f-8a9340736062-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.757476 4769 scope.go:117] "RemoveContainer" containerID="bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91" Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.771888 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.836444 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.854379 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.854447 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="galera" Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.860137 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.860656 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data podName:4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:43.360181976 +0000 UTC m=+1562.060843794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data") pod "rabbitmq-server-0" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5") : configmap "rabbitmq-config-data" not found Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.864099 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder9405-account-delete-6l74g"] Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.864672 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="ovsdbserver-nb" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.864687 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="ovsdbserver-nb" Nov 21 12:16:42 crc kubenswrapper[4769]: E1121 12:16:42.864706 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="openstack-network-exporter" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.864712 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="openstack-network-exporter" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.864906 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="openstack-network-exporter" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.864921 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" containerName="ovsdbserver-nb" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.865582 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.970123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder9405-account-delete-6l74g"] Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.977890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9cb03d6-db43-4569-b583-7d2cd315dbc6-operator-scripts\") pod \"cinder9405-account-delete-6l74g\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:42 crc kubenswrapper[4769]: I1121 12:16:42.977975 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvll\" (UniqueName: \"kubernetes.io/projected/d9cb03d6-db43-4569-b583-7d2cd315dbc6-kube-api-access-pwvll\") pod \"cinder9405-account-delete-6l74g\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.066690 4769 scope.go:117] "RemoveContainer" containerID="302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.067284 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glancece7b-account-delete-rq256"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.070536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.082080 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660\": container with ID starting with 302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660 not found: ID does not exist" containerID="302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.082132 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660"} err="failed to get container status \"302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660\": rpc error: code = NotFound desc = could not find container \"302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660\": container with ID starting with 302a779a44b1a052d99c434fee25149da602f4e7b6ec12a027a92012851e0660 not found: ID does not exist" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.082165 4769 scope.go:117] "RemoveContainer" containerID="bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91" Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.084598 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91\": container with ID starting with bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91 not found: ID does not exist" containerID="bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.084640 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91"} err="failed to get container status \"bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91\": rpc error: code = NotFound desc = could not find container \"bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91\": container with ID starting with bd6766ad09e15ebb6ee01bd8580f747ac1684a8387867257124a38af6438ee91 not found: ID does not exist" Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.110970 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.114474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/27fe312f-1788-4660-b46f-ac049f1529c9-operator-scripts\") pod \"glancece7b-account-delete-rq256\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.114544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76ts\" (UniqueName: \"kubernetes.io/projected/27fe312f-1788-4660-b46f-ac049f1529c9-kube-api-access-g76ts\") pod \"glancece7b-account-delete-rq256\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.114685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9cb03d6-db43-4569-b583-7d2cd315dbc6-operator-scripts\") pod \"cinder9405-account-delete-6l74g\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.114730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvll\" (UniqueName: \"kubernetes.io/projected/d9cb03d6-db43-4569-b583-7d2cd315dbc6-kube-api-access-pwvll\") pod \"cinder9405-account-delete-6l74g\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.118740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9cb03d6-db43-4569-b583-7d2cd315dbc6-operator-scripts\") pod \"cinder9405-account-delete-6l74g\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.118749 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hd8sk"] Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.139895 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.142936 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glancece7b-account-delete-rq256"] Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.184740 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.184811 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.232541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/27fe312f-1788-4660-b46f-ac049f1529c9-operator-scripts\") pod \"glancece7b-account-delete-rq256\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.232611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g76ts\" (UniqueName: \"kubernetes.io/projected/27fe312f-1788-4660-b46f-ac049f1529c9-kube-api-access-g76ts\") pod \"glancece7b-account-delete-rq256\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.233667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/27fe312f-1788-4660-b46f-ac049f1529c9-operator-scripts\") pod \"glancece7b-account-delete-rq256\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.287267 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hd8sk"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.328293 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.424758 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b11a06d-8213-4627-9c7d-f293782167ef" path="/var/lib/kubelet/pods/0b11a06d-8213-4627-9c7d-f293782167ef/volumes" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.425631 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.425653 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.425669 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron251c-account-delete-gftsp"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.444072 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-xb74v"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.444181 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.444624 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:16:43 crc kubenswrapper[4769]: E1121 12:16:43.444681 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data podName:4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:44.44466648 +0000 UTC m=+1563.145328298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data") pod "rabbitmq-server-0" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5") : configmap "rabbitmq-config-data" not found Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.461326 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron251c-account-delete-gftsp"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.496644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvll\" (UniqueName: \"kubernetes.io/projected/d9cb03d6-db43-4569-b583-7d2cd315dbc6-kube-api-access-pwvll\") pod \"cinder9405-account-delete-6l74g\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.513532 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-xb74v"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.530050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.549579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-combined-ca-bundle\") pod \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.549638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config-secret\") pod \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.549663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-868h8\" (UniqueName: \"kubernetes.io/projected/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-kube-api-access-868h8\") pod \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.549878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config\") pod \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\" (UID: \"8870a8ea-8869-4eb6-befb-ca059ee3bfd7\") " Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.550208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts\") pod \"neutron251c-account-delete-gftsp\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.550360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lkqs\" (UniqueName: \"kubernetes.io/projected/b1611028-fdb2-48bf-8f36-8109220e3d2c-kube-api-access-2lkqs\") pod \"neutron251c-account-delete-gftsp\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.553948 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placementecac-account-delete-qkp2t"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.555637 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.594309 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementecac-account-delete-qkp2t"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.635833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" event={"ID":"4ff3caad-9d87-4e02-abd3-e6148084a692","Type":"ContainerStarted","Data":"da5b72001cf011ea88c064ea734668c88d0cff8aeae552f7319e309af89b0e6a"} Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.652861 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-xplxh"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.656410 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts\") pod \"neutron251c-account-delete-gftsp\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.656537 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pld5r\" (UniqueName: \"kubernetes.io/projected/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-kube-api-access-pld5r\") pod \"placementecac-account-delete-qkp2t\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.656602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2lkqs\" (UniqueName: \"kubernetes.io/projected/b1611028-fdb2-48bf-8f36-8109220e3d2c-kube-api-access-2lkqs\") pod \"neutron251c-account-delete-gftsp\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.656636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts\") pod \"placementecac-account-delete-qkp2t\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.657631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts\") pod \"neutron251c-account-delete-gftsp\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.669927 4769 generic.go:334] "Generic (PLEG): container finished" podID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerID="b8b1acb6c3837a3eeb08810f5cd171240f04d4f58c7587bda8aac26e5ee43320" exitCode=2 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.670019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerDied","Data":"b8b1acb6c3837a3eeb08810f5cd171240f04d4f58c7587bda8aac26e5ee43320"} Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.685274 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.685561 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="82bc46a0-92fc-4db5-a7db-08ac6812d117" containerName="kube-state-metrics" containerID="cri-o://785eebb05575318089d30427f0a14b802279fa7dfe4562c35ee0ba8ec167d96f" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.722718 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-8nw95"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.732995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" event={"ID":"d5856314-1efb-4026-84a0-f18d4420682e","Type":"ContainerStarted","Data":"d4b38b2f0a74bcdc04513afd3ca43875e7a1c81a107b6af5ac333109a5f72d0a"} Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.747642 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-xplxh"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.750068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76ts\" (UniqueName: \"kubernetes.io/projected/27fe312f-1788-4660-b46f-ac049f1529c9-kube-api-access-g76ts\") pod \"glancece7b-account-delete-rq256\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.753872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" event={"ID":"ddf92e36-0f72-42e5-9a43-a4c62def4273","Type":"ContainerStarted","Data":"a5620e44e4048ff79526ea7eb83d69080f71db4027cb278c5fae33246445abc9"} Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.760103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts\") pod \"placementecac-account-delete-qkp2t\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.760368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pld5r\" (UniqueName: \"kubernetes.io/projected/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-kube-api-access-pld5r\") pod \"placementecac-account-delete-qkp2t\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.760421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-kube-api-access-868h8" (OuterVolumeSpecName: "kube-api-access-868h8") pod "8870a8ea-8869-4eb6-befb-ca059ee3bfd7" (UID: "8870a8ea-8869-4eb6-befb-ca059ee3bfd7"). InnerVolumeSpecName "kube-api-access-868h8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.761876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts\") pod \"placementecac-account-delete-qkp2t\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.764386 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.766775 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.767303 4769 scope.go:117] "RemoveContainer" containerID="ae272d0fc0aca11c58d180f73f6c556e1437c8a601c3234e216a6373e3952aa4" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.786565 4769 generic.go:334] "Generic (PLEG): container finished" podID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" containerID="1c992025fa044e59a758248ad17a279a740364afa4ded1df7466a7f0844e4282" exitCode=0 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.788712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lkqs\" (UniqueName: \"kubernetes.io/projected/b1611028-fdb2-48bf-8f36-8109220e3d2c-kube-api-access-2lkqs\") pod \"neutron251c-account-delete-gftsp\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.793881 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican2945-account-delete-lxwxk"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.795249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bac9dbe-2e92-4161-94cf-5f11f3762e00","Type":"ContainerDied","Data":"1c992025fa044e59a758248ad17a279a740364afa4ded1df7466a7f0844e4282"} Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.795352 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.846328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" event={"ID":"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a","Type":"ContainerStarted","Data":"b1576d5bc9e6f250a9a0d712593daea150b1a9613c624a025f3fef0b5707c526"} Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.846684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pld5r\" (UniqueName: \"kubernetes.io/projected/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-kube-api-access-pld5r\") pod \"placementecac-account-delete-qkp2t\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.862500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts\") pod \"barbican2945-account-delete-lxwxk\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.862649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cksp\" (UniqueName: \"kubernetes.io/projected/1a5a57f9-588e-4e9f-9208-895c4131ee2e-kube-api-access-2cksp\") pod \"barbican2945-account-delete-lxwxk\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.862752 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-868h8\" (UniqueName: \"kubernetes.io/projected/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-kube-api-access-868h8\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.892338 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-8nw95"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.917146 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-vv5ns"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.943309 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944000 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-server" containerID="cri-o://945c32e350c847e0aa9da2e6f054178271e0c145ed13e0c0fe29a4c6ea33fdac" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944255 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="swift-recon-cron" containerID="cri-o://cf82826193b6f45df71d06ed96b204d0c5b80c81545d2459bde6c09873109e25" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944321 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="rsync" containerID="cri-o://be39754759fd17a18f604f2728a7893626e52c3515f6214cd5e5e54fef183452" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944393 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-expirer" containerID="cri-o://e2808bd868aeae017a04132a01b7d2e857719666bf85d95a642328026416cf97" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944431 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-updater" containerID="cri-o://0a0d51356029320c9a583d23c45807d7f2663d7ff6c65f47a67e084309bbcd66" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944473 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-auditor" containerID="cri-o://388db589345d573a520830181a6ba64b6bc1cdbade81b8d62c71195efd4ef1c4" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944510 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-replicator" containerID="cri-o://3a14f3d66cae931eea76270308d88fb7ea2a243e0a7122714ca90e92a4890871" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944559 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-server" containerID="cri-o://25e1a54d26ddfb9a829a245940bfcaf7070e32fe5f4ddfcfb2d6f6aeb4ead557" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944604 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-updater" containerID="cri-o://27958e395e51d689bcbd2990abea2442025674f51da66c5dd8d41c22845b6a7e" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944642 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-auditor" containerID="cri-o://45f365205135ce2e01bbfee57ada2f110cd242b7e9e71f898a4ac35789747421" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944679 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-replicator" containerID="cri-o://0d588eda24d0241fbab0826491cc028433f6f2f32fdf6cd4d8affd66af104a68" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944719 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-server" containerID="cri-o://203e48f965912ad353abee711526bb792bbb4e47a16ecc867448217e54b56e0c" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944772 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-reaper" containerID="cri-o://dc7dea0d6dbeaa8c46b2065ff344204b8df21cb9810f401cf24d17ae7ca6afaf" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944814 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-auditor" containerID="cri-o://ca6b15428291fe150460b7d7882eebf311cbba0fcecfb1f7d9f74590dc5fe81b" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.944855 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-replicator" containerID="cri-o://5af4e4a2d044d5cb850f805f8996194bff8c44a4651a70d9a5dd2a8bd18805e3" gracePeriod=30 Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.972379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts\") pod \"barbican2945-account-delete-lxwxk\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.972644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2cksp\" (UniqueName: \"kubernetes.io/projected/1a5a57f9-588e-4e9f-9208-895c4131ee2e-kube-api-access-2cksp\") pod \"barbican2945-account-delete-lxwxk\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.973310 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-vv5ns"] Nov 21 12:16:43 crc kubenswrapper[4769]: I1121 12:16:43.974851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts\") pod \"barbican2945-account-delete-lxwxk\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.005319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican2945-account-delete-lxwxk"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.031335 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-jmrp4"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.053799 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-jmrp4"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.055263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cksp\" (UniqueName: \"kubernetes.io/projected/1a5a57f9-588e-4e9f-9208-895c4131ee2e-kube-api-access-2cksp\") pod \"barbican2945-account-delete-lxwxk\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.068722 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.070058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.070151 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.103182 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-fv7wd"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.125173 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.200678 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.148:8776/healthcheck\": read tcp 10.217.0.2:40628->10.217.0.148:8776: read: connection reset by peer" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.201906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts\") pod \"novaapi2ea5-account-delete-wgzgb\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.203096 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhtx9\" (UniqueName: \"kubernetes.io/projected/b0209b46-f4b0-43f9-ac34-43d89e7ece45-kube-api-access-qhtx9\") pod \"novaapi2ea5-account-delete-wgzgb\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.226464 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.191:8774/\": read tcp 10.217.0.2:52994->10.217.0.191:8774: read: connection reset by peer" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.226957 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.191:8774/\": read tcp 10.217.0.2:53004->10.217.0.191:8774: read: connection reset by peer" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.244803 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.313674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8870a8ea-8869-4eb6-befb-ca059ee3bfd7" (UID: "8870a8ea-8869-4eb6-befb-ca059ee3bfd7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.317663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts\") pod \"novaapi2ea5-account-delete-wgzgb\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.317734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qhtx9\" (UniqueName: \"kubernetes.io/projected/b0209b46-f4b0-43f9-ac34-43d89e7ece45-kube-api-access-qhtx9\") pod \"novaapi2ea5-account-delete-wgzgb\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.317978 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.319353 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7d95c8c454-8fh7j"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.319661 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-api" containerID="cri-o://ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.320083 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-httpd" containerID="cri-o://c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.322282 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts\") pod \"novaapi2ea5-account-delete-wgzgb\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.327240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.339784 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.393247 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-w88t5"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.416491 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-884df8874-pjgwg"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.416989 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-log" containerID="cri-o://b403934044941318e6651375f51ecc36e5f81e00ee82f2ad2b8339c2ccc34436" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.425017 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-api" containerID="cri-o://fb6193feb007cf67b31316497282420398830761390868d037e92991fc17586b" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.464291 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.465866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhtx9\" (UniqueName: \"kubernetes.io/projected/b0209b46-f4b0-43f9-ac34-43d89e7ece45-kube-api-access-qhtx9\") pod \"novaapi2ea5-account-delete-wgzgb\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.494679 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-79dbc96794-9llmc"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.500072 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.188:8775/\": read tcp 10.217.0.2:56996->10.217.0.188:8775: read: connection reset by peer" Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.502881 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.502926 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data podName:4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.50291229 +0000 UTC m=+1565.203574108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data") pod "rabbitmq-server-0" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5") : configmap "rabbitmq-config-data" not found Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.510631 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.188:8775/\": read tcp 10.217.0.2:56982->10.217.0.188:8775: read: connection reset by peer" Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.533892 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.557143 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.557233 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="galera" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.562400 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.564675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.604360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.604432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srtb7\" (UniqueName: \"kubernetes.io/projected/185dd314-18f2-4593-8ffe-5d639f37d8fd-kube-api-access-srtb7\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.604487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.612692 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.633939 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7fc58899d-l4892"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.634333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-httpd" containerID="cri-o://e69a0f0ed22436a34cabf3ecae6cabee67d0e8b122d3a32b210fb84c9c1543b8" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.634549 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-server" containerID="cri-o://337739d7c6d68e563dbc1168d422c8896ff321520b12a745cb41f2efcbf22a32" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.683306 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.684838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.712509 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.717455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker-log" containerID="cri-o://2b55bae3a63d3f831b3a08b94885ec33ff4c786ace9e23aaaba0da7b74ddf29e" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.717650 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker" containerID="cri-o://9d29b00738ee00debbe64c58fd28c69fdbf8efc91ce206a05e709e30b7fcbaca" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.718923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.718989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srtb7\" (UniqueName: \"kubernetes.io/projected/185dd314-18f2-4593-8ffe-5d639f37d8fd-kube-api-access-srtb7\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.719060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.720253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.727948 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.735173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.749324 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d678888-ggtgm"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.773828 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.787124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "8870a8ea-8869-4eb6-befb-ca059ee3bfd7" (UID: "8870a8ea-8869-4eb6-befb-ca059ee3bfd7"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.788382 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srtb7\" (UniqueName: \"kubernetes.io/projected/185dd314-18f2-4593-8ffe-5d639f37d8fd-kube-api-access-srtb7\") pod \"dnsmasq-dnsmasq-84b9f45d47-95qf4\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.802342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-82h5b"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.823279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.823549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.823662 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.823935 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-82h5b"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.839545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "8870a8ea-8869-4eb6-befb-ca059ee3bfd7" (UID: "8870a8ea-8869-4eb6-befb-ca059ee3bfd7"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.865389 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.900277 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.900659 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener-log" containerID="cri-o://e19ea74af62eb79c61648d2fffb4a2f02b7aa934083f7aa2451ae2edceb04ec8" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.901987 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener" containerID="cri-o://da4697819a0b98c949b52673594747ae7b4e374dc77098740107d6b34c0a4dfc" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.931357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.933116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.933441 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8870a8ea-8869-4eb6-befb-ca059ee3bfd7-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.934020 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.934905 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:45.434133513 +0000 UTC m=+1564.134795331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : configmap "openstack-scripts" not found Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.942111 4769 projected.go:194] Error preparing data for projected volume kube-api-access-dn8zt for pod openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:44 crc kubenswrapper[4769]: E1121 12:16:44.942514 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:45.442493768 +0000 UTC m=+1564.143155586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dn8zt" (UniqueName: "kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.968537 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c"] Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.968905 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api-log" containerID="cri-o://a19f4af7a3c8aa8c9c2ae885914cd7399f4163b4393cdbd396bc5759a3350ca6" gracePeriod=30 Nov 21 12:16:44 crc kubenswrapper[4769]: I1121 12:16:44.969468 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api" containerID="cri-o://c8ff59c06e10b72de9bf6a2f468f8a098c670c930fd78d9dd5beaf6ef3f19137" gracePeriod=30 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.019633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-60f3-account-create-xnblr"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.041803 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.047260 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" event={"ID":"0ba7fad1-0c38-4270-8742-6bf0646009cc","Type":"ContainerStarted","Data":"f116a1e141b61332e1ccc5be485e02bf09a9f596a59f6af5816127d8403ab177"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.063532 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.069814 4769 generic.go:334] "Generic (PLEG): container finished" podID="82bc46a0-92fc-4db5-a7db-08ac6812d117" containerID="785eebb05575318089d30427f0a14b802279fa7dfe4562c35ee0ba8ec167d96f" exitCode=2 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.069906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"82bc46a0-92fc-4db5-a7db-08ac6812d117","Type":"ContainerDied","Data":"785eebb05575318089d30427f0a14b802279fa7dfe4562c35ee0ba8ec167d96f"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.077523 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.147:8080/healthcheck\": read tcp 10.217.0.2:54852->10.217.0.147:8080: read: connection reset by peer" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.078010 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.147:8080/healthcheck\": read tcp 10.217.0.2:54844->10.217.0.147:8080: read: connection reset by peer" Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.103383 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.114808 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.114867 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerName="nova-cell0-conductor-conductor" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.116899 4769 generic.go:334] "Generic (PLEG): container finished" podID="9419c5db-b98d-44e8-a7f5-852229976f84" containerID="71bd808cf3109c1c57b0c47ebd57d285135d128165fac4321818df4e0501aba3" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.116999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9419c5db-b98d-44e8-a7f5-852229976f84","Type":"ContainerDied","Data":"71bd808cf3109c1c57b0c47ebd57d285135d128165fac4321818df4e0501aba3"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.146439 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.210316 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-2hs2c"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.219648 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3 is running failed: container process not found" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.229795 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3 is running failed: container process not found" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.238412 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3 is running failed: container process not found" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.238469 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" containerName="nova-scheduler-scheduler" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240661 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="be39754759fd17a18f604f2728a7893626e52c3515f6214cd5e5e54fef183452" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240699 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="e2808bd868aeae017a04132a01b7d2e857719666bf85d95a642328026416cf97" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240709 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="0a0d51356029320c9a583d23c45807d7f2663d7ff6c65f47a67e084309bbcd66" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240720 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="388db589345d573a520830181a6ba64b6bc1cdbade81b8d62c71195efd4ef1c4" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240729 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="3a14f3d66cae931eea76270308d88fb7ea2a243e0a7122714ca90e92a4890871" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240737 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="27958e395e51d689bcbd2990abea2442025674f51da66c5dd8d41c22845b6a7e" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240746 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="45f365205135ce2e01bbfee57ada2f110cd242b7e9e71f898a4ac35789747421" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240752 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="0d588eda24d0241fbab0826491cc028433f6f2f32fdf6cd4d8affd66af104a68" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240759 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="203e48f965912ad353abee711526bb792bbb4e47a16ecc867448217e54b56e0c" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240765 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="dc7dea0d6dbeaa8c46b2065ff344204b8df21cb9810f401cf24d17ae7ca6afaf" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240771 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="ca6b15428291fe150460b7d7882eebf311cbba0fcecfb1f7d9f74590dc5fe81b" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240777 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="5af4e4a2d044d5cb850f805f8996194bff8c44a4651a70d9a5dd2a8bd18805e3" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"be39754759fd17a18f604f2728a7893626e52c3515f6214cd5e5e54fef183452"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240853 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"e2808bd868aeae017a04132a01b7d2e857719666bf85d95a642328026416cf97"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"0a0d51356029320c9a583d23c45807d7f2663d7ff6c65f47a67e084309bbcd66"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"388db589345d573a520830181a6ba64b6bc1cdbade81b8d62c71195efd4ef1c4"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"3a14f3d66cae931eea76270308d88fb7ea2a243e0a7122714ca90e92a4890871"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"27958e395e51d689bcbd2990abea2442025674f51da66c5dd8d41c22845b6a7e"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"45f365205135ce2e01bbfee57ada2f110cd242b7e9e71f898a4ac35789747421"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"0d588eda24d0241fbab0826491cc028433f6f2f32fdf6cd4d8affd66af104a68"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"203e48f965912ad353abee711526bb792bbb4e47a16ecc867448217e54b56e0c"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"dc7dea0d6dbeaa8c46b2065ff344204b8df21cb9810f401cf24d17ae7ca6afaf"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"ca6b15428291fe150460b7d7882eebf311cbba0fcecfb1f7d9f74590dc5fe81b"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.240949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"5af4e4a2d044d5cb850f805f8996194bff8c44a4651a70d9a5dd2a8bd18805e3"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.256115 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.267973 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-gqqcs"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.280826 4769 generic.go:334] "Generic (PLEG): container finished" podID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerID="0f58a7d093708947f264330141cef846704d32a8005d80f147ef2f2cd05b2330" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.318984 4769 generic.go:334] "Generic (PLEG): container finished" podID="56388344-0941-4937-a249-fe91e7e0e0c6" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.402676 4769 generic.go:334] "Generic (PLEG): container finished" podID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerID="39455312801fe2617009399cff2130cf65149aad9326305623cf98c6a2b3a752" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.451251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.451391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.458607 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.458664 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.458641764 +0000 UTC m=+1565.159303582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : configmap "openstack-scripts" not found Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.459774 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerID="bb886765c75dd9fc578ff60a2d8b798cf9f7750dff79b940b8b756cb6765a457" exitCode=0 Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.466816 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.467159 4769 projected.go:194] Error preparing data for projected volume kube-api-access-dn8zt for pod openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.467288 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.467261866 +0000 UTC m=+1565.167923684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn8zt" (UniqueName: "kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.563620 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.645287 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.645361 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerName="nova-cell1-conductor-conductor" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.660878 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerID="b403934044941318e6651375f51ecc36e5f81e00ee82f2ad2b8339c2ccc34436" exitCode=143 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.711348 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" secret="" err="secret \"barbican-barbican-dockercfg-j82mn\" not found" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.737606 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a119cb-174d-44e0-9e8c-1522fd897a83" path="/var/lib/kubelet/pods/02a119cb-174d-44e0-9e8c-1522fd897a83/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.738425 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bfd0ec1-9312-4ce3-8b5f-8a9340736062" path="/var/lib/kubelet/pods/1bfd0ec1-9312-4ce3-8b5f-8a9340736062/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.739129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e1c225c-80d6-4815-a568-84586f607c18" path="/var/lib/kubelet/pods/3e1c225c-80d6-4815-a568-84586f607c18/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.740236 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64f9d792-e28f-47fd-bcaf-8ed581a0aae8" path="/var/lib/kubelet/pods/64f9d792-e28f-47fd-bcaf-8ed581a0aae8/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.740761 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="684fb2d3-5048-4358-9a86-defc40bc3f98" path="/var/lib/kubelet/pods/684fb2d3-5048-4358-9a86-defc40bc3f98/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.741282 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72219b79-7832-4690-973e-ef63273d47b7" path="/var/lib/kubelet/pods/72219b79-7832-4690-973e-ef63273d47b7/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.742445 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c03136-58e9-4dc8-b4db-7ba52267e180" path="/var/lib/kubelet/pods/78c03136-58e9-4dc8-b4db-7ba52267e180/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.743018 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a39442e-588a-4512-a91d-d5a1daa8ea1b" path="/var/lib/kubelet/pods/7a39442e-588a-4512-a91d-d5a1daa8ea1b/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.743755 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f54dca9-53ea-40ef-bfba-6603c5294daf" path="/var/lib/kubelet/pods/7f54dca9-53ea-40ef-bfba-6603c5294daf/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.744443 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" path="/var/lib/kubelet/pods/8870a8ea-8869-4eb6-befb-ca059ee3bfd7/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.745623 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12" path="/var/lib/kubelet/pods/8c4d7230-d308-4b8a-9d4f-04a6dfbf1e12/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.751272 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa6871b-dd1a-4709-88d1-82a8fe102771" path="/var/lib/kubelet/pods/bfa6871b-dd1a-4709-88d1-82a8fe102771/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.751822 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93ebecc-25df-4792-833d-ea6b48e54ed6" path="/var/lib/kubelet/pods/f93ebecc-25df-4792-833d-ea6b48e54ed6/volumes" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"41f05d9d-6645-4531-bca1-e94840a5bc88","Type":"ContainerDied","Data":"0f58a7d093708947f264330141cef846704d32a8005d80f147ef2f2cd05b2330"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752686 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lxd68"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752705 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"56388344-0941-4937-a249-fe91e7e0e0c6","Type":"ContainerDied","Data":"98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752720 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lxd68"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752739 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-zpzck"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752749 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-86b49c8d88-lq6lx"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerDied","Data":"39455312801fe2617009399cff2130cf65149aad9326305623cf98c6a2b3a752"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752781 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-zpzck"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752794 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-886bdb4f7-fq2hm"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752807 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-fgktm"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4bac9dbe-2e92-4161-94cf-5f11f3762e00","Type":"ContainerDied","Data":"7b8f715d4018c20a42727ca0d430abd233e5731d817b85fed71d6eb938b42325"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752844 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b8f715d4018c20a42727ca0d430abd233e5731d817b85fed71d6eb938b42325" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5ed7ff37-6da9-471e-977d-ed0086cbcc42","Type":"ContainerDied","Data":"bb886765c75dd9fc578ff60a2d8b798cf9f7750dff79b940b8b756cb6765a457"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"4be7b12a-19d5-476f-b806-41eb24d461ac","Type":"ContainerDied","Data":"769b9e9be241238dbcb10c0be85b55830fbd7cab94b99ee75afd45a2598e4eb0"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752877 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="769b9e9be241238dbcb10c0be85b55830fbd7cab94b99ee75afd45a2598e4eb0" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" event={"ID":"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35","Type":"ContainerDied","Data":"b403934044941318e6651375f51ecc36e5f81e00ee82f2ad2b8339c2ccc34436"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.752900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" event={"ID":"d5856314-1efb-4026-84a0-f18d4420682e","Type":"ContainerStarted","Data":"d3da256612d18012e177149e2ef5438be46b40c5619f9f15a81fe1cc9b16a290"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.753121 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" podUID="54bead83-c56d-4882-82a2-9188f98b2d79" containerName="keystone-api" containerID="cri-o://fbafc96e6d3dce2d6bffff2fa908082675370a3d13436e13d7b8e6068abcdcb7" gracePeriod=30 Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.786429 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.164:9696/\": read tcp 10.217.0.2:36134->10.217.0.164:9696: read: connection reset by peer" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.791218 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-fgktm"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.797539 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9d9e9e8e-52d3-4601-be5f-84b9ac61697b/ovsdbserver-sb/0.log" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.799788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9d9e9e8e-52d3-4601-be5f-84b9ac61697b","Type":"ContainerDied","Data":"f2626eb6d6cad5639a5f8b36ebe7ee35eefc975c370b189f10971b870e42e5ea"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.799886 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2626eb6d6cad5639a5f8b36ebe7ee35eefc975c370b189f10971b870e42e5ea" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.804331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-4e23-account-create-r7nb6"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.805358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" event={"ID":"75af4712-517b-45d9-981e-30e251a28bb0","Type":"ContainerStarted","Data":"dc7b111068a150068e5e568d701fa0d0c0335c24d806b7046fd1d2c4e235d667"} Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.828320 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-4e23-account-create-r7nb6"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.868610 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.876056 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.876157 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.376136818 +0000 UTC m=+1565.076798636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.876586 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.876623 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.376607081 +0000 UTC m=+1565.077268899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.877001 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.877025 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.377018522 +0000 UTC m=+1565.077680340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.882950 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.895061 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" podStartSLOduration=6.895037596 podStartE2EDuration="6.895037596s" podCreationTimestamp="2025-11-21 12:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:45.780277311 +0000 UTC m=+1564.480939149" watchObservedRunningTime="2025-11-21 12:16:45.895037596 +0000 UTC m=+1564.595699414" Nov 21 12:16:45 crc kubenswrapper[4769]: I1121 12:16:45.960428 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" containerID="cri-o://39a6f77204e9dd9b8eccd52e8103882ae2194706b6b1bddbb9ff9c2215a8432f" gracePeriod=604800 Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.980820 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:45 crc kubenswrapper[4769]: E1121 12:16:45.980900 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data podName:07035577-c371-41ab-b492-4d943dace285 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:46.480882964 +0000 UTC m=+1565.181544872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data") pod "rabbitmq-cell1-server-0" (UID: "07035577-c371-41ab-b492-4d943dace285") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.387728 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.387798 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.387782923 +0000 UTC m=+1566.088444741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.388124 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.388165 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.388155903 +0000 UTC m=+1566.088817721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.388340 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.388443 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.38841806 +0000 UTC m=+1566.089079948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.436165 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.499902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.500541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.500756 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.500916 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:48.500892573 +0000 UTC m=+1567.201554451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : configmap "openstack-scripts" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.501478 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.501631 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data podName:07035577-c371-41ab-b492-4d943dace285 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.501619423 +0000 UTC m=+1566.202281341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data") pod "rabbitmq-cell1-server-0" (UID: "07035577-c371-41ab-b492-4d943dace285") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.514985 4769 projected.go:194] Error preparing data for projected volume kube-api-access-dn8zt for pod openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.515098 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:48.515074485 +0000 UTC m=+1567.215736303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn8zt" (UniqueName: "kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.605646 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: E1121 12:16:46.605718 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data podName:4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:50.605704431 +0000 UTC m=+1569.306366249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data") pod "rabbitmq-server-0" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5") : configmap "rabbitmq-config-data" not found Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.857762 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerID="01a9779ef2ef2b9e782ee5a92d2cd4be9bf6b0bab2fd76223a9ab8b419219d67" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.858385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c5b897fd-dde5-489a-a738-88aa63a4f806","Type":"ContainerDied","Data":"01a9779ef2ef2b9e782ee5a92d2cd4be9bf6b0bab2fd76223a9ab8b419219d67"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.862513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"82bc46a0-92fc-4db5-a7db-08ac6812d117","Type":"ContainerDied","Data":"47b1c77150aabf5d5318458370bf0cc629b177d9fa2edb1c30499e6ac7d8c4ee"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.862554 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47b1c77150aabf5d5318458370bf0cc629b177d9fa2edb1c30499e6ac7d8c4ee" Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.866644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"56388344-0941-4937-a249-fe91e7e0e0c6","Type":"ContainerDied","Data":"5ffbc1f8a607ee27d0fc1b1981f3f05a592a1b9a8d14adf0cb2a7abecb98ed79"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.866688 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ffbc1f8a607ee27d0fc1b1981f3f05a592a1b9a8d14adf0cb2a7abecb98ed79" Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.873927 4769 generic.go:334] "Generic (PLEG): container finished" podID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.874232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"801dd535-e22a-4d31-85b8-c8cdb0c2bed2","Type":"ContainerDied","Data":"c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.894201 4769 generic.go:334] "Generic (PLEG): container finished" podID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerID="89a9a58d2361e0be72d982129d25a0f205081e5dcb8c3c89106166f9b5c55d15" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.895946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db2d38dd-f72e-42d3-b681-674040ed92ba","Type":"ContainerDied","Data":"89a9a58d2361e0be72d982129d25a0f205081e5dcb8c3c89106166f9b5c55d15"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.904459 4769 generic.go:334] "Generic (PLEG): container finished" podID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerID="17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.904542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"b249afc8-1e7a-4537-8778-fc1e56c2afdc","Type":"ContainerDied","Data":"17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.909439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5ed7ff37-6da9-471e-977d-ed0086cbcc42","Type":"ContainerDied","Data":"ff312e343ae570204feb5392894510072021d4c1637a755463bb8774a12d5afd"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.909540 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff312e343ae570204feb5392894510072021d4c1637a755463bb8774a12d5afd" Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.922262 4769 generic.go:334] "Generic (PLEG): container finished" podID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerID="c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.922502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" event={"ID":"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a","Type":"ContainerDied","Data":"c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.957510 4769 generic.go:334] "Generic (PLEG): container finished" podID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerID="337739d7c6d68e563dbc1168d422c8896ff321520b12a745cb41f2efcbf22a32" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.957567 4769 generic.go:334] "Generic (PLEG): container finished" podID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerID="e69a0f0ed22436a34cabf3ecae6cabee67d0e8b122d3a32b210fb84c9c1543b8" exitCode=0 Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.957674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" event={"ID":"d14bc1fc-4621-423c-9dd3-36ea104d0c9f","Type":"ContainerDied","Data":"337739d7c6d68e563dbc1168d422c8896ff321520b12a745cb41f2efcbf22a32"} Nov 21 12:16:46 crc kubenswrapper[4769]: I1121 12:16:46.957722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" event={"ID":"d14bc1fc-4621-423c-9dd3-36ea104d0c9f","Type":"ContainerDied","Data":"e69a0f0ed22436a34cabf3ecae6cabee67d0e8b122d3a32b210fb84c9c1543b8"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.010513 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" exitCode=0 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.010617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2f4e5e5e-6d6e-416a-9457-66f197b04835","Type":"ContainerDied","Data":"8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.014052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"41f05d9d-6645-4531-bca1-e94840a5bc88","Type":"ContainerDied","Data":"befed93acbfe9a9bbdd04ef15887b847a8dfd06fb93dac40bf5629f91ce9503a"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.014073 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="befed93acbfe9a9bbdd04ef15887b847a8dfd06fb93dac40bf5629f91ce9503a" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.015231 4769 generic.go:334] "Generic (PLEG): container finished" podID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerID="a19f4af7a3c8aa8c9c2ae885914cd7399f4163b4393cdbd396bc5759a3350ca6" exitCode=143 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.015266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" event={"ID":"2825ea3d-77e9-4cf1-8d50-c772fe89bc30","Type":"ContainerDied","Data":"a19f4af7a3c8aa8c9c2ae885914cd7399f4163b4393cdbd396bc5759a3350ca6"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.016769 4769 generic.go:334] "Generic (PLEG): container finished" podID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerID="ac2bffbc71c179a071c576298ebb8e06f11415663fce8e4cbe16de16a4e9665d" exitCode=0 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.016781 4769 generic.go:334] "Generic (PLEG): container finished" podID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerID="a2645245eb3ee3eebdf7c967d355d80fe90f95b6d3b5e5b4e4c366cab3e140c3" exitCode=0 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.016810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerDied","Data":"ac2bffbc71c179a071c576298ebb8e06f11415663fce8e4cbe16de16a4e9665d"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.016833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerDied","Data":"a2645245eb3ee3eebdf7c967d355d80fe90f95b6d3b5e5b4e4c366cab3e140c3"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.017921 4769 generic.go:334] "Generic (PLEG): container finished" podID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerID="e19ea74af62eb79c61648d2fffb4a2f02b7aa934083f7aa2451ae2edceb04ec8" exitCode=143 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.017951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" event={"ID":"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd","Type":"ContainerDied","Data":"e19ea74af62eb79c61648d2fffb4a2f02b7aa934083f7aa2451ae2edceb04ec8"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.045934 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="25e1a54d26ddfb9a829a245940bfcaf7070e32fe5f4ddfcfb2d6f6aeb4ead557" exitCode=0 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.045970 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="945c32e350c847e0aa9da2e6f054178271e0c145ed13e0c0fe29a4c6ea33fdac" exitCode=0 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.046010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"25e1a54d26ddfb9a829a245940bfcaf7070e32fe5f4ddfcfb2d6f6aeb4ead557"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.046036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"945c32e350c847e0aa9da2e6f054178271e0c145ed13e0c0fe29a4c6ea33fdac"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.070640 4769 generic.go:334] "Generic (PLEG): container finished" podID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerID="fc34b5b9c89a734a1ca3b777eca08363f055fb209f9d86edd65ba622fa71c3fa" exitCode=0 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.070789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8537fa74-d045-48de-b59b-59d7cab6d5fb","Type":"ContainerDied","Data":"fc34b5b9c89a734a1ca3b777eca08363f055fb209f9d86edd65ba622fa71c3fa"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.070827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8537fa74-d045-48de-b59b-59d7cab6d5fb","Type":"ContainerDied","Data":"57fee683ae8d697600a73d3837c230c8456cc313f6be6863543327a7a587230d"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.070844 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57fee683ae8d697600a73d3837c230c8456cc313f6be6863543327a7a587230d" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.098790 4769 generic.go:334] "Generic (PLEG): container finished" podID="da4c93fc-884b-4701-b589-da46434544d4" containerID="2b55bae3a63d3f831b3a08b94885ec33ff4c786ace9e23aaaba0da7b74ddf29e" exitCode=143 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.098932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" event={"ID":"da4c93fc-884b-4701-b589-da46434544d4","Type":"ContainerDied","Data":"2b55bae3a63d3f831b3a08b94885ec33ff4c786ace9e23aaaba0da7b74ddf29e"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.129637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9419c5db-b98d-44e8-a7f5-852229976f84","Type":"ContainerDied","Data":"da82e76dd7554e8e3d1e0435d59e6b0cc052ae998aedf26f5ee5d0d942152866"} Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.129690 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da82e76dd7554e8e3d1e0435d59e6b0cc052ae998aedf26f5ee5d0d942152866" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.129809 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener-log" containerID="cri-o://d4b38b2f0a74bcdc04513afd3ca43875e7a1c81a107b6af5ac333109a5f72d0a" gracePeriod=30 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.130530 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener" containerID="cri-o://d3da256612d18012e177149e2ef5438be46b40c5619f9f15a81fe1cc9b16a290" gracePeriod=30 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.194615 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" secret="" err="secret \"galera-openstack-dockercfg-jlgq8\" not found" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.195029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.198835 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="rabbitmq" containerID="cri-o://5e7d206d799633d2293ea1c3e7fd6b27165e4608e8d950efc6bb43320c259bb3" gracePeriod=604800 Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.237993 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" secret="" err="secret \"galera-openstack-dockercfg-jlgq8\" not found" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.238058 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.275768 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" secret="" err="secret \"galera-openstack-dockercfg-jlgq8\" not found" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.275900 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.276539 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.297031 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f91bd88-e10d-4afc-8719-7a0f28279581" path="/var/lib/kubelet/pods/3f91bd88-e10d-4afc-8719-7a0f28279581/volumes" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.297710 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f8e740-e416-47dd-98c9-05569f6de12a" path="/var/lib/kubelet/pods/78f8e740-e416-47dd-98c9-05569f6de12a/volumes" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.298284 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0" path="/var/lib/kubelet/pods/c2f7720a-03a0-4a8a-b9fc-8dc0d80618a0/volumes" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.298841 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c089ca-2a3c-419c-9096-ecc827a54255" path="/var/lib/kubelet/pods/f2c089ca-2a3c-419c-9096-ecc827a54255/volumes" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.352683 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" secret="" err="secret \"galera-openstack-dockercfg-jlgq8\" not found" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.352762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.360318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68hjm\" (UniqueName: \"kubernetes.io/projected/4bac9dbe-2e92-4161-94cf-5f11f3762e00-kube-api-access-68hjm\") pod \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.360390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-vencrypt-tls-certs\") pod \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.360434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-combined-ca-bundle\") pod \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.360536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-nova-novncproxy-tls-certs\") pod \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.360610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-config-data\") pod \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\" (UID: \"4bac9dbe-2e92-4161-94cf-5f11f3762e00\") " Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.361242 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.361302 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts podName:b1611028-fdb2-48bf-8f36-8109220e3d2c nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.861286954 +0000 UTC m=+1566.561948772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts") pod "neutron251c-account-delete-gftsp" (UID: "b1611028-fdb2-48bf-8f36-8109220e3d2c") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.366251 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.366870 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts podName:07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.866849084 +0000 UTC m=+1566.567511092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts") pod "placementecac-account-delete-qkp2t" (UID: "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.366484 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.367219 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts podName:1a5a57f9-588e-4e9f-9208-895c4131ee2e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.867207954 +0000 UTC m=+1566.567869772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts") pod "barbican2945-account-delete-lxwxk" (UID: "1a5a57f9-588e-4e9f-9208-895c4131ee2e") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.369567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bac9dbe-2e92-4161-94cf-5f11f3762e00-kube-api-access-68hjm" (OuterVolumeSpecName: "kube-api-access-68hjm") pod "4bac9dbe-2e92-4161-94cf-5f11f3762e00" (UID: "4bac9dbe-2e92-4161-94cf-5f11f3762e00"). InnerVolumeSpecName "kube-api-access-68hjm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.370299 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.390516 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9d9e9e8e-52d3-4601-be5f-84b9ac61697b/ovsdbserver-sb/0.log" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.391202 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.462795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-metrics-certs-tls-certs\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463241 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-memcached-tls-certs\") pod \"4be7b12a-19d5-476f-b806-41eb24d461ac\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdb-rundir\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-kolla-config\") pod \"4be7b12a-19d5-476f-b806-41eb24d461ac\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs6qp\" (UniqueName: \"kubernetes.io/projected/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-kube-api-access-vs6qp\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzqxd\" (UniqueName: \"kubernetes.io/projected/4be7b12a-19d5-476f-b806-41eb24d461ac-kube-api-access-vzqxd\") pod \"4be7b12a-19d5-476f-b806-41eb24d461ac\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.464029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-config\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.464143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-scripts\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.464519 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-config-data\") pod \"4be7b12a-19d5-476f-b806-41eb24d461ac\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.464690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdbserver-sb-tls-certs\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.464798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-combined-ca-bundle\") pod \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\" (UID: \"9d9e9e8e-52d3-4601-be5f-84b9ac61697b\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.464906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-combined-ca-bundle\") pod \"4be7b12a-19d5-476f-b806-41eb24d461ac\" (UID: \"4be7b12a-19d5-476f-b806-41eb24d461ac\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.463930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.466620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-config-data" (OuterVolumeSpecName: "config-data") pod "4be7b12a-19d5-476f-b806-41eb24d461ac" (UID: "4be7b12a-19d5-476f-b806-41eb24d461ac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.467070 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "4be7b12a-19d5-476f-b806-41eb24d461ac" (UID: "4be7b12a-19d5-476f-b806-41eb24d461ac"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.467723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-scripts" (OuterVolumeSpecName: "scripts") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.467912 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468013 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468085 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468154 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468180 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:49.468159698 +0000 UTC m=+1568.168821516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468263 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts podName:b0209b46-f4b0-43f9-ac34-43d89e7ece45 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:47.96825598 +0000 UTC m=+1566.668917798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts") pod "novaapi2ea5-account-delete-wgzgb" (UID: "b0209b46-f4b0-43f9-ac34-43d89e7ece45") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468461 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:49.468434785 +0000 UTC m=+1568.169096593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.468561 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:49.468547968 +0000 UTC m=+1568.169209786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.468598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-config" (OuterVolumeSpecName: "config") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.468992 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.469007 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68hjm\" (UniqueName: \"kubernetes.io/projected/4bac9dbe-2e92-4161-94cf-5f11f3762e00-kube-api-access-68hjm\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.469017 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.469028 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.469037 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.469046 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4be7b12a-19d5-476f-b806-41eb24d461ac-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.499474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.511914 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-kube-api-access-vs6qp" (OuterVolumeSpecName: "kube-api-access-vs6qp") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "kube-api-access-vs6qp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.537955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-config-data" (OuterVolumeSpecName: "config-data") pod "4bac9dbe-2e92-4161-94cf-5f11f3762e00" (UID: "4bac9dbe-2e92-4161-94cf-5f11f3762e00"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.544348 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.562503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be7b12a-19d5-476f-b806-41eb24d461ac-kube-api-access-vzqxd" (OuterVolumeSpecName: "kube-api-access-vzqxd") pod "4be7b12a-19d5-476f-b806-41eb24d461ac" (UID: "4be7b12a-19d5-476f-b806-41eb24d461ac"). InnerVolumeSpecName "kube-api-access-vzqxd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.575500 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.575547 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vzqxd\" (UniqueName: \"kubernetes.io/projected/4be7b12a-19d5-476f-b806-41eb24d461ac-kube-api-access-vzqxd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.575561 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vs6qp\" (UniqueName: \"kubernetes.io/projected/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-kube-api-access-vs6qp\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.575586 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.576271 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.576333 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data podName:07035577-c371-41ab-b492-4d943dace285 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:49.576311635 +0000 UTC m=+1568.276973453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data") pod "rabbitmq-cell1-server-0" (UID: "07035577-c371-41ab-b492-4d943dace285") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.599139 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.606316 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.636026 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glancece7b-account-delete-rq256"] Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-combined-ca-bundle\") pod \"82bc46a0-92fc-4db5-a7db-08ac6812d117\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676361 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-certs\") pod \"82bc46a0-92fc-4db5-a7db-08ac6812d117\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-nova-metadata-tls-certs\") pod \"9419c5db-b98d-44e8-a7f5-852229976f84\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676491 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9419c5db-b98d-44e8-a7f5-852229976f84-logs\") pod \"9419c5db-b98d-44e8-a7f5-852229976f84\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-959j2\" (UniqueName: \"kubernetes.io/projected/9419c5db-b98d-44e8-a7f5-852229976f84-kube-api-access-959j2\") pod \"9419c5db-b98d-44e8-a7f5-852229976f84\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-combined-ca-bundle\") pod \"9419c5db-b98d-44e8-a7f5-852229976f84\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-config-data\") pod \"9419c5db-b98d-44e8-a7f5-852229976f84\" (UID: \"9419c5db-b98d-44e8-a7f5-852229976f84\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-config\") pod \"82bc46a0-92fc-4db5-a7db-08ac6812d117\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.676865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szh5h\" (UniqueName: \"kubernetes.io/projected/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-api-access-szh5h\") pod \"82bc46a0-92fc-4db5-a7db-08ac6812d117\" (UID: \"82bc46a0-92fc-4db5-a7db-08ac6812d117\") " Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.677856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9419c5db-b98d-44e8-a7f5-852229976f84-logs" (OuterVolumeSpecName: "logs") pod "9419c5db-b98d-44e8-a7f5-852229976f84" (UID: "9419c5db-b98d-44e8-a7f5-852229976f84"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.784011 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9419c5db-b98d-44e8-a7f5-852229976f84-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.800372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-api-access-szh5h" (OuterVolumeSpecName: "kube-api-access-szh5h") pod "82bc46a0-92fc-4db5-a7db-08ac6812d117" (UID: "82bc46a0-92fc-4db5-a7db-08ac6812d117"). InnerVolumeSpecName "kube-api-access-szh5h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.820540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9419c5db-b98d-44e8-a7f5-852229976f84-kube-api-access-959j2" (OuterVolumeSpecName: "kube-api-access-959j2") pod "9419c5db-b98d-44e8-a7f5-852229976f84" (UID: "9419c5db-b98d-44e8-a7f5-852229976f84"). InnerVolumeSpecName "kube-api-access-959j2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.820811 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bd78p"] Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.839311 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bd78p"] Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.854332 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-9405-account-create-bqkzz"] Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.887074 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-959j2\" (UniqueName: \"kubernetes.io/projected/9419c5db-b98d-44e8-a7f5-852229976f84-kube-api-access-959j2\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.887110 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-szh5h\" (UniqueName: \"kubernetes.io/projected/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-api-access-szh5h\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.887183 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.887259 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts podName:07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b nodeName:}" failed. No retries permitted until 2025-11-21 12:16:48.887241795 +0000 UTC m=+1567.587903613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts") pod "placementecac-account-delete-qkp2t" (UID: "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.887620 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.887651 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts podName:1a5a57f9-588e-4e9f-9208-895c4131ee2e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:48.887642045 +0000 UTC m=+1567.588303863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts") pod "barbican2945-account-delete-lxwxk" (UID: "1a5a57f9-588e-4e9f-9208-895c4131ee2e") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.887686 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.887711 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts podName:b1611028-fdb2-48bf-8f36-8109220e3d2c nodeName:}" failed. No retries permitted until 2025-11-21 12:16:48.887703907 +0000 UTC m=+1567.588365725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts") pod "neutron251c-account-delete-gftsp" (UID: "b1611028-fdb2-48bf-8f36-8109220e3d2c") : configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.889266 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-9405-account-create-bqkzz"] Nov 21 12:16:47 crc kubenswrapper[4769]: I1121 12:16:47.902333 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder9405-account-delete-6l74g"] Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.993078 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:47 crc kubenswrapper[4769]: E1121 12:16:47.993171 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts podName:b0209b46-f4b0-43f9-ac34-43d89e7ece45 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:48.993147622 +0000 UTC m=+1567.693809450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts") pod "novaapi2ea5-account-delete-wgzgb" (UID: "b0209b46-f4b0-43f9-ac34-43d89e7ece45") : configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.067327 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-f5bnz"] Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.111523 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.116274 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-f5bnz"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.131316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glancece7b-account-delete-rq256"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.145303 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-ce7b-account-create-dch75"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.148964 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-ce7b-account-create-dch75"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.189992 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder9405-account-delete-6l74g"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.196416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4be7b12a-19d5-476f-b806-41eb24d461ac" (UID: "4be7b12a-19d5-476f-b806-41eb24d461ac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.196893 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.202012 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.205228 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.205288 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.233849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c5b897fd-dde5-489a-a738-88aa63a4f806","Type":"ContainerDied","Data":"340972b90372bca15c04b434cbd36a53f4c451187b9be9aa9e6137974eded67c"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.233897 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="340972b90372bca15c04b434cbd36a53f4c451187b9be9aa9e6137974eded67c" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.239317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" event={"ID":"0ba7fad1-0c38-4270-8742-6bf0646009cc","Type":"ContainerStarted","Data":"1ac15273050e574736d66f32b58a455ffd412210252313f77f768cad3b6fc81b"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.239482 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-log" containerID="cri-o://f116a1e141b61332e1ccc5be485e02bf09a9f596a59f6af5816127d8403ab177" gracePeriod=30 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.239737 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.239766 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.240069 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-api" containerID="cri-o://1ac15273050e574736d66f32b58a455ffd412210252313f77f768cad3b6fc81b" gracePeriod=30 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.247729 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-n6jck"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.253312 4769 generic.go:334] "Generic (PLEG): container finished" podID="da4c93fc-884b-4701-b589-da46434544d4" containerID="9d29b00738ee00debbe64c58fd28c69fdbf8efc91ce206a05e709e30b7fcbaca" exitCode=0 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.253670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" event={"ID":"da4c93fc-884b-4701-b589-da46434544d4","Type":"ContainerDied","Data":"9d29b00738ee00debbe64c58fd28c69fdbf8efc91ce206a05e709e30b7fcbaca"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.253704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" event={"ID":"da4c93fc-884b-4701-b589-da46434544d4","Type":"ContainerDied","Data":"14bc557e29737507143657deac22f3327bc01dc92dca6104838ae7e667090637"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.253717 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14bc557e29737507143657deac22f3327bc01dc92dca6104838ae7e667090637" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.261943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" event={"ID":"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a","Type":"ContainerStarted","Data":"c64b750efe1f46566969ada9c8a74f4196860d945c7762428a19b670b2b5ab22"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.262279 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" podUID="5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" containerName="keystone-api" containerID="cri-o://c64b750efe1f46566969ada9c8a74f4196860d945c7762428a19b670b2b5ab22" gracePeriod=30 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.262689 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.271557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "4bac9dbe-2e92-4161-94cf-5f11f3762e00" (UID: "4bac9dbe-2e92-4161-94cf-5f11f3762e00"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.274669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" event={"ID":"27fe312f-1788-4660-b46f-ac049f1529c9","Type":"ContainerStarted","Data":"6abebb8b75186165071463b8399f2424389f2760c4579f82b728e49106552a9a"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.288421 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-n6jck"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.309708 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.311622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b122f86f-b55d-4234-a61e-de0aabcf6760","Type":"ContainerDied","Data":"41a9c7d9650adaf65d5bf5b970e26502c2564e4f029c5f297cce95a3d00ae100"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.311662 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41a9c7d9650adaf65d5bf5b970e26502c2564e4f029c5f297cce95a3d00ae100" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.315005 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.323174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4bac9dbe-2e92-4161-94cf-5f11f3762e00" (UID: "4bac9dbe-2e92-4161-94cf-5f11f3762e00"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.328170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" event={"ID":"d14bc1fc-4621-423c-9dd3-36ea104d0c9f","Type":"ContainerDied","Data":"b7409e6ff55a99bd8121c4d07a60823a465a4605e8880ea133157a277b130175"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.328240 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7409e6ff55a99bd8121c4d07a60823a465a4605e8880ea133157a277b130175" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.350540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2f4e5e5e-6d6e-416a-9457-66f197b04835","Type":"ContainerDied","Data":"6edf60b70be43ea0bd340af5af093b9c997e6be254c417416570915271e84d07"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.350580 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6edf60b70be43ea0bd340af5af093b9c997e6be254c417416570915271e84d07" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.354920 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-251c-account-create-fzhbb"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.361456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" event={"ID":"4ff3caad-9d87-4e02-abd3-e6148084a692","Type":"ContainerStarted","Data":"796c9938e272dfa1ad0e8012c80dd458df641b93033d3f332159f1f3980c2792"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.365480 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron251c-account-delete-gftsp"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.374102 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-251c-account-create-fzhbb"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.377125 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" podStartSLOduration=9.377100824 podStartE2EDuration="9.377100824s" podCreationTimestamp="2025-11-21 12:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:48.266605783 +0000 UTC m=+1566.967267601" watchObservedRunningTime="2025-11-21 12:16:48.377100824 +0000 UTC m=+1567.077762642" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.396143 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-g6d54"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.402030 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" podStartSLOduration=8.402006964 podStartE2EDuration="8.402006964s" podCreationTimestamp="2025-11-21 12:16:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:48.30442285 +0000 UTC m=+1567.005084658" watchObservedRunningTime="2025-11-21 12:16:48.402006964 +0000 UTC m=+1567.102668782" Nov 21 12:16:48 crc kubenswrapper[4769]: W1121 12:16:48.410713 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9cb03d6_db43_4569_b583_7d2cd315dbc6.slice/crio-112f2d70becfc1a9204db796f0b497914f5f585ac7955eb623ffcccd096e397a WatchSource:0}: Error finding container 112f2d70becfc1a9204db796f0b497914f5f585ac7955eb623ffcccd096e397a: Status 404 returned error can't find the container with id 112f2d70becfc1a9204db796f0b497914f5f585ac7955eb623ffcccd096e397a Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.410842 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.142:9311/healthcheck\": read tcp 10.217.0.2:60942->10.217.0.142:9311: read: connection reset by peer" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.411215 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.142:9311/healthcheck\": read tcp 10.217.0.2:60930->10.217.0.142:9311: read: connection reset by peer" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.411479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"b249afc8-1e7a-4537-8778-fc1e56c2afdc","Type":"ContainerDied","Data":"422333d39139dcf503dad953d5de00e9bb2cc3af39db6805ad1d6cbcde877b97"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.411507 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="422333d39139dcf503dad953d5de00e9bb2cc3af39db6805ad1d6cbcde877b97" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.411617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-config-data" (OuterVolumeSpecName: "config-data") pod "9419c5db-b98d-44e8-a7f5-852229976f84" (UID: "9419c5db-b98d-44e8-a7f5-852229976f84"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.412025 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.412049 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.412059 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.422673 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-g6d54"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.448278 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementecac-account-delete-qkp2t"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.462257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"801dd535-e22a-4d31-85b8-c8cdb0c2bed2","Type":"ContainerDied","Data":"d8613a9252ebb6738af2ef2135ba771ceb48a9ecb0217abbd802cf2e5e72f83e"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.462309 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8613a9252ebb6738af2ef2135ba771ceb48a9ecb0217abbd802cf2e5e72f83e" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.467500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9419c5db-b98d-44e8-a7f5-852229976f84" (UID: "9419c5db-b98d-44e8-a7f5-852229976f84"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.487377 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-ecac-account-create-j4bjc"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.495651 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5856314-1efb-4026-84a0-f18d4420682e" containerID="d4b38b2f0a74bcdc04513afd3ca43875e7a1c81a107b6af5ac333109a5f72d0a" exitCode=143 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.495736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" event={"ID":"d5856314-1efb-4026-84a0-f18d4420682e","Type":"ContainerDied","Data":"d4b38b2f0a74bcdc04513afd3ca43875e7a1c81a107b6af5ac333109a5f72d0a"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.517619 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerID="016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f" exitCode=0 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.517742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b6385ef-77f7-4187-abae-725f7c9c6090","Type":"ContainerDied","Data":"016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.527453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.527669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.527733 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.527802 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.527851 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:52.527836966 +0000 UTC m=+1571.228498784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.528294 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-ecac-account-create-j4bjc"] Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.537585 4769 projected.go:194] Error preparing data for projected volume kube-api-access-dn8zt for pod openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.537665 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:52.5376442 +0000 UTC m=+1571.238306018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn8zt" (UniqueName: "kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.541209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" event={"ID":"ddf92e36-0f72-42e5-9a43-a4c62def4273","Type":"ContainerStarted","Data":"77a24c7e4374cb102e6e55368833596a67d6671d305260a07e3eae1ea49034ea"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.541400 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker-log" containerID="cri-o://a5620e44e4048ff79526ea7eb83d69080f71db4027cb278c5fae33246445abc9" gracePeriod=30 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.541777 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker" containerID="cri-o://77a24c7e4374cb102e6e55368833596a67d6671d305260a07e3eae1ea49034ea" gracePeriod=30 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.542932 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-lrkl8"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.556249 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.560524 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-lrkl8"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.575567 4769 generic.go:334] "Generic (PLEG): container finished" podID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerID="da4697819a0b98c949b52673594747ae7b4e374dc77098740107d6b34c0a4dfc" exitCode=0 Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.575656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" event={"ID":"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd","Type":"ContainerDied","Data":"da4697819a0b98c949b52673594747ae7b4e374dc77098740107d6b34c0a4dfc"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.590714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" event={"ID":"75af4712-517b-45d9-981e-30e251a28bb0","Type":"ContainerStarted","Data":"916d98f663ba6263039a2c39855de0d1d9fa14e0ed53c268bb35114528811668"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.600423 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican2945-account-delete-lxwxk"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.605006 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.605981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db2d38dd-f72e-42d3-b681-674040ed92ba","Type":"ContainerDied","Data":"ccdcecbef6f0c2fe210b903c2c8d36a3518ac655a6e59ca4ed3d0ff916452bca"} Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.606023 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccdcecbef6f0c2fe210b903c2c8d36a3518ac655a6e59ca4ed3d0ff916452bca" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.606085 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.606397 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.606693 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.606918 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.617214 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-2945-account-create-pqcv9"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.626860 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.631015 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.643005 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-2945-account-create-pqcv9"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.653314 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" podStartSLOduration=9.653262149 podStartE2EDuration="9.653262149s" podCreationTimestamp="2025-11-21 12:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:48.573895415 +0000 UTC m=+1567.274557233" watchObservedRunningTime="2025-11-21 12:16:48.653262149 +0000 UTC m=+1567.353923987" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.685672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "82bc46a0-92fc-4db5-a7db-08ac6812d117" (UID: "82bc46a0-92fc-4db5-a7db-08ac6812d117"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.705458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.707350 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-2qcvq"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.715631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "82bc46a0-92fc-4db5-a7db-08ac6812d117" (UID: "82bc46a0-92fc-4db5-a7db-08ac6812d117"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.734727 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.736556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-combined-ca-bundle\") pod \"56388344-0941-4937-a249-fe91e7e0e0c6\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.736611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29tdg\" (UniqueName: \"kubernetes.io/projected/56388344-0941-4937-a249-fe91e7e0e0c6-kube-api-access-29tdg\") pod \"56388344-0941-4937-a249-fe91e7e0e0c6\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.736691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-config-data\") pod \"56388344-0941-4937-a249-fe91e7e0e0c6\" (UID: \"56388344-0941-4937-a249-fe91e7e0e0c6\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.738370 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.738398 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.738410 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.747998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.772981 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-2qcvq"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.793750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56388344-0941-4937-a249-fe91e7e0e0c6-kube-api-access-29tdg" (OuterVolumeSpecName: "kube-api-access-29tdg") pod "56388344-0941-4937-a249-fe91e7e0e0c6" (UID: "56388344-0941-4937-a249-fe91e7e0e0c6"). InnerVolumeSpecName "kube-api-access-29tdg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.809141 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron251c-account-delete-gftsp"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.832823 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.841768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-scripts\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.841840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.841880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41f05d9d-6645-4531-bca1-e94840a5bc88-etc-machine-id\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.841954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.841997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z5gs\" (UniqueName: \"kubernetes.io/projected/41f05d9d-6645-4531-bca1-e94840a5bc88-kube-api-access-8z5gs\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-internal-tls-certs\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-httpd-run\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-internal-tls-certs\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/41f05d9d-6645-4531-bca1-e94840a5bc88-logs\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data-custom\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sxlg\" (UniqueName: \"kubernetes.io/projected/8537fa74-d045-48de-b59b-59d7cab6d5fb-kube-api-access-2sxlg\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842250 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-scripts\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842344 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-combined-ca-bundle\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842380 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-config-data\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-combined-ca-bundle\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-logs\") pod \"8537fa74-d045-48de-b59b-59d7cab6d5fb\" (UID: \"8537fa74-d045-48de-b59b-59d7cab6d5fb\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.842504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-public-tls-certs\") pod \"41f05d9d-6645-4531-bca1-e94840a5bc88\" (UID: \"41f05d9d-6645-4531-bca1-e94840a5bc88\") " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.844600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f05d9d-6645-4531-bca1-e94840a5bc88-logs" (OuterVolumeSpecName: "logs") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.844672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/41f05d9d-6645-4531-bca1-e94840a5bc88-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.846892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "4bac9dbe-2e92-4161-94cf-5f11f3762e00" (UID: "4bac9dbe-2e92-4161-94cf-5f11f3762e00"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.864594 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.864697 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-2ea5-account-create-fswnr"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.864728 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican2945-account-delete-lxwxk"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.878996 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-29tdg\" (UniqueName: \"kubernetes.io/projected/56388344-0941-4937-a249-fe91e7e0e0c6-kube-api-access-29tdg\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.879036 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/41f05d9d-6645-4531-bca1-e94840a5bc88-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.879047 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bac9dbe-2e92-4161-94cf-5f11f3762e00-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.879056 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/41f05d9d-6645-4531-bca1-e94840a5bc88-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.882242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.882358 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.183:6080/vnc_lite.html\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.882415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-logs" (OuterVolumeSpecName: "logs") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.927531 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-bknpf"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.934627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f05d9d-6645-4531-bca1-e94840a5bc88-kube-api-access-8z5gs" (OuterVolumeSpecName: "kube-api-access-8z5gs") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "kube-api-access-8z5gs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.934733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-scripts" (OuterVolumeSpecName: "scripts") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.935075 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8537fa74-d045-48de-b59b-59d7cab6d5fb-kube-api-access-2sxlg" (OuterVolumeSpecName: "kube-api-access-2sxlg") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "kube-api-access-2sxlg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.936919 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-bknpf"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.944549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.954958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.957278 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd"] Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.958487 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dn8zt operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" podUID="6f8129d1-7fcc-4f40-8f52-df287de84e48" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.961619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-scripts" (OuterVolumeSpecName: "scripts") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.961635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "82bc46a0-92fc-4db5-a7db-08ac6812d117" (UID: "82bc46a0-92fc-4db5-a7db-08ac6812d117"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.969914 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.976964 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-d8c4-account-create-8fwmk"] Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981006 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/82bc46a0-92fc-4db5-a7db-08ac6812d117-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981046 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981077 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981091 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8z5gs\" (UniqueName: \"kubernetes.io/projected/41f05d9d-6645-4531-bca1-e94840a5bc88-kube-api-access-8z5gs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981103 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981117 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981129 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2sxlg\" (UniqueName: \"kubernetes.io/projected/8537fa74-d045-48de-b59b-59d7cab6d5fb-kube-api-access-2sxlg\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981140 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: I1121 12:16:48.981152 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8537fa74-d045-48de-b59b-59d7cab6d5fb-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.983749 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.983853 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts podName:1a5a57f9-588e-4e9f-9208-895c4131ee2e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:50.983832336 +0000 UTC m=+1569.684494224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts") pod "barbican2945-account-delete-lxwxk" (UID: "1a5a57f9-588e-4e9f-9208-895c4131ee2e") : configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.984510 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.984587 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts podName:b1611028-fdb2-48bf-8f36-8109220e3d2c nodeName:}" failed. No retries permitted until 2025-11-21 12:16:50.984567715 +0000 UTC m=+1569.685229533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts") pod "neutron251c-account-delete-gftsp" (UID: "b1611028-fdb2-48bf-8f36-8109220e3d2c") : configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.984619 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:48 crc kubenswrapper[4769]: E1121 12:16:48.984637 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts podName:07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b nodeName:}" failed. No retries permitted until 2025-11-21 12:16:50.984631897 +0000 UTC m=+1569.685293705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts") pod "placementecac-account-delete-qkp2t" (UID: "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b") : configmap "openstack-scripts" not found Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.048594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9419c5db-b98d-44e8-a7f5-852229976f84" (UID: "9419c5db-b98d-44e8-a7f5-852229976f84"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: W1121 12:16:49.064421 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a5a57f9_588e_4e9f_9208_895c4131ee2e.slice/crio-b77ed26dc641f5b4bd154271aa704119e7b0457a663fcd73a032fe2e41729314 WatchSource:0}: Error finding container b77ed26dc641f5b4bd154271aa704119e7b0457a663fcd73a032fe2e41729314: Status 404 returned error can't find the container with id b77ed26dc641f5b4bd154271aa704119e7b0457a663fcd73a032fe2e41729314 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.086535 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9419c5db-b98d-44e8-a7f5-852229976f84-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.086653 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.086730 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts podName:b0209b46-f4b0-43f9-ac34-43d89e7ece45 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:51.086694911 +0000 UTC m=+1569.787356729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts") pod "novaapi2ea5-account-delete-wgzgb" (UID: "b0209b46-f4b0-43f9-ac34-43d89e7ece45") : configmap "openstack-scripts" not found Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.107634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.193175 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.217668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-config-data" (OuterVolumeSpecName: "config-data") pod "56388344-0941-4937-a249-fe91e7e0e0c6" (UID: "56388344-0941-4937-a249-fe91e7e0e0c6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.290925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "9d9e9e8e-52d3-4601-be5f-84b9ac61697b" (UID: "9d9e9e8e-52d3-4601-be5f-84b9ac61697b"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.295171 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d9e9e8e-52d3-4601-be5f-84b9ac61697b-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.295358 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.313750 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bef931-fe95-4aab-bd14-1f8778a37b34" path="/var/lib/kubelet/pods/00bef931-fe95-4aab-bd14-1f8778a37b34/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.314489 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9ed887-de46-48bc-b63e-dd92b455648e" path="/var/lib/kubelet/pods/0e9ed887-de46-48bc-b63e-dd92b455648e/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.315130 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13eb83d2-1076-4627-8f43-1c6972e0f779" path="/var/lib/kubelet/pods/13eb83d2-1076-4627-8f43-1c6972e0f779/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.315701 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="143a02da-24a6-41aa-91ba-21acfb688994" path="/var/lib/kubelet/pods/143a02da-24a6-41aa-91ba-21acfb688994/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.316708 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1865ea5b-bdb8-4d52-a805-30f4a0a870a1" path="/var/lib/kubelet/pods/1865ea5b-bdb8-4d52-a805-30f4a0a870a1/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.317294 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5778d34a-8bd2-4869-b078-46c8131756c3" path="/var/lib/kubelet/pods/5778d34a-8bd2-4869-b078-46c8131756c3/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.317899 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc07ccc-96e2-45fd-a7df-2f659e62a28c" path="/var/lib/kubelet/pods/5bc07ccc-96e2-45fd-a7df-2f659e62a28c/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.321669 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ecbc593-a1f2-412e-b4b7-f1a3d486daa9" path="/var/lib/kubelet/pods/5ecbc593-a1f2-412e-b4b7-f1a3d486daa9/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.322181 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69bf973c-6676-43f5-b866-9932164c3793" path="/var/lib/kubelet/pods/69bf973c-6676-43f5-b866-9932164c3793/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.322765 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad94a70c-4882-4641-928f-bfb6690c7dd9" path="/var/lib/kubelet/pods/ad94a70c-4882-4641-928f-bfb6690c7dd9/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.325366 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c570fccc-0d70-42a9-b6ef-a4d5047dee75" path="/var/lib/kubelet/pods/c570fccc-0d70-42a9-b6ef-a4d5047dee75/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.325966 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5fa9b0-6546-4c9d-82af-04a085249145" path="/var/lib/kubelet/pods/cc5fa9b0-6546-4c9d-82af-04a085249145/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.326642 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de487392-74bb-41d7-bdad-637781c45a34" path="/var/lib/kubelet/pods/de487392-74bb-41d7-bdad-637781c45a34/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.327396 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e07a0768-f1e7-47aa-a73e-c856a641c621" path="/var/lib/kubelet/pods/e07a0768-f1e7-47aa-a73e-c856a641c621/volumes" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.347482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.352928 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.393339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56388344-0941-4937-a249-fe91e7e0e0c6" (UID: "56388344-0941-4937-a249-fe91e7e0e0c6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.405705 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.405732 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56388344-0941-4937-a249-fe91e7e0e0c6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.405742 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.444340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "4be7b12a-19d5-476f-b806-41eb24d461ac" (UID: "4be7b12a-19d5-476f-b806-41eb24d461ac"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.508431 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.508555 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:53.508532842 +0000 UTC m=+1572.209194660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.509114 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.509151 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:53.509143458 +0000 UTC m=+1572.209805276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.509439 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/4be7b12a-19d5-476f-b806-41eb24d461ac-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.509493 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.509517 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:53.509510848 +0000 UTC m=+1572.210172666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.521442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.526387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.618865 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.618885 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.618945 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:49 crc kubenswrapper[4769]: E1121 12:16:49.618985 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data podName:07035577-c371-41ab-b492-4d943dace285 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:53.618970831 +0000 UTC m=+1572.319632649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data") pod "rabbitmq-cell1-server-0" (UID: "07035577-c371-41ab-b492-4d943dace285") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.625093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.629216 4769 generic.go:334] "Generic (PLEG): container finished" podID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerID="c8ff59c06e10b72de9bf6a2f468f8a098c670c930fd78d9dd5beaf6ef3f19137" exitCode=0 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.632317 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerID="fb6193feb007cf67b31316497282420398830761390868d037e92991fc17586b" exitCode=0 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.652117 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerID="a5620e44e4048ff79526ea7eb83d69080f71db4027cb278c5fae33246445abc9" exitCode=143 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.668410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data" (OuterVolumeSpecName: "config-data") pod "41f05d9d-6645-4531-bca1-e94840a5bc88" (UID: "41f05d9d-6645-4531-bca1-e94840a5bc88"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.672312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-config-data" (OuterVolumeSpecName: "config-data") pod "8537fa74-d045-48de-b59b-59d7cab6d5fb" (UID: "8537fa74-d045-48de-b59b-59d7cab6d5fb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.676393 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerID="f116a1e141b61332e1ccc5be485e02bf09a9f596a59f6af5816127d8403ab177" exitCode=143 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.695894 4769 generic.go:334] "Generic (PLEG): container finished" podID="54bead83-c56d-4882-82a2-9188f98b2d79" containerID="fbafc96e6d3dce2d6bffff2fa908082675370a3d13436e13d7b8e6068abcdcb7" exitCode=0 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.711599 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" containerID="c64b750efe1f46566969ada9c8a74f4196860d945c7762428a19b670b2b5ab22" exitCode=0 Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.711686 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.712500 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.712918 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.713769 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.720103 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8537fa74-d045-48de-b59b-59d7cab6d5fb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.720124 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.720135 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41f05d9d-6645-4531-bca1-e94840a5bc88-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:49 crc kubenswrapper[4769]: I1121 12:16:49.923762 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.104:11211: i/o timeout" Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.059556 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c is running failed: container process not found" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.060409 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c is running failed: container process not found" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.061952 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c is running failed: container process not found" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.061994 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerName="nova-cell0-conductor-conductor" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.086982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" event={"ID":"2825ea3d-77e9-4cf1-8d50-c772fe89bc30","Type":"ContainerDied","Data":"c8ff59c06e10b72de9bf6a2f468f8a098c670c930fd78d9dd5beaf6ef3f19137"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" event={"ID":"2825ea3d-77e9-4cf1-8d50-c772fe89bc30","Type":"ContainerDied","Data":"5629f4695cf8212645a59f2e0ebb6ce8c4726561f15b7e65e5482ab1623936a0"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087070 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5629f4695cf8212645a59f2e0ebb6ce8c4726561f15b7e65e5482ab1623936a0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087082 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087099 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementecac-account-delete-qkp2t"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" event={"ID":"d9cb03d6-db43-4569-b583-7d2cd315dbc6","Type":"ContainerStarted","Data":"112f2d70becfc1a9204db796f0b497914f5f585ac7955eb623ffcccd096e397a"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" event={"ID":"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35","Type":"ContainerDied","Data":"fb6193feb007cf67b31316497282420398830761390868d037e92991fc17586b"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" event={"ID":"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35","Type":"ContainerDied","Data":"129bd4c88baad5fbd65e85755df594e98f006c628c2f2ecaedeefb433e262e15"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087152 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="129bd4c88baad5fbd65e85755df594e98f006c628c2f2ecaedeefb433e262e15" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087164 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" event={"ID":"b1611028-fdb2-48bf-8f36-8109220e3d2c","Type":"ContainerStarted","Data":"cd46ef576aca5753ac750dc80f4b396c8531b4f8344c327babb26feb0b999f23"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" event={"ID":"1a5a57f9-588e-4e9f-9208-895c4131ee2e","Type":"ContainerStarted","Data":"b77ed26dc641f5b4bd154271aa704119e7b0457a663fcd73a032fe2e41729314"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b6385ef-77f7-4187-abae-725f7c9c6090","Type":"ContainerDied","Data":"8ea67472f31c4ec099e9f3ca549349f971f8b8b76f1226b261650e546f20f82b"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087261 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ea67472f31c4ec099e9f3ca549349f971f8b8b76f1226b261650e546f20f82b" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" event={"ID":"ddf92e36-0f72-42e5-9a43-a4c62def4273","Type":"ContainerDied","Data":"a5620e44e4048ff79526ea7eb83d69080f71db4027cb278c5fae33246445abc9"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" event={"ID":"0ba7fad1-0c38-4270-8742-6bf0646009cc","Type":"ContainerDied","Data":"f116a1e141b61332e1ccc5be485e02bf09a9f596a59f6af5816127d8403ab177"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" event={"ID":"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd","Type":"ContainerDied","Data":"28f9f51b019992be0afbdcbcc82020564f709e0d1a448603b5159941f981e55a"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087317 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28f9f51b019992be0afbdcbcc82020564f709e0d1a448603b5159941f981e55a" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" event={"ID":"54bead83-c56d-4882-82a2-9188f98b2d79","Type":"ContainerDied","Data":"fbafc96e6d3dce2d6bffff2fa908082675370a3d13436e13d7b8e6068abcdcb7"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" event={"ID":"185dd314-18f2-4593-8ffe-5d639f37d8fd","Type":"ContainerStarted","Data":"4ce630f97445a6080d1ca0d5623ec2c95adfc27784b96e8575839e796ca20ae0"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.087380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" event={"ID":"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a","Type":"ContainerDied","Data":"c64b750efe1f46566969ada9c8a74f4196860d945c7762428a19b670b2b5ab22"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.107957 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.128047 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.178634 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.242827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-internal-tls-certs\") pod \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.242971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-public-tls-certs\") pod \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.243036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ed7ff37-6da9-471e-977d-ed0086cbcc42-logs\") pod \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.243084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-combined-ca-bundle\") pod \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.243141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-config-data\") pod \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.243189 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbcr5\" (UniqueName: \"kubernetes.io/projected/5ed7ff37-6da9-471e-977d-ed0086cbcc42-kube-api-access-qbcr5\") pod \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\" (UID: \"5ed7ff37-6da9-471e-977d-ed0086cbcc42\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.244409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed7ff37-6da9-471e-977d-ed0086cbcc42-logs" (OuterVolumeSpecName: "logs") pod "5ed7ff37-6da9-471e-977d-ed0086cbcc42" (UID: "5ed7ff37-6da9-471e-977d-ed0086cbcc42"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.253731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed7ff37-6da9-471e-977d-ed0086cbcc42-kube-api-access-qbcr5" (OuterVolumeSpecName: "kube-api-access-qbcr5") pod "5ed7ff37-6da9-471e-977d-ed0086cbcc42" (UID: "5ed7ff37-6da9-471e-977d-ed0086cbcc42"). InnerVolumeSpecName "kube-api-access-qbcr5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.291962 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.294888 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-config-data" (OuterVolumeSpecName: "config-data") pod "5ed7ff37-6da9-471e-977d-ed0086cbcc42" (UID: "5ed7ff37-6da9-471e-977d-ed0086cbcc42"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.347926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zwss\" (UniqueName: \"kubernetes.io/projected/db2d38dd-f72e-42d3-b681-674040ed92ba-kube-api-access-5zwss\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.352382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-combined-ca-bundle\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.352766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-httpd-run\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.352851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-logs\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.352953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.352987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-config-data\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.353023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-scripts\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.353177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-public-tls-certs\") pod \"db2d38dd-f72e-42d3-b681-674040ed92ba\" (UID: \"db2d38dd-f72e-42d3-b681-674040ed92ba\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.353378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.353695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-logs" (OuterVolumeSpecName: "logs") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.358183 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.358222 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db2d38dd-f72e-42d3-b681-674040ed92ba-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.358230 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ed7ff37-6da9-471e-977d-ed0086cbcc42-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.358239 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.358248 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qbcr5\" (UniqueName: \"kubernetes.io/projected/5ed7ff37-6da9-471e-977d-ed0086cbcc42-kube-api-access-qbcr5\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.368669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2d38dd-f72e-42d3-b681-674040ed92ba-kube-api-access-5zwss" (OuterVolumeSpecName: "kube-api-access-5zwss") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "kube-api-access-5zwss". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.374572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5ed7ff37-6da9-471e-977d-ed0086cbcc42" (UID: "5ed7ff37-6da9-471e-977d-ed0086cbcc42"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.414417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5ed7ff37-6da9-471e-977d-ed0086cbcc42" (UID: "5ed7ff37-6da9-471e-977d-ed0086cbcc42"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.414422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-scripts" (OuterVolumeSpecName: "scripts") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.414489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.436162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5ed7ff37-6da9-471e-977d-ed0086cbcc42" (UID: "5ed7ff37-6da9-471e-977d-ed0086cbcc42"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.435816 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf is running failed: container process not found" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.437851 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf is running failed: container process not found" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.438079 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf is running failed: container process not found" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.438100 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerName="nova-cell1-conductor-conductor" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.461867 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.461902 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.461912 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.461922 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.461931 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5zwss\" (UniqueName: \"kubernetes.io/projected/db2d38dd-f72e-42d3-b681-674040ed92ba-kube-api-access-5zwss\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.461941 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ed7ff37-6da9-471e-977d-ed0086cbcc42-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.510002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.534769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-config-data" (OuterVolumeSpecName: "config-data") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.551941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "db2d38dd-f72e-42d3-b681-674040ed92ba" (UID: "db2d38dd-f72e-42d3-b681-674040ed92ba"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.571539 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.571574 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.571591 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db2d38dd-f72e-42d3-b681-674040ed92ba-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.584401 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.611788 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-scripts\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672761 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-log-httpd\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-sg-core-conf-yaml\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-ceilometer-tls-certs\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-run-httpd\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-config-data\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.672946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kjm6\" (UniqueName: \"kubernetes.io/projected/b122f86f-b55d-4234-a61e-de0aabcf6760-kube-api-access-7kjm6\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.673032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-combined-ca-bundle\") pod \"b122f86f-b55d-4234-a61e-de0aabcf6760\" (UID: \"b122f86f-b55d-4234-a61e-de0aabcf6760\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.673459 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.673520 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.673568 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data podName:4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:58.673552242 +0000 UTC m=+1577.374214060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data") pod "rabbitmq-server-0" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5") : configmap "rabbitmq-config-data" not found Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.675467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.675660 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.676954 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-scripts" (OuterVolumeSpecName: "scripts") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.691156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b122f86f-b55d-4234-a61e-de0aabcf6760-kube-api-access-7kjm6" (OuterVolumeSpecName: "kube-api-access-7kjm6") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "kube-api-access-7kjm6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.761152 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.775164 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.775266 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.775281 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.775293 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b122f86f-b55d-4234-a61e-de0aabcf6760-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.775304 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7kjm6\" (UniqueName: \"kubernetes.io/projected/b122f86f-b55d-4234-a61e-de0aabcf6760-kube-api-access-7kjm6\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.779067 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.783734 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.792163 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.797815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" event={"ID":"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b","Type":"ContainerStarted","Data":"c7c4db93987baa5f07b239f640964999e698d54cfb03a5c91264c80f8d97e1b7"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.800546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" event={"ID":"4ff3caad-9d87-4e02-abd3-e6148084a692","Type":"ContainerStarted","Data":"f563c0f22238d0ee0274d9de621c34f501fd39ad769a229da702df5ecf1587ea"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.801001 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api-log" containerID="cri-o://796c9938e272dfa1ad0e8012c80dd458df641b93033d3f332159f1f3980c2792" gracePeriod=30 Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.801163 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.801207 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.801239 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api" containerID="cri-o://f563c0f22238d0ee0274d9de621c34f501fd39ad769a229da702df5ecf1587ea" gracePeriod=30 Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.807277 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.810961 4769 generic.go:334] "Generic (PLEG): container finished" podID="27fe312f-1788-4660-b46f-ac049f1529c9" containerID="c272862294199cd29cdf62a47209a77ebe6a30aca36021b88785518fc4e932f6" exitCode=1 Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.811015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" event={"ID":"27fe312f-1788-4660-b46f-ac049f1529c9","Type":"ContainerDied","Data":"c272862294199cd29cdf62a47209a77ebe6a30aca36021b88785518fc4e932f6"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.824746 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.826246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" event={"ID":"75af4712-517b-45d9-981e-30e251a28bb0","Type":"ContainerStarted","Data":"d33009605c9d55b04f6760096b5eb13584040aca065be5164e5a534afebcad32"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.826369 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-httpd" containerID="cri-o://d33009605c9d55b04f6760096b5eb13584040aca065be5164e5a534afebcad32" gracePeriod=30 Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.826462 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.826276 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-api" containerID="cri-o://916d98f663ba6263039a2c39855de0d1d9fa14e0ed53c268bb35114528811668" gracePeriod=30 Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.827919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" event={"ID":"54bead83-c56d-4882-82a2-9188f98b2d79","Type":"ContainerDied","Data":"b8328603cef602872a0af5499a04e3c2eaad46562d75ae9c4f2d19477f4a6f8d"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.827955 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8328603cef602872a0af5499a04e3c2eaad46562d75ae9c4f2d19477f4a6f8d" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.828870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" event={"ID":"b0209b46-f4b0-43f9-ac34-43d89e7ece45","Type":"ContainerStarted","Data":"8c1ec0b5605ce1f3d6db3e22ebdc45a1db76d8fa49eb9bb724394c8f9347b260"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.830140 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.832258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" event={"ID":"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a","Type":"ContainerDied","Data":"b1576d5bc9e6f250a9a0d712593daea150b1a9613c624a025f3fef0b5707c526"} Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.832311 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1576d5bc9e6f250a9a0d712593daea150b1a9613c624a025f3fef0b5707c526" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.832398 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.832626 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.876440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-galera-tls-certs\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.880891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxjb4\" (UniqueName: \"kubernetes.io/projected/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kube-api-access-dxjb4\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.885651 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-generated\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.885816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.885934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-default\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.886030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kolla-config\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.886118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-operator-scripts\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.886221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-combined-ca-bundle\") pod \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\" (UID: \"b249afc8-1e7a-4537-8778-fc1e56c2afdc\") " Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.886917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.889231 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.889950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.889982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.890172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.895977 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.907420 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.924146 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.928642 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.949159 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.960515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kube-api-access-dxjb4" (OuterVolumeSpecName: "kube-api-access-dxjb4") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "kube-api-access-dxjb4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.960576 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.970941 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.978937 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.991447 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dxjb4\" (UniqueName: \"kubernetes.io/projected/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kube-api-access-dxjb4\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.991472 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b249afc8-1e7a-4537-8778-fc1e56c2afdc-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.991482 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.991490 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b249afc8-1e7a-4537-8778-fc1e56c2afdc-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.991568 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.991619 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts podName:07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b nodeName:}" failed. No retries permitted until 2025-11-21 12:16:54.991602572 +0000 UTC m=+1573.692264390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts") pod "placementecac-account-delete-qkp2t" (UID: "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b") : configmap "openstack-scripts" not found Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.992166 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.992207 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts podName:1a5a57f9-588e-4e9f-9208-895c4131ee2e nodeName:}" failed. No retries permitted until 2025-11-21 12:16:54.992185408 +0000 UTC m=+1573.692847226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts") pod "barbican2945-account-delete-lxwxk" (UID: "1a5a57f9-588e-4e9f-9208-895c4131ee2e") : configmap "openstack-scripts" not found Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.992232 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:50 crc kubenswrapper[4769]: E1121 12:16:50.992251 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts podName:b1611028-fdb2-48bf-8f36-8109220e3d2c nodeName:}" failed. No retries permitted until 2025-11-21 12:16:54.99224393 +0000 UTC m=+1573.692905748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts") pod "neutron251c-account-delete-gftsp" (UID: "b1611028-fdb2-48bf-8f36-8109220e3d2c") : configmap "openstack-scripts" not found Nov 21 12:16:50 crc kubenswrapper[4769]: I1121 12:16:50.997578 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" podStartSLOduration=11.997561733 podStartE2EDuration="11.997561733s" podCreationTimestamp="2025-11-21 12:16:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:50.994319015 +0000 UTC m=+1569.694980843" watchObservedRunningTime="2025-11-21 12:16:50.997561733 +0000 UTC m=+1569.698223551" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.009525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "mysql-db") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.028019 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" podStartSLOduration=11.028001071 podStartE2EDuration="11.028001071s" podCreationTimestamp="2025-11-21 12:16:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:51.024891307 +0000 UTC m=+1569.725553145" watchObservedRunningTime="2025-11-21 12:16:51.028001071 +0000 UTC m=+1569.728662889" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.098537 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:16:51 crc kubenswrapper[4769]: E1121 12:16:51.098776 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:51 crc kubenswrapper[4769]: E1121 12:16:51.098872 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts podName:b0209b46-f4b0-43f9-ac34-43d89e7ece45 nodeName:}" failed. No retries permitted until 2025-11-21 12:16:55.098849946 +0000 UTC m=+1573.799511794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts") pod "novaapi2ea5-account-delete-wgzgb" (UID: "b0209b46-f4b0-43f9-ac34-43d89e7ece45") : configmap "openstack-scripts" not found Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.161151 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.200943 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.257203 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.259463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.286805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.299444 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" path="/var/lib/kubelet/pods/41f05d9d-6645-4531-bca1-e94840a5bc88/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.300286 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" path="/var/lib/kubelet/pods/4bac9dbe-2e92-4161-94cf-5f11f3762e00/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.300804 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" path="/var/lib/kubelet/pods/4be7b12a-19d5-476f-b806-41eb24d461ac/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.301811 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" path="/var/lib/kubelet/pods/56388344-0941-4937-a249-fe91e7e0e0c6/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.302314 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82bc46a0-92fc-4db5-a7db-08ac6812d117" path="/var/lib/kubelet/pods/82bc46a0-92fc-4db5-a7db-08ac6812d117/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.302811 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" path="/var/lib/kubelet/pods/9419c5db-b98d-44e8-a7f5-852229976f84/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.303598 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.303631 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.303644 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.303946 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" path="/var/lib/kubelet/pods/9d9e9e8e-52d3-4601-be5f-84b9ac61697b/volumes" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.394523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-config-data" (OuterVolumeSpecName: "config-data") pod "b122f86f-b55d-4234-a61e-de0aabcf6760" (UID: "b122f86f-b55d-4234-a61e-de0aabcf6760"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.405166 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b122f86f-b55d-4234-a61e-de0aabcf6760-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.409318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "b249afc8-1e7a-4537-8778-fc1e56c2afdc" (UID: "b249afc8-1e7a-4537-8778-fc1e56c2afdc"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.440887 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.100:5671: connect: connection refused" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.488359 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.101:5671: connect: connection refused" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.507492 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b249afc8-1e7a-4537-8778-fc1e56c2afdc-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.627222 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.148:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.845092 4769 generic.go:334] "Generic (PLEG): container finished" podID="1a5a57f9-588e-4e9f-9208-895c4131ee2e" containerID="bc7e3c03582f19f7f8165b08d33ff53f2b83e490fe76e57f67c54ab51696e653" exitCode=1 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.849572 4769 generic.go:334] "Generic (PLEG): container finished" podID="75af4712-517b-45d9-981e-30e251a28bb0" containerID="d33009605c9d55b04f6760096b5eb13584040aca065be5164e5a534afebcad32" exitCode=0 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.870981 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9cb03d6-db43-4569-b583-7d2cd315dbc6" containerID="3321979704c2920a5803f23554c8d9a1a74a65deb5f290cea80a58a2c5b06447" exitCode=1 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.876385 4769 generic.go:334] "Generic (PLEG): container finished" podID="b0209b46-f4b0-43f9-ac34-43d89e7ece45" containerID="338a0af2da90548a556e696fdf1aff2877b0fac70612394b794e33f43a45c6d7" exitCode=1 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.879114 4769 generic.go:334] "Generic (PLEG): container finished" podID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerID="efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186" exitCode=0 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.892887 4769 generic.go:334] "Generic (PLEG): container finished" podID="07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" containerID="3e2d86b6a8c8d8a5b324e9e4371a7be913cc8df8e4c9bc7ff4720a07196a7732" exitCode=1 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.899935 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerID="f563c0f22238d0ee0274d9de621c34f501fd39ad769a229da702df5ecf1587ea" exitCode=0 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.900002 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerID="796c9938e272dfa1ad0e8012c80dd458df641b93033d3f332159f1f3980c2792" exitCode=143 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.903344 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1611028-fdb2-48bf-8f36-8109220e3d2c" containerID="b5b4941091ef63246d3086c1d90a505e23370f21e08833f4e8149119da352c31" exitCode=1 Nov 21 12:16:51 crc kubenswrapper[4769]: I1121 12:16:51.903535 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.054970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" event={"ID":"1a5a57f9-588e-4e9f-9208-895c4131ee2e","Type":"ContainerDied","Data":"bc7e3c03582f19f7f8165b08d33ff53f2b83e490fe76e57f67c54ab51696e653"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" event={"ID":"75af4712-517b-45d9-981e-30e251a28bb0","Type":"ContainerDied","Data":"d33009605c9d55b04f6760096b5eb13584040aca065be5164e5a534afebcad32"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" event={"ID":"27fe312f-1788-4660-b46f-ac049f1529c9","Type":"ContainerDied","Data":"6abebb8b75186165071463b8399f2424389f2760c4579f82b728e49106552a9a"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055645 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6abebb8b75186165071463b8399f2424389f2760c4579f82b728e49106552a9a" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" event={"ID":"d9cb03d6-db43-4569-b583-7d2cd315dbc6","Type":"ContainerDied","Data":"3321979704c2920a5803f23554c8d9a1a74a65deb5f290cea80a58a2c5b06447"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" event={"ID":"b0209b46-f4b0-43f9-ac34-43d89e7ece45","Type":"ContainerDied","Data":"338a0af2da90548a556e696fdf1aff2877b0fac70612394b794e33f43a45c6d7"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" event={"ID":"185dd314-18f2-4593-8ffe-5d639f37d8fd","Type":"ContainerDied","Data":"efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" event={"ID":"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b","Type":"ContainerDied","Data":"3e2d86b6a8c8d8a5b324e9e4371a7be913cc8df8e4c9bc7ff4720a07196a7732"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" event={"ID":"4ff3caad-9d87-4e02-abd3-e6148084a692","Type":"ContainerDied","Data":"f563c0f22238d0ee0274d9de621c34f501fd39ad769a229da702df5ecf1587ea"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" event={"ID":"4ff3caad-9d87-4e02-abd3-e6148084a692","Type":"ContainerDied","Data":"796c9938e272dfa1ad0e8012c80dd458df641b93033d3f332159f1f3980c2792"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055752 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" event={"ID":"4ff3caad-9d87-4e02-abd3-e6148084a692","Type":"ContainerDied","Data":"da5b72001cf011ea88c064ea734668c88d0cff8aeae552f7319e309af89b0e6a"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055760 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da5b72001cf011ea88c064ea734668c88d0cff8aeae552f7319e309af89b0e6a" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.055767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" event={"ID":"b1611028-fdb2-48bf-8f36-8109220e3d2c","Type":"ContainerDied","Data":"b5b4941091ef63246d3086c1d90a505e23370f21e08833f4e8149119da352c31"} Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.079958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.159656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-config-data\") pod \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.159770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-combined-ca-bundle\") pod \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.159847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs5lx\" (UniqueName: \"kubernetes.io/projected/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-kube-api-access-rs5lx\") pod \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\" (UID: \"801dd535-e22a-4d31-85b8-c8cdb0c2bed2\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.191631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "801dd535-e22a-4d31-85b8-c8cdb0c2bed2" (UID: "801dd535-e22a-4d31-85b8-c8cdb0c2bed2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.200117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-kube-api-access-rs5lx" (OuterVolumeSpecName: "kube-api-access-rs5lx") pod "801dd535-e22a-4d31-85b8-c8cdb0c2bed2" (UID: "801dd535-e22a-4d31-85b8-c8cdb0c2bed2"). InnerVolumeSpecName "kube-api-access-rs5lx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.220363 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.220711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-config-data" (OuterVolumeSpecName: "config-data") pod "801dd535-e22a-4d31-85b8-c8cdb0c2bed2" (UID: "801dd535-e22a-4d31-85b8-c8cdb0c2bed2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.239786 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.261936 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rs5lx\" (UniqueName: \"kubernetes.io/projected/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-kube-api-access-rs5lx\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.261961 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.261972 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801dd535-e22a-4d31-85b8-c8cdb0c2bed2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.324884 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.369237 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.405912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.408585 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.416407 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.416827 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.424424 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.444425 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.446335 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.450445 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-log-httpd\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-internal-tls-certs\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-scripts\") pod \"c5b897fd-dde5-489a-a738-88aa63a4f806\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tgw7\" (UniqueName: \"kubernetes.io/projected/2f4e5e5e-6d6e-416a-9457-66f197b04835-kube-api-access-5tgw7\") pod \"2f4e5e5e-6d6e-416a-9457-66f197b04835\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c5b897fd-dde5-489a-a738-88aa63a4f806-etc-machine-id\") pod \"c5b897fd-dde5-489a-a738-88aa63a4f806\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-combined-ca-bundle\") pod \"c5b897fd-dde5-489a-a738-88aa63a4f806\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data\") pod \"c5b897fd-dde5-489a-a738-88aa63a4f806\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-etc-swift\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data-custom\") pod \"c5b897fd-dde5-489a-a738-88aa63a4f806\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-config-data\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-run-httpd\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-combined-ca-bundle\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-public-tls-certs\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j97lf\" (UniqueName: \"kubernetes.io/projected/c5b897fd-dde5-489a-a738-88aa63a4f806-kube-api-access-j97lf\") pod \"c5b897fd-dde5-489a-a738-88aa63a4f806\" (UID: \"c5b897fd-dde5-489a-a738-88aa63a4f806\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spkm9\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-kube-api-access-spkm9\") pod \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\" (UID: \"d14bc1fc-4621-423c-9dd3-36ea104d0c9f\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-combined-ca-bundle\") pod \"2f4e5e5e-6d6e-416a-9457-66f197b04835\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.475846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-config-data\") pod \"2f4e5e5e-6d6e-416a-9457-66f197b04835\" (UID: \"2f4e5e5e-6d6e-416a-9457-66f197b04835\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.480894 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.480968 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.488127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.488250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c5b897fd-dde5-489a-a738-88aa63a4f806-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c5b897fd-dde5-489a-a738-88aa63a4f806" (UID: "c5b897fd-dde5-489a-a738-88aa63a4f806"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.489692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.493125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.496549 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.499467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-kube-api-access-spkm9" (OuterVolumeSpecName: "kube-api-access-spkm9") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "kube-api-access-spkm9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.505883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.508516 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.518261 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.527357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-scripts" (OuterVolumeSpecName: "scripts") pod "c5b897fd-dde5-489a-a738-88aa63a4f806" (UID: "c5b897fd-dde5-489a-a738-88aa63a4f806"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.528821 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.542213 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4e5e5e-6d6e-416a-9457-66f197b04835-kube-api-access-5tgw7" (OuterVolumeSpecName: "kube-api-access-5tgw7") pod "2f4e5e5e-6d6e-416a-9457-66f197b04835" (UID: "2f4e5e5e-6d6e-416a-9457-66f197b04835"). InnerVolumeSpecName "kube-api-access-5tgw7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.546372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b897fd-dde5-489a-a738-88aa63a4f806-kube-api-access-j97lf" (OuterVolumeSpecName: "kube-api-access-j97lf") pod "c5b897fd-dde5-489a-a738-88aa63a4f806" (UID: "c5b897fd-dde5-489a-a738-88aa63a4f806"). InnerVolumeSpecName "kube-api-access-j97lf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsfpn\" (UniqueName: \"kubernetes.io/projected/4b6385ef-77f7-4187-abae-725f7c9c6090-kube-api-access-nsfpn\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkn28\" (UniqueName: \"kubernetes.io/projected/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-kube-api-access-fkn28\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-internal-tls-certs\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-generated\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-public-tls-certs\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data\") pod \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-combined-ca-bundle\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-scripts\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.578975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-internal-tls-certs\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data-custom\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data-custom\") pod \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-kolla-config\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-logs\") pod \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579313 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data-custom\") pod \"da4c93fc-884b-4701-b589-da46434544d4\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thl8w\" (UniqueName: \"kubernetes.io/projected/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-kube-api-access-thl8w\") pod \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579360 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-operator-scripts\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data\") pod \"da4c93fc-884b-4701-b589-da46434544d4\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-default\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-combined-ca-bundle\") pod \"da4c93fc-884b-4701-b589-da46434544d4\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqrbx\" (UniqueName: \"kubernetes.io/projected/da4c93fc-884b-4701-b589-da46434544d4-kube-api-access-zqrbx\") pod \"da4c93fc-884b-4701-b589-da46434544d4\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579512 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cjhh\" (UniqueName: \"kubernetes.io/projected/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-kube-api-access-7cjhh\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-combined-ca-bundle\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-config-data\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/da4c93fc-884b-4701-b589-da46434544d4-logs\") pod \"da4c93fc-884b-4701-b589-da46434544d4\" (UID: \"da4c93fc-884b-4701-b589-da46434544d4\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-public-tls-certs\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-combined-ca-bundle\") pod \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\" (UID: \"c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-galera-tls-certs\") pod \"4b6385ef-77f7-4187-abae-725f7c9c6090\" (UID: \"4b6385ef-77f7-4187-abae-725f7c9c6090\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-logs\") pod \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\" (UID: \"6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-combined-ca-bundle\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.579786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-logs\") pod \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\" (UID: \"2825ea3d-77e9-4cf1-8d50-c772fe89bc30\") " Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.584589 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c5b897fd-dde5-489a-a738-88aa63a4f806" (UID: "c5b897fd-dde5-489a-a738-88aa63a4f806"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.585620 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.586972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.587302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.587527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") pod \"novacell0d8c4-account-delete-pxhjd\" (UID: \"6f8129d1-7fcc-4f40-8f52-df287de84e48\") " pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.587866 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j97lf\" (UniqueName: \"kubernetes.io/projected/c5b897fd-dde5-489a-a738-88aa63a4f806-kube-api-access-j97lf\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591122 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-spkm9\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-kube-api-access-spkm9\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591508 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591633 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591739 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5tgw7\" (UniqueName: \"kubernetes.io/projected/2f4e5e5e-6d6e-416a-9457-66f197b04835-kube-api-access-5tgw7\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591877 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c5b897fd-dde5-489a-a738-88aa63a4f806-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591980 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.592093 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.592761 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.592785 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.590344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.591647 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4c93fc-884b-4701-b589-da46434544d4-logs" (OuterVolumeSpecName: "logs") pod "da4c93fc-884b-4701-b589-da46434544d4" (UID: "da4c93fc-884b-4701-b589-da46434544d4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.595516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.598367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4c93fc-884b-4701-b589-da46434544d4-kube-api-access-zqrbx" (OuterVolumeSpecName: "kube-api-access-zqrbx") pod "da4c93fc-884b-4701-b589-da46434544d4" (UID: "da4c93fc-884b-4701-b589-da46434544d4"). InnerVolumeSpecName "kube-api-access-zqrbx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.598641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-kube-api-access-7cjhh" (OuterVolumeSpecName: "kube-api-access-7cjhh") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "kube-api-access-7cjhh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: E1121 12:16:52.599046 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:16:52 crc kubenswrapper[4769]: E1121 12:16:52.599120 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:00.599099799 +0000 UTC m=+1579.299761607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : configmap "openstack-scripts" not found Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.600960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-logs" (OuterVolumeSpecName: "logs") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.601945 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-logs" (OuterVolumeSpecName: "logs") pod "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" (UID: "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.604053 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.604499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-logs" (OuterVolumeSpecName: "logs") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.606136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6385ef-77f7-4187-abae-725f7c9c6090-kube-api-access-nsfpn" (OuterVolumeSpecName: "kube-api-access-nsfpn") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "kube-api-access-nsfpn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: E1121 12:16:52.608731 4769 projected.go:194] Error preparing data for projected volume kube-api-access-dn8zt for pod openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:52 crc kubenswrapper[4769]: E1121 12:16:52.608794 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt podName:6f8129d1-7fcc-4f40-8f52-df287de84e48 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:00.608777789 +0000 UTC m=+1579.309439607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn8zt" (UniqueName: "kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt") pod "novacell0d8c4-account-delete-pxhjd" (UID: "6f8129d1-7fcc-4f40-8f52-df287de84e48") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.611738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "da4c93fc-884b-4701-b589-da46434544d4" (UID: "da4c93fc-884b-4701-b589-da46434544d4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.618453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" (UID: "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.618480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-kube-api-access-fkn28" (OuterVolumeSpecName: "kube-api-access-fkn28") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "kube-api-access-fkn28". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.618675 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.619500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-kube-api-access-thl8w" (OuterVolumeSpecName: "kube-api-access-thl8w") pod "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" (UID: "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd"). InnerVolumeSpecName "kube-api-access-thl8w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.621302 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-scripts" (OuterVolumeSpecName: "scripts") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.638806 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.645420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:52 crc kubenswrapper[4769]: I1121 12:16:52.647912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.674337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2f4e5e5e-6d6e-416a-9457-66f197b04835" (UID: "2f4e5e5e-6d6e-416a-9457-66f197b04835"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.692913 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.693896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-credential-keys\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.693952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-internal-tls-certs\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.693972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-credential-keys\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-config-data\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-config-data\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694224 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-combined-ca-bundle\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg28w\" (UniqueName: \"kubernetes.io/projected/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-kube-api-access-zg28w\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-internal-tls-certs\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-public-tls-certs\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-fernet-keys\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-scripts\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-scripts\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-combined-ca-bundle\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-fernet-keys\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tpzb\" (UniqueName: \"kubernetes.io/projected/54bead83-c56d-4882-82a2-9188f98b2d79-kube-api-access-5tpzb\") pod \"54bead83-c56d-4882-82a2-9188f98b2d79\" (UID: \"54bead83-c56d-4882-82a2-9188f98b2d79\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-public-tls-certs\") pod \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\" (UID: \"5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694952 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694966 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694977 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.694989 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-thl8w\" (UniqueName: \"kubernetes.io/projected/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-kube-api-access-thl8w\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695000 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695009 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b6385ef-77f7-4187-abae-725f7c9c6090-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695018 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zqrbx\" (UniqueName: \"kubernetes.io/projected/da4c93fc-884b-4701-b589-da46434544d4-kube-api-access-zqrbx\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695028 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695038 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7cjhh\" (UniqueName: \"kubernetes.io/projected/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-kube-api-access-7cjhh\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695046 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/da4c93fc-884b-4701-b589-da46434544d4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695054 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695062 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695071 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nsfpn\" (UniqueName: \"kubernetes.io/projected/4b6385ef-77f7-4187-abae-725f7c9c6090-kube-api-access-nsfpn\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695081 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fkn28\" (UniqueName: \"kubernetes.io/projected/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-kube-api-access-fkn28\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695089 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695100 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695108 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.695083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.718993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "mysql-db") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.726864 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-kube-api-access-zg28w" (OuterVolumeSpecName: "kube-api-access-zg28w") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "kube-api-access-zg28w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.727108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.727121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54bead83-c56d-4882-82a2-9188f98b2d79-kube-api-access-5tpzb" (OuterVolumeSpecName: "kube-api-access-5tpzb") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "kube-api-access-5tpzb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.727168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.727175 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.727253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-scripts" (OuterVolumeSpecName: "scripts") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.727226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-scripts" (OuterVolumeSpecName: "scripts") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.786699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.796890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klhzn\" (UniqueName: \"kubernetes.io/projected/4ff3caad-9d87-4e02-abd3-e6148084a692-kube-api-access-klhzn\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.796980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data-custom\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cksp\" (UniqueName: \"kubernetes.io/projected/1a5a57f9-588e-4e9f-9208-895c4131ee2e-kube-api-access-2cksp\") pod \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-combined-ca-bundle\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797313 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwvll\" (UniqueName: \"kubernetes.io/projected/d9cb03d6-db43-4569-b583-7d2cd315dbc6-kube-api-access-pwvll\") pod \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g76ts\" (UniqueName: \"kubernetes.io/projected/27fe312f-1788-4660-b46f-ac049f1529c9-kube-api-access-g76ts\") pod \"27fe312f-1788-4660-b46f-ac049f1529c9\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9cb03d6-db43-4569-b583-7d2cd315dbc6-operator-scripts\") pod \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\" (UID: \"d9cb03d6-db43-4569-b583-7d2cd315dbc6\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts\") pod \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\" (UID: \"1a5a57f9-588e-4e9f-9208-895c4131ee2e\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ff3caad-9d87-4e02-abd3-e6148084a692-logs\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-internal-tls-certs\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/27fe312f-1788-4660-b46f-ac049f1529c9-operator-scripts\") pod \"27fe312f-1788-4660-b46f-ac049f1529c9\" (UID: \"27fe312f-1788-4660-b46f-ac049f1529c9\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.797680 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-public-tls-certs\") pod \"4ff3caad-9d87-4e02-abd3-e6148084a692\" (UID: \"4ff3caad-9d87-4e02-abd3-e6148084a692\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.796889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3caad-9d87-4e02-abd3-e6148084a692-logs" (OuterVolumeSpecName: "logs") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799673 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ff3caad-9d87-4e02-abd3-e6148084a692-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799709 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zg28w\" (UniqueName: \"kubernetes.io/projected/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-kube-api-access-zg28w\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799724 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799736 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799747 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799757 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799769 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5tpzb\" (UniqueName: \"kubernetes.io/projected/54bead83-c56d-4882-82a2-9188f98b2d79-kube-api-access-5tpzb\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799798 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799809 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.799834 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.800151 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1a5a57f9-588e-4e9f-9208-895c4131ee2e" (UID: "1a5a57f9-588e-4e9f-9208-895c4131ee2e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.800714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27fe312f-1788-4660-b46f-ac049f1529c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "27fe312f-1788-4660-b46f-ac049f1529c9" (UID: "27fe312f-1788-4660-b46f-ac049f1529c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.801426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9cb03d6-db43-4569-b583-7d2cd315dbc6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d9cb03d6-db43-4569-b583-7d2cd315dbc6" (UID: "d9cb03d6-db43-4569-b583-7d2cd315dbc6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.830763 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.834006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27fe312f-1788-4660-b46f-ac049f1529c9-kube-api-access-g76ts" (OuterVolumeSpecName: "kube-api-access-g76ts") pod "27fe312f-1788-4660-b46f-ac049f1529c9" (UID: "27fe312f-1788-4660-b46f-ac049f1529c9"). InnerVolumeSpecName "kube-api-access-g76ts". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.836269 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.840339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.840863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff3caad-9d87-4e02-abd3-e6148084a692-kube-api-access-klhzn" (OuterVolumeSpecName: "kube-api-access-klhzn") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "kube-api-access-klhzn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.842049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a5a57f9-588e-4e9f-9208-895c4131ee2e-kube-api-access-2cksp" (OuterVolumeSpecName: "kube-api-access-2cksp") pod "1a5a57f9-588e-4e9f-9208-895c4131ee2e" (UID: "1a5a57f9-588e-4e9f-9208-895c4131ee2e"). InnerVolumeSpecName "kube-api-access-2cksp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.847072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cb03d6-db43-4569-b583-7d2cd315dbc6-kube-api-access-pwvll" (OuterVolumeSpecName: "kube-api-access-pwvll") pod "d9cb03d6-db43-4569-b583-7d2cd315dbc6" (UID: "d9cb03d6-db43-4569-b583-7d2cd315dbc6"). InnerVolumeSpecName "kube-api-access-pwvll". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.904061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts\") pod \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.904178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lkqs\" (UniqueName: \"kubernetes.io/projected/b1611028-fdb2-48bf-8f36-8109220e3d2c-kube-api-access-2lkqs\") pod \"b1611028-fdb2-48bf-8f36-8109220e3d2c\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.904391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhtx9\" (UniqueName: \"kubernetes.io/projected/b0209b46-f4b0-43f9-ac34-43d89e7ece45-kube-api-access-qhtx9\") pod \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.904497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts\") pod \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\" (UID: \"b0209b46-f4b0-43f9-ac34-43d89e7ece45\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.904656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pld5r\" (UniqueName: \"kubernetes.io/projected/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-kube-api-access-pld5r\") pod \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\" (UID: \"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.904698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts\") pod \"b1611028-fdb2-48bf-8f36-8109220e3d2c\" (UID: \"b1611028-fdb2-48bf-8f36-8109220e3d2c\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909620 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pwvll\" (UniqueName: \"kubernetes.io/projected/d9cb03d6-db43-4569-b583-7d2cd315dbc6-kube-api-access-pwvll\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909657 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g76ts\" (UniqueName: \"kubernetes.io/projected/27fe312f-1788-4660-b46f-ac049f1529c9-kube-api-access-g76ts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909672 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9cb03d6-db43-4569-b583-7d2cd315dbc6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909684 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1a5a57f9-588e-4e9f-9208-895c4131ee2e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909701 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/27fe312f-1788-4660-b46f-ac049f1529c9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909715 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-klhzn\" (UniqueName: \"kubernetes.io/projected/4ff3caad-9d87-4e02-abd3-e6148084a692-kube-api-access-klhzn\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909729 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.909742 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2cksp\" (UniqueName: \"kubernetes.io/projected/1a5a57f9-588e-4e9f-9208-895c4131ee2e-kube-api-access-2cksp\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.912843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b0209b46-f4b0-43f9-ac34-43d89e7ece45" (UID: "b0209b46-f4b0-43f9-ac34-43d89e7ece45"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.918358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" (UID: "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.921112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b1611028-fdb2-48bf-8f36-8109220e3d2c" (UID: "b1611028-fdb2-48bf-8f36-8109220e3d2c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.939100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" event={"ID":"185dd314-18f2-4593-8ffe-5d639f37d8fd","Type":"ContainerStarted","Data":"bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.939176 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.943501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-config-data" (OuterVolumeSpecName: "config-data") pod "2f4e5e5e-6d6e-416a-9457-66f197b04835" (UID: "2f4e5e5e-6d6e-416a-9457-66f197b04835"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.943473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-kube-api-access-pld5r" (OuterVolumeSpecName: "kube-api-access-pld5r") pod "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" (UID: "07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b"). InnerVolumeSpecName "kube-api-access-pld5r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.943600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0209b46-f4b0-43f9-ac34-43d89e7ece45-kube-api-access-qhtx9" (OuterVolumeSpecName: "kube-api-access-qhtx9") pod "b0209b46-f4b0-43f9-ac34-43d89e7ece45" (UID: "b0209b46-f4b0-43f9-ac34-43d89e7ece45"). InnerVolumeSpecName "kube-api-access-qhtx9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.962851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" event={"ID":"07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b","Type":"ContainerDied","Data":"c7c4db93987baa5f07b239f640964999e698d54cfb03a5c91264c80f8d97e1b7"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.962898 4769 scope.go:117] "RemoveContainer" containerID="3e2d86b6a8c8d8a5b324e9e4371a7be913cc8df8e4c9bc7ff4720a07196a7732" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.963018 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementecac-account-delete-qkp2t" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:52.972458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1611028-fdb2-48bf-8f36-8109220e3d2c-kube-api-access-2lkqs" (OuterVolumeSpecName: "kube-api-access-2lkqs") pod "b1611028-fdb2-48bf-8f36-8109220e3d2c" (UID: "b1611028-fdb2-48bf-8f36-8109220e3d2c"). InnerVolumeSpecName "kube-api-access-2lkqs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.006770 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_602f0862-0d09-482c-90ae-750628c4ab13/ovn-northd/0.log" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.006826 4769 generic.go:334] "Generic (PLEG): container finished" podID="602f0862-0d09-482c-90ae-750628c4ab13" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" exitCode=139 Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.006992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"602f0862-0d09-482c-90ae-750628c4ab13","Type":"ContainerDied","Data":"5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.011155 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerID="39a6f77204e9dd9b8eccd52e8103882ae2194706b6b1bddbb9ff9c2215a8432f" exitCode=0 Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.011305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5","Type":"ContainerDied","Data":"39a6f77204e9dd9b8eccd52e8103882ae2194706b6b1bddbb9ff9c2215a8432f"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.011337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5","Type":"ContainerDied","Data":"4b4cc736cd67fe5141d34a0ee0178a181e2fe01b4c0ea154809c3a1679486d63"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.011353 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b4cc736cd67fe5141d34a0ee0178a181e2fe01b4c0ea154809c3a1679486d63" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.014341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" event={"ID":"d9cb03d6-db43-4569-b583-7d2cd315dbc6","Type":"ContainerDied","Data":"112f2d70becfc1a9204db796f0b497914f5f585ac7955eb623ffcccd096e397a"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.014469 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022631 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1611028-fdb2-48bf-8f36-8109220e3d2c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022670 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022694 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4e5e5e-6d6e-416a-9457-66f197b04835-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022709 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2lkqs\" (UniqueName: \"kubernetes.io/projected/b1611028-fdb2-48bf-8f36-8109220e3d2c-kube-api-access-2lkqs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022730 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qhtx9\" (UniqueName: \"kubernetes.io/projected/b0209b46-f4b0-43f9-ac34-43d89e7ece45-kube-api-access-qhtx9\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022744 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b0209b46-f4b0-43f9-ac34-43d89e7ece45-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.022762 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pld5r\" (UniqueName: \"kubernetes.io/projected/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b-kube-api-access-pld5r\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.033840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" event={"ID":"b1611028-fdb2-48bf-8f36-8109220e3d2c","Type":"ContainerDied","Data":"cd46ef576aca5753ac750dc80f4b396c8531b4f8344c327babb26feb0b999f23"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.035037 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron251c-account-delete-gftsp" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.042992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" event={"ID":"1a5a57f9-588e-4e9f-9208-895c4131ee2e","Type":"ContainerDied","Data":"b77ed26dc641f5b4bd154271aa704119e7b0457a663fcd73a032fe2e41729314"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.043150 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican2945-account-delete-lxwxk" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.047116 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancece7b-account-delete-rq256" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.049790 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.051332 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.051472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" event={"ID":"b0209b46-f4b0-43f9-ac34-43d89e7ece45","Type":"ContainerDied","Data":"8c1ec0b5605ce1f3d6db3e22ebdc45a1db76d8fa49eb9bb724394c8f9347b260"} Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.051702 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.051776 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.051801 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052038 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052112 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052215 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052272 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052305 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-884df8874-pjgwg" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-886bdb4f7-fq2hm" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052431 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-667d678888-ggtgm" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.052523 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-86b49c8d88-lq6lx" Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.096970 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389 is running failed: container process not found" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.097706 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389 is running failed: container process not found" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.098073 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389 is running failed: container process not found" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.098122 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.130403 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.133203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-config-data" (OuterVolumeSpecName: "config-data") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.204877 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" podStartSLOduration=10.204848944 podStartE2EDuration="10.204848944s" podCreationTimestamp="2025-11-21 12:16:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:16:53.082540186 +0000 UTC m=+1571.783202024" watchObservedRunningTime="2025-11-21 12:16:53.204848944 +0000 UTC m=+1571.905510762" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.234347 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.234412 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.239348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.248840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c5b897fd-dde5-489a-a738-88aa63a4f806" (UID: "c5b897fd-dde5-489a-a738-88aa63a4f806"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.294790 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.296415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.326219 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" path="/var/lib/kubelet/pods/5ed7ff37-6da9-471e-977d-ed0086cbcc42/volumes" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.326890 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" path="/var/lib/kubelet/pods/8537fa74-d045-48de-b59b-59d7cab6d5fb/volumes" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.327738 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" path="/var/lib/kubelet/pods/b122f86f-b55d-4234-a61e-de0aabcf6760/volumes" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.338695 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.338747 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.338762 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.338780 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.365479 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" path="/var/lib/kubelet/pods/b249afc8-1e7a-4537-8778-fc1e56c2afdc/volumes" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.366398 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" path="/var/lib/kubelet/pods/db2d38dd-f72e-42d3-b681-674040ed92ba/volumes" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.398626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.442111 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.486306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data" (OuterVolumeSpecName: "config-data") pod "da4c93fc-884b-4701-b589-da46434544d4" (UID: "da4c93fc-884b-4701-b589-da46434544d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.492727 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.544003 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.544010 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.544136 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.544133 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.544138 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.544231 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:01.544210597 +0000 UTC m=+1580.244872405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.544296 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:01.544265848 +0000 UTC m=+1580.244927846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.544317 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:01.544309799 +0000 UTC m=+1580.244971847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.551493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.551890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.608133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-config-data" (OuterVolumeSpecName: "config-data") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.611698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" (UID: "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.615570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.646281 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.646311 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.646323 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.646331 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.646340 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.646281 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:53 crc kubenswrapper[4769]: E1121 12:16:53.646396 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data podName:07035577-c371-41ab-b492-4d943dace285 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:01.646380904 +0000 UTC m=+1580.347042722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data") pod "rabbitmq-cell1-server-0" (UID: "07035577-c371-41ab-b492-4d943dace285") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.657284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.658064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.658541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.661044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-config-data" (OuterVolumeSpecName: "config-data") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.670533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-config-data" (OuterVolumeSpecName: "config-data") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.681084 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.685672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" (UID: "5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.687598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "da4c93fc-884b-4701-b589-da46434544d4" (UID: "da4c93fc-884b-4701-b589-da46434544d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.694482 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.696052 4769 scope.go:117] "RemoveContainer" containerID="3321979704c2920a5803f23554c8d9a1a74a65deb5f290cea80a58a2c5b06447" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.697939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data" (OuterVolumeSpecName: "config-data") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.706718 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data" (OuterVolumeSpecName: "config-data") pod "2825ea3d-77e9-4cf1-8d50-c772fe89bc30" (UID: "2825ea3d-77e9-4cf1-8d50-c772fe89bc30"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.708955 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_602f0862-0d09-482c-90ae-750628c4ab13/ovn-northd/0.log" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.709025 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.718242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "54bead83-c56d-4882-82a2-9188f98b2d79" (UID: "54bead83-c56d-4882-82a2-9188f98b2d79"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.719321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d14bc1fc-4621-423c-9dd3-36ea104d0c9f" (UID: "d14bc1fc-4621-423c-9dd3-36ea104d0c9f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.740329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4ff3caad-9d87-4e02-abd3-e6148084a692" (UID: "4ff3caad-9d87-4e02-abd3-e6148084a692"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764089 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da4c93fc-884b-4701-b589-da46434544d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764120 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764130 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764138 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764148 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764171 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764180 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764462 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ff3caad-9d87-4e02-abd3-e6148084a692-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764474 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764483 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764492 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2825ea3d-77e9-4cf1-8d50-c772fe89bc30-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764503 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d14bc1fc-4621-423c-9dd3-36ea104d0c9f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.764511 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/54bead83-c56d-4882-82a2-9188f98b2d79-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.779565 4769 scope.go:117] "RemoveContainer" containerID="b5b4941091ef63246d3086c1d90a505e23370f21e08833f4e8149119da352c31" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.790174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.794052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.829558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "4b6385ef-77f7-4187-abae-725f7c9c6090" (UID: "4b6385ef-77f7-4187-abae-725f7c9c6090"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.851401 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementecac-account-delete-qkp2t"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.860316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data" (OuterVolumeSpecName: "config-data") pod "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" (UID: "c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.865885 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placementecac-account-delete-qkp2t"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.866698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-ovn-northd-tls-certs\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.866845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-pod-info\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.866950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.867065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7mtg\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-kube-api-access-j7mtg\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.867163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29grc\" (UniqueName: \"kubernetes.io/projected/602f0862-0d09-482c-90ae-750628c4ab13-kube-api-access-29grc\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.867751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-erlang-cookie\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.867926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-confd\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-scripts\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868218 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-server-conf\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/602f0862-0d09-482c-90ae-750628c4ab13-ovn-rundir\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-config\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868549 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-metrics-certs-tls-certs\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-plugins\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.868964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-combined-ca-bundle\") pod \"602f0862-0d09-482c-90ae-750628c4ab13\" (UID: \"602f0862-0d09-482c-90ae-750628c4ab13\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.869085 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-plugins-conf\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.870212 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-tls\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.870449 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-erlang-cookie-secret\") pod \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\" (UID: \"4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5\") " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.871370 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6385ef-77f7-4187-abae-725f7c9c6090-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.872595 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.872698 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.872795 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.873995 4769 scope.go:117] "RemoveContainer" containerID="bc7e3c03582f19f7f8165b08d33ff53f2b83e490fe76e57f67c54ab51696e653" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.874423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.874654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602f0862-0d09-482c-90ae-750628c4ab13-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.874951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-config" (OuterVolumeSpecName: "config") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.882112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.882139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.898801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.900281 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.900541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-pod-info" (OuterVolumeSpecName: "pod-info") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.900884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-scripts" (OuterVolumeSpecName: "scripts") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.902102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" (UID: "6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.906428 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.907235 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-kube-api-access-j7mtg" (OuterVolumeSpecName: "kube-api-access-j7mtg") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "kube-api-access-j7mtg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.923710 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell0d8c4-account-delete-pxhjd"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.931018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "persistence") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.931207 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602f0862-0d09-482c-90ae-750628c4ab13-kube-api-access-29grc" (OuterVolumeSpecName: "kube-api-access-29grc") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "kube-api-access-29grc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.942412 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.954395 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.962355 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glancece7b-account-delete-rq256"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.992553 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glancece7b-account-delete-rq256"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.995501 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican2945-account-delete-lxwxk"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.995802 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican2945-account-delete-lxwxk"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.995894 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.974838 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996075 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/602f0862-0d09-482c-90ae-750628c4ab13-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996156 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602f0862-0d09-482c-90ae-750628c4ab13-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996408 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996497 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996584 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996669 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996748 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996860 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.996941 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j7mtg\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-kube-api-access-j7mtg\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.997021 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-29grc\" (UniqueName: \"kubernetes.io/projected/602f0862-0d09-482c-90ae-750628c4ab13-kube-api-access-29grc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.997099 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:53 crc kubenswrapper[4769]: I1121 12:16:53.997178 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:53.999919 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.009928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data" (OuterVolumeSpecName: "config-data") pod "c5b897fd-dde5-489a-a738-88aa63a4f806" (UID: "c5b897fd-dde5-489a-a738-88aa63a4f806"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.048985 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data" (OuterVolumeSpecName: "config-data") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.050110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.058281 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_602f0862-0d09-482c-90ae-750628c4ab13/ovn-northd/0.log" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.058373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"602f0862-0d09-482c-90ae-750628c4ab13","Type":"ContainerDied","Data":"e3331697f166a19a20ca1fc1b48f3c4eca9a3611fb15d4017ff5b3f434023168"} Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.058481 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.067746 4769 generic.go:334] "Generic (PLEG): container finished" podID="07035577-c371-41ab-b492-4d943dace285" containerID="5e7d206d799633d2293ea1c3e7fd6b27165e4608e8d950efc6bb43320c259bb3" exitCode=0 Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.067850 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.068751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"07035577-c371-41ab-b492-4d943dace285","Type":"ContainerDied","Data":"5e7d206d799633d2293ea1c3e7fd6b27165e4608e8d950efc6bb43320c259bb3"} Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.072079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-server-conf" (OuterVolumeSpecName: "server-conf") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.074834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.082976 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101462 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6f8129d1-7fcc-4f40-8f52-df287de84e48-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101502 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101513 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101524 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c5b897fd-dde5-489a-a738-88aa63a4f806-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101535 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101544 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101556 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.101566 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dn8zt\" (UniqueName: \"kubernetes.io/projected/6f8129d1-7fcc-4f40-8f52-df287de84e48-kube-api-access-dn8zt\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.102561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "602f0862-0d09-482c-90ae-750628c4ab13" (UID: "602f0862-0d09-482c-90ae-750628c4ab13"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.106878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" (UID: "4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.183100 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.188170 4769 scope.go:117] "RemoveContainer" containerID="338a0af2da90548a556e696fdf1aff2877b0fac70612394b794e33f43a45c6d7" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.193597 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi2ea5-account-delete-wgzgb"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.200027 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron251c-account-delete-gftsp"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.204261 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.204295 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/602f0862-0d09-482c-90ae-750628c4ab13-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.212141 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron251c-account-delete-gftsp"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.218139 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.231834 4769 scope.go:117] "RemoveContainer" containerID="23ab80415e281eb82c83446934d5b669e6b9a0e1961147c213fc61b2446c084d" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.326693 4769 scope.go:117] "RemoveContainer" containerID="5301d0d2ffe41ec5951f4fda329faa26fcd7c5273f5ded5389e5f616b476c389" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.333885 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.354742 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-79cf49bbf5-kwrfb"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.361743 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d678888-ggtgm"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.382169 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-667d678888-ggtgm"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.406997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.420000 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c9b87b494-jct8s"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.421747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-erlang-cookie\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.421890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-confd\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.421927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.421980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422014 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-server-conf\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tjr4\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-kube-api-access-6tjr4\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07035577-c371-41ab-b492-4d943dace285-erlang-cookie-secret\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-tls\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07035577-c371-41ab-b492-4d943dace285-pod-info\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-plugins-conf\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-plugins\") pod \"07035577-c371-41ab-b492-4d943dace285\" (UID: \"07035577-c371-41ab-b492-4d943dace285\") " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.422450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.423154 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.423738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.426691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07035577-c371-41ab-b492-4d943dace285-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.427329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-kube-api-access-6tjr4" (OuterVolumeSpecName: "kube-api-access-6tjr4") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "kube-api-access-6tjr4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.427564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.429661 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-884df8874-pjgwg"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.431128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.432528 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.438858 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-884df8874-pjgwg"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.446681 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.453526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07035577-c371-41ab-b492-4d943dace285-pod-info" (OuterVolumeSpecName: "pod-info") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.453970 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.457449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data" (OuterVolumeSpecName: "config-data") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.464731 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-886bdb4f7-fq2hm"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.479943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-server-conf" (OuterVolumeSpecName: "server-conf") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.480490 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-886bdb4f7-fq2hm"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.490775 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7fc58899d-l4892"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.496248 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7fc58899d-l4892"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.501624 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.506640 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-74c78d6cbd-7f94c"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.512623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-86b49c8d88-lq6lx"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.515740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "07035577-c371-41ab-b492-4d943dace285" (UID: "07035577-c371-41ab-b492-4d943dace285"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.520292 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-86b49c8d88-lq6lx"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.523782 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.523812 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/07035577-c371-41ab-b492-4d943dace285-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.523966 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524019 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/07035577-c371-41ab-b492-4d943dace285-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524029 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524039 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524067 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524076 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/07035577-c371-41ab-b492-4d943dace285-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524086 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6tjr4\" (UniqueName: \"kubernetes.io/projected/07035577-c371-41ab-b492-4d943dace285-kube-api-access-6tjr4\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.524114 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/07035577-c371-41ab-b492-4d943dace285-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.526564 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.531677 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.536725 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.540053 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.541136 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.545681 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.550155 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.624965 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.838822 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.147:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:54 crc kubenswrapper[4769]: I1121 12:16:54.838980 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7fc58899d-l4892" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.147:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.084388 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"07035577-c371-41ab-b492-4d943dace285","Type":"ContainerDied","Data":"da55c8c54ea4527fb96051b38bca5b7a8a3141916752d432e4b51439e0e3936e"} Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.084437 4769 scope.go:117] "RemoveContainer" containerID="5e7d206d799633d2293ea1c3e7fd6b27165e4608e8d950efc6bb43320c259bb3" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.084553 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.105383 4769 scope.go:117] "RemoveContainer" containerID="13b30d5ba32fd94fb4b51fd7cfa042d53251f175f92af53d61a459939b13989d" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.140896 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.146937 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.285407 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07035577-c371-41ab-b492-4d943dace285" path="/var/lib/kubelet/pods/07035577-c371-41ab-b492-4d943dace285/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.286993 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" path="/var/lib/kubelet/pods/07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.287626 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a5a57f9-588e-4e9f-9208-895c4131ee2e" path="/var/lib/kubelet/pods/1a5a57f9-588e-4e9f-9208-895c4131ee2e/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.288910 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27fe312f-1788-4660-b46f-ac049f1529c9" path="/var/lib/kubelet/pods/27fe312f-1788-4660-b46f-ac049f1529c9/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.289714 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" path="/var/lib/kubelet/pods/2825ea3d-77e9-4cf1-8d50-c772fe89bc30/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.290478 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" path="/var/lib/kubelet/pods/2f4e5e5e-6d6e-416a-9457-66f197b04835/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.291784 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" path="/var/lib/kubelet/pods/4b6385ef-77f7-4187-abae-725f7c9c6090/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.292782 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" path="/var/lib/kubelet/pods/4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.294324 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" path="/var/lib/kubelet/pods/4ff3caad-9d87-4e02-abd3-e6148084a692/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.295183 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54bead83-c56d-4882-82a2-9188f98b2d79" path="/var/lib/kubelet/pods/54bead83-c56d-4882-82a2-9188f98b2d79/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.295863 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" path="/var/lib/kubelet/pods/5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.297174 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602f0862-0d09-482c-90ae-750628c4ab13" path="/var/lib/kubelet/pods/602f0862-0d09-482c-90ae-750628c4ab13/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.298022 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" path="/var/lib/kubelet/pods/6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.298666 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8129d1-7fcc-4f40-8f52-df287de84e48" path="/var/lib/kubelet/pods/6f8129d1-7fcc-4f40-8f52-df287de84e48/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.299112 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" path="/var/lib/kubelet/pods/801dd535-e22a-4d31-85b8-c8cdb0c2bed2/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.300266 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0209b46-f4b0-43f9-ac34-43d89e7ece45" path="/var/lib/kubelet/pods/b0209b46-f4b0-43f9-ac34-43d89e7ece45/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.300934 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1611028-fdb2-48bf-8f36-8109220e3d2c" path="/var/lib/kubelet/pods/b1611028-fdb2-48bf-8f36-8109220e3d2c/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.301665 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" path="/var/lib/kubelet/pods/c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.303033 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" path="/var/lib/kubelet/pods/c5b897fd-dde5-489a-a738-88aa63a4f806/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.304726 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" path="/var/lib/kubelet/pods/d14bc1fc-4621-423c-9dd3-36ea104d0c9f/volumes" Nov 21 12:16:55 crc kubenswrapper[4769]: I1121 12:16:55.305727 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da4c93fc-884b-4701-b589-da46434544d4" path="/var/lib/kubelet/pods/da4c93fc-884b-4701-b589-da46434544d4/volumes" Nov 21 12:16:57 crc kubenswrapper[4769]: I1121 12:16:57.546400 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:16:57 crc kubenswrapper[4769]: I1121 12:16:57.602777 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn"] Nov 21 12:16:57 crc kubenswrapper[4769]: I1121 12:16:57.603246 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerName="dnsmasq-dns" containerID="cri-o://813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee" gracePeriod=10 Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.004469 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.128326 4769 generic.go:334] "Generic (PLEG): container finished" podID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerID="813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee" exitCode=0 Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.128374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" event={"ID":"1dcf57ba-14a9-4960-8108-7c66aad9a866","Type":"ContainerDied","Data":"813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee"} Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.128411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" event={"ID":"1dcf57ba-14a9-4960-8108-7c66aad9a866","Type":"ContainerDied","Data":"3b6206a7d4cd791272f5cc1660d00b20e97f5533a45c9dc4d437cdad01e97a07"} Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.128435 4769 scope.go:117] "RemoveContainer" containerID="813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.128580 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.154247 4769 scope.go:117] "RemoveContainer" containerID="8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.176780 4769 scope.go:117] "RemoveContainer" containerID="813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee" Nov 21 12:16:58 crc kubenswrapper[4769]: E1121 12:16:58.177296 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee\": container with ID starting with 813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee not found: ID does not exist" containerID="813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.177336 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee"} err="failed to get container status \"813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee\": rpc error: code = NotFound desc = could not find container \"813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee\": container with ID starting with 813a02bc6436e6b45d5cd10746f6a714a0a84a92078991cb252f7ffe9b0118ee not found: ID does not exist" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.177385 4769 scope.go:117] "RemoveContainer" containerID="8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40" Nov 21 12:16:58 crc kubenswrapper[4769]: E1121 12:16:58.177739 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40\": container with ID starting with 8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40 not found: ID does not exist" containerID="8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.177782 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40"} err="failed to get container status \"8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40\": rpc error: code = NotFound desc = could not find container \"8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40\": container with ID starting with 8969b02a2836ef169599d5d052e33d57b29434ffd143ab1c2939d80dd5ad7a40 not found: ID does not exist" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.204472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-config\") pod \"1dcf57ba-14a9-4960-8108-7c66aad9a866\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.204529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghcb7\" (UniqueName: \"kubernetes.io/projected/1dcf57ba-14a9-4960-8108-7c66aad9a866-kube-api-access-ghcb7\") pod \"1dcf57ba-14a9-4960-8108-7c66aad9a866\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.204609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dnsmasq-svc\") pod \"1dcf57ba-14a9-4960-8108-7c66aad9a866\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.204645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dns-swift-storage-0\") pod \"1dcf57ba-14a9-4960-8108-7c66aad9a866\" (UID: \"1dcf57ba-14a9-4960-8108-7c66aad9a866\") " Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.211109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dcf57ba-14a9-4960-8108-7c66aad9a866-kube-api-access-ghcb7" (OuterVolumeSpecName: "kube-api-access-ghcb7") pod "1dcf57ba-14a9-4960-8108-7c66aad9a866" (UID: "1dcf57ba-14a9-4960-8108-7c66aad9a866"). InnerVolumeSpecName "kube-api-access-ghcb7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.242464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "1dcf57ba-14a9-4960-8108-7c66aad9a866" (UID: "1dcf57ba-14a9-4960-8108-7c66aad9a866"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.242524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1dcf57ba-14a9-4960-8108-7c66aad9a866" (UID: "1dcf57ba-14a9-4960-8108-7c66aad9a866"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.243817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-config" (OuterVolumeSpecName: "config") pod "1dcf57ba-14a9-4960-8108-7c66aad9a866" (UID: "1dcf57ba-14a9-4960-8108-7c66aad9a866"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.307024 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.307087 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ghcb7\" (UniqueName: \"kubernetes.io/projected/1dcf57ba-14a9-4960-8108-7c66aad9a866-kube-api-access-ghcb7\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.307107 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.307126 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/1dcf57ba-14a9-4960-8108-7c66aad9a866-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.462032 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn"] Nov 21 12:16:58 crc kubenswrapper[4769]: I1121 12:16:58.473550 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84fc46597c-hrcbn"] Nov 21 12:16:59 crc kubenswrapper[4769]: I1121 12:16:59.285106 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" path="/var/lib/kubelet/pods/1dcf57ba-14a9-4960-8108-7c66aad9a866/volumes" Nov 21 12:17:01 crc kubenswrapper[4769]: E1121 12:17:01.558897 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:17:01 crc kubenswrapper[4769]: E1121 12:17:01.558937 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:17:01 crc kubenswrapper[4769]: E1121 12:17:01.559003 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:17.558984567 +0000 UTC m=+1596.259646385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:17:01 crc kubenswrapper[4769]: E1121 12:17:01.558902 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:17:01 crc kubenswrapper[4769]: E1121 12:17:01.559022 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:17.559014848 +0000 UTC m=+1596.259676666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:17:01 crc kubenswrapper[4769]: E1121 12:17:01.559048 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:17.559029328 +0000 UTC m=+1596.259691146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:17:11 crc kubenswrapper[4769]: I1121 12:17:11.111136 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.197:9696/\": dial tcp 10.217.0.197:9696: connect: connection refused" Nov 21 12:17:11 crc kubenswrapper[4769]: I1121 12:17:11.324788 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:17:11 crc kubenswrapper[4769]: I1121 12:17:11.324843 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:17:14 crc kubenswrapper[4769]: I1121 12:17:14.319416 4769 generic.go:334] "Generic (PLEG): container finished" podID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerID="cf82826193b6f45df71d06ed96b204d0c5b80c81545d2459bde6c09873109e25" exitCode=137 Nov 21 12:17:14 crc kubenswrapper[4769]: I1121 12:17:14.319589 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"cf82826193b6f45df71d06ed96b204d0c5b80c81545d2459bde6c09873109e25"} Nov 21 12:17:14 crc kubenswrapper[4769]: I1121 12:17:14.903965 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7d95c8c454-8fh7j_06ddf5d7-4d61-4f18-9d64-f99b7a0d236a/neutron-api/0.log" Nov 21 12:17:14 crc kubenswrapper[4769]: I1121 12:17:14.904278 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:17:14 crc kubenswrapper[4769]: I1121 12:17:14.945831 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-internal-tls-certs\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-lock\") pod \"3080b259-18ef-4c43-a7e9-f79d35c4a910\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021198 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") pod \"3080b259-18ef-4c43-a7e9-f79d35c4a910\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021243 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-public-tls-certs\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-combined-ca-bundle\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021332 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"3080b259-18ef-4c43-a7e9-f79d35c4a910\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021361 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-cache\") pod \"3080b259-18ef-4c43-a7e9-f79d35c4a910\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-httpd-config\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxfjl\" (UniqueName: \"kubernetes.io/projected/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-kube-api-access-pxfjl\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021471 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-ovndb-tls-certs\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-kube-api-access-sg7xz\") pod \"3080b259-18ef-4c43-a7e9-f79d35c4a910\" (UID: \"3080b259-18ef-4c43-a7e9-f79d35c4a910\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-config\") pod \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\" (UID: \"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a\") " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.021947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-lock" (OuterVolumeSpecName: "lock") pod "3080b259-18ef-4c43-a7e9-f79d35c4a910" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.022869 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-cache" (OuterVolumeSpecName: "cache") pod "3080b259-18ef-4c43-a7e9-f79d35c4a910" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.028092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.028339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "swift") pod "3080b259-18ef-4c43-a7e9-f79d35c4a910" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.028581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "3080b259-18ef-4c43-a7e9-f79d35c4a910" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.029855 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-kube-api-access-pxfjl" (OuterVolumeSpecName: "kube-api-access-pxfjl") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "kube-api-access-pxfjl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.032044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-kube-api-access-sg7xz" (OuterVolumeSpecName: "kube-api-access-sg7xz") pod "3080b259-18ef-4c43-a7e9-f79d35c4a910" (UID: "3080b259-18ef-4c43-a7e9-f79d35c4a910"). InnerVolumeSpecName "kube-api-access-sg7xz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.071655 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-config" (OuterVolumeSpecName: "config") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.073607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.077833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.078375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.092361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" (UID: "06ddf5d7-4d61-4f18-9d64-f99b7a0d236a"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123045 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123086 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123096 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123110 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123140 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123149 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/3080b259-18ef-4c43-a7e9-f79d35c4a910-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123158 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123166 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pxfjl\" (UniqueName: \"kubernetes.io/projected/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-kube-api-access-pxfjl\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123174 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123252 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/3080b259-18ef-4c43-a7e9-f79d35c4a910-kube-api-access-sg7xz\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123260 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.123270 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.146373 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.225229 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.336875 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.336741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"3080b259-18ef-4c43-a7e9-f79d35c4a910","Type":"ContainerDied","Data":"141eb42a42c521c78bfdd39e6959c40da53d213814cf190885ccec6f03c5819a"} Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.337223 4769 scope.go:117] "RemoveContainer" containerID="cf82826193b6f45df71d06ed96b204d0c5b80c81545d2459bde6c09873109e25" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.340273 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7d95c8c454-8fh7j_06ddf5d7-4d61-4f18-9d64-f99b7a0d236a/neutron-api/0.log" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.340335 4769 generic.go:334] "Generic (PLEG): container finished" podID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerID="ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca" exitCode=137 Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.340370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" event={"ID":"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a","Type":"ContainerDied","Data":"ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca"} Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.340400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" event={"ID":"06ddf5d7-4d61-4f18-9d64-f99b7a0d236a","Type":"ContainerDied","Data":"25c05323ea28b7c41545cb8ab0edffc5904e649344d577108c394ae07d9c3445"} Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.340435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7d95c8c454-8fh7j" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.370248 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7d95c8c454-8fh7j"] Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.371423 4769 scope.go:117] "RemoveContainer" containerID="be39754759fd17a18f604f2728a7893626e52c3515f6214cd5e5e54fef183452" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.383362 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7d95c8c454-8fh7j"] Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.403985 4769 scope.go:117] "RemoveContainer" containerID="e2808bd868aeae017a04132a01b7d2e857719666bf85d95a642328026416cf97" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.403994 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.417524 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.434515 4769 scope.go:117] "RemoveContainer" containerID="0a0d51356029320c9a583d23c45807d7f2663d7ff6c65f47a67e084309bbcd66" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.460667 4769 scope.go:117] "RemoveContainer" containerID="388db589345d573a520830181a6ba64b6bc1cdbade81b8d62c71195efd4ef1c4" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.491704 4769 scope.go:117] "RemoveContainer" containerID="3a14f3d66cae931eea76270308d88fb7ea2a243e0a7122714ca90e92a4890871" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.513826 4769 scope.go:117] "RemoveContainer" containerID="25e1a54d26ddfb9a829a245940bfcaf7070e32fe5f4ddfcfb2d6f6aeb4ead557" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.536366 4769 scope.go:117] "RemoveContainer" containerID="27958e395e51d689bcbd2990abea2442025674f51da66c5dd8d41c22845b6a7e" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.558774 4769 scope.go:117] "RemoveContainer" containerID="45f365205135ce2e01bbfee57ada2f110cd242b7e9e71f898a4ac35789747421" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.581383 4769 scope.go:117] "RemoveContainer" containerID="0d588eda24d0241fbab0826491cc028433f6f2f32fdf6cd4d8affd66af104a68" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.601965 4769 scope.go:117] "RemoveContainer" containerID="203e48f965912ad353abee711526bb792bbb4e47a16ecc867448217e54b56e0c" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.623956 4769 scope.go:117] "RemoveContainer" containerID="dc7dea0d6dbeaa8c46b2065ff344204b8df21cb9810f401cf24d17ae7ca6afaf" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.641848 4769 scope.go:117] "RemoveContainer" containerID="ca6b15428291fe150460b7d7882eebf311cbba0fcecfb1f7d9f74590dc5fe81b" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.666470 4769 scope.go:117] "RemoveContainer" containerID="5af4e4a2d044d5cb850f805f8996194bff8c44a4651a70d9a5dd2a8bd18805e3" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.683778 4769 scope.go:117] "RemoveContainer" containerID="945c32e350c847e0aa9da2e6f054178271e0c145ed13e0c0fe29a4c6ea33fdac" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.703074 4769 scope.go:117] "RemoveContainer" containerID="c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.722853 4769 scope.go:117] "RemoveContainer" containerID="ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.744731 4769 scope.go:117] "RemoveContainer" containerID="c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007" Nov 21 12:17:15 crc kubenswrapper[4769]: E1121 12:17:15.745570 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007\": container with ID starting with c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007 not found: ID does not exist" containerID="c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.745624 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007"} err="failed to get container status \"c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007\": rpc error: code = NotFound desc = could not find container \"c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007\": container with ID starting with c00e7f5d08bd9363d585195ad656272ac0acc43e7960c28f2fc771d24b9dc007 not found: ID does not exist" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.745660 4769 scope.go:117] "RemoveContainer" containerID="ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca" Nov 21 12:17:15 crc kubenswrapper[4769]: E1121 12:17:15.746107 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca\": container with ID starting with ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca not found: ID does not exist" containerID="ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca" Nov 21 12:17:15 crc kubenswrapper[4769]: I1121 12:17:15.746168 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca"} err="failed to get container status \"ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca\": rpc error: code = NotFound desc = could not find container \"ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca\": container with ID starting with ae0a8380bf757f66a5d3f7044290b073316c7592c17d1b592e1413bf5b940aca not found: ID does not exist" Nov 21 12:17:16 crc kubenswrapper[4769]: I1121 12:17:16.556796 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8870a8ea-8869-4eb6-befb-ca059ee3bfd7"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8870a8ea-8869-4eb6-befb-ca059ee3bfd7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8870a8ea_8869_4eb6_befb_ca059ee3bfd7.slice" Nov 21 12:17:16 crc kubenswrapper[4769]: E1121 12:17:16.556841 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod8870a8ea-8869-4eb6-befb-ca059ee3bfd7] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod8870a8ea-8869-4eb6-befb-ca059ee3bfd7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8870a8ea_8869_4eb6_befb_ca059ee3bfd7.slice" pod="openstack-kuttl-tests/openstackclient" podUID="8870a8ea-8869-4eb6-befb-ca059ee3bfd7" Nov 21 12:17:17 crc kubenswrapper[4769]: I1121 12:17:17.285787 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" path="/var/lib/kubelet/pods/06ddf5d7-4d61-4f18-9d64-f99b7a0d236a/volumes" Nov 21 12:17:17 crc kubenswrapper[4769]: I1121 12:17:17.286567 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" path="/var/lib/kubelet/pods/3080b259-18ef-4c43-a7e9-f79d35c4a910/volumes" Nov 21 12:17:17 crc kubenswrapper[4769]: I1121 12:17:17.367935 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5856314-1efb-4026-84a0-f18d4420682e" containerID="d3da256612d18012e177149e2ef5438be46b40c5619f9f15a81fe1cc9b16a290" exitCode=137 Nov 21 12:17:17 crc kubenswrapper[4769]: I1121 12:17:17.368078 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:17:17 crc kubenswrapper[4769]: I1121 12:17:17.368246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" event={"ID":"d5856314-1efb-4026-84a0-f18d4420682e","Type":"ContainerDied","Data":"d3da256612d18012e177149e2ef5438be46b40c5619f9f15a81fe1cc9b16a290"} Nov 21 12:17:17 crc kubenswrapper[4769]: E1121 12:17:17.565439 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:17:17 crc kubenswrapper[4769]: E1121 12:17:17.565495 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:17:17 crc kubenswrapper[4769]: E1121 12:17:17.565444 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-keystone-listener-config-data: secret "barbican-keystone-listener-config-data" not found Nov 21 12:17:17 crc kubenswrapper[4769]: E1121 12:17:17.565547 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:49.565522629 +0000 UTC m=+1628.266184447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "combined-ca-bundle" not found Nov 21 12:17:17 crc kubenswrapper[4769]: E1121 12:17:17.565573 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:49.56555769 +0000 UTC m=+1628.266219508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-keystone-listener-config-data" not found Nov 21 12:17:17 crc kubenswrapper[4769]: E1121 12:17:17.565591 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data podName:d5856314-1efb-4026-84a0-f18d4420682e nodeName:}" failed. No retries permitted until 2025-11-21 12:17:49.56558279 +0000 UTC m=+1628.266244608 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data") pod "barbican-keystone-listener-77fb7c74c6-5kzvz" (UID: "d5856314-1efb-4026-84a0-f18d4420682e") : secret "barbican-config-data" not found Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.049725 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.073768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data\") pod \"d5856314-1efb-4026-84a0-f18d4420682e\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.073827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle\") pod \"d5856314-1efb-4026-84a0-f18d4420682e\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.073857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom\") pod \"d5856314-1efb-4026-84a0-f18d4420682e\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.073895 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5856314-1efb-4026-84a0-f18d4420682e-logs\") pod \"d5856314-1efb-4026-84a0-f18d4420682e\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.073968 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7mf4\" (UniqueName: \"kubernetes.io/projected/d5856314-1efb-4026-84a0-f18d4420682e-kube-api-access-l7mf4\") pod \"d5856314-1efb-4026-84a0-f18d4420682e\" (UID: \"d5856314-1efb-4026-84a0-f18d4420682e\") " Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.074698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5856314-1efb-4026-84a0-f18d4420682e-logs" (OuterVolumeSpecName: "logs") pod "d5856314-1efb-4026-84a0-f18d4420682e" (UID: "d5856314-1efb-4026-84a0-f18d4420682e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.079389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5856314-1efb-4026-84a0-f18d4420682e-kube-api-access-l7mf4" (OuterVolumeSpecName: "kube-api-access-l7mf4") pod "d5856314-1efb-4026-84a0-f18d4420682e" (UID: "d5856314-1efb-4026-84a0-f18d4420682e"). InnerVolumeSpecName "kube-api-access-l7mf4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.079581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d5856314-1efb-4026-84a0-f18d4420682e" (UID: "d5856314-1efb-4026-84a0-f18d4420682e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.106407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d5856314-1efb-4026-84a0-f18d4420682e" (UID: "d5856314-1efb-4026-84a0-f18d4420682e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.115165 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data" (OuterVolumeSpecName: "config-data") pod "d5856314-1efb-4026-84a0-f18d4420682e" (UID: "d5856314-1efb-4026-84a0-f18d4420682e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.176382 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l7mf4\" (UniqueName: \"kubernetes.io/projected/d5856314-1efb-4026-84a0-f18d4420682e-kube-api-access-l7mf4\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.176427 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.176439 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.176451 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5856314-1efb-4026-84a0-f18d4420682e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.176462 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5856314-1efb-4026-84a0-f18d4420682e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.260566 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.195:8778/\": EOF" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.260566 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.195:8778/\": EOF" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.384784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" event={"ID":"d5856314-1efb-4026-84a0-f18d4420682e","Type":"ContainerDied","Data":"e3ef8320c869efe4c4ed4bc5b63b4e28dcc11671dfd124c32a85b3b944e65ce5"} Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.384856 4769 scope.go:117] "RemoveContainer" containerID="d3da256612d18012e177149e2ef5438be46b40c5619f9f15a81fe1cc9b16a290" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.385001 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz" Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.395173 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerID="1ac15273050e574736d66f32b58a455ffd412210252313f77f768cad3b6fc81b" exitCode=137 Nov 21 12:17:18 crc kubenswrapper[4769]: I1121 12:17:18.395248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" event={"ID":"0ba7fad1-0c38-4270-8742-6bf0646009cc","Type":"ContainerDied","Data":"1ac15273050e574736d66f32b58a455ffd412210252313f77f768cad3b6fc81b"} Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.412344 4769 scope.go:117] "RemoveContainer" containerID="d4b38b2f0a74bcdc04513afd3ca43875e7a1c81a107b6af5ac333109a5f72d0a" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.439953 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz"] Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.449857 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-77fb7c74c6-5kzvz"] Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.752804 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.790758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-public-tls-certs\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.790911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m8tq\" (UniqueName: \"kubernetes.io/projected/0ba7fad1-0c38-4270-8742-6bf0646009cc-kube-api-access-5m8tq\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.790970 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-scripts\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.790991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-config-data\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.791037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-combined-ca-bundle\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.791096 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-internal-tls-certs\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.791139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba7fad1-0c38-4270-8742-6bf0646009cc-logs\") pod \"0ba7fad1-0c38-4270-8742-6bf0646009cc\" (UID: \"0ba7fad1-0c38-4270-8742-6bf0646009cc\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.792174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ba7fad1-0c38-4270-8742-6bf0646009cc-logs" (OuterVolumeSpecName: "logs") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.820651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba7fad1-0c38-4270-8742-6bf0646009cc-kube-api-access-5m8tq" (OuterVolumeSpecName: "kube-api-access-5m8tq") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "kube-api-access-5m8tq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.823111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-scripts" (OuterVolumeSpecName: "scripts") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.855241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-config-data" (OuterVolumeSpecName: "config-data") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.856891 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.889512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.893094 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5m8tq\" (UniqueName: \"kubernetes.io/projected/0ba7fad1-0c38-4270-8742-6bf0646009cc-kube-api-access-5m8tq\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.893121 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.893135 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.893147 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.893159 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0ba7fad1-0c38-4270-8742-6bf0646009cc-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.893171 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.894835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0ba7fad1-0c38-4270-8742-6bf0646009cc" (UID: "0ba7fad1-0c38-4270-8742-6bf0646009cc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:18.994879 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba7fad1-0c38-4270-8742-6bf0646009cc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.283587 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5856314-1efb-4026-84a0-f18d4420682e" path="/var/lib/kubelet/pods/d5856314-1efb-4026-84a0-f18d4420682e/volumes" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.406853 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerID="77a24c7e4374cb102e6e55368833596a67d6671d305260a07e3eae1ea49034ea" exitCode=137 Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.406921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" event={"ID":"ddf92e36-0f72-42e5-9a43-a4c62def4273","Type":"ContainerDied","Data":"77a24c7e4374cb102e6e55368833596a67d6671d305260a07e3eae1ea49034ea"} Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.408964 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.408960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-79dbc96794-9llmc" event={"ID":"0ba7fad1-0c38-4270-8742-6bf0646009cc","Type":"ContainerDied","Data":"68f0c872f2aede1b11ef58743570794166236285199dc632726328e6050d3031"} Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.409045 4769 scope.go:117] "RemoveContainer" containerID="1ac15273050e574736d66f32b58a455ffd412210252313f77f768cad3b6fc81b" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.430503 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-79dbc96794-9llmc"] Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.436811 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-79dbc96794-9llmc"] Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.449481 4769 scope.go:117] "RemoveContainer" containerID="f116a1e141b61332e1ccc5be485e02bf09a9f596a59f6af5816127d8403ab177" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.690390 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.804883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data-custom\") pod \"ddf92e36-0f72-42e5-9a43-a4c62def4273\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.804943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddf92e36-0f72-42e5-9a43-a4c62def4273-logs\") pod \"ddf92e36-0f72-42e5-9a43-a4c62def4273\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.805047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data\") pod \"ddf92e36-0f72-42e5-9a43-a4c62def4273\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.805094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lwxb\" (UniqueName: \"kubernetes.io/projected/ddf92e36-0f72-42e5-9a43-a4c62def4273-kube-api-access-6lwxb\") pod \"ddf92e36-0f72-42e5-9a43-a4c62def4273\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.805127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-combined-ca-bundle\") pod \"ddf92e36-0f72-42e5-9a43-a4c62def4273\" (UID: \"ddf92e36-0f72-42e5-9a43-a4c62def4273\") " Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.805857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf92e36-0f72-42e5-9a43-a4c62def4273-logs" (OuterVolumeSpecName: "logs") pod "ddf92e36-0f72-42e5-9a43-a4c62def4273" (UID: "ddf92e36-0f72-42e5-9a43-a4c62def4273"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.808481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ddf92e36-0f72-42e5-9a43-a4c62def4273" (UID: "ddf92e36-0f72-42e5-9a43-a4c62def4273"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.809510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf92e36-0f72-42e5-9a43-a4c62def4273-kube-api-access-6lwxb" (OuterVolumeSpecName: "kube-api-access-6lwxb") pod "ddf92e36-0f72-42e5-9a43-a4c62def4273" (UID: "ddf92e36-0f72-42e5-9a43-a4c62def4273"). InnerVolumeSpecName "kube-api-access-6lwxb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.824964 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ddf92e36-0f72-42e5-9a43-a4c62def4273" (UID: "ddf92e36-0f72-42e5-9a43-a4c62def4273"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.843797 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data" (OuterVolumeSpecName: "config-data") pod "ddf92e36-0f72-42e5-9a43-a4c62def4273" (UID: "ddf92e36-0f72-42e5-9a43-a4c62def4273"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.907200 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddf92e36-0f72-42e5-9a43-a4c62def4273-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.907237 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.907267 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6lwxb\" (UniqueName: \"kubernetes.io/projected/ddf92e36-0f72-42e5-9a43-a4c62def4273-kube-api-access-6lwxb\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.907280 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:19 crc kubenswrapper[4769]: I1121 12:17:19.907293 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ddf92e36-0f72-42e5-9a43-a4c62def4273-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.423930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" event={"ID":"ddf92e36-0f72-42e5-9a43-a4c62def4273","Type":"ContainerDied","Data":"3f1d9ff66a4f267a1e501608714e446d707ed4aa16d6435ff3da97a23b90624a"} Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.424437 4769 scope.go:117] "RemoveContainer" containerID="77a24c7e4374cb102e6e55368833596a67d6671d305260a07e3eae1ea49034ea" Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.424032 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p" Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.448766 4769 scope.go:117] "RemoveContainer" containerID="a5620e44e4048ff79526ea7eb83d69080f71db4027cb278c5fae33246445abc9" Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.459886 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p"] Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.464898 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bd7985695-kll6p"] Nov 21 12:17:20 crc kubenswrapper[4769]: I1121 12:17:20.507037 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod9d9e9e8e-52d3-4601-be5f-84b9ac61697b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod9d9e9e8e-52d3-4601-be5f-84b9ac61697b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod9d9e9e8e_52d3_4601_be5f_84b9ac61697b.slice" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.283427 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" path="/var/lib/kubelet/pods/0ba7fad1-0c38-4270-8742-6bf0646009cc/volumes" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.284272 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" path="/var/lib/kubelet/pods/ddf92e36-0f72-42e5-9a43-a4c62def4273/volumes" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.440824 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5b6f78b9d-v4x2t_75af4712-517b-45d9-981e-30e251a28bb0/neutron-api/0.log" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.440897 4769 generic.go:334] "Generic (PLEG): container finished" podID="75af4712-517b-45d9-981e-30e251a28bb0" containerID="916d98f663ba6263039a2c39855de0d1d9fa14e0ed53c268bb35114528811668" exitCode=137 Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.441000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" event={"ID":"75af4712-517b-45d9-981e-30e251a28bb0","Type":"ContainerDied","Data":"916d98f663ba6263039a2c39855de0d1d9fa14e0ed53c268bb35114528811668"} Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.751597 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5b6f78b9d-v4x2t_75af4712-517b-45d9-981e-30e251a28bb0/neutron-api/0.log" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.751677 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.835780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-internal-tls-certs\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.835841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-config\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.836551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-httpd-config\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.836658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-combined-ca-bundle\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.836690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-public-tls-certs\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.836715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-ovndb-tls-certs\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.836745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdw64\" (UniqueName: \"kubernetes.io/projected/75af4712-517b-45d9-981e-30e251a28bb0-kube-api-access-fdw64\") pod \"75af4712-517b-45d9-981e-30e251a28bb0\" (UID: \"75af4712-517b-45d9-981e-30e251a28bb0\") " Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.842028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.844753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75af4712-517b-45d9-981e-30e251a28bb0-kube-api-access-fdw64" (OuterVolumeSpecName: "kube-api-access-fdw64") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "kube-api-access-fdw64". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.875125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.875692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.881925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-config" (OuterVolumeSpecName: "config") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.889066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.897381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "75af4712-517b-45d9-981e-30e251a28bb0" (UID: "75af4712-517b-45d9-981e-30e251a28bb0"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938583 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938632 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938649 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938682 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938694 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fdw64\" (UniqueName: \"kubernetes.io/projected/75af4712-517b-45d9-981e-30e251a28bb0-kube-api-access-fdw64\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938706 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:21 crc kubenswrapper[4769]: I1121 12:17:21.938716 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/75af4712-517b-45d9-981e-30e251a28bb0-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.453877 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-5b6f78b9d-v4x2t_75af4712-517b-45d9-981e-30e251a28bb0/neutron-api/0.log" Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.453938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" event={"ID":"75af4712-517b-45d9-981e-30e251a28bb0","Type":"ContainerDied","Data":"dc7b111068a150068e5e568d701fa0d0c0335c24d806b7046fd1d2c4e235d667"} Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.453975 4769 scope.go:117] "RemoveContainer" containerID="d33009605c9d55b04f6760096b5eb13584040aca065be5164e5a534afebcad32" Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.454083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t" Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.479794 4769 scope.go:117] "RemoveContainer" containerID="916d98f663ba6263039a2c39855de0d1d9fa14e0ed53c268bb35114528811668" Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.494749 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t"] Nov 21 12:17:22 crc kubenswrapper[4769]: I1121 12:17:22.502824 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5b6f78b9d-v4x2t"] Nov 21 12:17:23 crc kubenswrapper[4769]: I1121 12:17:23.284640 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75af4712-517b-45d9-981e-30e251a28bb0" path="/var/lib/kubelet/pods/75af4712-517b-45d9-981e-30e251a28bb0/volumes" Nov 21 12:17:23 crc kubenswrapper[4769]: I1121 12:17:23.669036 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podd9cb03d6-db43-4569-b583-7d2cd315dbc6"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podd9cb03d6-db43-4569-b583-7d2cd315dbc6] : Timed out while waiting for systemd to remove kubepods-besteffort-podd9cb03d6_db43_4569_b583_7d2cd315dbc6.slice" Nov 21 12:17:23 crc kubenswrapper[4769]: E1121 12:17:23.669492 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podd9cb03d6-db43-4569-b583-7d2cd315dbc6] : unable to destroy cgroup paths for cgroup [kubepods besteffort podd9cb03d6-db43-4569-b583-7d2cd315dbc6] : Timed out while waiting for systemd to remove kubepods-besteffort-podd9cb03d6_db43_4569_b583_7d2cd315dbc6.slice" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" podUID="d9cb03d6-db43-4569-b583-7d2cd315dbc6" Nov 21 12:17:24 crc kubenswrapper[4769]: I1121 12:17:24.473084 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder9405-account-delete-6l74g" Nov 21 12:17:24 crc kubenswrapper[4769]: I1121 12:17:24.498795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder9405-account-delete-6l74g"] Nov 21 12:17:24 crc kubenswrapper[4769]: I1121 12:17:24.504886 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder9405-account-delete-6l74g"] Nov 21 12:17:25 crc kubenswrapper[4769]: I1121 12:17:25.284725 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9cb03d6-db43-4569-b583-7d2cd315dbc6" path="/var/lib/kubelet/pods/d9cb03d6-db43-4569-b583-7d2cd315dbc6/volumes" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.360332 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361275 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82bc46a0-92fc-4db5-a7db-08ac6812d117" containerName="kube-state-metrics" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361295 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82bc46a0-92fc-4db5-a7db-08ac6812d117" containerName="kube-state-metrics" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361316 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27fe312f-1788-4660-b46f-ac049f1529c9" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361323 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="27fe312f-1788-4660-b46f-ac049f1529c9" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361333 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="ovsdbserver-sb" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361340 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="ovsdbserver-sb" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361351 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-updater" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361357 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-updater" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361365 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361371 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361382 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="setup-container" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361388 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="setup-container" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-metadata" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361402 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-metadata" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361410 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361416 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361435 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361441 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361448 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361467 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerName="init" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361474 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerName="init" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361481 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-expirer" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361486 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-expirer" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361496 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="mysql-bootstrap" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361502 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="mysql-bootstrap" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361509 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361526 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-central-agent" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361532 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-central-agent" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361539 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361544 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361552 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" containerName="keystone-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361557 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" containerName="keystone-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361565 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361573 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361583 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361589 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361596 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361602 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361609 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361615 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361623 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361631 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361640 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361646 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361655 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="cinder-scheduler" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361663 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="cinder-scheduler" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361677 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerName="nova-cell1-conductor-conductor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361685 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerName="nova-cell1-conductor-conductor" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361694 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361700 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361708 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361723 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-notification-agent" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361731 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-notification-agent" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361742 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-updater" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361748 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-updater" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361754 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerName="nova-cell0-conductor-conductor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerName="nova-cell0-conductor-conductor" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="sg-core" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361777 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="sg-core" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361785 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361791 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-server" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361804 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361810 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361820 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361826 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="mysql-bootstrap" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361839 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="mysql-bootstrap" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361847 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361853 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361862 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361870 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361887 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361901 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361911 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361917 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361924 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0209b46-f4b0-43f9-ac34-43d89e7ece45" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361932 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0209b46-f4b0-43f9-ac34-43d89e7ece45" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361939 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361944 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361953 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361960 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361968 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="openstack-network-exporter" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361975 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="openstack-network-exporter" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.361984 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="galera" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.361989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="galera" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362000 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="openstack-network-exporter" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362006 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="openstack-network-exporter" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362018 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1611028-fdb2-48bf-8f36-8109220e3d2c" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362025 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1611028-fdb2-48bf-8f36-8109220e3d2c" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="rsync" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362041 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="rsync" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362052 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="swift-recon-cron" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362057 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="swift-recon-cron" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362066 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9cb03d6-db43-4569-b583-7d2cd315dbc6" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362071 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cb03d6-db43-4569-b583-7d2cd315dbc6" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362080 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="rabbitmq" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362088 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="rabbitmq" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362104 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-reaper" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-reaper" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362124 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362152 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362161 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerName="dnsmasq-dns" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362168 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerName="dnsmasq-dns" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362178 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362186 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362223 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362230 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362239 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1a5a57f9-588e-4e9f-9208-895c4131ee2e" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362247 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a5a57f9-588e-4e9f-9208-895c4131ee2e" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362262 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362269 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362276 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362282 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-server" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362292 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362299 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362307 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362313 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-server" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362325 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="setup-container" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362331 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="setup-container" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362341 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362347 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362355 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362361 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362372 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362377 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362385 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362390 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-server" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362398 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362404 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362413 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="54bead83-c56d-4882-82a2-9188f98b2d79" containerName="keystone-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362419 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bead83-c56d-4882-82a2-9188f98b2d79" containerName="keystone-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362428 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" containerName="nova-scheduler-scheduler" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362435 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" containerName="nova-scheduler-scheduler" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362444 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-api" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362466 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362497 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362506 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362511 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362517 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="probe" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362523 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="probe" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362529 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362535 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362545 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" containerName="memcached" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362552 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" containerName="memcached" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362561 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="proxy-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362567 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="proxy-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362576 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362582 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener-log" Nov 21 12:17:32 crc kubenswrapper[4769]: E1121 12:17:32.362593 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="galera" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362599 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="galera" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362797 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362810 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1a5a57f9-588e-4e9f-9208-895c4131ee2e" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362820 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362829 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4bac9dbe-2e92-4161-94cf-5f11f3762e00" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362837 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-notification-agent" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362850 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362859 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362871 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362878 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-updater" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362888 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1611028-fdb2-48bf-8f36-8109220e3d2c" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362895 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4be7b12a-19d5-476f-b806-41eb24d461ac" containerName="memcached" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362905 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362910 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="27fe312f-1788-4660-b46f-ac049f1529c9" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362919 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ba7fad1-0c38-4270-8742-6bf0646009cc" containerName="placement-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362929 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="openstack-network-exporter" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362937 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362945 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362953 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9cb03d6-db43-4569-b583-7d2cd315dbc6" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362959 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="ovn-northd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362967 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-reaper" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362974 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362982 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2825ea3d-77e9-4cf1-8d50-c772fe89bc30" containerName="barbican-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362990 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="sg-core" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.362996 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363006 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4b6385ef-77f7-4187-abae-725f7c9c6090" containerName="galera" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363016 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="probe" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363025 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363035 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363044 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="56388344-0941-4937-a249-fe91e7e0e0c6" containerName="nova-scheduler-scheduler" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363050 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4ff16c85-ea8b-4df6-8b5c-c4a7d11746a5" containerName="rabbitmq" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363058 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e46fa04-2e5a-4d08-ad1e-f70a4ae9712a" containerName="keystone-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363069 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="account-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363076 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363082 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="proxy-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363090 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363098 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363105 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363112 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9419c5db-b98d-44e8-a7f5-852229976f84" containerName="nova-metadata-metadata" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363122 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f4e5e5e-6d6e-416a-9457-66f197b04835" containerName="nova-cell0-conductor-conductor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363132 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0209b46-f4b0-43f9-ac34-43d89e7ece45" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363140 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="container-auditor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363147 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d14bc1fc-4621-423c-9dd3-36ea104d0c9f" containerName="proxy-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363157 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363163 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="41f05d9d-6645-4531-bca1-e94840a5bc88" containerName="cinder-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363171 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="07deacd7-8cfa-4b28-abc6-c68fbbcc6b0b" containerName="mariadb-account-delete" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363179 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c5b897fd-dde5-489a-a738-88aa63a4f806" containerName="cinder-scheduler" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363202 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b249afc8-1e7a-4537-8778-fc1e56c2afdc" containerName="galera" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363210 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363218 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-updater" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363226 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363235 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363242 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363250 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5856314-1efb-4026-84a0-f18d4420682e" containerName="barbican-keystone-listener" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363259 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75af4712-517b-45d9-981e-30e251a28bb0" containerName="neutron-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363268 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="rsync" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363274 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="06ddf5d7-4d61-4f18-9d64-f99b7a0d236a" containerName="neutron-httpd" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363283 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="82bc46a0-92fc-4db5-a7db-08ac6812d117" containerName="kube-state-metrics" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363291 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b122f86f-b55d-4234-a61e-de0aabcf6760" containerName="ceilometer-central-agent" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363301 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="da4c93fc-884b-4701-b589-da46434544d4" containerName="barbican-worker-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363309 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ed7ff37-6da9-471e-977d-ed0086cbcc42" containerName="nova-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363315 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8537fa74-d045-48de-b59b-59d7cab6d5fb" containerName="glance-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363325 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="801dd535-e22a-4d31-85b8-c8cdb0c2bed2" containerName="nova-cell1-conductor-conductor" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363334 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="07035577-c371-41ab-b492-4d943dace285" containerName="rabbitmq" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363342 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-expirer" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363350 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="swift-recon-cron" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363358 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db2d38dd-f72e-42d3-b681-674040ed92ba" containerName="glance-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363365 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="54bead83-c56d-4882-82a2-9188f98b2d79" containerName="keystone-api" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363371 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-server" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363380 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1dcf57ba-14a9-4960-8108-7c66aad9a866" containerName="dnsmasq-dns" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363390 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4ff3caad-9d87-4e02-abd3-e6148084a692" containerName="barbican-api-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363398 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c073bdb-2f2a-4b5d-bf5d-6fbca282cd35" containerName="placement-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363405 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf92e36-0f72-42e5-9a43-a4c62def4273" containerName="barbican-worker" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d9e9e8e-52d3-4601-be5f-84b9ac61697b" containerName="ovsdbserver-sb" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363422 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="602f0862-0d09-482c-90ae-750628c4ab13" containerName="openstack-network-exporter" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363429 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3080b259-18ef-4c43-a7e9-f79d35c4a910" containerName="object-replicator" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.363436 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c0f7ba3e-b7a8-4211-9fb2-f1483461a2bd" containerName="barbican-keystone-listener-log" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.364457 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.368216 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.373060 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-t898g" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.373157 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.373071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.373405 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.373483 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.373590 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.376032 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529535 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-server-conf\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9b970d3d-1a5c-40da-90ff-ddcc991a571d-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9b970d3d-1a5c-40da-90ff-ddcc991a571d-pod-info\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.529776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskn5\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-kube-api-access-bskn5\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.630880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.630939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.630964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.630995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-server-conf\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631025 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9b970d3d-1a5c-40da-90ff-ddcc991a571d-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9b970d3d-1a5c-40da-90ff-ddcc991a571d-pod-info\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bskn5\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-kube-api-access-bskn5\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.631982 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.632875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-server-conf\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.633165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.633657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.640659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.642479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9b970d3d-1a5c-40da-90ff-ddcc991a571d-pod-info\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.645285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.647635 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9b970d3d-1a5c-40da-90ff-ddcc991a571d-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.655438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskn5\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-kube-api-access-bskn5\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.658523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"rabbitmq-server-0\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.697154 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.816659 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.817818 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.822484 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.822581 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-2rhx5" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.822760 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.822841 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.822842 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.822854 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.823048 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.840553 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938718 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmmr\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-kube-api-access-twmmr\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:32 crc kubenswrapper[4769]: I1121 12:17:32.938995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.040724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.040818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.040853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.040883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.040932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-twmmr\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-kube-api-access-twmmr\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041376 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.041409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.042703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.042779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.043505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.043629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.046501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.048113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.048254 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.048735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.058037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmmr\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-kube-api-access-twmmr\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.073827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.151778 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.181908 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.366143 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.367611 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.370081 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.370770 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.371075 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-wvnqs" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.375453 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.375905 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.378071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.451776 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm6xh\" (UniqueName: \"kubernetes.io/projected/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kube-api-access-zm6xh\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kolla-config\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.555695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-default\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.614688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"9b970d3d-1a5c-40da-90ff-ddcc991a571d","Type":"ContainerStarted","Data":"f6fe062a0b5b397299cd0acc860b07b6d261085ab6a899371e278667b89c8258"} Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.616056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec","Type":"ContainerStarted","Data":"7d9c657f22aae1c5ba4950e858929541e33af9a9739ad31c807eefe412a5729c"} Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zm6xh\" (UniqueName: \"kubernetes.io/projected/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kube-api-access-zm6xh\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kolla-config\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.657508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-default\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.658244 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.658510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kolla-config\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.658552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.658661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-default\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.663674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.663927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.666236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.675358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm6xh\" (UniqueName: \"kubernetes.io/projected/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kube-api-access-zm6xh\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.678417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:33 crc kubenswrapper[4769]: I1121 12:17:33.688612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.160056 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:17:34 crc kubenswrapper[4769]: W1121 12:17:34.167873 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba1ff42d_4e97_42a8_9bc1_12490fa969e1.slice/crio-16442703f6baee1100683618c9033230fe75d7bedf6831ff288b9ed0e464a444 WatchSource:0}: Error finding container 16442703f6baee1100683618c9033230fe75d7bedf6831ff288b9ed0e464a444: Status 404 returned error can't find the container with id 16442703f6baee1100683618c9033230fe75d7bedf6831ff288b9ed0e464a444 Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.625961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ba1ff42d-4e97-42a8-9bc1-12490fa969e1","Type":"ContainerStarted","Data":"fbd5f96ae58c63ce27a67e0354a19870d563db200e82a4e9e60e28c8ec4b0843"} Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.626549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ba1ff42d-4e97-42a8-9bc1-12490fa969e1","Type":"ContainerStarted","Data":"16442703f6baee1100683618c9033230fe75d7bedf6831ff288b9ed0e464a444"} Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.628270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"9b970d3d-1a5c-40da-90ff-ddcc991a571d","Type":"ContainerStarted","Data":"5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9"} Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.709509 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.710724 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.715036 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.715089 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.715165 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-tk9bc" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.715613 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.731639 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875556 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.875695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpm89\" (UniqueName: \"kubernetes.io/projected/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kube-api-access-zpm89\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976783 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.976843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zpm89\" (UniqueName: \"kubernetes.io/projected/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kube-api-access-zpm89\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.978008 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.978482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.979051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.979285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.979502 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.982464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:34 crc kubenswrapper[4769]: I1121 12:17:34.983261 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.004295 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpm89\" (UniqueName: \"kubernetes.io/projected/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kube-api-access-zpm89\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.006079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.039449 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.469245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:17:35 crc kubenswrapper[4769]: W1121 12:17:35.476503 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e84ae61_76e9_4820_a40f_9dc2ca2aad50.slice/crio-0e0528c96db37bc7915bd89a1c41b23acd69e0982b0193c338c799d939a4db28 WatchSource:0}: Error finding container 0e0528c96db37bc7915bd89a1c41b23acd69e0982b0193c338c799d939a4db28: Status 404 returned error can't find the container with id 0e0528c96db37bc7915bd89a1c41b23acd69e0982b0193c338c799d939a4db28 Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.637829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec","Type":"ContainerStarted","Data":"70c0b5cef16d5d41ee21e47f8165d658e0ebe75099e6efceaf4ab4137ad4fd75"} Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.645252 4769 generic.go:334] "Generic (PLEG): container finished" podID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerID="fbd5f96ae58c63ce27a67e0354a19870d563db200e82a4e9e60e28c8ec4b0843" exitCode=0 Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.645375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ba1ff42d-4e97-42a8-9bc1-12490fa969e1","Type":"ContainerDied","Data":"fbd5f96ae58c63ce27a67e0354a19870d563db200e82a4e9e60e28c8ec4b0843"} Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.647446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e84ae61-76e9-4820-a40f-9dc2ca2aad50","Type":"ContainerStarted","Data":"b35327d9c8de5cdcf4b1fa823d74541998279884dacd73871eba19120c565001"} Nov 21 12:17:35 crc kubenswrapper[4769]: I1121 12:17:35.647477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e84ae61-76e9-4820-a40f-9dc2ca2aad50","Type":"ContainerStarted","Data":"0e0528c96db37bc7915bd89a1c41b23acd69e0982b0193c338c799d939a4db28"} Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.009941 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.011231 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.025141 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-kbw69" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.026308 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.028543 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.067260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.118204 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27v4m\" (UniqueName: \"kubernetes.io/projected/d898c08a-4c85-42c8-86f7-43e5fab04611-kube-api-access-27v4m\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.118260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.118299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.118345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-config-data\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.118382 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-kolla-config\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.220287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-config-data\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.220345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-kolla-config\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.220421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-27v4m\" (UniqueName: \"kubernetes.io/projected/d898c08a-4c85-42c8-86f7-43e5fab04611-kube-api-access-27v4m\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.220440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.220477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.222032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-config-data\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.222968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-kolla-config\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.226650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-memcached-tls-certs\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.228271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-combined-ca-bundle\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.240937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-27v4m\" (UniqueName: \"kubernetes.io/projected/d898c08a-4c85-42c8-86f7-43e5fab04611-kube-api-access-27v4m\") pod \"memcached-0\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.329908 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.657543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ba1ff42d-4e97-42a8-9bc1-12490fa969e1","Type":"ContainerStarted","Data":"99df80460a2097a210975c9c3f81c06ddafc94375c50ae068765c59ce67ccff6"} Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.658922 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerID="b35327d9c8de5cdcf4b1fa823d74541998279884dacd73871eba19120c565001" exitCode=0 Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.659688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e84ae61-76e9-4820-a40f-9dc2ca2aad50","Type":"ContainerDied","Data":"b35327d9c8de5cdcf4b1fa823d74541998279884dacd73871eba19120c565001"} Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.687925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=3.687906956 podStartE2EDuration="3.687906956s" podCreationTimestamp="2025-11-21 12:17:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:36.684834083 +0000 UTC m=+1615.385495911" watchObservedRunningTime="2025-11-21 12:17:36.687906956 +0000 UTC m=+1615.388568774" Nov 21 12:17:36 crc kubenswrapper[4769]: I1121 12:17:36.772854 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:17:36 crc kubenswrapper[4769]: W1121 12:17:36.785987 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd898c08a_4c85_42c8_86f7_43e5fab04611.slice/crio-dd00449222b16139d7ad632004871dfa709232dbcf3b682b319ad3e7b535c0c3 WatchSource:0}: Error finding container dd00449222b16139d7ad632004871dfa709232dbcf3b682b319ad3e7b535c0c3: Status 404 returned error can't find the container with id dd00449222b16139d7ad632004871dfa709232dbcf3b682b319ad3e7b535c0c3 Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.669077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d898c08a-4c85-42c8-86f7-43e5fab04611","Type":"ContainerStarted","Data":"dea46b3b14bbd1e5122a520588b3b7295eb7903651356a0165e54bcd7dc9275d"} Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.669409 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.669419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d898c08a-4c85-42c8-86f7-43e5fab04611","Type":"ContainerStarted","Data":"dd00449222b16139d7ad632004871dfa709232dbcf3b682b319ad3e7b535c0c3"} Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.672553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e84ae61-76e9-4820-a40f-9dc2ca2aad50","Type":"ContainerStarted","Data":"26b697829e7267deb81d91feb65ff469a03f946ef4e391778b1456f41ec08739"} Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.693143 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.693122181 podStartE2EDuration="2.693122181s" podCreationTimestamp="2025-11-21 12:17:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:37.689592236 +0000 UTC m=+1616.390254044" watchObservedRunningTime="2025-11-21 12:17:37.693122181 +0000 UTC m=+1616.393783989" Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.723389 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=3.723370294 podStartE2EDuration="3.723370294s" podCreationTimestamp="2025-11-21 12:17:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:37.718854232 +0000 UTC m=+1616.419516060" watchObservedRunningTime="2025-11-21 12:17:37.723370294 +0000 UTC m=+1616.424032112" Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.897961 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.899224 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.902721 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-rbxlz" Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.909794 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:17:37 crc kubenswrapper[4769]: I1121 12:17:37.949140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zjdp\" (UniqueName: \"kubernetes.io/projected/8ecb8b81-c9f2-4fda-a634-86629d31cebe-kube-api-access-6zjdp\") pod \"kube-state-metrics-0\" (UID: \"8ecb8b81-c9f2-4fda-a634-86629d31cebe\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:38 crc kubenswrapper[4769]: I1121 12:17:38.050265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6zjdp\" (UniqueName: \"kubernetes.io/projected/8ecb8b81-c9f2-4fda-a634-86629d31cebe-kube-api-access-6zjdp\") pod \"kube-state-metrics-0\" (UID: \"8ecb8b81-c9f2-4fda-a634-86629d31cebe\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:38 crc kubenswrapper[4769]: I1121 12:17:38.067602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zjdp\" (UniqueName: \"kubernetes.io/projected/8ecb8b81-c9f2-4fda-a634-86629d31cebe-kube-api-access-6zjdp\") pod \"kube-state-metrics-0\" (UID: \"8ecb8b81-c9f2-4fda-a634-86629d31cebe\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:38 crc kubenswrapper[4769]: I1121 12:17:38.216467 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:38 crc kubenswrapper[4769]: I1121 12:17:38.679464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:17:39 crc kubenswrapper[4769]: I1121 12:17:39.693229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8ecb8b81-c9f2-4fda-a634-86629d31cebe","Type":"ContainerStarted","Data":"dcd9d7f1b0c9b1520961d2efc14cf280531d51badfb0be062c61d96275253045"} Nov 21 12:17:39 crc kubenswrapper[4769]: I1121 12:17:39.693711 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:39 crc kubenswrapper[4769]: I1121 12:17:39.693729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8ecb8b81-c9f2-4fda-a634-86629d31cebe","Type":"ContainerStarted","Data":"1b2c73e52fc5bed3f5e009d06a566c84b97aa752af3b2cfd48cf514423bda925"} Nov 21 12:17:39 crc kubenswrapper[4769]: I1121 12:17:39.714100 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.221366656 podStartE2EDuration="2.714079402s" podCreationTimestamp="2025-11-21 12:17:37 +0000 UTC" firstStartedPulling="2025-11-21 12:17:38.693697521 +0000 UTC m=+1617.394359339" lastFinishedPulling="2025-11-21 12:17:39.186410267 +0000 UTC m=+1617.887072085" observedRunningTime="2025-11-21 12:17:39.710425073 +0000 UTC m=+1618.411086911" watchObservedRunningTime="2025-11-21 12:17:39.714079402 +0000 UTC m=+1618.414741220" Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.325532 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.325879 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.325927 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.326571 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.326624 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" gracePeriod=600 Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.332051 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.711148 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" exitCode=0 Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.711296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00"} Nov 21 12:17:41 crc kubenswrapper[4769]: I1121 12:17:41.711334 4769 scope.go:117] "RemoveContainer" containerID="6e8df9d28b4dbd9830a4c8bbe1d15cc740f5f6d0ab87fac63ea00477540fb9ba" Nov 21 12:17:41 crc kubenswrapper[4769]: E1121 12:17:41.957855 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.729942 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:17:42 crc kubenswrapper[4769]: E1121 12:17:42.730498 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.821928 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.823295 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.827655 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.828208 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.828245 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.828294 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-h6hrf" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.828967 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:17:42 crc kubenswrapper[4769]: I1121 12:17:42.830820 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.023778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.023846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.023918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmbr\" (UniqueName: \"kubernetes.io/projected/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-kube-api-access-6fmbr\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.023950 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-config\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.023991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.024017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.024073 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.024100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmbr\" (UniqueName: \"kubernetes.io/projected/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-kube-api-access-6fmbr\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-config\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.125897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.126445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.126720 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.127185 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.127333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-config\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.143931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.143960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.144733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.149239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmbr\" (UniqueName: \"kubernetes.io/projected/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-kube-api-access-6fmbr\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.171200 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.188505 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.689089 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.689782 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.703130 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.741631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef","Type":"ContainerStarted","Data":"f0b13c813b9ee2d12907d719fcbf21c8e52ba850247e0bdaadf481b2f0d674b4"} Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.771248 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:43 crc kubenswrapper[4769]: I1121 12:17:43.849824 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.354080 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.355616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.358642 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.358854 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.359010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-d94ct" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.359132 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.370817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447561 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncz66\" (UniqueName: \"kubernetes.io/projected/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-kube-api-access-ncz66\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.447776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-config\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.549682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.549732 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.549768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-config\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.549806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.549834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.549872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.550264 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.550420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.550489 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ncz66\" (UniqueName: \"kubernetes.io/projected/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-kube-api-access-ncz66\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.550852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.551541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-config\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.551895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.557555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.558961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.559530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.573100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncz66\" (UniqueName: \"kubernetes.io/projected/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-kube-api-access-ncz66\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.582694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.680418 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.754879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef","Type":"ContainerStarted","Data":"985476194a6d86cb1958732c9ca35a10e2f6ed8d97ed6a86416672f4c2d3ced2"} Nov 21 12:17:44 crc kubenswrapper[4769]: I1121 12:17:44.754938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef","Type":"ContainerStarted","Data":"40e1928f40a6d608c2954cb2916b1fb1aba9c7b4b7c6ef9bc35ff7e8867e7c2f"} Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.039774 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.040117 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.127899 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.135062 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=4.135046708 podStartE2EDuration="4.135046708s" podCreationTimestamp="2025-11-21 12:17:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:44.781763792 +0000 UTC m=+1623.482425610" watchObservedRunningTime="2025-11-21 12:17:45.135046708 +0000 UTC m=+1623.835708526" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.139214 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:17:45 crc kubenswrapper[4769]: W1121 12:17:45.143725 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e5e3a8d_c0e0_48b6_8f36_12af17c8dd1d.slice/crio-a3e0872e023f92055257344f7a605d4ead96a5f6dfbe6b9c336b5f395b21e74f WatchSource:0}: Error finding container a3e0872e023f92055257344f7a605d4ead96a5f6dfbe6b9c336b5f395b21e74f: Status 404 returned error can't find the container with id a3e0872e023f92055257344f7a605d4ead96a5f6dfbe6b9c336b5f395b21e74f Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.765790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d","Type":"ContainerStarted","Data":"b9841c65cfcd0f79fb30a75438ffe6ed585ce9e1daf0312abd4343ea5fc49f08"} Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.767042 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d","Type":"ContainerStarted","Data":"113bbdbcb9e0efb0bd65ca73d7e2d3a8238f3a184837df9915776fe1c33c27ad"} Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.767062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d","Type":"ContainerStarted","Data":"a3e0872e023f92055257344f7a605d4ead96a5f6dfbe6b9c336b5f395b21e74f"} Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.794719 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.794697417 podStartE2EDuration="2.794697417s" podCreationTimestamp="2025-11-21 12:17:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:45.789532327 +0000 UTC m=+1624.490194165" watchObservedRunningTime="2025-11-21 12:17:45.794697417 +0000 UTC m=+1624.495359235" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.839036 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.966058 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-wmgsx"] Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.967232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:45 crc kubenswrapper[4769]: I1121 12:17:45.973973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-wmgsx"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.075785 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-8fc8-account-create-mnx95"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.079075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-operator-scripts\") pod \"keystone-db-create-wmgsx\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.079280 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qlt\" (UniqueName: \"kubernetes.io/projected/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-kube-api-access-r8qlt\") pod \"keystone-db-create-wmgsx\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.081048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.082073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8fc8-account-create-mnx95"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.083696 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.181396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-operator-scripts\") pod \"keystone-db-create-wmgsx\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.181496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b89132a-9f62-46dd-ab6d-27d315168730-operator-scripts\") pod \"keystone-8fc8-account-create-mnx95\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.181781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qlt\" (UniqueName: \"kubernetes.io/projected/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-kube-api-access-r8qlt\") pod \"keystone-db-create-wmgsx\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.181838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8nw2\" (UniqueName: \"kubernetes.io/projected/0b89132a-9f62-46dd-ab6d-27d315168730-kube-api-access-r8nw2\") pod \"keystone-8fc8-account-create-mnx95\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.182491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-operator-scripts\") pod \"keystone-db-create-wmgsx\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.189087 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.210653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qlt\" (UniqueName: \"kubernetes.io/projected/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-kube-api-access-r8qlt\") pod \"keystone-db-create-wmgsx\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.237175 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.282191 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.283194 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8nw2\" (UniqueName: \"kubernetes.io/projected/0b89132a-9f62-46dd-ab6d-27d315168730-kube-api-access-r8nw2\") pod \"keystone-8fc8-account-create-mnx95\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.283289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b89132a-9f62-46dd-ab6d-27d315168730-operator-scripts\") pod \"keystone-8fc8-account-create-mnx95\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.284087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b89132a-9f62-46dd-ab6d-27d315168730-operator-scripts\") pod \"keystone-8fc8-account-create-mnx95\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.300997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8nw2\" (UniqueName: \"kubernetes.io/projected/0b89132a-9f62-46dd-ab6d-27d315168730-kube-api-access-r8nw2\") pod \"keystone-8fc8-account-create-mnx95\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.367339 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-wdgk9"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.368416 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.397641 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.404733 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wdgk9"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.487880 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lwt\" (UniqueName: \"kubernetes.io/projected/0900f2e3-2223-4092-862e-01c92be296d9-kube-api-access-m2lwt\") pod \"placement-db-create-wdgk9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.487967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0900f2e3-2223-4092-862e-01c92be296d9-operator-scripts\") pod \"placement-db-create-wdgk9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.489753 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-a3a7-account-create-lln6n"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.490700 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.492577 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.520068 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-a3a7-account-create-lln6n"] Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.589216 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkwd\" (UniqueName: \"kubernetes.io/projected/068d3e6a-e00a-46d5-93b6-d353f6479048-kube-api-access-wqkwd\") pod \"placement-a3a7-account-create-lln6n\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.589280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0900f2e3-2223-4092-862e-01c92be296d9-operator-scripts\") pod \"placement-db-create-wdgk9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.589397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/068d3e6a-e00a-46d5-93b6-d353f6479048-operator-scripts\") pod \"placement-a3a7-account-create-lln6n\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.589678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lwt\" (UniqueName: \"kubernetes.io/projected/0900f2e3-2223-4092-862e-01c92be296d9-kube-api-access-m2lwt\") pod \"placement-db-create-wdgk9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.590669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0900f2e3-2223-4092-862e-01c92be296d9-operator-scripts\") pod \"placement-db-create-wdgk9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.605989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lwt\" (UniqueName: \"kubernetes.io/projected/0900f2e3-2223-4092-862e-01c92be296d9-kube-api-access-m2lwt\") pod \"placement-db-create-wdgk9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.691727 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/068d3e6a-e00a-46d5-93b6-d353f6479048-operator-scripts\") pod \"placement-a3a7-account-create-lln6n\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.691870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkwd\" (UniqueName: \"kubernetes.io/projected/068d3e6a-e00a-46d5-93b6-d353f6479048-kube-api-access-wqkwd\") pod \"placement-a3a7-account-create-lln6n\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.692481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/068d3e6a-e00a-46d5-93b6-d353f6479048-operator-scripts\") pod \"placement-a3a7-account-create-lln6n\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.704429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.708575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkwd\" (UniqueName: \"kubernetes.io/projected/068d3e6a-e00a-46d5-93b6-d353f6479048-kube-api-access-wqkwd\") pod \"placement-a3a7-account-create-lln6n\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.729651 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-wmgsx"] Nov 21 12:17:46 crc kubenswrapper[4769]: W1121 12:17:46.735229 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eed9de3_d5b6_4ab3_b75f_d9cf5e33a4c2.slice/crio-a8c105c93e291e68de33d9e618b6d3a3f4eb35ae38a94ab015d50abb67eadb6a WatchSource:0}: Error finding container a8c105c93e291e68de33d9e618b6d3a3f4eb35ae38a94ab015d50abb67eadb6a: Status 404 returned error can't find the container with id a8c105c93e291e68de33d9e618b6d3a3f4eb35ae38a94ab015d50abb67eadb6a Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.777302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" event={"ID":"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2","Type":"ContainerStarted","Data":"a8c105c93e291e68de33d9e618b6d3a3f4eb35ae38a94ab015d50abb67eadb6a"} Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.777753 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.825618 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:46 crc kubenswrapper[4769]: I1121 12:17:46.867634 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8fc8-account-create-mnx95"] Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.155240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wdgk9"] Nov 21 12:17:47 crc kubenswrapper[4769]: W1121 12:17:47.162447 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0900f2e3_2223_4092_862e_01c92be296d9.slice/crio-dd379bb8c984fb0da3f8dc0564136404d48e7381e409956fe15be3ce959d895c WatchSource:0}: Error finding container dd379bb8c984fb0da3f8dc0564136404d48e7381e409956fe15be3ce959d895c: Status 404 returned error can't find the container with id dd379bb8c984fb0da3f8dc0564136404d48e7381e409956fe15be3ce959d895c Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.321905 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-a3a7-account-create-lln6n"] Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.680944 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.753149 4769 scope.go:117] "RemoveContainer" containerID="b0ddacd8106b94f439abf6e29c46f39ea5cfc8dab85696d86af333984b62b792" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.780297 4769 scope.go:117] "RemoveContainer" containerID="95d2424b68eed99b942747e13339acb7c2625656f84a8a1298fd9d21bb4b2964" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.786181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" event={"ID":"068d3e6a-e00a-46d5-93b6-d353f6479048","Type":"ContainerStarted","Data":"69068dfbf5d1cb153096425bb7968e1e420ecfd5ee62209efcb7bc5061747e9a"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.786257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" event={"ID":"068d3e6a-e00a-46d5-93b6-d353f6479048","Type":"ContainerStarted","Data":"d5a61e7c5a0638953c76bf8199c07a53500134385e439f38457ddc145ce79dc1"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.787673 4769 generic.go:334] "Generic (PLEG): container finished" podID="0b89132a-9f62-46dd-ab6d-27d315168730" containerID="ddd7331e4821cdaab4f86e72d6f081f9a0c23116aaec656bdc376d85c1f9291b" exitCode=0 Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.787739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" event={"ID":"0b89132a-9f62-46dd-ab6d-27d315168730","Type":"ContainerDied","Data":"ddd7331e4821cdaab4f86e72d6f081f9a0c23116aaec656bdc376d85c1f9291b"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.787757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" event={"ID":"0b89132a-9f62-46dd-ab6d-27d315168730","Type":"ContainerStarted","Data":"87840d30475eb50a4b10a1010009509d2f541cd27528bae4d914e5ddfd995455"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.789415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wdgk9" event={"ID":"0900f2e3-2223-4092-862e-01c92be296d9","Type":"ContainerStarted","Data":"9baf567037c96bd1812d294445e155e0d8af2da6246bfb33d899c63c0aab3265"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.789445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wdgk9" event={"ID":"0900f2e3-2223-4092-862e-01c92be296d9","Type":"ContainerStarted","Data":"dd379bb8c984fb0da3f8dc0564136404d48e7381e409956fe15be3ce959d895c"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.791470 4769 generic.go:334] "Generic (PLEG): container finished" podID="9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" containerID="aa0aaf353808515c25820b3f6f59e5fe1bfd16a8d800522a00e0ab2927a73abf" exitCode=0 Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.791933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" event={"ID":"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2","Type":"ContainerDied","Data":"aa0aaf353808515c25820b3f6f59e5fe1bfd16a8d800522a00e0ab2927a73abf"} Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.805852 4769 scope.go:117] "RemoveContainer" containerID="c342ef116883b40c3ca2418b93d8035e76c5ff1be5f248e21e62dc3188d5fcae" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.807749 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" podStartSLOduration=1.807725446 podStartE2EDuration="1.807725446s" podCreationTimestamp="2025-11-21 12:17:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:47.803573394 +0000 UTC m=+1626.504235212" watchObservedRunningTime="2025-11-21 12:17:47.807725446 +0000 UTC m=+1626.508387264" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.836175 4769 scope.go:117] "RemoveContainer" containerID="d99f8925d5c910a83754d1a8d8b323b0532341d48d10f847db113db733e4c417" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.848717 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-wdgk9" podStartSLOduration=1.848701148 podStartE2EDuration="1.848701148s" podCreationTimestamp="2025-11-21 12:17:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:47.84730146 +0000 UTC m=+1626.547963268" watchObservedRunningTime="2025-11-21 12:17:47.848701148 +0000 UTC m=+1626.549362966" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.871797 4769 scope.go:117] "RemoveContainer" containerID="016fd98ea43d5b73a794d334a90f4647ad6c99cc0af36bb2c3790de298f12b4f" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.899346 4769 scope.go:117] "RemoveContainer" containerID="f263d2aab50136d84a94ead296762c77ecbbdd483614ab57ec45b721dd3d96fa" Nov 21 12:17:47 crc kubenswrapper[4769]: I1121 12:17:47.930279 4769 scope.go:117] "RemoveContainer" containerID="487d6e4c85f1536f074426ff6e4b51472bc80c7be9c35ef956e4c16837aa77df" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.079887 4769 scope.go:117] "RemoveContainer" containerID="11e4b09a040543deb8702b191dd7655481edc71f1af6c4504a2f4e4b95887c0b" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.113740 4769 scope.go:117] "RemoveContainer" containerID="e59c511ceaf471a346e731573e14b55126ffa06818ce22bc3e28e5e0d2ca97c3" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.136158 4769 scope.go:117] "RemoveContainer" containerID="17318c38f58b6374c1eb5ee69106d3778d8c3cf223b64e9b043fb9f2aa6150e9" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.186372 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.196077 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.198602 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.199738 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.199921 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.200442 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-qvb9w" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.212283 4769 scope.go:117] "RemoveContainer" containerID="dee31fe2775b1e34830fe9986dc8616114feab0d34df42f2a91357a77200ee03" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.215032 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.225617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.247775 4769 scope.go:117] "RemoveContainer" containerID="90be29082cb701cd689eeebe3c521f1cf3d923eb3e6440edd4fb00553b4da038" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.267595 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.277779 4769 scope.go:117] "RemoveContainer" containerID="b0dbd23fedb5b8fcce1d89ad9f3dcafbe5c4db7a046356f8b02cdbdfc66c7567" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.320330 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-lock\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.320384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.320619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75b5s\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-kube-api-access-75b5s\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.320722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.320819 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-cache\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.327147 4769 scope.go:117] "RemoveContainer" containerID="0c4da3ffea16b594dd3d4d115d32f42d562182ce9229a2fc7861062af357208f" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.336825 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mkbbg"] Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.338367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.344120 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.344468 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.344633 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.348829 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mkbbg"] Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.379793 4769 scope.go:117] "RemoveContainer" containerID="39a6f77204e9dd9b8eccd52e8103882ae2194706b6b1bddbb9ff9c2215a8432f" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.425632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75b5s\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-kube-api-access-75b5s\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.425715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.425811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-cache\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: E1121 12:17:48.426110 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:17:48 crc kubenswrapper[4769]: E1121 12:17:48.426266 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:17:48 crc kubenswrapper[4769]: E1121 12:17:48.426325 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:48.926304171 +0000 UTC m=+1627.626966059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : configmap "swift-ring-files" not found Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.426739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-lock\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.426826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.427079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-cache\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.427093 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.427226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-lock\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.437191 4769 scope.go:117] "RemoveContainer" containerID="5a4aa70f4fba22db17e561409a167be76a9d0852043bbb448bc271b11df4a18f" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.447678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75b5s\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-kube-api-access-75b5s\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.460605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.465379 4769 scope.go:117] "RemoveContainer" containerID="35b6ccfcae71cb4eee7522a0e3f906a1f43378dd3da429331d001e8b00a66449" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.508532 4769 scope.go:117] "RemoveContainer" containerID="7590d1d2a0754d15b540c74bc2ef401106a69fc9caa8db2f69bbd3c3fde3bb51" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.527711 4769 scope.go:117] "RemoveContainer" containerID="1c1554009b63c920b2c5916f776a49264fbde763a4e4001ddb1f3b664c851bde" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9441c299-7fb1-4908-8677-a92d7e39fdf4-etc-swift\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529207 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-swiftconf\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-combined-ca-bundle\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-scripts\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-ring-data-devices\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptzs\" (UniqueName: \"kubernetes.io/projected/9441c299-7fb1-4908-8677-a92d7e39fdf4-kube-api-access-qptzs\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.529562 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-dispersionconf\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.547489 4769 scope.go:117] "RemoveContainer" containerID="4b5fcaf70fd6f4542043e8e63c687594153cd20444770960a53dc1d92905b3f0" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.576701 4769 scope.go:117] "RemoveContainer" containerID="28313ef7b4949eacfe9c9ca5becf7da9ef29f43e75ac8130e5c645312f4b158c" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.606832 4769 scope.go:117] "RemoveContainer" containerID="6191f422b7618242b60d8366c1eb7390b51b04db2d6a9f111f868b735d95ac0b" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.629348 4769 scope.go:117] "RemoveContainer" containerID="5f7b3218f8211f27057d494c150e5c9636162f92765d5df7789425e3e877974c" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-scripts\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-ring-data-devices\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qptzs\" (UniqueName: \"kubernetes.io/projected/9441c299-7fb1-4908-8677-a92d7e39fdf4-kube-api-access-qptzs\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-dispersionconf\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630864 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9441c299-7fb1-4908-8677-a92d7e39fdf4-etc-swift\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-swiftconf\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.630924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-combined-ca-bundle\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.632014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9441c299-7fb1-4908-8677-a92d7e39fdf4-etc-swift\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.632087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-scripts\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.632093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-ring-data-devices\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.634344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-swiftconf\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.635062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-combined-ca-bundle\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.636233 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-dispersionconf\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.649827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptzs\" (UniqueName: \"kubernetes.io/projected/9441c299-7fb1-4908-8677-a92d7e39fdf4-kube-api-access-qptzs\") pod \"swift-ring-rebalance-mkbbg\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.694886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.812425 4769 generic.go:334] "Generic (PLEG): container finished" podID="0900f2e3-2223-4092-862e-01c92be296d9" containerID="9baf567037c96bd1812d294445e155e0d8af2da6246bfb33d899c63c0aab3265" exitCode=0 Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.812475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wdgk9" event={"ID":"0900f2e3-2223-4092-862e-01c92be296d9","Type":"ContainerDied","Data":"9baf567037c96bd1812d294445e155e0d8af2da6246bfb33d899c63c0aab3265"} Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.819563 4769 generic.go:334] "Generic (PLEG): container finished" podID="068d3e6a-e00a-46d5-93b6-d353f6479048" containerID="69068dfbf5d1cb153096425bb7968e1e420ecfd5ee62209efcb7bc5061747e9a" exitCode=0 Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.819821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" event={"ID":"068d3e6a-e00a-46d5-93b6-d353f6479048","Type":"ContainerDied","Data":"69068dfbf5d1cb153096425bb7968e1e420ecfd5ee62209efcb7bc5061747e9a"} Nov 21 12:17:48 crc kubenswrapper[4769]: I1121 12:17:48.943664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:48 crc kubenswrapper[4769]: E1121 12:17:48.947377 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:17:48 crc kubenswrapper[4769]: E1121 12:17:48.947408 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:17:48 crc kubenswrapper[4769]: E1121 12:17:48.947476 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:49.947458602 +0000 UTC m=+1628.648120420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : configmap "swift-ring-files" not found Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.249414 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mkbbg"] Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.440589 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.481609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.557297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-operator-scripts\") pod \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.557380 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8qlt\" (UniqueName: \"kubernetes.io/projected/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-kube-api-access-r8qlt\") pod \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\" (UID: \"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2\") " Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.557765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" (UID: "9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.567768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-kube-api-access-r8qlt" (OuterVolumeSpecName: "kube-api-access-r8qlt") pod "9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" (UID: "9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2"). InnerVolumeSpecName "kube-api-access-r8qlt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.658875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b89132a-9f62-46dd-ab6d-27d315168730-operator-scripts\") pod \"0b89132a-9f62-46dd-ab6d-27d315168730\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.659344 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8nw2\" (UniqueName: \"kubernetes.io/projected/0b89132a-9f62-46dd-ab6d-27d315168730-kube-api-access-r8nw2\") pod \"0b89132a-9f62-46dd-ab6d-27d315168730\" (UID: \"0b89132a-9f62-46dd-ab6d-27d315168730\") " Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.659816 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.659831 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r8qlt\" (UniqueName: \"kubernetes.io/projected/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2-kube-api-access-r8qlt\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.659919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b89132a-9f62-46dd-ab6d-27d315168730-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0b89132a-9f62-46dd-ab6d-27d315168730" (UID: "0b89132a-9f62-46dd-ab6d-27d315168730"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.663338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b89132a-9f62-46dd-ab6d-27d315168730-kube-api-access-r8nw2" (OuterVolumeSpecName: "kube-api-access-r8nw2") pod "0b89132a-9f62-46dd-ab6d-27d315168730" (UID: "0b89132a-9f62-46dd-ab6d-27d315168730"). InnerVolumeSpecName "kube-api-access-r8nw2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.681843 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.761070 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0b89132a-9f62-46dd-ab6d-27d315168730-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.761104 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r8nw2\" (UniqueName: \"kubernetes.io/projected/0b89132a-9f62-46dd-ab6d-27d315168730-kube-api-access-r8nw2\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.902835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" event={"ID":"9441c299-7fb1-4908-8677-a92d7e39fdf4","Type":"ContainerStarted","Data":"a5e333f1cc4b171249b7eb194937b2d290bc6d6137288188dd8bebc57448ad9f"} Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.902884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" event={"ID":"9441c299-7fb1-4908-8677-a92d7e39fdf4","Type":"ContainerStarted","Data":"f0868a712bfd4d0a3d683f538c5adfca0d128aae4f6d26e9d574c4b3011bf9c9"} Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.904994 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.905034 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8fc8-account-create-mnx95" event={"ID":"0b89132a-9f62-46dd-ab6d-27d315168730","Type":"ContainerDied","Data":"87840d30475eb50a4b10a1010009509d2f541cd27528bae4d914e5ddfd995455"} Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.905067 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87840d30475eb50a4b10a1010009509d2f541cd27528bae4d914e5ddfd995455" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.907498 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" event={"ID":"9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2","Type":"ContainerDied","Data":"a8c105c93e291e68de33d9e618b6d3a3f4eb35ae38a94ab015d50abb67eadb6a"} Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.907551 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8c105c93e291e68de33d9e618b6d3a3f4eb35ae38a94ab015d50abb67eadb6a" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.907604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-wmgsx" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.930613 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" podStartSLOduration=1.930590848 podStartE2EDuration="1.930590848s" podCreationTimestamp="2025-11-21 12:17:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:49.921434109 +0000 UTC m=+1628.622095947" watchObservedRunningTime="2025-11-21 12:17:49.930590848 +0000 UTC m=+1628.631252666" Nov 21 12:17:49 crc kubenswrapper[4769]: I1121 12:17:49.965017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:49 crc kubenswrapper[4769]: E1121 12:17:49.965209 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:17:49 crc kubenswrapper[4769]: E1121 12:17:49.965225 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:17:49 crc kubenswrapper[4769]: E1121 12:17:49.965267 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:51.965253378 +0000 UTC m=+1630.665915196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : configmap "swift-ring-files" not found Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.268590 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.352859 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.383488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/068d3e6a-e00a-46d5-93b6-d353f6479048-operator-scripts\") pod \"068d3e6a-e00a-46d5-93b6-d353f6479048\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.383909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqkwd\" (UniqueName: \"kubernetes.io/projected/068d3e6a-e00a-46d5-93b6-d353f6479048-kube-api-access-wqkwd\") pod \"068d3e6a-e00a-46d5-93b6-d353f6479048\" (UID: \"068d3e6a-e00a-46d5-93b6-d353f6479048\") " Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.385074 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/068d3e6a-e00a-46d5-93b6-d353f6479048-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "068d3e6a-e00a-46d5-93b6-d353f6479048" (UID: "068d3e6a-e00a-46d5-93b6-d353f6479048"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.390029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068d3e6a-e00a-46d5-93b6-d353f6479048-kube-api-access-wqkwd" (OuterVolumeSpecName: "kube-api-access-wqkwd") pod "068d3e6a-e00a-46d5-93b6-d353f6479048" (UID: "068d3e6a-e00a-46d5-93b6-d353f6479048"). InnerVolumeSpecName "kube-api-access-wqkwd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.486018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0900f2e3-2223-4092-862e-01c92be296d9-operator-scripts\") pod \"0900f2e3-2223-4092-862e-01c92be296d9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.486134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2lwt\" (UniqueName: \"kubernetes.io/projected/0900f2e3-2223-4092-862e-01c92be296d9-kube-api-access-m2lwt\") pod \"0900f2e3-2223-4092-862e-01c92be296d9\" (UID: \"0900f2e3-2223-4092-862e-01c92be296d9\") " Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.486615 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/068d3e6a-e00a-46d5-93b6-d353f6479048-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.486629 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wqkwd\" (UniqueName: \"kubernetes.io/projected/068d3e6a-e00a-46d5-93b6-d353f6479048-kube-api-access-wqkwd\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.486743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0900f2e3-2223-4092-862e-01c92be296d9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0900f2e3-2223-4092-862e-01c92be296d9" (UID: "0900f2e3-2223-4092-862e-01c92be296d9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.489455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0900f2e3-2223-4092-862e-01c92be296d9-kube-api-access-m2lwt" (OuterVolumeSpecName: "kube-api-access-m2lwt") pod "0900f2e3-2223-4092-862e-01c92be296d9" (UID: "0900f2e3-2223-4092-862e-01c92be296d9"). InnerVolumeSpecName "kube-api-access-m2lwt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.588187 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0900f2e3-2223-4092-862e-01c92be296d9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.588251 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m2lwt\" (UniqueName: \"kubernetes.io/projected/0900f2e3-2223-4092-862e-01c92be296d9-kube-api-access-m2lwt\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.732218 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.776751 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.917206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" event={"ID":"068d3e6a-e00a-46d5-93b6-d353f6479048","Type":"ContainerDied","Data":"d5a61e7c5a0638953c76bf8199c07a53500134385e439f38457ddc145ce79dc1"} Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.917322 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5a61e7c5a0638953c76bf8199c07a53500134385e439f38457ddc145ce79dc1" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.917225 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-a3a7-account-create-lln6n" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.918986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-wdgk9" event={"ID":"0900f2e3-2223-4092-862e-01c92be296d9","Type":"ContainerDied","Data":"dd379bb8c984fb0da3f8dc0564136404d48e7381e409956fe15be3ce959d895c"} Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.919032 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd379bb8c984fb0da3f8dc0564136404d48e7381e409956fe15be3ce959d895c" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.919102 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-wdgk9" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984156 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:17:50 crc kubenswrapper[4769]: E1121 12:17:50.984528 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" containerName="mariadb-database-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984540 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" containerName="mariadb-database-create" Nov 21 12:17:50 crc kubenswrapper[4769]: E1121 12:17:50.984549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0900f2e3-2223-4092-862e-01c92be296d9" containerName="mariadb-database-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984556 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0900f2e3-2223-4092-862e-01c92be296d9" containerName="mariadb-database-create" Nov 21 12:17:50 crc kubenswrapper[4769]: E1121 12:17:50.984565 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0b89132a-9f62-46dd-ab6d-27d315168730" containerName="mariadb-account-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984572 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b89132a-9f62-46dd-ab6d-27d315168730" containerName="mariadb-account-create" Nov 21 12:17:50 crc kubenswrapper[4769]: E1121 12:17:50.984592 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="068d3e6a-e00a-46d5-93b6-d353f6479048" containerName="mariadb-account-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984599 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d3e6a-e00a-46d5-93b6-d353f6479048" containerName="mariadb-account-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984737 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" containerName="mariadb-database-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984752 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0900f2e3-2223-4092-862e-01c92be296d9" containerName="mariadb-database-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984762 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="068d3e6a-e00a-46d5-93b6-d353f6479048" containerName="mariadb-account-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.984769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0b89132a-9f62-46dd-ab6d-27d315168730" containerName="mariadb-account-create" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.985591 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.988027 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-ttn87" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.988488 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.988805 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:17:50 crc kubenswrapper[4769]: I1121 12:17:50.988903 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.002345 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.100133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.100546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-config\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.100586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-scripts\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.101025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.101407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.101610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94shv\" (UniqueName: \"kubernetes.io/projected/56f4acf6-717c-423f-b338-bc1344ce9d0b-kube-api-access-94shv\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.101633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.202837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.202931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-config\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.202969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-scripts\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.202998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.203018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.203070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-94shv\" (UniqueName: \"kubernetes.io/projected/56f4acf6-717c-423f-b338-bc1344ce9d0b-kube-api-access-94shv\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.203089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.203463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.205001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-config\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.206558 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.207771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.208577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-scripts\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.208842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.231182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-94shv\" (UniqueName: \"kubernetes.io/projected/56f4acf6-717c-423f-b338-bc1344ce9d0b-kube-api-access-94shv\") pod \"ovn-northd-0\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.308748 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.494520 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-rczht"] Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.512424 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rczht"] Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.512530 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.618035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gkc7\" (UniqueName: \"kubernetes.io/projected/3255e587-f85f-4089-8dc1-47a52bd564c2-kube-api-access-4gkc7\") pod \"glance-db-create-rczht\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.618107 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3255e587-f85f-4089-8dc1-47a52bd564c2-operator-scripts\") pod \"glance-db-create-rczht\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.680220 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-3a55-account-create-6pp4w"] Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.683232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.685502 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.710300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3a55-account-create-6pp4w"] Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.719125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4gkc7\" (UniqueName: \"kubernetes.io/projected/3255e587-f85f-4089-8dc1-47a52bd564c2-kube-api-access-4gkc7\") pod \"glance-db-create-rczht\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.719287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3255e587-f85f-4089-8dc1-47a52bd564c2-operator-scripts\") pod \"glance-db-create-rczht\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.720098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3255e587-f85f-4089-8dc1-47a52bd564c2-operator-scripts\") pod \"glance-db-create-rczht\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.740213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gkc7\" (UniqueName: \"kubernetes.io/projected/3255e587-f85f-4089-8dc1-47a52bd564c2-kube-api-access-4gkc7\") pod \"glance-db-create-rczht\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.801591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.820440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c0ded7-5b8b-4083-a8ed-e924644a1581-operator-scripts\") pod \"glance-3a55-account-create-6pp4w\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.820522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lxq\" (UniqueName: \"kubernetes.io/projected/93c0ded7-5b8b-4083-a8ed-e924644a1581-kube-api-access-n2lxq\") pod \"glance-3a55-account-create-6pp4w\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.858153 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.921739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c0ded7-5b8b-4083-a8ed-e924644a1581-operator-scripts\") pod \"glance-3a55-account-create-6pp4w\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.922032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lxq\" (UniqueName: \"kubernetes.io/projected/93c0ded7-5b8b-4083-a8ed-e924644a1581-kube-api-access-n2lxq\") pod \"glance-3a55-account-create-6pp4w\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.922509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c0ded7-5b8b-4083-a8ed-e924644a1581-operator-scripts\") pod \"glance-3a55-account-create-6pp4w\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.928620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"56f4acf6-717c-423f-b338-bc1344ce9d0b","Type":"ContainerStarted","Data":"44dc7d584bc8ffe52550816d123b732ce111bfc88467c8d59400e8f972952ae0"} Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.944305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lxq\" (UniqueName: \"kubernetes.io/projected/93c0ded7-5b8b-4083-a8ed-e924644a1581-kube-api-access-n2lxq\") pod \"glance-3a55-account-create-6pp4w\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:51 crc kubenswrapper[4769]: I1121 12:17:51.998858 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.023980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:52 crc kubenswrapper[4769]: E1121 12:17:52.024184 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:17:52 crc kubenswrapper[4769]: E1121 12:17:52.024220 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:17:52 crc kubenswrapper[4769]: E1121 12:17:52.024289 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:17:56.024269506 +0000 UTC m=+1634.724931314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : configmap "swift-ring-files" not found Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.328225 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rczht"] Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.519614 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3a55-account-create-6pp4w"] Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.939771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rczht" event={"ID":"3255e587-f85f-4089-8dc1-47a52bd564c2","Type":"ContainerStarted","Data":"72a27be7fe85662fd73daf7a786692d3582a686c76e6e6e597cff26e844f5e17"} Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.939822 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rczht" event={"ID":"3255e587-f85f-4089-8dc1-47a52bd564c2","Type":"ContainerStarted","Data":"22a45bacd12c295fee8bafdd20480810f53cb3dc02b73a7778e407f1ff7c17a8"} Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.942072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" event={"ID":"93c0ded7-5b8b-4083-a8ed-e924644a1581","Type":"ContainerStarted","Data":"1ed98a1767201d6fd7a026421d4cf8c22fbb93d12961f1f16ab33024e78c0fa6"} Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.942099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" event={"ID":"93c0ded7-5b8b-4083-a8ed-e924644a1581","Type":"ContainerStarted","Data":"b8955bc279cc79f4ac4139110efe212b355f5da7238221c6389d6b3fa629d776"} Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.944907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"56f4acf6-717c-423f-b338-bc1344ce9d0b","Type":"ContainerStarted","Data":"bea7449439fa2707fcfabebf5dac9988755c52ccbd6ef1df8584efcdfa95c811"} Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.944944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"56f4acf6-717c-423f-b338-bc1344ce9d0b","Type":"ContainerStarted","Data":"01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7"} Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.945485 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:17:52 crc kubenswrapper[4769]: I1121 12:17:52.961382 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-rczht" podStartSLOduration=1.961365043 podStartE2EDuration="1.961365043s" podCreationTimestamp="2025-11-21 12:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:52.959328308 +0000 UTC m=+1631.659990126" watchObservedRunningTime="2025-11-21 12:17:52.961365043 +0000 UTC m=+1631.662026861" Nov 21 12:17:53 crc kubenswrapper[4769]: I1121 12:17:53.002170 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" podStartSLOduration=2.00215036 podStartE2EDuration="2.00215036s" podCreationTimestamp="2025-11-21 12:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:52.981774437 +0000 UTC m=+1631.682436255" watchObservedRunningTime="2025-11-21 12:17:53.00215036 +0000 UTC m=+1631.702812178" Nov 21 12:17:53 crc kubenswrapper[4769]: I1121 12:17:53.004421 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.004408281 podStartE2EDuration="3.004408281s" podCreationTimestamp="2025-11-21 12:17:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:52.999437846 +0000 UTC m=+1631.700099664" watchObservedRunningTime="2025-11-21 12:17:53.004408281 +0000 UTC m=+1631.705070099" Nov 21 12:17:53 crc kubenswrapper[4769]: I1121 12:17:53.957865 4769 generic.go:334] "Generic (PLEG): container finished" podID="3255e587-f85f-4089-8dc1-47a52bd564c2" containerID="72a27be7fe85662fd73daf7a786692d3582a686c76e6e6e597cff26e844f5e17" exitCode=0 Nov 21 12:17:53 crc kubenswrapper[4769]: I1121 12:17:53.957930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rczht" event={"ID":"3255e587-f85f-4089-8dc1-47a52bd564c2","Type":"ContainerDied","Data":"72a27be7fe85662fd73daf7a786692d3582a686c76e6e6e597cff26e844f5e17"} Nov 21 12:17:53 crc kubenswrapper[4769]: I1121 12:17:53.961707 4769 generic.go:334] "Generic (PLEG): container finished" podID="93c0ded7-5b8b-4083-a8ed-e924644a1581" containerID="1ed98a1767201d6fd7a026421d4cf8c22fbb93d12961f1f16ab33024e78c0fa6" exitCode=0 Nov 21 12:17:53 crc kubenswrapper[4769]: I1121 12:17:53.961810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" event={"ID":"93c0ded7-5b8b-4083-a8ed-e924644a1581","Type":"ContainerDied","Data":"1ed98a1767201d6fd7a026421d4cf8c22fbb93d12961f1f16ab33024e78c0fa6"} Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.275046 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:17:55 crc kubenswrapper[4769]: E1121 12:17:55.275922 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.405404 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.420131 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.518525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2lxq\" (UniqueName: \"kubernetes.io/projected/93c0ded7-5b8b-4083-a8ed-e924644a1581-kube-api-access-n2lxq\") pod \"93c0ded7-5b8b-4083-a8ed-e924644a1581\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.518677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gkc7\" (UniqueName: \"kubernetes.io/projected/3255e587-f85f-4089-8dc1-47a52bd564c2-kube-api-access-4gkc7\") pod \"3255e587-f85f-4089-8dc1-47a52bd564c2\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.518708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c0ded7-5b8b-4083-a8ed-e924644a1581-operator-scripts\") pod \"93c0ded7-5b8b-4083-a8ed-e924644a1581\" (UID: \"93c0ded7-5b8b-4083-a8ed-e924644a1581\") " Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.518736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3255e587-f85f-4089-8dc1-47a52bd564c2-operator-scripts\") pod \"3255e587-f85f-4089-8dc1-47a52bd564c2\" (UID: \"3255e587-f85f-4089-8dc1-47a52bd564c2\") " Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.519311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c0ded7-5b8b-4083-a8ed-e924644a1581-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "93c0ded7-5b8b-4083-a8ed-e924644a1581" (UID: "93c0ded7-5b8b-4083-a8ed-e924644a1581"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.519448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3255e587-f85f-4089-8dc1-47a52bd564c2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3255e587-f85f-4089-8dc1-47a52bd564c2" (UID: "3255e587-f85f-4089-8dc1-47a52bd564c2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.520062 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93c0ded7-5b8b-4083-a8ed-e924644a1581-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.520090 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3255e587-f85f-4089-8dc1-47a52bd564c2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.524693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3255e587-f85f-4089-8dc1-47a52bd564c2-kube-api-access-4gkc7" (OuterVolumeSpecName: "kube-api-access-4gkc7") pod "3255e587-f85f-4089-8dc1-47a52bd564c2" (UID: "3255e587-f85f-4089-8dc1-47a52bd564c2"). InnerVolumeSpecName "kube-api-access-4gkc7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.525795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c0ded7-5b8b-4083-a8ed-e924644a1581-kube-api-access-n2lxq" (OuterVolumeSpecName: "kube-api-access-n2lxq") pod "93c0ded7-5b8b-4083-a8ed-e924644a1581" (UID: "93c0ded7-5b8b-4083-a8ed-e924644a1581"). InnerVolumeSpecName "kube-api-access-n2lxq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.621259 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n2lxq\" (UniqueName: \"kubernetes.io/projected/93c0ded7-5b8b-4083-a8ed-e924644a1581-kube-api-access-n2lxq\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.621604 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4gkc7\" (UniqueName: \"kubernetes.io/projected/3255e587-f85f-4089-8dc1-47a52bd564c2-kube-api-access-4gkc7\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.981445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rczht" event={"ID":"3255e587-f85f-4089-8dc1-47a52bd564c2","Type":"ContainerDied","Data":"22a45bacd12c295fee8bafdd20480810f53cb3dc02b73a7778e407f1ff7c17a8"} Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.981711 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22a45bacd12c295fee8bafdd20480810f53cb3dc02b73a7778e407f1ff7c17a8" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.981627 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rczht" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.985631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" event={"ID":"93c0ded7-5b8b-4083-a8ed-e924644a1581","Type":"ContainerDied","Data":"b8955bc279cc79f4ac4139110efe212b355f5da7238221c6389d6b3fa629d776"} Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.985668 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8955bc279cc79f4ac4139110efe212b355f5da7238221c6389d6b3fa629d776" Nov 21 12:17:55 crc kubenswrapper[4769]: I1121 12:17:55.985721 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3a55-account-create-6pp4w" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.029229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:17:56 crc kubenswrapper[4769]: E1121 12:17:56.029425 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:17:56 crc kubenswrapper[4769]: E1121 12:17:56.029465 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:17:56 crc kubenswrapper[4769]: E1121 12:17:56.029527 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:18:04.029509812 +0000 UTC m=+1642.730171630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : configmap "swift-ring-files" not found Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.818961 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jsbs"] Nov 21 12:17:56 crc kubenswrapper[4769]: E1121 12:17:56.820239 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93c0ded7-5b8b-4083-a8ed-e924644a1581" containerName="mariadb-account-create" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.820263 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c0ded7-5b8b-4083-a8ed-e924644a1581" containerName="mariadb-account-create" Nov 21 12:17:56 crc kubenswrapper[4769]: E1121 12:17:56.820390 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3255e587-f85f-4089-8dc1-47a52bd564c2" containerName="mariadb-database-create" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.820398 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3255e587-f85f-4089-8dc1-47a52bd564c2" containerName="mariadb-database-create" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.820575 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3255e587-f85f-4089-8dc1-47a52bd564c2" containerName="mariadb-database-create" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.820595 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93c0ded7-5b8b-4083-a8ed-e924644a1581" containerName="mariadb-account-create" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.821224 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.826794 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-k5pvr" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.826938 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.827417 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jsbs"] Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.943431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjmsp\" (UniqueName: \"kubernetes.io/projected/83fa171d-c407-4bc8-8150-dd88041006e6-kube-api-access-wjmsp\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.943481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-db-sync-config-data\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.943739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-config-data\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:56 crc kubenswrapper[4769]: I1121 12:17:56.943911 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-combined-ca-bundle\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.045796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjmsp\" (UniqueName: \"kubernetes.io/projected/83fa171d-c407-4bc8-8150-dd88041006e6-kube-api-access-wjmsp\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.045860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-db-sync-config-data\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.045944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-config-data\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.045998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-combined-ca-bundle\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.051756 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-config-data\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.054832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-db-sync-config-data\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.059002 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-combined-ca-bundle\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.061787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjmsp\" (UniqueName: \"kubernetes.io/projected/83fa171d-c407-4bc8-8150-dd88041006e6-kube-api-access-wjmsp\") pod \"glance-db-sync-5jsbs\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.136505 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:17:57 crc kubenswrapper[4769]: I1121 12:17:57.636882 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jsbs"] Nov 21 12:17:58 crc kubenswrapper[4769]: I1121 12:17:58.005407 4769 generic.go:334] "Generic (PLEG): container finished" podID="9441c299-7fb1-4908-8677-a92d7e39fdf4" containerID="a5e333f1cc4b171249b7eb194937b2d290bc6d6137288188dd8bebc57448ad9f" exitCode=0 Nov 21 12:17:58 crc kubenswrapper[4769]: I1121 12:17:58.005516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" event={"ID":"9441c299-7fb1-4908-8677-a92d7e39fdf4","Type":"ContainerDied","Data":"a5e333f1cc4b171249b7eb194937b2d290bc6d6137288188dd8bebc57448ad9f"} Nov 21 12:17:58 crc kubenswrapper[4769]: I1121 12:17:58.007578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" event={"ID":"83fa171d-c407-4bc8-8150-dd88041006e6","Type":"ContainerStarted","Data":"5c998d7852ab1ccfe4d9e119a235ad7ae9cc086da1e995f73648285e2dd160b7"} Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.018830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" event={"ID":"83fa171d-c407-4bc8-8150-dd88041006e6","Type":"ContainerStarted","Data":"e9783af4629ca9eb0b180ee6343af5c10b68b575c6f61e30f1e484550e51dcba"} Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.048953 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" podStartSLOduration=3.048926689 podStartE2EDuration="3.048926689s" podCreationTimestamp="2025-11-21 12:17:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:17:59.042447834 +0000 UTC m=+1637.743109682" watchObservedRunningTime="2025-11-21 12:17:59.048926689 +0000 UTC m=+1637.749588527" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.363845 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-combined-ca-bundle\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qptzs\" (UniqueName: \"kubernetes.io/projected/9441c299-7fb1-4908-8677-a92d7e39fdf4-kube-api-access-qptzs\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494482 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-swiftconf\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-dispersionconf\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494680 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-scripts\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9441c299-7fb1-4908-8677-a92d7e39fdf4-etc-swift\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.494778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-ring-data-devices\") pod \"9441c299-7fb1-4908-8677-a92d7e39fdf4\" (UID: \"9441c299-7fb1-4908-8677-a92d7e39fdf4\") " Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.495689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.495892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9441c299-7fb1-4908-8677-a92d7e39fdf4-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.500548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9441c299-7fb1-4908-8677-a92d7e39fdf4-kube-api-access-qptzs" (OuterVolumeSpecName: "kube-api-access-qptzs") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "kube-api-access-qptzs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.505097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.520882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-scripts" (OuterVolumeSpecName: "scripts") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.522752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.524612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "9441c299-7fb1-4908-8677-a92d7e39fdf4" (UID: "9441c299-7fb1-4908-8677-a92d7e39fdf4"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597159 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597209 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9441c299-7fb1-4908-8677-a92d7e39fdf4-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597219 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9441c299-7fb1-4908-8677-a92d7e39fdf4-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597229 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597237 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qptzs\" (UniqueName: \"kubernetes.io/projected/9441c299-7fb1-4908-8677-a92d7e39fdf4-kube-api-access-qptzs\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597245 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:17:59 crc kubenswrapper[4769]: I1121 12:17:59.597254 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9441c299-7fb1-4908-8677-a92d7e39fdf4-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:00 crc kubenswrapper[4769]: I1121 12:18:00.029856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" event={"ID":"9441c299-7fb1-4908-8677-a92d7e39fdf4","Type":"ContainerDied","Data":"f0868a712bfd4d0a3d683f538c5adfca0d128aae4f6d26e9d574c4b3011bf9c9"} Nov 21 12:18:00 crc kubenswrapper[4769]: I1121 12:18:00.029940 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0868a712bfd4d0a3d683f538c5adfca0d128aae4f6d26e9d574c4b3011bf9c9" Nov 21 12:18:00 crc kubenswrapper[4769]: I1121 12:18:00.029908 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-mkbbg" Nov 21 12:18:01 crc kubenswrapper[4769]: I1121 12:18:01.364299 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:18:02 crc kubenswrapper[4769]: I1121 12:18:02.049451 4769 generic.go:334] "Generic (PLEG): container finished" podID="83fa171d-c407-4bc8-8150-dd88041006e6" containerID="e9783af4629ca9eb0b180ee6343af5c10b68b575c6f61e30f1e484550e51dcba" exitCode=0 Nov 21 12:18:02 crc kubenswrapper[4769]: I1121 12:18:02.049510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" event={"ID":"83fa171d-c407-4bc8-8150-dd88041006e6","Type":"ContainerDied","Data":"e9783af4629ca9eb0b180ee6343af5c10b68b575c6f61e30f1e484550e51dcba"} Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.431822 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.567552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-config-data\") pod \"83fa171d-c407-4bc8-8150-dd88041006e6\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.567786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-combined-ca-bundle\") pod \"83fa171d-c407-4bc8-8150-dd88041006e6\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.567833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjmsp\" (UniqueName: \"kubernetes.io/projected/83fa171d-c407-4bc8-8150-dd88041006e6-kube-api-access-wjmsp\") pod \"83fa171d-c407-4bc8-8150-dd88041006e6\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.567875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-db-sync-config-data\") pod \"83fa171d-c407-4bc8-8150-dd88041006e6\" (UID: \"83fa171d-c407-4bc8-8150-dd88041006e6\") " Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.574455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83fa171d-c407-4bc8-8150-dd88041006e6-kube-api-access-wjmsp" (OuterVolumeSpecName: "kube-api-access-wjmsp") pod "83fa171d-c407-4bc8-8150-dd88041006e6" (UID: "83fa171d-c407-4bc8-8150-dd88041006e6"). InnerVolumeSpecName "kube-api-access-wjmsp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.577293 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "83fa171d-c407-4bc8-8150-dd88041006e6" (UID: "83fa171d-c407-4bc8-8150-dd88041006e6"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.591926 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83fa171d-c407-4bc8-8150-dd88041006e6" (UID: "83fa171d-c407-4bc8-8150-dd88041006e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.618761 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-config-data" (OuterVolumeSpecName: "config-data") pod "83fa171d-c407-4bc8-8150-dd88041006e6" (UID: "83fa171d-c407-4bc8-8150-dd88041006e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.669441 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.669472 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjmsp\" (UniqueName: \"kubernetes.io/projected/83fa171d-c407-4bc8-8150-dd88041006e6-kube-api-access-wjmsp\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.669484 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:03 crc kubenswrapper[4769]: I1121 12:18:03.669494 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa171d-c407-4bc8-8150-dd88041006e6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.066813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" event={"ID":"83fa171d-c407-4bc8-8150-dd88041006e6","Type":"ContainerDied","Data":"5c998d7852ab1ccfe4d9e119a235ad7ae9cc086da1e995f73648285e2dd160b7"} Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.067185 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c998d7852ab1ccfe4d9e119a235ad7ae9cc086da1e995f73648285e2dd160b7" Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.066878 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-5jsbs" Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.076464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.082810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"swift-storage-0\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.118921 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:18:04 crc kubenswrapper[4769]: I1121 12:18:04.690677 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:18:05 crc kubenswrapper[4769]: I1121 12:18:05.086788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"1951f2f612d8624661ffb990eb8bdae5620b480f2f298bb3531bb95185fb7460"} Nov 21 12:18:05 crc kubenswrapper[4769]: I1121 12:18:05.087172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"1b47402cd4ebcb79ce4f4e3319bf1b549c86d5ae0d483da01038614d771b5d7e"} Nov 21 12:18:05 crc kubenswrapper[4769]: I1121 12:18:05.087206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"424ca304aff4684d53245f8fee91d6d96930363681d4be14f452bc5b27fab7c5"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.107817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"60cf880275322a5210f7546ddc7c4437085cbe3c435c5a4a64604849cd6e31e2"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.108144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"545fd17bf1a594b6b79ab5b3c3c474bce9e4a4cdfb1fb3d71d6e809e2321c568"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.108157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"5ae112626165051404b6c4d21af9ea913b45e0e07640786a82353a9092217ccb"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.108165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"380de022fa6897bb49e2b90851a7d26533d4a8796f267d2ebda1b29f716f0754"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.108177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"f7c98e6ded540db99d1ae274c234ad623eb1d8af56a779214208e374efcc049e"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.108211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"949ac7e464eca74f7851c055b756f3e7f8553e0c1d049cd1fb2b1a918486ac97"} Nov 21 12:18:06 crc kubenswrapper[4769]: I1121 12:18:06.274495 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:18:06 crc kubenswrapper[4769]: E1121 12:18:06.274743 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.126551 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerID="5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9" exitCode=0 Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.126603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"9b970d3d-1a5c-40da-90ff-ddcc991a571d","Type":"ContainerDied","Data":"5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9"} Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.133810 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerID="70c0b5cef16d5d41ee21e47f8165d658e0ebe75099e6efceaf4ab4137ad4fd75" exitCode=0 Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.133986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec","Type":"ContainerDied","Data":"70c0b5cef16d5d41ee21e47f8165d658e0ebe75099e6efceaf4ab4137ad4fd75"} Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.151004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"5eede93a540279c052a1922a202f61501b5cec8c65a7c89d9b9d2db329d15261"} Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.151059 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"7e98f346bb842a6f0f7f90daa9c76e61f76f39534b58a4f0ca82d3c41ed0261c"} Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.151078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"5274219d9fb6a2953704b2da6dd99ff55aaacf5afb220cd87b4549fbb1b4d616"} Nov 21 12:18:07 crc kubenswrapper[4769]: I1121 12:18:07.151091 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"c9a62102a031512e453dd37916c42559e1c19f7d2a47f895b95cf9ec268b4cd2"} Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.165683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec","Type":"ContainerStarted","Data":"259aba43b6950c460955890aea38f479d52382b756120c0666d872f19b098bb5"} Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.166404 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.174679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"f4e30e1beb7fd96db86bab3c05804f9e7284e6f16adb6a463b56d3123607973f"} Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.174741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"d8da63893abbdb88dec1ceb878bd18456a301dce36ff6bcf7fcfe38decb9d82d"} Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.180765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"9b970d3d-1a5c-40da-90ff-ddcc991a571d","Type":"ContainerStarted","Data":"4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e"} Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.182142 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.204948 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.204919934 podStartE2EDuration="37.204919934s" podCreationTimestamp="2025-11-21 12:17:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:08.189617639 +0000 UTC m=+1646.890279497" watchObservedRunningTime="2025-11-21 12:18:08.204919934 +0000 UTC m=+1646.905581772" Nov 21 12:18:08 crc kubenswrapper[4769]: I1121 12:18:08.235363 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.235335979 podStartE2EDuration="37.235335979s" podCreationTimestamp="2025-11-21 12:17:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:08.221476193 +0000 UTC m=+1646.922138021" watchObservedRunningTime="2025-11-21 12:18:08.235335979 +0000 UTC m=+1646.935997817" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.204475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerStarted","Data":"ecac77aced9608a3e0de9db9a8cd73817cce63d849c652425764e04d05c3f16d"} Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.241122 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.241100428 podStartE2EDuration="21.241100428s" podCreationTimestamp="2025-11-21 12:17:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:09.237226183 +0000 UTC m=+1647.937888011" watchObservedRunningTime="2025-11-21 12:18:09.241100428 +0000 UTC m=+1647.941762246" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.419882 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz"] Nov 21 12:18:09 crc kubenswrapper[4769]: E1121 12:18:09.420608 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83fa171d-c407-4bc8-8150-dd88041006e6" containerName="glance-db-sync" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.420632 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83fa171d-c407-4bc8-8150-dd88041006e6" containerName="glance-db-sync" Nov 21 12:18:09 crc kubenswrapper[4769]: E1121 12:18:09.420666 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9441c299-7fb1-4908-8677-a92d7e39fdf4" containerName="swift-ring-rebalance" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.420675 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9441c299-7fb1-4908-8677-a92d7e39fdf4" containerName="swift-ring-rebalance" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.420880 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83fa171d-c407-4bc8-8150-dd88041006e6" containerName="glance-db-sync" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.420901 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9441c299-7fb1-4908-8677-a92d7e39fdf4" containerName="swift-ring-rebalance" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.421988 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.424920 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.434283 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz"] Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.568064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-config\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.568123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.568199 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5jz\" (UniqueName: \"kubernetes.io/projected/4193f10f-ec9c-4846-bb96-a57ce07e71c0-kube-api-access-9c5jz\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.568272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.669877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-config\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.669937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.670004 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5jz\" (UniqueName: \"kubernetes.io/projected/4193f10f-ec9c-4846-bb96-a57ce07e71c0-kube-api-access-9c5jz\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.670050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.671037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.671158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-config\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.671333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.699575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5jz\" (UniqueName: \"kubernetes.io/projected/4193f10f-ec9c-4846-bb96-a57ce07e71c0-kube-api-access-9c5jz\") pod \"dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:09 crc kubenswrapper[4769]: I1121 12:18:09.739612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:10 crc kubenswrapper[4769]: I1121 12:18:10.078611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz"] Nov 21 12:18:10 crc kubenswrapper[4769]: W1121 12:18:10.091416 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4193f10f_ec9c_4846_bb96_a57ce07e71c0.slice/crio-dcede680d87e00273e584e6655b2e07ca6ec76c349b241d3d1620d674f1f8c1b WatchSource:0}: Error finding container dcede680d87e00273e584e6655b2e07ca6ec76c349b241d3d1620d674f1f8c1b: Status 404 returned error can't find the container with id dcede680d87e00273e584e6655b2e07ca6ec76c349b241d3d1620d674f1f8c1b Nov 21 12:18:10 crc kubenswrapper[4769]: I1121 12:18:10.217418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" event={"ID":"4193f10f-ec9c-4846-bb96-a57ce07e71c0","Type":"ContainerStarted","Data":"dcede680d87e00273e584e6655b2e07ca6ec76c349b241d3d1620d674f1f8c1b"} Nov 21 12:18:11 crc kubenswrapper[4769]: I1121 12:18:11.230981 4769 generic.go:334] "Generic (PLEG): container finished" podID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerID="8b2af33279acf49f2c5a4b6436f91475938e5c13408d2d907cf511bce75c8365" exitCode=0 Nov 21 12:18:11 crc kubenswrapper[4769]: I1121 12:18:11.231053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" event={"ID":"4193f10f-ec9c-4846-bb96-a57ce07e71c0","Type":"ContainerDied","Data":"8b2af33279acf49f2c5a4b6436f91475938e5c13408d2d907cf511bce75c8365"} Nov 21 12:18:12 crc kubenswrapper[4769]: I1121 12:18:12.243475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" event={"ID":"4193f10f-ec9c-4846-bb96-a57ce07e71c0","Type":"ContainerStarted","Data":"180a6d631466199ab2b58a28cc270e9c57269f96f796d0877d37ed72c1585af7"} Nov 21 12:18:12 crc kubenswrapper[4769]: I1121 12:18:12.243779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:12 crc kubenswrapper[4769]: I1121 12:18:12.268693 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" podStartSLOduration=3.268672187 podStartE2EDuration="3.268672187s" podCreationTimestamp="2025-11-21 12:18:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:12.263755013 +0000 UTC m=+1650.964416831" watchObservedRunningTime="2025-11-21 12:18:12.268672187 +0000 UTC m=+1650.969334005" Nov 21 12:18:17 crc kubenswrapper[4769]: I1121 12:18:17.273990 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:18:17 crc kubenswrapper[4769]: E1121 12:18:17.274803 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:18:19 crc kubenswrapper[4769]: I1121 12:18:19.741415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:18:19 crc kubenswrapper[4769]: I1121 12:18:19.800078 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4"] Nov 21 12:18:19 crc kubenswrapper[4769]: I1121 12:18:19.800475 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerName="dnsmasq-dns" containerID="cri-o://bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311" gracePeriod=10 Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.221932 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.323460 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.323481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" event={"ID":"185dd314-18f2-4593-8ffe-5d639f37d8fd","Type":"ContainerDied","Data":"bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311"} Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.323522 4769 scope.go:117] "RemoveContainer" containerID="bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.323446 4769 generic.go:334] "Generic (PLEG): container finished" podID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerID="bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311" exitCode=0 Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.323718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4" event={"ID":"185dd314-18f2-4593-8ffe-5d639f37d8fd","Type":"ContainerDied","Data":"4ce630f97445a6080d1ca0d5623ec2c95adfc27784b96e8575839e796ca20ae0"} Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.353163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-config\") pod \"185dd314-18f2-4593-8ffe-5d639f37d8fd\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.353335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-dnsmasq-svc\") pod \"185dd314-18f2-4593-8ffe-5d639f37d8fd\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.353447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srtb7\" (UniqueName: \"kubernetes.io/projected/185dd314-18f2-4593-8ffe-5d639f37d8fd-kube-api-access-srtb7\") pod \"185dd314-18f2-4593-8ffe-5d639f37d8fd\" (UID: \"185dd314-18f2-4593-8ffe-5d639f37d8fd\") " Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.359791 4769 scope.go:117] "RemoveContainer" containerID="efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.363679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185dd314-18f2-4593-8ffe-5d639f37d8fd-kube-api-access-srtb7" (OuterVolumeSpecName: "kube-api-access-srtb7") pod "185dd314-18f2-4593-8ffe-5d639f37d8fd" (UID: "185dd314-18f2-4593-8ffe-5d639f37d8fd"). InnerVolumeSpecName "kube-api-access-srtb7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.403646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "185dd314-18f2-4593-8ffe-5d639f37d8fd" (UID: "185dd314-18f2-4593-8ffe-5d639f37d8fd"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.405631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-config" (OuterVolumeSpecName: "config") pod "185dd314-18f2-4593-8ffe-5d639f37d8fd" (UID: "185dd314-18f2-4593-8ffe-5d639f37d8fd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.447362 4769 scope.go:117] "RemoveContainer" containerID="bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311" Nov 21 12:18:20 crc kubenswrapper[4769]: E1121 12:18:20.447979 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311\": container with ID starting with bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311 not found: ID does not exist" containerID="bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.448093 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311"} err="failed to get container status \"bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311\": rpc error: code = NotFound desc = could not find container \"bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311\": container with ID starting with bf1047ada735bc6cc8807c29a92e61a664a6ed0add546fa1a75ab42a49dc4311 not found: ID does not exist" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.448173 4769 scope.go:117] "RemoveContainer" containerID="efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186" Nov 21 12:18:20 crc kubenswrapper[4769]: E1121 12:18:20.448908 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186\": container with ID starting with efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186 not found: ID does not exist" containerID="efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.448990 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186"} err="failed to get container status \"efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186\": rpc error: code = NotFound desc = could not find container \"efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186\": container with ID starting with efdb475a33a3f2fb95989d07806c18da53b8315df2164ca305812548e9683186 not found: ID does not exist" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.457050 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.457111 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/185dd314-18f2-4593-8ffe-5d639f37d8fd-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.457128 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srtb7\" (UniqueName: \"kubernetes.io/projected/185dd314-18f2-4593-8ffe-5d639f37d8fd-kube-api-access-srtb7\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.668678 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4"] Nov 21 12:18:20 crc kubenswrapper[4769]: I1121 12:18:20.675159 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-95qf4"] Nov 21 12:18:21 crc kubenswrapper[4769]: I1121 12:18:21.288464 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" path="/var/lib/kubelet/pods/185dd314-18f2-4593-8ffe-5d639f37d8fd/volumes" Nov 21 12:18:22 crc kubenswrapper[4769]: I1121 12:18:22.701459 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.151776 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-31d6-account-create-flkgq"] Nov 21 12:18:23 crc kubenswrapper[4769]: E1121 12:18:23.152158 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerName="dnsmasq-dns" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.152172 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerName="dnsmasq-dns" Nov 21 12:18:23 crc kubenswrapper[4769]: E1121 12:18:23.152222 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerName="init" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.152228 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerName="init" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.152403 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="185dd314-18f2-4593-8ffe-5d639f37d8fd" containerName="dnsmasq-dns" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.153131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.162800 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.164308 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.172569 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5rvgd"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.174485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.184662 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-31d6-account-create-flkgq"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.212418 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5rvgd"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.288733 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-d005-account-create-v8rbt"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.291056 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.296431 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-p84sx"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.298091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.301675 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.309614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xfzx\" (UniqueName: \"kubernetes.io/projected/c6314295-c402-4f64-bc4a-4c5f00816c25-kube-api-access-5xfzx\") pod \"cinder-db-create-5rvgd\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.309781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6314295-c402-4f64-bc4a-4c5f00816c25-operator-scripts\") pod \"cinder-db-create-5rvgd\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.309940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30cb53e2-204b-4d6b-839a-072f30cd479d-operator-scripts\") pod \"cinder-31d6-account-create-flkgq\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.310068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxvrg\" (UniqueName: \"kubernetes.io/projected/30cb53e2-204b-4d6b-839a-072f30cd479d-kube-api-access-wxvrg\") pod \"cinder-31d6-account-create-flkgq\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.317536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-d005-account-create-v8rbt"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.335760 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-p84sx"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.386017 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-8kvkx"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.387316 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.401459 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-8kvkx"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfzx\" (UniqueName: \"kubernetes.io/projected/c6314295-c402-4f64-bc4a-4c5f00816c25-kube-api-access-5xfzx\") pod \"cinder-db-create-5rvgd\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5d9\" (UniqueName: \"kubernetes.io/projected/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-kube-api-access-7l5d9\") pod \"barbican-db-create-p84sx\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-operator-scripts\") pod \"barbican-db-create-p84sx\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412750 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6314295-c402-4f64-bc4a-4c5f00816c25-operator-scripts\") pod \"cinder-db-create-5rvgd\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30cb53e2-204b-4d6b-839a-072f30cd479d-operator-scripts\") pod \"cinder-31d6-account-create-flkgq\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f68bcd4c-d3d9-4bdb-8328-745682033ab4-operator-scripts\") pod \"neutron-d005-account-create-v8rbt\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrk5\" (UniqueName: \"kubernetes.io/projected/f68bcd4c-d3d9-4bdb-8328-745682033ab4-kube-api-access-7nrk5\") pod \"neutron-d005-account-create-v8rbt\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.412906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wxvrg\" (UniqueName: \"kubernetes.io/projected/30cb53e2-204b-4d6b-839a-072f30cd479d-kube-api-access-wxvrg\") pod \"cinder-31d6-account-create-flkgq\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.414482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6314295-c402-4f64-bc4a-4c5f00816c25-operator-scripts\") pod \"cinder-db-create-5rvgd\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.416025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30cb53e2-204b-4d6b-839a-072f30cd479d-operator-scripts\") pod \"cinder-31d6-account-create-flkgq\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.459916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xfzx\" (UniqueName: \"kubernetes.io/projected/c6314295-c402-4f64-bc4a-4c5f00816c25-kube-api-access-5xfzx\") pod \"cinder-db-create-5rvgd\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.479145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxvrg\" (UniqueName: \"kubernetes.io/projected/30cb53e2-204b-4d6b-839a-072f30cd479d-kube-api-access-wxvrg\") pod \"cinder-31d6-account-create-flkgq\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.493769 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.504376 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-xgqqh"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.506391 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.506799 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.511415 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-xbm47" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.511600 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.512091 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.512282 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.514685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrk5\" (UniqueName: \"kubernetes.io/projected/f68bcd4c-d3d9-4bdb-8328-745682033ab4-kube-api-access-7nrk5\") pod \"neutron-d005-account-create-v8rbt\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.514786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51b6ab2f-2185-4d33-987e-a3781685174d-operator-scripts\") pod \"neutron-db-create-8kvkx\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.514823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2cb5\" (UniqueName: \"kubernetes.io/projected/51b6ab2f-2185-4d33-987e-a3781685174d-kube-api-access-w2cb5\") pod \"neutron-db-create-8kvkx\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.514874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5d9\" (UniqueName: \"kubernetes.io/projected/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-kube-api-access-7l5d9\") pod \"barbican-db-create-p84sx\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.515091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-operator-scripts\") pod \"barbican-db-create-p84sx\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.515180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f68bcd4c-d3d9-4bdb-8328-745682033ab4-operator-scripts\") pod \"neutron-d005-account-create-v8rbt\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.516211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f68bcd4c-d3d9-4bdb-8328-745682033ab4-operator-scripts\") pod \"neutron-d005-account-create-v8rbt\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.516748 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-operator-scripts\") pod \"barbican-db-create-p84sx\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.523325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-xgqqh"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.551223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5d9\" (UniqueName: \"kubernetes.io/projected/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-kube-api-access-7l5d9\") pod \"barbican-db-create-p84sx\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.558137 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrk5\" (UniqueName: \"kubernetes.io/projected/f68bcd4c-d3d9-4bdb-8328-745682033ab4-kube-api-access-7nrk5\") pod \"neutron-d005-account-create-v8rbt\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.577299 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-22df-account-create-zzvvh"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.578982 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.581598 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.589450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-22df-account-create-zzvvh"] Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.618952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qbxz\" (UniqueName: \"kubernetes.io/projected/091f9579-b673-4163-bead-5d48a37f37b0-kube-api-access-8qbxz\") pod \"barbican-22df-account-create-zzvvh\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.619027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/091f9579-b673-4163-bead-5d48a37f37b0-operator-scripts\") pod \"barbican-22df-account-create-zzvvh\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.619414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51b6ab2f-2185-4d33-987e-a3781685174d-operator-scripts\") pod \"neutron-db-create-8kvkx\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.619544 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2cb5\" (UniqueName: \"kubernetes.io/projected/51b6ab2f-2185-4d33-987e-a3781685174d-kube-api-access-w2cb5\") pod \"neutron-db-create-8kvkx\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.619781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-combined-ca-bundle\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.619860 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-config-data\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.619898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcdjq\" (UniqueName: \"kubernetes.io/projected/8363122f-b7e7-4872-b1c6-5043306562aa-kube-api-access-jcdjq\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.621141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51b6ab2f-2185-4d33-987e-a3781685174d-operator-scripts\") pod \"neutron-db-create-8kvkx\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.626450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.637101 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.641136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2cb5\" (UniqueName: \"kubernetes.io/projected/51b6ab2f-2185-4d33-987e-a3781685174d-kube-api-access-w2cb5\") pod \"neutron-db-create-8kvkx\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.723702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8qbxz\" (UniqueName: \"kubernetes.io/projected/091f9579-b673-4163-bead-5d48a37f37b0-kube-api-access-8qbxz\") pod \"barbican-22df-account-create-zzvvh\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.724310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/091f9579-b673-4163-bead-5d48a37f37b0-operator-scripts\") pod \"barbican-22df-account-create-zzvvh\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.725518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/091f9579-b673-4163-bead-5d48a37f37b0-operator-scripts\") pod \"barbican-22df-account-create-zzvvh\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.727073 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.728643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-combined-ca-bundle\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.728703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-config-data\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.728742 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jcdjq\" (UniqueName: \"kubernetes.io/projected/8363122f-b7e7-4872-b1c6-5043306562aa-kube-api-access-jcdjq\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.738315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-config-data\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.742080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-combined-ca-bundle\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.762477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qbxz\" (UniqueName: \"kubernetes.io/projected/091f9579-b673-4163-bead-5d48a37f37b0-kube-api-access-8qbxz\") pod \"barbican-22df-account-create-zzvvh\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.767314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcdjq\" (UniqueName: \"kubernetes.io/projected/8363122f-b7e7-4872-b1c6-5043306562aa-kube-api-access-jcdjq\") pod \"keystone-db-sync-xgqqh\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.784349 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.797243 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:23 crc kubenswrapper[4769]: I1121 12:18:23.943767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5rvgd"] Nov 21 12:18:24 crc kubenswrapper[4769]: W1121 12:18:23.999609 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6314295_c402_4f64_bc4a_4c5f00816c25.slice/crio-061bcf0195bca7a35e488d1278273e2ccaea84c3426016a3d62b63762ff6e5e8 WatchSource:0}: Error finding container 061bcf0195bca7a35e488d1278273e2ccaea84c3426016a3d62b63762ff6e5e8: Status 404 returned error can't find the container with id 061bcf0195bca7a35e488d1278273e2ccaea84c3426016a3d62b63762ff6e5e8 Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.183081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-d005-account-create-v8rbt"] Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.272222 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-31d6-account-create-flkgq"] Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.399099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" event={"ID":"f68bcd4c-d3d9-4bdb-8328-745682033ab4","Type":"ContainerStarted","Data":"78c217f035e455f2fd0daf6bafce00b6bad5af4a4870fffdddb1f6c552399c72"} Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.405092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" event={"ID":"30cb53e2-204b-4d6b-839a-072f30cd479d","Type":"ContainerStarted","Data":"88a2ecdc6573744478aae4fa4a4c1bd951a48defe3fbdddd2a13dce9cd790c2c"} Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.414303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" event={"ID":"c6314295-c402-4f64-bc4a-4c5f00816c25","Type":"ContainerStarted","Data":"22e276d4bc1d37a68c2acf5e3d0304e3f7c14140cba00a69df8991aa086d4c36"} Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.414365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" event={"ID":"c6314295-c402-4f64-bc4a-4c5f00816c25","Type":"ContainerStarted","Data":"061bcf0195bca7a35e488d1278273e2ccaea84c3426016a3d62b63762ff6e5e8"} Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.428087 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-22df-account-create-zzvvh"] Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.453818 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" podStartSLOduration=1.453789899 podStartE2EDuration="1.453789899s" podCreationTimestamp="2025-11-21 12:18:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:24.447081327 +0000 UTC m=+1663.147743155" watchObservedRunningTime="2025-11-21 12:18:24.453789899 +0000 UTC m=+1663.154451717" Nov 21 12:18:24 crc kubenswrapper[4769]: W1121 12:18:24.507983 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded59396d_c7fc_4cc1_9092_3aa037cf0a70.slice/crio-dac3140382c91fe682bfb837370b1ecd8aa109cc5a29eb5ad078452145b70e97 WatchSource:0}: Error finding container dac3140382c91fe682bfb837370b1ecd8aa109cc5a29eb5ad078452145b70e97: Status 404 returned error can't find the container with id dac3140382c91fe682bfb837370b1ecd8aa109cc5a29eb5ad078452145b70e97 Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.518591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-p84sx"] Nov 21 12:18:24 crc kubenswrapper[4769]: W1121 12:18:24.522379 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8363122f_b7e7_4872_b1c6_5043306562aa.slice/crio-a2c8a04cdd1f21d5636a15b136cad06f38ea7314fa52acc9a7f01fcb7e7d743a WatchSource:0}: Error finding container a2c8a04cdd1f21d5636a15b136cad06f38ea7314fa52acc9a7f01fcb7e7d743a: Status 404 returned error can't find the container with id a2c8a04cdd1f21d5636a15b136cad06f38ea7314fa52acc9a7f01fcb7e7d743a Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.533934 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-xgqqh"] Nov 21 12:18:24 crc kubenswrapper[4769]: W1121 12:18:24.540937 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51b6ab2f_2185_4d33_987e_a3781685174d.slice/crio-9150c9cfbe5d5aefd574431d23713fab10007b7436aca8f5ca44e6dd1f89b704 WatchSource:0}: Error finding container 9150c9cfbe5d5aefd574431d23713fab10007b7436aca8f5ca44e6dd1f89b704: Status 404 returned error can't find the container with id 9150c9cfbe5d5aefd574431d23713fab10007b7436aca8f5ca44e6dd1f89b704 Nov 21 12:18:24 crc kubenswrapper[4769]: I1121 12:18:24.545600 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-8kvkx"] Nov 21 12:18:25 crc kubenswrapper[4769]: E1121 12:18:25.271847 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30cb53e2_204b_4d6b_839a_072f30cd479d.slice/crio-22e1e538966b65b561770ebf929bbc919c42b47f1dc5267bcd5f3424a1fbf128.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod091f9579_b673_4163_bead_5d48a37f37b0.slice/crio-9de1b07a8deecefa4af77a9c1f3d774640503439541fa2a2fec121cd44fb2d02.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.425904 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed59396d-c7fc-4cc1-9092-3aa037cf0a70" containerID="cd51cb6bb495ef6c53d50ac811f1a706fc60f3c0b388ea9a6f2b24c3f875453e" exitCode=0 Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.426005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-p84sx" event={"ID":"ed59396d-c7fc-4cc1-9092-3aa037cf0a70","Type":"ContainerDied","Data":"cd51cb6bb495ef6c53d50ac811f1a706fc60f3c0b388ea9a6f2b24c3f875453e"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.426041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-p84sx" event={"ID":"ed59396d-c7fc-4cc1-9092-3aa037cf0a70","Type":"ContainerStarted","Data":"dac3140382c91fe682bfb837370b1ecd8aa109cc5a29eb5ad078452145b70e97"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.428232 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6314295-c402-4f64-bc4a-4c5f00816c25" containerID="22e276d4bc1d37a68c2acf5e3d0304e3f7c14140cba00a69df8991aa086d4c36" exitCode=0 Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.428279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" event={"ID":"c6314295-c402-4f64-bc4a-4c5f00816c25","Type":"ContainerDied","Data":"22e276d4bc1d37a68c2acf5e3d0304e3f7c14140cba00a69df8991aa086d4c36"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.432349 4769 generic.go:334] "Generic (PLEG): container finished" podID="f68bcd4c-d3d9-4bdb-8328-745682033ab4" containerID="6c94ffd343594484c5a4b4d78b3c1053d7ddc75741335be410344cbd4a698cca" exitCode=0 Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.432411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" event={"ID":"f68bcd4c-d3d9-4bdb-8328-745682033ab4","Type":"ContainerDied","Data":"6c94ffd343594484c5a4b4d78b3c1053d7ddc75741335be410344cbd4a698cca"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.435748 4769 generic.go:334] "Generic (PLEG): container finished" podID="51b6ab2f-2185-4d33-987e-a3781685174d" containerID="0a2e957fde928411251548ec850baf428f736f3bb4d75c9710325e0416b01abf" exitCode=0 Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.435850 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" event={"ID":"51b6ab2f-2185-4d33-987e-a3781685174d","Type":"ContainerDied","Data":"0a2e957fde928411251548ec850baf428f736f3bb4d75c9710325e0416b01abf"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.435888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" event={"ID":"51b6ab2f-2185-4d33-987e-a3781685174d","Type":"ContainerStarted","Data":"9150c9cfbe5d5aefd574431d23713fab10007b7436aca8f5ca44e6dd1f89b704"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.440040 4769 generic.go:334] "Generic (PLEG): container finished" podID="091f9579-b673-4163-bead-5d48a37f37b0" containerID="9de1b07a8deecefa4af77a9c1f3d774640503439541fa2a2fec121cd44fb2d02" exitCode=0 Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.440101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" event={"ID":"091f9579-b673-4163-bead-5d48a37f37b0","Type":"ContainerDied","Data":"9de1b07a8deecefa4af77a9c1f3d774640503439541fa2a2fec121cd44fb2d02"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.440162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" event={"ID":"091f9579-b673-4163-bead-5d48a37f37b0","Type":"ContainerStarted","Data":"8726bfb92c41eb9d5555b118c6b731445155c942d2b085de2b03a992f7edbc81"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.442624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" event={"ID":"8363122f-b7e7-4872-b1c6-5043306562aa","Type":"ContainerStarted","Data":"8dd881a115475cab16de46caa3476924441cff9498e2df9b5067ed3c0db6ab8d"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.442678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" event={"ID":"8363122f-b7e7-4872-b1c6-5043306562aa","Type":"ContainerStarted","Data":"a2c8a04cdd1f21d5636a15b136cad06f38ea7314fa52acc9a7f01fcb7e7d743a"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.444518 4769 generic.go:334] "Generic (PLEG): container finished" podID="30cb53e2-204b-4d6b-839a-072f30cd479d" containerID="22e1e538966b65b561770ebf929bbc919c42b47f1dc5267bcd5f3424a1fbf128" exitCode=0 Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.444565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" event={"ID":"30cb53e2-204b-4d6b-839a-072f30cd479d","Type":"ContainerDied","Data":"22e1e538966b65b561770ebf929bbc919c42b47f1dc5267bcd5f3424a1fbf128"} Nov 21 12:18:25 crc kubenswrapper[4769]: I1121 12:18:25.569702 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" podStartSLOduration=2.569664967 podStartE2EDuration="2.569664967s" podCreationTimestamp="2025-11-21 12:18:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:25.557657782 +0000 UTC m=+1664.258319600" watchObservedRunningTime="2025-11-21 12:18:25.569664967 +0000 UTC m=+1664.270326785" Nov 21 12:18:26 crc kubenswrapper[4769]: I1121 12:18:26.883068 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:26 crc kubenswrapper[4769]: I1121 12:18:26.994793 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l5d9\" (UniqueName: \"kubernetes.io/projected/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-kube-api-access-7l5d9\") pod \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " Nov 21 12:18:26 crc kubenswrapper[4769]: I1121 12:18:26.994948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-operator-scripts\") pod \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\" (UID: \"ed59396d-c7fc-4cc1-9092-3aa037cf0a70\") " Nov 21 12:18:26 crc kubenswrapper[4769]: I1121 12:18:26.995733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ed59396d-c7fc-4cc1-9092-3aa037cf0a70" (UID: "ed59396d-c7fc-4cc1-9092-3aa037cf0a70"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.008286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-kube-api-access-7l5d9" (OuterVolumeSpecName: "kube-api-access-7l5d9") pod "ed59396d-c7fc-4cc1-9092-3aa037cf0a70" (UID: "ed59396d-c7fc-4cc1-9092-3aa037cf0a70"). InnerVolumeSpecName "kube-api-access-7l5d9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.089244 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.097250 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.097282 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7l5d9\" (UniqueName: \"kubernetes.io/projected/ed59396d-c7fc-4cc1-9092-3aa037cf0a70-kube-api-access-7l5d9\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.097958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.108841 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.130116 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.134147 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.199786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nrk5\" (UniqueName: \"kubernetes.io/projected/f68bcd4c-d3d9-4bdb-8328-745682033ab4-kube-api-access-7nrk5\") pod \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.199954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxvrg\" (UniqueName: \"kubernetes.io/projected/30cb53e2-204b-4d6b-839a-072f30cd479d-kube-api-access-wxvrg\") pod \"30cb53e2-204b-4d6b-839a-072f30cd479d\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6314295-c402-4f64-bc4a-4c5f00816c25-operator-scripts\") pod \"c6314295-c402-4f64-bc4a-4c5f00816c25\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200063 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51b6ab2f-2185-4d33-987e-a3781685174d-operator-scripts\") pod \"51b6ab2f-2185-4d33-987e-a3781685174d\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30cb53e2-204b-4d6b-839a-072f30cd479d-operator-scripts\") pod \"30cb53e2-204b-4d6b-839a-072f30cd479d\" (UID: \"30cb53e2-204b-4d6b-839a-072f30cd479d\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f68bcd4c-d3d9-4bdb-8328-745682033ab4-operator-scripts\") pod \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\" (UID: \"f68bcd4c-d3d9-4bdb-8328-745682033ab4\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qbxz\" (UniqueName: \"kubernetes.io/projected/091f9579-b673-4163-bead-5d48a37f37b0-kube-api-access-8qbxz\") pod \"091f9579-b673-4163-bead-5d48a37f37b0\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2cb5\" (UniqueName: \"kubernetes.io/projected/51b6ab2f-2185-4d33-987e-a3781685174d-kube-api-access-w2cb5\") pod \"51b6ab2f-2185-4d33-987e-a3781685174d\" (UID: \"51b6ab2f-2185-4d33-987e-a3781685174d\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200208 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/091f9579-b673-4163-bead-5d48a37f37b0-operator-scripts\") pod \"091f9579-b673-4163-bead-5d48a37f37b0\" (UID: \"091f9579-b673-4163-bead-5d48a37f37b0\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.200238 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xfzx\" (UniqueName: \"kubernetes.io/projected/c6314295-c402-4f64-bc4a-4c5f00816c25-kube-api-access-5xfzx\") pod \"c6314295-c402-4f64-bc4a-4c5f00816c25\" (UID: \"c6314295-c402-4f64-bc4a-4c5f00816c25\") " Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.201080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30cb53e2-204b-4d6b-839a-072f30cd479d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "30cb53e2-204b-4d6b-839a-072f30cd479d" (UID: "30cb53e2-204b-4d6b-839a-072f30cd479d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.201408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6314295-c402-4f64-bc4a-4c5f00816c25-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c6314295-c402-4f64-bc4a-4c5f00816c25" (UID: "c6314295-c402-4f64-bc4a-4c5f00816c25"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.201759 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f68bcd4c-d3d9-4bdb-8328-745682033ab4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f68bcd4c-d3d9-4bdb-8328-745682033ab4" (UID: "f68bcd4c-d3d9-4bdb-8328-745682033ab4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.201790 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51b6ab2f-2185-4d33-987e-a3781685174d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "51b6ab2f-2185-4d33-987e-a3781685174d" (UID: "51b6ab2f-2185-4d33-987e-a3781685174d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.202008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/091f9579-b673-4163-bead-5d48a37f37b0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "091f9579-b673-4163-bead-5d48a37f37b0" (UID: "091f9579-b673-4163-bead-5d48a37f37b0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.202179 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6314295-c402-4f64-bc4a-4c5f00816c25-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.202234 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51b6ab2f-2185-4d33-987e-a3781685174d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.202250 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/30cb53e2-204b-4d6b-839a-072f30cd479d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.202265 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f68bcd4c-d3d9-4bdb-8328-745682033ab4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.203927 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/091f9579-b673-4163-bead-5d48a37f37b0-kube-api-access-8qbxz" (OuterVolumeSpecName: "kube-api-access-8qbxz") pod "091f9579-b673-4163-bead-5d48a37f37b0" (UID: "091f9579-b673-4163-bead-5d48a37f37b0"). InnerVolumeSpecName "kube-api-access-8qbxz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.204342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30cb53e2-204b-4d6b-839a-072f30cd479d-kube-api-access-wxvrg" (OuterVolumeSpecName: "kube-api-access-wxvrg") pod "30cb53e2-204b-4d6b-839a-072f30cd479d" (UID: "30cb53e2-204b-4d6b-839a-072f30cd479d"). InnerVolumeSpecName "kube-api-access-wxvrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.207393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b6ab2f-2185-4d33-987e-a3781685174d-kube-api-access-w2cb5" (OuterVolumeSpecName: "kube-api-access-w2cb5") pod "51b6ab2f-2185-4d33-987e-a3781685174d" (UID: "51b6ab2f-2185-4d33-987e-a3781685174d"). InnerVolumeSpecName "kube-api-access-w2cb5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.207409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6314295-c402-4f64-bc4a-4c5f00816c25-kube-api-access-5xfzx" (OuterVolumeSpecName: "kube-api-access-5xfzx") pod "c6314295-c402-4f64-bc4a-4c5f00816c25" (UID: "c6314295-c402-4f64-bc4a-4c5f00816c25"). InnerVolumeSpecName "kube-api-access-5xfzx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.208380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68bcd4c-d3d9-4bdb-8328-745682033ab4-kube-api-access-7nrk5" (OuterVolumeSpecName: "kube-api-access-7nrk5") pod "f68bcd4c-d3d9-4bdb-8328-745682033ab4" (UID: "f68bcd4c-d3d9-4bdb-8328-745682033ab4"). InnerVolumeSpecName "kube-api-access-7nrk5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.303960 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8qbxz\" (UniqueName: \"kubernetes.io/projected/091f9579-b673-4163-bead-5d48a37f37b0-kube-api-access-8qbxz\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.304003 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w2cb5\" (UniqueName: \"kubernetes.io/projected/51b6ab2f-2185-4d33-987e-a3781685174d-kube-api-access-w2cb5\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.304018 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/091f9579-b673-4163-bead-5d48a37f37b0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.304033 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5xfzx\" (UniqueName: \"kubernetes.io/projected/c6314295-c402-4f64-bc4a-4c5f00816c25-kube-api-access-5xfzx\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.304046 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7nrk5\" (UniqueName: \"kubernetes.io/projected/f68bcd4c-d3d9-4bdb-8328-745682033ab4-kube-api-access-7nrk5\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.304060 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wxvrg\" (UniqueName: \"kubernetes.io/projected/30cb53e2-204b-4d6b-839a-072f30cd479d-kube-api-access-wxvrg\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.465120 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.465382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5rvgd" event={"ID":"c6314295-c402-4f64-bc4a-4c5f00816c25","Type":"ContainerDied","Data":"061bcf0195bca7a35e488d1278273e2ccaea84c3426016a3d62b63762ff6e5e8"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.465426 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="061bcf0195bca7a35e488d1278273e2ccaea84c3426016a3d62b63762ff6e5e8" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.467942 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.467956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-d005-account-create-v8rbt" event={"ID":"f68bcd4c-d3d9-4bdb-8328-745682033ab4","Type":"ContainerDied","Data":"78c217f035e455f2fd0daf6bafce00b6bad5af4a4870fffdddb1f6c552399c72"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.467987 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78c217f035e455f2fd0daf6bafce00b6bad5af4a4870fffdddb1f6c552399c72" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.471653 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.471642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-8kvkx" event={"ID":"51b6ab2f-2185-4d33-987e-a3781685174d","Type":"ContainerDied","Data":"9150c9cfbe5d5aefd574431d23713fab10007b7436aca8f5ca44e6dd1f89b704"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.472045 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9150c9cfbe5d5aefd574431d23713fab10007b7436aca8f5ca44e6dd1f89b704" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.475612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" event={"ID":"091f9579-b673-4163-bead-5d48a37f37b0","Type":"ContainerDied","Data":"8726bfb92c41eb9d5555b118c6b731445155c942d2b085de2b03a992f7edbc81"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.475671 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8726bfb92c41eb9d5555b118c6b731445155c942d2b085de2b03a992f7edbc81" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.475750 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-22df-account-create-zzvvh" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.478055 4769 generic.go:334] "Generic (PLEG): container finished" podID="8363122f-b7e7-4872-b1c6-5043306562aa" containerID="8dd881a115475cab16de46caa3476924441cff9498e2df9b5067ed3c0db6ab8d" exitCode=0 Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.478131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" event={"ID":"8363122f-b7e7-4872-b1c6-5043306562aa","Type":"ContainerDied","Data":"8dd881a115475cab16de46caa3476924441cff9498e2df9b5067ed3c0db6ab8d"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.482216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" event={"ID":"30cb53e2-204b-4d6b-839a-072f30cd479d","Type":"ContainerDied","Data":"88a2ecdc6573744478aae4fa4a4c1bd951a48defe3fbdddd2a13dce9cd790c2c"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.482256 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-31d6-account-create-flkgq" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.482277 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88a2ecdc6573744478aae4fa4a4c1bd951a48defe3fbdddd2a13dce9cd790c2c" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.487610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-p84sx" event={"ID":"ed59396d-c7fc-4cc1-9092-3aa037cf0a70","Type":"ContainerDied","Data":"dac3140382c91fe682bfb837370b1ecd8aa109cc5a29eb5ad078452145b70e97"} Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.487688 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dac3140382c91fe682bfb837370b1ecd8aa109cc5a29eb5ad078452145b70e97" Nov 21 12:18:27 crc kubenswrapper[4769]: I1121 12:18:27.487765 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-p84sx" Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.849269 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.941666 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-config-data\") pod \"8363122f-b7e7-4872-b1c6-5043306562aa\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.941788 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcdjq\" (UniqueName: \"kubernetes.io/projected/8363122f-b7e7-4872-b1c6-5043306562aa-kube-api-access-jcdjq\") pod \"8363122f-b7e7-4872-b1c6-5043306562aa\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.941866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-combined-ca-bundle\") pod \"8363122f-b7e7-4872-b1c6-5043306562aa\" (UID: \"8363122f-b7e7-4872-b1c6-5043306562aa\") " Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.950370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8363122f-b7e7-4872-b1c6-5043306562aa-kube-api-access-jcdjq" (OuterVolumeSpecName: "kube-api-access-jcdjq") pod "8363122f-b7e7-4872-b1c6-5043306562aa" (UID: "8363122f-b7e7-4872-b1c6-5043306562aa"). InnerVolumeSpecName "kube-api-access-jcdjq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.971537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8363122f-b7e7-4872-b1c6-5043306562aa" (UID: "8363122f-b7e7-4872-b1c6-5043306562aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:28 crc kubenswrapper[4769]: I1121 12:18:28.997225 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-config-data" (OuterVolumeSpecName: "config-data") pod "8363122f-b7e7-4872-b1c6-5043306562aa" (UID: "8363122f-b7e7-4872-b1c6-5043306562aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:29 crc kubenswrapper[4769]: I1121 12:18:29.043900 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:29 crc kubenswrapper[4769]: I1121 12:18:29.043934 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jcdjq\" (UniqueName: \"kubernetes.io/projected/8363122f-b7e7-4872-b1c6-5043306562aa-kube-api-access-jcdjq\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:29 crc kubenswrapper[4769]: I1121 12:18:29.043949 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8363122f-b7e7-4872-b1c6-5043306562aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:29 crc kubenswrapper[4769]: I1121 12:18:29.508977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" event={"ID":"8363122f-b7e7-4872-b1c6-5043306562aa","Type":"ContainerDied","Data":"a2c8a04cdd1f21d5636a15b136cad06f38ea7314fa52acc9a7f01fcb7e7d743a"} Nov 21 12:18:29 crc kubenswrapper[4769]: I1121 12:18:29.509381 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2c8a04cdd1f21d5636a15b136cad06f38ea7314fa52acc9a7f01fcb7e7d743a" Nov 21 12:18:29 crc kubenswrapper[4769]: I1121 12:18:29.509151 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-xgqqh" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007113 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xc6dz"] Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007486 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8363122f-b7e7-4872-b1c6-5043306562aa" containerName="keystone-db-sync" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007499 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8363122f-b7e7-4872-b1c6-5043306562aa" containerName="keystone-db-sync" Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007514 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="091f9579-b673-4163-bead-5d48a37f37b0" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007520 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="091f9579-b673-4163-bead-5d48a37f37b0" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007535 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30cb53e2-204b-4d6b-839a-072f30cd479d" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007541 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30cb53e2-204b-4d6b-839a-072f30cd479d" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007554 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6314295-c402-4f64-bc4a-4c5f00816c25" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007560 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6314295-c402-4f64-bc4a-4c5f00816c25" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007569 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed59396d-c7fc-4cc1-9092-3aa037cf0a70" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007575 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed59396d-c7fc-4cc1-9092-3aa037cf0a70" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007585 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f68bcd4c-d3d9-4bdb-8328-745682033ab4" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007593 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f68bcd4c-d3d9-4bdb-8328-745682033ab4" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: E1121 12:18:30.007616 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51b6ab2f-2185-4d33-987e-a3781685174d" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007622 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b6ab2f-2185-4d33-987e-a3781685174d" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007784 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed59396d-c7fc-4cc1-9092-3aa037cf0a70" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007801 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51b6ab2f-2185-4d33-987e-a3781685174d" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007811 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30cb53e2-204b-4d6b-839a-072f30cd479d" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007822 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8363122f-b7e7-4872-b1c6-5043306562aa" containerName="keystone-db-sync" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007838 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6314295-c402-4f64-bc4a-4c5f00816c25" containerName="mariadb-database-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007850 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f68bcd4c-d3d9-4bdb-8328-745682033ab4" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.007857 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="091f9579-b673-4163-bead-5d48a37f37b0" containerName="mariadb-account-create" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.008420 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.011923 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.012055 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.012259 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.012365 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.012382 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-xbm47" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.024505 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xc6dz"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.063503 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-credential-keys\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.063550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-combined-ca-bundle\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.063612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-fernet-keys\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.063645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-scripts\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.063668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-config-data\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.063732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8v4\" (UniqueName: \"kubernetes.io/projected/cd819a1c-a33c-4e75-9212-cd43441da6a4-kube-api-access-zl8v4\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.077612 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.079288 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.088786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.088877 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.089010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-k5pvr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.089037 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.089441 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.163612 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8v4\" (UniqueName: \"kubernetes.io/projected/cd819a1c-a33c-4e75-9212-cd43441da6a4-kube-api-access-zl8v4\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-credential-keys\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-combined-ca-bundle\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-scripts\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-logs\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-fernet-keys\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-scripts\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-config-data\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkj6\" (UniqueName: \"kubernetes.io/projected/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-kube-api-access-4wkj6\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.165530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-config-data\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.173352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-scripts\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.177040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-fernet-keys\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.178087 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.179542 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-config-data\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.181105 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.181227 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.181362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-credential-keys\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.199007 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.202720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-combined-ca-bundle\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.208550 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8v4\" (UniqueName: \"kubernetes.io/projected/cd819a1c-a33c-4e75-9212-cd43441da6a4-kube-api-access-zl8v4\") pod \"keystone-bootstrap-xc6dz\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-logs\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkj6\" (UniqueName: \"kubernetes.io/projected/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-kube-api-access-4wkj6\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-config-data\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7gw\" (UniqueName: \"kubernetes.io/projected/1e13adac-f934-44c2-a244-cddbeb3681dd-kube-api-access-2n7gw\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-scripts\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-logs\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.268839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.269471 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.282922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.285554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-logs\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.290380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.297450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.306328 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.309651 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.309834 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.320872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-scripts\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.333354 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.333522 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.342133 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-8rgdr"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.343909 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.344225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-config-data\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.359086 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.359439 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.360229 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-xssp9" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.360262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkj6\" (UniqueName: \"kubernetes.io/projected/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-kube-api-access-4wkj6\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.360709 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-db-sync-config-data\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-config-data\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7gw\" (UniqueName: \"kubernetes.io/projected/1e13adac-f934-44c2-a244-cddbeb3681dd-kube-api-access-2n7gw\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ffcf5779-da4d-4295-bdcc-2fcf48673978-etc-machine-id\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.370985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxwt5\" (UniqueName: \"kubernetes.io/projected/ffcf5779-da4d-4295-bdcc-2fcf48673978-kube-api-access-rxwt5\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371146 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqt8n\" (UniqueName: \"kubernetes.io/projected/3332f75b-195e-49d8-9e72-2b286287e0fc-kube-api-access-fqt8n\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-combined-ca-bundle\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-log-httpd\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-config-data\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-logs\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-scripts\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-run-httpd\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.371877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-scripts\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.372603 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.373014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.373246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-logs\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.379242 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zkqsm"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.380603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.386099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.388680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.394342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.401598 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.403438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.403931 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.407099 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.407907 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-mkvtt" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.410024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7gw\" (UniqueName: \"kubernetes.io/projected/1e13adac-f934-44c2-a244-cddbeb3681dd-kube-api-access-2n7gw\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.411112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.431670 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xmmrp"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.434631 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.438527 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-lg8h6" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.441773 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.448714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.476347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-combined-ca-bundle\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.476883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ffcf5779-da4d-4295-bdcc-2fcf48673978-etc-machine-id\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.476935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbq4m\" (UniqueName: \"kubernetes.io/projected/6fed44fa-821f-4930-81d2-d9f5e292a812-kube-api-access-dbq4m\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.476994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rxwt5\" (UniqueName: \"kubernetes.io/projected/ffcf5779-da4d-4295-bdcc-2fcf48673978-kube-api-access-rxwt5\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fqt8n\" (UniqueName: \"kubernetes.io/projected/3332f75b-195e-49d8-9e72-2b286287e0fc-kube-api-access-fqt8n\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqr5n\" (UniqueName: \"kubernetes.io/projected/124349fc-6922-4ef6-a2bb-b04a55629efb-kube-api-access-sqr5n\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-combined-ca-bundle\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-combined-ca-bundle\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-log-httpd\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-config-data\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-scripts\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-scripts\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-run-httpd\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-scripts\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-db-sync-config-data\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124349fc-6922-4ef6-a2bb-b04a55629efb-logs\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-db-sync-config-data\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-config-data\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.477761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-config-data\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.485395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ffcf5779-da4d-4295-bdcc-2fcf48673978-etc-machine-id\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.486934 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-run-httpd\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.490396 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.492067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-log-httpd\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.499963 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-8rgdr"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.512819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-config-data\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.512870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-scripts\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.517256 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.517594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-db-sync-config-data\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.518499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-combined-ca-bundle\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.519514 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-scripts\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.520531 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-config-data\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.522871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.552362 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-rc6kw"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.556007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqt8n\" (UniqueName: \"kubernetes.io/projected/3332f75b-195e-49d8-9e72-2b286287e0fc-kube-api-access-fqt8n\") pod \"ceilometer-0\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.559394 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.572936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxwt5\" (UniqueName: \"kubernetes.io/projected/ffcf5779-da4d-4295-bdcc-2fcf48673978-kube-api-access-rxwt5\") pod \"cinder-db-sync-8rgdr\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124349fc-6922-4ef6-a2bb-b04a55629efb-logs\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-combined-ca-bundle\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-config-data\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-combined-ca-bundle\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dbq4m\" (UniqueName: \"kubernetes.io/projected/6fed44fa-821f-4930-81d2-d9f5e292a812-kube-api-access-dbq4m\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sqr5n\" (UniqueName: \"kubernetes.io/projected/124349fc-6922-4ef6-a2bb-b04a55629efb-kube-api-access-sqr5n\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-config\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-combined-ca-bundle\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-scripts\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-db-sync-config-data\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.581575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dz5s\" (UniqueName: \"kubernetes.io/projected/f8890bca-a107-49c7-88c8-1c45c80ed6ba-kube-api-access-7dz5s\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.582104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124349fc-6922-4ef6-a2bb-b04a55629efb-logs\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.582721 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.582970 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-tbhlf" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.583603 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.601713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zkqsm"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.617580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.628741 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xmmrp"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.637138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-rc6kw"] Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.637938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-scripts\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.639539 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbq4m\" (UniqueName: \"kubernetes.io/projected/6fed44fa-821f-4930-81d2-d9f5e292a812-kube-api-access-dbq4m\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.661937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-combined-ca-bundle\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.662657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-combined-ca-bundle\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.663708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-config-data\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.666787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-db-sync-config-data\") pod \"barbican-db-sync-xmmrp\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.676853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqr5n\" (UniqueName: \"kubernetes.io/projected/124349fc-6922-4ef6-a2bb-b04a55629efb-kube-api-access-sqr5n\") pod \"placement-db-sync-zkqsm\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.687568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-config\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.687903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7dz5s\" (UniqueName: \"kubernetes.io/projected/f8890bca-a107-49c7-88c8-1c45c80ed6ba-kube-api-access-7dz5s\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.688059 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-combined-ca-bundle\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.725098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-config\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.721798 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.720333 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.727037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dz5s\" (UniqueName: \"kubernetes.io/projected/f8890bca-a107-49c7-88c8-1c45c80ed6ba-kube-api-access-7dz5s\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.762541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-combined-ca-bundle\") pod \"neutron-db-sync-rc6kw\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:30 crc kubenswrapper[4769]: I1121 12:18:30.853529 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.055233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.263634 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xc6dz"] Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.311386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.359985 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-8rgdr"] Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.397277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:31 crc kubenswrapper[4769]: W1121 12:18:31.416831 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e13adac_f934_44c2_a244_cddbeb3681dd.slice/crio-6a77c519a53d46e59de78cb9d3f70180ee972c1b61fd5fa3384db72845fa8a66 WatchSource:0}: Error finding container 6a77c519a53d46e59de78cb9d3f70180ee972c1b61fd5fa3384db72845fa8a66: Status 404 returned error can't find the container with id 6a77c519a53d46e59de78cb9d3f70180ee972c1b61fd5fa3384db72845fa8a66 Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.471884 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zkqsm"] Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.587556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a8bf0cb3-3de0-4060-bc44-e253e58c2b49","Type":"ContainerStarted","Data":"e9cce50ef6fa30937b760a2dbf262848806d279c20eed9f553f7c4e400e25705"} Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.590500 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xmmrp"] Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.591081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1e13adac-f934-44c2-a244-cddbeb3681dd","Type":"ContainerStarted","Data":"6a77c519a53d46e59de78cb9d3f70180ee972c1b61fd5fa3384db72845fa8a66"} Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.596604 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.601444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" event={"ID":"cd819a1c-a33c-4e75-9212-cd43441da6a4","Type":"ContainerStarted","Data":"6ecdb1e2e74feaade24ae1ab91feef8c793385d4dfdbff558749ea54cc56d960"} Nov 21 12:18:31 crc kubenswrapper[4769]: W1121 12:18:31.605859 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3332f75b_195e_49d8_9e72_2b286287e0fc.slice/crio-e85c188d7ead4d751a91134b7116157eaab09a733a4b1525b55abf410387993c WatchSource:0}: Error finding container e85c188d7ead4d751a91134b7116157eaab09a733a4b1525b55abf410387993c: Status 404 returned error can't find the container with id e85c188d7ead4d751a91134b7116157eaab09a733a4b1525b55abf410387993c Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.606146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" event={"ID":"124349fc-6922-4ef6-a2bb-b04a55629efb","Type":"ContainerStarted","Data":"4d281dac0cb3a9a687b1009463693878c086ab5ee7232d9da00d54977ccae939"} Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.609037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" event={"ID":"ffcf5779-da4d-4295-bdcc-2fcf48673978","Type":"ContainerStarted","Data":"9bdd4b767e90434ea71ab36ad46ac9d884862fae9bbb38cf93dfa3632e19396a"} Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.627991 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:18:31 crc kubenswrapper[4769]: I1121 12:18:31.690563 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-rc6kw"] Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.273762 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:18:32 crc kubenswrapper[4769]: E1121 12:18:32.274441 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.634421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" event={"ID":"ffcf5779-da4d-4295-bdcc-2fcf48673978","Type":"ContainerStarted","Data":"da319b2d7bcf1fb896b1234658ec9b28d815afeada13d809e4e75ad3ca847e31"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.641448 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" event={"ID":"6fed44fa-821f-4930-81d2-d9f5e292a812","Type":"ContainerStarted","Data":"accc916eff7a5ed4b0068af094fe0c19b28c17137eaa19ea932c092b620c01ef"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.641491 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" event={"ID":"6fed44fa-821f-4930-81d2-d9f5e292a812","Type":"ContainerStarted","Data":"1180392bc640fb7978987b8d1243c8418478b783a349d5a814aa9e3a0d47dd5c"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.651406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a8bf0cb3-3de0-4060-bc44-e253e58c2b49","Type":"ContainerStarted","Data":"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.673835 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" podStartSLOduration=2.673816908 podStartE2EDuration="2.673816908s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:32.67280583 +0000 UTC m=+1671.373467648" watchObservedRunningTime="2025-11-21 12:18:32.673816908 +0000 UTC m=+1671.374478726" Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.698575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerStarted","Data":"4b051b24cedf1a9b1a29d205e9b9320385cef8766bc3250e024b74fb54be6bac"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.698649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerStarted","Data":"e85c188d7ead4d751a91134b7116157eaab09a733a4b1525b55abf410387993c"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.698834 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" podStartSLOduration=2.6988120159999998 podStartE2EDuration="2.698812016s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:32.694985982 +0000 UTC m=+1671.395647800" watchObservedRunningTime="2025-11-21 12:18:32.698812016 +0000 UTC m=+1671.399473834" Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.725084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" event={"ID":"f8890bca-a107-49c7-88c8-1c45c80ed6ba","Type":"ContainerStarted","Data":"eac624f17c35a3f59d0359329e01e82b27282310e873f664c1484cee268ee4d1"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.725486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" event={"ID":"f8890bca-a107-49c7-88c8-1c45c80ed6ba","Type":"ContainerStarted","Data":"9bfa66ad0d21984a15fa7c343a80d923de2fa4364af1253e9001b93e304267b5"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.732544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1e13adac-f934-44c2-a244-cddbeb3681dd","Type":"ContainerStarted","Data":"eebc04c5693d0297004a0c68d6014e76b86053645a44761b85530325a208ac59"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.756645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" event={"ID":"cd819a1c-a33c-4e75-9212-cd43441da6a4","Type":"ContainerStarted","Data":"92abd3dbb7a4bf7424ae91a3f374a0143b00a39f6df1ffae5b810acc78c778b8"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.762324 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" podStartSLOduration=2.762294699 podStartE2EDuration="2.762294699s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:32.752610306 +0000 UTC m=+1671.453272124" watchObservedRunningTime="2025-11-21 12:18:32.762294699 +0000 UTC m=+1671.462956517" Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.768669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" event={"ID":"124349fc-6922-4ef6-a2bb-b04a55629efb","Type":"ContainerStarted","Data":"449731f678dec43df71983f5fee5bc97e33ecad0153fdfa92a843b3d8cbbb3f7"} Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.797756 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" podStartSLOduration=3.79772125 podStartE2EDuration="3.79772125s" podCreationTimestamp="2025-11-21 12:18:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:32.788947682 +0000 UTC m=+1671.489609520" watchObservedRunningTime="2025-11-21 12:18:32.79772125 +0000 UTC m=+1671.498383068" Nov 21 12:18:32 crc kubenswrapper[4769]: I1121 12:18:32.821600 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" podStartSLOduration=2.821571167 podStartE2EDuration="2.821571167s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:32.814973858 +0000 UTC m=+1671.515635676" watchObservedRunningTime="2025-11-21 12:18:32.821571167 +0000 UTC m=+1671.522232985" Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.832232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerStarted","Data":"472b7d08f97921bb6347c88f25ae884a2ba2f67e2d1283b7bbd65134c733859b"} Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.850588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1e13adac-f934-44c2-a244-cddbeb3681dd","Type":"ContainerStarted","Data":"c9f04c3f21b740afda7ca77308feaa8518d0ce1efef5cbfc9c552337c955f0d7"} Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.863527 4769 generic.go:334] "Generic (PLEG): container finished" podID="124349fc-6922-4ef6-a2bb-b04a55629efb" containerID="449731f678dec43df71983f5fee5bc97e33ecad0153fdfa92a843b3d8cbbb3f7" exitCode=0 Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.863775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" event={"ID":"124349fc-6922-4ef6-a2bb-b04a55629efb","Type":"ContainerDied","Data":"449731f678dec43df71983f5fee5bc97e33ecad0153fdfa92a843b3d8cbbb3f7"} Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.866764 4769 generic.go:334] "Generic (PLEG): container finished" podID="6fed44fa-821f-4930-81d2-d9f5e292a812" containerID="accc916eff7a5ed4b0068af094fe0c19b28c17137eaa19ea932c092b620c01ef" exitCode=0 Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.866849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" event={"ID":"6fed44fa-821f-4930-81d2-d9f5e292a812","Type":"ContainerDied","Data":"accc916eff7a5ed4b0068af094fe0c19b28c17137eaa19ea932c092b620c01ef"} Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.872598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a8bf0cb3-3de0-4060-bc44-e253e58c2b49","Type":"ContainerStarted","Data":"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d"} Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.887839 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.887793247 podStartE2EDuration="3.887793247s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:33.875996736 +0000 UTC m=+1672.576658554" watchObservedRunningTime="2025-11-21 12:18:33.887793247 +0000 UTC m=+1672.588455065" Nov 21 12:18:33 crc kubenswrapper[4769]: I1121 12:18:33.928697 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.928665695 podStartE2EDuration="3.928665695s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:33.916215738 +0000 UTC m=+1672.616877576" watchObservedRunningTime="2025-11-21 12:18:33.928665695 +0000 UTC m=+1672.629327503" Nov 21 12:18:34 crc kubenswrapper[4769]: I1121 12:18:34.234985 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:18:34 crc kubenswrapper[4769]: I1121 12:18:34.281988 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:34 crc kubenswrapper[4769]: I1121 12:18:34.334983 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:34 crc kubenswrapper[4769]: I1121 12:18:34.890785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerStarted","Data":"281f0bf49a7900aa08f3910a44ec60af39321043ceb04caac9afc5f787829e28"} Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.349090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.359143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.430983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-combined-ca-bundle\") pod \"124349fc-6922-4ef6-a2bb-b04a55629efb\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.431169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-config-data\") pod \"124349fc-6922-4ef6-a2bb-b04a55629efb\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.431346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-scripts\") pod \"124349fc-6922-4ef6-a2bb-b04a55629efb\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.431555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbq4m\" (UniqueName: \"kubernetes.io/projected/6fed44fa-821f-4930-81d2-d9f5e292a812-kube-api-access-dbq4m\") pod \"6fed44fa-821f-4930-81d2-d9f5e292a812\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.431684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-combined-ca-bundle\") pod \"6fed44fa-821f-4930-81d2-d9f5e292a812\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.431810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqr5n\" (UniqueName: \"kubernetes.io/projected/124349fc-6922-4ef6-a2bb-b04a55629efb-kube-api-access-sqr5n\") pod \"124349fc-6922-4ef6-a2bb-b04a55629efb\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.431945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-db-sync-config-data\") pod \"6fed44fa-821f-4930-81d2-d9f5e292a812\" (UID: \"6fed44fa-821f-4930-81d2-d9f5e292a812\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.432226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124349fc-6922-4ef6-a2bb-b04a55629efb-logs\") pod \"124349fc-6922-4ef6-a2bb-b04a55629efb\" (UID: \"124349fc-6922-4ef6-a2bb-b04a55629efb\") " Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.433030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124349fc-6922-4ef6-a2bb-b04a55629efb-logs" (OuterVolumeSpecName: "logs") pod "124349fc-6922-4ef6-a2bb-b04a55629efb" (UID: "124349fc-6922-4ef6-a2bb-b04a55629efb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.449624 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124349fc-6922-4ef6-a2bb-b04a55629efb-kube-api-access-sqr5n" (OuterVolumeSpecName: "kube-api-access-sqr5n") pod "124349fc-6922-4ef6-a2bb-b04a55629efb" (UID: "124349fc-6922-4ef6-a2bb-b04a55629efb"). InnerVolumeSpecName "kube-api-access-sqr5n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.451010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-scripts" (OuterVolumeSpecName: "scripts") pod "124349fc-6922-4ef6-a2bb-b04a55629efb" (UID: "124349fc-6922-4ef6-a2bb-b04a55629efb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.452485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fed44fa-821f-4930-81d2-d9f5e292a812-kube-api-access-dbq4m" (OuterVolumeSpecName: "kube-api-access-dbq4m") pod "6fed44fa-821f-4930-81d2-d9f5e292a812" (UID: "6fed44fa-821f-4930-81d2-d9f5e292a812"). InnerVolumeSpecName "kube-api-access-dbq4m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.461555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "6fed44fa-821f-4930-81d2-d9f5e292a812" (UID: "6fed44fa-821f-4930-81d2-d9f5e292a812"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.475710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "124349fc-6922-4ef6-a2bb-b04a55629efb" (UID: "124349fc-6922-4ef6-a2bb-b04a55629efb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.481003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-config-data" (OuterVolumeSpecName: "config-data") pod "124349fc-6922-4ef6-a2bb-b04a55629efb" (UID: "124349fc-6922-4ef6-a2bb-b04a55629efb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.483314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6fed44fa-821f-4930-81d2-d9f5e292a812" (UID: "6fed44fa-821f-4930-81d2-d9f5e292a812"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535432 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535603 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dbq4m\" (UniqueName: \"kubernetes.io/projected/6fed44fa-821f-4930-81d2-d9f5e292a812-kube-api-access-dbq4m\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535650 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535663 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sqr5n\" (UniqueName: \"kubernetes.io/projected/124349fc-6922-4ef6-a2bb-b04a55629efb-kube-api-access-sqr5n\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535677 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/6fed44fa-821f-4930-81d2-d9f5e292a812-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535720 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124349fc-6922-4ef6-a2bb-b04a55629efb-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535738 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.535750 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124349fc-6922-4ef6-a2bb-b04a55629efb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.904999 4769 generic.go:334] "Generic (PLEG): container finished" podID="ffcf5779-da4d-4295-bdcc-2fcf48673978" containerID="da319b2d7bcf1fb896b1234658ec9b28d815afeada13d809e4e75ad3ca847e31" exitCode=0 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.905343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" event={"ID":"ffcf5779-da4d-4295-bdcc-2fcf48673978","Type":"ContainerDied","Data":"da319b2d7bcf1fb896b1234658ec9b28d815afeada13d809e4e75ad3ca847e31"} Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.908490 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.908485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-xmmrp" event={"ID":"6fed44fa-821f-4930-81d2-d9f5e292a812","Type":"ContainerDied","Data":"1180392bc640fb7978987b8d1243c8418478b783a349d5a814aa9e3a0d47dd5c"} Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.908788 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1180392bc640fb7978987b8d1243c8418478b783a349d5a814aa9e3a0d47dd5c" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.911831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerStarted","Data":"7689f104d041a1ecaf64d62fe9a267b0023a8a69853db24440d9169c5cac6344"} Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.912081 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-central-agent" containerID="cri-o://4b051b24cedf1a9b1a29d205e9b9320385cef8766bc3250e024b74fb54be6bac" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.930157 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="proxy-httpd" containerID="cri-o://7689f104d041a1ecaf64d62fe9a267b0023a8a69853db24440d9169c5cac6344" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.930439 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="sg-core" containerID="cri-o://281f0bf49a7900aa08f3910a44ec60af39321043ceb04caac9afc5f787829e28" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.930428 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.930475 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-notification-agent" containerID="cri-o://472b7d08f97921bb6347c88f25ae884a2ba2f67e2d1283b7bbd65134c733859b" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.949048 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd819a1c-a33c-4e75-9212-cd43441da6a4" containerID="92abd3dbb7a4bf7424ae91a3f374a0143b00a39f6df1ffae5b810acc78c778b8" exitCode=0 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.949271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" event={"ID":"cd819a1c-a33c-4e75-9212-cd43441da6a4","Type":"ContainerDied","Data":"92abd3dbb7a4bf7424ae91a3f374a0143b00a39f6df1ffae5b810acc78c778b8"} Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.959671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" event={"ID":"124349fc-6922-4ef6-a2bb-b04a55629efb","Type":"ContainerDied","Data":"4d281dac0cb3a9a687b1009463693878c086ab5ee7232d9da00d54977ccae939"} Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.959724 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-zkqsm" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.959742 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d281dac0cb3a9a687b1009463693878c086ab5ee7232d9da00d54977ccae939" Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.960072 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-log" containerID="cri-o://d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.960268 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-httpd" containerID="cri-o://41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.960446 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-log" containerID="cri-o://eebc04c5693d0297004a0c68d6014e76b86053645a44761b85530325a208ac59" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.960630 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-httpd" containerID="cri-o://c9f04c3f21b740afda7ca77308feaa8518d0ce1efef5cbfc9c552337c955f0d7" gracePeriod=30 Nov 21 12:18:35 crc kubenswrapper[4769]: I1121 12:18:35.997995 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.266554937 podStartE2EDuration="5.997965483s" podCreationTimestamp="2025-11-21 12:18:30 +0000 UTC" firstStartedPulling="2025-11-21 12:18:31.627714863 +0000 UTC m=+1670.328376681" lastFinishedPulling="2025-11-21 12:18:35.359125409 +0000 UTC m=+1674.059787227" observedRunningTime="2025-11-21 12:18:35.966923901 +0000 UTC m=+1674.667585719" watchObservedRunningTime="2025-11-21 12:18:35.997965483 +0000 UTC m=+1674.698627301" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.151294 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz"] Nov 21 12:18:36 crc kubenswrapper[4769]: E1121 12:18:36.151741 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6fed44fa-821f-4930-81d2-d9f5e292a812" containerName="barbican-db-sync" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.151753 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fed44fa-821f-4930-81d2-d9f5e292a812" containerName="barbican-db-sync" Nov 21 12:18:36 crc kubenswrapper[4769]: E1121 12:18:36.151798 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="124349fc-6922-4ef6-a2bb-b04a55629efb" containerName="placement-db-sync" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.151805 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="124349fc-6922-4ef6-a2bb-b04a55629efb" containerName="placement-db-sync" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.151991 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="124349fc-6922-4ef6-a2bb-b04a55629efb" containerName="placement-db-sync" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.152006 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6fed44fa-821f-4930-81d2-d9f5e292a812" containerName="barbican-db-sync" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.157547 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.159678 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.160118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-mkvtt" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.160491 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.200295 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.201738 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.206297 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.206555 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.206681 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-lg8h6" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.216025 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.224731 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.226323 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.230581 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.256574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.261360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-logs\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.261461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5btfk\" (UniqueName: \"kubernetes.io/projected/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-kube-api-access-5btfk\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.261491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-combined-ca-bundle\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.261538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-scripts\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.261570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-config-data\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.278591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.292596 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-597868688-sdklb"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.294566 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.297147 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.300119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-597868688-sdklb"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.363677 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.363789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-config-data\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.363843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-logs\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.363891 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.363920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdxd4\" (UniqueName: \"kubernetes.io/projected/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-kube-api-access-xdxd4\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.363983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-logs\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364086 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-combined-ca-bundle\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5btfk\" (UniqueName: \"kubernetes.io/projected/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-kube-api-access-5btfk\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-combined-ca-bundle\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-486t7\" (UniqueName: \"kubernetes.io/projected/cd70ab0b-1d92-4c16-9be4-261b4773d364-kube-api-access-486t7\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data-custom\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data-custom\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd70ab0b-1d92-4c16-9be4-261b4773d364-logs\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.364463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-scripts\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.365450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-logs\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.371105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-scripts\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.371697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-config-data\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.390992 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5btfk\" (UniqueName: \"kubernetes.io/projected/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-kube-api-access-5btfk\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.410352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-combined-ca-bundle\") pod \"placement-57f9d5bb7d-v8tcz\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxd4\" (UniqueName: \"kubernetes.io/projected/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-kube-api-access-xdxd4\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-logs\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-combined-ca-bundle\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grzpn\" (UniqueName: \"kubernetes.io/projected/29ec12f2-a8ed-410d-a01d-4f8674db59d5-kube-api-access-grzpn\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-486t7\" (UniqueName: \"kubernetes.io/projected/cd70ab0b-1d92-4c16-9be4-261b4773d364-kube-api-access-486t7\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466381 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data-custom\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data-custom\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-combined-ca-bundle\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd70ab0b-1d92-4c16-9be4-261b4773d364-logs\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data-custom\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ec12f2-a8ed-410d-a01d-4f8674db59d5-logs\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.466666 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.467914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-logs\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.471836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-combined-ca-bundle\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.472330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.472584 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data-custom\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.473539 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd70ab0b-1d92-4c16-9be4-261b4773d364-logs\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.473813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.474119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data-custom\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.477957 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.492920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdxd4\" (UniqueName: \"kubernetes.io/projected/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-kube-api-access-xdxd4\") pod \"barbican-worker-598f7cbdbf-b26vf\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.493351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-486t7\" (UniqueName: \"kubernetes.io/projected/cd70ab0b-1d92-4c16-9be4-261b4773d364-kube-api-access-486t7\") pod \"barbican-keystone-listener-584c67dfc6-kntvc\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.503256 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.568497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-grzpn\" (UniqueName: \"kubernetes.io/projected/29ec12f2-a8ed-410d-a01d-4f8674db59d5-kube-api-access-grzpn\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.568589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-combined-ca-bundle\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.568623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.568691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data-custom\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.568724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ec12f2-a8ed-410d-a01d-4f8674db59d5-logs\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.569303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ec12f2-a8ed-410d-a01d-4f8674db59d5-logs\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.581323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data-custom\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.584471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.585124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-combined-ca-bundle\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.590055 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-grzpn\" (UniqueName: \"kubernetes.io/projected/29ec12f2-a8ed-410d-a01d-4f8674db59d5-kube-api-access-grzpn\") pod \"barbican-api-597868688-sdklb\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.614081 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.629851 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.660877 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.849734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.937690 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5f6f5bfd-47vgz"] Nov 21 12:18:36 crc kubenswrapper[4769]: E1121 12:18:36.944595 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-log" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.944629 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-log" Nov 21 12:18:36 crc kubenswrapper[4769]: E1121 12:18:36.944642 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-httpd" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.944648 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-httpd" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.944799 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-log" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.944829 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerName="glance-httpd" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.946970 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.951386 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.953872 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.962581 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5f6f5bfd-47vgz"] Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-scripts\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-logs\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-config-data\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975777 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-httpd-run\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975873 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-combined-ca-bundle\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wkj6\" (UniqueName: \"kubernetes.io/projected/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-kube-api-access-4wkj6\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.975957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-public-tls-certs\") pod \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\" (UID: \"a8bf0cb3-3de0-4060-bc44-e253e58c2b49\") " Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.979136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-logs" (OuterVolumeSpecName: "logs") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.981773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:36 crc kubenswrapper[4769]: I1121 12:18:36.992551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-scripts" (OuterVolumeSpecName: "scripts") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.001895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-kube-api-access-4wkj6" (OuterVolumeSpecName: "kube-api-access-4wkj6") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "kube-api-access-4wkj6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.010071 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerID="c9f04c3f21b740afda7ca77308feaa8518d0ce1efef5cbfc9c552337c955f0d7" exitCode=0 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.010105 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerID="eebc04c5693d0297004a0c68d6014e76b86053645a44761b85530325a208ac59" exitCode=143 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.010115 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1e13adac-f934-44c2-a244-cddbeb3681dd","Type":"ContainerDied","Data":"c9f04c3f21b740afda7ca77308feaa8518d0ce1efef5cbfc9c552337c955f0d7"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.010227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1e13adac-f934-44c2-a244-cddbeb3681dd","Type":"ContainerDied","Data":"eebc04c5693d0297004a0c68d6014e76b86053645a44761b85530325a208ac59"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.010658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015587 4769 generic.go:334] "Generic (PLEG): container finished" podID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerID="41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d" exitCode=0 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015618 4769 generic.go:334] "Generic (PLEG): container finished" podID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" containerID="d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f" exitCode=143 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a8bf0cb3-3de0-4060-bc44-e253e58c2b49","Type":"ContainerDied","Data":"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a8bf0cb3-3de0-4060-bc44-e253e58c2b49","Type":"ContainerDied","Data":"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a8bf0cb3-3de0-4060-bc44-e253e58c2b49","Type":"ContainerDied","Data":"e9cce50ef6fa30937b760a2dbf262848806d279c20eed9f553f7c4e400e25705"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015719 4769 scope.go:117] "RemoveContainer" containerID="41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.015844 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.021267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025661 4769 generic.go:334] "Generic (PLEG): container finished" podID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerID="7689f104d041a1ecaf64d62fe9a267b0023a8a69853db24440d9169c5cac6344" exitCode=0 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025715 4769 generic.go:334] "Generic (PLEG): container finished" podID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerID="281f0bf49a7900aa08f3910a44ec60af39321043ceb04caac9afc5f787829e28" exitCode=2 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025727 4769 generic.go:334] "Generic (PLEG): container finished" podID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerID="472b7d08f97921bb6347c88f25ae884a2ba2f67e2d1283b7bbd65134c733859b" exitCode=0 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025736 4769 generic.go:334] "Generic (PLEG): container finished" podID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerID="4b051b24cedf1a9b1a29d205e9b9320385cef8766bc3250e024b74fb54be6bac" exitCode=0 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerDied","Data":"7689f104d041a1ecaf64d62fe9a267b0023a8a69853db24440d9169c5cac6344"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerDied","Data":"281f0bf49a7900aa08f3910a44ec60af39321043ceb04caac9afc5f787829e28"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerDied","Data":"472b7d08f97921bb6347c88f25ae884a2ba2f67e2d1283b7bbd65134c733859b"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.025907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerDied","Data":"4b051b24cedf1a9b1a29d205e9b9320385cef8766bc3250e024b74fb54be6bac"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.049970 4769 generic.go:334] "Generic (PLEG): container finished" podID="f8890bca-a107-49c7-88c8-1c45c80ed6ba" containerID="eac624f17c35a3f59d0359329e01e82b27282310e873f664c1484cee268ee4d1" exitCode=0 Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.050472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" event={"ID":"f8890bca-a107-49c7-88c8-1c45c80ed6ba","Type":"ContainerDied","Data":"eac624f17c35a3f59d0359329e01e82b27282310e873f664c1484cee268ee4d1"} Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.056499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.064566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-config-data\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-logs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-public-tls-certs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-internal-tls-certs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-scripts\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-combined-ca-bundle\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqgf\" (UniqueName: \"kubernetes.io/projected/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-kube-api-access-7kqgf\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082910 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082931 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.082992 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.083009 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.083021 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.083034 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.083049 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4wkj6\" (UniqueName: \"kubernetes.io/projected/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-kube-api-access-4wkj6\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.111360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-config-data" (OuterVolumeSpecName: "config-data") pod "a8bf0cb3-3de0-4060-bc44-e253e58c2b49" (UID: "a8bf0cb3-3de0-4060-bc44-e253e58c2b49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.120676 4769 scope.go:117] "RemoveContainer" containerID="d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.129040 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.168952 4769 scope.go:117] "RemoveContainer" containerID="41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d" Nov 21 12:18:37 crc kubenswrapper[4769]: E1121 12:18:37.171132 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d\": container with ID starting with 41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d not found: ID does not exist" containerID="41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.171173 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d"} err="failed to get container status \"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d\": rpc error: code = NotFound desc = could not find container \"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d\": container with ID starting with 41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d not found: ID does not exist" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.171221 4769 scope.go:117] "RemoveContainer" containerID="d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f" Nov 21 12:18:37 crc kubenswrapper[4769]: E1121 12:18:37.171453 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f\": container with ID starting with d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f not found: ID does not exist" containerID="d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.171473 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f"} err="failed to get container status \"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f\": rpc error: code = NotFound desc = could not find container \"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f\": container with ID starting with d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f not found: ID does not exist" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.171492 4769 scope.go:117] "RemoveContainer" containerID="41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.172247 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d"} err="failed to get container status \"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d\": rpc error: code = NotFound desc = could not find container \"41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d\": container with ID starting with 41ce23bc96378cbcbd234146c09a2693f21a3586a4437a3eaba4acfa05f1530d not found: ID does not exist" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.172275 4769 scope.go:117] "RemoveContainer" containerID="d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.176834 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f"} err="failed to get container status \"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f\": rpc error: code = NotFound desc = could not find container \"d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f\": container with ID starting with d4f95591e98005ef34be5d0ed6dcdc0cbe6c77a9337f035f213c1f5232dc033f not found: ID does not exist" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.193841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-scripts\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.193977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-httpd-run\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-combined-ca-bundle\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-internal-tls-certs\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n7gw\" (UniqueName: \"kubernetes.io/projected/1e13adac-f934-44c2-a244-cddbeb3681dd-kube-api-access-2n7gw\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-logs\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194405 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-config-data\") pod \"1e13adac-f934-44c2-a244-cddbeb3681dd\" (UID: \"1e13adac-f934-44c2-a244-cddbeb3681dd\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-config-data\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194940 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-logs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.194978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-public-tls-certs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-internal-tls-certs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195059 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-scripts\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-combined-ca-bundle\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195110 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqgf\" (UniqueName: \"kubernetes.io/projected/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-kube-api-access-7kqgf\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195415 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8bf0cb3-3de0-4060-bc44-e253e58c2b49-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195432 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.195997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-logs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.199408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-logs" (OuterVolumeSpecName: "logs") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.201563 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e13adac-f934-44c2-a244-cddbeb3681dd-kube-api-access-2n7gw" (OuterVolumeSpecName: "kube-api-access-2n7gw") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "kube-api-access-2n7gw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.201685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.201901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.204142 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-scripts\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.204638 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-public-tls-certs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.204809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-combined-ca-bundle\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.210394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-scripts" (OuterVolumeSpecName: "scripts") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.232986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-config-data\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.239861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-internal-tls-certs\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.251360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqgf\" (UniqueName: \"kubernetes.io/projected/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-kube-api-access-7kqgf\") pod \"placement-5f6f5bfd-47vgz\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.285464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.297394 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.297441 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.299864 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.313821 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.314841 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2n7gw\" (UniqueName: \"kubernetes.io/projected/1e13adac-f934-44c2-a244-cddbeb3681dd-kube-api-access-2n7gw\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.314861 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1e13adac-f934-44c2-a244-cddbeb3681dd-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.316296 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.342871 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.351598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-config-data" (OuterVolumeSpecName: "config-data") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.361232 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1e13adac-f934-44c2-a244-cddbeb3681dd" (UID: "1e13adac-f934-44c2-a244-cddbeb3681dd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.421883 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.421933 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e13adac-f934-44c2-a244-cddbeb3681dd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.421946 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.512467 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz"] Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.603800 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.748622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-combined-ca-bundle\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.748757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-sg-core-conf-yaml\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.748791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-log-httpd\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.748874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-config-data\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.748985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-scripts\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.749068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-run-httpd\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.749112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqt8n\" (UniqueName: \"kubernetes.io/projected/3332f75b-195e-49d8-9e72-2b286287e0fc-kube-api-access-fqt8n\") pod \"3332f75b-195e-49d8-9e72-2b286287e0fc\" (UID: \"3332f75b-195e-49d8-9e72-2b286287e0fc\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.750544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.750884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.755076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-scripts" (OuterVolumeSpecName: "scripts") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.755273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3332f75b-195e-49d8-9e72-2b286287e0fc-kube-api-access-fqt8n" (OuterVolumeSpecName: "kube-api-access-fqt8n") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "kube-api-access-fqt8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.787211 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.800288 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-597868688-sdklb"] Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.809043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc"] Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.813502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.818595 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf"] Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.852031 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ffcf5779-da4d-4295-bdcc-2fcf48673978-etc-machine-id\") pod \"ffcf5779-da4d-4295-bdcc-2fcf48673978\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-scripts\") pod \"ffcf5779-da4d-4295-bdcc-2fcf48673978\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-db-sync-config-data\") pod \"ffcf5779-da4d-4295-bdcc-2fcf48673978\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-config-data\") pod \"ffcf5779-da4d-4295-bdcc-2fcf48673978\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-combined-ca-bundle\") pod \"ffcf5779-da4d-4295-bdcc-2fcf48673978\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxwt5\" (UniqueName: \"kubernetes.io/projected/ffcf5779-da4d-4295-bdcc-2fcf48673978-kube-api-access-rxwt5\") pod \"ffcf5779-da4d-4295-bdcc-2fcf48673978\" (UID: \"ffcf5779-da4d-4295-bdcc-2fcf48673978\") " Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854873 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854889 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854898 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854907 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3332f75b-195e-49d8-9e72-2b286287e0fc-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.854915 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fqt8n\" (UniqueName: \"kubernetes.io/projected/3332f75b-195e-49d8-9e72-2b286287e0fc-kube-api-access-fqt8n\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.860334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ffcf5779-da4d-4295-bdcc-2fcf48673978-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ffcf5779-da4d-4295-bdcc-2fcf48673978" (UID: "ffcf5779-da4d-4295-bdcc-2fcf48673978"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.886363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "ffcf5779-da4d-4295-bdcc-2fcf48673978" (UID: "ffcf5779-da4d-4295-bdcc-2fcf48673978"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.893716 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcf5779-da4d-4295-bdcc-2fcf48673978-kube-api-access-rxwt5" (OuterVolumeSpecName: "kube-api-access-rxwt5") pod "ffcf5779-da4d-4295-bdcc-2fcf48673978" (UID: "ffcf5779-da4d-4295-bdcc-2fcf48673978"). InnerVolumeSpecName "kube-api-access-rxwt5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.912421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-scripts" (OuterVolumeSpecName: "scripts") pod "ffcf5779-da4d-4295-bdcc-2fcf48673978" (UID: "ffcf5779-da4d-4295-bdcc-2fcf48673978"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.956309 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ffcf5779-da4d-4295-bdcc-2fcf48673978-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.956340 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.956357 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.956369 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rxwt5\" (UniqueName: \"kubernetes.io/projected/ffcf5779-da4d-4295-bdcc-2fcf48673978-kube-api-access-rxwt5\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:37 crc kubenswrapper[4769]: I1121 12:18:37.990441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ffcf5779-da4d-4295-bdcc-2fcf48673978" (UID: "ffcf5779-da4d-4295-bdcc-2fcf48673978"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.035268 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-config-data" (OuterVolumeSpecName: "config-data") pod "ffcf5779-da4d-4295-bdcc-2fcf48673978" (UID: "ffcf5779-da4d-4295-bdcc-2fcf48673978"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.080168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-scripts\") pod \"cd819a1c-a33c-4e75-9212-cd43441da6a4\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.080344 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-fernet-keys\") pod \"cd819a1c-a33c-4e75-9212-cd43441da6a4\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.080387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-credential-keys\") pod \"cd819a1c-a33c-4e75-9212-cd43441da6a4\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.080481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-combined-ca-bundle\") pod \"cd819a1c-a33c-4e75-9212-cd43441da6a4\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.080524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-config-data\") pod \"cd819a1c-a33c-4e75-9212-cd43441da6a4\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.080586 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl8v4\" (UniqueName: \"kubernetes.io/projected/cd819a1c-a33c-4e75-9212-cd43441da6a4-kube-api-access-zl8v4\") pod \"cd819a1c-a33c-4e75-9212-cd43441da6a4\" (UID: \"cd819a1c-a33c-4e75-9212-cd43441da6a4\") " Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.081073 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.081097 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffcf5779-da4d-4295-bdcc-2fcf48673978-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.124439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" event={"ID":"cd70ab0b-1d92-4c16-9be4-261b4773d364","Type":"ContainerStarted","Data":"2138b4d20c70aba0d425e809ab0f2ec8dabd64977511c99ccc7953fd42b47bc5"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.136683 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-scripts" (OuterVolumeSpecName: "scripts") pod "cd819a1c-a33c-4e75-9212-cd43441da6a4" (UID: "cd819a1c-a33c-4e75-9212-cd43441da6a4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.141364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "cd819a1c-a33c-4e75-9212-cd43441da6a4" (UID: "cd819a1c-a33c-4e75-9212-cd43441da6a4"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.147564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "cd819a1c-a33c-4e75-9212-cd43441da6a4" (UID: "cd819a1c-a33c-4e75-9212-cd43441da6a4"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.148375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-config-data" (OuterVolumeSpecName: "config-data") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.152616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd819a1c-a33c-4e75-9212-cd43441da6a4-kube-api-access-zl8v4" (OuterVolumeSpecName: "kube-api-access-zl8v4") pod "cd819a1c-a33c-4e75-9212-cd43441da6a4" (UID: "cd819a1c-a33c-4e75-9212-cd43441da6a4"). InnerVolumeSpecName "kube-api-access-zl8v4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.162813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3332f75b-195e-49d8-9e72-2b286287e0fc","Type":"ContainerDied","Data":"e85c188d7ead4d751a91134b7116157eaab09a733a4b1525b55abf410387993c"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.162887 4769 scope.go:117] "RemoveContainer" containerID="7689f104d041a1ecaf64d62fe9a267b0023a8a69853db24440d9169c5cac6344" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.163091 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.169430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" event={"ID":"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f","Type":"ContainerStarted","Data":"9d28c3bd36e1bc333640459704bab4e74033344f193cca0961971344adb61933"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.178255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd819a1c-a33c-4e75-9212-cd43441da6a4" (UID: "cd819a1c-a33c-4e75-9212-cd43441da6a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.184539 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.185622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xc6dz" event={"ID":"cd819a1c-a33c-4e75-9212-cd43441da6a4","Type":"ContainerDied","Data":"6ecdb1e2e74feaade24ae1ab91feef8c793385d4dfdbff558749ea54cc56d960"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.185673 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ecdb1e2e74feaade24ae1ab91feef8c793385d4dfdbff558749ea54cc56d960" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.195165 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.196036 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.196055 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zl8v4\" (UniqueName: \"kubernetes.io/projected/cd819a1c-a33c-4e75-9212-cd43441da6a4-kube-api-access-zl8v4\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.196065 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.196074 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.196084 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.199500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" event={"ID":"29ec12f2-a8ed-410d-a01d-4f8674db59d5","Type":"ContainerStarted","Data":"1e09b0a59a390f3c2e5afd425cb56da57f8de53e049fc0ed097dc7245f99fa27"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.211651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" event={"ID":"ffcf5779-da4d-4295-bdcc-2fcf48673978","Type":"ContainerDied","Data":"9bdd4b767e90434ea71ab36ad46ac9d884862fae9bbb38cf93dfa3632e19396a"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.211706 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bdd4b767e90434ea71ab36ad46ac9d884862fae9bbb38cf93dfa3632e19396a" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.211798 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-8rgdr" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.217329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3332f75b-195e-49d8-9e72-2b286287e0fc" (UID: "3332f75b-195e-49d8-9e72-2b286287e0fc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.224887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" event={"ID":"1905ef09-f68a-4eaa-bdc4-19aa620bc07b","Type":"ContainerStarted","Data":"dd440a104cd6a9793ab953723521efd48df139bc6e4fdc6e052e06456c79dc24"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.246013 4769 scope.go:117] "RemoveContainer" containerID="281f0bf49a7900aa08f3910a44ec60af39321043ceb04caac9afc5f787829e28" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.249927 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.252082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1e13adac-f934-44c2-a244-cddbeb3681dd","Type":"ContainerDied","Data":"6a77c519a53d46e59de78cb9d3f70180ee972c1b61fd5fa3384db72845fa8a66"} Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.256490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-config-data" (OuterVolumeSpecName: "config-data") pod "cd819a1c-a33c-4e75-9212-cd43441da6a4" (UID: "cd819a1c-a33c-4e75-9212-cd43441da6a4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.295721 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5f6f5bfd-47vgz"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.297238 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3332f75b-195e-49d8-9e72-2b286287e0fc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.297254 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd819a1c-a33c-4e75-9212-cd43441da6a4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.341602 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xc6dz"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.383318 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.384028 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-httpd" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.384114 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-httpd" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.384221 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ffcf5779-da4d-4295-bdcc-2fcf48673978" containerName="cinder-db-sync" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.384422 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf5779-da4d-4295-bdcc-2fcf48673978" containerName="cinder-db-sync" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.384494 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-notification-agent" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.384562 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-notification-agent" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.384629 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="proxy-httpd" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.384689 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="proxy-httpd" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.384775 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="sg-core" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.384841 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="sg-core" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.384919 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-central-agent" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.384985 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-central-agent" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.385051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd819a1c-a33c-4e75-9212-cd43441da6a4" containerName="keystone-bootstrap" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385140 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd819a1c-a33c-4e75-9212-cd43441da6a4" containerName="keystone-bootstrap" Nov 21 12:18:38 crc kubenswrapper[4769]: E1121 12:18:38.385224 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-log" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385289 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-log" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385601 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="proxy-httpd" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-central-agent" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385756 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd819a1c-a33c-4e75-9212-cd43441da6a4" containerName="keystone-bootstrap" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385840 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-log" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.385920 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="sg-core" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.386004 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" containerName="glance-httpd" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.386076 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" containerName="ceilometer-notification-agent" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.392653 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ffcf5779-da4d-4295-bdcc-2fcf48673978" containerName="cinder-db-sync" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.394010 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.404764 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xc6dz"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.407017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.407097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.407130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-scripts\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.407234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.407285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrnj5\" (UniqueName: \"kubernetes.io/projected/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-kube-api-access-jrnj5\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.407307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.411608 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.411838 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.411963 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.412735 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-xssp9" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.421815 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-vb44x"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.424611 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.446537 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.491410 4769 scope.go:117] "RemoveContainer" containerID="472b7d08f97921bb6347c88f25ae884a2ba2f67e2d1283b7bbd65134c733859b" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.500450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-vb44x"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.517782 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.520315 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.521259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jrnj5\" (UniqueName: \"kubernetes.io/projected/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-kube-api-access-jrnj5\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.521342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.521519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.521599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.521649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-scripts\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.521789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.529597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.530617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.536902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.541905 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.542286 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-scripts\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.556066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.572310 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.574011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrnj5\" (UniqueName: \"kubernetes.io/projected/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-kube-api-access-jrnj5\") pod \"cinder-scheduler-0\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.623887 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.625720 4769 scope.go:117] "RemoveContainer" containerID="4b051b24cedf1a9b1a29d205e9b9320385cef8766bc3250e024b74fb54be6bac" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cwn\" (UniqueName: \"kubernetes.io/projected/cedec03e-a964-4528-b14e-96bb56126556-kube-api-access-k5cwn\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-fernet-keys\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-combined-ca-bundle\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627365 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n4hv\" (UniqueName: \"kubernetes.io/projected/10ada652-8736-4844-b135-2153e692c23e-kube-api-access-7n4hv\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-config-data\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-scripts\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data-custom\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cedec03e-a964-4528-b14e-96bb56126556-logs\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cedec03e-a964-4528-b14e-96bb56126556-etc-machine-id\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-scripts\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.627780 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.628924 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-credential-keys\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.639275 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.645987 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.658896 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.660447 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.663596 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.667569 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.670805 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-k5pvr" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.671316 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.671569 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.691392 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.702182 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.706421 4769 scope.go:117] "RemoveContainer" containerID="c9f04c3f21b740afda7ca77308feaa8518d0ce1efef5cbfc9c552337c955f0d7" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.710444 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.713146 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.725373 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.725881 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-scripts\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-credential-keys\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cwn\" (UniqueName: \"kubernetes.io/projected/cedec03e-a964-4528-b14e-96bb56126556-kube-api-access-k5cwn\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-fernet-keys\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-combined-ca-bundle\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.738958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4hv\" (UniqueName: \"kubernetes.io/projected/10ada652-8736-4844-b135-2153e692c23e-kube-api-access-7n4hv\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.739002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-config-data\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.739045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-scripts\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.739082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data-custom\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.739107 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cedec03e-a964-4528-b14e-96bb56126556-logs\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.739148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cedec03e-a964-4528-b14e-96bb56126556-etc-machine-id\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.739310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cedec03e-a964-4528-b14e-96bb56126556-etc-machine-id\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.744038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-scripts\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.748706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cedec03e-a964-4528-b14e-96bb56126556-logs\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.751628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-fernet-keys\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.757684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data-custom\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.761425 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.764731 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-combined-ca-bundle\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.765924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-scripts\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.767300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.772996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-credential-keys\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.773083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-config-data\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.774337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.779149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cwn\" (UniqueName: \"kubernetes.io/projected/cedec03e-a964-4528-b14e-96bb56126556-kube-api-access-k5cwn\") pod \"cinder-api-0\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.779492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n4hv\" (UniqueName: \"kubernetes.io/projected/10ada652-8736-4844-b135-2153e692c23e-kube-api-access-7n4hv\") pod \"keystone-bootstrap-vb44x\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.782528 4769 scope.go:117] "RemoveContainer" containerID="eebc04c5693d0297004a0c68d6014e76b86053645a44761b85530325a208ac59" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-log-httpd\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841166 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-config-data\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841230 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-logs\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841421 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzd4\" (UniqueName: \"kubernetes.io/projected/57080d99-0ce3-47cc-adca-cb7dfad8e99f-kube-api-access-vfzd4\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-scripts\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-run-httpd\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.841596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6znjp\" (UniqueName: \"kubernetes.io/projected/3b5a798b-284e-49f6-bdda-87685fd9f51a-kube-api-access-6znjp\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.942760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943261 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-log-httpd\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-config-data\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-logs\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943679 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.943988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.944028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.944041 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.944049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzd4\" (UniqueName: \"kubernetes.io/projected/57080d99-0ce3-47cc-adca-cb7dfad8e99f-kube-api-access-vfzd4\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.944383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-scripts\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.944411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-run-httpd\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.944431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6znjp\" (UniqueName: \"kubernetes.io/projected/3b5a798b-284e-49f6-bdda-87685fd9f51a-kube-api-access-6znjp\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.948859 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.958139 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.973151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.974033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-scripts\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.974700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.976904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-log-httpd\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.978332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-logs\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.979995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-run-httpd\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.981586 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.987697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.990574 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:38 crc kubenswrapper[4769]: I1121 12:18:38.984954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.002280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-config-data\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.007209 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzd4\" (UniqueName: \"kubernetes.io/projected/57080d99-0ce3-47cc-adca-cb7dfad8e99f-kube-api-access-vfzd4\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.007873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6znjp\" (UniqueName: \"kubernetes.io/projected/3b5a798b-284e-49f6-bdda-87685fd9f51a-kube-api-access-6znjp\") pod \"ceilometer-0\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.008715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.020368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.050336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dz5s\" (UniqueName: \"kubernetes.io/projected/f8890bca-a107-49c7-88c8-1c45c80ed6ba-kube-api-access-7dz5s\") pod \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.050517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-config\") pod \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.050566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-combined-ca-bundle\") pod \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\" (UID: \"f8890bca-a107-49c7-88c8-1c45c80ed6ba\") " Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.057990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.060293 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.082606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8890bca-a107-49c7-88c8-1c45c80ed6ba-kube-api-access-7dz5s" (OuterVolumeSpecName: "kube-api-access-7dz5s") pod "f8890bca-a107-49c7-88c8-1c45c80ed6ba" (UID: "f8890bca-a107-49c7-88c8-1c45c80ed6ba"). InnerVolumeSpecName "kube-api-access-7dz5s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.154358 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7dz5s\" (UniqueName: \"kubernetes.io/projected/f8890bca-a107-49c7-88c8-1c45c80ed6ba-kube-api-access-7dz5s\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.242493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-config" (OuterVolumeSpecName: "config") pod "f8890bca-a107-49c7-88c8-1c45c80ed6ba" (UID: "f8890bca-a107-49c7-88c8-1c45c80ed6ba"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.252741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8890bca-a107-49c7-88c8-1c45c80ed6ba" (UID: "f8890bca-a107-49c7-88c8-1c45c80ed6ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.257169 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.257296 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8890bca-a107-49c7-88c8-1c45c80ed6ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.302975 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.318011 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e13adac-f934-44c2-a244-cddbeb3681dd" path="/var/lib/kubelet/pods/1e13adac-f934-44c2-a244-cddbeb3681dd/volumes" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.319231 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3332f75b-195e-49d8-9e72-2b286287e0fc" path="/var/lib/kubelet/pods/3332f75b-195e-49d8-9e72-2b286287e0fc/volumes" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.327928 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd819a1c-a33c-4e75-9212-cd43441da6a4" path="/var/lib/kubelet/pods/cd819a1c-a33c-4e75-9212-cd43441da6a4/volumes" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.332436 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-685978c557-7zw6c"] Nov 21 12:18:39 crc kubenswrapper[4769]: E1121 12:18:39.333177 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f8890bca-a107-49c7-88c8-1c45c80ed6ba" containerName="neutron-db-sync" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.333318 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8890bca-a107-49c7-88c8-1c45c80ed6ba" containerName="neutron-db-sync" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.334406 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f8890bca-a107-49c7-88c8-1c45c80ed6ba" containerName="neutron-db-sync" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.335456 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-685978c557-7zw6c"] Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.335553 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.338375 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.343903 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.387390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" event={"ID":"e065f3e6-390d-4bdc-98eb-d2efc6fabecf","Type":"ContainerStarted","Data":"6de66ba8fe1756d5210aad3a6ae29943290c8cb763fd345214b2270daf476b95"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.387863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" event={"ID":"e065f3e6-390d-4bdc-98eb-d2efc6fabecf","Type":"ContainerStarted","Data":"149d1824051a3dab6784c4e92dcced019b3f590eeb724a93d3dd23ca340b0710"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.390163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" event={"ID":"f8890bca-a107-49c7-88c8-1c45c80ed6ba","Type":"ContainerDied","Data":"9bfa66ad0d21984a15fa7c343a80d923de2fa4364af1253e9001b93e304267b5"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.390205 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bfa66ad0d21984a15fa7c343a80d923de2fa4364af1253e9001b93e304267b5" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.390259 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-rc6kw" Nov 21 12:18:39 crc kubenswrapper[4769]: W1121 12:18:39.418479 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee214a40_c76c_45fc_b3fa_e75c5a64fe90.slice/crio-518ca7d3a54daf311c7a4c3a82734e0b631659c25f2f892ac5ade202102a061a WatchSource:0}: Error finding container 518ca7d3a54daf311c7a4c3a82734e0b631659c25f2f892ac5ade202102a061a: Status 404 returned error can't find the container with id 518ca7d3a54daf311c7a4c3a82734e0b631659c25f2f892ac5ade202102a061a Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.420509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" event={"ID":"29ec12f2-a8ed-410d-a01d-4f8674db59d5","Type":"ContainerStarted","Data":"cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.420562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" event={"ID":"29ec12f2-a8ed-410d-a01d-4f8674db59d5","Type":"ContainerStarted","Data":"16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.421329 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.421560 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.426077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" event={"ID":"cd70ab0b-1d92-4c16-9be4-261b4773d364","Type":"ContainerStarted","Data":"060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.429007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" event={"ID":"1905ef09-f68a-4eaa-bdc4-19aa620bc07b","Type":"ContainerStarted","Data":"71368c476f9d7417e6c082f2f0d953cb39823f3b9aea2e54ea0f287e13ba2f74"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.435142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" event={"ID":"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f","Type":"ContainerStarted","Data":"08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.435177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" event={"ID":"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f","Type":"ContainerStarted","Data":"bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f"} Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.435905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.435928 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.447768 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" podStartSLOduration=3.447745758 podStartE2EDuration="3.447745758s" podCreationTimestamp="2025-11-21 12:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:39.438713603 +0000 UTC m=+1678.139375421" watchObservedRunningTime="2025-11-21 12:18:39.447745758 +0000 UTC m=+1678.148407576" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.481123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqlq\" (UniqueName: \"kubernetes.io/projected/5bd5a44f-54f7-47f6-989b-12774afaf58c-kube-api-access-dtqlq\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.481361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-httpd-config\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.481400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-ovndb-tls-certs\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.481454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-config\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.481566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-combined-ca-bundle\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.493255 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" podStartSLOduration=3.49317382 podStartE2EDuration="3.49317382s" podCreationTimestamp="2025-11-21 12:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:39.474682939 +0000 UTC m=+1678.175344757" watchObservedRunningTime="2025-11-21 12:18:39.49317382 +0000 UTC m=+1678.193835638" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.532247 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" podStartSLOduration=3.53222182 podStartE2EDuration="3.53222182s" podCreationTimestamp="2025-11-21 12:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:39.50236959 +0000 UTC m=+1678.203031408" watchObservedRunningTime="2025-11-21 12:18:39.53222182 +0000 UTC m=+1678.232883658" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.591980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-httpd-config\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.592053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-ovndb-tls-certs\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.592159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-config\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.592418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-combined-ca-bundle\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.592695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqlq\" (UniqueName: \"kubernetes.io/projected/5bd5a44f-54f7-47f6-989b-12774afaf58c-kube-api-access-dtqlq\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.604944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-combined-ca-bundle\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.611007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-config\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.619376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-httpd-config\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.619670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-ovndb-tls-certs\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.623713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqlq\" (UniqueName: \"kubernetes.io/projected/5bd5a44f-54f7-47f6-989b-12774afaf58c-kube-api-access-dtqlq\") pod \"neutron-685978c557-7zw6c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:39 crc kubenswrapper[4769]: I1121 12:18:39.893387 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.094970 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.107540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:18:40 crc kubenswrapper[4769]: W1121 12:18:40.117105 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcedec03e_a964_4528_b14e_96bb56126556.slice/crio-2caea7619ecdf480d685dbd4484968456c7637dc1f478752276785f99e72446f WatchSource:0}: Error finding container 2caea7619ecdf480d685dbd4484968456c7637dc1f478752276785f99e72446f: Status 404 returned error can't find the container with id 2caea7619ecdf480d685dbd4484968456c7637dc1f478752276785f99e72446f Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.118283 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-vb44x"] Nov 21 12:18:40 crc kubenswrapper[4769]: W1121 12:18:40.136502 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10ada652_8736_4844_b135_2153e692c23e.slice/crio-cc896da369215344941c2cfbebead7071d714e28440ebb314ca4b1b09526f9be WatchSource:0}: Error finding container cc896da369215344941c2cfbebead7071d714e28440ebb314ca4b1b09526f9be: Status 404 returned error can't find the container with id cc896da369215344941c2cfbebead7071d714e28440ebb314ca4b1b09526f9be Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.195407 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.449634 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-685978c557-7zw6c"] Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.459619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" event={"ID":"e065f3e6-390d-4bdc-98eb-d2efc6fabecf","Type":"ContainerStarted","Data":"c294f4926913ea9a60162f42ad399069486233b7eff0d59b236f4c3cc4f1abe5"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.461240 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.461746 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.465129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerStarted","Data":"6c47707fcb88ee53f1e9e32159654bffd03985aed708040142251a29fba55b38"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.469391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"57080d99-0ce3-47cc-adca-cb7dfad8e99f","Type":"ContainerStarted","Data":"da5c1f4640226659afa057597fc959dbc7572e58aea05ff17d6b0c4587b47280"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.484813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ee214a40-c76c-45fc-b3fa-e75c5a64fe90","Type":"ContainerStarted","Data":"518ca7d3a54daf311c7a4c3a82734e0b631659c25f2f892ac5ade202102a061a"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.510434 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" event={"ID":"10ada652-8736-4844-b135-2153e692c23e","Type":"ContainerStarted","Data":"cc896da369215344941c2cfbebead7071d714e28440ebb314ca4b1b09526f9be"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.520063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" event={"ID":"cd70ab0b-1d92-4c16-9be4-261b4773d364","Type":"ContainerStarted","Data":"83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.523406 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" podStartSLOduration=4.523374764 podStartE2EDuration="4.523374764s" podCreationTimestamp="2025-11-21 12:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:40.50885784 +0000 UTC m=+1679.209519668" watchObservedRunningTime="2025-11-21 12:18:40.523374764 +0000 UTC m=+1679.224036602" Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.539701 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" event={"ID":"1905ef09-f68a-4eaa-bdc4-19aa620bc07b","Type":"ContainerStarted","Data":"5028db88cf5823f013d2cb8a89fdfe11f284b0ca4af2031dc20a7841ec08433a"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.544489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"cedec03e-a964-4528-b14e-96bb56126556","Type":"ContainerStarted","Data":"2caea7619ecdf480d685dbd4484968456c7637dc1f478752276785f99e72446f"} Nov 21 12:18:40 crc kubenswrapper[4769]: I1121 12:18:40.581536 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" podStartSLOduration=4.581517551 podStartE2EDuration="4.581517551s" podCreationTimestamp="2025-11-21 12:18:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:40.561473097 +0000 UTC m=+1679.262134935" watchObservedRunningTime="2025-11-21 12:18:40.581517551 +0000 UTC m=+1679.282179369" Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.562331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"cedec03e-a964-4528-b14e-96bb56126556","Type":"ContainerStarted","Data":"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.565796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" event={"ID":"5bd5a44f-54f7-47f6-989b-12774afaf58c","Type":"ContainerStarted","Data":"2db803d2c46102ffcb0785d78133ecb3e2e3b7e95b3944ea2524a4cd3f52110f"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.565842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" event={"ID":"5bd5a44f-54f7-47f6-989b-12774afaf58c","Type":"ContainerStarted","Data":"eaf8523533c64e1ae6b9cd81e791d85b41307a8e3b6957243ad3cb24eccfe75e"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.565855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" event={"ID":"5bd5a44f-54f7-47f6-989b-12774afaf58c","Type":"ContainerStarted","Data":"c3dcdc3853288c6020de30c9bdda46b873a7980f413924c710463bf6ed171089"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.566344 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.568475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerStarted","Data":"3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.571599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"57080d99-0ce3-47cc-adca-cb7dfad8e99f","Type":"ContainerStarted","Data":"96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.577746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ee214a40-c76c-45fc-b3fa-e75c5a64fe90","Type":"ContainerStarted","Data":"8f04306ebb400718c52224d3fa27d32f0103b47c976fca957a6b6604b5b97bf2"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.594442 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" podStartSLOduration=2.5944249040000003 podStartE2EDuration="2.594424904s" podCreationTimestamp="2025-11-21 12:18:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:41.592104941 +0000 UTC m=+1680.292766759" watchObservedRunningTime="2025-11-21 12:18:41.594424904 +0000 UTC m=+1680.295086722" Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.594974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" event={"ID":"10ada652-8736-4844-b135-2153e692c23e","Type":"ContainerStarted","Data":"a978b09bcd12dd83a682b7a59562636938228c2791d65ebfcc0410d9b3f0c63d"} Nov 21 12:18:41 crc kubenswrapper[4769]: I1121 12:18:41.619808 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" podStartSLOduration=3.6197894330000002 podStartE2EDuration="3.619789433s" podCreationTimestamp="2025-11-21 12:18:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:41.615455705 +0000 UTC m=+1680.316117523" watchObservedRunningTime="2025-11-21 12:18:41.619789433 +0000 UTC m=+1680.320451251" Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.604814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"cedec03e-a964-4528-b14e-96bb56126556","Type":"ContainerStarted","Data":"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754"} Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.605457 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.607369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerStarted","Data":"a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87"} Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.607402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerStarted","Data":"13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6"} Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.609809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"57080d99-0ce3-47cc-adca-cb7dfad8e99f","Type":"ContainerStarted","Data":"5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266"} Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.612543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ee214a40-c76c-45fc-b3fa-e75c5a64fe90","Type":"ContainerStarted","Data":"2c94439cf384f973e39ef59a98c7639ef745d84f9f7a7ccfa85df7023c05f3a4"} Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.630768 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.630747074 podStartE2EDuration="4.630747074s" podCreationTimestamp="2025-11-21 12:18:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:42.625629665 +0000 UTC m=+1681.326291483" watchObservedRunningTime="2025-11-21 12:18:42.630747074 +0000 UTC m=+1681.331408882" Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.650467 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.650445958 podStartE2EDuration="4.650445958s" podCreationTimestamp="2025-11-21 12:18:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:42.647055346 +0000 UTC m=+1681.347717164" watchObservedRunningTime="2025-11-21 12:18:42.650445958 +0000 UTC m=+1681.351107776" Nov 21 12:18:42 crc kubenswrapper[4769]: I1121 12:18:42.674643 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.6746215840000005 podStartE2EDuration="4.674621584s" podCreationTimestamp="2025-11-21 12:18:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:42.666055622 +0000 UTC m=+1681.366717440" watchObservedRunningTime="2025-11-21 12:18:42.674621584 +0000 UTC m=+1681.375283402" Nov 21 12:18:43 crc kubenswrapper[4769]: I1121 12:18:43.625447 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.061701 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.634317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerStarted","Data":"98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146"} Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.635680 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.639668 4769 generic.go:334] "Generic (PLEG): container finished" podID="10ada652-8736-4844-b135-2153e692c23e" containerID="a978b09bcd12dd83a682b7a59562636938228c2791d65ebfcc0410d9b3f0c63d" exitCode=0 Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.640437 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" event={"ID":"10ada652-8736-4844-b135-2153e692c23e","Type":"ContainerDied","Data":"a978b09bcd12dd83a682b7a59562636938228c2791d65ebfcc0410d9b3f0c63d"} Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.640811 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api-log" containerID="cri-o://9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320" gracePeriod=30 Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.641045 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api" containerID="cri-o://13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754" gracePeriod=30 Nov 21 12:18:44 crc kubenswrapper[4769]: I1121 12:18:44.663168 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.1352356869999998 podStartE2EDuration="6.663145723s" podCreationTimestamp="2025-11-21 12:18:38 +0000 UTC" firstStartedPulling="2025-11-21 12:18:40.138672305 +0000 UTC m=+1678.839334123" lastFinishedPulling="2025-11-21 12:18:43.666582341 +0000 UTC m=+1682.367244159" observedRunningTime="2025-11-21 12:18:44.654894511 +0000 UTC m=+1683.355556339" watchObservedRunningTime="2025-11-21 12:18:44.663145723 +0000 UTC m=+1683.363807541" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.256304 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-scripts\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cedec03e-a964-4528-b14e-96bb56126556-logs\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-combined-ca-bundle\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cedec03e-a964-4528-b14e-96bb56126556-etc-machine-id\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data-custom\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5cwn\" (UniqueName: \"kubernetes.io/projected/cedec03e-a964-4528-b14e-96bb56126556-kube-api-access-k5cwn\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data\") pod \"cedec03e-a964-4528-b14e-96bb56126556\" (UID: \"cedec03e-a964-4528-b14e-96bb56126556\") " Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315562 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cedec03e-a964-4528-b14e-96bb56126556-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cedec03e-a964-4528-b14e-96bb56126556-logs" (OuterVolumeSpecName: "logs") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315924 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cedec03e-a964-4528-b14e-96bb56126556-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.315945 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cedec03e-a964-4528-b14e-96bb56126556-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.322600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.322653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-scripts" (OuterVolumeSpecName: "scripts") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.326247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cedec03e-a964-4528-b14e-96bb56126556-kube-api-access-k5cwn" (OuterVolumeSpecName: "kube-api-access-k5cwn") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "kube-api-access-k5cwn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.346837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.365624 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data" (OuterVolumeSpecName: "config-data") pod "cedec03e-a964-4528-b14e-96bb56126556" (UID: "cedec03e-a964-4528-b14e-96bb56126556"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.417300 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.417343 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.417354 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.417366 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cedec03e-a964-4528-b14e-96bb56126556-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.417374 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k5cwn\" (UniqueName: \"kubernetes.io/projected/cedec03e-a964-4528-b14e-96bb56126556-kube-api-access-k5cwn\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.651508 4769 generic.go:334] "Generic (PLEG): container finished" podID="cedec03e-a964-4528-b14e-96bb56126556" containerID="13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754" exitCode=0 Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.651557 4769 generic.go:334] "Generic (PLEG): container finished" podID="cedec03e-a964-4528-b14e-96bb56126556" containerID="9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320" exitCode=143 Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.651766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.654520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"cedec03e-a964-4528-b14e-96bb56126556","Type":"ContainerDied","Data":"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754"} Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.654570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"cedec03e-a964-4528-b14e-96bb56126556","Type":"ContainerDied","Data":"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320"} Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.654591 4769 scope.go:117] "RemoveContainer" containerID="13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.654743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"cedec03e-a964-4528-b14e-96bb56126556","Type":"ContainerDied","Data":"2caea7619ecdf480d685dbd4484968456c7637dc1f478752276785f99e72446f"} Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.694480 4769 scope.go:117] "RemoveContainer" containerID="9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.711795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.728512 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.736716 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:45 crc kubenswrapper[4769]: E1121 12:18:45.737172 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api-log" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.737213 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api-log" Nov 21 12:18:45 crc kubenswrapper[4769]: E1121 12:18:45.737247 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.737257 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.737500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.737522 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cedec03e-a964-4528-b14e-96bb56126556" containerName="cinder-api-log" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.738761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.770792 4769 scope.go:117] "RemoveContainer" containerID="13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.770905 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.771004 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.771088 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:18:45 crc kubenswrapper[4769]: E1121 12:18:45.771314 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754\": container with ID starting with 13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754 not found: ID does not exist" containerID="13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.771342 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754"} err="failed to get container status \"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754\": rpc error: code = NotFound desc = could not find container \"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754\": container with ID starting with 13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754 not found: ID does not exist" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.771362 4769 scope.go:117] "RemoveContainer" containerID="9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320" Nov 21 12:18:45 crc kubenswrapper[4769]: E1121 12:18:45.771858 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320\": container with ID starting with 9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320 not found: ID does not exist" containerID="9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.771877 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320"} err="failed to get container status \"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320\": rpc error: code = NotFound desc = could not find container \"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320\": container with ID starting with 9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320 not found: ID does not exist" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.771892 4769 scope.go:117] "RemoveContainer" containerID="13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.772089 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754"} err="failed to get container status \"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754\": rpc error: code = NotFound desc = could not find container \"13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754\": container with ID starting with 13101352d24486a21b663319059ea64264ad3c7e26eb3616c3fa8340d1f1c754 not found: ID does not exist" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.772107 4769 scope.go:117] "RemoveContainer" containerID="9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.773339 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320"} err="failed to get container status \"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320\": rpc error: code = NotFound desc = could not find container \"9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320\": container with ID starting with 9a20eda7aff05304483369e6d89642f3a4f08a6049644970fb03175b6b811320 not found: ID does not exist" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.789930 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823568 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data-custom\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwtk\" (UniqueName: \"kubernetes.io/projected/96896fd8-daed-4cfd-93d0-894c2ca63cf8-kube-api-access-hxwtk\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96896fd8-daed-4cfd-93d0-894c2ca63cf8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96896fd8-daed-4cfd-93d0-894c2ca63cf8-logs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-scripts\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.823757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.926870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.926909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data-custom\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.926940 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwtk\" (UniqueName: \"kubernetes.io/projected/96896fd8-daed-4cfd-93d0-894c2ca63cf8-kube-api-access-hxwtk\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.926976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96896fd8-daed-4cfd-93d0-894c2ca63cf8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.926998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96896fd8-daed-4cfd-93d0-894c2ca63cf8-logs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.927016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.927062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-scripts\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.927092 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.927119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.929329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96896fd8-daed-4cfd-93d0-894c2ca63cf8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.929795 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96896fd8-daed-4cfd-93d0-894c2ca63cf8-logs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.934893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-scripts\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.935126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.935280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.937835 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data-custom\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.939940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.940136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:45 crc kubenswrapper[4769]: I1121 12:18:45.952226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwtk\" (UniqueName: \"kubernetes.io/projected/96896fd8-daed-4cfd-93d0-894c2ca63cf8-kube-api-access-hxwtk\") pod \"cinder-api-0\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.159222 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.188412 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.234840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-credential-keys\") pod \"10ada652-8736-4844-b135-2153e692c23e\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.234950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-fernet-keys\") pod \"10ada652-8736-4844-b135-2153e692c23e\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.235040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-scripts\") pod \"10ada652-8736-4844-b135-2153e692c23e\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.235120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-combined-ca-bundle\") pod \"10ada652-8736-4844-b135-2153e692c23e\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.235212 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n4hv\" (UniqueName: \"kubernetes.io/projected/10ada652-8736-4844-b135-2153e692c23e-kube-api-access-7n4hv\") pod \"10ada652-8736-4844-b135-2153e692c23e\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.235294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-config-data\") pod \"10ada652-8736-4844-b135-2153e692c23e\" (UID: \"10ada652-8736-4844-b135-2153e692c23e\") " Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.242267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ada652-8736-4844-b135-2153e692c23e-kube-api-access-7n4hv" (OuterVolumeSpecName: "kube-api-access-7n4hv") pod "10ada652-8736-4844-b135-2153e692c23e" (UID: "10ada652-8736-4844-b135-2153e692c23e"). InnerVolumeSpecName "kube-api-access-7n4hv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.244331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-scripts" (OuterVolumeSpecName: "scripts") pod "10ada652-8736-4844-b135-2153e692c23e" (UID: "10ada652-8736-4844-b135-2153e692c23e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.244514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "10ada652-8736-4844-b135-2153e692c23e" (UID: "10ada652-8736-4844-b135-2153e692c23e"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.247312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "10ada652-8736-4844-b135-2153e692c23e" (UID: "10ada652-8736-4844-b135-2153e692c23e"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.273639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10ada652-8736-4844-b135-2153e692c23e" (UID: "10ada652-8736-4844-b135-2153e692c23e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.306899 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-config-data" (OuterVolumeSpecName: "config-data") pod "10ada652-8736-4844-b135-2153e692c23e" (UID: "10ada652-8736-4844-b135-2153e692c23e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.339761 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.339801 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.339817 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.339830 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.339841 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10ada652-8736-4844-b135-2153e692c23e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.339851 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7n4hv\" (UniqueName: \"kubernetes.io/projected/10ada652-8736-4844-b135-2153e692c23e-kube-api-access-7n4hv\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.666637 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.666826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-vb44x" event={"ID":"10ada652-8736-4844-b135-2153e692c23e","Type":"ContainerDied","Data":"cc896da369215344941c2cfbebead7071d714e28440ebb314ca4b1b09526f9be"} Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.666858 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc896da369215344941c2cfbebead7071d714e28440ebb314ca4b1b09526f9be" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.666877 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.777990 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk"] Nov 21 12:18:46 crc kubenswrapper[4769]: E1121 12:18:46.778636 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="10ada652-8736-4844-b135-2153e692c23e" containerName="keystone-bootstrap" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.778654 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ada652-8736-4844-b135-2153e692c23e" containerName="keystone-bootstrap" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.778831 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="10ada652-8736-4844-b135-2153e692c23e" containerName="keystone-bootstrap" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.779440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.800799 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.801053 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.801342 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-xbm47" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.801390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.801335 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.801608 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.820958 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk"] Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-public-tls-certs\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-credential-keys\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848406 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-fernet-keys\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-internal-tls-certs\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xhdx\" (UniqueName: \"kubernetes.io/projected/b9561d60-3f1b-4a40-b24f-b4dad34f7117-kube-api-access-7xhdx\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-config-data\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-scripts\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.848638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-combined-ca-bundle\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-internal-tls-certs\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7xhdx\" (UniqueName: \"kubernetes.io/projected/b9561d60-3f1b-4a40-b24f-b4dad34f7117-kube-api-access-7xhdx\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-config-data\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-scripts\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-combined-ca-bundle\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950759 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-public-tls-certs\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-credential-keys\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.950810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-fernet-keys\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.957965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-public-tls-certs\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.958130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-fernet-keys\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.958158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-combined-ca-bundle\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.960084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-credential-keys\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.960631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-internal-tls-certs\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.962224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-config-data\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.972718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-scripts\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:46 crc kubenswrapper[4769]: I1121 12:18:46.976223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xhdx\" (UniqueName: \"kubernetes.io/projected/b9561d60-3f1b-4a40-b24f-b4dad34f7117-kube-api-access-7xhdx\") pod \"keystone-7f5d4bd56d-9n2tk\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:47 crc kubenswrapper[4769]: I1121 12:18:47.141097 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:47 crc kubenswrapper[4769]: I1121 12:18:47.276455 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:18:47 crc kubenswrapper[4769]: E1121 12:18:47.277221 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:18:47 crc kubenswrapper[4769]: I1121 12:18:47.301598 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cedec03e-a964-4528-b14e-96bb56126556" path="/var/lib/kubelet/pods/cedec03e-a964-4528-b14e-96bb56126556/volumes" Nov 21 12:18:47 crc kubenswrapper[4769]: I1121 12:18:47.675621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"96896fd8-daed-4cfd-93d0-894c2ca63cf8","Type":"ContainerStarted","Data":"ab9e09e3d2d74e355ec8b1ebc2a7d30068e16e14cdf8d6aabf3d52642723a118"} Nov 21 12:18:47 crc kubenswrapper[4769]: I1121 12:18:47.786450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk"] Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.450043 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ff7758bd4-wmvql"] Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.456166 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.479643 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.479721 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.488774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-combined-ca-bundle\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.488879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-httpd-config\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.488907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-config\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.488939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-internal-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.488963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-public-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.489012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-ovndb-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.489044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs74w\" (UniqueName: \"kubernetes.io/projected/2e25f734-8e13-4f53-886a-930133a4900e-kube-api-access-vs74w\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.497802 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ff7758bd4-wmvql"] Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591052 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vs74w\" (UniqueName: \"kubernetes.io/projected/2e25f734-8e13-4f53-886a-930133a4900e-kube-api-access-vs74w\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-combined-ca-bundle\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-config\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-httpd-config\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-internal-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-public-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.591788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-ovndb-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.599108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-httpd-config\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.599811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-ovndb-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.599880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-config\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.600987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-combined-ca-bundle\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.601343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-internal-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.601904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-public-tls-certs\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.611487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs74w\" (UniqueName: \"kubernetes.io/projected/2e25f734-8e13-4f53-886a-930133a4900e-kube-api-access-vs74w\") pod \"neutron-ff7758bd4-wmvql\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.694472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"96896fd8-daed-4cfd-93d0-894c2ca63cf8","Type":"ContainerStarted","Data":"a9faf385df6ebec07048a10d2179d2bfca7b09aaf9abd65b3fcc9f4653fbfb51"} Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.694552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"96896fd8-daed-4cfd-93d0-894c2ca63cf8","Type":"ContainerStarted","Data":"a3835e574aef47319958bbf24788c6e911b4521ad675d4bc8be7f837131151c5"} Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.697893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" event={"ID":"b9561d60-3f1b-4a40-b24f-b4dad34f7117","Type":"ContainerStarted","Data":"832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a"} Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.697922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" event={"ID":"b9561d60-3f1b-4a40-b24f-b4dad34f7117","Type":"ContainerStarted","Data":"b5d5fb89c2a51b4a5144b1701279bdf1e3eba468d4b24c3c7a9cd5013bd3ee92"} Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.698133 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.736228 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.736204388 podStartE2EDuration="3.736204388s" podCreationTimestamp="2025-11-21 12:18:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:48.725924562 +0000 UTC m=+1687.426586400" watchObservedRunningTime="2025-11-21 12:18:48.736204388 +0000 UTC m=+1687.436866206" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.762305 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" podStartSLOduration=2.76228582 podStartE2EDuration="2.76228582s" podCreationTimestamp="2025-11-21 12:18:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:48.748859249 +0000 UTC m=+1687.449521067" watchObservedRunningTime="2025-11-21 12:18:48.76228582 +0000 UTC m=+1687.462947638" Nov 21 12:18:48 crc kubenswrapper[4769]: I1121 12:18:48.817984 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.053760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.162054 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.304131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.304214 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.332714 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.336495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.355182 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.384103 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.433434 4769 scope.go:117] "RemoveContainer" containerID="8899cb309299ed0ffc914aa64f5109bc9d73d1d18f55832df91c441f6295c6ee" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.458920 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ff7758bd4-wmvql"] Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.596455 4769 scope.go:117] "RemoveContainer" containerID="54afa3d44db3172825ebd6b27ef97095e76608384e8c8c50abf829b5940612e4" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.655054 4769 scope.go:117] "RemoveContainer" containerID="9b3090c3e9bec06093493025ef37a3a49c21061803cffc8e2863ef33018fd8a3" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.685172 4769 scope.go:117] "RemoveContainer" containerID="c295520ea0823d005ee4bacef81248d05a52bdb4b6dd4d80526c7b3f2b3e4792" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.724848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" event={"ID":"2e25f734-8e13-4f53-886a-930133a4900e","Type":"ContainerStarted","Data":"fb3632ce0f1b17d4b74c72db513d6cb4f241c8cd4ba718c23d7369bc1522776f"} Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.731417 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.731424 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="cinder-scheduler" containerID="cri-o://8f04306ebb400718c52224d3fa27d32f0103b47c976fca957a6b6604b5b97bf2" gracePeriod=30 Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.731663 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="probe" containerID="cri-o://2c94439cf384f973e39ef59a98c7639ef745d84f9f7a7ccfa85df7023c05f3a4" gracePeriod=30 Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.732363 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.733140 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.780937 4769 scope.go:117] "RemoveContainer" containerID="1ca3529a2680a180fe7c8e8051b29355f57d5a0d8e59f002423a6b86cd1b63c4" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.821264 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6489646f7b-4v47t"] Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.823334 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.828038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.828322 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.834376 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6489646f7b-4v47t"] Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.926715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s8zb\" (UniqueName: \"kubernetes.io/projected/b93ccd0d-4d54-491c-985e-6d149616f695-kube-api-access-8s8zb\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.926913 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b93ccd0d-4d54-491c-985e-6d149616f695-logs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.926957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.926981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data-custom\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.927040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-public-tls-certs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.927101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-combined-ca-bundle\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:49 crc kubenswrapper[4769]: I1121 12:18:49.927257 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-internal-tls-certs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-internal-tls-certs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8zb\" (UniqueName: \"kubernetes.io/projected/b93ccd0d-4d54-491c-985e-6d149616f695-kube-api-access-8s8zb\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b93ccd0d-4d54-491c-985e-6d149616f695-logs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028863 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028887 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data-custom\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028926 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-public-tls-certs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.028964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-combined-ca-bundle\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.031013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b93ccd0d-4d54-491c-985e-6d149616f695-logs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.036721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-combined-ca-bundle\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.037425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.038846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data-custom\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.039225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-internal-tls-certs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.041169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-public-tls-certs\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.049233 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8zb\" (UniqueName: \"kubernetes.io/projected/b93ccd0d-4d54-491c-985e-6d149616f695-kube-api-access-8s8zb\") pod \"barbican-api-6489646f7b-4v47t\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.296728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.741327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" event={"ID":"2e25f734-8e13-4f53-886a-930133a4900e","Type":"ContainerStarted","Data":"58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7"} Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.741968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" event={"ID":"2e25f734-8e13-4f53-886a-930133a4900e","Type":"ContainerStarted","Data":"2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181"} Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.742507 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.744979 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerID="2c94439cf384f973e39ef59a98c7639ef745d84f9f7a7ccfa85df7023c05f3a4" exitCode=0 Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.745064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ee214a40-c76c-45fc-b3fa-e75c5a64fe90","Type":"ContainerDied","Data":"2c94439cf384f973e39ef59a98c7639ef745d84f9f7a7ccfa85df7023c05f3a4"} Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.778775 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" podStartSLOduration=2.778752103 podStartE2EDuration="2.778752103s" podCreationTimestamp="2025-11-21 12:18:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:50.764680565 +0000 UTC m=+1689.465342383" watchObservedRunningTime="2025-11-21 12:18:50.778752103 +0000 UTC m=+1689.479413921" Nov 21 12:18:50 crc kubenswrapper[4769]: I1121 12:18:50.804003 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6489646f7b-4v47t"] Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.754477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" event={"ID":"b93ccd0d-4d54-491c-985e-6d149616f695","Type":"ContainerStarted","Data":"50e147f7889ceaf7fb95d13ab3783b5e090881e101729579e3050adae56b289f"} Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.754835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" event={"ID":"b93ccd0d-4d54-491c-985e-6d149616f695","Type":"ContainerStarted","Data":"3698bab596c29ca6814770541aae1aac5f1f4a8c2838d5487adb7c0a36048959"} Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.754856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" event={"ID":"b93ccd0d-4d54-491c-985e-6d149616f695","Type":"ContainerStarted","Data":"eb7e142f40c8d11093fed991c7f45d8e478eeaf979d76457d1d9a186f2736680"} Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.754900 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.754980 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.754988 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.755612 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.845818 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.847620 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:18:51 crc kubenswrapper[4769]: I1121 12:18:51.893743 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" podStartSLOduration=2.8937201 podStartE2EDuration="2.8937201s" podCreationTimestamp="2025-11-21 12:18:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:51.787580365 +0000 UTC m=+1690.488242183" watchObservedRunningTime="2025-11-21 12:18:51.8937201 +0000 UTC m=+1690.594381918" Nov 21 12:18:52 crc kubenswrapper[4769]: I1121 12:18:52.767912 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerID="8f04306ebb400718c52224d3fa27d32f0103b47c976fca957a6b6604b5b97bf2" exitCode=0 Nov 21 12:18:52 crc kubenswrapper[4769]: I1121 12:18:52.768216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ee214a40-c76c-45fc-b3fa-e75c5a64fe90","Type":"ContainerDied","Data":"8f04306ebb400718c52224d3fa27d32f0103b47c976fca957a6b6604b5b97bf2"} Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.022880 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data\") pod \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-combined-ca-bundle\") pod \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-scripts\") pod \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-etc-machine-id\") pod \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data-custom\") pod \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrnj5\" (UniqueName: \"kubernetes.io/projected/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-kube-api-access-jrnj5\") pod \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\" (UID: \"ee214a40-c76c-45fc-b3fa-e75c5a64fe90\") " Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.096867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ee214a40-c76c-45fc-b3fa-e75c5a64fe90" (UID: "ee214a40-c76c-45fc-b3fa-e75c5a64fe90"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.097179 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.102284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-scripts" (OuterVolumeSpecName: "scripts") pod "ee214a40-c76c-45fc-b3fa-e75c5a64fe90" (UID: "ee214a40-c76c-45fc-b3fa-e75c5a64fe90"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.102302 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ee214a40-c76c-45fc-b3fa-e75c5a64fe90" (UID: "ee214a40-c76c-45fc-b3fa-e75c5a64fe90"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.103752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-kube-api-access-jrnj5" (OuterVolumeSpecName: "kube-api-access-jrnj5") pod "ee214a40-c76c-45fc-b3fa-e75c5a64fe90" (UID: "ee214a40-c76c-45fc-b3fa-e75c5a64fe90"). InnerVolumeSpecName "kube-api-access-jrnj5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.163386 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee214a40-c76c-45fc-b3fa-e75c5a64fe90" (UID: "ee214a40-c76c-45fc-b3fa-e75c5a64fe90"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.199573 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.199604 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.199619 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.199630 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jrnj5\" (UniqueName: \"kubernetes.io/projected/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-kube-api-access-jrnj5\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.200442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data" (OuterVolumeSpecName: "config-data") pod "ee214a40-c76c-45fc-b3fa-e75c5a64fe90" (UID: "ee214a40-c76c-45fc-b3fa-e75c5a64fe90"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.302176 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee214a40-c76c-45fc-b3fa-e75c5a64fe90-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.785115 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.785156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ee214a40-c76c-45fc-b3fa-e75c5a64fe90","Type":"ContainerDied","Data":"518ca7d3a54daf311c7a4c3a82734e0b631659c25f2f892ac5ade202102a061a"} Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.785451 4769 scope.go:117] "RemoveContainer" containerID="2c94439cf384f973e39ef59a98c7639ef745d84f9f7a7ccfa85df7023c05f3a4" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.819534 4769 scope.go:117] "RemoveContainer" containerID="8f04306ebb400718c52224d3fa27d32f0103b47c976fca957a6b6604b5b97bf2" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.820739 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.832701 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.841940 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:53 crc kubenswrapper[4769]: E1121 12:18:53.842320 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="cinder-scheduler" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.842336 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="cinder-scheduler" Nov 21 12:18:53 crc kubenswrapper[4769]: E1121 12:18:53.842355 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="probe" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.842362 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="probe" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.842546 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="cinder-scheduler" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.842563 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" containerName="probe" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.844534 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.847513 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.863904 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.912574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.912657 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-scripts\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.912703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.912802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.912888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95rg\" (UniqueName: \"kubernetes.io/projected/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-kube-api-access-b95rg\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:53 crc kubenswrapper[4769]: I1121 12:18:53.912940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.015357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.015451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b95rg\" (UniqueName: \"kubernetes.io/projected/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-kube-api-access-b95rg\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.020147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.020397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.020459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-scripts\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.020519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.020696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.023644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.024792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.024941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.028886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-scripts\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.034168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95rg\" (UniqueName: \"kubernetes.io/projected/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-kube-api-access-b95rg\") pod \"cinder-scheduler-0\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.174214 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.607276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:18:54 crc kubenswrapper[4769]: I1121 12:18:54.797652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8afd06f7-779e-4ef5-a411-a00c1a15d5c3","Type":"ContainerStarted","Data":"8d98bb6349a379170d9e7f4f724bde1fac07966912412d04eafd78b198df2d6f"} Nov 21 12:18:55 crc kubenswrapper[4769]: I1121 12:18:55.289720 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee214a40-c76c-45fc-b3fa-e75c5a64fe90" path="/var/lib/kubelet/pods/ee214a40-c76c-45fc-b3fa-e75c5a64fe90/volumes" Nov 21 12:18:55 crc kubenswrapper[4769]: I1121 12:18:55.810407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8afd06f7-779e-4ef5-a411-a00c1a15d5c3","Type":"ContainerStarted","Data":"2dbf43d77946605400af5b7ce3c06180b86d0d63354eed52a59eaa13bb0e66e2"} Nov 21 12:18:55 crc kubenswrapper[4769]: I1121 12:18:55.811635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8afd06f7-779e-4ef5-a411-a00c1a15d5c3","Type":"ContainerStarted","Data":"9fb659f9424787f611011d4bc0d6e4091a6335a401f3e01ecfa4b75494bb0e2b"} Nov 21 12:18:55 crc kubenswrapper[4769]: I1121 12:18:55.833577 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=2.8335536919999997 podStartE2EDuration="2.833553692s" podCreationTimestamp="2025-11-21 12:18:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:18:55.833413338 +0000 UTC m=+1694.534075156" watchObservedRunningTime="2025-11-21 12:18:55.833553692 +0000 UTC m=+1694.534215510" Nov 21 12:18:58 crc kubenswrapper[4769]: I1121 12:18:58.072939 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:18:59 crc kubenswrapper[4769]: I1121 12:18:59.175671 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:19:01 crc kubenswrapper[4769]: I1121 12:19:01.279055 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:19:01 crc kubenswrapper[4769]: E1121 12:19:01.279521 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:19:01 crc kubenswrapper[4769]: I1121 12:19:01.753010 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:19:01 crc kubenswrapper[4769]: I1121 12:19:01.758919 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:19:01 crc kubenswrapper[4769]: I1121 12:19:01.835087 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-597868688-sdklb"] Nov 21 12:19:01 crc kubenswrapper[4769]: I1121 12:19:01.835371 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api-log" containerID="cri-o://16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54" gracePeriod=30 Nov 21 12:19:01 crc kubenswrapper[4769]: I1121 12:19:01.835773 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api" containerID="cri-o://cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0" gracePeriod=30 Nov 21 12:19:02 crc kubenswrapper[4769]: I1121 12:19:02.894376 4769 generic.go:334] "Generic (PLEG): container finished" podID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerID="16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54" exitCode=143 Nov 21 12:19:02 crc kubenswrapper[4769]: I1121 12:19:02.894468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" event={"ID":"29ec12f2-a8ed-410d-a01d-4f8674db59d5","Type":"ContainerDied","Data":"16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54"} Nov 21 12:19:04 crc kubenswrapper[4769]: I1121 12:19:04.373892 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.444669 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.543794 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-combined-ca-bundle\") pod \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.543988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ec12f2-a8ed-410d-a01d-4f8674db59d5-logs\") pod \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.544011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data-custom\") pod \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.544064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data\") pod \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.544102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grzpn\" (UniqueName: \"kubernetes.io/projected/29ec12f2-a8ed-410d-a01d-4f8674db59d5-kube-api-access-grzpn\") pod \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\" (UID: \"29ec12f2-a8ed-410d-a01d-4f8674db59d5\") " Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.544480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ec12f2-a8ed-410d-a01d-4f8674db59d5-logs" (OuterVolumeSpecName: "logs") pod "29ec12f2-a8ed-410d-a01d-4f8674db59d5" (UID: "29ec12f2-a8ed-410d-a01d-4f8674db59d5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.556377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "29ec12f2-a8ed-410d-a01d-4f8674db59d5" (UID: "29ec12f2-a8ed-410d-a01d-4f8674db59d5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.559399 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ec12f2-a8ed-410d-a01d-4f8674db59d5-kube-api-access-grzpn" (OuterVolumeSpecName: "kube-api-access-grzpn") pod "29ec12f2-a8ed-410d-a01d-4f8674db59d5" (UID: "29ec12f2-a8ed-410d-a01d-4f8674db59d5"). InnerVolumeSpecName "kube-api-access-grzpn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.569350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29ec12f2-a8ed-410d-a01d-4f8674db59d5" (UID: "29ec12f2-a8ed-410d-a01d-4f8674db59d5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.606893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data" (OuterVolumeSpecName: "config-data") pod "29ec12f2-a8ed-410d-a01d-4f8674db59d5" (UID: "29ec12f2-a8ed-410d-a01d-4f8674db59d5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.646744 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29ec12f2-a8ed-410d-a01d-4f8674db59d5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.646797 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.646813 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.646822 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-grzpn\" (UniqueName: \"kubernetes.io/projected/29ec12f2-a8ed-410d-a01d-4f8674db59d5-kube-api-access-grzpn\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.646850 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29ec12f2-a8ed-410d-a01d-4f8674db59d5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.936151 4769 generic.go:334] "Generic (PLEG): container finished" podID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerID="cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0" exitCode=0 Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.936242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" event={"ID":"29ec12f2-a8ed-410d-a01d-4f8674db59d5","Type":"ContainerDied","Data":"cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0"} Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.936248 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.936276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-597868688-sdklb" event={"ID":"29ec12f2-a8ed-410d-a01d-4f8674db59d5","Type":"ContainerDied","Data":"1e09b0a59a390f3c2e5afd425cb56da57f8de53e049fc0ed097dc7245f99fa27"} Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.936296 4769 scope.go:117] "RemoveContainer" containerID="cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.963577 4769 scope.go:117] "RemoveContainer" containerID="16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.974735 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-597868688-sdklb"] Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.981891 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-597868688-sdklb"] Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.990286 4769 scope.go:117] "RemoveContainer" containerID="cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0" Nov 21 12:19:05 crc kubenswrapper[4769]: E1121 12:19:05.990854 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0\": container with ID starting with cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0 not found: ID does not exist" containerID="cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.990918 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0"} err="failed to get container status \"cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0\": rpc error: code = NotFound desc = could not find container \"cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0\": container with ID starting with cc53821a9a8b6805ce2fc1762783815a8948a90d45b1b6d23b5ce555c790abc0 not found: ID does not exist" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.990960 4769 scope.go:117] "RemoveContainer" containerID="16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54" Nov 21 12:19:05 crc kubenswrapper[4769]: E1121 12:19:05.991554 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54\": container with ID starting with 16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54 not found: ID does not exist" containerID="16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54" Nov 21 12:19:05 crc kubenswrapper[4769]: I1121 12:19:05.991618 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54"} err="failed to get container status \"16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54\": rpc error: code = NotFound desc = could not find container \"16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54\": container with ID starting with 16b5b8f62a92cd625b5a271e8124257b154a8557bed1348abd4b955cd297ec54 not found: ID does not exist" Nov 21 12:19:07 crc kubenswrapper[4769]: I1121 12:19:07.287117 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" path="/var/lib/kubelet/pods/29ec12f2-a8ed-410d-a01d-4f8674db59d5/volumes" Nov 21 12:19:07 crc kubenswrapper[4769]: I1121 12:19:07.513315 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","poda8bf0cb3-3de0-4060-bc44-e253e58c2b49"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort poda8bf0cb3-3de0-4060-bc44-e253e58c2b49] : Timed out while waiting for systemd to remove kubepods-besteffort-poda8bf0cb3_3de0_4060_bc44_e253e58c2b49.slice" Nov 21 12:19:07 crc kubenswrapper[4769]: E1121 12:19:07.513710 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort poda8bf0cb3-3de0-4060-bc44-e253e58c2b49] : unable to destroy cgroup paths for cgroup [kubepods besteffort poda8bf0cb3-3de0-4060-bc44-e253e58c2b49] : Timed out while waiting for systemd to remove kubepods-besteffort-poda8bf0cb3_3de0_4060_bc44_e253e58c2b49.slice" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" Nov 21 12:19:07 crc kubenswrapper[4769]: I1121 12:19:07.614726 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:19:07 crc kubenswrapper[4769]: I1121 12:19:07.620398 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:19:07 crc kubenswrapper[4769]: I1121 12:19:07.954342 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:07 crc kubenswrapper[4769]: I1121 12:19:07.993736 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.002073 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.020262 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:08 crc kubenswrapper[4769]: E1121 12:19:08.020749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.021347 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api" Nov 21 12:19:08 crc kubenswrapper[4769]: E1121 12:19:08.021395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api-log" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.021402 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api-log" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.021598 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api-log" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.021612 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="29ec12f2-a8ed-410d-a01d-4f8674db59d5" containerName="barbican-api" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.022711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.025704 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.025957 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.036168 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.112676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-config-data\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.112770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.112817 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mll6r\" (UniqueName: \"kubernetes.io/projected/212f47da-fef4-4db1-a560-8a17ec789e49-kube-api-access-mll6r\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.113142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-scripts\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.113239 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-logs\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.113314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.113672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.113735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-config-data\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215206 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mll6r\" (UniqueName: \"kubernetes.io/projected/212f47da-fef4-4db1-a560-8a17ec789e49-kube-api-access-mll6r\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-scripts\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-logs\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.215775 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.216119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.216165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-logs\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.223221 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.228869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-scripts\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.230599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-config-data\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.240590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.241828 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mll6r\" (UniqueName: \"kubernetes.io/projected/212f47da-fef4-4db1-a560-8a17ec789e49-kube-api-access-mll6r\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.246898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.345564 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.534990 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.552311 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.618828 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz"] Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.843546 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:08 crc kubenswrapper[4769]: W1121 12:19:08.849290 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod212f47da_fef4_4db1_a560_8a17ec789e49.slice/crio-08ccc3f576a62b81d93112ad5bf972a1ff0171860a61ab55308e2b39fb0076b6 WatchSource:0}: Error finding container 08ccc3f576a62b81d93112ad5bf972a1ff0171860a61ab55308e2b39fb0076b6: Status 404 returned error can't find the container with id 08ccc3f576a62b81d93112ad5bf972a1ff0171860a61ab55308e2b39fb0076b6 Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.966495 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"212f47da-fef4-4db1-a560-8a17ec789e49","Type":"ContainerStarted","Data":"08ccc3f576a62b81d93112ad5bf972a1ff0171860a61ab55308e2b39fb0076b6"} Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.966998 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-log" containerID="cri-o://bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f" gracePeriod=30 Nov 21 12:19:08 crc kubenswrapper[4769]: I1121 12:19:08.967698 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-api" containerID="cri-o://08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329" gracePeriod=30 Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.069760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.288875 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8bf0cb3-3de0-4060-bc44-e253e58c2b49" path="/var/lib/kubelet/pods/a8bf0cb3-3de0-4060-bc44-e253e58c2b49/volumes" Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.552847 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podf8890bca-a107-49c7-88c8-1c45c80ed6ba"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podf8890bca-a107-49c7-88c8-1c45c80ed6ba] : Timed out while waiting for systemd to remove kubepods-besteffort-podf8890bca_a107_49c7_88c8_1c45c80ed6ba.slice" Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.907531 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.976922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"212f47da-fef4-4db1-a560-8a17ec789e49","Type":"ContainerStarted","Data":"f6536d8dd0063b0237a1b960e0c20054bbd237f51508fe90686c83d6952e51fc"} Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.976988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"212f47da-fef4-4db1-a560-8a17ec789e49","Type":"ContainerStarted","Data":"15462516bebe4c52f21813ad18301486ab84c611396c96a55d3d0a756f2c2c8e"} Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.983681 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerID="bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f" exitCode=143 Nov 21 12:19:09 crc kubenswrapper[4769]: I1121 12:19:09.983734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" event={"ID":"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f","Type":"ContainerDied","Data":"bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f"} Nov 21 12:19:10 crc kubenswrapper[4769]: I1121 12:19:10.006738 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.006716239 podStartE2EDuration="3.006716239s" podCreationTimestamp="2025-11-21 12:19:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:10.003441581 +0000 UTC m=+1708.704103409" watchObservedRunningTime="2025-11-21 12:19:10.006716239 +0000 UTC m=+1708.707378057" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.572634 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.709646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-scripts\") pod \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.709718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-combined-ca-bundle\") pod \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.709774 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5btfk\" (UniqueName: \"kubernetes.io/projected/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-kube-api-access-5btfk\") pod \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.709902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-logs\") pod \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.709998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-config-data\") pod \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\" (UID: \"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f\") " Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.710769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-logs" (OuterVolumeSpecName: "logs") pod "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" (UID: "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.716449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-scripts" (OuterVolumeSpecName: "scripts") pod "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" (UID: "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.716493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-kube-api-access-5btfk" (OuterVolumeSpecName: "kube-api-access-5btfk") pod "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" (UID: "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f"). InnerVolumeSpecName "kube-api-access-5btfk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.762993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-config-data" (OuterVolumeSpecName: "config-data") pod "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" (UID: "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.768091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" (UID: "b1a84ccd-8c22-46e4-a96e-85f4f70ce04f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.813334 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.813404 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.813423 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5btfk\" (UniqueName: \"kubernetes.io/projected/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-kube-api-access-5btfk\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.813446 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:12 crc kubenswrapper[4769]: I1121 12:19:12.813460 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.018326 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerID="08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329" exitCode=0 Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.018392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" event={"ID":"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f","Type":"ContainerDied","Data":"08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329"} Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.018426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" event={"ID":"b1a84ccd-8c22-46e4-a96e-85f4f70ce04f","Type":"ContainerDied","Data":"9d28c3bd36e1bc333640459704bab4e74033344f193cca0961971344adb61933"} Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.018445 4769 scope.go:117] "RemoveContainer" containerID="08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.018558 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.066573 4769 scope.go:117] "RemoveContainer" containerID="bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.069638 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz"] Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.076914 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-57f9d5bb7d-v8tcz"] Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.091232 4769 scope.go:117] "RemoveContainer" containerID="08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329" Nov 21 12:19:13 crc kubenswrapper[4769]: E1121 12:19:13.092176 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329\": container with ID starting with 08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329 not found: ID does not exist" containerID="08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.092251 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329"} err="failed to get container status \"08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329\": rpc error: code = NotFound desc = could not find container \"08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329\": container with ID starting with 08e687e7bca4c8281de62f44b182154293b46f734cfa8def2048a9ac5b03f329 not found: ID does not exist" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.092279 4769 scope.go:117] "RemoveContainer" containerID="bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f" Nov 21 12:19:13 crc kubenswrapper[4769]: E1121 12:19:13.092668 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f\": container with ID starting with bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f not found: ID does not exist" containerID="bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.092714 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f"} err="failed to get container status \"bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f\": rpc error: code = NotFound desc = could not find container \"bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f\": container with ID starting with bce4628164e4dc83d48b65bbbabd465b1205756c4af190d4bbc248d44f34773f not found: ID does not exist" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.279729 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:19:13 crc kubenswrapper[4769]: E1121 12:19:13.280174 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:19:13 crc kubenswrapper[4769]: I1121 12:19:13.284323 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" path="/var/lib/kubelet/pods/b1a84ccd-8c22-46e4-a96e-85f4f70ce04f/volumes" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.346966 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.347604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.376839 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.383815 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.753661 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.833281 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.904369 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-685978c557-7zw6c"] Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.904763 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-api" containerID="cri-o://eaf8523533c64e1ae6b9cd81e791d85b41307a8e3b6957243ad3cb24eccfe75e" gracePeriod=30 Nov 21 12:19:18 crc kubenswrapper[4769]: I1121 12:19:18.904836 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-httpd" containerID="cri-o://2db803d2c46102ffcb0785d78133ecb3e2e3b7e95b3944ea2524a4cd3f52110f" gracePeriod=30 Nov 21 12:19:19 crc kubenswrapper[4769]: I1121 12:19:19.087908 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:19 crc kubenswrapper[4769]: I1121 12:19:19.087959 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:20 crc kubenswrapper[4769]: I1121 12:19:20.099312 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerID="2db803d2c46102ffcb0785d78133ecb3e2e3b7e95b3944ea2524a4cd3f52110f" exitCode=0 Nov 21 12:19:20 crc kubenswrapper[4769]: I1121 12:19:20.099592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" event={"ID":"5bd5a44f-54f7-47f6-989b-12774afaf58c","Type":"ContainerDied","Data":"2db803d2c46102ffcb0785d78133ecb3e2e3b7e95b3944ea2524a4cd3f52110f"} Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.592249 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.593289 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.612778 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.682377 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.682859 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-central-agent" containerID="cri-o://3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0" gracePeriod=30 Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.683040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="proxy-httpd" containerID="cri-o://98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146" gracePeriod=30 Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.683149 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="sg-core" containerID="cri-o://a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87" gracePeriod=30 Nov 21 12:19:21 crc kubenswrapper[4769]: I1121 12:19:21.683287 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-notification-agent" containerID="cri-o://13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6" gracePeriod=30 Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.118691 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerID="98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146" exitCode=0 Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.118831 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerID="a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87" exitCode=2 Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.118779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerDied","Data":"98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146"} Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.118942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerDied","Data":"a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87"} Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.118959 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerDied","Data":"3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0"} Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.118906 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerID="3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0" exitCode=0 Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.754782 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:19:22 crc kubenswrapper[4769]: E1121 12:19:22.755502 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-log" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.755519 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-log" Nov 21 12:19:22 crc kubenswrapper[4769]: E1121 12:19:22.755543 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-api" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.755548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-api" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.755711 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-api" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.755733 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1a84ccd-8c22-46e4-a96e-85f4f70ce04f" containerName="placement-log" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.756419 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.761396 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-mf9v5" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.762450 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.762721 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.776381 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.839224 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4qm\" (UniqueName: \"kubernetes.io/projected/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-kube-api-access-zk4qm\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.839341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config-secret\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.839396 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-combined-ca-bundle\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.839434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.940842 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4qm\" (UniqueName: \"kubernetes.io/projected/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-kube-api-access-zk4qm\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.941214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config-secret\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.941435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-combined-ca-bundle\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.941564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.942519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.949334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config-secret\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.949754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-combined-ca-bundle\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:22 crc kubenswrapper[4769]: I1121 12:19:22.959569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4qm\" (UniqueName: \"kubernetes.io/projected/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-kube-api-access-zk4qm\") pod \"openstackclient\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:23 crc kubenswrapper[4769]: I1121 12:19:23.077220 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:19:23 crc kubenswrapper[4769]: I1121 12:19:23.619903 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:19:24 crc kubenswrapper[4769]: I1121 12:19:24.142326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37","Type":"ContainerStarted","Data":"baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133"} Nov 21 12:19:24 crc kubenswrapper[4769]: I1121 12:19:24.142743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37","Type":"ContainerStarted","Data":"3a7c84e37fb1c60ffc42f38f4046b286b54138b5a92a31bce1aa7f30917660a9"} Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.161931 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerID="eaf8523533c64e1ae6b9cd81e791d85b41307a8e3b6957243ad3cb24eccfe75e" exitCode=0 Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.162004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" event={"ID":"5bd5a44f-54f7-47f6-989b-12774afaf58c","Type":"ContainerDied","Data":"eaf8523533c64e1ae6b9cd81e791d85b41307a8e3b6957243ad3cb24eccfe75e"} Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.162453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" event={"ID":"5bd5a44f-54f7-47f6-989b-12774afaf58c","Type":"ContainerDied","Data":"c3dcdc3853288c6020de30c9bdda46b873a7980f413924c710463bf6ed171089"} Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.162472 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3dcdc3853288c6020de30c9bdda46b873a7980f413924c710463bf6ed171089" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.163091 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.200933 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=3.200916309 podStartE2EDuration="3.200916309s" podCreationTimestamp="2025-11-21 12:19:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:24.169829668 +0000 UTC m=+1722.870491486" watchObservedRunningTime="2025-11-21 12:19:25.200916309 +0000 UTC m=+1723.901578127" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.295079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-ovndb-tls-certs\") pod \"5bd5a44f-54f7-47f6-989b-12774afaf58c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.295252 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-combined-ca-bundle\") pod \"5bd5a44f-54f7-47f6-989b-12774afaf58c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.295312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtqlq\" (UniqueName: \"kubernetes.io/projected/5bd5a44f-54f7-47f6-989b-12774afaf58c-kube-api-access-dtqlq\") pod \"5bd5a44f-54f7-47f6-989b-12774afaf58c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.295354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-config\") pod \"5bd5a44f-54f7-47f6-989b-12774afaf58c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.295386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-httpd-config\") pod \"5bd5a44f-54f7-47f6-989b-12774afaf58c\" (UID: \"5bd5a44f-54f7-47f6-989b-12774afaf58c\") " Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.322912 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd5a44f-54f7-47f6-989b-12774afaf58c-kube-api-access-dtqlq" (OuterVolumeSpecName: "kube-api-access-dtqlq") pod "5bd5a44f-54f7-47f6-989b-12774afaf58c" (UID: "5bd5a44f-54f7-47f6-989b-12774afaf58c"). InnerVolumeSpecName "kube-api-access-dtqlq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.342315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "5bd5a44f-54f7-47f6-989b-12774afaf58c" (UID: "5bd5a44f-54f7-47f6-989b-12774afaf58c"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.397396 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dtqlq\" (UniqueName: \"kubernetes.io/projected/5bd5a44f-54f7-47f6-989b-12774afaf58c-kube-api-access-dtqlq\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.397428 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.398214 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5bd5a44f-54f7-47f6-989b-12774afaf58c" (UID: "5bd5a44f-54f7-47f6-989b-12774afaf58c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.401930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-config" (OuterVolumeSpecName: "config") pod "5bd5a44f-54f7-47f6-989b-12774afaf58c" (UID: "5bd5a44f-54f7-47f6-989b-12774afaf58c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.443379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "5bd5a44f-54f7-47f6-989b-12774afaf58c" (UID: "5bd5a44f-54f7-47f6-989b-12774afaf58c"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.499679 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.499725 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.499741 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd5a44f-54f7-47f6-989b-12774afaf58c-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.744976 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w"] Nov 21 12:19:25 crc kubenswrapper[4769]: E1121 12:19:25.746037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-httpd" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.746060 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-httpd" Nov 21 12:19:25 crc kubenswrapper[4769]: E1121 12:19:25.746097 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-api" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.746107 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-api" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.746336 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-httpd" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.746366 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" containerName="neutron-api" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.748059 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.763739 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.764351 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.765023 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.793427 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w"] Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.806721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5klx\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-kube-api-access-c5klx\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.806831 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-config-data\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.806923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-combined-ca-bundle\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.806973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-log-httpd\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.807001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-internal-tls-certs\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.807067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-run-httpd\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.807097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-public-tls-certs\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.807158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-etc-swift\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-log-httpd\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-internal-tls-certs\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-run-httpd\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-public-tls-certs\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-etc-swift\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c5klx\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-kube-api-access-c5klx\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-config-data\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.908935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-combined-ca-bundle\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.911049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-run-httpd\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.911356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-log-httpd\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.915026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-etc-swift\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.915047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-public-tls-certs\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.915663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-combined-ca-bundle\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.917807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-internal-tls-certs\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.917925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-config-data\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:25 crc kubenswrapper[4769]: I1121 12:19:25.934965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5klx\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-kube-api-access-c5klx\") pod \"swift-proxy-55999c7dfd-4r92w\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.065901 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.171627 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-685978c557-7zw6c" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.289323 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-685978c557-7zw6c"] Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.301571 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-685978c557-7zw6c"] Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.632925 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w"] Nov 21 12:19:26 crc kubenswrapper[4769]: W1121 12:19:26.638333 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b9329ea_65e5_4fff_978b_4cf7d1d1f68a.slice/crio-9011f110b487dc5975c4a5f3fcdb332ea253d47088e276eccb368f1ed988e685 WatchSource:0}: Error finding container 9011f110b487dc5975c4a5f3fcdb332ea253d47088e276eccb368f1ed988e685: Status 404 returned error can't find the container with id 9011f110b487dc5975c4a5f3fcdb332ea253d47088e276eccb368f1ed988e685 Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.864589 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-log-httpd\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-config-data\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6znjp\" (UniqueName: \"kubernetes.io/projected/3b5a798b-284e-49f6-bdda-87685fd9f51a-kube-api-access-6znjp\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-run-httpd\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-combined-ca-bundle\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-scripts\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.937469 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-sg-core-conf-yaml\") pod \"3b5a798b-284e-49f6-bdda-87685fd9f51a\" (UID: \"3b5a798b-284e-49f6-bdda-87685fd9f51a\") " Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.940705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.940950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.948331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5a798b-284e-49f6-bdda-87685fd9f51a-kube-api-access-6znjp" (OuterVolumeSpecName: "kube-api-access-6znjp") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "kube-api-access-6znjp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:26 crc kubenswrapper[4769]: I1121 12:19:26.954441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-scripts" (OuterVolumeSpecName: "scripts") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.006078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.038946 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6znjp\" (UniqueName: \"kubernetes.io/projected/3b5a798b-284e-49f6-bdda-87685fd9f51a-kube-api-access-6znjp\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.038990 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.039003 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.039015 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.039026 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3b5a798b-284e-49f6-bdda-87685fd9f51a-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.068168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.140211 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.162418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-config-data" (OuterVolumeSpecName: "config-data") pod "3b5a798b-284e-49f6-bdda-87685fd9f51a" (UID: "3b5a798b-284e-49f6-bdda-87685fd9f51a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.183722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" event={"ID":"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a","Type":"ContainerStarted","Data":"6e0e06803a8effabf9d9a369c8c4ee8c17297b3f91dfe329baf45669eb0960ae"} Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.183761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" event={"ID":"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a","Type":"ContainerStarted","Data":"81d493830474fa9ad25a97867794fbb2adc31b416d59455b4760c2202e02e4f8"} Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.183771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" event={"ID":"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a","Type":"ContainerStarted","Data":"9011f110b487dc5975c4a5f3fcdb332ea253d47088e276eccb368f1ed988e685"} Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.183783 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.183799 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.187707 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerID="13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6" exitCode=0 Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.187748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerDied","Data":"13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6"} Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.187771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3b5a798b-284e-49f6-bdda-87685fd9f51a","Type":"ContainerDied","Data":"6c47707fcb88ee53f1e9e32159654bffd03985aed708040142251a29fba55b38"} Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.187787 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.187796 4769 scope.go:117] "RemoveContainer" containerID="98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.230281 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" podStartSLOduration=2.230263569 podStartE2EDuration="2.230263569s" podCreationTimestamp="2025-11-21 12:19:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:27.214965048 +0000 UTC m=+1725.915626866" watchObservedRunningTime="2025-11-21 12:19:27.230263569 +0000 UTC m=+1725.930925387" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.231388 4769 scope.go:117] "RemoveContainer" containerID="a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.245422 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b5a798b-284e-49f6-bdda-87685fd9f51a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.251535 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.282402 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.284037 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.299563 4769 scope.go:117] "RemoveContainer" containerID="13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.316373 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd5a44f-54f7-47f6-989b-12774afaf58c" path="/var/lib/kubelet/pods/5bd5a44f-54f7-47f6-989b-12774afaf58c/volumes" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.317949 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.322774 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.323100 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-central-agent" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323119 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-central-agent" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.323133 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="proxy-httpd" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323140 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="proxy-httpd" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.323151 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-notification-agent" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323158 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-notification-agent" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.323172 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="sg-core" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323178 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="sg-core" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323375 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-central-agent" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323393 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="sg-core" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323404 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="proxy-httpd" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.323414 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" containerName="ceilometer-notification-agent" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.325058 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.327154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.329796 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.333115 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.337875 4769 scope.go:117] "RemoveContainer" containerID="3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.377615 4769 scope.go:117] "RemoveContainer" containerID="98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.378323 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146\": container with ID starting with 98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146 not found: ID does not exist" containerID="98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.378358 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146"} err="failed to get container status \"98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146\": rpc error: code = NotFound desc = could not find container \"98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146\": container with ID starting with 98dbbd211ecfc3a29e1eaf4619a092facc9e9d9166d0fe94c4e6cd8aba710146 not found: ID does not exist" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.378489 4769 scope.go:117] "RemoveContainer" containerID="a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.378727 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87\": container with ID starting with a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87 not found: ID does not exist" containerID="a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.378756 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87"} err="failed to get container status \"a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87\": rpc error: code = NotFound desc = could not find container \"a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87\": container with ID starting with a643e1b371cc1439cfdc8109210488d5f8bbf9bfd7fab0aa288036882ef11f87 not found: ID does not exist" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.378777 4769 scope.go:117] "RemoveContainer" containerID="13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.379469 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6\": container with ID starting with 13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6 not found: ID does not exist" containerID="13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.379501 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6"} err="failed to get container status \"13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6\": rpc error: code = NotFound desc = could not find container \"13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6\": container with ID starting with 13e9b8ef187f3a8e8e7d45c22cbc9f3cd9b0535a5e87d91ac281930ba94347e6 not found: ID does not exist" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.379520 4769 scope.go:117] "RemoveContainer" containerID="3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0" Nov 21 12:19:27 crc kubenswrapper[4769]: E1121 12:19:27.379762 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0\": container with ID starting with 3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0 not found: ID does not exist" containerID="3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.379791 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0"} err="failed to get container status \"3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0\": rpc error: code = NotFound desc = could not find container \"3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0\": container with ID starting with 3148665f6f345097b29dbca78e40f361ebd3f990b8bb054c3f0fd2e4bc5580b0 not found: ID does not exist" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.448867 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.448947 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.448977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-log-httpd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.449041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-config-data\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.449074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-run-httpd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.449105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-scripts\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.449153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ndd\" (UniqueName: \"kubernetes.io/projected/51264459-1d7c-40f6-8d2a-4bcee129338c-kube-api-access-q6ndd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-config-data\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-run-httpd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-scripts\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ndd\" (UniqueName: \"kubernetes.io/projected/51264459-1d7c-40f6-8d2a-4bcee129338c-kube-api-access-q6ndd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.550794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-log-httpd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.551253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-run-httpd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.551284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-log-httpd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.555331 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.555442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-scripts\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.556472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-config-data\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.558498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.574059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ndd\" (UniqueName: \"kubernetes.io/projected/51264459-1d7c-40f6-8d2a-4bcee129338c-kube-api-access-q6ndd\") pod \"ceilometer-0\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.644935 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:27 crc kubenswrapper[4769]: I1121 12:19:27.977742 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:28 crc kubenswrapper[4769]: I1121 12:19:28.205201 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerStarted","Data":"d304b6060338339ca77ead714b05ddef11ee5dd91b93885a28f42d62a004e11b"} Nov 21 12:19:29 crc kubenswrapper[4769]: I1121 12:19:29.219896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerStarted","Data":"7765a6151f9fc378aafe3b4aef9e2d7ff862638259a19c63936ec71138569cd6"} Nov 21 12:19:29 crc kubenswrapper[4769]: I1121 12:19:29.287130 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5a798b-284e-49f6-bdda-87685fd9f51a" path="/var/lib/kubelet/pods/3b5a798b-284e-49f6-bdda-87685fd9f51a/volumes" Nov 21 12:19:30 crc kubenswrapper[4769]: I1121 12:19:30.230579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerStarted","Data":"d2a154c53c2a28fdc925dca88900998e9e3cbaa7deb083745307d346be91a668"} Nov 21 12:19:31 crc kubenswrapper[4769]: I1121 12:19:31.081138 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:31 crc kubenswrapper[4769]: I1121 12:19:31.244959 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerStarted","Data":"5d7d79d4555b83c1f636ac60fe24dc4352c3ab679cdf54dc4356f55e2624a1b0"} Nov 21 12:19:31 crc kubenswrapper[4769]: I1121 12:19:31.413660 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:31 crc kubenswrapper[4769]: I1121 12:19:31.414295 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-log" containerID="cri-o://15462516bebe4c52f21813ad18301486ab84c611396c96a55d3d0a756f2c2c8e" gracePeriod=30 Nov 21 12:19:31 crc kubenswrapper[4769]: I1121 12:19:31.414544 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-httpd" containerID="cri-o://f6536d8dd0063b0237a1b960e0c20054bbd237f51508fe90686c83d6952e51fc" gracePeriod=30 Nov 21 12:19:32 crc kubenswrapper[4769]: I1121 12:19:32.206077 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:32 crc kubenswrapper[4769]: I1121 12:19:32.256869 4769 generic.go:334] "Generic (PLEG): container finished" podID="212f47da-fef4-4db1-a560-8a17ec789e49" containerID="15462516bebe4c52f21813ad18301486ab84c611396c96a55d3d0a756f2c2c8e" exitCode=143 Nov 21 12:19:32 crc kubenswrapper[4769]: I1121 12:19:32.256954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"212f47da-fef4-4db1-a560-8a17ec789e49","Type":"ContainerDied","Data":"15462516bebe4c52f21813ad18301486ab84c611396c96a55d3d0a756f2c2c8e"} Nov 21 12:19:32 crc kubenswrapper[4769]: I1121 12:19:32.260799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerStarted","Data":"97d8361eb9cf5994d3ff2a2661bc009a002766dc8c466b5648f9cd5c54ccf088"} Nov 21 12:19:32 crc kubenswrapper[4769]: I1121 12:19:32.260985 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:32 crc kubenswrapper[4769]: I1121 12:19:32.281897 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9281318029999999 podStartE2EDuration="5.281866602s" podCreationTimestamp="2025-11-21 12:19:27 +0000 UTC" firstStartedPulling="2025-11-21 12:19:28.011365056 +0000 UTC m=+1726.712026874" lastFinishedPulling="2025-11-21 12:19:31.365099855 +0000 UTC m=+1730.065761673" observedRunningTime="2025-11-21 12:19:32.280094164 +0000 UTC m=+1730.980755982" watchObservedRunningTime="2025-11-21 12:19:32.281866602 +0000 UTC m=+1730.982528420" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.181331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7wxht"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.182868 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.192736 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7wxht"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.243759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzvvn\" (UniqueName: \"kubernetes.io/projected/af5874bd-927a-49c2-b81e-c53567bf628d-kube-api-access-nzvvn\") pod \"nova-api-db-create-7wxht\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.243884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af5874bd-927a-49c2-b81e-c53567bf628d-operator-scripts\") pod \"nova-api-db-create-7wxht\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.292984 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-central-agent" containerID="cri-o://7765a6151f9fc378aafe3b4aef9e2d7ff862638259a19c63936ec71138569cd6" gracePeriod=30 Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.293545 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2pqkg"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.293610 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="proxy-httpd" containerID="cri-o://97d8361eb9cf5994d3ff2a2661bc009a002766dc8c466b5648f9cd5c54ccf088" gracePeriod=30 Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.293698 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="sg-core" containerID="cri-o://5d7d79d4555b83c1f636ac60fe24dc4352c3ab679cdf54dc4356f55e2624a1b0" gracePeriod=30 Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.293778 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-notification-agent" containerID="cri-o://d2a154c53c2a28fdc925dca88900998e9e3cbaa7deb083745307d346be91a668" gracePeriod=30 Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.295012 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.301156 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0895-account-create-hrqp5"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.302762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.306694 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.329344 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2pqkg"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.339387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0895-account-create-hrqp5"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.351095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7h47\" (UniqueName: \"kubernetes.io/projected/6b1bbf46-3f46-4554-9360-ed74840503cd-kube-api-access-z7h47\") pod \"nova-cell0-db-create-2pqkg\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.351242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6b1bbf46-3f46-4554-9360-ed74840503cd-operator-scripts\") pod \"nova-cell0-db-create-2pqkg\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.355090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nzvvn\" (UniqueName: \"kubernetes.io/projected/af5874bd-927a-49c2-b81e-c53567bf628d-kube-api-access-nzvvn\") pod \"nova-api-db-create-7wxht\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.355202 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-operator-scripts\") pod \"nova-api-0895-account-create-hrqp5\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.355232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc62l\" (UniqueName: \"kubernetes.io/projected/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-kube-api-access-dc62l\") pod \"nova-api-0895-account-create-hrqp5\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.358787 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af5874bd-927a-49c2-b81e-c53567bf628d-operator-scripts\") pod \"nova-api-db-create-7wxht\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.359566 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af5874bd-927a-49c2-b81e-c53567bf628d-operator-scripts\") pod \"nova-api-db-create-7wxht\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.377580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzvvn\" (UniqueName: \"kubernetes.io/projected/af5874bd-927a-49c2-b81e-c53567bf628d-kube-api-access-nzvvn\") pod \"nova-api-db-create-7wxht\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.460475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z7h47\" (UniqueName: \"kubernetes.io/projected/6b1bbf46-3f46-4554-9360-ed74840503cd-kube-api-access-z7h47\") pod \"nova-cell0-db-create-2pqkg\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.460563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6b1bbf46-3f46-4554-9360-ed74840503cd-operator-scripts\") pod \"nova-cell0-db-create-2pqkg\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.460636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-operator-scripts\") pod \"nova-api-0895-account-create-hrqp5\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.460664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dc62l\" (UniqueName: \"kubernetes.io/projected/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-kube-api-access-dc62l\") pod \"nova-api-0895-account-create-hrqp5\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.462073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6b1bbf46-3f46-4554-9360-ed74840503cd-operator-scripts\") pod \"nova-cell0-db-create-2pqkg\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.462723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-operator-scripts\") pod \"nova-api-0895-account-create-hrqp5\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.486723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc62l\" (UniqueName: \"kubernetes.io/projected/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-kube-api-access-dc62l\") pod \"nova-api-0895-account-create-hrqp5\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.488255 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-hxspj"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.489147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7h47\" (UniqueName: \"kubernetes.io/projected/6b1bbf46-3f46-4554-9360-ed74840503cd-kube-api-access-z7h47\") pod \"nova-cell0-db-create-2pqkg\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.489761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.503290 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-hxspj"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.514278 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.515709 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.523568 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.530134 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.543053 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.562200 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/591df651-4d68-41ac-b196-e2e50dcda057-operator-scripts\") pod \"nova-cell0-8ae7-account-create-htxf4\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.562309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk7dm\" (UniqueName: \"kubernetes.io/projected/df538c98-029e-4335-a317-1f089ec4147c-kube-api-access-hk7dm\") pod \"nova-cell1-db-create-hxspj\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.562843 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vm9x\" (UniqueName: \"kubernetes.io/projected/591df651-4d68-41ac-b196-e2e50dcda057-kube-api-access-5vm9x\") pod \"nova-cell0-8ae7-account-create-htxf4\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.562875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df538c98-029e-4335-a317-1f089ec4147c-operator-scripts\") pod \"nova-cell1-db-create-hxspj\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.635707 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.658416 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.667401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5vm9x\" (UniqueName: \"kubernetes.io/projected/591df651-4d68-41ac-b196-e2e50dcda057-kube-api-access-5vm9x\") pod \"nova-cell0-8ae7-account-create-htxf4\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.667462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df538c98-029e-4335-a317-1f089ec4147c-operator-scripts\") pod \"nova-cell1-db-create-hxspj\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.667532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/591df651-4d68-41ac-b196-e2e50dcda057-operator-scripts\") pod \"nova-cell0-8ae7-account-create-htxf4\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.667598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hk7dm\" (UniqueName: \"kubernetes.io/projected/df538c98-029e-4335-a317-1f089ec4147c-kube-api-access-hk7dm\") pod \"nova-cell1-db-create-hxspj\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.669948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/591df651-4d68-41ac-b196-e2e50dcda057-operator-scripts\") pod \"nova-cell0-8ae7-account-create-htxf4\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.670016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df538c98-029e-4335-a317-1f089ec4147c-operator-scripts\") pod \"nova-cell1-db-create-hxspj\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.710882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vm9x\" (UniqueName: \"kubernetes.io/projected/591df651-4d68-41ac-b196-e2e50dcda057-kube-api-access-5vm9x\") pod \"nova-cell0-8ae7-account-create-htxf4\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.719809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk7dm\" (UniqueName: \"kubernetes.io/projected/df538c98-029e-4335-a317-1f089ec4147c-kube-api-access-hk7dm\") pod \"nova-cell1-db-create-hxspj\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.719900 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.722023 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.725598 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.732113 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj"] Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.772798 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lkf\" (UniqueName: \"kubernetes.io/projected/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-kube-api-access-58lkf\") pod \"nova-cell1-f8ac-account-create-lwlsj\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.781392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-operator-scripts\") pod \"nova-cell1-f8ac-account-create-lwlsj\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.885341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58lkf\" (UniqueName: \"kubernetes.io/projected/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-kube-api-access-58lkf\") pod \"nova-cell1-f8ac-account-create-lwlsj\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.885836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-operator-scripts\") pod \"nova-cell1-f8ac-account-create-lwlsj\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.886669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-operator-scripts\") pod \"nova-cell1-f8ac-account-create-lwlsj\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.908556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lkf\" (UniqueName: \"kubernetes.io/projected/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-kube-api-access-58lkf\") pod \"nova-cell1-f8ac-account-create-lwlsj\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.940073 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:33 crc kubenswrapper[4769]: I1121 12:19:33.961179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.064925 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.078263 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7wxht"] Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.256649 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2pqkg"] Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.317971 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" event={"ID":"6b1bbf46-3f46-4554-9360-ed74840503cd","Type":"ContainerStarted","Data":"ca537f2c44b391874f8980ad366b4e0545af0c7b5c12e90824968bf1e18b6667"} Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.320354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" event={"ID":"af5874bd-927a-49c2-b81e-c53567bf628d","Type":"ContainerStarted","Data":"bc5855374e0e0132e6e1b6a021fbbe79342ea5a7e2e01b4be02c83e133ee5f30"} Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.340363 4769 generic.go:334] "Generic (PLEG): container finished" podID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerID="97d8361eb9cf5994d3ff2a2661bc009a002766dc8c466b5648f9cd5c54ccf088" exitCode=0 Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.340397 4769 generic.go:334] "Generic (PLEG): container finished" podID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerID="5d7d79d4555b83c1f636ac60fe24dc4352c3ab679cdf54dc4356f55e2624a1b0" exitCode=2 Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.340404 4769 generic.go:334] "Generic (PLEG): container finished" podID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerID="d2a154c53c2a28fdc925dca88900998e9e3cbaa7deb083745307d346be91a668" exitCode=0 Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.340423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerDied","Data":"97d8361eb9cf5994d3ff2a2661bc009a002766dc8c466b5648f9cd5c54ccf088"} Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.340682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerDied","Data":"5d7d79d4555b83c1f636ac60fe24dc4352c3ab679cdf54dc4356f55e2624a1b0"} Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.340709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerDied","Data":"d2a154c53c2a28fdc925dca88900998e9e3cbaa7deb083745307d346be91a668"} Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.376815 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0895-account-create-hrqp5"] Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.434348 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-hxspj"] Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.731552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4"] Nov 21 12:19:34 crc kubenswrapper[4769]: I1121 12:19:34.744036 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj"] Nov 21 12:19:34 crc kubenswrapper[4769]: W1121 12:19:34.744867 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod591df651_4d68_41ac_b196_e2e50dcda057.slice/crio-155c18b574f6eae98404c8e03f6832cbedac4b4937d0bd9d9b9290be0df518f9 WatchSource:0}: Error finding container 155c18b574f6eae98404c8e03f6832cbedac4b4937d0bd9d9b9290be0df518f9: Status 404 returned error can't find the container with id 155c18b574f6eae98404c8e03f6832cbedac4b4937d0bd9d9b9290be0df518f9 Nov 21 12:19:34 crc kubenswrapper[4769]: W1121 12:19:34.759337 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5e37e9c_26c8_4f10_a2f1_7fc41442f45a.slice/crio-cd063e01f86929b352a90fbcad5a73b93b063bd4f42f1206fa53c4733b110176 WatchSource:0}: Error finding container cd063e01f86929b352a90fbcad5a73b93b063bd4f42f1206fa53c4733b110176: Status 404 returned error can't find the container with id cd063e01f86929b352a90fbcad5a73b93b063bd4f42f1206fa53c4733b110176 Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.366892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" event={"ID":"591df651-4d68-41ac-b196-e2e50dcda057","Type":"ContainerStarted","Data":"155c18b574f6eae98404c8e03f6832cbedac4b4937d0bd9d9b9290be0df518f9"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.371962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" event={"ID":"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a","Type":"ContainerStarted","Data":"e51bdf5e4580a711d7c70afb7fd10e1bdf8344e344c5a7a77a65232883d6b35a"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.372015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" event={"ID":"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a","Type":"ContainerStarted","Data":"8d4269e677c3260f664f995ccc466158c8f0545e1c8b2e64b9d6598bde31c41d"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.378846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" event={"ID":"df538c98-029e-4335-a317-1f089ec4147c","Type":"ContainerStarted","Data":"069e5b8cd8670a4dd808e46d27dbb2a38a528a36a6ea1bfef5657e6a58b6911a"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.378919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" event={"ID":"df538c98-029e-4335-a317-1f089ec4147c","Type":"ContainerStarted","Data":"082c505ca53f384918ee8c9f3b1e0c226d2aeebab7fe1e77cf4c1ad577ebdbe9"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.393235 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" podStartSLOduration=2.393210291 podStartE2EDuration="2.393210291s" podCreationTimestamp="2025-11-21 12:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:35.390235161 +0000 UTC m=+1734.090896979" watchObservedRunningTime="2025-11-21 12:19:35.393210291 +0000 UTC m=+1734.093872109" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.397130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" event={"ID":"6b1bbf46-3f46-4554-9360-ed74840503cd","Type":"ContainerStarted","Data":"00339e29effc02ef1f6437f487b25807a1ebf8db6f9d3d81dc49ffc945247daf"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.416578 4769 generic.go:334] "Generic (PLEG): container finished" podID="af5874bd-927a-49c2-b81e-c53567bf628d" containerID="08cd50ee4778bd7560c34abd7843c3a7cdbe4b8a4c929d1db3a500bd5eab8a7f" exitCode=0 Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.417263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" event={"ID":"af5874bd-927a-49c2-b81e-c53567bf628d","Type":"ContainerDied","Data":"08cd50ee4778bd7560c34abd7843c3a7cdbe4b8a4c929d1db3a500bd5eab8a7f"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.423380 4769 generic.go:334] "Generic (PLEG): container finished" podID="212f47da-fef4-4db1-a560-8a17ec789e49" containerID="f6536d8dd0063b0237a1b960e0c20054bbd237f51508fe90686c83d6952e51fc" exitCode=0 Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.423484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"212f47da-fef4-4db1-a560-8a17ec789e49","Type":"ContainerDied","Data":"f6536d8dd0063b0237a1b960e0c20054bbd237f51508fe90686c83d6952e51fc"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.428376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" event={"ID":"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a","Type":"ContainerStarted","Data":"21824c43187f9dfb26d16e8013467f9af3e2180912cb19ba8226b3a99a986a31"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.428425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" event={"ID":"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a","Type":"ContainerStarted","Data":"cd063e01f86929b352a90fbcad5a73b93b063bd4f42f1206fa53c4733b110176"} Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.429469 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" podStartSLOduration=2.429323153 podStartE2EDuration="2.429323153s" podCreationTimestamp="2025-11-21 12:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:35.41657511 +0000 UTC m=+1734.117236938" watchObservedRunningTime="2025-11-21 12:19:35.429323153 +0000 UTC m=+1734.129984971" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.443912 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" podStartSLOduration=2.443882104 podStartE2EDuration="2.443882104s" podCreationTimestamp="2025-11-21 12:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:35.441764567 +0000 UTC m=+1734.142426405" watchObservedRunningTime="2025-11-21 12:19:35.443882104 +0000 UTC m=+1734.144543922" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.487509 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" podStartSLOduration=2.487486247 podStartE2EDuration="2.487486247s" podCreationTimestamp="2025-11-21 12:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:35.483844409 +0000 UTC m=+1734.184506227" watchObservedRunningTime="2025-11-21 12:19:35.487486247 +0000 UTC m=+1734.188148075" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.762290 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.762701 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-log" containerID="cri-o://96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9" gracePeriod=30 Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.762906 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-httpd" containerID="cri-o://5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266" gracePeriod=30 Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.817317 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.937555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-public-tls-certs\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.937651 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-logs\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.937832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mll6r\" (UniqueName: \"kubernetes.io/projected/212f47da-fef4-4db1-a560-8a17ec789e49-kube-api-access-mll6r\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.937876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-combined-ca-bundle\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.938043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-config-data\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.938090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.938132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-scripts\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.938246 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-httpd-run\") pod \"212f47da-fef4-4db1-a560-8a17ec789e49\" (UID: \"212f47da-fef4-4db1-a560-8a17ec789e49\") " Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.949987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.952412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.953586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212f47da-fef4-4db1-a560-8a17ec789e49-kube-api-access-mll6r" (OuterVolumeSpecName: "kube-api-access-mll6r") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "kube-api-access-mll6r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.954352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-scripts" (OuterVolumeSpecName: "scripts") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.974734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-logs" (OuterVolumeSpecName: "logs") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:35 crc kubenswrapper[4769]: I1121 12:19:35.983018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.010967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.035770 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-config-data" (OuterVolumeSpecName: "config-data") pod "212f47da-fef4-4db1-a560-8a17ec789e49" (UID: "212f47da-fef4-4db1-a560-8a17ec789e49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041109 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041149 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041206 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041219 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041232 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041244 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/212f47da-fef4-4db1-a560-8a17ec789e49-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041255 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/212f47da-fef4-4db1-a560-8a17ec789e49-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.041267 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mll6r\" (UniqueName: \"kubernetes.io/projected/212f47da-fef4-4db1-a560-8a17ec789e49-kube-api-access-mll6r\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.073474 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.076473 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.143422 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.457555 4769 generic.go:334] "Generic (PLEG): container finished" podID="df538c98-029e-4335-a317-1f089ec4147c" containerID="069e5b8cd8670a4dd808e46d27dbb2a38a528a36a6ea1bfef5657e6a58b6911a" exitCode=0 Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.457670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" event={"ID":"df538c98-029e-4335-a317-1f089ec4147c","Type":"ContainerDied","Data":"069e5b8cd8670a4dd808e46d27dbb2a38a528a36a6ea1bfef5657e6a58b6911a"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.460372 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b1bbf46-3f46-4554-9360-ed74840503cd" containerID="00339e29effc02ef1f6437f487b25807a1ebf8db6f9d3d81dc49ffc945247daf" exitCode=0 Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.460462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" event={"ID":"6b1bbf46-3f46-4554-9360-ed74840503cd","Type":"ContainerDied","Data":"00339e29effc02ef1f6437f487b25807a1ebf8db6f9d3d81dc49ffc945247daf"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.463081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"212f47da-fef4-4db1-a560-8a17ec789e49","Type":"ContainerDied","Data":"08ccc3f576a62b81d93112ad5bf972a1ff0171860a61ab55308e2b39fb0076b6"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.463133 4769 scope.go:117] "RemoveContainer" containerID="f6536d8dd0063b0237a1b960e0c20054bbd237f51508fe90686c83d6952e51fc" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.463309 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.475522 4769 generic.go:334] "Generic (PLEG): container finished" podID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerID="96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9" exitCode=143 Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.475599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"57080d99-0ce3-47cc-adca-cb7dfad8e99f","Type":"ContainerDied","Data":"96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.481619 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" containerID="21824c43187f9dfb26d16e8013467f9af3e2180912cb19ba8226b3a99a986a31" exitCode=0 Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.481685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" event={"ID":"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a","Type":"ContainerDied","Data":"21824c43187f9dfb26d16e8013467f9af3e2180912cb19ba8226b3a99a986a31"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.484084 4769 generic.go:334] "Generic (PLEG): container finished" podID="591df651-4d68-41ac-b196-e2e50dcda057" containerID="4582c56726a1a1fb28d010e1ba4770b3c6d68ccdaffb117e7ed2f36e0894f0f6" exitCode=0 Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.484157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" event={"ID":"591df651-4d68-41ac-b196-e2e50dcda057","Type":"ContainerDied","Data":"4582c56726a1a1fb28d010e1ba4770b3c6d68ccdaffb117e7ed2f36e0894f0f6"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.485496 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" containerID="e51bdf5e4580a711d7c70afb7fd10e1bdf8344e344c5a7a77a65232883d6b35a" exitCode=0 Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.485587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" event={"ID":"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a","Type":"ContainerDied","Data":"e51bdf5e4580a711d7c70afb7fd10e1bdf8344e344c5a7a77a65232883d6b35a"} Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.509280 4769 scope.go:117] "RemoveContainer" containerID="15462516bebe4c52f21813ad18301486ab84c611396c96a55d3d0a756f2c2c8e" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.565856 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.579137 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.598563 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:36 crc kubenswrapper[4769]: E1121 12:19:36.599023 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-httpd" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.599049 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-httpd" Nov 21 12:19:36 crc kubenswrapper[4769]: E1121 12:19:36.599091 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-log" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.599101 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-log" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.599330 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-httpd" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.599365 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" containerName="glance-log" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.602539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.610750 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.611786 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.611874 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754104 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-config-data\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-logs\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754677 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvsk\" (UniqueName: \"kubernetes.io/projected/d201fa7e-e3af-41a6-909e-2746298322c6-kube-api-access-jlvsk\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.754790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-scripts\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.856420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.856882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-scripts\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.856935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-config-data\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-logs\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857336 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvsk\" (UniqueName: \"kubernetes.io/projected/d201fa7e-e3af-41a6-909e-2746298322c6-kube-api-access-jlvsk\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857517 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.857535 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-logs\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.863659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.864459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.867272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-scripts\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.872181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-config-data\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.877221 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvsk\" (UniqueName: \"kubernetes.io/projected/d201fa7e-e3af-41a6-909e-2746298322c6-kube-api-access-jlvsk\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.887454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"glance-default-external-api-0\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.939902 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:36 crc kubenswrapper[4769]: I1121 12:19:36.959576 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.060757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzvvn\" (UniqueName: \"kubernetes.io/projected/af5874bd-927a-49c2-b81e-c53567bf628d-kube-api-access-nzvvn\") pod \"af5874bd-927a-49c2-b81e-c53567bf628d\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.060810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af5874bd-927a-49c2-b81e-c53567bf628d-operator-scripts\") pod \"af5874bd-927a-49c2-b81e-c53567bf628d\" (UID: \"af5874bd-927a-49c2-b81e-c53567bf628d\") " Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.061515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af5874bd-927a-49c2-b81e-c53567bf628d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "af5874bd-927a-49c2-b81e-c53567bf628d" (UID: "af5874bd-927a-49c2-b81e-c53567bf628d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.064999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af5874bd-927a-49c2-b81e-c53567bf628d-kube-api-access-nzvvn" (OuterVolumeSpecName: "kube-api-access-nzvvn") pod "af5874bd-927a-49c2-b81e-c53567bf628d" (UID: "af5874bd-927a-49c2-b81e-c53567bf628d"). InnerVolumeSpecName "kube-api-access-nzvvn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.163016 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzvvn\" (UniqueName: \"kubernetes.io/projected/af5874bd-927a-49c2-b81e-c53567bf628d-kube-api-access-nzvvn\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.163060 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af5874bd-927a-49c2-b81e-c53567bf628d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.284705 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="212f47da-fef4-4db1-a560-8a17ec789e49" path="/var/lib/kubelet/pods/212f47da-fef4-4db1-a560-8a17ec789e49/volumes" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.470253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.501722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" event={"ID":"af5874bd-927a-49c2-b81e-c53567bf628d","Type":"ContainerDied","Data":"bc5855374e0e0132e6e1b6a021fbbe79342ea5a7e2e01b4be02c83e133ee5f30"} Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.501815 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7wxht" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.504307 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc5855374e0e0132e6e1b6a021fbbe79342ea5a7e2e01b4be02c83e133ee5f30" Nov 21 12:19:37 crc kubenswrapper[4769]: I1121 12:19:37.510162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d201fa7e-e3af-41a6-909e-2746298322c6","Type":"ContainerStarted","Data":"bde64e90f27e4f9f75532c10b961af4c9f712d7476b20a0439b03383bf1390ea"} Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.038085 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.204316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58lkf\" (UniqueName: \"kubernetes.io/projected/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-kube-api-access-58lkf\") pod \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.204456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-operator-scripts\") pod \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\" (UID: \"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.206198 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" (UID: "f5e37e9c-26c8-4f10-a2f1-7fc41442f45a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.216452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-kube-api-access-58lkf" (OuterVolumeSpecName: "kube-api-access-58lkf") pod "f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" (UID: "f5e37e9c-26c8-4f10-a2f1-7fc41442f45a"). InnerVolumeSpecName "kube-api-access-58lkf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.282555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.310128 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-58lkf\" (UniqueName: \"kubernetes.io/projected/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-kube-api-access-58lkf\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.310151 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.314677 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.336403 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.363895 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.410915 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-operator-scripts\") pod \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.411155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc62l\" (UniqueName: \"kubernetes.io/projected/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-kube-api-access-dc62l\") pod \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\" (UID: \"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.411274 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7h47\" (UniqueName: \"kubernetes.io/projected/6b1bbf46-3f46-4554-9360-ed74840503cd-kube-api-access-z7h47\") pod \"6b1bbf46-3f46-4554-9360-ed74840503cd\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.411392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/591df651-4d68-41ac-b196-e2e50dcda057-operator-scripts\") pod \"591df651-4d68-41ac-b196-e2e50dcda057\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.411518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6b1bbf46-3f46-4554-9360-ed74840503cd-operator-scripts\") pod \"6b1bbf46-3f46-4554-9360-ed74840503cd\" (UID: \"6b1bbf46-3f46-4554-9360-ed74840503cd\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.411597 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vm9x\" (UniqueName: \"kubernetes.io/projected/591df651-4d68-41ac-b196-e2e50dcda057-kube-api-access-5vm9x\") pod \"591df651-4d68-41ac-b196-e2e50dcda057\" (UID: \"591df651-4d68-41ac-b196-e2e50dcda057\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.415625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/591df651-4d68-41ac-b196-e2e50dcda057-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "591df651-4d68-41ac-b196-e2e50dcda057" (UID: "591df651-4d68-41ac-b196-e2e50dcda057"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.417163 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/591df651-4d68-41ac-b196-e2e50dcda057-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.424320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1bbf46-3f46-4554-9360-ed74840503cd-kube-api-access-z7h47" (OuterVolumeSpecName: "kube-api-access-z7h47") pod "6b1bbf46-3f46-4554-9360-ed74840503cd" (UID: "6b1bbf46-3f46-4554-9360-ed74840503cd"). InnerVolumeSpecName "kube-api-access-z7h47". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.428707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1bbf46-3f46-4554-9360-ed74840503cd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6b1bbf46-3f46-4554-9360-ed74840503cd" (UID: "6b1bbf46-3f46-4554-9360-ed74840503cd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.432461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/591df651-4d68-41ac-b196-e2e50dcda057-kube-api-access-5vm9x" (OuterVolumeSpecName: "kube-api-access-5vm9x") pod "591df651-4d68-41ac-b196-e2e50dcda057" (UID: "591df651-4d68-41ac-b196-e2e50dcda057"). InnerVolumeSpecName "kube-api-access-5vm9x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.442503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" (UID: "6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.449156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-kube-api-access-dc62l" (OuterVolumeSpecName: "kube-api-access-dc62l") pod "6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" (UID: "6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a"). InnerVolumeSpecName "kube-api-access-dc62l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.518755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df538c98-029e-4335-a317-1f089ec4147c-operator-scripts\") pod \"df538c98-029e-4335-a317-1f089ec4147c\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.518929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk7dm\" (UniqueName: \"kubernetes.io/projected/df538c98-029e-4335-a317-1f089ec4147c-kube-api-access-hk7dm\") pod \"df538c98-029e-4335-a317-1f089ec4147c\" (UID: \"df538c98-029e-4335-a317-1f089ec4147c\") " Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.519400 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.519414 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dc62l\" (UniqueName: \"kubernetes.io/projected/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a-kube-api-access-dc62l\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.519425 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z7h47\" (UniqueName: \"kubernetes.io/projected/6b1bbf46-3f46-4554-9360-ed74840503cd-kube-api-access-z7h47\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.519435 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6b1bbf46-3f46-4554-9360-ed74840503cd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.519445 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5vm9x\" (UniqueName: \"kubernetes.io/projected/591df651-4d68-41ac-b196-e2e50dcda057-kube-api-access-5vm9x\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.521366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df538c98-029e-4335-a317-1f089ec4147c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "df538c98-029e-4335-a317-1f089ec4147c" (UID: "df538c98-029e-4335-a317-1f089ec4147c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.532509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df538c98-029e-4335-a317-1f089ec4147c-kube-api-access-hk7dm" (OuterVolumeSpecName: "kube-api-access-hk7dm") pod "df538c98-029e-4335-a317-1f089ec4147c" (UID: "df538c98-029e-4335-a317-1f089ec4147c"). InnerVolumeSpecName "kube-api-access-hk7dm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.550567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" event={"ID":"f5e37e9c-26c8-4f10-a2f1-7fc41442f45a","Type":"ContainerDied","Data":"cd063e01f86929b352a90fbcad5a73b93b063bd4f42f1206fa53c4733b110176"} Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.550612 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd063e01f86929b352a90fbcad5a73b93b063bd4f42f1206fa53c4733b110176" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.550678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.556046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" event={"ID":"591df651-4d68-41ac-b196-e2e50dcda057","Type":"ContainerDied","Data":"155c18b574f6eae98404c8e03f6832cbedac4b4937d0bd9d9b9290be0df518f9"} Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.556115 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="155c18b574f6eae98404c8e03f6832cbedac4b4937d0bd9d9b9290be0df518f9" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.556219 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.565510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" event={"ID":"6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a","Type":"ContainerDied","Data":"8d4269e677c3260f664f995ccc466158c8f0545e1c8b2e64b9d6598bde31c41d"} Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.565769 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d4269e677c3260f664f995ccc466158c8f0545e1c8b2e64b9d6598bde31c41d" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.565887 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0895-account-create-hrqp5" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.572330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" event={"ID":"df538c98-029e-4335-a317-1f089ec4147c","Type":"ContainerDied","Data":"082c505ca53f384918ee8c9f3b1e0c226d2aeebab7fe1e77cf4c1ad577ebdbe9"} Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.572584 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="082c505ca53f384918ee8c9f3b1e0c226d2aeebab7fe1e77cf4c1ad577ebdbe9" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.572405 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-hxspj" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.573787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" event={"ID":"6b1bbf46-3f46-4554-9360-ed74840503cd","Type":"ContainerDied","Data":"ca537f2c44b391874f8980ad366b4e0545af0c7b5c12e90824968bf1e18b6667"} Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.573848 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2pqkg" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.573882 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca537f2c44b391874f8980ad366b4e0545af0c7b5c12e90824968bf1e18b6667" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.621107 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hk7dm\" (UniqueName: \"kubernetes.io/projected/df538c98-029e-4335-a317-1f089ec4147c-kube-api-access-hk7dm\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:38 crc kubenswrapper[4769]: I1121 12:19:38.621151 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/df538c98-029e-4335-a317-1f089ec4147c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.274635 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.275282 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.374937 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-logs\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-internal-tls-certs\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-scripts\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-combined-ca-bundle\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-httpd-run\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfzd4\" (UniqueName: \"kubernetes.io/projected/57080d99-0ce3-47cc-adca-cb7dfad8e99f-kube-api-access-vfzd4\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-config-data\") pod \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\" (UID: \"57080d99-0ce3-47cc-adca-cb7dfad8e99f\") " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.544760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-logs" (OuterVolumeSpecName: "logs") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.545050 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.546597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.549976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-scripts" (OuterVolumeSpecName: "scripts") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.551306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.552404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57080d99-0ce3-47cc-adca-cb7dfad8e99f-kube-api-access-vfzd4" (OuterVolumeSpecName: "kube-api-access-vfzd4") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "kube-api-access-vfzd4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.588765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.591230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d201fa7e-e3af-41a6-909e-2746298322c6","Type":"ContainerStarted","Data":"8f6ad774a8254888f3e2cdcdc28df21e19a43d07485d96c1026e8cf36d2a802b"} Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.591279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d201fa7e-e3af-41a6-909e-2746298322c6","Type":"ContainerStarted","Data":"b973ee449f9bf72036cb4a436ce753b74ac421ac2bfbdb5827c31daefe182113"} Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.594881 4769 generic.go:334] "Generic (PLEG): container finished" podID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerID="5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266" exitCode=0 Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.594962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"57080d99-0ce3-47cc-adca-cb7dfad8e99f","Type":"ContainerDied","Data":"5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266"} Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.594978 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.595009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"57080d99-0ce3-47cc-adca-cb7dfad8e99f","Type":"ContainerDied","Data":"da5c1f4640226659afa057597fc959dbc7572e58aea05ff17d6b0c4587b47280"} Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.595042 4769 scope.go:117] "RemoveContainer" containerID="5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.607940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-config-data" (OuterVolumeSpecName: "config-data") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.626276 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.626233119 podStartE2EDuration="3.626233119s" podCreationTimestamp="2025-11-21 12:19:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:39.613462485 +0000 UTC m=+1738.314124303" watchObservedRunningTime="2025-11-21 12:19:39.626233119 +0000 UTC m=+1738.326894937" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.636870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "57080d99-0ce3-47cc-adca-cb7dfad8e99f" (UID: "57080d99-0ce3-47cc-adca-cb7dfad8e99f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647132 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/57080d99-0ce3-47cc-adca-cb7dfad8e99f-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647174 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vfzd4\" (UniqueName: \"kubernetes.io/projected/57080d99-0ce3-47cc-adca-cb7dfad8e99f-kube-api-access-vfzd4\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647204 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647218 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647231 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647244 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57080d99-0ce3-47cc-adca-cb7dfad8e99f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.647296 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.669071 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.728695 4769 scope.go:117] "RemoveContainer" containerID="96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.750473 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.756427 4769 scope.go:117] "RemoveContainer" containerID="5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.756827 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266\": container with ID starting with 5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266 not found: ID does not exist" containerID="5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.756864 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266"} err="failed to get container status \"5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266\": rpc error: code = NotFound desc = could not find container \"5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266\": container with ID starting with 5cb58cd1db0e6942804c20193ad789067930cfe94fab33cbcdaf54f687680266 not found: ID does not exist" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.756896 4769 scope.go:117] "RemoveContainer" containerID="96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.757120 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9\": container with ID starting with 96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9 not found: ID does not exist" containerID="96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.757148 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9"} err="failed to get container status \"96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9\": rpc error: code = NotFound desc = could not find container \"96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9\": container with ID starting with 96dec1d80a8cf83bc447c689ad2dbaefdf9276b5323dff5d950058413ab2cdb9 not found: ID does not exist" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.927080 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.936814 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.986740 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987440 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df538c98-029e-4335-a317-1f089ec4147c" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df538c98-029e-4335-a317-1f089ec4147c" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987485 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="591df651-4d68-41ac-b196-e2e50dcda057" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987491 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="591df651-4d68-41ac-b196-e2e50dcda057" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987515 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987521 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987528 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-httpd" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987535 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-httpd" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af5874bd-927a-49c2-b81e-c53567bf628d" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987579 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af5874bd-927a-49c2-b81e-c53567bf628d" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987595 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b1bbf46-3f46-4554-9360-ed74840503cd" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987603 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1bbf46-3f46-4554-9360-ed74840503cd" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987624 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-log" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987633 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-log" Nov 21 12:19:39 crc kubenswrapper[4769]: E1121 12:19:39.987652 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987659 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.987996 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988019 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="591df651-4d68-41ac-b196-e2e50dcda057" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988032 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-log" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988048 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af5874bd-927a-49c2-b81e-c53567bf628d" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988060 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df538c98-029e-4335-a317-1f089ec4147c" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988077 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b1bbf46-3f46-4554-9360-ed74840503cd" containerName="mariadb-database-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988085 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" containerName="mariadb-account-create" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.988091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-httpd" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.991443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:39 crc kubenswrapper[4769]: I1121 12:19:39.997165 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.000253 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.020965 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vswfv\" (UniqueName: \"kubernetes.io/projected/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-kube-api-access-vswfv\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-logs\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.158995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vswfv\" (UniqueName: \"kubernetes.io/projected/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-kube-api-access-vswfv\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.260785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-logs\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.261152 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.261901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.262235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-logs\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.265959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.266476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.267751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.273294 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.280875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vswfv\" (UniqueName: \"kubernetes.io/projected/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-kube-api-access-vswfv\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.291015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.316354 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:40 crc kubenswrapper[4769]: I1121 12:19:40.798792 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:19:41 crc kubenswrapper[4769]: I1121 12:19:41.286242 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" path="/var/lib/kubelet/pods/57080d99-0ce3-47cc-adca-cb7dfad8e99f/volumes" Nov 21 12:19:41 crc kubenswrapper[4769]: I1121 12:19:41.618781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b","Type":"ContainerStarted","Data":"af1cd2d919c7575b7e57f4eda560fb0bf162892f90ce7176b43cfc178cc35b9b"} Nov 21 12:19:41 crc kubenswrapper[4769]: I1121 12:19:41.618832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b","Type":"ContainerStarted","Data":"8798e767ce2b1d61e03ddcd68f498c081c87ef1b2e2c3d44692cefcfb1abf288"} Nov 21 12:19:42 crc kubenswrapper[4769]: I1121 12:19:42.631633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b","Type":"ContainerStarted","Data":"dd0e43d5b60bac8f8a93051855b26f738ec15e9e35b816fa885086c681956cd3"} Nov 21 12:19:42 crc kubenswrapper[4769]: I1121 12:19:42.655884 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.655864151 podStartE2EDuration="3.655864151s" podCreationTimestamp="2025-11-21 12:19:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:42.652542202 +0000 UTC m=+1741.353204020" watchObservedRunningTime="2025-11-21 12:19:42.655864151 +0000 UTC m=+1741.356525959" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.788331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns"] Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.790374 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.794831 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.797948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-2thtk" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.800338 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns"] Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.802721 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.933158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvjf\" (UniqueName: \"kubernetes.io/projected/973b15fa-1930-453a-8883-2f6055881104-kube-api-access-fmvjf\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.933497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-config-data\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.933581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-scripts\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:43 crc kubenswrapper[4769]: I1121 12:19:43.933736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.036573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvjf\" (UniqueName: \"kubernetes.io/projected/973b15fa-1930-453a-8883-2f6055881104-kube-api-access-fmvjf\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.036664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-config-data\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.036730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-scripts\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.036809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.045036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.045274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-config-data\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.050497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-scripts\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.053742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvjf\" (UniqueName: \"kubernetes.io/projected/973b15fa-1930-453a-8883-2f6055881104-kube-api-access-fmvjf\") pod \"nova-cell0-conductor-db-sync-rxkns\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.108668 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.603708 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns"] Nov 21 12:19:44 crc kubenswrapper[4769]: W1121 12:19:44.604282 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod973b15fa_1930_453a_8883_2f6055881104.slice/crio-0d26917528c0b52488862329d85d807822a88b5c8893788e9a660088bfc08797 WatchSource:0}: Error finding container 0d26917528c0b52488862329d85d807822a88b5c8893788e9a660088bfc08797: Status 404 returned error can't find the container with id 0d26917528c0b52488862329d85d807822a88b5c8893788e9a660088bfc08797 Nov 21 12:19:44 crc kubenswrapper[4769]: I1121 12:19:44.651453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" event={"ID":"973b15fa-1930-453a-8883-2f6055881104","Type":"ContainerStarted","Data":"0d26917528c0b52488862329d85d807822a88b5c8893788e9a660088bfc08797"} Nov 21 12:19:45 crc kubenswrapper[4769]: I1121 12:19:45.662071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" event={"ID":"973b15fa-1930-453a-8883-2f6055881104","Type":"ContainerStarted","Data":"f125fe387f26e2346ffd033546dd0762f62f9638f26e967cb48e632be53c51b4"} Nov 21 12:19:45 crc kubenswrapper[4769]: I1121 12:19:45.682566 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" podStartSLOduration=2.682545624 podStartE2EDuration="2.682545624s" podCreationTimestamp="2025-11-21 12:19:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:45.674144248 +0000 UTC m=+1744.374806056" watchObservedRunningTime="2025-11-21 12:19:45.682545624 +0000 UTC m=+1744.383207452" Nov 21 12:19:46 crc kubenswrapper[4769]: I1121 12:19:46.941756 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:46 crc kubenswrapper[4769]: I1121 12:19:46.941820 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:46 crc kubenswrapper[4769]: I1121 12:19:46.981010 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:46 crc kubenswrapper[4769]: I1121 12:19:46.992281 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.692000 4769 generic.go:334] "Generic (PLEG): container finished" podID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerID="7765a6151f9fc378aafe3b4aef9e2d7ff862638259a19c63936ec71138569cd6" exitCode=0 Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.692315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerDied","Data":"7765a6151f9fc378aafe3b4aef9e2d7ff862638259a19c63936ec71138569cd6"} Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.692374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"51264459-1d7c-40f6-8d2a-4bcee129338c","Type":"ContainerDied","Data":"d304b6060338339ca77ead714b05ddef11ee5dd91b93885a28f42d62a004e11b"} Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.692391 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d304b6060338339ca77ead714b05ddef11ee5dd91b93885a28f42d62a004e11b" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.693729 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.693869 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.769680 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-combined-ca-bundle\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-log-httpd\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-config-data\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-run-httpd\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819794 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6ndd\" (UniqueName: \"kubernetes.io/projected/51264459-1d7c-40f6-8d2a-4bcee129338c-kube-api-access-q6ndd\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-sg-core-conf-yaml\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.819912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-scripts\") pod \"51264459-1d7c-40f6-8d2a-4bcee129338c\" (UID: \"51264459-1d7c-40f6-8d2a-4bcee129338c\") " Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.820291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.820717 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.821018 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.821044 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/51264459-1d7c-40f6-8d2a-4bcee129338c-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.831444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-scripts" (OuterVolumeSpecName: "scripts") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.831523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51264459-1d7c-40f6-8d2a-4bcee129338c-kube-api-access-q6ndd" (OuterVolumeSpecName: "kube-api-access-q6ndd") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "kube-api-access-q6ndd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.852940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.923665 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q6ndd\" (UniqueName: \"kubernetes.io/projected/51264459-1d7c-40f6-8d2a-4bcee129338c-kube-api-access-q6ndd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.923703 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.923714 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:47 crc kubenswrapper[4769]: I1121 12:19:47.962450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.007785 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-config-data" (OuterVolumeSpecName: "config-data") pod "51264459-1d7c-40f6-8d2a-4bcee129338c" (UID: "51264459-1d7c-40f6-8d2a-4bcee129338c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.027169 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.027227 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51264459-1d7c-40f6-8d2a-4bcee129338c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.701146 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.735729 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.747867 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.769766 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:48 crc kubenswrapper[4769]: E1121 12:19:48.770311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-central-agent" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770357 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-central-agent" Nov 21 12:19:48 crc kubenswrapper[4769]: E1121 12:19:48.770379 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="proxy-httpd" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770387 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="proxy-httpd" Nov 21 12:19:48 crc kubenswrapper[4769]: E1121 12:19:48.770411 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="sg-core" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770419 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="sg-core" Nov 21 12:19:48 crc kubenswrapper[4769]: E1121 12:19:48.770443 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-notification-agent" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770451 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-notification-agent" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770831 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="proxy-httpd" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770861 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="sg-core" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770876 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-notification-agent" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.770889 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" containerName="ceilometer-central-agent" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.772488 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.776232 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.776810 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.833043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848318 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848386 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqfjr\" (UniqueName: \"kubernetes.io/projected/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-kube-api-access-wqfjr\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-log-httpd\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-config-data\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-run-httpd\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.848577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-scripts\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.950721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-log-httpd\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.950793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-config-data\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.950849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.950922 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-run-httpd\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.950970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-scripts\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.951015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.951052 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wqfjr\" (UniqueName: \"kubernetes.io/projected/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-kube-api-access-wqfjr\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.951226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-log-httpd\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.951592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-run-httpd\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.964096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-scripts\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.964836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.965662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.972134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-config-data\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:48 crc kubenswrapper[4769]: I1121 12:19:48.975967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqfjr\" (UniqueName: \"kubernetes.io/projected/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-kube-api-access-wqfjr\") pod \"ceilometer-0\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.100816 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.293912 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51264459-1d7c-40f6-8d2a-4bcee129338c" path="/var/lib/kubelet/pods/51264459-1d7c-40f6-8d2a-4bcee129338c/volumes" Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.573609 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.639771 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.720143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerStarted","Data":"964828d4e3a62a93548e30295a7216789b3326f75e296bbc95426ffedfa8ff23"} Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.900155 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.900312 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:19:49 crc kubenswrapper[4769]: I1121 12:19:49.927087 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.197625 4769 scope.go:117] "RemoveContainer" containerID="e6c51f5f51aadac314cb671e020efafa42e3dcda60b4752ee3291249844eadbe" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.273275 4769 scope.go:117] "RemoveContainer" containerID="b403934044941318e6651375f51ecc36e5f81e00ee82f2ad2b8339c2ccc34436" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.274953 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:19:50 crc kubenswrapper[4769]: E1121 12:19:50.275406 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.317334 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.317524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.321492 4769 scope.go:117] "RemoveContainer" containerID="08dd1479e2aca203dc5fc7ddbe94e087322ff19616b2eac4eaec1b860695c9df" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.358971 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.360017 4769 scope.go:117] "RemoveContainer" containerID="e2af434dc306232267147efe73828515c9bba9485dca4c0bd7eec9d66aac63c1" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.373623 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.457030 4769 scope.go:117] "RemoveContainer" containerID="825404bc8ce92279a7a5d401738064f06529617a29ca5bd0b3a4deb729da83e9" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.497782 4769 scope.go:117] "RemoveContainer" containerID="f567395d75936121013d9336600af062b6f6f14dfc4ee8d5c7616466811f6ba7" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.521358 4769 scope.go:117] "RemoveContainer" containerID="2b55bae3a63d3f831b3a08b94885ec33ff4c786ace9e23aaaba0da7b74ddf29e" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.545304 4769 scope.go:117] "RemoveContainer" containerID="0f58a7d093708947f264330141cef846704d32a8005d80f147ef2f2cd05b2330" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.569821 4769 scope.go:117] "RemoveContainer" containerID="9d29b00738ee00debbe64c58fd28c69fdbf8efc91ce206a05e709e30b7fcbaca" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.608227 4769 scope.go:117] "RemoveContainer" containerID="fbafc96e6d3dce2d6bffff2fa908082675370a3d13436e13d7b8e6068abcdcb7" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.654621 4769 scope.go:117] "RemoveContainer" containerID="9ea8205172aeb3a656e89536efe402a8749679f702d232cc9123f84aa05720ff" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.704605 4769 scope.go:117] "RemoveContainer" containerID="c8ff59c06e10b72de9bf6a2f468f8a098c670c930fd78d9dd5beaf6ef3f19137" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.737253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerStarted","Data":"c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf"} Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.743515 4769 scope.go:117] "RemoveContainer" containerID="fb6193feb007cf67b31316497282420398830761390868d037e92991fc17586b" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.753093 4769 generic.go:334] "Generic (PLEG): container finished" podID="973b15fa-1930-453a-8883-2f6055881104" containerID="f125fe387f26e2346ffd033546dd0762f62f9638f26e967cb48e632be53c51b4" exitCode=0 Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.753358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" event={"ID":"973b15fa-1930-453a-8883-2f6055881104","Type":"ContainerDied","Data":"f125fe387f26e2346ffd033546dd0762f62f9638f26e967cb48e632be53c51b4"} Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.753580 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.753602 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.771232 4769 scope.go:117] "RemoveContainer" containerID="3280ce84ae2e0c5d3285a21265201bb2afe0ddd3d315a640fcf8a796827408e9" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.799282 4769 scope.go:117] "RemoveContainer" containerID="da4697819a0b98c949b52673594747ae7b4e374dc77098740107d6b34c0a4dfc" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.854225 4769 scope.go:117] "RemoveContainer" containerID="e19ea74af62eb79c61648d2fffb4a2f02b7aa934083f7aa2451ae2edceb04ec8" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.878023 4769 scope.go:117] "RemoveContainer" containerID="df69af6335fbc2ae6e047325ced14ef0bd4a272ac2738237c8359371a2f471fe" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.910054 4769 scope.go:117] "RemoveContainer" containerID="0f48367076d95c5b7b37b3d211fe0e2acd8c96859d43ead15c023207dab160f3" Nov 21 12:19:50 crc kubenswrapper[4769]: I1121 12:19:50.978622 4769 scope.go:117] "RemoveContainer" containerID="337739d7c6d68e563dbc1168d422c8896ff321520b12a745cb41f2efcbf22a32" Nov 21 12:19:51 crc kubenswrapper[4769]: I1121 12:19:51.046303 4769 scope.go:117] "RemoveContainer" containerID="e69a0f0ed22436a34cabf3ecae6cabee67d0e8b122d3a32b210fb84c9c1543b8" Nov 21 12:19:51 crc kubenswrapper[4769]: I1121 12:19:51.078328 4769 scope.go:117] "RemoveContainer" containerID="a19f4af7a3c8aa8c9c2ae885914cd7399f4163b4393cdbd396bc5759a3350ca6" Nov 21 12:19:51 crc kubenswrapper[4769]: I1121 12:19:51.774620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerStarted","Data":"95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d"} Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.260343 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.354877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-config-data\") pod \"973b15fa-1930-453a-8883-2f6055881104\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.355027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-scripts\") pod \"973b15fa-1930-453a-8883-2f6055881104\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.355090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmvjf\" (UniqueName: \"kubernetes.io/projected/973b15fa-1930-453a-8883-2f6055881104-kube-api-access-fmvjf\") pod \"973b15fa-1930-453a-8883-2f6055881104\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.355411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-combined-ca-bundle\") pod \"973b15fa-1930-453a-8883-2f6055881104\" (UID: \"973b15fa-1930-453a-8883-2f6055881104\") " Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.363816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-scripts" (OuterVolumeSpecName: "scripts") pod "973b15fa-1930-453a-8883-2f6055881104" (UID: "973b15fa-1930-453a-8883-2f6055881104"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.364492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973b15fa-1930-453a-8883-2f6055881104-kube-api-access-fmvjf" (OuterVolumeSpecName: "kube-api-access-fmvjf") pod "973b15fa-1930-453a-8883-2f6055881104" (UID: "973b15fa-1930-453a-8883-2f6055881104"). InnerVolumeSpecName "kube-api-access-fmvjf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.381161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "973b15fa-1930-453a-8883-2f6055881104" (UID: "973b15fa-1930-453a-8883-2f6055881104"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.394923 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-config-data" (OuterVolumeSpecName: "config-data") pod "973b15fa-1930-453a-8883-2f6055881104" (UID: "973b15fa-1930-453a-8883-2f6055881104"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.459242 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.459752 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.460548 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/973b15fa-1930-453a-8883-2f6055881104-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.460597 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fmvjf\" (UniqueName: \"kubernetes.io/projected/973b15fa-1930-453a-8883-2f6055881104-kube-api-access-fmvjf\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.796598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerStarted","Data":"516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3"} Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.799247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" event={"ID":"973b15fa-1930-453a-8883-2f6055881104","Type":"ContainerDied","Data":"0d26917528c0b52488862329d85d807822a88b5c8893788e9a660088bfc08797"} Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.799286 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d26917528c0b52488862329d85d807822a88b5c8893788e9a660088bfc08797" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.799444 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.872256 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:52 crc kubenswrapper[4769]: E1121 12:19:52.872706 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="973b15fa-1930-453a-8883-2f6055881104" containerName="nova-cell0-conductor-db-sync" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.872723 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="973b15fa-1930-453a-8883-2f6055881104" containerName="nova-cell0-conductor-db-sync" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.872947 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="973b15fa-1930-453a-8883-2f6055881104" containerName="nova-cell0-conductor-db-sync" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.873587 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.875964 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-2thtk" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.882903 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.892980 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.970317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qr6\" (UniqueName: \"kubernetes.io/projected/41579dd4-9a25-404c-b3ee-488f4847c38d-kube-api-access-92qr6\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.970767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:52 crc kubenswrapper[4769]: I1121 12:19:52.971035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.072156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.072265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-92qr6\" (UniqueName: \"kubernetes.io/projected/41579dd4-9a25-404c-b3ee-488f4847c38d-kube-api-access-92qr6\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.072299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.078543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.087643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.091659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qr6\" (UniqueName: \"kubernetes.io/projected/41579dd4-9a25-404c-b3ee-488f4847c38d-kube-api-access-92qr6\") pod \"nova-cell0-conductor-0\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.198218 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.429841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.431448 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.561282 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.695256 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:53 crc kubenswrapper[4769]: I1121 12:19:53.810211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"41579dd4-9a25-404c-b3ee-488f4847c38d","Type":"ContainerStarted","Data":"8a9b159727bbbd6a6403f6d18590ae9f9f5951a761631969adfc8b58554fbee0"} Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.831020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"41579dd4-9a25-404c-b3ee-488f4847c38d","Type":"ContainerStarted","Data":"92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52"} Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.831422 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.834429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerStarted","Data":"0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719"} Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.834686 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-central-agent" containerID="cri-o://c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf" gracePeriod=30 Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.836582 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.836677 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="proxy-httpd" containerID="cri-o://0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719" gracePeriod=30 Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.836743 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="sg-core" containerID="cri-o://516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3" gracePeriod=30 Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.836789 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-notification-agent" containerID="cri-o://95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d" gracePeriod=30 Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.855261 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.855243746 podStartE2EDuration="2.855243746s" podCreationTimestamp="2025-11-21 12:19:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:19:54.852772959 +0000 UTC m=+1753.553434777" watchObservedRunningTime="2025-11-21 12:19:54.855243746 +0000 UTC m=+1753.555905554" Nov 21 12:19:54 crc kubenswrapper[4769]: I1121 12:19:54.880223 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.997221343 podStartE2EDuration="6.880205827s" podCreationTimestamp="2025-11-21 12:19:48 +0000 UTC" firstStartedPulling="2025-11-21 12:19:49.65153491 +0000 UTC m=+1748.352196738" lastFinishedPulling="2025-11-21 12:19:53.534519404 +0000 UTC m=+1752.235181222" observedRunningTime="2025-11-21 12:19:54.872822118 +0000 UTC m=+1753.573483936" watchObservedRunningTime="2025-11-21 12:19:54.880205827 +0000 UTC m=+1753.580867645" Nov 21 12:19:55 crc kubenswrapper[4769]: I1121 12:19:55.848864 4769 generic.go:334] "Generic (PLEG): container finished" podID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerID="0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719" exitCode=0 Nov 21 12:19:55 crc kubenswrapper[4769]: I1121 12:19:55.849135 4769 generic.go:334] "Generic (PLEG): container finished" podID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerID="516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3" exitCode=2 Nov 21 12:19:55 crc kubenswrapper[4769]: I1121 12:19:55.849148 4769 generic.go:334] "Generic (PLEG): container finished" podID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerID="95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d" exitCode=0 Nov 21 12:19:55 crc kubenswrapper[4769]: I1121 12:19:55.849081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerDied","Data":"0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719"} Nov 21 12:19:55 crc kubenswrapper[4769]: I1121 12:19:55.849253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerDied","Data":"516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3"} Nov 21 12:19:55 crc kubenswrapper[4769]: I1121 12:19:55.849266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerDied","Data":"95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d"} Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.629850 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.765732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-scripts\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.765827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-log-httpd\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.765945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-run-httpd\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766019 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-config-data\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-combined-ca-bundle\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766147 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-sg-core-conf-yaml\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqfjr\" (UniqueName: \"kubernetes.io/projected/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-kube-api-access-wqfjr\") pod \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\" (UID: \"645b5e4d-d7a2-44c3-9295-64f927d2ad9c\") " Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766833 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.766859 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.770720 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-scripts" (OuterVolumeSpecName: "scripts") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.776345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-kube-api-access-wqfjr" (OuterVolumeSpecName: "kube-api-access-wqfjr") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "kube-api-access-wqfjr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.812053 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.870338 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.870376 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wqfjr\" (UniqueName: \"kubernetes.io/projected/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-kube-api-access-wqfjr\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.870390 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.874306 4769 generic.go:334] "Generic (PLEG): container finished" podID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerID="c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf" exitCode=0 Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.874394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerDied","Data":"c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf"} Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.874416 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.874454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"645b5e4d-d7a2-44c3-9295-64f927d2ad9c","Type":"ContainerDied","Data":"964828d4e3a62a93548e30295a7216789b3326f75e296bbc95426ffedfa8ff23"} Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.874480 4769 scope.go:117] "RemoveContainer" containerID="0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.878858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.898561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-config-data" (OuterVolumeSpecName: "config-data") pod "645b5e4d-d7a2-44c3-9295-64f927d2ad9c" (UID: "645b5e4d-d7a2-44c3-9295-64f927d2ad9c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.902306 4769 scope.go:117] "RemoveContainer" containerID="516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.930420 4769 scope.go:117] "RemoveContainer" containerID="95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.954162 4769 scope.go:117] "RemoveContainer" containerID="c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.972591 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.972634 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/645b5e4d-d7a2-44c3-9295-64f927d2ad9c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.979757 4769 scope.go:117] "RemoveContainer" containerID="0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719" Nov 21 12:19:57 crc kubenswrapper[4769]: E1121 12:19:57.980395 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719\": container with ID starting with 0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719 not found: ID does not exist" containerID="0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.980445 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719"} err="failed to get container status \"0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719\": rpc error: code = NotFound desc = could not find container \"0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719\": container with ID starting with 0185c41d7a831c10f23fc3a24f29f326b6784f42af7396057c56b0fd6faac719 not found: ID does not exist" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.980478 4769 scope.go:117] "RemoveContainer" containerID="516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3" Nov 21 12:19:57 crc kubenswrapper[4769]: E1121 12:19:57.980998 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3\": container with ID starting with 516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3 not found: ID does not exist" containerID="516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.981110 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3"} err="failed to get container status \"516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3\": rpc error: code = NotFound desc = could not find container \"516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3\": container with ID starting with 516aa810cc0f06bdaa3f7c6aab8a37442a67571ab19d4b42e3e44a4950092fd3 not found: ID does not exist" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.981229 4769 scope.go:117] "RemoveContainer" containerID="95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d" Nov 21 12:19:57 crc kubenswrapper[4769]: E1121 12:19:57.981785 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d\": container with ID starting with 95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d not found: ID does not exist" containerID="95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.981821 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d"} err="failed to get container status \"95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d\": rpc error: code = NotFound desc = could not find container \"95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d\": container with ID starting with 95a5c0885c388134c48683981425b2cfc9a52a7dc44317cb2b8fa777304c3e4d not found: ID does not exist" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.981842 4769 scope.go:117] "RemoveContainer" containerID="c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf" Nov 21 12:19:57 crc kubenswrapper[4769]: E1121 12:19:57.982064 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf\": container with ID starting with c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf not found: ID does not exist" containerID="c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf" Nov 21 12:19:57 crc kubenswrapper[4769]: I1121 12:19:57.982090 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf"} err="failed to get container status \"c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf\": rpc error: code = NotFound desc = could not find container \"c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf\": container with ID starting with c6ea73cdca7ef7ba834c46032bbb0b131c7e66b45c84b6a5b1655f811fb2b3bf not found: ID does not exist" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.057917 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.058153 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="41579dd4-9a25-404c-b3ee-488f4847c38d" containerName="nova-cell0-conductor-conductor" containerID="cri-o://92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52" gracePeriod=30 Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.223541 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.230052 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.248291 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:58 crc kubenswrapper[4769]: E1121 12:19:58.248788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-central-agent" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.248803 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-central-agent" Nov 21 12:19:58 crc kubenswrapper[4769]: E1121 12:19:58.248839 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="sg-core" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.248847 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="sg-core" Nov 21 12:19:58 crc kubenswrapper[4769]: E1121 12:19:58.248876 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-notification-agent" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.248885 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-notification-agent" Nov 21 12:19:58 crc kubenswrapper[4769]: E1121 12:19:58.248905 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="proxy-httpd" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.248913 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="proxy-httpd" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.249151 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-central-agent" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.249175 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="ceilometer-notification-agent" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.249202 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="sg-core" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.249216 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" containerName="proxy-httpd" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.251075 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.255901 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.259153 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.260802 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.380163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvq44\" (UniqueName: \"kubernetes.io/projected/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-kube-api-access-tvq44\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.380550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-scripts\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.380598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.380624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-log-httpd\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.380882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-config-data\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.381698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.381821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-run-httpd\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-run-httpd\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tvq44\" (UniqueName: \"kubernetes.io/projected/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-kube-api-access-tvq44\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-scripts\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484439 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-log-httpd\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.484495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-config-data\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.485182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-log-httpd\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.485229 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-run-httpd\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.489834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.489903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-scripts\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.491959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-config-data\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.502238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.513000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvq44\" (UniqueName: \"kubernetes.io/projected/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-kube-api-access-tvq44\") pod \"ceilometer-0\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:58 crc kubenswrapper[4769]: I1121 12:19:58.618934 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.165825 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:59 crc kubenswrapper[4769]: W1121 12:19:59.168757 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7abd41a0_c54a_4c3e_9d0d_2c68f6653702.slice/crio-ebd2d6c1147f773d9e2f79bb48f5e2352a0eb94af3d4c9d1e18f5d9e34639812 WatchSource:0}: Error finding container ebd2d6c1147f773d9e2f79bb48f5e2352a0eb94af3d4c9d1e18f5d9e34639812: Status 404 returned error can't find the container with id ebd2d6c1147f773d9e2f79bb48f5e2352a0eb94af3d4c9d1e18f5d9e34639812 Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.285508 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="645b5e4d-d7a2-44c3-9295-64f927d2ad9c" path="/var/lib/kubelet/pods/645b5e4d-d7a2-44c3-9295-64f927d2ad9c/volumes" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.543362 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.706516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-config-data\") pod \"41579dd4-9a25-404c-b3ee-488f4847c38d\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.706637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92qr6\" (UniqueName: \"kubernetes.io/projected/41579dd4-9a25-404c-b3ee-488f4847c38d-kube-api-access-92qr6\") pod \"41579dd4-9a25-404c-b3ee-488f4847c38d\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.706780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-combined-ca-bundle\") pod \"41579dd4-9a25-404c-b3ee-488f4847c38d\" (UID: \"41579dd4-9a25-404c-b3ee-488f4847c38d\") " Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.711481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41579dd4-9a25-404c-b3ee-488f4847c38d-kube-api-access-92qr6" (OuterVolumeSpecName: "kube-api-access-92qr6") pod "41579dd4-9a25-404c-b3ee-488f4847c38d" (UID: "41579dd4-9a25-404c-b3ee-488f4847c38d"). InnerVolumeSpecName "kube-api-access-92qr6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.734408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "41579dd4-9a25-404c-b3ee-488f4847c38d" (UID: "41579dd4-9a25-404c-b3ee-488f4847c38d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.745094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-config-data" (OuterVolumeSpecName: "config-data") pod "41579dd4-9a25-404c-b3ee-488f4847c38d" (UID: "41579dd4-9a25-404c-b3ee-488f4847c38d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.809408 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.809463 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-92qr6\" (UniqueName: \"kubernetes.io/projected/41579dd4-9a25-404c-b3ee-488f4847c38d-kube-api-access-92qr6\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.809476 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41579dd4-9a25-404c-b3ee-488f4847c38d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.854126 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.899270 4769 generic.go:334] "Generic (PLEG): container finished" podID="41579dd4-9a25-404c-b3ee-488f4847c38d" containerID="92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52" exitCode=0 Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.899345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"41579dd4-9a25-404c-b3ee-488f4847c38d","Type":"ContainerDied","Data":"92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52"} Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.899372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"41579dd4-9a25-404c-b3ee-488f4847c38d","Type":"ContainerDied","Data":"8a9b159727bbbd6a6403f6d18590ae9f9f5951a761631969adfc8b58554fbee0"} Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.899436 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.899426 4769 scope.go:117] "RemoveContainer" containerID="92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.901484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerStarted","Data":"844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631"} Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.901510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerStarted","Data":"ebd2d6c1147f773d9e2f79bb48f5e2352a0eb94af3d4c9d1e18f5d9e34639812"} Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.928729 4769 scope.go:117] "RemoveContainer" containerID="92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52" Nov 21 12:19:59 crc kubenswrapper[4769]: E1121 12:19:59.929904 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52\": container with ID starting with 92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52 not found: ID does not exist" containerID="92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.929956 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52"} err="failed to get container status \"92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52\": rpc error: code = NotFound desc = could not find container \"92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52\": container with ID starting with 92854e96e2542c394328bbcc6e1f3aa0190c0cef42b99bb796bf0c210b1b2e52 not found: ID does not exist" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.936619 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.945786 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.958240 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:19:59 crc kubenswrapper[4769]: E1121 12:19:59.958621 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41579dd4-9a25-404c-b3ee-488f4847c38d" containerName="nova-cell0-conductor-conductor" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.958641 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="41579dd4-9a25-404c-b3ee-488f4847c38d" containerName="nova-cell0-conductor-conductor" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.958871 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="41579dd4-9a25-404c-b3ee-488f4847c38d" containerName="nova-cell0-conductor-conductor" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.959546 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.962272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-2thtk" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.962447 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:19:59 crc kubenswrapper[4769]: I1121 12:19:59.988324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.117061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.117129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.117149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmq79\" (UniqueName: \"kubernetes.io/projected/e47a4c53-835f-4501-9e11-dea59692b355-kube-api-access-hmq79\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.218462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.218519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.218538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hmq79\" (UniqueName: \"kubernetes.io/projected/e47a4c53-835f-4501-9e11-dea59692b355-kube-api-access-hmq79\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.221554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.223388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.233001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmq79\" (UniqueName: \"kubernetes.io/projected/e47a4c53-835f-4501-9e11-dea59692b355-kube-api-access-hmq79\") pod \"nova-cell0-conductor-0\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.282348 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.707715 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:20:00 crc kubenswrapper[4769]: W1121 12:20:00.720302 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode47a4c53_835f_4501_9e11_dea59692b355.slice/crio-465cc6ef28388206e4c5c388b247971bba2f66be3308ebb425078da89ca45f9e WatchSource:0}: Error finding container 465cc6ef28388206e4c5c388b247971bba2f66be3308ebb425078da89ca45f9e: Status 404 returned error can't find the container with id 465cc6ef28388206e4c5c388b247971bba2f66be3308ebb425078da89ca45f9e Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.913698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerStarted","Data":"b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102"} Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.914756 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e47a4c53-835f-4501-9e11-dea59692b355","Type":"ContainerStarted","Data":"6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795"} Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.914778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e47a4c53-835f-4501-9e11-dea59692b355","Type":"ContainerStarted","Data":"465cc6ef28388206e4c5c388b247971bba2f66be3308ebb425078da89ca45f9e"} Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.915711 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:00 crc kubenswrapper[4769]: I1121 12:20:00.937988 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.9379714909999999 podStartE2EDuration="1.937971491s" podCreationTimestamp="2025-11-21 12:19:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:00.928766503 +0000 UTC m=+1759.629428321" watchObservedRunningTime="2025-11-21 12:20:00.937971491 +0000 UTC m=+1759.638633309" Nov 21 12:20:01 crc kubenswrapper[4769]: I1121 12:20:01.286846 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41579dd4-9a25-404c-b3ee-488f4847c38d" path="/var/lib/kubelet/pods/41579dd4-9a25-404c-b3ee-488f4847c38d/volumes" Nov 21 12:20:01 crc kubenswrapper[4769]: I1121 12:20:01.927223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerStarted","Data":"0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3"} Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.273644 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:20:02 crc kubenswrapper[4769]: E1121 12:20:02.273920 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.940528 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-central-agent" containerID="cri-o://844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631" gracePeriod=30 Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.941096 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="proxy-httpd" containerID="cri-o://5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16" gracePeriod=30 Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.941255 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="sg-core" containerID="cri-o://0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3" gracePeriod=30 Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.941356 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-notification-agent" containerID="cri-o://b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102" gracePeriod=30 Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.942145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerStarted","Data":"5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16"} Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.942186 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:02 crc kubenswrapper[4769]: I1121 12:20:02.968630 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.578334484 podStartE2EDuration="4.968611506s" podCreationTimestamp="2025-11-21 12:19:58 +0000 UTC" firstStartedPulling="2025-11-21 12:19:59.186555707 +0000 UTC m=+1757.887217525" lastFinishedPulling="2025-11-21 12:20:02.576832729 +0000 UTC m=+1761.277494547" observedRunningTime="2025-11-21 12:20:02.96579062 +0000 UTC m=+1761.666452438" watchObservedRunningTime="2025-11-21 12:20:02.968611506 +0000 UTC m=+1761.669273344" Nov 21 12:20:03 crc kubenswrapper[4769]: I1121 12:20:03.953574 4769 generic.go:334] "Generic (PLEG): container finished" podID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerID="5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16" exitCode=0 Nov 21 12:20:03 crc kubenswrapper[4769]: I1121 12:20:03.953892 4769 generic.go:334] "Generic (PLEG): container finished" podID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerID="0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3" exitCode=2 Nov 21 12:20:03 crc kubenswrapper[4769]: I1121 12:20:03.953900 4769 generic.go:334] "Generic (PLEG): container finished" podID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerID="b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102" exitCode=0 Nov 21 12:20:03 crc kubenswrapper[4769]: I1121 12:20:03.953658 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerDied","Data":"5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16"} Nov 21 12:20:03 crc kubenswrapper[4769]: I1121 12:20:03.953939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerDied","Data":"0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3"} Nov 21 12:20:03 crc kubenswrapper[4769]: I1121 12:20:03.953962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerDied","Data":"b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102"} Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.682413 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.802584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-sg-core-conf-yaml\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.802787 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvq44\" (UniqueName: \"kubernetes.io/projected/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-kube-api-access-tvq44\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.803452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-scripts\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.803484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-run-httpd\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.803596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-log-httpd\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.803646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-combined-ca-bundle\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.803679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-config-data\") pod \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\" (UID: \"7abd41a0-c54a-4c3e-9d0d-2c68f6653702\") " Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.804133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.804163 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.804692 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.804722 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.808854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-kube-api-access-tvq44" (OuterVolumeSpecName: "kube-api-access-tvq44") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "kube-api-access-tvq44". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.808901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-scripts" (OuterVolumeSpecName: "scripts") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.833577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.881679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.901380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-config-data" (OuterVolumeSpecName: "config-data") pod "7abd41a0-c54a-4c3e-9d0d-2c68f6653702" (UID: "7abd41a0-c54a-4c3e-9d0d-2c68f6653702"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.906601 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.906639 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.906652 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.906661 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tvq44\" (UniqueName: \"kubernetes.io/projected/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-kube-api-access-tvq44\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.906671 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7abd41a0-c54a-4c3e-9d0d-2c68f6653702-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.966667 4769 generic.go:334] "Generic (PLEG): container finished" podID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerID="844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631" exitCode=0 Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.966710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerDied","Data":"844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631"} Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.966741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7abd41a0-c54a-4c3e-9d0d-2c68f6653702","Type":"ContainerDied","Data":"ebd2d6c1147f773d9e2f79bb48f5e2352a0eb94af3d4c9d1e18f5d9e34639812"} Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.966767 4769 scope.go:117] "RemoveContainer" containerID="5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.967539 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:04 crc kubenswrapper[4769]: I1121 12:20:04.996307 4769 scope.go:117] "RemoveContainer" containerID="0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.013236 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.032690 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.045597 4769 scope.go:117] "RemoveContainer" containerID="b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.049386 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.050102 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="proxy-httpd" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050147 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="proxy-httpd" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.050183 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="sg-core" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050234 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="sg-core" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.050289 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-notification-agent" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050306 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-notification-agent" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.050354 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-central-agent" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050371 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-central-agent" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050814 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-central-agent" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050872 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="proxy-httpd" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050904 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="ceilometer-notification-agent" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.050944 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" containerName="sg-core" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.059489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.061525 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.065948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.068436 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.087941 4769 scope.go:117] "RemoveContainer" containerID="844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.115260 4769 scope.go:117] "RemoveContainer" containerID="5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.116027 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16\": container with ID starting with 5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16 not found: ID does not exist" containerID="5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.116074 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16"} err="failed to get container status \"5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16\": rpc error: code = NotFound desc = could not find container \"5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16\": container with ID starting with 5d77832109c1eee16529104b8ea2d4e2aa2e7b422957ed8d89cfe89ad594ee16 not found: ID does not exist" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.116100 4769 scope.go:117] "RemoveContainer" containerID="0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.116538 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3\": container with ID starting with 0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3 not found: ID does not exist" containerID="0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.116577 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3"} err="failed to get container status \"0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3\": rpc error: code = NotFound desc = could not find container \"0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3\": container with ID starting with 0eb1b07162b28793b0ed395c7c7e1954a2cbbdbb1a531cdb25af5bf3c2d139c3 not found: ID does not exist" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.116606 4769 scope.go:117] "RemoveContainer" containerID="b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.116975 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102\": container with ID starting with b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102 not found: ID does not exist" containerID="b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.117006 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102"} err="failed to get container status \"b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102\": rpc error: code = NotFound desc = could not find container \"b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102\": container with ID starting with b9b3fce31c3df6b58b0dbab0ddbb32a7ae9b3cef8ed9afabf031947e0bc99102 not found: ID does not exist" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.117030 4769 scope.go:117] "RemoveContainer" containerID="844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631" Nov 21 12:20:05 crc kubenswrapper[4769]: E1121 12:20:05.117394 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631\": container with ID starting with 844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631 not found: ID does not exist" containerID="844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.117417 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631"} err="failed to get container status \"844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631\": rpc error: code = NotFound desc = could not find container \"844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631\": container with ID starting with 844f2386747fde0327e3444e613dc3c57e75cea64b0568186f342ade7402c631 not found: ID does not exist" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-scripts\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-run-httpd\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-config-data\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvw8w\" (UniqueName: \"kubernetes.io/projected/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-kube-api-access-pvw8w\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-log-httpd\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.214654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.286987 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7abd41a0-c54a-4c3e-9d0d-2c68f6653702" path="/var/lib/kubelet/pods/7abd41a0-c54a-4c3e-9d0d-2c68f6653702/volumes" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.313586 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318534 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-scripts\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318574 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-run-httpd\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-config-data\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw8w\" (UniqueName: \"kubernetes.io/projected/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-kube-api-access-pvw8w\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-log-httpd\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.318816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.319346 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-run-httpd\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.319370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-log-httpd\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.321810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-scripts\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.322605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-config-data\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.322664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.327670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.344136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvw8w\" (UniqueName: \"kubernetes.io/projected/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-kube-api-access-pvw8w\") pod \"ceilometer-0\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.388322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.808051 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57m77"] Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.811119 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.812673 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.817118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.833334 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57m77"] Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.882897 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.932961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-config-data\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.933085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-scripts\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.933138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.933158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlq2b\" (UniqueName: \"kubernetes.io/projected/8be7621d-353e-4591-b93c-3f1c15bae3c9-kube-api-access-tlq2b\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:05 crc kubenswrapper[4769]: I1121 12:20:05.992425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerStarted","Data":"de0db9124c9b40e844bd83a2a09c7f07b9817b0572b5673d3fa02a248a0b0215"} Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.035148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-scripts\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.035269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.035297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tlq2b\" (UniqueName: \"kubernetes.io/projected/8be7621d-353e-4591-b93c-3f1c15bae3c9-kube-api-access-tlq2b\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.035342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-config-data\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.044393 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.048789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-config-data\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.054924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-scripts\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.070964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlq2b\" (UniqueName: \"kubernetes.io/projected/8be7621d-353e-4591-b93c-3f1c15bae3c9-kube-api-access-tlq2b\") pod \"nova-cell0-cell-mapping-57m77\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.106943 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.110739 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.126499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.133687 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.135472 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.136654 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.138889 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.160386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.179215 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.239249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-config-data\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.239313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.239378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c45064ab-8d3b-4995-a27b-415c1998cc4d-logs\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.240520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8mv\" (UniqueName: \"kubernetes.io/projected/c45064ab-8d3b-4995-a27b-415c1998cc4d-kube-api-access-rl8mv\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.240776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.240996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz724\" (UniqueName: \"kubernetes.io/projected/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-kube-api-access-kz724\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.241067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-logs\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.241131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-config-data\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.310261 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.311879 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.334937 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.343608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kz724\" (UniqueName: \"kubernetes.io/projected/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-kube-api-access-kz724\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.343723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-logs\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.343792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-config-data\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.343871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-config-data\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.343939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.344105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c45064ab-8d3b-4995-a27b-415c1998cc4d-logs\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.344147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8mv\" (UniqueName: \"kubernetes.io/projected/c45064ab-8d3b-4995-a27b-415c1998cc4d-kube-api-access-rl8mv\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.344322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.349266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c45064ab-8d3b-4995-a27b-415c1998cc4d-logs\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.350082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-logs\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.354565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-config-data\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.374535 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.375441 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.387045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.396787 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.398922 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.402584 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.406745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-config-data\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.408222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz724\" (UniqueName: \"kubernetes.io/projected/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-kube-api-access-kz724\") pod \"nova-api-0\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.408719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8mv\" (UniqueName: \"kubernetes.io/projected/c45064ab-8d3b-4995-a27b-415c1998cc4d-kube-api-access-rl8mv\") pod \"nova-metadata-0\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.417275 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.446153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs9c5\" (UniqueName: \"kubernetes.io/projected/0eb32bea-a879-4ecd-b394-c9cb6151af0e-kube-api-access-xs9c5\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.446424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.446556 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-config-data\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.455967 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.543950 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.549040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.549122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-config-data\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.549230 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.549265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xs9c5\" (UniqueName: \"kubernetes.io/projected/0eb32bea-a879-4ecd-b394-c9cb6151af0e-kube-api-access-xs9c5\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.549331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.549362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8nm\" (UniqueName: \"kubernetes.io/projected/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-kube-api-access-zn8nm\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.558940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.559638 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-config-data\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.583622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs9c5\" (UniqueName: \"kubernetes.io/projected/0eb32bea-a879-4ecd-b394-c9cb6151af0e-kube-api-access-xs9c5\") pod \"nova-scheduler-0\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.653684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.660019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.660087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.660109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8nm\" (UniqueName: \"kubernetes.io/projected/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-kube-api-access-zn8nm\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.665203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.665660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.688967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8nm\" (UniqueName: \"kubernetes.io/projected/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-kube-api-access-zn8nm\") pod \"nova-cell1-novncproxy-0\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.723988 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:06 crc kubenswrapper[4769]: I1121 12:20:06.946490 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57m77"] Nov 21 12:20:06 crc kubenswrapper[4769]: W1121 12:20:06.948125 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8be7621d_353e_4591_b93c_3f1c15bae3c9.slice/crio-6eaee68ee6771a02030ea39825459c18e158ce9e806d08685f139bf0d212c64c WatchSource:0}: Error finding container 6eaee68ee6771a02030ea39825459c18e158ce9e806d08685f139bf0d212c64c: Status 404 returned error can't find the container with id 6eaee68ee6771a02030ea39825459c18e158ce9e806d08685f139bf0d212c64c Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.031854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" event={"ID":"8be7621d-353e-4591-b93c-3f1c15bae3c9","Type":"ContainerStarted","Data":"6eaee68ee6771a02030ea39825459c18e158ce9e806d08685f139bf0d212c64c"} Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.048047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerStarted","Data":"8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459"} Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.160004 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk"] Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.171357 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.175091 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.175808 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.176366 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk"] Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.192269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.199455 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.289647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-config-data\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.289736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-scripts\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.289788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.289949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sckks\" (UniqueName: \"kubernetes.io/projected/6120e168-ec6a-4f80-a3f2-da7f79c9a499-kube-api-access-sckks\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: W1121 12:20:07.350215 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0eb32bea_a879_4ecd_b394_c9cb6151af0e.slice/crio-73dabafb6738f9bf682bf4811e597b0444fedbed48004a92ffd4279cf8bba19e WatchSource:0}: Error finding container 73dabafb6738f9bf682bf4811e597b0444fedbed48004a92ffd4279cf8bba19e: Status 404 returned error can't find the container with id 73dabafb6738f9bf682bf4811e597b0444fedbed48004a92ffd4279cf8bba19e Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.360263 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:07 crc kubenswrapper[4769]: W1121 12:20:07.380366 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode592abd1_b596_4fd5_b7ac_ede2c8aabf16.slice/crio-8d1e24e6e4ec45223040e73bef06be2abf56bf57b8943b323221e20ea6bdb41d WatchSource:0}: Error finding container 8d1e24e6e4ec45223040e73bef06be2abf56bf57b8943b323221e20ea6bdb41d: Status 404 returned error can't find the container with id 8d1e24e6e4ec45223040e73bef06be2abf56bf57b8943b323221e20ea6bdb41d Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.384547 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.392670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-config-data\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.392725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-scripts\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.392761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.392857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sckks\" (UniqueName: \"kubernetes.io/projected/6120e168-ec6a-4f80-a3f2-da7f79c9a499-kube-api-access-sckks\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.399031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-scripts\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.399716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-config-data\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.399937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.412953 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sckks\" (UniqueName: \"kubernetes.io/projected/6120e168-ec6a-4f80-a3f2-da7f79c9a499-kube-api-access-sckks\") pod \"nova-cell1-conductor-db-sync-nfzxk\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:07 crc kubenswrapper[4769]: I1121 12:20:07.505228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.071232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0eb32bea-a879-4ecd-b394-c9cb6151af0e","Type":"ContainerStarted","Data":"002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.071552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0eb32bea-a879-4ecd-b394-c9cb6151af0e","Type":"ContainerStarted","Data":"73dabafb6738f9bf682bf4811e597b0444fedbed48004a92ffd4279cf8bba19e"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.079205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e592abd1-b596-4fd5-b7ac-ede2c8aabf16","Type":"ContainerStarted","Data":"16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.079249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e592abd1-b596-4fd5-b7ac-ede2c8aabf16","Type":"ContainerStarted","Data":"8d1e24e6e4ec45223040e73bef06be2abf56bf57b8943b323221e20ea6bdb41d"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.084799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerStarted","Data":"9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.088583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c45064ab-8d3b-4995-a27b-415c1998cc4d","Type":"ContainerStarted","Data":"41c43a370d8f6f63842b9c3717d2080fc19dce1f586dc1389c0a557a84c33ebb"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.088615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c45064ab-8d3b-4995-a27b-415c1998cc4d","Type":"ContainerStarted","Data":"b1f4b6f364e27ced6b6aa8a1e2ec35ee6017d7738e96b5855700559bf7001aa0"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.088624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c45064ab-8d3b-4995-a27b-415c1998cc4d","Type":"ContainerStarted","Data":"92f6bc0aaf610e42088420943abbcc2c9981124d33ffde4057845a29af0f4f54"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.099416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2","Type":"ContainerStarted","Data":"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.099468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2","Type":"ContainerStarted","Data":"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.099480 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2","Type":"ContainerStarted","Data":"43fdfd46f6b5fff8e1959c6dff913d2d07b26bb6ea44e9f495d73eb70a400c53"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.104893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" event={"ID":"8be7621d-353e-4591-b93c-3f1c15bae3c9","Type":"ContainerStarted","Data":"0d54399c2609c38b0a1f80d17e33fab46a47b42a60b69b79aba99056467ac6b0"} Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.107651 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.107628399 podStartE2EDuration="2.107628399s" podCreationTimestamp="2025-11-21 12:20:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:08.097171398 +0000 UTC m=+1766.797833216" watchObservedRunningTime="2025-11-21 12:20:08.107628399 +0000 UTC m=+1766.808290207" Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.124739 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.124720799 podStartE2EDuration="2.124720799s" podCreationTimestamp="2025-11-21 12:20:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:08.123492216 +0000 UTC m=+1766.824154034" watchObservedRunningTime="2025-11-21 12:20:08.124720799 +0000 UTC m=+1766.825382607" Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.153550 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk"] Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.160213 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.160181813 podStartE2EDuration="2.160181813s" podCreationTimestamp="2025-11-21 12:20:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:08.15151863 +0000 UTC m=+1766.852180458" watchObservedRunningTime="2025-11-21 12:20:08.160181813 +0000 UTC m=+1766.860843631" Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.190395 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.190372695 podStartE2EDuration="2.190372695s" podCreationTimestamp="2025-11-21 12:20:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:08.175127665 +0000 UTC m=+1766.875789483" watchObservedRunningTime="2025-11-21 12:20:08.190372695 +0000 UTC m=+1766.891034513" Nov 21 12:20:08 crc kubenswrapper[4769]: I1121 12:20:08.215584 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" podStartSLOduration=3.215566322 podStartE2EDuration="3.215566322s" podCreationTimestamp="2025-11-21 12:20:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:08.210502356 +0000 UTC m=+1766.911164174" watchObservedRunningTime="2025-11-21 12:20:08.215566322 +0000 UTC m=+1766.916228140" Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.115700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" event={"ID":"6120e168-ec6a-4f80-a3f2-da7f79c9a499","Type":"ContainerStarted","Data":"b35e8f43ce4ca5ccd03d0efd5ce80fb7c2c2c7d6ec7688436d6ab35ca06c1072"} Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.116224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" event={"ID":"6120e168-ec6a-4f80-a3f2-da7f79c9a499","Type":"ContainerStarted","Data":"3d770a123c718a3aaf8495acdd2d25587ac51921f4ffb51b767a7e438a9246d3"} Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.118662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerStarted","Data":"a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0"} Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.145723 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" podStartSLOduration=2.145700459 podStartE2EDuration="2.145700459s" podCreationTimestamp="2025-11-21 12:20:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:09.135265338 +0000 UTC m=+1767.835927156" watchObservedRunningTime="2025-11-21 12:20:09.145700459 +0000 UTC m=+1767.846362277" Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.310150 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.248:9292/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.310510 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="57080d99-0ce3-47cc-adca-cb7dfad8e99f" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.248:9292/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.589644 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:09 crc kubenswrapper[4769]: I1121 12:20:09.615666 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:10 crc kubenswrapper[4769]: I1121 12:20:10.133734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerStarted","Data":"c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd"} Nov 21 12:20:10 crc kubenswrapper[4769]: I1121 12:20:10.133874 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-log" containerID="cri-o://b1f4b6f364e27ced6b6aa8a1e2ec35ee6017d7738e96b5855700559bf7001aa0" gracePeriod=30 Nov 21 12:20:10 crc kubenswrapper[4769]: I1121 12:20:10.133967 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-metadata" containerID="cri-o://41c43a370d8f6f63842b9c3717d2080fc19dce1f586dc1389c0a557a84c33ebb" gracePeriod=30 Nov 21 12:20:10 crc kubenswrapper[4769]: I1121 12:20:10.134124 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="e592abd1-b596-4fd5-b7ac-ede2c8aabf16" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542" gracePeriod=30 Nov 21 12:20:10 crc kubenswrapper[4769]: I1121 12:20:10.178680 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.25895071 podStartE2EDuration="5.17865235s" podCreationTimestamp="2025-11-21 12:20:05 +0000 UTC" firstStartedPulling="2025-11-21 12:20:05.88156541 +0000 UTC m=+1764.582227218" lastFinishedPulling="2025-11-21 12:20:09.80126704 +0000 UTC m=+1768.501928858" observedRunningTime="2025-11-21 12:20:10.17083338 +0000 UTC m=+1768.871495208" watchObservedRunningTime="2025-11-21 12:20:10.17865235 +0000 UTC m=+1768.879314168" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.001413 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.142705 4769 generic.go:334] "Generic (PLEG): container finished" podID="e592abd1-b596-4fd5-b7ac-ede2c8aabf16" containerID="16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542" exitCode=0 Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.142773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e592abd1-b596-4fd5-b7ac-ede2c8aabf16","Type":"ContainerDied","Data":"16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542"} Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.142798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e592abd1-b596-4fd5-b7ac-ede2c8aabf16","Type":"ContainerDied","Data":"8d1e24e6e4ec45223040e73bef06be2abf56bf57b8943b323221e20ea6bdb41d"} Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.142816 4769 scope.go:117] "RemoveContainer" containerID="16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.142929 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148139 4769 generic.go:334] "Generic (PLEG): container finished" podID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerID="41c43a370d8f6f63842b9c3717d2080fc19dce1f586dc1389c0a557a84c33ebb" exitCode=0 Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148172 4769 generic.go:334] "Generic (PLEG): container finished" podID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerID="b1f4b6f364e27ced6b6aa8a1e2ec35ee6017d7738e96b5855700559bf7001aa0" exitCode=143 Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c45064ab-8d3b-4995-a27b-415c1998cc4d","Type":"ContainerDied","Data":"41c43a370d8f6f63842b9c3717d2080fc19dce1f586dc1389c0a557a84c33ebb"} Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c45064ab-8d3b-4995-a27b-415c1998cc4d","Type":"ContainerDied","Data":"b1f4b6f364e27ced6b6aa8a1e2ec35ee6017d7738e96b5855700559bf7001aa0"} Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c45064ab-8d3b-4995-a27b-415c1998cc4d","Type":"ContainerDied","Data":"92f6bc0aaf610e42088420943abbcc2c9981124d33ffde4057845a29af0f4f54"} Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148386 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92f6bc0aaf610e42088420943abbcc2c9981124d33ffde4057845a29af0f4f54" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.148651 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.184936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn8nm\" (UniqueName: \"kubernetes.io/projected/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-kube-api-access-zn8nm\") pod \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.185024 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-combined-ca-bundle\") pod \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.185348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-config-data\") pod \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\" (UID: \"e592abd1-b596-4fd5-b7ac-ede2c8aabf16\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.191227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-kube-api-access-zn8nm" (OuterVolumeSpecName: "kube-api-access-zn8nm") pod "e592abd1-b596-4fd5-b7ac-ede2c8aabf16" (UID: "e592abd1-b596-4fd5-b7ac-ede2c8aabf16"). InnerVolumeSpecName "kube-api-access-zn8nm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.212995 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-config-data" (OuterVolumeSpecName: "config-data") pod "e592abd1-b596-4fd5-b7ac-ede2c8aabf16" (UID: "e592abd1-b596-4fd5-b7ac-ede2c8aabf16"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.213458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e592abd1-b596-4fd5-b7ac-ede2c8aabf16" (UID: "e592abd1-b596-4fd5-b7ac-ede2c8aabf16"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.278818 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.287535 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.287562 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zn8nm\" (UniqueName: \"kubernetes.io/projected/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-kube-api-access-zn8nm\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.287570 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e592abd1-b596-4fd5-b7ac-ede2c8aabf16-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.309562 4769 scope.go:117] "RemoveContainer" containerID="16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542" Nov 21 12:20:11 crc kubenswrapper[4769]: E1121 12:20:11.310472 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542\": container with ID starting with 16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542 not found: ID does not exist" containerID="16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.310522 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542"} err="failed to get container status \"16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542\": rpc error: code = NotFound desc = could not find container \"16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542\": container with ID starting with 16aa856b62bda4826c816f27726a715d3c3b1d219737eda74e1fa36606a42542 not found: ID does not exist" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.388767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-combined-ca-bundle\") pod \"c45064ab-8d3b-4995-a27b-415c1998cc4d\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.388829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c45064ab-8d3b-4995-a27b-415c1998cc4d-logs\") pod \"c45064ab-8d3b-4995-a27b-415c1998cc4d\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.388988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl8mv\" (UniqueName: \"kubernetes.io/projected/c45064ab-8d3b-4995-a27b-415c1998cc4d-kube-api-access-rl8mv\") pod \"c45064ab-8d3b-4995-a27b-415c1998cc4d\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.389121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-config-data\") pod \"c45064ab-8d3b-4995-a27b-415c1998cc4d\" (UID: \"c45064ab-8d3b-4995-a27b-415c1998cc4d\") " Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.389289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45064ab-8d3b-4995-a27b-415c1998cc4d-logs" (OuterVolumeSpecName: "logs") pod "c45064ab-8d3b-4995-a27b-415c1998cc4d" (UID: "c45064ab-8d3b-4995-a27b-415c1998cc4d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.389688 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c45064ab-8d3b-4995-a27b-415c1998cc4d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.391957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45064ab-8d3b-4995-a27b-415c1998cc4d-kube-api-access-rl8mv" (OuterVolumeSpecName: "kube-api-access-rl8mv") pod "c45064ab-8d3b-4995-a27b-415c1998cc4d" (UID: "c45064ab-8d3b-4995-a27b-415c1998cc4d"). InnerVolumeSpecName "kube-api-access-rl8mv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.412359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c45064ab-8d3b-4995-a27b-415c1998cc4d" (UID: "c45064ab-8d3b-4995-a27b-415c1998cc4d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.418392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-config-data" (OuterVolumeSpecName: "config-data") pod "c45064ab-8d3b-4995-a27b-415c1998cc4d" (UID: "c45064ab-8d3b-4995-a27b-415c1998cc4d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.468974 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.474886 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.491300 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.491341 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c45064ab-8d3b-4995-a27b-415c1998cc4d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.491356 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rl8mv\" (UniqueName: \"kubernetes.io/projected/c45064ab-8d3b-4995-a27b-415c1998cc4d-kube-api-access-rl8mv\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493007 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:11 crc kubenswrapper[4769]: E1121 12:20:11.493455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-metadata" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493477 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-metadata" Nov 21 12:20:11 crc kubenswrapper[4769]: E1121 12:20:11.493499 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-log" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493507 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-log" Nov 21 12:20:11 crc kubenswrapper[4769]: E1121 12:20:11.493524 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e592abd1-b596-4fd5-b7ac-ede2c8aabf16" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493532 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e592abd1-b596-4fd5-b7ac-ede2c8aabf16" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-log" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493792 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" containerName="nova-metadata-metadata" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.493808 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e592abd1-b596-4fd5-b7ac-ede2c8aabf16" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.494579 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.496375 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.496923 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.497171 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.525115 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.593629 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.594011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvhwg\" (UniqueName: \"kubernetes.io/projected/5121d00c-030e-40f1-8e18-f0c07e63f00d-kube-api-access-cvhwg\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.594146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.594250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.594347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.654697 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.696565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.696676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cvhwg\" (UniqueName: \"kubernetes.io/projected/5121d00c-030e-40f1-8e18-f0c07e63f00d-kube-api-access-cvhwg\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.696719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.696753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.696772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.701613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.701832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.702054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.702292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.715860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvhwg\" (UniqueName: \"kubernetes.io/projected/5121d00c-030e-40f1-8e18-f0c07e63f00d-kube-api-access-cvhwg\") pod \"nova-cell1-novncproxy-0\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:11 crc kubenswrapper[4769]: I1121 12:20:11.820483 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.159372 4769 generic.go:334] "Generic (PLEG): container finished" podID="6120e168-ec6a-4f80-a3f2-da7f79c9a499" containerID="b35e8f43ce4ca5ccd03d0efd5ce80fb7c2c2c7d6ec7688436d6ab35ca06c1072" exitCode=0 Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.160789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" event={"ID":"6120e168-ec6a-4f80-a3f2-da7f79c9a499","Type":"ContainerDied","Data":"b35e8f43ce4ca5ccd03d0efd5ce80fb7c2c2c7d6ec7688436d6ab35ca06c1072"} Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.161347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.213837 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.222249 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.252382 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.253986 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.256315 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.259825 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.273133 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.306715 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.413373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-config-data\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.413425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zs7h\" (UniqueName: \"kubernetes.io/projected/037741a9-ce34-4023-9c80-11211b7a754e-kube-api-access-6zs7h\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.413508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.413538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/037741a9-ce34-4023-9c80-11211b7a754e-logs\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.413597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.520440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-config-data\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.520510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs7h\" (UniqueName: \"kubernetes.io/projected/037741a9-ce34-4023-9c80-11211b7a754e-kube-api-access-6zs7h\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.520569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.520605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/037741a9-ce34-4023-9c80-11211b7a754e-logs\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.520661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.521780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/037741a9-ce34-4023-9c80-11211b7a754e-logs\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.526579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-config-data\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.532233 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.533158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.546466 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zs7h\" (UniqueName: \"kubernetes.io/projected/037741a9-ce34-4023-9c80-11211b7a754e-kube-api-access-6zs7h\") pod \"nova-metadata-0\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:12 crc kubenswrapper[4769]: I1121 12:20:12.581601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.029174 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:13 crc kubenswrapper[4769]: W1121 12:20:13.038679 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod037741a9_ce34_4023_9c80_11211b7a754e.slice/crio-0e2070e246292be02e296cfa4aef7be0c944cc8e179703c94fd3142f57e9eedd WatchSource:0}: Error finding container 0e2070e246292be02e296cfa4aef7be0c944cc8e179703c94fd3142f57e9eedd: Status 404 returned error can't find the container with id 0e2070e246292be02e296cfa4aef7be0c944cc8e179703c94fd3142f57e9eedd Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.178928 4769 generic.go:334] "Generic (PLEG): container finished" podID="8be7621d-353e-4591-b93c-3f1c15bae3c9" containerID="0d54399c2609c38b0a1f80d17e33fab46a47b42a60b69b79aba99056467ac6b0" exitCode=0 Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.179034 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" event={"ID":"8be7621d-353e-4591-b93c-3f1c15bae3c9","Type":"ContainerDied","Data":"0d54399c2609c38b0a1f80d17e33fab46a47b42a60b69b79aba99056467ac6b0"} Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.185073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"037741a9-ce34-4023-9c80-11211b7a754e","Type":"ContainerStarted","Data":"0e2070e246292be02e296cfa4aef7be0c944cc8e179703c94fd3142f57e9eedd"} Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.188754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5121d00c-030e-40f1-8e18-f0c07e63f00d","Type":"ContainerStarted","Data":"25606af767d8ff3ee2e9429779f1c28627f5ceb4c165d7181fcd60475e9ded72"} Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.188787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5121d00c-030e-40f1-8e18-f0c07e63f00d","Type":"ContainerStarted","Data":"89baf302b0faecf297f6acddc63b457db8a5d1ddaf308d89f1c15f8cb5befbcb"} Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.220098 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.220079789 podStartE2EDuration="2.220079789s" podCreationTimestamp="2025-11-21 12:20:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:13.216319898 +0000 UTC m=+1771.916981726" watchObservedRunningTime="2025-11-21 12:20:13.220079789 +0000 UTC m=+1771.920741607" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.333251 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45064ab-8d3b-4995-a27b-415c1998cc4d" path="/var/lib/kubelet/pods/c45064ab-8d3b-4995-a27b-415c1998cc4d/volumes" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.338035 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e592abd1-b596-4fd5-b7ac-ede2c8aabf16" path="/var/lib/kubelet/pods/e592abd1-b596-4fd5-b7ac-ede2c8aabf16/volumes" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.603083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.744825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sckks\" (UniqueName: \"kubernetes.io/projected/6120e168-ec6a-4f80-a3f2-da7f79c9a499-kube-api-access-sckks\") pod \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.744967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-scripts\") pod \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.745005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-combined-ca-bundle\") pod \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.745051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-config-data\") pod \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\" (UID: \"6120e168-ec6a-4f80-a3f2-da7f79c9a499\") " Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.750533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-scripts" (OuterVolumeSpecName: "scripts") pod "6120e168-ec6a-4f80-a3f2-da7f79c9a499" (UID: "6120e168-ec6a-4f80-a3f2-da7f79c9a499"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.751752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6120e168-ec6a-4f80-a3f2-da7f79c9a499-kube-api-access-sckks" (OuterVolumeSpecName: "kube-api-access-sckks") pod "6120e168-ec6a-4f80-a3f2-da7f79c9a499" (UID: "6120e168-ec6a-4f80-a3f2-da7f79c9a499"). InnerVolumeSpecName "kube-api-access-sckks". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.777594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-config-data" (OuterVolumeSpecName: "config-data") pod "6120e168-ec6a-4f80-a3f2-da7f79c9a499" (UID: "6120e168-ec6a-4f80-a3f2-da7f79c9a499"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.780277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6120e168-ec6a-4f80-a3f2-da7f79c9a499" (UID: "6120e168-ec6a-4f80-a3f2-da7f79c9a499"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.847490 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.847537 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.847550 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6120e168-ec6a-4f80-a3f2-da7f79c9a499-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:13 crc kubenswrapper[4769]: I1121 12:20:13.847562 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sckks\" (UniqueName: \"kubernetes.io/projected/6120e168-ec6a-4f80-a3f2-da7f79c9a499-kube-api-access-sckks\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.212227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"037741a9-ce34-4023-9c80-11211b7a754e","Type":"ContainerStarted","Data":"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7"} Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.212266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"037741a9-ce34-4023-9c80-11211b7a754e","Type":"ContainerStarted","Data":"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362"} Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.217603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.219341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk" event={"ID":"6120e168-ec6a-4f80-a3f2-da7f79c9a499","Type":"ContainerDied","Data":"3d770a123c718a3aaf8495acdd2d25587ac51921f4ffb51b767a7e438a9246d3"} Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.219394 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d770a123c718a3aaf8495acdd2d25587ac51921f4ffb51b767a7e438a9246d3" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.265026 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.265009312 podStartE2EDuration="2.265009312s" podCreationTimestamp="2025-11-21 12:20:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:14.248344744 +0000 UTC m=+1772.949006572" watchObservedRunningTime="2025-11-21 12:20:14.265009312 +0000 UTC m=+1772.965671130" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.321089 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:20:14 crc kubenswrapper[4769]: E1121 12:20:14.321573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6120e168-ec6a-4f80-a3f2-da7f79c9a499" containerName="nova-cell1-conductor-db-sync" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.321588 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6120e168-ec6a-4f80-a3f2-da7f79c9a499" containerName="nova-cell1-conductor-db-sync" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.321808 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6120e168-ec6a-4f80-a3f2-da7f79c9a499" containerName="nova-cell1-conductor-db-sync" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.322598 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.326067 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.338590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.473068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.473602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmr5z\" (UniqueName: \"kubernetes.io/projected/c3fa206e-3155-4767-bab1-fb5fca9d3d06-kube-api-access-xmr5z\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.473673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.567908 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.575236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xmr5z\" (UniqueName: \"kubernetes.io/projected/c3fa206e-3155-4767-bab1-fb5fca9d3d06-kube-api-access-xmr5z\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.575305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.575403 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.582736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.585337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.598060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmr5z\" (UniqueName: \"kubernetes.io/projected/c3fa206e-3155-4767-bab1-fb5fca9d3d06-kube-api-access-xmr5z\") pod \"nova-cell1-conductor-0\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.656262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.676551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-combined-ca-bundle\") pod \"8be7621d-353e-4591-b93c-3f1c15bae3c9\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.676619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-scripts\") pod \"8be7621d-353e-4591-b93c-3f1c15bae3c9\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.676717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlq2b\" (UniqueName: \"kubernetes.io/projected/8be7621d-353e-4591-b93c-3f1c15bae3c9-kube-api-access-tlq2b\") pod \"8be7621d-353e-4591-b93c-3f1c15bae3c9\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.676746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-config-data\") pod \"8be7621d-353e-4591-b93c-3f1c15bae3c9\" (UID: \"8be7621d-353e-4591-b93c-3f1c15bae3c9\") " Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.683227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-scripts" (OuterVolumeSpecName: "scripts") pod "8be7621d-353e-4591-b93c-3f1c15bae3c9" (UID: "8be7621d-353e-4591-b93c-3f1c15bae3c9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.683307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be7621d-353e-4591-b93c-3f1c15bae3c9-kube-api-access-tlq2b" (OuterVolumeSpecName: "kube-api-access-tlq2b") pod "8be7621d-353e-4591-b93c-3f1c15bae3c9" (UID: "8be7621d-353e-4591-b93c-3f1c15bae3c9"). InnerVolumeSpecName "kube-api-access-tlq2b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.706031 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8be7621d-353e-4591-b93c-3f1c15bae3c9" (UID: "8be7621d-353e-4591-b93c-3f1c15bae3c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.713494 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-config-data" (OuterVolumeSpecName: "config-data") pod "8be7621d-353e-4591-b93c-3f1c15bae3c9" (UID: "8be7621d-353e-4591-b93c-3f1c15bae3c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.778625 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tlq2b\" (UniqueName: \"kubernetes.io/projected/8be7621d-353e-4591-b93c-3f1c15bae3c9-kube-api-access-tlq2b\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.778668 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.778680 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:14 crc kubenswrapper[4769]: I1121 12:20:14.778691 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8be7621d-353e-4591-b93c-3f1c15bae3c9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.073774 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.230500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" event={"ID":"8be7621d-353e-4591-b93c-3f1c15bae3c9","Type":"ContainerDied","Data":"6eaee68ee6771a02030ea39825459c18e158ce9e806d08685f139bf0d212c64c"} Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.230803 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eaee68ee6771a02030ea39825459c18e158ce9e806d08685f139bf0d212c64c" Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.230547 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-57m77" Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.242261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"c3fa206e-3155-4767-bab1-fb5fca9d3d06","Type":"ContainerStarted","Data":"55a1f9b31c8630efb6f01ee2a8d4b333c2693b17b0a742488455d6285d4ce5b7"} Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.392741 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.393028 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-log" containerID="cri-o://093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133" gracePeriod=30 Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.393075 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-api" containerID="cri-o://aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930" gracePeriod=30 Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.407272 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.407502 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0eb32bea-a879-4ecd-b394-c9cb6151af0e" containerName="nova-scheduler-scheduler" containerID="cri-o://002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0" gracePeriod=30 Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.442098 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:15 crc kubenswrapper[4769]: I1121 12:20:15.892766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.001309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz724\" (UniqueName: \"kubernetes.io/projected/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-kube-api-access-kz724\") pod \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.001463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-logs\") pod \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.001940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-config-data\") pod \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.002057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-combined-ca-bundle\") pod \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\" (UID: \"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.002078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-logs" (OuterVolumeSpecName: "logs") pod "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" (UID: "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.002540 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.008531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-kube-api-access-kz724" (OuterVolumeSpecName: "kube-api-access-kz724") pod "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" (UID: "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2"). InnerVolumeSpecName "kube-api-access-kz724". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.036302 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-config-data" (OuterVolumeSpecName: "config-data") pod "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" (UID: "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.062799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" (UID: "2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.103658 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.103693 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.103705 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kz724\" (UniqueName: \"kubernetes.io/projected/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2-kube-api-access-kz724\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.252414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"c3fa206e-3155-4767-bab1-fb5fca9d3d06","Type":"ContainerStarted","Data":"1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de"} Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.252493 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254692 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerID="aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930" exitCode=0 Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254721 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerID="093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133" exitCode=143 Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2","Type":"ContainerDied","Data":"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930"} Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2","Type":"ContainerDied","Data":"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133"} Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2","Type":"ContainerDied","Data":"43fdfd46f6b5fff8e1959c6dff913d2d07b26bb6ea44e9f495d73eb70a400c53"} Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254836 4769 scope.go:117] "RemoveContainer" containerID="aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254853 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-log" containerID="cri-o://24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362" gracePeriod=30 Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.254931 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-metadata" containerID="cri-o://093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7" gracePeriod=30 Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.274263 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:20:16 crc kubenswrapper[4769]: E1121 12:20:16.274478 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.280748 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.280729635 podStartE2EDuration="2.280729635s" podCreationTimestamp="2025-11-21 12:20:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:16.273424559 +0000 UTC m=+1774.974086377" watchObservedRunningTime="2025-11-21 12:20:16.280729635 +0000 UTC m=+1774.981391453" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.298426 4769 scope.go:117] "RemoveContainer" containerID="093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.323963 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.335143 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.338853 4769 scope.go:117] "RemoveContainer" containerID="aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930" Nov 21 12:20:16 crc kubenswrapper[4769]: E1121 12:20:16.339782 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930\": container with ID starting with aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930 not found: ID does not exist" containerID="aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.339824 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930"} err="failed to get container status \"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930\": rpc error: code = NotFound desc = could not find container \"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930\": container with ID starting with aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930 not found: ID does not exist" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.339844 4769 scope.go:117] "RemoveContainer" containerID="093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133" Nov 21 12:20:16 crc kubenswrapper[4769]: E1121 12:20:16.340696 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133\": container with ID starting with 093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133 not found: ID does not exist" containerID="093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.340836 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133"} err="failed to get container status \"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133\": rpc error: code = NotFound desc = could not find container \"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133\": container with ID starting with 093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133 not found: ID does not exist" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.340962 4769 scope.go:117] "RemoveContainer" containerID="aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.341624 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930"} err="failed to get container status \"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930\": rpc error: code = NotFound desc = could not find container \"aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930\": container with ID starting with aeddeb6ed09a3cbd60c41c9d3d57b7b02600cf2067c806fab2e710bd951c9930 not found: ID does not exist" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.341644 4769 scope.go:117] "RemoveContainer" containerID="093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.341869 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133"} err="failed to get container status \"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133\": rpc error: code = NotFound desc = could not find container \"093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133\": container with ID starting with 093264b10bdef4f7e5cc48440e873e6d87bc6462123826be047f9b30ba51a133 not found: ID does not exist" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.346455 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:16 crc kubenswrapper[4769]: E1121 12:20:16.347060 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-log" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.347151 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-log" Nov 21 12:20:16 crc kubenswrapper[4769]: E1121 12:20:16.347296 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-api" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.347367 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-api" Nov 21 12:20:16 crc kubenswrapper[4769]: E1121 12:20:16.347442 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8be7621d-353e-4591-b93c-3f1c15bae3c9" containerName="nova-manage" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.347517 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be7621d-353e-4591-b93c-3f1c15bae3c9" containerName="nova-manage" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.347851 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-api" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.347950 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8be7621d-353e-4591-b93c-3f1c15bae3c9" containerName="nova-manage" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.348034 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" containerName="nova-api-log" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.349375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.352980 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.379219 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.511292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b15e49d-aea2-4816-8f14-c4d333ae7bac-logs\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.511359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-config-data\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.511395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.511424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct5bn\" (UniqueName: \"kubernetes.io/projected/8b15e49d-aea2-4816-8f14-c4d333ae7bac-kube-api-access-ct5bn\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.613627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.613694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5bn\" (UniqueName: \"kubernetes.io/projected/8b15e49d-aea2-4816-8f14-c4d333ae7bac-kube-api-access-ct5bn\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.613826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b15e49d-aea2-4816-8f14-c4d333ae7bac-logs\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.613883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-config-data\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.614695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b15e49d-aea2-4816-8f14-c4d333ae7bac-logs\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.617924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.618880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-config-data\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.638820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct5bn\" (UniqueName: \"kubernetes.io/projected/8b15e49d-aea2-4816-8f14-c4d333ae7bac-kube-api-access-ct5bn\") pod \"nova-api-0\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.719170 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.736795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.822466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.823319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-combined-ca-bundle\") pod \"037741a9-ce34-4023-9c80-11211b7a754e\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.823457 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/037741a9-ce34-4023-9c80-11211b7a754e-logs\") pod \"037741a9-ce34-4023-9c80-11211b7a754e\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.823592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zs7h\" (UniqueName: \"kubernetes.io/projected/037741a9-ce34-4023-9c80-11211b7a754e-kube-api-access-6zs7h\") pod \"037741a9-ce34-4023-9c80-11211b7a754e\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.823640 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-nova-metadata-tls-certs\") pod \"037741a9-ce34-4023-9c80-11211b7a754e\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.823674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-config-data\") pod \"037741a9-ce34-4023-9c80-11211b7a754e\" (UID: \"037741a9-ce34-4023-9c80-11211b7a754e\") " Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.825608 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037741a9-ce34-4023-9c80-11211b7a754e-logs" (OuterVolumeSpecName: "logs") pod "037741a9-ce34-4023-9c80-11211b7a754e" (UID: "037741a9-ce34-4023-9c80-11211b7a754e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.830903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037741a9-ce34-4023-9c80-11211b7a754e-kube-api-access-6zs7h" (OuterVolumeSpecName: "kube-api-access-6zs7h") pod "037741a9-ce34-4023-9c80-11211b7a754e" (UID: "037741a9-ce34-4023-9c80-11211b7a754e"). InnerVolumeSpecName "kube-api-access-6zs7h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.858018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "037741a9-ce34-4023-9c80-11211b7a754e" (UID: "037741a9-ce34-4023-9c80-11211b7a754e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.863736 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-config-data" (OuterVolumeSpecName: "config-data") pod "037741a9-ce34-4023-9c80-11211b7a754e" (UID: "037741a9-ce34-4023-9c80-11211b7a754e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.878929 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "037741a9-ce34-4023-9c80-11211b7a754e" (UID: "037741a9-ce34-4023-9c80-11211b7a754e"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.925659 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.925694 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/037741a9-ce34-4023-9c80-11211b7a754e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.925708 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6zs7h\" (UniqueName: \"kubernetes.io/projected/037741a9-ce34-4023-9c80-11211b7a754e-kube-api-access-6zs7h\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.925722 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:16 crc kubenswrapper[4769]: I1121 12:20:16.925735 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/037741a9-ce34-4023-9c80-11211b7a754e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.136952 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.264987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8b15e49d-aea2-4816-8f14-c4d333ae7bac","Type":"ContainerStarted","Data":"974d4bbe98480ad0b4038fc018605ed2c081ca98f0d75421463aeed85b833765"} Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266292 4769 generic.go:334] "Generic (PLEG): container finished" podID="037741a9-ce34-4023-9c80-11211b7a754e" containerID="093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7" exitCode=0 Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266312 4769 generic.go:334] "Generic (PLEG): container finished" podID="037741a9-ce34-4023-9c80-11211b7a754e" containerID="24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362" exitCode=143 Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266770 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"037741a9-ce34-4023-9c80-11211b7a754e","Type":"ContainerDied","Data":"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7"} Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"037741a9-ce34-4023-9c80-11211b7a754e","Type":"ContainerDied","Data":"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362"} Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"037741a9-ce34-4023-9c80-11211b7a754e","Type":"ContainerDied","Data":"0e2070e246292be02e296cfa4aef7be0c944cc8e179703c94fd3142f57e9eedd"} Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.266930 4769 scope.go:117] "RemoveContainer" containerID="093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.288963 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2" path="/var/lib/kubelet/pods/2f4f3ffd-c732-46c0-ac23-cbd0c2239fd2/volumes" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.294037 4769 scope.go:117] "RemoveContainer" containerID="24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.316858 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.332313 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.349736 4769 scope.go:117] "RemoveContainer" containerID="093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7" Nov 21 12:20:17 crc kubenswrapper[4769]: E1121 12:20:17.350168 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7\": container with ID starting with 093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7 not found: ID does not exist" containerID="093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.350212 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7"} err="failed to get container status \"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7\": rpc error: code = NotFound desc = could not find container \"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7\": container with ID starting with 093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7 not found: ID does not exist" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.350233 4769 scope.go:117] "RemoveContainer" containerID="24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362" Nov 21 12:20:17 crc kubenswrapper[4769]: E1121 12:20:17.350501 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362\": container with ID starting with 24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362 not found: ID does not exist" containerID="24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.350528 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362"} err="failed to get container status \"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362\": rpc error: code = NotFound desc = could not find container \"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362\": container with ID starting with 24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362 not found: ID does not exist" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.350548 4769 scope.go:117] "RemoveContainer" containerID="093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.350893 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7"} err="failed to get container status \"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7\": rpc error: code = NotFound desc = could not find container \"093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7\": container with ID starting with 093afc9be6ee5bd88308bfc1836d3510776c864afd8341129f766cfe99d8a1e7 not found: ID does not exist" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.351050 4769 scope.go:117] "RemoveContainer" containerID="24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.351496 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362"} err="failed to get container status \"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362\": rpc error: code = NotFound desc = could not find container \"24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362\": container with ID starting with 24fae3c340d380a49fe9035a5389f986b49b190b5da8c701eba9101e629fc362 not found: ID does not exist" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.394677 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:17 crc kubenswrapper[4769]: E1121 12:20:17.395336 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-log" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.395362 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-log" Nov 21 12:20:17 crc kubenswrapper[4769]: E1121 12:20:17.395413 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-metadata" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.395422 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-metadata" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.395639 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-log" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.395677 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="037741a9-ce34-4023-9c80-11211b7a754e" containerName="nova-metadata-metadata" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.397262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.400404 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.401540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.405798 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.537176 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b25fc44a-2957-4797-aebd-c750b7322ff7-logs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.537294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.537378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkpfs\" (UniqueName: \"kubernetes.io/projected/b25fc44a-2957-4797-aebd-c750b7322ff7-kube-api-access-nkpfs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.537415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.537439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-config-data\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.639260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b25fc44a-2957-4797-aebd-c750b7322ff7-logs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.639328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.639389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nkpfs\" (UniqueName: \"kubernetes.io/projected/b25fc44a-2957-4797-aebd-c750b7322ff7-kube-api-access-nkpfs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.639426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.639453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-config-data\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.639968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b25fc44a-2957-4797-aebd-c750b7322ff7-logs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.644281 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.644628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.645340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-config-data\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.659353 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkpfs\" (UniqueName: \"kubernetes.io/projected/b25fc44a-2957-4797-aebd-c750b7322ff7-kube-api-access-nkpfs\") pod \"nova-metadata-0\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:17 crc kubenswrapper[4769]: I1121 12:20:17.802499 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:18 crc kubenswrapper[4769]: I1121 12:20:18.249617 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:18 crc kubenswrapper[4769]: W1121 12:20:18.258885 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25fc44a_2957_4797_aebd_c750b7322ff7.slice/crio-0214c84f0dae3fffd11d3d37780a371212185cd6ab3b29fb8ba26eb55633ad1a WatchSource:0}: Error finding container 0214c84f0dae3fffd11d3d37780a371212185cd6ab3b29fb8ba26eb55633ad1a: Status 404 returned error can't find the container with id 0214c84f0dae3fffd11d3d37780a371212185cd6ab3b29fb8ba26eb55633ad1a Nov 21 12:20:18 crc kubenswrapper[4769]: I1121 12:20:18.280209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b25fc44a-2957-4797-aebd-c750b7322ff7","Type":"ContainerStarted","Data":"0214c84f0dae3fffd11d3d37780a371212185cd6ab3b29fb8ba26eb55633ad1a"} Nov 21 12:20:18 crc kubenswrapper[4769]: I1121 12:20:18.282889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8b15e49d-aea2-4816-8f14-c4d333ae7bac","Type":"ContainerStarted","Data":"17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e"} Nov 21 12:20:18 crc kubenswrapper[4769]: I1121 12:20:18.282927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8b15e49d-aea2-4816-8f14-c4d333ae7bac","Type":"ContainerStarted","Data":"cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd"} Nov 21 12:20:18 crc kubenswrapper[4769]: I1121 12:20:18.308043 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.308022139 podStartE2EDuration="2.308022139s" podCreationTimestamp="2025-11-21 12:20:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:18.304306059 +0000 UTC m=+1777.004967867" watchObservedRunningTime="2025-11-21 12:20:18.308022139 +0000 UTC m=+1777.008683957" Nov 21 12:20:19 crc kubenswrapper[4769]: I1121 12:20:19.289800 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037741a9-ce34-4023-9c80-11211b7a754e" path="/var/lib/kubelet/pods/037741a9-ce34-4023-9c80-11211b7a754e/volumes" Nov 21 12:20:19 crc kubenswrapper[4769]: I1121 12:20:19.297951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b25fc44a-2957-4797-aebd-c750b7322ff7","Type":"ContainerStarted","Data":"289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13"} Nov 21 12:20:19 crc kubenswrapper[4769]: I1121 12:20:19.298031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b25fc44a-2957-4797-aebd-c750b7322ff7","Type":"ContainerStarted","Data":"4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a"} Nov 21 12:20:19 crc kubenswrapper[4769]: I1121 12:20:19.324348 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.324326583 podStartE2EDuration="2.324326583s" podCreationTimestamp="2025-11-21 12:20:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:19.316848822 +0000 UTC m=+1778.017510650" watchObservedRunningTime="2025-11-21 12:20:19.324326583 +0000 UTC m=+1778.024988401" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.098829 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.188889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs9c5\" (UniqueName: \"kubernetes.io/projected/0eb32bea-a879-4ecd-b394-c9cb6151af0e-kube-api-access-xs9c5\") pod \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.189018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-combined-ca-bundle\") pod \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.189051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-config-data\") pod \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\" (UID: \"0eb32bea-a879-4ecd-b394-c9cb6151af0e\") " Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.194219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb32bea-a879-4ecd-b394-c9cb6151af0e-kube-api-access-xs9c5" (OuterVolumeSpecName: "kube-api-access-xs9c5") pod "0eb32bea-a879-4ecd-b394-c9cb6151af0e" (UID: "0eb32bea-a879-4ecd-b394-c9cb6151af0e"). InnerVolumeSpecName "kube-api-access-xs9c5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.214819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-config-data" (OuterVolumeSpecName: "config-data") pod "0eb32bea-a879-4ecd-b394-c9cb6151af0e" (UID: "0eb32bea-a879-4ecd-b394-c9cb6151af0e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.215874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0eb32bea-a879-4ecd-b394-c9cb6151af0e" (UID: "0eb32bea-a879-4ecd-b394-c9cb6151af0e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.291449 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xs9c5\" (UniqueName: \"kubernetes.io/projected/0eb32bea-a879-4ecd-b394-c9cb6151af0e-kube-api-access-xs9c5\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.291490 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.291504 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eb32bea-a879-4ecd-b394-c9cb6151af0e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.322540 4769 generic.go:334] "Generic (PLEG): container finished" podID="0eb32bea-a879-4ecd-b394-c9cb6151af0e" containerID="002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0" exitCode=0 Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.322854 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.322895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0eb32bea-a879-4ecd-b394-c9cb6151af0e","Type":"ContainerDied","Data":"002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0"} Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.323610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0eb32bea-a879-4ecd-b394-c9cb6151af0e","Type":"ContainerDied","Data":"73dabafb6738f9bf682bf4811e597b0444fedbed48004a92ffd4279cf8bba19e"} Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.323643 4769 scope.go:117] "RemoveContainer" containerID="002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.347728 4769 scope.go:117] "RemoveContainer" containerID="002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0" Nov 21 12:20:20 crc kubenswrapper[4769]: E1121 12:20:20.348262 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0\": container with ID starting with 002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0 not found: ID does not exist" containerID="002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.348323 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0"} err="failed to get container status \"002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0\": rpc error: code = NotFound desc = could not find container \"002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0\": container with ID starting with 002a9912ac6299efd2b3d3d0442c5e4ec13e912b9e927038a058422d27f5ede0 not found: ID does not exist" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.359807 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.379552 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.388072 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:20 crc kubenswrapper[4769]: E1121 12:20:20.388683 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0eb32bea-a879-4ecd-b394-c9cb6151af0e" containerName="nova-scheduler-scheduler" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.388712 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb32bea-a879-4ecd-b394-c9cb6151af0e" containerName="nova-scheduler-scheduler" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.388987 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0eb32bea-a879-4ecd-b394-c9cb6151af0e" containerName="nova-scheduler-scheduler" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.389846 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.395371 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.399464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.494894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-config-data\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.495025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.495145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7jh\" (UniqueName: \"kubernetes.io/projected/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-kube-api-access-ct7jh\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.596805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-config-data\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.597031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.597110 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7jh\" (UniqueName: \"kubernetes.io/projected/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-kube-api-access-ct7jh\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.605864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.605875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-config-data\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.613814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7jh\" (UniqueName: \"kubernetes.io/projected/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-kube-api-access-ct7jh\") pod \"nova-scheduler-0\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:20 crc kubenswrapper[4769]: I1121 12:20:20.712530 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:21 crc kubenswrapper[4769]: I1121 12:20:21.283823 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb32bea-a879-4ecd-b394-c9cb6151af0e" path="/var/lib/kubelet/pods/0eb32bea-a879-4ecd-b394-c9cb6151af0e/volumes" Nov 21 12:20:21 crc kubenswrapper[4769]: I1121 12:20:21.822011 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:21 crc kubenswrapper[4769]: I1121 12:20:21.841729 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:22 crc kubenswrapper[4769]: I1121 12:20:22.104467 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:22 crc kubenswrapper[4769]: W1121 12:20:22.108398 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63575de7_3f4e_4bbb_a4b7_6c6157a5c591.slice/crio-82fcb6cba3711bb46dd04a80879bed16b017f9a4ffb63b8d012980e0aad6e99e WatchSource:0}: Error finding container 82fcb6cba3711bb46dd04a80879bed16b017f9a4ffb63b8d012980e0aad6e99e: Status 404 returned error can't find the container with id 82fcb6cba3711bb46dd04a80879bed16b017f9a4ffb63b8d012980e0aad6e99e Nov 21 12:20:22 crc kubenswrapper[4769]: I1121 12:20:22.346156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63575de7-3f4e-4bbb-a4b7-6c6157a5c591","Type":"ContainerStarted","Data":"82fcb6cba3711bb46dd04a80879bed16b017f9a4ffb63b8d012980e0aad6e99e"} Nov 21 12:20:22 crc kubenswrapper[4769]: I1121 12:20:22.361002 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:20:22 crc kubenswrapper[4769]: I1121 12:20:22.803095 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:22 crc kubenswrapper[4769]: I1121 12:20:22.803532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:23 crc kubenswrapper[4769]: I1121 12:20:23.357332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63575de7-3f4e-4bbb-a4b7-6c6157a5c591","Type":"ContainerStarted","Data":"ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5"} Nov 21 12:20:23 crc kubenswrapper[4769]: I1121 12:20:23.380082 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.380061402 podStartE2EDuration="3.380061402s" podCreationTimestamp="2025-11-21 12:20:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:23.377606276 +0000 UTC m=+1782.078268124" watchObservedRunningTime="2025-11-21 12:20:23.380061402 +0000 UTC m=+1782.080723220" Nov 21 12:20:24 crc kubenswrapper[4769]: I1121 12:20:24.681743 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.110386 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw"] Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.111927 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.116703 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.116911 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.121267 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw"] Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.174581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-scripts\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.174706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnp8c\" (UniqueName: \"kubernetes.io/projected/ab7093b8-e012-4655-ba79-137326ea7bfa-kube-api-access-vnp8c\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.174785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-config-data\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.174886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.276326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-scripts\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.276389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vnp8c\" (UniqueName: \"kubernetes.io/projected/ab7093b8-e012-4655-ba79-137326ea7bfa-kube-api-access-vnp8c\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.276425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-config-data\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.276459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.283522 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-scripts\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.283602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-config-data\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.288769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.297274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnp8c\" (UniqueName: \"kubernetes.io/projected/ab7093b8-e012-4655-ba79-137326ea7bfa-kube-api-access-vnp8c\") pod \"nova-cell1-cell-mapping-s9qsw\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.442337 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.713456 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:25 crc kubenswrapper[4769]: I1121 12:20:25.989024 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw"] Nov 21 12:20:25 crc kubenswrapper[4769]: W1121 12:20:25.994357 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab7093b8_e012_4655_ba79_137326ea7bfa.slice/crio-e261c1fe6f0cc748731ce14c04fdd57aeb74e43c35828b93cbf934ec37ff1092 WatchSource:0}: Error finding container e261c1fe6f0cc748731ce14c04fdd57aeb74e43c35828b93cbf934ec37ff1092: Status 404 returned error can't find the container with id e261c1fe6f0cc748731ce14c04fdd57aeb74e43c35828b93cbf934ec37ff1092 Nov 21 12:20:26 crc kubenswrapper[4769]: I1121 12:20:26.396555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" event={"ID":"ab7093b8-e012-4655-ba79-137326ea7bfa","Type":"ContainerStarted","Data":"90e305dcc2adbf7693208d066dba8a7311f737a2ca716344e9b053b80b47785c"} Nov 21 12:20:26 crc kubenswrapper[4769]: I1121 12:20:26.397090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" event={"ID":"ab7093b8-e012-4655-ba79-137326ea7bfa","Type":"ContainerStarted","Data":"e261c1fe6f0cc748731ce14c04fdd57aeb74e43c35828b93cbf934ec37ff1092"} Nov 21 12:20:26 crc kubenswrapper[4769]: I1121 12:20:26.416609 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" podStartSLOduration=1.41658861 podStartE2EDuration="1.41658861s" podCreationTimestamp="2025-11-21 12:20:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:26.410900267 +0000 UTC m=+1785.111562095" watchObservedRunningTime="2025-11-21 12:20:26.41658861 +0000 UTC m=+1785.117250428" Nov 21 12:20:26 crc kubenswrapper[4769]: I1121 12:20:26.720419 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:26 crc kubenswrapper[4769]: I1121 12:20:26.720477 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:27 crc kubenswrapper[4769]: I1121 12:20:27.803063 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:27 crc kubenswrapper[4769]: I1121 12:20:27.803148 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:27 crc kubenswrapper[4769]: I1121 12:20:27.803453 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.27:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:27 crc kubenswrapper[4769]: I1121 12:20:27.803533 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.27:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:28 crc kubenswrapper[4769]: I1121 12:20:28.813457 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.28:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:28 crc kubenswrapper[4769]: I1121 12:20:28.813463 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.28:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:30 crc kubenswrapper[4769]: I1121 12:20:30.274938 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:20:30 crc kubenswrapper[4769]: E1121 12:20:30.275197 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:20:30 crc kubenswrapper[4769]: I1121 12:20:30.712828 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:30 crc kubenswrapper[4769]: I1121 12:20:30.763167 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:31 crc kubenswrapper[4769]: I1121 12:20:31.448500 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab7093b8-e012-4655-ba79-137326ea7bfa" containerID="90e305dcc2adbf7693208d066dba8a7311f737a2ca716344e9b053b80b47785c" exitCode=0 Nov 21 12:20:31 crc kubenswrapper[4769]: I1121 12:20:31.449486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" event={"ID":"ab7093b8-e012-4655-ba79-137326ea7bfa","Type":"ContainerDied","Data":"90e305dcc2adbf7693208d066dba8a7311f737a2ca716344e9b053b80b47785c"} Nov 21 12:20:31 crc kubenswrapper[4769]: I1121 12:20:31.485675 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.837123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.931318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-config-data\") pod \"ab7093b8-e012-4655-ba79-137326ea7bfa\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.931452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnp8c\" (UniqueName: \"kubernetes.io/projected/ab7093b8-e012-4655-ba79-137326ea7bfa-kube-api-access-vnp8c\") pod \"ab7093b8-e012-4655-ba79-137326ea7bfa\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.931495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-scripts\") pod \"ab7093b8-e012-4655-ba79-137326ea7bfa\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.931575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-combined-ca-bundle\") pod \"ab7093b8-e012-4655-ba79-137326ea7bfa\" (UID: \"ab7093b8-e012-4655-ba79-137326ea7bfa\") " Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.937033 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab7093b8-e012-4655-ba79-137326ea7bfa-kube-api-access-vnp8c" (OuterVolumeSpecName: "kube-api-access-vnp8c") pod "ab7093b8-e012-4655-ba79-137326ea7bfa" (UID: "ab7093b8-e012-4655-ba79-137326ea7bfa"). InnerVolumeSpecName "kube-api-access-vnp8c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.937108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-scripts" (OuterVolumeSpecName: "scripts") pod "ab7093b8-e012-4655-ba79-137326ea7bfa" (UID: "ab7093b8-e012-4655-ba79-137326ea7bfa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.960400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab7093b8-e012-4655-ba79-137326ea7bfa" (UID: "ab7093b8-e012-4655-ba79-137326ea7bfa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:32 crc kubenswrapper[4769]: I1121 12:20:32.961971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-config-data" (OuterVolumeSpecName: "config-data") pod "ab7093b8-e012-4655-ba79-137326ea7bfa" (UID: "ab7093b8-e012-4655-ba79-137326ea7bfa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.033557 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.033600 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.033613 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vnp8c\" (UniqueName: \"kubernetes.io/projected/ab7093b8-e012-4655-ba79-137326ea7bfa-kube-api-access-vnp8c\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.033627 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab7093b8-e012-4655-ba79-137326ea7bfa-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.472983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" event={"ID":"ab7093b8-e012-4655-ba79-137326ea7bfa","Type":"ContainerDied","Data":"e261c1fe6f0cc748731ce14c04fdd57aeb74e43c35828b93cbf934ec37ff1092"} Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.473301 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e261c1fe6f0cc748731ce14c04fdd57aeb74e43c35828b93cbf934ec37ff1092" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.473021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw" Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.655793 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.656049 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" containerName="nova-scheduler-scheduler" containerID="cri-o://ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" gracePeriod=30 Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.664978 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.665256 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-log" containerID="cri-o://cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd" gracePeriod=30 Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.665433 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-api" containerID="cri-o://17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e" gracePeriod=30 Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.738481 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.738770 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-log" containerID="cri-o://4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a" gracePeriod=30 Nov 21 12:20:33 crc kubenswrapper[4769]: I1121 12:20:33.739084 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-metadata" containerID="cri-o://289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13" gracePeriod=30 Nov 21 12:20:34 crc kubenswrapper[4769]: I1121 12:20:34.485513 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerID="cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd" exitCode=143 Nov 21 12:20:34 crc kubenswrapper[4769]: I1121 12:20:34.485617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8b15e49d-aea2-4816-8f14-c4d333ae7bac","Type":"ContainerDied","Data":"cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd"} Nov 21 12:20:34 crc kubenswrapper[4769]: I1121 12:20:34.489467 4769 generic.go:334] "Generic (PLEG): container finished" podID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerID="4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a" exitCode=143 Nov 21 12:20:34 crc kubenswrapper[4769]: I1121 12:20:34.489500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b25fc44a-2957-4797-aebd-c750b7322ff7","Type":"ContainerDied","Data":"4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a"} Nov 21 12:20:35 crc kubenswrapper[4769]: I1121 12:20:35.393941 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:35 crc kubenswrapper[4769]: E1121 12:20:35.715438 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:20:35 crc kubenswrapper[4769]: E1121 12:20:35.718137 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:20:35 crc kubenswrapper[4769]: E1121 12:20:35.720016 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:20:35 crc kubenswrapper[4769]: E1121 12:20:35.720050 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" containerName="nova-scheduler-scheduler" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.311588 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.314730 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.408664 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-config-data\") pod \"b25fc44a-2957-4797-aebd-c750b7322ff7\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.408739 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-config-data\") pod \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.408810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b15e49d-aea2-4816-8f14-c4d333ae7bac-logs\") pod \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.408850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b25fc44a-2957-4797-aebd-c750b7322ff7-logs\") pod \"b25fc44a-2957-4797-aebd-c750b7322ff7\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.408882 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct5bn\" (UniqueName: \"kubernetes.io/projected/8b15e49d-aea2-4816-8f14-c4d333ae7bac-kube-api-access-ct5bn\") pod \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.408931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-nova-metadata-tls-certs\") pod \"b25fc44a-2957-4797-aebd-c750b7322ff7\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.409046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-combined-ca-bundle\") pod \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\" (UID: \"8b15e49d-aea2-4816-8f14-c4d333ae7bac\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.409108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-combined-ca-bundle\") pod \"b25fc44a-2957-4797-aebd-c750b7322ff7\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.409503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25fc44a-2957-4797-aebd-c750b7322ff7-logs" (OuterVolumeSpecName: "logs") pod "b25fc44a-2957-4797-aebd-c750b7322ff7" (UID: "b25fc44a-2957-4797-aebd-c750b7322ff7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.409929 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b15e49d-aea2-4816-8f14-c4d333ae7bac-logs" (OuterVolumeSpecName: "logs") pod "8b15e49d-aea2-4816-8f14-c4d333ae7bac" (UID: "8b15e49d-aea2-4816-8f14-c4d333ae7bac"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.410717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkpfs\" (UniqueName: \"kubernetes.io/projected/b25fc44a-2957-4797-aebd-c750b7322ff7-kube-api-access-nkpfs\") pod \"b25fc44a-2957-4797-aebd-c750b7322ff7\" (UID: \"b25fc44a-2957-4797-aebd-c750b7322ff7\") " Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.411641 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b15e49d-aea2-4816-8f14-c4d333ae7bac-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.411697 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b25fc44a-2957-4797-aebd-c750b7322ff7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.426639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b15e49d-aea2-4816-8f14-c4d333ae7bac-kube-api-access-ct5bn" (OuterVolumeSpecName: "kube-api-access-ct5bn") pod "8b15e49d-aea2-4816-8f14-c4d333ae7bac" (UID: "8b15e49d-aea2-4816-8f14-c4d333ae7bac"). InnerVolumeSpecName "kube-api-access-ct5bn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.433215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25fc44a-2957-4797-aebd-c750b7322ff7-kube-api-access-nkpfs" (OuterVolumeSpecName: "kube-api-access-nkpfs") pod "b25fc44a-2957-4797-aebd-c750b7322ff7" (UID: "b25fc44a-2957-4797-aebd-c750b7322ff7"). InnerVolumeSpecName "kube-api-access-nkpfs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.447525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-config-data" (OuterVolumeSpecName: "config-data") pod "b25fc44a-2957-4797-aebd-c750b7322ff7" (UID: "b25fc44a-2957-4797-aebd-c750b7322ff7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.450461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-config-data" (OuterVolumeSpecName: "config-data") pod "8b15e49d-aea2-4816-8f14-c4d333ae7bac" (UID: "8b15e49d-aea2-4816-8f14-c4d333ae7bac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.461873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b15e49d-aea2-4816-8f14-c4d333ae7bac" (UID: "8b15e49d-aea2-4816-8f14-c4d333ae7bac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.464028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b25fc44a-2957-4797-aebd-c750b7322ff7" (UID: "b25fc44a-2957-4797-aebd-c750b7322ff7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.482987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b25fc44a-2957-4797-aebd-c750b7322ff7" (UID: "b25fc44a-2957-4797-aebd-c750b7322ff7"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513170 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513244 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513255 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nkpfs\" (UniqueName: \"kubernetes.io/projected/b25fc44a-2957-4797-aebd-c750b7322ff7-kube-api-access-nkpfs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513267 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513276 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b15e49d-aea2-4816-8f14-c4d333ae7bac-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513284 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ct5bn\" (UniqueName: \"kubernetes.io/projected/8b15e49d-aea2-4816-8f14-c4d333ae7bac-kube-api-access-ct5bn\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.513293 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b25fc44a-2957-4797-aebd-c750b7322ff7-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.521360 4769 generic.go:334] "Generic (PLEG): container finished" podID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerID="289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13" exitCode=0 Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.521428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b25fc44a-2957-4797-aebd-c750b7322ff7","Type":"ContainerDied","Data":"289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13"} Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.521462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b25fc44a-2957-4797-aebd-c750b7322ff7","Type":"ContainerDied","Data":"0214c84f0dae3fffd11d3d37780a371212185cd6ab3b29fb8ba26eb55633ad1a"} Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.521488 4769 scope.go:117] "RemoveContainer" containerID="289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.521744 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.523564 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerID="17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e" exitCode=0 Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.523655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8b15e49d-aea2-4816-8f14-c4d333ae7bac","Type":"ContainerDied","Data":"17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e"} Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.523706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8b15e49d-aea2-4816-8f14-c4d333ae7bac","Type":"ContainerDied","Data":"974d4bbe98480ad0b4038fc018605ed2c081ca98f0d75421463aeed85b833765"} Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.523838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.570383 4769 scope.go:117] "RemoveContainer" containerID="4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.587944 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.620461 4769 scope.go:117] "RemoveContainer" containerID="289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.620663 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.637530 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13\": container with ID starting with 289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13 not found: ID does not exist" containerID="289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.637599 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13"} err="failed to get container status \"289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13\": rpc error: code = NotFound desc = could not find container \"289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13\": container with ID starting with 289ffe473eb76d6fe88e2a01c23db662a56a72b48c0f3f19bf04c658e0e1cb13 not found: ID does not exist" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.637641 4769 scope.go:117] "RemoveContainer" containerID="4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.638137 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a\": container with ID starting with 4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a not found: ID does not exist" containerID="4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.638165 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a"} err="failed to get container status \"4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a\": rpc error: code = NotFound desc = could not find container \"4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a\": container with ID starting with 4b120bb0928d4608324998136e12dff54f85a5c37ff311a7b4d3986f8a53794a not found: ID does not exist" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.638202 4769 scope.go:117] "RemoveContainer" containerID="17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.660409 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.664007 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.674325 4769 scope.go:117] "RemoveContainer" containerID="cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.674584 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.675357 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-api" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-api" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.675397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-log" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675437 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-log" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.675464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-log" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675472 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-log" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.675486 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-metadata" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675514 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-metadata" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.675539 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab7093b8-e012-4655-ba79-137326ea7bfa" containerName="nova-manage" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675547 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab7093b8-e012-4655-ba79-137326ea7bfa" containerName="nova-manage" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675853 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-api" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675882 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-metadata" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675925 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" containerName="nova-api-log" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675934 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab7093b8-e012-4655-ba79-137326ea7bfa" containerName="nova-manage" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.675953 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" containerName="nova-metadata-log" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.677572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.687273 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.690732 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.699011 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.705068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.709250 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.709401 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.716648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv2cd\" (UniqueName: \"kubernetes.io/projected/a9e79a06-2cce-4a73-816b-63a01eda3996-kube-api-access-qv2cd\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.716755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.716795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9e79a06-2cce-4a73-816b-63a01eda3996-logs\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.716835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-config-data\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.716655 4769 scope.go:117] "RemoveContainer" containerID="17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.717365 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e\": container with ID starting with 17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e not found: ID does not exist" containerID="17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.717415 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e"} err="failed to get container status \"17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e\": rpc error: code = NotFound desc = could not find container \"17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e\": container with ID starting with 17eaee135feff3ce8bd7686cfdd1e50bb29dfeb0613d847da7546827431e174e not found: ID does not exist" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.717445 4769 scope.go:117] "RemoveContainer" containerID="cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd" Nov 21 12:20:37 crc kubenswrapper[4769]: E1121 12:20:37.717695 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd\": container with ID starting with cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd not found: ID does not exist" containerID="cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.717725 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd"} err="failed to get container status \"cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd\": rpc error: code = NotFound desc = could not find container \"cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd\": container with ID starting with cfc4489437e706fafd2e8572e9bee4a9866eca860c4df1bedfe831d15b15fbbd not found: ID does not exist" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.731511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.820025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-config-data\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.820139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphvm\" (UniqueName: \"kubernetes.io/projected/9c849e8b-0572-485c-a8cc-3436a605a5d4-kube-api-access-hphvm\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.820236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.820283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c849e8b-0572-485c-a8cc-3436a605a5d4-logs\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.820312 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9e79a06-2cce-4a73-816b-63a01eda3996-logs\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.820360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-config-data\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.821054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9e79a06-2cce-4a73-816b-63a01eda3996-logs\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.821337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.821485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qv2cd\" (UniqueName: \"kubernetes.io/projected/a9e79a06-2cce-4a73-816b-63a01eda3996-kube-api-access-qv2cd\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.821530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.826294 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-config-data\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.827905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.847073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv2cd\" (UniqueName: \"kubernetes.io/projected/a9e79a06-2cce-4a73-816b-63a01eda3996-kube-api-access-qv2cd\") pod \"nova-api-0\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.923028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.923148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-config-data\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.923207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hphvm\" (UniqueName: \"kubernetes.io/projected/9c849e8b-0572-485c-a8cc-3436a605a5d4-kube-api-access-hphvm\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.923238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c849e8b-0572-485c-a8cc-3436a605a5d4-logs\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.923328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.924283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c849e8b-0572-485c-a8cc-3436a605a5d4-logs\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.928015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.930662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-config-data\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.932698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:37 crc kubenswrapper[4769]: I1121 12:20:37.949849 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphvm\" (UniqueName: \"kubernetes.io/projected/9c849e8b-0572-485c-a8cc-3436a605a5d4-kube-api-access-hphvm\") pod \"nova-metadata-0\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:38 crc kubenswrapper[4769]: I1121 12:20:38.013271 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:38 crc kubenswrapper[4769]: I1121 12:20:38.029479 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:38 crc kubenswrapper[4769]: I1121 12:20:38.571593 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:20:38 crc kubenswrapper[4769]: I1121 12:20:38.644311 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:20:38 crc kubenswrapper[4769]: W1121 12:20:38.645001 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c849e8b_0572_485c_a8cc_3436a605a5d4.slice/crio-9e105945dd15cc7c500f23d6fbffb2bfd348a6748d7bd609866fea1bbe6175a2 WatchSource:0}: Error finding container 9e105945dd15cc7c500f23d6fbffb2bfd348a6748d7bd609866fea1bbe6175a2: Status 404 returned error can't find the container with id 9e105945dd15cc7c500f23d6fbffb2bfd348a6748d7bd609866fea1bbe6175a2 Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.046889 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.047252 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="8ecb8b81-c9f2-4fda-a634-86629d31cebe" containerName="kube-state-metrics" containerID="cri-o://dcd9d7f1b0c9b1520961d2efc14cf280531d51badfb0be062c61d96275253045" gracePeriod=30 Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.284264 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b15e49d-aea2-4816-8f14-c4d333ae7bac" path="/var/lib/kubelet/pods/8b15e49d-aea2-4816-8f14-c4d333ae7bac/volumes" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.285249 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25fc44a-2957-4797-aebd-c750b7322ff7" path="/var/lib/kubelet/pods/b25fc44a-2957-4797-aebd-c750b7322ff7/volumes" Nov 21 12:20:39 crc kubenswrapper[4769]: E1121 12:20:39.301387 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ecb8b81_c9f2_4fda_a634_86629d31cebe.slice/crio-conmon-dcd9d7f1b0c9b1520961d2efc14cf280531d51badfb0be062c61d96275253045.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.311614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.351142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct7jh\" (UniqueName: \"kubernetes.io/projected/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-kube-api-access-ct7jh\") pod \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.351287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-combined-ca-bundle\") pod \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.351356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-config-data\") pod \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\" (UID: \"63575de7-3f4e-4bbb-a4b7-6c6157a5c591\") " Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.357210 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-kube-api-access-ct7jh" (OuterVolumeSpecName: "kube-api-access-ct7jh") pod "63575de7-3f4e-4bbb-a4b7-6c6157a5c591" (UID: "63575de7-3f4e-4bbb-a4b7-6c6157a5c591"). InnerVolumeSpecName "kube-api-access-ct7jh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.383540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "63575de7-3f4e-4bbb-a4b7-6c6157a5c591" (UID: "63575de7-3f4e-4bbb-a4b7-6c6157a5c591"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.401684 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-config-data" (OuterVolumeSpecName: "config-data") pod "63575de7-3f4e-4bbb-a4b7-6c6157a5c591" (UID: "63575de7-3f4e-4bbb-a4b7-6c6157a5c591"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.453845 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ct7jh\" (UniqueName: \"kubernetes.io/projected/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-kube-api-access-ct7jh\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.453885 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.453895 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63575de7-3f4e-4bbb-a4b7-6c6157a5c591-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.554457 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c849e8b-0572-485c-a8cc-3436a605a5d4","Type":"ContainerStarted","Data":"b4b3f57099e41a56cbff74a84cacda2ce3ff279cdeb430ff8e11bc8f337593ae"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.554500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c849e8b-0572-485c-a8cc-3436a605a5d4","Type":"ContainerStarted","Data":"cc23fc45461ffe3ef999a7fcd41dbe4dd21a5619869db7852079c67badbe6543"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.554509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c849e8b-0572-485c-a8cc-3436a605a5d4","Type":"ContainerStarted","Data":"9e105945dd15cc7c500f23d6fbffb2bfd348a6748d7bd609866fea1bbe6175a2"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.557839 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ecb8b81-c9f2-4fda-a634-86629d31cebe" containerID="dcd9d7f1b0c9b1520961d2efc14cf280531d51badfb0be062c61d96275253045" exitCode=2 Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.557884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8ecb8b81-c9f2-4fda-a634-86629d31cebe","Type":"ContainerDied","Data":"dcd9d7f1b0c9b1520961d2efc14cf280531d51badfb0be062c61d96275253045"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.562161 4769 generic.go:334] "Generic (PLEG): container finished" podID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" exitCode=0 Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.562221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63575de7-3f4e-4bbb-a4b7-6c6157a5c591","Type":"ContainerDied","Data":"ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.562241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63575de7-3f4e-4bbb-a4b7-6c6157a5c591","Type":"ContainerDied","Data":"82fcb6cba3711bb46dd04a80879bed16b017f9a4ffb63b8d012980e0aad6e99e"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.562257 4769 scope.go:117] "RemoveContainer" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.562367 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.568559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a9e79a06-2cce-4a73-816b-63a01eda3996","Type":"ContainerStarted","Data":"3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.568608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a9e79a06-2cce-4a73-816b-63a01eda3996","Type":"ContainerStarted","Data":"4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.568619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a9e79a06-2cce-4a73-816b-63a01eda3996","Type":"ContainerStarted","Data":"856fe2a553cb752284ff6b847a21cedb5deceb4fefcb7cd514d95b7008a1a942"} Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.576511 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.5764922070000003 podStartE2EDuration="2.576492207s" podCreationTimestamp="2025-11-21 12:20:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:39.574555905 +0000 UTC m=+1798.275217723" watchObservedRunningTime="2025-11-21 12:20:39.576492207 +0000 UTC m=+1798.277154025" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.617854 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.617829839 podStartE2EDuration="2.617829839s" podCreationTimestamp="2025-11-21 12:20:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:39.597024859 +0000 UTC m=+1798.297686697" watchObservedRunningTime="2025-11-21 12:20:39.617829839 +0000 UTC m=+1798.318491657" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.627369 4769 scope.go:117] "RemoveContainer" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" Nov 21 12:20:39 crc kubenswrapper[4769]: E1121 12:20:39.628529 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5\": container with ID starting with ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5 not found: ID does not exist" containerID="ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.628567 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5"} err="failed to get container status \"ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5\": rpc error: code = NotFound desc = could not find container \"ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5\": container with ID starting with ce79efcca8c3ea862cd86daf29dfaa9a3ebed71006c4d3200c5df937a53adfb5 not found: ID does not exist" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.634841 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.646161 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.646580 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.658690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zjdp\" (UniqueName: \"kubernetes.io/projected/8ecb8b81-c9f2-4fda-a634-86629d31cebe-kube-api-access-6zjdp\") pod \"8ecb8b81-c9f2-4fda-a634-86629d31cebe\" (UID: \"8ecb8b81-c9f2-4fda-a634-86629d31cebe\") " Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.669439 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:39 crc kubenswrapper[4769]: E1121 12:20:39.669834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ecb8b81-c9f2-4fda-a634-86629d31cebe" containerName="kube-state-metrics" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.669846 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ecb8b81-c9f2-4fda-a634-86629d31cebe" containerName="kube-state-metrics" Nov 21 12:20:39 crc kubenswrapper[4769]: E1121 12:20:39.669862 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" containerName="nova-scheduler-scheduler" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.669868 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" containerName="nova-scheduler-scheduler" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.670039 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ecb8b81-c9f2-4fda-a634-86629d31cebe" containerName="kube-state-metrics" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.670062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" containerName="nova-scheduler-scheduler" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.670652 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.676164 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.684740 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.690979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ecb8b81-c9f2-4fda-a634-86629d31cebe-kube-api-access-6zjdp" (OuterVolumeSpecName: "kube-api-access-6zjdp") pod "8ecb8b81-c9f2-4fda-a634-86629d31cebe" (UID: "8ecb8b81-c9f2-4fda-a634-86629d31cebe"). InnerVolumeSpecName "kube-api-access-6zjdp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.760681 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-config-data\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.760804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.760824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmvj9\" (UniqueName: \"kubernetes.io/projected/02eacc35-6822-431b-9909-90f9d7a0497c-kube-api-access-vmvj9\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.760896 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6zjdp\" (UniqueName: \"kubernetes.io/projected/8ecb8b81-c9f2-4fda-a634-86629d31cebe-kube-api-access-6zjdp\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.861976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-config-data\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.862112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.862134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vmvj9\" (UniqueName: \"kubernetes.io/projected/02eacc35-6822-431b-9909-90f9d7a0497c-kube-api-access-vmvj9\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.867737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-config-data\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.868235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:39 crc kubenswrapper[4769]: I1121 12:20:39.882414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmvj9\" (UniqueName: \"kubernetes.io/projected/02eacc35-6822-431b-9909-90f9d7a0497c-kube-api-access-vmvj9\") pod \"nova-scheduler-0\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.026636 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.532335 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.601915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eacc35-6822-431b-9909-90f9d7a0497c","Type":"ContainerStarted","Data":"d425f44070afa3ad6aac103dfd942d3bc8318fa2b7d0bc44a29337971ab1c0da"} Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.605642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8ecb8b81-c9f2-4fda-a634-86629d31cebe","Type":"ContainerDied","Data":"1b2c73e52fc5bed3f5e009d06a566c84b97aa752af3b2cfd48cf514423bda925"} Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.605699 4769 scope.go:117] "RemoveContainer" containerID="dcd9d7f1b0c9b1520961d2efc14cf280531d51badfb0be062c61d96275253045" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.605877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.663073 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.671133 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.684354 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.689534 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.711782 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.712167 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.736367 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.779204 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.779367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rld\" (UniqueName: \"kubernetes.io/projected/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-api-access-d6rld\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.779406 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.779445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.881653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rld\" (UniqueName: \"kubernetes.io/projected/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-api-access-d6rld\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.881722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.881766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.881852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.886077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.886761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.889517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:40 crc kubenswrapper[4769]: I1121 12:20:40.898929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rld\" (UniqueName: \"kubernetes.io/projected/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-api-access-d6rld\") pod \"kube-state-metrics-0\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.042432 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.153253 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.154045 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="sg-core" containerID="cri-o://a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0" gracePeriod=30 Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.154076 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="proxy-httpd" containerID="cri-o://c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd" gracePeriod=30 Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.154126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-notification-agent" containerID="cri-o://9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83" gracePeriod=30 Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.154004 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-central-agent" containerID="cri-o://8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459" gracePeriod=30 Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.277847 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:20:41 crc kubenswrapper[4769]: E1121 12:20:41.278203 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.324293 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63575de7-3f4e-4bbb-a4b7-6c6157a5c591" path="/var/lib/kubelet/pods/63575de7-3f4e-4bbb-a4b7-6c6157a5c591/volumes" Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.325250 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ecb8b81-c9f2-4fda-a634-86629d31cebe" path="/var/lib/kubelet/pods/8ecb8b81-c9f2-4fda-a634-86629d31cebe/volumes" Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.581700 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.624831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eacc35-6822-431b-9909-90f9d7a0497c","Type":"ContainerStarted","Data":"3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f"} Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.631990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"378706f5-ebf7-4c4f-8508-1c704af035c7","Type":"ContainerStarted","Data":"b424e09599b6c6fb042ebecaf930a0345c15cc4e1dfc50f2d0acdbf7c28d40fb"} Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.641984 4769 generic.go:334] "Generic (PLEG): container finished" podID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerID="c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd" exitCode=0 Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.642046 4769 generic.go:334] "Generic (PLEG): container finished" podID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerID="a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0" exitCode=2 Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.642038 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerDied","Data":"c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd"} Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.642091 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerDied","Data":"a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0"} Nov 21 12:20:41 crc kubenswrapper[4769]: I1121 12:20:41.647589 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.647567779 podStartE2EDuration="2.647567779s" podCreationTimestamp="2025-11-21 12:20:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:20:41.645589456 +0000 UTC m=+1800.346251274" watchObservedRunningTime="2025-11-21 12:20:41.647567779 +0000 UTC m=+1800.348229587" Nov 21 12:20:42 crc kubenswrapper[4769]: I1121 12:20:42.663570 4769 generic.go:334] "Generic (PLEG): container finished" podID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerID="8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459" exitCode=0 Nov 21 12:20:42 crc kubenswrapper[4769]: I1121 12:20:42.664443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerDied","Data":"8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459"} Nov 21 12:20:43 crc kubenswrapper[4769]: I1121 12:20:43.029604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:43 crc kubenswrapper[4769]: I1121 12:20:43.029948 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:43 crc kubenswrapper[4769]: I1121 12:20:43.675565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"378706f5-ebf7-4c4f-8508-1c704af035c7","Type":"ContainerStarted","Data":"74813f28ad095d48436449dcfac1c96e568e5de9dd3c39716c530f056b3074e1"} Nov 21 12:20:43 crc kubenswrapper[4769]: I1121 12:20:43.676057 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:43 crc kubenswrapper[4769]: I1121 12:20:43.715537 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.660481432 podStartE2EDuration="3.715513587s" podCreationTimestamp="2025-11-21 12:20:40 +0000 UTC" firstStartedPulling="2025-11-21 12:20:41.592311373 +0000 UTC m=+1800.292973191" lastFinishedPulling="2025-11-21 12:20:42.647343528 +0000 UTC m=+1801.348005346" observedRunningTime="2025-11-21 12:20:43.704367737 +0000 UTC m=+1802.405029555" watchObservedRunningTime="2025-11-21 12:20:43.715513587 +0000 UTC m=+1802.416175405" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.027296 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.359874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.486773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-sg-core-conf-yaml\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.487229 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-config-data\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.487268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-combined-ca-bundle\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.487300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvw8w\" (UniqueName: \"kubernetes.io/projected/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-kube-api-access-pvw8w\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.487579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-log-httpd\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.487683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-run-httpd\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.487814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-scripts\") pod \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\" (UID: \"0841b418-ad83-407d-b9e6-4c7d6aa43a1b\") " Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.490291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.490460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.494976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-kube-api-access-pvw8w" (OuterVolumeSpecName: "kube-api-access-pvw8w") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "kube-api-access-pvw8w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.495008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-scripts" (OuterVolumeSpecName: "scripts") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.516916 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.591680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.591876 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.591903 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.591914 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.591925 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.591967 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pvw8w\" (UniqueName: \"kubernetes.io/projected/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-kube-api-access-pvw8w\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.610950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-config-data" (OuterVolumeSpecName: "config-data") pod "0841b418-ad83-407d-b9e6-4c7d6aa43a1b" (UID: "0841b418-ad83-407d-b9e6-4c7d6aa43a1b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.693509 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.693555 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0841b418-ad83-407d-b9e6-4c7d6aa43a1b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.701382 4769 generic.go:334] "Generic (PLEG): container finished" podID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerID="9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83" exitCode=0 Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.701442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerDied","Data":"9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83"} Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.701466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.701496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0841b418-ad83-407d-b9e6-4c7d6aa43a1b","Type":"ContainerDied","Data":"de0db9124c9b40e844bd83a2a09c7f07b9817b0572b5673d3fa02a248a0b0215"} Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.701530 4769 scope.go:117] "RemoveContainer" containerID="c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.740092 4769 scope.go:117] "RemoveContainer" containerID="a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.753518 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.767915 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.769877 4769 scope.go:117] "RemoveContainer" containerID="9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.797079 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.797814 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-notification-agent" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.797848 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-notification-agent" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.797879 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="proxy-httpd" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.797888 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="proxy-httpd" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.797903 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="sg-core" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.797914 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="sg-core" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.797934 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-central-agent" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.797947 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-central-agent" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.798222 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="proxy-httpd" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.798248 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="sg-core" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.798268 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-notification-agent" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.798291 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" containerName="ceilometer-central-agent" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.800727 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.804608 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.804925 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.806000 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.808727 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.810649 4769 scope.go:117] "RemoveContainer" containerID="8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.839883 4769 scope.go:117] "RemoveContainer" containerID="c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.840365 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd\": container with ID starting with c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd not found: ID does not exist" containerID="c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.840398 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd"} err="failed to get container status \"c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd\": rpc error: code = NotFound desc = could not find container \"c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd\": container with ID starting with c1218cef45edb608725b63fcca1c1ca509e1f919363f801c20883a80c9a81acd not found: ID does not exist" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.840444 4769 scope.go:117] "RemoveContainer" containerID="a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.840871 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0\": container with ID starting with a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0 not found: ID does not exist" containerID="a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.840943 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0"} err="failed to get container status \"a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0\": rpc error: code = NotFound desc = could not find container \"a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0\": container with ID starting with a8cb10b4ad44f178f3154dbec5818f977b4b6ef7d412d6dedaa6d959f91be2b0 not found: ID does not exist" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.840959 4769 scope.go:117] "RemoveContainer" containerID="9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.841274 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83\": container with ID starting with 9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83 not found: ID does not exist" containerID="9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.841296 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83"} err="failed to get container status \"9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83\": rpc error: code = NotFound desc = could not find container \"9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83\": container with ID starting with 9e9ee06ef56222cf13a75a71e1abf216b972cf2e7a7d9e9802a11623008dce83 not found: ID does not exist" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.841311 4769 scope.go:117] "RemoveContainer" containerID="8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459" Nov 21 12:20:45 crc kubenswrapper[4769]: E1121 12:20:45.841567 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459\": container with ID starting with 8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459 not found: ID does not exist" containerID="8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.841586 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459"} err="failed to get container status \"8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459\": rpc error: code = NotFound desc = could not find container \"8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459\": container with ID starting with 8ecdc6bc2b006c62ab5c74a1a85e97116a23b8414691af884152a460702ca459 not found: ID does not exist" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-scripts\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998218 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-config-data\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-run-httpd\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvzz6\" (UniqueName: \"kubernetes.io/projected/cef44581-d049-4358-ac62-6ba8b5a59261-kube-api-access-lvzz6\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-log-httpd\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:45 crc kubenswrapper[4769]: I1121 12:20:45.998446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-config-data\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-run-httpd\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lvzz6\" (UniqueName: \"kubernetes.io/projected/cef44581-d049-4358-ac62-6ba8b5a59261-kube-api-access-lvzz6\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-log-httpd\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.100906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.101019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-scripts\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.102666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-run-httpd\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.103052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-log-httpd\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.107442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.107549 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-config-data\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.108386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-scripts\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.108545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.115593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.120595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvzz6\" (UniqueName: \"kubernetes.io/projected/cef44581-d049-4358-ac62-6ba8b5a59261-kube-api-access-lvzz6\") pod \"ceilometer-0\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.133531 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.589105 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:20:46 crc kubenswrapper[4769]: I1121 12:20:46.712298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerStarted","Data":"a9487d2a0732fe931bcfc8928994b665a90487248da8d2ab2237ea688142873d"} Nov 21 12:20:47 crc kubenswrapper[4769]: I1121 12:20:47.286494 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0841b418-ad83-407d-b9e6-4c7d6aa43a1b" path="/var/lib/kubelet/pods/0841b418-ad83-407d-b9e6-4c7d6aa43a1b/volumes" Nov 21 12:20:47 crc kubenswrapper[4769]: I1121 12:20:47.736727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerStarted","Data":"d820439637b0ecfa01cbba4062138f44d7ffc759220a63de580c0fd358178e63"} Nov 21 12:20:48 crc kubenswrapper[4769]: I1121 12:20:48.014561 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:48 crc kubenswrapper[4769]: I1121 12:20:48.014908 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:48 crc kubenswrapper[4769]: I1121 12:20:48.030451 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:48 crc kubenswrapper[4769]: I1121 12:20:48.030526 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:48 crc kubenswrapper[4769]: I1121 12:20:48.753424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerStarted","Data":"98cacd081a7fd08ab9313b168323ef89ba84eeb298570f18a0d0418d4eb77eb5"} Nov 21 12:20:48 crc kubenswrapper[4769]: I1121 12:20:48.753497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerStarted","Data":"724dc36fb80e69506e3e400c8f5a1072528e61b70b86debd3b63491b6f41387c"} Nov 21 12:20:49 crc kubenswrapper[4769]: I1121 12:20:49.109364 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.31:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:49 crc kubenswrapper[4769]: I1121 12:20:49.109364 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.32:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:49 crc kubenswrapper[4769]: I1121 12:20:49.109408 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.31:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:49 crc kubenswrapper[4769]: I1121 12:20:49.109502 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.32:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:20:50 crc kubenswrapper[4769]: I1121 12:20:50.027632 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:50 crc kubenswrapper[4769]: I1121 12:20:50.066081 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:50 crc kubenswrapper[4769]: I1121 12:20:50.779368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerStarted","Data":"7de69a31069434588487720f1283fe957a85d9023111caf241ff04e15668f3a3"} Nov 21 12:20:50 crc kubenswrapper[4769]: I1121 12:20:50.779762 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:20:50 crc kubenswrapper[4769]: I1121 12:20:50.803519 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.6465441419999998 podStartE2EDuration="5.803492678s" podCreationTimestamp="2025-11-21 12:20:45 +0000 UTC" firstStartedPulling="2025-11-21 12:20:46.599541192 +0000 UTC m=+1805.300203010" lastFinishedPulling="2025-11-21 12:20:49.756489728 +0000 UTC m=+1808.457151546" observedRunningTime="2025-11-21 12:20:50.799584853 +0000 UTC m=+1809.500246671" watchObservedRunningTime="2025-11-21 12:20:50.803492678 +0000 UTC m=+1809.504154506" Nov 21 12:20:50 crc kubenswrapper[4769]: I1121 12:20:50.823897 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.054719 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.637232 4769 scope.go:117] "RemoveContainer" containerID="01a9779ef2ef2b9e782ee5a92d2cd4be9bf6b0bab2fd76223a9ab8b419219d67" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.660774 4769 scope.go:117] "RemoveContainer" containerID="bc3160c6a457be2c16dc7b665615dd53c042c229de2b9ee436e6c7fcdccd8818" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.708273 4769 scope.go:117] "RemoveContainer" containerID="d9c15d507687b3db340748a9183bb730d5f0a9ea2d81a9506226846bfa031318" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.733735 4769 scope.go:117] "RemoveContainer" containerID="e0612457c3d7563df3a8d3abc3aad429a57c37541d27a4b2f4e5735bafab11b5" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.758277 4769 scope.go:117] "RemoveContainer" containerID="fc34b5b9c89a734a1ca3b777eca08363f055fb209f9d86edd65ba622fa71c3fa" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.787840 4769 scope.go:117] "RemoveContainer" containerID="a5361106354ada0dbadfd1a00f4fbf3a52fac99dcf64776d26f3261df4875e9c" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.810958 4769 scope.go:117] "RemoveContainer" containerID="50dec56698c2c9541cc9251f6d971ffd86e901ad590de59678f8c3a378ab0771" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.834023 4769 scope.go:117] "RemoveContainer" containerID="ad9d867a426f47b9f176c6c2a777c3980b6d17fd81e9d613a8c14dbf2c017f42" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.855023 4769 scope.go:117] "RemoveContainer" containerID="b986a002729503566a1f574b72c6b7e1fa44dbbb3a87e0d0ec923adad2d82a83" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.879611 4769 scope.go:117] "RemoveContainer" containerID="89a9a58d2361e0be72d982129d25a0f205081e5dcb8c3c89106166f9b5c55d15" Nov 21 12:20:51 crc kubenswrapper[4769]: I1121 12:20:51.925154 4769 scope.go:117] "RemoveContainer" containerID="f38c68a26a6082c216ef8f5ce34bc0d7488bef446b4b98446e94c3122164b79e" Nov 21 12:20:52 crc kubenswrapper[4769]: I1121 12:20:52.274331 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:20:52 crc kubenswrapper[4769]: E1121 12:20:52.274575 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.018319 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.018948 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.019226 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.019260 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.022044 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.022703 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.039573 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.040269 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.047543 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:20:58 crc kubenswrapper[4769]: I1121 12:20:58.882853 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.605669 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.606694 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="proxy-httpd" containerID="cri-o://7de69a31069434588487720f1283fe957a85d9023111caf241ff04e15668f3a3" gracePeriod=30 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.606665 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-central-agent" containerID="cri-o://d820439637b0ecfa01cbba4062138f44d7ffc759220a63de580c0fd358178e63" gracePeriod=30 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.606708 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="sg-core" containerID="cri-o://98cacd081a7fd08ab9313b168323ef89ba84eeb298570f18a0d0418d4eb77eb5" gracePeriod=30 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.606830 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-notification-agent" containerID="cri-o://724dc36fb80e69506e3e400c8f5a1072528e61b70b86debd3b63491b6f41387c" gracePeriod=30 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.713850 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.35:3000/\": read tcp 10.217.0.2:46736->10.217.1.35:3000: read: connection reset by peer" Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.799890 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.906912 4769 generic.go:334] "Generic (PLEG): container finished" podID="cef44581-d049-4358-ac62-6ba8b5a59261" containerID="7de69a31069434588487720f1283fe957a85d9023111caf241ff04e15668f3a3" exitCode=0 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.906947 4769 generic.go:334] "Generic (PLEG): container finished" podID="cef44581-d049-4358-ac62-6ba8b5a59261" containerID="98cacd081a7fd08ab9313b168323ef89ba84eeb298570f18a0d0418d4eb77eb5" exitCode=2 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.907002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerDied","Data":"7de69a31069434588487720f1283fe957a85d9023111caf241ff04e15668f3a3"} Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.907053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerDied","Data":"98cacd081a7fd08ab9313b168323ef89ba84eeb298570f18a0d0418d4eb77eb5"} Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.907142 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-log" containerID="cri-o://4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f" gracePeriod=30 Nov 21 12:21:00 crc kubenswrapper[4769]: I1121 12:21:00.907414 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-api" containerID="cri-o://3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5" gracePeriod=30 Nov 21 12:21:01 crc kubenswrapper[4769]: I1121 12:21:01.919347 4769 generic.go:334] "Generic (PLEG): container finished" podID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerID="4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f" exitCode=143 Nov 21 12:21:01 crc kubenswrapper[4769]: I1121 12:21:01.919575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a9e79a06-2cce-4a73-816b-63a01eda3996","Type":"ContainerDied","Data":"4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f"} Nov 21 12:21:01 crc kubenswrapper[4769]: I1121 12:21:01.923793 4769 generic.go:334] "Generic (PLEG): container finished" podID="cef44581-d049-4358-ac62-6ba8b5a59261" containerID="d820439637b0ecfa01cbba4062138f44d7ffc759220a63de580c0fd358178e63" exitCode=0 Nov 21 12:21:01 crc kubenswrapper[4769]: I1121 12:21:01.923835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerDied","Data":"d820439637b0ecfa01cbba4062138f44d7ffc759220a63de580c0fd358178e63"} Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.944504 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.952119 4769 generic.go:334] "Generic (PLEG): container finished" podID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerID="3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5" exitCode=0 Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.952154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a9e79a06-2cce-4a73-816b-63a01eda3996","Type":"ContainerDied","Data":"3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5"} Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.952200 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a9e79a06-2cce-4a73-816b-63a01eda3996","Type":"ContainerDied","Data":"856fe2a553cb752284ff6b847a21cedb5deceb4fefcb7cd514d95b7008a1a942"} Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.952238 4769 scope.go:117] "RemoveContainer" containerID="3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5" Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.952337 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.964298 4769 generic.go:334] "Generic (PLEG): container finished" podID="cef44581-d049-4358-ac62-6ba8b5a59261" containerID="724dc36fb80e69506e3e400c8f5a1072528e61b70b86debd3b63491b6f41387c" exitCode=0 Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.964346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerDied","Data":"724dc36fb80e69506e3e400c8f5a1072528e61b70b86debd3b63491b6f41387c"} Nov 21 12:21:04 crc kubenswrapper[4769]: I1121 12:21:04.991319 4769 scope.go:117] "RemoveContainer" containerID="4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.013651 4769 scope.go:117] "RemoveContainer" containerID="3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.014036 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5\": container with ID starting with 3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5 not found: ID does not exist" containerID="3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.014076 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5"} err="failed to get container status \"3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5\": rpc error: code = NotFound desc = could not find container \"3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5\": container with ID starting with 3e5e264536c8e9c08a5074934c9b65d82580d426ad0589145dad5e4a404966a5 not found: ID does not exist" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.014101 4769 scope.go:117] "RemoveContainer" containerID="4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.014530 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f\": container with ID starting with 4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f not found: ID does not exist" containerID="4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.014604 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f"} err="failed to get container status \"4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f\": rpc error: code = NotFound desc = could not find container \"4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f\": container with ID starting with 4d1cf2c45c977adbe9700a771fb01361516f709f147ef90b60b99d8c783eae8f not found: ID does not exist" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.083685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv2cd\" (UniqueName: \"kubernetes.io/projected/a9e79a06-2cce-4a73-816b-63a01eda3996-kube-api-access-qv2cd\") pod \"a9e79a06-2cce-4a73-816b-63a01eda3996\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.083874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-config-data\") pod \"a9e79a06-2cce-4a73-816b-63a01eda3996\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.083931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9e79a06-2cce-4a73-816b-63a01eda3996-logs\") pod \"a9e79a06-2cce-4a73-816b-63a01eda3996\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.083977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-combined-ca-bundle\") pod \"a9e79a06-2cce-4a73-816b-63a01eda3996\" (UID: \"a9e79a06-2cce-4a73-816b-63a01eda3996\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.087611 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9e79a06-2cce-4a73-816b-63a01eda3996-logs" (OuterVolumeSpecName: "logs") pod "a9e79a06-2cce-4a73-816b-63a01eda3996" (UID: "a9e79a06-2cce-4a73-816b-63a01eda3996"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.114253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e79a06-2cce-4a73-816b-63a01eda3996-kube-api-access-qv2cd" (OuterVolumeSpecName: "kube-api-access-qv2cd") pod "a9e79a06-2cce-4a73-816b-63a01eda3996" (UID: "a9e79a06-2cce-4a73-816b-63a01eda3996"). InnerVolumeSpecName "kube-api-access-qv2cd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.131104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a9e79a06-2cce-4a73-816b-63a01eda3996" (UID: "a9e79a06-2cce-4a73-816b-63a01eda3996"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.131236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-config-data" (OuterVolumeSpecName: "config-data") pod "a9e79a06-2cce-4a73-816b-63a01eda3996" (UID: "a9e79a06-2cce-4a73-816b-63a01eda3996"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.186015 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a9e79a06-2cce-4a73-816b-63a01eda3996-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.186053 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.186066 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qv2cd\" (UniqueName: \"kubernetes.io/projected/a9e79a06-2cce-4a73-816b-63a01eda3996-kube-api-access-qv2cd\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.186091 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9e79a06-2cce-4a73-816b-63a01eda3996-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.195526 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.274601 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.274964 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.286989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvzz6\" (UniqueName: \"kubernetes.io/projected/cef44581-d049-4358-ac62-6ba8b5a59261-kube-api-access-lvzz6\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-combined-ca-bundle\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287081 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-run-httpd\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-log-httpd\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287246 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-ceilometer-tls-certs\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-sg-core-conf-yaml\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-config-data\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.287380 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-scripts\") pod \"cef44581-d049-4358-ac62-6ba8b5a59261\" (UID: \"cef44581-d049-4358-ac62-6ba8b5a59261\") " Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.289984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.291080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.291820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-scripts" (OuterVolumeSpecName: "scripts") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.293914 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.296052 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.303966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef44581-d049-4358-ac62-6ba8b5a59261-kube-api-access-lvzz6" (OuterVolumeSpecName: "kube-api-access-lvzz6") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "kube-api-access-lvzz6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.324529 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.325015 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="sg-core" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325038 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="sg-core" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.325058 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-log" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325065 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-log" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.325081 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-api" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325087 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-api" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.325097 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="proxy-httpd" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325103 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="proxy-httpd" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.325120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-notification-agent" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325126 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-notification-agent" Nov 21 12:21:05 crc kubenswrapper[4769]: E1121 12:21:05.325145 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-central-agent" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325151 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-central-agent" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325404 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-log" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325425 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-central-agent" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325433 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" containerName="nova-api-api" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325442 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="proxy-httpd" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325454 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="ceilometer-notification-agent" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.325460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" containerName="sg-core" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.326888 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.330808 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.330991 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.331100 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.335963 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.370500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.371745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.389968 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-logs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-config-data\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-public-tls-certs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6bmg\" (UniqueName: \"kubernetes.io/projected/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-kube-api-access-n6bmg\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390371 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lvzz6\" (UniqueName: \"kubernetes.io/projected/cef44581-d049-4358-ac62-6ba8b5a59261-kube-api-access-lvzz6\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390383 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390392 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cef44581-d049-4358-ac62-6ba8b5a59261-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390402 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390411 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.390419 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.431961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.482496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-config-data" (OuterVolumeSpecName: "config-data") pod "cef44581-d049-4358-ac62-6ba8b5a59261" (UID: "cef44581-d049-4358-ac62-6ba8b5a59261"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.491782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-config-data\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.491850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.491881 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-public-tls-certs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.491927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6bmg\" (UniqueName: \"kubernetes.io/projected/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-kube-api-access-n6bmg\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.492027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.492053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-logs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.492110 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.492126 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cef44581-d049-4358-ac62-6ba8b5a59261-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.492617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-logs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.495474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-config-data\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.496271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.496733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.500055 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-public-tls-certs\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.511102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6bmg\" (UniqueName: \"kubernetes.io/projected/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-kube-api-access-n6bmg\") pod \"nova-api-0\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.663365 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.993820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cef44581-d049-4358-ac62-6ba8b5a59261","Type":"ContainerDied","Data":"a9487d2a0732fe931bcfc8928994b665a90487248da8d2ab2237ea688142873d"} Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.994154 4769 scope.go:117] "RemoveContainer" containerID="7de69a31069434588487720f1283fe957a85d9023111caf241ff04e15668f3a3" Nov 21 12:21:05 crc kubenswrapper[4769]: I1121 12:21:05.993905 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.027803 4769 scope.go:117] "RemoveContainer" containerID="98cacd081a7fd08ab9313b168323ef89ba84eeb298570f18a0d0418d4eb77eb5" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.049321 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.064907 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.065946 4769 scope.go:117] "RemoveContainer" containerID="724dc36fb80e69506e3e400c8f5a1072528e61b70b86debd3b63491b6f41387c" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.092209 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.094917 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.100181 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.101402 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.101968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.102665 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.106312 4769 scope.go:117] "RemoveContainer" containerID="d820439637b0ecfa01cbba4062138f44d7ffc759220a63de580c0fd358178e63" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.176388 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxp6\" (UniqueName: \"kubernetes.io/projected/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-kube-api-access-lpxp6\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-config-data\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210387 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-run-httpd\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-log-httpd\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-scripts\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.210990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.312898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxp6\" (UniqueName: \"kubernetes.io/projected/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-kube-api-access-lpxp6\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.312950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.313034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.313081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-config-data\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.313904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-run-httpd\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.313114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-run-httpd\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.315210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-log-httpd\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.315308 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-scripts\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.315340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.315616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-log-httpd\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.321973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.322646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.323228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.325766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-scripts\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.330034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-config-data\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.332812 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxp6\" (UniqueName: \"kubernetes.io/projected/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-kube-api-access-lpxp6\") pod \"ceilometer-0\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.425803 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:06 crc kubenswrapper[4769]: I1121 12:21:06.930387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:21:06 crc kubenswrapper[4769]: W1121 12:21:06.935832 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod847cfe9b_ba10_412a_ba1d_b3d7d635f6e1.slice/crio-57de27ad1d696e86fb0c2d91ffbb1776fc670e5e8285445b65f4c2fceea87fc2 WatchSource:0}: Error finding container 57de27ad1d696e86fb0c2d91ffbb1776fc670e5e8285445b65f4c2fceea87fc2: Status 404 returned error can't find the container with id 57de27ad1d696e86fb0c2d91ffbb1776fc670e5e8285445b65f4c2fceea87fc2 Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.005371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerStarted","Data":"57de27ad1d696e86fb0c2d91ffbb1776fc670e5e8285445b65f4c2fceea87fc2"} Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.009966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a","Type":"ContainerStarted","Data":"ee531eaae4596e437913d46d3b12917c98a7852b5af2681a891ae63fe69d63cd"} Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.010015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a","Type":"ContainerStarted","Data":"e8e91b1d726c809a8fdb4dd52969969029d6d35c7c52a9c279f3461f97fae829"} Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.010027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a","Type":"ContainerStarted","Data":"7fb893744b3657bafd687705a1243a33fb3cd2b5dce151de1a5e6269d0c5d3f6"} Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.051296 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.051256133 podStartE2EDuration="2.051256133s" podCreationTimestamp="2025-11-21 12:21:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:21:07.035023457 +0000 UTC m=+1825.735685275" watchObservedRunningTime="2025-11-21 12:21:07.051256133 +0000 UTC m=+1825.751917961" Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.286643 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e79a06-2cce-4a73-816b-63a01eda3996" path="/var/lib/kubelet/pods/a9e79a06-2cce-4a73-816b-63a01eda3996/volumes" Nov 21 12:21:07 crc kubenswrapper[4769]: I1121 12:21:07.287688 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef44581-d049-4358-ac62-6ba8b5a59261" path="/var/lib/kubelet/pods/cef44581-d049-4358-ac62-6ba8b5a59261/volumes" Nov 21 12:21:08 crc kubenswrapper[4769]: I1121 12:21:08.022382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerStarted","Data":"4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c"} Nov 21 12:21:09 crc kubenswrapper[4769]: I1121 12:21:09.034890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerStarted","Data":"2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2"} Nov 21 12:21:10 crc kubenswrapper[4769]: I1121 12:21:10.051518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerStarted","Data":"203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3"} Nov 21 12:21:12 crc kubenswrapper[4769]: I1121 12:21:12.071359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerStarted","Data":"3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247"} Nov 21 12:21:12 crc kubenswrapper[4769]: I1121 12:21:12.072695 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:12 crc kubenswrapper[4769]: I1121 12:21:12.106220 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.246853529 podStartE2EDuration="6.106174054s" podCreationTimestamp="2025-11-21 12:21:06 +0000 UTC" firstStartedPulling="2025-11-21 12:21:06.938382064 +0000 UTC m=+1825.639043892" lastFinishedPulling="2025-11-21 12:21:10.797702599 +0000 UTC m=+1829.498364417" observedRunningTime="2025-11-21 12:21:12.100174743 +0000 UTC m=+1830.800836561" watchObservedRunningTime="2025-11-21 12:21:12.106174054 +0000 UTC m=+1830.806835872" Nov 21 12:21:15 crc kubenswrapper[4769]: I1121 12:21:15.665048 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:15 crc kubenswrapper[4769]: I1121 12:21:15.665999 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:16 crc kubenswrapper[4769]: I1121 12:21:16.679437 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.36:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:21:16 crc kubenswrapper[4769]: I1121 12:21:16.679440 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.36:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:21:19 crc kubenswrapper[4769]: I1121 12:21:19.274710 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:21:19 crc kubenswrapper[4769]: E1121 12:21:19.275490 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:21:25 crc kubenswrapper[4769]: I1121 12:21:25.671116 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:25 crc kubenswrapper[4769]: I1121 12:21:25.672495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:25 crc kubenswrapper[4769]: I1121 12:21:25.672901 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:25 crc kubenswrapper[4769]: I1121 12:21:25.678793 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:26 crc kubenswrapper[4769]: I1121 12:21:26.213138 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:26 crc kubenswrapper[4769]: I1121 12:21:26.219167 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:21:31 crc kubenswrapper[4769]: I1121 12:21:31.275037 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:21:31 crc kubenswrapper[4769]: E1121 12:21:31.276083 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:21:36 crc kubenswrapper[4769]: I1121 12:21:36.434254 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.912805 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-l5h7r"] Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.914392 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.916882 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncontroller-ovncontroller-dockercfg-57fqb" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.917043 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovncontroller-ovndbs" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.919110 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-scripts" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.923457 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-gcd4z"] Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.925631 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.933136 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l5h7r"] Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.942345 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68cwj"] Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.943632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:40 crc kubenswrapper[4769]: W1121 12:21:40.945674 4769 reflector.go:561] object-"openstack-kuttl-tests"/"ovncontroller-metrics-config": failed to list *v1.ConfigMap: configmaps "ovncontroller-metrics-config" is forbidden: User "system:node:crc" cannot list resource "configmaps" in API group "" in the namespace "openstack-kuttl-tests": no relationship found between node 'crc' and this object Nov 21 12:21:40 crc kubenswrapper[4769]: E1121 12:21:40.945726 4769 reflector.go:158] "Unhandled Error" err="object-\"openstack-kuttl-tests\"/\"ovncontroller-metrics-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"ovncontroller-metrics-config\" is forbidden: User \"system:node:crc\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946352 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-etc-ovs\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-log\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhs2\" (UniqueName: \"kubernetes.io/projected/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-kube-api-access-drhs2\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-run\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946860 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-log-ovn\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.946949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-ovn-controller-tls-certs\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.947019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-combined-ca-bundle\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.947108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-scripts\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.947240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run-ovn\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.947343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6bhf\" (UniqueName: \"kubernetes.io/projected/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-kube-api-access-g6bhf\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.947411 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-lib\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.949967 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68cwj"] Nov 21 12:21:40 crc kubenswrapper[4769]: I1121 12:21:40.969501 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-gcd4z"] Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.050979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-combined-ca-bundle\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovn-rundir\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051273 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-etc-ovs\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovs-rundir\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-log\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-drhs2\" (UniqueName: \"kubernetes.io/projected/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-kube-api-access-drhs2\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-run\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051610 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-log-ovn\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-ovn-controller-tls-certs\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-combined-ca-bundle\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-scripts\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db588756-5ba2-4295-80c1-4509acb25940-config\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.051992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run-ovn\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.052029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g6bhf\" (UniqueName: \"kubernetes.io/projected/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-kube-api-access-g6bhf\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.052058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48vlz\" (UniqueName: \"kubernetes.io/projected/db588756-5ba2-4295-80c1-4509acb25940-kube-api-access-48vlz\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.052084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-lib\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.052878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-lib\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.052927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-etc-ovs\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.052950 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-log\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.053021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-log-ovn\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.053176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-run\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.053403 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.053401 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run-ovn\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.055052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-scripts\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.055978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.058608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-ovn-controller-tls-certs\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.058661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-combined-ca-bundle\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.071206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhs2\" (UniqueName: \"kubernetes.io/projected/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-kube-api-access-drhs2\") pod \"ovn-controller-ovs-gcd4z\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.075146 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6bhf\" (UniqueName: \"kubernetes.io/projected/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-kube-api-access-g6bhf\") pod \"ovn-controller-l5h7r\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.154316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db588756-5ba2-4295-80c1-4509acb25940-config\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.154715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.154756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-48vlz\" (UniqueName: \"kubernetes.io/projected/db588756-5ba2-4295-80c1-4509acb25940-kube-api-access-48vlz\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.154805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-combined-ca-bundle\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.154853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovn-rundir\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.154910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovs-rundir\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.155036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovs-rundir\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.155122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovn-rundir\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.158596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.158867 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-combined-ca-bundle\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.176750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-48vlz\" (UniqueName: \"kubernetes.io/projected/db588756-5ba2-4295-80c1-4509acb25940-kube-api-access-48vlz\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.277031 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.294245 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.849473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l5h7r"] Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.870054 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-metrics-config" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.875342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db588756-5ba2-4295-80c1-4509acb25940-config\") pod \"ovn-controller-metrics-68cwj\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.879229 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-gcd4z"] Nov 21 12:21:41 crc kubenswrapper[4769]: W1121 12:21:41.887124 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-6851a88d0cf03b95b621f225e43a78577d5a79f5ebf4a7540f271b056b5e9c2a WatchSource:0}: Error finding container 6851a88d0cf03b95b621f225e43a78577d5a79f5ebf4a7540f271b056b5e9c2a: Status 404 returned error can't find the container with id 6851a88d0cf03b95b621f225e43a78577d5a79f5ebf4a7540f271b056b5e9c2a Nov 21 12:21:41 crc kubenswrapper[4769]: I1121 12:21:41.914571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:42 crc kubenswrapper[4769]: I1121 12:21:42.364640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerStarted","Data":"6851a88d0cf03b95b621f225e43a78577d5a79f5ebf4a7540f271b056b5e9c2a"} Nov 21 12:21:42 crc kubenswrapper[4769]: I1121 12:21:42.366041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l5h7r" event={"ID":"c6bbba07-0fb8-41dd-9af9-73ff06670c8a","Type":"ContainerStarted","Data":"a44636531cf8adee1cc782bbef1ada386ee8e84bd476114bb4be10246079e788"} Nov 21 12:21:42 crc kubenswrapper[4769]: I1121 12:21:42.415960 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68cwj"] Nov 21 12:21:43 crc kubenswrapper[4769]: I1121 12:21:43.290293 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:21:43 crc kubenswrapper[4769]: E1121 12:21:43.290965 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:21:43 crc kubenswrapper[4769]: I1121 12:21:43.389861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" event={"ID":"db588756-5ba2-4295-80c1-4509acb25940","Type":"ContainerStarted","Data":"95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209"} Nov 21 12:21:43 crc kubenswrapper[4769]: I1121 12:21:43.389906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" event={"ID":"db588756-5ba2-4295-80c1-4509acb25940","Type":"ContainerStarted","Data":"4733a07c21b1923ac5a22579bab8bff6f1b9857cfd159f2152b71170567bfe87"} Nov 21 12:21:43 crc kubenswrapper[4769]: I1121 12:21:43.391898 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerID="7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053" exitCode=0 Nov 21 12:21:43 crc kubenswrapper[4769]: I1121 12:21:43.391928 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerDied","Data":"7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053"} Nov 21 12:21:43 crc kubenswrapper[4769]: I1121 12:21:43.432803 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" podStartSLOduration=3.432785127 podStartE2EDuration="3.432785127s" podCreationTimestamp="2025-11-21 12:21:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:21:43.409546123 +0000 UTC m=+1862.110207961" watchObservedRunningTime="2025-11-21 12:21:43.432785127 +0000 UTC m=+1862.133446945" Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.416414 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.417068 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.417082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerStarted","Data":"946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d"} Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.417099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerStarted","Data":"a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24"} Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.423143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l5h7r" event={"ID":"c6bbba07-0fb8-41dd-9af9-73ff06670c8a","Type":"ContainerStarted","Data":"f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0"} Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.441043 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" podStartSLOduration=3.964634807 podStartE2EDuration="4.441021308s" podCreationTimestamp="2025-11-21 12:21:40 +0000 UTC" firstStartedPulling="2025-11-21 12:21:41.88906661 +0000 UTC m=+1860.589728428" lastFinishedPulling="2025-11-21 12:21:42.365453101 +0000 UTC m=+1861.066114929" observedRunningTime="2025-11-21 12:21:44.437211316 +0000 UTC m=+1863.137873134" watchObservedRunningTime="2025-11-21 12:21:44.441021308 +0000 UTC m=+1863.141683146" Nov 21 12:21:44 crc kubenswrapper[4769]: I1121 12:21:44.468653 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-l5h7r" podStartSLOduration=3.282995539 podStartE2EDuration="4.468631519s" podCreationTimestamp="2025-11-21 12:21:40 +0000 UTC" firstStartedPulling="2025-11-21 12:21:41.854987536 +0000 UTC m=+1860.555649354" lastFinishedPulling="2025-11-21 12:21:43.040623516 +0000 UTC m=+1861.741285334" observedRunningTime="2025-11-21 12:21:44.459643757 +0000 UTC m=+1863.160305575" watchObservedRunningTime="2025-11-21 12:21:44.468631519 +0000 UTC m=+1863.169293337" Nov 21 12:21:45 crc kubenswrapper[4769]: I1121 12:21:45.431525 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:45 crc kubenswrapper[4769]: I1121 12:21:45.858026 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-gcd4z"] Nov 21 12:21:45 crc kubenswrapper[4769]: I1121 12:21:45.870901 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l5h7r"] Nov 21 12:21:45 crc kubenswrapper[4769]: I1121 12:21:45.879445 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68cwj"] Nov 21 12:21:45 crc kubenswrapper[4769]: I1121 12:21:45.879632 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" podUID="db588756-5ba2-4295-80c1-4509acb25940" containerName="openstack-network-exporter" containerID="cri-o://95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209" gracePeriod=30 Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.351896 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-68cwj_db588756-5ba2-4295-80c1-4509acb25940/openstack-network-exporter/0.log" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.352238 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.469588 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-68cwj_db588756-5ba2-4295-80c1-4509acb25940/openstack-network-exporter/0.log" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.470608 4769 generic.go:334] "Generic (PLEG): container finished" podID="db588756-5ba2-4295-80c1-4509acb25940" containerID="95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209" exitCode=2 Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.470965 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.471553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" event={"ID":"db588756-5ba2-4295-80c1-4509acb25940","Type":"ContainerDied","Data":"95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209"} Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.471649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68cwj" event={"ID":"db588756-5ba2-4295-80c1-4509acb25940","Type":"ContainerDied","Data":"4733a07c21b1923ac5a22579bab8bff6f1b9857cfd159f2152b71170567bfe87"} Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.471718 4769 scope.go:117] "RemoveContainer" containerID="95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.471971 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-l5h7r" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-57fqb\" not found" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.473973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db588756-5ba2-4295-80c1-4509acb25940-config\") pod \"db588756-5ba2-4295-80c1-4509acb25940\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.474132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovs-rundir\") pod \"db588756-5ba2-4295-80c1-4509acb25940\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.474162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-combined-ca-bundle\") pod \"db588756-5ba2-4295-80c1-4509acb25940\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.474263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48vlz\" (UniqueName: \"kubernetes.io/projected/db588756-5ba2-4295-80c1-4509acb25940-kube-api-access-48vlz\") pod \"db588756-5ba2-4295-80c1-4509acb25940\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.474282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-metrics-certs-tls-certs\") pod \"db588756-5ba2-4295-80c1-4509acb25940\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.474385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovn-rundir\") pod \"db588756-5ba2-4295-80c1-4509acb25940\" (UID: \"db588756-5ba2-4295-80c1-4509acb25940\") " Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.475204 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "db588756-5ba2-4295-80c1-4509acb25940" (UID: "db588756-5ba2-4295-80c1-4509acb25940"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.476540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovs-rundir" (OuterVolumeSpecName: "ovs-rundir") pod "db588756-5ba2-4295-80c1-4509acb25940" (UID: "db588756-5ba2-4295-80c1-4509acb25940"). InnerVolumeSpecName "ovs-rundir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.476798 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db588756-5ba2-4295-80c1-4509acb25940-config" (OuterVolumeSpecName: "config") pod "db588756-5ba2-4295-80c1-4509acb25940" (UID: "db588756-5ba2-4295-80c1-4509acb25940"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.505318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db588756-5ba2-4295-80c1-4509acb25940-kube-api-access-48vlz" (OuterVolumeSpecName: "kube-api-access-48vlz") pod "db588756-5ba2-4295-80c1-4509acb25940" (UID: "db588756-5ba2-4295-80c1-4509acb25940"). InnerVolumeSpecName "kube-api-access-48vlz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.529338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db588756-5ba2-4295-80c1-4509acb25940" (UID: "db588756-5ba2-4295-80c1-4509acb25940"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.576914 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.576944 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db588756-5ba2-4295-80c1-4509acb25940-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.576953 4769 reconciler_common.go:293] "Volume detached for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/db588756-5ba2-4295-80c1-4509acb25940-ovs-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.576961 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.576971 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-48vlz\" (UniqueName: \"kubernetes.io/projected/db588756-5ba2-4295-80c1-4509acb25940-kube-api-access-48vlz\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:46 crc kubenswrapper[4769]: E1121 12:21:46.577032 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Nov 21 12:21:46 crc kubenswrapper[4769]: E1121 12:21:46.577080 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts podName:c6bbba07-0fb8-41dd-9af9-73ff06670c8a nodeName:}" failed. No retries permitted until 2025-11-21 12:21:47.077063238 +0000 UTC m=+1865.777725056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts") pod "ovn-controller-l5h7r" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a") : configmap "ovncontroller-scripts" not found Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.602958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "db588756-5ba2-4295-80c1-4509acb25940" (UID: "db588756-5ba2-4295-80c1-4509acb25940"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.615207 4769 scope.go:117] "RemoveContainer" containerID="95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209" Nov 21 12:21:46 crc kubenswrapper[4769]: E1121 12:21:46.615672 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209\": container with ID starting with 95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209 not found: ID does not exist" containerID="95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.615702 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209"} err="failed to get container status \"95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209\": rpc error: code = NotFound desc = could not find container \"95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209\": container with ID starting with 95c9bd279b92a83258dc819e364e14945517ff98020f9935f9f739d0be770209 not found: ID does not exist" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.678424 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/db588756-5ba2-4295-80c1-4509acb25940-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.804072 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68cwj"] Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.812062 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68cwj"] Nov 21 12:21:46 crc kubenswrapper[4769]: I1121 12:21:46.876408 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovs-vswitchd" containerID="cri-o://946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" gracePeriod=30 Nov 21 12:21:47 crc kubenswrapper[4769]: E1121 12:21:47.084900 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Nov 21 12:21:47 crc kubenswrapper[4769]: E1121 12:21:47.085232 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts podName:c6bbba07-0fb8-41dd-9af9-73ff06670c8a nodeName:}" failed. No retries permitted until 2025-11-21 12:21:48.08521649 +0000 UTC m=+1866.785878308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts") pod "ovn-controller-l5h7r" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a") : configmap "ovncontroller-scripts" not found Nov 21 12:21:47 crc kubenswrapper[4769]: E1121 12:21:47.128738 4769 handlers.go:78] "Exec lifecycle hook for Container in Pod failed" err=< Nov 21 12:21:47 crc kubenswrapper[4769]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Nov 21 12:21:47 crc kubenswrapper[4769]: + source /usr/local/bin/container-scripts/functions Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNBridge=br-int Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNRemote=tcp:localhost:6642 Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNEncapType=geneve Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNAvailabilityZones= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ EnableChassisAsGateway=true Nov 21 12:21:47 crc kubenswrapper[4769]: ++ PhysicalNetworks= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNHostName= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ DB_FILE=/etc/openvswitch/conf.db Nov 21 12:21:47 crc kubenswrapper[4769]: ++ ovs_dir=/var/lib/openvswitch Nov 21 12:21:47 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Nov 21 12:21:47 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Nov 21 12:21:47 crc kubenswrapper[4769]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:21:47 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:21:47 crc kubenswrapper[4769]: + sleep 0.5 Nov 21 12:21:47 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:21:47 crc kubenswrapper[4769]: + cleanup_ovsdb_server_semaphore Nov 21 12:21:47 crc kubenswrapper[4769]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:21:47 crc kubenswrapper[4769]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Nov 21 12:21:47 crc kubenswrapper[4769]: > execCommand=["/usr/local/bin/container-scripts/stop-ovsdb-server.sh"] containerName="ovsdb-server" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" message=< Nov 21 12:21:47 crc kubenswrapper[4769]: Exiting ovsdb-server (5) [ OK ] Nov 21 12:21:47 crc kubenswrapper[4769]: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Nov 21 12:21:47 crc kubenswrapper[4769]: + source /usr/local/bin/container-scripts/functions Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNBridge=br-int Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNRemote=tcp:localhost:6642 Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNEncapType=geneve Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNAvailabilityZones= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ EnableChassisAsGateway=true Nov 21 12:21:47 crc kubenswrapper[4769]: ++ PhysicalNetworks= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNHostName= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ DB_FILE=/etc/openvswitch/conf.db Nov 21 12:21:47 crc kubenswrapper[4769]: ++ ovs_dir=/var/lib/openvswitch Nov 21 12:21:47 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Nov 21 12:21:47 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Nov 21 12:21:47 crc kubenswrapper[4769]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:21:47 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:21:47 crc kubenswrapper[4769]: + sleep 0.5 Nov 21 12:21:47 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:21:47 crc kubenswrapper[4769]: + cleanup_ovsdb_server_semaphore Nov 21 12:21:47 crc kubenswrapper[4769]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:21:47 crc kubenswrapper[4769]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Nov 21 12:21:47 crc kubenswrapper[4769]: > Nov 21 12:21:47 crc kubenswrapper[4769]: E1121 12:21:47.130004 4769 kuberuntime_container.go:691] "PreStop hook failed" err=< Nov 21 12:21:47 crc kubenswrapper[4769]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Nov 21 12:21:47 crc kubenswrapper[4769]: + source /usr/local/bin/container-scripts/functions Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNBridge=br-int Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNRemote=tcp:localhost:6642 Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNEncapType=geneve Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNAvailabilityZones= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ EnableChassisAsGateway=true Nov 21 12:21:47 crc kubenswrapper[4769]: ++ PhysicalNetworks= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ OVNHostName= Nov 21 12:21:47 crc kubenswrapper[4769]: ++ DB_FILE=/etc/openvswitch/conf.db Nov 21 12:21:47 crc kubenswrapper[4769]: ++ ovs_dir=/var/lib/openvswitch Nov 21 12:21:47 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Nov 21 12:21:47 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Nov 21 12:21:47 crc kubenswrapper[4769]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:21:47 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:21:47 crc kubenswrapper[4769]: + sleep 0.5 Nov 21 12:21:47 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:21:47 crc kubenswrapper[4769]: + cleanup_ovsdb_server_semaphore Nov 21 12:21:47 crc kubenswrapper[4769]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:21:47 crc kubenswrapper[4769]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Nov 21 12:21:47 crc kubenswrapper[4769]: > pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server" containerID="cri-o://a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" Nov 21 12:21:47 crc kubenswrapper[4769]: I1121 12:21:47.130715 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server" containerID="cri-o://a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" gracePeriod=30 Nov 21 12:21:47 crc kubenswrapper[4769]: I1121 12:21:47.285264 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db588756-5ba2-4295-80c1-4509acb25940" path="/var/lib/kubelet/pods/db588756-5ba2-4295-80c1-4509acb25940/volumes" Nov 21 12:21:47 crc kubenswrapper[4769]: I1121 12:21:47.481753 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" exitCode=0 Nov 21 12:21:47 crc kubenswrapper[4769]: I1121 12:21:47.481847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerDied","Data":"a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24"} Nov 21 12:21:47 crc kubenswrapper[4769]: E1121 12:21:47.563794 4769 handlers.go:78] "Exec lifecycle hook for Container in Pod failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " execCommand=["/usr/share/ovn/scripts/ovn-ctl","stop_controller"] containerName="ovn-controller" pod="openstack-kuttl-tests/ovn-controller-l5h7r" message=< Nov 21 12:21:47 crc kubenswrapper[4769]: Exiting ovn-controller (1) [ OK ] Nov 21 12:21:47 crc kubenswrapper[4769]: > Nov 21 12:21:47 crc kubenswrapper[4769]: E1121 12:21:47.563838 4769 kuberuntime_container.go:691] "PreStop hook failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " pod="openstack-kuttl-tests/ovn-controller-l5h7r" podUID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" containerName="ovn-controller" containerID="cri-o://f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0" Nov 21 12:21:47 crc kubenswrapper[4769]: I1121 12:21:47.563876 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-l5h7r" podUID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" containerName="ovn-controller" containerID="cri-o://f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0" gracePeriod=30 Nov 21 12:21:48 crc kubenswrapper[4769]: E1121 12:21:48.104924 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Nov 21 12:21:48 crc kubenswrapper[4769]: E1121 12:21:48.105302 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts podName:c6bbba07-0fb8-41dd-9af9-73ff06670c8a nodeName:}" failed. No retries permitted until 2025-11-21 12:21:50.105285039 +0000 UTC m=+1868.805946857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts") pod "ovn-controller-l5h7r" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a") : configmap "ovncontroller-scripts" not found Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.457839 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.494886 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" containerID="f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0" exitCode=0 Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.494941 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l5h7r" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.494942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l5h7r" event={"ID":"c6bbba07-0fb8-41dd-9af9-73ff06670c8a","Type":"ContainerDied","Data":"f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0"} Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.495092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l5h7r" event={"ID":"c6bbba07-0fb8-41dd-9af9-73ff06670c8a","Type":"ContainerDied","Data":"a44636531cf8adee1cc782bbef1ada386ee8e84bd476114bb4be10246079e788"} Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.495124 4769 scope.go:117] "RemoveContainer" containerID="f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.518798 4769 scope.go:117] "RemoveContainer" containerID="f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0" Nov 21 12:21:48 crc kubenswrapper[4769]: E1121 12:21:48.519260 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0\": container with ID starting with f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0 not found: ID does not exist" containerID="f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.519297 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0"} err="failed to get container status \"f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0\": rpc error: code = NotFound desc = could not find container \"f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0\": container with ID starting with f9a8e6124e8fcd884d96a516c4f3a34d311a1eb828cca4d23d09e5d5473a90c0 not found: ID does not exist" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run-ovn\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6bhf\" (UniqueName: \"kubernetes.io/projected/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-kube-api-access-g6bhf\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run" (OuterVolumeSpecName: "var-run") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-log-ovn\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-combined-ca-bundle\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.616534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-ovn-controller-tls-certs\") pod \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\" (UID: \"c6bbba07-0fb8-41dd-9af9-73ff06670c8a\") " Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.617401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts" (OuterVolumeSpecName: "scripts") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.617412 4769 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.617461 4769 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.617471 4769 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-var-log-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.621718 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-kube-api-access-g6bhf" (OuterVolumeSpecName: "kube-api-access-g6bhf") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "kube-api-access-g6bhf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.652706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.698356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-ovn-controller-tls-certs" (OuterVolumeSpecName: "ovn-controller-tls-certs") pod "c6bbba07-0fb8-41dd-9af9-73ff06670c8a" (UID: "c6bbba07-0fb8-41dd-9af9-73ff06670c8a"). InnerVolumeSpecName "ovn-controller-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.718962 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.719019 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g6bhf\" (UniqueName: \"kubernetes.io/projected/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-kube-api-access-g6bhf\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.719030 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.719039 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6bbba07-0fb8-41dd-9af9-73ff06670c8a-ovn-controller-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.837892 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l5h7r"] Nov 21 12:21:48 crc kubenswrapper[4769]: I1121 12:21:48.855625 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l5h7r"] Nov 21 12:21:49 crc kubenswrapper[4769]: I1121 12:21:49.287636 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" path="/var/lib/kubelet/pods/c6bbba07-0fb8-41dd-9af9-73ff06670c8a/volumes" Nov 21 12:21:51 crc kubenswrapper[4769]: E1121 12:21:51.114366 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-conmon-7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:21:52 crc kubenswrapper[4769]: I1121 12:21:52.218828 4769 scope.go:117] "RemoveContainer" containerID="1c992025fa044e59a758248ad17a279a740364afa4ded1df7466a7f0844e4282" Nov 21 12:21:52 crc kubenswrapper[4769]: I1121 12:21:52.244102 4769 scope.go:117] "RemoveContainer" containerID="612b0514da42992de0ad2ef47696f733ca98f09832a95934c7ed0dc9de461197" Nov 21 12:21:52 crc kubenswrapper[4769]: I1121 12:21:52.302451 4769 scope.go:117] "RemoveContainer" containerID="77bd7be7315f1a74c08eda80e545ccae22c5e936cf27112438ce6e3a3e860545" Nov 21 12:21:52 crc kubenswrapper[4769]: I1121 12:21:52.340962 4769 scope.go:117] "RemoveContainer" containerID="8bc982f7fefc9007e8a2c72c5e1339c96041b4629e2e05d425d33e0f4bb62f9c" Nov 21 12:21:52 crc kubenswrapper[4769]: I1121 12:21:52.370363 4769 scope.go:117] "RemoveContainer" containerID="c2509f438638bac6f3f5a217210ed39624d84b4bdb13da23c514c39d94660adf" Nov 21 12:21:52 crc kubenswrapper[4769]: I1121 12:21:52.396046 4769 scope.go:117] "RemoveContainer" containerID="785eebb05575318089d30427f0a14b802279fa7dfe4562c35ee0ba8ec167d96f" Nov 21 12:21:56 crc kubenswrapper[4769]: I1121 12:21:56.274681 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:21:56 crc kubenswrapper[4769]: E1121 12:21:56.275788 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:22:01 crc kubenswrapper[4769]: E1121 12:22:01.331870 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-conmon-7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:22:07 crc kubenswrapper[4769]: I1121 12:22:07.274074 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:22:07 crc kubenswrapper[4769]: E1121 12:22:07.274629 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:22:11 crc kubenswrapper[4769]: E1121 12:22:11.575647 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-conmon-7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.296248 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24 is running failed: container process not found" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.297826 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.297910 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24 is running failed: container process not found" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.298416 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24 is running failed: container process not found" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.298511 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server" Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.299343 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.301932 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Nov 21 12:22:16 crc kubenswrapper[4769]: E1121 12:22:16.301964 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovs-vswitchd" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.315531 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-gcd4z_c5627ee0-e5e4-43e7-8854-a6e90b7d8210/ovs-vswitchd/0.log" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.316637 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.372227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-run\") pod \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.372292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-log\") pod \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.372417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-scripts\") pod \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.372492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drhs2\" (UniqueName: \"kubernetes.io/projected/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-kube-api-access-drhs2\") pod \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.372525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-etc-ovs\") pod \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.372611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-lib\") pod \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\" (UID: \"c5627ee0-e5e4-43e7-8854-a6e90b7d8210\") " Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.374012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-scripts" (OuterVolumeSpecName: "scripts") pod "c5627ee0-e5e4-43e7-8854-a6e90b7d8210" (UID: "c5627ee0-e5e4-43e7-8854-a6e90b7d8210"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.374144 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-run" (OuterVolumeSpecName: "var-run") pod "c5627ee0-e5e4-43e7-8854-a6e90b7d8210" (UID: "c5627ee0-e5e4-43e7-8854-a6e90b7d8210"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.374251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-log" (OuterVolumeSpecName: "var-log") pod "c5627ee0-e5e4-43e7-8854-a6e90b7d8210" (UID: "c5627ee0-e5e4-43e7-8854-a6e90b7d8210"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.376377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-etc-ovs" (OuterVolumeSpecName: "etc-ovs") pod "c5627ee0-e5e4-43e7-8854-a6e90b7d8210" (UID: "c5627ee0-e5e4-43e7-8854-a6e90b7d8210"). InnerVolumeSpecName "etc-ovs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.376416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-lib" (OuterVolumeSpecName: "var-lib") pod "c5627ee0-e5e4-43e7-8854-a6e90b7d8210" (UID: "c5627ee0-e5e4-43e7-8854-a6e90b7d8210"). InnerVolumeSpecName "var-lib". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.382457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-kube-api-access-drhs2" (OuterVolumeSpecName: "kube-api-access-drhs2") pod "c5627ee0-e5e4-43e7-8854-a6e90b7d8210" (UID: "c5627ee0-e5e4-43e7-8854-a6e90b7d8210"). InnerVolumeSpecName "kube-api-access-drhs2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.475380 4769 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.475430 4769 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-log\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.475442 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.475456 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-drhs2\" (UniqueName: \"kubernetes.io/projected/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-kube-api-access-drhs2\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.475466 4769 reconciler_common.go:293] "Volume detached for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-etc-ovs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.475478 4769 reconciler_common.go:293] "Volume detached for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/c5627ee0-e5e4-43e7-8854-a6e90b7d8210-var-lib\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.789323 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-gcd4z_c5627ee0-e5e4-43e7-8854-a6e90b7d8210/ovs-vswitchd/0.log" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.790473 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" exitCode=137 Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.790548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerDied","Data":"946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d"} Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.790683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" event={"ID":"c5627ee0-e5e4-43e7-8854-a6e90b7d8210","Type":"ContainerDied","Data":"6851a88d0cf03b95b621f225e43a78577d5a79f5ebf4a7540f271b056b5e9c2a"} Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.790568 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-gcd4z" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.790742 4769 scope.go:117] "RemoveContainer" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.816444 4769 scope.go:117] "RemoveContainer" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.862168 4769 scope.go:117] "RemoveContainer" containerID="7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.876242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-gcd4z"] Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.886674 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-gcd4z"] Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.896550 4769 scope.go:117] "RemoveContainer" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" Nov 21 12:22:17 crc kubenswrapper[4769]: E1121 12:22:17.897276 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d\": container with ID starting with 946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d not found: ID does not exist" containerID="946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.897316 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d"} err="failed to get container status \"946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d\": rpc error: code = NotFound desc = could not find container \"946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d\": container with ID starting with 946ce050dfb6ab016783f1475719647640710bfc0cbb8700e498e80eea3fd79d not found: ID does not exist" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.897347 4769 scope.go:117] "RemoveContainer" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" Nov 21 12:22:17 crc kubenswrapper[4769]: E1121 12:22:17.897664 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24\": container with ID starting with a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24 not found: ID does not exist" containerID="a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.897686 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24"} err="failed to get container status \"a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24\": rpc error: code = NotFound desc = could not find container \"a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24\": container with ID starting with a597e38ec70b9a3b04689691e894d2e146349cab6af2fd96e5797f1d3f446d24 not found: ID does not exist" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.897698 4769 scope.go:117] "RemoveContainer" containerID="7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053" Nov 21 12:22:17 crc kubenswrapper[4769]: E1121 12:22:17.898027 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053\": container with ID starting with 7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053 not found: ID does not exist" containerID="7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053" Nov 21 12:22:17 crc kubenswrapper[4769]: I1121 12:22:17.898061 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053"} err="failed to get container status \"7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053\": rpc error: code = NotFound desc = could not find container \"7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053\": container with ID starting with 7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053 not found: ID does not exist" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.047785 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.094094 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.094376 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" containerName="openstackclient" containerID="cri-o://baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133" gracePeriod=2 Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.104306 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.113160 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.113243 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data podName:ad94928f-bd00-4e2a-a9a3-8d8a1419bfec nodeName:}" failed. No retries permitted until 2025-11-21 12:22:19.613225322 +0000 UTC m=+1898.313887140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data") pod "rabbitmq-cell1-server-0" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.282345 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.282603 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.316443 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" path="/var/lib/kubelet/pods/c5627ee0-e5e4-43e7-8854-a6e90b7d8210/volumes" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395104 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placementa3a7-account-delete-d4srh"] Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.395711 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovs-vswitchd" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovs-vswitchd" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.395750 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server-init" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395765 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server-init" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.395800 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" containerName="openstackclient" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395806 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" containerName="openstackclient" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.395816 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395822 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.395833 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" containerName="ovn-controller" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395840 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" containerName="ovn-controller" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.395866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db588756-5ba2-4295-80c1-4509acb25940" containerName="openstack-network-exporter" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.395883 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db588756-5ba2-4295-80c1-4509acb25940" containerName="openstack-network-exporter" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.396108 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6bbba07-0fb8-41dd-9af9-73ff06670c8a" containerName="ovn-controller" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.396129 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" containerName="openstackclient" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.396140 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db588756-5ba2-4295-80c1-4509acb25940" containerName="openstack-network-exporter" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.396161 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovs-vswitchd" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.396175 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c5627ee0-e5e4-43e7-8854-a6e90b7d8210" containerName="ovsdb-server" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.397084 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.422447 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.422545 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:19.922522479 +0000 UTC m=+1898.623184297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "barbican-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.423038 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.423232 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:19.923170306 +0000 UTC m=+1898.623832304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "combined-ca-bundle" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.423239 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.423375 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: secret "swift-conf" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.423447 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:19.923436264 +0000 UTC m=+1898.624098082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : secret "swift-conf" not found Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.424363 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.452670 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementa3a7-account-delete-d4srh"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.524981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21376353-0114-447a-aec5-9d1e773e996f-operator-scripts\") pod \"placementa3a7-account-delete-d4srh\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.525229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpr65\" (UniqueName: \"kubernetes.io/projected/21376353-0114-447a-aec5-9d1e773e996f-kube-api-access-lpr65\") pod \"placementa3a7-account-delete-d4srh\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.526752 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.526811 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data podName:9b970d3d-1a5c-40da-90ff-ddcc991a571d nodeName:}" failed. No retries permitted until 2025-11-21 12:22:20.026792327 +0000 UTC m=+1898.727454145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data") pod "rabbitmq-server-0" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d") : configmap "rabbitmq-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.530323 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.530835 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="openstack-network-exporter" containerID="cri-o://985476194a6d86cb1958732c9ca35a10e2f6ed8d97ed6a86416672f4c2d3ced2" gracePeriod=300 Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.579182 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.579527 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="ovn-northd" containerID="cri-o://01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7" gracePeriod=30 Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.580049 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="openstack-network-exporter" containerID="cri-o://bea7449439fa2707fcfabebf5dac9988755c52ccbd6ef1df8584efcdfa95c811" gracePeriod=30 Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.627032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lpr65\" (UniqueName: \"kubernetes.io/projected/21376353-0114-447a-aec5-9d1e773e996f-kube-api-access-lpr65\") pod \"placementa3a7-account-delete-d4srh\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.627351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21376353-0114-447a-aec5-9d1e773e996f-operator-scripts\") pod \"placementa3a7-account-delete-d4srh\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.627674 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.627786 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data podName:ad94928f-bd00-4e2a-a9a3-8d8a1419bfec nodeName:}" failed. No retries permitted until 2025-11-21 12:22:20.627769326 +0000 UTC m=+1899.328431144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data") pod "rabbitmq-cell1-server-0" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.628869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21376353-0114-447a-aec5-9d1e773e996f-operator-scripts\") pod \"placementa3a7-account-delete-d4srh\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.645043 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.645907 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="openstack-network-exporter" containerID="cri-o://b9841c65cfcd0f79fb30a75438ffe6ed585ce9e1daf0312abd4343ea5fc49f08" gracePeriod=300 Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.658236 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:46664->38.102.83.227:40411: write tcp 38.102.83.227:46664->38.102.83.227:40411: write: broken pipe Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.686271 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican22df-account-delete-hdprn"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.688670 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.697216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpr65\" (UniqueName: \"kubernetes.io/projected/21376353-0114-447a-aec5-9d1e773e996f-kube-api-access-lpr65\") pod \"placementa3a7-account-delete-d4srh\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.709057 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican22df-account-delete-hdprn"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.748412 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.753007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d62c426e-d8cb-4861-8e12-19a15e83948d-operator-scripts\") pod \"barbican22df-account-delete-hdprn\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.753211 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b68m\" (UniqueName: \"kubernetes.io/projected/d62c426e-d8cb-4861-8e12-19a15e83948d-kube-api-access-4b68m\") pod \"barbican22df-account-delete-hdprn\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.818045 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance3a55-account-delete-lpj8v"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.826127 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.842277 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zkqsm"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.862028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d62c426e-d8cb-4861-8e12-19a15e83948d-operator-scripts\") pod \"barbican22df-account-delete-hdprn\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.862133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4b68m\" (UniqueName: \"kubernetes.io/projected/d62c426e-d8cb-4861-8e12-19a15e83948d-kube-api-access-4b68m\") pod \"barbican22df-account-delete-hdprn\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.863207 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d62c426e-d8cb-4861-8e12-19a15e83948d-operator-scripts\") pod \"barbican22df-account-delete-hdprn\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.907513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b68m\" (UniqueName: \"kubernetes.io/projected/d62c426e-d8cb-4861-8e12-19a15e83948d-kube-api-access-4b68m\") pod \"barbican22df-account-delete-hdprn\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.912380 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-zkqsm"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.954279 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance3a55-account-delete-lpj8v"] Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.972175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2pn\" (UniqueName: \"kubernetes.io/projected/016592c0-e31c-48bf-8636-626daf48ad49-kube-api-access-gr2pn\") pod \"glance3a55-account-delete-lpj8v\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.972259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/016592c0-e31c-48bf-8636-626daf48ad49-operator-scripts\") pod \"glance3a55-account-delete-lpj8v\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972459 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-storage-config-data: configmap "swift-storage-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972488 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972499 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972513 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972559 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:20.972542246 +0000 UTC m=+1899.673204064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972646 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972672 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:20.972663029 +0000 UTC m=+1899.673324837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "combined-ca-bundle" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.972996 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: E1121 12:22:19.973025 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:20.973018389 +0000 UTC m=+1899.673680207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "barbican-config-data" not found Nov 21 12:22:19 crc kubenswrapper[4769]: I1121 12:22:19.992607 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.032269 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="ovsdbserver-nb" containerID="cri-o://40e1928f40a6d608c2954cb2916b1fb1aba9c7b4b7c6ef9bc35ff7e8867e7c2f" gracePeriod=300 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.053621 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xmmrp"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.074688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2pn\" (UniqueName: \"kubernetes.io/projected/016592c0-e31c-48bf-8636-626daf48ad49-kube-api-access-gr2pn\") pod \"glance3a55-account-delete-lpj8v\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.074764 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/016592c0-e31c-48bf-8636-626daf48ad49-operator-scripts\") pod \"glance3a55-account-delete-lpj8v\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.075591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/016592c0-e31c-48bf-8636-626daf48ad49-operator-scripts\") pod \"glance3a55-account-delete-lpj8v\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:20 crc kubenswrapper[4769]: E1121 12:22:20.075663 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:22:20 crc kubenswrapper[4769]: E1121 12:22:20.075711 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data podName:9b970d3d-1a5c-40da-90ff-ddcc991a571d nodeName:}" failed. No retries permitted until 2025-11-21 12:22:21.075697164 +0000 UTC m=+1899.776358982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data") pod "rabbitmq-server-0" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d") : configmap "rabbitmq-config-data" not found Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.087408 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-xmmrp"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.141220 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="ovsdbserver-sb" containerID="cri-o://113bbdbcb9e0efb0bd65ca73d7e2d3a8238f3a184837df9915776fe1c33c27ad" gracePeriod=300 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.156862 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="ovsdbserver-nb" probeResult="failure" output="" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.265664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2pn\" (UniqueName: \"kubernetes.io/projected/016592c0-e31c-48bf-8636-626daf48ad49-kube-api-access-gr2pn\") pod \"glance3a55-account-delete-lpj8v\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.333321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.369424 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutrond005-account-delete-ngwsv"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.370962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.409112 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jsbs"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.436000 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutrond005-account-delete-ngwsv"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.447092 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-5jsbs"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.466012 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-rc6kw"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.480878 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-rc6kw"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.497070 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder31d6-account-delete-sdktq"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.498634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.511473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder31d6-account-delete-sdktq"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.512679 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25wt\" (UniqueName: \"kubernetes.io/projected/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-kube-api-access-c25wt\") pod \"neutrond005-account-delete-ngwsv\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.512756 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-operator-scripts\") pod \"neutrond005-account-delete-ngwsv\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.534049 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-8rgdr"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.559101 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-8rgdr"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.588581 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mkbbg"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.613997 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-operator-scripts\") pod \"neutrond005-account-delete-ngwsv\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.614074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/446d3e05-b6f6-427d-9264-8a6447945da3-operator-scripts\") pod \"cinder31d6-account-delete-sdktq\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.614121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5blr\" (UniqueName: \"kubernetes.io/projected/446d3e05-b6f6-427d-9264-8a6447945da3-kube-api-access-v5blr\") pod \"cinder31d6-account-delete-sdktq\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.614214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c25wt\" (UniqueName: \"kubernetes.io/projected/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-kube-api-access-c25wt\") pod \"neutrond005-account-delete-ngwsv\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.615415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-operator-scripts\") pod \"neutrond005-account-delete-ngwsv\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.647933 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-mkbbg"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.666273 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi0895-account-delete-4v9rc"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.667729 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.669006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25wt\" (UniqueName: \"kubernetes.io/projected/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-kube-api-access-c25wt\") pod \"neutrond005-account-delete-ngwsv\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.722793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/446d3e05-b6f6-427d-9264-8a6447945da3-operator-scripts\") pod \"cinder31d6-account-delete-sdktq\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.722902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v5blr\" (UniqueName: \"kubernetes.io/projected/446d3e05-b6f6-427d-9264-8a6447945da3-kube-api-access-v5blr\") pod \"cinder31d6-account-delete-sdktq\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: E1121 12:22:20.723525 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:20 crc kubenswrapper[4769]: E1121 12:22:20.723594 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data podName:ad94928f-bd00-4e2a-a9a3-8d8a1419bfec nodeName:}" failed. No retries permitted until 2025-11-21 12:22:22.723572336 +0000 UTC m=+1901.424234154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data") pod "rabbitmq-cell1-server-0" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.725116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/446d3e05-b6f6-427d-9264-8a6447945da3-operator-scripts\") pod \"cinder31d6-account-delete-sdktq\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.740757 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi0895-account-delete-4v9rc"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.741241 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.771733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5blr\" (UniqueName: \"kubernetes.io/projected/446d3e05-b6f6-427d-9264-8a6447945da3-kube-api-access-v5blr\") pod \"cinder31d6-account-delete-sdktq\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.789412 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.803330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5f6f5bfd-47vgz"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.803781 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-log" containerID="cri-o://6de66ba8fe1756d5210aad3a6ae29943290c8cb763fd345214b2270daf476b95" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.803863 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-api" containerID="cri-o://c294f4926913ea9a60162f42ad399069486233b7eff0d59b236f4c3cc4f1abe5" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.826424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts\") pod \"novaapi0895-account-delete-4v9rc\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.826772 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r89c\" (UniqueName: \"kubernetes.io/projected/23a3ecd4-5133-4225-ac3b-a5914cacc71b-kube-api-access-5r89c\") pod \"novaapi0895-account-delete-4v9rc\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.827092 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.838896 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.839031 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.854068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856305 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856692 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-server" containerID="cri-o://1b47402cd4ebcb79ce4f4e3319bf1b549c86d5ae0d483da01038614d771b5d7e" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856769 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="swift-recon-cron" containerID="cri-o://ecac77aced9608a3e0de9db9a8cd73817cce63d849c652425764e04d05c3f16d" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856810 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="rsync" containerID="cri-o://f4e30e1beb7fd96db86bab3c05804f9e7284e6f16adb6a463b56d3123607973f" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856840 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-expirer" containerID="cri-o://d8da63893abbdb88dec1ceb878bd18456a301dce36ff6bcf7fcfe38decb9d82d" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856871 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-updater" containerID="cri-o://5eede93a540279c052a1922a202f61501b5cec8c65a7c89d9b9d2db329d15261" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-auditor" containerID="cri-o://7e98f346bb842a6f0f7f90daa9c76e61f76f39534b58a4f0ca82d3c41ed0261c" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856931 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-replicator" containerID="cri-o://5274219d9fb6a2953704b2da6dd99ff55aaacf5afb220cd87b4549fbb1b4d616" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.856979 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-server" containerID="cri-o://c9a62102a031512e453dd37916c42559e1c19f7d2a47f895b95cf9ec268b4cd2" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857013 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-updater" containerID="cri-o://60cf880275322a5210f7546ddc7c4437085cbe3c435c5a4a64604849cd6e31e2" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857042 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-auditor" containerID="cri-o://545fd17bf1a594b6b79ab5b3c3c474bce9e4a4cdfb1fb3d71d6e809e2321c568" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857071 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-replicator" containerID="cri-o://5ae112626165051404b6c4d21af9ea913b45e0e07640786a82353a9092217ccb" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857116 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-server" containerID="cri-o://380de022fa6897bb49e2b90851a7d26533d4a8796f267d2ebda1b29f716f0754" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857152 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-reaper" containerID="cri-o://f7c98e6ded540db99d1ae274c234ad623eb1d8af56a779214208e374efcc049e" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857302 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-auditor" containerID="cri-o://949ac7e464eca74f7851c055b756f3e7f8553e0c1d049cd1fb2b1a918486ac97" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.857360 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-replicator" containerID="cri-o://1951f2f612d8624661ffb990eb8bdae5620b480f2f298bb3531bb95185fb7460" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.873302 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.873617 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-log" containerID="cri-o://af1cd2d919c7575b7e57f4eda560fb0bf162892f90ce7176b43cfc178cc35b9b" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.873819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-httpd" containerID="cri-o://dd0e43d5b60bac8f8a93051855b26f738ec15e9e35b816fa885086c681956cd3" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.886683 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.887503 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-log" containerID="cri-o://b973ee449f9bf72036cb4a436ce753b74ac421ac2bfbdb5827c31daefe182113" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.894875 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-httpd" containerID="cri-o://8f6ad774a8254888f3e2cdcdc28df21e19a43d07485d96c1026e8cf36d2a802b" gracePeriod=30 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.930160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts\") pod \"novaapi0895-account-delete-4v9rc\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.938219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5r89c\" (UniqueName: \"kubernetes.io/projected/23a3ecd4-5133-4225-ac3b-a5914cacc71b-kube-api-access-5r89c\") pod \"novaapi0895-account-delete-4v9rc\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.938407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.938464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.931723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts\") pod \"novaapi0895-account-delete-4v9rc\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.947426 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="rabbitmq" containerID="cri-o://259aba43b6950c460955890aea38f479d52382b756120c0666d872f19b098bb5" gracePeriod=604800 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.956024 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk"] Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.961387 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.988561 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef/ovsdbserver-nb/0.log" Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.988672 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerID="985476194a6d86cb1958732c9ca35a10e2f6ed8d97ed6a86416672f4c2d3ced2" exitCode=2 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.988699 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerID="40e1928f40a6d608c2954cb2916b1fb1aba9c7b4b7c6ef9bc35ff7e8867e7c2f" exitCode=143 Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.988884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef","Type":"ContainerDied","Data":"985476194a6d86cb1958732c9ca35a10e2f6ed8d97ed6a86416672f4c2d3ced2"} Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.988934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef","Type":"ContainerDied","Data":"40e1928f40a6d608c2954cb2916b1fb1aba9c7b4b7c6ef9bc35ff7e8867e7c2f"} Nov 21 12:22:20 crc kubenswrapper[4769]: I1121 12:22:20.993860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r89c\" (UniqueName: \"kubernetes.io/projected/23a3ecd4-5133-4225-ac3b-a5914cacc71b-kube-api-access-5r89c\") pod \"novaapi0895-account-delete-4v9rc\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.002283 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.046848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.046915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.046956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.047081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.055561 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ff7758bd4-wmvql"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.055852 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-api" containerID="cri-o://2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.056481 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-httpd" containerID="cri-o://58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.088156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr2vr\" (UniqueName: \"kubernetes.io/projected/c81a2490-fdac-4a03-abd8-081f31034cee-kube-api-access-mr2vr\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088550 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088619 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:21.5885983 +0000 UTC m=+1900.289260118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : configmap "openstack-cell1-scripts" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088874 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-storage-config-data: configmap "swift-storage-config-data" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088903 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088914 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088925 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.088980 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:23.088960539 +0000 UTC m=+1901.789622357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.089033 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.089134 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.089172 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:23.089163355 +0000 UTC m=+1901.789825173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "barbican-config-data" not found Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.089236 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.089628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.089917 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.089945 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data podName:9b970d3d-1a5c-40da-90ff-ddcc991a571d nodeName:}" failed. No retries permitted until 2025-11-21 12:22:23.089935406 +0000 UTC m=+1901.790597224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data") pod "rabbitmq-server-0" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d") : configmap "rabbitmq-config-data" not found Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.090942 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.092438 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.092535 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:21.592509425 +0000 UTC m=+1900.293171413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.095968 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:23.095941597 +0000 UTC m=+1901.796603415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "combined-ca-bundle" not found Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.103493 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d/ovsdbserver-sb/0.log" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.103570 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerID="b9841c65cfcd0f79fb30a75438ffe6ed585ce9e1daf0312abd4343ea5fc49f08" exitCode=2 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.103594 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerID="113bbdbcb9e0efb0bd65ca73d7e2d3a8238f3a184837df9915776fe1c33c27ad" exitCode=143 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.103717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d","Type":"ContainerDied","Data":"b9841c65cfcd0f79fb30a75438ffe6ed585ce9e1daf0312abd4343ea5fc49f08"} Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.103748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d","Type":"ContainerDied","Data":"113bbdbcb9e0efb0bd65ca73d7e2d3a8238f3a184837df9915776fe1c33c27ad"} Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.127779 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.142487 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_56f4acf6-717c-423f-b338-bc1344ce9d0b/ovn-northd/0.log" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.152882 4769 generic.go:334] "Generic (PLEG): container finished" podID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerID="bea7449439fa2707fcfabebf5dac9988755c52ccbd6ef1df8584efcdfa95c811" exitCode=2 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.152905 4769 generic.go:334] "Generic (PLEG): container finished" podID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerID="01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7" exitCode=143 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.152923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"56f4acf6-717c-423f-b338-bc1344ce9d0b","Type":"ContainerDied","Data":"bea7449439fa2707fcfabebf5dac9988755c52ccbd6ef1df8584efcdfa95c811"} Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.152944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"56f4acf6-717c-423f-b338-bc1344ce9d0b","Type":"ContainerDied","Data":"01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7"} Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.168713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.190725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.190763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs88v\" (UniqueName: \"kubernetes.io/projected/caa9c968-8235-4441-b6fa-54a6ab4298ca-kube-api-access-gs88v\") pod \"novacell08ae7-account-delete-g2q5c\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.190891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mr2vr\" (UniqueName: \"kubernetes.io/projected/c81a2490-fdac-4a03-abd8-081f31034cee-kube-api-access-mr2vr\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.190911 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts\") pod \"novacell08ae7-account-delete-g2q5c\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.190957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.191857 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.211368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.216758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr2vr\" (UniqueName: \"kubernetes.io/projected/c81a2490-fdac-4a03-abd8-081f31034cee-kube-api-access-mr2vr\") pod \"dnsmasq-dnsmasq-84b9f45d47-kmfvk\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.222313 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57m77"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.241150 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.247614 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.256082 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-57m77"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.268393 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.268747 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="cinder-scheduler" containerID="cri-o://9fb659f9424787f611011d4bc0d6e4091a6335a401f3e01ecfa4b75494bb0e2b" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.269425 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="probe" containerID="cri-o://2dbf43d77946605400af5b7ce3c06180b86d0d63354eed52a59eaa13bb0e66e2" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.298277 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="rabbitmq" containerID="cri-o://4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e" gracePeriod=604800 Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.341169 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7 is running failed: container process not found" containerID="01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.361446 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7 is running failed: container process not found" containerID="01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.366310 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7 is running failed: container process not found" containerID="01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.366381 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="ovn-northd" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.388371 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124349fc-6922-4ef6-a2bb-b04a55629efb" path="/var/lib/kubelet/pods/124349fc-6922-4ef6-a2bb-b04a55629efb/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.388266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts\") pod \"novacell08ae7-account-delete-g2q5c\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.390531 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fed44fa-821f-4930-81d2-d9f5e292a812" path="/var/lib/kubelet/pods/6fed44fa-821f-4930-81d2-d9f5e292a812/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.391057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs88v\" (UniqueName: \"kubernetes.io/projected/caa9c968-8235-4441-b6fa-54a6ab4298ca-kube-api-access-gs88v\") pod \"novacell08ae7-account-delete-g2q5c\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.394005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts\") pod \"novacell08ae7-account-delete-g2q5c\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.394947 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83fa171d-c407-4bc8-8150-dd88041006e6" path="/var/lib/kubelet/pods/83fa171d-c407-4bc8-8150-dd88041006e6/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.402257 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8be7621d-353e-4591-b93c-3f1c15bae3c9" path="/var/lib/kubelet/pods/8be7621d-353e-4591-b93c-3f1c15bae3c9/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.403094 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9441c299-7fb1-4908-8677-a92d7e39fdf4" path="/var/lib/kubelet/pods/9441c299-7fb1-4908-8677-a92d7e39fdf4/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.403798 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8890bca-a107-49c7-88c8-1c45c80ed6ba" path="/var/lib/kubelet/pods/f8890bca-a107-49c7-88c8-1c45c80ed6ba/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.406567 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffcf5779-da4d-4295-bdcc-2fcf48673978" path="/var/lib/kubelet/pods/ffcf5779-da4d-4295-bdcc-2fcf48673978/volumes" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.409723 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-s9qsw"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.409767 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.410104 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-httpd" containerID="cri-o://81d493830474fa9ad25a97867794fbb2adc31b416d59455b4760c2202e02e4f8" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.410258 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-server" containerID="cri-o://6e0e06803a8effabf9d9a369c8c4ee8c17297b3f91dfe329baf45669eb0960ae" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.426948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs88v\" (UniqueName: \"kubernetes.io/projected/caa9c968-8235-4441-b6fa-54a6ab4298ca-kube-api-access-gs88v\") pod \"novacell08ae7-account-delete-g2q5c\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.429362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.431869 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api-log" containerID="cri-o://a3835e574aef47319958bbf24788c6e911b4521ad675d4bc8be7f837131151c5" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.432210 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api" containerID="cri-o://a9faf385df6ebec07048a10d2179d2bfca7b09aaf9abd65b3fcc9f4653fbfb51" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.456474 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.456769 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener-log" containerID="cri-o://060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.457214 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener" containerID="cri-o://83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.470229 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.470601 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker-log" containerID="cri-o://71368c476f9d7417e6c082f2f0d953cb39823f3b9aea2e54ea0f287e13ba2f74" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.470686 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker" containerID="cri-o://5028db88cf5823f013d2cb8a89fdfe11f284b0ca4af2031dc20a7841ec08433a" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.472014 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6489646f7b-4v47t"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.472505 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api-log" containerID="cri-o://3698bab596c29ca6814770541aae1aac5f1f4a8c2838d5487adb7c0a36048959" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.472742 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api" containerID="cri-o://50e147f7889ceaf7fb95d13ab3783b5e090881e101729579e3050adae56b289f" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.503029 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.503332 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-log" containerID="cri-o://e8e91b1d726c809a8fdb4dd52969969029d6d35c7c52a9c279f3461f97fae829" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.503487 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-api" containerID="cri-o://ee531eaae4596e437913d46d3b12917c98a7852b5af2681a891ae63fe69d63cd" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.537304 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.547661 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.548004 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-log" containerID="cri-o://cc23fc45461ffe3ef999a7fcd41dbe4dd21a5619869db7852079c67badbe6543" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.548469 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-metadata" containerID="cri-o://b4b3f57099e41a56cbff74a84cacda2ce3ff279cdeb430ff8e11bc8f337593ae" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.553352 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-hxspj"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.564745 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-hxspj"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.573941 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.575422 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.587098 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-f8ac-account-create-lwlsj"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.592411 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt"] Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.595761 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gs6zm operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" podUID="0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.597170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.597249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.597767 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_56f4acf6-717c-423f-b338-bc1344ce9d0b/ovn-northd/0.log" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.597866 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.597963 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.598019 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:22.598002897 +0000 UTC m=+1901.298664715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : configmap "openstack-cell1-scripts" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.604374 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:21 crc kubenswrapper[4769]: E1121 12:22:21.604441 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:22.604423909 +0000 UTC m=+1901.305085727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.604467 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.614378 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-nfzxk"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.636527 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.636954 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e47a4c53-835f-4501-9e11-dea59692b355" containerName="nova-cell0-conductor-conductor" containerID="cri-o://6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.641707 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.663590 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-rxkns"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.675831 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.676279 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" containerName="nova-cell1-conductor-conductor" containerID="cri-o://1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.702741 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.703317 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5121d00c-030e-40f1-8e18-f0c07e63f00d" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://25606af767d8ff3ee2e9429779f1c28627f5ceb4c165d7181fcd60475e9ded72" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.728273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.728532 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="02eacc35-6822-431b-9909-90f9d7a0497c" containerName="nova-scheduler-scheduler" containerID="cri-o://3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.737549 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican22df-account-delete-hdprn"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.765261 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementa3a7-account-delete-d4srh"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.802986 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.803487 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="378706f5-ebf7-4c4f-8508-1c704af035c7" containerName="kube-state-metrics" containerID="cri-o://74813f28ad095d48436449dcfac1c96e568e5de9dd3c39716c530f056b3074e1" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.803667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94shv\" (UniqueName: \"kubernetes.io/projected/56f4acf6-717c-423f-b338-bc1344ce9d0b-kube-api-access-94shv\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.803701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-config\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.803859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-combined-ca-bundle\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.803890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-scripts\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.803972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-northd-tls-certs\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.804041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-metrics-certs-tls-certs\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.804097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-rundir\") pod \"56f4acf6-717c-423f-b338-bc1344ce9d0b\" (UID: \"56f4acf6-717c-423f-b338-bc1344ce9d0b\") " Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.805979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.806568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-scripts" (OuterVolumeSpecName: "scripts") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.818071 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-config" (OuterVolumeSpecName: "config") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.826163 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5121d00c-030e-40f1-8e18-f0c07e63f00d" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.24:6080/vnc_lite.html\": dial tcp 10.217.1.24:6080: connect: connection refused" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.867169 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance3a55-account-delete-lpj8v"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.880512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f4acf6-717c-423f-b338-bc1344ce9d0b-kube-api-access-94shv" (OuterVolumeSpecName: "kube-api-access-94shv") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "kube-api-access-94shv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.906563 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutrond005-account-delete-ngwsv"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.907821 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.907839 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.907850 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-94shv\" (UniqueName: \"kubernetes.io/projected/56f4acf6-717c-423f-b338-bc1344ce9d0b-kube-api-access-94shv\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.907860 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/56f4acf6-717c-423f-b338-bc1344ce9d0b-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.911713 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.911986 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-central-agent" containerID="cri-o://4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.912666 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="proxy-httpd" containerID="cri-o://3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.912729 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="sg-core" containerID="cri-o://203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3" gracePeriod=30 Nov 21 12:22:21 crc kubenswrapper[4769]: I1121 12:22:21.912763 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-notification-agent" containerID="cri-o://2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2" gracePeriod=30 Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:21.998691 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-conmon-7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.013443 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerName="galera" containerID="cri-o://26b697829e7267deb81d91feb65ff469a03f946ef4e391778b1456f41ec08739" gracePeriod=30 Nov 21 12:22:22 crc kubenswrapper[4769]: W1121 12:22:22.052245 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod016592c0_e31c_48bf_8636_626daf48ad49.slice/crio-bac4483d30d6cfde6686d2e62ee1b79d94313324acbd0fbab6538be936524872 WatchSource:0}: Error finding container bac4483d30d6cfde6686d2e62ee1b79d94313324acbd0fbab6538be936524872: Status 404 returned error can't find the container with id bac4483d30d6cfde6686d2e62ee1b79d94313324acbd0fbab6538be936524872 Nov 21 12:22:22 crc kubenswrapper[4769]: W1121 12:22:22.068243 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod446d3e05_b6f6_427d_9264_8a6447945da3.slice/crio-244175e13f0de764418903ec732a67c3525e8dc1886f04942e0dd2d21566a073 WatchSource:0}: Error finding container 244175e13f0de764418903ec732a67c3525e8dc1886f04942e0dd2d21566a073: Status 404 returned error can't find the container with id 244175e13f0de764418903ec732a67c3525e8dc1886f04942e0dd2d21566a073 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.073210 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder31d6-account-delete-sdktq"] Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.077201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.119451 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.239471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.242264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" event={"ID":"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4","Type":"ContainerStarted","Data":"b39d78f2fdecab7ed32dbb9217f88dc86f5a3e69beb7874c742eb016464b7aa5"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.249104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "56f4acf6-717c-423f-b338-bc1344ce9d0b" (UID: "56f4acf6-717c-423f-b338-bc1344ce9d0b"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.258710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" event={"ID":"d62c426e-d8cb-4861-8e12-19a15e83948d","Type":"ContainerStarted","Data":"05f14d4b053e06e7f60458b237eea7f260b197e668dd02365e97dce52f97ed35"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.284237 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d/ovsdbserver-sb/0.log" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.284385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d","Type":"ContainerDied","Data":"a3e0872e023f92055257344f7a605d4ead96a5f6dfbe6b9c336b5f395b21e74f"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.284420 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3e0872e023f92055257344f7a605d4ead96a5f6dfbe6b9c336b5f395b21e74f" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.303568 4769 generic.go:334] "Generic (PLEG): container finished" podID="b93ccd0d-4d54-491c-985e-6d149616f695" containerID="3698bab596c29ca6814770541aae1aac5f1f4a8c2838d5487adb7c0a36048959" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.303649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" event={"ID":"b93ccd0d-4d54-491c-985e-6d149616f695","Type":"ContainerDied","Data":"3698bab596c29ca6814770541aae1aac5f1f4a8c2838d5487adb7c0a36048959"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.372984 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef/ovsdbserver-nb/0.log" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.373590 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.378848 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d/ovsdbserver-sb/0.log" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.378997 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.391982 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerID="060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.392224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" event={"ID":"cd70ab0b-1d92-4c16-9be4-261b4773d364","Type":"ContainerDied","Data":"060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.438100 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.438165 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/56f4acf6-717c-423f-b338-bc1344ce9d0b-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.488883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.491589 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerID="81d493830474fa9ad25a97867794fbb2adc31b416d59455b4760c2202e02e4f8" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.491714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" event={"ID":"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a","Type":"ContainerDied","Data":"81d493830474fa9ad25a97867794fbb2adc31b416d59455b4760c2202e02e4f8"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.505973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" event={"ID":"446d3e05-b6f6-427d-9264-8a6447945da3","Type":"ContainerStarted","Data":"244175e13f0de764418903ec732a67c3525e8dc1886f04942e0dd2d21566a073"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-scripts\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fmbr\" (UniqueName: \"kubernetes.io/projected/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-kube-api-access-6fmbr\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdbserver-nb-tls-certs\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-metrics-certs-tls-certs\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdb-rundir\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-config\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-config\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-scripts\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdbserver-sb-tls-certs\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.543971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-metrics-certs-tls-certs\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.544052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdb-rundir\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.544093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-combined-ca-bundle\") pod \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\" (UID: \"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.544124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-combined-ca-bundle\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.544154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncz66\" (UniqueName: \"kubernetes.io/projected/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-kube-api-access-ncz66\") pod \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\" (UID: \"0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.551582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-scripts" (OuterVolumeSpecName: "scripts") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.552042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-config" (OuterVolumeSpecName: "config") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.552359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-scripts" (OuterVolumeSpecName: "scripts") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.552985 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.553837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.557652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-config" (OuterVolumeSpecName: "config") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.561544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-kube-api-access-6fmbr" (OuterVolumeSpecName: "kube-api-access-6fmbr") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "kube-api-access-6fmbr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.569398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582139 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="f4e30e1beb7fd96db86bab3c05804f9e7284e6f16adb6a463b56d3123607973f" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582218 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="d8da63893abbdb88dec1ceb878bd18456a301dce36ff6bcf7fcfe38decb9d82d" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582232 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="5eede93a540279c052a1922a202f61501b5cec8c65a7c89d9b9d2db329d15261" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582243 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="7e98f346bb842a6f0f7f90daa9c76e61f76f39534b58a4f0ca82d3c41ed0261c" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582252 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="5274219d9fb6a2953704b2da6dd99ff55aaacf5afb220cd87b4549fbb1b4d616" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582260 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="c9a62102a031512e453dd37916c42559e1c19f7d2a47f895b95cf9ec268b4cd2" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582269 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="60cf880275322a5210f7546ddc7c4437085cbe3c435c5a4a64604849cd6e31e2" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582278 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="545fd17bf1a594b6b79ab5b3c3c474bce9e4a4cdfb1fb3d71d6e809e2321c568" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582285 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="5ae112626165051404b6c4d21af9ea913b45e0e07640786a82353a9092217ccb" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582298 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="380de022fa6897bb49e2b90851a7d26533d4a8796f267d2ebda1b29f716f0754" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582307 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="f7c98e6ded540db99d1ae274c234ad623eb1d8af56a779214208e374efcc049e" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582314 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="949ac7e464eca74f7851c055b756f3e7f8553e0c1d049cd1fb2b1a918486ac97" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582323 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="1951f2f612d8624661ffb990eb8bdae5620b480f2f298bb3531bb95185fb7460" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582332 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="1b47402cd4ebcb79ce4f4e3319bf1b549c86d5ae0d483da01038614d771b5d7e" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"f4e30e1beb7fd96db86bab3c05804f9e7284e6f16adb6a463b56d3123607973f"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"d8da63893abbdb88dec1ceb878bd18456a301dce36ff6bcf7fcfe38decb9d82d"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"5eede93a540279c052a1922a202f61501b5cec8c65a7c89d9b9d2db329d15261"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"7e98f346bb842a6f0f7f90daa9c76e61f76f39534b58a4f0ca82d3c41ed0261c"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.582575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"5274219d9fb6a2953704b2da6dd99ff55aaacf5afb220cd87b4549fbb1b4d616"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"c9a62102a031512e453dd37916c42559e1c19f7d2a47f895b95cf9ec268b4cd2"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"60cf880275322a5210f7546ddc7c4437085cbe3c435c5a4a64604849cd6e31e2"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"545fd17bf1a594b6b79ab5b3c3c474bce9e4a4cdfb1fb3d71d6e809e2321c568"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"5ae112626165051404b6c4d21af9ea913b45e0e07640786a82353a9092217ccb"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"380de022fa6897bb49e2b90851a7d26533d4a8796f267d2ebda1b29f716f0754"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"f7c98e6ded540db99d1ae274c234ad623eb1d8af56a779214208e374efcc049e"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"949ac7e464eca74f7851c055b756f3e7f8553e0c1d049cd1fb2b1a918486ac97"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"1951f2f612d8624661ffb990eb8bdae5620b480f2f298bb3531bb95185fb7460"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.583453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"1b47402cd4ebcb79ce4f4e3319bf1b549c86d5ae0d483da01038614d771b5d7e"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.584659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-kube-api-access-ncz66" (OuterVolumeSpecName: "kube-api-access-ncz66") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "kube-api-access-ncz66". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.598427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" event={"ID":"21376353-0114-447a-aec5-9d1e773e996f","Type":"ContainerStarted","Data":"c19665ae19bf88a3b205af7e271b1db99fdf6e620b0254f9c511f8fea3d0ce6e"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.600964 4769 generic.go:334] "Generic (PLEG): container finished" podID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerID="6de66ba8fe1756d5210aad3a6ae29943290c8cb763fd345214b2270daf476b95" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.601034 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" event={"ID":"e065f3e6-390d-4bdc-98eb-d2efc6fabecf","Type":"ContainerDied","Data":"6de66ba8fe1756d5210aad3a6ae29943290c8cb763fd345214b2270daf476b95"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.606670 4769 generic.go:334] "Generic (PLEG): container finished" podID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerID="a3835e574aef47319958bbf24788c6e911b4521ad675d4bc8be7f837131151c5" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.606753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"96896fd8-daed-4cfd-93d0-894c2ca63cf8","Type":"ContainerDied","Data":"a3835e574aef47319958bbf24788c6e911b4521ad675d4bc8be7f837131151c5"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.609354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.615253 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e25f734-8e13-4f53-886a-930133a4900e" containerID="58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.615379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" event={"ID":"2e25f734-8e13-4f53-886a-930133a4900e","Type":"ContainerDied","Data":"58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.629407 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef/ovsdbserver-nb/0.log" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.629526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef","Type":"ContainerDied","Data":"f0b13c813b9ee2d12907d719fcbf21c8e52ba850247e0bdaadf481b2f0d674b4"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.629591 4769 scope.go:117] "RemoveContainer" containerID="985476194a6d86cb1958732c9ca35a10e2f6ed8d97ed6a86416672f4c2d3ced2" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.629862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.650253 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config-secret\") pod \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.650471 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk4qm\" (UniqueName: \"kubernetes.io/projected/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-kube-api-access-zk4qm\") pod \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.650571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config\") pod \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.650652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-combined-ca-bundle\") pod \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\" (UID: \"6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37\") " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651292 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651309 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651322 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ncz66\" (UniqueName: \"kubernetes.io/projected/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-kube-api-access-ncz66\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651349 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651362 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651375 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6fmbr\" (UniqueName: \"kubernetes.io/projected/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-kube-api-access-6fmbr\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651385 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651396 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651407 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.651424 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:22.652554 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:22.652650 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:24.652624822 +0000 UTC m=+1903.353286700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : configmap "openstack-cell1-scripts" not found Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:22.659318 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:22.659403 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:24.659380174 +0000 UTC m=+1903.360042042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.660143 4769 generic.go:334] "Generic (PLEG): container finished" podID="d201fa7e-e3af-41a6-909e-2746298322c6" containerID="b973ee449f9bf72036cb4a436ce753b74ac421ac2bfbdb5827c31daefe182113" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.660231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d201fa7e-e3af-41a6-909e-2746298322c6","Type":"ContainerDied","Data":"b973ee449f9bf72036cb4a436ce753b74ac421ac2bfbdb5827c31daefe182113"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.663488 4769 generic.go:334] "Generic (PLEG): container finished" podID="6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" containerID="baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133" exitCode=137 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.663605 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.669817 4769 generic.go:334] "Generic (PLEG): container finished" podID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerID="71368c476f9d7417e6c082f2f0d953cb39823f3b9aea2e54ea0f287e13ba2f74" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.669951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" event={"ID":"1905ef09-f68a-4eaa-bdc4-19aa620bc07b","Type":"ContainerDied","Data":"71368c476f9d7417e6c082f2f0d953cb39823f3b9aea2e54ea0f287e13ba2f74"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.680018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.681886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-kube-api-access-zk4qm" (OuterVolumeSpecName: "kube-api-access-zk4qm") pod "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" (UID: "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37"). InnerVolumeSpecName "kube-api-access-zk4qm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.703985 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.206:5671: connect: connection refused" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.708865 4769 generic.go:334] "Generic (PLEG): container finished" podID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerID="e8e91b1d726c809a8fdb4dd52969969029d6d35c7c52a9c279f3461f97fae829" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.708967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a","Type":"ContainerDied","Data":"e8e91b1d726c809a8fdb4dd52969969029d6d35c7c52a9c279f3461f97fae829"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.723297 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_56f4acf6-717c-423f-b338-bc1344ce9d0b/ovn-northd/0.log" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.723419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"56f4acf6-717c-423f-b338-bc1344ce9d0b","Type":"ContainerDied","Data":"44dc7d584bc8ffe52550816d123b732ce111bfc88467c8d59400e8f972952ae0"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.723547 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.739565 4769 generic.go:334] "Generic (PLEG): container finished" podID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerID="af1cd2d919c7575b7e57f4eda560fb0bf162892f90ce7176b43cfc178cc35b9b" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.739643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b","Type":"ContainerDied","Data":"af1cd2d919c7575b7e57f4eda560fb0bf162892f90ce7176b43cfc178cc35b9b"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.746262 4769 generic.go:334] "Generic (PLEG): container finished" podID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerID="3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247" exitCode=0 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.746311 4769 generic.go:334] "Generic (PLEG): container finished" podID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerID="203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3" exitCode=2 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.746381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerDied","Data":"3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.746408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerDied","Data":"203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.753922 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zk4qm\" (UniqueName: \"kubernetes.io/projected/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-kube-api-access-zk4qm\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.753951 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:22.754015 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:22 crc kubenswrapper[4769]: E1121 12:22:22.754064 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data podName:ad94928f-bd00-4e2a-a9a3-8d8a1419bfec nodeName:}" failed. No retries permitted until 2025-11-21 12:22:26.754048653 +0000 UTC m=+1905.454710471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data") pod "rabbitmq-cell1-server-0" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.755143 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerID="cc23fc45461ffe3ef999a7fcd41dbe4dd21a5619869db7852079c67badbe6543" exitCode=143 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.755249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c849e8b-0572-485c-a8cc-3436a605a5d4","Type":"ContainerDied","Data":"cc23fc45461ffe3ef999a7fcd41dbe4dd21a5619869db7852079c67badbe6543"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.769484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" event={"ID":"016592c0-e31c-48bf-8636-626daf48ad49","Type":"ContainerStarted","Data":"bac4483d30d6cfde6686d2e62ee1b79d94313324acbd0fbab6538be936524872"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.789364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi0895-account-delete-4v9rc"] Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.794091 4769 generic.go:334] "Generic (PLEG): container finished" podID="378706f5-ebf7-4c4f-8508-1c704af035c7" containerID="74813f28ad095d48436449dcfac1c96e568e5de9dd3c39716c530f056b3074e1" exitCode=2 Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.795382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"378706f5-ebf7-4c4f-8508-1c704af035c7","Type":"ContainerDied","Data":"74813f28ad095d48436449dcfac1c96e568e5de9dd3c39716c530f056b3074e1"} Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.795504 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:22 crc kubenswrapper[4769]: I1121 12:22:22.803534 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk"] Nov 21 12:22:22 crc kubenswrapper[4769]: W1121 12:22:22.845791 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc81a2490_fdac_4a03_abd8_081f31034cee.slice/crio-6a1e7e9098daeddacf0f378f01fe250f8f7db2028946315a6c703e92b6ba4f65 WatchSource:0}: Error finding container 6a1e7e9098daeddacf0f378f01fe250f8f7db2028946315a6c703e92b6ba4f65: Status 404 returned error can't find the container with id 6a1e7e9098daeddacf0f378f01fe250f8f7db2028946315a6c703e92b6ba4f65 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.099836 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c"] Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.102135 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:22:23 crc kubenswrapper[4769]: W1121 12:22:23.113292 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaa9c968_8235_4441_b6fa_54a6ab4298ca.slice/crio-d90c64c8e87a595c39219009275261687e321d237062d1b750443dddd661b463 WatchSource:0}: Error finding container d90c64c8e87a595c39219009275261687e321d237062d1b750443dddd661b463: Status 404 returned error can't find the container with id d90c64c8e87a595c39219009275261687e321d237062d1b750443dddd661b463 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.127027 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.153302 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.207:5671: connect: connection refused" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.186997 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.187046 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187150 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187248 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data podName:9b970d3d-1a5c-40da-90ff-ddcc991a571d nodeName:}" failed. No retries permitted until 2025-11-21 12:22:27.187224565 +0000 UTC m=+1905.887886383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data") pod "rabbitmq-server-0" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d") : configmap "rabbitmq-config-data" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187347 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-storage-config-data: configmap "swift-storage-config-data" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187368 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187377 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187391 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187419 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:27.18741147 +0000 UTC m=+1905.888073288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187538 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187770 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187803 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:27.187606115 +0000 UTC m=+1905.888267923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "barbican-config-data" not found Nov 21 12:22:23 crc kubenswrapper[4769]: E1121 12:22:23.187967 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:27.187948424 +0000 UTC m=+1905.888610242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "combined-ca-bundle" not found Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.202061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" (UID: "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.221237 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" (UID: "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.235606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.288955 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.288996 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.289020 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.290115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" (UID: "6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.322787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.350714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" (UID: "7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.350857 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6120e168-ec6a-4f80-a3f2-da7f79c9a499" path="/var/lib/kubelet/pods/6120e168-ec6a-4f80-a3f2-da7f79c9a499/volumes" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.351644 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37" path="/var/lib/kubelet/pods/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37/volumes" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.352124 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="973b15fa-1930-453a-8883-2f6055881104" path="/var/lib/kubelet/pods/973b15fa-1930-453a-8883-2f6055881104/volumes" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.352626 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab7093b8-e012-4655-ba79-137326ea7bfa" path="/var/lib/kubelet/pods/ab7093b8-e012-4655-ba79-137326ea7bfa/volumes" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.376760 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df538c98-029e-4335-a317-1f089ec4147c" path="/var/lib/kubelet/pods/df538c98-029e-4335-a317-1f089ec4147c/volumes" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.377322 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e37e9c-26c8-4f10-a2f1-7fc41442f45a" path="/var/lib/kubelet/pods/f5e37e9c-26c8-4f10-a2f1-7fc41442f45a/volumes" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.390471 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.390506 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.390517 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fd13a83-7fcd-4e8e-82b3-abb4ebc27b37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.392009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.404503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" (UID: "0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.504477 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.504497 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.812721 4769 generic.go:334] "Generic (PLEG): container finished" podID="5121d00c-030e-40f1-8e18-f0c07e63f00d" containerID="25606af767d8ff3ee2e9429779f1c28627f5ceb4c165d7181fcd60475e9ded72" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.815590 4769 generic.go:334] "Generic (PLEG): container finished" podID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerID="2dbf43d77946605400af5b7ce3c06180b86d0d63354eed52a59eaa13bb0e66e2" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.815628 4769 generic.go:334] "Generic (PLEG): container finished" podID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerID="9fb659f9424787f611011d4bc0d6e4091a6335a401f3e01ecfa4b75494bb0e2b" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.819648 4769 generic.go:334] "Generic (PLEG): container finished" podID="0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" containerID="b0179972d2df25816ac563291099fcffaadc08920dfaf1f142f0cbe4409ee239" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.823141 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerID="26b697829e7267deb81d91feb65ff469a03f946ef4e391778b1456f41ec08739" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.826975 4769 generic.go:334] "Generic (PLEG): container finished" podID="d62c426e-d8cb-4861-8e12-19a15e83948d" containerID="b24b988b44b3140a6df38c976e6c18718b218e0f0a974b4ea57665902bb9b249" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.830894 4769 generic.go:334] "Generic (PLEG): container finished" podID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerID="5028db88cf5823f013d2cb8a89fdfe11f284b0ca4af2031dc20a7841ec08433a" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.841787 4769 generic.go:334] "Generic (PLEG): container finished" podID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerID="4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.843981 4769 generic.go:334] "Generic (PLEG): container finished" podID="016592c0-e31c-48bf-8636-626daf48ad49" containerID="98fc836e3d9969aa7dba5853f300dcd1c0d2517a66f37bb14f4a6bdb4e4ba332" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.862873 4769 generic.go:334] "Generic (PLEG): container finished" podID="21376353-0114-447a-aec5-9d1e773e996f" containerID="394eed05b63ae4cac6f397f5df014c49a16264940a9061d5ea8d900106136d6c" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.874205 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerID="6e0e06803a8effabf9d9a369c8c4ee8c17297b3f91dfe329baf45669eb0960ae" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.877850 4769 generic.go:334] "Generic (PLEG): container finished" podID="446d3e05-b6f6-427d-9264-8a6447945da3" containerID="24f40a9e4aa639de640ef87a2705698d67f6d608296903b52dbc60067571cd50" exitCode=0 Nov 21 12:22:23 crc kubenswrapper[4769]: I1121 12:22:23.878108 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"378706f5-ebf7-4c4f-8508-1c704af035c7","Type":"ContainerDied","Data":"b424e09599b6c6fb042ebecaf930a0345c15cc4e1dfc50f2d0acdbf7c28d40fb"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036756 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b424e09599b6c6fb042ebecaf930a0345c15cc4e1dfc50f2d0acdbf7c28d40fb" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" event={"ID":"23a3ecd4-5133-4225-ac3b-a5914cacc71b","Type":"ContainerStarted","Data":"030cbd85f25edf0e284cfbdada1912b55b08f50364b71eb643c896e01d398781"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5121d00c-030e-40f1-8e18-f0c07e63f00d","Type":"ContainerDied","Data":"25606af767d8ff3ee2e9429779f1c28627f5ceb4c165d7181fcd60475e9ded72"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5121d00c-030e-40f1-8e18-f0c07e63f00d","Type":"ContainerDied","Data":"89baf302b0faecf297f6acddc63b457db8a5d1ddaf308d89f1c15f8cb5befbcb"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036835 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89baf302b0faecf297f6acddc63b457db8a5d1ddaf308d89f1c15f8cb5befbcb" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8afd06f7-779e-4ef5-a411-a00c1a15d5c3","Type":"ContainerDied","Data":"2dbf43d77946605400af5b7ce3c06180b86d0d63354eed52a59eaa13bb0e66e2"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8afd06f7-779e-4ef5-a411-a00c1a15d5c3","Type":"ContainerDied","Data":"9fb659f9424787f611011d4bc0d6e4091a6335a401f3e01ecfa4b75494bb0e2b"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8afd06f7-779e-4ef5-a411-a00c1a15d5c3","Type":"ContainerDied","Data":"8d98bb6349a379170d9e7f4f724bde1fac07966912412d04eafd78b198df2d6f"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036924 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d98bb6349a379170d9e7f4f724bde1fac07966912412d04eafd78b198df2d6f" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" event={"ID":"caa9c968-8235-4441-b6fa-54a6ab4298ca","Type":"ContainerStarted","Data":"d90c64c8e87a595c39219009275261687e321d237062d1b750443dddd661b463"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036957 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" event={"ID":"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4","Type":"ContainerDied","Data":"b0179972d2df25816ac563291099fcffaadc08920dfaf1f142f0cbe4409ee239"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e84ae61-76e9-4820-a40f-9dc2ca2aad50","Type":"ContainerDied","Data":"26b697829e7267deb81d91feb65ff469a03f946ef4e391778b1456f41ec08739"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.036997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e84ae61-76e9-4820-a40f-9dc2ca2aad50","Type":"ContainerDied","Data":"0e0528c96db37bc7915bd89a1c41b23acd69e0982b0193c338c799d939a4db28"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037009 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e0528c96db37bc7915bd89a1c41b23acd69e0982b0193c338c799d939a4db28" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" event={"ID":"d62c426e-d8cb-4861-8e12-19a15e83948d","Type":"ContainerDied","Data":"b24b988b44b3140a6df38c976e6c18718b218e0f0a974b4ea57665902bb9b249"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" event={"ID":"1905ef09-f68a-4eaa-bdc4-19aa620bc07b","Type":"ContainerDied","Data":"5028db88cf5823f013d2cb8a89fdfe11f284b0ca4af2031dc20a7841ec08433a"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037069 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" event={"ID":"1905ef09-f68a-4eaa-bdc4-19aa620bc07b","Type":"ContainerDied","Data":"dd440a104cd6a9793ab953723521efd48df139bc6e4fdc6e052e06456c79dc24"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037083 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd440a104cd6a9793ab953723521efd48df139bc6e4fdc6e052e06456c79dc24" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerDied","Data":"4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" event={"ID":"016592c0-e31c-48bf-8636-626daf48ad49","Type":"ContainerDied","Data":"98fc836e3d9969aa7dba5853f300dcd1c0d2517a66f37bb14f4a6bdb4e4ba332"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" event={"ID":"c81a2490-fdac-4a03-abd8-081f31034cee","Type":"ContainerStarted","Data":"6a1e7e9098daeddacf0f378f01fe250f8f7db2028946315a6c703e92b6ba4f65"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" event={"ID":"21376353-0114-447a-aec5-9d1e773e996f","Type":"ContainerDied","Data":"394eed05b63ae4cac6f397f5df014c49a16264940a9061d5ea8d900106136d6c"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" event={"ID":"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a","Type":"ContainerDied","Data":"6e0e06803a8effabf9d9a369c8c4ee8c17297b3f91dfe329baf45669eb0960ae"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037220 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" event={"ID":"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a","Type":"ContainerDied","Data":"9011f110b487dc5975c4a5f3fcdb332ea253d47088e276eccb368f1ed988e685"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037237 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9011f110b487dc5975c4a5f3fcdb332ea253d47088e276eccb368f1ed988e685" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.037251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" event={"ID":"446d3e05-b6f6-427d-9264-8a6447945da3","Type":"ContainerDied","Data":"24f40a9e4aa639de640ef87a2705698d67f6d608296903b52dbc60067571cd50"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.042767 4769 scope.go:117] "RemoveContainer" containerID="40e1928f40a6d608c2954cb2916b1fb1aba9c7b4b7c6ef9bc35ff7e8867e7c2f" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.059085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.078829 4769 scope.go:117] "RemoveContainer" containerID="baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.097844 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.108962 4769 scope.go:117] "RemoveContainer" containerID="bea7449439fa2707fcfabebf5dac9988755c52ccbd6ef1df8584efcdfa95c811" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.178286 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.190108 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.190326 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.191254 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.204409 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.207815 4769 scope.go:117] "RemoveContainer" containerID="01a8866bb336fc6a20c60bba72fdb840f97c46cf4dc4d0ead87357cc889db3f7" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.213794 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.225166 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.225490 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="d898c08a-4c85-42c8-86f7-43e5fab04611" containerName="memcached" containerID="cri-o://dea46b3b14bbd1e5122a520588b3b7295eb7903651356a0165e54bcd7dc9275d" gracePeriod=30 Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.226314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-config\") pod \"378706f5-ebf7-4c4f-8508-1c704af035c7\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.227007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6rld\" (UniqueName: \"kubernetes.io/projected/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-api-access-d6rld\") pod \"378706f5-ebf7-4c4f-8508-1c704af035c7\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.227104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-combined-ca-bundle\") pod \"378706f5-ebf7-4c4f-8508-1c704af035c7\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.227137 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-certs\") pod \"378706f5-ebf7-4c4f-8508-1c704af035c7\" (UID: \"378706f5-ebf7-4c4f-8508-1c704af035c7\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.256246 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-api-access-d6rld" (OuterVolumeSpecName: "kube-api-access-d6rld") pod "378706f5-ebf7-4c4f-8508-1c704af035c7" (UID: "378706f5-ebf7-4c4f-8508-1c704af035c7"). InnerVolumeSpecName "kube-api-access-d6rld". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.264502 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.288911 4769 scope.go:117] "RemoveContainer" containerID="baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.289820 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.301419 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133\": container with ID starting with baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133 not found: ID does not exist" containerID="baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.301480 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133"} err="failed to get container status \"baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133\": rpc error: code = NotFound desc = could not find container \"baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133\": container with ID starting with baaaf88d375d1f385e562eea6eba1bb458023149209eca52d7b71708bf935133 not found: ID does not exist" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.301529 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.310266 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-logs\") pod \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-generated\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-combined-ca-bundle\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-combined-ca-bundle\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-config-data\") pod \"5121d00c-030e-40f1-8e18-f0c07e63f00d\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338206 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-default\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338372 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-vencrypt-tls-certs\") pod \"5121d00c-030e-40f1-8e18-f0c07e63f00d\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-etc-swift\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-log-httpd\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338473 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-operator-scripts\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-public-tls-certs\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-run-httpd\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvhwg\" (UniqueName: \"kubernetes.io/projected/5121d00c-030e-40f1-8e18-f0c07e63f00d-kube-api-access-cvhwg\") pod \"5121d00c-030e-40f1-8e18-f0c07e63f00d\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-combined-ca-bundle\") pod \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-combined-ca-bundle\") pod \"5121d00c-030e-40f1-8e18-f0c07e63f00d\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpm89\" (UniqueName: \"kubernetes.io/projected/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kube-api-access-zpm89\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data\") pod \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-internal-tls-certs\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5klx\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-kube-api-access-c5klx\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-galera-tls-certs\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338805 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdxd4\" (UniqueName: \"kubernetes.io/projected/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-kube-api-access-xdxd4\") pod \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.338820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data-custom\") pod \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\" (UID: \"1905ef09-f68a-4eaa-bdc4-19aa620bc07b\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.339299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.339628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-logs" (OuterVolumeSpecName: "logs") pod "1905ef09-f68a-4eaa-bdc4-19aa620bc07b" (UID: "1905ef09-f68a-4eaa-bdc4-19aa620bc07b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.339898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.351299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.353667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kolla-config\") pod \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\" (UID: \"2e84ae61-76e9-4820-a40f-9dc2ca2aad50\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.353758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-config-data\") pod \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\" (UID: \"7b9329ea-65e5-4fff-978b-4cf7d1d1f68a\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.353801 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-nova-novncproxy-tls-certs\") pod \"5121d00c-030e-40f1-8e18-f0c07e63f00d\" (UID: \"5121d00c-030e-40f1-8e18-f0c07e63f00d\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.356792 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.356825 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.356837 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.356848 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.356860 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d6rld\" (UniqueName: \"kubernetes.io/projected/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-api-access-d6rld\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.356963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.365118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.365819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.368803 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.407078 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-xgqqh"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.433679 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-xgqqh"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.443774 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1905ef09-f68a-4eaa-bdc4-19aa620bc07b" (UID: "1905ef09-f68a-4eaa-bdc4-19aa620bc07b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.448863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-kube-api-access-xdxd4" (OuterVolumeSpecName: "kube-api-access-xdxd4") pod "1905ef09-f68a-4eaa-bdc4-19aa620bc07b" (UID: "1905ef09-f68a-4eaa-bdc4-19aa620bc07b"). InnerVolumeSpecName "kube-api-access-xdxd4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.457554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data-custom\") pod \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.457713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-scripts\") pod \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.457826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b95rg\" (UniqueName: \"kubernetes.io/projected/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-kube-api-access-b95rg\") pod \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.457899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data\") pod \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.457931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-etc-machine-id\") pod \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.457985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-combined-ca-bundle\") pod \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\" (UID: \"8afd06f7-779e-4ef5-a411-a00c1a15d5c3\") " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.465474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8afd06f7-779e-4ef5-a411-a00c1a15d5c3" (UID: "8afd06f7-779e-4ef5-a411-a00c1a15d5c3"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.471464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.472440 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.484394 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.485159 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.485269 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.485339 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.485444 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xdxd4\" (UniqueName: \"kubernetes.io/projected/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-kube-api-access-xdxd4\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.485515 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.488837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5121d00c-030e-40f1-8e18-f0c07e63f00d-kube-api-access-cvhwg" (OuterVolumeSpecName: "kube-api-access-cvhwg") pod "5121d00c-030e-40f1-8e18-f0c07e63f00d" (UID: "5121d00c-030e-40f1-8e18-f0c07e63f00d"). InnerVolumeSpecName "kube-api-access-cvhwg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.493602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kube-api-access-zpm89" (OuterVolumeSpecName: "kube-api-access-zpm89") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "kube-api-access-zpm89". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.498281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-vb44x"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.505150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-kube-api-access-c5klx" (OuterVolumeSpecName: "kube-api-access-c5klx") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "kube-api-access-c5klx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.509035 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-vb44x"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.510787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8afd06f7-779e-4ef5-a411-a00c1a15d5c3" (UID: "8afd06f7-779e-4ef5-a411-a00c1a15d5c3"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.511602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-kube-api-access-b95rg" (OuterVolumeSpecName: "kube-api-access-b95rg") pod "8afd06f7-779e-4ef5-a411-a00c1a15d5c3" (UID: "8afd06f7-779e-4ef5-a411-a00c1a15d5c3"). InnerVolumeSpecName "kube-api-access-b95rg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.516169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "mysql-db") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.536793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-scripts" (OuterVolumeSpecName: "scripts") pod "8afd06f7-779e-4ef5-a411-a00c1a15d5c3" (UID: "8afd06f7-779e-4ef5-a411-a00c1a15d5c3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.536297 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.537344 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" podUID="b9561d60-3f1b-4a40-b24f-b4dad34f7117" containerName="keystone-api" containerID="cri-o://832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a" gracePeriod=30 Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.569681 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587198 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587256 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587270 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587284 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cvhwg\" (UniqueName: \"kubernetes.io/projected/5121d00c-030e-40f1-8e18-f0c07e63f00d-kube-api-access-cvhwg\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587300 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zpm89\" (UniqueName: \"kubernetes.io/projected/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-kube-api-access-zpm89\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587313 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b95rg\" (UniqueName: \"kubernetes.io/projected/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-kube-api-access-b95rg\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.587325 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c5klx\" (UniqueName: \"kubernetes.io/projected/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-kube-api-access-c5klx\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.634926 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wdgk9"] Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.673982 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.681750 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-wdgk9"] Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.685371 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.690516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.690575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.691475 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.691577 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:28.691547256 +0000 UTC m=+1907.392209154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : configmap "openstack-cell1-scripts" not found Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.695491 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.695569 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.695645 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:28.695622965 +0000 UTC m=+1907.396284783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:24 crc kubenswrapper[4769]: E1121 12:22:24.695565 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" containerName="nova-cell1-conductor-conductor" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.712365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "378706f5-ebf7-4c4f-8508-1c704af035c7" (UID: "378706f5-ebf7-4c4f-8508-1c704af035c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.733009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "378706f5-ebf7-4c4f-8508-1c704af035c7" (UID: "378706f5-ebf7-4c4f-8508-1c704af035c7"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.742125 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.745786 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-a3a7-account-create-lln6n"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.760228 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-a3a7-account-create-lln6n"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.788801 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementa3a7-account-delete-d4srh"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.799172 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.805405 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.805432 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.807397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5121d00c-030e-40f1-8e18-f0c07e63f00d" (UID: "5121d00c-030e-40f1-8e18-f0c07e63f00d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.839489 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-wmgsx"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.844882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-config-data" (OuterVolumeSpecName: "config-data") pod "5121d00c-030e-40f1-8e18-f0c07e63f00d" (UID: "5121d00c-030e-40f1-8e18-f0c07e63f00d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.867050 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-wmgsx"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.878479 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-8fc8-account-create-mnx95"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.893716 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-8fc8-account-create-mnx95"] Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.906799 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.32:8775/\": read tcp 10.217.0.2:42732->10.217.1.32:8775: read: connection reset by peer" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.907269 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.32:8775/\": read tcp 10.217.0.2:42736->10.217.1.32:8775: read: connection reset by peer" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.908318 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.908353 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.946382 4769 generic.go:334] "Generic (PLEG): container finished" podID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerID="dd0e43d5b60bac8f8a93051855b26f738ec15e9e35b816fa885086c681956cd3" exitCode=0 Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.946469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b","Type":"ContainerDied","Data":"dd0e43d5b60bac8f8a93051855b26f738ec15e9e35b816fa885086c681956cd3"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.963815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.973418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" event={"ID":"23a3ecd4-5133-4225-ac3b-a5914cacc71b","Type":"ContainerStarted","Data":"4492d3ff34f99cdbaa9ca423b4c8781cec9ea9218d5adfd7e8669c7d8c78331a"} Nov 21 12:22:24 crc kubenswrapper[4769]: I1121 12:22:24.974610 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" secret="" err="secret \"galera-openstack-dockercfg-wvnqs\" not found" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.050583 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.068082 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-p84sx"] Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.069582 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.073120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.078351 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-p84sx"] Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.091591 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.091759 4769 generic.go:334] "Generic (PLEG): container finished" podID="d201fa7e-e3af-41a6-909e-2746298322c6" containerID="8f6ad774a8254888f3e2cdcdc28df21e19a43d07485d96c1026e8cf36d2a802b" exitCode=0 Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.091802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d201fa7e-e3af-41a6-909e-2746298322c6","Type":"ContainerDied","Data":"8f6ad774a8254888f3e2cdcdc28df21e19a43d07485d96c1026e8cf36d2a802b"} Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.091883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1905ef09-f68a-4eaa-bdc4-19aa620bc07b" (UID: "1905ef09-f68a-4eaa-bdc4-19aa620bc07b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.097052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "378706f5-ebf7-4c4f-8508-1c704af035c7" (UID: "378706f5-ebf7-4c4f-8508-1c704af035c7"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.099984 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-22df-account-create-zzvvh"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.103740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data" (OuterVolumeSpecName: "config-data") pod "1905ef09-f68a-4eaa-bdc4-19aa620bc07b" (UID: "1905ef09-f68a-4eaa-bdc4-19aa620bc07b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.102662 4769 generic.go:334] "Generic (PLEG): container finished" podID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerID="c294f4926913ea9a60162f42ad399069486233b7eff0d59b236f4c3cc4f1abe5" exitCode=0 Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.104481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" event={"ID":"e065f3e6-390d-4bdc-98eb-d2efc6fabecf","Type":"ContainerDied","Data":"c294f4926913ea9a60162f42ad399069486233b7eff0d59b236f4c3cc4f1abe5"} Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.104808 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.104861 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="02eacc35-6822-431b-9909-90f9d7a0497c" containerName="nova-scheduler-scheduler" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.112028 4769 generic.go:334] "Generic (PLEG): container finished" podID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerID="a9faf385df6ebec07048a10d2179d2bfca7b09aaf9abd65b3fcc9f4653fbfb51" exitCode=0 Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.112118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"96896fd8-daed-4cfd-93d0-894c2ca63cf8","Type":"ContainerDied","Data":"a9faf385df6ebec07048a10d2179d2bfca7b09aaf9abd65b3fcc9f4653fbfb51"} Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.139039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" event={"ID":"caa9c968-8235-4441-b6fa-54a6ab4298ca","Type":"ContainerStarted","Data":"e9d461f06f79acc19dadb1308feb91194931d0c687f46ce1d5c230baecc8bdf0"} Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.139814 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" secret="" err="secret \"galera-openstack-dockercfg-wvnqs\" not found" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.147605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "5121d00c-030e-40f1-8e18-f0c07e63f00d" (UID: "5121d00c-030e-40f1-8e18-f0c07e63f00d"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.156149 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.156171 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.156199 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1905ef09-f68a-4eaa-bdc4-19aa620bc07b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.156208 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.156218 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/378706f5-ebf7-4c4f-8508-1c704af035c7-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.156337 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.156438 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:25.656413048 +0000 UTC m=+1904.357074936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.169700 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.176390 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.176544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" event={"ID":"c81a2490-fdac-4a03-abd8-081f31034cee","Type":"ContainerStarted","Data":"c38ecbe20dbb6e7844107011aaf892c606a0f887d18c974d40faabcdbdc9d2ad"} Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.176668 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.176762 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.177021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.177071 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.177110 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.185630 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican22df-account-delete-hdprn"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.203485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-config-data" (OuterVolumeSpecName: "config-data") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.206771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.232173 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-22df-account-create-zzvvh"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.236417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "5121d00c-030e-40f1-8e18-f0c07e63f00d" (UID: "5121d00c-030e-40f1-8e18-f0c07e63f00d"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.239277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8afd06f7-779e-4ef5-a411-a00c1a15d5c3" (UID: "8afd06f7-779e-4ef5-a411-a00c1a15d5c3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.241629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" (UID: "7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.257522 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.257576 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.257589 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5121d00c-030e-40f1-8e18-f0c07e63f00d-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.257599 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.257608 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.257674 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.257727 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:22:25.757711596 +0000 UTC m=+1904.458373404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.260854 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rczht"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.261748 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "2e84ae61-76e9-4820-a40f-9dc2ca2aad50" (UID: "2e84ae61-76e9-4820-a40f-9dc2ca2aad50"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.272799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data" (OuterVolumeSpecName: "config-data") pod "8afd06f7-779e-4ef5-a411-a00c1a15d5c3" (UID: "8afd06f7-779e-4ef5-a411-a00c1a15d5c3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.290079 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerName="galera" containerID="cri-o://99df80460a2097a210975c9c3f81c06ddafc94375c50ae068765c59ce67ccff6" gracePeriod=30 Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.292849 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068d3e6a-e00a-46d5-93b6-d353f6479048" path="/var/lib/kubelet/pods/068d3e6a-e00a-46d5-93b6-d353f6479048/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.293445 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0900f2e3-2223-4092-862e-01c92be296d9" path="/var/lib/kubelet/pods/0900f2e3-2223-4092-862e-01c92be296d9/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.293975 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="091f9579-b673-4163-bead-5d48a37f37b0" path="/var/lib/kubelet/pods/091f9579-b673-4163-bead-5d48a37f37b0/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.294628 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.295373 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b89132a-9f62-46dd-ab6d-27d315168730" path="/var/lib/kubelet/pods/0b89132a-9f62-46dd-ab6d-27d315168730/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.296290 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" path="/var/lib/kubelet/pods/0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.296897 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10ada652-8736-4844-b135-2153e692c23e" path="/var/lib/kubelet/pods/10ada652-8736-4844-b135-2153e692c23e/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.300787 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" path="/var/lib/kubelet/pods/56f4acf6-717c-423f-b338-bc1344ce9d0b/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.302352 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.254:9311/healthcheck\": dial tcp 10.217.0.254:9311: connect: connection refused" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.302349 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.254:9311/healthcheck\": dial tcp 10.217.0.254:9311: connect: connection refused" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.305461 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" path="/var/lib/kubelet/pods/7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.305463 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.309127 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8363122f-b7e7-4872-b1c6-5043306562aa" path="/var/lib/kubelet/pods/8363122f-b7e7-4872-b1c6-5043306562aa/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.310454 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2" path="/var/lib/kubelet/pods/9eed9de3-d5b6-4ab3-b75f-d9cf5e33a4c2/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.310654 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.310719 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e47a4c53-835f-4501-9e11-dea59692b355" containerName="nova-cell0-conductor-conductor" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.314836 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed59396d-c7fc-4cc1-9092-3aa037cf0a70" path="/var/lib/kubelet/pods/ed59396d-c7fc-4cc1-9092-3aa037cf0a70/volumes" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.320633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rczht"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.337549 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance3a55-account-delete-lpj8v"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.353838 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3a55-account-create-6pp4w"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.359672 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e84ae61-76e9-4820-a40f-9dc2ca2aad50-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.359733 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8afd06f7-779e-4ef5-a411-a00c1a15d5c3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.381607 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-3a55-account-create-6pp4w"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.396972 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-8kvkx"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.408734 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-8kvkx"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.420462 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" podStartSLOduration=5.420439672 podStartE2EDuration="5.420439672s" podCreationTimestamp="2025-11-21 12:22:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:22:24.997278018 +0000 UTC m=+1903.697939836" watchObservedRunningTime="2025-11-21 12:22:25.420439672 +0000 UTC m=+1904.121101490" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.463887 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-d005-account-create-v8rbt"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.485245 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-d005-account-create-v8rbt"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.505913 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutrond005-account-delete-ngwsv"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.528751 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5rvgd"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.558453 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5rvgd"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.574784 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.591628 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-31d6-account-create-flkgq"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.615278 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder31d6-account-delete-sdktq"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.623343 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" podStartSLOduration=5.623312285 podStartE2EDuration="5.623312285s" podCreationTimestamp="2025-11-21 12:22:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:22:25.164542496 +0000 UTC m=+1903.865204314" watchObservedRunningTime="2025-11-21 12:22:25.623312285 +0000 UTC m=+1904.323974103" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.635676 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-31d6-account-create-flkgq"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.648645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7wxht"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.657359 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7wxht"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.666211 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi0895-account-delete-4v9rc"] Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.670459 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.670525 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:26.670504521 +0000 UTC m=+1905.371166339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.675253 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0895-account-create-hrqp5"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.681921 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.682536 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0895-account-create-hrqp5"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.730472 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.740075 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2pqkg"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.761633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2pqkg"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.780510 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-logs\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.780741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-public-tls-certs\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.781016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-combined-ca-bundle\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.781171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-config-data\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.781328 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kqgf\" (UniqueName: \"kubernetes.io/projected/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-kube-api-access-7kqgf\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.781440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-scripts\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.781557 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-internal-tls-certs\") pod \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\" (UID: \"e065f3e6-390d-4bdc-98eb-d2efc6fabecf\") " Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.782745 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: E1121 12:22:25.782896 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:22:26.782871316 +0000 UTC m=+1905.483533134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.792483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-logs" (OuterVolumeSpecName: "logs") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.854405 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.873606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-scripts" (OuterVolumeSpecName: "scripts") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.876137 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.882466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-kube-api-access-7kqgf" (OuterVolumeSpecName: "kube-api-access-7kqgf") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "kube-api-access-7kqgf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.883614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-scripts\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-httpd-run\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-scripts\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-config-data\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlvsk\" (UniqueName: \"kubernetes.io/projected/d201fa7e-e3af-41a6-909e-2746298322c6-kube-api-access-jlvsk\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-httpd-run\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-config-data\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-public-tls-certs\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-logs\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-combined-ca-bundle\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-internal-tls-certs\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-logs\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-combined-ca-bundle\") pod \"d201fa7e-e3af-41a6-909e-2746298322c6\" (UID: \"d201fa7e-e3af-41a6-909e-2746298322c6\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vswfv\" (UniqueName: \"kubernetes.io/projected/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-kube-api-access-vswfv\") pod \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\" (UID: \"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b\") " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.885895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-logs" (OuterVolumeSpecName: "logs") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886562 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8ae7-account-create-htxf4"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886638 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886658 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886671 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886683 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7kqgf\" (UniqueName: \"kubernetes.io/projected/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-kube-api-access-7kqgf\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886697 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d201fa7e-e3af-41a6-909e-2746298322c6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.886710 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.890689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-logs" (OuterVolumeSpecName: "logs") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.907729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-scripts" (OuterVolumeSpecName: "scripts") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.908568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d201fa7e-e3af-41a6-909e-2746298322c6-kube-api-access-jlvsk" (OuterVolumeSpecName: "kube-api-access-jlvsk") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "kube-api-access-jlvsk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.909427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-scripts" (OuterVolumeSpecName: "scripts") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.911099 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.914137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "glance") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.931294 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.933910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-kube-api-access-vswfv" (OuterVolumeSpecName: "kube-api-access-vswfv") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "kube-api-access-vswfv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.940854 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.947949 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.955352 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.965767 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.971297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-598f7cbdbf-b26vf"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.979653 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.985282 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988308 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988343 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988356 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jlvsk\" (UniqueName: \"kubernetes.io/projected/d201fa7e-e3af-41a6-909e-2746298322c6-kube-api-access-jlvsk\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988388 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988408 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988421 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.988432 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vswfv\" (UniqueName: \"kubernetes.io/projected/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-kube-api-access-vswfv\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.999220 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w"] Nov 21 12:22:25 crc kubenswrapper[4769]: I1121 12:22:25.999316 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-55999c7dfd-4r92w"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.005329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.006360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.031598 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.033214 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.036430 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.075391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-config-data" (OuterVolumeSpecName: "config-data") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.077749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.081797 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-config-data" (OuterVolumeSpecName: "config-data") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.081924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090086 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090128 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090139 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090149 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090158 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090168 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090176 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.090646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.099149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" (UID: "876a68ab-e7c7-4b51-bc47-db7d9eb86e3b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.138206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-config-data" (OuterVolumeSpecName: "config-data") pod "d201fa7e-e3af-41a6-909e-2746298322c6" (UID: "d201fa7e-e3af-41a6-909e-2746298322c6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.161328 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.193653 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.193690 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d201fa7e-e3af-41a6-909e-2746298322c6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.193702 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.193713 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.194750 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerID="b4b3f57099e41a56cbff74a84cacda2ce3ff279cdeb430ff8e11bc8f337593ae" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.194875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c849e8b-0572-485c-a8cc-3436a605a5d4","Type":"ContainerDied","Data":"b4b3f57099e41a56cbff74a84cacda2ce3ff279cdeb430ff8e11bc8f337593ae"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.196083 4769 generic.go:334] "Generic (PLEG): container finished" podID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerID="ee531eaae4596e437913d46d3b12917c98a7852b5af2681a891ae63fe69d63cd" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.196208 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a","Type":"ContainerDied","Data":"ee531eaae4596e437913d46d3b12917c98a7852b5af2681a891ae63fe69d63cd"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.196374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a","Type":"ContainerDied","Data":"7fb893744b3657bafd687705a1243a33fb3cd2b5dce151de1a5e6269d0c5d3f6"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.196434 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fb893744b3657bafd687705a1243a33fb3cd2b5dce151de1a5e6269d0c5d3f6" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.214453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"96896fd8-daed-4cfd-93d0-894c2ca63cf8","Type":"ContainerDied","Data":"ab9e09e3d2d74e355ec8b1ebc2a7d30068e16e14cdf8d6aabf3d52642723a118"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.214493 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab9e09e3d2d74e355ec8b1ebc2a7d30068e16e14cdf8d6aabf3d52642723a118" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.216139 4769 generic.go:334] "Generic (PLEG): container finished" podID="e47a4c53-835f-4501-9e11-dea59692b355" containerID="6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.216179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e47a4c53-835f-4501-9e11-dea59692b355","Type":"ContainerDied","Data":"6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.217504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e065f3e6-390d-4bdc-98eb-d2efc6fabecf" (UID: "e065f3e6-390d-4bdc-98eb-d2efc6fabecf"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.221107 4769 generic.go:334] "Generic (PLEG): container finished" podID="c81a2490-fdac-4a03-abd8-081f31034cee" containerID="c38ecbe20dbb6e7844107011aaf892c606a0f887d18c974d40faabcdbdc9d2ad" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.221238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" event={"ID":"c81a2490-fdac-4a03-abd8-081f31034cee","Type":"ContainerDied","Data":"c38ecbe20dbb6e7844107011aaf892c606a0f887d18c974d40faabcdbdc9d2ad"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.221287 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" event={"ID":"c81a2490-fdac-4a03-abd8-081f31034cee","Type":"ContainerStarted","Data":"542b491b21e908de2d7297ec51130ad71e78e10c3f85f5f11dbceaf65046f90b"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.222841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.228428 4769 generic.go:334] "Generic (PLEG): container finished" podID="d898c08a-4c85-42c8-86f7-43e5fab04611" containerID="dea46b3b14bbd1e5122a520588b3b7295eb7903651356a0165e54bcd7dc9275d" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.228533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d898c08a-4c85-42c8-86f7-43e5fab04611","Type":"ContainerDied","Data":"dea46b3b14bbd1e5122a520588b3b7295eb7903651356a0165e54bcd7dc9275d"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.228570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"d898c08a-4c85-42c8-86f7-43e5fab04611","Type":"ContainerDied","Data":"dd00449222b16139d7ad632004871dfa709232dbcf3b682b319ad3e7b535c0c3"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.228587 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd00449222b16139d7ad632004871dfa709232dbcf3b682b319ad3e7b535c0c3" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.230736 4769 generic.go:334] "Generic (PLEG): container finished" podID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerID="99df80460a2097a210975c9c3f81c06ddafc94375c50ae068765c59ce67ccff6" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.230784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ba1ff42d-4e97-42a8-9bc1-12490fa969e1","Type":"ContainerDied","Data":"99df80460a2097a210975c9c3f81c06ddafc94375c50ae068765c59ce67ccff6"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.233893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d201fa7e-e3af-41a6-909e-2746298322c6","Type":"ContainerDied","Data":"bde64e90f27e4f9f75532c10b961af4c9f712d7476b20a0439b03383bf1390ea"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.233930 4769 scope.go:117] "RemoveContainer" containerID="8f6ad774a8254888f3e2cdcdc28df21e19a43d07485d96c1026e8cf36d2a802b" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.233979 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.246732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" event={"ID":"e065f3e6-390d-4bdc-98eb-d2efc6fabecf","Type":"ContainerDied","Data":"149d1824051a3dab6784c4e92dcced019b3f590eeb724a93d3dd23ca340b0710"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.246895 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f6f5bfd-47vgz" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.263048 4769 generic.go:334] "Generic (PLEG): container finished" podID="02eacc35-6822-431b-9909-90f9d7a0497c" containerID="3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.263165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eacc35-6822-431b-9909-90f9d7a0497c","Type":"ContainerDied","Data":"3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.264641 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" podStartSLOduration=6.264604891 podStartE2EDuration="6.264604891s" podCreationTimestamp="2025-11-21 12:22:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:22:26.248582411 +0000 UTC m=+1904.949244229" watchObservedRunningTime="2025-11-21 12:22:26.264604891 +0000 UTC m=+1904.965266709" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.267786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" event={"ID":"d62c426e-d8cb-4861-8e12-19a15e83948d","Type":"ContainerDied","Data":"05f14d4b053e06e7f60458b237eea7f260b197e668dd02365e97dce52f97ed35"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.267853 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05f14d4b053e06e7f60458b237eea7f260b197e668dd02365e97dce52f97ed35" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.298297 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.303091 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.303599 4769 generic.go:334] "Generic (PLEG): container finished" podID="b93ccd0d-4d54-491c-985e-6d149616f695" containerID="50e147f7889ceaf7fb95d13ab3783b5e090881e101729579e3050adae56b289f" exitCode=0 Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.309395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" event={"ID":"b93ccd0d-4d54-491c-985e-6d149616f695","Type":"ContainerDied","Data":"50e147f7889ceaf7fb95d13ab3783b5e090881e101729579e3050adae56b289f"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.309805 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.309868 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e065f3e6-390d-4bdc-98eb-d2efc6fabecf-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.311727 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.322807 4769 scope.go:117] "RemoveContainer" containerID="b973ee449f9bf72036cb4a436ce753b74ac421ac2bfbdb5827c31daefe182113" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.324527 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5f6f5bfd-47vgz"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.333479 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.339559 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5f6f5bfd-47vgz"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.352896 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.353411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"876a68ab-e7c7-4b51-bc47-db7d9eb86e3b","Type":"ContainerDied","Data":"8798e767ce2b1d61e03ddcd68f498c081c87ef1b2e2c3d44692cefcfb1abf288"} Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.353653 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" secret="" err="secret \"galera-openstack-dockercfg-wvnqs\" not found" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.354898 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" secret="" err="secret \"galera-openstack-dockercfg-wvnqs\" not found" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.359543 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.363172 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.365235 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.367890 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.403262 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96896fd8-daed-4cfd-93d0-894c2ca63cf8-logs\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412179 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-public-tls-certs\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-combined-ca-bundle\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b68m\" (UniqueName: \"kubernetes.io/projected/d62c426e-d8cb-4861-8e12-19a15e83948d-kube-api-access-4b68m\") pod \"d62c426e-d8cb-4861-8e12-19a15e83948d\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxwtk\" (UniqueName: \"kubernetes.io/projected/96896fd8-daed-4cfd-93d0-894c2ca63cf8-kube-api-access-hxwtk\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data-custom\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412361 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96896fd8-daed-4cfd-93d0-894c2ca63cf8-etc-machine-id\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d62c426e-d8cb-4861-8e12-19a15e83948d-operator-scripts\") pod \"d62c426e-d8cb-4861-8e12-19a15e83948d\" (UID: \"d62c426e-d8cb-4861-8e12-19a15e83948d\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-scripts\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-internal-tls-certs\") pod \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\" (UID: \"96896fd8-daed-4cfd-93d0-894c2ca63cf8\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.412807 4769 scope.go:117] "RemoveContainer" containerID="c294f4926913ea9a60162f42ad399069486233b7eff0d59b236f4c3cc4f1abe5" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.413695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d62c426e-d8cb-4861-8e12-19a15e83948d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d62c426e-d8cb-4861-8e12-19a15e83948d" (UID: "d62c426e-d8cb-4861-8e12-19a15e83948d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.416747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96896fd8-daed-4cfd-93d0-894c2ca63cf8-logs" (OuterVolumeSpecName: "logs") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.420990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/96896fd8-daed-4cfd-93d0-894c2ca63cf8-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.421627 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.429640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d62c426e-d8cb-4861-8e12-19a15e83948d-kube-api-access-4b68m" (OuterVolumeSpecName: "kube-api-access-4b68m") pod "d62c426e-d8cb-4861-8e12-19a15e83948d" (UID: "d62c426e-d8cb-4861-8e12-19a15e83948d"). InnerVolumeSpecName "kube-api-access-4b68m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.432548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96896fd8-daed-4cfd-93d0-894c2ca63cf8-kube-api-access-hxwtk" (OuterVolumeSpecName: "kube-api-access-hxwtk") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "kube-api-access-hxwtk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.444696 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.453078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.453810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.454409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-scripts" (OuterVolumeSpecName: "scripts") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.464984 4769 scope.go:117] "RemoveContainer" containerID="6de66ba8fe1756d5210aad3a6ae29943290c8cb763fd345214b2270daf476b95" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.500471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data" (OuterVolumeSpecName: "config-data") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.500501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.501327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.514705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s8zb\" (UniqueName: \"kubernetes.io/projected/b93ccd0d-4d54-491c-985e-6d149616f695-kube-api-access-8s8zb\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.514833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-internal-tls-certs\") pod \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.514867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpr65\" (UniqueName: \"kubernetes.io/projected/21376353-0114-447a-aec5-9d1e773e996f-kube-api-access-lpr65\") pod \"21376353-0114-447a-aec5-9d1e773e996f\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.514910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c849e8b-0572-485c-a8cc-3436a605a5d4-logs\") pod \"9c849e8b-0572-485c-a8cc-3436a605a5d4\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.514959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27v4m\" (UniqueName: \"kubernetes.io/projected/d898c08a-4c85-42c8-86f7-43e5fab04611-kube-api-access-27v4m\") pod \"d898c08a-4c85-42c8-86f7-43e5fab04611\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.514983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/446d3e05-b6f6-427d-9264-8a6447945da3-operator-scripts\") pod \"446d3e05-b6f6-427d-9264-8a6447945da3\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-config-data\") pod \"9c849e8b-0572-485c-a8cc-3436a605a5d4\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-combined-ca-bundle\") pod \"d898c08a-4c85-42c8-86f7-43e5fab04611\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-combined-ca-bundle\") pod \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6bmg\" (UniqueName: \"kubernetes.io/projected/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-kube-api-access-n6bmg\") pod \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-internal-tls-certs\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515176 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-combined-ca-bundle\") pod \"9c849e8b-0572-485c-a8cc-3436a605a5d4\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515242 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-kolla-config\") pod \"d898c08a-4c85-42c8-86f7-43e5fab04611\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-memcached-tls-certs\") pod \"d898c08a-4c85-42c8-86f7-43e5fab04611\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515332 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-public-tls-certs\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515430 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/016592c0-e31c-48bf-8636-626daf48ad49-operator-scripts\") pod \"016592c0-e31c-48bf-8636-626daf48ad49\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b93ccd0d-4d54-491c-985e-6d149616f695-logs\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr2pn\" (UniqueName: \"kubernetes.io/projected/016592c0-e31c-48bf-8636-626daf48ad49-kube-api-access-gr2pn\") pod \"016592c0-e31c-48bf-8636-626daf48ad49\" (UID: \"016592c0-e31c-48bf-8636-626daf48ad49\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515543 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-combined-ca-bundle\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21376353-0114-447a-aec5-9d1e773e996f-operator-scripts\") pod \"21376353-0114-447a-aec5-9d1e773e996f\" (UID: \"21376353-0114-447a-aec5-9d1e773e996f\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-logs\") pod \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hphvm\" (UniqueName: \"kubernetes.io/projected/9c849e8b-0572-485c-a8cc-3436a605a5d4-kube-api-access-hphvm\") pod \"9c849e8b-0572-485c-a8cc-3436a605a5d4\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515749 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-config-data\") pod \"d898c08a-4c85-42c8-86f7-43e5fab04611\" (UID: \"d898c08a-4c85-42c8-86f7-43e5fab04611\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5blr\" (UniqueName: \"kubernetes.io/projected/446d3e05-b6f6-427d-9264-8a6447945da3-kube-api-access-v5blr\") pod \"446d3e05-b6f6-427d-9264-8a6447945da3\" (UID: \"446d3e05-b6f6-427d-9264-8a6447945da3\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-config-data\") pod \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-public-tls-certs\") pod \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\" (UID: \"b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data-custom\") pod \"b93ccd0d-4d54-491c-985e-6d149616f695\" (UID: \"b93ccd0d-4d54-491c-985e-6d149616f695\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.515898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-nova-metadata-tls-certs\") pod \"9c849e8b-0572-485c-a8cc-3436a605a5d4\" (UID: \"9c849e8b-0572-485c-a8cc-3436a605a5d4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.516692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016592c0-e31c-48bf-8636-626daf48ad49-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "016592c0-e31c-48bf-8636-626daf48ad49" (UID: "016592c0-e31c-48bf-8636-626daf48ad49"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.517355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21376353-0114-447a-aec5-9d1e773e996f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "21376353-0114-447a-aec5-9d1e773e996f" (UID: "21376353-0114-447a-aec5-9d1e773e996f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.517814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b93ccd0d-4d54-491c-985e-6d149616f695-logs" (OuterVolumeSpecName: "logs") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518276 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/016592c0-e31c-48bf-8636-626daf48ad49-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518327 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b93ccd0d-4d54-491c-985e-6d149616f695-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518343 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21376353-0114-447a-aec5-9d1e773e996f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518356 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d62c426e-d8cb-4861-8e12-19a15e83948d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518369 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518380 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518395 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/96896fd8-daed-4cfd-93d0-894c2ca63cf8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518408 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518423 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518435 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4b68m\" (UniqueName: \"kubernetes.io/projected/d62c426e-d8cb-4861-8e12-19a15e83948d-kube-api-access-4b68m\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518453 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hxwtk\" (UniqueName: \"kubernetes.io/projected/96896fd8-daed-4cfd-93d0-894c2ca63cf8-kube-api-access-hxwtk\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518466 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.518478 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/96896fd8-daed-4cfd-93d0-894c2ca63cf8-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.519661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-logs" (OuterVolumeSpecName: "logs") pod "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" (UID: "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.523040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-config-data" (OuterVolumeSpecName: "config-data") pod "d898c08a-4c85-42c8-86f7-43e5fab04611" (UID: "d898c08a-4c85-42c8-86f7-43e5fab04611"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.525078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016592c0-e31c-48bf-8636-626daf48ad49-kube-api-access-gr2pn" (OuterVolumeSpecName: "kube-api-access-gr2pn") pod "016592c0-e31c-48bf-8636-626daf48ad49" (UID: "016592c0-e31c-48bf-8636-626daf48ad49"). InnerVolumeSpecName "kube-api-access-gr2pn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.525803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c849e8b-0572-485c-a8cc-3436a605a5d4-logs" (OuterVolumeSpecName: "logs") pod "9c849e8b-0572-485c-a8cc-3436a605a5d4" (UID: "9c849e8b-0572-485c-a8cc-3436a605a5d4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.525958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b93ccd0d-4d54-491c-985e-6d149616f695-kube-api-access-8s8zb" (OuterVolumeSpecName: "kube-api-access-8s8zb") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "kube-api-access-8s8zb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.527166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/446d3e05-b6f6-427d-9264-8a6447945da3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "446d3e05-b6f6-427d-9264-8a6447945da3" (UID: "446d3e05-b6f6-427d-9264-8a6447945da3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.527820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d898c08a-4c85-42c8-86f7-43e5fab04611" (UID: "d898c08a-4c85-42c8-86f7-43e5fab04611"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.530044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c849e8b-0572-485c-a8cc-3436a605a5d4-kube-api-access-hphvm" (OuterVolumeSpecName: "kube-api-access-hphvm") pod "9c849e8b-0572-485c-a8cc-3436a605a5d4" (UID: "9c849e8b-0572-485c-a8cc-3436a605a5d4"). InnerVolumeSpecName "kube-api-access-hphvm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.535768 4769 scope.go:117] "RemoveContainer" containerID="dd0e43d5b60bac8f8a93051855b26f738ec15e9e35b816fa885086c681956cd3" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.556952 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.574096 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d898c08a-4c85-42c8-86f7-43e5fab04611-kube-api-access-27v4m" (OuterVolumeSpecName: "kube-api-access-27v4m") pod "d898c08a-4c85-42c8-86f7-43e5fab04611" (UID: "d898c08a-4c85-42c8-86f7-43e5fab04611"). InnerVolumeSpecName "kube-api-access-27v4m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.574206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-kube-api-access-n6bmg" (OuterVolumeSpecName: "kube-api-access-n6bmg") pod "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" (UID: "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a"). InnerVolumeSpecName "kube-api-access-n6bmg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.588566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/446d3e05-b6f6-427d-9264-8a6447945da3-kube-api-access-v5blr" (OuterVolumeSpecName: "kube-api-access-v5blr") pod "446d3e05-b6f6-427d-9264-8a6447945da3" (UID: "446d3e05-b6f6-427d-9264-8a6447945da3"). InnerVolumeSpecName "kube-api-access-v5blr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.596408 4769 scope.go:117] "RemoveContainer" containerID="af1cd2d919c7575b7e57f4eda560fb0bf162892f90ce7176b43cfc178cc35b9b" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.605412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21376353-0114-447a-aec5-9d1e773e996f-kube-api-access-lpr65" (OuterVolumeSpecName: "kube-api-access-lpr65") pod "21376353-0114-447a-aec5-9d1e773e996f" (UID: "21376353-0114-447a-aec5-9d1e773e996f"). InnerVolumeSpecName "kube-api-access-lpr65". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmvj9\" (UniqueName: \"kubernetes.io/projected/02eacc35-6822-431b-9909-90f9d7a0497c-kube-api-access-vmvj9\") pod \"02eacc35-6822-431b-9909-90f9d7a0497c\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-config-data\") pod \"02eacc35-6822-431b-9909-90f9d7a0497c\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-combined-ca-bundle\") pod \"02eacc35-6822-431b-9909-90f9d7a0497c\" (UID: \"02eacc35-6822-431b-9909-90f9d7a0497c\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c25wt\" (UniqueName: \"kubernetes.io/projected/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-kube-api-access-c25wt\") pod \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-operator-scripts\") pod \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\" (UID: \"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619743 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-27v4m\" (UniqueName: \"kubernetes.io/projected/d898c08a-4c85-42c8-86f7-43e5fab04611-kube-api-access-27v4m\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619754 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/446d3e05-b6f6-427d-9264-8a6447945da3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619765 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n6bmg\" (UniqueName: \"kubernetes.io/projected/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-kube-api-access-n6bmg\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619773 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619782 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gr2pn\" (UniqueName: \"kubernetes.io/projected/016592c0-e31c-48bf-8636-626daf48ad49-kube-api-access-gr2pn\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619790 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619798 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hphvm\" (UniqueName: \"kubernetes.io/projected/9c849e8b-0572-485c-a8cc-3436a605a5d4-kube-api-access-hphvm\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619806 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d898c08a-4c85-42c8-86f7-43e5fab04611-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619815 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v5blr\" (UniqueName: \"kubernetes.io/projected/446d3e05-b6f6-427d-9264-8a6447945da3-kube-api-access-v5blr\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619823 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619832 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8s8zb\" (UniqueName: \"kubernetes.io/projected/b93ccd0d-4d54-491c-985e-6d149616f695-kube-api-access-8s8zb\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619843 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lpr65\" (UniqueName: \"kubernetes.io/projected/21376353-0114-447a-aec5-9d1e773e996f-kube-api-access-lpr65\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.619850 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c849e8b-0572-485c-a8cc-3436a605a5d4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.620358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" (UID: "0cf573d8-8dea-48c2-8ed6-fb42a68f85b4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.636006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-config-data" (OuterVolumeSpecName: "config-data") pod "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" (UID: "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.641505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-kube-api-access-c25wt" (OuterVolumeSpecName: "kube-api-access-c25wt") pod "0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" (UID: "0cf573d8-8dea-48c2-8ed6-fb42a68f85b4"). InnerVolumeSpecName "kube-api-access-c25wt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.642424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02eacc35-6822-431b-9909-90f9d7a0497c-kube-api-access-vmvj9" (OuterVolumeSpecName: "kube-api-access-vmvj9") pod "02eacc35-6822-431b-9909-90f9d7a0497c" (UID: "02eacc35-6822-431b-9909-90f9d7a0497c"). InnerVolumeSpecName "kube-api-access-vmvj9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.646570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "96896fd8-daed-4cfd-93d0-894c2ca63cf8" (UID: "96896fd8-daed-4cfd-93d0-894c2ca63cf8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.671178 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.682742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-config-data" (OuterVolumeSpecName: "config-data") pod "9c849e8b-0572-485c-a8cc-3436a605a5d4" (UID: "9c849e8b-0572-485c-a8cc-3436a605a5d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.685303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.685447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c849e8b-0572-485c-a8cc-3436a605a5d4" (UID: "9c849e8b-0572-485c-a8cc-3436a605a5d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.687510 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.697737 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.703790 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data" (OuterVolumeSpecName: "config-data") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.708992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" (UID: "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.708887 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d898c08a-4c85-42c8-86f7-43e5fab04611" (UID: "d898c08a-4c85-42c8-86f7-43e5fab04611"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.721944 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.721994 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722007 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vmvj9\" (UniqueName: \"kubernetes.io/projected/02eacc35-6822-431b-9909-90f9d7a0497c-kube-api-access-vmvj9\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722024 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722044 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722055 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722067 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c25wt\" (UniqueName: \"kubernetes.io/projected/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-kube-api-access-c25wt\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722081 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722096 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722108 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96896fd8-daed-4cfd-93d0-894c2ca63cf8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.722120 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: E1121 12:22:26.722266 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:26 crc kubenswrapper[4769]: E1121 12:22:26.722339 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:28.72231779 +0000 UTC m=+1907.422979608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.729426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-config-data" (OuterVolumeSpecName: "config-data") pod "02eacc35-6822-431b-9909-90f9d7a0497c" (UID: "02eacc35-6822-431b-9909-90f9d7a0497c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.733765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.744894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "d898c08a-4c85-42c8-86f7-43e5fab04611" (UID: "d898c08a-4c85-42c8-86f7-43e5fab04611"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.763311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "02eacc35-6822-431b-9909-90f9d7a0497c" (UID: "02eacc35-6822-431b-9909-90f9d7a0497c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.767134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9c849e8b-0572-485c-a8cc-3436a605a5d4" (UID: "9c849e8b-0572-485c-a8cc-3436a605a5d4"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.772067 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" (UID: "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.774471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b93ccd0d-4d54-491c-985e-6d149616f695" (UID: "b93ccd0d-4d54-491c-985e-6d149616f695"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.777332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" (UID: "b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.823950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-config-data\") pod \"e47a4c53-835f-4501-9e11-dea59692b355\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.824098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmq79\" (UniqueName: \"kubernetes.io/projected/e47a4c53-835f-4501-9e11-dea59692b355-kube-api-access-hmq79\") pod \"e47a4c53-835f-4501-9e11-dea59692b355\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.824330 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-combined-ca-bundle\") pod \"e47a4c53-835f-4501-9e11-dea59692b355\" (UID: \"e47a4c53-835f-4501-9e11-dea59692b355\") " Nov 21 12:22:26 crc kubenswrapper[4769]: E1121 12:22:26.825063 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:26 crc kubenswrapper[4769]: E1121 12:22:26.825179 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data podName:ad94928f-bd00-4e2a-a9a3-8d8a1419bfec nodeName:}" failed. No retries permitted until 2025-11-21 12:22:34.825148479 +0000 UTC m=+1913.525810467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data") pod "rabbitmq-cell1-server-0" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:22:26 crc kubenswrapper[4769]: E1121 12:22:26.825274 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:26 crc kubenswrapper[4769]: E1121 12:22:26.825372 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:22:28.825348114 +0000 UTC m=+1907.526010022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.825549 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c849e8b-0572-485c-a8cc-3436a605a5d4-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826383 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826401 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826413 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826423 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/d898c08a-4c85-42c8-86f7-43e5fab04611-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826433 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02eacc35-6822-431b-9909-90f9d7a0497c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826443 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b93ccd0d-4d54-491c-985e-6d149616f695-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.826453 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.828101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e47a4c53-835f-4501-9e11-dea59692b355-kube-api-access-hmq79" (OuterVolumeSpecName: "kube-api-access-hmq79") pod "e47a4c53-835f-4501-9e11-dea59692b355" (UID: "e47a4c53-835f-4501-9e11-dea59692b355"). InnerVolumeSpecName "kube-api-access-hmq79". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.851282 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e47a4c53-835f-4501-9e11-dea59692b355" (UID: "e47a4c53-835f-4501-9e11-dea59692b355"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.860620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-config-data" (OuterVolumeSpecName: "config-data") pod "e47a4c53-835f-4501-9e11-dea59692b355" (UID: "e47a4c53-835f-4501-9e11-dea59692b355"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.930586 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.930638 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e47a4c53-835f-4501-9e11-dea59692b355-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.930651 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hmq79\" (UniqueName: \"kubernetes.io/projected/e47a4c53-835f-4501-9e11-dea59692b355-kube-api-access-hmq79\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:26 crc kubenswrapper[4769]: I1121 12:22:26.970108 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-combined-ca-bundle\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-galera-tls-certs\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-generated\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-default\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kolla-config\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm6xh\" (UniqueName: \"kubernetes.io/projected/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kube-api-access-zm6xh\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-operator-scripts\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\" (UID: \"ba1ff42d-4e97-42a8-9bc1-12490fa969e1\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.133982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.134540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.137347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kube-api-access-zm6xh" (OuterVolumeSpecName: "kube-api-access-zm6xh") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "kube-api-access-zm6xh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.143362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "mysql-db") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.177157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.186344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "ba1ff42d-4e97-42a8-9bc1-12490fa969e1" (UID: "ba1ff42d-4e97-42a8-9bc1-12490fa969e1"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235503 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235539 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235551 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235561 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235572 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235581 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zm6xh\" (UniqueName: \"kubernetes.io/projected/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-kube-api-access-zm6xh\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235589 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba1ff42d-4e97-42a8-9bc1-12490fa969e1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.235608 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235528 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-storage-config-data: configmap "swift-storage-config-data" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235697 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235708 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235720 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235533 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235592 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235615 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/barbican-config-data: secret "barbican-config-data" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235779 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:35.235760936 +0000 UTC m=+1913.936422754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235946 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:35.23591778 +0000 UTC m=+1913.936579598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "combined-ca-bundle" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235962 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data podName:9b970d3d-1a5c-40da-90ff-ddcc991a571d nodeName:}" failed. No retries permitted until 2025-11-21 12:22:35.235955971 +0000 UTC m=+1913.936617779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data") pod "rabbitmq-server-0" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d") : configmap "rabbitmq-config-data" not found Nov 21 12:22:27 crc kubenswrapper[4769]: E1121 12:22:27.235975 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data podName:cd70ab0b-1d92-4c16-9be4-261b4773d364 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:35.235968401 +0000 UTC m=+1913.936630219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data") pod "barbican-keystone-listener-584c67dfc6-kntvc" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364") : secret "barbican-config-data" not found Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.253550 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.289634 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" path="/var/lib/kubelet/pods/1905ef09-f68a-4eaa-bdc4-19aa620bc07b/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.290471 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" path="/var/lib/kubelet/pods/2e84ae61-76e9-4820-a40f-9dc2ca2aad50/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.291118 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30cb53e2-204b-4d6b-839a-072f30cd479d" path="/var/lib/kubelet/pods/30cb53e2-204b-4d6b-839a-072f30cd479d/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.292275 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3255e587-f85f-4089-8dc1-47a52bd564c2" path="/var/lib/kubelet/pods/3255e587-f85f-4089-8dc1-47a52bd564c2/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.292834 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="378706f5-ebf7-4c4f-8508-1c704af035c7" path="/var/lib/kubelet/pods/378706f5-ebf7-4c4f-8508-1c704af035c7/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.293415 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5121d00c-030e-40f1-8e18-f0c07e63f00d" path="/var/lib/kubelet/pods/5121d00c-030e-40f1-8e18-f0c07e63f00d/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.294671 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51b6ab2f-2185-4d33-987e-a3781685174d" path="/var/lib/kubelet/pods/51b6ab2f-2185-4d33-987e-a3781685174d/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.295280 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="591df651-4d68-41ac-b196-e2e50dcda057" path="/var/lib/kubelet/pods/591df651-4d68-41ac-b196-e2e50dcda057/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.295859 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a" path="/var/lib/kubelet/pods/6a6698c9-6f90-4a92-ac49-2fc3c1f27d3a/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.296731 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1bbf46-3f46-4554-9360-ed74840503cd" path="/var/lib/kubelet/pods/6b1bbf46-3f46-4554-9360-ed74840503cd/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.297944 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" path="/var/lib/kubelet/pods/7b9329ea-65e5-4fff-978b-4cf7d1d1f68a/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.298714 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" path="/var/lib/kubelet/pods/876a68ab-e7c7-4b51-bc47-db7d9eb86e3b/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.300156 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" path="/var/lib/kubelet/pods/8afd06f7-779e-4ef5-a411-a00c1a15d5c3/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.301023 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c0ded7-5b8b-4083-a8ed-e924644a1581" path="/var/lib/kubelet/pods/93c0ded7-5b8b-4083-a8ed-e924644a1581/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.301586 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af5874bd-927a-49c2-b81e-c53567bf628d" path="/var/lib/kubelet/pods/af5874bd-927a-49c2-b81e-c53567bf628d/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.302647 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6314295-c402-4f64-bc4a-4c5f00816c25" path="/var/lib/kubelet/pods/c6314295-c402-4f64-bc4a-4c5f00816c25/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.303427 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" path="/var/lib/kubelet/pods/d201fa7e-e3af-41a6-909e-2746298322c6/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.304221 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" path="/var/lib/kubelet/pods/e065f3e6-390d-4bdc-98eb-d2efc6fabecf/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.305457 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f68bcd4c-d3d9-4bdb-8328-745682033ab4" path="/var/lib/kubelet/pods/f68bcd4c-d3d9-4bdb-8328-745682033ab4/volumes" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.336820 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.367835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" event={"ID":"21376353-0114-447a-aec5-9d1e773e996f","Type":"ContainerDied","Data":"c19665ae19bf88a3b205af7e271b1db99fdf6e620b0254f9c511f8fea3d0ce6e"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.367873 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c19665ae19bf88a3b205af7e271b1db99fdf6e620b0254f9c511f8fea3d0ce6e" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.367886 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementa3a7-account-delete-d4srh" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.369945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"02eacc35-6822-431b-9909-90f9d7a0497c","Type":"ContainerDied","Data":"d425f44070afa3ad6aac103dfd942d3bc8318fa2b7d0bc44a29337971ab1c0da"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.370020 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.370101 4769 scope.go:117] "RemoveContainer" containerID="3408f5682ee47e1025ab994408f9c719a1065020e34cfc14921d27a12db1c49f" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.372392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" event={"ID":"016592c0-e31c-48bf-8636-626daf48ad49","Type":"ContainerDied","Data":"bac4483d30d6cfde6686d2e62ee1b79d94313324acbd0fbab6538be936524872"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.372415 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bac4483d30d6cfde6686d2e62ee1b79d94313324acbd0fbab6538be936524872" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.372479 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance3a55-account-delete-lpj8v" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.397122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" event={"ID":"446d3e05-b6f6-427d-9264-8a6447945da3","Type":"ContainerDied","Data":"244175e13f0de764418903ec732a67c3525e8dc1886f04942e0dd2d21566a073"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.397231 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="244175e13f0de764418903ec732a67c3525e8dc1886f04942e0dd2d21566a073" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.397143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder31d6-account-delete-sdktq" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.406072 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.409141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6489646f7b-4v47t" event={"ID":"b93ccd0d-4d54-491c-985e-6d149616f695","Type":"ContainerDied","Data":"eb7e142f40c8d11093fed991c7f45d8e478eeaf979d76457d1d9a186f2736680"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.412801 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.413459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9c849e8b-0572-485c-a8cc-3436a605a5d4","Type":"ContainerDied","Data":"9e105945dd15cc7c500f23d6fbffb2bfd348a6748d7bd609866fea1bbe6175a2"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.418098 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerID="259aba43b6950c460955890aea38f479d52382b756120c0666d872f19b098bb5" exitCode=0 Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.418152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec","Type":"ContainerDied","Data":"259aba43b6950c460955890aea38f479d52382b756120c0666d872f19b098bb5"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.423989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ba1ff42d-4e97-42a8-9bc1-12490fa969e1","Type":"ContainerDied","Data":"16442703f6baee1100683618c9033230fe75d7bedf6831ff288b9ed0e464a444"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.424090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.428008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" event={"ID":"0cf573d8-8dea-48c2-8ed6-fb42a68f85b4","Type":"ContainerDied","Data":"b39d78f2fdecab7ed32dbb9217f88dc86f5a3e69beb7874c742eb016464b7aa5"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.428042 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b39d78f2fdecab7ed32dbb9217f88dc86f5a3e69beb7874c742eb016464b7aa5" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.428133 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutrond005-account-delete-ngwsv" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.432858 4769 scope.go:117] "RemoveContainer" containerID="50e147f7889ceaf7fb95d13ab3783b5e090881e101729579e3050adae56b289f" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.437729 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.437816 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican22df-account-delete-hdprn" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.438412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e47a4c53-835f-4501-9e11-dea59692b355","Type":"ContainerDied","Data":"465cc6ef28388206e4c5c388b247971bba2f66be3308ebb425078da89ca45f9e"} Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.438455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" podUID="23a3ecd4-5133-4225-ac3b-a5914cacc71b" containerName="mariadb-account-delete" containerID="cri-o://4492d3ff34f99cdbaa9ca423b4c8781cec9ea9218d5adfd7e8669c7d8c78331a" gracePeriod=30 Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.438475 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.438555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.438893 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" podUID="caa9c968-8235-4441-b6fa-54a6ab4298ca" containerName="mariadb-account-delete" containerID="cri-o://e9d461f06f79acc19dadb1308feb91194931d0c687f46ce1d5c230baecc8bdf0" gracePeriod=30 Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.438994 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.495473 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder31d6-account-delete-sdktq"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.506904 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder31d6-account-delete-sdktq"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.513789 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance3a55-account-delete-lpj8v"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.514685 4769 scope.go:117] "RemoveContainer" containerID="3698bab596c29ca6814770541aae1aac5f1f4a8c2838d5487adb7c0a36048959" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.517675 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance3a55-account-delete-lpj8v"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.559932 4769 scope.go:117] "RemoveContainer" containerID="b4b3f57099e41a56cbff74a84cacda2ce3ff279cdeb430ff8e11bc8f337593ae" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.568335 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.587760 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementa3a7-account-delete-d4srh"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.596504 4769 scope.go:117] "RemoveContainer" containerID="cc23fc45461ffe3ef999a7fcd41dbe4dd21a5619869db7852079c67badbe6543" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.605929 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placementa3a7-account-delete-d4srh"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.613563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.630936 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.634122 4769 scope.go:117] "RemoveContainer" containerID="99df80460a2097a210975c9c3f81c06ddafc94375c50ae068765c59ce67ccff6" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.634425 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6489646f7b-4v47t"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.640774 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6489646f7b-4v47t"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.658656 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.665166 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.673437 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.678215 4769 scope.go:117] "RemoveContainer" containerID="fbd5f96ae58c63ce27a67e0354a19870d563db200e82a4e9e60e28c8ec4b0843" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.687443 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.717128 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican22df-account-delete-hdprn"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.728951 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican22df-account-delete-hdprn"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.741022 4769 scope.go:117] "RemoveContainer" containerID="6b35be675aaa2e9378f86cafd36acdc0d245a7653407d2163510dde2afc98795" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-confd\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-plugins-conf\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751225 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-plugins\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751253 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-pod-info\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twmmr\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-kube-api-access-twmmr\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-erlang-cookie\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-tls\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-server-conf\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.751619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-erlang-cookie-secret\") pod \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\" (UID: \"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec\") " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.752241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.755440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.756238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.758206 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutrond005-account-delete-ngwsv"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.758236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.758883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-kube-api-access-twmmr" (OuterVolumeSpecName: "kube-api-access-twmmr") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "kube-api-access-twmmr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.763668 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutrond005-account-delete-ngwsv"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.772290 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "persistence") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.775123 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.783139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data" (OuterVolumeSpecName: "config-data") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.783326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-pod-info" (OuterVolumeSpecName: "pod-info") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.798433 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.811557 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.815370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.818305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-server-conf" (OuterVolumeSpecName: "server-conf") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.821499 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.830371 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.835453 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.839752 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.847154 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854552 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854604 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854616 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854631 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854645 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-twmmr\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-kube-api-access-twmmr\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854673 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854683 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854693 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854701 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.854709 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.872257 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" (UID: "ad94928f-bd00-4e2a-a9a3-8d8a1419bfec"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.876460 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.957386 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:27 crc kubenswrapper[4769]: I1121 12:22:27.957982 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.000179 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.160581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bskn5\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-kube-api-access-bskn5\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.160782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-tls\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.160874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-erlang-cookie\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.160905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9b970d3d-1a5c-40da-90ff-ddcc991a571d-pod-info\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.160945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-plugins-conf\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.160998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-plugins\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-server-conf\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9b970d3d-1a5c-40da-90ff-ddcc991a571d-erlang-cookie-secret\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-confd\") pod \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\" (UID: \"9b970d3d-1a5c-40da-90ff-ddcc991a571d\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.161772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.162526 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.162543 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.162593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.165573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b970d3d-1a5c-40da-90ff-ddcc991a571d-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.166045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b970d3d-1a5c-40da-90ff-ddcc991a571d-pod-info" (OuterVolumeSpecName: "pod-info") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.166316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-kube-api-access-bskn5" (OuterVolumeSpecName: "kube-api-access-bskn5") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "kube-api-access-bskn5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.166318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "persistence") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.166360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.184345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data" (OuterVolumeSpecName: "config-data") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.190384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.206325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-server-conf" (OuterVolumeSpecName: "server-conf") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.250713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "9b970d3d-1a5c-40da-90ff-ddcc991a571d" (UID: "9b970d3d-1a5c-40da-90ff-ddcc991a571d"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263543 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bskn5\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-kube-api-access-bskn5\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263584 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263600 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9b970d3d-1a5c-40da-90ff-ddcc991a571d-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263609 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263642 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263652 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263661 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9b970d3d-1a5c-40da-90ff-ddcc991a571d-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263671 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9b970d3d-1a5c-40da-90ff-ddcc991a571d-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.263680 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9b970d3d-1a5c-40da-90ff-ddcc991a571d-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.279512 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365081 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-internal-tls-certs\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-public-tls-certs\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-credential-keys\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xhdx\" (UniqueName: \"kubernetes.io/projected/b9561d60-3f1b-4a40-b24f-b4dad34f7117-kube-api-access-7xhdx\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-combined-ca-bundle\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365510 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-scripts\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365541 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-fernet-keys\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.365588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-config-data\") pod \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\" (UID: \"b9561d60-3f1b-4a40-b24f-b4dad34f7117\") " Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.366103 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.369466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.369786 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-scripts" (OuterVolumeSpecName: "scripts") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.369983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.370613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9561d60-3f1b-4a40-b24f-b4dad34f7117-kube-api-access-7xhdx" (OuterVolumeSpecName: "kube-api-access-7xhdx") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "kube-api-access-7xhdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.385422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.394556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-config-data" (OuterVolumeSpecName: "config-data") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.404072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.404499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b9561d60-3f1b-4a40-b24f-b4dad34f7117" (UID: "b9561d60-3f1b-4a40-b24f-b4dad34f7117"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.454108 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerID="4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e" exitCode=0 Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.454216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"9b970d3d-1a5c-40da-90ff-ddcc991a571d","Type":"ContainerDied","Data":"4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e"} Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.454246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"9b970d3d-1a5c-40da-90ff-ddcc991a571d","Type":"ContainerDied","Data":"f6fe062a0b5b397299cd0acc860b07b6d261085ab6a899371e278667b89c8258"} Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.454251 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.454299 4769 scope.go:117] "RemoveContainer" containerID="4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.462404 4769 generic.go:334] "Generic (PLEG): container finished" podID="b9561d60-3f1b-4a40-b24f-b4dad34f7117" containerID="832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a" exitCode=0 Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.462516 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.462541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" event={"ID":"b9561d60-3f1b-4a40-b24f-b4dad34f7117","Type":"ContainerDied","Data":"832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a"} Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.462602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk" event={"ID":"b9561d60-3f1b-4a40-b24f-b4dad34f7117","Type":"ContainerDied","Data":"b5d5fb89c2a51b4a5144b1701279bdf1e3eba468d4b24c3c7a9cd5013bd3ee92"} Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471533 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471564 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471574 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7xhdx\" (UniqueName: \"kubernetes.io/projected/b9561d60-3f1b-4a40-b24f-b4dad34f7117-kube-api-access-7xhdx\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471583 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471594 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471602 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471610 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.471621 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9561d60-3f1b-4a40-b24f-b4dad34f7117-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.474586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"ad94928f-bd00-4e2a-a9a3-8d8a1419bfec","Type":"ContainerDied","Data":"7d9c657f22aae1c5ba4950e858929541e33af9a9739ad31c807eefe412a5729c"} Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.474744 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.500581 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.506080 4769 scope.go:117] "RemoveContainer" containerID="5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.517990 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.532899 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk"] Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.538999 4769 scope.go:117] "RemoveContainer" containerID="4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e" Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.539586 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e\": container with ID starting with 4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e not found: ID does not exist" containerID="4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.539616 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e"} err="failed to get container status \"4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e\": rpc error: code = NotFound desc = could not find container \"4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e\": container with ID starting with 4d83c39d5a2e9259b87b848fe927399125eb111c7cb32a640b5bc9f18d6ef85e not found: ID does not exist" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.539639 4769 scope.go:117] "RemoveContainer" containerID="5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9" Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.540093 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9\": container with ID starting with 5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9 not found: ID does not exist" containerID="5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.540119 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9"} err="failed to get container status \"5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9\": rpc error: code = NotFound desc = could not find container \"5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9\": container with ID starting with 5d1d890e91d5afba51b4ed0b05c817d928b1a9a09e5d85a62d9d268eefe47bc9 not found: ID does not exist" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.540134 4769 scope.go:117] "RemoveContainer" containerID="832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.547735 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7f5d4bd56d-9n2tk"] Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.556597 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.564303 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.671163 4769 scope.go:117] "RemoveContainer" containerID="832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a" Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.671657 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a\": container with ID starting with 832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a not found: ID does not exist" containerID="832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.671720 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a"} err="failed to get container status \"832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a\": rpc error: code = NotFound desc = could not find container \"832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a\": container with ID starting with 832bc7a64bf254f9561d939b036ba393b3d3381d3ea6ba89c64a035b3dd8a02a not found: ID does not exist" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.671757 4769 scope.go:117] "RemoveContainer" containerID="259aba43b6950c460955890aea38f479d52382b756120c0666d872f19b098bb5" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.728865 4769 scope.go:117] "RemoveContainer" containerID="70c0b5cef16d5d41ee21e47f8165d658e0ebe75099e6efceaf4ab4137ad4fd75" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.776525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:28 crc kubenswrapper[4769]: I1121 12:22:28.776612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.776831 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.776895 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:32.776876804 +0000 UTC m=+1911.477538622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.777406 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: object "openstack-kuttl-tests"/"openstack-cell1-scripts" not registered Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.777449 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:36.777438219 +0000 UTC m=+1915.478100057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : object "openstack-kuttl-tests"/"openstack-cell1-scripts" not registered Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.781670 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.781721 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:36.781709533 +0000 UTC m=+1915.482371351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.879373 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:28 crc kubenswrapper[4769]: E1121 12:22:28.879515 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:22:32.879486337 +0000 UTC m=+1911.580148155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.159761 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.170293 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.286170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-combined-ca-bundle\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.287829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-scripts\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.287870 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-ceilometer-tls-certs\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.287930 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data\") pod \"cd70ab0b-1d92-4c16-9be4-261b4773d364\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.287965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-config-data\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-log-httpd\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288147 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-sg-core-conf-yaml\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288185 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-486t7\" (UniqueName: \"kubernetes.io/projected/cd70ab0b-1d92-4c16-9be4-261b4773d364-kube-api-access-486t7\") pod \"cd70ab0b-1d92-4c16-9be4-261b4773d364\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpxp6\" (UniqueName: \"kubernetes.io/projected/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-kube-api-access-lpxp6\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd70ab0b-1d92-4c16-9be4-261b4773d364-logs\") pod \"cd70ab0b-1d92-4c16-9be4-261b4773d364\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.288935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle\") pod \"cd70ab0b-1d92-4c16-9be4-261b4773d364\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.289440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data-custom\") pod \"cd70ab0b-1d92-4c16-9be4-261b4773d364\" (UID: \"cd70ab0b-1d92-4c16-9be4-261b4773d364\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.289467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-run-httpd\") pod \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\" (UID: \"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.289878 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.290693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.292948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd70ab0b-1d92-4c16-9be4-261b4773d364-logs" (OuterVolumeSpecName: "logs") pod "cd70ab0b-1d92-4c16-9be4-261b4773d364" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.293174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-scripts" (OuterVolumeSpecName: "scripts") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.295931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-kube-api-access-lpxp6" (OuterVolumeSpecName: "kube-api-access-lpxp6") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "kube-api-access-lpxp6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.295962 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016592c0-e31c-48bf-8636-626daf48ad49" path="/var/lib/kubelet/pods/016592c0-e31c-48bf-8636-626daf48ad49/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.297040 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02eacc35-6822-431b-9909-90f9d7a0497c" path="/var/lib/kubelet/pods/02eacc35-6822-431b-9909-90f9d7a0497c/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.297621 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" path="/var/lib/kubelet/pods/0cf573d8-8dea-48c2-8ed6-fb42a68f85b4/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.298268 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cd70ab0b-1d92-4c16-9be4-261b4773d364" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.298526 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21376353-0114-447a-aec5-9d1e773e996f" path="/var/lib/kubelet/pods/21376353-0114-447a-aec5-9d1e773e996f/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.300927 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446d3e05-b6f6-427d-9264-8a6447945da3" path="/var/lib/kubelet/pods/446d3e05-b6f6-427d-9264-8a6447945da3/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.302401 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" path="/var/lib/kubelet/pods/96896fd8-daed-4cfd-93d0-894c2ca63cf8/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.306137 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" path="/var/lib/kubelet/pods/9b970d3d-1a5c-40da-90ff-ddcc991a571d/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.307471 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" path="/var/lib/kubelet/pods/9c849e8b-0572-485c-a8cc-3436a605a5d4/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.307790 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd70ab0b-1d92-4c16-9be4-261b4773d364-kube-api-access-486t7" (OuterVolumeSpecName: "kube-api-access-486t7") pod "cd70ab0b-1d92-4c16-9be4-261b4773d364" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364"). InnerVolumeSpecName "kube-api-access-486t7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.309633 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" path="/var/lib/kubelet/pods/ad94928f-bd00-4e2a-a9a3-8d8a1419bfec/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.310657 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" path="/var/lib/kubelet/pods/b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.311692 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" path="/var/lib/kubelet/pods/b93ccd0d-4d54-491c-985e-6d149616f695/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.313763 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9561d60-3f1b-4a40-b24f-b4dad34f7117" path="/var/lib/kubelet/pods/b9561d60-3f1b-4a40-b24f-b4dad34f7117/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.314460 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" path="/var/lib/kubelet/pods/ba1ff42d-4e97-42a8-9bc1-12490fa969e1/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.315178 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d62c426e-d8cb-4861-8e12-19a15e83948d" path="/var/lib/kubelet/pods/d62c426e-d8cb-4861-8e12-19a15e83948d/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.316383 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d898c08a-4c85-42c8-86f7-43e5fab04611" path="/var/lib/kubelet/pods/d898c08a-4c85-42c8-86f7-43e5fab04611/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.316881 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e47a4c53-835f-4501-9e11-dea59692b355" path="/var/lib/kubelet/pods/e47a4c53-835f-4501-9e11-dea59692b355/volumes" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.322098 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.324452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.329871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd70ab0b-1d92-4c16-9be4-261b4773d364" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.332896 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data" (OuterVolumeSpecName: "config-data") pod "cd70ab0b-1d92-4c16-9be4-261b4773d364" (UID: "cd70ab0b-1d92-4c16-9be4-261b4773d364"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.349344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.377613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.386573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-config-data" (OuterVolumeSpecName: "config-data") pod "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" (UID: "847cfe9b-ba10-412a-ba1d-b3d7d635f6e1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392626 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392685 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-486t7\" (UniqueName: \"kubernetes.io/projected/cd70ab0b-1d92-4c16-9be4-261b4773d364-kube-api-access-486t7\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392705 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lpxp6\" (UniqueName: \"kubernetes.io/projected/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-kube-api-access-lpxp6\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392718 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cd70ab0b-1d92-4c16-9be4-261b4773d364-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392729 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392740 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392752 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392762 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392772 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392783 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392793 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd70ab0b-1d92-4c16-9be4-261b4773d364-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.392803 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.493499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-config-data\") pod \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.493669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-combined-ca-bundle\") pod \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.493698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmr5z\" (UniqueName: \"kubernetes.io/projected/c3fa206e-3155-4767-bab1-fb5fca9d3d06-kube-api-access-xmr5z\") pod \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\" (UID: \"c3fa206e-3155-4767-bab1-fb5fca9d3d06\") " Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.497156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3fa206e-3155-4767-bab1-fb5fca9d3d06-kube-api-access-xmr5z" (OuterVolumeSpecName: "kube-api-access-xmr5z") pod "c3fa206e-3155-4767-bab1-fb5fca9d3d06" (UID: "c3fa206e-3155-4767-bab1-fb5fca9d3d06"). InnerVolumeSpecName "kube-api-access-xmr5z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.499166 4769 generic.go:334] "Generic (PLEG): container finished" podID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerID="2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2" exitCode=0 Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.499256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerDied","Data":"2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2"} Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.499402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"847cfe9b-ba10-412a-ba1d-b3d7d635f6e1","Type":"ContainerDied","Data":"57de27ad1d696e86fb0c2d91ffbb1776fc670e5e8285445b65f4c2fceea87fc2"} Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.499476 4769 scope.go:117] "RemoveContainer" containerID="3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.499804 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.508601 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.509502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"c3fa206e-3155-4767-bab1-fb5fca9d3d06","Type":"ContainerDied","Data":"1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de"} Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.508405 4769 generic.go:334] "Generic (PLEG): container finished" podID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" exitCode=0 Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.510892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"c3fa206e-3155-4767-bab1-fb5fca9d3d06","Type":"ContainerDied","Data":"55a1f9b31c8630efb6f01ee2a8d4b333c2693b17b0a742488455d6285d4ce5b7"} Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.515504 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerID="83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035" exitCode=0 Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.515543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" event={"ID":"cd70ab0b-1d92-4c16-9be4-261b4773d364","Type":"ContainerDied","Data":"83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035"} Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.515570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" event={"ID":"cd70ab0b-1d92-4c16-9be4-261b4773d364","Type":"ContainerDied","Data":"2138b4d20c70aba0d425e809ab0f2ec8dabd64977511c99ccc7953fd42b47bc5"} Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.515651 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.521420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-config-data" (OuterVolumeSpecName: "config-data") pod "c3fa206e-3155-4767-bab1-fb5fca9d3d06" (UID: "c3fa206e-3155-4767-bab1-fb5fca9d3d06"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.547081 4769 scope.go:117] "RemoveContainer" containerID="203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.547424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c3fa206e-3155-4767-bab1-fb5fca9d3d06" (UID: "c3fa206e-3155-4767-bab1-fb5fca9d3d06"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.547451 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.555001 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.559816 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc"] Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.568633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-584c67dfc6-kntvc"] Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.578903 4769 scope.go:117] "RemoveContainer" containerID="2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.595879 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.595912 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xmr5z\" (UniqueName: \"kubernetes.io/projected/c3fa206e-3155-4767-bab1-fb5fca9d3d06-kube-api-access-xmr5z\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.595921 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3fa206e-3155-4767-bab1-fb5fca9d3d06-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.615880 4769 scope.go:117] "RemoveContainer" containerID="4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.651332 4769 scope.go:117] "RemoveContainer" containerID="3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.651991 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247\": container with ID starting with 3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247 not found: ID does not exist" containerID="3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.652044 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247"} err="failed to get container status \"3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247\": rpc error: code = NotFound desc = could not find container \"3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247\": container with ID starting with 3e5c1a07e83f1a09cf860d31b297f8436d8ab24c1a606996beb29cb3a48e0247 not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.652079 4769 scope.go:117] "RemoveContainer" containerID="203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.652589 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3\": container with ID starting with 203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3 not found: ID does not exist" containerID="203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.652648 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3"} err="failed to get container status \"203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3\": rpc error: code = NotFound desc = could not find container \"203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3\": container with ID starting with 203d2b8b9f705d57b52b0f52d9d1aefed4a637b8f4e6d730f3eeda9c7b642ee3 not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.652681 4769 scope.go:117] "RemoveContainer" containerID="2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.653110 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2\": container with ID starting with 2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2 not found: ID does not exist" containerID="2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.653138 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2"} err="failed to get container status \"2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2\": rpc error: code = NotFound desc = could not find container \"2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2\": container with ID starting with 2d690116d339222bc8344a12777e8732495d5a5d0d114c9d25dd16f2778d72e2 not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.653151 4769 scope.go:117] "RemoveContainer" containerID="4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.653689 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c\": container with ID starting with 4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c not found: ID does not exist" containerID="4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.653721 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c"} err="failed to get container status \"4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c\": rpc error: code = NotFound desc = could not find container \"4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c\": container with ID starting with 4ea52bdcb2d5e2bcf03eefb9d3dd91e5b3898de9151ce2faa2f479683dde106c not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.653741 4769 scope.go:117] "RemoveContainer" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.714398 4769 scope.go:117] "RemoveContainer" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.715208 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de\": container with ID starting with 1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de not found: ID does not exist" containerID="1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.715265 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de"} err="failed to get container status \"1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de\": rpc error: code = NotFound desc = could not find container \"1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de\": container with ID starting with 1378033f1ffa904dbe5e4dd20686a6fb0134bd8f204e0096dbddf5a3b35b80de not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.715306 4769 scope.go:117] "RemoveContainer" containerID="83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.745654 4769 scope.go:117] "RemoveContainer" containerID="060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.770742 4769 scope.go:117] "RemoveContainer" containerID="83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.771402 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035\": container with ID starting with 83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035 not found: ID does not exist" containerID="83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.771449 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035"} err="failed to get container status \"83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035\": rpc error: code = NotFound desc = could not find container \"83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035\": container with ID starting with 83e52ae55f3db92868363f2186ef06d1e07990bfe93bdb29027ff1485a359035 not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.771481 4769 scope.go:117] "RemoveContainer" containerID="060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2" Nov 21 12:22:29 crc kubenswrapper[4769]: E1121 12:22:29.772145 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2\": container with ID starting with 060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2 not found: ID does not exist" containerID="060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.772208 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2"} err="failed to get container status \"060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2\": rpc error: code = NotFound desc = could not find container \"060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2\": container with ID starting with 060565a3e721f49a90fad9ed5ed91903ba7f6afb23a2e01022cad78e278d30c2 not found: ID does not exist" Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.888501 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:22:29 crc kubenswrapper[4769]: I1121 12:22:29.894651 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:22:30 crc kubenswrapper[4769]: I1121 12:22:30.274592 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:22:30 crc kubenswrapper[4769]: E1121 12:22:30.274858 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.165493 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.251:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.250471 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.297754 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" path="/var/lib/kubelet/pods/847cfe9b-ba10-412a-ba1d-b3d7d635f6e1/volumes" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.299362 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" path="/var/lib/kubelet/pods/c3fa206e-3155-4767-bab1-fb5fca9d3d06/volumes" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.299997 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" path="/var/lib/kubelet/pods/cd70ab0b-1d92-4c16-9be4-261b4773d364/volumes" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.326796 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz"] Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.327071 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerName="dnsmasq-dns" containerID="cri-o://180a6d631466199ab2b58a28cc270e9c57269f96f796d0877d37ed72c1585af7" gracePeriod=10 Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.547327 4769 generic.go:334] "Generic (PLEG): container finished" podID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerID="180a6d631466199ab2b58a28cc270e9c57269f96f796d0877d37ed72c1585af7" exitCode=0 Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.547367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" event={"ID":"4193f10f-ec9c-4846-bb96-a57ce07e71c0","Type":"ContainerDied","Data":"180a6d631466199ab2b58a28cc270e9c57269f96f796d0877d37ed72c1585af7"} Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.778494 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.856271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dns-swift-storage-0\") pod \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.856357 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c5jz\" (UniqueName: \"kubernetes.io/projected/4193f10f-ec9c-4846-bb96-a57ce07e71c0-kube-api-access-9c5jz\") pod \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.856392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-config\") pod \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.856497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dnsmasq-svc\") pod \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\" (UID: \"4193f10f-ec9c-4846-bb96-a57ce07e71c0\") " Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.864459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4193f10f-ec9c-4846-bb96-a57ce07e71c0-kube-api-access-9c5jz" (OuterVolumeSpecName: "kube-api-access-9c5jz") pod "4193f10f-ec9c-4846-bb96-a57ce07e71c0" (UID: "4193f10f-ec9c-4846-bb96-a57ce07e71c0"). InnerVolumeSpecName "kube-api-access-9c5jz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.892127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "4193f10f-ec9c-4846-bb96-a57ce07e71c0" (UID: "4193f10f-ec9c-4846-bb96-a57ce07e71c0"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.900411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "4193f10f-ec9c-4846-bb96-a57ce07e71c0" (UID: "4193f10f-ec9c-4846-bb96-a57ce07e71c0"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.901631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-config" (OuterVolumeSpecName: "config") pod "4193f10f-ec9c-4846-bb96-a57ce07e71c0" (UID: "4193f10f-ec9c-4846-bb96-a57ce07e71c0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.957453 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9c5jz\" (UniqueName: \"kubernetes.io/projected/4193f10f-ec9c-4846-bb96-a57ce07e71c0-kube-api-access-9c5jz\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.957490 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.957499 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:31 crc kubenswrapper[4769]: I1121 12:22:31.957512 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/4193f10f-ec9c-4846-bb96-a57ce07e71c0-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:32 crc kubenswrapper[4769]: E1121 12:22:32.292886 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-conmon-7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:22:32 crc kubenswrapper[4769]: I1121 12:22:32.562323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" event={"ID":"4193f10f-ec9c-4846-bb96-a57ce07e71c0","Type":"ContainerDied","Data":"dcede680d87e00273e584e6655b2e07ca6ec76c349b241d3d1620d674f1f8c1b"} Nov 21 12:22:32 crc kubenswrapper[4769]: I1121 12:22:32.562779 4769 scope.go:117] "RemoveContainer" containerID="180a6d631466199ab2b58a28cc270e9c57269f96f796d0877d37ed72c1585af7" Nov 21 12:22:32 crc kubenswrapper[4769]: I1121 12:22:32.562970 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz" Nov 21 12:22:32 crc kubenswrapper[4769]: I1121 12:22:32.609112 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz"] Nov 21 12:22:32 crc kubenswrapper[4769]: I1121 12:22:32.614927 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bcdfcd6b5-gn5vz"] Nov 21 12:22:32 crc kubenswrapper[4769]: I1121 12:22:32.615693 4769 scope.go:117] "RemoveContainer" containerID="8b2af33279acf49f2c5a4b6436f91475938e5c13408d2d907cf511bce75c8365" Nov 21 12:22:32 crc kubenswrapper[4769]: E1121 12:22:32.777891 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:32 crc kubenswrapper[4769]: E1121 12:22:32.777997 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:40.777968852 +0000 UTC m=+1919.478630690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:32 crc kubenswrapper[4769]: E1121 12:22:32.980909 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:32 crc kubenswrapper[4769]: E1121 12:22:32.980983 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:22:40.980969248 +0000 UTC m=+1919.681631066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:33 crc kubenswrapper[4769]: I1121 12:22:33.284050 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" path="/var/lib/kubelet/pods/4193f10f-ec9c-4846-bb96-a57ce07e71c0/volumes" Nov 21 12:22:35 crc kubenswrapper[4769]: E1121 12:22:35.322219 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-storage-config-data: configmap "swift-storage-config-data" not found Nov 21 12:22:35 crc kubenswrapper[4769]: E1121 12:22:35.322617 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:35 crc kubenswrapper[4769]: E1121 12:22:35.322633 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:22:35 crc kubenswrapper[4769]: E1121 12:22:35.322653 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:35 crc kubenswrapper[4769]: E1121 12:22:35.322736 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:22:51.322707676 +0000 UTC m=+1930.023369524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:36 crc kubenswrapper[4769]: I1121 12:22:36.845477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:36 crc kubenswrapper[4769]: I1121 12:22:36.845866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:36 crc kubenswrapper[4769]: E1121 12:22:36.845725 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: object "openstack-kuttl-tests"/"openstack-cell1-scripts" not registered Nov 21 12:22:36 crc kubenswrapper[4769]: E1121 12:22:36.846015 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:52.845985345 +0000 UTC m=+1931.546647183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : object "openstack-kuttl-tests"/"openstack-cell1-scripts" not registered Nov 21 12:22:36 crc kubenswrapper[4769]: E1121 12:22:36.849929 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:36 crc kubenswrapper[4769]: E1121 12:22:36.849995 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:52.849979452 +0000 UTC m=+1931.550641290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:36 crc kubenswrapper[4769]: I1121 12:22:36.999401 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.048988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-public-tls-certs\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.049063 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-internal-tls-certs\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.049103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs74w\" (UniqueName: \"kubernetes.io/projected/2e25f734-8e13-4f53-886a-930133a4900e-kube-api-access-vs74w\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.049225 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-ovndb-tls-certs\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.049253 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-httpd-config\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.049289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-combined-ca-bundle\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.049318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-config\") pod \"2e25f734-8e13-4f53-886a-930133a4900e\" (UID: \"2e25f734-8e13-4f53-886a-930133a4900e\") " Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.054943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e25f734-8e13-4f53-886a-930133a4900e-kube-api-access-vs74w" (OuterVolumeSpecName: "kube-api-access-vs74w") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "kube-api-access-vs74w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.059371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.095210 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-config" (OuterVolumeSpecName: "config") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.098039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.103213 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.106217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.112992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "2e25f734-8e13-4f53-886a-930133a4900e" (UID: "2e25f734-8e13-4f53-886a-930133a4900e"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151211 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151406 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vs74w\" (UniqueName: \"kubernetes.io/projected/2e25f734-8e13-4f53-886a-930133a4900e-kube-api-access-vs74w\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151465 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151517 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151568 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151653 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.151739 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e25f734-8e13-4f53-886a-930133a4900e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.618807 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e25f734-8e13-4f53-886a-930133a4900e" containerID="2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181" exitCode=0 Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.618865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" event={"ID":"2e25f734-8e13-4f53-886a-930133a4900e","Type":"ContainerDied","Data":"2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181"} Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.618953 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" event={"ID":"2e25f734-8e13-4f53-886a-930133a4900e","Type":"ContainerDied","Data":"fb3632ce0f1b17d4b74c72db513d6cb4f241c8cd4ba718c23d7369bc1522776f"} Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.618888 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ff7758bd4-wmvql" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.619007 4769 scope.go:117] "RemoveContainer" containerID="58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.643269 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ff7758bd4-wmvql"] Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.650067 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ff7758bd4-wmvql"] Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.660723 4769 scope.go:117] "RemoveContainer" containerID="2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.702569 4769 scope.go:117] "RemoveContainer" containerID="58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7" Nov 21 12:22:37 crc kubenswrapper[4769]: E1121 12:22:37.703142 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7\": container with ID starting with 58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7 not found: ID does not exist" containerID="58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.703258 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7"} err="failed to get container status \"58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7\": rpc error: code = NotFound desc = could not find container \"58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7\": container with ID starting with 58a9439834ab6917a251a0d32f9cf4e8300bcb472df0fb27076b18accea7cff7 not found: ID does not exist" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.703295 4769 scope.go:117] "RemoveContainer" containerID="2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181" Nov 21 12:22:37 crc kubenswrapper[4769]: E1121 12:22:37.703849 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181\": container with ID starting with 2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181 not found: ID does not exist" containerID="2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181" Nov 21 12:22:37 crc kubenswrapper[4769]: I1121 12:22:37.703909 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181"} err="failed to get container status \"2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181\": rpc error: code = NotFound desc = could not find container \"2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181\": container with ID starting with 2a3d417f5a843f8ba3aae2f60f38ac9c84327ff5be4da313178dc649c6192181 not found: ID does not exist" Nov 21 12:22:39 crc kubenswrapper[4769]: I1121 12:22:39.288698 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e25f734-8e13-4f53-886a-930133a4900e" path="/var/lib/kubelet/pods/2e25f734-8e13-4f53-886a-930133a4900e/volumes" Nov 21 12:22:40 crc kubenswrapper[4769]: E1121 12:22:40.811689 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:40 crc kubenswrapper[4769]: E1121 12:22:40.812205 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:22:56.812164796 +0000 UTC m=+1935.512826614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:41 crc kubenswrapper[4769]: E1121 12:22:41.016690 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:41 crc kubenswrapper[4769]: E1121 12:22:41.016824 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:22:57.016796076 +0000 UTC m=+1935.717457894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:42 crc kubenswrapper[4769]: E1121 12:22:42.477260 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5627ee0_e5e4_43e7_8854_a6e90b7d8210.slice/crio-conmon-7efc6646e97be806ab168cbcabe99bdaca832241b0dd5750000b935eedd35053.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:22:44 crc kubenswrapper[4769]: I1121 12:22:44.274297 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:22:44 crc kubenswrapper[4769]: I1121 12:22:44.693964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"853819d0337afdd74f9dccd7824d5874788ad9e7c096f1f20047db41f5e665d1"} Nov 21 12:22:51 crc kubenswrapper[4769]: E1121 12:22:51.407312 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-storage-config-data: configmap "swift-storage-config-data" not found Nov 21 12:22:51 crc kubenswrapper[4769]: E1121 12:22:51.407977 4769 projected.go:263] Couldn't get secret openstack-kuttl-tests/swift-conf: secret "swift-conf" not found Nov 21 12:22:51 crc kubenswrapper[4769]: E1121 12:22:51.407991 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:22:51 crc kubenswrapper[4769]: E1121 12:22:51.408006 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:51 crc kubenswrapper[4769]: E1121 12:22:51.408091 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift podName:1df48a2b-22ba-4736-84a3-9be351bce9d5 nodeName:}" failed. No retries permitted until 2025-11-21 12:23:23.40806783 +0000 UTC m=+1962.108729748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift") pod "swift-storage-0" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5") : [configmap "swift-storage-config-data" not found, secret "swift-conf" not found, configmap "swift-ring-files" not found] Nov 21 12:22:51 crc kubenswrapper[4769]: I1121 12:22:51.785827 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerID="ecac77aced9608a3e0de9db9a8cd73817cce63d849c652425764e04d05c3f16d" exitCode=137 Nov 21 12:22:51 crc kubenswrapper[4769]: I1121 12:22:51.785888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"ecac77aced9608a3e0de9db9a8cd73817cce63d849c652425764e04d05c3f16d"} Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.080075 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.223123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"1df48a2b-22ba-4736-84a3-9be351bce9d5\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.223209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-lock\") pod \"1df48a2b-22ba-4736-84a3-9be351bce9d5\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.223265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") pod \"1df48a2b-22ba-4736-84a3-9be351bce9d5\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.223287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-cache\") pod \"1df48a2b-22ba-4736-84a3-9be351bce9d5\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.224116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-lock" (OuterVolumeSpecName: "lock") pod "1df48a2b-22ba-4736-84a3-9be351bce9d5" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.224180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-cache" (OuterVolumeSpecName: "cache") pod "1df48a2b-22ba-4736-84a3-9be351bce9d5" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.224409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75b5s\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-kube-api-access-75b5s\") pod \"1df48a2b-22ba-4736-84a3-9be351bce9d5\" (UID: \"1df48a2b-22ba-4736-84a3-9be351bce9d5\") " Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.228430 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.228479 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/1df48a2b-22ba-4736-84a3-9be351bce9d5-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.231553 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "swift") pod "1df48a2b-22ba-4736-84a3-9be351bce9d5" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.232860 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-kube-api-access-75b5s" (OuterVolumeSpecName: "kube-api-access-75b5s") pod "1df48a2b-22ba-4736-84a3-9be351bce9d5" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5"). InnerVolumeSpecName "kube-api-access-75b5s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.251424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "1df48a2b-22ba-4736-84a3-9be351bce9d5" (UID: "1df48a2b-22ba-4736-84a3-9be351bce9d5"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.329963 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.330004 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.330015 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75b5s\" (UniqueName: \"kubernetes.io/projected/1df48a2b-22ba-4736-84a3-9be351bce9d5-kube-api-access-75b5s\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.348667 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.430922 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.591670 4769 scope.go:117] "RemoveContainer" containerID="796c9938e272dfa1ad0e8012c80dd458df641b93033d3f332159f1f3980c2792" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.621994 4769 scope.go:117] "RemoveContainer" containerID="c64b750efe1f46566969ada9c8a74f4196860d945c7762428a19b670b2b5ab22" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.661661 4769 scope.go:117] "RemoveContainer" containerID="39455312801fe2617009399cff2130cf65149aad9326305623cf98c6a2b3a752" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.680846 4769 scope.go:117] "RemoveContainer" containerID="7d04a33c5515df3289f8f6e5eddc0c23b7dfac2466f8dc59d4916be90bc70c65" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.721408 4769 scope.go:117] "RemoveContainer" containerID="ac2bffbc71c179a071c576298ebb8e06f11415663fce8e4cbe16de16a4e9665d" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.740354 4769 scope.go:117] "RemoveContainer" containerID="75036f47f265df500dc97655322726e51a94570f3c85731591e2720cade34995" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.762357 4769 scope.go:117] "RemoveContainer" containerID="98d335891fdd26ec2d8bfec8ea788d2fe2ef78a9e4e46f05b40a9393db7ebae3" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.783903 4769 scope.go:117] "RemoveContainer" containerID="b8b1acb6c3837a3eeb08810f5cd171240f04d4f58c7587bda8aac26e5ee43320" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.809119 4769 scope.go:117] "RemoveContainer" containerID="71bd808cf3109c1c57b0c47ebd57d285135d128165fac4321818df4e0501aba3" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.814270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"1df48a2b-22ba-4736-84a3-9be351bce9d5","Type":"ContainerDied","Data":"424ca304aff4684d53245f8fee91d6d96930363681d4be14f452bc5b27fab7c5"} Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.814329 4769 scope.go:117] "RemoveContainer" containerID="ecac77aced9608a3e0de9db9a8cd73817cce63d849c652425764e04d05c3f16d" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.814380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.838467 4769 scope.go:117] "RemoveContainer" containerID="f7d252944da608511b8a454df97267561b5e6a9bdda0ea69140ef1eebb7bda82" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.851567 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.857330 4769 scope.go:117] "RemoveContainer" containerID="f4e30e1beb7fd96db86bab3c05804f9e7284e6f16adb6a463b56d3123607973f" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.859077 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.874337 4769 scope.go:117] "RemoveContainer" containerID="bb886765c75dd9fc578ff60a2d8b798cf9f7750dff79b940b8b756cb6765a457" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.891598 4769 scope.go:117] "RemoveContainer" containerID="d8da63893abbdb88dec1ceb878bd18456a301dce36ff6bcf7fcfe38decb9d82d" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.914326 4769 scope.go:117] "RemoveContainer" containerID="c272862294199cd29cdf62a47209a77ebe6a30aca36021b88785518fc4e932f6" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.938594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.938667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") pod \"novacell1f8ac-account-delete-hbvxt\" (UID: \"0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b\") " pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:52 crc kubenswrapper[4769]: E1121 12:22:52.938745 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: object "openstack-kuttl-tests"/"openstack-cell1-scripts" not registered Nov 21 12:22:52 crc kubenswrapper[4769]: E1121 12:22:52.938822 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:23:24.938803529 +0000 UTC m=+1963.639465347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : object "openstack-kuttl-tests"/"openstack-cell1-scripts" not registered Nov 21 12:22:52 crc kubenswrapper[4769]: E1121 12:22:52.942258 4769 projected.go:194] Error preparing data for projected volume kube-api-access-gs6zm for pod openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:52 crc kubenswrapper[4769]: E1121 12:22:52.942331 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm podName:0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b nodeName:}" failed. No retries permitted until 2025-11-21 12:23:24.942311033 +0000 UTC m=+1963.642972861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gs6zm" (UniqueName: "kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm") pod "novacell1f8ac-account-delete-hbvxt" (UID: "0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.947383 4769 scope.go:117] "RemoveContainer" containerID="5eede93a540279c052a1922a202f61501b5cec8c65a7c89d9b9d2db329d15261" Nov 21 12:22:52 crc kubenswrapper[4769]: I1121 12:22:52.960869 4769 scope.go:117] "RemoveContainer" containerID="a2645245eb3ee3eebdf7c967d355d80fe90f95b6d3b5e5b4e4c366cab3e140c3" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.001598 4769 scope.go:117] "RemoveContainer" containerID="f563c0f22238d0ee0274d9de621c34f501fd39ad769a229da702df5ecf1587ea" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.019850 4769 scope.go:117] "RemoveContainer" containerID="7e98f346bb842a6f0f7f90daa9c76e61f76f39534b58a4f0ca82d3c41ed0261c" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.067148 4769 scope.go:117] "RemoveContainer" containerID="5274219d9fb6a2953704b2da6dd99ff55aaacf5afb220cd87b4549fbb1b4d616" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.105610 4769 scope.go:117] "RemoveContainer" containerID="c9a62102a031512e453dd37916c42559e1c19f7d2a47f895b95cf9ec268b4cd2" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.226472 4769 scope.go:117] "RemoveContainer" containerID="60cf880275322a5210f7546ddc7c4437085cbe3c435c5a4a64604849cd6e31e2" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.287593 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" path="/var/lib/kubelet/pods/1df48a2b-22ba-4736-84a3-9be351bce9d5/volumes" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.299864 4769 scope.go:117] "RemoveContainer" containerID="545fd17bf1a594b6b79ab5b3c3c474bce9e4a4cdfb1fb3d71d6e809e2321c568" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.336738 4769 scope.go:117] "RemoveContainer" containerID="5ae112626165051404b6c4d21af9ea913b45e0e07640786a82353a9092217ccb" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.473397 4769 scope.go:117] "RemoveContainer" containerID="380de022fa6897bb49e2b90851a7d26533d4a8796f267d2ebda1b29f716f0754" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.503362 4769 scope.go:117] "RemoveContainer" containerID="f7c98e6ded540db99d1ae274c234ad623eb1d8af56a779214208e374efcc049e" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.553903 4769 scope.go:117] "RemoveContainer" containerID="949ac7e464eca74f7851c055b756f3e7f8553e0c1d049cd1fb2b1a918486ac97" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.610569 4769 scope.go:117] "RemoveContainer" containerID="1951f2f612d8624661ffb990eb8bdae5620b480f2f298bb3531bb95185fb7460" Nov 21 12:22:53 crc kubenswrapper[4769]: I1121 12:22:53.636842 4769 scope.go:117] "RemoveContainer" containerID="1b47402cd4ebcb79ce4f4e3319bf1b549c86d5ae0d483da01038614d771b5d7e" Nov 21 12:22:54 crc kubenswrapper[4769]: I1121 12:22:54.036582 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7b4fa6a1_8bf4_49b1_b700_1eb9d4b67eef.slice" Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.527004 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod0e48a830_8ec4_4dbf_87d7_f8f4f70ca02b.slice" Nov 21 12:22:55 crc kubenswrapper[4769]: E1121 12:22:55.527631 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod0e48a830_8ec4_4dbf_87d7_f8f4f70ca02b.slice" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" podUID="0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b" Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.606887 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod5121d00c-030e-40f1-8e18-f0c07e63f00d"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod5121d00c-030e-40f1-8e18-f0c07e63f00d] : Timed out while waiting for systemd to remove kubepods-besteffort-pod5121d00c_030e_40f1_8e18_f0c07e63f00d.slice" Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.669580 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod7b9329ea-65e5-4fff-978b-4cf7d1d1f68a"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod7b9329ea-65e5-4fff-978b-4cf7d1d1f68a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7b9329ea_65e5_4fff_978b_4cf7d1d1f68a.slice" Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.847275 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt" Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.883268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt"] Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.890071 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell1f8ac-account-delete-hbvxt"] Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.987974 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:55 crc kubenswrapper[4769]: I1121 12:22:55.988006 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gs6zm\" (UniqueName: \"kubernetes.io/projected/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b-kube-api-access-gs6zm\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:56 crc kubenswrapper[4769]: E1121 12:22:56.906414 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:56 crc kubenswrapper[4769]: E1121 12:22:56.906529 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts podName:23a3ecd4-5133-4225-ac3b-a5914cacc71b nodeName:}" failed. No retries permitted until 2025-11-21 12:23:28.906506161 +0000 UTC m=+1967.607167979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts") pod "novaapi0895-account-delete-4v9rc" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b") : configmap "openstack-scripts" not found Nov 21 12:22:57 crc kubenswrapper[4769]: E1121 12:22:57.109734 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:22:57 crc kubenswrapper[4769]: E1121 12:22:57.109820 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts podName:caa9c968-8235-4441-b6fa-54a6ab4298ca nodeName:}" failed. No retries permitted until 2025-11-21 12:23:29.109801376 +0000 UTC m=+1967.810463204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts") pod "novacell08ae7-account-delete-g2q5c" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca") : configmap "openstack-scripts" not found Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.287442 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b" path="/var/lib/kubelet/pods/0e48a830-8ec4-4dbf-87d7-f8f4f70ca02b/volumes" Nov 21 12:22:57 crc kubenswrapper[4769]: E1121 12:22:57.747911 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a3ecd4_5133_4225_ac3b_a5914cacc71b.slice/crio-conmon-4492d3ff34f99cdbaa9ca423b4c8781cec9ea9218d5adfd7e8669c7d8c78331a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaa9c968_8235_4441_b6fa_54a6ab4298ca.slice/crio-conmon-e9d461f06f79acc19dadb1308feb91194931d0c687f46ce1d5c230baecc8bdf0.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.866575 4769 generic.go:334] "Generic (PLEG): container finished" podID="23a3ecd4-5133-4225-ac3b-a5914cacc71b" containerID="4492d3ff34f99cdbaa9ca423b4c8781cec9ea9218d5adfd7e8669c7d8c78331a" exitCode=137 Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.866686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" event={"ID":"23a3ecd4-5133-4225-ac3b-a5914cacc71b","Type":"ContainerDied","Data":"4492d3ff34f99cdbaa9ca423b4c8781cec9ea9218d5adfd7e8669c7d8c78331a"} Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.866762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" event={"ID":"23a3ecd4-5133-4225-ac3b-a5914cacc71b","Type":"ContainerDied","Data":"030cbd85f25edf0e284cfbdada1912b55b08f50364b71eb643c896e01d398781"} Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.866779 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="030cbd85f25edf0e284cfbdada1912b55b08f50364b71eb643c896e01d398781" Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.868948 4769 generic.go:334] "Generic (PLEG): container finished" podID="caa9c968-8235-4441-b6fa-54a6ab4298ca" containerID="e9d461f06f79acc19dadb1308feb91194931d0c687f46ce1d5c230baecc8bdf0" exitCode=137 Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.869017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" event={"ID":"caa9c968-8235-4441-b6fa-54a6ab4298ca","Type":"ContainerDied","Data":"e9d461f06f79acc19dadb1308feb91194931d0c687f46ce1d5c230baecc8bdf0"} Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.869059 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" event={"ID":"caa9c968-8235-4441-b6fa-54a6ab4298ca","Type":"ContainerDied","Data":"d90c64c8e87a595c39219009275261687e321d237062d1b750443dddd661b463"} Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.869079 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d90c64c8e87a595c39219009275261687e321d237062d1b750443dddd661b463" Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.906712 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:57 crc kubenswrapper[4769]: I1121 12:22:57.929751 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.024170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r89c\" (UniqueName: \"kubernetes.io/projected/23a3ecd4-5133-4225-ac3b-a5914cacc71b-kube-api-access-5r89c\") pod \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.024347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts\") pod \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\" (UID: \"23a3ecd4-5133-4225-ac3b-a5914cacc71b\") " Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.024487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs88v\" (UniqueName: \"kubernetes.io/projected/caa9c968-8235-4441-b6fa-54a6ab4298ca-kube-api-access-gs88v\") pod \"caa9c968-8235-4441-b6fa-54a6ab4298ca\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.024516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts\") pod \"caa9c968-8235-4441-b6fa-54a6ab4298ca\" (UID: \"caa9c968-8235-4441-b6fa-54a6ab4298ca\") " Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.025524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "23a3ecd4-5133-4225-ac3b-a5914cacc71b" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.025535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "caa9c968-8235-4441-b6fa-54a6ab4298ca" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.029972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a3ecd4-5133-4225-ac3b-a5914cacc71b-kube-api-access-5r89c" (OuterVolumeSpecName: "kube-api-access-5r89c") pod "23a3ecd4-5133-4225-ac3b-a5914cacc71b" (UID: "23a3ecd4-5133-4225-ac3b-a5914cacc71b"). InnerVolumeSpecName "kube-api-access-5r89c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.030115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa9c968-8235-4441-b6fa-54a6ab4298ca-kube-api-access-gs88v" (OuterVolumeSpecName: "kube-api-access-gs88v") pod "caa9c968-8235-4441-b6fa-54a6ab4298ca" (UID: "caa9c968-8235-4441-b6fa-54a6ab4298ca"). InnerVolumeSpecName "kube-api-access-gs88v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.126046 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gs88v\" (UniqueName: \"kubernetes.io/projected/caa9c968-8235-4441-b6fa-54a6ab4298ca-kube-api-access-gs88v\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.126085 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/caa9c968-8235-4441-b6fa-54a6ab4298ca-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.126094 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5r89c\" (UniqueName: \"kubernetes.io/projected/23a3ecd4-5133-4225-ac3b-a5914cacc71b-kube-api-access-5r89c\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.126106 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/23a3ecd4-5133-4225-ac3b-a5914cacc71b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.879505 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.879572 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi0895-account-delete-4v9rc" Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.929415 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c"] Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.939948 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell08ae7-account-delete-g2q5c"] Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.945808 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi0895-account-delete-4v9rc"] Nov 21 12:22:58 crc kubenswrapper[4769]: I1121 12:22:58.950385 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi0895-account-delete-4v9rc"] Nov 21 12:22:59 crc kubenswrapper[4769]: I1121 12:22:59.287372 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a3ecd4-5133-4225-ac3b-a5914cacc71b" path="/var/lib/kubelet/pods/23a3ecd4-5133-4225-ac3b-a5914cacc71b/volumes" Nov 21 12:22:59 crc kubenswrapper[4769]: I1121 12:22:59.288499 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caa9c968-8235-4441-b6fa-54a6ab4298ca" path="/var/lib/kubelet/pods/caa9c968-8235-4441-b6fa-54a6ab4298ca/volumes" Nov 21 12:23:03 crc kubenswrapper[4769]: I1121 12:23:03.902488 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-llx8x"] Nov 21 12:23:03 crc kubenswrapper[4769]: I1121 12:23:03.909420 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-llx8x"] Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032324 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-db2rd"] Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032642 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032663 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032679 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-updater" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032686 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-updater" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032695 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032722 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-updater" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-updater" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032745 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032753 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032763 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032771 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032784 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="ovsdbserver-nb" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032792 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="ovsdbserver-nb" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032799 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-metadata" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032808 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-metadata" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032820 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032829 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032843 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="rabbitmq" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032850 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="rabbitmq" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032861 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="proxy-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032868 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="proxy-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032878 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5121d00c-030e-40f1-8e18-f0c07e63f00d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032886 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5121d00c-030e-40f1-8e18-f0c07e63f00d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="378706f5-ebf7-4c4f-8508-1c704af035c7" containerName="kube-state-metrics" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="378706f5-ebf7-4c4f-8508-1c704af035c7" containerName="kube-state-metrics" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032916 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="probe" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032924 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="probe" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032940 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="setup-container" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032947 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="setup-container" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032955 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032963 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032976 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" containerName="nova-cell1-conductor-conductor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.032985 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" containerName="nova-cell1-conductor-conductor" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.032995 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033004 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033018 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="cinder-scheduler" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033025 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="cinder-scheduler" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033042 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-central-agent" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033051 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-central-agent" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033059 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033080 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033088 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033104 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerName="init" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033112 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerName="init" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033124 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="ovsdbserver-sb" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033131 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="ovsdbserver-sb" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033146 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d62c426e-d8cb-4861-8e12-19a15e83948d" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033153 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62c426e-d8cb-4861-8e12-19a15e83948d" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033175 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033209 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033217 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033230 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="446d3e05-b6f6-427d-9264-8a6447945da3" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033239 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="446d3e05-b6f6-427d-9264-8a6447945da3" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033248 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033256 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-server" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033272 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033280 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033291 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033300 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033312 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b9561d60-3f1b-4a40-b24f-b4dad34f7117" containerName="keystone-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033320 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9561d60-3f1b-4a40-b24f-b4dad34f7117" containerName="keystone-api" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033328 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033335 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033351 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerName="mysql-bootstrap" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033360 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerName="mysql-bootstrap" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033369 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033378 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033388 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033395 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033407 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033414 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033428 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033436 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033447 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02eacc35-6822-431b-9909-90f9d7a0497c" containerName="nova-scheduler-scheduler" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033454 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02eacc35-6822-431b-9909-90f9d7a0497c" containerName="nova-scheduler-scheduler" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033471 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033483 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033499 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033505 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-server" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033517 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="rabbitmq" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033524 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="rabbitmq" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033533 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="swift-recon-cron" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033539 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="swift-recon-cron" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033547 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerName="galera" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerName="galera" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033587 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033595 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-server" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033605 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033613 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-api" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033623 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e47a4c53-835f-4501-9e11-dea59692b355" containerName="nova-cell0-conductor-conductor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033630 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e47a4c53-835f-4501-9e11-dea59692b355" containerName="nova-cell0-conductor-conductor" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033638 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="ovn-northd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033646 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="ovn-northd" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033660 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerName="dnsmasq-dns" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033668 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerName="dnsmasq-dns" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033683 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033691 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033701 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033709 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033721 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033729 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033739 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033747 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-api" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033759 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033766 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033819 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033828 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033837 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="rsync" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="rsync" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033855 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033862 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-server" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033875 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d898c08a-4c85-42c8-86f7-43e5fab04611" containerName="memcached" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033882 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d898c08a-4c85-42c8-86f7-43e5fab04611" containerName="memcached" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033893 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-reaper" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033900 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-reaper" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033910 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-expirer" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033917 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-expirer" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="016592c0-e31c-48bf-8636-626daf48ad49" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033933 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="016592c0-e31c-48bf-8636-626daf48ad49" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033946 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033953 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-api" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033967 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23a3ecd4-5133-4225-ac3b-a5914cacc71b" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033976 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a3ecd4-5133-4225-ac3b-a5914cacc71b" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.033991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerName="galera" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.033997 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerName="galera" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034008 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034016 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034026 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="caa9c968-8235-4441-b6fa-54a6ab4298ca" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034033 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa9c968-8235-4441-b6fa-54a6ab4298ca" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034041 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerName="mysql-bootstrap" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034047 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerName="mysql-bootstrap" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034059 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21376353-0114-447a-aec5-9d1e773e996f" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034066 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21376353-0114-447a-aec5-9d1e773e996f" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034074 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-notification-agent" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034081 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-notification-agent" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034092 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="setup-container" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034099 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="setup-container" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034108 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-log" Nov 21 12:23:04 crc kubenswrapper[4769]: E1121 12:23:04.034129 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="sg-core" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="sg-core" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034328 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ba1ff42d-4e97-42a8-9bc1-12490fa969e1" containerName="galera" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034343 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="swift-recon-cron" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034361 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="rsync" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034379 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="ovn-northd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034392 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034417 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034427 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad94928f-bd00-4e2a-a9a3-8d8a1419bfec" containerName="rabbitmq" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034439 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="378706f5-ebf7-4c4f-8508-1c704af035c7" containerName="kube-state-metrics" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034449 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b970d3d-1a5c-40da-90ff-ddcc991a571d" containerName="rabbitmq" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034462 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034471 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e84ae61-76e9-4820-a40f-9dc2ca2aad50" containerName="galera" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034481 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="02eacc35-6822-431b-9909-90f9d7a0497c" containerName="nova-scheduler-scheduler" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034496 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034509 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034520 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="proxy-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034530 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034543 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e47a4c53-835f-4501-9e11-dea59692b355" containerName="nova-cell0-conductor-conductor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034555 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-reaper" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034569 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-updater" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034580 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034593 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034605 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1905ef09-f68a-4eaa-bdc4-19aa620bc07b" containerName="barbican-worker" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034617 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034631 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034639 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5121d00c-030e-40f1-8e18-f0c07e63f00d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034650 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="876a68ab-e7c7-4b51-bc47-db7d9eb86e3b" containerName="glance-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034673 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034680 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd70ab0b-1d92-4c16-9be4-261b4773d364" containerName="barbican-keystone-listener" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034688 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034700 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034720 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="sg-core" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034735 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e5e3a8d-c0e0-48b6-8f36-12af17c8dd1d" containerName="ovsdbserver-sb" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034743 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-central-agent" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034756 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-expirer" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b4fa6a1-8bf4-49b1-b700-1eb9d4b67eef" containerName="ovsdbserver-nb" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034780 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="446d3e05-b6f6-427d-9264-8a6447945da3" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034788 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034796 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034803 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b93ccd0d-4d54-491c-985e-6d149616f695" containerName="barbican-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034812 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-replicator" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034824 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d62c426e-d8cb-4861-8e12-19a15e83948d" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034833 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e25f734-8e13-4f53-886a-930133a4900e" containerName="neutron-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034841 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="caa9c968-8235-4441-b6fa-54a6ab4298ca" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034851 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034860 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96896fd8-daed-4cfd-93d0-894c2ca63cf8" containerName="cinder-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034869 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c3fa206e-3155-4767-bab1-fb5fca9d3d06" containerName="nova-cell1-conductor-conductor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034877 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23a3ecd4-5133-4225-ac3b-a5914cacc71b" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="container-updater" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034899 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="cinder-scheduler" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b7f8c1f5-4401-4da0-b3d2-f233b17b8d0a" containerName="nova-api-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034918 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="56f4acf6-717c-423f-b338-bc1344ce9d0b" containerName="openstack-network-exporter" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034926 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="object-auditor" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034937 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d201fa7e-e3af-41a6-909e-2746298322c6" containerName="glance-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034949 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df48a2b-22ba-4736-84a3-9be351bce9d5" containerName="account-server" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034957 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c849e8b-0572-485c-a8cc-3436a605a5d4" containerName="nova-metadata-metadata" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034968 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d898c08a-4c85-42c8-86f7-43e5fab04611" containerName="memcached" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034979 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b9329ea-65e5-4fff-978b-4cf7d1d1f68a" containerName="proxy-httpd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034991 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-log" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.034999 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="847cfe9b-ba10-412a-ba1d-b3d7d635f6e1" containerName="ceilometer-notification-agent" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035010 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8afd06f7-779e-4ef5-a411-a00c1a15d5c3" containerName="probe" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035023 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e065f3e6-390d-4bdc-98eb-d2efc6fabecf" containerName="placement-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035032 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b9561d60-3f1b-4a40-b24f-b4dad34f7117" containerName="keystone-api" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035042 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="016592c0-e31c-48bf-8636-626daf48ad49" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035051 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4193f10f-ec9c-4846-bb96-a57ce07e71c0" containerName="dnsmasq-dns" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cf573d8-8dea-48c2-8ed6-fb42a68f85b4" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035070 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21376353-0114-447a-aec5-9d1e773e996f" containerName="mariadb-account-delete" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.035674 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.037404 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.037661 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.037783 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.038413 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.046463 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-db2rd"] Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.114575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2195413-7f41-4542-b7f4-f3dc2218af53-node-mnt\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.114634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8sn8\" (UniqueName: \"kubernetes.io/projected/c2195413-7f41-4542-b7f4-f3dc2218af53-kube-api-access-c8sn8\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.114660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2195413-7f41-4542-b7f4-f3dc2218af53-crc-storage\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.215573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2195413-7f41-4542-b7f4-f3dc2218af53-node-mnt\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.215633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c8sn8\" (UniqueName: \"kubernetes.io/projected/c2195413-7f41-4542-b7f4-f3dc2218af53-kube-api-access-c8sn8\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.215656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2195413-7f41-4542-b7f4-f3dc2218af53-crc-storage\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.216159 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2195413-7f41-4542-b7f4-f3dc2218af53-node-mnt\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.216426 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2195413-7f41-4542-b7f4-f3dc2218af53-crc-storage\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.236095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8sn8\" (UniqueName: \"kubernetes.io/projected/c2195413-7f41-4542-b7f4-f3dc2218af53-kube-api-access-c8sn8\") pod \"crc-storage-crc-db2rd\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.354321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.775515 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-db2rd"] Nov 21 12:23:04 crc kubenswrapper[4769]: I1121 12:23:04.936085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-db2rd" event={"ID":"c2195413-7f41-4542-b7f4-f3dc2218af53","Type":"ContainerStarted","Data":"bc1fe8c81685b71a44520336cee19cda539f747dbee3b703f97edb8546cb6828"} Nov 21 12:23:05 crc kubenswrapper[4769]: I1121 12:23:05.284493 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ced98bb-10b9-46dc-b611-cd9ead5d2018" path="/var/lib/kubelet/pods/1ced98bb-10b9-46dc-b611-cd9ead5d2018/volumes" Nov 21 12:23:06 crc kubenswrapper[4769]: I1121 12:23:06.994709 4769 generic.go:334] "Generic (PLEG): container finished" podID="c2195413-7f41-4542-b7f4-f3dc2218af53" containerID="7fa4332306cd863a718d5e7e56a9e119f8cd45de81e64acaeaf6edf201f99341" exitCode=0 Nov 21 12:23:06 crc kubenswrapper[4769]: I1121 12:23:06.994904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-db2rd" event={"ID":"c2195413-7f41-4542-b7f4-f3dc2218af53","Type":"ContainerDied","Data":"7fa4332306cd863a718d5e7e56a9e119f8cd45de81e64acaeaf6edf201f99341"} Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.310311 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.380408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2195413-7f41-4542-b7f4-f3dc2218af53-crc-storage\") pod \"c2195413-7f41-4542-b7f4-f3dc2218af53\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.380493 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8sn8\" (UniqueName: \"kubernetes.io/projected/c2195413-7f41-4542-b7f4-f3dc2218af53-kube-api-access-c8sn8\") pod \"c2195413-7f41-4542-b7f4-f3dc2218af53\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.381839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2195413-7f41-4542-b7f4-f3dc2218af53-node-mnt\") pod \"c2195413-7f41-4542-b7f4-f3dc2218af53\" (UID: \"c2195413-7f41-4542-b7f4-f3dc2218af53\") " Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.381961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c2195413-7f41-4542-b7f4-f3dc2218af53-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "c2195413-7f41-4542-b7f4-f3dc2218af53" (UID: "c2195413-7f41-4542-b7f4-f3dc2218af53"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.382757 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2195413-7f41-4542-b7f4-f3dc2218af53-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.386493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2195413-7f41-4542-b7f4-f3dc2218af53-kube-api-access-c8sn8" (OuterVolumeSpecName: "kube-api-access-c8sn8") pod "c2195413-7f41-4542-b7f4-f3dc2218af53" (UID: "c2195413-7f41-4542-b7f4-f3dc2218af53"). InnerVolumeSpecName "kube-api-access-c8sn8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.399815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2195413-7f41-4542-b7f4-f3dc2218af53-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "c2195413-7f41-4542-b7f4-f3dc2218af53" (UID: "c2195413-7f41-4542-b7f4-f3dc2218af53"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.484860 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c8sn8\" (UniqueName: \"kubernetes.io/projected/c2195413-7f41-4542-b7f4-f3dc2218af53-kube-api-access-c8sn8\") on node \"crc\" DevicePath \"\"" Nov 21 12:23:08 crc kubenswrapper[4769]: I1121 12:23:08.484926 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2195413-7f41-4542-b7f4-f3dc2218af53-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:23:09 crc kubenswrapper[4769]: I1121 12:23:09.016542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-db2rd" event={"ID":"c2195413-7f41-4542-b7f4-f3dc2218af53","Type":"ContainerDied","Data":"bc1fe8c81685b71a44520336cee19cda539f747dbee3b703f97edb8546cb6828"} Nov 21 12:23:09 crc kubenswrapper[4769]: I1121 12:23:09.016593 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc1fe8c81685b71a44520336cee19cda539f747dbee3b703f97edb8546cb6828" Nov 21 12:23:09 crc kubenswrapper[4769]: I1121 12:23:09.016638 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-db2rd" Nov 21 12:23:11 crc kubenswrapper[4769]: I1121 12:23:11.905261 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-db2rd"] Nov 21 12:23:11 crc kubenswrapper[4769]: I1121 12:23:11.913558 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-db2rd"] Nov 21 12:23:11 crc kubenswrapper[4769]: I1121 12:23:11.997264 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-fnmvc"] Nov 21 12:23:11 crc kubenswrapper[4769]: E1121 12:23:11.997568 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c2195413-7f41-4542-b7f4-f3dc2218af53" containerName="storage" Nov 21 12:23:11 crc kubenswrapper[4769]: I1121 12:23:11.997582 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2195413-7f41-4542-b7f4-f3dc2218af53" containerName="storage" Nov 21 12:23:11 crc kubenswrapper[4769]: I1121 12:23:11.997714 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c2195413-7f41-4542-b7f4-f3dc2218af53" containerName="storage" Nov 21 12:23:11 crc kubenswrapper[4769]: I1121 12:23:11.998234 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.000985 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.001535 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.002672 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.002791 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.011984 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-fnmvc"] Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.043034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e11211dd-4bf3-4690-a21e-dc1aaac2b805-node-mnt\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.043213 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6std5\" (UniqueName: \"kubernetes.io/projected/e11211dd-4bf3-4690-a21e-dc1aaac2b805-kube-api-access-6std5\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.043272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e11211dd-4bf3-4690-a21e-dc1aaac2b805-crc-storage\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.144329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e11211dd-4bf3-4690-a21e-dc1aaac2b805-node-mnt\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.144428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6std5\" (UniqueName: \"kubernetes.io/projected/e11211dd-4bf3-4690-a21e-dc1aaac2b805-kube-api-access-6std5\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.144458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e11211dd-4bf3-4690-a21e-dc1aaac2b805-crc-storage\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.144707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e11211dd-4bf3-4690-a21e-dc1aaac2b805-node-mnt\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.145167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e11211dd-4bf3-4690-a21e-dc1aaac2b805-crc-storage\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.164725 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6std5\" (UniqueName: \"kubernetes.io/projected/e11211dd-4bf3-4690-a21e-dc1aaac2b805-kube-api-access-6std5\") pod \"crc-storage-crc-fnmvc\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.323089 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:12 crc kubenswrapper[4769]: I1121 12:23:12.782148 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-fnmvc"] Nov 21 12:23:13 crc kubenswrapper[4769]: I1121 12:23:13.070002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fnmvc" event={"ID":"e11211dd-4bf3-4690-a21e-dc1aaac2b805","Type":"ContainerStarted","Data":"bb8b84cb9b1743942d0699328fab872823a3f7ddae334a7c3e721be84ca95031"} Nov 21 12:23:13 crc kubenswrapper[4769]: I1121 12:23:13.288331 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2195413-7f41-4542-b7f4-f3dc2218af53" path="/var/lib/kubelet/pods/c2195413-7f41-4542-b7f4-f3dc2218af53/volumes" Nov 21 12:23:14 crc kubenswrapper[4769]: I1121 12:23:14.083291 4769 generic.go:334] "Generic (PLEG): container finished" podID="e11211dd-4bf3-4690-a21e-dc1aaac2b805" containerID="799515d1c89fa28dc5f749c4acec8b36263777c1533a880c94ccdcbad9b6fc3f" exitCode=0 Nov 21 12:23:14 crc kubenswrapper[4769]: I1121 12:23:14.083354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fnmvc" event={"ID":"e11211dd-4bf3-4690-a21e-dc1aaac2b805","Type":"ContainerDied","Data":"799515d1c89fa28dc5f749c4acec8b36263777c1533a880c94ccdcbad9b6fc3f"} Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.397018 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.508514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e11211dd-4bf3-4690-a21e-dc1aaac2b805-crc-storage\") pod \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.508811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e11211dd-4bf3-4690-a21e-dc1aaac2b805-node-mnt\") pod \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.508861 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6std5\" (UniqueName: \"kubernetes.io/projected/e11211dd-4bf3-4690-a21e-dc1aaac2b805-kube-api-access-6std5\") pod \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\" (UID: \"e11211dd-4bf3-4690-a21e-dc1aaac2b805\") " Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.509007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e11211dd-4bf3-4690-a21e-dc1aaac2b805-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "e11211dd-4bf3-4690-a21e-dc1aaac2b805" (UID: "e11211dd-4bf3-4690-a21e-dc1aaac2b805"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.509237 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e11211dd-4bf3-4690-a21e-dc1aaac2b805-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.514949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e11211dd-4bf3-4690-a21e-dc1aaac2b805-kube-api-access-6std5" (OuterVolumeSpecName: "kube-api-access-6std5") pod "e11211dd-4bf3-4690-a21e-dc1aaac2b805" (UID: "e11211dd-4bf3-4690-a21e-dc1aaac2b805"). InnerVolumeSpecName "kube-api-access-6std5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.528882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e11211dd-4bf3-4690-a21e-dc1aaac2b805-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "e11211dd-4bf3-4690-a21e-dc1aaac2b805" (UID: "e11211dd-4bf3-4690-a21e-dc1aaac2b805"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.610674 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e11211dd-4bf3-4690-a21e-dc1aaac2b805-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:23:15 crc kubenswrapper[4769]: I1121 12:23:15.612176 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6std5\" (UniqueName: \"kubernetes.io/projected/e11211dd-4bf3-4690-a21e-dc1aaac2b805-kube-api-access-6std5\") on node \"crc\" DevicePath \"\"" Nov 21 12:23:16 crc kubenswrapper[4769]: I1121 12:23:16.123531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fnmvc" event={"ID":"e11211dd-4bf3-4690-a21e-dc1aaac2b805","Type":"ContainerDied","Data":"bb8b84cb9b1743942d0699328fab872823a3f7ddae334a7c3e721be84ca95031"} Nov 21 12:23:16 crc kubenswrapper[4769]: I1121 12:23:16.123609 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb8b84cb9b1743942d0699328fab872823a3f7ddae334a7c3e721be84ca95031" Nov 21 12:23:16 crc kubenswrapper[4769]: I1121 12:23:16.123656 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fnmvc" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.744129 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:23:28 crc kubenswrapper[4769]: E1121 12:23:28.745532 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e11211dd-4bf3-4690-a21e-dc1aaac2b805" containerName="storage" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.745550 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11211dd-4bf3-4690-a21e-dc1aaac2b805" containerName="storage" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.745744 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e11211dd-4bf3-4690-a21e-dc1aaac2b805" containerName="storage" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.746714 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.752903 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.752949 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.752961 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.753024 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.753332 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.753388 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-xtwq5" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.753519 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.774872 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926266 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x84jx\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-kube-api-access-x84jx\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7313da1b-b474-474a-acc2-51ee39d5d79b-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7313da1b-b474-474a-acc2-51ee39d5d79b-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-server-conf\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.926953 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:28 crc kubenswrapper[4769]: I1121 12:23:28.927004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031574 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x84jx\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-kube-api-access-x84jx\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031637 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031684 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7313da1b-b474-474a-acc2-51ee39d5d79b-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7313da1b-b474-474a-acc2-51ee39d5d79b-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-server-conf\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.031913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.032874 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.033334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.033380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.033653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.033978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-server-conf\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.034447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.040546 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.041278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.041423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7313da1b-b474-474a-acc2-51ee39d5d79b-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.045021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7313da1b-b474-474a-acc2-51ee39d5d79b-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.056457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x84jx\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-kube-api-access-x84jx\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.057597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.075547 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.106690 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.108748 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.111381 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.111621 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-jvtvk" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.112125 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.112333 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.112500 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.113019 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:23:29 crc kubenswrapper[4769]: I1121 12:23:29.113572 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.070611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071236 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr8w2\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-kube-api-access-cr8w2\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.071613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.116658 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cr8w2\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-kube-api-access-cr8w2\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.173520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.182285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.183173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.184119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.184422 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.182670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.185277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.200442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.205218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.210465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.213496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr8w2\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-kube-api-access-cr8w2\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.221059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.231874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.383885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.525300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:23:30 crc kubenswrapper[4769]: I1121 12:23:30.714627 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:23:30 crc kubenswrapper[4769]: W1121 12:23:30.717369 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fda5b9_ebf3_44fc_8f08_9aaf6e0a8301.slice/crio-abe1448282763458b0304fab94397bd095ba24cd0694316a2389f2fd9f143384 WatchSource:0}: Error finding container abe1448282763458b0304fab94397bd095ba24cd0694316a2389f2fd9f143384: Status 404 returned error can't find the container with id abe1448282763458b0304fab94397bd095ba24cd0694316a2389f2fd9f143384 Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.140932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301","Type":"ContainerStarted","Data":"abe1448282763458b0304fab94397bd095ba24cd0694316a2389f2fd9f143384"} Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.141880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7313da1b-b474-474a-acc2-51ee39d5d79b","Type":"ContainerStarted","Data":"ed5d30d14bb4cfd97bb983cbf46ad1b7ac16a6cb34cb9861b4017a2ab87212fa"} Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.483084 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.485431 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.493146 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.493823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-cpbcq" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.494315 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.494736 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.501036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.507752 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.598904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-default\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kolla-config\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599532 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtrqd\" (UniqueName: \"kubernetes.io/projected/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kube-api-access-jtrqd\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.599999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-default\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kolla-config\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jtrqd\" (UniqueName: \"kubernetes.io/projected/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kube-api-access-jtrqd\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.701906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.702651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.702883 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.703965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-default\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.704230 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.706975 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kolla-config\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.709838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.711394 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.724512 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtrqd\" (UniqueName: \"kubernetes.io/projected/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kube-api-access-jtrqd\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.735143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.852737 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.935284 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.937676 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.947374 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.948012 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.948321 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-9st9q" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.948464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:23:31 crc kubenswrapper[4769]: I1121 12:23:31.950948 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.109763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54wrt\" (UniqueName: \"kubernetes.io/projected/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kube-api-access-54wrt\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.110895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.159312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7313da1b-b474-474a-acc2-51ee39d5d79b","Type":"ContainerStarted","Data":"f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8"} Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.167562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301","Type":"ContainerStarted","Data":"c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b"} Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-54wrt\" (UniqueName: \"kubernetes.io/projected/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kube-api-access-54wrt\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.213353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.214503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.216040 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.216255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.217962 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.219671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.220896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.242489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.247744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-54wrt\" (UniqueName: \"kubernetes.io/projected/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kube-api-access-54wrt\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.249244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.276916 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.317772 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.319446 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.325612 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.325922 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.326072 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-pl7dp" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.342068 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.420881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvgq\" (UniqueName: \"kubernetes.io/projected/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kube-api-access-wmvgq\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.428706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.428815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.428846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kolla-config\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.428900 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-config-data\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.449241 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.533124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvgq\" (UniqueName: \"kubernetes.io/projected/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kube-api-access-wmvgq\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.533201 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.533230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.533249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kolla-config\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.533270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-config-data\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.534059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-config-data\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.536862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kolla-config\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.540239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-combined-ca-bundle\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.543396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-memcached-tls-certs\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.567809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvgq\" (UniqueName: \"kubernetes.io/projected/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kube-api-access-wmvgq\") pod \"memcached-0\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.694996 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:32 crc kubenswrapper[4769]: I1121 12:23:32.743570 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.112388 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:23:33 crc kubenswrapper[4769]: W1121 12:23:33.120308 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7759a04f_afff_47f4_9f22_6c7154fa2fb3.slice/crio-08b9f44b47c6c0078048a23e193d0483e889158f6c8dc1b4a0872141531e0f7e WatchSource:0}: Error finding container 08b9f44b47c6c0078048a23e193d0483e889158f6c8dc1b4a0872141531e0f7e: Status 404 returned error can't find the container with id 08b9f44b47c6c0078048a23e193d0483e889158f6c8dc1b4a0872141531e0f7e Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.183707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d125f717-0ab9-4ee5-971b-af7aa24e5ddd","Type":"ContainerStarted","Data":"ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305"} Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.183779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d125f717-0ab9-4ee5-971b-af7aa24e5ddd","Type":"ContainerStarted","Data":"1b23fd4bdf7a1394d97bceeecce4455eda2a90b25bb675b97bf1ebce57607bec"} Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.186668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7759a04f-afff-47f4-9f22-6c7154fa2fb3","Type":"ContainerStarted","Data":"08b9f44b47c6c0078048a23e193d0483e889158f6c8dc1b4a0872141531e0f7e"} Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.188977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1","Type":"ContainerStarted","Data":"a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7"} Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.189068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1","Type":"ContainerStarted","Data":"5ddeadcd87fcff5ccb72a7694a0653bca25f7884f39c77eafe90c81925038600"} Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.982809 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.984326 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:33 crc kubenswrapper[4769]: I1121 12:23:33.987520 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-xjnhd" Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.004073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.065648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4plr\" (UniqueName: \"kubernetes.io/projected/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9-kube-api-access-h4plr\") pod \"kube-state-metrics-0\" (UID: \"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.166986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h4plr\" (UniqueName: \"kubernetes.io/projected/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9-kube-api-access-h4plr\") pod \"kube-state-metrics-0\" (UID: \"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.187474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4plr\" (UniqueName: \"kubernetes.io/projected/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9-kube-api-access-h4plr\") pod \"kube-state-metrics-0\" (UID: \"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.198492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7759a04f-afff-47f4-9f22-6c7154fa2fb3","Type":"ContainerStarted","Data":"2d2ca713ec86c4868a610f79c736e20ed1acc9b6447d222c904a0d37a46cdfb4"} Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.224550 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.22452215 podStartE2EDuration="2.22452215s" podCreationTimestamp="2025-11-21 12:23:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:34.218713843 +0000 UTC m=+1972.919375661" watchObservedRunningTime="2025-11-21 12:23:34.22452215 +0000 UTC m=+1972.925183968" Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.348676 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.822961 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:23:34 crc kubenswrapper[4769]: I1121 12:23:34.826726 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:23:35 crc kubenswrapper[4769]: I1121 12:23:35.212870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9","Type":"ContainerStarted","Data":"6bc58a7052d8fc4098c8b2d0d9d954c39472a3b5412afd4f4badfda44ac96add"} Nov 21 12:23:35 crc kubenswrapper[4769]: I1121 12:23:35.213153 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:36 crc kubenswrapper[4769]: I1121 12:23:36.228291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9","Type":"ContainerStarted","Data":"aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c"} Nov 21 12:23:36 crc kubenswrapper[4769]: I1121 12:23:36.251265 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.8437799569999997 podStartE2EDuration="3.25123151s" podCreationTimestamp="2025-11-21 12:23:33 +0000 UTC" firstStartedPulling="2025-11-21 12:23:34.826534437 +0000 UTC m=+1973.527196255" lastFinishedPulling="2025-11-21 12:23:35.23398597 +0000 UTC m=+1973.934647808" observedRunningTime="2025-11-21 12:23:36.247729236 +0000 UTC m=+1974.948391064" watchObservedRunningTime="2025-11-21 12:23:36.25123151 +0000 UTC m=+1974.951893328" Nov 21 12:23:37 crc kubenswrapper[4769]: I1121 12:23:37.238001 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerID="a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7" exitCode=0 Nov 21 12:23:37 crc kubenswrapper[4769]: I1121 12:23:37.238128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1","Type":"ContainerDied","Data":"a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7"} Nov 21 12:23:37 crc kubenswrapper[4769]: I1121 12:23:37.241577 4769 generic.go:334] "Generic (PLEG): container finished" podID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerID="ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305" exitCode=0 Nov 21 12:23:37 crc kubenswrapper[4769]: I1121 12:23:37.242269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d125f717-0ab9-4ee5-971b-af7aa24e5ddd","Type":"ContainerDied","Data":"ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305"} Nov 21 12:23:37 crc kubenswrapper[4769]: I1121 12:23:37.242475 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.003785 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.006374 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.009046 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-s598h" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.010390 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.010797 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.011101 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.017402 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.049480 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-config\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4181add-a741-47a8-986b-ff015685ab63-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjcg\" (UniqueName: \"kubernetes.io/projected/f4181add-a741-47a8-986b-ff015685ab63-kube-api-access-qwjcg\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.149903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjcg\" (UniqueName: \"kubernetes.io/projected/f4181add-a741-47a8-986b-ff015685ab63-kube-api-access-qwjcg\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251233 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-config\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4181add-a741-47a8-986b-ff015685ab63-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.251916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4181add-a741-47a8-986b-ff015685ab63-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.252339 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.253379 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-config\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.253525 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.256680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1","Type":"ContainerStarted","Data":"e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4"} Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.258088 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.259468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.259683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.261496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d125f717-0ab9-4ee5-971b-af7aa24e5ddd","Type":"ContainerStarted","Data":"771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf"} Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.271103 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjcg\" (UniqueName: \"kubernetes.io/projected/f4181add-a741-47a8-986b-ff015685ab63-kube-api-access-qwjcg\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.278587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.290857 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=8.290826046 podStartE2EDuration="8.290826046s" podCreationTimestamp="2025-11-21 12:23:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:38.284279641 +0000 UTC m=+1976.984941479" watchObservedRunningTime="2025-11-21 12:23:38.290826046 +0000 UTC m=+1976.991487864" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.311646 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.311621105 podStartE2EDuration="8.311621105s" podCreationTimestamp="2025-11-21 12:23:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:38.31106308 +0000 UTC m=+1977.011724908" watchObservedRunningTime="2025-11-21 12:23:38.311621105 +0000 UTC m=+1977.012282933" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.366531 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:38 crc kubenswrapper[4769]: I1121 12:23:38.840320 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:23:39 crc kubenswrapper[4769]: I1121 12:23:39.275612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4181add-a741-47a8-986b-ff015685ab63","Type":"ContainerStarted","Data":"b466d0d40745c316900f1877090c4563ff416d50a5b9fa93562d9b459777270b"} Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.198965 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.202218 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.204436 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.204860 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.205080 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-qbd7b" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.205370 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.215531 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.286420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4181add-a741-47a8-986b-ff015685ab63","Type":"ContainerStarted","Data":"a296db2bbb1a0ec5378d886408b8069b843e087e2a97cd5b7ac759ff43b3104d"} Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.286465 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4181add-a741-47a8-986b-ff015685ab63","Type":"ContainerStarted","Data":"1bb06acd6e3f426a5168eac18c0fe9ba87116b36d8da1fea28749a22180f106e"} Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.312148 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=4.312119082 podStartE2EDuration="4.312119082s" podCreationTimestamp="2025-11-21 12:23:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:40.304771675 +0000 UTC m=+1979.005433493" watchObservedRunningTime="2025-11-21 12:23:40.312119082 +0000 UTC m=+1979.012780900" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325409 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325472 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zp2w\" (UniqueName: \"kubernetes.io/projected/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-kube-api-access-2zp2w\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-config\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.325875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2zp2w\" (UniqueName: \"kubernetes.io/projected/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-kube-api-access-2zp2w\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-config\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427680 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427731 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.427779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.429389 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-config\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.430348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.430669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.432927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.434431 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.437094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.446584 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zp2w\" (UniqueName: \"kubernetes.io/projected/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-kube-api-access-2zp2w\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.454463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.533937 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:40 crc kubenswrapper[4769]: W1121 12:23:40.991432 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1dca80_5bc5_46d8_bfe6_fb395e82b774.slice/crio-d4676b7f92221b948486556671ab6d1fb63e4f5aa8bc5a9adc97070583326bca WatchSource:0}: Error finding container d4676b7f92221b948486556671ab6d1fb63e4f5aa8bc5a9adc97070583326bca: Status 404 returned error can't find the container with id d4676b7f92221b948486556671ab6d1fb63e4f5aa8bc5a9adc97070583326bca Nov 21 12:23:40 crc kubenswrapper[4769]: I1121 12:23:40.992769 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:23:41 crc kubenswrapper[4769]: I1121 12:23:41.308948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0c1dca80-5bc5-46d8-bfe6-fb395e82b774","Type":"ContainerStarted","Data":"d4676b7f92221b948486556671ab6d1fb63e4f5aa8bc5a9adc97070583326bca"} Nov 21 12:23:41 crc kubenswrapper[4769]: I1121 12:23:41.367942 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:41 crc kubenswrapper[4769]: I1121 12:23:41.853313 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:41 crc kubenswrapper[4769]: I1121 12:23:41.853696 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:42 crc kubenswrapper[4769]: I1121 12:23:42.277072 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:42 crc kubenswrapper[4769]: I1121 12:23:42.277144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:23:42 crc kubenswrapper[4769]: I1121 12:23:42.320857 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0c1dca80-5bc5-46d8-bfe6-fb395e82b774","Type":"ContainerStarted","Data":"065ec9c640d6e0b1ce47372adc1e38d140372e8da5dd41e7d8a22523d1c4143d"} Nov 21 12:23:42 crc kubenswrapper[4769]: I1121 12:23:42.320933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0c1dca80-5bc5-46d8-bfe6-fb395e82b774","Type":"ContainerStarted","Data":"576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b"} Nov 21 12:23:42 crc kubenswrapper[4769]: I1121 12:23:42.346713 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.346684984 podStartE2EDuration="3.346684984s" podCreationTimestamp="2025-11-21 12:23:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:42.338895374 +0000 UTC m=+1981.039557182" watchObservedRunningTime="2025-11-21 12:23:42.346684984 +0000 UTC m=+1981.047346812" Nov 21 12:23:42 crc kubenswrapper[4769]: I1121 12:23:42.697502 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:23:43 crc kubenswrapper[4769]: I1121 12:23:43.368112 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:43 crc kubenswrapper[4769]: I1121 12:23:43.535024 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:44 crc kubenswrapper[4769]: I1121 12:23:44.378771 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:23:44 crc kubenswrapper[4769]: I1121 12:23:44.432529 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:44 crc kubenswrapper[4769]: I1121 12:23:44.492400 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.505660 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.525825 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.528325 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.528785 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.529116 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.529137 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-krzbl" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.536101 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.563919 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.629703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-cache\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.629757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.629866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d7j6\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-kube-api-access-7d7j6\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.629931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.629955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-lock\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.731710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7d7j6\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-kube-api-access-7d7j6\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.731837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.731861 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-lock\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.731906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-cache\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.731957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: E1121 12:23:45.732186 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:23:45 crc kubenswrapper[4769]: E1121 12:23:45.732232 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:23:45 crc kubenswrapper[4769]: E1121 12:23:45.732301 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift podName:d93dc2d4-b4c7-4075-8769-693bdb43673d nodeName:}" failed. No retries permitted until 2025-11-21 12:23:46.232274519 +0000 UTC m=+1984.932936337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift") pod "swift-storage-0" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d") : configmap "swift-ring-files" not found Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.732493 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.733084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-lock\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.733673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-cache\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.756740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d7j6\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-kube-api-access-7d7j6\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.758462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.943412 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qvjzw"] Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.944428 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.952676 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.952957 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.953176 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:23:45 crc kubenswrapper[4769]: I1121 12:23:45.958261 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qvjzw"] Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.036721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-combined-ca-bundle\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.037208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-swiftconf\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.037360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-ring-data-devices\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.037464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ce3d3815-ca29-4e8d-bb53-81364e18feb4-etc-swift\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.037599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-dispersionconf\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.037742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-scripts\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.037898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj8sh\" (UniqueName: \"kubernetes.io/projected/ce3d3815-ca29-4e8d-bb53-81364e18feb4-kube-api-access-qj8sh\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-ring-data-devices\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139211 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ce3d3815-ca29-4e8d-bb53-81364e18feb4-etc-swift\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-dispersionconf\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-scripts\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qj8sh\" (UniqueName: \"kubernetes.io/projected/ce3d3815-ca29-4e8d-bb53-81364e18feb4-kube-api-access-qj8sh\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-combined-ca-bundle\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-swiftconf\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.139743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ce3d3815-ca29-4e8d-bb53-81364e18feb4-etc-swift\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.140432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-scripts\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.140503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-ring-data-devices\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.143160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-dispersionconf\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.143506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-swiftconf\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.144639 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-combined-ca-bundle\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.158056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj8sh\" (UniqueName: \"kubernetes.io/projected/ce3d3815-ca29-4e8d-bb53-81364e18feb4-kube-api-access-qj8sh\") pod \"swift-ring-rebalance-qvjzw\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.240781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:46 crc kubenswrapper[4769]: E1121 12:23:46.241000 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:23:46 crc kubenswrapper[4769]: E1121 12:23:46.241031 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:23:46 crc kubenswrapper[4769]: E1121 12:23:46.241094 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift podName:d93dc2d4-b4c7-4075-8769-693bdb43673d nodeName:}" failed. No retries permitted until 2025-11-21 12:23:47.241074924 +0000 UTC m=+1985.941736742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift") pod "swift-storage-0" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d") : configmap "swift-ring-files" not found Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.273746 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.609070 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.654514 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.771106 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qvjzw"] Nov 21 12:23:46 crc kubenswrapper[4769]: W1121 12:23:46.787907 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce3d3815_ca29_4e8d_bb53_81364e18feb4.slice/crio-405e02bdc7fae6c437e827252348f97b2c6e792214590137171623137ed03b4a WatchSource:0}: Error finding container 405e02bdc7fae6c437e827252348f97b2c6e792214590137171623137ed03b4a: Status 404 returned error can't find the container with id 405e02bdc7fae6c437e827252348f97b2c6e792214590137171623137ed03b4a Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.894066 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.895891 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.900551 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.900859 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.901010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-95qlm" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.902695 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:23:46 crc kubenswrapper[4769]: I1121 12:23:46.914319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.055830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.055919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-config\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.056068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.056384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.056511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/6ca83904-6406-45e4-bfc1-6a953ed672b5-kube-api-access-tdsjv\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.056650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.056711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-scripts\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/6ca83904-6406-45e4-bfc1-6a953ed672b5-kube-api-access-tdsjv\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-scripts\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-config\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.158707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.159372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.160027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-scripts\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.160128 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-config\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.163040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.163079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.168011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.186112 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/6ca83904-6406-45e4-bfc1-6a953ed672b5-kube-api-access-tdsjv\") pod \"ovn-northd-0\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.251091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.260747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:47 crc kubenswrapper[4769]: E1121 12:23:47.260985 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:23:47 crc kubenswrapper[4769]: E1121 12:23:47.261019 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:23:47 crc kubenswrapper[4769]: E1121 12:23:47.261088 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift podName:d93dc2d4-b4c7-4075-8769-693bdb43673d nodeName:}" failed. No retries permitted until 2025-11-21 12:23:49.261064798 +0000 UTC m=+1987.961726616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift") pod "swift-storage-0" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d") : configmap "swift-ring-files" not found Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.406261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" event={"ID":"ce3d3815-ca29-4e8d-bb53-81364e18feb4","Type":"ContainerStarted","Data":"405e02bdc7fae6c437e827252348f97b2c6e792214590137171623137ed03b4a"} Nov 21 12:23:47 crc kubenswrapper[4769]: I1121 12:23:47.762978 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:23:48 crc kubenswrapper[4769]: I1121 12:23:48.418849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ca83904-6406-45e4-bfc1-6a953ed672b5","Type":"ContainerStarted","Data":"aff33439df2c0fde793a58d6c349ddf44be46a36e0939753f5e6db1045c54189"} Nov 21 12:23:49 crc kubenswrapper[4769]: I1121 12:23:49.299905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:49 crc kubenswrapper[4769]: E1121 12:23:49.300127 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:23:49 crc kubenswrapper[4769]: E1121 12:23:49.300159 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:23:49 crc kubenswrapper[4769]: E1121 12:23:49.300252 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift podName:d93dc2d4-b4c7-4075-8769-693bdb43673d nodeName:}" failed. No retries permitted until 2025-11-21 12:23:53.300229003 +0000 UTC m=+1992.000890821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift") pod "swift-storage-0" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d") : configmap "swift-ring-files" not found Nov 21 12:23:50 crc kubenswrapper[4769]: I1121 12:23:50.439270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" event={"ID":"ce3d3815-ca29-4e8d-bb53-81364e18feb4","Type":"ContainerStarted","Data":"68dcddd325bfc469c0588437fd5aa31fd078f0841172f8395ab7ca85da4c06f2"} Nov 21 12:23:50 crc kubenswrapper[4769]: I1121 12:23:50.440670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ca83904-6406-45e4-bfc1-6a953ed672b5","Type":"ContainerStarted","Data":"64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4"} Nov 21 12:23:51 crc kubenswrapper[4769]: I1121 12:23:51.475717 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" podStartSLOduration=6.475690779 podStartE2EDuration="6.475690779s" podCreationTimestamp="2025-11-21 12:23:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:51.470477659 +0000 UTC m=+1990.171139477" watchObservedRunningTime="2025-11-21 12:23:51.475690779 +0000 UTC m=+1990.176352607" Nov 21 12:23:52 crc kubenswrapper[4769]: I1121 12:23:52.461154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ca83904-6406-45e4-bfc1-6a953ed672b5","Type":"ContainerStarted","Data":"a6aea864b65349fff1b9b42caf5b5f4a0d8bbd1fa473c1220dfc154554c18240"} Nov 21 12:23:52 crc kubenswrapper[4769]: I1121 12:23:52.462608 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:23:52 crc kubenswrapper[4769]: I1121 12:23:52.489994 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=6.489957188 podStartE2EDuration="6.489957188s" podCreationTimestamp="2025-11-21 12:23:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:23:52.482875178 +0000 UTC m=+1991.183536996" watchObservedRunningTime="2025-11-21 12:23:52.489957188 +0000 UTC m=+1991.190619006" Nov 21 12:23:53 crc kubenswrapper[4769]: I1121 12:23:53.372299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:23:53 crc kubenswrapper[4769]: E1121 12:23:53.372449 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:23:53 crc kubenswrapper[4769]: E1121 12:23:53.373003 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:23:53 crc kubenswrapper[4769]: E1121 12:23:53.373075 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift podName:d93dc2d4-b4c7-4075-8769-693bdb43673d nodeName:}" failed. No retries permitted until 2025-11-21 12:24:01.373051136 +0000 UTC m=+2000.073713064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift") pod "swift-storage-0" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d") : configmap "swift-ring-files" not found Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.054619 4769 scope.go:117] "RemoveContainer" containerID="72a27be7fe85662fd73daf7a786692d3582a686c76e6e6e597cff26e844f5e17" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.140337 4769 scope.go:117] "RemoveContainer" containerID="b9841c65cfcd0f79fb30a75438ffe6ed585ce9e1daf0312abd4343ea5fc49f08" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.177620 4769 scope.go:117] "RemoveContainer" containerID="9baf567037c96bd1812d294445e155e0d8af2da6246bfb33d899c63c0aab3265" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.210447 4769 scope.go:117] "RemoveContainer" containerID="ddd7331e4821cdaab4f86e72d6f081f9a0c23116aaec656bdc376d85c1f9291b" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.259934 4769 scope.go:117] "RemoveContainer" containerID="b35327d9c8de5cdcf4b1fa823d74541998279884dacd73871eba19120c565001" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.299496 4769 scope.go:117] "RemoveContainer" containerID="aa0aaf353808515c25820b3f6f59e5fe1bfd16a8d800522a00e0ab2927a73abf" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.357398 4769 scope.go:117] "RemoveContainer" containerID="90ffa51c15db3acc914d73fb4054a7679c5162bf625f365b2265997eebe2e976" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.411591 4769 scope.go:117] "RemoveContainer" containerID="69068dfbf5d1cb153096425bb7968e1e420ecfd5ee62209efcb7bc5061747e9a" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.454733 4769 scope.go:117] "RemoveContainer" containerID="113bbdbcb9e0efb0bd65ca73d7e2d3a8238f3a184837df9915776fe1c33c27ad" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.532152 4769 scope.go:117] "RemoveContainer" containerID="dea46b3b14bbd1e5122a520588b3b7295eb7903651356a0165e54bcd7dc9275d" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.573691 4769 scope.go:117] "RemoveContainer" containerID="26b697829e7267deb81d91feb65ff469a03f946ef4e391778b1456f41ec08739" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.606182 4769 scope.go:117] "RemoveContainer" containerID="1ed98a1767201d6fd7a026421d4cf8c22fbb93d12961f1f16ab33024e78c0fa6" Nov 21 12:23:54 crc kubenswrapper[4769]: I1121 12:23:54.630508 4769 scope.go:117] "RemoveContainer" containerID="a5e333f1cc4b171249b7eb194937b2d290bc6d6137288188dd8bebc57448ad9f" Nov 21 12:23:56 crc kubenswrapper[4769]: I1121 12:23:56.737546 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:23:56 crc kubenswrapper[4769]: I1121 12:23:56.822344 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="galera" probeResult="failure" output=< Nov 21 12:23:56 crc kubenswrapper[4769]: wsrep_local_state_comment (Joined) differs from Synced Nov 21 12:23:56 crc kubenswrapper[4769]: > Nov 21 12:24:01 crc kubenswrapper[4769]: I1121 12:24:01.430357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:24:01 crc kubenswrapper[4769]: I1121 12:24:01.438843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"swift-storage-0\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:24:01 crc kubenswrapper[4769]: I1121 12:24:01.465648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:24:01 crc kubenswrapper[4769]: I1121 12:24:01.938492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.065005 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.194148 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-z5lbf"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.195170 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.210922 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-z5lbf"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.232184 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.248617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/604b1833-41e7-4520-b1a8-72e485dcf850-operator-scripts\") pod \"keystone-db-create-z5lbf\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.248791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw28m\" (UniqueName: \"kubernetes.io/projected/604b1833-41e7-4520-b1a8-72e485dcf850-kube-api-access-sw28m\") pod \"keystone-db-create-z5lbf\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.330084 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.335957 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" probeResult="failure" output=< Nov 21 12:24:02 crc kubenswrapper[4769]: wsrep_local_state_comment (Joined) differs from Synced Nov 21 12:24:02 crc kubenswrapper[4769]: > Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.343263 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-13d7-account-create-g9vpd"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.344339 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.346120 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.350456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sw28m\" (UniqueName: \"kubernetes.io/projected/604b1833-41e7-4520-b1a8-72e485dcf850-kube-api-access-sw28m\") pod \"keystone-db-create-z5lbf\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.350642 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/604b1833-41e7-4520-b1a8-72e485dcf850-operator-scripts\") pod \"keystone-db-create-z5lbf\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.351750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/604b1833-41e7-4520-b1a8-72e485dcf850-operator-scripts\") pod \"keystone-db-create-z5lbf\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.354983 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-13d7-account-create-g9vpd"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.371486 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw28m\" (UniqueName: \"kubernetes.io/projected/604b1833-41e7-4520-b1a8-72e485dcf850-kube-api-access-sw28m\") pod \"keystone-db-create-z5lbf\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.433789 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" probeResult="failure" output=< Nov 21 12:24:02 crc kubenswrapper[4769]: wsrep_local_state_comment (Joined) differs from Synced Nov 21 12:24:02 crc kubenswrapper[4769]: > Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.452170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsn2l\" (UniqueName: \"kubernetes.io/projected/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-kube-api-access-nsn2l\") pod \"keystone-13d7-account-create-g9vpd\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.452456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-operator-scripts\") pod \"keystone-13d7-account-create-g9vpd\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.539955 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-l85j4"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.541048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.550747 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.554319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nsn2l\" (UniqueName: \"kubernetes.io/projected/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-kube-api-access-nsn2l\") pod \"keystone-13d7-account-create-g9vpd\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.554502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-operator-scripts\") pod \"keystone-13d7-account-create-g9vpd\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.555796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-operator-scripts\") pod \"keystone-13d7-account-create-g9vpd\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.572079 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-l85j4"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.575681 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsn2l\" (UniqueName: \"kubernetes.io/projected/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-kube-api-access-nsn2l\") pod \"keystone-13d7-account-create-g9vpd\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.604072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"b27cab93324fa4ac513f603798ca0ac510d242b64c003f3e0eff9b3310975e2e"} Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.611165 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce3d3815-ca29-4e8d-bb53-81364e18feb4" containerID="68dcddd325bfc469c0588437fd5aa31fd078f0841172f8395ab7ca85da4c06f2" exitCode=0 Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.611262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" event={"ID":"ce3d3815-ca29-4e8d-bb53-81364e18feb4","Type":"ContainerDied","Data":"68dcddd325bfc469c0588437fd5aa31fd078f0841172f8395ab7ca85da4c06f2"} Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.651525 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-373d-account-create-hld28"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.652805 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.656173 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.657880 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc358105-4fcf-4ef4-b997-4ffb9f84a473-operator-scripts\") pod \"placement-db-create-l85j4\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.657952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc97m\" (UniqueName: \"kubernetes.io/projected/cc358105-4fcf-4ef4-b997-4ffb9f84a473-kube-api-access-nc97m\") pod \"placement-db-create-l85j4\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.658927 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.664240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-373d-account-create-hld28"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.783573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc358105-4fcf-4ef4-b997-4ffb9f84a473-operator-scripts\") pod \"placement-db-create-l85j4\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.783897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nc97m\" (UniqueName: \"kubernetes.io/projected/cc358105-4fcf-4ef4-b997-4ffb9f84a473-kube-api-access-nc97m\") pod \"placement-db-create-l85j4\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.783952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-operator-scripts\") pod \"placement-373d-account-create-hld28\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.783999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dzbs\" (UniqueName: \"kubernetes.io/projected/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-kube-api-access-6dzbs\") pod \"placement-373d-account-create-hld28\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.784851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc358105-4fcf-4ef4-b997-4ffb9f84a473-operator-scripts\") pod \"placement-db-create-l85j4\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.810024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc97m\" (UniqueName: \"kubernetes.io/projected/cc358105-4fcf-4ef4-b997-4ffb9f84a473-kube-api-access-nc97m\") pod \"placement-db-create-l85j4\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.843237 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-kkb4c"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.844260 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.874344 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kkb4c"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.879455 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.885440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6dzbs\" (UniqueName: \"kubernetes.io/projected/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-kube-api-access-6dzbs\") pod \"placement-373d-account-create-hld28\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.885563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-operator-scripts\") pod \"placement-373d-account-create-hld28\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.886296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-operator-scripts\") pod \"placement-373d-account-create-hld28\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.906670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dzbs\" (UniqueName: \"kubernetes.io/projected/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-kube-api-access-6dzbs\") pod \"placement-373d-account-create-hld28\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.960462 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-66cf-account-create-bj6f7"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.963272 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.965985 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.977268 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-66cf-account-create-bj6f7"] Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.985368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.988468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac14021d-cc6c-403c-bc6d-4c966a882eba-operator-scripts\") pod \"glance-db-create-kkb4c\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:02 crc kubenswrapper[4769]: I1121 12:24:02.988558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jbgp\" (UniqueName: \"kubernetes.io/projected/ac14021d-cc6c-403c-bc6d-4c966a882eba-kube-api-access-2jbgp\") pod \"glance-db-create-kkb4c\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.090025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56nl7\" (UniqueName: \"kubernetes.io/projected/671e1e54-25c5-48b3-bb05-05a3b289e9e2-kube-api-access-56nl7\") pod \"glance-66cf-account-create-bj6f7\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.090645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/671e1e54-25c5-48b3-bb05-05a3b289e9e2-operator-scripts\") pod \"glance-66cf-account-create-bj6f7\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.090688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac14021d-cc6c-403c-bc6d-4c966a882eba-operator-scripts\") pod \"glance-db-create-kkb4c\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.090754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2jbgp\" (UniqueName: \"kubernetes.io/projected/ac14021d-cc6c-403c-bc6d-4c966a882eba-kube-api-access-2jbgp\") pod \"glance-db-create-kkb4c\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.092360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac14021d-cc6c-403c-bc6d-4c966a882eba-operator-scripts\") pod \"glance-db-create-kkb4c\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.099067 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-z5lbf"] Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.112322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jbgp\" (UniqueName: \"kubernetes.io/projected/ac14021d-cc6c-403c-bc6d-4c966a882eba-kube-api-access-2jbgp\") pod \"glance-db-create-kkb4c\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.176390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.192450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-56nl7\" (UniqueName: \"kubernetes.io/projected/671e1e54-25c5-48b3-bb05-05a3b289e9e2-kube-api-access-56nl7\") pod \"glance-66cf-account-create-bj6f7\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.192525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/671e1e54-25c5-48b3-bb05-05a3b289e9e2-operator-scripts\") pod \"glance-66cf-account-create-bj6f7\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.193254 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/671e1e54-25c5-48b3-bb05-05a3b289e9e2-operator-scripts\") pod \"glance-66cf-account-create-bj6f7\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.199706 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-13d7-account-create-g9vpd"] Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.220873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-56nl7\" (UniqueName: \"kubernetes.io/projected/671e1e54-25c5-48b3-bb05-05a3b289e9e2-kube-api-access-56nl7\") pod \"glance-66cf-account-create-bj6f7\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: W1121 12:24:03.233415 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf97afbd8_4067_4ce1_8b2e_4c2b64f94f0a.slice/crio-3d23da55f0e94e0a0ba8479f0d8bf6cdd5965b5879319d341c70ccc21d3fd74e WatchSource:0}: Error finding container 3d23da55f0e94e0a0ba8479f0d8bf6cdd5965b5879319d341c70ccc21d3fd74e: Status 404 returned error can't find the container with id 3d23da55f0e94e0a0ba8479f0d8bf6cdd5965b5879319d341c70ccc21d3fd74e Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.288748 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.420513 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-l85j4"] Nov 21 12:24:03 crc kubenswrapper[4769]: W1121 12:24:03.435731 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc358105_4fcf_4ef4_b997_4ffb9f84a473.slice/crio-cb109f2d2e9cdec031057c90e148d2e688040798b74c22da3543a7afee0050f7 WatchSource:0}: Error finding container cb109f2d2e9cdec031057c90e148d2e688040798b74c22da3543a7afee0050f7: Status 404 returned error can't find the container with id cb109f2d2e9cdec031057c90e148d2e688040798b74c22da3543a7afee0050f7 Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.549170 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-373d-account-create-hld28"] Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.620229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" event={"ID":"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a","Type":"ContainerStarted","Data":"3d23da55f0e94e0a0ba8479f0d8bf6cdd5965b5879319d341c70ccc21d3fd74e"} Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.621845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" event={"ID":"604b1833-41e7-4520-b1a8-72e485dcf850","Type":"ContainerStarted","Data":"8bddc41db08ba61e8f1cf9326ce01b1be1b5ad7e80e51ed68074ba927a9e28fd"} Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.623718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727"} Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.625072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-l85j4" event={"ID":"cc358105-4fcf-4ef4-b997-4ffb9f84a473","Type":"ContainerStarted","Data":"cb109f2d2e9cdec031057c90e148d2e688040798b74c22da3543a7afee0050f7"} Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.626795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" event={"ID":"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8","Type":"ContainerStarted","Data":"a49c5173b13e463c54151f27ef06009e03e3fda52148f736201d3a5a95eb5f69"} Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.758607 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kkb4c"] Nov 21 12:24:03 crc kubenswrapper[4769]: W1121 12:24:03.764061 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac14021d_cc6c_403c_bc6d_4c966a882eba.slice/crio-b456827873c58fa57cd8e8307a87fe40094bc4801cff473f50ebe9220dfcca9e WatchSource:0}: Error finding container b456827873c58fa57cd8e8307a87fe40094bc4801cff473f50ebe9220dfcca9e: Status 404 returned error can't find the container with id b456827873c58fa57cd8e8307a87fe40094bc4801cff473f50ebe9220dfcca9e Nov 21 12:24:03 crc kubenswrapper[4769]: I1121 12:24:03.925681 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-66cf-account-create-bj6f7"] Nov 21 12:24:03 crc kubenswrapper[4769]: W1121 12:24:03.927880 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod671e1e54_25c5_48b3_bb05_05a3b289e9e2.slice/crio-de243874d7a88b94ca5f54e00c2fb3dc09cc5b72970eab71b1942d2c999a6b74 WatchSource:0}: Error finding container de243874d7a88b94ca5f54e00c2fb3dc09cc5b72970eab71b1942d2c999a6b74: Status 404 returned error can't find the container with id de243874d7a88b94ca5f54e00c2fb3dc09cc5b72970eab71b1942d2c999a6b74 Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.006213 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ce3d3815-ca29-4e8d-bb53-81364e18feb4-etc-swift\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-ring-data-devices\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-dispersionconf\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-scripts\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-combined-ca-bundle\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-swiftconf\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.111522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj8sh\" (UniqueName: \"kubernetes.io/projected/ce3d3815-ca29-4e8d-bb53-81364e18feb4-kube-api-access-qj8sh\") pod \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\" (UID: \"ce3d3815-ca29-4e8d-bb53-81364e18feb4\") " Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.112400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce3d3815-ca29-4e8d-bb53-81364e18feb4-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.113574 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.119602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce3d3815-ca29-4e8d-bb53-81364e18feb4-kube-api-access-qj8sh" (OuterVolumeSpecName: "kube-api-access-qj8sh") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "kube-api-access-qj8sh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.123706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.140373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.141691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-scripts" (OuterVolumeSpecName: "scripts") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.144736 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "ce3d3815-ca29-4e8d-bb53-81364e18feb4" (UID: "ce3d3815-ca29-4e8d-bb53-81364e18feb4"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213242 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213294 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213310 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213324 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/ce3d3815-ca29-4e8d-bb53-81364e18feb4-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213336 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qj8sh\" (UniqueName: \"kubernetes.io/projected/ce3d3815-ca29-4e8d-bb53-81364e18feb4-kube-api-access-qj8sh\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213351 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/ce3d3815-ca29-4e8d-bb53-81364e18feb4-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.213362 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/ce3d3815-ca29-4e8d-bb53-81364e18feb4-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.643118 4769 generic.go:334] "Generic (PLEG): container finished" podID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerID="c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b" exitCode=0 Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.643230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301","Type":"ContainerDied","Data":"c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.652421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.658796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kkb4c" event={"ID":"ac14021d-cc6c-403c-bc6d-4c966a882eba","Type":"ContainerStarted","Data":"148b56c4580bf9a268839c59f7508ebe16fa4ffb30397c9a41672d5d16b3a0f4"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.659632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kkb4c" event={"ID":"ac14021d-cc6c-403c-bc6d-4c966a882eba","Type":"ContainerStarted","Data":"b456827873c58fa57cd8e8307a87fe40094bc4801cff473f50ebe9220dfcca9e"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.666749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" event={"ID":"604b1833-41e7-4520-b1a8-72e485dcf850","Type":"ContainerStarted","Data":"95182d9f59156008afc913d892e2c89711121f2f773dbd5b591568f6353df43f"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.683301 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.683280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-qvjzw" event={"ID":"ce3d3815-ca29-4e8d-bb53-81364e18feb4","Type":"ContainerDied","Data":"405e02bdc7fae6c437e827252348f97b2c6e792214590137171623137ed03b4a"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.684790 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="405e02bdc7fae6c437e827252348f97b2c6e792214590137171623137ed03b4a" Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.689834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" event={"ID":"671e1e54-25c5-48b3-bb05-05a3b289e9e2","Type":"ContainerStarted","Data":"de243874d7a88b94ca5f54e00c2fb3dc09cc5b72970eab71b1942d2c999a6b74"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.697420 4769 generic.go:334] "Generic (PLEG): container finished" podID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerID="f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8" exitCode=0 Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.697540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7313da1b-b474-474a-acc2-51ee39d5d79b","Type":"ContainerDied","Data":"f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.703319 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-l85j4" event={"ID":"cc358105-4fcf-4ef4-b997-4ffb9f84a473","Type":"ContainerStarted","Data":"0cb566ad4e1ab22eed7e52334b7e0140609a46bb3f45b388336ac5cd505b8c5f"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.710350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" event={"ID":"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8","Type":"ContainerStarted","Data":"6e9233d0d36532ed6babf4e3fe833c27b09452a5e4d90ea9c5019df5992ffe5b"} Nov 21 12:24:04 crc kubenswrapper[4769]: I1121 12:24:04.713861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" event={"ID":"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a","Type":"ContainerStarted","Data":"0f422fe72f0ad13db20aa02d62438969f537702b7f29e196efe373cd9b9fc00c"} Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.722966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301","Type":"ContainerStarted","Data":"d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85"} Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.725915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" event={"ID":"671e1e54-25c5-48b3-bb05-05a3b289e9e2","Type":"ContainerStarted","Data":"4e0c4f70f88b25f91de352936f7ffec905e7e180958830789350cd922f5f93fd"} Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.728607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7313da1b-b474-474a-acc2-51ee39d5d79b","Type":"ContainerStarted","Data":"6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1"} Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.747375 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" podStartSLOduration=3.747357042 podStartE2EDuration="3.747357042s" podCreationTimestamp="2025-11-21 12:24:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:05.744799084 +0000 UTC m=+2004.445460902" watchObservedRunningTime="2025-11-21 12:24:05.747357042 +0000 UTC m=+2004.448018860" Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.766135 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" podStartSLOduration=3.766109496 podStartE2EDuration="3.766109496s" podCreationTimestamp="2025-11-21 12:24:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:05.765458838 +0000 UTC m=+2004.466120666" watchObservedRunningTime="2025-11-21 12:24:05.766109496 +0000 UTC m=+2004.466771314" Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.783701 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-l85j4" podStartSLOduration=3.783678788 podStartE2EDuration="3.783678788s" podCreationTimestamp="2025-11-21 12:24:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:05.778502849 +0000 UTC m=+2004.479164667" watchObservedRunningTime="2025-11-21 12:24:05.783678788 +0000 UTC m=+2004.484340606" Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.798864 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" podStartSLOduration=3.7988433649999997 podStartE2EDuration="3.798843365s" podCreationTimestamp="2025-11-21 12:24:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:05.79529781 +0000 UTC m=+2004.495959628" watchObservedRunningTime="2025-11-21 12:24:05.798843365 +0000 UTC m=+2004.499505183" Nov 21 12:24:05 crc kubenswrapper[4769]: I1121 12:24:05.811825 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-kkb4c" podStartSLOduration=3.811804523 podStartE2EDuration="3.811804523s" podCreationTimestamp="2025-11-21 12:24:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:05.809772019 +0000 UTC m=+2004.510433837" watchObservedRunningTime="2025-11-21 12:24:05.811804523 +0000 UTC m=+2004.512466341" Nov 21 12:24:06 crc kubenswrapper[4769]: I1121 12:24:06.739833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c"} Nov 21 12:24:06 crc kubenswrapper[4769]: I1121 12:24:06.739900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209"} Nov 21 12:24:06 crc kubenswrapper[4769]: I1121 12:24:06.739984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:24:06 crc kubenswrapper[4769]: I1121 12:24:06.787835 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=38.787812885 podStartE2EDuration="38.787812885s" podCreationTimestamp="2025-11-21 12:23:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:06.783422927 +0000 UTC m=+2005.484084745" watchObservedRunningTime="2025-11-21 12:24:06.787812885 +0000 UTC m=+2005.488474703" Nov 21 12:24:06 crc kubenswrapper[4769]: I1121 12:24:06.788575 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" podStartSLOduration=4.788567645 podStartE2EDuration="4.788567645s" podCreationTimestamp="2025-11-21 12:24:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:05.82397194 +0000 UTC m=+2004.524633758" watchObservedRunningTime="2025-11-21 12:24:06.788567645 +0000 UTC m=+2005.489229473" Nov 21 12:24:06 crc kubenswrapper[4769]: I1121 12:24:06.816803 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=39.816781313 podStartE2EDuration="39.816781313s" podCreationTimestamp="2025-11-21 12:23:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:06.815283213 +0000 UTC m=+2005.515945031" watchObservedRunningTime="2025-11-21 12:24:06.816781313 +0000 UTC m=+2005.517443131" Nov 21 12:24:08 crc kubenswrapper[4769]: I1121 12:24:08.758749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18"} Nov 21 12:24:08 crc kubenswrapper[4769]: I1121 12:24:08.759275 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0"} Nov 21 12:24:09 crc kubenswrapper[4769]: I1121 12:24:09.078380 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:24:09 crc kubenswrapper[4769]: I1121 12:24:09.776731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3"} Nov 21 12:24:09 crc kubenswrapper[4769]: I1121 12:24:09.776799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743"} Nov 21 12:24:09 crc kubenswrapper[4769]: I1121 12:24:09.779174 4769 generic.go:334] "Generic (PLEG): container finished" podID="604b1833-41e7-4520-b1a8-72e485dcf850" containerID="95182d9f59156008afc913d892e2c89711121f2f773dbd5b591568f6353df43f" exitCode=0 Nov 21 12:24:09 crc kubenswrapper[4769]: I1121 12:24:09.779242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" event={"ID":"604b1833-41e7-4520-b1a8-72e485dcf850","Type":"ContainerDied","Data":"95182d9f59156008afc913d892e2c89711121f2f773dbd5b591568f6353df43f"} Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.824937 4769 generic.go:334] "Generic (PLEG): container finished" podID="f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" containerID="0f422fe72f0ad13db20aa02d62438969f537702b7f29e196efe373cd9b9fc00c" exitCode=0 Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.824993 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" event={"ID":"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a","Type":"ContainerDied","Data":"0f422fe72f0ad13db20aa02d62438969f537702b7f29e196efe373cd9b9fc00c"} Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.833242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec"} Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.833304 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f"} Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.833325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a"} Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.835411 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc358105-4fcf-4ef4-b997-4ffb9f84a473" containerID="0cb566ad4e1ab22eed7e52334b7e0140609a46bb3f45b388336ac5cd505b8c5f" exitCode=0 Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.835503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-l85j4" event={"ID":"cc358105-4fcf-4ef4-b997-4ffb9f84a473","Type":"ContainerDied","Data":"0cb566ad4e1ab22eed7e52334b7e0140609a46bb3f45b388336ac5cd505b8c5f"} Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.838478 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac14021d-cc6c-403c-bc6d-4c966a882eba" containerID="148b56c4580bf9a268839c59f7508ebe16fa4ffb30397c9a41672d5d16b3a0f4" exitCode=0 Nov 21 12:24:10 crc kubenswrapper[4769]: I1121 12:24:10.838740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kkb4c" event={"ID":"ac14021d-cc6c-403c-bc6d-4c966a882eba","Type":"ContainerDied","Data":"148b56c4580bf9a268839c59f7508ebe16fa4ffb30397c9a41672d5d16b3a0f4"} Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.241255 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.345897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw28m\" (UniqueName: \"kubernetes.io/projected/604b1833-41e7-4520-b1a8-72e485dcf850-kube-api-access-sw28m\") pod \"604b1833-41e7-4520-b1a8-72e485dcf850\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.345954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/604b1833-41e7-4520-b1a8-72e485dcf850-operator-scripts\") pod \"604b1833-41e7-4520-b1a8-72e485dcf850\" (UID: \"604b1833-41e7-4520-b1a8-72e485dcf850\") " Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.346907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604b1833-41e7-4520-b1a8-72e485dcf850-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "604b1833-41e7-4520-b1a8-72e485dcf850" (UID: "604b1833-41e7-4520-b1a8-72e485dcf850"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.352916 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604b1833-41e7-4520-b1a8-72e485dcf850-kube-api-access-sw28m" (OuterVolumeSpecName: "kube-api-access-sw28m") pod "604b1833-41e7-4520-b1a8-72e485dcf850" (UID: "604b1833-41e7-4520-b1a8-72e485dcf850"). InnerVolumeSpecName "kube-api-access-sw28m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.448116 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sw28m\" (UniqueName: \"kubernetes.io/projected/604b1833-41e7-4520-b1a8-72e485dcf850-kube-api-access-sw28m\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.448160 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/604b1833-41e7-4520-b1a8-72e485dcf850-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.874747 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.874722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-z5lbf" event={"ID":"604b1833-41e7-4520-b1a8-72e485dcf850","Type":"ContainerDied","Data":"8bddc41db08ba61e8f1cf9326ce01b1be1b5ad7e80e51ed68074ba927a9e28fd"} Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.874995 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bddc41db08ba61e8f1cf9326ce01b1be1b5ad7e80e51ed68074ba927a9e28fd" Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.881499 4769 generic.go:334] "Generic (PLEG): container finished" podID="671e1e54-25c5-48b3-bb05-05a3b289e9e2" containerID="4e0c4f70f88b25f91de352936f7ffec905e7e180958830789350cd922f5f93fd" exitCode=0 Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.882156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" event={"ID":"671e1e54-25c5-48b3-bb05-05a3b289e9e2","Type":"ContainerDied","Data":"4e0c4f70f88b25f91de352936f7ffec905e7e180958830789350cd922f5f93fd"} Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.907951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46"} Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.908009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541"} Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.911985 4769 generic.go:334] "Generic (PLEG): container finished" podID="92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" containerID="6e9233d0d36532ed6babf4e3fe833c27b09452a5e4d90ea9c5019df5992ffe5b" exitCode=0 Nov 21 12:24:11 crc kubenswrapper[4769]: I1121 12:24:11.912218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" event={"ID":"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8","Type":"ContainerDied","Data":"6e9233d0d36532ed6babf4e3fe833c27b09452a5e4d90ea9c5019df5992ffe5b"} Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.362528 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.366821 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.388552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.394157 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.472990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jbgp\" (UniqueName: \"kubernetes.io/projected/ac14021d-cc6c-403c-bc6d-4c966a882eba-kube-api-access-2jbgp\") pod \"ac14021d-cc6c-403c-bc6d-4c966a882eba\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.473146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc358105-4fcf-4ef4-b997-4ffb9f84a473-operator-scripts\") pod \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.473242 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac14021d-cc6c-403c-bc6d-4c966a882eba-operator-scripts\") pod \"ac14021d-cc6c-403c-bc6d-4c966a882eba\" (UID: \"ac14021d-cc6c-403c-bc6d-4c966a882eba\") " Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.473378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc97m\" (UniqueName: \"kubernetes.io/projected/cc358105-4fcf-4ef4-b997-4ffb9f84a473-kube-api-access-nc97m\") pod \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\" (UID: \"cc358105-4fcf-4ef4-b997-4ffb9f84a473\") " Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.473831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc358105-4fcf-4ef4-b997-4ffb9f84a473-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cc358105-4fcf-4ef4-b997-4ffb9f84a473" (UID: "cc358105-4fcf-4ef4-b997-4ffb9f84a473"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.474549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac14021d-cc6c-403c-bc6d-4c966a882eba-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ac14021d-cc6c-403c-bc6d-4c966a882eba" (UID: "ac14021d-cc6c-403c-bc6d-4c966a882eba"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.482637 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc358105-4fcf-4ef4-b997-4ffb9f84a473-kube-api-access-nc97m" (OuterVolumeSpecName: "kube-api-access-nc97m") pod "cc358105-4fcf-4ef4-b997-4ffb9f84a473" (UID: "cc358105-4fcf-4ef4-b997-4ffb9f84a473"). InnerVolumeSpecName "kube-api-access-nc97m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.483000 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac14021d-cc6c-403c-bc6d-4c966a882eba-kube-api-access-2jbgp" (OuterVolumeSpecName: "kube-api-access-2jbgp") pod "ac14021d-cc6c-403c-bc6d-4c966a882eba" (UID: "ac14021d-cc6c-403c-bc6d-4c966a882eba"). InnerVolumeSpecName "kube-api-access-2jbgp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.574825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsn2l\" (UniqueName: \"kubernetes.io/projected/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-kube-api-access-nsn2l\") pod \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.574981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-operator-scripts\") pod \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\" (UID: \"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a\") " Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.575565 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac14021d-cc6c-403c-bc6d-4c966a882eba-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.575583 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nc97m\" (UniqueName: \"kubernetes.io/projected/cc358105-4fcf-4ef4-b997-4ffb9f84a473-kube-api-access-nc97m\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.575594 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2jbgp\" (UniqueName: \"kubernetes.io/projected/ac14021d-cc6c-403c-bc6d-4c966a882eba-kube-api-access-2jbgp\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.575604 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc358105-4fcf-4ef4-b997-4ffb9f84a473-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.575712 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" (UID: "f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.578806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-kube-api-access-nsn2l" (OuterVolumeSpecName: "kube-api-access-nsn2l") pod "f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" (UID: "f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a"). InnerVolumeSpecName "kube-api-access-nsn2l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.677331 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nsn2l\" (UniqueName: \"kubernetes.io/projected/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-kube-api-access-nsn2l\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.677377 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.925196 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.925254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-13d7-account-create-g9vpd" event={"ID":"f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a","Type":"ContainerDied","Data":"3d23da55f0e94e0a0ba8479f0d8bf6cdd5965b5879319d341c70ccc21d3fd74e"} Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.925332 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d23da55f0e94e0a0ba8479f0d8bf6cdd5965b5879319d341c70ccc21d3fd74e" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.933649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8"} Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.933714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerStarted","Data":"44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729"} Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.936753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-l85j4" event={"ID":"cc358105-4fcf-4ef4-b997-4ffb9f84a473","Type":"ContainerDied","Data":"cb109f2d2e9cdec031057c90e148d2e688040798b74c22da3543a7afee0050f7"} Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.936811 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb109f2d2e9cdec031057c90e148d2e688040798b74c22da3543a7afee0050f7" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.936889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-l85j4" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.943479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kkb4c" event={"ID":"ac14021d-cc6c-403c-bc6d-4c966a882eba","Type":"ContainerDied","Data":"b456827873c58fa57cd8e8307a87fe40094bc4801cff473f50ebe9220dfcca9e"} Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.943557 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b456827873c58fa57cd8e8307a87fe40094bc4801cff473f50ebe9220dfcca9e" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.943684 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kkb4c" Nov 21 12:24:12 crc kubenswrapper[4769]: I1121 12:24:12.984058 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=28.984038925 podStartE2EDuration="28.984038925s" podCreationTimestamp="2025-11-21 12:23:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:12.977206702 +0000 UTC m=+2011.677868520" watchObservedRunningTime="2025-11-21 12:24:12.984038925 +0000 UTC m=+2011.684700743" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.206812 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8"] Nov 21 12:24:13 crc kubenswrapper[4769]: E1121 12:24:13.207349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce3d3815-ca29-4e8d-bb53-81364e18feb4" containerName="swift-ring-rebalance" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207369 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce3d3815-ca29-4e8d-bb53-81364e18feb4" containerName="swift-ring-rebalance" Nov 21 12:24:13 crc kubenswrapper[4769]: E1121 12:24:13.207391 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac14021d-cc6c-403c-bc6d-4c966a882eba" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207399 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac14021d-cc6c-403c-bc6d-4c966a882eba" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: E1121 12:24:13.207428 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" containerName="mariadb-account-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207436 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" containerName="mariadb-account-create" Nov 21 12:24:13 crc kubenswrapper[4769]: E1121 12:24:13.207453 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="604b1833-41e7-4520-b1a8-72e485dcf850" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207460 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="604b1833-41e7-4520-b1a8-72e485dcf850" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: E1121 12:24:13.207474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc358105-4fcf-4ef4-b997-4ffb9f84a473" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc358105-4fcf-4ef4-b997-4ffb9f84a473" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" containerName="mariadb-account-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207706 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc358105-4fcf-4ef4-b997-4ffb9f84a473" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207718 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce3d3815-ca29-4e8d-bb53-81364e18feb4" containerName="swift-ring-rebalance" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207735 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="604b1833-41e7-4520-b1a8-72e485dcf850" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.207750 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac14021d-cc6c-403c-bc6d-4c966a882eba" containerName="mariadb-database-create" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.208764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.214613 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.226138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8"] Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.289120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84lf9\" (UniqueName: \"kubernetes.io/projected/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-kube-api-access-84lf9\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.289278 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.289317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-config\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.289416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.349037 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.392145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.392256 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-config\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.392371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.392400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-84lf9\" (UniqueName: \"kubernetes.io/projected/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-kube-api-access-84lf9\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.493752 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56nl7\" (UniqueName: \"kubernetes.io/projected/671e1e54-25c5-48b3-bb05-05a3b289e9e2-kube-api-access-56nl7\") pod \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.493828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/671e1e54-25c5-48b3-bb05-05a3b289e9e2-operator-scripts\") pod \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\" (UID: \"671e1e54-25c5-48b3-bb05-05a3b289e9e2\") " Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.500178 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/671e1e54-25c5-48b3-bb05-05a3b289e9e2-kube-api-access-56nl7" (OuterVolumeSpecName: "kube-api-access-56nl7") pod "671e1e54-25c5-48b3-bb05-05a3b289e9e2" (UID: "671e1e54-25c5-48b3-bb05-05a3b289e9e2"). InnerVolumeSpecName "kube-api-access-56nl7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.596244 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-56nl7\" (UniqueName: \"kubernetes.io/projected/671e1e54-25c5-48b3-bb05-05a3b289e9e2-kube-api-access-56nl7\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.756421 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.813598 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.813690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-config\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.814085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.820013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/671e1e54-25c5-48b3-bb05-05a3b289e9e2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "671e1e54-25c5-48b3-bb05-05a3b289e9e2" (UID: "671e1e54-25c5-48b3-bb05-05a3b289e9e2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.820612 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-84lf9\" (UniqueName: \"kubernetes.io/projected/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-kube-api-access-84lf9\") pod \"dnsmasq-dnsmasq-77c5df595f-hclk8\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.846131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.900692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-operator-scripts\") pod \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.900814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dzbs\" (UniqueName: \"kubernetes.io/projected/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-kube-api-access-6dzbs\") pod \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\" (UID: \"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8\") " Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.901234 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/671e1e54-25c5-48b3-bb05-05a3b289e9e2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.901259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" (UID: "92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.908211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-kube-api-access-6dzbs" (OuterVolumeSpecName: "kube-api-access-6dzbs") pod "92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" (UID: "92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8"). InnerVolumeSpecName "kube-api-access-6dzbs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.959032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" event={"ID":"671e1e54-25c5-48b3-bb05-05a3b289e9e2","Type":"ContainerDied","Data":"de243874d7a88b94ca5f54e00c2fb3dc09cc5b72970eab71b1942d2c999a6b74"} Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.959072 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-66cf-account-create-bj6f7" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.959086 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de243874d7a88b94ca5f54e00c2fb3dc09cc5b72970eab71b1942d2c999a6b74" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.963571 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.969385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-373d-account-create-hld28" event={"ID":"92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8","Type":"ContainerDied","Data":"a49c5173b13e463c54151f27ef06009e03e3fda52148f736201d3a5a95eb5f69"} Nov 21 12:24:13 crc kubenswrapper[4769]: I1121 12:24:13.969444 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a49c5173b13e463c54151f27ef06009e03e3fda52148f736201d3a5a95eb5f69" Nov 21 12:24:14 crc kubenswrapper[4769]: I1121 12:24:14.003134 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:14 crc kubenswrapper[4769]: I1121 12:24:14.003171 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6dzbs\" (UniqueName: \"kubernetes.io/projected/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8-kube-api-access-6dzbs\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:14 crc kubenswrapper[4769]: I1121 12:24:14.894503 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8"] Nov 21 12:24:14 crc kubenswrapper[4769]: W1121 12:24:14.906479 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f66ab64_6524_45d2_a5fd_8b1c6280f7e4.slice/crio-3f5032a7048714472a11709b6a760efcb57f23901d4cf8a10d505c69b1cbb888 WatchSource:0}: Error finding container 3f5032a7048714472a11709b6a760efcb57f23901d4cf8a10d505c69b1cbb888: Status 404 returned error can't find the container with id 3f5032a7048714472a11709b6a760efcb57f23901d4cf8a10d505c69b1cbb888 Nov 21 12:24:14 crc kubenswrapper[4769]: I1121 12:24:14.977735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" event={"ID":"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4","Type":"ContainerStarted","Data":"3f5032a7048714472a11709b6a760efcb57f23901d4cf8a10d505c69b1cbb888"} Nov 21 12:24:15 crc kubenswrapper[4769]: I1121 12:24:15.989209 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerID="3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2" exitCode=0 Nov 21 12:24:15 crc kubenswrapper[4769]: I1121 12:24:15.989324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" event={"ID":"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4","Type":"ContainerDied","Data":"3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2"} Nov 21 12:24:17 crc kubenswrapper[4769]: I1121 12:24:17.004610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" event={"ID":"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4","Type":"ContainerStarted","Data":"46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1"} Nov 21 12:24:17 crc kubenswrapper[4769]: I1121 12:24:17.005143 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.158790 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" podStartSLOduration=5.158761041 podStartE2EDuration="5.158761041s" podCreationTimestamp="2025-11-21 12:24:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:17.026623496 +0000 UTC m=+2015.727285404" watchObservedRunningTime="2025-11-21 12:24:18.158761041 +0000 UTC m=+2016.859422859" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.161420 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-pztn6"] Nov 21 12:24:18 crc kubenswrapper[4769]: E1121 12:24:18.161890 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" containerName="mariadb-account-create" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.161910 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" containerName="mariadb-account-create" Nov 21 12:24:18 crc kubenswrapper[4769]: E1121 12:24:18.161919 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="671e1e54-25c5-48b3-bb05-05a3b289e9e2" containerName="mariadb-account-create" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.161927 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="671e1e54-25c5-48b3-bb05-05a3b289e9e2" containerName="mariadb-account-create" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.162100 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="671e1e54-25c5-48b3-bb05-05a3b289e9e2" containerName="mariadb-account-create" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.162131 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" containerName="mariadb-account-create" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.163367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.165930 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-7n5nd" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.169339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.176536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-pztn6"] Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.286076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-config-data\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.286279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-db-sync-config-data\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.286335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-combined-ca-bundle\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.286828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfstt\" (UniqueName: \"kubernetes.io/projected/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-kube-api-access-qfstt\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.388801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-db-sync-config-data\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.388885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-combined-ca-bundle\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.388968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qfstt\" (UniqueName: \"kubernetes.io/projected/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-kube-api-access-qfstt\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.389009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-config-data\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.397712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-config-data\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.397949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-combined-ca-bundle\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.406934 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-db-sync-config-data\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.409453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfstt\" (UniqueName: \"kubernetes.io/projected/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-kube-api-access-qfstt\") pod \"glance-db-sync-pztn6\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:18 crc kubenswrapper[4769]: I1121 12:24:18.494817 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:19 crc kubenswrapper[4769]: I1121 12:24:19.063799 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-pztn6"] Nov 21 12:24:19 crc kubenswrapper[4769]: W1121 12:24:19.073321 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dd433e9_e3b1_47c7_877c_6c83f995bd4c.slice/crio-168751f5b8e25e7e49734cae2a67d2a2c6da0c25cdc17daf9b8c42ea37b37c9b WatchSource:0}: Error finding container 168751f5b8e25e7e49734cae2a67d2a2c6da0c25cdc17daf9b8c42ea37b37c9b: Status 404 returned error can't find the container with id 168751f5b8e25e7e49734cae2a67d2a2c6da0c25cdc17daf9b8c42ea37b37c9b Nov 21 12:24:19 crc kubenswrapper[4769]: I1121 12:24:19.078958 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.52:5671: connect: connection refused" Nov 21 12:24:20 crc kubenswrapper[4769]: I1121 12:24:20.037727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-pztn6" event={"ID":"0dd433e9-e3b1-47c7-877c-6c83f995bd4c","Type":"ContainerStarted","Data":"15774f550067dcb7af5418d497178549b67d1627c8e35ca80a508d9bb90e4de7"} Nov 21 12:24:20 crc kubenswrapper[4769]: I1121 12:24:20.038151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-pztn6" event={"ID":"0dd433e9-e3b1-47c7-877c-6c83f995bd4c","Type":"ContainerStarted","Data":"168751f5b8e25e7e49734cae2a67d2a2c6da0c25cdc17daf9b8c42ea37b37c9b"} Nov 21 12:24:20 crc kubenswrapper[4769]: I1121 12:24:20.058951 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-pztn6" podStartSLOduration=2.058931934 podStartE2EDuration="2.058931934s" podCreationTimestamp="2025-11-21 12:24:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:20.055729018 +0000 UTC m=+2018.756390836" watchObservedRunningTime="2025-11-21 12:24:20.058931934 +0000 UTC m=+2018.759593752" Nov 21 12:24:20 crc kubenswrapper[4769]: I1121 12:24:20.387423 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.53:5671: connect: connection refused" Nov 21 12:24:23 crc kubenswrapper[4769]: I1121 12:24:23.848462 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:24:23 crc kubenswrapper[4769]: I1121 12:24:23.914722 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk"] Nov 21 12:24:23 crc kubenswrapper[4769]: I1121 12:24:23.915840 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" containerName="dnsmasq-dns" containerID="cri-o://542b491b21e908de2d7297ec51130ad71e78e10c3f85f5f11dbceaf65046f90b" gracePeriod=10 Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.087617 4769 generic.go:334] "Generic (PLEG): container finished" podID="c81a2490-fdac-4a03-abd8-081f31034cee" containerID="542b491b21e908de2d7297ec51130ad71e78e10c3f85f5f11dbceaf65046f90b" exitCode=0 Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.087693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" event={"ID":"c81a2490-fdac-4a03-abd8-081f31034cee","Type":"ContainerDied","Data":"542b491b21e908de2d7297ec51130ad71e78e10c3f85f5f11dbceaf65046f90b"} Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.370810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.505028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr2vr\" (UniqueName: \"kubernetes.io/projected/c81a2490-fdac-4a03-abd8-081f31034cee-kube-api-access-mr2vr\") pod \"c81a2490-fdac-4a03-abd8-081f31034cee\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.505109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-dnsmasq-svc\") pod \"c81a2490-fdac-4a03-abd8-081f31034cee\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.505143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-config\") pod \"c81a2490-fdac-4a03-abd8-081f31034cee\" (UID: \"c81a2490-fdac-4a03-abd8-081f31034cee\") " Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.515350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81a2490-fdac-4a03-abd8-081f31034cee-kube-api-access-mr2vr" (OuterVolumeSpecName: "kube-api-access-mr2vr") pod "c81a2490-fdac-4a03-abd8-081f31034cee" (UID: "c81a2490-fdac-4a03-abd8-081f31034cee"). InnerVolumeSpecName "kube-api-access-mr2vr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.554631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "c81a2490-fdac-4a03-abd8-081f31034cee" (UID: "c81a2490-fdac-4a03-abd8-081f31034cee"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.558590 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-config" (OuterVolumeSpecName: "config") pod "c81a2490-fdac-4a03-abd8-081f31034cee" (UID: "c81a2490-fdac-4a03-abd8-081f31034cee"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.606529 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.606563 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81a2490-fdac-4a03-abd8-081f31034cee-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:24 crc kubenswrapper[4769]: I1121 12:24:24.606575 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mr2vr\" (UniqueName: \"kubernetes.io/projected/c81a2490-fdac-4a03-abd8-081f31034cee-kube-api-access-mr2vr\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.103277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" event={"ID":"c81a2490-fdac-4a03-abd8-081f31034cee","Type":"ContainerDied","Data":"6a1e7e9098daeddacf0f378f01fe250f8f7db2028946315a6c703e92b6ba4f65"} Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.104830 4769 scope.go:117] "RemoveContainer" containerID="542b491b21e908de2d7297ec51130ad71e78e10c3f85f5f11dbceaf65046f90b" Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.103417 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk" Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.129229 4769 scope.go:117] "RemoveContainer" containerID="c38ecbe20dbb6e7844107011aaf892c606a0f887d18c974d40faabcdbdc9d2ad" Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.147331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk"] Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.153529 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kmfvk"] Nov 21 12:24:25 crc kubenswrapper[4769]: I1121 12:24:25.287917 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" path="/var/lib/kubelet/pods/c81a2490-fdac-4a03-abd8-081f31034cee/volumes" Nov 21 12:24:29 crc kubenswrapper[4769]: I1121 12:24:29.785063 4769 generic.go:334] "Generic (PLEG): container finished" podID="0dd433e9-e3b1-47c7-877c-6c83f995bd4c" containerID="15774f550067dcb7af5418d497178549b67d1627c8e35ca80a508d9bb90e4de7" exitCode=0 Nov 21 12:24:29 crc kubenswrapper[4769]: I1121 12:24:29.788654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-pztn6" event={"ID":"0dd433e9-e3b1-47c7-877c-6c83f995bd4c","Type":"ContainerDied","Data":"15774f550067dcb7af5418d497178549b67d1627c8e35ca80a508d9bb90e4de7"} Nov 21 12:24:29 crc kubenswrapper[4769]: I1121 12:24:29.788761 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.387429 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.488892 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gk5gc"] Nov 21 12:24:30 crc kubenswrapper[4769]: E1121 12:24:30.489555 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" containerName="init" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.489577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" containerName="init" Nov 21 12:24:30 crc kubenswrapper[4769]: E1121 12:24:30.489629 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" containerName="dnsmasq-dns" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.489639 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" containerName="dnsmasq-dns" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.489848 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c81a2490-fdac-4a03-abd8-081f31034cee" containerName="dnsmasq-dns" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.492453 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.497210 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-86b3-account-create-2525f"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.498537 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.506670 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.513053 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gk5gc"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.524690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-86b3-account-create-2525f"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.592170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7b9886a-baca-4a98-923f-e0fb3babcdda-operator-scripts\") pod \"cinder-db-create-gk5gc\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.592296 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68e643ab-0142-4d28-a377-0898eadcc05d-operator-scripts\") pod \"neutron-86b3-account-create-2525f\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.592440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75m86\" (UniqueName: \"kubernetes.io/projected/f7b9886a-baca-4a98-923f-e0fb3babcdda-kube-api-access-75m86\") pod \"cinder-db-create-gk5gc\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.592484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzfqx\" (UniqueName: \"kubernetes.io/projected/68e643ab-0142-4d28-a377-0898eadcc05d-kube-api-access-lzfqx\") pod \"neutron-86b3-account-create-2525f\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.627574 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-sw29s"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.629054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.634324 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-52d4-account-create-8z4wn"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.637682 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.640479 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.642521 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-sw29s"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.666453 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-52d4-account-create-8z4wn"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.695889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lzfqx\" (UniqueName: \"kubernetes.io/projected/68e643ab-0142-4d28-a377-0898eadcc05d-kube-api-access-lzfqx\") pod \"neutron-86b3-account-create-2525f\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.696012 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7b9886a-baca-4a98-923f-e0fb3babcdda-operator-scripts\") pod \"cinder-db-create-gk5gc\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.696043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68e643ab-0142-4d28-a377-0898eadcc05d-operator-scripts\") pod \"neutron-86b3-account-create-2525f\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.696091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75m86\" (UniqueName: \"kubernetes.io/projected/f7b9886a-baca-4a98-923f-e0fb3babcdda-kube-api-access-75m86\") pod \"cinder-db-create-gk5gc\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.697168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7b9886a-baca-4a98-923f-e0fb3babcdda-operator-scripts\") pod \"cinder-db-create-gk5gc\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.697681 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68e643ab-0142-4d28-a377-0898eadcc05d-operator-scripts\") pod \"neutron-86b3-account-create-2525f\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.708437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-4vv6g"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.709592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.712961 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.713116 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m5bqk" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.713309 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.713800 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.715656 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-h4m9w"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.717557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.723814 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-e4c5-account-create-kvk88"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.725690 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.731418 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-h4m9w"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.731821 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.732090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75m86\" (UniqueName: \"kubernetes.io/projected/f7b9886a-baca-4a98-923f-e0fb3babcdda-kube-api-access-75m86\") pod \"cinder-db-create-gk5gc\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.737174 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-4vv6g"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.741474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzfqx\" (UniqueName: \"kubernetes.io/projected/68e643ab-0142-4d28-a377-0898eadcc05d-kube-api-access-lzfqx\") pod \"neutron-86b3-account-create-2525f\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.752253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-e4c5-account-create-kvk88"] Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vkb\" (UniqueName: \"kubernetes.io/projected/d7c3a781-961d-45dd-97d9-e9aa801d7509-kube-api-access-r2vkb\") pod \"neutron-db-create-sw29s\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xwvc\" (UniqueName: \"kubernetes.io/projected/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-kube-api-access-2xwvc\") pod \"barbican-e4c5-account-create-kvk88\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c3a781-961d-45dd-97d9-e9aa801d7509-operator-scripts\") pod \"neutron-db-create-sw29s\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-operator-scripts\") pod \"barbican-e4c5-account-create-kvk88\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-combined-ca-bundle\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9j66\" (UniqueName: \"kubernetes.io/projected/cb25d455-8cb7-4773-952f-e2068b8a1cf3-kube-api-access-s9j66\") pod \"cinder-52d4-account-create-8z4wn\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.797970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hfvv\" (UniqueName: \"kubernetes.io/projected/47bb1f7f-bd48-42d7-b497-8e9e11655921-kube-api-access-9hfvv\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.798005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxrnl\" (UniqueName: \"kubernetes.io/projected/adde1786-1486-4f06-beea-c00fe553b03f-kube-api-access-rxrnl\") pod \"barbican-db-create-h4m9w\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.798028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb25d455-8cb7-4773-952f-e2068b8a1cf3-operator-scripts\") pod \"cinder-52d4-account-create-8z4wn\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.798226 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/adde1786-1486-4f06-beea-c00fe553b03f-operator-scripts\") pod \"barbican-db-create-h4m9w\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.798256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-config-data\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.819550 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.829249 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.900465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-combined-ca-bundle\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.901085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s9j66\" (UniqueName: \"kubernetes.io/projected/cb25d455-8cb7-4773-952f-e2068b8a1cf3-kube-api-access-s9j66\") pod \"cinder-52d4-account-create-8z4wn\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.901129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9hfvv\" (UniqueName: \"kubernetes.io/projected/47bb1f7f-bd48-42d7-b497-8e9e11655921-kube-api-access-9hfvv\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.901166 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rxrnl\" (UniqueName: \"kubernetes.io/projected/adde1786-1486-4f06-beea-c00fe553b03f-kube-api-access-rxrnl\") pod \"barbican-db-create-h4m9w\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.901243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb25d455-8cb7-4773-952f-e2068b8a1cf3-operator-scripts\") pod \"cinder-52d4-account-create-8z4wn\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.901714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/adde1786-1486-4f06-beea-c00fe553b03f-operator-scripts\") pod \"barbican-db-create-h4m9w\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.901796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-config-data\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.902319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb25d455-8cb7-4773-952f-e2068b8a1cf3-operator-scripts\") pod \"cinder-52d4-account-create-8z4wn\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.902513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/adde1786-1486-4f06-beea-c00fe553b03f-operator-scripts\") pod \"barbican-db-create-h4m9w\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.902710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vkb\" (UniqueName: \"kubernetes.io/projected/d7c3a781-961d-45dd-97d9-e9aa801d7509-kube-api-access-r2vkb\") pod \"neutron-db-create-sw29s\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.903048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2xwvc\" (UniqueName: \"kubernetes.io/projected/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-kube-api-access-2xwvc\") pod \"barbican-e4c5-account-create-kvk88\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.903549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c3a781-961d-45dd-97d9-e9aa801d7509-operator-scripts\") pod \"neutron-db-create-sw29s\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.904389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-operator-scripts\") pod \"barbican-e4c5-account-create-kvk88\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.917435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-config-data\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.917931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-combined-ca-bundle\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.919968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-operator-scripts\") pod \"barbican-e4c5-account-create-kvk88\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.920368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c3a781-961d-45dd-97d9-e9aa801d7509-operator-scripts\") pod \"neutron-db-create-sw29s\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.922761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxrnl\" (UniqueName: \"kubernetes.io/projected/adde1786-1486-4f06-beea-c00fe553b03f-kube-api-access-rxrnl\") pod \"barbican-db-create-h4m9w\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.926472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vkb\" (UniqueName: \"kubernetes.io/projected/d7c3a781-961d-45dd-97d9-e9aa801d7509-kube-api-access-r2vkb\") pod \"neutron-db-create-sw29s\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.926816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hfvv\" (UniqueName: \"kubernetes.io/projected/47bb1f7f-bd48-42d7-b497-8e9e11655921-kube-api-access-9hfvv\") pod \"keystone-db-sync-4vv6g\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.941509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9j66\" (UniqueName: \"kubernetes.io/projected/cb25d455-8cb7-4773-952f-e2068b8a1cf3-kube-api-access-s9j66\") pod \"cinder-52d4-account-create-8z4wn\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.944829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xwvc\" (UniqueName: \"kubernetes.io/projected/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-kube-api-access-2xwvc\") pod \"barbican-e4c5-account-create-kvk88\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.953852 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:30 crc kubenswrapper[4769]: I1121 12:24:30.966649 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.027424 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.111321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.119725 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.214486 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.312291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-combined-ca-bundle\") pod \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.312369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-db-sync-config-data\") pod \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.312411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-config-data\") pod \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.312474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfstt\" (UniqueName: \"kubernetes.io/projected/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-kube-api-access-qfstt\") pod \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\" (UID: \"0dd433e9-e3b1-47c7-877c-6c83f995bd4c\") " Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.317344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0dd433e9-e3b1-47c7-877c-6c83f995bd4c" (UID: "0dd433e9-e3b1-47c7-877c-6c83f995bd4c"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.318591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-kube-api-access-qfstt" (OuterVolumeSpecName: "kube-api-access-qfstt") pod "0dd433e9-e3b1-47c7-877c-6c83f995bd4c" (UID: "0dd433e9-e3b1-47c7-877c-6c83f995bd4c"). InnerVolumeSpecName "kube-api-access-qfstt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.381168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0dd433e9-e3b1-47c7-877c-6c83f995bd4c" (UID: "0dd433e9-e3b1-47c7-877c-6c83f995bd4c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.385367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-config-data" (OuterVolumeSpecName: "config-data") pod "0dd433e9-e3b1-47c7-877c-6c83f995bd4c" (UID: "0dd433e9-e3b1-47c7-877c-6c83f995bd4c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.414719 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.415075 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.415176 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.415290 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qfstt\" (UniqueName: \"kubernetes.io/projected/0dd433e9-e3b1-47c7-877c-6c83f995bd4c-kube-api-access-qfstt\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.515255 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gk5gc"] Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.521574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-86b3-account-create-2525f"] Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.643841 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-sw29s"] Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.648670 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-4vv6g"] Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.660318 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-52d4-account-create-8z4wn"] Nov 21 12:24:31 crc kubenswrapper[4769]: W1121 12:24:31.683390 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47bb1f7f_bd48_42d7_b497_8e9e11655921.slice/crio-5ea3bd9534cd81c0f405081b14ec928225cdf211c71af56a23821a5c12e1616d WatchSource:0}: Error finding container 5ea3bd9534cd81c0f405081b14ec928225cdf211c71af56a23821a5c12e1616d: Status 404 returned error can't find the container with id 5ea3bd9534cd81c0f405081b14ec928225cdf211c71af56a23821a5c12e1616d Nov 21 12:24:31 crc kubenswrapper[4769]: W1121 12:24:31.684294 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb25d455_8cb7_4773_952f_e2068b8a1cf3.slice/crio-72ff5e2630af4fc86977eaff3a4ff824404b00e8b68ccab24022faf285863595 WatchSource:0}: Error finding container 72ff5e2630af4fc86977eaff3a4ff824404b00e8b68ccab24022faf285863595: Status 404 returned error can't find the container with id 72ff5e2630af4fc86977eaff3a4ff824404b00e8b68ccab24022faf285863595 Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.782160 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-h4m9w"] Nov 21 12:24:31 crc kubenswrapper[4769]: W1121 12:24:31.796324 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadde1786_1486_4f06_beea_c00fe553b03f.slice/crio-fae643216b4ddaf61ac59aa4fcfaaab72ae34e313479017f7df6dafa26567684 WatchSource:0}: Error finding container fae643216b4ddaf61ac59aa4fcfaaab72ae34e313479017f7df6dafa26567684: Status 404 returned error can't find the container with id fae643216b4ddaf61ac59aa4fcfaaab72ae34e313479017f7df6dafa26567684 Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.797606 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-e4c5-account-create-kvk88"] Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.810251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-sw29s" event={"ID":"d7c3a781-961d-45dd-97d9-e9aa801d7509","Type":"ContainerStarted","Data":"c2481314a1a30520b96e445bb21bb2a0fe417b0386843bbb36946091f3c07a65"} Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.814284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" event={"ID":"68e643ab-0142-4d28-a377-0898eadcc05d","Type":"ContainerStarted","Data":"027a9dd9e412241ea2940cac379c3cd23613165f2ea7688bbf320ae3c72b2ea5"} Nov 21 12:24:31 crc kubenswrapper[4769]: W1121 12:24:31.815056 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22fba7dc_2c76_4d2b_85c1_750c7d129bf2.slice/crio-0479d06a505fe77907cdee7c914a284dba12dcad5c3f032ea3f09756d06ab084 WatchSource:0}: Error finding container 0479d06a505fe77907cdee7c914a284dba12dcad5c3f032ea3f09756d06ab084: Status 404 returned error can't find the container with id 0479d06a505fe77907cdee7c914a284dba12dcad5c3f032ea3f09756d06ab084 Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.816884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-pztn6" event={"ID":"0dd433e9-e3b1-47c7-877c-6c83f995bd4c","Type":"ContainerDied","Data":"168751f5b8e25e7e49734cae2a67d2a2c6da0c25cdc17daf9b8c42ea37b37c9b"} Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.816914 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="168751f5b8e25e7e49734cae2a67d2a2c6da0c25cdc17daf9b8c42ea37b37c9b" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.816965 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-pztn6" Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.825919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" event={"ID":"cb25d455-8cb7-4773-952f-e2068b8a1cf3","Type":"ContainerStarted","Data":"72ff5e2630af4fc86977eaff3a4ff824404b00e8b68ccab24022faf285863595"} Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.829377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" event={"ID":"f7b9886a-baca-4a98-923f-e0fb3babcdda","Type":"ContainerStarted","Data":"c915e08011e6873975688d776fd775a80bb6a3f9e0f7d0984c0885739194ae55"} Nov 21 12:24:31 crc kubenswrapper[4769]: I1121 12:24:31.830833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" event={"ID":"47bb1f7f-bd48-42d7-b497-8e9e11655921","Type":"ContainerStarted","Data":"5ea3bd9534cd81c0f405081b14ec928225cdf211c71af56a23821a5c12e1616d"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.849398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" event={"ID":"47bb1f7f-bd48-42d7-b497-8e9e11655921","Type":"ContainerStarted","Data":"25070b5e073722fbf768807336bc4bfa2ca583acd8fcb2aa476ec1d03a2ec1b6"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.851737 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7c3a781-961d-45dd-97d9-e9aa801d7509" containerID="6edf7cd6d8163b95694ee40e477a96ba17df549016a69f8de6bdc6969ef4ad5c" exitCode=0 Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.851891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-sw29s" event={"ID":"d7c3a781-961d-45dd-97d9-e9aa801d7509","Type":"ContainerDied","Data":"6edf7cd6d8163b95694ee40e477a96ba17df549016a69f8de6bdc6969ef4ad5c"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.855626 4769 generic.go:334] "Generic (PLEG): container finished" podID="68e643ab-0142-4d28-a377-0898eadcc05d" containerID="4c1271d87070a5329e5ff71497e2f2894121ffab73d18121bfbedfe5a46a6e1e" exitCode=0 Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.855844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" event={"ID":"68e643ab-0142-4d28-a377-0898eadcc05d","Type":"ContainerDied","Data":"4c1271d87070a5329e5ff71497e2f2894121ffab73d18121bfbedfe5a46a6e1e"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.859068 4769 generic.go:334] "Generic (PLEG): container finished" podID="adde1786-1486-4f06-beea-c00fe553b03f" containerID="a9ae22ffd24de7390c9cc9842daaefa370b05b064ec18dbfa6ccfd268a7e3ab7" exitCode=0 Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.859302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" event={"ID":"adde1786-1486-4f06-beea-c00fe553b03f","Type":"ContainerDied","Data":"a9ae22ffd24de7390c9cc9842daaefa370b05b064ec18dbfa6ccfd268a7e3ab7"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.859368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" event={"ID":"adde1786-1486-4f06-beea-c00fe553b03f","Type":"ContainerStarted","Data":"fae643216b4ddaf61ac59aa4fcfaaab72ae34e313479017f7df6dafa26567684"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.862525 4769 generic.go:334] "Generic (PLEG): container finished" podID="cb25d455-8cb7-4773-952f-e2068b8a1cf3" containerID="a546c811f7df0e8503de989e9d47a22546f89b5f747037b4247c6b6633765d4c" exitCode=0 Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.862721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" event={"ID":"cb25d455-8cb7-4773-952f-e2068b8a1cf3","Type":"ContainerDied","Data":"a546c811f7df0e8503de989e9d47a22546f89b5f747037b4247c6b6633765d4c"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.866576 4769 generic.go:334] "Generic (PLEG): container finished" podID="22fba7dc-2c76-4d2b-85c1-750c7d129bf2" containerID="fb16a4a291827afdd973408f298978029b8b5147fa9c999a7f9071f4e72c36aa" exitCode=0 Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.866727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" event={"ID":"22fba7dc-2c76-4d2b-85c1-750c7d129bf2","Type":"ContainerDied","Data":"fb16a4a291827afdd973408f298978029b8b5147fa9c999a7f9071f4e72c36aa"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.866936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" event={"ID":"22fba7dc-2c76-4d2b-85c1-750c7d129bf2","Type":"ContainerStarted","Data":"0479d06a505fe77907cdee7c914a284dba12dcad5c3f032ea3f09756d06ab084"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.882687 4769 generic.go:334] "Generic (PLEG): container finished" podID="f7b9886a-baca-4a98-923f-e0fb3babcdda" containerID="82cf8ac697c2dd03cd5196fdcd7201367da1f166c6845f22c5601d6f73e813c4" exitCode=0 Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.882784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" event={"ID":"f7b9886a-baca-4a98-923f-e0fb3babcdda","Type":"ContainerDied","Data":"82cf8ac697c2dd03cd5196fdcd7201367da1f166c6845f22c5601d6f73e813c4"} Nov 21 12:24:32 crc kubenswrapper[4769]: I1121 12:24:32.895520 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" podStartSLOduration=2.895487172 podStartE2EDuration="2.895487172s" podCreationTimestamp="2025-11-21 12:24:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:32.86709111 +0000 UTC m=+2031.567752928" watchObservedRunningTime="2025-11-21 12:24:32.895487172 +0000 UTC m=+2031.596149000" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.290511 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.378056 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxrnl\" (UniqueName: \"kubernetes.io/projected/adde1786-1486-4f06-beea-c00fe553b03f-kube-api-access-rxrnl\") pod \"adde1786-1486-4f06-beea-c00fe553b03f\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.378148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/adde1786-1486-4f06-beea-c00fe553b03f-operator-scripts\") pod \"adde1786-1486-4f06-beea-c00fe553b03f\" (UID: \"adde1786-1486-4f06-beea-c00fe553b03f\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.380771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adde1786-1486-4f06-beea-c00fe553b03f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "adde1786-1486-4f06-beea-c00fe553b03f" (UID: "adde1786-1486-4f06-beea-c00fe553b03f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.431895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adde1786-1486-4f06-beea-c00fe553b03f-kube-api-access-rxrnl" (OuterVolumeSpecName: "kube-api-access-rxrnl") pod "adde1786-1486-4f06-beea-c00fe553b03f" (UID: "adde1786-1486-4f06-beea-c00fe553b03f"). InnerVolumeSpecName "kube-api-access-rxrnl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.482296 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rxrnl\" (UniqueName: \"kubernetes.io/projected/adde1786-1486-4f06-beea-c00fe553b03f-kube-api-access-rxrnl\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.482339 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/adde1786-1486-4f06-beea-c00fe553b03f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.607466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.616615 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.629012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.646267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.699785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb25d455-8cb7-4773-952f-e2068b8a1cf3-operator-scripts\") pod \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.700114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9j66\" (UniqueName: \"kubernetes.io/projected/cb25d455-8cb7-4773-952f-e2068b8a1cf3-kube-api-access-s9j66\") pod \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\" (UID: \"cb25d455-8cb7-4773-952f-e2068b8a1cf3\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.701484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb25d455-8cb7-4773-952f-e2068b8a1cf3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cb25d455-8cb7-4773-952f-e2068b8a1cf3" (UID: "cb25d455-8cb7-4773-952f-e2068b8a1cf3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.706518 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.716542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb25d455-8cb7-4773-952f-e2068b8a1cf3-kube-api-access-s9j66" (OuterVolumeSpecName: "kube-api-access-s9j66") pod "cb25d455-8cb7-4773-952f-e2068b8a1cf3" (UID: "cb25d455-8cb7-4773-952f-e2068b8a1cf3"). InnerVolumeSpecName "kube-api-access-s9j66". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzfqx\" (UniqueName: \"kubernetes.io/projected/68e643ab-0142-4d28-a377-0898eadcc05d-kube-api-access-lzfqx\") pod \"68e643ab-0142-4d28-a377-0898eadcc05d\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-operator-scripts\") pod \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xwvc\" (UniqueName: \"kubernetes.io/projected/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-kube-api-access-2xwvc\") pod \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\" (UID: \"22fba7dc-2c76-4d2b-85c1-750c7d129bf2\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68e643ab-0142-4d28-a377-0898eadcc05d-operator-scripts\") pod \"68e643ab-0142-4d28-a377-0898eadcc05d\" (UID: \"68e643ab-0142-4d28-a377-0898eadcc05d\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c3a781-961d-45dd-97d9-e9aa801d7509-operator-scripts\") pod \"d7c3a781-961d-45dd-97d9-e9aa801d7509\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2vkb\" (UniqueName: \"kubernetes.io/projected/d7c3a781-961d-45dd-97d9-e9aa801d7509-kube-api-access-r2vkb\") pod \"d7c3a781-961d-45dd-97d9-e9aa801d7509\" (UID: \"d7c3a781-961d-45dd-97d9-e9aa801d7509\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75m86\" (UniqueName: \"kubernetes.io/projected/f7b9886a-baca-4a98-923f-e0fb3babcdda-kube-api-access-75m86\") pod \"f7b9886a-baca-4a98-923f-e0fb3babcdda\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7b9886a-baca-4a98-923f-e0fb3babcdda-operator-scripts\") pod \"f7b9886a-baca-4a98-923f-e0fb3babcdda\" (UID: \"f7b9886a-baca-4a98-923f-e0fb3babcdda\") " Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806870 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cb25d455-8cb7-4773-952f-e2068b8a1cf3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.806895 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s9j66\" (UniqueName: \"kubernetes.io/projected/cb25d455-8cb7-4773-952f-e2068b8a1cf3-kube-api-access-s9j66\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.807419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b9886a-baca-4a98-923f-e0fb3babcdda-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f7b9886a-baca-4a98-923f-e0fb3babcdda" (UID: "f7b9886a-baca-4a98-923f-e0fb3babcdda"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.813918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e643ab-0142-4d28-a377-0898eadcc05d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "68e643ab-0142-4d28-a377-0898eadcc05d" (UID: "68e643ab-0142-4d28-a377-0898eadcc05d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.814180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "22fba7dc-2c76-4d2b-85c1-750c7d129bf2" (UID: "22fba7dc-2c76-4d2b-85c1-750c7d129bf2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.814730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c3a781-961d-45dd-97d9-e9aa801d7509-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d7c3a781-961d-45dd-97d9-e9aa801d7509" (UID: "d7c3a781-961d-45dd-97d9-e9aa801d7509"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.838438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e643ab-0142-4d28-a377-0898eadcc05d-kube-api-access-lzfqx" (OuterVolumeSpecName: "kube-api-access-lzfqx") pod "68e643ab-0142-4d28-a377-0898eadcc05d" (UID: "68e643ab-0142-4d28-a377-0898eadcc05d"). InnerVolumeSpecName "kube-api-access-lzfqx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.838594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-kube-api-access-2xwvc" (OuterVolumeSpecName: "kube-api-access-2xwvc") pod "22fba7dc-2c76-4d2b-85c1-750c7d129bf2" (UID: "22fba7dc-2c76-4d2b-85c1-750c7d129bf2"). InnerVolumeSpecName "kube-api-access-2xwvc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.841414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b9886a-baca-4a98-923f-e0fb3babcdda-kube-api-access-75m86" (OuterVolumeSpecName: "kube-api-access-75m86") pod "f7b9886a-baca-4a98-923f-e0fb3babcdda" (UID: "f7b9886a-baca-4a98-923f-e0fb3babcdda"). InnerVolumeSpecName "kube-api-access-75m86". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.841508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c3a781-961d-45dd-97d9-e9aa801d7509-kube-api-access-r2vkb" (OuterVolumeSpecName: "kube-api-access-r2vkb") pod "d7c3a781-961d-45dd-97d9-e9aa801d7509" (UID: "d7c3a781-961d-45dd-97d9-e9aa801d7509"). InnerVolumeSpecName "kube-api-access-r2vkb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910209 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lzfqx\" (UniqueName: \"kubernetes.io/projected/68e643ab-0142-4d28-a377-0898eadcc05d-kube-api-access-lzfqx\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910282 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910298 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2xwvc\" (UniqueName: \"kubernetes.io/projected/22fba7dc-2c76-4d2b-85c1-750c7d129bf2-kube-api-access-2xwvc\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910313 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/68e643ab-0142-4d28-a377-0898eadcc05d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910327 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c3a781-961d-45dd-97d9-e9aa801d7509-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910339 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r2vkb\" (UniqueName: \"kubernetes.io/projected/d7c3a781-961d-45dd-97d9-e9aa801d7509-kube-api-access-r2vkb\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910351 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75m86\" (UniqueName: \"kubernetes.io/projected/f7b9886a-baca-4a98-923f-e0fb3babcdda-kube-api-access-75m86\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.910361 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7b9886a-baca-4a98-923f-e0fb3babcdda-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.926145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" event={"ID":"f7b9886a-baca-4a98-923f-e0fb3babcdda","Type":"ContainerDied","Data":"c915e08011e6873975688d776fd775a80bb6a3f9e0f7d0984c0885739194ae55"} Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.926230 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c915e08011e6873975688d776fd775a80bb6a3f9e0f7d0984c0885739194ae55" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.926331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gk5gc" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.930150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-sw29s" event={"ID":"d7c3a781-961d-45dd-97d9-e9aa801d7509","Type":"ContainerDied","Data":"c2481314a1a30520b96e445bb21bb2a0fe417b0386843bbb36946091f3c07a65"} Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.930225 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2481314a1a30520b96e445bb21bb2a0fe417b0386843bbb36946091f3c07a65" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.930318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-sw29s" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.934863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" event={"ID":"68e643ab-0142-4d28-a377-0898eadcc05d","Type":"ContainerDied","Data":"027a9dd9e412241ea2940cac379c3cd23613165f2ea7688bbf320ae3c72b2ea5"} Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.934897 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="027a9dd9e412241ea2940cac379c3cd23613165f2ea7688bbf320ae3c72b2ea5" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.934932 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-86b3-account-create-2525f" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.937583 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.937582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-h4m9w" event={"ID":"adde1786-1486-4f06-beea-c00fe553b03f","Type":"ContainerDied","Data":"fae643216b4ddaf61ac59aa4fcfaaab72ae34e313479017f7df6dafa26567684"} Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.937683 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fae643216b4ddaf61ac59aa4fcfaaab72ae34e313479017f7df6dafa26567684" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.939912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" event={"ID":"cb25d455-8cb7-4773-952f-e2068b8a1cf3","Type":"ContainerDied","Data":"72ff5e2630af4fc86977eaff3a4ff824404b00e8b68ccab24022faf285863595"} Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.939948 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72ff5e2630af4fc86977eaff3a4ff824404b00e8b68ccab24022faf285863595" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.940047 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-52d4-account-create-8z4wn" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.942870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" event={"ID":"22fba7dc-2c76-4d2b-85c1-750c7d129bf2","Type":"ContainerDied","Data":"0479d06a505fe77907cdee7c914a284dba12dcad5c3f032ea3f09756d06ab084"} Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.942933 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0479d06a505fe77907cdee7c914a284dba12dcad5c3f032ea3f09756d06ab084" Nov 21 12:24:34 crc kubenswrapper[4769]: I1121 12:24:34.943021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e4c5-account-create-kvk88" Nov 21 12:24:42 crc kubenswrapper[4769]: I1121 12:24:42.008991 4769 generic.go:334] "Generic (PLEG): container finished" podID="47bb1f7f-bd48-42d7-b497-8e9e11655921" containerID="25070b5e073722fbf768807336bc4bfa2ca583acd8fcb2aa476ec1d03a2ec1b6" exitCode=0 Nov 21 12:24:42 crc kubenswrapper[4769]: I1121 12:24:42.009081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" event={"ID":"47bb1f7f-bd48-42d7-b497-8e9e11655921","Type":"ContainerDied","Data":"25070b5e073722fbf768807336bc4bfa2ca583acd8fcb2aa476ec1d03a2ec1b6"} Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.334463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.447436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-config-data\") pod \"47bb1f7f-bd48-42d7-b497-8e9e11655921\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.447635 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hfvv\" (UniqueName: \"kubernetes.io/projected/47bb1f7f-bd48-42d7-b497-8e9e11655921-kube-api-access-9hfvv\") pod \"47bb1f7f-bd48-42d7-b497-8e9e11655921\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.447678 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-combined-ca-bundle\") pod \"47bb1f7f-bd48-42d7-b497-8e9e11655921\" (UID: \"47bb1f7f-bd48-42d7-b497-8e9e11655921\") " Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.451965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47bb1f7f-bd48-42d7-b497-8e9e11655921-kube-api-access-9hfvv" (OuterVolumeSpecName: "kube-api-access-9hfvv") pod "47bb1f7f-bd48-42d7-b497-8e9e11655921" (UID: "47bb1f7f-bd48-42d7-b497-8e9e11655921"). InnerVolumeSpecName "kube-api-access-9hfvv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.477430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47bb1f7f-bd48-42d7-b497-8e9e11655921" (UID: "47bb1f7f-bd48-42d7-b497-8e9e11655921"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.499336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-config-data" (OuterVolumeSpecName: "config-data") pod "47bb1f7f-bd48-42d7-b497-8e9e11655921" (UID: "47bb1f7f-bd48-42d7-b497-8e9e11655921"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.550261 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9hfvv\" (UniqueName: \"kubernetes.io/projected/47bb1f7f-bd48-42d7-b497-8e9e11655921-kube-api-access-9hfvv\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.550306 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:43 crc kubenswrapper[4769]: I1121 12:24:43.550323 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47bb1f7f-bd48-42d7-b497-8e9e11655921-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.030887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" event={"ID":"47bb1f7f-bd48-42d7-b497-8e9e11655921","Type":"ContainerDied","Data":"5ea3bd9534cd81c0f405081b14ec928225cdf211c71af56a23821a5c12e1616d"} Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.031280 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ea3bd9534cd81c0f405081b14ec928225cdf211c71af56a23821a5c12e1616d" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.031002 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-4vv6g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.234034 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-82fgg"] Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.234460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0dd433e9-e3b1-47c7-877c-6c83f995bd4c" containerName="glance-db-sync" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.234482 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd433e9-e3b1-47c7-877c-6c83f995bd4c" containerName="glance-db-sync" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235341 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="adde1786-1486-4f06-beea-c00fe553b03f" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235376 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="adde1786-1486-4f06-beea-c00fe553b03f" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235400 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47bb1f7f-bd48-42d7-b497-8e9e11655921" containerName="keystone-db-sync" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235408 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47bb1f7f-bd48-42d7-b497-8e9e11655921" containerName="keystone-db-sync" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235423 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7c3a781-961d-45dd-97d9-e9aa801d7509" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235431 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c3a781-961d-45dd-97d9-e9aa801d7509" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235457 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7b9886a-baca-4a98-923f-e0fb3babcdda" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235465 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b9886a-baca-4a98-923f-e0fb3babcdda" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235486 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="22fba7dc-2c76-4d2b-85c1-750c7d129bf2" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235494 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fba7dc-2c76-4d2b-85c1-750c7d129bf2" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235508 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68e643ab-0142-4d28-a377-0898eadcc05d" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68e643ab-0142-4d28-a377-0898eadcc05d" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: E1121 12:24:44.235537 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cb25d455-8cb7-4773-952f-e2068b8a1cf3" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235545 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb25d455-8cb7-4773-952f-e2068b8a1cf3" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235768 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47bb1f7f-bd48-42d7-b497-8e9e11655921" containerName="keystone-db-sync" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235789 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d7c3a781-961d-45dd-97d9-e9aa801d7509" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235806 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7b9886a-baca-4a98-923f-e0fb3babcdda" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235826 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cb25d455-8cb7-4773-952f-e2068b8a1cf3" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235839 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68e643ab-0142-4d28-a377-0898eadcc05d" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235849 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="22fba7dc-2c76-4d2b-85c1-750c7d129bf2" containerName="mariadb-account-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235859 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0dd433e9-e3b1-47c7-877c-6c83f995bd4c" containerName="glance-db-sync" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.235869 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="adde1786-1486-4f06-beea-c00fe553b03f" containerName="mariadb-database-create" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.236581 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.242552 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.242607 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m5bqk" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.242798 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.242893 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.243058 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.245868 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-82fgg"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.368550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-credential-keys\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.368623 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmfj\" (UniqueName: \"kubernetes.io/projected/b44ece0d-6d96-4475-875e-2785f2a61490-kube-api-access-vcmfj\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.368663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-combined-ca-bundle\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.368698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-fernet-keys\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.368848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-config-data\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.368892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-scripts\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.407485 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-7s4wh"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.409236 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.417377 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.417620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.417885 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-rqx48" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.439999 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-7s4wh"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.469912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-config-data\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.469969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-scripts\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.470044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-credential-keys\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.470086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmfj\" (UniqueName: \"kubernetes.io/projected/b44ece0d-6d96-4475-875e-2785f2a61490-kube-api-access-vcmfj\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.470114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-combined-ca-bundle\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.470139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-fernet-keys\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.490875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-scripts\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.496675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-combined-ca-bundle\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.509204 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-wc85q"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.510397 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.515054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-fernet-keys\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.517677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-config-data\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.527812 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-credential-keys\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.528084 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.528649 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.528759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-nnfbm" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.532268 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-wc85q"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.540157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmfj\" (UniqueName: \"kubernetes.io/projected/b44ece0d-6d96-4475-875e-2785f2a61490-kube-api-access-vcmfj\") pod \"keystone-bootstrap-82fgg\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.563314 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.565833 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.569573 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.570141 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.570365 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.571255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-combined-ca-bundle\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.571415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg7bp\" (UniqueName: \"kubernetes.io/projected/3c096c83-a4ea-4dee-8821-0381ced22974-kube-api-access-xg7bp\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.571454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-config\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.578157 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-ghvhz"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.579707 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.595784 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.596032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-rc2w6" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.596347 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.655847 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.671308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-ghvhz"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-combined-ca-bundle\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-etc-machine-id\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-combined-ca-bundle\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wlhs\" (UniqueName: \"kubernetes.io/projected/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-kube-api-access-2wlhs\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-scripts\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-config-data\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-scripts\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673206 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxgn\" (UniqueName: \"kubernetes.io/projected/42f1192a-d439-40df-8556-73ad9dfb2661-kube-api-access-npxgn\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd64d3c-8006-4019-8e5c-81d4d8467fce-logs\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-run-httpd\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-config-data\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xg7bp\" (UniqueName: \"kubernetes.io/projected/3c096c83-a4ea-4dee-8821-0381ced22974-kube-api-access-xg7bp\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-config\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673352 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-scripts\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-config-data\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673382 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-log-httpd\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-db-sync-config-data\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673430 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kppzz\" (UniqueName: \"kubernetes.io/projected/3dd64d3c-8006-4019-8e5c-81d4d8467fce-kube-api-access-kppzz\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.673457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-combined-ca-bundle\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.683035 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-2lx2g"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.684763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.685362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-config\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.697773 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-vhmfw" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.697851 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.706203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-combined-ca-bundle\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.711885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg7bp\" (UniqueName: \"kubernetes.io/projected/3c096c83-a4ea-4dee-8821-0381ced22974-kube-api-access-xg7bp\") pod \"neutron-db-sync-7s4wh\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.721400 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-2lx2g"] Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.760692 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776006 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-scripts\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-npxgn\" (UniqueName: \"kubernetes.io/projected/42f1192a-d439-40df-8556-73ad9dfb2661-kube-api-access-npxgn\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd64d3c-8006-4019-8e5c-81d4d8467fce-logs\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-combined-ca-bundle\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-run-httpd\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-config-data\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776211 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8w4\" (UniqueName: \"kubernetes.io/projected/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-kube-api-access-tw8w4\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-scripts\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-config-data\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-log-httpd\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-db-sync-config-data\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kppzz\" (UniqueName: \"kubernetes.io/projected/3dd64d3c-8006-4019-8e5c-81d4d8467fce-kube-api-access-kppzz\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-combined-ca-bundle\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-etc-machine-id\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-combined-ca-bundle\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-db-sync-config-data\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776544 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2wlhs\" (UniqueName: \"kubernetes.io/projected/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-kube-api-access-2wlhs\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-scripts\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.776592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-config-data\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.778085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-run-httpd\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.779953 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-etc-machine-id\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.780251 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd64d3c-8006-4019-8e5c-81d4d8467fce-logs\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.780330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-log-httpd\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.782116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-config-data\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.790166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-config-data\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.791495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-db-sync-config-data\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.793567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-config-data\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.797234 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.800440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-scripts\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.805133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-combined-ca-bundle\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.805492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kppzz\" (UniqueName: \"kubernetes.io/projected/3dd64d3c-8006-4019-8e5c-81d4d8467fce-kube-api-access-kppzz\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.805568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.805925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-combined-ca-bundle\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.807945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-scripts\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.808158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxgn\" (UniqueName: \"kubernetes.io/projected/42f1192a-d439-40df-8556-73ad9dfb2661-kube-api-access-npxgn\") pod \"ceilometer-0\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.809618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-scripts\") pod \"placement-db-sync-wc85q\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.812324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wlhs\" (UniqueName: \"kubernetes.io/projected/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-kube-api-access-2wlhs\") pod \"cinder-db-sync-ghvhz\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.878540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-db-sync-config-data\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.878688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-combined-ca-bundle\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.878800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8w4\" (UniqueName: \"kubernetes.io/projected/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-kube-api-access-tw8w4\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.883253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-combined-ca-bundle\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.884156 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-db-sync-config-data\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:44 crc kubenswrapper[4769]: I1121 12:24:44.902452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8w4\" (UniqueName: \"kubernetes.io/projected/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-kube-api-access-tw8w4\") pod \"barbican-db-sync-2lx2g\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.006103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.021205 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.028414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.040532 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.209527 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-82fgg"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.352834 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-7s4wh"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.369474 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.370808 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.372471 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.373444 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.373543 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-7n5nd" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.374017 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:24:45 crc kubenswrapper[4769]: W1121 12:24:45.389448 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c096c83_a4ea_4dee_8821_0381ced22974.slice/crio-80d41982771ce0f29a246f35a0fed9023228acc66e858c9bf921971f9f137899 WatchSource:0}: Error finding container 80d41982771ce0f29a246f35a0fed9023228acc66e858c9bf921971f9f137899: Status 404 returned error can't find the container with id 80d41982771ce0f29a246f35a0fed9023228acc66e858c9bf921971f9f137899 Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.404605 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:45 crc kubenswrapper[4769]: W1121 12:24:45.431325 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dd64d3c_8006_4019_8e5c_81d4d8467fce.slice/crio-4d3d70ea1e2939c5f576d0f598fdf169aab1a2f7de330a171ef242921695b99b WatchSource:0}: Error finding container 4d3d70ea1e2939c5f576d0f598fdf169aab1a2f7de330a171ef242921695b99b: Status 404 returned error can't find the container with id 4d3d70ea1e2939c5f576d0f598fdf169aab1a2f7de330a171ef242921695b99b Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.472720 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-wc85q"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.500826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.500894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.500961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.500987 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-config-data\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.501009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-logs\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.501044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfsj\" (UniqueName: \"kubernetes.io/projected/56599ca2-32ce-4670-a6dd-f9d1e320720b-kube-api-access-rcfsj\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.501074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-scripts\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.501109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.515403 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.516960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.522251 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.522490 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.526889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.602988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-config-data\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-logs\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603086 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfsj\" (UniqueName: \"kubernetes.io/projected/56599ca2-32ce-4670-a6dd-f9d1e320720b-kube-api-access-rcfsj\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-logs\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbz5c\" (UniqueName: \"kubernetes.io/projected/0c569516-558b-48fd-8778-f5a2d48c5c6b-kube-api-access-bbz5c\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-scripts\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603246 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.603920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-logs\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.604129 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.606883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.608297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-scripts\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.612744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.620028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-config-data\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.621882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.626008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfsj\" (UniqueName: \"kubernetes.io/projected/56599ca2-32ce-4670-a6dd-f9d1e320720b-kube-api-access-rcfsj\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.639785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.702604 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-logs\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.704461 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bbz5c\" (UniqueName: \"kubernetes.io/projected/0c569516-558b-48fd-8778-f5a2d48c5c6b-kube-api-access-bbz5c\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.706316 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.711410 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-2lx2g"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.712709 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-logs\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.714726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.716966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.715728 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.717808 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.717820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.725745 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-ghvhz"] Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.731151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.738697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbz5c\" (UniqueName: \"kubernetes.io/projected/0c569516-558b-48fd-8778-f5a2d48c5c6b-kube-api-access-bbz5c\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.755592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:45 crc kubenswrapper[4769]: I1121 12:24:45.797948 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.056753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" event={"ID":"3c096c83-a4ea-4dee-8821-0381ced22974","Type":"ContainerStarted","Data":"80d41982771ce0f29a246f35a0fed9023228acc66e858c9bf921971f9f137899"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.062419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" event={"ID":"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45","Type":"ContainerStarted","Data":"3064287e224db8bc5ea0bbd5413637e1f9f891888ac665401dd1cbccaa4a08db"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.063665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" event={"ID":"08ab69b0-1536-4e46-8ecc-b3cee3a42bff","Type":"ContainerStarted","Data":"8d6b500e7c9242ecd590170774834c9e56ec4c40df02948d343b80942e7ef3a9"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.065808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-wc85q" event={"ID":"3dd64d3c-8006-4019-8e5c-81d4d8467fce","Type":"ContainerStarted","Data":"4d3d70ea1e2939c5f576d0f598fdf169aab1a2f7de330a171ef242921695b99b"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.069488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" event={"ID":"b44ece0d-6d96-4475-875e-2785f2a61490","Type":"ContainerStarted","Data":"2862fbf1d81d9c94b8306e4fdc83e9c8840f95b448a22ed370e61b6cf176a080"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.069545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" event={"ID":"b44ece0d-6d96-4475-875e-2785f2a61490","Type":"ContainerStarted","Data":"aeb304d9919f5f6a611ba04877b98812b24169e224df0dea13ecef313f23939c"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.073644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerStarted","Data":"6d72da84d72e778dd2542d527e85bde4b62e16bfb6466ba2c61e5eaa572edf91"} Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.092483 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" podStartSLOduration=2.09246521 podStartE2EDuration="2.09246521s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:46.088219196 +0000 UTC m=+2044.788881014" watchObservedRunningTime="2025-11-21 12:24:46.09246521 +0000 UTC m=+2044.793127028" Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.248417 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:46 crc kubenswrapper[4769]: W1121 12:24:46.257826 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56599ca2_32ce_4670_a6dd_f9d1e320720b.slice/crio-3f8cb4ff88251c674f60b2b2aba0da64081dd76c3c6a5f87c96c0a4f3b2c6ba9 WatchSource:0}: Error finding container 3f8cb4ff88251c674f60b2b2aba0da64081dd76c3c6a5f87c96c0a4f3b2c6ba9: Status 404 returned error can't find the container with id 3f8cb4ff88251c674f60b2b2aba0da64081dd76c3c6a5f87c96c0a4f3b2c6ba9 Nov 21 12:24:46 crc kubenswrapper[4769]: I1121 12:24:46.359590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:46 crc kubenswrapper[4769]: W1121 12:24:46.372120 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c569516_558b_48fd_8778_f5a2d48c5c6b.slice/crio-09234f407c8e900dc6140a789a945faca6831e2608e68fbd41ef54fae923202c WatchSource:0}: Error finding container 09234f407c8e900dc6140a789a945faca6831e2608e68fbd41ef54fae923202c: Status 404 returned error can't find the container with id 09234f407c8e900dc6140a789a945faca6831e2608e68fbd41ef54fae923202c Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.113907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-wc85q" event={"ID":"3dd64d3c-8006-4019-8e5c-81d4d8467fce","Type":"ContainerStarted","Data":"4d634d8f466ec06243f15d95cd862aa33c18eba6b4a607bc78287d5c530e7477"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.119428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0c569516-558b-48fd-8778-f5a2d48c5c6b","Type":"ContainerStarted","Data":"09234f407c8e900dc6140a789a945faca6831e2608e68fbd41ef54fae923202c"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.124228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"56599ca2-32ce-4670-a6dd-f9d1e320720b","Type":"ContainerStarted","Data":"b4f644d7042f7e2c9bd09706639a3260fcb01bb35d3ae247a5239cf5cecd5dfd"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.124279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"56599ca2-32ce-4670-a6dd-f9d1e320720b","Type":"ContainerStarted","Data":"3f8cb4ff88251c674f60b2b2aba0da64081dd76c3c6a5f87c96c0a4f3b2c6ba9"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.131394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" event={"ID":"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45","Type":"ContainerStarted","Data":"b8cc559f97e9e0be10200b60cefd630c95e22527edbcc750d2fe49e376034217"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.134951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" event={"ID":"3c096c83-a4ea-4dee-8821-0381ced22974","Type":"ContainerStarted","Data":"b561d78b1aab93c805dec672e918401150426bffbf2915c7d48f124611afdd4c"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.136279 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-wc85q" podStartSLOduration=3.136250853 podStartE2EDuration="3.136250853s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:47.132229315 +0000 UTC m=+2045.832891143" watchObservedRunningTime="2025-11-21 12:24:47.136250853 +0000 UTC m=+2045.836912681" Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.141998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" event={"ID":"08ab69b0-1536-4e46-8ecc-b3cee3a42bff","Type":"ContainerStarted","Data":"d4c049ade199c20b955929d81273a1206543d1315fb32842937b919f7b36dd9f"} Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.158393 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" podStartSLOduration=3.158363597 podStartE2EDuration="3.158363597s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:47.149230011 +0000 UTC m=+2045.849891859" watchObservedRunningTime="2025-11-21 12:24:47.158363597 +0000 UTC m=+2045.859025415" Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.171177 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" podStartSLOduration=3.17114958 podStartE2EDuration="3.17114958s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:47.167915403 +0000 UTC m=+2045.868577221" watchObservedRunningTime="2025-11-21 12:24:47.17114958 +0000 UTC m=+2045.871811388" Nov 21 12:24:47 crc kubenswrapper[4769]: I1121 12:24:47.187697 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" podStartSLOduration=3.1876718139999998 podStartE2EDuration="3.187671814s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:47.183154902 +0000 UTC m=+2045.883816720" watchObservedRunningTime="2025-11-21 12:24:47.187671814 +0000 UTC m=+2045.888333632" Nov 21 12:24:48 crc kubenswrapper[4769]: I1121 12:24:48.178084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0c569516-558b-48fd-8778-f5a2d48c5c6b","Type":"ContainerStarted","Data":"f52485247be6d0d6b7dab48774ae67b0bce79139f5930cbee02e90890fb18ecb"} Nov 21 12:24:48 crc kubenswrapper[4769]: I1121 12:24:48.190458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerStarted","Data":"4d7462dff1f44539da4e44f4c408065c2dc8c1aa3fad093665c47990622dba00"} Nov 21 12:24:48 crc kubenswrapper[4769]: I1121 12:24:48.883504 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:48 crc kubenswrapper[4769]: I1121 12:24:48.929167 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:24:48 crc kubenswrapper[4769]: I1121 12:24:48.977953 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:49 crc kubenswrapper[4769]: I1121 12:24:49.200620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0c569516-558b-48fd-8778-f5a2d48c5c6b","Type":"ContainerStarted","Data":"8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0"} Nov 21 12:24:49 crc kubenswrapper[4769]: I1121 12:24:49.202965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"56599ca2-32ce-4670-a6dd-f9d1e320720b","Type":"ContainerStarted","Data":"36fdda48a0bf0cf959b56cc1bc51d44486ecfa17f6523a893a2dce8343b88366"} Nov 21 12:24:49 crc kubenswrapper[4769]: I1121 12:24:49.225775 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.22575401 podStartE2EDuration="5.22575401s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:49.222619526 +0000 UTC m=+2047.923281364" watchObservedRunningTime="2025-11-21 12:24:49.22575401 +0000 UTC m=+2047.926415828" Nov 21 12:24:49 crc kubenswrapper[4769]: I1121 12:24:49.260314 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.260287158 podStartE2EDuration="5.260287158s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:49.250240138 +0000 UTC m=+2047.950901956" watchObservedRunningTime="2025-11-21 12:24:49.260287158 +0000 UTC m=+2047.960948976" Nov 21 12:24:50 crc kubenswrapper[4769]: I1121 12:24:50.214199 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerStarted","Data":"b785b13b3833da7d25aa412e47bbaa59c7dd6101533fb0db6dfb982fddecec37"} Nov 21 12:24:50 crc kubenswrapper[4769]: I1121 12:24:50.214424 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-log" containerID="cri-o://b4f644d7042f7e2c9bd09706639a3260fcb01bb35d3ae247a5239cf5cecd5dfd" gracePeriod=30 Nov 21 12:24:50 crc kubenswrapper[4769]: I1121 12:24:50.214481 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-httpd" containerID="cri-o://36fdda48a0bf0cf959b56cc1bc51d44486ecfa17f6523a893a2dce8343b88366" gracePeriod=30 Nov 21 12:24:50 crc kubenswrapper[4769]: I1121 12:24:50.214506 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-log" containerID="cri-o://f52485247be6d0d6b7dab48774ae67b0bce79139f5930cbee02e90890fb18ecb" gracePeriod=30 Nov 21 12:24:50 crc kubenswrapper[4769]: I1121 12:24:50.214523 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-httpd" containerID="cri-o://8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0" gracePeriod=30 Nov 21 12:24:50 crc kubenswrapper[4769]: E1121 12:24:50.570775 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c569516_558b_48fd_8778_f5a2d48c5c6b.slice/crio-8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c569516_558b_48fd_8778_f5a2d48c5c6b.slice/crio-conmon-8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56599ca2_32ce_4670_a6dd_f9d1e320720b.slice/crio-conmon-b4f644d7042f7e2c9bd09706639a3260fcb01bb35d3ae247a5239cf5cecd5dfd.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56599ca2_32ce_4670_a6dd_f9d1e320720b.slice/crio-conmon-36fdda48a0bf0cf959b56cc1bc51d44486ecfa17f6523a893a2dce8343b88366.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.264323 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerID="8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0" exitCode=0 Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.264636 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerID="f52485247be6d0d6b7dab48774ae67b0bce79139f5930cbee02e90890fb18ecb" exitCode=143 Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.264401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0c569516-558b-48fd-8778-f5a2d48c5c6b","Type":"ContainerDied","Data":"8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0"} Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.264723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0c569516-558b-48fd-8778-f5a2d48c5c6b","Type":"ContainerDied","Data":"f52485247be6d0d6b7dab48774ae67b0bce79139f5930cbee02e90890fb18ecb"} Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.297556 4769 generic.go:334] "Generic (PLEG): container finished" podID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerID="36fdda48a0bf0cf959b56cc1bc51d44486ecfa17f6523a893a2dce8343b88366" exitCode=0 Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.297593 4769 generic.go:334] "Generic (PLEG): container finished" podID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerID="b4f644d7042f7e2c9bd09706639a3260fcb01bb35d3ae247a5239cf5cecd5dfd" exitCode=143 Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.307796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"56599ca2-32ce-4670-a6dd-f9d1e320720b","Type":"ContainerDied","Data":"36fdda48a0bf0cf959b56cc1bc51d44486ecfa17f6523a893a2dce8343b88366"} Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.307849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"56599ca2-32ce-4670-a6dd-f9d1e320720b","Type":"ContainerDied","Data":"b4f644d7042f7e2c9bd09706639a3260fcb01bb35d3ae247a5239cf5cecd5dfd"} Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.307862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"56599ca2-32ce-4670-a6dd-f9d1e320720b","Type":"ContainerDied","Data":"3f8cb4ff88251c674f60b2b2aba0da64081dd76c3c6a5f87c96c0a4f3b2c6ba9"} Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.307874 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f8cb4ff88251c674f60b2b2aba0da64081dd76c3c6a5f87c96c0a4f3b2c6ba9" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.369543 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541359 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-combined-ca-bundle\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-config-data\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541835 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-scripts\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcfsj\" (UniqueName: \"kubernetes.io/projected/56599ca2-32ce-4670-a6dd-f9d1e320720b-kube-api-access-rcfsj\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-public-tls-certs\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-logs\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.541963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.542053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-httpd-run\") pod \"56599ca2-32ce-4670-a6dd-f9d1e320720b\" (UID: \"56599ca2-32ce-4670-a6dd-f9d1e320720b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.543776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.544135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-logs" (OuterVolumeSpecName: "logs") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.547179 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-scripts" (OuterVolumeSpecName: "scripts") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.547904 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "glance") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.549653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56599ca2-32ce-4670-a6dd-f9d1e320720b-kube-api-access-rcfsj" (OuterVolumeSpecName: "kube-api-access-rcfsj") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "kube-api-access-rcfsj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.577519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.598948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.619552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-config-data" (OuterVolumeSpecName: "config-data") pod "56599ca2-32ce-4670-a6dd-f9d1e320720b" (UID: "56599ca2-32ce-4670-a6dd-f9d1e320720b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.643821 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644056 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644173 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rcfsj\" (UniqueName: \"kubernetes.io/projected/56599ca2-32ce-4670-a6dd-f9d1e320720b-kube-api-access-rcfsj\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644289 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644370 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644461 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644524 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/56599ca2-32ce-4670-a6dd-f9d1e320720b-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.644582 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56599ca2-32ce-4670-a6dd-f9d1e320720b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.663974 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.668375 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.745884 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-logs\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-config-data\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbz5c\" (UniqueName: \"kubernetes.io/projected/0c569516-558b-48fd-8778-f5a2d48c5c6b-kube-api-access-bbz5c\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-scripts\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847315 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847381 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-internal-tls-certs\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-combined-ca-bundle\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-httpd-run\") pod \"0c569516-558b-48fd-8778-f5a2d48c5c6b\" (UID: \"0c569516-558b-48fd-8778-f5a2d48c5c6b\") " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-logs" (OuterVolumeSpecName: "logs") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.847882 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.848163 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.851043 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.852801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-scripts" (OuterVolumeSpecName: "scripts") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.855614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c569516-558b-48fd-8778-f5a2d48c5c6b-kube-api-access-bbz5c" (OuterVolumeSpecName: "kube-api-access-bbz5c") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "kube-api-access-bbz5c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.884995 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.911822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-config-data" (OuterVolumeSpecName: "config-data") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.923008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0c569516-558b-48fd-8778-f5a2d48c5c6b" (UID: "0c569516-558b-48fd-8778-f5a2d48c5c6b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949757 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bbz5c\" (UniqueName: \"kubernetes.io/projected/0c569516-558b-48fd-8778-f5a2d48c5c6b-kube-api-access-bbz5c\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949794 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949827 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949838 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949848 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949856 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0c569516-558b-48fd-8778-f5a2d48c5c6b-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.949864 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c569516-558b-48fd-8778-f5a2d48c5c6b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:51 crc kubenswrapper[4769]: I1121 12:24:51.970774 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.051562 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.315633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerStarted","Data":"324ccbb45d04fb926b8f52adee09e191ecddbc8b8f473a2298c6bbd54761e9cc"} Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.323710 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.324715 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.325329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0c569516-558b-48fd-8778-f5a2d48c5c6b","Type":"ContainerDied","Data":"09234f407c8e900dc6140a789a945faca6831e2608e68fbd41ef54fae923202c"} Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.325381 4769 scope.go:117] "RemoveContainer" containerID="8e82cca9fa41525ebdf34084a3f64774d465ac14b1a921378114b90b4bcb4ad0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.365044 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.372995 4769 scope.go:117] "RemoveContainer" containerID="f52485247be6d0d6b7dab48774ae67b0bce79139f5930cbee02e90890fb18ecb" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.375226 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.409351 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.429014 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.436790 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: E1121 12:24:52.437242 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-httpd" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437263 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-httpd" Nov 21 12:24:52 crc kubenswrapper[4769]: E1121 12:24:52.437283 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-log" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437292 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-log" Nov 21 12:24:52 crc kubenswrapper[4769]: E1121 12:24:52.437311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-log" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437319 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-log" Nov 21 12:24:52 crc kubenswrapper[4769]: E1121 12:24:52.437337 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-httpd" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437346 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-httpd" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437594 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-httpd" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437617 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-httpd" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437635 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" containerName="glance-log" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.437652 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" containerName="glance-log" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.438784 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.441772 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-7n5nd" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.443094 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.443324 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.443446 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.450383 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.458204 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.459673 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.463079 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.463313 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.465304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2p8b\" (UniqueName: \"kubernetes.io/projected/16d692e8-d465-46e0-ae83-48296ff68e1f-kube-api-access-p2p8b\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-logs\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-scripts\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjbqm\" (UniqueName: \"kubernetes.io/projected/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-kube-api-access-cjbqm\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-config-data\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.561839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.562173 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-logs\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.562333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.562461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2p8b\" (UniqueName: \"kubernetes.io/projected/16d692e8-d465-46e0-ae83-48296ff68e1f-kube-api-access-p2p8b\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664211 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-logs\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-scripts\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cjbqm\" (UniqueName: \"kubernetes.io/projected/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-kube-api-access-cjbqm\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-config-data\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-logs\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664489 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.664803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.665020 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.666001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.666311 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.666763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-logs\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.675296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.676685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-logs\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.677519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.677865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.678100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-config-data\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.678388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.679246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.684732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.686686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-scripts\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.688816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjbqm\" (UniqueName: \"kubernetes.io/projected/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-kube-api-access-cjbqm\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.698542 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2p8b\" (UniqueName: \"kubernetes.io/projected/16d692e8-d465-46e0-ae83-48296ff68e1f-kube-api-access-p2p8b\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.709345 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.709572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.812830 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:24:52 crc kubenswrapper[4769]: I1121 12:24:52.821886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:24:53 crc kubenswrapper[4769]: I1121 12:24:53.202862 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:24:53 crc kubenswrapper[4769]: W1121 12:24:53.212813 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16d692e8_d465_46e0_ae83_48296ff68e1f.slice/crio-4a53beb44fd6db111da294c83e65ffa225af99774209f094d8d3d8fab1b19712 WatchSource:0}: Error finding container 4a53beb44fd6db111da294c83e65ffa225af99774209f094d8d3d8fab1b19712: Status 404 returned error can't find the container with id 4a53beb44fd6db111da294c83e65ffa225af99774209f094d8d3d8fab1b19712 Nov 21 12:24:53 crc kubenswrapper[4769]: I1121 12:24:53.287521 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c569516-558b-48fd-8778-f5a2d48c5c6b" path="/var/lib/kubelet/pods/0c569516-558b-48fd-8778-f5a2d48c5c6b/volumes" Nov 21 12:24:53 crc kubenswrapper[4769]: I1121 12:24:53.288702 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56599ca2-32ce-4670-a6dd-f9d1e320720b" path="/var/lib/kubelet/pods/56599ca2-32ce-4670-a6dd-f9d1e320720b/volumes" Nov 21 12:24:53 crc kubenswrapper[4769]: I1121 12:24:53.360948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"16d692e8-d465-46e0-ae83-48296ff68e1f","Type":"ContainerStarted","Data":"4a53beb44fd6db111da294c83e65ffa225af99774209f094d8d3d8fab1b19712"} Nov 21 12:24:53 crc kubenswrapper[4769]: I1121 12:24:53.380786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:24:53 crc kubenswrapper[4769]: W1121 12:24:53.381983 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod109a61aa_34a6_4914_8f17_8b0abe1cb2b3.slice/crio-a9e72a1bced918fd4cf41e6de264e147975d8b3faa2eaf3c901f05345860fbf9 WatchSource:0}: Error finding container a9e72a1bced918fd4cf41e6de264e147975d8b3faa2eaf3c901f05345860fbf9: Status 404 returned error can't find the container with id a9e72a1bced918fd4cf41e6de264e147975d8b3faa2eaf3c901f05345860fbf9 Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.377917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"16d692e8-d465-46e0-ae83-48296ff68e1f","Type":"ContainerStarted","Data":"df85d13b0b2281a7babde7720b18ef42aff40e198c7d45f1b17210569f17a41f"} Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.383277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerStarted","Data":"7d1a029500c6947366ed7e6a90946726f19ca0207c1d19d97c4acf19378ec07c"} Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.383389 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-central-agent" containerID="cri-o://4d7462dff1f44539da4e44f4c408065c2dc8c1aa3fad093665c47990622dba00" gracePeriod=30 Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.383483 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-notification-agent" containerID="cri-o://b785b13b3833da7d25aa412e47bbaa59c7dd6101533fb0db6dfb982fddecec37" gracePeriod=30 Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.383509 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="proxy-httpd" containerID="cri-o://7d1a029500c6947366ed7e6a90946726f19ca0207c1d19d97c4acf19378ec07c" gracePeriod=30 Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.383480 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="sg-core" containerID="cri-o://324ccbb45d04fb926b8f52adee09e191ecddbc8b8f473a2298c6bbd54761e9cc" gracePeriod=30 Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.383639 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.395772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"109a61aa-34a6-4914-8f17-8b0abe1cb2b3","Type":"ContainerStarted","Data":"216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4"} Nov 21 12:24:54 crc kubenswrapper[4769]: I1121 12:24:54.395820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"109a61aa-34a6-4914-8f17-8b0abe1cb2b3","Type":"ContainerStarted","Data":"a9e72a1bced918fd4cf41e6de264e147975d8b3faa2eaf3c901f05345860fbf9"} Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.042869 4769 scope.go:117] "RemoveContainer" containerID="2db803d2c46102ffcb0785d78133ecb3e2e3b7e95b3944ea2524a4cd3f52110f" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.097501 4769 scope.go:117] "RemoveContainer" containerID="accc916eff7a5ed4b0068af094fe0c19b28c17137eaa19ea932c092b620c01ef" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.169896 4769 scope.go:117] "RemoveContainer" containerID="9fb659f9424787f611011d4bc0d6e4091a6335a401f3e01ecfa4b75494bb0e2b" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.194749 4769 scope.go:117] "RemoveContainer" containerID="eaf8523533c64e1ae6b9cd81e791d85b41307a8e3b6957243ad3cb24eccfe75e" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.253939 4769 scope.go:117] "RemoveContainer" containerID="e9783af4629ca9eb0b180ee6343af5c10b68b575c6f61e30f1e484550e51dcba" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.323424 4769 scope.go:117] "RemoveContainer" containerID="da319b2d7bcf1fb896b1234658ec9b28d815afeada13d809e4e75ad3ca847e31" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.395898 4769 scope.go:117] "RemoveContainer" containerID="449731f678dec43df71983f5fee5bc97e33ecad0153fdfa92a843b3d8cbbb3f7" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.408759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"16d692e8-d465-46e0-ae83-48296ff68e1f","Type":"ContainerStarted","Data":"59ea4738308fbf8588dd14b0d9e483d1652e23768b62c6f9930522b759891e08"} Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.417210 4769 generic.go:334] "Generic (PLEG): container finished" podID="42f1192a-d439-40df-8556-73ad9dfb2661" containerID="324ccbb45d04fb926b8f52adee09e191ecddbc8b8f473a2298c6bbd54761e9cc" exitCode=2 Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.417228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerDied","Data":"324ccbb45d04fb926b8f52adee09e191ecddbc8b8f473a2298c6bbd54761e9cc"} Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.417273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerDied","Data":"b785b13b3833da7d25aa412e47bbaa59c7dd6101533fb0db6dfb982fddecec37"} Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.417245 4769 generic.go:334] "Generic (PLEG): container finished" podID="42f1192a-d439-40df-8556-73ad9dfb2661" containerID="b785b13b3833da7d25aa412e47bbaa59c7dd6101533fb0db6dfb982fddecec37" exitCode=0 Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.417300 4769 generic.go:334] "Generic (PLEG): container finished" podID="42f1192a-d439-40df-8556-73ad9dfb2661" containerID="4d7462dff1f44539da4e44f4c408065c2dc8c1aa3fad093665c47990622dba00" exitCode=0 Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.417350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerDied","Data":"4d7462dff1f44539da4e44f4c408065c2dc8c1aa3fad093665c47990622dba00"} Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.419513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"109a61aa-34a6-4914-8f17-8b0abe1cb2b3","Type":"ContainerStarted","Data":"49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2"} Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.440227 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.440179859 podStartE2EDuration="3.440179859s" podCreationTimestamp="2025-11-21 12:24:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:55.432950375 +0000 UTC m=+2054.133612203" watchObservedRunningTime="2025-11-21 12:24:55.440179859 +0000 UTC m=+2054.140841677" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.444221 4769 scope.go:117] "RemoveContainer" containerID="22e276d4bc1d37a68c2acf5e3d0304e3f7c14140cba00a69df8991aa086d4c36" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.444943 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.263619585 podStartE2EDuration="11.444922367s" podCreationTimestamp="2025-11-21 12:24:44 +0000 UTC" firstStartedPulling="2025-11-21 12:24:45.784387887 +0000 UTC m=+2044.485049705" lastFinishedPulling="2025-11-21 12:24:53.965690669 +0000 UTC m=+2052.666352487" observedRunningTime="2025-11-21 12:24:54.407936956 +0000 UTC m=+2053.108598794" watchObservedRunningTime="2025-11-21 12:24:55.444922367 +0000 UTC m=+2054.145584185" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.465026 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.465003996 podStartE2EDuration="3.465003996s" podCreationTimestamp="2025-11-21 12:24:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:24:55.461241005 +0000 UTC m=+2054.161902843" watchObservedRunningTime="2025-11-21 12:24:55.465003996 +0000 UTC m=+2054.165665814" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.512010 4769 scope.go:117] "RemoveContainer" containerID="a9faf385df6ebec07048a10d2179d2bfca7b09aaf9abd65b3fcc9f4653fbfb51" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.633076 4769 scope.go:117] "RemoveContainer" containerID="cd51cb6bb495ef6c53d50ac811f1a706fc60f3c0b388ea9a6f2b24c3f875453e" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.674626 4769 scope.go:117] "RemoveContainer" containerID="a978b09bcd12dd83a682b7a59562636938228c2791d65ebfcc0410d9b3f0c63d" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.708701 4769 scope.go:117] "RemoveContainer" containerID="5028db88cf5823f013d2cb8a89fdfe11f284b0ca4af2031dc20a7841ec08433a" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.762777 4769 scope.go:117] "RemoveContainer" containerID="0a2e957fde928411251548ec850baf428f736f3bb4d75c9710325e0416b01abf" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.790793 4769 scope.go:117] "RemoveContainer" containerID="8dd881a115475cab16de46caa3476924441cff9498e2df9b5067ed3c0db6ab8d" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.850567 4769 scope.go:117] "RemoveContainer" containerID="9de1b07a8deecefa4af77a9c1f3d774640503439541fa2a2fec121cd44fb2d02" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.962958 4769 scope.go:117] "RemoveContainer" containerID="6c94ffd343594484c5a4b4d78b3c1053d7ddc75741335be410344cbd4a698cca" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.982844 4769 scope.go:117] "RemoveContainer" containerID="71368c476f9d7417e6c082f2f0d953cb39823f3b9aea2e54ea0f287e13ba2f74" Nov 21 12:24:55 crc kubenswrapper[4769]: I1121 12:24:55.999795 4769 scope.go:117] "RemoveContainer" containerID="22e1e538966b65b561770ebf929bbc919c42b47f1dc5267bcd5f3424a1fbf128" Nov 21 12:24:56 crc kubenswrapper[4769]: I1121 12:24:56.035568 4769 scope.go:117] "RemoveContainer" containerID="a3835e574aef47319958bbf24788c6e911b4521ad675d4bc8be7f837131151c5" Nov 21 12:24:56 crc kubenswrapper[4769]: I1121 12:24:56.056218 4769 scope.go:117] "RemoveContainer" containerID="eac624f17c35a3f59d0359329e01e82b27282310e873f664c1484cee268ee4d1" Nov 21 12:24:56 crc kubenswrapper[4769]: I1121 12:24:56.107042 4769 scope.go:117] "RemoveContainer" containerID="92abd3dbb7a4bf7424ae91a3f374a0143b00a39f6df1ffae5b810acc78c778b8" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.545459 4769 generic.go:334] "Generic (PLEG): container finished" podID="b44ece0d-6d96-4475-875e-2785f2a61490" containerID="2862fbf1d81d9c94b8306e4fdc83e9c8840f95b448a22ed370e61b6cf176a080" exitCode=0 Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.545754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" event={"ID":"b44ece0d-6d96-4475-875e-2785f2a61490","Type":"ContainerDied","Data":"2862fbf1d81d9c94b8306e4fdc83e9c8840f95b448a22ed370e61b6cf176a080"} Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.813923 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.814522 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.823058 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.823137 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.857872 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.860003 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.861538 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:02 crc kubenswrapper[4769]: I1121 12:25:02.878274 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:03 crc kubenswrapper[4769]: I1121 12:25:03.556123 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:03 crc kubenswrapper[4769]: I1121 12:25:03.557333 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:03 crc kubenswrapper[4769]: I1121 12:25:03.557355 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:03 crc kubenswrapper[4769]: I1121 12:25:03.557370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:03 crc kubenswrapper[4769]: I1121 12:25:03.903711 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.099154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-scripts\") pod \"b44ece0d-6d96-4475-875e-2785f2a61490\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.099515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-credential-keys\") pod \"b44ece0d-6d96-4475-875e-2785f2a61490\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.099578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-config-data\") pod \"b44ece0d-6d96-4475-875e-2785f2a61490\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.099631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-fernet-keys\") pod \"b44ece0d-6d96-4475-875e-2785f2a61490\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.099668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-combined-ca-bundle\") pod \"b44ece0d-6d96-4475-875e-2785f2a61490\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.099733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcmfj\" (UniqueName: \"kubernetes.io/projected/b44ece0d-6d96-4475-875e-2785f2a61490-kube-api-access-vcmfj\") pod \"b44ece0d-6d96-4475-875e-2785f2a61490\" (UID: \"b44ece0d-6d96-4475-875e-2785f2a61490\") " Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.121753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "b44ece0d-6d96-4475-875e-2785f2a61490" (UID: "b44ece0d-6d96-4475-875e-2785f2a61490"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.121815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "b44ece0d-6d96-4475-875e-2785f2a61490" (UID: "b44ece0d-6d96-4475-875e-2785f2a61490"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.121854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-scripts" (OuterVolumeSpecName: "scripts") pod "b44ece0d-6d96-4475-875e-2785f2a61490" (UID: "b44ece0d-6d96-4475-875e-2785f2a61490"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.126561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b44ece0d-6d96-4475-875e-2785f2a61490-kube-api-access-vcmfj" (OuterVolumeSpecName: "kube-api-access-vcmfj") pod "b44ece0d-6d96-4475-875e-2785f2a61490" (UID: "b44ece0d-6d96-4475-875e-2785f2a61490"). InnerVolumeSpecName "kube-api-access-vcmfj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.132452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-config-data" (OuterVolumeSpecName: "config-data") pod "b44ece0d-6d96-4475-875e-2785f2a61490" (UID: "b44ece0d-6d96-4475-875e-2785f2a61490"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.136443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b44ece0d-6d96-4475-875e-2785f2a61490" (UID: "b44ece0d-6d96-4475-875e-2785f2a61490"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.203404 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.203462 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.203473 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.203489 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vcmfj\" (UniqueName: \"kubernetes.io/projected/b44ece0d-6d96-4475-875e-2785f2a61490-kube-api-access-vcmfj\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.203501 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.203509 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b44ece0d-6d96-4475-875e-2785f2a61490-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.579493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" event={"ID":"b44ece0d-6d96-4475-875e-2785f2a61490","Type":"ContainerDied","Data":"aeb304d9919f5f6a611ba04877b98812b24169e224df0dea13ecef313f23939c"} Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.579936 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aeb304d9919f5f6a611ba04877b98812b24169e224df0dea13ecef313f23939c" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.579894 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-82fgg" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.688162 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-82fgg"] Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.703292 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-82fgg"] Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.796333 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cvr9p"] Nov 21 12:25:04 crc kubenswrapper[4769]: E1121 12:25:04.796800 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b44ece0d-6d96-4475-875e-2785f2a61490" containerName="keystone-bootstrap" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.796818 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44ece0d-6d96-4475-875e-2785f2a61490" containerName="keystone-bootstrap" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.797007 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b44ece0d-6d96-4475-875e-2785f2a61490" containerName="keystone-bootstrap" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.797584 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.800257 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.800524 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.800667 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.800780 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.802154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m5bqk" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.819104 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cvr9p"] Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.917093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-scripts\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.917173 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-combined-ca-bundle\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.917329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vq2z\" (UniqueName: \"kubernetes.io/projected/395c8b6c-33f9-4501-af41-d393410079d8-kube-api-access-6vq2z\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.917385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-credential-keys\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.917407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-fernet-keys\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:04 crc kubenswrapper[4769]: I1121 12:25:04.917491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-config-data\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.019241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-config-data\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.019403 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-scripts\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.019441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-combined-ca-bundle\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.019483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vq2z\" (UniqueName: \"kubernetes.io/projected/395c8b6c-33f9-4501-af41-d393410079d8-kube-api-access-6vq2z\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.019539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-credential-keys\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.019562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-fernet-keys\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.026032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-combined-ca-bundle\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.026807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-scripts\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.027241 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-credential-keys\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.027823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-config-data\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.030854 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-fernet-keys\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.040768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vq2z\" (UniqueName: \"kubernetes.io/projected/395c8b6c-33f9-4501-af41-d393410079d8-kube-api-access-6vq2z\") pod \"keystone-bootstrap-cvr9p\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.117615 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.292384 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b44ece0d-6d96-4475-875e-2785f2a61490" path="/var/lib/kubelet/pods/b44ece0d-6d96-4475-875e-2785f2a61490/volumes" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.421051 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cvr9p"] Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.591908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" event={"ID":"395c8b6c-33f9-4501-af41-d393410079d8","Type":"ContainerStarted","Data":"e8f14f6606522dfcdbf0515896b75e8009098da5dca44745022b5e3f97f7014b"} Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.591976 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.592395 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.592017 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.593072 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.735987 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:05 crc kubenswrapper[4769]: I1121 12:25:05.739033 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:25:06 crc kubenswrapper[4769]: I1121 12:25:06.251326 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:06 crc kubenswrapper[4769]: I1121 12:25:06.356263 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:25:06 crc kubenswrapper[4769]: I1121 12:25:06.604624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" event={"ID":"395c8b6c-33f9-4501-af41-d393410079d8","Type":"ContainerStarted","Data":"cbc7b6719dc33739b3cc3419412acb933db61b24cefbd4887a712fc0cb0fa006"} Nov 21 12:25:06 crc kubenswrapper[4769]: I1121 12:25:06.633048 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" podStartSLOduration=2.633028002 podStartE2EDuration="2.633028002s" podCreationTimestamp="2025-11-21 12:25:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:06.624817422 +0000 UTC m=+2065.325479240" watchObservedRunningTime="2025-11-21 12:25:06.633028002 +0000 UTC m=+2065.333689820" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.783789 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-p9lsm"] Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.786057 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.805688 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-p9lsm"] Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.896006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltv88\" (UniqueName: \"kubernetes.io/projected/31d7df5e-920e-41b4-ab3e-6290b468f67e-kube-api-access-ltv88\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.896114 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-catalog-content\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.896279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-utilities\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.998170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-catalog-content\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.998294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-utilities\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.998397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ltv88\" (UniqueName: \"kubernetes.io/projected/31d7df5e-920e-41b4-ab3e-6290b468f67e-kube-api-access-ltv88\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.998903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-catalog-content\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:08 crc kubenswrapper[4769]: I1121 12:25:08.998991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-utilities\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.019808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltv88\" (UniqueName: \"kubernetes.io/projected/31d7df5e-920e-41b4-ab3e-6290b468f67e-kube-api-access-ltv88\") pod \"community-operators-p9lsm\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.143257 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.630153 4769 generic.go:334] "Generic (PLEG): container finished" podID="3dd64d3c-8006-4019-8e5c-81d4d8467fce" containerID="4d634d8f466ec06243f15d95cd862aa33c18eba6b4a607bc78287d5c530e7477" exitCode=0 Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.630230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-wc85q" event={"ID":"3dd64d3c-8006-4019-8e5c-81d4d8467fce","Type":"ContainerDied","Data":"4d634d8f466ec06243f15d95cd862aa33c18eba6b4a607bc78287d5c530e7477"} Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.632628 4769 generic.go:334] "Generic (PLEG): container finished" podID="395c8b6c-33f9-4501-af41-d393410079d8" containerID="cbc7b6719dc33739b3cc3419412acb933db61b24cefbd4887a712fc0cb0fa006" exitCode=0 Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.632666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" event={"ID":"395c8b6c-33f9-4501-af41-d393410079d8","Type":"ContainerDied","Data":"cbc7b6719dc33739b3cc3419412acb933db61b24cefbd4887a712fc0cb0fa006"} Nov 21 12:25:09 crc kubenswrapper[4769]: I1121 12:25:09.700322 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-p9lsm"] Nov 21 12:25:09 crc kubenswrapper[4769]: W1121 12:25:09.704011 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d7df5e_920e_41b4_ab3e_6290b468f67e.slice/crio-a273a959f4982f7806b4288ef717da003c681c077bce5cdbe15faf36f127d122 WatchSource:0}: Error finding container a273a959f4982f7806b4288ef717da003c681c077bce5cdbe15faf36f127d122: Status 404 returned error can't find the container with id a273a959f4982f7806b4288ef717da003c681c077bce5cdbe15faf36f127d122 Nov 21 12:25:10 crc kubenswrapper[4769]: I1121 12:25:10.644323 4769 generic.go:334] "Generic (PLEG): container finished" podID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerID="c14158a8092ed632056e374aeeb2cb8124613b52601295d1c6caf8f0bdfe25e0" exitCode=0 Nov 21 12:25:10 crc kubenswrapper[4769]: I1121 12:25:10.644421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p9lsm" event={"ID":"31d7df5e-920e-41b4-ab3e-6290b468f67e","Type":"ContainerDied","Data":"c14158a8092ed632056e374aeeb2cb8124613b52601295d1c6caf8f0bdfe25e0"} Nov 21 12:25:10 crc kubenswrapper[4769]: I1121 12:25:10.644669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p9lsm" event={"ID":"31d7df5e-920e-41b4-ab3e-6290b468f67e","Type":"ContainerStarted","Data":"a273a959f4982f7806b4288ef717da003c681c077bce5cdbe15faf36f127d122"} Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.066494 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.077229 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.151826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd64d3c-8006-4019-8e5c-81d4d8467fce-logs\") pod \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.151913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-scripts\") pod \"395c8b6c-33f9-4501-af41-d393410079d8\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vq2z\" (UniqueName: \"kubernetes.io/projected/395c8b6c-33f9-4501-af41-d393410079d8-kube-api-access-6vq2z\") pod \"395c8b6c-33f9-4501-af41-d393410079d8\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-scripts\") pod \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kppzz\" (UniqueName: \"kubernetes.io/projected/3dd64d3c-8006-4019-8e5c-81d4d8467fce-kube-api-access-kppzz\") pod \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-credential-keys\") pod \"395c8b6c-33f9-4501-af41-d393410079d8\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-config-data\") pod \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-config-data\") pod \"395c8b6c-33f9-4501-af41-d393410079d8\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-combined-ca-bundle\") pod \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\" (UID: \"3dd64d3c-8006-4019-8e5c-81d4d8467fce\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd64d3c-8006-4019-8e5c-81d4d8467fce-logs" (OuterVolumeSpecName: "logs") pod "3dd64d3c-8006-4019-8e5c-81d4d8467fce" (UID: "3dd64d3c-8006-4019-8e5c-81d4d8467fce"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-combined-ca-bundle\") pod \"395c8b6c-33f9-4501-af41-d393410079d8\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.152699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-fernet-keys\") pod \"395c8b6c-33f9-4501-af41-d393410079d8\" (UID: \"395c8b6c-33f9-4501-af41-d393410079d8\") " Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.153430 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd64d3c-8006-4019-8e5c-81d4d8467fce-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.159822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-scripts" (OuterVolumeSpecName: "scripts") pod "3dd64d3c-8006-4019-8e5c-81d4d8467fce" (UID: "3dd64d3c-8006-4019-8e5c-81d4d8467fce"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.160436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-scripts" (OuterVolumeSpecName: "scripts") pod "395c8b6c-33f9-4501-af41-d393410079d8" (UID: "395c8b6c-33f9-4501-af41-d393410079d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.160491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "395c8b6c-33f9-4501-af41-d393410079d8" (UID: "395c8b6c-33f9-4501-af41-d393410079d8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.161133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "395c8b6c-33f9-4501-af41-d393410079d8" (UID: "395c8b6c-33f9-4501-af41-d393410079d8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.173376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd64d3c-8006-4019-8e5c-81d4d8467fce-kube-api-access-kppzz" (OuterVolumeSpecName: "kube-api-access-kppzz") pod "3dd64d3c-8006-4019-8e5c-81d4d8467fce" (UID: "3dd64d3c-8006-4019-8e5c-81d4d8467fce"). InnerVolumeSpecName "kube-api-access-kppzz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.175776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395c8b6c-33f9-4501-af41-d393410079d8-kube-api-access-6vq2z" (OuterVolumeSpecName: "kube-api-access-6vq2z") pod "395c8b6c-33f9-4501-af41-d393410079d8" (UID: "395c8b6c-33f9-4501-af41-d393410079d8"). InnerVolumeSpecName "kube-api-access-6vq2z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.185029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-config-data" (OuterVolumeSpecName: "config-data") pod "3dd64d3c-8006-4019-8e5c-81d4d8467fce" (UID: "3dd64d3c-8006-4019-8e5c-81d4d8467fce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.188152 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "395c8b6c-33f9-4501-af41-d393410079d8" (UID: "395c8b6c-33f9-4501-af41-d393410079d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.189003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3dd64d3c-8006-4019-8e5c-81d4d8467fce" (UID: "3dd64d3c-8006-4019-8e5c-81d4d8467fce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.190558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-config-data" (OuterVolumeSpecName: "config-data") pod "395c8b6c-33f9-4501-af41-d393410079d8" (UID: "395c8b6c-33f9-4501-af41-d393410079d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255293 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6vq2z\" (UniqueName: \"kubernetes.io/projected/395c8b6c-33f9-4501-af41-d393410079d8-kube-api-access-6vq2z\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255348 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255362 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kppzz\" (UniqueName: \"kubernetes.io/projected/3dd64d3c-8006-4019-8e5c-81d4d8467fce-kube-api-access-kppzz\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255377 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255390 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255404 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3dd64d3c-8006-4019-8e5c-81d4d8467fce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255416 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255428 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255439 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.255449 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/395c8b6c-33f9-4501-af41-d393410079d8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.326104 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.326165 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.654639 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-wc85q" event={"ID":"3dd64d3c-8006-4019-8e5c-81d4d8467fce","Type":"ContainerDied","Data":"4d3d70ea1e2939c5f576d0f598fdf169aab1a2f7de330a171ef242921695b99b"} Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.654673 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-wc85q" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.654682 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d3d70ea1e2939c5f576d0f598fdf169aab1a2f7de330a171ef242921695b99b" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.656931 4769 generic.go:334] "Generic (PLEG): container finished" podID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerID="dcf00f51a8936e8fd67a01f716a150355f934b9d3a0d74d735dca76c45b37e47" exitCode=0 Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.657003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p9lsm" event={"ID":"31d7df5e-920e-41b4-ab3e-6290b468f67e","Type":"ContainerDied","Data":"dcf00f51a8936e8fd67a01f716a150355f934b9d3a0d74d735dca76c45b37e47"} Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.658851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" event={"ID":"395c8b6c-33f9-4501-af41-d393410079d8","Type":"ContainerDied","Data":"e8f14f6606522dfcdbf0515896b75e8009098da5dca44745022b5e3f97f7014b"} Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.658884 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f14f6606522dfcdbf0515896b75e8009098da5dca44745022b5e3f97f7014b" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.658882 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cvr9p" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.773556 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-67946cbd78-pffwl"] Nov 21 12:25:11 crc kubenswrapper[4769]: E1121 12:25:11.774019 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="395c8b6c-33f9-4501-af41-d393410079d8" containerName="keystone-bootstrap" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.774043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="395c8b6c-33f9-4501-af41-d393410079d8" containerName="keystone-bootstrap" Nov 21 12:25:11 crc kubenswrapper[4769]: E1121 12:25:11.774063 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3dd64d3c-8006-4019-8e5c-81d4d8467fce" containerName="placement-db-sync" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.774071 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd64d3c-8006-4019-8e5c-81d4d8467fce" containerName="placement-db-sync" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.774310 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3dd64d3c-8006-4019-8e5c-81d4d8467fce" containerName="placement-db-sync" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.774341 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="395c8b6c-33f9-4501-af41-d393410079d8" containerName="keystone-bootstrap" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.793757 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.795419 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf"] Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.797824 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.806801 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.807308 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-nnfbm" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.807688 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.808038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.808484 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.809244 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.810056 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.811337 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.811629 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.812296 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m5bqk" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.812659 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.848492 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf"] Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.857888 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-67946cbd78-pffwl"] Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-combined-ca-bundle\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-public-tls-certs\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcd8k\" (UniqueName: \"kubernetes.io/projected/7d1af53a-9620-44a9-8a3c-fdea3faea22b-kube-api-access-mcd8k\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-public-tls-certs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866387 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44qtx\" (UniqueName: \"kubernetes.io/projected/6359092b-61ea-402d-9d63-0cb82f623c6c-kube-api-access-44qtx\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-internal-tls-certs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-internal-tls-certs\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-fernet-keys\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d1af53a-9620-44a9-8a3c-fdea3faea22b-logs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-config-data\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-scripts\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-credential-keys\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-scripts\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866580 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-combined-ca-bundle\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.866600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-config-data\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-combined-ca-bundle\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-public-tls-certs\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mcd8k\" (UniqueName: \"kubernetes.io/projected/7d1af53a-9620-44a9-8a3c-fdea3faea22b-kube-api-access-mcd8k\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-public-tls-certs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-44qtx\" (UniqueName: \"kubernetes.io/projected/6359092b-61ea-402d-9d63-0cb82f623c6c-kube-api-access-44qtx\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-internal-tls-certs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-internal-tls-certs\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-fernet-keys\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d1af53a-9620-44a9-8a3c-fdea3faea22b-logs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968489 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-config-data\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-scripts\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-credential-keys\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-scripts\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-combined-ca-bundle\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.968691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-config-data\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.969537 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d1af53a-9620-44a9-8a3c-fdea3faea22b-logs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.974597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-scripts\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.975858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-combined-ca-bundle\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.976942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-internal-tls-certs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.977063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-credential-keys\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.977333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-public-tls-certs\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.977362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-internal-tls-certs\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.977366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-public-tls-certs\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.977441 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-config-data\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.978022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-combined-ca-bundle\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.978970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-scripts\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.979600 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-fernet-keys\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.981694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-config-data\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.988556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-44qtx\" (UniqueName: \"kubernetes.io/projected/6359092b-61ea-402d-9d63-0cb82f623c6c-kube-api-access-44qtx\") pod \"keystone-65dbf6cdb4-q7xkf\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:11 crc kubenswrapper[4769]: I1121 12:25:11.990951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcd8k\" (UniqueName: \"kubernetes.io/projected/7d1af53a-9620-44a9-8a3c-fdea3faea22b-kube-api-access-mcd8k\") pod \"placement-67946cbd78-pffwl\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:12 crc kubenswrapper[4769]: I1121 12:25:12.136571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:12 crc kubenswrapper[4769]: I1121 12:25:12.158685 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:12 crc kubenswrapper[4769]: I1121 12:25:12.604937 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf"] Nov 21 12:25:12 crc kubenswrapper[4769]: I1121 12:25:12.675968 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-67946cbd78-pffwl"] Nov 21 12:25:12 crc kubenswrapper[4769]: I1121 12:25:12.678984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" event={"ID":"6359092b-61ea-402d-9d63-0cb82f623c6c","Type":"ContainerStarted","Data":"8f6114c4c6f6c89bd996cb106bf06503a38afec0fb319bc98086aae99fadf3f3"} Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.692323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" event={"ID":"6359092b-61ea-402d-9d63-0cb82f623c6c","Type":"ContainerStarted","Data":"c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95"} Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.693024 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.703379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" event={"ID":"7d1af53a-9620-44a9-8a3c-fdea3faea22b","Type":"ContainerStarted","Data":"e37e8ca9c13159ff75dbefc98fa8e79d84ee836baf47fc1b85942a8dbbf77b7f"} Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.703652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" event={"ID":"7d1af53a-9620-44a9-8a3c-fdea3faea22b","Type":"ContainerStarted","Data":"0007ac30b31f0ce12a8d4ec3ce279639c0cf5ed4f1fab2916d85d12034efbeca"} Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.703729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" event={"ID":"7d1af53a-9620-44a9-8a3c-fdea3faea22b","Type":"ContainerStarted","Data":"75a6f68afdfb567ef0d65731de279862c8f286ff836c0954c78c52d7c23b4f2e"} Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.703962 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.709317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p9lsm" event={"ID":"31d7df5e-920e-41b4-ab3e-6290b468f67e","Type":"ContainerStarted","Data":"7fc5c0d6df65185683b2c29124b80ad842e4aae5b8fadc4c23ba405fc5f625b4"} Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.731093 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" podStartSLOduration=2.731063852 podStartE2EDuration="2.731063852s" podCreationTimestamp="2025-11-21 12:25:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:13.717235001 +0000 UTC m=+2072.417896839" watchObservedRunningTime="2025-11-21 12:25:13.731063852 +0000 UTC m=+2072.431725670" Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.755280 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" podStartSLOduration=2.7552541919999998 podStartE2EDuration="2.755254192s" podCreationTimestamp="2025-11-21 12:25:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:13.741314928 +0000 UTC m=+2072.441976746" watchObservedRunningTime="2025-11-21 12:25:13.755254192 +0000 UTC m=+2072.455916020" Nov 21 12:25:13 crc kubenswrapper[4769]: I1121 12:25:13.770367 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-p9lsm" podStartSLOduration=3.864278517 podStartE2EDuration="5.770349138s" podCreationTimestamp="2025-11-21 12:25:08 +0000 UTC" firstStartedPulling="2025-11-21 12:25:10.646321246 +0000 UTC m=+2069.346983064" lastFinishedPulling="2025-11-21 12:25:12.552391867 +0000 UTC m=+2071.253053685" observedRunningTime="2025-11-21 12:25:13.761021767 +0000 UTC m=+2072.461683595" watchObservedRunningTime="2025-11-21 12:25:13.770349138 +0000 UTC m=+2072.471010956" Nov 21 12:25:14 crc kubenswrapper[4769]: I1121 12:25:14.719433 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:15 crc kubenswrapper[4769]: I1121 12:25:15.025755 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 12:25:15 crc kubenswrapper[4769]: I1121 12:25:15.731136 4769 generic.go:334] "Generic (PLEG): container finished" podID="333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" containerID="b8cc559f97e9e0be10200b60cefd630c95e22527edbcc750d2fe49e376034217" exitCode=0 Nov 21 12:25:15 crc kubenswrapper[4769]: I1121 12:25:15.731261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" event={"ID":"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45","Type":"ContainerDied","Data":"b8cc559f97e9e0be10200b60cefd630c95e22527edbcc750d2fe49e376034217"} Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.109093 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.168134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw8w4\" (UniqueName: \"kubernetes.io/projected/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-kube-api-access-tw8w4\") pod \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.168287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-combined-ca-bundle\") pod \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.168321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-db-sync-config-data\") pod \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\" (UID: \"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45\") " Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.191753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-kube-api-access-tw8w4" (OuterVolumeSpecName: "kube-api-access-tw8w4") pod "333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" (UID: "333b5f7e-9eff-47a7-bf3b-5cd0c1293e45"). InnerVolumeSpecName "kube-api-access-tw8w4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.209508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" (UID: "333b5f7e-9eff-47a7-bf3b-5cd0c1293e45"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.221457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" (UID: "333b5f7e-9eff-47a7-bf3b-5cd0c1293e45"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.276982 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tw8w4\" (UniqueName: \"kubernetes.io/projected/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-kube-api-access-tw8w4\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.277427 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.277537 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.751853 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" event={"ID":"333b5f7e-9eff-47a7-bf3b-5cd0c1293e45","Type":"ContainerDied","Data":"3064287e224db8bc5ea0bbd5413637e1f9f891888ac665401dd1cbccaa4a08db"} Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.752179 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3064287e224db8bc5ea0bbd5413637e1f9f891888ac665401dd1cbccaa4a08db" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.751904 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-2lx2g" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.867999 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg"] Nov 21 12:25:17 crc kubenswrapper[4769]: E1121 12:25:17.868555 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" containerName="barbican-db-sync" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.868578 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" containerName="barbican-db-sync" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.868814 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" containerName="barbican-db-sync" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.870090 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.873120 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.873903 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.874725 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp"] Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.874830 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-vhmfw" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.876179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.879691 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.898235 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp"] Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.956721 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg"] Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrk2r\" (UniqueName: \"kubernetes.io/projected/6b0e43c9-665b-4c35-9eb3-f10936347547-kube-api-access-xrk2r\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-combined-ca-bundle\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8205dbfb-fc46-457f-a977-7ceb6377da8d-logs\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data-custom\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991266 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7w2\" (UniqueName: \"kubernetes.io/projected/8205dbfb-fc46-457f-a977-7ceb6377da8d-kube-api-access-2z7w2\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-combined-ca-bundle\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data-custom\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991524 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:17 crc kubenswrapper[4769]: I1121 12:25:17.991583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b0e43c9-665b-4c35-9eb3-f10936347547-logs\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.048118 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-55c658785b-vntdg"] Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.049547 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.053982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.070762 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-55c658785b-vntdg"] Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.094506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data-custom\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.094550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.094615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdd2t\" (UniqueName: \"kubernetes.io/projected/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-kube-api-access-wdd2t\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7w2\" (UniqueName: \"kubernetes.io/projected/8205dbfb-fc46-457f-a977-7ceb6377da8d-kube-api-access-2z7w2\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095476 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-logs\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-combined-ca-bundle\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data-custom\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data-custom\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-combined-ca-bundle\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b0e43c9-665b-4c35-9eb3-f10936347547-logs\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xrk2r\" (UniqueName: \"kubernetes.io/projected/6b0e43c9-665b-4c35-9eb3-f10936347547-kube-api-access-xrk2r\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8205dbfb-fc46-457f-a977-7ceb6377da8d-logs\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.095763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-combined-ca-bundle\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.096442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b0e43c9-665b-4c35-9eb3-f10936347547-logs\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.096476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8205dbfb-fc46-457f-a977-7ceb6377da8d-logs\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.099617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data-custom\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.100139 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data-custom\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.101546 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.101985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-combined-ca-bundle\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.103761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.115090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-combined-ca-bundle\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.118742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrk2r\" (UniqueName: \"kubernetes.io/projected/6b0e43c9-665b-4c35-9eb3-f10936347547-kube-api-access-xrk2r\") pod \"barbican-keystone-listener-7744fd79f8-nmkfp\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.122499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7w2\" (UniqueName: \"kubernetes.io/projected/8205dbfb-fc46-457f-a977-7ceb6377da8d-kube-api-access-2z7w2\") pod \"barbican-worker-b866ddff5-tddxg\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.197662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-combined-ca-bundle\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.197728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.197809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wdd2t\" (UniqueName: \"kubernetes.io/projected/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-kube-api-access-wdd2t\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.197872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-logs\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.197901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data-custom\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.198748 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-logs\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.199073 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.211667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data-custom\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.211746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-combined-ca-bundle\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.212385 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.212398 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.223517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdd2t\" (UniqueName: \"kubernetes.io/projected/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-kube-api-access-wdd2t\") pod \"barbican-api-55c658785b-vntdg\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.365722 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:18 crc kubenswrapper[4769]: W1121 12:25:18.673274 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8205dbfb_fc46_457f_a977_7ceb6377da8d.slice/crio-5fbe6dc37ba603d4f5e5a9c21146554a5fb086e89988e1e536a67602904c420f WatchSource:0}: Error finding container 5fbe6dc37ba603d4f5e5a9c21146554a5fb086e89988e1e536a67602904c420f: Status 404 returned error can't find the container with id 5fbe6dc37ba603d4f5e5a9c21146554a5fb086e89988e1e536a67602904c420f Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.677693 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg"] Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.788108 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp"] Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.790558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" event={"ID":"8205dbfb-fc46-457f-a977-7ceb6377da8d","Type":"ContainerStarted","Data":"5fbe6dc37ba603d4f5e5a9c21146554a5fb086e89988e1e536a67602904c420f"} Nov 21 12:25:18 crc kubenswrapper[4769]: I1121 12:25:18.858977 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-55c658785b-vntdg"] Nov 21 12:25:18 crc kubenswrapper[4769]: W1121 12:25:18.863705 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd749a2ec_85d6_49e4_9ea1_b8b7580fdac7.slice/crio-44a11d6d47e258aeeb2a9c4a0d0d3be63ba34aecd67a92c3a462c74cf2871206 WatchSource:0}: Error finding container 44a11d6d47e258aeeb2a9c4a0d0d3be63ba34aecd67a92c3a462c74cf2871206: Status 404 returned error can't find the container with id 44a11d6d47e258aeeb2a9c4a0d0d3be63ba34aecd67a92c3a462c74cf2871206 Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.147937 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.148271 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.226183 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.803231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" event={"ID":"8205dbfb-fc46-457f-a977-7ceb6377da8d","Type":"ContainerStarted","Data":"214d2c35599922b5291aa6d73f8104c9866c71f665821c87c6c975ac55bf1faa"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.803283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" event={"ID":"8205dbfb-fc46-457f-a977-7ceb6377da8d","Type":"ContainerStarted","Data":"4d98cc64d4cbc1a8819c3d7c4e329de8b3d6c9afa10b7c1054e400933f42f8c0"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.806873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" event={"ID":"6b0e43c9-665b-4c35-9eb3-f10936347547","Type":"ContainerStarted","Data":"02e96ff8d49d4c0f1df8aad8bb6c2f91758c057b24bd5ec7ce588fc4f2b2caad"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.806913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" event={"ID":"6b0e43c9-665b-4c35-9eb3-f10936347547","Type":"ContainerStarted","Data":"38787751ae9b4a94077db573bfadf380c7880a0b40b47ae9fd11fca5829626d0"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.806926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" event={"ID":"6b0e43c9-665b-4c35-9eb3-f10936347547","Type":"ContainerStarted","Data":"242ea21f47fb4148bc83ea7b4facb88c1a5aadfe69b2d17e2c513e4496cdb784"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.829770 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" podStartSLOduration=2.829741322 podStartE2EDuration="2.829741322s" podCreationTimestamp="2025-11-21 12:25:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:19.827848821 +0000 UTC m=+2078.528510639" watchObservedRunningTime="2025-11-21 12:25:19.829741322 +0000 UTC m=+2078.530403160" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.835494 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" event={"ID":"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7","Type":"ContainerStarted","Data":"fcf239f1c2da8f21cc5db7324e3c258aee01153b2af7a81e0cd5129998d7d5c1"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.835546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" event={"ID":"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7","Type":"ContainerStarted","Data":"c2579e4bf01016cd2b3193bd5d76b1e51e09c14e6308b0835bb3dba188413dcc"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.835559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" event={"ID":"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7","Type":"ContainerStarted","Data":"44a11d6d47e258aeeb2a9c4a0d0d3be63ba34aecd67a92c3a462c74cf2871206"} Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.835958 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.836077 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.868388 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" podStartSLOduration=2.868361419 podStartE2EDuration="2.868361419s" podCreationTimestamp="2025-11-21 12:25:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:19.854662801 +0000 UTC m=+2078.555324649" watchObservedRunningTime="2025-11-21 12:25:19.868361419 +0000 UTC m=+2078.569023237" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.889670 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" podStartSLOduration=1.8896388210000001 podStartE2EDuration="1.889638821s" podCreationTimestamp="2025-11-21 12:25:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:19.883066364 +0000 UTC m=+2078.583728202" watchObservedRunningTime="2025-11-21 12:25:19.889638821 +0000 UTC m=+2078.590300639" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.901887 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:19 crc kubenswrapper[4769]: I1121 12:25:19.953218 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-p9lsm"] Nov 21 12:25:20 crc kubenswrapper[4769]: I1121 12:25:20.855989 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576"] Nov 21 12:25:20 crc kubenswrapper[4769]: I1121 12:25:20.857829 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:20 crc kubenswrapper[4769]: I1121 12:25:20.862344 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:25:20 crc kubenswrapper[4769]: I1121 12:25:20.862812 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:25:20 crc kubenswrapper[4769]: I1121 12:25:20.872239 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576"] Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.010743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fhp5\" (UniqueName: \"kubernetes.io/projected/8bc3ac6c-45bc-477e-b24e-778267d7a63e-kube-api-access-6fhp5\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.011091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.011150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-combined-ca-bundle\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.011237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8bc3ac6c-45bc-477e-b24e-778267d7a63e-logs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.011389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data-custom\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.011580 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-internal-tls-certs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.012001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-public-tls-certs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-combined-ca-bundle\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8bc3ac6c-45bc-477e-b24e-778267d7a63e-logs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data-custom\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-internal-tls-certs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-public-tls-certs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6fhp5\" (UniqueName: \"kubernetes.io/projected/8bc3ac6c-45bc-477e-b24e-778267d7a63e-kube-api-access-6fhp5\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.113875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.114290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8bc3ac6c-45bc-477e-b24e-778267d7a63e-logs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.119578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data-custom\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.120041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-internal-tls-certs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.122283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.122692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-public-tls-certs\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.125950 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-combined-ca-bundle\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.144090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fhp5\" (UniqueName: \"kubernetes.io/projected/8bc3ac6c-45bc-477e-b24e-778267d7a63e-kube-api-access-6fhp5\") pod \"barbican-api-7dcd6754fb-dn576\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.216650 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.708138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576"] Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.858422 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-p9lsm" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="registry-server" containerID="cri-o://7fc5c0d6df65185683b2c29124b80ad842e4aae5b8fadc4c23ba405fc5f625b4" gracePeriod=2 Nov 21 12:25:21 crc kubenswrapper[4769]: I1121 12:25:21.858836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" event={"ID":"8bc3ac6c-45bc-477e-b24e-778267d7a63e","Type":"ContainerStarted","Data":"de2837b5055f67b6839226eb26313a9fb551b3d4a35af53e6b8aa2d86c648efc"} Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:22.999900 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-6t9xc"] Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.003672 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.008835 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-6t9xc"] Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.157727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-catalog-content\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.157812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-utilities\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.157878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngk8\" (UniqueName: \"kubernetes.io/projected/f86b8cf5-65ee-42eb-98f0-a7551868a79c-kube-api-access-mngk8\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.259898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-catalog-content\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.259958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-utilities\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.260006 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mngk8\" (UniqueName: \"kubernetes.io/projected/f86b8cf5-65ee-42eb-98f0-a7551868a79c-kube-api-access-mngk8\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.260463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-utilities\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.260534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-catalog-content\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.290429 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngk8\" (UniqueName: \"kubernetes.io/projected/f86b8cf5-65ee-42eb-98f0-a7551868a79c-kube-api-access-mngk8\") pod \"redhat-operators-6t9xc\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.327276 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.882680 4769 generic.go:334] "Generic (PLEG): container finished" podID="08ab69b0-1536-4e46-8ecc-b3cee3a42bff" containerID="d4c049ade199c20b955929d81273a1206543d1315fb32842937b919f7b36dd9f" exitCode=0 Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.882789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" event={"ID":"08ab69b0-1536-4e46-8ecc-b3cee3a42bff","Type":"ContainerDied","Data":"d4c049ade199c20b955929d81273a1206543d1315fb32842937b919f7b36dd9f"} Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.890764 4769 generic.go:334] "Generic (PLEG): container finished" podID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerID="7fc5c0d6df65185683b2c29124b80ad842e4aae5b8fadc4c23ba405fc5f625b4" exitCode=0 Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.890863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p9lsm" event={"ID":"31d7df5e-920e-41b4-ab3e-6290b468f67e","Type":"ContainerDied","Data":"7fc5c0d6df65185683b2c29124b80ad842e4aae5b8fadc4c23ba405fc5f625b4"} Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.892284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" event={"ID":"8bc3ac6c-45bc-477e-b24e-778267d7a63e","Type":"ContainerStarted","Data":"017f91debc55afc1f32691f9fcb7a2055c6ca9f361ef281d2f91aa0faa9f7706"} Nov 21 12:25:23 crc kubenswrapper[4769]: I1121 12:25:23.935873 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-6t9xc"] Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.907465 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" event={"ID":"8bc3ac6c-45bc-477e-b24e-778267d7a63e","Type":"ContainerStarted","Data":"f26dbf44d9fe564886ba9eac123dcb6e2ac8626a543596179180a5e7572e70f8"} Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.908352 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.922477 4769 generic.go:334] "Generic (PLEG): container finished" podID="42f1192a-d439-40df-8556-73ad9dfb2661" containerID="7d1a029500c6947366ed7e6a90946726f19ca0207c1d19d97c4acf19378ec07c" exitCode=137 Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.922556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerDied","Data":"7d1a029500c6947366ed7e6a90946726f19ca0207c1d19d97c4acf19378ec07c"} Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.924957 4769 generic.go:334] "Generic (PLEG): container finished" podID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerID="d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d" exitCode=0 Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.925510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerDied","Data":"d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d"} Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.925588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerStarted","Data":"bd2e739f1b959526e179a0e3afdc05e85d7f28b3b048217119217aa5a86a69a5"} Nov 21 12:25:24 crc kubenswrapper[4769]: I1121 12:25:24.943930 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" podStartSLOduration=4.943908492 podStartE2EDuration="4.943908492s" podCreationTimestamp="2025-11-21 12:25:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:24.940550192 +0000 UTC m=+2083.641212010" watchObservedRunningTime="2025-11-21 12:25:24.943908492 +0000 UTC m=+2083.644570310" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.262220 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.318648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-catalog-content\") pod \"31d7df5e-920e-41b4-ab3e-6290b468f67e\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.318877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-utilities\") pod \"31d7df5e-920e-41b4-ab3e-6290b468f67e\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.318927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltv88\" (UniqueName: \"kubernetes.io/projected/31d7df5e-920e-41b4-ab3e-6290b468f67e-kube-api-access-ltv88\") pod \"31d7df5e-920e-41b4-ab3e-6290b468f67e\" (UID: \"31d7df5e-920e-41b4-ab3e-6290b468f67e\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.320986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-utilities" (OuterVolumeSpecName: "utilities") pod "31d7df5e-920e-41b4-ab3e-6290b468f67e" (UID: "31d7df5e-920e-41b4-ab3e-6290b468f67e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.331392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d7df5e-920e-41b4-ab3e-6290b468f67e-kube-api-access-ltv88" (OuterVolumeSpecName: "kube-api-access-ltv88") pod "31d7df5e-920e-41b4-ab3e-6290b468f67e" (UID: "31d7df5e-920e-41b4-ab3e-6290b468f67e"). InnerVolumeSpecName "kube-api-access-ltv88". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.387482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "31d7df5e-920e-41b4-ab3e-6290b468f67e" (UID: "31d7df5e-920e-41b4-ab3e-6290b468f67e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.420106 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.426874 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.426913 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31d7df5e-920e-41b4-ab3e-6290b468f67e-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.426924 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ltv88\" (UniqueName: \"kubernetes.io/projected/31d7df5e-920e-41b4-ab3e-6290b468f67e-kube-api-access-ltv88\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.528988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wlhs\" (UniqueName: \"kubernetes.io/projected/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-kube-api-access-2wlhs\") pod \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.529209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-etc-machine-id\") pod \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.529363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-db-sync-config-data\") pod \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.529430 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-scripts\") pod \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.529472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-combined-ca-bundle\") pod \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.529511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-config-data\") pod \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\" (UID: \"08ab69b0-1536-4e46-8ecc-b3cee3a42bff\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.530048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "08ab69b0-1536-4e46-8ecc-b3cee3a42bff" (UID: "08ab69b0-1536-4e46-8ecc-b3cee3a42bff"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.530240 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.536285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-scripts" (OuterVolumeSpecName: "scripts") pod "08ab69b0-1536-4e46-8ecc-b3cee3a42bff" (UID: "08ab69b0-1536-4e46-8ecc-b3cee3a42bff"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.537053 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "08ab69b0-1536-4e46-8ecc-b3cee3a42bff" (UID: "08ab69b0-1536-4e46-8ecc-b3cee3a42bff"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.539277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-kube-api-access-2wlhs" (OuterVolumeSpecName: "kube-api-access-2wlhs") pod "08ab69b0-1536-4e46-8ecc-b3cee3a42bff" (UID: "08ab69b0-1536-4e46-8ecc-b3cee3a42bff"). InnerVolumeSpecName "kube-api-access-2wlhs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.576577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08ab69b0-1536-4e46-8ecc-b3cee3a42bff" (UID: "08ab69b0-1536-4e46-8ecc-b3cee3a42bff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.618213 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-config-data" (OuterVolumeSpecName: "config-data") pod "08ab69b0-1536-4e46-8ecc-b3cee3a42bff" (UID: "08ab69b0-1536-4e46-8ecc-b3cee3a42bff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.628753 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.634864 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2wlhs\" (UniqueName: \"kubernetes.io/projected/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-kube-api-access-2wlhs\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.634899 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.634910 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.634919 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.634928 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08ab69b0-1536-4e46-8ecc-b3cee3a42bff-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.654655 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737357 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-log-httpd\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-config-data\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-combined-ca-bundle\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npxgn\" (UniqueName: \"kubernetes.io/projected/42f1192a-d439-40df-8556-73ad9dfb2661-kube-api-access-npxgn\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-scripts\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-sg-core-conf-yaml\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.737738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-run-httpd\") pod \"42f1192a-d439-40df-8556-73ad9dfb2661\" (UID: \"42f1192a-d439-40df-8556-73ad9dfb2661\") " Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.739445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.740090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.744816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f1192a-d439-40df-8556-73ad9dfb2661-kube-api-access-npxgn" (OuterVolumeSpecName: "kube-api-access-npxgn") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "kube-api-access-npxgn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.747459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-scripts" (OuterVolumeSpecName: "scripts") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.770176 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.823291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.840158 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.840878 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-npxgn\" (UniqueName: \"kubernetes.io/projected/42f1192a-d439-40df-8556-73ad9dfb2661-kube-api-access-npxgn\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.840965 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.841046 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.841139 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.841241 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/42f1192a-d439-40df-8556-73ad9dfb2661-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.844824 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-config-data" (OuterVolumeSpecName: "config-data") pod "42f1192a-d439-40df-8556-73ad9dfb2661" (UID: "42f1192a-d439-40df-8556-73ad9dfb2661"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.946576 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.946561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-ghvhz" event={"ID":"08ab69b0-1536-4e46-8ecc-b3cee3a42bff","Type":"ContainerDied","Data":"8d6b500e7c9242ecd590170774834c9e56ec4c40df02948d343b80942e7ef3a9"} Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.946705 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d6b500e7c9242ecd590170774834c9e56ec4c40df02948d343b80942e7ef3a9" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.949474 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f1192a-d439-40df-8556-73ad9dfb2661-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.955002 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-p9lsm" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.955002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-p9lsm" event={"ID":"31d7df5e-920e-41b4-ab3e-6290b468f67e","Type":"ContainerDied","Data":"a273a959f4982f7806b4288ef717da003c681c077bce5cdbe15faf36f127d122"} Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.955160 4769 scope.go:117] "RemoveContainer" containerID="7fc5c0d6df65185683b2c29124b80ad842e4aae5b8fadc4c23ba405fc5f625b4" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.961627 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.963276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"42f1192a-d439-40df-8556-73ad9dfb2661","Type":"ContainerDied","Data":"6d72da84d72e778dd2542d527e85bde4b62e16bfb6466ba2c61e5eaa572edf91"} Nov 21 12:25:25 crc kubenswrapper[4769]: I1121 12:25:25.963358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.021533 4769 scope.go:117] "RemoveContainer" containerID="dcf00f51a8936e8fd67a01f716a150355f934b9d3a0d74d735dca76c45b37e47" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.024657 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-p9lsm"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.045294 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-p9lsm"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.068640 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.093874 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.108557 4769 scope.go:117] "RemoveContainer" containerID="c14158a8092ed632056e374aeeb2cb8124613b52601295d1c6caf8f0bdfe25e0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.119506 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120137 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-notification-agent" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-notification-agent" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120174 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-central-agent" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120208 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-central-agent" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120221 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="registry-server" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120227 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="registry-server" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120245 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="proxy-httpd" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120251 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="proxy-httpd" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120283 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="extract-content" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120289 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="extract-content" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120296 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="08ab69b0-1536-4e46-8ecc-b3cee3a42bff" containerName="cinder-db-sync" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120302 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="08ab69b0-1536-4e46-8ecc-b3cee3a42bff" containerName="cinder-db-sync" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="extract-utilities" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120320 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="extract-utilities" Nov 21 12:25:26 crc kubenswrapper[4769]: E1121 12:25:26.120340 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="sg-core" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.120346 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="sg-core" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.121145 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-central-agent" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.121177 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="sg-core" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.121303 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="proxy-httpd" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.121321 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" containerName="ceilometer-notification-agent" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.121338 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="08ab69b0-1536-4e46-8ecc-b3cee3a42bff" containerName="cinder-db-sync" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.121347 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" containerName="registry-server" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.135016 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.145045 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.145418 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.154581 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.189779 4769 scope.go:117] "RemoveContainer" containerID="7d1a029500c6947366ed7e6a90946726f19ca0207c1d19d97c4acf19378ec07c" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.211137 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.214121 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.220712 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.221008 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-rc2w6" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.221141 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.221347 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.243592 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.255871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-scripts\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.255986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.256032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-run-httpd\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.256112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.256179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-config-data\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.256264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k979k\" (UniqueName: \"kubernetes.io/projected/70060020-1f46-4ae5-82d7-9748609795bd-kube-api-access-k979k\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.256312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-log-httpd\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.290600 4769 scope.go:117] "RemoveContainer" containerID="324ccbb45d04fb926b8f52adee09e191ecddbc8b8f473a2298c6bbd54761e9cc" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-run-httpd\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358494 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-config-data\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k979k\" (UniqueName: \"kubernetes.io/projected/70060020-1f46-4ae5-82d7-9748609795bd-kube-api-access-k979k\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358583 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-log-httpd\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358608 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-scripts\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-scripts\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77mg9\" (UniqueName: \"kubernetes.io/projected/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-kube-api-access-77mg9\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.358685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.360947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-run-httpd\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.361924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-log-httpd\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.375337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.393843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-config-data\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.394310 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.394742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-scripts\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.396598 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.397552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.403823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.404572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k979k\" (UniqueName: \"kubernetes.io/projected/70060020-1f46-4ae5-82d7-9748609795bd-kube-api-access-k979k\") pod \"ceilometer-0\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.420377 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.430517 4769 scope.go:117] "RemoveContainer" containerID="b785b13b3833da7d25aa412e47bbaa59c7dd6101533fb0db6dfb982fddecec37" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dae89807-8018-492e-bc41-d80c8e41085d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-scripts\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-77mg9\" (UniqueName: \"kubernetes.io/projected/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-kube-api-access-77mg9\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-scripts\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460642 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data-custom\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpxtp\" (UniqueName: \"kubernetes.io/projected/dae89807-8018-492e-bc41-d80c8e41085d-kube-api-access-tpxtp\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dae89807-8018-492e-bc41-d80c8e41085d-logs\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.460859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.462925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.467024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.467225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-scripts\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.483297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.488334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.496793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-77mg9\" (UniqueName: \"kubernetes.io/projected/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-kube-api-access-77mg9\") pod \"cinder-scheduler-0\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.523525 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.560568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.563814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dae89807-8018-492e-bc41-d80c8e41085d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.563925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-scripts\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.563984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data-custom\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.564025 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tpxtp\" (UniqueName: \"kubernetes.io/projected/dae89807-8018-492e-bc41-d80c8e41085d-kube-api-access-tpxtp\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.564051 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dae89807-8018-492e-bc41-d80c8e41085d-logs\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.564130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.564230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.569002 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dae89807-8018-492e-bc41-d80c8e41085d-logs\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.569675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dae89807-8018-492e-bc41-d80c8e41085d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.586539 4769 scope.go:117] "RemoveContainer" containerID="4d7462dff1f44539da4e44f4c408065c2dc8c1aa3fad093665c47990622dba00" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.591345 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data-custom\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.592227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-scripts\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.595400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.598367 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.618807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpxtp\" (UniqueName: \"kubernetes.io/projected/dae89807-8018-492e-bc41-d80c8e41085d-kube-api-access-tpxtp\") pod \"cinder-api-0\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.903414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:26 crc kubenswrapper[4769]: I1121 12:25:26.910338 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:27 crc kubenswrapper[4769]: I1121 12:25:27.045180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e","Type":"ContainerStarted","Data":"46f4bbcbccd1b4b945c1bb0b82438631e74138ffc0c478ca64599bda98cda595"} Nov 21 12:25:27 crc kubenswrapper[4769]: I1121 12:25:27.047716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerStarted","Data":"df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d"} Nov 21 12:25:27 crc kubenswrapper[4769]: I1121 12:25:27.331373 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d7df5e-920e-41b4-ab3e-6290b468f67e" path="/var/lib/kubelet/pods/31d7df5e-920e-41b4-ab3e-6290b468f67e/volumes" Nov 21 12:25:27 crc kubenswrapper[4769]: I1121 12:25:27.346999 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f1192a-d439-40df-8556-73ad9dfb2661" path="/var/lib/kubelet/pods/42f1192a-d439-40df-8556-73ad9dfb2661/volumes" Nov 21 12:25:27 crc kubenswrapper[4769]: I1121 12:25:27.348088 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:27 crc kubenswrapper[4769]: W1121 12:25:27.374309 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70060020_1f46_4ae5_82d7_9748609795bd.slice/crio-ac9ca74022dddbdf6e75d51c034f9aee5cca0db7b6ef7bae2aa39cb9d8c164e4 WatchSource:0}: Error finding container ac9ca74022dddbdf6e75d51c034f9aee5cca0db7b6ef7bae2aa39cb9d8c164e4: Status 404 returned error can't find the container with id ac9ca74022dddbdf6e75d51c034f9aee5cca0db7b6ef7bae2aa39cb9d8c164e4 Nov 21 12:25:27 crc kubenswrapper[4769]: I1121 12:25:27.462455 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:27 crc kubenswrapper[4769]: W1121 12:25:27.488291 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddae89807_8018_492e_bc41_d80c8e41085d.slice/crio-defb45212f5180ccb22b2d4b371627b8c547bb2be12e8fd397e458a92dea2226 WatchSource:0}: Error finding container defb45212f5180ccb22b2d4b371627b8c547bb2be12e8fd397e458a92dea2226: Status 404 returned error can't find the container with id defb45212f5180ccb22b2d4b371627b8c547bb2be12e8fd397e458a92dea2226 Nov 21 12:25:28 crc kubenswrapper[4769]: I1121 12:25:28.063497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dae89807-8018-492e-bc41-d80c8e41085d","Type":"ContainerStarted","Data":"defb45212f5180ccb22b2d4b371627b8c547bb2be12e8fd397e458a92dea2226"} Nov 21 12:25:28 crc kubenswrapper[4769]: I1121 12:25:28.064742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerStarted","Data":"ac9ca74022dddbdf6e75d51c034f9aee5cca0db7b6ef7bae2aa39cb9d8c164e4"} Nov 21 12:25:28 crc kubenswrapper[4769]: I1121 12:25:28.070091 4769 generic.go:334] "Generic (PLEG): container finished" podID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerID="df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d" exitCode=0 Nov 21 12:25:28 crc kubenswrapper[4769]: I1121 12:25:28.070152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerDied","Data":"df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d"} Nov 21 12:25:28 crc kubenswrapper[4769]: I1121 12:25:28.078058 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:29 crc kubenswrapper[4769]: I1121 12:25:29.107236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e","Type":"ContainerStarted","Data":"37fab6f6791ed34848de744caae04697b03ae6c08ae11f4a4f0af6196254849f"} Nov 21 12:25:29 crc kubenswrapper[4769]: I1121 12:25:29.132713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dae89807-8018-492e-bc41-d80c8e41085d","Type":"ContainerStarted","Data":"c58738b72ede9393232f72b13de34f1a3e9ace60254f139f5fb5dddbb6f78183"} Nov 21 12:25:29 crc kubenswrapper[4769]: I1121 12:25:29.146858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerStarted","Data":"2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c"} Nov 21 12:25:30 crc kubenswrapper[4769]: I1121 12:25:30.155631 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:30 crc kubenswrapper[4769]: I1121 12:25:30.168054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e","Type":"ContainerStarted","Data":"0e4a1103c894a3851a11ebcd65617186ba8bd9419bf99cb6316348b35aa87f43"} Nov 21 12:25:30 crc kubenswrapper[4769]: I1121 12:25:30.212862 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.212831547 podStartE2EDuration="4.212831547s" podCreationTimestamp="2025-11-21 12:25:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:30.210985418 +0000 UTC m=+2088.911647236" watchObservedRunningTime="2025-11-21 12:25:30.212831547 +0000 UTC m=+2088.913493365" Nov 21 12:25:30 crc kubenswrapper[4769]: I1121 12:25:30.351424 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:31 crc kubenswrapper[4769]: I1121 12:25:31.199390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dae89807-8018-492e-bc41-d80c8e41085d","Type":"ContainerStarted","Data":"6f7ee7c88e74df6fc39b055106a4cc8ba0411e3ddd2765b9e8dca827df6bb1c3"} Nov 21 12:25:31 crc kubenswrapper[4769]: I1121 12:25:31.201093 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api-log" containerID="cri-o://c58738b72ede9393232f72b13de34f1a3e9ace60254f139f5fb5dddbb6f78183" gracePeriod=30 Nov 21 12:25:31 crc kubenswrapper[4769]: I1121 12:25:31.201352 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:31 crc kubenswrapper[4769]: I1121 12:25:31.201854 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api" containerID="cri-o://6f7ee7c88e74df6fc39b055106a4cc8ba0411e3ddd2765b9e8dca827df6bb1c3" gracePeriod=30 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:31.221512 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerStarted","Data":"4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:31.241977 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.241944846 podStartE2EDuration="5.241944846s" podCreationTimestamp="2025-11-21 12:25:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:31.232572765 +0000 UTC m=+2089.933234583" watchObservedRunningTime="2025-11-21 12:25:31.241944846 +0000 UTC m=+2089.942606664" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:31.273450 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-6t9xc" podStartSLOduration=4.5141944259999995 podStartE2EDuration="9.273422402s" podCreationTimestamp="2025-11-21 12:25:22 +0000 UTC" firstStartedPulling="2025-11-21 12:25:24.926800483 +0000 UTC m=+2083.627462301" lastFinishedPulling="2025-11-21 12:25:29.686028459 +0000 UTC m=+2088.386690277" observedRunningTime="2025-11-21 12:25:31.266021623 +0000 UTC m=+2089.966683441" watchObservedRunningTime="2025-11-21 12:25:31.273422402 +0000 UTC m=+2089.974084230" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:31.561169 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:37 crc kubenswrapper[4769]: E1121 12:25:31.657471 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddae89807_8018_492e_bc41_d80c8e41085d.slice/crio-6f7ee7c88e74df6fc39b055106a4cc8ba0411e3ddd2765b9e8dca827df6bb1c3.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.223257 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.241330 4769 generic.go:334] "Generic (PLEG): container finished" podID="dae89807-8018-492e-bc41-d80c8e41085d" containerID="6f7ee7c88e74df6fc39b055106a4cc8ba0411e3ddd2765b9e8dca827df6bb1c3" exitCode=0 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.241385 4769 generic.go:334] "Generic (PLEG): container finished" podID="dae89807-8018-492e-bc41-d80c8e41085d" containerID="c58738b72ede9393232f72b13de34f1a3e9ace60254f139f5fb5dddbb6f78183" exitCode=143 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.241440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dae89807-8018-492e-bc41-d80c8e41085d","Type":"ContainerDied","Data":"6f7ee7c88e74df6fc39b055106a4cc8ba0411e3ddd2765b9e8dca827df6bb1c3"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.241508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dae89807-8018-492e-bc41-d80c8e41085d","Type":"ContainerDied","Data":"c58738b72ede9393232f72b13de34f1a3e9ace60254f139f5fb5dddbb6f78183"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.370862 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-55c658785b-vntdg"] Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.371180 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api-log" containerID="cri-o://c2579e4bf01016cd2b3193bd5d76b1e51e09c14e6308b0835bb3dba188413dcc" gracePeriod=30 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:32.371389 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api" containerID="cri-o://fcf239f1c2da8f21cc5db7324e3c258aee01153b2af7a81e0cd5129998d7d5c1" gracePeriod=30 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:33.328276 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:33.328358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:33.939972 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.062921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpxtp\" (UniqueName: \"kubernetes.io/projected/dae89807-8018-492e-bc41-d80c8e41085d-kube-api-access-tpxtp\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.063113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dae89807-8018-492e-bc41-d80c8e41085d-etc-machine-id\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.063177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.063264 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-scripts\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.063282 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dae89807-8018-492e-bc41-d80c8e41085d-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.064208 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-combined-ca-bundle\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.064256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data-custom\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.064289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dae89807-8018-492e-bc41-d80c8e41085d-logs\") pod \"dae89807-8018-492e-bc41-d80c8e41085d\" (UID: \"dae89807-8018-492e-bc41-d80c8e41085d\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.064857 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dae89807-8018-492e-bc41-d80c8e41085d-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.065020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae89807-8018-492e-bc41-d80c8e41085d-logs" (OuterVolumeSpecName: "logs") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.074931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-scripts" (OuterVolumeSpecName: "scripts") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.075289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.082677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae89807-8018-492e-bc41-d80c8e41085d-kube-api-access-tpxtp" (OuterVolumeSpecName: "kube-api-access-tpxtp") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "kube-api-access-tpxtp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.109558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.134656 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data" (OuterVolumeSpecName: "config-data") pod "dae89807-8018-492e-bc41-d80c8e41085d" (UID: "dae89807-8018-492e-bc41-d80c8e41085d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.168110 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.168154 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.168208 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dae89807-8018-492e-bc41-d80c8e41085d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.168239 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tpxtp\" (UniqueName: \"kubernetes.io/projected/dae89807-8018-492e-bc41-d80c8e41085d-kube-api-access-tpxtp\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.168282 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.168297 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dae89807-8018-492e-bc41-d80c8e41085d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.280377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerStarted","Data":"212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.289347 4769 generic.go:334] "Generic (PLEG): container finished" podID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerID="c2579e4bf01016cd2b3193bd5d76b1e51e09c14e6308b0835bb3dba188413dcc" exitCode=143 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.289481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" event={"ID":"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7","Type":"ContainerDied","Data":"c2579e4bf01016cd2b3193bd5d76b1e51e09c14e6308b0835bb3dba188413dcc"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.294387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dae89807-8018-492e-bc41-d80c8e41085d","Type":"ContainerDied","Data":"defb45212f5180ccb22b2d4b371627b8c547bb2be12e8fd397e458a92dea2226"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.294455 4769 scope.go:117] "RemoveContainer" containerID="6f7ee7c88e74df6fc39b055106a4cc8ba0411e3ddd2765b9e8dca827df6bb1c3" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.294529 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.352112 4769 scope.go:117] "RemoveContainer" containerID="c58738b72ede9393232f72b13de34f1a3e9ace60254f139f5fb5dddbb6f78183" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.371331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.390611 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.394912 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-6t9xc" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="registry-server" probeResult="failure" output=< Nov 21 12:25:37 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:25:37 crc kubenswrapper[4769]: > Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.408641 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:37 crc kubenswrapper[4769]: E1121 12:25:34.409115 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.409130 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api" Nov 21 12:25:37 crc kubenswrapper[4769]: E1121 12:25:34.409163 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api-log" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.409169 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api-log" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.409352 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api-log" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.409370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dae89807-8018-492e-bc41-d80c8e41085d" containerName="cinder-api" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.410402 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.414540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.414818 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.414986 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.419680 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v9mt\" (UniqueName: \"kubernetes.io/projected/a393fa88-8741-40b7-8a55-4f853c1722b8-kube-api-access-4v9mt\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-scripts\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a393fa88-8741-40b7-8a55-4f853c1722b8-logs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582521 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data-custom\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a393fa88-8741-40b7-8a55-4f853c1722b8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.582857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.684449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4v9mt\" (UniqueName: \"kubernetes.io/projected/a393fa88-8741-40b7-8a55-4f853c1722b8-kube-api-access-4v9mt\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.685345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-scripts\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.685667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a393fa88-8741-40b7-8a55-4f853c1722b8-logs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.685751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.685974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a393fa88-8741-40b7-8a55-4f853c1722b8-logs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.685786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.686568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.686649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data-custom\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.686784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a393fa88-8741-40b7-8a55-4f853c1722b8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.686878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a393fa88-8741-40b7-8a55-4f853c1722b8-etc-machine-id\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.686951 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.691007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-scripts\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.691930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.692266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data-custom\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.692823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.692839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-public-tls-certs\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.695446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.705506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v9mt\" (UniqueName: \"kubernetes.io/projected/a393fa88-8741-40b7-8a55-4f853c1722b8-kube-api-access-4v9mt\") pod \"cinder-api-0\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:34.752877 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:35.287680 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae89807-8018-492e-bc41-d80c8e41085d" path="/var/lib/kubelet/pods/dae89807-8018-492e-bc41-d80c8e41085d/volumes" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:35.540588 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.94:9311/healthcheck\": read tcp 10.217.0.2:53878->10.217.1.94:9311: read: connection reset by peer" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:35.540964 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.94:9311/healthcheck\": read tcp 10.217.0.2:53874->10.217.1.94:9311: read: connection reset by peer" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:36.322431 4769 generic.go:334] "Generic (PLEG): container finished" podID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerID="fcf239f1c2da8f21cc5db7324e3c258aee01153b2af7a81e0cd5129998d7d5c1" exitCode=0 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:36.322531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" event={"ID":"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7","Type":"ContainerDied","Data":"fcf239f1c2da8f21cc5db7324e3c258aee01153b2af7a81e0cd5129998d7d5c1"} Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:36.862323 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:36.915157 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.343722 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="cinder-scheduler" containerID="cri-o://37fab6f6791ed34848de744caae04697b03ae6c08ae11f4a4f0af6196254849f" gracePeriod=30 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.344076 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="probe" containerID="cri-o://0e4a1103c894a3851a11ebcd65617186ba8bd9419bf99cb6316348b35aa87f43" gracePeriod=30 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.716415 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.784897 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:25:37 crc kubenswrapper[4769]: W1121 12:25:37.798464 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda393fa88_8741_40b7_8a55_4f853c1722b8.slice/crio-f622e650095dfc402107f3a419e69c392ee055bb6e028509b01fce6b03aee357 WatchSource:0}: Error finding container f622e650095dfc402107f3a419e69c392ee055bb6e028509b01fce6b03aee357: Status 404 returned error can't find the container with id f622e650095dfc402107f3a419e69c392ee055bb6e028509b01fce6b03aee357 Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.878452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data\") pod \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.878503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data-custom\") pod \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.878698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-logs\") pod \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.878732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdd2t\" (UniqueName: \"kubernetes.io/projected/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-kube-api-access-wdd2t\") pod \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.878783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-combined-ca-bundle\") pod \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\" (UID: \"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7\") " Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.879814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-logs" (OuterVolumeSpecName: "logs") pod "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" (UID: "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.897960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" (UID: "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.913461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-kube-api-access-wdd2t" (OuterVolumeSpecName: "kube-api-access-wdd2t") pod "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" (UID: "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7"). InnerVolumeSpecName "kube-api-access-wdd2t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.913860 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" (UID: "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.950933 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data" (OuterVolumeSpecName: "config-data") pod "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" (UID: "d749a2ec-85d6-49e4-9ea1-b8b7580fdac7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.985997 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.986050 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.986069 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.986079 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wdd2t\" (UniqueName: \"kubernetes.io/projected/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-kube-api-access-wdd2t\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:37 crc kubenswrapper[4769]: I1121 12:25:37.986090 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.378146 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerID="0e4a1103c894a3851a11ebcd65617186ba8bd9419bf99cb6316348b35aa87f43" exitCode=0 Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.378609 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerID="37fab6f6791ed34848de744caae04697b03ae6c08ae11f4a4f0af6196254849f" exitCode=0 Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.378402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e","Type":"ContainerDied","Data":"0e4a1103c894a3851a11ebcd65617186ba8bd9419bf99cb6316348b35aa87f43"} Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.378703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e","Type":"ContainerDied","Data":"37fab6f6791ed34848de744caae04697b03ae6c08ae11f4a4f0af6196254849f"} Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.382045 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerStarted","Data":"32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42"} Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.385143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" event={"ID":"d749a2ec-85d6-49e4-9ea1-b8b7580fdac7","Type":"ContainerDied","Data":"44a11d6d47e258aeeb2a9c4a0d0d3be63ba34aecd67a92c3a462c74cf2871206"} Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.385217 4769 scope.go:117] "RemoveContainer" containerID="fcf239f1c2da8f21cc5db7324e3c258aee01153b2af7a81e0cd5129998d7d5c1" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.389600 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55c658785b-vntdg" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.399915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a393fa88-8741-40b7-8a55-4f853c1722b8","Type":"ContainerStarted","Data":"f622e650095dfc402107f3a419e69c392ee055bb6e028509b01fce6b03aee357"} Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.419029 4769 scope.go:117] "RemoveContainer" containerID="c2579e4bf01016cd2b3193bd5d76b1e51e09c14e6308b0835bb3dba188413dcc" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.448248 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-55c658785b-vntdg"] Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.461751 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-55c658785b-vntdg"] Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.686283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.807266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-scripts\") pod \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.807613 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data\") pod \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.807667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data-custom\") pod \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.807745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-combined-ca-bundle\") pod \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.807867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-etc-machine-id\") pod \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.807917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77mg9\" (UniqueName: \"kubernetes.io/projected/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-kube-api-access-77mg9\") pod \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\" (UID: \"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e\") " Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.808455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" (UID: "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.809065 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.815417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" (UID: "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.825475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-scripts" (OuterVolumeSpecName: "scripts") pod "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" (UID: "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.825550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-kube-api-access-77mg9" (OuterVolumeSpecName: "kube-api-access-77mg9") pod "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" (UID: "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e"). InnerVolumeSpecName "kube-api-access-77mg9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.882871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" (UID: "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.911152 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-77mg9\" (UniqueName: \"kubernetes.io/projected/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-kube-api-access-77mg9\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.911232 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.911252 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.911269 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:38 crc kubenswrapper[4769]: I1121 12:25:38.926169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data" (OuterVolumeSpecName: "config-data") pod "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" (UID: "fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.014962 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.287026 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" path="/var/lib/kubelet/pods/d749a2ec-85d6-49e4-9ea1-b8b7580fdac7/volumes" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.415774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a393fa88-8741-40b7-8a55-4f853c1722b8","Type":"ContainerStarted","Data":"677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d"} Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.416409 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.416428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a393fa88-8741-40b7-8a55-4f853c1722b8","Type":"ContainerStarted","Data":"9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34"} Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.420719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e","Type":"ContainerDied","Data":"46f4bbcbccd1b4b945c1bb0b82438631e74138ffc0c478ca64599bda98cda595"} Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.421075 4769 scope.go:117] "RemoveContainer" containerID="0e4a1103c894a3851a11ebcd65617186ba8bd9419bf99cb6316348b35aa87f43" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.421023 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.459143 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.459116142 podStartE2EDuration="5.459116142s" podCreationTimestamp="2025-11-21 12:25:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:39.45268628 +0000 UTC m=+2098.153348108" watchObservedRunningTime="2025-11-21 12:25:39.459116142 +0000 UTC m=+2098.159777960" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.477137 4769 scope.go:117] "RemoveContainer" containerID="37fab6f6791ed34848de744caae04697b03ae6c08ae11f4a4f0af6196254849f" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.486460 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.498240 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.520308 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:39 crc kubenswrapper[4769]: E1121 12:25:39.521430 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.521512 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api" Nov 21 12:25:39 crc kubenswrapper[4769]: E1121 12:25:39.521587 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api-log" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.521631 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api-log" Nov 21 12:25:39 crc kubenswrapper[4769]: E1121 12:25:39.521681 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="cinder-scheduler" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.521724 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="cinder-scheduler" Nov 21 12:25:39 crc kubenswrapper[4769]: E1121 12:25:39.521786 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="probe" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.521834 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="probe" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.522632 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.522736 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="probe" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.523978 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" containerName="cinder-scheduler" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.524141 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d749a2ec-85d6-49e4-9ea1-b8b7580fdac7" containerName="barbican-api-log" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.535949 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.547472 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.549731 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.632889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.633004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.633073 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-scripts\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.633093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.633142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.633174 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbwq\" (UniqueName: \"kubernetes.io/projected/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-kube-api-access-sqbwq\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.735174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.735484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.736210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-scripts\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.736302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.736413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.736493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbwq\" (UniqueName: \"kubernetes.io/projected/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-kube-api-access-sqbwq\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.736933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.742286 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-scripts\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.742544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.748149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.752842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.755469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbwq\" (UniqueName: \"kubernetes.io/projected/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-kube-api-access-sqbwq\") pod \"cinder-scheduler-0\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:39 crc kubenswrapper[4769]: I1121 12:25:39.900773 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:40 crc kubenswrapper[4769]: W1121 12:25:40.410599 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b8ee7d0_9900_447f_8b43_f72587e6c8c1.slice/crio-a5c9f59aeebd9a15559c05145c1e451785bfe9988e551d90dd2ff60c6456d310 WatchSource:0}: Error finding container a5c9f59aeebd9a15559c05145c1e451785bfe9988e551d90dd2ff60c6456d310: Status 404 returned error can't find the container with id a5c9f59aeebd9a15559c05145c1e451785bfe9988e551d90dd2ff60c6456d310 Nov 21 12:25:40 crc kubenswrapper[4769]: I1121 12:25:40.412112 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:25:40 crc kubenswrapper[4769]: I1121 12:25:40.439749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3b8ee7d0-9900-447f-8b43-f72587e6c8c1","Type":"ContainerStarted","Data":"a5c9f59aeebd9a15559c05145c1e451785bfe9988e551d90dd2ff60c6456d310"} Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.288120 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e" path="/var/lib/kubelet/pods/fd1aa7d4-f01d-4a33-92fb-d3dbaed59b8e/volumes" Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.325888 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.326366 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.454033 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3b8ee7d0-9900-447f-8b43-f72587e6c8c1","Type":"ContainerStarted","Data":"6d49d98619ee6cdd108b34a214e56a3a10487178b559a6a4ca100eb8c8680c8f"} Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.458104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerStarted","Data":"d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd"} Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.459148 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:41 crc kubenswrapper[4769]: I1121 12:25:41.490385 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.544978506 podStartE2EDuration="15.490365695s" podCreationTimestamp="2025-11-21 12:25:26 +0000 UTC" firstStartedPulling="2025-11-21 12:25:27.407119166 +0000 UTC m=+2086.107780984" lastFinishedPulling="2025-11-21 12:25:40.352506355 +0000 UTC m=+2099.053168173" observedRunningTime="2025-11-21 12:25:41.485839983 +0000 UTC m=+2100.186501811" watchObservedRunningTime="2025-11-21 12:25:41.490365695 +0000 UTC m=+2100.191027513" Nov 21 12:25:42 crc kubenswrapper[4769]: I1121 12:25:42.469750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3b8ee7d0-9900-447f-8b43-f72587e6c8c1","Type":"ContainerStarted","Data":"0fb0a642c9ce1976223af5451527b445f097c8a7afc70cd602bd2f6a565363e6"} Nov 21 12:25:42 crc kubenswrapper[4769]: I1121 12:25:42.497155 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.497130603 podStartE2EDuration="3.497130603s" podCreationTimestamp="2025-11-21 12:25:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:42.491444411 +0000 UTC m=+2101.192106249" watchObservedRunningTime="2025-11-21 12:25:42.497130603 +0000 UTC m=+2101.197792421" Nov 21 12:25:43 crc kubenswrapper[4769]: I1121 12:25:43.327763 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:43 crc kubenswrapper[4769]: I1121 12:25:43.331414 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:25:43 crc kubenswrapper[4769]: I1121 12:25:43.409142 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:43 crc kubenswrapper[4769]: I1121 12:25:43.504463 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:43 crc kubenswrapper[4769]: I1121 12:25:43.651428 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-6t9xc"] Nov 21 12:25:44 crc kubenswrapper[4769]: I1121 12:25:44.182683 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:25:44 crc kubenswrapper[4769]: I1121 12:25:44.508697 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-6t9xc" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="registry-server" containerID="cri-o://4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f" gracePeriod=2 Nov 21 12:25:44 crc kubenswrapper[4769]: I1121 12:25:44.901149 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.020589 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.180950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngk8\" (UniqueName: \"kubernetes.io/projected/f86b8cf5-65ee-42eb-98f0-a7551868a79c-kube-api-access-mngk8\") pod \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.181136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-catalog-content\") pod \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.181433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-utilities\") pod \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\" (UID: \"f86b8cf5-65ee-42eb-98f0-a7551868a79c\") " Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.182243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-utilities" (OuterVolumeSpecName: "utilities") pod "f86b8cf5-65ee-42eb-98f0-a7551868a79c" (UID: "f86b8cf5-65ee-42eb-98f0-a7551868a79c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.187026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f86b8cf5-65ee-42eb-98f0-a7551868a79c-kube-api-access-mngk8" (OuterVolumeSpecName: "kube-api-access-mngk8") pod "f86b8cf5-65ee-42eb-98f0-a7551868a79c" (UID: "f86b8cf5-65ee-42eb-98f0-a7551868a79c"). InnerVolumeSpecName "kube-api-access-mngk8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.275915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f86b8cf5-65ee-42eb-98f0-a7551868a79c" (UID: "f86b8cf5-65ee-42eb-98f0-a7551868a79c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.283777 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mngk8\" (UniqueName: \"kubernetes.io/projected/f86b8cf5-65ee-42eb-98f0-a7551868a79c-kube-api-access-mngk8\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.283826 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.283841 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f86b8cf5-65ee-42eb-98f0-a7551868a79c-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.523158 4769 generic.go:334] "Generic (PLEG): container finished" podID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerID="4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f" exitCode=0 Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.523248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerDied","Data":"4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f"} Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.523288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-6t9xc" event={"ID":"f86b8cf5-65ee-42eb-98f0-a7551868a79c","Type":"ContainerDied","Data":"bd2e739f1b959526e179a0e3afdc05e85d7f28b3b048217119217aa5a86a69a5"} Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.523312 4769 scope.go:117] "RemoveContainer" containerID="4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.523308 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-6t9xc" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.563546 4769 scope.go:117] "RemoveContainer" containerID="df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.570276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-6t9xc"] Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.587108 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-6t9xc"] Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.599201 4769 scope.go:117] "RemoveContainer" containerID="d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.643974 4769 scope.go:117] "RemoveContainer" containerID="4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f" Nov 21 12:25:45 crc kubenswrapper[4769]: E1121 12:25:45.644764 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f\": container with ID starting with 4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f not found: ID does not exist" containerID="4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.644833 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f"} err="failed to get container status \"4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f\": rpc error: code = NotFound desc = could not find container \"4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f\": container with ID starting with 4cb22557ec4ed112f8244a0897bfb9c4c2fcd1d15f7c3c1d40d85e61efa0786f not found: ID does not exist" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.644875 4769 scope.go:117] "RemoveContainer" containerID="df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d" Nov 21 12:25:45 crc kubenswrapper[4769]: E1121 12:25:45.648449 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d\": container with ID starting with df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d not found: ID does not exist" containerID="df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.648487 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d"} err="failed to get container status \"df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d\": rpc error: code = NotFound desc = could not find container \"df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d\": container with ID starting with df439a8edbdcefbaff1324499b9387732cb41dc317b9f3ffb0e3fae3845d701d not found: ID does not exist" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.648517 4769 scope.go:117] "RemoveContainer" containerID="d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d" Nov 21 12:25:45 crc kubenswrapper[4769]: E1121 12:25:45.652592 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d\": container with ID starting with d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d not found: ID does not exist" containerID="d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d" Nov 21 12:25:45 crc kubenswrapper[4769]: I1121 12:25:45.652628 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d"} err="failed to get container status \"d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d\": rpc error: code = NotFound desc = could not find container \"d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d\": container with ID starting with d609a90b4195b0668cd5e527082ee769f47800cd9e106459614ce2f8203b610d not found: ID does not exist" Nov 21 12:25:46 crc kubenswrapper[4769]: I1121 12:25:46.810013 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.301960 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" path="/var/lib/kubelet/pods/f86b8cf5-65ee-42eb-98f0-a7551868a79c/volumes" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.710218 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d"] Nov 21 12:25:47 crc kubenswrapper[4769]: E1121 12:25:47.710601 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="extract-utilities" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.710617 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="extract-utilities" Nov 21 12:25:47 crc kubenswrapper[4769]: E1121 12:25:47.710633 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="registry-server" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.710640 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="registry-server" Nov 21 12:25:47 crc kubenswrapper[4769]: E1121 12:25:47.710658 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="extract-content" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.710665 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="extract-content" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.710842 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f86b8cf5-65ee-42eb-98f0-a7551868a79c" containerName="registry-server" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.711823 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.714319 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.714612 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.728036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.771010 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d"] Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-config-data\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-etc-swift\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-internal-tls-certs\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-run-httpd\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhdss\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-kube-api-access-xhdss\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-log-httpd\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-combined-ca-bundle\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.827833 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-public-tls-certs\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.930805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-run-httpd\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.930948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xhdss\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-kube-api-access-xhdss\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.930983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-log-httpd\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-combined-ca-bundle\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-public-tls-certs\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-config-data\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-etc-swift\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-internal-tls-certs\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931566 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-run-httpd\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.931595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-log-httpd\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.938664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-config-data\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.941073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-combined-ca-bundle\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.952020 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-etc-swift\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.952426 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-internal-tls-certs\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.953446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-public-tls-certs\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:47 crc kubenswrapper[4769]: I1121 12:25:47.953898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhdss\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-kube-api-access-xhdss\") pod \"swift-proxy-57489bd448-vcj8d\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.037739 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.554841 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d"] Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.663216 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.665069 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.667904 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-rshvj" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.668425 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.668665 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.686208 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.746308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.746374 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config-secret\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.746537 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj86k\" (UniqueName: \"kubernetes.io/projected/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-kube-api-access-jj86k\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.746595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.847860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.847919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config-secret\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.847954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jj86k\" (UniqueName: \"kubernetes.io/projected/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-kube-api-access-jj86k\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.847990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.848852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.851624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config-secret\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.852020 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-combined-ca-bundle\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:48 crc kubenswrapper[4769]: I1121 12:25:48.871521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj86k\" (UniqueName: \"kubernetes.io/projected/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-kube-api-access-jj86k\") pod \"openstackclient\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.012630 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.519074 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.574838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"d4f893d1-0e6e-453b-898e-9d3a5b356c7d","Type":"ContainerStarted","Data":"9dcf59f6ac0ac3f871f18e7b586f292c065fb2a67ce7d05a5f2ecf6f8d2b32ec"} Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.582362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" event={"ID":"46dff394-5dc3-442d-bbe2-31563973474a","Type":"ContainerStarted","Data":"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904"} Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.582441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" event={"ID":"46dff394-5dc3-442d-bbe2-31563973474a","Type":"ContainerStarted","Data":"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372"} Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.582456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" event={"ID":"46dff394-5dc3-442d-bbe2-31563973474a","Type":"ContainerStarted","Data":"c165e460bcf61bbd1368141de57da7ba7865926b582743f0222ec367ddea460a"} Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.582936 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.582989 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.632555 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" podStartSLOduration=2.632524627 podStartE2EDuration="2.632524627s" podCreationTimestamp="2025-11-21 12:25:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:49.618720647 +0000 UTC m=+2108.319382475" watchObservedRunningTime="2025-11-21 12:25:49.632524627 +0000 UTC m=+2108.333186445" Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.961088 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.961378 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-central-agent" containerID="cri-o://2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c" gracePeriod=30 Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.961858 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="proxy-httpd" containerID="cri-o://d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd" gracePeriod=30 Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.961909 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="sg-core" containerID="cri-o://32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42" gracePeriod=30 Nov 21 12:25:49 crc kubenswrapper[4769]: I1121 12:25:49.961943 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-notification-agent" containerID="cri-o://212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0" gracePeriod=30 Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.366276 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.616927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"d4f893d1-0e6e-453b-898e-9d3a5b356c7d","Type":"ContainerStarted","Data":"cf007a44166b81d3a19a2d768bced5fb403930d33c79d57e889c4f7605de2fb9"} Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.630287 4769 generic.go:334] "Generic (PLEG): container finished" podID="70060020-1f46-4ae5-82d7-9748609795bd" containerID="d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd" exitCode=0 Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.630343 4769 generic.go:334] "Generic (PLEG): container finished" podID="70060020-1f46-4ae5-82d7-9748609795bd" containerID="32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42" exitCode=2 Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.630359 4769 generic.go:334] "Generic (PLEG): container finished" podID="70060020-1f46-4ae5-82d7-9748609795bd" containerID="2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c" exitCode=0 Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.630613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerDied","Data":"d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd"} Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.630731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerDied","Data":"32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42"} Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.630807 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerDied","Data":"2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c"} Nov 21 12:25:50 crc kubenswrapper[4769]: I1121 12:25:50.659617 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.65958327 podStartE2EDuration="2.65958327s" podCreationTimestamp="2025-11-21 12:25:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:50.641047252 +0000 UTC m=+2109.341709090" watchObservedRunningTime="2025-11-21 12:25:50.65958327 +0000 UTC m=+2109.360245098" Nov 21 12:25:53 crc kubenswrapper[4769]: I1121 12:25:53.047770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:53 crc kubenswrapper[4769]: I1121 12:25:53.050005 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:25:54 crc kubenswrapper[4769]: I1121 12:25:54.673281 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c096c83-a4ea-4dee-8821-0381ced22974" containerID="b561d78b1aab93c805dec672e918401150426bffbf2915c7d48f124611afdd4c" exitCode=0 Nov 21 12:25:54 crc kubenswrapper[4769]: I1121 12:25:54.673357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" event={"ID":"3c096c83-a4ea-4dee-8821-0381ced22974","Type":"ContainerDied","Data":"b561d78b1aab93c805dec672e918401150426bffbf2915c7d48f124611afdd4c"} Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.355302 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-log-httpd\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-config-data\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-sg-core-conf-yaml\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-run-httpd\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-combined-ca-bundle\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k979k\" (UniqueName: \"kubernetes.io/projected/70060020-1f46-4ae5-82d7-9748609795bd-kube-api-access-k979k\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.490976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-scripts\") pod \"70060020-1f46-4ae5-82d7-9748609795bd\" (UID: \"70060020-1f46-4ae5-82d7-9748609795bd\") " Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.491480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.491556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.498134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-scripts" (OuterVolumeSpecName: "scripts") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.499262 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70060020-1f46-4ae5-82d7-9748609795bd-kube-api-access-k979k" (OuterVolumeSpecName: "kube-api-access-k979k") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "kube-api-access-k979k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.532593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.593317 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k979k\" (UniqueName: \"kubernetes.io/projected/70060020-1f46-4ae5-82d7-9748609795bd-kube-api-access-k979k\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.593358 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.593368 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.593378 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.593387 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/70060020-1f46-4ae5-82d7-9748609795bd-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.593681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.617581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-config-data" (OuterVolumeSpecName: "config-data") pod "70060020-1f46-4ae5-82d7-9748609795bd" (UID: "70060020-1f46-4ae5-82d7-9748609795bd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.686621 4769 generic.go:334] "Generic (PLEG): container finished" podID="70060020-1f46-4ae5-82d7-9748609795bd" containerID="212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0" exitCode=0 Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.686715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerDied","Data":"212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0"} Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.686767 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.686787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"70060020-1f46-4ae5-82d7-9748609795bd","Type":"ContainerDied","Data":"ac9ca74022dddbdf6e75d51c034f9aee5cca0db7b6ef7bae2aa39cb9d8c164e4"} Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.686807 4769 scope.go:117] "RemoveContainer" containerID="d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.703379 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.703419 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70060020-1f46-4ae5-82d7-9748609795bd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.715164 4769 scope.go:117] "RemoveContainer" containerID="32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.739690 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.751435 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.765814 4769 scope.go:117] "RemoveContainer" containerID="212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.789500 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.790405 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="proxy-httpd" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.790520 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="proxy-httpd" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.790623 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-notification-agent" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.790703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-notification-agent" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.790831 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="sg-core" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.790913 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="sg-core" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.790991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-central-agent" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.791068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-central-agent" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.791403 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="sg-core" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.791502 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="proxy-httpd" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.791603 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-central-agent" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.791697 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70060020-1f46-4ae5-82d7-9748609795bd" containerName="ceilometer-notification-agent" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.794296 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.799491 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.799659 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.802580 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.836438 4769 scope.go:117] "RemoveContainer" containerID="2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.878599 4769 scope.go:117] "RemoveContainer" containerID="d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.879693 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd\": container with ID starting with d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd not found: ID does not exist" containerID="d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.879769 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd"} err="failed to get container status \"d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd\": rpc error: code = NotFound desc = could not find container \"d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd\": container with ID starting with d8fc805ab33587a5d4f158ebb5534549e3a13932f35f318feaa1ccd1413f41bd not found: ID does not exist" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.879813 4769 scope.go:117] "RemoveContainer" containerID="32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.880503 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42\": container with ID starting with 32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42 not found: ID does not exist" containerID="32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.880543 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42"} err="failed to get container status \"32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42\": rpc error: code = NotFound desc = could not find container \"32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42\": container with ID starting with 32bb308b63d8e27a9cd285df426b5b1460fd3c75beff7fea470dc19e46d49c42 not found: ID does not exist" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.880591 4769 scope.go:117] "RemoveContainer" containerID="212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.880948 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0\": container with ID starting with 212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0 not found: ID does not exist" containerID="212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.880996 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0"} err="failed to get container status \"212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0\": rpc error: code = NotFound desc = could not find container \"212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0\": container with ID starting with 212e03f62993f2d5a50caff764617c349dec7510999a2bc35ce1b9a6d76e1dd0 not found: ID does not exist" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.881042 4769 scope.go:117] "RemoveContainer" containerID="2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c" Nov 21 12:25:55 crc kubenswrapper[4769]: E1121 12:25:55.881420 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c\": container with ID starting with 2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c not found: ID does not exist" containerID="2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.881460 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c"} err="failed to get container status \"2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c\": rpc error: code = NotFound desc = could not find container \"2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c\": container with ID starting with 2bd433d2feac617ab0b47531a8c8b8cb556e6d720ce81bda7a54193416ae366c not found: ID does not exist" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.910922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.910975 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4s7j\" (UniqueName: \"kubernetes.io/projected/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-kube-api-access-c4s7j\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.911321 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-run-httpd\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.911421 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.911481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-log-httpd\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.911592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-config-data\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:55 crc kubenswrapper[4769]: I1121 12:25:55.911649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-scripts\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-log-httpd\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-config-data\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-scripts\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c4s7j\" (UniqueName: \"kubernetes.io/projected/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-kube-api-access-c4s7j\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.014889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-run-httpd\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.015652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-log-httpd\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.015773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-run-httpd\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.020885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.021489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.031092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-scripts\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.033831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-config-data\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.036002 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4s7j\" (UniqueName: \"kubernetes.io/projected/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-kube-api-access-c4s7j\") pod \"ceilometer-0\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.122958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.126651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.218391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-combined-ca-bundle\") pod \"3c096c83-a4ea-4dee-8821-0381ced22974\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.218506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-config\") pod \"3c096c83-a4ea-4dee-8821-0381ced22974\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.218588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg7bp\" (UniqueName: \"kubernetes.io/projected/3c096c83-a4ea-4dee-8821-0381ced22974-kube-api-access-xg7bp\") pod \"3c096c83-a4ea-4dee-8821-0381ced22974\" (UID: \"3c096c83-a4ea-4dee-8821-0381ced22974\") " Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.234742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c096c83-a4ea-4dee-8821-0381ced22974-kube-api-access-xg7bp" (OuterVolumeSpecName: "kube-api-access-xg7bp") pod "3c096c83-a4ea-4dee-8821-0381ced22974" (UID: "3c096c83-a4ea-4dee-8821-0381ced22974"). InnerVolumeSpecName "kube-api-access-xg7bp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.264426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-config" (OuterVolumeSpecName: "config") pod "3c096c83-a4ea-4dee-8821-0381ced22974" (UID: "3c096c83-a4ea-4dee-8821-0381ced22974"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.264628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c096c83-a4ea-4dee-8821-0381ced22974" (UID: "3c096c83-a4ea-4dee-8821-0381ced22974"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.323296 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xg7bp\" (UniqueName: \"kubernetes.io/projected/3c096c83-a4ea-4dee-8821-0381ced22974-kube-api-access-xg7bp\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.323353 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.323368 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c096c83-a4ea-4dee-8821-0381ced22974-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.681062 4769 scope.go:117] "RemoveContainer" containerID="00339e29effc02ef1f6437f487b25807a1ebf8db6f9d3d81dc49ffc945247daf" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.700863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" event={"ID":"3c096c83-a4ea-4dee-8821-0381ced22974","Type":"ContainerDied","Data":"80d41982771ce0f29a246f35a0fed9023228acc66e858c9bf921971f9f137899"} Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.700921 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80d41982771ce0f29a246f35a0fed9023228acc66e858c9bf921971f9f137899" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.700952 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-7s4wh" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.709412 4769 scope.go:117] "RemoveContainer" containerID="d2a154c53c2a28fdc925dca88900998e9e3cbaa7deb083745307d346be91a668" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.743993 4769 scope.go:117] "RemoveContainer" containerID="5d7d79d4555b83c1f636ac60fe24dc4352c3ab679cdf54dc4356f55e2624a1b0" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.782625 4769 scope.go:117] "RemoveContainer" containerID="f125fe387f26e2346ffd033546dd0762f62f9638f26e967cb48e632be53c51b4" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.786025 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.828922 4769 scope.go:117] "RemoveContainer" containerID="e51bdf5e4580a711d7c70afb7fd10e1bdf8344e344c5a7a77a65232883d6b35a" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.886351 4769 scope.go:117] "RemoveContainer" containerID="97d8361eb9cf5994d3ff2a2661bc009a002766dc8c466b5648f9cd5c54ccf088" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.921274 4769 scope.go:117] "RemoveContainer" containerID="4582c56726a1a1fb28d010e1ba4770b3c6d68ccdaffb117e7ed2f36e0894f0f6" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.947488 4769 scope.go:117] "RemoveContainer" containerID="6e0e06803a8effabf9d9a369c8c4ee8c17297b3f91dfe329baf45669eb0960ae" Nov 21 12:25:56 crc kubenswrapper[4769]: I1121 12:25:56.978361 4769 scope.go:117] "RemoveContainer" containerID="81d493830474fa9ad25a97867794fbb2adc31b416d59455b4760c2202e02e4f8" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:56.999359 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-9c55545b9-lsjgw"] Nov 21 12:25:57 crc kubenswrapper[4769]: E1121 12:25:57.007415 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c096c83-a4ea-4dee-8821-0381ced22974" containerName="neutron-db-sync" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.007454 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c096c83-a4ea-4dee-8821-0381ced22974" containerName="neutron-db-sync" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.007722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c096c83-a4ea-4dee-8821-0381ced22974" containerName="neutron-db-sync" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.012246 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.021537 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-rqx48" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.022792 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.023181 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.023376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.037863 4769 scope.go:117] "RemoveContainer" containerID="2dbf43d77946605400af5b7ce3c06180b86d0d63354eed52a59eaa13bb0e66e2" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.062262 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9c55545b9-lsjgw"] Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.118334 4769 scope.go:117] "RemoveContainer" containerID="21824c43187f9dfb26d16e8013467f9af3e2180912cb19ba8226b3a99a986a31" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.142304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-ovndb-tls-certs\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.142422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxpgp\" (UniqueName: \"kubernetes.io/projected/5311a32c-2827-4767-8c72-751ad4964935-kube-api-access-xxpgp\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.142464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-combined-ca-bundle\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.142568 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-config\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.142628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-httpd-config\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.148883 4769 scope.go:117] "RemoveContainer" containerID="069e5b8cd8670a4dd808e46d27dbb2a38a528a36a6ea1bfef5657e6a58b6911a" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.195731 4769 scope.go:117] "RemoveContainer" containerID="08cd50ee4778bd7560c34abd7843c3a7cdbe4b8a4c929d1db3a500bd5eab8a7f" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.230441 4769 scope.go:117] "RemoveContainer" containerID="7765a6151f9fc378aafe3b4aef9e2d7ff862638259a19c63936ec71138569cd6" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.244951 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-config\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.245081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-httpd-config\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.245161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-ovndb-tls-certs\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.245268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xxpgp\" (UniqueName: \"kubernetes.io/projected/5311a32c-2827-4767-8c72-751ad4964935-kube-api-access-xxpgp\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.245304 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-combined-ca-bundle\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.253010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-combined-ca-bundle\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.253204 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-config\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.253914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-httpd-config\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.257074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-ovndb-tls-certs\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.269252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxpgp\" (UniqueName: \"kubernetes.io/projected/5311a32c-2827-4767-8c72-751ad4964935-kube-api-access-xxpgp\") pod \"neutron-9c55545b9-lsjgw\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.297609 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70060020-1f46-4ae5-82d7-9748609795bd" path="/var/lib/kubelet/pods/70060020-1f46-4ae5-82d7-9748609795bd/volumes" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.405052 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:57 crc kubenswrapper[4769]: I1121 12:25:57.730791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerStarted","Data":"f6f5bb92eba660d552b5444e40aba3d2c2d81ab17472ecd31a2fc2706c227878"} Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.025200 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-9c55545b9-lsjgw"] Nov 21 12:25:58 crc kubenswrapper[4769]: W1121 12:25:58.029317 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5311a32c_2827_4767_8c72_751ad4964935.slice/crio-1e82424ec202d9d6ee3c7fa6fc26a0bf2e60271fa500fab6fd54751050258efd WatchSource:0}: Error finding container 1e82424ec202d9d6ee3c7fa6fc26a0bf2e60271fa500fab6fd54751050258efd: Status 404 returned error can't find the container with id 1e82424ec202d9d6ee3c7fa6fc26a0bf2e60271fa500fab6fd54751050258efd Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.761787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerStarted","Data":"17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807"} Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.762177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerStarted","Data":"c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218"} Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.764764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" event={"ID":"5311a32c-2827-4767-8c72-751ad4964935","Type":"ContainerStarted","Data":"300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c"} Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.764884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" event={"ID":"5311a32c-2827-4767-8c72-751ad4964935","Type":"ContainerStarted","Data":"693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2"} Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.764986 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.765075 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" event={"ID":"5311a32c-2827-4767-8c72-751ad4964935","Type":"ContainerStarted","Data":"1e82424ec202d9d6ee3c7fa6fc26a0bf2e60271fa500fab6fd54751050258efd"} Nov 21 12:25:58 crc kubenswrapper[4769]: I1121 12:25:58.800993 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" podStartSLOduration=2.800972811 podStartE2EDuration="2.800972811s" podCreationTimestamp="2025-11-21 12:25:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:25:58.790999883 +0000 UTC m=+2117.491661701" watchObservedRunningTime="2025-11-21 12:25:58.800972811 +0000 UTC m=+2117.501634629" Nov 21 12:25:59 crc kubenswrapper[4769]: I1121 12:25:59.780057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerStarted","Data":"45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd"} Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.101220 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.116473 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-687b9949b6-8nd9m"] Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.117995 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.125304 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.133528 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-687b9949b6-8nd9m"] Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.134323 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.207972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-internal-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.208029 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6jw\" (UniqueName: \"kubernetes.io/projected/2e07dc8f-0539-4778-9191-6d6909c373c1-kube-api-access-5n6jw\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.208067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-combined-ca-bundle\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.208103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-httpd-config\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.208126 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-ovndb-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.208175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-config\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.208240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-public-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.309973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-httpd-config\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.310631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-ovndb-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.310786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-config\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.310963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-public-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.311102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-internal-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.311176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6jw\" (UniqueName: \"kubernetes.io/projected/2e07dc8f-0539-4778-9191-6d6909c373c1-kube-api-access-5n6jw\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.311301 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-combined-ca-bundle\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.317111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-ovndb-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.316391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-internal-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.319344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-public-tls-certs\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.319446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-httpd-config\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.320251 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-config\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.324536 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-combined-ca-bundle\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.340688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6jw\" (UniqueName: \"kubernetes.io/projected/2e07dc8f-0539-4778-9191-6d6909c373c1-kube-api-access-5n6jw\") pod \"neutron-687b9949b6-8nd9m\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.436320 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:00 crc kubenswrapper[4769]: I1121 12:26:00.918318 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-687b9949b6-8nd9m"] Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.807708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" event={"ID":"2e07dc8f-0539-4778-9191-6d6909c373c1","Type":"ContainerStarted","Data":"61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1"} Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.808017 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.808028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" event={"ID":"2e07dc8f-0539-4778-9191-6d6909c373c1","Type":"ContainerStarted","Data":"209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc"} Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.808038 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" event={"ID":"2e07dc8f-0539-4778-9191-6d6909c373c1","Type":"ContainerStarted","Data":"1465321d1f5775fa968f215241dd13562d7795406b0d140e142274adad4bd468"} Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.811002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerStarted","Data":"971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12"} Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.811162 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-central-agent" containerID="cri-o://c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218" gracePeriod=30 Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.811207 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="proxy-httpd" containerID="cri-o://971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12" gracePeriod=30 Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.811209 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="sg-core" containerID="cri-o://45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd" gracePeriod=30 Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.811174 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.811294 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-notification-agent" containerID="cri-o://17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807" gracePeriod=30 Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.842802 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" podStartSLOduration=1.842782444 podStartE2EDuration="1.842782444s" podCreationTimestamp="2025-11-21 12:26:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:01.835101618 +0000 UTC m=+2120.535763426" watchObservedRunningTime="2025-11-21 12:26:01.842782444 +0000 UTC m=+2120.543444262" Nov 21 12:26:01 crc kubenswrapper[4769]: I1121 12:26:01.876172 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.784895293 podStartE2EDuration="6.87614371s" podCreationTimestamp="2025-11-21 12:25:55 +0000 UTC" firstStartedPulling="2025-11-21 12:25:56.811629995 +0000 UTC m=+2115.512291813" lastFinishedPulling="2025-11-21 12:26:00.902878412 +0000 UTC m=+2119.603540230" observedRunningTime="2025-11-21 12:26:01.864626091 +0000 UTC m=+2120.565287919" watchObservedRunningTime="2025-11-21 12:26:01.87614371 +0000 UTC m=+2120.576805528" Nov 21 12:26:02 crc kubenswrapper[4769]: I1121 12:26:02.823115 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerID="971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12" exitCode=0 Nov 21 12:26:02 crc kubenswrapper[4769]: I1121 12:26:02.823456 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerID="45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd" exitCode=2 Nov 21 12:26:02 crc kubenswrapper[4769]: I1121 12:26:02.823469 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerID="17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807" exitCode=0 Nov 21 12:26:02 crc kubenswrapper[4769]: I1121 12:26:02.823331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerDied","Data":"971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12"} Nov 21 12:26:02 crc kubenswrapper[4769]: I1121 12:26:02.823799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerDied","Data":"45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd"} Nov 21 12:26:02 crc kubenswrapper[4769]: I1121 12:26:02.823813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerDied","Data":"17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807"} Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.305348 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-combined-ca-bundle\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-sg-core-conf-yaml\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-log-httpd\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-run-httpd\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4s7j\" (UniqueName: \"kubernetes.io/projected/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-kube-api-access-c4s7j\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-scripts\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.409532 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-config-data\") pod \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\" (UID: \"5c7de788-7826-4b7b-bb5d-3d418e25cf5d\") " Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.410605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.410925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.427476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-kube-api-access-c4s7j" (OuterVolumeSpecName: "kube-api-access-c4s7j") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "kube-api-access-c4s7j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.433065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-scripts" (OuterVolumeSpecName: "scripts") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.447268 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.494180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.512298 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.512338 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.512351 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c4s7j\" (UniqueName: \"kubernetes.io/projected/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-kube-api-access-c4s7j\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.512363 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.512377 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.512390 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.518265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-config-data" (OuterVolumeSpecName: "config-data") pod "5c7de788-7826-4b7b-bb5d-3d418e25cf5d" (UID: "5c7de788-7826-4b7b-bb5d-3d418e25cf5d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.614246 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c7de788-7826-4b7b-bb5d-3d418e25cf5d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.866282 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerID="c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218" exitCode=0 Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.866328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerDied","Data":"c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218"} Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.866342 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.866358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5c7de788-7826-4b7b-bb5d-3d418e25cf5d","Type":"ContainerDied","Data":"f6f5bb92eba660d552b5444e40aba3d2c2d81ab17472ecd31a2fc2706c227878"} Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.866374 4769 scope.go:117] "RemoveContainer" containerID="971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.889859 4769 scope.go:117] "RemoveContainer" containerID="45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.917375 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.918029 4769 scope.go:117] "RemoveContainer" containerID="17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.932481 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.945592 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:05 crc kubenswrapper[4769]: E1121 12:26:05.946271 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-notification-agent" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.946358 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-notification-agent" Nov 21 12:26:05 crc kubenswrapper[4769]: E1121 12:26:05.946432 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="sg-core" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.946481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="sg-core" Nov 21 12:26:05 crc kubenswrapper[4769]: E1121 12:26:05.946578 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="proxy-httpd" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.946641 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="proxy-httpd" Nov 21 12:26:05 crc kubenswrapper[4769]: E1121 12:26:05.946714 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-central-agent" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.946782 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-central-agent" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.947043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="proxy-httpd" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.947147 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-central-agent" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.947248 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="sg-core" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.947330 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" containerName="ceilometer-notification-agent" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.949366 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.963408 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.964896 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:26:05 crc kubenswrapper[4769]: I1121 12:26:05.967171 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.005152 4769 scope.go:117] "RemoveContainer" containerID="c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.026035 4769 scope.go:117] "RemoveContainer" containerID="971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.027617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-config-data\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.027784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-scripts\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.027871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-log-httpd\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.027921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.027993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.028046 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-run-httpd\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.028183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h444t\" (UniqueName: \"kubernetes.io/projected/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-kube-api-access-h444t\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: E1121 12:26:06.028958 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12\": container with ID starting with 971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12 not found: ID does not exist" containerID="971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.029033 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12"} err="failed to get container status \"971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12\": rpc error: code = NotFound desc = could not find container \"971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12\": container with ID starting with 971ac6c6e3348187181a20218b0104e99e2d7fa64315d852d3b5a3b8308b4e12 not found: ID does not exist" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.029074 4769 scope.go:117] "RemoveContainer" containerID="45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd" Nov 21 12:26:06 crc kubenswrapper[4769]: E1121 12:26:06.029410 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd\": container with ID starting with 45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd not found: ID does not exist" containerID="45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.029447 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd"} err="failed to get container status \"45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd\": rpc error: code = NotFound desc = could not find container \"45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd\": container with ID starting with 45fd17e7fb2d514518155208227b75c92ddc70c18a78d8306656bfa1b26ae5fd not found: ID does not exist" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.029473 4769 scope.go:117] "RemoveContainer" containerID="17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807" Nov 21 12:26:06 crc kubenswrapper[4769]: E1121 12:26:06.034411 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807\": container with ID starting with 17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807 not found: ID does not exist" containerID="17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.034469 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807"} err="failed to get container status \"17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807\": rpc error: code = NotFound desc = could not find container \"17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807\": container with ID starting with 17cefb27ec858015994997b58d596b64df49d0b1a4c34c8d9ac1a702750c4807 not found: ID does not exist" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.034509 4769 scope.go:117] "RemoveContainer" containerID="c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218" Nov 21 12:26:06 crc kubenswrapper[4769]: E1121 12:26:06.034970 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218\": container with ID starting with c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218 not found: ID does not exist" containerID="c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.035021 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218"} err="failed to get container status \"c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218\": rpc error: code = NotFound desc = could not find container \"c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218\": container with ID starting with c4b6d929b4436f98804dde8a46576de6d72777931cbd2a2a60adb210a8fcb218 not found: ID does not exist" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.129799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.129934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.129976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-run-httpd\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.129993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h444t\" (UniqueName: \"kubernetes.io/projected/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-kube-api-access-h444t\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.130080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-config-data\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.130135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-scripts\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.130208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-log-httpd\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.131059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-log-httpd\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.131079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-run-httpd\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.136237 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-scripts\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.143064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.143965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.146014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-config-data\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.151506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h444t\" (UniqueName: \"kubernetes.io/projected/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-kube-api-access-h444t\") pod \"ceilometer-0\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.305680 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.771469 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:06 crc kubenswrapper[4769]: I1121 12:26:06.898958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerStarted","Data":"4a55b95168ed01ee43492e527d1848e01dfee0521906c78868ebf8f276ec532f"} Nov 21 12:26:07 crc kubenswrapper[4769]: I1121 12:26:07.294164 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7de788-7826-4b7b-bb5d-3d418e25cf5d" path="/var/lib/kubelet/pods/5c7de788-7826-4b7b-bb5d-3d418e25cf5d/volumes" Nov 21 12:26:07 crc kubenswrapper[4769]: I1121 12:26:07.913802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerStarted","Data":"64a7f33831d837acfb09fba1f3329d1e9741b539357e476e0db62effcde46655"} Nov 21 12:26:08 crc kubenswrapper[4769]: I1121 12:26:08.925087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerStarted","Data":"f187c36591c5d1b18be61b561a779e501efe23a39d4fad83ba73d65719394862"} Nov 21 12:26:08 crc kubenswrapper[4769]: I1121 12:26:08.925132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerStarted","Data":"5722c288f90477e4775121420de89fac4d02f9c1e7e926aa29fdeeada54a9aad"} Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.182425 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-d99b5"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.184151 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.199619 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-d99b5"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.207102 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxn9z\" (UniqueName: \"kubernetes.io/projected/773140a6-b580-4feb-a4bc-4271310e9569-kube-api-access-xxn9z\") pod \"nova-api-db-create-d99b5\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.207262 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/773140a6-b580-4feb-a4bc-4271310e9569-operator-scripts\") pod \"nova-api-db-create-d99b5\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.275061 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nnb6g"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.276609 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.287277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nnb6g"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.308662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/773140a6-b580-4feb-a4bc-4271310e9569-operator-scripts\") pod \"nova-api-db-create-d99b5\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.308716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14a8dafc-53b9-4c57-b534-76112365affc-operator-scripts\") pod \"nova-cell0-db-create-nnb6g\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.308914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xxn9z\" (UniqueName: \"kubernetes.io/projected/773140a6-b580-4feb-a4bc-4271310e9569-kube-api-access-xxn9z\") pod \"nova-api-db-create-d99b5\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.309015 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjgf\" (UniqueName: \"kubernetes.io/projected/14a8dafc-53b9-4c57-b534-76112365affc-kube-api-access-gdjgf\") pod \"nova-cell0-db-create-nnb6g\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.310645 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/773140a6-b580-4feb-a4bc-4271310e9569-operator-scripts\") pod \"nova-api-db-create-d99b5\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.330086 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxn9z\" (UniqueName: \"kubernetes.io/projected/773140a6-b580-4feb-a4bc-4271310e9569-kube-api-access-xxn9z\") pod \"nova-api-db-create-d99b5\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.384675 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7dvxm"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.386215 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.393845 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.395072 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.397893 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.406387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7dvxm"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.413434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tj42\" (UniqueName: \"kubernetes.io/projected/160e64f6-dd5c-40b6-ba26-9e93657d96c9-kube-api-access-7tj42\") pod \"nova-api-ca3a-account-create-8f2r7\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.413495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjgf\" (UniqueName: \"kubernetes.io/projected/14a8dafc-53b9-4c57-b534-76112365affc-kube-api-access-gdjgf\") pod \"nova-cell0-db-create-nnb6g\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.413544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-567h4\" (UniqueName: \"kubernetes.io/projected/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-kube-api-access-567h4\") pod \"nova-cell1-db-create-7dvxm\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.413600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/160e64f6-dd5c-40b6-ba26-9e93657d96c9-operator-scripts\") pod \"nova-api-ca3a-account-create-8f2r7\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.413645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14a8dafc-53b9-4c57-b534-76112365affc-operator-scripts\") pod \"nova-cell0-db-create-nnb6g\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.413672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-operator-scripts\") pod \"nova-cell1-db-create-7dvxm\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.414721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14a8dafc-53b9-4c57-b534-76112365affc-operator-scripts\") pod \"nova-cell0-db-create-nnb6g\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.439444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjgf\" (UniqueName: \"kubernetes.io/projected/14a8dafc-53b9-4c57-b534-76112365affc-kube-api-access-gdjgf\") pod \"nova-cell0-db-create-nnb6g\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.451783 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.502557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.512630 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.514264 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.515316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7tj42\" (UniqueName: \"kubernetes.io/projected/160e64f6-dd5c-40b6-ba26-9e93657d96c9-kube-api-access-7tj42\") pod \"nova-api-ca3a-account-create-8f2r7\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.515453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-567h4\" (UniqueName: \"kubernetes.io/projected/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-kube-api-access-567h4\") pod \"nova-cell1-db-create-7dvxm\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.515538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/160e64f6-dd5c-40b6-ba26-9e93657d96c9-operator-scripts\") pod \"nova-api-ca3a-account-create-8f2r7\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.515651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-operator-scripts\") pod \"nova-cell1-db-create-7dvxm\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.516805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-operator-scripts\") pod \"nova-cell1-db-create-7dvxm\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.516819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/160e64f6-dd5c-40b6-ba26-9e93657d96c9-operator-scripts\") pod \"nova-api-ca3a-account-create-8f2r7\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.518593 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.536896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-567h4\" (UniqueName: \"kubernetes.io/projected/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-kube-api-access-567h4\") pod \"nova-cell1-db-create-7dvxm\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.538023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.544657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tj42\" (UniqueName: \"kubernetes.io/projected/160e64f6-dd5c-40b6-ba26-9e93657d96c9-kube-api-access-7tj42\") pod \"nova-api-ca3a-account-create-8f2r7\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.593903 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.618624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvr2w\" (UniqueName: \"kubernetes.io/projected/d256f115-9c51-46ce-ab7e-8267b1b3dc54-kube-api-access-rvr2w\") pod \"nova-cell0-8833-account-create-fltzv\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.619139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d256f115-9c51-46ce-ab7e-8267b1b3dc54-operator-scripts\") pod \"nova-cell0-8833-account-create-fltzv\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.701575 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.712041 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.717955 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.720505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d256f115-9c51-46ce-ab7e-8267b1b3dc54-operator-scripts\") pod \"nova-cell0-8833-account-create-fltzv\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.720593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rvr2w\" (UniqueName: \"kubernetes.io/projected/d256f115-9c51-46ce-ab7e-8267b1b3dc54-kube-api-access-rvr2w\") pod \"nova-cell0-8833-account-create-fltzv\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.721632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d256f115-9c51-46ce-ab7e-8267b1b3dc54-operator-scripts\") pod \"nova-cell0-8833-account-create-fltzv\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.722674 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.735657 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.756293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvr2w\" (UniqueName: \"kubernetes.io/projected/d256f115-9c51-46ce-ab7e-8267b1b3dc54-kube-api-access-rvr2w\") pod \"nova-cell0-8833-account-create-fltzv\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.766961 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv"] Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.822533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zhjk\" (UniqueName: \"kubernetes.io/projected/41ec33a6-7893-47f0-b59b-aa4b3450b479-kube-api-access-8zhjk\") pod \"nova-cell1-51fa-account-create-4tlfv\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.822728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41ec33a6-7893-47f0-b59b-aa4b3450b479-operator-scripts\") pod \"nova-cell1-51fa-account-create-4tlfv\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.840628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.925661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41ec33a6-7893-47f0-b59b-aa4b3450b479-operator-scripts\") pod \"nova-cell1-51fa-account-create-4tlfv\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.925774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8zhjk\" (UniqueName: \"kubernetes.io/projected/41ec33a6-7893-47f0-b59b-aa4b3450b479-kube-api-access-8zhjk\") pod \"nova-cell1-51fa-account-create-4tlfv\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.930473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41ec33a6-7893-47f0-b59b-aa4b3450b479-operator-scripts\") pod \"nova-cell1-51fa-account-create-4tlfv\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:10 crc kubenswrapper[4769]: I1121 12:26:10.974704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zhjk\" (UniqueName: \"kubernetes.io/projected/41ec33a6-7893-47f0-b59b-aa4b3450b479-kube-api-access-8zhjk\") pod \"nova-cell1-51fa-account-create-4tlfv\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.015578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerStarted","Data":"c45736ad7bc29537d87375aa6d8ced3161f2a2756066b921146adf17bfb75cf7"} Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.016063 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.038286 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.9603822539999998 podStartE2EDuration="6.038262955s" podCreationTimestamp="2025-11-21 12:26:05 +0000 UTC" firstStartedPulling="2025-11-21 12:26:06.779143989 +0000 UTC m=+2125.479805807" lastFinishedPulling="2025-11-21 12:26:09.85702469 +0000 UTC m=+2128.557686508" observedRunningTime="2025-11-21 12:26:11.035578763 +0000 UTC m=+2129.736240591" watchObservedRunningTime="2025-11-21 12:26:11.038262955 +0000 UTC m=+2129.738924773" Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.052438 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:11 crc kubenswrapper[4769]: W1121 12:26:11.319709 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod773140a6_b580_4feb_a4bc_4271310e9569.slice/crio-eec59d56112c8c20442f5e73ee9240d0d70cbbcdadf1037277bb3e60b93f3c5c WatchSource:0}: Error finding container eec59d56112c8c20442f5e73ee9240d0d70cbbcdadf1037277bb3e60b93f3c5c: Status 404 returned error can't find the container with id eec59d56112c8c20442f5e73ee9240d0d70cbbcdadf1037277bb3e60b93f3c5c Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.325508 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.325563 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.331568 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-d99b5"] Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.331617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.332449 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"853819d0337afdd74f9dccd7824d5874788ad9e7c096f1f20047db41f5e665d1"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.332517 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://853819d0337afdd74f9dccd7824d5874788ad9e7c096f1f20047db41f5e665d1" gracePeriod=600 Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.546813 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nnb6g"] Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.566725 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7dvxm"] Nov 21 12:26:11 crc kubenswrapper[4769]: W1121 12:26:11.576426 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7662e8c1_8dc6_4ba5_988e_e8d10c7473c8.slice/crio-295e4b93b570785da226955356efa18eb36f70c70eeaeed0f2bfb18c6d069786 WatchSource:0}: Error finding container 295e4b93b570785da226955356efa18eb36f70c70eeaeed0f2bfb18c6d069786: Status 404 returned error can't find the container with id 295e4b93b570785da226955356efa18eb36f70c70eeaeed0f2bfb18c6d069786 Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.645510 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.645858 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-log" containerID="cri-o://df85d13b0b2281a7babde7720b18ef42aff40e198c7d45f1b17210569f17a41f" gracePeriod=30 Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.646390 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-httpd" containerID="cri-o://59ea4738308fbf8588dd14b0d9e483d1652e23768b62c6f9930522b759891e08" gracePeriod=30 Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.763075 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7"] Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.901493 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv"] Nov 21 12:26:11 crc kubenswrapper[4769]: I1121 12:26:11.940075 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv"] Nov 21 12:26:11 crc kubenswrapper[4769]: W1121 12:26:11.959926 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41ec33a6_7893_47f0_b59b_aa4b3450b479.slice/crio-72af9043dec377d5cca8420737764bc43d1c494ab64c11d5a22519aefaebc188 WatchSource:0}: Error finding container 72af9043dec377d5cca8420737764bc43d1c494ab64c11d5a22519aefaebc188: Status 404 returned error can't find the container with id 72af9043dec377d5cca8420737764bc43d1c494ab64c11d5a22519aefaebc188 Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.053983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" event={"ID":"14a8dafc-53b9-4c57-b534-76112365affc","Type":"ContainerStarted","Data":"cdea5e7fb66fbe7d2d9e9d32c7026d6a96e1274c9c50595695cb6632fab63513"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.054557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" event={"ID":"14a8dafc-53b9-4c57-b534-76112365affc","Type":"ContainerStarted","Data":"0c2db815aecbe9dd9e6de77f08527e6eb845c904bb5e6614c452cfff451519f5"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.081135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" event={"ID":"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8","Type":"ContainerStarted","Data":"5d91c1e16381ffb34da5a2525837d45ec1e34fbcc79ba3fa7d8febdcdcad9754"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.081230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" event={"ID":"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8","Type":"ContainerStarted","Data":"295e4b93b570785da226955356efa18eb36f70c70eeaeed0f2bfb18c6d069786"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.082171 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" podStartSLOduration=2.082145909 podStartE2EDuration="2.082145909s" podCreationTimestamp="2025-11-21 12:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:12.080802373 +0000 UTC m=+2130.781464211" watchObservedRunningTime="2025-11-21 12:26:12.082145909 +0000 UTC m=+2130.782807727" Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.107519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" event={"ID":"d256f115-9c51-46ce-ab7e-8267b1b3dc54","Type":"ContainerStarted","Data":"b5961593b0012b76c28f0fd8e16e14442bed5518ffaa26a1fa433cfedbc208e7"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.107851 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" podStartSLOduration=2.107831159 podStartE2EDuration="2.107831159s" podCreationTimestamp="2025-11-21 12:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:12.104961602 +0000 UTC m=+2130.805623450" watchObservedRunningTime="2025-11-21 12:26:12.107831159 +0000 UTC m=+2130.808492977" Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.108916 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" event={"ID":"41ec33a6-7893-47f0-b59b-aa4b3450b479","Type":"ContainerStarted","Data":"72af9043dec377d5cca8420737764bc43d1c494ab64c11d5a22519aefaebc188"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.119321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" event={"ID":"773140a6-b580-4feb-a4bc-4271310e9569","Type":"ContainerStarted","Data":"3fc3c30f17375383094a090bf25f85d4eb6c27ab87d17544d6489fe14be3249b"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.119360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" event={"ID":"773140a6-b580-4feb-a4bc-4271310e9569","Type":"ContainerStarted","Data":"eec59d56112c8c20442f5e73ee9240d0d70cbbcdadf1037277bb3e60b93f3c5c"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.140138 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="853819d0337afdd74f9dccd7824d5874788ad9e7c096f1f20047db41f5e665d1" exitCode=0 Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.140309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"853819d0337afdd74f9dccd7824d5874788ad9e7c096f1f20047db41f5e665d1"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.140354 4769 scope.go:117] "RemoveContainer" containerID="6a25c936989cb6e5e93d1c1999e7c88d19c5b9176cf2940ddf943fa41a18af00" Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.140480 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" podStartSLOduration=2.140432395 podStartE2EDuration="2.140432395s" podCreationTimestamp="2025-11-21 12:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:12.134925827 +0000 UTC m=+2130.835587645" watchObservedRunningTime="2025-11-21 12:26:12.140432395 +0000 UTC m=+2130.841094233" Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.178053 4769 generic.go:334] "Generic (PLEG): container finished" podID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerID="df85d13b0b2281a7babde7720b18ef42aff40e198c7d45f1b17210569f17a41f" exitCode=143 Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.178327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"16d692e8-d465-46e0-ae83-48296ff68e1f","Type":"ContainerDied","Data":"df85d13b0b2281a7babde7720b18ef42aff40e198c7d45f1b17210569f17a41f"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.185540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" event={"ID":"160e64f6-dd5c-40b6-ba26-9e93657d96c9","Type":"ContainerStarted","Data":"637f26b4b28226595c8ef32fda05fc4345cc8c723b461c84664e5209a7a7469b"} Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.601413 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.818886 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.819140 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-log" containerID="cri-o://216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4" gracePeriod=30 Nov 21 12:26:12 crc kubenswrapper[4769]: I1121 12:26:12.819617 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-httpd" containerID="cri-o://49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2" gracePeriod=30 Nov 21 12:26:12 crc kubenswrapper[4769]: E1121 12:26:12.886071 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod160e64f6_dd5c_40b6_ba26_9e93657d96c9.slice/crio-conmon-f52d9ee5fc92fc3c18ba03bd4c480a67da3a343ae27a48f195329d5d120351f6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod109a61aa_34a6_4914_8f17_8b0abe1cb2b3.slice/crio-216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.198778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.201345 4769 generic.go:334] "Generic (PLEG): container finished" podID="160e64f6-dd5c-40b6-ba26-9e93657d96c9" containerID="f52d9ee5fc92fc3c18ba03bd4c480a67da3a343ae27a48f195329d5d120351f6" exitCode=0 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.201454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" event={"ID":"160e64f6-dd5c-40b6-ba26-9e93657d96c9","Type":"ContainerDied","Data":"f52d9ee5fc92fc3c18ba03bd4c480a67da3a343ae27a48f195329d5d120351f6"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.205075 4769 generic.go:334] "Generic (PLEG): container finished" podID="14a8dafc-53b9-4c57-b534-76112365affc" containerID="cdea5e7fb66fbe7d2d9e9d32c7026d6a96e1274c9c50595695cb6632fab63513" exitCode=0 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.205289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" event={"ID":"14a8dafc-53b9-4c57-b534-76112365affc","Type":"ContainerDied","Data":"cdea5e7fb66fbe7d2d9e9d32c7026d6a96e1274c9c50595695cb6632fab63513"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.207747 4769 generic.go:334] "Generic (PLEG): container finished" podID="7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" containerID="5d91c1e16381ffb34da5a2525837d45ec1e34fbcc79ba3fa7d8febdcdcad9754" exitCode=0 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.207820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" event={"ID":"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8","Type":"ContainerDied","Data":"5d91c1e16381ffb34da5a2525837d45ec1e34fbcc79ba3fa7d8febdcdcad9754"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.211066 4769 generic.go:334] "Generic (PLEG): container finished" podID="d256f115-9c51-46ce-ab7e-8267b1b3dc54" containerID="1827b1f784e79a722086683fbfd7211d39f2dc36023ee7cf7fa62909636ac29a" exitCode=0 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.211160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" event={"ID":"d256f115-9c51-46ce-ab7e-8267b1b3dc54","Type":"ContainerDied","Data":"1827b1f784e79a722086683fbfd7211d39f2dc36023ee7cf7fa62909636ac29a"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.212810 4769 generic.go:334] "Generic (PLEG): container finished" podID="41ec33a6-7893-47f0-b59b-aa4b3450b479" containerID="bc44066b35ce9ffb7e858f3b0ecae5ca57a4f914a2d9b10a66f2d213bc8e0348" exitCode=0 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.212937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" event={"ID":"41ec33a6-7893-47f0-b59b-aa4b3450b479","Type":"ContainerDied","Data":"bc44066b35ce9ffb7e858f3b0ecae5ca57a4f914a2d9b10a66f2d213bc8e0348"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.214451 4769 generic.go:334] "Generic (PLEG): container finished" podID="773140a6-b580-4feb-a4bc-4271310e9569" containerID="3fc3c30f17375383094a090bf25f85d4eb6c27ab87d17544d6489fe14be3249b" exitCode=0 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.214515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" event={"ID":"773140a6-b580-4feb-a4bc-4271310e9569","Type":"ContainerDied","Data":"3fc3c30f17375383094a090bf25f85d4eb6c27ab87d17544d6489fe14be3249b"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.221597 4769 generic.go:334] "Generic (PLEG): container finished" podID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerID="216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4" exitCode=143 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.221923 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-central-agent" containerID="cri-o://64a7f33831d837acfb09fba1f3329d1e9741b539357e476e0db62effcde46655" gracePeriod=30 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.222108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"109a61aa-34a6-4914-8f17-8b0abe1cb2b3","Type":"ContainerDied","Data":"216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4"} Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.222146 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="proxy-httpd" containerID="cri-o://c45736ad7bc29537d87375aa6d8ced3161f2a2756066b921146adf17bfb75cf7" gracePeriod=30 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.222267 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-notification-agent" containerID="cri-o://5722c288f90477e4775121420de89fac4d02f9c1e7e926aa29fdeeada54a9aad" gracePeriod=30 Nov 21 12:26:13 crc kubenswrapper[4769]: I1121 12:26:13.222169 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="sg-core" containerID="cri-o://f187c36591c5d1b18be61b561a779e501efe23a39d4fad83ba73d65719394862" gracePeriod=30 Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.235794 4769 generic.go:334] "Generic (PLEG): container finished" podID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerID="c45736ad7bc29537d87375aa6d8ced3161f2a2756066b921146adf17bfb75cf7" exitCode=0 Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.236200 4769 generic.go:334] "Generic (PLEG): container finished" podID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerID="f187c36591c5d1b18be61b561a779e501efe23a39d4fad83ba73d65719394862" exitCode=2 Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.236223 4769 generic.go:334] "Generic (PLEG): container finished" podID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerID="5722c288f90477e4775121420de89fac4d02f9c1e7e926aa29fdeeada54a9aad" exitCode=0 Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.235877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerDied","Data":"c45736ad7bc29537d87375aa6d8ced3161f2a2756066b921146adf17bfb75cf7"} Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.236365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerDied","Data":"f187c36591c5d1b18be61b561a779e501efe23a39d4fad83ba73d65719394862"} Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.236387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerDied","Data":"5722c288f90477e4775121420de89fac4d02f9c1e7e926aa29fdeeada54a9aad"} Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.750889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.850450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxn9z\" (UniqueName: \"kubernetes.io/projected/773140a6-b580-4feb-a4bc-4271310e9569-kube-api-access-xxn9z\") pod \"773140a6-b580-4feb-a4bc-4271310e9569\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.850626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/773140a6-b580-4feb-a4bc-4271310e9569-operator-scripts\") pod \"773140a6-b580-4feb-a4bc-4271310e9569\" (UID: \"773140a6-b580-4feb-a4bc-4271310e9569\") " Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.851581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773140a6-b580-4feb-a4bc-4271310e9569-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "773140a6-b580-4feb-a4bc-4271310e9569" (UID: "773140a6-b580-4feb-a4bc-4271310e9569"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.865032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773140a6-b580-4feb-a4bc-4271310e9569-kube-api-access-xxn9z" (OuterVolumeSpecName: "kube-api-access-xxn9z") pod "773140a6-b580-4feb-a4bc-4271310e9569" (UID: "773140a6-b580-4feb-a4bc-4271310e9569"). InnerVolumeSpecName "kube-api-access-xxn9z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.953513 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/773140a6-b580-4feb-a4bc-4271310e9569-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:14 crc kubenswrapper[4769]: I1121 12:26:14.953558 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xxn9z\" (UniqueName: \"kubernetes.io/projected/773140a6-b580-4feb-a4bc-4271310e9569-kube-api-access-xxn9z\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.043030 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.049132 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.066836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.074057 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.089387 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.156959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41ec33a6-7893-47f0-b59b-aa4b3450b479-operator-scripts\") pod \"41ec33a6-7893-47f0-b59b-aa4b3450b479\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.157352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14a8dafc-53b9-4c57-b534-76112365affc-operator-scripts\") pod \"14a8dafc-53b9-4c57-b534-76112365affc\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.157797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d256f115-9c51-46ce-ab7e-8267b1b3dc54-operator-scripts\") pod \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.157847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-567h4\" (UniqueName: \"kubernetes.io/projected/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-kube-api-access-567h4\") pod \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.158100 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a8dafc-53b9-4c57-b534-76112365affc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "14a8dafc-53b9-4c57-b534-76112365affc" (UID: "14a8dafc-53b9-4c57-b534-76112365affc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.159119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d256f115-9c51-46ce-ab7e-8267b1b3dc54-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d256f115-9c51-46ce-ab7e-8267b1b3dc54" (UID: "d256f115-9c51-46ce-ab7e-8267b1b3dc54"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.159783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41ec33a6-7893-47f0-b59b-aa4b3450b479-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "41ec33a6-7893-47f0-b59b-aa4b3450b479" (UID: "41ec33a6-7893-47f0-b59b-aa4b3450b479"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.160357 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tj42\" (UniqueName: \"kubernetes.io/projected/160e64f6-dd5c-40b6-ba26-9e93657d96c9-kube-api-access-7tj42\") pod \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.160436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvr2w\" (UniqueName: \"kubernetes.io/projected/d256f115-9c51-46ce-ab7e-8267b1b3dc54-kube-api-access-rvr2w\") pod \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\" (UID: \"d256f115-9c51-46ce-ab7e-8267b1b3dc54\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.160471 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/160e64f6-dd5c-40b6-ba26-9e93657d96c9-operator-scripts\") pod \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\" (UID: \"160e64f6-dd5c-40b6-ba26-9e93657d96c9\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.160514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-operator-scripts\") pod \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\" (UID: \"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.160668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdjgf\" (UniqueName: \"kubernetes.io/projected/14a8dafc-53b9-4c57-b534-76112365affc-kube-api-access-gdjgf\") pod \"14a8dafc-53b9-4c57-b534-76112365affc\" (UID: \"14a8dafc-53b9-4c57-b534-76112365affc\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.160706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zhjk\" (UniqueName: \"kubernetes.io/projected/41ec33a6-7893-47f0-b59b-aa4b3450b479-kube-api-access-8zhjk\") pod \"41ec33a6-7893-47f0-b59b-aa4b3450b479\" (UID: \"41ec33a6-7893-47f0-b59b-aa4b3450b479\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.161373 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41ec33a6-7893-47f0-b59b-aa4b3450b479-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.161395 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/14a8dafc-53b9-4c57-b534-76112365affc-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.161408 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d256f115-9c51-46ce-ab7e-8267b1b3dc54-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.163098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160e64f6-dd5c-40b6-ba26-9e93657d96c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "160e64f6-dd5c-40b6-ba26-9e93657d96c9" (UID: "160e64f6-dd5c-40b6-ba26-9e93657d96c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.164754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" (UID: "7662e8c1-8dc6-4ba5-988e-e8d10c7473c8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.177089 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-kube-api-access-567h4" (OuterVolumeSpecName: "kube-api-access-567h4") pod "7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" (UID: "7662e8c1-8dc6-4ba5-988e-e8d10c7473c8"). InnerVolumeSpecName "kube-api-access-567h4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.187841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d256f115-9c51-46ce-ab7e-8267b1b3dc54-kube-api-access-rvr2w" (OuterVolumeSpecName: "kube-api-access-rvr2w") pod "d256f115-9c51-46ce-ab7e-8267b1b3dc54" (UID: "d256f115-9c51-46ce-ab7e-8267b1b3dc54"). InnerVolumeSpecName "kube-api-access-rvr2w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.188625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160e64f6-dd5c-40b6-ba26-9e93657d96c9-kube-api-access-7tj42" (OuterVolumeSpecName: "kube-api-access-7tj42") pod "160e64f6-dd5c-40b6-ba26-9e93657d96c9" (UID: "160e64f6-dd5c-40b6-ba26-9e93657d96c9"). InnerVolumeSpecName "kube-api-access-7tj42". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.192876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ec33a6-7893-47f0-b59b-aa4b3450b479-kube-api-access-8zhjk" (OuterVolumeSpecName: "kube-api-access-8zhjk") pod "41ec33a6-7893-47f0-b59b-aa4b3450b479" (UID: "41ec33a6-7893-47f0-b59b-aa4b3450b479"). InnerVolumeSpecName "kube-api-access-8zhjk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.201550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a8dafc-53b9-4c57-b534-76112365affc-kube-api-access-gdjgf" (OuterVolumeSpecName: "kube-api-access-gdjgf") pod "14a8dafc-53b9-4c57-b534-76112365affc" (UID: "14a8dafc-53b9-4c57-b534-76112365affc"). InnerVolumeSpecName "kube-api-access-gdjgf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.246957 4769 generic.go:334] "Generic (PLEG): container finished" podID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerID="59ea4738308fbf8588dd14b0d9e483d1652e23768b62c6f9930522b759891e08" exitCode=0 Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.247026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"16d692e8-d465-46e0-ae83-48296ff68e1f","Type":"ContainerDied","Data":"59ea4738308fbf8588dd14b0d9e483d1652e23768b62c6f9930522b759891e08"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.248451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" event={"ID":"160e64f6-dd5c-40b6-ba26-9e93657d96c9","Type":"ContainerDied","Data":"637f26b4b28226595c8ef32fda05fc4345cc8c723b461c84664e5209a7a7469b"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.248477 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="637f26b4b28226595c8ef32fda05fc4345cc8c723b461c84664e5209a7a7469b" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.248557 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.253477 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.253884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-nnb6g" event={"ID":"14a8dafc-53b9-4c57-b534-76112365affc","Type":"ContainerDied","Data":"0c2db815aecbe9dd9e6de77f08527e6eb845c904bb5e6614c452cfff451519f5"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.253944 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c2db815aecbe9dd9e6de77f08527e6eb845c904bb5e6614c452cfff451519f5" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.260295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" event={"ID":"7662e8c1-8dc6-4ba5-988e-e8d10c7473c8","Type":"ContainerDied","Data":"295e4b93b570785da226955356efa18eb36f70c70eeaeed0f2bfb18c6d069786"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.260334 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="295e4b93b570785da226955356efa18eb36f70c70eeaeed0f2bfb18c6d069786" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.260354 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7dvxm" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.263703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" event={"ID":"d256f115-9c51-46ce-ab7e-8267b1b3dc54","Type":"ContainerDied","Data":"b5961593b0012b76c28f0fd8e16e14442bed5518ffaa26a1fa433cfedbc208e7"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.263747 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5961593b0012b76c28f0fd8e16e14442bed5518ffaa26a1fa433cfedbc208e7" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.263807 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.264267 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gdjgf\" (UniqueName: \"kubernetes.io/projected/14a8dafc-53b9-4c57-b534-76112365affc-kube-api-access-gdjgf\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.265375 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8zhjk\" (UniqueName: \"kubernetes.io/projected/41ec33a6-7893-47f0-b59b-aa4b3450b479-kube-api-access-8zhjk\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.265419 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-567h4\" (UniqueName: \"kubernetes.io/projected/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-kube-api-access-567h4\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.265430 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7tj42\" (UniqueName: \"kubernetes.io/projected/160e64f6-dd5c-40b6-ba26-9e93657d96c9-kube-api-access-7tj42\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.265440 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rvr2w\" (UniqueName: \"kubernetes.io/projected/d256f115-9c51-46ce-ab7e-8267b1b3dc54-kube-api-access-rvr2w\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.265463 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/160e64f6-dd5c-40b6-ba26-9e93657d96c9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.265474 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.267091 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" event={"ID":"41ec33a6-7893-47f0-b59b-aa4b3450b479","Type":"ContainerDied","Data":"72af9043dec377d5cca8420737764bc43d1c494ab64c11d5a22519aefaebc188"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.267128 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72af9043dec377d5cca8420737764bc43d1c494ab64c11d5a22519aefaebc188" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.267232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.279723 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.352974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-d99b5" event={"ID":"773140a6-b580-4feb-a4bc-4271310e9569","Type":"ContainerDied","Data":"eec59d56112c8c20442f5e73ee9240d0d70cbbcdadf1037277bb3e60b93f3c5c"} Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.353029 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec59d56112c8c20442f5e73ee9240d0d70cbbcdadf1037277bb3e60b93f3c5c" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.518007 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.581899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-public-tls-certs\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-config-data\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-combined-ca-bundle\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-httpd-run\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2p8b\" (UniqueName: \"kubernetes.io/projected/16d692e8-d465-46e0-ae83-48296ff68e1f-kube-api-access-p2p8b\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-logs\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.582448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-scripts\") pod \"16d692e8-d465-46e0-ae83-48296ff68e1f\" (UID: \"16d692e8-d465-46e0-ae83-48296ff68e1f\") " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.583155 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.584009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-logs" (OuterVolumeSpecName: "logs") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.590668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-scripts" (OuterVolumeSpecName: "scripts") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.591145 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "glance") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.596820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d692e8-d465-46e0-ae83-48296ff68e1f-kube-api-access-p2p8b" (OuterVolumeSpecName: "kube-api-access-p2p8b") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "kube-api-access-p2p8b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.639283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.656845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684562 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p2p8b\" (UniqueName: \"kubernetes.io/projected/16d692e8-d465-46e0-ae83-48296ff68e1f-kube-api-access-p2p8b\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684625 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684636 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684646 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684659 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684668 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.684676 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16d692e8-d465-46e0-ae83-48296ff68e1f-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.685098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-config-data" (OuterVolumeSpecName: "config-data") pod "16d692e8-d465-46e0-ae83-48296ff68e1f" (UID: "16d692e8-d465-46e0-ae83-48296ff68e1f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.717433 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.786997 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:15 crc kubenswrapper[4769]: I1121 12:26:15.787043 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16d692e8-d465-46e0-ae83-48296ff68e1f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.292737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"16d692e8-d465-46e0-ae83-48296ff68e1f","Type":"ContainerDied","Data":"4a53beb44fd6db111da294c83e65ffa225af99774209f094d8d3d8fab1b19712"} Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.292838 4769 scope.go:117] "RemoveContainer" containerID="59ea4738308fbf8588dd14b0d9e483d1652e23768b62c6f9930522b759891e08" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.292892 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.407745 4769 scope.go:117] "RemoveContainer" containerID="df85d13b0b2281a7babde7720b18ef42aff40e198c7d45f1b17210569f17a41f" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.422933 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.434952 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.465764 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466337 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d256f115-9c51-46ce-ab7e-8267b1b3dc54" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466358 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d256f115-9c51-46ce-ab7e-8267b1b3dc54" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466386 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="773140a6-b580-4feb-a4bc-4271310e9569" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466394 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="773140a6-b580-4feb-a4bc-4271310e9569" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466412 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-log" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466421 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-log" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466442 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-httpd" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466448 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-httpd" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466475 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466484 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="160e64f6-dd5c-40b6-ba26-9e93657d96c9" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="160e64f6-dd5c-40b6-ba26-9e93657d96c9" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466503 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41ec33a6-7893-47f0-b59b-aa4b3450b479" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466509 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ec33a6-7893-47f0-b59b-aa4b3450b479" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: E1121 12:26:16.466521 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14a8dafc-53b9-4c57-b534-76112365affc" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466529 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a8dafc-53b9-4c57-b534-76112365affc" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466713 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="773140a6-b580-4feb-a4bc-4271310e9569" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466726 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-log" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466739 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="41ec33a6-7893-47f0-b59b-aa4b3450b479" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466759 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="160e64f6-dd5c-40b6-ba26-9e93657d96c9" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466778 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" containerName="glance-httpd" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466787 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="14a8dafc-53b9-4c57-b534-76112365affc" containerName="mariadb-database-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.466800 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d256f115-9c51-46ce-ab7e-8267b1b3dc54" containerName="mariadb-account-create" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.467880 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.475006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.475221 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.491463 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.504664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nst9p\" (UniqueName: \"kubernetes.io/projected/24e9adde-0ce7-4cf1-8c98-21458a046a0e-kube-api-access-nst9p\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.504740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-config-data\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.504784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.505648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-scripts\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.505766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.505865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-logs\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.505960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.506074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.607655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-logs\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nst9p\" (UniqueName: \"kubernetes.io/projected/24e9adde-0ce7-4cf1-8c98-21458a046a0e-kube-api-access-nst9p\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-config-data\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608321 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-scripts\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.608918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-logs\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.609010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.609009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.609460 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.617629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.628344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.631444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nst9p\" (UniqueName: \"kubernetes.io/projected/24e9adde-0ce7-4cf1-8c98-21458a046a0e-kube-api-access-nst9p\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.644877 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-scripts\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.658026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-config-data\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.701719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"glance-default-external-api-0\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.802876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:16 crc kubenswrapper[4769]: I1121 12:26:16.883482 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.021061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-internal-tls-certs\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.021133 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-scripts\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.021158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-config-data\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.021874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-logs\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.021932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.021959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjbqm\" (UniqueName: \"kubernetes.io/projected/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-kube-api-access-cjbqm\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.022053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-httpd-run\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.022075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-combined-ca-bundle\") pod \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\" (UID: \"109a61aa-34a6-4914-8f17-8b0abe1cb2b3\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.022464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-logs" (OuterVolumeSpecName: "logs") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.026702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.029348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.033346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-kube-api-access-cjbqm" (OuterVolumeSpecName: "kube-api-access-cjbqm") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "kube-api-access-cjbqm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.034840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-scripts" (OuterVolumeSpecName: "scripts") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.060714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.096352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-config-data" (OuterVolumeSpecName: "config-data") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.096639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "109a61aa-34a6-4914-8f17-8b0abe1cb2b3" (UID: "109a61aa-34a6-4914-8f17-8b0abe1cb2b3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125156 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125273 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125298 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cjbqm\" (UniqueName: \"kubernetes.io/projected/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-kube-api-access-cjbqm\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125315 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125327 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125344 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125358 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.125372 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/109a61aa-34a6-4914-8f17-8b0abe1cb2b3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.177236 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.228122 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.293958 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16d692e8-d465-46e0-ae83-48296ff68e1f" path="/var/lib/kubelet/pods/16d692e8-d465-46e0-ae83-48296ff68e1f/volumes" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.315154 4769 generic.go:334] "Generic (PLEG): container finished" podID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerID="64a7f33831d837acfb09fba1f3329d1e9741b539357e476e0db62effcde46655" exitCode=0 Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.315253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerDied","Data":"64a7f33831d837acfb09fba1f3329d1e9741b539357e476e0db62effcde46655"} Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.324233 4769 generic.go:334] "Generic (PLEG): container finished" podID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerID="49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2" exitCode=0 Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.324345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"109a61aa-34a6-4914-8f17-8b0abe1cb2b3","Type":"ContainerDied","Data":"49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2"} Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.324376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"109a61aa-34a6-4914-8f17-8b0abe1cb2b3","Type":"ContainerDied","Data":"a9e72a1bced918fd4cf41e6de264e147975d8b3faa2eaf3c901f05345860fbf9"} Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.324398 4769 scope.go:117] "RemoveContainer" containerID="49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.324673 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.336980 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.358952 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.367736 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.369203 4769 scope.go:117] "RemoveContainer" containerID="216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.394538 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:26:17 crc kubenswrapper[4769]: E1121 12:26:17.395732 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-httpd" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.395781 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-httpd" Nov 21 12:26:17 crc kubenswrapper[4769]: E1121 12:26:17.395802 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-log" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.395809 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-log" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.396079 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-log" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.396114 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" containerName="glance-httpd" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.399763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.401817 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.403939 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.407346 4769 scope.go:117] "RemoveContainer" containerID="49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2" Nov 21 12:26:17 crc kubenswrapper[4769]: E1121 12:26:17.408089 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2\": container with ID starting with 49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2 not found: ID does not exist" containerID="49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.408156 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2"} err="failed to get container status \"49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2\": rpc error: code = NotFound desc = could not find container \"49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2\": container with ID starting with 49df2dd38d78aa527a7fa2ce47018f8fd43901ab6d922a20826a78fdb2bb32c2 not found: ID does not exist" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.408219 4769 scope.go:117] "RemoveContainer" containerID="216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4" Nov 21 12:26:17 crc kubenswrapper[4769]: E1121 12:26:17.408622 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4\": container with ID starting with 216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4 not found: ID does not exist" containerID="216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.408673 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4"} err="failed to get container status \"216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4\": rpc error: code = NotFound desc = could not find container \"216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4\": container with ID starting with 216ef42c178a2fcaee24cfe0706ce5aef716f8bb348ab67954c906e41d4ac4c4 not found: ID does not exist" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.412173 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.534704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535352 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jzkx\" (UniqueName: \"kubernetes.io/projected/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-kube-api-access-9jzkx\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-logs\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.535883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.571855 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.640460 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.640570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.640824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.640976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.641153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.641175 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.641373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.641420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9jzkx\" (UniqueName: \"kubernetes.io/projected/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-kube-api-access-9jzkx\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.641550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-logs\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.642038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-logs\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.642308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.648916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.659105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.659326 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.664848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.667054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jzkx\" (UniqueName: \"kubernetes.io/projected/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-kube-api-access-9jzkx\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.679630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"glance-default-internal-api-0\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.742790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-combined-ca-bundle\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.742864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-log-httpd\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.743058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-sg-core-conf-yaml\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.743095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-scripts\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.743161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-run-httpd\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.743181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-config-data\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.743321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h444t\" (UniqueName: \"kubernetes.io/projected/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-kube-api-access-h444t\") pod \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\" (UID: \"650a3883-4e40-46ee-a1e9-8bb0ceb49a04\") " Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.744800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.745151 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.750777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-scripts" (OuterVolumeSpecName: "scripts") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.750932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-kube-api-access-h444t" (OuterVolumeSpecName: "kube-api-access-h444t") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "kube-api-access-h444t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.756339 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.788331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.840558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.845966 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.846008 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.846020 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.846032 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.846042 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.846052 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h444t\" (UniqueName: \"kubernetes.io/projected/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-kube-api-access-h444t\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.888569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-config-data" (OuterVolumeSpecName: "config-data") pod "650a3883-4e40-46ee-a1e9-8bb0ceb49a04" (UID: "650a3883-4e40-46ee-a1e9-8bb0ceb49a04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:17 crc kubenswrapper[4769]: I1121 12:26:17.948806 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/650a3883-4e40-46ee-a1e9-8bb0ceb49a04-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.285230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.359039 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.359213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"650a3883-4e40-46ee-a1e9-8bb0ceb49a04","Type":"ContainerDied","Data":"4a55b95168ed01ee43492e527d1848e01dfee0521906c78868ebf8f276ec532f"} Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.359284 4769 scope.go:117] "RemoveContainer" containerID="c45736ad7bc29537d87375aa6d8ced3161f2a2756066b921146adf17bfb75cf7" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.363897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"24e9adde-0ce7-4cf1-8c98-21458a046a0e","Type":"ContainerStarted","Data":"e1a8a85295fbfaf9ddcacaf104c7e3a5187c32bb6d23ba29095d186d1500d7e3"} Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.363944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"24e9adde-0ce7-4cf1-8c98-21458a046a0e","Type":"ContainerStarted","Data":"fdc05e7c68e509072a302de8397cb9c5f07ceeda3caec162275645bb7ce9fdb8"} Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.368852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"60d48f3d-32e3-4de7-8634-0f876ed5ac2f","Type":"ContainerStarted","Data":"9258cd9d53c3706c513a42d72819067737909e6f1c142592d70eb2044fd55ebd"} Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.389650 4769 scope.go:117] "RemoveContainer" containerID="f187c36591c5d1b18be61b561a779e501efe23a39d4fad83ba73d65719394862" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.409839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.429756 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.435477 4769 scope.go:117] "RemoveContainer" containerID="5722c288f90477e4775121420de89fac4d02f9c1e7e926aa29fdeeada54a9aad" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.459140 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:18 crc kubenswrapper[4769]: E1121 12:26:18.459699 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-notification-agent" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.459718 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-notification-agent" Nov 21 12:26:18 crc kubenswrapper[4769]: E1121 12:26:18.459742 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="sg-core" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.459748 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="sg-core" Nov 21 12:26:18 crc kubenswrapper[4769]: E1121 12:26:18.459757 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="proxy-httpd" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.459762 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="proxy-httpd" Nov 21 12:26:18 crc kubenswrapper[4769]: E1121 12:26:18.459785 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-central-agent" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.459791 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-central-agent" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.460180 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-central-agent" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.460215 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="sg-core" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.460229 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="proxy-httpd" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.460243 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" containerName="ceilometer-notification-agent" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.463090 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.467041 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.469394 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.478074 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.505230 4769 scope.go:117] "RemoveContainer" containerID="64a7f33831d837acfb09fba1f3329d1e9741b539357e476e0db62effcde46655" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561204 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-config-data\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-log-httpd\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-run-httpd\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-scripts\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.561658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qdvj\" (UniqueName: \"kubernetes.io/projected/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-kube-api-access-5qdvj\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-log-httpd\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664731 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-run-httpd\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-scripts\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5qdvj\" (UniqueName: \"kubernetes.io/projected/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-kube-api-access-5qdvj\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.664891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-config-data\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.665296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-log-httpd\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.666023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-run-httpd\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.669578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.670823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-config-data\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.671674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-scripts\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.672974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.685006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qdvj\" (UniqueName: \"kubernetes.io/projected/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-kube-api-access-5qdvj\") pod \"ceilometer-0\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:18 crc kubenswrapper[4769]: I1121 12:26:18.791962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:19 crc kubenswrapper[4769]: I1121 12:26:19.295243 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="109a61aa-34a6-4914-8f17-8b0abe1cb2b3" path="/var/lib/kubelet/pods/109a61aa-34a6-4914-8f17-8b0abe1cb2b3/volumes" Nov 21 12:26:19 crc kubenswrapper[4769]: I1121 12:26:19.297403 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="650a3883-4e40-46ee-a1e9-8bb0ceb49a04" path="/var/lib/kubelet/pods/650a3883-4e40-46ee-a1e9-8bb0ceb49a04/volumes" Nov 21 12:26:19 crc kubenswrapper[4769]: I1121 12:26:19.298383 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:19 crc kubenswrapper[4769]: I1121 12:26:19.412338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerStarted","Data":"06ae843b38c9a926d1539b1b34ae05b7786412621ada60d22577b225562a7267"} Nov 21 12:26:19 crc kubenswrapper[4769]: I1121 12:26:19.416002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"24e9adde-0ce7-4cf1-8c98-21458a046a0e","Type":"ContainerStarted","Data":"da9b83ab069f95e46f81bc4c86275abda61442db99af1310087deeb06729e95c"} Nov 21 12:26:19 crc kubenswrapper[4769]: I1121 12:26:19.420642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"60d48f3d-32e3-4de7-8634-0f876ed5ac2f","Type":"ContainerStarted","Data":"34c9d0a000299b8aa0798da9a634904fc939c7c330ef500f2aeb1dad6dab4995"} Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.451855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerStarted","Data":"82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5"} Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.460169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"60d48f3d-32e3-4de7-8634-0f876ed5ac2f","Type":"ContainerStarted","Data":"a9cb286696dfabe46b8f1cad7b25766dec37fcb850bd3469c5a9ec7c9b313078"} Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.481899 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.481870559 podStartE2EDuration="3.481870559s" podCreationTimestamp="2025-11-21 12:26:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:20.481713774 +0000 UTC m=+2139.182375592" watchObservedRunningTime="2025-11-21 12:26:20.481870559 +0000 UTC m=+2139.182532377" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.491757 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.491727013 podStartE2EDuration="4.491727013s" podCreationTimestamp="2025-11-21 12:26:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:19.445537166 +0000 UTC m=+2138.146199014" watchObservedRunningTime="2025-11-21 12:26:20.491727013 +0000 UTC m=+2139.192388831" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.748949 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x"] Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.754850 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.757946 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.758310 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-69vww" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.761072 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.762585 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x"] Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.815256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.815319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472xh\" (UniqueName: \"kubernetes.io/projected/5c6a19a5-0f21-4261-af83-0248988b8b3b-kube-api-access-472xh\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.815472 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-scripts\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.815504 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-config-data\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.916084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-472xh\" (UniqueName: \"kubernetes.io/projected/5c6a19a5-0f21-4261-af83-0248988b8b3b-kube-api-access-472xh\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.916268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-scripts\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.916309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-config-data\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.916352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.923323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-config-data\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.924337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-scripts\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.924589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:20 crc kubenswrapper[4769]: I1121 12:26:20.933743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-472xh\" (UniqueName: \"kubernetes.io/projected/5c6a19a5-0f21-4261-af83-0248988b8b3b-kube-api-access-472xh\") pod \"nova-cell0-conductor-db-sync-2pd9x\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:21 crc kubenswrapper[4769]: I1121 12:26:21.124614 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:21 crc kubenswrapper[4769]: I1121 12:26:21.475531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerStarted","Data":"96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0"} Nov 21 12:26:21 crc kubenswrapper[4769]: I1121 12:26:21.476055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerStarted","Data":"b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3"} Nov 21 12:26:21 crc kubenswrapper[4769]: I1121 12:26:21.615909 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x"] Nov 21 12:26:21 crc kubenswrapper[4769]: W1121 12:26:21.623876 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c6a19a5_0f21_4261_af83_0248988b8b3b.slice/crio-669016ad2d17e022f8c458cb7a6a10e504d58df24831b41f63da85411a97a3e4 WatchSource:0}: Error finding container 669016ad2d17e022f8c458cb7a6a10e504d58df24831b41f63da85411a97a3e4: Status 404 returned error can't find the container with id 669016ad2d17e022f8c458cb7a6a10e504d58df24831b41f63da85411a97a3e4 Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.487338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerStarted","Data":"f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6"} Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.488114 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.491153 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" event={"ID":"5c6a19a5-0f21-4261-af83-0248988b8b3b","Type":"ContainerStarted","Data":"6988eca2319d53f13a6625839d4af2bec2240a0d34f102eb559c4bb2e59d0a60"} Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.491203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" event={"ID":"5c6a19a5-0f21-4261-af83-0248988b8b3b","Type":"ContainerStarted","Data":"669016ad2d17e022f8c458cb7a6a10e504d58df24831b41f63da85411a97a3e4"} Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.519561 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.627108193 podStartE2EDuration="4.519535436s" podCreationTimestamp="2025-11-21 12:26:18 +0000 UTC" firstStartedPulling="2025-11-21 12:26:19.285515038 +0000 UTC m=+2137.986176856" lastFinishedPulling="2025-11-21 12:26:22.177942281 +0000 UTC m=+2140.878604099" observedRunningTime="2025-11-21 12:26:22.512846856 +0000 UTC m=+2141.213508674" watchObservedRunningTime="2025-11-21 12:26:22.519535436 +0000 UTC m=+2141.220197254" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.544046 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" podStartSLOduration=2.544013292 podStartE2EDuration="2.544013292s" podCreationTimestamp="2025-11-21 12:26:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:22.535443432 +0000 UTC m=+2141.236105250" watchObservedRunningTime="2025-11-21 12:26:22.544013292 +0000 UTC m=+2141.244675110" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.670263 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-xzvq8"] Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.672179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.718808 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-xzvq8"] Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.761347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-utilities\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.761687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-catalog-content\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.763337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgwc\" (UniqueName: \"kubernetes.io/projected/a327cca3-d347-49fa-b271-1e90e3bab68f-kube-api-access-9cgwc\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.865397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgwc\" (UniqueName: \"kubernetes.io/projected/a327cca3-d347-49fa-b271-1e90e3bab68f-kube-api-access-9cgwc\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.865813 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-utilities\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.865844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-catalog-content\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.866363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-catalog-content\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.866509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-utilities\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:22 crc kubenswrapper[4769]: I1121 12:26:22.891611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgwc\" (UniqueName: \"kubernetes.io/projected/a327cca3-d347-49fa-b271-1e90e3bab68f-kube-api-access-9cgwc\") pod \"certified-operators-xzvq8\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:23 crc kubenswrapper[4769]: I1121 12:26:23.015301 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:23 crc kubenswrapper[4769]: I1121 12:26:23.722946 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-xzvq8"] Nov 21 12:26:23 crc kubenswrapper[4769]: W1121 12:26:23.730890 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda327cca3_d347_49fa_b271_1e90e3bab68f.slice/crio-255bfbf920bcb353b7fead71940d2b7160bee0ebfeccbc2036117b5e46fb2b4c WatchSource:0}: Error finding container 255bfbf920bcb353b7fead71940d2b7160bee0ebfeccbc2036117b5e46fb2b4c: Status 404 returned error can't find the container with id 255bfbf920bcb353b7fead71940d2b7160bee0ebfeccbc2036117b5e46fb2b4c Nov 21 12:26:24 crc kubenswrapper[4769]: I1121 12:26:24.529273 4769 generic.go:334] "Generic (PLEG): container finished" podID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerID="60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d" exitCode=0 Nov 21 12:26:24 crc kubenswrapper[4769]: I1121 12:26:24.529486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-xzvq8" event={"ID":"a327cca3-d347-49fa-b271-1e90e3bab68f","Type":"ContainerDied","Data":"60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d"} Nov 21 12:26:24 crc kubenswrapper[4769]: I1121 12:26:24.529792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-xzvq8" event={"ID":"a327cca3-d347-49fa-b271-1e90e3bab68f","Type":"ContainerStarted","Data":"255bfbf920bcb353b7fead71940d2b7160bee0ebfeccbc2036117b5e46fb2b4c"} Nov 21 12:26:26 crc kubenswrapper[4769]: I1121 12:26:26.563632 4769 generic.go:334] "Generic (PLEG): container finished" podID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerID="ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8" exitCode=0 Nov 21 12:26:26 crc kubenswrapper[4769]: I1121 12:26:26.563883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-xzvq8" event={"ID":"a327cca3-d347-49fa-b271-1e90e3bab68f","Type":"ContainerDied","Data":"ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8"} Nov 21 12:26:26 crc kubenswrapper[4769]: I1121 12:26:26.803916 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:26 crc kubenswrapper[4769]: I1121 12:26:26.803975 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:26 crc kubenswrapper[4769]: I1121 12:26:26.841346 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:26 crc kubenswrapper[4769]: I1121 12:26:26.849028 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.425491 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.577600 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-xzvq8" event={"ID":"a327cca3-d347-49fa-b271-1e90e3bab68f","Type":"ContainerStarted","Data":"daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7"} Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.577698 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.577721 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.602710 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-xzvq8" podStartSLOduration=3.127326802 podStartE2EDuration="5.602663861s" podCreationTimestamp="2025-11-21 12:26:22 +0000 UTC" firstStartedPulling="2025-11-21 12:26:24.53222751 +0000 UTC m=+2143.232889318" lastFinishedPulling="2025-11-21 12:26:27.007564559 +0000 UTC m=+2145.708226377" observedRunningTime="2025-11-21 12:26:27.597507243 +0000 UTC m=+2146.298169071" watchObservedRunningTime="2025-11-21 12:26:27.602663861 +0000 UTC m=+2146.303325679" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.758454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.760041 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.804878 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:27 crc kubenswrapper[4769]: I1121 12:26:27.812434 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:28 crc kubenswrapper[4769]: I1121 12:26:28.589423 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:28 crc kubenswrapper[4769]: I1121 12:26:28.589484 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:29 crc kubenswrapper[4769]: I1121 12:26:29.808366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:29 crc kubenswrapper[4769]: I1121 12:26:29.809795 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.142519 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.455528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.509370 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9c55545b9-lsjgw"] Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.509641 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-api" containerID="cri-o://693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2" gracePeriod=30 Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.510079 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-httpd" containerID="cri-o://300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c" gracePeriod=30 Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.803750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.803892 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:26:30 crc kubenswrapper[4769]: I1121 12:26:30.805566 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:26:31 crc kubenswrapper[4769]: I1121 12:26:31.641944 4769 generic.go:334] "Generic (PLEG): container finished" podID="5311a32c-2827-4767-8c72-751ad4964935" containerID="300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c" exitCode=0 Nov 21 12:26:31 crc kubenswrapper[4769]: I1121 12:26:31.641962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" event={"ID":"5311a32c-2827-4767-8c72-751ad4964935","Type":"ContainerDied","Data":"300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c"} Nov 21 12:26:33 crc kubenswrapper[4769]: I1121 12:26:33.015641 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:33 crc kubenswrapper[4769]: I1121 12:26:33.015696 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:33 crc kubenswrapper[4769]: I1121 12:26:33.073813 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:33 crc kubenswrapper[4769]: I1121 12:26:33.779902 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:33 crc kubenswrapper[4769]: I1121 12:26:33.849432 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-xzvq8"] Nov 21 12:26:35 crc kubenswrapper[4769]: I1121 12:26:35.685631 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-xzvq8" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="registry-server" containerID="cri-o://daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7" gracePeriod=2 Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.564208 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.671538 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.700266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-config\") pod \"5311a32c-2827-4767-8c72-751ad4964935\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.700424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-combined-ca-bundle\") pod \"5311a32c-2827-4767-8c72-751ad4964935\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.700475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-ovndb-tls-certs\") pod \"5311a32c-2827-4767-8c72-751ad4964935\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.700669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-httpd-config\") pod \"5311a32c-2827-4767-8c72-751ad4964935\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.700718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxpgp\" (UniqueName: \"kubernetes.io/projected/5311a32c-2827-4767-8c72-751ad4964935-kube-api-access-xxpgp\") pod \"5311a32c-2827-4767-8c72-751ad4964935\" (UID: \"5311a32c-2827-4767-8c72-751ad4964935\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.730855 4769 generic.go:334] "Generic (PLEG): container finished" podID="5311a32c-2827-4767-8c72-751ad4964935" containerID="693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2" exitCode=0 Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.731378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" event={"ID":"5311a32c-2827-4767-8c72-751ad4964935","Type":"ContainerDied","Data":"693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2"} Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.731438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" event={"ID":"5311a32c-2827-4767-8c72-751ad4964935","Type":"ContainerDied","Data":"1e82424ec202d9d6ee3c7fa6fc26a0bf2e60271fa500fab6fd54751050258efd"} Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.731456 4769 scope.go:117] "RemoveContainer" containerID="300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.731615 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-9c55545b9-lsjgw" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.732106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "5311a32c-2827-4767-8c72-751ad4964935" (UID: "5311a32c-2827-4767-8c72-751ad4964935"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.734965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5311a32c-2827-4767-8c72-751ad4964935-kube-api-access-xxpgp" (OuterVolumeSpecName: "kube-api-access-xxpgp") pod "5311a32c-2827-4767-8c72-751ad4964935" (UID: "5311a32c-2827-4767-8c72-751ad4964935"). InnerVolumeSpecName "kube-api-access-xxpgp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.742707 4769 generic.go:334] "Generic (PLEG): container finished" podID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerID="daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7" exitCode=0 Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.742851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-xzvq8" event={"ID":"a327cca3-d347-49fa-b271-1e90e3bab68f","Type":"ContainerDied","Data":"daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7"} Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.742890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-xzvq8" event={"ID":"a327cca3-d347-49fa-b271-1e90e3bab68f","Type":"ContainerDied","Data":"255bfbf920bcb353b7fead71940d2b7160bee0ebfeccbc2036117b5e46fb2b4c"} Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.742981 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-xzvq8" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.767998 4769 scope.go:117] "RemoveContainer" containerID="693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.797757 4769 scope.go:117] "RemoveContainer" containerID="300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c" Nov 21 12:26:36 crc kubenswrapper[4769]: E1121 12:26:36.798384 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c\": container with ID starting with 300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c not found: ID does not exist" containerID="300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.799037 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c"} err="failed to get container status \"300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c\": rpc error: code = NotFound desc = could not find container \"300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c\": container with ID starting with 300c047166353f158770c0c51faa0ea169dceb07e15d673e01a39a4a4cf27b2c not found: ID does not exist" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.799071 4769 scope.go:117] "RemoveContainer" containerID="693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2" Nov 21 12:26:36 crc kubenswrapper[4769]: E1121 12:26:36.799504 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2\": container with ID starting with 693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2 not found: ID does not exist" containerID="693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.799524 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2"} err="failed to get container status \"693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2\": rpc error: code = NotFound desc = could not find container \"693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2\": container with ID starting with 693e0e192d28f172b397fe2ce7ba4333ea58e2a75489f2af86d75d305bd138e2 not found: ID does not exist" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.799541 4769 scope.go:117] "RemoveContainer" containerID="daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.802722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cgwc\" (UniqueName: \"kubernetes.io/projected/a327cca3-d347-49fa-b271-1e90e3bab68f-kube-api-access-9cgwc\") pod \"a327cca3-d347-49fa-b271-1e90e3bab68f\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.802815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-utilities\") pod \"a327cca3-d347-49fa-b271-1e90e3bab68f\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.802956 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-catalog-content\") pod \"a327cca3-d347-49fa-b271-1e90e3bab68f\" (UID: \"a327cca3-d347-49fa-b271-1e90e3bab68f\") " Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.803160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5311a32c-2827-4767-8c72-751ad4964935" (UID: "5311a32c-2827-4767-8c72-751ad4964935"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.803639 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.803668 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.803678 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xxpgp\" (UniqueName: \"kubernetes.io/projected/5311a32c-2827-4767-8c72-751ad4964935-kube-api-access-xxpgp\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.804445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-utilities" (OuterVolumeSpecName: "utilities") pod "a327cca3-d347-49fa-b271-1e90e3bab68f" (UID: "a327cca3-d347-49fa-b271-1e90e3bab68f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.812864 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-config" (OuterVolumeSpecName: "config") pod "5311a32c-2827-4767-8c72-751ad4964935" (UID: "5311a32c-2827-4767-8c72-751ad4964935"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.813409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a327cca3-d347-49fa-b271-1e90e3bab68f-kube-api-access-9cgwc" (OuterVolumeSpecName: "kube-api-access-9cgwc") pod "a327cca3-d347-49fa-b271-1e90e3bab68f" (UID: "a327cca3-d347-49fa-b271-1e90e3bab68f"). InnerVolumeSpecName "kube-api-access-9cgwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.833201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "5311a32c-2827-4767-8c72-751ad4964935" (UID: "5311a32c-2827-4767-8c72-751ad4964935"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.873136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a327cca3-d347-49fa-b271-1e90e3bab68f" (UID: "a327cca3-d347-49fa-b271-1e90e3bab68f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.906085 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.906125 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a327cca3-d347-49fa-b271-1e90e3bab68f-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.906138 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.906150 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5311a32c-2827-4767-8c72-751ad4964935-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.906165 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9cgwc\" (UniqueName: \"kubernetes.io/projected/a327cca3-d347-49fa-b271-1e90e3bab68f-kube-api-access-9cgwc\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.938632 4769 scope.go:117] "RemoveContainer" containerID="ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8" Nov 21 12:26:36 crc kubenswrapper[4769]: I1121 12:26:36.979966 4769 scope.go:117] "RemoveContainer" containerID="60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.036133 4769 scope.go:117] "RemoveContainer" containerID="daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7" Nov 21 12:26:37 crc kubenswrapper[4769]: E1121 12:26:37.049361 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7\": container with ID starting with daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7 not found: ID does not exist" containerID="daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.049426 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7"} err="failed to get container status \"daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7\": rpc error: code = NotFound desc = could not find container \"daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7\": container with ID starting with daa3a0df78458d06cf4cd152d8b415d7377cb2daeb31e3c7f9bb20ff3c0d66d7 not found: ID does not exist" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.049464 4769 scope.go:117] "RemoveContainer" containerID="ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8" Nov 21 12:26:37 crc kubenswrapper[4769]: E1121 12:26:37.051582 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8\": container with ID starting with ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8 not found: ID does not exist" containerID="ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.051633 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8"} err="failed to get container status \"ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8\": rpc error: code = NotFound desc = could not find container \"ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8\": container with ID starting with ab4a18209714613fdc5582d6f017877831284aded8e06a8e08c4ec09db6871d8 not found: ID does not exist" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.051664 4769 scope.go:117] "RemoveContainer" containerID="60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d" Nov 21 12:26:37 crc kubenswrapper[4769]: E1121 12:26:37.051943 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d\": container with ID starting with 60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d not found: ID does not exist" containerID="60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.051973 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d"} err="failed to get container status \"60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d\": rpc error: code = NotFound desc = could not find container \"60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d\": container with ID starting with 60c4a1a571da733b8845c2a9fa4ef32367158063f25ab2b8cdc497d41fd1a97d not found: ID does not exist" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.111643 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-xzvq8"] Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.128458 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-xzvq8"] Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.138712 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-9c55545b9-lsjgw"] Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.148526 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-9c55545b9-lsjgw"] Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.371035 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5311a32c-2827-4767-8c72-751ad4964935" path="/var/lib/kubelet/pods/5311a32c-2827-4767-8c72-751ad4964935/volumes" Nov 21 12:26:37 crc kubenswrapper[4769]: I1121 12:26:37.371964 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" path="/var/lib/kubelet/pods/a327cca3-d347-49fa-b271-1e90e3bab68f/volumes" Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.238513 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.239522 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-central-agent" containerID="cri-o://82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5" gracePeriod=30 Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.239667 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-notification-agent" containerID="cri-o://b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3" gracePeriod=30 Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.239693 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="proxy-httpd" containerID="cri-o://f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6" gracePeriod=30 Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.239676 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="sg-core" containerID="cri-o://96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0" gracePeriod=30 Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.253445 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.116:3000/\": EOF" Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.777524 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerID="f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6" exitCode=0 Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.777571 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerID="96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0" exitCode=2 Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.777592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerDied","Data":"f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6"} Nov 21 12:26:39 crc kubenswrapper[4769]: I1121 12:26:39.777643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerDied","Data":"96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0"} Nov 21 12:26:40 crc kubenswrapper[4769]: I1121 12:26:40.788944 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c6a19a5-0f21-4261-af83-0248988b8b3b" containerID="6988eca2319d53f13a6625839d4af2bec2240a0d34f102eb559c4bb2e59d0a60" exitCode=0 Nov 21 12:26:40 crc kubenswrapper[4769]: I1121 12:26:40.789047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" event={"ID":"5c6a19a5-0f21-4261-af83-0248988b8b3b","Type":"ContainerDied","Data":"6988eca2319d53f13a6625839d4af2bec2240a0d34f102eb559c4bb2e59d0a60"} Nov 21 12:26:40 crc kubenswrapper[4769]: I1121 12:26:40.795536 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerID="82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5" exitCode=0 Nov 21 12:26:40 crc kubenswrapper[4769]: I1121 12:26:40.795609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerDied","Data":"82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5"} Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.136200 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.224552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-config-data\") pod \"5c6a19a5-0f21-4261-af83-0248988b8b3b\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.224629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-combined-ca-bundle\") pod \"5c6a19a5-0f21-4261-af83-0248988b8b3b\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.224729 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-scripts\") pod \"5c6a19a5-0f21-4261-af83-0248988b8b3b\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.224766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-472xh\" (UniqueName: \"kubernetes.io/projected/5c6a19a5-0f21-4261-af83-0248988b8b3b-kube-api-access-472xh\") pod \"5c6a19a5-0f21-4261-af83-0248988b8b3b\" (UID: \"5c6a19a5-0f21-4261-af83-0248988b8b3b\") " Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.232107 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6a19a5-0f21-4261-af83-0248988b8b3b-kube-api-access-472xh" (OuterVolumeSpecName: "kube-api-access-472xh") pod "5c6a19a5-0f21-4261-af83-0248988b8b3b" (UID: "5c6a19a5-0f21-4261-af83-0248988b8b3b"). InnerVolumeSpecName "kube-api-access-472xh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.242823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-scripts" (OuterVolumeSpecName: "scripts") pod "5c6a19a5-0f21-4261-af83-0248988b8b3b" (UID: "5c6a19a5-0f21-4261-af83-0248988b8b3b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.272083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c6a19a5-0f21-4261-af83-0248988b8b3b" (UID: "5c6a19a5-0f21-4261-af83-0248988b8b3b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.290993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-config-data" (OuterVolumeSpecName: "config-data") pod "5c6a19a5-0f21-4261-af83-0248988b8b3b" (UID: "5c6a19a5-0f21-4261-af83-0248988b8b3b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.327060 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.327119 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-472xh\" (UniqueName: \"kubernetes.io/projected/5c6a19a5-0f21-4261-af83-0248988b8b3b-kube-api-access-472xh\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.327138 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.327155 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c6a19a5-0f21-4261-af83-0248988b8b3b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.818998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" event={"ID":"5c6a19a5-0f21-4261-af83-0248988b8b3b","Type":"ContainerDied","Data":"669016ad2d17e022f8c458cb7a6a10e504d58df24831b41f63da85411a97a3e4"} Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.819048 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="669016ad2d17e022f8c458cb7a6a10e504d58df24831b41f63da85411a97a3e4" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.819147 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905100 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:26:42 crc kubenswrapper[4769]: E1121 12:26:42.905614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="extract-content" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905639 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="extract-content" Nov 21 12:26:42 crc kubenswrapper[4769]: E1121 12:26:42.905655 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="extract-utilities" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905672 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="extract-utilities" Nov 21 12:26:42 crc kubenswrapper[4769]: E1121 12:26:42.905691 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c6a19a5-0f21-4261-af83-0248988b8b3b" containerName="nova-cell0-conductor-db-sync" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905699 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6a19a5-0f21-4261-af83-0248988b8b3b" containerName="nova-cell0-conductor-db-sync" Nov 21 12:26:42 crc kubenswrapper[4769]: E1121 12:26:42.905709 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-api" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905716 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-api" Nov 21 12:26:42 crc kubenswrapper[4769]: E1121 12:26:42.905739 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-httpd" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905747 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-httpd" Nov 21 12:26:42 crc kubenswrapper[4769]: E1121 12:26:42.905770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="registry-server" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.905780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="registry-server" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.910034 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c6a19a5-0f21-4261-af83-0248988b8b3b" containerName="nova-cell0-conductor-db-sync" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.910117 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a327cca3-d347-49fa-b271-1e90e3bab68f" containerName="registry-server" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.910150 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-api" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.910164 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5311a32c-2827-4767-8c72-751ad4964935" containerName="neutron-httpd" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.910981 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.916687 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.921513 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-69vww" Nov 21 12:26:42 crc kubenswrapper[4769]: I1121 12:26:42.922512 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.041106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.041205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.041233 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbwpp\" (UniqueName: \"kubernetes.io/projected/e67c9352-b51b-415a-a305-0e9b35c4370e-kube-api-access-cbwpp\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.144121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.144309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.144341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cbwpp\" (UniqueName: \"kubernetes.io/projected/e67c9352-b51b-415a-a305-0e9b35c4370e-kube-api-access-cbwpp\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.150216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.184321 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.188283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbwpp\" (UniqueName: \"kubernetes.io/projected/e67c9352-b51b-415a-a305-0e9b35c4370e-kube-api-access-cbwpp\") pod \"nova-cell0-conductor-0\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.231226 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.453589 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.551284 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-log-httpd\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.551695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-config-data\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.551753 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-combined-ca-bundle\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.551802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.551854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-scripts\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.552007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-sg-core-conf-yaml\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.552477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qdvj\" (UniqueName: \"kubernetes.io/projected/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-kube-api-access-5qdvj\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.552544 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-run-httpd\") pod \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\" (UID: \"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f\") " Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.553077 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.553398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.558444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-scripts" (OuterVolumeSpecName: "scripts") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.558538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-kube-api-access-5qdvj" (OuterVolumeSpecName: "kube-api-access-5qdvj") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "kube-api-access-5qdvj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.589539 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.642878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.654361 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5qdvj\" (UniqueName: \"kubernetes.io/projected/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-kube-api-access-5qdvj\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.654415 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.654427 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.654435 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.654446 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.665827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-config-data" (OuterVolumeSpecName: "config-data") pod "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" (UID: "5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.737063 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.757240 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.834967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e67c9352-b51b-415a-a305-0e9b35c4370e","Type":"ContainerStarted","Data":"b900fd13d7daaa64af8e6cfd20e1f84d736b4fa88e5d65197c2d3a16f11ada55"} Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.839056 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerID="b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3" exitCode=0 Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.839110 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerDied","Data":"b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3"} Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.839147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f","Type":"ContainerDied","Data":"06ae843b38c9a926d1539b1b34ae05b7786412621ada60d22577b225562a7267"} Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.839174 4769 scope.go:117] "RemoveContainer" containerID="f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.839184 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.858285 4769 scope.go:117] "RemoveContainer" containerID="96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.889750 4769 scope.go:117] "RemoveContainer" containerID="b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.905675 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.929129 4769 scope.go:117] "RemoveContainer" containerID="82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.940538 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.961421 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.961672 4769 scope.go:117] "RemoveContainer" containerID="f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.961893 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="proxy-httpd" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.961921 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="proxy-httpd" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.961967 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-notification-agent" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.961977 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-notification-agent" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.962012 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-central-agent" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-central-agent" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.962052 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="sg-core" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962060 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="sg-core" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="proxy-httpd" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962408 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-central-agent" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962435 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="ceilometer-notification-agent" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962450 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" containerName="sg-core" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.962370 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6\": container with ID starting with f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6 not found: ID does not exist" containerID="f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962657 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6"} err="failed to get container status \"f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6\": rpc error: code = NotFound desc = could not find container \"f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6\": container with ID starting with f1ab4a9c76a42e2455f56109506b9609fc849bec520e3e9dce6c6795d0e2f5b6 not found: ID does not exist" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.962763 4769 scope.go:117] "RemoveContainer" containerID="96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.963404 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0\": container with ID starting with 96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0 not found: ID does not exist" containerID="96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.963443 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0"} err="failed to get container status \"96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0\": rpc error: code = NotFound desc = could not find container \"96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0\": container with ID starting with 96c9fb3dbd7dadb168d6bb868b0558f352a1335a0888c5ec4f5a390ea61ea5a0 not found: ID does not exist" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.963470 4769 scope.go:117] "RemoveContainer" containerID="b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.963744 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3\": container with ID starting with b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3 not found: ID does not exist" containerID="b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.963825 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3"} err="failed to get container status \"b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3\": rpc error: code = NotFound desc = could not find container \"b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3\": container with ID starting with b0680bc1b3134747adce1419871e4cb1f29ed08b22b8c0af60ad47639b4d77d3 not found: ID does not exist" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.963895 4769 scope.go:117] "RemoveContainer" containerID="82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5" Nov 21 12:26:43 crc kubenswrapper[4769]: E1121 12:26:43.964304 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5\": container with ID starting with 82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5 not found: ID does not exist" containerID="82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.964341 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5"} err="failed to get container status \"82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5\": rpc error: code = NotFound desc = could not find container \"82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5\": container with ID starting with 82d6648f9842847de83a312d505ed909238fbfdc2254868c7b392609d51e8fb5 not found: ID does not exist" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.964526 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.967249 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.970259 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:26:43 crc kubenswrapper[4769]: I1121 12:26:43.974412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7nj\" (UniqueName: \"kubernetes.io/projected/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-kube-api-access-rn7nj\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-scripts\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-log-httpd\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063503 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-run-httpd\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.063652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-config-data\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.164935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-log-httpd\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165001 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-run-httpd\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-run-httpd\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-log-httpd\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-config-data\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7nj\" (UniqueName: \"kubernetes.io/projected/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-kube-api-access-rn7nj\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-scripts\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.165994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.171628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-scripts\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.172018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.172854 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.173145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-config-data\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.188035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7nj\" (UniqueName: \"kubernetes.io/projected/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-kube-api-access-rn7nj\") pod \"ceilometer-0\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.289998 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.818175 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.853400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerStarted","Data":"17ccaf1538de52bdd56eaa14795fb4162707daaee0d0622d038c332fbdf13848"} Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.855832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e67c9352-b51b-415a-a305-0e9b35c4370e","Type":"ContainerStarted","Data":"db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0"} Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.855999 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:44 crc kubenswrapper[4769]: I1121 12:26:44.880583 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.880562098 podStartE2EDuration="2.880562098s" podCreationTimestamp="2025-11-21 12:26:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:44.872907633 +0000 UTC m=+2163.573569451" watchObservedRunningTime="2025-11-21 12:26:44.880562098 +0000 UTC m=+2163.581223916" Nov 21 12:26:45 crc kubenswrapper[4769]: I1121 12:26:45.288272 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f" path="/var/lib/kubelet/pods/5f4a83b8-1f1b-4c82-808e-2d091e6ffe5f/volumes" Nov 21 12:26:45 crc kubenswrapper[4769]: I1121 12:26:45.870586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerStarted","Data":"f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43"} Nov 21 12:26:46 crc kubenswrapper[4769]: I1121 12:26:46.885866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerStarted","Data":"9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745"} Nov 21 12:26:47 crc kubenswrapper[4769]: I1121 12:26:47.909955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerStarted","Data":"112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba"} Nov 21 12:26:48 crc kubenswrapper[4769]: I1121 12:26:48.921945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerStarted","Data":"d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19"} Nov 21 12:26:48 crc kubenswrapper[4769]: I1121 12:26:48.922470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.262102 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.297800 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=6.988926033 podStartE2EDuration="10.297763647s" podCreationTimestamp="2025-11-21 12:26:43 +0000 UTC" firstStartedPulling="2025-11-21 12:26:44.8255094 +0000 UTC m=+2163.526171238" lastFinishedPulling="2025-11-21 12:26:48.134347034 +0000 UTC m=+2166.835008852" observedRunningTime="2025-11-21 12:26:48.960305217 +0000 UTC m=+2167.660967045" watchObservedRunningTime="2025-11-21 12:26:53.297763647 +0000 UTC m=+2171.998425475" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.711641 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp"] Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.712981 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.715747 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.715946 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.725901 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp"] Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.758737 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.758859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-scripts\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.758902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjw2r\" (UniqueName: \"kubernetes.io/projected/6c6c82f0-38b6-4948-b467-6d176d2072d4-kube-api-access-jjw2r\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.758949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-config-data\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.865935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.866363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-scripts\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.866434 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw2r\" (UniqueName: \"kubernetes.io/projected/6c6c82f0-38b6-4948-b467-6d176d2072d4-kube-api-access-jjw2r\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.866504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-config-data\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.873591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-scripts\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.876904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.881009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-config-data\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.894037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjw2r\" (UniqueName: \"kubernetes.io/projected/6c6c82f0-38b6-4948-b467-6d176d2072d4-kube-api-access-jjw2r\") pod \"nova-cell0-cell-mapping-4xrxp\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.911534 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.913163 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.934395 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.942267 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.943845 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.962798 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.967343 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.981055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-config-data\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.996857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66196036-c54b-4f10-861c-d3976bedbb49-logs\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.997012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2tnc\" (UniqueName: \"kubernetes.io/projected/66196036-c54b-4f10-861c-d3976bedbb49-kube-api-access-m2tnc\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.997115 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:53 crc kubenswrapper[4769]: I1121 12:26:53.990255 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.022855 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.025104 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.031948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.039328 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.083085 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103417 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnsk4\" (UniqueName: \"kubernetes.io/projected/845729de-0508-4a1f-8a60-f28742942a79-kube-api-access-mnsk4\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nccm9\" (UniqueName: \"kubernetes.io/projected/f0ce4540-badd-420e-8e83-38f399893420-kube-api-access-nccm9\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-config-data\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103574 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66196036-c54b-4f10-861c-d3976bedbb49-logs\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0ce4540-badd-420e-8e83-38f399893420-logs\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-config-data\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m2tnc\" (UniqueName: \"kubernetes.io/projected/66196036-c54b-4f10-861c-d3976bedbb49-kube-api-access-m2tnc\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.103738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-config-data\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.104856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66196036-c54b-4f10-861c-d3976bedbb49-logs\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.109770 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.110778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-config-data\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.111391 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.112675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.119072 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.166733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2tnc\" (UniqueName: \"kubernetes.io/projected/66196036-c54b-4f10-861c-d3976bedbb49-kube-api-access-m2tnc\") pod \"nova-api-0\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.180179 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.205381 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.205686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mnsk4\" (UniqueName: \"kubernetes.io/projected/845729de-0508-4a1f-8a60-f28742942a79-kube-api-access-mnsk4\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.205725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nccm9\" (UniqueName: \"kubernetes.io/projected/f0ce4540-badd-420e-8e83-38f399893420-kube-api-access-nccm9\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.205757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0ce4540-badd-420e-8e83-38f399893420-logs\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.205788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-config-data\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.206305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.206339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0ce4540-badd-420e-8e83-38f399893420-logs\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.206843 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.206877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.206908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-config-data\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.207488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5cd\" (UniqueName: \"kubernetes.io/projected/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-kube-api-access-mh5cd\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.211979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-config-data\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.212667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.213319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.217898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-config-data\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.237008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnsk4\" (UniqueName: \"kubernetes.io/projected/845729de-0508-4a1f-8a60-f28742942a79-kube-api-access-mnsk4\") pod \"nova-scheduler-0\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.238906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nccm9\" (UniqueName: \"kubernetes.io/projected/f0ce4540-badd-420e-8e83-38f399893420-kube-api-access-nccm9\") pod \"nova-metadata-0\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.309925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.310011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.310057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5cd\" (UniqueName: \"kubernetes.io/projected/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-kube-api-access-mh5cd\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.316434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.319841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.322029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.345411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5cd\" (UniqueName: \"kubernetes.io/projected/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-kube-api-access-mh5cd\") pod \"nova-cell1-novncproxy-0\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.356081 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.539444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.567296 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.620089 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.658874 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.900330 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.901766 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.917157 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.918274 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt"] Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.919732 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:26:54 crc kubenswrapper[4769]: W1121 12:26:54.952285 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0ce4540_badd_420e_8e83_38f399893420.slice/crio-d804cd7e0f5f816e3340e564a30196dcc22dcf1e5999e2f816ee2f1a488e8a91 WatchSource:0}: Error finding container d804cd7e0f5f816e3340e564a30196dcc22dcf1e5999e2f816ee2f1a488e8a91: Status 404 returned error can't find the container with id d804cd7e0f5f816e3340e564a30196dcc22dcf1e5999e2f816ee2f1a488e8a91 Nov 21 12:26:54 crc kubenswrapper[4769]: I1121 12:26:54.976117 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.028633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.028721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvgpp\" (UniqueName: \"kubernetes.io/projected/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-kube-api-access-zvgpp\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.028803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-scripts\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.028825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-config-data\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.034028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" event={"ID":"6c6c82f0-38b6-4948-b467-6d176d2072d4","Type":"ContainerStarted","Data":"a69290929be3979f2693fdf2c2918e8ef1ac4395ea4490372168398d8e752048"} Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.035862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f0ce4540-badd-420e-8e83-38f399893420","Type":"ContainerStarted","Data":"d804cd7e0f5f816e3340e564a30196dcc22dcf1e5999e2f816ee2f1a488e8a91"} Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.038441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"66196036-c54b-4f10-861c-d3976bedbb49","Type":"ContainerStarted","Data":"66495b30449d80f4cc624577c7114c344c22c00f7ffee17e04e003b0f8159b12"} Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.111971 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:26:55 crc kubenswrapper[4769]: W1121 12:26:55.120367 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod845729de_0508_4a1f_8a60_f28742942a79.slice/crio-2c557288b3e02dc7a403c4721105480fd4c0bbc509aaf5098c51ea0dc93dda40 WatchSource:0}: Error finding container 2c557288b3e02dc7a403c4721105480fd4c0bbc509aaf5098c51ea0dc93dda40: Status 404 returned error can't find the container with id 2c557288b3e02dc7a403c4721105480fd4c0bbc509aaf5098c51ea0dc93dda40 Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.125345 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.130842 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-config-data\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.130966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.131037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zvgpp\" (UniqueName: \"kubernetes.io/projected/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-kube-api-access-zvgpp\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.131133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-scripts\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.134770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-scripts\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.135810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.137315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-config-data\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.149250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvgpp\" (UniqueName: \"kubernetes.io/projected/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-kube-api-access-zvgpp\") pod \"nova-cell1-conductor-db-sync-xmpwt\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.320105 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:26:55 crc kubenswrapper[4769]: I1121 12:26:55.857235 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt"] Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.049518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f0ce4540-badd-420e-8e83-38f399893420","Type":"ContainerStarted","Data":"6c5d5bf81b0e16a0e34df33eca155cc06e549470a2d4ec0a6a848f0856f8c491"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.053102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"66196036-c54b-4f10-861c-d3976bedbb49","Type":"ContainerStarted","Data":"b29033df109247fbc57ee2fd0c7a8d7c2f07f2b5f5e3e11a04091d481f0661c2"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.053183 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"66196036-c54b-4f10-861c-d3976bedbb49","Type":"ContainerStarted","Data":"82378b795529616c9fa5b7d1428eb2a7cd9b5b9bd8495acbf79b943a75ab0ff7"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.055359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3c66b3aa-9822-429f-ad44-f6d19c19ccd8","Type":"ContainerStarted","Data":"8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.055499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3c66b3aa-9822-429f-ad44-f6d19c19ccd8","Type":"ContainerStarted","Data":"a1843c2076b8fd3a779958a82bae20e40c350554fc3e47a64db6723c99749df0"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.059027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" event={"ID":"6c6c82f0-38b6-4948-b467-6d176d2072d4","Type":"ContainerStarted","Data":"40d42ea9cdce4f803f1500c48021d39f0a3cdff2402fa9bd323bfdd692284b29"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.060653 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" event={"ID":"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc","Type":"ContainerStarted","Data":"13f23aa96afc8b8f0de51568ec15b5f55e6354ca1f933f66274942eaf1f878f7"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.062079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"845729de-0508-4a1f-8a60-f28742942a79","Type":"ContainerStarted","Data":"9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.062166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"845729de-0508-4a1f-8a60-f28742942a79","Type":"ContainerStarted","Data":"2c557288b3e02dc7a403c4721105480fd4c0bbc509aaf5098c51ea0dc93dda40"} Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.084454 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.084431327 podStartE2EDuration="3.084431327s" podCreationTimestamp="2025-11-21 12:26:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:56.076992638 +0000 UTC m=+2174.777654456" watchObservedRunningTime="2025-11-21 12:26:56.084431327 +0000 UTC m=+2174.785093145" Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.097156 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" podStartSLOduration=3.097134209 podStartE2EDuration="3.097134209s" podCreationTimestamp="2025-11-21 12:26:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:56.092673779 +0000 UTC m=+2174.793335597" watchObservedRunningTime="2025-11-21 12:26:56.097134209 +0000 UTC m=+2174.797796017" Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.119521 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.119498489 podStartE2EDuration="3.119498489s" podCreationTimestamp="2025-11-21 12:26:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:56.110772015 +0000 UTC m=+2174.811433833" watchObservedRunningTime="2025-11-21 12:26:56.119498489 +0000 UTC m=+2174.820160307" Nov 21 12:26:56 crc kubenswrapper[4769]: I1121 12:26:56.147003 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.146981797 podStartE2EDuration="2.146981797s" podCreationTimestamp="2025-11-21 12:26:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:56.140222966 +0000 UTC m=+2174.840884784" watchObservedRunningTime="2025-11-21 12:26:56.146981797 +0000 UTC m=+2174.847643615" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.089036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" event={"ID":"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc","Type":"ContainerStarted","Data":"37f50ffdbd0f6f408a64594eaa3cf2cfb3abaa80ffa12b6b70c9bb5515267117"} Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.096227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f0ce4540-badd-420e-8e83-38f399893420","Type":"ContainerStarted","Data":"e60a0eacbd92686a4e4625c7e0b984bfacf526395f1d0f5e1c33fde419f2e718"} Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.133238 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" podStartSLOduration=3.133201714 podStartE2EDuration="3.133201714s" podCreationTimestamp="2025-11-21 12:26:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:57.131069697 +0000 UTC m=+2175.831731515" watchObservedRunningTime="2025-11-21 12:26:57.133201714 +0000 UTC m=+2175.833863542" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.158292 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.158269537 podStartE2EDuration="4.158269537s" podCreationTimestamp="2025-11-21 12:26:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:26:57.148660539 +0000 UTC m=+2175.849322357" watchObservedRunningTime="2025-11-21 12:26:57.158269537 +0000 UTC m=+2175.858931355" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.634804 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.658194 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.777012 4769 scope.go:117] "RemoveContainer" containerID="41c43a370d8f6f63842b9c3717d2080fc19dce1f586dc1389c0a557a84c33ebb" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.811688 4769 scope.go:117] "RemoveContainer" containerID="25606af767d8ff3ee2e9429779f1c28627f5ceb4c165d7181fcd60475e9ded72" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.836697 4769 scope.go:117] "RemoveContainer" containerID="b1f4b6f364e27ced6b6aa8a1e2ec35ee6017d7738e96b5855700559bf7001aa0" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.855897 4769 scope.go:117] "RemoveContainer" containerID="b35e8f43ce4ca5ccd03d0efd5ce80fb7c2c2c7d6ec7688436d6ab35ca06c1072" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.942558 4769 scope.go:117] "RemoveContainer" containerID="90e305dcc2adbf7693208d066dba8a7311f737a2ca716344e9b053b80b47785c" Nov 21 12:26:57 crc kubenswrapper[4769]: I1121 12:26:57.992933 4769 scope.go:117] "RemoveContainer" containerID="0d54399c2609c38b0a1f80d17e33fab46a47b42a60b69b79aba99056467ac6b0" Nov 21 12:26:58 crc kubenswrapper[4769]: I1121 12:26:58.046556 4769 scope.go:117] "RemoveContainer" containerID="74813f28ad095d48436449dcfac1c96e568e5de9dd3c39716c530f056b3074e1" Nov 21 12:26:58 crc kubenswrapper[4769]: I1121 12:26:58.114815 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="3c66b3aa-9822-429f-ad44-f6d19c19ccd8" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b" gracePeriod=30 Nov 21 12:26:58 crc kubenswrapper[4769]: I1121 12:26:58.986266 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.029504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-config-data\") pod \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.029697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh5cd\" (UniqueName: \"kubernetes.io/projected/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-kube-api-access-mh5cd\") pod \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.029741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-combined-ca-bundle\") pod \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\" (UID: \"3c66b3aa-9822-429f-ad44-f6d19c19ccd8\") " Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.036441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-kube-api-access-mh5cd" (OuterVolumeSpecName: "kube-api-access-mh5cd") pod "3c66b3aa-9822-429f-ad44-f6d19c19ccd8" (UID: "3c66b3aa-9822-429f-ad44-f6d19c19ccd8"). InnerVolumeSpecName "kube-api-access-mh5cd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.058366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-config-data" (OuterVolumeSpecName: "config-data") pod "3c66b3aa-9822-429f-ad44-f6d19c19ccd8" (UID: "3c66b3aa-9822-429f-ad44-f6d19c19ccd8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.059936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c66b3aa-9822-429f-ad44-f6d19c19ccd8" (UID: "3c66b3aa-9822-429f-ad44-f6d19c19ccd8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.124277 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c66b3aa-9822-429f-ad44-f6d19c19ccd8" containerID="8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b" exitCode=0 Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.124496 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-log" containerID="cri-o://6c5d5bf81b0e16a0e34df33eca155cc06e549470a2d4ec0a6a848f0856f8c491" gracePeriod=30 Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.124846 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.129793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3c66b3aa-9822-429f-ad44-f6d19c19ccd8","Type":"ContainerDied","Data":"8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b"} Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.129860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"3c66b3aa-9822-429f-ad44-f6d19c19ccd8","Type":"ContainerDied","Data":"a1843c2076b8fd3a779958a82bae20e40c350554fc3e47a64db6723c99749df0"} Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.129882 4769 scope.go:117] "RemoveContainer" containerID="8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.130463 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-metadata" containerID="cri-o://e60a0eacbd92686a4e4625c7e0b984bfacf526395f1d0f5e1c33fde419f2e718" gracePeriod=30 Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.131995 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mh5cd\" (UniqueName: \"kubernetes.io/projected/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-kube-api-access-mh5cd\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.132022 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.132032 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c66b3aa-9822-429f-ad44-f6d19c19ccd8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.166817 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.180627 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.188020 4769 scope.go:117] "RemoveContainer" containerID="8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.188496 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:59 crc kubenswrapper[4769]: E1121 12:26:59.189000 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c66b3aa-9822-429f-ad44-f6d19c19ccd8" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.189026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c66b3aa-9822-429f-ad44-f6d19c19ccd8" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.189269 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c66b3aa-9822-429f-ad44-f6d19c19ccd8" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.189944 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: E1121 12:26:59.196421 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b\": container with ID starting with 8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b not found: ID does not exist" containerID="8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.196494 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b"} err="failed to get container status \"8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b\": rpc error: code = NotFound desc = could not find container \"8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b\": container with ID starting with 8cf1ccce205bc6b054bb0df2f7f9fcc51c32a0db5233e7f9ea67d493bc114c4b not found: ID does not exist" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.196774 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.196786 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.197431 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.216620 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.247505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.247575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.247621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.247691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd8cd\" (UniqueName: \"kubernetes.io/projected/5b1a8d65-32f5-486e-b01e-5f77f989621b-kube-api-access-cd8cd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.247728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.298484 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c66b3aa-9822-429f-ad44-f6d19c19ccd8" path="/var/lib/kubelet/pods/3c66b3aa-9822-429f-ad44-f6d19c19ccd8/volumes" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.349370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cd8cd\" (UniqueName: \"kubernetes.io/projected/5b1a8d65-32f5-486e-b01e-5f77f989621b-kube-api-access-cd8cd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.349444 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.349486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.349521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.349556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.357944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.358077 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.358110 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.359040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.362861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.373519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.375816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd8cd\" (UniqueName: \"kubernetes.io/projected/5b1a8d65-32f5-486e-b01e-5f77f989621b-kube-api-access-cd8cd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.522337 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.540738 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:26:59 crc kubenswrapper[4769]: I1121 12:26:59.989216 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:26:59 crc kubenswrapper[4769]: W1121 12:26:59.999282 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b1a8d65_32f5_486e_b01e_5f77f989621b.slice/crio-3d4a84ece90a72319d10d3c05751891d0e17c0f691441f8335a5b9b3d6a00171 WatchSource:0}: Error finding container 3d4a84ece90a72319d10d3c05751891d0e17c0f691441f8335a5b9b3d6a00171: Status 404 returned error can't find the container with id 3d4a84ece90a72319d10d3c05751891d0e17c0f691441f8335a5b9b3d6a00171 Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.135372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5b1a8d65-32f5-486e-b01e-5f77f989621b","Type":"ContainerStarted","Data":"3d4a84ece90a72319d10d3c05751891d0e17c0f691441f8335a5b9b3d6a00171"} Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.138553 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0ce4540-badd-420e-8e83-38f399893420" containerID="e60a0eacbd92686a4e4625c7e0b984bfacf526395f1d0f5e1c33fde419f2e718" exitCode=0 Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.138593 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0ce4540-badd-420e-8e83-38f399893420" containerID="6c5d5bf81b0e16a0e34df33eca155cc06e549470a2d4ec0a6a848f0856f8c491" exitCode=143 Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.138592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f0ce4540-badd-420e-8e83-38f399893420","Type":"ContainerDied","Data":"e60a0eacbd92686a4e4625c7e0b984bfacf526395f1d0f5e1c33fde419f2e718"} Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.138625 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f0ce4540-badd-420e-8e83-38f399893420","Type":"ContainerDied","Data":"6c5d5bf81b0e16a0e34df33eca155cc06e549470a2d4ec0a6a848f0856f8c491"} Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.138641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f0ce4540-badd-420e-8e83-38f399893420","Type":"ContainerDied","Data":"d804cd7e0f5f816e3340e564a30196dcc22dcf1e5999e2f816ee2f1a488e8a91"} Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.138652 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d804cd7e0f5f816e3340e564a30196dcc22dcf1e5999e2f816ee2f1a488e8a91" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.199632 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.269318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-combined-ca-bundle\") pod \"f0ce4540-badd-420e-8e83-38f399893420\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.270044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nccm9\" (UniqueName: \"kubernetes.io/projected/f0ce4540-badd-420e-8e83-38f399893420-kube-api-access-nccm9\") pod \"f0ce4540-badd-420e-8e83-38f399893420\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.270480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-config-data\") pod \"f0ce4540-badd-420e-8e83-38f399893420\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.271050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0ce4540-badd-420e-8e83-38f399893420-logs\") pod \"f0ce4540-badd-420e-8e83-38f399893420\" (UID: \"f0ce4540-badd-420e-8e83-38f399893420\") " Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.271391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ce4540-badd-420e-8e83-38f399893420-logs" (OuterVolumeSpecName: "logs") pod "f0ce4540-badd-420e-8e83-38f399893420" (UID: "f0ce4540-badd-420e-8e83-38f399893420"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.272658 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0ce4540-badd-420e-8e83-38f399893420-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.274857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ce4540-badd-420e-8e83-38f399893420-kube-api-access-nccm9" (OuterVolumeSpecName: "kube-api-access-nccm9") pod "f0ce4540-badd-420e-8e83-38f399893420" (UID: "f0ce4540-badd-420e-8e83-38f399893420"). InnerVolumeSpecName "kube-api-access-nccm9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.300095 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0ce4540-badd-420e-8e83-38f399893420" (UID: "f0ce4540-badd-420e-8e83-38f399893420"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.303661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-config-data" (OuterVolumeSpecName: "config-data") pod "f0ce4540-badd-420e-8e83-38f399893420" (UID: "f0ce4540-badd-420e-8e83-38f399893420"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.374962 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.375023 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nccm9\" (UniqueName: \"kubernetes.io/projected/f0ce4540-badd-420e-8e83-38f399893420-kube-api-access-nccm9\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:00 crc kubenswrapper[4769]: I1121 12:27:00.375042 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0ce4540-badd-420e-8e83-38f399893420-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.150371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5b1a8d65-32f5-486e-b01e-5f77f989621b","Type":"ContainerStarted","Data":"ff32259837c555f035ae17f9c7dbc6f2cf65abc18f7a5aed9461682668921b7a"} Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.150406 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.196895 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.196865281 podStartE2EDuration="2.196865281s" podCreationTimestamp="2025-11-21 12:26:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:01.188793484 +0000 UTC m=+2179.889455322" watchObservedRunningTime="2025-11-21 12:27:01.196865281 +0000 UTC m=+2179.897527099" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.216978 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.226266 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.260398 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:01 crc kubenswrapper[4769]: E1121 12:27:01.261175 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-log" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.261209 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-log" Nov 21 12:27:01 crc kubenswrapper[4769]: E1121 12:27:01.261223 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-metadata" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.261229 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-metadata" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.261429 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-metadata" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.261459 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0ce4540-badd-420e-8e83-38f399893420" containerName="nova-metadata-log" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.262542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.266480 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.267332 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.268795 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.303138 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ce4540-badd-420e-8e83-38f399893420" path="/var/lib/kubelet/pods/f0ce4540-badd-420e-8e83-38f399893420/volumes" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.393574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.393661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdv89\" (UniqueName: \"kubernetes.io/projected/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-kube-api-access-wdv89\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.393705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-config-data\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.393753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-logs\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.393850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.495880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.495963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.495991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wdv89\" (UniqueName: \"kubernetes.io/projected/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-kube-api-access-wdv89\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.496021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-config-data\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.496049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-logs\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.496521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-logs\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.501577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.501827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.503180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-config-data\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.516934 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdv89\" (UniqueName: \"kubernetes.io/projected/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-kube-api-access-wdv89\") pod \"nova-metadata-0\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:01 crc kubenswrapper[4769]: I1121 12:27:01.586763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:02 crc kubenswrapper[4769]: I1121 12:27:02.033626 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:02 crc kubenswrapper[4769]: I1121 12:27:02.161376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e","Type":"ContainerStarted","Data":"adba2a72da28d7c5729dd8a1cb7d13f492358a897b28c6273fbdd49d72c28edd"} Nov 21 12:27:03 crc kubenswrapper[4769]: I1121 12:27:03.172241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e","Type":"ContainerStarted","Data":"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e"} Nov 21 12:27:03 crc kubenswrapper[4769]: I1121 12:27:03.172812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e","Type":"ContainerStarted","Data":"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361"} Nov 21 12:27:03 crc kubenswrapper[4769]: I1121 12:27:03.198951 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.198926999 podStartE2EDuration="2.198926999s" podCreationTimestamp="2025-11-21 12:27:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:03.196789172 +0000 UTC m=+2181.897450990" watchObservedRunningTime="2025-11-21 12:27:03.198926999 +0000 UTC m=+2181.899588817" Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.184004 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c6c82f0-38b6-4948-b467-6d176d2072d4" containerID="40d42ea9cdce4f803f1500c48021d39f0a3cdff2402fa9bd323bfdd692284b29" exitCode=0 Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.184105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" event={"ID":"6c6c82f0-38b6-4948-b467-6d176d2072d4","Type":"ContainerDied","Data":"40d42ea9cdce4f803f1500c48021d39f0a3cdff2402fa9bd323bfdd692284b29"} Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.323434 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.323485 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.523545 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.540698 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:04 crc kubenswrapper[4769]: I1121 12:27:04.578567 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.244366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.409685 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.122:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.410294 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.122:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.605343 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.676843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-config-data\") pod \"6c6c82f0-38b6-4948-b467-6d176d2072d4\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.676947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-combined-ca-bundle\") pod \"6c6c82f0-38b6-4948-b467-6d176d2072d4\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.677748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjw2r\" (UniqueName: \"kubernetes.io/projected/6c6c82f0-38b6-4948-b467-6d176d2072d4-kube-api-access-jjw2r\") pod \"6c6c82f0-38b6-4948-b467-6d176d2072d4\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.678268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-scripts\") pod \"6c6c82f0-38b6-4948-b467-6d176d2072d4\" (UID: \"6c6c82f0-38b6-4948-b467-6d176d2072d4\") " Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.682313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c6c82f0-38b6-4948-b467-6d176d2072d4-kube-api-access-jjw2r" (OuterVolumeSpecName: "kube-api-access-jjw2r") pod "6c6c82f0-38b6-4948-b467-6d176d2072d4" (UID: "6c6c82f0-38b6-4948-b467-6d176d2072d4"). InnerVolumeSpecName "kube-api-access-jjw2r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.682402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-scripts" (OuterVolumeSpecName: "scripts") pod "6c6c82f0-38b6-4948-b467-6d176d2072d4" (UID: "6c6c82f0-38b6-4948-b467-6d176d2072d4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.704900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6c6c82f0-38b6-4948-b467-6d176d2072d4" (UID: "6c6c82f0-38b6-4948-b467-6d176d2072d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.708535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-config-data" (OuterVolumeSpecName: "config-data") pod "6c6c82f0-38b6-4948-b467-6d176d2072d4" (UID: "6c6c82f0-38b6-4948-b467-6d176d2072d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.780638 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.780676 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.780694 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c6c82f0-38b6-4948-b467-6d176d2072d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:05 crc kubenswrapper[4769]: I1121 12:27:05.780712 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jjw2r\" (UniqueName: \"kubernetes.io/projected/6c6c82f0-38b6-4948-b467-6d176d2072d4-kube-api-access-jjw2r\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.205930 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.205977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp" event={"ID":"6c6c82f0-38b6-4948-b467-6d176d2072d4","Type":"ContainerDied","Data":"a69290929be3979f2693fdf2c2918e8ef1ac4395ea4490372168398d8e752048"} Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.206006 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a69290929be3979f2693fdf2c2918e8ef1ac4395ea4490372168398d8e752048" Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.396440 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.396675 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-log" containerID="cri-o://82378b795529616c9fa5b7d1428eb2a7cd9b5b9bd8495acbf79b943a75ab0ff7" gracePeriod=30 Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.397959 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-api" containerID="cri-o://b29033df109247fbc57ee2fd0c7a8d7c2f07f2b5f5e3e11a04091d481f0661c2" gracePeriod=30 Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.427246 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.474745 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.475018 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-log" containerID="cri-o://70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361" gracePeriod=30 Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.475494 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-metadata" containerID="cri-o://855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e" gracePeriod=30 Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.587351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:06 crc kubenswrapper[4769]: I1121 12:27:06.587404 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.085961 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.206571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-config-data\") pod \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.206648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-combined-ca-bundle\") pod \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.206767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-logs\") pod \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.206814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-nova-metadata-tls-certs\") pod \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.206845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdv89\" (UniqueName: \"kubernetes.io/projected/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-kube-api-access-wdv89\") pod \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\" (UID: \"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e\") " Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.208310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-logs" (OuterVolumeSpecName: "logs") pod "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" (UID: "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.214513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-kube-api-access-wdv89" (OuterVolumeSpecName: "kube-api-access-wdv89") pod "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" (UID: "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e"). InnerVolumeSpecName "kube-api-access-wdv89". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.233883 4769 generic.go:334] "Generic (PLEG): container finished" podID="66196036-c54b-4f10-861c-d3976bedbb49" containerID="82378b795529616c9fa5b7d1428eb2a7cd9b5b9bd8495acbf79b943a75ab0ff7" exitCode=143 Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.233961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"66196036-c54b-4f10-861c-d3976bedbb49","Type":"ContainerDied","Data":"82378b795529616c9fa5b7d1428eb2a7cd9b5b9bd8495acbf79b943a75ab0ff7"} Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.236697 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" (UID: "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.237632 4769 generic.go:334] "Generic (PLEG): container finished" podID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerID="855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e" exitCode=0 Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.237656 4769 generic.go:334] "Generic (PLEG): container finished" podID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerID="70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361" exitCode=143 Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.237837 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="845729de-0508-4a1f-8a60-f28742942a79" containerName="nova-scheduler-scheduler" containerID="cri-o://9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7" gracePeriod=30 Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.238309 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.238774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e","Type":"ContainerDied","Data":"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e"} Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.238801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e","Type":"ContainerDied","Data":"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361"} Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.238812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e","Type":"ContainerDied","Data":"adba2a72da28d7c5729dd8a1cb7d13f492358a897b28c6273fbdd49d72c28edd"} Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.238827 4769 scope.go:117] "RemoveContainer" containerID="855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.248343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-config-data" (OuterVolumeSpecName: "config-data") pod "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" (UID: "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.289747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" (UID: "c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.296170 4769 scope.go:117] "RemoveContainer" containerID="70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.309669 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.309744 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.309763 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wdv89\" (UniqueName: \"kubernetes.io/projected/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-kube-api-access-wdv89\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.309778 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.309819 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.317427 4769 scope.go:117] "RemoveContainer" containerID="855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e" Nov 21 12:27:07 crc kubenswrapper[4769]: E1121 12:27:07.317885 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e\": container with ID starting with 855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e not found: ID does not exist" containerID="855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.317924 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e"} err="failed to get container status \"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e\": rpc error: code = NotFound desc = could not find container \"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e\": container with ID starting with 855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e not found: ID does not exist" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.317954 4769 scope.go:117] "RemoveContainer" containerID="70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361" Nov 21 12:27:07 crc kubenswrapper[4769]: E1121 12:27:07.318268 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361\": container with ID starting with 70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361 not found: ID does not exist" containerID="70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.318298 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361"} err="failed to get container status \"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361\": rpc error: code = NotFound desc = could not find container \"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361\": container with ID starting with 70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361 not found: ID does not exist" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.318315 4769 scope.go:117] "RemoveContainer" containerID="855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.318543 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e"} err="failed to get container status \"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e\": rpc error: code = NotFound desc = could not find container \"855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e\": container with ID starting with 855a01284d198fdbafc218ac0d742e3997dc9564ec844499bb07eac6ac5c512e not found: ID does not exist" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.318565 4769 scope.go:117] "RemoveContainer" containerID="70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.318829 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361"} err="failed to get container status \"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361\": rpc error: code = NotFound desc = could not find container \"70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361\": container with ID starting with 70874f7233319814dae98b954fec4b8b7108e8b4dbbd5aa7231537e33ccbe361 not found: ID does not exist" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.581725 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.594083 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.609345 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:07 crc kubenswrapper[4769]: E1121 12:27:07.610961 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-metadata" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.610997 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-metadata" Nov 21 12:27:07 crc kubenswrapper[4769]: E1121 12:27:07.611028 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c6c82f0-38b6-4948-b467-6d176d2072d4" containerName="nova-manage" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.611036 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c6c82f0-38b6-4948-b467-6d176d2072d4" containerName="nova-manage" Nov 21 12:27:07 crc kubenswrapper[4769]: E1121 12:27:07.611069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-log" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.611076 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-log" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.611289 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-log" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.611312 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" containerName="nova-metadata-metadata" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.611329 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c6c82f0-38b6-4948-b467-6d176d2072d4" containerName="nova-manage" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.612473 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.614492 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.615605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.626163 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.716004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df83c394-312c-46e1-baf8-4b9ee16c39ca-logs\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.716246 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-config-data\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.716384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd7sw\" (UniqueName: \"kubernetes.io/projected/df83c394-312c-46e1-baf8-4b9ee16c39ca-kube-api-access-xd7sw\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.716418 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.716525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.818307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df83c394-312c-46e1-baf8-4b9ee16c39ca-logs\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.818426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-config-data\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.818477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xd7sw\" (UniqueName: \"kubernetes.io/projected/df83c394-312c-46e1-baf8-4b9ee16c39ca-kube-api-access-xd7sw\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.818499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.818539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.818817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df83c394-312c-46e1-baf8-4b9ee16c39ca-logs\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.822381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.822452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-config-data\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.828245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.835652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd7sw\" (UniqueName: \"kubernetes.io/projected/df83c394-312c-46e1-baf8-4b9ee16c39ca-kube-api-access-xd7sw\") pod \"nova-metadata-0\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:07 crc kubenswrapper[4769]: I1121 12:27:07.931222 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:08 crc kubenswrapper[4769]: I1121 12:27:08.368010 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.259596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df83c394-312c-46e1-baf8-4b9ee16c39ca","Type":"ContainerStarted","Data":"cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834"} Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.260152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df83c394-312c-46e1-baf8-4b9ee16c39ca","Type":"ContainerStarted","Data":"6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2"} Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.260171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df83c394-312c-46e1-baf8-4b9ee16c39ca","Type":"ContainerStarted","Data":"4783619fc3e282faa955814bcd13fa8e0f02a5669eade77583132a6990a833e5"} Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.285921 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.285894415 podStartE2EDuration="2.285894415s" podCreationTimestamp="2025-11-21 12:27:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:09.281541198 +0000 UTC m=+2187.982203016" watchObservedRunningTime="2025-11-21 12:27:09.285894415 +0000 UTC m=+2187.986556243" Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.291281 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e" path="/var/lib/kubelet/pods/c46f9ed7-381a-4b5e-8f2e-06dbf33afc4e/volumes" Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.523069 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:27:09 crc kubenswrapper[4769]: E1121 12:27:09.543299 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:09 crc kubenswrapper[4769]: E1121 12:27:09.545070 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:09 crc kubenswrapper[4769]: I1121 12:27:09.546021 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:27:09 crc kubenswrapper[4769]: E1121 12:27:09.547964 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:09 crc kubenswrapper[4769]: E1121 12:27:09.548006 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="845729de-0508-4a1f-8a60-f28742942a79" containerName="nova-scheduler-scheduler" Nov 21 12:27:10 crc kubenswrapper[4769]: I1121 12:27:10.292273 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:27:11 crc kubenswrapper[4769]: I1121 12:27:11.285369 4769 generic.go:334] "Generic (PLEG): container finished" podID="66196036-c54b-4f10-861c-d3976bedbb49" containerID="b29033df109247fbc57ee2fd0c7a8d7c2f07f2b5f5e3e11a04091d481f0661c2" exitCode=0 Nov 21 12:27:11 crc kubenswrapper[4769]: I1121 12:27:11.285954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"66196036-c54b-4f10-861c-d3976bedbb49","Type":"ContainerDied","Data":"b29033df109247fbc57ee2fd0c7a8d7c2f07f2b5f5e3e11a04091d481f0661c2"} Nov 21 12:27:11 crc kubenswrapper[4769]: I1121 12:27:11.911883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.004281 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66196036-c54b-4f10-861c-d3976bedbb49-logs\") pod \"66196036-c54b-4f10-861c-d3976bedbb49\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.004496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-config-data\") pod \"66196036-c54b-4f10-861c-d3976bedbb49\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.004519 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2tnc\" (UniqueName: \"kubernetes.io/projected/66196036-c54b-4f10-861c-d3976bedbb49-kube-api-access-m2tnc\") pod \"66196036-c54b-4f10-861c-d3976bedbb49\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.004632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-combined-ca-bundle\") pod \"66196036-c54b-4f10-861c-d3976bedbb49\" (UID: \"66196036-c54b-4f10-861c-d3976bedbb49\") " Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.005112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66196036-c54b-4f10-861c-d3976bedbb49-logs" (OuterVolumeSpecName: "logs") pod "66196036-c54b-4f10-861c-d3976bedbb49" (UID: "66196036-c54b-4f10-861c-d3976bedbb49"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.005532 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/66196036-c54b-4f10-861c-d3976bedbb49-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.010447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66196036-c54b-4f10-861c-d3976bedbb49-kube-api-access-m2tnc" (OuterVolumeSpecName: "kube-api-access-m2tnc") pod "66196036-c54b-4f10-861c-d3976bedbb49" (UID: "66196036-c54b-4f10-861c-d3976bedbb49"). InnerVolumeSpecName "kube-api-access-m2tnc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.032761 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-config-data" (OuterVolumeSpecName: "config-data") pod "66196036-c54b-4f10-861c-d3976bedbb49" (UID: "66196036-c54b-4f10-861c-d3976bedbb49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.062705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66196036-c54b-4f10-861c-d3976bedbb49" (UID: "66196036-c54b-4f10-861c-d3976bedbb49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.108982 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.109041 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66196036-c54b-4f10-861c-d3976bedbb49-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.109059 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m2tnc\" (UniqueName: \"kubernetes.io/projected/66196036-c54b-4f10-861c-d3976bedbb49-kube-api-access-m2tnc\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.306586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"66196036-c54b-4f10-861c-d3976bedbb49","Type":"ContainerDied","Data":"66495b30449d80f4cc624577c7114c344c22c00f7ffee17e04e003b0f8159b12"} Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.306655 4769 scope.go:117] "RemoveContainer" containerID="b29033df109247fbc57ee2fd0c7a8d7c2f07f2b5f5e3e11a04091d481f0661c2" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.306661 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.338572 4769 scope.go:117] "RemoveContainer" containerID="82378b795529616c9fa5b7d1428eb2a7cd9b5b9bd8495acbf79b943a75ab0ff7" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.357153 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.374030 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.383568 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:12 crc kubenswrapper[4769]: E1121 12:27:12.384034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-log" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.384057 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-log" Nov 21 12:27:12 crc kubenswrapper[4769]: E1121 12:27:12.384085 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-api" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.384091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-api" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.384299 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-log" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.384323 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66196036-c54b-4f10-861c-d3976bedbb49" containerName="nova-api-api" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.385590 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.388489 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.423499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.423561 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cad6fe-868a-49e2-a759-fbfd751b2167-logs\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.423784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-config-data\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.423819 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjd5\" (UniqueName: \"kubernetes.io/projected/70cad6fe-868a-49e2-a759-fbfd751b2167-kube-api-access-5xjd5\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.424460 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.526207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-config-data\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.526271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjd5\" (UniqueName: \"kubernetes.io/projected/70cad6fe-868a-49e2-a759-fbfd751b2167-kube-api-access-5xjd5\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.526433 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.526467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cad6fe-868a-49e2-a759-fbfd751b2167-logs\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.527064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cad6fe-868a-49e2-a759-fbfd751b2167-logs\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.531156 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.538601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-config-data\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.550002 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjd5\" (UniqueName: \"kubernetes.io/projected/70cad6fe-868a-49e2-a759-fbfd751b2167-kube-api-access-5xjd5\") pod \"nova-api-0\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.714447 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.931456 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:12 crc kubenswrapper[4769]: I1121 12:27:12.931881 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.247566 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.286695 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66196036-c54b-4f10-861c-d3976bedbb49" path="/var/lib/kubelet/pods/66196036-c54b-4f10-861c-d3976bedbb49/volumes" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.359954 4769 generic.go:334] "Generic (PLEG): container finished" podID="845729de-0508-4a1f-8a60-f28742942a79" containerID="9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7" exitCode=0 Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.360134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"845729de-0508-4a1f-8a60-f28742942a79","Type":"ContainerDied","Data":"9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7"} Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.385793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70cad6fe-868a-49e2-a759-fbfd751b2167","Type":"ContainerStarted","Data":"1251aca373f6e2e3ea5c83d08d0e5e9f74a9edbae72e120351ade1ed514c4941"} Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.533826 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.567245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-config-data\") pod \"845729de-0508-4a1f-8a60-f28742942a79\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.568140 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnsk4\" (UniqueName: \"kubernetes.io/projected/845729de-0508-4a1f-8a60-f28742942a79-kube-api-access-mnsk4\") pod \"845729de-0508-4a1f-8a60-f28742942a79\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.568201 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-combined-ca-bundle\") pod \"845729de-0508-4a1f-8a60-f28742942a79\" (UID: \"845729de-0508-4a1f-8a60-f28742942a79\") " Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.579039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845729de-0508-4a1f-8a60-f28742942a79-kube-api-access-mnsk4" (OuterVolumeSpecName: "kube-api-access-mnsk4") pod "845729de-0508-4a1f-8a60-f28742942a79" (UID: "845729de-0508-4a1f-8a60-f28742942a79"). InnerVolumeSpecName "kube-api-access-mnsk4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.604306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "845729de-0508-4a1f-8a60-f28742942a79" (UID: "845729de-0508-4a1f-8a60-f28742942a79"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.610137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-config-data" (OuterVolumeSpecName: "config-data") pod "845729de-0508-4a1f-8a60-f28742942a79" (UID: "845729de-0508-4a1f-8a60-f28742942a79"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.670764 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mnsk4\" (UniqueName: \"kubernetes.io/projected/845729de-0508-4a1f-8a60-f28742942a79-kube-api-access-mnsk4\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.670803 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:13 crc kubenswrapper[4769]: I1121 12:27:13.670813 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845729de-0508-4a1f-8a60-f28742942a79-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.298941 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.408890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70cad6fe-868a-49e2-a759-fbfd751b2167","Type":"ContainerStarted","Data":"a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55"} Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.409438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70cad6fe-868a-49e2-a759-fbfd751b2167","Type":"ContainerStarted","Data":"ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca"} Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.412309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"845729de-0508-4a1f-8a60-f28742942a79","Type":"ContainerDied","Data":"2c557288b3e02dc7a403c4721105480fd4c0bbc509aaf5098c51ea0dc93dda40"} Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.412346 4769 scope.go:117] "RemoveContainer" containerID="9b2d6e6eaddbb492500c866e0be65d79f8e4ed9249141e6b6d077b1b29adeae7" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.412482 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.489841 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.500478 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.513540 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:14 crc kubenswrapper[4769]: E1121 12:27:14.514066 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="845729de-0508-4a1f-8a60-f28742942a79" containerName="nova-scheduler-scheduler" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.514097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="845729de-0508-4a1f-8a60-f28742942a79" containerName="nova-scheduler-scheduler" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.514400 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="845729de-0508-4a1f-8a60-f28742942a79" containerName="nova-scheduler-scheduler" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.515390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.519514 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.521722 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:14 crc kubenswrapper[4769]: E1121 12:27:14.589389 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod845729de_0508_4a1f_8a60_f28742942a79.slice\": RecentStats: unable to find data in memory cache]" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.592730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.592819 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75m5\" (UniqueName: \"kubernetes.io/projected/3ddab37e-4182-41f0-a79b-68e453823128-kube-api-access-m75m5\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.592893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-config-data\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.698562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.698735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m75m5\" (UniqueName: \"kubernetes.io/projected/3ddab37e-4182-41f0-a79b-68e453823128-kube-api-access-m75m5\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.698937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-config-data\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.716129 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-config-data\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.718544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.724592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75m5\" (UniqueName: \"kubernetes.io/projected/3ddab37e-4182-41f0-a79b-68e453823128-kube-api-access-m75m5\") pod \"nova-scheduler-0\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:14 crc kubenswrapper[4769]: I1121 12:27:14.835955 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:15 crc kubenswrapper[4769]: I1121 12:27:15.294123 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845729de-0508-4a1f-8a60-f28742942a79" path="/var/lib/kubelet/pods/845729de-0508-4a1f-8a60-f28742942a79/volumes" Nov 21 12:27:15 crc kubenswrapper[4769]: I1121 12:27:15.441864 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.441840024 podStartE2EDuration="3.441840024s" podCreationTimestamp="2025-11-21 12:27:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:15.437627031 +0000 UTC m=+2194.138288849" watchObservedRunningTime="2025-11-21 12:27:15.441840024 +0000 UTC m=+2194.142501842" Nov 21 12:27:15 crc kubenswrapper[4769]: I1121 12:27:15.573696 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:16 crc kubenswrapper[4769]: I1121 12:27:16.445312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ddab37e-4182-41f0-a79b-68e453823128","Type":"ContainerStarted","Data":"33d36a624012934f6bae0569ee11d4a2b582060886e262ac432141009471f03c"} Nov 21 12:27:17 crc kubenswrapper[4769]: I1121 12:27:17.456355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ddab37e-4182-41f0-a79b-68e453823128","Type":"ContainerStarted","Data":"ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa"} Nov 21 12:27:17 crc kubenswrapper[4769]: I1121 12:27:17.472476 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.472439449 podStartE2EDuration="3.472439449s" podCreationTimestamp="2025-11-21 12:27:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:17.471842023 +0000 UTC m=+2196.172503861" watchObservedRunningTime="2025-11-21 12:27:17.472439449 +0000 UTC m=+2196.173101267" Nov 21 12:27:17 crc kubenswrapper[4769]: I1121 12:27:17.932344 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:17 crc kubenswrapper[4769]: I1121 12:27:17.932885 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:18 crc kubenswrapper[4769]: I1121 12:27:18.582980 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:27:18 crc kubenswrapper[4769]: I1121 12:27:18.583230 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" containerName="kube-state-metrics" containerID="cri-o://aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c" gracePeriod=30 Nov 21 12:27:18 crc kubenswrapper[4769]: I1121 12:27:18.983485 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.129:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:27:18 crc kubenswrapper[4769]: I1121 12:27:18.983499 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.129:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.095033 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.185964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4plr\" (UniqueName: \"kubernetes.io/projected/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9-kube-api-access-h4plr\") pod \"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9\" (UID: \"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9\") " Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.191313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9-kube-api-access-h4plr" (OuterVolumeSpecName: "kube-api-access-h4plr") pod "d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" (UID: "d4a0e877-1ea0-4fc6-8033-f25ca3d799e9"). InnerVolumeSpecName "kube-api-access-h4plr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.288250 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h4plr\" (UniqueName: \"kubernetes.io/projected/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9-kube-api-access-h4plr\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.475129 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" containerID="aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c" exitCode=2 Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.475231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9","Type":"ContainerDied","Data":"aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c"} Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.475266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d4a0e877-1ea0-4fc6-8033-f25ca3d799e9","Type":"ContainerDied","Data":"6bc58a7052d8fc4098c8b2d0d9d954c39472a3b5412afd4f4badfda44ac96add"} Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.475285 4769 scope.go:117] "RemoveContainer" containerID="aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.475467 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.513914 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.530487 4769 scope.go:117] "RemoveContainer" containerID="aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.533017 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:27:19 crc kubenswrapper[4769]: E1121 12:27:19.542899 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c\": container with ID starting with aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c not found: ID does not exist" containerID="aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.543298 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c"} err="failed to get container status \"aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c\": rpc error: code = NotFound desc = could not find container \"aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c\": container with ID starting with aebaac63ac37442158c61813b5ac53046ed721be4c735b4cc4099fa9dbb1523c not found: ID does not exist" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.544410 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:27:19 crc kubenswrapper[4769]: E1121 12:27:19.545254 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" containerName="kube-state-metrics" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.545411 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" containerName="kube-state-metrics" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.545889 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" containerName="kube-state-metrics" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.546844 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.550512 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.551413 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.553038 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.695586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.696587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.696676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45kfx\" (UniqueName: \"kubernetes.io/projected/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-api-access-45kfx\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.696809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.798118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.798219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-45kfx\" (UniqueName: \"kubernetes.io/projected/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-api-access-45kfx\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.798271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.798343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.805029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.805057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.805660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.820955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-45kfx\" (UniqueName: \"kubernetes.io/projected/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-api-access-45kfx\") pod \"kube-state-metrics-0\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.836817 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:19 crc kubenswrapper[4769]: I1121 12:27:19.874472 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.370645 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.444347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.444720 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-central-agent" containerID="cri-o://f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43" gracePeriod=30 Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.444848 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="sg-core" containerID="cri-o://112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba" gracePeriod=30 Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.444892 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-notification-agent" containerID="cri-o://9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745" gracePeriod=30 Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.445136 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="proxy-httpd" containerID="cri-o://d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19" gracePeriod=30 Nov 21 12:27:20 crc kubenswrapper[4769]: I1121 12:27:20.486416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a614f405-9af6-4df3-b4ee-b062bd73077d","Type":"ContainerStarted","Data":"fd37ddb34c8b74e6364767600f4fbe2e804940b87328c8e6899c894f38fe9bbb"} Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.283469 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a0e877-1ea0-4fc6-8033-f25ca3d799e9" path="/var/lib/kubelet/pods/d4a0e877-1ea0-4fc6-8033-f25ca3d799e9/volumes" Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.501386 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerID="d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19" exitCode=0 Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.501417 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerID="112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba" exitCode=2 Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.501426 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerID="f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43" exitCode=0 Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.501409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerDied","Data":"d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19"} Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.501456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerDied","Data":"112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba"} Nov 21 12:27:21 crc kubenswrapper[4769]: I1121 12:27:21.501467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerDied","Data":"f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43"} Nov 21 12:27:22 crc kubenswrapper[4769]: I1121 12:27:22.518718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a614f405-9af6-4df3-b4ee-b062bd73077d","Type":"ContainerStarted","Data":"623848f9cf899442b90e26f118e5fe734ca71879282ecb184d2712f04fac5eca"} Nov 21 12:27:22 crc kubenswrapper[4769]: I1121 12:27:22.519314 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:22 crc kubenswrapper[4769]: I1121 12:27:22.541780 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.868589777 podStartE2EDuration="3.541756794s" podCreationTimestamp="2025-11-21 12:27:19 +0000 UTC" firstStartedPulling="2025-11-21 12:27:20.375397192 +0000 UTC m=+2199.076059010" lastFinishedPulling="2025-11-21 12:27:22.048564199 +0000 UTC m=+2200.749226027" observedRunningTime="2025-11-21 12:27:22.535673111 +0000 UTC m=+2201.236334939" watchObservedRunningTime="2025-11-21 12:27:22.541756794 +0000 UTC m=+2201.242418612" Nov 21 12:27:22 crc kubenswrapper[4769]: I1121 12:27:22.715707 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:22 crc kubenswrapper[4769]: I1121 12:27:22.715760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.246161 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.396954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn7nj\" (UniqueName: \"kubernetes.io/projected/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-kube-api-access-rn7nj\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.397005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-config-data\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.397060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-run-httpd\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.397091 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-scripts\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.397120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-combined-ca-bundle\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.397162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-sg-core-conf-yaml\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.397424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-log-httpd\") pod \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\" (UID: \"fd4ce1f5-b46c-4a32-a881-0def1f81a16c\") " Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.398027 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.398274 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.398544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.405522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-scripts" (OuterVolumeSpecName: "scripts") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.408379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-kube-api-access-rn7nj" (OuterVolumeSpecName: "kube-api-access-rn7nj") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "kube-api-access-rn7nj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.442465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.500418 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rn7nj\" (UniqueName: \"kubernetes.io/projected/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-kube-api-access-rn7nj\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.500801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.501896 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.501936 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.501945 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.518698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-config-data" (OuterVolumeSpecName: "config-data") pod "fd4ce1f5-b46c-4a32-a881-0def1f81a16c" (UID: "fd4ce1f5-b46c-4a32-a881-0def1f81a16c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.533431 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerID="9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745" exitCode=0 Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.533482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerDied","Data":"9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745"} Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.533549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"fd4ce1f5-b46c-4a32-a881-0def1f81a16c","Type":"ContainerDied","Data":"17ccaf1538de52bdd56eaa14795fb4162707daaee0d0622d038c332fbdf13848"} Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.533567 4769 scope.go:117] "RemoveContainer" containerID="d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.533699 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.577859 4769 scope.go:117] "RemoveContainer" containerID="112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.599349 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.604461 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.605793 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd4ce1f5-b46c-4a32-a881-0def1f81a16c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.620609 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.624906 4769 scope.go:117] "RemoveContainer" containerID="9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.632567 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.633164 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-central-agent" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633186 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-central-agent" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.633221 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="sg-core" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633228 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="sg-core" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.633244 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="proxy-httpd" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633251 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="proxy-httpd" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.633280 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-notification-agent" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633286 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-notification-agent" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633582 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="sg-core" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633614 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-notification-agent" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633632 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="proxy-httpd" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.633642 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" containerName="ceilometer-central-agent" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.639120 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.643442 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.643777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.643999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.649230 4769 scope.go:117] "RemoveContainer" containerID="f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.663380 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.708746 4769 scope.go:117] "RemoveContainer" containerID="d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.710917 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19\": container with ID starting with d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19 not found: ID does not exist" containerID="d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.711017 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19"} err="failed to get container status \"d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19\": rpc error: code = NotFound desc = could not find container \"d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19\": container with ID starting with d0dfe026f7c4876f4fdabf3b8ff8cd26e3423c9341a2636bf8fcd540911b9b19 not found: ID does not exist" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.711086 4769 scope.go:117] "RemoveContainer" containerID="112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.711638 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba\": container with ID starting with 112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba not found: ID does not exist" containerID="112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.711687 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba"} err="failed to get container status \"112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba\": rpc error: code = NotFound desc = could not find container \"112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba\": container with ID starting with 112ef973d30b808c5c7aca171eb4d5ad9bc1cc10a97cf516b06aca12aba494ba not found: ID does not exist" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.711724 4769 scope.go:117] "RemoveContainer" containerID="9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.712053 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745\": container with ID starting with 9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745 not found: ID does not exist" containerID="9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.712138 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745"} err="failed to get container status \"9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745\": rpc error: code = NotFound desc = could not find container \"9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745\": container with ID starting with 9c11352f28b3656ed9a4eaa56eba1fc5e1296ded09fbc277bf00d94b94579745 not found: ID does not exist" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.712153 4769 scope.go:117] "RemoveContainer" containerID="f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43" Nov 21 12:27:23 crc kubenswrapper[4769]: E1121 12:27:23.712440 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43\": container with ID starting with f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43 not found: ID does not exist" containerID="f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.712472 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43"} err="failed to get container status \"f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43\": rpc error: code = NotFound desc = could not find container \"f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43\": container with ID starting with f548a3345ae885ecad513604d4f2a0c79c2e506ea9d4b535d644071a580e8e43 not found: ID does not exist" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.757560 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.130:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.799605 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.130:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.813910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjh5j\" (UniqueName: \"kubernetes.io/projected/7dc2fbc7-8d09-4c4c-a021-07393e778d80-kube-api-access-tjh5j\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-scripts\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814245 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-run-httpd\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-log-httpd\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814387 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-config-data\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.814533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.916675 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917675 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tjh5j\" (UniqueName: \"kubernetes.io/projected/7dc2fbc7-8d09-4c4c-a021-07393e778d80-kube-api-access-tjh5j\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-scripts\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-run-httpd\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-log-httpd\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.917924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-config-data\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.918625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-log-httpd\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.918736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-run-httpd\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.922415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.922498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.923879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.925030 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-config-data\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.925704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-scripts\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.940036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjh5j\" (UniqueName: \"kubernetes.io/projected/7dc2fbc7-8d09-4c4c-a021-07393e778d80-kube-api-access-tjh5j\") pod \"ceilometer-0\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:23 crc kubenswrapper[4769]: I1121 12:27:23.977256 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:24 crc kubenswrapper[4769]: I1121 12:27:24.467364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:24 crc kubenswrapper[4769]: W1121 12:27:24.494082 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dc2fbc7_8d09_4c4c_a021_07393e778d80.slice/crio-506c3a013700bc0b6d88c875fad1d46b34b462bf52bb4e9cfc24f73e1aa8b69b WatchSource:0}: Error finding container 506c3a013700bc0b6d88c875fad1d46b34b462bf52bb4e9cfc24f73e1aa8b69b: Status 404 returned error can't find the container with id 506c3a013700bc0b6d88c875fad1d46b34b462bf52bb4e9cfc24f73e1aa8b69b Nov 21 12:27:24 crc kubenswrapper[4769]: I1121 12:27:24.549885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerStarted","Data":"506c3a013700bc0b6d88c875fad1d46b34b462bf52bb4e9cfc24f73e1aa8b69b"} Nov 21 12:27:24 crc kubenswrapper[4769]: I1121 12:27:24.836164 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:24 crc kubenswrapper[4769]: I1121 12:27:24.885920 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:25 crc kubenswrapper[4769]: I1121 12:27:25.289425 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd4ce1f5-b46c-4a32-a881-0def1f81a16c" path="/var/lib/kubelet/pods/fd4ce1f5-b46c-4a32-a881-0def1f81a16c/volumes" Nov 21 12:27:25 crc kubenswrapper[4769]: I1121 12:27:25.566604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerStarted","Data":"be158666898ad3b82e37af929398db9545eb305fae4b1b1b4c395557f43f400c"} Nov 21 12:27:25 crc kubenswrapper[4769]: I1121 12:27:25.602735 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:26 crc kubenswrapper[4769]: I1121 12:27:26.581906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerStarted","Data":"791da8e752897e7ce9cc0905c3626792b98b8a44fff9006a1b6bca799a58b747"} Nov 21 12:27:27 crc kubenswrapper[4769]: I1121 12:27:27.593578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerStarted","Data":"ca0716ff62fb6a78b938d9c81ed737fa2fc4768a89cc25432bf21c070cbdb0b3"} Nov 21 12:27:27 crc kubenswrapper[4769]: I1121 12:27:27.937986 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:27 crc kubenswrapper[4769]: I1121 12:27:27.939935 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:27 crc kubenswrapper[4769]: I1121 12:27:27.944010 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:28 crc kubenswrapper[4769]: I1121 12:27:28.618142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerStarted","Data":"3fcf7887b24457fdf70ecb54882b23bb1a2b7e14672ffa520abd4777ac865a94"} Nov 21 12:27:28 crc kubenswrapper[4769]: I1121 12:27:28.625910 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:28 crc kubenswrapper[4769]: I1121 12:27:28.669388 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.163813098 podStartE2EDuration="5.669364472s" podCreationTimestamp="2025-11-21 12:27:23 +0000 UTC" firstStartedPulling="2025-11-21 12:27:24.497584352 +0000 UTC m=+2203.198246170" lastFinishedPulling="2025-11-21 12:27:28.003135726 +0000 UTC m=+2206.703797544" observedRunningTime="2025-11-21 12:27:28.64256503 +0000 UTC m=+2207.343226848" watchObservedRunningTime="2025-11-21 12:27:28.669364472 +0000 UTC m=+2207.370026280" Nov 21 12:27:29 crc kubenswrapper[4769]: I1121 12:27:29.629941 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:30 crc kubenswrapper[4769]: I1121 12:27:30.203470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:27:30 crc kubenswrapper[4769]: I1121 12:27:30.643971 4769 generic.go:334] "Generic (PLEG): container finished" podID="b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" containerID="37f50ffdbd0f6f408a64594eaa3cf2cfb3abaa80ffa12b6b70c9bb5515267117" exitCode=0 Nov 21 12:27:30 crc kubenswrapper[4769]: I1121 12:27:30.644078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" event={"ID":"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc","Type":"ContainerDied","Data":"37f50ffdbd0f6f408a64594eaa3cf2cfb3abaa80ffa12b6b70c9bb5515267117"} Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.021929 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.090275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-combined-ca-bundle\") pod \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.090385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvgpp\" (UniqueName: \"kubernetes.io/projected/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-kube-api-access-zvgpp\") pod \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.090442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-config-data\") pod \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.090516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-scripts\") pod \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\" (UID: \"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc\") " Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.097695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-kube-api-access-zvgpp" (OuterVolumeSpecName: "kube-api-access-zvgpp") pod "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" (UID: "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc"). InnerVolumeSpecName "kube-api-access-zvgpp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.098182 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-scripts" (OuterVolumeSpecName: "scripts") pod "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" (UID: "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.125882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-config-data" (OuterVolumeSpecName: "config-data") pod "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" (UID: "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.126493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" (UID: "b30e07a1-77d5-4f6b-8a7e-9d9f816182cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.192385 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.192426 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.192438 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zvgpp\" (UniqueName: \"kubernetes.io/projected/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-kube-api-access-zvgpp\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.192447 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.663718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" event={"ID":"b30e07a1-77d5-4f6b-8a7e-9d9f816182cc","Type":"ContainerDied","Data":"13f23aa96afc8b8f0de51568ec15b5f55e6354ca1f933f66274942eaf1f878f7"} Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.663760 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13f23aa96afc8b8f0de51568ec15b5f55e6354ca1f933f66274942eaf1f878f7" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.664030 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.719310 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.719992 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.720220 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.729317 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.749135 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:27:32 crc kubenswrapper[4769]: E1121 12:27:32.749853 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" containerName="nova-cell1-conductor-db-sync" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.749943 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" containerName="nova-cell1-conductor-db-sync" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.750513 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" containerName="nova-cell1-conductor-db-sync" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.751545 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.753713 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.774448 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.909009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.909158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmv4g\" (UniqueName: \"kubernetes.io/projected/07afcc28-4336-44c0-b1b1-3a741b6f6b65-kube-api-access-zmv4g\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:32 crc kubenswrapper[4769]: I1121 12:27:32.909293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.010786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.010912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.011005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zmv4g\" (UniqueName: \"kubernetes.io/projected/07afcc28-4336-44c0-b1b1-3a741b6f6b65-kube-api-access-zmv4g\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.025506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.025887 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.028460 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmv4g\" (UniqueName: \"kubernetes.io/projected/07afcc28-4336-44c0-b1b1-3a741b6f6b65-kube-api-access-zmv4g\") pod \"nova-cell1-conductor-0\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.068653 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:33 crc kubenswrapper[4769]: W1121 12:27:33.508367 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07afcc28_4336_44c0_b1b1_3a741b6f6b65.slice/crio-7d89f07ec97ea3bfb90f858c89b94779e8c60025efb608ff28d460a165d7136b WatchSource:0}: Error finding container 7d89f07ec97ea3bfb90f858c89b94779e8c60025efb608ff28d460a165d7136b: Status 404 returned error can't find the container with id 7d89f07ec97ea3bfb90f858c89b94779e8c60025efb608ff28d460a165d7136b Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.509066 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.676048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07afcc28-4336-44c0-b1b1-3a741b6f6b65","Type":"ContainerStarted","Data":"7d89f07ec97ea3bfb90f858c89b94779e8c60025efb608ff28d460a165d7136b"} Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.676156 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:33 crc kubenswrapper[4769]: I1121 12:27:33.679453 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:34 crc kubenswrapper[4769]: I1121 12:27:34.686857 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07afcc28-4336-44c0-b1b1-3a741b6f6b65","Type":"ContainerStarted","Data":"79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a"} Nov 21 12:27:34 crc kubenswrapper[4769]: I1121 12:27:34.715800 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.715775599 podStartE2EDuration="2.715775599s" podCreationTimestamp="2025-11-21 12:27:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:34.713168098 +0000 UTC m=+2213.413829936" watchObservedRunningTime="2025-11-21 12:27:34.715775599 +0000 UTC m=+2213.416437417" Nov 21 12:27:35 crc kubenswrapper[4769]: I1121 12:27:35.700389 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:35 crc kubenswrapper[4769]: I1121 12:27:35.701041 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-central-agent" containerID="cri-o://be158666898ad3b82e37af929398db9545eb305fae4b1b1b4c395557f43f400c" gracePeriod=30 Nov 21 12:27:35 crc kubenswrapper[4769]: I1121 12:27:35.701085 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="sg-core" containerID="cri-o://ca0716ff62fb6a78b938d9c81ed737fa2fc4768a89cc25432bf21c070cbdb0b3" gracePeriod=30 Nov 21 12:27:35 crc kubenswrapper[4769]: I1121 12:27:35.701101 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="proxy-httpd" containerID="cri-o://3fcf7887b24457fdf70ecb54882b23bb1a2b7e14672ffa520abd4777ac865a94" gracePeriod=30 Nov 21 12:27:35 crc kubenswrapper[4769]: I1121 12:27:35.701085 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-notification-agent" containerID="cri-o://791da8e752897e7ce9cc0905c3626792b98b8a44fff9006a1b6bca799a58b747" gracePeriod=30 Nov 21 12:27:35 crc kubenswrapper[4769]: I1121 12:27:35.704067 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.439871 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716072 4769 generic.go:334] "Generic (PLEG): container finished" podID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerID="3fcf7887b24457fdf70ecb54882b23bb1a2b7e14672ffa520abd4777ac865a94" exitCode=0 Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716106 4769 generic.go:334] "Generic (PLEG): container finished" podID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerID="ca0716ff62fb6a78b938d9c81ed737fa2fc4768a89cc25432bf21c070cbdb0b3" exitCode=2 Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716114 4769 generic.go:334] "Generic (PLEG): container finished" podID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerID="791da8e752897e7ce9cc0905c3626792b98b8a44fff9006a1b6bca799a58b747" exitCode=0 Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716123 4769 generic.go:334] "Generic (PLEG): container finished" podID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerID="be158666898ad3b82e37af929398db9545eb305fae4b1b1b4c395557f43f400c" exitCode=0 Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerDied","Data":"3fcf7887b24457fdf70ecb54882b23bb1a2b7e14672ffa520abd4777ac865a94"} Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerDied","Data":"ca0716ff62fb6a78b938d9c81ed737fa2fc4768a89cc25432bf21c070cbdb0b3"} Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerDied","Data":"791da8e752897e7ce9cc0905c3626792b98b8a44fff9006a1b6bca799a58b747"} Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerDied","Data":"be158666898ad3b82e37af929398db9545eb305fae4b1b1b4c395557f43f400c"} Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.716567 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-log" containerID="cri-o://ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca" gracePeriod=30 Nov 21 12:27:36 crc kubenswrapper[4769]: I1121 12:27:36.717083 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-api" containerID="cri-o://a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55" gracePeriod=30 Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.040170 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.199581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjh5j\" (UniqueName: \"kubernetes.io/projected/7dc2fbc7-8d09-4c4c-a021-07393e778d80-kube-api-access-tjh5j\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.199929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-config-data\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-run-httpd\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-ceilometer-tls-certs\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-log-httpd\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-scripts\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-sg-core-conf-yaml\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-combined-ca-bundle\") pod \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\" (UID: \"7dc2fbc7-8d09-4c4c-a021-07393e778d80\") " Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.200756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.201293 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.201319 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7dc2fbc7-8d09-4c4c-a021-07393e778d80-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.219440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-scripts" (OuterVolumeSpecName: "scripts") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.219628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc2fbc7-8d09-4c4c-a021-07393e778d80-kube-api-access-tjh5j" (OuterVolumeSpecName: "kube-api-access-tjh5j") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "kube-api-access-tjh5j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.240613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.289871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.304830 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.304918 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.304931 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.304941 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tjh5j\" (UniqueName: \"kubernetes.io/projected/7dc2fbc7-8d09-4c4c-a021-07393e778d80-kube-api-access-tjh5j\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.305690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.343942 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-config-data" (OuterVolumeSpecName: "config-data") pod "7dc2fbc7-8d09-4c4c-a021-07393e778d80" (UID: "7dc2fbc7-8d09-4c4c-a021-07393e778d80"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.406844 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.406883 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7dc2fbc7-8d09-4c4c-a021-07393e778d80-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.731251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7dc2fbc7-8d09-4c4c-a021-07393e778d80","Type":"ContainerDied","Data":"506c3a013700bc0b6d88c875fad1d46b34b462bf52bb4e9cfc24f73e1aa8b69b"} Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.731274 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.733152 4769 scope.go:117] "RemoveContainer" containerID="3fcf7887b24457fdf70ecb54882b23bb1a2b7e14672ffa520abd4777ac865a94" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.736729 4769 generic.go:334] "Generic (PLEG): container finished" podID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerID="ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca" exitCode=143 Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.736780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70cad6fe-868a-49e2-a759-fbfd751b2167","Type":"ContainerDied","Data":"ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca"} Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.760756 4769 scope.go:117] "RemoveContainer" containerID="ca0716ff62fb6a78b938d9c81ed737fa2fc4768a89cc25432bf21c070cbdb0b3" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.802047 4769 scope.go:117] "RemoveContainer" containerID="791da8e752897e7ce9cc0905c3626792b98b8a44fff9006a1b6bca799a58b747" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.831758 4769 scope.go:117] "RemoveContainer" containerID="be158666898ad3b82e37af929398db9545eb305fae4b1b1b4c395557f43f400c" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.838518 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.871476 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.882477 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:37 crc kubenswrapper[4769]: E1121 12:27:37.884340 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-central-agent" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884397 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-central-agent" Nov 21 12:27:37 crc kubenswrapper[4769]: E1121 12:27:37.884436 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="sg-core" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884447 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="sg-core" Nov 21 12:27:37 crc kubenswrapper[4769]: E1121 12:27:37.884473 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-notification-agent" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-notification-agent" Nov 21 12:27:37 crc kubenswrapper[4769]: E1121 12:27:37.884495 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="proxy-httpd" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884502 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="proxy-httpd" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884802 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-central-agent" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884834 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="proxy-httpd" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884852 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="ceilometer-notification-agent" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.884868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" containerName="sg-core" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.887260 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.892847 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.893026 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.893425 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:27:37 crc kubenswrapper[4769]: I1121 12:27:37.895902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.016061 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:38 crc kubenswrapper[4769]: E1121 12:27:38.016808 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ceilometer-tls-certs combined-ca-bundle config-data kube-api-access-6226r log-httpd run-httpd scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.028800 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.028885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.028964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-run-httpd\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.029060 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-log-httpd\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.029084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6226r\" (UniqueName: \"kubernetes.io/projected/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-kube-api-access-6226r\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.029119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.029140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-config-data\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.029160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-scripts\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.101784 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.131309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.131360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-config-data\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.131389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-scripts\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.132189 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.132265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.132310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-run-httpd\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.132384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-log-httpd\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.132413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6226r\" (UniqueName: \"kubernetes.io/projected/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-kube-api-access-6226r\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.133172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-run-httpd\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.133595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-log-httpd\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.135657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-scripts\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.135772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.136793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-config-data\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.136792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.144589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.151270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6226r\" (UniqueName: \"kubernetes.io/projected/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-kube-api-access-6226r\") pod \"ceilometer-0\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.748037 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.761570 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-log-httpd\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-sg-core-conf-yaml\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-ceilometer-tls-certs\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-combined-ca-bundle\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6226r\" (UniqueName: \"kubernetes.io/projected/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-kube-api-access-6226r\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-config-data\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-run-httpd\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.948836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-scripts\") pod \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\" (UID: \"dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c\") " Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.949756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.949883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.953837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.955112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-scripts" (OuterVolumeSpecName: "scripts") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.955138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-config-data" (OuterVolumeSpecName: "config-data") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.955883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.956631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-kube-api-access-6226r" (OuterVolumeSpecName: "kube-api-access-6226r") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "kube-api-access-6226r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:38 crc kubenswrapper[4769]: I1121 12:27:38.958162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" (UID: "dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051041 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051130 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051144 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051156 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051168 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6226r\" (UniqueName: \"kubernetes.io/projected/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-kube-api-access-6226r\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051178 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051203 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.051214 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.285238 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dc2fbc7-8d09-4c4c-a021-07393e778d80" path="/var/lib/kubelet/pods/7dc2fbc7-8d09-4c4c-a021-07393e778d80/volumes" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.758977 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.818133 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.829015 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.862269 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.875514 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.878351 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.878618 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.878759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.890863 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.967440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-config-data\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.967483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.967797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-scripts\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.967851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.967887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-log-httpd\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.968127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.968235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5nqb\" (UniqueName: \"kubernetes.io/projected/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-kube-api-access-g5nqb\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:39 crc kubenswrapper[4769]: I1121 12:27:39.968282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-run-httpd\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.051616 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc"] Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.062694 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g5nqb\" (UniqueName: \"kubernetes.io/projected/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-kube-api-access-g5nqb\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-run-httpd\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-config-data\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-scripts\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.071525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-log-httpd\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.072109 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-log-httpd\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.073499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.073738 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.074323 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc"] Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.074381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-run-httpd\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.081827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-config-data\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.083968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-scripts\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.087931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.089407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.096495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5nqb\" (UniqueName: \"kubernetes.io/projected/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-kube-api-access-g5nqb\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.102031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.176523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-scripts\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.176655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.176766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dqzf\" (UniqueName: \"kubernetes.io/projected/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-kube-api-access-7dqzf\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.176793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-config-data\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.278954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7dqzf\" (UniqueName: \"kubernetes.io/projected/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-kube-api-access-7dqzf\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.279032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-config-data\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.279128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-scripts\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.279259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.283783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.284275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-scripts\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.284364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-config-data\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.304040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dqzf\" (UniqueName: \"kubernetes.io/projected/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-kube-api-access-7dqzf\") pod \"nova-cell1-cell-mapping-qz2pc\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.320062 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.387681 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.489223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cad6fe-868a-49e2-a759-fbfd751b2167-logs\") pod \"70cad6fe-868a-49e2-a759-fbfd751b2167\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.489401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-config-data\") pod \"70cad6fe-868a-49e2-a759-fbfd751b2167\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.489463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-combined-ca-bundle\") pod \"70cad6fe-868a-49e2-a759-fbfd751b2167\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.489540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xjd5\" (UniqueName: \"kubernetes.io/projected/70cad6fe-868a-49e2-a759-fbfd751b2167-kube-api-access-5xjd5\") pod \"70cad6fe-868a-49e2-a759-fbfd751b2167\" (UID: \"70cad6fe-868a-49e2-a759-fbfd751b2167\") " Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.494930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cad6fe-868a-49e2-a759-fbfd751b2167-logs" (OuterVolumeSpecName: "logs") pod "70cad6fe-868a-49e2-a759-fbfd751b2167" (UID: "70cad6fe-868a-49e2-a759-fbfd751b2167"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.495490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cad6fe-868a-49e2-a759-fbfd751b2167-kube-api-access-5xjd5" (OuterVolumeSpecName: "kube-api-access-5xjd5") pod "70cad6fe-868a-49e2-a759-fbfd751b2167" (UID: "70cad6fe-868a-49e2-a759-fbfd751b2167"). InnerVolumeSpecName "kube-api-access-5xjd5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.495560 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.532421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70cad6fe-868a-49e2-a759-fbfd751b2167" (UID: "70cad6fe-868a-49e2-a759-fbfd751b2167"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.542056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-config-data" (OuterVolumeSpecName: "config-data") pod "70cad6fe-868a-49e2-a759-fbfd751b2167" (UID: "70cad6fe-868a-49e2-a759-fbfd751b2167"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.591403 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70cad6fe-868a-49e2-a759-fbfd751b2167-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.591438 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.591448 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70cad6fe-868a-49e2-a759-fbfd751b2167-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.591461 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5xjd5\" (UniqueName: \"kubernetes.io/projected/70cad6fe-868a-49e2-a759-fbfd751b2167-kube-api-access-5xjd5\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.774249 4769 generic.go:334] "Generic (PLEG): container finished" podID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerID="a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55" exitCode=0 Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.774303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70cad6fe-868a-49e2-a759-fbfd751b2167","Type":"ContainerDied","Data":"a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55"} Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.774336 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70cad6fe-868a-49e2-a759-fbfd751b2167","Type":"ContainerDied","Data":"1251aca373f6e2e3ea5c83d08d0e5e9f74a9edbae72e120351ade1ed514c4941"} Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.774357 4769 scope.go:117] "RemoveContainer" containerID="a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.774501 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.831827 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.850739 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.851373 4769 scope.go:117] "RemoveContainer" containerID="ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.868639 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:40 crc kubenswrapper[4769]: E1121 12:27:40.869244 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-api" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.869271 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-api" Nov 21 12:27:40 crc kubenswrapper[4769]: E1121 12:27:40.869293 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-log" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.869302 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-log" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.869521 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-log" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.869560 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" containerName="nova-api-api" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.875568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.879793 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.880049 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.880758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.883119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.900609 4769 scope.go:117] "RemoveContainer" containerID="a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.900619 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:40 crc kubenswrapper[4769]: E1121 12:27:40.901097 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55\": container with ID starting with a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55 not found: ID does not exist" containerID="a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.901123 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55"} err="failed to get container status \"a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55\": rpc error: code = NotFound desc = could not find container \"a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55\": container with ID starting with a3e53f8aee1b8aba0bab23236872dc551a49e1455656018a2a1795bcf4675b55 not found: ID does not exist" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.901147 4769 scope.go:117] "RemoveContainer" containerID="ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca" Nov 21 12:27:40 crc kubenswrapper[4769]: E1121 12:27:40.901415 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca\": container with ID starting with ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca not found: ID does not exist" containerID="ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.901437 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca"} err="failed to get container status \"ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca\": rpc error: code = NotFound desc = could not find container \"ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca\": container with ID starting with ba39798ceaae2d8d2dafe9278c8327aa3dc819d2af875a3f8022a47d043f06ca not found: ID does not exist" Nov 21 12:27:40 crc kubenswrapper[4769]: I1121 12:27:40.973043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc"] Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.007633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-public-tls-certs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.009323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.009534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-logs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.009837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.010276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-config-data\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.010444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jc2\" (UniqueName: \"kubernetes.io/projected/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-kube-api-access-w5jc2\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.112934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-config-data\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.113430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jc2\" (UniqueName: \"kubernetes.io/projected/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-kube-api-access-w5jc2\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.113470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-public-tls-certs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.113528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.113588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-logs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.113648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.115014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-logs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.118974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-public-tls-certs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.119571 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.121609 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-config-data\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.122685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.143999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jc2\" (UniqueName: \"kubernetes.io/projected/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-kube-api-access-w5jc2\") pod \"nova-api-0\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.201246 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.298138 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cad6fe-868a-49e2-a759-fbfd751b2167" path="/var/lib/kubelet/pods/70cad6fe-868a-49e2-a759-fbfd751b2167/volumes" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.298822 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c" path="/var/lib/kubelet/pods/dbf18cb6-d1ff-4ab2-a9ef-be80fc0e669c/volumes" Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.659412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.794563 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" event={"ID":"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d","Type":"ContainerStarted","Data":"49672e9fb4e2c664206ac2b31720b995335e6b9dd9fa99582f659a3e4942e2c9"} Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.794618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" event={"ID":"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d","Type":"ContainerStarted","Data":"b57152e6e9acd77a5ac38247677fbd63f513c04a3745fea1ffc14ccbe354d4c4"} Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.798169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8","Type":"ContainerStarted","Data":"0e4a6ce80f854544e9c8d33b3f0e5d19352a481b766b2ee31b5a94664157456e"} Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.799519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerStarted","Data":"dc922543bebb8dd828284a5ba01c3aaaa08d9835c079e1af3ea2ddcc7598224a"} Nov 21 12:27:41 crc kubenswrapper[4769]: I1121 12:27:41.815315 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" podStartSLOduration=1.815294067 podStartE2EDuration="1.815294067s" podCreationTimestamp="2025-11-21 12:27:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:41.812397399 +0000 UTC m=+2220.513059217" watchObservedRunningTime="2025-11-21 12:27:41.815294067 +0000 UTC m=+2220.515955885" Nov 21 12:27:42 crc kubenswrapper[4769]: I1121 12:27:42.809129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerStarted","Data":"106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9"} Nov 21 12:27:42 crc kubenswrapper[4769]: I1121 12:27:42.810852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8","Type":"ContainerStarted","Data":"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c"} Nov 21 12:27:42 crc kubenswrapper[4769]: I1121 12:27:42.810890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8","Type":"ContainerStarted","Data":"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791"} Nov 21 12:27:43 crc kubenswrapper[4769]: I1121 12:27:43.822908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerStarted","Data":"a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e"} Nov 21 12:27:45 crc kubenswrapper[4769]: I1121 12:27:45.850335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerStarted","Data":"36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5"} Nov 21 12:27:46 crc kubenswrapper[4769]: I1121 12:27:46.862360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerStarted","Data":"e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072"} Nov 21 12:27:46 crc kubenswrapper[4769]: I1121 12:27:46.862950 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:27:46 crc kubenswrapper[4769]: I1121 12:27:46.865055 4769 generic.go:334] "Generic (PLEG): container finished" podID="1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" containerID="49672e9fb4e2c664206ac2b31720b995335e6b9dd9fa99582f659a3e4942e2c9" exitCode=0 Nov 21 12:27:46 crc kubenswrapper[4769]: I1121 12:27:46.865118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" event={"ID":"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d","Type":"ContainerDied","Data":"49672e9fb4e2c664206ac2b31720b995335e6b9dd9fa99582f659a3e4942e2c9"} Nov 21 12:27:46 crc kubenswrapper[4769]: I1121 12:27:46.887269 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.650253984 podStartE2EDuration="7.887252801s" podCreationTimestamp="2025-11-21 12:27:39 +0000 UTC" firstStartedPulling="2025-11-21 12:27:40.86077055 +0000 UTC m=+2219.561432368" lastFinishedPulling="2025-11-21 12:27:46.097769357 +0000 UTC m=+2224.798431185" observedRunningTime="2025-11-21 12:27:46.883447618 +0000 UTC m=+2225.584109436" watchObservedRunningTime="2025-11-21 12:27:46.887252801 +0000 UTC m=+2225.587914619" Nov 21 12:27:46 crc kubenswrapper[4769]: I1121 12:27:46.887627 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=6.8876211309999995 podStartE2EDuration="6.887621131s" podCreationTimestamp="2025-11-21 12:27:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:43.855028769 +0000 UTC m=+2222.555690587" watchObservedRunningTime="2025-11-21 12:27:46.887621131 +0000 UTC m=+2225.588282949" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.306693 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.374914 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-combined-ca-bundle\") pod \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.375000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-config-data\") pod \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.375212 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-scripts\") pod \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.375276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dqzf\" (UniqueName: \"kubernetes.io/projected/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-kube-api-access-7dqzf\") pod \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\" (UID: \"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d\") " Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.383496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-scripts" (OuterVolumeSpecName: "scripts") pod "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" (UID: "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.384414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-kube-api-access-7dqzf" (OuterVolumeSpecName: "kube-api-access-7dqzf") pod "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" (UID: "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d"). InnerVolumeSpecName "kube-api-access-7dqzf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.416482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" (UID: "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.419007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-config-data" (OuterVolumeSpecName: "config-data") pod "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" (UID: "1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.477736 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.477777 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.477787 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.477797 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7dqzf\" (UniqueName: \"kubernetes.io/projected/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d-kube-api-access-7dqzf\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.901005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" event={"ID":"1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d","Type":"ContainerDied","Data":"b57152e6e9acd77a5ac38247677fbd63f513c04a3745fea1ffc14ccbe354d4c4"} Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.901070 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b57152e6e9acd77a5ac38247677fbd63f513c04a3745fea1ffc14ccbe354d4c4" Nov 21 12:27:48 crc kubenswrapper[4769]: I1121 12:27:48.901149 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.123571 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.123969 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3ddab37e-4182-41f0-a79b-68e453823128" containerName="nova-scheduler-scheduler" containerID="cri-o://ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" gracePeriod=30 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.141818 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.142152 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-log" containerID="cri-o://42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791" gracePeriod=30 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.142348 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-api" containerID="cri-o://8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c" gracePeriod=30 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.221587 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.222375 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-log" containerID="cri-o://6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2" gracePeriod=30 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.222476 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-metadata" containerID="cri-o://cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834" gracePeriod=30 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.717602 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.799253 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-combined-ca-bundle\") pod \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.799350 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-internal-tls-certs\") pod \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.800030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5jc2\" (UniqueName: \"kubernetes.io/projected/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-kube-api-access-w5jc2\") pod \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.800090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-logs\") pod \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.800162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-config-data\") pod \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.800183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-public-tls-certs\") pod \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\" (UID: \"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8\") " Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.800568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-logs" (OuterVolumeSpecName: "logs") pod "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" (UID: "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.800691 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.806078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-kube-api-access-w5jc2" (OuterVolumeSpecName: "kube-api-access-w5jc2") pod "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" (UID: "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8"). InnerVolumeSpecName "kube-api-access-w5jc2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.830002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" (UID: "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.836812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-config-data" (OuterVolumeSpecName: "config-data") pod "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" (UID: "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:49 crc kubenswrapper[4769]: E1121 12:27:49.839465 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:49 crc kubenswrapper[4769]: E1121 12:27:49.841093 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:49 crc kubenswrapper[4769]: E1121 12:27:49.842451 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:49 crc kubenswrapper[4769]: E1121 12:27:49.842505 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3ddab37e-4182-41f0-a79b-68e453823128" containerName="nova-scheduler-scheduler" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.859065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" (UID: "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.867594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" (UID: "f4602e3b-ea0e-4b23-aa61-07c1c868ecd8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.906555 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.906617 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.906628 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w5jc2\" (UniqueName: \"kubernetes.io/projected/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-kube-api-access-w5jc2\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.906643 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.906660 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.921433 4769 generic.go:334] "Generic (PLEG): container finished" podID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerID="6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2" exitCode=143 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.921543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df83c394-312c-46e1-baf8-4b9ee16c39ca","Type":"ContainerDied","Data":"6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2"} Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924405 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerID="8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c" exitCode=0 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924442 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerID="42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791" exitCode=143 Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8","Type":"ContainerDied","Data":"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c"} Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8","Type":"ContainerDied","Data":"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791"} Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f4602e3b-ea0e-4b23-aa61-07c1c868ecd8","Type":"ContainerDied","Data":"0e4a6ce80f854544e9c8d33b3f0e5d19352a481b766b2ee31b5a94664157456e"} Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924534 4769 scope.go:117] "RemoveContainer" containerID="8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.924513 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.962962 4769 scope.go:117] "RemoveContainer" containerID="42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.968600 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.989548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.989758 4769 scope.go:117] "RemoveContainer" containerID="8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c" Nov 21 12:27:49 crc kubenswrapper[4769]: E1121 12:27:49.991427 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c\": container with ID starting with 8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c not found: ID does not exist" containerID="8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.991482 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c"} err="failed to get container status \"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c\": rpc error: code = NotFound desc = could not find container \"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c\": container with ID starting with 8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c not found: ID does not exist" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.991517 4769 scope.go:117] "RemoveContainer" containerID="42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791" Nov 21 12:27:49 crc kubenswrapper[4769]: E1121 12:27:49.992176 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791\": container with ID starting with 42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791 not found: ID does not exist" containerID="42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.992252 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791"} err="failed to get container status \"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791\": rpc error: code = NotFound desc = could not find container \"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791\": container with ID starting with 42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791 not found: ID does not exist" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.992271 4769 scope.go:117] "RemoveContainer" containerID="8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.992497 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c"} err="failed to get container status \"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c\": rpc error: code = NotFound desc = could not find container \"8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c\": container with ID starting with 8b6fe4500de7fd1ad949f49ceb0c1ff2c298bb5de5ad73c412a98d15ce56a90c not found: ID does not exist" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.992591 4769 scope.go:117] "RemoveContainer" containerID="42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791" Nov 21 12:27:49 crc kubenswrapper[4769]: I1121 12:27:49.992850 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791"} err="failed to get container status \"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791\": rpc error: code = NotFound desc = could not find container \"42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791\": container with ID starting with 42d8aa0c0b31a09cf9a8f1ca7852526a57b2d7ae2bc801945233252d2f42f791 not found: ID does not exist" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.002423 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:50 crc kubenswrapper[4769]: E1121 12:27:50.002934 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-log" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.002952 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-log" Nov 21 12:27:50 crc kubenswrapper[4769]: E1121 12:27:50.002972 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" containerName="nova-manage" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.002979 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" containerName="nova-manage" Nov 21 12:27:50 crc kubenswrapper[4769]: E1121 12:27:50.002990 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-api" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.002997 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-api" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.003241 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-api" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.003259 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" containerName="nova-manage" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.003268 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" containerName="nova-api-log" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.004403 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.009246 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.009374 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqk6\" (UniqueName: \"kubernetes.io/projected/e1b857b2-7449-4450-a61a-7cc9bfff316f-kube-api-access-dnqk6\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.009493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.009626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-public-tls-certs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.009850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1b857b2-7449-4450-a61a-7cc9bfff316f-logs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.010113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-config-data\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.010759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.010915 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.011142 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.019426 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.112107 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqk6\" (UniqueName: \"kubernetes.io/projected/e1b857b2-7449-4450-a61a-7cc9bfff316f-kube-api-access-dnqk6\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.112225 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.112295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-public-tls-certs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.112320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1b857b2-7449-4450-a61a-7cc9bfff316f-logs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.112356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-config-data\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.112390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.116886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.116920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-public-tls-certs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.117590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.117679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1b857b2-7449-4450-a61a-7cc9bfff316f-logs\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.123116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-config-data\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.134496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqk6\" (UniqueName: \"kubernetes.io/projected/e1b857b2-7449-4450-a61a-7cc9bfff316f-kube-api-access-dnqk6\") pod \"nova-api-0\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.328440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.823111 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:27:50 crc kubenswrapper[4769]: I1121 12:27:50.938176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e1b857b2-7449-4450-a61a-7cc9bfff316f","Type":"ContainerStarted","Data":"cca421570a8b46bb73528650a854da4db8ce5023be2deb3dc9e159af918bda62"} Nov 21 12:27:51 crc kubenswrapper[4769]: I1121 12:27:51.300978 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4602e3b-ea0e-4b23-aa61-07c1c868ecd8" path="/var/lib/kubelet/pods/f4602e3b-ea0e-4b23-aa61-07c1c868ecd8/volumes" Nov 21 12:27:51 crc kubenswrapper[4769]: I1121 12:27:51.950624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e1b857b2-7449-4450-a61a-7cc9bfff316f","Type":"ContainerStarted","Data":"34cd3387ad221c34560c76abcd77a2a62d83a55afb99a7549ca55e84d12a6368"} Nov 21 12:27:51 crc kubenswrapper[4769]: I1121 12:27:51.950683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e1b857b2-7449-4450-a61a-7cc9bfff316f","Type":"ContainerStarted","Data":"25b1a6d430b0e6524a6bc0e8066ada3b4eac6044cbff1aa6699d8fd23351f774"} Nov 21 12:27:51 crc kubenswrapper[4769]: I1121 12:27:51.981869 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.981807433 podStartE2EDuration="2.981807433s" podCreationTimestamp="2025-11-21 12:27:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:51.971463565 +0000 UTC m=+2230.672125393" watchObservedRunningTime="2025-11-21 12:27:51.981807433 +0000 UTC m=+2230.682469271" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.806749 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.862043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd7sw\" (UniqueName: \"kubernetes.io/projected/df83c394-312c-46e1-baf8-4b9ee16c39ca-kube-api-access-xd7sw\") pod \"df83c394-312c-46e1-baf8-4b9ee16c39ca\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.862104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-config-data\") pod \"df83c394-312c-46e1-baf8-4b9ee16c39ca\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.862144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df83c394-312c-46e1-baf8-4b9ee16c39ca-logs\") pod \"df83c394-312c-46e1-baf8-4b9ee16c39ca\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.862393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-nova-metadata-tls-certs\") pod \"df83c394-312c-46e1-baf8-4b9ee16c39ca\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.862551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-combined-ca-bundle\") pod \"df83c394-312c-46e1-baf8-4b9ee16c39ca\" (UID: \"df83c394-312c-46e1-baf8-4b9ee16c39ca\") " Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.862708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df83c394-312c-46e1-baf8-4b9ee16c39ca-logs" (OuterVolumeSpecName: "logs") pod "df83c394-312c-46e1-baf8-4b9ee16c39ca" (UID: "df83c394-312c-46e1-baf8-4b9ee16c39ca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.863072 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/df83c394-312c-46e1-baf8-4b9ee16c39ca-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.868049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df83c394-312c-46e1-baf8-4b9ee16c39ca-kube-api-access-xd7sw" (OuterVolumeSpecName: "kube-api-access-xd7sw") pod "df83c394-312c-46e1-baf8-4b9ee16c39ca" (UID: "df83c394-312c-46e1-baf8-4b9ee16c39ca"). InnerVolumeSpecName "kube-api-access-xd7sw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.892225 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-config-data" (OuterVolumeSpecName: "config-data") pod "df83c394-312c-46e1-baf8-4b9ee16c39ca" (UID: "df83c394-312c-46e1-baf8-4b9ee16c39ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.893930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "df83c394-312c-46e1-baf8-4b9ee16c39ca" (UID: "df83c394-312c-46e1-baf8-4b9ee16c39ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.918491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "df83c394-312c-46e1-baf8-4b9ee16c39ca" (UID: "df83c394-312c-46e1-baf8-4b9ee16c39ca"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.963888 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.963924 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.963936 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xd7sw\" (UniqueName: \"kubernetes.io/projected/df83c394-312c-46e1-baf8-4b9ee16c39ca-kube-api-access-xd7sw\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.963945 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df83c394-312c-46e1-baf8-4b9ee16c39ca-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.967363 4769 generic.go:334] "Generic (PLEG): container finished" podID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerID="cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834" exitCode=0 Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.968677 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.969247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df83c394-312c-46e1-baf8-4b9ee16c39ca","Type":"ContainerDied","Data":"cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834"} Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.969318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"df83c394-312c-46e1-baf8-4b9ee16c39ca","Type":"ContainerDied","Data":"4783619fc3e282faa955814bcd13fa8e0f02a5669eade77583132a6990a833e5"} Nov 21 12:27:52 crc kubenswrapper[4769]: I1121 12:27:52.969352 4769 scope.go:117] "RemoveContainer" containerID="cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.003125 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.013388 4769 scope.go:117] "RemoveContainer" containerID="6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.019866 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.033327 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:53 crc kubenswrapper[4769]: E1121 12:27:53.034012 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-metadata" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.034029 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-metadata" Nov 21 12:27:53 crc kubenswrapper[4769]: E1121 12:27:53.034084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-log" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.034090 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-log" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.034282 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-metadata" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.034312 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" containerName="nova-metadata-log" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.035690 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.036958 4769 scope.go:117] "RemoveContainer" containerID="cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834" Nov 21 12:27:53 crc kubenswrapper[4769]: E1121 12:27:53.037543 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834\": container with ID starting with cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834 not found: ID does not exist" containerID="cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.037587 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834"} err="failed to get container status \"cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834\": rpc error: code = NotFound desc = could not find container \"cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834\": container with ID starting with cf3aa73d064bc4c55d3a50f7906ef3dbaf1c60afec80eb42b69ac05440d4f834 not found: ID does not exist" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.037618 4769 scope.go:117] "RemoveContainer" containerID="6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2" Nov 21 12:27:53 crc kubenswrapper[4769]: E1121 12:27:53.038517 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2\": container with ID starting with 6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2 not found: ID does not exist" containerID="6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.038579 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2"} err="failed to get container status \"6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2\": rpc error: code = NotFound desc = could not find container \"6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2\": container with ID starting with 6706b64f5489692c28b17cb3c29cac16ace97262b8a95d5faede8ad9eadb5ec2 not found: ID does not exist" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.038755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.039051 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.045116 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.064837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8db99cd8-81fb-414a-8eec-3db988f78f5e-logs\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.064964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.065063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4pp\" (UniqueName: \"kubernetes.io/projected/8db99cd8-81fb-414a-8eec-3db988f78f5e-kube-api-access-6n4pp\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.065310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-config-data\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.065394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.167998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-config-data\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.168208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.168506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8db99cd8-81fb-414a-8eec-3db988f78f5e-logs\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.168614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.168691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4pp\" (UniqueName: \"kubernetes.io/projected/8db99cd8-81fb-414a-8eec-3db988f78f5e-kube-api-access-6n4pp\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.169047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8db99cd8-81fb-414a-8eec-3db988f78f5e-logs\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.172606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.173267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-config-data\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.174166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.186059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4pp\" (UniqueName: \"kubernetes.io/projected/8db99cd8-81fb-414a-8eec-3db988f78f5e-kube-api-access-6n4pp\") pod \"nova-metadata-0\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.285344 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df83c394-312c-46e1-baf8-4b9ee16c39ca" path="/var/lib/kubelet/pods/df83c394-312c-46e1-baf8-4b9ee16c39ca/volumes" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.367876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:53 crc kubenswrapper[4769]: I1121 12:27:53.882933 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:27:54 crc kubenswrapper[4769]: I1121 12:27:54.027475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8db99cd8-81fb-414a-8eec-3db988f78f5e","Type":"ContainerStarted","Data":"0c0c402adb079e5068efacdee69b2f4066f913f7a4f8c102db8d3c218350a109"} Nov 21 12:27:54 crc kubenswrapper[4769]: E1121 12:27:54.837606 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa is running failed: container process not found" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:54 crc kubenswrapper[4769]: E1121 12:27:54.838460 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa is running failed: container process not found" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:54 crc kubenswrapper[4769]: E1121 12:27:54.838889 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa is running failed: container process not found" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:27:54 crc kubenswrapper[4769]: E1121 12:27:54.838927 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="3ddab37e-4182-41f0-a79b-68e453823128" containerName="nova-scheduler-scheduler" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.047945 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ddab37e-4182-41f0-a79b-68e453823128" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" exitCode=0 Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.048288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ddab37e-4182-41f0-a79b-68e453823128","Type":"ContainerDied","Data":"ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa"} Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.050105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8db99cd8-81fb-414a-8eec-3db988f78f5e","Type":"ContainerStarted","Data":"eacfe69496d42243648977490be543cfccfa90344dc261525b705d4e2b35f758"} Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.050139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8db99cd8-81fb-414a-8eec-3db988f78f5e","Type":"ContainerStarted","Data":"2a990d18d760f975a0be3c11e04d817fc89798392bc035ca3ed0766d105d9af0"} Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.084703 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.084677866 podStartE2EDuration="2.084677866s" podCreationTimestamp="2025-11-21 12:27:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:55.071673926 +0000 UTC m=+2233.772335744" watchObservedRunningTime="2025-11-21 12:27:55.084677866 +0000 UTC m=+2233.785339684" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.250105 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.419597 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m75m5\" (UniqueName: \"kubernetes.io/projected/3ddab37e-4182-41f0-a79b-68e453823128-kube-api-access-m75m5\") pod \"3ddab37e-4182-41f0-a79b-68e453823128\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.419697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-combined-ca-bundle\") pod \"3ddab37e-4182-41f0-a79b-68e453823128\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.419760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-config-data\") pod \"3ddab37e-4182-41f0-a79b-68e453823128\" (UID: \"3ddab37e-4182-41f0-a79b-68e453823128\") " Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.427497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ddab37e-4182-41f0-a79b-68e453823128-kube-api-access-m75m5" (OuterVolumeSpecName: "kube-api-access-m75m5") pod "3ddab37e-4182-41f0-a79b-68e453823128" (UID: "3ddab37e-4182-41f0-a79b-68e453823128"). InnerVolumeSpecName "kube-api-access-m75m5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.446371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-config-data" (OuterVolumeSpecName: "config-data") pod "3ddab37e-4182-41f0-a79b-68e453823128" (UID: "3ddab37e-4182-41f0-a79b-68e453823128"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.467564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ddab37e-4182-41f0-a79b-68e453823128" (UID: "3ddab37e-4182-41f0-a79b-68e453823128"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.522285 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m75m5\" (UniqueName: \"kubernetes.io/projected/3ddab37e-4182-41f0-a79b-68e453823128-kube-api-access-m75m5\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.522339 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:55 crc kubenswrapper[4769]: I1121 12:27:55.522353 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ddab37e-4182-41f0-a79b-68e453823128-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.063432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.063425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"3ddab37e-4182-41f0-a79b-68e453823128","Type":"ContainerDied","Data":"33d36a624012934f6bae0569ee11d4a2b582060886e262ac432141009471f03c"} Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.063542 4769 scope.go:117] "RemoveContainer" containerID="ce54170665da7eb1cd0dad508de26429d3552157c0d1cfccf1441fd88d18d7fa" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.101344 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.120153 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.135299 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:56 crc kubenswrapper[4769]: E1121 12:27:56.135749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ddab37e-4182-41f0-a79b-68e453823128" containerName="nova-scheduler-scheduler" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.135774 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ddab37e-4182-41f0-a79b-68e453823128" containerName="nova-scheduler-scheduler" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.136086 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ddab37e-4182-41f0-a79b-68e453823128" containerName="nova-scheduler-scheduler" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.136975 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.143076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.144849 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.338247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.338420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-config-data\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.338907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggwm4\" (UniqueName: \"kubernetes.io/projected/eaabdea5-a92a-4d83-a910-fe0a9993b278-kube-api-access-ggwm4\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.440870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.441030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-config-data\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.441149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ggwm4\" (UniqueName: \"kubernetes.io/projected/eaabdea5-a92a-4d83-a910-fe0a9993b278-kube-api-access-ggwm4\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.451673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-config-data\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.454216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.467519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggwm4\" (UniqueName: \"kubernetes.io/projected/eaabdea5-a92a-4d83-a910-fe0a9993b278-kube-api-access-ggwm4\") pod \"nova-scheduler-0\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.481734 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:27:56 crc kubenswrapper[4769]: I1121 12:27:56.936507 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:27:57 crc kubenswrapper[4769]: I1121 12:27:57.080700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaabdea5-a92a-4d83-a910-fe0a9993b278","Type":"ContainerStarted","Data":"488aceeb679d9d82aac1e7371558187e92a32acaa572dd6f9698bfdee93eb2ce"} Nov 21 12:27:57 crc kubenswrapper[4769]: I1121 12:27:57.285389 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ddab37e-4182-41f0-a79b-68e453823128" path="/var/lib/kubelet/pods/3ddab37e-4182-41f0-a79b-68e453823128/volumes" Nov 21 12:27:58 crc kubenswrapper[4769]: I1121 12:27:58.092771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaabdea5-a92a-4d83-a910-fe0a9993b278","Type":"ContainerStarted","Data":"42260c171b88c7201b3f08d2d92a0fc3baa74960ca7cd600a2537e91c72ca9a0"} Nov 21 12:27:58 crc kubenswrapper[4769]: I1121 12:27:58.115099 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.115078988 podStartE2EDuration="2.115078988s" podCreationTimestamp="2025-11-21 12:27:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:27:58.113551437 +0000 UTC m=+2236.814213315" watchObservedRunningTime="2025-11-21 12:27:58.115078988 +0000 UTC m=+2236.815740806" Nov 21 12:27:58 crc kubenswrapper[4769]: I1121 12:27:58.367980 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:58 crc kubenswrapper[4769]: I1121 12:27:58.368075 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:27:58 crc kubenswrapper[4769]: I1121 12:27:58.383897 4769 scope.go:117] "RemoveContainer" containerID="ee531eaae4596e437913d46d3b12917c98a7852b5af2681a891ae63fe69d63cd" Nov 21 12:27:58 crc kubenswrapper[4769]: I1121 12:27:58.411248 4769 scope.go:117] "RemoveContainer" containerID="e8e91b1d726c809a8fdb4dd52969969029d6d35c7c52a9c279f3461f97fae829" Nov 21 12:28:00 crc kubenswrapper[4769]: I1121 12:28:00.329504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:00 crc kubenswrapper[4769]: I1121 12:28:00.329579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:01 crc kubenswrapper[4769]: I1121 12:28:01.346445 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.139:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:28:01 crc kubenswrapper[4769]: I1121 12:28:01.346434 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.139:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:28:01 crc kubenswrapper[4769]: I1121 12:28:01.482151 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:28:03 crc kubenswrapper[4769]: I1121 12:28:03.368802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:03 crc kubenswrapper[4769]: I1121 12:28:03.368871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:04 crc kubenswrapper[4769]: I1121 12:28:04.386390 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.140:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:28:04 crc kubenswrapper[4769]: I1121 12:28:04.386429 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.140:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:28:06 crc kubenswrapper[4769]: I1121 12:28:06.482179 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:28:06 crc kubenswrapper[4769]: I1121 12:28:06.511945 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:28:07 crc kubenswrapper[4769]: I1121 12:28:07.208107 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:28:10 crc kubenswrapper[4769]: I1121 12:28:10.329584 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:28:10 crc kubenswrapper[4769]: I1121 12:28:10.342938 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:10 crc kubenswrapper[4769]: I1121 12:28:10.343420 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:10 crc kubenswrapper[4769]: I1121 12:28:10.343645 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:10 crc kubenswrapper[4769]: I1121 12:28:10.353754 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:11 crc kubenswrapper[4769]: I1121 12:28:11.219936 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:11 crc kubenswrapper[4769]: I1121 12:28:11.228631 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:13 crc kubenswrapper[4769]: I1121 12:28:13.378515 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:13 crc kubenswrapper[4769]: I1121 12:28:13.384875 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:13 crc kubenswrapper[4769]: I1121 12:28:13.393411 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:14 crc kubenswrapper[4769]: I1121 12:28:14.258877 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.508259 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-6jkbx"] Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.511119 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.523160 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6jkbx"] Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.685074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mx6v\" (UniqueName: \"kubernetes.io/projected/f0440cef-3647-4eda-b613-19ab87c03e77-kube-api-access-5mx6v\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.685150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-utilities\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.685243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-catalog-content\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.786774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5mx6v\" (UniqueName: \"kubernetes.io/projected/f0440cef-3647-4eda-b613-19ab87c03e77-kube-api-access-5mx6v\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.786836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-utilities\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.786903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-catalog-content\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.787455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-utilities\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.787510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-catalog-content\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.810578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mx6v\" (UniqueName: \"kubernetes.io/projected/f0440cef-3647-4eda-b613-19ab87c03e77-kube-api-access-5mx6v\") pod \"redhat-marketplace-6jkbx\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:16 crc kubenswrapper[4769]: I1121 12:28:16.838654 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.299322 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.301211 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.304995 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-scripts" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.305018 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncontroller-ovncontroller-dockercfg-8c2d4" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.306585 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovncontroller-ovndbs" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.315172 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-l29rw"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.328385 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.337662 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-l29rw"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.343279 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.379105 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-ft5ng"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.380482 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.382688 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-metrics-config" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.391894 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-ft5ng"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzln\" (UniqueName: \"kubernetes.io/projected/e62e4f7d-ce60-4d0f-8f07-af5052da5427-kube-api-access-vnzln\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-combined-ca-bundle\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e62e4f7d-ce60-4d0f-8f07-af5052da5427-scripts\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run-ovn\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-ovn-controller-tls-certs\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-log-ovn\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.402991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: W1121 12:28:17.415678 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0440cef_3647_4eda_b613_19ab87c03e77.slice/crio-7afbcdcad746fcad29971eccb748a91ebb531ffc5290baafbe9c3289bee3df19 WatchSource:0}: Error finding container 7afbcdcad746fcad29971eccb748a91ebb531ffc5290baafbe9c3289bee3df19: Status 404 returned error can't find the container with id 7afbcdcad746fcad29971eccb748a91ebb531ffc5290baafbe9c3289bee3df19 Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.425836 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6jkbx"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.461365 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.462813 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.465310 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-extra-scripts" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.491144 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92"] Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.504978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovn-rundir\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovs-rundir\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfv86\" (UniqueName: \"kubernetes.io/projected/d61f7eef-c0be-4fb9-80d8-9220e406dc88-kube-api-access-cfv86\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txh2d\" (UniqueName: \"kubernetes.io/projected/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-kube-api-access-txh2d\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-log-ovn\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-combined-ca-bundle\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-lib\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d61f7eef-c0be-4fb9-80d8-9220e406dc88-config\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.505964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-log\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-run\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzln\" (UniqueName: \"kubernetes.io/projected/e62e4f7d-ce60-4d0f-8f07-af5052da5427-kube-api-access-vnzln\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-etc-ovs\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506234 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-log-ovn\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-combined-ca-bundle\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e62e4f7d-ce60-4d0f-8f07-af5052da5427-scripts\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run-ovn\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run-ovn\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.506701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-ovn-controller-tls-certs\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.510753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e62e4f7d-ce60-4d0f-8f07-af5052da5427-scripts\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.512500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-combined-ca-bundle\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.512621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-ovn-controller-tls-certs\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.524827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzln\" (UniqueName: \"kubernetes.io/projected/e62e4f7d-ce60-4d0f-8f07-af5052da5427-kube-api-access-vnzln\") pod \"ovn-controller-sl7np\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-run\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-run\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-etc-ovs\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovn-rundir\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-scripts\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovs-rundir\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run-ovn\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovn-rundir\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-log-ovn\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-etc-ovs\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovs-rundir\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cfv86\" (UniqueName: \"kubernetes.io/projected/d61f7eef-c0be-4fb9-80d8-9220e406dc88-kube-api-access-cfv86\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-txh2d\" (UniqueName: \"kubernetes.io/projected/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-kube-api-access-txh2d\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.608991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-combined-ca-bundle\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-lib\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p4v5\" (UniqueName: \"kubernetes.io/projected/da05a6c0-fa50-402b-9554-1d97e7c5d955-kube-api-access-5p4v5\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609099 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d61f7eef-c0be-4fb9-80d8-9220e406dc88-config\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-additional-scripts\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-log\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-log\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-lib\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.609916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d61f7eef-c0be-4fb9-80d8-9220e406dc88-config\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.611576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.613341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-combined-ca-bundle\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.615776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.628155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfv86\" (UniqueName: \"kubernetes.io/projected/d61f7eef-c0be-4fb9-80d8-9220e406dc88-kube-api-access-cfv86\") pod \"ovn-controller-metrics-ft5ng\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.631632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-txh2d\" (UniqueName: \"kubernetes.io/projected/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-kube-api-access-txh2d\") pod \"ovn-controller-ovs-l29rw\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.634984 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.670492 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.712870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5p4v5\" (UniqueName: \"kubernetes.io/projected/da05a6c0-fa50-402b-9554-1d97e7c5d955-kube-api-access-5p4v5\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.712934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.712964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-additional-scripts\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.713054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-scripts\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.713082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run-ovn\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.713107 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-log-ovn\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.713285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run-ovn\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.713286 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.713294 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-log-ovn\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.714017 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-additional-scripts\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.716103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.719677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-scripts\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.740664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p4v5\" (UniqueName: \"kubernetes.io/projected/da05a6c0-fa50-402b-9554-1d97e7c5d955-kube-api-access-5p4v5\") pod \"ovn-controller-sl7np-config-v8t92\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:17 crc kubenswrapper[4769]: I1121 12:28:17.885673 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.219649 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np"] Nov 21 12:28:18 crc kubenswrapper[4769]: W1121 12:28:18.223872 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode62e4f7d_ce60_4d0f_8f07_af5052da5427.slice/crio-d46081b4a604fb11976660f261795abb6c86247e25da098fc674a4b148a018c2 WatchSource:0}: Error finding container d46081b4a604fb11976660f261795abb6c86247e25da098fc674a4b148a018c2: Status 404 returned error can't find the container with id d46081b4a604fb11976660f261795abb6c86247e25da098fc674a4b148a018c2 Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.261374 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92"] Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.306377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np" event={"ID":"e62e4f7d-ce60-4d0f-8f07-af5052da5427","Type":"ContainerStarted","Data":"d46081b4a604fb11976660f261795abb6c86247e25da098fc674a4b148a018c2"} Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.330828 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-l29rw"] Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.331065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" event={"ID":"da05a6c0-fa50-402b-9554-1d97e7c5d955","Type":"ContainerStarted","Data":"69db7de3cb1cb9083188552c179f398c34037075d8653786f25b9feb4646e0c3"} Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.366630 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0440cef-3647-4eda-b613-19ab87c03e77" containerID="9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df" exitCode=0 Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.366692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6jkbx" event={"ID":"f0440cef-3647-4eda-b613-19ab87c03e77","Type":"ContainerDied","Data":"9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df"} Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.366728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6jkbx" event={"ID":"f0440cef-3647-4eda-b613-19ab87c03e77","Type":"ContainerStarted","Data":"7afbcdcad746fcad29971eccb748a91ebb531ffc5290baafbe9c3289bee3df19"} Nov 21 12:28:18 crc kubenswrapper[4769]: I1121 12:28:18.440296 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-ft5ng"] Nov 21 12:28:18 crc kubenswrapper[4769]: W1121 12:28:18.516522 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd61f7eef_c0be_4fb9_80d8_9220e406dc88.slice/crio-e5ef6c3d86347ebd970cb432f0ba534e837c9047a9da310ab21938777fe8f1fe WatchSource:0}: Error finding container e5ef6c3d86347ebd970cb432f0ba534e837c9047a9da310ab21938777fe8f1fe: Status 404 returned error can't find the container with id e5ef6c3d86347ebd970cb432f0ba534e837c9047a9da310ab21938777fe8f1fe Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.383926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerStarted","Data":"2bec774f897b0c52237c552949187576a6b45bbbce1fb4b41a19cf7a3d1caf4e"} Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.384347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerStarted","Data":"f44a1279939605adc30df98a06076c5c4fe3b0c54ea6bba2d3eac9f33e7091a9"} Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.387264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" event={"ID":"d61f7eef-c0be-4fb9-80d8-9220e406dc88","Type":"ContainerStarted","Data":"0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f"} Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.387294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" event={"ID":"d61f7eef-c0be-4fb9-80d8-9220e406dc88","Type":"ContainerStarted","Data":"e5ef6c3d86347ebd970cb432f0ba534e837c9047a9da310ab21938777fe8f1fe"} Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.390858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np" event={"ID":"e62e4f7d-ce60-4d0f-8f07-af5052da5427","Type":"ContainerStarted","Data":"b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781"} Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.392162 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.395155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" event={"ID":"da05a6c0-fa50-402b-9554-1d97e7c5d955","Type":"ContainerStarted","Data":"e1a67345fdf223614bd36a995a2cbc07dd81d95aa46d75cb548afd0e76386b22"} Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.444407 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-sl7np" podStartSLOduration=2.444370668 podStartE2EDuration="2.444370668s" podCreationTimestamp="2025-11-21 12:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:19.432605942 +0000 UTC m=+2258.133267770" watchObservedRunningTime="2025-11-21 12:28:19.444370668 +0000 UTC m=+2258.145032496" Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.465459 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" podStartSLOduration=2.465426125 podStartE2EDuration="2.465426125s" podCreationTimestamp="2025-11-21 12:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:19.452482337 +0000 UTC m=+2258.153144155" watchObservedRunningTime="2025-11-21 12:28:19.465426125 +0000 UTC m=+2258.166087943" Nov 21 12:28:19 crc kubenswrapper[4769]: I1121 12:28:19.486375 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" podStartSLOduration=2.486342128 podStartE2EDuration="2.486342128s" podCreationTimestamp="2025-11-21 12:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:19.473892763 +0000 UTC m=+2258.174554591" watchObservedRunningTime="2025-11-21 12:28:19.486342128 +0000 UTC m=+2258.187003946" Nov 21 12:28:20 crc kubenswrapper[4769]: I1121 12:28:20.412264 4769 generic.go:334] "Generic (PLEG): container finished" podID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerID="2bec774f897b0c52237c552949187576a6b45bbbce1fb4b41a19cf7a3d1caf4e" exitCode=0 Nov 21 12:28:20 crc kubenswrapper[4769]: I1121 12:28:20.412312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerDied","Data":"2bec774f897b0c52237c552949187576a6b45bbbce1fb4b41a19cf7a3d1caf4e"} Nov 21 12:28:21 crc kubenswrapper[4769]: I1121 12:28:21.429545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerStarted","Data":"d345609de63f0e89ed18a83d4611ae774edc318d4a2504fe28397c4706237421"} Nov 21 12:28:21 crc kubenswrapper[4769]: I1121 12:28:21.436212 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0440cef-3647-4eda-b613-19ab87c03e77" containerID="d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415" exitCode=0 Nov 21 12:28:21 crc kubenswrapper[4769]: I1121 12:28:21.436706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6jkbx" event={"ID":"f0440cef-3647-4eda-b613-19ab87c03e77","Type":"ContainerDied","Data":"d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415"} Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.449759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6jkbx" event={"ID":"f0440cef-3647-4eda-b613-19ab87c03e77","Type":"ContainerStarted","Data":"84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc"} Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.453316 4769 generic.go:334] "Generic (PLEG): container finished" podID="da05a6c0-fa50-402b-9554-1d97e7c5d955" containerID="e1a67345fdf223614bd36a995a2cbc07dd81d95aa46d75cb548afd0e76386b22" exitCode=0 Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.453378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" event={"ID":"da05a6c0-fa50-402b-9554-1d97e7c5d955","Type":"ContainerDied","Data":"e1a67345fdf223614bd36a995a2cbc07dd81d95aa46d75cb548afd0e76386b22"} Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.456313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerStarted","Data":"e77ac84ab00a0dd09f8beb69669f066368788011a674ef1c23ec3b7bf20b51a5"} Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.456635 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.472634 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-6jkbx" podStartSLOduration=2.7912464249999998 podStartE2EDuration="6.472608412s" podCreationTimestamp="2025-11-21 12:28:16 +0000 UTC" firstStartedPulling="2025-11-21 12:28:18.505175874 +0000 UTC m=+2257.205837692" lastFinishedPulling="2025-11-21 12:28:22.186537861 +0000 UTC m=+2260.887199679" observedRunningTime="2025-11-21 12:28:22.471323037 +0000 UTC m=+2261.171984855" watchObservedRunningTime="2025-11-21 12:28:22.472608412 +0000 UTC m=+2261.173270240" Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.507126 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" podStartSLOduration=5.507098921 podStartE2EDuration="5.507098921s" podCreationTimestamp="2025-11-21 12:28:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:22.504764768 +0000 UTC m=+2261.205426596" watchObservedRunningTime="2025-11-21 12:28:22.507098921 +0000 UTC m=+2261.207760739" Nov 21 12:28:22 crc kubenswrapper[4769]: I1121 12:28:22.670727 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.467300 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np"] Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.467583 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-8c2d4\" not found" Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.473682 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-l29rw"] Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.480767 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-ft5ng"] Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.481067 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" podUID="d61f7eef-c0be-4fb9-80d8-9220e406dc88" containerName="openstack-network-exporter" containerID="cri-o://0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f" gracePeriod=30 Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.487825 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92"] Nov 21 12:28:23 crc kubenswrapper[4769]: E1121 12:28:23.563328 4769 handlers.go:78] "Exec lifecycle hook for Container in Pod failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " execCommand=["/usr/share/ovn/scripts/ovn-ctl","stop_controller"] containerName="ovn-controller" pod="openstack-kuttl-tests/ovn-controller-sl7np" message=< Nov 21 12:28:23 crc kubenswrapper[4769]: Exiting ovn-controller (1) [ OK ] Nov 21 12:28:23 crc kubenswrapper[4769]: > Nov 21 12:28:23 crc kubenswrapper[4769]: E1121 12:28:23.563401 4769 kuberuntime_container.go:691] "PreStop hook failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " pod="openstack-kuttl-tests/ovn-controller-sl7np" podUID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" containerName="ovn-controller" containerID="cri-o://b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781" Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.563464 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-sl7np" podUID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" containerName="ovn-controller" containerID="cri-o://b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781" gracePeriod=30 Nov 21 12:28:23 crc kubenswrapper[4769]: E1121 12:28:23.598545 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Nov 21 12:28:23 crc kubenswrapper[4769]: E1121 12:28:23.598646 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts podName:0119a94b-1f20-45e1-a1dc-d01dc397cb9d nodeName:}" failed. No retries permitted until 2025-11-21 12:28:24.098621436 +0000 UTC m=+2262.799283254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts") pod "ovn-controller-ovs-l29rw" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d") : configmap "ovncontroller-scripts" not found Nov 21 12:28:23 crc kubenswrapper[4769]: I1121 12:28:23.883871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.004928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p4v5\" (UniqueName: \"kubernetes.io/projected/da05a6c0-fa50-402b-9554-1d97e7c5d955-kube-api-access-5p4v5\") pod \"da05a6c0-fa50-402b-9554-1d97e7c5d955\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.005071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-scripts\") pod \"da05a6c0-fa50-402b-9554-1d97e7c5d955\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.006693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-scripts" (OuterVolumeSpecName: "scripts") pod "da05a6c0-fa50-402b-9554-1d97e7c5d955" (UID: "da05a6c0-fa50-402b-9554-1d97e7c5d955"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.006795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-log-ovn\") pod \"da05a6c0-fa50-402b-9554-1d97e7c5d955\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.006868 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "da05a6c0-fa50-402b-9554-1d97e7c5d955" (UID: "da05a6c0-fa50-402b-9554-1d97e7c5d955"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.007015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-additional-scripts\") pod \"da05a6c0-fa50-402b-9554-1d97e7c5d955\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "da05a6c0-fa50-402b-9554-1d97e7c5d955" (UID: "da05a6c0-fa50-402b-9554-1d97e7c5d955"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run-ovn\") pod \"da05a6c0-fa50-402b-9554-1d97e7c5d955\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008233 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "da05a6c0-fa50-402b-9554-1d97e7c5d955" (UID: "da05a6c0-fa50-402b-9554-1d97e7c5d955"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run\") pod \"da05a6c0-fa50-402b-9554-1d97e7c5d955\" (UID: \"da05a6c0-fa50-402b-9554-1d97e7c5d955\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run" (OuterVolumeSpecName: "var-run") pod "da05a6c0-fa50-402b-9554-1d97e7c5d955" (UID: "da05a6c0-fa50-402b-9554-1d97e7c5d955"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008961 4769 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008979 4769 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008987 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.008995 4769 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/da05a6c0-fa50-402b-9554-1d97e7c5d955-var-log-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.009003 4769 reconciler_common.go:293] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/da05a6c0-fa50-402b-9554-1d97e7c5d955-additional-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.013509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da05a6c0-fa50-402b-9554-1d97e7c5d955-kube-api-access-5p4v5" (OuterVolumeSpecName: "kube-api-access-5p4v5") pod "da05a6c0-fa50-402b-9554-1d97e7c5d955" (UID: "da05a6c0-fa50-402b-9554-1d97e7c5d955"). InnerVolumeSpecName "kube-api-access-5p4v5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.083278 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.094014 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-ft5ng_d61f7eef-c0be-4fb9-80d8-9220e406dc88/openstack-network-exporter/0.log" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.094090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.111795 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5p4v5\" (UniqueName: \"kubernetes.io/projected/da05a6c0-fa50-402b-9554-1d97e7c5d955-kube-api-access-5p4v5\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: E1121 12:28:24.111795 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Nov 21 12:28:24 crc kubenswrapper[4769]: E1121 12:28:24.111961 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts podName:0119a94b-1f20-45e1-a1dc-d01dc397cb9d nodeName:}" failed. No retries permitted until 2025-11-21 12:28:25.111933495 +0000 UTC m=+2263.812595323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts") pod "ovn-controller-ovs-l29rw" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d") : configmap "ovncontroller-scripts" not found Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213453 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfv86\" (UniqueName: \"kubernetes.io/projected/d61f7eef-c0be-4fb9-80d8-9220e406dc88-kube-api-access-cfv86\") pod \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d61f7eef-c0be-4fb9-80d8-9220e406dc88-config\") pod \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-log-ovn\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-metrics-certs-tls-certs\") pod \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-combined-ca-bundle\") pod \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-ovn-controller-tls-certs\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-combined-ca-bundle\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovs-rundir\") pod \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run-ovn\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnzln\" (UniqueName: \"kubernetes.io/projected/e62e4f7d-ce60-4d0f-8f07-af5052da5427-kube-api-access-vnzln\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovn-rundir\") pod \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\" (UID: \"d61f7eef-c0be-4fb9-80d8-9220e406dc88\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e62e4f7d-ce60-4d0f-8f07-af5052da5427-scripts\") pod \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\" (UID: \"e62e4f7d-ce60-4d0f-8f07-af5052da5427\") " Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.213706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovs-rundir" (OuterVolumeSpecName: "ovs-rundir") pod "d61f7eef-c0be-4fb9-80d8-9220e406dc88" (UID: "d61f7eef-c0be-4fb9-80d8-9220e406dc88"). InnerVolumeSpecName "ovs-rundir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run" (OuterVolumeSpecName: "var-run") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d61f7eef-c0be-4fb9-80d8-9220e406dc88-config" (OuterVolumeSpecName: "config") pod "d61f7eef-c0be-4fb9-80d8-9220e406dc88" (UID: "d61f7eef-c0be-4fb9-80d8-9220e406dc88"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214488 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "d61f7eef-c0be-4fb9-80d8-9220e406dc88" (UID: "d61f7eef-c0be-4fb9-80d8-9220e406dc88"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214878 4769 reconciler_common.go:293] "Volume detached for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovs-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214902 4769 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214919 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/d61f7eef-c0be-4fb9-80d8-9220e406dc88-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214934 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d61f7eef-c0be-4fb9-80d8-9220e406dc88-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.214946 4769 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-log-ovn\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.215016 4769 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/e62e4f7d-ce60-4d0f-8f07-af5052da5427-var-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.215412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62e4f7d-ce60-4d0f-8f07-af5052da5427-scripts" (OuterVolumeSpecName: "scripts") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.218679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e62e4f7d-ce60-4d0f-8f07-af5052da5427-kube-api-access-vnzln" (OuterVolumeSpecName: "kube-api-access-vnzln") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "kube-api-access-vnzln". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.218905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d61f7eef-c0be-4fb9-80d8-9220e406dc88-kube-api-access-cfv86" (OuterVolumeSpecName: "kube-api-access-cfv86") pod "d61f7eef-c0be-4fb9-80d8-9220e406dc88" (UID: "d61f7eef-c0be-4fb9-80d8-9220e406dc88"). InnerVolumeSpecName "kube-api-access-cfv86". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.241437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.255281 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d61f7eef-c0be-4fb9-80d8-9220e406dc88" (UID: "d61f7eef-c0be-4fb9-80d8-9220e406dc88"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.317333 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.317373 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vnzln\" (UniqueName: \"kubernetes.io/projected/e62e4f7d-ce60-4d0f-8f07-af5052da5427-kube-api-access-vnzln\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.317384 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e62e4f7d-ce60-4d0f-8f07-af5052da5427-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.317399 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cfv86\" (UniqueName: \"kubernetes.io/projected/d61f7eef-c0be-4fb9-80d8-9220e406dc88-kube-api-access-cfv86\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.317412 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.317667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "d61f7eef-c0be-4fb9-80d8-9220e406dc88" (UID: "d61f7eef-c0be-4fb9-80d8-9220e406dc88"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.326876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-ovn-controller-tls-certs" (OuterVolumeSpecName: "ovn-controller-tls-certs") pod "e62e4f7d-ce60-4d0f-8f07-af5052da5427" (UID: "e62e4f7d-ce60-4d0f-8f07-af5052da5427"). InnerVolumeSpecName "ovn-controller-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.423424 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62e4f7d-ce60-4d0f-8f07-af5052da5427-ovn-controller-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.423461 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/d61f7eef-c0be-4fb9-80d8-9220e406dc88-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.481285 4769 generic.go:334] "Generic (PLEG): container finished" podID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" containerID="b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781" exitCode=0 Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.481391 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.481399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np" event={"ID":"e62e4f7d-ce60-4d0f-8f07-af5052da5427","Type":"ContainerDied","Data":"b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781"} Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.481431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np" event={"ID":"e62e4f7d-ce60-4d0f-8f07-af5052da5427","Type":"ContainerDied","Data":"d46081b4a604fb11976660f261795abb6c86247e25da098fc674a4b148a018c2"} Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.481447 4769 scope.go:117] "RemoveContainer" containerID="b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.486029 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.486121 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92" event={"ID":"da05a6c0-fa50-402b-9554-1d97e7c5d955","Type":"ContainerDied","Data":"69db7de3cb1cb9083188552c179f398c34037075d8653786f25b9feb4646e0c3"} Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.486155 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69db7de3cb1cb9083188552c179f398c34037075d8653786f25b9feb4646e0c3" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.488725 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-ft5ng_d61f7eef-c0be-4fb9-80d8-9220e406dc88/openstack-network-exporter/0.log" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.488777 4769 generic.go:334] "Generic (PLEG): container finished" podID="d61f7eef-c0be-4fb9-80d8-9220e406dc88" containerID="0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f" exitCode=2 Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.489706 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-8c2d4\" not found" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.490372 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.492479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" event={"ID":"d61f7eef-c0be-4fb9-80d8-9220e406dc88","Type":"ContainerDied","Data":"0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f"} Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.492523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-ft5ng" event={"ID":"d61f7eef-c0be-4fb9-80d8-9220e406dc88","Type":"ContainerDied","Data":"e5ef6c3d86347ebd970cb432f0ba534e837c9047a9da310ab21938777fe8f1fe"} Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.512776 4769 scope.go:117] "RemoveContainer" containerID="b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781" Nov 21 12:28:24 crc kubenswrapper[4769]: E1121 12:28:24.513612 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781\": container with ID starting with b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781 not found: ID does not exist" containerID="b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.513679 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781"} err="failed to get container status \"b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781\": rpc error: code = NotFound desc = could not find container \"b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781\": container with ID starting with b223726267507eb09058d60e75f65f72e41c294235a0eb8cff15a4916a33a781 not found: ID does not exist" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.513719 4769 scope.go:117] "RemoveContainer" containerID="0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.544712 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92"] Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.556897 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np-config-v8t92"] Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.561730 4769 scope.go:117] "RemoveContainer" containerID="0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f" Nov 21 12:28:24 crc kubenswrapper[4769]: E1121 12:28:24.562638 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f\": container with ID starting with 0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f not found: ID does not exist" containerID="0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.562682 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f"} err="failed to get container status \"0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f\": rpc error: code = NotFound desc = could not find container \"0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f\": container with ID starting with 0ad941b6cc861ba82db82e451c98a5ca62f1273de4056a16d601270bec904a0f not found: ID does not exist" Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.572796 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np"] Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.575065 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-sl7np"] Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.616015 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-ft5ng"] Nov 21 12:28:24 crc kubenswrapper[4769]: I1121 12:28:24.630727 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-ft5ng"] Nov 21 12:28:25 crc kubenswrapper[4769]: E1121 12:28:25.139694 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Nov 21 12:28:25 crc kubenswrapper[4769]: E1121 12:28:25.139789 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts podName:0119a94b-1f20-45e1-a1dc-d01dc397cb9d nodeName:}" failed. No retries permitted until 2025-11-21 12:28:27.139766375 +0000 UTC m=+2265.840428193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts") pod "ovn-controller-ovs-l29rw" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d") : configmap "ovncontroller-scripts" not found Nov 21 12:28:25 crc kubenswrapper[4769]: I1121 12:28:25.289038 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d61f7eef-c0be-4fb9-80d8-9220e406dc88" path="/var/lib/kubelet/pods/d61f7eef-c0be-4fb9-80d8-9220e406dc88/volumes" Nov 21 12:28:25 crc kubenswrapper[4769]: I1121 12:28:25.290098 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da05a6c0-fa50-402b-9554-1d97e7c5d955" path="/var/lib/kubelet/pods/da05a6c0-fa50-402b-9554-1d97e7c5d955/volumes" Nov 21 12:28:25 crc kubenswrapper[4769]: I1121 12:28:25.290784 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" path="/var/lib/kubelet/pods/e62e4f7d-ce60-4d0f-8f07-af5052da5427/volumes" Nov 21 12:28:25 crc kubenswrapper[4769]: I1121 12:28:25.883929 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovs-vswitchd" containerID="cri-o://e77ac84ab00a0dd09f8beb69669f066368788011a674ef1c23ec3b7bf20b51a5" gracePeriod=30 Nov 21 12:28:26 crc kubenswrapper[4769]: E1121 12:28:26.166342 4769 handlers.go:78] "Exec lifecycle hook for Container in Pod failed" err=< Nov 21 12:28:26 crc kubenswrapper[4769]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Nov 21 12:28:26 crc kubenswrapper[4769]: + source /usr/local/bin/container-scripts/functions Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNBridge=br-int Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNRemote=tcp:localhost:6642 Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNEncapType=geneve Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNAvailabilityZones= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ EnableChassisAsGateway=true Nov 21 12:28:26 crc kubenswrapper[4769]: ++ PhysicalNetworks= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNHostName= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ DB_FILE=/etc/openvswitch/conf.db Nov 21 12:28:26 crc kubenswrapper[4769]: ++ ovs_dir=/var/lib/openvswitch Nov 21 12:28:26 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Nov 21 12:28:26 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Nov 21 12:28:26 crc kubenswrapper[4769]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:28:26 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:28:26 crc kubenswrapper[4769]: + sleep 0.5 Nov 21 12:28:26 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:28:26 crc kubenswrapper[4769]: + cleanup_ovsdb_server_semaphore Nov 21 12:28:26 crc kubenswrapper[4769]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:28:26 crc kubenswrapper[4769]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Nov 21 12:28:26 crc kubenswrapper[4769]: > execCommand=["/usr/local/bin/container-scripts/stop-ovsdb-server.sh"] containerName="ovsdb-server" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" message=< Nov 21 12:28:26 crc kubenswrapper[4769]: Exiting ovsdb-server (5) [ OK ] Nov 21 12:28:26 crc kubenswrapper[4769]: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Nov 21 12:28:26 crc kubenswrapper[4769]: + source /usr/local/bin/container-scripts/functions Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNBridge=br-int Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNRemote=tcp:localhost:6642 Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNEncapType=geneve Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNAvailabilityZones= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ EnableChassisAsGateway=true Nov 21 12:28:26 crc kubenswrapper[4769]: ++ PhysicalNetworks= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNHostName= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ DB_FILE=/etc/openvswitch/conf.db Nov 21 12:28:26 crc kubenswrapper[4769]: ++ ovs_dir=/var/lib/openvswitch Nov 21 12:28:26 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Nov 21 12:28:26 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Nov 21 12:28:26 crc kubenswrapper[4769]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:28:26 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:28:26 crc kubenswrapper[4769]: + sleep 0.5 Nov 21 12:28:26 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:28:26 crc kubenswrapper[4769]: + cleanup_ovsdb_server_semaphore Nov 21 12:28:26 crc kubenswrapper[4769]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:28:26 crc kubenswrapper[4769]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Nov 21 12:28:26 crc kubenswrapper[4769]: > Nov 21 12:28:26 crc kubenswrapper[4769]: E1121 12:28:26.166431 4769 kuberuntime_container.go:691] "PreStop hook failed" err=< Nov 21 12:28:26 crc kubenswrapper[4769]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Nov 21 12:28:26 crc kubenswrapper[4769]: + source /usr/local/bin/container-scripts/functions Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNBridge=br-int Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNRemote=tcp:localhost:6642 Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNEncapType=geneve Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNAvailabilityZones= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ EnableChassisAsGateway=true Nov 21 12:28:26 crc kubenswrapper[4769]: ++ PhysicalNetworks= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ OVNHostName= Nov 21 12:28:26 crc kubenswrapper[4769]: ++ DB_FILE=/etc/openvswitch/conf.db Nov 21 12:28:26 crc kubenswrapper[4769]: ++ ovs_dir=/var/lib/openvswitch Nov 21 12:28:26 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Nov 21 12:28:26 crc kubenswrapper[4769]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Nov 21 12:28:26 crc kubenswrapper[4769]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:28:26 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:28:26 crc kubenswrapper[4769]: + sleep 0.5 Nov 21 12:28:26 crc kubenswrapper[4769]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Nov 21 12:28:26 crc kubenswrapper[4769]: + cleanup_ovsdb_server_semaphore Nov 21 12:28:26 crc kubenswrapper[4769]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Nov 21 12:28:26 crc kubenswrapper[4769]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Nov 21 12:28:26 crc kubenswrapper[4769]: > pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server" containerID="cri-o://d345609de63f0e89ed18a83d4611ae774edc318d4a2504fe28397c4706237421" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.166509 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server" containerID="cri-o://d345609de63f0e89ed18a83d4611ae774edc318d4a2504fe28397c4706237421" gracePeriod=30 Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.519726 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-l29rw_0119a94b-1f20-45e1-a1dc-d01dc397cb9d/ovs-vswitchd/0.log" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.520897 4769 generic.go:334] "Generic (PLEG): container finished" podID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerID="e77ac84ab00a0dd09f8beb69669f066368788011a674ef1c23ec3b7bf20b51a5" exitCode=143 Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.520924 4769 generic.go:334] "Generic (PLEG): container finished" podID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerID="d345609de63f0e89ed18a83d4611ae774edc318d4a2504fe28397c4706237421" exitCode=0 Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.520952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerDied","Data":"e77ac84ab00a0dd09f8beb69669f066368788011a674ef1c23ec3b7bf20b51a5"} Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.521010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerDied","Data":"d345609de63f0e89ed18a83d4611ae774edc318d4a2504fe28397c4706237421"} Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.521025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" event={"ID":"0119a94b-1f20-45e1-a1dc-d01dc397cb9d","Type":"ContainerDied","Data":"f44a1279939605adc30df98a06076c5c4fe3b0c54ea6bba2d3eac9f33e7091a9"} Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.521040 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f44a1279939605adc30df98a06076c5c4fe3b0c54ea6bba2d3eac9f33e7091a9" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.597737 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-l29rw_0119a94b-1f20-45e1-a1dc-d01dc397cb9d/ovs-vswitchd/0.log" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.599750 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.667141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-run\") pod \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.667314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txh2d\" (UniqueName: \"kubernetes.io/projected/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-kube-api-access-txh2d\") pod \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.667416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-log\") pod \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.667473 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-lib\") pod \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.667511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-etc-ovs\") pod \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.667566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts\") pod \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\" (UID: \"0119a94b-1f20-45e1-a1dc-d01dc397cb9d\") " Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.668277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-run" (OuterVolumeSpecName: "var-run") pod "0119a94b-1f20-45e1-a1dc-d01dc397cb9d" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.668491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-etc-ovs" (OuterVolumeSpecName: "etc-ovs") pod "0119a94b-1f20-45e1-a1dc-d01dc397cb9d" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d"). InnerVolumeSpecName "etc-ovs". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.668406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-lib" (OuterVolumeSpecName: "var-lib") pod "0119a94b-1f20-45e1-a1dc-d01dc397cb9d" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d"). InnerVolumeSpecName "var-lib". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.668465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-log" (OuterVolumeSpecName: "var-log") pod "0119a94b-1f20-45e1-a1dc-d01dc397cb9d" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.669285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts" (OuterVolumeSpecName: "scripts") pod "0119a94b-1f20-45e1-a1dc-d01dc397cb9d" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.687466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-kube-api-access-txh2d" (OuterVolumeSpecName: "kube-api-access-txh2d") pod "0119a94b-1f20-45e1-a1dc-d01dc397cb9d" (UID: "0119a94b-1f20-45e1-a1dc-d01dc397cb9d"). InnerVolumeSpecName "kube-api-access-txh2d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.770004 4769 reconciler_common.go:293] "Volume detached for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-etc-ovs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.770057 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.770068 4769 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.770081 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-txh2d\" (UniqueName: \"kubernetes.io/projected/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-kube-api-access-txh2d\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.770092 4769 reconciler_common.go:293] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-log\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.770102 4769 reconciler_common.go:293] "Volume detached for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/0119a94b-1f20-45e1-a1dc-d01dc397cb9d-var-lib\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.839144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:26 crc kubenswrapper[4769]: I1121 12:28:26.839244 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:27 crc kubenswrapper[4769]: I1121 12:28:27.532021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-l29rw" Nov 21 12:28:27 crc kubenswrapper[4769]: I1121 12:28:27.564394 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-l29rw"] Nov 21 12:28:27 crc kubenswrapper[4769]: I1121 12:28:27.573559 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-l29rw"] Nov 21 12:28:27 crc kubenswrapper[4769]: I1121 12:28:27.886726 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-marketplace-6jkbx" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="registry-server" probeResult="failure" output=< Nov 21 12:28:27 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:28:27 crc kubenswrapper[4769]: > Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.287959 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" path="/var/lib/kubelet/pods/0119a94b-1f20-45e1-a1dc-d01dc397cb9d/volumes" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.297145 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.409945 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:42330->38.102.83.227:40411: write tcp 38.102.83.227:42330->38.102.83.227:40411: write: broken pipe Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.422328 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.422417 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data podName:31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301 nodeName:}" failed. No retries permitted until 2025-11-21 12:28:29.922393449 +0000 UTC m=+2268.623055267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data") pod "rabbitmq-cell1-server-0" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521328 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder52d4-account-delete-mtt6h"] Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.521773 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server-init" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521792 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server-init" Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.521813 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521820 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server" Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.521834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" containerName="ovn-controller" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521840 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" containerName="ovn-controller" Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.521854 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="da05a6c0-fa50-402b-9554-1d97e7c5d955" containerName="ovn-config" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521860 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="da05a6c0-fa50-402b-9554-1d97e7c5d955" containerName="ovn-config" Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.521868 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d61f7eef-c0be-4fb9-80d8-9220e406dc88" containerName="openstack-network-exporter" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521875 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61f7eef-c0be-4fb9-80d8-9220e406dc88" containerName="openstack-network-exporter" Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.521894 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovs-vswitchd" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.521902 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovs-vswitchd" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.522085 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e62e4f7d-ce60-4d0f-8f07-af5052da5427" containerName="ovn-controller" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.522094 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d61f7eef-c0be-4fb9-80d8-9220e406dc88" containerName="openstack-network-exporter" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.522101 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovsdb-server" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.522116 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0119a94b-1f20-45e1-a1dc-d01dc397cb9d" containerName="ovs-vswitchd" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.522131 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="da05a6c0-fa50-402b-9554-1d97e7c5d955" containerName="ovn-config" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.522794 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.541161 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder52d4-account-delete-mtt6h"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.569994 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.570456 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="openstack-network-exporter" containerID="cri-o://065ec9c640d6e0b1ce47372adc1e38d140372e8da5dd41e7d8a22523d1c4143d" gracePeriod=300 Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.585566 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.587384 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="d4f893d1-0e6e-453b-898e-9d3a5b356c7d" containerName="openstackclient" containerID="cri-o://cf007a44166b81d3a19a2d768bced5fb403930d33c79d57e889c4f7605de2fb9" gracePeriod=2 Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.626406 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b655s\" (UniqueName: \"kubernetes.io/projected/b83c7f40-ebcf-4637-96ee-832bb5b8907d-kube-api-access-b655s\") pod \"cinder52d4-account-delete-mtt6h\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.626535 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b83c7f40-ebcf-4637-96ee-832bb5b8907d-operator-scripts\") pod \"cinder52d4-account-delete-mtt6h\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.632594 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.650510 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement373d-account-delete-8bwrt"] Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.651001 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4f893d1-0e6e-453b-898e-9d3a5b356c7d" containerName="openstackclient" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.651026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f893d1-0e6e-453b-898e-9d3a5b356c7d" containerName="openstackclient" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.651322 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4f893d1-0e6e-453b-898e-9d3a5b356c7d" containerName="openstackclient" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.652112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.727801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9595d186-9a49-465e-a5b7-555a9d45d578-operator-scripts\") pod \"placement373d-account-delete-8bwrt\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.727850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llrgk\" (UniqueName: \"kubernetes.io/projected/9595d186-9a49-465e-a5b7-555a9d45d578-kube-api-access-llrgk\") pod \"placement373d-account-delete-8bwrt\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.727883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b655s\" (UniqueName: \"kubernetes.io/projected/b83c7f40-ebcf-4637-96ee-832bb5b8907d-kube-api-access-b655s\") pod \"cinder52d4-account-delete-mtt6h\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.727954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b83c7f40-ebcf-4637-96ee-832bb5b8907d-operator-scripts\") pod \"cinder52d4-account-delete-mtt6h\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.728773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b83c7f40-ebcf-4637-96ee-832bb5b8907d-operator-scripts\") pod \"cinder52d4-account-delete-mtt6h\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.751525 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance66cf-account-delete-vxg8c"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.753557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.810418 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.811594 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.811978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b655s\" (UniqueName: \"kubernetes.io/projected/b83c7f40-ebcf-4637-96ee-832bb5b8907d-kube-api-access-b655s\") pod \"cinder52d4-account-delete-mtt6h\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.829667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq5jq\" (UniqueName: \"kubernetes.io/projected/d5c43124-452d-4146-aed0-d061973658e2-kube-api-access-wq5jq\") pod \"barbicane4c5-account-delete-mz4hb\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.829740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9595d186-9a49-465e-a5b7-555a9d45d578-operator-scripts\") pod \"placement373d-account-delete-8bwrt\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.829765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-llrgk\" (UniqueName: \"kubernetes.io/projected/9595d186-9a49-465e-a5b7-555a9d45d578-kube-api-access-llrgk\") pod \"placement373d-account-delete-8bwrt\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.829824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf24r\" (UniqueName: \"kubernetes.io/projected/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-kube-api-access-gf24r\") pod \"glance66cf-account-delete-vxg8c\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.829864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-operator-scripts\") pod \"glance66cf-account-delete-vxg8c\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.829886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5c43124-452d-4146-aed0-d061973658e2-operator-scripts\") pod \"barbicane4c5-account-delete-mz4hb\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.830627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9595d186-9a49-465e-a5b7-555a9d45d578-operator-scripts\") pod \"placement373d-account-delete-8bwrt\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.853786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-llrgk\" (UniqueName: \"kubernetes.io/projected/9595d186-9a49-465e-a5b7-555a9d45d578-kube-api-access-llrgk\") pod \"placement373d-account-delete-8bwrt\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.895150 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron86b3-account-delete-ggrcm"] Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.896720 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.921066 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="ovsdbserver-sb" containerID="cri-o://576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b" gracePeriod=300 Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.932497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gf24r\" (UniqueName: \"kubernetes.io/projected/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-kube-api-access-gf24r\") pod \"glance66cf-account-delete-vxg8c\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.932619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-644vc\" (UniqueName: \"kubernetes.io/projected/ad288522-75bb-4bfc-b547-c2552f8c2995-kube-api-access-644vc\") pod \"neutron86b3-account-delete-ggrcm\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.932669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-operator-scripts\") pod \"glance66cf-account-delete-vxg8c\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.932706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5c43124-452d-4146-aed0-d061973658e2-operator-scripts\") pod \"barbicane4c5-account-delete-mz4hb\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.932780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wq5jq\" (UniqueName: \"kubernetes.io/projected/d5c43124-452d-4146-aed0-d061973658e2-kube-api-access-wq5jq\") pod \"barbicane4c5-account-delete-mz4hb\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.932809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad288522-75bb-4bfc-b547-c2552f8c2995-operator-scripts\") pod \"neutron86b3-account-delete-ggrcm\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.934247 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-operator-scripts\") pod \"glance66cf-account-delete-vxg8c\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.934931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5c43124-452d-4146-aed0-d061973658e2-operator-scripts\") pod \"barbicane4c5-account-delete-mz4hb\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.935000 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:29 crc kubenswrapper[4769]: E1121 12:28:29.935048 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data podName:31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301 nodeName:}" failed. No retries permitted until 2025-11-21 12:28:30.93503205 +0000 UTC m=+2269.635693868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data") pod "rabbitmq-cell1-server-0" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.961380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq5jq\" (UniqueName: \"kubernetes.io/projected/d5c43124-452d-4146-aed0-d061973658e2-kube-api-access-wq5jq\") pod \"barbicane4c5-account-delete-mz4hb\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:29 crc kubenswrapper[4769]: I1121 12:28:29.985337 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-ghvhz"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.010898 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-ghvhz"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.024549 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf24r\" (UniqueName: \"kubernetes.io/projected/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-kube-api-access-gf24r\") pod \"glance66cf-account-delete-vxg8c\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.034705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-644vc\" (UniqueName: \"kubernetes.io/projected/ad288522-75bb-4bfc-b547-c2552f8c2995-kube-api-access-644vc\") pod \"neutron86b3-account-delete-ggrcm\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.034822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad288522-75bb-4bfc-b547-c2552f8c2995-operator-scripts\") pod \"neutron86b3-account-delete-ggrcm\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.035775 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad288522-75bb-4bfc-b547-c2552f8c2995-operator-scripts\") pod \"neutron86b3-account-delete-ggrcm\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.058364 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapica3a-account-delete-xtnxd"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.069946 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.079905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-644vc\" (UniqueName: \"kubernetes.io/projected/ad288522-75bb-4bfc-b547-c2552f8c2995-kube-api-access-644vc\") pod \"neutron86b3-account-delete-ggrcm\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.107134 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.130825 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.137148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfrt\" (UniqueName: \"kubernetes.io/projected/25d52098-169f-48dd-89d3-89cbba99b7c4-kube-api-access-lnfrt\") pod \"novaapica3a-account-delete-xtnxd\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.137276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25d52098-169f-48dd-89d3-89cbba99b7c4-operator-scripts\") pod \"novaapica3a-account-delete-xtnxd\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.144200 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance66cf-account-delete-vxg8c"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.150952 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.187274 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement373d-account-delete-8bwrt"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.212664 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.238416 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.252212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25d52098-169f-48dd-89d3-89cbba99b7c4-operator-scripts\") pod \"novaapica3a-account-delete-xtnxd\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.252426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfrt\" (UniqueName: \"kubernetes.io/projected/25d52098-169f-48dd-89d3-89cbba99b7c4-kube-api-access-lnfrt\") pod \"novaapica3a-account-delete-xtnxd\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.253853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25d52098-169f-48dd-89d3-89cbba99b7c4-operator-scripts\") pod \"novaapica3a-account-delete-xtnxd\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.271644 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.272924 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.273402 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="openstack-network-exporter" containerID="cri-o://a296db2bbb1a0ec5378d886408b8069b843e087e2a97cd5b7ac759ff43b3104d" gracePeriod=300 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.313958 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell151fa-account-delete-dzwtl"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.315222 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.322806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfrt\" (UniqueName: \"kubernetes.io/projected/25d52098-169f-48dd-89d3-89cbba99b7c4-kube-api-access-lnfrt\") pod \"novaapica3a-account-delete-xtnxd\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.360680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f1b72391-1ff2-4f97-bbf0-c928045f6395-operator-scripts\") pod \"novacell151fa-account-delete-dzwtl\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.361869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7786\" (UniqueName: \"kubernetes.io/projected/f1b72391-1ff2-4f97-bbf0-c928045f6395-kube-api-access-r7786\") pod \"novacell151fa-account-delete-dzwtl\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.363457 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-wc85q"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.374065 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.444800 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="ovsdbserver-nb" containerID="cri-o://1bb06acd6e3f426a5168eac18c0fe9ba87116b36d8da1fea28749a22180f106e" gracePeriod=300 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.461156 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-wc85q"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.491884 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.492574 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="ovn-northd" containerID="cri-o://64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.492829 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="openstack-network-exporter" containerID="cri-o://a6aea864b65349fff1b9b42caf5b5f4a0d8bbd1fa473c1220dfc154554c18240" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.513868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r7786\" (UniqueName: \"kubernetes.io/projected/f1b72391-1ff2-4f97-bbf0-c928045f6395-kube-api-access-r7786\") pod \"novacell151fa-account-delete-dzwtl\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.524907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7786\" (UniqueName: \"kubernetes.io/projected/f1b72391-1ff2-4f97-bbf0-c928045f6395-kube-api-access-r7786\") pod \"novacell151fa-account-delete-dzwtl\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.551866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f1b72391-1ff2-4f97-bbf0-c928045f6395-operator-scripts\") pod \"novacell151fa-account-delete-dzwtl\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.554720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f1b72391-1ff2-4f97-bbf0-c928045f6395-operator-scripts\") pod \"novacell151fa-account-delete-dzwtl\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.607577 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell151fa-account-delete-dzwtl"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.619891 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapica3a-account-delete-xtnxd"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.642127 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell08833-account-delete-jlwbf"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.643576 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.650592 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron86b3-account-delete-ggrcm"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.668447 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-pztn6"] Nov 21 12:28:30 crc kubenswrapper[4769]: E1121 12:28:30.668575 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b is running failed: container process not found" containerID="576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:28:30 crc kubenswrapper[4769]: E1121 12:28:30.669319 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b is running failed: container process not found" containerID="576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:28:30 crc kubenswrapper[4769]: E1121 12:28:30.670309 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b is running failed: container process not found" containerID="576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:28:30 crc kubenswrapper[4769]: E1121 12:28:30.670357 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="ovsdbserver-sb" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.695287 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-7s4wh"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.699766 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4181add-a741-47a8-986b-ff015685ab63/ovsdbserver-nb/0.log" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.699825 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4181add-a741-47a8-986b-ff015685ab63" containerID="a296db2bbb1a0ec5378d886408b8069b843e087e2a97cd5b7ac759ff43b3104d" exitCode=2 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.699952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4181add-a741-47a8-986b-ff015685ab63","Type":"ContainerDied","Data":"a296db2bbb1a0ec5378d886408b8069b843e087e2a97cd5b7ac759ff43b3104d"} Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.708804 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-pztn6"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.709484 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0c1dca80-5bc5-46d8-bfe6-fb395e82b774/ovsdbserver-sb/0.log" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.709536 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerID="065ec9c640d6e0b1ce47372adc1e38d140372e8da5dd41e7d8a22523d1c4143d" exitCode=2 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.709560 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerID="576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b" exitCode=143 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.709581 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0c1dca80-5bc5-46d8-bfe6-fb395e82b774","Type":"ContainerDied","Data":"065ec9c640d6e0b1ce47372adc1e38d140372e8da5dd41e7d8a22523d1c4143d"} Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.709609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0c1dca80-5bc5-46d8-bfe6-fb395e82b774","Type":"ContainerDied","Data":"576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b"} Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.731303 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-7s4wh"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.747108 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.752811 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-2lx2g"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.764075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f29aa49-a966-46a2-9f51-a5f344b0944a-operator-scripts\") pod \"novacell08833-account-delete-jlwbf\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.764251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq8bz\" (UniqueName: \"kubernetes.io/projected/8f29aa49-a966-46a2-9f51-a5f344b0944a-kube-api-access-tq8bz\") pod \"novacell08833-account-delete-jlwbf\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.779471 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-2lx2g"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.797386 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.797827 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-qz2pc"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.815674 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell08833-account-delete-jlwbf"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.868469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tq8bz\" (UniqueName: \"kubernetes.io/projected/8f29aa49-a966-46a2-9f51-a5f344b0944a-kube-api-access-tq8bz\") pod \"novacell08833-account-delete-jlwbf\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.868641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f29aa49-a966-46a2-9f51-a5f344b0944a-operator-scripts\") pod \"novacell08833-account-delete-jlwbf\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.879649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f29aa49-a966-46a2-9f51-a5f344b0944a-operator-scripts\") pod \"novacell08833-account-delete-jlwbf\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.882567 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.902846 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-4xrxp"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.911983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq8bz\" (UniqueName: \"kubernetes.io/projected/8f29aa49-a966-46a2-9f51-a5f344b0944a-kube-api-access-tq8bz\") pod \"novacell08833-account-delete-jlwbf\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.920325 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qvjzw"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.955660 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-qvjzw"] Nov 21 12:28:30 crc kubenswrapper[4769]: E1121 12:28:30.970215 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:30 crc kubenswrapper[4769]: E1121 12:28:30.970296 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data podName:31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301 nodeName:}" failed. No retries permitted until 2025-11-21 12:28:32.97027661 +0000 UTC m=+2271.670938428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data") pod "rabbitmq-cell1-server-0" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.977614 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978088 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-server" containerID="cri-o://d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978704 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="swift-recon-cron" containerID="cri-o://1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978752 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="rsync" containerID="cri-o://44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978785 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-expirer" containerID="cri-o://8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978817 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-updater" containerID="cri-o://84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-auditor" containerID="cri-o://2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978881 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-replicator" containerID="cri-o://d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978912 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-server" containerID="cri-o://3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.978946 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-updater" containerID="cri-o://00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.979012 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-auditor" containerID="cri-o://75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.979042 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-replicator" containerID="cri-o://0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.979077 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-server" containerID="cri-o://ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.979110 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-reaper" containerID="cri-o://42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.979156 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-auditor" containerID="cri-o://db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.979205 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-replicator" containerID="cri-o://94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.996637 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.996888 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="cinder-scheduler" containerID="cri-o://6d49d98619ee6cdd108b34a214e56a3a10487178b559a6a4ca100eb8c8680c8f" gracePeriod=30 Nov 21 12:28:30 crc kubenswrapper[4769]: I1121 12:28:30.997390 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="probe" containerID="cri-o://0fb0a642c9ce1976223af5451527b445f097c8a7afc70cd602bd2f6a565363e6" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.002239 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.023018 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.043352 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.056762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.083501 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.083802 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api-log" containerID="cri-o://9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.083935 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api" containerID="cri-o://677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.096944 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-67946cbd78-pffwl"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.097264 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-log" containerID="cri-o://0007ac30b31f0ce12a8d4ec3ce279639c0cf5ed4f1fab2916d85d12034efbeca" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.097322 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-api" containerID="cri-o://e37e8ca9c13159ff75dbefc98fa8e79d84ee836baf47fc1b85942a8dbbf77b7f" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: E1121 12:28:31.100441 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:28:31 crc kubenswrapper[4769]: E1121 12:28:31.100505 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data podName:7313da1b-b474-474a-acc2-51ee39d5d79b nodeName:}" failed. No retries permitted until 2025-11-21 12:28:31.600488706 +0000 UTC m=+2270.301150524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data") pod "rabbitmq-server-0" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b") : configmap "rabbitmq-config-data" not found Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.134936 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.141319 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.141579 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-log" containerID="cri-o://34c9d0a000299b8aa0798da9a634904fc939c7c330ef500f2aeb1dad6dab4995" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.141739 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-httpd" containerID="cri-o://a9cb286696dfabe46b8f1cad7b25766dec37fcb850bd3469c5a9ec7c9b313078" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.207434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.207587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.207624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm2nw\" (UniqueName: \"kubernetes.io/projected/c3120607-413a-487d-98ce-7ae0e94fd1f3-kube-api-access-mm2nw\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.231280 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.231533 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-log" containerID="cri-o://e1a8a85295fbfaf9ddcacaf104c7e3a5187c32bb6d23ba29095d186d1500d7e3" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.231975 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-httpd" containerID="cri-o://da9b83ab069f95e46f81bc4c86275abda61442db99af1310087deeb06729e95c" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.245272 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-687b9949b6-8nd9m"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.245495 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-api" containerID="cri-o://209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.245948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-httpd" containerID="cri-o://61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.320613 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.338650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.338717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mm2nw\" (UniqueName: \"kubernetes.io/projected/c3120607-413a-487d-98ce-7ae0e94fd1f3-kube-api-access-mm2nw\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.324836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.345493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.370484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm2nw\" (UniqueName: \"kubernetes.io/projected/c3120607-413a-487d-98ce-7ae0e94fd1f3-kube-api-access-mm2nw\") pod \"dnsmasq-dnsmasq-84b9f45d47-kbsj9\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.393564 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08ab69b0-1536-4e46-8ecc-b3cee3a42bff" path="/var/lib/kubelet/pods/08ab69b0-1536-4e46-8ecc-b3cee3a42bff/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.418659 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd433e9-e3b1-47c7-877c-6c83f995bd4c" path="/var/lib/kubelet/pods/0dd433e9-e3b1-47c7-877c-6c83f995bd4c/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.420146 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d" path="/var/lib/kubelet/pods/1bdaf5cd-2ddd-4bb8-84d2-1d49da4e854d/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.435672 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="333b5f7e-9eff-47a7-bf3b-5cd0c1293e45" path="/var/lib/kubelet/pods/333b5f7e-9eff-47a7-bf3b-5cd0c1293e45/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.437532 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c096c83-a4ea-4dee-8821-0381ced22974" path="/var/lib/kubelet/pods/3c096c83-a4ea-4dee-8821-0381ced22974/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.438877 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd64d3c-8006-4019-8e5c-81d4d8467fce" path="/var/lib/kubelet/pods/3dd64d3c-8006-4019-8e5c-81d4d8467fce/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.440043 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c6c82f0-38b6-4948-b467-6d176d2072d4" path="/var/lib/kubelet/pods/6c6c82f0-38b6-4948-b467-6d176d2072d4/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.450549 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce3d3815-ca29-4e8d-bb53-81364e18feb4" path="/var/lib/kubelet/pods/ce3d3815-ca29-4e8d-bb53-81364e18feb4/volumes" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.453661 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.453926 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement373d-account-delete-8bwrt"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.453939 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.453954 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.453966 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.457894 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-log" containerID="cri-o://2a990d18d760f975a0be3c11e04d817fc89798392bc035ca3ed0766d105d9af0" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.458393 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener-log" containerID="cri-o://38787751ae9b4a94077db573bfadf380c7880a0b40b47ae9fd11fca5829626d0" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.458674 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-log" containerID="cri-o://25b1a6d430b0e6524a6bc0e8066ada3b4eac6044cbff1aa6699d8fd23351f774" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.458811 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener" containerID="cri-o://02e96ff8d49d4c0f1df8aad8bb6c2f91758c057b24bd5ec7ce588fc4f2b2caad" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.458956 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-api" containerID="cri-o://34cd3387ad221c34560c76abcd77a2a62d83a55afb99a7549ca55e84d12a6368" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.458927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-metadata" containerID="cri-o://eacfe69496d42243648977490be543cfccfa90344dc261525b705d4e2b35f758" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.468358 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7dvxm"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.476480 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.540530 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7dvxm"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.590939 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.591284 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker-log" containerID="cri-o://4d98cc64d4cbc1a8819c3d7c4e329de8b3d6c9afa10b7c1054e400933f42f8c0" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.591753 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker" containerID="cri-o://214d2c35599922b5291aa6d73f8104c9866c71f665821c87c6c975ac55bf1faa" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.649513 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.660592 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0c1dca80-5bc5-46d8-bfe6-fb395e82b774/ovsdbserver-sb/0.log" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.660679 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.668259 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-51fa-account-create-4tlfv"] Nov 21 12:28:31 crc kubenswrapper[4769]: E1121 12:28:31.702672 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:28:31 crc kubenswrapper[4769]: E1121 12:28:31.704471 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data podName:7313da1b-b474-474a-acc2-51ee39d5d79b nodeName:}" failed. No retries permitted until 2025-11-21 12:28:32.704448344 +0000 UTC m=+2271.405110172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data") pod "rabbitmq-server-0" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b") : configmap "rabbitmq-config-data" not found Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.708774 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.735214 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.735766 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api-log" containerID="cri-o://017f91debc55afc1f32691f9fcb7a2055c6ca9f361ef281d2f91aa0faa9f7706" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.736271 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api" containerID="cri-o://f26dbf44d9fe564886ba9eac123dcb6e2ac8626a543596179180a5e7572e70f8" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.750746 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-2pd9x"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zp2w\" (UniqueName: \"kubernetes.io/projected/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-kube-api-access-2zp2w\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-metrics-certs-tls-certs\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-combined-ca-bundle\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdbserver-sb-tls-certs\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-scripts\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807599 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-config\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.807670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdb-rundir\") pod \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\" (UID: \"0c1dca80-5bc5-46d8-bfe6-fb395e82b774\") " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.811815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.829049 4769 generic.go:334] "Generic (PLEG): container finished" podID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerID="25b1a6d430b0e6524a6bc0e8066ada3b4eac6044cbff1aa6699d8fd23351f774" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.829224 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.829261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e1b857b2-7449-4450-a61a-7cc9bfff316f","Type":"ContainerDied","Data":"25b1a6d430b0e6524a6bc0e8066ada3b4eac6044cbff1aa6699d8fd23351f774"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.829492 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e67c9352-b51b-415a-a305-0e9b35c4370e" containerName="nova-cell0-conductor-conductor" containerID="cri-o://db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.834238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.837633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-config" (OuterVolumeSpecName: "config") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.842120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-scripts" (OuterVolumeSpecName: "scripts") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.871018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-kube-api-access-2zp2w" (OuterVolumeSpecName: "kube-api-access-2zp2w") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "kube-api-access-2zp2w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.877331 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerID="61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.877426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" event={"ID":"2e07dc8f-0539-4778-9191-6d6909c373c1","Type":"ContainerDied","Data":"61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.883049 4769 generic.go:334] "Generic (PLEG): container finished" podID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerID="9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.883124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a393fa88-8741-40b7-8a55-4f853c1722b8","Type":"ContainerDied","Data":"9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.884957 4769 generic.go:334] "Generic (PLEG): container finished" podID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerID="e1a8a85295fbfaf9ddcacaf104c7e3a5187c32bb6d23ba29095d186d1500d7e3" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.885000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"24e9adde-0ce7-4cf1-8c98-21458a046a0e","Type":"ContainerDied","Data":"e1a8a85295fbfaf9ddcacaf104c7e3a5187c32bb6d23ba29095d186d1500d7e3"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.886886 4769 generic.go:334] "Generic (PLEG): container finished" podID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerID="0007ac30b31f0ce12a8d4ec3ce279639c0cf5ed4f1fab2916d85d12034efbeca" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.886968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" event={"ID":"7d1af53a-9620-44a9-8a3c-fdea3faea22b","Type":"ContainerDied","Data":"0007ac30b31f0ce12a8d4ec3ce279639c0cf5ed4f1fab2916d85d12034efbeca"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.888968 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4181add-a741-47a8-986b-ff015685ab63/ovsdbserver-nb/0.log" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.889367 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4181add-a741-47a8-986b-ff015685ab63" containerID="1bb06acd6e3f426a5168eac18c0fe9ba87116b36d8da1fea28749a22180f106e" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.889433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4181add-a741-47a8-986b-ff015685ab63","Type":"ContainerDied","Data":"1bb06acd6e3f426a5168eac18c0fe9ba87116b36d8da1fea28749a22180f106e"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901242 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901275 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901283 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901290 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901296 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901306 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901314 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901320 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901327 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901333 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901341 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183" exitCode=0 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.901484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.932641 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell151fa-account-delete-dzwtl"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.945823 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2zp2w\" (UniqueName: \"kubernetes.io/projected/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-kube-api-access-2zp2w\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.945879 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.945889 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.945901 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.945909 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.951212 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" containerID="cri-o://e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.960612 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4f893d1-0e6e-453b-898e-9d3a5b356c7d" containerID="cf007a44166b81d3a19a2d768bced5fb403930d33c79d57e889c4f7605de2fb9" exitCode=137 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.964371 4769 generic.go:334] "Generic (PLEG): container finished" podID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerID="2a990d18d760f975a0be3c11e04d817fc89798392bc035ca3ed0766d105d9af0" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.964436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8db99cd8-81fb-414a-8eec-3db988f78f5e","Type":"ContainerDied","Data":"2a990d18d760f975a0be3c11e04d817fc89798392bc035ca3ed0766d105d9af0"} Nov 21 12:28:31 crc kubenswrapper[4769]: W1121 12:28:31.964795 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda52a4fb6_9ae7_4444_9a40_fdc68ebfe21b.slice/crio-847f1a130c0a778ab01af3a762aa61d28d1f82d55baebed46f24eb5b7b6f51c1 WatchSource:0}: Error finding container 847f1a130c0a778ab01af3a762aa61d28d1f82d55baebed46f24eb5b7b6f51c1: Status 404 returned error can't find the container with id 847f1a130c0a778ab01af3a762aa61d28d1f82d55baebed46f24eb5b7b6f51c1 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.966582 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.967718 4769 generic.go:334] "Generic (PLEG): container finished" podID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerID="34c9d0a000299b8aa0798da9a634904fc939c7c330ef500f2aeb1dad6dab4995" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.967798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"60d48f3d-32e3-4de7-8634-0f876ed5ac2f","Type":"ContainerDied","Data":"34c9d0a000299b8aa0798da9a634904fc939c7c330ef500f2aeb1dad6dab4995"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.977779 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.978002 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerName="nova-cell1-conductor-conductor" containerID="cri-o://79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" gracePeriod=30 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.983816 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-xmpwt"] Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.985035 4769 generic.go:334] "Generic (PLEG): container finished" podID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerID="a6aea864b65349fff1b9b42caf5b5f4a0d8bbd1fa473c1220dfc154554c18240" exitCode=2 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.985124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ca83904-6406-45e4-bfc1-6a953ed672b5","Type":"ContainerDied","Data":"a6aea864b65349fff1b9b42caf5b5f4a0d8bbd1fa473c1220dfc154554c18240"} Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.988200 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerID="38787751ae9b4a94077db573bfadf380c7880a0b40b47ae9fd11fca5829626d0" exitCode=143 Nov 21 12:28:31 crc kubenswrapper[4769]: I1121 12:28:31.988257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" event={"ID":"6b0e43c9-665b-4c35-9eb3-f10936347547","Type":"ContainerDied","Data":"38787751ae9b4a94077db573bfadf380c7880a0b40b47ae9fd11fca5829626d0"} Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.003087 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0c1dca80-5bc5-46d8-bfe6-fb395e82b774/ovsdbserver-sb/0.log" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.003255 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.003269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0c1dca80-5bc5-46d8-bfe6-fb395e82b774","Type":"ContainerDied","Data":"d4676b7f92221b948486556671ab6d1fb63e4f5aa8bc5a9adc97070583326bca"} Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.003317 4769 scope.go:117] "RemoveContainer" containerID="065ec9c640d6e0b1ce47372adc1e38d140372e8da5dd41e7d8a22523d1c4143d" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.007292 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.007561 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5b1a8d65-32f5-486e-b01e-5f77f989621b" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://ff32259837c555f035ae17f9c7dbc6f2cf65abc18f7a5aed9461682668921b7a" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.012441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.015037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" event={"ID":"9595d186-9a49-465e-a5b7-555a9d45d578","Type":"ContainerStarted","Data":"33ba24ed199abbcbfab61f587380246c7a69676bbf3bd70368749726bce232cd"} Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.026966 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.047489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.049014 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.049096 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.049134 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.069162 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.117654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "0c1dca80-5bc5-46d8-bfe6-fb395e82b774" (UID: "0c1dca80-5bc5-46d8-bfe6-fb395e82b774"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.140889 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.152795 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c1dca80-5bc5-46d8-bfe6-fb395e82b774-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.165252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.165440 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="eaabdea5-a92a-4d83-a910-fe0a9993b278" containerName="nova-scheduler-scheduler" containerID="cri-o://42260c171b88c7201b3f08d2d92a0fc3baa74960ca7cd600a2537e91c72ca9a0" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.182304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance66cf-account-delete-vxg8c"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.189346 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4181add-a741-47a8-986b-ff015685ab63/ovsdbserver-nb/0.log" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.189438 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.200264 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.202000 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="rabbitmq" containerID="cri-o://d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85" gracePeriod=604800 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.245976 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder52d4-account-delete-mtt6h"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.253545 4769 scope.go:117] "RemoveContainer" containerID="576945bb65170ea5825de9fb1d9c2956b21f7681719419824cf7fa64220ebf0b" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-config\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwjcg\" (UniqueName: \"kubernetes.io/projected/f4181add-a741-47a8-986b-ff015685ab63-kube-api-access-qwjcg\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-ovsdbserver-nb-tls-certs\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4181add-a741-47a8-986b-ff015685ab63-ovsdb-rundir\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-scripts\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-combined-ca-bundle\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.254972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-metrics-certs-tls-certs\") pod \"f4181add-a741-47a8-986b-ff015685ab63\" (UID: \"f4181add-a741-47a8-986b-ff015685ab63\") " Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.256681 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.259520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4181add-a741-47a8-986b-ff015685ab63-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.260061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-config" (OuterVolumeSpecName: "config") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.260268 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-scripts" (OuterVolumeSpecName: "scripts") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.280018 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="rabbitmq" containerID="cri-o://6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1" gracePeriod=604800 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.280315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.280541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4181add-a741-47a8-986b-ff015685ab63-kube-api-access-qwjcg" (OuterVolumeSpecName: "kube-api-access-qwjcg") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "kube-api-access-qwjcg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.296901 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.305701 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.305857 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="ovn-northd" Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.306244 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.324723 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.360662 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.360749 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.362890 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.362920 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qwjcg\" (UniqueName: \"kubernetes.io/projected/f4181add-a741-47a8-986b-ff015685ab63-kube-api-access-qwjcg\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.362942 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.362956 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4181add-a741-47a8-986b-ff015685ab63-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.362968 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4181add-a741-47a8-986b-ff015685ab63-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.430601 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell151fa-account-delete-dzwtl"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.445237 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell08833-account-delete-jlwbf"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.485282 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapica3a-account-delete-xtnxd"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.520756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron86b3-account-delete-ggrcm"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.545084 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.546046 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="a614f405-9af6-4df3-b4ee-b062bd73077d" containerName="kube-state-metrics" containerID="cri-o://623848f9cf899442b90e26f118e5fe734ca71879282ecb184d2712f04fac5eca" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.602613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.618499 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.637610 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.638859 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-central-agent" containerID="cri-o://106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.639564 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="proxy-httpd" containerID="cri-o://e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.639621 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="sg-core" containerID="cri-o://36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.639697 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-notification-agent" containerID="cri-o://a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.647521 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.661480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.683958 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.683994 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.729613 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.785347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config\") pod \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.785470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config-secret\") pod \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.785588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj86k\" (UniqueName: \"kubernetes.io/projected/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-kube-api-access-jj86k\") pod \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.785610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-combined-ca-bundle\") pod \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\" (UID: \"d4f893d1-0e6e-453b-898e-9d3a5b356c7d\") " Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.786202 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.786253 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data podName:7313da1b-b474-474a-acc2-51ee39d5d79b nodeName:}" failed. No retries permitted until 2025-11-21 12:28:34.786236828 +0000 UTC m=+2273.486898646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data") pod "rabbitmq-server-0" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b") : configmap "rabbitmq-config-data" not found Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.797599 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-kube-api-access-jj86k" (OuterVolumeSpecName: "kube-api-access-jj86k") pod "d4f893d1-0e6e-453b-898e-9d3a5b356c7d" (UID: "d4f893d1-0e6e-453b-898e-9d3a5b356c7d"). InnerVolumeSpecName "kube-api-access-jj86k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.816045 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.816368 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-httpd" containerID="cri-o://30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.816512 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-server" containerID="cri-o://53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904" gracePeriod=30 Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.830478 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9"] Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.868463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "d4f893d1-0e6e-453b-898e-9d3a5b356c7d" (UID: "d4f893d1-0e6e-453b-898e-9d3a5b356c7d"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.871260 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4f893d1-0e6e-453b-898e-9d3a5b356c7d" (UID: "d4f893d1-0e6e-453b-898e-9d3a5b356c7d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.871825 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.890801 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jj86k\" (UniqueName: \"kubernetes.io/projected/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-kube-api-access-jj86k\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.890962 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.891068 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.891221 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.895557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "f4181add-a741-47a8-986b-ff015685ab63" (UID: "f4181add-a741-47a8-986b-ff015685ab63"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.907256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "d4f893d1-0e6e-453b-898e-9d3a5b356c7d" (UID: "d4f893d1-0e6e-453b-898e-9d3a5b356c7d"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.996373 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4181add-a741-47a8-986b-ff015685ab63-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: I1121 12:28:32.996726 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/d4f893d1-0e6e-453b-898e-9d3a5b356c7d-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.996803 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:32 crc kubenswrapper[4769]: E1121 12:28:32.996856 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data podName:31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301 nodeName:}" failed. No retries permitted until 2025-11-21 12:28:36.996838518 +0000 UTC m=+2275.697500336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data") pod "rabbitmq-cell1-server-0" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.041797 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.102:8080/healthcheck\": dial tcp 10.217.1.102:8080: connect: connection refused" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.042155 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.102:8080/healthcheck\": dial tcp 10.217.1.102:8080: connect: connection refused" Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.122462 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.134482 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.136297 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.136329 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerName="nova-cell1-conductor-conductor" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.142397 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerID="e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.142443 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerID="36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5" exitCode=2 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.142505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerDied","Data":"e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.142532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerDied","Data":"36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.175177 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerID="0fb0a642c9ce1976223af5451527b445f097c8a7afc70cd602bd2f6a565363e6" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.175263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3b8ee7d0-9900-447f-8b43-f72587e6c8c1","Type":"ContainerDied","Data":"0fb0a642c9ce1976223af5451527b445f097c8a7afc70cd602bd2f6a565363e6"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.177176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" event={"ID":"25d52098-169f-48dd-89d3-89cbba99b7c4","Type":"ContainerStarted","Data":"c6e7cf8d546c599d31a2c031b56e8dd594d3d6b2c5cc47a1eba8573099be3b2a"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.182414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" event={"ID":"d5c43124-452d-4146-aed0-d061973658e2","Type":"ContainerStarted","Data":"0aa576a8200d3e3272701d21436df2fe3178e222c01a5954b4387e8dfbb1fcf9"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.185254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" event={"ID":"b83c7f40-ebcf-4637-96ee-832bb5b8907d","Type":"ContainerStarted","Data":"9b5f28059d12af88f1926cdc5bb99fb9166624509fc6b7ee07942fcb8ff47b00"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.185301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" event={"ID":"b83c7f40-ebcf-4637-96ee-832bb5b8907d","Type":"ContainerStarted","Data":"9c7e5e623a8bc896b1fb376fb3d71faff02586b57f2bcea134aa250421aa86be"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.216570 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" podStartSLOduration=4.216549142 podStartE2EDuration="4.216549142s" podCreationTimestamp="2025-11-21 12:28:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:33.208818534 +0000 UTC m=+2271.909480362" watchObservedRunningTime="2025-11-21 12:28:33.216549142 +0000 UTC m=+2271.917210960" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.226085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" event={"ID":"c3120607-413a-487d-98ce-7ae0e94fd1f3","Type":"ContainerStarted","Data":"b9d30613a1eabe3385311f24f7fc54fc27025c74b7bf66e5e9d4bc4e3c70bcde"} Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.236408 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0 is running failed: container process not found" containerID="db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.236537 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b1a8d65-32f5-486e-b01e-5f77f989621b" containerID="ff32259837c555f035ae17f9c7dbc6f2cf65abc18f7a5aed9461682668921b7a" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.236594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5b1a8d65-32f5-486e-b01e-5f77f989621b","Type":"ContainerDied","Data":"ff32259837c555f035ae17f9c7dbc6f2cf65abc18f7a5aed9461682668921b7a"} Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.237497 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0 is running failed: container process not found" containerID="db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.238117 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0 is running failed: container process not found" containerID="db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:33 crc kubenswrapper[4769]: E1121 12:28:33.238168 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e67c9352-b51b-415a-a305-0e9b35c4370e" containerName="nova-cell0-conductor-conductor" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.239912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" event={"ID":"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b","Type":"ContainerStarted","Data":"2a83389f924f26d6323ddc28f0111149cdbfbeaccf468ec38e3677fd06b80fef"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.239969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" event={"ID":"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b","Type":"ContainerStarted","Data":"847f1a130c0a778ab01af3a762aa61d28d1f82d55baebed46f24eb5b7b6f51c1"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.262529 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" podStartSLOduration=4.26250771 podStartE2EDuration="4.26250771s" podCreationTimestamp="2025-11-21 12:28:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:33.256425666 +0000 UTC m=+2271.957087484" watchObservedRunningTime="2025-11-21 12:28:33.26250771 +0000 UTC m=+2271.963169528" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.266583 4769 generic.go:334] "Generic (PLEG): container finished" podID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerID="4d98cc64d4cbc1a8819c3d7c4e329de8b3d6c9afa10b7c1054e400933f42f8c0" exitCode=143 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.266659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" event={"ID":"8205dbfb-fc46-457f-a977-7ceb6377da8d","Type":"ContainerDied","Data":"4d98cc64d4cbc1a8819c3d7c4e329de8b3d6c9afa10b7c1054e400933f42f8c0"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.306274 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.340314 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" path="/var/lib/kubelet/pods/0c1dca80-5bc5-46d8-bfe6-fb395e82b774/volumes" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.340929 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ec33a6-7893-47f0-b59b-aa4b3450b479" path="/var/lib/kubelet/pods/41ec33a6-7893-47f0-b59b-aa4b3450b479/volumes" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.342348 4769 generic.go:334] "Generic (PLEG): container finished" podID="a614f405-9af6-4df3-b4ee-b062bd73077d" containerID="623848f9cf899442b90e26f118e5fe734ca71879282ecb184d2712f04fac5eca" exitCode=2 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.349518 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6a19a5-0f21-4261-af83-0248988b8b3b" path="/var/lib/kubelet/pods/5c6a19a5-0f21-4261-af83-0248988b8b3b/volumes" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.350215 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7662e8c1-8dc6-4ba5-988e-e8d10c7473c8" path="/var/lib/kubelet/pods/7662e8c1-8dc6-4ba5-988e-e8d10c7473c8/volumes" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.351015 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b30e07a1-77d5-4f6b-8a7e-9d9f816182cc" path="/var/lib/kubelet/pods/b30e07a1-77d5-4f6b-8a7e-9d9f816182cc/volumes" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.352957 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f893d1-0e6e-453b-898e-9d3a5b356c7d" path="/var/lib/kubelet/pods/d4f893d1-0e6e-453b-898e-9d3a5b356c7d/volumes" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.354305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" event={"ID":"8f29aa49-a966-46a2-9f51-a5f344b0944a","Type":"ContainerStarted","Data":"6a01a95d1a5f823e2fab1a37b48236dec2fc2dc4061aaac3907cfdc04b3618db"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.354345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" event={"ID":"ad288522-75bb-4bfc-b547-c2552f8c2995","Type":"ContainerStarted","Data":"4fa8529f37537c4a7d95de38d9c96cd1c93e432ab3d1debccd3ded910b0498c8"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.354377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a614f405-9af6-4df3-b4ee-b062bd73077d","Type":"ContainerDied","Data":"623848f9cf899442b90e26f118e5fe734ca71879282ecb184d2712f04fac5eca"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.354399 4769 scope.go:117] "RemoveContainer" containerID="cf007a44166b81d3a19a2d768bced5fb403930d33c79d57e889c4f7605de2fb9" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.358718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" event={"ID":"f1b72391-1ff2-4f97-bbf0-c928045f6395","Type":"ContainerStarted","Data":"26732f532fda88c6097153b94e1428d7f475064afd8f8a2c22cb1a4d2aa95e4f"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.369800 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4181add-a741-47a8-986b-ff015685ab63/ovsdbserver-nb/0.log" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.369923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4181add-a741-47a8-986b-ff015685ab63","Type":"ContainerDied","Data":"b466d0d40745c316900f1877090c4563ff416d50a5b9fa93562d9b459777270b"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.370034 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.386290 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.386327 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.386334 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.386379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.386405 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.386417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.396740 4769 generic.go:334] "Generic (PLEG): container finished" podID="e67c9352-b51b-415a-a305-0e9b35c4370e" containerID="db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.396951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e67c9352-b51b-415a-a305-0e9b35c4370e","Type":"ContainerDied","Data":"db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.416572 4769 generic.go:334] "Generic (PLEG): container finished" podID="9595d186-9a49-465e-a5b7-555a9d45d578" containerID="18ea5c420813c443f6224b08df761140d877cc33d5206148a743f21dbb02982e" exitCode=0 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.416682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" event={"ID":"9595d186-9a49-465e-a5b7-555a9d45d578","Type":"ContainerDied","Data":"18ea5c420813c443f6224b08df761140d877cc33d5206148a743f21dbb02982e"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.440317 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerID="017f91debc55afc1f32691f9fcb7a2055c6ca9f361ef281d2f91aa0faa9f7706" exitCode=143 Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.440369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" event={"ID":"8bc3ac6c-45bc-477e-b24e-778267d7a63e","Type":"ContainerDied","Data":"017f91debc55afc1f32691f9fcb7a2055c6ca9f361ef281d2f91aa0faa9f7706"} Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.468599 4769 scope.go:117] "RemoveContainer" containerID="a296db2bbb1a0ec5378d886408b8069b843e087e2a97cd5b7ac759ff43b3104d" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.508776 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.519817 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.545176 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.568411 4769 scope.go:117] "RemoveContainer" containerID="1bb06acd6e3f426a5168eac18c0fe9ba87116b36d8da1fea28749a22180f106e" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.646627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-certs\") pod \"a614f405-9af6-4df3-b4ee-b062bd73077d\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.647032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-config\") pod \"a614f405-9af6-4df3-b4ee-b062bd73077d\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.647083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-combined-ca-bundle\") pod \"a614f405-9af6-4df3-b4ee-b062bd73077d\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.647325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45kfx\" (UniqueName: \"kubernetes.io/projected/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-api-access-45kfx\") pod \"a614f405-9af6-4df3-b4ee-b062bd73077d\" (UID: \"a614f405-9af6-4df3-b4ee-b062bd73077d\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.662210 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-api-access-45kfx" (OuterVolumeSpecName: "kube-api-access-45kfx") pod "a614f405-9af6-4df3-b4ee-b062bd73077d" (UID: "a614f405-9af6-4df3-b4ee-b062bd73077d"). InnerVolumeSpecName "kube-api-access-45kfx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.711392 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.718247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a614f405-9af6-4df3-b4ee-b062bd73077d" (UID: "a614f405-9af6-4df3-b4ee-b062bd73077d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.751088 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-45kfx\" (UniqueName: \"kubernetes.io/projected/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-api-access-45kfx\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.751123 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.771140 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "a614f405-9af6-4df3-b4ee-b062bd73077d" (UID: "a614f405-9af6-4df3-b4ee-b062bd73077d"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.811324 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "a614f405-9af6-4df3-b4ee-b062bd73077d" (UID: "a614f405-9af6-4df3-b4ee-b062bd73077d"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.852369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbwpp\" (UniqueName: \"kubernetes.io/projected/e67c9352-b51b-415a-a305-0e9b35c4370e-kube-api-access-cbwpp\") pod \"e67c9352-b51b-415a-a305-0e9b35c4370e\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.852514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-config-data\") pod \"e67c9352-b51b-415a-a305-0e9b35c4370e\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.852569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-combined-ca-bundle\") pod \"e67c9352-b51b-415a-a305-0e9b35c4370e\" (UID: \"e67c9352-b51b-415a-a305-0e9b35c4370e\") " Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.853172 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.853211 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/a614f405-9af6-4df3-b4ee-b062bd73077d-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.867605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67c9352-b51b-415a-a305-0e9b35c4370e-kube-api-access-cbwpp" (OuterVolumeSpecName: "kube-api-access-cbwpp") pod "e67c9352-b51b-415a-a305-0e9b35c4370e" (UID: "e67c9352-b51b-415a-a305-0e9b35c4370e"). InnerVolumeSpecName "kube-api-access-cbwpp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.905767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e67c9352-b51b-415a-a305-0e9b35c4370e" (UID: "e67c9352-b51b-415a-a305-0e9b35c4370e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.935228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-config-data" (OuterVolumeSpecName: "config-data") pod "e67c9352-b51b-415a-a305-0e9b35c4370e" (UID: "e67c9352-b51b-415a-a305-0e9b35c4370e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.960039 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.960080 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cbwpp\" (UniqueName: \"kubernetes.io/projected/e67c9352-b51b-415a-a305-0e9b35c4370e-kube-api-access-cbwpp\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:33 crc kubenswrapper[4769]: I1121 12:28:33.960091 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e67c9352-b51b-415a-a305-0e9b35c4370e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.197084 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.232873 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.266807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-vencrypt-tls-certs\") pod \"5b1a8d65-32f5-486e-b01e-5f77f989621b\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.267074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-config-data\") pod \"5b1a8d65-32f5-486e-b01e-5f77f989621b\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.267121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-nova-novncproxy-tls-certs\") pod \"5b1a8d65-32f5-486e-b01e-5f77f989621b\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.267228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd8cd\" (UniqueName: \"kubernetes.io/projected/5b1a8d65-32f5-486e-b01e-5f77f989621b-kube-api-access-cd8cd\") pod \"5b1a8d65-32f5-486e-b01e-5f77f989621b\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.267263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-combined-ca-bundle\") pod \"5b1a8d65-32f5-486e-b01e-5f77f989621b\" (UID: \"5b1a8d65-32f5-486e-b01e-5f77f989621b\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.281945 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1a8d65-32f5-486e-b01e-5f77f989621b-kube-api-access-cd8cd" (OuterVolumeSpecName: "kube-api-access-cd8cd") pod "5b1a8d65-32f5-486e-b01e-5f77f989621b" (UID: "5b1a8d65-32f5-486e-b01e-5f77f989621b"). InnerVolumeSpecName "kube-api-access-cd8cd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.301957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b1a8d65-32f5-486e-b01e-5f77f989621b" (UID: "5b1a8d65-32f5-486e-b01e-5f77f989621b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.310485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-config-data" (OuterVolumeSpecName: "config-data") pod "5b1a8d65-32f5-486e-b01e-5f77f989621b" (UID: "5b1a8d65-32f5-486e-b01e-5f77f989621b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.336253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "5b1a8d65-32f5-486e-b01e-5f77f989621b" (UID: "5b1a8d65-32f5-486e-b01e-5f77f989621b"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.337746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "5b1a8d65-32f5-486e-b01e-5f77f989621b" (UID: "5b1a8d65-32f5-486e-b01e-5f77f989621b"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369397 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-etc-swift\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369483 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-public-tls-certs\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369510 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-combined-ca-bundle\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-internal-tls-certs\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-run-httpd\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhdss\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-kube-api-access-xhdss\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-config-data\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.369839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-log-httpd\") pod \"46dff394-5dc3-442d-bbe2-31563973474a\" (UID: \"46dff394-5dc3-442d-bbe2-31563973474a\") " Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.371922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372431 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372458 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372472 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cd8cd\" (UniqueName: \"kubernetes.io/projected/5b1a8d65-32f5-486e-b01e-5f77f989621b-kube-api-access-cd8cd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372486 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372496 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372507 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1a8d65-32f5-486e-b01e-5f77f989621b-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.372516 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46dff394-5dc3-442d-bbe2-31563973474a-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.374430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.375168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-kube-api-access-xhdss" (OuterVolumeSpecName: "kube-api-access-xhdss") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "kube-api-access-xhdss". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.431068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.433021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.434879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.453388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-config-data" (OuterVolumeSpecName: "config-data") pod "46dff394-5dc3-442d-bbe2-31563973474a" (UID: "46dff394-5dc3-442d-bbe2-31563973474a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.459586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" event={"ID":"8f29aa49-a966-46a2-9f51-a5f344b0944a","Type":"ContainerStarted","Data":"4907a97d070814384d9b78a7371d9106151f7e2018ae9d4d389cb855cd164128"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.467624 4769 generic.go:334] "Generic (PLEG): container finished" podID="a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" containerID="2a83389f924f26d6323ddc28f0111149cdbfbeaccf468ec38e3677fd06b80fef" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.467700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" event={"ID":"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b","Type":"ContainerDied","Data":"2a83389f924f26d6323ddc28f0111149cdbfbeaccf468ec38e3677fd06b80fef"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.470066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" event={"ID":"ad288522-75bb-4bfc-b547-c2552f8c2995","Type":"ContainerStarted","Data":"cd46bfda5ba2d5edbbd333c7b454a290d0f39996d7c77405218eeb3955a79f58"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.479006 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerID="6d49d98619ee6cdd108b34a214e56a3a10487178b559a6a4ca100eb8c8680c8f" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.479161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3b8ee7d0-9900-447f-8b43-f72587e6c8c1","Type":"ContainerDied","Data":"6d49d98619ee6cdd108b34a214e56a3a10487178b559a6a4ca100eb8c8680c8f"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.485911 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xhdss\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-kube-api-access-xhdss\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.485952 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.485965 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46dff394-5dc3-442d-bbe2-31563973474a-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.485976 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.485987 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.485999 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/46dff394-5dc3-442d-bbe2-31563973474a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.492134 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1b72391-1ff2-4f97-bbf0-c928045f6395" containerID="a9e98a91f8bd51b95934be0cd9a239d70dc4f243abfbf4880540a544213457c7" exitCode=1 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.492420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" event={"ID":"f1b72391-1ff2-4f97-bbf0-c928045f6395","Type":"ContainerDied","Data":"a9e98a91f8bd51b95934be0cd9a239d70dc4f243abfbf4880540a544213457c7"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.498584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e67c9352-b51b-415a-a305-0e9b35c4370e","Type":"ContainerDied","Data":"b900fd13d7daaa64af8e6cfd20e1f84d736b4fa88e5d65197c2d3a16f11ada55"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.498653 4769 scope.go:117] "RemoveContainer" containerID="db7de94f4a89a19e3d8e5183ea3b7a07442d003530588668d6fa97a8708622b0" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.498607 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.505632 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" podStartSLOduration=4.505595185 podStartE2EDuration="4.505595185s" podCreationTimestamp="2025-11-21 12:28:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:34.479624166 +0000 UTC m=+2273.180285984" watchObservedRunningTime="2025-11-21 12:28:34.505595185 +0000 UTC m=+2273.206257003" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.507203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5b1a8d65-32f5-486e-b01e-5f77f989621b","Type":"ContainerDied","Data":"3d4a84ece90a72319d10d3c05751891d0e17c0f691441f8335a5b9b3d6a00171"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.507233 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.528542 4769 generic.go:334] "Generic (PLEG): container finished" podID="eaabdea5-a92a-4d83-a910-fe0a9993b278" containerID="42260c171b88c7201b3f08d2d92a0fc3baa74960ca7cd600a2537e91c72ca9a0" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.528615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaabdea5-a92a-4d83-a910-fe0a9993b278","Type":"ContainerDied","Data":"42260c171b88c7201b3f08d2d92a0fc3baa74960ca7cd600a2537e91c72ca9a0"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.544227 4769 scope.go:117] "RemoveContainer" containerID="ff32259837c555f035ae17f9c7dbc6f2cf65abc18f7a5aed9461682668921b7a" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.563827 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" podStartSLOduration=5.563804813 podStartE2EDuration="5.563804813s" podCreationTimestamp="2025-11-21 12:28:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:34.556424804 +0000 UTC m=+2273.257086622" watchObservedRunningTime="2025-11-21 12:28:34.563804813 +0000 UTC m=+2273.264466631" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.598157 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerID="106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.598364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerDied","Data":"106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.622639 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.626183 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5c43124-452d-4146-aed0-d061973658e2" containerID="8cba7870eb33004343707267ede289e384fd18cf83fc60b22eabb4071e4b6052" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.626401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" event={"ID":"d5c43124-452d-4146-aed0-d061973658e2","Type":"ContainerDied","Data":"8cba7870eb33004343707267ede289e384fd18cf83fc60b22eabb4071e4b6052"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.637642 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.638048 4769 generic.go:334] "Generic (PLEG): container finished" podID="b83c7f40-ebcf-4637-96ee-832bb5b8907d" containerID="9b5f28059d12af88f1926cdc5bb99fb9166624509fc6b7ee07942fcb8ff47b00" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.638092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" event={"ID":"b83c7f40-ebcf-4637-96ee-832bb5b8907d","Type":"ContainerDied","Data":"9b5f28059d12af88f1926cdc5bb99fb9166624509fc6b7ee07942fcb8ff47b00"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.643101 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.643336 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="7759a04f-afff-47f4-9f22-6c7154fa2fb3" containerName="memcached" containerID="cri-o://2d2ca713ec86c4868a610f79c736e20ed1acc9b6447d222c904a0d37a46cdfb4" gracePeriod=30 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.672397 4769 generic.go:334] "Generic (PLEG): container finished" podID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerID="faac1670eb07165da7c59a50d4ced3ea699fcdec778e48937d8e39071a645763" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.673359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" event={"ID":"c3120607-413a-487d-98ce-7ae0e94fd1f3","Type":"ContainerDied","Data":"faac1670eb07165da7c59a50d4ced3ea699fcdec778e48937d8e39071a645763"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.708783 4769 generic.go:334] "Generic (PLEG): container finished" podID="46dff394-5dc3-442d-bbe2-31563973474a" containerID="53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.708821 4769 generic.go:334] "Generic (PLEG): container finished" podID="46dff394-5dc3-442d-bbe2-31563973474a" containerID="30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372" exitCode=0 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.708936 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.784459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" event={"ID":"46dff394-5dc3-442d-bbe2-31563973474a","Type":"ContainerDied","Data":"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.784507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" event={"ID":"46dff394-5dc3-442d-bbe2-31563973474a","Type":"ContainerDied","Data":"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.784518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d" event={"ID":"46dff394-5dc3-442d-bbe2-31563973474a","Type":"ContainerDied","Data":"c165e460bcf61bbd1368141de57da7ba7865926b582743f0222ec367ddea460a"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.784530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" event={"ID":"25d52098-169f-48dd-89d3-89cbba99b7c4","Type":"ContainerStarted","Data":"0fbdb8114c7c1d007e78d3afa393fc534e980654a3f0e4b7bb530333819b8bc0"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.784560 4769 scope.go:117] "RemoveContainer" containerID="53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.798040 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:28:34 crc kubenswrapper[4769]: E1121 12:28:34.800610 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:28:34 crc kubenswrapper[4769]: E1121 12:28:34.813285 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data podName:7313da1b-b474-474a-acc2-51ee39d5d79b nodeName:}" failed. No retries permitted until 2025-11-21 12:28:38.800641679 +0000 UTC m=+2277.501303497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data") pod "rabbitmq-server-0" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b") : configmap "rabbitmq-config-data" not found Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.813440 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.828764 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-4vv6g"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.829797 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.831245 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a614f405-9af6-4df3-b4ee-b062bd73077d","Type":"ContainerDied","Data":"fd37ddb34c8b74e6364767600f4fbe2e804940b87328c8e6899c894f38fe9bbb"} Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.848645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cvr9p"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.875593 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.875935 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" podUID="6359092b-61ea-402d-9d63-0cb82f623c6c" containerName="keystone-api" containerID="cri-o://c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95" gracePeriod=30 Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.887651 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cvr9p"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.937738 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.100:8776/healthcheck\": read tcp 10.217.0.2:47420->10.217.1.100:8776: read: connection reset by peer" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.946997 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-4vv6g"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.966371 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.975079 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.140:8775/\": read tcp 10.217.0.2:54738->10.217.1.140:8775: read: connection reset by peer" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.975448 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kkb4c"] Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.975210 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.140:8775/\": read tcp 10.217.0.2:54724->10.217.1.140:8775: read: connection reset by peer" Nov 21 12:28:34 crc kubenswrapper[4769]: I1121 12:28:34.996749 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kkb4c"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.011524 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance66cf-account-delete-vxg8c"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.063758 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-66cf-account-create-bj6f7"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.092033 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-66cf-account-create-bj6f7"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.109210 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-h4m9w"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.115186 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-h4m9w"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.126965 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.144255 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-e4c5-account-create-kvk88"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.151149 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-e4c5-account-create-kvk88"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.156421 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-z5lbf"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.161386 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-z5lbf"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.174047 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-13d7-account-create-g9vpd"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.180347 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-13d7-account-create-g9vpd"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.186139 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-sw29s"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.196072 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-86b3-account-create-2525f"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.200496 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron86b3-account-delete-ggrcm"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.204838 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-86b3-account-create-2525f"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.211281 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-sw29s"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.214782 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-d99b5"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.223155 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-d99b5"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.233347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.240997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapica3a-account-delete-xtnxd"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.245395 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-ca3a-account-create-8f2r7"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.251552 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nnb6g"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.257958 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-nnb6g"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.272802 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.281741 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="galera" containerID="cri-o://771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf" gracePeriod=30 Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.289655 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a8dafc-53b9-4c57-b534-76112365affc" path="/var/lib/kubelet/pods/14a8dafc-53b9-4c57-b534-76112365affc/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.290309 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160e64f6-dd5c-40b6-ba26-9e93657d96c9" path="/var/lib/kubelet/pods/160e64f6-dd5c-40b6-ba26-9e93657d96c9/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.290851 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fba7dc-2c76-4d2b-85c1-750c7d129bf2" path="/var/lib/kubelet/pods/22fba7dc-2c76-4d2b-85c1-750c7d129bf2/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.291379 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395c8b6c-33f9-4501-af41-d393410079d8" path="/var/lib/kubelet/pods/395c8b6c-33f9-4501-af41-d393410079d8/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.292378 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47bb1f7f-bd48-42d7-b497-8e9e11655921" path="/var/lib/kubelet/pods/47bb1f7f-bd48-42d7-b497-8e9e11655921/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.292868 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1a8d65-32f5-486e-b01e-5f77f989621b" path="/var/lib/kubelet/pods/5b1a8d65-32f5-486e-b01e-5f77f989621b/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.293404 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604b1833-41e7-4520-b1a8-72e485dcf850" path="/var/lib/kubelet/pods/604b1833-41e7-4520-b1a8-72e485dcf850/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.294397 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="671e1e54-25c5-48b3-bb05-05a3b289e9e2" path="/var/lib/kubelet/pods/671e1e54-25c5-48b3-bb05-05a3b289e9e2/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.294900 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68e643ab-0142-4d28-a377-0898eadcc05d" path="/var/lib/kubelet/pods/68e643ab-0142-4d28-a377-0898eadcc05d/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.295387 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773140a6-b580-4feb-a4bc-4271310e9569" path="/var/lib/kubelet/pods/773140a6-b580-4feb-a4bc-4271310e9569/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.296292 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac14021d-cc6c-403c-bc6d-4c966a882eba" path="/var/lib/kubelet/pods/ac14021d-cc6c-403c-bc6d-4c966a882eba/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.296809 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adde1786-1486-4f06-beea-c00fe553b03f" path="/var/lib/kubelet/pods/adde1786-1486-4f06-beea-c00fe553b03f/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.297350 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c3a781-961d-45dd-97d9-e9aa801d7509" path="/var/lib/kubelet/pods/d7c3a781-961d-45dd-97d9-e9aa801d7509/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.298005 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67c9352-b51b-415a-a305-0e9b35c4370e" path="/var/lib/kubelet/pods/e67c9352-b51b-415a-a305-0e9b35c4370e/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.298967 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4181add-a741-47a8-986b-ff015685ab63" path="/var/lib/kubelet/pods/f4181add-a741-47a8-986b-ff015685ab63/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.299520 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a" path="/var/lib/kubelet/pods/f97afbd8-4067-4ce1-8b2e-4c2b64f94f0a/volumes" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.300320 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-8833-account-create-fltzv"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.300347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell08833-account-delete-jlwbf"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.455404 4769 scope.go:117] "RemoveContainer" containerID="30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.474695 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.489234 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.499305 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.531244 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.532566 4769 scope.go:117] "RemoveContainer" containerID="53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904" Nov 21 12:28:35 crc kubenswrapper[4769]: E1121 12:28:35.533054 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904\": container with ID starting with 53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904 not found: ID does not exist" containerID="53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.533093 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904"} err="failed to get container status \"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904\": rpc error: code = NotFound desc = could not find container \"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904\": container with ID starting with 53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904 not found: ID does not exist" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.533116 4769 scope.go:117] "RemoveContainer" containerID="30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372" Nov 21 12:28:35 crc kubenswrapper[4769]: E1121 12:28:35.535454 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372\": container with ID starting with 30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372 not found: ID does not exist" containerID="30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.535511 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372"} err="failed to get container status \"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372\": rpc error: code = NotFound desc = could not find container \"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372\": container with ID starting with 30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372 not found: ID does not exist" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.535541 4769 scope.go:117] "RemoveContainer" containerID="53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.538224 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-57489bd448-vcj8d"] Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.538254 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904"} err="failed to get container status \"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904\": rpc error: code = NotFound desc = could not find container \"53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904\": container with ID starting with 53fe356aba874236aa2c01468d5f00627f7278c1767d17d836d783b31d7b8904 not found: ID does not exist" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.538285 4769 scope.go:117] "RemoveContainer" containerID="30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.538967 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372"} err="failed to get container status \"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372\": rpc error: code = NotFound desc = could not find container \"30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372\": container with ID starting with 30550ec9e63ba3c80d93ee575bf20038dce021fc5c3bbaece7c503873347c372 not found: ID does not exist" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.538996 4769 scope.go:117] "RemoveContainer" containerID="623848f9cf899442b90e26f118e5fe734ca71879282ecb184d2712f04fac5eca" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.552741 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-etc-machine-id\") pod \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data-custom\") pod \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3b8ee7d0-9900-447f-8b43-f72587e6c8c1" (UID: "3b8ee7d0-9900-447f-8b43-f72587e6c8c1"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqbwq\" (UniqueName: \"kubernetes.io/projected/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-kube-api-access-sqbwq\") pod \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7786\" (UniqueName: \"kubernetes.io/projected/f1b72391-1ff2-4f97-bbf0-c928045f6395-kube-api-access-r7786\") pod \"f1b72391-1ff2-4f97-bbf0-c928045f6395\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-scripts\") pod \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-combined-ca-bundle\") pod \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f1b72391-1ff2-4f97-bbf0-c928045f6395-operator-scripts\") pod \"f1b72391-1ff2-4f97-bbf0-c928045f6395\" (UID: \"f1b72391-1ff2-4f97-bbf0-c928045f6395\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.651961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data\") pod \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\" (UID: \"3b8ee7d0-9900-447f-8b43-f72587e6c8c1\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.652828 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.658670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1b72391-1ff2-4f97-bbf0-c928045f6395-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f1b72391-1ff2-4f97-bbf0-c928045f6395" (UID: "f1b72391-1ff2-4f97-bbf0-c928045f6395"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.661409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-kube-api-access-sqbwq" (OuterVolumeSpecName: "kube-api-access-sqbwq") pod "3b8ee7d0-9900-447f-8b43-f72587e6c8c1" (UID: "3b8ee7d0-9900-447f-8b43-f72587e6c8c1"). InnerVolumeSpecName "kube-api-access-sqbwq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.661701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-scripts" (OuterVolumeSpecName: "scripts") pod "3b8ee7d0-9900-447f-8b43-f72587e6c8c1" (UID: "3b8ee7d0-9900-447f-8b43-f72587e6c8c1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.663379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3b8ee7d0-9900-447f-8b43-f72587e6c8c1" (UID: "3b8ee7d0-9900-447f-8b43-f72587e6c8c1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.672592 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1b72391-1ff2-4f97-bbf0-c928045f6395-kube-api-access-r7786" (OuterVolumeSpecName: "kube-api-access-r7786") pod "f1b72391-1ff2-4f97-bbf0-c928045f6395" (UID: "f1b72391-1ff2-4f97-bbf0-c928045f6395"). InnerVolumeSpecName "kube-api-access-r7786". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.697774 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.722121 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.740294 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3b8ee7d0-9900-447f-8b43-f72587e6c8c1" (UID: "3b8ee7d0-9900-447f-8b43-f72587e6c8c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.754687 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.754723 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.754736 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f1b72391-1ff2-4f97-bbf0-c928045f6395-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.754747 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.754756 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sqbwq\" (UniqueName: \"kubernetes.io/projected/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-kube-api-access-sqbwq\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.754768 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r7786\" (UniqueName: \"kubernetes.io/projected/f1b72391-1ff2-4f97-bbf0-c928045f6395-kube-api-access-r7786\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.855849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a393fa88-8741-40b7-8a55-4f853c1722b8-etc-machine-id\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.855910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a393fa88-8741-40b7-8a55-4f853c1722b8-logs\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.855977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data-custom\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856045 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9595d186-9a49-465e-a5b7-555a9d45d578-operator-scripts\") pod \"9595d186-9a49-465e-a5b7-555a9d45d578\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-internal-tls-certs\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-scripts\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llrgk\" (UniqueName: \"kubernetes.io/projected/9595d186-9a49-465e-a5b7-555a9d45d578-kube-api-access-llrgk\") pod \"9595d186-9a49-465e-a5b7-555a9d45d578\" (UID: \"9595d186-9a49-465e-a5b7-555a9d45d578\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856203 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-combined-ca-bundle\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v9mt\" (UniqueName: \"kubernetes.io/projected/a393fa88-8741-40b7-8a55-4f853c1722b8-kube-api-access-4v9mt\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.856348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-public-tls-certs\") pod \"a393fa88-8741-40b7-8a55-4f853c1722b8\" (UID: \"a393fa88-8741-40b7-8a55-4f853c1722b8\") " Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.857323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a393fa88-8741-40b7-8a55-4f853c1722b8-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.859487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a393fa88-8741-40b7-8a55-4f853c1722b8-logs" (OuterVolumeSpecName: "logs") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.862088 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9595d186-9a49-465e-a5b7-555a9d45d578-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9595d186-9a49-465e-a5b7-555a9d45d578" (UID: "9595d186-9a49-465e-a5b7-555a9d45d578"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.869513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9595d186-9a49-465e-a5b7-555a9d45d578-kube-api-access-llrgk" (OuterVolumeSpecName: "kube-api-access-llrgk") pod "9595d186-9a49-465e-a5b7-555a9d45d578" (UID: "9595d186-9a49-465e-a5b7-555a9d45d578"). InnerVolumeSpecName "kube-api-access-llrgk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.879240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.892149 4769 generic.go:334] "Generic (PLEG): container finished" podID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerID="eacfe69496d42243648977490be543cfccfa90344dc261525b705d4e2b35f758" exitCode=0 Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.892258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8db99cd8-81fb-414a-8eec-3db988f78f5e","Type":"ContainerDied","Data":"eacfe69496d42243648977490be543cfccfa90344dc261525b705d4e2b35f758"} Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.896793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data" (OuterVolumeSpecName: "config-data") pod "3b8ee7d0-9900-447f-8b43-f72587e6c8c1" (UID: "3b8ee7d0-9900-447f-8b43-f72587e6c8c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.910668 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f29aa49-a966-46a2-9f51-a5f344b0944a" containerID="4907a97d070814384d9b78a7371d9106151f7e2018ae9d4d389cb855cd164128" exitCode=0 Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.910786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" event={"ID":"8f29aa49-a966-46a2-9f51-a5f344b0944a","Type":"ContainerDied","Data":"4907a97d070814384d9b78a7371d9106151f7e2018ae9d4d389cb855cd164128"} Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.919050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-scripts" (OuterVolumeSpecName: "scripts") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.919481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a393fa88-8741-40b7-8a55-4f853c1722b8-kube-api-access-4v9mt" (OuterVolumeSpecName: "kube-api-access-4v9mt") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "kube-api-access-4v9mt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.952587 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerID="f26dbf44d9fe564886ba9eac123dcb6e2ac8626a543596179180a5e7572e70f8" exitCode=0 Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.952703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" event={"ID":"8bc3ac6c-45bc-477e-b24e-778267d7a63e","Type":"ContainerDied","Data":"f26dbf44d9fe564886ba9eac123dcb6e2ac8626a543596179180a5e7572e70f8"} Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960169 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9595d186-9a49-465e-a5b7-555a9d45d578-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960214 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960227 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-llrgk\" (UniqueName: \"kubernetes.io/projected/9595d186-9a49-465e-a5b7-555a9d45d578-kube-api-access-llrgk\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960239 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4v9mt\" (UniqueName: \"kubernetes.io/projected/a393fa88-8741-40b7-8a55-4f853c1722b8-kube-api-access-4v9mt\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960248 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3b8ee7d0-9900-447f-8b43-f72587e6c8c1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960256 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a393fa88-8741-40b7-8a55-4f853c1722b8-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960264 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a393fa88-8741-40b7-8a55-4f853c1722b8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.960338 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.971359 4769 generic.go:334] "Generic (PLEG): container finished" podID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerID="da9b83ab069f95e46f81bc4c86275abda61442db99af1310087deeb06729e95c" exitCode=0 Nov 21 12:28:35 crc kubenswrapper[4769]: I1121 12:28:35.971467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"24e9adde-0ce7-4cf1-8c98-21458a046a0e","Type":"ContainerDied","Data":"da9b83ab069f95e46f81bc4c86275abda61442db99af1310087deeb06729e95c"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.010503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.011061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" event={"ID":"c3120607-413a-487d-98ce-7ae0e94fd1f3","Type":"ContainerStarted","Data":"ae5e60e6cf5ad085eb4767c47ef3d44ce3fe82796b7f1fe064bc3fa0f799367f"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.011137 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.020170 4769 generic.go:334] "Generic (PLEG): container finished" podID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerID="a9cb286696dfabe46b8f1cad7b25766dec37fcb850bd3469c5a9ec7c9b313078" exitCode=0 Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.020257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"60d48f3d-32e3-4de7-8634-0f876ed5ac2f","Type":"ContainerDied","Data":"a9cb286696dfabe46b8f1cad7b25766dec37fcb850bd3469c5a9ec7c9b313078"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.022383 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad288522-75bb-4bfc-b547-c2552f8c2995" containerID="cd46bfda5ba2d5edbbd333c7b454a290d0f39996d7c77405218eeb3955a79f58" exitCode=0 Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.022436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" event={"ID":"ad288522-75bb-4bfc-b547-c2552f8c2995","Type":"ContainerDied","Data":"cd46bfda5ba2d5edbbd333c7b454a290d0f39996d7c77405218eeb3955a79f58"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.023981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.024650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaabdea5-a92a-4d83-a910-fe0a9993b278","Type":"ContainerDied","Data":"488aceeb679d9d82aac1e7371558187e92a32acaa572dd6f9698bfdee93eb2ce"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.024674 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="488aceeb679d9d82aac1e7371558187e92a32acaa572dd6f9698bfdee93eb2ce" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.026740 4769 generic.go:334] "Generic (PLEG): container finished" podID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerID="34cd3387ad221c34560c76abcd77a2a62d83a55afb99a7549ca55e84d12a6368" exitCode=0 Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.026781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e1b857b2-7449-4450-a61a-7cc9bfff316f","Type":"ContainerDied","Data":"34cd3387ad221c34560c76abcd77a2a62d83a55afb99a7549ca55e84d12a6368"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.028298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3b8ee7d0-9900-447f-8b43-f72587e6c8c1","Type":"ContainerDied","Data":"a5c9f59aeebd9a15559c05145c1e451785bfe9988e551d90dd2ff60c6456d310"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.028334 4769 scope.go:117] "RemoveContainer" containerID="0fb0a642c9ce1976223af5451527b445f097c8a7afc70cd602bd2f6a565363e6" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.028489 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.040183 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" event={"ID":"f1b72391-1ff2-4f97-bbf0-c928045f6395","Type":"ContainerDied","Data":"26732f532fda88c6097153b94e1428d7f475064afd8f8a2c22cb1a4d2aa95e4f"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.040331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell151fa-account-delete-dzwtl" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.044458 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" podStartSLOduration=6.044436522 podStartE2EDuration="6.044436522s" podCreationTimestamp="2025-11-21 12:28:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:28:36.034242838 +0000 UTC m=+2274.734904666" watchObservedRunningTime="2025-11-21 12:28:36.044436522 +0000 UTC m=+2274.745098340" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.047852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.048170 4769 generic.go:334] "Generic (PLEG): container finished" podID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerID="677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d" exitCode=0 Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.048277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a393fa88-8741-40b7-8a55-4f853c1722b8","Type":"ContainerDied","Data":"677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.048307 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.048334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a393fa88-8741-40b7-8a55-4f853c1722b8","Type":"ContainerDied","Data":"f622e650095dfc402107f3a419e69c392ee055bb6e028509b01fce6b03aee357"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.055125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" event={"ID":"9595d186-9a49-465e-a5b7-555a9d45d578","Type":"ContainerDied","Data":"33ba24ed199abbcbfab61f587380246c7a69676bbf3bd70368749726bce232cd"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.055292 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33ba24ed199abbcbfab61f587380246c7a69676bbf3bd70368749726bce232cd" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.055380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement373d-account-delete-8bwrt" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.061151 4769 generic.go:334] "Generic (PLEG): container finished" podID="25d52098-169f-48dd-89d3-89cbba99b7c4" containerID="0fbdb8114c7c1d007e78d3afa393fc534e980654a3f0e4b7bb530333819b8bc0" exitCode=0 Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.063650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" event={"ID":"25d52098-169f-48dd-89d3-89cbba99b7c4","Type":"ContainerDied","Data":"0fbdb8114c7c1d007e78d3afa393fc534e980654a3f0e4b7bb530333819b8bc0"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.064910 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.064966 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.064977 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.077729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data" (OuterVolumeSpecName: "config-data") pod "a393fa88-8741-40b7-8a55-4f853c1722b8" (UID: "a393fa88-8741-40b7-8a55-4f853c1722b8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.079163 4769 generic.go:334] "Generic (PLEG): container finished" podID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerID="e37e8ca9c13159ff75dbefc98fa8e79d84ee836baf47fc1b85942a8dbbf77b7f" exitCode=0 Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.079312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" event={"ID":"7d1af53a-9620-44a9-8a3c-fdea3faea22b","Type":"ContainerDied","Data":"e37e8ca9c13159ff75dbefc98fa8e79d84ee836baf47fc1b85942a8dbbf77b7f"} Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.136923 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.137506 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.154741 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.162036 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.170078 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a393fa88-8741-40b7-8a55-4f853c1722b8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.189669 4769 scope.go:117] "RemoveContainer" containerID="6d49d98619ee6cdd108b34a214e56a3a10487178b559a6a4ca100eb8c8680c8f" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.218087 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.220810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.221558 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.221743 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.224260 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell151fa-account-delete-dzwtl"] Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.238264 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell151fa-account-delete-dzwtl"] Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.265845 4769 scope.go:117] "RemoveContainer" containerID="a9e98a91f8bd51b95934be0cd9a239d70dc4f243abfbf4880540a544213457c7" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.271323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-combined-ca-bundle\") pod \"eaabdea5-a92a-4d83-a910-fe0a9993b278\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.271353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-config-data\") pod \"e1b857b2-7449-4450-a61a-7cc9bfff316f\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.271393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-internal-tls-certs\") pod \"e1b857b2-7449-4450-a61a-7cc9bfff316f\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.272269 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnqk6\" (UniqueName: \"kubernetes.io/projected/e1b857b2-7449-4450-a61a-7cc9bfff316f-kube-api-access-dnqk6\") pod \"e1b857b2-7449-4450-a61a-7cc9bfff316f\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.272597 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-public-tls-certs\") pod \"e1b857b2-7449-4450-a61a-7cc9bfff316f\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.272660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-combined-ca-bundle\") pod \"e1b857b2-7449-4450-a61a-7cc9bfff316f\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.272706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggwm4\" (UniqueName: \"kubernetes.io/projected/eaabdea5-a92a-4d83-a910-fe0a9993b278-kube-api-access-ggwm4\") pod \"eaabdea5-a92a-4d83-a910-fe0a9993b278\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.272763 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1b857b2-7449-4450-a61a-7cc9bfff316f-logs\") pod \"e1b857b2-7449-4450-a61a-7cc9bfff316f\" (UID: \"e1b857b2-7449-4450-a61a-7cc9bfff316f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.272837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-config-data\") pod \"eaabdea5-a92a-4d83-a910-fe0a9993b278\" (UID: \"eaabdea5-a92a-4d83-a910-fe0a9993b278\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.276025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b857b2-7449-4450-a61a-7cc9bfff316f-logs" (OuterVolumeSpecName: "logs") pod "e1b857b2-7449-4450-a61a-7cc9bfff316f" (UID: "e1b857b2-7449-4450-a61a-7cc9bfff316f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.277232 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b857b2-7449-4450-a61a-7cc9bfff316f-kube-api-access-dnqk6" (OuterVolumeSpecName: "kube-api-access-dnqk6") pod "e1b857b2-7449-4450-a61a-7cc9bfff316f" (UID: "e1b857b2-7449-4450-a61a-7cc9bfff316f"). InnerVolumeSpecName "kube-api-access-dnqk6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.312035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eaabdea5-a92a-4d83-a910-fe0a9993b278" (UID: "eaabdea5-a92a-4d83-a910-fe0a9993b278"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.320541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaabdea5-a92a-4d83-a910-fe0a9993b278-kube-api-access-ggwm4" (OuterVolumeSpecName: "kube-api-access-ggwm4") pod "eaabdea5-a92a-4d83-a910-fe0a9993b278" (UID: "eaabdea5-a92a-4d83-a910-fe0a9993b278"). InnerVolumeSpecName "kube-api-access-ggwm4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.331162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e1b857b2-7449-4450-a61a-7cc9bfff316f" (UID: "e1b857b2-7449-4450-a61a-7cc9bfff316f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.331404 4769 scope.go:117] "RemoveContainer" containerID="677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.339466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-config-data" (OuterVolumeSpecName: "config-data") pod "e1b857b2-7449-4450-a61a-7cc9bfff316f" (UID: "e1b857b2-7449-4450-a61a-7cc9bfff316f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.349094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.360908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-config-data" (OuterVolumeSpecName: "config-data") pod "eaabdea5-a92a-4d83-a910-fe0a9993b278" (UID: "eaabdea5-a92a-4d83-a910-fe0a9993b278"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.375792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-config-data\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.375841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d1af53a-9620-44a9-8a3c-fdea3faea22b-logs\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.375869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-combined-ca-bundle\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.375922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcd8k\" (UniqueName: \"kubernetes.io/projected/7d1af53a-9620-44a9-8a3c-fdea3faea22b-kube-api-access-mcd8k\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.375974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-nova-metadata-tls-certs\") pod \"8db99cd8-81fb-414a-8eec-3db988f78f5e\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.375998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data-custom\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-scripts\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-internal-tls-certs\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n4pp\" (UniqueName: \"kubernetes.io/projected/8db99cd8-81fb-414a-8eec-3db988f78f5e-kube-api-access-6n4pp\") pod \"8db99cd8-81fb-414a-8eec-3db988f78f5e\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-config-data\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jzkx\" (UniqueName: \"kubernetes.io/projected/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-kube-api-access-9jzkx\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.376245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-combined-ca-bundle\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fhp5\" (UniqueName: \"kubernetes.io/projected/8bc3ac6c-45bc-477e-b24e-778267d7a63e-kube-api-access-6fhp5\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-combined-ca-bundle\") pod \"8db99cd8-81fb-414a-8eec-3db988f78f5e\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-combined-ca-bundle\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-public-tls-certs\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-logs\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-internal-tls-certs\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-httpd-run\") pod \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\" (UID: \"60d48f3d-32e3-4de7-8634-0f876ed5ac2f\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377453 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-internal-tls-certs\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8db99cd8-81fb-414a-8eec-3db988f78f5e-logs\") pod \"8db99cd8-81fb-414a-8eec-3db988f78f5e\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377523 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-scripts\") pod \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\" (UID: \"7d1af53a-9620-44a9-8a3c-fdea3faea22b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8bc3ac6c-45bc-477e-b24e-778267d7a63e-logs\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377779 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-public-tls-certs\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-config-data\") pod \"8db99cd8-81fb-414a-8eec-3db988f78f5e\" (UID: \"8db99cd8-81fb-414a-8eec-3db988f78f5e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.377865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data\") pod \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\" (UID: \"8bc3ac6c-45bc-477e-b24e-778267d7a63e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378841 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ggwm4\" (UniqueName: \"kubernetes.io/projected/eaabdea5-a92a-4d83-a910-fe0a9993b278-kube-api-access-ggwm4\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378863 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1b857b2-7449-4450-a61a-7cc9bfff316f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378877 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378891 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaabdea5-a92a-4d83-a910-fe0a9993b278-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378903 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378915 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dnqk6\" (UniqueName: \"kubernetes.io/projected/e1b857b2-7449-4450-a61a-7cc9bfff316f-kube-api-access-dnqk6\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.378929 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.386820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc3ac6c-45bc-477e-b24e-778267d7a63e-logs" (OuterVolumeSpecName: "logs") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.388467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.399698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db99cd8-81fb-414a-8eec-3db988f78f5e-kube-api-access-6n4pp" (OuterVolumeSpecName: "kube-api-access-6n4pp") pod "8db99cd8-81fb-414a-8eec-3db988f78f5e" (UID: "8db99cd8-81fb-414a-8eec-3db988f78f5e"). InnerVolumeSpecName "kube-api-access-6n4pp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.399800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e1b857b2-7449-4450-a61a-7cc9bfff316f" (UID: "e1b857b2-7449-4450-a61a-7cc9bfff316f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.399824 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1af53a-9620-44a9-8a3c-fdea3faea22b-logs" (OuterVolumeSpecName: "logs") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.401394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-logs" (OuterVolumeSpecName: "logs") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.410063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db99cd8-81fb-414a-8eec-3db988f78f5e-logs" (OuterVolumeSpecName: "logs") pod "8db99cd8-81fb-414a-8eec-3db988f78f5e" (UID: "8db99cd8-81fb-414a-8eec-3db988f78f5e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.410224 4769 scope.go:117] "RemoveContainer" containerID="9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.410777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-scripts" (OuterVolumeSpecName: "scripts") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.412733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.413390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc3ac6c-45bc-477e-b24e-778267d7a63e-kube-api-access-6fhp5" (OuterVolumeSpecName: "kube-api-access-6fhp5") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "kube-api-access-6fhp5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.426517 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.429271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-scripts" (OuterVolumeSpecName: "scripts") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.431423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "glance") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.431670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-kube-api-access-9jzkx" (OuterVolumeSpecName: "kube-api-access-9jzkx") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "kube-api-access-9jzkx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.431863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d1af53a-9620-44a9-8a3c-fdea3faea22b-kube-api-access-mcd8k" (OuterVolumeSpecName: "kube-api-access-mcd8k") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "kube-api-access-mcd8k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.433550 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.475280 4769 scope.go:117] "RemoveContainer" containerID="677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d" Nov 21 12:28:36 crc kubenswrapper[4769]: E1121 12:28:36.478452 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d\": container with ID starting with 677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d not found: ID does not exist" containerID="677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.478498 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d"} err="failed to get container status \"677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d\": rpc error: code = NotFound desc = could not find container \"677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d\": container with ID starting with 677cef3dc8ec8b8fc1d26a09a6b6a0ac756f6f6e3972b1e46c99f8b2130af63d not found: ID does not exist" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.478525 4769 scope.go:117] "RemoveContainer" containerID="9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34" Nov 21 12:28:36 crc kubenswrapper[4769]: E1121 12:28:36.478752 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34\": container with ID starting with 9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34 not found: ID does not exist" containerID="9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.478775 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34"} err="failed to get container status \"9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34\": rpc error: code = NotFound desc = could not find container \"9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34\": container with ID starting with 9bb2ab91f86e2224799f5e2489851d094c6c4b7e44c7719b57f19ba557cb9e34 not found: ID does not exist" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.480941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-scripts\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-combined-ca-bundle\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-httpd-run\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nst9p\" (UniqueName: \"kubernetes.io/projected/24e9adde-0ce7-4cf1-8c98-21458a046a0e-kube-api-access-nst9p\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-public-tls-certs\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-logs\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.481488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-config-data\") pod \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\" (UID: \"24e9adde-0ce7-4cf1-8c98-21458a046a0e\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482231 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9jzkx\" (UniqueName: \"kubernetes.io/projected/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-kube-api-access-9jzkx\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482260 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482272 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6fhp5\" (UniqueName: \"kubernetes.io/projected/8bc3ac6c-45bc-477e-b24e-778267d7a63e-kube-api-access-6fhp5\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482281 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482290 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482299 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8db99cd8-81fb-414a-8eec-3db988f78f5e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482308 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482319 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8bc3ac6c-45bc-477e-b24e-778267d7a63e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482329 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482337 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d1af53a-9620-44a9-8a3c-fdea3faea22b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482346 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mcd8k\" (UniqueName: \"kubernetes.io/projected/7d1af53a-9620-44a9-8a3c-fdea3faea22b-kube-api-access-mcd8k\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482354 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482364 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.482373 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6n4pp\" (UniqueName: \"kubernetes.io/projected/8db99cd8-81fb-414a-8eec-3db988f78f5e-kube-api-access-6n4pp\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.484892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.492309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-logs" (OuterVolumeSpecName: "logs") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.526373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "glance") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.526466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e1b857b2-7449-4450-a61a-7cc9bfff316f" (UID: "e1b857b2-7449-4450-a61a-7cc9bfff316f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.527399 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.527724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e9adde-0ce7-4cf1-8c98-21458a046a0e-kube-api-access-nst9p" (OuterVolumeSpecName: "kube-api-access-nst9p") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "kube-api-access-nst9p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.546480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-scripts" (OuterVolumeSpecName: "scripts") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.583928 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.584212 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.584353 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.584463 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nst9p\" (UniqueName: \"kubernetes.io/projected/24e9adde-0ce7-4cf1-8c98-21458a046a0e-kube-api-access-nst9p\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.584592 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e1b857b2-7449-4450-a61a-7cc9bfff316f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.584694 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.584807 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/24e9adde-0ce7-4cf1-8c98-21458a046a0e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.606469 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.615761 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8db99cd8-81fb-414a-8eec-3db988f78f5e" (UID: "8db99cd8-81fb-414a-8eec-3db988f78f5e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.620331 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.668167 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.680743 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.688580 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-operator-scripts\") pod \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.688726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf24r\" (UniqueName: \"kubernetes.io/projected/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-kube-api-access-gf24r\") pod \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\" (UID: \"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.689994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" (UID: "a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.690717 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.690796 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.690807 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.703398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-kube-api-access-gf24r" (OuterVolumeSpecName: "kube-api-access-gf24r") pod "a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" (UID: "a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b"). InnerVolumeSpecName "kube-api-access-gf24r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.720638 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.746067 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-config-data" (OuterVolumeSpecName: "config-data") pod "8db99cd8-81fb-414a-8eec-3db988f78f5e" (UID: "8db99cd8-81fb-414a-8eec-3db988f78f5e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.750130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data" (OuterVolumeSpecName: "config-data") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.759565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8db99cd8-81fb-414a-8eec-3db988f78f5e" (UID: "8db99cd8-81fb-414a-8eec-3db988f78f5e"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.793679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.793770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54wrt\" (UniqueName: \"kubernetes.io/projected/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kube-api-access-54wrt\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.793864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-operator-scripts\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.793951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-combined-ca-bundle\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.793983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-default\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795360 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5c43124-452d-4146-aed0-d061973658e2-operator-scripts\") pod \"d5c43124-452d-4146-aed0-d061973658e2\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795446 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25d52098-169f-48dd-89d3-89cbba99b7c4-operator-scripts\") pod \"25d52098-169f-48dd-89d3-89cbba99b7c4\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-galera-tls-certs\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq5jq\" (UniqueName: \"kubernetes.io/projected/d5c43124-452d-4146-aed0-d061973658e2-kube-api-access-wq5jq\") pod \"d5c43124-452d-4146-aed0-d061973658e2\" (UID: \"d5c43124-452d-4146-aed0-d061973658e2\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kolla-config\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnfrt\" (UniqueName: \"kubernetes.io/projected/25d52098-169f-48dd-89d3-89cbba99b7c4-kube-api-access-lnfrt\") pod \"25d52098-169f-48dd-89d3-89cbba99b7c4\" (UID: \"25d52098-169f-48dd-89d3-89cbba99b7c4\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.795669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-generated\") pod \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\" (UID: \"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1\") " Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.798234 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c43124-452d-4146-aed0-d061973658e2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d5c43124-452d-4146-aed0-d061973658e2" (UID: "d5c43124-452d-4146-aed0-d061973658e2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.799033 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.799667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.799738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.799918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.801658 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.801717 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.801715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.801735 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gf24r\" (UniqueName: \"kubernetes.io/projected/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b-kube-api-access-gf24r\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.801794 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8db99cd8-81fb-414a-8eec-3db988f78f5e-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.820296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25d52098-169f-48dd-89d3-89cbba99b7c4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "25d52098-169f-48dd-89d3-89cbba99b7c4" (UID: "25d52098-169f-48dd-89d3-89cbba99b7c4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.833227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c43124-452d-4146-aed0-d061973658e2-kube-api-access-wq5jq" (OuterVolumeSpecName: "kube-api-access-wq5jq") pod "d5c43124-452d-4146-aed0-d061973658e2" (UID: "d5c43124-452d-4146-aed0-d061973658e2"). InnerVolumeSpecName "kube-api-access-wq5jq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.836961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kube-api-access-54wrt" (OuterVolumeSpecName: "kube-api-access-54wrt") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "kube-api-access-54wrt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.849474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.855579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25d52098-169f-48dd-89d3-89cbba99b7c4-kube-api-access-lnfrt" (OuterVolumeSpecName: "kube-api-access-lnfrt") pod "25d52098-169f-48dd-89d3-89cbba99b7c4" (UID: "25d52098-169f-48dd-89d3-89cbba99b7c4"). InnerVolumeSpecName "kube-api-access-lnfrt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.859144 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.883042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904450 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904493 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904506 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d5c43124-452d-4146-aed0-d061973658e2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904519 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25d52098-169f-48dd-89d3-89cbba99b7c4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904531 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wq5jq\" (UniqueName: \"kubernetes.io/projected/d5c43124-452d-4146-aed0-d061973658e2-kube-api-access-wq5jq\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904546 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904557 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904570 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lnfrt\" (UniqueName: \"kubernetes.io/projected/25d52098-169f-48dd-89d3-89cbba99b7c4-kube-api-access-lnfrt\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904584 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904597 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-54wrt\" (UniqueName: \"kubernetes.io/projected/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-kube-api-access-54wrt\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904608 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904622 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.904633 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.925882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.926117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.930436 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.933364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "mysql-db") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.946577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-config-data" (OuterVolumeSpecName: "config-data") pod "60d48f3d-32e3-4de7-8634-0f876ed5ac2f" (UID: "60d48f3d-32e3-4de7-8634-0f876ed5ac2f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.965476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-config-data" (OuterVolumeSpecName: "config-data") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:36 crc kubenswrapper[4769]: I1121 12:28:36.986051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.007080 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.007113 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.007126 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60d48f3d-32e3-4de7-8634-0f876ed5ac2f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.007136 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.007146 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.007171 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.009590 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.009662 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data podName:31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301 nodeName:}" failed. No retries permitted until 2025-11-21 12:28:45.009640097 +0000 UTC m=+2283.710301915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data") pod "rabbitmq-cell1-server-0" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.011844 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.026624 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-config-data" (OuterVolumeSpecName: "config-data") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.032394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.050410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8bc3ac6c-45bc-477e-b24e-778267d7a63e" (UID: "8bc3ac6c-45bc-477e-b24e-778267d7a63e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.065835 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.078773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "24e9adde-0ce7-4cf1-8c98-21458a046a0e" (UID: "24e9adde-0ce7-4cf1-8c98-21458a046a0e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.097984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" (UID: "c6fd9eea-ec5a-4e6f-96b5-5129595a62c1"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.100108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" event={"ID":"b83c7f40-ebcf-4637-96ee-832bb5b8907d","Type":"ContainerDied","Data":"9c7e5e623a8bc896b1fb376fb3d71faff02586b57f2bcea134aa250421aa86be"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.100165 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c7e5e623a8bc896b1fb376fb3d71faff02586b57f2bcea134aa250421aa86be" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.103094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e1b857b2-7449-4450-a61a-7cc9bfff316f","Type":"ContainerDied","Data":"cca421570a8b46bb73528650a854da4db8ce5023be2deb3dc9e159af918bda62"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.103156 4769 scope.go:117] "RemoveContainer" containerID="34cd3387ad221c34560c76abcd77a2a62d83a55afb99a7549ca55e84d12a6368" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.103342 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.110572 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.110603 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.110613 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3ac6c-45bc-477e-b24e-778267d7a63e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.110622 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24e9adde-0ce7-4cf1-8c98-21458a046a0e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.110630 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.110639 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.117609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.117648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8db99cd8-81fb-414a-8eec-3db988f78f5e","Type":"ContainerDied","Data":"0c0c402adb079e5068efacdee69b2f4066f913f7a4f8c102db8d3c218350a109"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.120329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" event={"ID":"8bc3ac6c-45bc-477e-b24e-778267d7a63e","Type":"ContainerDied","Data":"de2837b5055f67b6839226eb26313a9fb551b3d4a35af53e6b8aa2d86c648efc"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.120483 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.124319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7d1af53a-9620-44a9-8a3c-fdea3faea22b" (UID: "7d1af53a-9620-44a9-8a3c-fdea3faea22b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.124747 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.124839 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"60d48f3d-32e3-4de7-8634-0f876ed5ac2f","Type":"ContainerDied","Data":"9258cd9d53c3706c513a42d72819067737909e6f1c142592d70eb2044fd55ebd"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.126830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" event={"ID":"a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b","Type":"ContainerDied","Data":"847f1a130c0a778ab01af3a762aa61d28d1f82d55baebed46f24eb5b7b6f51c1"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.126867 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="847f1a130c0a778ab01af3a762aa61d28d1f82d55baebed46f24eb5b7b6f51c1" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.127663 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance66cf-account-delete-vxg8c" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.129711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" event={"ID":"7d1af53a-9620-44a9-8a3c-fdea3faea22b","Type":"ContainerDied","Data":"75a6f68afdfb567ef0d65731de279862c8f286ff836c0954c78c52d7c23b4f2e"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.129993 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67946cbd78-pffwl" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.138846 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" exitCode=0 Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.138912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1","Type":"ContainerDied","Data":"e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.138941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c6fd9eea-ec5a-4e6f-96b5-5129595a62c1","Type":"ContainerDied","Data":"5ddeadcd87fcff5ccb72a7694a0653bca25f7884f39c77eafe90c81925038600"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.139026 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.142656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" event={"ID":"d5c43124-452d-4146-aed0-d061973658e2","Type":"ContainerDied","Data":"0aa576a8200d3e3272701d21436df2fe3178e222c01a5954b4387e8dfbb1fcf9"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.142696 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aa576a8200d3e3272701d21436df2fe3178e222c01a5954b4387e8dfbb1fcf9" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.142797 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.144954 4769 generic.go:334] "Generic (PLEG): container finished" podID="7759a04f-afff-47f4-9f22-6c7154fa2fb3" containerID="2d2ca713ec86c4868a610f79c736e20ed1acc9b6447d222c904a0d37a46cdfb4" exitCode=0 Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.145014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7759a04f-afff-47f4-9f22-6c7154fa2fb3","Type":"ContainerDied","Data":"2d2ca713ec86c4868a610f79c736e20ed1acc9b6447d222c904a0d37a46cdfb4"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.157615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"24e9adde-0ce7-4cf1-8c98-21458a046a0e","Type":"ContainerDied","Data":"fdc05e7c68e509072a302de8397cb9c5f07ceeda3caec162275645bb7ce9fdb8"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.157767 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.160074 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.160117 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapica3a-account-delete-xtnxd" event={"ID":"25d52098-169f-48dd-89d3-89cbba99b7c4","Type":"ContainerDied","Data":"c6e7cf8d546c599d31a2c031b56e8dd594d3d6b2c5cc47a1eba8573099be3b2a"} Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.160141 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6e7cf8d546c599d31a2c031b56e8dd594d3d6b2c5cc47a1eba8573099be3b2a" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.160416 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.183627 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6jkbx"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.212523 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d1af53a-9620-44a9-8a3c-fdea3faea22b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.216520 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.235896 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.260393 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.263512 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.266941 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.267001 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="ovn-northd" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.283558 4769 scope.go:117] "RemoveContainer" containerID="25b1a6d430b0e6524a6bc0e8066ada3b4eac6044cbff1aa6699d8fd23351f774" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.298625 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" path="/var/lib/kubelet/pods/3b8ee7d0-9900-447f-8b43-f72587e6c8c1/volumes" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.299565 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46dff394-5dc3-442d-bbe2-31563973474a" path="/var/lib/kubelet/pods/46dff394-5dc3-442d-bbe2-31563973474a/volumes" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.303367 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" path="/var/lib/kubelet/pods/a393fa88-8741-40b7-8a55-4f853c1722b8/volumes" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.308075 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a614f405-9af6-4df3-b4ee-b062bd73077d" path="/var/lib/kubelet/pods/a614f405-9af6-4df3-b4ee-b062bd73077d/volumes" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.308963 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d256f115-9c51-46ce-ab7e-8267b1b3dc54" path="/var/lib/kubelet/pods/d256f115-9c51-46ce-ab7e-8267b1b3dc54/volumes" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.309553 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1b72391-1ff2-4f97-bbf0-c928045f6395" path="/var/lib/kubelet/pods/f1b72391-1ff2-4f97-bbf0-c928045f6395/volumes" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmvgq\" (UniqueName: \"kubernetes.io/projected/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kube-api-access-wmvgq\") pod \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b655s\" (UniqueName: \"kubernetes.io/projected/b83c7f40-ebcf-4637-96ee-832bb5b8907d-kube-api-access-b655s\") pod \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-config-data\") pod \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kolla-config\") pod \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b83c7f40-ebcf-4637-96ee-832bb5b8907d-operator-scripts\") pod \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\" (UID: \"b83c7f40-ebcf-4637-96ee-832bb5b8907d\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-combined-ca-bundle\") pod \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.314527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-memcached-tls-certs\") pod \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\" (UID: \"7759a04f-afff-47f4-9f22-6c7154fa2fb3\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.321582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-config-data" (OuterVolumeSpecName: "config-data") pod "7759a04f-afff-47f4-9f22-6c7154fa2fb3" (UID: "7759a04f-afff-47f4-9f22-6c7154fa2fb3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.322605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "7759a04f-afff-47f4-9f22-6c7154fa2fb3" (UID: "7759a04f-afff-47f4-9f22-6c7154fa2fb3"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.325006 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapica3a-account-delete-xtnxd"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.326030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b83c7f40-ebcf-4637-96ee-832bb5b8907d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b83c7f40-ebcf-4637-96ee-832bb5b8907d" (UID: "b83c7f40-ebcf-4637-96ee-832bb5b8907d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.326258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kube-api-access-wmvgq" (OuterVolumeSpecName: "kube-api-access-wmvgq") pod "7759a04f-afff-47f4-9f22-6c7154fa2fb3" (UID: "7759a04f-afff-47f4-9f22-6c7154fa2fb3"). InnerVolumeSpecName "kube-api-access-wmvgq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.326644 4769 scope.go:117] "RemoveContainer" containerID="eacfe69496d42243648977490be543cfccfa90344dc261525b705d4e2b35f758" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.331090 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapica3a-account-delete-xtnxd"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.338139 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.349136 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.350111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83c7f40-ebcf-4637-96ee-832bb5b8907d-kube-api-access-b655s" (OuterVolumeSpecName: "kube-api-access-b655s") pod "b83c7f40-ebcf-4637-96ee-832bb5b8907d" (UID: "b83c7f40-ebcf-4637-96ee-832bb5b8907d"). InnerVolumeSpecName "kube-api-access-b655s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.357502 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-67946cbd78-pffwl"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.371404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7759a04f-afff-47f4-9f22-6c7154fa2fb3" (UID: "7759a04f-afff-47f4-9f22-6c7154fa2fb3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.379514 4769 scope.go:117] "RemoveContainer" containerID="2a990d18d760f975a0be3c11e04d817fc89798392bc035ca3ed0766d105d9af0" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.381351 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-67946cbd78-pffwl"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.393553 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.409084 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.416946 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wmvgq\" (UniqueName: \"kubernetes.io/projected/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kube-api-access-wmvgq\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.416987 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b655s\" (UniqueName: \"kubernetes.io/projected/b83c7f40-ebcf-4637-96ee-832bb5b8907d-kube-api-access-b655s\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.416999 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.417009 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/7759a04f-afff-47f4-9f22-6c7154fa2fb3-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.417020 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b83c7f40-ebcf-4637-96ee-832bb5b8907d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.417031 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.418816 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.432124 4769 scope.go:117] "RemoveContainer" containerID="f26dbf44d9fe564886ba9eac123dcb6e2ac8626a543596179180a5e7572e70f8" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.435838 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "7759a04f-afff-47f4-9f22-6c7154fa2fb3" (UID: "7759a04f-afff-47f4-9f22-6c7154fa2fb3"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.439240 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.446300 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.453042 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.458170 4769 scope.go:117] "RemoveContainer" containerID="017f91debc55afc1f32691f9fcb7a2055c6ca9f361ef281d2f91aa0faa9f7706" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.459452 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.496800 4769 scope.go:117] "RemoveContainer" containerID="a9cb286696dfabe46b8f1cad7b25766dec37fcb850bd3469c5a9ec7c9b313078" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.513080 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7dcd6754fb-dn576"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.518753 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/7759a04f-afff-47f4-9f22-6c7154fa2fb3-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.520068 4769 scope.go:117] "RemoveContainer" containerID="34c9d0a000299b8aa0798da9a634904fc939c7c330ef500f2aeb1dad6dab4995" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.524297 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance66cf-account-delete-vxg8c"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.537101 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance66cf-account-delete-vxg8c"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.544008 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.546927 4769 scope.go:117] "RemoveContainer" containerID="e37e8ca9c13159ff75dbefc98fa8e79d84ee836baf47fc1b85942a8dbbf77b7f" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.554094 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.561514 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.568574 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbicane4c5-account-delete-mz4hb"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.573111 4769 scope.go:117] "RemoveContainer" containerID="0007ac30b31f0ce12a8d4ec3ce279639c0cf5ed4f1fab2916d85d12034efbeca" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.581447 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.588169 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.602402 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.615553 4769 scope.go:117] "RemoveContainer" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.638516 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.650363 4769 scope.go:117] "RemoveContainer" containerID="a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.694322 4769 scope.go:117] "RemoveContainer" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.695294 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4\": container with ID starting with e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4 not found: ID does not exist" containerID="e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.695359 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4"} err="failed to get container status \"e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4\": rpc error: code = NotFound desc = could not find container \"e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4\": container with ID starting with e15a51d8bc96b0f85ebdf3c7e2f05459b91ada92fa94e6737fc33b1722e78cf4 not found: ID does not exist" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.695394 4769 scope.go:117] "RemoveContainer" containerID="a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7" Nov 21 12:28:37 crc kubenswrapper[4769]: E1121 12:28:37.695863 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7\": container with ID starting with a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7 not found: ID does not exist" containerID="a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.695928 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7"} err="failed to get container status \"a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7\": rpc error: code = NotFound desc = could not find container \"a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7\": container with ID starting with a19a16487f3a434b9bf70cce5d288c527dbbbae13e8198d1c24413d08018e1c7 not found: ID does not exist" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.695969 4769 scope.go:117] "RemoveContainer" containerID="da9b83ab069f95e46f81bc4c86275abda61442db99af1310087deeb06729e95c" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.721550 4769 scope.go:117] "RemoveContainer" containerID="e1a8a85295fbfaf9ddcacaf104c7e3a5187c32bb6d23ba29095d186d1500d7e3" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.722048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq8bz\" (UniqueName: \"kubernetes.io/projected/8f29aa49-a966-46a2-9f51-a5f344b0944a-kube-api-access-tq8bz\") pod \"8f29aa49-a966-46a2-9f51-a5f344b0944a\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.722115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f29aa49-a966-46a2-9f51-a5f344b0944a-operator-scripts\") pod \"8f29aa49-a966-46a2-9f51-a5f344b0944a\" (UID: \"8f29aa49-a966-46a2-9f51-a5f344b0944a\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.722164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-644vc\" (UniqueName: \"kubernetes.io/projected/ad288522-75bb-4bfc-b547-c2552f8c2995-kube-api-access-644vc\") pod \"ad288522-75bb-4bfc-b547-c2552f8c2995\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.722306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad288522-75bb-4bfc-b547-c2552f8c2995-operator-scripts\") pod \"ad288522-75bb-4bfc-b547-c2552f8c2995\" (UID: \"ad288522-75bb-4bfc-b547-c2552f8c2995\") " Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.723271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f29aa49-a966-46a2-9f51-a5f344b0944a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8f29aa49-a966-46a2-9f51-a5f344b0944a" (UID: "8f29aa49-a966-46a2-9f51-a5f344b0944a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.723487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad288522-75bb-4bfc-b547-c2552f8c2995-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ad288522-75bb-4bfc-b547-c2552f8c2995" (UID: "ad288522-75bb-4bfc-b547-c2552f8c2995"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.726578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f29aa49-a966-46a2-9f51-a5f344b0944a-kube-api-access-tq8bz" (OuterVolumeSpecName: "kube-api-access-tq8bz") pod "8f29aa49-a966-46a2-9f51-a5f344b0944a" (UID: "8f29aa49-a966-46a2-9f51-a5f344b0944a"). InnerVolumeSpecName "kube-api-access-tq8bz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.726848 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad288522-75bb-4bfc-b547-c2552f8c2995-kube-api-access-644vc" (OuterVolumeSpecName: "kube-api-access-644vc") pod "ad288522-75bb-4bfc-b547-c2552f8c2995" (UID: "ad288522-75bb-4bfc-b547-c2552f8c2995"). InnerVolumeSpecName "kube-api-access-644vc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.824757 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tq8bz\" (UniqueName: \"kubernetes.io/projected/8f29aa49-a966-46a2-9f51-a5f344b0944a-kube-api-access-tq8bz\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.824801 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f29aa49-a966-46a2-9f51-a5f344b0944a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.824813 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-644vc\" (UniqueName: \"kubernetes.io/projected/ad288522-75bb-4bfc-b547-c2552f8c2995-kube-api-access-644vc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:37 crc kubenswrapper[4769]: I1121 12:28:37.824825 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad288522-75bb-4bfc-b547-c2552f8c2995-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.073919 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.076495 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.078168 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.078269 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerName="nova-cell1-conductor-conductor" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.161691 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.176080 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6ca83904-6406-45e4-bfc1-6a953ed672b5/ovn-northd/0.log" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.176121 4769 generic.go:334] "Generic (PLEG): container finished" podID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" exitCode=139 Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.176216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ca83904-6406-45e4-bfc1-6a953ed672b5","Type":"ContainerDied","Data":"64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4"} Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.180251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" event={"ID":"ad288522-75bb-4bfc-b547-c2552f8c2995","Type":"ContainerDied","Data":"4fa8529f37537c4a7d95de38d9c96cd1c93e432ab3d1debccd3ded910b0498c8"} Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.180267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron86b3-account-delete-ggrcm" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.180290 4769 scope.go:117] "RemoveContainer" containerID="cd46bfda5ba2d5edbbd333c7b454a290d0f39996d7c77405218eeb3955a79f58" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.198489 4769 generic.go:334] "Generic (PLEG): container finished" podID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerID="771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf" exitCode=0 Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.198540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d125f717-0ab9-4ee5-971b-af7aa24e5ddd","Type":"ContainerDied","Data":"771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf"} Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.198570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d125f717-0ab9-4ee5-971b-af7aa24e5ddd","Type":"ContainerDied","Data":"1b23fd4bdf7a1394d97bceeecce4455eda2a90b25bb675b97bf1ebce57607bec"} Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.198526 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.213543 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.213545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell08833-account-delete-jlwbf" event={"ID":"8f29aa49-a966-46a2-9f51-a5f344b0944a","Type":"ContainerDied","Data":"6a01a95d1a5f823e2fab1a37b48236dec2fc2dc4061aaac3907cfdc04b3618db"} Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.216699 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.216955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"7759a04f-afff-47f4-9f22-6c7154fa2fb3","Type":"ContainerDied","Data":"08b9f44b47c6c0078048a23e193d0483e889158f6c8dc1b4a0872141531e0f7e"} Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.224934 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron86b3-account-delete-ggrcm"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.228162 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder52d4-account-delete-mtt6h" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.228331 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-6jkbx" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="registry-server" containerID="cri-o://84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc" gracePeriod=2 Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtrqd\" (UniqueName: \"kubernetes.io/projected/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kube-api-access-jtrqd\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-combined-ca-bundle\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-operator-scripts\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-generated\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-default\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kolla-config\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231907 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-galera-tls-certs\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.231928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\" (UID: \"d125f717-0ab9-4ee5-971b-af7aa24e5ddd\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.232789 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.232801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.233208 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.233483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.234383 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron86b3-account-delete-ggrcm"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.236768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kube-api-access-jtrqd" (OuterVolumeSpecName: "kube-api-access-jtrqd") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "kube-api-access-jtrqd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.239305 4769 scope.go:117] "RemoveContainer" containerID="771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.261704 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.279964 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell08833-account-delete-jlwbf"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.285520 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell08833-account-delete-jlwbf"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.297114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.301340 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.306286 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.307658 4769 scope.go:117] "RemoveContainer" containerID="ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.318682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "d125f717-0ab9-4ee5-971b-af7aa24e5ddd" (UID: "d125f717-0ab9-4ee5-971b-af7aa24e5ddd"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339467 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339524 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339554 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339568 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jtrqd\" (UniqueName: \"kubernetes.io/projected/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-kube-api-access-jtrqd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339579 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339591 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339600 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.339609 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d125f717-0ab9-4ee5-971b-af7aa24e5ddd-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.360034 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.393042 4769 scope.go:117] "RemoveContainer" containerID="771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf" Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.393779 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf\": container with ID starting with 771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf not found: ID does not exist" containerID="771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.393852 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf"} err="failed to get container status \"771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf\": rpc error: code = NotFound desc = could not find container \"771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf\": container with ID starting with 771ff4771c2f99fdca39f20e3392e7926c8906157e2ab563571b68c7eba3cdaf not found: ID does not exist" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.393905 4769 scope.go:117] "RemoveContainer" containerID="ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305" Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.394384 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305\": container with ID starting with ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305 not found: ID does not exist" containerID="ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.394430 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305"} err="failed to get container status \"ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305\": rpc error: code = NotFound desc = could not find container \"ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305\": container with ID starting with ee79edead1346e61c27d3160960c74cc0970151f68fb39fa33766261ca2f3305 not found: ID does not exist" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.394462 4769 scope.go:117] "RemoveContainer" containerID="4907a97d070814384d9b78a7371d9106151f7e2018ae9d4d389cb855cd164128" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.426960 4769 scope.go:117] "RemoveContainer" containerID="2d2ca713ec86c4868a610f79c736e20ed1acc9b6447d222c904a0d37a46cdfb4" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.443104 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.656476 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6ca83904-6406-45e4-bfc1-6a953ed672b5/ovn-northd/0.log" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.656558 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.670062 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.679758 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.756651 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-metrics-certs-tls-certs\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.756744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-config\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.756773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/6ca83904-6406-45e4-bfc1-6a953ed672b5-kube-api-access-tdsjv\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.756796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-northd-tls-certs\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.756946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-rundir\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.756983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-combined-ca-bundle\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.757004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-scripts\") pod \"6ca83904-6406-45e4-bfc1-6a953ed672b5\" (UID: \"6ca83904-6406-45e4-bfc1-6a953ed672b5\") " Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.757632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.758566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-config" (OuterVolumeSpecName: "config") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.758665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-scripts" (OuterVolumeSpecName: "scripts") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.767346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ca83904-6406-45e4-bfc1-6a953ed672b5-kube-api-access-tdsjv" (OuterVolumeSpecName: "kube-api-access-tdsjv") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "kube-api-access-tdsjv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.820365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.859328 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.859387 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.859405 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.859416 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ca83904-6406-45e4-bfc1-6a953ed672b5-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.859428 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tdsjv\" (UniqueName: \"kubernetes.io/projected/6ca83904-6406-45e4-bfc1-6a953ed672b5-kube-api-access-tdsjv\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.859506 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:28:38 crc kubenswrapper[4769]: E1121 12:28:38.859570 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data podName:7313da1b-b474-474a-acc2-51ee39d5d79b nodeName:}" failed. No retries permitted until 2025-11-21 12:28:46.859546519 +0000 UTC m=+2285.560208337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data") pod "rabbitmq-server-0" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b") : configmap "rabbitmq-config-data" not found Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.867100 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.878143 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "6ca83904-6406-45e4-bfc1-6a953ed672b5" (UID: "6ca83904-6406-45e4-bfc1-6a953ed672b5"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.961621 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.961672 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ca83904-6406-45e4-bfc1-6a953ed672b5-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.971615 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:38 crc kubenswrapper[4769]: I1121 12:28:38.987091 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.025169 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.062979 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-combined-ca-bundle\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-config-data\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-public-tls-certs\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-internal-tls-certs\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-fernet-keys\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063176 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-scripts\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063252 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44qtx\" (UniqueName: \"kubernetes.io/projected/6359092b-61ea-402d-9d63-0cb82f623c6c-kube-api-access-44qtx\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-utilities\") pod \"f0440cef-3647-4eda-b613-19ab87c03e77\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-catalog-content\") pod \"f0440cef-3647-4eda-b613-19ab87c03e77\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-credential-keys\") pod \"6359092b-61ea-402d-9d63-0cb82f623c6c\" (UID: \"6359092b-61ea-402d-9d63-0cb82f623c6c\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.063349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mx6v\" (UniqueName: \"kubernetes.io/projected/f0440cef-3647-4eda-b613-19ab87c03e77-kube-api-access-5mx6v\") pod \"f0440cef-3647-4eda-b613-19ab87c03e77\" (UID: \"f0440cef-3647-4eda-b613-19ab87c03e77\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.076321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0440cef-3647-4eda-b613-19ab87c03e77-kube-api-access-5mx6v" (OuterVolumeSpecName: "kube-api-access-5mx6v") pod "f0440cef-3647-4eda-b613-19ab87c03e77" (UID: "f0440cef-3647-4eda-b613-19ab87c03e77"). InnerVolumeSpecName "kube-api-access-5mx6v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.081846 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.085782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-utilities" (OuterVolumeSpecName: "utilities") pod "f0440cef-3647-4eda-b613-19ab87c03e77" (UID: "f0440cef-3647-4eda-b613-19ab87c03e77"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.095255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-scripts" (OuterVolumeSpecName: "scripts") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.096423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6359092b-61ea-402d-9d63-0cb82f623c6c-kube-api-access-44qtx" (OuterVolumeSpecName: "kube-api-access-44qtx") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "kube-api-access-44qtx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.105970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f0440cef-3647-4eda-b613-19ab87c03e77" (UID: "f0440cef-3647-4eda-b613-19ab87c03e77"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.107030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.111785 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.125231 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-config-data" (OuterVolumeSpecName: "config-data") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.140369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.143063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6359092b-61ea-402d-9d63-0cb82f623c6c" (UID: "6359092b-61ea-402d-9d63-0cb82f623c6c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.153151 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-plugins-conf\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166801 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-plugins\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-confd\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-tls\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-pod-info\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166916 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr8w2\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-kube-api-access-cr8w2\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.166976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-erlang-cookie\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167024 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-erlang-cookie-secret\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-server-conf\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data\") pod \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\" (UID: \"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167629 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167646 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167657 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167666 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167675 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-44qtx\" (UniqueName: \"kubernetes.io/projected/6359092b-61ea-402d-9d63-0cb82f623c6c-kube-api-access-44qtx\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167685 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167736 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f0440cef-3647-4eda-b613-19ab87c03e77-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167752 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167768 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167784 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5mx6v\" (UniqueName: \"kubernetes.io/projected/f0440cef-3647-4eda-b613-19ab87c03e77-kube-api-access-5mx6v\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167798 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.167809 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6359092b-61ea-402d-9d63-0cb82f623c6c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.169167 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.171652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.173593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-pod-info" (OuterVolumeSpecName: "pod-info") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.173751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.176320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.176549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-kube-api-access-cr8w2" (OuterVolumeSpecName: "kube-api-access-cr8w2") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "kube-api-access-cr8w2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.207457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data" (OuterVolumeSpecName: "config-data") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.231137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-server-conf" (OuterVolumeSpecName: "server-conf") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.240600 4769 generic.go:334] "Generic (PLEG): container finished" podID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerID="d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85" exitCode=0 Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.240846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301","Type":"ContainerDied","Data":"d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.240931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301","Type":"ContainerDied","Data":"abe1448282763458b0304fab94397bd095ba24cd0694316a2389f2fd9f143384"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.241005 4769 scope.go:117] "RemoveContainer" containerID="d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.241252 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.245627 4769 generic.go:334] "Generic (PLEG): container finished" podID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerID="6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1" exitCode=0 Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.245729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7313da1b-b474-474a-acc2-51ee39d5d79b","Type":"ContainerDied","Data":"6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.245812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7313da1b-b474-474a-acc2-51ee39d5d79b","Type":"ContainerDied","Data":"ed5d30d14bb4cfd97bb983cbf46ad1b7ac16a6cb34cb9861b4017a2ab87212fa"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.245910 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.249760 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0440cef-3647-4eda-b613-19ab87c03e77" containerID="84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc" exitCode=0 Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.249856 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6jkbx" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.249864 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6jkbx" event={"ID":"f0440cef-3647-4eda-b613-19ab87c03e77","Type":"ContainerDied","Data":"84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.249926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6jkbx" event={"ID":"f0440cef-3647-4eda-b613-19ab87c03e77","Type":"ContainerDied","Data":"7afbcdcad746fcad29971eccb748a91ebb531ffc5290baafbe9c3289bee3df19"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.253922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" (UID: "31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.256571 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6ca83904-6406-45e4-bfc1-6a953ed672b5/ovn-northd/0.log" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.256729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6ca83904-6406-45e4-bfc1-6a953ed672b5","Type":"ContainerDied","Data":"aff33439df2c0fde793a58d6c349ddf44be46a36e0939753f5e6db1045c54189"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.256789 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.261711 4769 generic.go:334] "Generic (PLEG): container finished" podID="6359092b-61ea-402d-9d63-0cb82f623c6c" containerID="c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95" exitCode=0 Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.261757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" event={"ID":"6359092b-61ea-402d-9d63-0cb82f623c6c","Type":"ContainerDied","Data":"c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.261785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" event={"ID":"6359092b-61ea-402d-9d63-0cb82f623c6c","Type":"ContainerDied","Data":"8f6114c4c6f6c89bd996cb106bf06503a38afec0fb319bc98086aae99fadf3f3"} Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.261856 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.264517 4769 scope.go:117] "RemoveContainer" containerID="c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7313da1b-b474-474a-acc2-51ee39d5d79b-pod-info\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-confd\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-server-conf\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268377 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7313da1b-b474-474a-acc2-51ee39d5d79b-erlang-cookie-secret\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-plugins-conf\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-erlang-cookie\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268557 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-tls\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x84jx\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-kube-api-access-x84jx\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-plugins\") pod \"7313da1b-b474-474a-acc2-51ee39d5d79b\" (UID: \"7313da1b-b474-474a-acc2-51ee39d5d79b\") " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268939 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268955 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268965 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268974 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.268984 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cr8w2\" (UniqueName: \"kubernetes.io/projected/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-kube-api-access-cr8w2\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.269003 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.269012 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.269022 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.269030 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.269039 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.270932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.271261 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.272054 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.273712 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "persistence") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.274481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-kube-api-access-x84jx" (OuterVolumeSpecName: "kube-api-access-x84jx") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "kube-api-access-x84jx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.293672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7313da1b-b474-474a-acc2-51ee39d5d79b-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.299072 4769 scope.go:117] "RemoveContainer" containerID="d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.299968 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85\": container with ID starting with d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85 not found: ID does not exist" containerID="d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.300106 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85"} err="failed to get container status \"d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85\": rpc error: code = NotFound desc = could not find container \"d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85\": container with ID starting with d2669dbb4579d514dd219c0da9955da1f4044164fa97f23301a6b4ce7b643b85 not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.300149 4769 scope.go:117] "RemoveContainer" containerID="c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.300379 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b\": container with ID starting with c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b not found: ID does not exist" containerID="c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.300499 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b"} err="failed to get container status \"c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b\": rpc error: code = NotFound desc = could not find container \"c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b\": container with ID starting with c4b30eefd2c2f48745c1f73fbd431f72e7769d2b9a2e7f057ba9e2b605970a0b not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.300515 4769 scope.go:117] "RemoveContainer" containerID="6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.303094 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" path="/var/lib/kubelet/pods/24e9adde-0ce7-4cf1-8c98-21458a046a0e/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.305320 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25d52098-169f-48dd-89d3-89cbba99b7c4" path="/var/lib/kubelet/pods/25d52098-169f-48dd-89d3-89cbba99b7c4/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.306983 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" path="/var/lib/kubelet/pods/60d48f3d-32e3-4de7-8634-0f876ed5ac2f/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.311129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7759a04f-afff-47f4-9f22-6c7154fa2fb3" path="/var/lib/kubelet/pods/7759a04f-afff-47f4-9f22-6c7154fa2fb3/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.311662 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" path="/var/lib/kubelet/pods/7d1af53a-9620-44a9-8a3c-fdea3faea22b/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.312697 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" path="/var/lib/kubelet/pods/8bc3ac6c-45bc-477e-b24e-778267d7a63e/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.313286 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" path="/var/lib/kubelet/pods/8db99cd8-81fb-414a-8eec-3db988f78f5e/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.314083 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f29aa49-a966-46a2-9f51-a5f344b0944a" path="/var/lib/kubelet/pods/8f29aa49-a966-46a2-9f51-a5f344b0944a/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.315072 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" path="/var/lib/kubelet/pods/a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.315564 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad288522-75bb-4bfc-b547-c2552f8c2995" path="/var/lib/kubelet/pods/ad288522-75bb-4bfc-b547-c2552f8c2995/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.315666 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7313da1b-b474-474a-acc2-51ee39d5d79b-pod-info" (OuterVolumeSpecName: "pod-info") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.315752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.316578 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" path="/var/lib/kubelet/pods/c6fd9eea-ec5a-4e6f-96b5-5129595a62c1/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.317289 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" path="/var/lib/kubelet/pods/d125f717-0ab9-4ee5-971b-af7aa24e5ddd/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.318327 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5c43124-452d-4146-aed0-d061973658e2" path="/var/lib/kubelet/pods/d5c43124-452d-4146-aed0-d061973658e2/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.318999 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" path="/var/lib/kubelet/pods/e1b857b2-7449-4450-a61a-7cc9bfff316f/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.319563 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaabdea5-a92a-4d83-a910-fe0a9993b278" path="/var/lib/kubelet/pods/eaabdea5-a92a-4d83-a910-fe0a9993b278/volumes" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.324309 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.325727 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6jkbx"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.325780 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-6jkbx"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.325802 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.325818 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.326687 4769 scope.go:117] "RemoveContainer" containerID="f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.334000 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data" (OuterVolumeSpecName: "config-data") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.334242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.340242 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-65dbf6cdb4-q7xkf"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.347638 4769 scope.go:117] "RemoveContainer" containerID="6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.348423 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1\": container with ID starting with 6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1 not found: ID does not exist" containerID="6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.348459 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1"} err="failed to get container status \"6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1\": rpc error: code = NotFound desc = could not find container \"6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1\": container with ID starting with 6edde439f2f8f0b0aa88b88adc527ef710c66a2d6f088765bab5402e5a23a5f1 not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.348493 4769 scope.go:117] "RemoveContainer" containerID="f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.348771 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8\": container with ID starting with f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8 not found: ID does not exist" containerID="f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.348891 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8"} err="failed to get container status \"f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8\": rpc error: code = NotFound desc = could not find container \"f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8\": container with ID starting with f9d960542f4233e69d990dc9bc1cbfadd0efe21767d435d9eb383ed8e62a35e8 not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.348986 4769 scope.go:117] "RemoveContainer" containerID="84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.358280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-server-conf" (OuterVolumeSpecName: "server-conf") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.366208 4769 scope.go:117] "RemoveContainer" containerID="d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.370941 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.370969 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.370979 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7313da1b-b474-474a-acc2-51ee39d5d79b-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371036 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371047 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7313da1b-b474-474a-acc2-51ee39d5d79b-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371058 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371067 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371076 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x84jx\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-kube-api-access-x84jx\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371084 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371093 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.371100 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7313da1b-b474-474a-acc2-51ee39d5d79b-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.388286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "7313da1b-b474-474a-acc2-51ee39d5d79b" (UID: "7313da1b-b474-474a-acc2-51ee39d5d79b"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.388325 4769 scope.go:117] "RemoveContainer" containerID="9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.391569 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.412961 4769 scope.go:117] "RemoveContainer" containerID="84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.413441 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc\": container with ID starting with 84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc not found: ID does not exist" containerID="84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.413481 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc"} err="failed to get container status \"84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc\": rpc error: code = NotFound desc = could not find container \"84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc\": container with ID starting with 84b6d0ce8a5e20898c57eef8d1108c91f746a21ded00b6656e9cefd07d9f45bc not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.413512 4769 scope.go:117] "RemoveContainer" containerID="d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.413874 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415\": container with ID starting with d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415 not found: ID does not exist" containerID="d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.413903 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415"} err="failed to get container status \"d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415\": rpc error: code = NotFound desc = could not find container \"d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415\": container with ID starting with d1ee3d56a963b479b560b6610d8dd739e97a398cb8559391f9613a898993e415 not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.413922 4769 scope.go:117] "RemoveContainer" containerID="9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.414239 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df\": container with ID starting with 9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df not found: ID does not exist" containerID="9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.414264 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df"} err="failed to get container status \"9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df\": rpc error: code = NotFound desc = could not find container \"9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df\": container with ID starting with 9e7335afac4665f0d064228cc349ce63acfe6c18d656453a3a887b361c8c27df not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.414283 4769 scope.go:117] "RemoveContainer" containerID="a6aea864b65349fff1b9b42caf5b5f4a0d8bbd1fa473c1220dfc154554c18240" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.444295 4769 scope.go:117] "RemoveContainer" containerID="64287a6f9e10cc6758411d086dfd0bd2ef2f0cf3262381c30f21be0ea159c3c4" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.469320 4769 scope.go:117] "RemoveContainer" containerID="c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.472382 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7313da1b-b474-474a-acc2-51ee39d5d79b-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.472430 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.543681 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gk5gc"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.553164 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gk5gc"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.567863 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder52d4-account-delete-mtt6h"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.574063 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-52d4-account-create-8z4wn"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.576993 4769 scope.go:117] "RemoveContainer" containerID="c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95" Nov 21 12:28:39 crc kubenswrapper[4769]: E1121 12:28:39.577582 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95\": container with ID starting with c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95 not found: ID does not exist" containerID="c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.577729 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95"} err="failed to get container status \"c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95\": rpc error: code = NotFound desc = could not find container \"c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95\": container with ID starting with c265deee09de491176bbba3a8e7fa9325a32168f1d61284ffd7e3901f34cfb95 not found: ID does not exist" Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.583126 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.593489 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-52d4-account-create-8z4wn"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.597922 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder52d4-account-delete-mtt6h"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.602348 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.606909 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.610749 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.720983 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-l85j4"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.728395 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-l85j4"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.751258 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement373d-account-delete-8bwrt"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.758253 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-373d-account-create-hld28"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.764371 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement373d-account-delete-8bwrt"] Nov 21 12:28:39 crc kubenswrapper[4769]: I1121 12:28:39.770918 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-373d-account-create-hld28"] Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.205111 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-log-httpd\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-run-httpd\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-scripts\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290368 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-ceilometer-tls-certs\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-sg-core-conf-yaml\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5nqb\" (UniqueName: \"kubernetes.io/projected/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-kube-api-access-g5nqb\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290597 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-config-data\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-combined-ca-bundle\") pod \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\" (UID: \"6bc22451-dbc4-4588-8622-d9cd4ce4cebb\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.290993 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.292890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.294900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-scripts" (OuterVolumeSpecName: "scripts") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.295839 4769 generic.go:334] "Generic (PLEG): container finished" podID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerID="214d2c35599922b5291aa6d73f8104c9866c71f665821c87c6c975ac55bf1faa" exitCode=0 Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.295958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" event={"ID":"8205dbfb-fc46-457f-a977-7ceb6377da8d","Type":"ContainerDied","Data":"214d2c35599922b5291aa6d73f8104c9866c71f665821c87c6c975ac55bf1faa"} Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.300956 4769 generic.go:334] "Generic (PLEG): container finished" podID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" exitCode=0 Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.301162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07afcc28-4336-44c0-b1b1-3a741b6f6b65","Type":"ContainerDied","Data":"79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a"} Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.304873 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerID="02e96ff8d49d4c0f1df8aad8bb6c2f91758c057b24bd5ec7ce588fc4f2b2caad" exitCode=0 Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.304932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" event={"ID":"6b0e43c9-665b-4c35-9eb3-f10936347547","Type":"ContainerDied","Data":"02e96ff8d49d4c0f1df8aad8bb6c2f91758c057b24bd5ec7ce588fc4f2b2caad"} Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.308023 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-kube-api-access-g5nqb" (OuterVolumeSpecName: "kube-api-access-g5nqb") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "kube-api-access-g5nqb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.313304 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.313316 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerID="a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e" exitCode=0 Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.313348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerDied","Data":"a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e"} Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.313404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6bc22451-dbc4-4588-8622-d9cd4ce4cebb","Type":"ContainerDied","Data":"dc922543bebb8dd828284a5ba01c3aaaa08d9835c079e1af3ea2ddcc7598224a"} Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.313426 4769 scope.go:117] "RemoveContainer" containerID="e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.320387 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.329433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.355398 4769 scope.go:117] "RemoveContainer" containerID="36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.364604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.374926 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.388313 4769 scope.go:117] "RemoveContainer" containerID="a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.392736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-combined-ca-bundle\") pod \"6b0e43c9-665b-4c35-9eb3-f10936347547\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.392796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b0e43c9-665b-4c35-9eb3-f10936347547-logs\") pod \"6b0e43c9-665b-4c35-9eb3-f10936347547\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.392845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrk2r\" (UniqueName: \"kubernetes.io/projected/6b0e43c9-665b-4c35-9eb3-f10936347547-kube-api-access-xrk2r\") pod \"6b0e43c9-665b-4c35-9eb3-f10936347547\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.392967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data-custom\") pod \"6b0e43c9-665b-4c35-9eb3-f10936347547\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.393003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data\") pod \"6b0e43c9-665b-4c35-9eb3-f10936347547\" (UID: \"6b0e43c9-665b-4c35-9eb3-f10936347547\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.393657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b0e43c9-665b-4c35-9eb3-f10936347547-logs" (OuterVolumeSpecName: "logs") pod "6b0e43c9-665b-4c35-9eb3-f10936347547" (UID: "6b0e43c9-665b-4c35-9eb3-f10936347547"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395359 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b0e43c9-665b-4c35-9eb3-f10936347547-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395380 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395395 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g5nqb\" (UniqueName: \"kubernetes.io/projected/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-kube-api-access-g5nqb\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395406 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395418 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395428 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.395441 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.397318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-config-data" (OuterVolumeSpecName: "config-data") pod "6bc22451-dbc4-4588-8622-d9cd4ce4cebb" (UID: "6bc22451-dbc4-4588-8622-d9cd4ce4cebb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.397815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6b0e43c9-665b-4c35-9eb3-f10936347547" (UID: "6b0e43c9-665b-4c35-9eb3-f10936347547"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.412139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b0e43c9-665b-4c35-9eb3-f10936347547-kube-api-access-xrk2r" (OuterVolumeSpecName: "kube-api-access-xrk2r") pod "6b0e43c9-665b-4c35-9eb3-f10936347547" (UID: "6b0e43c9-665b-4c35-9eb3-f10936347547"). InnerVolumeSpecName "kube-api-access-xrk2r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.417558 4769 scope.go:117] "RemoveContainer" containerID="106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.432675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b0e43c9-665b-4c35-9eb3-f10936347547" (UID: "6b0e43c9-665b-4c35-9eb3-f10936347547"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.434090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.439356 4769 scope.go:117] "RemoveContainer" containerID="e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072" Nov 21 12:28:40 crc kubenswrapper[4769]: E1121 12:28:40.440236 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072\": container with ID starting with e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072 not found: ID does not exist" containerID="e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.440277 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072"} err="failed to get container status \"e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072\": rpc error: code = NotFound desc = could not find container \"e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072\": container with ID starting with e1c048d30b5558554fe8c705bf64e3216a5da7001beed4507d9e2a2298559072 not found: ID does not exist" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.440301 4769 scope.go:117] "RemoveContainer" containerID="36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5" Nov 21 12:28:40 crc kubenswrapper[4769]: E1121 12:28:40.440619 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5\": container with ID starting with 36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5 not found: ID does not exist" containerID="36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.440641 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5"} err="failed to get container status \"36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5\": rpc error: code = NotFound desc = could not find container \"36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5\": container with ID starting with 36e711f587d702221e0049afd11ef8d95e8c4c488ca0f0bce6e30bcaf0f5fac5 not found: ID does not exist" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.440653 4769 scope.go:117] "RemoveContainer" containerID="a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e" Nov 21 12:28:40 crc kubenswrapper[4769]: E1121 12:28:40.440961 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e\": container with ID starting with a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e not found: ID does not exist" containerID="a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.440986 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e"} err="failed to get container status \"a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e\": rpc error: code = NotFound desc = could not find container \"a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e\": container with ID starting with a5c82d756574f37cef72d61a2426608192c7e051441b017a9a2a31bee1965f4e not found: ID does not exist" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.440998 4769 scope.go:117] "RemoveContainer" containerID="106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9" Nov 21 12:28:40 crc kubenswrapper[4769]: E1121 12:28:40.441331 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9\": container with ID starting with 106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9 not found: ID does not exist" containerID="106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.441360 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9"} err="failed to get container status \"106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9\": rpc error: code = NotFound desc = could not find container \"106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9\": container with ID starting with 106a68903e5b86e3a4bb05ba63dae80fd50c1815cfb8942f972d62f5d944aae9 not found: ID does not exist" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.457667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data" (OuterVolumeSpecName: "config-data") pod "6b0e43c9-665b-4c35-9eb3-f10936347547" (UID: "6b0e43c9-665b-4c35-9eb3-f10936347547"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.483369 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.496400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z7w2\" (UniqueName: \"kubernetes.io/projected/8205dbfb-fc46-457f-a977-7ceb6377da8d-kube-api-access-2z7w2\") pod \"8205dbfb-fc46-457f-a977-7ceb6377da8d\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.496510 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data-custom\") pod \"8205dbfb-fc46-457f-a977-7ceb6377da8d\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.496608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-combined-ca-bundle\") pod \"8205dbfb-fc46-457f-a977-7ceb6377da8d\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.496688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data\") pod \"8205dbfb-fc46-457f-a977-7ceb6377da8d\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.496741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8205dbfb-fc46-457f-a977-7ceb6377da8d-logs\") pod \"8205dbfb-fc46-457f-a977-7ceb6377da8d\" (UID: \"8205dbfb-fc46-457f-a977-7ceb6377da8d\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.497870 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc22451-dbc4-4588-8622-d9cd4ce4cebb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.497894 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.497905 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.497916 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b0e43c9-665b-4c35-9eb3-f10936347547-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.497926 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xrk2r\" (UniqueName: \"kubernetes.io/projected/6b0e43c9-665b-4c35-9eb3-f10936347547-kube-api-access-xrk2r\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.500706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8205dbfb-fc46-457f-a977-7ceb6377da8d-logs" (OuterVolumeSpecName: "logs") pod "8205dbfb-fc46-457f-a977-7ceb6377da8d" (UID: "8205dbfb-fc46-457f-a977-7ceb6377da8d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.501247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8205dbfb-fc46-457f-a977-7ceb6377da8d" (UID: "8205dbfb-fc46-457f-a977-7ceb6377da8d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.503564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8205dbfb-fc46-457f-a977-7ceb6377da8d-kube-api-access-2z7w2" (OuterVolumeSpecName: "kube-api-access-2z7w2") pod "8205dbfb-fc46-457f-a977-7ceb6377da8d" (UID: "8205dbfb-fc46-457f-a977-7ceb6377da8d"). InnerVolumeSpecName "kube-api-access-2z7w2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.522632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8205dbfb-fc46-457f-a977-7ceb6377da8d" (UID: "8205dbfb-fc46-457f-a977-7ceb6377da8d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.543221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data" (OuterVolumeSpecName: "config-data") pod "8205dbfb-fc46-457f-a977-7ceb6377da8d" (UID: "8205dbfb-fc46-457f-a977-7ceb6377da8d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.599002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmv4g\" (UniqueName: \"kubernetes.io/projected/07afcc28-4336-44c0-b1b1-3a741b6f6b65-kube-api-access-zmv4g\") pod \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.599347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-config-data\") pod \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.599499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-combined-ca-bundle\") pod \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\" (UID: \"07afcc28-4336-44c0-b1b1-3a741b6f6b65\") " Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.600119 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.600260 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8205dbfb-fc46-457f-a977-7ceb6377da8d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.600407 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2z7w2\" (UniqueName: \"kubernetes.io/projected/8205dbfb-fc46-457f-a977-7ceb6377da8d-kube-api-access-2z7w2\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.600522 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.600626 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8205dbfb-fc46-457f-a977-7ceb6377da8d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.602119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07afcc28-4336-44c0-b1b1-3a741b6f6b65-kube-api-access-zmv4g" (OuterVolumeSpecName: "kube-api-access-zmv4g") pod "07afcc28-4336-44c0-b1b1-3a741b6f6b65" (UID: "07afcc28-4336-44c0-b1b1-3a741b6f6b65"). InnerVolumeSpecName "kube-api-access-zmv4g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.631550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-config-data" (OuterVolumeSpecName: "config-data") pod "07afcc28-4336-44c0-b1b1-3a741b6f6b65" (UID: "07afcc28-4336-44c0-b1b1-3a741b6f6b65"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.631722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07afcc28-4336-44c0-b1b1-3a741b6f6b65" (UID: "07afcc28-4336-44c0-b1b1-3a741b6f6b65"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.648997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.657803 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.701773 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zmv4g\" (UniqueName: \"kubernetes.io/projected/07afcc28-4336-44c0-b1b1-3a741b6f6b65-kube-api-access-zmv4g\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.701806 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:40 crc kubenswrapper[4769]: I1121 12:28:40.701817 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07afcc28-4336-44c0-b1b1-3a741b6f6b65-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.286171 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" path="/var/lib/kubelet/pods/31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.287790 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6359092b-61ea-402d-9d63-0cb82f623c6c" path="/var/lib/kubelet/pods/6359092b-61ea-402d-9d63-0cb82f623c6c/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.289944 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" path="/var/lib/kubelet/pods/6bc22451-dbc4-4588-8622-d9cd4ce4cebb/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.292449 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" path="/var/lib/kubelet/pods/6ca83904-6406-45e4-bfc1-6a953ed672b5/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.293751 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" path="/var/lib/kubelet/pods/7313da1b-b474-474a-acc2-51ee39d5d79b/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.294680 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8" path="/var/lib/kubelet/pods/92dd37a8-3be1-40ea-9ce9-7a2bd9803fc8/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.295262 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9595d186-9a49-465e-a5b7-555a9d45d578" path="/var/lib/kubelet/pods/9595d186-9a49-465e-a5b7-555a9d45d578/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.296214 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83c7f40-ebcf-4637-96ee-832bb5b8907d" path="/var/lib/kubelet/pods/b83c7f40-ebcf-4637-96ee-832bb5b8907d/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.296699 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb25d455-8cb7-4773-952f-e2068b8a1cf3" path="/var/lib/kubelet/pods/cb25d455-8cb7-4773-952f-e2068b8a1cf3/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.297215 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc358105-4fcf-4ef4-b997-4ffb9f84a473" path="/var/lib/kubelet/pods/cc358105-4fcf-4ef4-b997-4ffb9f84a473/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.298065 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" path="/var/lib/kubelet/pods/f0440cef-3647-4eda-b613-19ab87c03e77/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.298870 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b9886a-baca-4a98-923f-e0fb3babcdda" path="/var/lib/kubelet/pods/f7b9886a-baca-4a98-923f-e0fb3babcdda/volumes" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.325377 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.325438 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.335341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" event={"ID":"6b0e43c9-665b-4c35-9eb3-f10936347547","Type":"ContainerDied","Data":"242ea21f47fb4148bc83ea7b4facb88c1a5aadfe69b2d17e2c513e4496cdb784"} Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.335390 4769 scope.go:117] "RemoveContainer" containerID="02e96ff8d49d4c0f1df8aad8bb6c2f91758c057b24bd5ec7ce588fc4f2b2caad" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.335434 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.343259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" event={"ID":"8205dbfb-fc46-457f-a977-7ceb6377da8d","Type":"ContainerDied","Data":"5fbe6dc37ba603d4f5e5a9c21146554a5fb086e89988e1e536a67602904c420f"} Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.343424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.347849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"07afcc28-4336-44c0-b1b1-3a741b6f6b65","Type":"ContainerDied","Data":"7d89f07ec97ea3bfb90f858c89b94779e8c60025efb608ff28d460a165d7136b"} Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.347926 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.366737 4769 scope.go:117] "RemoveContainer" containerID="38787751ae9b4a94077db573bfadf380c7880a0b40b47ae9fd11fca5829626d0" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.398973 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.402879 4769 scope.go:117] "RemoveContainer" containerID="214d2c35599922b5291aa6d73f8104c9866c71f665821c87c6c975ac55bf1faa" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.407282 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7744fd79f8-nmkfp"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.417921 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.428759 4769 scope.go:117] "RemoveContainer" containerID="4d98cc64d4cbc1a8819c3d7c4e329de8b3d6c9afa10b7c1054e400933f42f8c0" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.430836 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.436442 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.441024 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-b866ddff5-tddxg"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.462273 4769 scope.go:117] "RemoveContainer" containerID="79fb754f3c10fe4e31964a245eaf557a5f44fb760ec9a379d8075b688355f35a" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.479383 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.531760 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8"] Nov 21 12:28:41 crc kubenswrapper[4769]: I1121 12:28:41.532020 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerName="dnsmasq-dns" containerID="cri-o://46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1" gracePeriod=10 Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.104395 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.242328 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84lf9\" (UniqueName: \"kubernetes.io/projected/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-kube-api-access-84lf9\") pod \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.242558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-config\") pod \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.242615 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dnsmasq-svc\") pod \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.242643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dns-swift-storage-0\") pod \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\" (UID: \"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4\") " Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.253402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-kube-api-access-84lf9" (OuterVolumeSpecName: "kube-api-access-84lf9") pod "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" (UID: "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4"). InnerVolumeSpecName "kube-api-access-84lf9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.291225 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-config" (OuterVolumeSpecName: "config") pod "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" (UID: "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.297395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" (UID: "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.301217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" (UID: "0f66ab64-6524-45d2-a5fd-8b1c6280f7e4"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.344284 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-84lf9\" (UniqueName: \"kubernetes.io/projected/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-kube-api-access-84lf9\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.344324 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.344337 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.344350 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.358974 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerID="46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1" exitCode=0 Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.359106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" event={"ID":"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4","Type":"ContainerDied","Data":"46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1"} Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.359112 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.359163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8" event={"ID":"0f66ab64-6524-45d2-a5fd-8b1c6280f7e4","Type":"ContainerDied","Data":"3f5032a7048714472a11709b6a760efcb57f23901d4cf8a10d505c69b1cbb888"} Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.359203 4769 scope.go:117] "RemoveContainer" containerID="46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.383110 4769 scope.go:117] "RemoveContainer" containerID="3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.401663 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8"] Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.417114 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-77c5df595f-hclk8"] Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.422879 4769 scope.go:117] "RemoveContainer" containerID="46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1" Nov 21 12:28:42 crc kubenswrapper[4769]: E1121 12:28:42.423409 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1\": container with ID starting with 46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1 not found: ID does not exist" containerID="46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.423534 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1"} err="failed to get container status \"46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1\": rpc error: code = NotFound desc = could not find container \"46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1\": container with ID starting with 46d0f767ddf7af82380fff7f0b78fdfd8c222c4a90aad43c1e1fb16fa7fc2fc1 not found: ID does not exist" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.423636 4769 scope.go:117] "RemoveContainer" containerID="3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2" Nov 21 12:28:42 crc kubenswrapper[4769]: E1121 12:28:42.424040 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2\": container with ID starting with 3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2 not found: ID does not exist" containerID="3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2" Nov 21 12:28:42 crc kubenswrapper[4769]: I1121 12:28:42.424082 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2"} err="failed to get container status \"3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2\": rpc error: code = NotFound desc = could not find container \"3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2\": container with ID starting with 3eb7c62f111d952debc8bec3dd6bf5f54e1e8f14bca365517d8df36ec936eaa2 not found: ID does not exist" Nov 21 12:28:43 crc kubenswrapper[4769]: I1121 12:28:43.301753 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" path="/var/lib/kubelet/pods/07afcc28-4336-44c0-b1b1-3a741b6f6b65/volumes" Nov 21 12:28:43 crc kubenswrapper[4769]: I1121 12:28:43.302433 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" path="/var/lib/kubelet/pods/0f66ab64-6524-45d2-a5fd-8b1c6280f7e4/volumes" Nov 21 12:28:43 crc kubenswrapper[4769]: I1121 12:28:43.303111 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" path="/var/lib/kubelet/pods/6b0e43c9-665b-4c35-9eb3-f10936347547/volumes" Nov 21 12:28:43 crc kubenswrapper[4769]: I1121 12:28:43.304324 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" path="/var/lib/kubelet/pods/8205dbfb-fc46-457f-a977-7ceb6377da8d/volumes" Nov 21 12:28:44 crc kubenswrapper[4769]: I1121 12:28:44.080522 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.52:5671: i/o timeout" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.041038 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-ovndb-tls-certs\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-combined-ca-bundle\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n6jw\" (UniqueName: \"kubernetes.io/projected/2e07dc8f-0539-4778-9191-6d6909c373c1-kube-api-access-5n6jw\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-public-tls-certs\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-internal-tls-certs\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186956 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-config\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.186976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-httpd-config\") pod \"2e07dc8f-0539-4778-9191-6d6909c373c1\" (UID: \"2e07dc8f-0539-4778-9191-6d6909c373c1\") " Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.192817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e07dc8f-0539-4778-9191-6d6909c373c1-kube-api-access-5n6jw" (OuterVolumeSpecName: "kube-api-access-5n6jw") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "kube-api-access-5n6jw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.192997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.230098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.245953 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-config" (OuterVolumeSpecName: "config") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.247808 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.252961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.255583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "2e07dc8f-0539-4778-9191-6d6909c373c1" (UID: "2e07dc8f-0539-4778-9191-6d6909c373c1"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288785 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5n6jw\" (UniqueName: \"kubernetes.io/projected/2e07dc8f-0539-4778-9191-6d6909c373c1-kube-api-access-5n6jw\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288855 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288871 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288890 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288905 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288918 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.288930 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e07dc8f-0539-4778-9191-6d6909c373c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.471151 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerID="209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc" exitCode=0 Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.471239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" event={"ID":"2e07dc8f-0539-4778-9191-6d6909c373c1","Type":"ContainerDied","Data":"209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc"} Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.471283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" event={"ID":"2e07dc8f-0539-4778-9191-6d6909c373c1","Type":"ContainerDied","Data":"1465321d1f5775fa968f215241dd13562d7795406b0d140e142274adad4bd468"} Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.471305 4769 scope.go:117] "RemoveContainer" containerID="61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.471393 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-687b9949b6-8nd9m" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.505535 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-687b9949b6-8nd9m"] Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.509962 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-687b9949b6-8nd9m"] Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.520572 4769 scope.go:117] "RemoveContainer" containerID="209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.552436 4769 scope.go:117] "RemoveContainer" containerID="61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1" Nov 21 12:28:50 crc kubenswrapper[4769]: E1121 12:28:50.552828 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1\": container with ID starting with 61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1 not found: ID does not exist" containerID="61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.552881 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1"} err="failed to get container status \"61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1\": rpc error: code = NotFound desc = could not find container \"61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1\": container with ID starting with 61891fc257500c6d3c5b287fdec36f5789e3e70c583c5d0318e0b55af6f951f1 not found: ID does not exist" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.552917 4769 scope.go:117] "RemoveContainer" containerID="209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc" Nov 21 12:28:50 crc kubenswrapper[4769]: E1121 12:28:50.553362 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc\": container with ID starting with 209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc not found: ID does not exist" containerID="209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc" Nov 21 12:28:50 crc kubenswrapper[4769]: I1121 12:28:50.553394 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc"} err="failed to get container status \"209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc\": rpc error: code = NotFound desc = could not find container \"209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc\": container with ID starting with 209f8035e5addbfb18d0bd5db9807e22a568d6d3678e1ab236d7dc4c2ff89bcc not found: ID does not exist" Nov 21 12:28:51 crc kubenswrapper[4769]: I1121 12:28:51.289702 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" path="/var/lib/kubelet/pods/2e07dc8f-0539-4778-9191-6d6909c373c1/volumes" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.662710 4769 scope.go:117] "RemoveContainer" containerID="394eed05b63ae4cac6f397f5df014c49a16264940a9061d5ea8d900106136d6c" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.690397 4769 scope.go:117] "RemoveContainer" containerID="24f40a9e4aa639de640ef87a2705698d67f6d608296903b52dbc60067571cd50" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.729722 4769 scope.go:117] "RemoveContainer" containerID="4492d3ff34f99cdbaa9ca423b4c8781cec9ea9218d5adfd7e8669c7d8c78331a" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.771626 4769 scope.go:117] "RemoveContainer" containerID="98fc836e3d9969aa7dba5853f300dcd1c0d2517a66f37bb14f4a6bdb4e4ba332" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.808737 4769 scope.go:117] "RemoveContainer" containerID="b24b988b44b3140a6df38c976e6c18718b218e0f0a974b4ea57665902bb9b249" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.840555 4769 scope.go:117] "RemoveContainer" containerID="b0179972d2df25816ac563291099fcffaadc08920dfaf1f142f0cbe4409ee239" Nov 21 12:28:58 crc kubenswrapper[4769]: I1121 12:28:58.867384 4769 scope.go:117] "RemoveContainer" containerID="e9d461f06f79acc19dadb1308feb91194931d0c687f46ce1d5c230baecc8bdf0" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.529087 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.599697 4769 generic.go:334] "Generic (PLEG): container finished" podID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerID="1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8" exitCode=137 Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.599760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8"} Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.599804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"d93dc2d4-b4c7-4075-8769-693bdb43673d","Type":"ContainerDied","Data":"b27cab93324fa4ac513f603798ca0ac510d242b64c003f3e0eff9b3310975e2e"} Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.599824 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.599834 4769 scope.go:117] "RemoveContainer" containerID="1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.620496 4769 scope.go:117] "RemoveContainer" containerID="44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.644459 4769 scope.go:117] "RemoveContainer" containerID="8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.662882 4769 scope.go:117] "RemoveContainer" containerID="84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.683220 4769 scope.go:117] "RemoveContainer" containerID="2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.699860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-cache\") pod \"d93dc2d4-b4c7-4075-8769-693bdb43673d\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.699927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-lock\") pod \"d93dc2d4-b4c7-4075-8769-693bdb43673d\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.700011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"d93dc2d4-b4c7-4075-8769-693bdb43673d\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.700171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") pod \"d93dc2d4-b4c7-4075-8769-693bdb43673d\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.700354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d7j6\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-kube-api-access-7d7j6\") pod \"d93dc2d4-b4c7-4075-8769-693bdb43673d\" (UID: \"d93dc2d4-b4c7-4075-8769-693bdb43673d\") " Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.701255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-cache" (OuterVolumeSpecName: "cache") pod "d93dc2d4-b4c7-4075-8769-693bdb43673d" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.701353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-lock" (OuterVolumeSpecName: "lock") pod "d93dc2d4-b4c7-4075-8769-693bdb43673d" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.704071 4769 scope.go:117] "RemoveContainer" containerID="d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.705941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-kube-api-access-7d7j6" (OuterVolumeSpecName: "kube-api-access-7d7j6") pod "d93dc2d4-b4c7-4075-8769-693bdb43673d" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d"). InnerVolumeSpecName "kube-api-access-7d7j6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.706181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "swift") pod "d93dc2d4-b4c7-4075-8769-693bdb43673d" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.706777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "d93dc2d4-b4c7-4075-8769-693bdb43673d" (UID: "d93dc2d4-b4c7-4075-8769-693bdb43673d"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.772236 4769 scope.go:117] "RemoveContainer" containerID="3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.795167 4769 scope.go:117] "RemoveContainer" containerID="00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.802053 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7d7j6\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-kube-api-access-7d7j6\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.802081 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.802091 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/d93dc2d4-b4c7-4075-8769-693bdb43673d-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.802129 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.802140 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/d93dc2d4-b4c7-4075-8769-693bdb43673d-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.816143 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.826551 4769 scope.go:117] "RemoveContainer" containerID="75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.849587 4769 scope.go:117] "RemoveContainer" containerID="0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.869694 4769 scope.go:117] "RemoveContainer" containerID="ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.892152 4769 scope.go:117] "RemoveContainer" containerID="42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.903276 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.915051 4769 scope.go:117] "RemoveContainer" containerID="db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.939180 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.945418 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.945834 4769 scope.go:117] "RemoveContainer" containerID="94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.970360 4769 scope.go:117] "RemoveContainer" containerID="d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.997121 4769 scope.go:117] "RemoveContainer" containerID="1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8" Nov 21 12:29:01 crc kubenswrapper[4769]: E1121 12:29:01.997748 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8\": container with ID starting with 1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8 not found: ID does not exist" containerID="1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.997794 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8"} err="failed to get container status \"1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8\": rpc error: code = NotFound desc = could not find container \"1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8\": container with ID starting with 1f71c8d8b3e8a156ab1b2233d1092d2c7116cee7f52011a7bf8ac9be62f054f8 not found: ID does not exist" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.997831 4769 scope.go:117] "RemoveContainer" containerID="44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729" Nov 21 12:29:01 crc kubenswrapper[4769]: E1121 12:29:01.998315 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729\": container with ID starting with 44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729 not found: ID does not exist" containerID="44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.998357 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729"} err="failed to get container status \"44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729\": rpc error: code = NotFound desc = could not find container \"44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729\": container with ID starting with 44a76cd707fdb388be71a438dbdeb0f179f2ed2e16d20bf8df29f4754c0cf729 not found: ID does not exist" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.998382 4769 scope.go:117] "RemoveContainer" containerID="8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46" Nov 21 12:29:01 crc kubenswrapper[4769]: E1121 12:29:01.998704 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46\": container with ID starting with 8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46 not found: ID does not exist" containerID="8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.998744 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46"} err="failed to get container status \"8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46\": rpc error: code = NotFound desc = could not find container \"8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46\": container with ID starting with 8e560b30517cc5d189b625b81b1d47308af47ef1d060b6cc58a970275c5abd46 not found: ID does not exist" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.998775 4769 scope.go:117] "RemoveContainer" containerID="84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541" Nov 21 12:29:01 crc kubenswrapper[4769]: E1121 12:29:01.999331 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541\": container with ID starting with 84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541 not found: ID does not exist" containerID="84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.999361 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541"} err="failed to get container status \"84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541\": rpc error: code = NotFound desc = could not find container \"84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541\": container with ID starting with 84757bf4fbb9e61fb1f7da3d56dfad51b1519784681088fa4622f3c69d9c4541 not found: ID does not exist" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.999379 4769 scope.go:117] "RemoveContainer" containerID="2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec" Nov 21 12:29:01 crc kubenswrapper[4769]: E1121 12:29:01.999669 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec\": container with ID starting with 2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec not found: ID does not exist" containerID="2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.999716 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec"} err="failed to get container status \"2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec\": rpc error: code = NotFound desc = could not find container \"2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec\": container with ID starting with 2012165a435051d09a40b5823f2fbbbbd56aad5c9aa0b19430f2da6c47cab8ec not found: ID does not exist" Nov 21 12:29:01 crc kubenswrapper[4769]: I1121 12:29:01.999734 4769 scope.go:117] "RemoveContainer" containerID="d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.000077 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f\": container with ID starting with d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f not found: ID does not exist" containerID="d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.000098 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f"} err="failed to get container status \"d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f\": rpc error: code = NotFound desc = could not find container \"d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f\": container with ID starting with d2af57992382b4c5181cb988456af12a5c7f61cd4c3f93f08c82f37b3c700c6f not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.000111 4769 scope.go:117] "RemoveContainer" containerID="3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.000382 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a\": container with ID starting with 3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a not found: ID does not exist" containerID="3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.000410 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a"} err="failed to get container status \"3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a\": rpc error: code = NotFound desc = could not find container \"3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a\": container with ID starting with 3c593f417792f93f03b6322fdd22bf0406497bb6aabb35b182e26465396fb43a not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.000430 4769 scope.go:117] "RemoveContainer" containerID="00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.000876 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3\": container with ID starting with 00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3 not found: ID does not exist" containerID="00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.000908 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3"} err="failed to get container status \"00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3\": rpc error: code = NotFound desc = could not find container \"00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3\": container with ID starting with 00f0d96440f48fa5c36f46f04705a3322f0330cc12b8c980663baa05c0495cc3 not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.000929 4769 scope.go:117] "RemoveContainer" containerID="75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.001335 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743\": container with ID starting with 75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743 not found: ID does not exist" containerID="75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.001358 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743"} err="failed to get container status \"75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743\": rpc error: code = NotFound desc = could not find container \"75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743\": container with ID starting with 75f739c793de5de4503487d7734a57e5449e9183b7ad267343db12cf083ba743 not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.001371 4769 scope.go:117] "RemoveContainer" containerID="0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.001644 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18\": container with ID starting with 0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18 not found: ID does not exist" containerID="0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.001668 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18"} err="failed to get container status \"0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18\": rpc error: code = NotFound desc = could not find container \"0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18\": container with ID starting with 0e79b802d4982822313cb23467f384859ad4c9f70ddbc8a6c8ae702107907d18 not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.001680 4769 scope.go:117] "RemoveContainer" containerID="ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.001882 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0\": container with ID starting with ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0 not found: ID does not exist" containerID="ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.001901 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0"} err="failed to get container status \"ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0\": rpc error: code = NotFound desc = could not find container \"ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0\": container with ID starting with ad9fbab70f77cf487af815ad08bee5f992786d8a2ff1e546418d5a6b95e126b0 not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.001915 4769 scope.go:117] "RemoveContainer" containerID="42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.002136 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c\": container with ID starting with 42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c not found: ID does not exist" containerID="42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.002176 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c"} err="failed to get container status \"42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c\": rpc error: code = NotFound desc = could not find container \"42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c\": container with ID starting with 42010edf0e1fc71a150e4f9b4644f6dfe23f5f380e54977091e392dbbb116e7c not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.002210 4769 scope.go:117] "RemoveContainer" containerID="db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.002431 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209\": container with ID starting with db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209 not found: ID does not exist" containerID="db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.002450 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209"} err="failed to get container status \"db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209\": rpc error: code = NotFound desc = could not find container \"db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209\": container with ID starting with db07cb60ef4bd97af203b8201b882c31d78e0314e31a9b7c32a3647529514209 not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.002463 4769 scope.go:117] "RemoveContainer" containerID="94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.002838 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183\": container with ID starting with 94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183 not found: ID does not exist" containerID="94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.002857 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183"} err="failed to get container status \"94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183\": rpc error: code = NotFound desc = could not find container \"94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183\": container with ID starting with 94093fa5192497cceffcd4b5389df0b5acebf4f26537450a5f5333862da19183 not found: ID does not exist" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.002868 4769 scope.go:117] "RemoveContainer" containerID="d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727" Nov 21 12:29:02 crc kubenswrapper[4769]: E1121 12:29:02.003105 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727\": container with ID starting with d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727 not found: ID does not exist" containerID="d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727" Nov 21 12:29:02 crc kubenswrapper[4769]: I1121 12:29:02.003142 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727"} err="failed to get container status \"d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727\": rpc error: code = NotFound desc = could not find container \"d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727\": container with ID starting with d06c2916287dcfdb763b87a0543ae0ed80d5f8cc0fae788721e2e55c5646e727 not found: ID does not exist" Nov 21 12:29:03 crc kubenswrapper[4769]: I1121 12:29:03.288338 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" path="/var/lib/kubelet/pods/d93dc2d4-b4c7-4075-8769-693bdb43673d/volumes" Nov 21 12:29:11 crc kubenswrapper[4769]: I1121 12:29:11.325544 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:29:11 crc kubenswrapper[4769]: I1121 12:29:11.326533 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.711170 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-fnmvc"] Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.726274 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-fnmvc"] Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.848953 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-4rtm5"] Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.849630 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.849742 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.849891 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="extract-content" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.850003 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="extract-content" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.850131 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.850283 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-server" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.850440 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.850535 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-server" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.850646 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="ovsdbserver-nb" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.850757 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="ovsdbserver-nb" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.850897 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.851013 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.851135 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.851281 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-api" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.851378 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="probe" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.851456 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="probe" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.851542 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f29aa49-a966-46a2-9f51-a5f344b0944a" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.851625 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f29aa49-a966-46a2-9f51-a5f344b0944a" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.851713 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="ovsdbserver-sb" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.851801 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="ovsdbserver-sb" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.851880 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="ovn-northd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.851959 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="ovn-northd" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.852051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.852156 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.852322 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.852440 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.852528 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.852602 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-server" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.852688 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="extract-utilities" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.852761 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="extract-utilities" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.852849 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.852929 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.853016 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.853090 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.853179 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerName="nova-cell1-conductor-conductor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.853284 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerName="nova-cell1-conductor-conductor" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.853371 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.853454 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.853539 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.853617 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-api" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.853698 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-expirer" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.853781 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-expirer" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.853860 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.853938 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.854029 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5c43124-452d-4146-aed0-d061973658e2" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.854116 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c43124-452d-4146-aed0-d061973658e2" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.854228 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.854358 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.854457 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.854549 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.854641 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.854745 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.854862 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.854959 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.855050 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.855136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-api" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.855254 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="sg-core" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.855348 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="sg-core" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.855444 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-reaper" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.855526 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-reaper" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.855618 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-updater" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.855698 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-updater" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.855788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a614f405-9af6-4df3-b4ee-b062bd73077d" containerName="kube-state-metrics" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.855879 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a614f405-9af6-4df3-b4ee-b062bd73077d" containerName="kube-state-metrics" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.855965 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="registry-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.856044 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="registry-server" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.856139 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="rsync" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.856265 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="rsync" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.856370 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad288522-75bb-4bfc-b547-c2552f8c2995" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.856455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad288522-75bb-4bfc-b547-c2552f8c2995" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.856545 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.856644 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.856749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9595d186-9a49-465e-a5b7-555a9d45d578" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.856835 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9595d186-9a49-465e-a5b7-555a9d45d578" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.856920 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.857011 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.857121 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e67c9352-b51b-415a-a305-0e9b35c4370e" containerName="nova-cell0-conductor-conductor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.857230 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67c9352-b51b-415a-a305-0e9b35c4370e" containerName="nova-cell0-conductor-conductor" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.857327 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.857410 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.857491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25d52098-169f-48dd-89d3-89cbba99b7c4" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.857569 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25d52098-169f-48dd-89d3-89cbba99b7c4" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.857654 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.857732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.857808 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="rabbitmq" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.857886 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="rabbitmq" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.857970 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-central-agent" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.858056 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-central-agent" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.858149 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="cinder-scheduler" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.858286 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="cinder-scheduler" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.858410 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b83c7f40-ebcf-4637-96ee-832bb5b8907d" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.858490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83c7f40-ebcf-4637-96ee-832bb5b8907d" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.858602 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.858699 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.858900 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="mysql-bootstrap" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.858984 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="mysql-bootstrap" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.859069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7759a04f-afff-47f4-9f22-6c7154fa2fb3" containerName="memcached" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.859150 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7759a04f-afff-47f4-9f22-6c7154fa2fb3" containerName="memcached" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.859282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.859386 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.859475 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="rabbitmq" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.859566 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="rabbitmq" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.859659 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-notification-agent" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.859760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-notification-agent" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.859856 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.859937 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-server" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.860027 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.860115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.860218 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.860310 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.860396 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.860469 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.860552 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerName="init" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.860642 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerName="init" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.860724 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eaabdea5-a92a-4d83-a910-fe0a9993b278" containerName="nova-scheduler-scheduler" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.860802 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaabdea5-a92a-4d83-a910-fe0a9993b278" containerName="nova-scheduler-scheduler" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.860937 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="mysql-bootstrap" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.861043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="mysql-bootstrap" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.861165 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b1a8d65-32f5-486e-b01e-5f77f989621b" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.861303 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1a8d65-32f5-486e-b01e-5f77f989621b" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.861404 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1b72391-1ff2-4f97-bbf0-c928045f6395" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.861487 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1b72391-1ff2-4f97-bbf0-c928045f6395" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.861573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="swift-recon-cron" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.861655 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="swift-recon-cron" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.861736 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.861814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.861898 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="proxy-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.861998 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="proxy-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.862102 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="galera" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.862270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="galera" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.862403 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerName="dnsmasq-dns" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.862489 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerName="dnsmasq-dns" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.862580 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.862661 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.862752 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="setup-container" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.862843 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="setup-container" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.862929 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.863010 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.863100 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.863236 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.863461 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-updater" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.863577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-updater" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.863694 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.863806 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.863907 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.863992 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.864073 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="setup-container" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.864152 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="setup-container" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.864272 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6359092b-61ea-402d-9d63-0cb82f623c6c" containerName="keystone-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.864355 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6359092b-61ea-402d-9d63-0cb82f623c6c" containerName="keystone-api" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.864432 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.864515 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: E1121 12:29:12.864590 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-metadata" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.864689 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-metadata" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865096 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="07afcc28-4336-44c0-b1b1-3a741b6f6b65" containerName="nova-cell1-conductor-conductor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865239 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7759a04f-afff-47f4-9f22-6c7154fa2fb3" containerName="memcached" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865332 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865425 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865518 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865602 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="31fda5b9-ebf3-44fc-8f08-9aaf6e0a8301" containerName="rabbitmq" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865684 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865762 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865846 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a52a4fb6-9ae7-4444-9a40-fdc68ebfe21b" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.865934 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866016 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866130 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866243 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad288522-75bb-4bfc-b547-c2552f8c2995" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866368 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866463 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866550 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e07dc8f-0539-4778-9191-6d6909c373c1" containerName="neutron-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866634 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866724 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7313da1b-b474-474a-acc2-51ee39d5d79b" containerName="rabbitmq" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866811 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866900 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eaabdea5-a92a-4d83-a910-fe0a9993b278" containerName="nova-scheduler-scheduler" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.866989 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="46dff394-5dc3-442d-bbe2-31563973474a" containerName="proxy-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.867070 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-reaper" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.867162 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b83c7f40-ebcf-4637-96ee-832bb5b8907d" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.867271 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="proxy-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868459 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868539 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e67c9352-b51b-415a-a305-0e9b35c4370e" containerName="nova-cell0-conductor-conductor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868575 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868598 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868623 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1b857b2-7449-4450-a61a-7cc9bfff316f" containerName="nova-api-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868649 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="rsync" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868677 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d125f717-0ab9-4ee5-971b-af7aa24e5ddd" containerName="galera" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868704 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c1dca80-5bc5-46d8-bfe6-fb395e82b774" containerName="ovsdbserver-sb" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="openstack-network-exporter" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868736 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-expirer" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868759 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6fd9eea-ec5a-4e6f-96b5-5129595a62c1" containerName="galera" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868774 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a614f405-9af6-4df3-b4ee-b062bd73077d" containerName="kube-state-metrics" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868790 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="sg-core" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868811 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868831 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9595d186-9a49-465e-a5b7-555a9d45d578" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868848 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="swift-recon-cron" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868864 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8bc3ac6c-45bc-477e-b24e-778267d7a63e" containerName="barbican-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868881 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-central-agent" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868899 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8db99cd8-81fb-414a-8eec-3db988f78f5e" containerName="nova-metadata-metadata" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868918 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6ca83904-6406-45e4-bfc1-6a953ed672b5" containerName="ovn-northd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868936 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b1a8d65-32f5-486e-b01e-5f77f989621b" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868955 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868980 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1b72391-1ff2-4f97-bbf0-c928045f6395" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.868995 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="24e9adde-0ce7-4cf1-8c98-21458a046a0e" containerName="glance-httpd" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869014 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc22451-dbc4-4588-8622-d9cd4ce4cebb" containerName="ceilometer-notification-agent" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869030 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4181add-a741-47a8-986b-ff015685ab63" containerName="ovsdbserver-nb" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869042 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6359092b-61ea-402d-9d63-0cb82f623c6c" containerName="keystone-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869055 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b0e43c9-665b-4c35-9eb3-f10936347547" containerName="barbican-keystone-listener-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869074 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5c43124-452d-4146-aed0-d061973658e2" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869107 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869124 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0440cef-3647-4eda-b613-19ab87c03e77" containerName="registry-server" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869145 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a393fa88-8741-40b7-8a55-4f853c1722b8" containerName="cinder-api-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869161 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869183 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-updater" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869229 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f66ab64-6524-45d2-a5fd-8b1c6280f7e4" containerName="dnsmasq-dns" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869248 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f29aa49-a966-46a2-9f51-a5f344b0944a" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869266 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60d48f3d-32e3-4de7-8634-0f876ed5ac2f" containerName="glance-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869286 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="object-replicator" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869302 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7d1af53a-9620-44a9-8a3c-fdea3faea22b" containerName="placement-api" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869315 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="cinder-scheduler" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8205dbfb-fc46-457f-a977-7ceb6377da8d" containerName="barbican-worker-log" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869357 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="container-updater" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869373 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25d52098-169f-48dd-89d3-89cbba99b7c4" containerName="mariadb-account-delete" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869392 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b8ee7d0-9900-447f-8b43-f72587e6c8c1" containerName="probe" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.869409 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d93dc2d4-b4c7-4075-8769-693bdb43673d" containerName="account-auditor" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.870113 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-4rtm5"] Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.870261 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.873563 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.873798 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.873975 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.874163 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.977612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a9584018-4672-41c6-bf16-1e2500b19f1d-node-mnt\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.977678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a9584018-4672-41c6-bf16-1e2500b19f1d-crc-storage\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:12 crc kubenswrapper[4769]: I1121 12:29:12.977747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9rmv\" (UniqueName: \"kubernetes.io/projected/a9584018-4672-41c6-bf16-1e2500b19f1d-kube-api-access-b9rmv\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.079781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a9584018-4672-41c6-bf16-1e2500b19f1d-node-mnt\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.079857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a9584018-4672-41c6-bf16-1e2500b19f1d-crc-storage\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.079898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rmv\" (UniqueName: \"kubernetes.io/projected/a9584018-4672-41c6-bf16-1e2500b19f1d-kube-api-access-b9rmv\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.080177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a9584018-4672-41c6-bf16-1e2500b19f1d-node-mnt\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.080642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a9584018-4672-41c6-bf16-1e2500b19f1d-crc-storage\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.099311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rmv\" (UniqueName: \"kubernetes.io/projected/a9584018-4672-41c6-bf16-1e2500b19f1d-kube-api-access-b9rmv\") pod \"crc-storage-crc-4rtm5\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.197100 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.310920 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e11211dd-4bf3-4690-a21e-dc1aaac2b805" path="/var/lib/kubelet/pods/e11211dd-4bf3-4690-a21e-dc1aaac2b805/volumes" Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.451552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-4rtm5"] Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.467677 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:29:13 crc kubenswrapper[4769]: I1121 12:29:13.717831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4rtm5" event={"ID":"a9584018-4672-41c6-bf16-1e2500b19f1d","Type":"ContainerStarted","Data":"3f250554f5e8f1e5047e70d67ec99c5172148eddffd52e53992377ac34d19adc"} Nov 21 12:29:15 crc kubenswrapper[4769]: I1121 12:29:15.741275 4769 generic.go:334] "Generic (PLEG): container finished" podID="a9584018-4672-41c6-bf16-1e2500b19f1d" containerID="b735df1452fb2eb11cc48e0dd6799b2efbd5dccba1cb7d0c7cf2313d46a4ebd7" exitCode=0 Nov 21 12:29:15 crc kubenswrapper[4769]: I1121 12:29:15.741337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4rtm5" event={"ID":"a9584018-4672-41c6-bf16-1e2500b19f1d","Type":"ContainerDied","Data":"b735df1452fb2eb11cc48e0dd6799b2efbd5dccba1cb7d0c7cf2313d46a4ebd7"} Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:16.999679 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.152744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a9584018-4672-41c6-bf16-1e2500b19f1d-crc-storage\") pod \"a9584018-4672-41c6-bf16-1e2500b19f1d\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.152840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9rmv\" (UniqueName: \"kubernetes.io/projected/a9584018-4672-41c6-bf16-1e2500b19f1d-kube-api-access-b9rmv\") pod \"a9584018-4672-41c6-bf16-1e2500b19f1d\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.152974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a9584018-4672-41c6-bf16-1e2500b19f1d-node-mnt\") pod \"a9584018-4672-41c6-bf16-1e2500b19f1d\" (UID: \"a9584018-4672-41c6-bf16-1e2500b19f1d\") " Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.153350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a9584018-4672-41c6-bf16-1e2500b19f1d-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "a9584018-4672-41c6-bf16-1e2500b19f1d" (UID: "a9584018-4672-41c6-bf16-1e2500b19f1d"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.159739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9584018-4672-41c6-bf16-1e2500b19f1d-kube-api-access-b9rmv" (OuterVolumeSpecName: "kube-api-access-b9rmv") pod "a9584018-4672-41c6-bf16-1e2500b19f1d" (UID: "a9584018-4672-41c6-bf16-1e2500b19f1d"). InnerVolumeSpecName "kube-api-access-b9rmv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.183006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9584018-4672-41c6-bf16-1e2500b19f1d-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "a9584018-4672-41c6-bf16-1e2500b19f1d" (UID: "a9584018-4672-41c6-bf16-1e2500b19f1d"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.255135 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a9584018-4672-41c6-bf16-1e2500b19f1d-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.255219 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b9rmv\" (UniqueName: \"kubernetes.io/projected/a9584018-4672-41c6-bf16-1e2500b19f1d-kube-api-access-b9rmv\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.255241 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a9584018-4672-41c6-bf16-1e2500b19f1d-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.761127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-4rtm5" event={"ID":"a9584018-4672-41c6-bf16-1e2500b19f1d","Type":"ContainerDied","Data":"3f250554f5e8f1e5047e70d67ec99c5172148eddffd52e53992377ac34d19adc"} Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.761397 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f250554f5e8f1e5047e70d67ec99c5172148eddffd52e53992377ac34d19adc" Nov 21 12:29:17 crc kubenswrapper[4769]: I1121 12:29:17.761359 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-4rtm5" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.636774 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-4rtm5"] Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.644329 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-4rtm5"] Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.809816 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-h74mw"] Nov 21 12:29:20 crc kubenswrapper[4769]: E1121 12:29:20.810170 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a9584018-4672-41c6-bf16-1e2500b19f1d" containerName="storage" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.810208 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9584018-4672-41c6-bf16-1e2500b19f1d" containerName="storage" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.810423 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a9584018-4672-41c6-bf16-1e2500b19f1d" containerName="storage" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.810971 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.813969 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.813969 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.813991 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.813968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.819795 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-h74mw"] Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.902917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-crc-storage\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.903023 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24b9q\" (UniqueName: \"kubernetes.io/projected/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-kube-api-access-24b9q\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:20 crc kubenswrapper[4769]: I1121 12:29:20.903099 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-node-mnt\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.004976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-crc-storage\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.005106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-24b9q\" (UniqueName: \"kubernetes.io/projected/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-kube-api-access-24b9q\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.005234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-node-mnt\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.005595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-node-mnt\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.005951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-crc-storage\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.027427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-24b9q\" (UniqueName: \"kubernetes.io/projected/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-kube-api-access-24b9q\") pod \"crc-storage-crc-h74mw\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.131848 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.287329 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9584018-4672-41c6-bf16-1e2500b19f1d" path="/var/lib/kubelet/pods/a9584018-4672-41c6-bf16-1e2500b19f1d/volumes" Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.606348 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-h74mw"] Nov 21 12:29:21 crc kubenswrapper[4769]: I1121 12:29:21.812524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h74mw" event={"ID":"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee","Type":"ContainerStarted","Data":"8aabc769c2e0bfd0a43f323c8ce182d6c08c7a64b5a6d5691f82521a0031dbeb"} Nov 21 12:29:22 crc kubenswrapper[4769]: I1121 12:29:22.824810 4769 generic.go:334] "Generic (PLEG): container finished" podID="a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" containerID="c94b1a788c1b06e299cc61d5488825fed26110055a205945544b8ff56dc22430" exitCode=0 Nov 21 12:29:22 crc kubenswrapper[4769]: I1121 12:29:22.824898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h74mw" event={"ID":"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee","Type":"ContainerDied","Data":"c94b1a788c1b06e299cc61d5488825fed26110055a205945544b8ff56dc22430"} Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.150780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.252639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24b9q\" (UniqueName: \"kubernetes.io/projected/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-kube-api-access-24b9q\") pod \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.252720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-node-mnt\") pod \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.252747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-crc-storage\") pod \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\" (UID: \"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee\") " Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.253065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" (UID: "a263d0d8-66cf-4a47-8ec3-eecedf6a36ee"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.259217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-kube-api-access-24b9q" (OuterVolumeSpecName: "kube-api-access-24b9q") pod "a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" (UID: "a263d0d8-66cf-4a47-8ec3-eecedf6a36ee"). InnerVolumeSpecName "kube-api-access-24b9q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.277343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" (UID: "a263d0d8-66cf-4a47-8ec3-eecedf6a36ee"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.354123 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-24b9q\" (UniqueName: \"kubernetes.io/projected/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-kube-api-access-24b9q\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.354160 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.354171 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.848846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h74mw" event={"ID":"a263d0d8-66cf-4a47-8ec3-eecedf6a36ee","Type":"ContainerDied","Data":"8aabc769c2e0bfd0a43f323c8ce182d6c08c7a64b5a6d5691f82521a0031dbeb"} Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.848904 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aabc769c2e0bfd0a43f323c8ce182d6c08c7a64b5a6d5691f82521a0031dbeb" Nov 21 12:29:24 crc kubenswrapper[4769]: I1121 12:29:24.849402 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h74mw" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.328995 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk"] Nov 21 12:29:30 crc kubenswrapper[4769]: E1121 12:29:30.329930 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" containerName="storage" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.329947 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" containerName="storage" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.330163 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" containerName="storage" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.331524 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.333843 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-marketplace"/"default-dockercfg-vmwhc" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.341067 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk"] Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.488316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.488459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64tn6\" (UniqueName: \"kubernetes.io/projected/010cc90d-22dc-45f9-9345-716a7a5ecafb-kube-api-access-64tn6\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.488506 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.590435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.590553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-64tn6\" (UniqueName: \"kubernetes.io/projected/010cc90d-22dc-45f9-9345-716a7a5ecafb-kube-api-access-64tn6\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.590592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.591155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-util\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.591263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-bundle\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.617120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-64tn6\" (UniqueName: \"kubernetes.io/projected/010cc90d-22dc-45f9-9345-716a7a5ecafb-kube-api-access-64tn6\") pod \"6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:30 crc kubenswrapper[4769]: I1121 12:29:30.656236 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:31 crc kubenswrapper[4769]: I1121 12:29:31.129571 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk"] Nov 21 12:29:31 crc kubenswrapper[4769]: I1121 12:29:31.916614 4769 generic.go:334] "Generic (PLEG): container finished" podID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerID="2d16b6caf3ef39e85c7a6298ad3fc50148356ee9a82e488214f8c28f48f64ee4" exitCode=0 Nov 21 12:29:31 crc kubenswrapper[4769]: I1121 12:29:31.916709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" event={"ID":"010cc90d-22dc-45f9-9345-716a7a5ecafb","Type":"ContainerDied","Data":"2d16b6caf3ef39e85c7a6298ad3fc50148356ee9a82e488214f8c28f48f64ee4"} Nov 21 12:29:31 crc kubenswrapper[4769]: I1121 12:29:31.916742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" event={"ID":"010cc90d-22dc-45f9-9345-716a7a5ecafb","Type":"ContainerStarted","Data":"412cb22b8fd9ae3399c4d11e23ad724b7fc57edefe0e799f276f55db70f5ad29"} Nov 21 12:29:33 crc kubenswrapper[4769]: I1121 12:29:33.942795 4769 generic.go:334] "Generic (PLEG): container finished" podID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerID="15d4c3d5fc6183a2a82cf619d30acf50870db9f547a2fddc449fcb47c4944732" exitCode=0 Nov 21 12:29:33 crc kubenswrapper[4769]: I1121 12:29:33.942966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" event={"ID":"010cc90d-22dc-45f9-9345-716a7a5ecafb","Type":"ContainerDied","Data":"15d4c3d5fc6183a2a82cf619d30acf50870db9f547a2fddc449fcb47c4944732"} Nov 21 12:29:34 crc kubenswrapper[4769]: I1121 12:29:34.954767 4769 generic.go:334] "Generic (PLEG): container finished" podID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerID="313711d593a77660ca0d0de2051f12fa03b8dbbf7f43ea7f81817d3a4e977dea" exitCode=0 Nov 21 12:29:34 crc kubenswrapper[4769]: I1121 12:29:34.954901 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" event={"ID":"010cc90d-22dc-45f9-9345-716a7a5ecafb","Type":"ContainerDied","Data":"313711d593a77660ca0d0de2051f12fa03b8dbbf7f43ea7f81817d3a4e977dea"} Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.296078 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.401355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64tn6\" (UniqueName: \"kubernetes.io/projected/010cc90d-22dc-45f9-9345-716a7a5ecafb-kube-api-access-64tn6\") pod \"010cc90d-22dc-45f9-9345-716a7a5ecafb\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.401420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-bundle\") pod \"010cc90d-22dc-45f9-9345-716a7a5ecafb\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.401484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-util\") pod \"010cc90d-22dc-45f9-9345-716a7a5ecafb\" (UID: \"010cc90d-22dc-45f9-9345-716a7a5ecafb\") " Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.403679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-bundle" (OuterVolumeSpecName: "bundle") pod "010cc90d-22dc-45f9-9345-716a7a5ecafb" (UID: "010cc90d-22dc-45f9-9345-716a7a5ecafb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.407334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010cc90d-22dc-45f9-9345-716a7a5ecafb-kube-api-access-64tn6" (OuterVolumeSpecName: "kube-api-access-64tn6") pod "010cc90d-22dc-45f9-9345-716a7a5ecafb" (UID: "010cc90d-22dc-45f9-9345-716a7a5ecafb"). InnerVolumeSpecName "kube-api-access-64tn6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.424734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-util" (OuterVolumeSpecName: "util") pod "010cc90d-22dc-45f9-9345-716a7a5ecafb" (UID: "010cc90d-22dc-45f9-9345-716a7a5ecafb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.503105 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-64tn6\" (UniqueName: \"kubernetes.io/projected/010cc90d-22dc-45f9-9345-716a7a5ecafb-kube-api-access-64tn6\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.503143 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.503152 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010cc90d-22dc-45f9-9345-716a7a5ecafb-util\") on node \"crc\" DevicePath \"\"" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.982028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" event={"ID":"010cc90d-22dc-45f9-9345-716a7a5ecafb","Type":"ContainerDied","Data":"412cb22b8fd9ae3399c4d11e23ad724b7fc57edefe0e799f276f55db70f5ad29"} Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.982092 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="412cb22b8fd9ae3399c4d11e23ad724b7fc57edefe0e799f276f55db70f5ad29" Nov 21 12:29:36 crc kubenswrapper[4769]: I1121 12:29:36.982239 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6c372a8d094fad7255d3bbeabb4914bd2356af7b203a2d2176be1c92106x5rk" Nov 21 12:29:41 crc kubenswrapper[4769]: I1121 12:29:41.325716 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:29:41 crc kubenswrapper[4769]: I1121 12:29:41.326480 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:29:41 crc kubenswrapper[4769]: I1121 12:29:41.326547 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:29:41 crc kubenswrapper[4769]: I1121 12:29:41.327515 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:29:41 crc kubenswrapper[4769]: I1121 12:29:41.327618 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" gracePeriod=600 Nov 21 12:29:41 crc kubenswrapper[4769]: E1121 12:29:41.465033 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:29:42 crc kubenswrapper[4769]: I1121 12:29:42.048589 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" exitCode=0 Nov 21 12:29:42 crc kubenswrapper[4769]: I1121 12:29:42.048701 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d"} Nov 21 12:29:42 crc kubenswrapper[4769]: I1121 12:29:42.048772 4769 scope.go:117] "RemoveContainer" containerID="853819d0337afdd74f9dccd7824d5874788ad9e7c096f1f20047db41f5e665d1" Nov 21 12:29:42 crc kubenswrapper[4769]: I1121 12:29:42.049700 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:29:42 crc kubenswrapper[4769]: E1121 12:29:42.050445 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:29:54 crc kubenswrapper[4769]: I1121 12:29:54.275548 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:29:54 crc kubenswrapper[4769]: E1121 12:29:54.276768 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:29:59 crc kubenswrapper[4769]: I1121 12:29:59.739720 4769 scope.go:117] "RemoveContainer" containerID="68dcddd325bfc469c0588437fd5aa31fd078f0841172f8395ab7ca85da4c06f2" Nov 21 12:29:59 crc kubenswrapper[4769]: I1121 12:29:59.789382 4769 scope.go:117] "RemoveContainer" containerID="799515d1c89fa28dc5f749c4acec8b36263777c1533a880c94ccdcbad9b6fc3f" Nov 21 12:29:59 crc kubenswrapper[4769]: I1121 12:29:59.832341 4769 scope.go:117] "RemoveContainer" containerID="7fa4332306cd863a718d5e7e56a9e119f8cd45de81e64acaeaf6edf201f99341" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.223099 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395470-744df"] Nov 21 12:30:00 crc kubenswrapper[4769]: E1121 12:30:00.223451 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="extract" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.223468 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="extract" Nov 21 12:30:00 crc kubenswrapper[4769]: E1121 12:30:00.223482 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="pull" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.223490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="pull" Nov 21 12:30:00 crc kubenswrapper[4769]: E1121 12:30:00.223512 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="util" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.223520 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="util" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.223656 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="010cc90d-22dc-45f9-9345-716a7a5ecafb" containerName="extract" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.224152 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.231014 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.231756 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.306467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-secret-volume\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.306562 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbb2h\" (UniqueName: \"kubernetes.io/projected/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-kube-api-access-vbb2h\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.306645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-config-volume\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.315814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395470-744df"] Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.408737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vbb2h\" (UniqueName: \"kubernetes.io/projected/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-kube-api-access-vbb2h\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.408801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-config-volume\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.409702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-config-volume\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.409834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-secret-volume\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.436079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-secret-volume\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.477974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbb2h\" (UniqueName: \"kubernetes.io/projected/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-kube-api-access-vbb2h\") pod \"collect-profiles-29395470-744df\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:00 crc kubenswrapper[4769]: I1121 12:30:00.540091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:01 crc kubenswrapper[4769]: I1121 12:30:01.220325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395470-744df"] Nov 21 12:30:01 crc kubenswrapper[4769]: I1121 12:30:01.267568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" event={"ID":"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e","Type":"ContainerStarted","Data":"614c3259e8cbc228c37508c3e5fc4a029c0a4f5a37744b636e9e3df03b571c1c"} Nov 21 12:30:02 crc kubenswrapper[4769]: I1121 12:30:02.279597 4769 generic.go:334] "Generic (PLEG): container finished" podID="8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" containerID="8beb2efdbf703007886b1e12a039aea01b3769c293d82fed64504282a9c72cc5" exitCode=0 Nov 21 12:30:02 crc kubenswrapper[4769]: I1121 12:30:02.279708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" event={"ID":"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e","Type":"ContainerDied","Data":"8beb2efdbf703007886b1e12a039aea01b3769c293d82fed64504282a9c72cc5"} Nov 21 12:30:02 crc kubenswrapper[4769]: I1121 12:30:02.998175 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp"] Nov 21 12:30:02 crc kubenswrapper[4769]: I1121 12:30:02.999206 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.001955 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"openshift-service-ca.crt" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.002091 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-dockercfg-827cl" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.009499 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"kube-root-ca.crt" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.019430 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.127902 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.128842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.135616 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-admission-webhook-service-cert" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.136288 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-admission-webhook-dockercfg-lnvb8" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.160559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2lp7\" (UniqueName: \"kubernetes.io/projected/9f66bcb2-7f66-4235-b585-dba843900a8f-kube-api-access-x2lp7\") pod \"obo-prometheus-operator-668cf9dfbb-hk9xp\" (UID: \"9f66bcb2-7f66-4235-b585-dba843900a8f\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.160887 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.162618 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.165841 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.171318 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.263631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84de1bcc-b8a4-4e42-ad5e-566a1a904402-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-5vdkb\" (UID: \"84de1bcc-b8a4-4e42-ad5e-566a1a904402\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.263709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lp7\" (UniqueName: \"kubernetes.io/projected/9f66bcb2-7f66-4235-b585-dba843900a8f-kube-api-access-x2lp7\") pod \"obo-prometheus-operator-668cf9dfbb-hk9xp\" (UID: \"9f66bcb2-7f66-4235-b585-dba843900a8f\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.263765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a8d21e7-d6be-4e98-b634-b1a22cdf0673-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-qg57f\" (UID: \"7a8d21e7-d6be-4e98-b634-b1a22cdf0673\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.263801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a8d21e7-d6be-4e98-b634-b1a22cdf0673-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-qg57f\" (UID: \"7a8d21e7-d6be-4e98-b634-b1a22cdf0673\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.263832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/84de1bcc-b8a4-4e42-ad5e-566a1a904402-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-5vdkb\" (UID: \"84de1bcc-b8a4-4e42-ad5e-566a1a904402\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.297434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lp7\" (UniqueName: \"kubernetes.io/projected/9f66bcb2-7f66-4235-b585-dba843900a8f-kube-api-access-x2lp7\") pod \"obo-prometheus-operator-668cf9dfbb-hk9xp\" (UID: \"9f66bcb2-7f66-4235-b585-dba843900a8f\") " pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.317374 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.357776 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-tlbd2"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.364015 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.365850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/84de1bcc-b8a4-4e42-ad5e-566a1a904402-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-5vdkb\" (UID: \"84de1bcc-b8a4-4e42-ad5e-566a1a904402\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.365920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84de1bcc-b8a4-4e42-ad5e-566a1a904402-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-5vdkb\" (UID: \"84de1bcc-b8a4-4e42-ad5e-566a1a904402\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.366010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a8d21e7-d6be-4e98-b634-b1a22cdf0673-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-qg57f\" (UID: \"7a8d21e7-d6be-4e98-b634-b1a22cdf0673\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.366073 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a8d21e7-d6be-4e98-b634-b1a22cdf0673-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-qg57f\" (UID: \"7a8d21e7-d6be-4e98-b634-b1a22cdf0673\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.369336 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"observability-operator-sa-dockercfg-djnnj" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.369591 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"observability-operator-tls" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.375714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/84de1bcc-b8a4-4e42-ad5e-566a1a904402-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-5vdkb\" (UID: \"84de1bcc-b8a4-4e42-ad5e-566a1a904402\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.382676 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a8d21e7-d6be-4e98-b634-b1a22cdf0673-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-qg57f\" (UID: \"7a8d21e7-d6be-4e98-b634-b1a22cdf0673\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.383983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a8d21e7-d6be-4e98-b634-b1a22cdf0673-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-qg57f\" (UID: \"7a8d21e7-d6be-4e98-b634-b1a22cdf0673\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.394335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84de1bcc-b8a4-4e42-ad5e-566a1a904402-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-756454bd79-5vdkb\" (UID: \"84de1bcc-b8a4-4e42-ad5e-566a1a904402\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.419261 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-tlbd2"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.462515 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.468120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vhvl\" (UniqueName: \"kubernetes.io/projected/d1b6a202-a25e-48a3-9090-53b80eacbe29-kube-api-access-6vhvl\") pod \"observability-operator-d8bb48f5d-tlbd2\" (UID: \"d1b6a202-a25e-48a3-9090-53b80eacbe29\") " pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.468375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1b6a202-a25e-48a3-9090-53b80eacbe29-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-tlbd2\" (UID: \"d1b6a202-a25e-48a3-9090-53b80eacbe29\") " pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.517579 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.567818 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/perses-operator-5446b9c989-lljj9"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.568843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.569936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1b6a202-a25e-48a3-9090-53b80eacbe29-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-tlbd2\" (UID: \"d1b6a202-a25e-48a3-9090-53b80eacbe29\") " pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.570026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vhvl\" (UniqueName: \"kubernetes.io/projected/d1b6a202-a25e-48a3-9090-53b80eacbe29-kube-api-access-6vhvl\") pod \"observability-operator-d8bb48f5d-tlbd2\" (UID: \"d1b6a202-a25e-48a3-9090-53b80eacbe29\") " pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.574010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"perses-operator-dockercfg-v76r6" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.588547 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-5446b9c989-lljj9"] Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.596140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1b6a202-a25e-48a3-9090-53b80eacbe29-observability-operator-tls\") pod \"observability-operator-d8bb48f5d-tlbd2\" (UID: \"d1b6a202-a25e-48a3-9090-53b80eacbe29\") " pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.636846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vhvl\" (UniqueName: \"kubernetes.io/projected/d1b6a202-a25e-48a3-9090-53b80eacbe29-kube-api-access-6vhvl\") pod \"observability-operator-d8bb48f5d-tlbd2\" (UID: \"d1b6a202-a25e-48a3-9090-53b80eacbe29\") " pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.671997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da244d44-0b9e-4cc0-921f-5ce3e8e962a9-openshift-service-ca\") pod \"perses-operator-5446b9c989-lljj9\" (UID: \"da244d44-0b9e-4cc0-921f-5ce3e8e962a9\") " pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.672057 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n24t\" (UniqueName: \"kubernetes.io/projected/da244d44-0b9e-4cc0-921f-5ce3e8e962a9-kube-api-access-2n24t\") pod \"perses-operator-5446b9c989-lljj9\" (UID: \"da244d44-0b9e-4cc0-921f-5ce3e8e962a9\") " pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.683823 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.773047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbb2h\" (UniqueName: \"kubernetes.io/projected/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-kube-api-access-vbb2h\") pod \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.773123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-config-volume\") pod \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.773180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-secret-volume\") pod \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\" (UID: \"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e\") " Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.773673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da244d44-0b9e-4cc0-921f-5ce3e8e962a9-openshift-service-ca\") pod \"perses-operator-5446b9c989-lljj9\" (UID: \"da244d44-0b9e-4cc0-921f-5ce3e8e962a9\") " pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.773746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2n24t\" (UniqueName: \"kubernetes.io/projected/da244d44-0b9e-4cc0-921f-5ce3e8e962a9-kube-api-access-2n24t\") pod \"perses-operator-5446b9c989-lljj9\" (UID: \"da244d44-0b9e-4cc0-921f-5ce3e8e962a9\") " pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.774984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-config-volume" (OuterVolumeSpecName: "config-volume") pod "8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" (UID: "8858feeb-2dd0-4eb5-9417-7efb5d53aa3e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.778701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" (UID: "8858feeb-2dd0-4eb5-9417-7efb5d53aa3e"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.779327 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da244d44-0b9e-4cc0-921f-5ce3e8e962a9-openshift-service-ca\") pod \"perses-operator-5446b9c989-lljj9\" (UID: \"da244d44-0b9e-4cc0-921f-5ce3e8e962a9\") " pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.788292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-kube-api-access-vbb2h" (OuterVolumeSpecName: "kube-api-access-vbb2h") pod "8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" (UID: "8858feeb-2dd0-4eb5-9417-7efb5d53aa3e"). InnerVolumeSpecName "kube-api-access-vbb2h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.789533 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.808395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n24t\" (UniqueName: \"kubernetes.io/projected/da244d44-0b9e-4cc0-921f-5ce3e8e962a9-kube-api-access-2n24t\") pod \"perses-operator-5446b9c989-lljj9\" (UID: \"da244d44-0b9e-4cc0-921f-5ce3e8e962a9\") " pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.880474 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vbb2h\" (UniqueName: \"kubernetes.io/projected/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-kube-api-access-vbb2h\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.880549 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.880560 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:03 crc kubenswrapper[4769]: I1121 12:30:03.928713 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.175329 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp"] Nov 21 12:30:04 crc kubenswrapper[4769]: W1121 12:30:04.184413 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f66bcb2_7f66_4235_b585_dba843900a8f.slice/crio-3113140e2b314261077c24795edc53922197726b86669920260eb479c4744f52 WatchSource:0}: Error finding container 3113140e2b314261077c24795edc53922197726b86669920260eb479c4744f52: Status 404 returned error can't find the container with id 3113140e2b314261077c24795edc53922197726b86669920260eb479c4744f52 Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.249306 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f"] Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.362134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" event={"ID":"9f66bcb2-7f66-4235-b585-dba843900a8f","Type":"ContainerStarted","Data":"3113140e2b314261077c24795edc53922197726b86669920260eb479c4744f52"} Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.365809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" event={"ID":"7a8d21e7-d6be-4e98-b634-b1a22cdf0673","Type":"ContainerStarted","Data":"c1fe2653ed157f2ba8773583f5efdc2ed045f761683994db9c1f827a1c2ea46a"} Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.367527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" event={"ID":"8858feeb-2dd0-4eb5-9417-7efb5d53aa3e","Type":"ContainerDied","Data":"614c3259e8cbc228c37508c3e5fc4a029c0a4f5a37744b636e9e3df03b571c1c"} Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.367548 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="614c3259e8cbc228c37508c3e5fc4a029c0a4f5a37744b636e9e3df03b571c1c" Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.367604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395470-744df" Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.369606 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb"] Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.557957 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-d8bb48f5d-tlbd2"] Nov 21 12:30:04 crc kubenswrapper[4769]: W1121 12:30:04.587277 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b6a202_a25e_48a3_9090_53b80eacbe29.slice/crio-787e184ac49fc09f6d474a7ada482ca02eb2d63bd80c95bcaa10fe1fab54a255 WatchSource:0}: Error finding container 787e184ac49fc09f6d474a7ada482ca02eb2d63bd80c95bcaa10fe1fab54a255: Status 404 returned error can't find the container with id 787e184ac49fc09f6d474a7ada482ca02eb2d63bd80c95bcaa10fe1fab54a255 Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.778812 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-5446b9c989-lljj9"] Nov 21 12:30:04 crc kubenswrapper[4769]: W1121 12:30:04.786968 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda244d44_0b9e_4cc0_921f_5ce3e8e962a9.slice/crio-f4f4d1ce707c1ae7aa3d10340110d04c279687db80556fd7207094c74cf9fd8c WatchSource:0}: Error finding container f4f4d1ce707c1ae7aa3d10340110d04c279687db80556fd7207094c74cf9fd8c: Status 404 returned error can't find the container with id f4f4d1ce707c1ae7aa3d10340110d04c279687db80556fd7207094c74cf9fd8c Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.866849 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz"] Nov 21 12:30:04 crc kubenswrapper[4769]: I1121 12:30:04.870948 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395425-kqgtz"] Nov 21 12:30:05 crc kubenswrapper[4769]: I1121 12:30:05.288295 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a" path="/var/lib/kubelet/pods/1ea6c139-4d7c-49b5-bff1-3cc20a6e1b9a/volumes" Nov 21 12:30:05 crc kubenswrapper[4769]: I1121 12:30:05.377626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" event={"ID":"84de1bcc-b8a4-4e42-ad5e-566a1a904402","Type":"ContainerStarted","Data":"3eea4d996a56dd1219b8a9e51ed1a9d3287aa3f6313bc27cac84fa4f6eb631f8"} Nov 21 12:30:05 crc kubenswrapper[4769]: I1121 12:30:05.379452 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" event={"ID":"d1b6a202-a25e-48a3-9090-53b80eacbe29","Type":"ContainerStarted","Data":"787e184ac49fc09f6d474a7ada482ca02eb2d63bd80c95bcaa10fe1fab54a255"} Nov 21 12:30:05 crc kubenswrapper[4769]: I1121 12:30:05.393339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-5446b9c989-lljj9" event={"ID":"da244d44-0b9e-4cc0-921f-5ce3e8e962a9","Type":"ContainerStarted","Data":"f4f4d1ce707c1ae7aa3d10340110d04c279687db80556fd7207094c74cf9fd8c"} Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.089466 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:30:09 crc kubenswrapper[4769]: E1121 12:30:09.090164 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" containerName="collect-profiles" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.090176 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" containerName="collect-profiles" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.090353 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" containerName="collect-profiles" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.094490 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.100843 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.100941 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.100988 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.101148 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.101154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-96prb" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.107471 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.110846 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.114171 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.278552 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:30:09 crc kubenswrapper[4769]: E1121 12:30:09.278875 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8bd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-kube-api-access-cc8bd\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f24e626c-11ec-4d3d-a065-822b13a8b8b0-pod-info\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279270 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f24e626c-11ec-4d3d-a065-822b13a8b8b0-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.279725 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f24e626c-11ec-4d3d-a065-822b13a8b8b0-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8bd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-kube-api-access-cc8bd\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381555 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f24e626c-11ec-4d3d-a065-822b13a8b8b0-pod-info\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.381615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.382443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.382703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.382716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.382930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.383152 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.400919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.402836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.404246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.415402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f24e626c-11ec-4d3d-a065-822b13a8b8b0-pod-info\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.429516 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f24e626c-11ec-4d3d-a065-822b13a8b8b0-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.435929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8bd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-kube-api-access-cc8bd\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.463585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.729726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.885715 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.890420 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.897834 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.899394 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-r6m8b" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.899591 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.899810 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.901221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.911464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993404 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-default\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-kolla-config\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-operator-scripts\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfbm\" (UniqueName: \"kubernetes.io/projected/5a9907bd-b1c1-4130-aa95-de70c92e4743-kube-api-access-fsfbm\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-generated\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:09 crc kubenswrapper[4769]: I1121 12:30:09.993652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.094905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-kolla-config\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.094966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-operator-scripts\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.095037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.095083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfbm\" (UniqueName: \"kubernetes.io/projected/5a9907bd-b1c1-4130-aa95-de70c92e4743-kube-api-access-fsfbm\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.095152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-generated\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.095180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.095382 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.095729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-generated\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.096407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-kolla-config\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.097311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-operator-scripts\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.100516 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.118449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.118549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-default\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.120321 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfbm\" (UniqueName: \"kubernetes.io/projected/5a9907bd-b1c1-4130-aa95-de70c92e4743-kube-api-access-fsfbm\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.124026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.128798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-default\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.154372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-galera-0\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.225881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.266982 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.269678 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.272440 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.272773 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.273368 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-xqxrn" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.289968 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.423204 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.423270 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.423357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpds\" (UniqueName: \"kubernetes.io/projected/9d322e5e-caf1-47f5-a352-9508f797537d-kube-api-access-7mpds\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.423393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-config-data\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.423425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-kolla-config\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.524392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.524481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpds\" (UniqueName: \"kubernetes.io/projected/9d322e5e-caf1-47f5-a352-9508f797537d-kube-api-access-7mpds\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.524520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-config-data\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.524561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-kolla-config\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.524586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.525461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-config-data\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.525525 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-kolla-config\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.529164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.530920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.544407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpds\" (UniqueName: \"kubernetes.io/projected/9d322e5e-caf1-47f5-a352-9508f797537d-kube-api-access-7mpds\") pod \"memcached-0\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:10 crc kubenswrapper[4769]: I1121 12:30:10.599677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:12 crc kubenswrapper[4769]: I1121 12:30:12.986788 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:30:12 crc kubenswrapper[4769]: I1121 12:30:12.988356 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:13 crc kubenswrapper[4769]: I1121 12:30:13.007600 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-zxmxm" Nov 21 12:30:13 crc kubenswrapper[4769]: I1121 12:30:13.016184 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:30:13 crc kubenswrapper[4769]: I1121 12:30:13.063710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9s4x\" (UniqueName: \"kubernetes.io/projected/a0bcf88b-4434-4ff8-86ff-2e343b9394fb-kube-api-access-f9s4x\") pod \"kube-state-metrics-0\" (UID: \"a0bcf88b-4434-4ff8-86ff-2e343b9394fb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:13 crc kubenswrapper[4769]: I1121 12:30:13.165024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f9s4x\" (UniqueName: \"kubernetes.io/projected/a0bcf88b-4434-4ff8-86ff-2e343b9394fb-kube-api-access-f9s4x\") pod \"kube-state-metrics-0\" (UID: \"a0bcf88b-4434-4ff8-86ff-2e343b9394fb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:13 crc kubenswrapper[4769]: I1121 12:30:13.213412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9s4x\" (UniqueName: \"kubernetes.io/projected/a0bcf88b-4434-4ff8-86ff-2e343b9394fb-kube-api-access-f9s4x\") pod \"kube-state-metrics-0\" (UID: \"a0bcf88b-4434-4ff8-86ff-2e343b9394fb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:13 crc kubenswrapper[4769]: I1121 12:30:13.325082 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.081986 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.084419 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.086419 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.086628 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.087403 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-mdr9b" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.089881 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.090074 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.096377 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-config\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp9q5\" (UniqueName: \"kubernetes.io/projected/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-kube-api-access-qp9q5\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.132904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234513 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-config\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qp9q5\" (UniqueName: \"kubernetes.io/projected/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-kube-api-access-qp9q5\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.234867 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.235781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.236017 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.236359 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-config\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.243386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.243652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.247220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.259020 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.264343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp9q5\" (UniqueName: \"kubernetes.io/projected/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-kube-api-access-qp9q5\") pod \"ovsdbserver-sb-0\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:17 crc kubenswrapper[4769]: I1121 12:30:17.403415 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.730392 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.731960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.734613 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.734852 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-jpbnf" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.734976 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.739099 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.788094 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863629 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-config\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjfs\" (UniqueName: \"kubernetes.io/projected/9244abb6-e799-4f0d-9af5-a506ee5c835f-kube-api-access-gkjfs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.863884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-config\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjfs\" (UniqueName: \"kubernetes.io/projected/9244abb6-e799-4f0d-9af5-a506ee5c835f-kube-api-access-gkjfs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.965602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.966355 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.966559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-config\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.972608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.977982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.978303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.978710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.988275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:18 crc kubenswrapper[4769]: I1121 12:30:18.994995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjfs\" (UniqueName: \"kubernetes.io/projected/9244abb6-e799-4f0d-9af5-a506ee5c835f-kube-api-access-gkjfs\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:19 crc kubenswrapper[4769]: I1121 12:30:19.021456 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:19 crc kubenswrapper[4769]: I1121 12:30:19.075401 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:20 crc kubenswrapper[4769]: I1121 12:30:20.274733 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:30:20 crc kubenswrapper[4769]: E1121 12:30:20.275484 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:30:21 crc kubenswrapper[4769]: I1121 12:30:21.381817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:30:21 crc kubenswrapper[4769]: I1121 12:30:21.443650 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:30:21 crc kubenswrapper[4769]: I1121 12:30:21.485947 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:30:21 crc kubenswrapper[4769]: I1121 12:30:21.494657 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:30:21 crc kubenswrapper[4769]: I1121 12:30:21.498828 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:30:21 crc kubenswrapper[4769]: I1121 12:30:21.558713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:30:21 crc kubenswrapper[4769]: W1121 12:30:21.718341 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a9907bd_b1c1_4130_aa95_de70c92e4743.slice/crio-771aa82b1682f033308bc2c0d5a998fb33d3835a64ce546b9b55a8073085a4b9 WatchSource:0}: Error finding container 771aa82b1682f033308bc2c0d5a998fb33d3835a64ce546b9b55a8073085a4b9: Status 404 returned error can't find the container with id 771aa82b1682f033308bc2c0d5a998fb33d3835a64ce546b9b55a8073085a4b9 Nov 21 12:30:21 crc kubenswrapper[4769]: W1121 12:30:21.718779 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9244abb6_e799_4f0d_9af5_a506ee5c835f.slice/crio-7c92f54b21f0e98d5dfaa049c5522c2e9cd6e39080a58f50d8bb9ee5cccac94f WatchSource:0}: Error finding container 7c92f54b21f0e98d5dfaa049c5522c2e9cd6e39080a58f50d8bb9ee5cccac94f: Status 404 returned error can't find the container with id 7c92f54b21f0e98d5dfaa049c5522c2e9cd6e39080a58f50d8bb9ee5cccac94f Nov 21 12:30:21 crc kubenswrapper[4769]: W1121 12:30:21.721032 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24e626c_11ec_4d3d_a065_822b13a8b8b0.slice/crio-66bba5e09ac7ed3afbd13f9200bfdf72f56a16f15394cf9c0bff53341f9f0b57 WatchSource:0}: Error finding container 66bba5e09ac7ed3afbd13f9200bfdf72f56a16f15394cf9c0bff53341f9f0b57: Status 404 returned error can't find the container with id 66bba5e09ac7ed3afbd13f9200bfdf72f56a16f15394cf9c0bff53341f9f0b57 Nov 21 12:30:21 crc kubenswrapper[4769]: W1121 12:30:21.724520 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d322e5e_caf1_47f5_a352_9508f797537d.slice/crio-9ba3123d795894b2c7e17cff793e022a2ad7ac1f1504f9b29e46a8f4ebcb1b56 WatchSource:0}: Error finding container 9ba3123d795894b2c7e17cff793e022a2ad7ac1f1504f9b29e46a8f4ebcb1b56: Status 404 returned error can't find the container with id 9ba3123d795894b2c7e17cff793e022a2ad7ac1f1504f9b29e46a8f4ebcb1b56 Nov 21 12:30:21 crc kubenswrapper[4769]: W1121 12:30:21.741614 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0bcf88b_4434_4ff8_86ff_2e343b9394fb.slice/crio-cc75cebfedb09f5a4834bd50f5eebe4e57ac44ae6066cbf5cd0d190e4b0a94fe WatchSource:0}: Error finding container cc75cebfedb09f5a4834bd50f5eebe4e57ac44ae6066cbf5cd0d190e4b0a94fe: Status 404 returned error can't find the container with id cc75cebfedb09f5a4834bd50f5eebe4e57ac44ae6066cbf5cd0d190e4b0a94fe Nov 21 12:30:21 crc kubenswrapper[4769]: W1121 12:30:21.741921 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod358a84ed_d9ff_4fd8_a429_0e1f81b00f43.slice/crio-c70fa7196f0297d266d3d14ad6e898d726b5e97dedf26a4e3bb229425e3a00ad WatchSource:0}: Error finding container c70fa7196f0297d266d3d14ad6e898d726b5e97dedf26a4e3bb229425e3a00ad: Status 404 returned error can't find the container with id c70fa7196f0297d266d3d14ad6e898d726b5e97dedf26a4e3bb229425e3a00ad Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.571170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a0bcf88b-4434-4ff8-86ff-2e343b9394fb","Type":"ContainerStarted","Data":"cc75cebfedb09f5a4834bd50f5eebe4e57ac44ae6066cbf5cd0d190e4b0a94fe"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.574854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358a84ed-d9ff-4fd8-a429-0e1f81b00f43","Type":"ContainerStarted","Data":"c70fa7196f0297d266d3d14ad6e898d726b5e97dedf26a4e3bb229425e3a00ad"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.577084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9244abb6-e799-4f0d-9af5-a506ee5c835f","Type":"ContainerStarted","Data":"7c92f54b21f0e98d5dfaa049c5522c2e9cd6e39080a58f50d8bb9ee5cccac94f"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.578804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" event={"ID":"9f66bcb2-7f66-4235-b585-dba843900a8f","Type":"ContainerStarted","Data":"6ac776c4b8bf122c07f1246581f7019cad01a1251b8da259fd3a0b2bff240d5b"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.586202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" event={"ID":"7a8d21e7-d6be-4e98-b634-b1a22cdf0673","Type":"ContainerStarted","Data":"2fcd91ed3fb1bed9aaf3dd43639a92cacb0e71b2528e8cc69714d85155c0be21"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.590524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"f24e626c-11ec-4d3d-a065-822b13a8b8b0","Type":"ContainerStarted","Data":"66bba5e09ac7ed3afbd13f9200bfdf72f56a16f15394cf9c0bff53341f9f0b57"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.591983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9d322e5e-caf1-47f5-a352-9508f797537d","Type":"ContainerStarted","Data":"9ba3123d795894b2c7e17cff793e022a2ad7ac1f1504f9b29e46a8f4ebcb1b56"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.595782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5a9907bd-b1c1-4130-aa95-de70c92e4743","Type":"ContainerStarted","Data":"771aa82b1682f033308bc2c0d5a998fb33d3835a64ce546b9b55a8073085a4b9"} Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.605673 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-668cf9dfbb-hk9xp" podStartSLOduration=4.005403621 podStartE2EDuration="20.605627908s" podCreationTimestamp="2025-11-21 12:30:02 +0000 UTC" firstStartedPulling="2025-11-21 12:30:04.190385724 +0000 UTC m=+2362.891047542" lastFinishedPulling="2025-11-21 12:30:20.790609991 +0000 UTC m=+2379.491271829" observedRunningTime="2025-11-21 12:30:22.601457353 +0000 UTC m=+2381.302119171" watchObservedRunningTime="2025-11-21 12:30:22.605627908 +0000 UTC m=+2381.306289726" Nov 21 12:30:22 crc kubenswrapper[4769]: I1121 12:30:22.629600 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-qg57f" podStartSLOduration=3.339922289 podStartE2EDuration="19.629576967s" podCreationTimestamp="2025-11-21 12:30:03 +0000 UTC" firstStartedPulling="2025-11-21 12:30:04.27780026 +0000 UTC m=+2362.978462078" lastFinishedPulling="2025-11-21 12:30:20.567454938 +0000 UTC m=+2379.268116756" observedRunningTime="2025-11-21 12:30:22.619051437 +0000 UTC m=+2381.319713255" watchObservedRunningTime="2025-11-21 12:30:22.629576967 +0000 UTC m=+2381.330238785" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.609771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" event={"ID":"d1b6a202-a25e-48a3-9090-53b80eacbe29","Type":"ContainerStarted","Data":"6245dcb5c516afc0be389d69c1eaffbc3974166c4ce02cc556dc3085c1c250c2"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.610097 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.615941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"f24e626c-11ec-4d3d-a065-822b13a8b8b0","Type":"ContainerStarted","Data":"c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.616566 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.631867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-5446b9c989-lljj9" event={"ID":"da244d44-0b9e-4cc0-921f-5ce3e8e962a9","Type":"ContainerStarted","Data":"286dd840b88062cf012ad114ed96a9179ef9ddde8fbdb55bd3bd2b81ac0115f5"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.632050 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.633287 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/observability-operator-d8bb48f5d-tlbd2" podStartSLOduration=3.033077541 podStartE2EDuration="20.633274649s" podCreationTimestamp="2025-11-21 12:30:03 +0000 UTC" firstStartedPulling="2025-11-21 12:30:04.590444646 +0000 UTC m=+2363.291106464" lastFinishedPulling="2025-11-21 12:30:22.190641754 +0000 UTC m=+2380.891303572" observedRunningTime="2025-11-21 12:30:23.630072221 +0000 UTC m=+2382.330734049" watchObservedRunningTime="2025-11-21 12:30:23.633274649 +0000 UTC m=+2382.333936467" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.633999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" event={"ID":"84de1bcc-b8a4-4e42-ad5e-566a1a904402","Type":"ContainerStarted","Data":"7145aa0142dffee9c4ec10fa74802398408d62fa593c93f7aab9a5eda2d0d3e6"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.635204 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9d322e5e-caf1-47f5-a352-9508f797537d","Type":"ContainerStarted","Data":"6d1ef35e7c2e8dcfbf2420aa494282a720fa09f16930951bf6e98ca866737536"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.635330 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.636689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5a9907bd-b1c1-4130-aa95-de70c92e4743","Type":"ContainerStarted","Data":"d5b02e7309708a0fa95dccb3bcec59b9cc46949c68b8b8bf1ce1de0010cd9314"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.641015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358a84ed-d9ff-4fd8-a429-0e1f81b00f43","Type":"ContainerStarted","Data":"fe8068383cb45a1c204412176239b47c0a9b6fce26638efabeb12b44588f5e0e"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.643486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9244abb6-e799-4f0d-9af5-a506ee5c835f","Type":"ContainerStarted","Data":"fa85e5b9eb24f0969fe3460d2230a6f32841e28c36ac4cad58d44fc10d117b33"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.643571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9244abb6-e799-4f0d-9af5-a506ee5c835f","Type":"ContainerStarted","Data":"85ab8e383f1be4f2724b5cb3872fcffdaba8dd7aac8c76ee6bf8a299ab75d745"} Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.820216 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/perses-operator-5446b9c989-lljj9" podStartSLOduration=4.84126632 podStartE2EDuration="20.820171964s" podCreationTimestamp="2025-11-21 12:30:03 +0000 UTC" firstStartedPulling="2025-11-21 12:30:04.789751743 +0000 UTC m=+2363.490413561" lastFinishedPulling="2025-11-21 12:30:20.768657387 +0000 UTC m=+2379.469319205" observedRunningTime="2025-11-21 12:30:23.744535772 +0000 UTC m=+2382.445197590" watchObservedRunningTime="2025-11-21 12:30:23.820171964 +0000 UTC m=+2382.520833782" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.820823 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-756454bd79-5vdkb" podStartSLOduration=4.389073523 podStartE2EDuration="20.820816052s" podCreationTimestamp="2025-11-21 12:30:03 +0000 UTC" firstStartedPulling="2025-11-21 12:30:04.379928092 +0000 UTC m=+2363.080589910" lastFinishedPulling="2025-11-21 12:30:20.811670621 +0000 UTC m=+2379.512332439" observedRunningTime="2025-11-21 12:30:23.815280239 +0000 UTC m=+2382.515942057" watchObservedRunningTime="2025-11-21 12:30:23.820816052 +0000 UTC m=+2382.521477890" Nov 21 12:30:23 crc kubenswrapper[4769]: I1121 12:30:23.884171 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=6.884153865 podStartE2EDuration="6.884153865s" podCreationTimestamp="2025-11-21 12:30:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:23.883375714 +0000 UTC m=+2382.584037532" watchObservedRunningTime="2025-11-21 12:30:23.884153865 +0000 UTC m=+2382.584815673" Nov 21 12:30:24 crc kubenswrapper[4769]: I1121 12:30:24.076888 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:24 crc kubenswrapper[4769]: I1121 12:30:24.653634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a0bcf88b-4434-4ff8-86ff-2e343b9394fb","Type":"ContainerStarted","Data":"d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9"} Nov 21 12:30:24 crc kubenswrapper[4769]: I1121 12:30:24.656423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358a84ed-d9ff-4fd8-a429-0e1f81b00f43","Type":"ContainerStarted","Data":"bcfed6b744a320ad393ec69b87b575dd1b2328687fc0135a0a2b971f19291e75"} Nov 21 12:30:24 crc kubenswrapper[4769]: I1121 12:30:24.671811 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=14.671789239 podStartE2EDuration="14.671789239s" podCreationTimestamp="2025-11-21 12:30:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:23.915681183 +0000 UTC m=+2382.616342991" watchObservedRunningTime="2025-11-21 12:30:24.671789239 +0000 UTC m=+2383.372451057" Nov 21 12:30:24 crc kubenswrapper[4769]: I1121 12:30:24.673124 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=11.413182871 podStartE2EDuration="12.673118836s" podCreationTimestamp="2025-11-21 12:30:12 +0000 UTC" firstStartedPulling="2025-11-21 12:30:22.159462956 +0000 UTC m=+2380.860124774" lastFinishedPulling="2025-11-21 12:30:23.419398911 +0000 UTC m=+2382.120060739" observedRunningTime="2025-11-21 12:30:24.666113963 +0000 UTC m=+2383.366775781" watchObservedRunningTime="2025-11-21 12:30:24.673118836 +0000 UTC m=+2383.373780654" Nov 21 12:30:24 crc kubenswrapper[4769]: I1121 12:30:24.715905 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=8.715887043 podStartE2EDuration="8.715887043s" podCreationTimestamp="2025-11-21 12:30:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:24.711516053 +0000 UTC m=+2383.412177871" watchObservedRunningTime="2025-11-21 12:30:24.715887043 +0000 UTC m=+2383.416548861" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.078490 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.127617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.166334 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.167929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.181067 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"alertmanager-metric-storage-web-config" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.181365 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"alertmanager-metric-storage-cluster-tls-config" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.181500 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"alertmanager-metric-storage-tls-assets-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.181665 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"metric-storage-alertmanager-dockercfg-m4d85" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.181872 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"alertmanager-metric-storage-generated" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.214075 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.223951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-cluster-tls-config\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.224005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-web-config\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.224035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7f8k\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-kube-api-access-m7f8k\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.224067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-alertmanager-metric-storage-db\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.224120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-tls-assets\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.224164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-out\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.224177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-volume\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-cluster-tls-config\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-web-config\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m7f8k\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-kube-api-access-m7f8k\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-alertmanager-metric-storage-db\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326218 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-tls-assets\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-volume\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.326287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-out\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.327143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-alertmanager-metric-storage-db\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.332473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-web-config\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.334538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-cluster-tls-config\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.338741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-volume\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.344628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-out\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.352804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-tls-assets\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.358827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7f8k\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-kube-api-access-m7f8k\") pod \"alertmanager-metric-storage-0\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.495938 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:25 crc kubenswrapper[4769]: I1121 12:30:25.667962 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.012392 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.110731 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.112720 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.115526 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage-thanos-prometheus-http-client-file" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.115532 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage-web-config" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.116050 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"metric-storage-prometheus-dockercfg-sdl54" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.121141 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"prometheus-metric-storage-rulefiles-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.121352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.125078 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage-tls-assets-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.131174 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rwwv\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-kube-api-access-8rwwv\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98ed42ab-e45a-47fb-874e-ea6112d8ace8-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.148938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8rwwv\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-kube-api-access-8rwwv\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98ed42ab-e45a-47fb-874e-ea6112d8ace8-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.250531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.251467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98ed42ab-e45a-47fb-874e-ea6112d8ace8-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.255074 4769 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.255149 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/6713970be8148b0f1a00873a1346e8c1d8fa973bd7ac7788108fa262f1d41e6d/globalmount\"" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.259978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.260029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.260303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.260434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.264105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.275538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rwwv\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-kube-api-access-8rwwv\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.296781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.404263 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.433150 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.450216 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.676765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerStarted","Data":"17566b5e5d644be530dcbdf777da0db2bb46ebc5bff4dcdc260612b8d16c5208"} Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.676871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:26 crc kubenswrapper[4769]: I1121 12:30:26.921538 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:30:27 crc kubenswrapper[4769]: I1121 12:30:27.693306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerStarted","Data":"7f953716032a2ecc330b54e8bfb6f1594fc42419a85f9bfa297971d713e688ad"} Nov 21 12:30:29 crc kubenswrapper[4769]: I1121 12:30:29.115814 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:30:30 crc kubenswrapper[4769]: I1121 12:30:30.601358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:30:30 crc kubenswrapper[4769]: I1121 12:30:30.728906 4769 generic.go:334] "Generic (PLEG): container finished" podID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerID="d5b02e7309708a0fa95dccb3bcec59b9cc46949c68b8b8bf1ce1de0010cd9314" exitCode=0 Nov 21 12:30:30 crc kubenswrapper[4769]: I1121 12:30:30.728940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5a9907bd-b1c1-4130-aa95-de70c92e4743","Type":"ContainerDied","Data":"d5b02e7309708a0fa95dccb3bcec59b9cc46949c68b8b8bf1ce1de0010cd9314"} Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.574891 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.754057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerStarted","Data":"e6cdaf6b05fb329efda986285eabb0bb69c46e3538454afede49a67e24db432d"} Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.757748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerStarted","Data":"edec438835cd6fe959382fdc5aa3d4205bf17d768b4b068a13229bafef66c1cb"} Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.773374 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.775772 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.778559 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.779301 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.782530 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.782530 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-5bmth" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.782973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-config\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-scripts\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drn6m\" (UniqueName: \"kubernetes.io/projected/a769253b-cd90-4510-9310-26a922996a2c-kube-api-access-drn6m\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.866515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a769253b-cd90-4510-9310-26a922996a2c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-config\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-scripts\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-drn6m\" (UniqueName: \"kubernetes.io/projected/a769253b-cd90-4510-9310-26a922996a2c-kube-api-access-drn6m\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a769253b-cd90-4510-9310-26a922996a2c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.968880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.969859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a769253b-cd90-4510-9310-26a922996a2c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.970118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-scripts\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.970255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-config\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.975368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.975495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.976113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:32 crc kubenswrapper[4769]: I1121 12:30:32.996292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-drn6m\" (UniqueName: \"kubernetes.io/projected/a769253b-cd90-4510-9310-26a922996a2c-kube-api-access-drn6m\") pod \"ovn-northd-0\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:33 crc kubenswrapper[4769]: I1121 12:30:33.099750 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:33 crc kubenswrapper[4769]: I1121 12:30:33.353576 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:30:33 crc kubenswrapper[4769]: I1121 12:30:33.638735 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:30:33 crc kubenswrapper[4769]: I1121 12:30:33.769364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a769253b-cd90-4510-9310-26a922996a2c","Type":"ContainerStarted","Data":"75cbbe6ee8847f7153217f21054ce7b5a60df0c8123847554094f9db86dfdb4a"} Nov 21 12:30:33 crc kubenswrapper[4769]: I1121 12:30:33.774082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5a9907bd-b1c1-4130-aa95-de70c92e4743","Type":"ContainerStarted","Data":"4bedff8d1dc16707eec95a4e52fed146d1162c72aeab15c070f8e0c403d044d5"} Nov 21 12:30:33 crc kubenswrapper[4769]: I1121 12:30:33.932114 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/perses-operator-5446b9c989-lljj9" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.229369 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.235016 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.244351 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.244497 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-dw2lt" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.244340 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.247913 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.253618 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.407993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-lock\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.408045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wn4n\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-kube-api-access-5wn4n\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.408251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.408415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.408488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-cache\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.509616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.509730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.509786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-cache\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.509833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-lock\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.509866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5wn4n\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-kube-api-access-5wn4n\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.510482 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: E1121 12:30:34.510664 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:30:34 crc kubenswrapper[4769]: E1121 12:30:34.510726 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:30:34 crc kubenswrapper[4769]: E1121 12:30:34.510820 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift podName:688dc93e-07c1-4e0c-a3ef-2326d539867a nodeName:}" failed. No retries permitted until 2025-11-21 12:30:35.010792923 +0000 UTC m=+2393.711454741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift") pod "swift-storage-0" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a") : configmap "swift-ring-files" not found Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.511118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-cache\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.511213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-lock\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.532050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wn4n\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-kube-api-access-5wn4n\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.539072 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.656084 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zzptb"] Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.659124 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.661494 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.661683 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.663218 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.676160 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zzptb"] Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-dispersionconf\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-ring-data-devices\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkk2k\" (UniqueName: \"kubernetes.io/projected/96c3a557-036a-4711-b082-e7b6521e83b3-kube-api-access-jkk2k\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/96c3a557-036a-4711-b082-e7b6521e83b3-etc-swift\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-combined-ca-bundle\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-scripts\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.815732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-swiftconf\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.917022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/96c3a557-036a-4711-b082-e7b6521e83b3-etc-swift\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.917435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-combined-ca-bundle\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.917602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-scripts\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.917741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-swiftconf\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.917937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-dispersionconf\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.918143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-ring-data-devices\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.918393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jkk2k\" (UniqueName: \"kubernetes.io/projected/96c3a557-036a-4711-b082-e7b6521e83b3-kube-api-access-jkk2k\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.918518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/96c3a557-036a-4711-b082-e7b6521e83b3-etc-swift\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.919210 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-scripts\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.919323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-ring-data-devices\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.922277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-swiftconf\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.922405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-combined-ca-bundle\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.923758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-dispersionconf\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.942331 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkk2k\" (UniqueName: \"kubernetes.io/projected/96c3a557-036a-4711-b082-e7b6521e83b3-kube-api-access-jkk2k\") pod \"swift-ring-rebalance-zzptb\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:34 crc kubenswrapper[4769]: I1121 12:30:34.985840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:35 crc kubenswrapper[4769]: I1121 12:30:35.021150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:35 crc kubenswrapper[4769]: E1121 12:30:35.021375 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:30:35 crc kubenswrapper[4769]: E1121 12:30:35.021400 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:30:35 crc kubenswrapper[4769]: E1121 12:30:35.021456 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift podName:688dc93e-07c1-4e0c-a3ef-2326d539867a nodeName:}" failed. No retries permitted until 2025-11-21 12:30:36.021434941 +0000 UTC m=+2394.722096769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift") pod "swift-storage-0" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a") : configmap "swift-ring-files" not found Nov 21 12:30:35 crc kubenswrapper[4769]: I1121 12:30:35.293044 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:30:35 crc kubenswrapper[4769]: E1121 12:30:35.295255 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:30:35 crc kubenswrapper[4769]: I1121 12:30:35.542678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zzptb"] Nov 21 12:30:35 crc kubenswrapper[4769]: I1121 12:30:35.793955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" event={"ID":"96c3a557-036a-4711-b082-e7b6521e83b3","Type":"ContainerStarted","Data":"cda16cc9edfa00c88eed21fb4b3d1c3d9d4fb48f391e32e2f12e22ddfe943bc2"} Nov 21 12:30:36 crc kubenswrapper[4769]: I1121 12:30:36.043320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:36 crc kubenswrapper[4769]: E1121 12:30:36.043847 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:30:36 crc kubenswrapper[4769]: E1121 12:30:36.043940 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:30:36 crc kubenswrapper[4769]: E1121 12:30:36.044105 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift podName:688dc93e-07c1-4e0c-a3ef-2326d539867a nodeName:}" failed. No retries permitted until 2025-11-21 12:30:38.044063254 +0000 UTC m=+2396.744725072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift") pod "swift-storage-0" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a") : configmap "swift-ring-files" not found Nov 21 12:30:37 crc kubenswrapper[4769]: I1121 12:30:37.823134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" event={"ID":"96c3a557-036a-4711-b082-e7b6521e83b3","Type":"ContainerStarted","Data":"7c11e23df091226a6f9ae3e6b2a54a288af9fb82567312afe07cdb14c7a97d7c"} Nov 21 12:30:37 crc kubenswrapper[4769]: I1121 12:30:37.826206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a769253b-cd90-4510-9310-26a922996a2c","Type":"ContainerStarted","Data":"b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e"} Nov 21 12:30:37 crc kubenswrapper[4769]: I1121 12:30:37.826256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a769253b-cd90-4510-9310-26a922996a2c","Type":"ContainerStarted","Data":"0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502"} Nov 21 12:30:37 crc kubenswrapper[4769]: I1121 12:30:37.826491 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:37 crc kubenswrapper[4769]: I1121 12:30:37.849909 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" podStartSLOduration=3.849885517 podStartE2EDuration="3.849885517s" podCreationTimestamp="2025-11-21 12:30:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:37.843862741 +0000 UTC m=+2396.544524559" watchObservedRunningTime="2025-11-21 12:30:37.849885517 +0000 UTC m=+2396.550547335" Nov 21 12:30:37 crc kubenswrapper[4769]: I1121 12:30:37.912698 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=5.912679636 podStartE2EDuration="5.912679636s" podCreationTimestamp="2025-11-21 12:30:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:37.910090694 +0000 UTC m=+2396.610752512" watchObservedRunningTime="2025-11-21 12:30:37.912679636 +0000 UTC m=+2396.613341454" Nov 21 12:30:38 crc kubenswrapper[4769]: I1121 12:30:38.004043 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=30.00402468 podStartE2EDuration="30.00402468s" podCreationTimestamp="2025-11-21 12:30:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:37.99784444 +0000 UTC m=+2396.698506258" watchObservedRunningTime="2025-11-21 12:30:38.00402468 +0000 UTC m=+2396.704686498" Nov 21 12:30:38 crc kubenswrapper[4769]: I1121 12:30:38.084660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:38 crc kubenswrapper[4769]: E1121 12:30:38.084924 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:30:38 crc kubenswrapper[4769]: E1121 12:30:38.084962 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:30:38 crc kubenswrapper[4769]: E1121 12:30:38.085032 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift podName:688dc93e-07c1-4e0c-a3ef-2326d539867a nodeName:}" failed. No retries permitted until 2025-11-21 12:30:42.08501124 +0000 UTC m=+2400.785673058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift") pod "swift-storage-0" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a") : configmap "swift-ring-files" not found Nov 21 12:30:38 crc kubenswrapper[4769]: I1121 12:30:38.836340 4769 generic.go:334] "Generic (PLEG): container finished" podID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerID="edec438835cd6fe959382fdc5aa3d4205bf17d768b4b068a13229bafef66c1cb" exitCode=0 Nov 21 12:30:38 crc kubenswrapper[4769]: I1121 12:30:38.836449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerDied","Data":"edec438835cd6fe959382fdc5aa3d4205bf17d768b4b068a13229bafef66c1cb"} Nov 21 12:30:38 crc kubenswrapper[4769]: I1121 12:30:38.838218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerDied","Data":"e6cdaf6b05fb329efda986285eabb0bb69c46e3538454afede49a67e24db432d"} Nov 21 12:30:38 crc kubenswrapper[4769]: I1121 12:30:38.838774 4769 generic.go:334] "Generic (PLEG): container finished" podID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerID="e6cdaf6b05fb329efda986285eabb0bb69c46e3538454afede49a67e24db432d" exitCode=0 Nov 21 12:30:40 crc kubenswrapper[4769]: I1121 12:30:40.226454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:40 crc kubenswrapper[4769]: I1121 12:30:40.227002 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:41 crc kubenswrapper[4769]: I1121 12:30:41.871978 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerStarted","Data":"2ee8ae0ab58869ce6d574b44a553bb6ca4dc7a97657715758c66332cc907ab94"} Nov 21 12:30:42 crc kubenswrapper[4769]: I1121 12:30:42.163342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:42 crc kubenswrapper[4769]: E1121 12:30:42.163676 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:30:42 crc kubenswrapper[4769]: E1121 12:30:42.163722 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:30:42 crc kubenswrapper[4769]: E1121 12:30:42.163811 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift podName:688dc93e-07c1-4e0c-a3ef-2326d539867a nodeName:}" failed. No retries permitted until 2025-11-21 12:30:50.163781227 +0000 UTC m=+2408.864443085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift") pod "swift-storage-0" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a") : configmap "swift-ring-files" not found Nov 21 12:30:42 crc kubenswrapper[4769]: I1121 12:30:42.541534 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:42 crc kubenswrapper[4769]: I1121 12:30:42.832030 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.185802 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-db-create-r6n9r"] Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.188125 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.219379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-r6n9r"] Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.301920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgqh\" (UniqueName: \"kubernetes.io/projected/9d6808d8-72fa-46b2-adec-aa952bfe77c6-kube-api-access-vlgqh\") pod \"watcher-db-create-r6n9r\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.302376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d6808d8-72fa-46b2-adec-aa952bfe77c6-operator-scripts\") pod \"watcher-db-create-r6n9r\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.310392 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-89e7-account-create-lg4rr"] Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.311892 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.314156 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-db-secret" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.317356 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-89e7-account-create-lg4rr"] Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.403395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wc4m\" (UniqueName: \"kubernetes.io/projected/550f1ca2-df61-4e64-8079-b066525a6cc6-kube-api-access-2wc4m\") pod \"watcher-89e7-account-create-lg4rr\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.403466 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f1ca2-df61-4e64-8079-b066525a6cc6-operator-scripts\") pod \"watcher-89e7-account-create-lg4rr\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.403528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d6808d8-72fa-46b2-adec-aa952bfe77c6-operator-scripts\") pod \"watcher-db-create-r6n9r\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.403585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgqh\" (UniqueName: \"kubernetes.io/projected/9d6808d8-72fa-46b2-adec-aa952bfe77c6-kube-api-access-vlgqh\") pod \"watcher-db-create-r6n9r\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.404578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d6808d8-72fa-46b2-adec-aa952bfe77c6-operator-scripts\") pod \"watcher-db-create-r6n9r\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.421728 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgqh\" (UniqueName: \"kubernetes.io/projected/9d6808d8-72fa-46b2-adec-aa952bfe77c6-kube-api-access-vlgqh\") pod \"watcher-db-create-r6n9r\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.505020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2wc4m\" (UniqueName: \"kubernetes.io/projected/550f1ca2-df61-4e64-8079-b066525a6cc6-kube-api-access-2wc4m\") pod \"watcher-89e7-account-create-lg4rr\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.505121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f1ca2-df61-4e64-8079-b066525a6cc6-operator-scripts\") pod \"watcher-89e7-account-create-lg4rr\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.506006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f1ca2-df61-4e64-8079-b066525a6cc6-operator-scripts\") pod \"watcher-89e7-account-create-lg4rr\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.522079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wc4m\" (UniqueName: \"kubernetes.io/projected/550f1ca2-df61-4e64-8079-b066525a6cc6-kube-api-access-2wc4m\") pod \"watcher-89e7-account-create-lg4rr\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.523856 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:43 crc kubenswrapper[4769]: I1121 12:30:43.644450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:44 crc kubenswrapper[4769]: I1121 12:30:44.907356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerStarted","Data":"5ea3bf3fda6e155a0b41039aeb02470563831f848c3bc161c5fb92bd78631660"} Nov 21 12:30:44 crc kubenswrapper[4769]: I1121 12:30:44.907970 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:44 crc kubenswrapper[4769]: I1121 12:30:44.911486 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:30:44 crc kubenswrapper[4769]: I1121 12:30:44.935678 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" podStartSLOduration=4.785693803 podStartE2EDuration="19.935652086s" podCreationTimestamp="2025-11-21 12:30:25 +0000 UTC" firstStartedPulling="2025-11-21 12:30:26.014839162 +0000 UTC m=+2384.715500980" lastFinishedPulling="2025-11-21 12:30:41.164797445 +0000 UTC m=+2399.865459263" observedRunningTime="2025-11-21 12:30:44.92890763 +0000 UTC m=+2403.629569448" watchObservedRunningTime="2025-11-21 12:30:44.935652086 +0000 UTC m=+2403.636313904" Nov 21 12:30:45 crc kubenswrapper[4769]: I1121 12:30:45.922018 4769 generic.go:334] "Generic (PLEG): container finished" podID="96c3a557-036a-4711-b082-e7b6521e83b3" containerID="7c11e23df091226a6f9ae3e6b2a54a288af9fb82567312afe07cdb14c7a97d7c" exitCode=0 Nov 21 12:30:45 crc kubenswrapper[4769]: I1121 12:30:45.922620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" event={"ID":"96c3a557-036a-4711-b082-e7b6521e83b3","Type":"ContainerDied","Data":"7c11e23df091226a6f9ae3e6b2a54a288af9fb82567312afe07cdb14c7a97d7c"} Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.180449 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-r6n9r"] Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.271761 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-89e7-account-create-lg4rr"] Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.932467 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d6808d8-72fa-46b2-adec-aa952bfe77c6" containerID="57d55533b36401a5c10a6da9cf6e09e1aeae5da8fe2c41eb3965e4d065b8de8a" exitCode=0 Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.932534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" event={"ID":"9d6808d8-72fa-46b2-adec-aa952bfe77c6","Type":"ContainerDied","Data":"57d55533b36401a5c10a6da9cf6e09e1aeae5da8fe2c41eb3965e4d065b8de8a"} Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.932607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" event={"ID":"9d6808d8-72fa-46b2-adec-aa952bfe77c6","Type":"ContainerStarted","Data":"29f288e5608a6b385bb13c6aac529ac1c784400b34f76b085463aa3f2fe4c2ca"} Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.935054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerStarted","Data":"f0b19d0bd975d4ebc7b0cc9758b93716b11468b08c562f0c36bec8cc1bd00fc1"} Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.937909 4769 generic.go:334] "Generic (PLEG): container finished" podID="550f1ca2-df61-4e64-8079-b066525a6cc6" containerID="8d3c12e9e87fbf1311c74ee020bc8d550c2966b5911dbb2bd9f5ce73044eb65f" exitCode=0 Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.939341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" event={"ID":"550f1ca2-df61-4e64-8079-b066525a6cc6","Type":"ContainerDied","Data":"8d3c12e9e87fbf1311c74ee020bc8d550c2966b5911dbb2bd9f5ce73044eb65f"} Nov 21 12:30:46 crc kubenswrapper[4769]: I1121 12:30:46.939395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" event={"ID":"550f1ca2-df61-4e64-8079-b066525a6cc6","Type":"ContainerStarted","Data":"34d6f079821d86b2ffb3778182e5acfd97c6b911d8234aded306aea76e8ed348"} Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.287490 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-scripts\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-ring-data-devices\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/96c3a557-036a-4711-b082-e7b6521e83b3-etc-swift\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkk2k\" (UniqueName: \"kubernetes.io/projected/96c3a557-036a-4711-b082-e7b6521e83b3-kube-api-access-jkk2k\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-combined-ca-bundle\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-swiftconf\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.391899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-dispersionconf\") pod \"96c3a557-036a-4711-b082-e7b6521e83b3\" (UID: \"96c3a557-036a-4711-b082-e7b6521e83b3\") " Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.392484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.393649 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c3a557-036a-4711-b082-e7b6521e83b3-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.402115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.405601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c3a557-036a-4711-b082-e7b6521e83b3-kube-api-access-jkk2k" (OuterVolumeSpecName: "kube-api-access-jkk2k") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "kube-api-access-jkk2k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.427439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-scripts" (OuterVolumeSpecName: "scripts") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.427888 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.439698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "96c3a557-036a-4711-b082-e7b6521e83b3" (UID: "96c3a557-036a-4711-b082-e7b6521e83b3"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493875 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493913 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/96c3a557-036a-4711-b082-e7b6521e83b3-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493928 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jkk2k\" (UniqueName: \"kubernetes.io/projected/96c3a557-036a-4711-b082-e7b6521e83b3-kube-api-access-jkk2k\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493944 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493957 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493967 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/96c3a557-036a-4711-b082-e7b6521e83b3-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.493978 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96c3a557-036a-4711-b082-e7b6521e83b3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.950020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" event={"ID":"96c3a557-036a-4711-b082-e7b6521e83b3","Type":"ContainerDied","Data":"cda16cc9edfa00c88eed21fb4b3d1c3d9d4fb48f391e32e2f12e22ddfe943bc2"} Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.950092 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cda16cc9edfa00c88eed21fb4b3d1c3d9d4fb48f391e32e2f12e22ddfe943bc2" Nov 21 12:30:47 crc kubenswrapper[4769]: I1121 12:30:47.950116 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zzptb" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.253390 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.274484 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:30:48 crc kubenswrapper[4769]: E1121 12:30:48.274790 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.652943 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.711942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d6808d8-72fa-46b2-adec-aa952bfe77c6-operator-scripts\") pod \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.712243 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlgqh\" (UniqueName: \"kubernetes.io/projected/9d6808d8-72fa-46b2-adec-aa952bfe77c6-kube-api-access-vlgqh\") pod \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\" (UID: \"9d6808d8-72fa-46b2-adec-aa952bfe77c6\") " Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.712851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d6808d8-72fa-46b2-adec-aa952bfe77c6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9d6808d8-72fa-46b2-adec-aa952bfe77c6" (UID: "9d6808d8-72fa-46b2-adec-aa952bfe77c6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.716418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d6808d8-72fa-46b2-adec-aa952bfe77c6-kube-api-access-vlgqh" (OuterVolumeSpecName: "kube-api-access-vlgqh") pod "9d6808d8-72fa-46b2-adec-aa952bfe77c6" (UID: "9d6808d8-72fa-46b2-adec-aa952bfe77c6"). InnerVolumeSpecName "kube-api-access-vlgqh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.771235 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.813734 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wc4m\" (UniqueName: \"kubernetes.io/projected/550f1ca2-df61-4e64-8079-b066525a6cc6-kube-api-access-2wc4m\") pod \"550f1ca2-df61-4e64-8079-b066525a6cc6\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.813829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f1ca2-df61-4e64-8079-b066525a6cc6-operator-scripts\") pod \"550f1ca2-df61-4e64-8079-b066525a6cc6\" (UID: \"550f1ca2-df61-4e64-8079-b066525a6cc6\") " Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.814391 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vlgqh\" (UniqueName: \"kubernetes.io/projected/9d6808d8-72fa-46b2-adec-aa952bfe77c6-kube-api-access-vlgqh\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.814418 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d6808d8-72fa-46b2-adec-aa952bfe77c6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.814777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550f1ca2-df61-4e64-8079-b066525a6cc6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "550f1ca2-df61-4e64-8079-b066525a6cc6" (UID: "550f1ca2-df61-4e64-8079-b066525a6cc6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.818863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550f1ca2-df61-4e64-8079-b066525a6cc6-kube-api-access-2wc4m" (OuterVolumeSpecName: "kube-api-access-2wc4m") pod "550f1ca2-df61-4e64-8079-b066525a6cc6" (UID: "550f1ca2-df61-4e64-8079-b066525a6cc6"). InnerVolumeSpecName "kube-api-access-2wc4m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.916498 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2wc4m\" (UniqueName: \"kubernetes.io/projected/550f1ca2-df61-4e64-8079-b066525a6cc6-kube-api-access-2wc4m\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.916533 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f1ca2-df61-4e64-8079-b066525a6cc6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.962340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" event={"ID":"550f1ca2-df61-4e64-8079-b066525a6cc6","Type":"ContainerDied","Data":"34d6f079821d86b2ffb3778182e5acfd97c6b911d8234aded306aea76e8ed348"} Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.962392 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34d6f079821d86b2ffb3778182e5acfd97c6b911d8234aded306aea76e8ed348" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.962366 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-89e7-account-create-lg4rr" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.964535 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.964554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-create-r6n9r" event={"ID":"9d6808d8-72fa-46b2-adec-aa952bfe77c6","Type":"ContainerDied","Data":"29f288e5608a6b385bb13c6aac529ac1c784400b34f76b085463aa3f2fe4c2ca"} Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.964594 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29f288e5608a6b385bb13c6aac529ac1c784400b34f76b085463aa3f2fe4c2ca" Nov 21 12:30:48 crc kubenswrapper[4769]: I1121 12:30:48.968361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerStarted","Data":"90e10cd999360fbbfc11f2f2d13011e2624f99c96cea72614132b1b8a07b50c9"} Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.184889 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5p2qv"] Nov 21 12:30:50 crc kubenswrapper[4769]: E1121 12:30:50.185652 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d6808d8-72fa-46b2-adec-aa952bfe77c6" containerName="mariadb-database-create" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.185668 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d6808d8-72fa-46b2-adec-aa952bfe77c6" containerName="mariadb-database-create" Nov 21 12:30:50 crc kubenswrapper[4769]: E1121 12:30:50.185688 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="550f1ca2-df61-4e64-8079-b066525a6cc6" containerName="mariadb-account-create" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.185696 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="550f1ca2-df61-4e64-8079-b066525a6cc6" containerName="mariadb-account-create" Nov 21 12:30:50 crc kubenswrapper[4769]: E1121 12:30:50.185711 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96c3a557-036a-4711-b082-e7b6521e83b3" containerName="swift-ring-rebalance" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.185720 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c3a557-036a-4711-b082-e7b6521e83b3" containerName="swift-ring-rebalance" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.185937 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96c3a557-036a-4711-b082-e7b6521e83b3" containerName="swift-ring-rebalance" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.185959 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d6808d8-72fa-46b2-adec-aa952bfe77c6" containerName="mariadb-database-create" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.185975 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="550f1ca2-df61-4e64-8079-b066525a6cc6" containerName="mariadb-account-create" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.187728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.194524 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5p2qv"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.250395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40ae7ab9-9999-4b6b-89cf-c56f1e754286-operator-scripts\") pod \"keystone-db-create-5p2qv\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.250687 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.250764 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5smt\" (UniqueName: \"kubernetes.io/projected/40ae7ab9-9999-4b6b-89cf-c56f1e754286-kube-api-access-n5smt\") pod \"keystone-db-create-5p2qv\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.290682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"swift-storage-0\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.301444 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-8c07-account-create-nndrx"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.302479 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.307801 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.318620 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8c07-account-create-nndrx"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.357216 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/348a3e48-6cdf-4439-9065-5c5d4b431c24-operator-scripts\") pod \"keystone-8c07-account-create-nndrx\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.357317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40ae7ab9-9999-4b6b-89cf-c56f1e754286-operator-scripts\") pod \"keystone-db-create-5p2qv\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.357355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzcxk\" (UniqueName: \"kubernetes.io/projected/348a3e48-6cdf-4439-9065-5c5d4b431c24-kube-api-access-pzcxk\") pod \"keystone-8c07-account-create-nndrx\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.357491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n5smt\" (UniqueName: \"kubernetes.io/projected/40ae7ab9-9999-4b6b-89cf-c56f1e754286-kube-api-access-n5smt\") pod \"keystone-db-create-5p2qv\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.358155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40ae7ab9-9999-4b6b-89cf-c56f1e754286-operator-scripts\") pod \"keystone-db-create-5p2qv\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.389875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5smt\" (UniqueName: \"kubernetes.io/projected/40ae7ab9-9999-4b6b-89cf-c56f1e754286-kube-api-access-n5smt\") pod \"keystone-db-create-5p2qv\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.459618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/348a3e48-6cdf-4439-9065-5c5d4b431c24-operator-scripts\") pod \"keystone-8c07-account-create-nndrx\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.459697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pzcxk\" (UniqueName: \"kubernetes.io/projected/348a3e48-6cdf-4439-9065-5c5d4b431c24-kube-api-access-pzcxk\") pod \"keystone-8c07-account-create-nndrx\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.460541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/348a3e48-6cdf-4439-9065-5c5d4b431c24-operator-scripts\") pod \"keystone-8c07-account-create-nndrx\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.483621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzcxk\" (UniqueName: \"kubernetes.io/projected/348a3e48-6cdf-4439-9065-5c5d4b431c24-kube-api-access-pzcxk\") pod \"keystone-8c07-account-create-nndrx\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.495634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.520074 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.557915 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-r4ngx"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.559089 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.581826 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-r4ngx"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.636489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.659325 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-ff8c-account-create-xkhsd"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.660497 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.662823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.663433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5mwj\" (UniqueName: \"kubernetes.io/projected/0891c356-7943-4b14-bd0a-9af8473a7c4e-kube-api-access-q5mwj\") pod \"placement-db-create-r4ngx\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.663879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0891c356-7943-4b14-bd0a-9af8473a7c4e-operator-scripts\") pod \"placement-db-create-r4ngx\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.696859 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-ff8c-account-create-xkhsd"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.760789 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-kwg7w"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.762108 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.765534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/256df24b-b409-4b1f-bdbc-c59ad89f9301-operator-scripts\") pod \"placement-ff8c-account-create-xkhsd\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.765612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdzf7\" (UniqueName: \"kubernetes.io/projected/256df24b-b409-4b1f-bdbc-c59ad89f9301-kube-api-access-wdzf7\") pod \"placement-ff8c-account-create-xkhsd\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.765684 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0891c356-7943-4b14-bd0a-9af8473a7c4e-operator-scripts\") pod \"placement-db-create-r4ngx\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.765771 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q5mwj\" (UniqueName: \"kubernetes.io/projected/0891c356-7943-4b14-bd0a-9af8473a7c4e-kube-api-access-q5mwj\") pod \"placement-db-create-r4ngx\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.767332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0891c356-7943-4b14-bd0a-9af8473a7c4e-operator-scripts\") pod \"placement-db-create-r4ngx\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.774690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kwg7w"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.797917 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5mwj\" (UniqueName: \"kubernetes.io/projected/0891c356-7943-4b14-bd0a-9af8473a7c4e-kube-api-access-q5mwj\") pod \"placement-db-create-r4ngx\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.842962 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-042f-account-create-d6wlb"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.846544 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.851629 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.853882 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-042f-account-create-d6wlb"] Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3db03b1-50a8-456c-ab19-da73753636f1-operator-scripts\") pod \"glance-db-create-kwg7w\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/256df24b-b409-4b1f-bdbc-c59ad89f9301-operator-scripts\") pod \"placement-ff8c-account-create-xkhsd\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-operator-scripts\") pod \"glance-042f-account-create-d6wlb\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wdzf7\" (UniqueName: \"kubernetes.io/projected/256df24b-b409-4b1f-bdbc-c59ad89f9301-kube-api-access-wdzf7\") pod \"placement-ff8c-account-create-xkhsd\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm7cx\" (UniqueName: \"kubernetes.io/projected/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-kube-api-access-dm7cx\") pod \"glance-042f-account-create-d6wlb\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/f3db03b1-50a8-456c-ab19-da73753636f1-kube-api-access-b94sq\") pod \"glance-db-create-kwg7w\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.868907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/256df24b-b409-4b1f-bdbc-c59ad89f9301-operator-scripts\") pod \"placement-ff8c-account-create-xkhsd\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.885202 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdzf7\" (UniqueName: \"kubernetes.io/projected/256df24b-b409-4b1f-bdbc-c59ad89f9301-kube-api-access-wdzf7\") pod \"placement-ff8c-account-create-xkhsd\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.936799 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.969445 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/f3db03b1-50a8-456c-ab19-da73753636f1-kube-api-access-b94sq\") pod \"glance-db-create-kwg7w\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.969581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3db03b1-50a8-456c-ab19-da73753636f1-operator-scripts\") pod \"glance-db-create-kwg7w\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.970360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3db03b1-50a8-456c-ab19-da73753636f1-operator-scripts\") pod \"glance-db-create-kwg7w\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.970438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-operator-scripts\") pod \"glance-042f-account-create-d6wlb\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.970477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dm7cx\" (UniqueName: \"kubernetes.io/projected/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-kube-api-access-dm7cx\") pod \"glance-042f-account-create-d6wlb\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.971459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-operator-scripts\") pod \"glance-042f-account-create-d6wlb\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.989855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm7cx\" (UniqueName: \"kubernetes.io/projected/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-kube-api-access-dm7cx\") pod \"glance-042f-account-create-d6wlb\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:50 crc kubenswrapper[4769]: I1121 12:30:50.993884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/f3db03b1-50a8-456c-ab19-da73753636f1-kube-api-access-b94sq\") pod \"glance-db-create-kwg7w\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.031659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.086382 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.156322 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5p2qv"] Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.177658 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.181383 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:51 crc kubenswrapper[4769]: W1121 12:30:51.183380 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40ae7ab9_9999_4b6b_89cf_c56f1e754286.slice/crio-eb94d4c3c0e385dd494ca216d3d238293f4d199e5d1101a21edc507acfed2fbf WatchSource:0}: Error finding container eb94d4c3c0e385dd494ca216d3d238293f4d199e5d1101a21edc507acfed2fbf: Status 404 returned error can't find the container with id eb94d4c3c0e385dd494ca216d3d238293f4d199e5d1101a21edc507acfed2fbf Nov 21 12:30:51 crc kubenswrapper[4769]: W1121 12:30:51.234396 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod688dc93e_07c1_4e0c_a3ef_2326d539867a.slice/crio-d1736126e212f704b9dcc82d66b40efb5e3118ee96e7a763c8984cd0c86fcd21 WatchSource:0}: Error finding container d1736126e212f704b9dcc82d66b40efb5e3118ee96e7a763c8984cd0c86fcd21: Status 404 returned error can't find the container with id d1736126e212f704b9dcc82d66b40efb5e3118ee96e7a763c8984cd0c86fcd21 Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.295044 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8c07-account-create-nndrx"] Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.460209 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-r4ngx"] Nov 21 12:30:51 crc kubenswrapper[4769]: W1121 12:30:51.476566 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0891c356_7943_4b14_bd0a_9af8473a7c4e.slice/crio-0deeb4b64b566fa19373f96ac275072bcbfe65221e9991e695768f45b23b62e5 WatchSource:0}: Error finding container 0deeb4b64b566fa19373f96ac275072bcbfe65221e9991e695768f45b23b62e5: Status 404 returned error can't find the container with id 0deeb4b64b566fa19373f96ac275072bcbfe65221e9991e695768f45b23b62e5 Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.586693 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-ff8c-account-create-xkhsd"] Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.688665 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kwg7w"] Nov 21 12:30:51 crc kubenswrapper[4769]: W1121 12:30:51.712096 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3db03b1_50a8_456c_ab19_da73753636f1.slice/crio-6b9254265e3b68fe9bb025d8ef4eec1d05c69808862c01ef000da9f46d8769aa WatchSource:0}: Error finding container 6b9254265e3b68fe9bb025d8ef4eec1d05c69808862c01ef000da9f46d8769aa: Status 404 returned error can't find the container with id 6b9254265e3b68fe9bb025d8ef4eec1d05c69808862c01ef000da9f46d8769aa Nov 21 12:30:51 crc kubenswrapper[4769]: I1121 12:30:51.806497 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-042f-account-create-d6wlb"] Nov 21 12:30:51 crc kubenswrapper[4769]: W1121 12:30:51.824981 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod851d6f07_b264_4db7_a1fb_aba1af1d7c3e.slice/crio-39ec57f4755043ddf13eae83caa6fb550567a4620e639d27567c84c3a675aba0 WatchSource:0}: Error finding container 39ec57f4755043ddf13eae83caa6fb550567a4620e639d27567c84c3a675aba0: Status 404 returned error can't find the container with id 39ec57f4755043ddf13eae83caa6fb550567a4620e639d27567c84c3a675aba0 Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:51.998865 4769 generic.go:334] "Generic (PLEG): container finished" podID="0891c356-7943-4b14-bd0a-9af8473a7c4e" containerID="5df8baf0d2b0948b81c51a04e2ab43ab095c1e97ecad0059b9900bed00d5ce1e" exitCode=0 Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:51.998939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-r4ngx" event={"ID":"0891c356-7943-4b14-bd0a-9af8473a7c4e","Type":"ContainerDied","Data":"5df8baf0d2b0948b81c51a04e2ab43ab095c1e97ecad0059b9900bed00d5ce1e"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:51.998977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-r4ngx" event={"ID":"0891c356-7943-4b14-bd0a-9af8473a7c4e","Type":"ContainerStarted","Data":"0deeb4b64b566fa19373f96ac275072bcbfe65221e9991e695768f45b23b62e5"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.009501 4769 generic.go:334] "Generic (PLEG): container finished" podID="348a3e48-6cdf-4439-9065-5c5d4b431c24" containerID="858792b7a29aaf40647c776baaf034cab1b8e959b6276abf9ffcefe35c76176a" exitCode=0 Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.009875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" event={"ID":"348a3e48-6cdf-4439-9065-5c5d4b431c24","Type":"ContainerDied","Data":"858792b7a29aaf40647c776baaf034cab1b8e959b6276abf9ffcefe35c76176a"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.009980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" event={"ID":"348a3e48-6cdf-4439-9065-5c5d4b431c24","Type":"ContainerStarted","Data":"ab8b8f6b9baaa672ec24e40d948f7544741e207bb275958788e4fe2822c69198"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.019613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" event={"ID":"851d6f07-b264-4db7-a1fb-aba1af1d7c3e","Type":"ContainerStarted","Data":"39ec57f4755043ddf13eae83caa6fb550567a4620e639d27567c84c3a675aba0"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.026639 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kwg7w" event={"ID":"f3db03b1-50a8-456c-ab19-da73753636f1","Type":"ContainerStarted","Data":"cda6aa5b8922a2b51912ddd956b298f5bd6958796fe215108cb827f2222f4b7d"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.026878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kwg7w" event={"ID":"f3db03b1-50a8-456c-ab19-da73753636f1","Type":"ContainerStarted","Data":"6b9254265e3b68fe9bb025d8ef4eec1d05c69808862c01ef000da9f46d8769aa"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.036976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" event={"ID":"256df24b-b409-4b1f-bdbc-c59ad89f9301","Type":"ContainerStarted","Data":"d6300bb2e2eb0505522c7aa5671d2a66dc595e440c74ba6e91b368f119db8fe4"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.037037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" event={"ID":"256df24b-b409-4b1f-bdbc-c59ad89f9301","Type":"ContainerStarted","Data":"8074bd7859db316b6554d6118abc9981c2ef37aa4729c137373b4023bc052359"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.046124 4769 generic.go:334] "Generic (PLEG): container finished" podID="40ae7ab9-9999-4b6b-89cf-c56f1e754286" containerID="d24d649ccac573f83a591e821ccf09e480e27c660238e2aad558cb5943d8d796" exitCode=0 Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.046280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" event={"ID":"40ae7ab9-9999-4b6b-89cf-c56f1e754286","Type":"ContainerDied","Data":"d24d649ccac573f83a591e821ccf09e480e27c660238e2aad558cb5943d8d796"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.046524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" event={"ID":"40ae7ab9-9999-4b6b-89cf-c56f1e754286","Type":"ContainerStarted","Data":"eb94d4c3c0e385dd494ca216d3d238293f4d199e5d1101a21edc507acfed2fbf"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.051210 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"bf3e347f273318f3f15293a4356f84a0f9bd2b4ea8727e9573419550831b6187"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.051252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"f019d8be557db1f153e7892c0c39a99b8e0635ac7c28aee437df1446567c404b"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.051263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"d1736126e212f704b9dcc82d66b40efb5e3118ee96e7a763c8984cd0c86fcd21"} Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.056078 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-kwg7w" podStartSLOduration=2.056056948 podStartE2EDuration="2.056056948s" podCreationTimestamp="2025-11-21 12:30:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:52.05139421 +0000 UTC m=+2410.752056028" watchObservedRunningTime="2025-11-21 12:30:52.056056948 +0000 UTC m=+2410.756718766" Nov 21 12:30:52 crc kubenswrapper[4769]: I1121 12:30:52.102625 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" podStartSLOduration=2.10260484 podStartE2EDuration="2.10260484s" podCreationTimestamp="2025-11-21 12:30:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:52.066757693 +0000 UTC m=+2410.767419511" watchObservedRunningTime="2025-11-21 12:30:52.10260484 +0000 UTC m=+2410.803266648" Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.068449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"a1b5bd570677920c74854244cfd7f9e8c70a41a3b6778e18c7d5edb92e8865d1"} Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.068886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"8b1ce8572f04445a01bb6068185ac94889800baa108b2dd6e928e82a227a7c85"} Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.068903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"e353e45d3f55e0d1979aad889a57f00db327e26732a94b9699b9e72bc65fc225"} Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.074517 4769 generic.go:334] "Generic (PLEG): container finished" podID="851d6f07-b264-4db7-a1fb-aba1af1d7c3e" containerID="1ea22ff91bda57d75d9c8215340e8636118db71b96028f0f91591643e82a2e88" exitCode=0 Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.074592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" event={"ID":"851d6f07-b264-4db7-a1fb-aba1af1d7c3e","Type":"ContainerDied","Data":"1ea22ff91bda57d75d9c8215340e8636118db71b96028f0f91591643e82a2e88"} Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.081444 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3db03b1-50a8-456c-ab19-da73753636f1" containerID="cda6aa5b8922a2b51912ddd956b298f5bd6958796fe215108cb827f2222f4b7d" exitCode=0 Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.081551 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kwg7w" event={"ID":"f3db03b1-50a8-456c-ab19-da73753636f1","Type":"ContainerDied","Data":"cda6aa5b8922a2b51912ddd956b298f5bd6958796fe215108cb827f2222f4b7d"} Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.083456 4769 generic.go:334] "Generic (PLEG): container finished" podID="256df24b-b409-4b1f-bdbc-c59ad89f9301" containerID="d6300bb2e2eb0505522c7aa5671d2a66dc595e440c74ba6e91b368f119db8fe4" exitCode=0 Nov 21 12:30:53 crc kubenswrapper[4769]: I1121 12:30:53.083648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" event={"ID":"256df24b-b409-4b1f-bdbc-c59ad89f9301","Type":"ContainerDied","Data":"d6300bb2e2eb0505522c7aa5671d2a66dc595e440c74ba6e91b368f119db8fe4"} Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.648169 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.656603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.684033 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.705737 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.709995 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.721826 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5smt\" (UniqueName: \"kubernetes.io/projected/40ae7ab9-9999-4b6b-89cf-c56f1e754286-kube-api-access-n5smt\") pod \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5mwj\" (UniqueName: \"kubernetes.io/projected/0891c356-7943-4b14-bd0a-9af8473a7c4e-kube-api-access-q5mwj\") pod \"0891c356-7943-4b14-bd0a-9af8473a7c4e\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-operator-scripts\") pod \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm7cx\" (UniqueName: \"kubernetes.io/projected/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-kube-api-access-dm7cx\") pod \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\" (UID: \"851d6f07-b264-4db7-a1fb-aba1af1d7c3e\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/256df24b-b409-4b1f-bdbc-c59ad89f9301-operator-scripts\") pod \"256df24b-b409-4b1f-bdbc-c59ad89f9301\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/f3db03b1-50a8-456c-ab19-da73753636f1-kube-api-access-b94sq\") pod \"f3db03b1-50a8-456c-ab19-da73753636f1\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzcxk\" (UniqueName: \"kubernetes.io/projected/348a3e48-6cdf-4439-9065-5c5d4b431c24-kube-api-access-pzcxk\") pod \"348a3e48-6cdf-4439-9065-5c5d4b431c24\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776895 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0891c356-7943-4b14-bd0a-9af8473a7c4e-operator-scripts\") pod \"0891c356-7943-4b14-bd0a-9af8473a7c4e\" (UID: \"0891c356-7943-4b14-bd0a-9af8473a7c4e\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/348a3e48-6cdf-4439-9065-5c5d4b431c24-operator-scripts\") pod \"348a3e48-6cdf-4439-9065-5c5d4b431c24\" (UID: \"348a3e48-6cdf-4439-9065-5c5d4b431c24\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.776992 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdzf7\" (UniqueName: \"kubernetes.io/projected/256df24b-b409-4b1f-bdbc-c59ad89f9301-kube-api-access-wdzf7\") pod \"256df24b-b409-4b1f-bdbc-c59ad89f9301\" (UID: \"256df24b-b409-4b1f-bdbc-c59ad89f9301\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.777037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40ae7ab9-9999-4b6b-89cf-c56f1e754286-operator-scripts\") pod \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\" (UID: \"40ae7ab9-9999-4b6b-89cf-c56f1e754286\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.777060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3db03b1-50a8-456c-ab19-da73753636f1-operator-scripts\") pod \"f3db03b1-50a8-456c-ab19-da73753636f1\" (UID: \"f3db03b1-50a8-456c-ab19-da73753636f1\") " Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.777421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "851d6f07-b264-4db7-a1fb-aba1af1d7c3e" (UID: "851d6f07-b264-4db7-a1fb-aba1af1d7c3e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.778519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0891c356-7943-4b14-bd0a-9af8473a7c4e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0891c356-7943-4b14-bd0a-9af8473a7c4e" (UID: "0891c356-7943-4b14-bd0a-9af8473a7c4e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.778583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/256df24b-b409-4b1f-bdbc-c59ad89f9301-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "256df24b-b409-4b1f-bdbc-c59ad89f9301" (UID: "256df24b-b409-4b1f-bdbc-c59ad89f9301"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.778868 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ae7ab9-9999-4b6b-89cf-c56f1e754286-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "40ae7ab9-9999-4b6b-89cf-c56f1e754286" (UID: "40ae7ab9-9999-4b6b-89cf-c56f1e754286"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.778878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3db03b1-50a8-456c-ab19-da73753636f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f3db03b1-50a8-456c-ab19-da73753636f1" (UID: "f3db03b1-50a8-456c-ab19-da73753636f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.779001 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348a3e48-6cdf-4439-9065-5c5d4b431c24-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "348a3e48-6cdf-4439-9065-5c5d4b431c24" (UID: "348a3e48-6cdf-4439-9065-5c5d4b431c24"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.783946 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ae7ab9-9999-4b6b-89cf-c56f1e754286-kube-api-access-n5smt" (OuterVolumeSpecName: "kube-api-access-n5smt") pod "40ae7ab9-9999-4b6b-89cf-c56f1e754286" (UID: "40ae7ab9-9999-4b6b-89cf-c56f1e754286"). InnerVolumeSpecName "kube-api-access-n5smt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.786590 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348a3e48-6cdf-4439-9065-5c5d4b431c24-kube-api-access-pzcxk" (OuterVolumeSpecName: "kube-api-access-pzcxk") pod "348a3e48-6cdf-4439-9065-5c5d4b431c24" (UID: "348a3e48-6cdf-4439-9065-5c5d4b431c24"). InnerVolumeSpecName "kube-api-access-pzcxk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.786745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0891c356-7943-4b14-bd0a-9af8473a7c4e-kube-api-access-q5mwj" (OuterVolumeSpecName: "kube-api-access-q5mwj") pod "0891c356-7943-4b14-bd0a-9af8473a7c4e" (UID: "0891c356-7943-4b14-bd0a-9af8473a7c4e"). InnerVolumeSpecName "kube-api-access-q5mwj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.788366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-kube-api-access-dm7cx" (OuterVolumeSpecName: "kube-api-access-dm7cx") pod "851d6f07-b264-4db7-a1fb-aba1af1d7c3e" (UID: "851d6f07-b264-4db7-a1fb-aba1af1d7c3e"). InnerVolumeSpecName "kube-api-access-dm7cx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.788798 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256df24b-b409-4b1f-bdbc-c59ad89f9301-kube-api-access-wdzf7" (OuterVolumeSpecName: "kube-api-access-wdzf7") pod "256df24b-b409-4b1f-bdbc-c59ad89f9301" (UID: "256df24b-b409-4b1f-bdbc-c59ad89f9301"). InnerVolumeSpecName "kube-api-access-wdzf7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.805281 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3db03b1-50a8-456c-ab19-da73753636f1-kube-api-access-b94sq" (OuterVolumeSpecName: "kube-api-access-b94sq") pod "f3db03b1-50a8-456c-ab19-da73753636f1" (UID: "f3db03b1-50a8-456c-ab19-da73753636f1"). InnerVolumeSpecName "kube-api-access-b94sq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879221 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q5mwj\" (UniqueName: \"kubernetes.io/projected/0891c356-7943-4b14-bd0a-9af8473a7c4e-kube-api-access-q5mwj\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879270 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879332 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dm7cx\" (UniqueName: \"kubernetes.io/projected/851d6f07-b264-4db7-a1fb-aba1af1d7c3e-kube-api-access-dm7cx\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879345 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/256df24b-b409-4b1f-bdbc-c59ad89f9301-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879358 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b94sq\" (UniqueName: \"kubernetes.io/projected/f3db03b1-50a8-456c-ab19-da73753636f1-kube-api-access-b94sq\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879373 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pzcxk\" (UniqueName: \"kubernetes.io/projected/348a3e48-6cdf-4439-9065-5c5d4b431c24-kube-api-access-pzcxk\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879406 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0891c356-7943-4b14-bd0a-9af8473a7c4e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879415 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/348a3e48-6cdf-4439-9065-5c5d4b431c24-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879425 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wdzf7\" (UniqueName: \"kubernetes.io/projected/256df24b-b409-4b1f-bdbc-c59ad89f9301-kube-api-access-wdzf7\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879434 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/40ae7ab9-9999-4b6b-89cf-c56f1e754286-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879443 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3db03b1-50a8-456c-ab19-da73753636f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:54 crc kubenswrapper[4769]: I1121 12:30:54.879451 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n5smt\" (UniqueName: \"kubernetes.io/projected/40ae7ab9-9999-4b6b-89cf-c56f1e754286-kube-api-access-n5smt\") on node \"crc\" DevicePath \"\"" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.123858 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kwg7w" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.123868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kwg7w" event={"ID":"f3db03b1-50a8-456c-ab19-da73753636f1","Type":"ContainerDied","Data":"6b9254265e3b68fe9bb025d8ef4eec1d05c69808862c01ef000da9f46d8769aa"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.123964 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b9254265e3b68fe9bb025d8ef4eec1d05c69808862c01ef000da9f46d8769aa" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.125548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" event={"ID":"256df24b-b409-4b1f-bdbc-c59ad89f9301","Type":"ContainerDied","Data":"8074bd7859db316b6554d6118abc9981c2ef37aa4729c137373b4023bc052359"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.125622 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8074bd7859db316b6554d6118abc9981c2ef37aa4729c137373b4023bc052359" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.125723 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-ff8c-account-create-xkhsd" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.130264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" event={"ID":"40ae7ab9-9999-4b6b-89cf-c56f1e754286","Type":"ContainerDied","Data":"eb94d4c3c0e385dd494ca216d3d238293f4d199e5d1101a21edc507acfed2fbf"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.130317 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb94d4c3c0e385dd494ca216d3d238293f4d199e5d1101a21edc507acfed2fbf" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.130391 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5p2qv" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.145461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"3e3476c9a96cb0b50309aeb5f761175f6ebf06724b11037154f42ebfe53afd6f"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.152135 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-r4ngx" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.152149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-r4ngx" event={"ID":"0891c356-7943-4b14-bd0a-9af8473a7c4e","Type":"ContainerDied","Data":"0deeb4b64b566fa19373f96ac275072bcbfe65221e9991e695768f45b23b62e5"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.152217 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0deeb4b64b566fa19373f96ac275072bcbfe65221e9991e695768f45b23b62e5" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.155386 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.155440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8c07-account-create-nndrx" event={"ID":"348a3e48-6cdf-4439-9065-5c5d4b431c24","Type":"ContainerDied","Data":"ab8b8f6b9baaa672ec24e40d948f7544741e207bb275958788e4fe2822c69198"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.155476 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab8b8f6b9baaa672ec24e40d948f7544741e207bb275958788e4fe2822c69198" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.157391 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.157377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-042f-account-create-d6wlb" event={"ID":"851d6f07-b264-4db7-a1fb-aba1af1d7c3e","Type":"ContainerDied","Data":"39ec57f4755043ddf13eae83caa6fb550567a4620e639d27567c84c3a675aba0"} Nov 21 12:30:55 crc kubenswrapper[4769]: I1121 12:30:55.157794 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39ec57f4755043ddf13eae83caa6fb550567a4620e639d27567c84c3a675aba0" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.083707 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zz4kt"] Nov 21 12:30:56 crc kubenswrapper[4769]: E1121 12:30:56.084320 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="348a3e48-6cdf-4439-9065-5c5d4b431c24" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084334 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="348a3e48-6cdf-4439-9065-5c5d4b431c24" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: E1121 12:30:56.084349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="256df24b-b409-4b1f-bdbc-c59ad89f9301" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="256df24b-b409-4b1f-bdbc-c59ad89f9301" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: E1121 12:30:56.084364 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40ae7ab9-9999-4b6b-89cf-c56f1e754286" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084371 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ae7ab9-9999-4b6b-89cf-c56f1e754286" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: E1121 12:30:56.084383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="851d6f07-b264-4db7-a1fb-aba1af1d7c3e" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="851d6f07-b264-4db7-a1fb-aba1af1d7c3e" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: E1121 12:30:56.084401 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0891c356-7943-4b14-bd0a-9af8473a7c4e" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0891c356-7943-4b14-bd0a-9af8473a7c4e" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: E1121 12:30:56.084421 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3db03b1-50a8-456c-ab19-da73753636f1" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3db03b1-50a8-456c-ab19-da73753636f1" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084587 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="348a3e48-6cdf-4439-9065-5c5d4b431c24" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084598 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="256df24b-b409-4b1f-bdbc-c59ad89f9301" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084610 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0891c356-7943-4b14-bd0a-9af8473a7c4e" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084617 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3db03b1-50a8-456c-ab19-da73753636f1" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084629 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="851d6f07-b264-4db7-a1fb-aba1af1d7c3e" containerName="mariadb-account-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.084649 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="40ae7ab9-9999-4b6b-89cf-c56f1e754286" containerName="mariadb-database-create" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.085352 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.088792 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-g52pz" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.091405 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.115399 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zz4kt"] Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.168144 4769 generic.go:334] "Generic (PLEG): container finished" podID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerID="c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345" exitCode=0 Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.168256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"f24e626c-11ec-4d3d-a065-822b13a8b8b0","Type":"ContainerDied","Data":"c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345"} Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.172530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"9741de62dc82c24266d38705c08765ede152139885bfd61fc0ff6146c633735d"} Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.204826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-combined-ca-bundle\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.204884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-db-sync-config-data\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.204928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-config-data\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.205156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7fb\" (UniqueName: \"kubernetes.io/projected/1615b03e-2fa0-49c1-a20d-eefe57a232b0-kube-api-access-4s7fb\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.306519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7fb\" (UniqueName: \"kubernetes.io/projected/1615b03e-2fa0-49c1-a20d-eefe57a232b0-kube-api-access-4s7fb\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.306775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-db-sync-config-data\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.306810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-combined-ca-bundle\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.306853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-config-data\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.312352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-db-sync-config-data\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.313427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-config-data\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.313889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-combined-ca-bundle\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.330762 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7fb\" (UniqueName: \"kubernetes.io/projected/1615b03e-2fa0-49c1-a20d-eefe57a232b0-kube-api-access-4s7fb\") pod \"glance-db-sync-zz4kt\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:56 crc kubenswrapper[4769]: I1121 12:30:56.411149 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.060177 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zz4kt"] Nov 21 12:30:57 crc kubenswrapper[4769]: W1121 12:30:57.065730 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1615b03e_2fa0_49c1_a20d_eefe57a232b0.slice/crio-d78113734e6746a4807d17a2447115b072d8624a561da869c1617e9fb8ca3181 WatchSource:0}: Error finding container d78113734e6746a4807d17a2447115b072d8624a561da869c1617e9fb8ca3181: Status 404 returned error can't find the container with id d78113734e6746a4807d17a2447115b072d8624a561da869c1617e9fb8ca3181 Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.188761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerStarted","Data":"ce4e65f959b39458230792d295acf0247e652fe7c6716c814417c99e1b0d5da2"} Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.194945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"1e9eff96dd33dea6fa47a37fdf9fe9785540857c58102274e00a7269903a47f4"} Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.195007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"f4bf3535ace846275d7269ea413b90e506b094a2ee67414f26edee0c83e47a40"} Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.203985 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"f24e626c-11ec-4d3d-a065-822b13a8b8b0","Type":"ContainerStarted","Data":"cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87"} Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.204917 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.207129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" event={"ID":"1615b03e-2fa0-49c1-a20d-eefe57a232b0","Type":"ContainerStarted","Data":"d78113734e6746a4807d17a2447115b072d8624a561da869c1617e9fb8ca3181"} Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.258522 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podStartSLOduration=2.583787965 podStartE2EDuration="32.25850233s" podCreationTimestamp="2025-11-21 12:30:25 +0000 UTC" firstStartedPulling="2025-11-21 12:30:26.927327953 +0000 UTC m=+2385.627989771" lastFinishedPulling="2025-11-21 12:30:56.602042318 +0000 UTC m=+2415.302704136" observedRunningTime="2025-11-21 12:30:57.227740893 +0000 UTC m=+2415.928402711" watchObservedRunningTime="2025-11-21 12:30:57.25850233 +0000 UTC m=+2415.959164148" Nov 21 12:30:57 crc kubenswrapper[4769]: I1121 12:30:57.259226 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=49.25922166 podStartE2EDuration="49.25922166s" podCreationTimestamp="2025-11-21 12:30:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:57.257277656 +0000 UTC m=+2415.957939484" watchObservedRunningTime="2025-11-21 12:30:57.25922166 +0000 UTC m=+2415.959883478" Nov 21 12:30:58 crc kubenswrapper[4769]: I1121 12:30:58.226297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" event={"ID":"1615b03e-2fa0-49c1-a20d-eefe57a232b0","Type":"ContainerStarted","Data":"473ed8b231a80e79799f77429f3c447797d75080f62f6b8f89efdd777757efa7"} Nov 21 12:30:58 crc kubenswrapper[4769]: I1121 12:30:58.241530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"3dc658ddd734c741c356918a825b1583cd250f9273845f9bd38a3c742c4d85a8"} Nov 21 12:30:58 crc kubenswrapper[4769]: I1121 12:30:58.241594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"2d10be3132dcf1cd9fa4028e5cb2d86dbfaadf86cc548f90ee41bb79d24ed971"} Nov 21 12:30:58 crc kubenswrapper[4769]: I1121 12:30:58.241610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"666e126b826f5c1d1979e541c9388be5da81dcbcc8cd779ec1496db988e7e9d6"} Nov 21 12:30:58 crc kubenswrapper[4769]: I1121 12:30:58.241621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"09c152a70de95d408fa2d1e62bd295e12eff93b04fda5707e6d786bbce57fa01"} Nov 21 12:30:59 crc kubenswrapper[4769]: I1121 12:30:59.262256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"a11d6914dac88a945153d4101f699a1126b4a1c0cfa9384233ff13589a6af179"} Nov 21 12:30:59 crc kubenswrapper[4769]: I1121 12:30:59.990979 4769 scope.go:117] "RemoveContainer" containerID="95182d9f59156008afc913d892e2c89711121f2f773dbd5b591568f6353df43f" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.036929 4769 scope.go:117] "RemoveContainer" containerID="fc213c3113290e183989f2c397c80e29407464b8b8ca867dc9a187fd5b4b132e" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.101293 4769 scope.go:117] "RemoveContainer" containerID="b561d78b1aab93c805dec672e918401150426bffbf2915c7d48f124611afdd4c" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.170072 4769 scope.go:117] "RemoveContainer" containerID="6edf7cd6d8163b95694ee40e477a96ba17df549016a69f8de6bdc6969ef4ad5c" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.207667 4769 scope.go:117] "RemoveContainer" containerID="2862fbf1d81d9c94b8306e4fdc83e9c8840f95b448a22ed370e61b6cf176a080" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.277395 4769 scope.go:117] "RemoveContainer" containerID="25070b5e073722fbf768807336bc4bfa2ca583acd8fcb2aa476ec1d03a2ec1b6" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.293863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerStarted","Data":"f403be3ce48985d69538737b6ffdcfbd0673bc116d4f3185b44449310fda1ccd"} Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.342100 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" podStartSLOduration=4.34208017 podStartE2EDuration="4.34208017s" podCreationTimestamp="2025-11-21 12:30:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:30:58.244527724 +0000 UTC m=+2416.945189542" watchObservedRunningTime="2025-11-21 12:31:00.34208017 +0000 UTC m=+2419.042741988" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.346658 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=27.346643856 podStartE2EDuration="27.346643856s" podCreationTimestamp="2025-11-21 12:30:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:00.33264903 +0000 UTC m=+2419.033310858" watchObservedRunningTime="2025-11-21 12:31:00.346643856 +0000 UTC m=+2419.047305674" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.357297 4769 scope.go:117] "RemoveContainer" containerID="82cf8ac697c2dd03cd5196fdcd7201367da1f166c6845f22c5601d6f73e813c4" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.426786 4769 scope.go:117] "RemoveContainer" containerID="0cb566ad4e1ab22eed7e52334b7e0140609a46bb3f45b388336ac5cd505b8c5f" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.481813 4769 scope.go:117] "RemoveContainer" containerID="b8cc559f97e9e0be10200b60cefd630c95e22527edbcc750d2fe49e376034217" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.507744 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r"] Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.510157 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.512927 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.535545 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r"] Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.552027 4769 scope.go:117] "RemoveContainer" containerID="36fdda48a0bf0cf959b56cc1bc51d44486ecfa17f6523a893a2dce8343b88366" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.588258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.588317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96x4d\" (UniqueName: \"kubernetes.io/projected/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-kube-api-access-96x4d\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.588359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.588395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-config\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.595983 4769 scope.go:117] "RemoveContainer" containerID="b4f644d7042f7e2c9bd09706639a3260fcb01bb35d3ae247a5239cf5cecd5dfd" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.690280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.690333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-96x4d\" (UniqueName: \"kubernetes.io/projected/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-kube-api-access-96x4d\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.690361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.690743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-config\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.691250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.691548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-config\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.691945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.711226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-96x4d\" (UniqueName: \"kubernetes.io/projected/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-kube-api-access-96x4d\") pod \"dnsmasq-dnsmasq-7799499c75-q9p8r\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.719106 4769 scope.go:117] "RemoveContainer" containerID="a546c811f7df0e8503de989e9d47a22546f89b5f747037b4247c6b6633765d4c" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.750224 4769 scope.go:117] "RemoveContainer" containerID="4c1271d87070a5329e5ff71497e2f2894121ffab73d18121bfbedfe5a46a6e1e" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.800010 4769 scope.go:117] "RemoveContainer" containerID="d4c049ade199c20b955929d81273a1206543d1315fb32842937b919f7b36dd9f" Nov 21 12:31:00 crc kubenswrapper[4769]: I1121 12:31:00.837035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.035757 4769 scope.go:117] "RemoveContainer" containerID="6e9233d0d36532ed6babf4e3fe833c27b09452a5e4d90ea9c5019df5992ffe5b" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.072897 4769 scope.go:117] "RemoveContainer" containerID="0f422fe72f0ad13db20aa02d62438969f537702b7f29e196efe373cd9b9fc00c" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.119890 4769 scope.go:117] "RemoveContainer" containerID="148b56c4580bf9a268839c59f7508ebe16fa4ffb30397c9a41672d5d16b3a0f4" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.192932 4769 scope.go:117] "RemoveContainer" containerID="fb16a4a291827afdd973408f298978029b8b5147fa9c999a7f9071f4e72c36aa" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.297537 4769 scope.go:117] "RemoveContainer" containerID="15774f550067dcb7af5418d497178549b67d1627c8e35ca80a508d9bb90e4de7" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.436537 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.496875 4769 scope.go:117] "RemoveContainer" containerID="4d634d8f466ec06243f15d95cd862aa33c18eba6b4a607bc78287d5c530e7477" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.560849 4769 scope.go:117] "RemoveContainer" containerID="a9ae22ffd24de7390c9cc9842daaefa370b05b064ec18dbfa6ccfd268a7e3ab7" Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.574259 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r"] Nov 21 12:31:01 crc kubenswrapper[4769]: I1121 12:31:01.610974 4769 scope.go:117] "RemoveContainer" containerID="4e0c4f70f88b25f91de352936f7ffec905e7e180958830789350cd922f5f93fd" Nov 21 12:31:02 crc kubenswrapper[4769]: I1121 12:31:02.273863 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:31:02 crc kubenswrapper[4769]: E1121 12:31:02.274700 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:31:02 crc kubenswrapper[4769]: I1121 12:31:02.460079 4769 generic.go:334] "Generic (PLEG): container finished" podID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerID="0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc" exitCode=0 Nov 21 12:31:02 crc kubenswrapper[4769]: I1121 12:31:02.460133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" event={"ID":"a1fe319d-547f-4eae-a3cb-3f7f47f8af29","Type":"ContainerDied","Data":"0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc"} Nov 21 12:31:02 crc kubenswrapper[4769]: I1121 12:31:02.460165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" event={"ID":"a1fe319d-547f-4eae-a3cb-3f7f47f8af29","Type":"ContainerStarted","Data":"c0b0ebad97f7323a0d9a4339fb599713fb683980609ddf8f463b29f1e1bde80a"} Nov 21 12:31:03 crc kubenswrapper[4769]: I1121 12:31:03.473410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" event={"ID":"a1fe319d-547f-4eae-a3cb-3f7f47f8af29","Type":"ContainerStarted","Data":"e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9"} Nov 21 12:31:03 crc kubenswrapper[4769]: I1121 12:31:03.473852 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:03 crc kubenswrapper[4769]: I1121 12:31:03.492444 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" podStartSLOduration=3.492426088 podStartE2EDuration="3.492426088s" podCreationTimestamp="2025-11-21 12:31:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:03.488845089 +0000 UTC m=+2422.189506927" watchObservedRunningTime="2025-11-21 12:31:03.492426088 +0000 UTC m=+2422.193087906" Nov 21 12:31:08 crc kubenswrapper[4769]: I1121 12:31:08.533112 4769 generic.go:334] "Generic (PLEG): container finished" podID="1615b03e-2fa0-49c1-a20d-eefe57a232b0" containerID="473ed8b231a80e79799f77429f3c447797d75080f62f6b8f89efdd777757efa7" exitCode=0 Nov 21 12:31:08 crc kubenswrapper[4769]: I1121 12:31:08.533399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" event={"ID":"1615b03e-2fa0-49c1-a20d-eefe57a232b0","Type":"ContainerDied","Data":"473ed8b231a80e79799f77429f3c447797d75080f62f6b8f89efdd777757efa7"} Nov 21 12:31:09 crc kubenswrapper[4769]: I1121 12:31:09.746467 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:31:09 crc kubenswrapper[4769]: I1121 12:31:09.903619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.078758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s7fb\" (UniqueName: \"kubernetes.io/projected/1615b03e-2fa0-49c1-a20d-eefe57a232b0-kube-api-access-4s7fb\") pod \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.079157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-db-sync-config-data\") pod \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.079403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-config-data\") pod \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.079569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-combined-ca-bundle\") pod \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\" (UID: \"1615b03e-2fa0-49c1-a20d-eefe57a232b0\") " Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.089541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1615b03e-2fa0-49c1-a20d-eefe57a232b0-kube-api-access-4s7fb" (OuterVolumeSpecName: "kube-api-access-4s7fb") pod "1615b03e-2fa0-49c1-a20d-eefe57a232b0" (UID: "1615b03e-2fa0-49c1-a20d-eefe57a232b0"). InnerVolumeSpecName "kube-api-access-4s7fb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.106547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "1615b03e-2fa0-49c1-a20d-eefe57a232b0" (UID: "1615b03e-2fa0-49c1-a20d-eefe57a232b0"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.155427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-config-data" (OuterVolumeSpecName: "config-data") pod "1615b03e-2fa0-49c1-a20d-eefe57a232b0" (UID: "1615b03e-2fa0-49c1-a20d-eefe57a232b0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.161670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1615b03e-2fa0-49c1-a20d-eefe57a232b0" (UID: "1615b03e-2fa0-49c1-a20d-eefe57a232b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.182108 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.182157 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.182167 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1615b03e-2fa0-49c1-a20d-eefe57a232b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.182178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4s7fb\" (UniqueName: \"kubernetes.io/projected/1615b03e-2fa0-49c1-a20d-eefe57a232b0-kube-api-access-4s7fb\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.216536 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-nkrnv"] Nov 21 12:31:10 crc kubenswrapper[4769]: E1121 12:31:10.217125 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1615b03e-2fa0-49c1-a20d-eefe57a232b0" containerName="glance-db-sync" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.217146 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1615b03e-2fa0-49c1-a20d-eefe57a232b0" containerName="glance-db-sync" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.217354 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1615b03e-2fa0-49c1-a20d-eefe57a232b0" containerName="glance-db-sync" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.218170 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.229511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-nkrnv"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.248151 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-gskxj"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.249698 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.264799 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-watcher-dockercfg-4vjml" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.264948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-config-data" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.305268 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-gskxj"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.386706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckdm\" (UniqueName: \"kubernetes.io/projected/d46a9281-82de-4242-b23c-91b71b14fe20-kube-api-access-gckdm\") pod \"cinder-db-create-nkrnv\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.386759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d46a9281-82de-4242-b23c-91b71b14fe20-operator-scripts\") pod \"cinder-db-create-nkrnv\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.386804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-db-sync-config-data\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.386855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-combined-ca-bundle\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.386885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d25h7\" (UniqueName: \"kubernetes.io/projected/8ddf7893-be82-4597-9e80-a652e9daedc1-kube-api-access-d25h7\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.386903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-config-data\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.392344 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4dd9c"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.401792 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.404657 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4dd9c"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.436589 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.437711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.448647 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.494800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gckdm\" (UniqueName: \"kubernetes.io/projected/d46a9281-82de-4242-b23c-91b71b14fe20-kube-api-access-gckdm\") pod \"cinder-db-create-nkrnv\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.494856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d46a9281-82de-4242-b23c-91b71b14fe20-operator-scripts\") pod \"cinder-db-create-nkrnv\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.494899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-db-sync-config-data\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.494939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-combined-ca-bundle\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.494969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d25h7\" (UniqueName: \"kubernetes.io/projected/8ddf7893-be82-4597-9e80-a652e9daedc1-kube-api-access-d25h7\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.494990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-config-data\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.503425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-db-sync-config-data\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.504025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d46a9281-82de-4242-b23c-91b71b14fe20-operator-scripts\") pod \"cinder-db-create-nkrnv\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.513061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-combined-ca-bundle\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.518027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-config-data\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.518136 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.537908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckdm\" (UniqueName: \"kubernetes.io/projected/d46a9281-82de-4242-b23c-91b71b14fe20-kube-api-access-gckdm\") pod \"cinder-db-create-nkrnv\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.543279 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-lwctk"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.544852 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.547651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.557546 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.563739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d25h7\" (UniqueName: \"kubernetes.io/projected/8ddf7893-be82-4597-9e80-a652e9daedc1-kube-api-access-d25h7\") pod \"watcher-db-sync-gskxj\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.568919 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w45kf" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.569122 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.569253 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.583527 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-lwctk"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.597523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z948\" (UniqueName: \"kubernetes.io/projected/c102ea71-dfba-4c00-bb61-3b55554a237f-kube-api-access-4z948\") pod \"barbican-e5ba-account-create-vtsrt\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.597585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5f6836-a88c-4d4c-a151-a75156de76ab-operator-scripts\") pod \"barbican-db-create-4dd9c\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.597650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c102ea71-dfba-4c00-bb61-3b55554a237f-operator-scripts\") pod \"barbican-e5ba-account-create-vtsrt\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.597695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g68p9\" (UniqueName: \"kubernetes.io/projected/4b5f6836-a88c-4d4c-a151-a75156de76ab-kube-api-access-g68p9\") pod \"barbican-db-create-4dd9c\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.600050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.641466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" event={"ID":"1615b03e-2fa0-49c1-a20d-eefe57a232b0","Type":"ContainerDied","Data":"d78113734e6746a4807d17a2447115b072d8624a561da869c1617e9fb8ca3181"} Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.641516 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d78113734e6746a4807d17a2447115b072d8624a561da869c1617e9fb8ca3181" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.641619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-zz4kt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-combined-ca-bundle\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711074 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g68p9\" (UniqueName: \"kubernetes.io/projected/4b5f6836-a88c-4d4c-a151-a75156de76ab-kube-api-access-g68p9\") pod \"barbican-db-create-4dd9c\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-config-data\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4z948\" (UniqueName: \"kubernetes.io/projected/c102ea71-dfba-4c00-bb61-3b55554a237f-kube-api-access-4z948\") pod \"barbican-e5ba-account-create-vtsrt\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8pbs\" (UniqueName: \"kubernetes.io/projected/459c1719-c33c-43bf-b657-89563a5e0f04-kube-api-access-t8pbs\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5f6836-a88c-4d4c-a151-a75156de76ab-operator-scripts\") pod \"barbican-db-create-4dd9c\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.711352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c102ea71-dfba-4c00-bb61-3b55554a237f-operator-scripts\") pod \"barbican-e5ba-account-create-vtsrt\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.712132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c102ea71-dfba-4c00-bb61-3b55554a237f-operator-scripts\") pod \"barbican-e5ba-account-create-vtsrt\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.713829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5f6836-a88c-4d4c-a151-a75156de76ab-operator-scripts\") pod \"barbican-db-create-4dd9c\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.717265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-8099-account-create-62dl6"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.718966 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.728768 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-8099-account-create-62dl6"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.733255 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.733925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z948\" (UniqueName: \"kubernetes.io/projected/c102ea71-dfba-4c00-bb61-3b55554a237f-kube-api-access-4z948\") pod \"barbican-e5ba-account-create-vtsrt\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.741113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g68p9\" (UniqueName: \"kubernetes.io/projected/4b5f6836-a88c-4d4c-a151-a75156de76ab-kube-api-access-g68p9\") pod \"barbican-db-create-4dd9c\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.781258 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mkmhc"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.782426 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.794211 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mkmhc"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.812341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-operator-scripts\") pod \"cinder-8099-account-create-62dl6\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.812386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-combined-ca-bundle\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.812435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-config-data\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.812475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d844j\" (UniqueName: \"kubernetes.io/projected/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-kube-api-access-d844j\") pod \"cinder-8099-account-create-62dl6\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.812511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t8pbs\" (UniqueName: \"kubernetes.io/projected/459c1719-c33c-43bf-b657-89563a5e0f04-kube-api-access-t8pbs\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.822125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-config-data\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.832043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-combined-ca-bundle\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.847668 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.860386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8pbs\" (UniqueName: \"kubernetes.io/projected/459c1719-c33c-43bf-b657-89563a5e0f04-kube-api-access-t8pbs\") pod \"keystone-db-sync-lwctk\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.860456 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-f206-account-create-2859j"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.861622 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.865643 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.882246 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-f206-account-create-2859j"] Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.920939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d844j\" (UniqueName: \"kubernetes.io/projected/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-kube-api-access-d844j\") pod \"cinder-8099-account-create-62dl6\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.921041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11b4b628-5c45-47af-97a8-e82c3054ce2b-operator-scripts\") pod \"neutron-db-create-mkmhc\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.921116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tp2m\" (UniqueName: \"kubernetes.io/projected/11b4b628-5c45-47af-97a8-e82c3054ce2b-kube-api-access-6tp2m\") pod \"neutron-db-create-mkmhc\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.921139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-operator-scripts\") pod \"cinder-8099-account-create-62dl6\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.921843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-operator-scripts\") pod \"cinder-8099-account-create-62dl6\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.960149 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:10 crc kubenswrapper[4769]: I1121 12:31:10.969977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d844j\" (UniqueName: \"kubernetes.io/projected/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-kube-api-access-d844j\") pod \"cinder-8099-account-create-62dl6\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.015569 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9"] Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.015823 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="dnsmasq-dns" containerID="cri-o://ae5e60e6cf5ad085eb4767c47ef3d44ce3fe82796b7f1fe064bc3fa0f799367f" gracePeriod=10 Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.022148 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.023973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01e03f6e-00b3-4016-a00e-e0be1ad78b23-operator-scripts\") pod \"neutron-f206-account-create-2859j\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.024002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjxwz\" (UniqueName: \"kubernetes.io/projected/01e03f6e-00b3-4016-a00e-e0be1ad78b23-kube-api-access-fjxwz\") pod \"neutron-f206-account-create-2859j\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.024035 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11b4b628-5c45-47af-97a8-e82c3054ce2b-operator-scripts\") pod \"neutron-db-create-mkmhc\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.024109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6tp2m\" (UniqueName: \"kubernetes.io/projected/11b4b628-5c45-47af-97a8-e82c3054ce2b-kube-api-access-6tp2m\") pod \"neutron-db-create-mkmhc\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.039410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11b4b628-5c45-47af-97a8-e82c3054ce2b-operator-scripts\") pod \"neutron-db-create-mkmhc\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.041810 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.064568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tp2m\" (UniqueName: \"kubernetes.io/projected/11b4b628-5c45-47af-97a8-e82c3054ce2b-kube-api-access-6tp2m\") pod \"neutron-db-create-mkmhc\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.067630 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.116695 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.127182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01e03f6e-00b3-4016-a00e-e0be1ad78b23-operator-scripts\") pod \"neutron-f206-account-create-2859j\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.127243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fjxwz\" (UniqueName: \"kubernetes.io/projected/01e03f6e-00b3-4016-a00e-e0be1ad78b23-kube-api-access-fjxwz\") pod \"neutron-f206-account-create-2859j\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.128858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01e03f6e-00b3-4016-a00e-e0be1ad78b23-operator-scripts\") pod \"neutron-f206-account-create-2859j\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.152018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjxwz\" (UniqueName: \"kubernetes.io/projected/01e03f6e-00b3-4016-a00e-e0be1ad78b23-kube-api-access-fjxwz\") pod \"neutron-f206-account-create-2859j\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: E1121 12:31:11.186266 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1615b03e_2fa0_49c1_a20d_eefe57a232b0.slice\": RecentStats: unable to find data in memory cache]" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.272690 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.433876 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.437493 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.478139 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.155:5353: connect: connection refused" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.521361 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-gskxj"] Nov 21 12:31:11 crc kubenswrapper[4769]: W1121 12:31:11.530858 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddf7893_be82_4597_9e80_a652e9daedc1.slice/crio-521d6f255e47fbf0888e0f1954ad2b777d1b250f99cfa5732a0efd786585b391 WatchSource:0}: Error finding container 521d6f255e47fbf0888e0f1954ad2b777d1b250f99cfa5732a0efd786585b391: Status 404 returned error can't find the container with id 521d6f255e47fbf0888e0f1954ad2b777d1b250f99cfa5732a0efd786585b391 Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.564644 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-nkrnv"] Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.662441 4769 generic.go:334] "Generic (PLEG): container finished" podID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerID="ae5e60e6cf5ad085eb4767c47ef3d44ce3fe82796b7f1fe064bc3fa0f799367f" exitCode=0 Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.662527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" event={"ID":"c3120607-413a-487d-98ce-7ae0e94fd1f3","Type":"ContainerDied","Data":"ae5e60e6cf5ad085eb4767c47ef3d44ce3fe82796b7f1fe064bc3fa0f799367f"} Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.677629 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" event={"ID":"d46a9281-82de-4242-b23c-91b71b14fe20","Type":"ContainerStarted","Data":"f83720ed68dc283c9fbfe32311c33d5eca00f924fe920af6550ee1cb02d8face"} Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.681298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" event={"ID":"8ddf7893-be82-4597-9e80-a652e9daedc1","Type":"ContainerStarted","Data":"521d6f255e47fbf0888e0f1954ad2b777d1b250f99cfa5732a0efd786585b391"} Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.691706 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.709593 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4dd9c"] Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.776001 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt"] Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.812879 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.967059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-config\") pod \"c3120607-413a-487d-98ce-7ae0e94fd1f3\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.967603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-dnsmasq-svc\") pod \"c3120607-413a-487d-98ce-7ae0e94fd1f3\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.972527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm2nw\" (UniqueName: \"kubernetes.io/projected/c3120607-413a-487d-98ce-7ae0e94fd1f3-kube-api-access-mm2nw\") pod \"c3120607-413a-487d-98ce-7ae0e94fd1f3\" (UID: \"c3120607-413a-487d-98ce-7ae0e94fd1f3\") " Nov 21 12:31:11 crc kubenswrapper[4769]: I1121 12:31:11.975495 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-8099-account-create-62dl6"] Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.015686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3120607-413a-487d-98ce-7ae0e94fd1f3-kube-api-access-mm2nw" (OuterVolumeSpecName: "kube-api-access-mm2nw") pod "c3120607-413a-487d-98ce-7ae0e94fd1f3" (UID: "c3120607-413a-487d-98ce-7ae0e94fd1f3"). InnerVolumeSpecName "kube-api-access-mm2nw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.041028 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-f206-account-create-2859j"] Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.059117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-config" (OuterVolumeSpecName: "config") pod "c3120607-413a-487d-98ce-7ae0e94fd1f3" (UID: "c3120607-413a-487d-98ce-7ae0e94fd1f3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.066912 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mkmhc"] Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.075377 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mm2nw\" (UniqueName: \"kubernetes.io/projected/c3120607-413a-487d-98ce-7ae0e94fd1f3-kube-api-access-mm2nw\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.075410 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.093819 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-lwctk"] Nov 21 12:31:12 crc kubenswrapper[4769]: W1121 12:31:12.111251 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11b4b628_5c45_47af_97a8_e82c3054ce2b.slice/crio-b04a102c69daa9ad68b64893aad2fc1a7684201e03915c1ca20785b0a6fac212 WatchSource:0}: Error finding container b04a102c69daa9ad68b64893aad2fc1a7684201e03915c1ca20785b0a6fac212: Status 404 returned error can't find the container with id b04a102c69daa9ad68b64893aad2fc1a7684201e03915c1ca20785b0a6fac212 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.113559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "c3120607-413a-487d-98ce-7ae0e94fd1f3" (UID: "c3120607-413a-487d-98ce-7ae0e94fd1f3"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:12 crc kubenswrapper[4769]: W1121 12:31:12.118339 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod459c1719_c33c_43bf_b657_89563a5e0f04.slice/crio-f47fda1eba87a45068c5084dc6ef04b515d9eae3ebe015d41fa376f05fbd96b8 WatchSource:0}: Error finding container f47fda1eba87a45068c5084dc6ef04b515d9eae3ebe015d41fa376f05fbd96b8: Status 404 returned error can't find the container with id f47fda1eba87a45068c5084dc6ef04b515d9eae3ebe015d41fa376f05fbd96b8 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.179086 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c3120607-413a-487d-98ce-7ae0e94fd1f3-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.697849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" event={"ID":"459c1719-c33c-43bf-b657-89563a5e0f04","Type":"ContainerStarted","Data":"b07e9aa6a6c0545ab5e16f2c97e743642f6cefdb47f1060394ed8d25dbb5a198"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.698174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" event={"ID":"459c1719-c33c-43bf-b657-89563a5e0f04","Type":"ContainerStarted","Data":"f47fda1eba87a45068c5084dc6ef04b515d9eae3ebe015d41fa376f05fbd96b8"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.701901 4769 generic.go:334] "Generic (PLEG): container finished" podID="11b4b628-5c45-47af-97a8-e82c3054ce2b" containerID="be77e614009f4fac5cf0663a31d12801b352ad01d44cfeba17da40a0b642e867" exitCode=0 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.701958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" event={"ID":"11b4b628-5c45-47af-97a8-e82c3054ce2b","Type":"ContainerDied","Data":"be77e614009f4fac5cf0663a31d12801b352ad01d44cfeba17da40a0b642e867"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.701982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" event={"ID":"11b4b628-5c45-47af-97a8-e82c3054ce2b","Type":"ContainerStarted","Data":"b04a102c69daa9ad68b64893aad2fc1a7684201e03915c1ca20785b0a6fac212"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.703606 4769 generic.go:334] "Generic (PLEG): container finished" podID="16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" containerID="067ddaf564becc991cf3dcc27aefa7e1295374b1bbff5a39103a63f29805992c" exitCode=0 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.703661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" event={"ID":"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe","Type":"ContainerDied","Data":"067ddaf564becc991cf3dcc27aefa7e1295374b1bbff5a39103a63f29805992c"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.703681 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" event={"ID":"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe","Type":"ContainerStarted","Data":"ecc41cfb8ce41a29cdce305644628c7154e64327e3a05f0a18900b9322ff7b4d"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.705861 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.705865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9" event={"ID":"c3120607-413a-487d-98ce-7ae0e94fd1f3","Type":"ContainerDied","Data":"b9d30613a1eabe3385311f24f7fc54fc27025c74b7bf66e5e9d4bc4e3c70bcde"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.705943 4769 scope.go:117] "RemoveContainer" containerID="ae5e60e6cf5ad085eb4767c47ef3d44ce3fe82796b7f1fe064bc3fa0f799367f" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.713798 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" podStartSLOduration=2.713778648 podStartE2EDuration="2.713778648s" podCreationTimestamp="2025-11-21 12:31:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:12.712784341 +0000 UTC m=+2431.413446159" watchObservedRunningTime="2025-11-21 12:31:12.713778648 +0000 UTC m=+2431.414440466" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.721922 4769 generic.go:334] "Generic (PLEG): container finished" podID="d46a9281-82de-4242-b23c-91b71b14fe20" containerID="5cfd0ce281d7bbe1917e1175a0fc3048cbc7ab20776c3f81d5ae31ce90c3560c" exitCode=0 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.721991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" event={"ID":"d46a9281-82de-4242-b23c-91b71b14fe20","Type":"ContainerDied","Data":"5cfd0ce281d7bbe1917e1175a0fc3048cbc7ab20776c3f81d5ae31ce90c3560c"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.752673 4769 generic.go:334] "Generic (PLEG): container finished" podID="01e03f6e-00b3-4016-a00e-e0be1ad78b23" containerID="14de7eb5e801f2a3cd0f659eb4ab206fb29d6cef898618be3459b6b522338ef2" exitCode=0 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.752824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" event={"ID":"01e03f6e-00b3-4016-a00e-e0be1ad78b23","Type":"ContainerDied","Data":"14de7eb5e801f2a3cd0f659eb4ab206fb29d6cef898618be3459b6b522338ef2"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.752870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" event={"ID":"01e03f6e-00b3-4016-a00e-e0be1ad78b23","Type":"ContainerStarted","Data":"9058f1363288d483fb40a780a6ac6a5945498ca558d624c4bb510eeed3b4fc02"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.761390 4769 generic.go:334] "Generic (PLEG): container finished" podID="c102ea71-dfba-4c00-bb61-3b55554a237f" containerID="1d4755050fc50ac223d92ad875b648f44570fc210830f00c3b56c365adec824e" exitCode=0 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.761459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" event={"ID":"c102ea71-dfba-4c00-bb61-3b55554a237f","Type":"ContainerDied","Data":"1d4755050fc50ac223d92ad875b648f44570fc210830f00c3b56c365adec824e"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.761484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" event={"ID":"c102ea71-dfba-4c00-bb61-3b55554a237f","Type":"ContainerStarted","Data":"2d7d81817cab7eb52548572424e5bb1a2ac2624005b24c6e925b9f0274b26cba"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.770814 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b5f6836-a88c-4d4c-a151-a75156de76ab" containerID="8e37bb213963559370470cf4b28ce4ca8c3b8b03e2fb76d76c5f6f874d48be09" exitCode=0 Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.770923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" event={"ID":"4b5f6836-a88c-4d4c-a151-a75156de76ab","Type":"ContainerDied","Data":"8e37bb213963559370470cf4b28ce4ca8c3b8b03e2fb76d76c5f6f874d48be09"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.770990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" event={"ID":"4b5f6836-a88c-4d4c-a151-a75156de76ab","Type":"ContainerStarted","Data":"ce6817d2c94125dff52285b2e7c96e4761c5e983f8b9ec756b407aab82028ab2"} Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.781600 4769 scope.go:117] "RemoveContainer" containerID="faac1670eb07165da7c59a50d4ced3ea699fcdec778e48937d8e39071a645763" Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.785773 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9"] Nov 21 12:31:12 crc kubenswrapper[4769]: I1121 12:31:12.791630 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kbsj9"] Nov 21 12:31:13 crc kubenswrapper[4769]: I1121 12:31:13.300303 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" path="/var/lib/kubelet/pods/c3120607-413a-487d-98ce-7ae0e94fd1f3/volumes" Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.227767 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.231421 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="prometheus" containerID="cri-o://f0b19d0bd975d4ebc7b0cc9758b93716b11468b08c562f0c36bec8cc1bd00fc1" gracePeriod=600 Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.231636 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="thanos-sidecar" containerID="cri-o://ce4e65f959b39458230792d295acf0247e652fe7c6716c814417c99e1b0d5da2" gracePeriod=600 Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.231724 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="config-reloader" containerID="cri-o://90e10cd999360fbbfc11f2f2d13011e2624f99c96cea72614132b1b8a07b50c9" gracePeriod=600 Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.274486 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:31:16 crc kubenswrapper[4769]: E1121 12:31:16.274842 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.434415 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="prometheus" probeResult="failure" output="Get \"http://10.217.1.172:9090/-/ready\": dial tcp 10.217.1.172:9090: connect: connection refused" Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.829375 4769 generic.go:334] "Generic (PLEG): container finished" podID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerID="ce4e65f959b39458230792d295acf0247e652fe7c6716c814417c99e1b0d5da2" exitCode=0 Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.829417 4769 generic.go:334] "Generic (PLEG): container finished" podID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerID="90e10cd999360fbbfc11f2f2d13011e2624f99c96cea72614132b1b8a07b50c9" exitCode=0 Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.829449 4769 generic.go:334] "Generic (PLEG): container finished" podID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerID="f0b19d0bd975d4ebc7b0cc9758b93716b11468b08c562f0c36bec8cc1bd00fc1" exitCode=0 Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.829476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerDied","Data":"ce4e65f959b39458230792d295acf0247e652fe7c6716c814417c99e1b0d5da2"} Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.829526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerDied","Data":"90e10cd999360fbbfc11f2f2d13011e2624f99c96cea72614132b1b8a07b50c9"} Nov 21 12:31:16 crc kubenswrapper[4769]: I1121 12:31:16.829544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerDied","Data":"f0b19d0bd975d4ebc7b0cc9758b93716b11468b08c562f0c36bec8cc1bd00fc1"} Nov 21 12:31:17 crc kubenswrapper[4769]: I1121 12:31:17.842586 4769 generic.go:334] "Generic (PLEG): container finished" podID="459c1719-c33c-43bf-b657-89563a5e0f04" containerID="b07e9aa6a6c0545ab5e16f2c97e743642f6cefdb47f1060394ed8d25dbb5a198" exitCode=0 Nov 21 12:31:17 crc kubenswrapper[4769]: I1121 12:31:17.844079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" event={"ID":"459c1719-c33c-43bf-b657-89563a5e0f04","Type":"ContainerDied","Data":"b07e9aa6a6c0545ab5e16f2c97e743642f6cefdb47f1060394ed8d25dbb5a198"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.774762 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.783049 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.810909 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.813528 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.823603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.834322 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.853487 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g68p9\" (UniqueName: \"kubernetes.io/projected/4b5f6836-a88c-4d4c-a151-a75156de76ab-kube-api-access-g68p9\") pod \"4b5f6836-a88c-4d4c-a151-a75156de76ab\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11b4b628-5c45-47af-97a8-e82c3054ce2b-operator-scripts\") pod \"11b4b628-5c45-47af-97a8-e82c3054ce2b\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5f6836-a88c-4d4c-a151-a75156de76ab-operator-scripts\") pod \"4b5f6836-a88c-4d4c-a151-a75156de76ab\" (UID: \"4b5f6836-a88c-4d4c-a151-a75156de76ab\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c102ea71-dfba-4c00-bb61-3b55554a237f-operator-scripts\") pod \"c102ea71-dfba-4c00-bb61-3b55554a237f\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d46a9281-82de-4242-b23c-91b71b14fe20-operator-scripts\") pod \"d46a9281-82de-4242-b23c-91b71b14fe20\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z948\" (UniqueName: \"kubernetes.io/projected/c102ea71-dfba-4c00-bb61-3b55554a237f-kube-api-access-4z948\") pod \"c102ea71-dfba-4c00-bb61-3b55554a237f\" (UID: \"c102ea71-dfba-4c00-bb61-3b55554a237f\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d844j\" (UniqueName: \"kubernetes.io/projected/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-kube-api-access-d844j\") pod \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01e03f6e-00b3-4016-a00e-e0be1ad78b23-operator-scripts\") pod \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gckdm\" (UniqueName: \"kubernetes.io/projected/d46a9281-82de-4242-b23c-91b71b14fe20-kube-api-access-gckdm\") pod \"d46a9281-82de-4242-b23c-91b71b14fe20\" (UID: \"d46a9281-82de-4242-b23c-91b71b14fe20\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-operator-scripts\") pod \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\" (UID: \"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.856981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjxwz\" (UniqueName: \"kubernetes.io/projected/01e03f6e-00b3-4016-a00e-e0be1ad78b23-kube-api-access-fjxwz\") pod \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\" (UID: \"01e03f6e-00b3-4016-a00e-e0be1ad78b23\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.857022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tp2m\" (UniqueName: \"kubernetes.io/projected/11b4b628-5c45-47af-97a8-e82c3054ce2b-kube-api-access-6tp2m\") pod \"11b4b628-5c45-47af-97a8-e82c3054ce2b\" (UID: \"11b4b628-5c45-47af-97a8-e82c3054ce2b\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.858419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5f6836-a88c-4d4c-a151-a75156de76ab-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4b5f6836-a88c-4d4c-a151-a75156de76ab" (UID: "4b5f6836-a88c-4d4c-a151-a75156de76ab"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.858560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c102ea71-dfba-4c00-bb61-3b55554a237f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c102ea71-dfba-4c00-bb61-3b55554a237f" (UID: "c102ea71-dfba-4c00-bb61-3b55554a237f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.859255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b4b628-5c45-47af-97a8-e82c3054ce2b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "11b4b628-5c45-47af-97a8-e82c3054ce2b" (UID: "11b4b628-5c45-47af-97a8-e82c3054ce2b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.859370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e03f6e-00b3-4016-a00e-e0be1ad78b23-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "01e03f6e-00b3-4016-a00e-e0be1ad78b23" (UID: "01e03f6e-00b3-4016-a00e-e0be1ad78b23"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.859766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d46a9281-82de-4242-b23c-91b71b14fe20-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d46a9281-82de-4242-b23c-91b71b14fe20" (UID: "d46a9281-82de-4242-b23c-91b71b14fe20"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.862767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" (UID: "16f8dfc9-ba93-4d2a-ab96-be64590cc8fe"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.875705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e03f6e-00b3-4016-a00e-e0be1ad78b23-kube-api-access-fjxwz" (OuterVolumeSpecName: "kube-api-access-fjxwz") pod "01e03f6e-00b3-4016-a00e-e0be1ad78b23" (UID: "01e03f6e-00b3-4016-a00e-e0be1ad78b23"). InnerVolumeSpecName "kube-api-access-fjxwz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.875843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c102ea71-dfba-4c00-bb61-3b55554a237f-kube-api-access-4z948" (OuterVolumeSpecName: "kube-api-access-4z948") pod "c102ea71-dfba-4c00-bb61-3b55554a237f" (UID: "c102ea71-dfba-4c00-bb61-3b55554a237f"). InnerVolumeSpecName "kube-api-access-4z948". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.889220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46a9281-82de-4242-b23c-91b71b14fe20-kube-api-access-gckdm" (OuterVolumeSpecName: "kube-api-access-gckdm") pod "d46a9281-82de-4242-b23c-91b71b14fe20" (UID: "d46a9281-82de-4242-b23c-91b71b14fe20"). InnerVolumeSpecName "kube-api-access-gckdm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.889287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b4b628-5c45-47af-97a8-e82c3054ce2b-kube-api-access-6tp2m" (OuterVolumeSpecName: "kube-api-access-6tp2m") pod "11b4b628-5c45-47af-97a8-e82c3054ce2b" (UID: "11b4b628-5c45-47af-97a8-e82c3054ce2b"). InnerVolumeSpecName "kube-api-access-6tp2m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.891335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5f6836-a88c-4d4c-a151-a75156de76ab-kube-api-access-g68p9" (OuterVolumeSpecName: "kube-api-access-g68p9") pod "4b5f6836-a88c-4d4c-a151-a75156de76ab" (UID: "4b5f6836-a88c-4d4c-a151-a75156de76ab"). InnerVolumeSpecName "kube-api-access-g68p9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.907446 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-kube-api-access-d844j" (OuterVolumeSpecName: "kube-api-access-d844j") pod "16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" (UID: "16f8dfc9-ba93-4d2a-ab96-be64590cc8fe"). InnerVolumeSpecName "kube-api-access-d844j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.912935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" event={"ID":"11b4b628-5c45-47af-97a8-e82c3054ce2b","Type":"ContainerDied","Data":"b04a102c69daa9ad68b64893aad2fc1a7684201e03915c1ca20785b0a6fac212"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.913407 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b04a102c69daa9ad68b64893aad2fc1a7684201e03915c1ca20785b0a6fac212" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.913871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mkmhc" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.928065 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.928425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8099-account-create-62dl6" event={"ID":"16f8dfc9-ba93-4d2a-ab96-be64590cc8fe","Type":"ContainerDied","Data":"ecc41cfb8ce41a29cdce305644628c7154e64327e3a05f0a18900b9322ff7b4d"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.928523 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecc41cfb8ce41a29cdce305644628c7154e64327e3a05f0a18900b9322ff7b4d" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.942391 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.942446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-nkrnv" event={"ID":"d46a9281-82de-4242-b23c-91b71b14fe20","Type":"ContainerDied","Data":"f83720ed68dc283c9fbfe32311c33d5eca00f924fe920af6550ee1cb02d8face"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.942512 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f83720ed68dc283c9fbfe32311c33d5eca00f924fe920af6550ee1cb02d8face" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.951949 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.951960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-f206-account-create-2859j" event={"ID":"01e03f6e-00b3-4016-a00e-e0be1ad78b23","Type":"ContainerDied","Data":"9058f1363288d483fb40a780a6ac6a5945498ca558d624c4bb510eeed3b4fc02"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.952006 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9058f1363288d483fb40a780a6ac6a5945498ca558d624c4bb510eeed3b4fc02" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.956300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" event={"ID":"c102ea71-dfba-4c00-bb61-3b55554a237f","Type":"ContainerDied","Data":"2d7d81817cab7eb52548572424e5bb1a2ac2624005b24c6e925b9f0274b26cba"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.956351 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d7d81817cab7eb52548572424e5bb1a2ac2624005b24c6e925b9f0274b26cba" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.956319 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.957616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8pbs\" (UniqueName: \"kubernetes.io/projected/459c1719-c33c-43bf-b657-89563a5e0f04-kube-api-access-t8pbs\") pod \"459c1719-c33c-43bf-b657-89563a5e0f04\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.957823 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-config-data\") pod \"459c1719-c33c-43bf-b657-89563a5e0f04\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.957894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-combined-ca-bundle\") pod \"459c1719-c33c-43bf-b657-89563a5e0f04\" (UID: \"459c1719-c33c-43bf-b657-89563a5e0f04\") " Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958161 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fjxwz\" (UniqueName: \"kubernetes.io/projected/01e03f6e-00b3-4016-a00e-e0be1ad78b23-kube-api-access-fjxwz\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958213 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6tp2m\" (UniqueName: \"kubernetes.io/projected/11b4b628-5c45-47af-97a8-e82c3054ce2b-kube-api-access-6tp2m\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958223 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g68p9\" (UniqueName: \"kubernetes.io/projected/4b5f6836-a88c-4d4c-a151-a75156de76ab-kube-api-access-g68p9\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958232 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11b4b628-5c45-47af-97a8-e82c3054ce2b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958240 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5f6836-a88c-4d4c-a151-a75156de76ab-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958250 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c102ea71-dfba-4c00-bb61-3b55554a237f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958260 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d46a9281-82de-4242-b23c-91b71b14fe20-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958268 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4z948\" (UniqueName: \"kubernetes.io/projected/c102ea71-dfba-4c00-bb61-3b55554a237f-kube-api-access-4z948\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958276 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d844j\" (UniqueName: \"kubernetes.io/projected/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe-kube-api-access-d844j\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958285 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/01e03f6e-00b3-4016-a00e-e0be1ad78b23-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.958293 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gckdm\" (UniqueName: \"kubernetes.io/projected/d46a9281-82de-4242-b23c-91b71b14fe20-kube-api-access-gckdm\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.966316 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.966290 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4dd9c" event={"ID":"4b5f6836-a88c-4d4c-a151-a75156de76ab","Type":"ContainerDied","Data":"ce6817d2c94125dff52285b2e7c96e4761c5e983f8b9ec756b407aab82028ab2"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.966534 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce6817d2c94125dff52285b2e7c96e4761c5e983f8b9ec756b407aab82028ab2" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.974047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" event={"ID":"459c1719-c33c-43bf-b657-89563a5e0f04","Type":"ContainerDied","Data":"f47fda1eba87a45068c5084dc6ef04b515d9eae3ebe015d41fa376f05fbd96b8"} Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.974098 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f47fda1eba87a45068c5084dc6ef04b515d9eae3ebe015d41fa376f05fbd96b8" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.974170 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-lwctk" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.976015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459c1719-c33c-43bf-b657-89563a5e0f04-kube-api-access-t8pbs" (OuterVolumeSpecName: "kube-api-access-t8pbs") pod "459c1719-c33c-43bf-b657-89563a5e0f04" (UID: "459c1719-c33c-43bf-b657-89563a5e0f04"). InnerVolumeSpecName "kube-api-access-t8pbs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:20 crc kubenswrapper[4769]: I1121 12:31:20.994878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "459c1719-c33c-43bf-b657-89563a5e0f04" (UID: "459c1719-c33c-43bf-b657-89563a5e0f04"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.020740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-config-data" (OuterVolumeSpecName: "config-data") pod "459c1719-c33c-43bf-b657-89563a5e0f04" (UID: "459c1719-c33c-43bf-b657-89563a5e0f04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.059891 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.059925 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/459c1719-c33c-43bf-b657-89563a5e0f04-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.059939 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t8pbs\" (UniqueName: \"kubernetes.io/projected/459c1719-c33c-43bf-b657-89563a5e0f04-kube-api-access-t8pbs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.289537 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.363880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-tls-assets\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.363935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-web-config\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.364001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98ed42ab-e45a-47fb-874e-ea6112d8ace8-prometheus-metric-storage-rulefiles-0\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.364145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-db\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.364399 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-thanos-prometheus-http-client-file\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.364474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.364524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rwwv\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-kube-api-access-8rwwv\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.365255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98ed42ab-e45a-47fb-874e-ea6112d8ace8-prometheus-metric-storage-rulefiles-0" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-0") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.365640 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config-out\") pod \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\" (UID: \"98ed42ab-e45a-47fb-874e-ea6112d8ace8\") " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.368634 4769 reconciler_common.go:293] "Volume detached for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/98ed42ab-e45a-47fb-874e-ea6112d8ace8-prometheus-metric-storage-rulefiles-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.369583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.371749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config" (OuterVolumeSpecName: "config") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.374132 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.374132 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-kube-api-access-8rwwv" (OuterVolumeSpecName: "kube-api-access-8rwwv") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "kube-api-access-8rwwv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.382813 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config-out" (OuterVolumeSpecName: "config-out") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.400413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9" (OuterVolumeSpecName: "prometheus-metric-storage-db") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "pvc-8cd3e173-9731-422f-aca3-ae21360798d9". PluginName "kubernetes.io/csi", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.406816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-web-config" (OuterVolumeSpecName: "web-config") pod "98ed42ab-e45a-47fb-874e-ea6112d8ace8" (UID: "98ed42ab-e45a-47fb-874e-ea6112d8ace8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470163 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") on node \"crc\" " Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470224 4769 reconciler_common.go:293] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-thanos-prometheus-http-client-file\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470239 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470254 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8rwwv\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-kube-api-access-8rwwv\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470268 4769 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98ed42ab-e45a-47fb-874e-ea6112d8ace8-config-out\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470282 4769 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98ed42ab-e45a-47fb-874e-ea6112d8ace8-tls-assets\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.470293 4769 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98ed42ab-e45a-47fb-874e-ea6112d8ace8-web-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: E1121 12:31:21.492745 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod459c1719_c33c_43bf_b657_89563a5e0f04.slice\": RecentStats: unable to find data in memory cache]" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.512219 4769 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.512591 4769 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-8cd3e173-9731-422f-aca3-ae21360798d9" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9") on node "crc" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.571551 4769 reconciler_common.go:293] "Volume detached for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.987414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"98ed42ab-e45a-47fb-874e-ea6112d8ace8","Type":"ContainerDied","Data":"7f953716032a2ecc330b54e8bfb6f1594fc42419a85f9bfa297971d713e688ad"} Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.987833 4769 scope.go:117] "RemoveContainer" containerID="ce4e65f959b39458230792d295acf0247e652fe7c6716c814417c99e1b0d5da2" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.988000 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:21 crc kubenswrapper[4769]: I1121 12:31:21.991418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" event={"ID":"8ddf7893-be82-4597-9e80-a652e9daedc1","Type":"ContainerStarted","Data":"900ab075cf227a8f5b6f40ea2b98bd2d3fb14fd44004c4cf58d34c1db12ecde8"} Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.009166 4769 scope.go:117] "RemoveContainer" containerID="90e10cd999360fbbfc11f2f2d13011e2624f99c96cea72614132b1b8a07b50c9" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.019635 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" podStartSLOduration=2.110162112 podStartE2EDuration="12.019609935s" podCreationTimestamp="2025-11-21 12:31:10 +0000 UTC" firstStartedPulling="2025-11-21 12:31:11.533791384 +0000 UTC m=+2430.234453202" lastFinishedPulling="2025-11-21 12:31:21.443239207 +0000 UTC m=+2440.143901025" observedRunningTime="2025-11-21 12:31:22.009135526 +0000 UTC m=+2440.709797344" watchObservedRunningTime="2025-11-21 12:31:22.019609935 +0000 UTC m=+2440.720271763" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.083939 4769 scope.go:117] "RemoveContainer" containerID="f0b19d0bd975d4ebc7b0cc9758b93716b11468b08c562f0c36bec8cc1bd00fc1" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.090136 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.115820 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.147741 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148101 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148112 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148121 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="dnsmasq-dns" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148128 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="dnsmasq-dns" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148144 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c102ea71-dfba-4c00-bb61-3b55554a237f" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148150 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c102ea71-dfba-4c00-bb61-3b55554a237f" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148163 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="459c1719-c33c-43bf-b657-89563a5e0f04" containerName="keystone-db-sync" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148169 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="459c1719-c33c-43bf-b657-89563a5e0f04" containerName="keystone-db-sync" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148181 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b5f6836-a88c-4d4c-a151-a75156de76ab" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148199 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5f6836-a88c-4d4c-a151-a75156de76ab" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148207 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="01e03f6e-00b3-4016-a00e-e0be1ad78b23" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148213 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e03f6e-00b3-4016-a00e-e0be1ad78b23" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148231 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="config-reloader" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148238 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="config-reloader" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148254 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d46a9281-82de-4242-b23c-91b71b14fe20" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148260 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46a9281-82de-4242-b23c-91b71b14fe20" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148270 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="thanos-sidecar" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148276 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="thanos-sidecar" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148296 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="prometheus" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148302 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="prometheus" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148320 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11b4b628-5c45-47af-97a8-e82c3054ce2b" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148326 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b4b628-5c45-47af-97a8-e82c3054ce2b" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148333 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="init-config-reloader" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148338 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="init-config-reloader" Nov 21 12:31:22 crc kubenswrapper[4769]: E1121 12:31:22.148345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="init" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148353 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="init" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148498 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="prometheus" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148511 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="config-reloader" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148519 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4b5f6836-a88c-4d4c-a151-a75156de76ab" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148530 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c3120607-413a-487d-98ce-7ae0e94fd1f3" containerName="dnsmasq-dns" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148538 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148549 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" containerName="thanos-sidecar" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148556 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d46a9281-82de-4242-b23c-91b71b14fe20" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148567 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="11b4b628-5c45-47af-97a8-e82c3054ce2b" containerName="mariadb-database-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148578 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="01e03f6e-00b3-4016-a00e-e0be1ad78b23" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148586 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c102ea71-dfba-4c00-bb61-3b55554a237f" containerName="mariadb-account-create" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.148597 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="459c1719-c33c-43bf-b657-89563a5e0f04" containerName="keystone-db-sync" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.153383 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.156713 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-metric-storage-prometheus-svc" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.157458 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage-web-config" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.157682 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"prometheus-metric-storage-rulefiles-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.158027 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"metric-storage-prometheus-dockercfg-sdl54" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.158145 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage-thanos-prometheus-http-client-file" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.158268 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.168892 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"prometheus-metric-storage-tls-assets-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.170976 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4jjl7"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.172124 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.172396 4769 scope.go:117] "RemoveContainer" containerID="e6cdaf6b05fb329efda986285eabb0bb69c46e3538454afede49a67e24db432d" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.178399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.178570 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.178681 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.178788 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w45kf" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.180150 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183408 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183623 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84013f03-f2eb-47c2-86c7-7a3d707ed64e-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb277\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-kube-api-access-mb277\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.183919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.187625 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4jjl7"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.194824 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nwlq\" (UniqueName: \"kubernetes.io/projected/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-kube-api-access-5nwlq\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-scripts\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-credential-keys\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-config-data\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84013f03-f2eb-47c2-86c7-7a3d707ed64e-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286768 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-fernet-keys\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-combined-ca-bundle\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286863 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286900 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mb277\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-kube-api-access-mb277\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.286992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.287020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.287060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.297862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84013f03-f2eb-47c2-86c7-7a3d707ed64e-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.298244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.298932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.301969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.304176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.311876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.312070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.312403 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.313073 4769 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.313103 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/6713970be8148b0f1a00873a1346e8c1d8fa973bd7ac7788108fa262f1d41e6d/globalmount\"" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.318754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.321167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb277\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-kube-api-access-mb277\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.353735 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.355893 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.364789 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.364983 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.388431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5nwlq\" (UniqueName: \"kubernetes.io/projected/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-kube-api-access-5nwlq\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.388499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-credential-keys\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.388527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-scripts\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.388569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-config-data\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.388646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-fernet-keys\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.388694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-combined-ca-bundle\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.394708 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.394916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"prometheus-metric-storage-0\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.397465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-fernet-keys\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.401575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-credential-keys\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.405460 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-scripts\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.436830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-combined-ca-bundle\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.437439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-config-data\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.444787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nwlq\" (UniqueName: \"kubernetes.io/projected/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-kube-api-access-5nwlq\") pod \"keystone-bootstrap-4jjl7\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.455929 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-8k9kv"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.457826 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.465101 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-vcxs4" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.465344 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.465462 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.486237 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-8k9kv"] Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490126 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-scripts\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-config-data\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490318 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-log-httpd\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86jmw\" (UniqueName: \"kubernetes.io/projected/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-kube-api-access-86jmw\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-run-httpd\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490506 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.490545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.491226 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.540085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.594239 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-combined-ca-bundle\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.594290 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-config-data\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.594310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-log-httpd\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.594465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-86jmw\" (UniqueName: \"kubernetes.io/projected/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-kube-api-access-86jmw\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.595018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-log-httpd\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-run-httpd\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-scripts\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-config-data\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-logs\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600717 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqzn\" (UniqueName: \"kubernetes.io/projected/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-kube-api-access-8gqzn\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-run-httpd\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600748 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-config-data\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.600794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-scripts\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.605289 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.605437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-scripts\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.607952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.619170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-86jmw\" (UniqueName: \"kubernetes.io/projected/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-kube-api-access-86jmw\") pod \"ceilometer-0\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.702182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-combined-ca-bundle\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.702380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-scripts\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.702418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-logs\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.702478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqzn\" (UniqueName: \"kubernetes.io/projected/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-kube-api-access-8gqzn\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.702497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-config-data\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.703240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-logs\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.708829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-combined-ca-bundle\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.711695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-scripts\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.712054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-config-data\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.721712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqzn\" (UniqueName: \"kubernetes.io/projected/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-kube-api-access-8gqzn\") pod \"placement-db-sync-8k9kv\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.758745 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.784330 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:22 crc kubenswrapper[4769]: I1121 12:31:22.788417 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.025778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerStarted","Data":"f67e3e80d66c8b9140bfb7001f08da341885c2874ce7ed6e3d52b9605d285b71"} Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.112088 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4jjl7"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.134498 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.255935 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.258017 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.264977 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.265305 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.265360 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-g52pz" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.265576 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.273010 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.299529 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98ed42ab-e45a-47fb-874e-ea6112d8ace8" path="/var/lib/kubelet/pods/98ed42ab-e45a-47fb-874e-ea6112d8ace8/volumes" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.370388 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.372110 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.374913 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.375136 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.387277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434209 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfbq\" (UniqueName: \"kubernetes.io/projected/e20e4ec3-df23-4100-8af9-b4b8582c6357-kube-api-access-4cfbq\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434286 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-config-data\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-logs\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.434518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-scripts\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.440006 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-8k9kv"] Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-config-data\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-config-data\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-scripts\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-logs\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmj5\" (UniqueName: \"kubernetes.io/projected/38ddd2ba-9b82-4767-9447-665b1c543227-kube-api-access-gcmj5\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-logs\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.542946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-scripts\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfbq\" (UniqueName: \"kubernetes.io/projected/e20e4ec3-df23-4100-8af9-b4b8582c6357-kube-api-access-4cfbq\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543157 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.543979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.544243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-logs\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.546713 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.548958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-scripts\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.549769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.552575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.554534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-config-data\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.578671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfbq\" (UniqueName: \"kubernetes.io/projected/e20e4ec3-df23-4100-8af9-b4b8582c6357-kube-api-access-4cfbq\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.596533 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.604976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645488 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-config-data\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-scripts\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmj5\" (UniqueName: \"kubernetes.io/projected/38ddd2ba-9b82-4767-9447-665b1c543227-kube-api-access-gcmj5\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.645573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-logs\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.646032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-logs\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.646273 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.647403 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.650797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.655422 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.659205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-config-data\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.660107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-scripts\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.673244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmj5\" (UniqueName: \"kubernetes.io/projected/38ddd2ba-9b82-4767-9447-665b1c543227-kube-api-access-gcmj5\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.683467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:23 crc kubenswrapper[4769]: I1121 12:31:23.720422 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.039979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" event={"ID":"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0","Type":"ContainerStarted","Data":"f1c27b172f389be68aeedce30e69924d6ca80c824feb4c63a9589fff2501ebdc"} Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.040356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" event={"ID":"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0","Type":"ContainerStarted","Data":"d9e84df811d11a50c83413d58638634c701793aa77a50183abccb89d829c4a68"} Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.043316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerStarted","Data":"4636efe8b89b8fb307c099772531008669e913e9f7546882204691a557d83b15"} Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.060624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" event={"ID":"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab","Type":"ContainerStarted","Data":"dc8d68ad780e028098bb8bcc578ce1b1c47587b9fec522a6b28330fb35c9a412"} Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.060679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" event={"ID":"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab","Type":"ContainerStarted","Data":"9bf9b161747f8254fffdf72684881a43b8bc13bc42b4fe457916a9a3161c4830"} Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.076616 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" podStartSLOduration=2.076593352 podStartE2EDuration="2.076593352s" podCreationTimestamp="2025-11-21 12:31:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:24.065593369 +0000 UTC m=+2442.766255187" watchObservedRunningTime="2025-11-21 12:31:24.076593352 +0000 UTC m=+2442.777255170" Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.102421 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" podStartSLOduration=2.102401093 podStartE2EDuration="2.102401093s" podCreationTimestamp="2025-11-21 12:31:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:24.08631107 +0000 UTC m=+2442.786972888" watchObservedRunningTime="2025-11-21 12:31:24.102401093 +0000 UTC m=+2442.803062911" Nov 21 12:31:24 crc kubenswrapper[4769]: W1121 12:31:24.108219 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode20e4ec3_df23_4100_8af9_b4b8582c6357.slice/crio-cce7ecb19704af08fa8cf6e2af927b2670130118fb3a3970fc8b31d518da4f7e WatchSource:0}: Error finding container cce7ecb19704af08fa8cf6e2af927b2670130118fb3a3970fc8b31d518da4f7e: Status 404 returned error can't find the container with id cce7ecb19704af08fa8cf6e2af927b2670130118fb3a3970fc8b31d518da4f7e Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.138575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.360916 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.920451 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:24 crc kubenswrapper[4769]: I1121 12:31:24.990695 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.118572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerStarted","Data":"f55b3958ecc90769f30015277c816ab9c4f32976ae9b24ac0cc782d0f97a62e0"} Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.121058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.156713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e20e4ec3-df23-4100-8af9-b4b8582c6357","Type":"ContainerStarted","Data":"cce7ecb19704af08fa8cf6e2af927b2670130118fb3a3970fc8b31d518da4f7e"} Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.173308 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"38ddd2ba-9b82-4767-9447-665b1c543227","Type":"ContainerStarted","Data":"832d5344428746e1d9deb11dde0f65003136b37cf27a81e1df243c320b35a235"} Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.876278 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvqhh"] Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.877760 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.880058 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-2nnhp" Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.880356 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.892712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvqhh"] Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.990148 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dqj8s"] Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.991558 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.997059 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-bz42l" Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.997704 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:31:25 crc kubenswrapper[4769]: I1121 12:31:25.998111 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.010230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dqj8s"] Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.012600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-db-sync-config-data\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.012716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-combined-ca-bundle\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.012767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxpld\" (UniqueName: \"kubernetes.io/projected/20158e10-be0f-42eb-b98f-6bf53a0e2e83-kube-api-access-zxpld\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.114580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-combined-ca-bundle\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.114652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5jxz\" (UniqueName: \"kubernetes.io/projected/3c045a84-b18c-4a40-864a-3174b38706f4-kube-api-access-f5jxz\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.114689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zxpld\" (UniqueName: \"kubernetes.io/projected/20158e10-be0f-42eb-b98f-6bf53a0e2e83-kube-api-access-zxpld\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.115036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-db-sync-config-data\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.115087 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3c045a84-b18c-4a40-864a-3174b38706f4-etc-machine-id\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.115121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-combined-ca-bundle\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.115181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-config-data\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.115254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-scripts\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.115313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-db-sync-config-data\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.125643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-combined-ca-bundle\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.126237 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-db-sync-config-data\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.132765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxpld\" (UniqueName: \"kubernetes.io/projected/20158e10-be0f-42eb-b98f-6bf53a0e2e83-kube-api-access-zxpld\") pod \"barbican-db-sync-fvqhh\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.204528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"38ddd2ba-9b82-4767-9447-665b1c543227","Type":"ContainerStarted","Data":"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446"} Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.205884 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.213310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerStarted","Data":"eb6e8c60bf35778b687be6d9ed515cc8494877cd42e33428ddae1661a4bffc14"} Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.216415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-scripts\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.216588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f5jxz\" (UniqueName: \"kubernetes.io/projected/3c045a84-b18c-4a40-864a-3174b38706f4-kube-api-access-f5jxz\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.216682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-db-sync-config-data\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.216747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3c045a84-b18c-4a40-864a-3174b38706f4-etc-machine-id\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.216833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-combined-ca-bundle\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.216904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-config-data\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.222947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3c045a84-b18c-4a40-864a-3174b38706f4-etc-machine-id\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.224490 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ddf7893-be82-4597-9e80-a652e9daedc1" containerID="900ab075cf227a8f5b6f40ea2b98bd2d3fb14fd44004c4cf58d34c1db12ecde8" exitCode=0 Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.224583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" event={"ID":"8ddf7893-be82-4597-9e80-a652e9daedc1","Type":"ContainerDied","Data":"900ab075cf227a8f5b6f40ea2b98bd2d3fb14fd44004c4cf58d34c1db12ecde8"} Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.224968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-config-data\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.236175 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e20e4ec3-df23-4100-8af9-b4b8582c6357","Type":"ContainerStarted","Data":"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851"} Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.236264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e20e4ec3-df23-4100-8af9-b4b8582c6357","Type":"ContainerStarted","Data":"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4"} Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.236403 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-log" containerID="cri-o://66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4" gracePeriod=30 Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.236670 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-httpd" containerID="cri-o://2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851" gracePeriod=30 Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.242008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-db-sync-config-data\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.245838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-combined-ca-bundle\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.253828 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-scripts\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.258454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerStarted","Data":"fc4f4aafd139d0ff4dcdf4b3a5e3bef1ca7be3d0e2866814597ceff90382a000"} Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.271225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5jxz\" (UniqueName: \"kubernetes.io/projected/3c045a84-b18c-4a40-864a-3174b38706f4-kube-api-access-f5jxz\") pod \"cinder-db-sync-dqj8s\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.276376 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.276361852 podStartE2EDuration="4.276361852s" podCreationTimestamp="2025-11-21 12:31:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:26.273218515 +0000 UTC m=+2444.973880323" watchObservedRunningTime="2025-11-21 12:31:26.276361852 +0000 UTC m=+2444.977023660" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.293080 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-d9t94"] Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.294282 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.298709 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-r4k4s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.299129 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.299412 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.326502 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.336664 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-d9t94"] Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.429775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzpwc\" (UniqueName: \"kubernetes.io/projected/7c7dd89d-4bef-4705-8620-65e04392d17a-kube-api-access-dzpwc\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.430157 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-config\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.430199 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-combined-ca-bundle\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.533317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dzpwc\" (UniqueName: \"kubernetes.io/projected/7c7dd89d-4bef-4705-8620-65e04392d17a-kube-api-access-dzpwc\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.533396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-config\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.533424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-combined-ca-bundle\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.554408 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-combined-ca-bundle\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.562554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzpwc\" (UniqueName: \"kubernetes.io/projected/7c7dd89d-4bef-4705-8620-65e04392d17a-kube-api-access-dzpwc\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.617022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-config\") pod \"neutron-db-sync-d9t94\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.728848 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:31:26 crc kubenswrapper[4769]: I1121 12:31:26.895047 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvqhh"] Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.077929 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.151745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-httpd-run\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152242 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dqj8s"] Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-combined-ca-bundle\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-public-tls-certs\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-logs\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cfbq\" (UniqueName: \"kubernetes.io/projected/e20e4ec3-df23-4100-8af9-b4b8582c6357-kube-api-access-4cfbq\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-scripts\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-config-data\") pod \"e20e4ec3-df23-4100-8af9-b4b8582c6357\" (UID: \"e20e4ec3-df23-4100-8af9-b4b8582c6357\") " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-logs" (OuterVolumeSpecName: "logs") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.152965 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.153177 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.157286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.157346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-scripts" (OuterVolumeSpecName: "scripts") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.162160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20e4ec3-df23-4100-8af9-b4b8582c6357-kube-api-access-4cfbq" (OuterVolumeSpecName: "kube-api-access-4cfbq") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "kube-api-access-4cfbq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.181316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.202432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-config-data" (OuterVolumeSpecName: "config-data") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.224419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e20e4ec3-df23-4100-8af9-b4b8582c6357" (UID: "e20e4ec3-df23-4100-8af9-b4b8582c6357"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254743 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254784 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4cfbq\" (UniqueName: \"kubernetes.io/projected/e20e4ec3-df23-4100-8af9-b4b8582c6357-kube-api-access-4cfbq\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254797 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254841 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254851 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254860 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e20e4ec3-df23-4100-8af9-b4b8582c6357-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.254869 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e20e4ec3-df23-4100-8af9-b4b8582c6357-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.270029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerStarted","Data":"ccb11eff8b85d3c5feeb4e3316a1b5f1e2bc1a9cf2c54a619df7db392b5f7a0f"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271514 4769 generic.go:334] "Generic (PLEG): container finished" podID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerID="2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851" exitCode=143 Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271542 4769 generic.go:334] "Generic (PLEG): container finished" podID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerID="66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4" exitCode=143 Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e20e4ec3-df23-4100-8af9-b4b8582c6357","Type":"ContainerDied","Data":"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e20e4ec3-df23-4100-8af9-b4b8582c6357","Type":"ContainerDied","Data":"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271597 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e20e4ec3-df23-4100-8af9-b4b8582c6357","Type":"ContainerDied","Data":"cce7ecb19704af08fa8cf6e2af927b2670130118fb3a3970fc8b31d518da4f7e"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271611 4769 scope.go:117] "RemoveContainer" containerID="2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.271749 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.274094 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.290441 4769 generic.go:334] "Generic (PLEG): container finished" podID="08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" containerID="dc8d68ad780e028098bb8bcc578ce1b1c47587b9fec522a6b28330fb35c9a412" exitCode=0 Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.323677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" event={"ID":"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab","Type":"ContainerDied","Data":"dc8d68ad780e028098bb8bcc578ce1b1c47587b9fec522a6b28330fb35c9a412"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.323724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" event={"ID":"20158e10-be0f-42eb-b98f-6bf53a0e2e83","Type":"ContainerStarted","Data":"7404b82dc7c50369c27d80aa331e4ea49d8e37fecf857352bbc3a44df97f01d6"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.323737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" event={"ID":"20158e10-be0f-42eb-b98f-6bf53a0e2e83","Type":"ContainerStarted","Data":"e87978b528f3bcc127ff6cd61301c45e15248b011d19803ddf2c0901cd035aba"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.330135 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.336482 4769 scope.go:117] "RemoveContainer" containerID="66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.341487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"38ddd2ba-9b82-4767-9447-665b1c543227","Type":"ContainerStarted","Data":"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.341713 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-log" containerID="cri-o://3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446" gracePeriod=30 Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.341966 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-httpd" containerID="cri-o://fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc" gracePeriod=30 Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.351520 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.353305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" event={"ID":"3c045a84-b18c-4a40-864a-3174b38706f4","Type":"ContainerStarted","Data":"74ac98789ee728518b3680010e3794545aa63b387f5389fe92cf3903357e3079"} Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.356401 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.358973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-d9t94"] Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.359209 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" podStartSLOduration=2.35917793 podStartE2EDuration="2.35917793s" podCreationTimestamp="2025-11-21 12:31:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:27.336012423 +0000 UTC m=+2446.036674241" watchObservedRunningTime="2025-11-21 12:31:27.35917793 +0000 UTC m=+2446.059839748" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.378565 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:27 crc kubenswrapper[4769]: E1121 12:31:27.379049 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-log" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.379064 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-log" Nov 21 12:31:27 crc kubenswrapper[4769]: E1121 12:31:27.379088 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-httpd" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.379097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-httpd" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.379312 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-log" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.379335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" containerName="glance-httpd" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.380470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.406017 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.413027 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.413007502 podStartE2EDuration="5.413007502s" podCreationTimestamp="2025-11-21 12:31:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:27.409360542 +0000 UTC m=+2446.110022360" watchObservedRunningTime="2025-11-21 12:31:27.413007502 +0000 UTC m=+2446.113669320" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.413633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.414287 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-scripts\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458157 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-config-data\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hn2v\" (UniqueName: \"kubernetes.io/projected/448739ed-7175-4f95-a249-27b10b9809f3-kube-api-access-9hn2v\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-logs\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.458500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.465438 4769 scope.go:117] "RemoveContainer" containerID="2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851" Nov 21 12:31:27 crc kubenswrapper[4769]: E1121 12:31:27.466301 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851\": container with ID starting with 2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851 not found: ID does not exist" containerID="2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.466354 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851"} err="failed to get container status \"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851\": rpc error: code = NotFound desc = could not find container \"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851\": container with ID starting with 2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851 not found: ID does not exist" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.466379 4769 scope.go:117] "RemoveContainer" containerID="66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4" Nov 21 12:31:27 crc kubenswrapper[4769]: E1121 12:31:27.473373 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4\": container with ID starting with 66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4 not found: ID does not exist" containerID="66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.473427 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4"} err="failed to get container status \"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4\": rpc error: code = NotFound desc = could not find container \"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4\": container with ID starting with 66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4 not found: ID does not exist" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.473457 4769 scope.go:117] "RemoveContainer" containerID="2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.482432 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851"} err="failed to get container status \"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851\": rpc error: code = NotFound desc = could not find container \"2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851\": container with ID starting with 2fdf83c1708fee74028d21033dbd6dba141de660bf1c4df09f4f26f180e7e851 not found: ID does not exist" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.482488 4769 scope.go:117] "RemoveContainer" containerID="66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.489637 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4"} err="failed to get container status \"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4\": rpc error: code = NotFound desc = could not find container \"66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4\": container with ID starting with 66258a43ad742788f15032b0b5557c5a4d25e40d45c0ee229fede35198c637f4 not found: ID does not exist" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-scripts\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-config-data\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9hn2v\" (UniqueName: \"kubernetes.io/projected/448739ed-7175-4f95-a249-27b10b9809f3-kube-api-access-9hn2v\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-logs\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561894 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.561919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.562338 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.562909 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-logs\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.563060 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.567952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-scripts\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.572568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-config-data\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.572611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.573472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.594762 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hn2v\" (UniqueName: \"kubernetes.io/projected/448739ed-7175-4f95-a249-27b10b9809f3-kube-api-access-9hn2v\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.595465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.741209 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:27 crc kubenswrapper[4769]: I1121 12:31:27.955735 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.075067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d25h7\" (UniqueName: \"kubernetes.io/projected/8ddf7893-be82-4597-9e80-a652e9daedc1-kube-api-access-d25h7\") pod \"8ddf7893-be82-4597-9e80-a652e9daedc1\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.075129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-combined-ca-bundle\") pod \"8ddf7893-be82-4597-9e80-a652e9daedc1\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.075163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-config-data\") pod \"8ddf7893-be82-4597-9e80-a652e9daedc1\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.075327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-db-sync-config-data\") pod \"8ddf7893-be82-4597-9e80-a652e9daedc1\" (UID: \"8ddf7893-be82-4597-9e80-a652e9daedc1\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.093695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ddf7893-be82-4597-9e80-a652e9daedc1-kube-api-access-d25h7" (OuterVolumeSpecName: "kube-api-access-d25h7") pod "8ddf7893-be82-4597-9e80-a652e9daedc1" (UID: "8ddf7893-be82-4597-9e80-a652e9daedc1"). InnerVolumeSpecName "kube-api-access-d25h7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.112968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "8ddf7893-be82-4597-9e80-a652e9daedc1" (UID: "8ddf7893-be82-4597-9e80-a652e9daedc1"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.127037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8ddf7893-be82-4597-9e80-a652e9daedc1" (UID: "8ddf7893-be82-4597-9e80-a652e9daedc1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.134135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-config-data" (OuterVolumeSpecName: "config-data") pod "8ddf7893-be82-4597-9e80-a652e9daedc1" (UID: "8ddf7893-be82-4597-9e80-a652e9daedc1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.160645 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.177988 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d25h7\" (UniqueName: \"kubernetes.io/projected/8ddf7893-be82-4597-9e80-a652e9daedc1-kube-api-access-d25h7\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.178056 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.178067 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.178082 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/8ddf7893-be82-4597-9e80-a652e9daedc1-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.278556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-internal-tls-certs\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.278926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-combined-ca-bundle\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.278996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.279086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-httpd-run\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.279123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-logs\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.279156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-config-data\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.279220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-scripts\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.279270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcmj5\" (UniqueName: \"kubernetes.io/projected/38ddd2ba-9b82-4767-9447-665b1c543227-kube-api-access-gcmj5\") pod \"38ddd2ba-9b82-4767-9447-665b1c543227\" (UID: \"38ddd2ba-9b82-4767-9447-665b1c543227\") " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.281479 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.282120 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.288436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-logs" (OuterVolumeSpecName: "logs") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.289782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-scripts" (OuterVolumeSpecName: "scripts") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.289889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ddd2ba-9b82-4767-9447-665b1c543227-kube-api-access-gcmj5" (OuterVolumeSpecName: "kube-api-access-gcmj5") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "kube-api-access-gcmj5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.291455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "glance") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.317281 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.384548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"448739ed-7175-4f95-a249-27b10b9809f3","Type":"ContainerStarted","Data":"afc76a832304556d9d59addde50e0857a4ccfc8beb8d4794f6c05ec66a3baa97"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.397158 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/38ddd2ba-9b82-4767-9447-665b1c543227-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.399469 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.399541 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gcmj5\" (UniqueName: \"kubernetes.io/projected/38ddd2ba-9b82-4767-9447-665b1c543227-kube-api-access-gcmj5\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.399606 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.404657 4769 generic.go:334] "Generic (PLEG): container finished" podID="38ddd2ba-9b82-4767-9447-665b1c543227" containerID="fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc" exitCode=0 Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.404697 4769 generic.go:334] "Generic (PLEG): container finished" podID="38ddd2ba-9b82-4767-9447-665b1c543227" containerID="3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446" exitCode=143 Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.404759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"38ddd2ba-9b82-4767-9447-665b1c543227","Type":"ContainerDied","Data":"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.404808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"38ddd2ba-9b82-4767-9447-665b1c543227","Type":"ContainerDied","Data":"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.404824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"38ddd2ba-9b82-4767-9447-665b1c543227","Type":"ContainerDied","Data":"832d5344428746e1d9deb11dde0f65003136b37cf27a81e1df243c320b35a235"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.405419 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.406567 4769 scope.go:117] "RemoveContainer" containerID="fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.411481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" event={"ID":"8ddf7893-be82-4597-9e80-a652e9daedc1","Type":"ContainerDied","Data":"521d6f255e47fbf0888e0f1954ad2b777d1b250f99cfa5732a0efd786585b391"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.411521 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="521d6f255e47fbf0888e0f1954ad2b777d1b250f99cfa5732a0efd786585b391" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.411598 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-db-sync-gskxj" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.459229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" event={"ID":"7c7dd89d-4bef-4705-8620-65e04392d17a","Type":"ContainerStarted","Data":"3d99fd2f630e92494ce24d32a3927ec6f6be113f58944ac8ea7f42cedf020604"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.459288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" event={"ID":"7c7dd89d-4bef-4705-8620-65e04392d17a","Type":"ContainerStarted","Data":"ce3b5810e4e7665a90ee515eaf104ebf0fdd0212b36b5222b74138145c9cced7"} Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.485938 4769 scope.go:117] "RemoveContainer" containerID="3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.512555 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" podStartSLOduration=2.512529122 podStartE2EDuration="2.512529122s" podCreationTimestamp="2025-11-21 12:31:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:28.503969317 +0000 UTC m=+2447.204631135" watchObservedRunningTime="2025-11-21 12:31:28.512529122 +0000 UTC m=+2447.213190940" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.546490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-config-data" (OuterVolumeSpecName: "config-data") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.546643 4769 scope.go:117] "RemoveContainer" containerID="fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.558979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: E1121 12:31:28.568432 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc\": container with ID starting with fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc not found: ID does not exist" containerID="fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.568488 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc"} err="failed to get container status \"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc\": rpc error: code = NotFound desc = could not find container \"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc\": container with ID starting with fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc not found: ID does not exist" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.568520 4769 scope.go:117] "RemoveContainer" containerID="3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446" Nov 21 12:31:28 crc kubenswrapper[4769]: E1121 12:31:28.573785 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446\": container with ID starting with 3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446 not found: ID does not exist" containerID="3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.573854 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446"} err="failed to get container status \"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446\": rpc error: code = NotFound desc = could not find container \"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446\": container with ID starting with 3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446 not found: ID does not exist" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.573896 4769 scope.go:117] "RemoveContainer" containerID="fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.575650 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc"} err="failed to get container status \"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc\": rpc error: code = NotFound desc = could not find container \"fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc\": container with ID starting with fff2bc9b3272d311046abf37e1706f53a96a44b9fde197d4cd01ab7aa834d8fc not found: ID does not exist" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.575710 4769 scope.go:117] "RemoveContainer" containerID="3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.581263 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.581328 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446"} err="failed to get container status \"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446\": rpc error: code = NotFound desc = could not find container \"3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446\": container with ID starting with 3cde40ba22ed0807ba3a45cf6b673fa85fca148e422df43bfb259f06b5c2d446 not found: ID does not exist" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.621435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "38ddd2ba-9b82-4767-9447-665b1c543227" (UID: "38ddd2ba-9b82-4767-9447-665b1c543227"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.621606 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.621618 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.621627 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.621635 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/38ddd2ba-9b82-4767-9447-665b1c543227-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.648961 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: E1121 12:31:28.649453 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-log" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.649469 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-log" Nov 21 12:31:28 crc kubenswrapper[4769]: E1121 12:31:28.649490 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ddf7893-be82-4597-9e80-a652e9daedc1" containerName="watcher-db-sync" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.649496 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddf7893-be82-4597-9e80-a652e9daedc1" containerName="watcher-db-sync" Nov 21 12:31:28 crc kubenswrapper[4769]: E1121 12:31:28.649505 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-httpd" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.649512 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-httpd" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.649716 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-log" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.649730 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" containerName="glance-httpd" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.649747 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ddf7893-be82-4597-9e80-a652e9daedc1" containerName="watcher-db-sync" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.650773 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.657417 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.662858 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-watcher-dockercfg-4vjml" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.663763 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-api-config-data" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.728816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-config-data\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.729176 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62baba1e-b4fd-4ade-9736-535792a555ce-logs\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.729216 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5vz5\" (UniqueName: \"kubernetes.io/projected/62baba1e-b4fd-4ade-9736-535792a555ce-kube-api-access-m5vz5\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.729289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.729346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.778265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.779688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.788918 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-decision-engine-config-data" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.825391 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830568 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-config-data\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-config-data\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-logs\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62baba1e-b4fd-4ade-9736-535792a555ce-logs\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830867 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jp5\" (UniqueName: \"kubernetes.io/projected/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-kube-api-access-t4jp5\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.830892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m5vz5\" (UniqueName: \"kubernetes.io/projected/62baba1e-b4fd-4ade-9736-535792a555ce-kube-api-access-m5vz5\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.835952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62baba1e-b4fd-4ade-9736-535792a555ce-logs\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.844736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.849371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.851666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-config-data\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.863975 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.872417 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.897075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5vz5\" (UniqueName: \"kubernetes.io/projected/62baba1e-b4fd-4ade-9736-535792a555ce-kube-api-access-m5vz5\") pod \"watcher-api-0\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.906965 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.923990 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.932762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.932847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-config-data\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.932895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-logs\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.932922 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jp5\" (UniqueName: \"kubernetes.io/projected/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-kube-api-access-t4jp5\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.933055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.933136 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-applier-config-data" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.935607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-logs\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.940968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.948913 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-config-data\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.951997 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.962938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.964129 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.968235 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.971298 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.973896 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.979778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jp5\" (UniqueName: \"kubernetes.io/projected/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-kube-api-access-t4jp5\") pod \"watcher-decision-engine-0\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:28 crc kubenswrapper[4769]: I1121 12:31:28.983676 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.026255 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.035313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-logs\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.035416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-combined-ca-bundle\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.035485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-config-data\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.035544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt862\" (UniqueName: \"kubernetes.io/projected/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-kube-api-access-lt862\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.105620 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq8ms\" (UniqueName: \"kubernetes.io/projected/04f17924-064f-4d86-91a5-4ab29b0016a2-kube-api-access-fq8ms\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-logs\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-combined-ca-bundle\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-logs\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141666 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-config-data\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lt862\" (UniqueName: \"kubernetes.io/projected/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-kube-api-access-lt862\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.141780 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.142539 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-logs\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.147538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-combined-ca-bundle\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.148398 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-config-data\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.159446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt862\" (UniqueName: \"kubernetes.io/projected/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-kube-api-access-lt862\") pod \"watcher-applier-0\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-logs\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.244973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fq8ms\" (UniqueName: \"kubernetes.io/projected/04f17924-064f-4d86-91a5-4ab29b0016a2-kube-api-access-fq8ms\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.245039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.245697 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.246773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-logs\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.249505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.256450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.256895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.258288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.260462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.274548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq8ms\" (UniqueName: \"kubernetes.io/projected/04f17924-064f-4d86-91a5-4ab29b0016a2-kube-api-access-fq8ms\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.288090 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ddd2ba-9b82-4767-9447-665b1c543227" path="/var/lib/kubelet/pods/38ddd2ba-9b82-4767-9447-665b1c543227/volumes" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.289094 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20e4ec3-df23-4100-8af9-b4b8582c6357" path="/var/lib/kubelet/pods/e20e4ec3-df23-4100-8af9-b4b8582c6357/volumes" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:29.290590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.642597 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:31:30 crc kubenswrapper[4769]: E1121 12:31:30.642895 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.670733 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.672128 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.752612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" event={"ID":"3c045a84-b18c-4a40-864a-3174b38706f4","Type":"ContainerStarted","Data":"82987ba7c0967acfc1bc9314aa7a2876e339af377884cdae78da5984cacc7350"} Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.788973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerStarted","Data":"46deb2eaf9d805f9cbc6a146fd91128e932419c5af1177d7db698b196a0557f4"} Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.789102 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-central-agent" containerID="cri-o://f55b3958ecc90769f30015277c816ab9c4f32976ae9b24ac0cc782d0f97a62e0" gracePeriod=30 Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.789220 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.789262 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="proxy-httpd" containerID="cri-o://46deb2eaf9d805f9cbc6a146fd91128e932419c5af1177d7db698b196a0557f4" gracePeriod=30 Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.789298 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="sg-core" containerID="cri-o://ccb11eff8b85d3c5feeb4e3316a1b5f1e2bc1a9cf2c54a619df7db392b5f7a0f" gracePeriod=30 Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.789345 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-notification-agent" containerID="cri-o://eb6e8c60bf35778b687be6d9ed515cc8494877cd42e33428ddae1661a4bffc14" gracePeriod=30 Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.809537 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" podStartSLOduration=5.809517007 podStartE2EDuration="5.809517007s" podCreationTimestamp="2025-11-21 12:31:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:30.801901737 +0000 UTC m=+2449.502563555" watchObservedRunningTime="2025-11-21 12:31:30.809517007 +0000 UTC m=+2449.510178825" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.814411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" event={"ID":"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab","Type":"ContainerDied","Data":"9bf9b161747f8254fffdf72684881a43b8bc13bc42b4fe457916a9a3161c4830"} Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.815813 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bf9b161747f8254fffdf72684881a43b8bc13bc42b4fe457916a9a3161c4830" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.823926 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" containerID="f1c27b172f389be68aeedce30e69924d6ca80c824feb4c63a9589fff2501ebdc" exitCode=0 Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.824945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" event={"ID":"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0","Type":"ContainerDied","Data":"f1c27b172f389be68aeedce30e69924d6ca80c824feb4c63a9589fff2501ebdc"} Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.845936 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.8632904999999997 podStartE2EDuration="8.845895249s" podCreationTimestamp="2025-11-21 12:31:22 +0000 UTC" firstStartedPulling="2025-11-21 12:31:23.135403922 +0000 UTC m=+2441.836065740" lastFinishedPulling="2025-11-21 12:31:28.118008671 +0000 UTC m=+2446.818670489" observedRunningTime="2025-11-21 12:31:30.832707726 +0000 UTC m=+2449.533369554" watchObservedRunningTime="2025-11-21 12:31:30.845895249 +0000 UTC m=+2449.546557077" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.853934 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.986878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-logs\") pod \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.987487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-config-data\") pod \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.987617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-combined-ca-bundle\") pod \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.987653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gqzn\" (UniqueName: \"kubernetes.io/projected/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-kube-api-access-8gqzn\") pod \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.987796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-scripts\") pod \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\" (UID: \"08fab2f9-d6a5-4ebf-a286-1cf47fb559ab\") " Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.988593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-logs" (OuterVolumeSpecName: "logs") pod "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" (UID: "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.989463 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.994284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-kube-api-access-8gqzn" (OuterVolumeSpecName: "kube-api-access-8gqzn") pod "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" (UID: "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab"). InnerVolumeSpecName "kube-api-access-8gqzn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:30 crc kubenswrapper[4769]: I1121 12:31:30.995777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-scripts" (OuterVolumeSpecName: "scripts") pod "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" (UID: "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.030427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-config-data" (OuterVolumeSpecName: "config-data") pod "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" (UID: "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.033986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" (UID: "08fab2f9-d6a5-4ebf-a286-1cf47fb559ab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.093641 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.093981 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8gqzn\" (UniqueName: \"kubernetes.io/projected/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-kube-api-access-8gqzn\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.093994 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.094003 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:31 crc kubenswrapper[4769]: W1121 12:31:31.578841 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ec0e61a_c1a8_43b4_b44f_3a9c021b4226.slice/crio-ad66eee7ec28fee8d31077d1cc6f91c9d63d3a428d5fc8cd502b2335ff3f94a9 WatchSource:0}: Error finding container ad66eee7ec28fee8d31077d1cc6f91c9d63d3a428d5fc8cd502b2335ff3f94a9: Status 404 returned error can't find the container with id ad66eee7ec28fee8d31077d1cc6f91c9d63d3a428d5fc8cd502b2335ff3f94a9 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.584225 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.602973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.839813 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.843337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"7ce95dd6-a420-4900-b156-9ab3e0d9afc2","Type":"ContainerStarted","Data":"e778894510fcc22140e361d5231933d9295088ffd6668a8d430117b4c181df53"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.847403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"448739ed-7175-4f95-a249-27b10b9809f3","Type":"ContainerStarted","Data":"7f26e98981093c1915fa2f6202cc1c1601d7016557b24f5dbe90d96d6e06833e"} Nov 21 12:31:31 crc kubenswrapper[4769]: W1121 12:31:31.855504 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04f17924_064f_4d86_91a5_4ab29b0016a2.slice/crio-be9556c9807202e6f43ff8a19b663a872be0f9ef41f3398d622e2835a0824341 WatchSource:0}: Error finding container be9556c9807202e6f43ff8a19b663a872be0f9ef41f3398d622e2835a0824341: Status 404 returned error can't find the container with id be9556c9807202e6f43ff8a19b663a872be0f9ef41f3398d622e2835a0824341 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873769 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerID="46deb2eaf9d805f9cbc6a146fd91128e932419c5af1177d7db698b196a0557f4" exitCode=0 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873824 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerID="ccb11eff8b85d3c5feeb4e3316a1b5f1e2bc1a9cf2c54a619df7db392b5f7a0f" exitCode=2 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873840 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerID="eb6e8c60bf35778b687be6d9ed515cc8494877cd42e33428ddae1661a4bffc14" exitCode=0 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873851 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerID="f55b3958ecc90769f30015277c816ab9c4f32976ae9b24ac0cc782d0f97a62e0" exitCode=0 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerDied","Data":"46deb2eaf9d805f9cbc6a146fd91128e932419c5af1177d7db698b196a0557f4"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873911 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerDied","Data":"ccb11eff8b85d3c5feeb4e3316a1b5f1e2bc1a9cf2c54a619df7db392b5f7a0f"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerDied","Data":"eb6e8c60bf35778b687be6d9ed515cc8494877cd42e33428ddae1661a4bffc14"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerDied","Data":"f55b3958ecc90769f30015277c816ab9c4f32976ae9b24ac0cc782d0f97a62e0"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04","Type":"ContainerDied","Data":"4636efe8b89b8fb307c099772531008669e913e9f7546882204691a557d83b15"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.873958 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4636efe8b89b8fb307c099772531008669e913e9f7546882204691a557d83b15" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.876897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226","Type":"ContainerStarted","Data":"ad66eee7ec28fee8d31077d1cc6f91c9d63d3a428d5fc8cd502b2335ff3f94a9"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.878065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"62baba1e-b4fd-4ade-9736-535792a555ce","Type":"ContainerStarted","Data":"015f5d945b47037598b13c9cd41947324f0d1bcfecd748574682324492ee524e"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.879108 4769 generic.go:334] "Generic (PLEG): container finished" podID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerID="fc4f4aafd139d0ff4dcdf4b3a5e3bef1ca7be3d0e2866814597ceff90382a000" exitCode=0 Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.879208 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-8k9kv" Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.879394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerDied","Data":"fc4f4aafd139d0ff4dcdf4b3a5e3bef1ca7be3d0e2866814597ceff90382a000"} Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.879618 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:31:31 crc kubenswrapper[4769]: I1121 12:31:31.983991 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.021110 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6c9bd6f466-wzz6c"] Nov 21 12:31:32 crc kubenswrapper[4769]: E1121 12:31:32.021746 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="proxy-httpd" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.021773 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="proxy-httpd" Nov 21 12:31:32 crc kubenswrapper[4769]: E1121 12:31:32.021790 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" containerName="placement-db-sync" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.021797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" containerName="placement-db-sync" Nov 21 12:31:32 crc kubenswrapper[4769]: E1121 12:31:32.021813 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-central-agent" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.021819 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-central-agent" Nov 21 12:31:32 crc kubenswrapper[4769]: E1121 12:31:32.021866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="sg-core" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.021872 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="sg-core" Nov 21 12:31:32 crc kubenswrapper[4769]: E1121 12:31:32.021883 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-notification-agent" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.021890 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-notification-agent" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.022081 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="proxy-httpd" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.022098 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" containerName="placement-db-sync" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.022113 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-central-agent" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.022126 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="ceilometer-notification-agent" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.022134 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" containerName="sg-core" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.031490 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.038689 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.038901 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.039148 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.039352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-vcxs4" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.041981 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.048902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6c9bd6f466-wzz6c"] Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.114413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-combined-ca-bundle\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.115277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-scripts\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.115393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-run-httpd\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.115425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-log-httpd\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.115454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-sg-core-conf-yaml\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.115553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-config-data\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.115641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86jmw\" (UniqueName: \"kubernetes.io/projected/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-kube-api-access-86jmw\") pod \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\" (UID: \"2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.119489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.120614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.126891 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-kube-api-access-86jmw" (OuterVolumeSpecName: "kube-api-access-86jmw") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "kube-api-access-86jmw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.129061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-scripts" (OuterVolumeSpecName: "scripts") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.215323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-config-data\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mmj9\" (UniqueName: \"kubernetes.io/projected/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-kube-api-access-5mmj9\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-internal-tls-certs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-combined-ca-bundle\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-scripts\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-logs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-public-tls-certs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218702 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218715 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218726 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218735 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-86jmw\" (UniqueName: \"kubernetes.io/projected/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-kube-api-access-86jmw\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.218745 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.221709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.300501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-config-data" (OuterVolumeSpecName: "config-data") pod "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" (UID: "2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.321748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-scripts\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.321836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-logs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.321903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-public-tls-certs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.321958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-config-data\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.322007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5mmj9\" (UniqueName: \"kubernetes.io/projected/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-kube-api-access-5mmj9\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.322028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-internal-tls-certs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.322049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-combined-ca-bundle\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.322172 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.322199 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.322842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-logs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.333814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-public-tls-certs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.353207 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-config-data\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.353304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mmj9\" (UniqueName: \"kubernetes.io/projected/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-kube-api-access-5mmj9\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.358518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-scripts\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.358903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-internal-tls-certs\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.359381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-combined-ca-bundle\") pod \"placement-6c9bd6f466-wzz6c\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.386700 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.428686 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.526171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-fernet-keys\") pod \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.526259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-scripts\") pod \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.526334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nwlq\" (UniqueName: \"kubernetes.io/projected/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-kube-api-access-5nwlq\") pod \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.526371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-credential-keys\") pod \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.526456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-combined-ca-bundle\") pod \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.526489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-config-data\") pod \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\" (UID: \"5e27bc88-b834-4a9a-8fc0-4a06db96b2f0\") " Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.530634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" (UID: "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.532238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-scripts" (OuterVolumeSpecName: "scripts") pod "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" (UID: "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.534946 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" (UID: "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.540452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-kube-api-access-5nwlq" (OuterVolumeSpecName: "kube-api-access-5nwlq") pod "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" (UID: "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0"). InnerVolumeSpecName "kube-api-access-5nwlq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.565430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" (UID: "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.631728 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.631791 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.631804 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5nwlq\" (UniqueName: \"kubernetes.io/projected/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-kube-api-access-5nwlq\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.631818 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.631854 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.687732 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-config-data" (OuterVolumeSpecName: "config-data") pod "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" (UID: "5e27bc88-b834-4a9a-8fc0-4a06db96b2f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.759529 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:32 crc kubenswrapper[4769]: I1121 12:31:32.914942 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6c9bd6f466-wzz6c"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.033961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"04f17924-064f-4d86-91a5-4ab29b0016a2","Type":"ContainerStarted","Data":"be9556c9807202e6f43ff8a19b663a872be0f9ef41f3398d622e2835a0824341"} Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.039607 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4jjl7"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.039880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"448739ed-7175-4f95-a249-27b10b9809f3","Type":"ContainerStarted","Data":"21bc089062ae8794f181d41e2d883b9b56f69cde1e0694ac09c1ec69f3a94b9b"} Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.042432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"62baba1e-b4fd-4ade-9736-535792a555ce","Type":"ContainerStarted","Data":"51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8"} Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.042489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"62baba1e-b4fd-4ade-9736-535792a555ce","Type":"ContainerStarted","Data":"6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c"} Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.043560 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.051062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerStarted","Data":"4be28df0047f0e9c1f4afba338f0e598149a1c05711d86e78a3c72f0e7b89616"} Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.065242 4769 generic.go:334] "Generic (PLEG): container finished" podID="20158e10-be0f-42eb-b98f-6bf53a0e2e83" containerID="7404b82dc7c50369c27d80aa331e4ea49d8e37fecf857352bbc3a44df97f01d6" exitCode=0 Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.065344 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" event={"ID":"20158e10-be0f-42eb-b98f-6bf53a0e2e83","Type":"ContainerDied","Data":"7404b82dc7c50369c27d80aa331e4ea49d8e37fecf857352bbc3a44df97f01d6"} Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.071729 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4jjl7"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.073621 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.075781 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9e84df811d11a50c83413d58638634c701793aa77a50183abccb89d829c4a68" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.075935 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4jjl7" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.096115 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-nm7bm"] Nov 21 12:31:33 crc kubenswrapper[4769]: E1121 12:31:33.096504 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" containerName="keystone-bootstrap" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.096516 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" containerName="keystone-bootstrap" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.096752 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" containerName="keystone-bootstrap" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.097438 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.104505 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-nm7bm"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.115200 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w45kf" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.115477 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.115629 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.115857 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.116581 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.126838 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.126817812 podStartE2EDuration="6.126817812s" podCreationTimestamp="2025-11-21 12:31:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:33.123675295 +0000 UTC m=+2451.824337123" watchObservedRunningTime="2025-11-21 12:31:33.126817812 +0000 UTC m=+2451.827479630" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.197289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-config-data\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.204690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-scripts\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.204959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggm4l\" (UniqueName: \"kubernetes.io/projected/79568fda-e5fd-45b7-b7c5-b4854223c93b-kube-api-access-ggm4l\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.205117 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-combined-ca-bundle\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.207923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-fernet-keys\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.207974 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-credential-keys\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.238664 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-api-0" podStartSLOduration=5.238640641 podStartE2EDuration="5.238640641s" podCreationTimestamp="2025-11-21 12:31:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:33.195305738 +0000 UTC m=+2451.895967556" watchObservedRunningTime="2025-11-21 12:31:33.238640641 +0000 UTC m=+2451.939302459" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.266219 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.309834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-credential-keys\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.309928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-config-data\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.309988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-scripts\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.310069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ggm4l\" (UniqueName: \"kubernetes.io/projected/79568fda-e5fd-45b7-b7c5-b4854223c93b-kube-api-access-ggm4l\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.310102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-combined-ca-bundle\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.310160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-fernet-keys\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.310428 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e27bc88-b834-4a9a-8fc0-4a06db96b2f0" path="/var/lib/kubelet/pods/5e27bc88-b834-4a9a-8fc0-4a06db96b2f0/volumes" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.311388 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.316393 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-fernet-keys\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.316679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-config-data\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.321711 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-scripts\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.323696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-credential-keys\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.327043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-combined-ca-bundle\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.327126 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.337929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.338360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggm4l\" (UniqueName: \"kubernetes.io/projected/79568fda-e5fd-45b7-b7c5-b4854223c93b-kube-api-access-ggm4l\") pod \"keystone-bootstrap-nm7bm\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.342301 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.342750 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.342966 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.413561 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-log-httpd\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.413701 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.413789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-run-httpd\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.414471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4g7n\" (UniqueName: \"kubernetes.io/projected/2cf57438-8e0b-4646-939f-65eab368e774-kube-api-access-m4g7n\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.414615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-scripts\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.414698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.414716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-config-data\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.462290 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517155 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m4g7n\" (UniqueName: \"kubernetes.io/projected/2cf57438-8e0b-4646-939f-65eab368e774-kube-api-access-m4g7n\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-scripts\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-config-data\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-log-httpd\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517378 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.517423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-run-httpd\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.524201 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.524898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-config-data\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.525176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-run-httpd\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.525239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-log-httpd\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.528435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.530312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-scripts\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.541409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4g7n\" (UniqueName: \"kubernetes.io/projected/2cf57438-8e0b-4646-939f-65eab368e774-kube-api-access-m4g7n\") pod \"ceilometer-0\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:33 crc kubenswrapper[4769]: I1121 12:31:33.669312 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.009062 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-nm7bm"] Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.027568 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.087641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" event={"ID":"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090","Type":"ContainerStarted","Data":"b17b8e96729770d76315fddd7ecd4a7f0e5003295d85b39ac30e920ed433ac79"} Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.087689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" event={"ID":"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090","Type":"ContainerStarted","Data":"1fdef3e6e93388772337b720e9298d8a88b15167af782f94c037331ba1452593"} Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.087702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" event={"ID":"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090","Type":"ContainerStarted","Data":"b481f08a63a3c00fb5d43c5ee5326c73c65b34901adb904cd3fbc7d667f728b9"} Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.088018 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.088166 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.090676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"04f17924-064f-4d86-91a5-4ab29b0016a2","Type":"ContainerStarted","Data":"a0580d1db64b4565a534cbae796a8a8232af63c48bbf2498bfc48677ead7040f"} Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.090738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"04f17924-064f-4d86-91a5-4ab29b0016a2","Type":"ContainerStarted","Data":"5d40b3dde4c81c304465a354fe1ed7a3c4944d363daa79ad90345d01263c7d36"} Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.107490 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" podStartSLOduration=3.107473359 podStartE2EDuration="3.107473359s" podCreationTimestamp="2025-11-21 12:31:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:34.10462286 +0000 UTC m=+2452.805284678" watchObservedRunningTime="2025-11-21 12:31:34.107473359 +0000 UTC m=+2452.808135177" Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.132993 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.132974391 podStartE2EDuration="6.132974391s" podCreationTimestamp="2025-11-21 12:31:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:34.127384307 +0000 UTC m=+2452.828046115" watchObservedRunningTime="2025-11-21 12:31:34.132974391 +0000 UTC m=+2452.833636209" Nov 21 12:31:34 crc kubenswrapper[4769]: W1121 12:31:34.139079 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79568fda_e5fd_45b7_b7c5_b4854223c93b.slice/crio-561b48ee2b3a01f38d2074e47cecca7b3486102c4f88ed0cedac9d970ba72c37 WatchSource:0}: Error finding container 561b48ee2b3a01f38d2074e47cecca7b3486102c4f88ed0cedac9d970ba72c37: Status 404 returned error can't find the container with id 561b48ee2b3a01f38d2074e47cecca7b3486102c4f88ed0cedac9d970ba72c37 Nov 21 12:31:34 crc kubenswrapper[4769]: I1121 12:31:34.949899 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.048806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxpld\" (UniqueName: \"kubernetes.io/projected/20158e10-be0f-42eb-b98f-6bf53a0e2e83-kube-api-access-zxpld\") pod \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.048886 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-db-sync-config-data\") pod \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.048936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-combined-ca-bundle\") pod \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\" (UID: \"20158e10-be0f-42eb-b98f-6bf53a0e2e83\") " Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.054970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20158e10-be0f-42eb-b98f-6bf53a0e2e83-kube-api-access-zxpld" (OuterVolumeSpecName: "kube-api-access-zxpld") pod "20158e10-be0f-42eb-b98f-6bf53a0e2e83" (UID: "20158e10-be0f-42eb-b98f-6bf53a0e2e83"). InnerVolumeSpecName "kube-api-access-zxpld". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.068932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "20158e10-be0f-42eb-b98f-6bf53a0e2e83" (UID: "20158e10-be0f-42eb-b98f-6bf53a0e2e83"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.097461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20158e10-be0f-42eb-b98f-6bf53a0e2e83" (UID: "20158e10-be0f-42eb-b98f-6bf53a0e2e83"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.114689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" event={"ID":"20158e10-be0f-42eb-b98f-6bf53a0e2e83","Type":"ContainerDied","Data":"e87978b528f3bcc127ff6cd61301c45e15248b011d19803ddf2c0901cd035aba"} Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.114736 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e87978b528f3bcc127ff6cd61301c45e15248b011d19803ddf2c0901cd035aba" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.114800 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvqhh" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.124778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" event={"ID":"79568fda-e5fd-45b7-b7c5-b4854223c93b","Type":"ContainerStarted","Data":"561b48ee2b3a01f38d2074e47cecca7b3486102c4f88ed0cedac9d970ba72c37"} Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.125640 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.153026 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.153066 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zxpld\" (UniqueName: \"kubernetes.io/projected/20158e10-be0f-42eb-b98f-6bf53a0e2e83-kube-api-access-zxpld\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.153080 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20158e10-be0f-42eb-b98f-6bf53a0e2e83-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.323142 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04" path="/var/lib/kubelet/pods/2f8b1cfb-be8c-45b9-95fd-b67dc2db2e04/volumes" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.459016 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx"] Nov 21 12:31:35 crc kubenswrapper[4769]: E1121 12:31:35.459461 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20158e10-be0f-42eb-b98f-6bf53a0e2e83" containerName="barbican-db-sync" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.459477 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20158e10-be0f-42eb-b98f-6bf53a0e2e83" containerName="barbican-db-sync" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.459676 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20158e10-be0f-42eb-b98f-6bf53a0e2e83" containerName="barbican-db-sync" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.460628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.468059 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-2nnhp" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.469709 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.469863 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.494259 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq"] Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.495762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.499053 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.515922 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq"] Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.565179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data-custom\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.565309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30133c6e-1e49-4adb-b996-03816171b3d8-logs\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.565388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.565416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zpq4\" (UniqueName: \"kubernetes.io/projected/30133c6e-1e49-4adb-b996-03816171b3d8-kube-api-access-6zpq4\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.565481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-combined-ca-bundle\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.573410 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx"] Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.635429 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.655106 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq"] Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.656974 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.662575 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.666758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3e12002-b8fa-4005-8e29-a5259652a4c6-logs\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.666819 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data-custom\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.666867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data-custom\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.667512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9sg6\" (UniqueName: \"kubernetes.io/projected/c3e12002-b8fa-4005-8e29-a5259652a4c6-kube-api-access-k9sg6\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.667560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30133c6e-1e49-4adb-b996-03816171b3d8-logs\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.667590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-combined-ca-bundle\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.667653 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.667720 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.667743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6zpq4\" (UniqueName: \"kubernetes.io/projected/30133c6e-1e49-4adb-b996-03816171b3d8-kube-api-access-6zpq4\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.669213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30133c6e-1e49-4adb-b996-03816171b3d8-logs\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.669736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-combined-ca-bundle\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.676723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.678997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-combined-ca-bundle\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.680581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data-custom\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.686879 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq"] Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.689605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zpq4\" (UniqueName: \"kubernetes.io/projected/30133c6e-1e49-4adb-b996-03816171b3d8-kube-api-access-6zpq4\") pod \"barbican-worker-767d7986dc-sbkmx\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.728381 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vr9\" (UniqueName: \"kubernetes.io/projected/b54407c2-ed80-466e-92b7-4a2c597f8dc0-kube-api-access-g7vr9\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-combined-ca-bundle\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3e12002-b8fa-4005-8e29-a5259652a4c6-logs\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771232 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data-custom\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b54407c2-ed80-466e-92b7-4a2c597f8dc0-logs\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9sg6\" (UniqueName: \"kubernetes.io/projected/c3e12002-b8fa-4005-8e29-a5259652a4c6-kube-api-access-k9sg6\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data-custom\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-combined-ca-bundle\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.771873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3e12002-b8fa-4005-8e29-a5259652a4c6-logs\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.780848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.781896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data-custom\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.782182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-combined-ca-bundle\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.795773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9sg6\" (UniqueName: \"kubernetes.io/projected/c3e12002-b8fa-4005-8e29-a5259652a4c6-kube-api-access-k9sg6\") pod \"barbican-keystone-listener-75dc6c79cd-sbdsq\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.831783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.872639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-combined-ca-bundle\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.872730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b54407c2-ed80-466e-92b7-4a2c597f8dc0-logs\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.872812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data-custom\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.872891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.872944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vr9\" (UniqueName: \"kubernetes.io/projected/b54407c2-ed80-466e-92b7-4a2c597f8dc0-kube-api-access-g7vr9\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.874163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b54407c2-ed80-466e-92b7-4a2c597f8dc0-logs\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.877995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data-custom\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.878660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-combined-ca-bundle\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.879269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.899821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vr9\" (UniqueName: \"kubernetes.io/projected/b54407c2-ed80-466e-92b7-4a2c597f8dc0-kube-api-access-g7vr9\") pod \"barbican-api-7fcfc7bb64-zlbhq\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.950968 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:31:35 crc kubenswrapper[4769]: I1121 12:31:35.997018 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.138342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226","Type":"ContainerStarted","Data":"982f11c7262b5ebdcbf5a5c6d0afe5b17a82819c249326a538594d4a2a0e07d8"} Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.143057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerStarted","Data":"4de8037e8993e37058d734db83e674d19b28ee2bc21190d4d70f078884b036c8"} Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.146726 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerStarted","Data":"279cb429f401675d3ac72bf3596f54e95cc544a0d649f24ae33dc1e13e0c94dc"} Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.146782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerStarted","Data":"f1a03cb356b42d3fe0a8443af51a3eacc2a84e5d1de42ee9a9ded91eaab486d7"} Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.148317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" event={"ID":"79568fda-e5fd-45b7-b7c5-b4854223c93b","Type":"ContainerStarted","Data":"bad66fbf85bba853777c21ae148f6df15f12f8fa7fae2af769e44bc09cfcace1"} Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.153617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"7ce95dd6-a420-4900-b156-9ab3e0d9afc2","Type":"ContainerStarted","Data":"213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3"} Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.168815 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-decision-engine-0" podStartSLOduration=4.783866391 podStartE2EDuration="8.168796567s" podCreationTimestamp="2025-11-21 12:31:28 +0000 UTC" firstStartedPulling="2025-11-21 12:31:31.581691135 +0000 UTC m=+2450.282352953" lastFinishedPulling="2025-11-21 12:31:34.966621311 +0000 UTC m=+2453.667283129" observedRunningTime="2025-11-21 12:31:36.162099832 +0000 UTC m=+2454.862761650" watchObservedRunningTime="2025-11-21 12:31:36.168796567 +0000 UTC m=+2454.869458385" Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.187805 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" podStartSLOduration=3.187776969 podStartE2EDuration="3.187776969s" podCreationTimestamp="2025-11-21 12:31:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:36.184470528 +0000 UTC m=+2454.885132356" watchObservedRunningTime="2025-11-21 12:31:36.187776969 +0000 UTC m=+2454.888438787" Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.227675 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podStartSLOduration=14.227654387 podStartE2EDuration="14.227654387s" podCreationTimestamp="2025-11-21 12:31:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:36.227234666 +0000 UTC m=+2454.927896484" watchObservedRunningTime="2025-11-21 12:31:36.227654387 +0000 UTC m=+2454.928316205" Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.278844 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-applier-0" podStartSLOduration=5.140117249 podStartE2EDuration="8.278816416s" podCreationTimestamp="2025-11-21 12:31:28 +0000 UTC" firstStartedPulling="2025-11-21 12:31:31.827575624 +0000 UTC m=+2450.528237442" lastFinishedPulling="2025-11-21 12:31:34.966274791 +0000 UTC m=+2453.666936609" observedRunningTime="2025-11-21 12:31:36.266594709 +0000 UTC m=+2454.967256537" watchObservedRunningTime="2025-11-21 12:31:36.278816416 +0000 UTC m=+2454.979478234" Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.373577 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx"] Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.657785 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq"] Nov 21 12:31:36 crc kubenswrapper[4769]: I1121 12:31:36.814123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq"] Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.165539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" event={"ID":"b54407c2-ed80-466e-92b7-4a2c597f8dc0","Type":"ContainerStarted","Data":"7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69"} Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.166021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" event={"ID":"b54407c2-ed80-466e-92b7-4a2c597f8dc0","Type":"ContainerStarted","Data":"59d5039f7fad6e45980bfe8eea152d642ff623d6b419d5af75d04af38b2c1c60"} Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.168930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" event={"ID":"30133c6e-1e49-4adb-b996-03816171b3d8","Type":"ContainerStarted","Data":"61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e"} Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.168976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" event={"ID":"30133c6e-1e49-4adb-b996-03816171b3d8","Type":"ContainerStarted","Data":"ef0fe7782b357d81f9f5f9106f6e6d1e2ef9cf3355ebe3e084437f968459d05d"} Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.171377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerStarted","Data":"8bcbffcfbd020f972289aeec8539fe0a35635524a33c2d3f8727a3bea3369131"} Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.173095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" event={"ID":"c3e12002-b8fa-4005-8e29-a5259652a4c6","Type":"ContainerStarted","Data":"d3aa3e74112142f73e1f125e0afa9fdb716a9b264c4063b7ef927c363e96db32"} Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.494524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.494971 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.511681 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.741779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.741837 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.796706 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:37 crc kubenswrapper[4769]: I1121 12:31:37.823557 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.183395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" event={"ID":"b54407c2-ed80-466e-92b7-4a2c597f8dc0","Type":"ContainerStarted","Data":"4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8"} Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.183959 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.183984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.187642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" event={"ID":"30133c6e-1e49-4adb-b996-03816171b3d8","Type":"ContainerStarted","Data":"3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b"} Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.189700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" event={"ID":"c3e12002-b8fa-4005-8e29-a5259652a4c6","Type":"ContainerStarted","Data":"30dfb140d9e8887836ba42cd44a7ee5b669d5d2d55d486ec52a4ea40f065a45b"} Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.189759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" event={"ID":"c3e12002-b8fa-4005-8e29-a5259652a4c6","Type":"ContainerStarted","Data":"2e8a55a9fd3d9c773ecc16615d57098e71c74ba81f02ba76ae17d2744bc3ff9f"} Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.190144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.190177 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.197494 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.206894 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" podStartSLOduration=3.206873294 podStartE2EDuration="3.206873294s" podCreationTimestamp="2025-11-21 12:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:38.199297045 +0000 UTC m=+2456.899958883" watchObservedRunningTime="2025-11-21 12:31:38.206873294 +0000 UTC m=+2456.907535112" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.222164 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" podStartSLOduration=3.222147444 podStartE2EDuration="3.222147444s" podCreationTimestamp="2025-11-21 12:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:38.219290896 +0000 UTC m=+2456.919952714" watchObservedRunningTime="2025-11-21 12:31:38.222147444 +0000 UTC m=+2456.922809262" Nov 21 12:31:38 crc kubenswrapper[4769]: I1121 12:31:38.248798 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" podStartSLOduration=3.248775687 podStartE2EDuration="3.248775687s" podCreationTimestamp="2025-11-21 12:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:38.24050157 +0000 UTC m=+2456.941163388" watchObservedRunningTime="2025-11-21 12:31:38.248775687 +0000 UTC m=+2456.949437505" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.027725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.047983 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.107429 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.168592 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.184620 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s"] Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.186068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.191007 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.191295 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.198182 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.214313 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s"] Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.215084 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.270181 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.297943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-internal-tls-certs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.298025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76pg9\" (UniqueName: \"kubernetes.io/projected/f733c362-4230-41b3-92d3-dab29b01fc70-kube-api-access-76pg9\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.298166 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-public-tls-certs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.298212 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f733c362-4230-41b3-92d3-dab29b01fc70-logs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.298379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.299387 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-combined-ca-bundle\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.299450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data-custom\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402213 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402325 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-combined-ca-bundle\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402346 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data-custom\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-internal-tls-certs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-76pg9\" (UniqueName: \"kubernetes.io/projected/f733c362-4230-41b3-92d3-dab29b01fc70-kube-api-access-76pg9\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-public-tls-certs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f733c362-4230-41b3-92d3-dab29b01fc70-logs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.402883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f733c362-4230-41b3-92d3-dab29b01fc70-logs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.413307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.420988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-combined-ca-bundle\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.421227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data-custom\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.426312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-internal-tls-certs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.444691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-76pg9\" (UniqueName: \"kubernetes.io/projected/f733c362-4230-41b3-92d3-dab29b01fc70-kube-api-access-76pg9\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.449756 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-public-tls-certs\") pod \"barbican-api-d9db648c6-6lx4s\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:39 crc kubenswrapper[4769]: I1121 12:31:39.508406 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.021946 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s"] Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.208742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" event={"ID":"f733c362-4230-41b3-92d3-dab29b01fc70","Type":"ContainerStarted","Data":"7084649a6640b841330f8e55999dce360e9d74bfaa84bcb70a7aa67ae17e57fd"} Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.672973 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.673227 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.673296 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.673415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.725297 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.729265 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.733466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.969656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:40 crc kubenswrapper[4769]: I1121 12:31:40.970083 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:31:41 crc kubenswrapper[4769]: I1121 12:31:41.008599 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:31:41 crc kubenswrapper[4769]: I1121 12:31:41.221490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" event={"ID":"f733c362-4230-41b3-92d3-dab29b01fc70","Type":"ContainerStarted","Data":"86b979769740240320ed7602b5e8a14671a912556e0456270c560fd52bb93976"} Nov 21 12:31:41 crc kubenswrapper[4769]: I1121 12:31:41.222137 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:41 crc kubenswrapper[4769]: I1121 12:31:41.222196 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:41 crc kubenswrapper[4769]: I1121 12:31:41.255108 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:31:41 crc kubenswrapper[4769]: I1121 12:31:41.274409 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:31:41 crc kubenswrapper[4769]: E1121 12:31:41.274682 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.235445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerStarted","Data":"feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203"} Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.240960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" event={"ID":"f733c362-4230-41b3-92d3-dab29b01fc70","Type":"ContainerStarted","Data":"855c5c5b3f89891e0167433c824f2882fafb494b412c2ad789adb40a31298fb5"} Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.241616 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.241765 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.277506 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" podStartSLOduration=3.277482766 podStartE2EDuration="3.277482766s" podCreationTimestamp="2025-11-21 12:31:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:42.274286148 +0000 UTC m=+2460.974947956" watchObservedRunningTime="2025-11-21 12:31:42.277482766 +0000 UTC m=+2460.978144584" Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.462026 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.462307 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api-log" containerID="cri-o://6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c" gracePeriod=30 Nov 21 12:31:42 crc kubenswrapper[4769]: I1121 12:31:42.462492 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api" containerID="cri-o://51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8" gracePeriod=30 Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.261680 4769 generic.go:334] "Generic (PLEG): container finished" podID="62baba1e-b4fd-4ade-9736-535792a555ce" containerID="6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c" exitCode=143 Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.261779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"62baba1e-b4fd-4ade-9736-535792a555ce","Type":"ContainerDied","Data":"6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c"} Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.268046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerStarted","Data":"5b121f6b9d7b8c5205d3bf328e14fd7be6e259bd7a2e780dfda3861e3d7560ae"} Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.270778 4769 generic.go:334] "Generic (PLEG): container finished" podID="79568fda-e5fd-45b7-b7c5-b4854223c93b" containerID="bad66fbf85bba853777c21ae148f6df15f12f8fa7fae2af769e44bc09cfcace1" exitCode=0 Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.270836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" event={"ID":"79568fda-e5fd-45b7-b7c5-b4854223c93b","Type":"ContainerDied","Data":"bad66fbf85bba853777c21ae148f6df15f12f8fa7fae2af769e44bc09cfcace1"} Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.939215 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:43 crc kubenswrapper[4769]: I1121 12:31:43.939379 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.767852 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.849547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-credential-keys\") pod \"79568fda-e5fd-45b7-b7c5-b4854223c93b\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.849700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-config-data\") pod \"79568fda-e5fd-45b7-b7c5-b4854223c93b\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.849838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-scripts\") pod \"79568fda-e5fd-45b7-b7c5-b4854223c93b\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.850023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggm4l\" (UniqueName: \"kubernetes.io/projected/79568fda-e5fd-45b7-b7c5-b4854223c93b-kube-api-access-ggm4l\") pod \"79568fda-e5fd-45b7-b7c5-b4854223c93b\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.850091 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-combined-ca-bundle\") pod \"79568fda-e5fd-45b7-b7c5-b4854223c93b\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.850163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-fernet-keys\") pod \"79568fda-e5fd-45b7-b7c5-b4854223c93b\" (UID: \"79568fda-e5fd-45b7-b7c5-b4854223c93b\") " Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.856125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-scripts" (OuterVolumeSpecName: "scripts") pod "79568fda-e5fd-45b7-b7c5-b4854223c93b" (UID: "79568fda-e5fd-45b7-b7c5-b4854223c93b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.858130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79568fda-e5fd-45b7-b7c5-b4854223c93b-kube-api-access-ggm4l" (OuterVolumeSpecName: "kube-api-access-ggm4l") pod "79568fda-e5fd-45b7-b7c5-b4854223c93b" (UID: "79568fda-e5fd-45b7-b7c5-b4854223c93b"). InnerVolumeSpecName "kube-api-access-ggm4l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.873504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "79568fda-e5fd-45b7-b7c5-b4854223c93b" (UID: "79568fda-e5fd-45b7-b7c5-b4854223c93b"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.879819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "79568fda-e5fd-45b7-b7c5-b4854223c93b" (UID: "79568fda-e5fd-45b7-b7c5-b4854223c93b"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.904471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-config-data" (OuterVolumeSpecName: "config-data") pod "79568fda-e5fd-45b7-b7c5-b4854223c93b" (UID: "79568fda-e5fd-45b7-b7c5-b4854223c93b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.905322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "79568fda-e5fd-45b7-b7c5-b4854223c93b" (UID: "79568fda-e5fd-45b7-b7c5-b4854223c93b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.952423 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.952469 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.952486 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.952497 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.952511 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ggm4l\" (UniqueName: \"kubernetes.io/projected/79568fda-e5fd-45b7-b7c5-b4854223c93b-kube-api-access-ggm4l\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:44 crc kubenswrapper[4769]: I1121 12:31:44.952526 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79568fda-e5fd-45b7-b7c5-b4854223c93b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.302793 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c045a84-b18c-4a40-864a-3174b38706f4" containerID="82987ba7c0967acfc1bc9314aa7a2876e339af377884cdae78da5984cacc7350" exitCode=0 Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.302822 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" event={"ID":"3c045a84-b18c-4a40-864a-3174b38706f4","Type":"ContainerDied","Data":"82987ba7c0967acfc1bc9314aa7a2876e339af377884cdae78da5984cacc7350"} Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.312633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerStarted","Data":"2cb3af8d0c60e21787cc54db1f018907b77b351b43d785ffe3d5ade3e38f72bc"} Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.312802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.317163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" event={"ID":"79568fda-e5fd-45b7-b7c5-b4854223c93b","Type":"ContainerDied","Data":"561b48ee2b3a01f38d2074e47cecca7b3486102c4f88ed0cedac9d970ba72c37"} Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.317232 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="561b48ee2b3a01f38d2074e47cecca7b3486102c4f88ed0cedac9d970ba72c37" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.317297 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-nm7bm" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.375448 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.924693646 podStartE2EDuration="12.375421231s" podCreationTimestamp="2025-11-21 12:31:33 +0000 UTC" firstStartedPulling="2025-11-21 12:31:35.568382937 +0000 UTC m=+2454.269044755" lastFinishedPulling="2025-11-21 12:31:45.019110522 +0000 UTC m=+2463.719772340" observedRunningTime="2025-11-21 12:31:45.365630332 +0000 UTC m=+2464.066292160" watchObservedRunningTime="2025-11-21 12:31:45.375421231 +0000 UTC m=+2464.076083049" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.444459 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-596f95c558-6zbwv"] Nov 21 12:31:45 crc kubenswrapper[4769]: E1121 12:31:45.444890 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="79568fda-e5fd-45b7-b7c5-b4854223c93b" containerName="keystone-bootstrap" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.444911 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="79568fda-e5fd-45b7-b7c5-b4854223c93b" containerName="keystone-bootstrap" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.445128 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="79568fda-e5fd-45b7-b7c5-b4854223c93b" containerName="keystone-bootstrap" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.445967 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.448609 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.448840 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:31:45 crc kubenswrapper[4769]: W1121 12:31:45.448876 4769 reflector.go:561] object-"openstack-kuttl-tests"/"cert-keystone-internal-svc": failed to list *v1.Secret: secrets "cert-keystone-internal-svc" is forbidden: User "system:node:crc" cannot list resource "secrets" in API group "" in the namespace "openstack-kuttl-tests": no relationship found between node 'crc' and this object Nov 21 12:31:45 crc kubenswrapper[4769]: E1121 12:31:45.449055 4769 reflector.go:158] "Unhandled Error" err="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"cert-keystone-internal-svc\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.449107 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w45kf" Nov 21 12:31:45 crc kubenswrapper[4769]: W1121 12:31:45.449235 4769 reflector.go:561] object-"openstack-kuttl-tests"/"cert-keystone-public-svc": failed to list *v1.Secret: secrets "cert-keystone-public-svc" is forbidden: User "system:node:crc" cannot list resource "secrets" in API group "" in the namespace "openstack-kuttl-tests": no relationship found between node 'crc' and this object Nov 21 12:31:45 crc kubenswrapper[4769]: E1121 12:31:45.449271 4769 reflector.go:158] "Unhandled Error" err="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"cert-keystone-public-svc\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.449285 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-internal-tls-certs\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-fernet-keys\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462717 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-scripts\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kbx\" (UniqueName: \"kubernetes.io/projected/ea67e490-4830-43fd-9c9f-c7fdee996bdb-kube-api-access-c9kbx\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-credential-keys\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-config-data\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-combined-ca-bundle\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.462969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-public-tls-certs\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.464317 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-596f95c558-6zbwv"] Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.564654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-public-tls-certs\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.565022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-internal-tls-certs\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.565132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-fernet-keys\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.565302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-scripts\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.565401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kbx\" (UniqueName: \"kubernetes.io/projected/ea67e490-4830-43fd-9c9f-c7fdee996bdb-kube-api-access-c9kbx\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.565503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-credential-keys\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.565606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-config-data\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.566047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-combined-ca-bundle\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.575839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-credential-keys\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.576298 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-combined-ca-bundle\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.581136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-fernet-keys\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.583583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kbx\" (UniqueName: \"kubernetes.io/projected/ea67e490-4830-43fd-9c9f-c7fdee996bdb-kube-api-access-c9kbx\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.586630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-scripts\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.586691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-config-data\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.625590 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api-log" probeResult="failure" output="Get \"http://10.217.1.204:9322/\": read tcp 10.217.0.2:59318->10.217.1.204:9322: read: connection reset by peer" Nov 21 12:31:45 crc kubenswrapper[4769]: I1121 12:31:45.625621 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api" probeResult="failure" output="Get \"http://10.217.1.204:9322/\": read tcp 10.217.0.2:59310->10.217.1.204:9322: read: connection reset by peer" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.154085 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.188401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-combined-ca-bundle\") pod \"62baba1e-b4fd-4ade-9736-535792a555ce\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.188462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62baba1e-b4fd-4ade-9736-535792a555ce-logs\") pod \"62baba1e-b4fd-4ade-9736-535792a555ce\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.188527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-config-data\") pod \"62baba1e-b4fd-4ade-9736-535792a555ce\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.188575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-custom-prometheus-ca\") pod \"62baba1e-b4fd-4ade-9736-535792a555ce\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.188723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5vz5\" (UniqueName: \"kubernetes.io/projected/62baba1e-b4fd-4ade-9736-535792a555ce-kube-api-access-m5vz5\") pod \"62baba1e-b4fd-4ade-9736-535792a555ce\" (UID: \"62baba1e-b4fd-4ade-9736-535792a555ce\") " Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.189163 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62baba1e-b4fd-4ade-9736-535792a555ce-logs" (OuterVolumeSpecName: "logs") pod "62baba1e-b4fd-4ade-9736-535792a555ce" (UID: "62baba1e-b4fd-4ade-9736-535792a555ce"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.189291 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/62baba1e-b4fd-4ade-9736-535792a555ce-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.221823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62baba1e-b4fd-4ade-9736-535792a555ce-kube-api-access-m5vz5" (OuterVolumeSpecName: "kube-api-access-m5vz5") pod "62baba1e-b4fd-4ade-9736-535792a555ce" (UID: "62baba1e-b4fd-4ade-9736-535792a555ce"). InnerVolumeSpecName "kube-api-access-m5vz5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.259464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "62baba1e-b4fd-4ade-9736-535792a555ce" (UID: "62baba1e-b4fd-4ade-9736-535792a555ce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.294355 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m5vz5\" (UniqueName: \"kubernetes.io/projected/62baba1e-b4fd-4ade-9736-535792a555ce-kube-api-access-m5vz5\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.294590 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.315329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-config-data" (OuterVolumeSpecName: "config-data") pod "62baba1e-b4fd-4ade-9736-535792a555ce" (UID: "62baba1e-b4fd-4ade-9736-535792a555ce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.315948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.338296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "62baba1e-b4fd-4ade-9736-535792a555ce" (UID: "62baba1e-b4fd-4ade-9736-535792a555ce"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.346018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-internal-tls-certs\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.358436 4769 generic.go:334] "Generic (PLEG): container finished" podID="62baba1e-b4fd-4ade-9736-535792a555ce" containerID="51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8" exitCode=0 Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.358796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"62baba1e-b4fd-4ade-9736-535792a555ce","Type":"ContainerDied","Data":"51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8"} Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.358984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"62baba1e-b4fd-4ade-9736-535792a555ce","Type":"ContainerDied","Data":"015f5d945b47037598b13c9cd41947324f0d1bcfecd748574682324492ee524e"} Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.359084 4769 scope.go:117] "RemoveContainer" containerID="51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.359948 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.398705 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.398739 4769 reconciler_common.go:293] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/62baba1e-b4fd-4ade-9736-535792a555ce-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.403453 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.411056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-public-tls-certs\") pod \"keystone-596f95c558-6zbwv\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.452325 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.458018 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.480287 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:46 crc kubenswrapper[4769]: E1121 12:31:46.480703 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api-log" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.480723 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api-log" Nov 21 12:31:46 crc kubenswrapper[4769]: E1121 12:31:46.480752 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.480760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.480951 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api-log" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.480971 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" containerName="watcher-api" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.494460 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.494568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.497660 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-api-config-data" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.497931 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-watcher-internal-svc" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.498109 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-watcher-public-svc" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-public-tls-certs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-internal-tls-certs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpht5\" (UniqueName: \"kubernetes.io/projected/4347fb32-914b-4f7d-b004-fbf9f37ad56a-kube-api-access-hpht5\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4347fb32-914b-4f7d-b004-fbf9f37ad56a-logs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.500806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-config-data\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.607821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-config-data\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.608521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-public-tls-certs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.608694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-internal-tls-certs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.608790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hpht5\" (UniqueName: \"kubernetes.io/projected/4347fb32-914b-4f7d-b004-fbf9f37ad56a-kube-api-access-hpht5\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.608944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4347fb32-914b-4f7d-b004-fbf9f37ad56a-logs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.609063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.609141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.611432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4347fb32-914b-4f7d-b004-fbf9f37ad56a-logs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.613837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-public-tls-certs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.615171 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-custom-prometheus-ca\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.617314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-combined-ca-bundle\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.624061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-internal-tls-certs\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.628447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-config-data\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.628652 4769 scope.go:117] "RemoveContainer" containerID="6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.635309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpht5\" (UniqueName: \"kubernetes.io/projected/4347fb32-914b-4f7d-b004-fbf9f37ad56a-kube-api-access-hpht5\") pod \"watcher-api-0\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.668684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.737357 4769 scope.go:117] "RemoveContainer" containerID="51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8" Nov 21 12:31:46 crc kubenswrapper[4769]: E1121 12:31:46.742027 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8\": container with ID starting with 51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8 not found: ID does not exist" containerID="51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.742087 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8"} err="failed to get container status \"51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8\": rpc error: code = NotFound desc = could not find container \"51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8\": container with ID starting with 51cb25689a423cf7a65b3a1b83a63a206d398a68e56ab5f51f86f727489232e8 not found: ID does not exist" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.742124 4769 scope.go:117] "RemoveContainer" containerID="6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c" Nov 21 12:31:46 crc kubenswrapper[4769]: E1121 12:31:46.742634 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c\": container with ID starting with 6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c not found: ID does not exist" containerID="6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.742671 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c"} err="failed to get container status \"6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c\": rpc error: code = NotFound desc = could not find container \"6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c\": container with ID starting with 6306f74c186260c69454a85a154e196aa1553a053cbb9340afbf229585e3938c not found: ID does not exist" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.828724 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:46 crc kubenswrapper[4769]: I1121 12:31:46.967918 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.023560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-combined-ca-bundle\") pod \"3c045a84-b18c-4a40-864a-3174b38706f4\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.024030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-db-sync-config-data\") pod \"3c045a84-b18c-4a40-864a-3174b38706f4\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.024083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-config-data\") pod \"3c045a84-b18c-4a40-864a-3174b38706f4\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.024114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5jxz\" (UniqueName: \"kubernetes.io/projected/3c045a84-b18c-4a40-864a-3174b38706f4-kube-api-access-f5jxz\") pod \"3c045a84-b18c-4a40-864a-3174b38706f4\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.024141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3c045a84-b18c-4a40-864a-3174b38706f4-etc-machine-id\") pod \"3c045a84-b18c-4a40-864a-3174b38706f4\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.024162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-scripts\") pod \"3c045a84-b18c-4a40-864a-3174b38706f4\" (UID: \"3c045a84-b18c-4a40-864a-3174b38706f4\") " Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.031669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-scripts" (OuterVolumeSpecName: "scripts") pod "3c045a84-b18c-4a40-864a-3174b38706f4" (UID: "3c045a84-b18c-4a40-864a-3174b38706f4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.031718 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3c045a84-b18c-4a40-864a-3174b38706f4-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3c045a84-b18c-4a40-864a-3174b38706f4" (UID: "3c045a84-b18c-4a40-864a-3174b38706f4"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.035661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c045a84-b18c-4a40-864a-3174b38706f4-kube-api-access-f5jxz" (OuterVolumeSpecName: "kube-api-access-f5jxz") pod "3c045a84-b18c-4a40-864a-3174b38706f4" (UID: "3c045a84-b18c-4a40-864a-3174b38706f4"). InnerVolumeSpecName "kube-api-access-f5jxz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.053685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "3c045a84-b18c-4a40-864a-3174b38706f4" (UID: "3c045a84-b18c-4a40-864a-3174b38706f4"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.107383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c045a84-b18c-4a40-864a-3174b38706f4" (UID: "3c045a84-b18c-4a40-864a-3174b38706f4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.129129 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-config-data" (OuterVolumeSpecName: "config-data") pod "3c045a84-b18c-4a40-864a-3174b38706f4" (UID: "3c045a84-b18c-4a40-864a-3174b38706f4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.130638 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.130690 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.130707 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.130722 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f5jxz\" (UniqueName: \"kubernetes.io/projected/3c045a84-b18c-4a40-864a-3174b38706f4-kube-api-access-f5jxz\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.130739 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3c045a84-b18c-4a40-864a-3174b38706f4-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.130752 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c045a84-b18c-4a40-864a-3174b38706f4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.293165 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62baba1e-b4fd-4ade-9736-535792a555ce" path="/var/lib/kubelet/pods/62baba1e-b4fd-4ade-9736-535792a555ce/volumes" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.381428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" event={"ID":"3c045a84-b18c-4a40-864a-3174b38706f4","Type":"ContainerDied","Data":"74ac98789ee728518b3680010e3794545aa63b387f5389fe92cf3903357e3079"} Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.381480 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74ac98789ee728518b3680010e3794545aa63b387f5389fe92cf3903357e3079" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.381560 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-dqj8s" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.425079 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-596f95c558-6zbwv"] Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.618122 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.718904 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:31:47 crc kubenswrapper[4769]: E1121 12:31:47.719264 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c045a84-b18c-4a40-864a-3174b38706f4" containerName="cinder-db-sync" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.719280 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c045a84-b18c-4a40-864a-3174b38706f4" containerName="cinder-db-sync" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.719486 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c045a84-b18c-4a40-864a-3174b38706f4" containerName="cinder-db-sync" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.720551 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.726587 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.726967 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-bz42l" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.727104 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.727233 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.747713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.762219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.762325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-scripts\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.762353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7626ddce-90a0-4348-baa1-1fc5e7211b3f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.762381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.762418 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.762447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p45p2\" (UniqueName: \"kubernetes.io/projected/7626ddce-90a0-4348-baa1-1fc5e7211b3f-kube-api-access-p45p2\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.864577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-scripts\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.864634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7626ddce-90a0-4348-baa1-1fc5e7211b3f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.864664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.864701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.864731 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p45p2\" (UniqueName: \"kubernetes.io/projected/7626ddce-90a0-4348-baa1-1fc5e7211b3f-kube-api-access-p45p2\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.864768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.871355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.871431 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7626ddce-90a0-4348-baa1-1fc5e7211b3f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.876999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-scripts\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.881262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.885886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.950988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p45p2\" (UniqueName: \"kubernetes.io/projected/7626ddce-90a0-4348-baa1-1fc5e7211b3f-kube-api-access-p45p2\") pod \"cinder-scheduler-0\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:47 crc kubenswrapper[4769]: I1121 12:31:47.983683 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.156956 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.158773 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.171946 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.172717 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.280867 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8zjm\" (UniqueName: \"kubernetes.io/projected/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-kube-api-access-z8zjm\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.280951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-logs\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.281019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data-custom\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.281055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.281090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.281132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-scripts\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.281180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zjm\" (UniqueName: \"kubernetes.io/projected/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-kube-api-access-z8zjm\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-logs\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data-custom\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-scripts\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.383952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.389176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-scripts\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.390835 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.396715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.397490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-logs\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.399808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data-custom\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.405220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8zjm\" (UniqueName: \"kubernetes.io/projected/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-kube-api-access-z8zjm\") pod \"cinder-api-0\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.413676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"4347fb32-914b-4f7d-b004-fbf9f37ad56a","Type":"ContainerStarted","Data":"7a61d42d53c7a5001181881ba7c9957c7c38c404d61460362a434aaf1d326d06"} Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.413743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"4347fb32-914b-4f7d-b004-fbf9f37ad56a","Type":"ContainerStarted","Data":"3bd22d88dcfb71840c1892dd9795724d3ecbb69d6f4a54c013af73c5b6bd7dcf"} Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.439041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" event={"ID":"ea67e490-4830-43fd-9c9f-c7fdee996bdb","Type":"ContainerStarted","Data":"c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c"} Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.439096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" event={"ID":"ea67e490-4830-43fd-9c9f-c7fdee996bdb","Type":"ContainerStarted","Data":"8aee9b2e05a60a58cf945d3bb06ceadf85c291d8f05a8fa81765a62b45354a55"} Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.464653 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.485176 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.681604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.719325 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" podStartSLOduration=3.719304077 podStartE2EDuration="3.719304077s" podCreationTimestamp="2025-11-21 12:31:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:48.512170955 +0000 UTC m=+2467.212832773" watchObservedRunningTime="2025-11-21 12:31:48.719304077 +0000 UTC m=+2467.419965895" Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.764948 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:31:48 crc kubenswrapper[4769]: I1121 12:31:48.826659 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:49 crc kubenswrapper[4769]: I1121 12:31:49.241071 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:49 crc kubenswrapper[4769]: I1121 12:31:49.480005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13","Type":"ContainerStarted","Data":"9c13b16d14c8de09badedefe25cc53cde01ec6cc8170cb1c4a6e491fc74ebc68"} Nov 21 12:31:49 crc kubenswrapper[4769]: I1121 12:31:49.481109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"7626ddce-90a0-4348-baa1-1fc5e7211b3f","Type":"ContainerStarted","Data":"d88165948666fe66d7c07eda2f84dde8998e75e1aa2350ff1d1c5d7eee804654"} Nov 21 12:31:49 crc kubenswrapper[4769]: I1121 12:31:49.484033 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"4347fb32-914b-4f7d-b004-fbf9f37ad56a","Type":"ContainerStarted","Data":"97513b514876280e1e80fe5e0696d9edf096c20ec2eb3eac3602c5016731f05f"} Nov 21 12:31:49 crc kubenswrapper[4769]: I1121 12:31:49.484064 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:50 crc kubenswrapper[4769]: I1121 12:31:50.493854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"7626ddce-90a0-4348-baa1-1fc5e7211b3f","Type":"ContainerStarted","Data":"20c27254702b4fa7940f91823834b5444bcbf3424ad0315af3dd48b73ee8015c"} Nov 21 12:31:50 crc kubenswrapper[4769]: I1121 12:31:50.577132 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-api-0" podStartSLOduration=4.577113533 podStartE2EDuration="4.577113533s" podCreationTimestamp="2025-11-21 12:31:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:49.50472981 +0000 UTC m=+2468.205391628" watchObservedRunningTime="2025-11-21 12:31:50.577113533 +0000 UTC m=+2469.277775351" Nov 21 12:31:50 crc kubenswrapper[4769]: I1121 12:31:50.584178 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:51 crc kubenswrapper[4769]: I1121 12:31:51.421579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:51 crc kubenswrapper[4769]: I1121 12:31:51.592458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13","Type":"ContainerStarted","Data":"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25"} Nov 21 12:31:51 crc kubenswrapper[4769]: I1121 12:31:51.830043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:51 crc kubenswrapper[4769]: I1121 12:31:51.830306 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:31:51 crc kubenswrapper[4769]: I1121 12:31:51.968221 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.127864 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.199404 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq"] Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.199638 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api-log" containerID="cri-o://7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69" gracePeriod=30 Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.199906 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api" containerID="cri-o://4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8" gracePeriod=30 Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.208539 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.213:9311/healthcheck\": EOF" Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.614463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"7626ddce-90a0-4348-baa1-1fc5e7211b3f","Type":"ContainerStarted","Data":"486903eae1c7ad4a823269cc1fa933f42934bcc612cc37cc2929fd91f8a27d52"} Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.622276 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api-log" containerID="cri-o://218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25" gracePeriod=30 Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.622378 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api" containerID="cri-o://8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2" gracePeriod=30 Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.622547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13","Type":"ContainerStarted","Data":"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2"} Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.623406 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.628014 4769 generic.go:334] "Generic (PLEG): container finished" podID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerID="7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69" exitCode=143 Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.628174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" event={"ID":"b54407c2-ed80-466e-92b7-4a2c597f8dc0","Type":"ContainerDied","Data":"7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69"} Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.662257 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.662234645 podStartE2EDuration="4.662234645s" podCreationTimestamp="2025-11-21 12:31:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:52.660401564 +0000 UTC m=+2471.361063382" watchObservedRunningTime="2025-11-21 12:31:52.662234645 +0000 UTC m=+2471.362896453" Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.665174 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.665165015 podStartE2EDuration="5.665165015s" podCreationTimestamp="2025-11-21 12:31:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:52.64496604 +0000 UTC m=+2471.345627878" watchObservedRunningTime="2025-11-21 12:31:52.665165015 +0000 UTC m=+2471.365826833" Nov 21 12:31:52 crc kubenswrapper[4769]: I1121 12:31:52.984855 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.290371 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-etc-machine-id\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data-custom\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8zjm\" (UniqueName: \"kubernetes.io/projected/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-kube-api-access-z8zjm\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-combined-ca-bundle\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-logs\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.410778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-scripts\") pod \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\" (UID: \"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13\") " Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.411833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.414587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-logs" (OuterVolumeSpecName: "logs") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.418690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-scripts" (OuterVolumeSpecName: "scripts") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.420412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.422475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-kube-api-access-z8zjm" (OuterVolumeSpecName: "kube-api-access-z8zjm") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "kube-api-access-z8zjm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.473428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.486840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data" (OuterVolumeSpecName: "config-data") pod "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" (UID: "4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.512808 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.512978 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.513060 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.513118 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.513189 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.513337 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.513403 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z8zjm\" (UniqueName: \"kubernetes.io/projected/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13-kube-api-access-z8zjm\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.640941 4769 generic.go:334] "Generic (PLEG): container finished" podID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerID="8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2" exitCode=0 Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.640974 4769 generic.go:334] "Generic (PLEG): container finished" podID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerID="218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25" exitCode=143 Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.641024 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.641023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13","Type":"ContainerDied","Data":"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2"} Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.641099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13","Type":"ContainerDied","Data":"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25"} Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.641112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13","Type":"ContainerDied","Data":"9c13b16d14c8de09badedefe25cc53cde01ec6cc8170cb1c4a6e491fc74ebc68"} Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.641139 4769 scope.go:117] "RemoveContainer" containerID="8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.667348 4769 scope.go:117] "RemoveContainer" containerID="218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.685409 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.701845 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.703675 4769 scope.go:117] "RemoveContainer" containerID="8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2" Nov 21 12:31:53 crc kubenswrapper[4769]: E1121 12:31:53.704302 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2\": container with ID starting with 8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2 not found: ID does not exist" containerID="8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.704339 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2"} err="failed to get container status \"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2\": rpc error: code = NotFound desc = could not find container \"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2\": container with ID starting with 8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2 not found: ID does not exist" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.704369 4769 scope.go:117] "RemoveContainer" containerID="218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25" Nov 21 12:31:53 crc kubenswrapper[4769]: E1121 12:31:53.708403 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25\": container with ID starting with 218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25 not found: ID does not exist" containerID="218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.708474 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25"} err="failed to get container status \"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25\": rpc error: code = NotFound desc = could not find container \"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25\": container with ID starting with 218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25 not found: ID does not exist" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.708515 4769 scope.go:117] "RemoveContainer" containerID="8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.709428 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2"} err="failed to get container status \"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2\": rpc error: code = NotFound desc = could not find container \"8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2\": container with ID starting with 8abc1b91296c2fc35c26998ca3582fb77445c307c478a80a090d86ecbedb1cb2 not found: ID does not exist" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.709480 4769 scope.go:117] "RemoveContainer" containerID="218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.710094 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25"} err="failed to get container status \"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25\": rpc error: code = NotFound desc = could not find container \"218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25\": container with ID starting with 218cd46bb65e5191bc0815ec543ec5ffdfff5a5d1306227c9f2a33ca9734fb25 not found: ID does not exist" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.715254 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:53 crc kubenswrapper[4769]: E1121 12:31:53.715871 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.715894 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api" Nov 21 12:31:53 crc kubenswrapper[4769]: E1121 12:31:53.715933 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api-log" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.715942 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api-log" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.716186 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.716218 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" containerName="cinder-api-log" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.728646 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.731088 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.731495 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.744112 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.747668 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.862735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863257 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c41b549-737e-4157-bbd6-e049ab34a8e4-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863417 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863532 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-scripts\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863625 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c41b549-737e-4157-bbd6-e049ab34a8e4-logs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data-custom\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.863936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqg5n\" (UniqueName: \"kubernetes.io/projected/0c41b549-737e-4157-bbd6-e049ab34a8e4-kube-api-access-kqg5n\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.966071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-scripts\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.967383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c41b549-737e-4157-bbd6-e049ab34a8e4-logs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.967540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data-custom\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.967680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.967795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kqg5n\" (UniqueName: \"kubernetes.io/projected/0c41b549-737e-4157-bbd6-e049ab34a8e4-kube-api-access-kqg5n\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.967947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.968067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.968241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c41b549-737e-4157-bbd6-e049ab34a8e4-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.968494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c41b549-737e-4157-bbd6-e049ab34a8e4-logs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.968516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.971469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c41b549-737e-4157-bbd6-e049ab34a8e4-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.973495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.973938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-scripts\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.974522 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.982422 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.982572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.986797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqg5n\" (UniqueName: \"kubernetes.io/projected/0c41b549-737e-4157-bbd6-e049ab34a8e4-kube-api-access-kqg5n\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:53 crc kubenswrapper[4769]: I1121 12:31:53.991048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data-custom\") pod \"cinder-api-0\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:54 crc kubenswrapper[4769]: I1121 12:31:54.089525 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:54 crc kubenswrapper[4769]: I1121 12:31:54.275314 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:31:54 crc kubenswrapper[4769]: E1121 12:31:54.276042 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:31:54 crc kubenswrapper[4769]: I1121 12:31:54.578183 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:31:54 crc kubenswrapper[4769]: I1121 12:31:54.656882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c41b549-737e-4157-bbd6-e049ab34a8e4","Type":"ContainerStarted","Data":"b771196fef7069c0b68f8212dc20de729f034071a924e4823c61db9b5a3adc55"} Nov 21 12:31:55 crc kubenswrapper[4769]: I1121 12:31:55.284945 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13" path="/var/lib/kubelet/pods/4e6895dd-2ab0-4bb5-bdbd-84bf0b591c13/volumes" Nov 21 12:31:55 crc kubenswrapper[4769]: I1121 12:31:55.683550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c41b549-737e-4157-bbd6-e049ab34a8e4","Type":"ContainerStarted","Data":"b9714013a9d9c36f5790c7927330bdcdbdb1247efaba98f65df513d451a4ddd3"} Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.621666 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.213:9311/healthcheck\": read tcp 10.217.0.2:53286->10.217.1.213:9311: read: connection reset by peer" Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.621730 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.213:9311/healthcheck\": read tcp 10.217.0.2:53290->10.217.1.213:9311: read: connection reset by peer" Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.700547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c41b549-737e-4157-bbd6-e049ab34a8e4","Type":"ContainerStarted","Data":"c2e35c65ee3281a8868c169717e85e16448db47322ae56d14fb755ce2df5fd31"} Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.701131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.744941 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.744918061 podStartE2EDuration="3.744918061s" podCreationTimestamp="2025-11-21 12:31:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:31:56.724758589 +0000 UTC m=+2475.425420457" watchObservedRunningTime="2025-11-21 12:31:56.744918061 +0000 UTC m=+2475.445579879" Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.829675 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:56 crc kubenswrapper[4769]: I1121 12:31:56.839584 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.208062 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.342370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b54407c2-ed80-466e-92b7-4a2c597f8dc0-logs\") pod \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.342892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-combined-ca-bundle\") pod \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.343054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7vr9\" (UniqueName: \"kubernetes.io/projected/b54407c2-ed80-466e-92b7-4a2c597f8dc0-kube-api-access-g7vr9\") pod \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.343249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data-custom\") pod \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.343275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b54407c2-ed80-466e-92b7-4a2c597f8dc0-logs" (OuterVolumeSpecName: "logs") pod "b54407c2-ed80-466e-92b7-4a2c597f8dc0" (UID: "b54407c2-ed80-466e-92b7-4a2c597f8dc0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.343407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data\") pod \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\" (UID: \"b54407c2-ed80-466e-92b7-4a2c597f8dc0\") " Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.344944 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b54407c2-ed80-466e-92b7-4a2c597f8dc0-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.348646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b54407c2-ed80-466e-92b7-4a2c597f8dc0" (UID: "b54407c2-ed80-466e-92b7-4a2c597f8dc0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.354631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54407c2-ed80-466e-92b7-4a2c597f8dc0-kube-api-access-g7vr9" (OuterVolumeSpecName: "kube-api-access-g7vr9") pod "b54407c2-ed80-466e-92b7-4a2c597f8dc0" (UID: "b54407c2-ed80-466e-92b7-4a2c597f8dc0"). InnerVolumeSpecName "kube-api-access-g7vr9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.384968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b54407c2-ed80-466e-92b7-4a2c597f8dc0" (UID: "b54407c2-ed80-466e-92b7-4a2c597f8dc0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.428409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data" (OuterVolumeSpecName: "config-data") pod "b54407c2-ed80-466e-92b7-4a2c597f8dc0" (UID: "b54407c2-ed80-466e-92b7-4a2c597f8dc0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.447287 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.447321 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g7vr9\" (UniqueName: \"kubernetes.io/projected/b54407c2-ed80-466e-92b7-4a2c597f8dc0-kube-api-access-g7vr9\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.447332 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.447343 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b54407c2-ed80-466e-92b7-4a2c597f8dc0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.719332 4769 generic.go:334] "Generic (PLEG): container finished" podID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerID="4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8" exitCode=0 Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.721652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" event={"ID":"b54407c2-ed80-466e-92b7-4a2c597f8dc0","Type":"ContainerDied","Data":"4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8"} Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.721757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" event={"ID":"b54407c2-ed80-466e-92b7-4a2c597f8dc0","Type":"ContainerDied","Data":"59d5039f7fad6e45980bfe8eea152d642ff623d6b419d5af75d04af38b2c1c60"} Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.721828 4769 scope.go:117] "RemoveContainer" containerID="4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.722837 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.734828 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.761944 4769 scope.go:117] "RemoveContainer" containerID="7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.805430 4769 scope.go:117] "RemoveContainer" containerID="4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8" Nov 21 12:31:57 crc kubenswrapper[4769]: E1121 12:31:57.805969 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8\": container with ID starting with 4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8 not found: ID does not exist" containerID="4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.806010 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8"} err="failed to get container status \"4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8\": rpc error: code = NotFound desc = could not find container \"4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8\": container with ID starting with 4a1672b421efbccab7756c2a25c90aa05c736d4b585e3a43c25406d80c74aef8 not found: ID does not exist" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.806034 4769 scope.go:117] "RemoveContainer" containerID="7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69" Nov 21 12:31:57 crc kubenswrapper[4769]: E1121 12:31:57.806556 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69\": container with ID starting with 7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69 not found: ID does not exist" containerID="7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.806582 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69"} err="failed to get container status \"7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69\": rpc error: code = NotFound desc = could not find container \"7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69\": container with ID starting with 7b095736ae24934018c1ca6f67def8849db80e6107510ba8f0f99f4bbbfa5e69 not found: ID does not exist" Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.819170 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq"] Nov 21 12:31:57 crc kubenswrapper[4769]: I1121 12:31:57.828973 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcfc7bb64-zlbhq"] Nov 21 12:31:58 crc kubenswrapper[4769]: I1121 12:31:58.179988 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:31:58 crc kubenswrapper[4769]: I1121 12:31:58.221950 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:31:58 crc kubenswrapper[4769]: I1121 12:31:58.730819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="cinder-scheduler" containerID="cri-o://20c27254702b4fa7940f91823834b5444bcbf3424ad0315af3dd48b73ee8015c" gracePeriod=30 Nov 21 12:31:58 crc kubenswrapper[4769]: I1121 12:31:58.730953 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="probe" containerID="cri-o://486903eae1c7ad4a823269cc1fa933f42934bcc612cc37cc2929fd91f8a27d52" gracePeriod=30 Nov 21 12:31:59 crc kubenswrapper[4769]: I1121 12:31:59.290459 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" path="/var/lib/kubelet/pods/b54407c2-ed80-466e-92b7-4a2c597f8dc0/volumes" Nov 21 12:31:59 crc kubenswrapper[4769]: I1121 12:31:59.747294 4769 generic.go:334] "Generic (PLEG): container finished" podID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerID="486903eae1c7ad4a823269cc1fa933f42934bcc612cc37cc2929fd91f8a27d52" exitCode=0 Nov 21 12:31:59 crc kubenswrapper[4769]: I1121 12:31:59.747366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"7626ddce-90a0-4348-baa1-1fc5e7211b3f","Type":"ContainerDied","Data":"486903eae1c7ad4a823269cc1fa933f42934bcc612cc37cc2929fd91f8a27d52"} Nov 21 12:32:02 crc kubenswrapper[4769]: I1121 12:32:02.066882 4769 scope.go:117] "RemoveContainer" containerID="cbc7b6719dc33739b3cc3419412acb933db61b24cefbd4887a712fc0cb0fa006" Nov 21 12:32:02 crc kubenswrapper[4769]: I1121 12:32:02.808360 4769 generic.go:334] "Generic (PLEG): container finished" podID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerID="20c27254702b4fa7940f91823834b5444bcbf3424ad0315af3dd48b73ee8015c" exitCode=0 Nov 21 12:32:02 crc kubenswrapper[4769]: I1121 12:32:02.809004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"7626ddce-90a0-4348-baa1-1fc5e7211b3f","Type":"ContainerDied","Data":"20c27254702b4fa7940f91823834b5444bcbf3424ad0315af3dd48b73ee8015c"} Nov 21 12:32:02 crc kubenswrapper[4769]: I1121 12:32:02.969972 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.069947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data-custom\") pod \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.070107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data\") pod \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.070136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7626ddce-90a0-4348-baa1-1fc5e7211b3f-etc-machine-id\") pod \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.070164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-scripts\") pod \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.070231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-combined-ca-bundle\") pod \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.070272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p45p2\" (UniqueName: \"kubernetes.io/projected/7626ddce-90a0-4348-baa1-1fc5e7211b3f-kube-api-access-p45p2\") pod \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\" (UID: \"7626ddce-90a0-4348-baa1-1fc5e7211b3f\") " Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.071841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7626ddce-90a0-4348-baa1-1fc5e7211b3f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7626ddce-90a0-4348-baa1-1fc5e7211b3f" (UID: "7626ddce-90a0-4348-baa1-1fc5e7211b3f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.089096 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7626ddce-90a0-4348-baa1-1fc5e7211b3f" (UID: "7626ddce-90a0-4348-baa1-1fc5e7211b3f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.090209 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-scripts" (OuterVolumeSpecName: "scripts") pod "7626ddce-90a0-4348-baa1-1fc5e7211b3f" (UID: "7626ddce-90a0-4348-baa1-1fc5e7211b3f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.092585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7626ddce-90a0-4348-baa1-1fc5e7211b3f-kube-api-access-p45p2" (OuterVolumeSpecName: "kube-api-access-p45p2") pod "7626ddce-90a0-4348-baa1-1fc5e7211b3f" (UID: "7626ddce-90a0-4348-baa1-1fc5e7211b3f"). InnerVolumeSpecName "kube-api-access-p45p2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.152430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7626ddce-90a0-4348-baa1-1fc5e7211b3f" (UID: "7626ddce-90a0-4348-baa1-1fc5e7211b3f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.172628 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.172847 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.172907 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p45p2\" (UniqueName: \"kubernetes.io/projected/7626ddce-90a0-4348-baa1-1fc5e7211b3f-kube-api-access-p45p2\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.172961 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.173038 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7626ddce-90a0-4348-baa1-1fc5e7211b3f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.208398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data" (OuterVolumeSpecName: "config-data") pod "7626ddce-90a0-4348-baa1-1fc5e7211b3f" (UID: "7626ddce-90a0-4348-baa1-1fc5e7211b3f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.275021 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7626ddce-90a0-4348-baa1-1fc5e7211b3f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.678767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.819521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"7626ddce-90a0-4348-baa1-1fc5e7211b3f","Type":"ContainerDied","Data":"d88165948666fe66d7c07eda2f84dde8998e75e1aa2350ff1d1c5d7eee804654"} Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.820017 4769 scope.go:117] "RemoveContainer" containerID="486903eae1c7ad4a823269cc1fa933f42934bcc612cc37cc2929fd91f8a27d52" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.819730 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.880348 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.881279 4769 scope.go:117] "RemoveContainer" containerID="20c27254702b4fa7940f91823834b5444bcbf3424ad0315af3dd48b73ee8015c" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.899693 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.932614 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:32:03 crc kubenswrapper[4769]: E1121 12:32:03.933076 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api-log" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api-log" Nov 21 12:32:03 crc kubenswrapper[4769]: E1121 12:32:03.933111 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api" Nov 21 12:32:03 crc kubenswrapper[4769]: E1121 12:32:03.933144 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="probe" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933154 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="probe" Nov 21 12:32:03 crc kubenswrapper[4769]: E1121 12:32:03.933180 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="cinder-scheduler" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933205 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="cinder-scheduler" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933438 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api-log" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933457 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="probe" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933470 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b54407c2-ed80-466e-92b7-4a2c597f8dc0" containerName="barbican-api" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.933492 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" containerName="cinder-scheduler" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.934623 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.937904 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:32:03 crc kubenswrapper[4769]: I1121 12:32:03.972247 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.095894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.095944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-scripts\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.095999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d1356b93-35d5-4255-910a-e18282520848-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.096028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.096095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd88r\" (UniqueName: \"kubernetes.io/projected/d1356b93-35d5-4255-910a-e18282520848-kube-api-access-gd88r\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.096129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.153787 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.166351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.198299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d1356b93-35d5-4255-910a-e18282520848-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.198403 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.198543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gd88r\" (UniqueName: \"kubernetes.io/projected/d1356b93-35d5-4255-910a-e18282520848-kube-api-access-gd88r\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.198597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.198635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.198668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-scripts\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.199303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d1356b93-35d5-4255-910a-e18282520848-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.230946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.231274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.233696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.234154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-scripts\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.248407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd88r\" (UniqueName: \"kubernetes.io/projected/d1356b93-35d5-4255-910a-e18282520848-kube-api-access-gd88r\") pod \"cinder-scheduler-0\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.323087 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:04 crc kubenswrapper[4769]: I1121 12:32:04.815041 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:32:05 crc kubenswrapper[4769]: I1121 12:32:05.283437 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:32:05 crc kubenswrapper[4769]: E1121 12:32:05.284461 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:32:05 crc kubenswrapper[4769]: I1121 12:32:05.296718 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7626ddce-90a0-4348-baa1-1fc5e7211b3f" path="/var/lib/kubelet/pods/7626ddce-90a0-4348-baa1-1fc5e7211b3f/volumes" Nov 21 12:32:05 crc kubenswrapper[4769]: I1121 12:32:05.847050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d1356b93-35d5-4255-910a-e18282520848","Type":"ContainerStarted","Data":"15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a"} Nov 21 12:32:05 crc kubenswrapper[4769]: I1121 12:32:05.847439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d1356b93-35d5-4255-910a-e18282520848","Type":"ContainerStarted","Data":"b1007a26a78f8b02bd47aab6ed56e2d29105f67cfbb1a1edfc6c3e2659a750e3"} Nov 21 12:32:06 crc kubenswrapper[4769]: I1121 12:32:06.033988 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:32:06 crc kubenswrapper[4769]: I1121 12:32:06.860899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d1356b93-35d5-4255-910a-e18282520848","Type":"ContainerStarted","Data":"2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776"} Nov 21 12:32:06 crc kubenswrapper[4769]: I1121 12:32:06.892623 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.89258118 podStartE2EDuration="3.89258118s" podCreationTimestamp="2025-11-21 12:32:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:06.882786737 +0000 UTC m=+2485.583448595" watchObservedRunningTime="2025-11-21 12:32:06.89258118 +0000 UTC m=+2485.593243038" Nov 21 12:32:09 crc kubenswrapper[4769]: I1121 12:32:09.324092 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:14 crc kubenswrapper[4769]: I1121 12:32:14.569709 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:32:18 crc kubenswrapper[4769]: I1121 12:32:18.275353 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:32:18 crc kubenswrapper[4769]: E1121 12:32:18.276572 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:32:19 crc kubenswrapper[4769]: I1121 12:32:19.536278 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:32:22 crc kubenswrapper[4769]: I1121 12:32:22.840578 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:32:22 crc kubenswrapper[4769]: I1121 12:32:22.847990 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:22 crc kubenswrapper[4769]: I1121 12:32:22.850897 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:32:22 crc kubenswrapper[4769]: I1121 12:32:22.851153 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:32:22 crc kubenswrapper[4769]: I1121 12:32:22.851493 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-6b65k" Nov 21 12:32:22 crc kubenswrapper[4769]: I1121 12:32:22.855792 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.001303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.001376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x747\" (UniqueName: \"kubernetes.io/projected/f0aaaf62-6314-4f0c-a148-78659ed61770-kube-api-access-2x747\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.001765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-combined-ca-bundle\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.001843 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.103495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-combined-ca-bundle\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.103589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.103649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.103716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2x747\" (UniqueName: \"kubernetes.io/projected/f0aaaf62-6314-4f0c-a148-78659ed61770-kube-api-access-2x747\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.105743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.117806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.120589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-combined-ca-bundle\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.131138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x747\" (UniqueName: \"kubernetes.io/projected/f0aaaf62-6314-4f0c-a148-78659ed61770-kube-api-access-2x747\") pod \"openstackclient\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.170796 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:32:23 crc kubenswrapper[4769]: I1121 12:32:23.706412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:32:24 crc kubenswrapper[4769]: I1121 12:32:24.061875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"f0aaaf62-6314-4f0c-a148-78659ed61770","Type":"ContainerStarted","Data":"84a1cbe96aa3f72c3321d6be9f0d078272780d29aa0a9773789cb1865a6c9304"} Nov 21 12:32:24 crc kubenswrapper[4769]: I1121 12:32:24.061924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"f0aaaf62-6314-4f0c-a148-78659ed61770","Type":"ContainerStarted","Data":"9fb0ee4158d2fc5ba8489f762ad94a70c4a33c4f2d5ff433ed62ce4832dd98c7"} Nov 21 12:32:25 crc kubenswrapper[4769]: I1121 12:32:25.097033 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=3.09701824 podStartE2EDuration="3.09701824s" podCreationTimestamp="2025-11-21 12:32:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:25.089074096 +0000 UTC m=+2503.789735914" watchObservedRunningTime="2025-11-21 12:32:25.09701824 +0000 UTC m=+2503.797680058" Nov 21 12:32:26 crc kubenswrapper[4769]: I1121 12:32:26.086574 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c7dd89d-4bef-4705-8620-65e04392d17a" containerID="3d99fd2f630e92494ce24d32a3927ec6f6be113f58944ac8ea7f42cedf020604" exitCode=0 Nov 21 12:32:26 crc kubenswrapper[4769]: I1121 12:32:26.086697 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" event={"ID":"7c7dd89d-4bef-4705-8620-65e04392d17a","Type":"ContainerDied","Data":"3d99fd2f630e92494ce24d32a3927ec6f6be113f58944ac8ea7f42cedf020604"} Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.461146 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.597781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzpwc\" (UniqueName: \"kubernetes.io/projected/7c7dd89d-4bef-4705-8620-65e04392d17a-kube-api-access-dzpwc\") pod \"7c7dd89d-4bef-4705-8620-65e04392d17a\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.598012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-config\") pod \"7c7dd89d-4bef-4705-8620-65e04392d17a\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.598039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-combined-ca-bundle\") pod \"7c7dd89d-4bef-4705-8620-65e04392d17a\" (UID: \"7c7dd89d-4bef-4705-8620-65e04392d17a\") " Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.613584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c7dd89d-4bef-4705-8620-65e04392d17a-kube-api-access-dzpwc" (OuterVolumeSpecName: "kube-api-access-dzpwc") pod "7c7dd89d-4bef-4705-8620-65e04392d17a" (UID: "7c7dd89d-4bef-4705-8620-65e04392d17a"). InnerVolumeSpecName "kube-api-access-dzpwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.639179 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c7dd89d-4bef-4705-8620-65e04392d17a" (UID: "7c7dd89d-4bef-4705-8620-65e04392d17a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.654822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-config" (OuterVolumeSpecName: "config") pod "7c7dd89d-4bef-4705-8620-65e04392d17a" (UID: "7c7dd89d-4bef-4705-8620-65e04392d17a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.700124 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dzpwc\" (UniqueName: \"kubernetes.io/projected/7c7dd89d-4bef-4705-8620-65e04392d17a-kube-api-access-dzpwc\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.700161 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.700173 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c7dd89d-4bef-4705-8620-65e04392d17a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.704543 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-8697448848-f5nl9"] Nov 21 12:32:27 crc kubenswrapper[4769]: E1121 12:32:27.704941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c7dd89d-4bef-4705-8620-65e04392d17a" containerName="neutron-db-sync" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.704958 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c7dd89d-4bef-4705-8620-65e04392d17a" containerName="neutron-db-sync" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.705126 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c7dd89d-4bef-4705-8620-65e04392d17a" containerName="neutron-db-sync" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.706091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.710819 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.711049 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.713407 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.718901 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8697448848-f5nl9"] Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.802368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-log-httpd\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.802874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-run-httpd\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.802917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-public-tls-certs\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.802945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-etc-swift\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.802994 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-internal-tls-certs\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.803027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-config-data\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.803069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ktxr\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-kube-api-access-5ktxr\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.803141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-combined-ca-bundle\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-combined-ca-bundle\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-log-httpd\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-run-httpd\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-public-tls-certs\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-etc-swift\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904600 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-internal-tls-certs\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-config-data\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.904657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5ktxr\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-kube-api-access-5ktxr\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.905048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-run-httpd\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.905391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-log-httpd\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.911392 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-public-tls-certs\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.911850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-config-data\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.913381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-combined-ca-bundle\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.913765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-internal-tls-certs\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.914791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-etc-swift\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:27 crc kubenswrapper[4769]: I1121 12:32:27.926018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ktxr\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-kube-api-access-5ktxr\") pod \"swift-proxy-8697448848-f5nl9\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.023266 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.123990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" event={"ID":"7c7dd89d-4bef-4705-8620-65e04392d17a","Type":"ContainerDied","Data":"ce3b5810e4e7665a90ee515eaf104ebf0fdd0212b36b5222b74138145c9cced7"} Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.124059 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce3b5810e4e7665a90ee515eaf104ebf0fdd0212b36b5222b74138145c9cced7" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.124165 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-d9t94" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.287801 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr"] Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.291275 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.298544 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.298778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.298901 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.303850 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr"] Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.309526 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-r4k4s" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.430137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-httpd-config\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.430206 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-ovndb-tls-certs\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.430317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-config\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.430370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ptbl\" (UniqueName: \"kubernetes.io/projected/a12216e8-3323-4cd2-a422-387689dcdf22-kube-api-access-6ptbl\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.430392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-combined-ca-bundle\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.509449 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8697448848-f5nl9"] Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.614893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-config\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.615131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6ptbl\" (UniqueName: \"kubernetes.io/projected/a12216e8-3323-4cd2-a422-387689dcdf22-kube-api-access-6ptbl\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.615175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-combined-ca-bundle\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.615339 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-httpd-config\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.615466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-ovndb-tls-certs\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.619901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-config\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.638012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-combined-ca-bundle\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.642262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-ovndb-tls-certs\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.642319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-httpd-config\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.652970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ptbl\" (UniqueName: \"kubernetes.io/projected/a12216e8-3323-4cd2-a422-387689dcdf22-kube-api-access-6ptbl\") pod \"neutron-6dbbbb985f-xd7vr\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:28 crc kubenswrapper[4769]: I1121 12:32:28.927937 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.149773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" event={"ID":"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f","Type":"ContainerStarted","Data":"960fd89888d62d428f05bc7deb1e51d62165368d753784343be9c2839028ecdd"} Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.447584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.448246 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-central-agent" containerID="cri-o://8bcbffcfbd020f972289aeec8539fe0a35635524a33c2d3f8727a3bea3369131" gracePeriod=30 Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.448328 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="proxy-httpd" containerID="cri-o://2cb3af8d0c60e21787cc54db1f018907b77b351b43d785ffe3d5ade3e38f72bc" gracePeriod=30 Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.448366 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="sg-core" containerID="cri-o://5b121f6b9d7b8c5205d3bf328e14fd7be6e259bd7a2e780dfda3861e3d7560ae" gracePeriod=30 Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.448361 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-notification-agent" containerID="cri-o://feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203" gracePeriod=30 Nov 21 12:32:29 crc kubenswrapper[4769]: I1121 12:32:29.519841 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr"] Nov 21 12:32:29 crc kubenswrapper[4769]: W1121 12:32:29.529820 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda12216e8_3323_4cd2_a422_387689dcdf22.slice/crio-25543d8883de2f5e26e1dfb0cebd676538b085e7506a94d26fb623fa81d002f5 WatchSource:0}: Error finding container 25543d8883de2f5e26e1dfb0cebd676538b085e7506a94d26fb623fa81d002f5: Status 404 returned error can't find the container with id 25543d8883de2f5e26e1dfb0cebd676538b085e7506a94d26fb623fa81d002f5 Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.194098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" event={"ID":"a12216e8-3323-4cd2-a422-387689dcdf22","Type":"ContainerStarted","Data":"c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.194227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" event={"ID":"a12216e8-3323-4cd2-a422-387689dcdf22","Type":"ContainerStarted","Data":"3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.194247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" event={"ID":"a12216e8-3323-4cd2-a422-387689dcdf22","Type":"ContainerStarted","Data":"25543d8883de2f5e26e1dfb0cebd676538b085e7506a94d26fb623fa81d002f5"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.197455 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.228806 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" event={"ID":"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f","Type":"ContainerStarted","Data":"f4f2ff038032497d9764ee4609ac54b083fd4e4edf2e7ce0cd8684840505c2cc"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.228854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" event={"ID":"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f","Type":"ContainerStarted","Data":"c81dc3670c42744300b003086b20e18f10b028bb729547f20f603a2570a3aca0"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.229327 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.229956 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.238702 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cf57438-8e0b-4646-939f-65eab368e774" containerID="2cb3af8d0c60e21787cc54db1f018907b77b351b43d785ffe3d5ade3e38f72bc" exitCode=0 Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.238766 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cf57438-8e0b-4646-939f-65eab368e774" containerID="5b121f6b9d7b8c5205d3bf328e14fd7be6e259bd7a2e780dfda3861e3d7560ae" exitCode=2 Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.238777 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cf57438-8e0b-4646-939f-65eab368e774" containerID="8bcbffcfbd020f972289aeec8539fe0a35635524a33c2d3f8727a3bea3369131" exitCode=0 Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.238812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerDied","Data":"2cb3af8d0c60e21787cc54db1f018907b77b351b43d785ffe3d5ade3e38f72bc"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.238866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerDied","Data":"5b121f6b9d7b8c5205d3bf328e14fd7be6e259bd7a2e780dfda3861e3d7560ae"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.238885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerDied","Data":"8bcbffcfbd020f972289aeec8539fe0a35635524a33c2d3f8727a3bea3369131"} Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.253149 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" podStartSLOduration=2.253122595 podStartE2EDuration="2.253122595s" podCreationTimestamp="2025-11-21 12:32:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:30.228638377 +0000 UTC m=+2508.929300195" watchObservedRunningTime="2025-11-21 12:32:30.253122595 +0000 UTC m=+2508.953784413" Nov 21 12:32:30 crc kubenswrapper[4769]: I1121 12:32:30.269773 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" podStartSLOduration=3.269755342 podStartE2EDuration="3.269755342s" podCreationTimestamp="2025-11-21 12:32:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:30.264988853 +0000 UTC m=+2508.965650671" watchObservedRunningTime="2025-11-21 12:32:30.269755342 +0000 UTC m=+2508.970417160" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.274939 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:32:31 crc kubenswrapper[4769]: E1121 12:32:31.275645 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.700905 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5b77df46b6-njhcp"] Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.703046 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.707992 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.709514 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.730947 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b77df46b6-njhcp"] Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-internal-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-httpd-config\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-ovndb-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-config\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-combined-ca-bundle\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-public-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.795896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4zhg\" (UniqueName: \"kubernetes.io/projected/8b184f71-6fcc-461e-902d-ec67e4abf4a2-kube-api-access-s4zhg\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-config\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-combined-ca-bundle\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-public-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s4zhg\" (UniqueName: \"kubernetes.io/projected/8b184f71-6fcc-461e-902d-ec67e4abf4a2-kube-api-access-s4zhg\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-internal-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-httpd-config\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.897382 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-ovndb-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.909130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-httpd-config\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.909724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-config\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.910331 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-ovndb-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.910903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-internal-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.910901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-public-tls-certs\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.915832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-combined-ca-bundle\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:31 crc kubenswrapper[4769]: I1121 12:32:31.925334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4zhg\" (UniqueName: \"kubernetes.io/projected/8b184f71-6fcc-461e-902d-ec67e4abf4a2-kube-api-access-s4zhg\") pod \"neutron-5b77df46b6-njhcp\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:32 crc kubenswrapper[4769]: I1121 12:32:32.091847 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:32 crc kubenswrapper[4769]: I1121 12:32:32.809771 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5b77df46b6-njhcp"] Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.285269 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cf57438-8e0b-4646-939f-65eab368e774" containerID="feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203" exitCode=0 Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.292388 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerDied","Data":"feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203"} Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.293439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" event={"ID":"8b184f71-6fcc-461e-902d-ec67e4abf4a2","Type":"ContainerStarted","Data":"433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8"} Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.293509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" event={"ID":"8b184f71-6fcc-461e-902d-ec67e4abf4a2","Type":"ContainerStarted","Data":"da71116e960032c4a5d8c613babe7a2cb5f99c248a311f951ddfed15f40dd5b8"} Nov 21 12:32:33 crc kubenswrapper[4769]: E1121 12:32:33.606605 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cf57438_8e0b_4646_939f_65eab368e774.slice/crio-feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cf57438_8e0b_4646_939f_65eab368e774.slice/crio-conmon-feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.615466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-combined-ca-bundle\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-run-httpd\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-log-httpd\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-config-data\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-scripts\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4g7n\" (UniqueName: \"kubernetes.io/projected/2cf57438-8e0b-4646-939f-65eab368e774-kube-api-access-m4g7n\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-sg-core-conf-yaml\") pod \"2cf57438-8e0b-4646-939f-65eab368e774\" (UID: \"2cf57438-8e0b-4646-939f-65eab368e774\") " Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.636852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.637129 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.641613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.660444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-scripts" (OuterVolumeSpecName: "scripts") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.671463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf57438-8e0b-4646-939f-65eab368e774-kube-api-access-m4g7n" (OuterVolumeSpecName: "kube-api-access-m4g7n") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "kube-api-access-m4g7n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.701731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.739607 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.739651 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m4g7n\" (UniqueName: \"kubernetes.io/projected/2cf57438-8e0b-4646-939f-65eab368e774-kube-api-access-m4g7n\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.739666 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.739677 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf57438-8e0b-4646-939f-65eab368e774-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.777518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.789104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-config-data" (OuterVolumeSpecName: "config-data") pod "2cf57438-8e0b-4646-939f-65eab368e774" (UID: "2cf57438-8e0b-4646-939f-65eab368e774"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.841548 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:33 crc kubenswrapper[4769]: I1121 12:32:33.841599 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf57438-8e0b-4646-939f-65eab368e774-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.304139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" event={"ID":"8b184f71-6fcc-461e-902d-ec67e4abf4a2","Type":"ContainerStarted","Data":"1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767"} Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.305841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.309724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2cf57438-8e0b-4646-939f-65eab368e774","Type":"ContainerDied","Data":"4de8037e8993e37058d734db83e674d19b28ee2bc21190d4d70f078884b036c8"} Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.309766 4769 scope.go:117] "RemoveContainer" containerID="2cb3af8d0c60e21787cc54db1f018907b77b351b43d785ffe3d5ade3e38f72bc" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.309889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.337199 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" podStartSLOduration=3.337168095 podStartE2EDuration="3.337168095s" podCreationTimestamp="2025-11-21 12:32:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:34.329014116 +0000 UTC m=+2513.029675944" watchObservedRunningTime="2025-11-21 12:32:34.337168095 +0000 UTC m=+2513.037829913" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.347616 4769 scope.go:117] "RemoveContainer" containerID="5b121f6b9d7b8c5205d3bf328e14fd7be6e259bd7a2e780dfda3861e3d7560ae" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.364853 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.381163 4769 scope.go:117] "RemoveContainer" containerID="feb0d7a1595a08b0112f3c47a4aad80db683dda26fcf67d0cff0d2c1f7372203" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.386921 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.401271 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:34 crc kubenswrapper[4769]: E1121 12:32:34.401709 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-central-agent" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.401725 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-central-agent" Nov 21 12:32:34 crc kubenswrapper[4769]: E1121 12:32:34.401754 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-notification-agent" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.401761 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-notification-agent" Nov 21 12:32:34 crc kubenswrapper[4769]: E1121 12:32:34.401770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="sg-core" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.401776 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="sg-core" Nov 21 12:32:34 crc kubenswrapper[4769]: E1121 12:32:34.401787 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="proxy-httpd" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.401793 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="proxy-httpd" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.401986 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-notification-agent" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.402008 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="ceilometer-central-agent" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.402017 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="sg-core" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.402024 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cf57438-8e0b-4646-939f-65eab368e774" containerName="proxy-httpd" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.403731 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.408133 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.408591 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.408610 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.410967 4769 scope.go:117] "RemoveContainer" containerID="8bcbffcfbd020f972289aeec8539fe0a35635524a33c2d3f8727a3bea3369131" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.454134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-scripts\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.454241 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.454307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqdb\" (UniqueName: \"kubernetes.io/projected/a503450a-da9c-458a-a870-af3b461afa7b-kube-api-access-vsqdb\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.454621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-config-data\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.454707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-log-httpd\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.454893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.455090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-run-httpd\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-run-httpd\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-scripts\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqdb\" (UniqueName: \"kubernetes.io/projected/a503450a-da9c-458a-a870-af3b461afa7b-kube-api-access-vsqdb\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-config-data\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-log-httpd\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.557862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-run-httpd\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.558087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-log-httpd\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.563227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-scripts\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.564110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.564329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-config-data\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.565842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.575483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqdb\" (UniqueName: \"kubernetes.io/projected/a503450a-da9c-458a-a870-af3b461afa7b-kube-api-access-vsqdb\") pod \"ceilometer-0\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.731355 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.782133 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.782758 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-log" containerID="cri-o://5d40b3dde4c81c304465a354fe1ed7a3c4944d363daa79ad90345d01263c7d36" gracePeriod=30 Nov 21 12:32:34 crc kubenswrapper[4769]: I1121 12:32:34.783169 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-httpd" containerID="cri-o://a0580d1db64b4565a534cbae796a8a8232af63c48bbf2498bfc48677ead7040f" gracePeriod=30 Nov 21 12:32:35 crc kubenswrapper[4769]: I1121 12:32:35.295767 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf57438-8e0b-4646-939f-65eab368e774" path="/var/lib/kubelet/pods/2cf57438-8e0b-4646-939f-65eab368e774/volumes" Nov 21 12:32:35 crc kubenswrapper[4769]: I1121 12:32:35.355411 4769 generic.go:334] "Generic (PLEG): container finished" podID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerID="5d40b3dde4c81c304465a354fe1ed7a3c4944d363daa79ad90345d01263c7d36" exitCode=143 Nov 21 12:32:35 crc kubenswrapper[4769]: I1121 12:32:35.355520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"04f17924-064f-4d86-91a5-4ab29b0016a2","Type":"ContainerDied","Data":"5d40b3dde4c81c304465a354fe1ed7a3c4944d363daa79ad90345d01263c7d36"} Nov 21 12:32:35 crc kubenswrapper[4769]: I1121 12:32:35.356365 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:36 crc kubenswrapper[4769]: I1121 12:32:36.368039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerStarted","Data":"2c3214d8a844091e8295629cc5664bb1f2b79a166d1b2dfa6cc216fba484a2bc"} Nov 21 12:32:36 crc kubenswrapper[4769]: I1121 12:32:36.368398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerStarted","Data":"cb5410ae0bf3fd6ac0a7fcaeb615b630e857f7f29f8ef85886edfd66e096198a"} Nov 21 12:32:36 crc kubenswrapper[4769]: I1121 12:32:36.903386 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:32:36 crc kubenswrapper[4769]: I1121 12:32:36.904149 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-httpd" containerID="cri-o://21bc089062ae8794f181d41e2d883b9b56f69cde1e0694ac09c1ec69f3a94b9b" gracePeriod=30 Nov 21 12:32:36 crc kubenswrapper[4769]: I1121 12:32:36.904063 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-log" containerID="cri-o://7f26e98981093c1915fa2f6202cc1c1601d7016557b24f5dbe90d96d6e06833e" gracePeriod=30 Nov 21 12:32:37 crc kubenswrapper[4769]: I1121 12:32:37.128558 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:37 crc kubenswrapper[4769]: I1121 12:32:37.379253 4769 generic.go:334] "Generic (PLEG): container finished" podID="448739ed-7175-4f95-a249-27b10b9809f3" containerID="7f26e98981093c1915fa2f6202cc1c1601d7016557b24f5dbe90d96d6e06833e" exitCode=143 Nov 21 12:32:37 crc kubenswrapper[4769]: I1121 12:32:37.379325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"448739ed-7175-4f95-a249-27b10b9809f3","Type":"ContainerDied","Data":"7f26e98981093c1915fa2f6202cc1c1601d7016557b24f5dbe90d96d6e06833e"} Nov 21 12:32:37 crc kubenswrapper[4769]: I1121 12:32:37.382348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerStarted","Data":"4b0b9a41ea578439734f7b5e5933fbe540e11b9366077cd0adeac76fb2d4035e"} Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.034175 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.056534 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.399239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerStarted","Data":"c78c36d4199b967172e48ee3bb5da120ffcc86fbca7de1a6b15fab2a7162b88d"} Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.406531 4769 generic.go:334] "Generic (PLEG): container finished" podID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerID="a0580d1db64b4565a534cbae796a8a8232af63c48bbf2498bfc48677ead7040f" exitCode=0 Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.406597 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"04f17924-064f-4d86-91a5-4ab29b0016a2","Type":"ContainerDied","Data":"a0580d1db64b4565a534cbae796a8a8232af63c48bbf2498bfc48677ead7040f"} Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.568328 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.638854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-internal-tls-certs\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.638946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-logs\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-httpd-run\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-config-data\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-scripts\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-combined-ca-bundle\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.639912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq8ms\" (UniqueName: \"kubernetes.io/projected/04f17924-064f-4d86-91a5-4ab29b0016a2-kube-api-access-fq8ms\") pod \"04f17924-064f-4d86-91a5-4ab29b0016a2\" (UID: \"04f17924-064f-4d86-91a5-4ab29b0016a2\") " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.640828 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.645613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-logs" (OuterVolumeSpecName: "logs") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.647358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f17924-064f-4d86-91a5-4ab29b0016a2-kube-api-access-fq8ms" (OuterVolumeSpecName: "kube-api-access-fq8ms") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "kube-api-access-fq8ms". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.647367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-scripts" (OuterVolumeSpecName: "scripts") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.647486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "glance") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.670419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.695106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.714508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-config-data" (OuterVolumeSpecName: "config-data") pod "04f17924-064f-4d86-91a5-4ab29b0016a2" (UID: "04f17924-064f-4d86-91a5-4ab29b0016a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742700 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742736 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742772 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742783 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fq8ms\" (UniqueName: \"kubernetes.io/projected/04f17924-064f-4d86-91a5-4ab29b0016a2-kube-api-access-fq8ms\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742793 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742804 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04f17924-064f-4d86-91a5-4ab29b0016a2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.742811 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04f17924-064f-4d86-91a5-4ab29b0016a2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.764180 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:32:38 crc kubenswrapper[4769]: I1121 12:32:38.846232 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.417984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"04f17924-064f-4d86-91a5-4ab29b0016a2","Type":"ContainerDied","Data":"be9556c9807202e6f43ff8a19b663a872be0f9ef41f3398d622e2835a0824341"} Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.418371 4769 scope.go:117] "RemoveContainer" containerID="a0580d1db64b4565a534cbae796a8a8232af63c48bbf2498bfc48677ead7040f" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.418060 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.443312 4769 scope.go:117] "RemoveContainer" containerID="5d40b3dde4c81c304465a354fe1ed7a3c4944d363daa79ad90345d01263c7d36" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.463486 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.476654 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.496227 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:32:39 crc kubenswrapper[4769]: E1121 12:32:39.496617 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-log" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.496632 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-log" Nov 21 12:32:39 crc kubenswrapper[4769]: E1121 12:32:39.496656 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-httpd" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.496662 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-httpd" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.496820 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-httpd" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.496840 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" containerName="glance-log" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.497816 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.499958 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.500575 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.522504 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.559711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.559783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.559818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xcz\" (UniqueName: \"kubernetes.io/projected/c194df7b-a418-440d-a1a6-5772c7ed5b32-kube-api-access-84xcz\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.559872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-logs\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.559930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.559952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.560036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.560063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.661795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.661859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.661896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.661936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.661963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-84xcz\" (UniqueName: \"kubernetes.io/projected/c194df7b-a418-440d-a1a6-5772c7ed5b32-kube-api-access-84xcz\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.662238 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.663316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-logs\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.663424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.663453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.663720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-logs\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.663943 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.670136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.671228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.677015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.684223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.684774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xcz\" (UniqueName: \"kubernetes.io/projected/c194df7b-a418-440d-a1a6-5772c7ed5b32-kube-api-access-84xcz\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.722235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-internal-api-0\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:39 crc kubenswrapper[4769]: I1121 12:32:39.813945 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.326491 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.451396 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerStarted","Data":"fd7e51bbada944cc02fb809e5387d55a1eee1aad3f6134b0e191d63acfa7a8ed"} Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.451554 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-central-agent" containerID="cri-o://2c3214d8a844091e8295629cc5664bb1f2b79a166d1b2dfa6cc216fba484a2bc" gracePeriod=30 Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.451816 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.452307 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="proxy-httpd" containerID="cri-o://fd7e51bbada944cc02fb809e5387d55a1eee1aad3f6134b0e191d63acfa7a8ed" gracePeriod=30 Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.452376 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-notification-agent" containerID="cri-o://4b0b9a41ea578439734f7b5e5933fbe540e11b9366077cd0adeac76fb2d4035e" gracePeriod=30 Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.452376 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="sg-core" containerID="cri-o://c78c36d4199b967172e48ee3bb5da120ffcc86fbca7de1a6b15fab2a7162b88d" gracePeriod=30 Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.456082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c194df7b-a418-440d-a1a6-5772c7ed5b32","Type":"ContainerStarted","Data":"9e6ed6f609e0f013c1b011401db7abeca7b752fbb369a8f97989084af8db59f5"} Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.476136 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.093633698 podStartE2EDuration="6.476119197s" podCreationTimestamp="2025-11-21 12:32:34 +0000 UTC" firstStartedPulling="2025-11-21 12:32:35.339363852 +0000 UTC m=+2514.040025670" lastFinishedPulling="2025-11-21 12:32:39.721849361 +0000 UTC m=+2518.422511169" observedRunningTime="2025-11-21 12:32:40.474921175 +0000 UTC m=+2519.175583013" watchObservedRunningTime="2025-11-21 12:32:40.476119197 +0000 UTC m=+2519.176781005" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.493394 4769 generic.go:334] "Generic (PLEG): container finished" podID="448739ed-7175-4f95-a249-27b10b9809f3" containerID="21bc089062ae8794f181d41e2d883b9b56f69cde1e0694ac09c1ec69f3a94b9b" exitCode=0 Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.493427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"448739ed-7175-4f95-a249-27b10b9809f3","Type":"ContainerDied","Data":"21bc089062ae8794f181d41e2d883b9b56f69cde1e0694ac09c1ec69f3a94b9b"} Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.621107 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.693837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-combined-ca-bundle\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694328 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-logs\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-config-data\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-scripts\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694490 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-httpd-run\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hn2v\" (UniqueName: \"kubernetes.io/projected/448739ed-7175-4f95-a249-27b10b9809f3-kube-api-access-9hn2v\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-public-tls-certs\") pod \"448739ed-7175-4f95-a249-27b10b9809f3\" (UID: \"448739ed-7175-4f95-a249-27b10b9809f3\") " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.694885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-logs" (OuterVolumeSpecName: "logs") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.695039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.695207 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.695223 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/448739ed-7175-4f95-a249-27b10b9809f3-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.701303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-scripts" (OuterVolumeSpecName: "scripts") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.707405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/448739ed-7175-4f95-a249-27b10b9809f3-kube-api-access-9hn2v" (OuterVolumeSpecName: "kube-api-access-9hn2v") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "kube-api-access-9hn2v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.716232 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.771426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.796982 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.797041 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.797053 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.797064 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9hn2v\" (UniqueName: \"kubernetes.io/projected/448739ed-7175-4f95-a249-27b10b9809f3-kube-api-access-9hn2v\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.817356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.824635 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.830714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-config-data" (OuterVolumeSpecName: "config-data") pod "448739ed-7175-4f95-a249-27b10b9809f3" (UID: "448739ed-7175-4f95-a249-27b10b9809f3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.898544 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.898583 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:40 crc kubenswrapper[4769]: I1121 12:32:40.898594 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/448739ed-7175-4f95-a249-27b10b9809f3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.301014 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f17924-064f-4d86-91a5-4ab29b0016a2" path="/var/lib/kubelet/pods/04f17924-064f-4d86-91a5-4ab29b0016a2/volumes" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.515663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"448739ed-7175-4f95-a249-27b10b9809f3","Type":"ContainerDied","Data":"afc76a832304556d9d59addde50e0857a4ccfc8beb8d4794f6c05ec66a3baa97"} Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.516087 4769 scope.go:117] "RemoveContainer" containerID="21bc089062ae8794f181d41e2d883b9b56f69cde1e0694ac09c1ec69f3a94b9b" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.515711 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.524034 4769 generic.go:334] "Generic (PLEG): container finished" podID="a503450a-da9c-458a-a870-af3b461afa7b" containerID="fd7e51bbada944cc02fb809e5387d55a1eee1aad3f6134b0e191d63acfa7a8ed" exitCode=0 Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.524080 4769 generic.go:334] "Generic (PLEG): container finished" podID="a503450a-da9c-458a-a870-af3b461afa7b" containerID="c78c36d4199b967172e48ee3bb5da120ffcc86fbca7de1a6b15fab2a7162b88d" exitCode=2 Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.524087 4769 generic.go:334] "Generic (PLEG): container finished" podID="a503450a-da9c-458a-a870-af3b461afa7b" containerID="4b0b9a41ea578439734f7b5e5933fbe540e11b9366077cd0adeac76fb2d4035e" exitCode=0 Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.524127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerDied","Data":"fd7e51bbada944cc02fb809e5387d55a1eee1aad3f6134b0e191d63acfa7a8ed"} Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.524158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerDied","Data":"c78c36d4199b967172e48ee3bb5da120ffcc86fbca7de1a6b15fab2a7162b88d"} Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.524168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerDied","Data":"4b0b9a41ea578439734f7b5e5933fbe540e11b9366077cd0adeac76fb2d4035e"} Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.526678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c194df7b-a418-440d-a1a6-5772c7ed5b32","Type":"ContainerStarted","Data":"2d7cfcead7b2b655d207c20f2bb7c59fe5d71759ecb364efbb0f6f511c42a0b9"} Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.547296 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.557477 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.578429 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:32:41 crc kubenswrapper[4769]: E1121 12:32:41.579597 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-httpd" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.579627 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-httpd" Nov 21 12:32:41 crc kubenswrapper[4769]: E1121 12:32:41.579643 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-log" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.579651 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-log" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.579887 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-log" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.579924 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="448739ed-7175-4f95-a249-27b10b9809f3" containerName="glance-httpd" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.581316 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.588961 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.600229 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620051 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-logs\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-scripts\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlcw9\" (UniqueName: \"kubernetes.io/projected/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-kube-api-access-wlcw9\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.620308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-config-data\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.636803 4769 scope.go:117] "RemoveContainer" containerID="7f26e98981093c1915fa2f6202cc1c1601d7016557b24f5dbe90d96d6e06833e" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.643176 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wlcw9\" (UniqueName: \"kubernetes.io/projected/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-kube-api-access-wlcw9\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-config-data\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-logs\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.722405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-scripts\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.723547 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.723979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-logs\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.724724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.727787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.729664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-scripts\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.732544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.743515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlcw9\" (UniqueName: \"kubernetes.io/projected/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-kube-api-access-wlcw9\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.746958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-config-data\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.758471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:41 crc kubenswrapper[4769]: I1121 12:32:41.957466 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.466078 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.541700 4769 generic.go:334] "Generic (PLEG): container finished" podID="a503450a-da9c-458a-a870-af3b461afa7b" containerID="2c3214d8a844091e8295629cc5664bb1f2b79a166d1b2dfa6cc216fba484a2bc" exitCode=0 Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.541748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerDied","Data":"2c3214d8a844091e8295629cc5664bb1f2b79a166d1b2dfa6cc216fba484a2bc"} Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.543657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c194df7b-a418-440d-a1a6-5772c7ed5b32","Type":"ContainerStarted","Data":"1abc6243c2532e88080e789ebe5e6e7fb69daba8348613143615ae943993df67"} Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.546298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9","Type":"ContainerStarted","Data":"6d2760ce182a56c6b9c1b3b452dff4eeb4b725fc9a15ac16f2052898e4423893"} Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.567133 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.567117598 podStartE2EDuration="3.567117598s" podCreationTimestamp="2025-11-21 12:32:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:42.565667429 +0000 UTC m=+2521.266329247" watchObservedRunningTime="2025-11-21 12:32:42.567117598 +0000 UTC m=+2521.267779416" Nov 21 12:32:42 crc kubenswrapper[4769]: I1121 12:32:42.855718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046423 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsqdb\" (UniqueName: \"kubernetes.io/projected/a503450a-da9c-458a-a870-af3b461afa7b-kube-api-access-vsqdb\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-combined-ca-bundle\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046533 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-config-data\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-sg-core-conf-yaml\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046671 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-run-httpd\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-log-httpd\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.046778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-scripts\") pod \"a503450a-da9c-458a-a870-af3b461afa7b\" (UID: \"a503450a-da9c-458a-a870-af3b461afa7b\") " Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.047530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.047715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.064751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-scripts" (OuterVolumeSpecName: "scripts") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.064926 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a503450a-da9c-458a-a870-af3b461afa7b-kube-api-access-vsqdb" (OuterVolumeSpecName: "kube-api-access-vsqdb") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "kube-api-access-vsqdb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.101925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.143444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.148674 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vsqdb\" (UniqueName: \"kubernetes.io/projected/a503450a-da9c-458a-a870-af3b461afa7b-kube-api-access-vsqdb\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.148718 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.148729 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.148780 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.148794 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a503450a-da9c-458a-a870-af3b461afa7b-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.148805 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.193292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-config-data" (OuterVolumeSpecName: "config-data") pod "a503450a-da9c-458a-a870-af3b461afa7b" (UID: "a503450a-da9c-458a-a870-af3b461afa7b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.250433 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a503450a-da9c-458a-a870-af3b461afa7b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.289739 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="448739ed-7175-4f95-a249-27b10b9809f3" path="/var/lib/kubelet/pods/448739ed-7175-4f95-a249-27b10b9809f3/volumes" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.588423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a503450a-da9c-458a-a870-af3b461afa7b","Type":"ContainerDied","Data":"cb5410ae0bf3fd6ac0a7fcaeb615b630e857f7f29f8ef85886edfd66e096198a"} Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.588479 4769 scope.go:117] "RemoveContainer" containerID="fd7e51bbada944cc02fb809e5387d55a1eee1aad3f6134b0e191d63acfa7a8ed" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.588596 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.600373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9","Type":"ContainerStarted","Data":"4bf31c2bf2bebb7001eaf66f396a43bfa310d34cbd6d3a17fe6833606f933742"} Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.637251 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.650333 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.668331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:43 crc kubenswrapper[4769]: E1121 12:32:43.668841 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-central-agent" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.668867 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-central-agent" Nov 21 12:32:43 crc kubenswrapper[4769]: E1121 12:32:43.668886 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-notification-agent" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.668896 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-notification-agent" Nov 21 12:32:43 crc kubenswrapper[4769]: E1121 12:32:43.668917 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="sg-core" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.668927 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="sg-core" Nov 21 12:32:43 crc kubenswrapper[4769]: E1121 12:32:43.668970 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="proxy-httpd" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.668981 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="proxy-httpd" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.669210 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-notification-agent" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.669249 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="ceilometer-central-agent" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.669267 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="proxy-httpd" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.669285 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a503450a-da9c-458a-a870-af3b461afa7b" containerName="sg-core" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.683544 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.689765 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.690455 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.707066 4769 scope.go:117] "RemoveContainer" containerID="c78c36d4199b967172e48ee3bb5da120ffcc86fbca7de1a6b15fab2a7162b88d" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.719726 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.807480 4769 scope.go:117] "RemoveContainer" containerID="4b0b9a41ea578439734f7b5e5933fbe540e11b9366077cd0adeac76fb2d4035e" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.827977 4769 scope.go:117] "RemoveContainer" containerID="2c3214d8a844091e8295629cc5664bb1f2b79a166d1b2dfa6cc216fba484a2bc" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-run-httpd\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-log-httpd\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-config-data\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-scripts\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r94nj\" (UniqueName: \"kubernetes.io/projected/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-kube-api-access-r94nj\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.871937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.973893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-run-httpd\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-log-httpd\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-config-data\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-scripts\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r94nj\" (UniqueName: \"kubernetes.io/projected/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-kube-api-access-r94nj\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-log-httpd\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.974852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-run-httpd\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.983932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.986946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-config-data\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.987464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.990540 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-scripts\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:43 crc kubenswrapper[4769]: I1121 12:32:43.993830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r94nj\" (UniqueName: \"kubernetes.io/projected/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-kube-api-access-r94nj\") pod \"ceilometer-0\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:44 crc kubenswrapper[4769]: I1121 12:32:44.009302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:44 crc kubenswrapper[4769]: I1121 12:32:44.516058 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:44 crc kubenswrapper[4769]: W1121 12:32:44.519330 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19b91183_fe8c_44e0_a1f1_bf13a057fe7b.slice/crio-4b46d31d33d51ac21165f74c045931e18c67f762f638acc70fb18aa7521a812c WatchSource:0}: Error finding container 4b46d31d33d51ac21165f74c045931e18c67f762f638acc70fb18aa7521a812c: Status 404 returned error can't find the container with id 4b46d31d33d51ac21165f74c045931e18c67f762f638acc70fb18aa7521a812c Nov 21 12:32:44 crc kubenswrapper[4769]: I1121 12:32:44.610011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerStarted","Data":"4b46d31d33d51ac21165f74c045931e18c67f762f638acc70fb18aa7521a812c"} Nov 21 12:32:44 crc kubenswrapper[4769]: I1121 12:32:44.612219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9","Type":"ContainerStarted","Data":"07ade9dcc929a836a885d01ae6862ab0c3432ac6d40b218c509b28428435976b"} Nov 21 12:32:44 crc kubenswrapper[4769]: I1121 12:32:44.641059 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.641032581 podStartE2EDuration="3.641032581s" podCreationTimestamp="2025-11-21 12:32:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:44.635549863 +0000 UTC m=+2523.336211681" watchObservedRunningTime="2025-11-21 12:32:44.641032581 +0000 UTC m=+2523.341694399" Nov 21 12:32:45 crc kubenswrapper[4769]: I1121 12:32:45.274160 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:32:45 crc kubenswrapper[4769]: E1121 12:32:45.274965 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:32:45 crc kubenswrapper[4769]: I1121 12:32:45.290864 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a503450a-da9c-458a-a870-af3b461afa7b" path="/var/lib/kubelet/pods/a503450a-da9c-458a-a870-af3b461afa7b/volumes" Nov 21 12:32:45 crc kubenswrapper[4769]: I1121 12:32:45.626329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerStarted","Data":"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af"} Nov 21 12:32:46 crc kubenswrapper[4769]: I1121 12:32:46.638994 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerStarted","Data":"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83"} Nov 21 12:32:46 crc kubenswrapper[4769]: I1121 12:32:46.639721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerStarted","Data":"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4"} Nov 21 12:32:48 crc kubenswrapper[4769]: I1121 12:32:48.284782 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:32:48 crc kubenswrapper[4769]: I1121 12:32:48.285375 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-decision-engine-0" podUID="8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" containerName="watcher-decision-engine" containerID="cri-o://982f11c7262b5ebdcbf5a5c6d0afe5b17a82819c249326a538594d4a2a0e07d8" gracePeriod=30 Nov 21 12:32:48 crc kubenswrapper[4769]: I1121 12:32:48.660719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerStarted","Data":"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71"} Nov 21 12:32:48 crc kubenswrapper[4769]: I1121 12:32:48.660894 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:48 crc kubenswrapper[4769]: I1121 12:32:48.683605 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.478588635 podStartE2EDuration="5.683584027s" podCreationTimestamp="2025-11-21 12:32:43 +0000 UTC" firstStartedPulling="2025-11-21 12:32:44.521978342 +0000 UTC m=+2523.222640160" lastFinishedPulling="2025-11-21 12:32:47.726973724 +0000 UTC m=+2526.427635552" observedRunningTime="2025-11-21 12:32:48.677637157 +0000 UTC m=+2527.378298975" watchObservedRunningTime="2025-11-21 12:32:48.683584027 +0000 UTC m=+2527.384245845" Nov 21 12:32:49 crc kubenswrapper[4769]: I1121 12:32:49.674900 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" containerID="982f11c7262b5ebdcbf5a5c6d0afe5b17a82819c249326a538594d4a2a0e07d8" exitCode=0 Nov 21 12:32:49 crc kubenswrapper[4769]: I1121 12:32:49.675280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226","Type":"ContainerDied","Data":"982f11c7262b5ebdcbf5a5c6d0afe5b17a82819c249326a538594d4a2a0e07d8"} Nov 21 12:32:49 crc kubenswrapper[4769]: I1121 12:32:49.814808 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:49 crc kubenswrapper[4769]: I1121 12:32:49.815391 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:49 crc kubenswrapper[4769]: I1121 12:32:49.881546 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:49 crc kubenswrapper[4769]: I1121 12:32:49.881823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.000611 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.095425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-custom-prometheus-ca\") pod \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.095487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-combined-ca-bundle\") pod \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.095518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-logs\") pod \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.095606 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4jp5\" (UniqueName: \"kubernetes.io/projected/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-kube-api-access-t4jp5\") pod \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.095669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-config-data\") pod \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\" (UID: \"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226\") " Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.096055 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-logs" (OuterVolumeSpecName: "logs") pod "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" (UID: "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.101906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-kube-api-access-t4jp5" (OuterVolumeSpecName: "kube-api-access-t4jp5") pod "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" (UID: "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226"). InnerVolumeSpecName "kube-api-access-t4jp5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.129412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" (UID: "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.133757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" (UID: "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.162653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-config-data" (OuterVolumeSpecName: "config-data") pod "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" (UID: "8ec0e61a-c1a8-43b4-b44f-3a9c021b4226"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.198228 4769 reconciler_common.go:293] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.198266 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.198276 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.198285 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t4jp5\" (UniqueName: \"kubernetes.io/projected/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-kube-api-access-t4jp5\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.198297 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.578380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.685708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"8ec0e61a-c1a8-43b4-b44f-3a9c021b4226","Type":"ContainerDied","Data":"ad66eee7ec28fee8d31077d1cc6f91c9d63d3a428d5fc8cd502b2335ff3f94a9"} Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.685783 4769 scope.go:117] "RemoveContainer" containerID="982f11c7262b5ebdcbf5a5c6d0afe5b17a82819c249326a538594d4a2a0e07d8" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.685877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.685876 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-central-agent" containerID="cri-o://7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" gracePeriod=30 Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.685900 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="proxy-httpd" containerID="cri-o://bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" gracePeriod=30 Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.686032 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-notification-agent" containerID="cri-o://cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" gracePeriod=30 Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.686040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="sg-core" containerID="cri-o://b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" gracePeriod=30 Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.686359 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.686391 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.725755 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.739258 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.767173 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:32:50 crc kubenswrapper[4769]: E1121 12:32:50.767672 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" containerName="watcher-decision-engine" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.767690 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" containerName="watcher-decision-engine" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.767907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" containerName="watcher-decision-engine" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.768572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.788190 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"watcher-decision-engine-config-data" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.806275 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.910494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.910920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-config-data\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.911040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k4q8\" (UniqueName: \"kubernetes.io/projected/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-kube-api-access-4k4q8\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.911182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-logs\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:50 crc kubenswrapper[4769]: I1121 12:32:50.911289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.013779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-config-data\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.013843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4k4q8\" (UniqueName: \"kubernetes.io/projected/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-kube-api-access-4k4q8\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.013888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-logs\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.013929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.014013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.014508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-logs\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.021937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.024553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.025769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-config-data\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.036122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k4q8\" (UniqueName: \"kubernetes.io/projected/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-kube-api-access-4k4q8\") pod \"watcher-decision-engine-0\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.160107 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.295253 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec0e61a-c1a8-43b4-b44f-3a9c021b4226" path="/var/lib/kubelet/pods/8ec0e61a-c1a8-43b4-b44f-3a9c021b4226/volumes" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.462463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-combined-ca-bundle\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-sg-core-conf-yaml\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-scripts\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529404 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-config-data\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-run-httpd\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r94nj\" (UniqueName: \"kubernetes.io/projected/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-kube-api-access-r94nj\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.529600 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-log-httpd\") pod \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\" (UID: \"19b91183-fe8c-44e0-a1f1-bf13a057fe7b\") " Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.531580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.532032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.540121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-kube-api-access-r94nj" (OuterVolumeSpecName: "kube-api-access-r94nj") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "kube-api-access-r94nj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.544079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-scripts" (OuterVolumeSpecName: "scripts") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.572113 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.613308 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.632342 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.632375 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.632386 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r94nj\" (UniqueName: \"kubernetes.io/projected/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-kube-api-access-r94nj\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.632398 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.632406 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.632414 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.639931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-config-data" (OuterVolumeSpecName: "config-data") pod "19b91183-fe8c-44e0-a1f1-bf13a057fe7b" (UID: "19b91183-fe8c-44e0-a1f1-bf13a057fe7b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699418 4769 generic.go:334] "Generic (PLEG): container finished" podID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" exitCode=0 Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699465 4769 generic.go:334] "Generic (PLEG): container finished" podID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" exitCode=2 Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699480 4769 generic.go:334] "Generic (PLEG): container finished" podID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" exitCode=0 Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699492 4769 generic.go:334] "Generic (PLEG): container finished" podID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" exitCode=0 Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerDied","Data":"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71"} Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerDied","Data":"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83"} Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerDied","Data":"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4"} Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerDied","Data":"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af"} Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"19b91183-fe8c-44e0-a1f1-bf13a057fe7b","Type":"ContainerDied","Data":"4b46d31d33d51ac21165f74c045931e18c67f762f638acc70fb18aa7521a812c"} Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.699740 4769 scope.go:117] "RemoveContainer" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.700054 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.733932 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/19b91183-fe8c-44e0-a1f1-bf13a057fe7b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.736055 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.753324 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.771332 4769 scope.go:117] "RemoveContainer" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.775304 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.796694 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.797210 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-central-agent" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797227 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-central-agent" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.797238 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-notification-agent" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797244 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-notification-agent" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.797261 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="sg-core" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797267 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="sg-core" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.797275 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="proxy-httpd" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797281 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="proxy-httpd" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797445 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="sg-core" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-notification-agent" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797467 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="proxy-httpd" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.797507 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" containerName="ceilometer-central-agent" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.799195 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.803661 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.803953 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.823712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.894408 4769 scope.go:117] "RemoveContainer" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.920866 4769 scope.go:117] "RemoveContainer" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-log-httpd\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-scripts\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-run-httpd\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-config-data\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.937886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfr4x\" (UniqueName: \"kubernetes.io/projected/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-kube-api-access-nfr4x\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.943659 4769 scope.go:117] "RemoveContainer" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.944472 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": container with ID starting with bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71 not found: ID does not exist" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.944513 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71"} err="failed to get container status \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": rpc error: code = NotFound desc = could not find container \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": container with ID starting with bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.944561 4769 scope.go:117] "RemoveContainer" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.944971 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": container with ID starting with b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83 not found: ID does not exist" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.944989 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83"} err="failed to get container status \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": rpc error: code = NotFound desc = could not find container \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": container with ID starting with b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.945000 4769 scope.go:117] "RemoveContainer" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.947020 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": container with ID starting with cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4 not found: ID does not exist" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.947078 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4"} err="failed to get container status \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": rpc error: code = NotFound desc = could not find container \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": container with ID starting with cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.947109 4769 scope.go:117] "RemoveContainer" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" Nov 21 12:32:51 crc kubenswrapper[4769]: E1121 12:32:51.948415 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": container with ID starting with 7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af not found: ID does not exist" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.948458 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af"} err="failed to get container status \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": rpc error: code = NotFound desc = could not find container \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": container with ID starting with 7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.948497 4769 scope.go:117] "RemoveContainer" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.948918 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71"} err="failed to get container status \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": rpc error: code = NotFound desc = could not find container \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": container with ID starting with bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.948955 4769 scope.go:117] "RemoveContainer" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.949225 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83"} err="failed to get container status \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": rpc error: code = NotFound desc = could not find container \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": container with ID starting with b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.949253 4769 scope.go:117] "RemoveContainer" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.949494 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4"} err="failed to get container status \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": rpc error: code = NotFound desc = could not find container \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": container with ID starting with cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.949531 4769 scope.go:117] "RemoveContainer" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.949757 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af"} err="failed to get container status \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": rpc error: code = NotFound desc = could not find container \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": container with ID starting with 7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.949799 4769 scope.go:117] "RemoveContainer" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950038 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71"} err="failed to get container status \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": rpc error: code = NotFound desc = could not find container \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": container with ID starting with bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950083 4769 scope.go:117] "RemoveContainer" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950288 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83"} err="failed to get container status \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": rpc error: code = NotFound desc = could not find container \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": container with ID starting with b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950327 4769 scope.go:117] "RemoveContainer" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950513 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4"} err="failed to get container status \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": rpc error: code = NotFound desc = could not find container \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": container with ID starting with cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950542 4769 scope.go:117] "RemoveContainer" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950736 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af"} err="failed to get container status \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": rpc error: code = NotFound desc = could not find container \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": container with ID starting with 7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950763 4769 scope.go:117] "RemoveContainer" containerID="bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.950975 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71"} err="failed to get container status \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": rpc error: code = NotFound desc = could not find container \"bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71\": container with ID starting with bb423a7976ac0a153f020755e86c8b88f32d21dacca5d1a342190e8231ab1a71 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.951004 4769 scope.go:117] "RemoveContainer" containerID="b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.951275 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83"} err="failed to get container status \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": rpc error: code = NotFound desc = could not find container \"b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83\": container with ID starting with b6b2e31d0f87369ad5e42b2bc010e3ad77af0c1e50a698effcf754f1eafd9d83 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.951302 4769 scope.go:117] "RemoveContainer" containerID="cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.951504 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4"} err="failed to get container status \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": rpc error: code = NotFound desc = could not find container \"cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4\": container with ID starting with cdfca62979c4c94d7bec229864b4eb7764dc1a45ae2ceec1ce7a065949f91ad4 not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.951528 4769 scope.go:117] "RemoveContainer" containerID="7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.951708 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af"} err="failed to get container status \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": rpc error: code = NotFound desc = could not find container \"7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af\": container with ID starting with 7aeaaab2c41f97ac8185c6c3e5b7a976fe3c5ec123a5ff65595450daf206f7af not found: ID does not exist" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.958169 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.958325 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:51 crc kubenswrapper[4769]: I1121 12:32:51.996448 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.009338 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-scripts\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040544 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-run-httpd\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-config-data\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nfr4x\" (UniqueName: \"kubernetes.io/projected/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-kube-api-access-nfr4x\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-log-httpd\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.040915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.041066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-run-httpd\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.041447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-log-httpd\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.048824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.048857 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.048982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-scripts\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.049152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-config-data\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.064821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfr4x\" (UniqueName: \"kubernetes.io/projected/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-kube-api-access-nfr4x\") pod \"ceilometer-0\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.203861 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.710462 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.723678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc","Type":"ContainerStarted","Data":"7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6"} Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.723723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc","Type":"ContainerStarted","Data":"0b9a90b4341c5a06ddb57e457f43bcfe5a06ba5bce9a3168d4abdd560fb45157"} Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.724551 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.724706 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:52 crc kubenswrapper[4769]: I1121 12:32:52.750092 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher-decision-engine-0" podStartSLOduration=2.750076085 podStartE2EDuration="2.750076085s" podCreationTimestamp="2025-11-21 12:32:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:52.745849891 +0000 UTC m=+2531.446511709" watchObservedRunningTime="2025-11-21 12:32:52.750076085 +0000 UTC m=+2531.450737903" Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.011879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.012005 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.288030 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b91183-fe8c-44e0-a1f1-bf13a057fe7b" path="/var/lib/kubelet/pods/19b91183-fe8c-44e0-a1f1-bf13a057fe7b/volumes" Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.387325 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.645482 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.734557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerStarted","Data":"21b51e998beb569a7fa648671992f944c7e637cf70dcb019287e5f79c60f1d5a"} Nov 21 12:32:53 crc kubenswrapper[4769]: I1121 12:32:53.734619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerStarted","Data":"ca99369551e95559633fe49929aa9b55155c2dca067359e0e4f96fc9ad0889bb"} Nov 21 12:32:54 crc kubenswrapper[4769]: I1121 12:32:54.746438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerStarted","Data":"a7ec988bf2b8f9d6f62325114e2a5a210b67fd300652e5f9705bf0bfbeea30df"} Nov 21 12:32:54 crc kubenswrapper[4769]: I1121 12:32:54.746997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerStarted","Data":"f5784937060356b6c99ea89233f5fb99fad88588f1cd611c96f49680c25c8b36"} Nov 21 12:32:54 crc kubenswrapper[4769]: I1121 12:32:54.746496 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:32:54 crc kubenswrapper[4769]: I1121 12:32:54.747026 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:32:55 crc kubenswrapper[4769]: I1121 12:32:55.423466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:55 crc kubenswrapper[4769]: I1121 12:32:55.426996 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:32:56 crc kubenswrapper[4769]: I1121 12:32:56.776812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerStarted","Data":"2972da44ab596a044839d5d499fe9a42c86945715140cf2ae80012493bfb504a"} Nov 21 12:32:56 crc kubenswrapper[4769]: I1121 12:32:56.776855 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-central-agent" containerID="cri-o://21b51e998beb569a7fa648671992f944c7e637cf70dcb019287e5f79c60f1d5a" gracePeriod=30 Nov 21 12:32:56 crc kubenswrapper[4769]: I1121 12:32:56.777508 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:32:56 crc kubenswrapper[4769]: I1121 12:32:56.777534 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="proxy-httpd" containerID="cri-o://2972da44ab596a044839d5d499fe9a42c86945715140cf2ae80012493bfb504a" gracePeriod=30 Nov 21 12:32:56 crc kubenswrapper[4769]: I1121 12:32:56.777606 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="sg-core" containerID="cri-o://a7ec988bf2b8f9d6f62325114e2a5a210b67fd300652e5f9705bf0bfbeea30df" gracePeriod=30 Nov 21 12:32:56 crc kubenswrapper[4769]: I1121 12:32:56.777650 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-notification-agent" containerID="cri-o://f5784937060356b6c99ea89233f5fb99fad88588f1cd611c96f49680c25c8b36" gracePeriod=30 Nov 21 12:32:57 crc kubenswrapper[4769]: I1121 12:32:57.796598 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerID="2972da44ab596a044839d5d499fe9a42c86945715140cf2ae80012493bfb504a" exitCode=0 Nov 21 12:32:57 crc kubenswrapper[4769]: I1121 12:32:57.796929 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerID="a7ec988bf2b8f9d6f62325114e2a5a210b67fd300652e5f9705bf0bfbeea30df" exitCode=2 Nov 21 12:32:57 crc kubenswrapper[4769]: I1121 12:32:57.796946 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerID="f5784937060356b6c99ea89233f5fb99fad88588f1cd611c96f49680c25c8b36" exitCode=0 Nov 21 12:32:57 crc kubenswrapper[4769]: I1121 12:32:57.796982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerDied","Data":"2972da44ab596a044839d5d499fe9a42c86945715140cf2ae80012493bfb504a"} Nov 21 12:32:57 crc kubenswrapper[4769]: I1121 12:32:57.797023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerDied","Data":"a7ec988bf2b8f9d6f62325114e2a5a210b67fd300652e5f9705bf0bfbeea30df"} Nov 21 12:32:57 crc kubenswrapper[4769]: I1121 12:32:57.797044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerDied","Data":"f5784937060356b6c99ea89233f5fb99fad88588f1cd611c96f49680c25c8b36"} Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.036472 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=4.041898592 podStartE2EDuration="7.036453811s" podCreationTimestamp="2025-11-21 12:32:51 +0000 UTC" firstStartedPulling="2025-11-21 12:32:52.712261939 +0000 UTC m=+2531.412923757" lastFinishedPulling="2025-11-21 12:32:55.706817158 +0000 UTC m=+2534.407478976" observedRunningTime="2025-11-21 12:32:56.819979036 +0000 UTC m=+2535.520640854" watchObservedRunningTime="2025-11-21 12:32:58.036453811 +0000 UTC m=+2536.737115629" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.044174 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sjmg7"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.045385 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.067902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sjmg7"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.150092 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-qjvcm"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.151823 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.173806 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-34da-account-create-s2cvr"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.175509 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.181757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.187461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmvgv\" (UniqueName: \"kubernetes.io/projected/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-kube-api-access-kmvgv\") pod \"nova-api-db-create-sjmg7\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.187657 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-operator-scripts\") pod \"nova-api-db-create-sjmg7\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.191292 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-qjvcm"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.207060 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-34da-account-create-s2cvr"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.288955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp2db\" (UniqueName: \"kubernetes.io/projected/e72c903a-fb96-4318-9c25-d5a5af14fe5b-kube-api-access-pp2db\") pod \"nova-api-34da-account-create-s2cvr\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.289076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-operator-scripts\") pod \"nova-api-db-create-sjmg7\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.289110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e72c903a-fb96-4318-9c25-d5a5af14fe5b-operator-scripts\") pod \"nova-api-34da-account-create-s2cvr\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.289157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kmvgv\" (UniqueName: \"kubernetes.io/projected/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-kube-api-access-kmvgv\") pod \"nova-api-db-create-sjmg7\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.289232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98615cf5-ae53-4563-8c79-0c09777cfdf8-operator-scripts\") pod \"nova-cell0-db-create-qjvcm\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.289251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhbt\" (UniqueName: \"kubernetes.io/projected/98615cf5-ae53-4563-8c79-0c09777cfdf8-kube-api-access-9qhbt\") pod \"nova-cell0-db-create-qjvcm\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.289982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-operator-scripts\") pod \"nova-api-db-create-sjmg7\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.309774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmvgv\" (UniqueName: \"kubernetes.io/projected/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-kube-api-access-kmvgv\") pod \"nova-api-db-create-sjmg7\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.348265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2k6gs"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.350071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.363546 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2k6gs"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.367382 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.373788 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.375269 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.378289 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.391119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.392121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98615cf5-ae53-4563-8c79-0c09777cfdf8-operator-scripts\") pod \"nova-cell0-db-create-qjvcm\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.392155 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhbt\" (UniqueName: \"kubernetes.io/projected/98615cf5-ae53-4563-8c79-0c09777cfdf8-kube-api-access-9qhbt\") pod \"nova-cell0-db-create-qjvcm\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.392190 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pp2db\" (UniqueName: \"kubernetes.io/projected/e72c903a-fb96-4318-9c25-d5a5af14fe5b-kube-api-access-pp2db\") pod \"nova-api-34da-account-create-s2cvr\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.392271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e72c903a-fb96-4318-9c25-d5a5af14fe5b-operator-scripts\") pod \"nova-api-34da-account-create-s2cvr\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.393450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e72c903a-fb96-4318-9c25-d5a5af14fe5b-operator-scripts\") pod \"nova-api-34da-account-create-s2cvr\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.394223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98615cf5-ae53-4563-8c79-0c09777cfdf8-operator-scripts\") pod \"nova-cell0-db-create-qjvcm\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.415119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp2db\" (UniqueName: \"kubernetes.io/projected/e72c903a-fb96-4318-9c25-d5a5af14fe5b-kube-api-access-pp2db\") pod \"nova-api-34da-account-create-s2cvr\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.431375 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhbt\" (UniqueName: \"kubernetes.io/projected/98615cf5-ae53-4563-8c79-0c09777cfdf8-kube-api-access-9qhbt\") pod \"nova-cell0-db-create-qjvcm\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.480131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.495456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b779838-79e3-45cb-be0b-6bacaba2eac3-operator-scripts\") pod \"nova-cell0-705a-account-create-g88d8\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.495618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-operator-scripts\") pod \"nova-cell1-db-create-2k6gs\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.495637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfck\" (UniqueName: \"kubernetes.io/projected/8b779838-79e3-45cb-be0b-6bacaba2eac3-kube-api-access-ljfck\") pod \"nova-cell0-705a-account-create-g88d8\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.495699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bnp8\" (UniqueName: \"kubernetes.io/projected/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-kube-api-access-5bnp8\") pod \"nova-cell1-db-create-2k6gs\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.513253 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.563265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.565019 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.576662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.593446 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r"] Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.606543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-operator-scripts\") pod \"nova-cell1-db-create-2k6gs\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.606606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfck\" (UniqueName: \"kubernetes.io/projected/8b779838-79e3-45cb-be0b-6bacaba2eac3-kube-api-access-ljfck\") pod \"nova-cell0-705a-account-create-g88d8\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.606643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5bnp8\" (UniqueName: \"kubernetes.io/projected/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-kube-api-access-5bnp8\") pod \"nova-cell1-db-create-2k6gs\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.606892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b779838-79e3-45cb-be0b-6bacaba2eac3-operator-scripts\") pod \"nova-cell0-705a-account-create-g88d8\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.608004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b779838-79e3-45cb-be0b-6bacaba2eac3-operator-scripts\") pod \"nova-cell0-705a-account-create-g88d8\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.609092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-operator-scripts\") pod \"nova-cell1-db-create-2k6gs\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.634455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bnp8\" (UniqueName: \"kubernetes.io/projected/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-kube-api-access-5bnp8\") pod \"nova-cell1-db-create-2k6gs\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.636438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfck\" (UniqueName: \"kubernetes.io/projected/8b779838-79e3-45cb-be0b-6bacaba2eac3-kube-api-access-ljfck\") pod \"nova-cell0-705a-account-create-g88d8\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.709547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d1ccc17d-6fdb-4b14-9953-f5309c225906-operator-scripts\") pod \"nova-cell1-1c71-account-create-lxq8r\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.709688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsxpw\" (UniqueName: \"kubernetes.io/projected/d1ccc17d-6fdb-4b14-9953-f5309c225906-kube-api-access-hsxpw\") pod \"nova-cell1-1c71-account-create-lxq8r\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.808255 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.812637 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d1ccc17d-6fdb-4b14-9953-f5309c225906-operator-scripts\") pod \"nova-cell1-1c71-account-create-lxq8r\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.812777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hsxpw\" (UniqueName: \"kubernetes.io/projected/d1ccc17d-6fdb-4b14-9953-f5309c225906-kube-api-access-hsxpw\") pod \"nova-cell1-1c71-account-create-lxq8r\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.814049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d1ccc17d-6fdb-4b14-9953-f5309c225906-operator-scripts\") pod \"nova-cell1-1c71-account-create-lxq8r\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.830890 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.844530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsxpw\" (UniqueName: \"kubernetes.io/projected/d1ccc17d-6fdb-4b14-9953-f5309c225906-kube-api-access-hsxpw\") pod \"nova-cell1-1c71-account-create-lxq8r\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.951814 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:32:58 crc kubenswrapper[4769]: I1121 12:32:58.972928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sjmg7"] Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.009220 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.148469 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-qjvcm"] Nov 21 12:32:59 crc kubenswrapper[4769]: W1121 12:32:59.257393 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode72c903a_fb96_4318_9c25_d5a5af14fe5b.slice/crio-2195ecf76b96b5ba1e9dac8e892f3c8bb215b9e962aa90f988a11dd55ddd168f WatchSource:0}: Error finding container 2195ecf76b96b5ba1e9dac8e892f3c8bb215b9e962aa90f988a11dd55ddd168f: Status 404 returned error can't find the container with id 2195ecf76b96b5ba1e9dac8e892f3c8bb215b9e962aa90f988a11dd55ddd168f Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.258625 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-34da-account-create-s2cvr"] Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.405867 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2k6gs"] Nov 21 12:32:59 crc kubenswrapper[4769]: W1121 12:32:59.405961 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa48c9f0_8467_445e_ae5f_133d2ad19e8d.slice/crio-f490cb8c7f47f5ed92d1ea9dcd54e5a966dcbe01a44a56e476f589cfd326896a WatchSource:0}: Error finding container f490cb8c7f47f5ed92d1ea9dcd54e5a966dcbe01a44a56e476f589cfd326896a: Status 404 returned error can't find the container with id f490cb8c7f47f5ed92d1ea9dcd54e5a966dcbe01a44a56e476f589cfd326896a Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.501181 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8"] Nov 21 12:32:59 crc kubenswrapper[4769]: W1121 12:32:59.678127 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1ccc17d_6fdb_4b14_9953_f5309c225906.slice/crio-ea5781c58e6cde0b71345bfdcc4b61b017cb158ab8397091bbaff523d8fd9606 WatchSource:0}: Error finding container ea5781c58e6cde0b71345bfdcc4b61b017cb158ab8397091bbaff523d8fd9606: Status 404 returned error can't find the container with id ea5781c58e6cde0b71345bfdcc4b61b017cb158ab8397091bbaff523d8fd9606 Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.687109 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r"] Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.828292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" event={"ID":"8b779838-79e3-45cb-be0b-6bacaba2eac3","Type":"ContainerStarted","Data":"e00d495c22eca933579a17e55c63d6c55f6e6b943d11d3b13a9438ed2c2a591d"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.830721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" event={"ID":"98615cf5-ae53-4563-8c79-0c09777cfdf8","Type":"ContainerStarted","Data":"18cd54a628817c8f7baf3d11018e2b325726a61ce627498876af9a968a67fe99"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.830766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" event={"ID":"98615cf5-ae53-4563-8c79-0c09777cfdf8","Type":"ContainerStarted","Data":"6a477a0ca5411f3de70f15f83d0e007f9626cdddaf6028a75ca0306e4ee19fe4"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.833106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" event={"ID":"e72c903a-fb96-4318-9c25-d5a5af14fe5b","Type":"ContainerStarted","Data":"2195ecf76b96b5ba1e9dac8e892f3c8bb215b9e962aa90f988a11dd55ddd168f"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.836126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" event={"ID":"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5","Type":"ContainerStarted","Data":"b06c346e0116f0dfa9930b33b0707370bff9e9fdf44963f59d03f5f9f74902c7"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.836163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" event={"ID":"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5","Type":"ContainerStarted","Data":"ff330a5a34da5c6f7ba7dd6aae1d63595f03c7ba8d4ec3cf45782f89304bfb26"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.837390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" event={"ID":"d1ccc17d-6fdb-4b14-9953-f5309c225906","Type":"ContainerStarted","Data":"ea5781c58e6cde0b71345bfdcc4b61b017cb158ab8397091bbaff523d8fd9606"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.839460 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" event={"ID":"fa48c9f0-8467-445e-ae5f-133d2ad19e8d","Type":"ContainerStarted","Data":"f490cb8c7f47f5ed92d1ea9dcd54e5a966dcbe01a44a56e476f589cfd326896a"} Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.847970 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" podStartSLOduration=1.8479530020000001 podStartE2EDuration="1.847953002s" podCreationTimestamp="2025-11-21 12:32:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:59.84229985 +0000 UTC m=+2538.542961668" watchObservedRunningTime="2025-11-21 12:32:59.847953002 +0000 UTC m=+2538.548614820" Nov 21 12:32:59 crc kubenswrapper[4769]: I1121 12:32:59.863376 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" podStartSLOduration=1.8633543559999999 podStartE2EDuration="1.863354356s" podCreationTimestamp="2025-11-21 12:32:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:32:59.855281919 +0000 UTC m=+2538.555943747" watchObservedRunningTime="2025-11-21 12:32:59.863354356 +0000 UTC m=+2538.564016174" Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.277764 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:33:00 crc kubenswrapper[4769]: E1121 12:33:00.278076 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.849295 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b779838-79e3-45cb-be0b-6bacaba2eac3" containerID="9dc17cf1cd84b80ca33795ff1fb32cc5cbc011913aceae8c323d820a5fd93e76" exitCode=0 Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.849680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" event={"ID":"8b779838-79e3-45cb-be0b-6bacaba2eac3","Type":"ContainerDied","Data":"9dc17cf1cd84b80ca33795ff1fb32cc5cbc011913aceae8c323d820a5fd93e76"} Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.851146 4769 generic.go:334] "Generic (PLEG): container finished" podID="98615cf5-ae53-4563-8c79-0c09777cfdf8" containerID="18cd54a628817c8f7baf3d11018e2b325726a61ce627498876af9a968a67fe99" exitCode=0 Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.851236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" event={"ID":"98615cf5-ae53-4563-8c79-0c09777cfdf8","Type":"ContainerDied","Data":"18cd54a628817c8f7baf3d11018e2b325726a61ce627498876af9a968a67fe99"} Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.852754 4769 generic.go:334] "Generic (PLEG): container finished" podID="e72c903a-fb96-4318-9c25-d5a5af14fe5b" containerID="0cdfa21496f8d481e65fc613245ee9cab33b56e012301d3142424f340c8b7568" exitCode=0 Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.852802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" event={"ID":"e72c903a-fb96-4318-9c25-d5a5af14fe5b","Type":"ContainerDied","Data":"0cdfa21496f8d481e65fc613245ee9cab33b56e012301d3142424f340c8b7568"} Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.854860 4769 generic.go:334] "Generic (PLEG): container finished" podID="579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" containerID="b06c346e0116f0dfa9930b33b0707370bff9e9fdf44963f59d03f5f9f74902c7" exitCode=0 Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.854900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" event={"ID":"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5","Type":"ContainerDied","Data":"b06c346e0116f0dfa9930b33b0707370bff9e9fdf44963f59d03f5f9f74902c7"} Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.856976 4769 generic.go:334] "Generic (PLEG): container finished" podID="d1ccc17d-6fdb-4b14-9953-f5309c225906" containerID="3f9f52b8356702d41729c5f27ddcc843fdd9003b7c6d35db954b10542c79366f" exitCode=0 Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.857040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" event={"ID":"d1ccc17d-6fdb-4b14-9953-f5309c225906","Type":"ContainerDied","Data":"3f9f52b8356702d41729c5f27ddcc843fdd9003b7c6d35db954b10542c79366f"} Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.859052 4769 generic.go:334] "Generic (PLEG): container finished" podID="fa48c9f0-8467-445e-ae5f-133d2ad19e8d" containerID="ae15527ade75ef4c2d7e9b112f520854088591d57a92b14948982eef9908b0a8" exitCode=0 Nov 21 12:33:00 crc kubenswrapper[4769]: I1121 12:33:00.859081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" event={"ID":"fa48c9f0-8467-445e-ae5f-133d2ad19e8d","Type":"ContainerDied","Data":"ae15527ade75ef4c2d7e9b112f520854088591d57a92b14948982eef9908b0a8"} Nov 21 12:33:01 crc kubenswrapper[4769]: I1121 12:33:01.161401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:33:01 crc kubenswrapper[4769]: I1121 12:33:01.187570 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:33:01 crc kubenswrapper[4769]: I1121 12:33:01.870358 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerID="21b51e998beb569a7fa648671992f944c7e637cf70dcb019287e5f79c60f1d5a" exitCode=0 Nov 21 12:33:01 crc kubenswrapper[4769]: I1121 12:33:01.870467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerDied","Data":"21b51e998beb569a7fa648671992f944c7e637cf70dcb019287e5f79c60f1d5a"} Nov 21 12:33:01 crc kubenswrapper[4769]: I1121 12:33:01.871909 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:33:01 crc kubenswrapper[4769]: I1121 12:33:01.901069 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.111088 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.173400 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr"] Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.173710 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-api" containerID="cri-o://3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989" gracePeriod=30 Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.173819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-httpd" containerID="cri-o://c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317" gracePeriod=30 Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.327104 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.385090 4769 scope.go:117] "RemoveContainer" containerID="e60a0eacbd92686a4e4625c7e0b984bfacf526395f1d0f5e1c33fde419f2e718" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.487495 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-sg-core-conf-yaml\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496680 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-combined-ca-bundle\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496734 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-config-data\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-log-httpd\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496852 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-run-httpd\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfr4x\" (UniqueName: \"kubernetes.io/projected/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-kube-api-access-nfr4x\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.496922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-scripts\") pod \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\" (UID: \"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.497585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.497945 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.511782 4769 scope.go:117] "RemoveContainer" containerID="3fc3c30f17375383094a090bf25f85d4eb6c27ab87d17544d6489fe14be3249b" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.512333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-scripts" (OuterVolumeSpecName: "scripts") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.512808 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.513385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-kube-api-access-nfr4x" (OuterVolumeSpecName: "kube-api-access-nfr4x") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "kube-api-access-nfr4x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.515237 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.527384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.533542 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.539610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.574373 4769 scope.go:117] "RemoveContainer" containerID="6c5d5bf81b0e16a0e34df33eca155cc06e549470a2d4ec0a6a848f0856f8c491" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.598237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b779838-79e3-45cb-be0b-6bacaba2eac3-operator-scripts\") pod \"8b779838-79e3-45cb-be0b-6bacaba2eac3\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.598695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e72c903a-fb96-4318-9c25-d5a5af14fe5b-operator-scripts\") pod \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.598764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qhbt\" (UniqueName: \"kubernetes.io/projected/98615cf5-ae53-4563-8c79-0c09777cfdf8-kube-api-access-9qhbt\") pod \"98615cf5-ae53-4563-8c79-0c09777cfdf8\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.598795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljfck\" (UniqueName: \"kubernetes.io/projected/8b779838-79e3-45cb-be0b-6bacaba2eac3-kube-api-access-ljfck\") pod \"8b779838-79e3-45cb-be0b-6bacaba2eac3\" (UID: \"8b779838-79e3-45cb-be0b-6bacaba2eac3\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.598933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98615cf5-ae53-4563-8c79-0c09777cfdf8-operator-scripts\") pod \"98615cf5-ae53-4563-8c79-0c09777cfdf8\" (UID: \"98615cf5-ae53-4563-8c79-0c09777cfdf8\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.598988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp2db\" (UniqueName: \"kubernetes.io/projected/e72c903a-fb96-4318-9c25-d5a5af14fe5b-kube-api-access-pp2db\") pod \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\" (UID: \"e72c903a-fb96-4318-9c25-d5a5af14fe5b\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.599635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b779838-79e3-45cb-be0b-6bacaba2eac3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8b779838-79e3-45cb-be0b-6bacaba2eac3" (UID: "8b779838-79e3-45cb-be0b-6bacaba2eac3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.599882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98615cf5-ae53-4563-8c79-0c09777cfdf8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "98615cf5-ae53-4563-8c79-0c09777cfdf8" (UID: "98615cf5-ae53-4563-8c79-0c09777cfdf8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.599960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e72c903a-fb96-4318-9c25-d5a5af14fe5b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e72c903a-fb96-4318-9c25-d5a5af14fe5b" (UID: "e72c903a-fb96-4318-9c25-d5a5af14fe5b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600244 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/98615cf5-ae53-4563-8c79-0c09777cfdf8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600264 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600273 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600283 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nfr4x\" (UniqueName: \"kubernetes.io/projected/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-kube-api-access-nfr4x\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600296 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600304 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8b779838-79e3-45cb-be0b-6bacaba2eac3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600314 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.600322 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e72c903a-fb96-4318-9c25-d5a5af14fe5b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.602986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98615cf5-ae53-4563-8c79-0c09777cfdf8-kube-api-access-9qhbt" (OuterVolumeSpecName: "kube-api-access-9qhbt") pod "98615cf5-ae53-4563-8c79-0c09777cfdf8" (UID: "98615cf5-ae53-4563-8c79-0c09777cfdf8"). InnerVolumeSpecName "kube-api-access-9qhbt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.604364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b779838-79e3-45cb-be0b-6bacaba2eac3-kube-api-access-ljfck" (OuterVolumeSpecName: "kube-api-access-ljfck") pod "8b779838-79e3-45cb-be0b-6bacaba2eac3" (UID: "8b779838-79e3-45cb-be0b-6bacaba2eac3"). InnerVolumeSpecName "kube-api-access-ljfck". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.607924 4769 scope.go:117] "RemoveContainer" containerID="40d42ea9cdce4f803f1500c48021d39f0a3cdff2402fa9bd323bfdd692284b29" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.610976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e72c903a-fb96-4318-9c25-d5a5af14fe5b-kube-api-access-pp2db" (OuterVolumeSpecName: "kube-api-access-pp2db") pod "e72c903a-fb96-4318-9c25-d5a5af14fe5b" (UID: "e72c903a-fb96-4318-9c25-d5a5af14fe5b"). InnerVolumeSpecName "kube-api-access-pp2db". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.626365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.649537 4769 scope.go:117] "RemoveContainer" containerID="6988eca2319d53f13a6625839d4af2bec2240a0d34f102eb559c4bb2e59d0a60" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.663471 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.701834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-operator-scripts\") pod \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsxpw\" (UniqueName: \"kubernetes.io/projected/d1ccc17d-6fdb-4b14-9953-f5309c225906-kube-api-access-hsxpw\") pod \"d1ccc17d-6fdb-4b14-9953-f5309c225906\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d1ccc17d-6fdb-4b14-9953-f5309c225906-operator-scripts\") pod \"d1ccc17d-6fdb-4b14-9953-f5309c225906\" (UID: \"d1ccc17d-6fdb-4b14-9953-f5309c225906\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" (UID: "579ced9e-ceda-43fe-aed4-1f3b0c3b13a5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmvgv\" (UniqueName: \"kubernetes.io/projected/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-kube-api-access-kmvgv\") pod \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\" (UID: \"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702708 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9qhbt\" (UniqueName: \"kubernetes.io/projected/98615cf5-ae53-4563-8c79-0c09777cfdf8-kube-api-access-9qhbt\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702728 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ljfck\" (UniqueName: \"kubernetes.io/projected/8b779838-79e3-45cb-be0b-6bacaba2eac3-kube-api-access-ljfck\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702737 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702746 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702756 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pp2db\" (UniqueName: \"kubernetes.io/projected/e72c903a-fb96-4318-9c25-d5a5af14fe5b-kube-api-access-pp2db\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.702814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ccc17d-6fdb-4b14-9953-f5309c225906-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d1ccc17d-6fdb-4b14-9953-f5309c225906" (UID: "d1ccc17d-6fdb-4b14-9953-f5309c225906"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.705742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-kube-api-access-kmvgv" (OuterVolumeSpecName: "kube-api-access-kmvgv") pod "579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" (UID: "579ced9e-ceda-43fe-aed4-1f3b0c3b13a5"). InnerVolumeSpecName "kube-api-access-kmvgv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.706016 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ccc17d-6fdb-4b14-9953-f5309c225906-kube-api-access-hsxpw" (OuterVolumeSpecName: "kube-api-access-hsxpw") pod "d1ccc17d-6fdb-4b14-9953-f5309c225906" (UID: "d1ccc17d-6fdb-4b14-9953-f5309c225906"). InnerVolumeSpecName "kube-api-access-hsxpw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.714429 4769 scope.go:117] "RemoveContainer" containerID="1827b1f784e79a722086683fbfd7211d39f2dc36023ee7cf7fa62909636ac29a" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.728626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-config-data" (OuterVolumeSpecName: "config-data") pod "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" (UID: "ae66f5ab-fa1b-401a-9df1-19e1defe8fd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.738841 4769 scope.go:117] "RemoveContainer" containerID="37f50ffdbd0f6f408a64594eaa3cf2cfb3abaa80ffa12b6b70c9bb5515267117" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.785315 4769 scope.go:117] "RemoveContainer" containerID="cdea5e7fb66fbe7d2d9e9d32c7026d6a96e1274c9c50595695cb6632fab63513" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.803592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-operator-scripts\") pod \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.803840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bnp8\" (UniqueName: \"kubernetes.io/projected/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-kube-api-access-5bnp8\") pod \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\" (UID: \"fa48c9f0-8467-445e-ae5f-133d2ad19e8d\") " Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.804315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fa48c9f0-8467-445e-ae5f-133d2ad19e8d" (UID: "fa48c9f0-8467-445e-ae5f-133d2ad19e8d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.804415 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.804444 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hsxpw\" (UniqueName: \"kubernetes.io/projected/d1ccc17d-6fdb-4b14-9953-f5309c225906-kube-api-access-hsxpw\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.804459 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d1ccc17d-6fdb-4b14-9953-f5309c225906-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.804477 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kmvgv\" (UniqueName: \"kubernetes.io/projected/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5-kube-api-access-kmvgv\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.806963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-kube-api-access-5bnp8" (OuterVolumeSpecName: "kube-api-access-5bnp8") pod "fa48c9f0-8467-445e-ae5f-133d2ad19e8d" (UID: "fa48c9f0-8467-445e-ae5f-133d2ad19e8d"). InnerVolumeSpecName "kube-api-access-5bnp8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.905961 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5bnp8\" (UniqueName: \"kubernetes.io/projected/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-kube-api-access-5bnp8\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.908929 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa48c9f0-8467-445e-ae5f-133d2ad19e8d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.908842 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.908819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ae66f5ab-fa1b-401a-9df1-19e1defe8fd6","Type":"ContainerDied","Data":"ca99369551e95559633fe49929aa9b55155c2dca067359e0e4f96fc9ad0889bb"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.909394 4769 scope.go:117] "RemoveContainer" containerID="2972da44ab596a044839d5d499fe9a42c86945715140cf2ae80012493bfb504a" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.911714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" event={"ID":"e72c903a-fb96-4318-9c25-d5a5af14fe5b","Type":"ContainerDied","Data":"2195ecf76b96b5ba1e9dac8e892f3c8bb215b9e962aa90f988a11dd55ddd168f"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.911758 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2195ecf76b96b5ba1e9dac8e892f3c8bb215b9e962aa90f988a11dd55ddd168f" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.912112 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-34da-account-create-s2cvr" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.921599 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.921843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sjmg7" event={"ID":"579ced9e-ceda-43fe-aed4-1f3b0c3b13a5","Type":"ContainerDied","Data":"ff330a5a34da5c6f7ba7dd6aae1d63595f03c7ba8d4ec3cf45782f89304bfb26"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.921892 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff330a5a34da5c6f7ba7dd6aae1d63595f03c7ba8d4ec3cf45782f89304bfb26" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.924044 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.924084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-2k6gs" event={"ID":"fa48c9f0-8467-445e-ae5f-133d2ad19e8d","Type":"ContainerDied","Data":"f490cb8c7f47f5ed92d1ea9dcd54e5a966dcbe01a44a56e476f589cfd326896a"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.924126 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f490cb8c7f47f5ed92d1ea9dcd54e5a966dcbe01a44a56e476f589cfd326896a" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.926455 4769 generic.go:334] "Generic (PLEG): container finished" podID="a12216e8-3323-4cd2-a422-387689dcdf22" containerID="c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317" exitCode=0 Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.926483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" event={"ID":"a12216e8-3323-4cd2-a422-387689dcdf22","Type":"ContainerDied","Data":"c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.930259 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.930409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r" event={"ID":"d1ccc17d-6fdb-4b14-9953-f5309c225906","Type":"ContainerDied","Data":"ea5781c58e6cde0b71345bfdcc4b61b017cb158ab8397091bbaff523d8fd9606"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.930441 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea5781c58e6cde0b71345bfdcc4b61b017cb158ab8397091bbaff523d8fd9606" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.935006 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" event={"ID":"8b779838-79e3-45cb-be0b-6bacaba2eac3","Type":"ContainerDied","Data":"e00d495c22eca933579a17e55c63d6c55f6e6b943d11d3b13a9438ed2c2a591d"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.935039 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e00d495c22eca933579a17e55c63d6c55f6e6b943d11d3b13a9438ed2c2a591d" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.935045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.937272 4769 scope.go:117] "RemoveContainer" containerID="5d91c1e16381ffb34da5a2525837d45ec1e34fbcc79ba3fa7d8febdcdcad9754" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.937945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" event={"ID":"98615cf5-ae53-4563-8c79-0c09777cfdf8","Type":"ContainerDied","Data":"6a477a0ca5411f3de70f15f83d0e007f9626cdddaf6028a75ca0306e4ee19fe4"} Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.937983 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a477a0ca5411f3de70f15f83d0e007f9626cdddaf6028a75ca0306e4ee19fe4" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.938034 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-qjvcm" Nov 21 12:33:02 crc kubenswrapper[4769]: I1121 12:33:02.962319 4769 scope.go:117] "RemoveContainer" containerID="a7ec988bf2b8f9d6f62325114e2a5a210b67fd300652e5f9705bf0bfbeea30df" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.004599 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.005931 4769 scope.go:117] "RemoveContainer" containerID="bc44066b35ce9ffb7e858f3b0ecae5ca57a4f914a2d9b10a66f2d213bc8e0348" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.021479 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.033741 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034123 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="proxy-httpd" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034135 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="proxy-httpd" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034150 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034155 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034168 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e72c903a-fb96-4318-9c25-d5a5af14fe5b" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e72c903a-fb96-4318-9c25-d5a5af14fe5b" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034206 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-central-agent" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-central-agent" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034237 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fa48c9f0-8467-445e-ae5f-133d2ad19e8d" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034245 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa48c9f0-8467-445e-ae5f-133d2ad19e8d" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034260 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d1ccc17d-6fdb-4b14-9953-f5309c225906" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034268 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ccc17d-6fdb-4b14-9953-f5309c225906" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034280 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-notification-agent" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034288 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-notification-agent" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034305 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98615cf5-ae53-4563-8c79-0c09777cfdf8" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034312 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98615cf5-ae53-4563-8c79-0c09777cfdf8" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034330 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b779838-79e3-45cb-be0b-6bacaba2eac3" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034336 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b779838-79e3-45cb-be0b-6bacaba2eac3" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: E1121 12:33:03.034365 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="sg-core" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034373 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="sg-core" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034585 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d1ccc17d-6fdb-4b14-9953-f5309c225906" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034609 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034621 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="proxy-httpd" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034631 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-central-agent" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034647 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b779838-79e3-45cb-be0b-6bacaba2eac3" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034656 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fa48c9f0-8467-445e-ae5f-133d2ad19e8d" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034668 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="sg-core" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034687 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="98615cf5-ae53-4563-8c79-0c09777cfdf8" containerName="mariadb-database-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034695 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e72c903a-fb96-4318-9c25-d5a5af14fe5b" containerName="mariadb-account-create" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.034722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" containerName="ceilometer-notification-agent" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.035916 4769 scope.go:117] "RemoveContainer" containerID="f5784937060356b6c99ea89233f5fb99fad88588f1cd611c96f49680c25c8b36" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.036876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.046250 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.052656 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.052840 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.074554 4769 scope.go:117] "RemoveContainer" containerID="f52d9ee5fc92fc3c18ba03bd4c480a67da3a343ae27a48f195329d5d120351f6" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.102625 4769 scope.go:117] "RemoveContainer" containerID="21b51e998beb569a7fa648671992f944c7e637cf70dcb019287e5f79c60f1d5a" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.213715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-config-data\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.213762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-run-httpd\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.213785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-log-httpd\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.213832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-scripts\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.213956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bgp4\" (UniqueName: \"kubernetes.io/projected/887cb438-b99d-46a7-b2ec-7306ec67f0a4-kube-api-access-5bgp4\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.214269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.214346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.288644 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae66f5ab-fa1b-401a-9df1-19e1defe8fd6" path="/var/lib/kubelet/pods/ae66f5ab-fa1b-401a-9df1-19e1defe8fd6/volumes" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.315947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-config-data\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.316003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-run-httpd\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.316028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-log-httpd\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.316078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-scripts\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.316100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5bgp4\" (UniqueName: \"kubernetes.io/projected/887cb438-b99d-46a7-b2ec-7306ec67f0a4-kube-api-access-5bgp4\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.316766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-run-httpd\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.316818 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-log-httpd\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.317047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.317086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.320471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.321568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-scripts\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.322961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.328496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-config-data\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.332990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bgp4\" (UniqueName: \"kubernetes.io/projected/887cb438-b99d-46a7-b2ec-7306ec67f0a4-kube-api-access-5bgp4\") pod \"ceilometer-0\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:03 crc kubenswrapper[4769]: I1121 12:33:03.396091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:04 crc kubenswrapper[4769]: I1121 12:33:04.048599 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:04 crc kubenswrapper[4769]: I1121 12:33:04.962830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerStarted","Data":"c94e4599a3de34c8a0b7806b5fee9354dcd2e5465bd95e25b970cefa29616bfe"} Nov 21 12:33:04 crc kubenswrapper[4769]: I1121 12:33:04.963495 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerStarted","Data":"3aebb8ce6f094e8f8e0e00ac6fee25c8f96f1734da010b194dd9f7e56a898992"} Nov 21 12:33:05 crc kubenswrapper[4769]: I1121 12:33:05.982933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerStarted","Data":"98d718e2f1adffa179fff8acd7d451d82d8b5093d8abe0b9fd78d0daf8781153"} Nov 21 12:33:06 crc kubenswrapper[4769]: I1121 12:33:06.994654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerStarted","Data":"d4d7f1007f9f8a6cededeef466399f2997d5dee82e1a8d0f876173379694f594"} Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.007423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerStarted","Data":"03da1e8510f1b286fae19234ba98f9e3e961b7916fb90b383406ba0ed80a64b9"} Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.007833 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.033687 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.956030466 podStartE2EDuration="6.033669777s" podCreationTimestamp="2025-11-21 12:33:02 +0000 UTC" firstStartedPulling="2025-11-21 12:33:04.015329071 +0000 UTC m=+2542.715990899" lastFinishedPulling="2025-11-21 12:33:07.092968392 +0000 UTC m=+2545.793630210" observedRunningTime="2025-11-21 12:33:08.028726035 +0000 UTC m=+2546.729387853" watchObservedRunningTime="2025-11-21 12:33:08.033669777 +0000 UTC m=+2546.734331585" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.624135 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7"] Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.625920 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.630785 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.630855 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-g64ck" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.631109 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.640010 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7"] Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.726041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.726371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-scripts\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.726512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-config-data\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.726709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjlbb\" (UniqueName: \"kubernetes.io/projected/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-kube-api-access-qjlbb\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.829111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.829258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-scripts\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.829299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-config-data\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.829346 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qjlbb\" (UniqueName: \"kubernetes.io/projected/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-kube-api-access-qjlbb\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.836655 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-scripts\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.837025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.837736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-config-data\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.862335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjlbb\" (UniqueName: \"kubernetes.io/projected/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-kube-api-access-qjlbb\") pod \"nova-cell0-conductor-db-sync-5r6h7\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:08 crc kubenswrapper[4769]: I1121 12:33:08.947849 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:09 crc kubenswrapper[4769]: W1121 12:33:09.454611 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ad342ab_e6e5_4a5d_a8b7_b2c0ee6ecba0.slice/crio-d265ecd38fd45cec456cef90c3363bed17232ad16fc83560bbf60a77d62ab8ef WatchSource:0}: Error finding container d265ecd38fd45cec456cef90c3363bed17232ad16fc83560bbf60a77d62ab8ef: Status 404 returned error can't find the container with id d265ecd38fd45cec456cef90c3363bed17232ad16fc83560bbf60a77d62ab8ef Nov 21 12:33:09 crc kubenswrapper[4769]: I1121 12:33:09.455062 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7"] Nov 21 12:33:10 crc kubenswrapper[4769]: I1121 12:33:10.036116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" event={"ID":"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0","Type":"ContainerStarted","Data":"6234749c292f517559d66625626c3a432015821d03db04773a332a9e9094722d"} Nov 21 12:33:10 crc kubenswrapper[4769]: I1121 12:33:10.036500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" event={"ID":"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0","Type":"ContainerStarted","Data":"d265ecd38fd45cec456cef90c3363bed17232ad16fc83560bbf60a77d62ab8ef"} Nov 21 12:33:10 crc kubenswrapper[4769]: I1121 12:33:10.058736 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" podStartSLOduration=2.058712237 podStartE2EDuration="2.058712237s" podCreationTimestamp="2025-11-21 12:33:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:10.052004857 +0000 UTC m=+2548.752666685" watchObservedRunningTime="2025-11-21 12:33:10.058712237 +0000 UTC m=+2548.759374055" Nov 21 12:33:14 crc kubenswrapper[4769]: I1121 12:33:14.273971 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:33:14 crc kubenswrapper[4769]: E1121 12:33:14.274755 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.523221 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.684500 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-httpd-config\") pod \"a12216e8-3323-4cd2-a422-387689dcdf22\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.684832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-ovndb-tls-certs\") pod \"a12216e8-3323-4cd2-a422-387689dcdf22\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.684902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-config\") pod \"a12216e8-3323-4cd2-a422-387689dcdf22\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.684941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ptbl\" (UniqueName: \"kubernetes.io/projected/a12216e8-3323-4cd2-a422-387689dcdf22-kube-api-access-6ptbl\") pod \"a12216e8-3323-4cd2-a422-387689dcdf22\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.685670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-combined-ca-bundle\") pod \"a12216e8-3323-4cd2-a422-387689dcdf22\" (UID: \"a12216e8-3323-4cd2-a422-387689dcdf22\") " Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.703499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "a12216e8-3323-4cd2-a422-387689dcdf22" (UID: "a12216e8-3323-4cd2-a422-387689dcdf22"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.703614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a12216e8-3323-4cd2-a422-387689dcdf22-kube-api-access-6ptbl" (OuterVolumeSpecName: "kube-api-access-6ptbl") pod "a12216e8-3323-4cd2-a422-387689dcdf22" (UID: "a12216e8-3323-4cd2-a422-387689dcdf22"). InnerVolumeSpecName "kube-api-access-6ptbl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.756103 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-config" (OuterVolumeSpecName: "config") pod "a12216e8-3323-4cd2-a422-387689dcdf22" (UID: "a12216e8-3323-4cd2-a422-387689dcdf22"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.761358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a12216e8-3323-4cd2-a422-387689dcdf22" (UID: "a12216e8-3323-4cd2-a422-387689dcdf22"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.788409 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.788468 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.788481 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6ptbl\" (UniqueName: \"kubernetes.io/projected/a12216e8-3323-4cd2-a422-387689dcdf22-kube-api-access-6ptbl\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.788493 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.789847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "a12216e8-3323-4cd2-a422-387689dcdf22" (UID: "a12216e8-3323-4cd2-a422-387689dcdf22"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:15 crc kubenswrapper[4769]: I1121 12:33:15.889830 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a12216e8-3323-4cd2-a422-387689dcdf22-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.108621 4769 generic.go:334] "Generic (PLEG): container finished" podID="a12216e8-3323-4cd2-a422-387689dcdf22" containerID="3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989" exitCode=0 Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.108674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" event={"ID":"a12216e8-3323-4cd2-a422-387689dcdf22","Type":"ContainerDied","Data":"3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989"} Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.108735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" event={"ID":"a12216e8-3323-4cd2-a422-387689dcdf22","Type":"ContainerDied","Data":"25543d8883de2f5e26e1dfb0cebd676538b085e7506a94d26fb623fa81d002f5"} Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.108765 4769 scope.go:117] "RemoveContainer" containerID="c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.108688 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.159361 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr"] Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.159605 4769 scope.go:117] "RemoveContainer" containerID="3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.176558 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6dbbbb985f-xd7vr"] Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.189015 4769 scope.go:117] "RemoveContainer" containerID="c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317" Nov 21 12:33:16 crc kubenswrapper[4769]: E1121 12:33:16.189504 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317\": container with ID starting with c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317 not found: ID does not exist" containerID="c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.189548 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317"} err="failed to get container status \"c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317\": rpc error: code = NotFound desc = could not find container \"c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317\": container with ID starting with c6f04c75a2592f8a5c4618c297ff635da72b809da97ce3b9a2cd72b6ebc11317 not found: ID does not exist" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.189575 4769 scope.go:117] "RemoveContainer" containerID="3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989" Nov 21 12:33:16 crc kubenswrapper[4769]: E1121 12:33:16.190021 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989\": container with ID starting with 3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989 not found: ID does not exist" containerID="3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989" Nov 21 12:33:16 crc kubenswrapper[4769]: I1121 12:33:16.190073 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989"} err="failed to get container status \"3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989\": rpc error: code = NotFound desc = could not find container \"3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989\": container with ID starting with 3a4c0f92ed911abc2c7e86d738bff60a78437198945433fc66237c71473f1989 not found: ID does not exist" Nov 21 12:33:17 crc kubenswrapper[4769]: I1121 12:33:17.328573 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" path="/var/lib/kubelet/pods/a12216e8-3323-4cd2-a422-387689dcdf22/volumes" Nov 21 12:33:19 crc kubenswrapper[4769]: I1121 12:33:19.251655 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:19 crc kubenswrapper[4769]: I1121 12:33:19.251933 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-central-agent" containerID="cri-o://c94e4599a3de34c8a0b7806b5fee9354dcd2e5465bd95e25b970cefa29616bfe" gracePeriod=30 Nov 21 12:33:19 crc kubenswrapper[4769]: I1121 12:33:19.251974 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="sg-core" containerID="cri-o://d4d7f1007f9f8a6cededeef466399f2997d5dee82e1a8d0f876173379694f594" gracePeriod=30 Nov 21 12:33:19 crc kubenswrapper[4769]: I1121 12:33:19.252036 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="proxy-httpd" containerID="cri-o://03da1e8510f1b286fae19234ba98f9e3e961b7916fb90b383406ba0ed80a64b9" gracePeriod=30 Nov 21 12:33:19 crc kubenswrapper[4769]: I1121 12:33:19.252039 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-notification-agent" containerID="cri-o://98d718e2f1adffa179fff8acd7d451d82d8b5093d8abe0b9fd78d0daf8781153" gracePeriod=30 Nov 21 12:33:19 crc kubenswrapper[4769]: I1121 12:33:19.271842 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 502" Nov 21 12:33:20 crc kubenswrapper[4769]: I1121 12:33:20.157101 4769 generic.go:334] "Generic (PLEG): container finished" podID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerID="03da1e8510f1b286fae19234ba98f9e3e961b7916fb90b383406ba0ed80a64b9" exitCode=0 Nov 21 12:33:20 crc kubenswrapper[4769]: I1121 12:33:20.157138 4769 generic.go:334] "Generic (PLEG): container finished" podID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerID="d4d7f1007f9f8a6cededeef466399f2997d5dee82e1a8d0f876173379694f594" exitCode=2 Nov 21 12:33:20 crc kubenswrapper[4769]: I1121 12:33:20.157147 4769 generic.go:334] "Generic (PLEG): container finished" podID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerID="c94e4599a3de34c8a0b7806b5fee9354dcd2e5465bd95e25b970cefa29616bfe" exitCode=0 Nov 21 12:33:20 crc kubenswrapper[4769]: I1121 12:33:20.157171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerDied","Data":"03da1e8510f1b286fae19234ba98f9e3e961b7916fb90b383406ba0ed80a64b9"} Nov 21 12:33:20 crc kubenswrapper[4769]: I1121 12:33:20.157216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerDied","Data":"d4d7f1007f9f8a6cededeef466399f2997d5dee82e1a8d0f876173379694f594"} Nov 21 12:33:20 crc kubenswrapper[4769]: I1121 12:33:20.157253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerDied","Data":"c94e4599a3de34c8a0b7806b5fee9354dcd2e5465bd95e25b970cefa29616bfe"} Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.183110 4769 generic.go:334] "Generic (PLEG): container finished" podID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerID="98d718e2f1adffa179fff8acd7d451d82d8b5093d8abe0b9fd78d0daf8781153" exitCode=0 Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.183177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerDied","Data":"98d718e2f1adffa179fff8acd7d451d82d8b5093d8abe0b9fd78d0daf8781153"} Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.641795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-log-httpd\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bgp4\" (UniqueName: \"kubernetes.io/projected/887cb438-b99d-46a7-b2ec-7306ec67f0a4-kube-api-access-5bgp4\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-config-data\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-scripts\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-run-httpd\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-sg-core-conf-yaml\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.718755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-combined-ca-bundle\") pod \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\" (UID: \"887cb438-b99d-46a7-b2ec-7306ec67f0a4\") " Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.720319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.720910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.725874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887cb438-b99d-46a7-b2ec-7306ec67f0a4-kube-api-access-5bgp4" (OuterVolumeSpecName: "kube-api-access-5bgp4") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "kube-api-access-5bgp4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.728207 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-scripts" (OuterVolumeSpecName: "scripts") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.757601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.818782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.822053 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.822105 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.822119 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.822133 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.822145 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/887cb438-b99d-46a7-b2ec-7306ec67f0a4-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.822156 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5bgp4\" (UniqueName: \"kubernetes.io/projected/887cb438-b99d-46a7-b2ec-7306ec67f0a4-kube-api-access-5bgp4\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.830765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-config-data" (OuterVolumeSpecName: "config-data") pod "887cb438-b99d-46a7-b2ec-7306ec67f0a4" (UID: "887cb438-b99d-46a7-b2ec-7306ec67f0a4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:22 crc kubenswrapper[4769]: I1121 12:33:22.923677 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/887cb438-b99d-46a7-b2ec-7306ec67f0a4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.197780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"887cb438-b99d-46a7-b2ec-7306ec67f0a4","Type":"ContainerDied","Data":"3aebb8ce6f094e8f8e0e00ac6fee25c8f96f1734da010b194dd9f7e56a898992"} Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.197866 4769 scope.go:117] "RemoveContainer" containerID="03da1e8510f1b286fae19234ba98f9e3e961b7916fb90b383406ba0ed80a64b9" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.197867 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.241699 4769 scope.go:117] "RemoveContainer" containerID="d4d7f1007f9f8a6cededeef466399f2997d5dee82e1a8d0f876173379694f594" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.270133 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.272258 4769 scope.go:117] "RemoveContainer" containerID="98d718e2f1adffa179fff8acd7d451d82d8b5093d8abe0b9fd78d0daf8781153" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.305315 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.314931 4769 scope.go:117] "RemoveContainer" containerID="c94e4599a3de34c8a0b7806b5fee9354dcd2e5465bd95e25b970cefa29616bfe" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.328704 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:23 crc kubenswrapper[4769]: E1121 12:33:23.329243 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-api" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329266 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-api" Nov 21 12:33:23 crc kubenswrapper[4769]: E1121 12:33:23.329288 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-httpd" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329297 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-httpd" Nov 21 12:33:23 crc kubenswrapper[4769]: E1121 12:33:23.329313 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="sg-core" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329322 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="sg-core" Nov 21 12:33:23 crc kubenswrapper[4769]: E1121 12:33:23.329349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-notification-agent" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329358 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-notification-agent" Nov 21 12:33:23 crc kubenswrapper[4769]: E1121 12:33:23.329388 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="proxy-httpd" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329398 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="proxy-httpd" Nov 21 12:33:23 crc kubenswrapper[4769]: E1121 12:33:23.329411 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-central-agent" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329419 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-central-agent" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329638 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="sg-core" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329671 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-notification-agent" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329695 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="proxy-httpd" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329709 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-httpd" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329726 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a12216e8-3323-4cd2-a422-387689dcdf22" containerName="neutron-api" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.329735 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" containerName="ceilometer-central-agent" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.332048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.335501 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.335819 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.361745 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-log-httpd\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-scripts\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-run-httpd\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srqqp\" (UniqueName: \"kubernetes.io/projected/d72488d1-2497-44b2-8206-32cf85562168-kube-api-access-srqqp\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446639 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-config-data\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.446689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.547858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-run-httpd\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.547913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srqqp\" (UniqueName: \"kubernetes.io/projected/d72488d1-2497-44b2-8206-32cf85562168-kube-api-access-srqqp\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.547976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.548009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-config-data\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.548029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.548114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-log-httpd\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.548144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-scripts\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.549103 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-run-httpd\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.549589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-log-httpd\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.554694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.554892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.555993 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-scripts\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.571043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-config-data\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.575702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srqqp\" (UniqueName: \"kubernetes.io/projected/d72488d1-2497-44b2-8206-32cf85562168-kube-api-access-srqqp\") pod \"ceilometer-0\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:23 crc kubenswrapper[4769]: I1121 12:33:23.694520 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:24 crc kubenswrapper[4769]: I1121 12:33:24.219508 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:24 crc kubenswrapper[4769]: W1121 12:33:24.224551 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd72488d1_2497_44b2_8206_32cf85562168.slice/crio-6db8948edda7b4f094f21a27103e9bb18bf7d6e077c8620f8a3d6776c58b48aa WatchSource:0}: Error finding container 6db8948edda7b4f094f21a27103e9bb18bf7d6e077c8620f8a3d6776c58b48aa: Status 404 returned error can't find the container with id 6db8948edda7b4f094f21a27103e9bb18bf7d6e077c8620f8a3d6776c58b48aa Nov 21 12:33:25 crc kubenswrapper[4769]: I1121 12:33:25.224145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerStarted","Data":"6db8948edda7b4f094f21a27103e9bb18bf7d6e077c8620f8a3d6776c58b48aa"} Nov 21 12:33:25 crc kubenswrapper[4769]: I1121 12:33:25.287106 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="887cb438-b99d-46a7-b2ec-7306ec67f0a4" path="/var/lib/kubelet/pods/887cb438-b99d-46a7-b2ec-7306ec67f0a4/volumes" Nov 21 12:33:26 crc kubenswrapper[4769]: I1121 12:33:26.241385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerStarted","Data":"8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0"} Nov 21 12:33:27 crc kubenswrapper[4769]: I1121 12:33:27.269062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerStarted","Data":"1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc"} Nov 21 12:33:28 crc kubenswrapper[4769]: I1121 12:33:28.284276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerStarted","Data":"9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a"} Nov 21 12:33:29 crc kubenswrapper[4769]: I1121 12:33:29.275949 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:33:29 crc kubenswrapper[4769]: E1121 12:33:29.276249 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:33:30 crc kubenswrapper[4769]: I1121 12:33:30.326951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerStarted","Data":"221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142"} Nov 21 12:33:30 crc kubenswrapper[4769]: I1121 12:33:30.327397 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:35 crc kubenswrapper[4769]: I1121 12:33:35.550083 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" containerID="6234749c292f517559d66625626c3a432015821d03db04773a332a9e9094722d" exitCode=0 Nov 21 12:33:35 crc kubenswrapper[4769]: I1121 12:33:35.550328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" event={"ID":"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0","Type":"ContainerDied","Data":"6234749c292f517559d66625626c3a432015821d03db04773a332a9e9094722d"} Nov 21 12:33:35 crc kubenswrapper[4769]: I1121 12:33:35.575436 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=6.962395123 podStartE2EDuration="12.575388983s" podCreationTimestamp="2025-11-21 12:33:23 +0000 UTC" firstStartedPulling="2025-11-21 12:33:24.227711082 +0000 UTC m=+2562.928372900" lastFinishedPulling="2025-11-21 12:33:29.840704942 +0000 UTC m=+2568.541366760" observedRunningTime="2025-11-21 12:33:30.350280294 +0000 UTC m=+2569.050942112" watchObservedRunningTime="2025-11-21 12:33:35.575388983 +0000 UTC m=+2574.276050811" Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.916534 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.934108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-combined-ca-bundle\") pod \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.934379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-scripts\") pod \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.934427 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjlbb\" (UniqueName: \"kubernetes.io/projected/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-kube-api-access-qjlbb\") pod \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.934479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-config-data\") pod \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\" (UID: \"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0\") " Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.942567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-scripts" (OuterVolumeSpecName: "scripts") pod "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" (UID: "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.942760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-kube-api-access-qjlbb" (OuterVolumeSpecName: "kube-api-access-qjlbb") pod "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" (UID: "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0"). InnerVolumeSpecName "kube-api-access-qjlbb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.964975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" (UID: "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:36 crc kubenswrapper[4769]: I1121 12:33:36.970437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-config-data" (OuterVolumeSpecName: "config-data") pod "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" (UID: "3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.036900 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.036943 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qjlbb\" (UniqueName: \"kubernetes.io/projected/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-kube-api-access-qjlbb\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.036959 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.036975 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.570268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" event={"ID":"3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0","Type":"ContainerDied","Data":"d265ecd38fd45cec456cef90c3363bed17232ad16fc83560bbf60a77d62ab8ef"} Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.570621 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d265ecd38fd45cec456cef90c3363bed17232ad16fc83560bbf60a77d62ab8ef" Nov 21 12:33:37 crc kubenswrapper[4769]: I1121 12:33:37.570367 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.128592 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8"] Nov 21 12:33:38 crc kubenswrapper[4769]: E1121 12:33:38.129066 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" containerName="nova-cell0-conductor-db-sync" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.129080 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" containerName="nova-cell0-conductor-db-sync" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.129276 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" containerName="nova-cell0-conductor-db-sync" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.129917 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.133605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-g64ck" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.135916 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.136607 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.147646 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.162125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txt2c\" (UniqueName: \"kubernetes.io/projected/409a2337-3898-48e1-b78a-1f60112aa414-kube-api-access-txt2c\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.162185 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.162289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-config-data\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.162314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-scripts\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.275702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-config-data\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.276278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-scripts\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.276383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-txt2c\" (UniqueName: \"kubernetes.io/projected/409a2337-3898-48e1-b78a-1f60112aa414-kube-api-access-txt2c\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.276428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.282211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.289362 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.292992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.300832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-scripts\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.301529 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.302359 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-config-data\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.318537 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.319813 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.326488 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.352518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.363080 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.374404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-txt2c\" (UniqueName: \"kubernetes.io/projected/409a2337-3898-48e1-b78a-1f60112aa414-kube-api-access-txt2c\") pod \"nova-cell0-cell-mapping-2m6j8\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.416234 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.429156 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.444053 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.446637 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.452009 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.465550 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.467172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.470032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-config-data\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxph5\" (UniqueName: \"kubernetes.io/projected/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-kube-api-access-gxph5\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479653 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94w9g\" (UniqueName: \"kubernetes.io/projected/4a295ad8-dda2-4001-ae3f-e47f737be733-kube-api-access-94w9g\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-logs\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.479721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.533140 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-94w9g\" (UniqueName: \"kubernetes.io/projected/4a295ad8-dda2-4001-ae3f-e47f737be733-kube-api-access-94w9g\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-logs\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86n4c\" (UniqueName: \"kubernetes.io/projected/ab73fd42-0c27-4900-b67b-d4af3414599a-kube-api-access-86n4c\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585206 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c27r\" (UniqueName: \"kubernetes.io/projected/43c6dfca-273a-47a3-9d4a-a81934fcb359-kube-api-access-8c27r\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-config-data\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab73fd42-0c27-4900-b67b-d4af3414599a-logs\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-config-data\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.585314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.587680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.587744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.587827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-config-data\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.587857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gxph5\" (UniqueName: \"kubernetes.io/projected/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-kube-api-access-gxph5\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.592604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-logs\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.593472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.594212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.601046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-config-data\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.601480 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.607576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxph5\" (UniqueName: \"kubernetes.io/projected/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-kube-api-access-gxph5\") pod \"nova-api-0\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.617455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-94w9g\" (UniqueName: \"kubernetes.io/projected/4a295ad8-dda2-4001-ae3f-e47f737be733-kube-api-access-94w9g\") pod \"nova-cell1-novncproxy-0\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.689982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.690520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.692089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-86n4c\" (UniqueName: \"kubernetes.io/projected/ab73fd42-0c27-4900-b67b-d4af3414599a-kube-api-access-86n4c\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.692133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8c27r\" (UniqueName: \"kubernetes.io/projected/43c6dfca-273a-47a3-9d4a-a81934fcb359-kube-api-access-8c27r\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.692154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-config-data\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.692239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab73fd42-0c27-4900-b67b-d4af3414599a-logs\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.692274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-config-data\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.693390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab73fd42-0c27-4900-b67b-d4af3414599a-logs\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.699643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-config-data\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.700154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.700773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-config-data\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.721424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c27r\" (UniqueName: \"kubernetes.io/projected/43c6dfca-273a-47a3-9d4a-a81934fcb359-kube-api-access-8c27r\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.722665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.725249 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-86n4c\" (UniqueName: \"kubernetes.io/projected/ab73fd42-0c27-4900-b67b-d4af3414599a-kube-api-access-86n4c\") pod \"nova-metadata-0\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.799523 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.900996 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.934385 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:38 crc kubenswrapper[4769]: I1121 12:33:38.942716 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.089923 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.576520 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.587910 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.593049 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.593402 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.599123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.606450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" event={"ID":"409a2337-3898-48e1-b78a-1f60112aa414","Type":"ContainerStarted","Data":"d6a457d464595b97b2846de1cc10537433fb67df2c69a1e090820cdbf0ce6106"} Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.606501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" event={"ID":"409a2337-3898-48e1-b78a-1f60112aa414","Type":"ContainerStarted","Data":"a5177102c530e35e2b6172a1ab47d5fd0eeaf66c5a0ab474c476359a577e045c"} Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.621275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-scripts\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.621410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvlf9\" (UniqueName: \"kubernetes.io/projected/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-kube-api-access-nvlf9\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.621689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-config-data\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.621746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.644401 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" podStartSLOduration=1.644380248 podStartE2EDuration="1.644380248s" podCreationTimestamp="2025-11-21 12:33:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:39.637603496 +0000 UTC m=+2578.338265314" watchObservedRunningTime="2025-11-21 12:33:39.644380248 +0000 UTC m=+2578.345042066" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.675164 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.724087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-config-data\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.724147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.724253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-scripts\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.724298 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlf9\" (UniqueName: \"kubernetes.io/projected/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-kube-api-access-nvlf9\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.747067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-config-data\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.753089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvlf9\" (UniqueName: \"kubernetes.io/projected/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-kube-api-access-nvlf9\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.768343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.768793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-scripts\") pod \"nova-cell1-conductor-db-sync-s9kbf\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.792089 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.802166 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.911308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:39 crc kubenswrapper[4769]: I1121 12:33:39.943847 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.496757 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf"] Nov 21 12:33:40 crc kubenswrapper[4769]: W1121 12:33:40.513085 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda720a5b9_eab6_4caa_a3fd_ab282bd68eb8.slice/crio-9fae8bf51044e0af142ddb2dd7d1193479115718d07b2801c47ad4b738db6ebd WatchSource:0}: Error finding container 9fae8bf51044e0af142ddb2dd7d1193479115718d07b2801c47ad4b738db6ebd: Status 404 returned error can't find the container with id 9fae8bf51044e0af142ddb2dd7d1193479115718d07b2801c47ad4b738db6ebd Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.658141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698","Type":"ContainerStarted","Data":"479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.658229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698","Type":"ContainerStarted","Data":"439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.658240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698","Type":"ContainerStarted","Data":"493418870c1a8b894fb9aa2e416d66d6f76aeff7d9a265028e7099a1902e008b"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.667894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"43c6dfca-273a-47a3-9d4a-a81934fcb359","Type":"ContainerStarted","Data":"a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.667945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"43c6dfca-273a-47a3-9d4a-a81934fcb359","Type":"ContainerStarted","Data":"75cc20f6bbe31d1b22e69b080ac446b6c1808ab5669e6023edaf2bc6d1b71beb"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.678541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4a295ad8-dda2-4001-ae3f-e47f737be733","Type":"ContainerStarted","Data":"cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.678590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4a295ad8-dda2-4001-ae3f-e47f737be733","Type":"ContainerStarted","Data":"8875551a942abaf236614bb692057f2d24cc588aea2d29783b13937f2c63c032"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.687633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" event={"ID":"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8","Type":"ContainerStarted","Data":"9fae8bf51044e0af142ddb2dd7d1193479115718d07b2801c47ad4b738db6ebd"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.697396 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ab73fd42-0c27-4900-b67b-d4af3414599a","Type":"ContainerStarted","Data":"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.697443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ab73fd42-0c27-4900-b67b-d4af3414599a","Type":"ContainerStarted","Data":"0fc828d9f34c21673b07919e762e2e3e7771a658e3854d4e46fda3f35ffb6fd4"} Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.706989 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.706968258 podStartE2EDuration="2.706968258s" podCreationTimestamp="2025-11-21 12:33:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:40.698927262 +0000 UTC m=+2579.399589080" watchObservedRunningTime="2025-11-21 12:33:40.706968258 +0000 UTC m=+2579.407630076" Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.725672 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.72564908 podStartE2EDuration="2.72564908s" podCreationTimestamp="2025-11-21 12:33:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:40.724860429 +0000 UTC m=+2579.425522247" watchObservedRunningTime="2025-11-21 12:33:40.72564908 +0000 UTC m=+2579.426310898" Nov 21 12:33:40 crc kubenswrapper[4769]: I1121 12:33:40.764560 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.764523855 podStartE2EDuration="2.764523855s" podCreationTimestamp="2025-11-21 12:33:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:40.749353147 +0000 UTC m=+2579.450014965" watchObservedRunningTime="2025-11-21 12:33:40.764523855 +0000 UTC m=+2579.465185673" Nov 21 12:33:41 crc kubenswrapper[4769]: I1121 12:33:41.439258 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:41 crc kubenswrapper[4769]: I1121 12:33:41.472465 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:41 crc kubenswrapper[4769]: I1121 12:33:41.711813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" event={"ID":"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8","Type":"ContainerStarted","Data":"96b9af56550c86e7119536df9ae1661ccc78a860f833a10c1a8b5659eabf3eed"} Nov 21 12:33:41 crc kubenswrapper[4769]: I1121 12:33:41.714882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ab73fd42-0c27-4900-b67b-d4af3414599a","Type":"ContainerStarted","Data":"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c"} Nov 21 12:33:41 crc kubenswrapper[4769]: I1121 12:33:41.736139 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" podStartSLOduration=2.73611739 podStartE2EDuration="2.73611739s" podCreationTimestamp="2025-11-21 12:33:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:41.730347915 +0000 UTC m=+2580.431009733" watchObservedRunningTime="2025-11-21 12:33:41.73611739 +0000 UTC m=+2580.436779208" Nov 21 12:33:41 crc kubenswrapper[4769]: I1121 12:33:41.764462 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.764438841 podStartE2EDuration="3.764438841s" podCreationTimestamp="2025-11-21 12:33:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:41.752249223 +0000 UTC m=+2580.452911041" watchObservedRunningTime="2025-11-21 12:33:41.764438841 +0000 UTC m=+2580.465100659" Nov 21 12:33:42 crc kubenswrapper[4769]: I1121 12:33:42.274817 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:33:42 crc kubenswrapper[4769]: E1121 12:33:42.275454 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:33:42 crc kubenswrapper[4769]: I1121 12:33:42.723924 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-log" containerID="cri-o://c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad" gracePeriod=30 Nov 21 12:33:42 crc kubenswrapper[4769]: I1121 12:33:42.724010 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-metadata" containerID="cri-o://4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c" gracePeriod=30 Nov 21 12:33:42 crc kubenswrapper[4769]: I1121 12:33:42.724442 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="4a295ad8-dda2-4001-ae3f-e47f737be733" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3" gracePeriod=30 Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.415015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.513442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-combined-ca-bundle\") pod \"ab73fd42-0c27-4900-b67b-d4af3414599a\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.513989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-config-data\") pod \"ab73fd42-0c27-4900-b67b-d4af3414599a\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.514038 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86n4c\" (UniqueName: \"kubernetes.io/projected/ab73fd42-0c27-4900-b67b-d4af3414599a-kube-api-access-86n4c\") pod \"ab73fd42-0c27-4900-b67b-d4af3414599a\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.514144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab73fd42-0c27-4900-b67b-d4af3414599a-logs\") pod \"ab73fd42-0c27-4900-b67b-d4af3414599a\" (UID: \"ab73fd42-0c27-4900-b67b-d4af3414599a\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.515153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab73fd42-0c27-4900-b67b-d4af3414599a-logs" (OuterVolumeSpecName: "logs") pod "ab73fd42-0c27-4900-b67b-d4af3414599a" (UID: "ab73fd42-0c27-4900-b67b-d4af3414599a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.521298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab73fd42-0c27-4900-b67b-d4af3414599a-kube-api-access-86n4c" (OuterVolumeSpecName: "kube-api-access-86n4c") pod "ab73fd42-0c27-4900-b67b-d4af3414599a" (UID: "ab73fd42-0c27-4900-b67b-d4af3414599a"). InnerVolumeSpecName "kube-api-access-86n4c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.557037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-config-data" (OuterVolumeSpecName: "config-data") pod "ab73fd42-0c27-4900-b67b-d4af3414599a" (UID: "ab73fd42-0c27-4900-b67b-d4af3414599a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.572711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab73fd42-0c27-4900-b67b-d4af3414599a" (UID: "ab73fd42-0c27-4900-b67b-d4af3414599a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.616349 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-86n4c\" (UniqueName: \"kubernetes.io/projected/ab73fd42-0c27-4900-b67b-d4af3414599a-kube-api-access-86n4c\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.616384 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab73fd42-0c27-4900-b67b-d4af3414599a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.616396 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.616404 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab73fd42-0c27-4900-b67b-d4af3414599a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.633696 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.737611 4769 generic.go:334] "Generic (PLEG): container finished" podID="4a295ad8-dda2-4001-ae3f-e47f737be733" containerID="cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3" exitCode=0 Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.737738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4a295ad8-dda2-4001-ae3f-e47f737be733","Type":"ContainerDied","Data":"cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3"} Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.737772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4a295ad8-dda2-4001-ae3f-e47f737be733","Type":"ContainerDied","Data":"8875551a942abaf236614bb692057f2d24cc588aea2d29783b13937f2c63c032"} Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.737793 4769 scope.go:117] "RemoveContainer" containerID="cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.737954 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.741715 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerID="4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c" exitCode=0 Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.741750 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerID="c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad" exitCode=143 Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.741774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ab73fd42-0c27-4900-b67b-d4af3414599a","Type":"ContainerDied","Data":"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c"} Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.741802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ab73fd42-0c27-4900-b67b-d4af3414599a","Type":"ContainerDied","Data":"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad"} Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.741817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ab73fd42-0c27-4900-b67b-d4af3414599a","Type":"ContainerDied","Data":"0fc828d9f34c21673b07919e762e2e3e7771a658e3854d4e46fda3f35ffb6fd4"} Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.741873 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.788756 4769 scope.go:117] "RemoveContainer" containerID="cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3" Nov 21 12:33:43 crc kubenswrapper[4769]: E1121 12:33:43.791580 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3\": container with ID starting with cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3 not found: ID does not exist" containerID="cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.791643 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3"} err="failed to get container status \"cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3\": rpc error: code = NotFound desc = could not find container \"cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3\": container with ID starting with cfb3f872f0e43fe19cbca8a5d8f4a5d0d5d995698f17334b47a58df6dda01ad3 not found: ID does not exist" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.791678 4769 scope.go:117] "RemoveContainer" containerID="4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.800082 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.815710 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.825344 4769 scope.go:117] "RemoveContainer" containerID="c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.827171 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:43 crc kubenswrapper[4769]: E1121 12:33:43.827710 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-metadata" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.827728 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-metadata" Nov 21 12:33:43 crc kubenswrapper[4769]: E1121 12:33:43.827752 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-log" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.827761 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-log" Nov 21 12:33:43 crc kubenswrapper[4769]: E1121 12:33:43.827782 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4a295ad8-dda2-4001-ae3f-e47f737be733" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.827790 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a295ad8-dda2-4001-ae3f-e47f737be733" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.828049 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4a295ad8-dda2-4001-ae3f-e47f737be733" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.828073 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-log" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.828103 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" containerName="nova-metadata-metadata" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.829476 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.830364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94w9g\" (UniqueName: \"kubernetes.io/projected/4a295ad8-dda2-4001-ae3f-e47f737be733-kube-api-access-94w9g\") pod \"4a295ad8-dda2-4001-ae3f-e47f737be733\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.830437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-config-data\") pod \"4a295ad8-dda2-4001-ae3f-e47f737be733\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.830506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-combined-ca-bundle\") pod \"4a295ad8-dda2-4001-ae3f-e47f737be733\" (UID: \"4a295ad8-dda2-4001-ae3f-e47f737be733\") " Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.837342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a295ad8-dda2-4001-ae3f-e47f737be733-kube-api-access-94w9g" (OuterVolumeSpecName: "kube-api-access-94w9g") pod "4a295ad8-dda2-4001-ae3f-e47f737be733" (UID: "4a295ad8-dda2-4001-ae3f-e47f737be733"). InnerVolumeSpecName "kube-api-access-94w9g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.837730 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.843282 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.847754 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.865945 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4a295ad8-dda2-4001-ae3f-e47f737be733" (UID: "4a295ad8-dda2-4001-ae3f-e47f737be733"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.869279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-config-data" (OuterVolumeSpecName: "config-data") pod "4a295ad8-dda2-4001-ae3f-e47f737be733" (UID: "4a295ad8-dda2-4001-ae3f-e47f737be733"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.932716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-config-data\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.932796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.932988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4lwc\" (UniqueName: \"kubernetes.io/projected/f663d285-a2e9-4c21-be55-e5021b51a8a6-kube-api-access-h4lwc\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f663d285-a2e9-4c21-be55-e5021b51a8a6-logs\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933107 4769 scope.go:117] "RemoveContainer" containerID="4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933235 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933249 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a295ad8-dda2-4001-ae3f-e47f737be733-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933262 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-94w9g\" (UniqueName: \"kubernetes.io/projected/4a295ad8-dda2-4001-ae3f-e47f737be733-kube-api-access-94w9g\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:43 crc kubenswrapper[4769]: E1121 12:33:43.933634 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c\": container with ID starting with 4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c not found: ID does not exist" containerID="4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933676 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c"} err="failed to get container status \"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c\": rpc error: code = NotFound desc = could not find container \"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c\": container with ID starting with 4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c not found: ID does not exist" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.933728 4769 scope.go:117] "RemoveContainer" containerID="c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad" Nov 21 12:33:43 crc kubenswrapper[4769]: E1121 12:33:43.934017 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad\": container with ID starting with c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad not found: ID does not exist" containerID="c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.934074 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad"} err="failed to get container status \"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad\": rpc error: code = NotFound desc = could not find container \"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad\": container with ID starting with c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad not found: ID does not exist" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.934091 4769 scope.go:117] "RemoveContainer" containerID="4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.934297 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c"} err="failed to get container status \"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c\": rpc error: code = NotFound desc = could not find container \"4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c\": container with ID starting with 4a694f1d27095e2387f79803262f73e3d7ecd10dd2501621f033e0b4fea8787c not found: ID does not exist" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.934322 4769 scope.go:117] "RemoveContainer" containerID="c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.934635 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad"} err="failed to get container status \"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad\": rpc error: code = NotFound desc = could not find container \"c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad\": container with ID starting with c5fd46ade38de680f7a7d87f5f8b220d61708e036a19f58bb3934e7a4b8ac2ad not found: ID does not exist" Nov 21 12:33:43 crc kubenswrapper[4769]: I1121 12:33:43.935059 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.034116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-config-data\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.034280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.035482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h4lwc\" (UniqueName: \"kubernetes.io/projected/f663d285-a2e9-4c21-be55-e5021b51a8a6-kube-api-access-h4lwc\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.035564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f663d285-a2e9-4c21-be55-e5021b51a8a6-logs\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.035615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.036680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f663d285-a2e9-4c21-be55-e5021b51a8a6-logs\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.039396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-config-data\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.039402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.051941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.056677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4lwc\" (UniqueName: \"kubernetes.io/projected/f663d285-a2e9-4c21-be55-e5021b51a8a6-kube-api-access-h4lwc\") pod \"nova-metadata-0\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.159593 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.168389 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.176558 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.178224 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.181368 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.181959 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.182173 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.220647 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.244658 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.350448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.350596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.350694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.350736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48fj\" (UniqueName: \"kubernetes.io/projected/11f66499-aa3b-4400-a0fa-a059a70e64bf-kube-api-access-s48fj\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.350763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.452799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.452891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s48fj\" (UniqueName: \"kubernetes.io/projected/11f66499-aa3b-4400-a0fa-a059a70e64bf-kube-api-access-s48fj\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.452925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.452962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.453114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.459818 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.459886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.460369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.460575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.474809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48fj\" (UniqueName: \"kubernetes.io/projected/11f66499-aa3b-4400-a0fa-a059a70e64bf-kube-api-access-s48fj\") pod \"nova-cell1-novncproxy-0\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.530689 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.701451 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:44 crc kubenswrapper[4769]: I1121 12:33:44.769753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f663d285-a2e9-4c21-be55-e5021b51a8a6","Type":"ContainerStarted","Data":"df6d7e7c4efa63a18e640b199580410e4f33e4e4083ee9b7a7b19ea81f047ef6"} Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.030534 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.286219 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a295ad8-dda2-4001-ae3f-e47f737be733" path="/var/lib/kubelet/pods/4a295ad8-dda2-4001-ae3f-e47f737be733/volumes" Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.289035 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab73fd42-0c27-4900-b67b-d4af3414599a" path="/var/lib/kubelet/pods/ab73fd42-0c27-4900-b67b-d4af3414599a/volumes" Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.788342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f663d285-a2e9-4c21-be55-e5021b51a8a6","Type":"ContainerStarted","Data":"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50"} Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.790125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f663d285-a2e9-4c21-be55-e5021b51a8a6","Type":"ContainerStarted","Data":"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f"} Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.790239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"11f66499-aa3b-4400-a0fa-a059a70e64bf","Type":"ContainerStarted","Data":"e9e603d6453feda077fbf42ee33ef94fd1e1390ebd478221377ade9874c3af33"} Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.790320 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"11f66499-aa3b-4400-a0fa-a059a70e64bf","Type":"ContainerStarted","Data":"9eef3c79b058a428fec1afde3ec937d9cebf071a51e06b2055595083913f974e"} Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.809570 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.809553035 podStartE2EDuration="2.809553035s" podCreationTimestamp="2025-11-21 12:33:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:45.809208996 +0000 UTC m=+2584.509870824" watchObservedRunningTime="2025-11-21 12:33:45.809553035 +0000 UTC m=+2584.510214853" Nov 21 12:33:45 crc kubenswrapper[4769]: I1121 12:33:45.832007 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.831984838 podStartE2EDuration="1.831984838s" podCreationTimestamp="2025-11-21 12:33:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:45.829763908 +0000 UTC m=+2584.530425736" watchObservedRunningTime="2025-11-21 12:33:45.831984838 +0000 UTC m=+2584.532646656" Nov 21 12:33:48 crc kubenswrapper[4769]: I1121 12:33:48.800105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:48 crc kubenswrapper[4769]: I1121 12:33:48.800652 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:48 crc kubenswrapper[4769]: I1121 12:33:48.832089 4769 generic.go:334] "Generic (PLEG): container finished" podID="409a2337-3898-48e1-b78a-1f60112aa414" containerID="d6a457d464595b97b2846de1cc10537433fb67df2c69a1e090820cdbf0ce6106" exitCode=0 Nov 21 12:33:48 crc kubenswrapper[4769]: I1121 12:33:48.832149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" event={"ID":"409a2337-3898-48e1-b78a-1f60112aa414","Type":"ContainerDied","Data":"d6a457d464595b97b2846de1cc10537433fb67df2c69a1e090820cdbf0ce6106"} Nov 21 12:33:48 crc kubenswrapper[4769]: I1121 12:33:48.935560 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:48 crc kubenswrapper[4769]: I1121 12:33:48.972874 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.245296 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.245346 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.531520 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.842204 4769 generic.go:334] "Generic (PLEG): container finished" podID="a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" containerID="96b9af56550c86e7119536df9ae1661ccc78a860f833a10c1a8b5659eabf3eed" exitCode=0 Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.842324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" event={"ID":"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8","Type":"ContainerDied","Data":"96b9af56550c86e7119536df9ae1661ccc78a860f833a10c1a8b5659eabf3eed"} Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.882661 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.241:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.882976 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.241:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:33:49 crc kubenswrapper[4769]: I1121 12:33:49.892996 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.253491 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.378165 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txt2c\" (UniqueName: \"kubernetes.io/projected/409a2337-3898-48e1-b78a-1f60112aa414-kube-api-access-txt2c\") pod \"409a2337-3898-48e1-b78a-1f60112aa414\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.378256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-config-data\") pod \"409a2337-3898-48e1-b78a-1f60112aa414\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.378299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-scripts\") pod \"409a2337-3898-48e1-b78a-1f60112aa414\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.378341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-combined-ca-bundle\") pod \"409a2337-3898-48e1-b78a-1f60112aa414\" (UID: \"409a2337-3898-48e1-b78a-1f60112aa414\") " Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.385132 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409a2337-3898-48e1-b78a-1f60112aa414-kube-api-access-txt2c" (OuterVolumeSpecName: "kube-api-access-txt2c") pod "409a2337-3898-48e1-b78a-1f60112aa414" (UID: "409a2337-3898-48e1-b78a-1f60112aa414"). InnerVolumeSpecName "kube-api-access-txt2c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.388427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-scripts" (OuterVolumeSpecName: "scripts") pod "409a2337-3898-48e1-b78a-1f60112aa414" (UID: "409a2337-3898-48e1-b78a-1f60112aa414"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.409355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "409a2337-3898-48e1-b78a-1f60112aa414" (UID: "409a2337-3898-48e1-b78a-1f60112aa414"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.425354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-config-data" (OuterVolumeSpecName: "config-data") pod "409a2337-3898-48e1-b78a-1f60112aa414" (UID: "409a2337-3898-48e1-b78a-1f60112aa414"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.480310 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.480349 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.480362 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-txt2c\" (UniqueName: \"kubernetes.io/projected/409a2337-3898-48e1-b78a-1f60112aa414-kube-api-access-txt2c\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.480374 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409a2337-3898-48e1-b78a-1f60112aa414-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.861305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" event={"ID":"409a2337-3898-48e1-b78a-1f60112aa414","Type":"ContainerDied","Data":"a5177102c530e35e2b6172a1ab47d5fd0eeaf66c5a0ab474c476359a577e045c"} Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.861375 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5177102c530e35e2b6172a1ab47d5fd0eeaf66c5a0ab474c476359a577e045c" Nov 21 12:33:50 crc kubenswrapper[4769]: I1121 12:33:50.861463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.062362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.062670 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-log" containerID="cri-o://439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f" gracePeriod=30 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.062753 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-api" containerID="cri-o://479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9" gracePeriod=30 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.078384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.086544 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.087119 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-log" containerID="cri-o://695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f" gracePeriod=30 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.087318 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-metadata" containerID="cri-o://9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50" gracePeriod=30 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.398803 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.518053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvlf9\" (UniqueName: \"kubernetes.io/projected/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-kube-api-access-nvlf9\") pod \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.518259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-scripts\") pod \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.518314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-config-data\") pod \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.518366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-combined-ca-bundle\") pod \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\" (UID: \"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.523489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-kube-api-access-nvlf9" (OuterVolumeSpecName: "kube-api-access-nvlf9") pod "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" (UID: "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8"). InnerVolumeSpecName "kube-api-access-nvlf9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.531420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-scripts" (OuterVolumeSpecName: "scripts") pod "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" (UID: "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.544681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-config-data" (OuterVolumeSpecName: "config-data") pod "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" (UID: "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.566058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" (UID: "a720a5b9-eab6-4caa-a3fd-ab282bd68eb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.621082 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.621115 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.621125 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.621134 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nvlf9\" (UniqueName: \"kubernetes.io/projected/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8-kube-api-access-nvlf9\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.686614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.823896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-combined-ca-bundle\") pod \"f663d285-a2e9-4c21-be55-e5021b51a8a6\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.823975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f663d285-a2e9-4c21-be55-e5021b51a8a6-logs\") pod \"f663d285-a2e9-4c21-be55-e5021b51a8a6\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.824057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4lwc\" (UniqueName: \"kubernetes.io/projected/f663d285-a2e9-4c21-be55-e5021b51a8a6-kube-api-access-h4lwc\") pod \"f663d285-a2e9-4c21-be55-e5021b51a8a6\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.824083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-config-data\") pod \"f663d285-a2e9-4c21-be55-e5021b51a8a6\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.824276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-nova-metadata-tls-certs\") pod \"f663d285-a2e9-4c21-be55-e5021b51a8a6\" (UID: \"f663d285-a2e9-4c21-be55-e5021b51a8a6\") " Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.824745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f663d285-a2e9-4c21-be55-e5021b51a8a6-logs" (OuterVolumeSpecName: "logs") pod "f663d285-a2e9-4c21-be55-e5021b51a8a6" (UID: "f663d285-a2e9-4c21-be55-e5021b51a8a6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.830012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f663d285-a2e9-4c21-be55-e5021b51a8a6-kube-api-access-h4lwc" (OuterVolumeSpecName: "kube-api-access-h4lwc") pod "f663d285-a2e9-4c21-be55-e5021b51a8a6" (UID: "f663d285-a2e9-4c21-be55-e5021b51a8a6"). InnerVolumeSpecName "kube-api-access-h4lwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.856083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f663d285-a2e9-4c21-be55-e5021b51a8a6" (UID: "f663d285-a2e9-4c21-be55-e5021b51a8a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.864754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-config-data" (OuterVolumeSpecName: "config-data") pod "f663d285-a2e9-4c21-be55-e5021b51a8a6" (UID: "f663d285-a2e9-4c21-be55-e5021b51a8a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.874425 4769 generic.go:334] "Generic (PLEG): container finished" podID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerID="439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f" exitCode=143 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.874491 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698","Type":"ContainerDied","Data":"439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f"} Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.877558 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.877690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf" event={"ID":"a720a5b9-eab6-4caa-a3fd-ab282bd68eb8","Type":"ContainerDied","Data":"9fae8bf51044e0af142ddb2dd7d1193479115718d07b2801c47ad4b738db6ebd"} Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.877743 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fae8bf51044e0af142ddb2dd7d1193479115718d07b2801c47ad4b738db6ebd" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.890721 4769 generic.go:334] "Generic (PLEG): container finished" podID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerID="9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50" exitCode=0 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.890758 4769 generic.go:334] "Generic (PLEG): container finished" podID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerID="695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f" exitCode=143 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.890936 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="43c6dfca-273a-47a3-9d4a-a81934fcb359" containerName="nova-scheduler-scheduler" containerID="cri-o://a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d" gracePeriod=30 Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.891287 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.891704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f663d285-a2e9-4c21-be55-e5021b51a8a6","Type":"ContainerDied","Data":"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50"} Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.891740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f663d285-a2e9-4c21-be55-e5021b51a8a6","Type":"ContainerDied","Data":"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f"} Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.891750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f663d285-a2e9-4c21-be55-e5021b51a8a6","Type":"ContainerDied","Data":"df6d7e7c4efa63a18e640b199580410e4f33e4e4083ee9b7a7b19ea81f047ef6"} Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.891764 4769 scope.go:117] "RemoveContainer" containerID="9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.926056 4769 scope.go:117] "RemoveContainer" containerID="695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.927844 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h4lwc\" (UniqueName: \"kubernetes.io/projected/f663d285-a2e9-4c21-be55-e5021b51a8a6-kube-api-access-h4lwc\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.927909 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.927925 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.927971 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f663d285-a2e9-4c21-be55-e5021b51a8a6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.934167 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f663d285-a2e9-4c21-be55-e5021b51a8a6" (UID: "f663d285-a2e9-4c21-be55-e5021b51a8a6"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950081 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:33:51 crc kubenswrapper[4769]: E1121 12:33:51.950518 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-log" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950537 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-log" Nov 21 12:33:51 crc kubenswrapper[4769]: E1121 12:33:51.950566 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-metadata" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950572 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-metadata" Nov 21 12:33:51 crc kubenswrapper[4769]: E1121 12:33:51.950583 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" containerName="nova-cell1-conductor-db-sync" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950589 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" containerName="nova-cell1-conductor-db-sync" Nov 21 12:33:51 crc kubenswrapper[4769]: E1121 12:33:51.950608 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="409a2337-3898-48e1-b78a-1f60112aa414" containerName="nova-manage" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950614 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="409a2337-3898-48e1-b78a-1f60112aa414" containerName="nova-manage" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-log" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950804 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" containerName="nova-metadata-metadata" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950827 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" containerName="nova-cell1-conductor-db-sync" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.950841 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="409a2337-3898-48e1-b78a-1f60112aa414" containerName="nova-manage" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.951595 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:51 crc kubenswrapper[4769]: I1121 12:33:51.959574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.000735 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.005162 4769 scope.go:117] "RemoveContainer" containerID="9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50" Nov 21 12:33:52 crc kubenswrapper[4769]: E1121 12:33:52.006140 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50\": container with ID starting with 9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50 not found: ID does not exist" containerID="9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.006176 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50"} err="failed to get container status \"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50\": rpc error: code = NotFound desc = could not find container \"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50\": container with ID starting with 9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50 not found: ID does not exist" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.006237 4769 scope.go:117] "RemoveContainer" containerID="695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f" Nov 21 12:33:52 crc kubenswrapper[4769]: E1121 12:33:52.006471 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f\": container with ID starting with 695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f not found: ID does not exist" containerID="695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.006504 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f"} err="failed to get container status \"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f\": rpc error: code = NotFound desc = could not find container \"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f\": container with ID starting with 695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f not found: ID does not exist" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.006522 4769 scope.go:117] "RemoveContainer" containerID="9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.006828 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50"} err="failed to get container status \"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50\": rpc error: code = NotFound desc = could not find container \"9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50\": container with ID starting with 9c5bcb90f79ec8f9c263ce637f3acef7474363a92b2145cecdd8f582fbc35e50 not found: ID does not exist" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.006849 4769 scope.go:117] "RemoveContainer" containerID="695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.007264 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f"} err="failed to get container status \"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f\": rpc error: code = NotFound desc = could not find container \"695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f\": container with ID starting with 695f08a01f21630578e2fb5e19ba7ad03759d5c83498aa55e5c96aa4f9d2bf7f not found: ID does not exist" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.029522 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f663d285-a2e9-4c21-be55-e5021b51a8a6-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.131623 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.131774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.131803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vfh2\" (UniqueName: \"kubernetes.io/projected/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-kube-api-access-7vfh2\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.233534 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.233941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.233975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7vfh2\" (UniqueName: \"kubernetes.io/projected/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-kube-api-access-7vfh2\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.237598 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.238265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.253694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vfh2\" (UniqueName: \"kubernetes.io/projected/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-kube-api-access-7vfh2\") pod \"nova-cell1-conductor-0\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.313046 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.361175 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.374530 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.386584 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.389129 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.391695 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.392255 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.424116 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.551553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.551674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-config-data\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.551727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtfnj\" (UniqueName: \"kubernetes.io/projected/1358e40a-9e89-4204-bfc7-7037274eadf9-kube-api-access-gtfnj\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.551778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1358e40a-9e89-4204-bfc7-7037274eadf9-logs\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.551836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.653857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.654041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-config-data\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.654100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gtfnj\" (UniqueName: \"kubernetes.io/projected/1358e40a-9e89-4204-bfc7-7037274eadf9-kube-api-access-gtfnj\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.654150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1358e40a-9e89-4204-bfc7-7037274eadf9-logs\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.654234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.654698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1358e40a-9e89-4204-bfc7-7037274eadf9-logs\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.661031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.661051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-config-data\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.661201 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.672181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtfnj\" (UniqueName: \"kubernetes.io/projected/1358e40a-9e89-4204-bfc7-7037274eadf9-kube-api-access-gtfnj\") pod \"nova-metadata-0\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.769827 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.853001 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:33:52 crc kubenswrapper[4769]: I1121 12:33:52.914217 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1","Type":"ContainerStarted","Data":"e9107a3c73fcf62d3ad557020e6e5402303903d7c5dca5deb5b182735f403a8c"} Nov 21 12:33:53 crc kubenswrapper[4769]: W1121 12:33:53.290581 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1358e40a_9e89_4204_bfc7_7037274eadf9.slice/crio-1335e5b410b567386d3e87c2b596abb2c73cc45db6cb9df11134c18d1e972864 WatchSource:0}: Error finding container 1335e5b410b567386d3e87c2b596abb2c73cc45db6cb9df11134c18d1e972864: Status 404 returned error can't find the container with id 1335e5b410b567386d3e87c2b596abb2c73cc45db6cb9df11134c18d1e972864 Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.291651 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f663d285-a2e9-4c21-be55-e5021b51a8a6" path="/var/lib/kubelet/pods/f663d285-a2e9-4c21-be55-e5021b51a8a6/volumes" Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.292728 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.698893 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.926416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1","Type":"ContainerStarted","Data":"efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3"} Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.927845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.931120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1358e40a-9e89-4204-bfc7-7037274eadf9","Type":"ContainerStarted","Data":"29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313"} Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.931155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1358e40a-9e89-4204-bfc7-7037274eadf9","Type":"ContainerStarted","Data":"55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d"} Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.931166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1358e40a-9e89-4204-bfc7-7037274eadf9","Type":"ContainerStarted","Data":"1335e5b410b567386d3e87c2b596abb2c73cc45db6cb9df11134c18d1e972864"} Nov 21 12:33:53 crc kubenswrapper[4769]: E1121 12:33:53.937245 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:33:53 crc kubenswrapper[4769]: E1121 12:33:53.938904 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:33:53 crc kubenswrapper[4769]: E1121 12:33:53.940692 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:33:53 crc kubenswrapper[4769]: E1121 12:33:53.940734 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="43c6dfca-273a-47a3-9d4a-a81934fcb359" containerName="nova-scheduler-scheduler" Nov 21 12:33:53 crc kubenswrapper[4769]: I1121 12:33:53.950890 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.950867328 podStartE2EDuration="2.950867328s" podCreationTimestamp="2025-11-21 12:33:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:53.944858716 +0000 UTC m=+2592.645520564" watchObservedRunningTime="2025-11-21 12:33:53.950867328 +0000 UTC m=+2592.651529146" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.531492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.566585 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.880042 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.941507 4769 generic.go:334] "Generic (PLEG): container finished" podID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerID="479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9" exitCode=0 Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.941558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698","Type":"ContainerDied","Data":"479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9"} Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.941602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698","Type":"ContainerDied","Data":"493418870c1a8b894fb9aa2e416d66d6f76aeff7d9a265028e7099a1902e008b"} Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.941603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.941619 4769 scope.go:117] "RemoveContainer" containerID="479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.967561 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.969481 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.969457406 podStartE2EDuration="2.969457406s" podCreationTimestamp="2025-11-21 12:33:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:54.958640875 +0000 UTC m=+2593.659302713" watchObservedRunningTime="2025-11-21 12:33:54.969457406 +0000 UTC m=+2593.670119224" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.978864 4769 scope.go:117] "RemoveContainer" containerID="439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f" Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.997166 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxph5\" (UniqueName: \"kubernetes.io/projected/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-kube-api-access-gxph5\") pod \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.997261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-config-data\") pod \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.997315 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-combined-ca-bundle\") pod \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.997419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-logs\") pod \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\" (UID: \"6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698\") " Nov 21 12:33:54 crc kubenswrapper[4769]: I1121 12:33:54.998269 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-logs" (OuterVolumeSpecName: "logs") pod "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" (UID: "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.012889 4769 scope.go:117] "RemoveContainer" containerID="479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9" Nov 21 12:33:55 crc kubenswrapper[4769]: E1121 12:33:55.013498 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9\": container with ID starting with 479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9 not found: ID does not exist" containerID="479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.013547 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9"} err="failed to get container status \"479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9\": rpc error: code = NotFound desc = could not find container \"479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9\": container with ID starting with 479f60e6fb759e209150d0f07b86bd17c983527c9ea69d27facb24a1dd4ff9a9 not found: ID does not exist" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.013578 4769 scope.go:117] "RemoveContainer" containerID="439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f" Nov 21 12:33:55 crc kubenswrapper[4769]: E1121 12:33:55.014405 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f\": container with ID starting with 439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f not found: ID does not exist" containerID="439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.014457 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f"} err="failed to get container status \"439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f\": rpc error: code = NotFound desc = could not find container \"439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f\": container with ID starting with 439c108c4cfb5fa9f5a44855a8451f7740619bd17fc179521ec4be6f8871763f not found: ID does not exist" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.022217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-kube-api-access-gxph5" (OuterVolumeSpecName: "kube-api-access-gxph5") pod "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" (UID: "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698"). InnerVolumeSpecName "kube-api-access-gxph5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.061393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-config-data" (OuterVolumeSpecName: "config-data") pod "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" (UID: "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.076883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" (UID: "6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.100649 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gxph5\" (UniqueName: \"kubernetes.io/projected/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-kube-api-access-gxph5\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.100682 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.100695 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.100706 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.277172 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:33:55 crc kubenswrapper[4769]: E1121 12:33:55.277451 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.316701 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.316749 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.354317 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:55 crc kubenswrapper[4769]: E1121 12:33:55.355247 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-log" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.355309 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-log" Nov 21 12:33:55 crc kubenswrapper[4769]: E1121 12:33:55.355348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-api" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.355356 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-api" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.356577 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-log" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.356630 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" containerName="nova-api-api" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.358938 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.364616 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.369211 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.507555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-config-data\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.507616 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.507643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/49987d4a-8aab-4442-b70d-381fe0765fa3-logs\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.507769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvc9n\" (UniqueName: \"kubernetes.io/projected/49987d4a-8aab-4442-b70d-381fe0765fa3-kube-api-access-cvc9n\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.608904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-config-data\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.609210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.609235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/49987d4a-8aab-4442-b70d-381fe0765fa3-logs\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.609291 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cvc9n\" (UniqueName: \"kubernetes.io/projected/49987d4a-8aab-4442-b70d-381fe0765fa3-kube-api-access-cvc9n\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.609744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/49987d4a-8aab-4442-b70d-381fe0765fa3-logs\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.612513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-config-data\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.620738 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.626330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvc9n\" (UniqueName: \"kubernetes.io/projected/49987d4a-8aab-4442-b70d-381fe0765fa3-kube-api-access-cvc9n\") pod \"nova-api-0\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:55 crc kubenswrapper[4769]: I1121 12:33:55.687174 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.202316 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.975675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"49987d4a-8aab-4442-b70d-381fe0765fa3","Type":"ContainerStarted","Data":"ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881"} Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.975989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"49987d4a-8aab-4442-b70d-381fe0765fa3","Type":"ContainerStarted","Data":"1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e"} Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.976001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"49987d4a-8aab-4442-b70d-381fe0765fa3","Type":"ContainerStarted","Data":"13b15fbd72cf6abd9a46af8f648614ad634ef792b141eb1d9d842e5074862fc8"} Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.978051 4769 generic.go:334] "Generic (PLEG): container finished" podID="43c6dfca-273a-47a3-9d4a-a81934fcb359" containerID="a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d" exitCode=0 Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.978083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"43c6dfca-273a-47a3-9d4a-a81934fcb359","Type":"ContainerDied","Data":"a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d"} Nov 21 12:33:56 crc kubenswrapper[4769]: I1121 12:33:56.998641 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.998621916 podStartE2EDuration="1.998621916s" podCreationTimestamp="2025-11-21 12:33:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:33:56.994809754 +0000 UTC m=+2595.695471592" watchObservedRunningTime="2025-11-21 12:33:56.998621916 +0000 UTC m=+2595.699283734" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.286363 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698" path="/var/lib/kubelet/pods/6e0c0dbf-0bc1-46f5-9b08-d5f0f8a3c698/volumes" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.335571 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.444623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.444947 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="a0bcf88b-4434-4ff8-86ff-2e343b9394fb" containerName="kube-state-metrics" containerID="cri-o://d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9" gracePeriod=30 Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.446171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-combined-ca-bundle\") pod \"43c6dfca-273a-47a3-9d4a-a81934fcb359\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.446363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c27r\" (UniqueName: \"kubernetes.io/projected/43c6dfca-273a-47a3-9d4a-a81934fcb359-kube-api-access-8c27r\") pod \"43c6dfca-273a-47a3-9d4a-a81934fcb359\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.446422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-config-data\") pod \"43c6dfca-273a-47a3-9d4a-a81934fcb359\" (UID: \"43c6dfca-273a-47a3-9d4a-a81934fcb359\") " Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.458066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c6dfca-273a-47a3-9d4a-a81934fcb359-kube-api-access-8c27r" (OuterVolumeSpecName: "kube-api-access-8c27r") pod "43c6dfca-273a-47a3-9d4a-a81934fcb359" (UID: "43c6dfca-273a-47a3-9d4a-a81934fcb359"). InnerVolumeSpecName "kube-api-access-8c27r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.480823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-config-data" (OuterVolumeSpecName: "config-data") pod "43c6dfca-273a-47a3-9d4a-a81934fcb359" (UID: "43c6dfca-273a-47a3-9d4a-a81934fcb359"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.481614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "43c6dfca-273a-47a3-9d4a-a81934fcb359" (UID: "43c6dfca-273a-47a3-9d4a-a81934fcb359"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.549472 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.549531 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8c27r\" (UniqueName: \"kubernetes.io/projected/43c6dfca-273a-47a3-9d4a-a81934fcb359-kube-api-access-8c27r\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.549547 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43c6dfca-273a-47a3-9d4a-a81934fcb359-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.770483 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.770925 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.913078 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.987940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"43c6dfca-273a-47a3-9d4a-a81934fcb359","Type":"ContainerDied","Data":"75cc20f6bbe31d1b22e69b080ac446b6c1808ab5669e6023edaf2bc6d1b71beb"} Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.987996 4769 scope.go:117] "RemoveContainer" containerID="a4d7f5489326fcca13ba0b4596c9ab3e9a34862c392be105dc6bc766d6714e4d" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.988162 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.992146 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0bcf88b-4434-4ff8-86ff-2e343b9394fb" containerID="d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9" exitCode=2 Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.992570 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.992765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a0bcf88b-4434-4ff8-86ff-2e343b9394fb","Type":"ContainerDied","Data":"d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9"} Nov 21 12:33:57 crc kubenswrapper[4769]: I1121 12:33:57.992813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a0bcf88b-4434-4ff8-86ff-2e343b9394fb","Type":"ContainerDied","Data":"cc75cebfedb09f5a4834bd50f5eebe4e57ac44ae6066cbf5cd0d190e4b0a94fe"} Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.027683 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.046539 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.065046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9s4x\" (UniqueName: \"kubernetes.io/projected/a0bcf88b-4434-4ff8-86ff-2e343b9394fb-kube-api-access-f9s4x\") pod \"a0bcf88b-4434-4ff8-86ff-2e343b9394fb\" (UID: \"a0bcf88b-4434-4ff8-86ff-2e343b9394fb\") " Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.065560 4769 scope.go:117] "RemoveContainer" containerID="d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.069541 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.070296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bcf88b-4434-4ff8-86ff-2e343b9394fb-kube-api-access-f9s4x" (OuterVolumeSpecName: "kube-api-access-f9s4x") pod "a0bcf88b-4434-4ff8-86ff-2e343b9394fb" (UID: "a0bcf88b-4434-4ff8-86ff-2e343b9394fb"). InnerVolumeSpecName "kube-api-access-f9s4x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:33:58 crc kubenswrapper[4769]: E1121 12:33:58.070540 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0bcf88b-4434-4ff8-86ff-2e343b9394fb" containerName="kube-state-metrics" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.070563 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bcf88b-4434-4ff8-86ff-2e343b9394fb" containerName="kube-state-metrics" Nov 21 12:33:58 crc kubenswrapper[4769]: E1121 12:33:58.070583 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="43c6dfca-273a-47a3-9d4a-a81934fcb359" containerName="nova-scheduler-scheduler" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.070594 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c6dfca-273a-47a3-9d4a-a81934fcb359" containerName="nova-scheduler-scheduler" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.071080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0bcf88b-4434-4ff8-86ff-2e343b9394fb" containerName="kube-state-metrics" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.071130 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="43c6dfca-273a-47a3-9d4a-a81934fcb359" containerName="nova-scheduler-scheduler" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.072359 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.075056 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.093397 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.097749 4769 scope.go:117] "RemoveContainer" containerID="d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9" Nov 21 12:33:58 crc kubenswrapper[4769]: E1121 12:33:58.098272 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9\": container with ID starting with d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9 not found: ID does not exist" containerID="d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.098312 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9"} err="failed to get container status \"d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9\": rpc error: code = NotFound desc = could not find container \"d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9\": container with ID starting with d418168cc69e223da19f89f677211a7710e461dada254790ce034b7e9e0bbff9 not found: ID does not exist" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.166957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.167008 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-config-data\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.167094 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8p8t\" (UniqueName: \"kubernetes.io/projected/f7928538-ecae-47cd-99cc-090188eaaa87-kube-api-access-x8p8t\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.167434 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f9s4x\" (UniqueName: \"kubernetes.io/projected/a0bcf88b-4434-4ff8-86ff-2e343b9394fb-kube-api-access-f9s4x\") on node \"crc\" DevicePath \"\"" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.268857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.268906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-config-data\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.268984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x8p8t\" (UniqueName: \"kubernetes.io/projected/f7928538-ecae-47cd-99cc-090188eaaa87-kube-api-access-x8p8t\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.272881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.274202 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-config-data\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.287071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8p8t\" (UniqueName: \"kubernetes.io/projected/f7928538-ecae-47cd-99cc-090188eaaa87-kube-api-access-x8p8t\") pod \"nova-scheduler-0\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.366956 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.377322 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.391011 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.392621 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.395239 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.395523 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.402210 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.413347 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.473206 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.473283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm55r\" (UniqueName: \"kubernetes.io/projected/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-api-access-wm55r\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.473350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.473390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.575928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.575983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wm55r\" (UniqueName: \"kubernetes.io/projected/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-api-access-wm55r\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.576024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.576054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.581987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.582107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.583082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.615401 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm55r\" (UniqueName: \"kubernetes.io/projected/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-api-access-wm55r\") pod \"kube-state-metrics-0\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.721538 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:33:58 crc kubenswrapper[4769]: I1121 12:33:58.891659 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:33:58 crc kubenswrapper[4769]: W1121 12:33:58.893490 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7928538_ecae_47cd_99cc_090188eaaa87.slice/crio-c5887197abb7b039023105c41fb214612455a20702e6f21d730cf066aa7646a8 WatchSource:0}: Error finding container c5887197abb7b039023105c41fb214612455a20702e6f21d730cf066aa7646a8: Status 404 returned error can't find the container with id c5887197abb7b039023105c41fb214612455a20702e6f21d730cf066aa7646a8 Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.012002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f7928538-ecae-47cd-99cc-090188eaaa87","Type":"ContainerStarted","Data":"c5887197abb7b039023105c41fb214612455a20702e6f21d730cf066aa7646a8"} Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.193052 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:33:59 crc kubenswrapper[4769]: W1121 12:33:59.194121 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dc4e7b0_25bf_4452_9e52_b03e773e485a.slice/crio-8b6088434753b67c2d993d40e0cf294f5205d3ee40d5d5c2db3a66d1491df80e WatchSource:0}: Error finding container 8b6088434753b67c2d993d40e0cf294f5205d3ee40d5d5c2db3a66d1491df80e: Status 404 returned error can't find the container with id 8b6088434753b67c2d993d40e0cf294f5205d3ee40d5d5c2db3a66d1491df80e Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.290930 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c6dfca-273a-47a3-9d4a-a81934fcb359" path="/var/lib/kubelet/pods/43c6dfca-273a-47a3-9d4a-a81934fcb359/volumes" Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.292082 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bcf88b-4434-4ff8-86ff-2e343b9394fb" path="/var/lib/kubelet/pods/a0bcf88b-4434-4ff8-86ff-2e343b9394fb/volumes" Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.361788 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.362151 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-central-agent" containerID="cri-o://8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0" gracePeriod=30 Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.362257 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="sg-core" containerID="cri-o://9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a" gracePeriod=30 Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.362263 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-notification-agent" containerID="cri-o://1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc" gracePeriod=30 Nov 21 12:33:59 crc kubenswrapper[4769]: I1121 12:33:59.362508 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="proxy-httpd" containerID="cri-o://221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142" gracePeriod=30 Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.033419 4769 generic.go:334] "Generic (PLEG): container finished" podID="d72488d1-2497-44b2-8206-32cf85562168" containerID="221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142" exitCode=0 Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.033752 4769 generic.go:334] "Generic (PLEG): container finished" podID="d72488d1-2497-44b2-8206-32cf85562168" containerID="9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a" exitCode=2 Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.033761 4769 generic.go:334] "Generic (PLEG): container finished" podID="d72488d1-2497-44b2-8206-32cf85562168" containerID="8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0" exitCode=0 Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.033560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerDied","Data":"221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142"} Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.033852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerDied","Data":"9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a"} Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.033877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerDied","Data":"8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0"} Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.036435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f7928538-ecae-47cd-99cc-090188eaaa87","Type":"ContainerStarted","Data":"8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913"} Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.038134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6dc4e7b0-25bf-4452-9e52-b03e773e485a","Type":"ContainerStarted","Data":"488b43b9d46ff3515b43b1f98135f48ab4e191939f47e94d7a737aa8bb72ff66"} Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.038169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6dc4e7b0-25bf-4452-9e52-b03e773e485a","Type":"ContainerStarted","Data":"8b6088434753b67c2d993d40e0cf294f5205d3ee40d5d5c2db3a66d1491df80e"} Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.064811 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.064788978 podStartE2EDuration="2.064788978s" podCreationTimestamp="2025-11-21 12:33:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:34:00.054341817 +0000 UTC m=+2598.755003645" watchObservedRunningTime="2025-11-21 12:34:00.064788978 +0000 UTC m=+2598.765450796" Nov 21 12:34:00 crc kubenswrapper[4769]: I1121 12:34:00.079824 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.561355432 podStartE2EDuration="2.079799951s" podCreationTimestamp="2025-11-21 12:33:58 +0000 UTC" firstStartedPulling="2025-11-21 12:33:59.196837158 +0000 UTC m=+2597.897498976" lastFinishedPulling="2025-11-21 12:33:59.715281677 +0000 UTC m=+2598.415943495" observedRunningTime="2025-11-21 12:34:00.068786295 +0000 UTC m=+2598.769448113" watchObservedRunningTime="2025-11-21 12:34:00.079799951 +0000 UTC m=+2598.780461779" Nov 21 12:34:01 crc kubenswrapper[4769]: I1121 12:34:01.046689 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.346155 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.770475 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.770503 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.823429 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-597gk"] Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.825053 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.827518 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.827756 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.838276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-597gk"] Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.979059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-scripts\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.979474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-config-data\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.979497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:02 crc kubenswrapper[4769]: I1121 12:34:02.979573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkrd\" (UniqueName: \"kubernetes.io/projected/5b907e1e-12df-47ff-8f31-f90226941ce9-kube-api-access-rmkrd\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.081615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-config-data\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.081668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.081762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkrd\" (UniqueName: \"kubernetes.io/projected/5b907e1e-12df-47ff-8f31-f90226941ce9-kube-api-access-rmkrd\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.081793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-scripts\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.088455 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.089565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-scripts\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.099646 4769 generic.go:334] "Generic (PLEG): container finished" podID="d72488d1-2497-44b2-8206-32cf85562168" containerID="1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc" exitCode=0 Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.099699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerDied","Data":"1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc"} Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.099724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d72488d1-2497-44b2-8206-32cf85562168","Type":"ContainerDied","Data":"6db8948edda7b4f094f21a27103e9bb18bf7d6e077c8620f8a3d6776c58b48aa"} Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.099739 4769 scope.go:117] "RemoveContainer" containerID="221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.105830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.108413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkrd\" (UniqueName: \"kubernetes.io/projected/5b907e1e-12df-47ff-8f31-f90226941ce9-kube-api-access-rmkrd\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.109757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-config-data\") pod \"nova-cell1-cell-mapping-597gk\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.150797 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.183095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-config-data\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.183151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-log-httpd\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.183307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-combined-ca-bundle\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.183377 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-run-httpd\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.187606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.187809 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.187856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-scripts\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.187908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srqqp\" (UniqueName: \"kubernetes.io/projected/d72488d1-2497-44b2-8206-32cf85562168-kube-api-access-srqqp\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.187982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-sg-core-conf-yaml\") pod \"d72488d1-2497-44b2-8206-32cf85562168\" (UID: \"d72488d1-2497-44b2-8206-32cf85562168\") " Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.189433 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.189465 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d72488d1-2497-44b2-8206-32cf85562168-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.194676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-scripts" (OuterVolumeSpecName: "scripts") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.205793 4769 scope.go:117] "RemoveContainer" containerID="9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.205824 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d72488d1-2497-44b2-8206-32cf85562168-kube-api-access-srqqp" (OuterVolumeSpecName: "kube-api-access-srqqp") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "kube-api-access-srqqp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.247059 4769 scope.go:117] "RemoveContainer" containerID="1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.252949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.286401 4769 scope.go:117] "RemoveContainer" containerID="8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.300852 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.300883 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srqqp\" (UniqueName: \"kubernetes.io/projected/d72488d1-2497-44b2-8206-32cf85562168-kube-api-access-srqqp\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.300896 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.327205 4769 scope.go:117] "RemoveContainer" containerID="221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142" Nov 21 12:34:03 crc kubenswrapper[4769]: E1121 12:34:03.328695 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142\": container with ID starting with 221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142 not found: ID does not exist" containerID="221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.328732 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142"} err="failed to get container status \"221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142\": rpc error: code = NotFound desc = could not find container \"221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142\": container with ID starting with 221c052d25d4754f6583f4a9cda8fc14a1f42163e0a5b6c00ec95999cf6cc142 not found: ID does not exist" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.328760 4769 scope.go:117] "RemoveContainer" containerID="9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a" Nov 21 12:34:03 crc kubenswrapper[4769]: E1121 12:34:03.332362 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a\": container with ID starting with 9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a not found: ID does not exist" containerID="9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.332423 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a"} err="failed to get container status \"9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a\": rpc error: code = NotFound desc = could not find container \"9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a\": container with ID starting with 9ea30af13039d72278642c2af7ddc23be31dedd7be611c899518da621173c12a not found: ID does not exist" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.332462 4769 scope.go:117] "RemoveContainer" containerID="1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc" Nov 21 12:34:03 crc kubenswrapper[4769]: E1121 12:34:03.332756 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc\": container with ID starting with 1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc not found: ID does not exist" containerID="1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.332784 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc"} err="failed to get container status \"1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc\": rpc error: code = NotFound desc = could not find container \"1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc\": container with ID starting with 1465645efca317f8203ed70e01543203f7b553223fff1f626b6179315b98adfc not found: ID does not exist" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.332801 4769 scope.go:117] "RemoveContainer" containerID="8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0" Nov 21 12:34:03 crc kubenswrapper[4769]: E1121 12:34:03.333009 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0\": container with ID starting with 8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0 not found: ID does not exist" containerID="8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.333038 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0"} err="failed to get container status \"8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0\": rpc error: code = NotFound desc = could not find container \"8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0\": container with ID starting with 8362ef03567d1c478bbfb2757eac86cb37f96a98a1f6048e9e1429802808bda0 not found: ID does not exist" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.335306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.344321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-config-data" (OuterVolumeSpecName: "config-data") pod "d72488d1-2497-44b2-8206-32cf85562168" (UID: "d72488d1-2497-44b2-8206-32cf85562168"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.403271 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.403309 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d72488d1-2497-44b2-8206-32cf85562168-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.403902 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.705392 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-597gk"] Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.790460 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.249:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.790776 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.249:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.820638 4769 scope.go:117] "RemoveContainer" containerID="42260c171b88c7201b3f08d2d92a0fc3baa74960ca7cd600a2537e91c72ca9a0" Nov 21 12:34:03 crc kubenswrapper[4769]: I1121 12:34:03.867098 4769 scope.go:117] "RemoveContainer" containerID="49672e9fb4e2c664206ac2b31720b995335e6b9dd9fa99582f659a3e4942e2c9" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.116352 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.126294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" event={"ID":"5b907e1e-12df-47ff-8f31-f90226941ce9","Type":"ContainerStarted","Data":"d01cc36f3c2c2d74fd2ff72845df2f626a95d928f5fba546a1cf55bf6f5e34d0"} Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.126349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" event={"ID":"5b907e1e-12df-47ff-8f31-f90226941ce9","Type":"ContainerStarted","Data":"d059020f5f0078b21e4c0670af7fabc7a50332743075573c47da5a447504eedf"} Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.157264 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" podStartSLOduration=2.157224834 podStartE2EDuration="2.157224834s" podCreationTimestamp="2025-11-21 12:34:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:34:04.147878533 +0000 UTC m=+2602.848540361" watchObservedRunningTime="2025-11-21 12:34:04.157224834 +0000 UTC m=+2602.857886652" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.179502 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.196136 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.220356 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:04 crc kubenswrapper[4769]: E1121 12:34:04.220865 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-central-agent" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.220893 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-central-agent" Nov 21 12:34:04 crc kubenswrapper[4769]: E1121 12:34:04.220917 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-notification-agent" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.220926 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-notification-agent" Nov 21 12:34:04 crc kubenswrapper[4769]: E1121 12:34:04.220946 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="proxy-httpd" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.220955 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="proxy-httpd" Nov 21 12:34:04 crc kubenswrapper[4769]: E1121 12:34:04.220974 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="sg-core" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.220982 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="sg-core" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.221270 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-central-agent" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.221299 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="ceilometer-notification-agent" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.221319 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="proxy-httpd" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.221332 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d72488d1-2497-44b2-8206-32cf85562168" containerName="sg-core" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.263614 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.263851 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.268068 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.268608 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.268947 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.421921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.421978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-log-httpd\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.422045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-scripts\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.422104 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-config-data\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.422123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5kzh\" (UniqueName: \"kubernetes.io/projected/1438da42-af61-4365-aa3d-ecb3b053fcec-kube-api-access-m5kzh\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.422154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-run-httpd\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.422169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.422229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.524348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-config-data\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.525689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m5kzh\" (UniqueName: \"kubernetes.io/projected/1438da42-af61-4365-aa3d-ecb3b053fcec-kube-api-access-m5kzh\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.525729 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.525751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-run-httpd\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.525854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.525944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.525983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-log-httpd\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.526295 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-run-httpd\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.526605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-log-httpd\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.526708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-scripts\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.531435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.532319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.532436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-scripts\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.532938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-config-data\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.533912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.549738 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5kzh\" (UniqueName: \"kubernetes.io/projected/1438da42-af61-4365-aa3d-ecb3b053fcec-kube-api-access-m5kzh\") pod \"ceilometer-0\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:04 crc kubenswrapper[4769]: I1121 12:34:04.606308 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:05 crc kubenswrapper[4769]: I1121 12:34:05.148818 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:05 crc kubenswrapper[4769]: W1121 12:34:05.161995 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1438da42_af61_4365_aa3d_ecb3b053fcec.slice/crio-7add91f87a37ad0b8a5a8c1ee1229d617bd707b04d29dab589d0530b1cef12e3 WatchSource:0}: Error finding container 7add91f87a37ad0b8a5a8c1ee1229d617bd707b04d29dab589d0530b1cef12e3: Status 404 returned error can't find the container with id 7add91f87a37ad0b8a5a8c1ee1229d617bd707b04d29dab589d0530b1cef12e3 Nov 21 12:34:05 crc kubenswrapper[4769]: I1121 12:34:05.289077 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d72488d1-2497-44b2-8206-32cf85562168" path="/var/lib/kubelet/pods/d72488d1-2497-44b2-8206-32cf85562168/volumes" Nov 21 12:34:05 crc kubenswrapper[4769]: I1121 12:34:05.689325 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:05 crc kubenswrapper[4769]: I1121 12:34:05.689407 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:06 crc kubenswrapper[4769]: I1121 12:34:06.155168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerStarted","Data":"ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be"} Nov 21 12:34:06 crc kubenswrapper[4769]: I1121 12:34:06.155564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerStarted","Data":"7add91f87a37ad0b8a5a8c1ee1229d617bd707b04d29dab589d0530b1cef12e3"} Nov 21 12:34:06 crc kubenswrapper[4769]: I1121 12:34:06.772431 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.250:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:06 crc kubenswrapper[4769]: I1121 12:34:06.772448 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.250:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:07 crc kubenswrapper[4769]: I1121 12:34:07.166664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerStarted","Data":"51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7"} Nov 21 12:34:08 crc kubenswrapper[4769]: I1121 12:34:08.179564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerStarted","Data":"14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8"} Nov 21 12:34:08 crc kubenswrapper[4769]: I1121 12:34:08.403747 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:08 crc kubenswrapper[4769]: I1121 12:34:08.446904 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:08 crc kubenswrapper[4769]: I1121 12:34:08.735245 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:34:09 crc kubenswrapper[4769]: I1121 12:34:09.198483 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b907e1e-12df-47ff-8f31-f90226941ce9" containerID="d01cc36f3c2c2d74fd2ff72845df2f626a95d928f5fba546a1cf55bf6f5e34d0" exitCode=0 Nov 21 12:34:09 crc kubenswrapper[4769]: I1121 12:34:09.198522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" event={"ID":"5b907e1e-12df-47ff-8f31-f90226941ce9","Type":"ContainerDied","Data":"d01cc36f3c2c2d74fd2ff72845df2f626a95d928f5fba546a1cf55bf6f5e34d0"} Nov 21 12:34:09 crc kubenswrapper[4769]: I1121 12:34:09.233337 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:09 crc kubenswrapper[4769]: I1121 12:34:09.274372 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:34:09 crc kubenswrapper[4769]: E1121 12:34:09.274622 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.217347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerStarted","Data":"9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2"} Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.218113 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.252547 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.446269337 podStartE2EDuration="6.252529304s" podCreationTimestamp="2025-11-21 12:34:04 +0000 UTC" firstStartedPulling="2025-11-21 12:34:05.167721454 +0000 UTC m=+2603.868383272" lastFinishedPulling="2025-11-21 12:34:08.973981421 +0000 UTC m=+2607.674643239" observedRunningTime="2025-11-21 12:34:10.242838943 +0000 UTC m=+2608.943500761" watchObservedRunningTime="2025-11-21 12:34:10.252529304 +0000 UTC m=+2608.953191122" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.637211 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.714897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmkrd\" (UniqueName: \"kubernetes.io/projected/5b907e1e-12df-47ff-8f31-f90226941ce9-kube-api-access-rmkrd\") pod \"5b907e1e-12df-47ff-8f31-f90226941ce9\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.714944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-config-data\") pod \"5b907e1e-12df-47ff-8f31-f90226941ce9\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.715103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-combined-ca-bundle\") pod \"5b907e1e-12df-47ff-8f31-f90226941ce9\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.715366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-scripts\") pod \"5b907e1e-12df-47ff-8f31-f90226941ce9\" (UID: \"5b907e1e-12df-47ff-8f31-f90226941ce9\") " Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.720781 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b907e1e-12df-47ff-8f31-f90226941ce9-kube-api-access-rmkrd" (OuterVolumeSpecName: "kube-api-access-rmkrd") pod "5b907e1e-12df-47ff-8f31-f90226941ce9" (UID: "5b907e1e-12df-47ff-8f31-f90226941ce9"). InnerVolumeSpecName "kube-api-access-rmkrd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.726402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-scripts" (OuterVolumeSpecName: "scripts") pod "5b907e1e-12df-47ff-8f31-f90226941ce9" (UID: "5b907e1e-12df-47ff-8f31-f90226941ce9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.745050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b907e1e-12df-47ff-8f31-f90226941ce9" (UID: "5b907e1e-12df-47ff-8f31-f90226941ce9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.747022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-config-data" (OuterVolumeSpecName: "config-data") pod "5b907e1e-12df-47ff-8f31-f90226941ce9" (UID: "5b907e1e-12df-47ff-8f31-f90226941ce9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.817833 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rmkrd\" (UniqueName: \"kubernetes.io/projected/5b907e1e-12df-47ff-8f31-f90226941ce9-kube-api-access-rmkrd\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.817876 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.817887 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:10 crc kubenswrapper[4769]: I1121 12:34:10.817894 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b907e1e-12df-47ff-8f31-f90226941ce9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.228225 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.228221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-597gk" event={"ID":"5b907e1e-12df-47ff-8f31-f90226941ce9","Type":"ContainerDied","Data":"d059020f5f0078b21e4c0670af7fabc7a50332743075573c47da5a447504eedf"} Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.228280 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d059020f5f0078b21e4c0670af7fabc7a50332743075573c47da5a447504eedf" Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.347203 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.347586 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-log" containerID="cri-o://1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e" gracePeriod=30 Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.348233 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-api" containerID="cri-o://ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881" gracePeriod=30 Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.358887 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.359147 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f7928538-ecae-47cd-99cc-090188eaaa87" containerName="nova-scheduler-scheduler" containerID="cri-o://8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" gracePeriod=30 Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.420683 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.421297 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-metadata" containerID="cri-o://29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313" gracePeriod=30 Nov 21 12:34:11 crc kubenswrapper[4769]: I1121 12:34:11.421180 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-log" containerID="cri-o://55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d" gracePeriod=30 Nov 21 12:34:12 crc kubenswrapper[4769]: I1121 12:34:12.240775 4769 generic.go:334] "Generic (PLEG): container finished" podID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerID="55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d" exitCode=143 Nov 21 12:34:12 crc kubenswrapper[4769]: I1121 12:34:12.240891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1358e40a-9e89-4204-bfc7-7037274eadf9","Type":"ContainerDied","Data":"55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d"} Nov 21 12:34:12 crc kubenswrapper[4769]: I1121 12:34:12.243412 4769 generic.go:334] "Generic (PLEG): container finished" podID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerID="1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e" exitCode=143 Nov 21 12:34:12 crc kubenswrapper[4769]: I1121 12:34:12.243545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"49987d4a-8aab-4442-b70d-381fe0765fa3","Type":"ContainerDied","Data":"1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e"} Nov 21 12:34:13 crc kubenswrapper[4769]: E1121 12:34:13.407245 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:34:13 crc kubenswrapper[4769]: E1121 12:34:13.409185 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:34:13 crc kubenswrapper[4769]: E1121 12:34:13.410727 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:34:13 crc kubenswrapper[4769]: E1121 12:34:13.410806 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f7928538-ecae-47cd-99cc-090188eaaa87" containerName="nova-scheduler-scheduler" Nov 21 12:34:14 crc kubenswrapper[4769]: I1121 12:34:14.997032 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.078980 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.121819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-config-data\") pod \"49987d4a-8aab-4442-b70d-381fe0765fa3\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.122207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-combined-ca-bundle\") pod \"49987d4a-8aab-4442-b70d-381fe0765fa3\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.123076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/49987d4a-8aab-4442-b70d-381fe0765fa3-logs\") pod \"49987d4a-8aab-4442-b70d-381fe0765fa3\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.123218 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvc9n\" (UniqueName: \"kubernetes.io/projected/49987d4a-8aab-4442-b70d-381fe0765fa3-kube-api-access-cvc9n\") pod \"49987d4a-8aab-4442-b70d-381fe0765fa3\" (UID: \"49987d4a-8aab-4442-b70d-381fe0765fa3\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.123794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49987d4a-8aab-4442-b70d-381fe0765fa3-logs" (OuterVolumeSpecName: "logs") pod "49987d4a-8aab-4442-b70d-381fe0765fa3" (UID: "49987d4a-8aab-4442-b70d-381fe0765fa3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.124697 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/49987d4a-8aab-4442-b70d-381fe0765fa3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.128969 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49987d4a-8aab-4442-b70d-381fe0765fa3-kube-api-access-cvc9n" (OuterVolumeSpecName: "kube-api-access-cvc9n") pod "49987d4a-8aab-4442-b70d-381fe0765fa3" (UID: "49987d4a-8aab-4442-b70d-381fe0765fa3"). InnerVolumeSpecName "kube-api-access-cvc9n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.155672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-config-data" (OuterVolumeSpecName: "config-data") pod "49987d4a-8aab-4442-b70d-381fe0765fa3" (UID: "49987d4a-8aab-4442-b70d-381fe0765fa3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.162578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "49987d4a-8aab-4442-b70d-381fe0765fa3" (UID: "49987d4a-8aab-4442-b70d-381fe0765fa3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.225948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-nova-metadata-tls-certs\") pod \"1358e40a-9e89-4204-bfc7-7037274eadf9\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.226022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-config-data\") pod \"1358e40a-9e89-4204-bfc7-7037274eadf9\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.226243 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1358e40a-9e89-4204-bfc7-7037274eadf9-logs\") pod \"1358e40a-9e89-4204-bfc7-7037274eadf9\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.226719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1358e40a-9e89-4204-bfc7-7037274eadf9-logs" (OuterVolumeSpecName: "logs") pod "1358e40a-9e89-4204-bfc7-7037274eadf9" (UID: "1358e40a-9e89-4204-bfc7-7037274eadf9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.226770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-combined-ca-bundle\") pod \"1358e40a-9e89-4204-bfc7-7037274eadf9\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.226868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtfnj\" (UniqueName: \"kubernetes.io/projected/1358e40a-9e89-4204-bfc7-7037274eadf9-kube-api-access-gtfnj\") pod \"1358e40a-9e89-4204-bfc7-7037274eadf9\" (UID: \"1358e40a-9e89-4204-bfc7-7037274eadf9\") " Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.227453 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1358e40a-9e89-4204-bfc7-7037274eadf9-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.227484 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.227518 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49987d4a-8aab-4442-b70d-381fe0765fa3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.227540 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cvc9n\" (UniqueName: \"kubernetes.io/projected/49987d4a-8aab-4442-b70d-381fe0765fa3-kube-api-access-cvc9n\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.230427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1358e40a-9e89-4204-bfc7-7037274eadf9-kube-api-access-gtfnj" (OuterVolumeSpecName: "kube-api-access-gtfnj") pod "1358e40a-9e89-4204-bfc7-7037274eadf9" (UID: "1358e40a-9e89-4204-bfc7-7037274eadf9"). InnerVolumeSpecName "kube-api-access-gtfnj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.252517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-config-data" (OuterVolumeSpecName: "config-data") pod "1358e40a-9e89-4204-bfc7-7037274eadf9" (UID: "1358e40a-9e89-4204-bfc7-7037274eadf9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.253504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1358e40a-9e89-4204-bfc7-7037274eadf9" (UID: "1358e40a-9e89-4204-bfc7-7037274eadf9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.275937 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "1358e40a-9e89-4204-bfc7-7037274eadf9" (UID: "1358e40a-9e89-4204-bfc7-7037274eadf9"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.279323 4769 generic.go:334] "Generic (PLEG): container finished" podID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerID="ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881" exitCode=0 Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.279426 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.284916 4769 generic.go:334] "Generic (PLEG): container finished" podID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerID="29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313" exitCode=0 Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.285015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.288037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"49987d4a-8aab-4442-b70d-381fe0765fa3","Type":"ContainerDied","Data":"ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881"} Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.288082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"49987d4a-8aab-4442-b70d-381fe0765fa3","Type":"ContainerDied","Data":"13b15fbd72cf6abd9a46af8f648614ad634ef792b141eb1d9d842e5074862fc8"} Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.288093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1358e40a-9e89-4204-bfc7-7037274eadf9","Type":"ContainerDied","Data":"29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313"} Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.288104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1358e40a-9e89-4204-bfc7-7037274eadf9","Type":"ContainerDied","Data":"1335e5b410b567386d3e87c2b596abb2c73cc45db6cb9df11134c18d1e972864"} Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.288121 4769 scope.go:117] "RemoveContainer" containerID="ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.330276 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.330946 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gtfnj\" (UniqueName: \"kubernetes.io/projected/1358e40a-9e89-4204-bfc7-7037274eadf9-kube-api-access-gtfnj\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.330962 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.330991 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1358e40a-9e89-4204-bfc7-7037274eadf9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.333883 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.344834 4769 scope.go:117] "RemoveContainer" containerID="1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.345501 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.370770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.374611 4769 scope.go:117] "RemoveContainer" containerID="ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.375134 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881\": container with ID starting with ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881 not found: ID does not exist" containerID="ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.375287 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881"} err="failed to get container status \"ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881\": rpc error: code = NotFound desc = could not find container \"ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881\": container with ID starting with ca6e116cb6e7983c11675326ab4f48be300e3dd15ee3c5bc8fb942f60c343881 not found: ID does not exist" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.375400 4769 scope.go:117] "RemoveContainer" containerID="1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.375875 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e\": container with ID starting with 1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e not found: ID does not exist" containerID="1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.375949 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e"} err="failed to get container status \"1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e\": rpc error: code = NotFound desc = could not find container \"1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e\": container with ID starting with 1f52fc4e24c1a0a139a868ed9efb4c5a2708789cbb38411e404775899e048d3e not found: ID does not exist" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.375982 4769 scope.go:117] "RemoveContainer" containerID="29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.403607 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.411387 4769 scope.go:117] "RemoveContainer" containerID="55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.415266 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.415788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-log" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.415813 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-log" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.415833 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-metadata" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.415842 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-metadata" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.415876 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-api" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.415884 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-api" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.415901 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b907e1e-12df-47ff-8f31-f90226941ce9" containerName="nova-manage" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.415909 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b907e1e-12df-47ff-8f31-f90226941ce9" containerName="nova-manage" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.415925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-log" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.415934 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-log" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.416561 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b907e1e-12df-47ff-8f31-f90226941ce9" containerName="nova-manage" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.416595 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-metadata" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.416621 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-log" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.416635 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" containerName="nova-api-api" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.416654 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" containerName="nova-metadata-log" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.418334 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.420098 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.423674 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.430546 4769 scope.go:117] "RemoveContainer" containerID="29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.431358 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313\": container with ID starting with 29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313 not found: ID does not exist" containerID="29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.431406 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313"} err="failed to get container status \"29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313\": rpc error: code = NotFound desc = could not find container \"29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313\": container with ID starting with 29ba322b90951650bc44c43523473e069ea1347a52ce9f872b2cce0c9e0f9313 not found: ID does not exist" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.431433 4769 scope.go:117] "RemoveContainer" containerID="55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d" Nov 21 12:34:15 crc kubenswrapper[4769]: E1121 12:34:15.432372 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d\": container with ID starting with 55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d not found: ID does not exist" containerID="55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.432406 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d"} err="failed to get container status \"55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d\": rpc error: code = NotFound desc = could not find container \"55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d\": container with ID starting with 55a1faf6ef61eb14d878efa241c899feea472e2bba21cf664d557b1b76fa939d not found: ID does not exist" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.438634 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.440809 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.447045 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.447235 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.451072 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.536366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dp7b\" (UniqueName: \"kubernetes.io/projected/534c3d4a-cf4d-4113-bf6d-d30df12dc875-kube-api-access-6dp7b\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.536426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-config-data\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.536717 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/534c3d4a-cf4d-4113-bf6d-d30df12dc875-logs\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.537007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.638730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4b9k\" (UniqueName: \"kubernetes.io/projected/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-kube-api-access-s4b9k\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.638954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-config-data\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-logs\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6dp7b\" (UniqueName: \"kubernetes.io/projected/534c3d4a-cf4d-4113-bf6d-d30df12dc875-kube-api-access-6dp7b\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-config-data\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.639719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/534c3d4a-cf4d-4113-bf6d-d30df12dc875-logs\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.640140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/534c3d4a-cf4d-4113-bf6d-d30df12dc875-logs\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.643482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.645691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-config-data\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.665147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dp7b\" (UniqueName: \"kubernetes.io/projected/534c3d4a-cf4d-4113-bf6d-d30df12dc875-kube-api-access-6dp7b\") pod \"nova-api-0\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.742844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.743231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-config-data\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.743276 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.743361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-logs\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.743615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s4b9k\" (UniqueName: \"kubernetes.io/projected/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-kube-api-access-s4b9k\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.744213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-logs\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.747112 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.748708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-config-data\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.750898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.751027 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.765880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4b9k\" (UniqueName: \"kubernetes.io/projected/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-kube-api-access-s4b9k\") pod \"nova-metadata-0\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.767468 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:15 crc kubenswrapper[4769]: I1121 12:34:15.988992 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.154447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-combined-ca-bundle\") pod \"f7928538-ecae-47cd-99cc-090188eaaa87\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.154648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8p8t\" (UniqueName: \"kubernetes.io/projected/f7928538-ecae-47cd-99cc-090188eaaa87-kube-api-access-x8p8t\") pod \"f7928538-ecae-47cd-99cc-090188eaaa87\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.154710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-config-data\") pod \"f7928538-ecae-47cd-99cc-090188eaaa87\" (UID: \"f7928538-ecae-47cd-99cc-090188eaaa87\") " Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.161646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7928538-ecae-47cd-99cc-090188eaaa87-kube-api-access-x8p8t" (OuterVolumeSpecName: "kube-api-access-x8p8t") pod "f7928538-ecae-47cd-99cc-090188eaaa87" (UID: "f7928538-ecae-47cd-99cc-090188eaaa87"). InnerVolumeSpecName "kube-api-access-x8p8t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.187223 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-config-data" (OuterVolumeSpecName: "config-data") pod "f7928538-ecae-47cd-99cc-090188eaaa87" (UID: "f7928538-ecae-47cd-99cc-090188eaaa87"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.187871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7928538-ecae-47cd-99cc-090188eaaa87" (UID: "f7928538-ecae-47cd-99cc-090188eaaa87"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.257671 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x8p8t\" (UniqueName: \"kubernetes.io/projected/f7928538-ecae-47cd-99cc-090188eaaa87-kube-api-access-x8p8t\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.257713 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.257726 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7928538-ecae-47cd-99cc-090188eaaa87-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.307282 4769 generic.go:334] "Generic (PLEG): container finished" podID="f7928538-ecae-47cd-99cc-090188eaaa87" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" exitCode=0 Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.307330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f7928538-ecae-47cd-99cc-090188eaaa87","Type":"ContainerDied","Data":"8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913"} Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.307354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f7928538-ecae-47cd-99cc-090188eaaa87","Type":"ContainerDied","Data":"c5887197abb7b039023105c41fb214612455a20702e6f21d730cf066aa7646a8"} Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.307371 4769 scope.go:117] "RemoveContainer" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.307480 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: W1121 12:34:16.319638 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod534c3d4a_cf4d_4113_bf6d_d30df12dc875.slice/crio-41b36e6d044d57f716e922cfde664050da8e473e60358fca34a9b44fa94d4b99 WatchSource:0}: Error finding container 41b36e6d044d57f716e922cfde664050da8e473e60358fca34a9b44fa94d4b99: Status 404 returned error can't find the container with id 41b36e6d044d57f716e922cfde664050da8e473e60358fca34a9b44fa94d4b99 Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.322611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.350907 4769 scope.go:117] "RemoveContainer" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" Nov 21 12:34:16 crc kubenswrapper[4769]: E1121 12:34:16.351580 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913\": container with ID starting with 8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913 not found: ID does not exist" containerID="8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.351647 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913"} err="failed to get container status \"8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913\": rpc error: code = NotFound desc = could not find container \"8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913\": container with ID starting with 8855f00d512e205c5272f4405f32ba13b5785de32777f7592a27393ed6a29913 not found: ID does not exist" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.359001 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.382830 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.397707 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:34:16 crc kubenswrapper[4769]: E1121 12:34:16.398143 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7928538-ecae-47cd-99cc-090188eaaa87" containerName="nova-scheduler-scheduler" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.398160 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7928538-ecae-47cd-99cc-090188eaaa87" containerName="nova-scheduler-scheduler" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.398382 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7928538-ecae-47cd-99cc-090188eaaa87" containerName="nova-scheduler-scheduler" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.400114 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.408020 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.412008 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.425464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:34:16 crc kubenswrapper[4769]: E1121 12:34:16.503592 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7928538_ecae_47cd_99cc_090188eaaa87.slice\": RecentStats: unable to find data in memory cache]" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.567267 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.567377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-config-data\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.567420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqdwd\" (UniqueName: \"kubernetes.io/projected/21166d92-cc4d-4b63-810d-4b80d10db159-kube-api-access-dqdwd\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.670441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.670537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-config-data\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.670715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dqdwd\" (UniqueName: \"kubernetes.io/projected/21166d92-cc4d-4b63-810d-4b80d10db159-kube-api-access-dqdwd\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.679395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-config-data\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.679840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.690869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqdwd\" (UniqueName: \"kubernetes.io/projected/21166d92-cc4d-4b63-810d-4b80d10db159-kube-api-access-dqdwd\") pod \"nova-scheduler-0\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:16 crc kubenswrapper[4769]: I1121 12:34:16.732034 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.201058 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:34:17 crc kubenswrapper[4769]: W1121 12:34:17.202353 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21166d92_cc4d_4b63_810d_4b80d10db159.slice/crio-9bc5832ea470ff6caeab95fc94ddfe4fc93c87f2712c5bf6d43ddb49a20e687f WatchSource:0}: Error finding container 9bc5832ea470ff6caeab95fc94ddfe4fc93c87f2712c5bf6d43ddb49a20e687f: Status 404 returned error can't find the container with id 9bc5832ea470ff6caeab95fc94ddfe4fc93c87f2712c5bf6d43ddb49a20e687f Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.292112 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1358e40a-9e89-4204-bfc7-7037274eadf9" path="/var/lib/kubelet/pods/1358e40a-9e89-4204-bfc7-7037274eadf9/volumes" Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.293234 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49987d4a-8aab-4442-b70d-381fe0765fa3" path="/var/lib/kubelet/pods/49987d4a-8aab-4442-b70d-381fe0765fa3/volumes" Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.295571 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7928538-ecae-47cd-99cc-090188eaaa87" path="/var/lib/kubelet/pods/f7928538-ecae-47cd-99cc-090188eaaa87/volumes" Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.328622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"21166d92-cc4d-4b63-810d-4b80d10db159","Type":"ContainerStarted","Data":"9bc5832ea470ff6caeab95fc94ddfe4fc93c87f2712c5bf6d43ddb49a20e687f"} Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.331138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b","Type":"ContainerStarted","Data":"915f4bcd9c6149ea9f5f50cc8ac6932c8c52ffc2f91b97b5209b3cfd6cfe2593"} Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.331231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b","Type":"ContainerStarted","Data":"562d26046cd9233dd15ce968a51d7a31fa483188af0d5dabd88eb444bf741987"} Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.335172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"534c3d4a-cf4d-4113-bf6d-d30df12dc875","Type":"ContainerStarted","Data":"a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f"} Nov 21 12:34:17 crc kubenswrapper[4769]: I1121 12:34:17.335246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"534c3d4a-cf4d-4113-bf6d-d30df12dc875","Type":"ContainerStarted","Data":"41b36e6d044d57f716e922cfde664050da8e473e60358fca34a9b44fa94d4b99"} Nov 21 12:34:18 crc kubenswrapper[4769]: I1121 12:34:18.351978 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"534c3d4a-cf4d-4113-bf6d-d30df12dc875","Type":"ContainerStarted","Data":"c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61"} Nov 21 12:34:18 crc kubenswrapper[4769]: I1121 12:34:18.357287 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"21166d92-cc4d-4b63-810d-4b80d10db159","Type":"ContainerStarted","Data":"26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580"} Nov 21 12:34:18 crc kubenswrapper[4769]: I1121 12:34:18.360329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b","Type":"ContainerStarted","Data":"652ca03c5ad58ceec7e88a3e5377a0554ef8b8df704a0b00b5b5e9a203f423ea"} Nov 21 12:34:18 crc kubenswrapper[4769]: I1121 12:34:18.378981 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.378953485 podStartE2EDuration="3.378953485s" podCreationTimestamp="2025-11-21 12:34:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:34:18.368887785 +0000 UTC m=+2617.069549643" watchObservedRunningTime="2025-11-21 12:34:18.378953485 +0000 UTC m=+2617.079615303" Nov 21 12:34:18 crc kubenswrapper[4769]: I1121 12:34:18.402015 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.401969034 podStartE2EDuration="3.401969034s" podCreationTimestamp="2025-11-21 12:34:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:34:18.387372922 +0000 UTC m=+2617.088034750" watchObservedRunningTime="2025-11-21 12:34:18.401969034 +0000 UTC m=+2617.102630852" Nov 21 12:34:18 crc kubenswrapper[4769]: I1121 12:34:18.416630 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.416604307 podStartE2EDuration="2.416604307s" podCreationTimestamp="2025-11-21 12:34:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:34:18.403054993 +0000 UTC m=+2617.103716811" watchObservedRunningTime="2025-11-21 12:34:18.416604307 +0000 UTC m=+2617.117266125" Nov 21 12:34:20 crc kubenswrapper[4769]: I1121 12:34:20.767717 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:20 crc kubenswrapper[4769]: I1121 12:34:20.769424 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:21 crc kubenswrapper[4769]: I1121 12:34:21.733132 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:22 crc kubenswrapper[4769]: I1121 12:34:22.273843 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:34:22 crc kubenswrapper[4769]: E1121 12:34:22.274088 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:34:25 crc kubenswrapper[4769]: I1121 12:34:25.752105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:25 crc kubenswrapper[4769]: I1121 12:34:25.752720 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:25 crc kubenswrapper[4769]: I1121 12:34:25.768441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:25 crc kubenswrapper[4769]: I1121 12:34:25.768504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:26 crc kubenswrapper[4769]: I1121 12:34:26.732750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:26 crc kubenswrapper[4769]: I1121 12:34:26.769242 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:26 crc kubenswrapper[4769]: I1121 12:34:26.834423 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.5:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:26 crc kubenswrapper[4769]: I1121 12:34:26.848431 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.12:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:26 crc kubenswrapper[4769]: I1121 12:34:26.848810 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.12:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:26 crc kubenswrapper[4769]: I1121 12:34:26.849165 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.5:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:27 crc kubenswrapper[4769]: I1121 12:34:27.509881 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:34:34 crc kubenswrapper[4769]: I1121 12:34:34.275626 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:34:34 crc kubenswrapper[4769]: E1121 12:34:34.276412 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:34:34 crc kubenswrapper[4769]: I1121 12:34:34.616032 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.771006 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.772228 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.783196 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.783285 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.799297 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.802012 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:35 crc kubenswrapper[4769]: I1121 12:34:35.807782 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:36 crc kubenswrapper[4769]: I1121 12:34:36.568105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:36 crc kubenswrapper[4769]: I1121 12:34:36.572071 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:36 crc kubenswrapper[4769]: I1121 12:34:36.574350 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:34:38 crc kubenswrapper[4769]: I1121 12:34:38.829828 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:38 crc kubenswrapper[4769]: I1121 12:34:38.830823 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-central-agent" containerID="cri-o://ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be" gracePeriod=30 Nov 21 12:34:38 crc kubenswrapper[4769]: I1121 12:34:38.830910 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="proxy-httpd" containerID="cri-o://9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2" gracePeriod=30 Nov 21 12:34:38 crc kubenswrapper[4769]: I1121 12:34:38.830950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="sg-core" containerID="cri-o://14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8" gracePeriod=30 Nov 21 12:34:38 crc kubenswrapper[4769]: I1121 12:34:38.830957 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-notification-agent" containerID="cri-o://51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7" gracePeriod=30 Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.241953 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.607924 4769 generic.go:334] "Generic (PLEG): container finished" podID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerID="9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2" exitCode=0 Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608252 4769 generic.go:334] "Generic (PLEG): container finished" podID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerID="14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8" exitCode=2 Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerDied","Data":"9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2"} Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerDied","Data":"14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8"} Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerDied","Data":"ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be"} Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608265 4769 generic.go:334] "Generic (PLEG): container finished" podID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerID="ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be" exitCode=0 Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608584 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-log" containerID="cri-o://a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f" gracePeriod=30 Nov 21 12:34:39 crc kubenswrapper[4769]: I1121 12:34:39.608680 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-api" containerID="cri-o://c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61" gracePeriod=30 Nov 21 12:34:40 crc kubenswrapper[4769]: I1121 12:34:40.620780 4769 generic.go:334] "Generic (PLEG): container finished" podID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerID="a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f" exitCode=143 Nov 21 12:34:40 crc kubenswrapper[4769]: I1121 12:34:40.620837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"534c3d4a-cf4d-4113-bf6d-d30df12dc875","Type":"ContainerDied","Data":"a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f"} Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.361009 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.370775 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.431818 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-config-data\") pod \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.431960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-combined-ca-bundle\") pod \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.431996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5kzh\" (UniqueName: \"kubernetes.io/projected/1438da42-af61-4365-aa3d-ecb3b053fcec-kube-api-access-m5kzh\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432038 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-ceilometer-tls-certs\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/534c3d4a-cf4d-4113-bf6d-d30df12dc875-logs\") pod \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dp7b\" (UniqueName: \"kubernetes.io/projected/534c3d4a-cf4d-4113-bf6d-d30df12dc875-kube-api-access-6dp7b\") pod \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\" (UID: \"534c3d4a-cf4d-4113-bf6d-d30df12dc875\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-run-httpd\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-config-data\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432330 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-sg-core-conf-yaml\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-log-httpd\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-combined-ca-bundle\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.432488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-scripts\") pod \"1438da42-af61-4365-aa3d-ecb3b053fcec\" (UID: \"1438da42-af61-4365-aa3d-ecb3b053fcec\") " Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.433890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/534c3d4a-cf4d-4113-bf6d-d30df12dc875-logs" (OuterVolumeSpecName: "logs") pod "534c3d4a-cf4d-4113-bf6d-d30df12dc875" (UID: "534c3d4a-cf4d-4113-bf6d-d30df12dc875"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.434449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.435170 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.440371 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/534c3d4a-cf4d-4113-bf6d-d30df12dc875-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.440401 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.440618 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/534c3d4a-cf4d-4113-bf6d-d30df12dc875-kube-api-access-6dp7b" (OuterVolumeSpecName: "kube-api-access-6dp7b") pod "534c3d4a-cf4d-4113-bf6d-d30df12dc875" (UID: "534c3d4a-cf4d-4113-bf6d-d30df12dc875"). InnerVolumeSpecName "kube-api-access-6dp7b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.452645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-scripts" (OuterVolumeSpecName: "scripts") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.452916 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1438da42-af61-4365-aa3d-ecb3b053fcec-kube-api-access-m5kzh" (OuterVolumeSpecName: "kube-api-access-m5kzh") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "kube-api-access-m5kzh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.490627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.516434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "534c3d4a-cf4d-4113-bf6d-d30df12dc875" (UID: "534c3d4a-cf4d-4113-bf6d-d30df12dc875"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.528512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-config-data" (OuterVolumeSpecName: "config-data") pod "534c3d4a-cf4d-4113-bf6d-d30df12dc875" (UID: "534c3d4a-cf4d-4113-bf6d-d30df12dc875"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541635 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541664 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534c3d4a-cf4d-4113-bf6d-d30df12dc875-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541675 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m5kzh\" (UniqueName: \"kubernetes.io/projected/1438da42-af61-4365-aa3d-ecb3b053fcec-kube-api-access-m5kzh\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541683 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6dp7b\" (UniqueName: \"kubernetes.io/projected/534c3d4a-cf4d-4113-bf6d-d30df12dc875-kube-api-access-6dp7b\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541691 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1438da42-af61-4365-aa3d-ecb3b053fcec-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541700 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.541708 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.544807 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.557321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.579363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-config-data" (OuterVolumeSpecName: "config-data") pod "1438da42-af61-4365-aa3d-ecb3b053fcec" (UID: "1438da42-af61-4365-aa3d-ecb3b053fcec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.643398 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.643461 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.643476 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1438da42-af61-4365-aa3d-ecb3b053fcec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.653249 4769 generic.go:334] "Generic (PLEG): container finished" podID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerID="c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61" exitCode=0 Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.653346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"534c3d4a-cf4d-4113-bf6d-d30df12dc875","Type":"ContainerDied","Data":"c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61"} Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.653378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"534c3d4a-cf4d-4113-bf6d-d30df12dc875","Type":"ContainerDied","Data":"41b36e6d044d57f716e922cfde664050da8e473e60358fca34a9b44fa94d4b99"} Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.653398 4769 scope.go:117] "RemoveContainer" containerID="c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.653631 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.659202 4769 generic.go:334] "Generic (PLEG): container finished" podID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerID="51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7" exitCode=0 Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.659244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerDied","Data":"51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7"} Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.659269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1438da42-af61-4365-aa3d-ecb3b053fcec","Type":"ContainerDied","Data":"7add91f87a37ad0b8a5a8c1ee1229d617bd707b04d29dab589d0530b1cef12e3"} Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.659338 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.682413 4769 scope.go:117] "RemoveContainer" containerID="a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.706116 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.716767 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.728277 4769 scope.go:117] "RemoveContainer" containerID="c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.728811 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61\": container with ID starting with c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61 not found: ID does not exist" containerID="c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.728842 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61"} err="failed to get container status \"c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61\": rpc error: code = NotFound desc = could not find container \"c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61\": container with ID starting with c583af8926e833f2ca43c816332cf892fd948292f0516a91f581dee2f938dc61 not found: ID does not exist" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.728863 4769 scope.go:117] "RemoveContainer" containerID="a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.729181 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f\": container with ID starting with a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f not found: ID does not exist" containerID="a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.729250 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f"} err="failed to get container status \"a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f\": rpc error: code = NotFound desc = could not find container \"a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f\": container with ID starting with a44754d4df48f2602615acd49ff91a98184657592f5d5fa1d38e92fc2242c56f not found: ID does not exist" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.729287 4769 scope.go:117] "RemoveContainer" containerID="9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.741638 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.757076 4769 scope.go:117] "RemoveContainer" containerID="14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.758168 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.766008 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.766832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="proxy-httpd" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.766859 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="proxy-httpd" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.766878 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="sg-core" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.766885 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="sg-core" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.766904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-api" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.766911 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-api" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.766930 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-log" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.766936 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-log" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.766963 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-central-agent" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.766971 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-central-agent" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.766998 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-notification-agent" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767007 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-notification-agent" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767325 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="proxy-httpd" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767642 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-notification-agent" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767654 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-log" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767676 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" containerName="nova-api-api" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767725 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="sg-core" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.767745 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" containerName="ceilometer-central-agent" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.770976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.774363 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.774739 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.774863 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.776614 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.787996 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.790775 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.793887 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.794327 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.795183 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.795692 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.831847 4769 scope.go:117] "RemoveContainer" containerID="51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.847780 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-public-tls-certs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.847822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-log-httpd\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.847988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-internal-tls-certs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78615e61-bc82-4c5d-baae-192881b1180c-logs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848246 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-run-httpd\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh2nj\" (UniqueName: \"kubernetes.io/projected/78615e61-bc82-4c5d-baae-192881b1180c-kube-api-access-kh2nj\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-scripts\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848605 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-config-data\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848718 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-config-data\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqph2\" (UniqueName: \"kubernetes.io/projected/5afe14b3-c830-484e-837e-3dd0cdd61413-kube-api-access-mqph2\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.848849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.851803 4769 scope.go:117] "RemoveContainer" containerID="ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.871961 4769 scope.go:117] "RemoveContainer" containerID="9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.872610 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2\": container with ID starting with 9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2 not found: ID does not exist" containerID="9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.872639 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2"} err="failed to get container status \"9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2\": rpc error: code = NotFound desc = could not find container \"9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2\": container with ID starting with 9da564fec0504893910464e9570658e44efd3e10235fd3b2176864aa8bcfc5e2 not found: ID does not exist" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.872713 4769 scope.go:117] "RemoveContainer" containerID="14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.873042 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8\": container with ID starting with 14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8 not found: ID does not exist" containerID="14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.873083 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8"} err="failed to get container status \"14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8\": rpc error: code = NotFound desc = could not find container \"14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8\": container with ID starting with 14761ddacd52d576396e5e243b580e12c85a2e2bf9e5e49df86b990e41cb3aa8 not found: ID does not exist" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.873111 4769 scope.go:117] "RemoveContainer" containerID="51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.873483 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7\": container with ID starting with 51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7 not found: ID does not exist" containerID="51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.873506 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7"} err="failed to get container status \"51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7\": rpc error: code = NotFound desc = could not find container \"51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7\": container with ID starting with 51eac4812b6d14a72f7443943706f3ccfc1704ecdeb55daf39afb7ec394b1ec7 not found: ID does not exist" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.873528 4769 scope.go:117] "RemoveContainer" containerID="ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be" Nov 21 12:34:43 crc kubenswrapper[4769]: E1121 12:34:43.873836 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be\": container with ID starting with ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be not found: ID does not exist" containerID="ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.873883 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be"} err="failed to get container status \"ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be\": rpc error: code = NotFound desc = could not find container \"ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be\": container with ID starting with ebd7c762721c3252dfca3565b8e019d81a0bd59dec1ac991ddd7f650045c60be not found: ID does not exist" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951079 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-public-tls-certs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-log-httpd\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-internal-tls-certs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78615e61-bc82-4c5d-baae-192881b1180c-logs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951273 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-run-httpd\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kh2nj\" (UniqueName: \"kubernetes.io/projected/78615e61-bc82-4c5d-baae-192881b1180c-kube-api-access-kh2nj\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-scripts\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-config-data\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-config-data\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mqph2\" (UniqueName: \"kubernetes.io/projected/5afe14b3-c830-484e-837e-3dd0cdd61413-kube-api-access-mqph2\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.951483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.952675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-run-httpd\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.952737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-log-httpd\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.955685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.955730 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.956101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-scripts\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.956538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-config-data\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.957727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78615e61-bc82-4c5d-baae-192881b1180c-logs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.957835 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.959876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.960311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-internal-tls-certs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.962063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-config-data\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.963068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-public-tls-certs\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.968552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqph2\" (UniqueName: \"kubernetes.io/projected/5afe14b3-c830-484e-837e-3dd0cdd61413-kube-api-access-mqph2\") pod \"ceilometer-0\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:43 crc kubenswrapper[4769]: I1121 12:34:43.969856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh2nj\" (UniqueName: \"kubernetes.io/projected/78615e61-bc82-4c5d-baae-192881b1180c-kube-api-access-kh2nj\") pod \"nova-api-0\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:44 crc kubenswrapper[4769]: I1121 12:34:44.129948 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:44 crc kubenswrapper[4769]: I1121 12:34:44.135696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:44 crc kubenswrapper[4769]: I1121 12:34:44.601136 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:34:44 crc kubenswrapper[4769]: W1121 12:34:44.607208 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78615e61_bc82_4c5d_baae_192881b1180c.slice/crio-dee21a814c88d9787cdb87397c08a7b7f36006b1e7c5372f5655ed0a6bd9e2cf WatchSource:0}: Error finding container dee21a814c88d9787cdb87397c08a7b7f36006b1e7c5372f5655ed0a6bd9e2cf: Status 404 returned error can't find the container with id dee21a814c88d9787cdb87397c08a7b7f36006b1e7c5372f5655ed0a6bd9e2cf Nov 21 12:34:44 crc kubenswrapper[4769]: I1121 12:34:44.676013 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"78615e61-bc82-4c5d-baae-192881b1180c","Type":"ContainerStarted","Data":"dee21a814c88d9787cdb87397c08a7b7f36006b1e7c5372f5655ed0a6bd9e2cf"} Nov 21 12:34:44 crc kubenswrapper[4769]: I1121 12:34:44.678680 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:34:44 crc kubenswrapper[4769]: W1121 12:34:44.680303 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5afe14b3_c830_484e_837e_3dd0cdd61413.slice/crio-70f74e2286deb525dd31e1e63b0aa0d069ce93446e07ac92e74f654b60fb2ba1 WatchSource:0}: Error finding container 70f74e2286deb525dd31e1e63b0aa0d069ce93446e07ac92e74f654b60fb2ba1: Status 404 returned error can't find the container with id 70f74e2286deb525dd31e1e63b0aa0d069ce93446e07ac92e74f654b60fb2ba1 Nov 21 12:34:44 crc kubenswrapper[4769]: I1121 12:34:44.683612 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:34:45 crc kubenswrapper[4769]: I1121 12:34:45.294026 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1438da42-af61-4365-aa3d-ecb3b053fcec" path="/var/lib/kubelet/pods/1438da42-af61-4365-aa3d-ecb3b053fcec/volumes" Nov 21 12:34:45 crc kubenswrapper[4769]: I1121 12:34:45.295132 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="534c3d4a-cf4d-4113-bf6d-d30df12dc875" path="/var/lib/kubelet/pods/534c3d4a-cf4d-4113-bf6d-d30df12dc875/volumes" Nov 21 12:34:45 crc kubenswrapper[4769]: I1121 12:34:45.688038 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerStarted","Data":"c2ff59122bb6cd9e227a6756a693dc739789ea1be511555a03dce05ca96b9cf3"} Nov 21 12:34:45 crc kubenswrapper[4769]: I1121 12:34:45.688507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerStarted","Data":"70f74e2286deb525dd31e1e63b0aa0d069ce93446e07ac92e74f654b60fb2ba1"} Nov 21 12:34:45 crc kubenswrapper[4769]: I1121 12:34:45.696274 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"78615e61-bc82-4c5d-baae-192881b1180c","Type":"ContainerStarted","Data":"907734f25feb7bfe17eda559c00541441bbc1acb0becb4a66c683c2ea04dcfb6"} Nov 21 12:34:45 crc kubenswrapper[4769]: I1121 12:34:45.696320 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"78615e61-bc82-4c5d-baae-192881b1180c","Type":"ContainerStarted","Data":"eddab7b09b2976c9d088ec264af8d57d4e3360a15360ce1fb1ce3dd2764ea451"} Nov 21 12:34:46 crc kubenswrapper[4769]: I1121 12:34:46.708046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerStarted","Data":"79cf097807ad70143b81a85f5a4633ae1eeabce755f04b365e25a404bde825a6"} Nov 21 12:34:46 crc kubenswrapper[4769]: I1121 12:34:46.708572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerStarted","Data":"0f09fca4f4d58cf691832977b419e1161c455d86d856d6bd614cf68364aab292"} Nov 21 12:34:47 crc kubenswrapper[4769]: I1121 12:34:47.274360 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:34:47 crc kubenswrapper[4769]: I1121 12:34:47.718594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"da2a3b3b916b37218a88212a2ea066749ffab8f49bbf57426bd700ab85ca0799"} Nov 21 12:34:47 crc kubenswrapper[4769]: I1121 12:34:47.736928 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.736907331 podStartE2EDuration="4.736907331s" podCreationTimestamp="2025-11-21 12:34:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:34:45.720600787 +0000 UTC m=+2644.421262605" watchObservedRunningTime="2025-11-21 12:34:47.736907331 +0000 UTC m=+2646.437569149" Nov 21 12:34:48 crc kubenswrapper[4769]: I1121 12:34:48.747650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerStarted","Data":"664e7d522f736774f797f9eb0e8f08404b82a1004b2192e7bf7e0349ca8b9f4e"} Nov 21 12:34:48 crc kubenswrapper[4769]: I1121 12:34:48.749018 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:34:48 crc kubenswrapper[4769]: I1121 12:34:48.783319 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.620729593 podStartE2EDuration="5.783299346s" podCreationTimestamp="2025-11-21 12:34:43 +0000 UTC" firstStartedPulling="2025-11-21 12:34:44.683355037 +0000 UTC m=+2643.384016855" lastFinishedPulling="2025-11-21 12:34:47.84592479 +0000 UTC m=+2646.546586608" observedRunningTime="2025-11-21 12:34:48.779620917 +0000 UTC m=+2647.480282735" watchObservedRunningTime="2025-11-21 12:34:48.783299346 +0000 UTC m=+2647.483961174" Nov 21 12:34:54 crc kubenswrapper[4769]: I1121 12:34:54.131364 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:54 crc kubenswrapper[4769]: I1121 12:34:54.132753 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:34:55 crc kubenswrapper[4769]: I1121 12:34:55.177384 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.45:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:34:55 crc kubenswrapper[4769]: I1121 12:34:55.177885 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.45:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.138788 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.139741 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.148072 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.148329 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.201667 4769 scope.go:117] "RemoveContainer" containerID="0fbdb8114c7c1d007e78d3afa393fc534e980654a3f0e4b7bb530333819b8bc0" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.233931 4769 scope.go:117] "RemoveContainer" containerID="e77ac84ab00a0dd09f8beb69669f066368788011a674ef1c23ec3b7bf20b51a5" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.304350 4769 scope.go:117] "RemoveContainer" containerID="9b5f28059d12af88f1926cdc5bb99fb9166624509fc6b7ee07942fcb8ff47b00" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.328013 4769 scope.go:117] "RemoveContainer" containerID="18ea5c420813c443f6224b08df761140d877cc33d5206148a743f21dbb02982e" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.378724 4769 scope.go:117] "RemoveContainer" containerID="e1a67345fdf223614bd36a995a2cbc07dd81d95aa46d75cb548afd0e76386b22" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.431449 4769 scope.go:117] "RemoveContainer" containerID="d345609de63f0e89ed18a83d4611ae774edc318d4a2504fe28397c4706237421" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.467032 4769 scope.go:117] "RemoveContainer" containerID="2bec774f897b0c52237c552949187576a6b45bbbce1fb4b41a19cf7a3d1caf4e" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.487919 4769 scope.go:117] "RemoveContainer" containerID="8cba7870eb33004343707267ede289e384fd18cf83fc60b22eabb4071e4b6052" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.530755 4769 scope.go:117] "RemoveContainer" containerID="2a83389f924f26d6323ddc28f0111149cdbfbeaccf468ec38e3677fd06b80fef" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.921740 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:04 crc kubenswrapper[4769]: I1121 12:35:04.927341 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:14 crc kubenswrapper[4769]: I1121 12:35:14.148237 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:35:17 crc kubenswrapper[4769]: I1121 12:35:17.712505 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:35:17 crc kubenswrapper[4769]: I1121 12:35:17.713330 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="f0aaaf62-6314-4f0c-a148-78659ed61770" containerName="openstackclient" containerID="cri-o://84a1cbe96aa3f72c3321d6be9f0d078272780d29aa0a9773789cb1865a6c9304" gracePeriod=2 Nov 21 12:35:17 crc kubenswrapper[4769]: I1121 12:35:17.740844 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.037479 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.131091 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.131753 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="openstack-network-exporter" containerID="cri-o://bcfed6b744a320ad393ec69b87b575dd1b2328687fc0135a0a2b971f19291e75" gracePeriod=300 Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.179081 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw"] Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.179497 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0aaaf62-6314-4f0c-a148-78659ed61770" containerName="openstackclient" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.179511 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0aaaf62-6314-4f0c-a148-78659ed61770" containerName="openstackclient" Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.192381 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.192432 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data podName:f24e626c-11ec-4d3d-a065-822b13a8b8b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:18.692418876 +0000 UTC m=+2677.393080694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data") pod "rabbitmq-server-0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0") : configmap "rabbitmq-config-data" not found Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.201644 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0aaaf62-6314-4f0c-a148-78659ed61770" containerName="openstackclient" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.202387 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.234774 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw"] Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.263321 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance042f-account-delete-s5zpr"] Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.264929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.293455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p72\" (UniqueName: \"kubernetes.io/projected/311dff41-2849-4530-8dfd-c566e4ad5859-kube-api-access-75p72\") pod \"glance042f-account-delete-s5zpr\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.293553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/311dff41-2849-4530-8dfd-c566e4ad5859-operator-scripts\") pod \"glance042f-account-delete-s5zpr\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.293649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-operator-scripts\") pod \"barbicane5ba-account-delete-bcnkw\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:18 crc kubenswrapper[4769]: I1121 12:35:18.293680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4lpr\" (UniqueName: \"kubernetes.io/projected/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-kube-api-access-z4lpr\") pod \"barbicane5ba-account-delete-bcnkw\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.294408 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.294445 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:18.794432337 +0000 UTC m=+2677.495094155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "combined-ca-bundle" not found Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.295325 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-metric-storage-prometheus-svc: secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:18 crc kubenswrapper[4769]: E1121 12:35:18.295350 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:18.795342442 +0000 UTC m=+2677.496004260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "custom-prometheus-ca" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.304526 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance042f-account-delete-s5zpr"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.352255 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder8099-account-delete-25zgn"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.353593 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.367410 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder8099-account-delete-25zgn"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.376023 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="ovsdbserver-sb" containerID="cri-o://fe8068383cb45a1c204412176239b47c0a9b6fce26638efabeb12b44588f5e0e" gracePeriod=300 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.391290 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvqhh"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.395259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-operator-scripts\") pod \"cinder8099-account-delete-25zgn\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.395343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-operator-scripts\") pod \"barbicane5ba-account-delete-bcnkw\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.395370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z4lpr\" (UniqueName: \"kubernetes.io/projected/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-kube-api-access-z4lpr\") pod \"barbicane5ba-account-delete-bcnkw\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.395630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75p72\" (UniqueName: \"kubernetes.io/projected/311dff41-2849-4530-8dfd-c566e4ad5859-kube-api-access-75p72\") pod \"glance042f-account-delete-s5zpr\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.395687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjhz\" (UniqueName: \"kubernetes.io/projected/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-kube-api-access-jvjhz\") pod \"cinder8099-account-delete-25zgn\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.395713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/311dff41-2849-4530-8dfd-c566e4ad5859-operator-scripts\") pod \"glance042f-account-delete-s5zpr\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.398672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-operator-scripts\") pod \"barbicane5ba-account-delete-bcnkw\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.399348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/311dff41-2849-4530-8dfd-c566e4ad5859-operator-scripts\") pod \"glance042f-account-delete-s5zpr\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.417283 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/watcher89e7-account-delete-6hz9b"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.418627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.427623 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvqhh"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.436920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p72\" (UniqueName: \"kubernetes.io/projected/311dff41-2849-4530-8dfd-c566e4ad5859-kube-api-access-75p72\") pod \"glance042f-account-delete-s5zpr\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.440506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4lpr\" (UniqueName: \"kubernetes.io/projected/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-kube-api-access-z4lpr\") pod \"barbicane5ba-account-delete-bcnkw\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.486350 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher89e7-account-delete-6hz9b"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.492626 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.492870 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" containerID="cri-o://0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.493283 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="openstack-network-exporter" containerID="cri-o://b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.500343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjhz\" (UniqueName: \"kubernetes.io/projected/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-kube-api-access-jvjhz\") pod \"cinder8099-account-delete-25zgn\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.503660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-operator-scripts\") pod \"cinder8099-account-delete-25zgn\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.503797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts\") pod \"watcher89e7-account-delete-6hz9b\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.503967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vllv6\" (UniqueName: \"kubernetes.io/projected/4008318b-1790-42b2-b86e-f1c1919e9da8-kube-api-access-vllv6\") pod \"watcher89e7-account-delete-6hz9b\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.507973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-operator-scripts\") pod \"cinder8099-account-delete-25zgn\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.511280 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zz4kt"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.536733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjhz\" (UniqueName: \"kubernetes.io/projected/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-kube-api-access-jvjhz\") pod \"cinder8099-account-delete-25zgn\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.584107 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.606654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vllv6\" (UniqueName: \"kubernetes.io/projected/4008318b-1790-42b2-b86e-f1c1919e9da8-kube-api-access-vllv6\") pod \"watcher89e7-account-delete-6hz9b\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.606969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts\") pod \"watcher89e7-account-delete-6hz9b\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.614857 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts\") pod \"watcher89e7-account-delete-6hz9b\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.624055 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" probeResult="failure" output=< Nov 21 12:35:19 crc kubenswrapper[4769]: 2025-11-21T12:35:18Z|00001|unixctl|WARN|failed to connect to /tmp/ovn-northd.1.ctl Nov 21 12:35:19 crc kubenswrapper[4769]: ovn-appctl: cannot connect to "/tmp/ovn-northd.1.ctl" (No such file or directory) Nov 21 12:35:19 crc kubenswrapper[4769]: > Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.632297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-zz4kt"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.683730 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vllv6\" (UniqueName: \"kubernetes.io/projected/4008318b-1790-42b2-b86e-f1c1919e9da8-kube-api-access-vllv6\") pod \"watcher89e7-account-delete-6hz9b\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:18.713454 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:18.713544 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data podName:f24e626c-11ec-4d3d-a065-822b13a8b8b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:19.713519117 +0000 UTC m=+2678.414180935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data") pod "rabbitmq-server-0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0") : configmap "rabbitmq-config-data" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.713957 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.715297 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="openstack-network-exporter" containerID="cri-o://fa85e5b9eb24f0969fe3460d2230a6f32841e28c36ac4cad58d44fc10d117b33" gracePeriod=300 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.778491 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutronf206-account-delete-r75nt"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.781137 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:18.819168 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-metric-storage-prometheus-svc: secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:18.819235 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:19.819218777 +0000 UTC m=+2678.519880595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "custom-prometheus-ca" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:18.819273 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:18.819290 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:19.819284709 +0000 UTC m=+2678.519946527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "combined-ca-bundle" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.864274 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronf206-account-delete-r75nt"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.894265 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dqj8s"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.930719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4hrc\" (UniqueName: \"kubernetes.io/projected/48522fa8-1b4a-488d-8912-7ce719f1875f-kube-api-access-h4hrc\") pod \"neutronf206-account-delete-r75nt\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.931143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts\") pod \"neutronf206-account-delete-r75nt\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.944291 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-gskxj"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:18.998926 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-dqj8s"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.053307 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-db-sync-gskxj"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.055141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts\") pod \"neutronf206-account-delete-r75nt\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.055228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h4hrc\" (UniqueName: \"kubernetes.io/projected/48522fa8-1b4a-488d-8912-7ce719f1875f-kube-api-access-h4hrc\") pod \"neutronf206-account-delete-r75nt\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.056900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts\") pod \"neutronf206-account-delete-r75nt\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.080287 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-d9t94"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.132310 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-d9t94"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.133096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4hrc\" (UniqueName: \"kubernetes.io/projected/48522fa8-1b4a-488d-8912-7ce719f1875f-kube-api-access-h4hrc\") pod \"neutronf206-account-delete-r75nt\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.174421 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_358a84ed-d9ff-4fd8-a429-0e1f81b00f43/ovsdbserver-sb/0.log" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.174554 4769 generic.go:334] "Generic (PLEG): container finished" podID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerID="bcfed6b744a320ad393ec69b87b575dd1b2328687fc0135a0a2b971f19291e75" exitCode=2 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.174591 4769 generic.go:334] "Generic (PLEG): container finished" podID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerID="fe8068383cb45a1c204412176239b47c0a9b6fce26638efabeb12b44588f5e0e" exitCode=143 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.174794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358a84ed-d9ff-4fd8-a429-0e1f81b00f43","Type":"ContainerDied","Data":"bcfed6b744a320ad393ec69b87b575dd1b2328687fc0135a0a2b971f19291e75"} Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.174844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358a84ed-d9ff-4fd8-a429-0e1f81b00f43","Type":"ContainerDied","Data":"fe8068383cb45a1c204412176239b47c0a9b6fce26638efabeb12b44588f5e0e"} Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.179496 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.180012 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-central-agent" containerID="cri-o://c2ff59122bb6cd9e227a6756a693dc739789ea1be511555a03dce05ca96b9cf3" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.180359 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="proxy-httpd" containerID="cri-o://664e7d522f736774f797f9eb0e8f08404b82a1004b2192e7bf7e0349ca8b9f4e" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.180439 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-notification-agent" containerID="cri-o://0f09fca4f4d58cf691832977b419e1161c455d86d856d6bd614cf68364aab292" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.180504 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="sg-core" containerID="cri-o://79cf097807ad70143b81a85f5a4633ae1eeabce755f04b365e25a404bde825a6" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.219659 4769 generic.go:334] "Generic (PLEG): container finished" podID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerID="fa85e5b9eb24f0969fe3460d2230a6f32841e28c36ac4cad58d44fc10d117b33" exitCode=2 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.219792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9244abb6-e799-4f0d-9af5-a506ee5c835f","Type":"ContainerDied","Data":"fa85e5b9eb24f0969fe3460d2230a6f32841e28c36ac4cad58d44fc10d117b33"} Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.251479 4769 generic.go:334] "Generic (PLEG): container finished" podID="a769253b-cd90-4510-9310-26a922996a2c" containerID="b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e" exitCode=2 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.251528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a769253b-cd90-4510-9310-26a922996a2c","Type":"ContainerDied","Data":"b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e"} Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.353077 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" probeResult="failure" output=< Nov 21 12:35:19 crc kubenswrapper[4769]: 2025-11-21T12:35:18Z|00001|unixctl|WARN|failed to connect to /tmp/ovn-northd.1.ctl Nov 21 12:35:19 crc kubenswrapper[4769]: ovn-appctl: cannot connect to "/tmp/ovn-northd.1.ctl" (No such file or directory) Nov 21 12:35:19 crc kubenswrapper[4769]: 2025-11-21T12:35:18Z|00001|unixctl|WARN|failed to connect to /tmp/ovn-northd.1.ctl Nov 21 12:35:19 crc kubenswrapper[4769]: ovn-appctl: cannot connect to "/tmp/ovn-northd.1.ctl" (No such file or directory) Nov 21 12:35:19 crc kubenswrapper[4769]: > Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.450674 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1615b03e-2fa0-49c1-a20d-eefe57a232b0" path="/var/lib/kubelet/pods/1615b03e-2fa0-49c1-a20d-eefe57a232b0/volumes" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.451858 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20158e10-be0f-42eb-b98f-6bf53a0e2e83" path="/var/lib/kubelet/pods/20158e10-be0f-42eb-b98f-6bf53a0e2e83/volumes" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.465935 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c045a84-b18c-4a40-864a-3174b38706f4" path="/var/lib/kubelet/pods/3c045a84-b18c-4a40-864a-3174b38706f4/volumes" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.466684 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c7dd89d-4bef-4705-8620-65e04392d17a" path="/var/lib/kubelet/pods/7c7dd89d-4bef-4705-8620-65e04392d17a/volumes" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.467360 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ddf7893-be82-4597-9e80-a652e9daedc1" path="/var/lib/kubelet/pods/8ddf7893-be82-4597-9e80-a652e9daedc1/volumes" Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.492789 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.492880 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0 podName:a1fe319d-547f-4eae-a3cb-3f7f47f8af29 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:19.992862426 +0000 UTC m=+2678.693524244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0") pod "dnsmasq-dnsmasq-7799499c75-q9p8r" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29") : configmap "dns-swift-storage-0" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.499613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.499657 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placementff8c-account-delete-fxnn4"] Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.508360 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9244abb6_e799_4f0d_9af5_a506ee5c835f.slice/crio-conmon-fa85e5b9eb24f0969fe3460d2230a6f32841e28c36ac4cad58d44fc10d117b33.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.508565 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-server" containerID="cri-o://f019d8be557db1f153e7892c0c39a99b8e0635ac7c28aee437df1446567c404b" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509019 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-server" containerID="cri-o://a1b5bd570677920c74854244cfd7f9e8c70a41a3b6778e18c7d5edb92e8865d1" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509055 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-server" containerID="cri-o://1e9eff96dd33dea6fa47a37fdf9fe9785540857c58102274e00a7269903a47f4" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509091 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-reaper" containerID="cri-o://8b1ce8572f04445a01bb6068185ac94889800baa108b2dd6e928e82a227a7c85" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509145 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-updater" containerID="cri-o://f4bf3535ace846275d7269ea413b90e506b094a2ee67414f26edee0c83e47a40" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509203 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-auditor" containerID="cri-o://9741de62dc82c24266d38705c08765ede152139885bfd61fc0ff6146c633735d" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509215 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-auditor" containerID="cri-o://e353e45d3f55e0d1979aad889a57f00db327e26732a94b9699b9e72bc65fc225" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509239 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-replicator" containerID="cri-o://3e3476c9a96cb0b50309aeb5f761175f6ebf06724b11037154f42ebfe53afd6f" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509294 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="swift-recon-cron" containerID="cri-o://f403be3ce48985d69538737b6ffdcfbd0673bc116d4f3185b44449310fda1ccd" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509305 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-replicator" containerID="cri-o://bf3e347f273318f3f15293a4356f84a0f9bd2b4ea8727e9573419550831b6187" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509312 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-updater" containerID="cri-o://2d10be3132dcf1cd9fa4028e5cb2d86dbfaadf86cc548f90ee41bb79d24ed971" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509353 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="rsync" containerID="cri-o://a11d6914dac88a945153d4101f699a1126b4a1c0cfa9384233ff13589a6af179" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509377 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-replicator" containerID="cri-o://09c152a70de95d408fa2d1e62bd295e12eff93b04fda5707e6d786bbce57fa01" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509388 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-expirer" containerID="cri-o://3dc658ddd734c741c356918a825b1583cd250f9273845f9bd38a3c742c4d85a8" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.509464 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-auditor" containerID="cri-o://666e126b826f5c1d1979e541c9388be5da81dcbcc8cd779ec1496db988e7e9d6" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.512670 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementff8c-account-delete-fxnn4"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.512784 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.540329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-8k9kv"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.587534 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-8k9kv"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.606324 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.688074 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zzptb"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.693170 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.714983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8qs\" (UniqueName: \"kubernetes.io/projected/4bfd5314-6358-4789-a76f-a12e61bca8a4-kube-api-access-mz8qs\") pod \"placementff8c-account-delete-fxnn4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.715108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bfd5314-6358-4789-a76f-a12e61bca8a4-operator-scripts\") pod \"placementff8c-account-delete-fxnn4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.715438 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.715501 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data podName:f24e626c-11ec-4d3d-a065-822b13a8b8b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:21.715480357 +0000 UTC m=+2680.416142245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data") pod "rabbitmq-server-0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0") : configmap "rabbitmq-config-data" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.758372 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zzptb"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.803215 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="ovsdbserver-nb" containerID="cri-o://85ab8e383f1be4f2724b5cb3872fcffdaba8dd7aac8c76ee6bf8a299ab75d745" gracePeriod=299 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.819310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bfd5314-6358-4789-a76f-a12e61bca8a4-operator-scripts\") pod \"placementff8c-account-delete-fxnn4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.819480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8qs\" (UniqueName: \"kubernetes.io/projected/4bfd5314-6358-4789-a76f-a12e61bca8a4-kube-api-access-mz8qs\") pod \"placementff8c-account-delete-fxnn4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.829388 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.829853 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:21.82982571 +0000 UTC m=+2680.530487588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "combined-ca-bundle" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.830763 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.831035 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-log" containerID="cri-o://2d7cfcead7b2b655d207c20f2bb7c59fe5d71759ecb364efbb0f6f511c42a0b9" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.831165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bfd5314-6358-4789-a76f-a12e61bca8a4-operator-scripts\") pod \"placementff8c-account-delete-fxnn4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.831524 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-httpd" containerID="cri-o://1abc6243c2532e88080e789ebe5e6e7fb69daba8348613143615ae943993df67" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.863927 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b77df46b6-njhcp"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.864373 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-api" containerID="cri-o://433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.864812 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-httpd" containerID="cri-o://1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.928613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.928893 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="cinder-scheduler" containerID="cri-o://15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.929247 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="probe" containerID="cri-o://2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.940382 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell11c71-account-delete-2cs4f"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.942178 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.953304 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-metric-storage-prometheus-svc: secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:19 crc kubenswrapper[4769]: E1121 12:35:19.953384 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:21.953365139 +0000 UTC m=+2680.654026957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "custom-prometheus-ca" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.957712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8qs\" (UniqueName: \"kubernetes.io/projected/4bfd5314-6358-4789-a76f-a12e61bca8a4-kube-api-access-mz8qs\") pod \"placementff8c-account-delete-fxnn4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.991613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.991954 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-log" containerID="cri-o://4bf31c2bf2bebb7001eaf66f396a43bfa310d34cbd6d3a17fe6833606f933742" gracePeriod=30 Nov 21 12:35:19 crc kubenswrapper[4769]: I1121 12:35:19.992122 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-httpd" containerID="cri-o://07ade9dcc929a836a885d01ae6862ab0c3432ac6d40b218c509b28428435976b" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.045920 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell11c71-account-delete-2cs4f"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.062590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/390a92a7-1cdc-481a-8718-fc0bd7f12d73-operator-scripts\") pod \"novacell11c71-account-delete-2cs4f\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.062797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw5vw\" (UniqueName: \"kubernetes.io/projected/390a92a7-1cdc-481a-8718-fc0bd7f12d73-kube-api-access-dw5vw\") pod \"novacell11c71-account-delete-2cs4f\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:20 crc kubenswrapper[4769]: E1121 12:35:20.063071 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Nov 21 12:35:20 crc kubenswrapper[4769]: E1121 12:35:20.063115 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0 podName:a1fe319d-547f-4eae-a3cb-3f7f47f8af29 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:21.063100008 +0000 UTC m=+2679.763761826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0") pod "dnsmasq-dnsmasq-7799499c75-q9p8r" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29") : configmap "dns-swift-storage-0" not found Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.110694 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.110996 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api-log" containerID="cri-o://b9714013a9d9c36f5790c7927330bdcdbdb1247efaba98f65df513d451a4ddd3" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.111513 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api" containerID="cri-o://c2e35c65ee3281a8868c169717e85e16448db47322ae56d14fb755ce2df5fd31" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.149401 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.150128 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener-log" containerID="cri-o://2e8a55a9fd3d9c773ecc16615d57098e71c74ba81f02ba76ae17d2744bc3ff9f" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.150622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener" containerID="cri-o://30dfb140d9e8887836ba42cd44a7ee5b669d5d2d55d486ec52a4ea40f065a45b" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.169504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/390a92a7-1cdc-481a-8718-fc0bd7f12d73-operator-scripts\") pod \"novacell11c71-account-delete-2cs4f\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.171911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/390a92a7-1cdc-481a-8718-fc0bd7f12d73-operator-scripts\") pod \"novacell11c71-account-delete-2cs4f\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.176751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dw5vw\" (UniqueName: \"kubernetes.io/projected/390a92a7-1cdc-481a-8718-fc0bd7f12d73-kube-api-access-dw5vw\") pod \"novacell11c71-account-delete-2cs4f\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.198662 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi34da-account-delete-r8hgm"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.200553 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.222952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw5vw\" (UniqueName: \"kubernetes.io/projected/390a92a7-1cdc-481a-8718-fc0bd7f12d73-kube-api-access-dw5vw\") pod \"novacell11c71-account-delete-2cs4f\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.223021 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6c9bd6f466-wzz6c"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.223321 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-log" containerID="cri-o://1fdef3e6e93388772337b720e9298d8a88b15167af782f94c037331ba1452593" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.223460 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-api" containerID="cri-o://b17b8e96729770d76315fddd7ecd4a7f0e5003295d85b39ac30e920ed433ac79" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.230559 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.230860 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-applier-0" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerName="watcher-applier" containerID="cri-o://213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.248674 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.249046 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="6dc4e7b0-25bf-4452-9e52-b03e773e485a" containerName="kube-state-metrics" containerID="cri-o://488b43b9d46ff3515b43b1f98135f48ab4e191939f47e94d7a737aa8bb72ff66" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.296645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zzmn\" (UniqueName: \"kubernetes.io/projected/0fe07eae-a4cd-49b4-b340-98c22fee11f8-kube-api-access-8zzmn\") pod \"novaapi34da-account-delete-r8hgm\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.296745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fe07eae-a4cd-49b4-b340-98c22fee11f8-operator-scripts\") pod \"novaapi34da-account-delete-r8hgm\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.332701 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.333154 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api-log" containerID="cri-o://7a61d42d53c7a5001181881ba7c9957c7c38c404d61460362a434aaf1d326d06" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.333948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-api-0" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api" containerID="cri-o://97513b514876280e1e80fe5e0696d9edf096c20ec2eb3eac3602c5016731f05f" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.386067 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.403983 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.409217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8zzmn\" (UniqueName: \"kubernetes.io/projected/0fe07eae-a4cd-49b4-b340-98c22fee11f8-kube-api-access-8zzmn\") pod \"novaapi34da-account-delete-r8hgm\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.409846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fe07eae-a4cd-49b4-b340-98c22fee11f8-operator-scripts\") pod \"novaapi34da-account-delete-r8hgm\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.411929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fe07eae-a4cd-49b4-b340-98c22fee11f8-operator-scripts\") pod \"novaapi34da-account-delete-r8hgm\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.432569 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi34da-account-delete-r8hgm"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.439871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zzmn\" (UniqueName: \"kubernetes.io/projected/0fe07eae-a4cd-49b4-b340-98c22fee11f8-kube-api-access-8zzmn\") pod \"novaapi34da-account-delete-r8hgm\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.456548 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell0705a-account-delete-gtvls"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.460992 4769 generic.go:334] "Generic (PLEG): container finished" podID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerID="79cf097807ad70143b81a85f5a4633ae1eeabce755f04b365e25a404bde825a6" exitCode=2 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.462229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerDied","Data":"79cf097807ad70143b81a85f5a4633ae1eeabce755f04b365e25a404bde825a6"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.462577 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.484599 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerID="b9714013a9d9c36f5790c7927330bdcdbdb1247efaba98f65df513d451a4ddd3" exitCode=143 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.484660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c41b549-737e-4157-bbd6-e049ab34a8e4","Type":"ContainerDied","Data":"b9714013a9d9c36f5790c7927330bdcdbdb1247efaba98f65df513d451a4ddd3"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.489261 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0aaaf62-6314-4f0c-a148-78659ed61770" containerID="84a1cbe96aa3f72c3321d6be9f0d078272780d29aa0a9773789cb1865a6c9304" exitCode=137 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.500859 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505340 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="a11d6914dac88a945153d4101f699a1126b4a1c0cfa9384233ff13589a6af179" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505365 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="3dc658ddd734c741c356918a825b1583cd250f9273845f9bd38a3c742c4d85a8" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505376 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="2d10be3132dcf1cd9fa4028e5cb2d86dbfaadf86cc548f90ee41bb79d24ed971" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505384 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="666e126b826f5c1d1979e541c9388be5da81dcbcc8cd779ec1496db988e7e9d6" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505390 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="09c152a70de95d408fa2d1e62bd295e12eff93b04fda5707e6d786bbce57fa01" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505399 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="f4bf3535ace846275d7269ea413b90e506b094a2ee67414f26edee0c83e47a40" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505406 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="9741de62dc82c24266d38705c08765ede152139885bfd61fc0ff6146c633735d" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505412 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="3e3476c9a96cb0b50309aeb5f761175f6ebf06724b11037154f42ebfe53afd6f" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505419 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="8b1ce8572f04445a01bb6068185ac94889800baa108b2dd6e928e82a227a7c85" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505427 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="e353e45d3f55e0d1979aad889a57f00db327e26732a94b9699b9e72bc65fc225" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505434 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="bf3e347f273318f3f15293a4356f84a0f9bd2b4ea8727e9573419550831b6187" exitCode=0 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"a11d6914dac88a945153d4101f699a1126b4a1c0cfa9384233ff13589a6af179"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505491 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"3dc658ddd734c741c356918a825b1583cd250f9273845f9bd38a3c742c4d85a8"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"2d10be3132dcf1cd9fa4028e5cb2d86dbfaadf86cc548f90ee41bb79d24ed971"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"666e126b826f5c1d1979e541c9388be5da81dcbcc8cd779ec1496db988e7e9d6"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"09c152a70de95d408fa2d1e62bd295e12eff93b04fda5707e6d786bbce57fa01"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"f4bf3535ace846275d7269ea413b90e506b094a2ee67414f26edee0c83e47a40"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"9741de62dc82c24266d38705c08765ede152139885bfd61fc0ff6146c633735d"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"3e3476c9a96cb0b50309aeb5f761175f6ebf06724b11037154f42ebfe53afd6f"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"8b1ce8572f04445a01bb6068185ac94889800baa108b2dd6e928e82a227a7c85"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"e353e45d3f55e0d1979aad889a57f00db327e26732a94b9699b9e72bc65fc225"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.505580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"bf3e347f273318f3f15293a4356f84a0f9bd2b4ea8727e9573419550831b6187"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.511047 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-597gk"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.513129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.515765 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9244abb6-e799-4f0d-9af5-a506ee5c835f/ovsdbserver-nb/0.log" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.515862 4769 generic.go:334] "Generic (PLEG): container finished" podID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerID="85ab8e383f1be4f2724b5cb3872fcffdaba8dd7aac8c76ee6bf8a299ab75d745" exitCode=143 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.516068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9244abb6-e799-4f0d-9af5-a506ee5c835f","Type":"ContainerDied","Data":"85ab8e383f1be4f2724b5cb3872fcffdaba8dd7aac8c76ee6bf8a299ab75d745"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.520578 4769 generic.go:334] "Generic (PLEG): container finished" podID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerID="2e8a55a9fd3d9c773ecc16615d57098e71c74ba81f02ba76ae17d2744bc3ff9f" exitCode=143 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.520648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" event={"ID":"c3e12002-b8fa-4005-8e29-a5259652a4c6","Type":"ContainerDied","Data":"2e8a55a9fd3d9c773ecc16615d57098e71c74ba81f02ba76ae17d2744bc3ff9f"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.521760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5878be-4791-4c35-87de-cdf379804fe5-operator-scripts\") pod \"novacell0705a-account-delete-gtvls\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.521842 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.522026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvbl\" (UniqueName: \"kubernetes.io/projected/7c5878be-4791-4c35-87de-cdf379804fe5-kube-api-access-tjvbl\") pod \"novacell0705a-account-delete-gtvls\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.522129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxkzp\" (UniqueName: \"kubernetes.io/projected/18dea187-c7dd-4482-83ea-9c36d754313d-kube-api-access-nxkzp\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.522410 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-597gk"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.523629 4769 generic.go:334] "Generic (PLEG): container finished" podID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerID="2d7cfcead7b2b655d207c20f2bb7c59fe5d71759ecb364efbb0f6f511c42a0b9" exitCode=143 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.523675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c194df7b-a418-440d-a1a6-5772c7ed5b32","Type":"ContainerDied","Data":"2d7cfcead7b2b655d207c20f2bb7c59fe5d71759ecb364efbb0f6f511c42a0b9"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.533376 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0705a-account-delete-gtvls"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.539165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9","Type":"ContainerDied","Data":"4bf31c2bf2bebb7001eaf66f396a43bfa310d34cbd6d3a17fe6833606f933742"} Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.539110 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerID="4bf31c2bf2bebb7001eaf66f396a43bfa310d34cbd6d3a17fe6833606f933742" exitCode=143 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.561849 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.565933 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-2m6j8"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.586036 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.586322 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher-decision-engine-0" podUID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" containerName="watcher-decision-engine" containerID="cri-o://7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.616384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.617040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api-log" containerID="cri-o://86b979769740240320ed7602b5e8a14671a912556e0456270c560fd52bb93976" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.618128 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api" containerID="cri-o://855c5c5b3f89891e0167433c824f2882fafb494b412c2ad789adb40a31298fb5" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.625896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.626028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5878be-4791-4c35-87de-cdf379804fe5-operator-scripts\") pod \"novacell0705a-account-delete-gtvls\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.626063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.626119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvbl\" (UniqueName: \"kubernetes.io/projected/7c5878be-4791-4c35-87de-cdf379804fe5-kube-api-access-tjvbl\") pod \"novacell0705a-account-delete-gtvls\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.626166 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nxkzp\" (UniqueName: \"kubernetes.io/projected/18dea187-c7dd-4482-83ea-9c36d754313d-kube-api-access-nxkzp\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.627625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.628472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.628673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5878be-4791-4c35-87de-cdf379804fe5-operator-scripts\") pod \"novacell0705a-account-delete-gtvls\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.652679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvbl\" (UniqueName: \"kubernetes.io/projected/7c5878be-4791-4c35-87de-cdf379804fe5-kube-api-access-tjvbl\") pod \"novacell0705a-account-delete-gtvls\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.652820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxkzp\" (UniqueName: \"kubernetes.io/projected/18dea187-c7dd-4482-83ea-9c36d754313d-kube-api-access-nxkzp\") pod \"dnsmasq-dnsmasq-84b9f45d47-6rm6c\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.664625 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.665104 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker-log" containerID="cri-o://61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.666273 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker" containerID="cri-o://3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: E1121 12:35:20.702586 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Nov 21 12:35:20 crc kubenswrapper[4769]: E1121 12:35:20.712333 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Nov 21 12:35:20 crc kubenswrapper[4769]: E1121 12:35:20.718642 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Nov 21 12:35:20 crc kubenswrapper[4769]: E1121 12:35:20.719232 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/watcher-applier-0" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerName="watcher-applier" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.726852 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.727105 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-log" containerID="cri-o://eddab7b09b2976c9d088ec264af8d57d4e3360a15360ce1fb1ce3dd2764ea451" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.727549 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-api" containerID="cri-o://907734f25feb7bfe17eda559c00541441bbc1acb0becb4a66c683c2ea04dcfb6" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.745901 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.772547 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.773229 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" containerID="cri-o://915f4bcd9c6149ea9f5f50cc8ac6932c8c52ffc2f91b97b5209b3cfd6cfe2593" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.773472 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" containerID="cri-o://652ca03c5ad58ceec7e88a3e5377a0554ef8b8df704a0b00b5b5e9a203f423ea" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.793420 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.793683 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerName="nova-cell1-conductor-conductor" containerID="cri-o://efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.812335 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.812425 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.12:8775/\": EOF" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.815009 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.12:8775/\": EOF" Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.827287 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-s9kbf"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.837077 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerName="rabbitmq" containerID="cri-o://cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87" gracePeriod=604800 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.847515 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.860503 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.860856 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="prometheus" containerID="cri-o://4be28df0047f0e9c1f4afba338f0e598149a1c05711d86e78a3c72f0e7b89616" gracePeriod=600 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.860975 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="thanos-sidecar" containerID="cri-o://f1a03cb356b42d3fe0a8443af51a3eacc2a84e5d1de42ee9a9ded91eaab486d7" gracePeriod=600 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.861003 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/prometheus-metric-storage-0" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="config-reloader" containerID="cri-o://279cb429f401675d3ac72bf3596f54e95cc544a0d649f24ae33dc1e13e0c94dc" gracePeriod=600 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.884159 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-5r6h7"] Nov 21 12:35:20 crc kubenswrapper[4769]: W1121 12:35:20.890570 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18e7dc87_de3f_4bcb_99c8_d4f2830ad7e3.slice/crio-fc212ee21dbe8fd216eb92b654350ec770f171e07e9a187e8b442c3548942a3c WatchSource:0}: Error finding container fc212ee21dbe8fd216eb92b654350ec770f171e07e9a187e8b442c3548942a3c: Status 404 returned error can't find the container with id fc212ee21dbe8fd216eb92b654350ec770f171e07e9a187e8b442c3548942a3c Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.901257 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.901693 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="alertmanager" containerID="cri-o://2ee8ae0ab58869ce6d574b44a553bb6ca4dc7a97657715758c66332cc907ab94" gracePeriod=120 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.902373 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="config-reloader" containerID="cri-o://5ea3bf3fda6e155a0b41039aeb02470563831f848c3bc161c5fb92bd78631660" gracePeriod=120 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.923804 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.924039 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="11f66499-aa3b-4400-a0fa-a059a70e64bf" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://e9e603d6453feda077fbf42ee33ef94fd1e1390ebd478221377ade9874c3af33" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.950337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.956215 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.956442 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" containerName="nova-scheduler-scheduler" containerID="cri-o://26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" gracePeriod=30 Nov 21 12:35:20 crc kubenswrapper[4769]: I1121 12:35:20.986071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.006053 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.038782 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.054864 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder8099-account-delete-25zgn"] Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.058533 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.072707 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.095997 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.122780 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.159844 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.159947 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0 podName:a1fe319d-547f-4eae-a3cb-3f7f47f8af29 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:23.159922747 +0000 UTC m=+2681.860584565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0") pod "dnsmasq-dnsmasq-7799499c75-q9p8r" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29") : configmap "dns-swift-storage-0" not found Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.162839 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance042f-account-delete-s5zpr"] Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.169792 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_358a84ed-d9ff-4fd8-a429-0e1f81b00f43/ovsdbserver-sb/0.log" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.169871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.170941 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" cmd=["/usr/bin/pgrep","-f","-r","DRST","watcher-decision-engine"] Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.185536 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8697448848-f5nl9"] Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.185784 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-httpd" containerID="cri-o://c81dc3670c42744300b003086b20e18f10b028bb729547f20f603a2570a3aca0" gracePeriod=30 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.185927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-server" containerID="cri-o://f4f2ff038032497d9764ee4609ac54b083fd4e4edf2e7ce0cd8684840505c2cc" gracePeriod=30 Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.187021 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" cmd=["/usr/bin/pgrep","-f","-r","DRST","watcher-decision-engine"] Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.271942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-metrics-certs-tls-certs\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.273160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-config\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.273266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdb-rundir\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.273589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.273840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-combined-ca-bundle\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.273931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp9q5\" (UniqueName: \"kubernetes.io/projected/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-kube-api-access-qp9q5\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.274013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdbserver-sb-tls-certs\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.274066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-scripts\") pod \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\" (UID: \"358a84ed-d9ff-4fd8-a429-0e1f81b00f43\") " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.275226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-config" (OuterVolumeSpecName: "config") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.275860 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.276342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-scripts" (OuterVolumeSpecName: "scripts") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.285201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.287472 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" cmd=["/usr/bin/pgrep","-f","-r","DRST","watcher-decision-engine"] Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.287534 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/watcher-decision-engine-0" podUID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" containerName="watcher-decision-engine" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.295929 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08fab2f9-d6a5-4ebf-a286-1cf47fb559ab" path="/var/lib/kubelet/pods/08fab2f9-d6a5-4ebf-a286-1cf47fb559ab/volumes" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.296518 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0" path="/var/lib/kubelet/pods/3ad342ab-e6e5-4a5d-a8b7-b2c0ee6ecba0/volumes" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.297031 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409a2337-3898-48e1-b78a-1f60112aa414" path="/var/lib/kubelet/pods/409a2337-3898-48e1-b78a-1f60112aa414/volumes" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.298069 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b907e1e-12df-47ff-8f31-f90226941ce9" path="/var/lib/kubelet/pods/5b907e1e-12df-47ff-8f31-f90226941ce9/volumes" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.298728 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c3a557-036a-4711-b082-e7b6521e83b3" path="/var/lib/kubelet/pods/96c3a557-036a-4711-b082-e7b6521e83b3/volumes" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.299255 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a720a5b9-eab6-4caa-a3fd-ab282bd68eb8" path="/var/lib/kubelet/pods/a720a5b9-eab6-4caa-a3fd-ab282bd68eb8/volumes" Nov 21 12:35:21 crc kubenswrapper[4769]: W1121 12:35:21.313879 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc5d568f_b5f7_4ef0_bc61_6ff2057e392f.slice/crio-ea08e75cf191d391188e38108c8dc07e7a126959115b2f80279938b13d26f5bc WatchSource:0}: Error finding container ea08e75cf191d391188e38108c8dc07e7a126959115b2f80279938b13d26f5bc: Status 404 returned error can't find the container with id ea08e75cf191d391188e38108c8dc07e7a126959115b2f80279938b13d26f5bc Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.379442 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.379468 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.384049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.384449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-kube-api-access-qp9q5" (OuterVolumeSpecName: "kube-api-access-qp9q5") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "kube-api-access-qp9q5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.396949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.490058 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.490089 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.490103 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qp9q5\" (UniqueName: \"kubernetes.io/projected/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-kube-api-access-qp9q5\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.508176 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.538771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "358a84ed-d9ff-4fd8-a429-0e1f81b00f43" (UID: "358a84ed-d9ff-4fd8-a429-0e1f81b00f43"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.574585 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.592574 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.592599 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.592610 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358a84ed-d9ff-4fd8-a429-0e1f81b00f43-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.638101 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerID="c81dc3670c42744300b003086b20e18f10b028bb729547f20f603a2570a3aca0" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.638202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" event={"ID":"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f","Type":"ContainerDied","Data":"c81dc3670c42744300b003086b20e18f10b028bb729547f20f603a2570a3aca0"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.668586 4769 generic.go:334] "Generic (PLEG): container finished" podID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerID="7a61d42d53c7a5001181881ba7c9957c7c38c404d61460362a434aaf1d326d06" exitCode=143 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.668675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"4347fb32-914b-4f7d-b004-fbf9f37ad56a","Type":"ContainerDied","Data":"7a61d42d53c7a5001181881ba7c9957c7c38c404d61460362a434aaf1d326d06"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.691155 4769 generic.go:334] "Generic (PLEG): container finished" podID="11f66499-aa3b-4400-a0fa-a059a70e64bf" containerID="e9e603d6453feda077fbf42ee33ef94fd1e1390ebd478221377ade9874c3af33" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.691310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"11f66499-aa3b-4400-a0fa-a059a70e64bf","Type":"ContainerDied","Data":"e9e603d6453feda077fbf42ee33ef94fd1e1390ebd478221377ade9874c3af33"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.706900 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerID="1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.706968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" event={"ID":"8b184f71-6fcc-461e-902d-ec67e4abf4a2","Type":"ContainerDied","Data":"1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.750391 4769 generic.go:334] "Generic (PLEG): container finished" podID="30133c6e-1e49-4adb-b996-03816171b3d8" containerID="61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e" exitCode=143 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.750481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" event={"ID":"30133c6e-1e49-4adb-b996-03816171b3d8","Type":"ContainerDied","Data":"61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e"} Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.750706 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.754992 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.757342 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.757401 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" containerName="nova-scheduler-scheduler" Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.798021 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.798080 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data podName:f24e626c-11ec-4d3d-a065-822b13a8b8b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:25.798065943 +0000 UTC m=+2684.498727761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data") pod "rabbitmq-server-0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0") : configmap "rabbitmq-config-data" not found Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.800655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" event={"ID":"311dff41-2849-4530-8dfd-c566e4ad5859","Type":"ContainerStarted","Data":"6491a18dc6dace7470fa33f1a15091a2c59e2ae699f185a45e1bdfe4809561be"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.855894 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="1e9eff96dd33dea6fa47a37fdf9fe9785540857c58102274e00a7269903a47f4" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.856019 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="a1b5bd570677920c74854244cfd7f9e8c70a41a3b6778e18c7d5edb92e8865d1" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.856056 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="f019d8be557db1f153e7892c0c39a99b8e0635ac7c28aee437df1446567c404b" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.856174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"1e9eff96dd33dea6fa47a37fdf9fe9785540857c58102274e00a7269903a47f4"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.856235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"a1b5bd570677920c74854244cfd7f9e8c70a41a3b6778e18c7d5edb92e8865d1"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.856250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"f019d8be557db1f153e7892c0c39a99b8e0635ac7c28aee437df1446567c404b"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.860338 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9244abb6-e799-4f0d-9af5-a506ee5c835f/ovsdbserver-nb/0.log" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.860607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9244abb6-e799-4f0d-9af5-a506ee5c835f","Type":"ContainerDied","Data":"7c92f54b21f0e98d5dfaa049c5522c2e9cd6e39080a58f50d8bb9ee5cccac94f"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.860750 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c92f54b21f0e98d5dfaa049c5522c2e9cd6e39080a58f50d8bb9ee5cccac94f" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.869228 4769 generic.go:334] "Generic (PLEG): container finished" podID="6dc4e7b0-25bf-4452-9e52-b03e773e485a" containerID="488b43b9d46ff3515b43b1f98135f48ab4e191939f47e94d7a737aa8bb72ff66" exitCode=2 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.869314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6dc4e7b0-25bf-4452-9e52-b03e773e485a","Type":"ContainerDied","Data":"488b43b9d46ff3515b43b1f98135f48ab4e191939f47e94d7a737aa8bb72ff66"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.876867 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerID="915f4bcd9c6149ea9f5f50cc8ac6932c8c52ffc2f91b97b5209b3cfd6cfe2593" exitCode=143 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.876906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b","Type":"ContainerDied","Data":"915f4bcd9c6149ea9f5f50cc8ac6932c8c52ffc2f91b97b5209b3cfd6cfe2593"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.879482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" event={"ID":"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f","Type":"ContainerStarted","Data":"ea08e75cf191d391188e38108c8dc07e7a126959115b2f80279938b13d26f5bc"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.881673 4769 generic.go:334] "Generic (PLEG): container finished" podID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerID="f1a03cb356b42d3fe0a8443af51a3eacc2a84e5d1de42ee9a9ded91eaab486d7" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.881690 4769 generic.go:334] "Generic (PLEG): container finished" podID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerID="279cb429f401675d3ac72bf3596f54e95cc544a0d649f24ae33dc1e13e0c94dc" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.881697 4769 generic.go:334] "Generic (PLEG): container finished" podID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerID="4be28df0047f0e9c1f4afba338f0e598149a1c05711d86e78a3c72f0e7b89616" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.881731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerDied","Data":"f1a03cb356b42d3fe0a8443af51a3eacc2a84e5d1de42ee9a9ded91eaab486d7"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.881746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerDied","Data":"279cb429f401675d3ac72bf3596f54e95cc544a0d649f24ae33dc1e13e0c94dc"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.881757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerDied","Data":"4be28df0047f0e9c1f4afba338f0e598149a1c05711d86e78a3c72f0e7b89616"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.883712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" event={"ID":"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3","Type":"ContainerStarted","Data":"913cd7871484cf964f780578405195a1af0ad1f375dcd0d6826245f32528c973"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.883781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" event={"ID":"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3","Type":"ContainerStarted","Data":"fc212ee21dbe8fd216eb92b654350ec770f171e07e9a187e8b442c3548942a3c"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.888125 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerID="1fdef3e6e93388772337b720e9298d8a88b15167af782f94c037331ba1452593" exitCode=143 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.888257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" event={"ID":"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090","Type":"ContainerDied","Data":"1fdef3e6e93388772337b720e9298d8a88b15167af782f94c037331ba1452593"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.890938 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_358a84ed-d9ff-4fd8-a429-0e1f81b00f43/ovsdbserver-sb/0.log" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.890991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358a84ed-d9ff-4fd8-a429-0e1f81b00f43","Type":"ContainerDied","Data":"c70fa7196f0297d266d3d14ad6e898d726b5e97dedf26a4e3bb229425e3a00ad"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.891017 4769 scope.go:117] "RemoveContainer" containerID="bcfed6b744a320ad393ec69b87b575dd1b2328687fc0135a0a2b971f19291e75" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.891141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.916076 4769 generic.go:334] "Generic (PLEG): container finished" podID="d1356b93-35d5-4255-910a-e18282520848" containerID="2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.917238 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:35:21 crc kubenswrapper[4769]: E1121 12:35:21.917339 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:25.917321458 +0000 UTC m=+2684.617983276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "combined-ca-bundle" not found Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.923893 4769 generic.go:334] "Generic (PLEG): container finished" podID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerID="5ea3bf3fda6e155a0b41039aeb02470563831f848c3bc161c5fb92bd78631660" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.923926 4769 generic.go:334] "Generic (PLEG): container finished" podID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerID="2ee8ae0ab58869ce6d574b44a553bb6ca4dc7a97657715758c66332cc907ab94" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.931003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d1356b93-35d5-4255-910a-e18282520848","Type":"ContainerDied","Data":"2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.931074 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerDied","Data":"5ea3bf3fda6e155a0b41039aeb02470563831f848c3bc161c5fb92bd78631660"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.931145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerDied","Data":"2ee8ae0ab58869ce6d574b44a553bb6ca4dc7a97657715758c66332cc907ab94"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.944220 4769 generic.go:334] "Generic (PLEG): container finished" podID="78615e61-bc82-4c5d-baae-192881b1180c" containerID="eddab7b09b2976c9d088ec264af8d57d4e3360a15360ce1fb1ce3dd2764ea451" exitCode=143 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.944372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"78615e61-bc82-4c5d-baae-192881b1180c","Type":"ContainerDied","Data":"eddab7b09b2976c9d088ec264af8d57d4e3360a15360ce1fb1ce3dd2764ea451"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.998683 4769 generic.go:334] "Generic (PLEG): container finished" podID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerID="664e7d522f736774f797f9eb0e8f08404b82a1004b2192e7bf7e0349ca8b9f4e" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.998719 4769 generic.go:334] "Generic (PLEG): container finished" podID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerID="c2ff59122bb6cd9e227a6756a693dc739789ea1be511555a03dce05ca96b9cf3" exitCode=0 Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.998789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerDied","Data":"664e7d522f736774f797f9eb0e8f08404b82a1004b2192e7bf7e0349ca8b9f4e"} Nov 21 12:35:21 crc kubenswrapper[4769]: I1121 12:35:21.998818 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerDied","Data":"c2ff59122bb6cd9e227a6756a693dc739789ea1be511555a03dce05ca96b9cf3"} Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.014100 4769 generic.go:334] "Generic (PLEG): container finished" podID="f733c362-4230-41b3-92d3-dab29b01fc70" containerID="86b979769740240320ed7602b5e8a14671a912556e0456270c560fd52bb93976" exitCode=143 Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.014161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" event={"ID":"f733c362-4230-41b3-92d3-dab29b01fc70","Type":"ContainerDied","Data":"86b979769740240320ed7602b5e8a14671a912556e0456270c560fd52bb93976"} Nov 21 12:35:22 crc kubenswrapper[4769]: E1121 12:35:22.018708 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-metric-storage-prometheus-svc: secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:22 crc kubenswrapper[4769]: E1121 12:35:22.018796 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:26.018778644 +0000 UTC m=+2684.719440462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "custom-prometheus-ca" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.091454 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9244abb6-e799-4f0d-9af5-a506ee5c835f/ovsdbserver-nb/0.log" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.092049 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.122345 4769 scope.go:117] "RemoveContainer" containerID="fe8068383cb45a1c204412176239b47c0a9b6fce26638efabeb12b44588f5e0e" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.135042 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.164057 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.172976 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdb-rundir\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x747\" (UniqueName: \"kubernetes.io/projected/f0aaaf62-6314-4f0c-a148-78659ed61770-kube-api-access-2x747\") pod \"f0aaaf62-6314-4f0c-a148-78659ed61770\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-scripts\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkjfs\" (UniqueName: \"kubernetes.io/projected/9244abb6-e799-4f0d-9af5-a506ee5c835f-kube-api-access-gkjfs\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-combined-ca-bundle\") pod \"f0aaaf62-6314-4f0c-a148-78659ed61770\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret\") pod \"f0aaaf62-6314-4f0c-a148-78659ed61770\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-certs\") pod \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-config\") pod \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-combined-ca-bundle\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-config\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdbserver-nb-tls-certs\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-metrics-certs-tls-certs\") pod \"9244abb6-e799-4f0d-9af5-a506ee5c835f\" (UID: \"9244abb6-e799-4f0d-9af5-a506ee5c835f\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.222974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config\") pod \"f0aaaf62-6314-4f0c-a148-78659ed61770\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.223025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm55r\" (UniqueName: \"kubernetes.io/projected/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-api-access-wm55r\") pod \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.223064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-combined-ca-bundle\") pod \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\" (UID: \"6dc4e7b0-25bf-4452-9e52-b03e773e485a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.223173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.223606 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.227457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-scripts" (OuterVolumeSpecName: "scripts") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.234943 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.295462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-config" (OuterVolumeSpecName: "config") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.309044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0aaaf62-6314-4f0c-a148-78659ed61770-kube-api-access-2x747" (OuterVolumeSpecName: "kube-api-access-2x747") pod "f0aaaf62-6314-4f0c-a148-78659ed61770" (UID: "f0aaaf62-6314-4f0c-a148-78659ed61770"). InnerVolumeSpecName "kube-api-access-2x747". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.309767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9244abb6-e799-4f0d-9af5-a506ee5c835f-kube-api-access-gkjfs" (OuterVolumeSpecName: "kube-api-access-gkjfs") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "kube-api-access-gkjfs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.311086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-api-access-wm55r" (OuterVolumeSpecName: "kube-api-access-wm55r") pod "6dc4e7b0-25bf-4452-9e52-b03e773e485a" (UID: "6dc4e7b0-25bf-4452-9e52-b03e773e485a"). InnerVolumeSpecName "kube-api-access-wm55r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.311149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: E1121 12:35:22.320573 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.325732 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2x747\" (UniqueName: \"kubernetes.io/projected/f0aaaf62-6314-4f0c-a148-78659ed61770-kube-api-access-2x747\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.325777 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.325788 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.325797 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gkjfs\" (UniqueName: \"kubernetes.io/projected/9244abb6-e799-4f0d-9af5-a506ee5c835f-kube-api-access-gkjfs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.325806 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9244abb6-e799-4f0d-9af5-a506ee5c835f-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.325815 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wm55r\" (UniqueName: \"kubernetes.io/projected/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-api-access-wm55r\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: E1121 12:35:22.327304 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:35:22 crc kubenswrapper[4769]: E1121 12:35:22.331361 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:35:22 crc kubenswrapper[4769]: E1121 12:35:22.331407 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerName="nova-cell1-conductor-conductor" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.424171 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell11c71-account-delete-2cs4f"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.451552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.461792 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.462126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronf206-account-delete-r75nt"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.472994 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.538865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-alertmanager-metric-storage-db\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.538918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.538917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "f0aaaf62-6314-4f0c-a148-78659ed61770" (UID: "f0aaaf62-6314-4f0c-a148-78659ed61770"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.538944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-vencrypt-tls-certs\") pod \"11f66499-aa3b-4400-a0fa-a059a70e64bf\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.538973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-cluster-tls-config\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.538990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-secret-combined-ca-bundle\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config-out\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-web-config\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb277\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-kube-api-access-mb277\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-thanos-prometheus-http-client-file\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6dc4e7b0-25bf-4452-9e52-b03e773e485a" (UID: "6dc4e7b0-25bf-4452-9e52-b03e773e485a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.539772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-alertmanager-metric-storage-db" (OuterVolumeSpecName: "alertmanager-metric-storage-db") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "alertmanager-metric-storage-db". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-config-data\") pod \"11f66499-aa3b-4400-a0fa-a059a70e64bf\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s48fj\" (UniqueName: \"kubernetes.io/projected/11f66499-aa3b-4400-a0fa-a059a70e64bf-kube-api-access-s48fj\") pod \"11f66499-aa3b-4400-a0fa-a059a70e64bf\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-out\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-tls-assets\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret\") pod \"f0aaaf62-6314-4f0c-a148-78659ed61770\" (UID: \"f0aaaf62-6314-4f0c-a148-78659ed61770\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7f8k\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-kube-api-access-m7f8k\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-db\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84013f03-f2eb-47c2-86c7-7a3d707ed64e-prometheus-metric-storage-rulefiles-0\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.552987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\" (UID: \"84013f03-f2eb-47c2-86c7-7a3d707ed64e\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-combined-ca-bundle\") pod \"11f66499-aa3b-4400-a0fa-a059a70e64bf\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-nova-novncproxy-tls-certs\") pod \"11f66499-aa3b-4400-a0fa-a059a70e64bf\" (UID: \"11f66499-aa3b-4400-a0fa-a059a70e64bf\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-tls-assets\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-volume\") pod \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\" (UID: \"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a\") " Nov 21 12:35:22 crc kubenswrapper[4769]: W1121 12:35:22.553630 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/f0aaaf62-6314-4f0c-a148-78659ed61770/volumes/kubernetes.io~secret/openstack-config-secret Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "f0aaaf62-6314-4f0c-a148-78659ed61770" (UID: "f0aaaf62-6314-4f0c-a148-78659ed61770"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553916 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553935 4769 reconciler_common.go:293] "Volume detached for volume \"alertmanager-metric-storage-db\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-alertmanager-metric-storage-db\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.553948 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.554961 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.573597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84013f03-f2eb-47c2-86c7-7a3d707ed64e-prometheus-metric-storage-rulefiles-0" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-0") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.586474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-volume" (OuterVolumeSpecName: "config-volume") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.590149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.590401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "f0aaaf62-6314-4f0c-a148-78659ed61770" (UID: "f0aaaf62-6314-4f0c-a148-78659ed61770"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.590757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.590786 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0aaaf62-6314-4f0c-a148-78659ed61770" (UID: "f0aaaf62-6314-4f0c-a148-78659ed61770"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.591256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f66499-aa3b-4400-a0fa-a059a70e64bf-kube-api-access-s48fj" (OuterVolumeSpecName: "kube-api-access-s48fj") pod "11f66499-aa3b-4400-a0fa-a059a70e64bf" (UID: "11f66499-aa3b-4400-a0fa-a059a70e64bf"). InnerVolumeSpecName "kube-api-access-s48fj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.592253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-kube-api-access-mb277" (OuterVolumeSpecName: "kube-api-access-mb277") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "kube-api-access-mb277". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.593593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config-out" (OuterVolumeSpecName: "config-out") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.595600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d" (OuterVolumeSpecName: "web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.596561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config" (OuterVolumeSpecName: "config") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.597662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-out" (OuterVolumeSpecName: "config-out") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.601006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d" (OuterVolumeSpecName: "web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.602426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-kube-api-access-m7f8k" (OuterVolumeSpecName: "kube-api-access-m7f8k") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "kube-api-access-m7f8k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.604030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.608773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "6dc4e7b0-25bf-4452-9e52-b03e773e485a" (UID: "6dc4e7b0-25bf-4452-9e52-b03e773e485a"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.652862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9" (OuterVolumeSpecName: "prometheus-metric-storage-db") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "pvc-8cd3e173-9731-422f-aca3-ae21360798d9". PluginName "kubernetes.io/csi", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657322 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mb277\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-kube-api-access-mb277\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657371 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657386 4769 reconciler_common.go:293] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-thanos-prometheus-http-client-file\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657404 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657419 4769 reconciler_common.go:293] "Volume detached for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657434 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s48fj\" (UniqueName: \"kubernetes.io/projected/11f66499-aa3b-4400-a0fa-a059a70e64bf-kube-api-access-s48fj\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657446 4769 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-out\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657458 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0aaaf62-6314-4f0c-a148-78659ed61770-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657470 4769 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84013f03-f2eb-47c2-86c7-7a3d707ed64e-tls-assets\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657482 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m7f8k\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-kube-api-access-m7f8k\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657524 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") on node \"crc\" " Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657542 4769 reconciler_common.go:293] "Volume detached for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84013f03-f2eb-47c2-86c7-7a3d707ed64e-prometheus-metric-storage-rulefiles-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657555 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657569 4769 reconciler_common.go:293] "Volume detached for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657582 4769 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-tls-assets\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657594 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657608 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0aaaf62-6314-4f0c-a148-78659ed61770-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.657619 4769 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84013f03-f2eb-47c2-86c7-7a3d707ed64e-config-out\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.661284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.665459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-config-data" (OuterVolumeSpecName: "config-data") pod "11f66499-aa3b-4400-a0fa-a059a70e64bf" (UID: "11f66499-aa3b-4400-a0fa-a059a70e64bf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.680758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.699514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-secret-combined-ca-bundle" (OuterVolumeSpecName: "secret-combined-ca-bundle") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "secret-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.705564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.728590 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "11f66499-aa3b-4400-a0fa-a059a70e64bf" (UID: "11f66499-aa3b-4400-a0fa-a059a70e64bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.729057 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementff8c-account-delete-fxnn4"] Nov 21 12:35:22 crc kubenswrapper[4769]: W1121 12:35:22.737338 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bfd5314_6358_4789_a76f_a12e61bca8a4.slice/crio-14c57c9d41722f47b3ad8c4bf657c6d634cb8dc9159a2c7ceaf4261eafbb4dd1 WatchSource:0}: Error finding container 14c57c9d41722f47b3ad8c4bf657c6d634cb8dc9159a2c7ceaf4261eafbb4dd1: Status 404 returned error can't find the container with id 14c57c9d41722f47b3ad8c4bf657c6d634cb8dc9159a2c7ceaf4261eafbb4dd1 Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.738935 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/watcher89e7-account-delete-6hz9b"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.739152 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "6dc4e7b0-25bf-4452-9e52-b03e773e485a" (UID: "6dc4e7b0-25bf-4452-9e52-b03e773e485a"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: W1121 12:35:22.739572 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4008318b_1790_42b2_b86e_f1c1919e9da8.slice/crio-19a4e4e9d460566209990c5f5e7e610656bb3f221444b533c716d7cabcfbcedd WatchSource:0}: Error finding container 19a4e4e9d460566209990c5f5e7e610656bb3f221444b533c716d7cabcfbcedd: Status 404 returned error can't find the container with id 19a4e4e9d460566209990c5f5e7e610656bb3f221444b533c716d7cabcfbcedd Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767176 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc4e7b0-25bf-4452-9e52-b03e773e485a-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767811 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767827 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767836 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767848 4769 reconciler_common.go:293] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-cluster-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767859 4769 reconciler_common.go:293] "Volume detached for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-secret-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.767869 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.776394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "11f66499-aa3b-4400-a0fa-a059a70e64bf" (UID: "11f66499-aa3b-4400-a0fa-a059a70e64bf"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.782507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "9244abb6-e799-4f0d-9af5-a506ee5c835f" (UID: "9244abb6-e799-4f0d-9af5-a506ee5c835f"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.800142 4769 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.801217 4769 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-8cd3e173-9731-422f-aca3-ae21360798d9" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9") on node "crc" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.834283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config" (OuterVolumeSpecName: "web-config") pod "84013f03-f2eb-47c2-86c7-7a3d707ed64e" (UID: "84013f03-f2eb-47c2-86c7-7a3d707ed64e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.836867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-web-config" (OuterVolumeSpecName: "web-config") pod "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" (UID: "60668a6c-9603-4d1d-b0b4-20fcad3a7b1a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.858086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "11f66499-aa3b-4400-a0fa-a059a70e64bf" (UID: "11f66499-aa3b-4400-a0fa-a059a70e64bf"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.869333 4769 reconciler_common.go:293] "Volume detached for volume \"pvc-8cd3e173-9731-422f-aca3-ae21360798d9\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-8cd3e173-9731-422f-aca3-ae21360798d9\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.869370 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9244abb6-e799-4f0d-9af5-a506ee5c835f-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.869381 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.869393 4769 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84013f03-f2eb-47c2-86c7-7a3d707ed64e-web-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.869404 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/11f66499-aa3b-4400-a0fa-a059a70e64bf-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.869412 4769 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a-web-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.900242 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c"] Nov 21 12:35:22 crc kubenswrapper[4769]: I1121 12:35:22.907611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi34da-account-delete-r8hgm"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.036247 4769 scope.go:117] "RemoveContainer" containerID="84a1cbe96aa3f72c3321d6be9f0d078272780d29aa0a9773789cb1865a6c9304" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.036800 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.041782 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerID="f4f2ff038032497d9764ee4609ac54b083fd4e4edf2e7ce0cd8684840505c2cc" exitCode=0 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.041862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" event={"ID":"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f","Type":"ContainerDied","Data":"f4f2ff038032497d9764ee4609ac54b083fd4e4edf2e7ce0cd8684840505c2cc"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.041892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" event={"ID":"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f","Type":"ContainerDied","Data":"960fd89888d62d428f05bc7deb1e51d62165368d753784343be9c2839028ecdd"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.041905 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="960fd89888d62d428f05bc7deb1e51d62165368d753784343be9c2839028ecdd" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.045672 4769 generic.go:334] "Generic (PLEG): container finished" podID="311dff41-2849-4530-8dfd-c566e4ad5859" containerID="42e893e76266ec204d3f83f307b2faf0609d07fe7d534ee7c806e5ff1e9f3f67" exitCode=0 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.045750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" event={"ID":"311dff41-2849-4530-8dfd-c566e4ad5859","Type":"ContainerDied","Data":"42e893e76266ec204d3f83f307b2faf0609d07fe7d534ee7c806e5ff1e9f3f67"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.050428 4769 generic.go:334] "Generic (PLEG): container finished" podID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerID="0f09fca4f4d58cf691832977b419e1161c455d86d856d6bd614cf68364aab292" exitCode=0 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.050501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerDied","Data":"0f09fca4f4d58cf691832977b419e1161c455d86d856d6bd614cf68364aab292"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.050535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5afe14b3-c830-484e-837e-3dd0cdd61413","Type":"ContainerDied","Data":"70f74e2286deb525dd31e1e63b0aa0d069ce93446e07ac92e74f654b60fb2ba1"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.050549 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70f74e2286deb525dd31e1e63b0aa0d069ce93446e07ac92e74f654b60fb2ba1" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.056593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"6dc4e7b0-25bf-4452-9e52-b03e773e485a","Type":"ContainerDied","Data":"8b6088434753b67c2d993d40e0cf294f5205d3ee40d5d5c2db3a66d1491df80e"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.056692 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.076679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" event={"ID":"4008318b-1790-42b2-b86e-f1c1919e9da8","Type":"ContainerStarted","Data":"19a4e4e9d460566209990c5f5e7e610656bb3f221444b533c716d7cabcfbcedd"} Nov 21 12:35:23 crc kubenswrapper[4769]: E1121 12:35:23.121324 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.121500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" event={"ID":"60668a6c-9603-4d1d-b0b4-20fcad3a7b1a","Type":"ContainerDied","Data":"17566b5e5d644be530dcbdf777da0db2bb46ebc5bff4dcdc260612b8d16c5208"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.121653 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/alertmanager-metric-storage-0" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.133606 4769 scope.go:117] "RemoveContainer" containerID="488b43b9d46ff3515b43b1f98135f48ab4e191939f47e94d7a737aa8bb72ff66" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.138943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" event={"ID":"18dea187-c7dd-4482-83ea-9c36d754313d","Type":"ContainerStarted","Data":"ee5ca1d8ee4167719417321af558dd8b7f6aa8677b51d7b924ae13ba22674805"} Nov 21 12:35:23 crc kubenswrapper[4769]: E1121 12:35:23.140093 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.148929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" event={"ID":"0fe07eae-a4cd-49b4-b340-98c22fee11f8","Type":"ContainerStarted","Data":"256ab0e0581eabd459cea7ad245e561cec4ba40fd567560a226de3f27ed4cbea"} Nov 21 12:35:23 crc kubenswrapper[4769]: E1121 12:35:23.152370 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:35:23 crc kubenswrapper[4769]: E1121 12:35:23.152475 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.178160 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:35:23 crc kubenswrapper[4769]: E1121 12:35:23.178637 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Nov 21 12:35:23 crc kubenswrapper[4769]: E1121 12:35:23.178714 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0 podName:a1fe319d-547f-4eae-a3cb-3f7f47f8af29 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:27.178701518 +0000 UTC m=+2685.879363336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0") pod "dnsmasq-dnsmasq-7799499c75-q9p8r" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29") : configmap "dns-swift-storage-0" not found Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.179179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"11f66499-aa3b-4400-a0fa-a059a70e64bf","Type":"ContainerDied","Data":"9eef3c79b058a428fec1afde3ec937d9cebf071a51e06b2055595083913f974e"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.192412 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.203305 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" containerID="1d1dc553e27bb32ca837a9e46bb78af1d5d8eaa3b4fadd50be18844443a3f2fb" exitCode=0 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.203557 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0705a-account-delete-gtvls"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.203602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" event={"ID":"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f","Type":"ContainerDied","Data":"1d1dc553e27bb32ca837a9e46bb78af1d5d8eaa3b4fadd50be18844443a3f2fb"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.229432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" event={"ID":"48522fa8-1b4a-488d-8912-7ce719f1875f","Type":"ContainerStarted","Data":"75db5953d815db35752280b3b954faaa35a00b42d809ed8e906fa45c0f3f19c6"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.235587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" event={"ID":"4bfd5314-6358-4789-a76f-a12e61bca8a4","Type":"ContainerStarted","Data":"14c57c9d41722f47b3ad8c4bf657c6d634cb8dc9159a2c7ceaf4261eafbb4dd1"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.243455 4769 scope.go:117] "RemoveContainer" containerID="5ea3bf3fda6e155a0b41039aeb02470563831f848c3bc161c5fb92bd78631660" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.246425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" event={"ID":"390a92a7-1cdc-481a-8718-fc0bd7f12d73","Type":"ContainerStarted","Data":"c376a7013e51cb1e64e7c08b38e86b4bc29498be0fc7042e099b67f4d276bfa3"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.272666 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/prometheus-metric-storage-0" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.277077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/prometheus-metric-storage-0" event={"ID":"84013f03-f2eb-47c2-86c7-7a3d707ed64e","Type":"ContainerDied","Data":"f67e3e80d66c8b9140bfb7001f08da341885c2874ce7ed6e3d52b9605d285b71"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-run-httpd\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-etc-swift\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-internal-tls-certs\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281662 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-log-httpd\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ktxr\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-kube-api-access-5ktxr\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-public-tls-certs\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-combined-ca-bundle\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.281913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-config-data\") pod \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\" (UID: \"ae2e4a20-719e-4fca-bfed-da8d2e30fd2f\") " Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.285447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.286727 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.289149 4769 generic.go:334] "Generic (PLEG): container finished" podID="18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" containerID="913cd7871484cf964f780578405195a1af0ad1f375dcd0d6826245f32528c973" exitCode=0 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.289308 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.315648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.318477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-kube-api-access-5ktxr" (OuterVolumeSpecName: "kube-api-access-5ktxr") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "kube-api-access-5ktxr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.386802 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.387266 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.387370 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.387755 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5ktxr\" (UniqueName: \"kubernetes.io/projected/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-kube-api-access-5ktxr\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.473407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.491943 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.500643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.537806 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api-log" probeResult="failure" output="Get \"https://10.217.1.216:9322/\": read tcp 10.217.0.2:37282->10.217.1.216:9322: read: connection reset by peer" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.538109 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/watcher-api-0" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api" probeResult="failure" output="Get \"https://10.217.1.216:9322/\": read tcp 10.217.0.2:37280->10.217.1.216:9322: read: connection reset by peer" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.583999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-config-data" (OuterVolumeSpecName: "config-data") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.593322 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.593347 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.602762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" (UID: "ae2e4a20-719e-4fca-bfed-da8d2e30fd2f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.699173 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.840039 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" path="/var/lib/kubelet/pods/358a84ed-d9ff-4fd8-a429-0e1f81b00f43/volumes" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.840887 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0aaaf62-6314-4f0c-a148-78659ed61770" path="/var/lib/kubelet/pods/f0aaaf62-6314-4f0c-a148-78659ed61770/volumes" Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842770 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" event={"ID":"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3","Type":"ContainerDied","Data":"913cd7871484cf964f780578405195a1af0ad1f375dcd0d6826245f32528c973"} Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842828 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842852 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842882 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842923 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-lwctk"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842936 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-nm7bm"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842949 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-lwctk"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842963 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-nm7bm"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.842999 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-596f95c558-6zbwv"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.843014 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.854923 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" podUID="ea67e490-4830-43fd-9c9f-c7fdee996bdb" containerName="keystone-api" containerID="cri-o://c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c" gracePeriod=30 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.855244 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="9d322e5e-caf1-47f5-a352-9508f797537d" containerName="memcached" containerID="cri-o://6d1ef35e7c2e8dcfbf2420aa494282a720fa09f16930951bf6e98ca866737536" gracePeriod=30 Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.890291 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5p2qv"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.907823 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5p2qv"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.917496 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-8c07-account-create-nndrx"] Nov 21 12:35:23 crc kubenswrapper[4769]: I1121 12:35:23.973500 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-8c07-account-create-nndrx"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.005095 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mkmhc"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.023625 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mkmhc"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.064046 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronf206-account-delete-r75nt"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.082983 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-f206-account-create-2859j"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.094045 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.219:8776/healthcheck\": dial tcp 10.217.1.219:8776: connect: connection refused" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.121828 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-f206-account-create-2859j"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.136896 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-r4ngx"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.146913 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-r4ngx"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.169456 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-ff8c-account-create-xkhsd"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.190879 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-ff8c-account-create-xkhsd"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.198930 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementff8c-account-delete-fxnn4"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.260352 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerName="galera" containerID="cri-o://4bedff8d1dc16707eec95a4e52fed146d1162c72aeab15c070f8e0c403d044d5" gracePeriod=30 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.322080 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" event={"ID":"7c5878be-4791-4c35-87de-cdf379804fe5","Type":"ContainerStarted","Data":"9f12cf48203e57ffa30cefde0bf290f664134ae44fddd0a7df1d7babfcd1f49b"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.347112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" event={"ID":"48522fa8-1b4a-488d-8912-7ce719f1875f","Type":"ContainerStarted","Data":"07fce744c3628b7e76ad6eff16f86f580661c29a3505932bc21da124e89ff64c"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.348121 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2k6gs"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.352249 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" secret="" err="secret \"galera-openstack-dockercfg-r6m8b\" not found" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.360640 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2k6gs"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.383255 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerID="07ade9dcc929a836a885d01ae6862ab0c3432ac6d40b218c509b28428435976b" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.383672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9","Type":"ContainerDied","Data":"07ade9dcc929a836a885d01ae6862ab0c3432ac6d40b218c509b28428435976b"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.407748 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell11c71-account-delete-2cs4f"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.416156 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerID="b17b8e96729770d76315fddd7ecd4a7f0e5003295d85b39ac30e920ed433ac79" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.416238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" event={"ID":"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090","Type":"ContainerDied","Data":"b17b8e96729770d76315fddd7ecd4a7f0e5003295d85b39ac30e920ed433ac79"} Nov 21 12:35:24 crc kubenswrapper[4769]: E1121 12:35:24.417571 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:24 crc kubenswrapper[4769]: E1121 12:35:24.417621 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:35:24.917607405 +0000 UTC m=+2683.618269223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.455856 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.466599 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-1c71-account-create-lxq8r"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.483472 4769 generic.go:334] "Generic (PLEG): container finished" podID="78615e61-bc82-4c5d-baae-192881b1180c" containerID="907734f25feb7bfe17eda559c00541441bbc1acb0becb4a66c683c2ea04dcfb6" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.483589 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"78615e61-bc82-4c5d-baae-192881b1180c","Type":"ContainerDied","Data":"907734f25feb7bfe17eda559c00541441bbc1acb0becb4a66c683c2ea04dcfb6"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.510055 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.214:9311/healthcheck\": dial tcp 10.217.1.214:9311: connect: connection refused" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.511438 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.214:9311/healthcheck\": dial tcp 10.217.1.214:9311: connect: connection refused" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.520656 4769 generic.go:334] "Generic (PLEG): container finished" podID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerID="1abc6243c2532e88080e789ebe5e6e7fb69daba8348613143615ae943993df67" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.520772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c194df7b-a418-440d-a1a6-5772c7ed5b32","Type":"ContainerDied","Data":"1abc6243c2532e88080e789ebe5e6e7fb69daba8348613143615ae943993df67"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.542784 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" podStartSLOduration=6.542753128 podStartE2EDuration="6.542753128s" podCreationTimestamp="2025-11-21 12:35:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:24.383730265 +0000 UTC m=+2683.084392083" watchObservedRunningTime="2025-11-21 12:35:24.542753128 +0000 UTC m=+2683.243414946" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.581367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" event={"ID":"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3","Type":"ContainerDied","Data":"fc212ee21dbe8fd216eb92b654350ec770f171e07e9a187e8b442c3548942a3c"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.581419 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc212ee21dbe8fd216eb92b654350ec770f171e07e9a187e8b442c3548942a3c" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.584249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sjmg7"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.603800 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sjmg7"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.616633 4769 generic.go:334] "Generic (PLEG): container finished" podID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerID="97513b514876280e1e80fe5e0696d9edf096c20ec2eb3eac3602c5016731f05f" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.616921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"4347fb32-914b-4f7d-b004-fbf9f37ad56a","Type":"ContainerDied","Data":"97513b514876280e1e80fe5e0696d9edf096c20ec2eb3eac3602c5016731f05f"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.625013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.634787 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerID="c2e35c65ee3281a8868c169717e85e16448db47322ae56d14fb755ce2df5fd31" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.634852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c41b549-737e-4157-bbd6-e049ab34a8e4","Type":"ContainerDied","Data":"c2e35c65ee3281a8868c169717e85e16448db47322ae56d14fb755ce2df5fd31"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.646150 4769 generic.go:334] "Generic (PLEG): container finished" podID="f733c362-4230-41b3-92d3-dab29b01fc70" containerID="855c5c5b3f89891e0167433c824f2882fafb494b412c2ad789adb40a31298fb5" exitCode=0 Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.646261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" event={"ID":"f733c362-4230-41b3-92d3-dab29b01fc70","Type":"ContainerDied","Data":"855c5c5b3f89891e0167433c824f2882fafb494b412c2ad789adb40a31298fb5"} Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.646407 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.672813 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi34da-account-delete-r8hgm"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.676352 4769 scope.go:117] "RemoveContainer" containerID="2ee8ae0ab58869ce6d574b44a553bb6ca4dc7a97657715758c66332cc907ab94" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.694654 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-34da-account-create-s2cvr"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.726712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-run-httpd\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.726810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-combined-ca-bundle\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.726909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-ceilometer-tls-certs\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.726942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-config-data\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.727052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-sg-core-conf-yaml\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.727075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqph2\" (UniqueName: \"kubernetes.io/projected/5afe14b3-c830-484e-837e-3dd0cdd61413-kube-api-access-mqph2\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.727178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-log-httpd\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.727389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-scripts\") pod \"5afe14b3-c830-484e-837e-3dd0cdd61413\" (UID: \"5afe14b3-c830-484e-837e-3dd0cdd61413\") " Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.729106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.729859 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.731215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.766360 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-34da-account-create-s2cvr"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.774936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afe14b3-c830-484e-837e-3dd0cdd61413-kube-api-access-mqph2" (OuterVolumeSpecName: "kube-api-access-mqph2") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "kube-api-access-mqph2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.822958 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.836545 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mqph2\" (UniqueName: \"kubernetes.io/projected/5afe14b3-c830-484e-837e-3dd0cdd61413-kube-api-access-mqph2\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.836597 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5afe14b3-c830-484e-837e-3dd0cdd61413-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.888777 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/alertmanager-metric-storage-0"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.899541 4769 scope.go:117] "RemoveContainer" containerID="edec438835cd6fe959382fdc5aa3d4205bf17d768b4b068a13229bafef66c1cb" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.909946 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-qjvcm"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.915891 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-qjvcm"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.930427 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.941250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-scripts" (OuterVolumeSpecName: "scripts") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.944422 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:24 crc kubenswrapper[4769]: E1121 12:35:24.944753 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:24 crc kubenswrapper[4769]: E1121 12:35:24.944845 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:35:25.944815711 +0000 UTC m=+2684.645477529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.959843 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-705a-account-create-g88d8"] Nov 21 12:35:24 crc kubenswrapper[4769]: I1121 12:35:24.981638 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0705a-account-delete-gtvls"] Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.166610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.250892 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.322939 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e03f6e-00b3-4016-a00e-e0be1ad78b23" path="/var/lib/kubelet/pods/01e03f6e-00b3-4016-a00e-e0be1ad78b23/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.324271 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0891c356-7943-4b14-bd0a-9af8473a7c4e" path="/var/lib/kubelet/pods/0891c356-7943-4b14-bd0a-9af8473a7c4e/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.324864 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b4b628-5c45-47af-97a8-e82c3054ce2b" path="/var/lib/kubelet/pods/11b4b628-5c45-47af-97a8-e82c3054ce2b/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.325423 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256df24b-b409-4b1f-bdbc-c59ad89f9301" path="/var/lib/kubelet/pods/256df24b-b409-4b1f-bdbc-c59ad89f9301/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.326508 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="348a3e48-6cdf-4439-9065-5c5d4b431c24" path="/var/lib/kubelet/pods/348a3e48-6cdf-4439-9065-5c5d4b431c24/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.327088 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ae7ab9-9999-4b6b-89cf-c56f1e754286" path="/var/lib/kubelet/pods/40ae7ab9-9999-4b6b-89cf-c56f1e754286/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.327791 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="459c1719-c33c-43bf-b657-89563a5e0f04" path="/var/lib/kubelet/pods/459c1719-c33c-43bf-b657-89563a5e0f04/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.328866 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579ced9e-ceda-43fe-aed4-1f3b0c3b13a5" path="/var/lib/kubelet/pods/579ced9e-ceda-43fe-aed4-1f3b0c3b13a5/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.329463 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" path="/var/lib/kubelet/pods/60668a6c-9603-4d1d-b0b4-20fcad3a7b1a/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.330150 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc4e7b0-25bf-4452-9e52-b03e773e485a" path="/var/lib/kubelet/pods/6dc4e7b0-25bf-4452-9e52-b03e773e485a/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.331177 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79568fda-e5fd-45b7-b7c5-b4854223c93b" path="/var/lib/kubelet/pods/79568fda-e5fd-45b7-b7c5-b4854223c93b/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.331739 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b779838-79e3-45cb-be0b-6bacaba2eac3" path="/var/lib/kubelet/pods/8b779838-79e3-45cb-be0b-6bacaba2eac3/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.332673 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98615cf5-ae53-4563-8c79-0c09777cfdf8" path="/var/lib/kubelet/pods/98615cf5-ae53-4563-8c79-0c09777cfdf8/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.334245 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ccc17d-6fdb-4b14-9953-f5309c225906" path="/var/lib/kubelet/pods/d1ccc17d-6fdb-4b14-9953-f5309c225906/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.334811 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e72c903a-fb96-4318-9c25-d5a5af14fe5b" path="/var/lib/kubelet/pods/e72c903a-fb96-4318-9c25-d5a5af14fe5b/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.335374 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa48c9f0-8467-445e-ae5f-133d2ad19e8d" path="/var/lib/kubelet/pods/fa48c9f0-8467-445e-ae5f-133d2ad19e8d/volumes" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.410925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.465241 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.493289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.567883 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.601866 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="9d322e5e-caf1-47f5-a352-9508f797537d" containerName="memcached" probeResult="failure" output="dial tcp 10.217.1.167:11211: connect: connection refused" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.606153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-config-data" (OuterVolumeSpecName: "config-data") pod "5afe14b3-c830-484e-837e-3dd0cdd61413" (UID: "5afe14b3-c830-484e-837e-3dd0cdd61413"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.665802 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" podUID="390a92a7-1cdc-481a-8718-fc0bd7f12d73" containerName="mariadb-account-delete" containerID="cri-o://88d4a200e3b2ec9d55ddbe0d62999ff04696c37f84c2c4dbaa877751adea568a" gracePeriod=30 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.669480 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5afe14b3-c830-484e-837e-3dd0cdd61413-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.674241 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3 is running failed: container process not found" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.674942 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3 is running failed: container process not found" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.676131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" event={"ID":"390a92a7-1cdc-481a-8718-fc0bd7f12d73","Type":"ContainerStarted","Data":"88d4a200e3b2ec9d55ddbe0d62999ff04696c37f84c2c4dbaa877751adea568a"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.676206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c41b549-737e-4157-bbd6-e049ab34a8e4","Type":"ContainerDied","Data":"b771196fef7069c0b68f8212dc20de729f034071a924e4823c61db9b5a3adc55"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.676232 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b771196fef7069c0b68f8212dc20de729f034071a924e4823c61db9b5a3adc55" Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.676531 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3 is running failed: container process not found" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" cmd=["/usr/bin/pgrep","-r","DRST","watcher-applier"] Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.676563 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/watcher-applier-0" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerName="watcher-applier" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.693549 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" podStartSLOduration=6.693533648 podStartE2EDuration="6.693533648s" podCreationTimestamp="2025-11-21 12:35:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:25.686473278 +0000 UTC m=+2684.387135096" watchObservedRunningTime="2025-11-21 12:35:25.693533648 +0000 UTC m=+2684.394195466" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.696693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-api-0" event={"ID":"4347fb32-914b-4f7d-b004-fbf9f37ad56a","Type":"ContainerDied","Data":"3bd22d88dcfb71840c1892dd9795724d3ecbb69d6f4a54c013af73c5b6bd7dcf"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.696755 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bd22d88dcfb71840c1892dd9795724d3ecbb69d6f4a54c013af73c5b6bd7dcf" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.698960 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.699461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" event={"ID":"4bfd5314-6358-4789-a76f-a12e61bca8a4","Type":"ContainerStarted","Data":"77b4f717b69602c8af7491b4e2d143955fe82bc0a43da8c7865a55cb3ac59d71"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.699509 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" podUID="4bfd5314-6358-4789-a76f-a12e61bca8a4" containerName="mariadb-account-delete" containerID="cri-o://77b4f717b69602c8af7491b4e2d143955fe82bc0a43da8c7865a55cb3ac59d71" gracePeriod=30 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.702876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"78615e61-bc82-4c5d-baae-192881b1180c","Type":"ContainerDied","Data":"dee21a814c88d9787cdb87397c08a7b7f36006b1e7c5372f5655ed0a6bd9e2cf"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.702936 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dee21a814c88d9787cdb87397c08a7b7f36006b1e7c5372f5655ed0a6bd9e2cf" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.704918 4769 generic.go:334] "Generic (PLEG): container finished" podID="18dea187-c7dd-4482-83ea-9c36d754313d" containerID="e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4" exitCode=0 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.704972 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" event={"ID":"18dea187-c7dd-4482-83ea-9c36d754313d","Type":"ContainerDied","Data":"e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.707690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" event={"ID":"0fe07eae-a4cd-49b4-b340-98c22fee11f8","Type":"ContainerStarted","Data":"afdb50742af821b5f7f309f454a7ba52ce95de0611e8f4e76ffb5483d42415b3"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.707869 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" podUID="0fe07eae-a4cd-49b4-b340-98c22fee11f8" containerName="mariadb-account-delete" containerID="cri-o://afdb50742af821b5f7f309f454a7ba52ce95de0611e8f4e76ffb5483d42415b3" gracePeriod=30 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.718022 4769 generic.go:334] "Generic (PLEG): container finished" podID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerID="30dfb140d9e8887836ba42cd44a7ee5b669d5d2d55d486ec52a4ea40f065a45b" exitCode=0 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.718105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" event={"ID":"c3e12002-b8fa-4005-8e29-a5259652a4c6","Type":"ContainerDied","Data":"30dfb140d9e8887836ba42cd44a7ee5b669d5d2d55d486ec52a4ea40f065a45b"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.718137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" event={"ID":"c3e12002-b8fa-4005-8e29-a5259652a4c6","Type":"ContainerDied","Data":"d3aa3e74112142f73e1f125e0afa9fdb716a9b264c4063b7ef927c363e96db32"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.718150 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3aa3e74112142f73e1f125e0afa9fdb716a9b264c4063b7ef927c363e96db32" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.726268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" event={"ID":"311dff41-2849-4530-8dfd-c566e4ad5859","Type":"ContainerDied","Data":"6491a18dc6dace7470fa33f1a15091a2c59e2ae699f185a45e1bdfe4809561be"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.726324 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6491a18dc6dace7470fa33f1a15091a2c59e2ae699f185a45e1bdfe4809561be" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.728454 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.729995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9","Type":"ContainerDied","Data":"6d2760ce182a56c6b9c1b3b452dff4eeb4b725fc9a15ac16f2052898e4423893"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.730031 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d2760ce182a56c6b9c1b3b452dff4eeb4b725fc9a15ac16f2052898e4423893" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.732604 4769 generic.go:334] "Generic (PLEG): container finished" podID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" exitCode=0 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.732673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"7ce95dd6-a420-4900-b156-9ab3e0d9afc2","Type":"ContainerDied","Data":"213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.749728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" event={"ID":"4008318b-1790-42b2-b86e-f1c1919e9da8","Type":"ContainerStarted","Data":"08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.750495 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" secret="" err="secret \"galera-openstack-dockercfg-r6m8b\" not found" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.754647 4769 scope.go:117] "RemoveContainer" containerID="e9e603d6453feda077fbf42ee33ef94fd1e1390ebd478221377ade9874c3af33" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.764341 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.768881 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" podStartSLOduration=6.768855271 podStartE2EDuration="6.768855271s" podCreationTimestamp="2025-11-21 12:35:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:25.739175174 +0000 UTC m=+2684.439836992" watchObservedRunningTime="2025-11-21 12:35:25.768855271 +0000 UTC m=+2684.469517079" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.770736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4lpr\" (UniqueName: \"kubernetes.io/projected/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-kube-api-access-z4lpr\") pod \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.770917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-operator-scripts\") pod \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\" (UID: \"18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.772964 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" (UID: "18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.775326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-kube-api-access-z4lpr" (OuterVolumeSpecName: "kube-api-access-z4lpr") pod "18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" (UID: "18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3"). InnerVolumeSpecName "kube-api-access-z4lpr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.777888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" event={"ID":"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f","Type":"ContainerDied","Data":"ea08e75cf191d391188e38108c8dc07e7a126959115b2f80279938b13d26f5bc"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.777931 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea08e75cf191d391188e38108c8dc07e7a126959115b2f80279938b13d26f5bc" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.794537 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.795729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c194df7b-a418-440d-a1a6-5772c7ed5b32","Type":"ContainerDied","Data":"9e6ed6f609e0f013c1b011401db7abeca7b752fbb369a8f97989084af8db59f5"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.795759 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e6ed6f609e0f013c1b011401db7abeca7b752fbb369a8f97989084af8db59f5" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.796128 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" podStartSLOduration=7.796111294 podStartE2EDuration="7.796111294s" podCreationTimestamp="2025-11-21 12:35:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:25.780534345 +0000 UTC m=+2684.481196173" watchObservedRunningTime="2025-11-21 12:35:25.796111294 +0000 UTC m=+2684.496773102" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.796440 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.802578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" event={"ID":"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090","Type":"ContainerDied","Data":"b481f08a63a3c00fb5d43c5ee5326c73c65b34901adb904cd3fbc7d667f728b9"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.802734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6c9bd6f466-wzz6c" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.806535 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.808594 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerID="652ca03c5ad58ceec7e88a3e5377a0554ef8b8df704a0b00b5b5e9a203f423ea" exitCode=0 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.808640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b","Type":"ContainerDied","Data":"652ca03c5ad58ceec7e88a3e5377a0554ef8b8df704a0b00b5b5e9a203f423ea"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.808703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b","Type":"ContainerDied","Data":"562d26046cd9233dd15ce968a51d7a31fa483188af0d5dabd88eb444bf741987"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.808719 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="562d26046cd9233dd15ce968a51d7a31fa483188af0d5dabd88eb444bf741987" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.810007 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.810575 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d322e5e-caf1-47f5-a352-9508f797537d" containerID="6d1ef35e7c2e8dcfbf2420aa494282a720fa09f16930951bf6e98ca866737536" exitCode=0 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.810622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9d322e5e-caf1-47f5-a352-9508f797537d","Type":"ContainerDied","Data":"6d1ef35e7c2e8dcfbf2420aa494282a720fa09f16930951bf6e98ca866737536"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.823470 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" podUID="7c5878be-4791-4c35-87de-cdf379804fe5" containerName="mariadb-account-delete" containerID="cri-o://06250d5b0e35f7e18ee489e95ebae6d7d3e2e592d94bbdb64b8398b21e789a0e" gracePeriod=30 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.823753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" event={"ID":"7c5878be-4791-4c35-87de-cdf379804fe5","Type":"ContainerStarted","Data":"06250d5b0e35f7e18ee489e95ebae6d7d3e2e592d94bbdb64b8398b21e789a0e"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.838452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.839512 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" event={"ID":"f733c362-4230-41b3-92d3-dab29b01fc70","Type":"ContainerDied","Data":"7084649a6640b841330f8e55999dce360e9d74bfaa84bcb70a7aa67ae17e57fd"} Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.839546 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7084649a6640b841330f8e55999dce360e9d74bfaa84bcb70a7aa67ae17e57fd" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.839740 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" podUID="48522fa8-1b4a-488d-8912-7ce719f1875f" containerName="mariadb-account-delete" containerID="cri-o://07fce744c3628b7e76ad6eff16f86f580661c29a3505932bc21da124e89ff64c" gracePeriod=30 Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.869799 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.869845 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.875854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.875905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-scripts\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.875925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c41b549-737e-4157-bbd6-e049ab34a8e4-etc-machine-id\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.875951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4347fb32-914b-4f7d-b004-fbf9f37ad56a-logs\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.875981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-config-data\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-combined-ca-bundle\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-internal-tls-certs\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-combined-ca-bundle\") pod \"78615e61-bc82-4c5d-baae-192881b1180c\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-public-tls-certs\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-public-tls-certs\") pod \"78615e61-bc82-4c5d-baae-192881b1180c\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-config-data\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-config-data\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-config-data\") pod \"78615e61-bc82-4c5d-baae-192881b1180c\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-httpd-run\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-combined-ca-bundle\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-scripts\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876254 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-httpd-run\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876274 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-combined-ca-bundle\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-custom-prometheus-ca\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c41b549-737e-4157-bbd6-e049ab34a8e4-logs\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-internal-tls-certs\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876372 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-logs\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-combined-ca-bundle\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876430 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-public-tls-certs\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqg5n\" (UniqueName: \"kubernetes.io/projected/0c41b549-737e-4157-bbd6-e049ab34a8e4-kube-api-access-kqg5n\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876469 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlcw9\" (UniqueName: \"kubernetes.io/projected/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-kube-api-access-wlcw9\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84xcz\" (UniqueName: \"kubernetes.io/projected/c194df7b-a418-440d-a1a6-5772c7ed5b32-kube-api-access-84xcz\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876510 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpht5\" (UniqueName: \"kubernetes.io/projected/4347fb32-914b-4f7d-b004-fbf9f37ad56a-kube-api-access-hpht5\") pod \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\" (UID: \"4347fb32-914b-4f7d-b004-fbf9f37ad56a\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-internal-tls-certs\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mmj9\" (UniqueName: \"kubernetes.io/projected/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-kube-api-access-5mmj9\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.876603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-public-tls-certs\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh2nj\" (UniqueName: \"kubernetes.io/projected/78615e61-bc82-4c5d-baae-192881b1180c-kube-api-access-kh2nj\") pod \"78615e61-bc82-4c5d-baae-192881b1180c\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-logs\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78615e61-bc82-4c5d-baae-192881b1180c-logs\") pod \"78615e61-bc82-4c5d-baae-192881b1180c\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-internal-tls-certs\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-logs\") pod \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\" (UID: \"fe4e424a-52f7-4cb6-bd2d-4c6c6e719090\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-scripts\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877885 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data-custom\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-config-data\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.877987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-scripts\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.878006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-combined-ca-bundle\") pod \"c194df7b-a418-440d-a1a6-5772c7ed5b32\" (UID: \"c194df7b-a418-440d-a1a6-5772c7ed5b32\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.878067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\" (UID: \"a0ceb8bd-b9c0-45be-a8ad-5c23341007e9\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.878084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-public-tls-certs\") pod \"0c41b549-737e-4157-bbd6-e049ab34a8e4\" (UID: \"0c41b549-737e-4157-bbd6-e049ab34a8e4\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.878138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-internal-tls-certs\") pod \"78615e61-bc82-4c5d-baae-192881b1180c\" (UID: \"78615e61-bc82-4c5d-baae-192881b1180c\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.879200 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z4lpr\" (UniqueName: \"kubernetes.io/projected/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-kube-api-access-z4lpr\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.879216 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.880804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4347fb32-914b-4f7d-b004-fbf9f37ad56a-logs" (OuterVolumeSpecName: "logs") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.885020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78615e61-bc82-4c5d-baae-192881b1180c-kube-api-access-kh2nj" (OuterVolumeSpecName: "kube-api-access-kh2nj") pod "78615e61-bc82-4c5d-baae-192881b1180c" (UID: "78615e61-bc82-4c5d-baae-192881b1180c"). InnerVolumeSpecName "kube-api-access-kh2nj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.885702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-scripts" (OuterVolumeSpecName: "scripts") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.885907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.886440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-scripts" (OuterVolumeSpecName: "scripts") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.886466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0c41b549-737e-4157-bbd6-e049ab34a8e4-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.891377 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.891739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-logs" (OuterVolumeSpecName: "logs") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.892301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78615e61-bc82-4c5d-baae-192881b1180c-logs" (OuterVolumeSpecName: "logs") pod "78615e61-bc82-4c5d-baae-192881b1180c" (UID: "78615e61-bc82-4c5d-baae-192881b1180c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.909749 4769 scope.go:117] "RemoveContainer" containerID="f1a03cb356b42d3fe0a8443af51a3eacc2a84e5d1de42ee9a9ded91eaab486d7" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.911701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-logs" (OuterVolumeSpecName: "logs") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.916542 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.917037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-scripts" (OuterVolumeSpecName: "scripts") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.918297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.927692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-kube-api-access-wlcw9" (OuterVolumeSpecName: "kube-api-access-wlcw9") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "kube-api-access-wlcw9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.929335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-logs" (OuterVolumeSpecName: "logs") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.934792 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" podStartSLOduration=7.934764159 podStartE2EDuration="7.934764159s" podCreationTimestamp="2025-11-21 12:35:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:25.881979841 +0000 UTC m=+2684.582641679" watchObservedRunningTime="2025-11-21 12:35:25.934764159 +0000 UTC m=+2684.635425977" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.935329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.945811 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/prometheus-metric-storage-0"] Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.946431 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.946560 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data podName:f24e626c-11ec-4d3d-a065-822b13a8b8b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:33.946526615 +0000 UTC m=+2692.647188433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data") pod "rabbitmq-server-0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0") : configmap "rabbitmq-config-data" not found Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.946825 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.946899 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:26.446879875 +0000 UTC m=+2685.147541693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.947821 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "glance") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.953671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4347fb32-914b-4f7d-b004-fbf9f37ad56a-kube-api-access-hpht5" (OuterVolumeSpecName: "kube-api-access-hpht5") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "kube-api-access-hpht5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.953852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c41b549-737e-4157-bbd6-e049ab34a8e4-logs" (OuterVolumeSpecName: "logs") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.962566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c41b549-737e-4157-bbd6-e049ab34a8e4-kube-api-access-kqg5n" (OuterVolumeSpecName: "kube-api-access-kqg5n") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "kube-api-access-kqg5n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.962800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.966636 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c194df7b-a418-440d-a1a6-5772c7ed5b32-kube-api-access-84xcz" (OuterVolumeSpecName: "kube-api-access-84xcz") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "kube-api-access-84xcz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.983149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-config-data\") pod \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.983454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4b9k\" (UniqueName: \"kubernetes.io/projected/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-kube-api-access-s4b9k\") pod \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.983525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-combined-ca-bundle\") pod \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.983591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-logs\") pod \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.983840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-nova-metadata-tls-certs\") pod \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\" (UID: \"8c6c3cfb-b016-466d-abb7-ec5fcaa0344b\") " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.983917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-scripts" (OuterVolumeSpecName: "scripts") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984316 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kh2nj\" (UniqueName: \"kubernetes.io/projected/78615e61-bc82-4c5d-baae-192881b1180c-kube-api-access-kh2nj\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984332 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984343 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78615e61-bc82-4c5d-baae-192881b1180c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984352 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984360 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984369 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984379 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984398 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984411 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984422 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984431 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c41b549-737e-4157-bbd6-e049ab34a8e4-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984440 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4347fb32-914b-4f7d-b004-fbf9f37ad56a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984449 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984457 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984465 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c194df7b-a418-440d-a1a6-5772c7ed5b32-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984474 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c41b549-737e-4157-bbd6-e049ab34a8e4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984482 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984490 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kqg5n\" (UniqueName: \"kubernetes.io/projected/0c41b549-737e-4157-bbd6-e049ab34a8e4-kube-api-access-kqg5n\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984500 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wlcw9\" (UniqueName: \"kubernetes.io/projected/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-kube-api-access-wlcw9\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984508 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-84xcz\" (UniqueName: \"kubernetes.io/projected/c194df7b-a418-440d-a1a6-5772c7ed5b32-kube-api-access-84xcz\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: I1121 12:35:25.984516 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hpht5\" (UniqueName: \"kubernetes.io/projected/4347fb32-914b-4f7d-b004-fbf9f37ad56a-kube-api-access-hpht5\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.986165 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.986264 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:33.986241672 +0000 UTC m=+2692.686903490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "combined-ca-bundle" not found Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.990057 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:25 crc kubenswrapper[4769]: E1121 12:35:25.990271 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:35:27.9902367 +0000 UTC m=+2686.690898518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.007889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-logs" (OuterVolumeSpecName: "logs") pod "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" (UID: "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.023063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-kube-api-access-5mmj9" (OuterVolumeSpecName: "kube-api-access-5mmj9") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "kube-api-access-5mmj9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.023317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-kube-api-access-s4b9k" (OuterVolumeSpecName: "kube-api-access-s4b9k") pod "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" (UID: "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b"). InnerVolumeSpecName "kube-api-access-s4b9k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.090977 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5mmj9\" (UniqueName: \"kubernetes.io/projected/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-kube-api-access-5mmj9\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.091018 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s4b9k\" (UniqueName: \"kubernetes.io/projected/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-kube-api-access-s4b9k\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.091035 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.091132 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-metric-storage-prometheus-svc: secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.097364 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:34.097339837 +0000 UTC m=+2692.798001655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "custom-prometheus-ca" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.133598 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.141297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-config-data" (OuterVolumeSpecName: "config-data") pod "78615e61-bc82-4c5d-baae-192881b1180c" (UID: "78615e61-bc82-4c5d-baae-192881b1180c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.156340 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.193459 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.247928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-config-data" (OuterVolumeSpecName: "config-data") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.258621 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" podStartSLOduration=7.2585987 podStartE2EDuration="7.2585987s" podCreationTimestamp="2025-11-21 12:35:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:26.210904839 +0000 UTC m=+2684.911566667" watchObservedRunningTime="2025-11-21 12:35:26.2585987 +0000 UTC m=+2684.959260528" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.290171 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.302441 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.302995 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.318368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.318371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.318440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-config-data" (OuterVolumeSpecName: "config-data") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.332437 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.334073 4769 scope.go:117] "RemoveContainer" containerID="279cb429f401675d3ac72bf3596f54e95cc544a0d649f24ae33dc1e13e0c94dc" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.373347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-config-data" (OuterVolumeSpecName: "config-data") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.376497 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.379117 4769 scope.go:117] "RemoveContainer" containerID="4be28df0047f0e9c1f4afba338f0e598149a1c05711d86e78a3c72f0e7b89616" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.383635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data" (OuterVolumeSpecName: "config-data") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.386902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.405069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.407136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-public-tls-certs\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.407337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76pg9\" (UniqueName: \"kubernetes.io/projected/f733c362-4230-41b3-92d3-dab29b01fc70-kube-api-access-76pg9\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.407416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data-custom\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.407605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-internal-tls-certs\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.407759 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f733c362-4230-41b3-92d3-dab29b01fc70-logs\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.407850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-combined-ca-bundle\") pod \"f733c362-4230-41b3-92d3-dab29b01fc70\" (UID: \"f733c362-4230-41b3-92d3-dab29b01fc70\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.410823 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.411009 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.411305 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.411402 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.411470 4769 reconciler_common.go:293] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.411544 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.412307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f733c362-4230-41b3-92d3-dab29b01fc70-logs" (OuterVolumeSpecName: "logs") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.413112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "78615e61-bc82-4c5d-baae-192881b1180c" (UID: "78615e61-bc82-4c5d-baae-192881b1180c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.413633 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.425856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.445323 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.456036 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.456513 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.480787 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.489196 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f733c362-4230-41b3-92d3-dab29b01fc70-kube-api-access-76pg9" (OuterVolumeSpecName: "kube-api-access-76pg9") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "kube-api-access-76pg9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.496428 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.496983 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.502569 4769 scope.go:117] "RemoveContainer" containerID="fc4f4aafd139d0ff4dcdf4b3a5e3bef1ca7be3d0e2866814597ceff90382a000" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.506628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-config-data" (OuterVolumeSpecName: "config-data") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9sg6\" (UniqueName: \"kubernetes.io/projected/c3e12002-b8fa-4005-8e29-a5259652a4c6-kube-api-access-k9sg6\") pod \"c3e12002-b8fa-4005-8e29-a5259652a4c6\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-operator-scripts\") pod \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt862\" (UniqueName: \"kubernetes.io/projected/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-kube-api-access-lt862\") pod \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data-custom\") pod \"c3e12002-b8fa-4005-8e29-a5259652a4c6\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data\") pod \"c3e12002-b8fa-4005-8e29-a5259652a4c6\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-logs\") pod \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvjhz\" (UniqueName: \"kubernetes.io/projected/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-kube-api-access-jvjhz\") pod \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\" (UID: \"dc5d568f-b5f7-4ef0-bc61-6ff2057e392f\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512793 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-config-data\") pod \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75p72\" (UniqueName: \"kubernetes.io/projected/311dff41-2849-4530-8dfd-c566e4ad5859-kube-api-access-75p72\") pod \"311dff41-2849-4530-8dfd-c566e4ad5859\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512885 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-combined-ca-bundle\") pod \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\" (UID: \"7ce95dd6-a420-4900-b156-9ab3e0d9afc2\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3e12002-b8fa-4005-8e29-a5259652a4c6-logs\") pod \"c3e12002-b8fa-4005-8e29-a5259652a4c6\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/311dff41-2849-4530-8dfd-c566e4ad5859-operator-scripts\") pod \"311dff41-2849-4530-8dfd-c566e4ad5859\" (UID: \"311dff41-2849-4530-8dfd-c566e4ad5859\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.512977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-combined-ca-bundle\") pod \"c3e12002-b8fa-4005-8e29-a5259652a4c6\" (UID: \"c3e12002-b8fa-4005-8e29-a5259652a4c6\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" (UID: "dc5d568f-b5f7-4ef0-bc61-6ff2057e392f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513370 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513384 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513397 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513408 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513418 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-76pg9\" (UniqueName: \"kubernetes.io/projected/f733c362-4230-41b3-92d3-dab29b01fc70-kube-api-access-76pg9\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513426 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.513434 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f733c362-4230-41b3-92d3-dab29b01fc70-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.513497 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.513548 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:27.51353133 +0000 UTC m=+2686.214193148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.514479 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/311dff41-2849-4530-8dfd-c566e4ad5859-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "311dff41-2849-4530-8dfd-c566e4ad5859" (UID: "311dff41-2849-4530-8dfd-c566e4ad5859"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.514767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e12002-b8fa-4005-8e29-a5259652a4c6-logs" (OuterVolumeSpecName: "logs") pod "c3e12002-b8fa-4005-8e29-a5259652a4c6" (UID: "c3e12002-b8fa-4005-8e29-a5259652a4c6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.519058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-logs" (OuterVolumeSpecName: "logs") pod "7ce95dd6-a420-4900-b156-9ab3e0d9afc2" (UID: "7ce95dd6-a420-4900-b156-9ab3e0d9afc2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.533000 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3e12002-b8fa-4005-8e29-a5259652a4c6-kube-api-access-k9sg6" (OuterVolumeSpecName: "kube-api-access-k9sg6") pod "c3e12002-b8fa-4005-8e29-a5259652a4c6" (UID: "c3e12002-b8fa-4005-8e29-a5259652a4c6"). InnerVolumeSpecName "kube-api-access-k9sg6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.533397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c3e12002-b8fa-4005-8e29-a5259652a4c6" (UID: "c3e12002-b8fa-4005-8e29-a5259652a4c6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.536883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311dff41-2849-4530-8dfd-c566e4ad5859-kube-api-access-75p72" (OuterVolumeSpecName: "kube-api-access-75p72") pod "311dff41-2849-4530-8dfd-c566e4ad5859" (UID: "311dff41-2849-4530-8dfd-c566e4ad5859"). InnerVolumeSpecName "kube-api-access-75p72". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.538729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-kube-api-access-jvjhz" (OuterVolumeSpecName: "kube-api-access-jvjhz") pod "dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" (UID: "dc5d568f-b5f7-4ef0-bc61-6ff2057e392f"). InnerVolumeSpecName "kube-api-access-jvjhz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.544678 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-kube-api-access-lt862" (OuterVolumeSpecName: "kube-api-access-lt862") pod "7ce95dd6-a420-4900-b156-9ab3e0d9afc2" (UID: "7ce95dd6-a420-4900-b156-9ab3e0d9afc2"). InnerVolumeSpecName "kube-api-access-lt862". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.549955 4769 scope.go:117] "RemoveContainer" containerID="b17b8e96729770d76315fddd7ecd4a7f0e5003295d85b39ac30e920ed433ac79" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.552918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.573673 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.580401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" (UID: "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.590551 4769 scope.go:117] "RemoveContainer" containerID="1fdef3e6e93388772337b720e9298d8a88b15167af782f94c037331ba1452593" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.590990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.623846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-kolla-config\") pod \"9d322e5e-caf1-47f5-a352-9508f797537d\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.624056 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-config-data\") pod \"9d322e5e-caf1-47f5-a352-9508f797537d\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.624215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mpds\" (UniqueName: \"kubernetes.io/projected/9d322e5e-caf1-47f5-a352-9508f797537d-kube-api-access-7mpds\") pod \"9d322e5e-caf1-47f5-a352-9508f797537d\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.624341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-memcached-tls-certs\") pod \"9d322e5e-caf1-47f5-a352-9508f797537d\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.624471 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-combined-ca-bundle\") pod \"9d322e5e-caf1-47f5-a352-9508f797537d\" (UID: \"9d322e5e-caf1-47f5-a352-9508f797537d\") " Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.624840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9d322e5e-caf1-47f5-a352-9508f797537d" (UID: "9d322e5e-caf1-47f5-a352-9508f797537d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.624969 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-config-data" (OuterVolumeSpecName: "config-data") pod "9d322e5e-caf1-47f5-a352-9508f797537d" (UID: "9d322e5e-caf1-47f5-a352-9508f797537d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625303 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625330 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625346 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jvjhz\" (UniqueName: \"kubernetes.io/projected/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f-kube-api-access-jvjhz\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625365 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75p72\" (UniqueName: \"kubernetes.io/projected/311dff41-2849-4530-8dfd-c566e4ad5859-kube-api-access-75p72\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625377 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c3e12002-b8fa-4005-8e29-a5259652a4c6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625392 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/311dff41-2849-4530-8dfd-c566e4ad5859-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625404 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625417 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625430 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625445 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k9sg6\" (UniqueName: \"kubernetes.io/projected/c3e12002-b8fa-4005-8e29-a5259652a4c6-kube-api-access-k9sg6\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625459 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lt862\" (UniqueName: \"kubernetes.io/projected/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-kube-api-access-lt862\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625472 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625483 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9d322e5e-caf1-47f5-a352-9508f797537d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.625496 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.634532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d322e5e-caf1-47f5-a352-9508f797537d-kube-api-access-7mpds" (OuterVolumeSpecName: "kube-api-access-7mpds") pod "9d322e5e-caf1-47f5-a352-9508f797537d" (UID: "9d322e5e-caf1-47f5-a352-9508f797537d"). InnerVolumeSpecName "kube-api-access-7mpds". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.634773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0c41b549-737e-4157-bbd6-e049ab34a8e4" (UID: "0c41b549-737e-4157-bbd6-e049ab34a8e4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.636645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.648061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.654954 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.662366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "78615e61-bc82-4c5d-baae-192881b1180c" (UID: "78615e61-bc82-4c5d-baae-192881b1180c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.667901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-config-data" (OuterVolumeSpecName: "config-data") pod "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" (UID: "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.679357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "78615e61-bc82-4c5d-baae-192881b1180c" (UID: "78615e61-bc82-4c5d-baae-192881b1180c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.683069 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ce95dd6-a420-4900-b156-9ab3e0d9afc2" (UID: "7ce95dd6-a420-4900-b156-9ab3e0d9afc2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.683291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d322e5e-caf1-47f5-a352-9508f797537d" (UID: "9d322e5e-caf1-47f5-a352-9508f797537d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.687160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.689315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c3e12002-b8fa-4005-8e29-a5259652a4c6" (UID: "c3e12002-b8fa-4005-8e29-a5259652a4c6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.694749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" (UID: "8c6c3cfb-b016-466d-abb7-ec5fcaa0344b"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.710921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" (UID: "a0ceb8bd-b9c0-45be-a8ad-5c23341007e9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.711736 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c194df7b-a418-440d-a1a6-5772c7ed5b32" (UID: "c194df7b-a418-440d-a1a6-5772c7ed5b32"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.714256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.715865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-config-data" (OuterVolumeSpecName: "config-data") pod "7ce95dd6-a420-4900-b156-9ab3e0d9afc2" (UID: "7ce95dd6-a420-4900-b156-9ab3e0d9afc2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.721457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4347fb32-914b-4f7d-b004-fbf9f37ad56a" (UID: "4347fb32-914b-4f7d-b004-fbf9f37ad56a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.726559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data" (OuterVolumeSpecName: "config-data") pod "f733c362-4230-41b3-92d3-dab29b01fc70" (UID: "f733c362-4230-41b3-92d3-dab29b01fc70"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.732214 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.732467 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c194df7b-a418-440d-a1a6-5772c7ed5b32-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.732531 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.732614 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.732881 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.732969 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mpds\" (UniqueName: \"kubernetes.io/projected/9d322e5e-caf1-47f5-a352-9508f797537d-kube-api-access-7mpds\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733068 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4347fb32-914b-4f7d-b004-fbf9f37ad56a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733150 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733257 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733464 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733546 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733605 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733678 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733736 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce95dd6-a420-4900-b156-9ab3e0d9afc2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733794 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733862 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733921 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c41b549-737e-4157-bbd6-e049ab34a8e4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.733980 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/78615e61-bc82-4c5d-baae-192881b1180c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.734050 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f733c362-4230-41b3-92d3-dab29b01fc70-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.735588 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.740019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "9d322e5e-caf1-47f5-a352-9508f797537d" (UID: "9d322e5e-caf1-47f5-a352-9508f797537d"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.740344 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.742536 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:35:26 crc kubenswrapper[4769]: E1121 12:35:26.742576 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" containerName="nova-scheduler-scheduler" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.742792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.749305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" (UID: "fe4e424a-52f7-4cb6-bd2d-4c6c6e719090"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.751857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data" (OuterVolumeSpecName: "config-data") pod "c3e12002-b8fa-4005-8e29-a5259652a4c6" (UID: "c3e12002-b8fa-4005-8e29-a5259652a4c6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.836430 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.836488 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d322e5e-caf1-47f5-a352-9508f797537d-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.836500 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3e12002-b8fa-4005-8e29-a5259652a4c6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.836510 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.853102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" event={"ID":"18dea187-c7dd-4482-83ea-9c36d754313d","Type":"ContainerStarted","Data":"8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2"} Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.855278 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.855566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-applier-0" event={"ID":"7ce95dd6-a420-4900-b156-9ab3e0d9afc2","Type":"ContainerDied","Data":"e778894510fcc22140e361d5231933d9295088ffd6668a8d430117b4c181df53"} Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.855690 4769 scope.go:117] "RemoveContainer" containerID="213f9ea3194013ecaee79afa159cf3a2b120245fd63b76cac7077099315fd9e3" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.854435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-applier-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.865844 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.865987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"9d322e5e-caf1-47f5-a352-9508f797537d","Type":"ContainerDied","Data":"9ba3123d795894b2c7e17cff793e022a2ad7ac1f1504f9b29e46a8f4ebcb1b56"} Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866159 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866178 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866255 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8099-account-delete-25zgn" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866254 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance042f-account-delete-s5zpr" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866265 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866310 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866335 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866369 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866417 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-api-0" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.866015 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" secret="" err="secret \"galera-openstack-dockercfg-r6m8b\" not found" Nov 21 12:35:26 crc kubenswrapper[4769]: I1121 12:35:26.889321 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" podStartSLOduration=7.8892953949999995 podStartE2EDuration="7.889295395s" podCreationTimestamp="2025-11-21 12:35:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:35:26.888430422 +0000 UTC m=+2685.589092260" watchObservedRunningTime="2025-11-21 12:35:26.889295395 +0000 UTC m=+2685.589957213" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.005710 4769 scope.go:117] "RemoveContainer" containerID="6d1ef35e7c2e8dcfbf2420aa494282a720fa09f16930951bf6e98ca866737536" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.064772 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.081874 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.095740 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.112265 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-d9db648c6-6lx4s"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.123924 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.138099 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-applier-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.149615 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.157649 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.170329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.182118 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.202631 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.210484 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.233446 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.244360 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.244532 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0 podName:a1fe319d-547f-4eae-a3cb-3f7f47f8af29 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:35.244499069 +0000 UTC m=+2693.945161087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0") pod "dnsmasq-dnsmasq-7799499c75-q9p8r" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29") : configmap "dns-swift-storage-0" not found Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.247014 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.258573 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.267978 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.294233 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f66499-aa3b-4400-a0fa-a059a70e64bf" path="/var/lib/kubelet/pods/11f66499-aa3b-4400-a0fa-a059a70e64bf/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.295117 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" path="/var/lib/kubelet/pods/4347fb32-914b-4f7d-b004-fbf9f37ad56a/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.295846 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" path="/var/lib/kubelet/pods/5afe14b3-c830-484e-837e-3dd0cdd61413/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.297651 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78615e61-bc82-4c5d-baae-192881b1180c" path="/var/lib/kubelet/pods/78615e61-bc82-4c5d-baae-192881b1180c/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.298620 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" path="/var/lib/kubelet/pods/7ce95dd6-a420-4900-b156-9ab3e0d9afc2/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.300185 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" path="/var/lib/kubelet/pods/84013f03-f2eb-47c2-86c7-7a3d707ed64e/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.301631 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" path="/var/lib/kubelet/pods/8c6c3cfb-b016-466d-abb7-ec5fcaa0344b/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.302951 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" path="/var/lib/kubelet/pods/9244abb6-e799-4f0d-9af5-a506ee5c835f/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.304061 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d322e5e-caf1-47f5-a352-9508f797537d" path="/var/lib/kubelet/pods/9d322e5e-caf1-47f5-a352-9508f797537d/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.304846 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" path="/var/lib/kubelet/pods/a0ceb8bd-b9c0-45be-a8ad-5c23341007e9/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.306148 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" path="/var/lib/kubelet/pods/c194df7b-a418-440d-a1a6-5772c7ed5b32/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.306955 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" path="/var/lib/kubelet/pods/f733c362-4230-41b3-92d3-dab29b01fc70/volumes" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.307804 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.307868 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.307888 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6c9bd6f466-wzz6c"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.307903 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6c9bd6f466-wzz6c"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.309906 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq"] Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.316703 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-75dc6c79cd-sbdsq"] Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.316997 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.327100 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.329033 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.329130 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerName="nova-cell1-conductor-conductor" Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.551760 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:27 crc kubenswrapper[4769]: E1121 12:35:27.552227 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:29.552207366 +0000 UTC m=+2688.252869184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.657439 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.665568 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-public-tls-certs\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-erlang-cookie\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-config-data\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-tls\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-scripts\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f24e626c-11ec-4d3d-a065-822b13a8b8b0-erlang-cookie-secret\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kbx\" (UniqueName: \"kubernetes.io/projected/ea67e490-4830-43fd-9c9f-c7fdee996bdb-kube-api-access-c9kbx\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-plugins\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-credential-keys\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756899 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.756928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-fernet-keys\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.757057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f24e626c-11ec-4d3d-a065-822b13a8b8b0-pod-info\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.757115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc8bd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-kube-api-access-cc8bd\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.757142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-confd\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.757167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-plugins-conf\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.757221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-combined-ca-bundle\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.757258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-internal-tls-certs\") pod \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\" (UID: \"ea67e490-4830-43fd-9c9f-c7fdee996bdb\") " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.758465 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.761059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.766332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.766581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.767812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "persistence") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.770426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f24e626c-11ec-4d3d-a065-822b13a8b8b0-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.782639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f24e626c-11ec-4d3d-a065-822b13a8b8b0-pod-info" (OuterVolumeSpecName: "pod-info") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.785703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-scripts" (OuterVolumeSpecName: "scripts") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.804972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea67e490-4830-43fd-9c9f-c7fdee996bdb-kube-api-access-c9kbx" (OuterVolumeSpecName: "kube-api-access-c9kbx") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "kube-api-access-c9kbx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.805617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.806257 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.807606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-kube-api-access-cc8bd" (OuterVolumeSpecName: "kube-api-access-cc8bd") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "kube-api-access-cc8bd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.812907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-config-data" (OuterVolumeSpecName: "config-data") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.814463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.824426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data" (OuterVolumeSpecName: "config-data") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.850381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.859705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf" (OuterVolumeSpecName: "server-conf") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.860109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf\") pod \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\" (UID: \"f24e626c-11ec-4d3d-a065-822b13a8b8b0\") " Nov 21 12:35:27 crc kubenswrapper[4769]: W1121 12:35:27.860773 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/f24e626c-11ec-4d3d-a065-822b13a8b8b0/volumes/kubernetes.io~configmap/server-conf Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.860799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf" (OuterVolumeSpecName: "server-conf") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.860957 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.860984 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861005 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861019 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f24e626c-11ec-4d3d-a065-822b13a8b8b0-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861035 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861049 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c9kbx\" (UniqueName: \"kubernetes.io/projected/ea67e490-4830-43fd-9c9f-c7fdee996bdb-kube-api-access-c9kbx\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.860979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ea67e490-4830-43fd-9c9f-c7fdee996bdb" (UID: "ea67e490-4830-43fd-9c9f-c7fdee996bdb"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861065 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861141 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861199 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861214 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f24e626c-11ec-4d3d-a065-822b13a8b8b0-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861229 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cc8bd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-kube-api-access-cc8bd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861243 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f24e626c-11ec-4d3d-a065-822b13a8b8b0-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861256 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861267 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861300 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.861313 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.887423 4769 generic.go:334] "Generic (PLEG): container finished" podID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerID="4bedff8d1dc16707eec95a4e52fed146d1162c72aeab15c070f8e0c403d044d5" exitCode=0 Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.887493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5a9907bd-b1c1-4130-aa95-de70c92e4743","Type":"ContainerDied","Data":"4bedff8d1dc16707eec95a4e52fed146d1162c72aeab15c070f8e0c403d044d5"} Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.887519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"5a9907bd-b1c1-4130-aa95-de70c92e4743","Type":"ContainerDied","Data":"771aa82b1682f033308bc2c0d5a998fb33d3835a64ce546b9b55a8073085a4b9"} Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.887531 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="771aa82b1682f033308bc2c0d5a998fb33d3835a64ce546b9b55a8073085a4b9" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.890689 4769 generic.go:334] "Generic (PLEG): container finished" podID="ea67e490-4830-43fd-9c9f-c7fdee996bdb" containerID="c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c" exitCode=0 Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.890984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" event={"ID":"ea67e490-4830-43fd-9c9f-c7fdee996bdb","Type":"ContainerDied","Data":"c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c"} Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.891025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" event={"ID":"ea67e490-4830-43fd-9c9f-c7fdee996bdb","Type":"ContainerDied","Data":"8aee9b2e05a60a58cf945d3bb06ceadf85c291d8f05a8fa81765a62b45354a55"} Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.891049 4769 scope.go:117] "RemoveContainer" containerID="c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.891948 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-596f95c558-6zbwv" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.894801 4769 generic.go:334] "Generic (PLEG): container finished" podID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerID="cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87" exitCode=0 Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.894877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.894961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"f24e626c-11ec-4d3d-a065-822b13a8b8b0","Type":"ContainerDied","Data":"cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87"} Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.895127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"f24e626c-11ec-4d3d-a065-822b13a8b8b0","Type":"ContainerDied","Data":"66bba5e09ac7ed3afbd13f9200bfdf72f56a16f15394cf9c0bff53341f9f0b57"} Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.898845 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.925663 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "f24e626c-11ec-4d3d-a065-822b13a8b8b0" (UID: "f24e626c-11ec-4d3d-a065-822b13a8b8b0"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.962917 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f24e626c-11ec-4d3d-a065-822b13a8b8b0-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.962944 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea67e490-4830-43fd-9c9f-c7fdee996bdb-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.962954 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:27 crc kubenswrapper[4769]: I1121 12:35:27.989485 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.002344 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-596f95c558-6zbwv"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.009604 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-596f95c558-6zbwv"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.011516 4769 scope.go:117] "RemoveContainer" containerID="c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c" Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.012308 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c\": container with ID starting with c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c not found: ID does not exist" containerID="c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.012343 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c"} err="failed to get container status \"c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c\": rpc error: code = NotFound desc = could not find container \"c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c\": container with ID starting with c5affa312682cd9513149f6a86e8244651c96d72dfb602811819f9604cbfc22c not found: ID does not exist" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.012363 4769 scope.go:117] "RemoveContainer" containerID="cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.028770 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.222:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.029166 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.222:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.045014 4769 scope.go:117] "RemoveContainer" containerID="c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-generated\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-operator-scripts\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-galera-tls-certs\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-combined-ca-bundle\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsfbm\" (UniqueName: \"kubernetes.io/projected/5a9907bd-b1c1-4130-aa95-de70c92e4743-kube-api-access-fsfbm\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-kolla-config\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-default\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.063989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"5a9907bd-b1c1-4130-aa95-de70c92e4743\" (UID: \"5a9907bd-b1c1-4130-aa95-de70c92e4743\") " Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.064493 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.064556 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:35:32.064538032 +0000 UTC m=+2690.765199850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.065281 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.066053 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.066587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.069784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.084160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "mysql-db") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.088436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9907bd-b1c1-4130-aa95-de70c92e4743-kube-api-access-fsfbm" (OuterVolumeSpecName: "kube-api-access-fsfbm") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "kube-api-access-fsfbm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.095785 4769 scope.go:117] "RemoveContainer" containerID="cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87" Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.096199 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87\": container with ID starting with cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87 not found: ID does not exist" containerID="cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.096245 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87"} err="failed to get container status \"cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87\": rpc error: code = NotFound desc = could not find container \"cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87\": container with ID starting with cd9e6e5031868d962c6715c8807bfb74179ae04760dcada70178342479e94b87 not found: ID does not exist" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.096298 4769 scope.go:117] "RemoveContainer" containerID="c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345" Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.100366 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345\": container with ID starting with c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345 not found: ID does not exist" containerID="c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.100396 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345"} err="failed to get container status \"c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345\": rpc error: code = NotFound desc = could not find container \"c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345\": container with ID starting with c106ea557d2f6e7654ef13263497662a9d9b7096dd82a35f83cb7c11717ad345 not found: ID does not exist" Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.103436 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.106144 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.107460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.107880 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:35:28 crc kubenswrapper[4769]: E1121 12:35:28.107919 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.135320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "5a9907bd-b1c1-4130-aa95-de70c92e4743" (UID: "5a9907bd-b1c1-4130-aa95-de70c92e4743"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.140210 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4dd9c"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.148959 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4dd9c"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.165407 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166366 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166415 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166427 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/5a9907bd-b1c1-4130-aa95-de70c92e4743-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166436 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166444 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166452 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a9907bd-b1c1-4130-aa95-de70c92e4743-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166460 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fsfbm\" (UniqueName: \"kubernetes.io/projected/5a9907bd-b1c1-4130-aa95-de70c92e4743-kube-api-access-fsfbm\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.166468 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/5a9907bd-b1c1-4130-aa95-de70c92e4743-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.178239 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.182322 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.186242 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-e5ba-account-create-vtsrt"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.189348 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbicane5ba-account-delete-bcnkw"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.268024 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.276879 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.284048 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.288737 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kwg7w"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.296482 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kwg7w"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.302296 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance042f-account-delete-s5zpr"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.310546 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-042f-account-create-d6wlb"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.321224 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance042f-account-delete-s5zpr"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.331725 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-042f-account-create-d6wlb"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.348990 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-nkrnv"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.355101 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-nkrnv"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.365010 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder8099-account-delete-25zgn"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.374329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-8099-account-create-62dl6"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.381409 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder8099-account-delete-25zgn"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.388079 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-8099-account-create-62dl6"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.458815 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-r6n9r"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.467081 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-db-create-r6n9r"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.479565 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-89e7-account-create-lg4rr"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.493086 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-89e7-account-create-lg4rr"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.497906 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher89e7-account-delete-6hz9b"] Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.498111 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" podUID="4008318b-1790-42b2-b86e-f1c1919e9da8" containerName="mariadb-account-delete" containerID="cri-o://08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e" gracePeriod=30 Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.757270 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a769253b-cd90-4510-9310-26a922996a2c/ovn-northd/0.log" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.757834 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.824163 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.878971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30133c6e-1e49-4adb-b996-03816171b3d8-logs\") pod \"30133c6e-1e49-4adb-b996-03816171b3d8\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data\") pod \"30133c6e-1e49-4adb-b996-03816171b3d8\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zpq4\" (UniqueName: \"kubernetes.io/projected/30133c6e-1e49-4adb-b996-03816171b3d8-kube-api-access-6zpq4\") pod \"30133c6e-1e49-4adb-b996-03816171b3d8\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879081 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-scripts\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-ovn-northd-tls-certs\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data-custom\") pod \"30133c6e-1e49-4adb-b996-03816171b3d8\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-combined-ca-bundle\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879179 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-metrics-certs-tls-certs\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drn6m\" (UniqueName: \"kubernetes.io/projected/a769253b-cd90-4510-9310-26a922996a2c-kube-api-access-drn6m\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-combined-ca-bundle\") pod \"30133c6e-1e49-4adb-b996-03816171b3d8\" (UID: \"30133c6e-1e49-4adb-b996-03816171b3d8\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a769253b-cd90-4510-9310-26a922996a2c-ovn-rundir\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.879351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-config\") pod \"a769253b-cd90-4510-9310-26a922996a2c\" (UID: \"a769253b-cd90-4510-9310-26a922996a2c\") " Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.881305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-config" (OuterVolumeSpecName: "config") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.881610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30133c6e-1e49-4adb-b996-03816171b3d8-logs" (OuterVolumeSpecName: "logs") pod "30133c6e-1e49-4adb-b996-03816171b3d8" (UID: "30133c6e-1e49-4adb-b996-03816171b3d8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.885983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a769253b-cd90-4510-9310-26a922996a2c-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.886528 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "30133c6e-1e49-4adb-b996-03816171b3d8" (UID: "30133c6e-1e49-4adb-b996-03816171b3d8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.886820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-scripts" (OuterVolumeSpecName: "scripts") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.897220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30133c6e-1e49-4adb-b996-03816171b3d8-kube-api-access-6zpq4" (OuterVolumeSpecName: "kube-api-access-6zpq4") pod "30133c6e-1e49-4adb-b996-03816171b3d8" (UID: "30133c6e-1e49-4adb-b996-03816171b3d8"). InnerVolumeSpecName "kube-api-access-6zpq4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.900941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a769253b-cd90-4510-9310-26a922996a2c-kube-api-access-drn6m" (OuterVolumeSpecName: "kube-api-access-drn6m") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "kube-api-access-drn6m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.911212 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30133c6e-1e49-4adb-b996-03816171b3d8" (UID: "30133c6e-1e49-4adb-b996-03816171b3d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.915285 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a769253b-cd90-4510-9310-26a922996a2c/ovn-northd/0.log" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.915336 4769 generic.go:334] "Generic (PLEG): container finished" podID="a769253b-cd90-4510-9310-26a922996a2c" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" exitCode=139 Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.915390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a769253b-cd90-4510-9310-26a922996a2c","Type":"ContainerDied","Data":"0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502"} Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.915419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a769253b-cd90-4510-9310-26a922996a2c","Type":"ContainerDied","Data":"75cbbe6ee8847f7153217f21054ce7b5a60df0c8123847554094f9db86dfdb4a"} Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.915440 4769 scope.go:117] "RemoveContainer" containerID="b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.915573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.921143 4769 generic.go:334] "Generic (PLEG): container finished" podID="21166d92-cc4d-4b63-810d-4b80d10db159" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" exitCode=0 Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.921238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"21166d92-cc4d-4b63-810d-4b80d10db159","Type":"ContainerDied","Data":"26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580"} Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.923165 4769 generic.go:334] "Generic (PLEG): container finished" podID="30133c6e-1e49-4adb-b996-03816171b3d8" containerID="3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b" exitCode=0 Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.923246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" event={"ID":"30133c6e-1e49-4adb-b996-03816171b3d8","Type":"ContainerDied","Data":"3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b"} Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.923268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" event={"ID":"30133c6e-1e49-4adb-b996-03816171b3d8","Type":"ContainerDied","Data":"ef0fe7782b357d81f9f5f9106f6e6d1e2ef9cf3355ebe3e084437f968459d05d"} Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.923314 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.926861 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.927651 4769 generic.go:334] "Generic (PLEG): container finished" podID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" exitCode=0 Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.927732 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.929243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1","Type":"ContainerDied","Data":"efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3"} Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983240 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983398 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/30133c6e-1e49-4adb-b996-03816171b3d8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983422 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6zpq4\" (UniqueName: \"kubernetes.io/projected/30133c6e-1e49-4adb-b996-03816171b3d8-kube-api-access-6zpq4\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983457 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a769253b-cd90-4510-9310-26a922996a2c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983468 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983500 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983536 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-drn6m\" (UniqueName: \"kubernetes.io/projected/a769253b-cd90-4510-9310-26a922996a2c-kube-api-access-drn6m\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983549 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:28 crc kubenswrapper[4769]: I1121 12:35:28.983561 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a769253b-cd90-4510-9310-26a922996a2c-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.008369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data" (OuterVolumeSpecName: "config-data") pod "30133c6e-1e49-4adb-b996-03816171b3d8" (UID: "30133c6e-1e49-4adb-b996-03816171b3d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.009331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.010255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "a769253b-cd90-4510-9310-26a922996a2c" (UID: "a769253b-cd90-4510-9310-26a922996a2c"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.054741 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.060978 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.073152 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.075293 4769 scope.go:117] "RemoveContainer" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.081245 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.086171 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30133c6e-1e49-4adb-b996-03816171b3d8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.086218 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.086229 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a769253b-cd90-4510-9310-26a922996a2c-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.103111 4769 scope.go:117] "RemoveContainer" containerID="b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e" Nov 21 12:35:29 crc kubenswrapper[4769]: E1121 12:35:29.103704 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e\": container with ID starting with b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e not found: ID does not exist" containerID="b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.103747 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e"} err="failed to get container status \"b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e\": rpc error: code = NotFound desc = could not find container \"b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e\": container with ID starting with b98cff0e29ea557df06f7875f10cae1d2452dc4cfcbe40dec2aa7e62069ff80e not found: ID does not exist" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.103775 4769 scope.go:117] "RemoveContainer" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" Nov 21 12:35:29 crc kubenswrapper[4769]: E1121 12:35:29.104113 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502\": container with ID starting with 0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502 not found: ID does not exist" containerID="0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.104141 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502"} err="failed to get container status \"0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502\": rpc error: code = NotFound desc = could not find container \"0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502\": container with ID starting with 0a91a4df22a5bd9b4c30594d608fd0b603cd53cadcdcd8ec237f4f6b382ef502 not found: ID does not exist" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.104161 4769 scope.go:117] "RemoveContainer" containerID="3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.130358 4769 scope.go:117] "RemoveContainer" containerID="61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.159844 4769 scope.go:117] "RemoveContainer" containerID="3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b" Nov 21 12:35:29 crc kubenswrapper[4769]: E1121 12:35:29.162385 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b\": container with ID starting with 3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b not found: ID does not exist" containerID="3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.162433 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b"} err="failed to get container status \"3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b\": rpc error: code = NotFound desc = could not find container \"3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b\": container with ID starting with 3ab7f7a5e8fdcee266bc97adeb079323b3d3aa452065293ffbd3b8ffff9fbc0b not found: ID does not exist" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.162461 4769 scope.go:117] "RemoveContainer" containerID="61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e" Nov 21 12:35:29 crc kubenswrapper[4769]: E1121 12:35:29.162935 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e\": container with ID starting with 61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e not found: ID does not exist" containerID="61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.162963 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e"} err="failed to get container status \"61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e\": rpc error: code = NotFound desc = could not find container \"61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e\": container with ID starting with 61c908f27626dde1ec80a06f66ffd83ee027e4242a0da36e257d8d714542ed0e not found: ID does not exist" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.186864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-config-data\") pod \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.186930 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqdwd\" (UniqueName: \"kubernetes.io/projected/21166d92-cc4d-4b63-810d-4b80d10db159-kube-api-access-dqdwd\") pod \"21166d92-cc4d-4b63-810d-4b80d10db159\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.186986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-combined-ca-bundle\") pod \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.187026 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-combined-ca-bundle\") pod \"21166d92-cc4d-4b63-810d-4b80d10db159\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.187044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-config-data\") pod \"21166d92-cc4d-4b63-810d-4b80d10db159\" (UID: \"21166d92-cc4d-4b63-810d-4b80d10db159\") " Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.187148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vfh2\" (UniqueName: \"kubernetes.io/projected/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-kube-api-access-7vfh2\") pod \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\" (UID: \"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1\") " Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.190405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21166d92-cc4d-4b63-810d-4b80d10db159-kube-api-access-dqdwd" (OuterVolumeSpecName: "kube-api-access-dqdwd") pod "21166d92-cc4d-4b63-810d-4b80d10db159" (UID: "21166d92-cc4d-4b63-810d-4b80d10db159"). InnerVolumeSpecName "kube-api-access-dqdwd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.195627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-kube-api-access-7vfh2" (OuterVolumeSpecName: "kube-api-access-7vfh2") pod "5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" (UID: "5989e5c7-eddc-4b79-91e2-d6d0e9e805f1"). InnerVolumeSpecName "kube-api-access-7vfh2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.206666 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-config-data" (OuterVolumeSpecName: "config-data") pod "21166d92-cc4d-4b63-810d-4b80d10db159" (UID: "21166d92-cc4d-4b63-810d-4b80d10db159"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.208250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-config-data" (OuterVolumeSpecName: "config-data") pod "5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" (UID: "5989e5c7-eddc-4b79-91e2-d6d0e9e805f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.213560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "21166d92-cc4d-4b63-810d-4b80d10db159" (UID: "21166d92-cc4d-4b63-810d-4b80d10db159"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.214896 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" (UID: "5989e5c7-eddc-4b79-91e2-d6d0e9e805f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.256353 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.258056 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.264142 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.270000 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-767d7986dc-sbkmx"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.285040 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" path="/var/lib/kubelet/pods/0c41b549-737e-4157-bbd6-e049ab34a8e4/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.285880 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16f8dfc9-ba93-4d2a-ab96-be64590cc8fe" path="/var/lib/kubelet/pods/16f8dfc9-ba93-4d2a-ab96-be64590cc8fe/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.286368 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" path="/var/lib/kubelet/pods/18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.287358 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" path="/var/lib/kubelet/pods/30133c6e-1e49-4adb-b996-03816171b3d8/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.287872 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311dff41-2849-4530-8dfd-c566e4ad5859" path="/var/lib/kubelet/pods/311dff41-2849-4530-8dfd-c566e4ad5859/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.288433 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5f6836-a88c-4d4c-a151-a75156de76ab" path="/var/lib/kubelet/pods/4b5f6836-a88c-4d4c-a151-a75156de76ab/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289035 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289064 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289073 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21166d92-cc4d-4b63-810d-4b80d10db159-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289085 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7vfh2\" (UniqueName: \"kubernetes.io/projected/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-kube-api-access-7vfh2\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289096 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289105 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dqdwd\" (UniqueName: \"kubernetes.io/projected/21166d92-cc4d-4b63-810d-4b80d10db159-kube-api-access-dqdwd\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289335 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550f1ca2-df61-4e64-8079-b066525a6cc6" path="/var/lib/kubelet/pods/550f1ca2-df61-4e64-8079-b066525a6cc6/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.289899 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" path="/var/lib/kubelet/pods/5a9907bd-b1c1-4130-aa95-de70c92e4743/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.290560 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="851d6f07-b264-4db7-a1fb-aba1af1d7c3e" path="/var/lib/kubelet/pods/851d6f07-b264-4db7-a1fb-aba1af1d7c3e/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.291839 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d6808d8-72fa-46b2-adec-aa952bfe77c6" path="/var/lib/kubelet/pods/9d6808d8-72fa-46b2-adec-aa952bfe77c6/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.292611 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a769253b-cd90-4510-9310-26a922996a2c" path="/var/lib/kubelet/pods/a769253b-cd90-4510-9310-26a922996a2c/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.293134 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c102ea71-dfba-4c00-bb61-3b55554a237f" path="/var/lib/kubelet/pods/c102ea71-dfba-4c00-bb61-3b55554a237f/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.294064 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" path="/var/lib/kubelet/pods/c3e12002-b8fa-4005-8e29-a5259652a4c6/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.294719 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d46a9281-82de-4242-b23c-91b71b14fe20" path="/var/lib/kubelet/pods/d46a9281-82de-4242-b23c-91b71b14fe20/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.295366 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" path="/var/lib/kubelet/pods/dc5d568f-b5f7-4ef0-bc61-6ff2057e392f/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.296444 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea67e490-4830-43fd-9c9f-c7fdee996bdb" path="/var/lib/kubelet/pods/ea67e490-4830-43fd-9c9f-c7fdee996bdb/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.297262 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" path="/var/lib/kubelet/pods/f24e626c-11ec-4d3d-a065-822b13a8b8b0/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.298244 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3db03b1-50a8-456c-ab19-da73753636f1" path="/var/lib/kubelet/pods/f3db03b1-50a8-456c-ab19-da73753636f1/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.299556 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" path="/var/lib/kubelet/pods/fe4e424a-52f7-4cb6-bd2d-4c6c6e719090/volumes" Nov 21 12:35:29 crc kubenswrapper[4769]: E1121 12:35:29.599642 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:29 crc kubenswrapper[4769]: E1121 12:35:29.599888 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:33.599873334 +0000 UTC m=+2692.300535152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.941441 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.942641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"21166d92-cc4d-4b63-810d-4b80d10db159","Type":"ContainerDied","Data":"9bc5832ea470ff6caeab95fc94ddfe4fc93c87f2712c5bf6d43ddb49a20e687f"} Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.942704 4769 scope.go:117] "RemoveContainer" containerID="26f1aeadc2b57f7be3be7579fc6d8e588e1cf575eb146ca1fe490d932e3a2580" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.947324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"5989e5c7-eddc-4b79-91e2-d6d0e9e805f1","Type":"ContainerDied","Data":"e9107a3c73fcf62d3ad557020e6e5402303903d7c5dca5deb5b182735f403a8c"} Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.947413 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.961929 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.967225 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.975143 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.977439 4769 scope.go:117] "RemoveContainer" containerID="efb1614962ca9faf909fccbc670b2800af1a79e4fb53042fc204572169acf5d3" Nov 21 12:35:29 crc kubenswrapper[4769]: I1121 12:35:29.979967 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:35:30 crc kubenswrapper[4769]: I1121 12:35:30.768282 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.12:8775/\": context deadline exceeded" Nov 21 12:35:30 crc kubenswrapper[4769]: I1121 12:35:30.768340 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.12:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.099379 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.155366 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r"] Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.155634 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerName="dnsmasq-dns" containerID="cri-o://e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9" gracePeriod=10 Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.287663 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" path="/var/lib/kubelet/pods/21166d92-cc4d-4b63-810d-4b80d10db159/volumes" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.288886 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" path="/var/lib/kubelet/pods/5989e5c7-eddc-4b79-91e2-d6d0e9e805f1/volumes" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.584770 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-internal-tls-certs\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-ovndb-tls-certs\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605381 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-public-tls-certs\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-config\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4zhg\" (UniqueName: \"kubernetes.io/projected/8b184f71-6fcc-461e-902d-ec67e4abf4a2-kube-api-access-s4zhg\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-combined-ca-bundle\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.605634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-httpd-config\") pod \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\" (UID: \"8b184f71-6fcc-461e-902d-ec67e4abf4a2\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.629033 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.641626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b184f71-6fcc-461e-902d-ec67e4abf4a2-kube-api-access-s4zhg" (OuterVolumeSpecName: "kube-api-access-s4zhg") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "kube-api-access-s4zhg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.652219 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.674577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-config" (OuterVolumeSpecName: "config") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.685997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.686738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.693988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0\") pod \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dnsmasq-svc\") pod \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707213 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-config\") pod \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707241 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96x4d\" (UniqueName: \"kubernetes.io/projected/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-kube-api-access-96x4d\") pod \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\" (UID: \"a1fe319d-547f-4eae-a3cb-3f7f47f8af29\") " Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707705 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707727 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707746 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707759 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707770 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s4zhg\" (UniqueName: \"kubernetes.io/projected/8b184f71-6fcc-461e-902d-ec67e4abf4a2-kube-api-access-s4zhg\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.707782 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.710814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-kube-api-access-96x4d" (OuterVolumeSpecName: "kube-api-access-96x4d") pod "a1fe319d-547f-4eae-a3cb-3f7f47f8af29" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29"). InnerVolumeSpecName "kube-api-access-96x4d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.727495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "8b184f71-6fcc-461e-902d-ec67e4abf4a2" (UID: "8b184f71-6fcc-461e-902d-ec67e4abf4a2"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.746902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "a1fe319d-547f-4eae-a3cb-3f7f47f8af29" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.747805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "a1fe319d-547f-4eae-a3cb-3f7f47f8af29" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.748733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-config" (OuterVolumeSpecName: "config") pod "a1fe319d-547f-4eae-a3cb-3f7f47f8af29" (UID: "a1fe319d-547f-4eae-a3cb-3f7f47f8af29"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.808792 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.808822 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.808834 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-96x4d\" (UniqueName: \"kubernetes.io/projected/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-kube-api-access-96x4d\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.808843 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b184f71-6fcc-461e-902d-ec67e4abf4a2-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.808852 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/a1fe319d-547f-4eae-a3cb-3f7f47f8af29-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.984539 4769 generic.go:334] "Generic (PLEG): container finished" podID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerID="e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9" exitCode=0 Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.984577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" event={"ID":"a1fe319d-547f-4eae-a3cb-3f7f47f8af29","Type":"ContainerDied","Data":"e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9"} Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.984605 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.984712 4769 scope.go:117] "RemoveContainer" containerID="e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9" Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.985030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r" event={"ID":"a1fe319d-547f-4eae-a3cb-3f7f47f8af29","Type":"ContainerDied","Data":"c0b0ebad97f7323a0d9a4339fb599713fb683980609ddf8f463b29f1e1bde80a"} Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.987722 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerID="433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8" exitCode=0 Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.987775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" event={"ID":"8b184f71-6fcc-461e-902d-ec67e4abf4a2","Type":"ContainerDied","Data":"433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8"} Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.987805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" event={"ID":"8b184f71-6fcc-461e-902d-ec67e4abf4a2","Type":"ContainerDied","Data":"da71116e960032c4a5d8c613babe7a2cb5f99c248a311f951ddfed15f40dd5b8"} Nov 21 12:35:31 crc kubenswrapper[4769]: I1121 12:35:31.987824 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5b77df46b6-njhcp" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.011235 4769 scope.go:117] "RemoveContainer" containerID="0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.032770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5b77df46b6-njhcp"] Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.043297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5b77df46b6-njhcp"] Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.050520 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r"] Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.057216 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7799499c75-q9p8r"] Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.061824 4769 scope.go:117] "RemoveContainer" containerID="e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9" Nov 21 12:35:32 crc kubenswrapper[4769]: E1121 12:35:32.062338 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9\": container with ID starting with e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9 not found: ID does not exist" containerID="e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.062369 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9"} err="failed to get container status \"e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9\": rpc error: code = NotFound desc = could not find container \"e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9\": container with ID starting with e78892580536cacee4e43e198244e5cac01ba7a12c06f3e3a3544e69a3a87fb9 not found: ID does not exist" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.062391 4769 scope.go:117] "RemoveContainer" containerID="0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc" Nov 21 12:35:32 crc kubenswrapper[4769]: E1121 12:35:32.062689 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc\": container with ID starting with 0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc not found: ID does not exist" containerID="0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.062708 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc"} err="failed to get container status \"0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc\": rpc error: code = NotFound desc = could not find container \"0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc\": container with ID starting with 0096fc6c260c892867b066c469d7bff9966dd935581162ec80e5e117d8ae4bdc not found: ID does not exist" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.062721 4769 scope.go:117] "RemoveContainer" containerID="1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.084929 4769 scope.go:117] "RemoveContainer" containerID="433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.110887 4769 scope.go:117] "RemoveContainer" containerID="1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767" Nov 21 12:35:32 crc kubenswrapper[4769]: E1121 12:35:32.111436 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767\": container with ID starting with 1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767 not found: ID does not exist" containerID="1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.111465 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767"} err="failed to get container status \"1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767\": rpc error: code = NotFound desc = could not find container \"1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767\": container with ID starting with 1068c946f237043e9278451a63596b271288293df2fbe2147d0f2b17b04e1767 not found: ID does not exist" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.111492 4769 scope.go:117] "RemoveContainer" containerID="433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8" Nov 21 12:35:32 crc kubenswrapper[4769]: E1121 12:35:32.111866 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8\": container with ID starting with 433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8 not found: ID does not exist" containerID="433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8" Nov 21 12:35:32 crc kubenswrapper[4769]: I1121 12:35:32.111916 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8"} err="failed to get container status \"433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8\": rpc error: code = NotFound desc = could not find container \"433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8\": container with ID starting with 433e22fb091cfacd8b531e8a60017ffd6fe8fa1d28486fdc528a68363ba0d0c8 not found: ID does not exist" Nov 21 12:35:32 crc kubenswrapper[4769]: E1121 12:35:32.112667 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:32 crc kubenswrapper[4769]: E1121 12:35:32.112723 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:35:40.112709079 +0000 UTC m=+2698.813370897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:33 crc kubenswrapper[4769]: I1121 12:35:33.292121 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" path="/var/lib/kubelet/pods/8b184f71-6fcc-461e-902d-ec67e4abf4a2/volumes" Nov 21 12:35:33 crc kubenswrapper[4769]: I1121 12:35:33.293004 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" path="/var/lib/kubelet/pods/a1fe319d-547f-4eae-a3cb-3f7f47f8af29/volumes" Nov 21 12:35:33 crc kubenswrapper[4769]: E1121 12:35:33.640544 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:33 crc kubenswrapper[4769]: E1121 12:35:33.640624 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:41.640606071 +0000 UTC m=+2700.341267889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:34 crc kubenswrapper[4769]: E1121 12:35:34.047853 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 12:35:34 crc kubenswrapper[4769]: E1121 12:35:34.047924 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:50.047907854 +0000 UTC m=+2708.748569672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "combined-ca-bundle" not found Nov 21 12:35:34 crc kubenswrapper[4769]: E1121 12:35:34.149067 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-metric-storage-prometheus-svc: secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:34 crc kubenswrapper[4769]: E1121 12:35:34.149215 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca podName:3cf7ced3-5726-46ea-852d-eef3d1cbc5fc nodeName:}" failed. No retries permitted until 2025-11-21 12:35:50.149156874 +0000 UTC m=+2708.849818732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "custom-prometheus-ca" (UniqueName: "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca") pod "watcher-decision-engine-0" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc") : secret "cert-metric-storage-prometheus-svc" not found Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.832184 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.870561 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-logs\") pod \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.870645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca\") pod \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.870665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle\") pod \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.870692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k4q8\" (UniqueName: \"kubernetes.io/projected/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-kube-api-access-4k4q8\") pod \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.870719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-config-data\") pod \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\" (UID: \"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc\") " Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.871475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-logs" (OuterVolumeSpecName: "logs") pod "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.878567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-kube-api-access-4k4q8" (OuterVolumeSpecName: "kube-api-access-4k4q8") pod "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc"). InnerVolumeSpecName "kube-api-access-4k4q8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.893616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.901982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca" (OuterVolumeSpecName: "custom-prometheus-ca") pod "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc"). InnerVolumeSpecName "custom-prometheus-ca". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.920166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-config-data" (OuterVolumeSpecName: "config-data") pod "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" (UID: "3cf7ced3-5726-46ea-852d-eef3d1cbc5fc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.972525 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.972567 4769 reconciler_common.go:293] "Volume detached for volume \"custom-prometheus-ca\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-custom-prometheus-ca\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.972582 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.972595 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4k4q8\" (UniqueName: \"kubernetes.io/projected/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-kube-api-access-4k4q8\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:35 crc kubenswrapper[4769]: I1121 12:35:35.972609 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.037008 4769 generic.go:334] "Generic (PLEG): container finished" podID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" exitCode=0 Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.037051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc","Type":"ContainerDied","Data":"7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6"} Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.037085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher-decision-engine-0" event={"ID":"3cf7ced3-5726-46ea-852d-eef3d1cbc5fc","Type":"ContainerDied","Data":"0b9a90b4341c5a06ddb57e457f43bcfe5a06ba5bce9a3168d4abdd560fb45157"} Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.037091 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher-decision-engine-0" Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.037106 4769 scope.go:117] "RemoveContainer" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.066454 4769 scope.go:117] "RemoveContainer" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" Nov 21 12:35:36 crc kubenswrapper[4769]: E1121 12:35:36.067055 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6\": container with ID starting with 7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6 not found: ID does not exist" containerID="7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6" Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.067141 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6"} err="failed to get container status \"7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6\": rpc error: code = NotFound desc = could not find container \"7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6\": container with ID starting with 7be8298d50f8481810fe80fddcde9364c84f84e4347056346be00e675797f8a6 not found: ID does not exist" Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.076653 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:35:36 crc kubenswrapper[4769]: I1121 12:35:36.089849 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher-decision-engine-0"] Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.288426 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" path="/var/lib/kubelet/pods/3cf7ced3-5726-46ea-852d-eef3d1cbc5fc/volumes" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291426 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-l84lp"] Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291693 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291723 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="sg-core" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291730 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="sg-core" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291747 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="ovsdbserver-sb" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291756 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="ovsdbserver-sb" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291766 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291773 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291789 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerName="setup-container" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291796 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerName="setup-container" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291804 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291810 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291816 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerName="rabbitmq" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291822 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerName="rabbitmq" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="init-config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291837 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="init-config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291849 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291856 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291872 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-api" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d322e5e-caf1-47f5-a352-9508f797537d" containerName="memcached" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291887 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d322e5e-caf1-47f5-a352-9508f797537d" containerName="memcached" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291902 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291914 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291920 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291929 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291935 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291946 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11f66499-aa3b-4400-a0fa-a059a70e64bf" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291952 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f66499-aa3b-4400-a0fa-a059a70e64bf" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291958 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291964 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291972 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.291989 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="alertmanager" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.291995 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="alertmanager" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292007 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292028 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292038 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292045 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292056 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-server" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292063 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-server" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292075 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292082 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292092 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292098 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-api" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292107 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="prometheus" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292113 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="prometheus" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="init-config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292126 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="init-config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292133 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292139 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292147 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-central-agent" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292153 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-central-agent" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292160 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292167 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292176 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292181 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292208 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="311dff41-2849-4530-8dfd-c566e4ad5859" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="311dff41-2849-4530-8dfd-c566e4ad5859" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292221 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292227 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292239 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerName="nova-cell1-conductor-conductor" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292245 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerName="nova-cell1-conductor-conductor" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292254 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerName="watcher-applier" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292260 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerName="watcher-applier" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292268 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292273 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292283 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292288 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292302 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerName="galera" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292308 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerName="galera" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292317 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerName="init" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292322 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerName="init" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292330 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" containerName="watcher-decision-engine" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292336 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" containerName="watcher-decision-engine" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerName="mysql-bootstrap" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerName="mysql-bootstrap" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292365 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ea67e490-4830-43fd-9c9f-c7fdee996bdb" containerName="keystone-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292372 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea67e490-4830-43fd-9c9f-c7fdee996bdb" containerName="keystone-api" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="ovsdbserver-nb" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292403 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="ovsdbserver-nb" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292408 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292414 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292428 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6dc4e7b0-25bf-4452-9e52-b03e773e485a" containerName="kube-state-metrics" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292444 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc4e7b0-25bf-4452-9e52-b03e773e485a" containerName="kube-state-metrics" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292451 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292457 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292463 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" containerName="nova-scheduler-scheduler" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292469 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" containerName="nova-scheduler-scheduler" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292478 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="proxy-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292485 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="proxy-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292496 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292501 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292512 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerName="dnsmasq-dns" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292517 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerName="dnsmasq-dns" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292526 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292532 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292540 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="thanos-sidecar" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292545 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="thanos-sidecar" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292556 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-notification-agent" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292563 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-notification-agent" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292571 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292585 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292591 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292599 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292604 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292620 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-log" Nov 21 12:35:37 crc kubenswrapper[4769]: E1121 12:35:37.292631 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292636 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292774 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc5d568f-b5f7-4ef0-bc61-6ff2057e392f" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292790 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ce95dd6-a420-4900-b156-9ab3e0d9afc2" containerName="watcher-applier" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292802 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292810 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="ovn-northd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292817 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3cf7ced3-5726-46ea-852d-eef3d1cbc5fc" containerName="watcher-decision-engine" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292825 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292833 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292843 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a769253b-cd90-4510-9310-26a922996a2c" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292851 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f24e626c-11ec-4d3d-a065-822b13a8b8b0" containerName="rabbitmq" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292859 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6dc4e7b0-25bf-4452-9e52-b03e773e485a" containerName="kube-state-metrics" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292869 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292877 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="18e7dc87-de3f-4bcb-99c8-d4f2830ad7e3" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4347fb32-914b-4f7d-b004-fbf9f37ad56a" containerName="watcher-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292893 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="11f66499-aa3b-4400-a0fa-a059a70e64bf" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292901 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ea67e490-4830-43fd-9c9f-c7fdee996bdb" containerName="keystone-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-server" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292915 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="config-reloader" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292924 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="311dff41-2849-4530-8dfd-c566e4ad5859" containerName="mariadb-account-delete" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292934 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292941 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-metadata" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292949 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d322e5e-caf1-47f5-a352-9508f797537d" containerName="memcached" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292957 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292968 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292978 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="prometheus" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292985 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="sg-core" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.292995 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293003 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b184f71-6fcc-461e-902d-ec67e4abf4a2" containerName="neutron-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293013 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293021 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c6c3cfb-b016-466d-abb7-ec5fcaa0344b" containerName="nova-metadata-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293030 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30133c6e-1e49-4adb-b996-03816171b3d8" containerName="barbican-worker" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78615e61-bc82-4c5d-baae-192881b1180c" containerName="nova-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293046 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-notification-agent" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293055 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="ceilometer-central-agent" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5a9907bd-b1c1-4130-aa95-de70c92e4743" containerName="galera" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293071 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="ovsdbserver-sb" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="84013f03-f2eb-47c2-86c7-7a3d707ed64e" containerName="thanos-sidecar" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293090 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293097 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a1fe319d-547f-4eae-a3cb-3f7f47f8af29" containerName="dnsmasq-dns" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293105 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="358a84ed-d9ff-4fd8-a429-0e1f81b00f43" containerName="openstack-network-exporter" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293111 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c3e12002-b8fa-4005-8e29-a5259652a4c6" containerName="barbican-keystone-listener-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293120 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe4e424a-52f7-4cb6-bd2d-4c6c6e719090" containerName="placement-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293127 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293132 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0ceb8bd-b9c0-45be-a8ad-5c23341007e9" containerName="glance-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293143 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5afe14b3-c830-484e-837e-3dd0cdd61413" containerName="proxy-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293152 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293159 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60668a6c-9603-4d1d-b0b4-20fcad3a7b1a" containerName="alertmanager" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293164 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5989e5c7-eddc-4b79-91e2-d6d0e9e805f1" containerName="nova-cell1-conductor-conductor" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293173 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c41b549-737e-4157-bbd6-e049ab34a8e4" containerName="cinder-api" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293181 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9244abb6-e799-4f0d-9af5-a506ee5c835f" containerName="ovsdbserver-nb" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293204 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" containerName="proxy-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293214 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c194df7b-a418-440d-a1a6-5772c7ed5b32" containerName="glance-httpd" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293220 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f733c362-4230-41b3-92d3-dab29b01fc70" containerName="barbican-api-log" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.293230 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21166d92-cc4d-4b63-810d-4b80d10db159" containerName="nova-scheduler-scheduler" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.295262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.298487 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-l84lp"] Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.403656 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-catalog-content\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.403715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkb2\" (UniqueName: \"kubernetes.io/projected/60760808-dcb5-45d5-9ee8-af52bb3389b3-kube-api-access-jxkb2\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.403754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-utilities\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.504929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-utilities\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.505297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-catalog-content\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.505395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkb2\" (UniqueName: \"kubernetes.io/projected/60760808-dcb5-45d5-9ee8-af52bb3389b3-kube-api-access-jxkb2\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.505656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-catalog-content\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.505815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-utilities\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.529961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkb2\" (UniqueName: \"kubernetes.io/projected/60760808-dcb5-45d5-9ee8-af52bb3389b3-kube-api-access-jxkb2\") pod \"community-operators-l84lp\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:37 crc kubenswrapper[4769]: I1121 12:35:37.627259 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:38 crc kubenswrapper[4769]: I1121 12:35:38.126743 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-l84lp"] Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.088934 4769 generic.go:334] "Generic (PLEG): container finished" podID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerID="23edb2346f3b45d2d19b428000cbc1ff24fd76e183f92645f5f58bdb206d78c1" exitCode=0 Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.089363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-l84lp" event={"ID":"60760808-dcb5-45d5-9ee8-af52bb3389b3","Type":"ContainerDied","Data":"23edb2346f3b45d2d19b428000cbc1ff24fd76e183f92645f5f58bdb206d78c1"} Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.089394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-l84lp" event={"ID":"60760808-dcb5-45d5-9ee8-af52bb3389b3","Type":"ContainerStarted","Data":"1d8af92f7dfdb64f3f3f05b4fd4991f7b3ccb4f92d08f70348cfce5d77b6289b"} Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.684339 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-cz7w9"] Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.687602 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.692786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cz7w9"] Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.741471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-utilities\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.741823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9dm\" (UniqueName: \"kubernetes.io/projected/4ad00184-6357-4f2b-82b1-20104eca1bac-kube-api-access-4k9dm\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.742314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-catalog-content\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.843656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-utilities\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.843807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9dm\" (UniqueName: \"kubernetes.io/projected/4ad00184-6357-4f2b-82b1-20104eca1bac-kube-api-access-4k9dm\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.843884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-catalog-content\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.844318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-utilities\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.844370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-catalog-content\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:39 crc kubenswrapper[4769]: I1121 12:35:39.868350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9dm\" (UniqueName: \"kubernetes.io/projected/4ad00184-6357-4f2b-82b1-20104eca1bac-kube-api-access-4k9dm\") pod \"redhat-operators-cz7w9\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:40 crc kubenswrapper[4769]: I1121 12:35:40.018063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:40 crc kubenswrapper[4769]: E1121 12:35:40.152197 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:40 crc kubenswrapper[4769]: E1121 12:35:40.152636 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:35:56.152611627 +0000 UTC m=+2714.853273445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:40 crc kubenswrapper[4769]: I1121 12:35:40.511992 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-cz7w9"] Nov 21 12:35:41 crc kubenswrapper[4769]: I1121 12:35:41.124020 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerID="e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893" exitCode=0 Nov 21 12:35:41 crc kubenswrapper[4769]: I1121 12:35:41.124126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerDied","Data":"e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893"} Nov 21 12:35:41 crc kubenswrapper[4769]: I1121 12:35:41.124930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerStarted","Data":"7fb4c89203c0185dc81bb7f43f16e8a940739c2f6ff6c4ab7c173d0d33f7551a"} Nov 21 12:35:41 crc kubenswrapper[4769]: I1121 12:35:41.134331 4769 generic.go:334] "Generic (PLEG): container finished" podID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerID="63f8c3b5a991669b6f8333e49b7d146449455e535d4a66a9a8aed9ac32a3130e" exitCode=0 Nov 21 12:35:41 crc kubenswrapper[4769]: I1121 12:35:41.134366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-l84lp" event={"ID":"60760808-dcb5-45d5-9ee8-af52bb3389b3","Type":"ContainerDied","Data":"63f8c3b5a991669b6f8333e49b7d146449455e535d4a66a9a8aed9ac32a3130e"} Nov 21 12:35:41 crc kubenswrapper[4769]: E1121 12:35:41.678303 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:41 crc kubenswrapper[4769]: E1121 12:35:41.678400 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:35:57.678377822 +0000 UTC m=+2716.379039710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:42 crc kubenswrapper[4769]: I1121 12:35:42.148058 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerStarted","Data":"5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0"} Nov 21 12:35:42 crc kubenswrapper[4769]: I1121 12:35:42.153249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-l84lp" event={"ID":"60760808-dcb5-45d5-9ee8-af52bb3389b3","Type":"ContainerStarted","Data":"789e7e1c7841de05c19e64065275f27d312bff43e4d500e0bcf681a176abd80e"} Nov 21 12:35:42 crc kubenswrapper[4769]: I1121 12:35:42.194481 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-l84lp" podStartSLOduration=2.724512795 podStartE2EDuration="5.194377026s" podCreationTimestamp="2025-11-21 12:35:37 +0000 UTC" firstStartedPulling="2025-11-21 12:35:39.09162873 +0000 UTC m=+2697.792290558" lastFinishedPulling="2025-11-21 12:35:41.561492981 +0000 UTC m=+2700.262154789" observedRunningTime="2025-11-21 12:35:42.187794719 +0000 UTC m=+2700.888456537" watchObservedRunningTime="2025-11-21 12:35:42.194377026 +0000 UTC m=+2700.895038844" Nov 21 12:35:43 crc kubenswrapper[4769]: I1121 12:35:43.169082 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerID="5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0" exitCode=0 Nov 21 12:35:43 crc kubenswrapper[4769]: I1121 12:35:43.169116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerDied","Data":"5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0"} Nov 21 12:35:44 crc kubenswrapper[4769]: I1121 12:35:44.180870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerStarted","Data":"a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722"} Nov 21 12:35:44 crc kubenswrapper[4769]: I1121 12:35:44.197104 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-cz7w9" podStartSLOduration=2.746702887 podStartE2EDuration="5.197087335s" podCreationTimestamp="2025-11-21 12:35:39 +0000 UTC" firstStartedPulling="2025-11-21 12:35:41.125691692 +0000 UTC m=+2699.826353510" lastFinishedPulling="2025-11-21 12:35:43.57607614 +0000 UTC m=+2702.276737958" observedRunningTime="2025-11-21 12:35:44.19575806 +0000 UTC m=+2702.896419878" watchObservedRunningTime="2025-11-21 12:35:44.197087335 +0000 UTC m=+2702.897749153" Nov 21 12:35:47 crc kubenswrapper[4769]: I1121 12:35:47.628330 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:47 crc kubenswrapper[4769]: I1121 12:35:47.628613 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:47 crc kubenswrapper[4769]: I1121 12:35:47.684377 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:48 crc kubenswrapper[4769]: I1121 12:35:48.308568 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:48 crc kubenswrapper[4769]: I1121 12:35:48.866461 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-l84lp"] Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.019301 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.019610 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.091831 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.254582 4769 generic.go:334] "Generic (PLEG): container finished" podID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerID="f403be3ce48985d69538737b6ffdcfbd0673bc116d4f3185b44449310fda1ccd" exitCode=137 Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.255001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"f403be3ce48985d69538737b6ffdcfbd0673bc116d4f3185b44449310fda1ccd"} Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.255299 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-l84lp" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="registry-server" containerID="cri-o://789e7e1c7841de05c19e64065275f27d312bff43e4d500e0bcf681a176abd80e" gracePeriod=2 Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.298654 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.764734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.841671 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wn4n\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-kube-api-access-5wn4n\") pod \"688dc93e-07c1-4e0c-a3ef-2326d539867a\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.841768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"688dc93e-07c1-4e0c-a3ef-2326d539867a\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.841848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-cache\") pod \"688dc93e-07c1-4e0c-a3ef-2326d539867a\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.841911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") pod \"688dc93e-07c1-4e0c-a3ef-2326d539867a\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.841948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-lock\") pod \"688dc93e-07c1-4e0c-a3ef-2326d539867a\" (UID: \"688dc93e-07c1-4e0c-a3ef-2326d539867a\") " Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.842983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-cache" (OuterVolumeSpecName: "cache") pod "688dc93e-07c1-4e0c-a3ef-2326d539867a" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.849481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "swift") pod "688dc93e-07c1-4e0c-a3ef-2326d539867a" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.851298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-lock" (OuterVolumeSpecName: "lock") pod "688dc93e-07c1-4e0c-a3ef-2326d539867a" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.851535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-kube-api-access-5wn4n" (OuterVolumeSpecName: "kube-api-access-5wn4n") pod "688dc93e-07c1-4e0c-a3ef-2326d539867a" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a"). InnerVolumeSpecName "kube-api-access-5wn4n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.853301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "688dc93e-07c1-4e0c-a3ef-2326d539867a" (UID: "688dc93e-07c1-4e0c-a3ef-2326d539867a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.943350 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.943384 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.943394 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.943406 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/688dc93e-07c1-4e0c-a3ef-2326d539867a-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.943415 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5wn4n\" (UniqueName: \"kubernetes.io/projected/688dc93e-07c1-4e0c-a3ef-2326d539867a-kube-api-access-5wn4n\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:50 crc kubenswrapper[4769]: I1121 12:35:50.960045 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.045162 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.210876 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.247627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-scripts\") pod \"d1356b93-35d5-4255-910a-e18282520848\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.247718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd88r\" (UniqueName: \"kubernetes.io/projected/d1356b93-35d5-4255-910a-e18282520848-kube-api-access-gd88r\") pod \"d1356b93-35d5-4255-910a-e18282520848\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.247773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data-custom\") pod \"d1356b93-35d5-4255-910a-e18282520848\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.247834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d1356b93-35d5-4255-910a-e18282520848-etc-machine-id\") pod \"d1356b93-35d5-4255-910a-e18282520848\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.248047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-combined-ca-bundle\") pod \"d1356b93-35d5-4255-910a-e18282520848\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.248093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data\") pod \"d1356b93-35d5-4255-910a-e18282520848\" (UID: \"d1356b93-35d5-4255-910a-e18282520848\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.248106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d1356b93-35d5-4255-910a-e18282520848-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d1356b93-35d5-4255-910a-e18282520848" (UID: "d1356b93-35d5-4255-910a-e18282520848"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.248658 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d1356b93-35d5-4255-910a-e18282520848-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.251225 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-scripts" (OuterVolumeSpecName: "scripts") pod "d1356b93-35d5-4255-910a-e18282520848" (UID: "d1356b93-35d5-4255-910a-e18282520848"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.251598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1356b93-35d5-4255-910a-e18282520848-kube-api-access-gd88r" (OuterVolumeSpecName: "kube-api-access-gd88r") pod "d1356b93-35d5-4255-910a-e18282520848" (UID: "d1356b93-35d5-4255-910a-e18282520848"). InnerVolumeSpecName "kube-api-access-gd88r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.252329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d1356b93-35d5-4255-910a-e18282520848" (UID: "d1356b93-35d5-4255-910a-e18282520848"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.264914 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-cz7w9"] Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.277538 4769 generic.go:334] "Generic (PLEG): container finished" podID="d1356b93-35d5-4255-910a-e18282520848" containerID="15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a" exitCode=137 Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.277719 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.281685 4769 generic.go:334] "Generic (PLEG): container finished" podID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerID="789e7e1c7841de05c19e64065275f27d312bff43e4d500e0bcf681a176abd80e" exitCode=0 Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.293171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d1356b93-35d5-4255-910a-e18282520848" (UID: "d1356b93-35d5-4255-910a-e18282520848"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.293321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d1356b93-35d5-4255-910a-e18282520848","Type":"ContainerDied","Data":"15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a"} Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.293371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d1356b93-35d5-4255-910a-e18282520848","Type":"ContainerDied","Data":"b1007a26a78f8b02bd47aab6ed56e2d29105f67cfbb1a1edfc6c3e2659a750e3"} Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.293386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-l84lp" event={"ID":"60760808-dcb5-45d5-9ee8-af52bb3389b3","Type":"ContainerDied","Data":"789e7e1c7841de05c19e64065275f27d312bff43e4d500e0bcf681a176abd80e"} Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.293415 4769 scope.go:117] "RemoveContainer" containerID="2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.297080 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.297090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"688dc93e-07c1-4e0c-a3ef-2326d539867a","Type":"ContainerDied","Data":"d1736126e212f704b9dcc82d66b40efb5e3118ee96e7a763c8984cd0c86fcd21"} Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.333944 4769 scope.go:117] "RemoveContainer" containerID="15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.337553 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.343766 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.350972 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gd88r\" (UniqueName: \"kubernetes.io/projected/d1356b93-35d5-4255-910a-e18282520848-kube-api-access-gd88r\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.351006 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.351015 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.351025 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.359674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data" (OuterVolumeSpecName: "config-data") pod "d1356b93-35d5-4255-910a-e18282520848" (UID: "d1356b93-35d5-4255-910a-e18282520848"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.361888 4769 scope.go:117] "RemoveContainer" containerID="2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776" Nov 21 12:35:51 crc kubenswrapper[4769]: E1121 12:35:51.362422 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776\": container with ID starting with 2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776 not found: ID does not exist" containerID="2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.362457 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776"} err="failed to get container status \"2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776\": rpc error: code = NotFound desc = could not find container \"2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776\": container with ID starting with 2b3e9388c9886771134178f8cc0090e044d6d9ce14a3667a0d748ed076b42776 not found: ID does not exist" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.362483 4769 scope.go:117] "RemoveContainer" containerID="15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a" Nov 21 12:35:51 crc kubenswrapper[4769]: E1121 12:35:51.363124 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a\": container with ID starting with 15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a not found: ID does not exist" containerID="15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.363152 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a"} err="failed to get container status \"15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a\": rpc error: code = NotFound desc = could not find container \"15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a\": container with ID starting with 15267201995a04f007c392c0c66355420320690702e5055580eb50d69e44501a not found: ID does not exist" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.363168 4769 scope.go:117] "RemoveContainer" containerID="f403be3ce48985d69538737b6ffdcfbd0673bc116d4f3185b44449310fda1ccd" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.392795 4769 scope.go:117] "RemoveContainer" containerID="a11d6914dac88a945153d4101f699a1126b4a1c0cfa9384233ff13589a6af179" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.414524 4769 scope.go:117] "RemoveContainer" containerID="3dc658ddd734c741c356918a825b1583cd250f9273845f9bd38a3c742c4d85a8" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.441746 4769 scope.go:117] "RemoveContainer" containerID="2d10be3132dcf1cd9fa4028e5cb2d86dbfaadf86cc548f90ee41bb79d24ed971" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.452098 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1356b93-35d5-4255-910a-e18282520848-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.473941 4769 scope.go:117] "RemoveContainer" containerID="666e126b826f5c1d1979e541c9388be5da81dcbcc8cd779ec1496db988e7e9d6" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.497935 4769 scope.go:117] "RemoveContainer" containerID="09c152a70de95d408fa2d1e62bd295e12eff93b04fda5707e6d786bbce57fa01" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.518694 4769 scope.go:117] "RemoveContainer" containerID="1e9eff96dd33dea6fa47a37fdf9fe9785540857c58102274e00a7269903a47f4" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.557321 4769 scope.go:117] "RemoveContainer" containerID="f4bf3535ace846275d7269ea413b90e506b094a2ee67414f26edee0c83e47a40" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.578315 4769 scope.go:117] "RemoveContainer" containerID="9741de62dc82c24266d38705c08765ede152139885bfd61fc0ff6146c633735d" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.629007 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.634370 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.648558 4769 scope.go:117] "RemoveContainer" containerID="3e3476c9a96cb0b50309aeb5f761175f6ebf06724b11037154f42ebfe53afd6f" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.663980 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.671306 4769 scope.go:117] "RemoveContainer" containerID="a1b5bd570677920c74854244cfd7f9e8c70a41a3b6778e18c7d5edb92e8865d1" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.695467 4769 scope.go:117] "RemoveContainer" containerID="8b1ce8572f04445a01bb6068185ac94889800baa108b2dd6e928e82a227a7c85" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.739569 4769 scope.go:117] "RemoveContainer" containerID="e353e45d3f55e0d1979aad889a57f00db327e26732a94b9699b9e72bc65fc225" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.755731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-catalog-content\") pod \"60760808-dcb5-45d5-9ee8-af52bb3389b3\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.755769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-utilities\") pod \"60760808-dcb5-45d5-9ee8-af52bb3389b3\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.755807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkb2\" (UniqueName: \"kubernetes.io/projected/60760808-dcb5-45d5-9ee8-af52bb3389b3-kube-api-access-jxkb2\") pod \"60760808-dcb5-45d5-9ee8-af52bb3389b3\" (UID: \"60760808-dcb5-45d5-9ee8-af52bb3389b3\") " Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.756580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-utilities" (OuterVolumeSpecName: "utilities") pod "60760808-dcb5-45d5-9ee8-af52bb3389b3" (UID: "60760808-dcb5-45d5-9ee8-af52bb3389b3"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.756786 4769 scope.go:117] "RemoveContainer" containerID="bf3e347f273318f3f15293a4356f84a0f9bd2b4ea8727e9573419550831b6187" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.759206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60760808-dcb5-45d5-9ee8-af52bb3389b3-kube-api-access-jxkb2" (OuterVolumeSpecName: "kube-api-access-jxkb2") pod "60760808-dcb5-45d5-9ee8-af52bb3389b3" (UID: "60760808-dcb5-45d5-9ee8-af52bb3389b3"). InnerVolumeSpecName "kube-api-access-jxkb2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.797135 4769 scope.go:117] "RemoveContainer" containerID="f019d8be557db1f153e7892c0c39a99b8e0635ac7c28aee437df1446567c404b" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.805430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "60760808-dcb5-45d5-9ee8-af52bb3389b3" (UID: "60760808-dcb5-45d5-9ee8-af52bb3389b3"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.857591 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.857626 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60760808-dcb5-45d5-9ee8-af52bb3389b3-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:51 crc kubenswrapper[4769]: I1121 12:35:51.857637 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jxkb2\" (UniqueName: \"kubernetes.io/projected/60760808-dcb5-45d5-9ee8-af52bb3389b3-kube-api-access-jxkb2\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.315095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-l84lp" event={"ID":"60760808-dcb5-45d5-9ee8-af52bb3389b3","Type":"ContainerDied","Data":"1d8af92f7dfdb64f3f3f05b4fd4991f7b3ccb4f92d08f70348cfce5d77b6289b"} Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.315233 4769 scope.go:117] "RemoveContainer" containerID="789e7e1c7841de05c19e64065275f27d312bff43e4d500e0bcf681a176abd80e" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.315552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-l84lp" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.319468 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-cz7w9" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="registry-server" containerID="cri-o://a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722" gracePeriod=2 Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.346294 4769 scope.go:117] "RemoveContainer" containerID="63f8c3b5a991669b6f8333e49b7d146449455e535d4a66a9a8aed9ac32a3130e" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.377459 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-l84lp"] Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.379897 4769 scope.go:117] "RemoveContainer" containerID="23edb2346f3b45d2d19b428000cbc1ff24fd76e183f92645f5f58bdb206d78c1" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.385327 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-l84lp"] Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.768998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.883688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k9dm\" (UniqueName: \"kubernetes.io/projected/4ad00184-6357-4f2b-82b1-20104eca1bac-kube-api-access-4k9dm\") pod \"4ad00184-6357-4f2b-82b1-20104eca1bac\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.883855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-utilities\") pod \"4ad00184-6357-4f2b-82b1-20104eca1bac\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.883903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-catalog-content\") pod \"4ad00184-6357-4f2b-82b1-20104eca1bac\" (UID: \"4ad00184-6357-4f2b-82b1-20104eca1bac\") " Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.885132 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-utilities" (OuterVolumeSpecName: "utilities") pod "4ad00184-6357-4f2b-82b1-20104eca1bac" (UID: "4ad00184-6357-4f2b-82b1-20104eca1bac"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.885965 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.890609 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad00184-6357-4f2b-82b1-20104eca1bac-kube-api-access-4k9dm" (OuterVolumeSpecName: "kube-api-access-4k9dm") pod "4ad00184-6357-4f2b-82b1-20104eca1bac" (UID: "4ad00184-6357-4f2b-82b1-20104eca1bac"). InnerVolumeSpecName "kube-api-access-4k9dm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.987962 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4k9dm\" (UniqueName: \"kubernetes.io/projected/4ad00184-6357-4f2b-82b1-20104eca1bac-kube-api-access-4k9dm\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:52 crc kubenswrapper[4769]: I1121 12:35:52.989975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4ad00184-6357-4f2b-82b1-20104eca1bac" (UID: "4ad00184-6357-4f2b-82b1-20104eca1bac"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.089028 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ad00184-6357-4f2b-82b1-20104eca1bac-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.289372 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" path="/var/lib/kubelet/pods/60760808-dcb5-45d5-9ee8-af52bb3389b3/volumes" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.290387 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" path="/var/lib/kubelet/pods/688dc93e-07c1-4e0c-a3ef-2326d539867a/volumes" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.292590 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1356b93-35d5-4255-910a-e18282520848" path="/var/lib/kubelet/pods/d1356b93-35d5-4255-910a-e18282520848/volumes" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.331396 4769 generic.go:334] "Generic (PLEG): container finished" podID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerID="a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722" exitCode=0 Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.331462 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-cz7w9" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.331497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerDied","Data":"a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722"} Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.331561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-cz7w9" event={"ID":"4ad00184-6357-4f2b-82b1-20104eca1bac","Type":"ContainerDied","Data":"7fb4c89203c0185dc81bb7f43f16e8a940739c2f6ff6c4ab7c173d0d33f7551a"} Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.331590 4769 scope.go:117] "RemoveContainer" containerID="a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.359183 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-cz7w9"] Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.363466 4769 scope.go:117] "RemoveContainer" containerID="5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.364978 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-cz7w9"] Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.383393 4769 scope.go:117] "RemoveContainer" containerID="e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.411204 4769 scope.go:117] "RemoveContainer" containerID="a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722" Nov 21 12:35:53 crc kubenswrapper[4769]: E1121 12:35:53.411865 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722\": container with ID starting with a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722 not found: ID does not exist" containerID="a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.411898 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722"} err="failed to get container status \"a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722\": rpc error: code = NotFound desc = could not find container \"a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722\": container with ID starting with a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722 not found: ID does not exist" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.411924 4769 scope.go:117] "RemoveContainer" containerID="5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0" Nov 21 12:35:53 crc kubenswrapper[4769]: E1121 12:35:53.412246 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0\": container with ID starting with 5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0 not found: ID does not exist" containerID="5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.412269 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0"} err="failed to get container status \"5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0\": rpc error: code = NotFound desc = could not find container \"5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0\": container with ID starting with 5ce740967818ee7bb21552b8c60160061e24683eab90f0cb95d419be5302b3c0 not found: ID does not exist" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.412281 4769 scope.go:117] "RemoveContainer" containerID="e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893" Nov 21 12:35:53 crc kubenswrapper[4769]: E1121 12:35:53.412524 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893\": container with ID starting with e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893 not found: ID does not exist" containerID="e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893" Nov 21 12:35:53 crc kubenswrapper[4769]: I1121 12:35:53.412551 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893"} err="failed to get container status \"e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893\": rpc error: code = NotFound desc = could not find container \"e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893\": container with ID starting with e40d7d63390854c26dfe090d5dc7fc7a5d02ae80c8bd2c447a873a58f37f7893 not found: ID does not exist" Nov 21 12:35:55 crc kubenswrapper[4769]: I1121 12:35:55.291162 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" path="/var/lib/kubelet/pods/4ad00184-6357-4f2b-82b1-20104eca1bac/volumes" Nov 21 12:35:55 crc kubenswrapper[4769]: I1121 12:35:55.691147 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podae2e4a20-719e-4fca-bfed-da8d2e30fd2f"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podae2e4a20-719e-4fca-bfed-da8d2e30fd2f] : Timed out while waiting for systemd to remove kubepods-besteffort-podae2e4a20_719e_4fca_bfed_da8d2e30fd2f.slice" Nov 21 12:35:55 crc kubenswrapper[4769]: I1121 12:35:55.716778 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podae2e4a20-719e-4fca-bfed-da8d2e30fd2f"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podae2e4a20-719e-4fca-bfed-da8d2e30fd2f] : Timed out while waiting for systemd to remove kubepods-besteffort-podae2e4a20_719e_4fca_bfed_da8d2e30fd2f.slice" Nov 21 12:35:55 crc kubenswrapper[4769]: E1121 12:35:55.717671 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podae2e4a20-719e-4fca-bfed-da8d2e30fd2f] : unable to destroy cgroup paths for cgroup [kubepods besteffort podae2e4a20-719e-4fca-bfed-da8d2e30fd2f] : Timed out while waiting for systemd to remove kubepods-besteffort-podae2e4a20_719e_4fca_bfed_da8d2e30fd2f.slice" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" Nov 21 12:35:55 crc kubenswrapper[4769]: W1121 12:35:55.758396 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad00184_6357_4f2b_82b1_20104eca1bac.slice/crio-a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722.scope WatchSource:0}: Error finding container a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722: Status 404 returned error can't find the container with id a916e7402fa983029c390d41e3d73d89d8fcdced63b38fcb035cdf9fa2710722 Nov 21 12:35:56 crc kubenswrapper[4769]: E1121 12:35:56.242805 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:56 crc kubenswrapper[4769]: E1121 12:35:56.242877 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts podName:48522fa8-1b4a-488d-8912-7ce719f1875f nodeName:}" failed. No retries permitted until 2025-11-21 12:36:28.242861182 +0000 UTC m=+2746.943523000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts") pod "neutronf206-account-delete-r75nt" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f") : configmap "openstack-scripts" not found Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.363271 4769 generic.go:334] "Generic (PLEG): container finished" podID="390a92a7-1cdc-481a-8718-fc0bd7f12d73" containerID="88d4a200e3b2ec9d55ddbe0d62999ff04696c37f84c2c4dbaa877751adea568a" exitCode=137 Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.363377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" event={"ID":"390a92a7-1cdc-481a-8718-fc0bd7f12d73","Type":"ContainerDied","Data":"88d4a200e3b2ec9d55ddbe0d62999ff04696c37f84c2c4dbaa877751adea568a"} Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.365123 4769 generic.go:334] "Generic (PLEG): container finished" podID="0fe07eae-a4cd-49b4-b340-98c22fee11f8" containerID="afdb50742af821b5f7f309f454a7ba52ce95de0611e8f4e76ffb5483d42415b3" exitCode=137 Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.365266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" event={"ID":"0fe07eae-a4cd-49b4-b340-98c22fee11f8","Type":"ContainerDied","Data":"afdb50742af821b5f7f309f454a7ba52ce95de0611e8f4e76ffb5483d42415b3"} Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.367577 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c5878be-4791-4c35-87de-cdf379804fe5" containerID="06250d5b0e35f7e18ee489e95ebae6d7d3e2e592d94bbdb64b8398b21e789a0e" exitCode=137 Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.367633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" event={"ID":"7c5878be-4791-4c35-87de-cdf379804fe5","Type":"ContainerDied","Data":"06250d5b0e35f7e18ee489e95ebae6d7d3e2e592d94bbdb64b8398b21e789a0e"} Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.369271 4769 generic.go:334] "Generic (PLEG): container finished" podID="48522fa8-1b4a-488d-8912-7ce719f1875f" containerID="07fce744c3628b7e76ad6eff16f86f580661c29a3505932bc21da124e89ff64c" exitCode=137 Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.369330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" event={"ID":"48522fa8-1b4a-488d-8912-7ce719f1875f","Type":"ContainerDied","Data":"07fce744c3628b7e76ad6eff16f86f580661c29a3505932bc21da124e89ff64c"} Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.369588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" event={"ID":"48522fa8-1b4a-488d-8912-7ce719f1875f","Type":"ContainerDied","Data":"75db5953d815db35752280b3b954faaa35a00b42d809ed8e906fa45c0f3f19c6"} Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.369658 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75db5953d815db35752280b3b954faaa35a00b42d809ed8e906fa45c0f3f19c6" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.371604 4769 generic.go:334] "Generic (PLEG): container finished" podID="4bfd5314-6358-4789-a76f-a12e61bca8a4" containerID="77b4f717b69602c8af7491b4e2d143955fe82bc0a43da8c7865a55cb3ac59d71" exitCode=137 Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.371707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-8697448848-f5nl9" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.371992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" event={"ID":"4bfd5314-6358-4789-a76f-a12e61bca8a4","Type":"ContainerDied","Data":"77b4f717b69602c8af7491b4e2d143955fe82bc0a43da8c7865a55cb3ac59d71"} Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.391876 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.413330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8697448848-f5nl9"] Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.417795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.431069 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-8697448848-f5nl9"] Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.454723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts\") pod \"48522fa8-1b4a-488d-8912-7ce719f1875f\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.454845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4hrc\" (UniqueName: \"kubernetes.io/projected/48522fa8-1b4a-488d-8912-7ce719f1875f-kube-api-access-h4hrc\") pod \"48522fa8-1b4a-488d-8912-7ce719f1875f\" (UID: \"48522fa8-1b4a-488d-8912-7ce719f1875f\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.455767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "48522fa8-1b4a-488d-8912-7ce719f1875f" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.456725 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.464389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48522fa8-1b4a-488d-8912-7ce719f1875f-kube-api-access-h4hrc" (OuterVolumeSpecName: "kube-api-access-h4hrc") pod "48522fa8-1b4a-488d-8912-7ce719f1875f" (UID: "48522fa8-1b4a-488d-8912-7ce719f1875f"). InnerVolumeSpecName "kube-api-access-h4hrc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.556641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5878be-4791-4c35-87de-cdf379804fe5-operator-scripts\") pod \"7c5878be-4791-4c35-87de-cdf379804fe5\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.556791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjvbl\" (UniqueName: \"kubernetes.io/projected/7c5878be-4791-4c35-87de-cdf379804fe5-kube-api-access-tjvbl\") pod \"7c5878be-4791-4c35-87de-cdf379804fe5\" (UID: \"7c5878be-4791-4c35-87de-cdf379804fe5\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.556894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw5vw\" (UniqueName: \"kubernetes.io/projected/390a92a7-1cdc-481a-8718-fc0bd7f12d73-kube-api-access-dw5vw\") pod \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.556975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/390a92a7-1cdc-481a-8718-fc0bd7f12d73-operator-scripts\") pod \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\" (UID: \"390a92a7-1cdc-481a-8718-fc0bd7f12d73\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.557172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c5878be-4791-4c35-87de-cdf379804fe5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7c5878be-4791-4c35-87de-cdf379804fe5" (UID: "7c5878be-4791-4c35-87de-cdf379804fe5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.557492 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48522fa8-1b4a-488d-8912-7ce719f1875f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.557524 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7c5878be-4791-4c35-87de-cdf379804fe5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.557543 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h4hrc\" (UniqueName: \"kubernetes.io/projected/48522fa8-1b4a-488d-8912-7ce719f1875f-kube-api-access-h4hrc\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.558263 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/390a92a7-1cdc-481a-8718-fc0bd7f12d73-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "390a92a7-1cdc-481a-8718-fc0bd7f12d73" (UID: "390a92a7-1cdc-481a-8718-fc0bd7f12d73"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.559770 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5878be-4791-4c35-87de-cdf379804fe5-kube-api-access-tjvbl" (OuterVolumeSpecName: "kube-api-access-tjvbl") pod "7c5878be-4791-4c35-87de-cdf379804fe5" (UID: "7c5878be-4791-4c35-87de-cdf379804fe5"). InnerVolumeSpecName "kube-api-access-tjvbl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.560408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390a92a7-1cdc-481a-8718-fc0bd7f12d73-kube-api-access-dw5vw" (OuterVolumeSpecName: "kube-api-access-dw5vw") pod "390a92a7-1cdc-481a-8718-fc0bd7f12d73" (UID: "390a92a7-1cdc-481a-8718-fc0bd7f12d73"). InnerVolumeSpecName "kube-api-access-dw5vw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.658549 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tjvbl\" (UniqueName: \"kubernetes.io/projected/7c5878be-4791-4c35-87de-cdf379804fe5-kube-api-access-tjvbl\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.658580 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dw5vw\" (UniqueName: \"kubernetes.io/projected/390a92a7-1cdc-481a-8718-fc0bd7f12d73-kube-api-access-dw5vw\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.658590 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/390a92a7-1cdc-481a-8718-fc0bd7f12d73-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.659279 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.706096 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.759052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zzmn\" (UniqueName: \"kubernetes.io/projected/0fe07eae-a4cd-49b4-b340-98c22fee11f8-kube-api-access-8zzmn\") pod \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.759134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz8qs\" (UniqueName: \"kubernetes.io/projected/4bfd5314-6358-4789-a76f-a12e61bca8a4-kube-api-access-mz8qs\") pod \"4bfd5314-6358-4789-a76f-a12e61bca8a4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.759159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fe07eae-a4cd-49b4-b340-98c22fee11f8-operator-scripts\") pod \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\" (UID: \"0fe07eae-a4cd-49b4-b340-98c22fee11f8\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.759280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bfd5314-6358-4789-a76f-a12e61bca8a4-operator-scripts\") pod \"4bfd5314-6358-4789-a76f-a12e61bca8a4\" (UID: \"4bfd5314-6358-4789-a76f-a12e61bca8a4\") " Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.760040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fe07eae-a4cd-49b4-b340-98c22fee11f8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0fe07eae-a4cd-49b4-b340-98c22fee11f8" (UID: "0fe07eae-a4cd-49b4-b340-98c22fee11f8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.760065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bfd5314-6358-4789-a76f-a12e61bca8a4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4bfd5314-6358-4789-a76f-a12e61bca8a4" (UID: "4bfd5314-6358-4789-a76f-a12e61bca8a4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.761902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe07eae-a4cd-49b4-b340-98c22fee11f8-kube-api-access-8zzmn" (OuterVolumeSpecName: "kube-api-access-8zzmn") pod "0fe07eae-a4cd-49b4-b340-98c22fee11f8" (UID: "0fe07eae-a4cd-49b4-b340-98c22fee11f8"). InnerVolumeSpecName "kube-api-access-8zzmn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.762304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bfd5314-6358-4789-a76f-a12e61bca8a4-kube-api-access-mz8qs" (OuterVolumeSpecName: "kube-api-access-mz8qs") pod "4bfd5314-6358-4789-a76f-a12e61bca8a4" (UID: "4bfd5314-6358-4789-a76f-a12e61bca8a4"). InnerVolumeSpecName "kube-api-access-mz8qs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.860813 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mz8qs\" (UniqueName: \"kubernetes.io/projected/4bfd5314-6358-4789-a76f-a12e61bca8a4-kube-api-access-mz8qs\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.860850 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0fe07eae-a4cd-49b4-b340-98c22fee11f8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.860861 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bfd5314-6358-4789-a76f-a12e61bca8a4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:56 crc kubenswrapper[4769]: I1121 12:35:56.860869 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8zzmn\" (UniqueName: \"kubernetes.io/projected/0fe07eae-a4cd-49b4-b340-98c22fee11f8-kube-api-access-8zzmn\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.285745 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2e4a20-719e-4fca-bfed-da8d2e30fd2f" path="/var/lib/kubelet/pods/ae2e4a20-719e-4fca-bfed-da8d2e30fd2f/volumes" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.384606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" event={"ID":"390a92a7-1cdc-481a-8718-fc0bd7f12d73","Type":"ContainerDied","Data":"c376a7013e51cb1e64e7c08b38e86b4bc29498be0fc7042e099b67f4d276bfa3"} Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.384729 4769 scope.go:117] "RemoveContainer" containerID="88d4a200e3b2ec9d55ddbe0d62999ff04696c37f84c2c4dbaa877751adea568a" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.384619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell11c71-account-delete-2cs4f" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.387935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" event={"ID":"0fe07eae-a4cd-49b4-b340-98c22fee11f8","Type":"ContainerDied","Data":"256ab0e0581eabd459cea7ad245e561cec4ba40fd567560a226de3f27ed4cbea"} Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.388101 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi34da-account-delete-r8hgm" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.390914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" event={"ID":"7c5878be-4791-4c35-87de-cdf379804fe5","Type":"ContainerDied","Data":"9f12cf48203e57ffa30cefde0bf290f664134ae44fddd0a7df1d7babfcd1f49b"} Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.390961 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0705a-account-delete-gtvls" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.393865 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.393873 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronf206-account-delete-r75nt" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.394212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementff8c-account-delete-fxnn4" event={"ID":"4bfd5314-6358-4789-a76f-a12e61bca8a4","Type":"ContainerDied","Data":"14c57c9d41722f47b3ad8c4bf657c6d634cb8dc9159a2c7ceaf4261eafbb4dd1"} Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.416480 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell11c71-account-delete-2cs4f"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.425319 4769 scope.go:117] "RemoveContainer" containerID="afdb50742af821b5f7f309f454a7ba52ce95de0611e8f4e76ffb5483d42415b3" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.427218 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell11c71-account-delete-2cs4f"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.433169 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi34da-account-delete-r8hgm"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.446707 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi34da-account-delete-r8hgm"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.459478 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronf206-account-delete-r75nt"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.460136 4769 scope.go:117] "RemoveContainer" containerID="06250d5b0e35f7e18ee489e95ebae6d7d3e2e592d94bbdb64b8398b21e789a0e" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.465269 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutronf206-account-delete-r75nt"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.472976 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0705a-account-delete-gtvls"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.479848 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell0705a-account-delete-gtvls"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.481625 4769 scope.go:117] "RemoveContainer" containerID="77b4f717b69602c8af7491b4e2d143955fe82bc0a43da8c7865a55cb3ac59d71" Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.486556 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementff8c-account-delete-fxnn4"] Nov 21 12:35:57 crc kubenswrapper[4769]: I1121 12:35:57.494444 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placementff8c-account-delete-fxnn4"] Nov 21 12:35:57 crc kubenswrapper[4769]: E1121 12:35:57.775600 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:35:57 crc kubenswrapper[4769]: E1121 12:35:57.775700 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts podName:4008318b-1790-42b2-b86e-f1c1919e9da8 nodeName:}" failed. No retries permitted until 2025-11-21 12:36:29.775677687 +0000 UTC m=+2748.476339515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts") pod "watcher89e7-account-delete-6hz9b" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8") : configmap "openstack-scripts" not found Nov 21 12:35:58 crc kubenswrapper[4769]: I1121 12:35:58.948136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:58 crc kubenswrapper[4769]: I1121 12:35:58.996974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vllv6\" (UniqueName: \"kubernetes.io/projected/4008318b-1790-42b2-b86e-f1c1919e9da8-kube-api-access-vllv6\") pod \"4008318b-1790-42b2-b86e-f1c1919e9da8\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " Nov 21 12:35:58 crc kubenswrapper[4769]: I1121 12:35:58.997088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts\") pod \"4008318b-1790-42b2-b86e-f1c1919e9da8\" (UID: \"4008318b-1790-42b2-b86e-f1c1919e9da8\") " Nov 21 12:35:58 crc kubenswrapper[4769]: I1121 12:35:58.997852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4008318b-1790-42b2-b86e-f1c1919e9da8" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.002165 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4008318b-1790-42b2-b86e-f1c1919e9da8-kube-api-access-vllv6" (OuterVolumeSpecName: "kube-api-access-vllv6") pod "4008318b-1790-42b2-b86e-f1c1919e9da8" (UID: "4008318b-1790-42b2-b86e-f1c1919e9da8"). InnerVolumeSpecName "kube-api-access-vllv6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.098635 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vllv6\" (UniqueName: \"kubernetes.io/projected/4008318b-1790-42b2-b86e-f1c1919e9da8-kube-api-access-vllv6\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.098663 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4008318b-1790-42b2-b86e-f1c1919e9da8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.290819 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fe07eae-a4cd-49b4-b340-98c22fee11f8" path="/var/lib/kubelet/pods/0fe07eae-a4cd-49b4-b340-98c22fee11f8/volumes" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.291972 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="390a92a7-1cdc-481a-8718-fc0bd7f12d73" path="/var/lib/kubelet/pods/390a92a7-1cdc-481a-8718-fc0bd7f12d73/volumes" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.292964 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48522fa8-1b4a-488d-8912-7ce719f1875f" path="/var/lib/kubelet/pods/48522fa8-1b4a-488d-8912-7ce719f1875f/volumes" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.294007 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bfd5314-6358-4789-a76f-a12e61bca8a4" path="/var/lib/kubelet/pods/4bfd5314-6358-4789-a76f-a12e61bca8a4/volumes" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.296085 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5878be-4791-4c35-87de-cdf379804fe5" path="/var/lib/kubelet/pods/7c5878be-4791-4c35-87de-cdf379804fe5/volumes" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.434303 4769 generic.go:334] "Generic (PLEG): container finished" podID="4008318b-1790-42b2-b86e-f1c1919e9da8" containerID="08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e" exitCode=137 Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.434411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" event={"ID":"4008318b-1790-42b2-b86e-f1c1919e9da8","Type":"ContainerDied","Data":"08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e"} Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.434666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" event={"ID":"4008318b-1790-42b2-b86e-f1c1919e9da8","Type":"ContainerDied","Data":"19a4e4e9d460566209990c5f5e7e610656bb3f221444b533c716d7cabcfbcedd"} Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.434761 4769 scope.go:117] "RemoveContainer" containerID="08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.434440 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/watcher89e7-account-delete-6hz9b" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.469486 4769 scope.go:117] "RemoveContainer" containerID="08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e" Nov 21 12:35:59 crc kubenswrapper[4769]: E1121 12:35:59.469969 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e\": container with ID starting with 08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e not found: ID does not exist" containerID="08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.470032 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e"} err="failed to get container status \"08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e\": rpc error: code = NotFound desc = could not find container \"08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e\": container with ID starting with 08b9e7bd3ad76cb55e32f2078f63119f0aac4978a6285a690b1bda563bc6d27e not found: ID does not exist" Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.470288 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/watcher89e7-account-delete-6hz9b"] Nov 21 12:35:59 crc kubenswrapper[4769]: I1121 12:35:59.484254 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/watcher89e7-account-delete-6hz9b"] Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.284999 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4008318b-1790-42b2-b86e-f1c1919e9da8" path="/var/lib/kubelet/pods/4008318b-1790-42b2-b86e-f1c1919e9da8/volumes" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.353468 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-h74mw"] Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.360660 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-h74mw"] Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528122 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-s45bn"] Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528423 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c5878be-4791-4c35-87de-cdf379804fe5" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528438 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5878be-4791-4c35-87de-cdf379804fe5" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528448 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="extract-utilities" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="extract-utilities" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528463 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-reaper" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528470 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-reaper" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528484 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528495 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="rsync" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528501 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="rsync" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528512 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="swift-recon-cron" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="swift-recon-cron" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528530 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="390a92a7-1cdc-481a-8718-fc0bd7f12d73" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528536 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="390a92a7-1cdc-481a-8718-fc0bd7f12d73" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528550 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-updater" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528556 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-updater" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528566 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="cinder-scheduler" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528571 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="cinder-scheduler" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528579 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-expirer" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528585 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-expirer" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528594 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0fe07eae-a4cd-49b4-b340-98c22fee11f8" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528599 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe07eae-a4cd-49b4-b340-98c22fee11f8" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528610 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="registry-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528615 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="registry-server" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528624 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528629 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528635 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48522fa8-1b4a-488d-8912-7ce719f1875f" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528640 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48522fa8-1b4a-488d-8912-7ce719f1875f" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528649 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="extract-utilities" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528655 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="extract-utilities" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528666 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="extract-content" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528672 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="extract-content" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528679 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="extract-content" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528684 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="extract-content" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528691 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4008318b-1790-42b2-b86e-f1c1919e9da8" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528697 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4008318b-1790-42b2-b86e-f1c1919e9da8" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528706 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="registry-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528711 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="registry-server" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528719 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528724 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528736 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528742 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528753 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528758 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-server" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528768 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528774 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-server" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528781 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528787 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-server" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528795 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-updater" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528800 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-updater" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528808 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528822 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4bfd5314-6358-4789-a76f-a12e61bca8a4" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528827 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bfd5314-6358-4789-a76f-a12e61bca8a4" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528839 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="probe" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528844 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="probe" Nov 21 12:36:01 crc kubenswrapper[4769]: E1121 12:36:01.528854 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.528861 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529004 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="probe" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529017 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529027 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4bfd5314-6358-4789-a76f-a12e61bca8a4" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529036 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0fe07eae-a4cd-49b4-b340-98c22fee11f8" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529045 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529051 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="swift-recon-cron" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529060 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529067 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60760808-dcb5-45d5-9ee8-af52bb3389b3" containerName="registry-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529073 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529084 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-replicator" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c5878be-4791-4c35-87de-cdf379804fe5" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529101 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="390a92a7-1cdc-481a-8718-fc0bd7f12d73" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529112 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4ad00184-6357-4f2b-82b1-20104eca1bac" containerName="registry-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529120 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-reaper" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529129 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d1356b93-35d5-4255-910a-e18282520848" containerName="cinder-scheduler" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529153 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529162 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529172 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-expirer" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529180 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="rsync" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529203 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-updater" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529211 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="account-auditor" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529219 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="object-updater" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529227 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="688dc93e-07c1-4e0c-a3ef-2326d539867a" containerName="container-server" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529235 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48522fa8-1b4a-488d-8912-7ce719f1875f" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529243 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4008318b-1790-42b2-b86e-f1c1919e9da8" containerName="mariadb-account-delete" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.529677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.532074 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.532106 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.532229 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.541058 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.551897 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-s45bn"] Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.634846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-crc-storage\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.634898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-node-mnt\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.634983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgxg4\" (UniqueName: \"kubernetes.io/projected/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-kube-api-access-rgxg4\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.737129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-crc-storage\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.737237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-node-mnt\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.737367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rgxg4\" (UniqueName: \"kubernetes.io/projected/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-kube-api-access-rgxg4\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.737528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-node-mnt\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.738261 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-crc-storage\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.761647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgxg4\" (UniqueName: \"kubernetes.io/projected/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-kube-api-access-rgxg4\") pod \"crc-storage-crc-s45bn\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:01 crc kubenswrapper[4769]: I1121 12:36:01.842870 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:02 crc kubenswrapper[4769]: I1121 12:36:02.131623 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-s45bn"] Nov 21 12:36:02 crc kubenswrapper[4769]: I1121 12:36:02.469345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s45bn" event={"ID":"0e6f8b55-491b-41c2-aedf-dbbf53e95a76","Type":"ContainerStarted","Data":"3cdf15db300d4675dbaeb76180b87bdbce3530ca79cbd9e2bd9373320128c828"} Nov 21 12:36:03 crc kubenswrapper[4769]: I1121 12:36:03.284564 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a263d0d8-66cf-4a47-8ec3-eecedf6a36ee" path="/var/lib/kubelet/pods/a263d0d8-66cf-4a47-8ec3-eecedf6a36ee/volumes" Nov 21 12:36:03 crc kubenswrapper[4769]: I1121 12:36:03.482243 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e6f8b55-491b-41c2-aedf-dbbf53e95a76" containerID="eededa8a72031bb21af931115071b72bb489d664e4901c4f152ade5510ef17b9" exitCode=0 Nov 21 12:36:03 crc kubenswrapper[4769]: I1121 12:36:03.482340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s45bn" event={"ID":"0e6f8b55-491b-41c2-aedf-dbbf53e95a76","Type":"ContainerDied","Data":"eededa8a72031bb21af931115071b72bb489d664e4901c4f152ade5510ef17b9"} Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.735004 4769 scope.go:117] "RemoveContainer" containerID="b735df1452fb2eb11cc48e0dd6799b2efbd5dccba1cb7d0c7cf2313d46a4ebd7" Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.759614 4769 scope.go:117] "RemoveContainer" containerID="c94b1a788c1b06e299cc61d5488825fed26110055a205945544b8ff56dc22430" Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.851950 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.992450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-crc-storage\") pod \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.992601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgxg4\" (UniqueName: \"kubernetes.io/projected/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-kube-api-access-rgxg4\") pod \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.992672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-node-mnt\") pod \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\" (UID: \"0e6f8b55-491b-41c2-aedf-dbbf53e95a76\") " Nov 21 12:36:04 crc kubenswrapper[4769]: I1121 12:36:04.992973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "0e6f8b55-491b-41c2-aedf-dbbf53e95a76" (UID: "0e6f8b55-491b-41c2-aedf-dbbf53e95a76"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.002966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-kube-api-access-rgxg4" (OuterVolumeSpecName: "kube-api-access-rgxg4") pod "0e6f8b55-491b-41c2-aedf-dbbf53e95a76" (UID: "0e6f8b55-491b-41c2-aedf-dbbf53e95a76"). InnerVolumeSpecName "kube-api-access-rgxg4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.032733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "0e6f8b55-491b-41c2-aedf-dbbf53e95a76" (UID: "0e6f8b55-491b-41c2-aedf-dbbf53e95a76"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.094015 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.094043 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rgxg4\" (UniqueName: \"kubernetes.io/projected/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-kube-api-access-rgxg4\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.094052 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0e6f8b55-491b-41c2-aedf-dbbf53e95a76-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.505017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s45bn" event={"ID":"0e6f8b55-491b-41c2-aedf-dbbf53e95a76","Type":"ContainerDied","Data":"3cdf15db300d4675dbaeb76180b87bdbce3530ca79cbd9e2bd9373320128c828"} Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.505073 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s45bn" Nov 21 12:36:05 crc kubenswrapper[4769]: I1121 12:36:05.505078 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cdf15db300d4675dbaeb76180b87bdbce3530ca79cbd9e2bd9373320128c828" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.544205 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-s45bn"] Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.559281 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-s45bn"] Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.688630 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-ttwmz"] Nov 21 12:36:08 crc kubenswrapper[4769]: E1121 12:36:08.688920 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e6f8b55-491b-41c2-aedf-dbbf53e95a76" containerName="storage" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.688937 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6f8b55-491b-41c2-aedf-dbbf53e95a76" containerName="storage" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.689105 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e6f8b55-491b-41c2-aedf-dbbf53e95a76" containerName="storage" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.689613 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.691628 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.691888 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.692271 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.692718 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.702510 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-ttwmz"] Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.760962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmtk8\" (UniqueName: \"kubernetes.io/projected/908989f9-98d1-4aad-9c83-cfba354dfeb7-kube-api-access-cmtk8\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.761011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/908989f9-98d1-4aad-9c83-cfba354dfeb7-node-mnt\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.761064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/908989f9-98d1-4aad-9c83-cfba354dfeb7-crc-storage\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.862149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cmtk8\" (UniqueName: \"kubernetes.io/projected/908989f9-98d1-4aad-9c83-cfba354dfeb7-kube-api-access-cmtk8\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.862245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/908989f9-98d1-4aad-9c83-cfba354dfeb7-node-mnt\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.862286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/908989f9-98d1-4aad-9c83-cfba354dfeb7-crc-storage\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.862769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/908989f9-98d1-4aad-9c83-cfba354dfeb7-node-mnt\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.862956 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/908989f9-98d1-4aad-9c83-cfba354dfeb7-crc-storage\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:08 crc kubenswrapper[4769]: I1121 12:36:08.887971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmtk8\" (UniqueName: \"kubernetes.io/projected/908989f9-98d1-4aad-9c83-cfba354dfeb7-kube-api-access-cmtk8\") pod \"crc-storage-crc-ttwmz\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:09 crc kubenswrapper[4769]: I1121 12:36:09.005228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:09 crc kubenswrapper[4769]: I1121 12:36:09.284414 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6f8b55-491b-41c2-aedf-dbbf53e95a76" path="/var/lib/kubelet/pods/0e6f8b55-491b-41c2-aedf-dbbf53e95a76/volumes" Nov 21 12:36:09 crc kubenswrapper[4769]: I1121 12:36:09.498599 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-ttwmz"] Nov 21 12:36:09 crc kubenswrapper[4769]: I1121 12:36:09.548300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-ttwmz" event={"ID":"908989f9-98d1-4aad-9c83-cfba354dfeb7","Type":"ContainerStarted","Data":"ac5f9ccdbcfe020a19c39bf614d60fc2e5088165e807c5682f698b9f6e30cdfc"} Nov 21 12:36:10 crc kubenswrapper[4769]: I1121 12:36:10.564504 4769 generic.go:334] "Generic (PLEG): container finished" podID="908989f9-98d1-4aad-9c83-cfba354dfeb7" containerID="4d0ffc8d8ad5241b15b57dc2bf33a2b5f7d8c272e960f82824e4f70f3613ff5a" exitCode=0 Nov 21 12:36:10 crc kubenswrapper[4769]: I1121 12:36:10.564610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-ttwmz" event={"ID":"908989f9-98d1-4aad-9c83-cfba354dfeb7","Type":"ContainerDied","Data":"4d0ffc8d8ad5241b15b57dc2bf33a2b5f7d8c272e960f82824e4f70f3613ff5a"} Nov 21 12:36:11 crc kubenswrapper[4769]: I1121 12:36:11.963889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.019705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmtk8\" (UniqueName: \"kubernetes.io/projected/908989f9-98d1-4aad-9c83-cfba354dfeb7-kube-api-access-cmtk8\") pod \"908989f9-98d1-4aad-9c83-cfba354dfeb7\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.019758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/908989f9-98d1-4aad-9c83-cfba354dfeb7-crc-storage\") pod \"908989f9-98d1-4aad-9c83-cfba354dfeb7\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.019785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/908989f9-98d1-4aad-9c83-cfba354dfeb7-node-mnt\") pod \"908989f9-98d1-4aad-9c83-cfba354dfeb7\" (UID: \"908989f9-98d1-4aad-9c83-cfba354dfeb7\") " Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.019990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/908989f9-98d1-4aad-9c83-cfba354dfeb7-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "908989f9-98d1-4aad-9c83-cfba354dfeb7" (UID: "908989f9-98d1-4aad-9c83-cfba354dfeb7"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.027871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908989f9-98d1-4aad-9c83-cfba354dfeb7-kube-api-access-cmtk8" (OuterVolumeSpecName: "kube-api-access-cmtk8") pod "908989f9-98d1-4aad-9c83-cfba354dfeb7" (UID: "908989f9-98d1-4aad-9c83-cfba354dfeb7"). InnerVolumeSpecName "kube-api-access-cmtk8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.042566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/908989f9-98d1-4aad-9c83-cfba354dfeb7-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "908989f9-98d1-4aad-9c83-cfba354dfeb7" (UID: "908989f9-98d1-4aad-9c83-cfba354dfeb7"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.121496 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/908989f9-98d1-4aad-9c83-cfba354dfeb7-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.121543 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cmtk8\" (UniqueName: \"kubernetes.io/projected/908989f9-98d1-4aad-9c83-cfba354dfeb7-kube-api-access-cmtk8\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.121555 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/908989f9-98d1-4aad-9c83-cfba354dfeb7-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.591577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-ttwmz" event={"ID":"908989f9-98d1-4aad-9c83-cfba354dfeb7","Type":"ContainerDied","Data":"ac5f9ccdbcfe020a19c39bf614d60fc2e5088165e807c5682f698b9f6e30cdfc"} Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.591616 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac5f9ccdbcfe020a19c39bf614d60fc2e5088165e807c5682f698b9f6e30cdfc" Nov 21 12:36:12 crc kubenswrapper[4769]: I1121 12:36:12.591646 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-ttwmz" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.989692 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:36:27 crc kubenswrapper[4769]: E1121 12:36:27.990470 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="908989f9-98d1-4aad-9c83-cfba354dfeb7" containerName="storage" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.990483 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="908989f9-98d1-4aad-9c83-cfba354dfeb7" containerName="storage" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.990654 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="908989f9-98d1-4aad-9c83-cfba354dfeb7" containerName="storage" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.991390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.994180 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.994257 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.994437 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.994451 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-ts85d" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.994831 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.995883 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:36:27 crc kubenswrapper[4769]: I1121 12:36:27.996134 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.011750 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.013014 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.022586 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.030156 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.031653 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.039433 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.049642 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwfp6\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-kube-api-access-xwfp6\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/857a150b-5f89-4c23-b71c-fa0ec47a855d-erlang-cookie-secret\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-server-conf\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/364fcc68-67f7-4008-bc5f-a932b88a72bf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/bd8a72b4-4330-450b-9a5d-431819e3ab7f-erlang-cookie-secret\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-tls\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.151988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-plugins-conf\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-server-conf\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152070 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-confd\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152098 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-confd\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/364fcc68-67f7-4008-bc5f-a932b88a72bf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-tls\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-plugins\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/857a150b-5f89-4c23-b71c-fa0ec47a855d-pod-info\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/bd8a72b4-4330-450b-9a5d-431819e3ab7f-pod-info\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thslx\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-kube-api-access-thslx\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-plugins-conf\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-plugins\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.152857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwrl\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-kube-api-access-nbwrl\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.245498 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.247720 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.251901 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.252367 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.252511 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.252674 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.252844 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-7pms9" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.252977 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.253151 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.253971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254064 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-plugins-conf\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-plugins\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwrl\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-kube-api-access-nbwrl\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254155 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xwfp6\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-kube-api-access-xwfp6\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/857a150b-5f89-4c23-b71c-fa0ec47a855d-erlang-cookie-secret\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-server-conf\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/364fcc68-67f7-4008-bc5f-a932b88a72bf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254337 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/bd8a72b4-4330-450b-9a5d-431819e3ab7f-erlang-cookie-secret\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-tls\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254381 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254403 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-plugins-conf\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-server-conf\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-confd\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-confd\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/364fcc68-67f7-4008-bc5f-a932b88a72bf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-tls\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-plugins\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254684 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/857a150b-5f89-4c23-b71c-fa0ec47a855d-pod-info\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254726 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/bd8a72b4-4330-450b-9a5d-431819e3ab7f-pod-info\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-thslx\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-kube-api-access-thslx\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.254773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.255281 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.255601 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.257933 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.258894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.259281 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.260621 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.262485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.262568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.263006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-plugins\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.264232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.264355 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.272696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-confd\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.275541 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.276267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-tls\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.277023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-plugins-conf\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.277369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-plugins\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.277516 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.277511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-server-conf\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.278408 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/857a150b-5f89-4c23-b71c-fa0ec47a855d-pod-info\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.278527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.279158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/857a150b-5f89-4c23-b71c-fa0ec47a855d-erlang-cookie-secret\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.279593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/bd8a72b4-4330-450b-9a5d-431819e3ab7f-pod-info\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.280240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.279912 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.280618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.281235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-confd\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.281767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-server-conf\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.282337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.283321 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-plugins-conf\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.285115 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-tls\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.287411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.299547 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/364fcc68-67f7-4008-bc5f-a932b88a72bf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.302275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-thslx\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-kube-api-access-thslx\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.304945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/364fcc68-67f7-4008-bc5f-a932b88a72bf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.305181 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.305457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/bd8a72b4-4330-450b-9a5d-431819e3ab7f-erlang-cookie-secret\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.306083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.308673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.311326 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwfp6\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-kube-api-access-xwfp6\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.313201 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.322982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwrl\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-kube-api-access-nbwrl\") pod \"rabbitmq-server-2\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.342669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-server-1\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.344981 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.355932 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/361938ec-ffd5-4e1c-80b2-c30d796ba89c-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356406 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-pod-info\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-tls\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-plugins-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-confd\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.356743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4qhn\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-kube-api-access-d4qhn\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/361938ec-ffd5-4e1c-80b2-c30d796ba89c-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6zr\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-kube-api-access-vt6zr\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-server-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4tz\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-kube-api-access-qj4tz\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-server-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b27c6ab8-1814-4fc4-be72-63efaf921244-pod-info\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-tls\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.357967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-confd\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.358015 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-plugins-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.358040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.358083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.358245 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.358302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b27c6ab8-1814-4fc4-be72-63efaf921244-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b27c6ab8-1814-4fc4-be72-63efaf921244-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/361938ec-ffd5-4e1c-80b2-c30d796ba89c-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-pod-info\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-tls\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-plugins-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-confd\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qhn\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-kube-api-access-d4qhn\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6zr\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-kube-api-access-vt6zr\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.461997 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/361938ec-ffd5-4e1c-80b2-c30d796ba89c-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-server-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4tz\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-kube-api-access-qj4tz\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462209 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-server-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b27c6ab8-1814-4fc4-be72-63efaf921244-pod-info\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-tls\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-confd\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-plugins-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.462536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.463540 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.463665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.465809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.466457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.467562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.468551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-plugins-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.469871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-server-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.470958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.470982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.471291 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.471929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.472453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-plugins-conf\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.473475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.474290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/361938ec-ffd5-4e1c-80b2-c30d796ba89c-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.475140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-tls\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.475495 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.476509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/361938ec-ffd5-4e1c-80b2-c30d796ba89c-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.476728 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.477067 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.477929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-server-conf\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.478770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.482143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b27c6ab8-1814-4fc4-be72-63efaf921244-pod-info\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.484416 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.487038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.488585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6zr\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-kube-api-access-vt6zr\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.489054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b27c6ab8-1814-4fc4-be72-63efaf921244-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.489182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4tz\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-kube-api-access-qj4tz\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.489594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-confd\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.489839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-tls\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.492070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-pod-info\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.492435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-confd\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.494772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.496781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qhn\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-kube-api-access-d4qhn\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.516473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.518605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-2\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.559604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"rabbitmq-cell1-server-1\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.621945 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.643605 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.718913 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.761741 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.763026 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.846965 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:36:28 crc kubenswrapper[4769]: I1121 12:36:28.997467 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.326154 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.444439 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.452130 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.521114 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:36:29 crc kubenswrapper[4769]: W1121 12:36:29.685087 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361938ec_ffd5_4e1c_80b2_c30d796ba89c.slice/crio-7288947da1ddc7c98ce1d138349459233e4cbd229df78bbd059a48ffc6bd2f69 WatchSource:0}: Error finding container 7288947da1ddc7c98ce1d138349459233e4cbd229df78bbd059a48ffc6bd2f69: Status 404 returned error can't find the container with id 7288947da1ddc7c98ce1d138349459233e4cbd229df78bbd059a48ffc6bd2f69 Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.752373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"bd8a72b4-4330-450b-9a5d-431819e3ab7f","Type":"ContainerStarted","Data":"a73abda22f023ca411b459f024af6decc69f7e8a99bc357ea468317c6e620c67"} Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.755021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4","Type":"ContainerStarted","Data":"84ea0b64dd61f15a560d926b735df6b9a50852b10b9e302720b8544fefd17b34"} Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.756793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"857a150b-5f89-4c23-b71c-fa0ec47a855d","Type":"ContainerStarted","Data":"94944d79abd35be231ef89076b8a8f25b91fac0f9d0e201c86b287e13a8f6c96"} Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.759960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"361938ec-ffd5-4e1c-80b2-c30d796ba89c","Type":"ContainerStarted","Data":"7288947da1ddc7c98ce1d138349459233e4cbd229df78bbd059a48ffc6bd2f69"} Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.761445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"364fcc68-67f7-4008-bc5f-a932b88a72bf","Type":"ContainerStarted","Data":"c7cda56b996aee2e4e1ed41197a7f78bb5a8017650b8fa1c65537b1b665b32ca"} Nov 21 12:36:29 crc kubenswrapper[4769]: W1121 12:36:29.784117 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27c6ab8_1814_4fc4_be72_63efaf921244.slice/crio-e74c8ba04112bb74f8c7de922cb14c1f4cc521bb645f176baae2cd1c3f4710df WatchSource:0}: Error finding container e74c8ba04112bb74f8c7de922cb14c1f4cc521bb645f176baae2cd1c3f4710df: Status 404 returned error can't find the container with id e74c8ba04112bb74f8c7de922cb14c1f4cc521bb645f176baae2cd1c3f4710df Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.834848 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.836697 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.840046 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.840892 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.843134 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.843433 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-rw8d9" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.848420 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.850237 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.856749 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.860098 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.875050 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.879354 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.903302 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Nov 21 12:36:29 crc kubenswrapper[4769]: I1121 12:36:29.928050 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.004589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-galera-tls-certs\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006239 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-operator-scripts\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006270 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-default\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kolla-config\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006332 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48101a85-8239-4484-88f5-77efc1a90f99-config-data-generated\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-generated\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-operator-scripts\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kf92\" (UniqueName: \"kubernetes.io/projected/48101a85-8239-4484-88f5-77efc1a90f99-kube-api-access-4kf92\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-combined-ca-bundle\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006605 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-galera-tls-certs\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006623 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-config-data-default\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-combined-ca-bundle\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxmh\" (UniqueName: \"kubernetes.io/projected/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kube-api-access-zcxmh\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-default\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-generated\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzbns\" (UniqueName: \"kubernetes.io/projected/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kube-api-access-fzbns\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-operator-scripts\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006834 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-kolla-config\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.006926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kolla-config\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.107954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-kolla-config\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.109762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.109890 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kolla-config\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-galera-tls-certs\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-operator-scripts\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110403 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-default\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kolla-config\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48101a85-8239-4484-88f5-77efc1a90f99-config-data-generated\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-generated\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.110960 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-operator-scripts\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111165 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4kf92\" (UniqueName: \"kubernetes.io/projected/48101a85-8239-4484-88f5-77efc1a90f99-kube-api-access-4kf92\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-combined-ca-bundle\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-galera-tls-certs\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-config-data-default\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111557 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-combined-ca-bundle\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxmh\" (UniqueName: \"kubernetes.io/projected/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kube-api-access-zcxmh\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-default\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-generated\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.111943 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fzbns\" (UniqueName: \"kubernetes.io/projected/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kube-api-access-fzbns\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.112038 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.112134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-operator-scripts\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.113460 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-operator-scripts\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.114530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-operator-scripts\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.114785 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.115774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kolla-config\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.109147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-kolla-config\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.114869 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.114801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-operator-scripts\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.117551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-generated\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.117829 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.118266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.118364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-combined-ca-bundle\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.118444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-default\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.119212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-generated\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.119410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48101a85-8239-4484-88f5-77efc1a90f99-config-data-generated\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.115361 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-default\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.120087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kolla-config\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.120305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-config-data-default\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.121157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-combined-ca-bundle\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.121300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.121787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-galera-tls-certs\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.121997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-galera-tls-certs\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.134815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzbns\" (UniqueName: \"kubernetes.io/projected/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kube-api-access-fzbns\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.136697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kf92\" (UniqueName: \"kubernetes.io/projected/48101a85-8239-4484-88f5-77efc1a90f99-kube-api-access-4kf92\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.180304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxmh\" (UniqueName: \"kubernetes.io/projected/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kube-api-access-zcxmh\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.480535 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-2\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.482568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-galera-0\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.558227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.587978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.597225 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.770784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"b27c6ab8-1814-4fc4-be72-63efaf921244","Type":"ContainerStarted","Data":"e74c8ba04112bb74f8c7de922cb14c1f4cc521bb645f176baae2cd1c3f4710df"} Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.773642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"857a150b-5f89-4c23-b71c-fa0ec47a855d","Type":"ContainerStarted","Data":"d00de34ef000571bff5ddb77532cdc14e6b2cd1682f5129c6ce052026efc516d"} Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.775382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"bd8a72b4-4330-450b-9a5d-431819e3ab7f","Type":"ContainerStarted","Data":"74e26fff634f34d7c7694b6e91f220f146baa5e135bb6a7466ed82ff803cf54f"} Nov 21 12:36:30 crc kubenswrapper[4769]: I1121 12:36:30.783793 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.050611 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.060884 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.060984 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.069751 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-457vp" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.070206 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.070383 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.070520 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.077054 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.078592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.086285 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.099788 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-default\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-combined-ca-bundle\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twg2k\" (UniqueName: \"kubernetes.io/projected/8960e53d-b896-4f34-8117-399f16f48b0a-kube-api-access-twg2k\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.138995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-operator-scripts\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139270 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-kolla-config\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f9hq\" (UniqueName: \"kubernetes.io/projected/ae60b576-2037-4318-a529-dca9e6f8eb6a-kube-api-access-2f9hq\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-galera-tls-certs\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-generated\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.139954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.140465 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.167682 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.184625 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.217573 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-default\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-combined-ca-bundle\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247452 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-kolla-config\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2k\" (UniqueName: \"kubernetes.io/projected/8960e53d-b896-4f34-8117-399f16f48b0a-kube-api-access-twg2k\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247526 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-operator-scripts\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-default\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrq2h\" (UniqueName: \"kubernetes.io/projected/4410612c-42ac-4f8a-b643-ddc90384366c-kube-api-access-hrq2h\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-generated\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247679 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-combined-ca-bundle\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247698 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-operator-scripts\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247731 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-kolla-config\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247764 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9hq\" (UniqueName: \"kubernetes.io/projected/ae60b576-2037-4318-a529-dca9e6f8eb6a-kube-api-access-2f9hq\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-galera-tls-certs\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-galera-tls-certs\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.247840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-generated\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.248439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-generated\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.248612 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.248984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-kolla-config\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.249300 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.250755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.251203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.251283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.252406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-default\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.253036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-operator-scripts\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.255961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.284707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.286264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-galera-tls-certs\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.287713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.289487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-combined-ca-bundle\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: W1121 12:36:31.289765 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod285b24a3_5a1e_4a39_89b1_a0e0885ece8f.slice/crio-aad775a535ce80c01a8b5c55c64b316e68799b79cf7b9b0cb9dbbb988c205a75 WatchSource:0}: Error finding container aad775a535ce80c01a8b5c55c64b316e68799b79cf7b9b0cb9dbbb988c205a75: Status 404 returned error can't find the container with id aad775a535ce80c01a8b5c55c64b316e68799b79cf7b9b0cb9dbbb988c205a75 Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.292070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-twg2k\" (UniqueName: \"kubernetes.io/projected/8960e53d-b896-4f34-8117-399f16f48b0a-kube-api-access-twg2k\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.292963 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f9hq\" (UniqueName: \"kubernetes.io/projected/ae60b576-2037-4318-a529-dca9e6f8eb6a-kube-api-access-2f9hq\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.325747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.338384 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-cell1-galera-1\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-kolla-config\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-operator-scripts\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-default\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hrq2h\" (UniqueName: \"kubernetes.io/projected/4410612c-42ac-4f8a-b643-ddc90384366c-kube-api-access-hrq2h\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-generated\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.350982 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.351010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-combined-ca-bundle\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.351762 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-kolla-config\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.352125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-generated\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.352807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-default\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.352812 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-operator-scripts\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.353354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-galera-tls-certs\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.359827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-galera-tls-certs\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.366712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-combined-ca-bundle\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.382001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrq2h\" (UniqueName: \"kubernetes.io/projected/4410612c-42ac-4f8a-b643-ddc90384366c-kube-api-access-hrq2h\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.384140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"openstack-cell1-galera-2\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.442508 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.443840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.446882 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-4r7bg" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.447171 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.456547 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.457580 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.457601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2pp\" (UniqueName: \"kubernetes.io/projected/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kube-api-access-xd2pp\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.459688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.459757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kolla-config\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.459923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.460062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-config-data\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.558967 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.559292 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.563877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.563935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-config-data\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.563982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2pp\" (UniqueName: \"kubernetes.io/projected/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kube-api-access-xd2pp\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.564015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.564035 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kolla-config\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.564838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-config-data\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.565771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kolla-config\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.569150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-combined-ca-bundle\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.570029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-memcached-tls-certs\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.585530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2pp\" (UniqueName: \"kubernetes.io/projected/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kube-api-access-xd2pp\") pod \"memcached-0\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.662469 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.674375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.703487 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.792665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"48101a85-8239-4484-88f5-77efc1a90f99","Type":"ContainerStarted","Data":"c6f1fbb740f08feb9aa7533df8a4c37c6c0b03624ed0c82c4ae64f3c5dc3e370"} Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.795355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4","Type":"ContainerStarted","Data":"a9fcee5b7051b3d501ea47cf8603d18936862cb52b4a6f069e5c2912878f7536"} Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.800088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"b27c6ab8-1814-4fc4-be72-63efaf921244","Type":"ContainerStarted","Data":"a95af62796ca42c1c82ad99b10961e88bc256169ecc67408fea5dd94f3a6af17"} Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.802295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd","Type":"ContainerStarted","Data":"420204a7d3094c75328083af1535f54069f58e7b6b574f9c1f6c4e7d1be49f20"} Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.803309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"285b24a3-5a1e-4a39-89b1-a0e0885ece8f","Type":"ContainerStarted","Data":"aad775a535ce80c01a8b5c55c64b316e68799b79cf7b9b0cb9dbbb988c205a75"} Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.805407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"361938ec-ffd5-4e1c-80b2-c30d796ba89c","Type":"ContainerStarted","Data":"ed6a52ed0624a844cc4eb2f17b70d287931af713158e213efdeaaa4341f60cd8"} Nov 21 12:36:31 crc kubenswrapper[4769]: I1121 12:36:31.824370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"364fcc68-67f7-4008-bc5f-a932b88a72bf","Type":"ContainerStarted","Data":"58692825c6b5cb6c3f32b93794183abec3565adf4077e30fc329031cf5629f2a"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.333537 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:36:32 crc kubenswrapper[4769]: W1121 12:36:32.340858 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8960e53d_b896_4f34_8117_399f16f48b0a.slice/crio-eb7816e831bf85c4c6c9b4fb8c3487732c4dbe1289f4f701136ddf0819a737d1 WatchSource:0}: Error finding container eb7816e831bf85c4c6c9b4fb8c3487732c4dbe1289f4f701136ddf0819a737d1: Status 404 returned error can't find the container with id eb7816e831bf85c4c6c9b4fb8c3487732c4dbe1289f4f701136ddf0819a737d1 Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.621594 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.643767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.669691 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.831855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"ae60b576-2037-4318-a529-dca9e6f8eb6a","Type":"ContainerStarted","Data":"f771ad48d5ef22e00ea533d3125af80ee889ca5655426c67d937929e98bc7d1a"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.833224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"48101a85-8239-4484-88f5-77efc1a90f99","Type":"ContainerStarted","Data":"8e29089efd9ecbda9b63a2ab03bc931d406dc33cb22b729cab2783bd2fcb1d8f"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.837666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"bfdef99c-9c68-4b51-b2c5-7effb71b205d","Type":"ContainerStarted","Data":"e40e00a84c816bbc9da53f8cfe1795663d599caaaf1ed0d9361d9786172c049a"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.841621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8960e53d-b896-4f34-8117-399f16f48b0a","Type":"ContainerStarted","Data":"eb7816e831bf85c4c6c9b4fb8c3487732c4dbe1289f4f701136ddf0819a737d1"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.849296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd","Type":"ContainerStarted","Data":"ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.851324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"285b24a3-5a1e-4a39-89b1-a0e0885ece8f","Type":"ContainerStarted","Data":"b1285179f75a85311041c1714562f0d1bf2f8a675cdafd31348b63f5c7dd14d6"} Nov 21 12:36:32 crc kubenswrapper[4769]: I1121 12:36:32.867251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"4410612c-42ac-4f8a-b643-ddc90384366c","Type":"ContainerStarted","Data":"9e583bbded8c02a2473cdf5acfb34941e2fd5a0365c6f41d084f457b327102d6"} Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.525418 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.526924 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.528889 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-d4bx4" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.538156 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.609476 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6plzz\" (UniqueName: \"kubernetes.io/projected/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d-kube-api-access-6plzz\") pod \"kube-state-metrics-0\" (UID: \"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.710749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6plzz\" (UniqueName: \"kubernetes.io/projected/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d-kube-api-access-6plzz\") pod \"kube-state-metrics-0\" (UID: \"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.728872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6plzz\" (UniqueName: \"kubernetes.io/projected/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d-kube-api-access-6plzz\") pod \"kube-state-metrics-0\" (UID: \"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.858688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.866841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"bfdef99c-9c68-4b51-b2c5-7effb71b205d","Type":"ContainerStarted","Data":"7d360957c8822f3fe69461bed081222da9aecb8b83ca4db8ecd0ceb413e0b155"} Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.866942 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.869794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8960e53d-b896-4f34-8117-399f16f48b0a","Type":"ContainerStarted","Data":"3d21c76716a4ab50a822fd89c312e9686e690eae47eccdc77b84a08ef3821d3f"} Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.871975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"4410612c-42ac-4f8a-b643-ddc90384366c","Type":"ContainerStarted","Data":"602cdde6651f0d5fae79b1a9ff1f46b1f98f08be3932bfb1407511a7056b31db"} Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.874364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"ae60b576-2037-4318-a529-dca9e6f8eb6a","Type":"ContainerStarted","Data":"a73163e55bef92d4580ade98aebe4c07ec6efcdd22f210e7248be7e68832dd42"} Nov 21 12:36:33 crc kubenswrapper[4769]: I1121 12:36:33.901413 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.901389586 podStartE2EDuration="2.901389586s" podCreationTimestamp="2025-11-21 12:36:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:33.886949698 +0000 UTC m=+2752.587611556" watchObservedRunningTime="2025-11-21 12:36:33.901389586 +0000 UTC m=+2752.602051414" Nov 21 12:36:34 crc kubenswrapper[4769]: I1121 12:36:34.352868 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:36:34 crc kubenswrapper[4769]: W1121 12:36:34.357143 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce2f5c70_2119_4a9b_9f48_7a14ebf04f4d.slice/crio-51ea29de8c223b4cff5eac272219bbc099b2cb00e355282de763a90fad326a5f WatchSource:0}: Error finding container 51ea29de8c223b4cff5eac272219bbc099b2cb00e355282de763a90fad326a5f: Status 404 returned error can't find the container with id 51ea29de8c223b4cff5eac272219bbc099b2cb00e355282de763a90fad326a5f Nov 21 12:36:34 crc kubenswrapper[4769]: I1121 12:36:34.886684 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d","Type":"ContainerStarted","Data":"51ea29de8c223b4cff5eac272219bbc099b2cb00e355282de763a90fad326a5f"} Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.283786 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.285771 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.287538 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.287977 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.288061 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-226ng" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.288149 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.289425 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.289916 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.382987 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wrrw\" (UniqueName: \"kubernetes.io/projected/4fc23439-b690-4f59-9028-ba72cf39c81e-kube-api-access-8wrrw\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.383383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.383513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.383667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.383785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.383951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.384125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-config\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.384276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.486852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.486976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-config\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8wrrw\" (UniqueName: \"kubernetes.io/projected/4fc23439-b690-4f59-9028-ba72cf39c81e-kube-api-access-8wrrw\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487298 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487469 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.487559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.488548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.489323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-config\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.493890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.495700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.497825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.502769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wrrw\" (UniqueName: \"kubernetes.io/projected/4fc23439-b690-4f59-9028-ba72cf39c81e-kube-api-access-8wrrw\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.520796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.600875 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.919637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d","Type":"ContainerStarted","Data":"a9bec5a1fbb440b3cc63d47a3f753453d4ee93006f4a273dd0fc0c707e59ac2e"} Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.920305 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:37 crc kubenswrapper[4769]: I1121 12:36:37.942145 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.554667425 podStartE2EDuration="4.942122329s" podCreationTimestamp="2025-11-21 12:36:33 +0000 UTC" firstStartedPulling="2025-11-21 12:36:34.360493795 +0000 UTC m=+2753.061155623" lastFinishedPulling="2025-11-21 12:36:36.747948689 +0000 UTC m=+2755.448610527" observedRunningTime="2025-11-21 12:36:37.934615707 +0000 UTC m=+2756.635277525" watchObservedRunningTime="2025-11-21 12:36:37.942122329 +0000 UTC m=+2756.642784157" Nov 21 12:36:38 crc kubenswrapper[4769]: I1121 12:36:38.132393 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:36:38 crc kubenswrapper[4769]: I1121 12:36:38.936781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4fc23439-b690-4f59-9028-ba72cf39c81e","Type":"ContainerStarted","Data":"9419892b774ee3fbe294ad5230b90a4fb25ab7759903ba82f9c81a47b872f96c"} Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.636686 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.639286 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.642222 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.642351 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.642464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-wlc2q" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.642538 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.645759 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgnw\" (UniqueName: \"kubernetes.io/projected/807d9aae-572d-4e30-bb12-62cebc91bde8-kube-api-access-fmgnw\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-config\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.731465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgnw\" (UniqueName: \"kubernetes.io/projected/807d9aae-572d-4e30-bb12-62cebc91bde8-kube-api-access-fmgnw\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833410 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-config\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833794 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.833965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.834619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.834885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-config\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.839166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.839620 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.840503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.852495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgnw\" (UniqueName: \"kubernetes.io/projected/807d9aae-572d-4e30-bb12-62cebc91bde8-kube-api-access-fmgnw\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.869772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.945861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4fc23439-b690-4f59-9028-ba72cf39c81e","Type":"ContainerStarted","Data":"f11b63d57e10848902fd856e8f9ca97a3b03b5b86b6c2e53b5d1586c2a86402b"} Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.946245 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4fc23439-b690-4f59-9028-ba72cf39c81e","Type":"ContainerStarted","Data":"8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028"} Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.969057 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.969034846 podStartE2EDuration="3.969034846s" podCreationTimestamp="2025-11-21 12:36:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:39.963104786 +0000 UTC m=+2758.663766614" watchObservedRunningTime="2025-11-21 12:36:39.969034846 +0000 UTC m=+2758.669696664" Nov 21 12:36:39 crc kubenswrapper[4769]: I1121 12:36:39.980569 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:40 crc kubenswrapper[4769]: I1121 12:36:40.411075 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:36:40 crc kubenswrapper[4769]: W1121 12:36:40.415252 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod807d9aae_572d_4e30_bb12_62cebc91bde8.slice/crio-6efe2960bf7041218ccb2d209a1555d0a1842ac6ece65500e3e307a5e08a5c10 WatchSource:0}: Error finding container 6efe2960bf7041218ccb2d209a1555d0a1842ac6ece65500e3e307a5e08a5c10: Status 404 returned error can't find the container with id 6efe2960bf7041218ccb2d209a1555d0a1842ac6ece65500e3e307a5e08a5c10 Nov 21 12:36:40 crc kubenswrapper[4769]: I1121 12:36:40.601466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:40 crc kubenswrapper[4769]: I1121 12:36:40.960401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"807d9aae-572d-4e30-bb12-62cebc91bde8","Type":"ContainerStarted","Data":"58c85b933c93f98831cd3dacc7238f42d4ccc675ed624e17bbae3abab44d90f2"} Nov 21 12:36:40 crc kubenswrapper[4769]: I1121 12:36:40.960508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"807d9aae-572d-4e30-bb12-62cebc91bde8","Type":"ContainerStarted","Data":"6efe2960bf7041218ccb2d209a1555d0a1842ac6ece65500e3e307a5e08a5c10"} Nov 21 12:36:41 crc kubenswrapper[4769]: I1121 12:36:41.705355 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:36:41 crc kubenswrapper[4769]: I1121 12:36:41.976134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"807d9aae-572d-4e30-bb12-62cebc91bde8","Type":"ContainerStarted","Data":"0bb3deb7a8d88680fb20c1ccfffc4b5733de01afb053f72ab677462d379e6562"} Nov 21 12:36:41 crc kubenswrapper[4769]: I1121 12:36:41.998289 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.998267355 podStartE2EDuration="3.998267355s" podCreationTimestamp="2025-11-21 12:36:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:41.997615308 +0000 UTC m=+2760.698277126" watchObservedRunningTime="2025-11-21 12:36:41.998267355 +0000 UTC m=+2760.698929173" Nov 21 12:36:42 crc kubenswrapper[4769]: I1121 12:36:42.601310 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:42 crc kubenswrapper[4769]: I1121 12:36:42.980889 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:43 crc kubenswrapper[4769]: I1121 12:36:43.666171 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:43 crc kubenswrapper[4769]: I1121 12:36:43.871081 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:36:43 crc kubenswrapper[4769]: I1121 12:36:43.995576 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerID="ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477" exitCode=0 Nov 21 12:36:43 crc kubenswrapper[4769]: I1121 12:36:43.995682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd","Type":"ContainerDied","Data":"ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477"} Nov 21 12:36:44 crc kubenswrapper[4769]: I1121 12:36:44.288752 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:36:44 crc kubenswrapper[4769]: I1121 12:36:44.981648 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.008540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd","Type":"ContainerStarted","Data":"9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977"} Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.010857 4769 generic.go:334] "Generic (PLEG): container finished" podID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerID="b1285179f75a85311041c1714562f0d1bf2f8a675cdafd31348b63f5c7dd14d6" exitCode=0 Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.010926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"285b24a3-5a1e-4a39-89b1-a0e0885ece8f","Type":"ContainerDied","Data":"b1285179f75a85311041c1714562f0d1bf2f8a675cdafd31348b63f5c7dd14d6"} Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.012581 4769 generic.go:334] "Generic (PLEG): container finished" podID="4410612c-42ac-4f8a-b643-ddc90384366c" containerID="602cdde6651f0d5fae79b1a9ff1f46b1f98f08be3932bfb1407511a7056b31db" exitCode=0 Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.012637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"4410612c-42ac-4f8a-b643-ddc90384366c","Type":"ContainerDied","Data":"602cdde6651f0d5fae79b1a9ff1f46b1f98f08be3932bfb1407511a7056b31db"} Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.014379 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerID="a73163e55bef92d4580ade98aebe4c07ec6efcdd22f210e7248be7e68832dd42" exitCode=0 Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.014447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"ae60b576-2037-4318-a529-dca9e6f8eb6a","Type":"ContainerDied","Data":"a73163e55bef92d4580ade98aebe4c07ec6efcdd22f210e7248be7e68832dd42"} Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.016366 4769 generic.go:334] "Generic (PLEG): container finished" podID="48101a85-8239-4484-88f5-77efc1a90f99" containerID="8e29089efd9ecbda9b63a2ab03bc931d406dc33cb22b729cab2783bd2fcb1d8f" exitCode=0 Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.016458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"48101a85-8239-4484-88f5-77efc1a90f99","Type":"ContainerDied","Data":"8e29089efd9ecbda9b63a2ab03bc931d406dc33cb22b729cab2783bd2fcb1d8f"} Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.023999 4769 generic.go:334] "Generic (PLEG): container finished" podID="8960e53d-b896-4f34-8117-399f16f48b0a" containerID="3d21c76716a4ab50a822fd89c312e9686e690eae47eccdc77b84a08ef3821d3f" exitCode=0 Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.024100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8960e53d-b896-4f34-8117-399f16f48b0a","Type":"ContainerDied","Data":"3d21c76716a4ab50a822fd89c312e9686e690eae47eccdc77b84a08ef3821d3f"} Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.042738 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=17.042713532 podStartE2EDuration="17.042713532s" podCreationTimestamp="2025-11-21 12:36:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:45.03557786 +0000 UTC m=+2763.736239678" watchObservedRunningTime="2025-11-21 12:36:45.042713532 +0000 UTC m=+2763.743375350" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.212173 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.228726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.231875 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.231875 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.231994 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.233086 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-qm77c" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.242480 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.346002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-lock\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.346057 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.346475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.346629 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-cache\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.346672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ncp6\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-kube-api-access-6ncp6\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.449012 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.449385 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.450417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-cache\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.450531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6ncp6\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-kube-api-access-6ncp6\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.450633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-lock\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.450719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.450786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-cache\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: E1121 12:36:45.451383 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:36:45 crc kubenswrapper[4769]: E1121 12:36:45.451401 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:36:45 crc kubenswrapper[4769]: E1121 12:36:45.451444 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift podName:62d412be-7e47-4355-b0de-c0ece98dfcbd nodeName:}" failed. No retries permitted until 2025-11-21 12:36:45.951429904 +0000 UTC m=+2764.652091722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift") pod "swift-storage-0" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd") : configmap "swift-ring-files" not found Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.451648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-lock\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.468954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ncp6\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-kube-api-access-6ncp6\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.481667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: I1121 12:36:45.959561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:45 crc kubenswrapper[4769]: E1121 12:36:45.959778 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:36:45 crc kubenswrapper[4769]: E1121 12:36:45.959992 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:36:45 crc kubenswrapper[4769]: E1121 12:36:45.960078 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift podName:62d412be-7e47-4355-b0de-c0ece98dfcbd nodeName:}" failed. No retries permitted until 2025-11-21 12:36:46.960059095 +0000 UTC m=+2765.660720923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift") pod "swift-storage-0" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd") : configmap "swift-ring-files" not found Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.033116 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.035981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"4410612c-42ac-4f8a-b643-ddc90384366c","Type":"ContainerStarted","Data":"07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21"} Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.038177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"ae60b576-2037-4318-a529-dca9e6f8eb6a","Type":"ContainerStarted","Data":"0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001"} Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.040303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"48101a85-8239-4484-88f5-77efc1a90f99","Type":"ContainerStarted","Data":"1a929f8fb5d24d5a7a5149b7c441b592b95ddcdc7c212c54f6ae7a0c3aab6b13"} Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.042523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8960e53d-b896-4f34-8117-399f16f48b0a","Type":"ContainerStarted","Data":"955fb3d7189dbb92109266c196b642fbb509c7dbafddc4d5f25d6673c61ae5ce"} Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.045636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"285b24a3-5a1e-4a39-89b1-a0e0885ece8f","Type":"ContainerStarted","Data":"a37bff3cd79ee53aa556c3e1617da82f738dace19196c4be216f961fb7d430bc"} Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.088264 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-2" podStartSLOduration=18.088245782 podStartE2EDuration="18.088245782s" podCreationTimestamp="2025-11-21 12:36:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:46.082818526 +0000 UTC m=+2764.783480354" watchObservedRunningTime="2025-11-21 12:36:46.088245782 +0000 UTC m=+2764.788907600" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.093301 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.127469 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podStartSLOduration=16.127449707 podStartE2EDuration="16.127449707s" podCreationTimestamp="2025-11-21 12:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:46.105069495 +0000 UTC m=+2764.805731313" watchObservedRunningTime="2025-11-21 12:36:46.127449707 +0000 UTC m=+2764.828111525" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.128707 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-1" podStartSLOduration=18.12869787 podStartE2EDuration="18.12869787s" podCreationTimestamp="2025-11-21 12:36:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:46.122066232 +0000 UTC m=+2764.822728050" watchObservedRunningTime="2025-11-21 12:36:46.12869787 +0000 UTC m=+2764.829359688" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.142867 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-1" podStartSLOduration=16.142849101 podStartE2EDuration="16.142849101s" podCreationTimestamp="2025-11-21 12:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:46.140771175 +0000 UTC m=+2764.841433023" watchObservedRunningTime="2025-11-21 12:36:46.142849101 +0000 UTC m=+2764.843510919" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.168731 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=16.168714597 podStartE2EDuration="16.168714597s" podCreationTimestamp="2025-11-21 12:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:46.163653051 +0000 UTC m=+2764.864314879" watchObservedRunningTime="2025-11-21 12:36:46.168714597 +0000 UTC m=+2764.869376415" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.311574 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.315172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.319142 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.319172 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.319387 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-ltg2p" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.319671 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.326766 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.368705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.368754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.368852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.368885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw2m4\" (UniqueName: \"kubernetes.io/projected/f0bfd46e-ddb1-452a-8df5-283922948dce-kube-api-access-zw2m4\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.369047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.369118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-config\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.369215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-scripts\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470813 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zw2m4\" (UniqueName: \"kubernetes.io/projected/f0bfd46e-ddb1-452a-8df5-283922948dce-kube-api-access-zw2m4\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-config\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.470918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-scripts\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.471745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.471899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-scripts\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.472184 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-config\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.476805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.477120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.477704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.491676 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw2m4\" (UniqueName: \"kubernetes.io/projected/f0bfd46e-ddb1-452a-8df5-283922948dce-kube-api-access-zw2m4\") pod \"ovn-northd-0\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.640694 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:46 crc kubenswrapper[4769]: I1121 12:36:46.979216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:46 crc kubenswrapper[4769]: E1121 12:36:46.979504 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:36:46 crc kubenswrapper[4769]: E1121 12:36:46.979542 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:36:46 crc kubenswrapper[4769]: E1121 12:36:46.979613 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift podName:62d412be-7e47-4355-b0de-c0ece98dfcbd nodeName:}" failed. No retries permitted until 2025-11-21 12:36:48.979591657 +0000 UTC m=+2767.680253545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift") pod "swift-storage-0" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd") : configmap "swift-ring-files" not found Nov 21 12:36:47 crc kubenswrapper[4769]: I1121 12:36:47.089810 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:36:47 crc kubenswrapper[4769]: W1121 12:36:47.090384 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0bfd46e_ddb1_452a_8df5_283922948dce.slice/crio-b89f0884a6164ad3f82bfcf42e7070db9f58cda1ad2789dda46cea7f6e3e3646 WatchSource:0}: Error finding container b89f0884a6164ad3f82bfcf42e7070db9f58cda1ad2789dda46cea7f6e3e3646: Status 404 returned error can't find the container with id b89f0884a6164ad3f82bfcf42e7070db9f58cda1ad2789dda46cea7f6e3e3646 Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.072435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f0bfd46e-ddb1-452a-8df5-283922948dce","Type":"ContainerStarted","Data":"c17bb2554cbf3fd6babe7e25350d95b1942383f8f5a7f1609039517336cefe63"} Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.072800 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.072816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f0bfd46e-ddb1-452a-8df5-283922948dce","Type":"ContainerStarted","Data":"9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e"} Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.072828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f0bfd46e-ddb1-452a-8df5-283922948dce","Type":"ContainerStarted","Data":"b89f0884a6164ad3f82bfcf42e7070db9f58cda1ad2789dda46cea7f6e3e3646"} Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.093130 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.093110467 podStartE2EDuration="2.093110467s" podCreationTimestamp="2025-11-21 12:36:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:48.089902981 +0000 UTC m=+2766.790564809" watchObservedRunningTime="2025-11-21 12:36:48.093110467 +0000 UTC m=+2766.793772285" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.813570 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-6gttj"] Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.815252 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.817414 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.817605 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.817722 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.848543 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-6gttj"] Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.932862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-dispersionconf\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.932952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-combined-ca-bundle\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.933040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb87b\" (UniqueName: \"kubernetes.io/projected/fc0106a6-df92-4ce9-b303-d17ab14cce65-kube-api-access-vb87b\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.933110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-scripts\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.933240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fc0106a6-df92-4ce9-b303-d17ab14cce65-etc-swift\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.933397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-ring-data-devices\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:48 crc kubenswrapper[4769]: I1121 12:36:48.933462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-swiftconf\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.034961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-ring-data-devices\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-swiftconf\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-dispersionconf\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-combined-ca-bundle\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vb87b\" (UniqueName: \"kubernetes.io/projected/fc0106a6-df92-4ce9-b303-d17ab14cce65-kube-api-access-vb87b\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035202 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-scripts\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fc0106a6-df92-4ce9-b303-d17ab14cce65-etc-swift\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.035297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:49 crc kubenswrapper[4769]: E1121 12:36:49.035477 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:36:49 crc kubenswrapper[4769]: E1121 12:36:49.035493 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:36:49 crc kubenswrapper[4769]: E1121 12:36:49.035548 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift podName:62d412be-7e47-4355-b0de-c0ece98dfcbd nodeName:}" failed. No retries permitted until 2025-11-21 12:36:53.035527474 +0000 UTC m=+2771.736189312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift") pod "swift-storage-0" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd") : configmap "swift-ring-files" not found Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.036239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fc0106a6-df92-4ce9-b303-d17ab14cce65-etc-swift\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.036906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-ring-data-devices\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.036946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-scripts\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.041311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-swiftconf\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.041768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-combined-ca-bundle\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.042222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-dispersionconf\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.052181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb87b\" (UniqueName: \"kubernetes.io/projected/fc0106a6-df92-4ce9-b303-d17ab14cce65-kube-api-access-vb87b\") pod \"swift-ring-rebalance-6gttj\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.154577 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:49 crc kubenswrapper[4769]: I1121 12:36:49.602334 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-6gttj"] Nov 21 12:36:49 crc kubenswrapper[4769]: W1121 12:36:49.605089 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc0106a6_df92_4ce9_b303_d17ab14cce65.slice/crio-4169d2a0ef4705d3f7c61a72ac0c374f4465b931df70f2a52ead7965ca1cf514 WatchSource:0}: Error finding container 4169d2a0ef4705d3f7c61a72ac0c374f4465b931df70f2a52ead7965ca1cf514: Status 404 returned error can't find the container with id 4169d2a0ef4705d3f7c61a72ac0c374f4465b931df70f2a52ead7965ca1cf514 Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.101917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" event={"ID":"fc0106a6-df92-4ce9-b303-d17ab14cce65","Type":"ContainerStarted","Data":"950d80f5cb32e4c3bac9d07ee3f3024af17387ff697395475e39c8d100b28a5e"} Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.102342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" event={"ID":"fc0106a6-df92-4ce9-b303-d17ab14cce65","Type":"ContainerStarted","Data":"4169d2a0ef4705d3f7c61a72ac0c374f4465b931df70f2a52ead7965ca1cf514"} Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.131034 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" podStartSLOduration=2.130994109 podStartE2EDuration="2.130994109s" podCreationTimestamp="2025-11-21 12:36:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:36:50.124222437 +0000 UTC m=+2768.824884255" watchObservedRunningTime="2025-11-21 12:36:50.130994109 +0000 UTC m=+2768.831655927" Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.559211 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.560823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.597969 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.598253 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.784803 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:50 crc kubenswrapper[4769]: I1121 12:36:50.785553 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:36:51 crc kubenswrapper[4769]: I1121 12:36:51.559288 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:51 crc kubenswrapper[4769]: I1121 12:36:51.559979 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:36:51 crc kubenswrapper[4769]: I1121 12:36:51.663457 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:51 crc kubenswrapper[4769]: I1121 12:36:51.663572 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:36:51 crc kubenswrapper[4769]: I1121 12:36:51.675417 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:51 crc kubenswrapper[4769]: I1121 12:36:51.675467 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:52 crc kubenswrapper[4769]: I1121 12:36:52.646234 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:52 crc kubenswrapper[4769]: I1121 12:36:52.736032 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:36:53 crc kubenswrapper[4769]: I1121 12:36:53.035697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:36:53 crc kubenswrapper[4769]: E1121 12:36:53.036136 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:36:53 crc kubenswrapper[4769]: E1121 12:36:53.036162 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:36:53 crc kubenswrapper[4769]: E1121 12:36:53.036269 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift podName:62d412be-7e47-4355-b0de-c0ece98dfcbd nodeName:}" failed. No retries permitted until 2025-11-21 12:37:01.03624541 +0000 UTC m=+2779.736907268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift") pod "swift-storage-0" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd") : configmap "swift-ring-files" not found Nov 21 12:36:57 crc kubenswrapper[4769]: I1121 12:36:57.184422 4769 generic.go:334] "Generic (PLEG): container finished" podID="fc0106a6-df92-4ce9-b303-d17ab14cce65" containerID="950d80f5cb32e4c3bac9d07ee3f3024af17387ff697395475e39c8d100b28a5e" exitCode=0 Nov 21 12:36:57 crc kubenswrapper[4769]: I1121 12:36:57.184480 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" event={"ID":"fc0106a6-df92-4ce9-b303-d17ab14cce65","Type":"ContainerDied","Data":"950d80f5cb32e4c3bac9d07ee3f3024af17387ff697395475e39c8d100b28a5e"} Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.624181 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-scripts\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-ring-data-devices\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-dispersionconf\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-combined-ca-bundle\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb87b\" (UniqueName: \"kubernetes.io/projected/fc0106a6-df92-4ce9-b303-d17ab14cce65-kube-api-access-vb87b\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655739 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fc0106a6-df92-4ce9-b303-d17ab14cce65-etc-swift\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.655769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-swiftconf\") pod \"fc0106a6-df92-4ce9-b303-d17ab14cce65\" (UID: \"fc0106a6-df92-4ce9-b303-d17ab14cce65\") " Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.657138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc0106a6-df92-4ce9-b303-d17ab14cce65-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.657403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.663329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0106a6-df92-4ce9-b303-d17ab14cce65-kube-api-access-vb87b" (OuterVolumeSpecName: "kube-api-access-vb87b") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "kube-api-access-vb87b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.667384 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.683005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-scripts" (OuterVolumeSpecName: "scripts") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.685078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.691846 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fc0106a6-df92-4ce9-b303-d17ab14cce65" (UID: "fc0106a6-df92-4ce9-b303-d17ab14cce65"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757130 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757170 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fc0106a6-df92-4ce9-b303-d17ab14cce65-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757180 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757250 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757265 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vb87b\" (UniqueName: \"kubernetes.io/projected/fc0106a6-df92-4ce9-b303-d17ab14cce65-kube-api-access-vb87b\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757276 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fc0106a6-df92-4ce9-b303-d17ab14cce65-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:58 crc kubenswrapper[4769]: I1121 12:36:58.757286 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fc0106a6-df92-4ce9-b303-d17ab14cce65-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:36:59 crc kubenswrapper[4769]: I1121 12:36:59.214220 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" event={"ID":"fc0106a6-df92-4ce9-b303-d17ab14cce65","Type":"ContainerDied","Data":"4169d2a0ef4705d3f7c61a72ac0c374f4465b931df70f2a52ead7965ca1cf514"} Nov 21 12:36:59 crc kubenswrapper[4769]: I1121 12:36:59.214689 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4169d2a0ef4705d3f7c61a72ac0c374f4465b931df70f2a52ead7965ca1cf514" Nov 21 12:36:59 crc kubenswrapper[4769]: I1121 12:36:59.214310 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-6gttj" Nov 21 12:36:59 crc kubenswrapper[4769]: I1121 12:36:59.803173 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:36:59 crc kubenswrapper[4769]: I1121 12:36:59.900228 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:37:00 crc kubenswrapper[4769]: I1121 12:37:00.644807 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-2" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="galera" probeResult="failure" output=< Nov 21 12:37:00 crc kubenswrapper[4769]: wsrep_local_state_comment (Donor/Desynced) differs from Synced Nov 21 12:37:00 crc kubenswrapper[4769]: > Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.104175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.113250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"swift-storage-0\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.263922 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.373139 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5qlv2"] Nov 21 12:37:01 crc kubenswrapper[4769]: E1121 12:37:01.377620 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc0106a6-df92-4ce9-b303-d17ab14cce65" containerName="swift-ring-rebalance" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.377657 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0106a6-df92-4ce9-b303-d17ab14cce65" containerName="swift-ring-rebalance" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.377912 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc0106a6-df92-4ce9-b303-d17ab14cce65" containerName="swift-ring-rebalance" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.378859 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.384908 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5qlv2"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.493518 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-2331-account-create-8kfz5"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.495533 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.501564 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.505404 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2331-account-create-8kfz5"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.513471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzdh\" (UniqueName: \"kubernetes.io/projected/2a9ec7d7-20af-4215-bfa6-06a203e6479e-kube-api-access-nzzdh\") pod \"keystone-db-create-5qlv2\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.513764 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a9ec7d7-20af-4215-bfa6-06a203e6479e-operator-scripts\") pod \"keystone-db-create-5qlv2\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.615802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a9ec7d7-20af-4215-bfa6-06a203e6479e-operator-scripts\") pod \"keystone-db-create-5qlv2\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.615870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzdh\" (UniqueName: \"kubernetes.io/projected/2a9ec7d7-20af-4215-bfa6-06a203e6479e-kube-api-access-nzzdh\") pod \"keystone-db-create-5qlv2\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.615915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qscxb\" (UniqueName: \"kubernetes.io/projected/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-kube-api-access-qscxb\") pod \"keystone-2331-account-create-8kfz5\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.615946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-operator-scripts\") pod \"keystone-2331-account-create-8kfz5\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.616994 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a9ec7d7-20af-4215-bfa6-06a203e6479e-operator-scripts\") pod \"keystone-db-create-5qlv2\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.643304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzdh\" (UniqueName: \"kubernetes.io/projected/2a9ec7d7-20af-4215-bfa6-06a203e6479e-kube-api-access-nzzdh\") pod \"keystone-db-create-5qlv2\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.678583 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-v5487"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.682182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.690440 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-v5487"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.712401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.719143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qscxb\" (UniqueName: \"kubernetes.io/projected/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-kube-api-access-qscxb\") pod \"keystone-2331-account-create-8kfz5\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.719204 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-operator-scripts\") pod \"keystone-2331-account-create-8kfz5\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.719277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9z5m\" (UniqueName: \"kubernetes.io/projected/76fe0888-df08-4e5a-866f-211e3ebc5c3c-kube-api-access-q9z5m\") pod \"placement-db-create-v5487\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.719595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/76fe0888-df08-4e5a-866f-211e3ebc5c3c-operator-scripts\") pod \"placement-db-create-v5487\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.721130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-operator-scripts\") pod \"keystone-2331-account-create-8kfz5\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.766314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qscxb\" (UniqueName: \"kubernetes.io/projected/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-kube-api-access-qscxb\") pod \"keystone-2331-account-create-8kfz5\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.773248 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.834331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-77f5-account-create-gn48j"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.835774 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.837997 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.839355 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.844772 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77f5-account-create-gn48j"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.845347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ebb8764-2359-45db-89ba-6de7965a4fb3-operator-scripts\") pod \"placement-77f5-account-create-gn48j\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.845388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqm2s\" (UniqueName: \"kubernetes.io/projected/5ebb8764-2359-45db-89ba-6de7965a4fb3-kube-api-access-zqm2s\") pod \"placement-77f5-account-create-gn48j\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.846671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/76fe0888-df08-4e5a-866f-211e3ebc5c3c-operator-scripts\") pod \"placement-db-create-v5487\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.845413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/76fe0888-df08-4e5a-866f-211e3ebc5c3c-operator-scripts\") pod \"placement-db-create-v5487\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.849968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q9z5m\" (UniqueName: \"kubernetes.io/projected/76fe0888-df08-4e5a-866f-211e3ebc5c3c-kube-api-access-q9z5m\") pod \"placement-db-create-v5487\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.870802 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.871306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9z5m\" (UniqueName: \"kubernetes.io/projected/76fe0888-df08-4e5a-866f-211e3ebc5c3c-kube-api-access-q9z5m\") pod \"placement-db-create-v5487\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.895593 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-qms5v"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.896853 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.902878 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-qms5v"] Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.954396 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e3741bb-6b59-41ec-9312-743a83ebbfff-operator-scripts\") pod \"glance-db-create-qms5v\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.954466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ebb8764-2359-45db-89ba-6de7965a4fb3-operator-scripts\") pod \"placement-77f5-account-create-gn48j\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.954486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zqm2s\" (UniqueName: \"kubernetes.io/projected/5ebb8764-2359-45db-89ba-6de7965a4fb3-kube-api-access-zqm2s\") pod \"placement-77f5-account-create-gn48j\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.954706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2d68\" (UniqueName: \"kubernetes.io/projected/9e3741bb-6b59-41ec-9312-743a83ebbfff-kube-api-access-l2d68\") pod \"glance-db-create-qms5v\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.957755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ebb8764-2359-45db-89ba-6de7965a4fb3-operator-scripts\") pod \"placement-77f5-account-create-gn48j\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:01 crc kubenswrapper[4769]: I1121 12:37:01.982409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqm2s\" (UniqueName: \"kubernetes.io/projected/5ebb8764-2359-45db-89ba-6de7965a4fb3-kube-api-access-zqm2s\") pod \"placement-77f5-account-create-gn48j\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.005929 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-184a-account-create-hsdc5"] Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.008251 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.010920 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.013453 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.021682 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-184a-account-create-hsdc5"] Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.057080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l2d68\" (UniqueName: \"kubernetes.io/projected/9e3741bb-6b59-41ec-9312-743a83ebbfff-kube-api-access-l2d68\") pod \"glance-db-create-qms5v\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.057230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e3741bb-6b59-41ec-9312-743a83ebbfff-operator-scripts\") pod \"glance-db-create-qms5v\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.057320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jb52\" (UniqueName: \"kubernetes.io/projected/a3aab941-415e-4923-9b5d-2f38004ae8c8-kube-api-access-9jb52\") pod \"glance-184a-account-create-hsdc5\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.057385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3aab941-415e-4923-9b5d-2f38004ae8c8-operator-scripts\") pod \"glance-184a-account-create-hsdc5\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.058216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e3741bb-6b59-41ec-9312-743a83ebbfff-operator-scripts\") pod \"glance-db-create-qms5v\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.074151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2d68\" (UniqueName: \"kubernetes.io/projected/9e3741bb-6b59-41ec-9312-743a83ebbfff-kube-api-access-l2d68\") pod \"glance-db-create-qms5v\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.159406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9jb52\" (UniqueName: \"kubernetes.io/projected/a3aab941-415e-4923-9b5d-2f38004ae8c8-kube-api-access-9jb52\") pod \"glance-184a-account-create-hsdc5\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.159485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3aab941-415e-4923-9b5d-2f38004ae8c8-operator-scripts\") pod \"glance-184a-account-create-hsdc5\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.160143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.160764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3aab941-415e-4923-9b5d-2f38004ae8c8-operator-scripts\") pod \"glance-184a-account-create-hsdc5\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.219536 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jb52\" (UniqueName: \"kubernetes.io/projected/a3aab941-415e-4923-9b5d-2f38004ae8c8-kube-api-access-9jb52\") pod \"glance-184a-account-create-hsdc5\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.225580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.313442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"2a44257f61a84469b828910c85ff5691e1b4a7169355aff6a0a8d19f8a7d0333"} Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.313772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"357d8f25b1c166e50db956d15671d5f6636e62df89e0fd6c1dff559e6f40f168"} Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.337540 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.348442 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5qlv2"] Nov 21 12:37:02 crc kubenswrapper[4769]: W1121 12:37:02.394281 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a9ec7d7_20af_4215_bfa6_06a203e6479e.slice/crio-4db75871747c48efe19dfc78bb9c1b74c7684aaf2e1ff50850629103655d347a WatchSource:0}: Error finding container 4db75871747c48efe19dfc78bb9c1b74c7684aaf2e1ff50850629103655d347a: Status 404 returned error can't find the container with id 4db75871747c48efe19dfc78bb9c1b74c7684aaf2e1ff50850629103655d347a Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.480140 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2331-account-create-8kfz5"] Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.649776 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-v5487"] Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.759092 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-qms5v"] Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.774133 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77f5-account-create-gn48j"] Nov 21 12:37:02 crc kubenswrapper[4769]: W1121 12:37:02.787450 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ebb8764_2359_45db_89ba_6de7965a4fb3.slice/crio-c91b963852aba7b3dce8e98d6f93f6c1621aa9198791b5d0f54e1675638e22be WatchSource:0}: Error finding container c91b963852aba7b3dce8e98d6f93f6c1621aa9198791b5d0f54e1675638e22be: Status 404 returned error can't find the container with id c91b963852aba7b3dce8e98d6f93f6c1621aa9198791b5d0f54e1675638e22be Nov 21 12:37:02 crc kubenswrapper[4769]: I1121 12:37:02.972361 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-184a-account-create-hsdc5"] Nov 21 12:37:02 crc kubenswrapper[4769]: W1121 12:37:02.990590 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3aab941_415e_4923_9b5d_2f38004ae8c8.slice/crio-50b6cdf17c5a925cf5ca37800be30faa38c5e458f20f12f292072f3c6977cb1f WatchSource:0}: Error finding container 50b6cdf17c5a925cf5ca37800be30faa38c5e458f20f12f292072f3c6977cb1f: Status 404 returned error can't find the container with id 50b6cdf17c5a925cf5ca37800be30faa38c5e458f20f12f292072f3c6977cb1f Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.328177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" event={"ID":"a3aab941-415e-4923-9b5d-2f38004ae8c8","Type":"ContainerStarted","Data":"9bcbe61febdba83a142f04fbd4769b2beb6a4d45dc7f65e740df9de8d55fbc5f"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.329060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" event={"ID":"a3aab941-415e-4923-9b5d-2f38004ae8c8","Type":"ContainerStarted","Data":"50b6cdf17c5a925cf5ca37800be30faa38c5e458f20f12f292072f3c6977cb1f"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.333500 4769 generic.go:334] "Generic (PLEG): container finished" podID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerID="58692825c6b5cb6c3f32b93794183abec3565adf4077e30fc329031cf5629f2a" exitCode=0 Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.333545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"364fcc68-67f7-4008-bc5f-a932b88a72bf","Type":"ContainerDied","Data":"58692825c6b5cb6c3f32b93794183abec3565adf4077e30fc329031cf5629f2a"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.345734 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerID="74e26fff634f34d7c7694b6e91f220f146baa5e135bb6a7466ed82ff803cf54f" exitCode=0 Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.345858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"bd8a72b4-4330-450b-9a5d-431819e3ab7f","Type":"ContainerDied","Data":"74e26fff634f34d7c7694b6e91f220f146baa5e135bb6a7466ed82ff803cf54f"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.352995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-qms5v" event={"ID":"9e3741bb-6b59-41ec-9312-743a83ebbfff","Type":"ContainerStarted","Data":"e2f5728603ef3abc644ca890bb85535e82af5f8824e9dbb4cfe2c838da5c46d3"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.353055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-qms5v" event={"ID":"9e3741bb-6b59-41ec-9312-743a83ebbfff","Type":"ContainerStarted","Data":"c72ecc03aa4e903ad2ea741b3f0904351901992e0178b18bcc53d1230614a2c8"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.354797 4769 generic.go:334] "Generic (PLEG): container finished" podID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerID="d00de34ef000571bff5ddb77532cdc14e6b2cd1682f5129c6ce052026efc516d" exitCode=0 Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.354855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"857a150b-5f89-4c23-b71c-fa0ec47a855d","Type":"ContainerDied","Data":"d00de34ef000571bff5ddb77532cdc14e6b2cd1682f5129c6ce052026efc516d"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.361639 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-v5487" event={"ID":"76fe0888-df08-4e5a-866f-211e3ebc5c3c","Type":"ContainerStarted","Data":"7615323faca95a4a0caac0c8dd27f3f529b0c9116804cb6bb7565f8a154bf7b4"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.361694 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-v5487" event={"ID":"76fe0888-df08-4e5a-866f-211e3ebc5c3c","Type":"ContainerStarted","Data":"50a5bb1b430f41de44cbab048803eed67148844cdf4ba5c3aef0cce14e154a85"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.372945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" event={"ID":"2a9ec7d7-20af-4215-bfa6-06a203e6479e","Type":"ContainerStarted","Data":"1136a521dba6c885093ffd7bcac2447e489032535d26084f29061d6ac0e0ab96"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.373381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" event={"ID":"2a9ec7d7-20af-4215-bfa6-06a203e6479e","Type":"ContainerStarted","Data":"4db75871747c48efe19dfc78bb9c1b74c7684aaf2e1ff50850629103655d347a"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.380543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" event={"ID":"c0928503-af84-4ec4-8cfe-85f4b1c15a1b","Type":"ContainerStarted","Data":"8974426ba5f173a9bdb635ea46a7f86d822701c94efac257f629d7f2fefab38c"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.380577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" event={"ID":"c0928503-af84-4ec4-8cfe-85f4b1c15a1b","Type":"ContainerStarted","Data":"d52da6c034e3a1e36d8bdfb0ee0e6f1e1ca4d117bc8aa9de8838c5f5b1a7127f"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.406921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" event={"ID":"5ebb8764-2359-45db-89ba-6de7965a4fb3","Type":"ContainerStarted","Data":"842c3425e6c1bda6e162376b200e5c026aee943076a359b9c1b7c774adb4a477"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.406967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" event={"ID":"5ebb8764-2359-45db-89ba-6de7965a4fb3","Type":"ContainerStarted","Data":"c91b963852aba7b3dce8e98d6f93f6c1621aa9198791b5d0f54e1675638e22be"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.451824 4769 generic.go:334] "Generic (PLEG): container finished" podID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerID="a95af62796ca42c1c82ad99b10961e88bc256169ecc67408fea5dd94f3a6af17" exitCode=0 Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.451967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"b27c6ab8-1814-4fc4-be72-63efaf921244","Type":"ContainerDied","Data":"a95af62796ca42c1c82ad99b10961e88bc256169ecc67408fea5dd94f3a6af17"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.557743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"b5b8093f4dff60c86fd5e9fdda4853c6722373cb26df618bc7120a60a1a38256"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.557990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"b308ba5b9db0d5cc512394f23bd38cff8189c1cdfe06d5def513b0cfae404bbf"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.558463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"98cd919c625608e55be9333a4a0de4346eeb7320e68eb0dc6187d0736f520c5c"} Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.722046 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" podStartSLOduration=2.7220228520000003 podStartE2EDuration="2.722022852s" podCreationTimestamp="2025-11-21 12:37:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:03.716462562 +0000 UTC m=+2782.417124380" watchObservedRunningTime="2025-11-21 12:37:03.722022852 +0000 UTC m=+2782.422684670" Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.724516 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" podStartSLOduration=2.724507949 podStartE2EDuration="2.724507949s" podCreationTimestamp="2025-11-21 12:37:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:03.697897673 +0000 UTC m=+2782.398559491" watchObservedRunningTime="2025-11-21 12:37:03.724507949 +0000 UTC m=+2782.425169767" Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.828320 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" podStartSLOduration=2.8282849 podStartE2EDuration="2.8282849s" podCreationTimestamp="2025-11-21 12:37:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:03.810395279 +0000 UTC m=+2782.511057097" watchObservedRunningTime="2025-11-21 12:37:03.8282849 +0000 UTC m=+2782.528946708" Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.883173 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-v5487" podStartSLOduration=2.883145156 podStartE2EDuration="2.883145156s" podCreationTimestamp="2025-11-21 12:37:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:03.870734532 +0000 UTC m=+2782.571396350" watchObservedRunningTime="2025-11-21 12:37:03.883145156 +0000 UTC m=+2782.583806974" Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.901423 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-qms5v" podStartSLOduration=2.901399367 podStartE2EDuration="2.901399367s" podCreationTimestamp="2025-11-21 12:37:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:03.890665728 +0000 UTC m=+2782.591327546" watchObservedRunningTime="2025-11-21 12:37:03.901399367 +0000 UTC m=+2782.602061185" Nov 21 12:37:03 crc kubenswrapper[4769]: I1121 12:37:03.915456 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" podStartSLOduration=2.915437534 podStartE2EDuration="2.915437534s" podCreationTimestamp="2025-11-21 12:37:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:03.91007717 +0000 UTC m=+2782.610738998" watchObservedRunningTime="2025-11-21 12:37:03.915437534 +0000 UTC m=+2782.616099352" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.570421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"1dafc30651707f08ea650bf9b9b0796de80bb95979b7a0efb96286f05f698430"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.572729 4769 generic.go:334] "Generic (PLEG): container finished" podID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerID="ed6a52ed0624a844cc4eb2f17b70d287931af713158e213efdeaaa4341f60cd8" exitCode=0 Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.572811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"361938ec-ffd5-4e1c-80b2-c30d796ba89c","Type":"ContainerDied","Data":"ed6a52ed0624a844cc4eb2f17b70d287931af713158e213efdeaaa4341f60cd8"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.575242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"364fcc68-67f7-4008-bc5f-a932b88a72bf","Type":"ContainerStarted","Data":"e2032218e6520f26808442a08fd290d961aebba34ef50c59302b1352114c8009"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.575508 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.577478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"bd8a72b4-4330-450b-9a5d-431819e3ab7f","Type":"ContainerStarted","Data":"06f9b1eadf78537bacbf8b298bd6f6f093395ccee46990931528d0149a21a2b4"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.577781 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.585442 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerID="a9fcee5b7051b3d501ea47cf8603d18936862cb52b4a6f069e5c2912878f7536" exitCode=0 Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.585519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4","Type":"ContainerDied","Data":"a9fcee5b7051b3d501ea47cf8603d18936862cb52b4a6f069e5c2912878f7536"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.617008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"b27c6ab8-1814-4fc4-be72-63efaf921244","Type":"ContainerStarted","Data":"f991f55168305f20b720d822948dd591aea9434eebd32153073bcbdeec6a1ad3"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.617678 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.623244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"857a150b-5f89-4c23-b71c-fa0ec47a855d","Type":"ContainerStarted","Data":"d91f2b5aa00b4a0bb40a511eef51984d65607b6b0e7578970c9a341fd55e765a"} Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.624007 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.696440 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-2" podStartSLOduration=38.69642011 podStartE2EDuration="38.69642011s" podCreationTimestamp="2025-11-21 12:36:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:04.674047679 +0000 UTC m=+2783.374709507" watchObservedRunningTime="2025-11-21 12:37:04.69642011 +0000 UTC m=+2783.397081928" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.807625 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=38.807608191 podStartE2EDuration="38.807608191s" podCreationTimestamp="2025-11-21 12:36:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:04.765809577 +0000 UTC m=+2783.466471395" watchObservedRunningTime="2025-11-21 12:37:04.807608191 +0000 UTC m=+2783.508270009" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.850425 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-1" podStartSLOduration=38.850409532 podStartE2EDuration="38.850409532s" podCreationTimestamp="2025-11-21 12:36:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:04.814817305 +0000 UTC m=+2783.515479123" watchObservedRunningTime="2025-11-21 12:37:04.850409532 +0000 UTC m=+2783.551071350" Nov 21 12:37:04 crc kubenswrapper[4769]: I1121 12:37:04.853457 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podStartSLOduration=37.853448434 podStartE2EDuration="37.853448434s" podCreationTimestamp="2025-11-21 12:36:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:04.8481085 +0000 UTC m=+2783.548770318" watchObservedRunningTime="2025-11-21 12:37:04.853448434 +0000 UTC m=+2783.554110252" Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.325506 4769 scope.go:117] "RemoveContainer" containerID="d24d649ccac573f83a591e821ccf09e480e27c660238e2aad558cb5943d8d796" Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.357267 4769 scope.go:117] "RemoveContainer" containerID="57d55533b36401a5c10a6da9cf6e09e1aeae5da8fe2c41eb3965e4d065b8de8a" Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.408203 4769 scope.go:117] "RemoveContainer" containerID="cda6aa5b8922a2b51912ddd956b298f5bd6958796fe215108cb827f2222f4b7d" Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.442987 4769 scope.go:117] "RemoveContainer" containerID="8d3c12e9e87fbf1311c74ee020bc8d550c2966b5911dbb2bd9f5ce73044eb65f" Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.637375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"82948b309b2ce73212f41f6eb4ef37b090d2501d82ce65ad827583a6d443d278"} Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.641182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"361938ec-ffd5-4e1c-80b2-c30d796ba89c","Type":"ContainerStarted","Data":"dab4ae7ecb4ebb3704d24abb60a8e223ac27f6bb8813d9b2533a4fd3320398aa"} Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.646822 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4","Type":"ContainerStarted","Data":"c572bc5f406e7ad8283eb6f8e1b6d7bdcf53fa68dc4b386c41e00bfb8d80b1fe"} Nov 21 12:37:05 crc kubenswrapper[4769]: I1121 12:37:05.842430 4769 scope.go:117] "RemoveContainer" containerID="473ed8b231a80e79799f77429f3c447797d75080f62f6b8f89efdd777757efa7" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.366505 4769 scope.go:117] "RemoveContainer" containerID="1ea22ff91bda57d75d9c8215340e8636118db71b96028f0f91591643e82a2e88" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.506707 4769 scope.go:117] "RemoveContainer" containerID="7c11e23df091226a6f9ae3e6b2a54a288af9fb82567312afe07cdb14c7a97d7c" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.543293 4769 scope.go:117] "RemoveContainer" containerID="4bedff8d1dc16707eec95a4e52fed146d1162c72aeab15c070f8e0c403d044d5" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.584446 4769 scope.go:117] "RemoveContainer" containerID="85ab8e383f1be4f2724b5cb3872fcffdaba8dd7aac8c76ee6bf8a299ab75d745" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.615741 4769 scope.go:117] "RemoveContainer" containerID="d5b02e7309708a0fa95dccb3bcec59b9cc46949c68b8b8bf1ce1de0010cd9314" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.687499 4769 scope.go:117] "RemoveContainer" containerID="858792b7a29aaf40647c776baaf034cab1b8e959b6276abf9ffcefe35c76176a" Nov 21 12:37:06 crc kubenswrapper[4769]: I1121 12:37:06.702975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"840623d07147e6cf6f6469870ee10b31b867a5ca4cda3a760f89c523661aa7a9"} Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.005848 4769 scope.go:117] "RemoveContainer" containerID="fa85e5b9eb24f0969fe3460d2230a6f32841e28c36ac4cad58d44fc10d117b33" Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.092513 4769 scope.go:117] "RemoveContainer" containerID="5df8baf0d2b0948b81c51a04e2ab43ab095c1e97ecad0059b9900bed00d5ce1e" Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.130108 4769 scope.go:117] "RemoveContainer" containerID="d6300bb2e2eb0505522c7aa5671d2a66dc595e440c74ba6e91b368f119db8fe4" Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.719016 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.719056 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.744302 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=40.744283958 podStartE2EDuration="40.744283958s" podCreationTimestamp="2025-11-21 12:36:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:07.739656513 +0000 UTC m=+2786.440318331" watchObservedRunningTime="2025-11-21 12:37:07.744283958 +0000 UTC m=+2786.444945776" Nov 21 12:37:07 crc kubenswrapper[4769]: I1121 12:37:07.771540 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podStartSLOduration=40.771523619999996 podStartE2EDuration="40.77152362s" podCreationTimestamp="2025-11-21 12:36:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:07.771032427 +0000 UTC m=+2786.471694235" watchObservedRunningTime="2025-11-21 12:37:07.77152362 +0000 UTC m=+2786.472185438" Nov 21 12:37:08 crc kubenswrapper[4769]: I1121 12:37:08.734680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"830287bfe1d042f3e89be356787c988ff5fa6963f4d3af7bf41d1c452071b115"} Nov 21 12:37:09 crc kubenswrapper[4769]: I1121 12:37:09.754347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"5360ab1344e47a7d43209a01e2d9ded2e9ba65717ac480f30ced543424799dca"} Nov 21 12:37:09 crc kubenswrapper[4769]: I1121 12:37:09.755301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"dc146c5dcd18856f85005711936352194db9a939fe6011aefd5ebeedf33e9968"} Nov 21 12:37:10 crc kubenswrapper[4769]: E1121 12:37:10.464847 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0928503_af84_4ec4_8cfe_85f4b1c15a1b.slice/crio-conmon-8974426ba5f173a9bdb635ea46a7f86d822701c94efac257f629d7f2fefab38c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76fe0888_df08_4e5a_866f_211e3ebc5c3c.slice/crio-7615323faca95a4a0caac0c8dd27f3f529b0c9116804cb6bb7565f8a154bf7b4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a9ec7d7_20af_4215_bfa6_06a203e6479e.slice/crio-conmon-1136a521dba6c885093ffd7bcac2447e489032535d26084f29061d6ac0e0ab96.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.665851 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-2" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="galera" probeResult="failure" output=< Nov 21 12:37:10 crc kubenswrapper[4769]: wsrep_local_state_comment (Donor/Desynced) differs from Synced Nov 21 12:37:10 crc kubenswrapper[4769]: > Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.766000 4769 generic.go:334] "Generic (PLEG): container finished" podID="76fe0888-df08-4e5a-866f-211e3ebc5c3c" containerID="7615323faca95a4a0caac0c8dd27f3f529b0c9116804cb6bb7565f8a154bf7b4" exitCode=0 Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.766072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-v5487" event={"ID":"76fe0888-df08-4e5a-866f-211e3ebc5c3c","Type":"ContainerDied","Data":"7615323faca95a4a0caac0c8dd27f3f529b0c9116804cb6bb7565f8a154bf7b4"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.776087 4769 generic.go:334] "Generic (PLEG): container finished" podID="a3aab941-415e-4923-9b5d-2f38004ae8c8" containerID="9bcbe61febdba83a142f04fbd4769b2beb6a4d45dc7f65e740df9de8d55fbc5f" exitCode=0 Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.776167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" event={"ID":"a3aab941-415e-4923-9b5d-2f38004ae8c8","Type":"ContainerDied","Data":"9bcbe61febdba83a142f04fbd4769b2beb6a4d45dc7f65e740df9de8d55fbc5f"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.778835 4769 generic.go:334] "Generic (PLEG): container finished" podID="2a9ec7d7-20af-4215-bfa6-06a203e6479e" containerID="1136a521dba6c885093ffd7bcac2447e489032535d26084f29061d6ac0e0ab96" exitCode=0 Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.778896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" event={"ID":"2a9ec7d7-20af-4215-bfa6-06a203e6479e","Type":"ContainerDied","Data":"1136a521dba6c885093ffd7bcac2447e489032535d26084f29061d6ac0e0ab96"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.781492 4769 generic.go:334] "Generic (PLEG): container finished" podID="c0928503-af84-4ec4-8cfe-85f4b1c15a1b" containerID="8974426ba5f173a9bdb635ea46a7f86d822701c94efac257f629d7f2fefab38c" exitCode=0 Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.781550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" event={"ID":"c0928503-af84-4ec4-8cfe-85f4b1c15a1b","Type":"ContainerDied","Data":"8974426ba5f173a9bdb635ea46a7f86d822701c94efac257f629d7f2fefab38c"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.783382 4769 generic.go:334] "Generic (PLEG): container finished" podID="9e3741bb-6b59-41ec-9312-743a83ebbfff" containerID="e2f5728603ef3abc644ca890bb85535e82af5f8824e9dbb4cfe2c838da5c46d3" exitCode=0 Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.783439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-qms5v" event={"ID":"9e3741bb-6b59-41ec-9312-743a83ebbfff","Type":"ContainerDied","Data":"e2f5728603ef3abc644ca890bb85535e82af5f8824e9dbb4cfe2c838da5c46d3"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.785616 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ebb8764-2359-45db-89ba-6de7965a4fb3" containerID="842c3425e6c1bda6e162376b200e5c026aee943076a359b9c1b7c774adb4a477" exitCode=0 Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.785684 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" event={"ID":"5ebb8764-2359-45db-89ba-6de7965a4fb3","Type":"ContainerDied","Data":"842c3425e6c1bda6e162376b200e5c026aee943076a359b9c1b7c774adb4a477"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.796227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"4f2e11536e9dfb8311db5338a7d21c52507a051785eafcf51feb0bac9499d177"} Nov 21 12:37:10 crc kubenswrapper[4769]: I1121 12:37:10.796281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"7d100fe3a4f3a805fe8d957b1438f4eb91b2aa14273dd6eb1a0a391152abe50b"} Nov 21 12:37:11 crc kubenswrapper[4769]: I1121 12:37:11.325810 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:37:11 crc kubenswrapper[4769]: I1121 12:37:11.325916 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:37:11 crc kubenswrapper[4769]: I1121 12:37:11.777892 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="galera" probeResult="failure" output=< Nov 21 12:37:11 crc kubenswrapper[4769]: wsrep_local_state_comment (Donor/Desynced) differs from Synced Nov 21 12:37:11 crc kubenswrapper[4769]: > Nov 21 12:37:11 crc kubenswrapper[4769]: I1121 12:37:11.815899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"382e49e62259b12a0b804b135afca426072edd614c2b0360032fd5e93434a325"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.472415 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.553297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ebb8764-2359-45db-89ba-6de7965a4fb3-operator-scripts\") pod \"5ebb8764-2359-45db-89ba-6de7965a4fb3\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.554379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqm2s\" (UniqueName: \"kubernetes.io/projected/5ebb8764-2359-45db-89ba-6de7965a4fb3-kube-api-access-zqm2s\") pod \"5ebb8764-2359-45db-89ba-6de7965a4fb3\" (UID: \"5ebb8764-2359-45db-89ba-6de7965a4fb3\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.558727 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebb8764-2359-45db-89ba-6de7965a4fb3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5ebb8764-2359-45db-89ba-6de7965a4fb3" (UID: "5ebb8764-2359-45db-89ba-6de7965a4fb3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.578310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebb8764-2359-45db-89ba-6de7965a4fb3-kube-api-access-zqm2s" (OuterVolumeSpecName: "kube-api-access-zqm2s") pod "5ebb8764-2359-45db-89ba-6de7965a4fb3" (UID: "5ebb8764-2359-45db-89ba-6de7965a4fb3"). InnerVolumeSpecName "kube-api-access-zqm2s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.653821 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.659729 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5ebb8764-2359-45db-89ba-6de7965a4fb3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.659760 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zqm2s\" (UniqueName: \"kubernetes.io/projected/5ebb8764-2359-45db-89ba-6de7965a4fb3-kube-api-access-zqm2s\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.670527 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.679660 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.685756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.757766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jb52\" (UniqueName: \"kubernetes.io/projected/a3aab941-415e-4923-9b5d-2f38004ae8c8-kube-api-access-9jb52\") pod \"a3aab941-415e-4923-9b5d-2f38004ae8c8\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-operator-scripts\") pod \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760590 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qscxb\" (UniqueName: \"kubernetes.io/projected/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-kube-api-access-qscxb\") pod \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\" (UID: \"c0928503-af84-4ec4-8cfe-85f4b1c15a1b\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3aab941-415e-4923-9b5d-2f38004ae8c8-operator-scripts\") pod \"a3aab941-415e-4923-9b5d-2f38004ae8c8\" (UID: \"a3aab941-415e-4923-9b5d-2f38004ae8c8\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzzdh\" (UniqueName: \"kubernetes.io/projected/2a9ec7d7-20af-4215-bfa6-06a203e6479e-kube-api-access-nzzdh\") pod \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e3741bb-6b59-41ec-9312-743a83ebbfff-operator-scripts\") pod \"9e3741bb-6b59-41ec-9312-743a83ebbfff\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760752 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a9ec7d7-20af-4215-bfa6-06a203e6479e-operator-scripts\") pod \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\" (UID: \"2a9ec7d7-20af-4215-bfa6-06a203e6479e\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.760777 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2d68\" (UniqueName: \"kubernetes.io/projected/9e3741bb-6b59-41ec-9312-743a83ebbfff-kube-api-access-l2d68\") pod \"9e3741bb-6b59-41ec-9312-743a83ebbfff\" (UID: \"9e3741bb-6b59-41ec-9312-743a83ebbfff\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.762477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c0928503-af84-4ec4-8cfe-85f4b1c15a1b" (UID: "c0928503-af84-4ec4-8cfe-85f4b1c15a1b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.762972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3741bb-6b59-41ec-9312-743a83ebbfff-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9e3741bb-6b59-41ec-9312-743a83ebbfff" (UID: "9e3741bb-6b59-41ec-9312-743a83ebbfff"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.763401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3aab941-415e-4923-9b5d-2f38004ae8c8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a3aab941-415e-4923-9b5d-2f38004ae8c8" (UID: "a3aab941-415e-4923-9b5d-2f38004ae8c8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.763686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a9ec7d7-20af-4215-bfa6-06a203e6479e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2a9ec7d7-20af-4215-bfa6-06a203e6479e" (UID: "2a9ec7d7-20af-4215-bfa6-06a203e6479e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.766851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9ec7d7-20af-4215-bfa6-06a203e6479e-kube-api-access-nzzdh" (OuterVolumeSpecName: "kube-api-access-nzzdh") pod "2a9ec7d7-20af-4215-bfa6-06a203e6479e" (UID: "2a9ec7d7-20af-4215-bfa6-06a203e6479e"). InnerVolumeSpecName "kube-api-access-nzzdh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.767663 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-kube-api-access-qscxb" (OuterVolumeSpecName: "kube-api-access-qscxb") pod "c0928503-af84-4ec4-8cfe-85f4b1c15a1b" (UID: "c0928503-af84-4ec4-8cfe-85f4b1c15a1b"). InnerVolumeSpecName "kube-api-access-qscxb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.772396 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3741bb-6b59-41ec-9312-743a83ebbfff-kube-api-access-l2d68" (OuterVolumeSpecName: "kube-api-access-l2d68") pod "9e3741bb-6b59-41ec-9312-743a83ebbfff" (UID: "9e3741bb-6b59-41ec-9312-743a83ebbfff"). InnerVolumeSpecName "kube-api-access-l2d68". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.772816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3aab941-415e-4923-9b5d-2f38004ae8c8-kube-api-access-9jb52" (OuterVolumeSpecName: "kube-api-access-9jb52") pod "a3aab941-415e-4923-9b5d-2f38004ae8c8" (UID: "a3aab941-415e-4923-9b5d-2f38004ae8c8"). InnerVolumeSpecName "kube-api-access-9jb52". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.837206 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-qms5v" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.837241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-qms5v" event={"ID":"9e3741bb-6b59-41ec-9312-743a83ebbfff","Type":"ContainerDied","Data":"c72ecc03aa4e903ad2ea741b3f0904351901992e0178b18bcc53d1230614a2c8"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.837295 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c72ecc03aa4e903ad2ea741b3f0904351901992e0178b18bcc53d1230614a2c8" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.838644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" event={"ID":"5ebb8764-2359-45db-89ba-6de7965a4fb3","Type":"ContainerDied","Data":"c91b963852aba7b3dce8e98d6f93f6c1621aa9198791b5d0f54e1675638e22be"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.838663 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c91b963852aba7b3dce8e98d6f93f6c1621aa9198791b5d0f54e1675638e22be" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.838736 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77f5-account-create-gn48j" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.862101 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/76fe0888-df08-4e5a-866f-211e3ebc5c3c-operator-scripts\") pod \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.862545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9z5m\" (UniqueName: \"kubernetes.io/projected/76fe0888-df08-4e5a-866f-211e3ebc5c3c-kube-api-access-q9z5m\") pod \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\" (UID: \"76fe0888-df08-4e5a-866f-211e3ebc5c3c\") " Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863026 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzzdh\" (UniqueName: \"kubernetes.io/projected/2a9ec7d7-20af-4215-bfa6-06a203e6479e-kube-api-access-nzzdh\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863064 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e3741bb-6b59-41ec-9312-743a83ebbfff-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863077 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a9ec7d7-20af-4215-bfa6-06a203e6479e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863087 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l2d68\" (UniqueName: \"kubernetes.io/projected/9e3741bb-6b59-41ec-9312-743a83ebbfff-kube-api-access-l2d68\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863096 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9jb52\" (UniqueName: \"kubernetes.io/projected/a3aab941-415e-4923-9b5d-2f38004ae8c8-kube-api-access-9jb52\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863104 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863113 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qscxb\" (UniqueName: \"kubernetes.io/projected/c0928503-af84-4ec4-8cfe-85f4b1c15a1b-kube-api-access-qscxb\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.863122 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a3aab941-415e-4923-9b5d-2f38004ae8c8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.868695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76fe0888-df08-4e5a-866f-211e3ebc5c3c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "76fe0888-df08-4e5a-866f-211e3ebc5c3c" (UID: "76fe0888-df08-4e5a-866f-211e3ebc5c3c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.882174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"00c7261b6fba217c4e24a1664abc878170130e5209700df5097de176b6b61570"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.886180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-v5487" event={"ID":"76fe0888-df08-4e5a-866f-211e3ebc5c3c","Type":"ContainerDied","Data":"50a5bb1b430f41de44cbab048803eed67148844cdf4ba5c3aef0cce14e154a85"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.886253 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50a5bb1b430f41de44cbab048803eed67148844cdf4ba5c3aef0cce14e154a85" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.886335 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-v5487" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.895571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" event={"ID":"a3aab941-415e-4923-9b5d-2f38004ae8c8","Type":"ContainerDied","Data":"50b6cdf17c5a925cf5ca37800be30faa38c5e458f20f12f292072f3c6977cb1f"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.895616 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50b6cdf17c5a925cf5ca37800be30faa38c5e458f20f12f292072f3c6977cb1f" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.895698 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-184a-account-create-hsdc5" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.902051 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.902235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-5qlv2" event={"ID":"2a9ec7d7-20af-4215-bfa6-06a203e6479e","Type":"ContainerDied","Data":"4db75871747c48efe19dfc78bb9c1b74c7684aaf2e1ff50850629103655d347a"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.903553 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4db75871747c48efe19dfc78bb9c1b74c7684aaf2e1ff50850629103655d347a" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.907510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" event={"ID":"c0928503-af84-4ec4-8cfe-85f4b1c15a1b","Type":"ContainerDied","Data":"d52da6c034e3a1e36d8bdfb0ee0e6f1e1ca4d117bc8aa9de8838c5f5b1a7127f"} Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.907558 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d52da6c034e3a1e36d8bdfb0ee0e6f1e1ca4d117bc8aa9de8838c5f5b1a7127f" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.907643 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2331-account-create-8kfz5" Nov 21 12:37:12 crc kubenswrapper[4769]: I1121 12:37:12.965299 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/76fe0888-df08-4e5a-866f-211e3ebc5c3c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:13 crc kubenswrapper[4769]: I1121 12:37:13.024379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76fe0888-df08-4e5a-866f-211e3ebc5c3c-kube-api-access-q9z5m" (OuterVolumeSpecName: "kube-api-access-q9z5m") pod "76fe0888-df08-4e5a-866f-211e3ebc5c3c" (UID: "76fe0888-df08-4e5a-866f-211e3ebc5c3c"). InnerVolumeSpecName "kube-api-access-q9z5m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:13 crc kubenswrapper[4769]: I1121 12:37:13.068152 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q9z5m\" (UniqueName: \"kubernetes.io/projected/76fe0888-df08-4e5a-866f-211e3ebc5c3c-kube-api-access-q9z5m\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:13 crc kubenswrapper[4769]: I1121 12:37:13.797814 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:37:13 crc kubenswrapper[4769]: I1121 12:37:13.903998 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:37:13 crc kubenswrapper[4769]: I1121 12:37:13.949071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerStarted","Data":"06506e0bf02484fbd9db9e70996803ffdb0e5e3c0108bdd7c65596b358830bb8"} Nov 21 12:37:13 crc kubenswrapper[4769]: I1121 12:37:13.990828 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=29.990810699 podStartE2EDuration="29.990810699s" podCreationTimestamp="2025-11-21 12:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:13.988001333 +0000 UTC m=+2792.688663161" watchObservedRunningTime="2025-11-21 12:37:13.990810699 +0000 UTC m=+2792.691472517" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189386 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9"] Nov 21 12:37:14 crc kubenswrapper[4769]: E1121 12:37:14.189838 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c0928503-af84-4ec4-8cfe-85f4b1c15a1b" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189859 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0928503-af84-4ec4-8cfe-85f4b1c15a1b" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: E1121 12:37:14.189874 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a3aab941-415e-4923-9b5d-2f38004ae8c8" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189882 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3aab941-415e-4923-9b5d-2f38004ae8c8" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: E1121 12:37:14.189906 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e3741bb-6b59-41ec-9312-743a83ebbfff" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189914 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3741bb-6b59-41ec-9312-743a83ebbfff" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: E1121 12:37:14.189930 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ebb8764-2359-45db-89ba-6de7965a4fb3" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189936 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebb8764-2359-45db-89ba-6de7965a4fb3" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: E1121 12:37:14.189950 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2a9ec7d7-20af-4215-bfa6-06a203e6479e" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189958 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9ec7d7-20af-4215-bfa6-06a203e6479e" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: E1121 12:37:14.189971 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="76fe0888-df08-4e5a-866f-211e3ebc5c3c" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.189978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fe0888-df08-4e5a-866f-211e3ebc5c3c" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.190181 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a3aab941-415e-4923-9b5d-2f38004ae8c8" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.190218 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2a9ec7d7-20af-4215-bfa6-06a203e6479e" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.190229 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ebb8764-2359-45db-89ba-6de7965a4fb3" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.190248 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e3741bb-6b59-41ec-9312-743a83ebbfff" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.190261 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="76fe0888-df08-4e5a-866f-211e3ebc5c3c" containerName="mariadb-database-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.190280 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c0928503-af84-4ec4-8cfe-85f4b1c15a1b" containerName="mariadb-account-create" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.192140 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.196640 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.206279 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9"] Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.292093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-config\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.292177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.292315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.292410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8m7d\" (UniqueName: \"kubernetes.io/projected/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-kube-api-access-q8m7d\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.395819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.395916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.395964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q8m7d\" (UniqueName: \"kubernetes.io/projected/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-kube-api-access-q8m7d\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.396202 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-config\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.397990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.398011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-config\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.402906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.450626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8m7d\" (UniqueName: \"kubernetes.io/projected/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-kube-api-access-q8m7d\") pod \"dnsmasq-dnsmasq-5f74d875b5-vxvn9\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.514498 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.912073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9"] Nov 21 12:37:14 crc kubenswrapper[4769]: I1121 12:37:14.961503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" event={"ID":"be7ae658-46c5-4bc5-9af6-585e3cb3c49c","Type":"ContainerStarted","Data":"84a15f4c2083bc4e7cea7eb07221c13f66f6c16c7575e4970c03e74d59a4c759"} Nov 21 12:37:15 crc kubenswrapper[4769]: I1121 12:37:15.972914 4769 generic.go:334] "Generic (PLEG): container finished" podID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerID="1bc7dbaa544d3ee426af8ac366dae4a99802c2e4cdb63cb2fdceecfe9ac2fc8b" exitCode=0 Nov 21 12:37:15 crc kubenswrapper[4769]: I1121 12:37:15.972988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" event={"ID":"be7ae658-46c5-4bc5-9af6-585e3cb3c49c","Type":"ContainerDied","Data":"1bc7dbaa544d3ee426af8ac366dae4a99802c2e4cdb63cb2fdceecfe9ac2fc8b"} Nov 21 12:37:16 crc kubenswrapper[4769]: I1121 12:37:16.986087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" event={"ID":"be7ae658-46c5-4bc5-9af6-585e3cb3c49c","Type":"ContainerStarted","Data":"a5a8146a15ea9bc60a554534b0905f417aca1b11cf6200982f79b001e6db04e5"} Nov 21 12:37:16 crc kubenswrapper[4769]: I1121 12:37:16.986413 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.012094 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" podStartSLOduration=3.012073831 podStartE2EDuration="3.012073831s" podCreationTimestamp="2025-11-21 12:37:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:17.002403101 +0000 UTC m=+2795.703064919" watchObservedRunningTime="2025-11-21 12:37:17.012073831 +0000 UTC m=+2795.712735649" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.325885 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-77f4g"] Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.327559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.329999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-lhswr" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.331017 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.344701 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-77f4g"] Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.354002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-db-sync-config-data\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.354079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-config-data\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.354309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79449\" (UniqueName: \"kubernetes.io/projected/4351132b-709f-4e78-9ddc-55107a3874ec-kube-api-access-79449\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.354557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-combined-ca-bundle\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.456428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-config-data\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.456512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-79449\" (UniqueName: \"kubernetes.io/projected/4351132b-709f-4e78-9ddc-55107a3874ec-kube-api-access-79449\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.456590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-combined-ca-bundle\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.456621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-db-sync-config-data\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.462039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-db-sync-config-data\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.462224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-config-data\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.473263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-combined-ca-bundle\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.477150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-79449\" (UniqueName: \"kubernetes.io/projected/4351132b-709f-4e78-9ddc-55107a3874ec-kube-api-access-79449\") pod \"glance-db-sync-77f4g\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:17 crc kubenswrapper[4769]: I1121 12:37:17.677920 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.135751 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-77f4g"] Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.360071 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-2" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.107:5671: connect: connection refused" Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.624883 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.105:5671: connect: connection refused" Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.645217 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-1" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.106:5671: connect: connection refused" Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.765523 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.108:5671: connect: connection refused" Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.766394 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.110:5671: connect: connection refused" Nov 21 12:37:18 crc kubenswrapper[4769]: I1121 12:37:18.849307 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.109:5671: connect: connection refused" Nov 21 12:37:19 crc kubenswrapper[4769]: I1121 12:37:19.007309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-77f4g" event={"ID":"4351132b-709f-4e78-9ddc-55107a3874ec","Type":"ContainerStarted","Data":"4ee9bad102975b864cba37066653c22ce42788fc760662701ca8489d908831e7"} Nov 21 12:37:19 crc kubenswrapper[4769]: I1121 12:37:19.007354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-77f4g" event={"ID":"4351132b-709f-4e78-9ddc-55107a3874ec","Type":"ContainerStarted","Data":"f9e5e37008fbf95ebe9c4dd806031299fff8d23892d395feaee6b3901d4ae386"} Nov 21 12:37:19 crc kubenswrapper[4769]: I1121 12:37:19.028008 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-77f4g" podStartSLOduration=2.027993083 podStartE2EDuration="2.027993083s" podCreationTimestamp="2025-11-21 12:37:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:19.024417326 +0000 UTC m=+2797.725079154" watchObservedRunningTime="2025-11-21 12:37:19.027993083 +0000 UTC m=+2797.728654901" Nov 21 12:37:19 crc kubenswrapper[4769]: I1121 12:37:19.467862 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:37:19 crc kubenswrapper[4769]: I1121 12:37:19.549912 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:37:21 crc kubenswrapper[4769]: I1121 12:37:21.532058 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:37:21 crc kubenswrapper[4769]: I1121 12:37:21.626725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:37:24 crc kubenswrapper[4769]: I1121 12:37:24.516437 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:37:24 crc kubenswrapper[4769]: I1121 12:37:24.583731 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c"] Nov 21 12:37:24 crc kubenswrapper[4769]: I1121 12:37:24.586667 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" containerName="dnsmasq-dns" containerID="cri-o://8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2" gracePeriod=10 Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.057710 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.093782 4769 generic.go:334] "Generic (PLEG): container finished" podID="18dea187-c7dd-4482-83ea-9c36d754313d" containerID="8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2" exitCode=0 Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.093828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" event={"ID":"18dea187-c7dd-4482-83ea-9c36d754313d","Type":"ContainerDied","Data":"8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2"} Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.093858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" event={"ID":"18dea187-c7dd-4482-83ea-9c36d754313d","Type":"ContainerDied","Data":"ee5ca1d8ee4167719417321af558dd8b7f6aa8677b51d7b924ae13ba22674805"} Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.093877 4769 scope.go:117] "RemoveContainer" containerID="8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.093983 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.125699 4769 scope.go:117] "RemoveContainer" containerID="e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.152425 4769 scope.go:117] "RemoveContainer" containerID="8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2" Nov 21 12:37:25 crc kubenswrapper[4769]: E1121 12:37:25.152974 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2\": container with ID starting with 8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2 not found: ID does not exist" containerID="8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.153006 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2"} err="failed to get container status \"8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2\": rpc error: code = NotFound desc = could not find container \"8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2\": container with ID starting with 8d2573794cc18397819c6e1595339cff390aaa7329ae1b0e5cb70007b9acbbf2 not found: ID does not exist" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.153027 4769 scope.go:117] "RemoveContainer" containerID="e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4" Nov 21 12:37:25 crc kubenswrapper[4769]: E1121 12:37:25.153435 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4\": container with ID starting with e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4 not found: ID does not exist" containerID="e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.153517 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4"} err="failed to get container status \"e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4\": rpc error: code = NotFound desc = could not find container \"e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4\": container with ID starting with e28bcd52a2bca2478e0968b5764ddb3c7d8e1a03a0c5e8e9c123a44bf7e348d4 not found: ID does not exist" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.192733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-config\") pod \"18dea187-c7dd-4482-83ea-9c36d754313d\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.192816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxkzp\" (UniqueName: \"kubernetes.io/projected/18dea187-c7dd-4482-83ea-9c36d754313d-kube-api-access-nxkzp\") pod \"18dea187-c7dd-4482-83ea-9c36d754313d\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.192866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-dnsmasq-svc\") pod \"18dea187-c7dd-4482-83ea-9c36d754313d\" (UID: \"18dea187-c7dd-4482-83ea-9c36d754313d\") " Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.200358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18dea187-c7dd-4482-83ea-9c36d754313d-kube-api-access-nxkzp" (OuterVolumeSpecName: "kube-api-access-nxkzp") pod "18dea187-c7dd-4482-83ea-9c36d754313d" (UID: "18dea187-c7dd-4482-83ea-9c36d754313d"). InnerVolumeSpecName "kube-api-access-nxkzp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.244826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-config" (OuterVolumeSpecName: "config") pod "18dea187-c7dd-4482-83ea-9c36d754313d" (UID: "18dea187-c7dd-4482-83ea-9c36d754313d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.248817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "18dea187-c7dd-4482-83ea-9c36d754313d" (UID: "18dea187-c7dd-4482-83ea-9c36d754313d"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.296429 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.296668 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nxkzp\" (UniqueName: \"kubernetes.io/projected/18dea187-c7dd-4482-83ea-9c36d754313d-kube-api-access-nxkzp\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.296756 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/18dea187-c7dd-4482-83ea-9c36d754313d-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.380653 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.432281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c"] Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.441983 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-6rm6c"] Nov 21 12:37:25 crc kubenswrapper[4769]: I1121 12:37:25.492662 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:37:27 crc kubenswrapper[4769]: I1121 12:37:27.286157 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" path="/var/lib/kubelet/pods/18dea187-c7dd-4482-83ea-9c36d754313d/volumes" Nov 21 12:37:28 crc kubenswrapper[4769]: I1121 12:37:28.358336 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:37:28 crc kubenswrapper[4769]: I1121 12:37:28.625436 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:37:28 crc kubenswrapper[4769]: I1121 12:37:28.644770 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-1" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.106:5671: connect: connection refused" Nov 21 12:37:28 crc kubenswrapper[4769]: I1121 12:37:28.762910 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.110:5671: connect: connection refused" Nov 21 12:37:28 crc kubenswrapper[4769]: I1121 12:37:28.764301 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.108:5671: connect: connection refused" Nov 21 12:37:28 crc kubenswrapper[4769]: I1121 12:37:28.850416 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:37:31 crc kubenswrapper[4769]: I1121 12:37:31.154824 4769 generic.go:334] "Generic (PLEG): container finished" podID="4351132b-709f-4e78-9ddc-55107a3874ec" containerID="4ee9bad102975b864cba37066653c22ce42788fc760662701ca8489d908831e7" exitCode=0 Nov 21 12:37:31 crc kubenswrapper[4769]: I1121 12:37:31.155322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-77f4g" event={"ID":"4351132b-709f-4e78-9ddc-55107a3874ec","Type":"ContainerDied","Data":"4ee9bad102975b864cba37066653c22ce42788fc760662701ca8489d908831e7"} Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.521761 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.647871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79449\" (UniqueName: \"kubernetes.io/projected/4351132b-709f-4e78-9ddc-55107a3874ec-kube-api-access-79449\") pod \"4351132b-709f-4e78-9ddc-55107a3874ec\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.648095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-db-sync-config-data\") pod \"4351132b-709f-4e78-9ddc-55107a3874ec\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.648299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-config-data\") pod \"4351132b-709f-4e78-9ddc-55107a3874ec\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.648363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-combined-ca-bundle\") pod \"4351132b-709f-4e78-9ddc-55107a3874ec\" (UID: \"4351132b-709f-4e78-9ddc-55107a3874ec\") " Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.657342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4351132b-709f-4e78-9ddc-55107a3874ec-kube-api-access-79449" (OuterVolumeSpecName: "kube-api-access-79449") pod "4351132b-709f-4e78-9ddc-55107a3874ec" (UID: "4351132b-709f-4e78-9ddc-55107a3874ec"). InnerVolumeSpecName "kube-api-access-79449". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.664449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "4351132b-709f-4e78-9ddc-55107a3874ec" (UID: "4351132b-709f-4e78-9ddc-55107a3874ec"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.688971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4351132b-709f-4e78-9ddc-55107a3874ec" (UID: "4351132b-709f-4e78-9ddc-55107a3874ec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.713067 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-config-data" (OuterVolumeSpecName: "config-data") pod "4351132b-709f-4e78-9ddc-55107a3874ec" (UID: "4351132b-709f-4e78-9ddc-55107a3874ec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.749872 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.749916 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.749928 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4351132b-709f-4e78-9ddc-55107a3874ec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:32 crc kubenswrapper[4769]: I1121 12:37:32.749937 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-79449\" (UniqueName: \"kubernetes.io/projected/4351132b-709f-4e78-9ddc-55107a3874ec-kube-api-access-79449\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:33 crc kubenswrapper[4769]: I1121 12:37:33.176318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-77f4g" event={"ID":"4351132b-709f-4e78-9ddc-55107a3874ec","Type":"ContainerDied","Data":"f9e5e37008fbf95ebe9c4dd806031299fff8d23892d395feaee6b3901d4ae386"} Nov 21 12:37:33 crc kubenswrapper[4769]: I1121 12:37:33.176356 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9e5e37008fbf95ebe9c4dd806031299fff8d23892d395feaee6b3901d4ae386" Nov 21 12:37:33 crc kubenswrapper[4769]: I1121 12:37:33.176384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-77f4g" Nov 21 12:37:38 crc kubenswrapper[4769]: I1121 12:37:38.645432 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:37:38 crc kubenswrapper[4769]: I1121 12:37:38.764378 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:37:38 crc kubenswrapper[4769]: I1121 12:37:38.765454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.021887 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lnzdp"] Nov 21 12:37:39 crc kubenswrapper[4769]: E1121 12:37:39.022260 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4351132b-709f-4e78-9ddc-55107a3874ec" containerName="glance-db-sync" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.022276 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4351132b-709f-4e78-9ddc-55107a3874ec" containerName="glance-db-sync" Nov 21 12:37:39 crc kubenswrapper[4769]: E1121 12:37:39.022289 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" containerName="dnsmasq-dns" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.022295 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" containerName="dnsmasq-dns" Nov 21 12:37:39 crc kubenswrapper[4769]: E1121 12:37:39.022332 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" containerName="init" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.022340 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" containerName="init" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.022484 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="18dea187-c7dd-4482-83ea-9c36d754313d" containerName="dnsmasq-dns" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.022511 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4351132b-709f-4e78-9ddc-55107a3874ec" containerName="glance-db-sync" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.023065 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.033075 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-161d-account-create-8hc9p"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.039308 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.041895 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.095156 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lnzdp"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.112370 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-161d-account-create-8hc9p"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.144791 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4fxml"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.146049 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.159716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqrg\" (UniqueName: \"kubernetes.io/projected/f67e7c6c-c640-4ec4-83c2-66da32a1046f-kube-api-access-gmqrg\") pod \"barbican-161d-account-create-8hc9p\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.159841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab774fec-28fc-4350-a6df-2b93e7e00df9-operator-scripts\") pod \"cinder-db-create-lnzdp\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.159886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f67e7c6c-c640-4ec4-83c2-66da32a1046f-operator-scripts\") pod \"barbican-161d-account-create-8hc9p\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.159912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gslqv\" (UniqueName: \"kubernetes.io/projected/ab774fec-28fc-4350-a6df-2b93e7e00df9-kube-api-access-gslqv\") pod \"cinder-db-create-lnzdp\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.160093 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4fxml"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.169983 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-7629-account-create-n7f6f"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.171454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.183346 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.196242 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-7629-account-create-n7f6f"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.260896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqrg\" (UniqueName: \"kubernetes.io/projected/f67e7c6c-c640-4ec4-83c2-66da32a1046f-kube-api-access-gmqrg\") pod \"barbican-161d-account-create-8hc9p\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.260976 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ce645b3-d9d2-4754-bd86-e2255425058c-operator-scripts\") pod \"cinder-7629-account-create-n7f6f\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-operator-scripts\") pod \"barbican-db-create-4fxml\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab774fec-28fc-4350-a6df-2b93e7e00df9-operator-scripts\") pod \"cinder-db-create-lnzdp\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f67e7c6c-c640-4ec4-83c2-66da32a1046f-operator-scripts\") pod \"barbican-161d-account-create-8hc9p\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gslqv\" (UniqueName: \"kubernetes.io/projected/ab774fec-28fc-4350-a6df-2b93e7e00df9-kube-api-access-gslqv\") pod \"cinder-db-create-lnzdp\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr6qs\" (UniqueName: \"kubernetes.io/projected/2ce645b3-d9d2-4754-bd86-e2255425058c-kube-api-access-pr6qs\") pod \"cinder-7629-account-create-n7f6f\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbj6p\" (UniqueName: \"kubernetes.io/projected/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-kube-api-access-dbj6p\") pod \"barbican-db-create-4fxml\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.261983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab774fec-28fc-4350-a6df-2b93e7e00df9-operator-scripts\") pod \"cinder-db-create-lnzdp\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.262457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f67e7c6c-c640-4ec4-83c2-66da32a1046f-operator-scripts\") pod \"barbican-161d-account-create-8hc9p\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.281795 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gslqv\" (UniqueName: \"kubernetes.io/projected/ab774fec-28fc-4350-a6df-2b93e7e00df9-kube-api-access-gslqv\") pod \"cinder-db-create-lnzdp\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.283396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqrg\" (UniqueName: \"kubernetes.io/projected/f67e7c6c-c640-4ec4-83c2-66da32a1046f-kube-api-access-gmqrg\") pod \"barbican-161d-account-create-8hc9p\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.309680 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-gl7xv"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.310786 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.312908 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.313304 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.313479 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w2kpl" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.313612 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.328115 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-gl7xv"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.356872 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.362205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pr6qs\" (UniqueName: \"kubernetes.io/projected/2ce645b3-d9d2-4754-bd86-e2255425058c-kube-api-access-pr6qs\") pod \"cinder-7629-account-create-n7f6f\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.362859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj6p\" (UniqueName: \"kubernetes.io/projected/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-kube-api-access-dbj6p\") pod \"barbican-db-create-4fxml\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.362894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25fxp\" (UniqueName: \"kubernetes.io/projected/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-kube-api-access-25fxp\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.362995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-config-data\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.363252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ce645b3-d9d2-4754-bd86-e2255425058c-operator-scripts\") pod \"cinder-7629-account-create-n7f6f\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.363316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-operator-scripts\") pod \"barbican-db-create-4fxml\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.363362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-combined-ca-bundle\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.363998 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-operator-scripts\") pod \"barbican-db-create-4fxml\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.364145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ce645b3-d9d2-4754-bd86-e2255425058c-operator-scripts\") pod \"cinder-7629-account-create-n7f6f\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.380297 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.383296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbj6p\" (UniqueName: \"kubernetes.io/projected/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-kube-api-access-dbj6p\") pod \"barbican-db-create-4fxml\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.383676 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr6qs\" (UniqueName: \"kubernetes.io/projected/2ce645b3-d9d2-4754-bd86-e2255425058c-kube-api-access-pr6qs\") pod \"cinder-7629-account-create-n7f6f\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.444082 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-2b29-account-create-ktl57"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.447399 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.449508 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.458655 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-28bn5"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.460058 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.465481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-config-data\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.465570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-combined-ca-bundle\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.465625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-25fxp\" (UniqueName: \"kubernetes.io/projected/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-kube-api-access-25fxp\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.469436 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.471063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-combined-ca-bundle\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.475988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-config-data\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.507516 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-25fxp\" (UniqueName: \"kubernetes.io/projected/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-kube-api-access-25fxp\") pod \"keystone-db-sync-gl7xv\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.508047 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-2b29-account-create-ktl57"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.511542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.538927 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.561859 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-28bn5"] Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.581807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/157ffe7a-4ce3-4903-a2a0-e34bd0032714-operator-scripts\") pod \"neutron-db-create-28bn5\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.581871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7a836c3-2094-4661-b1f1-1159e00614ff-operator-scripts\") pod \"neutron-2b29-account-create-ktl57\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.581964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq5vz\" (UniqueName: \"kubernetes.io/projected/f7a836c3-2094-4661-b1f1-1159e00614ff-kube-api-access-bq5vz\") pod \"neutron-2b29-account-create-ktl57\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.581999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vshc\" (UniqueName: \"kubernetes.io/projected/157ffe7a-4ce3-4903-a2a0-e34bd0032714-kube-api-access-6vshc\") pod \"neutron-db-create-28bn5\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.683983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bq5vz\" (UniqueName: \"kubernetes.io/projected/f7a836c3-2094-4661-b1f1-1159e00614ff-kube-api-access-bq5vz\") pod \"neutron-2b29-account-create-ktl57\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.685577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6vshc\" (UniqueName: \"kubernetes.io/projected/157ffe7a-4ce3-4903-a2a0-e34bd0032714-kube-api-access-6vshc\") pod \"neutron-db-create-28bn5\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.685689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/157ffe7a-4ce3-4903-a2a0-e34bd0032714-operator-scripts\") pod \"neutron-db-create-28bn5\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.685790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7a836c3-2094-4661-b1f1-1159e00614ff-operator-scripts\") pod \"neutron-2b29-account-create-ktl57\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.686684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/157ffe7a-4ce3-4903-a2a0-e34bd0032714-operator-scripts\") pod \"neutron-db-create-28bn5\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.686790 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7a836c3-2094-4661-b1f1-1159e00614ff-operator-scripts\") pod \"neutron-2b29-account-create-ktl57\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.709769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vshc\" (UniqueName: \"kubernetes.io/projected/157ffe7a-4ce3-4903-a2a0-e34bd0032714-kube-api-access-6vshc\") pod \"neutron-db-create-28bn5\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.745399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq5vz\" (UniqueName: \"kubernetes.io/projected/f7a836c3-2094-4661-b1f1-1159e00614ff-kube-api-access-bq5vz\") pod \"neutron-2b29-account-create-ktl57\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.874111 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:39 crc kubenswrapper[4769]: I1121 12:37:39.884348 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.011151 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lnzdp"] Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.176390 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4fxml"] Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.194318 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-161d-account-create-8hc9p"] Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.203169 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-gl7xv"] Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.289183 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" event={"ID":"ab774fec-28fc-4350-a6df-2b93e7e00df9","Type":"ContainerStarted","Data":"19af8e0d55e175276f68d3965da099402e27d87e1b887cfd237272addc06c9bd"} Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.289309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" event={"ID":"ab774fec-28fc-4350-a6df-2b93e7e00df9","Type":"ContainerStarted","Data":"06a8e9b64944f6cafce688c699d27c501886271402a7d975fa76f0ceb69bd1a7"} Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.297676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4fxml" event={"ID":"a47d2205-0f3d-421c-acfa-fc91d51a2ed6","Type":"ContainerStarted","Data":"cfc5acee029ce0a8d7036be3fbcb287c3191aa20a84b9952ad95a9199096947b"} Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.299142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" event={"ID":"f67e7c6c-c640-4ec4-83c2-66da32a1046f","Type":"ContainerStarted","Data":"475eb5a0aa97a2705c95718de4d5bde745d66e1b9eb9f315c686bd7f50b37f63"} Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.300652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" event={"ID":"bebfb972-08eb-4f4d-9ba0-dadb691edfc2","Type":"ContainerStarted","Data":"914fc1778d957c5622a8f56c89755ab67e4669c2a91fd0b92a3699b3fdae645e"} Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.306902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-7629-account-create-n7f6f"] Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.360059 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-28bn5"] Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.367873 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" podStartSLOduration=1.367853234 podStartE2EDuration="1.367853234s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:40.325949897 +0000 UTC m=+2819.026611705" watchObservedRunningTime="2025-11-21 12:37:40.367853234 +0000 UTC m=+2819.068515052" Nov 21 12:37:40 crc kubenswrapper[4769]: I1121 12:37:40.456812 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-2b29-account-create-ktl57"] Nov 21 12:37:40 crc kubenswrapper[4769]: W1121 12:37:40.463204 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a836c3_2094_4661_b1f1_1159e00614ff.slice/crio-f2c868a05e381083ca2887f2b693db59665ece81c9b31aeb275f2fb5e42ce15c WatchSource:0}: Error finding container f2c868a05e381083ca2887f2b693db59665ece81c9b31aeb275f2fb5e42ce15c: Status 404 returned error can't find the container with id f2c868a05e381083ca2887f2b693db59665ece81c9b31aeb275f2fb5e42ce15c Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.313003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" event={"ID":"f7a836c3-2094-4661-b1f1-1159e00614ff","Type":"ContainerStarted","Data":"5200b0f1de461cbc96abcbfde5c1eba4e45d03683d1452b17bdfab5ee492ba80"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.313057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" event={"ID":"f7a836c3-2094-4661-b1f1-1159e00614ff","Type":"ContainerStarted","Data":"f2c868a05e381083ca2887f2b693db59665ece81c9b31aeb275f2fb5e42ce15c"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.322644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" event={"ID":"f67e7c6c-c640-4ec4-83c2-66da32a1046f","Type":"ContainerStarted","Data":"4e957633211855a1b5b6a0f3280d014600d295bcb3f59cdc4fe29f4abed1f0b3"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.325525 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.325580 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.326305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" event={"ID":"bebfb972-08eb-4f4d-9ba0-dadb691edfc2","Type":"ContainerStarted","Data":"00bb5fa66fefd6977fa04dec5423aa621b838825da13a70a2136a4665e09f258"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.338076 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" podStartSLOduration=2.338056419 podStartE2EDuration="2.338056419s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:41.337809483 +0000 UTC m=+2820.038471301" watchObservedRunningTime="2025-11-21 12:37:41.338056419 +0000 UTC m=+2820.038718237" Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.338355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" event={"ID":"2ce645b3-d9d2-4754-bd86-e2255425058c","Type":"ContainerStarted","Data":"daab05b610a70299e05b9f69ba9387bdf7e6c968d31322685e687bdfdcfddc46"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.338443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" event={"ID":"2ce645b3-d9d2-4754-bd86-e2255425058c","Type":"ContainerStarted","Data":"3b3a00366e621f41242191a43689edf272f943c71c91b0c7d7f49ecca76ed05d"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.341888 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab774fec-28fc-4350-a6df-2b93e7e00df9" containerID="19af8e0d55e175276f68d3965da099402e27d87e1b887cfd237272addc06c9bd" exitCode=0 Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.342083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" event={"ID":"ab774fec-28fc-4350-a6df-2b93e7e00df9","Type":"ContainerDied","Data":"19af8e0d55e175276f68d3965da099402e27d87e1b887cfd237272addc06c9bd"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.346653 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-28bn5" event={"ID":"157ffe7a-4ce3-4903-a2a0-e34bd0032714","Type":"ContainerStarted","Data":"d5c4c723fa02ac810a6a5560b18dcb7359fc4adab4b8b583a32ce3e47379ec5e"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.346934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-28bn5" event={"ID":"157ffe7a-4ce3-4903-a2a0-e34bd0032714","Type":"ContainerStarted","Data":"7bc4cf607e32bd60e9bfe13761c52a4a43d025aa98e4e8230452e6fc68cb48ce"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.348702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4fxml" event={"ID":"a47d2205-0f3d-421c-acfa-fc91d51a2ed6","Type":"ContainerStarted","Data":"b5f24884ebb2404925f8810286415bfa340f155ee76e831e32145e3c32b76cd3"} Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.368533 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" podStartSLOduration=2.368518169 podStartE2EDuration="2.368518169s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:41.364564272 +0000 UTC m=+2820.065226090" watchObservedRunningTime="2025-11-21 12:37:41.368518169 +0000 UTC m=+2820.069179987" Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.397301 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" podStartSLOduration=2.397285322 podStartE2EDuration="2.397285322s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:41.395503655 +0000 UTC m=+2820.096165473" watchObservedRunningTime="2025-11-21 12:37:41.397285322 +0000 UTC m=+2820.097947140" Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.439027 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-28bn5" podStartSLOduration=2.439003535 podStartE2EDuration="2.439003535s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:41.432665194 +0000 UTC m=+2820.133327012" watchObservedRunningTime="2025-11-21 12:37:41.439003535 +0000 UTC m=+2820.139665353" Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.455849 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-4fxml" podStartSLOduration=2.455828897 podStartE2EDuration="2.455828897s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:41.451734727 +0000 UTC m=+2820.152396545" watchObservedRunningTime="2025-11-21 12:37:41.455828897 +0000 UTC m=+2820.156490715" Nov 21 12:37:41 crc kubenswrapper[4769]: I1121 12:37:41.502586 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" podStartSLOduration=2.502565144 podStartE2EDuration="2.502565144s" podCreationTimestamp="2025-11-21 12:37:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:41.497907629 +0000 UTC m=+2820.198569447" watchObservedRunningTime="2025-11-21 12:37:41.502565144 +0000 UTC m=+2820.203226962" Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.360964 4769 generic.go:334] "Generic (PLEG): container finished" podID="157ffe7a-4ce3-4903-a2a0-e34bd0032714" containerID="d5c4c723fa02ac810a6a5560b18dcb7359fc4adab4b8b583a32ce3e47379ec5e" exitCode=0 Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.361424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-28bn5" event={"ID":"157ffe7a-4ce3-4903-a2a0-e34bd0032714","Type":"ContainerDied","Data":"d5c4c723fa02ac810a6a5560b18dcb7359fc4adab4b8b583a32ce3e47379ec5e"} Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.363954 4769 generic.go:334] "Generic (PLEG): container finished" podID="a47d2205-0f3d-421c-acfa-fc91d51a2ed6" containerID="b5f24884ebb2404925f8810286415bfa340f155ee76e831e32145e3c32b76cd3" exitCode=0 Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.364142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4fxml" event={"ID":"a47d2205-0f3d-421c-acfa-fc91d51a2ed6","Type":"ContainerDied","Data":"b5f24884ebb2404925f8810286415bfa340f155ee76e831e32145e3c32b76cd3"} Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.367329 4769 generic.go:334] "Generic (PLEG): container finished" podID="f7a836c3-2094-4661-b1f1-1159e00614ff" containerID="5200b0f1de461cbc96abcbfde5c1eba4e45d03683d1452b17bdfab5ee492ba80" exitCode=0 Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.367423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" event={"ID":"f7a836c3-2094-4661-b1f1-1159e00614ff","Type":"ContainerDied","Data":"5200b0f1de461cbc96abcbfde5c1eba4e45d03683d1452b17bdfab5ee492ba80"} Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.369020 4769 generic.go:334] "Generic (PLEG): container finished" podID="f67e7c6c-c640-4ec4-83c2-66da32a1046f" containerID="4e957633211855a1b5b6a0f3280d014600d295bcb3f59cdc4fe29f4abed1f0b3" exitCode=0 Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.369126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" event={"ID":"f67e7c6c-c640-4ec4-83c2-66da32a1046f","Type":"ContainerDied","Data":"4e957633211855a1b5b6a0f3280d014600d295bcb3f59cdc4fe29f4abed1f0b3"} Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.370852 4769 generic.go:334] "Generic (PLEG): container finished" podID="2ce645b3-d9d2-4754-bd86-e2255425058c" containerID="daab05b610a70299e05b9f69ba9387bdf7e6c968d31322685e687bdfdcfddc46" exitCode=0 Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.370969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" event={"ID":"2ce645b3-d9d2-4754-bd86-e2255425058c","Type":"ContainerDied","Data":"daab05b610a70299e05b9f69ba9387bdf7e6c968d31322685e687bdfdcfddc46"} Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.797314 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.961415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gslqv\" (UniqueName: \"kubernetes.io/projected/ab774fec-28fc-4350-a6df-2b93e7e00df9-kube-api-access-gslqv\") pod \"ab774fec-28fc-4350-a6df-2b93e7e00df9\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.961955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab774fec-28fc-4350-a6df-2b93e7e00df9-operator-scripts\") pod \"ab774fec-28fc-4350-a6df-2b93e7e00df9\" (UID: \"ab774fec-28fc-4350-a6df-2b93e7e00df9\") " Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.962483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab774fec-28fc-4350-a6df-2b93e7e00df9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ab774fec-28fc-4350-a6df-2b93e7e00df9" (UID: "ab774fec-28fc-4350-a6df-2b93e7e00df9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:42 crc kubenswrapper[4769]: I1121 12:37:42.967877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab774fec-28fc-4350-a6df-2b93e7e00df9-kube-api-access-gslqv" (OuterVolumeSpecName: "kube-api-access-gslqv") pod "ab774fec-28fc-4350-a6df-2b93e7e00df9" (UID: "ab774fec-28fc-4350-a6df-2b93e7e00df9"). InnerVolumeSpecName "kube-api-access-gslqv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.064582 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gslqv\" (UniqueName: \"kubernetes.io/projected/ab774fec-28fc-4350-a6df-2b93e7e00df9-kube-api-access-gslqv\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.064635 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab774fec-28fc-4350-a6df-2b93e7e00df9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.393207 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.393333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-lnzdp" event={"ID":"ab774fec-28fc-4350-a6df-2b93e7e00df9","Type":"ContainerDied","Data":"06a8e9b64944f6cafce688c699d27c501886271402a7d975fa76f0ceb69bd1a7"} Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.393422 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06a8e9b64944f6cafce688c699d27c501886271402a7d975fa76f0ceb69bd1a7" Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.831917 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.984316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr6qs\" (UniqueName: \"kubernetes.io/projected/2ce645b3-d9d2-4754-bd86-e2255425058c-kube-api-access-pr6qs\") pod \"2ce645b3-d9d2-4754-bd86-e2255425058c\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.984492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ce645b3-d9d2-4754-bd86-e2255425058c-operator-scripts\") pod \"2ce645b3-d9d2-4754-bd86-e2255425058c\" (UID: \"2ce645b3-d9d2-4754-bd86-e2255425058c\") " Nov 21 12:37:43 crc kubenswrapper[4769]: I1121 12:37:43.986049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ce645b3-d9d2-4754-bd86-e2255425058c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2ce645b3-d9d2-4754-bd86-e2255425058c" (UID: "2ce645b3-d9d2-4754-bd86-e2255425058c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.006141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce645b3-d9d2-4754-bd86-e2255425058c-kube-api-access-pr6qs" (OuterVolumeSpecName: "kube-api-access-pr6qs") pod "2ce645b3-d9d2-4754-bd86-e2255425058c" (UID: "2ce645b3-d9d2-4754-bd86-e2255425058c"). InnerVolumeSpecName "kube-api-access-pr6qs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.088142 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pr6qs\" (UniqueName: \"kubernetes.io/projected/2ce645b3-d9d2-4754-bd86-e2255425058c-kube-api-access-pr6qs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.088185 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2ce645b3-d9d2-4754-bd86-e2255425058c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.177919 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.186524 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.193401 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.201083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.298995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-operator-scripts\") pod \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vshc\" (UniqueName: \"kubernetes.io/projected/157ffe7a-4ce3-4903-a2a0-e34bd0032714-kube-api-access-6vshc\") pod \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f67e7c6c-c640-4ec4-83c2-66da32a1046f-operator-scripts\") pod \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbj6p\" (UniqueName: \"kubernetes.io/projected/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-kube-api-access-dbj6p\") pod \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\" (UID: \"a47d2205-0f3d-421c-acfa-fc91d51a2ed6\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmqrg\" (UniqueName: \"kubernetes.io/projected/f67e7c6c-c640-4ec4-83c2-66da32a1046f-kube-api-access-gmqrg\") pod \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\" (UID: \"f67e7c6c-c640-4ec4-83c2-66da32a1046f\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq5vz\" (UniqueName: \"kubernetes.io/projected/f7a836c3-2094-4661-b1f1-1159e00614ff-kube-api-access-bq5vz\") pod \"f7a836c3-2094-4661-b1f1-1159e00614ff\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7a836c3-2094-4661-b1f1-1159e00614ff-operator-scripts\") pod \"f7a836c3-2094-4661-b1f1-1159e00614ff\" (UID: \"f7a836c3-2094-4661-b1f1-1159e00614ff\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.299555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/157ffe7a-4ce3-4903-a2a0-e34bd0032714-operator-scripts\") pod \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\" (UID: \"157ffe7a-4ce3-4903-a2a0-e34bd0032714\") " Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.302259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f67e7c6c-c640-4ec4-83c2-66da32a1046f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f67e7c6c-c640-4ec4-83c2-66da32a1046f" (UID: "f67e7c6c-c640-4ec4-83c2-66da32a1046f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.302477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a836c3-2094-4661-b1f1-1159e00614ff-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f7a836c3-2094-4661-b1f1-1159e00614ff" (UID: "f7a836c3-2094-4661-b1f1-1159e00614ff"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.302931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a47d2205-0f3d-421c-acfa-fc91d51a2ed6" (UID: "a47d2205-0f3d-421c-acfa-fc91d51a2ed6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.303030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/157ffe7a-4ce3-4903-a2a0-e34bd0032714-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "157ffe7a-4ce3-4903-a2a0-e34bd0032714" (UID: "157ffe7a-4ce3-4903-a2a0-e34bd0032714"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.308817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/157ffe7a-4ce3-4903-a2a0-e34bd0032714-kube-api-access-6vshc" (OuterVolumeSpecName: "kube-api-access-6vshc") pod "157ffe7a-4ce3-4903-a2a0-e34bd0032714" (UID: "157ffe7a-4ce3-4903-a2a0-e34bd0032714"). InnerVolumeSpecName "kube-api-access-6vshc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.312659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a836c3-2094-4661-b1f1-1159e00614ff-kube-api-access-bq5vz" (OuterVolumeSpecName: "kube-api-access-bq5vz") pod "f7a836c3-2094-4661-b1f1-1159e00614ff" (UID: "f7a836c3-2094-4661-b1f1-1159e00614ff"). InnerVolumeSpecName "kube-api-access-bq5vz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.313877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-kube-api-access-dbj6p" (OuterVolumeSpecName: "kube-api-access-dbj6p") pod "a47d2205-0f3d-421c-acfa-fc91d51a2ed6" (UID: "a47d2205-0f3d-421c-acfa-fc91d51a2ed6"). InnerVolumeSpecName "kube-api-access-dbj6p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.314136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67e7c6c-c640-4ec4-83c2-66da32a1046f-kube-api-access-gmqrg" (OuterVolumeSpecName: "kube-api-access-gmqrg") pod "f67e7c6c-c640-4ec4-83c2-66da32a1046f" (UID: "f67e7c6c-c640-4ec4-83c2-66da32a1046f"). InnerVolumeSpecName "kube-api-access-gmqrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403010 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/157ffe7a-4ce3-4903-a2a0-e34bd0032714-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403442 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403456 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6vshc\" (UniqueName: \"kubernetes.io/projected/157ffe7a-4ce3-4903-a2a0-e34bd0032714-kube-api-access-6vshc\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403471 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f67e7c6c-c640-4ec4-83c2-66da32a1046f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403484 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gmqrg\" (UniqueName: \"kubernetes.io/projected/f67e7c6c-c640-4ec4-83c2-66da32a1046f-kube-api-access-gmqrg\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403496 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dbj6p\" (UniqueName: \"kubernetes.io/projected/a47d2205-0f3d-421c-acfa-fc91d51a2ed6-kube-api-access-dbj6p\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403510 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bq5vz\" (UniqueName: \"kubernetes.io/projected/f7a836c3-2094-4661-b1f1-1159e00614ff-kube-api-access-bq5vz\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.403523 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7a836c3-2094-4661-b1f1-1159e00614ff-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.418823 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-28bn5" event={"ID":"157ffe7a-4ce3-4903-a2a0-e34bd0032714","Type":"ContainerDied","Data":"7bc4cf607e32bd60e9bfe13761c52a4a43d025aa98e4e8230452e6fc68cb48ce"} Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.418883 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bc4cf607e32bd60e9bfe13761c52a4a43d025aa98e4e8230452e6fc68cb48ce" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.418884 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-28bn5" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.425015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-4fxml" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.425004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-4fxml" event={"ID":"a47d2205-0f3d-421c-acfa-fc91d51a2ed6","Type":"ContainerDied","Data":"cfc5acee029ce0a8d7036be3fbcb287c3191aa20a84b9952ad95a9199096947b"} Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.425966 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfc5acee029ce0a8d7036be3fbcb287c3191aa20a84b9952ad95a9199096947b" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.427786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" event={"ID":"f7a836c3-2094-4661-b1f1-1159e00614ff","Type":"ContainerDied","Data":"f2c868a05e381083ca2887f2b693db59665ece81c9b31aeb275f2fb5e42ce15c"} Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.427834 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2c868a05e381083ca2887f2b693db59665ece81c9b31aeb275f2fb5e42ce15c" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.429438 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-2b29-account-create-ktl57" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.441448 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" event={"ID":"f67e7c6c-c640-4ec4-83c2-66da32a1046f","Type":"ContainerDied","Data":"475eb5a0aa97a2705c95718de4d5bde745d66e1b9eb9f315c686bd7f50b37f63"} Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.441516 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="475eb5a0aa97a2705c95718de4d5bde745d66e1b9eb9f315c686bd7f50b37f63" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.441547 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-161d-account-create-8hc9p" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.444454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" event={"ID":"2ce645b3-d9d2-4754-bd86-e2255425058c","Type":"ContainerDied","Data":"3b3a00366e621f41242191a43689edf272f943c71c91b0c7d7f49ecca76ed05d"} Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.444502 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b3a00366e621f41242191a43689edf272f943c71c91b0c7d7f49ecca76ed05d" Nov 21 12:37:44 crc kubenswrapper[4769]: I1121 12:37:44.444590 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7629-account-create-n7f6f" Nov 21 12:37:47 crc kubenswrapper[4769]: I1121 12:37:47.477830 4769 generic.go:334] "Generic (PLEG): container finished" podID="bebfb972-08eb-4f4d-9ba0-dadb691edfc2" containerID="00bb5fa66fefd6977fa04dec5423aa621b838825da13a70a2136a4665e09f258" exitCode=0 Nov 21 12:37:47 crc kubenswrapper[4769]: I1121 12:37:47.477969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" event={"ID":"bebfb972-08eb-4f4d-9ba0-dadb691edfc2","Type":"ContainerDied","Data":"00bb5fa66fefd6977fa04dec5423aa621b838825da13a70a2136a4665e09f258"} Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.845446 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.902388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-config-data\") pod \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.902442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25fxp\" (UniqueName: \"kubernetes.io/projected/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-kube-api-access-25fxp\") pod \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.902550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-combined-ca-bundle\") pod \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\" (UID: \"bebfb972-08eb-4f4d-9ba0-dadb691edfc2\") " Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.937968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bebfb972-08eb-4f4d-9ba0-dadb691edfc2" (UID: "bebfb972-08eb-4f4d-9ba0-dadb691edfc2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.943009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-kube-api-access-25fxp" (OuterVolumeSpecName: "kube-api-access-25fxp") pod "bebfb972-08eb-4f4d-9ba0-dadb691edfc2" (UID: "bebfb972-08eb-4f4d-9ba0-dadb691edfc2"). InnerVolumeSpecName "kube-api-access-25fxp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:48 crc kubenswrapper[4769]: I1121 12:37:48.961956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-config-data" (OuterVolumeSpecName: "config-data") pod "bebfb972-08eb-4f4d-9ba0-dadb691edfc2" (UID: "bebfb972-08eb-4f4d-9ba0-dadb691edfc2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.004790 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.004836 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.004853 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-25fxp\" (UniqueName: \"kubernetes.io/projected/bebfb972-08eb-4f4d-9ba0-dadb691edfc2-kube-api-access-25fxp\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.505150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" event={"ID":"bebfb972-08eb-4f4d-9ba0-dadb691edfc2","Type":"ContainerDied","Data":"914fc1778d957c5622a8f56c89755ab67e4669c2a91fd0b92a3699b3fdae645e"} Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.505233 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="914fc1778d957c5622a8f56c89755ab67e4669c2a91fd0b92a3699b3fdae645e" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.505262 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-gl7xv" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.669201 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8gb96"] Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.673051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7a836c3-2094-4661-b1f1-1159e00614ff" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.673288 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a836c3-2094-4661-b1f1-1159e00614ff" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.673403 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab774fec-28fc-4350-a6df-2b93e7e00df9" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.673496 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab774fec-28fc-4350-a6df-2b93e7e00df9" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.673601 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bebfb972-08eb-4f4d-9ba0-dadb691edfc2" containerName="keystone-db-sync" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.673694 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebfb972-08eb-4f4d-9ba0-dadb691edfc2" containerName="keystone-db-sync" Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.673766 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="157ffe7a-4ce3-4903-a2a0-e34bd0032714" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.673827 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="157ffe7a-4ce3-4903-a2a0-e34bd0032714" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.673902 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f67e7c6c-c640-4ec4-83c2-66da32a1046f" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.673972 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67e7c6c-c640-4ec4-83c2-66da32a1046f" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.674058 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a47d2205-0f3d-421c-acfa-fc91d51a2ed6" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674119 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47d2205-0f3d-421c-acfa-fc91d51a2ed6" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: E1121 12:37:49.674209 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ce645b3-d9d2-4754-bd86-e2255425058c" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674275 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce645b3-d9d2-4754-bd86-e2255425058c" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674512 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="157ffe7a-4ce3-4903-a2a0-e34bd0032714" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674599 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7a836c3-2094-4661-b1f1-1159e00614ff" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674663 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a47d2205-0f3d-421c-acfa-fc91d51a2ed6" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674733 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f67e7c6c-c640-4ec4-83c2-66da32a1046f" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674801 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab774fec-28fc-4350-a6df-2b93e7e00df9" containerName="mariadb-database-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674866 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bebfb972-08eb-4f4d-9ba0-dadb691edfc2" containerName="keystone-db-sync" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.674938 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2ce645b3-d9d2-4754-bd86-e2255425058c" containerName="mariadb-account-create" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.675650 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.679759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.680067 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w2kpl" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.680159 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.680388 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.680566 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.706147 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8gb96"] Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.728486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-fernet-keys\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.728807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-combined-ca-bundle\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.728968 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-scripts\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.729258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjhv4\" (UniqueName: \"kubernetes.io/projected/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-kube-api-access-vjhv4\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.729313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-credential-keys\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.729378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-config-data\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.831307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-fernet-keys\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.831413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-combined-ca-bundle\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.831447 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-scripts\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.831512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vjhv4\" (UniqueName: \"kubernetes.io/projected/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-kube-api-access-vjhv4\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.831546 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-credential-keys\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.831585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-config-data\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.837792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-config-data\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.839278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-scripts\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.839698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-credential-keys\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.845065 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-fernet-keys\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.846453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-combined-ca-bundle\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.858790 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjhv4\" (UniqueName: \"kubernetes.io/projected/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-kube-api-access-vjhv4\") pod \"keystone-bootstrap-8gb96\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.965529 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-lrthj"] Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.966768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.970381 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.971888 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-dh5dt"] Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.974167 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-knzk5" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.974416 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.977676 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.984082 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-lrthj"] Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.988047 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-d9svr" Nov 21 12:37:49 crc kubenswrapper[4769]: I1121 12:37:49.988093 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.002136 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.022027 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-dh5dt"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.035486 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-ljftr"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.036775 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-combined-ca-bundle\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-combined-ca-bundle\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48e592e6-4275-4db4-aad1-96772bb728f3-etc-machine-id\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-scripts\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-db-sync-config-data\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-db-sync-config-data\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr9jm\" (UniqueName: \"kubernetes.io/projected/0072aa8e-79ea-46a8-8d60-daba46db5e2c-kube-api-access-wr9jm\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-config-data\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.038755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9t44\" (UniqueName: \"kubernetes.io/projected/48e592e6-4275-4db4-aad1-96772bb728f3-kube-api-access-t9t44\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.041178 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.041450 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.041649 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-4ckzl" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.091561 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-ljftr"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.134739 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.137361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.139477 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.140029 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-scripts\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-db-sync-config-data\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-combined-ca-bundle\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-db-sync-config-data\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wr9jm\" (UniqueName: \"kubernetes.io/projected/0072aa8e-79ea-46a8-8d60-daba46db5e2c-kube-api-access-wr9jm\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-config-data\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t9t44\" (UniqueName: \"kubernetes.io/projected/48e592e6-4275-4db4-aad1-96772bb728f3-kube-api-access-t9t44\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd8lc\" (UniqueName: \"kubernetes.io/projected/3927663a-c253-4853-979f-e48092cc7809-kube-api-access-vd8lc\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-combined-ca-bundle\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141504 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-config\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-combined-ca-bundle\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48e592e6-4275-4db4-aad1-96772bb728f3-etc-machine-id\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.141744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48e592e6-4275-4db4-aad1-96772bb728f3-etc-machine-id\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.146898 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-2h9wc"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.149606 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.173324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-scripts\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.175368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-db-sync-config-data\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.175577 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.175886 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.175988 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-fm25b" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.178330 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.181806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-config-data\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.183099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-combined-ca-bundle\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.186161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-db-sync-config-data\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.191080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr9jm\" (UniqueName: \"kubernetes.io/projected/0072aa8e-79ea-46a8-8d60-daba46db5e2c-kube-api-access-wr9jm\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.210850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9t44\" (UniqueName: \"kubernetes.io/projected/48e592e6-4275-4db4-aad1-96772bb728f3-kube-api-access-t9t44\") pod \"cinder-db-sync-lrthj\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.238263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-combined-ca-bundle\") pod \"barbican-db-sync-dh5dt\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.245427 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-combined-ca-bundle\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.245467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.245895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-config-data\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-log-httpd\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw2cr\" (UniqueName: \"kubernetes.io/projected/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-kube-api-access-dw2cr\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-combined-ca-bundle\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-scripts\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-logs\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-scripts\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.246958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-run-httpd\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.247027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vd8lc\" (UniqueName: \"kubernetes.io/projected/3927663a-c253-4853-979f-e48092cc7809-kube-api-access-vd8lc\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.248437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-config-data\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.248631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-config\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.248759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvxd6\" (UniqueName: \"kubernetes.io/projected/df47f19f-9fd0-494b-a472-76fa4c722bcb-kube-api-access-nvxd6\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.254377 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-2h9wc"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.255969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-config\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.256255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-combined-ca-bundle\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.280599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd8lc\" (UniqueName: \"kubernetes.io/projected/3927663a-c253-4853-979f-e48092cc7809-kube-api-access-vd8lc\") pod \"neutron-db-sync-ljftr\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.295602 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.314758 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.350840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-config-data\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.351296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-log-httpd\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.351461 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dw2cr\" (UniqueName: \"kubernetes.io/projected/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-kube-api-access-dw2cr\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.351589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-scripts\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.352394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-logs\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.352505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-scripts\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.352635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.352808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-run-httpd\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.353117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-config-data\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.353979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-log-httpd\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.354163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-run-httpd\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.356621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nvxd6\" (UniqueName: \"kubernetes.io/projected/df47f19f-9fd0-494b-a472-76fa4c722bcb-kube-api-access-nvxd6\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.357165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-scripts\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.357214 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-logs\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.357754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-combined-ca-bundle\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.357869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.362205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.362426 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-scripts\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.362528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.363940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-config-data\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.364416 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-config-data\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.364552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-combined-ca-bundle\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.371647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw2cr\" (UniqueName: \"kubernetes.io/projected/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-kube-api-access-dw2cr\") pod \"placement-db-sync-2h9wc\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.377514 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvxd6\" (UniqueName: \"kubernetes.io/projected/df47f19f-9fd0-494b-a472-76fa4c722bcb-kube-api-access-nvxd6\") pod \"ceilometer-0\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.540542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.545085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.561912 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.645807 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8gb96"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.829679 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-lrthj"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.864232 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.869583 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.875766 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.876232 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-lhswr" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.876448 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.876602 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.881660 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.922035 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-dh5dt"] Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-config-data\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5wqt\" (UniqueName: \"kubernetes.io/projected/ddbf1531-48db-4333-8d3d-922e5dfefcf7-kube-api-access-x5wqt\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-logs\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:50 crc kubenswrapper[4769]: I1121 12:37:50.973585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-scripts\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.006586 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.008588 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.012889 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.013587 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.043106 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076336 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x5wqt\" (UniqueName: \"kubernetes.io/projected/ddbf1531-48db-4333-8d3d-922e5dfefcf7-kube-api-access-x5wqt\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-logs\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-scripts\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-config-data\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.076871 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.079478 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.081037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-logs\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.089951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.097470 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-config-data\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.106793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-scripts\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.108016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.109435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5wqt\" (UniqueName: \"kubernetes.io/projected/ddbf1531-48db-4333-8d3d-922e5dfefcf7-kube-api-access-x5wqt\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.139623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.183954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-logs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-scripts\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6cs\" (UniqueName: \"kubernetes.io/projected/94544de5-5a60-4263-ad83-a8913d485791-kube-api-access-tr6cs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.184260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-config-data\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.193543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.202406 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-2h9wc"] Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.289888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290448 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-config-data\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-logs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-scripts\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.290734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6cs\" (UniqueName: \"kubernetes.io/projected/94544de5-5a60-4263-ad83-a8913d485791-kube-api-access-tr6cs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.294177 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.295548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-logs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.295858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.311568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.311968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-config-data\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.313583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.314851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-scripts\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.317553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6cs\" (UniqueName: \"kubernetes.io/projected/94544de5-5a60-4263-ad83-a8913d485791-kube-api-access-tr6cs\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.344810 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.349056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.378097 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-ljftr"] Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.523536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.543825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" event={"ID":"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb","Type":"ContainerStarted","Data":"88410982ed218b472e9f9d0443d82ebd9159b6a957d14acba64394e63d2bbdbb"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.546130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" event={"ID":"3927663a-c253-4853-979f-e48092cc7809","Type":"ContainerStarted","Data":"da6f9dd3ee2cf976b423779ca628642aa1313f3cc9d4c741b4290ce70aa6e6fa"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.554352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerStarted","Data":"58bc3c0b1e7dc41f97f7a391c3904fb4a97761768ac855f6422ce4312e76aa19"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.558615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" event={"ID":"7cd15bb3-6ca7-4a0d-82f9-a76757082e59","Type":"ContainerStarted","Data":"d72f33ffa088b3b60de1f5975ebd18d92272577bd0e3bec59783ae90d3c3fb4b"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.558672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" event={"ID":"7cd15bb3-6ca7-4a0d-82f9-a76757082e59","Type":"ContainerStarted","Data":"0449efc7cfa36810a16bf9a8009a3d5ab0f4576662426fc8762acc9f24538738"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.569846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" event={"ID":"48e592e6-4275-4db4-aad1-96772bb728f3","Type":"ContainerStarted","Data":"70fc14c570cb0a260ce8438eb6ad0f76736c0c8c2d290f150893d14fba29a5c0"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.572754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" event={"ID":"0072aa8e-79ea-46a8-8d60-daba46db5e2c","Type":"ContainerStarted","Data":"06cc6420e52c1e0c5c94ff81609ba2ab5304d6575f3d9c12ff1b6f799545beb5"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.572825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" event={"ID":"0072aa8e-79ea-46a8-8d60-daba46db5e2c","Type":"ContainerStarted","Data":"3df0be63122b3a55df869602288964fadc419643c31a5ea5e4742c3afdc15e31"} Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.585088 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" podStartSLOduration=2.58506618 podStartE2EDuration="2.58506618s" podCreationTimestamp="2025-11-21 12:37:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:51.573285183 +0000 UTC m=+2830.273947001" watchObservedRunningTime="2025-11-21 12:37:51.58506618 +0000 UTC m=+2830.285727988" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.605424 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" podStartSLOduration=2.605403807 podStartE2EDuration="2.605403807s" podCreationTimestamp="2025-11-21 12:37:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:51.597566186 +0000 UTC m=+2830.298228004" watchObservedRunningTime="2025-11-21 12:37:51.605403807 +0000 UTC m=+2830.306065625" Nov 21 12:37:51 crc kubenswrapper[4769]: I1121 12:37:51.729150 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:51 crc kubenswrapper[4769]: W1121 12:37:51.805570 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddbf1531_48db_4333_8d3d_922e5dfefcf7.slice/crio-d24a2b73e80d8622c97cb0d396e1669c72491a63857992812e0f833840154a28 WatchSource:0}: Error finding container d24a2b73e80d8622c97cb0d396e1669c72491a63857992812e0f833840154a28: Status 404 returned error can't find the container with id d24a2b73e80d8622c97cb0d396e1669c72491a63857992812e0f833840154a28 Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.105019 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.513007 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.584631 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.628413 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94544de5-5a60-4263-ad83-a8913d485791","Type":"ContainerStarted","Data":"d168b6190c6d64eda200a9729881d6f15933cfb3a7e7038a6e595641f4f00585"} Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.643405 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" event={"ID":"3927663a-c253-4853-979f-e48092cc7809","Type":"ContainerStarted","Data":"0c73cae7cacd357226b059ee356f23d06715c53ca6779666056b711afed63ee2"} Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.652026 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.659984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" event={"ID":"48e592e6-4275-4db4-aad1-96772bb728f3","Type":"ContainerStarted","Data":"264b29fa2e5a2c344e5ad746d614e362cae3d7b7d9c7f2876d5b025bdb0c8948"} Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.674109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" event={"ID":"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb","Type":"ContainerStarted","Data":"df520837211f5136eab1f13a2aa4e17ba0d27bfe70fde97b2f5b45d69fe945ef"} Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.684785 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" podStartSLOduration=3.684762928 podStartE2EDuration="3.684762928s" podCreationTimestamp="2025-11-21 12:37:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:52.677885183 +0000 UTC m=+2831.378547001" watchObservedRunningTime="2025-11-21 12:37:52.684762928 +0000 UTC m=+2831.385424746" Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.692044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ddbf1531-48db-4333-8d3d-922e5dfefcf7","Type":"ContainerStarted","Data":"d24a2b73e80d8622c97cb0d396e1669c72491a63857992812e0f833840154a28"} Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.716069 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" podStartSLOduration=2.71604384 podStartE2EDuration="2.71604384s" podCreationTimestamp="2025-11-21 12:37:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:52.705500696 +0000 UTC m=+2831.406162514" watchObservedRunningTime="2025-11-21 12:37:52.71604384 +0000 UTC m=+2831.416705658" Nov 21 12:37:52 crc kubenswrapper[4769]: I1121 12:37:52.732414 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" podStartSLOduration=3.73239295 podStartE2EDuration="3.73239295s" podCreationTimestamp="2025-11-21 12:37:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:52.730508739 +0000 UTC m=+2831.431170557" watchObservedRunningTime="2025-11-21 12:37:52.73239295 +0000 UTC m=+2831.433054768" Nov 21 12:37:53 crc kubenswrapper[4769]: I1121 12:37:53.714477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerStarted","Data":"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51"} Nov 21 12:37:53 crc kubenswrapper[4769]: I1121 12:37:53.718662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ddbf1531-48db-4333-8d3d-922e5dfefcf7","Type":"ContainerStarted","Data":"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8"} Nov 21 12:37:53 crc kubenswrapper[4769]: I1121 12:37:53.718704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ddbf1531-48db-4333-8d3d-922e5dfefcf7","Type":"ContainerStarted","Data":"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb"} Nov 21 12:37:53 crc kubenswrapper[4769]: I1121 12:37:53.718789 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-log" containerID="cri-o://3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb" gracePeriod=30 Nov 21 12:37:53 crc kubenswrapper[4769]: I1121 12:37:53.718962 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-httpd" containerID="cri-o://dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8" gracePeriod=30 Nov 21 12:37:53 crc kubenswrapper[4769]: I1121 12:37:53.730252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94544de5-5a60-4263-ad83-a8913d485791","Type":"ContainerStarted","Data":"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.314847 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-logs\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-httpd-run\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408240 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-scripts\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408281 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-config-data\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5wqt\" (UniqueName: \"kubernetes.io/projected/ddbf1531-48db-4333-8d3d-922e5dfefcf7-kube-api-access-x5wqt\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-public-tls-certs\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-combined-ca-bundle\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-logs" (OuterVolumeSpecName: "logs") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\" (UID: \"ddbf1531-48db-4333-8d3d-922e5dfefcf7\") " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.408752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.409218 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.409243 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ddbf1531-48db-4333-8d3d-922e5dfefcf7-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.427118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.429749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-scripts" (OuterVolumeSpecName: "scripts") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.433868 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddbf1531-48db-4333-8d3d-922e5dfefcf7-kube-api-access-x5wqt" (OuterVolumeSpecName: "kube-api-access-x5wqt") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "kube-api-access-x5wqt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.451958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.479537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-config-data" (OuterVolumeSpecName: "config-data") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.488385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ddbf1531-48db-4333-8d3d-922e5dfefcf7" (UID: "ddbf1531-48db-4333-8d3d-922e5dfefcf7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.511642 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.511671 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.511685 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x5wqt\" (UniqueName: \"kubernetes.io/projected/ddbf1531-48db-4333-8d3d-922e5dfefcf7-kube-api-access-x5wqt\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.511694 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.511702 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddbf1531-48db-4333-8d3d-922e5dfefcf7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.511733 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.558082 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.613214 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.741871 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerID="dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8" exitCode=143 Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.741903 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerID="3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb" exitCode=143 Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.741939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ddbf1531-48db-4333-8d3d-922e5dfefcf7","Type":"ContainerDied","Data":"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.741963 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ddbf1531-48db-4333-8d3d-922e5dfefcf7","Type":"ContainerDied","Data":"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.741974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ddbf1531-48db-4333-8d3d-922e5dfefcf7","Type":"ContainerDied","Data":"d24a2b73e80d8622c97cb0d396e1669c72491a63857992812e0f833840154a28"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.741989 4769 scope.go:117] "RemoveContainer" containerID="dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.742097 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.747927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94544de5-5a60-4263-ad83-a8913d485791","Type":"ContainerStarted","Data":"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.747944 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-log" containerID="cri-o://d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c" gracePeriod=30 Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.748126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-httpd" containerID="cri-o://51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483" gracePeriod=30 Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.751420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerStarted","Data":"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.751464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerStarted","Data":"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947"} Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.772027 4769 scope.go:117] "RemoveContainer" containerID="3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.776900 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.776885839 podStartE2EDuration="5.776885839s" podCreationTimestamp="2025-11-21 12:37:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:54.775873132 +0000 UTC m=+2833.476534950" watchObservedRunningTime="2025-11-21 12:37:54.776885839 +0000 UTC m=+2833.477547657" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.802420 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.825662 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.843889 4769 scope.go:117] "RemoveContainer" containerID="dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8" Nov 21 12:37:54 crc kubenswrapper[4769]: E1121 12:37:54.844321 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8\": container with ID starting with dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8 not found: ID does not exist" containerID="dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.844362 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8"} err="failed to get container status \"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8\": rpc error: code = NotFound desc = could not find container \"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8\": container with ID starting with dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8 not found: ID does not exist" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.844392 4769 scope.go:117] "RemoveContainer" containerID="3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.844489 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:54 crc kubenswrapper[4769]: E1121 12:37:54.844968 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-log" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.844991 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-log" Nov 21 12:37:54 crc kubenswrapper[4769]: E1121 12:37:54.845020 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-httpd" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.845031 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-httpd" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.845307 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-log" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.845352 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" containerName="glance-httpd" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.846612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: E1121 12:37:54.848703 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb\": container with ID starting with 3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb not found: ID does not exist" containerID="3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.848731 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb"} err="failed to get container status \"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb\": rpc error: code = NotFound desc = could not find container \"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb\": container with ID starting with 3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb not found: ID does not exist" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.848753 4769 scope.go:117] "RemoveContainer" containerID="dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.849607 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8"} err="failed to get container status \"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8\": rpc error: code = NotFound desc = could not find container \"dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8\": container with ID starting with dbf274350f56d5e0d6e9a6c19dc3d96ffb691577fcc83371ef5c3c955d72d8c8 not found: ID does not exist" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.849626 4769 scope.go:117] "RemoveContainer" containerID="3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.851147 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb"} err="failed to get container status \"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb\": rpc error: code = NotFound desc = could not find container \"3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb\": container with ID starting with 3b750dc8f6cb04da95ea466856408c2f5bb62214669ea0e26f65d275eeb9d9bb not found: ID does not exist" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.851464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.851749 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.859762 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.920398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.920796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.920823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-scripts\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.920876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-config-data\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.920992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-logs\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.921084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.921138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzq7\" (UniqueName: \"kubernetes.io/projected/6fc4390c-b3dc-4f10-b414-612efd74c1e7-kube-api-access-8hzq7\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:54 crc kubenswrapper[4769]: I1121 12:37:54.921211 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-scripts\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-config-data\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-logs\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzq7\" (UniqueName: \"kubernetes.io/projected/6fc4390c-b3dc-4f10-b414-612efd74c1e7-kube-api-access-8hzq7\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.022398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.023457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.023487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-logs\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.023787 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.032481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.035594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-scripts\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.039511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.049401 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-config-data\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.080222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzq7\" (UniqueName: \"kubernetes.io/projected/6fc4390c-b3dc-4f10-b414-612efd74c1e7-kube-api-access-8hzq7\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.129997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.268080 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.291439 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddbf1531-48db-4333-8d3d-922e5dfefcf7" path="/var/lib/kubelet/pods/ddbf1531-48db-4333-8d3d-922e5dfefcf7/volumes" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.720759 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.743497 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771644 4769 generic.go:334] "Generic (PLEG): container finished" podID="94544de5-5a60-4263-ad83-a8913d485791" containerID="51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483" exitCode=0 Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771723 4769 generic.go:334] "Generic (PLEG): container finished" podID="94544de5-5a60-4263-ad83-a8913d485791" containerID="d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c" exitCode=143 Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94544de5-5a60-4263-ad83-a8913d485791","Type":"ContainerDied","Data":"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483"} Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94544de5-5a60-4263-ad83-a8913d485791","Type":"ContainerDied","Data":"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c"} Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94544de5-5a60-4263-ad83-a8913d485791","Type":"ContainerDied","Data":"d168b6190c6d64eda200a9729881d6f15933cfb3a7e7038a6e595641f4f00585"} Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771845 4769 scope.go:117] "RemoveContainer" containerID="51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.771988 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.842777 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-combined-ca-bundle\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-httpd-run\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-internal-tls-certs\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-scripts\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr6cs\" (UniqueName: \"kubernetes.io/projected/94544de5-5a60-4263-ad83-a8913d485791-kube-api-access-tr6cs\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-config-data\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-logs\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"94544de5-5a60-4263-ad83-a8913d485791\" (UID: \"94544de5-5a60-4263-ad83-a8913d485791\") " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.843857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.844343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-logs" (OuterVolumeSpecName: "logs") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.844432 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.846943 4769 scope.go:117] "RemoveContainer" containerID="d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.848570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.849431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94544de5-5a60-4263-ad83-a8913d485791-kube-api-access-tr6cs" (OuterVolumeSpecName: "kube-api-access-tr6cs") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "kube-api-access-tr6cs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.850638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-scripts" (OuterVolumeSpecName: "scripts") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.881391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.913961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.914423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-config-data" (OuterVolumeSpecName: "config-data") pod "94544de5-5a60-4263-ad83-a8913d485791" (UID: "94544de5-5a60-4263-ad83-a8913d485791"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946079 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946121 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946133 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946146 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tr6cs\" (UniqueName: \"kubernetes.io/projected/94544de5-5a60-4263-ad83-a8913d485791-kube-api-access-tr6cs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946162 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94544de5-5a60-4263-ad83-a8913d485791-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946171 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94544de5-5a60-4263-ad83-a8913d485791-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.946224 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Nov 21 12:37:55 crc kubenswrapper[4769]: I1121 12:37:55.983522 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.048059 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.106059 4769 scope.go:117] "RemoveContainer" containerID="51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483" Nov 21 12:37:56 crc kubenswrapper[4769]: E1121 12:37:56.106741 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483\": container with ID starting with 51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483 not found: ID does not exist" containerID="51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.106777 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483"} err="failed to get container status \"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483\": rpc error: code = NotFound desc = could not find container \"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483\": container with ID starting with 51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483 not found: ID does not exist" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.106809 4769 scope.go:117] "RemoveContainer" containerID="d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c" Nov 21 12:37:56 crc kubenswrapper[4769]: E1121 12:37:56.107286 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c\": container with ID starting with d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c not found: ID does not exist" containerID="d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.107344 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c"} err="failed to get container status \"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c\": rpc error: code = NotFound desc = could not find container \"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c\": container with ID starting with d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c not found: ID does not exist" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.107381 4769 scope.go:117] "RemoveContainer" containerID="51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.108443 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483"} err="failed to get container status \"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483\": rpc error: code = NotFound desc = could not find container \"51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483\": container with ID starting with 51aa42a34b2434da8c25a1042cdccd0a1f89bf876e65a892e6fa5bbadbdac483 not found: ID does not exist" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.108467 4769 scope.go:117] "RemoveContainer" containerID="d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.108948 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c"} err="failed to get container status \"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c\": rpc error: code = NotFound desc = could not find container \"d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c\": container with ID starting with d99b0792902166ada80ec0da55a6cd5e25e58fb497c28d232340e4be60c3902c not found: ID does not exist" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.140738 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.164343 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.197655 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:56 crc kubenswrapper[4769]: E1121 12:37:56.198065 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-log" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.198085 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-log" Nov 21 12:37:56 crc kubenswrapper[4769]: E1121 12:37:56.198110 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-httpd" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.198118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-httpd" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.198335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-log" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.198351 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94544de5-5a60-4263-ad83-a8913d485791" containerName="glance-httpd" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.199561 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.201706 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.202656 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.208332 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.368292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wf92\" (UniqueName: \"kubernetes.io/projected/4244ba1d-befe-499c-a473-a8d123345bef-kube-api-access-8wf92\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.368730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.368781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.368812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.368838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-logs\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.368874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.369066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.369151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.471182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.471276 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.471828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-logs\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.472469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-logs\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.472525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.472940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.473050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.473100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.473327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8wf92\" (UniqueName: \"kubernetes.io/projected/4244ba1d-befe-499c-a473-a8d123345bef-kube-api-access-8wf92\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.473384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.473994 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.474385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.474842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.478414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.480528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.491823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wf92\" (UniqueName: \"kubernetes.io/projected/4244ba1d-befe-499c-a473-a8d123345bef-kube-api-access-8wf92\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.508334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.538745 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.807236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerStarted","Data":"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f"} Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.807630 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.807392 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-central-agent" containerID="cri-o://e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" gracePeriod=30 Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.807925 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-notification-agent" containerID="cri-o://525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" gracePeriod=30 Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.807927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="sg-core" containerID="cri-o://211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" gracePeriod=30 Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.807925 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="proxy-httpd" containerID="cri-o://8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" gracePeriod=30 Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.812241 4769 generic.go:334] "Generic (PLEG): container finished" podID="7cd15bb3-6ca7-4a0d-82f9-a76757082e59" containerID="d72f33ffa088b3b60de1f5975ebd18d92272577bd0e3bec59783ae90d3c3fb4b" exitCode=0 Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.812378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" event={"ID":"7cd15bb3-6ca7-4a0d-82f9-a76757082e59","Type":"ContainerDied","Data":"d72f33ffa088b3b60de1f5975ebd18d92272577bd0e3bec59783ae90d3c3fb4b"} Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.816584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6fc4390c-b3dc-4f10-b414-612efd74c1e7","Type":"ContainerStarted","Data":"c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e"} Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.816647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6fc4390c-b3dc-4f10-b414-612efd74c1e7","Type":"ContainerStarted","Data":"29ad80ed23891bb8ed713f0bcf78093cce28a784d4678f743e1e8d1c03f66b71"} Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.820019 4769 generic.go:334] "Generic (PLEG): container finished" podID="e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" containerID="df520837211f5136eab1f13a2aa4e17ba0d27bfe70fde97b2f5b45d69fe945ef" exitCode=0 Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.820094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" event={"ID":"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb","Type":"ContainerDied","Data":"df520837211f5136eab1f13a2aa4e17ba0d27bfe70fde97b2f5b45d69fe945ef"} Nov 21 12:37:56 crc kubenswrapper[4769]: I1121 12:37:56.849885 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.3035972559999998 podStartE2EDuration="6.849858856s" podCreationTimestamp="2025-11-21 12:37:50 +0000 UTC" firstStartedPulling="2025-11-21 12:37:51.375145204 +0000 UTC m=+2830.075807012" lastFinishedPulling="2025-11-21 12:37:55.921406794 +0000 UTC m=+2834.622068612" observedRunningTime="2025-11-21 12:37:56.832048647 +0000 UTC m=+2835.532710475" watchObservedRunningTime="2025-11-21 12:37:56.849858856 +0000 UTC m=+2835.550520674" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.073291 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:37:57 crc kubenswrapper[4769]: W1121 12:37:57.087930 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4244ba1d_befe_499c_a473_a8d123345bef.slice/crio-6b2868a666e3c12d69ff3d6a61ecd0cda7231c324914b8a942aef7f39469e1cc WatchSource:0}: Error finding container 6b2868a666e3c12d69ff3d6a61ecd0cda7231c324914b8a942aef7f39469e1cc: Status 404 returned error can't find the container with id 6b2868a666e3c12d69ff3d6a61ecd0cda7231c324914b8a942aef7f39469e1cc Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.286710 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94544de5-5a60-4263-ad83-a8913d485791" path="/var/lib/kubelet/pods/94544de5-5a60-4263-ad83-a8913d485791/volumes" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.551575 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.697005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-scripts\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.697063 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-combined-ca-bundle\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.697163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-config-data\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.697300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvxd6\" (UniqueName: \"kubernetes.io/projected/df47f19f-9fd0-494b-a472-76fa4c722bcb-kube-api-access-nvxd6\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.697345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-run-httpd\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.698296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-log-httpd\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.698383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.698435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-sg-core-conf-yaml\") pod \"df47f19f-9fd0-494b-a472-76fa4c722bcb\" (UID: \"df47f19f-9fd0-494b-a472-76fa4c722bcb\") " Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.698636 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.698939 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.698955 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/df47f19f-9fd0-494b-a472-76fa4c722bcb-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.703618 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df47f19f-9fd0-494b-a472-76fa4c722bcb-kube-api-access-nvxd6" (OuterVolumeSpecName: "kube-api-access-nvxd6") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "kube-api-access-nvxd6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.704570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-scripts" (OuterVolumeSpecName: "scripts") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.736094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.801422 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nvxd6\" (UniqueName: \"kubernetes.io/projected/df47f19f-9fd0-494b-a472-76fa4c722bcb-kube-api-access-nvxd6\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.801661 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.801790 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.806850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.809345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-config-data" (OuterVolumeSpecName: "config-data") pod "df47f19f-9fd0-494b-a472-76fa4c722bcb" (UID: "df47f19f-9fd0-494b-a472-76fa4c722bcb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.835555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4244ba1d-befe-499c-a473-a8d123345bef","Type":"ContainerStarted","Data":"6b2868a666e3c12d69ff3d6a61ecd0cda7231c324914b8a942aef7f39469e1cc"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839632 4769 generic.go:334] "Generic (PLEG): container finished" podID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" exitCode=0 Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839668 4769 generic.go:334] "Generic (PLEG): container finished" podID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" exitCode=2 Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839676 4769 generic.go:334] "Generic (PLEG): container finished" podID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" exitCode=0 Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839684 4769 generic.go:334] "Generic (PLEG): container finished" podID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" exitCode=0 Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerDied","Data":"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerDied","Data":"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerDied","Data":"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerDied","Data":"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"df47f19f-9fd0-494b-a472-76fa4c722bcb","Type":"ContainerDied","Data":"58bc3c0b1e7dc41f97f7a391c3904fb4a97761768ac855f6422ce4312e76aa19"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.839796 4769 scope.go:117] "RemoveContainer" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.840246 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.842403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6fc4390c-b3dc-4f10-b414-612efd74c1e7","Type":"ContainerStarted","Data":"b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592"} Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.872551 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.8725233919999997 podStartE2EDuration="3.872523392s" podCreationTimestamp="2025-11-21 12:37:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:57.871740331 +0000 UTC m=+2836.572402149" watchObservedRunningTime="2025-11-21 12:37:57.872523392 +0000 UTC m=+2836.573185210" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.880465 4769 scope.go:117] "RemoveContainer" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.904982 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.905010 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df47f19f-9fd0-494b-a472-76fa4c722bcb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.984526 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:57 crc kubenswrapper[4769]: I1121 12:37:57.986995 4769 scope.go:117] "RemoveContainer" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.003424 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.013157 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.013657 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="sg-core" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.013672 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="sg-core" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.013690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-central-agent" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.013697 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-central-agent" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.013714 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="proxy-httpd" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.013721 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="proxy-httpd" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.013762 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-notification-agent" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.013772 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-notification-agent" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.013984 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="sg-core" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.014005 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="proxy-httpd" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.014021 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-central-agent" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.014035 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" containerName="ceilometer-notification-agent" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.015821 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.018968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.022812 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.047621 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-log-httpd\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-config-data\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-scripts\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcsb\" (UniqueName: \"kubernetes.io/projected/21a7bbcd-15a8-4653-8096-ba923625fc88-kube-api-access-4wcsb\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-run-httpd\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.111507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.178314 4769 scope.go:117] "RemoveContainer" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-log-httpd\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-config-data\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-scripts\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcsb\" (UniqueName: \"kubernetes.io/projected/21a7bbcd-15a8-4653-8096-ba923625fc88-kube-api-access-4wcsb\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.213615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-run-httpd\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.214459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-run-httpd\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.221077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-log-httpd\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.223911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.224290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-scripts\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.225094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-config-data\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.236036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.249578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcsb\" (UniqueName: \"kubernetes.io/projected/21a7bbcd-15a8-4653-8096-ba923625fc88-kube-api-access-4wcsb\") pod \"ceilometer-0\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.256925 4769 scope.go:117] "RemoveContainer" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.265437 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": container with ID starting with 8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f not found: ID does not exist" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.265491 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f"} err="failed to get container status \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": rpc error: code = NotFound desc = could not find container \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": container with ID starting with 8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.265536 4769 scope.go:117] "RemoveContainer" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.266671 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": container with ID starting with 211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad not found: ID does not exist" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.266692 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad"} err="failed to get container status \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": rpc error: code = NotFound desc = could not find container \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": container with ID starting with 211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.266705 4769 scope.go:117] "RemoveContainer" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.267012 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": container with ID starting with 525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947 not found: ID does not exist" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.267032 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947"} err="failed to get container status \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": rpc error: code = NotFound desc = could not find container \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": container with ID starting with 525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.267047 4769 scope.go:117] "RemoveContainer" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" Nov 21 12:37:58 crc kubenswrapper[4769]: E1121 12:37:58.269371 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": container with ID starting with e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51 not found: ID does not exist" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.269397 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51"} err="failed to get container status \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": rpc error: code = NotFound desc = could not find container \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": container with ID starting with e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.269413 4769 scope.go:117] "RemoveContainer" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.271074 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f"} err="failed to get container status \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": rpc error: code = NotFound desc = could not find container \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": container with ID starting with 8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.271095 4769 scope.go:117] "RemoveContainer" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.271632 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad"} err="failed to get container status \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": rpc error: code = NotFound desc = could not find container \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": container with ID starting with 211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.271649 4769 scope.go:117] "RemoveContainer" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.271915 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947"} err="failed to get container status \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": rpc error: code = NotFound desc = could not find container \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": container with ID starting with 525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.271932 4769 scope.go:117] "RemoveContainer" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.272315 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51"} err="failed to get container status \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": rpc error: code = NotFound desc = could not find container \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": container with ID starting with e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.272337 4769 scope.go:117] "RemoveContainer" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.272813 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f"} err="failed to get container status \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": rpc error: code = NotFound desc = could not find container \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": container with ID starting with 8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.273317 4769 scope.go:117] "RemoveContainer" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.275589 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad"} err="failed to get container status \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": rpc error: code = NotFound desc = could not find container \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": container with ID starting with 211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.275648 4769 scope.go:117] "RemoveContainer" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.276088 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947"} err="failed to get container status \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": rpc error: code = NotFound desc = could not find container \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": container with ID starting with 525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.276109 4769 scope.go:117] "RemoveContainer" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.276922 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51"} err="failed to get container status \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": rpc error: code = NotFound desc = could not find container \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": container with ID starting with e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.276947 4769 scope.go:117] "RemoveContainer" containerID="8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.280885 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f"} err="failed to get container status \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": rpc error: code = NotFound desc = could not find container \"8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f\": container with ID starting with 8cc6ec517c90f3af37a469d078495e0121ef9c9e1ffacafefe954e254474314f not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.280929 4769 scope.go:117] "RemoveContainer" containerID="211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.281417 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad"} err="failed to get container status \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": rpc error: code = NotFound desc = could not find container \"211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad\": container with ID starting with 211f1f8be9311efac42019a7c6e98d0bd323a41353d61e8326381e214e00fdad not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.281464 4769 scope.go:117] "RemoveContainer" containerID="525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.285976 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947"} err="failed to get container status \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": rpc error: code = NotFound desc = could not find container \"525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947\": container with ID starting with 525c44c93381201926d661e54f5fe0120b4c7e31b4feb286ffcd57d95f697947 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.286002 4769 scope.go:117] "RemoveContainer" containerID="e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.286328 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51"} err="failed to get container status \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": rpc error: code = NotFound desc = could not find container \"e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51\": container with ID starting with e52725336e76338aeff2192292834f24812e9171ab95350808fb86d5b6820e51 not found: ID does not exist" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.299878 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.393044 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.416540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-config-data\") pod \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.416634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-fernet-keys\") pod \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.416670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjhv4\" (UniqueName: \"kubernetes.io/projected/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-kube-api-access-vjhv4\") pod \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.416701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-credential-keys\") pod \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.416822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-scripts\") pod \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.416879 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-combined-ca-bundle\") pod \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\" (UID: \"7cd15bb3-6ca7-4a0d-82f9-a76757082e59\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.421560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "7cd15bb3-6ca7-4a0d-82f9-a76757082e59" (UID: "7cd15bb3-6ca7-4a0d-82f9-a76757082e59"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.430443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-kube-api-access-vjhv4" (OuterVolumeSpecName: "kube-api-access-vjhv4") pod "7cd15bb3-6ca7-4a0d-82f9-a76757082e59" (UID: "7cd15bb3-6ca7-4a0d-82f9-a76757082e59"). InnerVolumeSpecName "kube-api-access-vjhv4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.433245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-scripts" (OuterVolumeSpecName: "scripts") pod "7cd15bb3-6ca7-4a0d-82f9-a76757082e59" (UID: "7cd15bb3-6ca7-4a0d-82f9-a76757082e59"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.449405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "7cd15bb3-6ca7-4a0d-82f9-a76757082e59" (UID: "7cd15bb3-6ca7-4a0d-82f9-a76757082e59"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.455856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7cd15bb3-6ca7-4a0d-82f9-a76757082e59" (UID: "7cd15bb3-6ca7-4a0d-82f9-a76757082e59"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.465526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-config-data" (OuterVolumeSpecName: "config-data") pod "7cd15bb3-6ca7-4a0d-82f9-a76757082e59" (UID: "7cd15bb3-6ca7-4a0d-82f9-a76757082e59"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.469103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.518719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-combined-ca-bundle\") pod \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.518812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-config-data\") pod \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.518831 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw2cr\" (UniqueName: \"kubernetes.io/projected/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-kube-api-access-dw2cr\") pod \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.518892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-scripts\") pod \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.518932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-logs\") pod \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\" (UID: \"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb\") " Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-logs" (OuterVolumeSpecName: "logs") pod "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" (UID: "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519877 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519903 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519916 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519929 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vjhv4\" (UniqueName: \"kubernetes.io/projected/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-kube-api-access-vjhv4\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519944 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519955 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.519966 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd15bb3-6ca7-4a0d-82f9-a76757082e59-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.523159 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-kube-api-access-dw2cr" (OuterVolumeSpecName: "kube-api-access-dw2cr") pod "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" (UID: "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb"). InnerVolumeSpecName "kube-api-access-dw2cr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.524732 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-scripts" (OuterVolumeSpecName: "scripts") pod "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" (UID: "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.545573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" (UID: "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.548336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-config-data" (OuterVolumeSpecName: "config-data") pod "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" (UID: "e332caa5-8279-4d2c-9d0a-8e66ded5dfbb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.623283 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.623324 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.623340 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.623353 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dw2cr\" (UniqueName: \"kubernetes.io/projected/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb-kube-api-access-dw2cr\") on node \"crc\" DevicePath \"\"" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.855762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" event={"ID":"e332caa5-8279-4d2c-9d0a-8e66ded5dfbb","Type":"ContainerDied","Data":"88410982ed218b472e9f9d0443d82ebd9159b6a957d14acba64394e63d2bbdbb"} Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.856146 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88410982ed218b472e9f9d0443d82ebd9159b6a957d14acba64394e63d2bbdbb" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.856277 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-2h9wc" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.861379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4244ba1d-befe-499c-a473-a8d123345bef","Type":"ContainerStarted","Data":"dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c"} Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.861436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4244ba1d-befe-499c-a473-a8d123345bef","Type":"ContainerStarted","Data":"edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9"} Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.871995 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.873657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-8gb96" event={"ID":"7cd15bb3-6ca7-4a0d-82f9-a76757082e59","Type":"ContainerDied","Data":"0449efc7cfa36810a16bf9a8009a3d5ab0f4576662426fc8762acc9f24538738"} Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.873745 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0449efc7cfa36810a16bf9a8009a3d5ab0f4576662426fc8762acc9f24538738" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.913014 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=2.9129819169999998 podStartE2EDuration="2.912981917s" podCreationTimestamp="2025-11-21 12:37:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:37:58.898184979 +0000 UTC m=+2837.598846797" watchObservedRunningTime="2025-11-21 12:37:58.912981917 +0000 UTC m=+2837.613643745" Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.950980 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8gb96"] Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.960259 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-8gb96"] Nov 21 12:37:58 crc kubenswrapper[4769]: I1121 12:37:58.967239 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.021652 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xkvr9"] Nov 21 12:37:59 crc kubenswrapper[4769]: E1121 12:37:59.022096 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" containerName="placement-db-sync" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.022118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" containerName="placement-db-sync" Nov 21 12:37:59 crc kubenswrapper[4769]: E1121 12:37:59.022133 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7cd15bb3-6ca7-4a0d-82f9-a76757082e59" containerName="keystone-bootstrap" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.022141 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd15bb3-6ca7-4a0d-82f9-a76757082e59" containerName="keystone-bootstrap" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.022844 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" containerName="placement-db-sync" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.022879 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7cd15bb3-6ca7-4a0d-82f9-a76757082e59" containerName="keystone-bootstrap" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.023955 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.026413 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.026580 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.033415 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.035376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.040764 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xkvr9"] Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.042469 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w2kpl" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.076886 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-997b6456b-j6hhp"] Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.079045 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.081599 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.081814 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.082688 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.083122 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-fm25b" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.083354 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.115948 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-997b6456b-j6hhp"] Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-fernet-keys\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-combined-ca-bundle\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-config-data\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g55h\" (UniqueName: \"kubernetes.io/projected/bbc6cddf-3e72-4186-bdf5-23ad222a4686-kube-api-access-7g55h\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-scripts\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-credential-keys\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-config-data\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-public-tls-certs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-combined-ca-bundle\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-scripts\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-internal-tls-certs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbc6cddf-3e72-4186-bdf5-23ad222a4686-logs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.136540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glw2n\" (UniqueName: \"kubernetes.io/projected/20e7a128-1b78-4637-bcd6-0cc30877afb8-kube-api-access-glw2n\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-config-data\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-public-tls-certs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-combined-ca-bundle\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-scripts\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-internal-tls-certs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbc6cddf-3e72-4186-bdf5-23ad222a4686-logs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-glw2n\" (UniqueName: \"kubernetes.io/projected/20e7a128-1b78-4637-bcd6-0cc30877afb8-kube-api-access-glw2n\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-fernet-keys\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238863 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-combined-ca-bundle\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-config-data\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7g55h\" (UniqueName: \"kubernetes.io/projected/bbc6cddf-3e72-4186-bdf5-23ad222a4686-kube-api-access-7g55h\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-scripts\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.238962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-credential-keys\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.240267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbc6cddf-3e72-4186-bdf5-23ad222a4686-logs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.246571 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-fernet-keys\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.248138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-credential-keys\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.248467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-public-tls-certs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.248735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-config-data\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.249607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-combined-ca-bundle\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.250163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-config-data\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.250863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-combined-ca-bundle\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.251402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-scripts\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.256725 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-scripts\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.256830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g55h\" (UniqueName: \"kubernetes.io/projected/bbc6cddf-3e72-4186-bdf5-23ad222a4686-kube-api-access-7g55h\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.259589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-internal-tls-certs\") pod \"placement-997b6456b-j6hhp\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.266781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-glw2n\" (UniqueName: \"kubernetes.io/projected/20e7a128-1b78-4637-bcd6-0cc30877afb8-kube-api-access-glw2n\") pod \"keystone-bootstrap-xkvr9\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.289753 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd15bb3-6ca7-4a0d-82f9-a76757082e59" path="/var/lib/kubelet/pods/7cd15bb3-6ca7-4a0d-82f9-a76757082e59/volumes" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.291031 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df47f19f-9fd0-494b-a472-76fa4c722bcb" path="/var/lib/kubelet/pods/df47f19f-9fd0-494b-a472-76fa4c722bcb/volumes" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.367786 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.405131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.850997 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xkvr9"] Nov 21 12:37:59 crc kubenswrapper[4769]: W1121 12:37:59.851271 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20e7a128_1b78_4637_bcd6_0cc30877afb8.slice/crio-58c91c03911ee2f1dd13bf6b6c6489f98f9acdbaf43765b1bde117dc730ce145 WatchSource:0}: Error finding container 58c91c03911ee2f1dd13bf6b6c6489f98f9acdbaf43765b1bde117dc730ce145: Status 404 returned error can't find the container with id 58c91c03911ee2f1dd13bf6b6c6489f98f9acdbaf43765b1bde117dc730ce145 Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.885616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" event={"ID":"20e7a128-1b78-4637-bcd6-0cc30877afb8","Type":"ContainerStarted","Data":"58c91c03911ee2f1dd13bf6b6c6489f98f9acdbaf43765b1bde117dc730ce145"} Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.888222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerStarted","Data":"dbb4ec56096596aa7155bda123bb2479f6bd196fce3b6920908ff766249ff562"} Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.888273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerStarted","Data":"f91d9bc71193ae065531ab4292e53a6a60356e5f3d44c7b8fd49e3262a5cea09"} Nov 21 12:37:59 crc kubenswrapper[4769]: I1121 12:37:59.980067 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-997b6456b-j6hhp"] Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.921904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" event={"ID":"bbc6cddf-3e72-4186-bdf5-23ad222a4686","Type":"ContainerStarted","Data":"c98138b795f4cbd3160b47d4e5bca080367c97055345e9be9a1a4d7cd7370c29"} Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.922306 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.922331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" event={"ID":"bbc6cddf-3e72-4186-bdf5-23ad222a4686","Type":"ContainerStarted","Data":"8cfe92f182ec79cd472097f18b95255229f7d04c1b3c86d17a2f76b7f53bc763"} Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.922346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" event={"ID":"bbc6cddf-3e72-4186-bdf5-23ad222a4686","Type":"ContainerStarted","Data":"d6d64e5bb6ec88ecd3e63ab3d7549a4dc093552407c9407cf440078cc757f7ba"} Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.922463 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.928837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" event={"ID":"20e7a128-1b78-4637-bcd6-0cc30877afb8","Type":"ContainerStarted","Data":"1264f7d1eb6f3c43e19ac1a6d6738d82cb33274606e629e18e1b9b182a0c8f11"} Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.932659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerStarted","Data":"9916c21f25d7b6380cdfbdbdcfe44b28a191cb262961f6362ac168bacb4c16c4"} Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.955786 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" podStartSLOduration=1.955769511 podStartE2EDuration="1.955769511s" podCreationTimestamp="2025-11-21 12:37:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:00.945181206 +0000 UTC m=+2839.645843044" watchObservedRunningTime="2025-11-21 12:38:00.955769511 +0000 UTC m=+2839.656431329" Nov 21 12:38:00 crc kubenswrapper[4769]: I1121 12:38:00.986996 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" podStartSLOduration=1.98697628 podStartE2EDuration="1.98697628s" podCreationTimestamp="2025-11-21 12:37:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:00.966949241 +0000 UTC m=+2839.667611069" watchObservedRunningTime="2025-11-21 12:38:00.98697628 +0000 UTC m=+2839.687638098" Nov 21 12:38:01 crc kubenswrapper[4769]: I1121 12:38:01.949635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerStarted","Data":"b1b8bff43fa27df5a0a24e9028084e7676ea631ee795aa32055d47806dd782cf"} Nov 21 12:38:01 crc kubenswrapper[4769]: I1121 12:38:01.952670 4769 generic.go:334] "Generic (PLEG): container finished" podID="0072aa8e-79ea-46a8-8d60-daba46db5e2c" containerID="06cc6420e52c1e0c5c94ff81609ba2ab5304d6575f3d9c12ff1b6f799545beb5" exitCode=0 Nov 21 12:38:01 crc kubenswrapper[4769]: I1121 12:38:01.954209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" event={"ID":"0072aa8e-79ea-46a8-8d60-daba46db5e2c","Type":"ContainerDied","Data":"06cc6420e52c1e0c5c94ff81609ba2ab5304d6575f3d9c12ff1b6f799545beb5"} Nov 21 12:38:02 crc kubenswrapper[4769]: I1121 12:38:02.964981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerStarted","Data":"739487a08c3f56eb841a4aa9f85832f59ee9a56bcd24ffe0266b4d0f1ced8872"} Nov 21 12:38:02 crc kubenswrapper[4769]: I1121 12:38:02.965322 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:02 crc kubenswrapper[4769]: I1121 12:38:02.989761 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.429949051 podStartE2EDuration="5.989739348s" podCreationTimestamp="2025-11-21 12:37:57 +0000 UTC" firstStartedPulling="2025-11-21 12:37:58.972168999 +0000 UTC m=+2837.672830817" lastFinishedPulling="2025-11-21 12:38:02.531959296 +0000 UTC m=+2841.232621114" observedRunningTime="2025-11-21 12:38:02.985555766 +0000 UTC m=+2841.686217594" watchObservedRunningTime="2025-11-21 12:38:02.989739348 +0000 UTC m=+2841.690401166" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.405727 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.574402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-db-sync-config-data\") pod \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.574583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-combined-ca-bundle\") pod \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.574769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr9jm\" (UniqueName: \"kubernetes.io/projected/0072aa8e-79ea-46a8-8d60-daba46db5e2c-kube-api-access-wr9jm\") pod \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\" (UID: \"0072aa8e-79ea-46a8-8d60-daba46db5e2c\") " Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.588335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0072aa8e-79ea-46a8-8d60-daba46db5e2c" (UID: "0072aa8e-79ea-46a8-8d60-daba46db5e2c"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.588444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0072aa8e-79ea-46a8-8d60-daba46db5e2c-kube-api-access-wr9jm" (OuterVolumeSpecName: "kube-api-access-wr9jm") pod "0072aa8e-79ea-46a8-8d60-daba46db5e2c" (UID: "0072aa8e-79ea-46a8-8d60-daba46db5e2c"). InnerVolumeSpecName "kube-api-access-wr9jm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.607867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0072aa8e-79ea-46a8-8d60-daba46db5e2c" (UID: "0072aa8e-79ea-46a8-8d60-daba46db5e2c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.676501 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.676543 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0072aa8e-79ea-46a8-8d60-daba46db5e2c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.676555 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wr9jm\" (UniqueName: \"kubernetes.io/projected/0072aa8e-79ea-46a8-8d60-daba46db5e2c-kube-api-access-wr9jm\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.978642 4769 generic.go:334] "Generic (PLEG): container finished" podID="20e7a128-1b78-4637-bcd6-0cc30877afb8" containerID="1264f7d1eb6f3c43e19ac1a6d6738d82cb33274606e629e18e1b9b182a0c8f11" exitCode=0 Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.978787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" event={"ID":"20e7a128-1b78-4637-bcd6-0cc30877afb8","Type":"ContainerDied","Data":"1264f7d1eb6f3c43e19ac1a6d6738d82cb33274606e629e18e1b9b182a0c8f11"} Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.982238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" event={"ID":"0072aa8e-79ea-46a8-8d60-daba46db5e2c","Type":"ContainerDied","Data":"3df0be63122b3a55df869602288964fadc419643c31a5ea5e4742c3afdc15e31"} Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.982280 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3df0be63122b3a55df869602288964fadc419643c31a5ea5e4742c3afdc15e31" Nov 21 12:38:03 crc kubenswrapper[4769]: I1121 12:38:03.982331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-dh5dt" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.165768 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb"] Nov 21 12:38:04 crc kubenswrapper[4769]: E1121 12:38:04.166397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0072aa8e-79ea-46a8-8d60-daba46db5e2c" containerName="barbican-db-sync" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.166412 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0072aa8e-79ea-46a8-8d60-daba46db5e2c" containerName="barbican-db-sync" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.166573 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0072aa8e-79ea-46a8-8d60-daba46db5e2c" containerName="barbican-db-sync" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.167533 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.171799 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-d9svr" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.172062 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.172215 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.209784 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb"] Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.219243 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49"] Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.221080 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.223457 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.238409 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49"] Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.288959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data-custom\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.289040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-combined-ca-bundle\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.289062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlkc\" (UniqueName: \"kubernetes.io/projected/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-kube-api-access-kvlkc\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.289125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-logs\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.289150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.351414 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-67778847c6-8qbm7"] Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.352895 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.355135 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.363772 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-67778847c6-8qbm7"] Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390532 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-logs\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-logs\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-combined-ca-bundle\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data-custom\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvs5d\" (UniqueName: \"kubernetes.io/projected/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-kube-api-access-dvs5d\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data-custom\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-combined-ca-bundle\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.390949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlkc\" (UniqueName: \"kubernetes.io/projected/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-kube-api-access-kvlkc\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.391097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-logs\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.395778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.397132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-combined-ca-bundle\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.410677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data-custom\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.411177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlkc\" (UniqueName: \"kubernetes.io/projected/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-kube-api-access-kvlkc\") pod \"barbican-worker-dbbb4cfd7-h4pdb\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.487042 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.492580 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-combined-ca-bundle\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.492811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.492980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.493100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh59\" (UniqueName: \"kubernetes.io/projected/20f972a0-fb23-4a52-adca-85142c41c792-kube-api-access-9wh59\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.493234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data-custom\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.493378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f972a0-fb23-4a52-adca-85142c41c792-logs\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.493513 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-logs\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.493868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-combined-ca-bundle\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.494050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data-custom\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.494216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dvs5d\" (UniqueName: \"kubernetes.io/projected/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-kube-api-access-dvs5d\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.494248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-logs\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.498151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data-custom\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.499293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-combined-ca-bundle\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.499699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.516418 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvs5d\" (UniqueName: \"kubernetes.io/projected/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-kube-api-access-dvs5d\") pod \"barbican-keystone-listener-d7ddd44f4-kgt49\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.544831 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.596165 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.596235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh59\" (UniqueName: \"kubernetes.io/projected/20f972a0-fb23-4a52-adca-85142c41c792-kube-api-access-9wh59\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.596290 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data-custom\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.596339 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f972a0-fb23-4a52-adca-85142c41c792-logs\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.596459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-combined-ca-bundle\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.601358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-combined-ca-bundle\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.601700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f972a0-fb23-4a52-adca-85142c41c792-logs\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.606345 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.607791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data-custom\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.625244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh59\" (UniqueName: \"kubernetes.io/projected/20f972a0-fb23-4a52-adca-85142c41c792-kube-api-access-9wh59\") pod \"barbican-api-67778847c6-8qbm7\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:04 crc kubenswrapper[4769]: I1121 12:38:04.672721 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:04.958144 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb"] Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:04.996544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" event={"ID":"964afe99-46d9-4b4e-be03-e3cf7c5b6e04","Type":"ContainerStarted","Data":"36d2e8f4a23d3f78920c060c862b0ad3514e05e6cbcdf3b75198f13b955ef831"} Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:05.137289 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49"] Nov 21 12:38:07 crc kubenswrapper[4769]: W1121 12:38:05.159987 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1e5c05c_a6e7_4bb2_a397_d4feb7197966.slice/crio-a378ed2082fbbdd6564b0bc8690e94e830931c732680927f510c93d4ef6d3e70 WatchSource:0}: Error finding container a378ed2082fbbdd6564b0bc8690e94e830931c732680927f510c93d4ef6d3e70: Status 404 returned error can't find the container with id a378ed2082fbbdd6564b0bc8690e94e830931c732680927f510c93d4ef6d3e70 Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:05.269508 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:05.269837 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:05.308811 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:05.323701 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.009329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" event={"ID":"964afe99-46d9-4b4e-be03-e3cf7c5b6e04","Type":"ContainerStarted","Data":"2f9795b688b62d68c169c1a0b5cf8fe745204cc77d4b840b0bffbc200faad6ab"} Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.011026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" event={"ID":"e1e5c05c-a6e7-4bb2-a397-d4feb7197966","Type":"ContainerStarted","Data":"7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd"} Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.011068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" event={"ID":"e1e5c05c-a6e7-4bb2-a397-d4feb7197966","Type":"ContainerStarted","Data":"a378ed2082fbbdd6564b0bc8690e94e830931c732680927f510c93d4ef6d3e70"} Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.011305 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.011335 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.539138 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.539204 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.592526 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:06.596934 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.044278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" event={"ID":"964afe99-46d9-4b4e-be03-e3cf7c5b6e04","Type":"ContainerStarted","Data":"22d08c8fb8e93d13fcd5f7caba4ee618409e1a225ae88c4d57b04382f8b4cfe0"} Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.057262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" event={"ID":"e1e5c05c-a6e7-4bb2-a397-d4feb7197966","Type":"ContainerStarted","Data":"41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44"} Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.058263 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.058298 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.073954 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" podStartSLOduration=3.073923159 podStartE2EDuration="3.073923159s" podCreationTimestamp="2025-11-21 12:38:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:07.066717876 +0000 UTC m=+2845.767379694" watchObservedRunningTime="2025-11-21 12:38:07.073923159 +0000 UTC m=+2845.774584977" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.139502 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" podStartSLOduration=3.139477652 podStartE2EDuration="3.139477652s" podCreationTimestamp="2025-11-21 12:38:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:07.091208984 +0000 UTC m=+2845.791870822" watchObservedRunningTime="2025-11-21 12:38:07.139477652 +0000 UTC m=+2845.840139470" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.806249 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.833072 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-67778847c6-8qbm7"] Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.867871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-credential-keys\") pod \"20e7a128-1b78-4637-bcd6-0cc30877afb8\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.868110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-scripts\") pod \"20e7a128-1b78-4637-bcd6-0cc30877afb8\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.868164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glw2n\" (UniqueName: \"kubernetes.io/projected/20e7a128-1b78-4637-bcd6-0cc30877afb8-kube-api-access-glw2n\") pod \"20e7a128-1b78-4637-bcd6-0cc30877afb8\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.868217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-combined-ca-bundle\") pod \"20e7a128-1b78-4637-bcd6-0cc30877afb8\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.868278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-config-data\") pod \"20e7a128-1b78-4637-bcd6-0cc30877afb8\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.868318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-fernet-keys\") pod \"20e7a128-1b78-4637-bcd6-0cc30877afb8\" (UID: \"20e7a128-1b78-4637-bcd6-0cc30877afb8\") " Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.880805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-scripts" (OuterVolumeSpecName: "scripts") pod "20e7a128-1b78-4637-bcd6-0cc30877afb8" (UID: "20e7a128-1b78-4637-bcd6-0cc30877afb8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.882284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "20e7a128-1b78-4637-bcd6-0cc30877afb8" (UID: "20e7a128-1b78-4637-bcd6-0cc30877afb8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.886423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e7a128-1b78-4637-bcd6-0cc30877afb8-kube-api-access-glw2n" (OuterVolumeSpecName: "kube-api-access-glw2n") pod "20e7a128-1b78-4637-bcd6-0cc30877afb8" (UID: "20e7a128-1b78-4637-bcd6-0cc30877afb8"). InnerVolumeSpecName "kube-api-access-glw2n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.891533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "20e7a128-1b78-4637-bcd6-0cc30877afb8" (UID: "20e7a128-1b78-4637-bcd6-0cc30877afb8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.903692 4769 scope.go:117] "RemoveContainer" containerID="97513b514876280e1e80fe5e0696d9edf096c20ec2eb3eac3602c5016731f05f" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.922121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20e7a128-1b78-4637-bcd6-0cc30877afb8" (UID: "20e7a128-1b78-4637-bcd6-0cc30877afb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.938322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-config-data" (OuterVolumeSpecName: "config-data") pod "20e7a128-1b78-4637-bcd6-0cc30877afb8" (UID: "20e7a128-1b78-4637-bcd6-0cc30877afb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.974541 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.974577 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-glw2n\" (UniqueName: \"kubernetes.io/projected/20e7a128-1b78-4637-bcd6-0cc30877afb8-kube-api-access-glw2n\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.974590 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.974598 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.974607 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:07 crc kubenswrapper[4769]: I1121 12:38:07.974616 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/20e7a128-1b78-4637-bcd6-0cc30877afb8-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.010395 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-545c7885b4-plwx7"] Nov 21 12:38:08 crc kubenswrapper[4769]: E1121 12:38:08.010933 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20e7a128-1b78-4637-bcd6-0cc30877afb8" containerName="keystone-bootstrap" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.010953 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7a128-1b78-4637-bcd6-0cc30877afb8" containerName="keystone-bootstrap" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.011244 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20e7a128-1b78-4637-bcd6-0cc30877afb8" containerName="keystone-bootstrap" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.012677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.018451 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.022808 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.027581 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-545c7885b4-plwx7"] Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.030418 4769 scope.go:117] "RemoveContainer" containerID="067ddaf564becc991cf3dcc27aefa7e1295374b1bbff5a39103a63f29805992c" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.064312 4769 scope.go:117] "RemoveContainer" containerID="5cfd0ce281d7bbe1917e1175a0fc3048cbc7ab20776c3f81d5ae31ce90c3560c" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.075883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-public-tls-certs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.075932 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/946c5e3d-0426-4c04-b00c-9fdaa8da7146-logs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.075963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-internal-tls-certs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.076066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.076097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-combined-ca-bundle\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.076125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data-custom\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.076148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdc9g\" (UniqueName: \"kubernetes.io/projected/946c5e3d-0426-4c04-b00c-9fdaa8da7146-kube-api-access-hdc9g\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.080516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" event={"ID":"20e7a128-1b78-4637-bcd6-0cc30877afb8","Type":"ContainerDied","Data":"58c91c03911ee2f1dd13bf6b6c6489f98f9acdbaf43765b1bde117dc730ce145"} Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.080548 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58c91c03911ee2f1dd13bf6b6c6489f98f9acdbaf43765b1bde117dc730ce145" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.080603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-xkvr9" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.090016 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" event={"ID":"20f972a0-fb23-4a52-adca-85142c41c792","Type":"ContainerStarted","Data":"630ed0002f09dc452a6813808f778ebc1ecf341df8992c95f44fd667518c06ae"} Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.110808 4769 scope.go:117] "RemoveContainer" containerID="86b979769740240320ed7602b5e8a14671a912556e0456270c560fd52bb93976" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.162202 4769 scope.go:117] "RemoveContainer" containerID="bad66fbf85bba853777c21ae148f6df15f12f8fa7fae2af769e44bc09cfcace1" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-combined-ca-bundle\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data-custom\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hdc9g\" (UniqueName: \"kubernetes.io/projected/946c5e3d-0426-4c04-b00c-9fdaa8da7146-kube-api-access-hdc9g\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-public-tls-certs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/946c5e3d-0426-4c04-b00c-9fdaa8da7146-logs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.178846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-internal-tls-certs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.183070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/946c5e3d-0426-4c04-b00c-9fdaa8da7146-logs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.187868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-internal-tls-certs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.191880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.193593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-public-tls-certs\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.196013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-combined-ca-bundle\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.196231 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data-custom\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.207341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdc9g\" (UniqueName: \"kubernetes.io/projected/946c5e3d-0426-4c04-b00c-9fdaa8da7146-kube-api-access-hdc9g\") pod \"barbican-api-545c7885b4-plwx7\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.221400 4769 scope.go:117] "RemoveContainer" containerID="14de7eb5e801f2a3cd0f659eb4ab206fb29d6cef898618be3459b6b522338ef2" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.244335 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.244433 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.248586 4769 scope.go:117] "RemoveContainer" containerID="1d4755050fc50ac223d92ad875b648f44570fc210830f00c3b56c365adec824e" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.307487 4769 scope.go:117] "RemoveContainer" containerID="8e37bb213963559370470cf4b28ce4ca8c3b8b03e2fb76d76c5f6f874d48be09" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.336635 4769 scope.go:117] "RemoveContainer" containerID="7a61d42d53c7a5001181881ba7c9957c7c38c404d61460362a434aaf1d326d06" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.338808 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.386821 4769 scope.go:117] "RemoveContainer" containerID="900ab075cf227a8f5b6f40ea2b98bd2d3fb14fd44004c4cf58d34c1db12ecde8" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.443168 4769 scope.go:117] "RemoveContainer" containerID="46deb2eaf9d805f9cbc6a146fd91128e932419c5af1177d7db698b196a0557f4" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.479282 4769 scope.go:117] "RemoveContainer" containerID="3d99fd2f630e92494ce24d32a3927ec6f6be113f58944ac8ea7f42cedf020604" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.543023 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.578985 4769 scope.go:117] "RemoveContainer" containerID="be77e614009f4fac5cf0663a31d12801b352ad01d44cfeba17da40a0b642e867" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.616474 4769 scope.go:117] "RemoveContainer" containerID="b9714013a9d9c36f5790c7927330bdcdbdb1247efaba98f65df513d451a4ddd3" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.656419 4769 scope.go:117] "RemoveContainer" containerID="f55b3958ecc90769f30015277c816ab9c4f32976ae9b24ac0cc782d0f97a62e0" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.708377 4769 scope.go:117] "RemoveContainer" containerID="f1c27b172f389be68aeedce30e69924d6ca80c824feb4c63a9589fff2501ebdc" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.797497 4769 scope.go:117] "RemoveContainer" containerID="eb6e8c60bf35778b687be6d9ed515cc8494877cd42e33428ddae1661a4bffc14" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.822681 4769 scope.go:117] "RemoveContainer" containerID="2e8a55a9fd3d9c773ecc16615d57098e71c74ba81f02ba76ae17d2744bc3ff9f" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.856217 4769 scope.go:117] "RemoveContainer" containerID="7404b82dc7c50369c27d80aa331e4ea49d8e37fecf857352bbc3a44df97f01d6" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.899579 4769 scope.go:117] "RemoveContainer" containerID="ccb11eff8b85d3c5feeb4e3316a1b5f1e2bc1a9cf2c54a619df7db392b5f7a0f" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.923049 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-545c7885b4-plwx7"] Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.931563 4769 scope.go:117] "RemoveContainer" containerID="855c5c5b3f89891e0167433c824f2882fafb494b412c2ad789adb40a31298fb5" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.977884 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5dff568d6d-2ltjv"] Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.979743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.984466 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.984702 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.984859 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.985174 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.985364 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.985792 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-w2kpl" Nov 21 12:38:08 crc kubenswrapper[4769]: I1121 12:38:08.999718 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5dff568d6d-2ltjv"] Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.043032 4769 scope.go:117] "RemoveContainer" containerID="30dfb140d9e8887836ba42cd44a7ee5b669d5d2d55d486ec52a4ea40f065a45b" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095452 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-credential-keys\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-combined-ca-bundle\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-internal-tls-certs\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-fernet-keys\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095608 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-scripts\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-config-data\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-public-tls-certs\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.095681 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbnwc\" (UniqueName: \"kubernetes.io/projected/3f9ccc3c-419c-48a9-b052-640fc504a4c3-kube-api-access-bbnwc\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.153694 4769 scope.go:117] "RemoveContainer" containerID="b07e9aa6a6c0545ab5e16f2c97e743642f6cefdb47f1060394ed8d25dbb5a198" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-combined-ca-bundle\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-internal-tls-certs\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-fernet-keys\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-scripts\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-config-data\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-public-tls-certs\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bbnwc\" (UniqueName: \"kubernetes.io/projected/3f9ccc3c-419c-48a9-b052-640fc504a4c3-kube-api-access-bbnwc\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.197587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-credential-keys\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.205864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-config-data\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.206152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-internal-tls-certs\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.206637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-scripts\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.207672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-combined-ca-bundle\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.208054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-public-tls-certs\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.210601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-credential-keys\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.217453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbnwc\" (UniqueName: \"kubernetes.io/projected/3f9ccc3c-419c-48a9-b052-640fc504a4c3-kube-api-access-bbnwc\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.217463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-fernet-keys\") pod \"keystone-5dff568d6d-2ltjv\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.222110 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" event={"ID":"20f972a0-fb23-4a52-adca-85142c41c792","Type":"ContainerStarted","Data":"5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271"} Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.222270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" event={"ID":"20f972a0-fb23-4a52-adca-85142c41c792","Type":"ContainerStarted","Data":"3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c"} Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.223478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.228989 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.229342 4769 scope.go:117] "RemoveContainer" containerID="c2e35c65ee3281a8868c169717e85e16448db47322ae56d14fb755ce2df5fd31" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.239964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" event={"ID":"946c5e3d-0426-4c04-b00c-9fdaa8da7146","Type":"ContainerStarted","Data":"1292ccbe8026bb738068f5b6078ea74d8534d9f718e80fc84ef4e0a150eb1646"} Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.257640 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" podStartSLOduration=5.257594952 podStartE2EDuration="5.257594952s" podCreationTimestamp="2025-11-21 12:38:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:09.247748467 +0000 UTC m=+2847.948410285" watchObservedRunningTime="2025-11-21 12:38:09.257594952 +0000 UTC m=+2847.958256770" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.266739 4769 scope.go:117] "RemoveContainer" containerID="82987ba7c0967acfc1bc9314aa7a2876e339af377884cdae78da5984cacc7350" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.326992 4769 scope.go:117] "RemoveContainer" containerID="dc8d68ad780e028098bb8bcc578ce1b1c47587b9fec522a6b28330fb35c9a412" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.339228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.708270 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.708368 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.886936 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:38:09 crc kubenswrapper[4769]: I1121 12:38:09.920660 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5dff568d6d-2ltjv"] Nov 21 12:38:10 crc kubenswrapper[4769]: I1121 12:38:10.291603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" event={"ID":"3f9ccc3c-419c-48a9-b052-640fc504a4c3","Type":"ContainerStarted","Data":"12593aa3a11fc7bca506a51384f660a9325c499ca94b58cecdd3bff613a2da21"} Nov 21 12:38:10 crc kubenswrapper[4769]: I1121 12:38:10.297896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" event={"ID":"946c5e3d-0426-4c04-b00c-9fdaa8da7146","Type":"ContainerStarted","Data":"db111da3413ec218967d1a5ce01181ec0a6d6af36b5cc1ff9f160658a1fcd4c9"} Nov 21 12:38:10 crc kubenswrapper[4769]: I1121 12:38:10.297964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" event={"ID":"946c5e3d-0426-4c04-b00c-9fdaa8da7146","Type":"ContainerStarted","Data":"b3e8c9b38ba95e3907d800185d34ce21776a8fb69cb0b2f5e4ea8a479e6df3fc"} Nov 21 12:38:10 crc kubenswrapper[4769]: I1121 12:38:10.329961 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podStartSLOduration=3.329886064 podStartE2EDuration="3.329886064s" podCreationTimestamp="2025-11-21 12:38:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:10.320297186 +0000 UTC m=+2849.020959004" watchObservedRunningTime="2025-11-21 12:38:10.329886064 +0000 UTC m=+2849.030547892" Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.315991 4769 generic.go:334] "Generic (PLEG): container finished" podID="48e592e6-4275-4db4-aad1-96772bb728f3" containerID="264b29fa2e5a2c344e5ad746d614e362cae3d7b7d9c7f2876d5b025bdb0c8948" exitCode=0 Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.316087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" event={"ID":"48e592e6-4275-4db4-aad1-96772bb728f3","Type":"ContainerDied","Data":"264b29fa2e5a2c344e5ad746d614e362cae3d7b7d9c7f2876d5b025bdb0c8948"} Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.319909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" event={"ID":"3f9ccc3c-419c-48a9-b052-640fc504a4c3","Type":"ContainerStarted","Data":"58fe909266273dec1aa413ce6b37f92941f2f4ca2dc892c70b34c612a1ecef72"} Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.320528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.320558 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.324960 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.325051 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.325118 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.326366 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"da2a3b3b916b37218a88212a2ea066749ffab8f49bbf57426bd700ab85ca0799"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.326461 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://da2a3b3b916b37218a88212a2ea066749ffab8f49bbf57426bd700ab85ca0799" gracePeriod=600 Nov 21 12:38:11 crc kubenswrapper[4769]: I1121 12:38:11.369282 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" podStartSLOduration=3.369250478 podStartE2EDuration="3.369250478s" podCreationTimestamp="2025-11-21 12:38:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:11.364949993 +0000 UTC m=+2850.065611821" watchObservedRunningTime="2025-11-21 12:38:11.369250478 +0000 UTC m=+2850.069912336" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.337670 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="da2a3b3b916b37218a88212a2ea066749ffab8f49bbf57426bd700ab85ca0799" exitCode=0 Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.337858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"da2a3b3b916b37218a88212a2ea066749ffab8f49bbf57426bd700ab85ca0799"} Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.337948 4769 scope.go:117] "RemoveContainer" containerID="fe7c56fbf5f08c9e4fcf97efc46a156504cf7c63e5c8283e569e6e18a21f185d" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.338251 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.806051 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.906228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-scripts\") pod \"48e592e6-4275-4db4-aad1-96772bb728f3\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.906289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9t44\" (UniqueName: \"kubernetes.io/projected/48e592e6-4275-4db4-aad1-96772bb728f3-kube-api-access-t9t44\") pod \"48e592e6-4275-4db4-aad1-96772bb728f3\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.906484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-config-data\") pod \"48e592e6-4275-4db4-aad1-96772bb728f3\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.906681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-db-sync-config-data\") pod \"48e592e6-4275-4db4-aad1-96772bb728f3\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.906728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-combined-ca-bundle\") pod \"48e592e6-4275-4db4-aad1-96772bb728f3\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.906803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48e592e6-4275-4db4-aad1-96772bb728f3-etc-machine-id\") pod \"48e592e6-4275-4db4-aad1-96772bb728f3\" (UID: \"48e592e6-4275-4db4-aad1-96772bb728f3\") " Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.907133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/48e592e6-4275-4db4-aad1-96772bb728f3-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "48e592e6-4275-4db4-aad1-96772bb728f3" (UID: "48e592e6-4275-4db4-aad1-96772bb728f3"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.907515 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48e592e6-4275-4db4-aad1-96772bb728f3-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.914027 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-scripts" (OuterVolumeSpecName: "scripts") pod "48e592e6-4275-4db4-aad1-96772bb728f3" (UID: "48e592e6-4275-4db4-aad1-96772bb728f3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.920357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "48e592e6-4275-4db4-aad1-96772bb728f3" (UID: "48e592e6-4275-4db4-aad1-96772bb728f3"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.920373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e592e6-4275-4db4-aad1-96772bb728f3-kube-api-access-t9t44" (OuterVolumeSpecName: "kube-api-access-t9t44") pod "48e592e6-4275-4db4-aad1-96772bb728f3" (UID: "48e592e6-4275-4db4-aad1-96772bb728f3"). InnerVolumeSpecName "kube-api-access-t9t44". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.939170 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48e592e6-4275-4db4-aad1-96772bb728f3" (UID: "48e592e6-4275-4db4-aad1-96772bb728f3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:12 crc kubenswrapper[4769]: I1121 12:38:12.975403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-config-data" (OuterVolumeSpecName: "config-data") pod "48e592e6-4275-4db4-aad1-96772bb728f3" (UID: "48e592e6-4275-4db4-aad1-96772bb728f3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.008704 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.008746 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.008762 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.008774 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t9t44\" (UniqueName: \"kubernetes.io/projected/48e592e6-4275-4db4-aad1-96772bb728f3-kube-api-access-t9t44\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.008786 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48e592e6-4275-4db4-aad1-96772bb728f3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.360060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" event={"ID":"48e592e6-4275-4db4-aad1-96772bb728f3","Type":"ContainerDied","Data":"70fc14c570cb0a260ce8438eb6ad0f76736c0c8c2d290f150893d14fba29a5c0"} Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.360528 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70fc14c570cb0a260ce8438eb6ad0f76736c0c8c2d290f150893d14fba29a5c0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.360551 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-lrthj" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.367568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05"} Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.689030 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:13 crc kubenswrapper[4769]: E1121 12:38:13.689563 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48e592e6-4275-4db4-aad1-96772bb728f3" containerName="cinder-db-sync" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.689580 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e592e6-4275-4db4-aad1-96772bb728f3" containerName="cinder-db-sync" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.689835 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48e592e6-4275-4db4-aad1-96772bb728f3" containerName="cinder-db-sync" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.691178 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.694570 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-knzk5" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.694788 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.694898 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.695076 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.696584 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.819881 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.821684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.823885 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.827357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc2s4\" (UniqueName: \"kubernetes.io/projected/d4893c22-4cea-4851-b242-27155556bf63-kube-api-access-qc2s4\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.827413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-scripts\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.827480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4893c22-4cea-4851-b242-27155556bf63-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.827503 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.827546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.827577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.852627 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.929695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.929756 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.929811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data-custom\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.929843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.929949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-scripts\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.929986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03d84c85-bd3f-42fa-96a4-43edbf9200bb-logs\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28sh\" (UniqueName: \"kubernetes.io/projected/03d84c85-bd3f-42fa-96a4-43edbf9200bb-kube-api-access-q28sh\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qc2s4\" (UniqueName: \"kubernetes.io/projected/d4893c22-4cea-4851-b242-27155556bf63-kube-api-access-qc2s4\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930183 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-scripts\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930245 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930306 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4893c22-4cea-4851-b242-27155556bf63-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4893c22-4cea-4851-b242-27155556bf63-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930377 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.930420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03d84c85-bd3f-42fa-96a4-43edbf9200bb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.936300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.936918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-scripts\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.939105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.947942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:13 crc kubenswrapper[4769]: I1121 12:38:13.948251 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc2s4\" (UniqueName: \"kubernetes.io/projected/d4893c22-4cea-4851-b242-27155556bf63-kube-api-access-qc2s4\") pod \"cinder-scheduler-0\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.009167 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data-custom\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-scripts\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03d84c85-bd3f-42fa-96a4-43edbf9200bb-logs\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q28sh\" (UniqueName: \"kubernetes.io/projected/03d84c85-bd3f-42fa-96a4-43edbf9200bb-kube-api-access-q28sh\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03d84c85-bd3f-42fa-96a4-43edbf9200bb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.032800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.033362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03d84c85-bd3f-42fa-96a4-43edbf9200bb-logs\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.033368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03d84c85-bd3f-42fa-96a4-43edbf9200bb-etc-machine-id\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.037736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-scripts\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.038455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data-custom\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.039814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.039872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.054422 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28sh\" (UniqueName: \"kubernetes.io/projected/03d84c85-bd3f-42fa-96a4-43edbf9200bb-kube-api-access-q28sh\") pod \"cinder-api-0\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.140673 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.521170 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:14 crc kubenswrapper[4769]: W1121 12:38:14.532594 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4893c22_4cea_4851_b242_27155556bf63.slice/crio-247ebdab6232e66c0a8b75e300af223edf20622fe107b121b5e9a51c40a256a4 WatchSource:0}: Error finding container 247ebdab6232e66c0a8b75e300af223edf20622fe107b121b5e9a51c40a256a4: Status 404 returned error can't find the container with id 247ebdab6232e66c0a8b75e300af223edf20622fe107b121b5e9a51c40a256a4 Nov 21 12:38:14 crc kubenswrapper[4769]: I1121 12:38:14.724563 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:15 crc kubenswrapper[4769]: I1121 12:38:15.438557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4893c22-4cea-4851-b242-27155556bf63","Type":"ContainerStarted","Data":"247ebdab6232e66c0a8b75e300af223edf20622fe107b121b5e9a51c40a256a4"} Nov 21 12:38:15 crc kubenswrapper[4769]: I1121 12:38:15.462646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03d84c85-bd3f-42fa-96a4-43edbf9200bb","Type":"ContainerStarted","Data":"3f33300a4f2d70ae1846a34de8d8151e3864e2ab80f89a12282e3c7b6470b703"} Nov 21 12:38:16 crc kubenswrapper[4769]: I1121 12:38:16.499013 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03d84c85-bd3f-42fa-96a4-43edbf9200bb","Type":"ContainerStarted","Data":"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4"} Nov 21 12:38:16 crc kubenswrapper[4769]: I1121 12:38:16.505558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4893c22-4cea-4851-b242-27155556bf63","Type":"ContainerStarted","Data":"ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6"} Nov 21 12:38:16 crc kubenswrapper[4769]: I1121 12:38:16.690697 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:16 crc kubenswrapper[4769]: I1121 12:38:16.836816 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:16 crc kubenswrapper[4769]: I1121 12:38:16.904363 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:17 crc kubenswrapper[4769]: I1121 12:38:17.517299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4893c22-4cea-4851-b242-27155556bf63","Type":"ContainerStarted","Data":"75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45"} Nov 21 12:38:17 crc kubenswrapper[4769]: I1121 12:38:17.521062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03d84c85-bd3f-42fa-96a4-43edbf9200bb","Type":"ContainerStarted","Data":"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54"} Nov 21 12:38:17 crc kubenswrapper[4769]: I1121 12:38:17.521178 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api-log" containerID="cri-o://89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4" gracePeriod=30 Nov 21 12:38:17 crc kubenswrapper[4769]: I1121 12:38:17.521243 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api" containerID="cri-o://965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54" gracePeriod=30 Nov 21 12:38:17 crc kubenswrapper[4769]: I1121 12:38:17.521499 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:17 crc kubenswrapper[4769]: I1121 12:38:17.571473 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.571449607 podStartE2EDuration="4.571449607s" podCreationTimestamp="2025-11-21 12:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:17.543639239 +0000 UTC m=+2856.244301077" watchObservedRunningTime="2025-11-21 12:38:17.571449607 +0000 UTC m=+2856.272111425" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.188825 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254081 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data-custom\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-scripts\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03d84c85-bd3f-42fa-96a4-43edbf9200bb-etc-machine-id\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-combined-ca-bundle\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03d84c85-bd3f-42fa-96a4-43edbf9200bb-logs\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254404 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q28sh\" (UniqueName: \"kubernetes.io/projected/03d84c85-bd3f-42fa-96a4-43edbf9200bb-kube-api-access-q28sh\") pod \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\" (UID: \"03d84c85-bd3f-42fa-96a4-43edbf9200bb\") " Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/03d84c85-bd3f-42fa-96a4-43edbf9200bb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.254963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03d84c85-bd3f-42fa-96a4-43edbf9200bb-logs" (OuterVolumeSpecName: "logs") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.256214 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03d84c85-bd3f-42fa-96a4-43edbf9200bb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.256247 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03d84c85-bd3f-42fa-96a4-43edbf9200bb-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.262934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-scripts" (OuterVolumeSpecName: "scripts") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.265895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d84c85-bd3f-42fa-96a4-43edbf9200bb-kube-api-access-q28sh" (OuterVolumeSpecName: "kube-api-access-q28sh") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "kube-api-access-q28sh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.270829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.300330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.338988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data" (OuterVolumeSpecName: "config-data") pod "03d84c85-bd3f-42fa-96a4-43edbf9200bb" (UID: "03d84c85-bd3f-42fa-96a4-43edbf9200bb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.357639 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.357674 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.357685 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.357694 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03d84c85-bd3f-42fa-96a4-43edbf9200bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.357705 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q28sh\" (UniqueName: \"kubernetes.io/projected/03d84c85-bd3f-42fa-96a4-43edbf9200bb-kube-api-access-q28sh\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.535906 4769 generic.go:334] "Generic (PLEG): container finished" podID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerID="965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54" exitCode=0 Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.535950 4769 generic.go:334] "Generic (PLEG): container finished" podID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerID="89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4" exitCode=143 Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.536347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.537079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03d84c85-bd3f-42fa-96a4-43edbf9200bb","Type":"ContainerDied","Data":"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54"} Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.537114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03d84c85-bd3f-42fa-96a4-43edbf9200bb","Type":"ContainerDied","Data":"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4"} Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.537129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03d84c85-bd3f-42fa-96a4-43edbf9200bb","Type":"ContainerDied","Data":"3f33300a4f2d70ae1846a34de8d8151e3864e2ab80f89a12282e3c7b6470b703"} Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.537150 4769 scope.go:117] "RemoveContainer" containerID="965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.569741 4769 scope.go:117] "RemoveContainer" containerID="89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.582362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.593365 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.603584 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:18 crc kubenswrapper[4769]: E1121 12:38:18.604118 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.604142 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api" Nov 21 12:38:18 crc kubenswrapper[4769]: E1121 12:38:18.604165 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api-log" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.604173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api-log" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.604396 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.604414 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" containerName="cinder-api-log" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.606699 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.610666 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.610686 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.610845 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.611332 4769 scope.go:117] "RemoveContainer" containerID="965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.617779 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:18 crc kubenswrapper[4769]: E1121 12:38:18.626713 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54\": container with ID starting with 965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54 not found: ID does not exist" containerID="965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.626763 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54"} err="failed to get container status \"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54\": rpc error: code = NotFound desc = could not find container \"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54\": container with ID starting with 965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54 not found: ID does not exist" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.626799 4769 scope.go:117] "RemoveContainer" containerID="89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4" Nov 21 12:38:18 crc kubenswrapper[4769]: E1121 12:38:18.629335 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4\": container with ID starting with 89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4 not found: ID does not exist" containerID="89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.629370 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4"} err="failed to get container status \"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4\": rpc error: code = NotFound desc = could not find container \"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4\": container with ID starting with 89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4 not found: ID does not exist" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.629392 4769 scope.go:117] "RemoveContainer" containerID="965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.633814 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54"} err="failed to get container status \"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54\": rpc error: code = NotFound desc = could not find container \"965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54\": container with ID starting with 965e3e04c158030a45677d6a6a824a2679f13cbdce32b820d3a41a40f9030d54 not found: ID does not exist" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.633858 4769 scope.go:117] "RemoveContainer" containerID="89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.634089 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4"} err="failed to get container status \"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4\": rpc error: code = NotFound desc = could not find container \"89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4\": container with ID starting with 89902f7e3d265b6d4555bd28f0005ea95f23e338de627b811b0a25523f5542c4 not found: ID does not exist" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-scripts\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766805 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqrq\" (UniqueName: \"kubernetes.io/projected/e689da25-a663-48f8-acc0-3890d96884a2-kube-api-access-mrqrq\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e689da25-a663-48f8-acc0-3890d96884a2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.766878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data-custom\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.767003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e689da25-a663-48f8-acc0-3890d96884a2-logs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.767106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e689da25-a663-48f8-acc0-3890d96884a2-logs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869460 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-scripts\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqrq\" (UniqueName: \"kubernetes.io/projected/e689da25-a663-48f8-acc0-3890d96884a2-kube-api-access-mrqrq\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e689da25-a663-48f8-acc0-3890d96884a2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data-custom\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.869761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e689da25-a663-48f8-acc0-3890d96884a2-logs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.870602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e689da25-a663-48f8-acc0-3890d96884a2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.881376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.881865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.881877 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.882084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.882383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data-custom\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.884105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-scripts\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.894769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqrq\" (UniqueName: \"kubernetes.io/projected/e689da25-a663-48f8-acc0-3890d96884a2-kube-api-access-mrqrq\") pod \"cinder-api-0\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:18 crc kubenswrapper[4769]: I1121 12:38:18.933006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:19 crc kubenswrapper[4769]: I1121 12:38:19.009709 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:19 crc kubenswrapper[4769]: I1121 12:38:19.285568 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d84c85-bd3f-42fa-96a4-43edbf9200bb" path="/var/lib/kubelet/pods/03d84c85-bd3f-42fa-96a4-43edbf9200bb/volumes" Nov 21 12:38:19 crc kubenswrapper[4769]: I1121 12:38:19.477349 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:38:19 crc kubenswrapper[4769]: I1121 12:38:19.551058 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e689da25-a663-48f8-acc0-3890d96884a2","Type":"ContainerStarted","Data":"f2730f469f7940247b8f0dce9c27f8162a6186aa7efb4dd927c74fb18e3f946b"} Nov 21 12:38:19 crc kubenswrapper[4769]: I1121 12:38:19.954283 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:20 crc kubenswrapper[4769]: I1121 12:38:20.234816 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:38:20 crc kubenswrapper[4769]: I1121 12:38:20.341085 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-67778847c6-8qbm7"] Nov 21 12:38:20 crc kubenswrapper[4769]: I1121 12:38:20.341546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api-log" containerID="cri-o://3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c" gracePeriod=30 Nov 21 12:38:20 crc kubenswrapper[4769]: I1121 12:38:20.341927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api" containerID="cri-o://5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271" gracePeriod=30 Nov 21 12:38:20 crc kubenswrapper[4769]: I1121 12:38:20.552768 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": EOF" Nov 21 12:38:20 crc kubenswrapper[4769]: I1121 12:38:20.591423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e689da25-a663-48f8-acc0-3890d96884a2","Type":"ContainerStarted","Data":"08f3dac19275963f7631149ded191aab9c95d11c06c4f3ef01c1d0b027a28a6a"} Nov 21 12:38:21 crc kubenswrapper[4769]: I1121 12:38:21.604466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e689da25-a663-48f8-acc0-3890d96884a2","Type":"ContainerStarted","Data":"b7988bea32c802e8b5a49d276c9ee94444c8899e8888fc245b7ea7c260125703"} Nov 21 12:38:21 crc kubenswrapper[4769]: I1121 12:38:21.605456 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:21 crc kubenswrapper[4769]: I1121 12:38:21.606951 4769 generic.go:334] "Generic (PLEG): container finished" podID="20f972a0-fb23-4a52-adca-85142c41c792" containerID="3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c" exitCode=143 Nov 21 12:38:21 crc kubenswrapper[4769]: I1121 12:38:21.607011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" event={"ID":"20f972a0-fb23-4a52-adca-85142c41c792","Type":"ContainerDied","Data":"3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c"} Nov 21 12:38:21 crc kubenswrapper[4769]: I1121 12:38:21.629300 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.62927404 podStartE2EDuration="3.62927404s" podCreationTimestamp="2025-11-21 12:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:21.625101967 +0000 UTC m=+2860.325763786" watchObservedRunningTime="2025-11-21 12:38:21.62927404 +0000 UTC m=+2860.329935878" Nov 21 12:38:24 crc kubenswrapper[4769]: I1121 12:38:24.254860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:24 crc kubenswrapper[4769]: I1121 12:38:24.330352 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:24 crc kubenswrapper[4769]: I1121 12:38:24.644348 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="cinder-scheduler" containerID="cri-o://ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6" gracePeriod=30 Nov 21 12:38:24 crc kubenswrapper[4769]: I1121 12:38:24.644496 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="probe" containerID="cri-o://75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45" gracePeriod=30 Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.039602 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:55854->10.217.0.154:9311: read: connection reset by peer" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.039667 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:55870->10.217.0.154:9311: read: connection reset by peer" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.598547 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.661576 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4893c22-4cea-4851-b242-27155556bf63" containerID="75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45" exitCode=0 Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.661642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4893c22-4cea-4851-b242-27155556bf63","Type":"ContainerDied","Data":"75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45"} Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.663513 4769 generic.go:334] "Generic (PLEG): container finished" podID="20f972a0-fb23-4a52-adca-85142c41c792" containerID="5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271" exitCode=0 Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.663564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" event={"ID":"20f972a0-fb23-4a52-adca-85142c41c792","Type":"ContainerDied","Data":"5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271"} Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.663590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" event={"ID":"20f972a0-fb23-4a52-adca-85142c41c792","Type":"ContainerDied","Data":"630ed0002f09dc452a6813808f778ebc1ecf341df8992c95f44fd667518c06ae"} Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.663637 4769 scope.go:117] "RemoveContainer" containerID="5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.663795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-67778847c6-8qbm7" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.689056 4769 scope.go:117] "RemoveContainer" containerID="3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.708300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f972a0-fb23-4a52-adca-85142c41c792-logs\") pod \"20f972a0-fb23-4a52-adca-85142c41c792\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.708455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data\") pod \"20f972a0-fb23-4a52-adca-85142c41c792\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.708498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data-custom\") pod \"20f972a0-fb23-4a52-adca-85142c41c792\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.708563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wh59\" (UniqueName: \"kubernetes.io/projected/20f972a0-fb23-4a52-adca-85142c41c792-kube-api-access-9wh59\") pod \"20f972a0-fb23-4a52-adca-85142c41c792\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.708588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-combined-ca-bundle\") pod \"20f972a0-fb23-4a52-adca-85142c41c792\" (UID: \"20f972a0-fb23-4a52-adca-85142c41c792\") " Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.711732 4769 scope.go:117] "RemoveContainer" containerID="5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.711981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f972a0-fb23-4a52-adca-85142c41c792-logs" (OuterVolumeSpecName: "logs") pod "20f972a0-fb23-4a52-adca-85142c41c792" (UID: "20f972a0-fb23-4a52-adca-85142c41c792"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:38:25 crc kubenswrapper[4769]: E1121 12:38:25.712336 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271\": container with ID starting with 5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271 not found: ID does not exist" containerID="5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.712391 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271"} err="failed to get container status \"5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271\": rpc error: code = NotFound desc = could not find container \"5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271\": container with ID starting with 5d5223b7faf8df6b66a7ac153d659c2c78660a9ce0e97c98e6ce209b90a84271 not found: ID does not exist" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.712419 4769 scope.go:117] "RemoveContainer" containerID="3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c" Nov 21 12:38:25 crc kubenswrapper[4769]: E1121 12:38:25.712775 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c\": container with ID starting with 3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c not found: ID does not exist" containerID="3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.712802 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c"} err="failed to get container status \"3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c\": rpc error: code = NotFound desc = could not find container \"3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c\": container with ID starting with 3531fabbc48b21a2eb6b50298f2c8b25e2a89a3f3165bd65119bcc86b57ab81c not found: ID does not exist" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.716402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f972a0-fb23-4a52-adca-85142c41c792-kube-api-access-9wh59" (OuterVolumeSpecName: "kube-api-access-9wh59") pod "20f972a0-fb23-4a52-adca-85142c41c792" (UID: "20f972a0-fb23-4a52-adca-85142c41c792"). InnerVolumeSpecName "kube-api-access-9wh59". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.716884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "20f972a0-fb23-4a52-adca-85142c41c792" (UID: "20f972a0-fb23-4a52-adca-85142c41c792"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.747809 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20f972a0-fb23-4a52-adca-85142c41c792" (UID: "20f972a0-fb23-4a52-adca-85142c41c792"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.806487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data" (OuterVolumeSpecName: "config-data") pod "20f972a0-fb23-4a52-adca-85142c41c792" (UID: "20f972a0-fb23-4a52-adca-85142c41c792"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.810624 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9wh59\" (UniqueName: \"kubernetes.io/projected/20f972a0-fb23-4a52-adca-85142c41c792-kube-api-access-9wh59\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.810659 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.810670 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f972a0-fb23-4a52-adca-85142c41c792-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.810682 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:25 crc kubenswrapper[4769]: I1121 12:38:25.810693 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/20f972a0-fb23-4a52-adca-85142c41c792-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:26 crc kubenswrapper[4769]: I1121 12:38:26.010140 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-67778847c6-8qbm7"] Nov 21 12:38:26 crc kubenswrapper[4769]: I1121 12:38:26.014063 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-67778847c6-8qbm7"] Nov 21 12:38:27 crc kubenswrapper[4769]: I1121 12:38:27.290745 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20f972a0-fb23-4a52-adca-85142c41c792" path="/var/lib/kubelet/pods/20f972a0-fb23-4a52-adca-85142c41c792/volumes" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.275971 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.355483 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-scripts\") pod \"d4893c22-4cea-4851-b242-27155556bf63\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.355579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-combined-ca-bundle\") pod \"d4893c22-4cea-4851-b242-27155556bf63\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.355645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4893c22-4cea-4851-b242-27155556bf63-etc-machine-id\") pod \"d4893c22-4cea-4851-b242-27155556bf63\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.355695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data\") pod \"d4893c22-4cea-4851-b242-27155556bf63\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.355733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc2s4\" (UniqueName: \"kubernetes.io/projected/d4893c22-4cea-4851-b242-27155556bf63-kube-api-access-qc2s4\") pod \"d4893c22-4cea-4851-b242-27155556bf63\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.355775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data-custom\") pod \"d4893c22-4cea-4851-b242-27155556bf63\" (UID: \"d4893c22-4cea-4851-b242-27155556bf63\") " Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.356083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d4893c22-4cea-4851-b242-27155556bf63-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d4893c22-4cea-4851-b242-27155556bf63" (UID: "d4893c22-4cea-4851-b242-27155556bf63"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.356543 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4893c22-4cea-4851-b242-27155556bf63-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.361882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4893c22-4cea-4851-b242-27155556bf63-kube-api-access-qc2s4" (OuterVolumeSpecName: "kube-api-access-qc2s4") pod "d4893c22-4cea-4851-b242-27155556bf63" (UID: "d4893c22-4cea-4851-b242-27155556bf63"). InnerVolumeSpecName "kube-api-access-qc2s4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.363905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-scripts" (OuterVolumeSpecName: "scripts") pod "d4893c22-4cea-4851-b242-27155556bf63" (UID: "d4893c22-4cea-4851-b242-27155556bf63"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.372714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d4893c22-4cea-4851-b242-27155556bf63" (UID: "d4893c22-4cea-4851-b242-27155556bf63"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.425120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4893c22-4cea-4851-b242-27155556bf63" (UID: "d4893c22-4cea-4851-b242-27155556bf63"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.460221 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.460257 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qc2s4\" (UniqueName: \"kubernetes.io/projected/d4893c22-4cea-4851-b242-27155556bf63-kube-api-access-qc2s4\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.460269 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.460279 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.476246 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.485418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data" (OuterVolumeSpecName: "config-data") pod "d4893c22-4cea-4851-b242-27155556bf63" (UID: "d4893c22-4cea-4851-b242-27155556bf63"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.561816 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4893c22-4cea-4851-b242-27155556bf63-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.693713 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4893c22-4cea-4851-b242-27155556bf63" containerID="ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6" exitCode=0 Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.693768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4893c22-4cea-4851-b242-27155556bf63","Type":"ContainerDied","Data":"ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6"} Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.693831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4893c22-4cea-4851-b242-27155556bf63","Type":"ContainerDied","Data":"247ebdab6232e66c0a8b75e300af223edf20622fe107b121b5e9a51c40a256a4"} Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.693855 4769 scope.go:117] "RemoveContainer" containerID="75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.694086 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.718738 4769 scope.go:117] "RemoveContainer" containerID="ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.730342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.742548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.744633 4769 scope.go:117] "RemoveContainer" containerID="75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45" Nov 21 12:38:28 crc kubenswrapper[4769]: E1121 12:38:28.745298 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45\": container with ID starting with 75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45 not found: ID does not exist" containerID="75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.745362 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45"} err="failed to get container status \"75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45\": rpc error: code = NotFound desc = could not find container \"75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45\": container with ID starting with 75e8100bfd656d4078f33c9bee4db9baadd66b17dc79bdd792d6ed610090be45 not found: ID does not exist" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.745392 4769 scope.go:117] "RemoveContainer" containerID="ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6" Nov 21 12:38:28 crc kubenswrapper[4769]: E1121 12:38:28.748403 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6\": container with ID starting with ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6 not found: ID does not exist" containerID="ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.748529 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6"} err="failed to get container status \"ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6\": rpc error: code = NotFound desc = could not find container \"ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6\": container with ID starting with ce5fbc9217546a9778e564eb7b874f93216e691035ef1c96b4b6708f10f482c6 not found: ID does not exist" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.758822 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:28 crc kubenswrapper[4769]: E1121 12:38:28.759416 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="probe" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759436 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="probe" Nov 21 12:38:28 crc kubenswrapper[4769]: E1121 12:38:28.759455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759461 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api" Nov 21 12:38:28 crc kubenswrapper[4769]: E1121 12:38:28.759475 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="cinder-scheduler" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="cinder-scheduler" Nov 21 12:38:28 crc kubenswrapper[4769]: E1121 12:38:28.759505 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api-log" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759510 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api-log" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759692 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api-log" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759707 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="probe" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759721 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4893c22-4cea-4851-b242-27155556bf63" containerName="cinder-scheduler" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.759733 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20f972a0-fb23-4a52-adca-85142c41c792" containerName="barbican-api" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.760772 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.763309 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.768377 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.867033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.867320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.867349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.867430 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-scripts\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.867492 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkk9\" (UniqueName: \"kubernetes.io/projected/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-kube-api-access-bjkk9\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.867522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.969717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.969980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.970631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.970804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-scripts\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.970953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkk9\" (UniqueName: \"kubernetes.io/projected/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-kube-api-access-bjkk9\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.971033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.971381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.974785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-scripts\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.975238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.975609 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.977390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:28 crc kubenswrapper[4769]: I1121 12:38:28.991290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkk9\" (UniqueName: \"kubernetes.io/projected/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-kube-api-access-bjkk9\") pod \"cinder-scheduler-0\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:29 crc kubenswrapper[4769]: I1121 12:38:29.093468 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:29 crc kubenswrapper[4769]: I1121 12:38:29.287418 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4893c22-4cea-4851-b242-27155556bf63" path="/var/lib/kubelet/pods/d4893c22-4cea-4851-b242-27155556bf63/volumes" Nov 21 12:38:29 crc kubenswrapper[4769]: I1121 12:38:29.596652 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:38:29 crc kubenswrapper[4769]: W1121 12:38:29.602304 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf5c7d97_c7aa_4b91_b784_ff9a10b76d85.slice/crio-59cc84166fab8618dbb86461d4f527eeab9b15c04da677dcdc0729e1fc36792a WatchSource:0}: Error finding container 59cc84166fab8618dbb86461d4f527eeab9b15c04da677dcdc0729e1fc36792a: Status 404 returned error can't find the container with id 59cc84166fab8618dbb86461d4f527eeab9b15c04da677dcdc0729e1fc36792a Nov 21 12:38:29 crc kubenswrapper[4769]: I1121 12:38:29.714086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85","Type":"ContainerStarted","Data":"59cc84166fab8618dbb86461d4f527eeab9b15c04da677dcdc0729e1fc36792a"} Nov 21 12:38:30 crc kubenswrapper[4769]: I1121 12:38:30.734671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85","Type":"ContainerStarted","Data":"908724d52efa7d576b7f6591f9a9144816fe4c25e7857cf621f85b556381d9ed"} Nov 21 12:38:31 crc kubenswrapper[4769]: I1121 12:38:31.574834 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:38:31 crc kubenswrapper[4769]: I1121 12:38:31.781639 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85","Type":"ContainerStarted","Data":"ed10da15d9a853724f32abe130cf71488623cce53a6627d5b2df941aa10bf5ce"} Nov 21 12:38:31 crc kubenswrapper[4769]: I1121 12:38:31.789996 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:38:31 crc kubenswrapper[4769]: I1121 12:38:31.807362 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.807338186 podStartE2EDuration="3.807338186s" podCreationTimestamp="2025-11-21 12:38:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:31.796524835 +0000 UTC m=+2870.497186653" watchObservedRunningTime="2025-11-21 12:38:31.807338186 +0000 UTC m=+2870.508000014" Nov 21 12:38:31 crc kubenswrapper[4769]: I1121 12:38:31.881605 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:38:34 crc kubenswrapper[4769]: I1121 12:38:34.094207 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:39 crc kubenswrapper[4769]: I1121 12:38:39.315922 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:38:40 crc kubenswrapper[4769]: I1121 12:38:40.934080 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.084751 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.087893 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.096998 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.137581 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.137909 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-jblc2" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.139884 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.166048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnvrf\" (UniqueName: \"kubernetes.io/projected/b4170bf0-4651-402b-b28e-28443fc3f568-kube-api-access-hnvrf\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.166089 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.166122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config-secret\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.166259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.268251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.268374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hnvrf\" (UniqueName: \"kubernetes.io/projected/b4170bf0-4651-402b-b28e-28443fc3f568-kube-api-access-hnvrf\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.268398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.268435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config-secret\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.279313 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.279443 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.291049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.293563 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.300607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config-secret\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.307256 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnvrf\" (UniqueName: \"kubernetes.io/projected/b4170bf0-4651-402b-b28e-28443fc3f568-kube-api-access-hnvrf\") pod \"openstackclient\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.463015 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-jblc2" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.471489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:38:43 crc kubenswrapper[4769]: I1121 12:38:43.939101 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:38:44 crc kubenswrapper[4769]: I1121 12:38:44.945885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b4170bf0-4651-402b-b28e-28443fc3f568","Type":"ContainerStarted","Data":"97bf8f1119990e5f020933900bdd694b77bd4716487dbd84b9e49dbaf47b746c"} Nov 21 12:38:44 crc kubenswrapper[4769]: I1121 12:38:44.946492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b4170bf0-4651-402b-b28e-28443fc3f568","Type":"ContainerStarted","Data":"107614545ab589a677699c01448f0565b598b8fd514ea7dd7e3c3aad376f6a44"} Nov 21 12:38:44 crc kubenswrapper[4769]: I1121 12:38:44.984030 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.9840025639999999 podStartE2EDuration="1.984002564s" podCreationTimestamp="2025-11-21 12:38:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:44.963105252 +0000 UTC m=+2883.663767070" watchObservedRunningTime="2025-11-21 12:38:44.984002564 +0000 UTC m=+2883.684664382" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.885569 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc"] Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.888391 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.891357 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.892002 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.901383 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc"] Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.901620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.959724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-internal-tls-certs\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.959798 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-combined-ca-bundle\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.959835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-run-httpd\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.959894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-log-httpd\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.959914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-etc-swift\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.959930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-public-tls-certs\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.960049 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76779\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-kube-api-access-76779\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:47 crc kubenswrapper[4769]: I1121 12:38:47.960237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-config-data\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-combined-ca-bundle\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-run-httpd\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062535 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-log-httpd\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-etc-swift\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-public-tls-certs\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-76779\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-kube-api-access-76779\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.062944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-config-data\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.063075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-log-httpd\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.063151 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-internal-tls-certs\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.063495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-run-httpd\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.067845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-internal-tls-certs\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.068714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-etc-swift\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.068919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-public-tls-certs\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.069041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-combined-ca-bundle\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.071180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-config-data\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.084789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-76779\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-kube-api-access-76779\") pod \"swift-proxy-867d8f6754-vfcsc\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.230719 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.571800 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.572584 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-central-agent" containerID="cri-o://dbb4ec56096596aa7155bda123bb2479f6bd196fce3b6920908ff766249ff562" gracePeriod=30 Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.572680 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="proxy-httpd" containerID="cri-o://739487a08c3f56eb841a4aa9f85832f59ee9a56bcd24ffe0266b4d0f1ced8872" gracePeriod=30 Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.572794 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-notification-agent" containerID="cri-o://9916c21f25d7b6380cdfbdbdcfe44b28a191cb262961f6362ac168bacb4c16c4" gracePeriod=30 Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.572886 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="sg-core" containerID="cri-o://b1b8bff43fa27df5a0a24e9028084e7676ea631ee795aa32055d47806dd782cf" gracePeriod=30 Nov 21 12:38:48 crc kubenswrapper[4769]: I1121 12:38:48.688874 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc"] Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.000739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" event={"ID":"96cb08c2-a543-4f8a-8e70-3fe6b2c02998","Type":"ContainerStarted","Data":"c420f1506cf28ef6804b486348b6d21fe955600f531eb9caa2242a1d8c4392b5"} Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.001179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" event={"ID":"96cb08c2-a543-4f8a-8e70-3fe6b2c02998","Type":"ContainerStarted","Data":"0190dd178126c87c0812a9d0193bf9e2035c3985db48a63680eb723ea0ae3f28"} Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.004214 4769 generic.go:334] "Generic (PLEG): container finished" podID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerID="739487a08c3f56eb841a4aa9f85832f59ee9a56bcd24ffe0266b4d0f1ced8872" exitCode=0 Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.004242 4769 generic.go:334] "Generic (PLEG): container finished" podID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerID="b1b8bff43fa27df5a0a24e9028084e7676ea631ee795aa32055d47806dd782cf" exitCode=2 Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.004252 4769 generic.go:334] "Generic (PLEG): container finished" podID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerID="dbb4ec56096596aa7155bda123bb2479f6bd196fce3b6920908ff766249ff562" exitCode=0 Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.004268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerDied","Data":"739487a08c3f56eb841a4aa9f85832f59ee9a56bcd24ffe0266b4d0f1ced8872"} Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.004289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerDied","Data":"b1b8bff43fa27df5a0a24e9028084e7676ea631ee795aa32055d47806dd782cf"} Nov 21 12:38:49 crc kubenswrapper[4769]: I1121 12:38:49.004301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerDied","Data":"dbb4ec56096596aa7155bda123bb2479f6bd196fce3b6920908ff766249ff562"} Nov 21 12:38:50 crc kubenswrapper[4769]: I1121 12:38:50.040990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" event={"ID":"96cb08c2-a543-4f8a-8e70-3fe6b2c02998","Type":"ContainerStarted","Data":"5a286a7207d803214125f331757b926a6d3cc978313ad63da1425b15628d7c24"} Nov 21 12:38:50 crc kubenswrapper[4769]: I1121 12:38:50.041849 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:50 crc kubenswrapper[4769]: I1121 12:38:50.041912 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:50 crc kubenswrapper[4769]: I1121 12:38:50.049096 4769 generic.go:334] "Generic (PLEG): container finished" podID="3927663a-c253-4853-979f-e48092cc7809" containerID="0c73cae7cacd357226b059ee356f23d06715c53ca6779666056b711afed63ee2" exitCode=0 Nov 21 12:38:50 crc kubenswrapper[4769]: I1121 12:38:50.049165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" event={"ID":"3927663a-c253-4853-979f-e48092cc7809","Type":"ContainerDied","Data":"0c73cae7cacd357226b059ee356f23d06715c53ca6779666056b711afed63ee2"} Nov 21 12:38:50 crc kubenswrapper[4769]: I1121 12:38:50.074676 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" podStartSLOduration=3.074652367 podStartE2EDuration="3.074652367s" podCreationTimestamp="2025-11-21 12:38:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:50.065330276 +0000 UTC m=+2888.765992094" watchObservedRunningTime="2025-11-21 12:38:50.074652367 +0000 UTC m=+2888.775314195" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.402962 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.446798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-combined-ca-bundle\") pod \"3927663a-c253-4853-979f-e48092cc7809\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.446905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd8lc\" (UniqueName: \"kubernetes.io/projected/3927663a-c253-4853-979f-e48092cc7809-kube-api-access-vd8lc\") pod \"3927663a-c253-4853-979f-e48092cc7809\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.447068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-config\") pod \"3927663a-c253-4853-979f-e48092cc7809\" (UID: \"3927663a-c253-4853-979f-e48092cc7809\") " Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.453019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3927663a-c253-4853-979f-e48092cc7809-kube-api-access-vd8lc" (OuterVolumeSpecName: "kube-api-access-vd8lc") pod "3927663a-c253-4853-979f-e48092cc7809" (UID: "3927663a-c253-4853-979f-e48092cc7809"). InnerVolumeSpecName "kube-api-access-vd8lc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.480129 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-config" (OuterVolumeSpecName: "config") pod "3927663a-c253-4853-979f-e48092cc7809" (UID: "3927663a-c253-4853-979f-e48092cc7809"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.495658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3927663a-c253-4853-979f-e48092cc7809" (UID: "3927663a-c253-4853-979f-e48092cc7809"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.549758 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vd8lc\" (UniqueName: \"kubernetes.io/projected/3927663a-c253-4853-979f-e48092cc7809-kube-api-access-vd8lc\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.549814 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:51 crc kubenswrapper[4769]: I1121 12:38:51.549825 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3927663a-c253-4853-979f-e48092cc7809-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.076557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" event={"ID":"3927663a-c253-4853-979f-e48092cc7809","Type":"ContainerDied","Data":"da6f9dd3ee2cf976b423779ca628642aa1313f3cc9d4c741b4290ce70aa6e6fa"} Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.076597 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da6f9dd3ee2cf976b423779ca628642aa1313f3cc9d4c741b4290ce70aa6e6fa" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.076637 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-ljftr" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.303431 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44"] Nov 21 12:38:52 crc kubenswrapper[4769]: E1121 12:38:52.303945 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3927663a-c253-4853-979f-e48092cc7809" containerName="neutron-db-sync" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.303965 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3927663a-c253-4853-979f-e48092cc7809" containerName="neutron-db-sync" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.304267 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3927663a-c253-4853-979f-e48092cc7809" containerName="neutron-db-sync" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.305623 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.308778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.308929 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-4ckzl" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.310220 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.313589 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44"] Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.324672 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.364760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-combined-ca-bundle\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.364904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffft\" (UniqueName: \"kubernetes.io/projected/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-kube-api-access-cffft\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.364955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-config\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.365010 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-ovndb-tls-certs\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.365102 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-httpd-config\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.466712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cffft\" (UniqueName: \"kubernetes.io/projected/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-kube-api-access-cffft\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.466791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-config\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.466833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-ovndb-tls-certs\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.466884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-httpd-config\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.466989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-combined-ca-bundle\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.472024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-combined-ca-bundle\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.473908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-httpd-config\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.474565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-ovndb-tls-certs\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.486591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-config\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.489890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffft\" (UniqueName: \"kubernetes.io/projected/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-kube-api-access-cffft\") pod \"neutron-58b5cbd5fc-tzf44\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:52 crc kubenswrapper[4769]: I1121 12:38:52.625228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:53 crc kubenswrapper[4769]: I1121 12:38:53.115365 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44"] Nov 21 12:38:53 crc kubenswrapper[4769]: W1121 12:38:53.116402 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9689cfa_f59a_4e94_9e04_fc5d679d0bc4.slice/crio-36423caca731768947c8593fd040bc1b614b2ee43c13d0ccdebe7b188fdfec07 WatchSource:0}: Error finding container 36423caca731768947c8593fd040bc1b614b2ee43c13d0ccdebe7b188fdfec07: Status 404 returned error can't find the container with id 36423caca731768947c8593fd040bc1b614b2ee43c13d0ccdebe7b188fdfec07 Nov 21 12:38:53 crc kubenswrapper[4769]: I1121 12:38:53.249436 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:54 crc kubenswrapper[4769]: I1121 12:38:54.103685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" event={"ID":"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4","Type":"ContainerStarted","Data":"36423caca731768947c8593fd040bc1b614b2ee43c13d0ccdebe7b188fdfec07"} Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.037758 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-79b4b5654b-2zhqj"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.039347 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.042289 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.043130 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.064498 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-79b4b5654b-2zhqj"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.122620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx7gl\" (UniqueName: \"kubernetes.io/projected/857f2fcc-9d8d-4cad-9945-b8e62997525b-kube-api-access-vx7gl\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.122773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-combined-ca-bundle\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.122836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-httpd-config\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.122879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-internal-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.122897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-config\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.122922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-ovndb-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.123011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-public-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.127020 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-q9mqm"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.128368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.151216 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-q9mqm"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.190509 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-z8r69"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.191915 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.213782 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-z8r69"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-combined-ca-bundle\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2m28\" (UniqueName: \"kubernetes.io/projected/22eca770-9f56-41ee-ac28-d6f37b4b52e3-kube-api-access-n2m28\") pod \"nova-cell0-db-create-z8r69\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-httpd-config\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-internal-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-config\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-ovndb-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.224700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-public-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.225599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7bm8\" (UniqueName: \"kubernetes.io/projected/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-kube-api-access-z7bm8\") pod \"nova-api-db-create-q9mqm\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.225873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vx7gl\" (UniqueName: \"kubernetes.io/projected/857f2fcc-9d8d-4cad-9945-b8e62997525b-kube-api-access-vx7gl\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.225919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22eca770-9f56-41ee-ac28-d6f37b4b52e3-operator-scripts\") pod \"nova-cell0-db-create-z8r69\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.225937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-operator-scripts\") pod \"nova-api-db-create-q9mqm\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.232145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-internal-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.232252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-combined-ca-bundle\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.232319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-public-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.232637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-ovndb-tls-certs\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.233170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-httpd-config\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.240634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx7gl\" (UniqueName: \"kubernetes.io/projected/857f2fcc-9d8d-4cad-9945-b8e62997525b-kube-api-access-vx7gl\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.247080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-config\") pod \"neutron-79b4b5654b-2zhqj\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.310697 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-44j7w"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.311956 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.330761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22eca770-9f56-41ee-ac28-d6f37b4b52e3-operator-scripts\") pod \"nova-cell0-db-create-z8r69\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.331001 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-operator-scripts\") pod \"nova-api-db-create-q9mqm\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.331199 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n2m28\" (UniqueName: \"kubernetes.io/projected/22eca770-9f56-41ee-ac28-d6f37b4b52e3-kube-api-access-n2m28\") pod \"nova-cell0-db-create-z8r69\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.331312 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z7bm8\" (UniqueName: \"kubernetes.io/projected/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-kube-api-access-z7bm8\") pod \"nova-api-db-create-q9mqm\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.331501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22eca770-9f56-41ee-ac28-d6f37b4b52e3-operator-scripts\") pod \"nova-cell0-db-create-z8r69\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.332070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-operator-scripts\") pod \"nova-api-db-create-q9mqm\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.332371 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.334904 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.336694 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.343045 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.350819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2m28\" (UniqueName: \"kubernetes.io/projected/22eca770-9f56-41ee-ac28-d6f37b4b52e3-kube-api-access-n2m28\") pod \"nova-cell0-db-create-z8r69\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.351369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7bm8\" (UniqueName: \"kubernetes.io/projected/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-kube-api-access-z7bm8\") pod \"nova-api-db-create-q9mqm\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.355660 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-44j7w"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.358744 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.433366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z256g\" (UniqueName: \"kubernetes.io/projected/199ec800-d681-4746-adcb-bc43e6f91d3e-kube-api-access-z256g\") pod \"nova-api-2cdb-account-create-nx52v\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.433549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba104143-e793-4d5e-9c9e-85b2320d51c3-operator-scripts\") pod \"nova-cell1-db-create-44j7w\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.433575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tbs\" (UniqueName: \"kubernetes.io/projected/ba104143-e793-4d5e-9c9e-85b2320d51c3-kube-api-access-s9tbs\") pod \"nova-cell1-db-create-44j7w\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.433591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/199ec800-d681-4746-adcb-bc43e6f91d3e-operator-scripts\") pod \"nova-api-2cdb-account-create-nx52v\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.450006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.513302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.520009 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.521628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.529261 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.537512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba104143-e793-4d5e-9c9e-85b2320d51c3-operator-scripts\") pod \"nova-cell1-db-create-44j7w\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.537553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/199ec800-d681-4746-adcb-bc43e6f91d3e-operator-scripts\") pod \"nova-api-2cdb-account-create-nx52v\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.537578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tbs\" (UniqueName: \"kubernetes.io/projected/ba104143-e793-4d5e-9c9e-85b2320d51c3-kube-api-access-s9tbs\") pod \"nova-cell1-db-create-44j7w\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.537629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z256g\" (UniqueName: \"kubernetes.io/projected/199ec800-d681-4746-adcb-bc43e6f91d3e-kube-api-access-z256g\") pod \"nova-api-2cdb-account-create-nx52v\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.539105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/199ec800-d681-4746-adcb-bc43e6f91d3e-operator-scripts\") pod \"nova-api-2cdb-account-create-nx52v\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.539120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba104143-e793-4d5e-9c9e-85b2320d51c3-operator-scripts\") pod \"nova-cell1-db-create-44j7w\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.552655 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.611575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tbs\" (UniqueName: \"kubernetes.io/projected/ba104143-e793-4d5e-9c9e-85b2320d51c3-kube-api-access-s9tbs\") pod \"nova-cell1-db-create-44j7w\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.622138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z256g\" (UniqueName: \"kubernetes.io/projected/199ec800-d681-4746-adcb-bc43e6f91d3e-kube-api-access-z256g\") pod \"nova-api-2cdb-account-create-nx52v\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.640704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbs8g\" (UniqueName: \"kubernetes.io/projected/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-kube-api-access-cbs8g\") pod \"nova-cell0-14d7-account-create-mpckt\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.640791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-operator-scripts\") pod \"nova-cell0-14d7-account-create-mpckt\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.703776 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.705442 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.710233 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.733379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs"] Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.743297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-operator-scripts\") pod \"nova-cell1-3f2d-account-create-kfqhs\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.743429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcr7d\" (UniqueName: \"kubernetes.io/projected/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-kube-api-access-fcr7d\") pod \"nova-cell1-3f2d-account-create-kfqhs\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.743743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cbs8g\" (UniqueName: \"kubernetes.io/projected/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-kube-api-access-cbs8g\") pod \"nova-cell0-14d7-account-create-mpckt\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.743930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-operator-scripts\") pod \"nova-cell0-14d7-account-create-mpckt\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.745161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-operator-scripts\") pod \"nova-cell0-14d7-account-create-mpckt\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.762041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbs8g\" (UniqueName: \"kubernetes.io/projected/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-kube-api-access-cbs8g\") pod \"nova-cell0-14d7-account-create-mpckt\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.787315 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.844043 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.845899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fcr7d\" (UniqueName: \"kubernetes.io/projected/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-kube-api-access-fcr7d\") pod \"nova-cell1-3f2d-account-create-kfqhs\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.846077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-operator-scripts\") pod \"nova-cell1-3f2d-account-create-kfqhs\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.846742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-operator-scripts\") pod \"nova-cell1-3f2d-account-create-kfqhs\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.869716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcr7d\" (UniqueName: \"kubernetes.io/projected/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-kube-api-access-fcr7d\") pod \"nova-cell1-3f2d-account-create-kfqhs\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.869818 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:38:55 crc kubenswrapper[4769]: I1121 12:38:55.881012 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-79b4b5654b-2zhqj"] Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.036931 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.075056 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-q9mqm"] Nov 21 12:38:56 crc kubenswrapper[4769]: W1121 12:38:56.086803 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7fe74c0_1fa2_43d4_9983_3b7f3f471c05.slice/crio-9ee62aff148a9307022e83a8488d14cd9bea48bec2fdd6f5939a13a00186e586 WatchSource:0}: Error finding container 9ee62aff148a9307022e83a8488d14cd9bea48bec2fdd6f5939a13a00186e586: Status 404 returned error can't find the container with id 9ee62aff148a9307022e83a8488d14cd9bea48bec2fdd6f5939a13a00186e586 Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.127347 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-z8r69"] Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.130068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" event={"ID":"857f2fcc-9d8d-4cad-9945-b8e62997525b","Type":"ContainerStarted","Data":"2a30590f7cfcc69872520bbd150400dcb2fc290a6929edaa3377dc7df07b1eda"} Nov 21 12:38:56 crc kubenswrapper[4769]: W1121 12:38:56.130204 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22eca770_9f56_41ee_ac28_d6f37b4b52e3.slice/crio-dd9330a3def0e2acff8fef2e5fdf71c1b4a5df4e9c0305a84e8789ffd2ab4585 WatchSource:0}: Error finding container dd9330a3def0e2acff8fef2e5fdf71c1b4a5df4e9c0305a84e8789ffd2ab4585: Status 404 returned error can't find the container with id dd9330a3def0e2acff8fef2e5fdf71c1b4a5df4e9c0305a84e8789ffd2ab4585 Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.132609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" event={"ID":"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05","Type":"ContainerStarted","Data":"9ee62aff148a9307022e83a8488d14cd9bea48bec2fdd6f5939a13a00186e586"} Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.324413 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-44j7w"] Nov 21 12:38:56 crc kubenswrapper[4769]: W1121 12:38:56.333885 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod199ec800_d681_4746_adcb_bc43e6f91d3e.slice/crio-e93d915524ffa38c738d3cc8529f5673b3a71b115ae8b553588f19fe6af582b4 WatchSource:0}: Error finding container e93d915524ffa38c738d3cc8529f5673b3a71b115ae8b553588f19fe6af582b4: Status 404 returned error can't find the container with id e93d915524ffa38c738d3cc8529f5673b3a71b115ae8b553588f19fe6af582b4 Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.342610 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v"] Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.511367 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt"] Nov 21 12:38:56 crc kubenswrapper[4769]: I1121 12:38:56.626435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs"] Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.143888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" event={"ID":"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0","Type":"ContainerStarted","Data":"a519a861272b99d1e0c60db5bac9fafdf14865a5a15bca92e286e64e329c20f1"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.144487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" event={"ID":"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0","Type":"ContainerStarted","Data":"bd80b108cc2021cf32497418fdc12e29fd8628dabfb1de5faf37de5c0f420fee"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.149646 4769 generic.go:334] "Generic (PLEG): container finished" podID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerID="9916c21f25d7b6380cdfbdbdcfe44b28a191cb262961f6362ac168bacb4c16c4" exitCode=0 Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.149689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerDied","Data":"9916c21f25d7b6380cdfbdbdcfe44b28a191cb262961f6362ac168bacb4c16c4"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.151084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" event={"ID":"c0d68f8c-7883-4b21-aeca-2adce9cca4a6","Type":"ContainerStarted","Data":"80351b626483f01999e80989157153661002afd4c23fc1c31259341a54b36dcf"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.151108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" event={"ID":"c0d68f8c-7883-4b21-aeca-2adce9cca4a6","Type":"ContainerStarted","Data":"ef6d83707f075b1b263008152ab775d7cc4a4ac436a7eb95a267c83941cc22a8"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.152128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" event={"ID":"857f2fcc-9d8d-4cad-9945-b8e62997525b","Type":"ContainerStarted","Data":"010d2d75e0547988836316bace3c069b5bf5662168a019571a27d806ae524ed3"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.153999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" event={"ID":"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05","Type":"ContainerStarted","Data":"2f65b0f763dfc4859f7c13f5557d2c9ca783cb0d1c7df074200c92d8eeef6158"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.155318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" event={"ID":"22eca770-9f56-41ee-ac28-d6f37b4b52e3","Type":"ContainerStarted","Data":"022dd433ccea512d5c5390a08c32ebd23f6437a3d74f55d4e3cced8338a6da6f"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.155342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" event={"ID":"22eca770-9f56-41ee-ac28-d6f37b4b52e3","Type":"ContainerStarted","Data":"dd9330a3def0e2acff8fef2e5fdf71c1b4a5df4e9c0305a84e8789ffd2ab4585"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.157692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" event={"ID":"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4","Type":"ContainerStarted","Data":"111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.159795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" event={"ID":"199ec800-d681-4746-adcb-bc43e6f91d3e","Type":"ContainerStarted","Data":"233ea3996215f8cbe2ec9d0ae64b6cda9ffcea14e51e455859c082b6ae160e16"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.159827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" event={"ID":"199ec800-d681-4746-adcb-bc43e6f91d3e","Type":"ContainerStarted","Data":"e93d915524ffa38c738d3cc8529f5673b3a71b115ae8b553588f19fe6af582b4"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.165939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" event={"ID":"ba104143-e793-4d5e-9c9e-85b2320d51c3","Type":"ContainerStarted","Data":"bc221043d89eea757aeefab2d26c9f7d767f99de08e643e371fb3a44d00ae71e"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.165965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" event={"ID":"ba104143-e793-4d5e-9c9e-85b2320d51c3","Type":"ContainerStarted","Data":"d9c9836299a023a02453beeb9ef62cf837ee906b59d0d6f024f3a6777086cff5"} Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.167379 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" podStartSLOduration=2.167359588 podStartE2EDuration="2.167359588s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:57.161788518 +0000 UTC m=+2895.862450336" watchObservedRunningTime="2025-11-21 12:38:57.167359588 +0000 UTC m=+2895.868021396" Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.181525 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" podStartSLOduration=2.1815073480000002 podStartE2EDuration="2.181507348s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:57.17523497 +0000 UTC m=+2895.875896788" watchObservedRunningTime="2025-11-21 12:38:57.181507348 +0000 UTC m=+2895.882169166" Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.197814 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" podStartSLOduration=2.197790766 podStartE2EDuration="2.197790766s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:57.18899161 +0000 UTC m=+2895.889653428" watchObservedRunningTime="2025-11-21 12:38:57.197790766 +0000 UTC m=+2895.898452584" Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.205423 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" podStartSLOduration=2.205406631 podStartE2EDuration="2.205406631s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:57.202709689 +0000 UTC m=+2895.903371507" watchObservedRunningTime="2025-11-21 12:38:57.205406631 +0000 UTC m=+2895.906068449" Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.228569 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" podStartSLOduration=2.228552584 podStartE2EDuration="2.228552584s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:57.220953079 +0000 UTC m=+2895.921614917" watchObservedRunningTime="2025-11-21 12:38:57.228552584 +0000 UTC m=+2895.929214402" Nov 21 12:38:57 crc kubenswrapper[4769]: I1121 12:38:57.237217 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" podStartSLOduration=2.237181516 podStartE2EDuration="2.237181516s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:57.23621525 +0000 UTC m=+2895.936877068" watchObservedRunningTime="2025-11-21 12:38:57.237181516 +0000 UTC m=+2895.937843334" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.018911 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.122680 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-log-httpd\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.122740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-combined-ca-bundle\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.122925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-run-httpd\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.122962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wcsb\" (UniqueName: \"kubernetes.io/projected/21a7bbcd-15a8-4653-8096-ba923625fc88-kube-api-access-4wcsb\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.122988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-config-data\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.123057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-scripts\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.123094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-sg-core-conf-yaml\") pod \"21a7bbcd-15a8-4653-8096-ba923625fc88\" (UID: \"21a7bbcd-15a8-4653-8096-ba923625fc88\") " Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.123110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.123686 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.123810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.130495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-scripts" (OuterVolumeSpecName: "scripts") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.130923 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a7bbcd-15a8-4653-8096-ba923625fc88-kube-api-access-4wcsb" (OuterVolumeSpecName: "kube-api-access-4wcsb") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "kube-api-access-4wcsb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.157330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.181398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" event={"ID":"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4","Type":"ContainerStarted","Data":"3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889"} Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.181553 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.196836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"21a7bbcd-15a8-4653-8096-ba923625fc88","Type":"ContainerDied","Data":"f91d9bc71193ae065531ab4292e53a6a60356e5f3d44c7b8fd49e3262a5cea09"} Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.196987 4769 scope.go:117] "RemoveContainer" containerID="739487a08c3f56eb841a4aa9f85832f59ee9a56bcd24ffe0266b4d0f1ced8872" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.197180 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.238216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" event={"ID":"857f2fcc-9d8d-4cad-9945-b8e62997525b","Type":"ContainerStarted","Data":"5485cdb6e4522d9d7b3eef3e7cc920816967583ab4c38f53b4f8cd80eaf4da22"} Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.241096 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.262233 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.276654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.279439 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" podStartSLOduration=3.279415998 podStartE2EDuration="3.279415998s" podCreationTimestamp="2025-11-21 12:38:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:58.262175244 +0000 UTC m=+2896.962837062" watchObservedRunningTime="2025-11-21 12:38:58.279415998 +0000 UTC m=+2896.980077816" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.290565 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/21a7bbcd-15a8-4653-8096-ba923625fc88-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.290615 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4wcsb\" (UniqueName: \"kubernetes.io/projected/21a7bbcd-15a8-4653-8096-ba923625fc88-kube-api-access-4wcsb\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.290631 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.290644 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.308640 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" podStartSLOduration=6.308612263 podStartE2EDuration="6.308612263s" podCreationTimestamp="2025-11-21 12:38:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:38:58.222826636 +0000 UTC m=+2896.923488454" watchObservedRunningTime="2025-11-21 12:38:58.308612263 +0000 UTC m=+2897.009274081" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.329465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-config-data" (OuterVolumeSpecName: "config-data") pod "21a7bbcd-15a8-4653-8096-ba923625fc88" (UID: "21a7bbcd-15a8-4653-8096-ba923625fc88"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.396766 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.396964 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21a7bbcd-15a8-4653-8096-ba923625fc88-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.432962 4769 scope.go:117] "RemoveContainer" containerID="b1b8bff43fa27df5a0a24e9028084e7676ea631ee795aa32055d47806dd782cf" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.452479 4769 scope.go:117] "RemoveContainer" containerID="9916c21f25d7b6380cdfbdbdcfe44b28a191cb262961f6362ac168bacb4c16c4" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.533753 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.542396 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.561761 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:38:58 crc kubenswrapper[4769]: E1121 12:38:58.562355 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-central-agent" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-central-agent" Nov 21 12:38:58 crc kubenswrapper[4769]: E1121 12:38:58.562402 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="sg-core" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562410 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="sg-core" Nov 21 12:38:58 crc kubenswrapper[4769]: E1121 12:38:58.562429 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-notification-agent" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562437 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-notification-agent" Nov 21 12:38:58 crc kubenswrapper[4769]: E1121 12:38:58.562460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="proxy-httpd" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562468 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="proxy-httpd" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562705 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="proxy-httpd" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562730 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-notification-agent" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562767 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="ceilometer-central-agent" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.562781 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" containerName="sg-core" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.566161 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.568999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.569059 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.574297 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.702963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-config-data\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.703008 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-scripts\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.703141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.703221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqfs\" (UniqueName: \"kubernetes.io/projected/af2c762f-a2c7-4b78-bbb3-8c39e306b851-kube-api-access-mlqfs\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.703530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.703590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-log-httpd\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.703628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-run-httpd\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.736305 4769 scope.go:117] "RemoveContainer" containerID="dbb4ec56096596aa7155bda123bb2479f6bd196fce3b6920908ff766249ff562" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.805912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-config-data\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.805965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-scripts\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.805994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.806013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqfs\" (UniqueName: \"kubernetes.io/projected/af2c762f-a2c7-4b78-bbb3-8c39e306b851-kube-api-access-mlqfs\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.806096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.806120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-log-httpd\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.806141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-run-httpd\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.806704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-log-httpd\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.806800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-run-httpd\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.810918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.811582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.812286 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-scripts\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.813683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-config-data\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.826511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqfs\" (UniqueName: \"kubernetes.io/projected/af2c762f-a2c7-4b78-bbb3-8c39e306b851-kube-api-access-mlqfs\") pod \"ceilometer-0\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:58 crc kubenswrapper[4769]: I1121 12:38:58.903961 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:38:59 crc kubenswrapper[4769]: I1121 12:38:59.290948 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a7bbcd-15a8-4653-8096-ba923625fc88" path="/var/lib/kubelet/pods/21a7bbcd-15a8-4653-8096-ba923625fc88/volumes" Nov 21 12:38:59 crc kubenswrapper[4769]: I1121 12:38:59.369297 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.227663 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.227911 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-log" containerID="cri-o://c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e" gracePeriod=30 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.228622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-httpd" containerID="cri-o://b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592" gracePeriod=30 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.269636 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" containerID="2f65b0f763dfc4859f7c13f5557d2c9ca783cb0d1c7df074200c92d8eeef6158" exitCode=0 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.269698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" event={"ID":"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05","Type":"ContainerDied","Data":"2f65b0f763dfc4859f7c13f5557d2c9ca783cb0d1c7df074200c92d8eeef6158"} Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.274491 4769 generic.go:334] "Generic (PLEG): container finished" podID="22eca770-9f56-41ee-ac28-d6f37b4b52e3" containerID="022dd433ccea512d5c5390a08c32ebd23f6437a3d74f55d4e3cced8338a6da6f" exitCode=0 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.274560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" event={"ID":"22eca770-9f56-41ee-ac28-d6f37b4b52e3","Type":"ContainerDied","Data":"022dd433ccea512d5c5390a08c32ebd23f6437a3d74f55d4e3cced8338a6da6f"} Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.279501 4769 generic.go:334] "Generic (PLEG): container finished" podID="ba104143-e793-4d5e-9c9e-85b2320d51c3" containerID="bc221043d89eea757aeefab2d26c9f7d767f99de08e643e371fb3a44d00ae71e" exitCode=0 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.279590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" event={"ID":"ba104143-e793-4d5e-9c9e-85b2320d51c3","Type":"ContainerDied","Data":"bc221043d89eea757aeefab2d26c9f7d767f99de08e643e371fb3a44d00ae71e"} Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.281246 4769 generic.go:334] "Generic (PLEG): container finished" podID="199ec800-d681-4746-adcb-bc43e6f91d3e" containerID="233ea3996215f8cbe2ec9d0ae64b6cda9ffcea14e51e455859c082b6ae160e16" exitCode=0 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.281338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" event={"ID":"199ec800-d681-4746-adcb-bc43e6f91d3e","Type":"ContainerDied","Data":"233ea3996215f8cbe2ec9d0ae64b6cda9ffcea14e51e455859c082b6ae160e16"} Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.283215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerStarted","Data":"43ab8d30d2f9dde51258bc2f80b0e94d788da39bef37f2998f5c46ba6b1175b8"} Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.288031 4769 generic.go:334] "Generic (PLEG): container finished" podID="4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" containerID="a519a861272b99d1e0c60db5bac9fafdf14865a5a15bca92e286e64e329c20f1" exitCode=0 Nov 21 12:39:00 crc kubenswrapper[4769]: I1121 12:39:00.288072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" event={"ID":"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0","Type":"ContainerDied","Data":"a519a861272b99d1e0c60db5bac9fafdf14865a5a15bca92e286e64e329c20f1"} Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.236993 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.238377 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-log" containerID="cri-o://edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9" gracePeriod=30 Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.238927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-httpd" containerID="cri-o://dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c" gracePeriod=30 Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.335595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerStarted","Data":"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af"} Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.337546 4769 generic.go:334] "Generic (PLEG): container finished" podID="c0d68f8c-7883-4b21-aeca-2adce9cca4a6" containerID="80351b626483f01999e80989157153661002afd4c23fc1c31259341a54b36dcf" exitCode=0 Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.337587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" event={"ID":"c0d68f8c-7883-4b21-aeca-2adce9cca4a6","Type":"ContainerDied","Data":"80351b626483f01999e80989157153661002afd4c23fc1c31259341a54b36dcf"} Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.342942 4769 generic.go:334] "Generic (PLEG): container finished" podID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerID="c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e" exitCode=143 Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.343299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6fc4390c-b3dc-4f10-b414-612efd74c1e7","Type":"ContainerDied","Data":"c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e"} Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.652384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:01 crc kubenswrapper[4769]: I1121 12:39:01.946432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.054085 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.067114 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.073791 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.082223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba104143-e793-4d5e-9c9e-85b2320d51c3-operator-scripts\") pod \"ba104143-e793-4d5e-9c9e-85b2320d51c3\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.082435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9tbs\" (UniqueName: \"kubernetes.io/projected/ba104143-e793-4d5e-9c9e-85b2320d51c3-kube-api-access-s9tbs\") pod \"ba104143-e793-4d5e-9c9e-85b2320d51c3\" (UID: \"ba104143-e793-4d5e-9c9e-85b2320d51c3\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.086575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba104143-e793-4d5e-9c9e-85b2320d51c3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ba104143-e793-4d5e-9c9e-85b2320d51c3" (UID: "ba104143-e793-4d5e-9c9e-85b2320d51c3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.087707 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ba104143-e793-4d5e-9c9e-85b2320d51c3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.096681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba104143-e793-4d5e-9c9e-85b2320d51c3-kube-api-access-s9tbs" (OuterVolumeSpecName: "kube-api-access-s9tbs") pod "ba104143-e793-4d5e-9c9e-85b2320d51c3" (UID: "ba104143-e793-4d5e-9c9e-85b2320d51c3"). InnerVolumeSpecName "kube-api-access-s9tbs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.097618 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.189586 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z256g\" (UniqueName: \"kubernetes.io/projected/199ec800-d681-4746-adcb-bc43e6f91d3e-kube-api-access-z256g\") pod \"199ec800-d681-4746-adcb-bc43e6f91d3e\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.189691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2m28\" (UniqueName: \"kubernetes.io/projected/22eca770-9f56-41ee-ac28-d6f37b4b52e3-kube-api-access-n2m28\") pod \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.189774 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7bm8\" (UniqueName: \"kubernetes.io/projected/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-kube-api-access-z7bm8\") pod \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.189819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-operator-scripts\") pod \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\" (UID: \"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.189852 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22eca770-9f56-41ee-ac28-d6f37b4b52e3-operator-scripts\") pod \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\" (UID: \"22eca770-9f56-41ee-ac28-d6f37b4b52e3\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.190134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/199ec800-d681-4746-adcb-bc43e6f91d3e-operator-scripts\") pod \"199ec800-d681-4746-adcb-bc43e6f91d3e\" (UID: \"199ec800-d681-4746-adcb-bc43e6f91d3e\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.192076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" (UID: "d7fe74c0-1fa2-43d4-9983-3b7f3f471c05"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.192282 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22eca770-9f56-41ee-ac28-d6f37b4b52e3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "22eca770-9f56-41ee-ac28-d6f37b4b52e3" (UID: "22eca770-9f56-41ee-ac28-d6f37b4b52e3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.192412 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s9tbs\" (UniqueName: \"kubernetes.io/projected/ba104143-e793-4d5e-9c9e-85b2320d51c3-kube-api-access-s9tbs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.192424 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.192433 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22eca770-9f56-41ee-ac28-d6f37b4b52e3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.193411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199ec800-d681-4746-adcb-bc43e6f91d3e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "199ec800-d681-4746-adcb-bc43e6f91d3e" (UID: "199ec800-d681-4746-adcb-bc43e6f91d3e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.197096 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-kube-api-access-z7bm8" (OuterVolumeSpecName: "kube-api-access-z7bm8") pod "d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" (UID: "d7fe74c0-1fa2-43d4-9983-3b7f3f471c05"). InnerVolumeSpecName "kube-api-access-z7bm8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.197423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22eca770-9f56-41ee-ac28-d6f37b4b52e3-kube-api-access-n2m28" (OuterVolumeSpecName: "kube-api-access-n2m28") pod "22eca770-9f56-41ee-ac28-d6f37b4b52e3" (UID: "22eca770-9f56-41ee-ac28-d6f37b4b52e3"). InnerVolumeSpecName "kube-api-access-n2m28". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.197459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199ec800-d681-4746-adcb-bc43e6f91d3e-kube-api-access-z256g" (OuterVolumeSpecName: "kube-api-access-z256g") pod "199ec800-d681-4746-adcb-bc43e6f91d3e" (UID: "199ec800-d681-4746-adcb-bc43e6f91d3e"). InnerVolumeSpecName "kube-api-access-z256g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.293395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-operator-scripts\") pod \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.293649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcr7d\" (UniqueName: \"kubernetes.io/projected/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-kube-api-access-fcr7d\") pod \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\" (UID: \"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0\") " Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.294259 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/199ec800-d681-4746-adcb-bc43e6f91d3e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.294298 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z256g\" (UniqueName: \"kubernetes.io/projected/199ec800-d681-4746-adcb-bc43e6f91d3e-kube-api-access-z256g\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.294316 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n2m28\" (UniqueName: \"kubernetes.io/projected/22eca770-9f56-41ee-ac28-d6f37b4b52e3-kube-api-access-n2m28\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.294330 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z7bm8\" (UniqueName: \"kubernetes.io/projected/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05-kube-api-access-z7bm8\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.295105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" (UID: "4f1b4d1d-b8ab-4686-b77c-d049aaa758b0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.299483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-kube-api-access-fcr7d" (OuterVolumeSpecName: "kube-api-access-fcr7d") pod "4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" (UID: "4f1b4d1d-b8ab-4686-b77c-d049aaa758b0"). InnerVolumeSpecName "kube-api-access-fcr7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.360135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" event={"ID":"22eca770-9f56-41ee-ac28-d6f37b4b52e3","Type":"ContainerDied","Data":"dd9330a3def0e2acff8fef2e5fdf71c1b4a5df4e9c0305a84e8789ffd2ab4585"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.360174 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd9330a3def0e2acff8fef2e5fdf71c1b4a5df4e9c0305a84e8789ffd2ab4585" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.360273 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-z8r69" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.367395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" event={"ID":"ba104143-e793-4d5e-9c9e-85b2320d51c3","Type":"ContainerDied","Data":"d9c9836299a023a02453beeb9ef62cf837ee906b59d0d6f024f3a6777086cff5"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.367700 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9c9836299a023a02453beeb9ef62cf837ee906b59d0d6f024f3a6777086cff5" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.367674 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-44j7w" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.372930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" event={"ID":"199ec800-d681-4746-adcb-bc43e6f91d3e","Type":"ContainerDied","Data":"e93d915524ffa38c738d3cc8529f5673b3a71b115ae8b553588f19fe6af582b4"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.372965 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e93d915524ffa38c738d3cc8529f5673b3a71b115ae8b553588f19fe6af582b4" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.373012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.396723 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fcr7d\" (UniqueName: \"kubernetes.io/projected/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-kube-api-access-fcr7d\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.396750 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.400086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerStarted","Data":"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.404572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" event={"ID":"4f1b4d1d-b8ab-4686-b77c-d049aaa758b0","Type":"ContainerDied","Data":"bd80b108cc2021cf32497418fdc12e29fd8628dabfb1de5faf37de5c0f420fee"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.404612 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd80b108cc2021cf32497418fdc12e29fd8628dabfb1de5faf37de5c0f420fee" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.404584 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.407722 4769 generic.go:334] "Generic (PLEG): container finished" podID="4244ba1d-befe-499c-a473-a8d123345bef" containerID="edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9" exitCode=143 Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.407811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4244ba1d-befe-499c-a473-a8d123345bef","Type":"ContainerDied","Data":"edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.409396 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.409406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-q9mqm" event={"ID":"d7fe74c0-1fa2-43d4-9983-3b7f3f471c05","Type":"ContainerDied","Data":"9ee62aff148a9307022e83a8488d14cd9bea48bec2fdd6f5939a13a00186e586"} Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.409455 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ee62aff148a9307022e83a8488d14cd9bea48bec2fdd6f5939a13a00186e586" Nov 21 12:39:02 crc kubenswrapper[4769]: I1121 12:39:02.812435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.007743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbs8g\" (UniqueName: \"kubernetes.io/projected/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-kube-api-access-cbs8g\") pod \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.007912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-operator-scripts\") pod \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\" (UID: \"c0d68f8c-7883-4b21-aeca-2adce9cca4a6\") " Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.008558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c0d68f8c-7883-4b21-aeca-2adce9cca4a6" (UID: "c0d68f8c-7883-4b21-aeca-2adce9cca4a6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.013587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-kube-api-access-cbs8g" (OuterVolumeSpecName: "kube-api-access-cbs8g") pod "c0d68f8c-7883-4b21-aeca-2adce9cca4a6" (UID: "c0d68f8c-7883-4b21-aeca-2adce9cca4a6"). InnerVolumeSpecName "kube-api-access-cbs8g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.109906 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cbs8g\" (UniqueName: \"kubernetes.io/projected/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-kube-api-access-cbs8g\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.110237 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0d68f8c-7883-4b21-aeca-2adce9cca4a6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.423256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerStarted","Data":"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0"} Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.425565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" event={"ID":"c0d68f8c-7883-4b21-aeca-2adce9cca4a6","Type":"ContainerDied","Data":"ef6d83707f075b1b263008152ab775d7cc4a4ac436a7eb95a267c83941cc22a8"} Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.425614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.425621 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef6d83707f075b1b263008152ab775d7cc4a4ac436a7eb95a267c83941cc22a8" Nov 21 12:39:03 crc kubenswrapper[4769]: I1121 12:39:03.917414 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-httpd-run\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-config-data\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032519 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-combined-ca-bundle\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032544 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hzq7\" (UniqueName: \"kubernetes.io/projected/6fc4390c-b3dc-4f10-b414-612efd74c1e7-kube-api-access-8hzq7\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032607 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-logs\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-public-tls-certs\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-scripts\") pod \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\" (UID: \"6fc4390c-b3dc-4f10-b414-612efd74c1e7\") " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.032979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.033095 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.033841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-logs" (OuterVolumeSpecName: "logs") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.041083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.041082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fc4390c-b3dc-4f10-b414-612efd74c1e7-kube-api-access-8hzq7" (OuterVolumeSpecName: "kube-api-access-8hzq7") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "kube-api-access-8hzq7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.041238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-scripts" (OuterVolumeSpecName: "scripts") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.079439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.106392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-config-data" (OuterVolumeSpecName: "config-data") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.113106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6fc4390c-b3dc-4f10-b414-612efd74c1e7" (UID: "6fc4390c-b3dc-4f10-b414-612efd74c1e7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.137807 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.137898 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.137917 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8hzq7\" (UniqueName: \"kubernetes.io/projected/6fc4390c-b3dc-4f10-b414-612efd74c1e7-kube-api-access-8hzq7\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.137931 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fc4390c-b3dc-4f10-b414-612efd74c1e7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.137976 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.137990 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.138003 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fc4390c-b3dc-4f10-b414-612efd74c1e7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.168426 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.241300 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.435909 4769 generic.go:334] "Generic (PLEG): container finished" podID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerID="b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592" exitCode=0 Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.435968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6fc4390c-b3dc-4f10-b414-612efd74c1e7","Type":"ContainerDied","Data":"b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592"} Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.435998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6fc4390c-b3dc-4f10-b414-612efd74c1e7","Type":"ContainerDied","Data":"29ad80ed23891bb8ed713f0bcf78093cce28a784d4678f743e1e8d1c03f66b71"} Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.436015 4769 scope.go:117] "RemoveContainer" containerID="b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.436131 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.441873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerStarted","Data":"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b"} Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.441995 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-central-agent" containerID="cri-o://2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" gracePeriod=30 Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.442232 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.442274 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="proxy-httpd" containerID="cri-o://fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" gracePeriod=30 Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.442319 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="sg-core" containerID="cri-o://5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" gracePeriod=30 Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.442352 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-notification-agent" containerID="cri-o://123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" gracePeriod=30 Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.463315 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.21617647 podStartE2EDuration="6.463291284s" podCreationTimestamp="2025-11-21 12:38:58 +0000 UTC" firstStartedPulling="2025-11-21 12:38:59.380111233 +0000 UTC m=+2898.080773051" lastFinishedPulling="2025-11-21 12:39:03.627226047 +0000 UTC m=+2902.327887865" observedRunningTime="2025-11-21 12:39:04.462106162 +0000 UTC m=+2903.162767970" watchObservedRunningTime="2025-11-21 12:39:04.463291284 +0000 UTC m=+2903.163953102" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.584291 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.592854 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606356 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606729 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ba104143-e793-4d5e-9c9e-85b2320d51c3" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606742 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba104143-e793-4d5e-9c9e-85b2320d51c3" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606763 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="22eca770-9f56-41ee-ac28-d6f37b4b52e3" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606770 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="22eca770-9f56-41ee-ac28-d6f37b4b52e3" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606783 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-httpd" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606789 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-httpd" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606800 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-log" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606806 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-log" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="199ec800-d681-4746-adcb-bc43e6f91d3e" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="199ec800-d681-4746-adcb-bc43e6f91d3e" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606854 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c0d68f8c-7883-4b21-aeca-2adce9cca4a6" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606860 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d68f8c-7883-4b21-aeca-2adce9cca4a6" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606868 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606874 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.606884 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.606889 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607070 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="22eca770-9f56-41ee-ac28-d6f37b4b52e3" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607083 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c0d68f8c-7883-4b21-aeca-2adce9cca4a6" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607095 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="199ec800-d681-4746-adcb-bc43e6f91d3e" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607111 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-log" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607119 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607129 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" containerName="glance-httpd" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607140 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ba104143-e793-4d5e-9c9e-85b2320d51c3" containerName="mariadb-database-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.607149 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" containerName="mariadb-account-create" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.611059 4769 scope.go:117] "RemoveContainer" containerID="c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.614122 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.617723 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.618081 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.637937 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.667398 4769 scope.go:117] "RemoveContainer" containerID="b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.676644 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592\": container with ID starting with b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592 not found: ID does not exist" containerID="b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.676685 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592"} err="failed to get container status \"b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592\": rpc error: code = NotFound desc = could not find container \"b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592\": container with ID starting with b0cfa195915ba865ce27167652992314e9909420e157f9c304c0b954f58a6592 not found: ID does not exist" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.676709 4769 scope.go:117] "RemoveContainer" containerID="c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e" Nov 21 12:39:04 crc kubenswrapper[4769]: E1121 12:39:04.676969 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e\": container with ID starting with c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e not found: ID does not exist" containerID="c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.676986 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e"} err="failed to get container status \"c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e\": rpc error: code = NotFound desc = could not find container \"c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e\": container with ID starting with c025e5798cb5cec7d4186a46817d098cf157c76a46a1ebb00bfea45b40aadb7e not found: ID does not exist" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.761293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-config-data\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.761346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.761368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.761552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-scripts\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.761650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q5wf\" (UniqueName: \"kubernetes.io/projected/28df21b3-2a77-4353-8fac-3fa307992568-kube-api-access-9q5wf\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.761984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.762105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-logs\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.762249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-scripts\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9q5wf\" (UniqueName: \"kubernetes.io/projected/28df21b3-2a77-4353-8fac-3fa307992568-kube-api-access-9q5wf\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865378 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-logs\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865447 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-config-data\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.865570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.866752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.867025 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.870613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-logs\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.885201 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.886402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-config-data\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.887107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.887761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-scripts\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.897817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q5wf\" (UniqueName: \"kubernetes.io/projected/28df21b3-2a77-4353-8fac-3fa307992568-kube-api-access-9q5wf\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.910607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"glance-default-external-api-0\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:04 crc kubenswrapper[4769]: I1121 12:39:04.961231 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.004815 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.173851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-config-data\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.174556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-scripts\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.175038 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-internal-tls-certs\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.175092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-logs\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.175247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-combined-ca-bundle\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.175270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.175302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-httpd-run\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.175356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wf92\" (UniqueName: \"kubernetes.io/projected/4244ba1d-befe-499c-a473-a8d123345bef-kube-api-access-8wf92\") pod \"4244ba1d-befe-499c-a473-a8d123345bef\" (UID: \"4244ba1d-befe-499c-a473-a8d123345bef\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.180855 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-logs" (OuterVolumeSpecName: "logs") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.181766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.182468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-scripts" (OuterVolumeSpecName: "scripts") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.200602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.200750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4244ba1d-befe-499c-a473-a8d123345bef-kube-api-access-8wf92" (OuterVolumeSpecName: "kube-api-access-8wf92") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "kube-api-access-8wf92". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.244456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.266708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277440 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277482 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277496 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277508 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8wf92\" (UniqueName: \"kubernetes.io/projected/4244ba1d-befe-499c-a473-a8d123345bef-kube-api-access-8wf92\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277522 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277535 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.277545 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4244ba1d-befe-499c-a473-a8d123345bef-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.316781 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fc4390c-b3dc-4f10-b414-612efd74c1e7" path="/var/lib/kubelet/pods/6fc4390c-b3dc-4f10-b414-612efd74c1e7/volumes" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.317846 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.323765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-config-data" (OuterVolumeSpecName: "config-data") pod "4244ba1d-befe-499c-a473-a8d123345bef" (UID: "4244ba1d-befe-499c-a473-a8d123345bef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.378862 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.378885 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4244ba1d-befe-499c-a473-a8d123345bef-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.437086 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.464399 4769 generic.go:334] "Generic (PLEG): container finished" podID="4244ba1d-befe-499c-a473-a8d123345bef" containerID="dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c" exitCode=0 Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.464462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4244ba1d-befe-499c-a473-a8d123345bef","Type":"ContainerDied","Data":"dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.464490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4244ba1d-befe-499c-a473-a8d123345bef","Type":"ContainerDied","Data":"6b2868a666e3c12d69ff3d6a61ecd0cda7231c324914b8a942aef7f39469e1cc"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.464506 4769 scope.go:117] "RemoveContainer" containerID="dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.464641 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503677 4769 generic.go:334] "Generic (PLEG): container finished" podID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" exitCode=0 Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503719 4769 generic.go:334] "Generic (PLEG): container finished" podID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" exitCode=2 Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503728 4769 generic.go:334] "Generic (PLEG): container finished" podID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" exitCode=0 Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503736 4769 generic.go:334] "Generic (PLEG): container finished" podID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" exitCode=0 Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503756 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerDied","Data":"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerDied","Data":"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerDied","Data":"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerDied","Data":"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"af2c762f-a2c7-4b78-bbb3-8c39e306b851","Type":"ContainerDied","Data":"43ab8d30d2f9dde51258bc2f80b0e94d788da39bef37f2998f5c46ba6b1175b8"} Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.503915 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.558396 4769 scope.go:117] "RemoveContainer" containerID="edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.605824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-run-httpd\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.605904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-combined-ca-bundle\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.605934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-scripts\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.606047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-log-httpd\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.606078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlqfs\" (UniqueName: \"kubernetes.io/projected/af2c762f-a2c7-4b78-bbb3-8c39e306b851-kube-api-access-mlqfs\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.606101 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-config-data\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.606215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-sg-core-conf-yaml\") pod \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\" (UID: \"af2c762f-a2c7-4b78-bbb3-8c39e306b851\") " Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.611005 4769 scope.go:117] "RemoveContainer" containerID="dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.612064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.612158 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c\": container with ID starting with dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c not found: ID does not exist" containerID="dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.612200 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c"} err="failed to get container status \"dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c\": rpc error: code = NotFound desc = could not find container \"dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c\": container with ID starting with dc687dccc4de07f00f3747be2b25844a00e35d1053b20f2c2c37080cee23097c not found: ID does not exist" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.612221 4769 scope.go:117] "RemoveContainer" containerID="edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.612713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.612866 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9\": container with ID starting with edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9 not found: ID does not exist" containerID="edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.612917 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9"} err="failed to get container status \"edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9\": rpc error: code = NotFound desc = could not find container \"edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9\": container with ID starting with edf5fa038dd5abe86041a2a081ddea7bae2f15bed8d608bd7621a05f48aa92c9 not found: ID does not exist" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.612947 4769 scope.go:117] "RemoveContainer" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.625312 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.632710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2c762f-a2c7-4b78-bbb3-8c39e306b851-kube-api-access-mlqfs" (OuterVolumeSpecName: "kube-api-access-mlqfs") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "kube-api-access-mlqfs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.632937 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-scripts" (OuterVolumeSpecName: "scripts") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.666597 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.669886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675255 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.675763 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="proxy-httpd" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="proxy-httpd" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.675797 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-notification-agent" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675803 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-notification-agent" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.675814 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-httpd" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675821 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-httpd" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.675838 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-central-agent" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675844 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-central-agent" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.675869 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-log" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675876 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-log" Nov 21 12:39:05 crc kubenswrapper[4769]: E1121 12:39:05.675893 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="sg-core" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.675899 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="sg-core" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.677498 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="proxy-httpd" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.677520 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-httpd" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.677537 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-central-agent" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.677547 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="sg-core" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.677560 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" containerName="ceilometer-notification-agent" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.677575 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4244ba1d-befe-499c-a473-a8d123345bef" containerName="glance-log" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.688487 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.688588 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.695777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.693722 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.696239 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.708090 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.708119 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.708128 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.708136 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/af2c762f-a2c7-4b78-bbb3-8c39e306b851-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.708145 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mlqfs\" (UniqueName: \"kubernetes.io/projected/af2c762f-a2c7-4b78-bbb3-8c39e306b851-kube-api-access-mlqfs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.815005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.834905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5cfl\" (UniqueName: \"kubernetes.io/projected/94b1f363-8761-4a8e-a35c-d7cc338232f2-kube-api-access-z5cfl\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.834938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.834979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.835002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-logs\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.835020 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.835050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.835087 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.835127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.835198 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.862599 4769 scope.go:117] "RemoveContainer" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.898483 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5"] Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.899938 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.905560 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-lcfbj" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.906516 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.906716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.920344 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5"] Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.936403 4769 scope.go:117] "RemoveContainer" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.936928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.936966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-logs\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.936982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-scripts\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937216 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwd7\" (UniqueName: \"kubernetes.io/projected/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-kube-api-access-7dwd7\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z5cfl\" (UniqueName: \"kubernetes.io/projected/94b1f363-8761-4a8e-a35c-d7cc338232f2-kube-api-access-z5cfl\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-config-data\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.937274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.938032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-logs\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.938478 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.938723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.946404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.950434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.950685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-config-data" (OuterVolumeSpecName: "config-data") pod "af2c762f-a2c7-4b78-bbb3-8c39e306b851" (UID: "af2c762f-a2c7-4b78-bbb3-8c39e306b851"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.951310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.952036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.956699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5cfl\" (UniqueName: \"kubernetes.io/projected/94b1f363-8761-4a8e-a35c-d7cc338232f2-kube-api-access-z5cfl\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:05 crc kubenswrapper[4769]: I1121 12:39:05.978162 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.023538 4769 scope.go:117] "RemoveContainer" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.039205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwd7\" (UniqueName: \"kubernetes.io/projected/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-kube-api-access-7dwd7\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.039262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-config-data\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.039341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-scripts\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.039374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.039473 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af2c762f-a2c7-4b78-bbb3-8c39e306b851-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.042964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-config-data\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.044040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-scripts\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.044577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.056800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwd7\" (UniqueName: \"kubernetes.io/projected/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-kube-api-access-7dwd7\") pod \"nova-cell0-conductor-db-sync-xlvg5\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.057590 4769 scope.go:117] "RemoveContainer" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" Nov 21 12:39:06 crc kubenswrapper[4769]: E1121 12:39:06.057989 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": container with ID starting with fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b not found: ID does not exist" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.058019 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b"} err="failed to get container status \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": rpc error: code = NotFound desc = could not find container \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": container with ID starting with fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.058040 4769 scope.go:117] "RemoveContainer" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" Nov 21 12:39:06 crc kubenswrapper[4769]: E1121 12:39:06.058565 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": container with ID starting with 5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0 not found: ID does not exist" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.058590 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0"} err="failed to get container status \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": rpc error: code = NotFound desc = could not find container \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": container with ID starting with 5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.058623 4769 scope.go:117] "RemoveContainer" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" Nov 21 12:39:06 crc kubenswrapper[4769]: E1121 12:39:06.058892 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": container with ID starting with 123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4 not found: ID does not exist" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.058913 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4"} err="failed to get container status \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": rpc error: code = NotFound desc = could not find container \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": container with ID starting with 123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.058928 4769 scope.go:117] "RemoveContainer" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" Nov 21 12:39:06 crc kubenswrapper[4769]: E1121 12:39:06.059136 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": container with ID starting with 2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af not found: ID does not exist" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059158 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af"} err="failed to get container status \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": rpc error: code = NotFound desc = could not find container \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": container with ID starting with 2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059170 4769 scope.go:117] "RemoveContainer" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059445 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b"} err="failed to get container status \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": rpc error: code = NotFound desc = could not find container \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": container with ID starting with fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059463 4769 scope.go:117] "RemoveContainer" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059650 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0"} err="failed to get container status \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": rpc error: code = NotFound desc = could not find container \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": container with ID starting with 5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059669 4769 scope.go:117] "RemoveContainer" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059913 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4"} err="failed to get container status \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": rpc error: code = NotFound desc = could not find container \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": container with ID starting with 123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.059942 4769 scope.go:117] "RemoveContainer" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.060102 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af"} err="failed to get container status \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": rpc error: code = NotFound desc = could not find container \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": container with ID starting with 2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.060114 4769 scope.go:117] "RemoveContainer" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.060423 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b"} err="failed to get container status \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": rpc error: code = NotFound desc = could not find container \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": container with ID starting with fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.060447 4769 scope.go:117] "RemoveContainer" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.060827 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0"} err="failed to get container status \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": rpc error: code = NotFound desc = could not find container \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": container with ID starting with 5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.060849 4769 scope.go:117] "RemoveContainer" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.061557 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4"} err="failed to get container status \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": rpc error: code = NotFound desc = could not find container \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": container with ID starting with 123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.061595 4769 scope.go:117] "RemoveContainer" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.061935 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af"} err="failed to get container status \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": rpc error: code = NotFound desc = could not find container \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": container with ID starting with 2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.061952 4769 scope.go:117] "RemoveContainer" containerID="fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.062173 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b"} err="failed to get container status \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": rpc error: code = NotFound desc = could not find container \"fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b\": container with ID starting with fde46eabe5c7bae2d3fa3947bb9f87050f51fcf62206be19295452302d1c9d1b not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.062217 4769 scope.go:117] "RemoveContainer" containerID="5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.062667 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0"} err="failed to get container status \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": rpc error: code = NotFound desc = could not find container \"5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0\": container with ID starting with 5a9be5db1fe7a60c947c23867809459b03dafe62d35bd0fbb6288e0909fb3eb0 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.062686 4769 scope.go:117] "RemoveContainer" containerID="123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.062928 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4"} err="failed to get container status \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": rpc error: code = NotFound desc = could not find container \"123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4\": container with ID starting with 123eaaa0f4860dc58d78240054b711f7d2de1584193ce6590437432a1ceae4f4 not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.062947 4769 scope.go:117] "RemoveContainer" containerID="2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.063165 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af"} err="failed to get container status \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": rpc error: code = NotFound desc = could not find container \"2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af\": container with ID starting with 2a773ec45753c053c070faae6b464b01ba48fabf5d269ef3ee6ed1d1ba5c29af not found: ID does not exist" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.152940 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.173265 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.176820 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.204437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.206993 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.209950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.211209 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.215362 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.232443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.347489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-scripts\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.347829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.347871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-run-httpd\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.347906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-log-httpd\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.347926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.347986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlfts\" (UniqueName: \"kubernetes.io/projected/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-kube-api-access-xlfts\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.348011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-config-data\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xlfts\" (UniqueName: \"kubernetes.io/projected/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-kube-api-access-xlfts\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-config-data\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-scripts\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-run-httpd\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-log-httpd\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.449980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.452737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-log-httpd\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.453052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-run-httpd\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.455811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-scripts\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.457259 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.461724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.475459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlfts\" (UniqueName: \"kubernetes.io/projected/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-kube-api-access-xlfts\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.483433 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-config-data\") pod \"ceilometer-0\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.533339 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.535395 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.539164 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"28df21b3-2a77-4353-8fac-3fa307992568","Type":"ContainerStarted","Data":"159afc2dfdd50fb5cf8576f3819b134721278e456333d34a574585afab289f5b"} Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.539263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"28df21b3-2a77-4353-8fac-3fa307992568","Type":"ContainerStarted","Data":"2e147c578dbd49cc9c77c381c973564ad1e368854fb728c1534a65c7465b7a0f"} Nov 21 12:39:06 crc kubenswrapper[4769]: W1121 12:39:06.547775 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94b1f363_8761_4a8e_a35c_d7cc338232f2.slice/crio-ed38c6ed397f6b9cec29da42267a358f52f826ff28212a75290880ea69cd8fed WatchSource:0}: Error finding container ed38c6ed397f6b9cec29da42267a358f52f826ff28212a75290880ea69cd8fed: Status 404 returned error can't find the container with id ed38c6ed397f6b9cec29da42267a358f52f826ff28212a75290880ea69cd8fed Nov 21 12:39:06 crc kubenswrapper[4769]: I1121 12:39:06.801117 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5"] Nov 21 12:39:06 crc kubenswrapper[4769]: W1121 12:39:06.831967 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee4b6e2d_a6eb_4ec4_ae7c_cf53b71ac195.slice/crio-0c804d560fd4cbaa94bb2b2ce265da6a6d49492386ca1dba6f5a128949401f44 WatchSource:0}: Error finding container 0c804d560fd4cbaa94bb2b2ce265da6a6d49492386ca1dba6f5a128949401f44: Status 404 returned error can't find the container with id 0c804d560fd4cbaa94bb2b2ce265da6a6d49492386ca1dba6f5a128949401f44 Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.079559 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.299388 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4244ba1d-befe-499c-a473-a8d123345bef" path="/var/lib/kubelet/pods/4244ba1d-befe-499c-a473-a8d123345bef/volumes" Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.300352 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2c762f-a2c7-4b78-bbb3-8c39e306b851" path="/var/lib/kubelet/pods/af2c762f-a2c7-4b78-bbb3-8c39e306b851/volumes" Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.572734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94b1f363-8761-4a8e-a35c-d7cc338232f2","Type":"ContainerStarted","Data":"654a77c7034caba2ea536f55e4aa893f3edd8f15f5710b7ebc7bf47fbb15357f"} Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.573310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94b1f363-8761-4a8e-a35c-d7cc338232f2","Type":"ContainerStarted","Data":"ed38c6ed397f6b9cec29da42267a358f52f826ff28212a75290880ea69cd8fed"} Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.585432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"28df21b3-2a77-4353-8fac-3fa307992568","Type":"ContainerStarted","Data":"0b71d3bf15064131e4dc7c417b4abfc3cb7822e2433df02e5147417739760822"} Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.589012 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerStarted","Data":"5644b9e18115b875be92a0d85efd5497f6b2a53010dc56cf143663a60bdaab12"} Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.595061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" event={"ID":"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195","Type":"ContainerStarted","Data":"bc5cf1008572afddeb19fe64767b3b314afeb4253e0a16d419805431cb4075d1"} Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.595103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" event={"ID":"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195","Type":"ContainerStarted","Data":"0c804d560fd4cbaa94bb2b2ce265da6a6d49492386ca1dba6f5a128949401f44"} Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.625199 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.6251686579999998 podStartE2EDuration="3.625168658s" podCreationTimestamp="2025-11-21 12:39:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:07.603489755 +0000 UTC m=+2906.304151583" watchObservedRunningTime="2025-11-21 12:39:07.625168658 +0000 UTC m=+2906.325830476" Nov 21 12:39:07 crc kubenswrapper[4769]: I1121 12:39:07.630510 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" podStartSLOduration=2.630497201 podStartE2EDuration="2.630497201s" podCreationTimestamp="2025-11-21 12:39:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:07.620312818 +0000 UTC m=+2906.320974636" watchObservedRunningTime="2025-11-21 12:39:07.630497201 +0000 UTC m=+2906.331159019" Nov 21 12:39:08 crc kubenswrapper[4769]: I1121 12:39:08.613167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94b1f363-8761-4a8e-a35c-d7cc338232f2","Type":"ContainerStarted","Data":"99ee46e7be53655c9ff1ea8014b01115ef5a430294ae2e1adbe9b53c4d2f5174"} Nov 21 12:39:08 crc kubenswrapper[4769]: I1121 12:39:08.615934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerStarted","Data":"06c2f113c49e3f8e8b27dcbd3717aeef0804db9a269f116bad4be986fde2548d"} Nov 21 12:39:08 crc kubenswrapper[4769]: I1121 12:39:08.636000 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.635981475 podStartE2EDuration="3.635981475s" podCreationTimestamp="2025-11-21 12:39:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:08.634732501 +0000 UTC m=+2907.335394329" watchObservedRunningTime="2025-11-21 12:39:08.635981475 +0000 UTC m=+2907.336643293" Nov 21 12:39:09 crc kubenswrapper[4769]: I1121 12:39:09.636378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerStarted","Data":"51ab9491abdd3bec497b94673a7eb856b713dd0bd4b8e061b2780b07d60da949"} Nov 21 12:39:09 crc kubenswrapper[4769]: I1121 12:39:09.636443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerStarted","Data":"568eb29610878a95d9744e7dd995d964d5dab6aed333f970a1337dcf80b4bc3a"} Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.220426 4769 scope.go:117] "RemoveContainer" containerID="0cdfa21496f8d481e65fc613245ee9cab33b56e012301d3142424f340c8b7568" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.249495 4769 scope.go:117] "RemoveContainer" containerID="18cd54a628817c8f7baf3d11018e2b325726a61ce627498876af9a968a67fe99" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.294654 4769 scope.go:117] "RemoveContainer" containerID="3f9f52b8356702d41729c5f27ddcc843fdd9003b7c6d35db954b10542c79366f" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.343831 4769 scope.go:117] "RemoveContainer" containerID="6234749c292f517559d66625626c3a432015821d03db04773a332a9e9094722d" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.421349 4769 scope.go:117] "RemoveContainer" containerID="07ade9dcc929a836a885d01ae6862ab0c3432ac6d40b218c509b28428435976b" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.443073 4769 scope.go:117] "RemoveContainer" containerID="c81dc3670c42744300b003086b20e18f10b028bb729547f20f603a2570a3aca0" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.461496 4769 scope.go:117] "RemoveContainer" containerID="4bf31c2bf2bebb7001eaf66f396a43bfa310d34cbd6d3a17fe6833606f933742" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.479801 4769 scope.go:117] "RemoveContainer" containerID="ae15527ade75ef4c2d7e9b112f520854088591d57a92b14948982eef9908b0a8" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.508778 4769 scope.go:117] "RemoveContainer" containerID="9dc17cf1cd84b80ca33795ff1fb32cc5cbc011913aceae8c323d820a5fd93e76" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.535568 4769 scope.go:117] "RemoveContainer" containerID="1abc6243c2532e88080e789ebe5e6e7fb69daba8348613143615ae943993df67" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.602917 4769 scope.go:117] "RemoveContainer" containerID="b06c346e0116f0dfa9930b33b0707370bff9e9fdf44963f59d03f5f9f74902c7" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.629657 4769 scope.go:117] "RemoveContainer" containerID="2d7cfcead7b2b655d207c20f2bb7c59fe5d71759ecb364efbb0f6f511c42a0b9" Nov 21 12:39:10 crc kubenswrapper[4769]: I1121 12:39:10.694936 4769 scope.go:117] "RemoveContainer" containerID="f4f2ff038032497d9764ee4609ac54b083fd4e4edf2e7ce0cd8684840505c2cc" Nov 21 12:39:11 crc kubenswrapper[4769]: I1121 12:39:11.698765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerStarted","Data":"804a27865913b71a4a5b54f17f3c37d8242699419ae1a17bcd0c58782d743a66"} Nov 21 12:39:11 crc kubenswrapper[4769]: I1121 12:39:11.699564 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:11 crc kubenswrapper[4769]: I1121 12:39:11.730596 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9000020100000001 podStartE2EDuration="5.73057115s" podCreationTimestamp="2025-11-21 12:39:06 +0000 UTC" firstStartedPulling="2025-11-21 12:39:07.112216131 +0000 UTC m=+2905.812877939" lastFinishedPulling="2025-11-21 12:39:10.942785261 +0000 UTC m=+2909.643447079" observedRunningTime="2025-11-21 12:39:11.720873269 +0000 UTC m=+2910.421535087" watchObservedRunningTime="2025-11-21 12:39:11.73057115 +0000 UTC m=+2910.431232978" Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.952159 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.952803 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-central-agent" containerID="cri-o://06c2f113c49e3f8e8b27dcbd3717aeef0804db9a269f116bad4be986fde2548d" gracePeriod=30 Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.952888 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-notification-agent" containerID="cri-o://568eb29610878a95d9744e7dd995d964d5dab6aed333f970a1337dcf80b4bc3a" gracePeriod=30 Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.952960 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="sg-core" containerID="cri-o://51ab9491abdd3bec497b94673a7eb856b713dd0bd4b8e061b2780b07d60da949" gracePeriod=30 Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.953277 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="proxy-httpd" containerID="cri-o://804a27865913b71a4a5b54f17f3c37d8242699419ae1a17bcd0c58782d743a66" gracePeriod=30 Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.962589 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:14 crc kubenswrapper[4769]: I1121 12:39:14.962659 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.013519 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.017936 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757104 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerID="804a27865913b71a4a5b54f17f3c37d8242699419ae1a17bcd0c58782d743a66" exitCode=0 Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757140 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerID="51ab9491abdd3bec497b94673a7eb856b713dd0bd4b8e061b2780b07d60da949" exitCode=2 Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757150 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerID="568eb29610878a95d9744e7dd995d964d5dab6aed333f970a1337dcf80b4bc3a" exitCode=0 Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757160 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerID="06c2f113c49e3f8e8b27dcbd3717aeef0804db9a269f116bad4be986fde2548d" exitCode=0 Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerDied","Data":"804a27865913b71a4a5b54f17f3c37d8242699419ae1a17bcd0c58782d743a66"} Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757285 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerDied","Data":"51ab9491abdd3bec497b94673a7eb856b713dd0bd4b8e061b2780b07d60da949"} Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerDied","Data":"568eb29610878a95d9744e7dd995d964d5dab6aed333f970a1337dcf80b4bc3a"} Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerDied","Data":"06c2f113c49e3f8e8b27dcbd3717aeef0804db9a269f116bad4be986fde2548d"} Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757716 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:15 crc kubenswrapper[4769]: I1121 12:39:15.757767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.177593 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.178003 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.219864 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.232986 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.370534 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.486667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-config-data\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.486950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-combined-ca-bundle\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.487138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-log-httpd\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.487323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlfts\" (UniqueName: \"kubernetes.io/projected/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-kube-api-access-xlfts\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.487457 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-sg-core-conf-yaml\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.487640 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-scripts\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.487775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-run-httpd\") pod \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\" (UID: \"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9\") " Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.487695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.488268 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.488785 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.488879 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.493108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-scripts" (OuterVolumeSpecName: "scripts") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.501390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-kube-api-access-xlfts" (OuterVolumeSpecName: "kube-api-access-xlfts") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "kube-api-access-xlfts". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.516569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.587416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-config-data" (OuterVolumeSpecName: "config-data") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.590883 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xlfts\" (UniqueName: \"kubernetes.io/projected/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-kube-api-access-xlfts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.590919 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.590929 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.590941 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.596532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" (UID: "3a1aaa39-d224-4b44-a4f9-6780f3c40aa9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.692506 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.770546 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.772509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3a1aaa39-d224-4b44-a4f9-6780f3c40aa9","Type":"ContainerDied","Data":"5644b9e18115b875be92a0d85efd5497f6b2a53010dc56cf143663a60bdaab12"} Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.772606 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.772641 4769 scope.go:117] "RemoveContainer" containerID="804a27865913b71a4a5b54f17f3c37d8242699419ae1a17bcd0c58782d743a66" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.772892 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.810670 4769 scope.go:117] "RemoveContainer" containerID="51ab9491abdd3bec497b94673a7eb856b713dd0bd4b8e061b2780b07d60da949" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.811645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.821660 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.841276 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.841608 4769 scope.go:117] "RemoveContainer" containerID="568eb29610878a95d9744e7dd995d964d5dab6aed333f970a1337dcf80b4bc3a" Nov 21 12:39:16 crc kubenswrapper[4769]: E1121 12:39:16.841747 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-central-agent" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.841786 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-central-agent" Nov 21 12:39:16 crc kubenswrapper[4769]: E1121 12:39:16.841808 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="sg-core" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.841815 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="sg-core" Nov 21 12:39:16 crc kubenswrapper[4769]: E1121 12:39:16.841832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-notification-agent" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.841838 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-notification-agent" Nov 21 12:39:16 crc kubenswrapper[4769]: E1121 12:39:16.841863 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="proxy-httpd" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.841870 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="proxy-httpd" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.842062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="proxy-httpd" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.842093 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="sg-core" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.842106 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-central-agent" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.842118 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" containerName="ceilometer-notification-agent" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.843965 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.846754 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.847115 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.864728 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.882457 4769 scope.go:117] "RemoveContainer" containerID="06c2f113c49e3f8e8b27dcbd3717aeef0804db9a269f116bad4be986fde2548d" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.896434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-config-data\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.896742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.896854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5vjz\" (UniqueName: \"kubernetes.io/projected/853352d3-bb37-4e68-9c42-677bd8202c57-kube-api-access-f5vjz\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.896948 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-log-httpd\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.897038 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-run-httpd\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.897115 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-scripts\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:16 crc kubenswrapper[4769]: I1121 12:39:16.897186 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-config-data\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f5vjz\" (UniqueName: \"kubernetes.io/projected/853352d3-bb37-4e68-9c42-677bd8202c57-kube-api-access-f5vjz\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-log-httpd\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-run-httpd\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-scripts\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.000859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.001673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-run-httpd\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.001727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-log-httpd\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.005675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-config-data\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.006324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-scripts\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.007699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.018044 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.020627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5vjz\" (UniqueName: \"kubernetes.io/projected/853352d3-bb37-4e68-9c42-677bd8202c57-kube-api-access-f5vjz\") pod \"ceilometer-0\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.179712 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.287575 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a1aaa39-d224-4b44-a4f9-6780f3c40aa9" path="/var/lib/kubelet/pods/3a1aaa39-d224-4b44-a4f9-6780f3c40aa9/volumes" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.682435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.781252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerStarted","Data":"ff920072fa6ac6d958a7190450cfad27d3cf24911db6556c3ad6e102a0a77b17"} Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.853944 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.854029 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:39:17 crc kubenswrapper[4769]: I1121 12:39:17.867610 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:39:18 crc kubenswrapper[4769]: I1121 12:39:18.047862 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:18 crc kubenswrapper[4769]: I1121 12:39:18.790504 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:39:18 crc kubenswrapper[4769]: I1121 12:39:18.790756 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:39:18 crc kubenswrapper[4769]: I1121 12:39:18.854923 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:18 crc kubenswrapper[4769]: I1121 12:39:18.880384 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:39:20 crc kubenswrapper[4769]: I1121 12:39:20.826083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerStarted","Data":"66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295"} Nov 21 12:39:20 crc kubenswrapper[4769]: I1121 12:39:20.826764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerStarted","Data":"367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b"} Nov 21 12:39:21 crc kubenswrapper[4769]: I1121 12:39:21.838542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerStarted","Data":"75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17"} Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.635842 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.851932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerStarted","Data":"afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c"} Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.852274 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.852112 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-central-agent" containerID="cri-o://367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b" gracePeriod=30 Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.852300 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-notification-agent" containerID="cri-o://66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295" gracePeriod=30 Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.852367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="proxy-httpd" containerID="cri-o://afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c" gracePeriod=30 Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.854158 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="sg-core" containerID="cri-o://75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17" gracePeriod=30 Nov 21 12:39:22 crc kubenswrapper[4769]: I1121 12:39:22.894133 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.251191652 podStartE2EDuration="6.89410587s" podCreationTimestamp="2025-11-21 12:39:16 +0000 UTC" firstStartedPulling="2025-11-21 12:39:17.686849524 +0000 UTC m=+2916.387511342" lastFinishedPulling="2025-11-21 12:39:22.329763742 +0000 UTC m=+2921.030425560" observedRunningTime="2025-11-21 12:39:22.876533548 +0000 UTC m=+2921.577195366" watchObservedRunningTime="2025-11-21 12:39:22.89410587 +0000 UTC m=+2921.594767678" Nov 21 12:39:23 crc kubenswrapper[4769]: I1121 12:39:23.864897 4769 generic.go:334] "Generic (PLEG): container finished" podID="853352d3-bb37-4e68-9c42-677bd8202c57" containerID="afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c" exitCode=0 Nov 21 12:39:23 crc kubenswrapper[4769]: I1121 12:39:23.865288 4769 generic.go:334] "Generic (PLEG): container finished" podID="853352d3-bb37-4e68-9c42-677bd8202c57" containerID="75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17" exitCode=2 Nov 21 12:39:23 crc kubenswrapper[4769]: I1121 12:39:23.865297 4769 generic.go:334] "Generic (PLEG): container finished" podID="853352d3-bb37-4e68-9c42-677bd8202c57" containerID="66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295" exitCode=0 Nov 21 12:39:23 crc kubenswrapper[4769]: I1121 12:39:23.864971 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerDied","Data":"afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c"} Nov 21 12:39:23 crc kubenswrapper[4769]: I1121 12:39:23.865327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerDied","Data":"75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17"} Nov 21 12:39:23 crc kubenswrapper[4769]: I1121 12:39:23.865341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerDied","Data":"66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295"} Nov 21 12:39:25 crc kubenswrapper[4769]: I1121 12:39:25.371356 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:39:25 crc kubenswrapper[4769]: I1121 12:39:25.441974 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44"] Nov 21 12:39:25 crc kubenswrapper[4769]: I1121 12:39:25.442293 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-api" containerID="cri-o://111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052" gracePeriod=30 Nov 21 12:39:25 crc kubenswrapper[4769]: I1121 12:39:25.442808 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-httpd" containerID="cri-o://3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889" gracePeriod=30 Nov 21 12:39:25 crc kubenswrapper[4769]: I1121 12:39:25.889118 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerID="3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889" exitCode=0 Nov 21 12:39:25 crc kubenswrapper[4769]: I1121 12:39:25.889218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" event={"ID":"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4","Type":"ContainerDied","Data":"3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889"} Nov 21 12:39:28 crc kubenswrapper[4769]: I1121 12:39:28.917898 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" containerID="bc5cf1008572afddeb19fe64767b3b314afeb4253e0a16d419805431cb4075d1" exitCode=0 Nov 21 12:39:28 crc kubenswrapper[4769]: I1121 12:39:28.917981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" event={"ID":"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195","Type":"ContainerDied","Data":"bc5cf1008572afddeb19fe64767b3b314afeb4253e0a16d419805431cb4075d1"} Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.908266 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.931883 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerID="111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052" exitCode=0 Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.931936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" event={"ID":"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4","Type":"ContainerDied","Data":"111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052"} Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.931996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" event={"ID":"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4","Type":"ContainerDied","Data":"36423caca731768947c8593fd040bc1b614b2ee43c13d0ccdebe7b188fdfec07"} Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.932023 4769 scope.go:117] "RemoveContainer" containerID="3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889" Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.932247 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44" Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.982377 4769 scope.go:117] "RemoveContainer" containerID="111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052" Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.986025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-combined-ca-bundle\") pod \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.986105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-httpd-config\") pod \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.986226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cffft\" (UniqueName: \"kubernetes.io/projected/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-kube-api-access-cffft\") pod \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.986269 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-config\") pod \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " Nov 21 12:39:29 crc kubenswrapper[4769]: I1121 12:39:29.986291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-ovndb-tls-certs\") pod \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\" (UID: \"e9689cfa-f59a-4e94-9e04-fc5d679d0bc4\") " Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:29.997163 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" (UID: "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.020441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-kube-api-access-cffft" (OuterVolumeSpecName: "kube-api-access-cffft") pod "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" (UID: "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4"). InnerVolumeSpecName "kube-api-access-cffft". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.086698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-config" (OuterVolumeSpecName: "config") pod "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" (UID: "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.088153 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cffft\" (UniqueName: \"kubernetes.io/projected/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-kube-api-access-cffft\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.088181 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.088245 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.118165 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" (UID: "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.141965 4769 scope.go:117] "RemoveContainer" containerID="3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889" Nov 21 12:39:30 crc kubenswrapper[4769]: E1121 12:39:30.142655 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889\": container with ID starting with 3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889 not found: ID does not exist" containerID="3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.142687 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889"} err="failed to get container status \"3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889\": rpc error: code = NotFound desc = could not find container \"3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889\": container with ID starting with 3b2b430e4af787ffd1c51e32ac3afdaa160685036e1e3cf22d5df6e268f36889 not found: ID does not exist" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.142712 4769 scope.go:117] "RemoveContainer" containerID="111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052" Nov 21 12:39:30 crc kubenswrapper[4769]: E1121 12:39:30.143160 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052\": container with ID starting with 111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052 not found: ID does not exist" containerID="111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.143207 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052"} err="failed to get container status \"111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052\": rpc error: code = NotFound desc = could not find container \"111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052\": container with ID starting with 111205eb64f95cba60cd257ea15497b197afe80dcdf8e3831201cf4b9ee9c052 not found: ID does not exist" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.151046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" (UID: "e9689cfa-f59a-4e94-9e04-fc5d679d0bc4"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.190276 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.190312 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.269593 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.273396 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44"] Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.282840 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-58b5cbd5fc-tzf44"] Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.396366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-scripts\") pod \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.396619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dwd7\" (UniqueName: \"kubernetes.io/projected/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-kube-api-access-7dwd7\") pod \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.396863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-combined-ca-bundle\") pod \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.396994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-config-data\") pod \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\" (UID: \"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195\") " Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.399996 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-kube-api-access-7dwd7" (OuterVolumeSpecName: "kube-api-access-7dwd7") pod "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" (UID: "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195"). InnerVolumeSpecName "kube-api-access-7dwd7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.402297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-scripts" (OuterVolumeSpecName: "scripts") pod "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" (UID: "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.436116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" (UID: "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.437120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-config-data" (OuterVolumeSpecName: "config-data") pod "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" (UID: "ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.499857 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.499901 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7dwd7\" (UniqueName: \"kubernetes.io/projected/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-kube-api-access-7dwd7\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.499916 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.499926 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.956055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" event={"ID":"ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195","Type":"ContainerDied","Data":"0c804d560fd4cbaa94bb2b2ce265da6a6d49492386ca1dba6f5a128949401f44"} Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.957093 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5" Nov 21 12:39:30 crc kubenswrapper[4769]: I1121 12:39:30.958845 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c804d560fd4cbaa94bb2b2ce265da6a6d49492386ca1dba6f5a128949401f44" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.054723 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:31 crc kubenswrapper[4769]: E1121 12:39:31.055181 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-api" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.055217 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-api" Nov 21 12:39:31 crc kubenswrapper[4769]: E1121 12:39:31.055245 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" containerName="nova-cell0-conductor-db-sync" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.055252 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" containerName="nova-cell0-conductor-db-sync" Nov 21 12:39:31 crc kubenswrapper[4769]: E1121 12:39:31.055268 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-httpd" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.055274 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-httpd" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.055464 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-api" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.055488 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" containerName="nova-cell0-conductor-db-sync" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.055508 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" containerName="neutron-httpd" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.056669 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.061437 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.063879 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.070758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-lcfbj" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.114598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.114757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.114801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx5x2\" (UniqueName: \"kubernetes.io/projected/91961bd1-3f74-4798-96cb-999a22716dfb-kube-api-access-jx5x2\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.127835 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:31 crc kubenswrapper[4769]: E1121 12:39:31.128568 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-jx5x2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="91961bd1-3f74-4798-96cb-999a22716dfb" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.216798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.216941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.216981 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jx5x2\" (UniqueName: \"kubernetes.io/projected/91961bd1-3f74-4798-96cb-999a22716dfb-kube-api-access-jx5x2\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.222358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.233138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.238250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx5x2\" (UniqueName: \"kubernetes.io/projected/91961bd1-3f74-4798-96cb-999a22716dfb-kube-api-access-jx5x2\") pod \"nova-cell0-conductor-0\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.290695 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9689cfa-f59a-4e94-9e04-fc5d679d0bc4" path="/var/lib/kubelet/pods/e9689cfa-f59a-4e94-9e04-fc5d679d0bc4/volumes" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.434094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.522565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-scripts\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.522620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-log-httpd\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.522650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-run-httpd\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.523296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.523548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.523593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-combined-ca-bundle\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.523683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-config-data\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.523771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5vjz\" (UniqueName: \"kubernetes.io/projected/853352d3-bb37-4e68-9c42-677bd8202c57-kube-api-access-f5vjz\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.524217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-sg-core-conf-yaml\") pod \"853352d3-bb37-4e68-9c42-677bd8202c57\" (UID: \"853352d3-bb37-4e68-9c42-677bd8202c57\") " Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.525275 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.525293 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/853352d3-bb37-4e68-9c42-677bd8202c57-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.528052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853352d3-bb37-4e68-9c42-677bd8202c57-kube-api-access-f5vjz" (OuterVolumeSpecName: "kube-api-access-f5vjz") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "kube-api-access-f5vjz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.528085 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-scripts" (OuterVolumeSpecName: "scripts") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.552203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.608019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.629920 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.629966 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.629983 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f5vjz\" (UniqueName: \"kubernetes.io/projected/853352d3-bb37-4e68-9c42-677bd8202c57-kube-api-access-f5vjz\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.629996 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.639499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-config-data" (OuterVolumeSpecName: "config-data") pod "853352d3-bb37-4e68-9c42-677bd8202c57" (UID: "853352d3-bb37-4e68-9c42-677bd8202c57"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.731407 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/853352d3-bb37-4e68-9c42-677bd8202c57-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.970536 4769 generic.go:334] "Generic (PLEG): container finished" podID="853352d3-bb37-4e68-9c42-677bd8202c57" containerID="367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b" exitCode=0 Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.970611 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.971022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerDied","Data":"367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b"} Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.971056 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.971082 4769 scope.go:117] "RemoveContainer" containerID="afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c" Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.971065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"853352d3-bb37-4e68-9c42-677bd8202c57","Type":"ContainerDied","Data":"ff920072fa6ac6d958a7190450cfad27d3cf24911db6556c3ad6e102a0a77b17"} Nov 21 12:39:31 crc kubenswrapper[4769]: I1121 12:39:31.984900 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.022666 4769 scope.go:117] "RemoveContainer" containerID="75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.034351 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.049249 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066259 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.066647 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-central-agent" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066659 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-central-agent" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.066688 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="proxy-httpd" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066696 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="proxy-httpd" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.066723 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="sg-core" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066730 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="sg-core" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.066744 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-notification-agent" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066750 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-notification-agent" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066918 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-notification-agent" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066930 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="sg-core" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066948 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="ceilometer-central-agent" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.066958 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" containerName="proxy-httpd" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.068606 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.074245 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.074539 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.076616 4769 scope.go:117] "RemoveContainer" containerID="66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.078868 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.112628 4769 scope.go:117] "RemoveContainer" containerID="367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.132624 4769 scope.go:117] "RemoveContainer" containerID="afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.133208 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c\": container with ID starting with afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c not found: ID does not exist" containerID="afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.133243 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c"} err="failed to get container status \"afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c\": rpc error: code = NotFound desc = could not find container \"afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c\": container with ID starting with afe788e06bd1a88e73f61d0bc09c276fe41f55243a4b11e2e7582008dbd16b4c not found: ID does not exist" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.133265 4769 scope.go:117] "RemoveContainer" containerID="75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.133773 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17\": container with ID starting with 75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17 not found: ID does not exist" containerID="75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.133797 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17"} err="failed to get container status \"75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17\": rpc error: code = NotFound desc = could not find container \"75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17\": container with ID starting with 75f8954311650058440c0228a5061b1b4f39c9a6e8ff89e7b8df1b0ebba45a17 not found: ID does not exist" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.133813 4769 scope.go:117] "RemoveContainer" containerID="66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.134095 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295\": container with ID starting with 66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295 not found: ID does not exist" containerID="66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.134137 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295"} err="failed to get container status \"66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295\": rpc error: code = NotFound desc = could not find container \"66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295\": container with ID starting with 66f93b0816485d698696c9121e019da5660276a366d0db99be1a20bfd56ed295 not found: ID does not exist" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.134150 4769 scope.go:117] "RemoveContainer" containerID="367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b" Nov 21 12:39:32 crc kubenswrapper[4769]: E1121 12:39:32.134493 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b\": container with ID starting with 367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b not found: ID does not exist" containerID="367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.134533 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b"} err="failed to get container status \"367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b\": rpc error: code = NotFound desc = could not find container \"367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b\": container with ID starting with 367372ef4173052fd76f973e014cdae0bdf3d81111adb1e95c006102a382cc7b not found: ID does not exist" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-config-data\") pod \"91961bd1-3f74-4798-96cb-999a22716dfb\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-combined-ca-bundle\") pod \"91961bd1-3f74-4798-96cb-999a22716dfb\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx5x2\" (UniqueName: \"kubernetes.io/projected/91961bd1-3f74-4798-96cb-999a22716dfb-kube-api-access-jx5x2\") pod \"91961bd1-3f74-4798-96cb-999a22716dfb\" (UID: \"91961bd1-3f74-4798-96cb-999a22716dfb\") " Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-kube-api-access-xz2m4\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-scripts\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-run-httpd\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-log-httpd\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.139974 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-config-data\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.140454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.140527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.143792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91961bd1-3f74-4798-96cb-999a22716dfb-kube-api-access-jx5x2" (OuterVolumeSpecName: "kube-api-access-jx5x2") pod "91961bd1-3f74-4798-96cb-999a22716dfb" (UID: "91961bd1-3f74-4798-96cb-999a22716dfb"). InnerVolumeSpecName "kube-api-access-jx5x2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.144881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-config-data" (OuterVolumeSpecName: "config-data") pod "91961bd1-3f74-4798-96cb-999a22716dfb" (UID: "91961bd1-3f74-4798-96cb-999a22716dfb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.145015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "91961bd1-3f74-4798-96cb-999a22716dfb" (UID: "91961bd1-3f74-4798-96cb-999a22716dfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-kube-api-access-xz2m4\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-scripts\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-run-httpd\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-log-httpd\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242698 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-config-data\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242774 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242790 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jx5x2\" (UniqueName: \"kubernetes.io/projected/91961bd1-3f74-4798-96cb-999a22716dfb-kube-api-access-jx5x2\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.242803 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91961bd1-3f74-4798-96cb-999a22716dfb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.243064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-run-httpd\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.243137 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-log-httpd\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.246447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.246528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-scripts\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.246765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.248670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-config-data\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.263343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-kube-api-access-xz2m4\") pod \"ceilometer-0\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.394145 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.896681 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.925280 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.982021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerStarted","Data":"3d69dfc922736d5e0fb12684394d46b9ca958e4b0bdc265ef7bc6a895de99b59"} Nov 21 12:39:32 crc kubenswrapper[4769]: I1121 12:39:32.983417 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.028361 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.035616 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.064525 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.066376 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.068984 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-lcfbj" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.069461 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.090780 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.164559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.164665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppcmr\" (UniqueName: \"kubernetes.io/projected/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-kube-api-access-ppcmr\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.164711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.267312 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.267476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ppcmr\" (UniqueName: \"kubernetes.io/projected/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-kube-api-access-ppcmr\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.267565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.276226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.282439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.293806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppcmr\" (UniqueName: \"kubernetes.io/projected/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-kube-api-access-ppcmr\") pod \"nova-cell0-conductor-0\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.297872 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853352d3-bb37-4e68-9c42-677bd8202c57" path="/var/lib/kubelet/pods/853352d3-bb37-4e68-9c42-677bd8202c57/volumes" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.299887 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91961bd1-3f74-4798-96cb-999a22716dfb" path="/var/lib/kubelet/pods/91961bd1-3f74-4798-96cb-999a22716dfb/volumes" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.399946 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:33 crc kubenswrapper[4769]: I1121 12:39:33.873755 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:39:33 crc kubenswrapper[4769]: W1121 12:39:33.879941 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd24cf656_a5f0_4c9f_bdc0_a95e5bf92a16.slice/crio-0d66bb6216ee18ec44b4de79ed56c4d68f8a2d26c0c836d566fdc336da59c4b5 WatchSource:0}: Error finding container 0d66bb6216ee18ec44b4de79ed56c4d68f8a2d26c0c836d566fdc336da59c4b5: Status 404 returned error can't find the container with id 0d66bb6216ee18ec44b4de79ed56c4d68f8a2d26c0c836d566fdc336da59c4b5 Nov 21 12:39:34 crc kubenswrapper[4769]: I1121 12:39:34.002526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerStarted","Data":"1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7"} Nov 21 12:39:34 crc kubenswrapper[4769]: I1121 12:39:34.008236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16","Type":"ContainerStarted","Data":"0d66bb6216ee18ec44b4de79ed56c4d68f8a2d26c0c836d566fdc336da59c4b5"} Nov 21 12:39:35 crc kubenswrapper[4769]: I1121 12:39:35.025527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerStarted","Data":"da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6"} Nov 21 12:39:35 crc kubenswrapper[4769]: I1121 12:39:35.028581 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16","Type":"ContainerStarted","Data":"a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16"} Nov 21 12:39:35 crc kubenswrapper[4769]: I1121 12:39:35.028756 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:36 crc kubenswrapper[4769]: I1121 12:39:36.039760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerStarted","Data":"7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6"} Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.067484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerStarted","Data":"dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824"} Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.068581 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="sg-core" containerID="cri-o://7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6" gracePeriod=30 Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.068617 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-notification-agent" containerID="cri-o://da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6" gracePeriod=30 Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.068705 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="proxy-httpd" containerID="cri-o://dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824" gracePeriod=30 Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.071775 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-central-agent" containerID="cri-o://1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7" gracePeriod=30 Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.104531 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.6469616070000002 podStartE2EDuration="5.104507844s" podCreationTimestamp="2025-11-21 12:39:32 +0000 UTC" firstStartedPulling="2025-11-21 12:39:32.912130673 +0000 UTC m=+2931.612792491" lastFinishedPulling="2025-11-21 12:39:36.36967691 +0000 UTC m=+2935.070338728" observedRunningTime="2025-11-21 12:39:37.095852842 +0000 UTC m=+2935.796514720" watchObservedRunningTime="2025-11-21 12:39:37.104507844 +0000 UTC m=+2935.805169662" Nov 21 12:39:37 crc kubenswrapper[4769]: I1121 12:39:37.107916 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=4.107901096 podStartE2EDuration="4.107901096s" podCreationTimestamp="2025-11-21 12:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:35.056763256 +0000 UTC m=+2933.757425074" watchObservedRunningTime="2025-11-21 12:39:37.107901096 +0000 UTC m=+2935.808562914" Nov 21 12:39:38 crc kubenswrapper[4769]: I1121 12:39:38.085147 4769 generic.go:334] "Generic (PLEG): container finished" podID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerID="dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824" exitCode=0 Nov 21 12:39:38 crc kubenswrapper[4769]: I1121 12:39:38.085235 4769 generic.go:334] "Generic (PLEG): container finished" podID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerID="7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6" exitCode=2 Nov 21 12:39:38 crc kubenswrapper[4769]: I1121 12:39:38.085254 4769 generic.go:334] "Generic (PLEG): container finished" podID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerID="da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6" exitCode=0 Nov 21 12:39:38 crc kubenswrapper[4769]: I1121 12:39:38.085288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerDied","Data":"dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824"} Nov 21 12:39:38 crc kubenswrapper[4769]: I1121 12:39:38.085327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerDied","Data":"7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6"} Nov 21 12:39:38 crc kubenswrapper[4769]: I1121 12:39:38.085346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerDied","Data":"da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6"} Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.896945 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-log-httpd\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-sg-core-conf-yaml\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-config-data\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-scripts\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-run-httpd\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-combined-ca-bundle\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.977876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-kube-api-access-xz2m4\") pod \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\" (UID: \"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86\") " Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.978050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.978558 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.978585 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.986744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-kube-api-access-xz2m4" (OuterVolumeSpecName: "kube-api-access-xz2m4") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "kube-api-access-xz2m4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:42 crc kubenswrapper[4769]: I1121 12:39:42.986810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-scripts" (OuterVolumeSpecName: "scripts") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.021492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.061870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.080216 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.080391 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.080480 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-kube-api-access-xz2m4\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.080536 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.093215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-config-data" (OuterVolumeSpecName: "config-data") pod "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" (UID: "1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.136500 4769 generic.go:334] "Generic (PLEG): container finished" podID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerID="1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7" exitCode=0 Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.136558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerDied","Data":"1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7"} Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.136602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86","Type":"ContainerDied","Data":"3d69dfc922736d5e0fb12684394d46b9ca958e4b0bdc265ef7bc6a895de99b59"} Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.136627 4769 scope.go:117] "RemoveContainer" containerID="dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.136656 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.166461 4769 scope.go:117] "RemoveContainer" containerID="7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.181387 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.182173 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.204343 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.207772 4769 scope.go:117] "RemoveContainer" containerID="da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.218798 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.219595 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="sg-core" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.219736 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="sg-core" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.219827 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-central-agent" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.219930 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-central-agent" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.220029 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-notification-agent" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.220107 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-notification-agent" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.220345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="proxy-httpd" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.220429 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="proxy-httpd" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.220748 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="sg-core" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.220916 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="proxy-httpd" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.221020 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-central-agent" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.221109 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" containerName="ceilometer-notification-agent" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.228033 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.233907 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.234092 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.234499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.246961 4769 scope.go:117] "RemoveContainer" containerID="1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.273177 4769 scope.go:117] "RemoveContainer" containerID="dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.274107 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824\": container with ID starting with dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824 not found: ID does not exist" containerID="dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.274351 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824"} err="failed to get container status \"dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824\": rpc error: code = NotFound desc = could not find container \"dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824\": container with ID starting with dcfaaf2f26925f0121ab38fa9a983f697fe4787751d45caf811edc6b02dd0824 not found: ID does not exist" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.274459 4769 scope.go:117] "RemoveContainer" containerID="7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.274834 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6\": container with ID starting with 7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6 not found: ID does not exist" containerID="7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.274876 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6"} err="failed to get container status \"7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6\": rpc error: code = NotFound desc = could not find container \"7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6\": container with ID starting with 7ace8c612eed57650e0ef35cad7b46a024f28b82a82116bb5c3e37a12f350fa6 not found: ID does not exist" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.274904 4769 scope.go:117] "RemoveContainer" containerID="da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.275182 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6\": container with ID starting with da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6 not found: ID does not exist" containerID="da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.275307 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6"} err="failed to get container status \"da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6\": rpc error: code = NotFound desc = could not find container \"da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6\": container with ID starting with da80abd0fce96919010b252ea5503d93627a1578931effeacdde866c8becdbc6 not found: ID does not exist" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.275395 4769 scope.go:117] "RemoveContainer" containerID="1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7" Nov 21 12:39:43 crc kubenswrapper[4769]: E1121 12:39:43.275815 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7\": container with ID starting with 1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7 not found: ID does not exist" containerID="1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.275867 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7"} err="failed to get container status \"1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7\": rpc error: code = NotFound desc = could not find container \"1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7\": container with ID starting with 1296311eee2aec432e22ac00ee7d25a5ccc96eb8ce70153bc7ce11eeee7331b7 not found: ID does not exist" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.283770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-log-httpd\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.283812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-scripts\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.283846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kltr\" (UniqueName: \"kubernetes.io/projected/a36b31e9-27d2-4d86-aaea-c414b09b253e-kube-api-access-5kltr\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.284346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-config-data\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.284399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.284436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-run-httpd\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.284564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.285562 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86" path="/var/lib/kubelet/pods/1414e2bd-bfc0-43c1-bba6-6c7b9b5c2b86/volumes" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.387775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.387907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-log-httpd\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.387942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-scripts\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.388003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kltr\" (UniqueName: \"kubernetes.io/projected/a36b31e9-27d2-4d86-aaea-c414b09b253e-kube-api-access-5kltr\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.388249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-config-data\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.388286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.388317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-run-httpd\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.388671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-log-httpd\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.388717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-run-httpd\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.391813 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.392045 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.392165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.403015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.403628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-scripts\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.404604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-config-data\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.406916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kltr\" (UniqueName: \"kubernetes.io/projected/a36b31e9-27d2-4d86-aaea-c414b09b253e-kube-api-access-5kltr\") pod \"ceilometer-0\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.436052 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.551397 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.939159 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll"] Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.941267 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.943662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.943981 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:39:43 crc kubenswrapper[4769]: I1121 12:39:43.957793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.004574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-config-data\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.004623 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4r9\" (UniqueName: \"kubernetes.io/projected/5955251c-5d2f-43ee-a371-883cfd5f4558-kube-api-access-9q4r9\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.004769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.004803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-scripts\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: W1121 12:39:44.100915 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda36b31e9_27d2_4d86_aaea_c414b09b253e.slice/crio-9cefd02387b7d2d15081515f5545a8d3049984cc49a02477ae7ca9572ddf2b36 WatchSource:0}: Error finding container 9cefd02387b7d2d15081515f5545a8d3049984cc49a02477ae7ca9572ddf2b36: Status 404 returned error can't find the container with id 9cefd02387b7d2d15081515f5545a8d3049984cc49a02477ae7ca9572ddf2b36 Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.100978 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.109687 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.109754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-scripts\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.109879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-config-data\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.109913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4r9\" (UniqueName: \"kubernetes.io/projected/5955251c-5d2f-43ee-a371-883cfd5f4558-kube-api-access-9q4r9\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.111099 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.119374 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-scripts\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.119617 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.122789 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.129407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-config-data\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.170593 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.183937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.247766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4r9\" (UniqueName: \"kubernetes.io/projected/5955251c-5d2f-43ee-a371-883cfd5f4558-kube-api-access-9q4r9\") pod \"nova-cell0-cell-mapping-gdcll\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.292736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerStarted","Data":"9cefd02387b7d2d15081515f5545a8d3049984cc49a02477ae7ca9572ddf2b36"} Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.309205 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.309666 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.326395 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.330007 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.344006 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.346179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.349688 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.353123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.365639 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.377977 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.380650 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.384273 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.384653 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.385331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8fx\" (UniqueName: \"kubernetes.io/projected/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-kube-api-access-7t8fx\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.385451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-logs\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.385471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.385503 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-config-data\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.487450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.487864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-config-data\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.487895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.487927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-logs\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.487948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.487971 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.488021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-config-data\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.488042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-config-data\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.488080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzz56\" (UniqueName: \"kubernetes.io/projected/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-kube-api-access-zzz56\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.488116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8nfs\" (UniqueName: \"kubernetes.io/projected/30477b21-33e4-46e9-a1dc-9264896a6e02-kube-api-access-n8nfs\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.488149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdx2j\" (UniqueName: \"kubernetes.io/projected/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-kube-api-access-mdx2j\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.488172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-logs\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.491822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8fx\" (UniqueName: \"kubernetes.io/projected/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-kube-api-access-7t8fx\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.491929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.492465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-logs\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.498338 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.499408 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-config-data\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.512366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8fx\" (UniqueName: \"kubernetes.io/projected/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-kube-api-access-7t8fx\") pod \"nova-api-0\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.530283 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n8nfs\" (UniqueName: \"kubernetes.io/projected/30477b21-33e4-46e9-a1dc-9264896a6e02-kube-api-access-n8nfs\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mdx2j\" (UniqueName: \"kubernetes.io/projected/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-kube-api-access-mdx2j\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-logs\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-config-data\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.595822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-config-data\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.597042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zzz56\" (UniqueName: \"kubernetes.io/projected/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-kube-api-access-zzz56\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.598080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-logs\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.604950 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.605721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.609823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.609922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.613848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzz56\" (UniqueName: \"kubernetes.io/projected/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-kube-api-access-zzz56\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.615902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-config-data\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.616023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdx2j\" (UniqueName: \"kubernetes.io/projected/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-kube-api-access-mdx2j\") pod \"nova-scheduler-0\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.616128 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-config-data\") pod \"nova-metadata-0\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.616921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8nfs\" (UniqueName: \"kubernetes.io/projected/30477b21-33e4-46e9-a1dc-9264896a6e02-kube-api-access-n8nfs\") pod \"nova-cell1-novncproxy-0\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.648749 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.671292 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.718978 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.869093 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll"] Nov 21 12:39:44 crc kubenswrapper[4769]: I1121 12:39:44.937439 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.055459 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6"] Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.057163 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.065247 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.065502 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.074744 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6"] Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.108749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-scripts\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.108806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.108845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-config-data\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.108925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrnpz\" (UniqueName: \"kubernetes.io/projected/242ebd44-6200-4f38-acd8-e48ababc139d-kube-api-access-wrnpz\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.191814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.214786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-scripts\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.216749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.216780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-config-data\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.216917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wrnpz\" (UniqueName: \"kubernetes.io/projected/242ebd44-6200-4f38-acd8-e48ababc139d-kube-api-access-wrnpz\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.222817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-scripts\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.224843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.228739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-config-data\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.233832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrnpz\" (UniqueName: \"kubernetes.io/projected/242ebd44-6200-4f38-acd8-e48ababc139d-kube-api-access-wrnpz\") pod \"nova-cell1-conductor-db-sync-bb7r6\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.312095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"02d74f0a-d57b-4d01-a90a-f9b5396e42fd","Type":"ContainerStarted","Data":"143f566a987670aa4689c5e8b0c30a01edae6301c1f9f7443b8812a51eb23a00"} Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.313923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" event={"ID":"5955251c-5d2f-43ee-a371-883cfd5f4558","Type":"ContainerStarted","Data":"ef628575ad5099427844136ae8f72577c2e883ca1b8e68196ff62ea429410210"} Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.313951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" event={"ID":"5955251c-5d2f-43ee-a371-883cfd5f4558","Type":"ContainerStarted","Data":"789374ae713ef3ad45f1f89b64a5f37807568aaedaf64856db51c2fd7bccdd1d"} Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.315673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerStarted","Data":"bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67"} Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.345468 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" podStartSLOduration=2.345448708 podStartE2EDuration="2.345448708s" podCreationTimestamp="2025-11-21 12:39:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:45.33472702 +0000 UTC m=+2944.035388838" watchObservedRunningTime="2025-11-21 12:39:45.345448708 +0000 UTC m=+2944.046110526" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.376590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:45 crc kubenswrapper[4769]: W1121 12:39:45.379717 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb982c2bf_825a_4eb5_84a8_a2b7d2fbdba4.slice/crio-3d746cbb6fcfbc11a93c00f786d54d238e1794b91ac7281edfbb27ed0b62b524 WatchSource:0}: Error finding container 3d746cbb6fcfbc11a93c00f786d54d238e1794b91ac7281edfbb27ed0b62b524: Status 404 returned error can't find the container with id 3d746cbb6fcfbc11a93c00f786d54d238e1794b91ac7281edfbb27ed0b62b524 Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.396866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.402011 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:39:45 crc kubenswrapper[4769]: I1121 12:39:45.546535 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.090367 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6"] Nov 21 12:39:46 crc kubenswrapper[4769]: W1121 12:39:46.104529 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod242ebd44_6200_4f38_acd8_e48ababc139d.slice/crio-456eb44b9e5736c95dc73da50a490c497eab6550824e7c9d681ffd0ac795790d WatchSource:0}: Error finding container 456eb44b9e5736c95dc73da50a490c497eab6550824e7c9d681ffd0ac795790d: Status 404 returned error can't find the container with id 456eb44b9e5736c95dc73da50a490c497eab6550824e7c9d681ffd0ac795790d Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.350875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4","Type":"ContainerStarted","Data":"d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.352037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4","Type":"ContainerStarted","Data":"3d746cbb6fcfbc11a93c00f786d54d238e1794b91ac7281edfbb27ed0b62b524"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.365808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerStarted","Data":"717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.369282 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.369259066 podStartE2EDuration="2.369259066s" podCreationTimestamp="2025-11-21 12:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:46.368268179 +0000 UTC m=+2945.068930007" watchObservedRunningTime="2025-11-21 12:39:46.369259066 +0000 UTC m=+2945.069920884" Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.371918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" event={"ID":"242ebd44-6200-4f38-acd8-e48ababc139d","Type":"ContainerStarted","Data":"456eb44b9e5736c95dc73da50a490c497eab6550824e7c9d681ffd0ac795790d"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.378299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"02d74f0a-d57b-4d01-a90a-f9b5396e42fd","Type":"ContainerStarted","Data":"24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.378361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"02d74f0a-d57b-4d01-a90a-f9b5396e42fd","Type":"ContainerStarted","Data":"db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.389799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4b4b47b7-6661-4bea-8bc5-e7d723b082d6","Type":"ContainerStarted","Data":"0b375f13bbac168fb981318510ab8f3aca47b060acd05e0a0e57b20ab173dadd"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.390094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4b4b47b7-6661-4bea-8bc5-e7d723b082d6","Type":"ContainerStarted","Data":"4c76fb70dd8778467015517d5ef22d22e44e284eb2967d504a8e7149ede5ad3a"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.398328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"30477b21-33e4-46e9-a1dc-9264896a6e02","Type":"ContainerStarted","Data":"0800cd6de1d31ea3885037956442d8573e85fe030c9295e39659b57743b089f5"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.398562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"30477b21-33e4-46e9-a1dc-9264896a6e02","Type":"ContainerStarted","Data":"5d71146821d7c39d18f1e752d934aa5a100be838c0b711869547491205153072"} Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.405621 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.405602133 podStartE2EDuration="2.405602133s" podCreationTimestamp="2025-11-21 12:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:46.401417721 +0000 UTC m=+2945.102079549" watchObservedRunningTime="2025-11-21 12:39:46.405602133 +0000 UTC m=+2945.106263951" Nov 21 12:39:46 crc kubenswrapper[4769]: I1121 12:39:46.421918 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.421888921 podStartE2EDuration="2.421888921s" podCreationTimestamp="2025-11-21 12:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:46.4173718 +0000 UTC m=+2945.118033618" watchObservedRunningTime="2025-11-21 12:39:46.421888921 +0000 UTC m=+2945.122550739" Nov 21 12:39:47 crc kubenswrapper[4769]: I1121 12:39:47.332581 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:47 crc kubenswrapper[4769]: I1121 12:39:47.409056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" event={"ID":"242ebd44-6200-4f38-acd8-e48ababc139d","Type":"ContainerStarted","Data":"2bd33ac784cf09190eda17873d45df781be1d4b88d4cf0d042c51c2b6f9aa9f4"} Nov 21 12:39:47 crc kubenswrapper[4769]: I1121 12:39:47.411742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4b4b47b7-6661-4bea-8bc5-e7d723b082d6","Type":"ContainerStarted","Data":"296e23c7445dae800abce57e045af36f4baa2402f96fc3403bf07c174800f53d"} Nov 21 12:39:47 crc kubenswrapper[4769]: I1121 12:39:47.423240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:48 crc kubenswrapper[4769]: I1121 12:39:48.430664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerStarted","Data":"669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4"} Nov 21 12:39:48 crc kubenswrapper[4769]: I1121 12:39:48.430775 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="30477b21-33e4-46e9-a1dc-9264896a6e02" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://0800cd6de1d31ea3885037956442d8573e85fe030c9295e39659b57743b089f5" gracePeriod=30 Nov 21 12:39:48 crc kubenswrapper[4769]: I1121 12:39:48.431171 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-log" containerID="cri-o://0b375f13bbac168fb981318510ab8f3aca47b060acd05e0a0e57b20ab173dadd" gracePeriod=30 Nov 21 12:39:48 crc kubenswrapper[4769]: I1121 12:39:48.431308 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-metadata" containerID="cri-o://296e23c7445dae800abce57e045af36f4baa2402f96fc3403bf07c174800f53d" gracePeriod=30 Nov 21 12:39:48 crc kubenswrapper[4769]: I1121 12:39:48.454009 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" podStartSLOduration=3.453987118 podStartE2EDuration="3.453987118s" podCreationTimestamp="2025-11-21 12:39:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:48.449710623 +0000 UTC m=+2947.150372461" watchObservedRunningTime="2025-11-21 12:39:48.453987118 +0000 UTC m=+2947.154648936" Nov 21 12:39:48 crc kubenswrapper[4769]: I1121 12:39:48.515811 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.51578826 podStartE2EDuration="4.51578826s" podCreationTimestamp="2025-11-21 12:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:48.471968081 +0000 UTC m=+2947.172629899" watchObservedRunningTime="2025-11-21 12:39:48.51578826 +0000 UTC m=+2947.216450078" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.442981 4769 generic.go:334] "Generic (PLEG): container finished" podID="30477b21-33e4-46e9-a1dc-9264896a6e02" containerID="0800cd6de1d31ea3885037956442d8573e85fe030c9295e39659b57743b089f5" exitCode=0 Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.443147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"30477b21-33e4-46e9-a1dc-9264896a6e02","Type":"ContainerDied","Data":"0800cd6de1d31ea3885037956442d8573e85fe030c9295e39659b57743b089f5"} Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.443723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"30477b21-33e4-46e9-a1dc-9264896a6e02","Type":"ContainerDied","Data":"5d71146821d7c39d18f1e752d934aa5a100be838c0b711869547491205153072"} Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.443746 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d71146821d7c39d18f1e752d934aa5a100be838c0b711869547491205153072" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.447118 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerID="296e23c7445dae800abce57e045af36f4baa2402f96fc3403bf07c174800f53d" exitCode=0 Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.447156 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerID="0b375f13bbac168fb981318510ab8f3aca47b060acd05e0a0e57b20ab173dadd" exitCode=143 Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.447167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4b4b47b7-6661-4bea-8bc5-e7d723b082d6","Type":"ContainerDied","Data":"296e23c7445dae800abce57e045af36f4baa2402f96fc3403bf07c174800f53d"} Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.447226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4b4b47b7-6661-4bea-8bc5-e7d723b082d6","Type":"ContainerDied","Data":"0b375f13bbac168fb981318510ab8f3aca47b060acd05e0a0e57b20ab173dadd"} Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.447236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4b4b47b7-6661-4bea-8bc5-e7d723b082d6","Type":"ContainerDied","Data":"4c76fb70dd8778467015517d5ef22d22e44e284eb2967d504a8e7149ede5ad3a"} Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.447245 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c76fb70dd8778467015517d5ef22d22e44e284eb2967d504a8e7149ede5ad3a" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.452925 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.477207 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.532935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-config-data\") pod \"30477b21-33e4-46e9-a1dc-9264896a6e02\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.532987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-config-data\") pod \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.533051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8nfs\" (UniqueName: \"kubernetes.io/projected/30477b21-33e4-46e9-a1dc-9264896a6e02-kube-api-access-n8nfs\") pod \"30477b21-33e4-46e9-a1dc-9264896a6e02\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.533233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-combined-ca-bundle\") pod \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.533355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzz56\" (UniqueName: \"kubernetes.io/projected/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-kube-api-access-zzz56\") pod \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.533418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-logs\") pod \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\" (UID: \"4b4b47b7-6661-4bea-8bc5-e7d723b082d6\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.533498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-combined-ca-bundle\") pod \"30477b21-33e4-46e9-a1dc-9264896a6e02\" (UID: \"30477b21-33e4-46e9-a1dc-9264896a6e02\") " Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.537565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-logs" (OuterVolumeSpecName: "logs") pod "4b4b47b7-6661-4bea-8bc5-e7d723b082d6" (UID: "4b4b47b7-6661-4bea-8bc5-e7d723b082d6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.550412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30477b21-33e4-46e9-a1dc-9264896a6e02-kube-api-access-n8nfs" (OuterVolumeSpecName: "kube-api-access-n8nfs") pod "30477b21-33e4-46e9-a1dc-9264896a6e02" (UID: "30477b21-33e4-46e9-a1dc-9264896a6e02"). InnerVolumeSpecName "kube-api-access-n8nfs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.553310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-kube-api-access-zzz56" (OuterVolumeSpecName: "kube-api-access-zzz56") pod "4b4b47b7-6661-4bea-8bc5-e7d723b082d6" (UID: "4b4b47b7-6661-4bea-8bc5-e7d723b082d6"). InnerVolumeSpecName "kube-api-access-zzz56". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.574496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-config-data" (OuterVolumeSpecName: "config-data") pod "30477b21-33e4-46e9-a1dc-9264896a6e02" (UID: "30477b21-33e4-46e9-a1dc-9264896a6e02"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.578880 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b4b47b7-6661-4bea-8bc5-e7d723b082d6" (UID: "4b4b47b7-6661-4bea-8bc5-e7d723b082d6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.583718 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30477b21-33e4-46e9-a1dc-9264896a6e02" (UID: "30477b21-33e4-46e9-a1dc-9264896a6e02"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.590388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-config-data" (OuterVolumeSpecName: "config-data") pod "4b4b47b7-6661-4bea-8bc5-e7d723b082d6" (UID: "4b4b47b7-6661-4bea-8bc5-e7d723b082d6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635796 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635847 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30477b21-33e4-46e9-a1dc-9264896a6e02-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635856 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635865 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n8nfs\" (UniqueName: \"kubernetes.io/projected/30477b21-33e4-46e9-a1dc-9264896a6e02-kube-api-access-n8nfs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635877 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635885 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zzz56\" (UniqueName: \"kubernetes.io/projected/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-kube-api-access-zzz56\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.635893 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b4b47b7-6661-4bea-8bc5-e7d723b082d6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:49 crc kubenswrapper[4769]: I1121 12:39:49.649366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.473931 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.475777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerStarted","Data":"63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3"} Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.475905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.475453 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.542448 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.4287972 podStartE2EDuration="7.54242422s" podCreationTimestamp="2025-11-21 12:39:43 +0000 UTC" firstStartedPulling="2025-11-21 12:39:44.10372458 +0000 UTC m=+2942.804386398" lastFinishedPulling="2025-11-21 12:39:49.2173516 +0000 UTC m=+2947.918013418" observedRunningTime="2025-11-21 12:39:50.50672086 +0000 UTC m=+2949.207382748" watchObservedRunningTime="2025-11-21 12:39:50.54242422 +0000 UTC m=+2949.243086028" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.547332 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.557801 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.573725 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.605118 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: E1121 12:39:50.605702 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-log" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.605725 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-log" Nov 21 12:39:50 crc kubenswrapper[4769]: E1121 12:39:50.605765 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-metadata" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.605774 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-metadata" Nov 21 12:39:50 crc kubenswrapper[4769]: E1121 12:39:50.605788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30477b21-33e4-46e9-a1dc-9264896a6e02" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.605798 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30477b21-33e4-46e9-a1dc-9264896a6e02" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.606271 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-metadata" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.606348 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" containerName="nova-metadata-log" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.606364 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30477b21-33e4-46e9-a1dc-9264896a6e02" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.608312 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.610575 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.612387 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.623931 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.634978 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.636426 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.641352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.641709 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.642481 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.648384 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.658597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmr8\" (UniqueName: \"kubernetes.io/projected/f271eb2d-b489-4556-968a-b3f9c5144301-kube-api-access-dpmr8\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.658777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f271eb2d-b489-4556-968a-b3f9c5144301-logs\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.658823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.658869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-config-data\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.658987 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.663124 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmr8\" (UniqueName: \"kubernetes.io/projected/f271eb2d-b489-4556-968a-b3f9c5144301-kube-api-access-dpmr8\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760203 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760239 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8px\" (UniqueName: \"kubernetes.io/projected/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-kube-api-access-6b8px\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760441 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f271eb2d-b489-4556-968a-b3f9c5144301-logs\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-config-data\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.760957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.761123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.761351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f271eb2d-b489-4556-968a-b3f9c5144301-logs\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.765726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.766862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-config-data\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.767779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.781846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmr8\" (UniqueName: \"kubernetes.io/projected/f271eb2d-b489-4556-968a-b3f9c5144301-kube-api-access-dpmr8\") pod \"nova-metadata-0\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.866703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.867019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.867059 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8px\" (UniqueName: \"kubernetes.io/projected/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-kube-api-access-6b8px\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.867128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.867169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.870971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.871947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.872534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.873307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.888790 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8px\" (UniqueName: \"kubernetes.io/projected/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-kube-api-access-6b8px\") pod \"nova-cell1-novncproxy-0\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.942320 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:50 crc kubenswrapper[4769]: I1121 12:39:50.966348 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:51 crc kubenswrapper[4769]: I1121 12:39:51.311129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30477b21-33e4-46e9-a1dc-9264896a6e02" path="/var/lib/kubelet/pods/30477b21-33e4-46e9-a1dc-9264896a6e02/volumes" Nov 21 12:39:51 crc kubenswrapper[4769]: I1121 12:39:51.312718 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4b47b7-6661-4bea-8bc5-e7d723b082d6" path="/var/lib/kubelet/pods/4b4b47b7-6661-4bea-8bc5-e7d723b082d6/volumes" Nov 21 12:39:51 crc kubenswrapper[4769]: I1121 12:39:51.452360 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:39:51 crc kubenswrapper[4769]: I1121 12:39:51.461678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:51 crc kubenswrapper[4769]: W1121 12:39:51.466998 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bd67268_d5ea_4c3b_8d8a_7b252c582fa5.slice/crio-4e1acdd43bc05865cc99186c2a4f41e6c9b6d3d92f6a7d65650e91f8f82d5d94 WatchSource:0}: Error finding container 4e1acdd43bc05865cc99186c2a4f41e6c9b6d3d92f6a7d65650e91f8f82d5d94: Status 404 returned error can't find the container with id 4e1acdd43bc05865cc99186c2a4f41e6c9b6d3d92f6a7d65650e91f8f82d5d94 Nov 21 12:39:51 crc kubenswrapper[4769]: I1121 12:39:51.488925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f271eb2d-b489-4556-968a-b3f9c5144301","Type":"ContainerStarted","Data":"f4b5927e15cbc60dad50b1d8419cc9aae0dfa1fa36d40ef6161e74e80a0b137f"} Nov 21 12:39:52 crc kubenswrapper[4769]: I1121 12:39:52.504878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f271eb2d-b489-4556-968a-b3f9c5144301","Type":"ContainerStarted","Data":"efb5fe71ad34cc3680675ef911814c489e7b2913017f60e32bcd165b8019a7c2"} Nov 21 12:39:52 crc kubenswrapper[4769]: I1121 12:39:52.505867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f271eb2d-b489-4556-968a-b3f9c5144301","Type":"ContainerStarted","Data":"cba05b951ba3beafe3ac149850cbe483da79ff8190f0e7f3e6d35f2a3c755c00"} Nov 21 12:39:52 crc kubenswrapper[4769]: I1121 12:39:52.508741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5","Type":"ContainerStarted","Data":"9c0f1a84912c10da1c181ce099086af20f4da8bee6ba96e0698a1ddd91727820"} Nov 21 12:39:52 crc kubenswrapper[4769]: I1121 12:39:52.508880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5","Type":"ContainerStarted","Data":"4e1acdd43bc05865cc99186c2a4f41e6c9b6d3d92f6a7d65650e91f8f82d5d94"} Nov 21 12:39:52 crc kubenswrapper[4769]: I1121 12:39:52.540698 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.540669136 podStartE2EDuration="2.540669136s" podCreationTimestamp="2025-11-21 12:39:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:52.531606182 +0000 UTC m=+2951.232268040" watchObservedRunningTime="2025-11-21 12:39:52.540669136 +0000 UTC m=+2951.241330954" Nov 21 12:39:52 crc kubenswrapper[4769]: I1121 12:39:52.562016 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.5619982 podStartE2EDuration="2.5619982s" podCreationTimestamp="2025-11-21 12:39:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:39:52.555703481 +0000 UTC m=+2951.256365319" watchObservedRunningTime="2025-11-21 12:39:52.5619982 +0000 UTC m=+2951.262660008" Nov 21 12:39:54 crc kubenswrapper[4769]: I1121 12:39:54.531366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:54 crc kubenswrapper[4769]: I1121 12:39:54.532346 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:39:54 crc kubenswrapper[4769]: I1121 12:39:54.540048 4769 generic.go:334] "Generic (PLEG): container finished" podID="5955251c-5d2f-43ee-a371-883cfd5f4558" containerID="ef628575ad5099427844136ae8f72577c2e883ca1b8e68196ff62ea429410210" exitCode=0 Nov 21 12:39:54 crc kubenswrapper[4769]: I1121 12:39:54.540122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" event={"ID":"5955251c-5d2f-43ee-a371-883cfd5f4558","Type":"ContainerDied","Data":"ef628575ad5099427844136ae8f72577c2e883ca1b8e68196ff62ea429410210"} Nov 21 12:39:54 crc kubenswrapper[4769]: I1121 12:39:54.650130 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:54 crc kubenswrapper[4769]: I1121 12:39:54.688708 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.596791 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.615424 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.182:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.615451 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.182:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.943235 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.943695 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.966963 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:39:55 crc kubenswrapper[4769]: I1121 12:39:55.974981 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.104722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-scripts\") pod \"5955251c-5d2f-43ee-a371-883cfd5f4558\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.104858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-combined-ca-bundle\") pod \"5955251c-5d2f-43ee-a371-883cfd5f4558\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.104902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q4r9\" (UniqueName: \"kubernetes.io/projected/5955251c-5d2f-43ee-a371-883cfd5f4558-kube-api-access-9q4r9\") pod \"5955251c-5d2f-43ee-a371-883cfd5f4558\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.104937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-config-data\") pod \"5955251c-5d2f-43ee-a371-883cfd5f4558\" (UID: \"5955251c-5d2f-43ee-a371-883cfd5f4558\") " Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.114486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5955251c-5d2f-43ee-a371-883cfd5f4558-kube-api-access-9q4r9" (OuterVolumeSpecName: "kube-api-access-9q4r9") pod "5955251c-5d2f-43ee-a371-883cfd5f4558" (UID: "5955251c-5d2f-43ee-a371-883cfd5f4558"). InnerVolumeSpecName "kube-api-access-9q4r9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.115382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-scripts" (OuterVolumeSpecName: "scripts") pod "5955251c-5d2f-43ee-a371-883cfd5f4558" (UID: "5955251c-5d2f-43ee-a371-883cfd5f4558"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.155777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-config-data" (OuterVolumeSpecName: "config-data") pod "5955251c-5d2f-43ee-a371-883cfd5f4558" (UID: "5955251c-5d2f-43ee-a371-883cfd5f4558"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.160090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5955251c-5d2f-43ee-a371-883cfd5f4558" (UID: "5955251c-5d2f-43ee-a371-883cfd5f4558"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.207640 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9q4r9\" (UniqueName: \"kubernetes.io/projected/5955251c-5d2f-43ee-a371-883cfd5f4558-kube-api-access-9q4r9\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.207690 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.207705 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.207717 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5955251c-5d2f-43ee-a371-883cfd5f4558-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.567923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" event={"ID":"5955251c-5d2f-43ee-a371-883cfd5f4558","Type":"ContainerDied","Data":"789374ae713ef3ad45f1f89b64a5f37807568aaedaf64856db51c2fd7bccdd1d"} Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.567991 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="789374ae713ef3ad45f1f89b64a5f37807568aaedaf64856db51c2fd7bccdd1d" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.567947 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll" Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.770058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.770899 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-log" containerID="cri-o://db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e" gracePeriod=30 Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.770979 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-api" containerID="cri-o://24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677" gracePeriod=30 Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.783650 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.834926 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.835466 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-log" containerID="cri-o://cba05b951ba3beafe3ac149850cbe483da79ff8190f0e7f3e6d35f2a3c755c00" gracePeriod=30 Nov 21 12:39:56 crc kubenswrapper[4769]: I1121 12:39:56.835543 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-metadata" containerID="cri-o://efb5fe71ad34cc3680675ef911814c489e7b2913017f60e32bcd165b8019a7c2" gracePeriod=30 Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.581519 4769 generic.go:334] "Generic (PLEG): container finished" podID="f271eb2d-b489-4556-968a-b3f9c5144301" containerID="efb5fe71ad34cc3680675ef911814c489e7b2913017f60e32bcd165b8019a7c2" exitCode=0 Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.581559 4769 generic.go:334] "Generic (PLEG): container finished" podID="f271eb2d-b489-4556-968a-b3f9c5144301" containerID="cba05b951ba3beafe3ac149850cbe483da79ff8190f0e7f3e6d35f2a3c755c00" exitCode=143 Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.581611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f271eb2d-b489-4556-968a-b3f9c5144301","Type":"ContainerDied","Data":"efb5fe71ad34cc3680675ef911814c489e7b2913017f60e32bcd165b8019a7c2"} Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.581665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f271eb2d-b489-4556-968a-b3f9c5144301","Type":"ContainerDied","Data":"cba05b951ba3beafe3ac149850cbe483da79ff8190f0e7f3e6d35f2a3c755c00"} Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.581676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f271eb2d-b489-4556-968a-b3f9c5144301","Type":"ContainerDied","Data":"f4b5927e15cbc60dad50b1d8419cc9aae0dfa1fa36d40ef6161e74e80a0b137f"} Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.581694 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4b5927e15cbc60dad50b1d8419cc9aae0dfa1fa36d40ef6161e74e80a0b137f" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.585729 4769 generic.go:334] "Generic (PLEG): container finished" podID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerID="db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e" exitCode=143 Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.585913 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" containerName="nova-scheduler-scheduler" containerID="cri-o://d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce" gracePeriod=30 Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.586224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"02d74f0a-d57b-4d01-a90a-f9b5396e42fd","Type":"ContainerDied","Data":"db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e"} Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.652498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.753811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-config-data\") pod \"f271eb2d-b489-4556-968a-b3f9c5144301\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.753921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpmr8\" (UniqueName: \"kubernetes.io/projected/f271eb2d-b489-4556-968a-b3f9c5144301-kube-api-access-dpmr8\") pod \"f271eb2d-b489-4556-968a-b3f9c5144301\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.754065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-combined-ca-bundle\") pod \"f271eb2d-b489-4556-968a-b3f9c5144301\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.754143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f271eb2d-b489-4556-968a-b3f9c5144301-logs\") pod \"f271eb2d-b489-4556-968a-b3f9c5144301\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.754211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-nova-metadata-tls-certs\") pod \"f271eb2d-b489-4556-968a-b3f9c5144301\" (UID: \"f271eb2d-b489-4556-968a-b3f9c5144301\") " Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.755859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f271eb2d-b489-4556-968a-b3f9c5144301-logs" (OuterVolumeSpecName: "logs") pod "f271eb2d-b489-4556-968a-b3f9c5144301" (UID: "f271eb2d-b489-4556-968a-b3f9c5144301"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.762839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f271eb2d-b489-4556-968a-b3f9c5144301-kube-api-access-dpmr8" (OuterVolumeSpecName: "kube-api-access-dpmr8") pod "f271eb2d-b489-4556-968a-b3f9c5144301" (UID: "f271eb2d-b489-4556-968a-b3f9c5144301"). InnerVolumeSpecName "kube-api-access-dpmr8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.789741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f271eb2d-b489-4556-968a-b3f9c5144301" (UID: "f271eb2d-b489-4556-968a-b3f9c5144301"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.804552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-config-data" (OuterVolumeSpecName: "config-data") pod "f271eb2d-b489-4556-968a-b3f9c5144301" (UID: "f271eb2d-b489-4556-968a-b3f9c5144301"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.823052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f271eb2d-b489-4556-968a-b3f9c5144301" (UID: "f271eb2d-b489-4556-968a-b3f9c5144301"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.857297 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.857344 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dpmr8\" (UniqueName: \"kubernetes.io/projected/f271eb2d-b489-4556-968a-b3f9c5144301-kube-api-access-dpmr8\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.857357 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.857368 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f271eb2d-b489-4556-968a-b3f9c5144301-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:57 crc kubenswrapper[4769]: I1121 12:39:57.857377 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f271eb2d-b489-4556-968a-b3f9c5144301-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.604885 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.701940 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.719860 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.745455 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:58 crc kubenswrapper[4769]: E1121 12:39:58.746293 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-log" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.746324 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-log" Nov 21 12:39:58 crc kubenswrapper[4769]: E1121 12:39:58.746380 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5955251c-5d2f-43ee-a371-883cfd5f4558" containerName="nova-manage" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.746390 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5955251c-5d2f-43ee-a371-883cfd5f4558" containerName="nova-manage" Nov 21 12:39:58 crc kubenswrapper[4769]: E1121 12:39:58.746403 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-metadata" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.746410 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-metadata" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.746672 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5955251c-5d2f-43ee-a371-883cfd5f4558" containerName="nova-manage" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.746709 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-metadata" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.746720 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" containerName="nova-metadata-log" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.748266 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.751113 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.752035 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.755807 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.880658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5g8\" (UniqueName: \"kubernetes.io/projected/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-kube-api-access-2j5g8\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.880734 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-config-data\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.880932 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-logs\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.881455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.881838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.983502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.983582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5g8\" (UniqueName: \"kubernetes.io/projected/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-kube-api-access-2j5g8\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.983650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-config-data\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.983701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-logs\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.983765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.984292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-logs\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.989395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.990095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-config-data\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:58 crc kubenswrapper[4769]: I1121 12:39:58.990260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.004177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5g8\" (UniqueName: \"kubernetes.io/projected/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-kube-api-access-2j5g8\") pod \"nova-metadata-0\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.066095 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.224646 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.294723 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f271eb2d-b489-4556-968a-b3f9c5144301" path="/var/lib/kubelet/pods/f271eb2d-b489-4556-968a-b3f9c5144301/volumes" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.391645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-combined-ca-bundle\") pod \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.391746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdx2j\" (UniqueName: \"kubernetes.io/projected/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-kube-api-access-mdx2j\") pod \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.391772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-config-data\") pod \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\" (UID: \"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4\") " Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.398230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-kube-api-access-mdx2j" (OuterVolumeSpecName: "kube-api-access-mdx2j") pod "b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" (UID: "b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4"). InnerVolumeSpecName "kube-api-access-mdx2j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.426518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" (UID: "b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.432356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-config-data" (OuterVolumeSpecName: "config-data") pod "b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" (UID: "b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.494290 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.494556 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mdx2j\" (UniqueName: \"kubernetes.io/projected/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-kube-api-access-mdx2j\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.494654 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.532435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:39:59 crc kubenswrapper[4769]: W1121 12:39:59.535668 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ee9f4ac_de8b_4212_813a_3cb2d0be5fde.slice/crio-79fd26e98757102e485b02d9ef0b9f8dc60cd877d083e56c626ea8334fe5f6ea WatchSource:0}: Error finding container 79fd26e98757102e485b02d9ef0b9f8dc60cd877d083e56c626ea8334fe5f6ea: Status 404 returned error can't find the container with id 79fd26e98757102e485b02d9ef0b9f8dc60cd877d083e56c626ea8334fe5f6ea Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.626412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde","Type":"ContainerStarted","Data":"79fd26e98757102e485b02d9ef0b9f8dc60cd877d083e56c626ea8334fe5f6ea"} Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.630002 4769 generic.go:334] "Generic (PLEG): container finished" podID="b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" containerID="d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce" exitCode=0 Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.630141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.630222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4","Type":"ContainerDied","Data":"d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce"} Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.630270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4","Type":"ContainerDied","Data":"3d746cbb6fcfbc11a93c00f786d54d238e1794b91ac7281edfbb27ed0b62b524"} Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.630301 4769 scope.go:117] "RemoveContainer" containerID="d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.671544 4769 scope.go:117] "RemoveContainer" containerID="d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce" Nov 21 12:39:59 crc kubenswrapper[4769]: E1121 12:39:59.672330 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce\": container with ID starting with d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce not found: ID does not exist" containerID="d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.672385 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce"} err="failed to get container status \"d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce\": rpc error: code = NotFound desc = could not find container \"d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce\": container with ID starting with d971f120ff432f3a4aaba83a424c219a3c77f7b5a2d56d77f01aafdc2c0f73ce not found: ID does not exist" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.683905 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.698958 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.721798 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:59 crc kubenswrapper[4769]: E1121 12:39:59.722633 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" containerName="nova-scheduler-scheduler" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.722736 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" containerName="nova-scheduler-scheduler" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.723122 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" containerName="nova-scheduler-scheduler" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.725136 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.729595 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.735484 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.903456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pn6l\" (UniqueName: \"kubernetes.io/projected/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-kube-api-access-7pn6l\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.903641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-config-data\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:39:59 crc kubenswrapper[4769]: I1121 12:39:59.903691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.006545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-config-data\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.006607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.006674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7pn6l\" (UniqueName: \"kubernetes.io/projected/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-kube-api-access-7pn6l\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.011908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-config-data\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.011968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.023089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pn6l\" (UniqueName: \"kubernetes.io/projected/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-kube-api-access-7pn6l\") pod \"nova-scheduler-0\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.065528 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.527985 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:00 crc kubenswrapper[4769]: W1121 12:40:00.531826 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f79a38e_9a3b_42e6_8732_0dd1ab9788e6.slice/crio-48e3e82760fc2868a59a484ed9d018cedf27465a1199caa7bb8959d00a2cc8a5 WatchSource:0}: Error finding container 48e3e82760fc2868a59a484ed9d018cedf27465a1199caa7bb8959d00a2cc8a5: Status 404 returned error can't find the container with id 48e3e82760fc2868a59a484ed9d018cedf27465a1199caa7bb8959d00a2cc8a5 Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.652006 4769 generic.go:334] "Generic (PLEG): container finished" podID="242ebd44-6200-4f38-acd8-e48ababc139d" containerID="2bd33ac784cf09190eda17873d45df781be1d4b88d4cf0d042c51c2b6f9aa9f4" exitCode=0 Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.652093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" event={"ID":"242ebd44-6200-4f38-acd8-e48ababc139d","Type":"ContainerDied","Data":"2bd33ac784cf09190eda17873d45df781be1d4b88d4cf0d042c51c2b6f9aa9f4"} Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.654848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6","Type":"ContainerStarted","Data":"48e3e82760fc2868a59a484ed9d018cedf27465a1199caa7bb8959d00a2cc8a5"} Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.658944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde","Type":"ContainerStarted","Data":"d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4"} Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.658994 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde","Type":"ContainerStarted","Data":"d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a"} Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.697109 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.697087167 podStartE2EDuration="2.697087167s" podCreationTimestamp="2025-11-21 12:39:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:00.687355325 +0000 UTC m=+2959.388017143" watchObservedRunningTime="2025-11-21 12:40:00.697087167 +0000 UTC m=+2959.397748985" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.967909 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:40:00 crc kubenswrapper[4769]: I1121 12:40:00.990479 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:40:01 crc kubenswrapper[4769]: I1121 12:40:01.285175 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4" path="/var/lib/kubelet/pods/b982c2bf-825a-4eb5-84a8-a2b7d2fbdba4/volumes" Nov 21 12:40:01 crc kubenswrapper[4769]: I1121 12:40:01.692421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6","Type":"ContainerStarted","Data":"cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe"} Nov 21 12:40:01 crc kubenswrapper[4769]: I1121 12:40:01.722410 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:40:01 crc kubenswrapper[4769]: I1121 12:40:01.731020 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.730993076 podStartE2EDuration="2.730993076s" podCreationTimestamp="2025-11-21 12:39:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:01.713903196 +0000 UTC m=+2960.414565014" watchObservedRunningTime="2025-11-21 12:40:01.730993076 +0000 UTC m=+2960.431654914" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.161437 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.256412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-scripts\") pod \"242ebd44-6200-4f38-acd8-e48ababc139d\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.256631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-config-data\") pod \"242ebd44-6200-4f38-acd8-e48ababc139d\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.256733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrnpz\" (UniqueName: \"kubernetes.io/projected/242ebd44-6200-4f38-acd8-e48ababc139d-kube-api-access-wrnpz\") pod \"242ebd44-6200-4f38-acd8-e48ababc139d\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.256843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-combined-ca-bundle\") pod \"242ebd44-6200-4f38-acd8-e48ababc139d\" (UID: \"242ebd44-6200-4f38-acd8-e48ababc139d\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.263022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-scripts" (OuterVolumeSpecName: "scripts") pod "242ebd44-6200-4f38-acd8-e48ababc139d" (UID: "242ebd44-6200-4f38-acd8-e48ababc139d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.264903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242ebd44-6200-4f38-acd8-e48ababc139d-kube-api-access-wrnpz" (OuterVolumeSpecName: "kube-api-access-wrnpz") pod "242ebd44-6200-4f38-acd8-e48ababc139d" (UID: "242ebd44-6200-4f38-acd8-e48ababc139d"). InnerVolumeSpecName "kube-api-access-wrnpz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.291403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-config-data" (OuterVolumeSpecName: "config-data") pod "242ebd44-6200-4f38-acd8-e48ababc139d" (UID: "242ebd44-6200-4f38-acd8-e48ababc139d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.310346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "242ebd44-6200-4f38-acd8-e48ababc139d" (UID: "242ebd44-6200-4f38-acd8-e48ababc139d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.360928 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.361204 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.361294 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wrnpz\" (UniqueName: \"kubernetes.io/projected/242ebd44-6200-4f38-acd8-e48ababc139d-kube-api-access-wrnpz\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.361373 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/242ebd44-6200-4f38-acd8-e48ababc139d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.664507 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.726172 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.727461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6" event={"ID":"242ebd44-6200-4f38-acd8-e48ababc139d","Type":"ContainerDied","Data":"456eb44b9e5736c95dc73da50a490c497eab6550824e7c9d681ffd0ac795790d"} Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.727572 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="456eb44b9e5736c95dc73da50a490c497eab6550824e7c9d681ffd0ac795790d" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.730093 4769 generic.go:334] "Generic (PLEG): container finished" podID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerID="24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677" exitCode=0 Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.730276 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.730324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"02d74f0a-d57b-4d01-a90a-f9b5396e42fd","Type":"ContainerDied","Data":"24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677"} Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.730448 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"02d74f0a-d57b-4d01-a90a-f9b5396e42fd","Type":"ContainerDied","Data":"143f566a987670aa4689c5e8b0c30a01edae6301c1f9f7443b8812a51eb23a00"} Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.730490 4769 scope.go:117] "RemoveContainer" containerID="24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.775317 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:40:02 crc kubenswrapper[4769]: E1121 12:40:02.775864 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-log" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.775880 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-log" Nov 21 12:40:02 crc kubenswrapper[4769]: E1121 12:40:02.775918 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="242ebd44-6200-4f38-acd8-e48ababc139d" containerName="nova-cell1-conductor-db-sync" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.775928 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="242ebd44-6200-4f38-acd8-e48ababc139d" containerName="nova-cell1-conductor-db-sync" Nov 21 12:40:02 crc kubenswrapper[4769]: E1121 12:40:02.775943 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-api" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.775951 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-api" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.776181 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="242ebd44-6200-4f38-acd8-e48ababc139d" containerName="nova-cell1-conductor-db-sync" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.776404 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-log" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.776421 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" containerName="nova-api-api" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.777401 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.786740 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.804682 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.825515 4769 scope.go:117] "RemoveContainer" containerID="db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.853134 4769 scope.go:117] "RemoveContainer" containerID="24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677" Nov 21 12:40:02 crc kubenswrapper[4769]: E1121 12:40:02.853612 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677\": container with ID starting with 24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677 not found: ID does not exist" containerID="24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.853649 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677"} err="failed to get container status \"24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677\": rpc error: code = NotFound desc = could not find container \"24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677\": container with ID starting with 24e9e590d014996669c777a5ea9e10ff151f5d38c7f7b2bf3983161482a23677 not found: ID does not exist" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.853671 4769 scope.go:117] "RemoveContainer" containerID="db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e" Nov 21 12:40:02 crc kubenswrapper[4769]: E1121 12:40:02.854526 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e\": container with ID starting with db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e not found: ID does not exist" containerID="db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.854566 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e"} err="failed to get container status \"db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e\": rpc error: code = NotFound desc = could not find container \"db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e\": container with ID starting with db4a16f88791af4f3df43d6045334c335cdf80cc4bcbe6db8a2cfde8ede24b3e not found: ID does not exist" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.873879 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t8fx\" (UniqueName: \"kubernetes.io/projected/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-kube-api-access-7t8fx\") pod \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.874013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-combined-ca-bundle\") pod \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.874153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-logs\") pod \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.874305 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-config-data\") pod \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\" (UID: \"02d74f0a-d57b-4d01-a90a-f9b5396e42fd\") " Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.874624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.875000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.875018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-logs" (OuterVolumeSpecName: "logs") pod "02d74f0a-d57b-4d01-a90a-f9b5396e42fd" (UID: "02d74f0a-d57b-4d01-a90a-f9b5396e42fd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.875243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgz8z\" (UniqueName: \"kubernetes.io/projected/f215726f-5d62-4daf-98e4-270f4778542f-kube-api-access-cgz8z\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.875727 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.878372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-kube-api-access-7t8fx" (OuterVolumeSpecName: "kube-api-access-7t8fx") pod "02d74f0a-d57b-4d01-a90a-f9b5396e42fd" (UID: "02d74f0a-d57b-4d01-a90a-f9b5396e42fd"). InnerVolumeSpecName "kube-api-access-7t8fx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.906654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-config-data" (OuterVolumeSpecName: "config-data") pod "02d74f0a-d57b-4d01-a90a-f9b5396e42fd" (UID: "02d74f0a-d57b-4d01-a90a-f9b5396e42fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.911803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "02d74f0a-d57b-4d01-a90a-f9b5396e42fd" (UID: "02d74f0a-d57b-4d01-a90a-f9b5396e42fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.977525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.977633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cgz8z\" (UniqueName: \"kubernetes.io/projected/f215726f-5d62-4daf-98e4-270f4778542f-kube-api-access-cgz8z\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.977710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.977829 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7t8fx\" (UniqueName: \"kubernetes.io/projected/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-kube-api-access-7t8fx\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.977847 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.977856 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/02d74f0a-d57b-4d01-a90a-f9b5396e42fd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.981717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.983514 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:02 crc kubenswrapper[4769]: I1121 12:40:02.999878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgz8z\" (UniqueName: \"kubernetes.io/projected/f215726f-5d62-4daf-98e4-270f4778542f-kube-api-access-cgz8z\") pod \"nova-cell1-conductor-0\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.126845 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.127420 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.139323 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.163601 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.177494 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.183964 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.194742 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.294586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbnqq\" (UniqueName: \"kubernetes.io/projected/002f54a8-683e-4541-a0b8-19ec215b3751-kube-api-access-bbnqq\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.294763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-config-data\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.294931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/002f54a8-683e-4541-a0b8-19ec215b3751-logs\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.294963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.304245 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d74f0a-d57b-4d01-a90a-f9b5396e42fd" path="/var/lib/kubelet/pods/02d74f0a-d57b-4d01-a90a-f9b5396e42fd/volumes" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.397623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bbnqq\" (UniqueName: \"kubernetes.io/projected/002f54a8-683e-4541-a0b8-19ec215b3751-kube-api-access-bbnqq\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.397751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-config-data\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.397905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/002f54a8-683e-4541-a0b8-19ec215b3751-logs\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.397936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.399270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/002f54a8-683e-4541-a0b8-19ec215b3751-logs\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.410592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.411577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-config-data\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.422744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbnqq\" (UniqueName: \"kubernetes.io/projected/002f54a8-683e-4541-a0b8-19ec215b3751-kube-api-access-bbnqq\") pod \"nova-api-0\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.626473 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.704550 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:40:03 crc kubenswrapper[4769]: W1121 12:40:03.706737 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf215726f_5d62_4daf_98e4_270f4778542f.slice/crio-2af25815c86e49bd7cba6c2365cbca8ddf9a26d876efe1f9be036dfe41e1ad52 WatchSource:0}: Error finding container 2af25815c86e49bd7cba6c2365cbca8ddf9a26d876efe1f9be036dfe41e1ad52: Status 404 returned error can't find the container with id 2af25815c86e49bd7cba6c2365cbca8ddf9a26d876efe1f9be036dfe41e1ad52 Nov 21 12:40:03 crc kubenswrapper[4769]: I1121 12:40:03.749488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f215726f-5d62-4daf-98e4-270f4778542f","Type":"ContainerStarted","Data":"2af25815c86e49bd7cba6c2365cbca8ddf9a26d876efe1f9be036dfe41e1ad52"} Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.066637 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.066737 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.158844 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.767894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f215726f-5d62-4daf-98e4-270f4778542f","Type":"ContainerStarted","Data":"476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15"} Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.770277 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.775141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"002f54a8-683e-4541-a0b8-19ec215b3751","Type":"ContainerStarted","Data":"a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638"} Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.775182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"002f54a8-683e-4541-a0b8-19ec215b3751","Type":"ContainerStarted","Data":"90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f"} Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.775219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"002f54a8-683e-4541-a0b8-19ec215b3751","Type":"ContainerStarted","Data":"d7080319a418e4152d7b00c76622b763df64e1b978fa3354e36fa3c8807d2a0b"} Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.804637 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.804609706 podStartE2EDuration="2.804609706s" podCreationTimestamp="2025-11-21 12:40:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:04.792332126 +0000 UTC m=+2963.492993954" watchObservedRunningTime="2025-11-21 12:40:04.804609706 +0000 UTC m=+2963.505271524" Nov 21 12:40:04 crc kubenswrapper[4769]: I1121 12:40:04.825123 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.825096497 podStartE2EDuration="1.825096497s" podCreationTimestamp="2025-11-21 12:40:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:04.817862592 +0000 UTC m=+2963.518524430" watchObservedRunningTime="2025-11-21 12:40:04.825096497 +0000 UTC m=+2963.525758325" Nov 21 12:40:05 crc kubenswrapper[4769]: I1121 12:40:05.066453 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.160860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.714218 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8"] Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.716452 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.719246 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.719755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.732202 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8"] Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.761320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-scripts\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.761405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.761463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brtqp\" (UniqueName: \"kubernetes.io/projected/e885e099-14b4-44ec-bee0-c4d226c41bbd-kube-api-access-brtqp\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.761492 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-config-data\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.862864 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.862966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-brtqp\" (UniqueName: \"kubernetes.io/projected/e885e099-14b4-44ec-bee0-c4d226c41bbd-kube-api-access-brtqp\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.862995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-config-data\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.863242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-scripts\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.872425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-config-data\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.872962 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-scripts\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.873046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:08 crc kubenswrapper[4769]: I1121 12:40:08.899767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-brtqp\" (UniqueName: \"kubernetes.io/projected/e885e099-14b4-44ec-bee0-c4d226c41bbd-kube-api-access-brtqp\") pod \"nova-cell1-cell-mapping-fjvf8\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:09 crc kubenswrapper[4769]: I1121 12:40:09.043322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:09 crc kubenswrapper[4769]: I1121 12:40:09.066728 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:09 crc kubenswrapper[4769]: I1121 12:40:09.066834 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:09 crc kubenswrapper[4769]: I1121 12:40:09.561844 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8"] Nov 21 12:40:09 crc kubenswrapper[4769]: W1121 12:40:09.568444 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode885e099_14b4_44ec_bee0_c4d226c41bbd.slice/crio-48bf78ffede689975efa197f1a5c4729e80cc36a43c30af14f7a3b4652ac96f6 WatchSource:0}: Error finding container 48bf78ffede689975efa197f1a5c4729e80cc36a43c30af14f7a3b4652ac96f6: Status 404 returned error can't find the container with id 48bf78ffede689975efa197f1a5c4729e80cc36a43c30af14f7a3b4652ac96f6 Nov 21 12:40:09 crc kubenswrapper[4769]: I1121 12:40:09.856243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" event={"ID":"e885e099-14b4-44ec-bee0-c4d226c41bbd","Type":"ContainerStarted","Data":"48bf78ffede689975efa197f1a5c4729e80cc36a43c30af14f7a3b4652ac96f6"} Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.070440 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.093363 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.189:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.093500 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.189:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.106653 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.875120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" event={"ID":"e885e099-14b4-44ec-bee0-c4d226c41bbd","Type":"ContainerStarted","Data":"56c860160f723ef3edb50ab1ab4409fdd423e7ca83722f08db57402864c0e2dd"} Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.909147 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" podStartSLOduration=2.909128067 podStartE2EDuration="2.909128067s" podCreationTimestamp="2025-11-21 12:40:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:10.900219237 +0000 UTC m=+2969.600881065" watchObservedRunningTime="2025-11-21 12:40:10.909128067 +0000 UTC m=+2969.609789885" Nov 21 12:40:10 crc kubenswrapper[4769]: I1121 12:40:10.916659 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:11 crc kubenswrapper[4769]: I1121 12:40:11.088803 4769 scope.go:117] "RemoveContainer" containerID="96b9af56550c86e7119536df9ae1661ccc78a860f833a10c1a8b5659eabf3eed" Nov 21 12:40:11 crc kubenswrapper[4769]: I1121 12:40:11.138244 4769 scope.go:117] "RemoveContainer" containerID="d6a457d464595b97b2846de1cc10537433fb67df2c69a1e090820cdbf0ce6106" Nov 21 12:40:11 crc kubenswrapper[4769]: I1121 12:40:11.209456 4769 scope.go:117] "RemoveContainer" containerID="d01cc36f3c2c2d74fd2ff72845df2f626a95d928f5fba546a1cf55bf6f5e34d0" Nov 21 12:40:13 crc kubenswrapper[4769]: I1121 12:40:13.556957 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:13 crc kubenswrapper[4769]: I1121 12:40:13.627578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:13 crc kubenswrapper[4769]: I1121 12:40:13.627674 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:14 crc kubenswrapper[4769]: I1121 12:40:14.710571 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.192:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:14 crc kubenswrapper[4769]: I1121 12:40:14.710590 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.192:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:14 crc kubenswrapper[4769]: I1121 12:40:14.946507 4769 generic.go:334] "Generic (PLEG): container finished" podID="e885e099-14b4-44ec-bee0-c4d226c41bbd" containerID="56c860160f723ef3edb50ab1ab4409fdd423e7ca83722f08db57402864c0e2dd" exitCode=0 Nov 21 12:40:14 crc kubenswrapper[4769]: I1121 12:40:14.946563 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" event={"ID":"e885e099-14b4-44ec-bee0-c4d226c41bbd","Type":"ContainerDied","Data":"56c860160f723ef3edb50ab1ab4409fdd423e7ca83722f08db57402864c0e2dd"} Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.394297 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.429249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-config-data\") pod \"e885e099-14b4-44ec-bee0-c4d226c41bbd\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.429297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-combined-ca-bundle\") pod \"e885e099-14b4-44ec-bee0-c4d226c41bbd\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.429333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-scripts\") pod \"e885e099-14b4-44ec-bee0-c4d226c41bbd\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.429360 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brtqp\" (UniqueName: \"kubernetes.io/projected/e885e099-14b4-44ec-bee0-c4d226c41bbd-kube-api-access-brtqp\") pod \"e885e099-14b4-44ec-bee0-c4d226c41bbd\" (UID: \"e885e099-14b4-44ec-bee0-c4d226c41bbd\") " Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.438243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-scripts" (OuterVolumeSpecName: "scripts") pod "e885e099-14b4-44ec-bee0-c4d226c41bbd" (UID: "e885e099-14b4-44ec-bee0-c4d226c41bbd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.438468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e885e099-14b4-44ec-bee0-c4d226c41bbd-kube-api-access-brtqp" (OuterVolumeSpecName: "kube-api-access-brtqp") pod "e885e099-14b4-44ec-bee0-c4d226c41bbd" (UID: "e885e099-14b4-44ec-bee0-c4d226c41bbd"). InnerVolumeSpecName "kube-api-access-brtqp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.471885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e885e099-14b4-44ec-bee0-c4d226c41bbd" (UID: "e885e099-14b4-44ec-bee0-c4d226c41bbd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.472682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-config-data" (OuterVolumeSpecName: "config-data") pod "e885e099-14b4-44ec-bee0-c4d226c41bbd" (UID: "e885e099-14b4-44ec-bee0-c4d226c41bbd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.532147 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.532203 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.532222 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e885e099-14b4-44ec-bee0-c4d226c41bbd-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.532236 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-brtqp\" (UniqueName: \"kubernetes.io/projected/e885e099-14b4-44ec-bee0-c4d226c41bbd-kube-api-access-brtqp\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.973544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" event={"ID":"e885e099-14b4-44ec-bee0-c4d226c41bbd","Type":"ContainerDied","Data":"48bf78ffede689975efa197f1a5c4729e80cc36a43c30af14f7a3b4652ac96f6"} Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.973606 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8" Nov 21 12:40:16 crc kubenswrapper[4769]: I1121 12:40:16.973630 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48bf78ffede689975efa197f1a5c4729e80cc36a43c30af14f7a3b4652ac96f6" Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.241033 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.241482 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-log" containerID="cri-o://90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f" gracePeriod=30 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.241726 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-api" containerID="cri-o://a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638" gracePeriod=30 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.267085 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.267406 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" containerName="nova-scheduler-scheduler" containerID="cri-o://cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" gracePeriod=30 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.292415 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.292817 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-metadata" containerID="cri-o://d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4" gracePeriod=30 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.293692 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-log" containerID="cri-o://d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a" gracePeriod=30 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.531285 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.531515 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" containerName="kube-state-metrics" containerID="cri-o://a9bec5a1fbb440b3cc63d47a3f753453d4ee93006f4a273dd0fc0c707e59ac2e" gracePeriod=30 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.988200 4769 generic.go:334] "Generic (PLEG): container finished" podID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerID="d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a" exitCode=143 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.988590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde","Type":"ContainerDied","Data":"d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a"} Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.990307 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" containerID="a9bec5a1fbb440b3cc63d47a3f753453d4ee93006f4a273dd0fc0c707e59ac2e" exitCode=2 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.990386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d","Type":"ContainerDied","Data":"a9bec5a1fbb440b3cc63d47a3f753453d4ee93006f4a273dd0fc0c707e59ac2e"} Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.990441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d","Type":"ContainerDied","Data":"51ea29de8c223b4cff5eac272219bbc099b2cb00e355282de763a90fad326a5f"} Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.990459 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51ea29de8c223b4cff5eac272219bbc099b2cb00e355282de763a90fad326a5f" Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.992765 4769 generic.go:334] "Generic (PLEG): container finished" podID="002f54a8-683e-4541-a0b8-19ec215b3751" containerID="90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f" exitCode=143 Nov 21 12:40:17 crc kubenswrapper[4769]: I1121 12:40:17.992818 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"002f54a8-683e-4541-a0b8-19ec215b3751","Type":"ContainerDied","Data":"90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f"} Nov 21 12:40:18 crc kubenswrapper[4769]: I1121 12:40:18.096988 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:18 crc kubenswrapper[4769]: I1121 12:40:18.189267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6plzz\" (UniqueName: \"kubernetes.io/projected/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d-kube-api-access-6plzz\") pod \"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d\" (UID: \"ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d\") " Nov 21 12:40:18 crc kubenswrapper[4769]: I1121 12:40:18.198086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d-kube-api-access-6plzz" (OuterVolumeSpecName: "kube-api-access-6plzz") pod "ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" (UID: "ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d"). InnerVolumeSpecName "kube-api-access-6plzz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:18 crc kubenswrapper[4769]: I1121 12:40:18.292141 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6plzz\" (UniqueName: \"kubernetes.io/projected/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d-kube-api-access-6plzz\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.003943 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.069353 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.084787 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.096220 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:40:19 crc kubenswrapper[4769]: E1121 12:40:19.096853 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e885e099-14b4-44ec-bee0-c4d226c41bbd" containerName="nova-manage" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.096876 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e885e099-14b4-44ec-bee0-c4d226c41bbd" containerName="nova-manage" Nov 21 12:40:19 crc kubenswrapper[4769]: E1121 12:40:19.096895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" containerName="kube-state-metrics" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.096905 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" containerName="kube-state-metrics" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.097173 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" containerName="kube-state-metrics" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.097301 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e885e099-14b4-44ec-bee0-c4d226c41bbd" containerName="nova-manage" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.098421 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.103758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.103996 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.108376 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.211970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.212372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.212867 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffsk\" (UniqueName: \"kubernetes.io/projected/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-api-access-hffsk\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.213221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.290910 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d" path="/var/lib/kubelet/pods/ce2f5c70-2119-4a9b-9f48-7a14ebf04f4d/volumes" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.314822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.315017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hffsk\" (UniqueName: \"kubernetes.io/projected/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-api-access-hffsk\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.315178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.315246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.322301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.323499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.324343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.350628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffsk\" (UniqueName: \"kubernetes.io/projected/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-api-access-hffsk\") pod \"kube-state-metrics-0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.417393 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.417724 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-central-agent" containerID="cri-o://bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67" gracePeriod=30 Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.417856 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="proxy-httpd" containerID="cri-o://63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3" gracePeriod=30 Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.417912 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="sg-core" containerID="cri-o://669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4" gracePeriod=30 Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.417954 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-notification-agent" containerID="cri-o://717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e" gracePeriod=30 Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.426050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:19 crc kubenswrapper[4769]: W1121 12:40:19.951587 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff7d33ec_3dd6_40bc_a371_734a70ab6ed0.slice/crio-8d96f02488a3f633b37692a35b46d104efd4be4b607c40c02f695a51f1aa846a WatchSource:0}: Error finding container 8d96f02488a3f633b37692a35b46d104efd4be4b607c40c02f695a51f1aa846a: Status 404 returned error can't find the container with id 8d96f02488a3f633b37692a35b46d104efd4be4b607c40c02f695a51f1aa846a Nov 21 12:40:19 crc kubenswrapper[4769]: I1121 12:40:19.953741 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.025809 4769 generic.go:334] "Generic (PLEG): container finished" podID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerID="63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3" exitCode=0 Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.025847 4769 generic.go:334] "Generic (PLEG): container finished" podID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerID="669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4" exitCode=2 Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.025859 4769 generic.go:334] "Generic (PLEG): container finished" podID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerID="bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67" exitCode=0 Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.025931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerDied","Data":"63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3"} Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.026036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerDied","Data":"669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4"} Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.026060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerDied","Data":"bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67"} Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.028668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0","Type":"ContainerStarted","Data":"8d96f02488a3f633b37692a35b46d104efd4be4b607c40c02f695a51f1aa846a"} Nov 21 12:40:20 crc kubenswrapper[4769]: E1121 12:40:20.068374 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:40:20 crc kubenswrapper[4769]: E1121 12:40:20.070781 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:40:20 crc kubenswrapper[4769]: E1121 12:40:20.072830 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:40:20 crc kubenswrapper[4769]: E1121 12:40:20.072907 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" containerName="nova-scheduler-scheduler" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.897251 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.904998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/002f54a8-683e-4541-a0b8-19ec215b3751-logs\") pod \"002f54a8-683e-4541-a0b8-19ec215b3751\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbnqq\" (UniqueName: \"kubernetes.io/projected/002f54a8-683e-4541-a0b8-19ec215b3751-kube-api-access-bbnqq\") pod \"002f54a8-683e-4541-a0b8-19ec215b3751\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-combined-ca-bundle\") pod \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-logs\") pod \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-config-data\") pod \"002f54a8-683e-4541-a0b8-19ec215b3751\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954861 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-config-data\") pod \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j5g8\" (UniqueName: \"kubernetes.io/projected/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-kube-api-access-2j5g8\") pod \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.954987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-nova-metadata-tls-certs\") pod \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\" (UID: \"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.955029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-combined-ca-bundle\") pod \"002f54a8-683e-4541-a0b8-19ec215b3751\" (UID: \"002f54a8-683e-4541-a0b8-19ec215b3751\") " Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.955725 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-logs" (OuterVolumeSpecName: "logs") pod "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" (UID: "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.956313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002f54a8-683e-4541-a0b8-19ec215b3751-logs" (OuterVolumeSpecName: "logs") pod "002f54a8-683e-4541-a0b8-19ec215b3751" (UID: "002f54a8-683e-4541-a0b8-19ec215b3751"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.964363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-kube-api-access-2j5g8" (OuterVolumeSpecName: "kube-api-access-2j5g8") pod "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" (UID: "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde"). InnerVolumeSpecName "kube-api-access-2j5g8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.965661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002f54a8-683e-4541-a0b8-19ec215b3751-kube-api-access-bbnqq" (OuterVolumeSpecName: "kube-api-access-bbnqq") pod "002f54a8-683e-4541-a0b8-19ec215b3751" (UID: "002f54a8-683e-4541-a0b8-19ec215b3751"). InnerVolumeSpecName "kube-api-access-bbnqq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.990138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-config-data" (OuterVolumeSpecName: "config-data") pod "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" (UID: "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:20 crc kubenswrapper[4769]: I1121 12:40:20.998469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "002f54a8-683e-4541-a0b8-19ec215b3751" (UID: "002f54a8-683e-4541-a0b8-19ec215b3751"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.000571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" (UID: "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.002737 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-config-data" (OuterVolumeSpecName: "config-data") pod "002f54a8-683e-4541-a0b8-19ec215b3751" (UID: "002f54a8-683e-4541-a0b8-19ec215b3751"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.029764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" (UID: "7ee9f4ac-de8b-4212-813a-3cb2d0be5fde"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.046035 4769 generic.go:334] "Generic (PLEG): container finished" podID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerID="d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4" exitCode=0 Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.046232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.046426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde","Type":"ContainerDied","Data":"d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4"} Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.046497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7ee9f4ac-de8b-4212-813a-3cb2d0be5fde","Type":"ContainerDied","Data":"79fd26e98757102e485b02d9ef0b9f8dc60cd877d083e56c626ea8334fe5f6ea"} Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.046525 4769 scope.go:117] "RemoveContainer" containerID="d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.048963 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0","Type":"ContainerStarted","Data":"e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2"} Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.049384 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.054630 4769 generic.go:334] "Generic (PLEG): container finished" podID="002f54a8-683e-4541-a0b8-19ec215b3751" containerID="a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638" exitCode=0 Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.054677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"002f54a8-683e-4541-a0b8-19ec215b3751","Type":"ContainerDied","Data":"a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638"} Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.054729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"002f54a8-683e-4541-a0b8-19ec215b3751","Type":"ContainerDied","Data":"d7080319a418e4152d7b00c76622b763df64e1b978fa3354e36fa3c8807d2a0b"} Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.054894 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065255 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065330 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065356 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/002f54a8-683e-4541-a0b8-19ec215b3751-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065373 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bbnqq\" (UniqueName: \"kubernetes.io/projected/002f54a8-683e-4541-a0b8-19ec215b3751-kube-api-access-bbnqq\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065396 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065435 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065447 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/002f54a8-683e-4541-a0b8-19ec215b3751-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065465 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.065475 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2j5g8\" (UniqueName: \"kubernetes.io/projected/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde-kube-api-access-2j5g8\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.079601 4769 scope.go:117] "RemoveContainer" containerID="d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.086402 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.663686582 podStartE2EDuration="2.086381811s" podCreationTimestamp="2025-11-21 12:40:19 +0000 UTC" firstStartedPulling="2025-11-21 12:40:19.957122628 +0000 UTC m=+2978.657784446" lastFinishedPulling="2025-11-21 12:40:20.379817837 +0000 UTC m=+2979.080479675" observedRunningTime="2025-11-21 12:40:21.06959803 +0000 UTC m=+2979.770259858" watchObservedRunningTime="2025-11-21 12:40:21.086381811 +0000 UTC m=+2979.787043629" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.117841 4769 scope.go:117] "RemoveContainer" containerID="d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.120087 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4\": container with ID starting with d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4 not found: ID does not exist" containerID="d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.120169 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4"} err="failed to get container status \"d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4\": rpc error: code = NotFound desc = could not find container \"d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4\": container with ID starting with d5334e5ddde1817e68fd3aa05ef1cebd92a0c7e56018fec38d301238bd3b2ac4 not found: ID does not exist" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.120240 4769 scope.go:117] "RemoveContainer" containerID="d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.122356 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a\": container with ID starting with d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a not found: ID does not exist" containerID="d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.122413 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a"} err="failed to get container status \"d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a\": rpc error: code = NotFound desc = could not find container \"d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a\": container with ID starting with d846c5e7e28ffc661b318ce9511d8d1b00e0646e47ae4e65f49fc15001cc579a not found: ID does not exist" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.122446 4769 scope.go:117] "RemoveContainer" containerID="a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.129569 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.144888 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.154202 4769 scope.go:117] "RemoveContainer" containerID="90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.154431 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.165523 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.176717 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.177262 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-log" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177284 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-log" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.177316 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-api" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177323 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-api" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.177341 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-log" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177348 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-log" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.177358 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-metadata" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177364 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-metadata" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177574 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-log" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177588 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-api" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177602 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" containerName="nova-api-log" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.177613 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" containerName="nova-metadata-metadata" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.178764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.181630 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.182007 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.183202 4769 scope.go:117] "RemoveContainer" containerID="a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.183989 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638\": container with ID starting with a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638 not found: ID does not exist" containerID="a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.184028 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638"} err="failed to get container status \"a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638\": rpc error: code = NotFound desc = could not find container \"a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638\": container with ID starting with a4bc5f8bf0d644f3383e0e8f347551d41dba4b9f3b20c08c1740004a85de8638 not found: ID does not exist" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.184052 4769 scope.go:117] "RemoveContainer" containerID="90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f" Nov 21 12:40:21 crc kubenswrapper[4769]: E1121 12:40:21.184578 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f\": container with ID starting with 90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f not found: ID does not exist" containerID="90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.184609 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f"} err="failed to get container status \"90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f\": rpc error: code = NotFound desc = could not find container \"90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f\": container with ID starting with 90049caece9405f4255fc6acc420b47341bc41db603ee5dfea74d5099da48c1f not found: ID does not exist" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.193992 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.204236 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.206835 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.209330 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.214373 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-config-data\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vtc\" (UniqueName: \"kubernetes.io/projected/6f231df0-d475-4ac5-9de8-403d93cc5d8a-kube-api-access-59vtc\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv88k\" (UniqueName: \"kubernetes.io/projected/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-kube-api-access-kv88k\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f231df0-d475-4ac5-9de8-403d93cc5d8a-logs\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.270854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-config-data\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.271138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.271656 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-logs\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.287362 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002f54a8-683e-4541-a0b8-19ec215b3751" path="/var/lib/kubelet/pods/002f54a8-683e-4541-a0b8-19ec215b3751/volumes" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.288064 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ee9f4ac-de8b-4212-813a-3cb2d0be5fde" path="/var/lib/kubelet/pods/7ee9f4ac-de8b-4212-813a-3cb2d0be5fde/volumes" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-logs\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-config-data\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59vtc\" (UniqueName: \"kubernetes.io/projected/6f231df0-d475-4ac5-9de8-403d93cc5d8a-kube-api-access-59vtc\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kv88k\" (UniqueName: \"kubernetes.io/projected/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-kube-api-access-kv88k\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.375374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f231df0-d475-4ac5-9de8-403d93cc5d8a-logs\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.374938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-logs\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.375459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-config-data\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.375629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.376378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f231df0-d475-4ac5-9de8-403d93cc5d8a-logs\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.379611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-config-data\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.379753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.380350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-config-data\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.385706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.386228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.396435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vtc\" (UniqueName: \"kubernetes.io/projected/6f231df0-d475-4ac5-9de8-403d93cc5d8a-kube-api-access-59vtc\") pod \"nova-metadata-0\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.398763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv88k\" (UniqueName: \"kubernetes.io/projected/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-kube-api-access-kv88k\") pod \"nova-api-0\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.495872 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:21 crc kubenswrapper[4769]: I1121 12:40:21.528978 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.021359 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:40:22 crc kubenswrapper[4769]: W1121 12:40:22.031088 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f231df0_d475_4ac5_9de8_403d93cc5d8a.slice/crio-f4566d2af2b2244944dbfc2be0124f23d5560dc8bbc4457cb40516b44e2d8666 WatchSource:0}: Error finding container f4566d2af2b2244944dbfc2be0124f23d5560dc8bbc4457cb40516b44e2d8666: Status 404 returned error can't find the container with id f4566d2af2b2244944dbfc2be0124f23d5560dc8bbc4457cb40516b44e2d8666 Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.090740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6f231df0-d475-4ac5-9de8-403d93cc5d8a","Type":"ContainerStarted","Data":"f4566d2af2b2244944dbfc2be0124f23d5560dc8bbc4457cb40516b44e2d8666"} Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.110560 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:22 crc kubenswrapper[4769]: W1121 12:40:22.120161 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf4f2bbd_ada1_42a7_8c7e_d3468e5e9e71.slice/crio-bf5d18325860067c401738168270002d0d0ebe20b444cc74f9a5f83f095705d1 WatchSource:0}: Error finding container bf5d18325860067c401738168270002d0d0ebe20b444cc74f9a5f83f095705d1: Status 404 returned error can't find the container with id bf5d18325860067c401738168270002d0d0ebe20b444cc74f9a5f83f095705d1 Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.668868 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.713852 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pn6l\" (UniqueName: \"kubernetes.io/projected/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-kube-api-access-7pn6l\") pod \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.713966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-combined-ca-bundle\") pod \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.713990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-config-data\") pod \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\" (UID: \"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6\") " Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.738657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-kube-api-access-7pn6l" (OuterVolumeSpecName: "kube-api-access-7pn6l") pod "2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" (UID: "2f79a38e-9a3b-42e6-8732-0dd1ab9788e6"). InnerVolumeSpecName "kube-api-access-7pn6l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.746466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-config-data" (OuterVolumeSpecName: "config-data") pod "2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" (UID: "2f79a38e-9a3b-42e6-8732-0dd1ab9788e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.758990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" (UID: "2f79a38e-9a3b-42e6-8732-0dd1ab9788e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.817009 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7pn6l\" (UniqueName: \"kubernetes.io/projected/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-kube-api-access-7pn6l\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.817295 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:22 crc kubenswrapper[4769]: I1121 12:40:22.817402 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.104442 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" exitCode=0 Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.104498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.104492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6","Type":"ContainerDied","Data":"cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.104709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2f79a38e-9a3b-42e6-8732-0dd1ab9788e6","Type":"ContainerDied","Data":"48e3e82760fc2868a59a484ed9d018cedf27465a1199caa7bb8959d00a2cc8a5"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.104775 4769 scope.go:117] "RemoveContainer" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.106731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71","Type":"ContainerStarted","Data":"d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.106758 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71","Type":"ContainerStarted","Data":"26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.106768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71","Type":"ContainerStarted","Data":"bf5d18325860067c401738168270002d0d0ebe20b444cc74f9a5f83f095705d1"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.108888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6f231df0-d475-4ac5-9de8-403d93cc5d8a","Type":"ContainerStarted","Data":"7fc50dbca35cc370c828ce095218982f40a265632084df3e8461aaab8c01ccce"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.108920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6f231df0-d475-4ac5-9de8-403d93cc5d8a","Type":"ContainerStarted","Data":"f3dad24278a9314cbf59401dbd8773ca03e2ea32ae3cd9d1d1e52db203c71095"} Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.155134 4769 scope.go:117] "RemoveContainer" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" Nov 21 12:40:23 crc kubenswrapper[4769]: E1121 12:40:23.156737 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe\": container with ID starting with cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe not found: ID does not exist" containerID="cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.156764 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe"} err="failed to get container status \"cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe\": rpc error: code = NotFound desc = could not find container \"cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe\": container with ID starting with cc355f28a13519d0df966f775d76a28ae00611a1edf1a88cf3f9cf8807f005fe not found: ID does not exist" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.166994 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.166967983 podStartE2EDuration="2.166967983s" podCreationTimestamp="2025-11-21 12:40:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:23.145860795 +0000 UTC m=+2981.846522623" watchObservedRunningTime="2025-11-21 12:40:23.166967983 +0000 UTC m=+2981.867629801" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.174372 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.174344661 podStartE2EDuration="2.174344661s" podCreationTimestamp="2025-11-21 12:40:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:23.166795648 +0000 UTC m=+2981.867457466" watchObservedRunningTime="2025-11-21 12:40:23.174344661 +0000 UTC m=+2981.875006479" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.201640 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.217131 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.240415 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:23 crc kubenswrapper[4769]: E1121 12:40:23.241014 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" containerName="nova-scheduler-scheduler" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.241035 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" containerName="nova-scheduler-scheduler" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.241308 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" containerName="nova-scheduler-scheduler" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.242211 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.247658 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.337721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qdw\" (UniqueName: \"kubernetes.io/projected/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-kube-api-access-n6qdw\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.349105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-config-data\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.349449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.370290 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f79a38e-9a3b-42e6-8732-0dd1ab9788e6" path="/var/lib/kubelet/pods/2f79a38e-9a3b-42e6-8732-0dd1ab9788e6/volumes" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.372789 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.451494 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.451575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qdw\" (UniqueName: \"kubernetes.io/projected/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-kube-api-access-n6qdw\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.451642 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-config-data\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.463958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-config-data\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.491332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qdw\" (UniqueName: \"kubernetes.io/projected/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-kube-api-access-n6qdw\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.497812 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.637361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.798801 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.860797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-sg-core-conf-yaml\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.861004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kltr\" (UniqueName: \"kubernetes.io/projected/a36b31e9-27d2-4d86-aaea-c414b09b253e-kube-api-access-5kltr\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.862758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-combined-ca-bundle\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.862815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-run-httpd\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.862859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-config-data\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.862901 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-scripts\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.862996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-log-httpd\") pod \"a36b31e9-27d2-4d86-aaea-c414b09b253e\" (UID: \"a36b31e9-27d2-4d86-aaea-c414b09b253e\") " Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.864592 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.865295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.871336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-scripts" (OuterVolumeSpecName: "scripts") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.871468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36b31e9-27d2-4d86-aaea-c414b09b253e-kube-api-access-5kltr" (OuterVolumeSpecName: "kube-api-access-5kltr") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "kube-api-access-5kltr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.903581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.955875 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.966287 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.966342 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.966360 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kltr\" (UniqueName: \"kubernetes.io/projected/a36b31e9-27d2-4d86-aaea-c414b09b253e-kube-api-access-5kltr\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.966373 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.966384 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a36b31e9-27d2-4d86-aaea-c414b09b253e-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.966398 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:23 crc kubenswrapper[4769]: I1121 12:40:23.986017 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-config-data" (OuterVolumeSpecName: "config-data") pod "a36b31e9-27d2-4d86-aaea-c414b09b253e" (UID: "a36b31e9-27d2-4d86-aaea-c414b09b253e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.068272 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a36b31e9-27d2-4d86-aaea-c414b09b253e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.093770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:40:24 crc kubenswrapper[4769]: W1121 12:40:24.096734 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92b8d7f9_665b_4f65_96fe_2a447f95ee0c.slice/crio-da96b430258c0b9f4221810ca79c4468211102fc7fa6b26d62842486924d63cf WatchSource:0}: Error finding container da96b430258c0b9f4221810ca79c4468211102fc7fa6b26d62842486924d63cf: Status 404 returned error can't find the container with id da96b430258c0b9f4221810ca79c4468211102fc7fa6b26d62842486924d63cf Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.125663 4769 generic.go:334] "Generic (PLEG): container finished" podID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerID="717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e" exitCode=0 Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.125739 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.125759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerDied","Data":"717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e"} Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.125809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a36b31e9-27d2-4d86-aaea-c414b09b253e","Type":"ContainerDied","Data":"9cefd02387b7d2d15081515f5545a8d3049984cc49a02477ae7ca9572ddf2b36"} Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.125831 4769 scope.go:117] "RemoveContainer" containerID="63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.127816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92b8d7f9-665b-4f65-96fe-2a447f95ee0c","Type":"ContainerStarted","Data":"da96b430258c0b9f4221810ca79c4468211102fc7fa6b26d62842486924d63cf"} Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.154842 4769 scope.go:117] "RemoveContainer" containerID="669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.183890 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.196479 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.209427 4769 scope.go:117] "RemoveContainer" containerID="717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.217284 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.218296 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-central-agent" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.218331 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-central-agent" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.218383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="sg-core" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.218400 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="sg-core" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.218454 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="proxy-httpd" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.218467 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="proxy-httpd" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.218494 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-notification-agent" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.218506 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-notification-agent" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.218947 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-notification-agent" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.219014 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="proxy-httpd" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.219031 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="ceilometer-central-agent" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.219067 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" containerName="sg-core" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.222580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.227871 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.228135 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.228325 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.243175 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.250738 4769 scope.go:117] "RemoveContainer" containerID="bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-log-httpd\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277386 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-scripts\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-config-data\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-run-httpd\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.277706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb77n\" (UniqueName: \"kubernetes.io/projected/302423e3-077c-40f1-8627-a026238408aa-kube-api-access-cb77n\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.280991 4769 scope.go:117] "RemoveContainer" containerID="63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.282394 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3\": container with ID starting with 63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3 not found: ID does not exist" containerID="63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.282441 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3"} err="failed to get container status \"63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3\": rpc error: code = NotFound desc = could not find container \"63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3\": container with ID starting with 63a81a9e600a5005d3b46dbfa7b37e03186a9569f900e1e30d1cae08dc484ad3 not found: ID does not exist" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.282462 4769 scope.go:117] "RemoveContainer" containerID="669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.283393 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4\": container with ID starting with 669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4 not found: ID does not exist" containerID="669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.283442 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4"} err="failed to get container status \"669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4\": rpc error: code = NotFound desc = could not find container \"669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4\": container with ID starting with 669b51bad6730908bf70aac144858999a1d62e01dd9686950d1e347c279a04e4 not found: ID does not exist" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.283476 4769 scope.go:117] "RemoveContainer" containerID="717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.284463 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e\": container with ID starting with 717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e not found: ID does not exist" containerID="717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.284486 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e"} err="failed to get container status \"717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e\": rpc error: code = NotFound desc = could not find container \"717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e\": container with ID starting with 717f0a786a1eb916c25b63baca98ce4ba776dd29034590318e557241c9736f0e not found: ID does not exist" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.284499 4769 scope.go:117] "RemoveContainer" containerID="bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67" Nov 21 12:40:24 crc kubenswrapper[4769]: E1121 12:40:24.284898 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67\": container with ID starting with bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67 not found: ID does not exist" containerID="bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.284922 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67"} err="failed to get container status \"bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67\": rpc error: code = NotFound desc = could not find container \"bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67\": container with ID starting with bb5245e2b0a9ca6f4aae121ab92cbe072d7f4961b80648c5bc1d1c1150201d67 not found: ID does not exist" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.383776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-run-httpd\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.383833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.383871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cb77n\" (UniqueName: \"kubernetes.io/projected/302423e3-077c-40f1-8627-a026238408aa-kube-api-access-cb77n\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.383976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-log-httpd\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.384118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.384175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-scripts\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.384253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-config-data\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.384293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.384624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-run-httpd\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.385076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-log-httpd\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.389755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.390225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-scripts\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.392379 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.392872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.393162 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-config-data\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.402011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb77n\" (UniqueName: \"kubernetes.io/projected/302423e3-077c-40f1-8627-a026238408aa-kube-api-access-cb77n\") pod \"ceilometer-0\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:24 crc kubenswrapper[4769]: I1121 12:40:24.557994 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:25 crc kubenswrapper[4769]: I1121 12:40:25.076119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:25 crc kubenswrapper[4769]: W1121 12:40:25.088072 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod302423e3_077c_40f1_8627_a026238408aa.slice/crio-e8c7f1e35316de56fadabe08103fc2f80ccc89bc6c2f7c304de30aa60bdc952c WatchSource:0}: Error finding container e8c7f1e35316de56fadabe08103fc2f80ccc89bc6c2f7c304de30aa60bdc952c: Status 404 returned error can't find the container with id e8c7f1e35316de56fadabe08103fc2f80ccc89bc6c2f7c304de30aa60bdc952c Nov 21 12:40:25 crc kubenswrapper[4769]: I1121 12:40:25.143178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92b8d7f9-665b-4f65-96fe-2a447f95ee0c","Type":"ContainerStarted","Data":"ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354"} Nov 21 12:40:25 crc kubenswrapper[4769]: I1121 12:40:25.144862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerStarted","Data":"e8c7f1e35316de56fadabe08103fc2f80ccc89bc6c2f7c304de30aa60bdc952c"} Nov 21 12:40:25 crc kubenswrapper[4769]: I1121 12:40:25.168237 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.168179433 podStartE2EDuration="2.168179433s" podCreationTimestamp="2025-11-21 12:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:25.156122935 +0000 UTC m=+2983.856784753" watchObservedRunningTime="2025-11-21 12:40:25.168179433 +0000 UTC m=+2983.868841251" Nov 21 12:40:25 crc kubenswrapper[4769]: I1121 12:40:25.284806 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36b31e9-27d2-4d86-aaea-c414b09b253e" path="/var/lib/kubelet/pods/a36b31e9-27d2-4d86-aaea-c414b09b253e/volumes" Nov 21 12:40:26 crc kubenswrapper[4769]: I1121 12:40:26.164078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerStarted","Data":"965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438"} Nov 21 12:40:26 crc kubenswrapper[4769]: I1121 12:40:26.496431 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:26 crc kubenswrapper[4769]: I1121 12:40:26.496488 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.050008 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-r2zxt"] Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.052840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.074567 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-r2zxt"] Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.153223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-catalog-content\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.153629 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlfzk\" (UniqueName: \"kubernetes.io/projected/d7d54c94-ba72-44cc-85d8-fb1c4953e166-kube-api-access-zlfzk\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.153654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-utilities\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.174931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerStarted","Data":"338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28"} Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.255719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-catalog-content\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.255827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zlfzk\" (UniqueName: \"kubernetes.io/projected/d7d54c94-ba72-44cc-85d8-fb1c4953e166-kube-api-access-zlfzk\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.255847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-utilities\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.256350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-utilities\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.256573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-catalog-content\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.274690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlfzk\" (UniqueName: \"kubernetes.io/projected/d7d54c94-ba72-44cc-85d8-fb1c4953e166-kube-api-access-zlfzk\") pod \"redhat-marketplace-r2zxt\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.371677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:27 crc kubenswrapper[4769]: W1121 12:40:27.907973 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d54c94_ba72_44cc_85d8_fb1c4953e166.slice/crio-4f79d0ab681661aaed9e953c8f118fd62c3a2909d76075da954aaa5d836bcf8e WatchSource:0}: Error finding container 4f79d0ab681661aaed9e953c8f118fd62c3a2909d76075da954aaa5d836bcf8e: Status 404 returned error can't find the container with id 4f79d0ab681661aaed9e953c8f118fd62c3a2909d76075da954aaa5d836bcf8e Nov 21 12:40:27 crc kubenswrapper[4769]: I1121 12:40:27.915179 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-r2zxt"] Nov 21 12:40:28 crc kubenswrapper[4769]: I1121 12:40:28.191227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerStarted","Data":"83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc"} Nov 21 12:40:28 crc kubenswrapper[4769]: I1121 12:40:28.191529 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerStarted","Data":"4f79d0ab681661aaed9e953c8f118fd62c3a2909d76075da954aaa5d836bcf8e"} Nov 21 12:40:28 crc kubenswrapper[4769]: I1121 12:40:28.638617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.202522 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerID="83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc" exitCode=0 Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.202638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerDied","Data":"83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc"} Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.205593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerStarted","Data":"cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98"} Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.437344 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.474138 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-lqnxm"] Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.476330 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-lqnxm"] Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.476420 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.608986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-utilities\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.609179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-catalog-content\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.609557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtncw\" (UniqueName: \"kubernetes.io/projected/4c26c2a8-dd78-4312-854f-91cb0a2202db-kube-api-access-vtncw\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.711417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-catalog-content\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.711598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vtncw\" (UniqueName: \"kubernetes.io/projected/4c26c2a8-dd78-4312-854f-91cb0a2202db-kube-api-access-vtncw\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.711773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-utilities\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.711961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-catalog-content\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.712331 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-utilities\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.734374 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtncw\" (UniqueName: \"kubernetes.io/projected/4c26c2a8-dd78-4312-854f-91cb0a2202db-kube-api-access-vtncw\") pod \"certified-operators-lqnxm\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:29 crc kubenswrapper[4769]: I1121 12:40:29.826941 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:30 crc kubenswrapper[4769]: I1121 12:40:30.592466 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-lqnxm"] Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.240787 4769 generic.go:334] "Generic (PLEG): container finished" podID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerID="d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94" exitCode=0 Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.241160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerDied","Data":"d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94"} Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.241377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerStarted","Data":"c12f6ecdee27c363e6451478077bc5bb690f4414b697a50d3d26a6f039900f46"} Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.254779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerStarted","Data":"4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172"} Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.255156 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.257586 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerID="fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f" exitCode=0 Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.257627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerDied","Data":"fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f"} Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.299875 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.263045092 podStartE2EDuration="7.299851855s" podCreationTimestamp="2025-11-21 12:40:24 +0000 UTC" firstStartedPulling="2025-11-21 12:40:25.091015174 +0000 UTC m=+2983.791676982" lastFinishedPulling="2025-11-21 12:40:30.127821927 +0000 UTC m=+2988.828483745" observedRunningTime="2025-11-21 12:40:31.293923713 +0000 UTC m=+2989.994585541" watchObservedRunningTime="2025-11-21 12:40:31.299851855 +0000 UTC m=+2990.000513673" Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.496879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.496930 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.530074 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:31 crc kubenswrapper[4769]: I1121 12:40:31.530153 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:32 crc kubenswrapper[4769]: I1121 12:40:32.270805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerStarted","Data":"10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c"} Nov 21 12:40:32 crc kubenswrapper[4769]: I1121 12:40:32.291927 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-r2zxt" podStartSLOduration=2.853504698 podStartE2EDuration="5.291909119s" podCreationTimestamp="2025-11-21 12:40:27 +0000 UTC" firstStartedPulling="2025-11-21 12:40:29.205329064 +0000 UTC m=+2987.905990882" lastFinishedPulling="2025-11-21 12:40:31.643733485 +0000 UTC m=+2990.344395303" observedRunningTime="2025-11-21 12:40:32.288882767 +0000 UTC m=+2990.989544585" watchObservedRunningTime="2025-11-21 12:40:32.291909119 +0000 UTC m=+2990.992570937" Nov 21 12:40:32 crc kubenswrapper[4769]: I1121 12:40:32.507389 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.195:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:32 crc kubenswrapper[4769]: I1121 12:40:32.507410 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.195:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:32 crc kubenswrapper[4769]: I1121 12:40:32.614917 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.196:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:32 crc kubenswrapper[4769]: I1121 12:40:32.615112 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.196:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:40:33 crc kubenswrapper[4769]: I1121 12:40:33.294475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerStarted","Data":"679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3"} Nov 21 12:40:33 crc kubenswrapper[4769]: I1121 12:40:33.638259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:33 crc kubenswrapper[4769]: I1121 12:40:33.676928 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:34 crc kubenswrapper[4769]: I1121 12:40:34.348434 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:40:36 crc kubenswrapper[4769]: I1121 12:40:36.335000 4769 generic.go:334] "Generic (PLEG): container finished" podID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerID="679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3" exitCode=0 Nov 21 12:40:36 crc kubenswrapper[4769]: I1121 12:40:36.335112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerDied","Data":"679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3"} Nov 21 12:40:37 crc kubenswrapper[4769]: I1121 12:40:37.352827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerStarted","Data":"5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c"} Nov 21 12:40:37 crc kubenswrapper[4769]: I1121 12:40:37.373062 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:37 crc kubenswrapper[4769]: I1121 12:40:37.373181 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:37 crc kubenswrapper[4769]: I1121 12:40:37.412274 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-lqnxm" podStartSLOduration=2.934653085 podStartE2EDuration="8.412250783s" podCreationTimestamp="2025-11-21 12:40:29 +0000 UTC" firstStartedPulling="2025-11-21 12:40:31.244772047 +0000 UTC m=+2989.945433865" lastFinishedPulling="2025-11-21 12:40:36.722369745 +0000 UTC m=+2995.423031563" observedRunningTime="2025-11-21 12:40:37.391014666 +0000 UTC m=+2996.091676544" watchObservedRunningTime="2025-11-21 12:40:37.412250783 +0000 UTC m=+2996.112912611" Nov 21 12:40:37 crc kubenswrapper[4769]: I1121 12:40:37.452775 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:38 crc kubenswrapper[4769]: I1121 12:40:38.434914 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:38 crc kubenswrapper[4769]: I1121 12:40:38.842993 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-r2zxt"] Nov 21 12:40:39 crc kubenswrapper[4769]: I1121 12:40:39.827535 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:39 crc kubenswrapper[4769]: I1121 12:40:39.829619 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:40 crc kubenswrapper[4769]: I1121 12:40:40.413998 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-r2zxt" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="registry-server" containerID="cri-o://10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c" gracePeriod=2 Nov 21 12:40:40 crc kubenswrapper[4769]: I1121 12:40:40.920543 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/certified-operators-lqnxm" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="registry-server" probeResult="failure" output=< Nov 21 12:40:40 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:40:40 crc kubenswrapper[4769]: > Nov 21 12:40:40 crc kubenswrapper[4769]: I1121 12:40:40.998401 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.138479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-catalog-content\") pod \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.138905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-utilities\") pod \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.139052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlfzk\" (UniqueName: \"kubernetes.io/projected/d7d54c94-ba72-44cc-85d8-fb1c4953e166-kube-api-access-zlfzk\") pod \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\" (UID: \"d7d54c94-ba72-44cc-85d8-fb1c4953e166\") " Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.140058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-utilities" (OuterVolumeSpecName: "utilities") pod "d7d54c94-ba72-44cc-85d8-fb1c4953e166" (UID: "d7d54c94-ba72-44cc-85d8-fb1c4953e166"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.147919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d54c94-ba72-44cc-85d8-fb1c4953e166-kube-api-access-zlfzk" (OuterVolumeSpecName: "kube-api-access-zlfzk") pod "d7d54c94-ba72-44cc-85d8-fb1c4953e166" (UID: "d7d54c94-ba72-44cc-85d8-fb1c4953e166"). InnerVolumeSpecName "kube-api-access-zlfzk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.162834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d7d54c94-ba72-44cc-85d8-fb1c4953e166" (UID: "d7d54c94-ba72-44cc-85d8-fb1c4953e166"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.242395 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.242456 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d7d54c94-ba72-44cc-85d8-fb1c4953e166-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.242468 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zlfzk\" (UniqueName: \"kubernetes.io/projected/d7d54c94-ba72-44cc-85d8-fb1c4953e166-kube-api-access-zlfzk\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.325881 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.325968 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.431910 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerID="10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c" exitCode=0 Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.431987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerDied","Data":"10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c"} Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.432014 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-r2zxt" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.432030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-r2zxt" event={"ID":"d7d54c94-ba72-44cc-85d8-fb1c4953e166","Type":"ContainerDied","Data":"4f79d0ab681661aaed9e953c8f118fd62c3a2909d76075da954aaa5d836bcf8e"} Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.432061 4769 scope.go:117] "RemoveContainer" containerID="10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.467845 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-r2zxt"] Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.473073 4769 scope.go:117] "RemoveContainer" containerID="fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.482420 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-r2zxt"] Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.506444 4769 scope.go:117] "RemoveContainer" containerID="83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.506685 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.508001 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.515497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.547727 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.548387 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.548550 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.573616 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.578081 4769 scope.go:117] "RemoveContainer" containerID="10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c" Nov 21 12:40:41 crc kubenswrapper[4769]: E1121 12:40:41.578769 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c\": container with ID starting with 10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c not found: ID does not exist" containerID="10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.578835 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c"} err="failed to get container status \"10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c\": rpc error: code = NotFound desc = could not find container \"10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c\": container with ID starting with 10639794304c27e46e98bf5d72afa3dfbd21559d54e7721beabe5a547732078c not found: ID does not exist" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.578877 4769 scope.go:117] "RemoveContainer" containerID="fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f" Nov 21 12:40:41 crc kubenswrapper[4769]: E1121 12:40:41.579406 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f\": container with ID starting with fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f not found: ID does not exist" containerID="fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.579490 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f"} err="failed to get container status \"fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f\": rpc error: code = NotFound desc = could not find container \"fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f\": container with ID starting with fb3f8ec8db94c070ac1cb79489a9d96022918301834dc42af5cd08985915678f not found: ID does not exist" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.579551 4769 scope.go:117] "RemoveContainer" containerID="83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc" Nov 21 12:40:41 crc kubenswrapper[4769]: E1121 12:40:41.582963 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc\": container with ID starting with 83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc not found: ID does not exist" containerID="83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc" Nov 21 12:40:41 crc kubenswrapper[4769]: I1121 12:40:41.583004 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc"} err="failed to get container status \"83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc\": rpc error: code = NotFound desc = could not find container \"83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc\": container with ID starting with 83e27e7f2761ea94f5d17505c2b69561b95d5b63b6034d7cbc0c83e272dd3fcc not found: ID does not exist" Nov 21 12:40:42 crc kubenswrapper[4769]: I1121 12:40:42.448971 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:42 crc kubenswrapper[4769]: I1121 12:40:42.456964 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:40:42 crc kubenswrapper[4769]: I1121 12:40:42.457174 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:43 crc kubenswrapper[4769]: I1121 12:40:43.339487 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" path="/var/lib/kubelet/pods/d7d54c94-ba72-44cc-85d8-fb1c4953e166/volumes" Nov 21 12:40:44 crc kubenswrapper[4769]: I1121 12:40:44.631332 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:44 crc kubenswrapper[4769]: I1121 12:40:44.631981 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="sg-core" containerID="cri-o://cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98" gracePeriod=30 Nov 21 12:40:44 crc kubenswrapper[4769]: I1121 12:40:44.632060 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="proxy-httpd" containerID="cri-o://4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172" gracePeriod=30 Nov 21 12:40:44 crc kubenswrapper[4769]: I1121 12:40:44.632078 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-notification-agent" containerID="cri-o://338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28" gracePeriod=30 Nov 21 12:40:44 crc kubenswrapper[4769]: I1121 12:40:44.631917 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-central-agent" containerID="cri-o://965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438" gracePeriod=30 Nov 21 12:40:44 crc kubenswrapper[4769]: I1121 12:40:44.652727 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.198:3000/\": EOF" Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.485565 4769 generic.go:334] "Generic (PLEG): container finished" podID="302423e3-077c-40f1-8627-a026238408aa" containerID="4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172" exitCode=0 Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.486066 4769 generic.go:334] "Generic (PLEG): container finished" podID="302423e3-077c-40f1-8627-a026238408aa" containerID="cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98" exitCode=2 Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.486078 4769 generic.go:334] "Generic (PLEG): container finished" podID="302423e3-077c-40f1-8627-a026238408aa" containerID="965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438" exitCode=0 Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.485767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerDied","Data":"4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172"} Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.486109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerDied","Data":"cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98"} Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.486120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerDied","Data":"965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438"} Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.817107 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.818214 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-log" containerID="cri-o://26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb" gracePeriod=30 Nov 21 12:40:45 crc kubenswrapper[4769]: I1121 12:40:45.818442 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-api" containerID="cri-o://d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249" gracePeriod=30 Nov 21 12:40:46 crc kubenswrapper[4769]: I1121 12:40:46.500658 4769 generic.go:334] "Generic (PLEG): container finished" podID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerID="26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb" exitCode=143 Nov 21 12:40:46 crc kubenswrapper[4769]: I1121 12:40:46.500717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71","Type":"ContainerDied","Data":"26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb"} Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.185665 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.273035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-config-data\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.273408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-run-httpd\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.273437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-sg-core-conf-yaml\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.273482 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-log-httpd\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.273992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.274150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-scripts\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.274336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-ceilometer-tls-certs\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.274653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-combined-ca-bundle\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.274766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb77n\" (UniqueName: \"kubernetes.io/projected/302423e3-077c-40f1-8627-a026238408aa-kube-api-access-cb77n\") pod \"302423e3-077c-40f1-8627-a026238408aa\" (UID: \"302423e3-077c-40f1-8627-a026238408aa\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.276020 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.283377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.288880 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-scripts" (OuterVolumeSpecName: "scripts") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.291562 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302423e3-077c-40f1-8627-a026238408aa-kube-api-access-cb77n" (OuterVolumeSpecName: "kube-api-access-cb77n") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "kube-api-access-cb77n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.326522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.379479 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.379517 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/302423e3-077c-40f1-8627-a026238408aa-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.379530 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.379543 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cb77n\" (UniqueName: \"kubernetes.io/projected/302423e3-077c-40f1-8627-a026238408aa-kube-api-access-cb77n\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.406327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.431795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-config-data" (OuterVolumeSpecName: "config-data") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.457591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "302423e3-077c-40f1-8627-a026238408aa" (UID: "302423e3-077c-40f1-8627-a026238408aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.483007 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.483071 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.483085 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/302423e3-077c-40f1-8627-a026238408aa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.507467 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.539567 4769 generic.go:334] "Generic (PLEG): container finished" podID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerID="d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249" exitCode=0 Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.539671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71","Type":"ContainerDied","Data":"d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249"} Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.539725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71","Type":"ContainerDied","Data":"bf5d18325860067c401738168270002d0d0ebe20b444cc74f9a5f83f095705d1"} Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.539756 4769 scope.go:117] "RemoveContainer" containerID="d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.540081 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.571284 4769 generic.go:334] "Generic (PLEG): container finished" podID="302423e3-077c-40f1-8627-a026238408aa" containerID="338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28" exitCode=0 Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.571339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerDied","Data":"338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28"} Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.571369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"302423e3-077c-40f1-8627-a026238408aa","Type":"ContainerDied","Data":"e8c7f1e35316de56fadabe08103fc2f80ccc89bc6c2f7c304de30aa60bdc952c"} Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.571457 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.584436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv88k\" (UniqueName: \"kubernetes.io/projected/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-kube-api-access-kv88k\") pod \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.584526 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-logs\") pod \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.584655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-config-data\") pod \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.584934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-combined-ca-bundle\") pod \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\" (UID: \"bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71\") " Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.585723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-logs" (OuterVolumeSpecName: "logs") pod "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" (UID: "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.587544 4769 scope.go:117] "RemoveContainer" containerID="26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.592253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-kube-api-access-kv88k" (OuterVolumeSpecName: "kube-api-access-kv88k") pod "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" (UID: "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71"). InnerVolumeSpecName "kube-api-access-kv88k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.649691 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.653151 4769 scope.go:117] "RemoveContainer" containerID="d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.654938 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249\": container with ID starting with d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249 not found: ID does not exist" containerID="d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.655024 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249"} err="failed to get container status \"d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249\": rpc error: code = NotFound desc = could not find container \"d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249\": container with ID starting with d8bcdebad6a17d19e19aca96c50bfd2a73cb4f89348fb7e1fdbbfa6b56821249 not found: ID does not exist" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.655069 4769 scope.go:117] "RemoveContainer" containerID="26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.655626 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb\": container with ID starting with 26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb not found: ID does not exist" containerID="26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.655686 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb"} err="failed to get container status \"26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb\": rpc error: code = NotFound desc = could not find container \"26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb\": container with ID starting with 26ce1412dd1a964ce0361ebee16361d41a14a958160cdd55255fae94cc730bcb not found: ID does not exist" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.655710 4769 scope.go:117] "RemoveContainer" containerID="4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.693034 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kv88k\" (UniqueName: \"kubernetes.io/projected/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-kube-api-access-kv88k\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.693107 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.747463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-config-data" (OuterVolumeSpecName: "config-data") pod "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" (UID: "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.748321 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.755092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" (UID: "bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.764416 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765020 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-notification-agent" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765037 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-notification-agent" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765067 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="sg-core" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765074 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="sg-core" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765090 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="extract-content" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="extract-content" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765110 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="extract-utilities" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765117 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="extract-utilities" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765142 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-log" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765149 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-log" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765174 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-api" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765181 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-api" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765210 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-central-agent" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765217 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-central-agent" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765232 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="registry-server" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765239 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="registry-server" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.765257 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="proxy-httpd" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765263 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="proxy-httpd" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-log" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765504 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d7d54c94-ba72-44cc-85d8-fb1c4953e166" containerName="registry-server" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765514 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="proxy-httpd" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765524 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-central-agent" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765535 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" containerName="nova-api-api" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765547 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="sg-core" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.765568 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="302423e3-077c-40f1-8627-a026238408aa" containerName="ceilometer-notification-agent" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.769411 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.771906 4769 scope.go:117] "RemoveContainer" containerID="cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.773555 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.774303 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.775159 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.779081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.796135 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.796174 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.843221 4769 scope.go:117] "RemoveContainer" containerID="338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.877415 4769 scope.go:117] "RemoveContainer" containerID="965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.889992 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.898821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-log-httpd\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzwgg\" (UniqueName: \"kubernetes.io/projected/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-kube-api-access-jzwgg\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-config-data\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-scripts\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-run-httpd\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.899740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.902070 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.907712 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.911714 4769 scope.go:117] "RemoveContainer" containerID="4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.912333 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172\": container with ID starting with 4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172 not found: ID does not exist" containerID="4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.912381 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172"} err="failed to get container status \"4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172\": rpc error: code = NotFound desc = could not find container \"4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172\": container with ID starting with 4bc40478e758d56c3f338368fb99d05914c38b1d52d00e7fbee9e8f29102b172 not found: ID does not exist" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.912428 4769 scope.go:117] "RemoveContainer" containerID="cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.912747 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98\": container with ID starting with cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98 not found: ID does not exist" containerID="cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.912776 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98"} err="failed to get container status \"cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98\": rpc error: code = NotFound desc = could not find container \"cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98\": container with ID starting with cfb14a8470cf767b00c0fd9aa44a492e12844abc304c24fad67974d869ca7d98 not found: ID does not exist" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.912805 4769 scope.go:117] "RemoveContainer" containerID="338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.913042 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28\": container with ID starting with 338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28 not found: ID does not exist" containerID="338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.913073 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28"} err="failed to get container status \"338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28\": rpc error: code = NotFound desc = could not find container \"338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28\": container with ID starting with 338042cf3896d960367d0f7bd67b3c9886ca11367f41674209282098d3168e28 not found: ID does not exist" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.913092 4769 scope.go:117] "RemoveContainer" containerID="965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438" Nov 21 12:40:49 crc kubenswrapper[4769]: E1121 12:40:49.913380 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438\": container with ID starting with 965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438 not found: ID does not exist" containerID="965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.913403 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438"} err="failed to get container status \"965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438\": rpc error: code = NotFound desc = could not find container \"965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438\": container with ID starting with 965b755dcf2dd8471bdb1b3c16073b5d4c97f73292ffc21d0b31db6020290438 not found: ID does not exist" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.916326 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.919618 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.921594 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.922100 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.922273 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.926879 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:49 crc kubenswrapper[4769]: I1121 12:40:49.985135 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.002463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-scripts\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.002658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-run-httpd\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.005373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.005545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.005593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-logs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.005844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-config-data\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.005884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-log-httpd\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006013 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jzwgg\" (UniqueName: \"kubernetes.io/projected/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-kube-api-access-jzwgg\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-config-data\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4blzb\" (UniqueName: \"kubernetes.io/projected/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-kube-api-access-4blzb\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.006379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-public-tls-certs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.007117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-run-httpd\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.008205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-log-httpd\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.009463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-scripts\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.014661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-config-data\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.015180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.015580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.016064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.025449 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzwgg\" (UniqueName: \"kubernetes.io/projected/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-kube-api-access-jzwgg\") pod \"ceilometer-0\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.108777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-public-tls-certs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.108860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.108900 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-logs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.108962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-config-data\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.108997 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.109037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4blzb\" (UniqueName: \"kubernetes.io/projected/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-kube-api-access-4blzb\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.109983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-logs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.113909 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-internal-tls-certs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.114739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.118336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-config-data\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.126922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-public-tls-certs\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.137768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4blzb\" (UniqueName: \"kubernetes.io/projected/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-kube-api-access-4blzb\") pod \"nova-api-0\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.140219 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.160358 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-lqnxm"] Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.241956 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.698165 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:40:50 crc kubenswrapper[4769]: I1121 12:40:50.816107 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.290696 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="302423e3-077c-40f1-8627-a026238408aa" path="/var/lib/kubelet/pods/302423e3-077c-40f1-8627-a026238408aa/volumes" Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.293741 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71" path="/var/lib/kubelet/pods/bf4f2bbd-ada1-42a7-8c7e-d3468e5e9e71/volumes" Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.617348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerStarted","Data":"642cc14ff093159f93a9081bb20a7fd1ff23f2f544fa737e5cda8819ee063408"} Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.617428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerStarted","Data":"ddaa22a10a2af794f8b1ab27a3efcb4cad0d075caef4ea8eeb4ba3c60462058a"} Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.621874 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-lqnxm" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="registry-server" containerID="cri-o://5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c" gracePeriod=2 Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.622079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5515ac85-cbc8-453f-8b3d-5f4ac3940b30","Type":"ContainerStarted","Data":"83a0081ccc7bc4469392f021dba095ec7b5d40baa4591504a425d1db88f87dd3"} Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.622103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5515ac85-cbc8-453f-8b3d-5f4ac3940b30","Type":"ContainerStarted","Data":"f92d255a3f58d6a7718af643b8ee3527754ea3ffa0b236b27bd81e12131c26f4"} Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.622113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5515ac85-cbc8-453f-8b3d-5f4ac3940b30","Type":"ContainerStarted","Data":"f53db7455a093091b8a103d71027782e5bbf9237d4eac04c16c88f5772c77cc3"} Nov 21 12:40:51 crc kubenswrapper[4769]: I1121 12:40:51.683009 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.68297804 podStartE2EDuration="2.68297804s" podCreationTimestamp="2025-11-21 12:40:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:40:51.662793741 +0000 UTC m=+3010.363455639" watchObservedRunningTime="2025-11-21 12:40:51.68297804 +0000 UTC m=+3010.383639858" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.345123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.485494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-catalog-content\") pod \"4c26c2a8-dd78-4312-854f-91cb0a2202db\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.485583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-utilities\") pod \"4c26c2a8-dd78-4312-854f-91cb0a2202db\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.485628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtncw\" (UniqueName: \"kubernetes.io/projected/4c26c2a8-dd78-4312-854f-91cb0a2202db-kube-api-access-vtncw\") pod \"4c26c2a8-dd78-4312-854f-91cb0a2202db\" (UID: \"4c26c2a8-dd78-4312-854f-91cb0a2202db\") " Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.487067 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-utilities" (OuterVolumeSpecName: "utilities") pod "4c26c2a8-dd78-4312-854f-91cb0a2202db" (UID: "4c26c2a8-dd78-4312-854f-91cb0a2202db"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.494329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c26c2a8-dd78-4312-854f-91cb0a2202db-kube-api-access-vtncw" (OuterVolumeSpecName: "kube-api-access-vtncw") pod "4c26c2a8-dd78-4312-854f-91cb0a2202db" (UID: "4c26c2a8-dd78-4312-854f-91cb0a2202db"). InnerVolumeSpecName "kube-api-access-vtncw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.556030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4c26c2a8-dd78-4312-854f-91cb0a2202db" (UID: "4c26c2a8-dd78-4312-854f-91cb0a2202db"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.588437 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vtncw\" (UniqueName: \"kubernetes.io/projected/4c26c2a8-dd78-4312-854f-91cb0a2202db-kube-api-access-vtncw\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.588492 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.588506 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4c26c2a8-dd78-4312-854f-91cb0a2202db-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.637027 4769 generic.go:334] "Generic (PLEG): container finished" podID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerID="5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c" exitCode=0 Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.637120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerDied","Data":"5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c"} Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.637160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-lqnxm" event={"ID":"4c26c2a8-dd78-4312-854f-91cb0a2202db","Type":"ContainerDied","Data":"c12f6ecdee27c363e6451478077bc5bb690f4414b697a50d3d26a6f039900f46"} Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.637202 4769 scope.go:117] "RemoveContainer" containerID="5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.637388 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-lqnxm" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.650523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerStarted","Data":"8be503a780af2106b1093a3cc784715994f0866fa4b64ab072cf0110f424501e"} Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.676242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-lqnxm"] Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.689470 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-lqnxm"] Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.694772 4769 scope.go:117] "RemoveContainer" containerID="679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.728409 4769 scope.go:117] "RemoveContainer" containerID="d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.800621 4769 scope.go:117] "RemoveContainer" containerID="5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c" Nov 21 12:40:52 crc kubenswrapper[4769]: E1121 12:40:52.801147 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c\": container with ID starting with 5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c not found: ID does not exist" containerID="5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.801241 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c"} err="failed to get container status \"5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c\": rpc error: code = NotFound desc = could not find container \"5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c\": container with ID starting with 5520ae48c546b6cfc343e8bfffe27f74728ebd3cbf2b6bce9db6ab722943a22c not found: ID does not exist" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.801287 4769 scope.go:117] "RemoveContainer" containerID="679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3" Nov 21 12:40:52 crc kubenswrapper[4769]: E1121 12:40:52.801752 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3\": container with ID starting with 679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3 not found: ID does not exist" containerID="679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.801790 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3"} err="failed to get container status \"679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3\": rpc error: code = NotFound desc = could not find container \"679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3\": container with ID starting with 679cf8a88aaff54217952658630b9010743b072919a7fd40755b0fe6e0e4d4a3 not found: ID does not exist" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.801818 4769 scope.go:117] "RemoveContainer" containerID="d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94" Nov 21 12:40:52 crc kubenswrapper[4769]: E1121 12:40:52.802114 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94\": container with ID starting with d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94 not found: ID does not exist" containerID="d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94" Nov 21 12:40:52 crc kubenswrapper[4769]: I1121 12:40:52.802178 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94"} err="failed to get container status \"d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94\": rpc error: code = NotFound desc = could not find container \"d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94\": container with ID starting with d58bd84a9c8aabf3c0b7fbde78ab95ae21bf38faad89171ff702673265972e94 not found: ID does not exist" Nov 21 12:40:53 crc kubenswrapper[4769]: I1121 12:40:53.290300 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" path="/var/lib/kubelet/pods/4c26c2a8-dd78-4312-854f-91cb0a2202db/volumes" Nov 21 12:40:53 crc kubenswrapper[4769]: I1121 12:40:53.674785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerStarted","Data":"c774bfbaefcd18b588133e670d55b5bae274c5e6b1953a1142c7eb00b6a64788"} Nov 21 12:40:55 crc kubenswrapper[4769]: I1121 12:40:55.703681 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerStarted","Data":"d4eadae0ff5501a365781ddd07ff906e43aec811838eb6b2bf7ed3be3c21c5db"} Nov 21 12:40:55 crc kubenswrapper[4769]: I1121 12:40:55.706440 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:40:55 crc kubenswrapper[4769]: I1121 12:40:55.739856 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.682663811 podStartE2EDuration="6.739835017s" podCreationTimestamp="2025-11-21 12:40:49 +0000 UTC" firstStartedPulling="2025-11-21 12:40:50.713612252 +0000 UTC m=+3009.414274070" lastFinishedPulling="2025-11-21 12:40:54.770783418 +0000 UTC m=+3013.471445276" observedRunningTime="2025-11-21 12:40:55.734178553 +0000 UTC m=+3014.434840381" watchObservedRunningTime="2025-11-21 12:40:55.739835017 +0000 UTC m=+3014.440496825" Nov 21 12:41:00 crc kubenswrapper[4769]: I1121 12:41:00.242883 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:00 crc kubenswrapper[4769]: I1121 12:41:00.244136 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:01 crc kubenswrapper[4769]: I1121 12:41:01.258558 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.202:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:41:01 crc kubenswrapper[4769]: I1121 12:41:01.258545 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.202:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:41:10 crc kubenswrapper[4769]: I1121 12:41:10.248809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:10 crc kubenswrapper[4769]: I1121 12:41:10.249447 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:10 crc kubenswrapper[4769]: I1121 12:41:10.249885 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:10 crc kubenswrapper[4769]: I1121 12:41:10.250006 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:10 crc kubenswrapper[4769]: I1121 12:41:10.256413 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:10 crc kubenswrapper[4769]: I1121 12:41:10.256465 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.325794 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.326125 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.501843 4769 scope.go:117] "RemoveContainer" containerID="c2ff59122bb6cd9e227a6756a693dc739789ea1be511555a03dce05ca96b9cf3" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.538640 4769 scope.go:117] "RemoveContainer" containerID="eddab7b09b2976c9d088ec264af8d57d4e3360a15360ce1fb1ce3dd2764ea451" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.557951 4769 scope.go:117] "RemoveContainer" containerID="664e7d522f736774f797f9eb0e8f08404b82a1004b2192e7bf7e0349ca8b9f4e" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.583428 4769 scope.go:117] "RemoveContainer" containerID="79cf097807ad70143b81a85f5a4633ae1eeabce755f04b365e25a404bde825a6" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.611176 4769 scope.go:117] "RemoveContainer" containerID="907734f25feb7bfe17eda559c00541441bbc1acb0becb4a66c683c2ea04dcfb6" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.638104 4769 scope.go:117] "RemoveContainer" containerID="652ca03c5ad58ceec7e88a3e5377a0554ef8b8df704a0b00b5b5e9a203f423ea" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.674260 4769 scope.go:117] "RemoveContainer" containerID="0f09fca4f4d58cf691832977b419e1161c455d86d856d6bd614cf68364aab292" Nov 21 12:41:11 crc kubenswrapper[4769]: I1121 12:41:11.717681 4769 scope.go:117] "RemoveContainer" containerID="915f4bcd9c6149ea9f5f50cc8ac6932c8c52ffc2f91b97b5209b3cfd6cfe2593" Nov 21 12:41:20 crc kubenswrapper[4769]: I1121 12:41:20.150694 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.421732 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.422489 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="b4170bf0-4651-402b-b28e-28443fc3f568" containerName="openstackclient" containerID="cri-o://97bf8f1119990e5f020933900bdd694b77bd4716487dbd84b9e49dbaf47b746c" gracePeriod=2 Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.445344 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.530406 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.563525 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.616330 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement77f5-account-delete-pvwjs"] Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.616880 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="registry-server" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.616898 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="registry-server" Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.616916 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b4170bf0-4651-402b-b28e-28443fc3f568" containerName="openstackclient" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.616923 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4170bf0-4651-402b-b28e-28443fc3f568" containerName="openstackclient" Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.616947 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="extract-content" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.616955 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="extract-content" Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.616989 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="extract-utilities" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.616996 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="extract-utilities" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.617372 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4c26c2a8-dd78-4312-854f-91cb0a2202db" containerName="registry-server" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.617392 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b4170bf0-4651-402b-b28e-28443fc3f568" containerName="openstackclient" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.618152 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.626501 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.626745 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" containerID="cri-o://9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" gracePeriod=30 Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.626929 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="openstack-network-exporter" containerID="cri-o://c17bb2554cbf3fd6babe7e25350d95b1942383f8f5a7f1609039517336cefe63" gracePeriod=30 Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.640277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.648719 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement77f5-account-delete-pvwjs"] Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.695437 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.695599 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data podName:364fcc68-67f7-4008-bc5f-a932b88a72bf nodeName:}" failed. No retries permitted until 2025-11-21 12:41:25.195581263 +0000 UTC m=+3043.896243081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data") pod "rabbitmq-server-0" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf") : configmap "rabbitmq-config-data" not found Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.729803 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.736686 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data podName:bd8a72b4-4330-450b-9a5d-431819e3ab7f nodeName:}" failed. No retries permitted until 2025-11-21 12:41:25.236589018 +0000 UTC m=+3043.937250836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data") pod "rabbitmq-server-1" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f") : configmap "rabbitmq-config-data" not found Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.805661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1947d55-7857-40da-9103-804862218844-operator-scripts\") pod \"placement77f5-account-delete-pvwjs\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.806193 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klmmt\" (UniqueName: \"kubernetes.io/projected/c1947d55-7857-40da-9103-804862218844-kube-api-access-klmmt\") pod \"placement77f5-account-delete-pvwjs\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.806767 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.806819 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data podName:857a150b-5f89-4c23-b71c-fa0ec47a855d nodeName:}" failed. No retries permitted until 2025-11-21 12:41:25.306805497 +0000 UTC m=+3044.007467315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data") pod "rabbitmq-server-2" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d") : configmap "rabbitmq-config-data" not found Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.870577 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.871335 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="openstack-network-exporter" containerID="cri-o://f11b63d57e10848902fd856e8f9ca97a3b03b5b86b6c2e53b5d1586c2a86402b" gracePeriod=300 Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.910846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1947d55-7857-40da-9103-804862218844-operator-scripts\") pod \"placement77f5-account-delete-pvwjs\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.910931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-klmmt\" (UniqueName: \"kubernetes.io/projected/c1947d55-7857-40da-9103-804862218844-kube-api-access-klmmt\") pod \"placement77f5-account-delete-pvwjs\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.911693 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1947d55-7857-40da-9103-804862218844-operator-scripts\") pod \"placement77f5-account-delete-pvwjs\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.913584 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder7629-account-delete-z2cd6"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.916859 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.948714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder7629-account-delete-z2cd6"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.965105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-klmmt\" (UniqueName: \"kubernetes.io/projected/c1947d55-7857-40da-9103-804862218844-kube-api-access-klmmt\") pod \"placement77f5-account-delete-pvwjs\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.974347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:41:24 crc kubenswrapper[4769]: I1121 12:41:24.974982 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="openstack-network-exporter" containerID="cri-o://0bb3deb7a8d88680fb20c1ccfffc4b5733de01afb053f72ab677462d379e6562" gracePeriod=300 Nov 21 12:41:24 crc kubenswrapper[4769]: E1121 12:41:24.997007 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:58004->38.102.83.227:40411: write tcp 38.102.83.227:58004->38.102.83.227:40411: write: broken pipe Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.006431 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance184a-account-delete-zgztl"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.011799 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.013534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts\") pod \"cinder7629-account-delete-z2cd6\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.013606 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kv2\" (UniqueName: \"kubernetes.io/projected/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-kube-api-access-85kv2\") pod \"cinder7629-account-delete-z2cd6\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.030438 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-2h9wc"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.045271 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance184a-account-delete-zgztl"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.065303 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-2h9wc"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.075379 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-lrthj"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.088469 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-lrthj"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.106663 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican161d-account-delete-hpxvg"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.108029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.117453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d862ac-19bc-4f97-8920-41d1008aece5-operator-scripts\") pod \"glance184a-account-delete-zgztl\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.117513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfq6x\" (UniqueName: \"kubernetes.io/projected/90d862ac-19bc-4f97-8920-41d1008aece5-kube-api-access-xfq6x\") pod \"glance184a-account-delete-zgztl\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.117607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts\") pod \"cinder7629-account-delete-z2cd6\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.117676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-85kv2\" (UniqueName: \"kubernetes.io/projected/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-kube-api-access-85kv2\") pod \"cinder7629-account-delete-z2cd6\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.118682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts\") pod \"cinder7629-account-delete-z2cd6\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.118716 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican161d-account-delete-hpxvg"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.123198 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.182480 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerID="c17bb2554cbf3fd6babe7e25350d95b1942383f8f5a7f1609039517336cefe63" exitCode=2 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.182566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f0bfd46e-ddb1-452a-8df5-283922948dce","Type":"ContainerDied","Data":"c17bb2554cbf3fd6babe7e25350d95b1942383f8f5a7f1609039517336cefe63"} Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.194837 4769 generic.go:334] "Generic (PLEG): container finished" podID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerID="f11b63d57e10848902fd856e8f9ca97a3b03b5b86b6c2e53b5d1586c2a86402b" exitCode=2 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.194875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4fc23439-b690-4f59-9028-ba72cf39c81e","Type":"ContainerDied","Data":"f11b63d57e10848902fd856e8f9ca97a3b03b5b86b6c2e53b5d1586c2a86402b"} Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.218919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kv2\" (UniqueName: \"kubernetes.io/projected/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-kube-api-access-85kv2\") pod \"cinder7629-account-delete-z2cd6\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.219439 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d862ac-19bc-4f97-8920-41d1008aece5-operator-scripts\") pod \"glance184a-account-delete-zgztl\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.219579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xfq6x\" (UniqueName: \"kubernetes.io/projected/90d862ac-19bc-4f97-8920-41d1008aece5-kube-api-access-xfq6x\") pod \"glance184a-account-delete-zgztl\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.219898 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.220003 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data podName:364fcc68-67f7-4008-bc5f-a932b88a72bf nodeName:}" failed. No retries permitted until 2025-11-21 12:41:26.219989372 +0000 UTC m=+3044.920651180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data") pod "rabbitmq-server-0" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf") : configmap "rabbitmq-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.220383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d862ac-19bc-4f97-8920-41d1008aece5-operator-scripts\") pod \"glance184a-account-delete-zgztl\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.260688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.271863 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.309163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfq6x\" (UniqueName: \"kubernetes.io/projected/90d862ac-19bc-4f97-8920-41d1008aece5-kube-api-access-xfq6x\") pod \"glance184a-account-delete-zgztl\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.322489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts\") pod \"barbican161d-account-delete-hpxvg\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.322600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6slw\" (UniqueName: \"kubernetes.io/projected/3769889c-3377-4452-80a0-387660264035-kube-api-access-d6slw\") pod \"barbican161d-account-delete-hpxvg\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.323773 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.323844 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data podName:857a150b-5f89-4c23-b71c-fa0ec47a855d nodeName:}" failed. No retries permitted until 2025-11-21 12:41:26.323829986 +0000 UTC m=+3045.024491804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data") pod "rabbitmq-server-2" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d") : configmap "rabbitmq-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.324152 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.324178 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data podName:bd8a72b4-4330-450b-9a5d-431819e3ab7f nodeName:}" failed. No retries permitted until 2025-11-21 12:41:26.324170125 +0000 UTC m=+3045.024831943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data") pod "rabbitmq-server-1" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f") : configmap "rabbitmq-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.324233 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.324257 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data podName:1e2aa50b-63a4-4d92-88bd-345ec2d80dd4 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:25.824251087 +0000 UTC m=+3044.524912905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data") pod "rabbitmq-cell1-server-2" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.360232 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e592e6-4275-4db4-aad1-96772bb728f3" path="/var/lib/kubelet/pods/48e592e6-4275-4db4-aad1-96772bb728f3/volumes" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.361171 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e332caa5-8279-4d2c-9d0a-8e66ded5dfbb" path="/var/lib/kubelet/pods/e332caa5-8279-4d2c-9d0a-8e66ded5dfbb/volumes" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.361758 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron2b29-account-delete-j5kk7"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.362992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.401804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.434590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron2b29-account-delete-j5kk7"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.446882 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-77f4g"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.448673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d6slw\" (UniqueName: \"kubernetes.io/projected/3769889c-3377-4452-80a0-387660264035-kube-api-access-d6slw\") pod \"barbican161d-account-delete-hpxvg\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.448897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts\") pod \"barbican161d-account-delete-hpxvg\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.449637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts\") pod \"barbican161d-account-delete-hpxvg\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.484318 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.516773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6slw\" (UniqueName: \"kubernetes.io/projected/3769889c-3377-4452-80a0-387660264035-kube-api-access-d6slw\") pod \"barbican161d-account-delete-hpxvg\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.566681 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts\") pod \"neutron2b29-account-delete-j5kk7\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.566735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6t9z\" (UniqueName: \"kubernetes.io/projected/ab6773c4-0375-4426-a9c9-aa301a616474-kube-api-access-z6t9z\") pod \"neutron2b29-account-delete-j5kk7\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.568301 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.568347 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data podName:361938ec-ffd5-4e1c-80b2-c30d796ba89c nodeName:}" failed. No retries permitted until 2025-11-21 12:41:26.068334114 +0000 UTC m=+3044.768995932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data") pod "rabbitmq-cell1-server-0" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.634396 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.635029 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="ovsdbserver-sb" containerID="cri-o://58c85b933c93f98831cd3dacc7238f42d4ccc675ed624e17bbae3abab44d90f2" gracePeriod=300 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.668926 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts\") pod \"neutron2b29-account-delete-j5kk7\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.668982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z6t9z\" (UniqueName: \"kubernetes.io/projected/ab6773c4-0375-4426-a9c9-aa301a616474-kube-api-access-z6t9z\") pod \"neutron2b29-account-delete-j5kk7\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.669766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts\") pod \"neutron2b29-account-delete-j5kk7\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.672376 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-77f4g"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.721822 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.735705 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-dh5dt"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.755196 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6t9z\" (UniqueName: \"kubernetes.io/projected/ab6773c4-0375-4426-a9c9-aa301a616474-kube-api-access-z6t9z\") pod \"neutron2b29-account-delete-j5kk7\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.791267 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-dh5dt"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.811819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="ovsdbserver-nb" containerID="cri-o://8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028" gracePeriod=300 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.820963 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.866848 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="ovsdbserver-sb" probeResult="failure" output="" Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.879613 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.879674 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data podName:1e2aa50b-63a4-4d92-88bd-345ec2d80dd4 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:26.879660259 +0000 UTC m=+3045.580322077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data") pod "rabbitmq-cell1-server-2" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.893922 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-ljftr"] Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.895321 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: E1121 12:41:25.895422 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data podName:b27c6ab8-1814-4fc4-be72-63efaf921244 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:26.395399917 +0000 UTC m=+3045.096061735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data") pod "rabbitmq-cell1-server-1" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.911757 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-997b6456b-j6hhp"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.912006 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-log" containerID="cri-o://8cfe92f182ec79cd472097f18b95255229f7d04c1b3c86d17a2f76b7f53bc763" gracePeriod=30 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.912484 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-api" containerID="cri-o://c98138b795f4cbd3160b47d4e5bca080367c97055345e9be9a1a4d7cd7370c29" gracePeriod=30 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.954549 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-ljftr"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.968853 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-6gttj"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.976831 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-6gttj"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.987257 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.989080 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-server" containerID="cri-o://2a44257f61a84469b828910c85ff5691e1b4a7169355aff6a0a8d19f8a7d0333" gracePeriod=30 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.989522 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="swift-recon-cron" containerID="cri-o://06506e0bf02484fbd9db9e70996803ffdb0e5e3c0108bdd7c65596b358830bb8" gracePeriod=30 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.989567 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="rsync" containerID="cri-o://00c7261b6fba217c4e24a1664abc878170130e5209700df5097de176b6b61570" gracePeriod=30 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.989601 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-expirer" containerID="cri-o://382e49e62259b12a0b804b135afca426072edd614c2b0360032fd5e93434a325" gracePeriod=30 Nov 21 12:41:25 crc kubenswrapper[4769]: I1121 12:41:25.991730 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-updater" containerID="cri-o://4f2e11536e9dfb8311db5338a7d21c52507a051785eafcf51feb0bac9499d177" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.001435 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-auditor" containerID="cri-o://7d100fe3a4f3a805fe8d957b1438f4eb91b2aa14273dd6eb1a0a391152abe50b" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.001869 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-replicator" containerID="cri-o://5360ab1344e47a7d43209a01e2d9ded2e9ba65717ac480f30ced543424799dca" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002061 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-server" containerID="cri-o://dc146c5dcd18856f85005711936352194db9a939fe6011aefd5ebeedf33e9968" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002288 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-updater" containerID="cri-o://830287bfe1d042f3e89be356787c988ff5fa6963f4d3af7bf41d1c452071b115" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002424 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-auditor" containerID="cri-o://840623d07147e6cf6f6469870ee10b31b867a5ca4cda3a760f89c523661aa7a9" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002569 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-replicator" containerID="cri-o://82948b309b2ce73212f41f6eb4ef37b090d2501d82ce65ad827583a6d443d278" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002694 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-server" containerID="cri-o://1dafc30651707f08ea650bf9b9b0796de80bb95979b7a0efb96286f05f698430" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002813 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-reaper" containerID="cri-o://b5b8093f4dff60c86fd5e9fdda4853c6722373cb26df618bc7120a60a1a38256" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.002931 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-auditor" containerID="cri-o://b308ba5b9db0d5cc512394f23bd38cff8189c1cdfe06d5def513b0cfae404bbf" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.003040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-replicator" containerID="cri-o://98cd919c625608e55be9333a4a0de4346eeb7320e68eb0dc6187d0736f520c5c" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.008251 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.013846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="cinder-scheduler" containerID="cri-o://908724d52efa7d576b7f6591f9a9144816fe4c25e7857cf621f85b556381d9ed" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.014290 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="probe" containerID="cri-o://ed10da15d9a853724f32abe130cf71488623cce53a6627d5b2df941aa10bf5ce" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.086989 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.087382 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data podName:361938ec-ffd5-4e1c-80b2-c30d796ba89c nodeName:}" failed. No retries permitted until 2025-11-21 12:41:27.087363217 +0000 UTC m=+3045.788025035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data") pod "rabbitmq-cell1-server-0" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.108277 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.152715 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.152927 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.166916 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.258384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.260624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sldtg\" (UniqueName: \"kubernetes.io/projected/3a4d44b3-704e-44c0-8e41-64af780dcd32-kube-api-access-sldtg\") pod \"novaapi2cdb-account-delete-lrgmx\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.261005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts\") pod \"novaapi2cdb-account-delete-lrgmx\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.261118 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.261298 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data podName:364fcc68-67f7-4008-bc5f-a932b88a72bf nodeName:}" failed. No retries permitted until 2025-11-21 12:41:28.261152662 +0000 UTC m=+3046.961814480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data") pod "rabbitmq-server-0" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf") : configmap "rabbitmq-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.333218 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-gdcll"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.339878 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_807d9aae-572d-4e30-bb12-62cebc91bde8/ovsdbserver-sb/0.log" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.339924 4769 generic.go:334] "Generic (PLEG): container finished" podID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerID="0bb3deb7a8d88680fb20c1ccfffc4b5733de01afb053f72ab677462d379e6562" exitCode=2 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.339941 4769 generic.go:334] "Generic (PLEG): container finished" podID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerID="58c85b933c93f98831cd3dacc7238f42d4ccc675ed624e17bbae3abab44d90f2" exitCode=143 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.340005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"807d9aae-572d-4e30-bb12-62cebc91bde8","Type":"ContainerDied","Data":"0bb3deb7a8d88680fb20c1ccfffc4b5733de01afb053f72ab677462d379e6562"} Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.340031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"807d9aae-572d-4e30-bb12-62cebc91bde8","Type":"ContainerDied","Data":"58c85b933c93f98831cd3dacc7238f42d4ccc675ed624e17bbae3abab44d90f2"} Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.364176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sldtg\" (UniqueName: \"kubernetes.io/projected/3a4d44b3-704e-44c0-8e41-64af780dcd32-kube-api-access-sldtg\") pod \"novaapi2cdb-account-delete-lrgmx\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.366689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts\") pod \"novaapi2cdb-account-delete-lrgmx\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.367456 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.367532 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data podName:857a150b-5f89-4c23-b71c-fa0ec47a855d nodeName:}" failed. No retries permitted until 2025-11-21 12:41:28.367514304 +0000 UTC m=+3047.068176122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data") pod "rabbitmq-server-2" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d") : configmap "rabbitmq-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.367859 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.367884 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data podName:bd8a72b4-4330-450b-9a5d-431819e3ab7f nodeName:}" failed. No retries permitted until 2025-11-21 12:41:28.367876644 +0000 UTC m=+3047.068538462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data") pod "rabbitmq-server-1" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f") : configmap "rabbitmq-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.368232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts\") pod \"novaapi2cdb-account-delete-lrgmx\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.414828 4769 generic.go:334] "Generic (PLEG): container finished" podID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerID="8cfe92f182ec79cd472097f18b95255229f7d04c1b3c86d17a2f76b7f53bc763" exitCode=143 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.414877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" event={"ID":"bbc6cddf-3e72-4186-bdf5-23ad222a4686","Type":"ContainerDied","Data":"8cfe92f182ec79cd472097f18b95255229f7d04c1b3c86d17a2f76b7f53bc763"} Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.442823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sldtg\" (UniqueName: \"kubernetes.io/projected/3a4d44b3-704e-44c0-8e41-64af780dcd32-kube-api-access-sldtg\") pod \"novaapi2cdb-account-delete-lrgmx\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.462613 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-fjvf8"] Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.477168 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.477242 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data podName:b27c6ab8-1814-4fc4-be72-63efaf921244 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:27.477227357 +0000 UTC m=+3046.177889175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data") pod "rabbitmq-cell1-server-1" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.505659 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell014d7-account-delete-snw8t"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.508032 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.543757 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.545406 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api-log" containerID="cri-o://08f3dac19275963f7631149ded191aab9c95d11c06c4f3ef01c1d0b027a28a6a" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.545847 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api" containerID="cri-o://b7988bea32c802e8b5a49d276c9ee94444c8899e8888fc245b7ea7c260125703" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.576062 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell014d7-account-delete-snw8t"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.582992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgs65\" (UniqueName: \"kubernetes.io/projected/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-kube-api-access-wgs65\") pod \"novacell014d7-account-delete-snw8t\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.588317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts\") pod \"novacell014d7-account-delete-snw8t\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.634287 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.635083 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-log" containerID="cri-o://654a77c7034caba2ea536f55e4aa893f3edd8f15f5710b7ebc7bf47fbb15357f" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.635671 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-httpd" containerID="cri-o://99ee46e7be53655c9ff1ea8014b01115ef5a430294ae2e1adbe9b53c4d2f5174" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.655317 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.671247 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.675980 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.676021 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.697268 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.699078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wgs65\" (UniqueName: \"kubernetes.io/projected/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-kube-api-access-wgs65\") pod \"novacell014d7-account-delete-snw8t\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.702297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts\") pod \"novacell014d7-account-delete-snw8t\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.699788 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.711557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts\") pod \"novacell014d7-account-delete-snw8t\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.738623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.739060 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-log" containerID="cri-o://159afc2dfdd50fb5cf8576f3819b134721278e456333d34a574585afab289f5b" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.739822 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-httpd" containerID="cri-o://0b71d3bf15064131e4dc7c417b4abfc3cb7822e2433df02e5147417739760822" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.746497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgs65\" (UniqueName: \"kubernetes.io/projected/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-kube-api-access-wgs65\") pod \"novacell014d7-account-delete-snw8t\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.752024 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.759807 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-79b4b5654b-2zhqj"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.760321 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-api" containerID="cri-o://010d2d75e0547988836316bace3c069b5bf5662168a019571a27d806ae524ed3" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.760952 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-httpd" containerID="cri-o://5485cdb6e4522d9d7b3eef3e7cc920816967583ab4c38f53b4f8cd80eaf4da22" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.773582 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.785693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.808160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bcws\" (UniqueName: \"kubernetes.io/projected/650a3adf-623d-4869-be32-b9188cb6f1f1-kube-api-access-9bcws\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.841935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.847542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.848268 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-2" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="rabbitmq" containerID="cri-o://d91f2b5aa00b4a0bb40a511eef51984d65607b6b0e7578970c9a341fd55e765a" gracePeriod=604800 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.848328 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-1" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" containerID="cri-o://06f9b1eadf78537bacbf8b298bd6f6f093395ccee46990931528d0149a21a2b4" gracePeriod=604800 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.835739 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.851818 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.851914 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-545c7885b4-plwx7"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.852628 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-log" containerID="cri-o://f3dad24278a9314cbf59401dbd8773ca03e2ea32ae3cd9d1d1e52db203c71095" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.852756 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api-log" containerID="cri-o://b3e8c9b38ba95e3907d800185d34ce21776a8fb69cb0b2f5e4ea8a479e6df3fc" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.852946 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-metadata" containerID="cri-o://7fc50dbca35cc370c828ce095218982f40a265632084df3e8461aaab8c01ccce" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.853005 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api" containerID="cri-o://db111da3413ec218967d1a5ce01181ec0a6d6af36b5cc1ff9f160658a1fcd4c9" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.865427 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.884281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.894077 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.894375 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" containerName="nova-scheduler-scheduler" containerID="cri-o://ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.913445 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.928110 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.928321 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener-log" containerID="cri-o://7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.928650 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener" containerID="cri-o://41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44" gracePeriod=30 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.939095 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" containerID="cri-o://e2032218e6520f26808442a08fd290d961aebba34ef50c59302b1352114c8009" gracePeriod=604800 Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.953409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.953831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.953920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9bcws\" (UniqueName: \"kubernetes.io/projected/650a3adf-623d-4869-be32-b9188cb6f1f1-kube-api-access-9bcws\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.955105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.955605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.955649 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: E1121 12:41:26.955686 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data podName:1e2aa50b-63a4-4d92-88bd-345ec2d80dd4 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:28.955673667 +0000 UTC m=+3047.656335485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data") pod "rabbitmq-cell1-server-2" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.988629 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb"] Nov 21 12:41:26 crc kubenswrapper[4769]: I1121 12:41:26.992028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bcws\" (UniqueName: \"kubernetes.io/projected/650a3adf-623d-4869-be32-b9188cb6f1f1-kube-api-access-9bcws\") pod \"dnsmasq-dnsmasq-84b9f45d47-qcptd\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.012763 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.026550 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker-log" containerID="cri-o://2f9795b688b62d68c169c1a0b5cf8fe745204cc77d4b840b0bffbc200faad6ab" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.026949 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker" containerID="cri-o://22d08c8fb8e93d13fcd5f7caba4ee618409e1a225ae88c4d57b04382f8b4cfe0" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.029859 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-log" containerID="cri-o://f92d255a3f58d6a7718af643b8ee3527754ea3ffa0b236b27bd81e12131c26f4" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.029993 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-api" containerID="cri-o://83a0081ccc7bc4469392f021dba095ec7b5d40baa4591504a425d1db88f87dd3" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.066411 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.066711 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://9c0f1a84912c10da1c181ce099086af20f4da8bee6ba96e0698a1ddd91727820" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.091018 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-44j7w"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.115906 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.116425 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-44j7w"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.123063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.123445 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.137267 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.146000 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_807d9aae-572d-4e30-bb12-62cebc91bde8/ovsdbserver-sb/0.log" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.146088 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.170852 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-3f2d-account-create-kfqhs"] Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.175889 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.175970 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data podName:361938ec-ffd5-4e1c-80b2-c30d796ba89c nodeName:}" failed. No retries permitted until 2025-11-21 12:41:29.175953736 +0000 UTC m=+3047.876615554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data") pod "rabbitmq-cell1-server-0" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.195040 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.209285 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.223245 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.240100 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.262333 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.262584 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerName="nova-cell0-conductor-conductor" containerID="cri-o://a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.276912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmgnw\" (UniqueName: \"kubernetes.io/projected/807d9aae-572d-4e30-bb12-62cebc91bde8-kube-api-access-fmgnw\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.276993 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdb-rundir\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.277023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-scripts\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.277058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-metrics-certs-tls-certs\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.277138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.277164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-combined-ca-bundle\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.277228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-config\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.277268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdbserver-sb-tls-certs\") pod \"807d9aae-572d-4e30-bb12-62cebc91bde8\" (UID: \"807d9aae-572d-4e30-bb12-62cebc91bde8\") " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.290276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807d9aae-572d-4e30-bb12-62cebc91bde8-kube-api-access-fmgnw" (OuterVolumeSpecName: "kube-api-access-fmgnw") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "kube-api-access-fmgnw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.293710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.294310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-scripts" (OuterVolumeSpecName: "scripts") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.310869 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-config" (OuterVolumeSpecName: "config") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.321502 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" containerID="cri-o://c572bc5f406e7ad8283eb6f8e1b6d7bdcf53fa68dc4b386c41e00bfb8d80b1fe" gracePeriod=604800 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.326561 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0072aa8e-79ea-46a8-8d60-daba46db5e2c" path="/var/lib/kubelet/pods/0072aa8e-79ea-46a8-8d60-daba46db5e2c/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.327434 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3927663a-c253-4853-979f-e48092cc7809" path="/var/lib/kubelet/pods/3927663a-c253-4853-979f-e48092cc7809/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.334265 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4351132b-709f-4e78-9ddc-55107a3874ec" path="/var/lib/kubelet/pods/4351132b-709f-4e78-9ddc-55107a3874ec/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.335404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.336621 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f1b4d1d-b8ab-4686-b77c-d049aaa758b0" path="/var/lib/kubelet/pods/4f1b4d1d-b8ab-4686-b77c-d049aaa758b0/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.341662 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5955251c-5d2f-43ee-a371-883cfd5f4558" path="/var/lib/kubelet/pods/5955251c-5d2f-43ee-a371-883cfd5f4558/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.362636 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba104143-e793-4d5e-9c9e-85b2320d51c3" path="/var/lib/kubelet/pods/ba104143-e793-4d5e-9c9e-85b2320d51c3/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.363861 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e885e099-14b4-44ec-bee0-c4d226c41bbd" path="/var/lib/kubelet/pods/e885e099-14b4-44ec-bee0-c4d226c41bbd/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.385812 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" containerID="cri-o://dab4ae7ecb4ebb3704d24abb60a8e223ac27f6bb8813d9b2533a4fd3320398aa" gracePeriod=604800 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.396327 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="rabbitmq" containerID="cri-o://f991f55168305f20b720d822948dd591aea9434eebd32153073bcbdeec6a1ad3" gracePeriod=604800 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.408558 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc0106a6-df92-4ce9-b303-d17ab14cce65" path="/var/lib/kubelet/pods/fc0106a6-df92-4ce9-b303-d17ab14cce65/volumes" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.450883 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.450939 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fmgnw\" (UniqueName: \"kubernetes.io/projected/807d9aae-572d-4e30-bb12-62cebc91bde8-kube-api-access-fmgnw\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.450951 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.450961 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/807d9aae-572d-4e30-bb12-62cebc91bde8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.451077 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.454352 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-xlvg5"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.454389 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.454405 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.454416 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-bb7r6"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.454726 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f215726f-5d62-4daf-98e4-270f4778542f" containerName="nova-cell1-conductor-conductor" containerID="cri-o://476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.519278 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance184a-account-delete-zgztl"] Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.561522 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.561577 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data podName:b27c6ab8-1814-4fc4-be72-63efaf921244 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:29.561563421 +0000 UTC m=+3048.262225229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data") pod "rabbitmq-cell1-server-1" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.582681 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement77f5-account-delete-pvwjs"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.582756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder7629-account-delete-z2cd6"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.583121 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.583240 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="galera" containerID="cri-o://07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.600750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6f231df0-d475-4ac5-9de8-403d93cc5d8a","Type":"ContainerDied","Data":"f3dad24278a9314cbf59401dbd8773ca03e2ea32ae3cd9d1d1e52db203c71095"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.600916 4769 generic.go:334] "Generic (PLEG): container finished" podID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerID="f3dad24278a9314cbf59401dbd8773ca03e2ea32ae3cd9d1d1e52db203c71095" exitCode=143 Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.604414 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028 is running failed: container process not found" containerID="8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.605809 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028 is running failed: container process not found" containerID="8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.607607 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028 is running failed: container process not found" containerID="8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:41:27 crc kubenswrapper[4769]: E1121 12:41:27.607757 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="ovsdbserver-nb" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.610248 4769 generic.go:334] "Generic (PLEG): container finished" podID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerID="b3e8c9b38ba95e3907d800185d34ce21776a8fb69cb0b2f5e4ea8a479e6df3fc" exitCode=143 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.610380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" event={"ID":"946c5e3d-0426-4c04-b00c-9fdaa8da7146","Type":"ContainerDied","Data":"b3e8c9b38ba95e3907d800185d34ce21776a8fb69cb0b2f5e4ea8a479e6df3fc"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.612298 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.612475 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" containerName="kube-state-metrics" containerID="cri-o://e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.650853 4769 generic.go:334] "Generic (PLEG): container finished" podID="b4170bf0-4651-402b-b28e-28443fc3f568" containerID="97bf8f1119990e5f020933900bdd694b77bd4716487dbd84b9e49dbaf47b746c" exitCode=137 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.655956 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.662807 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.665014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.665367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-central-agent" containerID="cri-o://642cc14ff093159f93a9081bb20a7fd1ff23f2f544fa737e5cda8819ee063408" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.665866 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="proxy-httpd" containerID="cri-o://d4eadae0ff5501a365781ddd07ff906e43aec811838eb6b2bf7ed3be3c21c5db" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.665921 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="sg-core" containerID="cri-o://c774bfbaefcd18b588133e670d55b5bae274c5e6b1953a1142c7eb00b6a64788" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.665954 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-notification-agent" containerID="cri-o://8be503a780af2106b1093a3cc784715994f0866fa4b64ab072cf0110f424501e" gracePeriod=30 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.682310 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_807d9aae-572d-4e30-bb12-62cebc91bde8/ovsdbserver-sb/0.log" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.682632 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.683030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"807d9aae-572d-4e30-bb12-62cebc91bde8","Type":"ContainerDied","Data":"6efe2960bf7041218ccb2d209a1555d0a1842ac6ece65500e3e307a5e08a5c10"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.683102 4769 scope.go:117] "RemoveContainer" containerID="0bb3deb7a8d88680fb20c1ccfffc4b5733de01afb053f72ab677462d379e6562" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.723078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.728931 4769 generic.go:334] "Generic (PLEG): container finished" podID="28df21b3-2a77-4353-8fac-3fa307992568" containerID="159afc2dfdd50fb5cf8576f3819b134721278e456333d34a574585afab289f5b" exitCode=143 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.729029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"28df21b3-2a77-4353-8fac-3fa307992568","Type":"ContainerDied","Data":"159afc2dfdd50fb5cf8576f3819b134721278e456333d34a574585afab289f5b"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.771379 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.771769 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.791461 4769 generic.go:334] "Generic (PLEG): container finished" podID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerID="ed10da15d9a853724f32abe130cf71488623cce53a6627d5b2df941aa10bf5ce" exitCode=0 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.793901 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85","Type":"ContainerDied","Data":"ed10da15d9a853724f32abe130cf71488623cce53a6627d5b2df941aa10bf5ce"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.849938 4769 generic.go:334] "Generic (PLEG): container finished" podID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerID="654a77c7034caba2ea536f55e4aa893f3edd8f15f5710b7ebc7bf47fbb15357f" exitCode=143 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.850037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94b1f363-8761-4a8e-a35c-d7cc338232f2","Type":"ContainerDied","Data":"654a77c7034caba2ea536f55e4aa893f3edd8f15f5710b7ebc7bf47fbb15357f"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.874126 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "807d9aae-572d-4e30-bb12-62cebc91bde8" (UID: "807d9aae-572d-4e30-bb12-62cebc91bde8"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.890843 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican161d-account-delete-hpxvg"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.899019 4769 generic.go:334] "Generic (PLEG): container finished" podID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerID="2f9795b688b62d68c169c1a0b5cf8fe745204cc77d4b840b0bffbc200faad6ab" exitCode=143 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.899121 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" event={"ID":"964afe99-46d9-4b4e-be03-e3cf7c5b6e04","Type":"ContainerDied","Data":"2f9795b688b62d68c169c1a0b5cf8fe745204cc77d4b840b0bffbc200faad6ab"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.924160 4769 generic.go:334] "Generic (PLEG): container finished" podID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerID="7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd" exitCode=143 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.924270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" event={"ID":"e1e5c05c-a6e7-4bb2-a397-d4feb7197966","Type":"ContainerDied","Data":"7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd"} Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.952835 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron2b29-account-delete-j5kk7"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.968617 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx"] Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.978729 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/807d9aae-572d-4e30-bb12-62cebc91bde8-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.995212 4769 generic.go:334] "Generic (PLEG): container finished" podID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerID="5485cdb6e4522d9d7b3eef3e7cc920816967583ab4c38f53b4f8cd80eaf4da22" exitCode=0 Nov 21 12:41:27 crc kubenswrapper[4769]: I1121 12:41:27.995814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" event={"ID":"857f2fcc-9d8d-4cad-9945-b8e62997525b","Type":"ContainerDied","Data":"5485cdb6e4522d9d7b3eef3e7cc920816967583ab4c38f53b4f8cd80eaf4da22"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.060334 4769 generic.go:334] "Generic (PLEG): container finished" podID="e689da25-a663-48f8-acc0-3890d96884a2" containerID="08f3dac19275963f7631149ded191aab9c95d11c06c4f3ef01c1d0b027a28a6a" exitCode=143 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.060488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e689da25-a663-48f8-acc0-3890d96884a2","Type":"ContainerDied","Data":"08f3dac19275963f7631149ded191aab9c95d11c06c4f3ef01c1d0b027a28a6a"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.105640 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.110556 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.123378 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4fc23439-b690-4f59-9028-ba72cf39c81e/ovsdbserver-nb/0.log" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.123429 4769 generic.go:334] "Generic (PLEG): container finished" podID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerID="8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028" exitCode=143 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.123500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4fc23439-b690-4f59-9028-ba72cf39c81e","Type":"ContainerDied","Data":"8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.125668 4769 scope.go:117] "RemoveContainer" containerID="58c85b933c93f98831cd3dacc7238f42d4ccc675ed624e17bbae3abab44d90f2" Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.146327 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.146812 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4fc23439-b690-4f59-9028-ba72cf39c81e/ovsdbserver-nb/0.log" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.146968 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.159469 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.190269 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.190715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-metrics-certs-tls-certs\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.190895 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-config\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.190963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdb-rundir\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.191047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-combined-ca-bundle\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.191159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-scripts\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.191249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wrrw\" (UniqueName: \"kubernetes.io/projected/4fc23439-b690-4f59-9028-ba72cf39c81e-kube-api-access-8wrrw\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.191411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdbserver-nb-tls-certs\") pod \"4fc23439-b690-4f59-9028-ba72cf39c81e\" (UID: \"4fc23439-b690-4f59-9028-ba72cf39c81e\") " Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.195081 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.195152 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f215726f-5d62-4daf-98e4-270f4778542f" containerName="nova-cell1-conductor-conductor" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.195808 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-config" (OuterVolumeSpecName: "config") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.204275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.204546 4769 generic.go:334] "Generic (PLEG): container finished" podID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerID="f92d255a3f58d6a7718af643b8ee3527754ea3ffa0b236b27bd81e12131c26f4" exitCode=143 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.204622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5515ac85-cbc8-453f-8b3d-5f4ac3940b30","Type":"ContainerDied","Data":"f92d255a3f58d6a7718af643b8ee3527754ea3ffa0b236b27bd81e12131c26f4"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.220025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.220736 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-scripts" (OuterVolumeSpecName: "scripts") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.237951 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273690 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="00c7261b6fba217c4e24a1664abc878170130e5209700df5097de176b6b61570" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273721 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="382e49e62259b12a0b804b135afca426072edd614c2b0360032fd5e93434a325" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273728 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="4f2e11536e9dfb8311db5338a7d21c52507a051785eafcf51feb0bac9499d177" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273735 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="7d100fe3a4f3a805fe8d957b1438f4eb91b2aa14273dd6eb1a0a391152abe50b" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273742 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="5360ab1344e47a7d43209a01e2d9ded2e9ba65717ac480f30ced543424799dca" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273749 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="dc146c5dcd18856f85005711936352194db9a939fe6011aefd5ebeedf33e9968" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273755 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="830287bfe1d042f3e89be356787c988ff5fa6963f4d3af7bf41d1c452071b115" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273764 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="840623d07147e6cf6f6469870ee10b31b867a5ca4cda3a760f89c523661aa7a9" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273773 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="82948b309b2ce73212f41f6eb4ef37b090d2501d82ce65ad827583a6d443d278" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273780 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="1dafc30651707f08ea650bf9b9b0796de80bb95979b7a0efb96286f05f698430" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273788 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="b5b8093f4dff60c86fd5e9fdda4853c6722373cb26df618bc7120a60a1a38256" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273794 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="b308ba5b9db0d5cc512394f23bd38cff8189c1cdfe06d5def513b0cfae404bbf" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273804 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="98cd919c625608e55be9333a4a0de4346eeb7320e68eb0dc6187d0736f520c5c" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273811 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="2a44257f61a84469b828910c85ff5691e1b4a7169355aff6a0a8d19f8a7d0333" exitCode=0 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"00c7261b6fba217c4e24a1664abc878170130e5209700df5097de176b6b61570"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"382e49e62259b12a0b804b135afca426072edd614c2b0360032fd5e93434a325"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"4f2e11536e9dfb8311db5338a7d21c52507a051785eafcf51feb0bac9499d177"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"7d100fe3a4f3a805fe8d957b1438f4eb91b2aa14273dd6eb1a0a391152abe50b"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"5360ab1344e47a7d43209a01e2d9ded2e9ba65717ac480f30ced543424799dca"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"dc146c5dcd18856f85005711936352194db9a939fe6011aefd5ebeedf33e9968"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"830287bfe1d042f3e89be356787c988ff5fa6963f4d3af7bf41d1c452071b115"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"840623d07147e6cf6f6469870ee10b31b867a5ca4cda3a760f89c523661aa7a9"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"82948b309b2ce73212f41f6eb4ef37b090d2501d82ce65ad827583a6d443d278"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"1dafc30651707f08ea650bf9b9b0796de80bb95979b7a0efb96286f05f698430"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"b5b8093f4dff60c86fd5e9fdda4853c6722373cb26df618bc7120a60a1a38256"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"b308ba5b9db0d5cc512394f23bd38cff8189c1cdfe06d5def513b0cfae404bbf"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"98cd919c625608e55be9333a4a0de4346eeb7320e68eb0dc6187d0736f520c5c"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.273963 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"2a44257f61a84469b828910c85ff5691e1b4a7169355aff6a0a8d19f8a7d0333"} Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.295347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnvrf\" (UniqueName: \"kubernetes.io/projected/b4170bf0-4651-402b-b28e-28443fc3f568-kube-api-access-hnvrf\") pod \"b4170bf0-4651-402b-b28e-28443fc3f568\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.295420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-combined-ca-bundle\") pod \"b4170bf0-4651-402b-b28e-28443fc3f568\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.295589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config-secret\") pod \"b4170bf0-4651-402b-b28e-28443fc3f568\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.295639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config\") pod \"b4170bf0-4651-402b-b28e-28443fc3f568\" (UID: \"b4170bf0-4651-402b-b28e-28443fc3f568\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.296227 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.296241 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.296252 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4fc23439-b690-4f59-9028-ba72cf39c81e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.296270 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.297157 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.297438 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data podName:364fcc68-67f7-4008-bc5f-a932b88a72bf nodeName:}" failed. No retries permitted until 2025-11-21 12:41:32.297393838 +0000 UTC m=+3050.998055656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data") pod "rabbitmq-server-0" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf") : configmap "rabbitmq-config-data" not found Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.321743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc23439-b690-4f59-9028-ba72cf39c81e-kube-api-access-8wrrw" (OuterVolumeSpecName: "kube-api-access-8wrrw") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "kube-api-access-8wrrw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.350078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4170bf0-4651-402b-b28e-28443fc3f568-kube-api-access-hnvrf" (OuterVolumeSpecName: "kube-api-access-hnvrf") pod "b4170bf0-4651-402b-b28e-28443fc3f568" (UID: "b4170bf0-4651-402b-b28e-28443fc3f568"). InnerVolumeSpecName "kube-api-access-hnvrf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.356831 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-2" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.107:5671: connect: connection refused" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.401795 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hnvrf\" (UniqueName: \"kubernetes.io/projected/b4170bf0-4651-402b-b28e-28443fc3f568-kube-api-access-hnvrf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.401839 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8wrrw\" (UniqueName: \"kubernetes.io/projected/4fc23439-b690-4f59-9028-ba72cf39c81e-kube-api-access-8wrrw\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.401971 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.402048 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data podName:857a150b-5f89-4c23-b71c-fa0ec47a855d nodeName:}" failed. No retries permitted until 2025-11-21 12:41:32.402023113 +0000 UTC m=+3051.102684931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data") pod "rabbitmq-server-2" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d") : configmap "rabbitmq-config-data" not found Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.402526 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.402567 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data podName:bd8a72b4-4330-450b-9a5d-431819e3ab7f nodeName:}" failed. No retries permitted until 2025-11-21 12:41:32.402558307 +0000 UTC m=+3051.103220115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data") pod "rabbitmq-server-1" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f") : configmap "rabbitmq-config-data" not found Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.411628 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.418293 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.431003 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.431093 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerName="nova-cell0-conductor-conductor" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.451339 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell014d7-account-delete-snw8t"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.467448 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod807d9aae_572d_4e30_bb12_62cebc91bde8.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1ec30bb_632a_4b2e_b008_1ddaf3ba99ac.slice/crio-conmon-d4eadae0ff5501a365781ddd07ff906e43aec811838eb6b2bf7ed3be3c21c5db.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.636820 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.105:5671: connect: connection refused" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.655659 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-1" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.106:5671: connect: connection refused" Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.715808 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.722637 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.725363 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:41:28 crc kubenswrapper[4769]: E1121 12:41:28.725529 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" containerName="nova-scheduler-scheduler" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.728840 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.739728 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc"] Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.740102 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-httpd" containerID="cri-o://c420f1506cf28ef6804b486348b6d21fe955600f531eb9caa2242a1d8c4392b5" gracePeriod=30 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.740333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-server" containerID="cri-o://5a286a7207d803214125f331757b926a6d3cc978313ad63da1425b15628d7c24" gracePeriod=30 Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.756388 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd"] Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.757964 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "b4170bf0-4651-402b-b28e-28443fc3f568" (UID: "b4170bf0-4651-402b-b28e-28443fc3f568"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.769902 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.108:5671: connect: connection refused" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.769928 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.110:5671: connect: connection refused" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.770810 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.824818 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hffsk\" (UniqueName: \"kubernetes.io/projected/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-api-access-hffsk\") pod \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.824896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-certs\") pod \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.825051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-config\") pod \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.825079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-combined-ca-bundle\") pod \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\" (UID: \"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0\") " Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.825662 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.825680 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.856474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "b4170bf0-4651-402b-b28e-28443fc3f568" (UID: "b4170bf0-4651-402b-b28e-28443fc3f568"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.856776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-api-access-hffsk" (OuterVolumeSpecName: "kube-api-access-hffsk") pod "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" (UID: "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0"). InnerVolumeSpecName "kube-api-access-hffsk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.857485 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.109:5671: connect: connection refused" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.931229 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:28 crc kubenswrapper[4769]: I1121 12:41:28.931287 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hffsk\" (UniqueName: \"kubernetes.io/projected/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-api-access-hffsk\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.032834 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.033170 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data podName:1e2aa50b-63a4-4d92-88bd-345ec2d80dd4 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.033154884 +0000 UTC m=+3051.733816702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data") pod "rabbitmq-cell1-server-2" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.057923 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.152672 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.173704 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.177849 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b4170bf0-4651-402b-b28e-28443fc3f568" (UID: "b4170bf0-4651-402b-b28e-28443fc3f568"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.193356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" (UID: "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.193392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" (UID: "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.234329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "4fc23439-b690-4f59-9028-ba72cf39c81e" (UID: "4fc23439-b690-4f59-9028-ba72cf39c81e"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.257798 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.257856 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4170bf0-4651-402b-b28e-28443fc3f568-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.257866 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc23439-b690-4f59-9028-ba72cf39c81e-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.257876 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.257890 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.257976 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.258045 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data podName:361938ec-ffd5-4e1c-80b2-c30d796ba89c nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.258023208 +0000 UTC m=+3051.958685026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data") pod "rabbitmq-cell1-server-0" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.321688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" (UID: "ff7d33ec-3dd6-40bc-a371-734a70ab6ed0"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.337509 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242ebd44-6200-4f38-acd8-e48ababc139d" path="/var/lib/kubelet/pods/242ebd44-6200-4f38-acd8-e48ababc139d/volumes" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.350823 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" containerID="9c0f1a84912c10da1c181ce099086af20f4da8bee6ba96e0698a1ddd91727820" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.355946 4769 generic.go:334] "Generic (PLEG): container finished" podID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerID="5a286a7207d803214125f331757b926a6d3cc978313ad63da1425b15628d7c24" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.355973 4769 generic.go:334] "Generic (PLEG): container finished" podID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerID="c420f1506cf28ef6804b486348b6d21fe955600f531eb9caa2242a1d8c4392b5" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.359468 4769 generic.go:334] "Generic (PLEG): container finished" podID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" containerID="ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.360921 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.368362 4769 generic.go:334] "Generic (PLEG): container finished" podID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerID="908724d52efa7d576b7f6591f9a9144816fe4c25e7857cf621f85b556381d9ed" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.381020 4769 generic.go:334] "Generic (PLEG): container finished" podID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" containerID="e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2" exitCode=2 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.381887 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.386646 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" path="/var/lib/kubelet/pods/807d9aae-572d-4e30-bb12-62cebc91bde8/volumes" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.388202 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4170bf0-4651-402b-b28e-28443fc3f568" path="/var/lib/kubelet/pods/b4170bf0-4651-402b-b28e-28443fc3f568/volumes" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.389394 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195" path="/var/lib/kubelet/pods/ee4b6e2d-a6eb-4ec4-ae7c-cf53b71ac195/volumes" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.391690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5","Type":"ContainerDied","Data":"9c0f1a84912c10da1c181ce099086af20f4da8bee6ba96e0698a1ddd91727820"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.391813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" event={"ID":"96cb08c2-a543-4f8a-8e70-3fe6b2c02998","Type":"ContainerDied","Data":"5a286a7207d803214125f331757b926a6d3cc978313ad63da1425b15628d7c24"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.391915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" event={"ID":"96cb08c2-a543-4f8a-8e70-3fe6b2c02998","Type":"ContainerDied","Data":"c420f1506cf28ef6804b486348b6d21fe955600f531eb9caa2242a1d8c4392b5"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.392004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92b8d7f9-665b-4f65-96fe-2a447f95ee0c","Type":"ContainerDied","Data":"ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.392096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85","Type":"ContainerDied","Data":"908724d52efa7d576b7f6591f9a9144816fe4c25e7857cf621f85b556381d9ed"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.392173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" event={"ID":"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce","Type":"ContainerStarted","Data":"393fc01f36071199791b5c6624013ff65ff9e16667d95e9aee6214ca655a25d0"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.392262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0","Type":"ContainerDied","Data":"e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.394516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"ff7d33ec-3dd6-40bc-a371-734a70ab6ed0","Type":"ContainerDied","Data":"8d96f02488a3f633b37692a35b46d104efd4be4b607c40c02f695a51f1aa846a"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.394770 4769 scope.go:117] "RemoveContainer" containerID="e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.416457 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" event={"ID":"650a3adf-623d-4869-be32-b9188cb6f1f1","Type":"ContainerStarted","Data":"7620b986126ada08f3feebadda7b0f307ef12fbf95f5e21ff2cced291a4dcf0f"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.424083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.430451 4769 generic.go:334] "Generic (PLEG): container finished" podID="90d862ac-19bc-4f97-8920-41d1008aece5" containerID="e9a24a60a13339f824b9e88443465735fa6fa49767d07867036f9439bf30578b" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.430546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" event={"ID":"90d862ac-19bc-4f97-8920-41d1008aece5","Type":"ContainerDied","Data":"e9a24a60a13339f824b9e88443465735fa6fa49767d07867036f9439bf30578b"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.430573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" event={"ID":"90d862ac-19bc-4f97-8920-41d1008aece5","Type":"ContainerStarted","Data":"7dbc4680825d0aa32b58a01a83eae9b44e4ae260f8d21ab369089270c0ce60f9"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.441453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" event={"ID":"ab6773c4-0375-4426-a9c9-aa301a616474","Type":"ContainerStarted","Data":"dad7468c24ba83553a4779cd09840f89b7a7773434b541b129bac3861139b785"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.452748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" event={"ID":"3a4d44b3-704e-44c0-8e41-64af780dcd32","Type":"ContainerStarted","Data":"9d401d9f12862d67a0352973e604007d1c96529411db6e809df2f0a6897325f7"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.476157 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerID="d4eadae0ff5501a365781ddd07ff906e43aec811838eb6b2bf7ed3be3c21c5db" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.484255 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerID="c774bfbaefcd18b588133e670d55b5bae274c5e6b1953a1142c7eb00b6a64788" exitCode=2 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.484299 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerID="642cc14ff093159f93a9081bb20a7fd1ff23f2f544fa737e5cda8819ee063408" exitCode=0 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.477244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerDied","Data":"d4eadae0ff5501a365781ddd07ff906e43aec811838eb6b2bf7ed3be3c21c5db"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.484487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerDied","Data":"c774bfbaefcd18b588133e670d55b5bae274c5e6b1953a1142c7eb00b6a64788"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.484507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerDied","Data":"642cc14ff093159f93a9081bb20a7fd1ff23f2f544fa737e5cda8819ee063408"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.501075 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" event={"ID":"c1947d55-7857-40da-9103-804862218844","Type":"ContainerStarted","Data":"07c7d1e5090d33e40a35aee365f85f3973ef7aa5ea8b369563af0508670090d8"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.501127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" event={"ID":"c1947d55-7857-40da-9103-804862218844","Type":"ContainerStarted","Data":"77f784eed5cacf46549f7e7b05cd112c2cb9eabe2b0a17aa259ab9ac8e745d0d"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.511913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" event={"ID":"3769889c-3377-4452-80a0-387660264035","Type":"ContainerStarted","Data":"cf7891c035d844206afcc77b6cb1a1bec28b4d3d9fc302ed59129f9ec080bb65"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.555623 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-1" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="galera" containerID="cri-o://0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001" gracePeriod=28 Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.561029 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4fc23439-b690-4f59-9028-ba72cf39c81e/ovsdbserver-nb/0.log" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.561181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4fc23439-b690-4f59-9028-ba72cf39c81e","Type":"ContainerDied","Data":"9419892b774ee3fbe294ad5230b90a4fb25ab7759903ba82f9c81a47b872f96c"} Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.561334 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.563813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" event={"ID":"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe","Type":"ContainerStarted","Data":"4098ba6be1b9d980e7cf421fd87715ec3b69e6de1e0f3c9c97faeed6c6640e10"} Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.602862 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.602937 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data podName:b27c6ab8-1814-4fc4-be72-63efaf921244 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.602921616 +0000 UTC m=+3052.303583434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data") pod "rabbitmq-cell1-server-1" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.931192 4769 scope.go:117] "RemoveContainer" containerID="e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2" Nov 21 12:41:29 crc kubenswrapper[4769]: E1121 12:41:29.931902 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2\": container with ID starting with e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2 not found: ID does not exist" containerID="e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.931934 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2"} err="failed to get container status \"e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2\": rpc error: code = NotFound desc = could not find container \"e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2\": container with ID starting with e39cbec4819decb1c812d7c19be00cbea734a01215e9d31aba304a27f91552b2 not found: ID does not exist" Nov 21 12:41:29 crc kubenswrapper[4769]: I1121 12:41:29.931955 4769 scope.go:117] "RemoveContainer" containerID="97bf8f1119990e5f020933900bdd694b77bd4716487dbd84b9e49dbaf47b746c" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.030288 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.159:8776/healthcheck\": read tcp 10.217.0.2:41218->10.217.0.159:8776: read: connection reset by peer" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.054498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.078160 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" podStartSLOduration=6.078141538 podStartE2EDuration="6.078141538s" podCreationTimestamp="2025-11-21 12:41:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:29.555852086 +0000 UTC m=+3048.256513904" watchObservedRunningTime="2025-11-21 12:41:30.078141538 +0000 UTC m=+3048.778803356" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.220921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-config-data\") pod \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.221013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-combined-ca-bundle\") pod \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.221179 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-nova-novncproxy-tls-certs\") pod \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.221277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-vencrypt-tls-certs\") pod \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.221300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b8px\" (UniqueName: \"kubernetes.io/projected/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-kube-api-access-6b8px\") pod \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\" (UID: \"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5\") " Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.241345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-kube-api-access-6b8px" (OuterVolumeSpecName: "kube-api-access-6b8px") pod "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" (UID: "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5"). InnerVolumeSpecName "kube-api-access-6b8px". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.305675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-config-data" (OuterVolumeSpecName: "config-data") pod "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" (UID: "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.327663 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6b8px\" (UniqueName: \"kubernetes.io/projected/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-kube-api-access-6b8px\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.327711 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.354993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" (UID: "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.364286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" (UID: "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.369059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" (UID: "2bd67268-d5ea-4c3b-8d8a-7b252c582fa5"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.413439 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.155:9311/healthcheck\": read tcp 10.217.0.2:52660->10.217.0.155:9311: read: connection reset by peer" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.413469 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.155:9311/healthcheck\": read tcp 10.217.0.2:52664->10.217.0.155:9311: read: connection reset by peer" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.429554 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.429588 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.429796 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.465516 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.151:8778/\": read tcp 10.217.0.2:33434->10.217.0.151:8778: read: connection reset by peer" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.465516 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.151:8778/\": read tcp 10.217.0.2:33450->10.217.0.151:8778: read: connection reset by peer" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.658014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" event={"ID":"96cb08c2-a543-4f8a-8e70-3fe6b2c02998","Type":"ContainerDied","Data":"0190dd178126c87c0812a9d0193bf9e2035c3985db48a63680eb723ea0ae3f28"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.658053 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0190dd178126c87c0812a9d0193bf9e2035c3985db48a63680eb723ea0ae3f28" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.668066 4769 generic.go:334] "Generic (PLEG): container finished" podID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerID="7fc50dbca35cc370c828ce095218982f40a265632084df3e8461aaab8c01ccce" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.668133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6f231df0-d475-4ac5-9de8-403d93cc5d8a","Type":"ContainerDied","Data":"7fc50dbca35cc370c828ce095218982f40a265632084df3e8461aaab8c01ccce"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.671513 4769 generic.go:334] "Generic (PLEG): container finished" podID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerID="22d08c8fb8e93d13fcd5f7caba4ee618409e1a225ae88c4d57b04382f8b4cfe0" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.671554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" event={"ID":"964afe99-46d9-4b4e-be03-e3cf7c5b6e04","Type":"ContainerDied","Data":"22d08c8fb8e93d13fcd5f7caba4ee618409e1a225ae88c4d57b04382f8b4cfe0"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.690501 4769 generic.go:334] "Generic (PLEG): container finished" podID="4410612c-42ac-4f8a-b643-ddc90384366c" containerID="07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.690617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"4410612c-42ac-4f8a-b643-ddc90384366c","Type":"ContainerDied","Data":"07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.754839 4769 scope.go:117] "RemoveContainer" containerID="f11b63d57e10848902fd856e8f9ca97a3b03b5b86b6c2e53b5d1586c2a86402b" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.759016 4769 generic.go:334] "Generic (PLEG): container finished" podID="28df21b3-2a77-4353-8fac-3fa307992568" containerID="0b71d3bf15064131e4dc7c417b4abfc3cb7822e2433df02e5147417739760822" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.759155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"28df21b3-2a77-4353-8fac-3fa307992568","Type":"ContainerDied","Data":"0b71d3bf15064131e4dc7c417b4abfc3cb7822e2433df02e5147417739760822"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.808276 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerID="8be503a780af2106b1093a3cc784715994f0866fa4b64ab072cf0110f424501e" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.808414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerDied","Data":"8be503a780af2106b1093a3cc784715994f0866fa4b64ab072cf0110f424501e"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.818487 4769 generic.go:334] "Generic (PLEG): container finished" podID="e689da25-a663-48f8-acc0-3890d96884a2" containerID="b7988bea32c802e8b5a49d276c9ee94444c8899e8888fc245b7ea7c260125703" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.818884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e689da25-a663-48f8-acc0-3890d96884a2","Type":"ContainerDied","Data":"b7988bea32c802e8b5a49d276c9ee94444c8899e8888fc245b7ea7c260125703"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.822486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2bd67268-d5ea-4c3b-8d8a-7b252c582fa5","Type":"ContainerDied","Data":"4e1acdd43bc05865cc99186c2a4f41e6c9b6d3d92f6a7d65650e91f8f82d5d94"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.822580 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.836615 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.836846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="bfdef99c-9c68-4b51-b2c5-7effb71b205d" containerName="memcached" containerID="cri-o://7d360957c8822f3fe69461bed081222da9aecb8b83ca4db8ecd0ceb413e0b155" gracePeriod=30 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.863879 4769 generic.go:334] "Generic (PLEG): container finished" podID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerID="99ee46e7be53655c9ff1ea8014b01115ef5a430294ae2e1adbe9b53c4d2f5174" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.863981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94b1f363-8761-4a8e-a35c-d7cc338232f2","Type":"ContainerDied","Data":"99ee46e7be53655c9ff1ea8014b01115ef5a430294ae2e1adbe9b53c4d2f5174"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.906353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85","Type":"ContainerDied","Data":"59cc84166fab8618dbb86461d4f527eeab9b15c04da677dcdc0729e1fc36792a"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.906531 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59cc84166fab8618dbb86461d4f527eeab9b15c04da677dcdc0729e1fc36792a" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.914006 4769 generic.go:334] "Generic (PLEG): container finished" podID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerID="c98138b795f4cbd3160b47d4e5bca080367c97055345e9be9a1a4d7cd7370c29" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.914277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" event={"ID":"bbc6cddf-3e72-4186-bdf5-23ad222a4686","Type":"ContainerDied","Data":"c98138b795f4cbd3160b47d4e5bca080367c97055345e9be9a1a4d7cd7370c29"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.919426 4769 generic.go:334] "Generic (PLEG): container finished" podID="c1947d55-7857-40da-9103-804862218844" containerID="07c7d1e5090d33e40a35aee365f85f3973ef7aa5ea8b369563af0508670090d8" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.919623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" event={"ID":"c1947d55-7857-40da-9103-804862218844","Type":"ContainerDied","Data":"07c7d1e5090d33e40a35aee365f85f3973ef7aa5ea8b369563af0508670090d8"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.926706 4769 generic.go:334] "Generic (PLEG): container finished" podID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerID="db111da3413ec218967d1a5ce01181ec0a6d6af36b5cc1ff9f160658a1fcd4c9" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.926946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" event={"ID":"946c5e3d-0426-4c04-b00c-9fdaa8da7146","Type":"ContainerDied","Data":"db111da3413ec218967d1a5ce01181ec0a6d6af36b5cc1ff9f160658a1fcd4c9"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.935763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"92b8d7f9-665b-4f65-96fe-2a447f95ee0c","Type":"ContainerDied","Data":"da96b430258c0b9f4221810ca79c4468211102fc7fa6b26d62842486924d63cf"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.935812 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da96b430258c0b9f4221810ca79c4468211102fc7fa6b26d62842486924d63cf" Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.942259 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xkvr9"] Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.946408 4769 generic.go:334] "Generic (PLEG): container finished" podID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerID="83a0081ccc7bc4469392f021dba095ec7b5d40baa4591504a425d1db88f87dd3" exitCode=0 Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.946631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5515ac85-cbc8-453f-8b3d-5f4ac3940b30","Type":"ContainerDied","Data":"83a0081ccc7bc4469392f021dba095ec7b5d40baa4591504a425d1db88f87dd3"} Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.951157 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-xkvr9"] Nov 21 12:41:30 crc kubenswrapper[4769]: I1121 12:41:30.974540 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-gl7xv"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.004139 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.005433 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-gl7xv"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.025553 4769 scope.go:117] "RemoveContainer" containerID="8fc1f8c17fb43ef1d2529b628249d1e756fa8945c3c6aad6945a9e9716cc1028" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.082247 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.091236 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.091698 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.109569 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.114480 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5dff568d6d-2ltjv"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.114785 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" podUID="3f9ccc3c-419c-48a9-b052-640fc504a4c3" containerName="keystone-api" containerID="cri-o://58fe909266273dec1aa413ce6b37f92941f2f4ca2dc892c70b34c612a1ecef72" gracePeriod=30 Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.141430 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.175446 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-combined-ca-bundle\") pod \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.175582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-config-data\") pod \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.175705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6qdw\" (UniqueName: \"kubernetes.io/projected/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-kube-api-access-n6qdw\") pod \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\" (UID: \"92b8d7f9-665b-4f65-96fe-2a447f95ee0c\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.206416 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.227493 4769 scope.go:117] "RemoveContainer" containerID="9c0f1a84912c10da1c181ce099086af20f4da8bee6ba96e0698a1ddd91727820" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.228815 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone2331-account-delete-tkzfh"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229231 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-server" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229265 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-server" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229275 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="ovsdbserver-sb" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229282 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="ovsdbserver-sb" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229296 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="probe" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229303 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="probe" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229316 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229322 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229332 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-log" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229339 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-log" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-httpd" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229353 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-httpd" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229368 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-httpd" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229374 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-httpd" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229390 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" containerName="nova-scheduler-scheduler" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229396 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" containerName="nova-scheduler-scheduler" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229415 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" containerName="kube-state-metrics" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229421 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" containerName="kube-state-metrics" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229432 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="cinder-scheduler" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229439 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="cinder-scheduler" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229453 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="ovsdbserver-nb" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229460 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="ovsdbserver-nb" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229476 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="openstack-network-exporter" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229482 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="openstack-network-exporter" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.229492 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="openstack-network-exporter" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229501 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="openstack-network-exporter" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229708 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" containerName="kube-state-metrics" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229718 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-log" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229727 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="28df21b3-2a77-4353-8fac-3fa307992568" containerName="glance-httpd" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229739 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="ovsdbserver-nb" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229745 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" containerName="nova-scheduler-scheduler" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229754 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="cinder-scheduler" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229765 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-server" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229775 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229785 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="openstack-network-exporter" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229792 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" containerName="proxy-httpd" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229799 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" containerName="openstack-network-exporter" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229811 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="807d9aae-572d-4e30-bb12-62cebc91bde8" containerName="ovsdbserver-sb" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.229823 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" containerName="probe" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.235513 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-scripts\") pod \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-logs\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-etc-swift\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-config-data\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-scripts\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76779\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-kube-api-access-76779\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-internal-tls-certs\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-config-data\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-log-httpd\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.276989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-public-tls-certs\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.277029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-etc-machine-id\") pod \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.277100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-httpd-run\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.277143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjkk9\" (UniqueName: \"kubernetes.io/projected/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-kube-api-access-bjkk9\") pod \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.277186 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-combined-ca-bundle\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-public-tls-certs\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data-custom\") pod \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-combined-ca-bundle\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data\") pod \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283541 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-combined-ca-bundle\") pod \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\" (UID: \"cf5c7d97-c7aa-4b91-b784-ff9a10b76d85\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-run-httpd\") pod \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\" (UID: \"96cb08c2-a543-4f8a-8e70-3fe6b2c02998\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.283643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q5wf\" (UniqueName: \"kubernetes.io/projected/28df21b3-2a77-4353-8fac-3fa307992568-kube-api-access-9q5wf\") pod \"28df21b3-2a77-4353-8fac-3fa307992568\" (UID: \"28df21b3-2a77-4353-8fac-3fa307992568\") " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.287385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.290412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-logs" (OuterVolumeSpecName: "logs") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.292487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.292550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" (UID: "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.301138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.317398 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e7a128-1b78-4637-bcd6-0cc30877afb8" path="/var/lib/kubelet/pods/20e7a128-1b78-4637-bcd6-0cc30877afb8/volumes" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.320851 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc23439-b690-4f59-9028-ba72cf39c81e" path="/var/lib/kubelet/pods/4fc23439-b690-4f59-9028-ba72cf39c81e/volumes" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.321507 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebfb972-08eb-4f4d-9ba0-dadb691edfc2" path="/var/lib/kubelet/pods/bebfb972-08eb-4f4d-9ba0-dadb691edfc2/volumes" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.360425 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.397952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrfbj\" (UniqueName: \"kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.398009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.398104 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.398115 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.398124 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.398132 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.398140 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/28df21b3-2a77-4353-8fac-3fa307992568-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.415168 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.447337 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.481013 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.491260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone2331-account-delete-tkzfh"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.513577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfbj\" (UniqueName: \"kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.513666 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.514057 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.514167 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:32.014140723 +0000 UTC m=+3050.714802541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : configmap "openstack-scripts" not found Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.522403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-scripts" (OuterVolumeSpecName: "scripts") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.526848 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zrfbj for pod openstack-kuttl-tests/keystone2331-account-delete-tkzfh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.526940 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:32.02690518 +0000 UTC m=+3050.727566998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zrfbj" (UniqueName: "kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.541955 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5qlv2"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.555715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-kube-api-access-76779" (OuterVolumeSpecName: "kube-api-access-76779") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "kube-api-access-76779". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.580411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-scripts" (OuterVolumeSpecName: "scripts") pod "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" (UID: "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.585617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "glance") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.588466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28df21b3-2a77-4353-8fac-3fa307992568-kube-api-access-9q5wf" (OuterVolumeSpecName: "kube-api-access-9q5wf") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "kube-api-access-9q5wf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.590376 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-5qlv2"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.591020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-kube-api-access-bjkk9" (OuterVolumeSpecName: "kube-api-access-bjkk9") pod "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" (UID: "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85"). InnerVolumeSpecName "kube-api-access-bjkk9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.616333 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9q5wf\" (UniqueName: \"kubernetes.io/projected/28df21b3-2a77-4353-8fac-3fa307992568-kube-api-access-9q5wf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.616369 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.616396 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.616405 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.616415 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-76779\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-kube-api-access-76779\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.616424 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bjkk9\" (UniqueName: \"kubernetes.io/projected/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-kube-api-access-bjkk9\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.621365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-kube-api-access-n6qdw" (OuterVolumeSpecName: "kube-api-access-n6qdw") pod "92b8d7f9-665b-4f65-96fe-2a447f95ee0c" (UID: "92b8d7f9-665b-4f65-96fe-2a447f95ee0c"). InnerVolumeSpecName "kube-api-access-n6qdw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.629512 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-2331-account-create-8kfz5"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.640843 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-2331-account-create-8kfz5"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.645781 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.651105 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.654603 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.654637 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.656193 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone2331-account-delete-tkzfh"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.656934 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zrfbj operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" podUID="878271c0-b6d8-414e-abe3-64ab67691f72" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.658103 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.666612 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.670365 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.672983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" (UID: "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.674263 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.674300 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-1" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="galera" Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.675230 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21 is running failed: container process not found" containerID="07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.676248 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21 is running failed: container process not found" containerID="07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.679065 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21 is running failed: container process not found" containerID="07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:41:31 crc kubenswrapper[4769]: E1121 12:41:31.679089 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="galera" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.719234 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.722775 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n6qdw\" (UniqueName: \"kubernetes.io/projected/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-kube-api-access-n6qdw\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.722801 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.780326 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="galera" probeResult="failure" output="command timed out" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.780736 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="galera" probeResult="failure" output="command timed out" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.783759 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/openstack-galera-1" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="galera" probeResult="failure" output="command timed out" Nov 21 12:41:31 crc kubenswrapper[4769]: I1121 12:41:31.806981 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="galera" containerID="cri-o://955fb3d7189dbb92109266c196b642fbb509c7dbafddc4d5f25d6673c61ae5ce" gracePeriod=26 Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.002576 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"28df21b3-2a77-4353-8fac-3fa307992568","Type":"ContainerDied","Data":"2e147c578dbd49cc9c77c381c973564ad1e368854fb728c1534a65c7465b7a0f"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.002680 4769 scope.go:117] "RemoveContainer" containerID="0b71d3bf15064131e4dc7c417b4abfc3cb7822e2433df02e5147417739760822" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.003059 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.040553 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zrfbj for pod openstack-kuttl-tests/keystone2331-account-delete-tkzfh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.040634 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.040611657 +0000 UTC m=+3051.741273525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrfbj" (UniqueName: "kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.040988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6f231df0-d475-4ac5-9de8-403d93cc5d8a","Type":"ContainerDied","Data":"f4566d2af2b2244944dbfc2be0124f23d5560dc8bbc4457cb40516b44e2d8666"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.041013 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4566d2af2b2244944dbfc2be0124f23d5560dc8bbc4457cb40516b44e2d8666" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.035487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfbj\" (UniqueName: \"kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.049716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.049849 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.049929 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.04988792 +0000 UTC m=+3051.750549738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : configmap "openstack-scripts" not found Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.050295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"94b1f363-8761-4a8e-a35c-d7cc338232f2","Type":"ContainerDied","Data":"ed38c6ed397f6b9cec29da42267a358f52f826ff28212a75290880ea69cd8fed"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.050321 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed38c6ed397f6b9cec29da42267a358f52f826ff28212a75290880ea69cd8fed" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.055916 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" event={"ID":"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce","Type":"ContainerStarted","Data":"23c6db1c35ef5682dfe3c48f66160953ad34b211d0755d02db8bc679029538f5"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.056769 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.076216 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" podStartSLOduration=8.076182454 podStartE2EDuration="8.076182454s" podCreationTimestamp="2025-11-21 12:41:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:32.072567916 +0000 UTC m=+3050.773229734" watchObservedRunningTime="2025-11-21 12:41:32.076182454 +0000 UTC m=+3050.776844262" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.076855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"e689da25-a663-48f8-acc0-3890d96884a2","Type":"ContainerDied","Data":"f2730f469f7940247b8f0dce9c27f8162a6186aa7efb4dd927c74fb18e3f946b"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.076917 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2730f469f7940247b8f0dce9c27f8162a6186aa7efb4dd927c74fb18e3f946b" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.094256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5515ac85-cbc8-453f-8b3d-5f4ac3940b30","Type":"ContainerDied","Data":"f53db7455a093091b8a103d71027782e5bbf9237d4eac04c16c88f5772c77cc3"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.094322 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f53db7455a093091b8a103d71027782e5bbf9237d4eac04c16c88f5772c77cc3" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.105956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-2" event={"ID":"4410612c-42ac-4f8a-b643-ddc90384366c","Type":"ContainerDied","Data":"9e583bbded8c02a2473cdf5acfb34941e2fd5a0365c6f41d084f457b327102d6"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.106021 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e583bbded8c02a2473cdf5acfb34941e2fd5a0365c6f41d084f457b327102d6" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.109067 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.111171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" event={"ID":"964afe99-46d9-4b4e-be03-e3cf7c5b6e04","Type":"ContainerDied","Data":"36d2e8f4a23d3f78920c060c862b0ad3514e05e6cbcdf3b75198f13b955ef831"} Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.111234 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36d2e8f4a23d3f78920c060c862b0ad3514e05e6cbcdf3b75198f13b955ef831" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.111308 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.111596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.111829 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.163167 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.163273 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:41:32.663254222 +0000 UTC m=+3051.363916040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.368912 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.369039 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data podName:364fcc68-67f7-4008-bc5f-a932b88a72bf nodeName:}" failed. No retries permitted until 2025-11-21 12:41:40.369012397 +0000 UTC m=+3059.069674285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data") pod "rabbitmq-server-0" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf") : configmap "rabbitmq-config-data" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.469244 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.469316 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data podName:857a150b-5f89-4c23-b71c-fa0ec47a855d nodeName:}" failed. No retries permitted until 2025-11-21 12:41:40.469301684 +0000 UTC m=+3059.169963502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data") pod "rabbitmq-server-2" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d") : configmap "rabbitmq-config-data" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.469351 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.469373 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data podName:bd8a72b4-4330-450b-9a5d-431819e3ab7f nodeName:}" failed. No retries permitted until 2025-11-21 12:41:40.469366685 +0000 UTC m=+3059.170028503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data") pod "rabbitmq-server-1" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f") : configmap "rabbitmq-config-data" not found Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.515905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "92b8d7f9-665b-4f65-96fe-2a447f95ee0c" (UID: "92b8d7f9-665b-4f65-96fe-2a447f95ee0c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.521407 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.539364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.543364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-config-data" (OuterVolumeSpecName: "config-data") pod "92b8d7f9-665b-4f65-96fe-2a447f95ee0c" (UID: "92b8d7f9-665b-4f65-96fe-2a447f95ee0c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.571624 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.571662 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.571672 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.571683 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92b8d7f9-665b-4f65-96fe-2a447f95ee0c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.619844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.640149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.641568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" (UID: "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.644491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-config-data" (OuterVolumeSpecName: "config-data") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.654667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "28df21b3-2a77-4353-8fac-3fa307992568" (UID: "28df21b3-2a77-4353-8fac-3fa307992568"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.668231 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.671641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-config-data" (OuterVolumeSpecName: "config-data") pod "96cb08c2-a543-4f8a-8e70-3fe6b2c02998" (UID: "96cb08c2-a543-4f8a-8e70-3fe6b2c02998"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.676862 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.676977 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.677074 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.677165 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.677304 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96cb08c2-a543-4f8a-8e70-3fe6b2c02998-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.677405 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.677495 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/28df21b3-2a77-4353-8fac-3fa307992568-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.677112 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:32 crc kubenswrapper[4769]: E1121 12:41:32.677711 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.67769106 +0000 UTC m=+3052.378352878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.744832 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-2" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="galera" containerID="cri-o://1a929f8fb5d24d5a7a5149b7c441b592b95ddcdc7c212c54f6ae7a0c3aab6b13" gracePeriod=29 Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.749711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data" (OuterVolumeSpecName: "config-data") pod "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" (UID: "cf5c7d97-c7aa-4b91-b784-ff9a10b76d85"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.779942 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.783364 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="galera" probeResult="failure" output="command timed out" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.962647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:41:32 crc kubenswrapper[4769]: I1121 12:41:32.973140 4769 scope.go:117] "RemoveContainer" containerID="159afc2dfdd50fb5cf8576f3819b134721278e456333d34a574585afab289f5b" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.001789 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.031422 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.036524 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.044134 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.048144 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.053341 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-867d8f6754-vfcsc"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.062316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.069264 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.076276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.078685 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.079268 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.090922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-internal-tls-certs\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.090977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5cfl\" (UniqueName: \"kubernetes.io/projected/94b1f363-8761-4a8e-a35c-d7cc338232f2-kube-api-access-z5cfl\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrqrq\" (UniqueName: \"kubernetes.io/projected/e689da25-a663-48f8-acc0-3890d96884a2-kube-api-access-mrqrq\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59vtc\" (UniqueName: \"kubernetes.io/projected/6f231df0-d475-4ac5-9de8-403d93cc5d8a-kube-api-access-59vtc\") pod \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data-custom\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-logs\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-config-data\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-combined-ca-bundle\") pod \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-combined-ca-bundle\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e689da25-a663-48f8-acc0-3890d96884a2-etc-machine-id\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091315 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-config-data\") pod \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-scripts\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091381 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-public-tls-certs\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-nova-metadata-tls-certs\") pod \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f231df0-d475-4ac5-9de8-403d93cc5d8a-logs\") pod \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\" (UID: \"6f231df0-d475-4ac5-9de8-403d93cc5d8a\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e689da25-a663-48f8-acc0-3890d96884a2-logs\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-httpd-run\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-combined-ca-bundle\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091535 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-internal-tls-certs\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-scripts\") pod \"94b1f363-8761-4a8e-a35c-d7cc338232f2\" (UID: \"94b1f363-8761-4a8e-a35c-d7cc338232f2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data\") pod \"e689da25-a663-48f8-acc0-3890d96884a2\" (UID: \"e689da25-a663-48f8-acc0-3890d96884a2\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfbj\" (UniqueName: \"kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.091909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.092163 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.092233 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data podName:1e2aa50b-63a4-4d92-88bd-345ec2d80dd4 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.092220501 +0000 UTC m=+3059.792882319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data") pod "rabbitmq-cell1-server-2" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.093602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f231df0-d475-4ac5-9de8-403d93cc5d8a-logs" (OuterVolumeSpecName: "logs") pod "6f231df0-d475-4ac5-9de8-403d93cc5d8a" (UID: "6f231df0-d475-4ac5-9de8-403d93cc5d8a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.096035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e689da25-a663-48f8-acc0-3890d96884a2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.097555 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.097632 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:35.097610188 +0000 UTC m=+3053.798272006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.099329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.101557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e689da25-a663-48f8-acc0-3890d96884a2-logs" (OuterVolumeSpecName: "logs") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.102042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.102687 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zrfbj for pod openstack-kuttl-tests/keystone2331-account-delete-tkzfh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.102770 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-logs" (OuterVolumeSpecName: "logs") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.102885 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:35.102862771 +0000 UTC m=+3053.803524589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrfbj" (UniqueName: "kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.103181 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.106839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-scripts" (OuterVolumeSpecName: "scripts") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.120842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e689da25-a663-48f8-acc0-3890d96884a2-kube-api-access-mrqrq" (OuterVolumeSpecName: "kube-api-access-mrqrq") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "kube-api-access-mrqrq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.121818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-scripts" (OuterVolumeSpecName: "scripts") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.139878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f231df0-d475-4ac5-9de8-403d93cc5d8a-kube-api-access-59vtc" (OuterVolumeSpecName: "kube-api-access-59vtc") pod "6f231df0-d475-4ac5-9de8-403d93cc5d8a" (UID: "6f231df0-d475-4ac5-9de8-403d93cc5d8a"). InnerVolumeSpecName "kube-api-access-59vtc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.159067 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.166572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.166585 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.169631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac","Type":"ContainerDied","Data":"ddaa22a10a2af794f8b1ab27a3efcb4cad0d075caef4ea8eeb4ba3c60462058a"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.169706 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddaa22a10a2af794f8b1ab27a3efcb4cad0d075caef4ea8eeb4ba3c60462058a" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.174112 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.174159 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f215726f-5d62-4daf-98e4-270f4778542f" containerName="nova-cell1-conductor-conductor" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.174698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" event={"ID":"c1947d55-7857-40da-9103-804862218844","Type":"ContainerDied","Data":"77f784eed5cacf46549f7e7b05cd112c2cb9eabe2b0a17aa259ab9ac8e745d0d"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.174820 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77f784eed5cacf46549f7e7b05cd112c2cb9eabe2b0a17aa259ab9ac8e745d0d" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.189112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b1f363-8761-4a8e-a35c-d7cc338232f2-kube-api-access-z5cfl" (OuterVolumeSpecName: "kube-api-access-z5cfl") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "kube-api-access-z5cfl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.190252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" event={"ID":"90d862ac-19bc-4f97-8920-41d1008aece5","Type":"ContainerDied","Data":"7dbc4680825d0aa32b58a01a83eae9b44e4ae260f8d21ab369089270c0ce60f9"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.190308 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dbc4680825d0aa32b58a01a83eae9b44e4ae260f8d21ab369089270c0ce60f9" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.194923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4blzb\" (UniqueName: \"kubernetes.io/projected/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-kube-api-access-4blzb\") pod \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.202917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-combined-ca-bundle\") pod \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-galera-tls-certs\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203181 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-config-data\") pod \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203607 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-public-tls-certs\") pod \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-internal-tls-certs\") pod \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-operator-scripts\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.203988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-generated\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.204046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrq2h\" (UniqueName: \"kubernetes.io/projected/4410612c-42ac-4f8a-b643-ddc90384366c-kube-api-access-hrq2h\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.204299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-kolla-config\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.204366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-combined-ca-bundle\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.204396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-logs\") pod \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\" (UID: \"5515ac85-cbc8-453f-8b3d-5f4ac3940b30\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.204448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-default\") pod \"4410612c-42ac-4f8a-b643-ddc90384366c\" (UID: \"4410612c-42ac-4f8a-b643-ddc90384366c\") " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.208677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.209833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.221092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-kube-api-access-4blzb" (OuterVolumeSpecName: "kube-api-access-4blzb") pod "5515ac85-cbc8-453f-8b3d-5f4ac3940b30" (UID: "5515ac85-cbc8-453f-8b3d-5f4ac3940b30"). InnerVolumeSpecName "kube-api-access-4blzb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.201188 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" event={"ID":"ab6773c4-0375-4426-a9c9-aa301a616474","Type":"ContainerStarted","Data":"8183e4f32616b12778da0d9f0435279bc14055f3ecfbb7f019fc955b630b3af4"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224016 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224753 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z5cfl\" (UniqueName: \"kubernetes.io/projected/94b1f363-8761-4a8e-a35c-d7cc338232f2-kube-api-access-z5cfl\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224791 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mrqrq\" (UniqueName: \"kubernetes.io/projected/e689da25-a663-48f8-acc0-3890d96884a2-kube-api-access-mrqrq\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224803 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-59vtc\" (UniqueName: \"kubernetes.io/projected/6f231df0-d475-4ac5-9de8-403d93cc5d8a-kube-api-access-59vtc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224814 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224828 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224841 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224851 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224886 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224897 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224908 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e689da25-a663-48f8-acc0-3890d96884a2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224921 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4410612c-42ac-4f8a-b643-ddc90384366c-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224931 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224942 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4blzb\" (UniqueName: \"kubernetes.io/projected/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-kube-api-access-4blzb\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224953 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f231df0-d475-4ac5-9de8-403d93cc5d8a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224967 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e689da25-a663-48f8-acc0-3890d96884a2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224979 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/94b1f363-8761-4a8e-a35c-d7cc338232f2-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.224991 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.225067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" event={"ID":"946c5e3d-0426-4c04-b00c-9fdaa8da7146","Type":"ContainerDied","Data":"1292ccbe8026bb738068f5b6078ea74d8534d9f718e80fc84ef4e0a150eb1646"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.225100 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1292ccbe8026bb738068f5b6078ea74d8534d9f718e80fc84ef4e0a150eb1646" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.226032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-logs" (OuterVolumeSpecName: "logs") pod "5515ac85-cbc8-453f-8b3d-5f4ac3940b30" (UID: "5515ac85-cbc8-453f-8b3d-5f4ac3940b30"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.231923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" event={"ID":"bbc6cddf-3e72-4186-bdf5-23ad222a4686","Type":"ContainerDied","Data":"d6d64e5bb6ec88ecd3e63ab3d7549a4dc093552407c9407cf440078cc757f7ba"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.231967 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6d64e5bb6ec88ecd3e63ab3d7549a4dc093552407c9407cf440078cc757f7ba" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.244621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" event={"ID":"3769889c-3377-4452-80a0-387660264035","Type":"ContainerStarted","Data":"f0c2db99458339e365ea10ca0e1225d00463a74d471df369270719399ae39ca9"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.245879 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.255511 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" podStartSLOduration=8.25548205 podStartE2EDuration="8.25548205s" podCreationTimestamp="2025-11-21 12:41:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:33.223501341 +0000 UTC m=+3051.924163159" watchObservedRunningTime="2025-11-21 12:41:33.25548205 +0000 UTC m=+3051.956143868" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.255615 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfdef99c-9c68-4b51-b2c5-7effb71b205d" containerID="7d360957c8822f3fe69461bed081222da9aecb8b83ca4db8ecd0ceb413e0b155" exitCode=0 Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.255765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"bfdef99c-9c68-4b51-b2c5-7effb71b205d","Type":"ContainerDied","Data":"7d360957c8822f3fe69461bed081222da9aecb8b83ca4db8ecd0ceb413e0b155"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.255802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"bfdef99c-9c68-4b51-b2c5-7effb71b205d","Type":"ContainerDied","Data":"e40e00a84c816bbc9da53f8cfe1795663d599caaaf1ed0d9361d9786172c049a"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.255819 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e40e00a84c816bbc9da53f8cfe1795663d599caaaf1ed0d9361d9786172c049a" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.264013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4410612c-42ac-4f8a-b643-ddc90384366c-kube-api-access-hrq2h" (OuterVolumeSpecName: "kube-api-access-hrq2h") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "kube-api-access-hrq2h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.270976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" event={"ID":"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe","Type":"ContainerStarted","Data":"8f5942845aa51dc6c5d15fcbf0a3fb629726301cc8f7f0181c7b21739d712478"} Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.275619 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.276076 4769 generic.go:334] "Generic (PLEG): container finished" podID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerID="379c1dcb9363d3e66bfc22ffc6d92ae31ff19d0469d3953d14ae2a1ef3242286" exitCode=0 Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.283719 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.284705 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.284826 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.284893 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.285103 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.285353 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.285884 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.296282 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" podStartSLOduration=9.296257529 podStartE2EDuration="9.296257529s" podCreationTimestamp="2025-11-21 12:41:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:33.268847424 +0000 UTC m=+3051.969509232" watchObservedRunningTime="2025-11-21 12:41:33.296257529 +0000 UTC m=+3051.996919347" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.332702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.333810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.341302 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hrq2h\" (UniqueName: \"kubernetes.io/projected/4410612c-42ac-4f8a-b643-ddc90384366c-kube-api-access-hrq2h\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.341328 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.341339 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.341350 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.341414 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.341458 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.841441668 +0000 UTC m=+3052.542103486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.342517 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.342548 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.842540488 +0000 UTC m=+3052.543202296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.342622 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.342643 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data podName:361938ec-ffd5-4e1c-80b2-c30d796ba89c nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.34263669 +0000 UTC m=+3060.043298508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data") pod "rabbitmq-cell1-server-0" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.342956 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.343048 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.843025061 +0000 UTC m=+3052.543687069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.349330 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28df21b3-2a77-4353-8fac-3fa307992568" path="/var/lib/kubelet/pods/28df21b3-2a77-4353-8fac-3fa307992568/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.350161 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9ec7d7-20af-4215-bfa6-06a203e6479e" path="/var/lib/kubelet/pods/2a9ec7d7-20af-4215-bfa6-06a203e6479e/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.351818 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd67268-d5ea-4c3b-8d8a-7b252c582fa5" path="/var/lib/kubelet/pods/2bd67268-d5ea-4c3b-8d8a-7b252c582fa5/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.353092 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b8d7f9-665b-4f65-96fe-2a447f95ee0c" path="/var/lib/kubelet/pods/92b8d7f9-665b-4f65-96fe-2a447f95ee0c/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.353848 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96cb08c2-a543-4f8a-8e70-3fe6b2c02998" path="/var/lib/kubelet/pods/96cb08c2-a543-4f8a-8e70-3fe6b2c02998/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.355324 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0928503-af84-4ec4-8cfe-85f4b1c15a1b" path="/var/lib/kubelet/pods/c0928503-af84-4ec4-8cfe-85f4b1c15a1b/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.356753 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf5c7d97-c7aa-4b91-b784-ff9a10b76d85" path="/var/lib/kubelet/pods/cf5c7d97-c7aa-4b91-b784-ff9a10b76d85/volumes" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.364884 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" podStartSLOduration=8.364856594 podStartE2EDuration="8.364856594s" podCreationTimestamp="2025-11-21 12:41:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:33.306562769 +0000 UTC m=+3052.007224587" watchObservedRunningTime="2025-11-21 12:41:33.364856594 +0000 UTC m=+3052.065518412" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.373613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-config-data" (OuterVolumeSpecName: "config-data") pod "6f231df0-d475-4ac5-9de8-403d93cc5d8a" (UID: "6f231df0-d475-4ac5-9de8-403d93cc5d8a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.377285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "mysql-db") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.402668 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" podStartSLOduration=8.402630491 podStartE2EDuration="8.402630491s" podCreationTimestamp="2025-11-21 12:41:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:33.390869742 +0000 UTC m=+3052.091531560" watchObservedRunningTime="2025-11-21 12:41:33.402630491 +0000 UTC m=+3052.103292339" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.411792 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.431030 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.437765 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.437826 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerName="nova-cell0-conductor-conductor" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.446623 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.446667 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.450270 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.450321 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:33.950305058 +0000 UTC m=+3052.650966876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.504155 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.517084 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f231df0-d475-4ac5-9de8-403d93cc5d8a" (UID: "6f231df0-d475-4ac5-9de8-403d93cc5d8a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.522746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "6f231df0-d475-4ac5-9de8-403d93cc5d8a" (UID: "6f231df0-d475-4ac5-9de8-403d93cc5d8a"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.549939 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.550472 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f231df0-d475-4ac5-9de8-403d93cc5d8a-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.550486 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.566321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-config-data" (OuterVolumeSpecName: "config-data") pod "5515ac85-cbc8-453f-8b3d-5f4ac3940b30" (UID: "5515ac85-cbc8-453f-8b3d-5f4ac3940b30"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.569414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.586314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5515ac85-cbc8-453f-8b3d-5f4ac3940b30" (UID: "5515ac85-cbc8-453f-8b3d-5f4ac3940b30"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.639485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-config-data" (OuterVolumeSpecName: "config-data") pod "94b1f363-8761-4a8e-a35c-d7cc338232f2" (UID: "94b1f363-8761-4a8e-a35c-d7cc338232f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.639577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.640362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.647106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5515ac85-cbc8-453f-8b3d-5f4ac3940b30" (UID: "5515ac85-cbc8-453f-8b3d-5f4ac3940b30"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.647325 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.648884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5515ac85-cbc8-453f-8b3d-5f4ac3940b30" (UID: "5515ac85-cbc8-453f-8b3d-5f4ac3940b30"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654149 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654233 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654244 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654257 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654267 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654301 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b1f363-8761-4a8e-a35c-d7cc338232f2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654313 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654323 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.654332 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5515ac85-cbc8-453f-8b3d-5f4ac3940b30-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.654422 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.654499 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data podName:b27c6ab8-1814-4fc4-be72-63efaf921244 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.654481779 +0000 UTC m=+3060.355143597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data") pod "rabbitmq-cell1-server-1" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.660685 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.703384 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data" (OuterVolumeSpecName: "config-data") pod "e689da25-a663-48f8-acc0-3890d96884a2" (UID: "e689da25-a663-48f8-acc0-3890d96884a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.707996 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "4410612c-42ac-4f8a-b643-ddc90384366c" (UID: "4410612c-42ac-4f8a-b643-ddc90384366c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.761817 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.761878 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.761913 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:41:35.76189188 +0000 UTC m=+3054.462553698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.761951 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4410612c-42ac-4f8a-b643-ddc90384366c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: I1121 12:41:33.761973 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e689da25-a663-48f8-acc0-3890d96884a2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.864746 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.864835 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.864867 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:34.864834939 +0000 UTC m=+3053.565496747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.864916 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:41:34.864897791 +0000 UTC m=+3053.565559609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.864920 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.865003 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:34.864960332 +0000 UTC m=+3053.565622140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.967516 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:33 crc kubenswrapper[4769]: E1121 12:41:33.967616 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:34.967597093 +0000 UTC m=+3053.668258911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.308046 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.034s" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.310327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" event={"ID":"650a3adf-623d-4869-be32-b9188cb6f1f1","Type":"ContainerDied","Data":"379c1dcb9363d3e66bfc22ffc6d92ae31ff19d0469d3953d14ae2a1ef3242286"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.310366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" event={"ID":"3a4d44b3-704e-44c0-8e41-64af780dcd32","Type":"ContainerStarted","Data":"a77680d8874c4fae988ac4825e84fd1f98ab983222bee0268e3e41edfdbd74ea"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.320488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.322615 4769 generic.go:334] "Generic (PLEG): container finished" podID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerID="d91f2b5aa00b4a0bb40a511eef51984d65607b6b0e7578970c9a341fd55e765a" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.322718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"857a150b-5f89-4c23-b71c-fa0ec47a855d","Type":"ContainerDied","Data":"d91f2b5aa00b4a0bb40a511eef51984d65607b6b0e7578970c9a341fd55e765a"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.322748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-2" event={"ID":"857a150b-5f89-4c23-b71c-fa0ec47a855d","Type":"ContainerDied","Data":"94944d79abd35be231ef89076b8a8f25b91fac0f9d0e201c86b287e13a8f6c96"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.322773 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94944d79abd35be231ef89076b8a8f25b91fac0f9d0e201c86b287e13a8f6c96" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.327176 4769 generic.go:334] "Generic (PLEG): container finished" podID="8960e53d-b896-4f34-8117-399f16f48b0a" containerID="955fb3d7189dbb92109266c196b642fbb509c7dbafddc4d5f25d6673c61ae5ce" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.329302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8960e53d-b896-4f34-8117-399f16f48b0a","Type":"ContainerDied","Data":"955fb3d7189dbb92109266c196b642fbb509c7dbafddc4d5f25d6673c61ae5ce"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.329488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"8960e53d-b896-4f34-8117-399f16f48b0a","Type":"ContainerDied","Data":"eb7816e831bf85c4c6c9b4fb8c3487732c4dbe1289f4f701136ddf0819a737d1"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.329556 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb7816e831bf85c4c6c9b4fb8c3487732c4dbe1289f4f701136ddf0819a737d1" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.340081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"361938ec-ffd5-4e1c-80b2-c30d796ba89c","Type":"ContainerDied","Data":"dab4ae7ecb4ebb3704d24abb60a8e223ac27f6bb8813d9b2533a4fd3320398aa"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.340366 4769 generic.go:334] "Generic (PLEG): container finished" podID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerID="dab4ae7ecb4ebb3704d24abb60a8e223ac27f6bb8813d9b2533a4fd3320398aa" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.340548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"361938ec-ffd5-4e1c-80b2-c30d796ba89c","Type":"ContainerDied","Data":"7288947da1ddc7c98ce1d138349459233e4cbd229df78bbd059a48ffc6bd2f69"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.341508 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7288947da1ddc7c98ce1d138349459233e4cbd229df78bbd059a48ffc6bd2f69" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.350288 4769 generic.go:334] "Generic (PLEG): container finished" podID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerID="0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.350710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"ae60b576-2037-4318-a529-dca9e6f8eb6a","Type":"ContainerDied","Data":"0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.350826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-1" event={"ID":"ae60b576-2037-4318-a529-dca9e6f8eb6a","Type":"ContainerDied","Data":"f771ad48d5ef22e00ea533d3125af80ee889ca5655426c67d937929e98bc7d1a"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.350928 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f771ad48d5ef22e00ea533d3125af80ee889ca5655426c67d937929e98bc7d1a" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.353663 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerID="06f9b1eadf78537bacbf8b298bd6f6f093395ccee46990931528d0149a21a2b4" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.353849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"bd8a72b4-4330-450b-9a5d-431819e3ab7f","Type":"ContainerDied","Data":"06f9b1eadf78537bacbf8b298bd6f6f093395ccee46990931528d0149a21a2b4"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.353952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-1" event={"ID":"bd8a72b4-4330-450b-9a5d-431819e3ab7f","Type":"ContainerDied","Data":"a73abda22f023ca411b459f024af6decc69f7e8a99bc357ea468317c6e620c67"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.354043 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a73abda22f023ca411b459f024af6decc69f7e8a99bc357ea468317c6e620c67" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.368706 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerID="c572bc5f406e7ad8283eb6f8e1b6d7bdcf53fa68dc4b386c41e00bfb8d80b1fe" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.368797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4","Type":"ContainerDied","Data":"c572bc5f406e7ad8283eb6f8e1b6d7bdcf53fa68dc4b386c41e00bfb8d80b1fe"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.368836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" event={"ID":"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4","Type":"ContainerDied","Data":"84ea0b64dd61f15a560d926b735df6b9a50852b10b9e302720b8544fefd17b34"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.368854 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84ea0b64dd61f15a560d926b735df6b9a50852b10b9e302720b8544fefd17b34" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.373663 4769 generic.go:334] "Generic (PLEG): container finished" podID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerID="f991f55168305f20b720d822948dd591aea9434eebd32153073bcbdeec6a1ad3" exitCode=0 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.374383 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"b27c6ab8-1814-4fc4-be72-63efaf921244","Type":"ContainerDied","Data":"f991f55168305f20b720d822948dd591aea9434eebd32153073bcbdeec6a1ad3"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.374435 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.374438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" event={"ID":"b27c6ab8-1814-4fc4-be72-63efaf921244","Type":"ContainerDied","Data":"e74c8ba04112bb74f8c7de922cb14c1f4cc521bb645f176baae2cd1c3f4710df"} Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.374494 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e74c8ba04112bb74f8c7de922cb14c1f4cc521bb645f176baae2cd1c3f4710df" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.374976 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.375411 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.375937 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" secret="" err="secret \"galera-openstack-dockercfg-rw8d9\" not found" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.384754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.384819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data\") pod \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.385063 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-combined-ca-bundle\") pod \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.385160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data-custom\") pod \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.385226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvlkc\" (UniqueName: \"kubernetes.io/projected/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-kube-api-access-kvlkc\") pod \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.385267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-logs\") pod \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\" (UID: \"964afe99-46d9-4b4e-be03-e3cf7c5b6e04\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.387810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-logs" (OuterVolumeSpecName: "logs") pod "964afe99-46d9-4b4e-be03-e3cf7c5b6e04" (UID: "964afe99-46d9-4b4e-be03-e3cf7c5b6e04"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.409665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "964afe99-46d9-4b4e-be03-e3cf7c5b6e04" (UID: "964afe99-46d9-4b4e-be03-e3cf7c5b6e04"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.422472 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-kube-api-access-kvlkc" (OuterVolumeSpecName: "kube-api-access-kvlkc") pod "964afe99-46d9-4b4e-be03-e3cf7c5b6e04" (UID: "964afe99-46d9-4b4e-be03-e3cf7c5b6e04"). InnerVolumeSpecName "kube-api-access-kvlkc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487140 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-scripts\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzwgg\" (UniqueName: \"kubernetes.io/projected/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-kube-api-access-jzwgg\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-sg-core-conf-yaml\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487870 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-config-data\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-combined-ca-bundle\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-run-httpd\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.487963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-log-httpd\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.489014 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.489033 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kvlkc\" (UniqueName: \"kubernetes.io/projected/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-kube-api-access-kvlkc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.489048 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.497570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.497801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.499680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-kube-api-access-jzwgg" (OuterVolumeSpecName: "kube-api-access-jzwgg") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "kube-api-access-jzwgg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.511104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-scripts" (OuterVolumeSpecName: "scripts") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.511217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "964afe99-46d9-4b4e-be03-e3cf7c5b6e04" (UID: "964afe99-46d9-4b4e-be03-e3cf7c5b6e04"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.546895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.564299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data" (OuterVolumeSpecName: "config-data") pod "964afe99-46d9-4b4e-be03-e3cf7c5b6e04" (UID: "964afe99-46d9-4b4e-be03-e3cf7c5b6e04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.590921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs\") pod \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\" (UID: \"b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592875 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592890 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592909 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592920 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592929 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jzwgg\" (UniqueName: \"kubernetes.io/projected/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-kube-api-access-jzwgg\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592940 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/964afe99-46d9-4b4e-be03-e3cf7c5b6e04-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.592948 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: W1121 12:41:34.592532 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac/volumes/kubernetes.io~secret/ceilometer-tls-certs Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.599284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.624317 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-v5487"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.634717 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-v5487"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.650986 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement77f5-account-delete-pvwjs"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.658636 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77f5-account-create-gn48j"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.665974 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-77f5-account-create-gn48j"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.672070 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.674861 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.699486 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.704766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.724303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-config-data" (OuterVolumeSpecName: "config-data") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.725653 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.725801 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.729688 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.729719 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.748056 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.750735 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.761379 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.761443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" (UID: "b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.767677 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-1" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="galera" containerID="cri-o://a37bff3cd79ee53aa556c3e1617da82f738dace19196c4be216f961fb7d430bc" gracePeriod=27 Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.796451 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-config-data\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835257 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-combined-ca-bundle\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-generated\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd2pp\" (UniqueName: \"kubernetes.io/projected/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kube-api-access-xd2pp\") pod \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-public-tls-certs\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twg2k\" (UniqueName: \"kubernetes.io/projected/8960e53d-b896-4f34-8117-399f16f48b0a-kube-api-access-twg2k\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/946c5e3d-0426-4c04-b00c-9fdaa8da7146-logs\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-combined-ca-bundle\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-memcached-tls-certs\") pod \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-combined-ca-bundle\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-config-data\") pod \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g55h\" (UniqueName: \"kubernetes.io/projected/bbc6cddf-3e72-4186-bdf5-23ad222a4686-kube-api-access-7g55h\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfq6x\" (UniqueName: \"kubernetes.io/projected/90d862ac-19bc-4f97-8920-41d1008aece5-kube-api-access-xfq6x\") pod \"90d862ac-19bc-4f97-8920-41d1008aece5\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835787 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-kolla-config\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835813 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-galera-tls-certs\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbc6cddf-3e72-4186-bdf5-23ad222a4686-logs\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1947d55-7857-40da-9103-804862218844-operator-scripts\") pod \"c1947d55-7857-40da-9103-804862218844\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdc9g\" (UniqueName: \"kubernetes.io/projected/946c5e3d-0426-4c04-b00c-9fdaa8da7146-kube-api-access-hdc9g\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.835965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-internal-tls-certs\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data-custom\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-operator-scripts\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-public-tls-certs\") pod \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\" (UID: \"946c5e3d-0426-4c04-b00c-9fdaa8da7146\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836133 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-scripts\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-internal-tls-certs\") pod \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\" (UID: \"bbc6cddf-3e72-4186-bdf5-23ad222a4686\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-default\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kolla-config\") pod \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-combined-ca-bundle\") pod \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\" (UID: \"bfdef99c-9c68-4b51-b2c5-7effb71b205d\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836358 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klmmt\" (UniqueName: \"kubernetes.io/projected/c1947d55-7857-40da-9103-804862218844-kube-api-access-klmmt\") pod \"c1947d55-7857-40da-9103-804862218844\" (UID: \"c1947d55-7857-40da-9103-804862218844\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d862ac-19bc-4f97-8920-41d1008aece5-operator-scripts\") pod \"90d862ac-19bc-4f97-8920-41d1008aece5\" (UID: \"90d862ac-19bc-4f97-8920-41d1008aece5\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.836411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.837641 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.842769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.856740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "bfdef99c-9c68-4b51-b2c5-7effb71b205d" (UID: "bfdef99c-9c68-4b51-b2c5-7effb71b205d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.865557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc6cddf-3e72-4186-bdf5-23ad222a4686-logs" (OuterVolumeSpecName: "logs") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.870036 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1947d55-7857-40da-9103-804862218844-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c1947d55-7857-40da-9103-804862218844" (UID: "c1947d55-7857-40da-9103-804862218844"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.873883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.874561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.882602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90d862ac-19bc-4f97-8920-41d1008aece5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "90d862ac-19bc-4f97-8920-41d1008aece5" (UID: "90d862ac-19bc-4f97-8920-41d1008aece5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.894482 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.896108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/946c5e3d-0426-4c04-b00c-9fdaa8da7146-logs" (OuterVolumeSpecName: "logs") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.899301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-config-data" (OuterVolumeSpecName: "config-data") pod "bfdef99c-9c68-4b51-b2c5-7effb71b205d" (UID: "bfdef99c-9c68-4b51-b2c5-7effb71b205d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.900969 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946c5e3d-0426-4c04-b00c-9fdaa8da7146-kube-api-access-hdc9g" (OuterVolumeSpecName: "kube-api-access-hdc9g") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "kube-api-access-hdc9g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.902635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.914544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc6cddf-3e72-4186-bdf5-23ad222a4686-kube-api-access-7g55h" (OuterVolumeSpecName: "kube-api-access-7g55h") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "kube-api-access-7g55h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.921791 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.933997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1947d55-7857-40da-9103-804862218844-kube-api-access-klmmt" (OuterVolumeSpecName: "kube-api-access-klmmt") pod "c1947d55-7857-40da-9103-804862218844" (UID: "c1947d55-7857-40da-9103-804862218844"). InnerVolumeSpecName "kube-api-access-klmmt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.934131 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d862ac-19bc-4f97-8920-41d1008aece5-kube-api-access-xfq6x" (OuterVolumeSpecName: "kube-api-access-xfq6x") pod "90d862ac-19bc-4f97-8920-41d1008aece5" (UID: "90d862ac-19bc-4f97-8920-41d1008aece5"). InnerVolumeSpecName "kube-api-access-xfq6x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.934472 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.934676 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.945874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.946780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "mysql-db") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.950018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8960e53d-b896-4f34-8117-399f16f48b0a-kube-api-access-twg2k" (OuterVolumeSpecName: "kube-api-access-twg2k") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "kube-api-access-twg2k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.950475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"8960e53d-b896-4f34-8117-399f16f48b0a\" (UID: \"8960e53d-b896-4f34-8117-399f16f48b0a\") " Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951546 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951564 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-klmmt\" (UniqueName: \"kubernetes.io/projected/c1947d55-7857-40da-9103-804862218844-kube-api-access-klmmt\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951575 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/90d862ac-19bc-4f97-8920-41d1008aece5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951592 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951602 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-twg2k\" (UniqueName: \"kubernetes.io/projected/8960e53d-b896-4f34-8117-399f16f48b0a-kube-api-access-twg2k\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951611 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/946c5e3d-0426-4c04-b00c-9fdaa8da7146-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951623 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bfdef99c-9c68-4b51-b2c5-7effb71b205d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: W1121 12:41:34.951621 4769 mount_helper_common.go:34] Warning: mount cleanup skipped because path does not exist: /var/lib/kubelet/pods/8960e53d-b896-4f34-8117-399f16f48b0a/volumes/kubernetes.io~local-volume/local-storage08-crc Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "mysql-db") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.951696 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.951744 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:41:36.951730002 +0000 UTC m=+3055.652391820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.952107 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.952140 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:36.952131303 +0000 UTC m=+3055.652793121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.952176 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: E1121 12:41:34.952221 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:36.952215016 +0000 UTC m=+3055.652876834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.951634 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7g55h\" (UniqueName: \"kubernetes.io/projected/bbc6cddf-3e72-4186-bdf5-23ad222a4686-kube-api-access-7g55h\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953141 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xfq6x\" (UniqueName: \"kubernetes.io/projected/90d862ac-19bc-4f97-8920-41d1008aece5-kube-api-access-xfq6x\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953162 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953179 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bbc6cddf-3e72-4186-bdf5-23ad222a4686-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953234 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1947d55-7857-40da-9103-804862218844-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953250 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hdc9g\" (UniqueName: \"kubernetes.io/projected/946c5e3d-0426-4c04-b00c-9fdaa8da7146-kube-api-access-hdc9g\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953261 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953277 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/8960e53d-b896-4f34-8117-399f16f48b0a-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.953410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-scripts" (OuterVolumeSpecName: "scripts") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.954412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.964318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.968151 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.971395 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:41:34 crc kubenswrapper[4769]: I1121 12:41:34.978265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kube-api-access-xd2pp" (OuterVolumeSpecName: "kube-api-access-xd2pp") pod "bfdef99c-9c68-4b51-b2c5-7effb71b205d" (UID: "bfdef99c-9c68-4b51-b2c5-7effb71b205d"). InnerVolumeSpecName "kube-api-access-xd2pp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.003019 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054423 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt6zr\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-kube-api-access-vt6zr\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-plugins\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-plugins-conf\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-confd\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-server-conf\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054600 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f9hq\" (UniqueName: \"kubernetes.io/projected/ae60b576-2037-4318-a529-dca9e6f8eb6a-kube-api-access-2f9hq\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-tls\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054661 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-plugins\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-plugins-conf\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4qhn\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-kube-api-access-d4qhn\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-server-conf\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054788 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-confd\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-default\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbwrl\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-kube-api-access-nbwrl\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-erlang-cookie\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-plugins\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-tls\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.054980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-pod-info\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-confd\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-operator-scripts\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-plugins-conf\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-server-conf\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-server-conf\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-server-conf\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-tls\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-confd\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-plugins-conf\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/361938ec-ffd5-4e1c-80b2-c30d796ba89c-pod-info\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-plugins\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-plugins-conf\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-combined-ca-bundle\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/bd8a72b4-4330-450b-9a5d-431819e3ab7f-pod-info\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-plugins\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-galera-tls-certs\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj4tz\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-kube-api-access-qj4tz\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-tls\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-erlang-cookie\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-erlang-cookie\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055490 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-confd\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055532 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/857a150b-5f89-4c23-b71c-fa0ec47a855d-erlang-cookie-secret\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwfp6\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-kube-api-access-xwfp6\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055574 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-erlang-cookie\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b27c6ab8-1814-4fc4-be72-63efaf921244-pod-info\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/857a150b-5f89-4c23-b71c-fa0ec47a855d-pod-info\") pod \"857a150b-5f89-4c23-b71c-fa0ec47a855d\" (UID: \"857a150b-5f89-4c23-b71c-fa0ec47a855d\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/361938ec-ffd5-4e1c-80b2-c30d796ba89c-erlang-cookie-secret\") pod \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\" (UID: \"361938ec-ffd5-4e1c-80b2-c30d796ba89c\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-generated\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-erlang-cookie\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-kolla-config\") pod \"ae60b576-2037-4318-a529-dca9e6f8eb6a\" (UID: \"ae60b576-2037-4318-a529-dca9e6f8eb6a\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-tls\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-erlang-cookie-secret\") pod \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\" (UID: \"1e2aa50b-63a4-4d92-88bd-345ec2d80dd4\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b27c6ab8-1814-4fc4-be72-63efaf921244-erlang-cookie-secret\") pod \"b27c6ab8-1814-4fc4-be72-63efaf921244\" (UID: \"b27c6ab8-1814-4fc4-be72-63efaf921244\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.055800 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/bd8a72b4-4330-450b-9a5d-431819e3ab7f-erlang-cookie-secret\") pod \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\" (UID: \"bd8a72b4-4330-450b-9a5d-431819e3ab7f\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.056177 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.056206 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.056228 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.056238 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xd2pp\" (UniqueName: \"kubernetes.io/projected/bfdef99c-9c68-4b51-b2c5-7effb71b205d-kube-api-access-xd2pp\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.062247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.063609 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.063908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.066300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.066920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.070714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.071474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.072045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.074821 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.075586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.075783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.076363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.076978 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.077115 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:37.077077381 +0000 UTC m=+3055.777739199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.077584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.078709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.079102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.083309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.086841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.089469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/361938ec-ffd5-4e1c-80b2-c30d796ba89c-pod-info" (OuterVolumeSpecName: "pod-info") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.091387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/361938ec-ffd5-4e1c-80b2-c30d796ba89c-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.092094 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.096361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.097951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.101675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.106984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.109429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-kube-api-access-nbwrl" (OuterVolumeSpecName: "kube-api-access-nbwrl") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "kube-api-access-nbwrl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.115018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b27c6ab8-1814-4fc4-be72-63efaf921244-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.117105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.119067 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-kube-api-access-xwfp6" (OuterVolumeSpecName: "kube-api-access-xwfp6") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "kube-api-access-xwfp6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.119778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "persistence") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.120232 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd8a72b4-4330-450b-9a5d-431819e3ab7f-pod-info" (OuterVolumeSpecName: "pod-info") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.120239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857a150b-5f89-4c23-b71c-fa0ec47a855d-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.121575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.123903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.124785 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.126510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae60b576-2037-4318-a529-dca9e6f8eb6a-kube-api-access-2f9hq" (OuterVolumeSpecName: "kube-api-access-2f9hq") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "kube-api-access-2f9hq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.127657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-kube-api-access-vt6zr" (OuterVolumeSpecName: "kube-api-access-vt6zr") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "kube-api-access-vt6zr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.129254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd8a72b4-4330-450b-9a5d-431819e3ab7f-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.146257 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.162853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfbj\" (UniqueName: \"kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.162922 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts\") pod \"keystone2331-account-delete-tkzfh\" (UID: \"878271c0-b6d8-414e-abe3-64ab67691f72\") " pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163083 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163097 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163106 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163115 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nbwrl\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-kube-api-access-nbwrl\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163125 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163134 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163142 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163150 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163158 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163180 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163192 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163213 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/361938ec-ffd5-4e1c-80b2-c30d796ba89c-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163223 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163231 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163240 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/bd8a72b4-4330-450b-9a5d-431819e3ab7f-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163249 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163259 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163268 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163277 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163285 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/857a150b-5f89-4c23-b71c-fa0ec47a855d-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163294 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xwfp6\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-kube-api-access-xwfp6\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163304 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163313 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/361938ec-ffd5-4e1c-80b2-c30d796ba89c-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163322 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ae60b576-2037-4318-a529-dca9e6f8eb6a-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163333 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163342 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ae60b576-2037-4318-a529-dca9e6f8eb6a-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163350 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163358 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163366 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b27c6ab8-1814-4fc4-be72-63efaf921244-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163375 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/bd8a72b4-4330-450b-9a5d-431819e3ab7f-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163384 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vt6zr\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-kube-api-access-vt6zr\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163393 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163401 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163409 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2f9hq\" (UniqueName: \"kubernetes.io/projected/ae60b576-2037-4318-a529-dca9e6f8eb6a-kube-api-access-2f9hq\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.163419 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.168262 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.168362 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:39.168334432 +0000 UTC m=+3057.868996250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : configmap "openstack-scripts" not found Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.189115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "persistence") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.189202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "persistence") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.189243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-pod-info" (OuterVolumeSpecName: "pod-info") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.189696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "persistence") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.189742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.189787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-kube-api-access-d4qhn" (OuterVolumeSpecName: "kube-api-access-d4qhn") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "kube-api-access-d4qhn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.189913 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zrfbj for pod openstack-kuttl-tests/keystone2331-account-delete-tkzfh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.190865 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj podName:878271c0-b6d8-414e-abe3-64ab67691f72 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:39.190841754 +0000 UTC m=+3057.891503642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrfbj" (UniqueName: "kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj") pod "keystone2331-account-delete-tkzfh" (UID: "878271c0-b6d8-414e-abe3-64ab67691f72") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.190014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-kube-api-access-qj4tz" (OuterVolumeSpecName: "kube-api-access-qj4tz") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "kube-api-access-qj4tz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.190173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b27c6ab8-1814-4fc4-be72-63efaf921244-pod-info" (OuterVolumeSpecName: "pod-info") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.191427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/857a150b-5f89-4c23-b71c-fa0ec47a855d-pod-info" (OuterVolumeSpecName: "pod-info") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.195382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "persistence") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.199180 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.264355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-combined-ca-bundle\") pod \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.264416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-logs\") pod \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.264511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data-custom\") pod \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.264678 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvs5d\" (UniqueName: \"kubernetes.io/projected/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-kube-api-access-dvs5d\") pod \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.264821 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data\") pod \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\" (UID: \"e1e5c05c-a6e7-4bb2-a397-d4feb7197966\") " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265459 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qj4tz\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-kube-api-access-qj4tz\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265484 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265494 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b27c6ab8-1814-4fc4-be72-63efaf921244-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265505 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/857a150b-5f89-4c23-b71c-fa0ec47a855d-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265515 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265528 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265542 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265553 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d4qhn\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-kube-api-access-d4qhn\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265568 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265576 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265585 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.265794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-logs" (OuterVolumeSpecName: "logs") pod "e1e5c05c-a6e7-4bb2-a397-d4feb7197966" (UID: "e1e5c05c-a6e7-4bb2-a397-d4feb7197966"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.296433 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" path="/var/lib/kubelet/pods/5515ac85-cbc8-453f-8b3d-5f4ac3940b30/volumes" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.297114 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebb8764-2359-45db-89ba-6de7965a4fb3" path="/var/lib/kubelet/pods/5ebb8764-2359-45db-89ba-6de7965a4fb3/volumes" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.297655 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" path="/var/lib/kubelet/pods/6f231df0-d475-4ac5-9de8-403d93cc5d8a/volumes" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.329494 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76fe0888-df08-4e5a-866f-211e3ebc5c3c" path="/var/lib/kubelet/pods/76fe0888-df08-4e5a-866f-211e3ebc5c3c/volumes" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.330256 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" path="/var/lib/kubelet/pods/94b1f363-8761-4a8e-a35c-d7cc338232f2/volumes" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.340740 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e689da25-a663-48f8-acc0-3890d96884a2" path="/var/lib/kubelet/pods/e689da25-a663-48f8-acc0-3890d96884a2/volumes" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.368089 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.374841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.374974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-kube-api-access-dvs5d" (OuterVolumeSpecName: "kube-api-access-dvs5d") pod "e1e5c05c-a6e7-4bb2-a397-d4feb7197966" (UID: "e1e5c05c-a6e7-4bb2-a397-d4feb7197966"). InnerVolumeSpecName "kube-api-access-dvs5d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.374971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e1e5c05c-a6e7-4bb2-a397-d4feb7197966" (UID: "e1e5c05c-a6e7-4bb2-a397-d4feb7197966"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.378597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.391700 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.393939 4769 generic.go:334] "Generic (PLEG): container finished" podID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" exitCode=0 Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.412991 4769 generic.go:334] "Generic (PLEG): container finished" podID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerID="41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44" exitCode=0 Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.413129 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.417741 4769 generic.go:334] "Generic (PLEG): container finished" podID="3f9ccc3c-419c-48a9-b052-640fc504a4c3" containerID="58fe909266273dec1aa413ce6b37f92941f2f4ca2dc892c70b34c612a1ecef72" exitCode=0 Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.417824 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement77f5-account-delete-pvwjs" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.418560 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-2" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419439 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance184a-account-delete-zgztl" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419613 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419649 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-1" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419711 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419746 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-2" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419774 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-1" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419917 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-1" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-997b6456b-j6hhp" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.419993 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.420042 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.420050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2331-account-delete-tkzfh" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.420085 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.432764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.491725 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dvs5d\" (UniqueName: \"kubernetes.io/projected/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-kube-api-access-dvs5d\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.491765 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.491781 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.491794 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.491807 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.491818 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.551554 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data" (OuterVolumeSpecName: "config-data") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.552051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data" (OuterVolumeSpecName: "config-data") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.598342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.598454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfdef99c-9c68-4b51-b2c5-7effb71b205d" (UID: "bfdef99c-9c68-4b51-b2c5-7effb71b205d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.598745 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.598794 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.598805 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.598815 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.650119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data" (OuterVolumeSpecName: "config-data") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.696428 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.707057 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.707083 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.711413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "bfdef99c-9c68-4b51-b2c5-7effb71b205d" (UID: "bfdef99c-9c68-4b51-b2c5-7effb71b205d"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.779977 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-server-conf" (OuterVolumeSpecName: "server-conf") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.786293 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data" (OuterVolumeSpecName: "config-data") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.808698 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.816617 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.819649 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.819679 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfdef99c-9c68-4b51-b2c5-7effb71b205d-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.819690 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.819701 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.819710 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.819801 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:35 crc kubenswrapper[4769]: E1121 12:41:35.819848 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:41:39.819833836 +0000 UTC m=+3058.520495654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.825738 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.861692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data" (OuterVolumeSpecName: "config-data") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.878108 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" podStartSLOduration=10.87808727 podStartE2EDuration="10.87808727s" podCreationTimestamp="2025-11-21 12:41:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:41:35.41431552 +0000 UTC m=+3054.114977338" watchObservedRunningTime="2025-11-21 12:41:35.87808727 +0000 UTC m=+3054.578749088" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.898344 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.911305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-server-conf" (OuterVolumeSpecName: "server-conf") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.913303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e1e5c05c-a6e7-4bb2-a397-d4feb7197966" (UID: "e1e5c05c-a6e7-4bb2-a397-d4feb7197966"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.922794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data" (OuterVolumeSpecName: "config-data") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.928388 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.928482 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.928494 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.928505 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.928515 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.928524 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/857a150b-5f89-4c23-b71c-fa0ec47a855d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.930443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data" (OuterVolumeSpecName: "config-data") pod "e1e5c05c-a6e7-4bb2-a397-d4feb7197966" (UID: "e1e5c05c-a6e7-4bb2-a397-d4feb7197966"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:35 crc kubenswrapper[4769]: I1121 12:41:35.936960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "8960e53d-b896-4f34-8117-399f16f48b0a" (UID: "8960e53d-b896-4f34-8117-399f16f48b0a"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.013912 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.044633 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/8960e53d-b896-4f34-8117-399f16f48b0a-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.044666 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.044676 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1e5c05c-a6e7-4bb2-a397-d4feb7197966-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.077854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-server-conf" (OuterVolumeSpecName: "server-conf") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.121251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "946c5e3d-0426-4c04-b00c-9fdaa8da7146" (UID: "946c5e3d-0426-4c04-b00c-9fdaa8da7146"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.151459 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/bd8a72b4-4330-450b-9a5d-431819e3ab7f-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.151501 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/946c5e3d-0426-4c04-b00c-9fdaa8da7146-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.169571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.244407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "ae60b576-2037-4318-a529-dca9e6f8eb6a" (UID: "ae60b576-2037-4318-a529-dca9e6f8eb6a"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.257814 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.257852 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae60b576-2037-4318-a529-dca9e6f8eb6a-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.274797 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-server-conf" (OuterVolumeSpecName: "server-conf") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.292495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.321012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-server-conf" (OuterVolumeSpecName: "server-conf") pod "361938ec-ffd5-4e1c-80b2-c30d796ba89c" (UID: "361938ec-ffd5-4e1c-80b2-c30d796ba89c"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.350057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-config-data" (OuterVolumeSpecName: "config-data") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.359575 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/361938ec-ffd5-4e1c-80b2-c30d796ba89c-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.359611 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/361938ec-ffd5-4e1c-80b2-c30d796ba89c-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.359622 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.359631 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b27c6ab8-1814-4fc4-be72-63efaf921244-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.385639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.440167 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_f0bfd46e-ddb1-452a-8df5-283922948dce/ovn-northd/0.log" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.440448 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" exitCode=139 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.443247 4769 generic.go:334] "Generic (PLEG): container finished" podID="48101a85-8239-4484-88f5-77efc1a90f99" containerID="1a929f8fb5d24d5a7a5149b7c441b592b95ddcdc7c212c54f6ae7a0c3aab6b13" exitCode=0 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.444730 4769 generic.go:334] "Generic (PLEG): container finished" podID="f215726f-5d62-4daf-98e4-270f4778542f" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" exitCode=0 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.490626 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.498284 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.195:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.498553 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.195:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.516877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" (UID: "1e2aa50b-63a4-4d92-88bd-345ec2d80dd4"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.519305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "bd8a72b4-4330-450b-9a5d-431819e3ab7f" (UID: "bd8a72b4-4330-450b-9a5d-431819e3ab7f"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.528275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "857a150b-5f89-4c23-b71c-fa0ec47a855d" (UID: "857a150b-5f89-4c23-b71c-fa0ec47a855d"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.541112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bbc6cddf-3e72-4186-bdf5-23ad222a4686" (UID: "bbc6cddf-3e72-4186-bdf5-23ad222a4686"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.558385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "b27c6ab8-1814-4fc4-be72-63efaf921244" (UID: "b27c6ab8-1814-4fc4-be72-63efaf921244"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.592412 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b27c6ab8-1814-4fc4-be72-63efaf921244-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.592676 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/bd8a72b4-4330-450b-9a5d-431819e3ab7f-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.592687 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.592696 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/857a150b-5f89-4c23-b71c-fa0ec47a855d-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.592705 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc6cddf-3e72-4186-bdf5-23ad222a4686-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.629309 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="galera" containerID="cri-o://9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977" gracePeriod=25 Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.641663 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e is running failed: container process not found" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.641973 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e is running failed: container process not found" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.642274 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e is running failed: container process not found" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.642316 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.738797 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.461s" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738883 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lnzdp"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738904 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738918 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-lnzdp"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738936 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-7629-account-create-n7f6f"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738946 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-7629-account-create-n7f6f"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738955 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder7629-account-delete-z2cd6"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738970 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-qms5v"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.738980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16","Type":"ContainerDied","Data":"a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739002 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-qms5v"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739016 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-184a-account-create-hsdc5"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739024 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance184a-account-delete-zgztl"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739034 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" event={"ID":"650a3adf-623d-4869-be32-b9188cb6f1f1","Type":"ContainerStarted","Data":"40ea0a17c9cc6fc3f28c459cb70b4613217eeba970e2c513eb6ec00af71603cb"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739043 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" event={"ID":"e1e5c05c-a6e7-4bb2-a397-d4feb7197966","Type":"ContainerDied","Data":"41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49" event={"ID":"e1e5c05c-a6e7-4bb2-a397-d4feb7197966","Type":"ContainerDied","Data":"a378ed2082fbbdd6564b0bc8690e94e830931c732680927f510c93d4ef6d3e70"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739078 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-184a-account-create-hsdc5"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" event={"ID":"3f9ccc3c-419c-48a9-b052-640fc504a4c3","Type":"ContainerDied","Data":"58fe909266273dec1aa413ce6b37f92941f2f4ca2dc892c70b34c612a1ecef72"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16","Type":"ContainerDied","Data":"0d66bb6216ee18ec44b4de79ed56c4d68f8a2d26c0c836d566fdc336da59c4b5"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739115 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d66bb6216ee18ec44b4de79ed56c4d68f8a2d26c0c836d566fdc336da59c4b5" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f0bfd46e-ddb1-452a-8df5-283922948dce","Type":"ContainerDied","Data":"9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739137 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance184a-account-delete-zgztl"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739149 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4fxml"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739161 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-4fxml"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f0bfd46e-ddb1-452a-8df5-283922948dce","Type":"ContainerDied","Data":"b89f0884a6164ad3f82bfcf42e7070db9f58cda1ad2789dda46cea7f6e3e3646"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739181 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b89f0884a6164ad3f82bfcf42e7070db9f58cda1ad2789dda46cea7f6e3e3646" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739209 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-161d-account-create-8hc9p"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739218 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican161d-account-delete-hpxvg"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"48101a85-8239-4484-88f5-77efc1a90f99","Type":"ContainerDied","Data":"1a929f8fb5d24d5a7a5149b7c441b592b95ddcdc7c212c54f6ae7a0c3aab6b13"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739246 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-161d-account-create-8hc9p"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-2" event={"ID":"48101a85-8239-4484-88f5-77efc1a90f99","Type":"ContainerDied","Data":"c6f1fbb740f08feb9aa7533df8a4c37c6c0b03624ed0c82c4ae64f3c5dc3e370"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739269 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6f1fbb740f08feb9aa7533df8a4c37c6c0b03624ed0c82c4ae64f3c5dc3e370" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739282 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f215726f-5d62-4daf-98e4-270f4778542f","Type":"ContainerDied","Data":"476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" event={"ID":"3f9ccc3c-419c-48a9-b052-640fc504a4c3","Type":"ContainerDied","Data":"12593aa3a11fc7bca506a51384f660a9325c499ca94b58cecdd3bff613a2da21"} Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739303 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12593aa3a11fc7bca506a51384f660a9325c499ca94b58cecdd3bff613a2da21" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739317 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-28bn5"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739329 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-28bn5"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739338 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-2b29-account-create-ktl57"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739349 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-2b29-account-create-ktl57"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739361 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron2b29-account-delete-j5kk7"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-q9mqm"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739389 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-q9mqm"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739399 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739407 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739419 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-2cdb-account-create-nx52v"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739428 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-z8r69"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739437 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-z8r69"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739446 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739455 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell014d7-account-delete-snw8t"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739467 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-14d7-account-create-mpckt"] Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.739638 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" podUID="0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" containerName="mariadb-account-delete" containerID="cri-o://8f5942845aa51dc6c5d15fcbf0a3fb629726301cc8f7f0181c7b21739d712478" gracePeriod=30 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.744236 4769 scope.go:117] "RemoveContainer" containerID="41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.745063 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" podUID="3769889c-3377-4452-80a0-387660264035" containerName="mariadb-account-delete" containerID="cri-o://f0c2db99458339e365ea10ca0e1225d00463a74d471df369270719399ae39ca9" gracePeriod=30 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.745766 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" podUID="ab6773c4-0375-4426-a9c9-aa301a616474" containerName="mariadb-account-delete" containerID="cri-o://8183e4f32616b12778da0d9f0435279bc14055f3ecfbb7f019fc955b630b3af4" gracePeriod=30 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.745904 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" podUID="3a4d44b3-704e-44c0-8e41-64af780dcd32" containerName="mariadb-account-delete" containerID="cri-o://a77680d8874c4fae988ac4825e84fd1f98ab983222bee0268e3e41edfdbd74ea" gracePeriod=30 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.746941 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" podUID="ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" containerName="mariadb-account-delete" containerID="cri-o://23c6db1c35ef5682dfe3c48f66160953ad34b211d0755d02db8bc679029538f5" gracePeriod=30 Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.804218 4769 scope.go:117] "RemoveContainer" containerID="7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.833131 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.842108 4769 scope.go:117] "RemoveContainer" containerID="41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44" Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.842871 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44\": container with ID starting with 41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44 not found: ID does not exist" containerID="41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.842977 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44"} err="failed to get container status \"41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44\": rpc error: code = NotFound desc = could not find container \"41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44\": container with ID starting with 41b4677ebf726745a6ec89e53a6570688b5cd975c6bd06ca7dbe626d023c3a44 not found: ID does not exist" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.843056 4769 scope.go:117] "RemoveContainer" containerID="7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd" Nov 21 12:41:36 crc kubenswrapper[4769]: E1121 12:41:36.844525 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd\": container with ID starting with 7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd not found: ID does not exist" containerID="7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.844606 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd"} err="failed to get container status \"7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd\": rpc error: code = NotFound desc = could not find container \"7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd\": container with ID starting with 7fc04bac4efc2dbed1fa06227da5c0fe11df5325eee41d6cfa4f2e9064a176cd not found: ID does not exist" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-credential-keys\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-config-data\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbnwc\" (UniqueName: \"kubernetes.io/projected/3f9ccc3c-419c-48a9-b052-640fc504a4c3-kube-api-access-bbnwc\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-combined-ca-bundle\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-public-tls-certs\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-fernet-keys\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-internal-tls-certs\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.898958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-scripts\") pod \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\" (UID: \"3f9ccc3c-419c-48a9-b052-640fc504a4c3\") " Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.904778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-scripts" (OuterVolumeSpecName: "scripts") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.904854 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.906476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.908346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.915888 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9ccc3c-419c-48a9-b052-640fc504a4c3-kube-api-access-bbnwc" (OuterVolumeSpecName: "kube-api-access-bbnwc") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "kube-api-access-bbnwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.940403 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_f0bfd46e-ddb1-452a-8df5-283922948dce/ovn-northd/0.log" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.940527 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.944641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.945360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-config-data" (OuterVolumeSpecName: "config-data") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.975064 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:41:36 crc kubenswrapper[4769]: I1121 12:41:36.981981 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.000871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-combined-ca-bundle\") pod \"f215726f-5d62-4daf-98e4-270f4778542f\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.000931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-kolla-config\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.000982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-config-data-default\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-metrics-certs-tls-certs\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48101a85-8239-4484-88f5-77efc1a90f99-config-data-generated\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppcmr\" (UniqueName: \"kubernetes.io/projected/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-kube-api-access-ppcmr\") pod \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-northd-tls-certs\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-operator-scripts\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-config-data\") pod \"f215726f-5d62-4daf-98e4-270f4778542f\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-combined-ca-bundle\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-scripts\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-combined-ca-bundle\") pod \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-galera-tls-certs\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-config-data\") pod \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\" (UID: \"d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgz8z\" (UniqueName: \"kubernetes.io/projected/f215726f-5d62-4daf-98e4-270f4778542f-kube-api-access-cgz8z\") pod \"f215726f-5d62-4daf-98e4-270f4778542f\" (UID: \"f215726f-5d62-4daf-98e4-270f4778542f\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw2m4\" (UniqueName: \"kubernetes.io/projected/f0bfd46e-ddb1-452a-8df5-283922948dce-kube-api-access-zw2m4\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-config\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-rundir\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.001944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kf92\" (UniqueName: \"kubernetes.io/projected/48101a85-8239-4484-88f5-77efc1a90f99-kube-api-access-4kf92\") pod \"48101a85-8239-4484-88f5-77efc1a90f99\" (UID: \"48101a85-8239-4484-88f5-77efc1a90f99\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.002024 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-combined-ca-bundle\") pod \"f0bfd46e-ddb1-452a-8df5-283922948dce\" (UID: \"f0bfd46e-ddb1-452a-8df5-283922948dce\") " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.002202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003017 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003045 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003062 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bbnwc\" (UniqueName: \"kubernetes.io/projected/3f9ccc3c-419c-48a9-b052-640fc504a4c3-kube-api-access-bbnwc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003078 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003089 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003101 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003113 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.003176 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.003250 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.003231763 +0000 UTC m=+3059.703893581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-scripts" (OuterVolumeSpecName: "scripts") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.003603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.004400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-config" (OuterVolumeSpecName: "config") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.004568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.004603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.004666 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.004703 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.004691893 +0000 UTC m=+3059.705353771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.005708 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.005789 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.005776162 +0000 UTC m=+3059.706438050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.006440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48101a85-8239-4484-88f5-77efc1a90f99-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.007898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.019402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48101a85-8239-4484-88f5-77efc1a90f99-kube-api-access-4kf92" (OuterVolumeSpecName: "kube-api-access-4kf92") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "kube-api-access-4kf92". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.024628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0bfd46e-ddb1-452a-8df5-283922948dce-kube-api-access-zw2m4" (OuterVolumeSpecName: "kube-api-access-zw2m4") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "kube-api-access-zw2m4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.025802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f215726f-5d62-4daf-98e4-270f4778542f-kube-api-access-cgz8z" (OuterVolumeSpecName: "kube-api-access-cgz8z") pod "f215726f-5d62-4daf-98e4-270f4778542f" (UID: "f215726f-5d62-4daf-98e4-270f4778542f"). InnerVolumeSpecName "kube-api-access-cgz8z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.041145 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-kube-api-access-ppcmr" (OuterVolumeSpecName: "kube-api-access-ppcmr") pod "d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" (UID: "d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16"). InnerVolumeSpecName "kube-api-access-ppcmr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.054860 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.082617 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-1"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.082970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.098388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-config-data" (OuterVolumeSpecName: "config-data") pod "d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" (UID: "d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.101329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" (UID: "d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104856 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104880 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4kf92\" (UniqueName: \"kubernetes.io/projected/48101a85-8239-4484-88f5-77efc1a90f99-kube-api-access-4kf92\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104892 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104903 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/48101a85-8239-4484-88f5-77efc1a90f99-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104913 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/48101a85-8239-4484-88f5-77efc1a90f99-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104923 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ppcmr\" (UniqueName: \"kubernetes.io/projected/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-kube-api-access-ppcmr\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104931 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104940 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104958 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104968 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104976 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cgz8z\" (UniqueName: \"kubernetes.io/projected/f215726f-5d62-4daf-98e4-270f4778542f-kube-api-access-cgz8z\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104985 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.104994 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zw2m4\" (UniqueName: \"kubernetes.io/projected/f0bfd46e-ddb1-452a-8df5-283922948dce-kube-api-access-zw2m4\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.105003 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0bfd46e-ddb1-452a-8df5-283922948dce-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.105029 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: E1121 12:41:37.105090 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:41.105069832 +0000 UTC m=+3059.805731650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.117091 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.117604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-config-data" (OuterVolumeSpecName: "config-data") pod "f215726f-5d62-4daf-98e4-270f4778542f" (UID: "f215726f-5d62-4daf-98e4-270f4778542f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.133312 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.139070 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-997b6456b-j6hhp"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.146427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.160412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.170053 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-997b6456b-j6hhp"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.179076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f215726f-5d62-4daf-98e4-270f4778542f" (UID: "f215726f-5d62-4daf-98e4-270f4778542f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.187841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3f9ccc3c-419c-48a9-b052-640fc504a4c3" (UID: "3f9ccc3c-419c-48a9-b052-640fc504a4c3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.195134 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.204659 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.207263 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.207317 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.207333 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.207347 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f9ccc3c-419c-48a9-b052-640fc504a4c3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.207361 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.207377 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f215726f-5d62-4daf-98e4-270f4778542f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.218370 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.227242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.229327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "48101a85-8239-4484-88f5-77efc1a90f99" (UID: "48101a85-8239-4484-88f5-77efc1a90f99"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.237066 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-dbbb4cfd7-h4pdb"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.237418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.259272 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-545c7885b4-plwx7"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.274938 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "f0bfd46e-ddb1-452a-8df5-283922948dce" (UID: "f0bfd46e-ddb1-452a-8df5-283922948dce"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.287000 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="157ffe7a-4ce3-4903-a2a0-e34bd0032714" path="/var/lib/kubelet/pods/157ffe7a-4ce3-4903-a2a0-e34bd0032714/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.287566 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="199ec800-d681-4746-adcb-bc43e6f91d3e" path="/var/lib/kubelet/pods/199ec800-d681-4746-adcb-bc43e6f91d3e/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.288040 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22eca770-9f56-41ee-ac28-d6f37b4b52e3" path="/var/lib/kubelet/pods/22eca770-9f56-41ee-ac28-d6f37b4b52e3/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.289974 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ce645b3-d9d2-4754-bd86-e2255425058c" path="/var/lib/kubelet/pods/2ce645b3-d9d2-4754-bd86-e2255425058c/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.291470 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" path="/var/lib/kubelet/pods/361938ec-ffd5-4e1c-80b2-c30d796ba89c/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.292015 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d862ac-19bc-4f97-8920-41d1008aece5" path="/var/lib/kubelet/pods/90d862ac-19bc-4f97-8920-41d1008aece5/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.292943 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" path="/var/lib/kubelet/pods/964afe99-46d9-4b4e-be03-e3cf7c5b6e04/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.293554 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e3741bb-6b59-41ec-9312-743a83ebbfff" path="/var/lib/kubelet/pods/9e3741bb-6b59-41ec-9312-743a83ebbfff/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.294147 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3aab941-415e-4923-9b5d-2f38004ae8c8" path="/var/lib/kubelet/pods/a3aab941-415e-4923-9b5d-2f38004ae8c8/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.295101 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47d2205-0f3d-421c-acfa-fc91d51a2ed6" path="/var/lib/kubelet/pods/a47d2205-0f3d-421c-acfa-fc91d51a2ed6/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.295678 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab774fec-28fc-4350-a6df-2b93e7e00df9" path="/var/lib/kubelet/pods/ab774fec-28fc-4350-a6df-2b93e7e00df9/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.296178 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" path="/var/lib/kubelet/pods/bbc6cddf-3e72-4186-bdf5-23ad222a4686/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.297305 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" path="/var/lib/kubelet/pods/bd8a72b4-4330-450b-9a5d-431819e3ab7f/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.297943 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfdef99c-9c68-4b51-b2c5-7effb71b205d" path="/var/lib/kubelet/pods/bfdef99c-9c68-4b51-b2c5-7effb71b205d/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.298438 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d68f8c-7883-4b21-aeca-2adce9cca4a6" path="/var/lib/kubelet/pods/c0d68f8c-7883-4b21-aeca-2adce9cca4a6/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.316025 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7fe74c0-1fa2-43d4-9983-3b7f3f471c05" path="/var/lib/kubelet/pods/d7fe74c0-1fa2-43d4-9983-3b7f3f471c05/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.316453 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/48101a85-8239-4484-88f5-77efc1a90f99-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.317471 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67e7c6c-c640-4ec4-83c2-66da32a1046f" path="/var/lib/kubelet/pods/f67e7c6c-c640-4ec4-83c2-66da32a1046f/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.318095 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a836c3-2094-4661-b1f1-1159e00614ff" path="/var/lib/kubelet/pods/f7a836c3-2094-4661-b1f1-1159e00614ff/volumes" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.318704 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.320603 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bfd46e-ddb1-452a-8df5-283922948dce-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.322536 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-545c7885b4-plwx7"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.322599 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.322627 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-1"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.322642 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.326482 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.348458 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone2331-account-delete-tkzfh"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.360040 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone2331-account-delete-tkzfh"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.367548 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.373032 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-2"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.378005 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.383321 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d7ddd44f4-kgt49"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.388994 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement77f5-account-delete-pvwjs"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.394534 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement77f5-account-delete-pvwjs"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.400393 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.408498 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.412774 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.421985 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-1"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.422240 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878271c0-b6d8-414e-abe3-64ab67691f72-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.422259 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zrfbj\" (UniqueName: \"kubernetes.io/projected/878271c0-b6d8-414e-abe3-64ab67691f72-kube-api-access-zrfbj\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.428750 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.435231 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-2"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472297 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f215726f-5d62-4daf-98e4-270f4778542f","Type":"ContainerDied","Data":"2af25815c86e49bd7cba6c2365cbca8ddf9a26d876efe1f9be036dfe41e1ad52"} Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472442 4769 scope.go:117] "RemoveContainer" containerID="476f95930aa30f1e50da338faccf4360d363acf386db52ee0509c8273fab8c15" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472459 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472617 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5dff568d6d-2ltjv" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.472899 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-2" Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.521860 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.527629 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.532509 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.536828 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.552456 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.564056 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-2"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.580383 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.589903 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.596566 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5dff568d6d-2ltjv"] Nov 21 12:41:37 crc kubenswrapper[4769]: I1121 12:41:37.603073 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5dff568d6d-2ltjv"] Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.351177 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.155:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.351282 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-545c7885b4-plwx7" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.155:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.511011 4769 generic.go:334] "Generic (PLEG): container finished" podID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerID="e2032218e6520f26808442a08fd290d961aebba34ef50c59302b1352114c8009" exitCode=0 Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.511168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"364fcc68-67f7-4008-bc5f-a932b88a72bf","Type":"ContainerDied","Data":"e2032218e6520f26808442a08fd290d961aebba34ef50c59302b1352114c8009"} Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.695179 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/364fcc68-67f7-4008-bc5f-a932b88a72bf-pod-info\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thslx\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-kube-api-access-thslx\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-plugins-conf\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-erlang-cookie\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-server-conf\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-plugins\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.748900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-tls\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.749045 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/364fcc68-67f7-4008-bc5f-a932b88a72bf-erlang-cookie-secret\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.749081 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-confd\") pod \"364fcc68-67f7-4008-bc5f-a932b88a72bf\" (UID: \"364fcc68-67f7-4008-bc5f-a932b88a72bf\") " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.750708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.755322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.755811 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.756128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/364fcc68-67f7-4008-bc5f-a932b88a72bf-pod-info" (OuterVolumeSpecName: "pod-info") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.759504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.760238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/364fcc68-67f7-4008-bc5f-a932b88a72bf-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.763024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-kube-api-access-thslx" (OuterVolumeSpecName: "kube-api-access-thslx") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "kube-api-access-thslx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.780079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.788826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data" (OuterVolumeSpecName: "config-data") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.839924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-server-conf" (OuterVolumeSpecName: "server-conf") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.845966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "364fcc68-67f7-4008-bc5f-a932b88a72bf" (UID: "364fcc68-67f7-4008-bc5f-a932b88a72bf"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851325 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/364fcc68-67f7-4008-bc5f-a932b88a72bf-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851386 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-thslx\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-kube-api-access-thslx\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851409 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851453 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851475 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851494 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851512 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/364fcc68-67f7-4008-bc5f-a932b88a72bf-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851531 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851549 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851563 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/364fcc68-67f7-4008-bc5f-a932b88a72bf-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.851579 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/364fcc68-67f7-4008-bc5f-a932b88a72bf-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.870343 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 12:41:38 crc kubenswrapper[4769]: I1121 12:41:38.953961 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.293020 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" path="/var/lib/kubelet/pods/1e2aa50b-63a4-4d92-88bd-345ec2d80dd4/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.294105 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f9ccc3c-419c-48a9-b052-640fc504a4c3" path="/var/lib/kubelet/pods/3f9ccc3c-419c-48a9-b052-640fc504a4c3/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.294954 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48101a85-8239-4484-88f5-77efc1a90f99" path="/var/lib/kubelet/pods/48101a85-8239-4484-88f5-77efc1a90f99/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.296943 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" path="/var/lib/kubelet/pods/857a150b-5f89-4c23-b71c-fa0ec47a855d/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.297569 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878271c0-b6d8-414e-abe3-64ab67691f72" path="/var/lib/kubelet/pods/878271c0-b6d8-414e-abe3-64ab67691f72/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.298279 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" path="/var/lib/kubelet/pods/8960e53d-b896-4f34-8117-399f16f48b0a/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.299719 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" path="/var/lib/kubelet/pods/946c5e3d-0426-4c04-b00c-9fdaa8da7146/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.300693 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" path="/var/lib/kubelet/pods/ae60b576-2037-4318-a529-dca9e6f8eb6a/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.302076 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" path="/var/lib/kubelet/pods/b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.303334 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" path="/var/lib/kubelet/pods/b27c6ab8-1814-4fc4-be72-63efaf921244/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.304694 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1947d55-7857-40da-9103-804862218844" path="/var/lib/kubelet/pods/c1947d55-7857-40da-9103-804862218844/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.305398 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" path="/var/lib/kubelet/pods/d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.306126 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" path="/var/lib/kubelet/pods/e1e5c05c-a6e7-4bb2-a397-d4feb7197966/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.307666 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" path="/var/lib/kubelet/pods/f0bfd46e-ddb1-452a-8df5-283922948dce/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.308502 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f215726f-5d62-4daf-98e4-270f4778542f" path="/var/lib/kubelet/pods/f215726f-5d62-4daf-98e4-270f4778542f/volumes" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.534408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"364fcc68-67f7-4008-bc5f-a932b88a72bf","Type":"ContainerDied","Data":"c7cda56b996aee2e4e1ed41197a7f78bb5a8017650b8fa1c65537b1b665b32ca"} Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.534498 4769 scope.go:117] "RemoveContainer" containerID="e2032218e6520f26808442a08fd290d961aebba34ef50c59302b1352114c8009" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.534522 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.542565 4769 generic.go:334] "Generic (PLEG): container finished" podID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerID="a37bff3cd79ee53aa556c3e1617da82f738dace19196c4be216f961fb7d430bc" exitCode=0 Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.542632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"285b24a3-5a1e-4a39-89b1-a0e0885ece8f","Type":"ContainerDied","Data":"a37bff3cd79ee53aa556c3e1617da82f738dace19196c4be216f961fb7d430bc"} Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.600016 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.608902 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.668856 4769 scope.go:117] "RemoveContainer" containerID="58692825c6b5cb6c3f32b93794183abec3565adf4077e30fc329031cf5629f2a" Nov 21 12:41:39 crc kubenswrapper[4769]: E1121 12:41:39.879486 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:39 crc kubenswrapper[4769]: E1121 12:41:39.879568 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:41:47.879551071 +0000 UTC m=+3066.580212889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:41:39 crc kubenswrapper[4769]: I1121 12:41:39.954682 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.054301 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.083859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-default\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-operator-scripts\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcxmh\" (UniqueName: \"kubernetes.io/projected/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kube-api-access-zcxmh\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-combined-ca-bundle\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-galera-tls-certs\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084519 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kolla-config\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.084729 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-generated\") pod \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\" (UID: \"285b24a3-5a1e-4a39-89b1-a0e0885ece8f\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.086973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.087498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.088538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.088635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.091367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kube-api-access-zcxmh" (OuterVolumeSpecName: "kube-api-access-zcxmh") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "kube-api-access-zcxmh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.103442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "mysql-db") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.117582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.137834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "285b24a3-5a1e-4a39-89b1-a0e0885ece8f" (UID: "285b24a3-5a1e-4a39-89b1-a0e0885ece8f"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.186771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-galera-tls-certs\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.186846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.186884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-combined-ca-bundle\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.186922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kolla-config\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.187009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzbns\" (UniqueName: \"kubernetes.io/projected/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kube-api-access-fzbns\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.187059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-generated\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.187955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.188476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-operator-scripts\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.188724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-default\") pod \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\" (UID: \"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd\") " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.188942 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189634 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189675 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189695 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189734 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189759 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189779 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189798 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189818 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189840 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zcxmh\" (UniqueName: \"kubernetes.io/projected/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kube-api-access-zcxmh\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189859 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189876 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.189892 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/285b24a3-5a1e-4a39-89b1-a0e0885ece8f-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.191002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kube-api-access-fzbns" (OuterVolumeSpecName: "kube-api-access-fzbns") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "kube-api-access-fzbns". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.210136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "mysql-db") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.211675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.215833 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.265006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" (UID: "bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.291321 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.291366 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.291395 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.291410 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.291423 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fzbns\" (UniqueName: \"kubernetes.io/projected/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd-kube-api-access-fzbns\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.313781 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.407886 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.563492 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerID="9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977" exitCode=0 Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.563566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd","Type":"ContainerDied","Data":"9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977"} Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.563598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd","Type":"ContainerDied","Data":"420204a7d3094c75328083af1535f54069f58e7b6b574f9c1f6c4e7d1be49f20"} Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.563640 4769 scope.go:117] "RemoveContainer" containerID="9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.563770 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.583145 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-1" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.583143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-1" event={"ID":"285b24a3-5a1e-4a39-89b1-a0e0885ece8f","Type":"ContainerDied","Data":"aad775a535ce80c01a8b5c55c64b316e68799b79cf7b9b0cb9dbbb988c205a75"} Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.628316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.655580 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.660966 4769 scope.go:117] "RemoveContainer" containerID="ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.748889 4769 scope.go:117] "RemoveContainer" containerID="9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977" Nov 21 12:41:40 crc kubenswrapper[4769]: E1121 12:41:40.749336 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977\": container with ID starting with 9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977 not found: ID does not exist" containerID="9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.749415 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977"} err="failed to get container status \"9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977\": rpc error: code = NotFound desc = could not find container \"9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977\": container with ID starting with 9bec90e930288976f0b093dd12f534c2e65b74a142e6ceff67097d0085255977 not found: ID does not exist" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.749463 4769 scope.go:117] "RemoveContainer" containerID="ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477" Nov 21 12:41:40 crc kubenswrapper[4769]: E1121 12:41:40.749923 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477\": container with ID starting with ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477 not found: ID does not exist" containerID="ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.749956 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477"} err="failed to get container status \"ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477\": rpc error: code = NotFound desc = could not find container \"ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477\": container with ID starting with ee38fef44ed2a2a9626d9327e4f4b0bf94ddbea375a9399f53bd4fa0c46a7477 not found: ID does not exist" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.749980 4769 scope.go:117] "RemoveContainer" containerID="a37bff3cd79ee53aa556c3e1617da82f738dace19196c4be216f961fb7d430bc" Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.777388 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.784897 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-1"] Nov 21 12:41:40 crc kubenswrapper[4769]: I1121 12:41:40.797426 4769 scope.go:117] "RemoveContainer" containerID="b1285179f75a85311041c1714562f0d1bf2f8a675cdafd31348b63f5c7dd14d6" Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.021811 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.021912 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:41:49.021896042 +0000 UTC m=+3067.722557860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.021943 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.021963 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:49.021958314 +0000 UTC m=+3067.722620132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.021985 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.021999 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:49.021995055 +0000 UTC m=+3067.722656873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.123054 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.123124 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:41:49.123109104 +0000 UTC m=+3067.823770922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.285167 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" path="/var/lib/kubelet/pods/285b24a3-5a1e-4a39-89b1-a0e0885ece8f/volumes" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.286338 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" path="/var/lib/kubelet/pods/364fcc68-67f7-4008-bc5f-a932b88a72bf/volumes" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.287776 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" path="/var/lib/kubelet/pods/bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd/volumes" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.325128 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.325182 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.325244 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.325744 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.325817 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" gracePeriod=600 Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.468890 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.600784 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" exitCode=0 Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.600821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05"} Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.600917 4769 scope.go:117] "RemoveContainer" containerID="da2a3b3b916b37218a88212a2ea066749ffab8f49bbf57426bd700ab85ca0799" Nov 21 12:41:41 crc kubenswrapper[4769]: I1121 12:41:41.601540 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:41:41 crc kubenswrapper[4769]: E1121 12:41:41.601836 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.140579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.227096 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9"] Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.227467 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerName="dnsmasq-dns" containerID="cri-o://a5a8146a15ea9bc60a554534b0905f417aca1b11cf6200982f79b001e6db04e5" gracePeriod=10 Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.618408 4769 generic.go:334] "Generic (PLEG): container finished" podID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerID="a5a8146a15ea9bc60a554534b0905f417aca1b11cf6200982f79b001e6db04e5" exitCode=0 Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.618711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" event={"ID":"be7ae658-46c5-4bc5-9af6-585e3cb3c49c","Type":"ContainerDied","Data":"a5a8146a15ea9bc60a554534b0905f417aca1b11cf6200982f79b001e6db04e5"} Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.704674 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.749503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8m7d\" (UniqueName: \"kubernetes.io/projected/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-kube-api-access-q8m7d\") pod \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.749594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dnsmasq-svc\") pod \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.749726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dns-swift-storage-0\") pod \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.749759 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-config\") pod \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\" (UID: \"be7ae658-46c5-4bc5-9af6-585e3cb3c49c\") " Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.757445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-kube-api-access-q8m7d" (OuterVolumeSpecName: "kube-api-access-q8m7d") pod "be7ae658-46c5-4bc5-9af6-585e3cb3c49c" (UID: "be7ae658-46c5-4bc5-9af6-585e3cb3c49c"). InnerVolumeSpecName "kube-api-access-q8m7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.794259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "be7ae658-46c5-4bc5-9af6-585e3cb3c49c" (UID: "be7ae658-46c5-4bc5-9af6-585e3cb3c49c"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.797461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-config" (OuterVolumeSpecName: "config") pod "be7ae658-46c5-4bc5-9af6-585e3cb3c49c" (UID: "be7ae658-46c5-4bc5-9af6-585e3cb3c49c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.814180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "be7ae658-46c5-4bc5-9af6-585e3cb3c49c" (UID: "be7ae658-46c5-4bc5-9af6-585e3cb3c49c"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.853751 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.853798 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.853815 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q8m7d\" (UniqueName: \"kubernetes.io/projected/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-kube-api-access-q8m7d\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:42 crc kubenswrapper[4769]: I1121 12:41:42.853826 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/be7ae658-46c5-4bc5-9af6-585e3cb3c49c-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.625764 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.105:5671: i/o timeout" Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.642572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" event={"ID":"be7ae658-46c5-4bc5-9af6-585e3cb3c49c","Type":"ContainerDied","Data":"84a15f4c2083bc4e7cea7eb07221c13f66f6c16c7575e4970c03e74d59a4c759"} Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.642743 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9" Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.642777 4769 scope.go:117] "RemoveContainer" containerID="a5a8146a15ea9bc60a554534b0905f417aca1b11cf6200982f79b001e6db04e5" Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.673946 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9"] Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.689623 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f74d875b5-vxvn9"] Nov 21 12:41:43 crc kubenswrapper[4769]: I1121 12:41:43.690955 4769 scope.go:117] "RemoveContainer" containerID="1bc7dbaa544d3ee426af8ac366dae4a99802c2e4cdb63cb2fdceecfe9ac2fc8b" Nov 21 12:41:45 crc kubenswrapper[4769]: I1121 12:41:45.286741 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" path="/var/lib/kubelet/pods/be7ae658-46c5-4bc5-9af6-585e3cb3c49c/volumes" Nov 21 12:41:47 crc kubenswrapper[4769]: E1121 12:41:47.949364 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:47 crc kubenswrapper[4769]: E1121 12:41:47.950069 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:42:03.950036401 +0000 UTC m=+3082.650698259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.072149 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.072788 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:42:05.072760428 +0000 UTC m=+3083.773422266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.072256 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.074029 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:42:05.074014403 +0000 UTC m=+3083.774676231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.072350 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.074081 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:42:05.074072864 +0000 UTC m=+3083.774734692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.174673 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:41:49 crc kubenswrapper[4769]: E1121 12:41:49.174766 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:42:05.174747202 +0000 UTC m=+3083.875409030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:41:53 crc kubenswrapper[4769]: I1121 12:41:53.281083 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:41:53 crc kubenswrapper[4769]: E1121 12:41:53.283100 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:41:55 crc kubenswrapper[4769]: I1121 12:41:55.361574 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.164:9696/\": dial tcp 10.217.0.164:9696: connect: connection refused" Nov 21 12:41:58 crc kubenswrapper[4769]: I1121 12:41:58.917475 4769 generic.go:334] "Generic (PLEG): container finished" podID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerID="06506e0bf02484fbd9db9e70996803ffdb0e5e3c0108bdd7c65596b358830bb8" exitCode=137 Nov 21 12:41:58 crc kubenswrapper[4769]: I1121 12:41:58.918418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"06506e0bf02484fbd9db9e70996803ffdb0e5e3c0108bdd7c65596b358830bb8"} Nov 21 12:41:58 crc kubenswrapper[4769]: I1121 12:41:58.922444 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-79b4b5654b-2zhqj_857f2fcc-9d8d-4cad-9945-b8e62997525b/neutron-api/0.log" Nov 21 12:41:58 crc kubenswrapper[4769]: I1121 12:41:58.922527 4769 generic.go:334] "Generic (PLEG): container finished" podID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerID="010d2d75e0547988836316bace3c069b5bf5662168a019571a27d806ae524ed3" exitCode=137 Nov 21 12:41:58 crc kubenswrapper[4769]: I1121 12:41:58.922573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" event={"ID":"857f2fcc-9d8d-4cad-9945-b8e62997525b","Type":"ContainerDied","Data":"010d2d75e0547988836316bace3c069b5bf5662168a019571a27d806ae524ed3"} Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.366789 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-79b4b5654b-2zhqj_857f2fcc-9d8d-4cad-9945-b8e62997525b/neutron-api/0.log" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.367335 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.376347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.537964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ncp6\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-kube-api-access-6ncp6\") pod \"62d412be-7e47-4355-b0de-c0ece98dfcbd\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-combined-ca-bundle\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-public-tls-certs\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"62d412be-7e47-4355-b0de-c0ece98dfcbd\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-config\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-internal-tls-certs\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx7gl\" (UniqueName: \"kubernetes.io/projected/857f2fcc-9d8d-4cad-9945-b8e62997525b-kube-api-access-vx7gl\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") pod \"62d412be-7e47-4355-b0de-c0ece98dfcbd\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-lock\") pod \"62d412be-7e47-4355-b0de-c0ece98dfcbd\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-httpd-config\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538873 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-cache\") pod \"62d412be-7e47-4355-b0de-c0ece98dfcbd\" (UID: \"62d412be-7e47-4355-b0de-c0ece98dfcbd\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.538939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-ovndb-tls-certs\") pod \"857f2fcc-9d8d-4cad-9945-b8e62997525b\" (UID: \"857f2fcc-9d8d-4cad-9945-b8e62997525b\") " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.540014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-lock" (OuterVolumeSpecName: "lock") pod "62d412be-7e47-4355-b0de-c0ece98dfcbd" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.540121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-cache" (OuterVolumeSpecName: "cache") pod "62d412be-7e47-4355-b0de-c0ece98dfcbd" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.545556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "swift") pod "62d412be-7e47-4355-b0de-c0ece98dfcbd" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.546005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-kube-api-access-6ncp6" (OuterVolumeSpecName: "kube-api-access-6ncp6") pod "62d412be-7e47-4355-b0de-c0ece98dfcbd" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd"). InnerVolumeSpecName "kube-api-access-6ncp6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.546722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.547457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/857f2fcc-9d8d-4cad-9945-b8e62997525b-kube-api-access-vx7gl" (OuterVolumeSpecName: "kube-api-access-vx7gl") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "kube-api-access-vx7gl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.548690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "62d412be-7e47-4355-b0de-c0ece98dfcbd" (UID: "62d412be-7e47-4355-b0de-c0ece98dfcbd"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.597767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.624972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.630529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-config" (OuterVolumeSpecName: "config") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.635875 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.643709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "857f2fcc-9d8d-4cad-9945-b8e62997525b" (UID: "857f2fcc-9d8d-4cad-9945-b8e62997525b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.646972 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647029 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647045 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647058 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/62d412be-7e47-4355-b0de-c0ece98dfcbd-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647072 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647090 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6ncp6\" (UniqueName: \"kubernetes.io/projected/62d412be-7e47-4355-b0de-c0ece98dfcbd-kube-api-access-6ncp6\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647106 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647119 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647158 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647171 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647184 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/857f2fcc-9d8d-4cad-9945-b8e62997525b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.647215 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vx7gl\" (UniqueName: \"kubernetes.io/projected/857f2fcc-9d8d-4cad-9945-b8e62997525b-kube-api-access-vx7gl\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.669775 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.750292 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.893582 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podff7d33ec-3dd6-40bc-a371-734a70ab6ed0"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podff7d33ec-3dd6-40bc-a371-734a70ab6ed0] : Timed out while waiting for systemd to remove kubepods-besteffort-podff7d33ec_3dd6_40bc_a371_734a70ab6ed0.slice" Nov 21 12:41:59 crc kubenswrapper[4769]: E1121 12:41:59.893737 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podff7d33ec-3dd6-40bc-a371-734a70ab6ed0] : unable to destroy cgroup paths for cgroup [kubepods besteffort podff7d33ec-3dd6-40bc-a371-734a70ab6ed0] : Timed out while waiting for systemd to remove kubepods-besteffort-podff7d33ec_3dd6_40bc_a371_734a70ab6ed0.slice" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.901217 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb4170bf0-4651-402b-b28e-28443fc3f568"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb4170bf0-4651-402b-b28e-28443fc3f568] : Timed out while waiting for systemd to remove kubepods-besteffort-podb4170bf0_4651_402b_b28e_28443fc3f568.slice" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.952121 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"62d412be-7e47-4355-b0de-c0ece98dfcbd","Type":"ContainerDied","Data":"357d8f25b1c166e50db956d15671d5f6636e62df89e0fd6c1dff559e6f40f168"} Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.952227 4769 scope.go:117] "RemoveContainer" containerID="06506e0bf02484fbd9db9e70996803ffdb0e5e3c0108bdd7c65596b358830bb8" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.952353 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.959080 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-79b4b5654b-2zhqj_857f2fcc-9d8d-4cad-9945-b8e62997525b/neutron-api/0.log" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.959264 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.959586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" event={"ID":"857f2fcc-9d8d-4cad-9945-b8e62997525b","Type":"ContainerDied","Data":"2a30590f7cfcc69872520bbd150400dcb2fc290a6929edaa3377dc7df07b1eda"} Nov 21 12:41:59 crc kubenswrapper[4769]: I1121 12:41:59.959836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79b4b5654b-2zhqj" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.000976 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.008663 4769 scope.go:117] "RemoveContainer" containerID="00c7261b6fba217c4e24a1664abc878170130e5209700df5097de176b6b61570" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.018520 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.022491 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.026314 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.053433 4769 scope.go:117] "RemoveContainer" containerID="382e49e62259b12a0b804b135afca426072edd614c2b0360032fd5e93434a325" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.064036 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-79b4b5654b-2zhqj"] Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.079726 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-79b4b5654b-2zhqj"] Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.086282 4769 scope.go:117] "RemoveContainer" containerID="4f2e11536e9dfb8311db5338a7d21c52507a051785eafcf51feb0bac9499d177" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.117060 4769 scope.go:117] "RemoveContainer" containerID="7d100fe3a4f3a805fe8d957b1438f4eb91b2aa14273dd6eb1a0a391152abe50b" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.143549 4769 scope.go:117] "RemoveContainer" containerID="5360ab1344e47a7d43209a01e2d9ded2e9ba65717ac480f30ced543424799dca" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.176160 4769 scope.go:117] "RemoveContainer" containerID="dc146c5dcd18856f85005711936352194db9a939fe6011aefd5ebeedf33e9968" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.198866 4769 scope.go:117] "RemoveContainer" containerID="830287bfe1d042f3e89be356787c988ff5fa6963f4d3af7bf41d1c452071b115" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.228602 4769 scope.go:117] "RemoveContainer" containerID="840623d07147e6cf6f6469870ee10b31b867a5ca4cda3a760f89c523661aa7a9" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.260258 4769 scope.go:117] "RemoveContainer" containerID="82948b309b2ce73212f41f6eb4ef37b090d2501d82ce65ad827583a6d443d278" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.323244 4769 scope.go:117] "RemoveContainer" containerID="1dafc30651707f08ea650bf9b9b0796de80bb95979b7a0efb96286f05f698430" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.349689 4769 scope.go:117] "RemoveContainer" containerID="b5b8093f4dff60c86fd5e9fdda4853c6722373cb26df618bc7120a60a1a38256" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.378224 4769 scope.go:117] "RemoveContainer" containerID="b308ba5b9db0d5cc512394f23bd38cff8189c1cdfe06d5def513b0cfae404bbf" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.407657 4769 scope.go:117] "RemoveContainer" containerID="98cd919c625608e55be9333a4a0de4346eeb7320e68eb0dc6187d0736f520c5c" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.435040 4769 scope.go:117] "RemoveContainer" containerID="2a44257f61a84469b828910c85ff5691e1b4a7169355aff6a0a8d19f8a7d0333" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.466348 4769 scope.go:117] "RemoveContainer" containerID="5485cdb6e4522d9d7b3eef3e7cc920816967583ab4c38f53b4f8cd80eaf4da22" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.504253 4769 scope.go:117] "RemoveContainer" containerID="010d2d75e0547988836316bace3c069b5bf5662168a019571a27d806ae524ed3" Nov 21 12:42:00 crc kubenswrapper[4769]: I1121 12:42:00.952439 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod4fc23439-b690-4f59-9028-ba72cf39c81e"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod4fc23439-b690-4f59-9028-ba72cf39c81e] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4fc23439_b690_4f59_9028_ba72cf39c81e.slice" Nov 21 12:42:01 crc kubenswrapper[4769]: I1121 12:42:01.284599 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" path="/var/lib/kubelet/pods/62d412be-7e47-4355-b0de-c0ece98dfcbd/volumes" Nov 21 12:42:01 crc kubenswrapper[4769]: I1121 12:42:01.286995 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" path="/var/lib/kubelet/pods/857f2fcc-9d8d-4cad-9945-b8e62997525b/volumes" Nov 21 12:42:01 crc kubenswrapper[4769]: I1121 12:42:01.287588 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7d33ec-3dd6-40bc-a371-734a70ab6ed0" path="/var/lib/kubelet/pods/ff7d33ec-3dd6-40bc-a371-734a70ab6ed0/volumes" Nov 21 12:42:04 crc kubenswrapper[4769]: E1121 12:42:04.039693 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:42:04 crc kubenswrapper[4769]: E1121 12:42:04.040381 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts podName:ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce nodeName:}" failed. No retries permitted until 2025-11-21 12:42:36.040347102 +0000 UTC m=+3114.741008960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts") pod "cinder7629-account-delete-z2cd6" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce") : configmap "openstack-scripts" not found Nov 21 12:42:04 crc kubenswrapper[4769]: I1121 12:42:04.382557 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod4410612c-42ac-4f8a-b643-ddc90384366c"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod4410612c-42ac-4f8a-b643-ddc90384366c] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4410612c_42ac_4f8a_b643_ddc90384366c.slice" Nov 21 12:42:04 crc kubenswrapper[4769]: E1121 12:42:04.383088 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod4410612c-42ac-4f8a-b643-ddc90384366c] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod4410612c-42ac-4f8a-b643-ddc90384366c] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4410612c_42ac_4f8a_b643_ddc90384366c.slice" pod="openstack-kuttl-tests/openstack-cell1-galera-2" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" Nov 21 12:42:05 crc kubenswrapper[4769]: I1121 12:42:05.040075 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-2" Nov 21 12:42:05 crc kubenswrapper[4769]: I1121 12:42:05.083245 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Nov 21 12:42:05 crc kubenswrapper[4769]: I1121 12:42:05.094718 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-2"] Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.165331 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.165388 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.165452 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.165459 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts podName:3769889c-3377-4452-80a0-387660264035 nodeName:}" failed. No retries permitted until 2025-11-21 12:42:37.165432523 +0000 UTC m=+3115.866094341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts") pod "barbican161d-account-delete-hpxvg" (UID: "3769889c-3377-4452-80a0-387660264035") : configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.165654 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts podName:ab6773c4-0375-4426-a9c9-aa301a616474 nodeName:}" failed. No retries permitted until 2025-11-21 12:42:37.165615018 +0000 UTC m=+3115.866276866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts") pod "neutron2b29-account-delete-j5kk7" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474") : configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.165700 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts podName:0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe nodeName:}" failed. No retries permitted until 2025-11-21 12:42:37.16568322 +0000 UTC m=+3115.866345078 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts") pod "novacell014d7-account-delete-snw8t" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe") : configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.267749 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: E1121 12:42:05.267894 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts podName:3a4d44b3-704e-44c0-8e41-64af780dcd32 nodeName:}" failed. No retries permitted until 2025-11-21 12:42:37.267863609 +0000 UTC m=+3115.968525477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts") pod "novaapi2cdb-account-delete-lrgmx" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32") : configmap "openstack-scripts" not found Nov 21 12:42:05 crc kubenswrapper[4769]: I1121 12:42:05.285888 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" path="/var/lib/kubelet/pods/4410612c-42ac-4f8a-b643-ddc90384366c/volumes" Nov 21 12:42:06 crc kubenswrapper[4769]: I1121 12:42:06.274905 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:42:06 crc kubenswrapper[4769]: E1121 12:42:06.275393 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:42:11 crc kubenswrapper[4769]: I1121 12:42:11.953357 4769 scope.go:117] "RemoveContainer" containerID="1d1dc553e27bb32ca837a9e46bb78af1d5d8eaa3b4fadd50be18844443a3f2fb" Nov 21 12:42:12 crc kubenswrapper[4769]: I1121 12:42:12.005079 4769 scope.go:117] "RemoveContainer" containerID="eededa8a72031bb21af931115071b72bb489d664e4901c4f152ade5510ef17b9" Nov 21 12:42:12 crc kubenswrapper[4769]: I1121 12:42:12.043932 4769 scope.go:117] "RemoveContainer" containerID="42e893e76266ec204d3f83f307b2faf0609d07fe7d534ee7c806e5ff1e9f3f67" Nov 21 12:42:12 crc kubenswrapper[4769]: I1121 12:42:12.090180 4769 scope.go:117] "RemoveContainer" containerID="07fce744c3628b7e76ad6eff16f86f580661c29a3505932bc21da124e89ff64c" Nov 21 12:42:12 crc kubenswrapper[4769]: I1121 12:42:12.136773 4769 scope.go:117] "RemoveContainer" containerID="913cd7871484cf964f780578405195a1af0ad1f375dcd0d6826245f32528c973" Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.835478 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab6773c4-0375-4426-a9c9-aa301a616474" containerID="8183e4f32616b12778da0d9f0435279bc14055f3ecfbb7f019fc955b630b3af4" exitCode=137 Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.835611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" event={"ID":"ab6773c4-0375-4426-a9c9-aa301a616474","Type":"ContainerDied","Data":"8183e4f32616b12778da0d9f0435279bc14055f3ecfbb7f019fc955b630b3af4"} Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.839142 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" containerID="8f5942845aa51dc6c5d15fcbf0a3fb629726301cc8f7f0181c7b21739d712478" exitCode=137 Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.839235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" event={"ID":"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe","Type":"ContainerDied","Data":"8f5942845aa51dc6c5d15fcbf0a3fb629726301cc8f7f0181c7b21739d712478"} Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.842286 4769 generic.go:334] "Generic (PLEG): container finished" podID="ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" containerID="23c6db1c35ef5682dfe3c48f66160953ad34b211d0755d02db8bc679029538f5" exitCode=137 Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.842361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" event={"ID":"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce","Type":"ContainerDied","Data":"23c6db1c35ef5682dfe3c48f66160953ad34b211d0755d02db8bc679029538f5"} Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.844937 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a4d44b3-704e-44c0-8e41-64af780dcd32" containerID="a77680d8874c4fae988ac4825e84fd1f98ab983222bee0268e3e41edfdbd74ea" exitCode=137 Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.844973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" event={"ID":"3a4d44b3-704e-44c0-8e41-64af780dcd32","Type":"ContainerDied","Data":"a77680d8874c4fae988ac4825e84fd1f98ab983222bee0268e3e41edfdbd74ea"} Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.847081 4769 generic.go:334] "Generic (PLEG): container finished" podID="3769889c-3377-4452-80a0-387660264035" containerID="f0c2db99458339e365ea10ca0e1225d00463a74d471df369270719399ae39ca9" exitCode=137 Nov 21 12:42:13 crc kubenswrapper[4769]: I1121 12:42:13.847129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" event={"ID":"3769889c-3377-4452-80a0-387660264035","Type":"ContainerDied","Data":"f0c2db99458339e365ea10ca0e1225d00463a74d471df369270719399ae39ca9"} Nov 21 12:42:14 crc kubenswrapper[4769]: I1121 12:42:14.989492 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.091339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6t9z\" (UniqueName: \"kubernetes.io/projected/ab6773c4-0375-4426-a9c9-aa301a616474-kube-api-access-z6t9z\") pod \"ab6773c4-0375-4426-a9c9-aa301a616474\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.091829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts\") pod \"ab6773c4-0375-4426-a9c9-aa301a616474\" (UID: \"ab6773c4-0375-4426-a9c9-aa301a616474\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.092646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ab6773c4-0375-4426-a9c9-aa301a616474" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.099121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6773c4-0375-4426-a9c9-aa301a616474-kube-api-access-z6t9z" (OuterVolumeSpecName: "kube-api-access-z6t9z") pod "ab6773c4-0375-4426-a9c9-aa301a616474" (UID: "ab6773c4-0375-4426-a9c9-aa301a616474"). InnerVolumeSpecName "kube-api-access-z6t9z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.156468 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.164268 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.179488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.190463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.193432 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab6773c4-0375-4426-a9c9-aa301a616474-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.193458 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z6t9z\" (UniqueName: \"kubernetes.io/projected/ab6773c4-0375-4426-a9c9-aa301a616474-kube-api-access-z6t9z\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.294764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85kv2\" (UniqueName: \"kubernetes.io/projected/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-kube-api-access-85kv2\") pod \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.294838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts\") pod \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\" (UID: \"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.294961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgs65\" (UniqueName: \"kubernetes.io/projected/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-kube-api-access-wgs65\") pod \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.294985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sldtg\" (UniqueName: \"kubernetes.io/projected/3a4d44b3-704e-44c0-8e41-64af780dcd32-kube-api-access-sldtg\") pod \"3a4d44b3-704e-44c0-8e41-64af780dcd32\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.295012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6slw\" (UniqueName: \"kubernetes.io/projected/3769889c-3377-4452-80a0-387660264035-kube-api-access-d6slw\") pod \"3769889c-3377-4452-80a0-387660264035\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.295168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts\") pod \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\" (UID: \"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.295346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts\") pod \"3769889c-3377-4452-80a0-387660264035\" (UID: \"3769889c-3377-4452-80a0-387660264035\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.295373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts\") pod \"3a4d44b3-704e-44c0-8e41-64af780dcd32\" (UID: \"3a4d44b3-704e-44c0-8e41-64af780dcd32\") " Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.296231 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3a4d44b3-704e-44c0-8e41-64af780dcd32" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.296250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.296287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.296773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3769889c-3377-4452-80a0-387660264035" (UID: "3769889c-3377-4452-80a0-387660264035"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.302517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-kube-api-access-wgs65" (OuterVolumeSpecName: "kube-api-access-wgs65") pod "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" (UID: "0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe"). InnerVolumeSpecName "kube-api-access-wgs65". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.302681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-kube-api-access-85kv2" (OuterVolumeSpecName: "kube-api-access-85kv2") pod "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" (UID: "ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce"). InnerVolumeSpecName "kube-api-access-85kv2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.302847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a4d44b3-704e-44c0-8e41-64af780dcd32-kube-api-access-sldtg" (OuterVolumeSpecName: "kube-api-access-sldtg") pod "3a4d44b3-704e-44c0-8e41-64af780dcd32" (UID: "3a4d44b3-704e-44c0-8e41-64af780dcd32"). InnerVolumeSpecName "kube-api-access-sldtg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.307519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3769889c-3377-4452-80a0-387660264035-kube-api-access-d6slw" (OuterVolumeSpecName: "kube-api-access-d6slw") pod "3769889c-3377-4452-80a0-387660264035" (UID: "3769889c-3377-4452-80a0-387660264035"). InnerVolumeSpecName "kube-api-access-d6slw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397389 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-85kv2\" (UniqueName: \"kubernetes.io/projected/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-kube-api-access-85kv2\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397434 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397448 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wgs65\" (UniqueName: \"kubernetes.io/projected/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-kube-api-access-wgs65\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397467 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sldtg\" (UniqueName: \"kubernetes.io/projected/3a4d44b3-704e-44c0-8e41-64af780dcd32-kube-api-access-sldtg\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397481 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d6slw\" (UniqueName: \"kubernetes.io/projected/3769889c-3377-4452-80a0-387660264035-kube-api-access-d6slw\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397496 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397508 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3769889c-3377-4452-80a0-387660264035-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.397521 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a4d44b3-704e-44c0-8e41-64af780dcd32-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.905842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" event={"ID":"3a4d44b3-704e-44c0-8e41-64af780dcd32","Type":"ContainerDied","Data":"9d401d9f12862d67a0352973e604007d1c96529411db6e809df2f0a6897325f7"} Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.906000 4769 scope.go:117] "RemoveContainer" containerID="a77680d8874c4fae988ac4825e84fd1f98ab983222bee0268e3e41edfdbd74ea" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.906112 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.914893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" event={"ID":"3769889c-3377-4452-80a0-387660264035","Type":"ContainerDied","Data":"cf7891c035d844206afcc77b6cb1a1bec28b4d3d9fc302ed59129f9ec080bb65"} Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.915175 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican161d-account-delete-hpxvg" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.923141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.924062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron2b29-account-delete-j5kk7" event={"ID":"ab6773c4-0375-4426-a9c9-aa301a616474","Type":"ContainerDied","Data":"dad7468c24ba83553a4779cd09840f89b7a7773434b541b129bac3861139b785"} Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.927536 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.927493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell014d7-account-delete-snw8t" event={"ID":"0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe","Type":"ContainerDied","Data":"4098ba6be1b9d980e7cf421fd87715ec3b69e6de1e0f3c9c97faeed6c6640e10"} Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.930736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" event={"ID":"ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce","Type":"ContainerDied","Data":"393fc01f36071199791b5c6624013ff65ff9e16667d95e9aee6214ca655a25d0"} Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.930996 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder7629-account-delete-z2cd6" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.973665 4769 scope.go:117] "RemoveContainer" containerID="f0c2db99458339e365ea10ca0e1225d00463a74d471df369270719399ae39ca9" Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.976140 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron2b29-account-delete-j5kk7"] Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.988842 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron2b29-account-delete-j5kk7"] Nov 21 12:42:15 crc kubenswrapper[4769]: I1121 12:42:15.996423 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.010142 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi2cdb-account-delete-lrgmx"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.017471 4769 scope.go:117] "RemoveContainer" containerID="8183e4f32616b12778da0d9f0435279bc14055f3ecfbb7f019fc955b630b3af4" Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.026365 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder7629-account-delete-z2cd6"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.034006 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder7629-account-delete-z2cd6"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.038453 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican161d-account-delete-hpxvg"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.039937 4769 scope.go:117] "RemoveContainer" containerID="8f5942845aa51dc6c5d15fcbf0a3fb629726301cc8f7f0181c7b21739d712478" Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.042858 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican161d-account-delete-hpxvg"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.047344 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell014d7-account-delete-snw8t"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.052548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell014d7-account-delete-snw8t"] Nov 21 12:42:16 crc kubenswrapper[4769]: I1121 12:42:16.070725 4769 scope.go:117] "RemoveContainer" containerID="23c6db1c35ef5682dfe3c48f66160953ad34b211d0755d02db8bc679029538f5" Nov 21 12:42:17 crc kubenswrapper[4769]: I1121 12:42:17.275606 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:42:17 crc kubenswrapper[4769]: E1121 12:42:17.276597 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:42:17 crc kubenswrapper[4769]: I1121 12:42:17.289387 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" path="/var/lib/kubelet/pods/0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe/volumes" Nov 21 12:42:17 crc kubenswrapper[4769]: I1121 12:42:17.290908 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3769889c-3377-4452-80a0-387660264035" path="/var/lib/kubelet/pods/3769889c-3377-4452-80a0-387660264035/volumes" Nov 21 12:42:17 crc kubenswrapper[4769]: I1121 12:42:17.292007 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a4d44b3-704e-44c0-8e41-64af780dcd32" path="/var/lib/kubelet/pods/3a4d44b3-704e-44c0-8e41-64af780dcd32/volumes" Nov 21 12:42:17 crc kubenswrapper[4769]: I1121 12:42:17.294025 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6773c4-0375-4426-a9c9-aa301a616474" path="/var/lib/kubelet/pods/ab6773c4-0375-4426-a9c9-aa301a616474/volumes" Nov 21 12:42:17 crc kubenswrapper[4769]: I1121 12:42:17.296943 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" path="/var/lib/kubelet/pods/ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce/volumes" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.691662 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-ttwmz"] Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.705650 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-ttwmz"] Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.839588 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-bf5rv"] Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.840348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.840432 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.840491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.840540 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.840600 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerName="init" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.840650 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerName="init" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.840712 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.840767 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.840834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.840886 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.840960 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3f9ccc3c-419c-48a9-b052-640fc504a4c3" containerName="keystone-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841010 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9ccc3c-419c-48a9-b052-640fc504a4c3" containerName="keystone-api" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841067 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841117 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-api" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841179 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841327 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-notification-agent" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841377 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-notification-agent" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841434 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841483 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841539 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-server" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841589 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-server" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841652 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841759 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="rsync" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841817 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="rsync" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.841876 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.841957 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842016 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-server" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842065 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-server" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842116 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f215726f-5d62-4daf-98e4-270f4778542f" containerName="nova-cell1-conductor-conductor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842178 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f215726f-5d62-4daf-98e4-270f4778542f" containerName="nova-cell1-conductor-conductor" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842267 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-central-agent" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842327 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-central-agent" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842382 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842457 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842508 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-expirer" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842562 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-expirer" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842621 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842720 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="sg-core" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="sg-core" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.842896 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.842951 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843006 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-updater" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843058 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-updater" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843113 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843168 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843249 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843306 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843356 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843412 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843468 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843521 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843630 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-api" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843683 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843741 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843803 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843856 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.843912 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.843987 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844043 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="proxy-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="proxy-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844153 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844223 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844277 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844358 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844410 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844467 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844524 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844637 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844686 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844741 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844855 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerName="dnsmasq-dns" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.844912 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerName="dnsmasq-dns" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.844967 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845029 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845138 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845215 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845280 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845336 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845385 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845439 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="openstack-network-exporter" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845495 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="openstack-network-exporter" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845553 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845608 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845667 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845720 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-api" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845774 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845824 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845877 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.845931 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.845996 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846049 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846106 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846155 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846235 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846288 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="swift-recon-cron" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846405 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="swift-recon-cron" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846461 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846515 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846567 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846622 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="setup-container" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846677 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846729 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846781 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab6773c4-0375-4426-a9c9-aa301a616474" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846836 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6773c4-0375-4426-a9c9-aa301a616474" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846891 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.846941 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.846999 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3769889c-3377-4452-80a0-387660264035" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847057 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3769889c-3377-4452-80a0-387660264035" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847113 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-updater" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847169 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-updater" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847251 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847304 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847362 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847422 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847481 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847531 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847581 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="90d862ac-19bc-4f97-8920-41d1008aece5" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847635 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d862ac-19bc-4f97-8920-41d1008aece5" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847739 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="mysql-bootstrap" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847796 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847850 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.847905 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1947d55-7857-40da-9103-804862218844" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.847979 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1947d55-7857-40da-9103-804862218844" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848035 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-metadata" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-metadata" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848145 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848217 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848273 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-reaper" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848331 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-reaper" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848386 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848434 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848492 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerName="nova-cell0-conductor-conductor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848547 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerName="nova-cell0-conductor-conductor" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848605 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-server" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848655 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-server" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848706 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848817 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848866 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.848923 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a4d44b3-704e-44c0-8e41-64af780dcd32" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.848975 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4d44b3-704e-44c0-8e41-64af780dcd32" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: E1121 12:42:22.849034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfdef99c-9c68-4b51-b2c5-7effb71b205d" containerName="memcached" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdef99c-9c68-4b51-b2c5-7effb71b205d" containerName="memcached" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849366 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849441 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849501 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849557 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849608 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-server" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849663 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849716 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="proxy-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849777 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-metadata" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849828 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-updater" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849877 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849930 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c73cd3f-0a56-4bed-8ae3-4ca55e5e5bbe" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.849989 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="openstack-network-exporter" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5515ac85-cbc8-453f-8b3d-5f4ac3940b30" containerName="nova-api-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850100 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-server" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850156 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-server" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850251 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfdef99c-9c68-4b51-b2c5-7effb71b205d" containerName="memcached" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850315 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="361938ec-ffd5-4e1c-80b2-c30d796ba89c" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-expirer" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850421 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0bfd46e-ddb1-452a-8df5-283922948dce" containerName="ovn-northd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850644 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-reaper" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850707 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850760 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850838 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bbc6cddf-3e72-4186-bdf5-23ad222a4686" containerName="placement-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850898 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48101a85-8239-4484-88f5-77efc1a90f99" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.850951 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="857a150b-5f89-4c23-b71c-fa0ec47a855d" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851007 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="364fcc68-67f7-4008-bc5f-a932b88a72bf" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851069 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="swift-recon-cron" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851123 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851178 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="object-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851258 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3769889c-3377-4452-80a0-387660264035" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851319 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3f9ccc3c-419c-48a9-b052-640fc504a4c3" containerName="keystone-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851430 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="964afe99-46d9-4b4e-be03-e3cf7c5b6e04" containerName="barbican-worker" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851491 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851547 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="857f2fcc-9d8d-4cad-9945-b8e62997525b" containerName="neutron-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851607 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-central-agent" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851663 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="90d862ac-19bc-4f97-8920-41d1008aece5" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851719 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be7ae658-46c5-4bc5-9af6-585e3cb3c49c" containerName="dnsmasq-dns" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851778 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a4d44b3-704e-44c0-8e41-64af780dcd32" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851829 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bd8a72b4-4330-450b-9a5d-431819e3ab7f" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851880 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-updater" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.851956 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e689da25-a663-48f8-acc0-3890d96884a2" containerName="cinder-api-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="account-replicator" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852093 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab6773c4-0375-4426-a9c9-aa301a616474" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852148 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f231df0-d475-4ac5-9de8-403d93cc5d8a" containerName="nova-metadata-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852224 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4410612c-42ac-4f8a-b643-ddc90384366c" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852278 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="285b24a3-5a1e-4a39-89b1-a0e0885ece8f" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852329 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="container-auditor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852382 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="sg-core" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852430 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ae60b576-2037-4318-a529-dca9e6f8eb6a" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852482 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1ec30bb-632a-4b2e-b008-1ddaf3ba99ac" containerName="ceilometer-notification-agent" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852548 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b27c6ab8-1814-4fc4-be72-63efaf921244" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852609 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1e5c05c-a6e7-4bb2-a397-d4feb7197966" containerName="barbican-keystone-listener-log" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852662 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ccdde9f6-5cc5-4777-b483-08ff8f2ef6ce" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852716 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d24cf656-a5f0-4c9f-bdc0-a95e5bf92a16" containerName="nova-cell0-conductor-conductor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852770 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfe29cd4-7ebc-4d38-b0cf-7aa812c11fdd" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852827 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c1947d55-7857-40da-9103-804862218844" containerName="mariadb-account-delete" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f215726f-5d62-4daf-98e4-270f4778542f" containerName="nova-cell1-conductor-conductor" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.852946 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e2aa50b-63a4-4d92-88bd-345ec2d80dd4" containerName="rabbitmq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.853003 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="946c5e3d-0426-4c04-b00c-9fdaa8da7146" containerName="barbican-api" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.853059 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94b1f363-8761-4a8e-a35c-d7cc338232f2" containerName="glance-httpd" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.853110 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8960e53d-b896-4f34-8117-399f16f48b0a" containerName="galera" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.853163 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62d412be-7e47-4355-b0de-c0ece98dfcbd" containerName="rsync" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.853701 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-bf5rv"] Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.853869 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.856707 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.857918 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.858745 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.858906 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.946325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swpvp\" (UniqueName: \"kubernetes.io/projected/42632efd-3412-443d-8e52-e00bcbf00783-kube-api-access-swpvp\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.946469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42632efd-3412-443d-8e52-e00bcbf00783-crc-storage\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:22 crc kubenswrapper[4769]: I1121 12:42:22.946515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42632efd-3412-443d-8e52-e00bcbf00783-node-mnt\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.048131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-swpvp\" (UniqueName: \"kubernetes.io/projected/42632efd-3412-443d-8e52-e00bcbf00783-kube-api-access-swpvp\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.048260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42632efd-3412-443d-8e52-e00bcbf00783-crc-storage\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.048310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42632efd-3412-443d-8e52-e00bcbf00783-node-mnt\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.048884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42632efd-3412-443d-8e52-e00bcbf00783-node-mnt\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.050407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42632efd-3412-443d-8e52-e00bcbf00783-crc-storage\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.082742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-swpvp\" (UniqueName: \"kubernetes.io/projected/42632efd-3412-443d-8e52-e00bcbf00783-kube-api-access-swpvp\") pod \"crc-storage-crc-bf5rv\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.187289 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.291500 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="908989f9-98d1-4aad-9c83-cfba354dfeb7" path="/var/lib/kubelet/pods/908989f9-98d1-4aad-9c83-cfba354dfeb7/volumes" Nov 21 12:42:23 crc kubenswrapper[4769]: I1121 12:42:23.720843 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-bf5rv"] Nov 21 12:42:24 crc kubenswrapper[4769]: I1121 12:42:24.067010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bf5rv" event={"ID":"42632efd-3412-443d-8e52-e00bcbf00783","Type":"ContainerStarted","Data":"ac118bd0edd9c2e67293fb6af29fa8f2169a7386268685719d6ebf9d706fd64a"} Nov 21 12:42:26 crc kubenswrapper[4769]: I1121 12:42:26.096079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bf5rv" event={"ID":"42632efd-3412-443d-8e52-e00bcbf00783","Type":"ContainerStarted","Data":"748a781178f3063bba0f59477e73b37361fbbe5b3f3e09613413a5dd8c90b7a6"} Nov 21 12:42:26 crc kubenswrapper[4769]: I1121 12:42:26.125687 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="crc-storage/crc-storage-crc-bf5rv" podStartSLOduration=2.942102647 podStartE2EDuration="4.12565636s" podCreationTimestamp="2025-11-21 12:42:22 +0000 UTC" firstStartedPulling="2025-11-21 12:42:23.993050383 +0000 UTC m=+3102.693712271" lastFinishedPulling="2025-11-21 12:42:25.176604146 +0000 UTC m=+3103.877265984" observedRunningTime="2025-11-21 12:42:26.116522242 +0000 UTC m=+3104.817184060" watchObservedRunningTime="2025-11-21 12:42:26.12565636 +0000 UTC m=+3104.826318178" Nov 21 12:42:27 crc kubenswrapper[4769]: I1121 12:42:27.114335 4769 generic.go:334] "Generic (PLEG): container finished" podID="42632efd-3412-443d-8e52-e00bcbf00783" containerID="748a781178f3063bba0f59477e73b37361fbbe5b3f3e09613413a5dd8c90b7a6" exitCode=0 Nov 21 12:42:27 crc kubenswrapper[4769]: I1121 12:42:27.114603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bf5rv" event={"ID":"42632efd-3412-443d-8e52-e00bcbf00783","Type":"ContainerDied","Data":"748a781178f3063bba0f59477e73b37361fbbe5b3f3e09613413a5dd8c90b7a6"} Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.723767 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.870775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42632efd-3412-443d-8e52-e00bcbf00783-crc-storage\") pod \"42632efd-3412-443d-8e52-e00bcbf00783\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.870957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42632efd-3412-443d-8e52-e00bcbf00783-node-mnt\") pod \"42632efd-3412-443d-8e52-e00bcbf00783\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.870991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swpvp\" (UniqueName: \"kubernetes.io/projected/42632efd-3412-443d-8e52-e00bcbf00783-kube-api-access-swpvp\") pod \"42632efd-3412-443d-8e52-e00bcbf00783\" (UID: \"42632efd-3412-443d-8e52-e00bcbf00783\") " Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.871179 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/42632efd-3412-443d-8e52-e00bcbf00783-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "42632efd-3412-443d-8e52-e00bcbf00783" (UID: "42632efd-3412-443d-8e52-e00bcbf00783"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.871881 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42632efd-3412-443d-8e52-e00bcbf00783-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.882267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42632efd-3412-443d-8e52-e00bcbf00783-kube-api-access-swpvp" (OuterVolumeSpecName: "kube-api-access-swpvp") pod "42632efd-3412-443d-8e52-e00bcbf00783" (UID: "42632efd-3412-443d-8e52-e00bcbf00783"). InnerVolumeSpecName "kube-api-access-swpvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.914717 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42632efd-3412-443d-8e52-e00bcbf00783-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "42632efd-3412-443d-8e52-e00bcbf00783" (UID: "42632efd-3412-443d-8e52-e00bcbf00783"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.975976 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-swpvp\" (UniqueName: \"kubernetes.io/projected/42632efd-3412-443d-8e52-e00bcbf00783-kube-api-access-swpvp\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:28 crc kubenswrapper[4769]: I1121 12:42:28.976146 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42632efd-3412-443d-8e52-e00bcbf00783-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:29 crc kubenswrapper[4769]: I1121 12:42:29.155693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-bf5rv" event={"ID":"42632efd-3412-443d-8e52-e00bcbf00783","Type":"ContainerDied","Data":"ac118bd0edd9c2e67293fb6af29fa8f2169a7386268685719d6ebf9d706fd64a"} Nov 21 12:42:29 crc kubenswrapper[4769]: I1121 12:42:29.155773 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac118bd0edd9c2e67293fb6af29fa8f2169a7386268685719d6ebf9d706fd64a" Nov 21 12:42:29 crc kubenswrapper[4769]: I1121 12:42:29.156337 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-bf5rv" Nov 21 12:42:30 crc kubenswrapper[4769]: I1121 12:42:30.274312 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:42:30 crc kubenswrapper[4769]: E1121 12:42:30.275326 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:42:31 crc kubenswrapper[4769]: I1121 12:42:31.960217 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-bf5rv"] Nov 21 12:42:31 crc kubenswrapper[4769]: I1121 12:42:31.971633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-bf5rv"] Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.115620 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-f7grx"] Nov 21 12:42:32 crc kubenswrapper[4769]: E1121 12:42:32.116215 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42632efd-3412-443d-8e52-e00bcbf00783" containerName="storage" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.116240 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42632efd-3412-443d-8e52-e00bcbf00783" containerName="storage" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.116416 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42632efd-3412-443d-8e52-e00bcbf00783" containerName="storage" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.117184 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.120692 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.121047 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.121353 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.121985 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.126815 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-f7grx"] Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.265605 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tbw7\" (UniqueName: \"kubernetes.io/projected/df634252-d877-48c1-a1fa-6bf8fe5ce68f-kube-api-access-6tbw7\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.265743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/df634252-d877-48c1-a1fa-6bf8fe5ce68f-crc-storage\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.265771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/df634252-d877-48c1-a1fa-6bf8fe5ce68f-node-mnt\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.367986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/df634252-d877-48c1-a1fa-6bf8fe5ce68f-crc-storage\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.368081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/df634252-d877-48c1-a1fa-6bf8fe5ce68f-node-mnt\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.368414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6tbw7\" (UniqueName: \"kubernetes.io/projected/df634252-d877-48c1-a1fa-6bf8fe5ce68f-kube-api-access-6tbw7\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.369927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/df634252-d877-48c1-a1fa-6bf8fe5ce68f-node-mnt\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.370862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/df634252-d877-48c1-a1fa-6bf8fe5ce68f-crc-storage\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.397931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tbw7\" (UniqueName: \"kubernetes.io/projected/df634252-d877-48c1-a1fa-6bf8fe5ce68f-kube-api-access-6tbw7\") pod \"crc-storage-crc-f7grx\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.450500 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:32 crc kubenswrapper[4769]: I1121 12:42:32.729969 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-f7grx"] Nov 21 12:42:33 crc kubenswrapper[4769]: I1121 12:42:33.225359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-f7grx" event={"ID":"df634252-d877-48c1-a1fa-6bf8fe5ce68f","Type":"ContainerStarted","Data":"0f7765fb67b1a3c73b7c283b9dfa0b7bcbe86aae76ab72fbdc7fa1f4b30f620a"} Nov 21 12:42:33 crc kubenswrapper[4769]: I1121 12:42:33.299265 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42632efd-3412-443d-8e52-e00bcbf00783" path="/var/lib/kubelet/pods/42632efd-3412-443d-8e52-e00bcbf00783/volumes" Nov 21 12:42:36 crc kubenswrapper[4769]: I1121 12:42:36.267229 4769 generic.go:334] "Generic (PLEG): container finished" podID="df634252-d877-48c1-a1fa-6bf8fe5ce68f" containerID="c9a1065d4afe764dac0d7d0da1c88eafa5576cb784b5cba6121b2a609421e79f" exitCode=0 Nov 21 12:42:36 crc kubenswrapper[4769]: I1121 12:42:36.267332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-f7grx" event={"ID":"df634252-d877-48c1-a1fa-6bf8fe5ce68f","Type":"ContainerDied","Data":"c9a1065d4afe764dac0d7d0da1c88eafa5576cb784b5cba6121b2a609421e79f"} Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.702597 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.898943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/df634252-d877-48c1-a1fa-6bf8fe5ce68f-node-mnt\") pod \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.899093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/df634252-d877-48c1-a1fa-6bf8fe5ce68f-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "df634252-d877-48c1-a1fa-6bf8fe5ce68f" (UID: "df634252-d877-48c1-a1fa-6bf8fe5ce68f"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.899165 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tbw7\" (UniqueName: \"kubernetes.io/projected/df634252-d877-48c1-a1fa-6bf8fe5ce68f-kube-api-access-6tbw7\") pod \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.899369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/df634252-d877-48c1-a1fa-6bf8fe5ce68f-crc-storage\") pod \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\" (UID: \"df634252-d877-48c1-a1fa-6bf8fe5ce68f\") " Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.900295 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/df634252-d877-48c1-a1fa-6bf8fe5ce68f-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.912269 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df634252-d877-48c1-a1fa-6bf8fe5ce68f-kube-api-access-6tbw7" (OuterVolumeSpecName: "kube-api-access-6tbw7") pod "df634252-d877-48c1-a1fa-6bf8fe5ce68f" (UID: "df634252-d877-48c1-a1fa-6bf8fe5ce68f"). InnerVolumeSpecName "kube-api-access-6tbw7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:42:37 crc kubenswrapper[4769]: I1121 12:42:37.939828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df634252-d877-48c1-a1fa-6bf8fe5ce68f-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "df634252-d877-48c1-a1fa-6bf8fe5ce68f" (UID: "df634252-d877-48c1-a1fa-6bf8fe5ce68f"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:42:38 crc kubenswrapper[4769]: I1121 12:42:38.002875 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6tbw7\" (UniqueName: \"kubernetes.io/projected/df634252-d877-48c1-a1fa-6bf8fe5ce68f-kube-api-access-6tbw7\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:38 crc kubenswrapper[4769]: I1121 12:42:38.002937 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/df634252-d877-48c1-a1fa-6bf8fe5ce68f-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:42:38 crc kubenswrapper[4769]: I1121 12:42:38.300066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-f7grx" event={"ID":"df634252-d877-48c1-a1fa-6bf8fe5ce68f","Type":"ContainerDied","Data":"0f7765fb67b1a3c73b7c283b9dfa0b7bcbe86aae76ab72fbdc7fa1f4b30f620a"} Nov 21 12:42:38 crc kubenswrapper[4769]: I1121 12:42:38.300636 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f7765fb67b1a3c73b7c283b9dfa0b7bcbe86aae76ab72fbdc7fa1f4b30f620a" Nov 21 12:42:38 crc kubenswrapper[4769]: I1121 12:42:38.300245 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-f7grx" Nov 21 12:42:44 crc kubenswrapper[4769]: I1121 12:42:44.275251 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:42:44 crc kubenswrapper[4769]: E1121 12:42:44.277592 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.493988 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:42:51 crc kubenswrapper[4769]: E1121 12:42:51.494866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df634252-d877-48c1-a1fa-6bf8fe5ce68f" containerName="storage" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.494879 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df634252-d877-48c1-a1fa-6bf8fe5ce68f" containerName="storage" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.495023 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df634252-d877-48c1-a1fa-6bf8fe5ce68f" containerName="storage" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.495807 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.498588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.499236 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.500676 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.500820 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.500758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.500773 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-62s8c" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.502290 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.523004 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.661692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpwd8\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-kube-api-access-hpwd8\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.662163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.662566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.662745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-pod-info\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.662964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-server-conf\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.663274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.663512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.663772 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.664018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.664306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.664879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hpwd8\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-kube-api-access-hpwd8\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766232 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-pod-info\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-server-conf\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.766811 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.769157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.769682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-server-conf\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.770424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.770524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.770613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.780768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.784172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-pod-info\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.782391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.793270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.795649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpwd8\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-kube-api-access-hpwd8\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.799701 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-server-0\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.820822 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.879323 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.881892 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.892988 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-7vp9f" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.893352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.893468 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.893586 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.893763 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.893899 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.894072 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.943023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.970432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.970597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.970787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.970932 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8ba57a49-8363-41c4-b411-40dcff3a84b1-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.970959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.971095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.971211 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.971368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.971410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8ba57a49-8363-41c4-b411-40dcff3a84b1-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.971439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsz4m\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-kube-api-access-qsz4m\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:51 crc kubenswrapper[4769]: I1121 12:42:51.971498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072742 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8ba57a49-8363-41c4-b411-40dcff3a84b1-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.072976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.073007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.073024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8ba57a49-8363-41c4-b411-40dcff3a84b1-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.073040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qsz4m\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-kube-api-access-qsz4m\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.074231 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.074827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.075416 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.080619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.081112 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.081378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.081624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.086007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.090473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8ba57a49-8363-41c4-b411-40dcff3a84b1-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.096505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8ba57a49-8363-41c4-b411-40dcff3a84b1-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.127073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsz4m\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-kube-api-access-qsz4m\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.141678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.244311 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.515253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:42:52 crc kubenswrapper[4769]: W1121 12:42:52.519245 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba57a49_8363_41c4_b411_40dcff3a84b1.slice/crio-ee3a4786812ba8321b30f308b4116b4cd01181a8911e2554142f4d33e000ca67 WatchSource:0}: Error finding container ee3a4786812ba8321b30f308b4116b4cd01181a8911e2554142f4d33e000ca67: Status 404 returned error can't find the container with id ee3a4786812ba8321b30f308b4116b4cd01181a8911e2554142f4d33e000ca67 Nov 21 12:42:52 crc kubenswrapper[4769]: I1121 12:42:52.519913 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:42:52 crc kubenswrapper[4769]: W1121 12:42:52.522393 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358ea7e8_fdf4_4096_948a_a1cd27a5a1c1.slice/crio-8a07a270af6269beb668fef549193e3e1de3a0b20c393e69067bf93c7b1971bb WatchSource:0}: Error finding container 8a07a270af6269beb668fef549193e3e1de3a0b20c393e69067bf93c7b1971bb: Status 404 returned error can't find the container with id 8a07a270af6269beb668fef549193e3e1de3a0b20c393e69067bf93c7b1971bb Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.039696 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.041932 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.052681 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-pddct" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.053598 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.055423 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.055662 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.069043 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.069925 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.195642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.195758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.195846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.195925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-default\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.196142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.196242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.196300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdjv\" (UniqueName: \"kubernetes.io/projected/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kube-api-access-jbdjv\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.196445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kolla-config\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.298576 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kolla-config\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.299275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.299532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.299668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kolla-config\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.299832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.299900 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.300040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-default\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.300320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.300392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.300464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdjv\" (UniqueName: \"kubernetes.io/projected/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kube-api-access-jbdjv\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.301023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-default\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.301031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.302624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.309012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.310645 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.333928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdjv\" (UniqueName: \"kubernetes.io/projected/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kube-api-access-jbdjv\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.359427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-0\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.376313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.496967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8ba57a49-8363-41c4-b411-40dcff3a84b1","Type":"ContainerStarted","Data":"ee3a4786812ba8321b30f308b4116b4cd01181a8911e2554142f4d33e000ca67"} Nov 21 12:42:53 crc kubenswrapper[4769]: I1121 12:42:53.502259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1","Type":"ContainerStarted","Data":"8a07a270af6269beb668fef549193e3e1de3a0b20c393e69067bf93c7b1971bb"} Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.347500 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.517544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3c0de7b0-5c27-4052-a219-6b701aef6f6b","Type":"ContainerStarted","Data":"893543fb9397f7c8039d65073fc4d295c12ad4aed37f38dd1ee34199344fd5d9"} Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.560940 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.562917 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.566950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-8njcx" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.567122 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.567232 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.567437 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.589611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/82907629-360d-4481-86ed-2d4abb75ecff-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6mr\" (UniqueName: \"kubernetes.io/projected/82907629-360d-4481-86ed-2d4abb75ecff-kube-api-access-qb6mr\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.634859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.663239 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.664798 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.669180 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.669906 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.678885 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-rm7wb" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.693167 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/82907629-360d-4481-86ed-2d4abb75ecff-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-memcached-tls-certs\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6mr\" (UniqueName: \"kubernetes.io/projected/82907629-360d-4481-86ed-2d4abb75ecff-kube-api-access-qb6mr\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kolla-config\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-combined-ca-bundle\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmbn\" (UniqueName: \"kubernetes.io/projected/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kube-api-access-vtmbn\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736881 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-config-data\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.736946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.737811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.738449 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/82907629-360d-4481-86ed-2d4abb75ecff-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.739062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.739779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.740094 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.742896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.752356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6mr\" (UniqueName: \"kubernetes.io/projected/82907629-360d-4481-86ed-2d4abb75ecff-kube-api-access-qb6mr\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.763499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.766674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-cell1-galera-0\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.839295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-config-data\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.839470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-memcached-tls-certs\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.839495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kolla-config\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.839522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-combined-ca-bundle\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.839553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmbn\" (UniqueName: \"kubernetes.io/projected/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kube-api-access-vtmbn\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.840540 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-config-data\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.840545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kolla-config\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.843276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-memcached-tls-certs\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.843704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-combined-ca-bundle\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.865620 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmbn\" (UniqueName: \"kubernetes.io/projected/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kube-api-access-vtmbn\") pod \"memcached-0\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.887961 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:42:54 crc kubenswrapper[4769]: I1121 12:42:54.993302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.408238 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:42:55 crc kubenswrapper[4769]: W1121 12:42:55.410638 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82907629_360d_4481_86ed_2d4abb75ecff.slice/crio-eb7610e7e43ab2f6f0bdddcb7be09abbf750c1f949cbb8ab78c552fd30a46858 WatchSource:0}: Error finding container eb7610e7e43ab2f6f0bdddcb7be09abbf750c1f949cbb8ab78c552fd30a46858: Status 404 returned error can't find the container with id eb7610e7e43ab2f6f0bdddcb7be09abbf750c1f949cbb8ab78c552fd30a46858 Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.485615 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.540965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1","Type":"ContainerStarted","Data":"c760f0f48028b4106e87bcbf2583e64106415ee45fde91f735003e4c387e69c4"} Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.542832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b5d4b44e-5548-4cdb-a2ac-6192fec95c43","Type":"ContainerStarted","Data":"4dfc22c7114dfd7da23c6ced5e0ebe212c8c2f3a1c07b0277596d8a97e52b155"} Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.544851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3c0de7b0-5c27-4052-a219-6b701aef6f6b","Type":"ContainerStarted","Data":"d8be63883a99d105d2afe48aedd8e3a1382da5e070922863f958ffd231e77e5f"} Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.546999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"82907629-360d-4481-86ed-2d4abb75ecff","Type":"ContainerStarted","Data":"eb7610e7e43ab2f6f0bdddcb7be09abbf750c1f949cbb8ab78c552fd30a46858"} Nov 21 12:42:55 crc kubenswrapper[4769]: I1121 12:42:55.548501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8ba57a49-8363-41c4-b411-40dcff3a84b1","Type":"ContainerStarted","Data":"caf338fde4549ca5d2634d4635bfd88cb3fe3d186dfb81862b83c38a8fee3534"} Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.475865 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.477134 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.481601 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-g7sbh" Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.487769 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.559723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"82907629-360d-4481-86ed-2d4abb75ecff","Type":"ContainerStarted","Data":"e1c859f43535ff073c9273dc7ee975073fc44454002d3fb2a962ffeb02322a6c"} Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.561854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b5d4b44e-5548-4cdb-a2ac-6192fec95c43","Type":"ContainerStarted","Data":"faac91ebebab06a02c43aae579e4b27c115b8f34801002ff38acd386b6bf5adf"} Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.574510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh62j\" (UniqueName: \"kubernetes.io/projected/344ee685-9247-4375-a3e4-03ec648356d5-kube-api-access-gh62j\") pod \"kube-state-metrics-0\" (UID: \"344ee685-9247-4375-a3e4-03ec648356d5\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.622001 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.621958438 podStartE2EDuration="2.621958438s" podCreationTimestamp="2025-11-21 12:42:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:42:56.617767874 +0000 UTC m=+3135.318429692" watchObservedRunningTime="2025-11-21 12:42:56.621958438 +0000 UTC m=+3135.322620276" Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.676540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gh62j\" (UniqueName: \"kubernetes.io/projected/344ee685-9247-4375-a3e4-03ec648356d5-kube-api-access-gh62j\") pod \"kube-state-metrics-0\" (UID: \"344ee685-9247-4375-a3e4-03ec648356d5\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.730484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh62j\" (UniqueName: \"kubernetes.io/projected/344ee685-9247-4375-a3e4-03ec648356d5-kube-api-access-gh62j\") pod \"kube-state-metrics-0\" (UID: \"344ee685-9247-4375-a3e4-03ec648356d5\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:42:56 crc kubenswrapper[4769]: I1121 12:42:56.851332 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:42:57 crc kubenswrapper[4769]: I1121 12:42:57.274959 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:42:57 crc kubenswrapper[4769]: E1121 12:42:57.275762 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:42:57 crc kubenswrapper[4769]: I1121 12:42:57.451158 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:42:57 crc kubenswrapper[4769]: W1121 12:42:57.457725 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod344ee685_9247_4375_a3e4_03ec648356d5.slice/crio-4205e7379854a3c822424cb8e83315e10396dc89d7253ea29cb4896c2abe3672 WatchSource:0}: Error finding container 4205e7379854a3c822424cb8e83315e10396dc89d7253ea29cb4896c2abe3672: Status 404 returned error can't find the container with id 4205e7379854a3c822424cb8e83315e10396dc89d7253ea29cb4896c2abe3672 Nov 21 12:42:57 crc kubenswrapper[4769]: I1121 12:42:57.578508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"344ee685-9247-4375-a3e4-03ec648356d5","Type":"ContainerStarted","Data":"4205e7379854a3c822424cb8e83315e10396dc89d7253ea29cb4896c2abe3672"} Nov 21 12:42:57 crc kubenswrapper[4769]: I1121 12:42:57.579613 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:42:58 crc kubenswrapper[4769]: I1121 12:42:58.612440 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerID="d8be63883a99d105d2afe48aedd8e3a1382da5e070922863f958ffd231e77e5f" exitCode=0 Nov 21 12:42:58 crc kubenswrapper[4769]: I1121 12:42:58.612559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3c0de7b0-5c27-4052-a219-6b701aef6f6b","Type":"ContainerDied","Data":"d8be63883a99d105d2afe48aedd8e3a1382da5e070922863f958ffd231e77e5f"} Nov 21 12:42:58 crc kubenswrapper[4769]: I1121 12:42:58.619863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"344ee685-9247-4375-a3e4-03ec648356d5","Type":"ContainerStarted","Data":"b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5"} Nov 21 12:42:58 crc kubenswrapper[4769]: I1121 12:42:58.669277 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.231657237 podStartE2EDuration="2.669245654s" podCreationTimestamp="2025-11-21 12:42:56 +0000 UTC" firstStartedPulling="2025-11-21 12:42:57.460750205 +0000 UTC m=+3136.161412023" lastFinishedPulling="2025-11-21 12:42:57.898338622 +0000 UTC m=+3136.599000440" observedRunningTime="2025-11-21 12:42:58.662545352 +0000 UTC m=+3137.363207190" watchObservedRunningTime="2025-11-21 12:42:58.669245654 +0000 UTC m=+3137.369907482" Nov 21 12:42:59 crc kubenswrapper[4769]: I1121 12:42:59.641555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3c0de7b0-5c27-4052-a219-6b701aef6f6b","Type":"ContainerStarted","Data":"c35464a3e65222fb30957342ae0556146a82822c4f11ec90d17fe91d69203acc"} Nov 21 12:42:59 crc kubenswrapper[4769]: I1121 12:42:59.643855 4769 generic.go:334] "Generic (PLEG): container finished" podID="82907629-360d-4481-86ed-2d4abb75ecff" containerID="e1c859f43535ff073c9273dc7ee975073fc44454002d3fb2a962ffeb02322a6c" exitCode=0 Nov 21 12:42:59 crc kubenswrapper[4769]: I1121 12:42:59.643938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"82907629-360d-4481-86ed-2d4abb75ecff","Type":"ContainerDied","Data":"e1c859f43535ff073c9273dc7ee975073fc44454002d3fb2a962ffeb02322a6c"} Nov 21 12:42:59 crc kubenswrapper[4769]: I1121 12:42:59.644070 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:42:59 crc kubenswrapper[4769]: I1121 12:42:59.684571 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.684549071 podStartE2EDuration="8.684549071s" podCreationTimestamp="2025-11-21 12:42:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:42:59.673457799 +0000 UTC m=+3138.374119627" watchObservedRunningTime="2025-11-21 12:42:59.684549071 +0000 UTC m=+3138.385210899" Nov 21 12:43:00 crc kubenswrapper[4769]: I1121 12:43:00.661877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"82907629-360d-4481-86ed-2d4abb75ecff","Type":"ContainerStarted","Data":"f8951fb0205b9b418476b216d36f63087f35f7d86fce2af42515b76e7151687c"} Nov 21 12:43:00 crc kubenswrapper[4769]: I1121 12:43:00.698774 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.698735827 podStartE2EDuration="7.698735827s" podCreationTimestamp="2025-11-21 12:42:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:00.696808305 +0000 UTC m=+3139.397470133" watchObservedRunningTime="2025-11-21 12:43:00.698735827 +0000 UTC m=+3139.399397685" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.298510 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.300553 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.303740 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.304557 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-wx85m" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.305151 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.305946 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.307603 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.307813 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.370850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.370946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.371065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.371128 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.371534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.371603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-config\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.371650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.371965 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jq9\" (UniqueName: \"kubernetes.io/projected/7648f0d3-f29e-4add-8c77-b245d309acfb-kube-api-access-q7jq9\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.474408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jq9\" (UniqueName: \"kubernetes.io/projected/7648f0d3-f29e-4add-8c77-b245d309acfb-kube-api-access-q7jq9\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.474558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.474709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.474761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.474816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.474966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.475032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-config\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.475078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.475167 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.475645 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.476905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-config\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.476989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.485250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.486923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.490557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.504996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jq9\" (UniqueName: \"kubernetes.io/projected/7648f0d3-f29e-4add-8c77-b245d309acfb-kube-api-access-q7jq9\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.532519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:01 crc kubenswrapper[4769]: I1121 12:43:01.627559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:02 crc kubenswrapper[4769]: W1121 12:43:02.173401 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7648f0d3_f29e_4add_8c77_b245d309acfb.slice/crio-3f1cc8f8795163051aa242bc238104284e259fbbd981d8ec2a8974b8525d4817 WatchSource:0}: Error finding container 3f1cc8f8795163051aa242bc238104284e259fbbd981d8ec2a8974b8525d4817: Status 404 returned error can't find the container with id 3f1cc8f8795163051aa242bc238104284e259fbbd981d8ec2a8974b8525d4817 Nov 21 12:43:02 crc kubenswrapper[4769]: I1121 12:43:02.173478 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:43:02 crc kubenswrapper[4769]: I1121 12:43:02.689271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7648f0d3-f29e-4add-8c77-b245d309acfb","Type":"ContainerStarted","Data":"d06659096c9419a370874ec900e948f82869a0846513d931db41a01bc043a1e1"} Nov 21 12:43:02 crc kubenswrapper[4769]: I1121 12:43:02.689808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7648f0d3-f29e-4add-8c77-b245d309acfb","Type":"ContainerStarted","Data":"3f1cc8f8795163051aa242bc238104284e259fbbd981d8ec2a8974b8525d4817"} Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.377441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.377879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.512438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.549881 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.551293 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.553529 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.553871 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.562097 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-2tv84" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.562328 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.568806 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.621226 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.621534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-config\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.621777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.621850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.622110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.622303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.622403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrp5\" (UniqueName: \"kubernetes.io/projected/80b2eb72-37b4-4511-975a-2434e80375e9-kube-api-access-bxrp5\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.622954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.704303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7648f0d3-f29e-4add-8c77-b245d309acfb","Type":"ContainerStarted","Data":"13c24a98bc571e8e1ca4c437716301b6c19f9a64c5b50b0c56b0b27509c3ef2c"} Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrp5\" (UniqueName: \"kubernetes.io/projected/80b2eb72-37b4-4511-975a-2434e80375e9-kube-api-access-bxrp5\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-config\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.725897 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.726655 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-config\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.727949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.729849 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.736039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.740150 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.7401304140000002 podStartE2EDuration="3.740130414s" podCreationTimestamp="2025-11-21 12:43:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:03.734526061 +0000 UTC m=+3142.435187889" watchObservedRunningTime="2025-11-21 12:43:03.740130414 +0000 UTC m=+3142.440792232" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.750804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.752008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.764825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrp5\" (UniqueName: \"kubernetes.io/projected/80b2eb72-37b4-4511-975a-2434e80375e9-kube-api-access-bxrp5\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.772557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"ovsdbserver-sb-0\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.837827 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:43:03 crc kubenswrapper[4769]: I1121 12:43:03.889167 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.356732 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:43:04 crc kubenswrapper[4769]: W1121 12:43:04.367902 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80b2eb72_37b4_4511_975a_2434e80375e9.slice/crio-eb805fc57467c9249bb4dec8c48f0cc5f3f70f1dab5d498df5def196a7a99760 WatchSource:0}: Error finding container eb805fc57467c9249bb4dec8c48f0cc5f3f70f1dab5d498df5def196a7a99760: Status 404 returned error can't find the container with id eb805fc57467c9249bb4dec8c48f0cc5f3f70f1dab5d498df5def196a7a99760 Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.628529 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.737327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"80b2eb72-37b4-4511-975a-2434e80375e9","Type":"ContainerStarted","Data":"dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189"} Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.737369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"80b2eb72-37b4-4511-975a-2434e80375e9","Type":"ContainerStarted","Data":"eb805fc57467c9249bb4dec8c48f0cc5f3f70f1dab5d498df5def196a7a99760"} Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.888242 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.888330 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.900901 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-5x87d"] Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.903620 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.908422 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-5x87d"] Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.983890 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6868-account-create-57vth"] Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.985711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.988054 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.992403 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6868-account-create-57vth"] Nov 21 12:43:04 crc kubenswrapper[4769]: I1121 12:43:04.996233 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.049268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l5zm\" (UniqueName: \"kubernetes.io/projected/67e089d3-3e07-433d-a340-4993df686804-kube-api-access-6l5zm\") pod \"placement-db-create-5x87d\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.049490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67e089d3-3e07-433d-a340-4993df686804-operator-scripts\") pod \"placement-db-create-5x87d\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.150936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bdfbdb07-6216-47fa-8e9c-519412e753ba-operator-scripts\") pod \"placement-6868-account-create-57vth\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.150995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67e089d3-3e07-433d-a340-4993df686804-operator-scripts\") pod \"placement-db-create-5x87d\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.151041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rqm\" (UniqueName: \"kubernetes.io/projected/bdfbdb07-6216-47fa-8e9c-519412e753ba-kube-api-access-c7rqm\") pod \"placement-6868-account-create-57vth\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.151070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6l5zm\" (UniqueName: \"kubernetes.io/projected/67e089d3-3e07-433d-a340-4993df686804-kube-api-access-6l5zm\") pod \"placement-db-create-5x87d\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.152615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67e089d3-3e07-433d-a340-4993df686804-operator-scripts\") pod \"placement-db-create-5x87d\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.172252 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-b456h"] Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.173566 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.173707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l5zm\" (UniqueName: \"kubernetes.io/projected/67e089d3-3e07-433d-a340-4993df686804-kube-api-access-6l5zm\") pod \"placement-db-create-5x87d\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.181381 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-b456h"] Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.252912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bdfbdb07-6216-47fa-8e9c-519412e753ba-operator-scripts\") pod \"placement-6868-account-create-57vth\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.253028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rqm\" (UniqueName: \"kubernetes.io/projected/bdfbdb07-6216-47fa-8e9c-519412e753ba-kube-api-access-c7rqm\") pod \"placement-6868-account-create-57vth\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.253096 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c67d2\" (UniqueName: \"kubernetes.io/projected/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-kube-api-access-c67d2\") pod \"glance-db-create-b456h\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.253134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-operator-scripts\") pod \"glance-db-create-b456h\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.254506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bdfbdb07-6216-47fa-8e9c-519412e753ba-operator-scripts\") pod \"placement-6868-account-create-57vth\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.255704 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.278135 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rqm\" (UniqueName: \"kubernetes.io/projected/bdfbdb07-6216-47fa-8e9c-519412e753ba-kube-api-access-c7rqm\") pod \"placement-6868-account-create-57vth\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.286739 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-ca0f-account-create-wnwl7"] Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.288568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.290838 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.300245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ca0f-account-create-wnwl7"] Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.309741 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.355724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c67d2\" (UniqueName: \"kubernetes.io/projected/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-kube-api-access-c67d2\") pod \"glance-db-create-b456h\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.355785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-operator-scripts\") pod \"glance-db-create-b456h\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.357885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-operator-scripts\") pod \"glance-db-create-b456h\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.374886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c67d2\" (UniqueName: \"kubernetes.io/projected/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-kube-api-access-c67d2\") pod \"glance-db-create-b456h\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.458728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b997h\" (UniqueName: \"kubernetes.io/projected/707a6d3f-07b8-465a-b696-e49dcff1eacb-kube-api-access-b997h\") pod \"glance-ca0f-account-create-wnwl7\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.458849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/707a6d3f-07b8-465a-b696-e49dcff1eacb-operator-scripts\") pod \"glance-ca0f-account-create-wnwl7\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.530614 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.560664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b997h\" (UniqueName: \"kubernetes.io/projected/707a6d3f-07b8-465a-b696-e49dcff1eacb-kube-api-access-b997h\") pod \"glance-ca0f-account-create-wnwl7\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.561306 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/707a6d3f-07b8-465a-b696-e49dcff1eacb-operator-scripts\") pod \"glance-ca0f-account-create-wnwl7\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.562285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/707a6d3f-07b8-465a-b696-e49dcff1eacb-operator-scripts\") pod \"glance-ca0f-account-create-wnwl7\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.586313 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b997h\" (UniqueName: \"kubernetes.io/projected/707a6d3f-07b8-465a-b696-e49dcff1eacb-kube-api-access-b997h\") pod \"glance-ca0f-account-create-wnwl7\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.709930 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.734471 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-5x87d"] Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.764170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"80b2eb72-37b4-4511-975a-2434e80375e9","Type":"ContainerStarted","Data":"38ad069447ecdb6e7a4a1186e4b5dcce107d38add2358a2e635e60c7ebce8983"} Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.835763 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.835745804 podStartE2EDuration="3.835745804s" podCreationTimestamp="2025-11-21 12:43:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:05.789971539 +0000 UTC m=+3144.490633357" watchObservedRunningTime="2025-11-21 12:43:05.835745804 +0000 UTC m=+3144.536407622" Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.838712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6868-account-create-57vth"] Nov 21 12:43:05 crc kubenswrapper[4769]: I1121 12:43:05.978888 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-b456h"] Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.268353 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ca0f-account-create-wnwl7"] Nov 21 12:43:06 crc kubenswrapper[4769]: W1121 12:43:06.268964 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod707a6d3f_07b8_465a_b696_e49dcff1eacb.slice/crio-7dd2375230a618b6fb98e7c3c5fb5c1d52da8e3d980366e246256fd13eeb9d32 WatchSource:0}: Error finding container 7dd2375230a618b6fb98e7c3c5fb5c1d52da8e3d980366e246256fd13eeb9d32: Status 404 returned error can't find the container with id 7dd2375230a618b6fb98e7c3c5fb5c1d52da8e3d980366e246256fd13eeb9d32 Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.628036 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.780356 4769 generic.go:334] "Generic (PLEG): container finished" podID="bdfbdb07-6216-47fa-8e9c-519412e753ba" containerID="22283d06532a60bf3192759a09303eb14c11548e179042b0bf37efbda9965d43" exitCode=0 Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.780472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" event={"ID":"bdfbdb07-6216-47fa-8e9c-519412e753ba","Type":"ContainerDied","Data":"22283d06532a60bf3192759a09303eb14c11548e179042b0bf37efbda9965d43"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.780526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" event={"ID":"bdfbdb07-6216-47fa-8e9c-519412e753ba","Type":"ContainerStarted","Data":"321ec287bb098f2e4589dd440362df7e94a21fd89bee43cae2a60e0bb9a997d6"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.786577 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7c1f761-7503-4d0a-a2f9-7cf5d310127c" containerID="8a6c782c8c9308763a2ca97391df3a06e759c659ee02c3a1ee35190a53b5305a" exitCode=0 Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.786641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-b456h" event={"ID":"d7c1f761-7503-4d0a-a2f9-7cf5d310127c","Type":"ContainerDied","Data":"8a6c782c8c9308763a2ca97391df3a06e759c659ee02c3a1ee35190a53b5305a"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.786669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-b456h" event={"ID":"d7c1f761-7503-4d0a-a2f9-7cf5d310127c","Type":"ContainerStarted","Data":"e7599cb46ffa5fde84aca7a833c783c812a0c772d9116df17b6de187d450b936"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.788958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" event={"ID":"707a6d3f-07b8-465a-b696-e49dcff1eacb","Type":"ContainerStarted","Data":"916ddc04eb1228ad66207276c99ebb958f7377894f78ba9d2cf13dec82caf3b5"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.788986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" event={"ID":"707a6d3f-07b8-465a-b696-e49dcff1eacb","Type":"ContainerStarted","Data":"7dd2375230a618b6fb98e7c3c5fb5c1d52da8e3d980366e246256fd13eeb9d32"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.790997 4769 generic.go:334] "Generic (PLEG): container finished" podID="67e089d3-3e07-433d-a340-4993df686804" containerID="4c4c827743b73c36aa8f9ec91e3bb20a9ed1a2bf4193cdedd6e8368f99a8f068" exitCode=0 Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.791603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-5x87d" event={"ID":"67e089d3-3e07-433d-a340-4993df686804","Type":"ContainerDied","Data":"4c4c827743b73c36aa8f9ec91e3bb20a9ed1a2bf4193cdedd6e8368f99a8f068"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.791630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-5x87d" event={"ID":"67e089d3-3e07-433d-a340-4993df686804","Type":"ContainerStarted","Data":"d9c826ae0753784d53273623bfb97f9311aac73d518a1ca583ed8b771034784c"} Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.841996 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" podStartSLOduration=1.8419798840000001 podStartE2EDuration="1.841979884s" podCreationTimestamp="2025-11-21 12:43:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:06.835134378 +0000 UTC m=+3145.535796196" watchObservedRunningTime="2025-11-21 12:43:06.841979884 +0000 UTC m=+3145.542641702" Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.855731 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:43:06 crc kubenswrapper[4769]: I1121 12:43:06.896653 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.187810 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.303988 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.681014 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.804384 4769 generic.go:334] "Generic (PLEG): container finished" podID="707a6d3f-07b8-465a-b696-e49dcff1eacb" containerID="916ddc04eb1228ad66207276c99ebb958f7377894f78ba9d2cf13dec82caf3b5" exitCode=0 Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.804506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" event={"ID":"707a6d3f-07b8-465a-b696-e49dcff1eacb","Type":"ContainerDied","Data":"916ddc04eb1228ad66207276c99ebb958f7377894f78ba9d2cf13dec82caf3b5"} Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.808670 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.818020 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.821633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-wzrg2" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.832672 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.833028 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.833334 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.838678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.885896 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.923088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.923168 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tkm\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-kube-api-access-84tkm\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.923351 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-lock\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.923420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:07 crc kubenswrapper[4769]: I1121 12:43:07.923532 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-cache\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.025103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.025167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-84tkm\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-kube-api-access-84tkm\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.025228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-lock\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.025280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.025383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-cache\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: E1121 12:43:08.025606 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:43:08 crc kubenswrapper[4769]: E1121 12:43:08.025626 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:43:08 crc kubenswrapper[4769]: E1121 12:43:08.025687 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift podName:6948baaa-5e35-43d5-a742-7b6c9b6e80d3 nodeName:}" failed. No retries permitted until 2025-11-21 12:43:08.525664949 +0000 UTC m=+3147.226326767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift") pod "swift-storage-0" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3") : configmap "swift-ring-files" not found Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.026343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-cache\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.026480 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.026745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-lock\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.046471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tkm\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-kube-api-access-84tkm\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.054380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.326330 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.413293 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.418395 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.432554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l5zm\" (UniqueName: \"kubernetes.io/projected/67e089d3-3e07-433d-a340-4993df686804-kube-api-access-6l5zm\") pod \"67e089d3-3e07-433d-a340-4993df686804\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.432749 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67e089d3-3e07-433d-a340-4993df686804-operator-scripts\") pod \"67e089d3-3e07-433d-a340-4993df686804\" (UID: \"67e089d3-3e07-433d-a340-4993df686804\") " Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.433456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e089d3-3e07-433d-a340-4993df686804-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "67e089d3-3e07-433d-a340-4993df686804" (UID: "67e089d3-3e07-433d-a340-4993df686804"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.491329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e089d3-3e07-433d-a340-4993df686804-kube-api-access-6l5zm" (OuterVolumeSpecName: "kube-api-access-6l5zm") pod "67e089d3-3e07-433d-a340-4993df686804" (UID: "67e089d3-3e07-433d-a340-4993df686804"). InnerVolumeSpecName "kube-api-access-6l5zm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.534804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bdfbdb07-6216-47fa-8e9c-519412e753ba-operator-scripts\") pod \"bdfbdb07-6216-47fa-8e9c-519412e753ba\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.534986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c67d2\" (UniqueName: \"kubernetes.io/projected/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-kube-api-access-c67d2\") pod \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7rqm\" (UniqueName: \"kubernetes.io/projected/bdfbdb07-6216-47fa-8e9c-519412e753ba-kube-api-access-c7rqm\") pod \"bdfbdb07-6216-47fa-8e9c-519412e753ba\" (UID: \"bdfbdb07-6216-47fa-8e9c-519412e753ba\") " Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-operator-scripts\") pod \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\" (UID: \"d7c1f761-7503-4d0a-a2f9-7cf5d310127c\") " Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdfbdb07-6216-47fa-8e9c-519412e753ba-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bdfbdb07-6216-47fa-8e9c-519412e753ba" (UID: "bdfbdb07-6216-47fa-8e9c-519412e753ba"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535711 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bdfbdb07-6216-47fa-8e9c-519412e753ba-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535729 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/67e089d3-3e07-433d-a340-4993df686804-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535740 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6l5zm\" (UniqueName: \"kubernetes.io/projected/67e089d3-3e07-433d-a340-4993df686804-kube-api-access-6l5zm\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.535836 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d7c1f761-7503-4d0a-a2f9-7cf5d310127c" (UID: "d7c1f761-7503-4d0a-a2f9-7cf5d310127c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:08 crc kubenswrapper[4769]: E1121 12:43:08.535868 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:43:08 crc kubenswrapper[4769]: E1121 12:43:08.535884 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:43:08 crc kubenswrapper[4769]: E1121 12:43:08.535944 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift podName:6948baaa-5e35-43d5-a742-7b6c9b6e80d3 nodeName:}" failed. No retries permitted until 2025-11-21 12:43:09.535923862 +0000 UTC m=+3148.236585680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift") pod "swift-storage-0" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3") : configmap "swift-ring-files" not found Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.539272 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdfbdb07-6216-47fa-8e9c-519412e753ba-kube-api-access-c7rqm" (OuterVolumeSpecName: "kube-api-access-c7rqm") pod "bdfbdb07-6216-47fa-8e9c-519412e753ba" (UID: "bdfbdb07-6216-47fa-8e9c-519412e753ba"). InnerVolumeSpecName "kube-api-access-c7rqm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.539338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-kube-api-access-c67d2" (OuterVolumeSpecName: "kube-api-access-c67d2") pod "d7c1f761-7503-4d0a-a2f9-7cf5d310127c" (UID: "d7c1f761-7503-4d0a-a2f9-7cf5d310127c"). InnerVolumeSpecName "kube-api-access-c67d2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.638437 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c7rqm\" (UniqueName: \"kubernetes.io/projected/bdfbdb07-6216-47fa-8e9c-519412e753ba-kube-api-access-c7rqm\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.638494 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.638510 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c67d2\" (UniqueName: \"kubernetes.io/projected/d7c1f761-7503-4d0a-a2f9-7cf5d310127c-kube-api-access-c67d2\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.822155 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.824652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6868-account-create-57vth" event={"ID":"bdfbdb07-6216-47fa-8e9c-519412e753ba","Type":"ContainerDied","Data":"321ec287bb098f2e4589dd440362df7e94a21fd89bee43cae2a60e0bb9a997d6"} Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.824724 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="321ec287bb098f2e4589dd440362df7e94a21fd89bee43cae2a60e0bb9a997d6" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.829830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-b456h" event={"ID":"d7c1f761-7503-4d0a-a2f9-7cf5d310127c","Type":"ContainerDied","Data":"e7599cb46ffa5fde84aca7a833c783c812a0c772d9116df17b6de187d450b936"} Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.829861 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7599cb46ffa5fde84aca7a833c783c812a0c772d9116df17b6de187d450b936" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.830260 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-b456h" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.835376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-5x87d" event={"ID":"67e089d3-3e07-433d-a340-4993df686804","Type":"ContainerDied","Data":"d9c826ae0753784d53273623bfb97f9311aac73d518a1ca583ed8b771034784c"} Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.835564 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-5x87d" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.835662 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9c826ae0753784d53273623bfb97f9311aac73d518a1ca583ed8b771034784c" Nov 21 12:43:08 crc kubenswrapper[4769]: I1121 12:43:08.896344 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.293809 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.470408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/707a6d3f-07b8-465a-b696-e49dcff1eacb-operator-scripts\") pod \"707a6d3f-07b8-465a-b696-e49dcff1eacb\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.470579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b997h\" (UniqueName: \"kubernetes.io/projected/707a6d3f-07b8-465a-b696-e49dcff1eacb-kube-api-access-b997h\") pod \"707a6d3f-07b8-465a-b696-e49dcff1eacb\" (UID: \"707a6d3f-07b8-465a-b696-e49dcff1eacb\") " Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.477048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707a6d3f-07b8-465a-b696-e49dcff1eacb-kube-api-access-b997h" (OuterVolumeSpecName: "kube-api-access-b997h") pod "707a6d3f-07b8-465a-b696-e49dcff1eacb" (UID: "707a6d3f-07b8-465a-b696-e49dcff1eacb"). InnerVolumeSpecName "kube-api-access-b997h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.477090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707a6d3f-07b8-465a-b696-e49dcff1eacb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "707a6d3f-07b8-465a-b696-e49dcff1eacb" (UID: "707a6d3f-07b8-465a-b696-e49dcff1eacb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.573520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.573751 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/707a6d3f-07b8-465a-b696-e49dcff1eacb-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.573777 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b997h\" (UniqueName: \"kubernetes.io/projected/707a6d3f-07b8-465a-b696-e49dcff1eacb-kube-api-access-b997h\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:09 crc kubenswrapper[4769]: E1121 12:43:09.573847 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:43:09 crc kubenswrapper[4769]: E1121 12:43:09.573903 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:43:09 crc kubenswrapper[4769]: E1121 12:43:09.574008 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift podName:6948baaa-5e35-43d5-a742-7b6c9b6e80d3 nodeName:}" failed. No retries permitted until 2025-11-21 12:43:11.573971287 +0000 UTC m=+3150.274633315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift") pod "swift-storage-0" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3") : configmap "swift-ring-files" not found Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.847904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" event={"ID":"707a6d3f-07b8-465a-b696-e49dcff1eacb","Type":"ContainerDied","Data":"7dd2375230a618b6fb98e7c3c5fb5c1d52da8e3d980366e246256fd13eeb9d32"} Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.847947 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd2375230a618b6fb98e7c3c5fb5c1d52da8e3d980366e246256fd13eeb9d32" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.847991 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ca0f-account-create-wnwl7" Nov 21 12:43:09 crc kubenswrapper[4769]: I1121 12:43:09.959380 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.071429 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.213526 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:43:10 crc kubenswrapper[4769]: E1121 12:43:10.213865 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdfbdb07-6216-47fa-8e9c-519412e753ba" containerName="mariadb-account-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.213881 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdfbdb07-6216-47fa-8e9c-519412e753ba" containerName="mariadb-account-create" Nov 21 12:43:10 crc kubenswrapper[4769]: E1121 12:43:10.213898 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="67e089d3-3e07-433d-a340-4993df686804" containerName="mariadb-database-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.213905 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e089d3-3e07-433d-a340-4993df686804" containerName="mariadb-database-create" Nov 21 12:43:10 crc kubenswrapper[4769]: E1121 12:43:10.213912 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7c1f761-7503-4d0a-a2f9-7cf5d310127c" containerName="mariadb-database-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.213919 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c1f761-7503-4d0a-a2f9-7cf5d310127c" containerName="mariadb-database-create" Nov 21 12:43:10 crc kubenswrapper[4769]: E1121 12:43:10.213947 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="707a6d3f-07b8-465a-b696-e49dcff1eacb" containerName="mariadb-account-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.213954 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="707a6d3f-07b8-465a-b696-e49dcff1eacb" containerName="mariadb-account-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.214092 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="67e089d3-3e07-433d-a340-4993df686804" containerName="mariadb-database-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.214109 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d7c1f761-7503-4d0a-a2f9-7cf5d310127c" containerName="mariadb-database-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.214116 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdfbdb07-6216-47fa-8e9c-519412e753ba" containerName="mariadb-account-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.214128 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="707a6d3f-07b8-465a-b696-e49dcff1eacb" containerName="mariadb-account-create" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.214908 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.218470 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.219477 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.221038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-z28dk" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.221463 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.230582 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286288 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxknl\" (UniqueName: \"kubernetes.io/projected/10edbd41-2f31-466a-94be-9b0d3bf334d8-kube-api-access-jxknl\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-scripts\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-config\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.286672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-scripts\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-config\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.389916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jxknl\" (UniqueName: \"kubernetes.io/projected/10edbd41-2f31-466a-94be-9b0d3bf334d8-kube-api-access-jxknl\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.390573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-scripts\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.390968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.392563 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-config\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.398766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.399277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.400046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.418276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxknl\" (UniqueName: \"kubernetes.io/projected/10edbd41-2f31-466a-94be-9b0d3bf334d8-kube-api-access-jxknl\") pod \"ovn-northd-0\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.519445 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-n9wnv"] Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.521507 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.524118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-5zhpj" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.524247 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.531668 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-n9wnv"] Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.535757 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.594335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-combined-ca-bundle\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.594979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-db-sync-config-data\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.595097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjm94\" (UniqueName: \"kubernetes.io/projected/494df0d7-41ee-40f2-9711-ad9f06bca57a-kube-api-access-cjm94\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.595336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-config-data\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.696904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-db-sync-config-data\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.697028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cjm94\" (UniqueName: \"kubernetes.io/projected/494df0d7-41ee-40f2-9711-ad9f06bca57a-kube-api-access-cjm94\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.697085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-config-data\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.697139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-combined-ca-bundle\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.705797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-db-sync-config-data\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.707815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-config-data\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.710371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-combined-ca-bundle\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.718300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjm94\" (UniqueName: \"kubernetes.io/projected/494df0d7-41ee-40f2-9711-ad9f06bca57a-kube-api-access-cjm94\") pod \"glance-db-sync-n9wnv\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:10 crc kubenswrapper[4769]: I1121 12:43:10.847363 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.085028 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:43:11 crc kubenswrapper[4769]: W1121 12:43:11.089679 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10edbd41_2f31_466a_94be_9b0d3bf334d8.slice/crio-78e07d4864fb39bffde9c620ad80c58da519370331e54e5bf48fc399d52a2fb1 WatchSource:0}: Error finding container 78e07d4864fb39bffde9c620ad80c58da519370331e54e5bf48fc399d52a2fb1: Status 404 returned error can't find the container with id 78e07d4864fb39bffde9c620ad80c58da519370331e54e5bf48fc399d52a2fb1 Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.276874 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:43:11 crc kubenswrapper[4769]: E1121 12:43:11.278462 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.400142 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-n9wnv"] Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.622278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:11 crc kubenswrapper[4769]: E1121 12:43:11.622637 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:43:11 crc kubenswrapper[4769]: E1121 12:43:11.622661 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:43:11 crc kubenswrapper[4769]: E1121 12:43:11.622755 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift podName:6948baaa-5e35-43d5-a742-7b6c9b6e80d3 nodeName:}" failed. No retries permitted until 2025-11-21 12:43:15.622730195 +0000 UTC m=+3154.323392013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift") pod "swift-storage-0" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3") : configmap "swift-ring-files" not found Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.641804 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-5q2l2"] Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.643958 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.646968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.647908 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.653117 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.661825 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-5q2l2"] Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.710492 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-87crh"] Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.711814 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.726994 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-combined-ca-bundle\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.728058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-ring-data-devices\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.728234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/dd057303-9664-4eb1-af3d-8e947dc70b5f-etc-swift\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.728334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-swiftconf\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.728443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-dispersionconf\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.728570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-scripts\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.728744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5p7\" (UniqueName: \"kubernetes.io/projected/dd057303-9664-4eb1-af3d-8e947dc70b5f-kube-api-access-2r5p7\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.737307 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-5q2l2"] Nov 21 12:43:11 crc kubenswrapper[4769]: E1121 12:43:11.738277 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-2r5p7 ring-data-devices scripts swiftconf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" podUID="dd057303-9664-4eb1-af3d-8e947dc70b5f" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.745138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-87crh"] Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.831177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9940ebf1-4095-4094-ac9c-65d923a749d3-etc-swift\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.831934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-ring-data-devices\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/dd057303-9664-4eb1-af3d-8e947dc70b5f-etc-swift\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832115 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-ring-data-devices\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-swiftconf\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-combined-ca-bundle\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-dispersionconf\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-scripts\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-scripts\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-swiftconf\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.832568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5p7\" (UniqueName: \"kubernetes.io/projected/dd057303-9664-4eb1-af3d-8e947dc70b5f-kube-api-access-2r5p7\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.833015 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-dispersionconf\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.833103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-combined-ca-bundle\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.833180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hssht\" (UniqueName: \"kubernetes.io/projected/9940ebf1-4095-4094-ac9c-65d923a749d3-kube-api-access-hssht\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.833765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/dd057303-9664-4eb1-af3d-8e947dc70b5f-etc-swift\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.834333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-ring-data-devices\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.834397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-scripts\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.844259 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-swiftconf\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.844485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-dispersionconf\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.850320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-combined-ca-bundle\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.853069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5p7\" (UniqueName: \"kubernetes.io/projected/dd057303-9664-4eb1-af3d-8e947dc70b5f-kube-api-access-2r5p7\") pod \"swift-ring-rebalance-5q2l2\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.888280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"10edbd41-2f31-466a-94be-9b0d3bf334d8","Type":"ContainerStarted","Data":"8d0ac4a600f17c5430fd4fd9c4f8de99d52a03fde923500cecb363fad63912dc"} Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.888342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"10edbd41-2f31-466a-94be-9b0d3bf334d8","Type":"ContainerStarted","Data":"e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57"} Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.888355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"10edbd41-2f31-466a-94be-9b0d3bf334d8","Type":"ContainerStarted","Data":"78e07d4864fb39bffde9c620ad80c58da519370331e54e5bf48fc399d52a2fb1"} Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.888374 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.890897 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.891140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" event={"ID":"494df0d7-41ee-40f2-9711-ad9f06bca57a","Type":"ContainerStarted","Data":"d908c6f65ba838e8e33f0c3eb3c9da88ad57b4372a618299d9226db4d62df584"} Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.928267 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-dispersionconf\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hssht\" (UniqueName: \"kubernetes.io/projected/9940ebf1-4095-4094-ac9c-65d923a749d3-kube-api-access-hssht\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9940ebf1-4095-4094-ac9c-65d923a749d3-etc-swift\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-ring-data-devices\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-combined-ca-bundle\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-scripts\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.935827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-swiftconf\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.936895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9940ebf1-4095-4094-ac9c-65d923a749d3-etc-swift\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.937308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-ring-data-devices\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.937918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-scripts\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.939747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-combined-ca-bundle\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.940080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-swiftconf\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.941296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-dispersionconf\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:11 crc kubenswrapper[4769]: I1121 12:43:11.954076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hssht\" (UniqueName: \"kubernetes.io/projected/9940ebf1-4095-4094-ac9c-65d923a749d3-kube-api-access-hssht\") pod \"swift-ring-rebalance-87crh\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.037769 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.038735 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-combined-ca-bundle\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.038811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-ring-data-devices\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.038881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-swiftconf\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.038969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-dispersionconf\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.039079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/dd057303-9664-4eb1-af3d-8e947dc70b5f-etc-swift\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.039160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r5p7\" (UniqueName: \"kubernetes.io/projected/dd057303-9664-4eb1-af3d-8e947dc70b5f-kube-api-access-2r5p7\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.039225 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-scripts\") pod \"dd057303-9664-4eb1-af3d-8e947dc70b5f\" (UID: \"dd057303-9664-4eb1-af3d-8e947dc70b5f\") " Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.040676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-scripts" (OuterVolumeSpecName: "scripts") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.041608 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd057303-9664-4eb1-af3d-8e947dc70b5f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.044047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.046779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.047050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.047638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.048643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd057303-9664-4eb1-af3d-8e947dc70b5f-kube-api-access-2r5p7" (OuterVolumeSpecName: "kube-api-access-2r5p7") pod "dd057303-9664-4eb1-af3d-8e947dc70b5f" (UID: "dd057303-9664-4eb1-af3d-8e947dc70b5f"). InnerVolumeSpecName "kube-api-access-2r5p7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141493 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141542 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141557 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141569 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/dd057303-9664-4eb1-af3d-8e947dc70b5f-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141585 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/dd057303-9664-4eb1-af3d-8e947dc70b5f-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141599 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2r5p7\" (UniqueName: \"kubernetes.io/projected/dd057303-9664-4eb1-af3d-8e947dc70b5f-kube-api-access-2r5p7\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.141618 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/dd057303-9664-4eb1-af3d-8e947dc70b5f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:12 crc kubenswrapper[4769]: W1121 12:43:12.574460 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9940ebf1_4095_4094_ac9c_65d923a749d3.slice/crio-58769c3fd5858c90fee793b4e1170918c0238c7543f72fd23ac9bb6f74afaac1 WatchSource:0}: Error finding container 58769c3fd5858c90fee793b4e1170918c0238c7543f72fd23ac9bb6f74afaac1: Status 404 returned error can't find the container with id 58769c3fd5858c90fee793b4e1170918c0238c7543f72fd23ac9bb6f74afaac1 Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.572759 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.572724125 podStartE2EDuration="2.572724125s" podCreationTimestamp="2025-11-21 12:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:11.915486524 +0000 UTC m=+3150.616148342" watchObservedRunningTime="2025-11-21 12:43:12.572724125 +0000 UTC m=+3151.273385973" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.586394 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-87crh"] Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.819347 4769 scope.go:117] "RemoveContainer" containerID="c17bb2554cbf3fd6babe7e25350d95b1942383f8f5a7f1609039517336cefe63" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.871529 4769 scope.go:117] "RemoveContainer" containerID="dab4ae7ecb4ebb3704d24abb60a8e223ac27f6bb8813d9b2533a4fd3320398aa" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.907814 4769 scope.go:117] "RemoveContainer" containerID="06f9b1eadf78537bacbf8b298bd6f6f093395ccee46990931528d0149a21a2b4" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.912793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" event={"ID":"494df0d7-41ee-40f2-9711-ad9f06bca57a","Type":"ContainerStarted","Data":"4ae0c0f2ff5a703a50b2f134e4a4b029f1ba19c4e539c1d91dba2775738e09f9"} Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.917561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" event={"ID":"9940ebf1-4095-4094-ac9c-65d923a749d3","Type":"ContainerStarted","Data":"b78ae03a726387fdf2735f3c92a89e864ec4d040b21582891aa8cea4abda187f"} Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.917655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" event={"ID":"9940ebf1-4095-4094-ac9c-65d923a749d3","Type":"ContainerStarted","Data":"58769c3fd5858c90fee793b4e1170918c0238c7543f72fd23ac9bb6f74afaac1"} Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.921180 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-5q2l2" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.953440 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" podStartSLOduration=2.9533994249999997 podStartE2EDuration="2.953399425s" podCreationTimestamp="2025-11-21 12:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:12.934898692 +0000 UTC m=+3151.635560510" watchObservedRunningTime="2025-11-21 12:43:12.953399425 +0000 UTC m=+3151.654061283" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.955640 4769 scope.go:117] "RemoveContainer" containerID="e2f5728603ef3abc644ca890bb85535e82af5f8824e9dbb4cfe2c838da5c46d3" Nov 21 12:43:12 crc kubenswrapper[4769]: I1121 12:43:12.979891 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" podStartSLOduration=1.979860155 podStartE2EDuration="1.979860155s" podCreationTimestamp="2025-11-21 12:43:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:12.970798238 +0000 UTC m=+3151.671460086" watchObservedRunningTime="2025-11-21 12:43:12.979860155 +0000 UTC m=+3151.680521983" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.021857 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-5q2l2"] Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.022605 4769 scope.go:117] "RemoveContainer" containerID="950d80f5cb32e4c3bac9d07ee3f3024af17387ff697395475e39c8d100b28a5e" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.031095 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-5q2l2"] Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.056034 4769 scope.go:117] "RemoveContainer" containerID="955fb3d7189dbb92109266c196b642fbb509c7dbafddc4d5f25d6673c61ae5ce" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.085864 4769 scope.go:117] "RemoveContainer" containerID="f991f55168305f20b720d822948dd591aea9434eebd32153073bcbdeec6a1ad3" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.116146 4769 scope.go:117] "RemoveContainer" containerID="07527c9e4bbd8815f0ed36c865193d26c2ff2f89fd68f2dcbe7a462788f52c21" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.142223 4769 scope.go:117] "RemoveContainer" containerID="0013a431b2fd10c3c0e4ab0b5f792aa7e0eda57bd0839be82acebeeea7d3e001" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.171272 4769 scope.go:117] "RemoveContainer" containerID="1a929f8fb5d24d5a7a5149b7c441b592b95ddcdc7c212c54f6ae7a0c3aab6b13" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.201074 4769 scope.go:117] "RemoveContainer" containerID="602cdde6651f0d5fae79b1a9ff1f46b1f98f08be3932bfb1407511a7056b31db" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.228768 4769 scope.go:117] "RemoveContainer" containerID="a9bec5a1fbb440b3cc63d47a3f753453d4ee93006f4a273dd0fc0c707e59ac2e" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.258690 4769 scope.go:117] "RemoveContainer" containerID="3d21c76716a4ab50a822fd89c312e9686e690eae47eccdc77b84a08ef3821d3f" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.296178 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd057303-9664-4eb1-af3d-8e947dc70b5f" path="/var/lib/kubelet/pods/dd057303-9664-4eb1-af3d-8e947dc70b5f/volumes" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.300263 4769 scope.go:117] "RemoveContainer" containerID="9bcbe61febdba83a142f04fbd4769b2beb6a4d45dc7f65e740df9de8d55fbc5f" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.328336 4769 scope.go:117] "RemoveContainer" containerID="8974426ba5f173a9bdb635ea46a7f86d822701c94efac257f629d7f2fefab38c" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.359520 4769 scope.go:117] "RemoveContainer" containerID="ed6a52ed0624a844cc4eb2f17b70d287931af713158e213efdeaaa4341f60cd8" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.397248 4769 scope.go:117] "RemoveContainer" containerID="a95af62796ca42c1c82ad99b10961e88bc256169ecc67408fea5dd94f3a6af17" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.472367 4769 scope.go:117] "RemoveContainer" containerID="d00de34ef000571bff5ddb77532cdc14e6b2cd1682f5129c6ce052026efc516d" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.505956 4769 scope.go:117] "RemoveContainer" containerID="9f3cb11d85ba3677048fa9f6fd982f9ed28f8da6fc359d60f2bb3dc72e0c490e" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.533574 4769 scope.go:117] "RemoveContainer" containerID="8e29089efd9ecbda9b63a2ab03bc931d406dc33cb22b729cab2783bd2fcb1d8f" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.557837 4769 scope.go:117] "RemoveContainer" containerID="4d0ffc8d8ad5241b15b57dc2bf33a2b5f7d8c272e960f82824e4f70f3613ff5a" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.592907 4769 scope.go:117] "RemoveContainer" containerID="842c3425e6c1bda6e162376b200e5c026aee943076a359b9c1b7c774adb4a477" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.619285 4769 scope.go:117] "RemoveContainer" containerID="7615323faca95a4a0caac0c8dd27f3f529b0c9116804cb6bb7565f8a154bf7b4" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.645657 4769 scope.go:117] "RemoveContainer" containerID="1136a521dba6c885093ffd7bcac2447e489032535d26084f29061d6ac0e0ab96" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.674714 4769 scope.go:117] "RemoveContainer" containerID="74e26fff634f34d7c7694b6e91f220f146baa5e135bb6a7466ed82ff803cf54f" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.698224 4769 scope.go:117] "RemoveContainer" containerID="d91f2b5aa00b4a0bb40a511eef51984d65607b6b0e7578970c9a341fd55e765a" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.719199 4769 scope.go:117] "RemoveContainer" containerID="a73163e55bef92d4580ade98aebe4c07ec6efcdd22f210e7248be7e68832dd42" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.747853 4769 scope.go:117] "RemoveContainer" containerID="a9fcee5b7051b3d501ea47cf8603d18936862cb52b4a6f069e5c2912878f7536" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.771402 4769 scope.go:117] "RemoveContainer" containerID="c572bc5f406e7ad8283eb6f8e1b6d7bdcf53fa68dc4b386c41e00bfb8d80b1fe" Nov 21 12:43:13 crc kubenswrapper[4769]: I1121 12:43:13.797926 4769 scope.go:117] "RemoveContainer" containerID="7d360957c8822f3fe69461bed081222da9aecb8b83ca4db8ecd0ceb413e0b155" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.569884 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-c48mb"] Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.571918 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.593352 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-c48mb"] Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.678878 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-2f46-account-create-czl2w"] Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.679925 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.682205 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.698132 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2f46-account-create-czl2w"] Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.710575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d8df2d2d-30ee-4db9-9417-8b754c24220a-operator-scripts\") pod \"keystone-db-create-c48mb\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.711033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8cb\" (UniqueName: \"kubernetes.io/projected/d8df2d2d-30ee-4db9-9417-8b754c24220a-kube-api-access-hl8cb\") pod \"keystone-db-create-c48mb\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.813724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rttcf\" (UniqueName: \"kubernetes.io/projected/faaf5643-f2f2-43d2-83e3-30016afe164e-kube-api-access-rttcf\") pod \"keystone-2f46-account-create-czl2w\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.813937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/faaf5643-f2f2-43d2-83e3-30016afe164e-operator-scripts\") pod \"keystone-2f46-account-create-czl2w\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.813977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d8df2d2d-30ee-4db9-9417-8b754c24220a-operator-scripts\") pod \"keystone-db-create-c48mb\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.814057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8cb\" (UniqueName: \"kubernetes.io/projected/d8df2d2d-30ee-4db9-9417-8b754c24220a-kube-api-access-hl8cb\") pod \"keystone-db-create-c48mb\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.815421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d8df2d2d-30ee-4db9-9417-8b754c24220a-operator-scripts\") pod \"keystone-db-create-c48mb\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.849034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8cb\" (UniqueName: \"kubernetes.io/projected/d8df2d2d-30ee-4db9-9417-8b754c24220a-kube-api-access-hl8cb\") pod \"keystone-db-create-c48mb\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.905766 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.916324 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/faaf5643-f2f2-43d2-83e3-30016afe164e-operator-scripts\") pod \"keystone-2f46-account-create-czl2w\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.916533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rttcf\" (UniqueName: \"kubernetes.io/projected/faaf5643-f2f2-43d2-83e3-30016afe164e-kube-api-access-rttcf\") pod \"keystone-2f46-account-create-czl2w\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.917498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/faaf5643-f2f2-43d2-83e3-30016afe164e-operator-scripts\") pod \"keystone-2f46-account-create-czl2w\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:14 crc kubenswrapper[4769]: I1121 12:43:14.942953 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rttcf\" (UniqueName: \"kubernetes.io/projected/faaf5643-f2f2-43d2-83e3-30016afe164e-kube-api-access-rttcf\") pod \"keystone-2f46-account-create-czl2w\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:15 crc kubenswrapper[4769]: I1121 12:43:15.004867 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:15 crc kubenswrapper[4769]: I1121 12:43:15.471581 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-c48mb"] Nov 21 12:43:15 crc kubenswrapper[4769]: W1121 12:43:15.495228 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8df2d2d_30ee_4db9_9417_8b754c24220a.slice/crio-baef607e898246a7ed875458bee05bcf930c336a6ca4993d9a48bdec789b55b5 WatchSource:0}: Error finding container baef607e898246a7ed875458bee05bcf930c336a6ca4993d9a48bdec789b55b5: Status 404 returned error can't find the container with id baef607e898246a7ed875458bee05bcf930c336a6ca4993d9a48bdec789b55b5 Nov 21 12:43:15 crc kubenswrapper[4769]: I1121 12:43:15.552084 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-2f46-account-create-czl2w"] Nov 21 12:43:15 crc kubenswrapper[4769]: W1121 12:43:15.558400 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaaf5643_f2f2_43d2_83e3_30016afe164e.slice/crio-f4f2a9ae7b81ced7830561cb9f9f7a1aa070b523235aa6552562d9f0f266ff56 WatchSource:0}: Error finding container f4f2a9ae7b81ced7830561cb9f9f7a1aa070b523235aa6552562d9f0f266ff56: Status 404 returned error can't find the container with id f4f2a9ae7b81ced7830561cb9f9f7a1aa070b523235aa6552562d9f0f266ff56 Nov 21 12:43:15 crc kubenswrapper[4769]: I1121 12:43:15.629808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:15 crc kubenswrapper[4769]: E1121 12:43:15.630085 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:43:15 crc kubenswrapper[4769]: E1121 12:43:15.630124 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:43:15 crc kubenswrapper[4769]: E1121 12:43:15.630222 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift podName:6948baaa-5e35-43d5-a742-7b6c9b6e80d3 nodeName:}" failed. No retries permitted until 2025-11-21 12:43:23.630182888 +0000 UTC m=+3162.330844716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift") pod "swift-storage-0" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3") : configmap "swift-ring-files" not found Nov 21 12:43:16 crc kubenswrapper[4769]: I1121 12:43:16.051160 4769 generic.go:334] "Generic (PLEG): container finished" podID="faaf5643-f2f2-43d2-83e3-30016afe164e" containerID="2da921b2026043a55b91bfeb31903c8701abe654b8f6519b8cf5ff0360725b41" exitCode=0 Nov 21 12:43:16 crc kubenswrapper[4769]: I1121 12:43:16.051288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" event={"ID":"faaf5643-f2f2-43d2-83e3-30016afe164e","Type":"ContainerDied","Data":"2da921b2026043a55b91bfeb31903c8701abe654b8f6519b8cf5ff0360725b41"} Nov 21 12:43:16 crc kubenswrapper[4769]: I1121 12:43:16.051334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" event={"ID":"faaf5643-f2f2-43d2-83e3-30016afe164e","Type":"ContainerStarted","Data":"f4f2a9ae7b81ced7830561cb9f9f7a1aa070b523235aa6552562d9f0f266ff56"} Nov 21 12:43:16 crc kubenswrapper[4769]: I1121 12:43:16.053704 4769 generic.go:334] "Generic (PLEG): container finished" podID="d8df2d2d-30ee-4db9-9417-8b754c24220a" containerID="ce1d328ccbc915838f798bc19375e66aa8a11fb4730594b611c0800d8711dec9" exitCode=0 Nov 21 12:43:16 crc kubenswrapper[4769]: I1121 12:43:16.053735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-c48mb" event={"ID":"d8df2d2d-30ee-4db9-9417-8b754c24220a","Type":"ContainerDied","Data":"ce1d328ccbc915838f798bc19375e66aa8a11fb4730594b611c0800d8711dec9"} Nov 21 12:43:16 crc kubenswrapper[4769]: I1121 12:43:16.053749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-c48mb" event={"ID":"d8df2d2d-30ee-4db9-9417-8b754c24220a","Type":"ContainerStarted","Data":"baef607e898246a7ed875458bee05bcf930c336a6ca4993d9a48bdec789b55b5"} Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.655399 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.659325 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.793004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/faaf5643-f2f2-43d2-83e3-30016afe164e-operator-scripts\") pod \"faaf5643-f2f2-43d2-83e3-30016afe164e\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.793134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl8cb\" (UniqueName: \"kubernetes.io/projected/d8df2d2d-30ee-4db9-9417-8b754c24220a-kube-api-access-hl8cb\") pod \"d8df2d2d-30ee-4db9-9417-8b754c24220a\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.793262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rttcf\" (UniqueName: \"kubernetes.io/projected/faaf5643-f2f2-43d2-83e3-30016afe164e-kube-api-access-rttcf\") pod \"faaf5643-f2f2-43d2-83e3-30016afe164e\" (UID: \"faaf5643-f2f2-43d2-83e3-30016afe164e\") " Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.793306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d8df2d2d-30ee-4db9-9417-8b754c24220a-operator-scripts\") pod \"d8df2d2d-30ee-4db9-9417-8b754c24220a\" (UID: \"d8df2d2d-30ee-4db9-9417-8b754c24220a\") " Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.794901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8df2d2d-30ee-4db9-9417-8b754c24220a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d8df2d2d-30ee-4db9-9417-8b754c24220a" (UID: "d8df2d2d-30ee-4db9-9417-8b754c24220a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.795415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faaf5643-f2f2-43d2-83e3-30016afe164e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "faaf5643-f2f2-43d2-83e3-30016afe164e" (UID: "faaf5643-f2f2-43d2-83e3-30016afe164e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.802476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8df2d2d-30ee-4db9-9417-8b754c24220a-kube-api-access-hl8cb" (OuterVolumeSpecName: "kube-api-access-hl8cb") pod "d8df2d2d-30ee-4db9-9417-8b754c24220a" (UID: "d8df2d2d-30ee-4db9-9417-8b754c24220a"). InnerVolumeSpecName "kube-api-access-hl8cb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.802623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faaf5643-f2f2-43d2-83e3-30016afe164e-kube-api-access-rttcf" (OuterVolumeSpecName: "kube-api-access-rttcf") pod "faaf5643-f2f2-43d2-83e3-30016afe164e" (UID: "faaf5643-f2f2-43d2-83e3-30016afe164e"). InnerVolumeSpecName "kube-api-access-rttcf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.895537 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rttcf\" (UniqueName: \"kubernetes.io/projected/faaf5643-f2f2-43d2-83e3-30016afe164e-kube-api-access-rttcf\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.895589 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d8df2d2d-30ee-4db9-9417-8b754c24220a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.895601 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/faaf5643-f2f2-43d2-83e3-30016afe164e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:17 crc kubenswrapper[4769]: I1121 12:43:17.895615 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hl8cb\" (UniqueName: \"kubernetes.io/projected/d8df2d2d-30ee-4db9-9417-8b754c24220a-kube-api-access-hl8cb\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:18 crc kubenswrapper[4769]: I1121 12:43:18.129173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" event={"ID":"faaf5643-f2f2-43d2-83e3-30016afe164e","Type":"ContainerDied","Data":"f4f2a9ae7b81ced7830561cb9f9f7a1aa070b523235aa6552562d9f0f266ff56"} Nov 21 12:43:18 crc kubenswrapper[4769]: I1121 12:43:18.129493 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4f2a9ae7b81ced7830561cb9f9f7a1aa070b523235aa6552562d9f0f266ff56" Nov 21 12:43:18 crc kubenswrapper[4769]: I1121 12:43:18.129613 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-2f46-account-create-czl2w" Nov 21 12:43:18 crc kubenswrapper[4769]: I1121 12:43:18.133635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-c48mb" event={"ID":"d8df2d2d-30ee-4db9-9417-8b754c24220a","Type":"ContainerDied","Data":"baef607e898246a7ed875458bee05bcf930c336a6ca4993d9a48bdec789b55b5"} Nov 21 12:43:18 crc kubenswrapper[4769]: I1121 12:43:18.133731 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-c48mb" Nov 21 12:43:18 crc kubenswrapper[4769]: I1121 12:43:18.133753 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baef607e898246a7ed875458bee05bcf930c336a6ca4993d9a48bdec789b55b5" Nov 21 12:43:19 crc kubenswrapper[4769]: I1121 12:43:19.149658 4769 generic.go:334] "Generic (PLEG): container finished" podID="494df0d7-41ee-40f2-9711-ad9f06bca57a" containerID="4ae0c0f2ff5a703a50b2f134e4a4b029f1ba19c4e539c1d91dba2775738e09f9" exitCode=0 Nov 21 12:43:19 crc kubenswrapper[4769]: I1121 12:43:19.149799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" event={"ID":"494df0d7-41ee-40f2-9711-ad9f06bca57a","Type":"ContainerDied","Data":"4ae0c0f2ff5a703a50b2f134e4a4b029f1ba19c4e539c1d91dba2775738e09f9"} Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.172721 4769 generic.go:334] "Generic (PLEG): container finished" podID="9940ebf1-4095-4094-ac9c-65d923a749d3" containerID="b78ae03a726387fdf2735f3c92a89e864ec4d040b21582891aa8cea4abda187f" exitCode=0 Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.172847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" event={"ID":"9940ebf1-4095-4094-ac9c-65d923a749d3","Type":"ContainerDied","Data":"b78ae03a726387fdf2735f3c92a89e864ec4d040b21582891aa8cea4abda187f"} Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.625575 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.762875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjm94\" (UniqueName: \"kubernetes.io/projected/494df0d7-41ee-40f2-9711-ad9f06bca57a-kube-api-access-cjm94\") pod \"494df0d7-41ee-40f2-9711-ad9f06bca57a\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.763040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-config-data\") pod \"494df0d7-41ee-40f2-9711-ad9f06bca57a\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.763086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-combined-ca-bundle\") pod \"494df0d7-41ee-40f2-9711-ad9f06bca57a\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.763158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-db-sync-config-data\") pod \"494df0d7-41ee-40f2-9711-ad9f06bca57a\" (UID: \"494df0d7-41ee-40f2-9711-ad9f06bca57a\") " Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.773979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494df0d7-41ee-40f2-9711-ad9f06bca57a-kube-api-access-cjm94" (OuterVolumeSpecName: "kube-api-access-cjm94") pod "494df0d7-41ee-40f2-9711-ad9f06bca57a" (UID: "494df0d7-41ee-40f2-9711-ad9f06bca57a"). InnerVolumeSpecName "kube-api-access-cjm94". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.786553 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "494df0d7-41ee-40f2-9711-ad9f06bca57a" (UID: "494df0d7-41ee-40f2-9711-ad9f06bca57a"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.802940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "494df0d7-41ee-40f2-9711-ad9f06bca57a" (UID: "494df0d7-41ee-40f2-9711-ad9f06bca57a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.842862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-config-data" (OuterVolumeSpecName: "config-data") pod "494df0d7-41ee-40f2-9711-ad9f06bca57a" (UID: "494df0d7-41ee-40f2-9711-ad9f06bca57a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.865944 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cjm94\" (UniqueName: \"kubernetes.io/projected/494df0d7-41ee-40f2-9711-ad9f06bca57a-kube-api-access-cjm94\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.865999 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.866023 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:20 crc kubenswrapper[4769]: I1121 12:43:20.866048 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/494df0d7-41ee-40f2-9711-ad9f06bca57a-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.193010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" event={"ID":"494df0d7-41ee-40f2-9711-ad9f06bca57a","Type":"ContainerDied","Data":"d908c6f65ba838e8e33f0c3eb3c9da88ad57b4372a618299d9226db4d62df584"} Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.193082 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d908c6f65ba838e8e33f0c3eb3c9da88ad57b4372a618299d9226db4d62df584" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.193109 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-n9wnv" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.655955 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-swiftconf\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814198 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-dispersionconf\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-combined-ca-bundle\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9940ebf1-4095-4094-ac9c-65d923a749d3-etc-swift\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814597 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-ring-data-devices\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hssht\" (UniqueName: \"kubernetes.io/projected/9940ebf1-4095-4094-ac9c-65d923a749d3-kube-api-access-hssht\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.814708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-scripts\") pod \"9940ebf1-4095-4094-ac9c-65d923a749d3\" (UID: \"9940ebf1-4095-4094-ac9c-65d923a749d3\") " Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.817858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.818997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9940ebf1-4095-4094-ac9c-65d923a749d3-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.831839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9940ebf1-4095-4094-ac9c-65d923a749d3-kube-api-access-hssht" (OuterVolumeSpecName: "kube-api-access-hssht") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "kube-api-access-hssht". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.837226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.852274 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-scripts" (OuterVolumeSpecName: "scripts") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.852595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.865775 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "9940ebf1-4095-4094-ac9c-65d923a749d3" (UID: "9940ebf1-4095-4094-ac9c-65d923a749d3"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917479 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917518 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917532 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917549 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9940ebf1-4095-4094-ac9c-65d923a749d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917562 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9940ebf1-4095-4094-ac9c-65d923a749d3-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917573 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9940ebf1-4095-4094-ac9c-65d923a749d3-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:21 crc kubenswrapper[4769]: I1121 12:43:21.917587 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hssht\" (UniqueName: \"kubernetes.io/projected/9940ebf1-4095-4094-ac9c-65d923a749d3-kube-api-access-hssht\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:22 crc kubenswrapper[4769]: I1121 12:43:22.208610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" event={"ID":"9940ebf1-4095-4094-ac9c-65d923a749d3","Type":"ContainerDied","Data":"58769c3fd5858c90fee793b4e1170918c0238c7543f72fd23ac9bb6f74afaac1"} Nov 21 12:43:22 crc kubenswrapper[4769]: I1121 12:43:22.210127 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58769c3fd5858c90fee793b4e1170918c0238c7543f72fd23ac9bb6f74afaac1" Nov 21 12:43:22 crc kubenswrapper[4769]: I1121 12:43:22.210331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-87crh" Nov 21 12:43:22 crc kubenswrapper[4769]: I1121 12:43:22.275050 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:43:22 crc kubenswrapper[4769]: E1121 12:43:22.276043 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:43:23 crc kubenswrapper[4769]: I1121 12:43:23.662101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:23 crc kubenswrapper[4769]: I1121 12:43:23.676109 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"swift-storage-0\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:23 crc kubenswrapper[4769]: I1121 12:43:23.747107 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:43:24 crc kubenswrapper[4769]: I1121 12:43:24.301897 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:43:25 crc kubenswrapper[4769]: I1121 12:43:25.249092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f"} Nov 21 12:43:25 crc kubenswrapper[4769]: I1121 12:43:25.250154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611"} Nov 21 12:43:25 crc kubenswrapper[4769]: I1121 12:43:25.250235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a"} Nov 21 12:43:25 crc kubenswrapper[4769]: I1121 12:43:25.250250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335"} Nov 21 12:43:25 crc kubenswrapper[4769]: I1121 12:43:25.250263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"704e9a63a7cf9b7f5cac6ab886d339c25f8c698819ffae0f27e5c04c392ded7c"} Nov 21 12:43:25 crc kubenswrapper[4769]: I1121 12:43:25.633866 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:43:26 crc kubenswrapper[4769]: I1121 12:43:26.287553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495"} Nov 21 12:43:26 crc kubenswrapper[4769]: I1121 12:43:26.288081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5"} Nov 21 12:43:26 crc kubenswrapper[4769]: I1121 12:43:26.288092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864"} Nov 21 12:43:26 crc kubenswrapper[4769]: I1121 12:43:26.288101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392"} Nov 21 12:43:26 crc kubenswrapper[4769]: I1121 12:43:26.288112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf"} Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.305731 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerID="caf338fde4549ca5d2634d4635bfd88cb3fe3d186dfb81862b83c38a8fee3534" exitCode=0 Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.305829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8ba57a49-8363-41c4-b411-40dcff3a84b1","Type":"ContainerDied","Data":"caf338fde4549ca5d2634d4635bfd88cb3fe3d186dfb81862b83c38a8fee3534"} Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.313432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20"} Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.313499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c"} Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.313513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba"} Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.313528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021"} Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.316299 4769 generic.go:334] "Generic (PLEG): container finished" podID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerID="c760f0f48028b4106e87bcbf2583e64106415ee45fde91f735003e4c387e69c4" exitCode=0 Nov 21 12:43:27 crc kubenswrapper[4769]: I1121 12:43:27.316336 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1","Type":"ContainerDied","Data":"c760f0f48028b4106e87bcbf2583e64106415ee45fde91f735003e4c387e69c4"} Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.329353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8ba57a49-8363-41c4-b411-40dcff3a84b1","Type":"ContainerStarted","Data":"4f3e3f2c1093f3f0b105c93aca74f71deb6ddf2bcd3d804498f0643b36a63f44"} Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.330493 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.336530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00"} Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.336616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerStarted","Data":"564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9"} Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.339585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1","Type":"ContainerStarted","Data":"9e2e1cc67c6aa2e34674953ae3b8c63657f8647ec532fa841a91efb8df6a4e32"} Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.340450 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.375384 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=38.375356324 podStartE2EDuration="38.375356324s" podCreationTimestamp="2025-11-21 12:42:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:28.363778309 +0000 UTC m=+3167.064440127" watchObservedRunningTime="2025-11-21 12:43:28.375356324 +0000 UTC m=+3167.076018182" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.410805 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=38.410765307 podStartE2EDuration="38.410765307s" podCreationTimestamp="2025-11-21 12:42:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:28.391784601 +0000 UTC m=+3167.092446459" watchObservedRunningTime="2025-11-21 12:43:28.410765307 +0000 UTC m=+3167.111427165" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.461301 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=22.4612467 podStartE2EDuration="22.4612467s" podCreationTimestamp="2025-11-21 12:43:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:28.451478974 +0000 UTC m=+3167.152140802" watchObservedRunningTime="2025-11-21 12:43:28.4612467 +0000 UTC m=+3167.161908558" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.658366 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk"] Nov 21 12:43:28 crc kubenswrapper[4769]: E1121 12:43:28.658956 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d8df2d2d-30ee-4db9-9417-8b754c24220a" containerName="mariadb-database-create" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.658984 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8df2d2d-30ee-4db9-9417-8b754c24220a" containerName="mariadb-database-create" Nov 21 12:43:28 crc kubenswrapper[4769]: E1121 12:43:28.659018 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9940ebf1-4095-4094-ac9c-65d923a749d3" containerName="swift-ring-rebalance" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.659029 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ebf1-4095-4094-ac9c-65d923a749d3" containerName="swift-ring-rebalance" Nov 21 12:43:28 crc kubenswrapper[4769]: E1121 12:43:28.659100 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="faaf5643-f2f2-43d2-83e3-30016afe164e" containerName="mariadb-account-create" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.659112 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="faaf5643-f2f2-43d2-83e3-30016afe164e" containerName="mariadb-account-create" Nov 21 12:43:28 crc kubenswrapper[4769]: E1121 12:43:28.659134 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="494df0d7-41ee-40f2-9711-ad9f06bca57a" containerName="glance-db-sync" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.659144 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="494df0d7-41ee-40f2-9711-ad9f06bca57a" containerName="glance-db-sync" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.660820 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d8df2d2d-30ee-4db9-9417-8b754c24220a" containerName="mariadb-database-create" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.660847 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="494df0d7-41ee-40f2-9711-ad9f06bca57a" containerName="glance-db-sync" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.660887 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9940ebf1-4095-4094-ac9c-65d923a749d3" containerName="swift-ring-rebalance" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.660906 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="faaf5643-f2f2-43d2-83e3-30016afe164e" containerName="mariadb-account-create" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.662373 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.665167 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.675487 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk"] Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.807005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbpw\" (UniqueName: \"kubernetes.io/projected/8870f588-dcd9-4a29-a1af-28d085ee8c1e-kube-api-access-fnbpw\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.807315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.807402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.807602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-config\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.909575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbpw\" (UniqueName: \"kubernetes.io/projected/8870f588-dcd9-4a29-a1af-28d085ee8c1e-kube-api-access-fnbpw\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.909701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.909734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.909785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-config\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.910823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-config\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.910974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.911059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:28 crc kubenswrapper[4769]: I1121 12:43:28.935363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbpw\" (UniqueName: \"kubernetes.io/projected/8870f588-dcd9-4a29-a1af-28d085ee8c1e-kube-api-access-fnbpw\") pod \"dnsmasq-dnsmasq-5688dfc9c-kq7kk\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:29 crc kubenswrapper[4769]: I1121 12:43:29.017368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:29 crc kubenswrapper[4769]: I1121 12:43:29.632081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk"] Nov 21 12:43:29 crc kubenswrapper[4769]: W1121 12:43:29.637775 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8870f588_dcd9_4a29_a1af_28d085ee8c1e.slice/crio-994693a73c2520c68ee95561e2aad118e5d64f3564424e9ab7bfb8296b39cc19 WatchSource:0}: Error finding container 994693a73c2520c68ee95561e2aad118e5d64f3564424e9ab7bfb8296b39cc19: Status 404 returned error can't find the container with id 994693a73c2520c68ee95561e2aad118e5d64f3564424e9ab7bfb8296b39cc19 Nov 21 12:43:30 crc kubenswrapper[4769]: I1121 12:43:30.367955 4769 generic.go:334] "Generic (PLEG): container finished" podID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerID="32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a" exitCode=0 Nov 21 12:43:30 crc kubenswrapper[4769]: I1121 12:43:30.368016 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" event={"ID":"8870f588-dcd9-4a29-a1af-28d085ee8c1e","Type":"ContainerDied","Data":"32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a"} Nov 21 12:43:30 crc kubenswrapper[4769]: I1121 12:43:30.368056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" event={"ID":"8870f588-dcd9-4a29-a1af-28d085ee8c1e","Type":"ContainerStarted","Data":"994693a73c2520c68ee95561e2aad118e5d64f3564424e9ab7bfb8296b39cc19"} Nov 21 12:43:31 crc kubenswrapper[4769]: I1121 12:43:31.385970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" event={"ID":"8870f588-dcd9-4a29-a1af-28d085ee8c1e","Type":"ContainerStarted","Data":"f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5"} Nov 21 12:43:31 crc kubenswrapper[4769]: I1121 12:43:31.386545 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:31 crc kubenswrapper[4769]: I1121 12:43:31.412159 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" podStartSLOduration=3.412133415 podStartE2EDuration="3.412133415s" podCreationTimestamp="2025-11-21 12:43:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:31.403913692 +0000 UTC m=+3170.104575510" watchObservedRunningTime="2025-11-21 12:43:31.412133415 +0000 UTC m=+3170.112795233" Nov 21 12:43:36 crc kubenswrapper[4769]: I1121 12:43:36.274331 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:43:36 crc kubenswrapper[4769]: E1121 12:43:36.276971 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.019484 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.113106 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd"] Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.113483 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerName="dnsmasq-dns" containerID="cri-o://40ea0a17c9cc6fc3f28c459cb70b4613217eeba970e2c513eb6ec00af71603cb" gracePeriod=10 Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.518771 4769 generic.go:334] "Generic (PLEG): container finished" podID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerID="40ea0a17c9cc6fc3f28c459cb70b4613217eeba970e2c513eb6ec00af71603cb" exitCode=0 Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.519303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" event={"ID":"650a3adf-623d-4869-be32-b9188cb6f1f1","Type":"ContainerDied","Data":"40ea0a17c9cc6fc3f28c459cb70b4613217eeba970e2c513eb6ec00af71603cb"} Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.610135 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.668766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-dnsmasq-svc\") pod \"650a3adf-623d-4869-be32-b9188cb6f1f1\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.668919 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bcws\" (UniqueName: \"kubernetes.io/projected/650a3adf-623d-4869-be32-b9188cb6f1f1-kube-api-access-9bcws\") pod \"650a3adf-623d-4869-be32-b9188cb6f1f1\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.669091 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-config\") pod \"650a3adf-623d-4869-be32-b9188cb6f1f1\" (UID: \"650a3adf-623d-4869-be32-b9188cb6f1f1\") " Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.681496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/650a3adf-623d-4869-be32-b9188cb6f1f1-kube-api-access-9bcws" (OuterVolumeSpecName: "kube-api-access-9bcws") pod "650a3adf-623d-4869-be32-b9188cb6f1f1" (UID: "650a3adf-623d-4869-be32-b9188cb6f1f1"). InnerVolumeSpecName "kube-api-access-9bcws". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.732935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-config" (OuterVolumeSpecName: "config") pod "650a3adf-623d-4869-be32-b9188cb6f1f1" (UID: "650a3adf-623d-4869-be32-b9188cb6f1f1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.735851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "650a3adf-623d-4869-be32-b9188cb6f1f1" (UID: "650a3adf-623d-4869-be32-b9188cb6f1f1"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.772087 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.772175 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/650a3adf-623d-4869-be32-b9188cb6f1f1-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:39 crc kubenswrapper[4769]: I1121 12:43:39.772248 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9bcws\" (UniqueName: \"kubernetes.io/projected/650a3adf-623d-4869-be32-b9188cb6f1f1-kube-api-access-9bcws\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:40 crc kubenswrapper[4769]: I1121 12:43:40.541530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" event={"ID":"650a3adf-623d-4869-be32-b9188cb6f1f1","Type":"ContainerDied","Data":"7620b986126ada08f3feebadda7b0f307ef12fbf95f5e21ff2cced291a4dcf0f"} Nov 21 12:43:40 crc kubenswrapper[4769]: I1121 12:43:40.542102 4769 scope.go:117] "RemoveContainer" containerID="40ea0a17c9cc6fc3f28c459cb70b4613217eeba970e2c513eb6ec00af71603cb" Nov 21 12:43:40 crc kubenswrapper[4769]: I1121 12:43:40.542013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd" Nov 21 12:43:40 crc kubenswrapper[4769]: I1121 12:43:40.596788 4769 scope.go:117] "RemoveContainer" containerID="379c1dcb9363d3e66bfc22ffc6d92ae31ff19d0469d3953d14ae2a1ef3242286" Nov 21 12:43:40 crc kubenswrapper[4769]: I1121 12:43:40.606369 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd"] Nov 21 12:43:40 crc kubenswrapper[4769]: I1121 12:43:40.615374 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qcptd"] Nov 21 12:43:41 crc kubenswrapper[4769]: I1121 12:43:41.299951 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" path="/var/lib/kubelet/pods/650a3adf-623d-4869-be32-b9188cb6f1f1/volumes" Nov 21 12:43:41 crc kubenswrapper[4769]: I1121 12:43:41.825519 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.236530 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-mbl28"] Nov 21 12:43:42 crc kubenswrapper[4769]: E1121 12:43:42.237114 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerName="dnsmasq-dns" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.237138 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerName="dnsmasq-dns" Nov 21 12:43:42 crc kubenswrapper[4769]: E1121 12:43:42.237179 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerName="init" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.237250 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerName="init" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.237509 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="650a3adf-623d-4869-be32-b9188cb6f1f1" containerName="dnsmasq-dns" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.238398 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.243472 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-mbl28"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.248364 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.322420 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-frqv5"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.323815 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.355974 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-frqv5"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.359882 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-8f44-account-create-2g8jp"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.367454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.373215 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8f44-account-create-2g8jp"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.376987 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.433563 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-c15e-account-create-2sfh9"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.434622 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.437283 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.441159 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/387ffe22-065e-4b2c-ae58-44c931ba346b-operator-scripts\") pod \"cinder-db-create-mbl28\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.441238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jhkh\" (UniqueName: \"kubernetes.io/projected/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-kube-api-access-8jhkh\") pod \"barbican-db-create-frqv5\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.441348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmg5z\" (UniqueName: \"kubernetes.io/projected/387ffe22-065e-4b2c-ae58-44c931ba346b-kube-api-access-cmg5z\") pod \"cinder-db-create-mbl28\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.441431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-operator-scripts\") pod \"barbican-db-create-frqv5\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.454258 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-c15e-account-create-2sfh9"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.523979 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-37fb-account-create-drsrv"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.525559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.529017 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.537112 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-37fb-account-create-drsrv"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543088 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/387ffe22-065e-4b2c-ae58-44c931ba346b-operator-scripts\") pod \"cinder-db-create-mbl28\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8jhkh\" (UniqueName: \"kubernetes.io/projected/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-kube-api-access-8jhkh\") pod \"barbican-db-create-frqv5\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c286l\" (UniqueName: \"kubernetes.io/projected/1e808382-c2c4-4452-b551-ab3725493318-kube-api-access-c286l\") pod \"barbican-8f44-account-create-2g8jp\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-operator-scripts\") pod \"neutron-c15e-account-create-2sfh9\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cmg5z\" (UniqueName: \"kubernetes.io/projected/387ffe22-065e-4b2c-ae58-44c931ba346b-kube-api-access-cmg5z\") pod \"cinder-db-create-mbl28\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e808382-c2c4-4452-b551-ab3725493318-operator-scripts\") pod \"barbican-8f44-account-create-2g8jp\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsjqg\" (UniqueName: \"kubernetes.io/projected/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-kube-api-access-qsjqg\") pod \"neutron-c15e-account-create-2sfh9\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.543561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-operator-scripts\") pod \"barbican-db-create-frqv5\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.544029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/387ffe22-065e-4b2c-ae58-44c931ba346b-operator-scripts\") pod \"cinder-db-create-mbl28\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.544688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-operator-scripts\") pod \"barbican-db-create-frqv5\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.581551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jhkh\" (UniqueName: \"kubernetes.io/projected/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-kube-api-access-8jhkh\") pod \"barbican-db-create-frqv5\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.597029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmg5z\" (UniqueName: \"kubernetes.io/projected/387ffe22-065e-4b2c-ae58-44c931ba346b-kube-api-access-cmg5z\") pod \"cinder-db-create-mbl28\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.642943 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.646240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c286l\" (UniqueName: \"kubernetes.io/projected/1e808382-c2c4-4452-b551-ab3725493318-kube-api-access-c286l\") pod \"barbican-8f44-account-create-2g8jp\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.646317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqgj\" (UniqueName: \"kubernetes.io/projected/9f257e32-13e3-4f28-97f4-eaefb3255d54-kube-api-access-5dqgj\") pod \"cinder-37fb-account-create-drsrv\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.646356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-operator-scripts\") pod \"neutron-c15e-account-create-2sfh9\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.646392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e808382-c2c4-4452-b551-ab3725493318-operator-scripts\") pod \"barbican-8f44-account-create-2g8jp\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.646417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qsjqg\" (UniqueName: \"kubernetes.io/projected/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-kube-api-access-qsjqg\") pod \"neutron-c15e-account-create-2sfh9\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.646472 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f257e32-13e3-4f28-97f4-eaefb3255d54-operator-scripts\") pod \"cinder-37fb-account-create-drsrv\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.647405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-operator-scripts\") pod \"neutron-c15e-account-create-2sfh9\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.647456 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e808382-c2c4-4452-b551-ab3725493318-operator-scripts\") pod \"barbican-8f44-account-create-2g8jp\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.661602 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-87d4x"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.662972 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.671560 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.671953 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-68nkp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.672136 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.672256 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.677687 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsjqg\" (UniqueName: \"kubernetes.io/projected/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-kube-api-access-qsjqg\") pod \"neutron-c15e-account-create-2sfh9\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.677892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c286l\" (UniqueName: \"kubernetes.io/projected/1e808382-c2c4-4452-b551-ab3725493318-kube-api-access-c286l\") pod \"barbican-8f44-account-create-2g8jp\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.683357 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-87d4x"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.687499 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.703262 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nrzvs"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.704873 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.719290 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nrzvs"] Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.749265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-config-data\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.749331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqgj\" (UniqueName: \"kubernetes.io/projected/9f257e32-13e3-4f28-97f4-eaefb3255d54-kube-api-access-5dqgj\") pod \"cinder-37fb-account-create-drsrv\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.749374 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-combined-ca-bundle\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.749400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6922\" (UniqueName: \"kubernetes.io/projected/66f5bb02-7c0d-40f3-8417-42feca72085c-kube-api-access-p6922\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.749432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f257e32-13e3-4f28-97f4-eaefb3255d54-operator-scripts\") pod \"cinder-37fb-account-create-drsrv\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.750244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f257e32-13e3-4f28-97f4-eaefb3255d54-operator-scripts\") pod \"cinder-37fb-account-create-drsrv\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.750444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.781914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqgj\" (UniqueName: \"kubernetes.io/projected/9f257e32-13e3-4f28-97f4-eaefb3255d54-kube-api-access-5dqgj\") pod \"cinder-37fb-account-create-drsrv\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.841543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.851082 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49c03449-12ad-44f1-a622-0d08559e1eeb-operator-scripts\") pod \"neutron-db-create-nrzvs\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.851134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqzh\" (UniqueName: \"kubernetes.io/projected/49c03449-12ad-44f1-a622-0d08559e1eeb-kube-api-access-fvqzh\") pod \"neutron-db-create-nrzvs\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.851162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-config-data\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.851222 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-combined-ca-bundle\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.851245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p6922\" (UniqueName: \"kubernetes.io/projected/66f5bb02-7c0d-40f3-8417-42feca72085c-kube-api-access-p6922\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.855575 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.857500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-config-data\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.857808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-combined-ca-bundle\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.880895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6922\" (UniqueName: \"kubernetes.io/projected/66f5bb02-7c0d-40f3-8417-42feca72085c-kube-api-access-p6922\") pod \"keystone-db-sync-87d4x\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.952788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49c03449-12ad-44f1-a622-0d08559e1eeb-operator-scripts\") pod \"neutron-db-create-nrzvs\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.952864 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqzh\" (UniqueName: \"kubernetes.io/projected/49c03449-12ad-44f1-a622-0d08559e1eeb-kube-api-access-fvqzh\") pod \"neutron-db-create-nrzvs\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.953676 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49c03449-12ad-44f1-a622-0d08559e1eeb-operator-scripts\") pod \"neutron-db-create-nrzvs\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:42 crc kubenswrapper[4769]: I1121 12:43:42.971936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqzh\" (UniqueName: \"kubernetes.io/projected/49c03449-12ad-44f1-a622-0d08559e1eeb-kube-api-access-fvqzh\") pod \"neutron-db-create-nrzvs\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.106051 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.126682 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.206716 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-37fb-account-create-drsrv"] Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.216749 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8f44-account-create-2g8jp"] Nov 21 12:43:43 crc kubenswrapper[4769]: W1121 12:43:43.244112 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f257e32_13e3_4f28_97f4_eaefb3255d54.slice/crio-53fa413a2b050385eb5e82913f8460762f1e72224f66d3432b7a0fff37ea4793 WatchSource:0}: Error finding container 53fa413a2b050385eb5e82913f8460762f1e72224f66d3432b7a0fff37ea4793: Status 404 returned error can't find the container with id 53fa413a2b050385eb5e82913f8460762f1e72224f66d3432b7a0fff37ea4793 Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.250664 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-frqv5"] Nov 21 12:43:43 crc kubenswrapper[4769]: W1121 12:43:43.311075 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod387ffe22_065e_4b2c_ae58_44c931ba346b.slice/crio-3dd23de094557aa52b5a6c0b3038b77a7d57ca5201ee1a085d37119fe7a8997a WatchSource:0}: Error finding container 3dd23de094557aa52b5a6c0b3038b77a7d57ca5201ee1a085d37119fe7a8997a: Status 404 returned error can't find the container with id 3dd23de094557aa52b5a6c0b3038b77a7d57ca5201ee1a085d37119fe7a8997a Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.317430 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-mbl28"] Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.369898 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-c15e-account-create-2sfh9"] Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.420415 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.493116 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-87d4x"] Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.598772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" event={"ID":"1e808382-c2c4-4452-b551-ab3725493318","Type":"ContainerStarted","Data":"59e1fc7f0fa8035ce829c4a7744c642e0845202fe1efdff995f30af59bb71b31"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.598842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" event={"ID":"1e808382-c2c4-4452-b551-ab3725493318","Type":"ContainerStarted","Data":"67e43a1f1f6c98ed9fd7af2019f55aaaed8c474c96a2c7103229bbb6188a72e6"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.604463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-frqv5" event={"ID":"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af","Type":"ContainerStarted","Data":"20a0b568abf2190e0c241398d701559bef4cb81bafebe70eab42289584d77fb5"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.614070 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" event={"ID":"66f5bb02-7c0d-40f3-8417-42feca72085c","Type":"ContainerStarted","Data":"8ffc7e2bf3b741f4d54ce80e0dd416b472149c8e61981707c217a869525475fb"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.616343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" event={"ID":"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa","Type":"ContainerStarted","Data":"07ab7c85db0831875b037409cac1a3fbbdef9bafb329bdfac656279a68a8c6d7"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.618008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-mbl28" event={"ID":"387ffe22-065e-4b2c-ae58-44c931ba346b","Type":"ContainerStarted","Data":"3dd23de094557aa52b5a6c0b3038b77a7d57ca5201ee1a085d37119fe7a8997a"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.620713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" event={"ID":"9f257e32-13e3-4f28-97f4-eaefb3255d54","Type":"ContainerStarted","Data":"53fa413a2b050385eb5e82913f8460762f1e72224f66d3432b7a0fff37ea4793"} Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.630569 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" podStartSLOduration=1.63055237 podStartE2EDuration="1.63055237s" podCreationTimestamp="2025-11-21 12:43:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:43.624484714 +0000 UTC m=+3182.325146532" watchObservedRunningTime="2025-11-21 12:43:43.63055237 +0000 UTC m=+3182.331214188" Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.658133 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" podStartSLOduration=1.658106429 podStartE2EDuration="1.658106429s" podCreationTimestamp="2025-11-21 12:43:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:43.651209011 +0000 UTC m=+3182.351870829" watchObservedRunningTime="2025-11-21 12:43:43.658106429 +0000 UTC m=+3182.358768247" Nov 21 12:43:43 crc kubenswrapper[4769]: I1121 12:43:43.735843 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nrzvs"] Nov 21 12:43:43 crc kubenswrapper[4769]: W1121 12:43:43.753273 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49c03449_12ad_44f1_a622_0d08559e1eeb.slice/crio-64c3780f1202d68726a930b049e8fb9ce1a22d138c54a4ece377613f90b04f77 WatchSource:0}: Error finding container 64c3780f1202d68726a930b049e8fb9ce1a22d138c54a4ece377613f90b04f77: Status 404 returned error can't find the container with id 64c3780f1202d68726a930b049e8fb9ce1a22d138c54a4ece377613f90b04f77 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.645098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" event={"ID":"66f5bb02-7c0d-40f3-8417-42feca72085c","Type":"ContainerStarted","Data":"325a7dcb1b018b58b35a4a7571675839e68bd954c5247fe18ba378aacd177b7f"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.649543 4769 generic.go:334] "Generic (PLEG): container finished" podID="1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" containerID="310943124bf0bbcbe253b2098687aa33b54b9832b04b4abe740312903a89255c" exitCode=0 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.649598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" event={"ID":"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa","Type":"ContainerDied","Data":"310943124bf0bbcbe253b2098687aa33b54b9832b04b4abe740312903a89255c"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.656456 4769 generic.go:334] "Generic (PLEG): container finished" podID="387ffe22-065e-4b2c-ae58-44c931ba346b" containerID="d6315c0f5d8daa33be1e1d824d7147ececdab46a837961a0fba132147a505347" exitCode=0 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.656716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-mbl28" event={"ID":"387ffe22-065e-4b2c-ae58-44c931ba346b","Type":"ContainerDied","Data":"d6315c0f5d8daa33be1e1d824d7147ececdab46a837961a0fba132147a505347"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.660116 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f257e32-13e3-4f28-97f4-eaefb3255d54" containerID="7bbc416028492f8eb5355869268ae90a7ca52406ef851c659a75310f6b1e5fb8" exitCode=0 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.660257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" event={"ID":"9f257e32-13e3-4f28-97f4-eaefb3255d54","Type":"ContainerDied","Data":"7bbc416028492f8eb5355869268ae90a7ca52406ef851c659a75310f6b1e5fb8"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.665799 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e808382-c2c4-4452-b551-ab3725493318" containerID="59e1fc7f0fa8035ce829c4a7744c642e0845202fe1efdff995f30af59bb71b31" exitCode=0 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.665883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" event={"ID":"1e808382-c2c4-4452-b551-ab3725493318","Type":"ContainerDied","Data":"59e1fc7f0fa8035ce829c4a7744c642e0845202fe1efdff995f30af59bb71b31"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.668121 4769 generic.go:334] "Generic (PLEG): container finished" podID="49c03449-12ad-44f1-a622-0d08559e1eeb" containerID="d5fa890706c9ea442d5afe145f6c33660280b36ecba95bc06852333fdc3815ff" exitCode=0 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.668180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" event={"ID":"49c03449-12ad-44f1-a622-0d08559e1eeb","Type":"ContainerDied","Data":"d5fa890706c9ea442d5afe145f6c33660280b36ecba95bc06852333fdc3815ff"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.668384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" event={"ID":"49c03449-12ad-44f1-a622-0d08559e1eeb","Type":"ContainerStarted","Data":"64c3780f1202d68726a930b049e8fb9ce1a22d138c54a4ece377613f90b04f77"} Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.668794 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" podStartSLOduration=2.6687817689999997 podStartE2EDuration="2.668781769s" podCreationTimestamp="2025-11-21 12:43:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:44.66147947 +0000 UTC m=+3183.362141298" watchObservedRunningTime="2025-11-21 12:43:44.668781769 +0000 UTC m=+3183.369443577" Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.670166 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" containerID="8824b7792340149c4c9fb2e1937391f25caf1777f672a6724006184cd308b26e" exitCode=0 Nov 21 12:43:44 crc kubenswrapper[4769]: I1121 12:43:44.670288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-frqv5" event={"ID":"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af","Type":"ContainerDied","Data":"8824b7792340149c4c9fb2e1937391f25caf1777f672a6724006184cd308b26e"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.120492 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.221409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jhkh\" (UniqueName: \"kubernetes.io/projected/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-kube-api-access-8jhkh\") pod \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.221629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-operator-scripts\") pod \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\" (UID: \"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.222851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" (UID: "cfb09a65-8b7d-4fdd-ae97-550f1e96a1af"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.232522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-kube-api-access-8jhkh" (OuterVolumeSpecName: "kube-api-access-8jhkh") pod "cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" (UID: "cfb09a65-8b7d-4fdd-ae97-550f1e96a1af"). InnerVolumeSpecName "kube-api-access-8jhkh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.323566 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.323634 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8jhkh\" (UniqueName: \"kubernetes.io/projected/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af-kube-api-access-8jhkh\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.330796 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.340892 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.352396 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.359555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.366969 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.424980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49c03449-12ad-44f1-a622-0d08559e1eeb-operator-scripts\") pod \"49c03449-12ad-44f1-a622-0d08559e1eeb\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/387ffe22-065e-4b2c-ae58-44c931ba346b-operator-scripts\") pod \"387ffe22-065e-4b2c-ae58-44c931ba346b\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsjqg\" (UniqueName: \"kubernetes.io/projected/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-kube-api-access-qsjqg\") pod \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dqgj\" (UniqueName: \"kubernetes.io/projected/9f257e32-13e3-4f28-97f4-eaefb3255d54-kube-api-access-5dqgj\") pod \"9f257e32-13e3-4f28-97f4-eaefb3255d54\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-operator-scripts\") pod \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\" (UID: \"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425264 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c286l\" (UniqueName: \"kubernetes.io/projected/1e808382-c2c4-4452-b551-ab3725493318-kube-api-access-c286l\") pod \"1e808382-c2c4-4452-b551-ab3725493318\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425338 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvqzh\" (UniqueName: \"kubernetes.io/projected/49c03449-12ad-44f1-a622-0d08559e1eeb-kube-api-access-fvqzh\") pod \"49c03449-12ad-44f1-a622-0d08559e1eeb\" (UID: \"49c03449-12ad-44f1-a622-0d08559e1eeb\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmg5z\" (UniqueName: \"kubernetes.io/projected/387ffe22-065e-4b2c-ae58-44c931ba346b-kube-api-access-cmg5z\") pod \"387ffe22-065e-4b2c-ae58-44c931ba346b\" (UID: \"387ffe22-065e-4b2c-ae58-44c931ba346b\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f257e32-13e3-4f28-97f4-eaefb3255d54-operator-scripts\") pod \"9f257e32-13e3-4f28-97f4-eaefb3255d54\" (UID: \"9f257e32-13e3-4f28-97f4-eaefb3255d54\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.425440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e808382-c2c4-4452-b551-ab3725493318-operator-scripts\") pod \"1e808382-c2c4-4452-b551-ab3725493318\" (UID: \"1e808382-c2c4-4452-b551-ab3725493318\") " Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.427930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f257e32-13e3-4f28-97f4-eaefb3255d54-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9f257e32-13e3-4f28-97f4-eaefb3255d54" (UID: "9f257e32-13e3-4f28-97f4-eaefb3255d54"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.429172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" (UID: "1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.429311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387ffe22-065e-4b2c-ae58-44c931ba346b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "387ffe22-065e-4b2c-ae58-44c931ba346b" (UID: "387ffe22-065e-4b2c-ae58-44c931ba346b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.429543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c03449-12ad-44f1-a622-0d08559e1eeb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "49c03449-12ad-44f1-a622-0d08559e1eeb" (UID: "49c03449-12ad-44f1-a622-0d08559e1eeb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.429827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e808382-c2c4-4452-b551-ab3725493318-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1e808382-c2c4-4452-b551-ab3725493318" (UID: "1e808382-c2c4-4452-b551-ab3725493318"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.433701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f257e32-13e3-4f28-97f4-eaefb3255d54-kube-api-access-5dqgj" (OuterVolumeSpecName: "kube-api-access-5dqgj") pod "9f257e32-13e3-4f28-97f4-eaefb3255d54" (UID: "9f257e32-13e3-4f28-97f4-eaefb3255d54"). InnerVolumeSpecName "kube-api-access-5dqgj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.434415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c03449-12ad-44f1-a622-0d08559e1eeb-kube-api-access-fvqzh" (OuterVolumeSpecName: "kube-api-access-fvqzh") pod "49c03449-12ad-44f1-a622-0d08559e1eeb" (UID: "49c03449-12ad-44f1-a622-0d08559e1eeb"). InnerVolumeSpecName "kube-api-access-fvqzh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.435606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e808382-c2c4-4452-b551-ab3725493318-kube-api-access-c286l" (OuterVolumeSpecName: "kube-api-access-c286l") pod "1e808382-c2c4-4452-b551-ab3725493318" (UID: "1e808382-c2c4-4452-b551-ab3725493318"). InnerVolumeSpecName "kube-api-access-c286l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.436817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387ffe22-065e-4b2c-ae58-44c931ba346b-kube-api-access-cmg5z" (OuterVolumeSpecName: "kube-api-access-cmg5z") pod "387ffe22-065e-4b2c-ae58-44c931ba346b" (UID: "387ffe22-065e-4b2c-ae58-44c931ba346b"). InnerVolumeSpecName "kube-api-access-cmg5z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.437180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-kube-api-access-qsjqg" (OuterVolumeSpecName: "kube-api-access-qsjqg") pod "1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" (UID: "1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa"). InnerVolumeSpecName "kube-api-access-qsjqg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528426 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49c03449-12ad-44f1-a622-0d08559e1eeb-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528470 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/387ffe22-065e-4b2c-ae58-44c931ba346b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528483 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qsjqg\" (UniqueName: \"kubernetes.io/projected/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-kube-api-access-qsjqg\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528500 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5dqgj\" (UniqueName: \"kubernetes.io/projected/9f257e32-13e3-4f28-97f4-eaefb3255d54-kube-api-access-5dqgj\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528514 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528527 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c286l\" (UniqueName: \"kubernetes.io/projected/1e808382-c2c4-4452-b551-ab3725493318-kube-api-access-c286l\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528538 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fvqzh\" (UniqueName: \"kubernetes.io/projected/49c03449-12ad-44f1-a622-0d08559e1eeb-kube-api-access-fvqzh\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528548 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cmg5z\" (UniqueName: \"kubernetes.io/projected/387ffe22-065e-4b2c-ae58-44c931ba346b-kube-api-access-cmg5z\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528561 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f257e32-13e3-4f28-97f4-eaefb3255d54-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.528572 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1e808382-c2c4-4452-b551-ab3725493318-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.706168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-frqv5" event={"ID":"cfb09a65-8b7d-4fdd-ae97-550f1e96a1af","Type":"ContainerDied","Data":"20a0b568abf2190e0c241398d701559bef4cb81bafebe70eab42289584d77fb5"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.706630 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20a0b568abf2190e0c241398d701559bef4cb81bafebe70eab42289584d77fb5" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.707313 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-frqv5" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.709413 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" event={"ID":"1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa","Type":"ContainerDied","Data":"07ab7c85db0831875b037409cac1a3fbbdef9bafb329bdfac656279a68a8c6d7"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.709484 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07ab7c85db0831875b037409cac1a3fbbdef9bafb329bdfac656279a68a8c6d7" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.709933 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-c15e-account-create-2sfh9" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.712202 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-mbl28" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.712222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-mbl28" event={"ID":"387ffe22-065e-4b2c-ae58-44c931ba346b","Type":"ContainerDied","Data":"3dd23de094557aa52b5a6c0b3038b77a7d57ca5201ee1a085d37119fe7a8997a"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.712269 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dd23de094557aa52b5a6c0b3038b77a7d57ca5201ee1a085d37119fe7a8997a" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.714419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" event={"ID":"9f257e32-13e3-4f28-97f4-eaefb3255d54","Type":"ContainerDied","Data":"53fa413a2b050385eb5e82913f8460762f1e72224f66d3432b7a0fff37ea4793"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.714454 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53fa413a2b050385eb5e82913f8460762f1e72224f66d3432b7a0fff37ea4793" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.714436 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-37fb-account-create-drsrv" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.717016 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.717028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8f44-account-create-2g8jp" event={"ID":"1e808382-c2c4-4452-b551-ab3725493318","Type":"ContainerDied","Data":"67e43a1f1f6c98ed9fd7af2019f55aaaed8c474c96a2c7103229bbb6188a72e6"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.717053 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67e43a1f1f6c98ed9fd7af2019f55aaaed8c474c96a2c7103229bbb6188a72e6" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.730106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" event={"ID":"49c03449-12ad-44f1-a622-0d08559e1eeb","Type":"ContainerDied","Data":"64c3780f1202d68726a930b049e8fb9ce1a22d138c54a4ece377613f90b04f77"} Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.730155 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c3780f1202d68726a930b049e8fb9ce1a22d138c54a4ece377613f90b04f77" Nov 21 12:43:46 crc kubenswrapper[4769]: I1121 12:43:46.730235 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-nrzvs" Nov 21 12:43:47 crc kubenswrapper[4769]: I1121 12:43:47.747555 4769 generic.go:334] "Generic (PLEG): container finished" podID="66f5bb02-7c0d-40f3-8417-42feca72085c" containerID="325a7dcb1b018b58b35a4a7571675839e68bd954c5247fe18ba378aacd177b7f" exitCode=0 Nov 21 12:43:47 crc kubenswrapper[4769]: I1121 12:43:47.747633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" event={"ID":"66f5bb02-7c0d-40f3-8417-42feca72085c","Type":"ContainerDied","Data":"325a7dcb1b018b58b35a4a7571675839e68bd954c5247fe18ba378aacd177b7f"} Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.213573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.280889 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.281355 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.387177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-config-data\") pod \"66f5bb02-7c0d-40f3-8417-42feca72085c\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.387442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6922\" (UniqueName: \"kubernetes.io/projected/66f5bb02-7c0d-40f3-8417-42feca72085c-kube-api-access-p6922\") pod \"66f5bb02-7c0d-40f3-8417-42feca72085c\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.387504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-combined-ca-bundle\") pod \"66f5bb02-7c0d-40f3-8417-42feca72085c\" (UID: \"66f5bb02-7c0d-40f3-8417-42feca72085c\") " Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.400871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f5bb02-7c0d-40f3-8417-42feca72085c-kube-api-access-p6922" (OuterVolumeSpecName: "kube-api-access-p6922") pod "66f5bb02-7c0d-40f3-8417-42feca72085c" (UID: "66f5bb02-7c0d-40f3-8417-42feca72085c"). InnerVolumeSpecName "kube-api-access-p6922". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.434291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66f5bb02-7c0d-40f3-8417-42feca72085c" (UID: "66f5bb02-7c0d-40f3-8417-42feca72085c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.445259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-config-data" (OuterVolumeSpecName: "config-data") pod "66f5bb02-7c0d-40f3-8417-42feca72085c" (UID: "66f5bb02-7c0d-40f3-8417-42feca72085c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.491484 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.492502 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p6922\" (UniqueName: \"kubernetes.io/projected/66f5bb02-7c0d-40f3-8417-42feca72085c-kube-api-access-p6922\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.492896 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f5bb02-7c0d-40f3-8417-42feca72085c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.784828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" event={"ID":"66f5bb02-7c0d-40f3-8417-42feca72085c","Type":"ContainerDied","Data":"8ffc7e2bf3b741f4d54ce80e0dd416b472149c8e61981707c217a869525475fb"} Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.784915 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ffc7e2bf3b741f4d54ce80e0dd416b472149c8e61981707c217a869525475fb" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.784972 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-87d4x" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977012 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-5dnxh"] Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977514 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="387ffe22-065e-4b2c-ae58-44c931ba346b" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977535 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="387ffe22-065e-4b2c-ae58-44c931ba346b" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977554 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e808382-c2c4-4452-b551-ab3725493318" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977565 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e808382-c2c4-4452-b551-ab3725493318" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977578 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977590 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977612 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f257e32-13e3-4f28-97f4-eaefb3255d54" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977623 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f257e32-13e3-4f28-97f4-eaefb3255d54" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977645 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="49c03449-12ad-44f1-a622-0d08559e1eeb" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977654 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c03449-12ad-44f1-a622-0d08559e1eeb" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977681 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977689 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: E1121 12:43:49.977699 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66f5bb02-7c0d-40f3-8417-42feca72085c" containerName="keystone-db-sync" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977706 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f5bb02-7c0d-40f3-8417-42feca72085c" containerName="keystone-db-sync" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977923 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977944 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="49c03449-12ad-44f1-a622-0d08559e1eeb" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977963 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f257e32-13e3-4f28-97f4-eaefb3255d54" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.977986 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="387ffe22-065e-4b2c-ae58-44c931ba346b" containerName="mariadb-database-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.978001 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e808382-c2c4-4452-b551-ab3725493318" containerName="mariadb-account-create" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.978033 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66f5bb02-7c0d-40f3-8417-42feca72085c" containerName="keystone-db-sync" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.978764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.985838 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.985968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.986043 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.986912 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-68nkp" Nov 21 12:43:49 crc kubenswrapper[4769]: I1121 12:43:49.987230 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.003180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-credential-keys\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.003274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b84t\" (UniqueName: \"kubernetes.io/projected/fa50e10d-174a-4a02-ba42-e3926492061a-kube-api-access-9b84t\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.003301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-config-data\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.003331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-combined-ca-bundle\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.003384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-scripts\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.003413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-fernet-keys\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.028341 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-5dnxh"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.104548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-credential-keys\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.104599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9b84t\" (UniqueName: \"kubernetes.io/projected/fa50e10d-174a-4a02-ba42-e3926492061a-kube-api-access-9b84t\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.104630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-config-data\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.104659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-combined-ca-bundle\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.104713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-scripts\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.104739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-fernet-keys\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.109465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-fernet-keys\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.110486 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-credential-keys\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.111086 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-config-data\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.115287 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-combined-ca-bundle\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.126948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-scripts\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.139141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b84t\" (UniqueName: \"kubernetes.io/projected/fa50e10d-174a-4a02-ba42-e3926492061a-kube-api-access-9b84t\") pod \"keystone-bootstrap-5dnxh\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.244741 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f6jrf"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.249099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.251680 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.251830 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-skr4t" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.252165 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.262377 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.264971 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.267842 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.268032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.291017 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-m4mp9"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.292116 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.302700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.302899 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-snfqj" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.303077 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.303474 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.303657 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f6jrf"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.349802 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.363912 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-9kqsk"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.365414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.378650 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.378813 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-fq8sk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.396341 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-9kqsk"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-log-httpd\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4swdn\" (UniqueName: \"kubernetes.io/projected/3882a022-56e5-4765-81a1-bb57a63ce3f6-kube-api-access-4swdn\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-scripts\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411535 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-combined-ca-bundle\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6806d38c-af44-4215-94da-a24176d6e8f2-logs\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt9hk\" (UniqueName: \"kubernetes.io/projected/11a8d81f-ec12-4073-abad-8023c585e9c7-kube-api-access-gt9hk\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-config-data\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-config\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-config-data\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nccx\" (UniqueName: \"kubernetes.io/projected/6806d38c-af44-4215-94da-a24176d6e8f2-kube-api-access-5nccx\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-combined-ca-bundle\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-run-httpd\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.411806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-scripts\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.422679 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-m4mp9"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-scripts\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513079 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-log-httpd\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4swdn\" (UniqueName: \"kubernetes.io/projected/3882a022-56e5-4765-81a1-bb57a63ce3f6-kube-api-access-4swdn\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-db-sync-config-data\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-scripts\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513256 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-combined-ca-bundle\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513273 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6806d38c-af44-4215-94da-a24176d6e8f2-logs\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gt9hk\" (UniqueName: \"kubernetes.io/projected/11a8d81f-ec12-4073-abad-8023c585e9c7-kube-api-access-gt9hk\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-config-data\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-config\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-config-data\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5nccx\" (UniqueName: \"kubernetes.io/projected/6806d38c-af44-4215-94da-a24176d6e8f2-kube-api-access-5nccx\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513409 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-combined-ca-bundle\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj5m5\" (UniqueName: \"kubernetes.io/projected/4488e602-68fa-4259-987c-2279513c4394-kube-api-access-wj5m5\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-combined-ca-bundle\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.513505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-run-httpd\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.514948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-run-httpd\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.515382 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-log-httpd\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.515433 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6806d38c-af44-4215-94da-a24176d6e8f2-logs\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.528875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-scripts\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.537350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.537562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-config\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.538013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-scripts\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.538283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.538737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-combined-ca-bundle\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.538806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-config-data\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.540918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-combined-ca-bundle\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.544411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-config-data\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.547916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt9hk\" (UniqueName: \"kubernetes.io/projected/11a8d81f-ec12-4073-abad-8023c585e9c7-kube-api-access-gt9hk\") pod \"neutron-db-sync-m4mp9\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.548424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nccx\" (UniqueName: \"kubernetes.io/projected/6806d38c-af44-4215-94da-a24176d6e8f2-kube-api-access-5nccx\") pod \"placement-db-sync-f6jrf\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.553410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4swdn\" (UniqueName: \"kubernetes.io/projected/3882a022-56e5-4765-81a1-bb57a63ce3f6-kube-api-access-4swdn\") pod \"ceilometer-0\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.569175 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.589388 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.615685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-db-sync-config-data\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.616121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-combined-ca-bundle\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.616147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wj5m5\" (UniqueName: \"kubernetes.io/projected/4488e602-68fa-4259-987c-2279513c4394-kube-api-access-wj5m5\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.624144 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-combined-ca-bundle\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.626169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-db-sync-config-data\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.627903 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.644691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj5m5\" (UniqueName: \"kubernetes.io/projected/4488e602-68fa-4259-987c-2279513c4394-kube-api-access-wj5m5\") pod \"barbican-db-sync-9kqsk\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.646823 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-5dnxh"] Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.743854 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.798739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" event={"ID":"fa50e10d-174a-4a02-ba42-e3926492061a","Type":"ContainerStarted","Data":"8c2c99ca5dcd8c36887ab1f9f6d1e9aa428317a9e96bd2b3c2169cc6c7887a2f"} Nov 21 12:43:50 crc kubenswrapper[4769]: I1121 12:43:50.927592 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:50 crc kubenswrapper[4769]: W1121 12:43:50.940006 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3882a022_56e5_4765_81a1_bb57a63ce3f6.slice/crio-2e5c2dc69e723c6795073ef5eb385e9003fe650daa0889379441634771ffb13a WatchSource:0}: Error finding container 2e5c2dc69e723c6795073ef5eb385e9003fe650daa0889379441634771ffb13a: Status 404 returned error can't find the container with id 2e5c2dc69e723c6795073ef5eb385e9003fe650daa0889379441634771ffb13a Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.035720 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f6jrf"] Nov 21 12:43:51 crc kubenswrapper[4769]: W1121 12:43:51.040470 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6806d38c_af44_4215_94da_a24176d6e8f2.slice/crio-a3bff6735f6ae2cd82026660270f66ad7ff15862838b78810d231a4c5ca5c9f2 WatchSource:0}: Error finding container a3bff6735f6ae2cd82026660270f66ad7ff15862838b78810d231a4c5ca5c9f2: Status 404 returned error can't find the container with id a3bff6735f6ae2cd82026660270f66ad7ff15862838b78810d231a4c5ca5c9f2 Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.135335 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.136823 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.142710 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.143012 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.143134 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.143262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-5zhpj" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.161734 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.206242 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.208158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.211418 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-9kqsk"] Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.211545 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.211882 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.227528 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.249322 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-m4mp9"] Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.334745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335288 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335438 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-config-data\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw5qk\" (UniqueName: \"kubernetes.io/projected/b0bb55ab-8c4f-4727-a23e-e43de11e671a-kube-api-access-kw5qk\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-scripts\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bmv\" (UniqueName: \"kubernetes.io/projected/1d7ee6ee-645a-4313-b766-6cff0828738c-kube-api-access-88bmv\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-logs\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-logs\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.335763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-logs\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-logs\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-config-data\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kw5qk\" (UniqueName: \"kubernetes.io/projected/b0bb55ab-8c4f-4727-a23e-e43de11e671a-kube-api-access-kw5qk\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-scripts\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-88bmv\" (UniqueName: \"kubernetes.io/projected/1d7ee6ee-645a-4313-b766-6cff0828738c-kube-api-access-88bmv\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.438821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.439136 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.440312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-logs\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.440808 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.442436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.443716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-logs\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.443839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.448614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-config-data\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.460606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.460616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.460705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-scripts\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.461238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.461970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.467265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.467991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bmv\" (UniqueName: \"kubernetes.io/projected/1d7ee6ee-645a-4313-b766-6cff0828738c-kube-api-access-88bmv\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.489069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw5qk\" (UniqueName: \"kubernetes.io/projected/b0bb55ab-8c4f-4727-a23e-e43de11e671a-kube-api-access-kw5qk\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.491010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.560820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.623681 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.824254 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.825376 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.833815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" event={"ID":"fa50e10d-174a-4a02-ba42-e3926492061a","Type":"ContainerStarted","Data":"a18368bbfd1881b256f49fcd5b14d901fb12e9968b865524c3ba12b9efabb776"} Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.839722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" event={"ID":"6806d38c-af44-4215-94da-a24176d6e8f2","Type":"ContainerStarted","Data":"a3bff6735f6ae2cd82026660270f66ad7ff15862838b78810d231a4c5ca5c9f2"} Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.848699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" event={"ID":"4488e602-68fa-4259-987c-2279513c4394","Type":"ContainerStarted","Data":"c999830b76a80a5e4d88e7294ab63e5c59f75e6f612ab8717404827d0343c280"} Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.850903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerStarted","Data":"2e5c2dc69e723c6795073ef5eb385e9003fe650daa0889379441634771ffb13a"} Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.852678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" event={"ID":"11a8d81f-ec12-4073-abad-8023c585e9c7","Type":"ContainerStarted","Data":"9c1e12e08ffa678ea053159381479dc8041488ea97f1e326546cb86646c16843"} Nov 21 12:43:51 crc kubenswrapper[4769]: I1121 12:43:51.865395 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" podStartSLOduration=2.865369226 podStartE2EDuration="2.865369226s" podCreationTimestamp="2025-11-21 12:43:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:51.859528638 +0000 UTC m=+3190.560190456" watchObservedRunningTime="2025-11-21 12:43:51.865369226 +0000 UTC m=+3190.566031034" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.150562 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.270017 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.325279 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.423627 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.466282 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.517243 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gtxxc"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.518799 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.521637 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.522181 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-tghfr" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.522420 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.552600 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gtxxc"] Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.625563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhbj\" (UniqueName: \"kubernetes.io/projected/3fab6c98-700a-4db9-9d2f-073777822c73-kube-api-access-wvhbj\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.627333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3fab6c98-700a-4db9-9d2f-073777822c73-etc-machine-id\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.627527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-config-data\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.627566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-scripts\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.627593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-db-sync-config-data\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.627619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-combined-ca-bundle\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.729583 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-db-sync-config-data\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.729652 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-combined-ca-bundle\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.729691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhbj\" (UniqueName: \"kubernetes.io/projected/3fab6c98-700a-4db9-9d2f-073777822c73-kube-api-access-wvhbj\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.729721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3fab6c98-700a-4db9-9d2f-073777822c73-etc-machine-id\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.729831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-config-data\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.729854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-scripts\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.731383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3fab6c98-700a-4db9-9d2f-073777822c73-etc-machine-id\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.734770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-db-sync-config-data\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.740005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-config-data\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.746096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-combined-ca-bundle\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.747956 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-scripts\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.755141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhbj\" (UniqueName: \"kubernetes.io/projected/3fab6c98-700a-4db9-9d2f-073777822c73-kube-api-access-wvhbj\") pod \"cinder-db-sync-gtxxc\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.860695 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.883356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" event={"ID":"6806d38c-af44-4215-94da-a24176d6e8f2","Type":"ContainerStarted","Data":"e43fc4d47f13fba7663df675f878c9ab6d36809a417f4c19ea834263800b56fd"} Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.891480 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b0bb55ab-8c4f-4727-a23e-e43de11e671a","Type":"ContainerStarted","Data":"99b2ea1d3e170310db6446e8b5e7906f15f2d04d9c758e3f5ebb1cdb8751e4dc"} Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.896147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" event={"ID":"4488e602-68fa-4259-987c-2279513c4394","Type":"ContainerStarted","Data":"7562f740e26699884921a47916494594b3f11a00d0f7ad28b5268a217bf687d7"} Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.899694 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" podStartSLOduration=2.89968094 podStartE2EDuration="2.89968094s" podCreationTimestamp="2025-11-21 12:43:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:52.897873221 +0000 UTC m=+3191.598535029" watchObservedRunningTime="2025-11-21 12:43:52.89968094 +0000 UTC m=+3191.600342758" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.919475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerStarted","Data":"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36"} Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.919768 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" podStartSLOduration=2.919745776 podStartE2EDuration="2.919745776s" podCreationTimestamp="2025-11-21 12:43:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:52.915401497 +0000 UTC m=+3191.616063315" watchObservedRunningTime="2025-11-21 12:43:52.919745776 +0000 UTC m=+3191.620407594" Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.930001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" event={"ID":"11a8d81f-ec12-4073-abad-8023c585e9c7","Type":"ContainerStarted","Data":"d3d1d7821d4449d88e497d1e36e71f5304a668b4bfe41add2dcfd48fec53c39e"} Nov 21 12:43:52 crc kubenswrapper[4769]: I1121 12:43:52.961329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1d7ee6ee-645a-4313-b766-6cff0828738c","Type":"ContainerStarted","Data":"bd70684dae1ce0f87a8301aea92b2153b61f32929cf366fc660f82188f15fab3"} Nov 21 12:43:53 crc kubenswrapper[4769]: I1121 12:43:53.322960 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" podStartSLOduration=3.322936059 podStartE2EDuration="3.322936059s" podCreationTimestamp="2025-11-21 12:43:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:52.961418349 +0000 UTC m=+3191.662080187" watchObservedRunningTime="2025-11-21 12:43:53.322936059 +0000 UTC m=+3192.023597877" Nov 21 12:43:53 crc kubenswrapper[4769]: I1121 12:43:53.549714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gtxxc"] Nov 21 12:43:53 crc kubenswrapper[4769]: W1121 12:43:53.604478 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fab6c98_700a_4db9_9d2f_073777822c73.slice/crio-65c2cad51c5adbe50f3055e7d78bfdbf35b61e3b91df303a8e49cf5c0cb343f6 WatchSource:0}: Error finding container 65c2cad51c5adbe50f3055e7d78bfdbf35b61e3b91df303a8e49cf5c0cb343f6: Status 404 returned error can't find the container with id 65c2cad51c5adbe50f3055e7d78bfdbf35b61e3b91df303a8e49cf5c0cb343f6 Nov 21 12:43:53 crc kubenswrapper[4769]: I1121 12:43:53.996837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerStarted","Data":"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792"} Nov 21 12:43:53 crc kubenswrapper[4769]: I1121 12:43:53.997577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerStarted","Data":"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61"} Nov 21 12:43:53 crc kubenswrapper[4769]: I1121 12:43:53.999711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" event={"ID":"3fab6c98-700a-4db9-9d2f-073777822c73","Type":"ContainerStarted","Data":"65c2cad51c5adbe50f3055e7d78bfdbf35b61e3b91df303a8e49cf5c0cb343f6"} Nov 21 12:43:54 crc kubenswrapper[4769]: I1121 12:43:54.011827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1d7ee6ee-645a-4313-b766-6cff0828738c","Type":"ContainerStarted","Data":"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2"} Nov 21 12:43:54 crc kubenswrapper[4769]: I1121 12:43:54.024342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b0bb55ab-8c4f-4727-a23e-e43de11e671a","Type":"ContainerStarted","Data":"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65"} Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.041630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" event={"ID":"3fab6c98-700a-4db9-9d2f-073777822c73","Type":"ContainerStarted","Data":"2016abda21e152de0ecf12b4a36864158a88c66c7855057f3e6bbc05174cdfcb"} Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.048107 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1d7ee6ee-645a-4313-b766-6cff0828738c","Type":"ContainerStarted","Data":"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3"} Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.048463 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-log" containerID="cri-o://50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2" gracePeriod=30 Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.048672 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-httpd" containerID="cri-o://1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3" gracePeriod=30 Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.072602 4769 generic.go:334] "Generic (PLEG): container finished" podID="6806d38c-af44-4215-94da-a24176d6e8f2" containerID="e43fc4d47f13fba7663df675f878c9ab6d36809a417f4c19ea834263800b56fd" exitCode=0 Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.073108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" event={"ID":"6806d38c-af44-4215-94da-a24176d6e8f2","Type":"ContainerDied","Data":"e43fc4d47f13fba7663df675f878c9ab6d36809a417f4c19ea834263800b56fd"} Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.081655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b0bb55ab-8c4f-4727-a23e-e43de11e671a","Type":"ContainerStarted","Data":"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22"} Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.081953 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-log" containerID="cri-o://6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65" gracePeriod=30 Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.082157 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-httpd" containerID="cri-o://f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22" gracePeriod=30 Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.091555 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" podStartSLOduration=3.091523847 podStartE2EDuration="3.091523847s" podCreationTimestamp="2025-11-21 12:43:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:55.065212101 +0000 UTC m=+3193.765873909" watchObservedRunningTime="2025-11-21 12:43:55.091523847 +0000 UTC m=+3193.792185665" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.109524 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.109498405 podStartE2EDuration="5.109498405s" podCreationTimestamp="2025-11-21 12:43:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:55.094409775 +0000 UTC m=+3193.795071593" watchObservedRunningTime="2025-11-21 12:43:55.109498405 +0000 UTC m=+3193.810160223" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.145422 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.145399792 podStartE2EDuration="5.145399792s" podCreationTimestamp="2025-11-21 12:43:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:55.14533791 +0000 UTC m=+3193.845999728" watchObservedRunningTime="2025-11-21 12:43:55.145399792 +0000 UTC m=+3193.846061610" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.714293 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.766023 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.855987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856038 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-public-tls-certs\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-scripts\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856218 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-config-data\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-httpd-run\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw5qk\" (UniqueName: \"kubernetes.io/projected/b0bb55ab-8c4f-4727-a23e-e43de11e671a-kube-api-access-kw5qk\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-logs\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-combined-ca-bundle\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-internal-tls-certs\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-httpd-run\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-combined-ca-bundle\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-scripts\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-logs\") pod \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\" (UID: \"b0bb55ab-8c4f-4727-a23e-e43de11e671a\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-config-data\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88bmv\" (UniqueName: \"kubernetes.io/projected/1d7ee6ee-645a-4313-b766-6cff0828738c-kube-api-access-88bmv\") pod \"1d7ee6ee-645a-4313-b766-6cff0828738c\" (UID: \"1d7ee6ee-645a-4313-b766-6cff0828738c\") " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.856997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.857316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-logs" (OuterVolumeSpecName: "logs") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.857435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-logs" (OuterVolumeSpecName: "logs") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.857570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.863428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.863635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0bb55ab-8c4f-4727-a23e-e43de11e671a-kube-api-access-kw5qk" (OuterVolumeSpecName: "kube-api-access-kw5qk") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "kube-api-access-kw5qk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.864350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-scripts" (OuterVolumeSpecName: "scripts") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.867397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-scripts" (OuterVolumeSpecName: "scripts") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.869227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7ee6ee-645a-4313-b766-6cff0828738c-kube-api-access-88bmv" (OuterVolumeSpecName: "kube-api-access-88bmv") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "kube-api-access-88bmv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.869346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "glance") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.893883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.894515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.913178 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.917898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-config-data" (OuterVolumeSpecName: "config-data") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.920280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-config-data" (OuterVolumeSpecName: "config-data") pod "b0bb55ab-8c4f-4727-a23e-e43de11e671a" (UID: "b0bb55ab-8c4f-4727-a23e-e43de11e671a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.922991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1d7ee6ee-645a-4313-b766-6cff0828738c" (UID: "1d7ee6ee-645a-4313-b766-6cff0828738c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962408 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962539 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962573 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962628 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-88bmv\" (UniqueName: \"kubernetes.io/projected/1d7ee6ee-645a-4313-b766-6cff0828738c-kube-api-access-88bmv\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962714 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962725 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962737 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962746 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b0bb55ab-8c4f-4727-a23e-e43de11e671a-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962775 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962789 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kw5qk\" (UniqueName: \"kubernetes.io/projected/b0bb55ab-8c4f-4727-a23e-e43de11e671a-kube-api-access-kw5qk\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962809 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962818 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962828 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0bb55ab-8c4f-4727-a23e-e43de11e671a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962858 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962868 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1d7ee6ee-645a-4313-b766-6cff0828738c-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.962877 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7ee6ee-645a-4313-b766-6cff0828738c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.980785 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:43:55 crc kubenswrapper[4769]: I1121 12:43:55.985075 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.064238 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.064278 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.104728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerStarted","Data":"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.105003 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-central-agent" containerID="cri-o://057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" gracePeriod=30 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.105040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="proxy-httpd" containerID="cri-o://00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" gracePeriod=30 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.105104 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.105113 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-notification-agent" containerID="cri-o://1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" gracePeriod=30 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.105027 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="sg-core" containerID="cri-o://aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" gracePeriod=30 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.112077 4769 generic.go:334] "Generic (PLEG): container finished" podID="fa50e10d-174a-4a02-ba42-e3926492061a" containerID="a18368bbfd1881b256f49fcd5b14d901fb12e9968b865524c3ba12b9efabb776" exitCode=0 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.112346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" event={"ID":"fa50e10d-174a-4a02-ba42-e3926492061a","Type":"ContainerDied","Data":"a18368bbfd1881b256f49fcd5b14d901fb12e9968b865524c3ba12b9efabb776"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118128 4769 generic.go:334] "Generic (PLEG): container finished" podID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerID="1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3" exitCode=0 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118152 4769 generic.go:334] "Generic (PLEG): container finished" podID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerID="50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2" exitCode=143 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118201 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1d7ee6ee-645a-4313-b766-6cff0828738c","Type":"ContainerDied","Data":"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1d7ee6ee-645a-4313-b766-6cff0828738c","Type":"ContainerDied","Data":"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1d7ee6ee-645a-4313-b766-6cff0828738c","Type":"ContainerDied","Data":"bd70684dae1ce0f87a8301aea92b2153b61f32929cf366fc660f82188f15fab3"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.118311 4769 scope.go:117] "RemoveContainer" containerID="1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.124452 4769 generic.go:334] "Generic (PLEG): container finished" podID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerID="f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22" exitCode=0 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.124474 4769 generic.go:334] "Generic (PLEG): container finished" podID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerID="6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65" exitCode=143 Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.124673 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.144135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b0bb55ab-8c4f-4727-a23e-e43de11e671a","Type":"ContainerDied","Data":"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.144238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b0bb55ab-8c4f-4727-a23e-e43de11e671a","Type":"ContainerDied","Data":"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.144250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b0bb55ab-8c4f-4727-a23e-e43de11e671a","Type":"ContainerDied","Data":"99b2ea1d3e170310db6446e8b5e7906f15f2d04d9c758e3f5ebb1cdb8751e4dc"} Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.151317 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.949788732 podStartE2EDuration="6.151294892s" podCreationTimestamp="2025-11-21 12:43:50 +0000 UTC" firstStartedPulling="2025-11-21 12:43:50.946856622 +0000 UTC m=+3189.647518440" lastFinishedPulling="2025-11-21 12:43:55.148362782 +0000 UTC m=+3193.849024600" observedRunningTime="2025-11-21 12:43:56.144768335 +0000 UTC m=+3194.845430163" watchObservedRunningTime="2025-11-21 12:43:56.151294892 +0000 UTC m=+3194.851956710" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.172636 4769 scope.go:117] "RemoveContainer" containerID="50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.218198 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.227755 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249098 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.249489 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-httpd" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249502 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-httpd" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.249517 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-httpd" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249523 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-httpd" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.249539 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-log" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249545 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-log" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.249566 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-log" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249572 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-log" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249747 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-httpd" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249762 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-httpd" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" containerName="glance-log" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.249778 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" containerName="glance-log" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.250685 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.253705 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.254662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.254900 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-5zhpj" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.255304 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.260732 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-logs\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.389753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbf2\" (UniqueName: \"kubernetes.io/projected/5e0b8e2f-1237-41b9-a04b-787064d2047b-kube-api-access-7zbf2\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.409169 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.415435 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.419222 4769 scope.go:117] "RemoveContainer" containerID="1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.419669 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3\": container with ID starting with 1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3 not found: ID does not exist" containerID="1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.419699 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3"} err="failed to get container status \"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3\": rpc error: code = NotFound desc = could not find container \"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3\": container with ID starting with 1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.419727 4769 scope.go:117] "RemoveContainer" containerID="50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.420140 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2\": container with ID starting with 50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2 not found: ID does not exist" containerID="50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.420160 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2"} err="failed to get container status \"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2\": rpc error: code = NotFound desc = could not find container \"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2\": container with ID starting with 50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.420172 4769 scope.go:117] "RemoveContainer" containerID="1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.420483 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3"} err="failed to get container status \"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3\": rpc error: code = NotFound desc = could not find container \"1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3\": container with ID starting with 1aa769c94c8353a7d5713fd0bc5ae3316dafe92a429b894232fa87b1246a23f3 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.420503 4769 scope.go:117] "RemoveContainer" containerID="50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.420708 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2"} err="failed to get container status \"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2\": rpc error: code = NotFound desc = could not find container \"50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2\": container with ID starting with 50dadd0fb80523b148c8cf4730b5776cf899af2512bf2fb5d27a470b94ee7fe2 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.420722 4769 scope.go:117] "RemoveContainer" containerID="f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.436177 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.437649 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.439906 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.440149 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.454337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.476009 4769 scope.go:117] "RemoveContainer" containerID="6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.505810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.505961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.506167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.506243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-logs\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.506330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.506394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbf2\" (UniqueName: \"kubernetes.io/projected/5e0b8e2f-1237-41b9-a04b-787064d2047b-kube-api-access-7zbf2\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.506511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.506579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.513892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-logs\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.522838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.524147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.524260 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.531263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.532073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.543794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.544772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbf2\" (UniqueName: \"kubernetes.io/projected/5e0b8e2f-1237-41b9-a04b-787064d2047b-kube-api-access-7zbf2\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.565372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.582178 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.588595 4769 scope.go:117] "RemoveContainer" containerID="f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.589041 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22\": container with ID starting with f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22 not found: ID does not exist" containerID="f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.589118 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22"} err="failed to get container status \"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22\": rpc error: code = NotFound desc = could not find container \"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22\": container with ID starting with f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.589161 4769 scope.go:117] "RemoveContainer" containerID="6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65" Nov 21 12:43:56 crc kubenswrapper[4769]: E1121 12:43:56.589604 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65\": container with ID starting with 6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65 not found: ID does not exist" containerID="6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.589656 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65"} err="failed to get container status \"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65\": rpc error: code = NotFound desc = could not find container \"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65\": container with ID starting with 6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.589694 4769 scope.go:117] "RemoveContainer" containerID="f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.590024 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22"} err="failed to get container status \"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22\": rpc error: code = NotFound desc = could not find container \"f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22\": container with ID starting with f628e6b9df7d3fdbb3fab67033a084899fe60a0bcacfab69139a467669ba5e22 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.590168 4769 scope.go:117] "RemoveContainer" containerID="6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.590504 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65"} err="failed to get container status \"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65\": rpc error: code = NotFound desc = could not find container \"6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65\": container with ID starting with 6fbe5d1e35d17fab910610ef6dcdcccec5366ee68b391c9e9a27bd359f19ee65 not found: ID does not exist" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.623130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.623361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.623477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-config-data\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.623617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.623812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.623921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-logs\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.624001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-scripts\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.624380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smbx\" (UniqueName: \"kubernetes.io/projected/13c6fb58-b0b0-4980-bd79-a86a2375f047-kube-api-access-5smbx\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.724451 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.725580 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nccx\" (UniqueName: \"kubernetes.io/projected/6806d38c-af44-4215-94da-a24176d6e8f2-kube-api-access-5nccx\") pod \"6806d38c-af44-4215-94da-a24176d6e8f2\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.725797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-config-data\") pod \"6806d38c-af44-4215-94da-a24176d6e8f2\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.725864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6806d38c-af44-4215-94da-a24176d6e8f2-logs\") pod \"6806d38c-af44-4215-94da-a24176d6e8f2\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.725923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-combined-ca-bundle\") pod \"6806d38c-af44-4215-94da-a24176d6e8f2\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.725971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-scripts\") pod \"6806d38c-af44-4215-94da-a24176d6e8f2\" (UID: \"6806d38c-af44-4215-94da-a24176d6e8f2\") " Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-config-data\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726647 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6806d38c-af44-4215-94da-a24176d6e8f2-logs" (OuterVolumeSpecName: "logs") pod "6806d38c-af44-4215-94da-a24176d6e8f2" (UID: "6806d38c-af44-4215-94da-a24176d6e8f2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-logs\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-scripts\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5smbx\" (UniqueName: \"kubernetes.io/projected/13c6fb58-b0b0-4980-bd79-a86a2375f047-kube-api-access-5smbx\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.726849 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6806d38c-af44-4215-94da-a24176d6e8f2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.727581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-logs\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.728087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.730354 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.731338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-scripts" (OuterVolumeSpecName: "scripts") pod "6806d38c-af44-4215-94da-a24176d6e8f2" (UID: "6806d38c-af44-4215-94da-a24176d6e8f2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.733388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6806d38c-af44-4215-94da-a24176d6e8f2-kube-api-access-5nccx" (OuterVolumeSpecName: "kube-api-access-5nccx") pod "6806d38c-af44-4215-94da-a24176d6e8f2" (UID: "6806d38c-af44-4215-94da-a24176d6e8f2"). InnerVolumeSpecName "kube-api-access-5nccx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.733803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.735228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-config-data\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.732801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-scripts\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.744790 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.745679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smbx\" (UniqueName: \"kubernetes.io/projected/13c6fb58-b0b0-4980-bd79-a86a2375f047-kube-api-access-5smbx\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.775759 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-config-data" (OuterVolumeSpecName: "config-data") pod "6806d38c-af44-4215-94da-a24176d6e8f2" (UID: "6806d38c-af44-4215-94da-a24176d6e8f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.778903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6806d38c-af44-4215-94da-a24176d6e8f2" (UID: "6806d38c-af44-4215-94da-a24176d6e8f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.786800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.828645 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5nccx\" (UniqueName: \"kubernetes.io/projected/6806d38c-af44-4215-94da-a24176d6e8f2-kube-api-access-5nccx\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.828689 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.828702 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.828712 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6806d38c-af44-4215-94da-a24176d6e8f2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:56 crc kubenswrapper[4769]: I1121 12:43:56.966925 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.056805 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.141289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4swdn\" (UniqueName: \"kubernetes.io/projected/3882a022-56e5-4765-81a1-bb57a63ce3f6-kube-api-access-4swdn\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.142610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-run-httpd\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-combined-ca-bundle\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-scripts\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-config-data\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143155 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-log-httpd\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-sg-core-conf-yaml\") pod \"3882a022-56e5-4765-81a1-bb57a63ce3f6\" (UID: \"3882a022-56e5-4765-81a1-bb57a63ce3f6\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.143760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.144535 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.144580 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3882a022-56e5-4765-81a1-bb57a63ce3f6-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.146184 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3882a022-56e5-4765-81a1-bb57a63ce3f6-kube-api-access-4swdn" (OuterVolumeSpecName: "kube-api-access-4swdn") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "kube-api-access-4swdn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.147817 4769 generic.go:334] "Generic (PLEG): container finished" podID="4488e602-68fa-4259-987c-2279513c4394" containerID="7562f740e26699884921a47916494594b3f11a00d0f7ad28b5268a217bf687d7" exitCode=0 Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.147843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" event={"ID":"4488e602-68fa-4259-987c-2279513c4394","Type":"ContainerDied","Data":"7562f740e26699884921a47916494594b3f11a00d0f7ad28b5268a217bf687d7"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.177443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-scripts" (OuterVolumeSpecName: "scripts") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180626 4769 generic.go:334] "Generic (PLEG): container finished" podID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" exitCode=0 Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180665 4769 generic.go:334] "Generic (PLEG): container finished" podID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" exitCode=2 Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180674 4769 generic.go:334] "Generic (PLEG): container finished" podID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" exitCode=0 Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180687 4769 generic.go:334] "Generic (PLEG): container finished" podID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" exitCode=0 Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerDied","Data":"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerDied","Data":"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerDied","Data":"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerDied","Data":"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3882a022-56e5-4765-81a1-bb57a63ce3f6","Type":"ContainerDied","Data":"2e5c2dc69e723c6795073ef5eb385e9003fe650daa0889379441634771ffb13a"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.180848 4769 scope.go:117] "RemoveContainer" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.181030 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.208093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" event={"ID":"6806d38c-af44-4215-94da-a24176d6e8f2","Type":"ContainerDied","Data":"a3bff6735f6ae2cd82026660270f66ad7ff15862838b78810d231a4c5ca5c9f2"} Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.208140 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3bff6735f6ae2cd82026660270f66ad7ff15862838b78810d231a4c5ca5c9f2" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.208225 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.235954 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.259775 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4swdn\" (UniqueName: \"kubernetes.io/projected/3882a022-56e5-4765-81a1-bb57a63ce3f6-kube-api-access-4swdn\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.259814 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.259848 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.289992 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d7ee6ee-645a-4313-b766-6cff0828738c" path="/var/lib/kubelet/pods/1d7ee6ee-645a-4313-b766-6cff0828738c/volumes" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.290921 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0bb55ab-8c4f-4727-a23e-e43de11e671a" path="/var/lib/kubelet/pods/b0bb55ab-8c4f-4727-a23e-e43de11e671a/volumes" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.293707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: W1121 12:43:57.340904 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e0b8e2f_1237_41b9_a04b_787064d2047b.slice/crio-f7f0902e1f7aadaa68c9eee87030fc729ee202beecb74b96cbdae441379f1b94 WatchSource:0}: Error finding container f7f0902e1f7aadaa68c9eee87030fc729ee202beecb74b96cbdae441379f1b94: Status 404 returned error can't find the container with id f7f0902e1f7aadaa68c9eee87030fc729ee202beecb74b96cbdae441379f1b94 Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.363440 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.391316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-config-data" (OuterVolumeSpecName: "config-data") pod "3882a022-56e5-4765-81a1-bb57a63ce3f6" (UID: "3882a022-56e5-4765-81a1-bb57a63ce3f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.394222 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-77cdbfb47d-zxg6d"] Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.395427 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-notification-agent" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395458 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-notification-agent" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.395494 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="sg-core" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395505 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="sg-core" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.395520 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-central-agent" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395529 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-central-agent" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.395565 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6806d38c-af44-4215-94da-a24176d6e8f2" containerName="placement-db-sync" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395573 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6806d38c-af44-4215-94da-a24176d6e8f2" containerName="placement-db-sync" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.395582 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="proxy-httpd" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395589 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="proxy-httpd" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395945 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-notification-agent" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.395993 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="sg-core" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.396062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6806d38c-af44-4215-94da-a24176d6e8f2" containerName="placement-db-sync" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.396104 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="proxy-httpd" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.396116 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" containerName="ceilometer-central-agent" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.397647 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77cdbfb47d-zxg6d"] Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.397678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.397796 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.401394 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.401628 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-skr4t" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.401758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.403090 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.404238 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.415796 4769 scope.go:117] "RemoveContainer" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.441628 4769 scope.go:117] "RemoveContainer" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6th\" (UniqueName: \"kubernetes.io/projected/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-kube-api-access-bp6th\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-config-data\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-logs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-scripts\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-combined-ca-bundle\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-public-tls-certs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.468929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-internal-tls-certs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.469175 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3882a022-56e5-4765-81a1-bb57a63ce3f6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.482597 4769 scope.go:117] "RemoveContainer" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.548032 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.549917 4769 scope.go:117] "RemoveContainer" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.551404 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": container with ID starting with 00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749 not found: ID does not exist" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.551457 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749"} err="failed to get container status \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": rpc error: code = NotFound desc = could not find container \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": container with ID starting with 00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.551488 4769 scope.go:117] "RemoveContainer" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.551809 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": container with ID starting with aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61 not found: ID does not exist" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.551843 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61"} err="failed to get container status \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": rpc error: code = NotFound desc = could not find container \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": container with ID starting with aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.551868 4769 scope.go:117] "RemoveContainer" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.552084 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": container with ID starting with 1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792 not found: ID does not exist" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.552110 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792"} err="failed to get container status \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": rpc error: code = NotFound desc = could not find container \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": container with ID starting with 1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.552124 4769 scope.go:117] "RemoveContainer" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" Nov 21 12:43:57 crc kubenswrapper[4769]: E1121 12:43:57.552715 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": container with ID starting with 057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36 not found: ID does not exist" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.552749 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36"} err="failed to get container status \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": rpc error: code = NotFound desc = could not find container \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": container with ID starting with 057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.552767 4769 scope.go:117] "RemoveContainer" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.554548 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749"} err="failed to get container status \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": rpc error: code = NotFound desc = could not find container \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": container with ID starting with 00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.554574 4769 scope.go:117] "RemoveContainer" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.554792 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61"} err="failed to get container status \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": rpc error: code = NotFound desc = could not find container \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": container with ID starting with aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.554813 4769 scope.go:117] "RemoveContainer" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555019 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792"} err="failed to get container status \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": rpc error: code = NotFound desc = could not find container \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": container with ID starting with 1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555038 4769 scope.go:117] "RemoveContainer" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555281 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36"} err="failed to get container status \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": rpc error: code = NotFound desc = could not find container \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": container with ID starting with 057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555296 4769 scope.go:117] "RemoveContainer" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555560 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749"} err="failed to get container status \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": rpc error: code = NotFound desc = could not find container \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": container with ID starting with 00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555581 4769 scope.go:117] "RemoveContainer" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555790 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61"} err="failed to get container status \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": rpc error: code = NotFound desc = could not find container \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": container with ID starting with aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.555808 4769 scope.go:117] "RemoveContainer" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.556259 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792"} err="failed to get container status \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": rpc error: code = NotFound desc = could not find container \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": container with ID starting with 1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.556319 4769 scope.go:117] "RemoveContainer" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.556737 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36"} err="failed to get container status \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": rpc error: code = NotFound desc = could not find container \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": container with ID starting with 057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.556813 4769 scope.go:117] "RemoveContainer" containerID="00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.557335 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749"} err="failed to get container status \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": rpc error: code = NotFound desc = could not find container \"00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749\": container with ID starting with 00964457ad66c54a98445a14c85e74aa309acdad64004b73350064f0f8b84749 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.557396 4769 scope.go:117] "RemoveContainer" containerID="aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.558031 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61"} err="failed to get container status \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": rpc error: code = NotFound desc = could not find container \"aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61\": container with ID starting with aca4e30696b10fd0567083da3f34aa6c3084996fb7a9fc74de0963e59d095e61 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.558058 4769 scope.go:117] "RemoveContainer" containerID="1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.558640 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792"} err="failed to get container status \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": rpc error: code = NotFound desc = could not find container \"1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792\": container with ID starting with 1e16db2e072fd9ec9c34e6e9ed347c19ff30da33a987fdf17b7643b8a5d3a792 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.558906 4769 scope.go:117] "RemoveContainer" containerID="057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.559885 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.561287 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36"} err="failed to get container status \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": rpc error: code = NotFound desc = could not find container \"057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36\": container with ID starting with 057e00976876143189ea8fa13061a4c1a64b8f53e26e13cb6497d2bbe6550f36 not found: ID does not exist" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.571692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6th\" (UniqueName: \"kubernetes.io/projected/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-kube-api-access-bp6th\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.571740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-config-data\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.571793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-logs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.572819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-logs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.573690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-scripts\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.573776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-combined-ca-bundle\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.573806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-public-tls-certs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.573835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-internal-tls-certs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.574930 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.577158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.584932 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.585262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.586924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-internal-tls-certs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.587047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-public-tls-certs\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.587264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-scripts\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.596080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-combined-ca-bundle\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.615000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-config-data\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.619286 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.620506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6th\" (UniqueName: \"kubernetes.io/projected/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-kube-api-access-bp6th\") pod \"placement-77cdbfb47d-zxg6d\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.653556 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.662048 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:43:57 crc kubenswrapper[4769]: W1121 12:43:57.667681 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13c6fb58_b0b0_4980_bd79_a86a2375f047.slice/crio-f0b1790df257f406860bd12abf5b4ec17d7afbb9299efa36dec933b203a3531b WatchSource:0}: Error finding container f0b1790df257f406860bd12abf5b4ec17d7afbb9299efa36dec933b203a3531b: Status 404 returned error can't find the container with id f0b1790df257f406860bd12abf5b4ec17d7afbb9299efa36dec933b203a3531b Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675748 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-log-httpd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqvzd\" (UniqueName: \"kubernetes.io/projected/7adf0c1d-4e74-42b6-acee-ea4c6305e308-kube-api-access-jqvzd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-run-httpd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-config-data\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.675980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-scripts\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.718172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.777744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-credential-keys\") pod \"fa50e10d-174a-4a02-ba42-e3926492061a\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b84t\" (UniqueName: \"kubernetes.io/projected/fa50e10d-174a-4a02-ba42-e3926492061a-kube-api-access-9b84t\") pod \"fa50e10d-174a-4a02-ba42-e3926492061a\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-scripts\") pod \"fa50e10d-174a-4a02-ba42-e3926492061a\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-fernet-keys\") pod \"fa50e10d-174a-4a02-ba42-e3926492061a\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-combined-ca-bundle\") pod \"fa50e10d-174a-4a02-ba42-e3926492061a\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778252 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-config-data\") pod \"fa50e10d-174a-4a02-ba42-e3926492061a\" (UID: \"fa50e10d-174a-4a02-ba42-e3926492061a\") " Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-config-data\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-scripts\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-log-httpd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.778989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jqvzd\" (UniqueName: \"kubernetes.io/projected/7adf0c1d-4e74-42b6-acee-ea4c6305e308-kube-api-access-jqvzd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.779149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-run-httpd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.779201 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.781033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-log-httpd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.782607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-run-httpd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.782915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-scripts" (OuterVolumeSpecName: "scripts") pod "fa50e10d-174a-4a02-ba42-e3926492061a" (UID: "fa50e10d-174a-4a02-ba42-e3926492061a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.783036 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "fa50e10d-174a-4a02-ba42-e3926492061a" (UID: "fa50e10d-174a-4a02-ba42-e3926492061a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.784464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "fa50e10d-174a-4a02-ba42-e3926492061a" (UID: "fa50e10d-174a-4a02-ba42-e3926492061a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.786336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.787909 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa50e10d-174a-4a02-ba42-e3926492061a-kube-api-access-9b84t" (OuterVolumeSpecName: "kube-api-access-9b84t") pod "fa50e10d-174a-4a02-ba42-e3926492061a" (UID: "fa50e10d-174a-4a02-ba42-e3926492061a"). InnerVolumeSpecName "kube-api-access-9b84t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.788436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.789248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-config-data\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.793121 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-scripts\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.800027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqvzd\" (UniqueName: \"kubernetes.io/projected/7adf0c1d-4e74-42b6-acee-ea4c6305e308-kube-api-access-jqvzd\") pod \"ceilometer-0\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.812877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fa50e10d-174a-4a02-ba42-e3926492061a" (UID: "fa50e10d-174a-4a02-ba42-e3926492061a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.827783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-config-data" (OuterVolumeSpecName: "config-data") pod "fa50e10d-174a-4a02-ba42-e3926492061a" (UID: "fa50e10d-174a-4a02-ba42-e3926492061a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.881376 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.881421 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9b84t\" (UniqueName: \"kubernetes.io/projected/fa50e10d-174a-4a02-ba42-e3926492061a-kube-api-access-9b84t\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.881432 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.881441 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.881450 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.881460 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fa50e10d-174a-4a02-ba42-e3926492061a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:57 crc kubenswrapper[4769]: I1121 12:43:57.916623 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.194907 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-77cdbfb47d-zxg6d"] Nov 21 12:43:58 crc kubenswrapper[4769]: W1121 12:43:58.206594 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bed045d_dcfa_4235_a778_cc12b3ee6a6c.slice/crio-3cdbb534a44ca0f14a9137c6b8b38dcd4d4189c0b8901c83aaac76bb039a820f WatchSource:0}: Error finding container 3cdbb534a44ca0f14a9137c6b8b38dcd4d4189c0b8901c83aaac76bb039a820f: Status 404 returned error can't find the container with id 3cdbb534a44ca0f14a9137c6b8b38dcd4d4189c0b8901c83aaac76bb039a820f Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.250715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5e0b8e2f-1237-41b9-a04b-787064d2047b","Type":"ContainerStarted","Data":"bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e"} Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.250763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5e0b8e2f-1237-41b9-a04b-787064d2047b","Type":"ContainerStarted","Data":"f7f0902e1f7aadaa68c9eee87030fc729ee202beecb74b96cbdae441379f1b94"} Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.255576 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" event={"ID":"2bed045d-dcfa-4235-a778-cc12b3ee6a6c","Type":"ContainerStarted","Data":"3cdbb534a44ca0f14a9137c6b8b38dcd4d4189c0b8901c83aaac76bb039a820f"} Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.260650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"13c6fb58-b0b0-4980-bd79-a86a2375f047","Type":"ContainerStarted","Data":"f0b1790df257f406860bd12abf5b4ec17d7afbb9299efa36dec933b203a3531b"} Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.262627 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.266430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-5dnxh" event={"ID":"fa50e10d-174a-4a02-ba42-e3926492061a","Type":"ContainerDied","Data":"8c2c99ca5dcd8c36887ab1f9f6d1e9aa428317a9e96bd2b3c2169cc6c7887a2f"} Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.266480 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c2c99ca5dcd8c36887ab1f9f6d1e9aa428317a9e96bd2b3c2169cc6c7887a2f" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.456597 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-5dnxh"] Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.489679 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-5dnxh"] Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.498413 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dx2cg"] Nov 21 12:43:58 crc kubenswrapper[4769]: E1121 12:43:58.505658 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fa50e10d-174a-4a02-ba42-e3926492061a" containerName="keystone-bootstrap" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.507144 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa50e10d-174a-4a02-ba42-e3926492061a" containerName="keystone-bootstrap" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.507532 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fa50e10d-174a-4a02-ba42-e3926492061a" containerName="keystone-bootstrap" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.509682 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.511352 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.513782 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.514204 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.514646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-68nkp" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.515331 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.515737 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.555304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dx2cg"] Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.607909 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-credential-keys\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.608333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-scripts\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.608402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-combined-ca-bundle\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.608500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-config-data\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.608552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-fernet-keys\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.608596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd6wv\" (UniqueName: \"kubernetes.io/projected/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-kube-api-access-bd6wv\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.656874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.710155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj5m5\" (UniqueName: \"kubernetes.io/projected/4488e602-68fa-4259-987c-2279513c4394-kube-api-access-wj5m5\") pod \"4488e602-68fa-4259-987c-2279513c4394\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.710245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-db-sync-config-data\") pod \"4488e602-68fa-4259-987c-2279513c4394\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.710611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-combined-ca-bundle\") pod \"4488e602-68fa-4259-987c-2279513c4394\" (UID: \"4488e602-68fa-4259-987c-2279513c4394\") " Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.711484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-fernet-keys\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.711590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6wv\" (UniqueName: \"kubernetes.io/projected/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-kube-api-access-bd6wv\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.711647 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-credential-keys\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.711672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-scripts\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.711721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-combined-ca-bundle\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.711761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-config-data\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.719278 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4488e602-68fa-4259-987c-2279513c4394-kube-api-access-wj5m5" (OuterVolumeSpecName: "kube-api-access-wj5m5") pod "4488e602-68fa-4259-987c-2279513c4394" (UID: "4488e602-68fa-4259-987c-2279513c4394"). InnerVolumeSpecName "kube-api-access-wj5m5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.720583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-fernet-keys\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.720594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-scripts\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.721100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-combined-ca-bundle\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.721562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-credential-keys\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.721804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "4488e602-68fa-4259-987c-2279513c4394" (UID: "4488e602-68fa-4259-987c-2279513c4394"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.730900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd6wv\" (UniqueName: \"kubernetes.io/projected/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-kube-api-access-bd6wv\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.734319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-config-data\") pod \"keystone-bootstrap-dx2cg\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.752354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4488e602-68fa-4259-987c-2279513c4394" (UID: "4488e602-68fa-4259-987c-2279513c4394"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.814375 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.814420 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wj5m5\" (UniqueName: \"kubernetes.io/projected/4488e602-68fa-4259-987c-2279513c4394-kube-api-access-wj5m5\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.814440 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/4488e602-68fa-4259-987c-2279513c4394-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:43:58 crc kubenswrapper[4769]: I1121 12:43:58.843868 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.371401 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3882a022-56e5-4765-81a1-bb57a63ce3f6" path="/var/lib/kubelet/pods/3882a022-56e5-4765-81a1-bb57a63ce3f6/volumes" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.374565 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa50e10d-174a-4a02-ba42-e3926492061a" path="/var/lib/kubelet/pods/fa50e10d-174a-4a02-ba42-e3926492061a/volumes" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.385237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5e0b8e2f-1237-41b9-a04b-787064d2047b","Type":"ContainerStarted","Data":"76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.385382 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6"] Nov 21 12:43:59 crc kubenswrapper[4769]: E1121 12:43:59.385869 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4488e602-68fa-4259-987c-2279513c4394" containerName="barbican-db-sync" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.385948 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4488e602-68fa-4259-987c-2279513c4394" containerName="barbican-db-sync" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.386390 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4488e602-68fa-4259-987c-2279513c4394" containerName="barbican-db-sync" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.387752 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl"] Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.389487 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.390360 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.390327643 podStartE2EDuration="3.390327643s" podCreationTimestamp="2025-11-21 12:43:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:59.38469211 +0000 UTC m=+3198.085353928" watchObservedRunningTime="2025-11-21 12:43:59.390327643 +0000 UTC m=+3198.090989451" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.391412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6"] Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.391496 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl"] Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.391657 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.393955 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.394303 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.404597 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerStarted","Data":"dc4f423ba20b7a1b751e6c331e0b1220cb7a7c43454fda5b042c327d4f8e6aad"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.404732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerStarted","Data":"ed4ad3e09e1f586462ae0126693ea61e8f582960a7c9885f6d49f3c327243e11"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.424454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" event={"ID":"4488e602-68fa-4259-987c-2279513c4394","Type":"ContainerDied","Data":"c999830b76a80a5e4d88e7294ab63e5c59f75e6f612ab8717404827d0343c280"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.424503 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c999830b76a80a5e4d88e7294ab63e5c59f75e6f612ab8717404827d0343c280" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.424578 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-9kqsk" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.431540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.431996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-combined-ca-bundle\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data-custom\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432374 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data-custom\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432584 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-combined-ca-bundle\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2956e126-fdb7-48f8-866d-fd679d38c050-logs\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-logs\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.432865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmr7w\" (UniqueName: \"kubernetes.io/projected/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-kube-api-access-tmr7w\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.433033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw924\" (UniqueName: \"kubernetes.io/projected/2956e126-fdb7-48f8-866d-fd679d38c050-kube-api-access-rw924\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.446882 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dx2cg"] Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.452166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" event={"ID":"2bed045d-dcfa-4235-a778-cc12b3ee6a6c","Type":"ContainerStarted","Data":"ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.452234 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.452262 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.452270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" event={"ID":"2bed045d-dcfa-4235-a778-cc12b3ee6a6c","Type":"ContainerStarted","Data":"b9b55ae79098551e9db710cb10db51d68298684e3c1142e64326952f537d2852"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.460602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"13c6fb58-b0b0-4980-bd79-a86a2375f047","Type":"ContainerStarted","Data":"cdfbfbd6be4222375a45f2688bfaa47e2314b9852abf0063aecc75f65be3c1d4"} Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-combined-ca-bundle\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data-custom\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data-custom\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-combined-ca-bundle\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2956e126-fdb7-48f8-866d-fd679d38c050-logs\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-logs\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537759 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tmr7w\" (UniqueName: \"kubernetes.io/projected/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-kube-api-access-tmr7w\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.537784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rw924\" (UniqueName: \"kubernetes.io/projected/2956e126-fdb7-48f8-866d-fd679d38c050-kube-api-access-rw924\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.539012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2956e126-fdb7-48f8-866d-fd679d38c050-logs\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.539585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-logs\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.545939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data-custom\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.546316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-combined-ca-bundle\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.554059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.554663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.556367 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-combined-ca-bundle\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.559841 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" podStartSLOduration=2.559825951 podStartE2EDuration="2.559825951s" podCreationTimestamp="2025-11-21 12:43:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:43:59.483374233 +0000 UTC m=+3198.184036051" watchObservedRunningTime="2025-11-21 12:43:59.559825951 +0000 UTC m=+3198.260487769" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.562881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw924\" (UniqueName: \"kubernetes.io/projected/2956e126-fdb7-48f8-866d-fd679d38c050-kube-api-access-rw924\") pod \"barbican-keystone-listener-7b6dbd5996-nnzg6\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.562914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data-custom\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.571995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmr7w\" (UniqueName: \"kubernetes.io/projected/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-kube-api-access-tmr7w\") pod \"barbican-worker-74dd8d9f6c-4tmrl\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.606743 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf"] Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.609235 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.614507 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.614819 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf"] Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.638551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ef5e05d-7252-4671-93a7-1853df0cd05f-logs\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.638803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-combined-ca-bundle\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.638857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data-custom\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.639098 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.639141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsh7c\" (UniqueName: \"kubernetes.io/projected/5ef5e05d-7252-4671-93a7-1853df0cd05f-kube-api-access-tsh7c\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.683112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.714009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.741269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ef5e05d-7252-4671-93a7-1853df0cd05f-logs\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.741563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-combined-ca-bundle\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.741621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data-custom\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.741740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.741809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tsh7c\" (UniqueName: \"kubernetes.io/projected/5ef5e05d-7252-4671-93a7-1853df0cd05f-kube-api-access-tsh7c\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.742784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ef5e05d-7252-4671-93a7-1853df0cd05f-logs\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.753938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data-custom\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.757089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-combined-ca-bundle\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.757780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:43:59 crc kubenswrapper[4769]: I1121 12:43:59.764881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsh7c\" (UniqueName: \"kubernetes.io/projected/5ef5e05d-7252-4671-93a7-1853df0cd05f-kube-api-access-tsh7c\") pod \"barbican-api-79d4d7f9cb-lvvxf\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.018744 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.257306 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6"] Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.274082 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:44:00 crc kubenswrapper[4769]: E1121 12:44:00.274424 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.357746 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl"] Nov 21 12:44:00 crc kubenswrapper[4769]: W1121 12:44:00.378362 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72ba863c_b5b0_4af7_a2ac_ba307b9e0fbb.slice/crio-60758d47d07dd7d33bbc7c83610d14d41c54d2ed5e9e62d22f391e90f15e4db8 WatchSource:0}: Error finding container 60758d47d07dd7d33bbc7c83610d14d41c54d2ed5e9e62d22f391e90f15e4db8: Status 404 returned error can't find the container with id 60758d47d07dd7d33bbc7c83610d14d41c54d2ed5e9e62d22f391e90f15e4db8 Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.492810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerStarted","Data":"a46145bc2aaaa237b797950e81f3fdcf0832bf79ceb897bf30e43ad8ab5e109f"} Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.494444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" event={"ID":"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b","Type":"ContainerStarted","Data":"3cb2cd9f4c9df0b7853358fb778c165f8dc9823664fc57673e388d2641665032"} Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.494476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" event={"ID":"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b","Type":"ContainerStarted","Data":"abecccc2f0b2f29e8971d7c23fb90bea56ad5b59588b9b24a1926c54498938ad"} Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.500135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" event={"ID":"2956e126-fdb7-48f8-866d-fd679d38c050","Type":"ContainerStarted","Data":"fa984eda1d305f30d4dbad90229b185f364a4bba2f503a6684fe83fe29db092d"} Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.502810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"13c6fb58-b0b0-4980-bd79-a86a2375f047","Type":"ContainerStarted","Data":"0b2d1f7ec44ccc5764ca0531ac173f28dd9d74edab0dc9fdf0c2bafe48a6e7af"} Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.506033 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" event={"ID":"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb","Type":"ContainerStarted","Data":"60758d47d07dd7d33bbc7c83610d14d41c54d2ed5e9e62d22f391e90f15e4db8"} Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.516123 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" podStartSLOduration=2.516110964 podStartE2EDuration="2.516110964s" podCreationTimestamp="2025-11-21 12:43:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:00.514833669 +0000 UTC m=+3199.215495497" watchObservedRunningTime="2025-11-21 12:44:00.516110964 +0000 UTC m=+3199.216772782" Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.547081 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.547052025 podStartE2EDuration="4.547052025s" podCreationTimestamp="2025-11-21 12:43:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:00.540320442 +0000 UTC m=+3199.240982260" watchObservedRunningTime="2025-11-21 12:44:00.547052025 +0000 UTC m=+3199.247713843" Nov 21 12:44:00 crc kubenswrapper[4769]: I1121 12:44:00.634037 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf"] Nov 21 12:44:00 crc kubenswrapper[4769]: W1121 12:44:00.643680 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef5e05d_7252_4671_93a7_1853df0cd05f.slice/crio-a995aef3683ee61d12313f50d22de59daec591d7f3934bc25d3c9cd7a07dad4b WatchSource:0}: Error finding container a995aef3683ee61d12313f50d22de59daec591d7f3934bc25d3c9cd7a07dad4b: Status 404 returned error can't find the container with id a995aef3683ee61d12313f50d22de59daec591d7f3934bc25d3c9cd7a07dad4b Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.518775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerStarted","Data":"ac392612a8b84fee90760a1dde265607ae88c42cc65c0a21362e93aab53033ac"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.520792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" event={"ID":"2956e126-fdb7-48f8-866d-fd679d38c050","Type":"ContainerStarted","Data":"3b6e58bf8cdbcf61e584df01168d1f8db62aaff6bb9436e2b866a33414e50430"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.520815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" event={"ID":"2956e126-fdb7-48f8-866d-fd679d38c050","Type":"ContainerStarted","Data":"b3c83b15f3932426877c440dd7e11ad9cc8e803b59286cb80e88df7c49803066"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.525438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" event={"ID":"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb","Type":"ContainerStarted","Data":"49bc58f1831922623e18c3eb5c0bcf86a02b029c43c0c21eb6d1776361d42264"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.525462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" event={"ID":"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb","Type":"ContainerStarted","Data":"422269e23c92dba5a740e096f70b861938f38d732472b1771370d1a725668bdc"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.528861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" event={"ID":"5ef5e05d-7252-4671-93a7-1853df0cd05f","Type":"ContainerStarted","Data":"e92b430858ce601f5227262219a5e94c44ff24285066fed77c45b7e28a87d957"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.528886 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.528897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" event={"ID":"5ef5e05d-7252-4671-93a7-1853df0cd05f","Type":"ContainerStarted","Data":"774dbe64506fc3c1108c2ac068f51bbe90076f2c20cc05cabad6424c05700f40"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.528905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" event={"ID":"5ef5e05d-7252-4671-93a7-1853df0cd05f","Type":"ContainerStarted","Data":"a995aef3683ee61d12313f50d22de59daec591d7f3934bc25d3c9cd7a07dad4b"} Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.529320 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.550343 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" podStartSLOduration=2.550328245 podStartE2EDuration="2.550328245s" podCreationTimestamp="2025-11-21 12:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:01.5406066 +0000 UTC m=+3200.241268418" watchObservedRunningTime="2025-11-21 12:44:01.550328245 +0000 UTC m=+3200.250990063" Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.565792 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" podStartSLOduration=2.565776155 podStartE2EDuration="2.565776155s" podCreationTimestamp="2025-11-21 12:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:01.559662538 +0000 UTC m=+3200.260324356" watchObservedRunningTime="2025-11-21 12:44:01.565776155 +0000 UTC m=+3200.266437973" Nov 21 12:44:01 crc kubenswrapper[4769]: I1121 12:44:01.589639 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" podStartSLOduration=2.5896211730000003 podStartE2EDuration="2.589621173s" podCreationTimestamp="2025-11-21 12:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:01.586289342 +0000 UTC m=+3200.286951160" watchObservedRunningTime="2025-11-21 12:44:01.589621173 +0000 UTC m=+3200.290282991" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.510550 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp"] Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.512170 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.514438 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.514612 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.532076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp"] Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.574497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerStarted","Data":"1efd85ce7f9bf17e4fd851e0ffc8c0329d2f12d541787b1b0c169cbc71e1d84c"} Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.575809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.620134 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.135464452 podStartE2EDuration="5.620006509s" podCreationTimestamp="2025-11-21 12:43:57 +0000 UTC" firstStartedPulling="2025-11-21 12:43:58.451632209 +0000 UTC m=+3197.152294027" lastFinishedPulling="2025-11-21 12:44:01.936174266 +0000 UTC m=+3200.636836084" observedRunningTime="2025-11-21 12:44:02.608434964 +0000 UTC m=+3201.309096782" watchObservedRunningTime="2025-11-21 12:44:02.620006509 +0000 UTC m=+3201.320668317" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.658879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-public-tls-certs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.659271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-internal-tls-certs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.668559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtdjn\" (UniqueName: \"kubernetes.io/projected/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-kube-api-access-gtdjn\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.668876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.668973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data-custom\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.669088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-combined-ca-bundle\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.669157 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-logs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.769849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-combined-ca-bundle\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.769901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-logs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.770021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-public-tls-certs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.770112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-internal-tls-certs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.770146 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gtdjn\" (UniqueName: \"kubernetes.io/projected/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-kube-api-access-gtdjn\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.770173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.770213 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data-custom\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.777815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-public-tls-certs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.778341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-logs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.782945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-combined-ca-bundle\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.784147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.784973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data-custom\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.797081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-internal-tls-certs\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.803004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtdjn\" (UniqueName: \"kubernetes.io/projected/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-kube-api-access-gtdjn\") pod \"barbican-api-c7b57cd5b-klmpp\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:02 crc kubenswrapper[4769]: I1121 12:44:02.853321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:03 crc kubenswrapper[4769]: I1121 12:44:03.361768 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp"] Nov 21 12:44:03 crc kubenswrapper[4769]: I1121 12:44:03.586349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" event={"ID":"ed71386e-c354-4139-b9cf-ea8f7a8d90d1","Type":"ContainerStarted","Data":"3f6cc4b6ffc17a62e421e7a52b3224ce48159a28e12100f0bd18bfaf15f4b93f"} Nov 21 12:44:03 crc kubenswrapper[4769]: I1121 12:44:03.587348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" event={"ID":"ed71386e-c354-4139-b9cf-ea8f7a8d90d1","Type":"ContainerStarted","Data":"6194ac0cf96a48d427bd275c388065c892d07dfbe5486d8b354670293f8e98bc"} Nov 21 12:44:03 crc kubenswrapper[4769]: I1121 12:44:03.589781 4769 generic.go:334] "Generic (PLEG): container finished" podID="3fab6c98-700a-4db9-9d2f-073777822c73" containerID="2016abda21e152de0ecf12b4a36864158a88c66c7855057f3e6bbc05174cdfcb" exitCode=0 Nov 21 12:44:03 crc kubenswrapper[4769]: I1121 12:44:03.590332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" event={"ID":"3fab6c98-700a-4db9-9d2f-073777822c73","Type":"ContainerDied","Data":"2016abda21e152de0ecf12b4a36864158a88c66c7855057f3e6bbc05174cdfcb"} Nov 21 12:44:04 crc kubenswrapper[4769]: I1121 12:44:04.607111 4769 generic.go:334] "Generic (PLEG): container finished" podID="f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" containerID="3cb2cd9f4c9df0b7853358fb778c165f8dc9823664fc57673e388d2641665032" exitCode=0 Nov 21 12:44:04 crc kubenswrapper[4769]: I1121 12:44:04.607204 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" event={"ID":"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b","Type":"ContainerDied","Data":"3cb2cd9f4c9df0b7853358fb778c165f8dc9823664fc57673e388d2641665032"} Nov 21 12:44:04 crc kubenswrapper[4769]: I1121 12:44:04.611884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" event={"ID":"ed71386e-c354-4139-b9cf-ea8f7a8d90d1","Type":"ContainerStarted","Data":"30cc782af112ceea951508724584bd46c90baf4a451c6d555408ea545c2d69cb"} Nov 21 12:44:04 crc kubenswrapper[4769]: I1121 12:44:04.686562 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" podStartSLOduration=2.686529189 podStartE2EDuration="2.686529189s" podCreationTimestamp="2025-11-21 12:44:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:04.679748514 +0000 UTC m=+3203.380410342" watchObservedRunningTime="2025-11-21 12:44:04.686529189 +0000 UTC m=+3203.387191027" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.062097 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.217336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-db-sync-config-data\") pod \"3fab6c98-700a-4db9-9d2f-073777822c73\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.217458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-combined-ca-bundle\") pod \"3fab6c98-700a-4db9-9d2f-073777822c73\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.217587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvhbj\" (UniqueName: \"kubernetes.io/projected/3fab6c98-700a-4db9-9d2f-073777822c73-kube-api-access-wvhbj\") pod \"3fab6c98-700a-4db9-9d2f-073777822c73\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.217813 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-scripts\") pod \"3fab6c98-700a-4db9-9d2f-073777822c73\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.217844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3fab6c98-700a-4db9-9d2f-073777822c73-etc-machine-id\") pod \"3fab6c98-700a-4db9-9d2f-073777822c73\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.217962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-config-data\") pod \"3fab6c98-700a-4db9-9d2f-073777822c73\" (UID: \"3fab6c98-700a-4db9-9d2f-073777822c73\") " Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.218022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3fab6c98-700a-4db9-9d2f-073777822c73-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3fab6c98-700a-4db9-9d2f-073777822c73" (UID: "3fab6c98-700a-4db9-9d2f-073777822c73"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.218565 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3fab6c98-700a-4db9-9d2f-073777822c73-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.226047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "3fab6c98-700a-4db9-9d2f-073777822c73" (UID: "3fab6c98-700a-4db9-9d2f-073777822c73"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.229640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-scripts" (OuterVolumeSpecName: "scripts") pod "3fab6c98-700a-4db9-9d2f-073777822c73" (UID: "3fab6c98-700a-4db9-9d2f-073777822c73"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.247447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fab6c98-700a-4db9-9d2f-073777822c73-kube-api-access-wvhbj" (OuterVolumeSpecName: "kube-api-access-wvhbj") pod "3fab6c98-700a-4db9-9d2f-073777822c73" (UID: "3fab6c98-700a-4db9-9d2f-073777822c73"). InnerVolumeSpecName "kube-api-access-wvhbj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.252635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3fab6c98-700a-4db9-9d2f-073777822c73" (UID: "3fab6c98-700a-4db9-9d2f-073777822c73"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.286497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-config-data" (OuterVolumeSpecName: "config-data") pod "3fab6c98-700a-4db9-9d2f-073777822c73" (UID: "3fab6c98-700a-4db9-9d2f-073777822c73"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.320230 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.320269 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.320285 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.320299 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wvhbj\" (UniqueName: \"kubernetes.io/projected/3fab6c98-700a-4db9-9d2f-073777822c73-kube-api-access-wvhbj\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.320313 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3fab6c98-700a-4db9-9d2f-073777822c73-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.630478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" event={"ID":"3fab6c98-700a-4db9-9d2f-073777822c73","Type":"ContainerDied","Data":"65c2cad51c5adbe50f3055e7d78bfdbf35b61e3b91df303a8e49cf5c0cb343f6"} Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.630537 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65c2cad51c5adbe50f3055e7d78bfdbf35b61e3b91df303a8e49cf5c0cb343f6" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.630628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-gtxxc" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.630922 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:05 crc kubenswrapper[4769]: I1121 12:44:05.630945 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.185655 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.186101 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:06 crc kubenswrapper[4769]: E1121 12:44:06.186685 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3fab6c98-700a-4db9-9d2f-073777822c73" containerName="cinder-db-sync" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.186711 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fab6c98-700a-4db9-9d2f-073777822c73" containerName="cinder-db-sync" Nov 21 12:44:06 crc kubenswrapper[4769]: E1121 12:44:06.186734 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" containerName="keystone-bootstrap" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.186743 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" containerName="keystone-bootstrap" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.187011 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" containerName="keystone-bootstrap" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.187041 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3fab6c98-700a-4db9-9d2f-073777822c73" containerName="cinder-db-sync" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.188330 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.192521 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.192751 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-tghfr" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.193275 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.196623 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.215202 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.341776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-combined-ca-bundle\") pod \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.341951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-fernet-keys\") pod \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.341993 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd6wv\" (UniqueName: \"kubernetes.io/projected/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-kube-api-access-bd6wv\") pod \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-credential-keys\") pod \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-scripts\") pod \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-config-data\") pod \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\" (UID: \"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b\") " Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-scripts\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klw6g\" (UniqueName: \"kubernetes.io/projected/a6e28035-4055-44b1-bcf6-31419510e886-kube-api-access-klw6g\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.342649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a6e28035-4055-44b1-bcf6-31419510e886-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.369375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-scripts" (OuterVolumeSpecName: "scripts") pod "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" (UID: "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.370464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" (UID: "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.371388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" (UID: "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.372361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-kube-api-access-bd6wv" (OuterVolumeSpecName: "kube-api-access-bd6wv") pod "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" (UID: "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b"). InnerVolumeSpecName "kube-api-access-bd6wv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.396486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" (UID: "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.414162 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.415754 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.420148 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-config-data" (OuterVolumeSpecName: "config-data") pod "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" (UID: "f31c2bdf-fc79-489e-93b3-f856cbd3bd4b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.428696 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-scripts\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444282 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-klw6g\" (UniqueName: \"kubernetes.io/projected/a6e28035-4055-44b1-bcf6-31419510e886-kube-api-access-klw6g\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a6e28035-4055-44b1-bcf6-31419510e886-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444459 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444472 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bd6wv\" (UniqueName: \"kubernetes.io/projected/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-kube-api-access-bd6wv\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444484 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444497 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444509 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444520 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.444772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a6e28035-4055-44b1-bcf6-31419510e886-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.453794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-scripts\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.453984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.454829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.457740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.461023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.477290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-klw6g\" (UniqueName: \"kubernetes.io/projected/a6e28035-4055-44b1-bcf6-31419510e886-kube-api-access-klw6g\") pod \"cinder-scheduler-0\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.505968 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.547487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c434f822-0477-4403-b1c4-8a344aac2556-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.547557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wf8l\" (UniqueName: \"kubernetes.io/projected/c434f822-0477-4403-b1c4-8a344aac2556-kube-api-access-2wf8l\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.547583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c434f822-0477-4403-b1c4-8a344aac2556-logs\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.547621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.548567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.548946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-scripts\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.549416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data-custom\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data-custom\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c434f822-0477-4403-b1c4-8a344aac2556-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2wf8l\" (UniqueName: \"kubernetes.io/projected/c434f822-0477-4403-b1c4-8a344aac2556-kube-api-access-2wf8l\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c434f822-0477-4403-b1c4-8a344aac2556-logs\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.652311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-scripts\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.654240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c434f822-0477-4403-b1c4-8a344aac2556-logs\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.654317 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c434f822-0477-4403-b1c4-8a344aac2556-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.660473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data-custom\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.666350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.669985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.671842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-scripts\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.687167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wf8l\" (UniqueName: \"kubernetes.io/projected/c434f822-0477-4403-b1c4-8a344aac2556-kube-api-access-2wf8l\") pod \"cinder-api-0\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.692892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" event={"ID":"f31c2bdf-fc79-489e-93b3-f856cbd3bd4b","Type":"ContainerDied","Data":"abecccc2f0b2f29e8971d7c23fb90bea56ad5b59588b9b24a1926c54498938ad"} Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.692942 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abecccc2f0b2f29e8971d7c23fb90bea56ad5b59588b9b24a1926c54498938ad" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.693017 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dx2cg" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.725265 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.725309 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.827284 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.840229 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-77c6665cf8-s6vm9"] Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.841512 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.854439 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.854720 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.855112 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.855252 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.855357 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.855438 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-68nkp" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.860783 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.883509 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-77c6665cf8-s6vm9"] Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.903337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.924596 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.970770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-internal-tls-certs\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.970872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzr8\" (UniqueName: \"kubernetes.io/projected/f8c3fc37-e777-4549-b153-ad4965d13a8a-kube-api-access-zhzr8\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.970931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-config-data\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.971081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-combined-ca-bundle\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.971182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-fernet-keys\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.971274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-scripts\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.971328 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-public-tls-certs\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:06 crc kubenswrapper[4769]: I1121 12:44:06.971648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-credential-keys\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.057815 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.057871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.074886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-config-data\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.074948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-combined-ca-bundle\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.074977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-fernet-keys\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.075033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-scripts\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.075058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-public-tls-certs\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.075119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-credential-keys\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.075160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-internal-tls-certs\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.075182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzr8\" (UniqueName: \"kubernetes.io/projected/f8c3fc37-e777-4549-b153-ad4965d13a8a-kube-api-access-zhzr8\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.087094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-combined-ca-bundle\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.093717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-scripts\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.093785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-public-tls-certs\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.094704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-credential-keys\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.105119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzr8\" (UniqueName: \"kubernetes.io/projected/f8c3fc37-e777-4549-b153-ad4965d13a8a-kube-api-access-zhzr8\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.118177 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.118404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-fernet-keys\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.119023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-config-data\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.119421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-internal-tls-certs\") pod \"keystone-77c6665cf8-s6vm9\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.196698 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.208020 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.378321 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.712723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c434f822-0477-4403-b1c4-8a344aac2556","Type":"ContainerStarted","Data":"fb81ae0e415ce182384fbcb5ea93b89599ce6323eb0f5b2924d057f81f4e158a"} Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.719086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a6e28035-4055-44b1-bcf6-31419510e886","Type":"ContainerStarted","Data":"6cdf5baaa219009cf06ba466f6f863cce52522751908cd85162e7cc9c7f907fb"} Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.719147 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.719165 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.719176 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.719321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.800092 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-77c6665cf8-s6vm9"] Nov 21 12:44:07 crc kubenswrapper[4769]: I1121 12:44:07.891898 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.131267 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.740378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" event={"ID":"f8c3fc37-e777-4549-b153-ad4965d13a8a","Type":"ContainerStarted","Data":"9aefa9d52d14027efe0407875f87a49569f3107d82fda1cdb5c326040e5fb813"} Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.740824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" event={"ID":"f8c3fc37-e777-4549-b153-ad4965d13a8a","Type":"ContainerStarted","Data":"b330a2a1ec5a8ba73c67f407d93a1bad2531999915a9b2a6bc88aebe6a849b71"} Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.741255 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.750095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c434f822-0477-4403-b1c4-8a344aac2556","Type":"ContainerStarted","Data":"087b08fd07cdd3c9330ecef6e74bc27c2ac91fb0ec98c9342fef7d071b560a3c"} Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.767097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a6e28035-4055-44b1-bcf6-31419510e886","Type":"ContainerStarted","Data":"e822b0af2c56c3f010908425fefbce190734501e7f1a4342834e41f83f873b6f"} Nov 21 12:44:08 crc kubenswrapper[4769]: I1121 12:44:08.771977 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" podStartSLOduration=2.771946003 podStartE2EDuration="2.771946003s" podCreationTimestamp="2025-11-21 12:44:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:08.762219438 +0000 UTC m=+3207.462881256" watchObservedRunningTime="2025-11-21 12:44:08.771946003 +0000 UTC m=+3207.472607821" Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.806915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c434f822-0477-4403-b1c4-8a344aac2556","Type":"ContainerStarted","Data":"a102f19576e8278c04097c765e8038b43688aa36f74c9a0da64f7e8e62ff3fbc"} Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.807319 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api-log" containerID="cri-o://087b08fd07cdd3c9330ecef6e74bc27c2ac91fb0ec98c9342fef7d071b560a3c" gracePeriod=30 Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.807580 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api" containerID="cri-o://a102f19576e8278c04097c765e8038b43688aa36f74c9a0da64f7e8e62ff3fbc" gracePeriod=30 Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.815840 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.816004 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.816338 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.816361 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.817647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a6e28035-4055-44b1-bcf6-31419510e886","Type":"ContainerStarted","Data":"4d2a28c2254339f07a7ea550acb8a0e054f6fdf405bb0a62a8c0ee3f91e0c6e9"} Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.861606 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.86158432 podStartE2EDuration="3.86158432s" podCreationTimestamp="2025-11-21 12:44:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:09.847125107 +0000 UTC m=+3208.547786925" watchObservedRunningTime="2025-11-21 12:44:09.86158432 +0000 UTC m=+3208.562246128" Nov 21 12:44:09 crc kubenswrapper[4769]: I1121 12:44:09.867915 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.867902982 podStartE2EDuration="3.867902982s" podCreationTimestamp="2025-11-21 12:44:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:09.865001013 +0000 UTC m=+3208.565662851" watchObservedRunningTime="2025-11-21 12:44:09.867902982 +0000 UTC m=+3208.568564800" Nov 21 12:44:10 crc kubenswrapper[4769]: I1121 12:44:10.282849 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:10 crc kubenswrapper[4769]: I1121 12:44:10.309735 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:10 crc kubenswrapper[4769]: I1121 12:44:10.520927 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:10 crc kubenswrapper[4769]: I1121 12:44:10.831248 4769 generic.go:334] "Generic (PLEG): container finished" podID="c434f822-0477-4403-b1c4-8a344aac2556" containerID="087b08fd07cdd3c9330ecef6e74bc27c2ac91fb0ec98c9342fef7d071b560a3c" exitCode=143 Nov 21 12:44:10 crc kubenswrapper[4769]: I1121 12:44:10.832638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c434f822-0477-4403-b1c4-8a344aac2556","Type":"ContainerDied","Data":"087b08fd07cdd3c9330ecef6e74bc27c2ac91fb0ec98c9342fef7d071b560a3c"} Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.198015 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.198736 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.200255 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.507043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.828668 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.848734 4769 generic.go:334] "Generic (PLEG): container finished" podID="c434f822-0477-4403-b1c4-8a344aac2556" containerID="a102f19576e8278c04097c765e8038b43688aa36f74c9a0da64f7e8e62ff3fbc" exitCode=0 Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.848787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c434f822-0477-4403-b1c4-8a344aac2556","Type":"ContainerDied","Data":"a102f19576e8278c04097c765e8038b43688aa36f74c9a0da64f7e8e62ff3fbc"} Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.849780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c434f822-0477-4403-b1c4-8a344aac2556","Type":"ContainerDied","Data":"fb81ae0e415ce182384fbcb5ea93b89599ce6323eb0f5b2924d057f81f4e158a"} Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.849805 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb81ae0e415ce182384fbcb5ea93b89599ce6323eb0f5b2924d057f81f4e158a" Nov 21 12:44:11 crc kubenswrapper[4769]: I1121 12:44:11.861627 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035512 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035633 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wf8l\" (UniqueName: \"kubernetes.io/projected/c434f822-0477-4403-b1c4-8a344aac2556-kube-api-access-2wf8l\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data-custom\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c434f822-0477-4403-b1c4-8a344aac2556-etc-machine-id\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-combined-ca-bundle\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c434f822-0477-4403-b1c4-8a344aac2556-logs\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.035943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-scripts\") pod \"c434f822-0477-4403-b1c4-8a344aac2556\" (UID: \"c434f822-0477-4403-b1c4-8a344aac2556\") " Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.036057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c434f822-0477-4403-b1c4-8a344aac2556-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.036542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c434f822-0477-4403-b1c4-8a344aac2556-logs" (OuterVolumeSpecName: "logs") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.036692 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c434f822-0477-4403-b1c4-8a344aac2556-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.036717 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c434f822-0477-4403-b1c4-8a344aac2556-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.047277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.050342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-scripts" (OuterVolumeSpecName: "scripts") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.061470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c434f822-0477-4403-b1c4-8a344aac2556-kube-api-access-2wf8l" (OuterVolumeSpecName: "kube-api-access-2wf8l") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "kube-api-access-2wf8l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.085752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.127064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data" (OuterVolumeSpecName: "config-data") pod "c434f822-0477-4403-b1c4-8a344aac2556" (UID: "c434f822-0477-4403-b1c4-8a344aac2556"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.138518 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.138546 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2wf8l\" (UniqueName: \"kubernetes.io/projected/c434f822-0477-4403-b1c4-8a344aac2556-kube-api-access-2wf8l\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.138559 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.138569 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.138578 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c434f822-0477-4403-b1c4-8a344aac2556-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.865707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.929298 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.941981 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.983168 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:12 crc kubenswrapper[4769]: E1121 12:44:12.983881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api-log" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.983912 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api-log" Nov 21 12:44:12 crc kubenswrapper[4769]: E1121 12:44:12.983984 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.983995 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.984426 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api-log" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.984492 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c434f822-0477-4403-b1c4-8a344aac2556" containerName="cinder-api" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.988798 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.995552 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.995832 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.996172 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:44:12 crc kubenswrapper[4769]: I1121 12:44:12.999838 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-public-tls-certs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/229177f2-bc85-4c53-86e2-9daab3200250-logs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-scripts\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdch\" (UniqueName: \"kubernetes.io/projected/229177f2-bc85-4c53-86e2-9daab3200250-kube-api-access-zvdch\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data-custom\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/229177f2-bc85-4c53-86e2-9daab3200250-etc-machine-id\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.159768 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.261279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdch\" (UniqueName: \"kubernetes.io/projected/229177f2-bc85-4c53-86e2-9daab3200250-kube-api-access-zvdch\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.261571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.261690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.261787 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data-custom\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.261893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/229177f2-bc85-4c53-86e2-9daab3200250-etc-machine-id\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.261972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.262058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-public-tls-certs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.262130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/229177f2-bc85-4c53-86e2-9daab3200250-logs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.262240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-scripts\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.262455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/229177f2-bc85-4c53-86e2-9daab3200250-etc-machine-id\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.263127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/229177f2-bc85-4c53-86e2-9daab3200250-logs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.267579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data-custom\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.267589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.268832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-public-tls-certs\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.269653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.269936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-scripts\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.271550 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.281904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdch\" (UniqueName: \"kubernetes.io/projected/229177f2-bc85-4c53-86e2-9daab3200250-kube-api-access-zvdch\") pod \"cinder-api-0\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.299569 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c434f822-0477-4403-b1c4-8a344aac2556" path="/var/lib/kubelet/pods/c434f822-0477-4403-b1c4-8a344aac2556/volumes" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.328449 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:13 crc kubenswrapper[4769]: I1121 12:44:13.903133 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.394154 4769 scope.go:117] "RemoveContainer" containerID="db111da3413ec218967d1a5ce01181ec0a6d6af36b5cc1ff9f160658a1fcd4c9" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.408656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.457162 4769 scope.go:117] "RemoveContainer" containerID="d72f33ffa088b3b60de1f5975ebd18d92272577bd0e3bec59783ae90d3c3fb4b" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.473226 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.531640 4769 scope.go:117] "RemoveContainer" containerID="daab05b610a70299e05b9f69ba9387bdf7e6c968d31322685e687bdfdcfddc46" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.573719 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf"] Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.574144 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api-log" containerID="cri-o://774dbe64506fc3c1108c2ac068f51bbe90076f2c20cc05cabad6424c05700f40" gracePeriod=30 Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.575948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api" containerID="cri-o://e92b430858ce601f5227262219a5e94c44ff24285066fed77c45b7e28a87d957" gracePeriod=30 Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.595731 4769 scope.go:117] "RemoveContainer" containerID="00bb5fa66fefd6977fa04dec5423aa621b838825da13a70a2136a4665e09f258" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.655601 4769 scope.go:117] "RemoveContainer" containerID="8cfe92f182ec79cd472097f18b95255229f7d04c1b3c86d17a2f76b7f53bc763" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.689727 4769 scope.go:117] "RemoveContainer" containerID="df520837211f5136eab1f13a2aa4e17ba0d27bfe70fde97b2f5b45d69fe945ef" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.741184 4769 scope.go:117] "RemoveContainer" containerID="c98138b795f4cbd3160b47d4e5bca080367c97055345e9be9a1a4d7cd7370c29" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.778068 4769 scope.go:117] "RemoveContainer" containerID="264b29fa2e5a2c344e5ad746d614e362cae3d7b7d9c7f2876d5b025bdb0c8948" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.908056 4769 scope.go:117] "RemoveContainer" containerID="5200b0f1de461cbc96abcbfde5c1eba4e45d03683d1452b17bdfab5ee492ba80" Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.966402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"229177f2-bc85-4c53-86e2-9daab3200250","Type":"ContainerStarted","Data":"0220fa21ea5b11a9c3a0df2b8315ef935464c5bb63f37079b7b694d11055311d"} Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.966464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"229177f2-bc85-4c53-86e2-9daab3200250","Type":"ContainerStarted","Data":"1cff184e6a699ca1080e89435bcba2d70d344e3ca3c4bbd32609d9b676165d30"} Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.973943 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerID="774dbe64506fc3c1108c2ac068f51bbe90076f2c20cc05cabad6424c05700f40" exitCode=143 Nov 21 12:44:14 crc kubenswrapper[4769]: I1121 12:44:14.974009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" event={"ID":"5ef5e05d-7252-4671-93a7-1853df0cd05f","Type":"ContainerDied","Data":"774dbe64506fc3c1108c2ac068f51bbe90076f2c20cc05cabad6424c05700f40"} Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.048350 4769 scope.go:117] "RemoveContainer" containerID="b5f24884ebb2404925f8810286415bfa340f155ee76e831e32145e3c32b76cd3" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.126422 4769 scope.go:117] "RemoveContainer" containerID="4ee9bad102975b864cba37066653c22ce42788fc760662701ca8489d908831e7" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.274973 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:44:15 crc kubenswrapper[4769]: E1121 12:44:15.275232 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.292761 4769 scope.go:117] "RemoveContainer" containerID="58fe909266273dec1aa413ce6b37f92941f2f4ca2dc892c70b34c612a1ecef72" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.346875 4769 scope.go:117] "RemoveContainer" containerID="2f9795b688b62d68c169c1a0b5cf8fe745204cc77d4b840b0bffbc200faad6ab" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.372482 4769 scope.go:117] "RemoveContainer" containerID="4e957633211855a1b5b6a0f3280d014600d295bcb3f59cdc4fe29f4abed1f0b3" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.396026 4769 scope.go:117] "RemoveContainer" containerID="22d08c8fb8e93d13fcd5f7caba4ee618409e1a225ae88c4d57b04382f8b4cfe0" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.431429 4769 scope.go:117] "RemoveContainer" containerID="0c73cae7cacd357226b059ee356f23d06715c53ca6779666056b711afed63ee2" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.511038 4769 scope.go:117] "RemoveContainer" containerID="1264f7d1eb6f3c43e19ac1a6d6738d82cb33274606e629e18e1b9b182a0c8f11" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.607923 4769 scope.go:117] "RemoveContainer" containerID="19af8e0d55e175276f68d3965da099402e27d87e1b887cfd237272addc06c9bd" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.638441 4769 scope.go:117] "RemoveContainer" containerID="d5c4c723fa02ac810a6a5560b18dcb7359fc4adab4b8b583a32ce3e47379ec5e" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.673853 4769 scope.go:117] "RemoveContainer" containerID="b3e8c9b38ba95e3907d800185d34ce21776a8fb69cb0b2f5e4ea8a479e6df3fc" Nov 21 12:44:15 crc kubenswrapper[4769]: I1121 12:44:15.701521 4769 scope.go:117] "RemoveContainer" containerID="06cc6420e52c1e0c5c94ff81609ba2ab5304d6575f3d9c12ff1b6f799545beb5" Nov 21 12:44:16 crc kubenswrapper[4769]: I1121 12:44:16.067985 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"229177f2-bc85-4c53-86e2-9daab3200250","Type":"ContainerStarted","Data":"970ed70182aee5ce4e2e0a18af5f95caf9f7fe5a886215c9d7cd9823d6abc38d"} Nov 21 12:44:16 crc kubenswrapper[4769]: I1121 12:44:16.070270 4769 generic.go:334] "Generic (PLEG): container finished" podID="11a8d81f-ec12-4073-abad-8023c585e9c7" containerID="d3d1d7821d4449d88e497d1e36e71f5304a668b4bfe41add2dcfd48fec53c39e" exitCode=0 Nov 21 12:44:16 crc kubenswrapper[4769]: I1121 12:44:16.070335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" event={"ID":"11a8d81f-ec12-4073-abad-8023c585e9c7","Type":"ContainerDied","Data":"d3d1d7821d4449d88e497d1e36e71f5304a668b4bfe41add2dcfd48fec53c39e"} Nov 21 12:44:16 crc kubenswrapper[4769]: I1121 12:44:16.096312 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.096289414 podStartE2EDuration="4.096289414s" podCreationTimestamp="2025-11-21 12:44:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:16.090442675 +0000 UTC m=+3214.791104493" watchObservedRunningTime="2025-11-21 12:44:16.096289414 +0000 UTC m=+3214.796951232" Nov 21 12:44:16 crc kubenswrapper[4769]: I1121 12:44:16.775156 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:16 crc kubenswrapper[4769]: I1121 12:44:16.868303 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.086502 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="cinder-scheduler" containerID="cri-o://e822b0af2c56c3f010908425fefbce190734501e7f1a4342834e41f83f873b6f" gracePeriod=30 Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.086544 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="probe" containerID="cri-o://4d2a28c2254339f07a7ea550acb8a0e054f6fdf405bb0a62a8c0ee3f91e0c6e9" gracePeriod=30 Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.086890 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.519933 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.645037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt9hk\" (UniqueName: \"kubernetes.io/projected/11a8d81f-ec12-4073-abad-8023c585e9c7-kube-api-access-gt9hk\") pod \"11a8d81f-ec12-4073-abad-8023c585e9c7\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.645812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-combined-ca-bundle\") pod \"11a8d81f-ec12-4073-abad-8023c585e9c7\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.646073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-config\") pod \"11a8d81f-ec12-4073-abad-8023c585e9c7\" (UID: \"11a8d81f-ec12-4073-abad-8023c585e9c7\") " Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.658239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a8d81f-ec12-4073-abad-8023c585e9c7-kube-api-access-gt9hk" (OuterVolumeSpecName: "kube-api-access-gt9hk") pod "11a8d81f-ec12-4073-abad-8023c585e9c7" (UID: "11a8d81f-ec12-4073-abad-8023c585e9c7"). InnerVolumeSpecName "kube-api-access-gt9hk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.688641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "11a8d81f-ec12-4073-abad-8023c585e9c7" (UID: "11a8d81f-ec12-4073-abad-8023c585e9c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.691270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-config" (OuterVolumeSpecName: "config") pod "11a8d81f-ec12-4073-abad-8023c585e9c7" (UID: "11a8d81f-ec12-4073-abad-8023c585e9c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.748837 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.748894 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/11a8d81f-ec12-4073-abad-8023c585e9c7-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.748912 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gt9hk\" (UniqueName: \"kubernetes.io/projected/11a8d81f-ec12-4073-abad-8023c585e9c7-kube-api-access-gt9hk\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.780345 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.0:9311/healthcheck\": read tcp 10.217.0.2:50120->10.217.1.0:9311: read: connection reset by peer" Nov 21 12:44:17 crc kubenswrapper[4769]: I1121 12:44:17.781008 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.0:9311/healthcheck\": read tcp 10.217.0.2:50124->10.217.1.0:9311: read: connection reset by peer" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.132658 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerID="e92b430858ce601f5227262219a5e94c44ff24285066fed77c45b7e28a87d957" exitCode=0 Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.132851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" event={"ID":"5ef5e05d-7252-4671-93a7-1853df0cd05f","Type":"ContainerDied","Data":"e92b430858ce601f5227262219a5e94c44ff24285066fed77c45b7e28a87d957"} Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.137035 4769 generic.go:334] "Generic (PLEG): container finished" podID="a6e28035-4055-44b1-bcf6-31419510e886" containerID="4d2a28c2254339f07a7ea550acb8a0e054f6fdf405bb0a62a8c0ee3f91e0c6e9" exitCode=0 Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.137146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a6e28035-4055-44b1-bcf6-31419510e886","Type":"ContainerDied","Data":"4d2a28c2254339f07a7ea550acb8a0e054f6fdf405bb0a62a8c0ee3f91e0c6e9"} Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.149780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.154736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-m4mp9" event={"ID":"11a8d81f-ec12-4073-abad-8023c585e9c7","Type":"ContainerDied","Data":"9c1e12e08ffa678ea053159381479dc8041488ea97f1e326546cb86646c16843"} Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.154817 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c1e12e08ffa678ea053159381479dc8041488ea97f1e326546cb86646c16843" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.167658 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.267027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-combined-ca-bundle\") pod \"5ef5e05d-7252-4671-93a7-1853df0cd05f\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.267117 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsh7c\" (UniqueName: \"kubernetes.io/projected/5ef5e05d-7252-4671-93a7-1853df0cd05f-kube-api-access-tsh7c\") pod \"5ef5e05d-7252-4671-93a7-1853df0cd05f\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.267201 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ef5e05d-7252-4671-93a7-1853df0cd05f-logs\") pod \"5ef5e05d-7252-4671-93a7-1853df0cd05f\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.267227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data\") pod \"5ef5e05d-7252-4671-93a7-1853df0cd05f\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.267253 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data-custom\") pod \"5ef5e05d-7252-4671-93a7-1853df0cd05f\" (UID: \"5ef5e05d-7252-4671-93a7-1853df0cd05f\") " Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.269829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef5e05d-7252-4671-93a7-1853df0cd05f-logs" (OuterVolumeSpecName: "logs") pod "5ef5e05d-7252-4671-93a7-1853df0cd05f" (UID: "5ef5e05d-7252-4671-93a7-1853df0cd05f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.284739 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68"] Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286142 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5ef5e05d-7252-4671-93a7-1853df0cd05f" (UID: "5ef5e05d-7252-4671-93a7-1853df0cd05f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:18 crc kubenswrapper[4769]: E1121 12:44:18.286614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286642 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api" Nov 21 12:44:18 crc kubenswrapper[4769]: E1121 12:44:18.286666 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api-log" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286674 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api-log" Nov 21 12:44:18 crc kubenswrapper[4769]: E1121 12:44:18.286687 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11a8d81f-ec12-4073-abad-8023c585e9c7" containerName="neutron-db-sync" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286697 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a8d81f-ec12-4073-abad-8023c585e9c7" containerName="neutron-db-sync" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286912 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api-log" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286937 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="11a8d81f-ec12-4073-abad-8023c585e9c7" containerName="neutron-db-sync" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.286951 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" containerName="barbican-api" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.288379 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.293959 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-snfqj" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.294499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.294772 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.295020 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.295533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef5e05d-7252-4671-93a7-1853df0cd05f-kube-api-access-tsh7c" (OuterVolumeSpecName: "kube-api-access-tsh7c") pod "5ef5e05d-7252-4671-93a7-1853df0cd05f" (UID: "5ef5e05d-7252-4671-93a7-1853df0cd05f"). InnerVolumeSpecName "kube-api-access-tsh7c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.320734 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68"] Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.345578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5ef5e05d-7252-4671-93a7-1853df0cd05f" (UID: "5ef5e05d-7252-4671-93a7-1853df0cd05f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.356377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data" (OuterVolumeSpecName: "config-data") pod "5ef5e05d-7252-4671-93a7-1853df0cd05f" (UID: "5ef5e05d-7252-4671-93a7-1853df0cd05f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.370944 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.371015 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tsh7c\" (UniqueName: \"kubernetes.io/projected/5ef5e05d-7252-4671-93a7-1853df0cd05f-kube-api-access-tsh7c\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.371035 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ef5e05d-7252-4671-93a7-1853df0cd05f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.371046 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.371056 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ef5e05d-7252-4671-93a7-1853df0cd05f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.473147 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whr4b\" (UniqueName: \"kubernetes.io/projected/b6041691-cacc-46a8-8993-72770af7d96a-kube-api-access-whr4b\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.473327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-httpd-config\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.473440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-ovndb-tls-certs\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.473566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-combined-ca-bundle\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.473746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-config\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.575993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-ovndb-tls-certs\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.576054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-combined-ca-bundle\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.576102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-config\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.576152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-whr4b\" (UniqueName: \"kubernetes.io/projected/b6041691-cacc-46a8-8993-72770af7d96a-kube-api-access-whr4b\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.576223 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-httpd-config\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.581144 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-httpd-config\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.581181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-config\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.581651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-combined-ca-bundle\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.582056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-ovndb-tls-certs\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.594340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-whr4b\" (UniqueName: \"kubernetes.io/projected/b6041691-cacc-46a8-8993-72770af7d96a-kube-api-access-whr4b\") pod \"neutron-5cbcf7d67f-mmb68\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:18 crc kubenswrapper[4769]: I1121 12:44:18.610808 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.111816 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68"] Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.176511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" event={"ID":"5ef5e05d-7252-4671-93a7-1853df0cd05f","Type":"ContainerDied","Data":"a995aef3683ee61d12313f50d22de59daec591d7f3934bc25d3c9cd7a07dad4b"} Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.176571 4769 scope.go:117] "RemoveContainer" containerID="e92b430858ce601f5227262219a5e94c44ff24285066fed77c45b7e28a87d957" Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.176741 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf" Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.184411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" event={"ID":"b6041691-cacc-46a8-8993-72770af7d96a","Type":"ContainerStarted","Data":"e55f60489d940bbf89bf3020df8b7192cd42c219ec2612bb558260fd944d4897"} Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.279394 4769 scope.go:117] "RemoveContainer" containerID="774dbe64506fc3c1108c2ac068f51bbe90076f2c20cc05cabad6424c05700f40" Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.317053 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf"] Nov 21 12:44:19 crc kubenswrapper[4769]: I1121 12:44:19.317098 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-79d4d7f9cb-lvvxf"] Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.202392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" event={"ID":"b6041691-cacc-46a8-8993-72770af7d96a","Type":"ContainerStarted","Data":"5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125"} Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.203113 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.203133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" event={"ID":"b6041691-cacc-46a8-8993-72770af7d96a","Type":"ContainerStarted","Data":"672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784"} Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.226850 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" podStartSLOduration=2.226816914 podStartE2EDuration="2.226816914s" podCreationTimestamp="2025-11-21 12:44:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:20.220998006 +0000 UTC m=+3218.921659864" watchObservedRunningTime="2025-11-21 12:44:20.226816914 +0000 UTC m=+3218.927478742" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.823340 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5885cb869d-qjsvb"] Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.840038 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.843774 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.844157 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.875344 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5885cb869d-qjsvb"] Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-ovndb-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwj2v\" (UniqueName: \"kubernetes.io/projected/324118dd-eff5-47ce-aae2-ab2155ab1bd8-kube-api-access-rwj2v\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928206 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-public-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-internal-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-httpd-config\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:20 crc kubenswrapper[4769]: I1121 12:44:20.928360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-combined-ca-bundle\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rwj2v\" (UniqueName: \"kubernetes.io/projected/324118dd-eff5-47ce-aae2-ab2155ab1bd8-kube-api-access-rwj2v\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-public-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-internal-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029767 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-httpd-config\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029838 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-combined-ca-bundle\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.029860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-ovndb-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.040454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-ovndb-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.047402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-public-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.047799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-combined-ca-bundle\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.047910 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.048394 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-internal-tls-certs\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.052306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwj2v\" (UniqueName: \"kubernetes.io/projected/324118dd-eff5-47ce-aae2-ab2155ab1bd8-kube-api-access-rwj2v\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.082705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-httpd-config\") pod \"neutron-5885cb869d-qjsvb\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.221729 4769 generic.go:334] "Generic (PLEG): container finished" podID="a6e28035-4055-44b1-bcf6-31419510e886" containerID="e822b0af2c56c3f010908425fefbce190734501e7f1a4342834e41f83f873b6f" exitCode=0 Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.225506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a6e28035-4055-44b1-bcf6-31419510e886","Type":"ContainerDied","Data":"e822b0af2c56c3f010908425fefbce190734501e7f1a4342834e41f83f873b6f"} Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.225556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a6e28035-4055-44b1-bcf6-31419510e886","Type":"ContainerDied","Data":"6cdf5baaa219009cf06ba466f6f863cce52522751908cd85162e7cc9c7f907fb"} Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.225571 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cdf5baaa219009cf06ba466f6f863cce52522751908cd85162e7cc9c7f907fb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.245343 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.291056 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef5e05d-7252-4671-93a7-1853df0cd05f" path="/var/lib/kubelet/pods/5ef5e05d-7252-4671-93a7-1853df0cd05f/volumes" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.296789 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.465380 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-combined-ca-bundle\") pod \"a6e28035-4055-44b1-bcf6-31419510e886\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.465434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-scripts\") pod \"a6e28035-4055-44b1-bcf6-31419510e886\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.465457 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a6e28035-4055-44b1-bcf6-31419510e886-etc-machine-id\") pod \"a6e28035-4055-44b1-bcf6-31419510e886\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.465533 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data\") pod \"a6e28035-4055-44b1-bcf6-31419510e886\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.465571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data-custom\") pod \"a6e28035-4055-44b1-bcf6-31419510e886\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.466126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klw6g\" (UniqueName: \"kubernetes.io/projected/a6e28035-4055-44b1-bcf6-31419510e886-kube-api-access-klw6g\") pod \"a6e28035-4055-44b1-bcf6-31419510e886\" (UID: \"a6e28035-4055-44b1-bcf6-31419510e886\") " Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.468828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a6e28035-4055-44b1-bcf6-31419510e886-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "a6e28035-4055-44b1-bcf6-31419510e886" (UID: "a6e28035-4055-44b1-bcf6-31419510e886"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.473055 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a6e28035-4055-44b1-bcf6-31419510e886" (UID: "a6e28035-4055-44b1-bcf6-31419510e886"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.473845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-scripts" (OuterVolumeSpecName: "scripts") pod "a6e28035-4055-44b1-bcf6-31419510e886" (UID: "a6e28035-4055-44b1-bcf6-31419510e886"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.477691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e28035-4055-44b1-bcf6-31419510e886-kube-api-access-klw6g" (OuterVolumeSpecName: "kube-api-access-klw6g") pod "a6e28035-4055-44b1-bcf6-31419510e886" (UID: "a6e28035-4055-44b1-bcf6-31419510e886"). InnerVolumeSpecName "kube-api-access-klw6g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.530765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a6e28035-4055-44b1-bcf6-31419510e886" (UID: "a6e28035-4055-44b1-bcf6-31419510e886"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.568448 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-klw6g\" (UniqueName: \"kubernetes.io/projected/a6e28035-4055-44b1-bcf6-31419510e886-kube-api-access-klw6g\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.568484 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.568498 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.568510 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a6e28035-4055-44b1-bcf6-31419510e886-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.568520 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.608325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data" (OuterVolumeSpecName: "config-data") pod "a6e28035-4055-44b1-bcf6-31419510e886" (UID: "a6e28035-4055-44b1-bcf6-31419510e886"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.671243 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6e28035-4055-44b1-bcf6-31419510e886-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:21 crc kubenswrapper[4769]: W1121 12:44:21.699655 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod324118dd_eff5_47ce_aae2_ab2155ab1bd8.slice/crio-4707e0a0ff490caa9e39e06ccd1fce845f884777fa50c81f6d540308d3b9ed23 WatchSource:0}: Error finding container 4707e0a0ff490caa9e39e06ccd1fce845f884777fa50c81f6d540308d3b9ed23: Status 404 returned error can't find the container with id 4707e0a0ff490caa9e39e06ccd1fce845f884777fa50c81f6d540308d3b9ed23 Nov 21 12:44:21 crc kubenswrapper[4769]: I1121 12:44:21.701105 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5885cb869d-qjsvb"] Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.236526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" event={"ID":"324118dd-eff5-47ce-aae2-ab2155ab1bd8","Type":"ContainerStarted","Data":"7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb"} Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.237010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" event={"ID":"324118dd-eff5-47ce-aae2-ab2155ab1bd8","Type":"ContainerStarted","Data":"4707e0a0ff490caa9e39e06ccd1fce845f884777fa50c81f6d540308d3b9ed23"} Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.236584 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.273406 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.281764 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.311088 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:22 crc kubenswrapper[4769]: E1121 12:44:22.311581 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="cinder-scheduler" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.311608 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="cinder-scheduler" Nov 21 12:44:22 crc kubenswrapper[4769]: E1121 12:44:22.311635 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="probe" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.311645 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="probe" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.311844 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="probe" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.311863 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a6e28035-4055-44b1-bcf6-31419510e886" containerName="cinder-scheduler" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.312915 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.320076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.321588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.393904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.393977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.394062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-scripts\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.394119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5f4\" (UniqueName: \"kubernetes.io/projected/3360df8e-c791-460f-a1bc-d2a473cd9028-kube-api-access-9r5f4\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.394222 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3360df8e-c791-460f-a1bc-d2a473cd9028-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.394254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.494991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3360df8e-c791-460f-a1bc-d2a473cd9028-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.495045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.495071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.495106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.495155 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-scripts\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.495219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5f4\" (UniqueName: \"kubernetes.io/projected/3360df8e-c791-460f-a1bc-d2a473cd9028-kube-api-access-9r5f4\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.495665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3360df8e-c791-460f-a1bc-d2a473cd9028-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.500614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.501722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.504737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.509600 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-scripts\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.522939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5f4\" (UniqueName: \"kubernetes.io/projected/3360df8e-c791-460f-a1bc-d2a473cd9028-kube-api-access-9r5f4\") pod \"cinder-scheduler-0\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:22 crc kubenswrapper[4769]: I1121 12:44:22.654261 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:23 crc kubenswrapper[4769]: I1121 12:44:23.250831 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:44:23 crc kubenswrapper[4769]: I1121 12:44:23.272085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3360df8e-c791-460f-a1bc-d2a473cd9028","Type":"ContainerStarted","Data":"494b95dbe88246d8a4624a563f65957aea0b27f7eb54c1526dc16680750dbd1a"} Nov 21 12:44:23 crc kubenswrapper[4769]: I1121 12:44:23.293535 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e28035-4055-44b1-bcf6-31419510e886" path="/var/lib/kubelet/pods/a6e28035-4055-44b1-bcf6-31419510e886/volumes" Nov 21 12:44:23 crc kubenswrapper[4769]: I1121 12:44:23.294593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" event={"ID":"324118dd-eff5-47ce-aae2-ab2155ab1bd8","Type":"ContainerStarted","Data":"e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904"} Nov 21 12:44:23 crc kubenswrapper[4769]: I1121 12:44:23.372210 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" podStartSLOduration=3.372170919 podStartE2EDuration="3.372170919s" podCreationTimestamp="2025-11-21 12:44:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:23.358006323 +0000 UTC m=+3222.058668141" watchObservedRunningTime="2025-11-21 12:44:23.372170919 +0000 UTC m=+3222.072832737" Nov 21 12:44:24 crc kubenswrapper[4769]: I1121 12:44:24.299227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3360df8e-c791-460f-a1bc-d2a473cd9028","Type":"ContainerStarted","Data":"f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346"} Nov 21 12:44:24 crc kubenswrapper[4769]: I1121 12:44:24.300017 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:25 crc kubenswrapper[4769]: I1121 12:44:25.301444 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:44:25 crc kubenswrapper[4769]: I1121 12:44:25.317860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3360df8e-c791-460f-a1bc-d2a473cd9028","Type":"ContainerStarted","Data":"aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42"} Nov 21 12:44:25 crc kubenswrapper[4769]: I1121 12:44:25.418569 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.418531429 podStartE2EDuration="3.418531429s" podCreationTimestamp="2025-11-21 12:44:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:25.400409617 +0000 UTC m=+3224.101071435" watchObservedRunningTime="2025-11-21 12:44:25.418531429 +0000 UTC m=+3224.119193247" Nov 21 12:44:27 crc kubenswrapper[4769]: I1121 12:44:27.393925 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod6806d38c-af44-4215-94da-a24176d6e8f2"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod6806d38c-af44-4215-94da-a24176d6e8f2] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6806d38c_af44_4215_94da_a24176d6e8f2.slice" Nov 21 12:44:27 crc kubenswrapper[4769]: E1121 12:44:27.394561 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod6806d38c-af44-4215-94da-a24176d6e8f2] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod6806d38c-af44-4215-94da-a24176d6e8f2] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6806d38c_af44_4215_94da_a24176d6e8f2.slice" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" podUID="6806d38c-af44-4215-94da-a24176d6e8f2" Nov 21 12:44:27 crc kubenswrapper[4769]: I1121 12:44:27.654691 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:27 crc kubenswrapper[4769]: I1121 12:44:27.926767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:28 crc kubenswrapper[4769]: I1121 12:44:28.357585 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f6jrf" Nov 21 12:44:28 crc kubenswrapper[4769]: I1121 12:44:28.816885 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:44:28 crc kubenswrapper[4769]: I1121 12:44:28.819758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:44:29 crc kubenswrapper[4769]: I1121 12:44:29.276556 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:44:29 crc kubenswrapper[4769]: E1121 12:44:29.276809 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:44:29 crc kubenswrapper[4769]: I1121 12:44:29.669267 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod4488e602-68fa-4259-987c-2279513c4394"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod4488e602-68fa-4259-987c-2279513c4394] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4488e602_68fa_4259_987c_2279513c4394.slice" Nov 21 12:44:32 crc kubenswrapper[4769]: I1121 12:44:32.966057 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:44:38 crc kubenswrapper[4769]: I1121 12:44:38.773846 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.231003 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.232944 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.240038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-dvh5m" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.240410 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.240549 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.251927 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.255600 4769 status_manager.go:875] "Failed to update status for pod" pod="openstack-kuttl-tests/openstackclient" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ff88fd78-f462-48a2-accd-d28611ebd98f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T12:44:41Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T12:44:41Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T12:44:41Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T12:44:41Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/podified-antelope-centos9/openstack-openstackclient@sha256:fed8e34e2c12b6bae77e207c0620bf237aee86c22f0e5e8dc5a39d1920d422cb\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"openstackclient\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/clouds.yaml\\\",\\\"name\\\":\\\"openstack-config\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/secure.yaml\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/cloudrc\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem\\\",\\\"name\\\":\\\"combined-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-99lvt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T12:44:41Z\\\"}}\" for pod \"openstack-kuttl-tests\"/\"openstackclient\": pods \"openstackclient\" not found" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.268320 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:41 crc kubenswrapper[4769]: E1121 12:44:41.270348 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-99lvt openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="ff88fd78-f462-48a2-accd-d28611ebd98f" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.276551 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:44:41 crc kubenswrapper[4769]: E1121 12:44:41.276786 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.297887 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.314241 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.316136 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.321972 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="ff88fd78-f462-48a2-accd-d28611ebd98f" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.326837 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.345428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.345565 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99lvt\" (UniqueName: \"kubernetes.io/projected/ff88fd78-f462-48a2-accd-d28611ebd98f-kube-api-access-99lvt\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.345682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config-secret\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.345708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-combined-ca-bundle\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448223 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-combined-ca-bundle\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scl5v\" (UniqueName: \"kubernetes.io/projected/16871c90-c542-47f1-b528-6d2384b9bcd0-kube-api-access-scl5v\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-combined-ca-bundle\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-99lvt\" (UniqueName: \"kubernetes.io/projected/ff88fd78-f462-48a2-accd-d28611ebd98f-kube-api-access-99lvt\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config-secret\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.448973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config-secret\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.450567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: E1121 12:44:41.452864 4769 projected.go:194] Error preparing data for projected volume kube-api-access-99lvt for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (ff88fd78-f462-48a2-accd-d28611ebd98f) does not match the UID in record. The object might have been deleted and then recreated Nov 21 12:44:41 crc kubenswrapper[4769]: E1121 12:44:41.452974 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff88fd78-f462-48a2-accd-d28611ebd98f-kube-api-access-99lvt podName:ff88fd78-f462-48a2-accd-d28611ebd98f nodeName:}" failed. No retries permitted until 2025-11-21 12:44:41.95294621 +0000 UTC m=+3240.653608028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-99lvt" (UniqueName: "kubernetes.io/projected/ff88fd78-f462-48a2-accd-d28611ebd98f-kube-api-access-99lvt") pod "openstackclient" (UID: "ff88fd78-f462-48a2-accd-d28611ebd98f") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (ff88fd78-f462-48a2-accd-d28611ebd98f) does not match the UID in record. The object might have been deleted and then recreated Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.456693 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config-secret\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.457317 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-combined-ca-bundle\") pod \"openstackclient\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.550725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-scl5v\" (UniqueName: \"kubernetes.io/projected/16871c90-c542-47f1-b528-6d2384b9bcd0-kube-api-access-scl5v\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.550868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.550908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-combined-ca-bundle\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.551060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config-secret\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.555093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.557697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-combined-ca-bundle\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.561218 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.564010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config-secret\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.565451 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="ff88fd78-f462-48a2-accd-d28611ebd98f" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.575033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-scl5v\" (UniqueName: \"kubernetes.io/projected/16871c90-c542-47f1-b528-6d2384b9bcd0-kube-api-access-scl5v\") pod \"openstackclient\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.638007 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.651908 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.655251 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="ff88fd78-f462-48a2-accd-d28611ebd98f" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.758568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-combined-ca-bundle\") pod \"ff88fd78-f462-48a2-accd-d28611ebd98f\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.758725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config\") pod \"ff88fd78-f462-48a2-accd-d28611ebd98f\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.758841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config-secret\") pod \"ff88fd78-f462-48a2-accd-d28611ebd98f\" (UID: \"ff88fd78-f462-48a2-accd-d28611ebd98f\") " Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.759492 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-99lvt\" (UniqueName: \"kubernetes.io/projected/ff88fd78-f462-48a2-accd-d28611ebd98f-kube-api-access-99lvt\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.765507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff88fd78-f462-48a2-accd-d28611ebd98f" (UID: "ff88fd78-f462-48a2-accd-d28611ebd98f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.765681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "ff88fd78-f462-48a2-accd-d28611ebd98f" (UID: "ff88fd78-f462-48a2-accd-d28611ebd98f"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.773314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "ff88fd78-f462-48a2-accd-d28611ebd98f" (UID: "ff88fd78-f462-48a2-accd-d28611ebd98f"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.861316 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.861702 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff88fd78-f462-48a2-accd-d28611ebd98f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:41 crc kubenswrapper[4769]: I1121 12:44:41.861714 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/ff88fd78-f462-48a2-accd-d28611ebd98f-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.216710 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.575854 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.576644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"16871c90-c542-47f1-b528-6d2384b9bcd0","Type":"ContainerStarted","Data":"93ac65b5ac031fb778736d51bfd33e6eb245d89d3d9c2d7bc36b1b5e9626ae10"} Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.576709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"16871c90-c542-47f1-b528-6d2384b9bcd0","Type":"ContainerStarted","Data":"2fe4809b19dbc2b755b9f09cac3d1922049151bee6f83ea30c607d3e89d7fdec"} Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.597941 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="ff88fd78-f462-48a2-accd-d28611ebd98f" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.598435 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.598411826 podStartE2EDuration="1.598411826s" podCreationTimestamp="2025-11-21 12:44:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:42.594287295 +0000 UTC m=+3241.294949113" watchObservedRunningTime="2025-11-21 12:44:42.598411826 +0000 UTC m=+3241.299073654" Nov 21 12:44:42 crc kubenswrapper[4769]: I1121 12:44:42.605486 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="ff88fd78-f462-48a2-accd-d28611ebd98f" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" Nov 21 12:44:43 crc kubenswrapper[4769]: I1121 12:44:43.291206 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff88fd78-f462-48a2-accd-d28611ebd98f" path="/var/lib/kubelet/pods/ff88fd78-f462-48a2-accd-d28611ebd98f/volumes" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.072170 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh"] Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.077228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.080581 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.087829 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.088982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.105026 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh"] Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.273333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-public-tls-certs\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.274372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-etc-swift\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.274449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-internal-tls-certs\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.274520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-config-data\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.275284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7cdf\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-kube-api-access-w7cdf\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.275362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-log-httpd\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.275560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-combined-ca-bundle\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.275648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-run-httpd\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.354142 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.354611 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-central-agent" containerID="cri-o://dc4f423ba20b7a1b751e6c331e0b1220cb7a7c43454fda5b042c327d4f8e6aad" gracePeriod=30 Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.354677 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="sg-core" containerID="cri-o://ac392612a8b84fee90760a1dde265607ae88c42cc65c0a21362e93aab53033ac" gracePeriod=30 Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.354743 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="proxy-httpd" containerID="cri-o://1efd85ce7f9bf17e4fd851e0ffc8c0329d2f12d541787b1b0c169cbc71e1d84c" gracePeriod=30 Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.354786 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-notification-agent" containerID="cri-o://a46145bc2aaaa237b797950e81f3fdcf0832bf79ceb897bf30e43ad8ab5e109f" gracePeriod=30 Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.378688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-public-tls-certs\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.378832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-etc-swift\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.378882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-internal-tls-certs\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.378925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-config-data\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.378986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w7cdf\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-kube-api-access-w7cdf\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.379028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-log-httpd\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.379078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-combined-ca-bundle\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.379115 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-run-httpd\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.379865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-run-httpd\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.380274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-log-httpd\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.387596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-combined-ca-bundle\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.387603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-internal-tls-certs\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.389012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-config-data\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.390145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-public-tls-certs\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.392444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-etc-swift\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.408624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7cdf\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-kube-api-access-w7cdf\") pod \"swift-proxy-7bb5bb8474-4p7hh\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.414729 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.647828 4769 generic.go:334] "Generic (PLEG): container finished" podID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerID="1efd85ce7f9bf17e4fd851e0ffc8c0329d2f12d541787b1b0c169cbc71e1d84c" exitCode=0 Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.648118 4769 generic.go:334] "Generic (PLEG): container finished" podID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerID="ac392612a8b84fee90760a1dde265607ae88c42cc65c0a21362e93aab53033ac" exitCode=2 Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.648149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerDied","Data":"1efd85ce7f9bf17e4fd851e0ffc8c0329d2f12d541787b1b0c169cbc71e1d84c"} Nov 21 12:44:46 crc kubenswrapper[4769]: I1121 12:44:46.648203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerDied","Data":"ac392612a8b84fee90760a1dde265607ae88c42cc65c0a21362e93aab53033ac"} Nov 21 12:44:47 crc kubenswrapper[4769]: W1121 12:44:47.014393 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0ee2070_d0d3_48e5_a82e_e902f5daf74b.slice/crio-58dd41957abdf8fa9893d7b6c5729755c41c35285c3220b1dda3e03942072bb7 WatchSource:0}: Error finding container 58dd41957abdf8fa9893d7b6c5729755c41c35285c3220b1dda3e03942072bb7: Status 404 returned error can't find the container with id 58dd41957abdf8fa9893d7b6c5729755c41c35285c3220b1dda3e03942072bb7 Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.017594 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh"] Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.666506 4769 generic.go:334] "Generic (PLEG): container finished" podID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerID="dc4f423ba20b7a1b751e6c331e0b1220cb7a7c43454fda5b042c327d4f8e6aad" exitCode=0 Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.666607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerDied","Data":"dc4f423ba20b7a1b751e6c331e0b1220cb7a7c43454fda5b042c327d4f8e6aad"} Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.669365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" event={"ID":"a0ee2070-d0d3-48e5-a82e-e902f5daf74b","Type":"ContainerStarted","Data":"c22b152459ac64dcc18bc3a178f69f96bcf6eb13092d379e4b03db1548875160"} Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.669402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" event={"ID":"a0ee2070-d0d3-48e5-a82e-e902f5daf74b","Type":"ContainerStarted","Data":"5e37766e0cc8f0454c5e8ceb91238c3d60d326c7563a0d29d8febda4bf390814"} Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.669415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" event={"ID":"a0ee2070-d0d3-48e5-a82e-e902f5daf74b","Type":"ContainerStarted","Data":"58dd41957abdf8fa9893d7b6c5729755c41c35285c3220b1dda3e03942072bb7"} Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.669637 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:47 crc kubenswrapper[4769]: I1121 12:44:47.698160 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" podStartSLOduration=1.698131515 podStartE2EDuration="1.698131515s" podCreationTimestamp="2025-11-21 12:44:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:44:47.69311021 +0000 UTC m=+3246.393772028" watchObservedRunningTime="2025-11-21 12:44:47.698131515 +0000 UTC m=+3246.398793333" Nov 21 12:44:48 crc kubenswrapper[4769]: I1121 12:44:48.626085 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:48 crc kubenswrapper[4769]: I1121 12:44:48.697056 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.721845 4769 generic.go:334] "Generic (PLEG): container finished" podID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerID="a46145bc2aaaa237b797950e81f3fdcf0832bf79ceb897bf30e43ad8ab5e109f" exitCode=0 Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.721899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerDied","Data":"a46145bc2aaaa237b797950e81f3fdcf0832bf79ceb897bf30e43ad8ab5e109f"} Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.894174 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqvzd\" (UniqueName: \"kubernetes.io/projected/7adf0c1d-4e74-42b6-acee-ea4c6305e308-kube-api-access-jqvzd\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-scripts\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-run-httpd\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-combined-ca-bundle\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960696 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-log-httpd\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-sg-core-conf-yaml\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.960756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-config-data\") pod \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\" (UID: \"7adf0c1d-4e74-42b6-acee-ea4c6305e308\") " Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.961586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.961646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.961753 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.961772 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7adf0c1d-4e74-42b6-acee-ea4c6305e308-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.968978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-scripts" (OuterVolumeSpecName: "scripts") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:49 crc kubenswrapper[4769]: I1121 12:44:49.970503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7adf0c1d-4e74-42b6-acee-ea4c6305e308-kube-api-access-jqvzd" (OuterVolumeSpecName: "kube-api-access-jqvzd") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "kube-api-access-jqvzd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.036306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.062654 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.062806 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.062865 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jqvzd\" (UniqueName: \"kubernetes.io/projected/7adf0c1d-4e74-42b6-acee-ea4c6305e308-kube-api-access-jqvzd\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.067283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.069739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-config-data" (OuterVolumeSpecName: "config-data") pod "7adf0c1d-4e74-42b6-acee-ea4c6305e308" (UID: "7adf0c1d-4e74-42b6-acee-ea4c6305e308"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.164808 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.164863 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7adf0c1d-4e74-42b6-acee-ea4c6305e308-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.713028 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.713485 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="344ee685-9247-4375-a3e4-03ec648356d5" containerName="kube-state-metrics" containerID="cri-o://b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5" gracePeriod=30 Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.738631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7adf0c1d-4e74-42b6-acee-ea4c6305e308","Type":"ContainerDied","Data":"ed4ad3e09e1f586462ae0126693ea61e8f582960a7c9885f6d49f3c327243e11"} Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.738735 4769 scope.go:117] "RemoveContainer" containerID="1efd85ce7f9bf17e4fd851e0ffc8c0329d2f12d541787b1b0c169cbc71e1d84c" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.738756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.817163 4769 scope.go:117] "RemoveContainer" containerID="ac392612a8b84fee90760a1dde265607ae88c42cc65c0a21362e93aab53033ac" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.825995 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.838250 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.875149 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:50 crc kubenswrapper[4769]: E1121 12:44:50.876326 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-notification-agent" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876345 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-notification-agent" Nov 21 12:44:50 crc kubenswrapper[4769]: E1121 12:44:50.876399 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="proxy-httpd" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="proxy-httpd" Nov 21 12:44:50 crc kubenswrapper[4769]: E1121 12:44:50.876460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="sg-core" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876467 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="sg-core" Nov 21 12:44:50 crc kubenswrapper[4769]: E1121 12:44:50.876496 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-central-agent" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876504 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-central-agent" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876864 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-notification-agent" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876887 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="ceilometer-central-agent" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876902 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="sg-core" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.876929 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" containerName="proxy-httpd" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.879412 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.882449 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.882672 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.885928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.888459 4769 scope.go:117] "RemoveContainer" containerID="a46145bc2aaaa237b797950e81f3fdcf0832bf79ceb897bf30e43ad8ab5e109f" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.954664 4769 scope.go:117] "RemoveContainer" containerID="dc4f423ba20b7a1b751e6c331e0b1220cb7a7c43454fda5b042c327d4f8e6aad" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wz5j\" (UniqueName: \"kubernetes.io/projected/97b8440d-f7c8-4e4e-8369-65b02b8aa684-kube-api-access-9wz5j\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986144 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-config-data\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986207 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-scripts\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-run-httpd\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:50 crc kubenswrapper[4769]: I1121 12:44:50.986266 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-log-httpd\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9wz5j\" (UniqueName: \"kubernetes.io/projected/97b8440d-f7c8-4e4e-8369-65b02b8aa684-kube-api-access-9wz5j\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-config-data\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-scripts\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-run-httpd\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.088499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-log-httpd\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.089087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-log-httpd\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.091914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-run-httpd\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.096359 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-scripts\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.098207 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.098742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.103021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-config-data\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.110255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wz5j\" (UniqueName: \"kubernetes.io/projected/97b8440d-f7c8-4e4e-8369-65b02b8aa684-kube-api-access-9wz5j\") pod \"ceilometer-0\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.229403 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.238365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.303671 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7adf0c1d-4e74-42b6-acee-ea4c6305e308" path="/var/lib/kubelet/pods/7adf0c1d-4e74-42b6-acee-ea4c6305e308/volumes" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.308727 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.377011 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68"] Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.377281 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-api" containerID="cri-o://672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784" gracePeriod=30 Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.378402 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-httpd" containerID="cri-o://5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125" gracePeriod=30 Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.397497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh62j\" (UniqueName: \"kubernetes.io/projected/344ee685-9247-4375-a3e4-03ec648356d5-kube-api-access-gh62j\") pod \"344ee685-9247-4375-a3e4-03ec648356d5\" (UID: \"344ee685-9247-4375-a3e4-03ec648356d5\") " Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.402604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/344ee685-9247-4375-a3e4-03ec648356d5-kube-api-access-gh62j" (OuterVolumeSpecName: "kube-api-access-gh62j") pod "344ee685-9247-4375-a3e4-03ec648356d5" (UID: "344ee685-9247-4375-a3e4-03ec648356d5"). InnerVolumeSpecName "kube-api-access-gh62j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.501272 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gh62j\" (UniqueName: \"kubernetes.io/projected/344ee685-9247-4375-a3e4-03ec648356d5-kube-api-access-gh62j\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.753416 4769 generic.go:334] "Generic (PLEG): container finished" podID="344ee685-9247-4375-a3e4-03ec648356d5" containerID="b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5" exitCode=2 Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.753514 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.753526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"344ee685-9247-4375-a3e4-03ec648356d5","Type":"ContainerDied","Data":"b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5"} Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.753564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"344ee685-9247-4375-a3e4-03ec648356d5","Type":"ContainerDied","Data":"4205e7379854a3c822424cb8e83315e10396dc89d7253ea29cb4896c2abe3672"} Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.753619 4769 scope.go:117] "RemoveContainer" containerID="b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.757624 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.766514 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.777173 4769 generic.go:334] "Generic (PLEG): container finished" podID="b6041691-cacc-46a8-8993-72770af7d96a" containerID="5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125" exitCode=0 Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.777229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" event={"ID":"b6041691-cacc-46a8-8993-72770af7d96a","Type":"ContainerDied","Data":"5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125"} Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.830938 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.836064 4769 scope.go:117] "RemoveContainer" containerID="b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5" Nov 21 12:44:51 crc kubenswrapper[4769]: E1121 12:44:51.836848 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5\": container with ID starting with b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5 not found: ID does not exist" containerID="b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.836893 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5"} err="failed to get container status \"b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5\": rpc error: code = NotFound desc = could not find container \"b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5\": container with ID starting with b2326e12fd38a13096eabb088d23d4e57b68904554f24cfa11601577e56664b5 not found: ID does not exist" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.838621 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.860385 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:44:51 crc kubenswrapper[4769]: E1121 12:44:51.861081 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="344ee685-9247-4375-a3e4-03ec648356d5" containerName="kube-state-metrics" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.861109 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="344ee685-9247-4375-a3e4-03ec648356d5" containerName="kube-state-metrics" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.861421 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="344ee685-9247-4375-a3e4-03ec648356d5" containerName="kube-state-metrics" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.862470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.871891 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.881575 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:44:51 crc kubenswrapper[4769]: I1121 12:44:51.890865 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.016737 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.017120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.017156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b69s7\" (UniqueName: \"kubernetes.io/projected/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-api-access-b69s7\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.017217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.119315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.119414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.119472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b69s7\" (UniqueName: \"kubernetes.io/projected/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-api-access-b69s7\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.119562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.127208 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.136021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.136370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.160121 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b69s7\" (UniqueName: \"kubernetes.io/projected/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-api-access-b69s7\") pod \"kube-state-metrics-0\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.180142 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.716683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.736457 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.788895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e59628c3-2e82-4f0c-a148-66ea1e85edca","Type":"ContainerStarted","Data":"60ab61612c450cba5013dba91347c0aa13bba14e2904a8af2801844890f3d13b"} Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.792477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerStarted","Data":"a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68"} Nov 21 12:44:52 crc kubenswrapper[4769]: I1121 12:44:52.792611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerStarted","Data":"26ce3ce92aee6bed4a263772acb13940f30e331535a67c6ec0e893e69288e089"} Nov 21 12:44:53 crc kubenswrapper[4769]: I1121 12:44:53.310894 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:44:53 crc kubenswrapper[4769]: E1121 12:44:53.311447 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:44:53 crc kubenswrapper[4769]: I1121 12:44:53.336979 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="344ee685-9247-4375-a3e4-03ec648356d5" path="/var/lib/kubelet/pods/344ee685-9247-4375-a3e4-03ec648356d5/volumes" Nov 21 12:44:53 crc kubenswrapper[4769]: I1121 12:44:53.811083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerStarted","Data":"0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228"} Nov 21 12:44:53 crc kubenswrapper[4769]: I1121 12:44:53.813836 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:44:53 crc kubenswrapper[4769]: I1121 12:44:53.832329 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.185557375 podStartE2EDuration="2.832303125s" podCreationTimestamp="2025-11-21 12:44:51 +0000 UTC" firstStartedPulling="2025-11-21 12:44:52.72136009 +0000 UTC m=+3251.422021908" lastFinishedPulling="2025-11-21 12:44:53.36810583 +0000 UTC m=+3252.068767658" observedRunningTime="2025-11-21 12:44:53.830145207 +0000 UTC m=+3252.530807025" watchObservedRunningTime="2025-11-21 12:44:53.832303125 +0000 UTC m=+3252.532964943" Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.332937 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.333879 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-log" containerID="cri-o://cdfbfbd6be4222375a45f2688bfaa47e2314b9852abf0063aecc75f65be3c1d4" gracePeriod=30 Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.334067 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-httpd" containerID="cri-o://0b2d1f7ec44ccc5764ca0531ac173f28dd9d74edab0dc9fdf0c2bafe48a6e7af" gracePeriod=30 Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.826632 4769 generic.go:334] "Generic (PLEG): container finished" podID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerID="cdfbfbd6be4222375a45f2688bfaa47e2314b9852abf0063aecc75f65be3c1d4" exitCode=143 Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.826712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"13c6fb58-b0b0-4980-bd79-a86a2375f047","Type":"ContainerDied","Data":"cdfbfbd6be4222375a45f2688bfaa47e2314b9852abf0063aecc75f65be3c1d4"} Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.829340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e59628c3-2e82-4f0c-a148-66ea1e85edca","Type":"ContainerStarted","Data":"169f6f0dc7f9175300da2ec97a1d9938bda7b7301f2f9d48cbd6fb6270944bc7"} Nov 21 12:44:54 crc kubenswrapper[4769]: I1121 12:44:54.831804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerStarted","Data":"58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376"} Nov 21 12:44:55 crc kubenswrapper[4769]: I1121 12:44:55.286273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:44:55 crc kubenswrapper[4769]: I1121 12:44:55.286577 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-log" containerID="cri-o://bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e" gracePeriod=30 Nov 21 12:44:55 crc kubenswrapper[4769]: I1121 12:44:55.286722 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-httpd" containerID="cri-o://76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c" gracePeriod=30 Nov 21 12:44:55 crc kubenswrapper[4769]: I1121 12:44:55.846006 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerID="bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e" exitCode=143 Nov 21 12:44:55 crc kubenswrapper[4769]: I1121 12:44:55.846171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5e0b8e2f-1237-41b9-a04b-787064d2047b","Type":"ContainerDied","Data":"bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e"} Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.424920 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.425737 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.863744 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-central-agent" containerID="cri-o://a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68" gracePeriod=30 Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.864242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerStarted","Data":"00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0"} Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.864315 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.864821 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="proxy-httpd" containerID="cri-o://00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0" gracePeriod=30 Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.864947 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="sg-core" containerID="cri-o://58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376" gracePeriod=30 Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.865032 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-notification-agent" containerID="cri-o://0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228" gracePeriod=30 Nov 21 12:44:56 crc kubenswrapper[4769]: I1121 12:44:56.894624 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.023755168 podStartE2EDuration="6.89459761s" podCreationTimestamp="2025-11-21 12:44:50 +0000 UTC" firstStartedPulling="2025-11-21 12:44:51.766214389 +0000 UTC m=+3250.466876207" lastFinishedPulling="2025-11-21 12:44:55.637056831 +0000 UTC m=+3254.337718649" observedRunningTime="2025-11-21 12:44:56.892629897 +0000 UTC m=+3255.593291735" watchObservedRunningTime="2025-11-21 12:44:56.89459761 +0000 UTC m=+3255.595259418" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.524741 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.250:9292/healthcheck\": read tcp 10.217.0.2:39826->10.217.0.250:9292: read: connection reset by peer" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.525017 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.250:9292/healthcheck\": read tcp 10.217.0.2:39814->10.217.0.250:9292: read: connection reset by peer" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.531758 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.567060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whr4b\" (UniqueName: \"kubernetes.io/projected/b6041691-cacc-46a8-8993-72770af7d96a-kube-api-access-whr4b\") pod \"b6041691-cacc-46a8-8993-72770af7d96a\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.567384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-combined-ca-bundle\") pod \"b6041691-cacc-46a8-8993-72770af7d96a\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.567456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-httpd-config\") pod \"b6041691-cacc-46a8-8993-72770af7d96a\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.567486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-config\") pod \"b6041691-cacc-46a8-8993-72770af7d96a\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.567531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-ovndb-tls-certs\") pod \"b6041691-cacc-46a8-8993-72770af7d96a\" (UID: \"b6041691-cacc-46a8-8993-72770af7d96a\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.575707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "b6041691-cacc-46a8-8993-72770af7d96a" (UID: "b6041691-cacc-46a8-8993-72770af7d96a"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.575754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6041691-cacc-46a8-8993-72770af7d96a-kube-api-access-whr4b" (OuterVolumeSpecName: "kube-api-access-whr4b") pod "b6041691-cacc-46a8-8993-72770af7d96a" (UID: "b6041691-cacc-46a8-8993-72770af7d96a"). InnerVolumeSpecName "kube-api-access-whr4b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.650248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-config" (OuterVolumeSpecName: "config") pod "b6041691-cacc-46a8-8993-72770af7d96a" (UID: "b6041691-cacc-46a8-8993-72770af7d96a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.670839 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.670878 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.670890 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-whr4b\" (UniqueName: \"kubernetes.io/projected/b6041691-cacc-46a8-8993-72770af7d96a-kube-api-access-whr4b\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.673346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "b6041691-cacc-46a8-8993-72770af7d96a" (UID: "b6041691-cacc-46a8-8993-72770af7d96a"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.677392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b6041691-cacc-46a8-8993-72770af7d96a" (UID: "b6041691-cacc-46a8-8993-72770af7d96a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.773231 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.773287 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6041691-cacc-46a8-8993-72770af7d96a-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.881497 4769 generic.go:334] "Generic (PLEG): container finished" podID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerID="00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0" exitCode=0 Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.881543 4769 generic.go:334] "Generic (PLEG): container finished" podID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerID="58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376" exitCode=2 Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.881555 4769 generic.go:334] "Generic (PLEG): container finished" podID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerID="0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228" exitCode=0 Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.881577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerDied","Data":"00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0"} Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.881634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerDied","Data":"58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376"} Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.881650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerDied","Data":"0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228"} Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.884402 4769 generic.go:334] "Generic (PLEG): container finished" podID="b6041691-cacc-46a8-8993-72770af7d96a" containerID="672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784" exitCode=0 Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.884628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.884877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" event={"ID":"b6041691-cacc-46a8-8993-72770af7d96a","Type":"ContainerDied","Data":"672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784"} Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.884906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68" event={"ID":"b6041691-cacc-46a8-8993-72770af7d96a","Type":"ContainerDied","Data":"e55f60489d940bbf89bf3020df8b7192cd42c219ec2612bb558260fd944d4897"} Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.884926 4769 scope.go:117] "RemoveContainer" containerID="5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.890466 4769 generic.go:334] "Generic (PLEG): container finished" podID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerID="0b2d1f7ec44ccc5764ca0531ac173f28dd9d74edab0dc9fdf0c2bafe48a6e7af" exitCode=0 Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.890522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"13c6fb58-b0b0-4980-bd79-a86a2375f047","Type":"ContainerDied","Data":"0b2d1f7ec44ccc5764ca0531ac173f28dd9d74edab0dc9fdf0c2bafe48a6e7af"} Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.917875 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.928402 4769 scope.go:117] "RemoveContainer" containerID="672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.956052 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68"] Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.977096 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5cbcf7d67f-mmb68"] Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.977911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.978018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-config-data\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.989077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-scripts\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.989158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-httpd-run\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.989297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5smbx\" (UniqueName: \"kubernetes.io/projected/13c6fb58-b0b0-4980-bd79-a86a2375f047-kube-api-access-5smbx\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.989366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-public-tls-certs\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.989390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-logs\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.993012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.993547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-logs" (OuterVolumeSpecName: "logs") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.994272 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "glance") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.994378 4769 scope.go:117] "RemoveContainer" containerID="5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.994402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-combined-ca-bundle\") pod \"13c6fb58-b0b0-4980-bd79-a86a2375f047\" (UID: \"13c6fb58-b0b0-4980-bd79-a86a2375f047\") " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.995759 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.995794 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.995806 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13c6fb58-b0b0-4980-bd79-a86a2375f047-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:57 crc kubenswrapper[4769]: E1121 12:44:57.996402 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125\": container with ID starting with 5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125 not found: ID does not exist" containerID="5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.996493 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125"} err="failed to get container status \"5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125\": rpc error: code = NotFound desc = could not find container \"5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125\": container with ID starting with 5cbe4d5ce98e3e9aa5911463fbaca699e8c49ebdf7cc8da27dd7f93f608b5125 not found: ID does not exist" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.996531 4769 scope.go:117] "RemoveContainer" containerID="672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784" Nov 21 12:44:57 crc kubenswrapper[4769]: E1121 12:44:57.998318 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784\": container with ID starting with 672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784 not found: ID does not exist" containerID="672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784" Nov 21 12:44:57 crc kubenswrapper[4769]: I1121 12:44:57.998431 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784"} err="failed to get container status \"672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784\": rpc error: code = NotFound desc = could not find container \"672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784\": container with ID starting with 672945d1e9f4e6aa40897812c8e211421059154fd531d26f5c236906b74f3784 not found: ID does not exist" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.032804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-scripts" (OuterVolumeSpecName: "scripts") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.037336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.044591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c6fb58-b0b0-4980-bd79-a86a2375f047-kube-api-access-5smbx" (OuterVolumeSpecName: "kube-api-access-5smbx") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "kube-api-access-5smbx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.062122 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.085273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-config-data" (OuterVolumeSpecName: "config-data") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.097956 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.097998 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.098010 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5smbx\" (UniqueName: \"kubernetes.io/projected/13c6fb58-b0b0-4980-bd79-a86a2375f047-kube-api-access-5smbx\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.098024 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.098036 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.108293 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "13c6fb58-b0b0-4980-bd79-a86a2375f047" (UID: "13c6fb58-b0b0-4980-bd79-a86a2375f047"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.200887 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/13c6fb58-b0b0-4980-bd79-a86a2375f047-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.224774 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sfc7t"] Nov 21 12:44:58 crc kubenswrapper[4769]: E1121 12:44:58.225404 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-log" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.225472 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-log" Nov 21 12:44:58 crc kubenswrapper[4769]: E1121 12:44:58.225540 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-httpd" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.225590 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-httpd" Nov 21 12:44:58 crc kubenswrapper[4769]: E1121 12:44:58.225699 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-api" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.225756 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-api" Nov 21 12:44:58 crc kubenswrapper[4769]: E1121 12:44:58.225813 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-httpd" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.225873 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-httpd" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.226102 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-log" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.226173 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-api" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.226266 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" containerName="glance-httpd" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.226333 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6041691-cacc-46a8-8993-72770af7d96a" containerName="neutron-httpd" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.227007 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.236255 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sfc7t"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.315930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25tmf\" (UniqueName: \"kubernetes.io/projected/c113f75f-1306-4880-b153-4bf29356b2dc-kube-api-access-25tmf\") pod \"nova-api-db-create-sfc7t\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.316811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c113f75f-1306-4880-b153-4bf29356b2dc-operator-scripts\") pod \"nova-api-db-create-sfc7t\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.352963 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hlpf5"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.354829 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.376050 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-4224-account-create-vkrch"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.378155 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.386006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.411605 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-4224-account-create-vkrch"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.420592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c113f75f-1306-4880-b153-4bf29356b2dc-operator-scripts\") pod \"nova-api-db-create-sfc7t\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.420701 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2slv\" (UniqueName: \"kubernetes.io/projected/89845c89-7ba8-4fe7-bcc1-c44c10550252-kube-api-access-d2slv\") pod \"nova-api-4224-account-create-vkrch\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.420744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89845c89-7ba8-4fe7-bcc1-c44c10550252-operator-scripts\") pod \"nova-api-4224-account-create-vkrch\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.420776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw45h\" (UniqueName: \"kubernetes.io/projected/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-kube-api-access-cw45h\") pod \"nova-cell0-db-create-hlpf5\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.420844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-operator-scripts\") pod \"nova-cell0-db-create-hlpf5\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.420969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-25tmf\" (UniqueName: \"kubernetes.io/projected/c113f75f-1306-4880-b153-4bf29356b2dc-kube-api-access-25tmf\") pod \"nova-api-db-create-sfc7t\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.426007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c113f75f-1306-4880-b153-4bf29356b2dc-operator-scripts\") pod \"nova-api-db-create-sfc7t\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.453270 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hlpf5"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.485435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-25tmf\" (UniqueName: \"kubernetes.io/projected/c113f75f-1306-4880-b153-4bf29356b2dc-kube-api-access-25tmf\") pod \"nova-api-db-create-sfc7t\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.503131 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-kz486"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.504895 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.513687 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-kz486"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.524776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d2slv\" (UniqueName: \"kubernetes.io/projected/89845c89-7ba8-4fe7-bcc1-c44c10550252-kube-api-access-d2slv\") pod \"nova-api-4224-account-create-vkrch\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.524833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89845c89-7ba8-4fe7-bcc1-c44c10550252-operator-scripts\") pod \"nova-api-4224-account-create-vkrch\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.524869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cw45h\" (UniqueName: \"kubernetes.io/projected/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-kube-api-access-cw45h\") pod \"nova-cell0-db-create-hlpf5\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.524928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-operator-scripts\") pod \"nova-cell0-db-create-hlpf5\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.526626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89845c89-7ba8-4fe7-bcc1-c44c10550252-operator-scripts\") pod \"nova-api-4224-account-create-vkrch\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.537472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-operator-scripts\") pod \"nova-cell0-db-create-hlpf5\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.582248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2slv\" (UniqueName: \"kubernetes.io/projected/89845c89-7ba8-4fe7-bcc1-c44c10550252-kube-api-access-d2slv\") pod \"nova-api-4224-account-create-vkrch\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.584107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw45h\" (UniqueName: \"kubernetes.io/projected/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-kube-api-access-cw45h\") pod \"nova-cell0-db-create-hlpf5\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.603835 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.604312 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.605678 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.622555 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.626356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8nbt\" (UniqueName: \"kubernetes.io/projected/25ec7f1b-5b49-4021-9476-25004c7684be-kube-api-access-t8nbt\") pod \"nova-cell1-db-create-kz486\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.626471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25ec7f1b-5b49-4021-9476-25004c7684be-operator-scripts\") pod \"nova-cell1-db-create-kz486\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.684095 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.702000 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.765517 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.779269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25ec7f1b-5b49-4021-9476-25004c7684be-operator-scripts\") pod \"nova-cell1-db-create-kz486\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.779470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-operator-scripts\") pod \"nova-cell0-b8ba-account-create-hbdlf\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.779807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t8nbt\" (UniqueName: \"kubernetes.io/projected/25ec7f1b-5b49-4021-9476-25004c7684be-kube-api-access-t8nbt\") pod \"nova-cell1-db-create-kz486\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.780020 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42ff\" (UniqueName: \"kubernetes.io/projected/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-kube-api-access-r42ff\") pod \"nova-cell0-b8ba-account-create-hbdlf\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.780016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25ec7f1b-5b49-4021-9476-25004c7684be-operator-scripts\") pod \"nova-cell1-db-create-kz486\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.811526 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8nbt\" (UniqueName: \"kubernetes.io/projected/25ec7f1b-5b49-4021-9476-25004c7684be-kube-api-access-t8nbt\") pod \"nova-cell1-db-create-kz486\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.814139 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.817543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.820393 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.827625 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x"] Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.837929 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.249:9292/healthcheck\": read tcp 10.217.0.2:59422->10.217.0.249:9292: read: connection reset by peer" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.838639 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.249:9292/healthcheck\": read tcp 10.217.0.2:59430->10.217.0.249:9292: read: connection reset by peer" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.861675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.882421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r42ff\" (UniqueName: \"kubernetes.io/projected/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-kube-api-access-r42ff\") pod \"nova-cell0-b8ba-account-create-hbdlf\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.885823 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-operator-scripts\") pod \"nova-cell1-86a5-account-create-nr42x\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.885940 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-operator-scripts\") pod \"nova-cell0-b8ba-account-create-hbdlf\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.886168 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ck7\" (UniqueName: \"kubernetes.io/projected/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-kube-api-access-s4ck7\") pod \"nova-cell1-86a5-account-create-nr42x\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.887510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-operator-scripts\") pod \"nova-cell0-b8ba-account-create-hbdlf\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.900671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42ff\" (UniqueName: \"kubernetes.io/projected/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-kube-api-access-r42ff\") pod \"nova-cell0-b8ba-account-create-hbdlf\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.942030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"13c6fb58-b0b0-4980-bd79-a86a2375f047","Type":"ContainerDied","Data":"f0b1790df257f406860bd12abf5b4ec17d7afbb9299efa36dec933b203a3531b"} Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.942092 4769 scope.go:117] "RemoveContainer" containerID="0b2d1f7ec44ccc5764ca0531ac173f28dd9d74edab0dc9fdf0c2bafe48a6e7af" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.942283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.988628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-operator-scripts\") pod \"nova-cell1-86a5-account-create-nr42x\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.988781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ck7\" (UniqueName: \"kubernetes.io/projected/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-kube-api-access-s4ck7\") pod \"nova-cell1-86a5-account-create-nr42x\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:58 crc kubenswrapper[4769]: I1121 12:44:58.989454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-operator-scripts\") pod \"nova-cell1-86a5-account-create-nr42x\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.007885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.011824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ck7\" (UniqueName: \"kubernetes.io/projected/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-kube-api-access-s4ck7\") pod \"nova-cell1-86a5-account-create-nr42x\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.148318 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.311687 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6041691-cacc-46a8-8993-72770af7d96a" path="/var/lib/kubelet/pods/b6041691-cacc-46a8-8993-72770af7d96a/volumes" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.311742 4769 scope.go:117] "RemoveContainer" containerID="cdfbfbd6be4222375a45f2688bfaa47e2314b9852abf0063aecc75f65be3c1d4" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.343237 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.374823 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.392048 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.396774 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.400275 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.400499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.403930 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511174 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-config-data\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-logs\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7jk\" (UniqueName: \"kubernetes.io/projected/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-kube-api-access-zx7jk\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.511539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-scripts\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.559262 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.613461 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-httpd-run\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-logs\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zbf2\" (UniqueName: \"kubernetes.io/projected/5e0b8e2f-1237-41b9-a04b-787064d2047b-kube-api-access-7zbf2\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-config-data\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-scripts\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-internal-tls-certs\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-combined-ca-bundle\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.614806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"5e0b8e2f-1237-41b9-a04b-787064d2047b\" (UID: \"5e0b8e2f-1237-41b9-a04b-787064d2047b\") " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.615989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-scripts\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-config-data\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-logs\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616334 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.616491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7jk\" (UniqueName: \"kubernetes.io/projected/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-kube-api-access-zx7jk\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.621531 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-logs\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.624706 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.624753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-scripts\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.627506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.627810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.630567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-logs" (OuterVolumeSpecName: "logs") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.631218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.631240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.634245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-scripts" (OuterVolumeSpecName: "scripts") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.634365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.637120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-config-data\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.652990 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sfc7t"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.666409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7jk\" (UniqueName: \"kubernetes.io/projected/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-kube-api-access-zx7jk\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.667174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e0b8e2f-1237-41b9-a04b-787064d2047b-kube-api-access-7zbf2" (OuterVolumeSpecName: "kube-api-access-7zbf2") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "kube-api-access-7zbf2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.681048 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hlpf5"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.689858 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-kz486"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.699906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"glance-default-external-api-0\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.703533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.718397 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.718425 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.718459 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.718469 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.718479 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e0b8e2f-1237-41b9-a04b-787064d2047b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.718489 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7zbf2\" (UniqueName: \"kubernetes.io/projected/5e0b8e2f-1237-41b9-a04b-787064d2047b-kube-api-access-7zbf2\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.728820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.739921 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.748331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-config-data" (OuterVolumeSpecName: "config-data") pod "5e0b8e2f-1237-41b9-a04b-787064d2047b" (UID: "5e0b8e2f-1237-41b9-a04b-787064d2047b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.752242 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.821017 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.821068 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e0b8e2f-1237-41b9-a04b-787064d2047b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.821083 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.838424 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-4224-account-create-vkrch"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.943751 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.970402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" event={"ID":"89845c89-7ba8-4fe7-bcc1-c44c10550252","Type":"ContainerStarted","Data":"55df338f647e748ab2b80bef51b4f33d674fe4a4cfad609323a3f92db243921f"} Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.972074 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf"] Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.996402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" event={"ID":"c113f75f-1306-4880-b153-4bf29356b2dc","Type":"ContainerStarted","Data":"b1fda8208f729ca984f00f82d7ce234d4d3241e7f7ea100f7e732d4e58481d2d"} Nov 21 12:44:59 crc kubenswrapper[4769]: I1121 12:44:59.996471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" event={"ID":"c113f75f-1306-4880-b153-4bf29356b2dc","Type":"ContainerStarted","Data":"e9ef1793ffcb92713a350443c0800230eefd945fd1e3281e6b76beef2bd1327f"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.010667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" event={"ID":"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7","Type":"ContainerStarted","Data":"8ddb655d6fe8a329261b4a78e3030b8b3c518115d98ca16fb73b0978963b8c68"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.010721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" event={"ID":"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7","Type":"ContainerStarted","Data":"3eaf177854453bdb6a816c144250cd126bf946d54f17a2017bcf931ea791102c"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.022967 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" podStartSLOduration=2.022942098 podStartE2EDuration="2.022942098s" podCreationTimestamp="2025-11-21 12:44:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:00.015776645 +0000 UTC m=+3258.716438463" watchObservedRunningTime="2025-11-21 12:45:00.022942098 +0000 UTC m=+3258.723603916" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.025615 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerID="76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c" exitCode=0 Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.025700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5e0b8e2f-1237-41b9-a04b-787064d2047b","Type":"ContainerDied","Data":"76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.025725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5e0b8e2f-1237-41b9-a04b-787064d2047b","Type":"ContainerDied","Data":"f7f0902e1f7aadaa68c9eee87030fc729ee202beecb74b96cbdae441379f1b94"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.025745 4769 scope.go:117] "RemoveContainer" containerID="76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.025876 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.041291 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" podStartSLOduration=2.041261142 podStartE2EDuration="2.041261142s" podCreationTimestamp="2025-11-21 12:44:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:00.034443568 +0000 UTC m=+3258.735105386" watchObservedRunningTime="2025-11-21 12:45:00.041261142 +0000 UTC m=+3258.741922960" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.053233 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" event={"ID":"25ec7f1b-5b49-4021-9476-25004c7684be","Type":"ContainerStarted","Data":"d4ea3af4842648fb4ad7104c028c874cf1ffc79a30e861a191287a78d18c64ba"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.053302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" event={"ID":"25ec7f1b-5b49-4021-9476-25004c7684be","Type":"ContainerStarted","Data":"b2774900bc5522b6f2c9eab9a6cc82bf012cb4ed90b0e962192ebd243e2bf7c1"} Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.155924 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" podStartSLOduration=2.155899445 podStartE2EDuration="2.155899445s" podCreationTimestamp="2025-11-21 12:44:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:00.07418094 +0000 UTC m=+3258.774842758" watchObservedRunningTime="2025-11-21 12:45:00.155899445 +0000 UTC m=+3258.856561263" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.157405 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm"] Nov 21 12:45:00 crc kubenswrapper[4769]: E1121 12:45:00.159576 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-httpd" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.159621 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-httpd" Nov 21 12:45:00 crc kubenswrapper[4769]: E1121 12:45:00.159695 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-log" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.159702 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-log" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.160233 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-log" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.160252 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" containerName="glance-httpd" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.161201 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.163664 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.164588 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.168442 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm"] Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.224505 4769 scope.go:117] "RemoveContainer" containerID="bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.332630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4474e22a-06ba-4064-beae-c2a9748add3d-secret-volume\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.332723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgr8v\" (UniqueName: \"kubernetes.io/projected/4474e22a-06ba-4064-beae-c2a9748add3d-kube-api-access-sgr8v\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.335047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4474e22a-06ba-4064-beae-c2a9748add3d-config-volume\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.365753 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.437001 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4474e22a-06ba-4064-beae-c2a9748add3d-config-volume\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.437062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4474e22a-06ba-4064-beae-c2a9748add3d-secret-volume\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.437105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sgr8v\" (UniqueName: \"kubernetes.io/projected/4474e22a-06ba-4064-beae-c2a9748add3d-kube-api-access-sgr8v\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.438217 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4474e22a-06ba-4064-beae-c2a9748add3d-config-volume\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.445952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4474e22a-06ba-4064-beae-c2a9748add3d-secret-volume\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.453510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgr8v\" (UniqueName: \"kubernetes.io/projected/4474e22a-06ba-4064-beae-c2a9748add3d-kube-api-access-sgr8v\") pod \"collect-profiles-29395485-vf4pm\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.630263 4769 scope.go:117] "RemoveContainer" containerID="76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c" Nov 21 12:45:00 crc kubenswrapper[4769]: E1121 12:45:00.631557 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c\": container with ID starting with 76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c not found: ID does not exist" containerID="76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.631622 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c"} err="failed to get container status \"76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c\": rpc error: code = NotFound desc = could not find container \"76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c\": container with ID starting with 76f28daa476edf3af83d8ddb8041cdaded0e56a7e9ffb58254de66d328b1805c not found: ID does not exist" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.631662 4769 scope.go:117] "RemoveContainer" containerID="bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.635832 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:00 crc kubenswrapper[4769]: E1121 12:45:00.639378 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e\": container with ID starting with bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e not found: ID does not exist" containerID="bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.639424 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e"} err="failed to get container status \"bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e\": rpc error: code = NotFound desc = could not find container \"bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e\": container with ID starting with bef1c3d2fb80ac4b7bc5b2385596ca2ceb0a35fa57dda39e41337a7ca174a80e not found: ID does not exist" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.649351 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.656982 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.710353 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.713631 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.719924 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.721737 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.729260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.830997 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.848313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.849866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-logs\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.849928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.851765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szltf\" (UniqueName: \"kubernetes.io/projected/d2849a02-b828-4f2a-8d0a-bc4b36da1357-kube-api-access-szltf\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.851850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.852054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.852449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.852502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.958414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wz5j\" (UniqueName: \"kubernetes.io/projected/97b8440d-f7c8-4e4e-8369-65b02b8aa684-kube-api-access-9wz5j\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.958604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-combined-ca-bundle\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.958874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-scripts\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-config-data\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-sg-core-conf-yaml\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-run-httpd\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959206 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-log-httpd\") pod \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\" (UID: \"97b8440d-f7c8-4e4e-8369-65b02b8aa684\") " Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-logs\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-szltf\" (UniqueName: \"kubernetes.io/projected/d2849a02-b828-4f2a-8d0a-bc4b36da1357-kube-api-access-szltf\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.959855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.960002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.960041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.960086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.961352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.961657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.962319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-logs\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.965712 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.965726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.967298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-scripts" (OuterVolumeSpecName: "scripts") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.976121 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-config-data\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.984938 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b8440d-f7c8-4e4e-8369-65b02b8aa684-kube-api-access-9wz5j" (OuterVolumeSpecName: "kube-api-access-9wz5j") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "kube-api-access-9wz5j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.993042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.995047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-scripts\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.995834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:00 crc kubenswrapper[4769]: I1121 12:45:00.999417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-szltf\" (UniqueName: \"kubernetes.io/projected/d2849a02-b828-4f2a-8d0a-bc4b36da1357-kube-api-access-szltf\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.029814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.035018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"glance-default-internal-api-0\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.043697 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.067914 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.067959 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.067969 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.067983 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/97b8440d-f7c8-4e4e-8369-65b02b8aa684-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.067993 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9wz5j\" (UniqueName: \"kubernetes.io/projected/97b8440d-f7c8-4e4e-8369-65b02b8aa684-kube-api-access-9wz5j\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.071977 4769 generic.go:334] "Generic (PLEG): container finished" podID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerID="a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.072051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerDied","Data":"a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.072089 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"97b8440d-f7c8-4e4e-8369-65b02b8aa684","Type":"ContainerDied","Data":"26ce3ce92aee6bed4a263772acb13940f30e331535a67c6ec0e893e69288e089"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.072133 4769 scope.go:117] "RemoveContainer" containerID="00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.072299 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.075122 4769 generic.go:334] "Generic (PLEG): container finished" podID="25ec7f1b-5b49-4021-9476-25004c7684be" containerID="d4ea3af4842648fb4ad7104c028c874cf1ffc79a30e861a191287a78d18c64ba" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.075236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" event={"ID":"25ec7f1b-5b49-4021-9476-25004c7684be","Type":"ContainerDied","Data":"d4ea3af4842648fb4ad7104c028c874cf1ffc79a30e861a191287a78d18c64ba"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.087795 4769 generic.go:334] "Generic (PLEG): container finished" podID="e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" containerID="61a3120144d8bfd40133bf667a68c3d2d5b7ef4d7a2e545a3a3733f8d504c34c" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.087913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" event={"ID":"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06","Type":"ContainerDied","Data":"61a3120144d8bfd40133bf667a68c3d2d5b7ef4d7a2e545a3a3733f8d504c34c"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.087951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" event={"ID":"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06","Type":"ContainerStarted","Data":"4d7120d346fbf6be32441a3754794242bb973e81f459dce25180da95aef574cc"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.097860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad3fd932-0bbe-42b5-82d0-a7c427395cf6","Type":"ContainerStarted","Data":"a90d4f5ce26db644b27bcb0e348c446205a32776334af07f43fe8edcb786e6d3"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.111396 4769 generic.go:334] "Generic (PLEG): container finished" podID="c113f75f-1306-4880-b153-4bf29356b2dc" containerID="b1fda8208f729ca984f00f82d7ce234d4d3241e7f7ea100f7e732d4e58481d2d" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.111490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" event={"ID":"c113f75f-1306-4880-b153-4bf29356b2dc","Type":"ContainerDied","Data":"b1fda8208f729ca984f00f82d7ce234d4d3241e7f7ea100f7e732d4e58481d2d"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.123339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.129608 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" containerID="8ddb655d6fe8a329261b4a78e3030b8b3c518115d98ca16fb73b0978963b8c68" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.129738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" event={"ID":"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7","Type":"ContainerDied","Data":"8ddb655d6fe8a329261b4a78e3030b8b3c518115d98ca16fb73b0978963b8c68"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.138709 4769 generic.go:334] "Generic (PLEG): container finished" podID="9ef93c1d-8128-42c4-9634-e4c4d7c855e4" containerID="eb08559c754c092bc1c0d20287519cca4297fe379ae89270ff8f1adc6cf498ab" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.138985 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" event={"ID":"9ef93c1d-8128-42c4-9634-e4c4d7c855e4","Type":"ContainerDied","Data":"eb08559c754c092bc1c0d20287519cca4297fe379ae89270ff8f1adc6cf498ab"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.139027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" event={"ID":"9ef93c1d-8128-42c4-9634-e4c4d7c855e4","Type":"ContainerStarted","Data":"77daa554d84b70b0c16b1b6c5162f2df098b7848e38ea8b052acb9ce15fb66e8"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.144935 4769 generic.go:334] "Generic (PLEG): container finished" podID="89845c89-7ba8-4fe7-bcc1-c44c10550252" containerID="c78c90ba9fd8184a542aba3937ae75f62712bcd2eea3b2202ea3d8d4bb615c62" exitCode=0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.145082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" event={"ID":"89845c89-7ba8-4fe7-bcc1-c44c10550252","Type":"ContainerDied","Data":"c78c90ba9fd8184a542aba3937ae75f62712bcd2eea3b2202ea3d8d4bb615c62"} Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.152847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-config-data" (OuterVolumeSpecName: "config-data") pod "97b8440d-f7c8-4e4e-8369-65b02b8aa684" (UID: "97b8440d-f7c8-4e4e-8369-65b02b8aa684"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.170381 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.170413 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97b8440d-f7c8-4e4e-8369-65b02b8aa684-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.294969 4769 scope.go:117] "RemoveContainer" containerID="58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.296569 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c6fb58-b0b0-4980-bd79-a86a2375f047" path="/var/lib/kubelet/pods/13c6fb58-b0b0-4980-bd79-a86a2375f047/volumes" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.300381 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e0b8e2f-1237-41b9-a04b-787064d2047b" path="/var/lib/kubelet/pods/5e0b8e2f-1237-41b9-a04b-787064d2047b/volumes" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.301913 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm"] Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.368061 4769 scope.go:117] "RemoveContainer" containerID="0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.446565 4769 scope.go:117] "RemoveContainer" containerID="a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.479229 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.505335 4769 scope.go:117] "RemoveContainer" containerID="00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.505152 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512122 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.512512 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-notification-agent" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512530 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-notification-agent" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.512548 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="proxy-httpd" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="proxy-httpd" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.512569 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-central-agent" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512579 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-central-agent" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.512596 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="sg-core" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512602 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="sg-core" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-notification-agent" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512812 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="ceilometer-central-agent" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512825 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="sg-core" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.512840 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" containerName="proxy-httpd" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.514931 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.519098 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.519390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.521563 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.547993 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0\": container with ID starting with 00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0 not found: ID does not exist" containerID="00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.548047 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0"} err="failed to get container status \"00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0\": rpc error: code = NotFound desc = could not find container \"00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0\": container with ID starting with 00904ecfb72e9d38599114116e4508bd1d6e80fa7b084c2c8f7c76b2005adaf0 not found: ID does not exist" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.548080 4769 scope.go:117] "RemoveContainer" containerID="58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.549091 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376\": container with ID starting with 58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376 not found: ID does not exist" containerID="58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.549116 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376"} err="failed to get container status \"58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376\": rpc error: code = NotFound desc = could not find container \"58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376\": container with ID starting with 58142b0267fc14c55a17c8a4302249ed84dccd296542242d8081babc1c674376 not found: ID does not exist" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.549138 4769 scope.go:117] "RemoveContainer" containerID="0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.550154 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228\": container with ID starting with 0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228 not found: ID does not exist" containerID="0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.550177 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228"} err="failed to get container status \"0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228\": rpc error: code = NotFound desc = could not find container \"0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228\": container with ID starting with 0f1e39e745dc94c29867b1247ba7998470ca6db4c9a0537cf66bce68636d2228 not found: ID does not exist" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.550202 4769 scope.go:117] "RemoveContainer" containerID="a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68" Nov 21 12:45:01 crc kubenswrapper[4769]: E1121 12:45:01.552934 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68\": container with ID starting with a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68 not found: ID does not exist" containerID="a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.552957 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68"} err="failed to get container status \"a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68\": rpc error: code = NotFound desc = could not find container \"a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68\": container with ID starting with a1c72e68adcadc0ae4812e786df50c2661dcfe3d0f7458e6289279e1378aae68 not found: ID does not exist" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.558973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-scripts\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578236 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-config-data\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-log-httpd\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlkp\" (UniqueName: \"kubernetes.io/projected/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-kube-api-access-lqlkp\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.578488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-run-httpd\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.600555 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:45:01 crc kubenswrapper[4769]: W1121 12:45:01.607508 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2849a02_b828_4f2a_8d0a_bc4b36da1357.slice/crio-efa0a17f1200dcf71c153996796d71e110ccedbfecafff1d7a9529a1973097c0 WatchSource:0}: Error finding container efa0a17f1200dcf71c153996796d71e110ccedbfecafff1d7a9529a1973097c0: Status 404 returned error can't find the container with id efa0a17f1200dcf71c153996796d71e110ccedbfecafff1d7a9529a1973097c0 Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.695435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-run-httpd\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.696032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-scripts\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.696143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-config-data\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.696263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-log-httpd\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.696750 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.696897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.697597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlkp\" (UniqueName: \"kubernetes.io/projected/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-kube-api-access-lqlkp\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.697754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.700885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-log-httpd\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.702569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-run-httpd\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.704351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.705563 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.705583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-config-data\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.709080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-scripts\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.716326 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.734093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlkp\" (UniqueName: \"kubernetes.io/projected/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-kube-api-access-lqlkp\") pod \"ceilometer-0\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:01 crc kubenswrapper[4769]: I1121 12:45:01.866304 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.167600 4769 generic.go:334] "Generic (PLEG): container finished" podID="4474e22a-06ba-4064-beae-c2a9748add3d" containerID="8ae65709e63cf2452b103949a5ba8f2dfa3cfcb98302deb471cb811cb6985a5d" exitCode=0 Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.167847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" event={"ID":"4474e22a-06ba-4064-beae-c2a9748add3d","Type":"ContainerDied","Data":"8ae65709e63cf2452b103949a5ba8f2dfa3cfcb98302deb471cb811cb6985a5d"} Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.168518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" event={"ID":"4474e22a-06ba-4064-beae-c2a9748add3d","Type":"ContainerStarted","Data":"5b6778b00555a1b167056a174df38dcd0cb6fb511776f8d88cd4fb6926a7a8c7"} Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.172787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad3fd932-0bbe-42b5-82d0-a7c427395cf6","Type":"ContainerStarted","Data":"4c28531219c8efbaa37de55e1d8eed2042fb62ab2c238f6bf4c4988a3a8f43d7"} Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.172849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad3fd932-0bbe-42b5-82d0-a7c427395cf6","Type":"ContainerStarted","Data":"30ff22077c52b23945531587c6ab17c12f5dace9b120813b6ae1b86f680ee1cc"} Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.175891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d2849a02-b828-4f2a-8d0a-bc4b36da1357","Type":"ContainerStarted","Data":"efa0a17f1200dcf71c153996796d71e110ccedbfecafff1d7a9529a1973097c0"} Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.207708 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.239227 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.2391740159999998 podStartE2EDuration="3.239174016s" podCreationTimestamp="2025-11-21 12:44:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:02.226885154 +0000 UTC m=+3260.927546972" watchObservedRunningTime="2025-11-21 12:45:02.239174016 +0000 UTC m=+3260.939835834" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.457756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:02 crc kubenswrapper[4769]: W1121 12:45:02.469719 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53c3a22e_dcdf_43ba_b2f8_38dfd0a61016.slice/crio-751e4a99c08e106cc4513a09d265dcaf406df8d95dce2f522a80aa41d740bad4 WatchSource:0}: Error finding container 751e4a99c08e106cc4513a09d265dcaf406df8d95dce2f522a80aa41d740bad4: Status 404 returned error can't find the container with id 751e4a99c08e106cc4513a09d265dcaf406df8d95dce2f522a80aa41d740bad4 Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.674416 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.857309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25tmf\" (UniqueName: \"kubernetes.io/projected/c113f75f-1306-4880-b153-4bf29356b2dc-kube-api-access-25tmf\") pod \"c113f75f-1306-4880-b153-4bf29356b2dc\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.857428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c113f75f-1306-4880-b153-4bf29356b2dc-operator-scripts\") pod \"c113f75f-1306-4880-b153-4bf29356b2dc\" (UID: \"c113f75f-1306-4880-b153-4bf29356b2dc\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.858442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c113f75f-1306-4880-b153-4bf29356b2dc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c113f75f-1306-4880-b153-4bf29356b2dc" (UID: "c113f75f-1306-4880-b153-4bf29356b2dc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.870474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c113f75f-1306-4880-b153-4bf29356b2dc-kube-api-access-25tmf" (OuterVolumeSpecName: "kube-api-access-25tmf") pod "c113f75f-1306-4880-b153-4bf29356b2dc" (UID: "c113f75f-1306-4880-b153-4bf29356b2dc"). InnerVolumeSpecName "kube-api-access-25tmf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.891800 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.917155 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.945605 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.960032 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89845c89-7ba8-4fe7-bcc1-c44c10550252-operator-scripts\") pod \"89845c89-7ba8-4fe7-bcc1-c44c10550252\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2slv\" (UniqueName: \"kubernetes.io/projected/89845c89-7ba8-4fe7-bcc1-c44c10550252-kube-api-access-d2slv\") pod \"89845c89-7ba8-4fe7-bcc1-c44c10550252\" (UID: \"89845c89-7ba8-4fe7-bcc1-c44c10550252\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw45h\" (UniqueName: \"kubernetes.io/projected/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-kube-api-access-cw45h\") pod \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969216 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-operator-scripts\") pod \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969241 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4ck7\" (UniqueName: \"kubernetes.io/projected/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-kube-api-access-s4ck7\") pod \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r42ff\" (UniqueName: \"kubernetes.io/projected/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-kube-api-access-r42ff\") pod \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\" (UID: \"9ef93c1d-8128-42c4-9634-e4c4d7c855e4\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969308 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-operator-scripts\") pod \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\" (UID: \"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-operator-scripts\") pod \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\" (UID: \"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06\") " Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.969756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89845c89-7ba8-4fe7-bcc1-c44c10550252-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "89845c89-7ba8-4fe7-bcc1-c44c10550252" (UID: "89845c89-7ba8-4fe7-bcc1-c44c10550252"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.970044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9ef93c1d-8128-42c4-9634-e4c4d7c855e4" (UID: "9ef93c1d-8128-42c4-9634-e4c4d7c855e4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.970522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" (UID: "3b5387a5-ef3b-491d-8870-c6d0d3bd59a7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.970695 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.972057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" (UID: "e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.972097 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-25tmf\" (UniqueName: \"kubernetes.io/projected/c113f75f-1306-4880-b153-4bf29356b2dc-kube-api-access-25tmf\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.972113 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c113f75f-1306-4880-b153-4bf29356b2dc-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.977518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89845c89-7ba8-4fe7-bcc1-c44c10550252-kube-api-access-d2slv" (OuterVolumeSpecName: "kube-api-access-d2slv") pod "89845c89-7ba8-4fe7-bcc1-c44c10550252" (UID: "89845c89-7ba8-4fe7-bcc1-c44c10550252"). InnerVolumeSpecName "kube-api-access-d2slv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.983169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-kube-api-access-cw45h" (OuterVolumeSpecName: "kube-api-access-cw45h") pod "3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" (UID: "3b5387a5-ef3b-491d-8870-c6d0d3bd59a7"). InnerVolumeSpecName "kube-api-access-cw45h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.983252 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-kube-api-access-s4ck7" (OuterVolumeSpecName: "kube-api-access-s4ck7") pod "e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" (UID: "e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06"). InnerVolumeSpecName "kube-api-access-s4ck7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:02 crc kubenswrapper[4769]: I1121 12:45:02.985169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-kube-api-access-r42ff" (OuterVolumeSpecName: "kube-api-access-r42ff") pod "9ef93c1d-8128-42c4-9634-e4c4d7c855e4" (UID: "9ef93c1d-8128-42c4-9634-e4c4d7c855e4"). InnerVolumeSpecName "kube-api-access-r42ff". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.072494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8nbt\" (UniqueName: \"kubernetes.io/projected/25ec7f1b-5b49-4021-9476-25004c7684be-kube-api-access-t8nbt\") pod \"25ec7f1b-5b49-4021-9476-25004c7684be\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25ec7f1b-5b49-4021-9476-25004c7684be-operator-scripts\") pod \"25ec7f1b-5b49-4021-9476-25004c7684be\" (UID: \"25ec7f1b-5b49-4021-9476-25004c7684be\") " Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073334 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89845c89-7ba8-4fe7-bcc1-c44c10550252-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073354 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cw45h\" (UniqueName: \"kubernetes.io/projected/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-kube-api-access-cw45h\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073367 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d2slv\" (UniqueName: \"kubernetes.io/projected/89845c89-7ba8-4fe7-bcc1-c44c10550252-kube-api-access-d2slv\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073381 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073393 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s4ck7\" (UniqueName: \"kubernetes.io/projected/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-kube-api-access-s4ck7\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073401 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r42ff\" (UniqueName: \"kubernetes.io/projected/9ef93c1d-8128-42c4-9634-e4c4d7c855e4-kube-api-access-r42ff\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073410 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073419 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.073829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ec7f1b-5b49-4021-9476-25004c7684be-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "25ec7f1b-5b49-4021-9476-25004c7684be" (UID: "25ec7f1b-5b49-4021-9476-25004c7684be"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.079533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ec7f1b-5b49-4021-9476-25004c7684be-kube-api-access-t8nbt" (OuterVolumeSpecName: "kube-api-access-t8nbt") pod "25ec7f1b-5b49-4021-9476-25004c7684be" (UID: "25ec7f1b-5b49-4021-9476-25004c7684be"). InnerVolumeSpecName "kube-api-access-t8nbt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.175516 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25ec7f1b-5b49-4021-9476-25004c7684be-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.175545 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t8nbt\" (UniqueName: \"kubernetes.io/projected/25ec7f1b-5b49-4021-9476-25004c7684be-kube-api-access-t8nbt\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.190840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerStarted","Data":"751e4a99c08e106cc4513a09d265dcaf406df8d95dce2f522a80aa41d740bad4"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.195524 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.195768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf" event={"ID":"9ef93c1d-8128-42c4-9634-e4c4d7c855e4","Type":"ContainerDied","Data":"77daa554d84b70b0c16b1b6c5162f2df098b7848e38ea8b052acb9ce15fb66e8"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.195830 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77daa554d84b70b0c16b1b6c5162f2df098b7848e38ea8b052acb9ce15fb66e8" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.197724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" event={"ID":"e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06","Type":"ContainerDied","Data":"4d7120d346fbf6be32441a3754794242bb973e81f459dce25180da95aef574cc"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.197755 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d7120d346fbf6be32441a3754794242bb973e81f459dce25180da95aef574cc" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.197827 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.202533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d2849a02-b828-4f2a-8d0a-bc4b36da1357","Type":"ContainerStarted","Data":"2f7f7f98a870dbf12ccacfebdd086b9adde83dc9bb77deff51dfff3258774418"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.202577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d2849a02-b828-4f2a-8d0a-bc4b36da1357","Type":"ContainerStarted","Data":"97a9e19b11e737a04c0983227e24c3355c7fc97cbc953b01c547aa972f3b1445"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.207548 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.207739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-sfc7t" event={"ID":"c113f75f-1306-4880-b153-4bf29356b2dc","Type":"ContainerDied","Data":"e9ef1793ffcb92713a350443c0800230eefd945fd1e3281e6b76beef2bd1327f"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.207784 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9ef1793ffcb92713a350443c0800230eefd945fd1e3281e6b76beef2bd1327f" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.211370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" event={"ID":"3b5387a5-ef3b-491d-8870-c6d0d3bd59a7","Type":"ContainerDied","Data":"3eaf177854453bdb6a816c144250cd126bf946d54f17a2017bcf931ea791102c"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.211415 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3eaf177854453bdb6a816c144250cd126bf946d54f17a2017bcf931ea791102c" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.211492 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hlpf5" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.214930 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" event={"ID":"25ec7f1b-5b49-4021-9476-25004c7684be","Type":"ContainerDied","Data":"b2774900bc5522b6f2c9eab9a6cc82bf012cb4ed90b0e962192ebd243e2bf7c1"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.214986 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2774900bc5522b6f2c9eab9a6cc82bf012cb4ed90b0e962192ebd243e2bf7c1" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.215066 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-kz486" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.227343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" event={"ID":"89845c89-7ba8-4fe7-bcc1-c44c10550252","Type":"ContainerDied","Data":"55df338f647e748ab2b80bef51b4f33d674fe4a4cfad609323a3f92db243921f"} Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.227384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-4224-account-create-vkrch" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.227410 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55df338f647e748ab2b80bef51b4f33d674fe4a4cfad609323a3f92db243921f" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.240151 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.240123893 podStartE2EDuration="3.240123893s" podCreationTimestamp="2025-11-21 12:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:03.227706428 +0000 UTC m=+3261.928368246" watchObservedRunningTime="2025-11-21 12:45:03.240123893 +0000 UTC m=+3261.940785711" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.297314 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b8440d-f7c8-4e4e-8369-65b02b8aa684" path="/var/lib/kubelet/pods/97b8440d-f7c8-4e4e-8369-65b02b8aa684/volumes" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.595896 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.686698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4474e22a-06ba-4064-beae-c2a9748add3d-config-volume\") pod \"4474e22a-06ba-4064-beae-c2a9748add3d\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.686815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgr8v\" (UniqueName: \"kubernetes.io/projected/4474e22a-06ba-4064-beae-c2a9748add3d-kube-api-access-sgr8v\") pod \"4474e22a-06ba-4064-beae-c2a9748add3d\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.686939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4474e22a-06ba-4064-beae-c2a9748add3d-secret-volume\") pod \"4474e22a-06ba-4064-beae-c2a9748add3d\" (UID: \"4474e22a-06ba-4064-beae-c2a9748add3d\") " Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.688180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4474e22a-06ba-4064-beae-c2a9748add3d-config-volume" (OuterVolumeSpecName: "config-volume") pod "4474e22a-06ba-4064-beae-c2a9748add3d" (UID: "4474e22a-06ba-4064-beae-c2a9748add3d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.693042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4474e22a-06ba-4064-beae-c2a9748add3d-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "4474e22a-06ba-4064-beae-c2a9748add3d" (UID: "4474e22a-06ba-4064-beae-c2a9748add3d"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.693219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4474e22a-06ba-4064-beae-c2a9748add3d-kube-api-access-sgr8v" (OuterVolumeSpecName: "kube-api-access-sgr8v") pod "4474e22a-06ba-4064-beae-c2a9748add3d" (UID: "4474e22a-06ba-4064-beae-c2a9748add3d"). InnerVolumeSpecName "kube-api-access-sgr8v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.799861 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4474e22a-06ba-4064-beae-c2a9748add3d-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.800309 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sgr8v\" (UniqueName: \"kubernetes.io/projected/4474e22a-06ba-4064-beae-c2a9748add3d-kube-api-access-sgr8v\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:03 crc kubenswrapper[4769]: I1121 12:45:03.800433 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/4474e22a-06ba-4064-beae-c2a9748add3d-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.250025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" event={"ID":"4474e22a-06ba-4064-beae-c2a9748add3d","Type":"ContainerDied","Data":"5b6778b00555a1b167056a174df38dcd0cb6fb511776f8d88cd4fb6926a7a8c7"} Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.250115 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b6778b00555a1b167056a174df38dcd0cb6fb511776f8d88cd4fb6926a7a8c7" Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.250595 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm" Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.261448 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerStarted","Data":"7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47"} Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.261532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerStarted","Data":"90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a"} Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.687123 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5"] Nov 21 12:45:04 crc kubenswrapper[4769]: I1121 12:45:04.698098 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395440-dgkf5"] Nov 21 12:45:05 crc kubenswrapper[4769]: I1121 12:45:05.299013 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7507241b-946d-4fce-8c24-7088de77f34f" path="/var/lib/kubelet/pods/7507241b-946d-4fce-8c24-7088de77f34f/volumes" Nov 21 12:45:05 crc kubenswrapper[4769]: I1121 12:45:05.303459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerStarted","Data":"cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a"} Nov 21 12:45:05 crc kubenswrapper[4769]: I1121 12:45:05.516992 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:06 crc kubenswrapper[4769]: I1121 12:45:06.274682 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:45:06 crc kubenswrapper[4769]: E1121 12:45:06.275335 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.326597 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerStarted","Data":"05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0"} Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.326928 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-central-agent" containerID="cri-o://90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a" gracePeriod=30 Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.327103 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.327167 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="proxy-httpd" containerID="cri-o://05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0" gracePeriod=30 Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.327252 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="sg-core" containerID="cri-o://cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a" gracePeriod=30 Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.327288 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-notification-agent" containerID="cri-o://7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47" gracePeriod=30 Nov 21 12:45:07 crc kubenswrapper[4769]: I1121 12:45:07.360044 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.546987723 podStartE2EDuration="6.360017464s" podCreationTimestamp="2025-11-21 12:45:01 +0000 UTC" firstStartedPulling="2025-11-21 12:45:02.488700789 +0000 UTC m=+3261.189362607" lastFinishedPulling="2025-11-21 12:45:06.30173054 +0000 UTC m=+3265.002392348" observedRunningTime="2025-11-21 12:45:07.352066919 +0000 UTC m=+3266.052728747" watchObservedRunningTime="2025-11-21 12:45:07.360017464 +0000 UTC m=+3266.060679272" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.340822 4769 generic.go:334] "Generic (PLEG): container finished" podID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerID="05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0" exitCode=0 Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.340877 4769 generic.go:334] "Generic (PLEG): container finished" podID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerID="cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a" exitCode=2 Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.340891 4769 generic.go:334] "Generic (PLEG): container finished" podID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerID="7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47" exitCode=0 Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.340920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerDied","Data":"05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0"} Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.340960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerDied","Data":"cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a"} Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.340976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerDied","Data":"7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47"} Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.903478 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz"] Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904285 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ef93c1d-8128-42c4-9634-e4c4d7c855e4" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904314 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef93c1d-8128-42c4-9634-e4c4d7c855e4" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904336 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="89845c89-7ba8-4fe7-bcc1-c44c10550252" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904346 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="89845c89-7ba8-4fe7-bcc1-c44c10550252" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904367 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25ec7f1b-5b49-4021-9476-25004c7684be" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ec7f1b-5b49-4021-9476-25004c7684be" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904398 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904419 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4474e22a-06ba-4064-beae-c2a9748add3d" containerName="collect-profiles" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4474e22a-06ba-4064-beae-c2a9748add3d" containerName="collect-profiles" Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904459 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c113f75f-1306-4880-b153-4bf29356b2dc" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904469 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c113f75f-1306-4880-b153-4bf29356b2dc" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: E1121 12:45:08.904484 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904494 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904729 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904752 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c113f75f-1306-4880-b153-4bf29356b2dc" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904778 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4474e22a-06ba-4064-beae-c2a9748add3d" containerName="collect-profiles" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904809 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ef93c1d-8128-42c4-9634-e4c4d7c855e4" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904819 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25ec7f1b-5b49-4021-9476-25004c7684be" containerName="mariadb-database-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.904835 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="89845c89-7ba8-4fe7-bcc1-c44c10550252" containerName="mariadb-account-create" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.906023 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.919646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-stsbq" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.919786 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.919836 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:45:08 crc kubenswrapper[4769]: I1121 12:45:08.921298 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz"] Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.021558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b5pd\" (UniqueName: \"kubernetes.io/projected/b23a8bb4-7473-461c-bdee-d0d7de0acb24-kube-api-access-8b5pd\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.021635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-scripts\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.021804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-config-data\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.021846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.124227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-config-data\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.124291 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.124369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8b5pd\" (UniqueName: \"kubernetes.io/projected/b23a8bb4-7473-461c-bdee-d0d7de0acb24-kube-api-access-8b5pd\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.124409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-scripts\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.137182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.137737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-config-data\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.138355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-scripts\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.149268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b5pd\" (UniqueName: \"kubernetes.io/projected/b23a8bb4-7473-461c-bdee-d0d7de0acb24-kube-api-access-8b5pd\") pod \"nova-cell0-conductor-db-sync-72dgz\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.241088 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.740978 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.741487 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.747750 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz"] Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.789598 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:09 crc kubenswrapper[4769]: I1121 12:45:09.805951 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:10 crc kubenswrapper[4769]: I1121 12:45:10.402615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" event={"ID":"b23a8bb4-7473-461c-bdee-d0d7de0acb24","Type":"ContainerStarted","Data":"619ccfe65b0cee9b2672cb225974f9f89105e1de9a911b41e5ef3c62af66fc65"} Nov 21 12:45:10 crc kubenswrapper[4769]: I1121 12:45:10.404665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" event={"ID":"b23a8bb4-7473-461c-bdee-d0d7de0acb24","Type":"ContainerStarted","Data":"397ba0f1229f12b2700bf47767cf21caf0e3c3a2eed1309d045603f78aee1038"} Nov 21 12:45:10 crc kubenswrapper[4769]: I1121 12:45:10.404895 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:10 crc kubenswrapper[4769]: I1121 12:45:10.405176 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:10 crc kubenswrapper[4769]: I1121 12:45:10.955755 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:10 crc kubenswrapper[4769]: I1121 12:45:10.983119 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" podStartSLOduration=2.98309246 podStartE2EDuration="2.98309246s" podCreationTimestamp="2025-11-21 12:45:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:10.421048225 +0000 UTC m=+3269.121710083" watchObservedRunningTime="2025-11-21 12:45:10.98309246 +0000 UTC m=+3269.683754278" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.043882 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.043949 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.088131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.090750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqlkp\" (UniqueName: \"kubernetes.io/projected/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-kube-api-access-lqlkp\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.090799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-run-httpd\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.090854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-log-httpd\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.090880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-config-data\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.090958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-sg-core-conf-yaml\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.091098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-combined-ca-bundle\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.091133 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-scripts\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.091154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-ceilometer-tls-certs\") pod \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\" (UID: \"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016\") " Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.091603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.091748 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.105279 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.122548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-scripts" (OuterVolumeSpecName: "scripts") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.123438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-kube-api-access-lqlkp" (OuterVolumeSpecName: "kube-api-access-lqlkp") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "kube-api-access-lqlkp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.137561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.193803 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lqlkp\" (UniqueName: \"kubernetes.io/projected/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-kube-api-access-lqlkp\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.193856 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.193867 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.193881 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.193890 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.194370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.244844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.247314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-config-data" (OuterVolumeSpecName: "config-data") pod "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" (UID: "53c3a22e-dcdf-43ba-b2f8-38dfd0a61016"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.295705 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.295743 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.295754 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.419278 4769 generic.go:334] "Generic (PLEG): container finished" podID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerID="90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a" exitCode=0 Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.419397 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.419471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerDied","Data":"90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a"} Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.419527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"53c3a22e-dcdf-43ba-b2f8-38dfd0a61016","Type":"ContainerDied","Data":"751e4a99c08e106cc4513a09d265dcaf406df8d95dce2f522a80aa41d740bad4"} Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.419548 4769 scope.go:117] "RemoveContainer" containerID="05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.421122 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.421152 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.470120 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.479780 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.486861 4769 scope.go:117] "RemoveContainer" containerID="cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.492855 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.493531 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="proxy-httpd" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493551 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="proxy-httpd" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.493581 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="sg-core" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493588 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="sg-core" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.493601 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-notification-agent" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493608 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-notification-agent" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.493635 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-central-agent" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493641 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-central-agent" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493910 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-notification-agent" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493966 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="sg-core" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493980 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="proxy-httpd" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.493994 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" containerName="ceilometer-central-agent" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.506980 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.511601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.514786 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.515044 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.515315 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.522348 4769 scope.go:117] "RemoveContainer" containerID="7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.556570 4769 scope.go:117] "RemoveContainer" containerID="90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.581533 4769 scope.go:117] "RemoveContainer" containerID="05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.582916 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0\": container with ID starting with 05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0 not found: ID does not exist" containerID="05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.582959 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0"} err="failed to get container status \"05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0\": rpc error: code = NotFound desc = could not find container \"05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0\": container with ID starting with 05493bb9004cd45cecc7ae18a5a3df4062405d2b686645cd6a329cad63beada0 not found: ID does not exist" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.582991 4769 scope.go:117] "RemoveContainer" containerID="cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.584017 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a\": container with ID starting with cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a not found: ID does not exist" containerID="cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.584047 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a"} err="failed to get container status \"cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a\": rpc error: code = NotFound desc = could not find container \"cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a\": container with ID starting with cb4cea060d9ac611465ed1b65e320cea2380c67e1849d729a9f2c7562eb45b8a not found: ID does not exist" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.584066 4769 scope.go:117] "RemoveContainer" containerID="7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.584574 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47\": container with ID starting with 7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47 not found: ID does not exist" containerID="7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.584605 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47"} err="failed to get container status \"7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47\": rpc error: code = NotFound desc = could not find container \"7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47\": container with ID starting with 7187147f59cda6a644bd2cd5bd9d41aba623b8a7063743e5be24d14b9ade7c47 not found: ID does not exist" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.584623 4769 scope.go:117] "RemoveContainer" containerID="90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a" Nov 21 12:45:11 crc kubenswrapper[4769]: E1121 12:45:11.584926 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a\": container with ID starting with 90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a not found: ID does not exist" containerID="90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.584954 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a"} err="failed to get container status \"90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a\": rpc error: code = NotFound desc = could not find container \"90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a\": container with ID starting with 90ec66b0efc9998f35b570097663341a7c682c863d6efe1aee01cc055009d80a not found: ID does not exist" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.602959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-log-httpd\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-config-data\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htps7\" (UniqueName: \"kubernetes.io/projected/a4007e3e-cc52-4842-9dc5-f2c0b5873444-kube-api-access-htps7\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-scripts\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.603572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-run-httpd\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.704774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-htps7\" (UniqueName: \"kubernetes.io/projected/a4007e3e-cc52-4842-9dc5-f2c0b5873444-kube-api-access-htps7\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.704820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-scripts\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.704851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.704942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-run-httpd\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.704969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.704994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-log-httpd\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.705023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.705045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-config-data\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.705755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-run-httpd\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.705850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-log-httpd\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.710673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-config-data\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.711491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.711975 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-scripts\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.718713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.724150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.728211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-htps7\" (UniqueName: \"kubernetes.io/projected/a4007e3e-cc52-4842-9dc5-f2c0b5873444-kube-api-access-htps7\") pod \"ceilometer-0\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:11 crc kubenswrapper[4769]: I1121 12:45:11.853771 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:12 crc kubenswrapper[4769]: I1121 12:45:12.374796 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:45:12 crc kubenswrapper[4769]: I1121 12:45:12.433918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerStarted","Data":"e435d413bf9f08f519dd355639164d733d6565eb839131f9eb3e3a35c4788424"} Nov 21 12:45:12 crc kubenswrapper[4769]: I1121 12:45:12.435998 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:45:12 crc kubenswrapper[4769]: I1121 12:45:12.436011 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:45:12 crc kubenswrapper[4769]: I1121 12:45:12.469995 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:12 crc kubenswrapper[4769]: I1121 12:45:12.470845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:45:13 crc kubenswrapper[4769]: I1121 12:45:13.333010 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c3a22e-dcdf-43ba-b2f8-38dfd0a61016" path="/var/lib/kubelet/pods/53c3a22e-dcdf-43ba-b2f8-38dfd0a61016/volumes" Nov 21 12:45:13 crc kubenswrapper[4769]: I1121 12:45:13.452806 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:45:13 crc kubenswrapper[4769]: I1121 12:45:13.452837 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:45:13 crc kubenswrapper[4769]: I1121 12:45:13.452874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerStarted","Data":"ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7"} Nov 21 12:45:13 crc kubenswrapper[4769]: I1121 12:45:13.518332 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:13 crc kubenswrapper[4769]: I1121 12:45:13.664459 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:45:14 crc kubenswrapper[4769]: I1121 12:45:14.465584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerStarted","Data":"9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad"} Nov 21 12:45:15 crc kubenswrapper[4769]: I1121 12:45:15.484413 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerStarted","Data":"73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a"} Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.313082 4769 scope.go:117] "RemoveContainer" containerID="022dd433ccea512d5c5390a08c32ebd23f6437a3d74f55d4e3cced8338a6da6f" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.344713 4769 scope.go:117] "RemoveContainer" containerID="ed10da15d9a853724f32abe130cf71488623cce53a6627d5b2df941aa10bf5ce" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.399867 4769 scope.go:117] "RemoveContainer" containerID="bc221043d89eea757aeefab2d26c9f7d767f99de08e643e371fb3a44d00ae71e" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.424729 4769 scope.go:117] "RemoveContainer" containerID="2fd2f37a46a5fa04eaa37bc9029917dc693b30eadcddce8516bf8400cb58ab6d" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.515096 4769 scope.go:117] "RemoveContainer" containerID="2f65b0f763dfc4859f7c13f5557d2c9ca783cb0d1c7df074200c92d8eeef6158" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.524362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerStarted","Data":"0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5"} Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.524787 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.556849 4769 scope.go:117] "RemoveContainer" containerID="908724d52efa7d576b7f6591f9a9144816fe4c25e7857cf621f85b556381d9ed" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.557255 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.161980441 podStartE2EDuration="5.55722769s" podCreationTimestamp="2025-11-21 12:45:11 +0000 UTC" firstStartedPulling="2025-11-21 12:45:12.375431628 +0000 UTC m=+3271.076093446" lastFinishedPulling="2025-11-21 12:45:15.770678837 +0000 UTC m=+3274.471340695" observedRunningTime="2025-11-21 12:45:16.553680964 +0000 UTC m=+3275.254342782" watchObservedRunningTime="2025-11-21 12:45:16.55722769 +0000 UTC m=+3275.257889508" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.574696 4769 scope.go:117] "RemoveContainer" containerID="bc5cf1008572afddeb19fe64767b3b314afeb4253e0a16d419805431cb4075d1" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.616890 4769 scope.go:117] "RemoveContainer" containerID="c420f1506cf28ef6804b486348b6d21fe955600f531eb9caa2242a1d8c4392b5" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.645906 4769 scope.go:117] "RemoveContainer" containerID="a519a861272b99d1e0c60db5bac9fafdf14865a5a15bca92e286e64e329c20f1" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.679108 4769 scope.go:117] "RemoveContainer" containerID="233ea3996215f8cbe2ec9d0ae64b6cda9ffcea14e51e455859c082b6ae160e16" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.709247 4769 scope.go:117] "RemoveContainer" containerID="654a77c7034caba2ea536f55e4aa893f3edd8f15f5710b7ebc7bf47fbb15357f" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.748142 4769 scope.go:117] "RemoveContainer" containerID="99ee46e7be53655c9ff1ea8014b01115ef5a430294ae2e1adbe9b53c4d2f5174" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.775531 4769 scope.go:117] "RemoveContainer" containerID="b7988bea32c802e8b5a49d276c9ee94444c8899e8888fc245b7ea7c260125703" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.807932 4769 scope.go:117] "RemoveContainer" containerID="80351b626483f01999e80989157153661002afd4c23fc1c31259341a54b36dcf" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.848122 4769 scope.go:117] "RemoveContainer" containerID="08f3dac19275963f7631149ded191aab9c95d11c06c4f3ef01c1d0b027a28a6a" Nov 21 12:45:16 crc kubenswrapper[4769]: I1121 12:45:16.884341 4769 scope.go:117] "RemoveContainer" containerID="5a286a7207d803214125f331757b926a6d3cc978313ad63da1425b15628d7c24" Nov 21 12:45:19 crc kubenswrapper[4769]: I1121 12:45:19.275056 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:45:19 crc kubenswrapper[4769]: E1121 12:45:19.275747 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:45:23 crc kubenswrapper[4769]: I1121 12:45:23.629080 4769 generic.go:334] "Generic (PLEG): container finished" podID="b23a8bb4-7473-461c-bdee-d0d7de0acb24" containerID="619ccfe65b0cee9b2672cb225974f9f89105e1de9a911b41e5ef3c62af66fc65" exitCode=0 Nov 21 12:45:23 crc kubenswrapper[4769]: I1121 12:45:23.629356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" event={"ID":"b23a8bb4-7473-461c-bdee-d0d7de0acb24","Type":"ContainerDied","Data":"619ccfe65b0cee9b2672cb225974f9f89105e1de9a911b41e5ef3c62af66fc65"} Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.104763 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.239398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-config-data\") pod \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.239514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-scripts\") pod \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.239617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-combined-ca-bundle\") pod \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.239702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b5pd\" (UniqueName: \"kubernetes.io/projected/b23a8bb4-7473-461c-bdee-d0d7de0acb24-kube-api-access-8b5pd\") pod \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\" (UID: \"b23a8bb4-7473-461c-bdee-d0d7de0acb24\") " Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.248051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-scripts" (OuterVolumeSpecName: "scripts") pod "b23a8bb4-7473-461c-bdee-d0d7de0acb24" (UID: "b23a8bb4-7473-461c-bdee-d0d7de0acb24"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.249416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b23a8bb4-7473-461c-bdee-d0d7de0acb24-kube-api-access-8b5pd" (OuterVolumeSpecName: "kube-api-access-8b5pd") pod "b23a8bb4-7473-461c-bdee-d0d7de0acb24" (UID: "b23a8bb4-7473-461c-bdee-d0d7de0acb24"). InnerVolumeSpecName "kube-api-access-8b5pd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.273073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-config-data" (OuterVolumeSpecName: "config-data") pod "b23a8bb4-7473-461c-bdee-d0d7de0acb24" (UID: "b23a8bb4-7473-461c-bdee-d0d7de0acb24"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.297407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b23a8bb4-7473-461c-bdee-d0d7de0acb24" (UID: "b23a8bb4-7473-461c-bdee-d0d7de0acb24"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.342623 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.342679 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8b5pd\" (UniqueName: \"kubernetes.io/projected/b23a8bb4-7473-461c-bdee-d0d7de0acb24-kube-api-access-8b5pd\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.342697 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.342709 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b23a8bb4-7473-461c-bdee-d0d7de0acb24-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.668828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" event={"ID":"b23a8bb4-7473-461c-bdee-d0d7de0acb24","Type":"ContainerDied","Data":"397ba0f1229f12b2700bf47767cf21caf0e3c3a2eed1309d045603f78aee1038"} Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.669472 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="397ba0f1229f12b2700bf47767cf21caf0e3c3a2eed1309d045603f78aee1038" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.669838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.762540 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:45:25 crc kubenswrapper[4769]: E1121 12:45:25.763174 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b23a8bb4-7473-461c-bdee-d0d7de0acb24" containerName="nova-cell0-conductor-db-sync" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.763207 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b23a8bb4-7473-461c-bdee-d0d7de0acb24" containerName="nova-cell0-conductor-db-sync" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.763443 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b23a8bb4-7473-461c-bdee-d0d7de0acb24" containerName="nova-cell0-conductor-db-sync" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.764397 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.767986 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-stsbq" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.768027 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.774652 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.857895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.858356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.858505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcdvk\" (UniqueName: \"kubernetes.io/projected/45969258-6de5-4b79-ba45-c82a31743fc5-kube-api-access-wcdvk\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.960549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.960669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.960708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wcdvk\" (UniqueName: \"kubernetes.io/projected/45969258-6de5-4b79-ba45-c82a31743fc5-kube-api-access-wcdvk\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.969932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.969954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:25 crc kubenswrapper[4769]: I1121 12:45:25.986385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcdvk\" (UniqueName: \"kubernetes.io/projected/45969258-6de5-4b79-ba45-c82a31743fc5-kube-api-access-wcdvk\") pod \"nova-cell0-conductor-0\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:26 crc kubenswrapper[4769]: I1121 12:45:26.106436 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:26 crc kubenswrapper[4769]: W1121 12:45:26.658635 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45969258_6de5_4b79_ba45_c82a31743fc5.slice/crio-6481a3bc2c87efd05f17f554dfcadc28fe1766460d9d05d56ef71e263e0a2342 WatchSource:0}: Error finding container 6481a3bc2c87efd05f17f554dfcadc28fe1766460d9d05d56ef71e263e0a2342: Status 404 returned error can't find the container with id 6481a3bc2c87efd05f17f554dfcadc28fe1766460d9d05d56ef71e263e0a2342 Nov 21 12:45:26 crc kubenswrapper[4769]: I1121 12:45:26.660912 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:45:26 crc kubenswrapper[4769]: I1121 12:45:26.691816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45969258-6de5-4b79-ba45-c82a31743fc5","Type":"ContainerStarted","Data":"6481a3bc2c87efd05f17f554dfcadc28fe1766460d9d05d56ef71e263e0a2342"} Nov 21 12:45:27 crc kubenswrapper[4769]: I1121 12:45:27.712176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45969258-6de5-4b79-ba45-c82a31743fc5","Type":"ContainerStarted","Data":"587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa"} Nov 21 12:45:27 crc kubenswrapper[4769]: I1121 12:45:27.712802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:27 crc kubenswrapper[4769]: I1121 12:45:27.744756 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.7447216660000002 podStartE2EDuration="2.744721666s" podCreationTimestamp="2025-11-21 12:45:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:27.737855021 +0000 UTC m=+3286.438516879" watchObservedRunningTime="2025-11-21 12:45:27.744721666 +0000 UTC m=+3286.445383514" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.139360 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.622985 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.625065 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.629164 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.629294 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.640164 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.692199 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.692322 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-config-data\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.692349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-scripts\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.692418 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrtdr\" (UniqueName: \"kubernetes.io/projected/b14c7d34-ee99-42ca-bfe4-03af16191085-kube-api-access-hrtdr\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.771590 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.780864 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.784038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.789116 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.794246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-config-data\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.794514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-scripts\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.794663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hrtdr\" (UniqueName: \"kubernetes.io/projected/b14c7d34-ee99-42ca-bfe4-03af16191085-kube-api-access-hrtdr\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.794779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.826936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-scripts\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.832942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-config-data\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.842615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrtdr\" (UniqueName: \"kubernetes.io/projected/b14c7d34-ee99-42ca-bfe4-03af16191085-kube-api-access-hrtdr\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.845182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-5hk6p\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.865100 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.866410 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.871932 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897049 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-config-data\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d818881-b880-4514-b263-17199cc17f84-logs\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27mvg\" (UniqueName: \"kubernetes.io/projected/8ac2ac94-238a-43e0-a667-c12934ffff54-kube-api-access-27mvg\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-config-data\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.897608 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntqwc\" (UniqueName: \"kubernetes.io/projected/8d818881-b880-4514-b263-17199cc17f84-kube-api-access-ntqwc\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.900789 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.952830 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.953527 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.955455 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.962774 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.972107 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.973765 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.976351 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.997464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999276 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d818881-b880-4514-b263-17199cc17f84-logs\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pll28\" (UniqueName: \"kubernetes.io/projected/d2c5f082-9558-4305-aed4-b93377d97e1d-kube-api-access-pll28\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2c5f082-9558-4305-aed4-b93377d97e1d-logs\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-27mvg\" (UniqueName: \"kubernetes.io/projected/8ac2ac94-238a-43e0-a667-c12934ffff54-kube-api-access-27mvg\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-config-data\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqwc\" (UniqueName: \"kubernetes.io/projected/8d818881-b880-4514-b263-17199cc17f84-kube-api-access-ntqwc\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-config-data\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-config-data\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:31 crc kubenswrapper[4769]: I1121 12:45:31.999637 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.003628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d818881-b880-4514-b263-17199cc17f84-logs\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.009737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.012986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.020606 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.024100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-config-data\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.035868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-27mvg\" (UniqueName: \"kubernetes.io/projected/8ac2ac94-238a-43e0-a667-c12934ffff54-kube-api-access-27mvg\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.046665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-config-data\") pod \"nova-scheduler-0\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.047515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntqwc\" (UniqueName: \"kubernetes.io/projected/8d818881-b880-4514-b263-17199cc17f84-kube-api-access-ntqwc\") pod \"nova-api-0\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.100957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2c5f082-9558-4305-aed4-b93377d97e1d-logs\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2c5f082-9558-4305-aed4-b93377d97e1d-logs\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9m4z\" (UniqueName: \"kubernetes.io/projected/7c2e12f7-def1-4b39-8e43-db671b53b819-kube-api-access-r9m4z\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-config-data\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.101871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pll28\" (UniqueName: \"kubernetes.io/projected/d2c5f082-9558-4305-aed4-b93377d97e1d-kube-api-access-pll28\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.104597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.105411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-config-data\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.112334 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.137130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pll28\" (UniqueName: \"kubernetes.io/projected/d2c5f082-9558-4305-aed4-b93377d97e1d-kube-api-access-pll28\") pod \"nova-metadata-0\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.205849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.205986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.206024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r9m4z\" (UniqueName: \"kubernetes.io/projected/7c2e12f7-def1-4b39-8e43-db671b53b819-kube-api-access-r9m4z\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.211623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.214799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.221675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9m4z\" (UniqueName: \"kubernetes.io/projected/7c2e12f7-def1-4b39-8e43-db671b53b819-kube-api-access-r9m4z\") pod \"nova-cell1-novncproxy-0\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.245673 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.275079 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:45:32 crc kubenswrapper[4769]: E1121 12:45:32.275532 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.276572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.414012 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.556771 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p"] Nov 21 12:45:32 crc kubenswrapper[4769]: W1121 12:45:32.569312 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb14c7d34_ee99_42ca_bfe4_03af16191085.slice/crio-4d286b578bd4b83cc1607249697715e9608b263754c793812a2313efce86f75b WatchSource:0}: Error finding container 4d286b578bd4b83cc1607249697715e9608b263754c793812a2313efce86f75b: Status 404 returned error can't find the container with id 4d286b578bd4b83cc1607249697715e9608b263754c793812a2313efce86f75b Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.790317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" event={"ID":"b14c7d34-ee99-42ca-bfe4-03af16191085","Type":"ContainerStarted","Data":"4d286b578bd4b83cc1607249697715e9608b263754c793812a2313efce86f75b"} Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.817490 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj"] Nov 21 12:45:32 crc kubenswrapper[4769]: W1121 12:45:32.818204 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d818881_b880_4514_b263_17199cc17f84.slice/crio-6ad2708baa42ff200c769ccf99aff350821981048d68ac059a331111a84b6b8a WatchSource:0}: Error finding container 6ad2708baa42ff200c769ccf99aff350821981048d68ac059a331111a84b6b8a: Status 404 returned error can't find the container with id 6ad2708baa42ff200c769ccf99aff350821981048d68ac059a331111a84b6b8a Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.821481 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.826007 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.826152 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.837375 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj"] Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.858951 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.885534 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:32 crc kubenswrapper[4769]: W1121 12:45:32.902427 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ac2ac94_238a_43e0_a667_c12934ffff54.slice/crio-5e28af5cf49f2559562d856f1f2d7f324e42b59d474e6ea8f45852bd732b34fe WatchSource:0}: Error finding container 5e28af5cf49f2559562d856f1f2d7f324e42b59d474e6ea8f45852bd732b34fe: Status 404 returned error can't find the container with id 5e28af5cf49f2559562d856f1f2d7f324e42b59d474e6ea8f45852bd732b34fe Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.920823 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.936749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.936852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47m2x\" (UniqueName: \"kubernetes.io/projected/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-kube-api-access-47m2x\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.936984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-config-data\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:32 crc kubenswrapper[4769]: I1121 12:45:32.937072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-scripts\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.017441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.038265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.038317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-47m2x\" (UniqueName: \"kubernetes.io/projected/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-kube-api-access-47m2x\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.038357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-config-data\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.038386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-scripts\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.046541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.046969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-scripts\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.047028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-config-data\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.069705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-47m2x\" (UniqueName: \"kubernetes.io/projected/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-kube-api-access-47m2x\") pod \"nova-cell1-conductor-db-sync-r9slj\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.094885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.635583 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj"] Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.801491 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" event={"ID":"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5","Type":"ContainerStarted","Data":"bc1ce83cd62e8718f506d868d90caf493975ec96f2d594d53bed44bf65052208"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.802777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8ac2ac94-238a-43e0-a667-c12934ffff54","Type":"ContainerStarted","Data":"70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.802811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8ac2ac94-238a-43e0-a667-c12934ffff54","Type":"ContainerStarted","Data":"5e28af5cf49f2559562d856f1f2d7f324e42b59d474e6ea8f45852bd732b34fe"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.805955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d2c5f082-9558-4305-aed4-b93377d97e1d","Type":"ContainerStarted","Data":"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.805976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d2c5f082-9558-4305-aed4-b93377d97e1d","Type":"ContainerStarted","Data":"a05b263622f79c8bf004297f769e348e581c7a73191fb6c8f31e1a27d8ce62d8"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.807550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" event={"ID":"b14c7d34-ee99-42ca-bfe4-03af16191085","Type":"ContainerStarted","Data":"4e22ea228bd4e7295af13d1ec84eec80e46889925d9f59c2648baa6d634185f9"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.809965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8d818881-b880-4514-b263-17199cc17f84","Type":"ContainerStarted","Data":"f60ee0115af7e774fb7a38b3b4775892d7d8749b8c18d11bb9542ddbd3e602bf"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.809990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8d818881-b880-4514-b263-17199cc17f84","Type":"ContainerStarted","Data":"825fa2a50bc170ab3bce3b04c904bdabff205e7715de8a6cff509755d197fbdf"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.810000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8d818881-b880-4514-b263-17199cc17f84","Type":"ContainerStarted","Data":"6ad2708baa42ff200c769ccf99aff350821981048d68ac059a331111a84b6b8a"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.813442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7c2e12f7-def1-4b39-8e43-db671b53b819","Type":"ContainerStarted","Data":"16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.813470 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7c2e12f7-def1-4b39-8e43-db671b53b819","Type":"ContainerStarted","Data":"905d208a158a11eea0c61f80d03637547ab81cb589838d426f2eff8acc13d3ac"} Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.834452 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.834430946 podStartE2EDuration="2.834430946s" podCreationTimestamp="2025-11-21 12:45:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:33.826725588 +0000 UTC m=+3292.527387416" watchObservedRunningTime="2025-11-21 12:45:33.834430946 +0000 UTC m=+3292.535092764" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.865602 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.865584177 podStartE2EDuration="2.865584177s" podCreationTimestamp="2025-11-21 12:45:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:33.858201938 +0000 UTC m=+3292.558863756" watchObservedRunningTime="2025-11-21 12:45:33.865584177 +0000 UTC m=+3292.566245995" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.896749 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.896725867 podStartE2EDuration="2.896725867s" podCreationTimestamp="2025-11-21 12:45:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:33.880777127 +0000 UTC m=+3292.581438945" watchObservedRunningTime="2025-11-21 12:45:33.896725867 +0000 UTC m=+3292.597387685" Nov 21 12:45:33 crc kubenswrapper[4769]: I1121 12:45:33.940009 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" podStartSLOduration=2.939982244 podStartE2EDuration="2.939982244s" podCreationTimestamp="2025-11-21 12:45:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:33.917900879 +0000 UTC m=+3292.618562697" watchObservedRunningTime="2025-11-21 12:45:33.939982244 +0000 UTC m=+3292.640644062" Nov 21 12:45:34 crc kubenswrapper[4769]: I1121 12:45:34.570037 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:34 crc kubenswrapper[4769]: I1121 12:45:34.582393 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:34 crc kubenswrapper[4769]: I1121 12:45:34.827755 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" event={"ID":"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5","Type":"ContainerStarted","Data":"1fa6d3e3808aac3344588a26f5acc8c073dc274c498c11b08709e3f7e70f2f8a"} Nov 21 12:45:34 crc kubenswrapper[4769]: I1121 12:45:34.831516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d2c5f082-9558-4305-aed4-b93377d97e1d","Type":"ContainerStarted","Data":"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477"} Nov 21 12:45:34 crc kubenswrapper[4769]: I1121 12:45:34.857474 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" podStartSLOduration=2.85745793 podStartE2EDuration="2.85745793s" podCreationTimestamp="2025-11-21 12:45:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:34.85116474 +0000 UTC m=+3293.551826558" watchObservedRunningTime="2025-11-21 12:45:34.85745793 +0000 UTC m=+3293.558119748" Nov 21 12:45:34 crc kubenswrapper[4769]: I1121 12:45:34.891157 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.8911388689999997 podStartE2EDuration="3.891138869s" podCreationTimestamp="2025-11-21 12:45:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:34.885845686 +0000 UTC m=+3293.586507504" watchObservedRunningTime="2025-11-21 12:45:34.891138869 +0000 UTC m=+3293.591800687" Nov 21 12:45:35 crc kubenswrapper[4769]: I1121 12:45:35.841718 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-log" containerID="cri-o://4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66" gracePeriod=30 Nov 21 12:45:35 crc kubenswrapper[4769]: I1121 12:45:35.842327 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-metadata" containerID="cri-o://214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477" gracePeriod=30 Nov 21 12:45:35 crc kubenswrapper[4769]: I1121 12:45:35.842395 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="7c2e12f7-def1-4b39-8e43-db671b53b819" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140" gracePeriod=30 Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.495136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.541851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-config-data\") pod \"d2c5f082-9558-4305-aed4-b93377d97e1d\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.542391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-combined-ca-bundle\") pod \"d2c5f082-9558-4305-aed4-b93377d97e1d\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.542545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2c5f082-9558-4305-aed4-b93377d97e1d-logs\") pod \"d2c5f082-9558-4305-aed4-b93377d97e1d\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.542618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pll28\" (UniqueName: \"kubernetes.io/projected/d2c5f082-9558-4305-aed4-b93377d97e1d-kube-api-access-pll28\") pod \"d2c5f082-9558-4305-aed4-b93377d97e1d\" (UID: \"d2c5f082-9558-4305-aed4-b93377d97e1d\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.543679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c5f082-9558-4305-aed4-b93377d97e1d-logs" (OuterVolumeSpecName: "logs") pod "d2c5f082-9558-4305-aed4-b93377d97e1d" (UID: "d2c5f082-9558-4305-aed4-b93377d97e1d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.544641 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2c5f082-9558-4305-aed4-b93377d97e1d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.550562 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c5f082-9558-4305-aed4-b93377d97e1d-kube-api-access-pll28" (OuterVolumeSpecName: "kube-api-access-pll28") pod "d2c5f082-9558-4305-aed4-b93377d97e1d" (UID: "d2c5f082-9558-4305-aed4-b93377d97e1d"). InnerVolumeSpecName "kube-api-access-pll28". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.583828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d2c5f082-9558-4305-aed4-b93377d97e1d" (UID: "d2c5f082-9558-4305-aed4-b93377d97e1d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.606101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-config-data" (OuterVolumeSpecName: "config-data") pod "d2c5f082-9558-4305-aed4-b93377d97e1d" (UID: "d2c5f082-9558-4305-aed4-b93377d97e1d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.626067 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.646303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9m4z\" (UniqueName: \"kubernetes.io/projected/7c2e12f7-def1-4b39-8e43-db671b53b819-kube-api-access-r9m4z\") pod \"7c2e12f7-def1-4b39-8e43-db671b53b819\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.646497 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-config-data\") pod \"7c2e12f7-def1-4b39-8e43-db671b53b819\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.646617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-combined-ca-bundle\") pod \"7c2e12f7-def1-4b39-8e43-db671b53b819\" (UID: \"7c2e12f7-def1-4b39-8e43-db671b53b819\") " Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.647218 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.647242 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pll28\" (UniqueName: \"kubernetes.io/projected/d2c5f082-9558-4305-aed4-b93377d97e1d-kube-api-access-pll28\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.647256 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2c5f082-9558-4305-aed4-b93377d97e1d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.652052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2e12f7-def1-4b39-8e43-db671b53b819-kube-api-access-r9m4z" (OuterVolumeSpecName: "kube-api-access-r9m4z") pod "7c2e12f7-def1-4b39-8e43-db671b53b819" (UID: "7c2e12f7-def1-4b39-8e43-db671b53b819"). InnerVolumeSpecName "kube-api-access-r9m4z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.676041 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-config-data" (OuterVolumeSpecName: "config-data") pod "7c2e12f7-def1-4b39-8e43-db671b53b819" (UID: "7c2e12f7-def1-4b39-8e43-db671b53b819"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.684516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c2e12f7-def1-4b39-8e43-db671b53b819" (UID: "7c2e12f7-def1-4b39-8e43-db671b53b819"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.749604 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.749638 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c2e12f7-def1-4b39-8e43-db671b53b819-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.749652 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r9m4z\" (UniqueName: \"kubernetes.io/projected/7c2e12f7-def1-4b39-8e43-db671b53b819-kube-api-access-r9m4z\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.856056 4769 generic.go:334] "Generic (PLEG): container finished" podID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerID="214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477" exitCode=0 Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.856159 4769 generic.go:334] "Generic (PLEG): container finished" podID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerID="4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66" exitCode=143 Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.856209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d2c5f082-9558-4305-aed4-b93377d97e1d","Type":"ContainerDied","Data":"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477"} Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.856326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d2c5f082-9558-4305-aed4-b93377d97e1d","Type":"ContainerDied","Data":"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66"} Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.856340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d2c5f082-9558-4305-aed4-b93377d97e1d","Type":"ContainerDied","Data":"a05b263622f79c8bf004297f769e348e581c7a73191fb6c8f31e1a27d8ce62d8"} Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.856382 4769 scope.go:117] "RemoveContainer" containerID="214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.857961 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.858952 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c2e12f7-def1-4b39-8e43-db671b53b819" containerID="16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140" exitCode=0 Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.858970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7c2e12f7-def1-4b39-8e43-db671b53b819","Type":"ContainerDied","Data":"16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140"} Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.859523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7c2e12f7-def1-4b39-8e43-db671b53b819","Type":"ContainerDied","Data":"905d208a158a11eea0c61f80d03637547ab81cb589838d426f2eff8acc13d3ac"} Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.859048 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.923546 4769 scope.go:117] "RemoveContainer" containerID="4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.929287 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.941261 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.951930 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:36 crc kubenswrapper[4769]: E1121 12:45:36.952346 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c2e12f7-def1-4b39-8e43-db671b53b819" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.952364 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2e12f7-def1-4b39-8e43-db671b53b819" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:45:36 crc kubenswrapper[4769]: E1121 12:45:36.952390 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-metadata" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.952398 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-metadata" Nov 21 12:45:36 crc kubenswrapper[4769]: E1121 12:45:36.952425 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-log" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.952431 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-log" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.952601 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c2e12f7-def1-4b39-8e43-db671b53b819" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.952617 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-log" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.952631 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" containerName="nova-metadata-metadata" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.953232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.960579 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.960883 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.961044 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.971350 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.981956 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:36 crc kubenswrapper[4769]: I1121 12:45:36.992393 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.003960 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.005784 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.012502 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.012698 4769 scope.go:117] "RemoveContainer" containerID="214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.012873 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.013001 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:45:37 crc kubenswrapper[4769]: E1121 12:45:37.015492 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477\": container with ID starting with 214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477 not found: ID does not exist" containerID="214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.015529 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477"} err="failed to get container status \"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477\": rpc error: code = NotFound desc = could not find container \"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477\": container with ID starting with 214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477 not found: ID does not exist" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.015552 4769 scope.go:117] "RemoveContainer" containerID="4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66" Nov 21 12:45:37 crc kubenswrapper[4769]: E1121 12:45:37.015932 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66\": container with ID starting with 4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66 not found: ID does not exist" containerID="4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.015963 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66"} err="failed to get container status \"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66\": rpc error: code = NotFound desc = could not find container \"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66\": container with ID starting with 4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66 not found: ID does not exist" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.015988 4769 scope.go:117] "RemoveContainer" containerID="214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.020482 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477"} err="failed to get container status \"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477\": rpc error: code = NotFound desc = could not find container \"214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477\": container with ID starting with 214f84acfd2ed74054918b049e9570e22baee6f8294068e515cb3efde2b90477 not found: ID does not exist" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.020542 4769 scope.go:117] "RemoveContainer" containerID="4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.021183 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66"} err="failed to get container status \"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66\": rpc error: code = NotFound desc = could not find container \"4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66\": container with ID starting with 4d29b9087ab695aa0f9d200f5d4bfff49ad2335be78b6b7cc0e97252f2adec66 not found: ID does not exist" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.021297 4769 scope.go:117] "RemoveContainer" containerID="16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb2pc\" (UniqueName: \"kubernetes.io/projected/23ba26dc-ff31-4837-94db-85584619d8b4-kube-api-access-kb2pc\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsv7h\" (UniqueName: \"kubernetes.io/projected/b36ce55a-e855-4560-9a7b-ea18164abe71-kube-api-access-hsv7h\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-config-data\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057827 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b36ce55a-e855-4560-9a7b-ea18164abe71-logs\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057900 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.057994 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.059372 4769 scope.go:117] "RemoveContainer" containerID="16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140" Nov 21 12:45:37 crc kubenswrapper[4769]: E1121 12:45:37.059990 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140\": container with ID starting with 16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140 not found: ID does not exist" containerID="16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.060024 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140"} err="failed to get container status \"16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140\": rpc error: code = NotFound desc = could not find container \"16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140\": container with ID starting with 16f51bf6dc89c771f0921d24603e8eafc50db7d39a3e58caabead75267e77140 not found: ID does not exist" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.158921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kb2pc\" (UniqueName: \"kubernetes.io/projected/23ba26dc-ff31-4837-94db-85584619d8b4-kube-api-access-kb2pc\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hsv7h\" (UniqueName: \"kubernetes.io/projected/b36ce55a-e855-4560-9a7b-ea18164abe71-kube-api-access-hsv7h\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-config-data\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b36ce55a-e855-4560-9a7b-ea18164abe71-logs\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159419 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159447 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.159473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.160417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b36ce55a-e855-4560-9a7b-ea18164abe71-logs\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.164333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.165315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.166047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.167119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-config-data\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.168412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.169479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.180583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.190145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsv7h\" (UniqueName: \"kubernetes.io/projected/b36ce55a-e855-4560-9a7b-ea18164abe71-kube-api-access-hsv7h\") pod \"nova-metadata-0\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.198255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb2pc\" (UniqueName: \"kubernetes.io/projected/23ba26dc-ff31-4837-94db-85584619d8b4-kube-api-access-kb2pc\") pod \"nova-cell1-novncproxy-0\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.246621 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.288052 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2e12f7-def1-4b39-8e43-db671b53b819" path="/var/lib/kubelet/pods/7c2e12f7-def1-4b39-8e43-db671b53b819/volumes" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.288647 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c5f082-9558-4305-aed4-b93377d97e1d" path="/var/lib/kubelet/pods/d2c5f082-9558-4305-aed4-b93377d97e1d/volumes" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.345133 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:37 crc kubenswrapper[4769]: I1121 12:45:37.351239 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.014665 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:38 crc kubenswrapper[4769]: W1121 12:45:38.023243 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb36ce55a_e855_4560_9a7b_ea18164abe71.slice/crio-fc9f6aac74baced1f6cb4a779040dfa9e718ce3b1cb6321c84761efff3a22bd9 WatchSource:0}: Error finding container fc9f6aac74baced1f6cb4a779040dfa9e718ce3b1cb6321c84761efff3a22bd9: Status 404 returned error can't find the container with id fc9f6aac74baced1f6cb4a779040dfa9e718ce3b1cb6321c84761efff3a22bd9 Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.106362 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:45:38 crc kubenswrapper[4769]: W1121 12:45:38.120398 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23ba26dc_ff31_4837_94db_85584619d8b4.slice/crio-262ce462ee54214483cc00ede6baa489b10897fc223d17ee593de8609ab3221a WatchSource:0}: Error finding container 262ce462ee54214483cc00ede6baa489b10897fc223d17ee593de8609ab3221a: Status 404 returned error can't find the container with id 262ce462ee54214483cc00ede6baa489b10897fc223d17ee593de8609ab3221a Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.896725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"23ba26dc-ff31-4837-94db-85584619d8b4","Type":"ContainerStarted","Data":"c44b3e5451855a61065e3bc9d86fade0455d8776d80e8c21a3fbf0c80d547ebc"} Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.897382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"23ba26dc-ff31-4837-94db-85584619d8b4","Type":"ContainerStarted","Data":"262ce462ee54214483cc00ede6baa489b10897fc223d17ee593de8609ab3221a"} Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.900713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b36ce55a-e855-4560-9a7b-ea18164abe71","Type":"ContainerStarted","Data":"1fa389cf388eba168045169c8ec4e81df1f2b4350309778456f3bd2729e1ee54"} Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.900815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b36ce55a-e855-4560-9a7b-ea18164abe71","Type":"ContainerStarted","Data":"39a0b2e46884e18844e85585ca62a8980178fb4cfccdba4e1009961cba6c275c"} Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.900833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b36ce55a-e855-4560-9a7b-ea18164abe71","Type":"ContainerStarted","Data":"fc9f6aac74baced1f6cb4a779040dfa9e718ce3b1cb6321c84761efff3a22bd9"} Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.926176 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.926148279 podStartE2EDuration="2.926148279s" podCreationTimestamp="2025-11-21 12:45:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:38.919811078 +0000 UTC m=+3297.620472906" watchObservedRunningTime="2025-11-21 12:45:38.926148279 +0000 UTC m=+3297.626810097" Nov 21 12:45:38 crc kubenswrapper[4769]: I1121 12:45:38.949749 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.949716265 podStartE2EDuration="2.949716265s" podCreationTimestamp="2025-11-21 12:45:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:38.947661729 +0000 UTC m=+3297.648323557" watchObservedRunningTime="2025-11-21 12:45:38.949716265 +0000 UTC m=+3297.650378113" Nov 21 12:45:39 crc kubenswrapper[4769]: I1121 12:45:39.865559 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-w4s99"] Nov 21 12:45:39 crc kubenswrapper[4769]: I1121 12:45:39.867688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:39 crc kubenswrapper[4769]: I1121 12:45:39.897060 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-w4s99"] Nov 21 12:45:39 crc kubenswrapper[4769]: I1121 12:45:39.939806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-catalog-content\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:39 crc kubenswrapper[4769]: I1121 12:45:39.939916 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjqc\" (UniqueName: \"kubernetes.io/projected/d6cb0d3b-4157-426a-b5a4-6459156e719b-kube-api-access-wmjqc\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:39 crc kubenswrapper[4769]: I1121 12:45:39.939979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-utilities\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.041720 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-utilities\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.041904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-catalog-content\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.041978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjqc\" (UniqueName: \"kubernetes.io/projected/d6cb0d3b-4157-426a-b5a4-6459156e719b-kube-api-access-wmjqc\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.042278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-utilities\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.042554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-catalog-content\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.063264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjqc\" (UniqueName: \"kubernetes.io/projected/d6cb0d3b-4157-426a-b5a4-6459156e719b-kube-api-access-wmjqc\") pod \"community-operators-w4s99\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.196664 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.717282 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-w4s99"] Nov 21 12:45:40 crc kubenswrapper[4769]: W1121 12:45:40.727811 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cb0d3b_4157_426a_b5a4_6459156e719b.slice/crio-b382a6c99ac555037330a8f2c3be38dbbdbec0f25e9232dbab83ec6af2017368 WatchSource:0}: Error finding container b382a6c99ac555037330a8f2c3be38dbbdbec0f25e9232dbab83ec6af2017368: Status 404 returned error can't find the container with id b382a6c99ac555037330a8f2c3be38dbbdbec0f25e9232dbab83ec6af2017368 Nov 21 12:45:40 crc kubenswrapper[4769]: I1121 12:45:40.965972 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerStarted","Data":"b382a6c99ac555037330a8f2c3be38dbbdbec0f25e9232dbab83ec6af2017368"} Nov 21 12:45:41 crc kubenswrapper[4769]: I1121 12:45:41.871405 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:45:41 crc kubenswrapper[4769]: I1121 12:45:41.979268 4769 generic.go:334] "Generic (PLEG): container finished" podID="b14c7d34-ee99-42ca-bfe4-03af16191085" containerID="4e22ea228bd4e7295af13d1ec84eec80e46889925d9f59c2648baa6d634185f9" exitCode=0 Nov 21 12:45:41 crc kubenswrapper[4769]: I1121 12:45:41.979403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" event={"ID":"b14c7d34-ee99-42ca-bfe4-03af16191085","Type":"ContainerDied","Data":"4e22ea228bd4e7295af13d1ec84eec80e46889925d9f59c2648baa6d634185f9"} Nov 21 12:45:41 crc kubenswrapper[4769]: I1121 12:45:41.982383 4769 generic.go:334] "Generic (PLEG): container finished" podID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerID="5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c" exitCode=0 Nov 21 12:45:41 crc kubenswrapper[4769]: I1121 12:45:41.982558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerDied","Data":"5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c"} Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.113287 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.113372 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.246268 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.289168 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.347011 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.352615 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:42 crc kubenswrapper[4769]: I1121 12:45:42.352671 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.034492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.196482 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.28:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.197001 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.28:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.391158 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.538028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrtdr\" (UniqueName: \"kubernetes.io/projected/b14c7d34-ee99-42ca-bfe4-03af16191085-kube-api-access-hrtdr\") pod \"b14c7d34-ee99-42ca-bfe4-03af16191085\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.538765 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-config-data\") pod \"b14c7d34-ee99-42ca-bfe4-03af16191085\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.538838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-scripts\") pod \"b14c7d34-ee99-42ca-bfe4-03af16191085\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.538858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-combined-ca-bundle\") pod \"b14c7d34-ee99-42ca-bfe4-03af16191085\" (UID: \"b14c7d34-ee99-42ca-bfe4-03af16191085\") " Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.549350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-scripts" (OuterVolumeSpecName: "scripts") pod "b14c7d34-ee99-42ca-bfe4-03af16191085" (UID: "b14c7d34-ee99-42ca-bfe4-03af16191085"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.549524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14c7d34-ee99-42ca-bfe4-03af16191085-kube-api-access-hrtdr" (OuterVolumeSpecName: "kube-api-access-hrtdr") pod "b14c7d34-ee99-42ca-bfe4-03af16191085" (UID: "b14c7d34-ee99-42ca-bfe4-03af16191085"). InnerVolumeSpecName "kube-api-access-hrtdr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.572901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b14c7d34-ee99-42ca-bfe4-03af16191085" (UID: "b14c7d34-ee99-42ca-bfe4-03af16191085"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.581524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-config-data" (OuterVolumeSpecName: "config-data") pod "b14c7d34-ee99-42ca-bfe4-03af16191085" (UID: "b14c7d34-ee99-42ca-bfe4-03af16191085"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.641322 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.641369 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.641382 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14c7d34-ee99-42ca-bfe4-03af16191085-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:43 crc kubenswrapper[4769]: I1121 12:45:43.641400 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hrtdr\" (UniqueName: \"kubernetes.io/projected/b14c7d34-ee99-42ca-bfe4-03af16191085-kube-api-access-hrtdr\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.009794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" event={"ID":"b14c7d34-ee99-42ca-bfe4-03af16191085","Type":"ContainerDied","Data":"4d286b578bd4b83cc1607249697715e9608b263754c793812a2313efce86f75b"} Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.009890 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d286b578bd4b83cc1607249697715e9608b263754c793812a2313efce86f75b" Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.009818 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p" Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.011787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerStarted","Data":"66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294"} Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.126590 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.127305 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-log" containerID="cri-o://825fa2a50bc170ab3bce3b04c904bdabff205e7715de8a6cff509755d197fbdf" gracePeriod=30 Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.127921 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-api" containerID="cri-o://f60ee0115af7e774fb7a38b3b4775892d7d8749b8c18d11bb9542ddbd3e602bf" gracePeriod=30 Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.145525 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.183030 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.183395 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-log" containerID="cri-o://39a0b2e46884e18844e85585ca62a8980178fb4cfccdba4e1009961cba6c275c" gracePeriod=30 Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.183593 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-metadata" containerID="cri-o://1fa389cf388eba168045169c8ec4e81df1f2b4350309778456f3bd2729e1ee54" gracePeriod=30 Nov 21 12:45:44 crc kubenswrapper[4769]: I1121 12:45:44.274757 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:45:44 crc kubenswrapper[4769]: E1121 12:45:44.275100 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.023726 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d818881-b880-4514-b263-17199cc17f84" containerID="825fa2a50bc170ab3bce3b04c904bdabff205e7715de8a6cff509755d197fbdf" exitCode=143 Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.023821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8d818881-b880-4514-b263-17199cc17f84","Type":"ContainerDied","Data":"825fa2a50bc170ab3bce3b04c904bdabff205e7715de8a6cff509755d197fbdf"} Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.027346 4769 generic.go:334] "Generic (PLEG): container finished" podID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerID="66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294" exitCode=0 Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.027399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerDied","Data":"66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294"} Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031414 4769 generic.go:334] "Generic (PLEG): container finished" podID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerID="1fa389cf388eba168045169c8ec4e81df1f2b4350309778456f3bd2729e1ee54" exitCode=0 Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031448 4769 generic.go:334] "Generic (PLEG): container finished" podID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerID="39a0b2e46884e18844e85585ca62a8980178fb4cfccdba4e1009961cba6c275c" exitCode=143 Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b36ce55a-e855-4560-9a7b-ea18164abe71","Type":"ContainerDied","Data":"1fa389cf388eba168045169c8ec4e81df1f2b4350309778456f3bd2729e1ee54"} Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b36ce55a-e855-4560-9a7b-ea18164abe71","Type":"ContainerDied","Data":"39a0b2e46884e18844e85585ca62a8980178fb4cfccdba4e1009961cba6c275c"} Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b36ce55a-e855-4560-9a7b-ea18164abe71","Type":"ContainerDied","Data":"fc9f6aac74baced1f6cb4a779040dfa9e718ce3b1cb6321c84761efff3a22bd9"} Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031555 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc9f6aac74baced1f6cb4a779040dfa9e718ce3b1cb6321c84761efff3a22bd9" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.031644 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8ac2ac94-238a-43e0-a667-c12934ffff54" containerName="nova-scheduler-scheduler" containerID="cri-o://70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" gracePeriod=30 Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.048933 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.176160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-nova-metadata-tls-certs\") pod \"b36ce55a-e855-4560-9a7b-ea18164abe71\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.176259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsv7h\" (UniqueName: \"kubernetes.io/projected/b36ce55a-e855-4560-9a7b-ea18164abe71-kube-api-access-hsv7h\") pod \"b36ce55a-e855-4560-9a7b-ea18164abe71\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.176394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-combined-ca-bundle\") pod \"b36ce55a-e855-4560-9a7b-ea18164abe71\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.176502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b36ce55a-e855-4560-9a7b-ea18164abe71-logs\") pod \"b36ce55a-e855-4560-9a7b-ea18164abe71\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.176592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-config-data\") pod \"b36ce55a-e855-4560-9a7b-ea18164abe71\" (UID: \"b36ce55a-e855-4560-9a7b-ea18164abe71\") " Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.176898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b36ce55a-e855-4560-9a7b-ea18164abe71-logs" (OuterVolumeSpecName: "logs") pod "b36ce55a-e855-4560-9a7b-ea18164abe71" (UID: "b36ce55a-e855-4560-9a7b-ea18164abe71"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.177326 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b36ce55a-e855-4560-9a7b-ea18164abe71-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.187176 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36ce55a-e855-4560-9a7b-ea18164abe71-kube-api-access-hsv7h" (OuterVolumeSpecName: "kube-api-access-hsv7h") pod "b36ce55a-e855-4560-9a7b-ea18164abe71" (UID: "b36ce55a-e855-4560-9a7b-ea18164abe71"). InnerVolumeSpecName "kube-api-access-hsv7h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.227080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-config-data" (OuterVolumeSpecName: "config-data") pod "b36ce55a-e855-4560-9a7b-ea18164abe71" (UID: "b36ce55a-e855-4560-9a7b-ea18164abe71"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.234304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b36ce55a-e855-4560-9a7b-ea18164abe71" (UID: "b36ce55a-e855-4560-9a7b-ea18164abe71"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.280773 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.281125 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hsv7h\" (UniqueName: \"kubernetes.io/projected/b36ce55a-e855-4560-9a7b-ea18164abe71-kube-api-access-hsv7h\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.281236 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.286643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b36ce55a-e855-4560-9a7b-ea18164abe71" (UID: "b36ce55a-e855-4560-9a7b-ea18164abe71"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:45 crc kubenswrapper[4769]: I1121 12:45:45.383973 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b36ce55a-e855-4560-9a7b-ea18164abe71-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.057295 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.059428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerStarted","Data":"41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b"} Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.098535 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-w4s99" podStartSLOduration=3.643777936 podStartE2EDuration="7.09849652s" podCreationTimestamp="2025-11-21 12:45:39 +0000 UTC" firstStartedPulling="2025-11-21 12:45:41.985402673 +0000 UTC m=+3300.686064501" lastFinishedPulling="2025-11-21 12:45:45.440121267 +0000 UTC m=+3304.140783085" observedRunningTime="2025-11-21 12:45:46.087454822 +0000 UTC m=+3304.788116650" watchObservedRunningTime="2025-11-21 12:45:46.09849652 +0000 UTC m=+3304.799158348" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.164839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.178556 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.213442 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:46 crc kubenswrapper[4769]: E1121 12:45:46.213968 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-metadata" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.213991 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-metadata" Nov 21 12:45:46 crc kubenswrapper[4769]: E1121 12:45:46.214011 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b14c7d34-ee99-42ca-bfe4-03af16191085" containerName="nova-manage" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.214021 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14c7d34-ee99-42ca-bfe4-03af16191085" containerName="nova-manage" Nov 21 12:45:46 crc kubenswrapper[4769]: E1121 12:45:46.214042 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-log" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.214049 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-log" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.214338 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b14c7d34-ee99-42ca-bfe4-03af16191085" containerName="nova-manage" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.214359 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-log" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.214373 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" containerName="nova-metadata-metadata" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.215563 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.222630 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.225809 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.229081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.312996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g8j2\" (UniqueName: \"kubernetes.io/projected/cfcc20de-89d2-4045-bcc5-4bf18de5415f-kube-api-access-4g8j2\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.313048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfcc20de-89d2-4045-bcc5-4bf18de5415f-logs\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.313071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.313255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.313320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-config-data\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.415453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4g8j2\" (UniqueName: \"kubernetes.io/projected/cfcc20de-89d2-4045-bcc5-4bf18de5415f-kube-api-access-4g8j2\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.415517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfcc20de-89d2-4045-bcc5-4bf18de5415f-logs\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.415554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.415671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.415728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-config-data\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.419689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfcc20de-89d2-4045-bcc5-4bf18de5415f-logs\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.422591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.422647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.429323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-config-data\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.448703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g8j2\" (UniqueName: \"kubernetes.io/projected/cfcc20de-89d2-4045-bcc5-4bf18de5415f-kube-api-access-4g8j2\") pod \"nova-metadata-0\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:46 crc kubenswrapper[4769]: I1121 12:45:46.539595 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:47 crc kubenswrapper[4769]: I1121 12:45:47.059377 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:45:47 crc kubenswrapper[4769]: W1121 12:45:47.059492 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfcc20de_89d2_4045_bcc5_4bf18de5415f.slice/crio-c67aa377b3f6c227748c5986a218a4929eb64069f3ad37cfe79d91084ba1593a WatchSource:0}: Error finding container c67aa377b3f6c227748c5986a218a4929eb64069f3ad37cfe79d91084ba1593a: Status 404 returned error can't find the container with id c67aa377b3f6c227748c5986a218a4929eb64069f3ad37cfe79d91084ba1593a Nov 21 12:45:47 crc kubenswrapper[4769]: I1121 12:45:47.082118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfcc20de-89d2-4045-bcc5-4bf18de5415f","Type":"ContainerStarted","Data":"c67aa377b3f6c227748c5986a218a4929eb64069f3ad37cfe79d91084ba1593a"} Nov 21 12:45:47 crc kubenswrapper[4769]: E1121 12:45:47.248568 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:45:47 crc kubenswrapper[4769]: E1121 12:45:47.250643 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:45:47 crc kubenswrapper[4769]: E1121 12:45:47.251995 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:45:47 crc kubenswrapper[4769]: E1121 12:45:47.252036 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8ac2ac94-238a-43e0-a667-c12934ffff54" containerName="nova-scheduler-scheduler" Nov 21 12:45:47 crc kubenswrapper[4769]: I1121 12:45:47.289098 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b36ce55a-e855-4560-9a7b-ea18164abe71" path="/var/lib/kubelet/pods/b36ce55a-e855-4560-9a7b-ea18164abe71/volumes" Nov 21 12:45:47 crc kubenswrapper[4769]: I1121 12:45:47.346991 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:47 crc kubenswrapper[4769]: I1121 12:45:47.392942 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:48 crc kubenswrapper[4769]: I1121 12:45:48.097054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfcc20de-89d2-4045-bcc5-4bf18de5415f","Type":"ContainerStarted","Data":"81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c"} Nov 21 12:45:48 crc kubenswrapper[4769]: I1121 12:45:48.097130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfcc20de-89d2-4045-bcc5-4bf18de5415f","Type":"ContainerStarted","Data":"7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4"} Nov 21 12:45:48 crc kubenswrapper[4769]: I1121 12:45:48.124421 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.124401873 podStartE2EDuration="2.124401873s" podCreationTimestamp="2025-11-21 12:45:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:48.118465422 +0000 UTC m=+3306.819127280" watchObservedRunningTime="2025-11-21 12:45:48.124401873 +0000 UTC m=+3306.825063691" Nov 21 12:45:48 crc kubenswrapper[4769]: I1121 12:45:48.135090 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.120971 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d818881-b880-4514-b263-17199cc17f84" containerID="f60ee0115af7e774fb7a38b3b4775892d7d8749b8c18d11bb9542ddbd3e602bf" exitCode=0 Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.121062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8d818881-b880-4514-b263-17199cc17f84","Type":"ContainerDied","Data":"f60ee0115af7e774fb7a38b3b4775892d7d8749b8c18d11bb9542ddbd3e602bf"} Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.121456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8d818881-b880-4514-b263-17199cc17f84","Type":"ContainerDied","Data":"6ad2708baa42ff200c769ccf99aff350821981048d68ac059a331111a84b6b8a"} Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.121484 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ad2708baa42ff200c769ccf99aff350821981048d68ac059a331111a84b6b8a" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.138184 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.197210 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.197259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.255882 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.301395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-combined-ca-bundle\") pod \"8d818881-b880-4514-b263-17199cc17f84\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.301566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntqwc\" (UniqueName: \"kubernetes.io/projected/8d818881-b880-4514-b263-17199cc17f84-kube-api-access-ntqwc\") pod \"8d818881-b880-4514-b263-17199cc17f84\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.301605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d818881-b880-4514-b263-17199cc17f84-logs\") pod \"8d818881-b880-4514-b263-17199cc17f84\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.301698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-config-data\") pod \"8d818881-b880-4514-b263-17199cc17f84\" (UID: \"8d818881-b880-4514-b263-17199cc17f84\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.302299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d818881-b880-4514-b263-17199cc17f84-logs" (OuterVolumeSpecName: "logs") pod "8d818881-b880-4514-b263-17199cc17f84" (UID: "8d818881-b880-4514-b263-17199cc17f84"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.310594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d818881-b880-4514-b263-17199cc17f84-kube-api-access-ntqwc" (OuterVolumeSpecName: "kube-api-access-ntqwc") pod "8d818881-b880-4514-b263-17199cc17f84" (UID: "8d818881-b880-4514-b263-17199cc17f84"). InnerVolumeSpecName "kube-api-access-ntqwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.330454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d818881-b880-4514-b263-17199cc17f84" (UID: "8d818881-b880-4514-b263-17199cc17f84"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.345938 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-config-data" (OuterVolumeSpecName: "config-data") pod "8d818881-b880-4514-b263-17199cc17f84" (UID: "8d818881-b880-4514-b263-17199cc17f84"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.404890 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ntqwc\" (UniqueName: \"kubernetes.io/projected/8d818881-b880-4514-b263-17199cc17f84-kube-api-access-ntqwc\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.404946 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d818881-b880-4514-b263-17199cc17f84-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.404971 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.404993 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d818881-b880-4514-b263-17199cc17f84-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.822965 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.834427 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-config-data\") pod \"8ac2ac94-238a-43e0-a667-c12934ffff54\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.834490 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27mvg\" (UniqueName: \"kubernetes.io/projected/8ac2ac94-238a-43e0-a667-c12934ffff54-kube-api-access-27mvg\") pod \"8ac2ac94-238a-43e0-a667-c12934ffff54\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.834632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-combined-ca-bundle\") pod \"8ac2ac94-238a-43e0-a667-c12934ffff54\" (UID: \"8ac2ac94-238a-43e0-a667-c12934ffff54\") " Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.841992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac2ac94-238a-43e0-a667-c12934ffff54-kube-api-access-27mvg" (OuterVolumeSpecName: "kube-api-access-27mvg") pod "8ac2ac94-238a-43e0-a667-c12934ffff54" (UID: "8ac2ac94-238a-43e0-a667-c12934ffff54"). InnerVolumeSpecName "kube-api-access-27mvg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.896406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-config-data" (OuterVolumeSpecName: "config-data") pod "8ac2ac94-238a-43e0-a667-c12934ffff54" (UID: "8ac2ac94-238a-43e0-a667-c12934ffff54"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.910974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8ac2ac94-238a-43e0-a667-c12934ffff54" (UID: "8ac2ac94-238a-43e0-a667-c12934ffff54"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.936962 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.936994 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-27mvg\" (UniqueName: \"kubernetes.io/projected/8ac2ac94-238a-43e0-a667-c12934ffff54-kube-api-access-27mvg\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:50 crc kubenswrapper[4769]: I1121 12:45:50.937008 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ac2ac94-238a-43e0-a667-c12934ffff54-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.144850 4769 generic.go:334] "Generic (PLEG): container finished" podID="be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" containerID="1fa6d3e3808aac3344588a26f5acc8c073dc274c498c11b08709e3f7e70f2f8a" exitCode=0 Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.144957 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" event={"ID":"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5","Type":"ContainerDied","Data":"1fa6d3e3808aac3344588a26f5acc8c073dc274c498c11b08709e3f7e70f2f8a"} Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.150767 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ac2ac94-238a-43e0-a667-c12934ffff54" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" exitCode=0 Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.150889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8ac2ac94-238a-43e0-a667-c12934ffff54","Type":"ContainerDied","Data":"70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8"} Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.150999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8ac2ac94-238a-43e0-a667-c12934ffff54","Type":"ContainerDied","Data":"5e28af5cf49f2559562d856f1f2d7f324e42b59d474e6ea8f45852bd732b34fe"} Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.151042 4769 scope.go:117] "RemoveContainer" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.151120 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.151213 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.224583 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.236560 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.240882 4769 scope.go:117] "RemoveContainer" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" Nov 21 12:45:51 crc kubenswrapper[4769]: E1121 12:45:51.243325 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8\": container with ID starting with 70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8 not found: ID does not exist" containerID="70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.243390 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8"} err="failed to get container status \"70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8\": rpc error: code = NotFound desc = could not find container \"70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8\": container with ID starting with 70a7dae0dc4a9d9e5f20f9c63d240ac8dec99a352110edd30c772e8d29fe96a8 not found: ID does not exist" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.245732 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.255282 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.302475 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac2ac94-238a-43e0-a667-c12934ffff54" path="/var/lib/kubelet/pods/8ac2ac94-238a-43e0-a667-c12934ffff54/volumes" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.303939 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: E1121 12:45:51.304414 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-log" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.304437 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-log" Nov 21 12:45:51 crc kubenswrapper[4769]: E1121 12:45:51.304470 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-api" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.304480 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-api" Nov 21 12:45:51 crc kubenswrapper[4769]: E1121 12:45:51.304498 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ac2ac94-238a-43e0-a667-c12934ffff54" containerName="nova-scheduler-scheduler" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.304508 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac2ac94-238a-43e0-a667-c12934ffff54" containerName="nova-scheduler-scheduler" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.304847 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ac2ac94-238a-43e0-a667-c12934ffff54" containerName="nova-scheduler-scheduler" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.304884 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-api" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.304910 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d818881-b880-4514-b263-17199cc17f84" containerName="nova-api-log" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.308554 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.312268 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.311678 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.325258 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.337821 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.339876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.342864 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.344673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhfvd\" (UniqueName: \"kubernetes.io/projected/cd45d601-20a0-46b5-8018-47da698db08b-kube-api-access-xhfvd\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.344728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.344774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-config-data\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.350090 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.368232 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-w4s99"] Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-config-data\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9zj\" (UniqueName: \"kubernetes.io/projected/7346c3c9-e282-4628-a1e8-37db52e4356c-kube-api-access-qq9zj\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xhfvd\" (UniqueName: \"kubernetes.io/projected/cd45d601-20a0-46b5-8018-47da698db08b-kube-api-access-xhfvd\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-config-data\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.447982 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7346c3c9-e282-4628-a1e8-37db52e4356c-logs\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.453358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.454218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-config-data\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.464107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhfvd\" (UniqueName: \"kubernetes.io/projected/cd45d601-20a0-46b5-8018-47da698db08b-kube-api-access-xhfvd\") pod \"nova-scheduler-0\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.540679 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.540744 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.550711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.550786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7346c3c9-e282-4628-a1e8-37db52e4356c-logs\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.550930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-config-data\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.550964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9zj\" (UniqueName: \"kubernetes.io/projected/7346c3c9-e282-4628-a1e8-37db52e4356c-kube-api-access-qq9zj\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.551358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7346c3c9-e282-4628-a1e8-37db52e4356c-logs\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.555233 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-config-data\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.555770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.571861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9zj\" (UniqueName: \"kubernetes.io/projected/7346c3c9-e282-4628-a1e8-37db52e4356c-kube-api-access-qq9zj\") pod \"nova-api-0\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.630664 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:51 crc kubenswrapper[4769]: I1121 12:45:51.657256 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:52.218487 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:52.237453 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:45:53 crc kubenswrapper[4769]: W1121 12:45:52.248938 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7346c3c9_e282_4628_a1e8_37db52e4356c.slice/crio-474ee251cd506157c4ce791ffac59e340edd55fc7f456acc9489058545102e3f WatchSource:0}: Error finding container 474ee251cd506157c4ce791ffac59e340edd55fc7f456acc9489058545102e3f: Status 404 returned error can't find the container with id 474ee251cd506157c4ce791ffac59e340edd55fc7f456acc9489058545102e3f Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.215741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7346c3c9-e282-4628-a1e8-37db52e4356c","Type":"ContainerStarted","Data":"c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226"} Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.216322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7346c3c9-e282-4628-a1e8-37db52e4356c","Type":"ContainerStarted","Data":"66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e"} Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.216333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7346c3c9-e282-4628-a1e8-37db52e4356c","Type":"ContainerStarted","Data":"474ee251cd506157c4ce791ffac59e340edd55fc7f456acc9489058545102e3f"} Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.223745 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-w4s99" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="registry-server" containerID="cri-o://41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b" gracePeriod=2 Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.224582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cd45d601-20a0-46b5-8018-47da698db08b","Type":"ContainerStarted","Data":"439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c"} Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.224604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cd45d601-20a0-46b5-8018-47da698db08b","Type":"ContainerStarted","Data":"8f8821f79a8ef6ba6f99e995d71f2dede68d325255cc3e2575b4a6c5d4e825ec"} Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.254554 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.254530851 podStartE2EDuration="2.254530851s" podCreationTimestamp="2025-11-21 12:45:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:53.249895816 +0000 UTC m=+3311.950557634" watchObservedRunningTime="2025-11-21 12:45:53.254530851 +0000 UTC m=+3311.955192669" Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.282887 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.282859865 podStartE2EDuration="2.282859865s" podCreationTimestamp="2025-11-21 12:45:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:53.277542242 +0000 UTC m=+3311.978204070" watchObservedRunningTime="2025-11-21 12:45:53.282859865 +0000 UTC m=+3311.983521683" Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.453354 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d818881-b880-4514-b263-17199cc17f84" path="/var/lib/kubelet/pods/8d818881-b880-4514-b263-17199cc17f84/volumes" Nov 21 12:45:53 crc kubenswrapper[4769]: I1121 12:45:53.926527 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.021659 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47m2x\" (UniqueName: \"kubernetes.io/projected/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-kube-api-access-47m2x\") pod \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.021788 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-config-data\") pod \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.021859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-combined-ca-bundle\") pod \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.022018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-scripts\") pod \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\" (UID: \"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.030350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-kube-api-access-47m2x" (OuterVolumeSpecName: "kube-api-access-47m2x") pod "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" (UID: "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5"). InnerVolumeSpecName "kube-api-access-47m2x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.030589 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-scripts" (OuterVolumeSpecName: "scripts") pod "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" (UID: "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.055943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" (UID: "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.063253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-config-data" (OuterVolumeSpecName: "config-data") pod "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" (UID: "be547a2f-4f2b-4c3a-8d65-2a0b833e03f5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.101357 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.123961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-utilities\") pod \"d6cb0d3b-4157-426a-b5a4-6459156e719b\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.124125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmjqc\" (UniqueName: \"kubernetes.io/projected/d6cb0d3b-4157-426a-b5a4-6459156e719b-kube-api-access-wmjqc\") pod \"d6cb0d3b-4157-426a-b5a4-6459156e719b\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.124310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-catalog-content\") pod \"d6cb0d3b-4157-426a-b5a4-6459156e719b\" (UID: \"d6cb0d3b-4157-426a-b5a4-6459156e719b\") " Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.124872 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-47m2x\" (UniqueName: \"kubernetes.io/projected/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-kube-api-access-47m2x\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.124907 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.124926 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.124944 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.126898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-utilities" (OuterVolumeSpecName: "utilities") pod "d6cb0d3b-4157-426a-b5a4-6459156e719b" (UID: "d6cb0d3b-4157-426a-b5a4-6459156e719b"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.130367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6cb0d3b-4157-426a-b5a4-6459156e719b-kube-api-access-wmjqc" (OuterVolumeSpecName: "kube-api-access-wmjqc") pod "d6cb0d3b-4157-426a-b5a4-6459156e719b" (UID: "d6cb0d3b-4157-426a-b5a4-6459156e719b"). InnerVolumeSpecName "kube-api-access-wmjqc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.202734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d6cb0d3b-4157-426a-b5a4-6459156e719b" (UID: "d6cb0d3b-4157-426a-b5a4-6459156e719b"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.227148 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.227207 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d6cb0d3b-4157-426a-b5a4-6459156e719b-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.227223 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wmjqc\" (UniqueName: \"kubernetes.io/projected/d6cb0d3b-4157-426a-b5a4-6459156e719b-kube-api-access-wmjqc\") on node \"crc\" DevicePath \"\"" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.238776 4769 generic.go:334] "Generic (PLEG): container finished" podID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerID="41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b" exitCode=0 Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.238839 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerDied","Data":"41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b"} Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.238871 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-w4s99" event={"ID":"d6cb0d3b-4157-426a-b5a4-6459156e719b","Type":"ContainerDied","Data":"b382a6c99ac555037330a8f2c3be38dbbdbec0f25e9232dbab83ec6af2017368"} Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.238893 4769 scope.go:117] "RemoveContainer" containerID="41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.239028 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-w4s99" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.249552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.249537 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj" event={"ID":"be547a2f-4f2b-4c3a-8d65-2a0b833e03f5","Type":"ContainerDied","Data":"bc1ce83cd62e8718f506d868d90caf493975ec96f2d594d53bed44bf65052208"} Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.249619 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc1ce83cd62e8718f506d868d90caf493975ec96f2d594d53bed44bf65052208" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.302055 4769 scope.go:117] "RemoveContainer" containerID="66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.323061 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-w4s99"] Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.336243 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-w4s99"] Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.347066 4769 scope.go:117] "RemoveContainer" containerID="5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.370436 4769 scope.go:117] "RemoveContainer" containerID="41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b" Nov 21 12:45:54 crc kubenswrapper[4769]: E1121 12:45:54.371525 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b\": container with ID starting with 41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b not found: ID does not exist" containerID="41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.371564 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b"} err="failed to get container status \"41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b\": rpc error: code = NotFound desc = could not find container \"41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b\": container with ID starting with 41a6fdd0c8f5e785645a72754d47987402ef9dfbb896fd8e13effdc3b9f1202b not found: ID does not exist" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.371635 4769 scope.go:117] "RemoveContainer" containerID="66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294" Nov 21 12:45:54 crc kubenswrapper[4769]: E1121 12:45:54.372062 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294\": container with ID starting with 66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294 not found: ID does not exist" containerID="66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.372116 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294"} err="failed to get container status \"66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294\": rpc error: code = NotFound desc = could not find container \"66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294\": container with ID starting with 66794367e893d6c8b0362b285cb7e2b0072e4c3e9cbe11bcdbcf40a2645af294 not found: ID does not exist" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.372150 4769 scope.go:117] "RemoveContainer" containerID="5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c" Nov 21 12:45:54 crc kubenswrapper[4769]: E1121 12:45:54.372717 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c\": container with ID starting with 5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c not found: ID does not exist" containerID="5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c" Nov 21 12:45:54 crc kubenswrapper[4769]: I1121 12:45:54.372763 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c"} err="failed to get container status \"5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c\": rpc error: code = NotFound desc = could not find container \"5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c\": container with ID starting with 5946e3be759ab4f090bcdcfa69ad82a6ef4180b4810ccd1b6f97bede2e46bd9c not found: ID does not exist" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.032319 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:45:55 crc kubenswrapper[4769]: E1121 12:45:55.032892 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="extract-utilities" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.032913 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="extract-utilities" Nov 21 12:45:55 crc kubenswrapper[4769]: E1121 12:45:55.032954 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" containerName="nova-cell1-conductor-db-sync" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.032962 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" containerName="nova-cell1-conductor-db-sync" Nov 21 12:45:55 crc kubenswrapper[4769]: E1121 12:45:55.032981 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="extract-content" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.032989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="extract-content" Nov 21 12:45:55 crc kubenswrapper[4769]: E1121 12:45:55.033013 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="registry-server" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.033020 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="registry-server" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.033279 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" containerName="registry-server" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.033322 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" containerName="nova-cell1-conductor-db-sync" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.034308 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.036417 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.042785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.042851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.042963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksns7\" (UniqueName: \"kubernetes.io/projected/ee849839-867d-45a9-8078-2d530cd62ff7-kube-api-access-ksns7\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.043287 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.144817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.144873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.144906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ksns7\" (UniqueName: \"kubernetes.io/projected/ee849839-867d-45a9-8078-2d530cd62ff7-kube-api-access-ksns7\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.149577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.150853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.163849 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksns7\" (UniqueName: \"kubernetes.io/projected/ee849839-867d-45a9-8078-2d530cd62ff7-kube-api-access-ksns7\") pod \"nova-cell1-conductor-0\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.286900 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6cb0d3b-4157-426a-b5a4-6459156e719b" path="/var/lib/kubelet/pods/d6cb0d3b-4157-426a-b5a4-6459156e719b/volumes" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.372513 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:55 crc kubenswrapper[4769]: I1121 12:45:55.875704 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.274529 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:45:56 crc kubenswrapper[4769]: E1121 12:45:56.276597 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.278629 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"ee849839-867d-45a9-8078-2d530cd62ff7","Type":"ContainerStarted","Data":"b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc"} Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.278675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"ee849839-867d-45a9-8078-2d530cd62ff7","Type":"ContainerStarted","Data":"4065247a532b3f5fb951766a5a2ef5194ef51bf1d69c95e0d6a897c682466fdd"} Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.280129 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.298358 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=1.298336178 podStartE2EDuration="1.298336178s" podCreationTimestamp="2025-11-21 12:45:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:45:56.296886659 +0000 UTC m=+3314.997548487" watchObservedRunningTime="2025-11-21 12:45:56.298336178 +0000 UTC m=+3314.998997996" Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.540884 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.541134 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:45:56 crc kubenswrapper[4769]: I1121 12:45:56.631798 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:45:57 crc kubenswrapper[4769]: I1121 12:45:57.553600 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.36:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:45:57 crc kubenswrapper[4769]: I1121 12:45:57.553592 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.36:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:01 crc kubenswrapper[4769]: I1121 12:46:01.631417 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:01 crc kubenswrapper[4769]: I1121 12:46:01.657801 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:01 crc kubenswrapper[4769]: I1121 12:46:01.657850 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:01 crc kubenswrapper[4769]: I1121 12:46:01.682900 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:02 crc kubenswrapper[4769]: I1121 12:46:02.428153 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:02 crc kubenswrapper[4769]: I1121 12:46:02.740422 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.38:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:02 crc kubenswrapper[4769]: I1121 12:46:02.740432 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.38:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:05 crc kubenswrapper[4769]: I1121 12:46:05.417604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.029133 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz"] Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.031419 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.034149 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.034918 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.039039 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz"] Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.201914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-config-data\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.202110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.202150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-scripts\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.202225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frnnx\" (UniqueName: \"kubernetes.io/projected/d0c48ca4-3d73-4082-b79a-3bb6673e5241-kube-api-access-frnnx\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.305030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-frnnx\" (UniqueName: \"kubernetes.io/projected/d0c48ca4-3d73-4082-b79a-3bb6673e5241-kube-api-access-frnnx\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.306430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-config-data\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.307668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.307886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-scripts\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.315614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-scripts\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.316356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.316752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-config-data\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.340884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-frnnx\" (UniqueName: \"kubernetes.io/projected/d0c48ca4-3d73-4082-b79a-3bb6673e5241-kube-api-access-frnnx\") pod \"nova-cell1-cell-mapping-hdssz\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.373557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.557361 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.557549 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.568225 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.568750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:06 crc kubenswrapper[4769]: W1121 12:46:06.971954 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0c48ca4_3d73_4082_b79a_3bb6673e5241.slice/crio-b230df5bd7fa040b91e9d3876b4646b7fcbf7f39ad7abc5d9b5c7c336c8db34f WatchSource:0}: Error finding container b230df5bd7fa040b91e9d3876b4646b7fcbf7f39ad7abc5d9b5c7c336c8db34f: Status 404 returned error can't find the container with id b230df5bd7fa040b91e9d3876b4646b7fcbf7f39ad7abc5d9b5c7c336c8db34f Nov 21 12:46:06 crc kubenswrapper[4769]: I1121 12:46:06.972713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz"] Nov 21 12:46:07 crc kubenswrapper[4769]: I1121 12:46:07.475319 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" event={"ID":"d0c48ca4-3d73-4082-b79a-3bb6673e5241","Type":"ContainerStarted","Data":"3bff30276be14354820ba8ba4107daae246c512d6d17bcee716e03687536091c"} Nov 21 12:46:07 crc kubenswrapper[4769]: I1121 12:46:07.475683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" event={"ID":"d0c48ca4-3d73-4082-b79a-3bb6673e5241","Type":"ContainerStarted","Data":"b230df5bd7fa040b91e9d3876b4646b7fcbf7f39ad7abc5d9b5c7c336c8db34f"} Nov 21 12:46:07 crc kubenswrapper[4769]: I1121 12:46:07.495440 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" podStartSLOduration=1.495421744 podStartE2EDuration="1.495421744s" podCreationTimestamp="2025-11-21 12:46:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:46:07.494686164 +0000 UTC m=+3326.195347992" watchObservedRunningTime="2025-11-21 12:46:07.495421744 +0000 UTC m=+3326.196083572" Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.274525 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:46:11 crc kubenswrapper[4769]: E1121 12:46:11.275648 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.544903 4769 generic.go:334] "Generic (PLEG): container finished" podID="d0c48ca4-3d73-4082-b79a-3bb6673e5241" containerID="3bff30276be14354820ba8ba4107daae246c512d6d17bcee716e03687536091c" exitCode=0 Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.545339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" event={"ID":"d0c48ca4-3d73-4082-b79a-3bb6673e5241","Type":"ContainerDied","Data":"3bff30276be14354820ba8ba4107daae246c512d6d17bcee716e03687536091c"} Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.665258 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.666850 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.667088 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:11 crc kubenswrapper[4769]: I1121 12:46:11.671484 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:12 crc kubenswrapper[4769]: I1121 12:46:12.563451 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:12 crc kubenswrapper[4769]: I1121 12:46:12.576985 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.026573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.188522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frnnx\" (UniqueName: \"kubernetes.io/projected/d0c48ca4-3d73-4082-b79a-3bb6673e5241-kube-api-access-frnnx\") pod \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.188576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-combined-ca-bundle\") pod \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.188605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-scripts\") pod \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.188666 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-config-data\") pod \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\" (UID: \"d0c48ca4-3d73-4082-b79a-3bb6673e5241\") " Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.202639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-scripts" (OuterVolumeSpecName: "scripts") pod "d0c48ca4-3d73-4082-b79a-3bb6673e5241" (UID: "d0c48ca4-3d73-4082-b79a-3bb6673e5241"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.240604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c48ca4-3d73-4082-b79a-3bb6673e5241-kube-api-access-frnnx" (OuterVolumeSpecName: "kube-api-access-frnnx") pod "d0c48ca4-3d73-4082-b79a-3bb6673e5241" (UID: "d0c48ca4-3d73-4082-b79a-3bb6673e5241"). InnerVolumeSpecName "kube-api-access-frnnx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.274353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0c48ca4-3d73-4082-b79a-3bb6673e5241" (UID: "d0c48ca4-3d73-4082-b79a-3bb6673e5241"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.286464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-config-data" (OuterVolumeSpecName: "config-data") pod "d0c48ca4-3d73-4082-b79a-3bb6673e5241" (UID: "d0c48ca4-3d73-4082-b79a-3bb6673e5241"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.290493 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-frnnx\" (UniqueName: \"kubernetes.io/projected/d0c48ca4-3d73-4082-b79a-3bb6673e5241-kube-api-access-frnnx\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.290538 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.290548 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.290558 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c48ca4-3d73-4082-b79a-3bb6673e5241-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.572265 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.572298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz" event={"ID":"d0c48ca4-3d73-4082-b79a-3bb6673e5241","Type":"ContainerDied","Data":"b230df5bd7fa040b91e9d3876b4646b7fcbf7f39ad7abc5d9b5c7c336c8db34f"} Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.573486 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b230df5bd7fa040b91e9d3876b4646b7fcbf7f39ad7abc5d9b5c7c336c8db34f" Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.688613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.701005 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.701228 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="cd45d601-20a0-46b5-8018-47da698db08b" containerName="nova-scheduler-scheduler" containerID="cri-o://439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" gracePeriod=30 Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.713890 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.714175 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-log" containerID="cri-o://7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4" gracePeriod=30 Nov 21 12:46:13 crc kubenswrapper[4769]: I1121 12:46:13.714285 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-metadata" containerID="cri-o://81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c" gracePeriod=30 Nov 21 12:46:14 crc kubenswrapper[4769]: I1121 12:46:14.584783 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerID="7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4" exitCode=143 Nov 21 12:46:14 crc kubenswrapper[4769]: I1121 12:46:14.586001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfcc20de-89d2-4045-bcc5-4bf18de5415f","Type":"ContainerDied","Data":"7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4"} Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.069745 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.070024 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-central-agent" containerID="cri-o://ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7" gracePeriod=30 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.070098 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="proxy-httpd" containerID="cri-o://0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5" gracePeriod=30 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.070153 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-notification-agent" containerID="cri-o://9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad" gracePeriod=30 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.070141 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="sg-core" containerID="cri-o://73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a" gracePeriod=30 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.600793 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerID="0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5" exitCode=0 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.600841 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerID="73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a" exitCode=2 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.600851 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerID="ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7" exitCode=0 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.601079 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-log" containerID="cri-o://66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e" gracePeriod=30 Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.601387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerDied","Data":"0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5"} Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.601415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerDied","Data":"73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a"} Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.601426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerDied","Data":"ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7"} Nov 21 12:46:15 crc kubenswrapper[4769]: I1121 12:46:15.601794 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-api" containerID="cri-o://c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226" gracePeriod=30 Nov 21 12:46:16 crc kubenswrapper[4769]: I1121 12:46:16.618319 4769 generic.go:334] "Generic (PLEG): container finished" podID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerID="66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e" exitCode=143 Nov 21 12:46:16 crc kubenswrapper[4769]: I1121 12:46:16.618572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7346c3c9-e282-4628-a1e8-37db52e4356c","Type":"ContainerDied","Data":"66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e"} Nov 21 12:46:16 crc kubenswrapper[4769]: E1121 12:46:16.633175 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:46:16 crc kubenswrapper[4769]: E1121 12:46:16.635221 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:46:16 crc kubenswrapper[4769]: E1121 12:46:16.636445 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:46:16 crc kubenswrapper[4769]: E1121 12:46:16.636479 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="cd45d601-20a0-46b5-8018-47da698db08b" containerName="nova-scheduler-scheduler" Nov 21 12:46:16 crc kubenswrapper[4769]: I1121 12:46:16.862949 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.36:8775/\": read tcp 10.217.0.2:37104->10.217.1.36:8775: read: connection reset by peer" Nov 21 12:46:16 crc kubenswrapper[4769]: I1121 12:46:16.862996 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.36:8775/\": read tcp 10.217.0.2:37116->10.217.1.36:8775: read: connection reset by peer" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.191003 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.310377 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366081 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-combined-ca-bundle\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-sg-core-conf-yaml\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-ceilometer-tls-certs\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-run-httpd\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-log-httpd\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htps7\" (UniqueName: \"kubernetes.io/projected/a4007e3e-cc52-4842-9dc5-f2c0b5873444-kube-api-access-htps7\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-scripts\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.366466 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-config-data\") pod \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\" (UID: \"a4007e3e-cc52-4842-9dc5-f2c0b5873444\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.369595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.372485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.374110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-scripts" (OuterVolumeSpecName: "scripts") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.391320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4007e3e-cc52-4842-9dc5-f2c0b5873444-kube-api-access-htps7" (OuterVolumeSpecName: "kube-api-access-htps7") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "kube-api-access-htps7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.411789 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.422385 4769 scope.go:117] "RemoveContainer" containerID="0800cd6de1d31ea3885037956442d8573e85fe030c9295e39659b57743b089f5" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.425637 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.448787 4769 scope.go:117] "RemoveContainer" containerID="cba05b951ba3beafe3ac149850cbe483da79ff8190f0e7f3e6d35f2a3c755c00" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.454410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468027 4769 scope.go:117] "RemoveContainer" containerID="efb5fe71ad34cc3680675ef911814c489e7b2913017f60e32bcd165b8019a7c2" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-combined-ca-bundle\") pod \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-nova-metadata-tls-certs\") pod \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-config-data\") pod \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g8j2\" (UniqueName: \"kubernetes.io/projected/cfcc20de-89d2-4045-bcc5-4bf18de5415f-kube-api-access-4g8j2\") pod \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfcc20de-89d2-4045-bcc5-4bf18de5415f-logs\") pod \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\" (UID: \"cfcc20de-89d2-4045-bcc5-4bf18de5415f\") " Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468846 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468862 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-htps7\" (UniqueName: \"kubernetes.io/projected/a4007e3e-cc52-4842-9dc5-f2c0b5873444-kube-api-access-htps7\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468872 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468880 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468890 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468898 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.468905 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4007e3e-cc52-4842-9dc5-f2c0b5873444-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.469062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfcc20de-89d2-4045-bcc5-4bf18de5415f-logs" (OuterVolumeSpecName: "logs") pod "cfcc20de-89d2-4045-bcc5-4bf18de5415f" (UID: "cfcc20de-89d2-4045-bcc5-4bf18de5415f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.471465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfcc20de-89d2-4045-bcc5-4bf18de5415f-kube-api-access-4g8j2" (OuterVolumeSpecName: "kube-api-access-4g8j2") pod "cfcc20de-89d2-4045-bcc5-4bf18de5415f" (UID: "cfcc20de-89d2-4045-bcc5-4bf18de5415f"). InnerVolumeSpecName "kube-api-access-4g8j2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.492833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cfcc20de-89d2-4045-bcc5-4bf18de5415f" (UID: "cfcc20de-89d2-4045-bcc5-4bf18de5415f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.493654 4769 scope.go:117] "RemoveContainer" containerID="ef628575ad5099427844136ae8f72577c2e883ca1b8e68196ff62ea429410210" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.494076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-config-data" (OuterVolumeSpecName: "config-data") pod "a4007e3e-cc52-4842-9dc5-f2c0b5873444" (UID: "a4007e3e-cc52-4842-9dc5-f2c0b5873444"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.495384 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-config-data" (OuterVolumeSpecName: "config-data") pod "cfcc20de-89d2-4045-bcc5-4bf18de5415f" (UID: "cfcc20de-89d2-4045-bcc5-4bf18de5415f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.519975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "cfcc20de-89d2-4045-bcc5-4bf18de5415f" (UID: "cfcc20de-89d2-4045-bcc5-4bf18de5415f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.545971 4769 scope.go:117] "RemoveContainer" containerID="0b375f13bbac168fb981318510ab8f3aca47b060acd05e0a0e57b20ab173dadd" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.567173 4769 scope.go:117] "RemoveContainer" containerID="296e23c7445dae800abce57e045af36f4baa2402f96fc3403bf07c174800f53d" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.570581 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.570620 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4g8j2\" (UniqueName: \"kubernetes.io/projected/cfcc20de-89d2-4045-bcc5-4bf18de5415f-kube-api-access-4g8j2\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.570635 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfcc20de-89d2-4045-bcc5-4bf18de5415f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.570644 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4007e3e-cc52-4842-9dc5-f2c0b5873444-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.570653 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.570661 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfcc20de-89d2-4045-bcc5-4bf18de5415f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.587290 4769 scope.go:117] "RemoveContainer" containerID="a5ef9d056548c48f3a75eceb006cf1a9de635d2e87321b729cdcf81d39bcdf16" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.606416 4769 scope.go:117] "RemoveContainer" containerID="56c860160f723ef3edb50ab1ab4409fdd423e7ca83722f08db57402864c0e2dd" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.639082 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerID="9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad" exitCode=0 Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.639158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerDied","Data":"9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad"} Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.639201 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4007e3e-cc52-4842-9dc5-f2c0b5873444","Type":"ContainerDied","Data":"e435d413bf9f08f519dd355639164d733d6565eb839131f9eb3e3a35c4788424"} Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.639221 4769 scope.go:117] "RemoveContainer" containerID="0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.639347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.661687 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerID="81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c" exitCode=0 Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.661752 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.661770 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfcc20de-89d2-4045-bcc5-4bf18de5415f","Type":"ContainerDied","Data":"81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c"} Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.661860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfcc20de-89d2-4045-bcc5-4bf18de5415f","Type":"ContainerDied","Data":"c67aa377b3f6c227748c5986a218a4929eb64069f3ad37cfe79d91084ba1593a"} Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.661877 4769 scope.go:117] "RemoveContainer" containerID="2bd33ac784cf09190eda17873d45df781be1d4b88d4cf0d042c51c2b6f9aa9f4" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.685060 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.698724 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.717645 4769 scope.go:117] "RemoveContainer" containerID="73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.719945 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.732352 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742000 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d0c48ca4-3d73-4082-b79a-3bb6673e5241" containerName="nova-manage" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742439 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c48ca4-3d73-4082-b79a-3bb6673e5241" containerName="nova-manage" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-central-agent" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742461 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-central-agent" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742475 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="proxy-httpd" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="proxy-httpd" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742487 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-metadata" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742493 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-metadata" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742503 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="sg-core" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742508 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="sg-core" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742530 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-log" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742536 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-log" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.742558 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-notification-agent" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742563 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-notification-agent" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742731 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-metadata" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742746 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-central-agent" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742755 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="sg-core" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742765 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="ceilometer-notification-agent" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742774 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" containerName="proxy-httpd" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742786 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d0c48ca4-3d73-4082-b79a-3bb6673e5241" containerName="nova-manage" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.742795 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" containerName="nova-metadata-log" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.744433 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.746534 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.748533 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.748742 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.758748 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.760295 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.762940 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.763305 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.773131 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.789452 4769 scope.go:117] "RemoveContainer" containerID="9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.815881 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-config-data\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg427\" (UniqueName: \"kubernetes.io/projected/30b662da-331f-4736-bfb7-a1c5f31c1ffa-kube-api-access-qg427\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqcs\" (UniqueName: \"kubernetes.io/projected/7e7510e8-fd68-404b-9774-ce64060e8857-kube-api-access-pbqcs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-config-data\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e7510e8-fd68-404b-9774-ce64060e8857-logs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-scripts\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883908 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.883983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-log-httpd\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.884029 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-run-httpd\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.888211 4769 scope.go:117] "RemoveContainer" containerID="ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.929779 4769 scope.go:117] "RemoveContainer" containerID="0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.930450 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5\": container with ID starting with 0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5 not found: ID does not exist" containerID="0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.930497 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5"} err="failed to get container status \"0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5\": rpc error: code = NotFound desc = could not find container \"0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5\": container with ID starting with 0f6ec6253b5e842dcd0aba38b07a3abcf5826f8bde7f31afc6f05977f9f788d5 not found: ID does not exist" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.930525 4769 scope.go:117] "RemoveContainer" containerID="73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.930927 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a\": container with ID starting with 73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a not found: ID does not exist" containerID="73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.930946 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a"} err="failed to get container status \"73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a\": rpc error: code = NotFound desc = could not find container \"73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a\": container with ID starting with 73e7502d454f619866130d63a193b2eaf8ded6aad7ba1647df8cc564d8b6fd9a not found: ID does not exist" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.930958 4769 scope.go:117] "RemoveContainer" containerID="9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.931322 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad\": container with ID starting with 9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad not found: ID does not exist" containerID="9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.931342 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad"} err="failed to get container status \"9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad\": rpc error: code = NotFound desc = could not find container \"9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad\": container with ID starting with 9ff62944979e22c4f8b01c6db72b184f1b500995533fa7f205b8521e3dc3b7ad not found: ID does not exist" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.931356 4769 scope.go:117] "RemoveContainer" containerID="ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.931592 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7\": container with ID starting with ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7 not found: ID does not exist" containerID="ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.931610 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7"} err="failed to get container status \"ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7\": rpc error: code = NotFound desc = could not find container \"ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7\": container with ID starting with ecc435601ba2f8dc322029a5992c6d3eb2fe2698f39549e9b79a6e479190aad7 not found: ID does not exist" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.931623 4769 scope.go:117] "RemoveContainer" containerID="81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.959246 4769 scope.go:117] "RemoveContainer" containerID="7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-scripts\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-log-httpd\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987727 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-run-httpd\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987764 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-config-data\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qg427\" (UniqueName: \"kubernetes.io/projected/30b662da-331f-4736-bfb7-a1c5f31c1ffa-kube-api-access-qg427\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqcs\" (UniqueName: \"kubernetes.io/projected/7e7510e8-fd68-404b-9774-ce64060e8857-kube-api-access-pbqcs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-config-data\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e7510e8-fd68-404b-9774-ce64060e8857-logs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.987935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.989039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-run-httpd\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.989505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-log-httpd\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.989536 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e7510e8-fd68-404b-9774-ce64060e8857-logs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.991658 4769 scope.go:117] "RemoveContainer" containerID="81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.992027 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c\": container with ID starting with 81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c not found: ID does not exist" containerID="81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.992085 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c"} err="failed to get container status \"81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c\": rpc error: code = NotFound desc = could not find container \"81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c\": container with ID starting with 81852a68d5b9a68c8d61b641fa147b1dce4bdfb9a0e505633e76066c0b72e01c not found: ID does not exist" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.992106 4769 scope.go:117] "RemoveContainer" containerID="7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4" Nov 21 12:46:17 crc kubenswrapper[4769]: E1121 12:46:17.993020 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4\": container with ID starting with 7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4 not found: ID does not exist" containerID="7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.993057 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4"} err="failed to get container status \"7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4\": rpc error: code = NotFound desc = could not find container \"7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4\": container with ID starting with 7777ae3c59ceecdf528eebee4b42de3cb4df720f93f89467ba5ac587c1a6e2d4 not found: ID does not exist" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.993097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.993325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.993478 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.998793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:17 crc kubenswrapper[4769]: I1121 12:46:17.999345 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-config-data\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.002305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-scripts\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.003318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.004955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg427\" (UniqueName: \"kubernetes.io/projected/30b662da-331f-4736-bfb7-a1c5f31c1ffa-kube-api-access-qg427\") pod \"ceilometer-0\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.005167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqcs\" (UniqueName: \"kubernetes.io/projected/7e7510e8-fd68-404b-9774-ce64060e8857-kube-api-access-pbqcs\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.007355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-config-data\") pod \"nova-metadata-0\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.083552 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.159658 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.591885 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.676693 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:18 crc kubenswrapper[4769]: I1121 12:46:18.677535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerStarted","Data":"5b345a409dacfae1facede940eb4f68d0bf0f8ea7c92839647fdc513e2946e99"} Nov 21 12:46:18 crc kubenswrapper[4769]: W1121 12:46:18.677849 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e7510e8_fd68_404b_9774_ce64060e8857.slice/crio-ac2dae15a3cbbeeab25d209ecc403651a814970f1f0dd6dfb24643b0ec8c2d95 WatchSource:0}: Error finding container ac2dae15a3cbbeeab25d209ecc403651a814970f1f0dd6dfb24643b0ec8c2d95: Status 404 returned error can't find the container with id ac2dae15a3cbbeeab25d209ecc403651a814970f1f0dd6dfb24643b0ec8c2d95 Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.187385 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.287275 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4007e3e-cc52-4842-9dc5-f2c0b5873444" path="/var/lib/kubelet/pods/a4007e3e-cc52-4842-9dc5-f2c0b5873444/volumes" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.290217 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfcc20de-89d2-4045-bcc5-4bf18de5415f" path="/var/lib/kubelet/pods/cfcc20de-89d2-4045-bcc5-4bf18de5415f/volumes" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.316312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-combined-ca-bundle\") pod \"cd45d601-20a0-46b5-8018-47da698db08b\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.316419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-config-data\") pod \"cd45d601-20a0-46b5-8018-47da698db08b\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.316663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhfvd\" (UniqueName: \"kubernetes.io/projected/cd45d601-20a0-46b5-8018-47da698db08b-kube-api-access-xhfvd\") pod \"cd45d601-20a0-46b5-8018-47da698db08b\" (UID: \"cd45d601-20a0-46b5-8018-47da698db08b\") " Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.322892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd45d601-20a0-46b5-8018-47da698db08b-kube-api-access-xhfvd" (OuterVolumeSpecName: "kube-api-access-xhfvd") pod "cd45d601-20a0-46b5-8018-47da698db08b" (UID: "cd45d601-20a0-46b5-8018-47da698db08b"). InnerVolumeSpecName "kube-api-access-xhfvd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.349153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd45d601-20a0-46b5-8018-47da698db08b" (UID: "cd45d601-20a0-46b5-8018-47da698db08b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.352120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-config-data" (OuterVolumeSpecName: "config-data") pod "cd45d601-20a0-46b5-8018-47da698db08b" (UID: "cd45d601-20a0-46b5-8018-47da698db08b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.419043 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.419075 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xhfvd\" (UniqueName: \"kubernetes.io/projected/cd45d601-20a0-46b5-8018-47da698db08b-kube-api-access-xhfvd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.419086 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd45d601-20a0-46b5-8018-47da698db08b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.689355 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd45d601-20a0-46b5-8018-47da698db08b" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" exitCode=0 Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.689647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.689577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cd45d601-20a0-46b5-8018-47da698db08b","Type":"ContainerDied","Data":"439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c"} Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.689719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"cd45d601-20a0-46b5-8018-47da698db08b","Type":"ContainerDied","Data":"8f8821f79a8ef6ba6f99e995d71f2dede68d325255cc3e2575b4a6c5d4e825ec"} Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.689754 4769 scope.go:117] "RemoveContainer" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.695956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerStarted","Data":"e64383e9e28b8793e25f3e0cf88d3784c0f6f3d62df9ed582de13f9a54939bd3"} Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.697801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7e7510e8-fd68-404b-9774-ce64060e8857","Type":"ContainerStarted","Data":"b37dd98fa6bdd1e416c4efa33b95a2376a102e8ec9992a969e3acb0389717f44"} Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.697832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7e7510e8-fd68-404b-9774-ce64060e8857","Type":"ContainerStarted","Data":"6c5df0f5565a0a8e26abaec9f5e0baacef7b8dc82ff4bd1b27c945357f6e89de"} Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.697846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7e7510e8-fd68-404b-9774-ce64060e8857","Type":"ContainerStarted","Data":"ac2dae15a3cbbeeab25d209ecc403651a814970f1f0dd6dfb24643b0ec8c2d95"} Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.725297 4769 scope.go:117] "RemoveContainer" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" Nov 21 12:46:19 crc kubenswrapper[4769]: E1121 12:46:19.725908 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c\": container with ID starting with 439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c not found: ID does not exist" containerID="439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.725967 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c"} err="failed to get container status \"439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c\": rpc error: code = NotFound desc = could not find container \"439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c\": container with ID starting with 439ee2e3e97ae591101a9213c0bb66a9eb930426f6ff58984aec77041b7e0b2c not found: ID does not exist" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.746056 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.746034655 podStartE2EDuration="2.746034655s" podCreationTimestamp="2025-11-21 12:46:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:46:19.725552643 +0000 UTC m=+3338.426214461" watchObservedRunningTime="2025-11-21 12:46:19.746034655 +0000 UTC m=+3338.446696473" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.747177 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.756990 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.775346 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:19 crc kubenswrapper[4769]: E1121 12:46:19.775903 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd45d601-20a0-46b5-8018-47da698db08b" containerName="nova-scheduler-scheduler" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.775926 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd45d601-20a0-46b5-8018-47da698db08b" containerName="nova-scheduler-scheduler" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.776208 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd45d601-20a0-46b5-8018-47da698db08b" containerName="nova-scheduler-scheduler" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.777138 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.779535 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.783745 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.934858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2qc\" (UniqueName: \"kubernetes.io/projected/a0d74e83-a8b1-480f-8afb-b8ff9464350d-kube-api-access-tq2qc\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.934930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:19 crc kubenswrapper[4769]: I1121 12:46:19.934993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-config-data\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.037782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-config-data\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.037966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2qc\" (UniqueName: \"kubernetes.io/projected/a0d74e83-a8b1-480f-8afb-b8ff9464350d-kube-api-access-tq2qc\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.038010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.042958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.045928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-config-data\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.070318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2qc\" (UniqueName: \"kubernetes.io/projected/a0d74e83-a8b1-480f-8afb-b8ff9464350d-kube-api-access-tq2qc\") pod \"nova-scheduler-0\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.280893 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.509427 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.657262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-combined-ca-bundle\") pod \"7346c3c9-e282-4628-a1e8-37db52e4356c\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.657352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq9zj\" (UniqueName: \"kubernetes.io/projected/7346c3c9-e282-4628-a1e8-37db52e4356c-kube-api-access-qq9zj\") pod \"7346c3c9-e282-4628-a1e8-37db52e4356c\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.657407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7346c3c9-e282-4628-a1e8-37db52e4356c-logs\") pod \"7346c3c9-e282-4628-a1e8-37db52e4356c\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.657477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-config-data\") pod \"7346c3c9-e282-4628-a1e8-37db52e4356c\" (UID: \"7346c3c9-e282-4628-a1e8-37db52e4356c\") " Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.658407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7346c3c9-e282-4628-a1e8-37db52e4356c-logs" (OuterVolumeSpecName: "logs") pod "7346c3c9-e282-4628-a1e8-37db52e4356c" (UID: "7346c3c9-e282-4628-a1e8-37db52e4356c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.662220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7346c3c9-e282-4628-a1e8-37db52e4356c-kube-api-access-qq9zj" (OuterVolumeSpecName: "kube-api-access-qq9zj") pod "7346c3c9-e282-4628-a1e8-37db52e4356c" (UID: "7346c3c9-e282-4628-a1e8-37db52e4356c"). InnerVolumeSpecName "kube-api-access-qq9zj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.686216 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7346c3c9-e282-4628-a1e8-37db52e4356c" (UID: "7346c3c9-e282-4628-a1e8-37db52e4356c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.689450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-config-data" (OuterVolumeSpecName: "config-data") pod "7346c3c9-e282-4628-a1e8-37db52e4356c" (UID: "7346c3c9-e282-4628-a1e8-37db52e4356c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.725866 4769 generic.go:334] "Generic (PLEG): container finished" podID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerID="c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226" exitCode=0 Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.725918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7346c3c9-e282-4628-a1e8-37db52e4356c","Type":"ContainerDied","Data":"c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226"} Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.725942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7346c3c9-e282-4628-a1e8-37db52e4356c","Type":"ContainerDied","Data":"474ee251cd506157c4ce791ffac59e340edd55fc7f456acc9489058545102e3f"} Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.725959 4769 scope.go:117] "RemoveContainer" containerID="c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.726054 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.733247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerStarted","Data":"8cb918195a2da496d4cebc90d283625185cdf93939a6a1a014af5c164ec23e6e"} Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.765081 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.765136 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7346c3c9-e282-4628-a1e8-37db52e4356c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.765151 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qq9zj\" (UniqueName: \"kubernetes.io/projected/7346c3c9-e282-4628-a1e8-37db52e4356c-kube-api-access-qq9zj\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.765204 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7346c3c9-e282-4628-a1e8-37db52e4356c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.766938 4769 scope.go:117] "RemoveContainer" containerID="66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.774973 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.794441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.803993 4769 scope.go:117] "RemoveContainer" containerID="c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.804103 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:20 crc kubenswrapper[4769]: E1121 12:46:20.806003 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226\": container with ID starting with c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226 not found: ID does not exist" containerID="c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.806049 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226"} err="failed to get container status \"c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226\": rpc error: code = NotFound desc = could not find container \"c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226\": container with ID starting with c8a3dc6340ddf42d9e177df487408f673f82766d83f47534bd0f0108dce70226 not found: ID does not exist" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.806082 4769 scope.go:117] "RemoveContainer" containerID="66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e" Nov 21 12:46:20 crc kubenswrapper[4769]: E1121 12:46:20.806431 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e\": container with ID starting with 66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e not found: ID does not exist" containerID="66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.806459 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e"} err="failed to get container status \"66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e\": rpc error: code = NotFound desc = could not find container \"66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e\": container with ID starting with 66c057826f619241b523efddecf7071f651661d4400c1298e76bad17e62ceb6e not found: ID does not exist" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.814257 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:20 crc kubenswrapper[4769]: E1121 12:46:20.814707 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-api" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.814727 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-api" Nov 21 12:46:20 crc kubenswrapper[4769]: E1121 12:46:20.814749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-log" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.814758 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-log" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.814974 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-log" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.814992 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" containerName="nova-api-api" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.816026 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.824174 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.825474 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.827410 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.834945 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.968645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c4055bb-10f7-45d3-a0e1-0a70629f1813-logs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.968686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-config-data\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.968721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z24sf\" (UniqueName: \"kubernetes.io/projected/2c4055bb-10f7-45d3-a0e1-0a70629f1813-kube-api-access-z24sf\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.969389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.969494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:20 crc kubenswrapper[4769]: I1121 12:46:20.969540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-public-tls-certs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.072463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c4055bb-10f7-45d3-a0e1-0a70629f1813-logs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.072535 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-config-data\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.072607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z24sf\" (UniqueName: \"kubernetes.io/projected/2c4055bb-10f7-45d3-a0e1-0a70629f1813-kube-api-access-z24sf\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.072979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.073044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.073089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-public-tls-certs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.073126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c4055bb-10f7-45d3-a0e1-0a70629f1813-logs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.077925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.079224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-config-data\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.087736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-public-tls-certs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.088496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-internal-tls-certs\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.099226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z24sf\" (UniqueName: \"kubernetes.io/projected/2c4055bb-10f7-45d3-a0e1-0a70629f1813-kube-api-access-z24sf\") pod \"nova-api-0\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.286381 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7346c3c9-e282-4628-a1e8-37db52e4356c" path="/var/lib/kubelet/pods/7346c3c9-e282-4628-a1e8-37db52e4356c/volumes" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.287302 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd45d601-20a0-46b5-8018-47da698db08b" path="/var/lib/kubelet/pods/cd45d601-20a0-46b5-8018-47da698db08b/volumes" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.328246 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.749835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a0d74e83-a8b1-480f-8afb-b8ff9464350d","Type":"ContainerStarted","Data":"00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f"} Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.750184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a0d74e83-a8b1-480f-8afb-b8ff9464350d","Type":"ContainerStarted","Data":"e290c9d62079d7f5b97a4f88941b8ba4ec7924e61b76459cb9de2a75e5d0ef09"} Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.755087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerStarted","Data":"fa17db7dda109607250ffcf2848b4eb8c590c6c8c657e77f08a21cde6c71544c"} Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.767381 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.767348453 podStartE2EDuration="2.767348453s" podCreationTimestamp="2025-11-21 12:46:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:46:21.765415691 +0000 UTC m=+3340.466077579" watchObservedRunningTime="2025-11-21 12:46:21.767348453 +0000 UTC m=+3340.468010301" Nov 21 12:46:21 crc kubenswrapper[4769]: I1121 12:46:21.827568 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.277650 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:46:22 crc kubenswrapper[4769]: E1121 12:46:22.278511 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.773474 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerStarted","Data":"922026f24477774d131d19141cf1ed82430246c1c8751339467c909f4f231e6e"} Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.773629 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.777296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2c4055bb-10f7-45d3-a0e1-0a70629f1813","Type":"ContainerStarted","Data":"18d68e0ceba5d92cca0d815cffc64f84ca5574b67046925d76df13fff47bcfd2"} Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.777332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2c4055bb-10f7-45d3-a0e1-0a70629f1813","Type":"ContainerStarted","Data":"9aa63d7878d435b8c9508e2d472b50b0aa84bef0e411533648bc4dc50cc49174"} Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.777343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2c4055bb-10f7-45d3-a0e1-0a70629f1813","Type":"ContainerStarted","Data":"6cf658a7355d8e5820fdd7fa8d66aa4e48efc57f5d7595a6b2eaa90c2c429095"} Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.814396 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.960593742 podStartE2EDuration="5.814353053s" podCreationTimestamp="2025-11-21 12:46:17 +0000 UTC" firstStartedPulling="2025-11-21 12:46:18.607568127 +0000 UTC m=+3337.308229945" lastFinishedPulling="2025-11-21 12:46:22.461327448 +0000 UTC m=+3341.161989256" observedRunningTime="2025-11-21 12:46:22.804530728 +0000 UTC m=+3341.505192546" watchObservedRunningTime="2025-11-21 12:46:22.814353053 +0000 UTC m=+3341.515014951" Nov 21 12:46:22 crc kubenswrapper[4769]: I1121 12:46:22.846607 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.846582133 podStartE2EDuration="2.846582133s" podCreationTimestamp="2025-11-21 12:46:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:46:22.84647113 +0000 UTC m=+3341.547132998" watchObservedRunningTime="2025-11-21 12:46:22.846582133 +0000 UTC m=+3341.547243951" Nov 21 12:46:23 crc kubenswrapper[4769]: I1121 12:46:23.160878 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:23 crc kubenswrapper[4769]: I1121 12:46:23.161000 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:25 crc kubenswrapper[4769]: I1121 12:46:25.299349 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:28 crc kubenswrapper[4769]: I1121 12:46:28.160921 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:28 crc kubenswrapper[4769]: I1121 12:46:28.161644 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:29 crc kubenswrapper[4769]: I1121 12:46:29.175420 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.42:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:29 crc kubenswrapper[4769]: I1121 12:46:29.175480 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.42:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:30 crc kubenswrapper[4769]: I1121 12:46:30.281955 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:30 crc kubenswrapper[4769]: I1121 12:46:30.323310 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:30 crc kubenswrapper[4769]: I1121 12:46:30.940095 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:46:31 crc kubenswrapper[4769]: I1121 12:46:31.332263 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:31 crc kubenswrapper[4769]: I1121 12:46:31.333163 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:32 crc kubenswrapper[4769]: I1121 12:46:32.362605 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.44:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:32 crc kubenswrapper[4769]: I1121 12:46:32.362711 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.44:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:46:33 crc kubenswrapper[4769]: I1121 12:46:33.287301 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:46:33 crc kubenswrapper[4769]: E1121 12:46:33.288242 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:46:38 crc kubenswrapper[4769]: I1121 12:46:38.169157 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:38 crc kubenswrapper[4769]: I1121 12:46:38.170360 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:38 crc kubenswrapper[4769]: I1121 12:46:38.180696 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:39 crc kubenswrapper[4769]: I1121 12:46:39.093750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:46:41 crc kubenswrapper[4769]: I1121 12:46:41.342590 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:41 crc kubenswrapper[4769]: I1121 12:46:41.343132 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:41 crc kubenswrapper[4769]: I1121 12:46:41.343988 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:41 crc kubenswrapper[4769]: I1121 12:46:41.344025 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:41 crc kubenswrapper[4769]: I1121 12:46:41.357926 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:41 crc kubenswrapper[4769]: I1121 12:46:41.359223 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:46:48 crc kubenswrapper[4769]: I1121 12:46:48.098430 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:48 crc kubenswrapper[4769]: I1121 12:46:48.274272 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:46:50 crc kubenswrapper[4769]: I1121 12:46:50.245582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"6450126284f2853982969dd408b7da0c051c6c8c0e976974a4cad5517598b69f"} Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.239581 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.253014 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.253224 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" containerName="openstackclient" containerID="cri-o://93ac65b5ac031fb778736d51bfd33e6eb245d89d3d9c2d7bc36b1b5e9626ae10" gracePeriod=2 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.266932 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:46:52 crc kubenswrapper[4769]: E1121 12:46:52.372358 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:59090->38.102.83.227:40411: write tcp 38.102.83.227:59090->38.102.83.227:40411: write: broken pipe Nov 21 12:46:52 crc kubenswrapper[4769]: E1121 12:46:52.397855 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:46:52 crc kubenswrapper[4769]: E1121 12:46:52.397930 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data podName:358ea7e8-fdf4-4096-948a-a1cd27a5a1c1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:52.897911136 +0000 UTC m=+3371.598572944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data") pod "rabbitmq-server-0" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1") : configmap "rabbitmq-config-data" not found Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.452716 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.453351 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="openstack-network-exporter" containerID="cri-o://13c24a98bc571e8e1ca4c437716301b6c19f9a64c5b50b0c56b0b27509c3ef2c" gracePeriod=300 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.551851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.554353 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="openstack-network-exporter" containerID="cri-o://38ad069447ecdb6e7a4a1186e4b5dcce107d38add2358a2e635e60c7ebce8983" gracePeriod=300 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.708986 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.709347 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="ovn-northd" containerID="cri-o://e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" gracePeriod=30 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.709499 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="openstack-network-exporter" containerID="cri-o://8d0ac4a600f17c5430fd4fd9c4f8de99d52a03fde923500cecb363fad63912dc" gracePeriod=30 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.753358 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="ovsdbserver-nb" containerID="cri-o://d06659096c9419a370874ec900e948f82869a0846513d931db41a01bc043a1e1" gracePeriod=300 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.774740 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement6868-account-delete-wmplj"] Nov 21 12:46:52 crc kubenswrapper[4769]: E1121 12:46:52.775403 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" containerName="openstackclient" Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.775417 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" containerName="openstackclient" Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.775820 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" containerName="openstackclient" Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.777610 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.782922 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="ovsdbserver-sb" containerID="cri-o://dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189" gracePeriod=300 Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.846889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement6868-account-delete-wmplj"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.921442 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder37fb-account-delete-6brjl"] Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.923179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.943507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts\") pod \"placement6868-account-delete-wmplj\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.943596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjwvr\" (UniqueName: \"kubernetes.io/projected/18d3919f-40c4-42fe-9bbb-86abb8b181a1-kube-api-access-xjwvr\") pod \"placement6868-account-delete-wmplj\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:52 crc kubenswrapper[4769]: E1121 12:46:52.943761 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:46:52 crc kubenswrapper[4769]: E1121 12:46:52.943807 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data podName:358ea7e8-fdf4-4096-948a-a1cd27a5a1c1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:53.943790455 +0000 UTC m=+3372.644452273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data") pod "rabbitmq-server-0" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1") : configmap "rabbitmq-config-data" not found Nov 21 12:46:52 crc kubenswrapper[4769]: I1121 12:46:52.958691 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder37fb-account-delete-6brjl"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.013299 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glanceca0f-account-delete-jjz99"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.016032 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glanceca0f-account-delete-jjz99"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.016212 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.047277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkjcj\" (UniqueName: \"kubernetes.io/projected/3943fea7-7c63-4205-95fd-f1a5587b6269-kube-api-access-zkjcj\") pod \"cinder37fb-account-delete-6brjl\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.047354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts\") pod \"placement6868-account-delete-wmplj\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.047425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts\") pod \"cinder37fb-account-delete-6brjl\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.047455 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xjwvr\" (UniqueName: \"kubernetes.io/projected/18d3919f-40c4-42fe-9bbb-86abb8b181a1-kube-api-access-xjwvr\") pod \"placement6868-account-delete-wmplj\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.048732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts\") pod \"placement6868-account-delete-wmplj\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.048820 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.067672 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f6jrf"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.099598 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f6jrf"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.154178 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4xxj\" (UniqueName: \"kubernetes.io/projected/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-kube-api-access-z4xxj\") pod \"glanceca0f-account-delete-jjz99\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.155710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zkjcj\" (UniqueName: \"kubernetes.io/projected/3943fea7-7c63-4205-95fd-f1a5587b6269-kube-api-access-zkjcj\") pod \"cinder37fb-account-delete-6brjl\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.157761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts\") pod \"cinder37fb-account-delete-6brjl\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.157851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts\") pod \"glanceca0f-account-delete-jjz99\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.157943 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.157982 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data podName:8ba57a49-8363-41c4-b411-40dcff3a84b1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:53.657968804 +0000 UTC m=+3372.358630612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data") pod "rabbitmq-cell1-server-0" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.158695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts\") pod \"cinder37fb-account-delete-6brjl\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.169768 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gtxxc"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.214494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjwvr\" (UniqueName: \"kubernetes.io/projected/18d3919f-40c4-42fe-9bbb-86abb8b181a1-kube-api-access-xjwvr\") pod \"placement6868-account-delete-wmplj\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.233590 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-gtxxc"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.268778 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts\") pod \"glanceca0f-account-delete-jjz99\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.278500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z4xxj\" (UniqueName: \"kubernetes.io/projected/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-kube-api-access-z4xxj\") pod \"glanceca0f-account-delete-jjz99\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.274450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts\") pod \"glanceca0f-account-delete-jjz99\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.345746 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.371224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkjcj\" (UniqueName: \"kubernetes.io/projected/3943fea7-7c63-4205-95fd-f1a5587b6269-kube-api-access-zkjcj\") pod \"cinder37fb-account-delete-6brjl\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.388592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.389411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4xxj\" (UniqueName: \"kubernetes.io/projected/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-kube-api-access-z4xxj\") pod \"glanceca0f-account-delete-jjz99\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.407890 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fab6c98-700a-4db9-9d2f-073777822c73" path="/var/lib/kubelet/pods/3fab6c98-700a-4db9-9d2f-073777822c73/volumes" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.408762 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6806d38c-af44-4215-94da-a24176d6e8f2" path="/var/lib/kubelet/pods/6806d38c-af44-4215-94da-a24176d6e8f2/volumes" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.435551 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-2z2jt"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.467307 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican8f44-account-delete-r5kbv"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.468182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.470003 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.471494 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.484747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-2z2jt"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.578846 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_80b2eb72-37b4-4511-975a-2434e80375e9/ovsdbserver-sb/0.log" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.579212 4769 generic.go:334] "Generic (PLEG): container finished" podID="80b2eb72-37b4-4511-975a-2434e80375e9" containerID="38ad069447ecdb6e7a4a1186e4b5dcce107d38add2358a2e635e60c7ebce8983" exitCode=2 Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.582470 4769 generic.go:334] "Generic (PLEG): container finished" podID="80b2eb72-37b4-4511-975a-2434e80375e9" containerID="dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189" exitCode=143 Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.582548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"80b2eb72-37b4-4511-975a-2434e80375e9","Type":"ContainerDied","Data":"38ad069447ecdb6e7a4a1186e4b5dcce107d38add2358a2e635e60c7ebce8983"} Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.582576 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"80b2eb72-37b4-4511-975a-2434e80375e9","Type":"ContainerDied","Data":"dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189"} Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.616795 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutronc15e-account-delete-vvw9t"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.618063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.624823 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7648f0d3-f29e-4add-8c77-b245d309acfb/ovsdbserver-nb/0.log" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.625708 4769 generic.go:334] "Generic (PLEG): container finished" podID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerID="13c24a98bc571e8e1ca4c437716301b6c19f9a64c5b50b0c56b0b27509c3ef2c" exitCode=2 Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.629528 4769 generic.go:334] "Generic (PLEG): container finished" podID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerID="d06659096c9419a370874ec900e948f82869a0846513d931db41a01bc043a1e1" exitCode=143 Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.625977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7648f0d3-f29e-4add-8c77-b245d309acfb","Type":"ContainerDied","Data":"13c24a98bc571e8e1ca4c437716301b6c19f9a64c5b50b0c56b0b27509c3ef2c"} Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.629792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7648f0d3-f29e-4add-8c77-b245d309acfb","Type":"ContainerDied","Data":"d06659096c9419a370874ec900e948f82869a0846513d931db41a01bc043a1e1"} Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc9sv\" (UniqueName: \"kubernetes.io/projected/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-kube-api-access-rc9sv\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-utilities\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qz8\" (UniqueName: \"kubernetes.io/projected/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-kube-api-access-b2qz8\") pod \"neutronc15e-account-delete-vvw9t\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fg2v\" (UniqueName: \"kubernetes.io/projected/3da71fd1-0ca1-4e28-b702-d2fb5665627c-kube-api-access-8fg2v\") pod \"barbican8f44-account-delete-r5kbv\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts\") pod \"barbican8f44-account-delete-r5kbv\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-catalog-content\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.647929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts\") pod \"neutronc15e-account-delete-vvw9t\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.667111 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican8f44-account-delete-r5kbv"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.689554 4769 generic.go:334] "Generic (PLEG): container finished" podID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerID="8d0ac4a600f17c5430fd4fd9c4f8de99d52a03fde923500cecb363fad63912dc" exitCode=2 Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.689608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"10edbd41-2f31-466a-94be-9b0d3bf334d8","Type":"ContainerDied","Data":"8d0ac4a600f17c5430fd4fd9c4f8de99d52a03fde923500cecb363fad63912dc"} Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.702317 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.703519 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="e59628c3-2e82-4f0c-a148-66ea1e85edca" containerName="kube-state-metrics" containerID="cri-o://169f6f0dc7f9175300da2ec97a1d9938bda7b7301f2f9d48cbd6fb6270944bc7" gracePeriod=30 Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.722348 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-9kqsk"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.739780 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronc15e-account-delete-vvw9t"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.751147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rc9sv\" (UniqueName: \"kubernetes.io/projected/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-kube-api-access-rc9sv\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.763482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-utilities\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.763741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qz8\" (UniqueName: \"kubernetes.io/projected/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-kube-api-access-b2qz8\") pod \"neutronc15e-account-delete-vvw9t\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.763875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8fg2v\" (UniqueName: \"kubernetes.io/projected/3da71fd1-0ca1-4e28-b702-d2fb5665627c-kube-api-access-8fg2v\") pod \"barbican8f44-account-delete-r5kbv\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.764034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts\") pod \"barbican8f44-account-delete-r5kbv\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.764121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-catalog-content\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.764241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts\") pod \"neutronc15e-account-delete-vvw9t\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.766528 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.766624 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data podName:8ba57a49-8363-41c4-b411-40dcff3a84b1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:54.766597506 +0000 UTC m=+3373.467259324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data") pod "rabbitmq-cell1-server-0" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.774097 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-9kqsk"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.775883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts\") pod \"barbican8f44-account-delete-r5kbv\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.788156 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts\") pod \"neutronc15e-account-delete-vvw9t\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.814471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-utilities\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.815343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc9sv\" (UniqueName: \"kubernetes.io/projected/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-kube-api-access-rc9sv\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.815476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-catalog-content\") pod \"redhat-operators-2z2jt\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.826069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fg2v\" (UniqueName: \"kubernetes.io/projected/3da71fd1-0ca1-4e28-b702-d2fb5665627c-kube-api-access-8fg2v\") pod \"barbican8f44-account-delete-r5kbv\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.841089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qz8\" (UniqueName: \"kubernetes.io/projected/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-kube-api-access-b2qz8\") pod \"neutronc15e-account-delete-vvw9t\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.866867 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.881400 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-n9wnv"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.892134 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-n9wnv"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.907233 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-m4mp9"] Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.908864 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189 is running failed: container process not found" containerID="dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.909144 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189 is running failed: container process not found" containerID="dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.909366 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189 is running failed: container process not found" containerID="dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.909395 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="ovsdbserver-sb" Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.913469 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-m4mp9"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.927420 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p"] Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.933297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-5hk6p"] Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.972281 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:46:53 crc kubenswrapper[4769]: E1121 12:46:53.972350 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data podName:358ea7e8-fdf4-4096-948a-a1cd27a5a1c1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:55.972335026 +0000 UTC m=+3374.672996844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data") pod "rabbitmq-server-0" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1") : configmap "rabbitmq-config-data" not found Nov 21 12:46:53 crc kubenswrapper[4769]: I1121 12:46:53.974114 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.045783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.063836 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.066481 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.133272 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.192262 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi4224-account-delete-kcwdp"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.195003 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.205326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6zn\" (UniqueName: \"kubernetes.io/projected/29bef206-0bc0-43a4-9fc3-f8382be7ea45-kube-api-access-ht6zn\") pod \"novacell0b8ba-account-delete-ngs4m\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.205450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts\") pod \"novacell0b8ba-account-delete-ngs4m\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.307021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37ce1474-d401-43fc-9e17-4e5691d2b451-operator-scripts\") pod \"novaapi4224-account-delete-kcwdp\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.307061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frdnn\" (UniqueName: \"kubernetes.io/projected/37ce1474-d401-43fc-9e17-4e5691d2b451-kube-api-access-frdnn\") pod \"novaapi4224-account-delete-kcwdp\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.307091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts\") pod \"novacell0b8ba-account-delete-ngs4m\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.312573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6zn\" (UniqueName: \"kubernetes.io/projected/29bef206-0bc0-43a4-9fc3-f8382be7ea45-kube-api-access-ht6zn\") pod \"novacell0b8ba-account-delete-ngs4m\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.314080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts\") pod \"novacell0b8ba-account-delete-ngs4m\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.316137 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_80b2eb72-37b4-4511-975a-2434e80375e9/ovsdbserver-sb/0.log" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.316259 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.365357 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi4224-account-delete-kcwdp"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.370594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6zn\" (UniqueName: \"kubernetes.io/projected/29bef206-0bc0-43a4-9fc3-f8382be7ea45-kube-api-access-ht6zn\") pod \"novacell0b8ba-account-delete-ngs4m\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.399435 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.414698 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hdssz"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.417901 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.417948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-config\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.418182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-metrics-certs-tls-certs\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.418239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-combined-ca-bundle\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.418268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-scripts\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.418322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxrp5\" (UniqueName: \"kubernetes.io/projected/80b2eb72-37b4-4511-975a-2434e80375e9-kube-api-access-bxrp5\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.418421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdbserver-sb-tls-certs\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.418505 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdb-rundir\") pod \"80b2eb72-37b4-4511-975a-2434e80375e9\" (UID: \"80b2eb72-37b4-4511-975a-2434e80375e9\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.421412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-scripts" (OuterVolumeSpecName: "scripts") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.421796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.422043 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-config" (OuterVolumeSpecName: "config") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.423621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37ce1474-d401-43fc-9e17-4e5691d2b451-operator-scripts\") pod \"novaapi4224-account-delete-kcwdp\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.423977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-frdnn\" (UniqueName: \"kubernetes.io/projected/37ce1474-d401-43fc-9e17-4e5691d2b451-kube-api-access-frdnn\") pod \"novaapi4224-account-delete-kcwdp\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.424225 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.424238 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.424250 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80b2eb72-37b4-4511-975a-2434e80375e9-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.424555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80b2eb72-37b4-4511-975a-2434e80375e9-kube-api-access-bxrp5" (OuterVolumeSpecName: "kube-api-access-bxrp5") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "kube-api-access-bxrp5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.426804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37ce1474-d401-43fc-9e17-4e5691d2b451-operator-scripts\") pod \"novaapi4224-account-delete-kcwdp\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.437606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.444623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77cdbfb47d-zxg6d"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.444910 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-log" containerID="cri-o://b9b55ae79098551e9db710cb10db51d68298684e3c1142e64326952f537d2852" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.445301 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-api" containerID="cri-o://ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.476464 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-87crh"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.490695 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-87crh"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.498355 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.498819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="cinder-scheduler" containerID="cri-o://f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.499058 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="probe" containerID="cri-o://aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.510544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-frdnn\" (UniqueName: \"kubernetes.io/projected/37ce1474-d401-43fc-9e17-4e5691d2b451-kube-api-access-frdnn\") pod \"novaapi4224-account-delete-kcwdp\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.528156 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bxrp5\" (UniqueName: \"kubernetes.io/projected/80b2eb72-37b4-4511-975a-2434e80375e9-kube-api-access-bxrp5\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.528212 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.529498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.529979 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-server" containerID="cri-o://a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530481 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="swift-recon-cron" containerID="cri-o://88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530539 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="rsync" containerID="cri-o://564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530577 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-expirer" containerID="cri-o://34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530612 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-updater" containerID="cri-o://bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530658 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-auditor" containerID="cri-o://0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530711 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-replicator" containerID="cri-o://a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530746 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-server" containerID="cri-o://71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530778 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-updater" containerID="cri-o://20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530809 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-auditor" containerID="cri-o://d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-replicator" containerID="cri-o://1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530875 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-server" containerID="cri-o://7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530903 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-reaper" containerID="cri-o://64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530931 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-auditor" containerID="cri-o://7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.530958 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-replicator" containerID="cri-o://e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.545048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.571844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.617233 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.617717 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.625482 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.626052 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-log" containerID="cri-o://30ff22077c52b23945531587c6ab17c12f5dace9b120813b6ae1b86f680ee1cc" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.626502 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-httpd" containerID="cri-o://4c28531219c8efbaa37de55e1d8eed2042fb62ab2c238f6bf4c4988a3a8f43d7" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.645573 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.645611 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.681180 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.681457 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api-log" containerID="cri-o://0220fa21ea5b11a9c3a0df2b8315ef935464c5bb63f37079b7b694d11055311d" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.681910 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api" containerID="cri-o://970ed70182aee5ce4e2e0a18af5f95caf9f7fe5a886215c9d7cd9823d6abc38d" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.753347 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q"] Nov 21 12:46:54 crc kubenswrapper[4769]: E1121 12:46:54.753834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="ovsdbserver-sb" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.753846 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="ovsdbserver-sb" Nov 21 12:46:54 crc kubenswrapper[4769]: E1121 12:46:54.753880 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="openstack-network-exporter" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.753887 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="openstack-network-exporter" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.754082 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="openstack-network-exporter" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.754110 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" containerName="ovsdbserver-sb" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.755117 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.766086 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.800897 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.801231 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-central-agent" containerID="cri-o://e64383e9e28b8793e25f3e0cf88d3784c0f6f3d62df9ed582de13f9a54939bd3" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.801347 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="sg-core" containerID="cri-o://fa17db7dda109607250ffcf2848b4eb8c590c6c8c657e77f08a21cde6c71544c" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.801358 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="proxy-httpd" containerID="cri-o://922026f24477774d131d19141cf1ed82430246c1c8751339467c909f4f231e6e" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.801380 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-notification-agent" containerID="cri-o://8cb918195a2da496d4cebc90d283625185cdf93939a6a1a014af5c164ec23e6e" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.801239 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7648f0d3-f29e-4add-8c77-b245d309acfb/ovsdbserver-nb/0.log" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.801635 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.806866 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerID="b9b55ae79098551e9db710cb10db51d68298684e3c1142e64326952f537d2852" exitCode=143 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.806920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" event={"ID":"2bed045d-dcfa-4235-a778-cc12b3ee6a6c","Type":"ContainerDied","Data":"b9b55ae79098551e9db710cb10db51d68298684e3c1142e64326952f537d2852"} Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.816507 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.816759 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-log" containerID="cri-o://97a9e19b11e737a04c0983227e24c3355c7fc97cbc953b01c547aa972f3b1445" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.816904 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-httpd" containerID="cri-o://2f7f7f98a870dbf12ccacfebdd086b9adde83dc9bb77deff51dfff3258774418" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.854942 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.855027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz7zl\" (UniqueName: \"kubernetes.io/projected/74667797-02dc-4a11-95fe-97d24a539e51-kube-api-access-mz7zl\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.855053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: E1121 12:46:54.855164 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:54 crc kubenswrapper[4769]: E1121 12:46:54.855212 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data podName:8ba57a49-8363-41c4-b411-40dcff3a84b1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:56.855199098 +0000 UTC m=+3375.555860916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data") pod "rabbitmq-cell1-server-0" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.866304 4769 generic.go:334] "Generic (PLEG): container finished" podID="e59628c3-2e82-4f0c-a148-66ea1e85edca" containerID="169f6f0dc7f9175300da2ec97a1d9938bda7b7301f2f9d48cbd6fb6270944bc7" exitCode=2 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.866406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e59628c3-2e82-4f0c-a148-66ea1e85edca","Type":"ContainerDied","Data":"169f6f0dc7f9175300da2ec97a1d9938bda7b7301f2f9d48cbd6fb6270944bc7"} Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.884871 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5885cb869d-qjsvb"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.885223 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-api" containerID="cri-o://7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.885351 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-httpd" containerID="cri-o://e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.903728 4769 generic.go:334] "Generic (PLEG): container finished" podID="16871c90-c542-47f1-b528-6d2384b9bcd0" containerID="93ac65b5ac031fb778736d51bfd33e6eb245d89d3d9c2d7bc36b1b5e9626ae10" exitCode=137 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.904233 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.904471 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-log" containerID="cri-o://9aa63d7878d435b8c9508e2d472b50b0aa84bef0e411533648bc4dc50cc49174" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.904849 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-api" containerID="cri-o://18d68e0ceba5d92cca0d815cffc64f84ca5574b67046925d76df13fff47bcfd2" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.926776 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.932396 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerName="nova-scheduler-scheduler" containerID="cri-o://00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.944175 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_80b2eb72-37b4-4511-975a-2434e80375e9/ovsdbserver-sb/0.log" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.944263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"80b2eb72-37b4-4511-975a-2434e80375e9","Type":"ContainerDied","Data":"eb805fc57467c9249bb4dec8c48f0cc5f3f70f1dab5d498df5def196a7a99760"} Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.944299 4769 scope.go:117] "RemoveContainer" containerID="38ad069447ecdb6e7a4a1186e4b5dcce107d38add2358a2e635e60c7ebce8983" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.944446 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.959409 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.966949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-combined-ca-bundle\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967232 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdbserver-nb-tls-certs\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jq9\" (UniqueName: \"kubernetes.io/projected/7648f0d3-f29e-4add-8c77-b245d309acfb-kube-api-access-q7jq9\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967320 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-config\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdb-rundir\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967431 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-metrics-certs-tls-certs\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-scripts\") pod \"7648f0d3-f29e-4add-8c77-b245d309acfb\" (UID: \"7648f0d3-f29e-4add-8c77-b245d309acfb\") " Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967829 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mz7zl\" (UniqueName: \"kubernetes.io/projected/74667797-02dc-4a11-95fe-97d24a539e51-kube-api-access-mz7zl\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.967860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.969535 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh"] Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.969764 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-httpd" containerID="cri-o://5e37766e0cc8f0454c5e8ceb91238c3d60d326c7563a0d29d8febda4bf390814" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.969906 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-server" containerID="cri-o://c22b152459ac64dcc18bc3a178f69f96bcf6eb13092d379e4b03db1548875160" gracePeriod=30 Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.971038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-scripts" (OuterVolumeSpecName: "scripts") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.971270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.972065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-config" (OuterVolumeSpecName: "config") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.972983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.977280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.992780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.992964 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7648f0d3-f29e-4add-8c77-b245d309acfb/ovsdbserver-nb/0.log" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.993067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7648f0d3-f29e-4add-8c77-b245d309acfb","Type":"ContainerDied","Data":"3f1cc8f8795163051aa242bc238104284e259fbbd981d8ec2a8974b8525d4817"} Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.993214 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:46:54 crc kubenswrapper[4769]: I1121 12:46:54.998895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz7zl\" (UniqueName: \"kubernetes.io/projected/74667797-02dc-4a11-95fe-97d24a539e51-kube-api-access-mz7zl\") pod \"dnsmasq-dnsmasq-84b9f45d47-fqf5q\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.005919 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.006447 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-log" containerID="cri-o://6c5df0f5565a0a8e26abaec9f5e0baacef7b8dc82ff4bd1b27c945357f6e89de" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.006718 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-metadata" containerID="cri-o://b37dd98fa6bdd1e416c4efa33b95a2376a102e8ec9992a969e3acb0389717f44" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.021003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7648f0d3-f29e-4add-8c77-b245d309acfb-kube-api-access-q7jq9" (OuterVolumeSpecName: "kube-api-access-q7jq9") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "kube-api-access-q7jq9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.022042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.023926 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.040795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.045049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "80b2eb72-37b4-4511-975a-2434e80375e9" (UID: "80b2eb72-37b4-4511-975a-2434e80375e9"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.057546 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.057957 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker-log" containerID="cri-o://422269e23c92dba5a740e096f70b861938f38d732472b1771370d1a725668bdc" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.058349 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker" containerID="cri-o://49bc58f1831922623e18c3eb5c0bcf86a02b029c43c0c21eb6d1776361d42264" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.061366 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="rabbitmq" containerID="cri-o://9e2e1cc67c6aa2e34674953ae3b8c63657f8647ec532fa841a91efb8df6a4e32" gracePeriod=604800 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.081880 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082401 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082760 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082783 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082794 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/80b2eb72-37b4-4511-975a-2434e80375e9-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082803 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q7jq9\" (UniqueName: \"kubernetes.io/projected/7648f0d3-f29e-4add-8c77-b245d309acfb-kube-api-access-q7jq9\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082812 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7648f0d3-f29e-4add-8c77-b245d309acfb-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082820 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.082845 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.099794 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.100031 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api-log" containerID="cri-o://3f6cc4b6ffc17a62e421e7a52b3224ce48159a28e12100f0bd18bfaf15f4b93f" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.101091 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api" containerID="cri-o://30cc782af112ceea951508724584bd46c90baf4a451c6d555408ea545c2d69cb" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.105488 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.105848 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener-log" containerID="cri-o://b3c83b15f3932426877c440dd7e11ad9cc8e803b59286cb80e88df7c49803066" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.106210 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener" containerID="cri-o://3b6e58bf8cdbcf61e584df01168d1f8db62aaff6bb9436e2b866a33414e50430" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.138247 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-kz486"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.148403 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-kz486"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.175734 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.180935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.184134 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.186393 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-86a5-account-create-nr42x"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.203591 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone2f46-account-delete-2hg6v"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.204801 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="openstack-network-exporter" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.204821 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="openstack-network-exporter" Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.204890 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="ovsdbserver-nb" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.204898 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="ovsdbserver-nb" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.205614 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="openstack-network-exporter" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.205637 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" containerName="ovsdbserver-nb" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.206869 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.230832 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone2f46-account-delete-2hg6v"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.250810 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.251093 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" containerName="nova-cell0-conductor-conductor" containerID="cri-o://587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.292407 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.294435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-557dk\" (UniqueName: \"kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.294684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.294863 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.295822 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.310545 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.336785 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.337112 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerName="nova-scheduler-scheduler" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.387322 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a8d81f-ec12-4073-abad-8023c585e9c7" path="/var/lib/kubelet/pods/11a8d81f-ec12-4073-abad-8023c585e9c7/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.395138 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ec7f1b-5b49-4021-9476-25004c7684be" path="/var/lib/kubelet/pods/25ec7f1b-5b49-4021-9476-25004c7684be/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.399083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-557dk\" (UniqueName: \"kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.399234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.399398 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.399449 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:46:55.899433132 +0000 UTC m=+3374.600094950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : configmap "openstack-scripts" not found Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.407614 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4488e602-68fa-4259-987c-2279513c4394" path="/var/lib/kubelet/pods/4488e602-68fa-4259-987c-2279513c4394/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.408306 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494df0d7-41ee-40f2-9711-ad9f06bca57a" path="/var/lib/kubelet/pods/494df0d7-41ee-40f2-9711-ad9f06bca57a/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.409082 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9940ebf1-4095-4094-ac9c-65d923a749d3" path="/var/lib/kubelet/pods/9940ebf1-4095-4094-ac9c-65d923a749d3/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.411779 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14c7d34-ee99-42ca-bfe4-03af16191085" path="/var/lib/kubelet/pods/b14c7d34-ee99-42ca-bfe4-03af16191085/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.411813 4769 projected.go:194] Error preparing data for projected volume kube-api-access-557dk for pod openstack-kuttl-tests/keystone2f46-account-delete-2hg6v: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.411887 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:46:55.911866188 +0000 UTC m=+3374.612528006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-557dk" (UniqueName: "kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.412396 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c48ca4-3d73-4082-b79a-3bb6673e5241" path="/var/lib/kubelet/pods/d0c48ca4-3d73-4082-b79a-3bb6673e5241/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.416236 4769 scope.go:117] "RemoveContainer" containerID="dc9b2e4bfabf03efbd439217e6bc5fbe645420b3b00e1e4ef8c2bf0babc39189" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.420812 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06" path="/var/lib/kubelet/pods/e771b9d9-e8bc-4ab4-b05b-e66f3ae8fd06/volumes" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.443079 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.443113 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.443311 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="ee849839-867d-45a9-8078-2d530cd62ff7" containerName="nova-cell1-conductor-conductor" containerID="cri-o://b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.443760 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="82907629-360d-4481-86ed-2d4abb75ecff" containerName="galera" containerID="cri-o://f8951fb0205b9b418476b216d36f63087f35f7d86fce2af42515b76e7151687c" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.448895 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.474976 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-72dgz"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.487328 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-r9slj"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.494937 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.503259 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.503569 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://c44b3e5451855a61065e3bc9d86fade0455d8776d80e8c21a3fbf0c80d547ebc" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.513946 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.514170 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="b5d4b44e-5548-4cdb-a2ac-6192fec95c43" containerName="memcached" containerID="cri-o://faac91ebebab06a02c43aae579e4b27c115b8f34801002ff38acd386b6bf5adf" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.515440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "7648f0d3-f29e-4add-8c77-b245d309acfb" (UID: "7648f0d3-f29e-4add-8c77-b245d309acfb"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.528981 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dx2cg"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.530044 4769 scope.go:117] "RemoveContainer" containerID="13c24a98bc571e8e1ca4c437716301b6c19f9a64c5b50b0c56b0b27509c3ef2c" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.534821 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dx2cg"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.541394 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-87d4x"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.543831 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.552043 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.556304 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-87d4x"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.556497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="rabbitmq" containerID="cri-o://4f3e3f2c1093f3f0b105c93aca74f71deb6ddf2bcd3d804498f0643b36a63f44" gracePeriod=604800 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.564265 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-77c6665cf8-s6vm9"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.564645 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" podUID="f8c3fc37-e777-4549-b153-ad4965d13a8a" containerName="keystone-api" containerID="cri-o://9aefa9d52d14027efe0407875f87a49569f3107d82fda1cdb5c326040e5fb813" gracePeriod=30 Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.570306 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.578976 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement6868-account-delete-wmplj"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.587265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder37fb-account-delete-6brjl"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.588131 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.588218 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="ovn-northd" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.618703 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7648f0d3-f29e-4add-8c77-b245d309acfb-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.630620 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glanceca0f-account-delete-jjz99"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.702802 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.720638 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.726994 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican8f44-account-delete-r5kbv"] Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.791574 4769 scope.go:117] "RemoveContainer" containerID="d06659096c9419a370874ec900e948f82869a0846513d931db41a01bc043a1e1" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.928311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.928727 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-557dk\" (UniqueName: \"kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.929150 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.929241 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:46:56.929176396 +0000 UTC m=+3375.629838214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : configmap "openstack-scripts" not found Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.939894 4769 projected.go:194] Error preparing data for projected volume kube-api-access-557dk for pod openstack-kuttl-tests/keystone2f46-account-delete-2hg6v: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:55 crc kubenswrapper[4769]: E1121 12:46:55.939963 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:46:56.939944726 +0000 UTC m=+3375.640606544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-557dk" (UniqueName: "kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:55 crc kubenswrapper[4769]: I1121 12:46:55.967380 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronc15e-account-delete-vvw9t"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.005220 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-2z2jt"] Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.033329 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.033387 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data podName:358ea7e8-fdf4-4096-948a-a1cd27a5a1c1 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:00.033372467 +0000 UTC m=+3378.734034285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data") pod "rabbitmq-server-0" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1") : configmap "rabbitmq-config-data" not found Nov 21 12:46:56 crc kubenswrapper[4769]: W1121 12:46:56.053333 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe87338c_6ebd_46a9_8740_3f6b3b5e2d26.slice/crio-54885e320f5117c37d4755a6fad138b321e5c9be75914cd7978aca766f2e4f4b WatchSource:0}: Error finding container 54885e320f5117c37d4755a6fad138b321e5c9be75914cd7978aca766f2e4f4b: Status 404 returned error can't find the container with id 54885e320f5117c37d4755a6fad138b321e5c9be75914cd7978aca766f2e4f4b Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.061781 4769 generic.go:334] "Generic (PLEG): container finished" podID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerID="e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.061839 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" event={"ID":"324118dd-eff5-47ce-aae2-ab2155ab1bd8","Type":"ContainerDied","Data":"e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.074216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" event={"ID":"18d3919f-40c4-42fe-9bbb-86abb8b181a1","Type":"ContainerStarted","Data":"be97def5348d47a887d2159ca316cdd7a98bcb7c08178011edbd11d789e86297"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.095971 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e59628c3-2e82-4f0c-a148-66ea1e85edca","Type":"ContainerDied","Data":"60ab61612c450cba5013dba91347c0aa13bba14e2904a8af2801844890f3d13b"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.096011 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60ab61612c450cba5013dba91347c0aa13bba14e2904a8af2801844890f3d13b" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.100308 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerID="30ff22077c52b23945531587c6ab17c12f5dace9b120813b6ae1b86f680ee1cc" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.100358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad3fd932-0bbe-42b5-82d0-a7c427395cf6","Type":"ContainerDied","Data":"30ff22077c52b23945531587c6ab17c12f5dace9b120813b6ae1b86f680ee1cc"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.108768 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerName="galera" containerID="cri-o://c35464a3e65222fb30957342ae0556146a82822c4f11ec90d17fe91d69203acc" gracePeriod=30 Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.127545 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.134912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" event={"ID":"3da71fd1-0ca1-4e28-b702-d2fb5665627c","Type":"ContainerStarted","Data":"d86982ec2920d3514b17a7c005af04b913b050258c317ac430aa68eb52e0c459"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.148263 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.151822 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.154630 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.166816 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.166880 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" containerName="nova-cell0-conductor-conductor" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.172070 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.175331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199688 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199715 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199722 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199728 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199735 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199742 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199749 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199756 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199763 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199770 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199776 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199783 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199789 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199796 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.199977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.211598 4769 generic.go:334] "Generic (PLEG): container finished" podID="229177f2-bc85-4c53-86e2-9daab3200250" containerID="0220fa21ea5b11a9c3a0df2b8315ef935464c5bb63f37079b7b694d11055311d" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.211671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"229177f2-bc85-4c53-86e2-9daab3200250","Type":"ContainerDied","Data":"0220fa21ea5b11a9c3a0df2b8315ef935464c5bb63f37079b7b694d11055311d"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.223522 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi4224-account-delete-kcwdp"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.237904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scl5v\" (UniqueName: \"kubernetes.io/projected/16871c90-c542-47f1-b528-6d2384b9bcd0-kube-api-access-scl5v\") pod \"16871c90-c542-47f1-b528-6d2384b9bcd0\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.238134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config-secret\") pod \"16871c90-c542-47f1-b528-6d2384b9bcd0\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.238160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config\") pod \"16871c90-c542-47f1-b528-6d2384b9bcd0\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.238221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-combined-ca-bundle\") pod \"16871c90-c542-47f1-b528-6d2384b9bcd0\" (UID: \"16871c90-c542-47f1-b528-6d2384b9bcd0\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.248073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.261355 4769 generic.go:334] "Generic (PLEG): container finished" podID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerID="422269e23c92dba5a740e096f70b861938f38d732472b1771370d1a725668bdc" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.261416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" event={"ID":"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb","Type":"ContainerDied","Data":"422269e23c92dba5a740e096f70b861938f38d732472b1771370d1a725668bdc"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.267819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" event={"ID":"ddfa2ac9-c267-49e2-b203-7f5d736a16eb","Type":"ContainerStarted","Data":"1b925a15dbcf3a761f5f52563849062d280c310938d9af78e0bc6dd35a41f77b"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.271271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16871c90-c542-47f1-b528-6d2384b9bcd0-kube-api-access-scl5v" (OuterVolumeSpecName: "kube-api-access-scl5v") pod "16871c90-c542-47f1-b528-6d2384b9bcd0" (UID: "16871c90-c542-47f1-b528-6d2384b9bcd0"). InnerVolumeSpecName "kube-api-access-scl5v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.282056 4769 generic.go:334] "Generic (PLEG): container finished" podID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerID="97a9e19b11e737a04c0983227e24c3355c7fc97cbc953b01c547aa972f3b1445" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.282160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d2849a02-b828-4f2a-8d0a-bc4b36da1357","Type":"ContainerDied","Data":"97a9e19b11e737a04c0983227e24c3355c7fc97cbc953b01c547aa972f3b1445"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.290983 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerID="c22b152459ac64dcc18bc3a178f69f96bcf6eb13092d379e4b03db1548875160" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.291017 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerID="5e37766e0cc8f0454c5e8ceb91238c3d60d326c7563a0d29d8febda4bf390814" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.291112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" event={"ID":"a0ee2070-d0d3-48e5-a82e-e902f5daf74b","Type":"ContainerDied","Data":"c22b152459ac64dcc18bc3a178f69f96bcf6eb13092d379e4b03db1548875160"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.291147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" event={"ID":"a0ee2070-d0d3-48e5-a82e-e902f5daf74b","Type":"ContainerDied","Data":"5e37766e0cc8f0454c5e8ceb91238c3d60d326c7563a0d29d8febda4bf390814"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.294442 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.294455 4769 scope.go:117] "RemoveContainer" containerID="93ac65b5ac031fb778736d51bfd33e6eb245d89d3d9c2d7bc36b1b5e9626ae10" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.318714 4769 generic.go:334] "Generic (PLEG): container finished" podID="7e7510e8-fd68-404b-9774-ce64060e8857" containerID="6c5df0f5565a0a8e26abaec9f5e0baacef7b8dc82ff4bd1b27c945357f6e89de" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.318788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7e7510e8-fd68-404b-9774-ce64060e8857","Type":"ContainerDied","Data":"6c5df0f5565a0a8e26abaec9f5e0baacef7b8dc82ff4bd1b27c945357f6e89de"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.319639 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q"] Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.326913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" event={"ID":"3943fea7-7c63-4205-95fd-f1a5587b6269","Type":"ContainerStarted","Data":"e5a6c6ca15e6d1022a14412c9ed876f551c5a029ccbb0f9623365270761daf5a"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.333961 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerID="3f6cc4b6ffc17a62e421e7a52b3224ce48159a28e12100f0bd18bfaf15f4b93f" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.334126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" event={"ID":"ed71386e-c354-4139-b9cf-ea8f7a8d90d1","Type":"ContainerDied","Data":"3f6cc4b6ffc17a62e421e7a52b3224ce48159a28e12100f0bd18bfaf15f4b93f"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.343545 4769 generic.go:334] "Generic (PLEG): container finished" podID="2956e126-fdb7-48f8-866d-fd679d38c050" containerID="b3c83b15f3932426877c440dd7e11ad9cc8e803b59286cb80e88df7c49803066" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.343612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" event={"ID":"2956e126-fdb7-48f8-866d-fd679d38c050","Type":"ContainerDied","Data":"b3c83b15f3932426877c440dd7e11ad9cc8e803b59286cb80e88df7c49803066"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.348286 4769 generic.go:334] "Generic (PLEG): container finished" podID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerID="9aa63d7878d435b8c9508e2d472b50b0aa84bef0e411533648bc4dc50cc49174" exitCode=143 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.348350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2c4055bb-10f7-45d3-a0e1-0a70629f1813","Type":"ContainerDied","Data":"9aa63d7878d435b8c9508e2d472b50b0aa84bef0e411533648bc4dc50cc49174"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.353556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b69s7\" (UniqueName: \"kubernetes.io/projected/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-api-access-b69s7\") pod \"e59628c3-2e82-4f0c-a148-66ea1e85edca\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.353766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-combined-ca-bundle\") pod \"e59628c3-2e82-4f0c-a148-66ea1e85edca\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.354137 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-certs\") pod \"e59628c3-2e82-4f0c-a148-66ea1e85edca\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.357553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-config\") pod \"e59628c3-2e82-4f0c-a148-66ea1e85edca\" (UID: \"e59628c3-2e82-4f0c-a148-66ea1e85edca\") " Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.358407 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-scl5v\" (UniqueName: \"kubernetes.io/projected/16871c90-c542-47f1-b528-6d2384b9bcd0-kube-api-access-scl5v\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.366076 4769 generic.go:334] "Generic (PLEG): container finished" podID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerID="922026f24477774d131d19141cf1ed82430246c1c8751339467c909f4f231e6e" exitCode=0 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.366098 4769 generic.go:334] "Generic (PLEG): container finished" podID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerID="fa17db7dda109607250ffcf2848b4eb8c590c6c8c657e77f08a21cde6c71544c" exitCode=2 Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.366124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerDied","Data":"922026f24477774d131d19141cf1ed82430246c1c8751339467c909f4f231e6e"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.366155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerDied","Data":"fa17db7dda109607250ffcf2848b4eb8c590c6c8c657e77f08a21cde6c71544c"} Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.394617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-api-access-b69s7" (OuterVolumeSpecName: "kube-api-access-b69s7") pod "e59628c3-2e82-4f0c-a148-66ea1e85edca" (UID: "e59628c3-2e82-4f0c-a148-66ea1e85edca"). InnerVolumeSpecName "kube-api-access-b69s7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.463135 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b69s7\" (UniqueName: \"kubernetes.io/projected/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-api-access-b69s7\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.676324 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16871c90-c542-47f1-b528-6d2384b9bcd0" (UID: "16871c90-c542-47f1-b528-6d2384b9bcd0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.713245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "16871c90-c542-47f1-b528-6d2384b9bcd0" (UID: "16871c90-c542-47f1-b528-6d2384b9bcd0"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.768868 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.768895 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.776040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "e59628c3-2e82-4f0c-a148-66ea1e85edca" (UID: "e59628c3-2e82-4f0c-a148-66ea1e85edca"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.817805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "16871c90-c542-47f1-b528-6d2384b9bcd0" (UID: "16871c90-c542-47f1-b528-6d2384b9bcd0"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.820321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e59628c3-2e82-4f0c-a148-66ea1e85edca" (UID: "e59628c3-2e82-4f0c-a148-66ea1e85edca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.871537 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.871568 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/16871c90-c542-47f1-b528-6d2384b9bcd0-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.871579 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.871643 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.871791 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data podName:8ba57a49-8363-41c4-b411-40dcff3a84b1 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:00.871676796 +0000 UTC m=+3379.572338614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data") pod "rabbitmq-cell1-server-0" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.873545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "e59628c3-2e82-4f0c-a148-66ea1e85edca" (UID: "e59628c3-2e82-4f0c-a148-66ea1e85edca"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.973230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-557dk\" (UniqueName: \"kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.973348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:56 crc kubenswrapper[4769]: I1121 12:46:56.973421 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e59628c3-2e82-4f0c-a148-66ea1e85edca-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.973530 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.973587 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:46:58.973571426 +0000 UTC m=+3377.674233244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : configmap "openstack-scripts" not found Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.980776 4769 projected.go:194] Error preparing data for projected volume kube-api-access-557dk for pod openstack-kuttl-tests/keystone2f46-account-delete-2hg6v: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:56 crc kubenswrapper[4769]: E1121 12:46:56.980869 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:46:58.980843142 +0000 UTC m=+3377.681505010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-557dk" (UniqueName: "kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.292884 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" path="/var/lib/kubelet/pods/16871c90-c542-47f1-b528-6d2384b9bcd0/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.294742 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f5bb02-7c0d-40f3-8417-42feca72085c" path="/var/lib/kubelet/pods/66f5bb02-7c0d-40f3-8417-42feca72085c/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.295580 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7648f0d3-f29e-4add-8c77-b245d309acfb" path="/var/lib/kubelet/pods/7648f0d3-f29e-4add-8c77-b245d309acfb/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.298117 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80b2eb72-37b4-4511-975a-2434e80375e9" path="/var/lib/kubelet/pods/80b2eb72-37b4-4511-975a-2434e80375e9/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.299025 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b23a8bb4-7473-461c-bdee-d0d7de0acb24" path="/var/lib/kubelet/pods/b23a8bb4-7473-461c-bdee-d0d7de0acb24/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.299761 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be547a2f-4f2b-4c3a-8d65-2a0b833e03f5" path="/var/lib/kubelet/pods/be547a2f-4f2b-4c3a-8d65-2a0b833e03f5/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.301175 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f31c2bdf-fc79-489e-93b3-f856cbd3bd4b" path="/var/lib/kubelet/pods/f31c2bdf-fc79-489e-93b3-f856cbd3bd4b/volumes" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.392863 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerID="0b127430d37a2b8bd02beca56782f24d85673a86201af9979267b08a0604c19a" exitCode=1 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.392926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" event={"ID":"ddfa2ac9-c267-49e2-b203-7f5d736a16eb","Type":"ContainerDied","Data":"0b127430d37a2b8bd02beca56782f24d85673a86201af9979267b08a0604c19a"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.393256 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.393287 4769 scope.go:117] "RemoveContainer" containerID="0b127430d37a2b8bd02beca56782f24d85673a86201af9979267b08a0604c19a" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.400076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" event={"ID":"37ce1474-d401-43fc-9e17-4e5691d2b451","Type":"ContainerStarted","Data":"1e4b51bf095ac780518be3d3e6514b21bfe9d5ef059b6d1e1b4f7bbbe9996288"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.401455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" event={"ID":"29bef206-0bc0-43a4-9fc3-f8382be7ea45","Type":"ContainerStarted","Data":"d7e46e1533127fbe2ef8d8217b2662b12311f313955aa4a8f25b41f24ddb9883"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.415218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" event={"ID":"a0ee2070-d0d3-48e5-a82e-e902f5daf74b","Type":"ContainerDied","Data":"58dd41957abdf8fa9893d7b6c5729755c41c35285c3220b1dda3e03942072bb7"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.415266 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58dd41957abdf8fa9893d7b6c5729755c41c35285c3220b1dda3e03942072bb7" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.417310 4769 generic.go:334] "Generic (PLEG): container finished" podID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerID="bc668555cfef713e4ab92611d15c81fa282a638ecb567817cae478b23daa48ae" exitCode=1 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.417809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" event={"ID":"3943fea7-7c63-4205-95fd-f1a5587b6269","Type":"ContainerDied","Data":"bc668555cfef713e4ab92611d15c81fa282a638ecb567817cae478b23daa48ae"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.417988 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.418026 4769 scope.go:117] "RemoveContainer" containerID="bc668555cfef713e4ab92611d15c81fa282a638ecb567817cae478b23daa48ae" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.421500 4769 generic.go:334] "Generic (PLEG): container finished" podID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerID="e41569304ef7a84a1819c5271104655f4cc64a600c4efcf962f6de3194921ed2" exitCode=1 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.421754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" event={"ID":"9400fe9a-0cca-4e21-b857-d4ae307e6ef6","Type":"ContainerDied","Data":"e41569304ef7a84a1819c5271104655f4cc64a600c4efcf962f6de3194921ed2"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.421798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" event={"ID":"9400fe9a-0cca-4e21-b857-d4ae307e6ef6","Type":"ContainerStarted","Data":"4bdc17793f8429ec58f9b3cb8e91e9bd7a67fe6602956af0e1b2129382c7b271"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.421955 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.422003 4769 scope.go:117] "RemoveContainer" containerID="e41569304ef7a84a1819c5271104655f4cc64a600c4efcf962f6de3194921ed2" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.443984 4769 generic.go:334] "Generic (PLEG): container finished" podID="b5d4b44e-5548-4cdb-a2ac-6192fec95c43" containerID="faac91ebebab06a02c43aae579e4b27c115b8f34801002ff38acd386b6bf5adf" exitCode=0 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.444086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b5d4b44e-5548-4cdb-a2ac-6192fec95c43","Type":"ContainerDied","Data":"faac91ebebab06a02c43aae579e4b27c115b8f34801002ff38acd386b6bf5adf"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.444122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b5d4b44e-5548-4cdb-a2ac-6192fec95c43","Type":"ContainerDied","Data":"4dfc22c7114dfd7da23c6ced5e0ebe212c8c2f3a1c07b0277596d8a97e52b155"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.444136 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dfc22c7114dfd7da23c6ced5e0ebe212c8c2f3a1c07b0277596d8a97e52b155" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.449079 4769 generic.go:334] "Generic (PLEG): container finished" podID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerID="c122bd85eed21f262f277dffad84a7fb6e2c9fb02f0223e40afc6a62b01422f5" exitCode=1 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.449174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" event={"ID":"18d3919f-40c4-42fe-9bbb-86abb8b181a1","Type":"ContainerDied","Data":"c122bd85eed21f262f277dffad84a7fb6e2c9fb02f0223e40afc6a62b01422f5"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.449820 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.449858 4769 scope.go:117] "RemoveContainer" containerID="c122bd85eed21f262f277dffad84a7fb6e2c9fb02f0223e40afc6a62b01422f5" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.469250 4769 generic.go:334] "Generic (PLEG): container finished" podID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerID="aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42" exitCode=0 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.469320 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3360df8e-c791-460f-a1bc-d2a473cd9028","Type":"ContainerDied","Data":"aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.479230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" event={"ID":"74667797-02dc-4a11-95fe-97d24a539e51","Type":"ContainerStarted","Data":"20af16df7316dd093519bb7cc835575c352599301e28b69e3c284468185a2d99"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.482326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2z2jt" event={"ID":"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26","Type":"ContainerStarted","Data":"54885e320f5117c37d4755a6fad138b321e5c9be75914cd7978aca766f2e4f4b"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.488541 4769 generic.go:334] "Generic (PLEG): container finished" podID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerID="8cb918195a2da496d4cebc90d283625185cdf93939a6a1a014af5c164ec23e6e" exitCode=0 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.488582 4769 generic.go:334] "Generic (PLEG): container finished" podID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerID="e64383e9e28b8793e25f3e0cf88d3784c0f6f3d62df9ed582de13f9a54939bd3" exitCode=0 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.488626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerDied","Data":"8cb918195a2da496d4cebc90d283625185cdf93939a6a1a014af5c164ec23e6e"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.488656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerDied","Data":"e64383e9e28b8793e25f3e0cf88d3784c0f6f3d62df9ed582de13f9a54939bd3"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.488670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"30b662da-331f-4736-bfb7-a1c5f31c1ffa","Type":"ContainerDied","Data":"5b345a409dacfae1facede940eb4f68d0bf0f8ea7c92839647fdc513e2946e99"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.488681 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b345a409dacfae1facede940eb4f68d0bf0f8ea7c92839647fdc513e2946e99" Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.492916 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.492957 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.492987 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts podName:ddfa2ac9-c267-49e2-b203-7f5d736a16eb nodeName:}" failed. No retries permitted until 2025-11-21 12:46:57.992969959 +0000 UTC m=+3376.693631777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts") pod "glanceca0f-account-delete-jjz99" (UID: "ddfa2ac9-c267-49e2-b203-7f5d736a16eb") : configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.493025 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts podName:3943fea7-7c63-4205-95fd-f1a5587b6269 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:57.99299612 +0000 UTC m=+3376.693657938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts") pod "cinder37fb-account-delete-6brjl" (UID: "3943fea7-7c63-4205-95fd-f1a5587b6269") : configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.495522 4769 generic.go:334] "Generic (PLEG): container finished" podID="82907629-360d-4481-86ed-2d4abb75ecff" containerID="f8951fb0205b9b418476b216d36f63087f35f7d86fce2af42515b76e7151687c" exitCode=0 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.495619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"82907629-360d-4481-86ed-2d4abb75ecff","Type":"ContainerDied","Data":"f8951fb0205b9b418476b216d36f63087f35f7d86fce2af42515b76e7151687c"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.495662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"82907629-360d-4481-86ed-2d4abb75ecff","Type":"ContainerDied","Data":"eb7610e7e43ab2f6f0bdddcb7be09abbf750c1f949cbb8ab78c552fd30a46858"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.495674 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb7610e7e43ab2f6f0bdddcb7be09abbf750c1f949cbb8ab78c552fd30a46858" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.500513 4769 generic.go:334] "Generic (PLEG): container finished" podID="23ba26dc-ff31-4837-94db-85584619d8b4" containerID="c44b3e5451855a61065e3bc9d86fade0455d8776d80e8c21a3fbf0c80d547ebc" exitCode=0 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.500596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"23ba26dc-ff31-4837-94db-85584619d8b4","Type":"ContainerDied","Data":"c44b3e5451855a61065e3bc9d86fade0455d8776d80e8c21a3fbf0c80d547ebc"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.500766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"23ba26dc-ff31-4837-94db-85584619d8b4","Type":"ContainerDied","Data":"262ce462ee54214483cc00ede6baa489b10897fc223d17ee593de8609ab3221a"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.500833 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="262ce462ee54214483cc00ede6baa489b10897fc223d17ee593de8609ab3221a" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.503689 4769 generic.go:334] "Generic (PLEG): container finished" podID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerID="25bb25c011e17059eae3ac0a07f26cfb59ed22e7e0196aeb654da35a20b7245f" exitCode=1 Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.503872 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.504291 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.504324 4769 scope.go:117] "RemoveContainer" containerID="25bb25c011e17059eae3ac0a07f26cfb59ed22e7e0196aeb654da35a20b7245f" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.503878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" event={"ID":"3da71fd1-0ca1-4e28-b702-d2fb5665627c","Type":"ContainerDied","Data":"25bb25c011e17059eae3ac0a07f26cfb59ed22e7e0196aeb654da35a20b7245f"} Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.513901 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.593299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-public-tls-certs\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.593373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-etc-swift\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.593412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-internal-tls-certs\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.593428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7cdf\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-kube-api-access-w7cdf\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.593529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-combined-ca-bundle\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.594062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-config-data\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.594132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-run-httpd\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.594205 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-log-httpd\") pod \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\" (UID: \"a0ee2070-d0d3-48e5-a82e-e902f5daf74b\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.595269 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.595317 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.595353 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts podName:3da71fd1-0ca1-4e28-b702-d2fb5665627c nodeName:}" failed. No retries permitted until 2025-11-21 12:46:58.095340971 +0000 UTC m=+3376.796002789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts") pod "barbican8f44-account-delete-r5kbv" (UID: "3da71fd1-0ca1-4e28-b702-d2fb5665627c") : configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.595394 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.595615 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.595638 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts podName:9400fe9a-0cca-4e21-b857-d4ae307e6ef6 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:58.095631009 +0000 UTC m=+3376.796292827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts") pod "neutronc15e-account-delete-vvw9t" (UID: "9400fe9a-0cca-4e21-b857-d4ae307e6ef6") : configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.595811 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: E1121 12:46:57.596076 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts podName:18d3919f-40c4-42fe-9bbb-86abb8b181a1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:58.09605746 +0000 UTC m=+3376.796719278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts") pod "placement6868-account-delete-wmplj" (UID: "18d3919f-40c4-42fe-9bbb-86abb8b181a1") : configmap "openstack-scripts" not found Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.599849 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.601876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-kube-api-access-w7cdf" (OuterVolumeSpecName: "kube-api-access-w7cdf") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "kube-api-access-w7cdf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.666059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.670705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.680740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.687769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-config-data" (OuterVolumeSpecName: "config-data") pod "a0ee2070-d0d3-48e5-a82e-e902f5daf74b" (UID: "a0ee2070-d0d3-48e5-a82e-e902f5daf74b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698430 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698483 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698512 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698533 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w7cdf\" (UniqueName: \"kubernetes.io/projected/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-kube-api-access-w7cdf\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698550 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698571 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698580 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.698599 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a0ee2070-d0d3-48e5-a82e-e902f5daf74b-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.747558 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-5x87d"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.755378 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-5x87d"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.765219 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement6868-account-delete-wmplj"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.770296 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6868-account-create-57vth"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.775665 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6868-account-create-57vth"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.775949 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.811684 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-mbl28"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.822572 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-mbl28"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.838714 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.842042 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-37fb-account-create-drsrv"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.847136 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder37fb-account-delete-6brjl"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.852601 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-37fb-account-create-drsrv"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903429 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/82907629-360d-4481-86ed-2d4abb75ecff-config-data-generated\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-combined-ca-bundle\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-nova-novncproxy-tls-certs\") pod \"23ba26dc-ff31-4837-94db-85584619d8b4\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb6mr\" (UniqueName: \"kubernetes.io/projected/82907629-360d-4481-86ed-2d4abb75ecff-kube-api-access-qb6mr\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-galera-tls-certs\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-kolla-config\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-operator-scripts\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-config-data\") pod \"23ba26dc-ff31-4837-94db-85584619d8b4\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.903951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-combined-ca-bundle\") pod \"23ba26dc-ff31-4837-94db-85584619d8b4\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.904004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb2pc\" (UniqueName: \"kubernetes.io/projected/23ba26dc-ff31-4837-94db-85584619d8b4-kube-api-access-kb2pc\") pod \"23ba26dc-ff31-4837-94db-85584619d8b4\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.904034 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-vencrypt-tls-certs\") pod \"23ba26dc-ff31-4837-94db-85584619d8b4\" (UID: \"23ba26dc-ff31-4837-94db-85584619d8b4\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.904123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-config-data-default\") pod \"82907629-360d-4481-86ed-2d4abb75ecff\" (UID: \"82907629-360d-4481-86ed-2d4abb75ecff\") " Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.912296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.912940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.914531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82907629-360d-4481-86ed-2d4abb75ecff-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.915658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.917298 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-b456h"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.923855 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-b456h"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.932397 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.932667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82907629-360d-4481-86ed-2d4abb75ecff-kube-api-access-qb6mr" (OuterVolumeSpecName: "kube-api-access-qb6mr") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "kube-api-access-qb6mr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.950912 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glanceca0f-account-delete-jjz99"] Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.952281 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.251:8778/\": read tcp 10.217.0.2:57880->10.217.0.251:8778: read: connection reset by peer" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.952418 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.251:8778/\": read tcp 10.217.0.2:57890->10.217.0.251:8778: read: connection reset by peer" Nov 21 12:46:57 crc kubenswrapper[4769]: I1121 12:46:57.976099 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ba26dc-ff31-4837-94db-85584619d8b4-kube-api-access-kb2pc" (OuterVolumeSpecName: "kube-api-access-kb2pc") pod "23ba26dc-ff31-4837-94db-85584619d8b4" (UID: "23ba26dc-ff31-4837-94db-85584619d8b4"). InnerVolumeSpecName "kube-api-access-kb2pc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.003113 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-ca0f-account-create-wnwl7"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.009850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "mysql-db") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.011846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-sg-core-conf-yaml\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.011929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-run-httpd\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.012086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-scripts\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.012452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-ceilometer-tls-certs\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.012624 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.012699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-log-httpd\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.012806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-config-data\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.012908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg427\" (UniqueName: \"kubernetes.io/projected/30b662da-331f-4736-bfb7-a1c5f31c1ffa-kube-api-access-qg427\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014585 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qb6mr\" (UniqueName: \"kubernetes.io/projected/82907629-360d-4481-86ed-2d4abb75ecff-kube-api-access-qb6mr\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014623 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014646 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014662 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kb2pc\" (UniqueName: \"kubernetes.io/projected/23ba26dc-ff31-4837-94db-85584619d8b4-kube-api-access-kb2pc\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014676 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/82907629-360d-4481-86ed-2d4abb75ecff-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014714 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.014731 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/82907629-360d-4481-86ed-2d4abb75ecff-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.016385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.016865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.018222 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.018348 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts podName:3943fea7-7c63-4205-95fd-f1a5587b6269 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:59.018295983 +0000 UTC m=+3377.718957801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts") pod "cinder37fb-account-delete-6brjl" (UID: "3943fea7-7c63-4205-95fd-f1a5587b6269") : configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.019744 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.020917 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts podName:ddfa2ac9-c267-49e2-b203-7f5d736a16eb nodeName:}" failed. No retries permitted until 2025-11-21 12:46:59.019920607 +0000 UTC m=+3377.720582425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts") pod "glanceca0f-account-delete-jjz99" (UID: "ddfa2ac9-c267-49e2-b203-7f5d736a16eb") : configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.027686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.032815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b662da-331f-4736-bfb7-a1c5f31c1ffa-kube-api-access-qg427" (OuterVolumeSpecName: "kube-api-access-qg427") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "kube-api-access-qg427". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.036688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-scripts" (OuterVolumeSpecName: "scripts") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.065287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "23ba26dc-ff31-4837-94db-85584619d8b4" (UID: "23ba26dc-ff31-4837-94db-85584619d8b4"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.065665 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-ca0f-account-create-wnwl7"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.078490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.100755 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.104570 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode59628c3_2e82_4f0c_a148_66ea1e85edca.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16871c90_c542_47f1_b528_6d2384b9bcd0.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode59628c3_2e82_4f0c_a148_66ea1e85edca.slice/crio-60ab61612c450cba5013dba91347c0aa13bba14e2904a8af2801844890f3d13b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bed045d_dcfa_4235_a778_cc12b3ee6a6c.slice/crio-conmon-ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bed045d_dcfa_4235_a778_cc12b3ee6a6c.slice/crio-ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.112263 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117268 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117302 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117312 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qg427\" (UniqueName: \"kubernetes.io/projected/30b662da-331f-4736-bfb7-a1c5f31c1ffa-kube-api-access-qg427\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117324 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117333 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117342 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/30b662da-331f-4736-bfb7-a1c5f31c1ffa-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117349 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.117415 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.117466 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts podName:9400fe9a-0cca-4e21-b857-d4ae307e6ef6 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:59.117449739 +0000 UTC m=+3377.818111547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts") pod "neutronc15e-account-delete-vvw9t" (UID: "9400fe9a-0cca-4e21-b857-d4ae307e6ef6") : configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.117468 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.117519 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.117541 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts podName:3da71fd1-0ca1-4e28-b702-d2fb5665627c nodeName:}" failed. No retries permitted until 2025-11-21 12:46:59.117535301 +0000 UTC m=+3377.818197119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts") pod "barbican8f44-account-delete-r5kbv" (UID: "3da71fd1-0ca1-4e28-b702-d2fb5665627c") : configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.117498 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.117653 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts podName:18d3919f-40c4-42fe-9bbb-86abb8b181a1 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:59.117616253 +0000 UTC m=+3377.818278291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts") pod "placement6868-account-delete-wmplj" (UID: "18d3919f-40c4-42fe-9bbb-86abb8b181a1") : configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.174297 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-frqv5"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.189365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-config-data" (OuterVolumeSpecName: "config-data") pod "23ba26dc-ff31-4837-94db-85584619d8b4" (UID: "23ba26dc-ff31-4837-94db-85584619d8b4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.199118 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-frqv5"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.220167 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.42:8775/\": read tcp 10.217.0.2:44352->10.217.1.42:8775: read: connection reset by peer" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.220359 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.42:8775/\": read tcp 10.217.0.2:44342->10.217.1.42:8775: read: connection reset by peer" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.221654 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.221681 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.224942 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-8f44-account-create-2g8jp"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.235937 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican8f44-account-delete-r5kbv"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.247138 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-8f44-account-create-2g8jp"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.261918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "23ba26dc-ff31-4837-94db-85584619d8b4" (UID: "23ba26dc-ff31-4837-94db-85584619d8b4"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.268575 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nrzvs"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.325392 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.329781 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.5:8776/healthcheck\": dial tcp 10.217.1.5:8776: connect: connection refused" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.336112 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-nrzvs"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.373441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "23ba26dc-ff31-4837-94db-85584619d8b4" (UID: "23ba26dc-ff31-4837-94db-85584619d8b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.401021 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronc15e-account-delete-vvw9t"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.427940 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23ba26dc-ff31-4837-94db-85584619d8b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.438273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-c15e-account-create-2sfh9"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.451672 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-c15e-account-create-2sfh9"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.453332 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.1:9311/healthcheck\": read tcp 10.217.0.2:35508->10.217.1.1:9311: read: connection reset by peer" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.453431 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.1:9311/healthcheck\": read tcp 10.217.0.2:35494->10.217.1.1:9311: read: connection reset by peer" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.484565 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.528554 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerID="4c28531219c8efbaa37de55e1d8eed2042fb62ab2c238f6bf4c4988a3a8f43d7" exitCode=0 Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.528632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad3fd932-0bbe-42b5-82d0-a7c427395cf6","Type":"ContainerDied","Data":"4c28531219c8efbaa37de55e1d8eed2042fb62ab2c238f6bf4c4988a3a8f43d7"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.535364 4769 generic.go:334] "Generic (PLEG): container finished" podID="229177f2-bc85-4c53-86e2-9daab3200250" containerID="970ed70182aee5ce4e2e0a18af5f95caf9f7fe5a886215c9d7cd9823d6abc38d" exitCode=0 Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.535430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"229177f2-bc85-4c53-86e2-9daab3200250","Type":"ContainerDied","Data":"970ed70182aee5ce4e2e0a18af5f95caf9f7fe5a886215c9d7cd9823d6abc38d"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.537342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" event={"ID":"29bef206-0bc0-43a4-9fc3-f8382be7ea45","Type":"ContainerStarted","Data":"3c1bf2bd84f5f490964af46bf51a5e904ee4b404706f3548f37da6da79e7e8d8"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.538016 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.565013 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerID="c35464a3e65222fb30957342ae0556146a82822c4f11ec90d17fe91d69203acc" exitCode=0 Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.565094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3c0de7b0-5c27-4052-a219-6b701aef6f6b","Type":"ContainerDied","Data":"c35464a3e65222fb30957342ae0556146a82822c4f11ec90d17fe91d69203acc"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.575347 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" podStartSLOduration=5.575325233 podStartE2EDuration="5.575325233s" podCreationTimestamp="2025-11-21 12:46:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:46:58.564587173 +0000 UTC m=+3377.265248991" watchObservedRunningTime="2025-11-21 12:46:58.575325233 +0000 UTC m=+3377.275987041" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.579521 4769 generic.go:334] "Generic (PLEG): container finished" podID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerID="18d68e0ceba5d92cca0d815cffc64f84ca5574b67046925d76df13fff47bcfd2" exitCode=0 Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.579588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2c4055bb-10f7-45d3-a0e1-0a70629f1813","Type":"ContainerDied","Data":"18d68e0ceba5d92cca0d815cffc64f84ca5574b67046925d76df13fff47bcfd2"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.620635 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerID="ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841" exitCode=0 Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.620764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" event={"ID":"2bed045d-dcfa-4235-a778-cc12b3ee6a6c","Type":"ContainerDied","Data":"ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.630629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-memcached-tls-certs\") pod \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.630779 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kolla-config\") pod \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.630822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-config-data\") pod \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.630864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-combined-ca-bundle\") pod \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.630927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtmbn\" (UniqueName: \"kubernetes.io/projected/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kube-api-access-vtmbn\") pod \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\" (UID: \"b5d4b44e-5548-4cdb-a2ac-6192fec95c43\") " Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.631461 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: E1121 12:46:58.631512 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts podName:29bef206-0bc0-43a4-9fc3-f8382be7ea45 nodeName:}" failed. No retries permitted until 2025-11-21 12:46:59.131497608 +0000 UTC m=+3377.832159416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts") pod "novacell0b8ba-account-delete-ngs4m" (UID: "29bef206-0bc0-43a4-9fc3-f8382be7ea45") : configmap "openstack-scripts" not found Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.637228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "b5d4b44e-5548-4cdb-a2ac-6192fec95c43" (UID: "b5d4b44e-5548-4cdb-a2ac-6192fec95c43"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.637603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-config-data" (OuterVolumeSpecName: "config-data") pod "b5d4b44e-5548-4cdb-a2ac-6192fec95c43" (UID: "b5d4b44e-5548-4cdb-a2ac-6192fec95c43"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.639359 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hlpf5"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.643757 4769 generic.go:334] "Generic (PLEG): container finished" podID="7e7510e8-fd68-404b-9774-ce64060e8857" containerID="b37dd98fa6bdd1e416c4efa33b95a2376a102e8ec9992a969e3acb0389717f44" exitCode=0 Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.643909 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.644238 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.644660 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.644687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7e7510e8-fd68-404b-9774-ce64060e8857","Type":"ContainerDied","Data":"b37dd98fa6bdd1e416c4efa33b95a2376a102e8ec9992a969e3acb0389717f44"} Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.644794 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.645013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.680359 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hlpf5"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.704209 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.720583 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.730059 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-b8ba-account-create-hbdlf"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.733242 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.733262 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.740286 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sfc7t"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.741311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kube-api-access-vtmbn" (OuterVolumeSpecName: "kube-api-access-vtmbn") pod "b5d4b44e-5548-4cdb-a2ac-6192fec95c43" (UID: "b5d4b44e-5548-4cdb-a2ac-6192fec95c43"). InnerVolumeSpecName "kube-api-access-vtmbn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.750584 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-sfc7t"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.763436 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi4224-account-delete-kcwdp"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.771000 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-4224-account-create-vkrch"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.784723 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-4224-account-create-vkrch"] Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.838413 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vtmbn\" (UniqueName: \"kubernetes.io/projected/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-kube-api-access-vtmbn\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.934856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:58 crc kubenswrapper[4769]: I1121 12:46:58.941867 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.046059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "82907629-360d-4481-86ed-2d4abb75ecff" (UID: "82907629-360d-4481-86ed-2d4abb75ecff"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.046473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.046622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-557dk\" (UniqueName: \"kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk\") pod \"keystone2f46-account-delete-2hg6v\" (UID: \"89d5f45d-75ad-4319-839a-011182707a5a\") " pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.046744 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/82907629-360d-4481-86ed-2d4abb75ecff-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.047026 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.047077 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts podName:3943fea7-7c63-4205-95fd-f1a5587b6269 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:01.047061991 +0000 UTC m=+3379.747723809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts") pod "cinder37fb-account-delete-6brjl" (UID: "3943fea7-7c63-4205-95fd-f1a5587b6269") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.047109 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.047136 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts podName:ddfa2ac9-c267-49e2-b203-7f5d736a16eb nodeName:}" failed. No retries permitted until 2025-11-21 12:47:01.047127773 +0000 UTC m=+3379.747789591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts") pod "glanceca0f-account-delete-jjz99" (UID: "ddfa2ac9-c267-49e2-b203-7f5d736a16eb") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.047162 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.047180 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:47:03.047174284 +0000 UTC m=+3381.747836102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.060835 4769 projected.go:194] Error preparing data for projected volume kube-api-access-557dk for pod openstack-kuttl-tests/keystone2f46-account-delete-2hg6v: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.060944 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk podName:89d5f45d-75ad-4319-839a-011182707a5a nodeName:}" failed. No retries permitted until 2025-11-21 12:47:03.060915945 +0000 UTC m=+3381.761577763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-557dk" (UniqueName: "kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk") pod "keystone2f46-account-delete-2hg6v" (UID: "89d5f45d-75ad-4319-839a-011182707a5a") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.149237 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.149353 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts podName:9400fe9a-0cca-4e21-b857-d4ae307e6ef6 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:01.1493179 +0000 UTC m=+3379.849979718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts") pod "neutronc15e-account-delete-vvw9t" (UID: "9400fe9a-0cca-4e21-b857-d4ae307e6ef6") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.150027 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.150051 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.150087 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts podName:18d3919f-40c4-42fe-9bbb-86abb8b181a1 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:01.1500584 +0000 UTC m=+3379.850720228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts") pod "placement6868-account-delete-wmplj" (UID: "18d3919f-40c4-42fe-9bbb-86abb8b181a1") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.150121 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.150135 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts podName:3da71fd1-0ca1-4e28-b702-d2fb5665627c nodeName:}" failed. No retries permitted until 2025-11-21 12:47:01.150115962 +0000 UTC m=+3379.850777780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts") pod "barbican8f44-account-delete-r5kbv" (UID: "3da71fd1-0ca1-4e28-b702-d2fb5665627c") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.150153 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts podName:29bef206-0bc0-43a4-9fc3-f8382be7ea45 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:00.150146323 +0000 UTC m=+3378.850808141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts") pod "novacell0b8ba-account-delete-ngs4m" (UID: "29bef206-0bc0-43a4-9fc3-f8382be7ea45") : configmap "openstack-scripts" not found Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.206319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b5d4b44e-5548-4cdb-a2ac-6192fec95c43" (UID: "b5d4b44e-5548-4cdb-a2ac-6192fec95c43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.240082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-config-data" (OuterVolumeSpecName: "config-data") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.251139 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.251171 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.277203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "b5d4b44e-5548-4cdb-a2ac-6192fec95c43" (UID: "b5d4b44e-5548-4cdb-a2ac-6192fec95c43"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.345176 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa" path="/var/lib/kubelet/pods/1cdaa0aa-fcb8-4493-ba99-0aece4dc50fa/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.345863 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e808382-c2c4-4452-b551-ab3725493318" path="/var/lib/kubelet/pods/1e808382-c2c4-4452-b551-ab3725493318/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.346619 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387ffe22-065e-4b2c-ae58-44c931ba346b" path="/var/lib/kubelet/pods/387ffe22-065e-4b2c-ae58-44c931ba346b/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.347125 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5387a5-ef3b-491d-8870-c6d0d3bd59a7" path="/var/lib/kubelet/pods/3b5387a5-ef3b-491d-8870-c6d0d3bd59a7/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.348320 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c03449-12ad-44f1-a622-0d08559e1eeb" path="/var/lib/kubelet/pods/49c03449-12ad-44f1-a622-0d08559e1eeb/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.348833 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67e089d3-3e07-433d-a340-4993df686804" path="/var/lib/kubelet/pods/67e089d3-3e07-433d-a340-4993df686804/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.356324 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="707a6d3f-07b8-465a-b696-e49dcff1eacb" path="/var/lib/kubelet/pods/707a6d3f-07b8-465a-b696-e49dcff1eacb/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.355944 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.358452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle\") pod \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\" (UID: \"30b662da-331f-4736-bfb7-a1c5f31c1ffa\") " Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.359844 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89845c89-7ba8-4fe7-bcc1-c44c10550252" path="/var/lib/kubelet/pods/89845c89-7ba8-4fe7-bcc1-c44c10550252/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.362028 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef93c1d-8128-42c4-9634-e4c4d7c855e4" path="/var/lib/kubelet/pods/9ef93c1d-8128-42c4-9634-e4c4d7c855e4/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.363368 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f257e32-13e3-4f28-97f4-eaefb3255d54" path="/var/lib/kubelet/pods/9f257e32-13e3-4f28-97f4-eaefb3255d54/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: W1121 12:46:59.363811 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/30b662da-331f-4736-bfb7-a1c5f31c1ffa/volumes/kubernetes.io~secret/combined-ca-bundle Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.363851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "30b662da-331f-4736-bfb7-a1c5f31c1ffa" (UID: "30b662da-331f-4736-bfb7-a1c5f31c1ffa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.368274 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdfbdb07-6216-47fa-8e9c-519412e753ba" path="/var/lib/kubelet/pods/bdfbdb07-6216-47fa-8e9c-519412e753ba/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.368980 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c113f75f-1306-4880-b153-4bf29356b2dc" path="/var/lib/kubelet/pods/c113f75f-1306-4880-b153-4bf29356b2dc/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.369929 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfb09a65-8b7d-4fdd-ae97-550f1e96a1af" path="/var/lib/kubelet/pods/cfb09a65-8b7d-4fdd-ae97-550f1e96a1af/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.372134 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c1f761-7503-4d0a-a2f9-7cf5d310127c" path="/var/lib/kubelet/pods/d7c1f761-7503-4d0a-a2f9-7cf5d310127c/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.373146 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59628c3-2e82-4f0c-a148-66ea1e85edca" path="/var/lib/kubelet/pods/e59628c3-2e82-4f0c-a148-66ea1e85edca/volumes" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.384756 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b5d4b44e-5548-4cdb-a2ac-6192fec95c43-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.396746 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/30b662da-331f-4736-bfb7-a1c5f31c1ffa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.662144 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-c48mb"] Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.663758 4769 generic.go:334] "Generic (PLEG): container finished" podID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerID="cac4f60a12a1c0952946fc47e09ab4f62a97adbf88ffcb17d9d4c65a64c4d1f1" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.663820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" event={"ID":"3da71fd1-0ca1-4e28-b702-d2fb5665627c","Type":"ContainerDied","Data":"cac4f60a12a1c0952946fc47e09ab4f62a97adbf88ffcb17d9d4c65a64c4d1f1"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.663857 4769 scope.go:117] "RemoveContainer" containerID="25bb25c011e17059eae3ac0a07f26cfb59ed22e7e0196aeb654da35a20b7245f" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.674795 4769 generic.go:334] "Generic (PLEG): container finished" podID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerID="3c1bf2bd84f5f490964af46bf51a5e904ee4b404706f3548f37da6da79e7e8d8" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.675302 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-c48mb"] Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.675339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" event={"ID":"29bef206-0bc0-43a4-9fc3-f8382be7ea45","Type":"ContainerDied","Data":"3c1bf2bd84f5f490964af46bf51a5e904ee4b404706f3548f37da6da79e7e8d8"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.676025 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" secret="" err="secret \"galera-openstack-dockercfg-pddct\" not found" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.676067 4769 scope.go:117] "RemoveContainer" containerID="3c1bf2bd84f5f490964af46bf51a5e904ee4b404706f3548f37da6da79e7e8d8" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.684323 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerID="ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.684565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2z2jt" event={"ID":"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26","Type":"ContainerDied","Data":"ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.711544 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerID="30cc782af112ceea951508724584bd46c90baf4a451c6d555408ea545c2d69cb" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.711620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" event={"ID":"ed71386e-c354-4139-b9cf-ea8f7a8d90d1","Type":"ContainerDied","Data":"30cc782af112ceea951508724584bd46c90baf4a451c6d555408ea545c2d69cb"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.711649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" event={"ID":"ed71386e-c354-4139-b9cf-ea8f7a8d90d1","Type":"ContainerDied","Data":"6194ac0cf96a48d427bd275c388065c892d07dfbe5486d8b354670293f8e98bc"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.711662 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6194ac0cf96a48d427bd275c388065c892d07dfbe5486d8b354670293f8e98bc" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.739455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"2c4055bb-10f7-45d3-a0e1-0a70629f1813","Type":"ContainerDied","Data":"6cf658a7355d8e5820fdd7fa8d66aa4e48efc57f5d7595a6b2eaa90c2c429095"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.739509 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cf658a7355d8e5820fdd7fa8d66aa4e48efc57f5d7595a6b2eaa90c2c429095" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.743607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" event={"ID":"2bed045d-dcfa-4235-a778-cc12b3ee6a6c","Type":"ContainerDied","Data":"3cdbb534a44ca0f14a9137c6b8b38dcd4d4189c0b8901c83aaac76bb039a820f"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.743653 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cdbb534a44ca0f14a9137c6b8b38dcd4d4189c0b8901c83aaac76bb039a820f" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.745967 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-2f46-account-create-czl2w"] Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.747656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7e7510e8-fd68-404b-9774-ce64060e8857","Type":"ContainerDied","Data":"ac2dae15a3cbbeeab25d209ecc403651a814970f1f0dd6dfb24643b0ec8c2d95"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.747682 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac2dae15a3cbbeeab25d209ecc403651a814970f1f0dd6dfb24643b0ec8c2d95" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.750115 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad3fd932-0bbe-42b5-82d0-a7c427395cf6","Type":"ContainerDied","Data":"a90d4f5ce26db644b27bcb0e348c446205a32776334af07f43fe8edcb786e6d3"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.750150 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a90d4f5ce26db644b27bcb0e348c446205a32776334af07f43fe8edcb786e6d3" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.752893 4769 generic.go:334] "Generic (PLEG): container finished" podID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerID="5c30e4792f341d93e32cceba812c233f2e7efd7eadf925001bafd200eb65a313" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.753019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" event={"ID":"9400fe9a-0cca-4e21-b857-d4ae307e6ef6","Type":"ContainerDied","Data":"5c30e4792f341d93e32cceba812c233f2e7efd7eadf925001bafd200eb65a313"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.755271 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone2f46-account-delete-2hg6v"] Nov 21 12:46:59 crc kubenswrapper[4769]: E1121 12:46:59.756590 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-557dk operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" podUID="89d5f45d-75ad-4319-839a-011182707a5a" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.762815 4769 generic.go:334] "Generic (PLEG): container finished" podID="74667797-02dc-4a11-95fe-97d24a539e51" containerID="2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.762916 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" event={"ID":"74667797-02dc-4a11-95fe-97d24a539e51","Type":"ContainerDied","Data":"2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.767346 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-2f46-account-create-czl2w"] Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.803688 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.803781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a0d74e83-a8b1-480f-8afb-b8ff9464350d","Type":"ContainerDied","Data":"00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.812358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3c0de7b0-5c27-4052-a219-6b701aef6f6b","Type":"ContainerDied","Data":"893543fb9397f7c8039d65073fc4d295c12ad4aed37f38dd1ee34199344fd5d9"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.812470 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="893543fb9397f7c8039d65073fc4d295c12ad4aed37f38dd1ee34199344fd5d9" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.814069 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee849839-867d-45a9-8078-2d530cd62ff7" containerID="b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.814137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"ee849839-867d-45a9-8078-2d530cd62ff7","Type":"ContainerDied","Data":"b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.821535 4769 generic.go:334] "Generic (PLEG): container finished" podID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerID="49bc58f1831922623e18c3eb5c0bcf86a02b029c43c0c21eb6d1776361d42264" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.821572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" event={"ID":"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb","Type":"ContainerDied","Data":"49bc58f1831922623e18c3eb5c0bcf86a02b029c43c0c21eb6d1776361d42264"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.825238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" event={"ID":"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb","Type":"ContainerDied","Data":"60758d47d07dd7d33bbc7c83610d14d41c54d2ed5e9e62d22f391e90f15e4db8"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.825273 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60758d47d07dd7d33bbc7c83610d14d41c54d2ed5e9e62d22f391e90f15e4db8" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.835043 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerID="4d1e33667932b6f6212ea7d17989c1963d17079c3c91caf651f6b9513f57a612" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.835163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" event={"ID":"ddfa2ac9-c267-49e2-b203-7f5d736a16eb","Type":"ContainerDied","Data":"4d1e33667932b6f6212ea7d17989c1963d17079c3c91caf651f6b9513f57a612"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.846553 4769 generic.go:334] "Generic (PLEG): container finished" podID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerID="2f7f7f98a870dbf12ccacfebdd086b9adde83dc9bb77deff51dfff3258774418" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.846846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d2849a02-b828-4f2a-8d0a-bc4b36da1357","Type":"ContainerDied","Data":"2f7f7f98a870dbf12ccacfebdd086b9adde83dc9bb77deff51dfff3258774418"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.846881 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"d2849a02-b828-4f2a-8d0a-bc4b36da1357","Type":"ContainerDied","Data":"efa0a17f1200dcf71c153996796d71e110ccedbfecafff1d7a9529a1973097c0"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.846893 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efa0a17f1200dcf71c153996796d71e110ccedbfecafff1d7a9529a1973097c0" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.852939 4769 generic.go:334] "Generic (PLEG): container finished" podID="37ce1474-d401-43fc-9e17-4e5691d2b451" containerID="acf6f669a9a4324de2c555ba73c82a682c2313f586002009031b52594b9b72e4" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.853043 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" event={"ID":"37ce1474-d401-43fc-9e17-4e5691d2b451","Type":"ContainerDied","Data":"acf6f669a9a4324de2c555ba73c82a682c2313f586002009031b52594b9b72e4"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.859017 4769 generic.go:334] "Generic (PLEG): container finished" podID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerID="9f009b2ef78b2f741b1eddf9695c1b778a9c9fa04c65bb647bb63c0745e67d0c" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.859128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" event={"ID":"18d3919f-40c4-42fe-9bbb-86abb8b181a1","Type":"ContainerDied","Data":"9f009b2ef78b2f741b1eddf9695c1b778a9c9fa04c65bb647bb63c0745e67d0c"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.874922 4769 generic.go:334] "Generic (PLEG): container finished" podID="f8c3fc37-e777-4549-b153-ad4965d13a8a" containerID="9aefa9d52d14027efe0407875f87a49569f3107d82fda1cdb5c326040e5fb813" exitCode=0 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.874997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" event={"ID":"f8c3fc37-e777-4549-b153-ad4965d13a8a","Type":"ContainerDied","Data":"9aefa9d52d14027efe0407875f87a49569f3107d82fda1cdb5c326040e5fb813"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.891135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"229177f2-bc85-4c53-86e2-9daab3200250","Type":"ContainerDied","Data":"1cff184e6a699ca1080e89435bcba2d70d344e3ca3c4bbd32609d9b676165d30"} Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.891305 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cff184e6a699ca1080e89435bcba2d70d344e3ca3c4bbd32609d9b676165d30" Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.893766 4769 generic.go:334] "Generic (PLEG): container finished" podID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerID="c30fb1219810f1f1186fa3d6e117b216245d01de60bc27de74cd429346301a5f" exitCode=1 Nov 21 12:46:59 crc kubenswrapper[4769]: I1121 12:46:59.893805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" event={"ID":"3943fea7-7c63-4205-95fd-f1a5587b6269","Type":"ContainerDied","Data":"c30fb1219810f1f1186fa3d6e117b216245d01de60bc27de74cd429346301a5f"} Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.128370 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.128484 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data podName:358ea7e8-fdf4-4096-948a-a1cd27a5a1c1 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:08.128464029 +0000 UTC m=+3386.829125847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data") pod "rabbitmq-server-0" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1") : configmap "rabbitmq-config-data" not found Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.231182 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.231310 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts podName:29bef206-0bc0-43a4-9fc3-f8382be7ea45 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:02.231271933 +0000 UTC m=+3380.931933751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts") pod "novacell0b8ba-account-delete-ngs4m" (UID: "29bef206-0bc0-43a4-9fc3-f8382be7ea45") : configmap "openstack-scripts" not found Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.298504 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f is running failed: container process not found" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.299123 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f is running failed: container process not found" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.299913 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f is running failed: container process not found" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.299949 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerName="nova-scheduler-scheduler" Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.374333 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc is running failed: container process not found" containerID="b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.374639 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc is running failed: container process not found" containerID="b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.374878 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc is running failed: container process not found" containerID="b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.374907 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="ee849839-867d-45a9-8078-2d530cd62ff7" containerName="nova-cell1-conductor-conductor" Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.538518 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.540214 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.541534 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.541586 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="ovn-northd" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.603475 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.609419 4769 scope.go:117] "RemoveContainer" containerID="e41569304ef7a84a1819c5271104655f4cc64a600c4efcf962f6de3194921ed2" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.623076 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.654878 4769 scope.go:117] "RemoveContainer" containerID="0b127430d37a2b8bd02beca56782f24d85673a86201af9979267b08a0604c19a" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.669762 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c4055bb-10f7-45d3-a0e1-0a70629f1813-logs\") pod \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-config-data\") pod \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-public-tls-certs\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745729 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z24sf\" (UniqueName: \"kubernetes.io/projected/2c4055bb-10f7-45d3-a0e1-0a70629f1813-kube-api-access-z24sf\") pod \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-logs\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-public-tls-certs\") pod \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-internal-tls-certs\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.745993 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp6th\" (UniqueName: \"kubernetes.io/projected/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-kube-api-access-bp6th\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.746030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-scripts\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.746143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-internal-tls-certs\") pod \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.746202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c4055bb-10f7-45d3-a0e1-0a70629f1813-logs" (OuterVolumeSpecName: "logs") pod "2c4055bb-10f7-45d3-a0e1-0a70629f1813" (UID: "2c4055bb-10f7-45d3-a0e1-0a70629f1813"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.746286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-combined-ca-bundle\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.746376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-config-data\") pod \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\" (UID: \"2bed045d-dcfa-4235-a778-cc12b3ee6a6c\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.746426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-combined-ca-bundle\") pod \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\" (UID: \"2c4055bb-10f7-45d3-a0e1-0a70629f1813\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.747183 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c4055bb-10f7-45d3-a0e1-0a70629f1813-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.751731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-logs" (OuterVolumeSpecName: "logs") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.753965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c4055bb-10f7-45d3-a0e1-0a70629f1813-kube-api-access-z24sf" (OuterVolumeSpecName: "kube-api-access-z24sf") pod "2c4055bb-10f7-45d3-a0e1-0a70629f1813" (UID: "2c4055bb-10f7-45d3-a0e1-0a70629f1813"). InnerVolumeSpecName "kube-api-access-z24sf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.758455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-scripts" (OuterVolumeSpecName: "scripts") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.775204 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-kube-api-access-bp6th" (OuterVolumeSpecName: "kube-api-access-bp6th") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "kube-api-access-bp6th". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.807853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-config-data" (OuterVolumeSpecName: "config-data") pod "2c4055bb-10f7-45d3-a0e1-0a70629f1813" (UID: "2c4055bb-10f7-45d3-a0e1-0a70629f1813"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.809677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c4055bb-10f7-45d3-a0e1-0a70629f1813" (UID: "2c4055bb-10f7-45d3-a0e1-0a70629f1813"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.819720 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-config-data" (OuterVolumeSpecName: "config-data") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.829264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.844125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2c4055bb-10f7-45d3-a0e1-0a70629f1813" (UID: "2c4055bb-10f7-45d3-a0e1-0a70629f1813"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-default\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-combined-ca-bundle\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849606 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-operator-scripts\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-galera-tls-certs\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-generated\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kolla-config\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.849874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbdjv\" (UniqueName: \"kubernetes.io/projected/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kube-api-access-jbdjv\") pod \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\" (UID: \"3c0de7b0-5c27-4052-a219-6b701aef6f6b\") " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850565 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850583 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bp6th\" (UniqueName: \"kubernetes.io/projected/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-kube-api-access-bp6th\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850597 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850626 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850636 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850645 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850656 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850668 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850678 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z24sf\" (UniqueName: \"kubernetes.io/projected/2c4055bb-10f7-45d3-a0e1-0a70629f1813-kube-api-access-z24sf\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.850687 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.851522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.851659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.854027 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2c4055bb-10f7-45d3-a0e1-0a70629f1813" (UID: "2c4055bb-10f7-45d3-a0e1-0a70629f1813"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.854426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kube-api-access-jbdjv" (OuterVolumeSpecName: "kube-api-access-jbdjv") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "kube-api-access-jbdjv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.872946 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "mysql-db") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.889691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.907762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.909549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" event={"ID":"f8c3fc37-e777-4549-b153-ad4965d13a8a","Type":"ContainerDied","Data":"b330a2a1ec5a8ba73c67f407d93a1bad2531999915a9b2a6bc88aebe6a849b71"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.909613 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b330a2a1ec5a8ba73c67f407d93a1bad2531999915a9b2a6bc88aebe6a849b71" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.909966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2bed045d-dcfa-4235-a778-cc12b3ee6a6c" (UID: "2bed045d-dcfa-4235-a778-cc12b3ee6a6c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.911010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "3c0de7b0-5c27-4052-a219-6b701aef6f6b" (UID: "3c0de7b0-5c27-4052-a219-6b701aef6f6b"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.913238 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_10edbd41-2f31-466a-94be-9b0d3bf334d8/ovn-northd/0.log" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.913319 4769 generic.go:334] "Generic (PLEG): container finished" podID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" exitCode=139 Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.913397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"10edbd41-2f31-466a-94be-9b0d3bf334d8","Type":"ContainerDied","Data":"e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.915428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"a0d74e83-a8b1-480f-8afb-b8ff9464350d","Type":"ContainerDied","Data":"e290c9d62079d7f5b97a4f88941b8ba4ec7924e61b76459cb9de2a75e5d0ef09"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.915469 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e290c9d62079d7f5b97a4f88941b8ba4ec7924e61b76459cb9de2a75e5d0ef09" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.917640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" event={"ID":"9400fe9a-0cca-4e21-b857-d4ae307e6ef6","Type":"ContainerDied","Data":"4bdc17793f8429ec58f9b3cb8e91e9bd7a67fe6602956af0e1b2129382c7b271"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.917962 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bdc17793f8429ec58f9b3cb8e91e9bd7a67fe6602956af0e1b2129382c7b271" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.919823 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" event={"ID":"3943fea7-7c63-4205-95fd-f1a5587b6269","Type":"ContainerDied","Data":"e5a6c6ca15e6d1022a14412c9ed876f551c5a029ccbb0f9623365270761daf5a"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.919857 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a6c6ca15e6d1022a14412c9ed876f551c5a029ccbb0f9623365270761daf5a" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.922240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" event={"ID":"18d3919f-40c4-42fe-9bbb-86abb8b181a1","Type":"ContainerDied","Data":"be97def5348d47a887d2159ca316cdd7a98bcb7c08178011edbd11d789e86297"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.922265 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be97def5348d47a887d2159ca316cdd7a98bcb7c08178011edbd11d789e86297" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.923905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"ee849839-867d-45a9-8078-2d530cd62ff7","Type":"ContainerDied","Data":"4065247a532b3f5fb951766a5a2ef5194ef51bf1d69c95e0d6a897c682466fdd"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.923929 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4065247a532b3f5fb951766a5a2ef5194ef51bf1d69c95e0d6a897c682466fdd" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.926602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" event={"ID":"ddfa2ac9-c267-49e2-b203-7f5d736a16eb","Type":"ContainerDied","Data":"1b925a15dbcf3a761f5f52563849062d280c310938d9af78e0bc6dd35a41f77b"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.926654 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b925a15dbcf3a761f5f52563849062d280c310938d9af78e0bc6dd35a41f77b" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.928815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" event={"ID":"3da71fd1-0ca1-4e28-b702-d2fb5665627c","Type":"ContainerDied","Data":"d86982ec2920d3514b17a7c005af04b913b050258c317ac430aa68eb52e0c459"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.928876 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d86982ec2920d3514b17a7c005af04b913b050258c317ac430aa68eb52e0c459" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.931063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.931083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" event={"ID":"37ce1474-d401-43fc-9e17-4e5691d2b451","Type":"ContainerDied","Data":"1e4b51bf095ac780518be3d3e6514b21bfe9d5ef059b6d1e1b4f7bbbe9996288"} Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.931102 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e4b51bf095ac780518be3d3e6514b21bfe9d5ef059b6d1e1b4f7bbbe9996288" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.931141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.931074 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-77cdbfb47d-zxg6d" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.931730 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953090 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953116 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c4055bb-10f7-45d3-a0e1-0a70629f1813-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953127 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953162 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953175 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953211 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0de7b0-5c27-4052-a219-6b701aef6f6b-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953223 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3c0de7b0-5c27-4052-a219-6b701aef6f6b-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953232 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953242 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jbdjv\" (UniqueName: \"kubernetes.io/projected/3c0de7b0-5c27-4052-a219-6b701aef6f6b-kube-api-access-jbdjv\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.953254 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bed045d-dcfa-4235-a778-cc12b3ee6a6c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.953490 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:47:00 crc kubenswrapper[4769]: E1121 12:47:00.953670 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data podName:8ba57a49-8363-41c4-b411-40dcff3a84b1 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:08.953638153 +0000 UTC m=+3387.654300001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data") pod "rabbitmq-cell1-server-0" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:47:00 crc kubenswrapper[4769]: I1121 12:47:00.973404 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.054991 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.055062 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts podName:3943fea7-7c63-4205-95fd-f1a5587b6269 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:05.055043829 +0000 UTC m=+3383.755705647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts") pod "cinder37fb-account-delete-6brjl" (UID: "3943fea7-7c63-4205-95fd-f1a5587b6269") : configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.055129 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.055241 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts podName:ddfa2ac9-c267-49e2-b203-7f5d736a16eb nodeName:}" failed. No retries permitted until 2025-11-21 12:47:05.055215834 +0000 UTC m=+3383.755877682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts") pod "glanceca0f-account-delete-jjz99" (UID: "ddfa2ac9-c267-49e2-b203-7f5d736a16eb") : configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.055504 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.097737 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.097911 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.098053 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.107578 4769 scope.go:117] "RemoveContainer" containerID="c122bd85eed21f262f277dffad84a7fb6e2c9fb02f0223e40afc6a62b01422f5" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.110696 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.114234 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.114573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.118225 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.122183 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.122890 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" containerName="nova-cell0-conductor-conductor" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.122997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.127965 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.143801 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.159510 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.159635 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts podName:18d3919f-40c4-42fe-9bbb-86abb8b181a1 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:05.1596013 +0000 UTC m=+3383.860263118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts") pod "placement6868-account-delete-wmplj" (UID: "18d3919f-40c4-42fe-9bbb-86abb8b181a1") : configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.159655 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.159752 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts podName:3da71fd1-0ca1-4e28-b702-d2fb5665627c nodeName:}" failed. No retries permitted until 2025-11-21 12:47:05.159717584 +0000 UTC m=+3383.860379402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts") pod "barbican8f44-account-delete-r5kbv" (UID: "3da71fd1-0ca1-4e28-b702-d2fb5665627c") : configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.159968 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: E1121 12:47:01.160012 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts podName:9400fe9a-0cca-4e21-b857-d4ae307e6ef6 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:05.159997501 +0000 UTC m=+3383.860659319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts") pod "neutronc15e-account-delete-vvw9t" (UID: "9400fe9a-0cca-4e21-b857-d4ae307e6ef6") : configmap "openstack-scripts" not found Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.160861 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.173854 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.174431 4769 scope.go:117] "RemoveContainer" containerID="bc668555cfef713e4ab92611d15c81fa282a638ecb567817cae478b23daa48ae" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.180793 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.199069 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.206674 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.231377 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.231586 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.235693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.244349 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-combined-ca-bundle\") pod \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-public-tls-certs\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-logs\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-scripts\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-httpd-run\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data-custom\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbqcs\" (UniqueName: \"kubernetes.io/projected/7e7510e8-fd68-404b-9774-ce64060e8857-kube-api-access-pbqcs\") pod \"7e7510e8-fd68-404b-9774-ce64060e8857\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/229177f2-bc85-4c53-86e2-9daab3200250-etc-machine-id\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx7jk\" (UniqueName: \"kubernetes.io/projected/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-kube-api-access-zx7jk\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-scripts\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260835 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/229177f2-bc85-4c53-86e2-9daab3200250-logs\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmr7w\" (UniqueName: \"kubernetes.io/projected/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-kube-api-access-tmr7w\") pod \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260895 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-internal-tls-certs\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data\") pod \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.260980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-config-data\") pod \"7e7510e8-fd68-404b-9774-ce64060e8857\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-combined-ca-bundle\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-logs\") pod \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-scripts\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-httpd-run\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-combined-ca-bundle\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data-custom\") pod \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\" (UID: \"72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-combined-ca-bundle\") pod \"7e7510e8-fd68-404b-9774-ce64060e8857\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-config-data\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-public-tls-certs\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-config-data\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-internal-tls-certs\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-logs\") pod \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\" (UID: \"ad3fd932-0bbe-42b5-82d0-a7c427395cf6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szltf\" (UniqueName: \"kubernetes.io/projected/d2849a02-b828-4f2a-8d0a-bc4b36da1357-kube-api-access-szltf\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e7510e8-fd68-404b-9774-ce64060e8857-logs\") pod \"7e7510e8-fd68-404b-9774-ce64060e8857\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-combined-ca-bundle\") pod \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\" (UID: \"d2849a02-b828-4f2a-8d0a-bc4b36da1357\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-nova-metadata-tls-certs\") pod \"7e7510e8-fd68-404b-9774-ce64060e8857\" (UID: \"7e7510e8-fd68-404b-9774-ce64060e8857\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.261991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvdch\" (UniqueName: \"kubernetes.io/projected/229177f2-bc85-4c53-86e2-9daab3200250-kube-api-access-zvdch\") pod \"229177f2-bc85-4c53-86e2-9daab3200250\" (UID: \"229177f2-bc85-4c53-86e2-9daab3200250\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.264983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229177f2-bc85-4c53-86e2-9daab3200250-logs" (OuterVolumeSpecName: "logs") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.265124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/229177f2-bc85-4c53-86e2-9daab3200250-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.267003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229177f2-bc85-4c53-86e2-9daab3200250-kube-api-access-zvdch" (OuterVolumeSpecName: "kube-api-access-zvdch") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "kube-api-access-zvdch". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.267579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-logs" (OuterVolumeSpecName: "logs") pod "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" (UID: "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.269338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e7510e8-fd68-404b-9774-ce64060e8857-kube-api-access-pbqcs" (OuterVolumeSpecName: "kube-api-access-pbqcs") pod "7e7510e8-fd68-404b-9774-ce64060e8857" (UID: "7e7510e8-fd68-404b-9774-ce64060e8857"). InnerVolumeSpecName "kube-api-access-pbqcs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.271417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-kube-api-access-zx7jk" (OuterVolumeSpecName: "kube-api-access-zx7jk") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "kube-api-access-zx7jk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.275022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.277920 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.284025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "glance") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.284496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e7510e8-fd68-404b-9774-ce64060e8857-logs" (OuterVolumeSpecName: "logs") pod "7e7510e8-fd68-404b-9774-ce64060e8857" (UID: "7e7510e8-fd68-404b-9774-ce64060e8857"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.284967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-logs" (OuterVolumeSpecName: "logs") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.285696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.284776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-scripts" (OuterVolumeSpecName: "scripts") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.286539 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-logs" (OuterVolumeSpecName: "logs") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.302343 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.302557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-scripts" (OuterVolumeSpecName: "scripts") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.302783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2849a02-b828-4f2a-8d0a-bc4b36da1357-kube-api-access-szltf" (OuterVolumeSpecName: "kube-api-access-szltf") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "kube-api-access-szltf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.302876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-scripts" (OuterVolumeSpecName: "scripts") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.303245 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" path="/var/lib/kubelet/pods/2c4055bb-10f7-45d3-a0e1-0a70629f1813/volumes" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.307954 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" path="/var/lib/kubelet/pods/30b662da-331f-4736-bfb7-a1c5f31c1ffa/volumes" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.309001 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" path="/var/lib/kubelet/pods/3c0de7b0-5c27-4052-a219-6b701aef6f6b/volumes" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.310064 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5d4b44e-5548-4cdb-a2ac-6192fec95c43" path="/var/lib/kubelet/pods/b5d4b44e-5548-4cdb-a2ac-6192fec95c43/volumes" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.310608 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8df2d2d-30ee-4db9-9417-8b754c24220a" path="/var/lib/kubelet/pods/d8df2d2d-30ee-4db9-9417-8b754c24220a/volumes" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.311128 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faaf5643-f2f2-43d2-83e3-30016afe164e" path="/var/lib/kubelet/pods/faaf5643-f2f2-43d2-83e3-30016afe164e/volumes" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.317834 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.321348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "glance") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.321570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.322803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" (UID: "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.323552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.329714 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.335480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-kube-api-access-tmr7w" (OuterVolumeSpecName: "kube-api-access-tmr7w") pod "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" (UID: "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb"). InnerVolumeSpecName "kube-api-access-tmr7w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.349362 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.351423 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.358204 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-77cdbfb47d-zxg6d"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-combined-ca-bundle\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhzr8\" (UniqueName: \"kubernetes.io/projected/f8c3fc37-e777-4549-b153-ad4965d13a8a-kube-api-access-zhzr8\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-scripts\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-config-data\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-combined-ca-bundle\") pod \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2qz8\" (UniqueName: \"kubernetes.io/projected/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-kube-api-access-b2qz8\") pod \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq2qc\" (UniqueName: \"kubernetes.io/projected/a0d74e83-a8b1-480f-8afb-b8ff9464350d-kube-api-access-tq2qc\") pod \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksns7\" (UniqueName: \"kubernetes.io/projected/ee849839-867d-45a9-8078-2d530cd62ff7-kube-api-access-ksns7\") pod \"ee849839-867d-45a9-8078-2d530cd62ff7\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-combined-ca-bundle\") pod \"ee849839-867d-45a9-8078-2d530cd62ff7\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-credential-keys\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-logs\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.364978 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-config-data\") pod \"ee849839-867d-45a9-8078-2d530cd62ff7\" (UID: \"ee849839-867d-45a9-8078-2d530cd62ff7\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-combined-ca-bundle\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-public-tls-certs\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts\") pod \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\" (UID: \"9400fe9a-0cca-4e21-b857-d4ae307e6ef6\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-internal-tls-certs\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365461 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-config-data\") pod \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\" (UID: \"a0d74e83-a8b1-480f-8afb-b8ff9464350d\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365501 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data-custom\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-fernet-keys\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-public-tls-certs\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtdjn\" (UniqueName: \"kubernetes.io/projected/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-kube-api-access-gtdjn\") pod \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\" (UID: \"ed71386e-c354-4139-b9cf-ea8f7a8d90d1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.365720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-internal-tls-certs\") pod \"f8c3fc37-e777-4549-b153-ad4965d13a8a\" (UID: \"f8c3fc37-e777-4549-b153-ad4965d13a8a\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366413 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-szltf\" (UniqueName: \"kubernetes.io/projected/d2849a02-b828-4f2a-8d0a-bc4b36da1357-kube-api-access-szltf\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366449 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e7510e8-fd68-404b-9774-ce64060e8857-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366468 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zvdch\" (UniqueName: \"kubernetes.io/projected/229177f2-bc85-4c53-86e2-9daab3200250-kube-api-access-zvdch\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366478 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366521 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366533 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366544 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d2849a02-b828-4f2a-8d0a-bc4b36da1357-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366556 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366568 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pbqcs\" (UniqueName: \"kubernetes.io/projected/7e7510e8-fd68-404b-9774-ce64060e8857-kube-api-access-pbqcs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366579 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/229177f2-bc85-4c53-86e2-9daab3200250-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366610 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zx7jk\" (UniqueName: \"kubernetes.io/projected/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-kube-api-access-zx7jk\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366620 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366631 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/229177f2-bc85-4c53-86e2-9daab3200250-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366642 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tmr7w\" (UniqueName: \"kubernetes.io/projected/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-kube-api-access-tmr7w\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366652 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366682 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366692 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366717 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366760 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.366772 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.368655 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.394698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e7510e8-fd68-404b-9774-ce64060e8857" (UID: "7e7510e8-fd68-404b-9774-ce64060e8857"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.396444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-logs" (OuterVolumeSpecName: "logs") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.396481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9400fe9a-0cca-4e21-b857-d4ae307e6ef6" (UID: "9400fe9a-0cca-4e21-b857-d4ae307e6ef6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.398379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" (UID: "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.398441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d74e83-a8b1-480f-8afb-b8ff9464350d-kube-api-access-tq2qc" (OuterVolumeSpecName: "kube-api-access-tq2qc") pod "a0d74e83-a8b1-480f-8afb-b8ff9464350d" (UID: "a0d74e83-a8b1-480f-8afb-b8ff9464350d"). InnerVolumeSpecName "kube-api-access-tq2qc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.398710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c3fc37-e777-4549-b153-ad4965d13a8a-kube-api-access-zhzr8" (OuterVolumeSpecName: "kube-api-access-zhzr8") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "kube-api-access-zhzr8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.398920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.399760 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-77cdbfb47d-zxg6d"] Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.408922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-kube-api-access-b2qz8" (OuterVolumeSpecName: "kube-api-access-b2qz8") pod "9400fe9a-0cca-4e21-b857-d4ae307e6ef6" (UID: "9400fe9a-0cca-4e21-b857-d4ae307e6ef6"). InnerVolumeSpecName "kube-api-access-b2qz8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.409037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.409217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee849839-867d-45a9-8078-2d530cd62ff7-kube-api-access-ksns7" (OuterVolumeSpecName: "kube-api-access-ksns7") pod "ee849839-867d-45a9-8078-2d530cd62ff7" (UID: "ee849839-867d-45a9-8078-2d530cd62ff7"). InnerVolumeSpecName "kube-api-access-ksns7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.410252 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.416948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-kube-api-access-gtdjn" (OuterVolumeSpecName: "kube-api-access-gtdjn") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "kube-api-access-gtdjn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.417102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-scripts" (OuterVolumeSpecName: "scripts") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.427723 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.11:8080/healthcheck\": dial tcp 10.217.1.11:8080: i/o timeout" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.432180 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.11:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.462852 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.468737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fg2v\" (UniqueName: \"kubernetes.io/projected/3da71fd1-0ca1-4e28-b702-d2fb5665627c-kube-api-access-8fg2v\") pod \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.468828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts\") pod \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.468857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frdnn\" (UniqueName: \"kubernetes.io/projected/37ce1474-d401-43fc-9e17-4e5691d2b451-kube-api-access-frdnn\") pod \"37ce1474-d401-43fc-9e17-4e5691d2b451\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.468980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjwvr\" (UniqueName: \"kubernetes.io/projected/18d3919f-40c4-42fe-9bbb-86abb8b181a1-kube-api-access-xjwvr\") pod \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\" (UID: \"18d3919f-40c4-42fe-9bbb-86abb8b181a1\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkjcj\" (UniqueName: \"kubernetes.io/projected/3943fea7-7c63-4205-95fd-f1a5587b6269-kube-api-access-zkjcj\") pod \"3943fea7-7c63-4205-95fd-f1a5587b6269\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4xxj\" (UniqueName: \"kubernetes.io/projected/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-kube-api-access-z4xxj\") pod \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts\") pod \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\" (UID: \"ddfa2ac9-c267-49e2-b203-7f5d736a16eb\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37ce1474-d401-43fc-9e17-4e5691d2b451-operator-scripts\") pod \"37ce1474-d401-43fc-9e17-4e5691d2b451\" (UID: \"37ce1474-d401-43fc-9e17-4e5691d2b451\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts\") pod \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\" (UID: \"3da71fd1-0ca1-4e28-b702-d2fb5665627c\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts\") pod \"3943fea7-7c63-4205-95fd-f1a5587b6269\" (UID: \"3943fea7-7c63-4205-95fd-f1a5587b6269\") " Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469859 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469878 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469889 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gtdjn\" (UniqueName: \"kubernetes.io/projected/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-kube-api-access-gtdjn\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469904 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zhzr8\" (UniqueName: \"kubernetes.io/projected/f8c3fc37-e777-4549-b153-ad4965d13a8a-kube-api-access-zhzr8\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469915 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469925 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469935 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b2qz8\" (UniqueName: \"kubernetes.io/projected/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-kube-api-access-b2qz8\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469945 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469955 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tq2qc\" (UniqueName: \"kubernetes.io/projected/a0d74e83-a8b1-480f-8afb-b8ff9464350d-kube-api-access-tq2qc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469965 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ksns7\" (UniqueName: \"kubernetes.io/projected/ee849839-867d-45a9-8078-2d530cd62ff7-kube-api-access-ksns7\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469974 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469983 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.469992 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9400fe9a-0cca-4e21-b857-d4ae307e6ef6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.470001 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.470011 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.473254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "18d3919f-40c4-42fe-9bbb-86abb8b181a1" (UID: "18d3919f-40c4-42fe-9bbb-86abb8b181a1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.473711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ddfa2ac9-c267-49e2-b203-7f5d736a16eb" (UID: "ddfa2ac9-c267-49e2-b203-7f5d736a16eb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.474221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3943fea7-7c63-4205-95fd-f1a5587b6269" (UID: "3943fea7-7c63-4205-95fd-f1a5587b6269"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.474223 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37ce1474-d401-43fc-9e17-4e5691d2b451-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "37ce1474-d401-43fc-9e17-4e5691d2b451" (UID: "37ce1474-d401-43fc-9e17-4e5691d2b451"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.474585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3da71fd1-0ca1-4e28-b702-d2fb5665627c" (UID: "3da71fd1-0ca1-4e28-b702-d2fb5665627c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.485550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.486425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da71fd1-0ca1-4e28-b702-d2fb5665627c-kube-api-access-8fg2v" (OuterVolumeSpecName: "kube-api-access-8fg2v") pod "3da71fd1-0ca1-4e28-b702-d2fb5665627c" (UID: "3da71fd1-0ca1-4e28-b702-d2fb5665627c"). InnerVolumeSpecName "kube-api-access-8fg2v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.488507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-kube-api-access-z4xxj" (OuterVolumeSpecName: "kube-api-access-z4xxj") pod "ddfa2ac9-c267-49e2-b203-7f5d736a16eb" (UID: "ddfa2ac9-c267-49e2-b203-7f5d736a16eb"). InnerVolumeSpecName "kube-api-access-z4xxj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.494833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ce1474-d401-43fc-9e17-4e5691d2b451-kube-api-access-frdnn" (OuterVolumeSpecName: "kube-api-access-frdnn") pod "37ce1474-d401-43fc-9e17-4e5691d2b451" (UID: "37ce1474-d401-43fc-9e17-4e5691d2b451"). InnerVolumeSpecName "kube-api-access-frdnn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.495315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d3919f-40c4-42fe-9bbb-86abb8b181a1-kube-api-access-xjwvr" (OuterVolumeSpecName: "kube-api-access-xjwvr") pod "18d3919f-40c4-42fe-9bbb-86abb8b181a1" (UID: "18d3919f-40c4-42fe-9bbb-86abb8b181a1"). InnerVolumeSpecName "kube-api-access-xjwvr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.500928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3943fea7-7c63-4205-95fd-f1a5587b6269-kube-api-access-zkjcj" (OuterVolumeSpecName: "kube-api-access-zkjcj") pod "3943fea7-7c63-4205-95fd-f1a5587b6269" (UID: "3943fea7-7c63-4205-95fd-f1a5587b6269"). InnerVolumeSpecName "kube-api-access-zkjcj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.502461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-config-data" (OuterVolumeSpecName: "config-data") pod "7e7510e8-fd68-404b-9774-ce64060e8857" (UID: "7e7510e8-fd68-404b-9774-ce64060e8857"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.529314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.556935 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.557255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee849839-867d-45a9-8078-2d530cd62ff7" (UID: "ee849839-867d-45a9-8078-2d530cd62ff7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.563312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571669 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z4xxj\" (UniqueName: \"kubernetes.io/projected/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-kube-api-access-z4xxj\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571703 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ddfa2ac9-c267-49e2-b203-7f5d736a16eb-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571715 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571726 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37ce1474-d401-43fc-9e17-4e5691d2b451-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571734 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da71fd1-0ca1-4e28-b702-d2fb5665627c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571746 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3943fea7-7c63-4205-95fd-f1a5587b6269-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571755 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571763 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8fg2v\" (UniqueName: \"kubernetes.io/projected/3da71fd1-0ca1-4e28-b702-d2fb5665627c-kube-api-access-8fg2v\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571772 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571781 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18d3919f-40c4-42fe-9bbb-86abb8b181a1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571790 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-frdnn\" (UniqueName: \"kubernetes.io/projected/37ce1474-d401-43fc-9e17-4e5691d2b451-kube-api-access-frdnn\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571799 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571808 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xjwvr\" (UniqueName: \"kubernetes.io/projected/18d3919f-40c4-42fe-9bbb-86abb8b181a1-kube-api-access-xjwvr\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571818 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571828 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.571839 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zkjcj\" (UniqueName: \"kubernetes.io/projected/3943fea7-7c63-4205-95fd-f1a5587b6269-kube-api-access-zkjcj\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.587794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.603447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.603600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data" (OuterVolumeSpecName: "config-data") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.607653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "229177f2-bc85-4c53-86e2-9daab3200250" (UID: "229177f2-bc85-4c53-86e2-9daab3200250"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.608514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data" (OuterVolumeSpecName: "config-data") pod "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" (UID: "72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.615278 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.620594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.628260 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.635267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a0d74e83-a8b1-480f-8afb-b8ff9464350d" (UID: "a0d74e83-a8b1-480f-8afb-b8ff9464350d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.639645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-config-data" (OuterVolumeSpecName: "config-data") pod "a0d74e83-a8b1-480f-8afb-b8ff9464350d" (UID: "a0d74e83-a8b1-480f-8afb-b8ff9464350d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.652870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-config-data" (OuterVolumeSpecName: "config-data") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.658258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-config-data" (OuterVolumeSpecName: "config-data") pod "ee849839-867d-45a9-8078-2d530cd62ff7" (UID: "ee849839-867d-45a9-8078-2d530cd62ff7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.664171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674518 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674548 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674559 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee849839-867d-45a9-8078-2d530cd62ff7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674584 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674595 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674605 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674614 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674623 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674633 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674642 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674651 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/229177f2-bc85-4c53-86e2-9daab3200250-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674663 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.674673 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0d74e83-a8b1-480f-8afb-b8ff9464350d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.686457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "7e7510e8-fd68-404b-9774-ce64060e8857" (UID: "7e7510e8-fd68-404b-9774-ce64060e8857"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.686517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data" (OuterVolumeSpecName: "config-data") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.703708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-config-data" (OuterVolumeSpecName: "config-data") pod "ad3fd932-0bbe-42b5-82d0-a7c427395cf6" (UID: "ad3fd932-0bbe-42b5-82d0-a7c427395cf6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.708653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ed71386e-c354-4139-b9cf-ea8f7a8d90d1" (UID: "ed71386e-c354-4139-b9cf-ea8f7a8d90d1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.726485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-config-data" (OuterVolumeSpecName: "config-data") pod "d2849a02-b828-4f2a-8d0a-bc4b36da1357" (UID: "d2849a02-b828-4f2a-8d0a-bc4b36da1357"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.776533 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d2849a02-b828-4f2a-8d0a-bc4b36da1357-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.776583 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad3fd932-0bbe-42b5-82d0-a7c427395cf6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.776595 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.776611 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e7510e8-fd68-404b-9774-ce64060e8857-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.776622 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed71386e-c354-4139-b9cf-ea8f7a8d90d1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.786491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f8c3fc37-e777-4549-b153-ad4965d13a8a" (UID: "f8c3fc37-e777-4549-b153-ad4965d13a8a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.879211 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f8c3fc37-e777-4549-b153-ad4965d13a8a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.952896 4769 generic.go:334] "Generic (PLEG): container finished" podID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerID="9e2e1cc67c6aa2e34674953ae3b8c63657f8647ec532fa841a91efb8df6a4e32" exitCode=0 Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.953024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1","Type":"ContainerDied","Data":"9e2e1cc67c6aa2e34674953ae3b8c63657f8647ec532fa841a91efb8df6a4e32"} Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.953118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1","Type":"ContainerDied","Data":"8a07a270af6269beb668fef549193e3e1de3a0b20c393e69067bf93c7b1971bb"} Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.953146 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a07a270af6269beb668fef549193e3e1de3a0b20c393e69067bf93c7b1971bb" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.957261 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerID="6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e" exitCode=0 Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.957390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2z2jt" event={"ID":"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26","Type":"ContainerDied","Data":"6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e"} Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.969044 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement6868-account-delete-wmplj" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.972427 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerID="4f3e3f2c1093f3f0b105c93aca74f71deb6ddf2bcd3d804498f0643b36a63f44" exitCode=0 Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.972505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8ba57a49-8363-41c4-b411-40dcff3a84b1","Type":"ContainerDied","Data":"4f3e3f2c1093f3f0b105c93aca74f71deb6ddf2bcd3d804498f0643b36a63f44"} Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.975015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glanceca0f-account-delete-jjz99" Nov 21 12:47:01 crc kubenswrapper[4769]: I1121 12:47:01.978071 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder37fb-account-delete-6brjl" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:01.999168 4769 generic.go:334] "Generic (PLEG): container finished" podID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerID="85a173c21fa7b6b4ca5f391845fc5064c5fe62d15d7e5f2a72adefc3d1a190a9" exitCode=1 Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:01.999333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" event={"ID":"29bef206-0bc0-43a4-9fc3-f8382be7ea45","Type":"ContainerDied","Data":"85a173c21fa7b6b4ca5f391845fc5064c5fe62d15d7e5f2a72adefc3d1a190a9"} Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:01.999388 4769 scope.go:117] "RemoveContainer" containerID="3c1bf2bd84f5f490964af46bf51a5e904ee4b404706f3548f37da6da79e7e8d8" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.011411 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_10edbd41-2f31-466a-94be-9b0d3bf334d8/ovn-northd/0.log" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.011506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"10edbd41-2f31-466a-94be-9b0d3bf334d8","Type":"ContainerDied","Data":"78e07d4864fb39bffde9c620ad80c58da519370331e54e5bf48fc399d52a2fb1"} Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.011535 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78e07d4864fb39bffde9c620ad80c58da519370331e54e5bf48fc399d52a2fb1" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.030149 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.032150 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.032183 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.032167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" event={"ID":"74667797-02dc-4a11-95fe-97d24a539e51","Type":"ContainerStarted","Data":"4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace"} Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033277 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033329 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronc15e-account-delete-vvw9t" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033350 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone2f46-account-delete-2hg6v" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033390 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033427 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033457 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-77c6665cf8-s6vm9" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033539 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8f44-account-delete-r5kbv" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033574 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi4224-account-delete-kcwdp" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.033637 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.131028 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_10edbd41-2f31-466a-94be-9b0d3bf334d8/ovn-northd/0.log" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.131857 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.149514 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" podStartSLOduration=8.149486739 podStartE2EDuration="8.149486739s" podCreationTimestamp="2025-11-21 12:46:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:47:02.118926895 +0000 UTC m=+3380.819588733" watchObservedRunningTime="2025-11-21 12:47:02.149486739 +0000 UTC m=+3380.850148567" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.279610 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-combined-ca-bundle\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-rundir\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288739 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-scripts\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-config\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxknl\" (UniqueName: \"kubernetes.io/projected/10edbd41-2f31-466a-94be-9b0d3bf334d8-kube-api-access-jxknl\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-northd-tls-certs\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.288962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-metrics-certs-tls-certs\") pod \"10edbd41-2f31-466a-94be-9b0d3bf334d8\" (UID: \"10edbd41-2f31-466a-94be-9b0d3bf334d8\") " Nov 21 12:47:02 crc kubenswrapper[4769]: E1121 12:47:02.289709 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:47:02 crc kubenswrapper[4769]: E1121 12:47:02.289761 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts podName:29bef206-0bc0-43a4-9fc3-f8382be7ea45 nodeName:}" failed. No retries permitted until 2025-11-21 12:47:06.289745224 +0000 UTC m=+3384.990407042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts") pod "novacell0b8ba-account-delete-ngs4m" (UID: "29bef206-0bc0-43a4-9fc3-f8382be7ea45") : configmap "openstack-scripts" not found Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.290326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-scripts" (OuterVolumeSpecName: "scripts") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.291713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-config" (OuterVolumeSpecName: "config") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.293201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.301872 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glanceca0f-account-delete-jjz99"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.310693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10edbd41-2f31-466a-94be-9b0d3bf334d8-kube-api-access-jxknl" (OuterVolumeSpecName: "kube-api-access-jxknl") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "kube-api-access-jxknl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.311964 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.344769 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glanceca0f-account-delete-jjz99"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.354513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.354615 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.33:6080/vnc_lite.html\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.364577 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder37fb-account-delete-6brjl"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.373908 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder37fb-account-delete-6brjl"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-tls\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-erlang-cookie\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-plugins-conf\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-server-conf\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-erlang-cookie-secret\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-erlang-cookie\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.401290 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.390801 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-confd\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.404934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.404959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-tls\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.404997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-pod-info\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-plugins\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-confd\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpwd8\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-kube-api-access-hpwd8\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-server-conf\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8ba57a49-8363-41c4-b411-40dcff3a84b1-pod-info\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405251 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-plugins\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-plugins-conf\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data\") pod \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\" (UID: \"358ea7e8-fdf4-4096-948a-a1cd27a5a1c1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsz4m\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-kube-api-access-qsz4m\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8ba57a49-8363-41c4-b411-40dcff3a84b1-erlang-cookie-secret\") pod \"8ba57a49-8363-41c4-b411-40dcff3a84b1\" (UID: \"8ba57a49-8363-41c4-b411-40dcff3a84b1\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.405983 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.406000 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/10edbd41-2f31-466a-94be-9b0d3bf334d8-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.406009 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jxknl\" (UniqueName: \"kubernetes.io/projected/10edbd41-2f31-466a-94be-9b0d3bf334d8-kube-api-access-jxknl\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.406019 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.406028 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.406036 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.406625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.407236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.412005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.412058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.412773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "persistence") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.413041 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.413203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.413353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.414875 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ba57a49-8363-41c4-b411-40dcff3a84b1-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.417523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-pod-info" (OuterVolumeSpecName: "pod-info") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.420029 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement6868-account-delete-wmplj"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.423696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-kube-api-access-hpwd8" (OuterVolumeSpecName: "kube-api-access-hpwd8") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "kube-api-access-hpwd8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.428468 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.432039 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement6868-account-delete-wmplj"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.432160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-kube-api-access-qsz4m" (OuterVolumeSpecName: "kube-api-access-qsz4m") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "kube-api-access-qsz4m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.435990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "persistence") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.436453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.443735 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.444695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ba57a49-8363-41c4-b411-40dcff3a84b1-pod-info" (OuterVolumeSpecName: "pod-info") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.445082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data" (OuterVolumeSpecName: "config-data") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.454397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.457297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.473474 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.476814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "10edbd41-2f31-466a-94be-9b0d3bf334d8" (UID: "10edbd41-2f31-466a-94be-9b0d3bf334d8"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.480854 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74dd8d9f6c-4tmrl"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.489845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-server-conf" (OuterVolumeSpecName: "server-conf") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.504266 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht6zn\" (UniqueName: \"kubernetes.io/projected/29bef206-0bc0-43a4-9fc3-f8382be7ea45-kube-api-access-ht6zn\") pod \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts\") pod \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\" (UID: \"29bef206-0bc0-43a4-9fc3-f8382be7ea45\") " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509750 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509772 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509782 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509791 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509802 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509835 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509848 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hpwd8\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-kube-api-access-hpwd8\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509861 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8ba57a49-8363-41c4-b411-40dcff3a84b1-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509873 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509885 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509896 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qsz4m\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-kube-api-access-qsz4m\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509909 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8ba57a49-8363-41c4-b411-40dcff3a84b1-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509922 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509942 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509953 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509966 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509976 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/10edbd41-2f31-466a-94be-9b0d3bf334d8-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509986 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.509997 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.510434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "29bef206-0bc0-43a4-9fc3-f8382be7ea45" (UID: "29bef206-0bc0-43a4-9fc3-f8382be7ea45"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.513938 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data" (OuterVolumeSpecName: "config-data") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.521167 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.521720 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bef206-0bc0-43a4-9fc3-f8382be7ea45-kube-api-access-ht6zn" (OuterVolumeSpecName: "kube-api-access-ht6zn") pod "29bef206-0bc0-43a4-9fc3-f8382be7ea45" (UID: "29bef206-0bc0-43a4-9fc3-f8382be7ea45"). InnerVolumeSpecName "kube-api-access-ht6zn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.523447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-server-conf" (OuterVolumeSpecName: "server-conf") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.533770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.539300 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.551552 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-77c6665cf8-s6vm9"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.556258 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.576230 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-77c6665cf8-s6vm9"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.589118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican8f44-account-delete-r5kbv"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.594111 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican8f44-account-delete-r5kbv"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.616800 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.620137 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.620158 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29bef206-0bc0-43a4-9fc3-f8382be7ea45-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.620168 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.620179 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8ba57a49-8363-41c4-b411-40dcff3a84b1-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.620207 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ht6zn\" (UniqueName: \"kubernetes.io/projected/29bef206-0bc0-43a4-9fc3-f8382be7ea45-kube-api-access-ht6zn\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.620215 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.626490 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone2f46-account-delete-2hg6v"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.640886 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone2f46-account-delete-2hg6v"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.649558 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.655443 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.660707 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.661696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "8ba57a49-8363-41c4-b411-40dcff3a84b1" (UID: "8ba57a49-8363-41c4-b411-40dcff3a84b1"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.666020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" (UID: "358ea7e8-fdf4-4096-948a-a1cd27a5a1c1"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.666087 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-c7b57cd5b-klmpp"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.670982 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.675338 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.680574 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronc15e-account-delete-vvw9t"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.685230 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutronc15e-account-delete-vvw9t"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.689650 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi4224-account-delete-kcwdp"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.694067 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi4224-account-delete-kcwdp"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.702259 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.702668 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.724099 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.724146 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/89d5f45d-75ad-4319-839a-011182707a5a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.724161 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8ba57a49-8363-41c4-b411-40dcff3a84b1-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:02 crc kubenswrapper[4769]: I1121 12:47:02.724176 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-557dk\" (UniqueName: \"kubernetes.io/projected/89d5f45d-75ad-4319-839a-011182707a5a-kube-api-access-557dk\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.052477 4769 generic.go:334] "Generic (PLEG): container finished" podID="2956e126-fdb7-48f8-866d-fd679d38c050" containerID="3b6e58bf8cdbcf61e584df01168d1f8db62aaff6bb9436e2b866a33414e50430" exitCode=0 Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.052541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" event={"ID":"2956e126-fdb7-48f8-866d-fd679d38c050","Type":"ContainerDied","Data":"3b6e58bf8cdbcf61e584df01168d1f8db62aaff6bb9436e2b866a33414e50430"} Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.066309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8ba57a49-8363-41c4-b411-40dcff3a84b1","Type":"ContainerDied","Data":"ee3a4786812ba8321b30f308b4116b4cd01181a8911e2554142f4d33e000ca67"} Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.066369 4769 scope.go:117] "RemoveContainer" containerID="4f3e3f2c1093f3f0b105c93aca74f71deb6ddf2bcd3d804498f0643b36a63f44" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.066547 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.077440 4769 generic.go:334] "Generic (PLEG): container finished" podID="45969258-6de5-4b79-ba45-c82a31743fc5" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" exitCode=0 Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.077782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45969258-6de5-4b79-ba45-c82a31743fc5","Type":"ContainerDied","Data":"587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa"} Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.083996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" event={"ID":"29bef206-0bc0-43a4-9fc3-f8382be7ea45","Type":"ContainerDied","Data":"d7e46e1533127fbe2ef8d8217b2662b12311f313955aa4a8f25b41f24ddb9883"} Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.084090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.107750 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.108255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2z2jt" event={"ID":"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26","Type":"ContainerStarted","Data":"eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2"} Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.108420 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.109438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.140145 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-2z2jt" podStartSLOduration=7.440737725 podStartE2EDuration="10.140120138s" podCreationTimestamp="2025-11-21 12:46:53 +0000 UTC" firstStartedPulling="2025-11-21 12:46:59.687478951 +0000 UTC m=+3378.388140769" lastFinishedPulling="2025-11-21 12:47:02.386861364 +0000 UTC m=+3381.087523182" observedRunningTime="2025-11-21 12:47:03.130301553 +0000 UTC m=+3381.830963371" watchObservedRunningTime="2025-11-21 12:47:03.140120138 +0000 UTC m=+3381.840781956" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.168061 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.176849 4769 scope.go:117] "RemoveContainer" containerID="caf338fde4549ca5d2634d4635bfd88cb3fe3d186dfb81862b83c38a8fee3534" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.219330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.220341 4769 scope.go:117] "RemoveContainer" containerID="85a173c21fa7b6b4ca5f391845fc5064c5fe62d15d7e5f2a72adefc3d1a190a9" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.227408 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.240098 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.260589 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.265067 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.291035 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" path="/var/lib/kubelet/pods/10edbd41-2f31-466a-94be-9b0d3bf334d8/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.291664 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" path="/var/lib/kubelet/pods/18d3919f-40c4-42fe-9bbb-86abb8b181a1/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.292212 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="229177f2-bc85-4c53-86e2-9daab3200250" path="/var/lib/kubelet/pods/229177f2-bc85-4c53-86e2-9daab3200250/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.293522 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" path="/var/lib/kubelet/pods/2bed045d-dcfa-4235-a778-cc12b3ee6a6c/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.294296 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" path="/var/lib/kubelet/pods/358ea7e8-fdf4-4096-948a-a1cd27a5a1c1/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.295464 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37ce1474-d401-43fc-9e17-4e5691d2b451" path="/var/lib/kubelet/pods/37ce1474-d401-43fc-9e17-4e5691d2b451/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.295943 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" path="/var/lib/kubelet/pods/3943fea7-7c63-4205-95fd-f1a5587b6269/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.296417 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" path="/var/lib/kubelet/pods/3da71fd1-0ca1-4e28-b702-d2fb5665627c/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.297580 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" path="/var/lib/kubelet/pods/72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.298280 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" path="/var/lib/kubelet/pods/7e7510e8-fd68-404b-9774-ce64060e8857/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.298732 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d5f45d-75ad-4319-839a-011182707a5a" path="/var/lib/kubelet/pods/89d5f45d-75ad-4319-839a-011182707a5a/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.299025 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" path="/var/lib/kubelet/pods/9400fe9a-0cca-4e21-b857-d4ae307e6ef6/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.300158 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" path="/var/lib/kubelet/pods/a0d74e83-a8b1-480f-8afb-b8ff9464350d/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.300905 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" path="/var/lib/kubelet/pods/ad3fd932-0bbe-42b5-82d0-a7c427395cf6/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.301605 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" path="/var/lib/kubelet/pods/d2849a02-b828-4f2a-8d0a-bc4b36da1357/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.302693 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" path="/var/lib/kubelet/pods/ddfa2ac9-c267-49e2-b203-7f5d736a16eb/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.304444 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" path="/var/lib/kubelet/pods/ed71386e-c354-4139-b9cf-ea8f7a8d90d1/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.305881 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee849839-867d-45a9-8078-2d530cd62ff7" path="/var/lib/kubelet/pods/ee849839-867d-45a9-8078-2d530cd62ff7/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.306412 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c3fc37-e777-4549-b153-ad4965d13a8a" path="/var/lib/kubelet/pods/f8c3fc37-e777-4549-b153-ad4965d13a8a/volumes" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.312271 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.312310 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.312329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.312351 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell0b8ba-account-delete-ngs4m"] Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.333386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw924\" (UniqueName: \"kubernetes.io/projected/2956e126-fdb7-48f8-866d-fd679d38c050-kube-api-access-rw924\") pod \"2956e126-fdb7-48f8-866d-fd679d38c050\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.334369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2956e126-fdb7-48f8-866d-fd679d38c050-logs\") pod \"2956e126-fdb7-48f8-866d-fd679d38c050\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.334435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data-custom\") pod \"2956e126-fdb7-48f8-866d-fd679d38c050\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.334495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-combined-ca-bundle\") pod \"45969258-6de5-4b79-ba45-c82a31743fc5\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.334567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-combined-ca-bundle\") pod \"2956e126-fdb7-48f8-866d-fd679d38c050\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.335396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcdvk\" (UniqueName: \"kubernetes.io/projected/45969258-6de5-4b79-ba45-c82a31743fc5-kube-api-access-wcdvk\") pod \"45969258-6de5-4b79-ba45-c82a31743fc5\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.334877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2956e126-fdb7-48f8-866d-fd679d38c050-logs" (OuterVolumeSpecName: "logs") pod "2956e126-fdb7-48f8-866d-fd679d38c050" (UID: "2956e126-fdb7-48f8-866d-fd679d38c050"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.335642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data\") pod \"2956e126-fdb7-48f8-866d-fd679d38c050\" (UID: \"2956e126-fdb7-48f8-866d-fd679d38c050\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.335677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-config-data\") pod \"45969258-6de5-4b79-ba45-c82a31743fc5\" (UID: \"45969258-6de5-4b79-ba45-c82a31743fc5\") " Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.336307 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2956e126-fdb7-48f8-866d-fd679d38c050-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.339369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45969258-6de5-4b79-ba45-c82a31743fc5-kube-api-access-wcdvk" (OuterVolumeSpecName: "kube-api-access-wcdvk") pod "45969258-6de5-4b79-ba45-c82a31743fc5" (UID: "45969258-6de5-4b79-ba45-c82a31743fc5"). InnerVolumeSpecName "kube-api-access-wcdvk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.339426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2956e126-fdb7-48f8-866d-fd679d38c050-kube-api-access-rw924" (OuterVolumeSpecName: "kube-api-access-rw924") pod "2956e126-fdb7-48f8-866d-fd679d38c050" (UID: "2956e126-fdb7-48f8-866d-fd679d38c050"). InnerVolumeSpecName "kube-api-access-rw924". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.339509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2956e126-fdb7-48f8-866d-fd679d38c050" (UID: "2956e126-fdb7-48f8-866d-fd679d38c050"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.368818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2956e126-fdb7-48f8-866d-fd679d38c050" (UID: "2956e126-fdb7-48f8-866d-fd679d38c050"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.371091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-config-data" (OuterVolumeSpecName: "config-data") pod "45969258-6de5-4b79-ba45-c82a31743fc5" (UID: "45969258-6de5-4b79-ba45-c82a31743fc5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.373451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45969258-6de5-4b79-ba45-c82a31743fc5" (UID: "45969258-6de5-4b79-ba45-c82a31743fc5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.405289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data" (OuterVolumeSpecName: "config-data") pod "2956e126-fdb7-48f8-866d-fd679d38c050" (UID: "2956e126-fdb7-48f8-866d-fd679d38c050"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438254 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438293 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438306 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rw924\" (UniqueName: \"kubernetes.io/projected/2956e126-fdb7-48f8-866d-fd679d38c050-kube-api-access-rw924\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438320 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438332 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45969258-6de5-4b79-ba45-c82a31743fc5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438343 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2956e126-fdb7-48f8-866d-fd679d38c050-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:03 crc kubenswrapper[4769]: I1121 12:47:03.438353 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wcdvk\" (UniqueName: \"kubernetes.io/projected/45969258-6de5-4b79-ba45-c82a31743fc5-kube-api-access-wcdvk\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.046546 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.046997 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.124646 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.125554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"45969258-6de5-4b79-ba45-c82a31743fc5","Type":"ContainerDied","Data":"6481a3bc2c87efd05f17f554dfcadc28fe1766460d9d05d56ef71e263e0a2342"} Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.125627 4769 scope.go:117] "RemoveContainer" containerID="587d8114bb16faaf050e545cd7be5af4a5a9a76583bac39bd30a4872da5979aa" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.135374 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.136735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6" event={"ID":"2956e126-fdb7-48f8-866d-fd679d38c050","Type":"ContainerDied","Data":"fa984eda1d305f30d4dbad90229b185f364a4bba2f503a6684fe83fe29db092d"} Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.169355 4769 scope.go:117] "RemoveContainer" containerID="3b6e58bf8cdbcf61e584df01168d1f8db62aaff6bb9436e2b866a33414e50430" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.187716 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.209250 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.209742 4769 scope.go:117] "RemoveContainer" containerID="b3c83b15f3932426877c440dd7e11ad9cc8e803b59286cb80e88df7c49803066" Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.221295 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6"] Nov 21 12:47:04 crc kubenswrapper[4769]: I1121 12:47:04.234201 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b6dbd5996-nnzg6"] Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.132050 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-2z2jt" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="registry-server" probeResult="failure" output=< Nov 21 12:47:05 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:47:05 crc kubenswrapper[4769]: > Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.309269 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" path="/var/lib/kubelet/pods/2956e126-fdb7-48f8-866d-fd679d38c050/volumes" Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.310046 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" path="/var/lib/kubelet/pods/29bef206-0bc0-43a4-9fc3-f8382be7ea45/volumes" Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.311156 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" path="/var/lib/kubelet/pods/45969258-6de5-4b79-ba45-c82a31743fc5/volumes" Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.312638 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" path="/var/lib/kubelet/pods/8ba57a49-8363-41c4-b411-40dcff3a84b1/volumes" Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.767332 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.898849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-combined-ca-bundle\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.898947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.898994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-ovndb-tls-certs\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.899031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-internal-tls-certs\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.899126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-httpd-config\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.899168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-public-tls-certs\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.899237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwj2v\" (UniqueName: \"kubernetes.io/projected/324118dd-eff5-47ce-aae2-ab2155ab1bd8-kube-api-access-rwj2v\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.929151 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/324118dd-eff5-47ce-aae2-ab2155ab1bd8-kube-api-access-rwj2v" (OuterVolumeSpecName: "kube-api-access-rwj2v") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "kube-api-access-rwj2v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:05 crc kubenswrapper[4769]: I1121 12:47:05.936127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.003373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config" (OuterVolumeSpecName: "config") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.003659 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config\") pod \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\" (UID: \"324118dd-eff5-47ce-aae2-ab2155ab1bd8\") " Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.004374 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.004392 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rwj2v\" (UniqueName: \"kubernetes.io/projected/324118dd-eff5-47ce-aae2-ab2155ab1bd8-kube-api-access-rwj2v\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: W1121 12:47:06.004453 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/324118dd-eff5-47ce-aae2-ab2155ab1bd8/volumes/kubernetes.io~secret/config Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.004461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config" (OuterVolumeSpecName: "config") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.021373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.032381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.050351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.051350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "324118dd-eff5-47ce-aae2-ab2155ab1bd8" (UID: "324118dd-eff5-47ce-aae2-ab2155ab1bd8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.106040 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.106082 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.106094 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.106102 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.106114 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/324118dd-eff5-47ce-aae2-ab2155ab1bd8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.164931 4769 generic.go:334] "Generic (PLEG): container finished" podID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerID="7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb" exitCode=0 Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.164979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" event={"ID":"324118dd-eff5-47ce-aae2-ab2155ab1bd8","Type":"ContainerDied","Data":"7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb"} Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.165015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" event={"ID":"324118dd-eff5-47ce-aae2-ab2155ab1bd8","Type":"ContainerDied","Data":"4707e0a0ff490caa9e39e06ccd1fce845f884777fa50c81f6d540308d3b9ed23"} Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.165019 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5885cb869d-qjsvb" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.165033 4769 scope.go:117] "RemoveContainer" containerID="e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.200681 4769 scope.go:117] "RemoveContainer" containerID="7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.219582 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5885cb869d-qjsvb"] Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.233300 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5885cb869d-qjsvb"] Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.234693 4769 scope.go:117] "RemoveContainer" containerID="e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904" Nov 21 12:47:06 crc kubenswrapper[4769]: E1121 12:47:06.235134 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904\": container with ID starting with e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904 not found: ID does not exist" containerID="e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.235167 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904"} err="failed to get container status \"e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904\": rpc error: code = NotFound desc = could not find container \"e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904\": container with ID starting with e9b5a5874aa63a6d21ce584b55036a879bf0e5f8bca7bb5232017db9dd547904 not found: ID does not exist" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.235205 4769 scope.go:117] "RemoveContainer" containerID="7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb" Nov 21 12:47:06 crc kubenswrapper[4769]: E1121 12:47:06.235426 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb\": container with ID starting with 7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb not found: ID does not exist" containerID="7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.235444 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb"} err="failed to get container status \"7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb\": rpc error: code = NotFound desc = could not find container \"7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb\": container with ID starting with 7d46eabe6118fe8551b3ace9831e6fa7505836eac7e533de5f7200ce18c8aadb not found: ID does not exist" Nov 21 12:47:06 crc kubenswrapper[4769]: I1121 12:47:06.822696 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.214:5671: i/o timeout" Nov 21 12:47:07 crc kubenswrapper[4769]: I1121 12:47:07.246643 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.215:5671: i/o timeout" Nov 21 12:47:07 crc kubenswrapper[4769]: I1121 12:47:07.292821 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" path="/var/lib/kubelet/pods/324118dd-eff5-47ce-aae2-ab2155ab1bd8/volumes" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.084587 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.149338 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk"] Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.149675 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerName="dnsmasq-dns" containerID="cri-o://f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5" gracePeriod=10 Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.662301 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.792805 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dnsmasq-svc\") pod \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.792887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-config\") pod \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.793167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dns-swift-storage-0\") pod \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.793932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnbpw\" (UniqueName: \"kubernetes.io/projected/8870f588-dcd9-4a29-a1af-28d085ee8c1e-kube-api-access-fnbpw\") pod \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\" (UID: \"8870f588-dcd9-4a29-a1af-28d085ee8c1e\") " Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.800374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8870f588-dcd9-4a29-a1af-28d085ee8c1e-kube-api-access-fnbpw" (OuterVolumeSpecName: "kube-api-access-fnbpw") pod "8870f588-dcd9-4a29-a1af-28d085ee8c1e" (UID: "8870f588-dcd9-4a29-a1af-28d085ee8c1e"). InnerVolumeSpecName "kube-api-access-fnbpw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.855950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "8870f588-dcd9-4a29-a1af-28d085ee8c1e" (UID: "8870f588-dcd9-4a29-a1af-28d085ee8c1e"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.859714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "8870f588-dcd9-4a29-a1af-28d085ee8c1e" (UID: "8870f588-dcd9-4a29-a1af-28d085ee8c1e"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.859977 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-config" (OuterVolumeSpecName: "config") pod "8870f588-dcd9-4a29-a1af-28d085ee8c1e" (UID: "8870f588-dcd9-4a29-a1af-28d085ee8c1e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.896132 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.896175 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fnbpw\" (UniqueName: \"kubernetes.io/projected/8870f588-dcd9-4a29-a1af-28d085ee8c1e-kube-api-access-fnbpw\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.896204 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:10 crc kubenswrapper[4769]: I1121 12:47:10.896212 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8870f588-dcd9-4a29-a1af-28d085ee8c1e-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.253611 4769 generic.go:334] "Generic (PLEG): container finished" podID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerID="f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5" exitCode=0 Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.253794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" event={"ID":"8870f588-dcd9-4a29-a1af-28d085ee8c1e","Type":"ContainerDied","Data":"f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5"} Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.254130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" event={"ID":"8870f588-dcd9-4a29-a1af-28d085ee8c1e","Type":"ContainerDied","Data":"994693a73c2520c68ee95561e2aad118e5d64f3564424e9ab7bfb8296b39cc19"} Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.253954 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.254171 4769 scope.go:117] "RemoveContainer" containerID="f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.312459 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk"] Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.314716 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5688dfc9c-kq7kk"] Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.321018 4769 scope.go:117] "RemoveContainer" containerID="32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.359151 4769 scope.go:117] "RemoveContainer" containerID="f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5" Nov 21 12:47:11 crc kubenswrapper[4769]: E1121 12:47:11.359641 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5\": container with ID starting with f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5 not found: ID does not exist" containerID="f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.359691 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5"} err="failed to get container status \"f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5\": rpc error: code = NotFound desc = could not find container \"f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5\": container with ID starting with f6a9bfbd802c90a61a09f760476bd238c2f24589b80de286be6e29f1060358e5 not found: ID does not exist" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.359718 4769 scope.go:117] "RemoveContainer" containerID="32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a" Nov 21 12:47:11 crc kubenswrapper[4769]: E1121 12:47:11.360247 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a\": container with ID starting with 32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a not found: ID does not exist" containerID="32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a" Nov 21 12:47:11 crc kubenswrapper[4769]: I1121 12:47:11.360325 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a"} err="failed to get container status \"32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a\": rpc error: code = NotFound desc = could not find container \"32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a\": container with ID starting with 32d7e3a85feaecb6c5dcdc4b24dff9d47d20a8c0c784dec78c972329225b910a not found: ID does not exist" Nov 21 12:47:13 crc kubenswrapper[4769]: I1121 12:47:13.286793 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" path="/var/lib/kubelet/pods/8870f588-dcd9-4a29-a1af-28d085ee8c1e/volumes" Nov 21 12:47:14 crc kubenswrapper[4769]: I1121 12:47:14.126944 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:47:14 crc kubenswrapper[4769]: I1121 12:47:14.204850 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:47:14 crc kubenswrapper[4769]: I1121 12:47:14.385331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-2z2jt"] Nov 21 12:47:15 crc kubenswrapper[4769]: I1121 12:47:15.314319 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-2z2jt" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="registry-server" containerID="cri-o://eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2" gracePeriod=2 Nov 21 12:47:15 crc kubenswrapper[4769]: I1121 12:47:15.830844 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.003055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-catalog-content\") pod \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.003284 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-utilities\") pod \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.003333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc9sv\" (UniqueName: \"kubernetes.io/projected/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-kube-api-access-rc9sv\") pod \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\" (UID: \"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26\") " Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.004458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-utilities" (OuterVolumeSpecName: "utilities") pod "fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" (UID: "fe87338c-6ebd-46a9-8740-3f6b3b5e2d26"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.014465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-kube-api-access-rc9sv" (OuterVolumeSpecName: "kube-api-access-rc9sv") pod "fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" (UID: "fe87338c-6ebd-46a9-8740-3f6b3b5e2d26"). InnerVolumeSpecName "kube-api-access-rc9sv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.106423 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.106476 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rc9sv\" (UniqueName: \"kubernetes.io/projected/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-kube-api-access-rc9sv\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.135700 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" (UID: "fe87338c-6ebd-46a9-8740-3f6b3b5e2d26"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.208970 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.327613 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerID="eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2" exitCode=0 Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.327666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2z2jt" event={"ID":"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26","Type":"ContainerDied","Data":"eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2"} Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.327734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2z2jt" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.327772 4769 scope.go:117] "RemoveContainer" containerID="eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.327749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2z2jt" event={"ID":"fe87338c-6ebd-46a9-8740-3f6b3b5e2d26","Type":"ContainerDied","Data":"54885e320f5117c37d4755a6fad138b321e5c9be75914cd7978aca766f2e4f4b"} Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.369899 4769 scope.go:117] "RemoveContainer" containerID="6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.374125 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-2z2jt"] Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.383132 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-2z2jt"] Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.394079 4769 scope.go:117] "RemoveContainer" containerID="ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.447847 4769 scope.go:117] "RemoveContainer" containerID="eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2" Nov 21 12:47:16 crc kubenswrapper[4769]: E1121 12:47:16.448611 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2\": container with ID starting with eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2 not found: ID does not exist" containerID="eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.448677 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2"} err="failed to get container status \"eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2\": rpc error: code = NotFound desc = could not find container \"eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2\": container with ID starting with eb7e2747a709d002554c257342f062116a3b3f0fe0d72a03b20f83a8c7b4abc2 not found: ID does not exist" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.448724 4769 scope.go:117] "RemoveContainer" containerID="6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e" Nov 21 12:47:16 crc kubenswrapper[4769]: E1121 12:47:16.449253 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e\": container with ID starting with 6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e not found: ID does not exist" containerID="6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.449299 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e"} err="failed to get container status \"6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e\": rpc error: code = NotFound desc = could not find container \"6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e\": container with ID starting with 6d4308a7303fcdda0c89e6fcde003c9a8cdbbabe01a7d024063d0753de38065e not found: ID does not exist" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.449325 4769 scope.go:117] "RemoveContainer" containerID="ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d" Nov 21 12:47:16 crc kubenswrapper[4769]: E1121 12:47:16.449661 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d\": container with ID starting with ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d not found: ID does not exist" containerID="ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d" Nov 21 12:47:16 crc kubenswrapper[4769]: I1121 12:47:16.449687 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d"} err="failed to get container status \"ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d\": rpc error: code = NotFound desc = could not find container \"ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d\": container with ID starting with ec1df24671897c8aed4d6a50aca16cc5325ad0217e30c03868fb36e84718a62d not found: ID does not exist" Nov 21 12:47:17 crc kubenswrapper[4769]: I1121 12:47:17.287820 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" path="/var/lib/kubelet/pods/fe87338c-6ebd-46a9-8740-3f6b3b5e2d26/volumes" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.055137 4769 scope.go:117] "RemoveContainer" containerID="642cc14ff093159f93a9081bb20a7fd1ff23f2f544fa737e5cda8819ee063408" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.086671 4769 scope.go:117] "RemoveContainer" containerID="7fc50dbca35cc370c828ce095218982f40a265632084df3e8461aaab8c01ccce" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.144496 4769 scope.go:117] "RemoveContainer" containerID="ff03cd3464ae0545775fc75068766b0b0bac4bd3b38fd71f3bee292888894354" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.180284 4769 scope.go:117] "RemoveContainer" containerID="f3dad24278a9314cbf59401dbd8773ca03e2ea32ae3cd9d1d1e52db203c71095" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.216406 4769 scope.go:117] "RemoveContainer" containerID="83a0081ccc7bc4469392f021dba095ec7b5d40baa4591504a425d1db88f87dd3" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.258988 4769 scope.go:117] "RemoveContainer" containerID="f92d255a3f58d6a7718af643b8ee3527754ea3ffa0b236b27bd81e12131c26f4" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.290081 4769 scope.go:117] "RemoveContainer" containerID="d4eadae0ff5501a365781ddd07ff906e43aec811838eb6b2bf7ed3be3c21c5db" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.323803 4769 scope.go:117] "RemoveContainer" containerID="c774bfbaefcd18b588133e670d55b5bae274c5e6b1953a1142c7eb00b6a64788" Nov 21 12:47:18 crc kubenswrapper[4769]: I1121 12:47:18.357733 4769 scope.go:117] "RemoveContainer" containerID="8be503a780af2106b1093a3cc784715994f0866fa4b64ab072cf0110f424501e" Nov 21 12:47:24 crc kubenswrapper[4769]: I1121 12:47:24.991255 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.077521 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-scripts\") pod \"3360df8e-c791-460f-a1bc-d2a473cd9028\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.077593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-combined-ca-bundle\") pod \"3360df8e-c791-460f-a1bc-d2a473cd9028\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.077639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r5f4\" (UniqueName: \"kubernetes.io/projected/3360df8e-c791-460f-a1bc-d2a473cd9028-kube-api-access-9r5f4\") pod \"3360df8e-c791-460f-a1bc-d2a473cd9028\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.077703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data-custom\") pod \"3360df8e-c791-460f-a1bc-d2a473cd9028\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.077734 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data\") pod \"3360df8e-c791-460f-a1bc-d2a473cd9028\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.078437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3360df8e-c791-460f-a1bc-d2a473cd9028-etc-machine-id\") pod \"3360df8e-c791-460f-a1bc-d2a473cd9028\" (UID: \"3360df8e-c791-460f-a1bc-d2a473cd9028\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.078622 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3360df8e-c791-460f-a1bc-d2a473cd9028-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3360df8e-c791-460f-a1bc-d2a473cd9028" (UID: "3360df8e-c791-460f-a1bc-d2a473cd9028"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.078831 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3360df8e-c791-460f-a1bc-d2a473cd9028-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.084549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3360df8e-c791-460f-a1bc-d2a473cd9028-kube-api-access-9r5f4" (OuterVolumeSpecName: "kube-api-access-9r5f4") pod "3360df8e-c791-460f-a1bc-d2a473cd9028" (UID: "3360df8e-c791-460f-a1bc-d2a473cd9028"). InnerVolumeSpecName "kube-api-access-9r5f4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.086351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-scripts" (OuterVolumeSpecName: "scripts") pod "3360df8e-c791-460f-a1bc-d2a473cd9028" (UID: "3360df8e-c791-460f-a1bc-d2a473cd9028"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.095061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3360df8e-c791-460f-a1bc-d2a473cd9028" (UID: "3360df8e-c791-460f-a1bc-d2a473cd9028"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.100453 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.118692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3360df8e-c791-460f-a1bc-d2a473cd9028" (UID: "3360df8e-c791-460f-a1bc-d2a473cd9028"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.169096 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data" (OuterVolumeSpecName: "config-data") pod "3360df8e-c791-460f-a1bc-d2a473cd9028" (UID: "3360df8e-c791-460f-a1bc-d2a473cd9028"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") pod \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180357 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84tkm\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-kube-api-access-84tkm\") pod \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-cache\") pod \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-lock\") pod \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\" (UID: \"6948baaa-5e35-43d5-a742-7b6c9b6e80d3\") " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180840 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180857 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180866 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180915 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9r5f4\" (UniqueName: \"kubernetes.io/projected/3360df8e-c791-460f-a1bc-d2a473cd9028-kube-api-access-9r5f4\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.180924 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3360df8e-c791-460f-a1bc-d2a473cd9028-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.181511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-lock" (OuterVolumeSpecName: "lock") pod "6948baaa-5e35-43d5-a742-7b6c9b6e80d3" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.182253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-cache" (OuterVolumeSpecName: "cache") pod "6948baaa-5e35-43d5-a742-7b6c9b6e80d3" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.184012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-kube-api-access-84tkm" (OuterVolumeSpecName: "kube-api-access-84tkm") pod "6948baaa-5e35-43d5-a742-7b6c9b6e80d3" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3"). InnerVolumeSpecName "kube-api-access-84tkm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.184872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "swift") pod "6948baaa-5e35-43d5-a742-7b6c9b6e80d3" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.187845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "6948baaa-5e35-43d5-a742-7b6c9b6e80d3" (UID: "6948baaa-5e35-43d5-a742-7b6c9b6e80d3"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.282385 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.282880 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.283032 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-84tkm\" (UniqueName: \"kubernetes.io/projected/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-kube-api-access-84tkm\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.283047 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/6948baaa-5e35-43d5-a742-7b6c9b6e80d3-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.283120 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.306036 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.385330 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.481352 4769 generic.go:334] "Generic (PLEG): container finished" podID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerID="88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00" exitCode=137 Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.481478 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.481472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00"} Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.481884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"6948baaa-5e35-43d5-a742-7b6c9b6e80d3","Type":"ContainerDied","Data":"704e9a63a7cf9b7f5cac6ab886d339c25f8c698819ffae0f27e5c04c392ded7c"} Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.481921 4769 scope.go:117] "RemoveContainer" containerID="88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.490008 4769 generic.go:334] "Generic (PLEG): container finished" podID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerID="f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346" exitCode=137 Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.490118 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.491153 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3360df8e-c791-460f-a1bc-d2a473cd9028","Type":"ContainerDied","Data":"f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346"} Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.491368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"3360df8e-c791-460f-a1bc-d2a473cd9028","Type":"ContainerDied","Data":"494b95dbe88246d8a4624a563f65957aea0b27f7eb54c1526dc16680750dbd1a"} Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.530833 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.537515 4769 scope.go:117] "RemoveContainer" containerID="564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.539263 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.557970 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.575664 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.604117 4769 scope.go:117] "RemoveContainer" containerID="34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.649279 4769 scope.go:117] "RemoveContainer" containerID="bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.671954 4769 scope.go:117] "RemoveContainer" containerID="0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.699718 4769 scope.go:117] "RemoveContainer" containerID="a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.737670 4769 scope.go:117] "RemoveContainer" containerID="71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.770854 4769 scope.go:117] "RemoveContainer" containerID="20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.800135 4769 scope.go:117] "RemoveContainer" containerID="d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.827027 4769 scope.go:117] "RemoveContainer" containerID="1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.855083 4769 scope.go:117] "RemoveContainer" containerID="7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.883823 4769 scope.go:117] "RemoveContainer" containerID="64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.913374 4769 scope.go:117] "RemoveContainer" containerID="7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.948730 4769 scope.go:117] "RemoveContainer" containerID="e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a" Nov 21 12:47:25 crc kubenswrapper[4769]: I1121 12:47:25.979014 4769 scope.go:117] "RemoveContainer" containerID="a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.015778 4769 scope.go:117] "RemoveContainer" containerID="88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.016745 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00\": container with ID starting with 88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00 not found: ID does not exist" containerID="88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.016793 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00"} err="failed to get container status \"88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00\": rpc error: code = NotFound desc = could not find container \"88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00\": container with ID starting with 88214540351bf37c669ae0cbe3b58e10cc0e75e0e7e2688659cfff8938f7de00 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.016829 4769 scope.go:117] "RemoveContainer" containerID="564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.017321 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9\": container with ID starting with 564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9 not found: ID does not exist" containerID="564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.017367 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9"} err="failed to get container status \"564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9\": rpc error: code = NotFound desc = could not find container \"564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9\": container with ID starting with 564d8829a5832d29b6a2056c90e4b62c78d66579be07d798f5d667e08fc909d9 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.017385 4769 scope.go:117] "RemoveContainer" containerID="34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.017807 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20\": container with ID starting with 34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20 not found: ID does not exist" containerID="34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.017838 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20"} err="failed to get container status \"34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20\": rpc error: code = NotFound desc = could not find container \"34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20\": container with ID starting with 34c157dd0033b26d574fb861744384650075116f6f20cc19cbfb83f007d41f20 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.017855 4769 scope.go:117] "RemoveContainer" containerID="bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.018235 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c\": container with ID starting with bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c not found: ID does not exist" containerID="bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.018326 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c"} err="failed to get container status \"bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c\": rpc error: code = NotFound desc = could not find container \"bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c\": container with ID starting with bb8ef1ec8afd5096a530b51406e4dcb29fedfd057ec2b95100a305831cf8043c not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.018386 4769 scope.go:117] "RemoveContainer" containerID="0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.018941 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba\": container with ID starting with 0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba not found: ID does not exist" containerID="0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.018972 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba"} err="failed to get container status \"0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba\": rpc error: code = NotFound desc = could not find container \"0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba\": container with ID starting with 0a9d25bcfd57426b1bc5db34fe66e8519724e35e566c1f36a1cf65ba088773ba not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.018990 4769 scope.go:117] "RemoveContainer" containerID="a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.019692 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021\": container with ID starting with a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021 not found: ID does not exist" containerID="a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.019717 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021"} err="failed to get container status \"a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021\": rpc error: code = NotFound desc = could not find container \"a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021\": container with ID starting with a8f384b03133c36ebd71d94f9c956ab2bde9359b6f53fccc7903c2b77d2aa021 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.019734 4769 scope.go:117] "RemoveContainer" containerID="71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.020325 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495\": container with ID starting with 71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495 not found: ID does not exist" containerID="71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.020350 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495"} err="failed to get container status \"71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495\": rpc error: code = NotFound desc = could not find container \"71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495\": container with ID starting with 71135d515acd1b859e39a317dfb6efb2351cb878401d42de8f18eb57addae495 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.020366 4769 scope.go:117] "RemoveContainer" containerID="20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.021043 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5\": container with ID starting with 20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5 not found: ID does not exist" containerID="20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.021073 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5"} err="failed to get container status \"20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5\": rpc error: code = NotFound desc = could not find container \"20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5\": container with ID starting with 20acb99da70da15683e9b157c1f9f9038a434f05ef95c3c7a61d992aafacb2e5 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.021091 4769 scope.go:117] "RemoveContainer" containerID="d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.021544 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864\": container with ID starting with d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864 not found: ID does not exist" containerID="d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.021576 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864"} err="failed to get container status \"d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864\": rpc error: code = NotFound desc = could not find container \"d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864\": container with ID starting with d0009b22afc6545564333b6da64dbc7a7cf2514e32b8f10f9c2f9b3b0024a864 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.021592 4769 scope.go:117] "RemoveContainer" containerID="1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.022233 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392\": container with ID starting with 1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392 not found: ID does not exist" containerID="1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.022261 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392"} err="failed to get container status \"1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392\": rpc error: code = NotFound desc = could not find container \"1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392\": container with ID starting with 1516590c81736dc0bce54c0d0d976fff9d7dbbd9152f4a1913e54aee52a6c392 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.022276 4769 scope.go:117] "RemoveContainer" containerID="7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.022661 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf\": container with ID starting with 7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf not found: ID does not exist" containerID="7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.022687 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf"} err="failed to get container status \"7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf\": rpc error: code = NotFound desc = could not find container \"7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf\": container with ID starting with 7d91e7e975217902759ffcf875516937eaac982eb7bbc306cf1c9aa3191e42bf not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.022706 4769 scope.go:117] "RemoveContainer" containerID="64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.023243 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f\": container with ID starting with 64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f not found: ID does not exist" containerID="64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.023271 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f"} err="failed to get container status \"64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f\": rpc error: code = NotFound desc = could not find container \"64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f\": container with ID starting with 64a67f46b5c692a116707d506a85d054ef7c9c3a51bb12be38d8a29cf2bb893f not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.023290 4769 scope.go:117] "RemoveContainer" containerID="7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.023631 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611\": container with ID starting with 7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611 not found: ID does not exist" containerID="7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.023654 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611"} err="failed to get container status \"7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611\": rpc error: code = NotFound desc = could not find container \"7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611\": container with ID starting with 7cddf8c426a0c769314846831096cc4a84f644cf997ae0d017d51c725030d611 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.023670 4769 scope.go:117] "RemoveContainer" containerID="e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.024025 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a\": container with ID starting with e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a not found: ID does not exist" containerID="e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.024048 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a"} err="failed to get container status \"e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a\": rpc error: code = NotFound desc = could not find container \"e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a\": container with ID starting with e31ea45162ba9aae3ccefaf94a289f0ca8f51a9b951fe5010ff6be235f98bc9a not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.024064 4769 scope.go:117] "RemoveContainer" containerID="a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.024504 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335\": container with ID starting with a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335 not found: ID does not exist" containerID="a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.024559 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335"} err="failed to get container status \"a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335\": rpc error: code = NotFound desc = could not find container \"a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335\": container with ID starting with a5db07bb47a90bed8054c447200f6a1d0c7adacf67394c21fee6520824b84335 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.024598 4769 scope.go:117] "RemoveContainer" containerID="aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.060175 4769 scope.go:117] "RemoveContainer" containerID="f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.092473 4769 scope.go:117] "RemoveContainer" containerID="aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.092879 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42\": container with ID starting with aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42 not found: ID does not exist" containerID="aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.092915 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42"} err="failed to get container status \"aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42\": rpc error: code = NotFound desc = could not find container \"aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42\": container with ID starting with aa4b3ceb86c8fef8775e25fe55f32ecfb5601220898b687b8c40b0f444d3eb42 not found: ID does not exist" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.092961 4769 scope.go:117] "RemoveContainer" containerID="f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346" Nov 21 12:47:26 crc kubenswrapper[4769]: E1121 12:47:26.093591 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346\": container with ID starting with f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346 not found: ID does not exist" containerID="f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346" Nov 21 12:47:26 crc kubenswrapper[4769]: I1121 12:47:26.093621 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346"} err="failed to get container status \"f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346\": rpc error: code = NotFound desc = could not find container \"f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346\": container with ID starting with f8517f83a26ed0e7970734036e62702aeb319856ab77d307b585e70e9399e346 not found: ID does not exist" Nov 21 12:47:27 crc kubenswrapper[4769]: I1121 12:47:27.290767 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" path="/var/lib/kubelet/pods/3360df8e-c791-460f-a1bc-d2a473cd9028/volumes" Nov 21 12:47:27 crc kubenswrapper[4769]: I1121 12:47:27.292036 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" path="/var/lib/kubelet/pods/6948baaa-5e35-43d5-a742-7b6c9b6e80d3/volumes" Nov 21 12:47:27 crc kubenswrapper[4769]: I1121 12:47:27.371514 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod16871c90-c542-47f1-b528-6d2384b9bcd0"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod16871c90-c542-47f1-b528-6d2384b9bcd0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod16871c90_c542_47f1_b528_6d2384b9bcd0.slice" Nov 21 12:47:27 crc kubenswrapper[4769]: E1121 12:47:27.371602 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod16871c90-c542-47f1-b528-6d2384b9bcd0] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod16871c90-c542-47f1-b528-6d2384b9bcd0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod16871c90_c542_47f1_b528_6d2384b9bcd0.slice" pod="openstack-kuttl-tests/openstackclient" podUID="16871c90-c542-47f1-b528-6d2384b9bcd0" Nov 21 12:47:27 crc kubenswrapper[4769]: I1121 12:47:27.510014 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pode59628c3-2e82-4f0c-a148-66ea1e85edca"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pode59628c3-2e82-4f0c-a148-66ea1e85edca] : Timed out while waiting for systemd to remove kubepods-besteffort-pode59628c3_2e82_4f0c_a148_66ea1e85edca.slice" Nov 21 12:47:27 crc kubenswrapper[4769]: I1121 12:47:27.518649 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:47:29 crc kubenswrapper[4769]: I1121 12:47:29.742493 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.20:9292/healthcheck\": dial tcp 10.217.1.20:9292: i/o timeout" Nov 21 12:47:29 crc kubenswrapper[4769]: I1121 12:47:29.742546 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.20:9292/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:47:30 crc kubenswrapper[4769]: I1121 12:47:30.577236 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","poda0ee2070-d0d3-48e5-a82e-e902f5daf74b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort poda0ee2070-d0d3-48e5-a82e-e902f5daf74b] : Timed out while waiting for systemd to remove kubepods-besteffort-poda0ee2070_d0d3_48e5_a82e_e902f5daf74b.slice" Nov 21 12:47:30 crc kubenswrapper[4769]: E1121 12:47:30.577319 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort poda0ee2070-d0d3-48e5-a82e-e902f5daf74b] : unable to destroy cgroup paths for cgroup [kubepods besteffort poda0ee2070-d0d3-48e5-a82e-e902f5daf74b] : Timed out while waiting for systemd to remove kubepods-besteffort-poda0ee2070_d0d3_48e5_a82e_e902f5daf74b.slice" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" Nov 21 12:47:30 crc kubenswrapper[4769]: I1121 12:47:30.590858 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod23ba26dc-ff31-4837-94db-85584619d8b4"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod23ba26dc-ff31-4837-94db-85584619d8b4] : Timed out while waiting for systemd to remove kubepods-besteffort-pod23ba26dc_ff31_4837_94db_85584619d8b4.slice" Nov 21 12:47:30 crc kubenswrapper[4769]: E1121 12:47:30.590933 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod23ba26dc-ff31-4837-94db-85584619d8b4] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod23ba26dc-ff31-4837-94db-85584619d8b4] : Timed out while waiting for systemd to remove kubepods-besteffort-pod23ba26dc_ff31_4837_94db_85584619d8b4.slice" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" Nov 21 12:47:30 crc kubenswrapper[4769]: I1121 12:47:30.602413 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod82907629-360d-4481-86ed-2d4abb75ecff"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod82907629-360d-4481-86ed-2d4abb75ecff] : Timed out while waiting for systemd to remove kubepods-besteffort-pod82907629_360d_4481_86ed_2d4abb75ecff.slice" Nov 21 12:47:30 crc kubenswrapper[4769]: E1121 12:47:30.602462 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod82907629-360d-4481-86ed-2d4abb75ecff] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod82907629-360d-4481-86ed-2d4abb75ecff] : Timed out while waiting for systemd to remove kubepods-besteffort-pod82907629_360d_4481_86ed_2d4abb75ecff.slice" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="82907629-360d-4481-86ed-2d4abb75ecff" Nov 21 12:47:30 crc kubenswrapper[4769]: I1121 12:47:30.642452 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod30b662da-331f-4736-bfb7-a1c5f31c1ffa"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod30b662da-331f-4736-bfb7-a1c5f31c1ffa] : Timed out while waiting for systemd to remove kubepods-besteffort-pod30b662da_331f_4736_bfb7_a1c5f31c1ffa.slice" Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.051010 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.22:9292/healthcheck\": dial tcp 10.217.1.22:9292: i/o timeout" Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.051101 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.22:9292/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.577481 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh" Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.577582 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.577649 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.614610 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.627115 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.640759 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh"] Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.651628 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7bb5bb8474-4p7hh"] Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.659327 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:47:31 crc kubenswrapper[4769]: I1121 12:47:31.664987 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:47:33 crc kubenswrapper[4769]: I1121 12:47:33.291788 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" path="/var/lib/kubelet/pods/23ba26dc-ff31-4837-94db-85584619d8b4/volumes" Nov 21 12:47:33 crc kubenswrapper[4769]: I1121 12:47:33.293281 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82907629-360d-4481-86ed-2d4abb75ecff" path="/var/lib/kubelet/pods/82907629-360d-4481-86ed-2d4abb75ecff/volumes" Nov 21 12:47:33 crc kubenswrapper[4769]: I1121 12:47:33.294475 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" path="/var/lib/kubelet/pods/a0ee2070-d0d3-48e5-a82e-e902f5daf74b/volumes" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.877498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-f7grx"] Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.889412 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-f7grx"] Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.984861 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-vfg8q"] Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985597 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985644 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-server" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985680 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" containerName="nova-cell0-conductor-conductor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985700 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" containerName="nova-cell0-conductor-conductor" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985734 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerName="mysql-bootstrap" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985755 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerName="mysql-bootstrap" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985792 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="ovn-northd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985809 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="ovn-northd" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985842 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985860 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985894 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985911 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-api" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985935 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="registry-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.985951 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="registry-server" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.985980 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986001 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986030 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986044 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986082 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986104 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e59628c3-2e82-4f0c-a148-66ea1e85edca" containerName="kube-state-metrics" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986117 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59628c3-2e82-4f0c-a148-66ea1e85edca" containerName="kube-state-metrics" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986133 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986146 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986169 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986223 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-server" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986243 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986256 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986285 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-expirer" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986299 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-expirer" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986324 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="rabbitmq" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986337 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="rabbitmq" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986351 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986364 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986380 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82907629-360d-4481-86ed-2d4abb75ecff" containerName="galera" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986393 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82907629-360d-4481-86ed-2d4abb75ecff" containerName="galera" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986420 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-metadata" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986434 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-metadata" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986465 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986485 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerName="galera" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986498 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerName="galera" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986526 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b5d4b44e-5548-4cdb-a2ac-6192fec95c43" containerName="memcached" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986538 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d4b44e-5548-4cdb-a2ac-6192fec95c43" containerName="memcached" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986559 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986572 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986592 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="sg-core" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986605 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="sg-core" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986625 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986638 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986656 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986669 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986692 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerName="nova-scheduler-scheduler" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986704 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerName="nova-scheduler-scheduler" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986730 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986745 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986761 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986774 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986792 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986805 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986827 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-updater" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986839 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-updater" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986865 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986878 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986908 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-api" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986928 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986942 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986964 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.986977 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.986993 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="rsync" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987007 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="rsync" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerName="init" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987046 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerName="init" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="setup-container" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987085 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="setup-container" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987110 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987122 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987151 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987163 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987184 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987203 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987253 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987267 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987296 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987318 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f8c3fc37-e777-4549-b153-ad4965d13a8a" containerName="keystone-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987330 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c3fc37-e777-4549-b153-ad4965d13a8a" containerName="keystone-api" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-reaper" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987361 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-reaper" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987384 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987397 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987414 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987442 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-notification-agent" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-notification-agent" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987479 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="proxy-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987492 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="proxy-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987515 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987528 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987547 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="openstack-network-exporter" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987560 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="openstack-network-exporter" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987584 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987597 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-server" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987620 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="rabbitmq" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987633 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="rabbitmq" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987645 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987658 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-api" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987672 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987685 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987704 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987718 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987733 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee849839-867d-45a9-8078-2d530cd62ff7" containerName="nova-cell1-conductor-conductor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987750 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee849839-867d-45a9-8078-2d530cd62ff7" containerName="nova-cell1-conductor-conductor" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987781 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987799 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987826 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="setup-container" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987843 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="setup-container" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987870 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-updater" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987883 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-updater" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987903 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="cinder-scheduler" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987916 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="cinder-scheduler" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.987942 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.987955 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988007 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988020 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988045 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="extract-utilities" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988060 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="extract-utilities" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988079 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="extract-content" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="extract-content" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988115 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988127 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988147 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="probe" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988160 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="probe" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988182 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-central-agent" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988203 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-central-agent" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988221 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988265 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-log" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988288 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988301 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988319 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988332 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-server" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="swift-recon-cron" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988361 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="swift-recon-cron" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988377 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82907629-360d-4481-86ed-2d4abb75ecff" containerName="mysql-bootstrap" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988390 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82907629-360d-4481-86ed-2d4abb75ecff" containerName="mysql-bootstrap" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988410 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerName="dnsmasq-dns" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988423 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerName="dnsmasq-dns" Nov 21 12:47:48 crc kubenswrapper[4769]: E1121 12:47:48.988439 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="37ce1474-d401-43fc-9e17-4e5691d2b451" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988451 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ce1474-d401-43fc-9e17-4e5691d2b451" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988784 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988812 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="37ce1474-d401-43fc-9e17-4e5691d2b451" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988828 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988852 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="probe" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988893 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="sg-core" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988917 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988943 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-metadata" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988974 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f8c3fc37-e777-4549-b153-ad4965d13a8a" containerName="keystone-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.988999 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989022 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989047 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe87338c-6ebd-46a9-8740-3f6b3b5e2d26" containerName="registry-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989068 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-central-agent" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989102 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989148 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989167 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c0de7b0-5c27-4052-a219-6b701aef6f6b" containerName="galera" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989190 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989341 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989362 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0ee2070-d0d3-48e5-a82e-e902f5daf74b" containerName="proxy-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989376 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989393 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2c4055bb-10f7-45d3-a0e1-0a70629f1813" containerName="nova-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989416 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989433 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="proxy-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989453 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989467 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989482 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="30b662da-331f-4736-bfb7-a1c5f31c1ffa" containerName="ceilometer-notification-agent" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989520 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad3fd932-0bbe-42b5-82d0-a7c427395cf6" containerName="glance-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989573 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989589 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989612 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23ba26dc-ff31-4837-94db-85584619d8b4" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989630 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7e7510e8-fd68-404b-9774-ce64060e8857" containerName="nova-metadata-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989655 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="swift-recon-cron" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989669 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3360df8e-c791-460f-a1bc-d2a473cd9028" containerName="cinder-scheduler" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989692 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989712 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989734 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989754 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee849839-867d-45a9-8078-2d530cd62ff7" containerName="nova-cell1-conductor-conductor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989771 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="82907629-360d-4481-86ed-2d4abb75ecff" containerName="galera" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989789 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="ovn-northd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989805 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989827 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989842 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="358ea7e8-fdf4-4096-948a-a1cd27a5a1c1" containerName="rabbitmq" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989888 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e59628c3-2e82-4f0c-a148-66ea1e85edca" containerName="kube-state-metrics" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989919 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="324118dd-eff5-47ce-aae2-ab2155ab1bd8" containerName="neutron-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989950 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-expirer" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989975 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8870f588-dcd9-4a29-a1af-28d085ee8c1e" containerName="dnsmasq-dns" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.989994 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-updater" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990022 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-server" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990059 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0d74e83-a8b1-480f-8afb-b8ff9464350d" containerName="nova-scheduler-scheduler" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990079 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="72ba863c-b5b0-4af7-a2ac-ba307b9e0fbb" containerName="barbican-worker" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990096 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="229177f2-bc85-4c53-86e2-9daab3200250" containerName="cinder-api-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990113 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d2849a02-b828-4f2a-8d0a-bc4b36da1357" containerName="glance-httpd" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990142 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990173 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45969258-6de5-4b79-ba45-c82a31743fc5" containerName="nova-cell0-conductor-conductor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990210 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="container-replicator" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990280 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="rsync" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990307 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="10edbd41-2f31-466a-94be-9b0d3bf334d8" containerName="openstack-network-exporter" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990348 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bed045d-dcfa-4235-a778-cc12b3ee6a6c" containerName="placement-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990366 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b5d4b44e-5548-4cdb-a2ac-6192fec95c43" containerName="memcached" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990389 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990414 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3da71fd1-0ca1-4e28-b702-d2fb5665627c" containerName="mariadb-account-delete" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990445 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2956e126-fdb7-48f8-866d-fd679d38c050" containerName="barbican-keystone-listener-log" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990468 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="account-reaper" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990485 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-updater" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990515 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6948baaa-5e35-43d5-a742-7b6c9b6e80d3" containerName="object-auditor" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990540 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ba57a49-8363-41c4-b411-40dcff3a84b1" containerName="rabbitmq" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.990561 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed71386e-c354-4139-b9cf-ea8f7a8d90d1" containerName="barbican-api" Nov 21 12:47:48 crc kubenswrapper[4769]: I1121 12:47:48.991993 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:48.995154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:48.996386 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:48.996842 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:48.997017 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.002035 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-vfg8q"] Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.133758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-node-mnt\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.133978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t88d\" (UniqueName: \"kubernetes.io/projected/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-kube-api-access-5t88d\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.134077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-crc-storage\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.236152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5t88d\" (UniqueName: \"kubernetes.io/projected/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-kube-api-access-5t88d\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.236435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-crc-storage\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.236635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-node-mnt\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.237158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-node-mnt\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.238556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-crc-storage\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.282709 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t88d\" (UniqueName: \"kubernetes.io/projected/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-kube-api-access-5t88d\") pod \"crc-storage-crc-vfg8q\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.289288 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df634252-d877-48c1-a1fa-6bf8fe5ce68f" path="/var/lib/kubelet/pods/df634252-d877-48c1-a1fa-6bf8fe5ce68f/volumes" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.316024 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.657089 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-vfg8q"] Nov 21 12:47:49 crc kubenswrapper[4769]: I1121 12:47:49.858565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vfg8q" event={"ID":"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9","Type":"ContainerStarted","Data":"7c372b2c317c6beabf5e88d5d42fc9691996569d22dcd1027de49e59fd5f7b73"} Nov 21 12:47:50 crc kubenswrapper[4769]: I1121 12:47:50.877900 4769 generic.go:334] "Generic (PLEG): container finished" podID="83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" containerID="15c7bdeedb34a102ed075bb23f3febe22baf993c6933a35af89e033a1eb597a5" exitCode=0 Nov 21 12:47:50 crc kubenswrapper[4769]: I1121 12:47:50.878056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vfg8q" event={"ID":"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9","Type":"ContainerDied","Data":"15c7bdeedb34a102ed075bb23f3febe22baf993c6933a35af89e033a1eb597a5"} Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.246772 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.412933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t88d\" (UniqueName: \"kubernetes.io/projected/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-kube-api-access-5t88d\") pod \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.413362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-crc-storage\") pod \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.413465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-node-mnt\") pod \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\" (UID: \"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9\") " Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.413687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" (UID: "83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.414168 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.424541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-kube-api-access-5t88d" (OuterVolumeSpecName: "kube-api-access-5t88d") pod "83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" (UID: "83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9"). InnerVolumeSpecName "kube-api-access-5t88d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.451667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" (UID: "83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.515545 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.515583 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5t88d\" (UniqueName: \"kubernetes.io/projected/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9-kube-api-access-5t88d\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.908469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-vfg8q" event={"ID":"83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9","Type":"ContainerDied","Data":"7c372b2c317c6beabf5e88d5d42fc9691996569d22dcd1027de49e59fd5f7b73"} Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.908549 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-vfg8q" Nov 21 12:47:52 crc kubenswrapper[4769]: I1121 12:47:52.908583 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c372b2c317c6beabf5e88d5d42fc9691996569d22dcd1027de49e59fd5f7b73" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.761800 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-vfg8q"] Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.773161 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-vfg8q"] Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.906668 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-22crx"] Nov 21 12:47:55 crc kubenswrapper[4769]: E1121 12:47:55.907156 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907179 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3943fea7-7c63-4205-95fd-f1a5587b6269" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: E1121 12:47:55.907195 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" containerName="storage" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907217 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" containerName="storage" Nov 21 12:47:55 crc kubenswrapper[4769]: E1121 12:47:55.907231 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907239 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfa2ac9-c267-49e2-b203-7f5d736a16eb" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: E1121 12:47:55.907269 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907276 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907441 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="29bef206-0bc0-43a4-9fc3-f8382be7ea45" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907453 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9400fe9a-0cca-4e21-b857-d4ae307e6ef6" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907462 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="18d3919f-40c4-42fe-9bbb-86abb8b181a1" containerName="mariadb-account-delete" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.907484 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" containerName="storage" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.908765 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.911400 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.911556 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.912324 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.912501 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:47:55 crc kubenswrapper[4769]: I1121 12:47:55.922621 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-22crx"] Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.105022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dbcab3d8-d2b6-442a-ba8c-658494968b8f-node-mnt\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.105156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7kjx\" (UniqueName: \"kubernetes.io/projected/dbcab3d8-d2b6-442a-ba8c-658494968b8f-kube-api-access-s7kjx\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.105234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dbcab3d8-d2b6-442a-ba8c-658494968b8f-crc-storage\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.208284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s7kjx\" (UniqueName: \"kubernetes.io/projected/dbcab3d8-d2b6-442a-ba8c-658494968b8f-kube-api-access-s7kjx\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.208443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dbcab3d8-d2b6-442a-ba8c-658494968b8f-crc-storage\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.208740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dbcab3d8-d2b6-442a-ba8c-658494968b8f-node-mnt\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.209413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dbcab3d8-d2b6-442a-ba8c-658494968b8f-node-mnt\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.209462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dbcab3d8-d2b6-442a-ba8c-658494968b8f-crc-storage\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.232719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7kjx\" (UniqueName: \"kubernetes.io/projected/dbcab3d8-d2b6-442a-ba8c-658494968b8f-kube-api-access-s7kjx\") pod \"crc-storage-crc-22crx\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.236512 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.799917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-22crx"] Nov 21 12:47:56 crc kubenswrapper[4769]: I1121 12:47:56.983613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-22crx" event={"ID":"dbcab3d8-d2b6-442a-ba8c-658494968b8f","Type":"ContainerStarted","Data":"673e079135432fc8fbe9730f5cebc624a606a3eed6c988a262af6381182b1e04"} Nov 21 12:47:57 crc kubenswrapper[4769]: I1121 12:47:57.295417 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9" path="/var/lib/kubelet/pods/83ecd2ac-ef35-4a3f-a9b2-a941f440b8a9/volumes" Nov 21 12:47:58 crc kubenswrapper[4769]: I1121 12:47:57.999769 4769 generic.go:334] "Generic (PLEG): container finished" podID="dbcab3d8-d2b6-442a-ba8c-658494968b8f" containerID="1f1c1d750a1c62c56df46d8aced8c03683225f44d00bdab5b2e426f5b5e01eed" exitCode=0 Nov 21 12:47:58 crc kubenswrapper[4769]: I1121 12:47:57.999861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-22crx" event={"ID":"dbcab3d8-d2b6-442a-ba8c-658494968b8f","Type":"ContainerDied","Data":"1f1c1d750a1c62c56df46d8aced8c03683225f44d00bdab5b2e426f5b5e01eed"} Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.410259 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.581078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7kjx\" (UniqueName: \"kubernetes.io/projected/dbcab3d8-d2b6-442a-ba8c-658494968b8f-kube-api-access-s7kjx\") pod \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.581278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dbcab3d8-d2b6-442a-ba8c-658494968b8f-node-mnt\") pod \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.581392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dbcab3d8-d2b6-442a-ba8c-658494968b8f-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "dbcab3d8-d2b6-442a-ba8c-658494968b8f" (UID: "dbcab3d8-d2b6-442a-ba8c-658494968b8f"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.581648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dbcab3d8-d2b6-442a-ba8c-658494968b8f-crc-storage\") pod \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\" (UID: \"dbcab3d8-d2b6-442a-ba8c-658494968b8f\") " Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.582857 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/dbcab3d8-d2b6-442a-ba8c-658494968b8f-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.591139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbcab3d8-d2b6-442a-ba8c-658494968b8f-kube-api-access-s7kjx" (OuterVolumeSpecName: "kube-api-access-s7kjx") pod "dbcab3d8-d2b6-442a-ba8c-658494968b8f" (UID: "dbcab3d8-d2b6-442a-ba8c-658494968b8f"). InnerVolumeSpecName "kube-api-access-s7kjx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.620653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbcab3d8-d2b6-442a-ba8c-658494968b8f-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "dbcab3d8-d2b6-442a-ba8c-658494968b8f" (UID: "dbcab3d8-d2b6-442a-ba8c-658494968b8f"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.684513 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s7kjx\" (UniqueName: \"kubernetes.io/projected/dbcab3d8-d2b6-442a-ba8c-658494968b8f-kube-api-access-s7kjx\") on node \"crc\" DevicePath \"\"" Nov 21 12:47:59 crc kubenswrapper[4769]: I1121 12:47:59.684588 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/dbcab3d8-d2b6-442a-ba8c-658494968b8f-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:00 crc kubenswrapper[4769]: I1121 12:48:00.039327 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-22crx" Nov 21 12:48:00 crc kubenswrapper[4769]: I1121 12:48:00.039311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-22crx" event={"ID":"dbcab3d8-d2b6-442a-ba8c-658494968b8f","Type":"ContainerDied","Data":"673e079135432fc8fbe9730f5cebc624a606a3eed6c988a262af6381182b1e04"} Nov 21 12:48:00 crc kubenswrapper[4769]: I1121 12:48:00.039549 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="673e079135432fc8fbe9730f5cebc624a606a3eed6c988a262af6381182b1e04" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.667348 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:48:12 crc kubenswrapper[4769]: E1121 12:48:12.668515 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dbcab3d8-d2b6-442a-ba8c-658494968b8f" containerName="storage" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.668535 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbcab3d8-d2b6-442a-ba8c-658494968b8f" containerName="storage" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.668787 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dbcab3d8-d2b6-442a-ba8c-658494968b8f" containerName="storage" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.669871 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.673373 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.673849 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-rdvht" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.673880 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.673876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.674331 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.674503 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.674888 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.702289 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.783829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.783895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.783930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.783959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.783984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.784018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.784232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mc77\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-kube-api-access-4mc77\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.784286 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.784314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.784377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.784455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4mc77\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-kube-api-access-4mc77\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.886902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.887471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.887566 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.888403 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.888444 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.888529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.888572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.888644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.888728 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.889373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.889795 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.899147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.902234 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.902236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.902182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.919556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mc77\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-kube-api-access-4mc77\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:12 crc kubenswrapper[4769]: I1121 12:48:12.933138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.010336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.429441 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.431265 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.435053 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.435570 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.435961 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.436231 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.436299 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.437110 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-vdwrv" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.443872 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.453232 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.597646 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603057 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/66952fe6-66e9-40b4-93df-3e91438a78f9-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/66952fe6-66e9-40b4-93df-3e91438a78f9-pod-info\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6s7s\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-kube-api-access-k6s7s\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.603623 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.604292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-server-conf\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.604356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-config-data\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/66952fe6-66e9-40b4-93df-3e91438a78f9-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/66952fe6-66e9-40b4-93df-3e91438a78f9-pod-info\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6s7s\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-kube-api-access-k6s7s\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-server-conf\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.705639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-config-data\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.706737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.706878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-config-data\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.706992 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.707079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.707242 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.708502 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-server-conf\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.711755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/66952fe6-66e9-40b4-93df-3e91438a78f9-pod-info\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.712699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/66952fe6-66e9-40b4-93df-3e91438a78f9-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.713632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.715427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.732458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6s7s\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-kube-api-access-k6s7s\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.748387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:13 crc kubenswrapper[4769]: I1121 12:48:13.763820 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.004767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:48:14 crc kubenswrapper[4769]: W1121 12:48:14.011473 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66952fe6_66e9_40b4_93df_3e91438a78f9.slice/crio-838df2b5538927682967837208229f474347a528b3e1d426323d2a6c49f6a7b6 WatchSource:0}: Error finding container 838df2b5538927682967837208229f474347a528b3e1d426323d2a6c49f6a7b6: Status 404 returned error can't find the container with id 838df2b5538927682967837208229f474347a528b3e1d426323d2a6c49f6a7b6 Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.229231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"66952fe6-66e9-40b4-93df-3e91438a78f9","Type":"ContainerStarted","Data":"838df2b5538927682967837208229f474347a528b3e1d426323d2a6c49f6a7b6"} Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.230998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc","Type":"ContainerStarted","Data":"130aa547fd9b489a1df327794c079825b237df63b1243246c358c3fb8592a9ab"} Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.744990 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.747448 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.754436 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.754453 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-mlzpx" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.755510 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.756258 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.771008 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.792474 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.826389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-kolla-config\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.826450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.826558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.826652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-operator-scripts\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.826709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2rb\" (UniqueName: \"kubernetes.io/projected/657f116c-8e01-426a-b9e6-251c11c3c0b6-kube-api-access-mk2rb\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.826822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-default\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.827156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.827269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-generated\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.928589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-generated\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-kolla-config\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929171 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929067 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929304 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-operator-scripts\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929372 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2rb\" (UniqueName: \"kubernetes.io/projected/657f116c-8e01-426a-b9e6-251c11c3c0b6-kube-api-access-mk2rb\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-default\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.929503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-generated\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.930642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-kolla-config\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.931007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-default\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.931670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-operator-scripts\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.978935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.980154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:14 crc kubenswrapper[4769]: I1121 12:48:14.984534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2rb\" (UniqueName: \"kubernetes.io/projected/657f116c-8e01-426a-b9e6-251c11c3c0b6-kube-api-access-mk2rb\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:15 crc kubenswrapper[4769]: I1121 12:48:15.013847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:15 crc kubenswrapper[4769]: I1121 12:48:15.079086 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:15 crc kubenswrapper[4769]: I1121 12:48:15.246041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc","Type":"ContainerStarted","Data":"fd6ca74f63b4756b4af38ee8899275ee4708f896235dd0666af05eb80cdb4c38"} Nov 21 12:48:15 crc kubenswrapper[4769]: I1121 12:48:15.664097 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:48:15 crc kubenswrapper[4769]: W1121 12:48:15.676257 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod657f116c_8e01_426a_b9e6_251c11c3c0b6.slice/crio-ef73c16896ade7f410703f597f2bc72bfc2d9b2099ebdc64c489a06eacfd637b WatchSource:0}: Error finding container ef73c16896ade7f410703f597f2bc72bfc2d9b2099ebdc64c489a06eacfd637b: Status 404 returned error can't find the container with id ef73c16896ade7f410703f597f2bc72bfc2d9b2099ebdc64c489a06eacfd637b Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.143874 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.145399 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.148638 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-dfvd9" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.148957 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.150333 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.150502 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.165340 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.256170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"66952fe6-66e9-40b4-93df-3e91438a78f9","Type":"ContainerStarted","Data":"b51b6e0b818040d5aa0b770763e60d7c3a1de388a4d7bb2a5c13d6493c765d7c"} Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"657f116c-8e01-426a-b9e6-251c11c3c0b6","Type":"ContainerStarted","Data":"8c95e665d2e9d6f8634866e2f45de59008d367ad271ebe8a63e05f4d90376f9f"} Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"657f116c-8e01-426a-b9e6-251c11c3c0b6","Type":"ContainerStarted","Data":"ef73c16896ade7f410703f597f2bc72bfc2d9b2099ebdc64c489a06eacfd637b"} Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258625 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258741 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d26b\" (UniqueName: \"kubernetes.io/projected/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kube-api-access-7d26b\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.258790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.319208 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.320233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.322360 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.322699 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-khdxd" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.323356 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.345395 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-memcached-tls-certs\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7d26b\" (UniqueName: \"kubernetes.io/projected/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kube-api-access-7d26b\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl2lx\" (UniqueName: \"kubernetes.io/projected/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kube-api-access-sl2lx\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.360977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.361092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-config-data\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.361121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kolla-config\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.361161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.361217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-combined-ca-bundle\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.367054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.367706 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.368265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.368802 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.372926 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.376025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.376602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.393715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d26b\" (UniqueName: \"kubernetes.io/projected/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kube-api-access-7d26b\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.403327 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.463045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sl2lx\" (UniqueName: \"kubernetes.io/projected/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kube-api-access-sl2lx\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.463181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-config-data\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.463242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kolla-config\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.463296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-combined-ca-bundle\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.463335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-memcached-tls-certs\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.464220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kolla-config\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.464870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-config-data\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.468573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-combined-ca-bundle\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.471543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.472612 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-memcached-tls-certs\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.481527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl2lx\" (UniqueName: \"kubernetes.io/projected/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kube-api-access-sl2lx\") pod \"memcached-0\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.633841 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:16 crc kubenswrapper[4769]: I1121 12:48:16.930824 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:48:17 crc kubenswrapper[4769]: I1121 12:48:17.089101 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:48:17 crc kubenswrapper[4769]: W1121 12:48:17.090304 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb68bf7eb_b5ee_4bb0_be82_76c8c384aae8.slice/crio-b2c761862dc0ed6cc2d542bdeda9c01033848c2db8ec50a699ba430544ea640e WatchSource:0}: Error finding container b2c761862dc0ed6cc2d542bdeda9c01033848c2db8ec50a699ba430544ea640e: Status 404 returned error can't find the container with id b2c761862dc0ed6cc2d542bdeda9c01033848c2db8ec50a699ba430544ea640e Nov 21 12:48:17 crc kubenswrapper[4769]: I1121 12:48:17.272510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c4b18f8d-32ef-4ac8-be62-61672fe8b645","Type":"ContainerStarted","Data":"c64b126a60282548e13a973028979a3592fed761a5c3091fcb1bac287021d838"} Nov 21 12:48:17 crc kubenswrapper[4769]: I1121 12:48:17.272587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c4b18f8d-32ef-4ac8-be62-61672fe8b645","Type":"ContainerStarted","Data":"7946b1ba8d9311c3e89abf1cb1dceaf194800bcd4e2fbea8b814f97a02b9a637"} Nov 21 12:48:17 crc kubenswrapper[4769]: I1121 12:48:17.285835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8","Type":"ContainerStarted","Data":"b2c761862dc0ed6cc2d542bdeda9c01033848c2db8ec50a699ba430544ea640e"} Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.059717 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.060915 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.064416 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-fzxlg" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.070291 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.193156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kghz\" (UniqueName: \"kubernetes.io/projected/bd45f137-c772-405d-ab6a-c4c05513a801-kube-api-access-5kghz\") pod \"kube-state-metrics-0\" (UID: \"bd45f137-c772-405d-ab6a-c4c05513a801\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.295031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kghz\" (UniqueName: \"kubernetes.io/projected/bd45f137-c772-405d-ab6a-c4c05513a801-kube-api-access-5kghz\") pod \"kube-state-metrics-0\" (UID: \"bd45f137-c772-405d-ab6a-c4c05513a801\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.296099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8","Type":"ContainerStarted","Data":"7bee2832b945087145ffcb590c83369ee975c70b4e0d11a7cf7bd12005f5cec2"} Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.296265 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.320081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kghz\" (UniqueName: \"kubernetes.io/projected/bd45f137-c772-405d-ab6a-c4c05513a801-kube-api-access-5kghz\") pod \"kube-state-metrics-0\" (UID: \"bd45f137-c772-405d-ab6a-c4c05513a801\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.327718 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.3276944139999998 podStartE2EDuration="2.327694414s" podCreationTimestamp="2025-11-21 12:48:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:18.312964066 +0000 UTC m=+3457.013625884" watchObservedRunningTime="2025-11-21 12:48:18.327694414 +0000 UTC m=+3457.028356232" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.384661 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.975662 4769 scope.go:117] "RemoveContainer" containerID="07c7d1e5090d33e40a35aee365f85f3973ef7aa5ea8b369563af0508670090d8" Nov 21 12:48:18 crc kubenswrapper[4769]: W1121 12:48:18.977374 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd45f137_c772_405d_ab6a_c4c05513a801.slice/crio-eab37c286ce9b0379426b497de85f3bfc8ca9963c360633df7c5e86ebb0eec35 WatchSource:0}: Error finding container eab37c286ce9b0379426b497de85f3bfc8ca9963c360633df7c5e86ebb0eec35: Status 404 returned error can't find the container with id eab37c286ce9b0379426b497de85f3bfc8ca9963c360633df7c5e86ebb0eec35 Nov 21 12:48:18 crc kubenswrapper[4769]: I1121 12:48:18.982713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:48:19 crc kubenswrapper[4769]: I1121 12:48:19.021734 4769 scope.go:117] "RemoveContainer" containerID="e9a24a60a13339f824b9e88443465735fa6fa49767d07867036f9439bf30578b" Nov 21 12:48:19 crc kubenswrapper[4769]: I1121 12:48:19.315758 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd45f137-c772-405d-ab6a-c4c05513a801","Type":"ContainerStarted","Data":"eab37c286ce9b0379426b497de85f3bfc8ca9963c360633df7c5e86ebb0eec35"} Nov 21 12:48:20 crc kubenswrapper[4769]: I1121 12:48:20.329567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd45f137-c772-405d-ab6a-c4c05513a801","Type":"ContainerStarted","Data":"2e04e7151a7ca0b706646be541412fbb11b5de3afd8e56bb32ee63fbb282060c"} Nov 21 12:48:20 crc kubenswrapper[4769]: I1121 12:48:20.329973 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:20 crc kubenswrapper[4769]: I1121 12:48:20.332062 4769 generic.go:334] "Generic (PLEG): container finished" podID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerID="8c95e665d2e9d6f8634866e2f45de59008d367ad271ebe8a63e05f4d90376f9f" exitCode=0 Nov 21 12:48:20 crc kubenswrapper[4769]: I1121 12:48:20.332125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"657f116c-8e01-426a-b9e6-251c11c3c0b6","Type":"ContainerDied","Data":"8c95e665d2e9d6f8634866e2f45de59008d367ad271ebe8a63e05f4d90376f9f"} Nov 21 12:48:20 crc kubenswrapper[4769]: I1121 12:48:20.359005 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.962678828 podStartE2EDuration="2.358977311s" podCreationTimestamp="2025-11-21 12:48:18 +0000 UTC" firstStartedPulling="2025-11-21 12:48:18.981359521 +0000 UTC m=+3457.682021339" lastFinishedPulling="2025-11-21 12:48:19.377657964 +0000 UTC m=+3458.078319822" observedRunningTime="2025-11-21 12:48:20.357965423 +0000 UTC m=+3459.058627281" watchObservedRunningTime="2025-11-21 12:48:20.358977311 +0000 UTC m=+3459.059639139" Nov 21 12:48:21 crc kubenswrapper[4769]: I1121 12:48:21.349253 4769 generic.go:334] "Generic (PLEG): container finished" podID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerID="c64b126a60282548e13a973028979a3592fed761a5c3091fcb1bac287021d838" exitCode=0 Nov 21 12:48:21 crc kubenswrapper[4769]: I1121 12:48:21.349356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c4b18f8d-32ef-4ac8-be62-61672fe8b645","Type":"ContainerDied","Data":"c64b126a60282548e13a973028979a3592fed761a5c3091fcb1bac287021d838"} Nov 21 12:48:21 crc kubenswrapper[4769]: I1121 12:48:21.355624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"657f116c-8e01-426a-b9e6-251c11c3c0b6","Type":"ContainerStarted","Data":"00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f"} Nov 21 12:48:21 crc kubenswrapper[4769]: I1121 12:48:21.446494 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.446472873 podStartE2EDuration="8.446472873s" podCreationTimestamp="2025-11-21 12:48:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:21.44152044 +0000 UTC m=+3460.142182298" watchObservedRunningTime="2025-11-21 12:48:21.446472873 +0000 UTC m=+3460.147134701" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.374661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c4b18f8d-32ef-4ac8-be62-61672fe8b645","Type":"ContainerStarted","Data":"6bda79a077d92c7831c16878d761e913a69a5bfc58776708e95b6a11c60b0f20"} Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.421677 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.421646995 podStartE2EDuration="7.421646995s" podCreationTimestamp="2025-11-21 12:48:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:22.408670325 +0000 UTC m=+3461.109332183" watchObservedRunningTime="2025-11-21 12:48:22.421646995 +0000 UTC m=+3461.122308853" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.664423 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.666686 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.670344 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.670340 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.670958 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-m5hz7" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.671168 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.671628 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.689248 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47e271a1-6724-41f1-bb76-3ff682490126-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775529 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4bvc\" (UniqueName: \"kubernetes.io/projected/47e271a1-6724-41f1-bb76-3ff682490126-kube-api-access-m4bvc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775751 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-config\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.775885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.877979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m4bvc\" (UniqueName: \"kubernetes.io/projected/47e271a1-6724-41f1-bb76-3ff682490126-kube-api-access-m4bvc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.878431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.878470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.878547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-config\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.878610 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.879469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47e271a1-6724-41f1-bb76-3ff682490126-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.880265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47e271a1-6724-41f1-bb76-3ff682490126-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.880331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.880402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.880780 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.881923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-config\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.882978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.889691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.889746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.900337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.913850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4bvc\" (UniqueName: \"kubernetes.io/projected/47e271a1-6724-41f1-bb76-3ff682490126-kube-api-access-m4bvc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:22 crc kubenswrapper[4769]: I1121 12:48:22.941057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:23 crc kubenswrapper[4769]: I1121 12:48:23.002739 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:23 crc kubenswrapper[4769]: I1121 12:48:23.499597 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.339875 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.345361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.353569 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-5hmlz" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.355264 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.358455 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.359328 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.366429 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.398995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47e271a1-6724-41f1-bb76-3ff682490126","Type":"ContainerStarted","Data":"c9ab3bc114246c79bbd1d600d35d80b2fb57760bc20868d0c5b0cf8435d11dbd"} Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.399036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47e271a1-6724-41f1-bb76-3ff682490126","Type":"ContainerStarted","Data":"5a75dad19aa42c3760429244da833580790947a6560d35b71702d8af6e3b87e8"} Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.399048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47e271a1-6724-41f1-bb76-3ff682490126","Type":"ContainerStarted","Data":"1b09facd315f2fa0ddc56bcd35de4ebb71913aee9488969608cfb3d7903a5589"} Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.406688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.406745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-config\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.406803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.407014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.407041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st8dh\" (UniqueName: \"kubernetes.io/projected/297dac89-7b00-4c59-b9c7-20618457ff4f-kube-api-access-st8dh\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.407102 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.407134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.407160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.430249 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.430227719 podStartE2EDuration="3.430227719s" podCreationTimestamp="2025-11-21 12:48:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:24.420811145 +0000 UTC m=+3463.121472963" watchObservedRunningTime="2025-11-21 12:48:24.430227719 +0000 UTC m=+3463.130889537" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.508823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.508936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.508954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-st8dh\" (UniqueName: \"kubernetes.io/projected/297dac89-7b00-4c59-b9c7-20618457ff4f-kube-api-access-st8dh\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.509005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.509028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.509045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.509099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.509116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-config\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.509933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-config\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.512482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.515529 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.515677 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.516720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.521994 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.524585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.530976 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-st8dh\" (UniqueName: \"kubernetes.io/projected/297dac89-7b00-4c59-b9c7-20618457ff4f-kube-api-access-st8dh\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.547688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:24 crc kubenswrapper[4769]: I1121 12:48:24.673790 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:25 crc kubenswrapper[4769]: I1121 12:48:25.080062 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:25 crc kubenswrapper[4769]: I1121 12:48:25.080335 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:25 crc kubenswrapper[4769]: I1121 12:48:25.165428 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:48:25 crc kubenswrapper[4769]: W1121 12:48:25.181876 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod297dac89_7b00_4c59_b9c7_20618457ff4f.slice/crio-21e716519fae7de684c2c13a54996a4ecaf5208de44be09fae5e6f1fb3ea1a0b WatchSource:0}: Error finding container 21e716519fae7de684c2c13a54996a4ecaf5208de44be09fae5e6f1fb3ea1a0b: Status 404 returned error can't find the container with id 21e716519fae7de684c2c13a54996a4ecaf5208de44be09fae5e6f1fb3ea1a0b Nov 21 12:48:25 crc kubenswrapper[4769]: I1121 12:48:25.189689 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:25 crc kubenswrapper[4769]: I1121 12:48:25.411404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"297dac89-7b00-4c59-b9c7-20618457ff4f","Type":"ContainerStarted","Data":"21e716519fae7de684c2c13a54996a4ecaf5208de44be09fae5e6f1fb3ea1a0b"} Nov 21 12:48:25 crc kubenswrapper[4769]: I1121 12:48:25.492467 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.003030 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.058842 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.297920 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tfd6s"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.299708 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.309497 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tfd6s"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.345518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/791a2a08-f5a6-4684-8297-ce0e7fea58f3-operator-scripts\") pod \"keystone-db-create-tfd6s\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.345575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsw9z\" (UniqueName: \"kubernetes.io/projected/791a2a08-f5a6-4684-8297-ce0e7fea58f3-kube-api-access-hsw9z\") pod \"keystone-db-create-tfd6s\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.396572 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-j4h4v"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.398244 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.401466 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.404759 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-j4h4v"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.425059 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"297dac89-7b00-4c59-b9c7-20618457ff4f","Type":"ContainerStarted","Data":"bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5"} Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.425117 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"297dac89-7b00-4c59-b9c7-20618457ff4f","Type":"ContainerStarted","Data":"b29db688e2acae5247042350da5dc5728d4cb6e2c0f98b7fdad4bcb286591d34"} Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.426228 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.447890 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/791a2a08-f5a6-4684-8297-ce0e7fea58f3-operator-scripts\") pod \"keystone-db-create-tfd6s\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.448055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw9z\" (UniqueName: \"kubernetes.io/projected/791a2a08-f5a6-4684-8297-ce0e7fea58f3-kube-api-access-hsw9z\") pod \"keystone-db-create-tfd6s\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.449216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/791a2a08-f5a6-4684-8297-ce0e7fea58f3-operator-scripts\") pod \"keystone-db-create-tfd6s\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.458366 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.458350672 podStartE2EDuration="3.458350672s" podCreationTimestamp="2025-11-21 12:48:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:26.45754165 +0000 UTC m=+3465.158203468" watchObservedRunningTime="2025-11-21 12:48:26.458350672 +0000 UTC m=+3465.159012490" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.472330 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.473544 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.479650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsw9z\" (UniqueName: \"kubernetes.io/projected/791a2a08-f5a6-4684-8297-ce0e7fea58f3-kube-api-access-hsw9z\") pod \"keystone-db-create-tfd6s\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.550002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4c373181-218c-40fb-a082-14594e5181a1-operator-scripts\") pod \"keystone-80e8-account-create-j4h4v\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.550131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8f2\" (UniqueName: \"kubernetes.io/projected/4c373181-218c-40fb-a082-14594e5181a1-kube-api-access-kk8f2\") pod \"keystone-80e8-account-create-j4h4v\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.551987 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-p4rps"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.553714 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.567505 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p4rps"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.624198 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.639351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.664697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8f2\" (UniqueName: \"kubernetes.io/projected/4c373181-218c-40fb-a082-14594e5181a1-kube-api-access-kk8f2\") pod \"keystone-80e8-account-create-j4h4v\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.664801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg9x\" (UniqueName: \"kubernetes.io/projected/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-kube-api-access-8jg9x\") pod \"placement-db-create-p4rps\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.664857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-operator-scripts\") pod \"placement-db-create-p4rps\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.664898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4c373181-218c-40fb-a082-14594e5181a1-operator-scripts\") pod \"keystone-80e8-account-create-j4h4v\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.666557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4c373181-218c-40fb-a082-14594e5181a1-operator-scripts\") pod \"keystone-80e8-account-create-j4h4v\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.697096 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5148-account-create-lq5hp"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.699864 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.703597 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.710809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8f2\" (UniqueName: \"kubernetes.io/projected/4c373181-218c-40fb-a082-14594e5181a1-kube-api-access-kk8f2\") pod \"keystone-80e8-account-create-j4h4v\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.715758 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5148-account-create-lq5hp"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.726329 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.767714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg9x\" (UniqueName: \"kubernetes.io/projected/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-kube-api-access-8jg9x\") pod \"placement-db-create-p4rps\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.767817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-operator-scripts\") pod \"placement-db-create-p4rps\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.769101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-operator-scripts\") pod \"placement-db-create-p4rps\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.786517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg9x\" (UniqueName: \"kubernetes.io/projected/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-kube-api-access-8jg9x\") pod \"placement-db-create-p4rps\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.809555 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-5kmlk"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.810830 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.826851 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-5kmlk"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.873693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds4pw\" (UniqueName: \"kubernetes.io/projected/7f69cef9-9def-4679-81e4-95d61cdc8135-kube-api-access-ds4pw\") pod \"placement-5148-account-create-lq5hp\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.873784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f69cef9-9def-4679-81e4-95d61cdc8135-operator-scripts\") pod \"placement-5148-account-create-lq5hp\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.906365 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-0893-account-create-nsdxt"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.907754 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.911154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.912491 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-0893-account-create-nsdxt"] Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.923140 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.975480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ds4pw\" (UniqueName: \"kubernetes.io/projected/7f69cef9-9def-4679-81e4-95d61cdc8135-kube-api-access-ds4pw\") pod \"placement-5148-account-create-lq5hp\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.975550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/95ce7265-f42a-41d0-b298-f7eed9fb59e0-operator-scripts\") pod \"glance-db-create-5kmlk\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.975593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f69cef9-9def-4679-81e4-95d61cdc8135-operator-scripts\") pod \"placement-5148-account-create-lq5hp\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.975609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkrp\" (UniqueName: \"kubernetes.io/projected/95ce7265-f42a-41d0-b298-f7eed9fb59e0-kube-api-access-xhkrp\") pod \"glance-db-create-5kmlk\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.976599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f69cef9-9def-4679-81e4-95d61cdc8135-operator-scripts\") pod \"placement-5148-account-create-lq5hp\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:26 crc kubenswrapper[4769]: I1121 12:48:26.993674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds4pw\" (UniqueName: \"kubernetes.io/projected/7f69cef9-9def-4679-81e4-95d61cdc8135-kube-api-access-ds4pw\") pod \"placement-5148-account-create-lq5hp\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.076873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/95ce7265-f42a-41d0-b298-f7eed9fb59e0-operator-scripts\") pod \"glance-db-create-5kmlk\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.076914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm5dx\" (UniqueName: \"kubernetes.io/projected/b18665eb-d9cc-4c23-bd26-79c45741fe22-kube-api-access-mm5dx\") pod \"glance-0893-account-create-nsdxt\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.076939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b18665eb-d9cc-4c23-bd26-79c45741fe22-operator-scripts\") pod \"glance-0893-account-create-nsdxt\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.076982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkrp\" (UniqueName: \"kubernetes.io/projected/95ce7265-f42a-41d0-b298-f7eed9fb59e0-kube-api-access-xhkrp\") pod \"glance-db-create-5kmlk\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.077830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/95ce7265-f42a-41d0-b298-f7eed9fb59e0-operator-scripts\") pod \"glance-db-create-5kmlk\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.083646 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.094784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkrp\" (UniqueName: \"kubernetes.io/projected/95ce7265-f42a-41d0-b298-f7eed9fb59e0-kube-api-access-xhkrp\") pod \"glance-db-create-5kmlk\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.133915 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.173324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tfd6s"] Nov 21 12:48:27 crc kubenswrapper[4769]: W1121 12:48:27.183392 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod791a2a08_f5a6_4684_8297_ce0e7fea58f3.slice/crio-08e20bc0bdab52e0db95b6250aa0f8bcadd50a6b7a02620422231f3df8edafe6 WatchSource:0}: Error finding container 08e20bc0bdab52e0db95b6250aa0f8bcadd50a6b7a02620422231f3df8edafe6: Status 404 returned error can't find the container with id 08e20bc0bdab52e0db95b6250aa0f8bcadd50a6b7a02620422231f3df8edafe6 Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.189627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mm5dx\" (UniqueName: \"kubernetes.io/projected/b18665eb-d9cc-4c23-bd26-79c45741fe22-kube-api-access-mm5dx\") pod \"glance-0893-account-create-nsdxt\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.189718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b18665eb-d9cc-4c23-bd26-79c45741fe22-operator-scripts\") pod \"glance-0893-account-create-nsdxt\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.190634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b18665eb-d9cc-4c23-bd26-79c45741fe22-operator-scripts\") pod \"glance-0893-account-create-nsdxt\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.209605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm5dx\" (UniqueName: \"kubernetes.io/projected/b18665eb-d9cc-4c23-bd26-79c45741fe22-kube-api-access-mm5dx\") pod \"glance-0893-account-create-nsdxt\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.231214 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.244328 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-j4h4v"] Nov 21 12:48:27 crc kubenswrapper[4769]: W1121 12:48:27.296145 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c373181_218c_40fb_a082_14594e5181a1.slice/crio-a7769e33319032a834bc6b40c6e05afebe7aefb4c23d834007598fa3e5e6885d WatchSource:0}: Error finding container a7769e33319032a834bc6b40c6e05afebe7aefb4c23d834007598fa3e5e6885d: Status 404 returned error can't find the container with id a7769e33319032a834bc6b40c6e05afebe7aefb4c23d834007598fa3e5e6885d Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.364576 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p4rps"] Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.447343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-p4rps" event={"ID":"9c8fb94e-bf69-434a-b0d1-60bd7129eec1","Type":"ContainerStarted","Data":"13b87622a67416e5584b2d9c857e0b57509eb3e6fc355c1dbed764bf5b5f15cd"} Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.449613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" event={"ID":"791a2a08-f5a6-4684-8297-ce0e7fea58f3","Type":"ContainerStarted","Data":"08e20bc0bdab52e0db95b6250aa0f8bcadd50a6b7a02620422231f3df8edafe6"} Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.451411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" event={"ID":"4c373181-218c-40fb-a082-14594e5181a1","Type":"ContainerStarted","Data":"a7769e33319032a834bc6b40c6e05afebe7aefb4c23d834007598fa3e5e6885d"} Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.539027 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5148-account-create-lq5hp"] Nov 21 12:48:27 crc kubenswrapper[4769]: W1121 12:48:27.541130 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f69cef9_9def_4679_81e4_95d61cdc8135.slice/crio-c4f64a04392061f2d098517c9fcb7cc79443b8afaffe30cb556e848d4e3e932a WatchSource:0}: Error finding container c4f64a04392061f2d098517c9fcb7cc79443b8afaffe30cb556e848d4e3e932a: Status 404 returned error can't find the container with id c4f64a04392061f2d098517c9fcb7cc79443b8afaffe30cb556e848d4e3e932a Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.674617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.676804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-5kmlk"] Nov 21 12:48:27 crc kubenswrapper[4769]: W1121 12:48:27.690736 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95ce7265_f42a_41d0_b298_f7eed9fb59e0.slice/crio-6336aef16bde45281ffe60ffb15fa33561389cb0fc3a5cf8788a25ef70081597 WatchSource:0}: Error finding container 6336aef16bde45281ffe60ffb15fa33561389cb0fc3a5cf8788a25ef70081597: Status 404 returned error can't find the container with id 6336aef16bde45281ffe60ffb15fa33561389cb0fc3a5cf8788a25ef70081597 Nov 21 12:48:27 crc kubenswrapper[4769]: I1121 12:48:27.799876 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-0893-account-create-nsdxt"] Nov 21 12:48:27 crc kubenswrapper[4769]: W1121 12:48:27.810562 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb18665eb_d9cc_4c23_bd26_79c45741fe22.slice/crio-9dd271442a6798fe52ac243560ddd002e0d90d45984feee2d95f3e2e09034200 WatchSource:0}: Error finding container 9dd271442a6798fe52ac243560ddd002e0d90d45984feee2d95f3e2e09034200: Status 404 returned error can't find the container with id 9dd271442a6798fe52ac243560ddd002e0d90d45984feee2d95f3e2e09034200 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.053066 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.390458 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.461661 4769 generic.go:334] "Generic (PLEG): container finished" podID="b18665eb-d9cc-4c23-bd26-79c45741fe22" containerID="ff9d9cc40052d71cc1eeb40acde6ac84123ec85d569ab58709b7cd259bad7a16" exitCode=0 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.461925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" event={"ID":"b18665eb-d9cc-4c23-bd26-79c45741fe22","Type":"ContainerDied","Data":"ff9d9cc40052d71cc1eeb40acde6ac84123ec85d569ab58709b7cd259bad7a16"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.461982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" event={"ID":"b18665eb-d9cc-4c23-bd26-79c45741fe22","Type":"ContainerStarted","Data":"9dd271442a6798fe52ac243560ddd002e0d90d45984feee2d95f3e2e09034200"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.464322 4769 generic.go:334] "Generic (PLEG): container finished" podID="7f69cef9-9def-4679-81e4-95d61cdc8135" containerID="8e7738f507454bf36d660c076c58850a6cff176248838c52c6b6febfb8ff005b" exitCode=0 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.464389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" event={"ID":"7f69cef9-9def-4679-81e4-95d61cdc8135","Type":"ContainerDied","Data":"8e7738f507454bf36d660c076c58850a6cff176248838c52c6b6febfb8ff005b"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.464459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" event={"ID":"7f69cef9-9def-4679-81e4-95d61cdc8135","Type":"ContainerStarted","Data":"c4f64a04392061f2d098517c9fcb7cc79443b8afaffe30cb556e848d4e3e932a"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.465934 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c8fb94e-bf69-434a-b0d1-60bd7129eec1" containerID="f89912feee1f15f4e386d1ae4c699514cbd9622e9359f46ba518ea6857e3e5b7" exitCode=0 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.465984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-p4rps" event={"ID":"9c8fb94e-bf69-434a-b0d1-60bd7129eec1","Type":"ContainerDied","Data":"f89912feee1f15f4e386d1ae4c699514cbd9622e9359f46ba518ea6857e3e5b7"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.467619 4769 generic.go:334] "Generic (PLEG): container finished" podID="791a2a08-f5a6-4684-8297-ce0e7fea58f3" containerID="3f720586ed80081e76d8251c9915ba9fd1a64ff5d387fa47c3fc68b843f05c03" exitCode=0 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.467700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" event={"ID":"791a2a08-f5a6-4684-8297-ce0e7fea58f3","Type":"ContainerDied","Data":"3f720586ed80081e76d8251c9915ba9fd1a64ff5d387fa47c3fc68b843f05c03"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.469179 4769 generic.go:334] "Generic (PLEG): container finished" podID="95ce7265-f42a-41d0-b298-f7eed9fb59e0" containerID="1777960e9cb1495cb5d97b2949474133b4ccd62645768da9412f06e3de2ab1f0" exitCode=0 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.469213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-5kmlk" event={"ID":"95ce7265-f42a-41d0-b298-f7eed9fb59e0","Type":"ContainerDied","Data":"1777960e9cb1495cb5d97b2949474133b4ccd62645768da9412f06e3de2ab1f0"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.469324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-5kmlk" event={"ID":"95ce7265-f42a-41d0-b298-f7eed9fb59e0","Type":"ContainerStarted","Data":"6336aef16bde45281ffe60ffb15fa33561389cb0fc3a5cf8788a25ef70081597"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.470643 4769 generic.go:334] "Generic (PLEG): container finished" podID="4c373181-218c-40fb-a082-14594e5181a1" containerID="8ebee137a50a5ba33cfccf6429ea78d0e04cb3861589e7b06d15107d88b3d78e" exitCode=0 Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.470672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" event={"ID":"4c373181-218c-40fb-a082-14594e5181a1","Type":"ContainerDied","Data":"8ebee137a50a5ba33cfccf6429ea78d0e04cb3861589e7b06d15107d88b3d78e"} Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.742028 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:28 crc kubenswrapper[4769]: I1121 12:48:28.839327 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.342813 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.348843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.351662 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.352042 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.352044 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-8f7tg" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.352085 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.375412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.439510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-cache\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.439598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.439629 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-lock\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.439770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp5lv\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-kube-api-access-wp5lv\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.439896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.542093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-cache\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.542249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.542315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-lock\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.542426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wp5lv\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-kube-api-access-wp5lv\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.542550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.544391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-cache\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: E1121 12:48:29.545260 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:48:29 crc kubenswrapper[4769]: E1121 12:48:29.545295 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:48:29 crc kubenswrapper[4769]: E1121 12:48:29.545361 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift podName:85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469 nodeName:}" failed. No retries permitted until 2025-11-21 12:48:30.045337364 +0000 UTC m=+3468.745999212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift") pod "swift-storage-0" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469") : configmap "swift-ring-files" not found Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.546884 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.547592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-lock\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.588132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp5lv\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-kube-api-access-wp5lv\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.610957 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:29 crc kubenswrapper[4769]: I1121 12:48:29.698383 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.025472 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.051552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-operator-scripts\") pod \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.051899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jg9x\" (UniqueName: \"kubernetes.io/projected/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-kube-api-access-8jg9x\") pod \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\" (UID: \"9c8fb94e-bf69-434a-b0d1-60bd7129eec1\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.052604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:30 crc kubenswrapper[4769]: E1121 12:48:30.053121 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:48:30 crc kubenswrapper[4769]: E1121 12:48:30.053290 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:48:30 crc kubenswrapper[4769]: E1121 12:48:30.053462 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift podName:85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469 nodeName:}" failed. No retries permitted until 2025-11-21 12:48:31.053436863 +0000 UTC m=+3469.754098711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift") pod "swift-storage-0" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469") : configmap "swift-ring-files" not found Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.054247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9c8fb94e-bf69-434a-b0d1-60bd7129eec1" (UID: "9c8fb94e-bf69-434a-b0d1-60bd7129eec1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.083739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-kube-api-access-8jg9x" (OuterVolumeSpecName: "kube-api-access-8jg9x") pod "9c8fb94e-bf69-434a-b0d1-60bd7129eec1" (UID: "9c8fb94e-bf69-434a-b0d1-60bd7129eec1"). InnerVolumeSpecName "kube-api-access-8jg9x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.154197 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8jg9x\" (UniqueName: \"kubernetes.io/projected/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-kube-api-access-8jg9x\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.154232 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c8fb94e-bf69-434a-b0d1-60bd7129eec1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.194661 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.198718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.206580 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.213837 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.236716 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255308 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm5dx\" (UniqueName: \"kubernetes.io/projected/b18665eb-d9cc-4c23-bd26-79c45741fe22-kube-api-access-mm5dx\") pod \"b18665eb-d9cc-4c23-bd26-79c45741fe22\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f69cef9-9def-4679-81e4-95d61cdc8135-operator-scripts\") pod \"7f69cef9-9def-4679-81e4-95d61cdc8135\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk8f2\" (UniqueName: \"kubernetes.io/projected/4c373181-218c-40fb-a082-14594e5181a1-kube-api-access-kk8f2\") pod \"4c373181-218c-40fb-a082-14594e5181a1\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/791a2a08-f5a6-4684-8297-ce0e7fea58f3-operator-scripts\") pod \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds4pw\" (UniqueName: \"kubernetes.io/projected/7f69cef9-9def-4679-81e4-95d61cdc8135-kube-api-access-ds4pw\") pod \"7f69cef9-9def-4679-81e4-95d61cdc8135\" (UID: \"7f69cef9-9def-4679-81e4-95d61cdc8135\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsw9z\" (UniqueName: \"kubernetes.io/projected/791a2a08-f5a6-4684-8297-ce0e7fea58f3-kube-api-access-hsw9z\") pod \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\" (UID: \"791a2a08-f5a6-4684-8297-ce0e7fea58f3\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4c373181-218c-40fb-a082-14594e5181a1-operator-scripts\") pod \"4c373181-218c-40fb-a082-14594e5181a1\" (UID: \"4c373181-218c-40fb-a082-14594e5181a1\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.255703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b18665eb-d9cc-4c23-bd26-79c45741fe22-operator-scripts\") pod \"b18665eb-d9cc-4c23-bd26-79c45741fe22\" (UID: \"b18665eb-d9cc-4c23-bd26-79c45741fe22\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.257463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f69cef9-9def-4679-81e4-95d61cdc8135-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7f69cef9-9def-4679-81e4-95d61cdc8135" (UID: "7f69cef9-9def-4679-81e4-95d61cdc8135"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.257782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c373181-218c-40fb-a082-14594e5181a1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4c373181-218c-40fb-a082-14594e5181a1" (UID: "4c373181-218c-40fb-a082-14594e5181a1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.258673 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791a2a08-f5a6-4684-8297-ce0e7fea58f3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "791a2a08-f5a6-4684-8297-ce0e7fea58f3" (UID: "791a2a08-f5a6-4684-8297-ce0e7fea58f3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.258904 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18665eb-d9cc-4c23-bd26-79c45741fe22-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b18665eb-d9cc-4c23-bd26-79c45741fe22" (UID: "b18665eb-d9cc-4c23-bd26-79c45741fe22"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.261397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18665eb-d9cc-4c23-bd26-79c45741fe22-kube-api-access-mm5dx" (OuterVolumeSpecName: "kube-api-access-mm5dx") pod "b18665eb-d9cc-4c23-bd26-79c45741fe22" (UID: "b18665eb-d9cc-4c23-bd26-79c45741fe22"). InnerVolumeSpecName "kube-api-access-mm5dx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.261436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c373181-218c-40fb-a082-14594e5181a1-kube-api-access-kk8f2" (OuterVolumeSpecName: "kube-api-access-kk8f2") pod "4c373181-218c-40fb-a082-14594e5181a1" (UID: "4c373181-218c-40fb-a082-14594e5181a1"). InnerVolumeSpecName "kube-api-access-kk8f2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.262643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791a2a08-f5a6-4684-8297-ce0e7fea58f3-kube-api-access-hsw9z" (OuterVolumeSpecName: "kube-api-access-hsw9z") pod "791a2a08-f5a6-4684-8297-ce0e7fea58f3" (UID: "791a2a08-f5a6-4684-8297-ce0e7fea58f3"). InnerVolumeSpecName "kube-api-access-hsw9z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.264317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f69cef9-9def-4679-81e4-95d61cdc8135-kube-api-access-ds4pw" (OuterVolumeSpecName: "kube-api-access-ds4pw") pod "7f69cef9-9def-4679-81e4-95d61cdc8135" (UID: "7f69cef9-9def-4679-81e4-95d61cdc8135"). InnerVolumeSpecName "kube-api-access-ds4pw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.358220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhkrp\" (UniqueName: \"kubernetes.io/projected/95ce7265-f42a-41d0-b298-f7eed9fb59e0-kube-api-access-xhkrp\") pod \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.358369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/95ce7265-f42a-41d0-b298-f7eed9fb59e0-operator-scripts\") pod \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\" (UID: \"95ce7265-f42a-41d0-b298-f7eed9fb59e0\") " Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.358924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ce7265-f42a-41d0-b298-f7eed9fb59e0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "95ce7265-f42a-41d0-b298-f7eed9fb59e0" (UID: "95ce7265-f42a-41d0-b298-f7eed9fb59e0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359116 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hsw9z\" (UniqueName: \"kubernetes.io/projected/791a2a08-f5a6-4684-8297-ce0e7fea58f3-kube-api-access-hsw9z\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359136 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4c373181-218c-40fb-a082-14594e5181a1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359146 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b18665eb-d9cc-4c23-bd26-79c45741fe22-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359157 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/95ce7265-f42a-41d0-b298-f7eed9fb59e0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359166 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mm5dx\" (UniqueName: \"kubernetes.io/projected/b18665eb-d9cc-4c23-bd26-79c45741fe22-kube-api-access-mm5dx\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359175 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f69cef9-9def-4679-81e4-95d61cdc8135-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359183 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kk8f2\" (UniqueName: \"kubernetes.io/projected/4c373181-218c-40fb-a082-14594e5181a1-kube-api-access-kk8f2\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359213 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/791a2a08-f5a6-4684-8297-ce0e7fea58f3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.359222 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ds4pw\" (UniqueName: \"kubernetes.io/projected/7f69cef9-9def-4679-81e4-95d61cdc8135-kube-api-access-ds4pw\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.361943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ce7265-f42a-41d0-b298-f7eed9fb59e0-kube-api-access-xhkrp" (OuterVolumeSpecName: "kube-api-access-xhkrp") pod "95ce7265-f42a-41d0-b298-f7eed9fb59e0" (UID: "95ce7265-f42a-41d0-b298-f7eed9fb59e0"). InnerVolumeSpecName "kube-api-access-xhkrp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.460234 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xhkrp\" (UniqueName: \"kubernetes.io/projected/95ce7265-f42a-41d0-b298-f7eed9fb59e0-kube-api-access-xhkrp\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.491960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" event={"ID":"4c373181-218c-40fb-a082-14594e5181a1","Type":"ContainerDied","Data":"a7769e33319032a834bc6b40c6e05afebe7aefb4c23d834007598fa3e5e6885d"} Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.492001 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7769e33319032a834bc6b40c6e05afebe7aefb4c23d834007598fa3e5e6885d" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.492020 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-j4h4v" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.493970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" event={"ID":"b18665eb-d9cc-4c23-bd26-79c45741fe22","Type":"ContainerDied","Data":"9dd271442a6798fe52ac243560ddd002e0d90d45984feee2d95f3e2e09034200"} Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.493983 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-0893-account-create-nsdxt" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.493995 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dd271442a6798fe52ac243560ddd002e0d90d45984feee2d95f3e2e09034200" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.496888 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.496925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5148-account-create-lq5hp" event={"ID":"7f69cef9-9def-4679-81e4-95d61cdc8135","Type":"ContainerDied","Data":"c4f64a04392061f2d098517c9fcb7cc79443b8afaffe30cb556e848d4e3e932a"} Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.496976 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4f64a04392061f2d098517c9fcb7cc79443b8afaffe30cb556e848d4e3e932a" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.499003 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p4rps" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.499017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-p4rps" event={"ID":"9c8fb94e-bf69-434a-b0d1-60bd7129eec1","Type":"ContainerDied","Data":"13b87622a67416e5584b2d9c857e0b57509eb3e6fc355c1dbed764bf5b5f15cd"} Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.499302 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13b87622a67416e5584b2d9c857e0b57509eb3e6fc355c1dbed764bf5b5f15cd" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.500571 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.500579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tfd6s" event={"ID":"791a2a08-f5a6-4684-8297-ce0e7fea58f3","Type":"ContainerDied","Data":"08e20bc0bdab52e0db95b6250aa0f8bcadd50a6b7a02620422231f3df8edafe6"} Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.500616 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08e20bc0bdab52e0db95b6250aa0f8bcadd50a6b7a02620422231f3df8edafe6" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.502107 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-5kmlk" event={"ID":"95ce7265-f42a-41d0-b298-f7eed9fb59e0","Type":"ContainerDied","Data":"6336aef16bde45281ffe60ffb15fa33561389cb0fc3a5cf8788a25ef70081597"} Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.502142 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6336aef16bde45281ffe60ffb15fa33561389cb0fc3a5cf8788a25ef70081597" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.502113 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-5kmlk" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.726302 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:30 crc kubenswrapper[4769]: I1121 12:48:30.793043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001168 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.001567 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c373181-218c-40fb-a082-14594e5181a1" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001583 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c373181-218c-40fb-a082-14594e5181a1" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.001605 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b18665eb-d9cc-4c23-bd26-79c45741fe22" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001615 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18665eb-d9cc-4c23-bd26-79c45741fe22" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.001644 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f69cef9-9def-4679-81e4-95d61cdc8135" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001652 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f69cef9-9def-4679-81e4-95d61cdc8135" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.001668 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="791a2a08-f5a6-4684-8297-ce0e7fea58f3" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001676 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="791a2a08-f5a6-4684-8297-ce0e7fea58f3" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.001689 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c8fb94e-bf69-434a-b0d1-60bd7129eec1" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001696 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8fb94e-bf69-434a-b0d1-60bd7129eec1" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.001711 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95ce7265-f42a-41d0-b298-f7eed9fb59e0" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001718 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ce7265-f42a-41d0-b298-f7eed9fb59e0" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001927 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95ce7265-f42a-41d0-b298-f7eed9fb59e0" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001946 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="791a2a08-f5a6-4684-8297-ce0e7fea58f3" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001965 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f69cef9-9def-4679-81e4-95d61cdc8135" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.001986 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4c373181-218c-40fb-a082-14594e5181a1" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.002001 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c8fb94e-bf69-434a-b0d1-60bd7129eec1" containerName="mariadb-database-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.002010 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b18665eb-d9cc-4c23-bd26-79c45741fe22" containerName="mariadb-account-create" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.008314 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.015434 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.015539 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.015716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-wwv28" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.015975 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.019176 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.073628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6qbb\" (UniqueName: \"kubernetes.io/projected/958a6399-8efa-4703-a612-528546972586-kube-api-access-h6qbb\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.073735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/958a6399-8efa-4703-a612-528546972586-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.073817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.073910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-scripts\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.073952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.074000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-config\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.074058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.074092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.074378 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.074412 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:48:31 crc kubenswrapper[4769]: E1121 12:48:31.074474 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift podName:85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469 nodeName:}" failed. No retries permitted until 2025-11-21 12:48:33.074452291 +0000 UTC m=+3471.775114149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift") pod "swift-storage-0" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469") : configmap "swift-ring-files" not found Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.175832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6qbb\" (UniqueName: \"kubernetes.io/projected/958a6399-8efa-4703-a612-528546972586-kube-api-access-h6qbb\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.176265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/958a6399-8efa-4703-a612-528546972586-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.176511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-scripts\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.176654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.176913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-config\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.177107 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.177927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.177243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/958a6399-8efa-4703-a612-528546972586-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.178154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-scripts\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.179694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-config\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.183080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.183500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.184003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.197577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6qbb\" (UniqueName: \"kubernetes.io/projected/958a6399-8efa-4703-a612-528546972586-kube-api-access-h6qbb\") pod \"ovn-northd-0\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.331629 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:31 crc kubenswrapper[4769]: I1121 12:48:31.812728 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:48:31 crc kubenswrapper[4769]: W1121 12:48:31.817487 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod958a6399_8efa_4703_a612_528546972586.slice/crio-93410b689e9d6f3630f576e7952d9b8846dbb4c8bdffe06160eac14af55976fa WatchSource:0}: Error finding container 93410b689e9d6f3630f576e7952d9b8846dbb4c8bdffe06160eac14af55976fa: Status 404 returned error can't find the container with id 93410b689e9d6f3630f576e7952d9b8846dbb4c8bdffe06160eac14af55976fa Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.136580 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7c586"] Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.138237 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.140313 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-78dvp" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.141313 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.157819 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7c586"] Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.304709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmshq\" (UniqueName: \"kubernetes.io/projected/c477f4d1-5801-48f9-82bb-9808a7833249-kube-api-access-pmshq\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.304777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-combined-ca-bundle\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.304998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-config-data\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.305105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-db-sync-config-data\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.406973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pmshq\" (UniqueName: \"kubernetes.io/projected/c477f4d1-5801-48f9-82bb-9808a7833249-kube-api-access-pmshq\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.407028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-combined-ca-bundle\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.407152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-config-data\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.407216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-db-sync-config-data\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.411222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-db-sync-config-data\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.411702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-combined-ca-bundle\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.415176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-config-data\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.423808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmshq\" (UniqueName: \"kubernetes.io/projected/c477f4d1-5801-48f9-82bb-9808a7833249-kube-api-access-pmshq\") pod \"glance-db-sync-7c586\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.493629 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.534184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"958a6399-8efa-4703-a612-528546972586","Type":"ContainerStarted","Data":"5c7c8df63643bb12b59eb23d35cf2050591d4e22ecfad274f62645c670517a20"} Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.534262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"958a6399-8efa-4703-a612-528546972586","Type":"ContainerStarted","Data":"7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4"} Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.534278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"958a6399-8efa-4703-a612-528546972586","Type":"ContainerStarted","Data":"93410b689e9d6f3630f576e7952d9b8846dbb4c8bdffe06160eac14af55976fa"} Nov 21 12:48:32 crc kubenswrapper[4769]: I1121 12:48:32.534386 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.003999 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.003972573 podStartE2EDuration="3.003972573s" podCreationTimestamp="2025-11-21 12:48:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:32.560709433 +0000 UTC m=+3471.261371261" watchObservedRunningTime="2025-11-21 12:48:33.003972573 +0000 UTC m=+3471.704634411" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.004688 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7c586"] Nov 21 12:48:33 crc kubenswrapper[4769]: W1121 12:48:33.006784 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc477f4d1_5801_48f9_82bb_9808a7833249.slice/crio-63ac48edee1423fed9208f1e71bebca4889a47be0c83abc17c047bdbf1855be4 WatchSource:0}: Error finding container 63ac48edee1423fed9208f1e71bebca4889a47be0c83abc17c047bdbf1855be4: Status 404 returned error can't find the container with id 63ac48edee1423fed9208f1e71bebca4889a47be0c83abc17c047bdbf1855be4 Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.118280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:33 crc kubenswrapper[4769]: E1121 12:48:33.118523 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:48:33 crc kubenswrapper[4769]: E1121 12:48:33.119022 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:48:33 crc kubenswrapper[4769]: E1121 12:48:33.119100 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift podName:85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469 nodeName:}" failed. No retries permitted until 2025-11-21 12:48:37.119076728 +0000 UTC m=+3475.819738546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift") pod "swift-storage-0" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469") : configmap "swift-ring-files" not found Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.225776 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ncqj5"] Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.226838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.230482 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.230731 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.238051 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ncqj5"] Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.238826 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.425467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-dispersionconf\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.425569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtfj\" (UniqueName: \"kubernetes.io/projected/0752c05d-d9bd-4946-9948-22e4a3270c4b-kube-api-access-kdtfj\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.425609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-ring-data-devices\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.425637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-scripts\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.425804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0752c05d-d9bd-4946-9948-22e4a3270c4b-etc-swift\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.425830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-combined-ca-bundle\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.426009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-swiftconf\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.527998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-swiftconf\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.528176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-dispersionconf\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.528247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtfj\" (UniqueName: \"kubernetes.io/projected/0752c05d-d9bd-4946-9948-22e4a3270c4b-kube-api-access-kdtfj\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.528294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-ring-data-devices\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.528332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-scripts\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.528493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0752c05d-d9bd-4946-9948-22e4a3270c4b-etc-swift\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.528541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-combined-ca-bundle\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.529127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0752c05d-d9bd-4946-9948-22e4a3270c4b-etc-swift\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.529301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-scripts\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.529359 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-ring-data-devices\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.536479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-dispersionconf\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.536842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-swiftconf\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.537484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-combined-ca-bundle\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.545847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtfj\" (UniqueName: \"kubernetes.io/projected/0752c05d-d9bd-4946-9948-22e4a3270c4b-kube-api-access-kdtfj\") pod \"swift-ring-rebalance-ncqj5\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.551982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7c586" event={"ID":"c477f4d1-5801-48f9-82bb-9808a7833249","Type":"ContainerStarted","Data":"63ac48edee1423fed9208f1e71bebca4889a47be0c83abc17c047bdbf1855be4"} Nov 21 12:48:33 crc kubenswrapper[4769]: I1121 12:48:33.584608 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:34 crc kubenswrapper[4769]: W1121 12:48:34.057412 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0752c05d_d9bd_4946_9948_22e4a3270c4b.slice/crio-3db62f1febcbbeece12e51608bac0f7f2bf23f8593da083ad491a574e3537e96 WatchSource:0}: Error finding container 3db62f1febcbbeece12e51608bac0f7f2bf23f8593da083ad491a574e3537e96: Status 404 returned error can't find the container with id 3db62f1febcbbeece12e51608bac0f7f2bf23f8593da083ad491a574e3537e96 Nov 21 12:48:34 crc kubenswrapper[4769]: I1121 12:48:34.061712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ncqj5"] Nov 21 12:48:34 crc kubenswrapper[4769]: I1121 12:48:34.570556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" event={"ID":"0752c05d-d9bd-4946-9948-22e4a3270c4b","Type":"ContainerStarted","Data":"9b51c56e4d1a42f7ba94a30c1777308a93a42f8c0640ed36f283697fac54f9af"} Nov 21 12:48:34 crc kubenswrapper[4769]: I1121 12:48:34.575579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" event={"ID":"0752c05d-d9bd-4946-9948-22e4a3270c4b","Type":"ContainerStarted","Data":"3db62f1febcbbeece12e51608bac0f7f2bf23f8593da083ad491a574e3537e96"} Nov 21 12:48:34 crc kubenswrapper[4769]: I1121 12:48:34.582296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7c586" event={"ID":"c477f4d1-5801-48f9-82bb-9808a7833249","Type":"ContainerStarted","Data":"2c6797e76df0bc1b98206b7e04f78628fca119a8b8f31052a5808d8ac8459c09"} Nov 21 12:48:34 crc kubenswrapper[4769]: I1121 12:48:34.602371 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" podStartSLOduration=1.602349239 podStartE2EDuration="1.602349239s" podCreationTimestamp="2025-11-21 12:48:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:34.598968188 +0000 UTC m=+3473.299630016" watchObservedRunningTime="2025-11-21 12:48:34.602349239 +0000 UTC m=+3473.303011067" Nov 21 12:48:34 crc kubenswrapper[4769]: I1121 12:48:34.618629 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-7c586" podStartSLOduration=2.618610018 podStartE2EDuration="2.618610018s" podCreationTimestamp="2025-11-21 12:48:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:34.618557126 +0000 UTC m=+3473.319218964" watchObservedRunningTime="2025-11-21 12:48:34.618610018 +0000 UTC m=+3473.319271836" Nov 21 12:48:37 crc kubenswrapper[4769]: I1121 12:48:37.123782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:37 crc kubenswrapper[4769]: E1121 12:48:37.124341 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:48:37 crc kubenswrapper[4769]: E1121 12:48:37.124377 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:48:37 crc kubenswrapper[4769]: E1121 12:48:37.124537 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift podName:85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469 nodeName:}" failed. No retries permitted until 2025-11-21 12:48:45.124473491 +0000 UTC m=+3483.825135349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift") pod "swift-storage-0" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469") : configmap "swift-ring-files" not found Nov 21 12:48:41 crc kubenswrapper[4769]: I1121 12:48:41.681635 4769 generic.go:334] "Generic (PLEG): container finished" podID="0752c05d-d9bd-4946-9948-22e4a3270c4b" containerID="9b51c56e4d1a42f7ba94a30c1777308a93a42f8c0640ed36f283697fac54f9af" exitCode=0 Nov 21 12:48:41 crc kubenswrapper[4769]: I1121 12:48:41.681765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" event={"ID":"0752c05d-d9bd-4946-9948-22e4a3270c4b","Type":"ContainerDied","Data":"9b51c56e4d1a42f7ba94a30c1777308a93a42f8c0640ed36f283697fac54f9af"} Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.151143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.248809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0752c05d-d9bd-4946-9948-22e4a3270c4b-etc-swift\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.248904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-ring-data-devices\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.248939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-swiftconf\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.248965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-scripts\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.248995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-dispersionconf\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.249016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdtfj\" (UniqueName: \"kubernetes.io/projected/0752c05d-d9bd-4946-9948-22e4a3270c4b-kube-api-access-kdtfj\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.249057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-combined-ca-bundle\") pod \"0752c05d-d9bd-4946-9948-22e4a3270c4b\" (UID: \"0752c05d-d9bd-4946-9948-22e4a3270c4b\") " Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.250267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.250333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0752c05d-d9bd-4946-9948-22e4a3270c4b-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.255958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0752c05d-d9bd-4946-9948-22e4a3270c4b-kube-api-access-kdtfj" (OuterVolumeSpecName: "kube-api-access-kdtfj") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "kube-api-access-kdtfj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.260319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.273251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-scripts" (OuterVolumeSpecName: "scripts") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.293333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.295312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0752c05d-d9bd-4946-9948-22e4a3270c4b" (UID: "0752c05d-d9bd-4946-9948-22e4a3270c4b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350815 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350859 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kdtfj\" (UniqueName: \"kubernetes.io/projected/0752c05d-d9bd-4946-9948-22e4a3270c4b-kube-api-access-kdtfj\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350875 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350887 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/0752c05d-d9bd-4946-9948-22e4a3270c4b-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350903 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350915 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/0752c05d-d9bd-4946-9948-22e4a3270c4b-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.350927 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0752c05d-d9bd-4946-9948-22e4a3270c4b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.711053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" event={"ID":"0752c05d-d9bd-4946-9948-22e4a3270c4b","Type":"ContainerDied","Data":"3db62f1febcbbeece12e51608bac0f7f2bf23f8593da083ad491a574e3537e96"} Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.711533 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3db62f1febcbbeece12e51608bac0f7f2bf23f8593da083ad491a574e3537e96" Nov 21 12:48:43 crc kubenswrapper[4769]: I1121 12:48:43.711120 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ncqj5" Nov 21 12:48:45 crc kubenswrapper[4769]: I1121 12:48:45.181540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:45 crc kubenswrapper[4769]: I1121 12:48:45.192553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"swift-storage-0\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:45 crc kubenswrapper[4769]: I1121 12:48:45.289824 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:48:45 crc kubenswrapper[4769]: I1121 12:48:45.746445 4769 generic.go:334] "Generic (PLEG): container finished" podID="c477f4d1-5801-48f9-82bb-9808a7833249" containerID="2c6797e76df0bc1b98206b7e04f78628fca119a8b8f31052a5808d8ac8459c09" exitCode=0 Nov 21 12:48:45 crc kubenswrapper[4769]: I1121 12:48:45.746547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7c586" event={"ID":"c477f4d1-5801-48f9-82bb-9808a7833249","Type":"ContainerDied","Data":"2c6797e76df0bc1b98206b7e04f78628fca119a8b8f31052a5808d8ac8459c09"} Nov 21 12:48:45 crc kubenswrapper[4769]: I1121 12:48:45.828141 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:48:46 crc kubenswrapper[4769]: I1121 12:48:46.438414 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:48:46 crc kubenswrapper[4769]: I1121 12:48:46.760602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769"} Nov 21 12:48:46 crc kubenswrapper[4769]: I1121 12:48:46.760661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814"} Nov 21 12:48:46 crc kubenswrapper[4769]: I1121 12:48:46.760676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14"} Nov 21 12:48:46 crc kubenswrapper[4769]: I1121 12:48:46.760687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"2ecf3e99c58dfbcf4138f3a99c9607306eebd7afbde246c178e89ba91fa9a9c4"} Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.184793 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.329288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-config-data\") pod \"c477f4d1-5801-48f9-82bb-9808a7833249\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.329519 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-combined-ca-bundle\") pod \"c477f4d1-5801-48f9-82bb-9808a7833249\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.329563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmshq\" (UniqueName: \"kubernetes.io/projected/c477f4d1-5801-48f9-82bb-9808a7833249-kube-api-access-pmshq\") pod \"c477f4d1-5801-48f9-82bb-9808a7833249\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.329598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-db-sync-config-data\") pod \"c477f4d1-5801-48f9-82bb-9808a7833249\" (UID: \"c477f4d1-5801-48f9-82bb-9808a7833249\") " Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.335883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "c477f4d1-5801-48f9-82bb-9808a7833249" (UID: "c477f4d1-5801-48f9-82bb-9808a7833249"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.336963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c477f4d1-5801-48f9-82bb-9808a7833249-kube-api-access-pmshq" (OuterVolumeSpecName: "kube-api-access-pmshq") pod "c477f4d1-5801-48f9-82bb-9808a7833249" (UID: "c477f4d1-5801-48f9-82bb-9808a7833249"). InnerVolumeSpecName "kube-api-access-pmshq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.364267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c477f4d1-5801-48f9-82bb-9808a7833249" (UID: "c477f4d1-5801-48f9-82bb-9808a7833249"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.396961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-config-data" (OuterVolumeSpecName: "config-data") pod "c477f4d1-5801-48f9-82bb-9808a7833249" (UID: "c477f4d1-5801-48f9-82bb-9808a7833249"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.430940 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.430979 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.430991 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pmshq\" (UniqueName: \"kubernetes.io/projected/c477f4d1-5801-48f9-82bb-9808a7833249-kube-api-access-pmshq\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.431053 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/c477f4d1-5801-48f9-82bb-9808a7833249-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.777678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b"} Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.777723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab"} Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.779397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-7c586" event={"ID":"c477f4d1-5801-48f9-82bb-9808a7833249","Type":"ContainerDied","Data":"63ac48edee1423fed9208f1e71bebca4889a47be0c83abc17c047bdbf1855be4"} Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.779419 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63ac48edee1423fed9208f1e71bebca4889a47be0c83abc17c047bdbf1855be4" Nov 21 12:48:47 crc kubenswrapper[4769]: I1121 12:48:47.779528 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-7c586" Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.795213 4769 generic.go:334] "Generic (PLEG): container finished" podID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerID="fd6ca74f63b4756b4af38ee8899275ee4708f896235dd0666af05eb80cdb4c38" exitCode=0 Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.795417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc","Type":"ContainerDied","Data":"fd6ca74f63b4756b4af38ee8899275ee4708f896235dd0666af05eb80cdb4c38"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.803089 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.803139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.803307 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.803324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.803335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.806859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"66952fe6-66e9-40b4-93df-3e91438a78f9","Type":"ContainerDied","Data":"b51b6e0b818040d5aa0b770763e60d7c3a1de388a4d7bb2a5c13d6493c765d7c"} Nov 21 12:48:48 crc kubenswrapper[4769]: I1121 12:48:48.806859 4769 generic.go:334] "Generic (PLEG): container finished" podID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerID="b51b6e0b818040d5aa0b770763e60d7c3a1de388a4d7bb2a5c13d6493c765d7c" exitCode=0 Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.850893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.851231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.851247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.851258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.851270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerStarted","Data":"71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.858614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"66952fe6-66e9-40b4-93df-3e91438a78f9","Type":"ContainerStarted","Data":"cc198110946fb67c2e80ec49d47496e089e3cd247ee736ce68afa9e2115fe25f"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.859363 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.862157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc","Type":"ContainerStarted","Data":"c13d74ce5dbd7f85d83030e818e88ade494f1c8ec1907c6617cc76ed83cd05db"} Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.862442 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.916235 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.916215302 podStartE2EDuration="21.916215302s" podCreationTimestamp="2025-11-21 12:48:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:49.916128789 +0000 UTC m=+3488.616790617" watchObservedRunningTime="2025-11-21 12:48:49.916215302 +0000 UTC m=+3488.616877120" Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.949048 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=38.949032577 podStartE2EDuration="38.949032577s" podCreationTimestamp="2025-11-21 12:48:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:49.948247856 +0000 UTC m=+3488.648909694" watchObservedRunningTime="2025-11-21 12:48:49.949032577 +0000 UTC m=+3488.649694395" Nov 21 12:48:49 crc kubenswrapper[4769]: I1121 12:48:49.983866 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.983849707 podStartE2EDuration="37.983849707s" podCreationTimestamp="2025-11-21 12:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:49.979475809 +0000 UTC m=+3488.680137637" watchObservedRunningTime="2025-11-21 12:48:49.983849707 +0000 UTC m=+3488.684511525" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.088786 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s"] Nov 21 12:48:50 crc kubenswrapper[4769]: E1121 12:48:50.089422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c477f4d1-5801-48f9-82bb-9808a7833249" containerName="glance-db-sync" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.089443 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c477f4d1-5801-48f9-82bb-9808a7833249" containerName="glance-db-sync" Nov 21 12:48:50 crc kubenswrapper[4769]: E1121 12:48:50.089466 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0752c05d-d9bd-4946-9948-22e4a3270c4b" containerName="swift-ring-rebalance" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.089473 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0752c05d-d9bd-4946-9948-22e4a3270c4b" containerName="swift-ring-rebalance" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.089635 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c477f4d1-5801-48f9-82bb-9808a7833249" containerName="glance-db-sync" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.089655 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0752c05d-d9bd-4946-9948-22e4a3270c4b" containerName="swift-ring-rebalance" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.090540 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.092532 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.104676 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s"] Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.176370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.176474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.176496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnh4x\" (UniqueName: \"kubernetes.io/projected/e7c1a815-ffde-4f64-85c1-281bb457b1fa-kube-api-access-rnh4x\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.176528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-config\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.277813 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-config\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.277907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.277991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.278011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rnh4x\" (UniqueName: \"kubernetes.io/projected/e7c1a815-ffde-4f64-85c1-281bb457b1fa-kube-api-access-rnh4x\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.278717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-config\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.278811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.278894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.300285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnh4x\" (UniqueName: \"kubernetes.io/projected/e7c1a815-ffde-4f64-85c1-281bb457b1fa-kube-api-access-rnh4x\") pod \"dnsmasq-dnsmasq-699b4797df-q6n4s\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.405440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:50 crc kubenswrapper[4769]: I1121 12:48:50.896700 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s"] Nov 21 12:48:50 crc kubenswrapper[4769]: W1121 12:48:50.902454 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7c1a815_ffde_4f64_85c1_281bb457b1fa.slice/crio-1166f5fe23c000ff1b42785a70824acda59bb5febed8c10ea7175ed9e51bcf6b WatchSource:0}: Error finding container 1166f5fe23c000ff1b42785a70824acda59bb5febed8c10ea7175ed9e51bcf6b: Status 404 returned error can't find the container with id 1166f5fe23c000ff1b42785a70824acda59bb5febed8c10ea7175ed9e51bcf6b Nov 21 12:48:51 crc kubenswrapper[4769]: I1121 12:48:51.886232 4769 generic.go:334] "Generic (PLEG): container finished" podID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerID="f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119" exitCode=0 Nov 21 12:48:51 crc kubenswrapper[4769]: I1121 12:48:51.886356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" event={"ID":"e7c1a815-ffde-4f64-85c1-281bb457b1fa","Type":"ContainerDied","Data":"f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119"} Nov 21 12:48:51 crc kubenswrapper[4769]: I1121 12:48:51.887262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" event={"ID":"e7c1a815-ffde-4f64-85c1-281bb457b1fa","Type":"ContainerStarted","Data":"1166f5fe23c000ff1b42785a70824acda59bb5febed8c10ea7175ed9e51bcf6b"} Nov 21 12:48:52 crc kubenswrapper[4769]: I1121 12:48:52.910630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" event={"ID":"e7c1a815-ffde-4f64-85c1-281bb457b1fa","Type":"ContainerStarted","Data":"a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8"} Nov 21 12:48:52 crc kubenswrapper[4769]: I1121 12:48:52.911173 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:48:52 crc kubenswrapper[4769]: I1121 12:48:52.948928 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" podStartSLOduration=2.948901798 podStartE2EDuration="2.948901798s" podCreationTimestamp="2025-11-21 12:48:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:48:52.93931393 +0000 UTC m=+3491.639975758" watchObservedRunningTime="2025-11-21 12:48:52.948901798 +0000 UTC m=+3491.649563656" Nov 21 12:49:00 crc kubenswrapper[4769]: I1121 12:49:00.407493 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:49:00 crc kubenswrapper[4769]: I1121 12:49:00.498428 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q"] Nov 21 12:49:00 crc kubenswrapper[4769]: I1121 12:49:00.498797 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" podUID="74667797-02dc-4a11-95fe-97d24a539e51" containerName="dnsmasq-dns" containerID="cri-o://4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace" gracePeriod=10 Nov 21 12:49:01 crc kubenswrapper[4769]: E1121 12:49:01.203355 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74667797_02dc_4a11_95fe_97d24a539e51.slice/crio-conmon-4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.659441 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.830738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-dnsmasq-svc\") pod \"74667797-02dc-4a11-95fe-97d24a539e51\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.831030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz7zl\" (UniqueName: \"kubernetes.io/projected/74667797-02dc-4a11-95fe-97d24a539e51-kube-api-access-mz7zl\") pod \"74667797-02dc-4a11-95fe-97d24a539e51\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.831061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-config\") pod \"74667797-02dc-4a11-95fe-97d24a539e51\" (UID: \"74667797-02dc-4a11-95fe-97d24a539e51\") " Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.852507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74667797-02dc-4a11-95fe-97d24a539e51-kube-api-access-mz7zl" (OuterVolumeSpecName: "kube-api-access-mz7zl") pod "74667797-02dc-4a11-95fe-97d24a539e51" (UID: "74667797-02dc-4a11-95fe-97d24a539e51"). InnerVolumeSpecName "kube-api-access-mz7zl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.907500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-config" (OuterVolumeSpecName: "config") pod "74667797-02dc-4a11-95fe-97d24a539e51" (UID: "74667797-02dc-4a11-95fe-97d24a539e51"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.910750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "74667797-02dc-4a11-95fe-97d24a539e51" (UID: "74667797-02dc-4a11-95fe-97d24a539e51"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.933106 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mz7zl\" (UniqueName: \"kubernetes.io/projected/74667797-02dc-4a11-95fe-97d24a539e51-kube-api-access-mz7zl\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.933155 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:01 crc kubenswrapper[4769]: I1121 12:49:01.933166 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/74667797-02dc-4a11-95fe-97d24a539e51-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.038130 4769 generic.go:334] "Generic (PLEG): container finished" podID="74667797-02dc-4a11-95fe-97d24a539e51" containerID="4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace" exitCode=0 Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.038267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" event={"ID":"74667797-02dc-4a11-95fe-97d24a539e51","Type":"ContainerDied","Data":"4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace"} Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.038346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" event={"ID":"74667797-02dc-4a11-95fe-97d24a539e51","Type":"ContainerDied","Data":"20af16df7316dd093519bb7cc835575c352599301e28b69e3c284468185a2d99"} Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.038369 4769 scope.go:117] "RemoveContainer" containerID="4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.038242 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.079014 4769 scope.go:117] "RemoveContainer" containerID="2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.088129 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q"] Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.100736 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-fqf5q"] Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.126761 4769 scope.go:117] "RemoveContainer" containerID="4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace" Nov 21 12:49:02 crc kubenswrapper[4769]: E1121 12:49:02.127420 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace\": container with ID starting with 4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace not found: ID does not exist" containerID="4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.127459 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace"} err="failed to get container status \"4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace\": rpc error: code = NotFound desc = could not find container \"4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace\": container with ID starting with 4e147d14b38c6f3aa5238305fc02229a7b51baa61da53baab41f0f001c311ace not found: ID does not exist" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.127485 4769 scope.go:117] "RemoveContainer" containerID="2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49" Nov 21 12:49:02 crc kubenswrapper[4769]: E1121 12:49:02.127890 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49\": container with ID starting with 2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49 not found: ID does not exist" containerID="2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49" Nov 21 12:49:02 crc kubenswrapper[4769]: I1121 12:49:02.127939 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49"} err="failed to get container status \"2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49\": rpc error: code = NotFound desc = could not find container \"2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49\": container with ID starting with 2facbc747395469ac55a881c703b31ea7b8b74b42e9484340efcad79a132db49 not found: ID does not exist" Nov 21 12:49:03 crc kubenswrapper[4769]: I1121 12:49:03.014544 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:49:03 crc kubenswrapper[4769]: I1121 12:49:03.289005 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74667797-02dc-4a11-95fe-97d24a539e51" path="/var/lib/kubelet/pods/74667797-02dc-4a11-95fe-97d24a539e51/volumes" Nov 21 12:49:03 crc kubenswrapper[4769]: I1121 12:49:03.768489 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.321515 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-5xjxs"] Nov 21 12:49:05 crc kubenswrapper[4769]: E1121 12:49:05.322086 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74667797-02dc-4a11-95fe-97d24a539e51" containerName="dnsmasq-dns" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.322098 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74667797-02dc-4a11-95fe-97d24a539e51" containerName="dnsmasq-dns" Nov 21 12:49:05 crc kubenswrapper[4769]: E1121 12:49:05.322112 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74667797-02dc-4a11-95fe-97d24a539e51" containerName="init" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.322117 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74667797-02dc-4a11-95fe-97d24a539e51" containerName="init" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.322289 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="74667797-02dc-4a11-95fe-97d24a539e51" containerName="dnsmasq-dns" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.322797 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.332108 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-5xjxs"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.397858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px7dt\" (UniqueName: \"kubernetes.io/projected/170d353a-c12f-4e7a-b173-37444306e05e-kube-api-access-px7dt\") pod \"barbican-db-create-5xjxs\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.398038 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/170d353a-c12f-4e7a-b173-37444306e05e-operator-scripts\") pod \"barbican-db-create-5xjxs\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.421277 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-1f1d-account-create-grcs2"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.422262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.435114 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-1f1d-account-create-grcs2"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.435536 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.499167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctw8r\" (UniqueName: \"kubernetes.io/projected/946c079a-b406-4924-a4de-cce549b51be1-kube-api-access-ctw8r\") pod \"barbican-1f1d-account-create-grcs2\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.499451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/946c079a-b406-4924-a4de-cce549b51be1-operator-scripts\") pod \"barbican-1f1d-account-create-grcs2\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.499659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/170d353a-c12f-4e7a-b173-37444306e05e-operator-scripts\") pod \"barbican-db-create-5xjxs\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.499752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-px7dt\" (UniqueName: \"kubernetes.io/projected/170d353a-c12f-4e7a-b173-37444306e05e-kube-api-access-px7dt\") pod \"barbican-db-create-5xjxs\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.500499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/170d353a-c12f-4e7a-b173-37444306e05e-operator-scripts\") pod \"barbican-db-create-5xjxs\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.515888 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-g8sst"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.516874 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.518015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-px7dt\" (UniqueName: \"kubernetes.io/projected/170d353a-c12f-4e7a-b173-37444306e05e-kube-api-access-px7dt\") pod \"barbican-db-create-5xjxs\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.524756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-g8sst"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.604233 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/946c079a-b406-4924-a4de-cce549b51be1-operator-scripts\") pod \"barbican-1f1d-account-create-grcs2\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.604344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk2ss\" (UniqueName: \"kubernetes.io/projected/f77e1839-a878-4f8b-95b8-50f268ba8902-kube-api-access-dk2ss\") pod \"cinder-db-create-g8sst\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.604407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ctw8r\" (UniqueName: \"kubernetes.io/projected/946c079a-b406-4924-a4de-cce549b51be1-kube-api-access-ctw8r\") pod \"barbican-1f1d-account-create-grcs2\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.604439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f77e1839-a878-4f8b-95b8-50f268ba8902-operator-scripts\") pod \"cinder-db-create-g8sst\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.605050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/946c079a-b406-4924-a4de-cce549b51be1-operator-scripts\") pod \"barbican-1f1d-account-create-grcs2\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.620390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctw8r\" (UniqueName: \"kubernetes.io/projected/946c079a-b406-4924-a4de-cce549b51be1-kube-api-access-ctw8r\") pod \"barbican-1f1d-account-create-grcs2\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.624108 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s2t92"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.627291 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.639130 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-033b-account-create-482ff"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.640324 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.640340 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.645543 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s2t92"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.653196 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.654000 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-033b-account-create-482ff"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.707311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dk2ss\" (UniqueName: \"kubernetes.io/projected/f77e1839-a878-4f8b-95b8-50f268ba8902-kube-api-access-dk2ss\") pod \"cinder-db-create-g8sst\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.707806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a15364d-dc05-4a50-a1c4-473f7393eff7-operator-scripts\") pod \"neutron-db-create-s2t92\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.707887 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f77e1839-a878-4f8b-95b8-50f268ba8902-operator-scripts\") pod \"cinder-db-create-g8sst\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.707926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzspw\" (UniqueName: \"kubernetes.io/projected/4a15364d-dc05-4a50-a1c4-473f7393eff7-kube-api-access-jzspw\") pod \"neutron-db-create-s2t92\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.707958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zmmj\" (UniqueName: \"kubernetes.io/projected/dcebadd9-e29b-494a-9578-1fc3312e728c-kube-api-access-7zmmj\") pod \"neutron-033b-account-create-482ff\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.707979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcebadd9-e29b-494a-9578-1fc3312e728c-operator-scripts\") pod \"neutron-033b-account-create-482ff\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.709311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f77e1839-a878-4f8b-95b8-50f268ba8902-operator-scripts\") pod \"cinder-db-create-g8sst\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.740830 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-djs2n"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.744974 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.758610 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.769860 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.770943 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.771282 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-mbqmh" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.774944 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-px7d7"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.775968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.783341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk2ss\" (UniqueName: \"kubernetes.io/projected/f77e1839-a878-4f8b-95b8-50f268ba8902-kube-api-access-dk2ss\") pod \"cinder-db-create-g8sst\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.790610 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.793914 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.812049 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-djs2n"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jzspw\" (UniqueName: \"kubernetes.io/projected/4a15364d-dc05-4a50-a1c4-473f7393eff7-kube-api-access-jzspw\") pod \"neutron-db-create-s2t92\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7zmmj\" (UniqueName: \"kubernetes.io/projected/dcebadd9-e29b-494a-9578-1fc3312e728c-kube-api-access-7zmmj\") pod \"neutron-033b-account-create-482ff\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcebadd9-e29b-494a-9578-1fc3312e728c-operator-scripts\") pod \"neutron-033b-account-create-482ff\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-combined-ca-bundle\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-config-data\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a15364d-dc05-4a50-a1c4-473f7393eff7-operator-scripts\") pod \"neutron-db-create-s2t92\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.817784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8nh\" (UniqueName: \"kubernetes.io/projected/021c214f-187f-4bec-9938-f41139eba221-kube-api-access-vk8nh\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.818629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcebadd9-e29b-494a-9578-1fc3312e728c-operator-scripts\") pod \"neutron-033b-account-create-482ff\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.818866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a15364d-dc05-4a50-a1c4-473f7393eff7-operator-scripts\") pod \"neutron-db-create-s2t92\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.831617 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-px7d7"] Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.835689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzspw\" (UniqueName: \"kubernetes.io/projected/4a15364d-dc05-4a50-a1c4-473f7393eff7-kube-api-access-jzspw\") pod \"neutron-db-create-s2t92\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.836558 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zmmj\" (UniqueName: \"kubernetes.io/projected/dcebadd9-e29b-494a-9578-1fc3312e728c-kube-api-access-7zmmj\") pod \"neutron-033b-account-create-482ff\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.893444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.919358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-combined-ca-bundle\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.919422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-config-data\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.919466 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppt6\" (UniqueName: \"kubernetes.io/projected/c98251c5-0166-4aae-8fb0-9bdc52b45c26-kube-api-access-nppt6\") pod \"cinder-0e56-account-create-px7d7\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.919518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8nh\" (UniqueName: \"kubernetes.io/projected/021c214f-187f-4bec-9938-f41139eba221-kube-api-access-vk8nh\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.919552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c98251c5-0166-4aae-8fb0-9bdc52b45c26-operator-scripts\") pod \"cinder-0e56-account-create-px7d7\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.926964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-config-data\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.938089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8nh\" (UniqueName: \"kubernetes.io/projected/021c214f-187f-4bec-9938-f41139eba221-kube-api-access-vk8nh\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:05 crc kubenswrapper[4769]: I1121 12:49:05.939174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-combined-ca-bundle\") pod \"keystone-db-sync-djs2n\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.021554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nppt6\" (UniqueName: \"kubernetes.io/projected/c98251c5-0166-4aae-8fb0-9bdc52b45c26-kube-api-access-nppt6\") pod \"cinder-0e56-account-create-px7d7\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.021646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c98251c5-0166-4aae-8fb0-9bdc52b45c26-operator-scripts\") pod \"cinder-0e56-account-create-px7d7\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.022322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c98251c5-0166-4aae-8fb0-9bdc52b45c26-operator-scripts\") pod \"cinder-0e56-account-create-px7d7\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.033603 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.039998 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppt6\" (UniqueName: \"kubernetes.io/projected/c98251c5-0166-4aae-8fb0-9bdc52b45c26-kube-api-access-nppt6\") pod \"cinder-0e56-account-create-px7d7\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.056960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.121853 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.142221 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.232902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-5xjxs"] Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.324996 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-1f1d-account-create-grcs2"] Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.402480 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-033b-account-create-482ff"] Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.448786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-g8sst"] Nov 21 12:49:06 crc kubenswrapper[4769]: W1121 12:49:06.453527 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcebadd9_e29b_494a_9578_1fc3312e728c.slice/crio-bceca0688b0c9eddfc60677fea70912d0a056fd41e2af8995624964cb83d85b5 WatchSource:0}: Error finding container bceca0688b0c9eddfc60677fea70912d0a056fd41e2af8995624964cb83d85b5: Status 404 returned error can't find the container with id bceca0688b0c9eddfc60677fea70912d0a056fd41e2af8995624964cb83d85b5 Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.542379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s2t92"] Nov 21 12:49:06 crc kubenswrapper[4769]: W1121 12:49:06.553498 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a15364d_dc05_4a50_a1c4_473f7393eff7.slice/crio-9d7a9945171f1c7d1938ec1acf3a35a806ce665e465ca04f81d14305482a22d9 WatchSource:0}: Error finding container 9d7a9945171f1c7d1938ec1acf3a35a806ce665e465ca04f81d14305482a22d9: Status 404 returned error can't find the container with id 9d7a9945171f1c7d1938ec1acf3a35a806ce665e465ca04f81d14305482a22d9 Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.684542 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-px7d7"] Nov 21 12:49:06 crc kubenswrapper[4769]: W1121 12:49:06.694733 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc98251c5_0166_4aae_8fb0_9bdc52b45c26.slice/crio-a0a99b8ab6456c8f92bc52ec142b087888565699f4f708764fd1b3b38da8b705 WatchSource:0}: Error finding container a0a99b8ab6456c8f92bc52ec142b087888565699f4f708764fd1b3b38da8b705: Status 404 returned error can't find the container with id a0a99b8ab6456c8f92bc52ec142b087888565699f4f708764fd1b3b38da8b705 Nov 21 12:49:06 crc kubenswrapper[4769]: I1121 12:49:06.718970 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-djs2n"] Nov 21 12:49:06 crc kubenswrapper[4769]: W1121 12:49:06.754023 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod021c214f_187f_4bec_9938_f41139eba221.slice/crio-13ffce6325a0113c9e7fd93ba8f7afcf301033e13edad2c5e4028443f2b69aba WatchSource:0}: Error finding container 13ffce6325a0113c9e7fd93ba8f7afcf301033e13edad2c5e4028443f2b69aba: Status 404 returned error can't find the container with id 13ffce6325a0113c9e7fd93ba8f7afcf301033e13edad2c5e4028443f2b69aba Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.123208 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" event={"ID":"021c214f-187f-4bec-9938-f41139eba221","Type":"ContainerStarted","Data":"6fa27cb583cbd4188d2f2a620e64742637d5b8d379b12edd0bdb077e5eb9ffca"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.123266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" event={"ID":"021c214f-187f-4bec-9938-f41139eba221","Type":"ContainerStarted","Data":"13ffce6325a0113c9e7fd93ba8f7afcf301033e13edad2c5e4028443f2b69aba"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.124730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" event={"ID":"dcebadd9-e29b-494a-9578-1fc3312e728c","Type":"ContainerStarted","Data":"94b53d32059958589c61ac3291152dbf4b5f4564bf4f215bb296e3208e8a3fcf"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.124770 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" event={"ID":"dcebadd9-e29b-494a-9578-1fc3312e728c","Type":"ContainerStarted","Data":"bceca0688b0c9eddfc60677fea70912d0a056fd41e2af8995624964cb83d85b5"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.127918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" event={"ID":"170d353a-c12f-4e7a-b173-37444306e05e","Type":"ContainerStarted","Data":"c0a9278f41ba47ecce94c3a744ee61b82f624c0e5841c37351d0b8b056b76e50"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.127962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" event={"ID":"170d353a-c12f-4e7a-b173-37444306e05e","Type":"ContainerStarted","Data":"544bd8156ee1a0dd1e1cf34c4e9401d7b497f205a563b3b6dc8687497889cd81"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.130245 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-g8sst" event={"ID":"f77e1839-a878-4f8b-95b8-50f268ba8902","Type":"ContainerStarted","Data":"b0908c9c3af2001c2d00836d863694814344699e5b0d6ad7bd11ef283fb433ea"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.130283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-g8sst" event={"ID":"f77e1839-a878-4f8b-95b8-50f268ba8902","Type":"ContainerStarted","Data":"d9fb0fcf4f053e4a103c9c88d12e28ad30d82652af8a2e7633163bc938af8679"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.131912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" event={"ID":"c98251c5-0166-4aae-8fb0-9bdc52b45c26","Type":"ContainerStarted","Data":"b031c526f4a33dd319db8596c815b15225728574ac48474464c6cc8899a74f6a"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.131945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" event={"ID":"c98251c5-0166-4aae-8fb0-9bdc52b45c26","Type":"ContainerStarted","Data":"a0a99b8ab6456c8f92bc52ec142b087888565699f4f708764fd1b3b38da8b705"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.136142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s2t92" event={"ID":"4a15364d-dc05-4a50-a1c4-473f7393eff7","Type":"ContainerStarted","Data":"51dfee9453dc993615898ea64d0e65dd3dd38078e1a79604cce71fe21db745b6"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.136222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s2t92" event={"ID":"4a15364d-dc05-4a50-a1c4-473f7393eff7","Type":"ContainerStarted","Data":"9d7a9945171f1c7d1938ec1acf3a35a806ce665e465ca04f81d14305482a22d9"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.138750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" event={"ID":"946c079a-b406-4924-a4de-cce549b51be1","Type":"ContainerStarted","Data":"d7e08c5cb9f88f9d70830a71eb265d5c8c3cc00c5d73426e2ca9f97e58cbf25e"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.138795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" event={"ID":"946c079a-b406-4924-a4de-cce549b51be1","Type":"ContainerStarted","Data":"5d501847126c97593616a2ae1bce0a824df430fadf6fd7497f09aa75bb3e0e97"} Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.146144 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" podStartSLOduration=2.146130227 podStartE2EDuration="2.146130227s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.139752053 +0000 UTC m=+3505.840413861" watchObservedRunningTime="2025-11-21 12:49:07.146130227 +0000 UTC m=+3505.846792045" Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.162971 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" podStartSLOduration=2.162951935 podStartE2EDuration="2.162951935s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.15434547 +0000 UTC m=+3505.855007278" watchObservedRunningTime="2025-11-21 12:49:07.162951935 +0000 UTC m=+3505.863613753" Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.181145 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-g8sst" podStartSLOduration=2.181123449 podStartE2EDuration="2.181123449s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.1782125 +0000 UTC m=+3505.878874308" watchObservedRunningTime="2025-11-21 12:49:07.181123449 +0000 UTC m=+3505.881785267" Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.198119 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" podStartSLOduration=2.198091511 podStartE2EDuration="2.198091511s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.194078021 +0000 UTC m=+3505.894739839" watchObservedRunningTime="2025-11-21 12:49:07.198091511 +0000 UTC m=+3505.898753339" Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.220701 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-s2t92" podStartSLOduration=2.220678875 podStartE2EDuration="2.220678875s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.218618169 +0000 UTC m=+3505.919279997" watchObservedRunningTime="2025-11-21 12:49:07.220678875 +0000 UTC m=+3505.921340693" Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.239374 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" podStartSLOduration=2.239352243 podStartE2EDuration="2.239352243s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.232822775 +0000 UTC m=+3505.933484593" watchObservedRunningTime="2025-11-21 12:49:07.239352243 +0000 UTC m=+3505.940014071" Nov 21 12:49:07 crc kubenswrapper[4769]: I1121 12:49:07.252447 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" podStartSLOduration=2.2524235790000002 podStartE2EDuration="2.252423579s" podCreationTimestamp="2025-11-21 12:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:07.249880699 +0000 UTC m=+3505.950542527" watchObservedRunningTime="2025-11-21 12:49:07.252423579 +0000 UTC m=+3505.953085407" Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.158256 4769 generic.go:334] "Generic (PLEG): container finished" podID="c98251c5-0166-4aae-8fb0-9bdc52b45c26" containerID="b031c526f4a33dd319db8596c815b15225728574ac48474464c6cc8899a74f6a" exitCode=0 Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.158534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" event={"ID":"c98251c5-0166-4aae-8fb0-9bdc52b45c26","Type":"ContainerDied","Data":"b031c526f4a33dd319db8596c815b15225728574ac48474464c6cc8899a74f6a"} Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.162575 4769 generic.go:334] "Generic (PLEG): container finished" podID="4a15364d-dc05-4a50-a1c4-473f7393eff7" containerID="51dfee9453dc993615898ea64d0e65dd3dd38078e1a79604cce71fe21db745b6" exitCode=0 Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.162688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s2t92" event={"ID":"4a15364d-dc05-4a50-a1c4-473f7393eff7","Type":"ContainerDied","Data":"51dfee9453dc993615898ea64d0e65dd3dd38078e1a79604cce71fe21db745b6"} Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.178151 4769 generic.go:334] "Generic (PLEG): container finished" podID="946c079a-b406-4924-a4de-cce549b51be1" containerID="d7e08c5cb9f88f9d70830a71eb265d5c8c3cc00c5d73426e2ca9f97e58cbf25e" exitCode=0 Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.178333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" event={"ID":"946c079a-b406-4924-a4de-cce549b51be1","Type":"ContainerDied","Data":"d7e08c5cb9f88f9d70830a71eb265d5c8c3cc00c5d73426e2ca9f97e58cbf25e"} Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.182076 4769 generic.go:334] "Generic (PLEG): container finished" podID="dcebadd9-e29b-494a-9578-1fc3312e728c" containerID="94b53d32059958589c61ac3291152dbf4b5f4564bf4f215bb296e3208e8a3fcf" exitCode=0 Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.182255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" event={"ID":"dcebadd9-e29b-494a-9578-1fc3312e728c","Type":"ContainerDied","Data":"94b53d32059958589c61ac3291152dbf4b5f4564bf4f215bb296e3208e8a3fcf"} Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.187247 4769 generic.go:334] "Generic (PLEG): container finished" podID="170d353a-c12f-4e7a-b173-37444306e05e" containerID="c0a9278f41ba47ecce94c3a744ee61b82f624c0e5841c37351d0b8b056b76e50" exitCode=0 Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.187412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" event={"ID":"170d353a-c12f-4e7a-b173-37444306e05e","Type":"ContainerDied","Data":"c0a9278f41ba47ecce94c3a744ee61b82f624c0e5841c37351d0b8b056b76e50"} Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.195070 4769 generic.go:334] "Generic (PLEG): container finished" podID="f77e1839-a878-4f8b-95b8-50f268ba8902" containerID="b0908c9c3af2001c2d00836d863694814344699e5b0d6ad7bd11ef283fb433ea" exitCode=0 Nov 21 12:49:08 crc kubenswrapper[4769]: I1121 12:49:08.197058 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-g8sst" event={"ID":"f77e1839-a878-4f8b-95b8-50f268ba8902","Type":"ContainerDied","Data":"b0908c9c3af2001c2d00836d863694814344699e5b0d6ad7bd11ef283fb433ea"} Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.678025 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.805078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcebadd9-e29b-494a-9578-1fc3312e728c-operator-scripts\") pod \"dcebadd9-e29b-494a-9578-1fc3312e728c\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.805359 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zmmj\" (UniqueName: \"kubernetes.io/projected/dcebadd9-e29b-494a-9578-1fc3312e728c-kube-api-access-7zmmj\") pod \"dcebadd9-e29b-494a-9578-1fc3312e728c\" (UID: \"dcebadd9-e29b-494a-9578-1fc3312e728c\") " Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.806296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcebadd9-e29b-494a-9578-1fc3312e728c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dcebadd9-e29b-494a-9578-1fc3312e728c" (UID: "dcebadd9-e29b-494a-9578-1fc3312e728c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.811181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcebadd9-e29b-494a-9578-1fc3312e728c-kube-api-access-7zmmj" (OuterVolumeSpecName: "kube-api-access-7zmmj") pod "dcebadd9-e29b-494a-9578-1fc3312e728c" (UID: "dcebadd9-e29b-494a-9578-1fc3312e728c"). InnerVolumeSpecName "kube-api-access-7zmmj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.877662 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.886655 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.893141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.900375 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.906987 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7zmmj\" (UniqueName: \"kubernetes.io/projected/dcebadd9-e29b-494a-9578-1fc3312e728c-kube-api-access-7zmmj\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.907022 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dcebadd9-e29b-494a-9578-1fc3312e728c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:09 crc kubenswrapper[4769]: I1121 12:49:09.911776 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk2ss\" (UniqueName: \"kubernetes.io/projected/f77e1839-a878-4f8b-95b8-50f268ba8902-kube-api-access-dk2ss\") pod \"f77e1839-a878-4f8b-95b8-50f268ba8902\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzspw\" (UniqueName: \"kubernetes.io/projected/4a15364d-dc05-4a50-a1c4-473f7393eff7-kube-api-access-jzspw\") pod \"4a15364d-dc05-4a50-a1c4-473f7393eff7\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c98251c5-0166-4aae-8fb0-9bdc52b45c26-operator-scripts\") pod \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctw8r\" (UniqueName: \"kubernetes.io/projected/946c079a-b406-4924-a4de-cce549b51be1-kube-api-access-ctw8r\") pod \"946c079a-b406-4924-a4de-cce549b51be1\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nppt6\" (UniqueName: \"kubernetes.io/projected/c98251c5-0166-4aae-8fb0-9bdc52b45c26-kube-api-access-nppt6\") pod \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\" (UID: \"c98251c5-0166-4aae-8fb0-9bdc52b45c26\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a15364d-dc05-4a50-a1c4-473f7393eff7-operator-scripts\") pod \"4a15364d-dc05-4a50-a1c4-473f7393eff7\" (UID: \"4a15364d-dc05-4a50-a1c4-473f7393eff7\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px7dt\" (UniqueName: \"kubernetes.io/projected/170d353a-c12f-4e7a-b173-37444306e05e-kube-api-access-px7dt\") pod \"170d353a-c12f-4e7a-b173-37444306e05e\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f77e1839-a878-4f8b-95b8-50f268ba8902-operator-scripts\") pod \"f77e1839-a878-4f8b-95b8-50f268ba8902\" (UID: \"f77e1839-a878-4f8b-95b8-50f268ba8902\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.008993 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/170d353a-c12f-4e7a-b173-37444306e05e-operator-scripts\") pod \"170d353a-c12f-4e7a-b173-37444306e05e\" (UID: \"170d353a-c12f-4e7a-b173-37444306e05e\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.009010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/946c079a-b406-4924-a4de-cce549b51be1-operator-scripts\") pod \"946c079a-b406-4924-a4de-cce549b51be1\" (UID: \"946c079a-b406-4924-a4de-cce549b51be1\") " Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.010241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98251c5-0166-4aae-8fb0-9bdc52b45c26-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c98251c5-0166-4aae-8fb0-9bdc52b45c26" (UID: "c98251c5-0166-4aae-8fb0-9bdc52b45c26"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.010251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a15364d-dc05-4a50-a1c4-473f7393eff7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4a15364d-dc05-4a50-a1c4-473f7393eff7" (UID: "4a15364d-dc05-4a50-a1c4-473f7393eff7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.010293 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946c079a-b406-4924-a4de-cce549b51be1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "946c079a-b406-4924-a4de-cce549b51be1" (UID: "946c079a-b406-4924-a4de-cce549b51be1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.010309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77e1839-a878-4f8b-95b8-50f268ba8902-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f77e1839-a878-4f8b-95b8-50f268ba8902" (UID: "f77e1839-a878-4f8b-95b8-50f268ba8902"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.010353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/170d353a-c12f-4e7a-b173-37444306e05e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "170d353a-c12f-4e7a-b173-37444306e05e" (UID: "170d353a-c12f-4e7a-b173-37444306e05e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.012968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946c079a-b406-4924-a4de-cce549b51be1-kube-api-access-ctw8r" (OuterVolumeSpecName: "kube-api-access-ctw8r") pod "946c079a-b406-4924-a4de-cce549b51be1" (UID: "946c079a-b406-4924-a4de-cce549b51be1"). InnerVolumeSpecName "kube-api-access-ctw8r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.013003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98251c5-0166-4aae-8fb0-9bdc52b45c26-kube-api-access-nppt6" (OuterVolumeSpecName: "kube-api-access-nppt6") pod "c98251c5-0166-4aae-8fb0-9bdc52b45c26" (UID: "c98251c5-0166-4aae-8fb0-9bdc52b45c26"). InnerVolumeSpecName "kube-api-access-nppt6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.013411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170d353a-c12f-4e7a-b173-37444306e05e-kube-api-access-px7dt" (OuterVolumeSpecName: "kube-api-access-px7dt") pod "170d353a-c12f-4e7a-b173-37444306e05e" (UID: "170d353a-c12f-4e7a-b173-37444306e05e"). InnerVolumeSpecName "kube-api-access-px7dt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.014636 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a15364d-dc05-4a50-a1c4-473f7393eff7-kube-api-access-jzspw" (OuterVolumeSpecName: "kube-api-access-jzspw") pod "4a15364d-dc05-4a50-a1c4-473f7393eff7" (UID: "4a15364d-dc05-4a50-a1c4-473f7393eff7"). InnerVolumeSpecName "kube-api-access-jzspw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.018319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77e1839-a878-4f8b-95b8-50f268ba8902-kube-api-access-dk2ss" (OuterVolumeSpecName: "kube-api-access-dk2ss") pod "f77e1839-a878-4f8b-95b8-50f268ba8902" (UID: "f77e1839-a878-4f8b-95b8-50f268ba8902"). InnerVolumeSpecName "kube-api-access-dk2ss". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111574 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c98251c5-0166-4aae-8fb0-9bdc52b45c26-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111634 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ctw8r\" (UniqueName: \"kubernetes.io/projected/946c079a-b406-4924-a4de-cce549b51be1-kube-api-access-ctw8r\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111657 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nppt6\" (UniqueName: \"kubernetes.io/projected/c98251c5-0166-4aae-8fb0-9bdc52b45c26-kube-api-access-nppt6\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111675 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a15364d-dc05-4a50-a1c4-473f7393eff7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111694 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-px7dt\" (UniqueName: \"kubernetes.io/projected/170d353a-c12f-4e7a-b173-37444306e05e-kube-api-access-px7dt\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111711 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f77e1839-a878-4f8b-95b8-50f268ba8902-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111731 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/170d353a-c12f-4e7a-b173-37444306e05e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111748 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/946c079a-b406-4924-a4de-cce549b51be1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111766 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dk2ss\" (UniqueName: \"kubernetes.io/projected/f77e1839-a878-4f8b-95b8-50f268ba8902-kube-api-access-dk2ss\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.111784 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jzspw\" (UniqueName: \"kubernetes.io/projected/4a15364d-dc05-4a50-a1c4-473f7393eff7-kube-api-access-jzspw\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.232284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-s2t92" event={"ID":"4a15364d-dc05-4a50-a1c4-473f7393eff7","Type":"ContainerDied","Data":"9d7a9945171f1c7d1938ec1acf3a35a806ce665e465ca04f81d14305482a22d9"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.232640 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d7a9945171f1c7d1938ec1acf3a35a806ce665e465ca04f81d14305482a22d9" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.232501 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-s2t92" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.235493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" event={"ID":"946c079a-b406-4924-a4de-cce549b51be1","Type":"ContainerDied","Data":"5d501847126c97593616a2ae1bce0a824df430fadf6fd7497f09aa75bb3e0e97"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.235601 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d501847126c97593616a2ae1bce0a824df430fadf6fd7497f09aa75bb3e0e97" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.235657 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-1f1d-account-create-grcs2" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.239952 4769 generic.go:334] "Generic (PLEG): container finished" podID="021c214f-187f-4bec-9938-f41139eba221" containerID="6fa27cb583cbd4188d2f2a620e64742637d5b8d379b12edd0bdb077e5eb9ffca" exitCode=0 Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.240066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" event={"ID":"021c214f-187f-4bec-9938-f41139eba221","Type":"ContainerDied","Data":"6fa27cb583cbd4188d2f2a620e64742637d5b8d379b12edd0bdb077e5eb9ffca"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.245409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" event={"ID":"dcebadd9-e29b-494a-9578-1fc3312e728c","Type":"ContainerDied","Data":"bceca0688b0c9eddfc60677fea70912d0a056fd41e2af8995624964cb83d85b5"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.245488 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bceca0688b0c9eddfc60677fea70912d0a056fd41e2af8995624964cb83d85b5" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.245594 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-033b-account-create-482ff" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.249910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" event={"ID":"170d353a-c12f-4e7a-b173-37444306e05e","Type":"ContainerDied","Data":"544bd8156ee1a0dd1e1cf34c4e9401d7b497f205a563b3b6dc8687497889cd81"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.249966 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="544bd8156ee1a0dd1e1cf34c4e9401d7b497f205a563b3b6dc8687497889cd81" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.250048 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-5xjxs" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.253525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-g8sst" event={"ID":"f77e1839-a878-4f8b-95b8-50f268ba8902","Type":"ContainerDied","Data":"d9fb0fcf4f053e4a103c9c88d12e28ad30d82652af8a2e7633163bc938af8679"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.253617 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9fb0fcf4f053e4a103c9c88d12e28ad30d82652af8a2e7633163bc938af8679" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.255155 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-g8sst" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.256887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" event={"ID":"c98251c5-0166-4aae-8fb0-9bdc52b45c26","Type":"ContainerDied","Data":"a0a99b8ab6456c8f92bc52ec142b087888565699f4f708764fd1b3b38da8b705"} Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.257003 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0a99b8ab6456c8f92bc52ec142b087888565699f4f708764fd1b3b38da8b705" Nov 21 12:49:10 crc kubenswrapper[4769]: I1121 12:49:10.257134 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-px7d7" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.325142 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.325739 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.726372 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.851746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-config-data\") pod \"021c214f-187f-4bec-9938-f41139eba221\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.851824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-combined-ca-bundle\") pod \"021c214f-187f-4bec-9938-f41139eba221\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.851969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk8nh\" (UniqueName: \"kubernetes.io/projected/021c214f-187f-4bec-9938-f41139eba221-kube-api-access-vk8nh\") pod \"021c214f-187f-4bec-9938-f41139eba221\" (UID: \"021c214f-187f-4bec-9938-f41139eba221\") " Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.861551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021c214f-187f-4bec-9938-f41139eba221-kube-api-access-vk8nh" (OuterVolumeSpecName: "kube-api-access-vk8nh") pod "021c214f-187f-4bec-9938-f41139eba221" (UID: "021c214f-187f-4bec-9938-f41139eba221"). InnerVolumeSpecName "kube-api-access-vk8nh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.899314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "021c214f-187f-4bec-9938-f41139eba221" (UID: "021c214f-187f-4bec-9938-f41139eba221"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.941676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-config-data" (OuterVolumeSpecName: "config-data") pod "021c214f-187f-4bec-9938-f41139eba221" (UID: "021c214f-187f-4bec-9938-f41139eba221"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.954355 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.954469 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021c214f-187f-4bec-9938-f41139eba221-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:11 crc kubenswrapper[4769]: I1121 12:49:11.954489 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vk8nh\" (UniqueName: \"kubernetes.io/projected/021c214f-187f-4bec-9938-f41139eba221-kube-api-access-vk8nh\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.322061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" event={"ID":"021c214f-187f-4bec-9938-f41139eba221","Type":"ContainerDied","Data":"13ffce6325a0113c9e7fd93ba8f7afcf301033e13edad2c5e4028443f2b69aba"} Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.322125 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13ffce6325a0113c9e7fd93ba8f7afcf301033e13edad2c5e4028443f2b69aba" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.322282 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-djs2n" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485173 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tltbb"] Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485594 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="946c079a-b406-4924-a4de-cce549b51be1" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485609 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="946c079a-b406-4924-a4de-cce549b51be1" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485618 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="021c214f-187f-4bec-9938-f41139eba221" containerName="keystone-db-sync" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485625 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="021c214f-187f-4bec-9938-f41139eba221" containerName="keystone-db-sync" Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485641 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4a15364d-dc05-4a50-a1c4-473f7393eff7" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485649 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a15364d-dc05-4a50-a1c4-473f7393eff7" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485663 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dcebadd9-e29b-494a-9578-1fc3312e728c" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485670 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcebadd9-e29b-494a-9578-1fc3312e728c" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485685 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f77e1839-a878-4f8b-95b8-50f268ba8902" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485693 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77e1839-a878-4f8b-95b8-50f268ba8902" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485710 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c98251c5-0166-4aae-8fb0-9bdc52b45c26" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485718 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98251c5-0166-4aae-8fb0-9bdc52b45c26" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: E1121 12:49:12.485732 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="170d353a-c12f-4e7a-b173-37444306e05e" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485739 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d353a-c12f-4e7a-b173-37444306e05e" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485951 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dcebadd9-e29b-494a-9578-1fc3312e728c" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485972 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="021c214f-187f-4bec-9938-f41139eba221" containerName="keystone-db-sync" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.485986 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f77e1839-a878-4f8b-95b8-50f268ba8902" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.486002 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c98251c5-0166-4aae-8fb0-9bdc52b45c26" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.486012 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4a15364d-dc05-4a50-a1c4-473f7393eff7" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.486028 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="946c079a-b406-4924-a4de-cce549b51be1" containerName="mariadb-account-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.486040 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="170d353a-c12f-4e7a-b173-37444306e05e" containerName="mariadb-database-create" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.486681 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.490370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.490802 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.491058 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.491481 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.494406 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-mbqmh" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.526784 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tltbb"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.571581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-scripts\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.571670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-config-data\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.571697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-combined-ca-bundle\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.571724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmgfd\" (UniqueName: \"kubernetes.io/projected/23eb0047-e318-410e-a007-dfecedc93ec5-kube-api-access-gmgfd\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.571744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-fernet-keys\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.571762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-credential-keys\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.673511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-fernet-keys\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.673558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-credential-keys\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.674060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-scripts\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.674119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-config-data\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.674147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-combined-ca-bundle\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.674171 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmgfd\" (UniqueName: \"kubernetes.io/projected/23eb0047-e318-410e-a007-dfecedc93ec5-kube-api-access-gmgfd\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.679466 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-config-data\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.682118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-credential-keys\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.684491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-scripts\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.684965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-fernet-keys\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.686268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-combined-ca-bundle\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.700051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmgfd\" (UniqueName: \"kubernetes.io/projected/23eb0047-e318-410e-a007-dfecedc93ec5-kube-api-access-gmgfd\") pod \"keystone-bootstrap-tltbb\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.704027 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.706395 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.711540 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.712278 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.721462 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.765903 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-sg9sp"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.771670 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.777323 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.777456 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.777719 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-tqv9g" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txg7\" (UniqueName: \"kubernetes.io/projected/437d65f9-a3a0-4267-954e-109c0e077594-kube-api-access-7txg7\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-log-httpd\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-run-httpd\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-config-data\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.778459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-scripts\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.797680 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-sg9sp"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.815010 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bpxnn"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.816164 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.821084 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.821909 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-2qqr6" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.822063 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.822413 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.839794 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bpxnn"] Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.881991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-scripts\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e8724-a026-4cb0-9c45-4059b9c42e91-logs\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-combined-ca-bundle\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882212 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f2g9\" (UniqueName: \"kubernetes.io/projected/4d2e8724-a026-4cb0-9c45-4059b9c42e91-kube-api-access-9f2g9\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-config\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvk8n\" (UniqueName: \"kubernetes.io/projected/5230efa8-6d27-4741-b21b-4b7abb304abf-kube-api-access-wvk8n\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7txg7\" (UniqueName: \"kubernetes.io/projected/437d65f9-a3a0-4267-954e-109c0e077594-kube-api-access-7txg7\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-config-data\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-log-httpd\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-combined-ca-bundle\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-run-httpd\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-config-data\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.882961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-scripts\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.885485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-log-httpd\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.885691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-run-httpd\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.889259 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.892424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-config-data\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.892697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-scripts\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.903133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txg7\" (UniqueName: \"kubernetes.io/projected/437d65f9-a3a0-4267-954e-109c0e077594-kube-api-access-7txg7\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.950602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-config\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvk8n\" (UniqueName: \"kubernetes.io/projected/5230efa8-6d27-4741-b21b-4b7abb304abf-kube-api-access-wvk8n\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-config-data\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985583 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-combined-ca-bundle\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-scripts\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e8724-a026-4cb0-9c45-4059b9c42e91-logs\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-combined-ca-bundle\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.985718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9f2g9\" (UniqueName: \"kubernetes.io/projected/4d2e8724-a026-4cb0-9c45-4059b9c42e91-kube-api-access-9f2g9\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.986393 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e8724-a026-4cb0-9c45-4059b9c42e91-logs\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.997893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-scripts\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.998508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-config\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:12 crc kubenswrapper[4769]: I1121 12:49:12.999070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-config-data\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.000817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-combined-ca-bundle\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.001357 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-combined-ca-bundle\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.008741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f2g9\" (UniqueName: \"kubernetes.io/projected/4d2e8724-a026-4cb0-9c45-4059b9c42e91-kube-api-access-9f2g9\") pod \"placement-db-sync-bpxnn\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.023620 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvk8n\" (UniqueName: \"kubernetes.io/projected/5230efa8-6d27-4741-b21b-4b7abb304abf-kube-api-access-wvk8n\") pod \"neutron-db-sync-sg9sp\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.066586 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.097744 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.139486 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.340827 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tltbb"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.551780 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:13 crc kubenswrapper[4769]: W1121 12:49:13.555534 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod437d65f9_a3a0_4267_954e_109c0e077594.slice/crio-3f1b83d002ed9fbbe2efbf00292c439d7d54ee8000a3869dd70fd9765a7e05ed WatchSource:0}: Error finding container 3f1b83d002ed9fbbe2efbf00292c439d7d54ee8000a3869dd70fd9765a7e05ed: Status 404 returned error can't find the container with id 3f1b83d002ed9fbbe2efbf00292c439d7d54ee8000a3869dd70fd9765a7e05ed Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.645870 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.647769 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.651364 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.651782 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.651913 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-78dvp" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.654841 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.666900 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.669722 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.675740 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.675919 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.681469 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.692248 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.710407 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-sg9sp"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.719647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.719894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-kube-api-access-9xxzv\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.719986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720051 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-logs\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-scripts\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720262 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-scripts\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-config-data\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-config-data\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-logs\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.720784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp9tz\" (UniqueName: \"kubernetes.io/projected/a289f874-b8db-44b9-a125-28443a395df8-kube-api-access-lp9tz\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.733654 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bpxnn"] Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.822810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.822900 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-config-data\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-config-data\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-logs\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lp9tz\" (UniqueName: \"kubernetes.io/projected/a289f874-b8db-44b9-a125-28443a395df8-kube-api-access-lp9tz\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-kube-api-access-9xxzv\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824210 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-logs\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.823499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-logs\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824276 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-scripts\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-scripts\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.824768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-logs\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.825319 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.825354 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.826883 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.827876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-config-data\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.830322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-config-data\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.833344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-scripts\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.833985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.835152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-scripts\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.837417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.839948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.841366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp9tz\" (UniqueName: \"kubernetes.io/projected/a289f874-b8db-44b9-a125-28443a395df8-kube-api-access-lp9tz\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.842702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.845788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-kube-api-access-9xxzv\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.863663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.870230 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.903204 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:13 crc kubenswrapper[4769]: I1121 12:49:13.966840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.331546 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.367048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerStarted","Data":"3f1b83d002ed9fbbe2efbf00292c439d7d54ee8000a3869dd70fd9765a7e05ed"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.369477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" event={"ID":"5230efa8-6d27-4741-b21b-4b7abb304abf","Type":"ContainerStarted","Data":"ddfcf65be0f1acda17774c4f889ecb6e3e0fabe803b8caab5a54ff6245f67805"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.369513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" event={"ID":"5230efa8-6d27-4741-b21b-4b7abb304abf","Type":"ContainerStarted","Data":"d8c794c87702220d3fb0a2c3df3969d24dce632a0f7986cbacba0f5211e17688"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.377172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" event={"ID":"4d2e8724-a026-4cb0-9c45-4059b9c42e91","Type":"ContainerStarted","Data":"ac5f4a5d6424277be7cc254709ccdb759c0d43a21062e8e81885e0fb08cb7196"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.377340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" event={"ID":"4d2e8724-a026-4cb0-9c45-4059b9c42e91","Type":"ContainerStarted","Data":"365ca60d03605b2008962597166b1d1867d7fd6911ca93afc8dfe6b35bede2d2"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.392328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" event={"ID":"23eb0047-e318-410e-a007-dfecedc93ec5","Type":"ContainerStarted","Data":"2d8b485001e264ddab1b92ee57a4f20e66d019d3bb9558bb5b4a5dbc988a0127"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.392384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" event={"ID":"23eb0047-e318-410e-a007-dfecedc93ec5","Type":"ContainerStarted","Data":"d1d8da301216a69f195ad623d3532cf38a9ada8dd749c8141f2d14bc839a2766"} Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.400447 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.418718 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" podStartSLOduration=2.418700228 podStartE2EDuration="2.418700228s" podCreationTimestamp="2025-11-21 12:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:14.394022056 +0000 UTC m=+3513.094683874" watchObservedRunningTime="2025-11-21 12:49:14.418700228 +0000 UTC m=+3513.119362046" Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.438276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.438816 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" podStartSLOduration=2.438806385 podStartE2EDuration="2.438806385s" podCreationTimestamp="2025-11-21 12:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:14.412985052 +0000 UTC m=+3513.113646870" watchObservedRunningTime="2025-11-21 12:49:14.438806385 +0000 UTC m=+3513.139468203" Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.492942 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" podStartSLOduration=2.492921527 podStartE2EDuration="2.492921527s" podCreationTimestamp="2025-11-21 12:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:14.427738804 +0000 UTC m=+3513.128400612" watchObservedRunningTime="2025-11-21 12:49:14.492921527 +0000 UTC m=+3513.193583345" Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.507348 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:14 crc kubenswrapper[4769]: I1121 12:49:14.529664 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.410891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"250ecab7-91a2-43f4-a2f4-3c1dae36ae85","Type":"ContainerStarted","Data":"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf"} Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.411642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"250ecab7-91a2-43f4-a2f4-3c1dae36ae85","Type":"ContainerStarted","Data":"79697950d4208390518c4bde3a1588d08b076bc2851229460af91d4a6c9285c2"} Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.429519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerStarted","Data":"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d"} Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.429590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerStarted","Data":"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436"} Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.434241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a289f874-b8db-44b9-a125-28443a395df8","Type":"ContainerStarted","Data":"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e"} Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.434297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a289f874-b8db-44b9-a125-28443a395df8","Type":"ContainerStarted","Data":"58bf2058203dab3ce32ee1b85a1f426a23d9d3355eacd14e5cbca293b0cefc08"} Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.825891 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvrls"] Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.827886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.829851 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-4gsg9" Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.830320 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:49:15 crc kubenswrapper[4769]: I1121 12:49:15.835262 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvrls"] Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.046218 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-combined-ca-bundle\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.046376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-db-sync-config-data\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.046525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78p4\" (UniqueName: \"kubernetes.io/projected/0afb11a7-3376-4f3c-abea-50c5dd099a2a-kube-api-access-d78p4\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.150870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d78p4\" (UniqueName: \"kubernetes.io/projected/0afb11a7-3376-4f3c-abea-50c5dd099a2a-kube-api-access-d78p4\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.151378 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-combined-ca-bundle\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.151540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-db-sync-config-data\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.157069 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-xnpwk"] Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.157398 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-combined-ca-bundle\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.158116 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.158315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-db-sync-config-data\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.162455 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.162733 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-8gf4m" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.163514 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.169478 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-xnpwk"] Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.174569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78p4\" (UniqueName: \"kubernetes.io/projected/0afb11a7-3376-4f3c-abea-50c5dd099a2a-kube-api-access-d78p4\") pod \"barbican-db-sync-fvrls\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.179658 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.253420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25d8\" (UniqueName: \"kubernetes.io/projected/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-kube-api-access-b25d8\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.253477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-config-data\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.253502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-scripts\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.253575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-combined-ca-bundle\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.253593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-db-sync-config-data\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.253618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-etc-machine-id\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.361119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-config-data\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.361485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-scripts\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.361585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-combined-ca-bundle\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.361605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-db-sync-config-data\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.361633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-etc-machine-id\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.361715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b25d8\" (UniqueName: \"kubernetes.io/projected/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-kube-api-access-b25d8\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.362043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-etc-machine-id\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.372926 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-scripts\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.374786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-db-sync-config-data\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.387133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-combined-ca-bundle\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.392813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25d8\" (UniqueName: \"kubernetes.io/projected/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-kube-api-access-b25d8\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.416522 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-config-data\") pod \"cinder-db-sync-xnpwk\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.454814 4769 generic.go:334] "Generic (PLEG): container finished" podID="4d2e8724-a026-4cb0-9c45-4059b9c42e91" containerID="ac5f4a5d6424277be7cc254709ccdb759c0d43a21062e8e81885e0fb08cb7196" exitCode=0 Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.454891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" event={"ID":"4d2e8724-a026-4cb0-9c45-4059b9c42e91","Type":"ContainerDied","Data":"ac5f4a5d6424277be7cc254709ccdb759c0d43a21062e8e81885e0fb08cb7196"} Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.457127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"250ecab7-91a2-43f4-a2f4-3c1dae36ae85","Type":"ContainerStarted","Data":"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6"} Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.457338 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-log" containerID="cri-o://8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf" gracePeriod=30 Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.457641 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-httpd" containerID="cri-o://b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6" gracePeriod=30 Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.466832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerStarted","Data":"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd"} Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.469544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a289f874-b8db-44b9-a125-28443a395df8","Type":"ContainerStarted","Data":"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15"} Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.469683 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-log" containerID="cri-o://c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e" gracePeriod=30 Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.469731 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-httpd" containerID="cri-o://c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15" gracePeriod=30 Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.512372 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.512351423 podStartE2EDuration="4.512351423s" podCreationTimestamp="2025-11-21 12:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:16.511685815 +0000 UTC m=+3515.212347633" watchObservedRunningTime="2025-11-21 12:49:16.512351423 +0000 UTC m=+3515.213013241" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.525077 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.534829 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.534813434 podStartE2EDuration="4.534813434s" podCreationTimestamp="2025-11-21 12:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:16.531893465 +0000 UTC m=+3515.232555283" watchObservedRunningTime="2025-11-21 12:49:16.534813434 +0000 UTC m=+3515.235475252" Nov 21 12:49:16 crc kubenswrapper[4769]: I1121 12:49:16.774759 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvrls"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.060144 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-xnpwk"] Nov 21 12:49:17 crc kubenswrapper[4769]: W1121 12:49:17.096921 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb43f65e_1c25_4b63_b1c6_6b4e196376a9.slice/crio-f1f6926e7b5305c3f28d1f39178e66827e80f811b0526d67fa9895cca1a38109 WatchSource:0}: Error finding container f1f6926e7b5305c3f28d1f39178e66827e80f811b0526d67fa9895cca1a38109: Status 404 returned error can't find the container with id f1f6926e7b5305c3f28d1f39178e66827e80f811b0526d67fa9895cca1a38109 Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.143833 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.147347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.210808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-combined-ca-bundle\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.210910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-logs\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.210984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-scripts\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211089 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-scripts\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-kube-api-access-9xxzv\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211229 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-combined-ca-bundle\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211250 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp9tz\" (UniqueName: \"kubernetes.io/projected/a289f874-b8db-44b9-a125-28443a395df8-kube-api-access-lp9tz\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-config-data\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-internal-tls-certs\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-logs\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-httpd-run\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-public-tls-certs\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-httpd-run\") pod \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\" (UID: \"250ecab7-91a2-43f4-a2f4-3c1dae36ae85\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.211576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-config-data\") pod \"a289f874-b8db-44b9-a125-28443a395df8\" (UID: \"a289f874-b8db-44b9-a125-28443a395df8\") " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.215306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-logs" (OuterVolumeSpecName: "logs") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.222726 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.223007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.223125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-logs" (OuterVolumeSpecName: "logs") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.232380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-kube-api-access-9xxzv" (OuterVolumeSpecName: "kube-api-access-9xxzv") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "kube-api-access-9xxzv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.235984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.237366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-scripts" (OuterVolumeSpecName: "scripts") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.241839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a289f874-b8db-44b9-a125-28443a395df8-kube-api-access-lp9tz" (OuterVolumeSpecName: "kube-api-access-lp9tz") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "kube-api-access-lp9tz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.245533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-scripts" (OuterVolumeSpecName: "scripts") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.246035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.256098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.272570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-config-data" (OuterVolumeSpecName: "config-data") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.281477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.284817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-config-data" (OuterVolumeSpecName: "config-data") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.299318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a289f874-b8db-44b9-a125-28443a395df8" (UID: "a289f874-b8db-44b9-a125-28443a395df8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.315596 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.315843 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a289f874-b8db-44b9-a125-28443a395df8-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.315905 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.315968 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.316055 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.316685 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.316785 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.316865 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.316928 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.316984 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9xxzv\" (UniqueName: \"kubernetes.io/projected/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-kube-api-access-9xxzv\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.317039 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.317098 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lp9tz\" (UniqueName: \"kubernetes.io/projected/a289f874-b8db-44b9-a125-28443a395df8-kube-api-access-lp9tz\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.317152 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.317288 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.317351 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a289f874-b8db-44b9-a125-28443a395df8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.326090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "250ecab7-91a2-43f4-a2f4-3c1dae36ae85" (UID: "250ecab7-91a2-43f4-a2f4-3c1dae36ae85"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.337338 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.345341 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.419520 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.419870 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/250ecab7-91a2-43f4-a2f4-3c1dae36ae85-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.419881 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.485975 4769 generic.go:334] "Generic (PLEG): container finished" podID="23eb0047-e318-410e-a007-dfecedc93ec5" containerID="2d8b485001e264ddab1b92ee57a4f20e66d019d3bb9558bb5b4a5dbc988a0127" exitCode=0 Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.486054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" event={"ID":"23eb0047-e318-410e-a007-dfecedc93ec5","Type":"ContainerDied","Data":"2d8b485001e264ddab1b92ee57a4f20e66d019d3bb9558bb5b4a5dbc988a0127"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.487578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" event={"ID":"fb43f65e-1c25-4b63-b1c6-6b4e196376a9","Type":"ContainerStarted","Data":"f1f6926e7b5305c3f28d1f39178e66827e80f811b0526d67fa9895cca1a38109"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.492923 4769 generic.go:334] "Generic (PLEG): container finished" podID="a289f874-b8db-44b9-a125-28443a395df8" containerID="c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15" exitCode=0 Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.492958 4769 generic.go:334] "Generic (PLEG): container finished" podID="a289f874-b8db-44b9-a125-28443a395df8" containerID="c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e" exitCode=143 Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.493029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a289f874-b8db-44b9-a125-28443a395df8","Type":"ContainerDied","Data":"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.493087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a289f874-b8db-44b9-a125-28443a395df8","Type":"ContainerDied","Data":"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.493098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a289f874-b8db-44b9-a125-28443a395df8","Type":"ContainerDied","Data":"58bf2058203dab3ce32ee1b85a1f426a23d9d3355eacd14e5cbca293b0cefc08"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.493118 4769 scope.go:117] "RemoveContainer" containerID="c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.493376 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.514901 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" event={"ID":"0afb11a7-3376-4f3c-abea-50c5dd099a2a","Type":"ContainerStarted","Data":"dcf75b7ed39b2a1f6fe8e8444f434d5291168d1debb86cabd9bffb3d5db705a1"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.514969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" event={"ID":"0afb11a7-3376-4f3c-abea-50c5dd099a2a","Type":"ContainerStarted","Data":"9b9dbe55988c6f71ea6ba90d52d1b098bcad53098ed4cf9cb039998d58785d28"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.529155 4769 generic.go:334] "Generic (PLEG): container finished" podID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerID="b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6" exitCode=0 Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.529183 4769 generic.go:334] "Generic (PLEG): container finished" podID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerID="8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf" exitCode=143 Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.529424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.530997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"250ecab7-91a2-43f4-a2f4-3c1dae36ae85","Type":"ContainerDied","Data":"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.531045 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"250ecab7-91a2-43f4-a2f4-3c1dae36ae85","Type":"ContainerDied","Data":"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.531062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"250ecab7-91a2-43f4-a2f4-3c1dae36ae85","Type":"ContainerDied","Data":"79697950d4208390518c4bde3a1588d08b076bc2851229460af91d4a6c9285c2"} Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.554988 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.580355 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" podStartSLOduration=2.580329196 podStartE2EDuration="2.580329196s" podCreationTimestamp="2025-11-21 12:49:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:17.546129295 +0000 UTC m=+3516.246791113" watchObservedRunningTime="2025-11-21 12:49:17.580329196 +0000 UTC m=+3516.280991014" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.587771 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.591547 4769 scope.go:117] "RemoveContainer" containerID="c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.613933 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.614722 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-httpd" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.614740 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-httpd" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.614762 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-httpd" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.614769 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-httpd" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.614791 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-log" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.614798 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-log" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.614814 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-log" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.614820 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-log" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.614990 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-httpd" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.615011 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-log" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.615020 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a289f874-b8db-44b9-a125-28443a395df8" containerName="glance-httpd" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.615032 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" containerName="glance-log" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.616767 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.620331 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.622182 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-78dvp" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.622321 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.622486 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.636756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.654363 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.660615 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.668634 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.670245 4769 scope.go:117] "RemoveContainer" containerID="c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.672584 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.672680 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.675571 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.675702 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.675899 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15\": container with ID starting with c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15 not found: ID does not exist" containerID="c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.675932 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15"} err="failed to get container status \"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15\": rpc error: code = NotFound desc = could not find container \"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15\": container with ID starting with c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15 not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.675959 4769 scope.go:117] "RemoveContainer" containerID="c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.677449 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e\": container with ID starting with c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e not found: ID does not exist" containerID="c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.677497 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e"} err="failed to get container status \"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e\": rpc error: code = NotFound desc = could not find container \"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e\": container with ID starting with c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.677534 4769 scope.go:117] "RemoveContainer" containerID="c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.680491 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15"} err="failed to get container status \"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15\": rpc error: code = NotFound desc = could not find container \"c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15\": container with ID starting with c073dc93351de56aa4993a4aa90cec4c34ebcd65e4137a51abd5454e90ddef15 not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.680524 4769 scope.go:117] "RemoveContainer" containerID="c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.681768 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e"} err="failed to get container status \"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e\": rpc error: code = NotFound desc = could not find container \"c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e\": container with ID starting with c989f49002fc4acc7b269472e6b630ae308f27c58323ac5c145814869bdd190e not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.681795 4769 scope.go:117] "RemoveContainer" containerID="b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741230 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-logs\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbtc\" (UniqueName: \"kubernetes.io/projected/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-kube-api-access-scbtc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.741461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.785897 4769 scope.go:117] "RemoveContainer" containerID="8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.814326 4769 scope.go:117] "RemoveContainer" containerID="b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.814983 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6\": container with ID starting with b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6 not found: ID does not exist" containerID="b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.815009 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6"} err="failed to get container status \"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6\": rpc error: code = NotFound desc = could not find container \"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6\": container with ID starting with b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6 not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.815032 4769 scope.go:117] "RemoveContainer" containerID="8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf" Nov 21 12:49:17 crc kubenswrapper[4769]: E1121 12:49:17.815300 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf\": container with ID starting with 8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf not found: ID does not exist" containerID="8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.815319 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf"} err="failed to get container status \"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf\": rpc error: code = NotFound desc = could not find container \"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf\": container with ID starting with 8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.815332 4769 scope.go:117] "RemoveContainer" containerID="b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.815852 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6"} err="failed to get container status \"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6\": rpc error: code = NotFound desc = could not find container \"b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6\": container with ID starting with b80a53195ef419304fd488595cf566a8db59a48d3ebe994e87d4474c24aa83e6 not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.815871 4769 scope.go:117] "RemoveContainer" containerID="8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.816096 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf"} err="failed to get container status \"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf\": rpc error: code = NotFound desc = could not find container \"8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf\": container with ID starting with 8fede10b135ff5d41de8df0ac49290f1aee03d94ca83e364f395905f971d07cf not found: ID does not exist" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-scripts\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x27l6\" (UniqueName: \"kubernetes.io/projected/5ab314e3-8554-422d-bb15-f3d706c39ef3-kube-api-access-x27l6\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-logs\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-scbtc\" (UniqueName: \"kubernetes.io/projected/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-kube-api-access-scbtc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.842975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843049 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-logs\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-config-data\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.843264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.844499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-logs\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.844630 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.845864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.850868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.851035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.851651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.854907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.871889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbtc\" (UniqueName: \"kubernetes.io/projected/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-kube-api-access-scbtc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.883918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.942634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.944925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-scripts\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.944974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x27l6\" (UniqueName: \"kubernetes.io/projected/5ab314e3-8554-422d-bb15-f3d706c39ef3-kube-api-access-x27l6\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.944999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.945030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.945099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.945119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-logs\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.945144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-config-data\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.945506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.945902 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.948082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-logs\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.948922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.949768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-scripts\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.950404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.952866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-config-data\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.954800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.962755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x27l6\" (UniqueName: \"kubernetes.io/projected/5ab314e3-8554-422d-bb15-f3d706c39ef3-kube-api-access-x27l6\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:17 crc kubenswrapper[4769]: I1121 12:49:17.980656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.043382 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.078297 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.148022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e8724-a026-4cb0-9c45-4059b9c42e91-logs\") pod \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.148098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-scripts\") pod \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.148472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-config-data\") pod \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.148569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-combined-ca-bundle\") pod \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.148729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2e8724-a026-4cb0-9c45-4059b9c42e91-logs" (OuterVolumeSpecName: "logs") pod "4d2e8724-a026-4cb0-9c45-4059b9c42e91" (UID: "4d2e8724-a026-4cb0-9c45-4059b9c42e91"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.149121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f2g9\" (UniqueName: \"kubernetes.io/projected/4d2e8724-a026-4cb0-9c45-4059b9c42e91-kube-api-access-9f2g9\") pod \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\" (UID: \"4d2e8724-a026-4cb0-9c45-4059b9c42e91\") " Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.150231 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d2e8724-a026-4cb0-9c45-4059b9c42e91-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.158459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-scripts" (OuterVolumeSpecName: "scripts") pod "4d2e8724-a026-4cb0-9c45-4059b9c42e91" (UID: "4d2e8724-a026-4cb0-9c45-4059b9c42e91"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.162641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2e8724-a026-4cb0-9c45-4059b9c42e91-kube-api-access-9f2g9" (OuterVolumeSpecName: "kube-api-access-9f2g9") pod "4d2e8724-a026-4cb0-9c45-4059b9c42e91" (UID: "4d2e8724-a026-4cb0-9c45-4059b9c42e91"). InnerVolumeSpecName "kube-api-access-9f2g9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.175784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4d2e8724-a026-4cb0-9c45-4059b9c42e91" (UID: "4d2e8724-a026-4cb0-9c45-4059b9c42e91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.182965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-config-data" (OuterVolumeSpecName: "config-data") pod "4d2e8724-a026-4cb0-9c45-4059b9c42e91" (UID: "4d2e8724-a026-4cb0-9c45-4059b9c42e91"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.251442 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.251476 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.251489 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9f2g9\" (UniqueName: \"kubernetes.io/projected/4d2e8724-a026-4cb0-9c45-4059b9c42e91-kube-api-access-9f2g9\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.251499 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d2e8724-a026-4cb0-9c45-4059b9c42e91-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.424555 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.568035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7bd1e76c-ce79-4b90-8bbc-c2b676690d54","Type":"ContainerStarted","Data":"82d9502f27d61f75c6f8d31724a0010c09a2811599001558e3db0c654eb5c807"} Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.585464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" event={"ID":"4d2e8724-a026-4cb0-9c45-4059b9c42e91","Type":"ContainerDied","Data":"365ca60d03605b2008962597166b1d1867d7fd6911ca93afc8dfe6b35bede2d2"} Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.585537 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="365ca60d03605b2008962597166b1d1867d7fd6911ca93afc8dfe6b35bede2d2" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.585512 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bpxnn" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.592371 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7fc86bb567-hdclf"] Nov 21 12:49:18 crc kubenswrapper[4769]: E1121 12:49:18.593310 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4d2e8724-a026-4cb0-9c45-4059b9c42e91" containerName="placement-db-sync" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.593331 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2e8724-a026-4cb0-9c45-4059b9c42e91" containerName="placement-db-sync" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.593510 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4d2e8724-a026-4cb0-9c45-4059b9c42e91" containerName="placement-db-sync" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.594384 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.602983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" event={"ID":"fb43f65e-1c25-4b63-b1c6-6b4e196376a9","Type":"ContainerStarted","Data":"73d48851f9d09d3e64cdac01b0e9d74453b46a2867eca7ec9a8de9ae016bda20"} Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.609401 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-2qqr6" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.609422 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.609499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.609679 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.611821 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7fc86bb567-hdclf"] Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.616454 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.655160 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-central-agent" containerID="cri-o://e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" gracePeriod=30 Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.655382 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="proxy-httpd" containerID="cri-o://a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" gracePeriod=30 Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.655466 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="sg-core" containerID="cri-o://95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" gracePeriod=30 Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.655244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerStarted","Data":"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf"} Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.655573 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-notification-agent" containerID="cri-o://a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" gracePeriod=30 Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.655713 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-scripts\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665656 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-public-tls-certs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-internal-tls-certs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvqg\" (UniqueName: \"kubernetes.io/projected/20f55126-1aa7-4b10-9858-a35e8a073286-kube-api-access-7mvqg\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-combined-ca-bundle\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-config-data\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.665955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f55126-1aa7-4b10-9858-a35e8a073286-logs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.724952 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.736639 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" podStartSLOduration=2.73657351 podStartE2EDuration="2.73657351s" podCreationTimestamp="2025-11-21 12:49:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:18.665779274 +0000 UTC m=+3517.366441092" watchObservedRunningTime="2025-11-21 12:49:18.73657351 +0000 UTC m=+3517.437235328" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.738466 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.964014682 podStartE2EDuration="6.738458551s" podCreationTimestamp="2025-11-21 12:49:12 +0000 UTC" firstStartedPulling="2025-11-21 12:49:13.558305181 +0000 UTC m=+3512.258966999" lastFinishedPulling="2025-11-21 12:49:17.33274905 +0000 UTC m=+3516.033410868" observedRunningTime="2025-11-21 12:49:18.683869656 +0000 UTC m=+3517.384531494" watchObservedRunningTime="2025-11-21 12:49:18.738458551 +0000 UTC m=+3517.439120369" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-internal-tls-certs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvqg\" (UniqueName: \"kubernetes.io/projected/20f55126-1aa7-4b10-9858-a35e8a073286-kube-api-access-7mvqg\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-combined-ca-bundle\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-config-data\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f55126-1aa7-4b10-9858-a35e8a073286-logs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-scripts\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.768452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-public-tls-certs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.769657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f55126-1aa7-4b10-9858-a35e8a073286-logs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.786265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-scripts\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.786310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-public-tls-certs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.786686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-config-data\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.790749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-internal-tls-certs\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.790796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvqg\" (UniqueName: \"kubernetes.io/projected/20f55126-1aa7-4b10-9858-a35e8a073286-kube-api-access-7mvqg\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.791266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-combined-ca-bundle\") pod \"placement-7fc86bb567-hdclf\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:18 crc kubenswrapper[4769]: I1121 12:49:18.939939 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.028175 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.077435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmgfd\" (UniqueName: \"kubernetes.io/projected/23eb0047-e318-410e-a007-dfecedc93ec5-kube-api-access-gmgfd\") pod \"23eb0047-e318-410e-a007-dfecedc93ec5\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.077533 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-combined-ca-bundle\") pod \"23eb0047-e318-410e-a007-dfecedc93ec5\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.077664 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-config-data\") pod \"23eb0047-e318-410e-a007-dfecedc93ec5\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.077763 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-scripts\") pod \"23eb0047-e318-410e-a007-dfecedc93ec5\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.077787 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-credential-keys\") pod \"23eb0047-e318-410e-a007-dfecedc93ec5\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.077848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-fernet-keys\") pod \"23eb0047-e318-410e-a007-dfecedc93ec5\" (UID: \"23eb0047-e318-410e-a007-dfecedc93ec5\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.088028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "23eb0047-e318-410e-a007-dfecedc93ec5" (UID: "23eb0047-e318-410e-a007-dfecedc93ec5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.093506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-scripts" (OuterVolumeSpecName: "scripts") pod "23eb0047-e318-410e-a007-dfecedc93ec5" (UID: "23eb0047-e318-410e-a007-dfecedc93ec5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.099727 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23eb0047-e318-410e-a007-dfecedc93ec5-kube-api-access-gmgfd" (OuterVolumeSpecName: "kube-api-access-gmgfd") pod "23eb0047-e318-410e-a007-dfecedc93ec5" (UID: "23eb0047-e318-410e-a007-dfecedc93ec5"). InnerVolumeSpecName "kube-api-access-gmgfd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.105383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "23eb0047-e318-410e-a007-dfecedc93ec5" (UID: "23eb0047-e318-410e-a007-dfecedc93ec5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.124604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "23eb0047-e318-410e-a007-dfecedc93ec5" (UID: "23eb0047-e318-410e-a007-dfecedc93ec5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.145065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-config-data" (OuterVolumeSpecName: "config-data") pod "23eb0047-e318-410e-a007-dfecedc93ec5" (UID: "23eb0047-e318-410e-a007-dfecedc93ec5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.180738 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.180809 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gmgfd\" (UniqueName: \"kubernetes.io/projected/23eb0047-e318-410e-a007-dfecedc93ec5-kube-api-access-gmgfd\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.180827 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.180858 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.180868 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.180880 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23eb0047-e318-410e-a007-dfecedc93ec5-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.210429 4769 scope.go:117] "RemoveContainer" containerID="22283d06532a60bf3192759a09303eb14c11548e179042b0bf37efbda9965d43" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.241706 4769 scope.go:117] "RemoveContainer" containerID="8d0ac4a600f17c5430fd4fd9c4f8de99d52a03fde923500cecb363fad63912dc" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.274833 4769 scope.go:117] "RemoveContainer" containerID="c9a1065d4afe764dac0d7d0da1c88eafa5576cb784b5cba6121b2a609421e79f" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.293411 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="250ecab7-91a2-43f4-a2f4-3c1dae36ae85" path="/var/lib/kubelet/pods/250ecab7-91a2-43f4-a2f4-3c1dae36ae85/volumes" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.294448 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a289f874-b8db-44b9-a125-28443a395df8" path="/var/lib/kubelet/pods/a289f874-b8db-44b9-a125-28443a395df8/volumes" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.319106 4769 scope.go:117] "RemoveContainer" containerID="2da921b2026043a55b91bfeb31903c8701abe654b8f6519b8cf5ff0360725b41" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.364644 4769 scope.go:117] "RemoveContainer" containerID="ce1d328ccbc915838f798bc19375e66aa8a11fb4730594b611c0800d8711dec9" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.457866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7fc86bb567-hdclf"] Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.510464 4769 scope.go:117] "RemoveContainer" containerID="b78ae03a726387fdf2735f3c92a89e864ec4d040b21582891aa8cea4abda187f" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.593811 4769 scope.go:117] "RemoveContainer" containerID="c35464a3e65222fb30957342ae0556146a82822c4f11ec90d17fe91d69203acc" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.684593 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.707404 4769 scope.go:117] "RemoveContainer" containerID="d8be63883a99d105d2afe48aedd8e3a1382da5e070922863f958ffd231e77e5f" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.718254 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tltbb"] Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.795906 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tltbb"] Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.847888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-sg-core-conf-yaml\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848019 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-combined-ca-bundle\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-scripts\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-log-httpd\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7txg7\" (UniqueName: \"kubernetes.io/projected/437d65f9-a3a0-4267-954e-109c0e077594-kube-api-access-7txg7\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-run-httpd\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848360 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-config-data\") pod \"437d65f9-a3a0-4267-954e-109c0e077594\" (UID: \"437d65f9-a3a0-4267-954e-109c0e077594\") " Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848567 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7l7gg"] Nov 21 12:49:19 crc kubenswrapper[4769]: E1121 12:49:19.848930 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="sg-core" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848950 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="sg-core" Nov 21 12:49:19 crc kubenswrapper[4769]: E1121 12:49:19.848967 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-central-agent" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848974 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-central-agent" Nov 21 12:49:19 crc kubenswrapper[4769]: E1121 12:49:19.848985 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23eb0047-e318-410e-a007-dfecedc93ec5" containerName="keystone-bootstrap" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.848992 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eb0047-e318-410e-a007-dfecedc93ec5" containerName="keystone-bootstrap" Nov 21 12:49:19 crc kubenswrapper[4769]: E1121 12:49:19.849018 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-notification-agent" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.849026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-notification-agent" Nov 21 12:49:19 crc kubenswrapper[4769]: E1121 12:49:19.849059 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="proxy-httpd" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.849067 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="proxy-httpd" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.853585 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-central-agent" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.853622 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="ceilometer-notification-agent" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.853637 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="proxy-httpd" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.853647 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="437d65f9-a3a0-4267-954e-109c0e077594" containerName="sg-core" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.853658 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23eb0047-e318-410e-a007-dfecedc93ec5" containerName="keystone-bootstrap" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.854210 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.866920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.867155 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.883795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tltbb" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.886012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437d65f9-a3a0-4267-954e-109c0e077594-kube-api-access-7txg7" (OuterVolumeSpecName: "kube-api-access-7txg7") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "kube-api-access-7txg7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.889953 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-scripts" (OuterVolumeSpecName: "scripts") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.897652 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1d8da301216a69f195ad623d3532cf38a9ada8dd749c8141f2d14bc839a2766" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.900404 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7l7gg"] Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.949833 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-credential-keys\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.949880 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44krq\" (UniqueName: \"kubernetes.io/projected/48598363-9c87-49d3-ac97-609138b72597-kube-api-access-44krq\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.949927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-fernet-keys\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-scripts\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950039 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-config-data\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-combined-ca-bundle\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950136 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7txg7\" (UniqueName: \"kubernetes.io/projected/437d65f9-a3a0-4267-954e-109c0e077594-kube-api-access-7txg7\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950146 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950155 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.950170 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/437d65f9-a3a0-4267-954e-109c0e077594-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.966408 4769 scope.go:117] "RemoveContainer" containerID="f8951fb0205b9b418476b216d36f63087f35f7d86fce2af42515b76e7151687c" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.968740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.972316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5ab314e3-8554-422d-bb15-f3d706c39ef3","Type":"ContainerStarted","Data":"7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390"} Nov 21 12:49:19 crc kubenswrapper[4769]: I1121 12:49:19.972358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5ab314e3-8554-422d-bb15-f3d706c39ef3","Type":"ContainerStarted","Data":"43d6facdd7f327d508d48148a19b021f7c1830a80a9eb1b9d8691808efde21a0"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004517 4769 generic.go:334] "Generic (PLEG): container finished" podID="437d65f9-a3a0-4267-954e-109c0e077594" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" exitCode=0 Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004558 4769 generic.go:334] "Generic (PLEG): container finished" podID="437d65f9-a3a0-4267-954e-109c0e077594" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" exitCode=2 Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004567 4769 generic.go:334] "Generic (PLEG): container finished" podID="437d65f9-a3a0-4267-954e-109c0e077594" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" exitCode=0 Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004575 4769 generic.go:334] "Generic (PLEG): container finished" podID="437d65f9-a3a0-4267-954e-109c0e077594" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" exitCode=0 Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerDied","Data":"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerDied","Data":"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerDied","Data":"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerDied","Data":"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"437d65f9-a3a0-4267-954e-109c0e077594","Type":"ContainerDied","Data":"3f1b83d002ed9fbbe2efbf00292c439d7d54ee8000a3869dd70fd9765a7e05ed"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004687 4769 scope.go:117] "RemoveContainer" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.004821 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.011076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7bd1e76c-ce79-4b90-8bbc-c2b676690d54","Type":"ContainerStarted","Data":"7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.014451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" event={"ID":"20f55126-1aa7-4b10-9858-a35e8a073286","Type":"ContainerStarted","Data":"adc24dff6ad45f1b8afd06b76fe46b777ec8c944d3db466c716c61f9a98baf7f"} Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.022804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.025734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-config-data" (OuterVolumeSpecName: "config-data") pod "437d65f9-a3a0-4267-954e-109c0e077594" (UID: "437d65f9-a3a0-4267-954e-109c0e077594"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.043882 4769 scope.go:117] "RemoveContainer" containerID="e1c859f43535ff073c9273dc7ee975073fc44454002d3fb2a962ffeb02322a6c" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-combined-ca-bundle\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-credential-keys\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051448 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-44krq\" (UniqueName: \"kubernetes.io/projected/48598363-9c87-49d3-ac97-609138b72597-kube-api-access-44krq\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-fernet-keys\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-scripts\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-config-data\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051679 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051689 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.051701 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437d65f9-a3a0-4267-954e-109c0e077594-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.056805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-scripts\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.057777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-credential-keys\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.058395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-config-data\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.059607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-fernet-keys\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.060049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-combined-ca-bundle\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.071386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-44krq\" (UniqueName: \"kubernetes.io/projected/48598363-9c87-49d3-ac97-609138b72597-kube-api-access-44krq\") pod \"keystone-bootstrap-7l7gg\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.074030 4769 scope.go:117] "RemoveContainer" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.099605 4769 scope.go:117] "RemoveContainer" containerID="c760f0f48028b4106e87bcbf2583e64106415ee45fde91f735003e4c387e69c4" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.113963 4769 scope.go:117] "RemoveContainer" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.127065 4769 scope.go:117] "RemoveContainer" containerID="748a781178f3063bba0f59477e73b37361fbbe5b3f3e09613413a5dd8c90b7a6" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.147994 4769 scope.go:117] "RemoveContainer" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.173777 4769 scope.go:117] "RemoveContainer" containerID="916ddc04eb1228ad66207276c99ebb958f7377894f78ba9d2cf13dec82caf3b5" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.197578 4769 scope.go:117] "RemoveContainer" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" Nov 21 12:49:20 crc kubenswrapper[4769]: E1121 12:49:20.198261 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": container with ID starting with a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf not found: ID does not exist" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.198294 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf"} err="failed to get container status \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": rpc error: code = NotFound desc = could not find container \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": container with ID starting with a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.198317 4769 scope.go:117] "RemoveContainer" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" Nov 21 12:49:20 crc kubenswrapper[4769]: E1121 12:49:20.198666 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": container with ID starting with 95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd not found: ID does not exist" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.198695 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd"} err="failed to get container status \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": rpc error: code = NotFound desc = could not find container \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": container with ID starting with 95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.198709 4769 scope.go:117] "RemoveContainer" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" Nov 21 12:49:20 crc kubenswrapper[4769]: E1121 12:49:20.198919 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": container with ID starting with a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d not found: ID does not exist" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.198944 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d"} err="failed to get container status \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": rpc error: code = NotFound desc = could not find container \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": container with ID starting with a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.198957 4769 scope.go:117] "RemoveContainer" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" Nov 21 12:49:20 crc kubenswrapper[4769]: E1121 12:49:20.199323 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": container with ID starting with e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436 not found: ID does not exist" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.199349 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436"} err="failed to get container status \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": rpc error: code = NotFound desc = could not find container \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": container with ID starting with e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436 not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.199362 4769 scope.go:117] "RemoveContainer" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.199705 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf"} err="failed to get container status \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": rpc error: code = NotFound desc = could not find container \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": container with ID starting with a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.199723 4769 scope.go:117] "RemoveContainer" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.199993 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd"} err="failed to get container status \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": rpc error: code = NotFound desc = could not find container \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": container with ID starting with 95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200016 4769 scope.go:117] "RemoveContainer" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200199 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d"} err="failed to get container status \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": rpc error: code = NotFound desc = could not find container \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": container with ID starting with a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200217 4769 scope.go:117] "RemoveContainer" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200406 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436"} err="failed to get container status \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": rpc error: code = NotFound desc = could not find container \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": container with ID starting with e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436 not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200426 4769 scope.go:117] "RemoveContainer" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200767 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf"} err="failed to get container status \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": rpc error: code = NotFound desc = could not find container \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": container with ID starting with a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.200788 4769 scope.go:117] "RemoveContainer" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201125 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd"} err="failed to get container status \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": rpc error: code = NotFound desc = could not find container \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": container with ID starting with 95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201161 4769 scope.go:117] "RemoveContainer" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201376 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d"} err="failed to get container status \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": rpc error: code = NotFound desc = could not find container \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": container with ID starting with a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201396 4769 scope.go:117] "RemoveContainer" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201581 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436"} err="failed to get container status \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": rpc error: code = NotFound desc = could not find container \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": container with ID starting with e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436 not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201597 4769 scope.go:117] "RemoveContainer" containerID="a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201765 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf"} err="failed to get container status \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": rpc error: code = NotFound desc = could not find container \"a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf\": container with ID starting with a1bd239be7996259d4cfb27a1f0e48b403073b4e192f68521597d7515e92b1cf not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.201778 4769 scope.go:117] "RemoveContainer" containerID="95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.202430 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd"} err="failed to get container status \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": rpc error: code = NotFound desc = could not find container \"95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd\": container with ID starting with 95bae8879cdcc5919c8a229ce533709b5319fc42490192c85f81c8a77ac687fd not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.202462 4769 scope.go:117] "RemoveContainer" containerID="a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.202668 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d"} err="failed to get container status \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": rpc error: code = NotFound desc = could not find container \"a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d\": container with ID starting with a43438b78d45de9ece7457156bb493bb954c2a3e89be6b270e47b5fe347b325d not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.202705 4769 scope.go:117] "RemoveContainer" containerID="e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.203001 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436"} err="failed to get container status \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": rpc error: code = NotFound desc = could not find container \"e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436\": container with ID starting with e185d16c31a452be0c5baf19357437128c6c9afead444ba0b37bb4b74b80c436 not found: ID does not exist" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.217085 4769 scope.go:117] "RemoveContainer" containerID="8a6c782c8c9308763a2ca97391df3a06e759c659ee02c3a1ee35190a53b5305a" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.251585 4769 scope.go:117] "RemoveContainer" containerID="4ae0c0f2ff5a703a50b2f134e4a4b029f1ba19c4e539c1d91dba2775738e09f9" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.283217 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.327085 4769 scope.go:117] "RemoveContainer" containerID="e730e0451f474199fd6aa43f4849ebe8dbf6a76764a670feb136ad8dca079b57" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.352760 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.364558 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.376151 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.381084 4769 scope.go:117] "RemoveContainer" containerID="4c4c827743b73c36aa8f9ec91e3bb20a9ed1a2bf4193cdedd6e8368f99a8f068" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.381307 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.384588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.385331 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.431612 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.446375 4769 scope.go:117] "RemoveContainer" containerID="faac91ebebab06a02c43aae579e4b27c115b8f34801002ff38acd386b6bf5adf" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465114 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-run-httpd\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-config-data\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqvr\" (UniqueName: \"kubernetes.io/projected/8c736e2e-616d-4dae-a715-1eda548fe728-kube-api-access-8kqvr\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-log-httpd\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.465734 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-scripts\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.567806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.568174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqvr\" (UniqueName: \"kubernetes.io/projected/8c736e2e-616d-4dae-a715-1eda548fe728-kube-api-access-8kqvr\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.568206 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-log-httpd\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.568224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-scripts\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.568245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-run-httpd\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.568297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-config-data\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.568344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.569590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-run-httpd\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.569636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-log-httpd\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.577442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-scripts\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.579999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-config-data\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.583859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.584039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.591072 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqvr\" (UniqueName: \"kubernetes.io/projected/8c736e2e-616d-4dae-a715-1eda548fe728-kube-api-access-8kqvr\") pod \"ceilometer-0\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.720288 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:20 crc kubenswrapper[4769]: I1121 12:49:20.857367 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7l7gg"] Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.034389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5ab314e3-8554-422d-bb15-f3d706c39ef3","Type":"ContainerStarted","Data":"079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06"} Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.036936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" event={"ID":"20f55126-1aa7-4b10-9858-a35e8a073286","Type":"ContainerStarted","Data":"85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d"} Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.036986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" event={"ID":"20f55126-1aa7-4b10-9858-a35e8a073286","Type":"ContainerStarted","Data":"1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1"} Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.037583 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.037619 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.039923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" event={"ID":"48598363-9c87-49d3-ac97-609138b72597","Type":"ContainerStarted","Data":"0f06f781b0ffdf328539cd471dff673d940d561b8c9eced4fcda7a1efc82fb88"} Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.045513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7bd1e76c-ce79-4b90-8bbc-c2b676690d54","Type":"ContainerStarted","Data":"f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050"} Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.063022 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.063002937 podStartE2EDuration="4.063002937s" podCreationTimestamp="2025-11-21 12:49:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:21.056113969 +0000 UTC m=+3519.756775797" watchObservedRunningTime="2025-11-21 12:49:21.063002937 +0000 UTC m=+3519.763664755" Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.111261 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" podStartSLOduration=3.111229979 podStartE2EDuration="3.111229979s" podCreationTimestamp="2025-11-21 12:49:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:21.094064142 +0000 UTC m=+3519.794725990" watchObservedRunningTime="2025-11-21 12:49:21.111229979 +0000 UTC m=+3519.811891797" Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.132925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.132906939 podStartE2EDuration="4.132906939s" podCreationTimestamp="2025-11-21 12:49:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:21.130145103 +0000 UTC m=+3519.830806921" watchObservedRunningTime="2025-11-21 12:49:21.132906939 +0000 UTC m=+3519.833568757" Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.214818 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:49:21 crc kubenswrapper[4769]: W1121 12:49:21.216438 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c736e2e_616d_4dae_a715_1eda548fe728.slice/crio-23f73e7eb9228382116573e3fa96556e265db5ec6e980726d2fbc6610e94fa38 WatchSource:0}: Error finding container 23f73e7eb9228382116573e3fa96556e265db5ec6e980726d2fbc6610e94fa38: Status 404 returned error can't find the container with id 23f73e7eb9228382116573e3fa96556e265db5ec6e980726d2fbc6610e94fa38 Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.286335 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23eb0047-e318-410e-a007-dfecedc93ec5" path="/var/lib/kubelet/pods/23eb0047-e318-410e-a007-dfecedc93ec5/volumes" Nov 21 12:49:21 crc kubenswrapper[4769]: I1121 12:49:21.287149 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="437d65f9-a3a0-4267-954e-109c0e077594" path="/var/lib/kubelet/pods/437d65f9-a3a0-4267-954e-109c0e077594/volumes" Nov 21 12:49:22 crc kubenswrapper[4769]: I1121 12:49:22.060773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerStarted","Data":"d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305"} Nov 21 12:49:22 crc kubenswrapper[4769]: I1121 12:49:22.061565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerStarted","Data":"23f73e7eb9228382116573e3fa96556e265db5ec6e980726d2fbc6610e94fa38"} Nov 21 12:49:22 crc kubenswrapper[4769]: I1121 12:49:22.068084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" event={"ID":"48598363-9c87-49d3-ac97-609138b72597","Type":"ContainerStarted","Data":"79d372547989d83e9b92ed42c5448f7c26f7dcdb2ef8213f0c8ee892bf44abd9"} Nov 21 12:49:22 crc kubenswrapper[4769]: I1121 12:49:22.091573 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" podStartSLOduration=3.091536907 podStartE2EDuration="3.091536907s" podCreationTimestamp="2025-11-21 12:49:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:22.086405747 +0000 UTC m=+3520.787067605" watchObservedRunningTime="2025-11-21 12:49:22.091536907 +0000 UTC m=+3520.792198745" Nov 21 12:49:23 crc kubenswrapper[4769]: I1121 12:49:23.084367 4769 generic.go:334] "Generic (PLEG): container finished" podID="0afb11a7-3376-4f3c-abea-50c5dd099a2a" containerID="dcf75b7ed39b2a1f6fe8e8444f434d5291168d1debb86cabd9bffb3d5db705a1" exitCode=0 Nov 21 12:49:23 crc kubenswrapper[4769]: I1121 12:49:23.084444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" event={"ID":"0afb11a7-3376-4f3c-abea-50c5dd099a2a","Type":"ContainerDied","Data":"dcf75b7ed39b2a1f6fe8e8444f434d5291168d1debb86cabd9bffb3d5db705a1"} Nov 21 12:49:23 crc kubenswrapper[4769]: I1121 12:49:23.092868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerStarted","Data":"d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a"} Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.112724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerStarted","Data":"0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b"} Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.117631 4769 generic.go:334] "Generic (PLEG): container finished" podID="48598363-9c87-49d3-ac97-609138b72597" containerID="79d372547989d83e9b92ed42c5448f7c26f7dcdb2ef8213f0c8ee892bf44abd9" exitCode=0 Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.117783 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" event={"ID":"48598363-9c87-49d3-ac97-609138b72597","Type":"ContainerDied","Data":"79d372547989d83e9b92ed42c5448f7c26f7dcdb2ef8213f0c8ee892bf44abd9"} Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.605128 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.756972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-combined-ca-bundle\") pod \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.757245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-db-sync-config-data\") pod \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.757403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d78p4\" (UniqueName: \"kubernetes.io/projected/0afb11a7-3376-4f3c-abea-50c5dd099a2a-kube-api-access-d78p4\") pod \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\" (UID: \"0afb11a7-3376-4f3c-abea-50c5dd099a2a\") " Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.761839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afb11a7-3376-4f3c-abea-50c5dd099a2a-kube-api-access-d78p4" (OuterVolumeSpecName: "kube-api-access-d78p4") pod "0afb11a7-3376-4f3c-abea-50c5dd099a2a" (UID: "0afb11a7-3376-4f3c-abea-50c5dd099a2a"). InnerVolumeSpecName "kube-api-access-d78p4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.762796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0afb11a7-3376-4f3c-abea-50c5dd099a2a" (UID: "0afb11a7-3376-4f3c-abea-50c5dd099a2a"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.817770 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0afb11a7-3376-4f3c-abea-50c5dd099a2a" (UID: "0afb11a7-3376-4f3c-abea-50c5dd099a2a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.862919 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.862988 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0afb11a7-3376-4f3c-abea-50c5dd099a2a-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:24 crc kubenswrapper[4769]: I1121 12:49:24.863012 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d78p4\" (UniqueName: \"kubernetes.io/projected/0afb11a7-3376-4f3c-abea-50c5dd099a2a-kube-api-access-d78p4\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.136816 4769 generic.go:334] "Generic (PLEG): container finished" podID="fb43f65e-1c25-4b63-b1c6-6b4e196376a9" containerID="73d48851f9d09d3e64cdac01b0e9d74453b46a2867eca7ec9a8de9ae016bda20" exitCode=0 Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.136961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" event={"ID":"fb43f65e-1c25-4b63-b1c6-6b4e196376a9","Type":"ContainerDied","Data":"73d48851f9d09d3e64cdac01b0e9d74453b46a2867eca7ec9a8de9ae016bda20"} Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.140398 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.140387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvrls" event={"ID":"0afb11a7-3376-4f3c-abea-50c5dd099a2a","Type":"ContainerDied","Data":"9b9dbe55988c6f71ea6ba90d52d1b098bcad53098ed4cf9cb039998d58785d28"} Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.140612 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b9dbe55988c6f71ea6ba90d52d1b098bcad53098ed4cf9cb039998d58785d28" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.147698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerStarted","Data":"db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528"} Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.230764 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.7717135069999999 podStartE2EDuration="5.230728884s" podCreationTimestamp="2025-11-21 12:49:20 +0000 UTC" firstStartedPulling="2025-11-21 12:49:21.219446663 +0000 UTC m=+3519.920108481" lastFinishedPulling="2025-11-21 12:49:24.67846203 +0000 UTC m=+3523.379123858" observedRunningTime="2025-11-21 12:49:25.21258596 +0000 UTC m=+3523.913247788" watchObservedRunningTime="2025-11-21 12:49:25.230728884 +0000 UTC m=+3523.931390712" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.369647 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp"] Nov 21 12:49:25 crc kubenswrapper[4769]: E1121 12:49:25.370071 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0afb11a7-3376-4f3c-abea-50c5dd099a2a" containerName="barbican-db-sync" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.370089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afb11a7-3376-4f3c-abea-50c5dd099a2a" containerName="barbican-db-sync" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.370281 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0afb11a7-3376-4f3c-abea-50c5dd099a2a" containerName="barbican-db-sync" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.371246 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.374645 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.374663 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-4gsg9" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.374823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.398761 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp"] Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.405363 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-65c98777d4-j687l"] Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.407437 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.409032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.440761 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65c98777d4-j687l"] Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.482465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-combined-ca-bundle\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.482513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data-custom\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.482578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.482607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a72248b-c557-4b25-b168-9b5022a81cec-logs\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.482667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgt4p\" (UniqueName: \"kubernetes.io/projected/0a72248b-c557-4b25-b168-9b5022a81cec-kube-api-access-wgt4p\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.499002 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-8559b84c95-qswr6"] Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.500797 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.515775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.516076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-8559b84c95-qswr6"] Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.584560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d291823-8a89-4b29-bd20-3a10b05de58a-logs\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.584784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data-custom\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.584858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-combined-ca-bundle\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.584972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.585055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data-custom\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.585219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a72248b-c557-4b25-b168-9b5022a81cec-logs\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.585310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-combined-ca-bundle\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.585415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.585485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wgt4p\" (UniqueName: \"kubernetes.io/projected/0a72248b-c557-4b25-b168-9b5022a81cec-kube-api-access-wgt4p\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.585631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbd5j\" (UniqueName: \"kubernetes.io/projected/5d291823-8a89-4b29-bd20-3a10b05de58a-kube-api-access-vbd5j\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.587282 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a72248b-c557-4b25-b168-9b5022a81cec-logs\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.591937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data-custom\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.596391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-combined-ca-bundle\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.598368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.612948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgt4p\" (UniqueName: \"kubernetes.io/projected/0a72248b-c557-4b25-b168-9b5022a81cec-kube-api-access-wgt4p\") pod \"barbican-keystone-listener-864b4d7f8c-btkpp\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.674282 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.686231 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-combined-ca-bundle\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vbd5j\" (UniqueName: \"kubernetes.io/projected/5d291823-8a89-4b29-bd20-3a10b05de58a-kube-api-access-vbd5j\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d291823-8a89-4b29-bd20-3a10b05de58a-logs\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rz6p\" (UniqueName: \"kubernetes.io/projected/dfafd1b8-1f52-406b-87f6-0e243841e3bf-kube-api-access-2rz6p\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dfafd1b8-1f52-406b-87f6-0e243841e3bf-logs\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data-custom\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687759 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data-custom\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.687810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-combined-ca-bundle\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.688954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d291823-8a89-4b29-bd20-3a10b05de58a-logs\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.692858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data-custom\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.693373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-combined-ca-bundle\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.693519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.716882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbd5j\" (UniqueName: \"kubernetes.io/projected/5d291823-8a89-4b29-bd20-3a10b05de58a-kube-api-access-vbd5j\") pod \"barbican-worker-65c98777d4-j687l\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.745251 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.788487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-combined-ca-bundle\") pod \"48598363-9c87-49d3-ac97-609138b72597\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.788646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-credential-keys\") pod \"48598363-9c87-49d3-ac97-609138b72597\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.788701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-scripts\") pod \"48598363-9c87-49d3-ac97-609138b72597\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.788732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-config-data\") pod \"48598363-9c87-49d3-ac97-609138b72597\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.788787 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-fernet-keys\") pod \"48598363-9c87-49d3-ac97-609138b72597\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.788820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44krq\" (UniqueName: \"kubernetes.io/projected/48598363-9c87-49d3-ac97-609138b72597-kube-api-access-44krq\") pod \"48598363-9c87-49d3-ac97-609138b72597\" (UID: \"48598363-9c87-49d3-ac97-609138b72597\") " Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.789036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dfafd1b8-1f52-406b-87f6-0e243841e3bf-logs\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.789057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data-custom\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.789158 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-combined-ca-bundle\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.789207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.789223 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2rz6p\" (UniqueName: \"kubernetes.io/projected/dfafd1b8-1f52-406b-87f6-0e243841e3bf-kube-api-access-2rz6p\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.793125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dfafd1b8-1f52-406b-87f6-0e243841e3bf-logs\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.796432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-scripts" (OuterVolumeSpecName: "scripts") pod "48598363-9c87-49d3-ac97-609138b72597" (UID: "48598363-9c87-49d3-ac97-609138b72597"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.798250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-combined-ca-bundle\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.800004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data-custom\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.801627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.802301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "48598363-9c87-49d3-ac97-609138b72597" (UID: "48598363-9c87-49d3-ac97-609138b72597"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.802827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48598363-9c87-49d3-ac97-609138b72597-kube-api-access-44krq" (OuterVolumeSpecName: "kube-api-access-44krq") pod "48598363-9c87-49d3-ac97-609138b72597" (UID: "48598363-9c87-49d3-ac97-609138b72597"). InnerVolumeSpecName "kube-api-access-44krq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.815129 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rz6p\" (UniqueName: \"kubernetes.io/projected/dfafd1b8-1f52-406b-87f6-0e243841e3bf-kube-api-access-2rz6p\") pod \"barbican-api-8559b84c95-qswr6\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.817323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "48598363-9c87-49d3-ac97-609138b72597" (UID: "48598363-9c87-49d3-ac97-609138b72597"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.834137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48598363-9c87-49d3-ac97-609138b72597" (UID: "48598363-9c87-49d3-ac97-609138b72597"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.836785 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-config-data" (OuterVolumeSpecName: "config-data") pod "48598363-9c87-49d3-ac97-609138b72597" (UID: "48598363-9c87-49d3-ac97-609138b72597"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.890631 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.890672 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.890682 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.890691 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-44krq\" (UniqueName: \"kubernetes.io/projected/48598363-9c87-49d3-ac97-609138b72597-kube-api-access-44krq\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.890703 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.890713 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/48598363-9c87-49d3-ac97-609138b72597-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:25 crc kubenswrapper[4769]: I1121 12:49:25.972759 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.155541 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65c98777d4-j687l"] Nov 21 12:49:26 crc kubenswrapper[4769]: W1121 12:49:26.156563 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d291823_8a89_4b29_bd20_3a10b05de58a.slice/crio-c72081efe685740d8536221fef589996b49213d7a279b9cfc942983b88784bfe WatchSource:0}: Error finding container c72081efe685740d8536221fef589996b49213d7a279b9cfc942983b88784bfe: Status 404 returned error can't find the container with id c72081efe685740d8536221fef589996b49213d7a279b9cfc942983b88784bfe Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.164647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.165049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-7l7gg" event={"ID":"48598363-9c87-49d3-ac97-609138b72597","Type":"ContainerDied","Data":"0f06f781b0ffdf328539cd471dff673d940d561b8c9eced4fcda7a1efc82fb88"} Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.165086 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f06f781b0ffdf328539cd471dff673d940d561b8c9eced4fcda7a1efc82fb88" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.166343 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.215680 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp"] Nov 21 12:49:26 crc kubenswrapper[4769]: W1121 12:49:26.238965 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a72248b_c557_4b25_b168_9b5022a81cec.slice/crio-acd792357719b2fcee7e701739f39e166fab3b83d9509aa6b59b6d5da3bb0ce5 WatchSource:0}: Error finding container acd792357719b2fcee7e701739f39e166fab3b83d9509aa6b59b6d5da3bb0ce5: Status 404 returned error can't find the container with id acd792357719b2fcee7e701739f39e166fab3b83d9509aa6b59b6d5da3bb0ce5 Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.286635 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-75dd64ff8d-6p889"] Nov 21 12:49:26 crc kubenswrapper[4769]: E1121 12:49:26.287080 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48598363-9c87-49d3-ac97-609138b72597" containerName="keystone-bootstrap" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.287097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48598363-9c87-49d3-ac97-609138b72597" containerName="keystone-bootstrap" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.287303 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48598363-9c87-49d3-ac97-609138b72597" containerName="keystone-bootstrap" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.288364 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.291076 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.291182 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.292273 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.292399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-mbqmh" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.292597 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.292721 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.294360 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-75dd64ff8d-6p889"] Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.309471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv67j\" (UniqueName: \"kubernetes.io/projected/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-kube-api-access-qv67j\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.310037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-scripts\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.310962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-fernet-keys\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.310996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-internal-tls-certs\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.311016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-credential-keys\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.311084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-public-tls-certs\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.311107 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-config-data\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.311137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-combined-ca-bundle\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.412634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-public-tls-certs\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.412699 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-config-data\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.412725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-combined-ca-bundle\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.412789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qv67j\" (UniqueName: \"kubernetes.io/projected/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-kube-api-access-qv67j\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.413739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-scripts\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.413844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-fernet-keys\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.414214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-internal-tls-certs\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.414242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-credential-keys\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.416529 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-config-data\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.417236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-credential-keys\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.418133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-fernet-keys\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.419841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-public-tls-certs\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.420078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-internal-tls-certs\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.421580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-scripts\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.422038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-combined-ca-bundle\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.430399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv67j\" (UniqueName: \"kubernetes.io/projected/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-kube-api-access-qv67j\") pod \"keystone-75dd64ff8d-6p889\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.523016 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-8559b84c95-qswr6"] Nov 21 12:49:26 crc kubenswrapper[4769]: W1121 12:49:26.539809 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfafd1b8_1f52_406b_87f6_0e243841e3bf.slice/crio-a859d881c454e664b88e9e869bcca3de3d3630931dc2c91ebc97a7df6af3fcc8 WatchSource:0}: Error finding container a859d881c454e664b88e9e869bcca3de3d3630931dc2c91ebc97a7df6af3fcc8: Status 404 returned error can't find the container with id a859d881c454e664b88e9e869bcca3de3d3630931dc2c91ebc97a7df6af3fcc8 Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.624487 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.782158 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.829759 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-scripts\") pod \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.829834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25d8\" (UniqueName: \"kubernetes.io/projected/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-kube-api-access-b25d8\") pod \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.829851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-db-sync-config-data\") pod \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.830016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-combined-ca-bundle\") pod \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.830034 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-etc-machine-id\") pod \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.830060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-config-data\") pod \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\" (UID: \"fb43f65e-1c25-4b63-b1c6-6b4e196376a9\") " Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.830944 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "fb43f65e-1c25-4b63-b1c6-6b4e196376a9" (UID: "fb43f65e-1c25-4b63-b1c6-6b4e196376a9"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.846731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "fb43f65e-1c25-4b63-b1c6-6b4e196376a9" (UID: "fb43f65e-1c25-4b63-b1c6-6b4e196376a9"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.848607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-kube-api-access-b25d8" (OuterVolumeSpecName: "kube-api-access-b25d8") pod "fb43f65e-1c25-4b63-b1c6-6b4e196376a9" (UID: "fb43f65e-1c25-4b63-b1c6-6b4e196376a9"). InnerVolumeSpecName "kube-api-access-b25d8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.853122 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-scripts" (OuterVolumeSpecName: "scripts") pod "fb43f65e-1c25-4b63-b1c6-6b4e196376a9" (UID: "fb43f65e-1c25-4b63-b1c6-6b4e196376a9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.915467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb43f65e-1c25-4b63-b1c6-6b4e196376a9" (UID: "fb43f65e-1c25-4b63-b1c6-6b4e196376a9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.932066 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.932101 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.932112 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.932124 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b25d8\" (UniqueName: \"kubernetes.io/projected/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-kube-api-access-b25d8\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.932138 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:26 crc kubenswrapper[4769]: I1121 12:49:26.949867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-config-data" (OuterVolumeSpecName: "config-data") pod "fb43f65e-1c25-4b63-b1c6-6b4e196376a9" (UID: "fb43f65e-1c25-4b63-b1c6-6b4e196376a9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.033239 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb43f65e-1c25-4b63-b1c6-6b4e196376a9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.106575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-75dd64ff8d-6p889"] Nov 21 12:49:27 crc kubenswrapper[4769]: W1121 12:49:27.112441 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b2227b4_f0f5_41a8_8825_c0a9e44c0bb8.slice/crio-0dcaa9a60f5078fdaedd7051c5d0ac6d4abd940269ae9def01e344a16eaa228a WatchSource:0}: Error finding container 0dcaa9a60f5078fdaedd7051c5d0ac6d4abd940269ae9def01e344a16eaa228a: Status 404 returned error can't find the container with id 0dcaa9a60f5078fdaedd7051c5d0ac6d4abd940269ae9def01e344a16eaa228a Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.198379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" event={"ID":"dfafd1b8-1f52-406b-87f6-0e243841e3bf","Type":"ContainerStarted","Data":"e3a7f70262734abaefda74e103f8ed7d134dbd726f9d6d6125eee86de39036e8"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.198422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" event={"ID":"dfafd1b8-1f52-406b-87f6-0e243841e3bf","Type":"ContainerStarted","Data":"ac1d28f6a30651500d68da8d2c890eabacee90404daebf055d65bfc1c71f765d"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.198435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" event={"ID":"dfafd1b8-1f52-406b-87f6-0e243841e3bf","Type":"ContainerStarted","Data":"a859d881c454e664b88e9e869bcca3de3d3630931dc2c91ebc97a7df6af3fcc8"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.198478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.198488 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.200744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" event={"ID":"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8","Type":"ContainerStarted","Data":"0dcaa9a60f5078fdaedd7051c5d0ac6d4abd940269ae9def01e344a16eaa228a"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.202398 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.202507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-xnpwk" event={"ID":"fb43f65e-1c25-4b63-b1c6-6b4e196376a9","Type":"ContainerDied","Data":"f1f6926e7b5305c3f28d1f39178e66827e80f811b0526d67fa9895cca1a38109"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.202540 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1f6926e7b5305c3f28d1f39178e66827e80f811b0526d67fa9895cca1a38109" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.206981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" event={"ID":"5d291823-8a89-4b29-bd20-3a10b05de58a","Type":"ContainerStarted","Data":"5a67db22b21f6fb627583f9c459c934186dfe8b52304a49f003ca1fcc1e60287"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.207015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" event={"ID":"5d291823-8a89-4b29-bd20-3a10b05de58a","Type":"ContainerStarted","Data":"793e3f5d3767dec3f664f6d1182ce025e2b4d90e3869bb6f9c107c692d39e592"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.207028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" event={"ID":"5d291823-8a89-4b29-bd20-3a10b05de58a","Type":"ContainerStarted","Data":"c72081efe685740d8536221fef589996b49213d7a279b9cfc942983b88784bfe"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.212257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" event={"ID":"0a72248b-c557-4b25-b168-9b5022a81cec","Type":"ContainerStarted","Data":"8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.212291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" event={"ID":"0a72248b-c557-4b25-b168-9b5022a81cec","Type":"ContainerStarted","Data":"6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.212301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" event={"ID":"0a72248b-c557-4b25-b168-9b5022a81cec","Type":"ContainerStarted","Data":"acd792357719b2fcee7e701739f39e166fab3b83d9509aa6b59b6d5da3bb0ce5"} Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.225588 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podStartSLOduration=2.225568181 podStartE2EDuration="2.225568181s" podCreationTimestamp="2025-11-21 12:49:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:27.220598236 +0000 UTC m=+3525.921260054" watchObservedRunningTime="2025-11-21 12:49:27.225568181 +0000 UTC m=+3525.926229999" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.257027 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" podStartSLOduration=2.257009847 podStartE2EDuration="2.257009847s" podCreationTimestamp="2025-11-21 12:49:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:27.248527416 +0000 UTC m=+3525.949189234" watchObservedRunningTime="2025-11-21 12:49:27.257009847 +0000 UTC m=+3525.957671655" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.298510 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" podStartSLOduration=2.298487955 podStartE2EDuration="2.298487955s" podCreationTimestamp="2025-11-21 12:49:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:27.29243851 +0000 UTC m=+3525.993100328" watchObservedRunningTime="2025-11-21 12:49:27.298487955 +0000 UTC m=+3525.999149773" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.448766 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:27 crc kubenswrapper[4769]: E1121 12:49:27.449182 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fb43f65e-1c25-4b63-b1c6-6b4e196376a9" containerName="cinder-db-sync" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.449212 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb43f65e-1c25-4b63-b1c6-6b4e196376a9" containerName="cinder-db-sync" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.449396 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fb43f65e-1c25-4b63-b1c6-6b4e196376a9" containerName="cinder-db-sync" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.450343 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.458823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.459091 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.459212 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.459322 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-8gf4m" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.494464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.536975 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.538525 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.546168 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.546258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d34a4977-7095-46dd-b67b-f1350b8d6e71-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.546288 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-scripts\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.546345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h857k\" (UniqueName: \"kubernetes.io/projected/d34a4977-7095-46dd-b67b-f1350b8d6e71-kube-api-access-h857k\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.546369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.546390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.556960 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.559916 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d20b104b-5345-44a5-8819-76b37533573e-logs\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d34a4977-7095-46dd-b67b-f1350b8d6e71-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-scripts\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-scripts\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data-custom\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d20b104b-5345-44a5-8819-76b37533573e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h857k\" (UniqueName: \"kubernetes.io/projected/d34a4977-7095-46dd-b67b-f1350b8d6e71-kube-api-access-h857k\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpqw\" (UniqueName: \"kubernetes.io/projected/d20b104b-5345-44a5-8819-76b37533573e-kube-api-access-wjpqw\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.648824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.649036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.649145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d34a4977-7095-46dd-b67b-f1350b8d6e71-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.654144 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.654696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.660747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.672220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-scripts\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.687661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h857k\" (UniqueName: \"kubernetes.io/projected/d34a4977-7095-46dd-b67b-f1350b8d6e71-kube-api-access-h857k\") pod \"cinder-scheduler-0\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d20b104b-5345-44a5-8819-76b37533573e-logs\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-scripts\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data-custom\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d20b104b-5345-44a5-8819-76b37533573e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpqw\" (UniqueName: \"kubernetes.io/projected/d20b104b-5345-44a5-8819-76b37533573e-kube-api-access-wjpqw\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d20b104b-5345-44a5-8819-76b37533573e-logs\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.751982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d20b104b-5345-44a5-8819-76b37533573e-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.756399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-scripts\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.757027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.757424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.759511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data-custom\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.766130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpqw\" (UniqueName: \"kubernetes.io/projected/d20b104b-5345-44a5-8819-76b37533573e-kube-api-access-wjpqw\") pod \"cinder-api-0\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.791225 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.893967 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.943183 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:27 crc kubenswrapper[4769]: I1121 12:49:27.943327 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.009449 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.023754 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.083268 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.083314 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.117813 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.141773 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.227142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" event={"ID":"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8","Type":"ContainerStarted","Data":"c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175"} Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.228565 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.228597 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.228608 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.228617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.285642 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" podStartSLOduration=2.2855952569999998 podStartE2EDuration="2.285595257s" podCreationTimestamp="2025-11-21 12:49:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:28.271553305 +0000 UTC m=+3526.972215123" watchObservedRunningTime="2025-11-21 12:49:28.285595257 +0000 UTC m=+3526.986257085" Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.311133 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:28 crc kubenswrapper[4769]: I1121 12:49:28.449775 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:28 crc kubenswrapper[4769]: W1121 12:49:28.457939 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd20b104b_5345_44a5_8819_76b37533573e.slice/crio-c4d27e56658ede7a7ef267a0c17fabadf270915527f41cc1b55b248f4989209c WatchSource:0}: Error finding container c4d27e56658ede7a7ef267a0c17fabadf270915527f41cc1b55b248f4989209c: Status 404 returned error can't find the container with id c4d27e56658ede7a7ef267a0c17fabadf270915527f41cc1b55b248f4989209c Nov 21 12:49:29 crc kubenswrapper[4769]: I1121 12:49:29.240580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d34a4977-7095-46dd-b67b-f1350b8d6e71","Type":"ContainerStarted","Data":"6ca077b757a7f5e03fc5b41c49ad2b263e67ff4304cb634b298fdfc9624cc283"} Nov 21 12:49:29 crc kubenswrapper[4769]: I1121 12:49:29.242666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d20b104b-5345-44a5-8819-76b37533573e","Type":"ContainerStarted","Data":"c4d27e56658ede7a7ef267a0c17fabadf270915527f41cc1b55b248f4989209c"} Nov 21 12:49:29 crc kubenswrapper[4769]: I1121 12:49:29.242700 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.166050 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.167797 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.276872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d20b104b-5345-44a5-8819-76b37533573e","Type":"ContainerStarted","Data":"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb"} Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.280861 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.280879 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.281489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d34a4977-7095-46dd-b67b-f1350b8d6e71","Type":"ContainerStarted","Data":"4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35"} Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.281514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d34a4977-7095-46dd-b67b-f1350b8d6e71","Type":"ContainerStarted","Data":"9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72"} Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.399990 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:30 crc kubenswrapper[4769]: I1121 12:49:30.519120 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:49:31 crc kubenswrapper[4769]: I1121 12:49:31.291475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d20b104b-5345-44a5-8819-76b37533573e","Type":"ContainerStarted","Data":"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28"} Nov 21 12:49:31 crc kubenswrapper[4769]: I1121 12:49:31.326337 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.326305855 podStartE2EDuration="4.326305855s" podCreationTimestamp="2025-11-21 12:49:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:31.318600986 +0000 UTC m=+3530.019262804" watchObservedRunningTime="2025-11-21 12:49:31.326305855 +0000 UTC m=+3530.026967713" Nov 21 12:49:31 crc kubenswrapper[4769]: I1121 12:49:31.522174 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.5221571130000005 podStartE2EDuration="4.522157113s" podCreationTimestamp="2025-11-21 12:49:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:31.350031731 +0000 UTC m=+3530.050693549" watchObservedRunningTime="2025-11-21 12:49:31.522157113 +0000 UTC m=+3530.222818931" Nov 21 12:49:31 crc kubenswrapper[4769]: I1121 12:49:31.526940 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:31 crc kubenswrapper[4769]: I1121 12:49:31.992437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv"] Nov 21 12:49:31 crc kubenswrapper[4769]: I1121 12:49:31.994698 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.004646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.005999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.011766 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv"] Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.068984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-public-tls-certs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.069046 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-internal-tls-certs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.069092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqmbh\" (UniqueName: \"kubernetes.io/projected/752b9e59-87a6-408f-8a3d-6f12449e03f0-kube-api-access-bqmbh\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.069123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data-custom\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.069155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.069200 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/752b9e59-87a6-408f-8a3d-6f12449e03f0-logs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.069234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-combined-ca-bundle\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.170774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bqmbh\" (UniqueName: \"kubernetes.io/projected/752b9e59-87a6-408f-8a3d-6f12449e03f0-kube-api-access-bqmbh\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.170854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data-custom\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.172257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.172335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/752b9e59-87a6-408f-8a3d-6f12449e03f0-logs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.172395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-combined-ca-bundle\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.172466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-public-tls-certs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.172515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-internal-tls-certs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.176848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-combined-ca-bundle\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.177018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data-custom\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.177228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/752b9e59-87a6-408f-8a3d-6f12449e03f0-logs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.177671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-internal-tls-certs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.179422 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-public-tls-certs\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.195438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqmbh\" (UniqueName: \"kubernetes.io/projected/752b9e59-87a6-408f-8a3d-6f12449e03f0-kube-api-access-bqmbh\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.198242 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data\") pod \"barbican-api-69b6dffd55-glnsv\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.301489 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.311726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.792411 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:32 crc kubenswrapper[4769]: I1121 12:49:32.867171 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv"] Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.327493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" event={"ID":"752b9e59-87a6-408f-8a3d-6f12449e03f0","Type":"ContainerStarted","Data":"4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7"} Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.328392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" event={"ID":"752b9e59-87a6-408f-8a3d-6f12449e03f0","Type":"ContainerStarted","Data":"31a300749671599e3a7d5a0cd49638c2e8fa5d0288bb3ba27d4b43a0a5d4179b"} Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.327861 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api" containerID="cri-o://72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28" gracePeriod=30 Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.327789 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api-log" containerID="cri-o://e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb" gracePeriod=30 Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.884556 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.909807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-combined-ca-bundle\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.910214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.910314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d20b104b-5345-44a5-8819-76b37533573e-etc-machine-id\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.910431 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-scripts\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.910600 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjpqw\" (UniqueName: \"kubernetes.io/projected/d20b104b-5345-44a5-8819-76b37533573e-kube-api-access-wjpqw\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.910704 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d20b104b-5345-44a5-8819-76b37533573e-logs\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.910856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data-custom\") pod \"d20b104b-5345-44a5-8819-76b37533573e\" (UID: \"d20b104b-5345-44a5-8819-76b37533573e\") " Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.914116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d20b104b-5345-44a5-8819-76b37533573e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.915815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20b104b-5345-44a5-8819-76b37533573e-logs" (OuterVolumeSpecName: "logs") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.919316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-scripts" (OuterVolumeSpecName: "scripts") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.919337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.919564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20b104b-5345-44a5-8819-76b37533573e-kube-api-access-wjpqw" (OuterVolumeSpecName: "kube-api-access-wjpqw") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "kube-api-access-wjpqw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.958361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:33 crc kubenswrapper[4769]: I1121 12:49:33.965795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data" (OuterVolumeSpecName: "config-data") pod "d20b104b-5345-44a5-8819-76b37533573e" (UID: "d20b104b-5345-44a5-8819-76b37533573e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012717 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjpqw\" (UniqueName: \"kubernetes.io/projected/d20b104b-5345-44a5-8819-76b37533573e-kube-api-access-wjpqw\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012760 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d20b104b-5345-44a5-8819-76b37533573e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012773 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012784 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012795 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012807 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d20b104b-5345-44a5-8819-76b37533573e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.012817 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d20b104b-5345-44a5-8819-76b37533573e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.341591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" event={"ID":"752b9e59-87a6-408f-8a3d-6f12449e03f0","Type":"ContainerStarted","Data":"1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666"} Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.341739 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.342090 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344371 4769 generic.go:334] "Generic (PLEG): container finished" podID="d20b104b-5345-44a5-8819-76b37533573e" containerID="72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28" exitCode=0 Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344510 4769 generic.go:334] "Generic (PLEG): container finished" podID="d20b104b-5345-44a5-8819-76b37533573e" containerID="e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb" exitCode=143 Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d20b104b-5345-44a5-8819-76b37533573e","Type":"ContainerDied","Data":"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28"} Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d20b104b-5345-44a5-8819-76b37533573e","Type":"ContainerDied","Data":"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb"} Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d20b104b-5345-44a5-8819-76b37533573e","Type":"ContainerDied","Data":"c4d27e56658ede7a7ef267a0c17fabadf270915527f41cc1b55b248f4989209c"} Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344686 4769 scope.go:117] "RemoveContainer" containerID="72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.344434 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.370854 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" podStartSLOduration=3.370830638 podStartE2EDuration="3.370830638s" podCreationTimestamp="2025-11-21 12:49:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:34.368392872 +0000 UTC m=+3533.069054700" watchObservedRunningTime="2025-11-21 12:49:34.370830638 +0000 UTC m=+3533.071492466" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.385852 4769 scope.go:117] "RemoveContainer" containerID="e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.410505 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.420590 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.443231 4769 scope.go:117] "RemoveContainer" containerID="72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28" Nov 21 12:49:34 crc kubenswrapper[4769]: E1121 12:49:34.445509 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28\": container with ID starting with 72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28 not found: ID does not exist" containerID="72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.445601 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28"} err="failed to get container status \"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28\": rpc error: code = NotFound desc = could not find container \"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28\": container with ID starting with 72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28 not found: ID does not exist" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.445640 4769 scope.go:117] "RemoveContainer" containerID="e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb" Nov 21 12:49:34 crc kubenswrapper[4769]: E1121 12:49:34.446180 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb\": container with ID starting with e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb not found: ID does not exist" containerID="e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.448299 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb"} err="failed to get container status \"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb\": rpc error: code = NotFound desc = could not find container \"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb\": container with ID starting with e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb not found: ID does not exist" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.448336 4769 scope.go:117] "RemoveContainer" containerID="72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.449054 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28"} err="failed to get container status \"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28\": rpc error: code = NotFound desc = could not find container \"72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28\": container with ID starting with 72e887ff26cbec3cf6b745ae0159b103f70eb4393bed8dbb690710776a3aaa28 not found: ID does not exist" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.449136 4769 scope.go:117] "RemoveContainer" containerID="e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.449620 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb"} err="failed to get container status \"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb\": rpc error: code = NotFound desc = could not find container \"e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb\": container with ID starting with e03c479da3c90873f874fe85403e119bb84375aba1818cad7560ca25c398bdeb not found: ID does not exist" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.484329 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:34 crc kubenswrapper[4769]: E1121 12:49:34.484765 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.484783 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api" Nov 21 12:49:34 crc kubenswrapper[4769]: E1121 12:49:34.484831 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api-log" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.484838 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api-log" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.485061 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api-log" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.485090 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d20b104b-5345-44a5-8819-76b37533573e" containerName="cinder-api" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.486119 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.488594 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.488774 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.489075 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.493511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.623936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-scripts\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0f4af21e-cf38-47ca-b541-60d52694c667-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624288 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data-custom\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4af21e-cf38-47ca-b541-60d52694c667-logs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624408 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lxs\" (UniqueName: \"kubernetes.io/projected/0f4af21e-cf38-47ca-b541-60d52694c667-kube-api-access-n2lxs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.624490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.725972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.727373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lxs\" (UniqueName: \"kubernetes.io/projected/0f4af21e-cf38-47ca-b541-60d52694c667-kube-api-access-n2lxs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.727553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.727709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-scripts\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.727871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.728018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0f4af21e-cf38-47ca-b541-60d52694c667-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.728167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data-custom\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.728326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.728332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0f4af21e-cf38-47ca-b541-60d52694c667-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.728512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4af21e-cf38-47ca-b541-60d52694c667-logs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.729003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4af21e-cf38-47ca-b541-60d52694c667-logs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.734739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.736246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.754265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data-custom\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.754288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.754854 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-scripts\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.757770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lxs\" (UniqueName: \"kubernetes.io/projected/0f4af21e-cf38-47ca-b541-60d52694c667-kube-api-access-n2lxs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.763081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:34 crc kubenswrapper[4769]: I1121 12:49:34.806740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:35 crc kubenswrapper[4769]: I1121 12:49:35.297879 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20b104b-5345-44a5-8819-76b37533573e" path="/var/lib/kubelet/pods/d20b104b-5345-44a5-8819-76b37533573e/volumes" Nov 21 12:49:35 crc kubenswrapper[4769]: I1121 12:49:35.299059 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:49:35 crc kubenswrapper[4769]: I1121 12:49:35.365293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0f4af21e-cf38-47ca-b541-60d52694c667","Type":"ContainerStarted","Data":"4495e43fbcd938f013f260a1aa28db803fd28e9d00e6f955253855290adff0a5"} Nov 21 12:49:36 crc kubenswrapper[4769]: I1121 12:49:36.389430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0f4af21e-cf38-47ca-b541-60d52694c667","Type":"ContainerStarted","Data":"d06a3f20f4817acf73144199db37518c37a6385128e56f2e054b001d2cb7acc8"} Nov 21 12:49:37 crc kubenswrapper[4769]: I1121 12:49:37.298039 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:37 crc kubenswrapper[4769]: I1121 12:49:37.347274 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:37 crc kubenswrapper[4769]: I1121 12:49:37.406912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0f4af21e-cf38-47ca-b541-60d52694c667","Type":"ContainerStarted","Data":"a07d5cb25170cc8787c0e0da9ae622529ba4ab9edf63668f30686bf481ea8583"} Nov 21 12:49:37 crc kubenswrapper[4769]: I1121 12:49:37.446377 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.446354703 podStartE2EDuration="3.446354703s" podCreationTimestamp="2025-11-21 12:49:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:37.431839418 +0000 UTC m=+3536.132501356" watchObservedRunningTime="2025-11-21 12:49:37.446354703 +0000 UTC m=+3536.147016531" Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.069308 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.174718 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.420856 4769 generic.go:334] "Generic (PLEG): container finished" podID="5230efa8-6d27-4741-b21b-4b7abb304abf" containerID="ddfcf65be0f1acda17774c4f889ecb6e3e0fabe803b8caab5a54ff6245f67805" exitCode=0 Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.421185 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="cinder-scheduler" containerID="cri-o://9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72" gracePeriod=30 Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.421349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" event={"ID":"5230efa8-6d27-4741-b21b-4b7abb304abf","Type":"ContainerDied","Data":"ddfcf65be0f1acda17774c4f889ecb6e3e0fabe803b8caab5a54ff6245f67805"} Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.422763 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:38 crc kubenswrapper[4769]: I1121 12:49:38.422908 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="probe" containerID="cri-o://4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35" gracePeriod=30 Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.437684 4769 generic.go:334] "Generic (PLEG): container finished" podID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerID="4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35" exitCode=0 Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.439163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d34a4977-7095-46dd-b67b-f1350b8d6e71","Type":"ContainerDied","Data":"4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35"} Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.866047 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.960766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-combined-ca-bundle\") pod \"5230efa8-6d27-4741-b21b-4b7abb304abf\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.960841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvk8n\" (UniqueName: \"kubernetes.io/projected/5230efa8-6d27-4741-b21b-4b7abb304abf-kube-api-access-wvk8n\") pod \"5230efa8-6d27-4741-b21b-4b7abb304abf\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.960949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-config\") pod \"5230efa8-6d27-4741-b21b-4b7abb304abf\" (UID: \"5230efa8-6d27-4741-b21b-4b7abb304abf\") " Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.965657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5230efa8-6d27-4741-b21b-4b7abb304abf-kube-api-access-wvk8n" (OuterVolumeSpecName: "kube-api-access-wvk8n") pod "5230efa8-6d27-4741-b21b-4b7abb304abf" (UID: "5230efa8-6d27-4741-b21b-4b7abb304abf"). InnerVolumeSpecName "kube-api-access-wvk8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.987001 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5230efa8-6d27-4741-b21b-4b7abb304abf" (UID: "5230efa8-6d27-4741-b21b-4b7abb304abf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:39 crc kubenswrapper[4769]: I1121 12:49:39.987423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-config" (OuterVolumeSpecName: "config") pod "5230efa8-6d27-4741-b21b-4b7abb304abf" (UID: "5230efa8-6d27-4741-b21b-4b7abb304abf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.063560 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.063911 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5230efa8-6d27-4741-b21b-4b7abb304abf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.063924 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wvk8n\" (UniqueName: \"kubernetes.io/projected/5230efa8-6d27-4741-b21b-4b7abb304abf-kube-api-access-wvk8n\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.449234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" event={"ID":"5230efa8-6d27-4741-b21b-4b7abb304abf","Type":"ContainerDied","Data":"d8c794c87702220d3fb0a2c3df3969d24dce632a0f7986cbacba0f5211e17688"} Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.449275 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8c794c87702220d3fb0a2c3df3969d24dce632a0f7986cbacba0f5211e17688" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.449296 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-sg9sp" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.737374 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5cf7b496c4-djs87"] Nov 21 12:49:40 crc kubenswrapper[4769]: E1121 12:49:40.737858 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5230efa8-6d27-4741-b21b-4b7abb304abf" containerName="neutron-db-sync" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.737876 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5230efa8-6d27-4741-b21b-4b7abb304abf" containerName="neutron-db-sync" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.738091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5230efa8-6d27-4741-b21b-4b7abb304abf" containerName="neutron-db-sync" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.739122 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.743245 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.743376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.743430 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-tqv9g" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.746466 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5cf7b496c4-djs87"] Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.747386 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.777836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-combined-ca-bundle\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.777937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-config\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.778031 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-httpd-config\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.778049 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbkj\" (UniqueName: \"kubernetes.io/projected/c289fd13-6b14-4e1b-a7ba-a80609f67b50-kube-api-access-7xbkj\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.778114 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-ovndb-tls-certs\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.880120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-combined-ca-bundle\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.880217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-config\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.880264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbkj\" (UniqueName: \"kubernetes.io/projected/c289fd13-6b14-4e1b-a7ba-a80609f67b50-kube-api-access-7xbkj\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.880285 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-httpd-config\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.880322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-ovndb-tls-certs\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.886260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-config\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.886309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-ovndb-tls-certs\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.888893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-combined-ca-bundle\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.897276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-httpd-config\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:40 crc kubenswrapper[4769]: I1121 12:49:40.910746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbkj\" (UniqueName: \"kubernetes.io/projected/c289fd13-6b14-4e1b-a7ba-a80609f67b50-kube-api-access-7xbkj\") pod \"neutron-5cf7b496c4-djs87\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.055150 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.067650 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.184816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data-custom\") pod \"d34a4977-7095-46dd-b67b-f1350b8d6e71\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.185074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data\") pod \"d34a4977-7095-46dd-b67b-f1350b8d6e71\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.185127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h857k\" (UniqueName: \"kubernetes.io/projected/d34a4977-7095-46dd-b67b-f1350b8d6e71-kube-api-access-h857k\") pod \"d34a4977-7095-46dd-b67b-f1350b8d6e71\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.185184 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-combined-ca-bundle\") pod \"d34a4977-7095-46dd-b67b-f1350b8d6e71\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.185296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-scripts\") pod \"d34a4977-7095-46dd-b67b-f1350b8d6e71\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.185598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d34a4977-7095-46dd-b67b-f1350b8d6e71-etc-machine-id\") pod \"d34a4977-7095-46dd-b67b-f1350b8d6e71\" (UID: \"d34a4977-7095-46dd-b67b-f1350b8d6e71\") " Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.186284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d34a4977-7095-46dd-b67b-f1350b8d6e71-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d34a4977-7095-46dd-b67b-f1350b8d6e71" (UID: "d34a4977-7095-46dd-b67b-f1350b8d6e71"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.190752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-scripts" (OuterVolumeSpecName: "scripts") pod "d34a4977-7095-46dd-b67b-f1350b8d6e71" (UID: "d34a4977-7095-46dd-b67b-f1350b8d6e71"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.192821 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d34a4977-7095-46dd-b67b-f1350b8d6e71" (UID: "d34a4977-7095-46dd-b67b-f1350b8d6e71"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.196333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34a4977-7095-46dd-b67b-f1350b8d6e71-kube-api-access-h857k" (OuterVolumeSpecName: "kube-api-access-h857k") pod "d34a4977-7095-46dd-b67b-f1350b8d6e71" (UID: "d34a4977-7095-46dd-b67b-f1350b8d6e71"). InnerVolumeSpecName "kube-api-access-h857k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.261618 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d34a4977-7095-46dd-b67b-f1350b8d6e71" (UID: "d34a4977-7095-46dd-b67b-f1350b8d6e71"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.288404 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d34a4977-7095-46dd-b67b-f1350b8d6e71-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.288680 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.288695 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h857k\" (UniqueName: \"kubernetes.io/projected/d34a4977-7095-46dd-b67b-f1350b8d6e71-kube-api-access-h857k\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.288711 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.288745 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.304739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data" (OuterVolumeSpecName: "config-data") pod "d34a4977-7095-46dd-b67b-f1350b8d6e71" (UID: "d34a4977-7095-46dd-b67b-f1350b8d6e71"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.326031 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.326107 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.391514 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d34a4977-7095-46dd-b67b-f1350b8d6e71-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.461671 4769 generic.go:334] "Generic (PLEG): container finished" podID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerID="9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72" exitCode=0 Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.461717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d34a4977-7095-46dd-b67b-f1350b8d6e71","Type":"ContainerDied","Data":"9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72"} Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.461744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d34a4977-7095-46dd-b67b-f1350b8d6e71","Type":"ContainerDied","Data":"6ca077b757a7f5e03fc5b41c49ad2b263e67ff4304cb634b298fdfc9624cc283"} Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.461762 4769 scope.go:117] "RemoveContainer" containerID="4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.461891 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.507048 4769 scope.go:117] "RemoveContainer" containerID="9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.509182 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.520449 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.529624 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:41 crc kubenswrapper[4769]: E1121 12:49:41.530061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="probe" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.530076 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="probe" Nov 21 12:49:41 crc kubenswrapper[4769]: E1121 12:49:41.530107 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="cinder-scheduler" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.530114 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="cinder-scheduler" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.530304 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="cinder-scheduler" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.530322 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" containerName="probe" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.531279 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.534238 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.536132 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.552469 4769 scope.go:117] "RemoveContainer" containerID="4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35" Nov 21 12:49:41 crc kubenswrapper[4769]: E1121 12:49:41.552932 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35\": container with ID starting with 4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35 not found: ID does not exist" containerID="4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.552989 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35"} err="failed to get container status \"4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35\": rpc error: code = NotFound desc = could not find container \"4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35\": container with ID starting with 4c5790803bdb7fdd78a4dcada1a5d656036690198740f9d558ff8373d244cf35 not found: ID does not exist" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.553021 4769 scope.go:117] "RemoveContainer" containerID="9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72" Nov 21 12:49:41 crc kubenswrapper[4769]: E1121 12:49:41.553564 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72\": container with ID starting with 9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72 not found: ID does not exist" containerID="9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.553580 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72"} err="failed to get container status \"9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72\": rpc error: code = NotFound desc = could not find container \"9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72\": container with ID starting with 9f6b4de89d7dcee1440c20a068c7e6b64c77ed6ae5e90dc1f6e7399da9cdcd72 not found: ID does not exist" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598089 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598220 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgdrt\" (UniqueName: \"kubernetes.io/projected/4db4811a-d420-4b48-a312-db8f5c3424bb-kube-api-access-jgdrt\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-scripts\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4db4811a-d420-4b48-a312-db8f5c3424bb-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.598913 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5cf7b496c4-djs87"] Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.700653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4db4811a-d420-4b48-a312-db8f5c3424bb-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.700752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.700802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.700828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jgdrt\" (UniqueName: \"kubernetes.io/projected/4db4811a-d420-4b48-a312-db8f5c3424bb-kube-api-access-jgdrt\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.701101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-scripts\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.701140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.701232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4db4811a-d420-4b48-a312-db8f5c3424bb-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.710227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.711936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.712595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-scripts\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.714395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.728458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgdrt\" (UniqueName: \"kubernetes.io/projected/4db4811a-d420-4b48-a312-db8f5c3424bb-kube-api-access-jgdrt\") pod \"cinder-scheduler-0\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:41 crc kubenswrapper[4769]: I1121 12:49:41.855422 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.288394 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.485276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" event={"ID":"c289fd13-6b14-4e1b-a7ba-a80609f67b50","Type":"ContainerStarted","Data":"d5ca73a0a3d8fea095b80f2b3d0086e2f9cfcf022ce9f4f16ab08905d1f56385"} Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.485557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" event={"ID":"c289fd13-6b14-4e1b-a7ba-a80609f67b50","Type":"ContainerStarted","Data":"75ddde4ab414b04db3c6011a307107f8aa9db7e0e7f8204ddabaec3e114446cf"} Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.485567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" event={"ID":"c289fd13-6b14-4e1b-a7ba-a80609f67b50","Type":"ContainerStarted","Data":"c29f81e3064c2fc720d4224b374154c0c949bc2862f8f6bf811ad22583a6b4a5"} Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.485606 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.492375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerStarted","Data":"2c966ba78741a30da78df96f078611ead8dc0b707a4c051f69bbf98efddcd714"} Nov 21 12:49:42 crc kubenswrapper[4769]: I1121 12:49:42.504210 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" podStartSLOduration=2.504184364 podStartE2EDuration="2.504184364s" podCreationTimestamp="2025-11-21 12:49:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:42.502346153 +0000 UTC m=+3541.203007971" watchObservedRunningTime="2025-11-21 12:49:42.504184364 +0000 UTC m=+3541.204857732" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.161736 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5d976fd77c-mvv95"] Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.170388 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.178748 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.178929 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.181288 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5d976fd77c-mvv95"] Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.233995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-config\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.234042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-internal-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.234093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-ovndb-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.234227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-public-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.234518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-combined-ca-bundle\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.234597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcrd8\" (UniqueName: \"kubernetes.io/projected/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-kube-api-access-jcrd8\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.234707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-httpd-config\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.301170 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34a4977-7095-46dd-b67b-f1350b8d6e71" path="/var/lib/kubelet/pods/d34a4977-7095-46dd-b67b-f1350b8d6e71/volumes" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-ovndb-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336306 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-public-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-combined-ca-bundle\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jcrd8\" (UniqueName: \"kubernetes.io/projected/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-kube-api-access-jcrd8\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-httpd-config\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-config\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.336510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-internal-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.339319 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.339620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.341536 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-config\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.344147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-ovndb-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.344655 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-combined-ca-bundle\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.349767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-httpd-config\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.353774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-public-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.354394 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-internal-tls-certs\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.355123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcrd8\" (UniqueName: \"kubernetes.io/projected/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-kube-api-access-jcrd8\") pod \"neutron-5d976fd77c-mvv95\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.503501 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:43 crc kubenswrapper[4769]: I1121 12:49:43.561234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerStarted","Data":"c9f25f7b58f2b214420ba3902aaacc67729bc24099f7643f8ebfecac08af7316"} Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:43.806540 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:43.931702 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:43.987842 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-8559b84c95-qswr6"] Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:43.988071 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api-log" containerID="cri-o://ac1d28f6a30651500d68da8d2c890eabacee90404daebf055d65bfc1c71f765d" gracePeriod=30 Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:43.988474 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api" containerID="cri-o://e3a7f70262734abaefda74e103f8ed7d134dbd726f9d6d6125eee86de39036e8" gracePeriod=30 Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:44.006934 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.98:9311/healthcheck\": EOF" Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:44.007328 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.98:9311/healthcheck\": EOF" Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:44.571175 4769 generic.go:334] "Generic (PLEG): container finished" podID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerID="ac1d28f6a30651500d68da8d2c890eabacee90404daebf055d65bfc1c71f765d" exitCode=143 Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:44.571433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" event={"ID":"dfafd1b8-1f52-406b-87f6-0e243841e3bf","Type":"ContainerDied","Data":"ac1d28f6a30651500d68da8d2c890eabacee90404daebf055d65bfc1c71f765d"} Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:44.575719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerStarted","Data":"c76d0fc31a5f2b3491cef248bb6e9202cec9d4c7115e247c897efe656fe502c2"} Nov 21 12:49:45 crc kubenswrapper[4769]: I1121 12:49:44.616036 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.616019684 podStartE2EDuration="3.616019684s" podCreationTimestamp="2025-11-21 12:49:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:44.606756302 +0000 UTC m=+3543.307418120" watchObservedRunningTime="2025-11-21 12:49:44.616019684 +0000 UTC m=+3543.316681492" Nov 21 12:49:46 crc kubenswrapper[4769]: W1121 12:49:46.096975 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd529a0c_32c3_48c4_b835_f0ac206ec2d9.slice/crio-c71550174a9ea210d2ef0071b0d23a2a9d854dea5ee7b0a2f045c81f4e9337de WatchSource:0}: Error finding container c71550174a9ea210d2ef0071b0d23a2a9d854dea5ee7b0a2f045c81f4e9337de: Status 404 returned error can't find the container with id c71550174a9ea210d2ef0071b0d23a2a9d854dea5ee7b0a2f045c81f4e9337de Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.103319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5d976fd77c-mvv95"] Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.612147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" event={"ID":"cd529a0c-32c3-48c4-b835-f0ac206ec2d9","Type":"ContainerStarted","Data":"f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e"} Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.612584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" event={"ID":"cd529a0c-32c3-48c4-b835-f0ac206ec2d9","Type":"ContainerStarted","Data":"a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288"} Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.612609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" event={"ID":"cd529a0c-32c3-48c4-b835-f0ac206ec2d9","Type":"ContainerStarted","Data":"c71550174a9ea210d2ef0071b0d23a2a9d854dea5ee7b0a2f045c81f4e9337de"} Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.612681 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.640014 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" podStartSLOduration=3.639991202 podStartE2EDuration="3.639991202s" podCreationTimestamp="2025-11-21 12:49:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:49:46.62851189 +0000 UTC m=+3545.329173728" watchObservedRunningTime="2025-11-21 12:49:46.639991202 +0000 UTC m=+3545.340653030" Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.759969 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:49:46 crc kubenswrapper[4769]: I1121 12:49:46.856118 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.164837 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.98:9311/healthcheck\": read tcp 10.217.0.2:43132->10.217.1.98:9311: read: connection reset by peer" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.164843 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.98:9311/healthcheck\": read tcp 10.217.0.2:43140->10.217.1.98:9311: read: connection reset by peer" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.629278 4769 generic.go:334] "Generic (PLEG): container finished" podID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerID="e3a7f70262734abaefda74e103f8ed7d134dbd726f9d6d6125eee86de39036e8" exitCode=0 Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.629358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" event={"ID":"dfafd1b8-1f52-406b-87f6-0e243841e3bf","Type":"ContainerDied","Data":"e3a7f70262734abaefda74e103f8ed7d134dbd726f9d6d6125eee86de39036e8"} Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.629605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" event={"ID":"dfafd1b8-1f52-406b-87f6-0e243841e3bf","Type":"ContainerDied","Data":"a859d881c454e664b88e9e869bcca3de3d3630931dc2c91ebc97a7df6af3fcc8"} Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.629628 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a859d881c454e664b88e9e869bcca3de3d3630931dc2c91ebc97a7df6af3fcc8" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.651787 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.738685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data-custom\") pod \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.738996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data\") pod \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.739162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-combined-ca-bundle\") pod \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.739290 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dfafd1b8-1f52-406b-87f6-0e243841e3bf-logs\") pod \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.739395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rz6p\" (UniqueName: \"kubernetes.io/projected/dfafd1b8-1f52-406b-87f6-0e243841e3bf-kube-api-access-2rz6p\") pod \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\" (UID: \"dfafd1b8-1f52-406b-87f6-0e243841e3bf\") " Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.740275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfafd1b8-1f52-406b-87f6-0e243841e3bf-logs" (OuterVolumeSpecName: "logs") pod "dfafd1b8-1f52-406b-87f6-0e243841e3bf" (UID: "dfafd1b8-1f52-406b-87f6-0e243841e3bf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.751619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dfafd1b8-1f52-406b-87f6-0e243841e3bf" (UID: "dfafd1b8-1f52-406b-87f6-0e243841e3bf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.752624 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dfafd1b8-1f52-406b-87f6-0e243841e3bf-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.752968 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.754342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfafd1b8-1f52-406b-87f6-0e243841e3bf-kube-api-access-2rz6p" (OuterVolumeSpecName: "kube-api-access-2rz6p") pod "dfafd1b8-1f52-406b-87f6-0e243841e3bf" (UID: "dfafd1b8-1f52-406b-87f6-0e243841e3bf"). InnerVolumeSpecName "kube-api-access-2rz6p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.788008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dfafd1b8-1f52-406b-87f6-0e243841e3bf" (UID: "dfafd1b8-1f52-406b-87f6-0e243841e3bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.808346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data" (OuterVolumeSpecName: "config-data") pod "dfafd1b8-1f52-406b-87f6-0e243841e3bf" (UID: "dfafd1b8-1f52-406b-87f6-0e243841e3bf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.855083 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.855120 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dfafd1b8-1f52-406b-87f6-0e243841e3bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:47 crc kubenswrapper[4769]: I1121 12:49:47.855134 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2rz6p\" (UniqueName: \"kubernetes.io/projected/dfafd1b8-1f52-406b-87f6-0e243841e3bf-kube-api-access-2rz6p\") on node \"crc\" DevicePath \"\"" Nov 21 12:49:48 crc kubenswrapper[4769]: I1121 12:49:48.640143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-8559b84c95-qswr6" Nov 21 12:49:48 crc kubenswrapper[4769]: I1121 12:49:48.671947 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-8559b84c95-qswr6"] Nov 21 12:49:48 crc kubenswrapper[4769]: I1121 12:49:48.691481 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-8559b84c95-qswr6"] Nov 21 12:49:49 crc kubenswrapper[4769]: I1121 12:49:49.294773 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" path="/var/lib/kubelet/pods/dfafd1b8-1f52-406b-87f6-0e243841e3bf/volumes" Nov 21 12:49:50 crc kubenswrapper[4769]: I1121 12:49:50.332559 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:50 crc kubenswrapper[4769]: I1121 12:49:50.727142 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:49:51 crc kubenswrapper[4769]: I1121 12:49:51.031415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:49:52 crc kubenswrapper[4769]: I1121 12:49:52.078601 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:49:58 crc kubenswrapper[4769]: I1121 12:49:58.038947 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.646664 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4"] Nov 21 12:50:01 crc kubenswrapper[4769]: E1121 12:50:01.647421 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api-log" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.647437 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api-log" Nov 21 12:50:01 crc kubenswrapper[4769]: E1121 12:50:01.647458 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.647466 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.647669 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api-log" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.647684 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dfafd1b8-1f52-406b-87f6-0e243841e3bf" containerName="barbican-api" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.648812 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.653763 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.654059 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.654311 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.658084 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4"] Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743351 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9m9\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-kube-api-access-xx9m9\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-etc-swift\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-combined-ca-bundle\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-run-httpd\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-public-tls-certs\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743568 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-internal-tls-certs\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-config-data\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.743615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-log-httpd\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-internal-tls-certs\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845166 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-config-data\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845201 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-log-httpd\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9m9\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-kube-api-access-xx9m9\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-etc-swift\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-combined-ca-bundle\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-run-httpd\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.845360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-public-tls-certs\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.846466 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-run-httpd\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.846699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-log-httpd\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.851708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-internal-tls-certs\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.851820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-public-tls-certs\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.851978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-etc-swift\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.853040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-config-data\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.855813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-combined-ca-bundle\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.866937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9m9\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-kube-api-access-xx9m9\") pod \"swift-proxy-66667fb49-bqwl4\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:01 crc kubenswrapper[4769]: I1121 12:50:01.974998 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.507576 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4"] Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.787585 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.788269 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-central-agent" containerID="cri-o://d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305" gracePeriod=30 Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.788333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="sg-core" containerID="cri-o://0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b" gracePeriod=30 Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.788444 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-notification-agent" containerID="cri-o://d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a" gracePeriod=30 Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.788528 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="proxy-httpd" containerID="cri-o://db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528" gracePeriod=30 Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.819525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" event={"ID":"263ef7b9-093f-464d-96b8-515171a2d93c","Type":"ContainerStarted","Data":"e443bde35cc5c72a9d863814eea6feb91d2e9e7e0af2b2bb509ab3d14afe8b01"} Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.819950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" event={"ID":"263ef7b9-093f-464d-96b8-515171a2d93c","Type":"ContainerStarted","Data":"b792da0f6383416d5d9cdc5c94a908c852125ae88b2215f5e4590462d961fc70"} Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.919226 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.921405 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.924531 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-pbzds" Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.924708 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.924889 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:50:02 crc kubenswrapper[4769]: I1121 12:50:02.930531 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.065790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config-secret\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.065868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-combined-ca-bundle\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.065910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.066006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9s7k\" (UniqueName: \"kubernetes.io/projected/f0778bb1-d136-493d-8628-7836f4dcb341-kube-api-access-p9s7k\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.168020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config-secret\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.168093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-combined-ca-bundle\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.168129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.168271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p9s7k\" (UniqueName: \"kubernetes.io/projected/f0778bb1-d136-493d-8628-7836f4dcb341-kube-api-access-p9s7k\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.172004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.176744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config-secret\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.192803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-combined-ca-bundle\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.196107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9s7k\" (UniqueName: \"kubernetes.io/projected/f0778bb1-d136-493d-8628-7836f4dcb341-kube-api-access-p9s7k\") pod \"openstackclient\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.303795 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.756419 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:50:03 crc kubenswrapper[4769]: W1121 12:50:03.759827 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0778bb1_d136_493d_8628_7836f4dcb341.slice/crio-52a63a94543ab70987d27231c6126c79b3f344a40d93003ed8e68d8b323c1127 WatchSource:0}: Error finding container 52a63a94543ab70987d27231c6126c79b3f344a40d93003ed8e68d8b323c1127: Status 404 returned error can't find the container with id 52a63a94543ab70987d27231c6126c79b3f344a40d93003ed8e68d8b323c1127 Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.833138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" event={"ID":"263ef7b9-093f-464d-96b8-515171a2d93c","Type":"ContainerStarted","Data":"bef5aac01593326ea08b3a1560628380143c94bfdad8949356e08ca13749ec81"} Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.834486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"f0778bb1-d136-493d-8628-7836f4dcb341","Type":"ContainerStarted","Data":"52a63a94543ab70987d27231c6126c79b3f344a40d93003ed8e68d8b323c1127"} Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.837862 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c736e2e-616d-4dae-a715-1eda548fe728" containerID="db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528" exitCode=0 Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.837905 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c736e2e-616d-4dae-a715-1eda548fe728" containerID="0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b" exitCode=2 Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.837918 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c736e2e-616d-4dae-a715-1eda548fe728" containerID="d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305" exitCode=0 Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.837924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerDied","Data":"db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528"} Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.837955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerDied","Data":"0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b"} Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.837969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerDied","Data":"d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305"} Nov 21 12:50:03 crc kubenswrapper[4769]: I1121 12:50:03.850123 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" podStartSLOduration=2.850091849 podStartE2EDuration="2.850091849s" podCreationTimestamp="2025-11-21 12:50:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:03.848642779 +0000 UTC m=+3562.549304597" watchObservedRunningTime="2025-11-21 12:50:03.850091849 +0000 UTC m=+3562.550753677" Nov 21 12:50:04 crc kubenswrapper[4769]: I1121 12:50:04.855276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"f0778bb1-d136-493d-8628-7836f4dcb341","Type":"ContainerStarted","Data":"7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6"} Nov 21 12:50:04 crc kubenswrapper[4769]: I1121 12:50:04.856061 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:04 crc kubenswrapper[4769]: I1121 12:50:04.856105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:04 crc kubenswrapper[4769]: I1121 12:50:04.877774 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.877750625 podStartE2EDuration="2.877750625s" podCreationTimestamp="2025-11-21 12:50:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:04.869819199 +0000 UTC m=+3563.570481057" watchObservedRunningTime="2025-11-21 12:50:04.877750625 +0000 UTC m=+3563.578412483" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.517642 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-log-httpd\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-sg-core-conf-yaml\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-run-httpd\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kqvr\" (UniqueName: \"kubernetes.io/projected/8c736e2e-616d-4dae-a715-1eda548fe728-kube-api-access-8kqvr\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-scripts\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-config-data\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-combined-ca-bundle\") pod \"8c736e2e-616d-4dae-a715-1eda548fe728\" (UID: \"8c736e2e-616d-4dae-a715-1eda548fe728\") " Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.642802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.643762 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.643795 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8c736e2e-616d-4dae-a715-1eda548fe728-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.647983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c736e2e-616d-4dae-a715-1eda548fe728-kube-api-access-8kqvr" (OuterVolumeSpecName: "kube-api-access-8kqvr") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "kube-api-access-8kqvr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.650974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-scripts" (OuterVolumeSpecName: "scripts") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.671943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.730924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.746773 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.747033 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.747099 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.747163 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8kqvr\" (UniqueName: \"kubernetes.io/projected/8c736e2e-616d-4dae-a715-1eda548fe728-kube-api-access-8kqvr\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.772705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-config-data" (OuterVolumeSpecName: "config-data") pod "8c736e2e-616d-4dae-a715-1eda548fe728" (UID: "8c736e2e-616d-4dae-a715-1eda548fe728"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.848796 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c736e2e-616d-4dae-a715-1eda548fe728-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.879610 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c736e2e-616d-4dae-a715-1eda548fe728" containerID="d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a" exitCode=0 Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.879663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerDied","Data":"d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a"} Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.879690 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.879717 4769 scope.go:117] "RemoveContainer" containerID="db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.879703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8c736e2e-616d-4dae-a715-1eda548fe728","Type":"ContainerDied","Data":"23f73e7eb9228382116573e3fa96556e265db5ec6e980726d2fbc6610e94fa38"} Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.914804 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.921061 4769 scope.go:117] "RemoveContainer" containerID="0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.924091 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.943955 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:06 crc kubenswrapper[4769]: E1121 12:50:06.945964 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-central-agent" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.945992 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-central-agent" Nov 21 12:50:06 crc kubenswrapper[4769]: E1121 12:50:06.946025 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="sg-core" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946033 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="sg-core" Nov 21 12:50:06 crc kubenswrapper[4769]: E1121 12:50:06.946066 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-notification-agent" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946074 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-notification-agent" Nov 21 12:50:06 crc kubenswrapper[4769]: E1121 12:50:06.946097 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="proxy-httpd" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946104 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="proxy-httpd" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946359 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="proxy-httpd" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946379 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-central-agent" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946389 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="sg-core" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.946418 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" containerName="ceilometer-notification-agent" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.951485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.954052 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.956619 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.956707 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:50:06 crc kubenswrapper[4769]: I1121 12:50:06.962678 4769 scope.go:117] "RemoveContainer" containerID="d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.001914 4769 scope.go:117] "RemoveContainer" containerID="d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.024473 4769 scope.go:117] "RemoveContainer" containerID="db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528" Nov 21 12:50:07 crc kubenswrapper[4769]: E1121 12:50:07.024894 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528\": container with ID starting with db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528 not found: ID does not exist" containerID="db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.024923 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528"} err="failed to get container status \"db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528\": rpc error: code = NotFound desc = could not find container \"db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528\": container with ID starting with db2a9db9c9ba35a9fda177967c1321161f82c93b8aba857ed105689b79cf1528 not found: ID does not exist" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.024946 4769 scope.go:117] "RemoveContainer" containerID="0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b" Nov 21 12:50:07 crc kubenswrapper[4769]: E1121 12:50:07.026491 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b\": container with ID starting with 0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b not found: ID does not exist" containerID="0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.026545 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b"} err="failed to get container status \"0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b\": rpc error: code = NotFound desc = could not find container \"0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b\": container with ID starting with 0d55156c6a293a7455e5d586082690aa6e98f6415bf4a5ff34b075ead86fe14b not found: ID does not exist" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.026581 4769 scope.go:117] "RemoveContainer" containerID="d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a" Nov 21 12:50:07 crc kubenswrapper[4769]: E1121 12:50:07.026870 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a\": container with ID starting with d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a not found: ID does not exist" containerID="d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.026895 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a"} err="failed to get container status \"d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a\": rpc error: code = NotFound desc = could not find container \"d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a\": container with ID starting with d1ac7eb6ca9db040a3584ae63546a667cb65c8895e8aaa91431e3f791ff0e60a not found: ID does not exist" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.026909 4769 scope.go:117] "RemoveContainer" containerID="d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305" Nov 21 12:50:07 crc kubenswrapper[4769]: E1121 12:50:07.027303 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305\": container with ID starting with d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305 not found: ID does not exist" containerID="d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.027321 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305"} err="failed to get container status \"d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305\": rpc error: code = NotFound desc = could not find container \"d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305\": container with ID starting with d6ccf14943c1b3c8a6bcc8d6d8da753870fa3ad14f979e94251b57b43e572305 not found: ID does not exist" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.154782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.154936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-run-httpd\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.155236 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-log-httpd\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.155331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-scripts\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.155510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.155598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-config-data\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.155707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8t7\" (UniqueName: \"kubernetes.io/projected/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-kube-api-access-jw8t7\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-log-httpd\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-scripts\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-config-data\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8t7\" (UniqueName: \"kubernetes.io/projected/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-kube-api-access-jw8t7\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.257899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-run-httpd\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.258492 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-log-httpd\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.259481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-run-httpd\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.264916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.265274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-config-data\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.265829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.266379 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-scripts\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.280526 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8t7\" (UniqueName: \"kubernetes.io/projected/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-kube-api-access-jw8t7\") pod \"ceilometer-0\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.292145 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c736e2e-616d-4dae-a715-1eda548fe728" path="/var/lib/kubelet/pods/8c736e2e-616d-4dae-a715-1eda548fe728/volumes" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.294367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.736257 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.736942 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:50:07 crc kubenswrapper[4769]: I1121 12:50:07.892613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerStarted","Data":"a43e15d7839ea139a7f8d4cb33b6ff97a04f4908f0cc1afe4d68a84bccbc9bbf"} Nov 21 12:50:08 crc kubenswrapper[4769]: I1121 12:50:08.914014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerStarted","Data":"8933a0712099de75728e7e8db188676a9fa4fb272412f70557ffbb2df1e03f91"} Nov 21 12:50:09 crc kubenswrapper[4769]: I1121 12:50:09.942423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerStarted","Data":"ea4b142b7f6e56b03bff3b8b26c9b64e62de2d85817d06e9d10684dc1cbf5984"} Nov 21 12:50:10 crc kubenswrapper[4769]: I1121 12:50:10.955558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerStarted","Data":"c3e1572784f327d400712b3bc6a8708d34382dd15fab0a9dfd1e5cc385c3b86f"} Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.068585 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.325222 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.325601 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.325657 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.326567 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"6450126284f2853982969dd408b7da0c051c6c8c0e976974a4cad5517598b69f"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.326645 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://6450126284f2853982969dd408b7da0c051c6c8c0e976974a4cad5517598b69f" gracePeriod=600 Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.908870 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.971622 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="6450126284f2853982969dd408b7da0c051c6c8c0e976974a4cad5517598b69f" exitCode=0 Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.971674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"6450126284f2853982969dd408b7da0c051c6c8c0e976974a4cad5517598b69f"} Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.971750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d"} Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.971776 4769 scope.go:117] "RemoveContainer" containerID="08562dd4e4b3bce8ea975effe7dd20563a358f0ecb47396bda3e3bb9c2cd6d05" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.976990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerStarted","Data":"982b649a3afce49266a3e1a1d1d1159a5d50005efe139ccba80edc41c8df7190"} Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.977086 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.990295 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:11 crc kubenswrapper[4769]: I1121 12:50:11.994875 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:50:12 crc kubenswrapper[4769]: I1121 12:50:12.017155 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.520054979 podStartE2EDuration="6.017130932s" podCreationTimestamp="2025-11-21 12:50:06 +0000 UTC" firstStartedPulling="2025-11-21 12:50:07.736426381 +0000 UTC m=+3566.437088209" lastFinishedPulling="2025-11-21 12:50:11.233502344 +0000 UTC m=+3569.934164162" observedRunningTime="2025-11-21 12:50:12.010050419 +0000 UTC m=+3570.710712277" watchObservedRunningTime="2025-11-21 12:50:12.017130932 +0000 UTC m=+3570.717792780" Nov 21 12:50:12 crc kubenswrapper[4769]: I1121 12:50:12.990321 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-central-agent" containerID="cri-o://8933a0712099de75728e7e8db188676a9fa4fb272412f70557ffbb2df1e03f91" gracePeriod=30 Nov 21 12:50:12 crc kubenswrapper[4769]: I1121 12:50:12.995176 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="proxy-httpd" containerID="cri-o://982b649a3afce49266a3e1a1d1d1159a5d50005efe139ccba80edc41c8df7190" gracePeriod=30 Nov 21 12:50:12 crc kubenswrapper[4769]: I1121 12:50:12.995358 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="sg-core" containerID="cri-o://c3e1572784f327d400712b3bc6a8708d34382dd15fab0a9dfd1e5cc385c3b86f" gracePeriod=30 Nov 21 12:50:12 crc kubenswrapper[4769]: I1121 12:50:12.995413 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-notification-agent" containerID="cri-o://ea4b142b7f6e56b03bff3b8b26c9b64e62de2d85817d06e9d10684dc1cbf5984" gracePeriod=30 Nov 21 12:50:13 crc kubenswrapper[4769]: E1121 12:50:13.183157 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e5fcd9e_4e5b_461d_8b06_b504041d47ae.slice/crio-conmon-982b649a3afce49266a3e1a1d1d1159a5d50005efe139ccba80edc41c8df7190.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e5fcd9e_4e5b_461d_8b06_b504041d47ae.slice/crio-c3e1572784f327d400712b3bc6a8708d34382dd15fab0a9dfd1e5cc385c3b86f.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:50:13 crc kubenswrapper[4769]: I1121 12:50:13.517972 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:50:13 crc kubenswrapper[4769]: I1121 12:50:13.612466 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5cf7b496c4-djs87"] Nov 21 12:50:13 crc kubenswrapper[4769]: I1121 12:50:13.612758 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-api" containerID="cri-o://75ddde4ab414b04db3c6011a307107f8aa9db7e0e7f8204ddabaec3e114446cf" gracePeriod=30 Nov 21 12:50:13 crc kubenswrapper[4769]: I1121 12:50:13.612913 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-httpd" containerID="cri-o://d5ca73a0a3d8fea095b80f2b3d0086e2f9cfcf022ce9f4f16ab08905d1f56385" gracePeriod=30 Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007071 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerID="982b649a3afce49266a3e1a1d1d1159a5d50005efe139ccba80edc41c8df7190" exitCode=0 Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007362 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerID="c3e1572784f327d400712b3bc6a8708d34382dd15fab0a9dfd1e5cc385c3b86f" exitCode=2 Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007371 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerID="ea4b142b7f6e56b03bff3b8b26c9b64e62de2d85817d06e9d10684dc1cbf5984" exitCode=0 Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007377 4769 generic.go:334] "Generic (PLEG): container finished" podID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerID="8933a0712099de75728e7e8db188676a9fa4fb272412f70557ffbb2df1e03f91" exitCode=0 Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerDied","Data":"982b649a3afce49266a3e1a1d1d1159a5d50005efe139ccba80edc41c8df7190"} Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerDied","Data":"c3e1572784f327d400712b3bc6a8708d34382dd15fab0a9dfd1e5cc385c3b86f"} Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerDied","Data":"ea4b142b7f6e56b03bff3b8b26c9b64e62de2d85817d06e9d10684dc1cbf5984"} Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.007489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerDied","Data":"8933a0712099de75728e7e8db188676a9fa4fb272412f70557ffbb2df1e03f91"} Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.018090 4769 generic.go:334] "Generic (PLEG): container finished" podID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerID="d5ca73a0a3d8fea095b80f2b3d0086e2f9cfcf022ce9f4f16ab08905d1f56385" exitCode=0 Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.018231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" event={"ID":"c289fd13-6b14-4e1b-a7ba-a80609f67b50","Type":"ContainerDied","Data":"d5ca73a0a3d8fea095b80f2b3d0086e2f9cfcf022ce9f4f16ab08905d1f56385"} Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.406372 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-config-data\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-sg-core-conf-yaml\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-log-httpd\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-scripts\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-run-httpd\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-combined-ca-bundle\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.523758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw8t7\" (UniqueName: \"kubernetes.io/projected/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-kube-api-access-jw8t7\") pod \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\" (UID: \"1e5fcd9e-4e5b-461d-8b06-b504041d47ae\") " Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.524410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.524781 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.530390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-kube-api-access-jw8t7" (OuterVolumeSpecName: "kube-api-access-jw8t7") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "kube-api-access-jw8t7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.530462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-scripts" (OuterVolumeSpecName: "scripts") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.557728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.613312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.619273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-config-data" (OuterVolumeSpecName: "config-data") pod "1e5fcd9e-4e5b-461d-8b06-b504041d47ae" (UID: "1e5fcd9e-4e5b-461d-8b06-b504041d47ae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625536 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jw8t7\" (UniqueName: \"kubernetes.io/projected/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-kube-api-access-jw8t7\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625558 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625569 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625579 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625587 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625595 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:14 crc kubenswrapper[4769]: I1121 12:50:14.625603 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e5fcd9e-4e5b-461d-8b06-b504041d47ae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.045513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1e5fcd9e-4e5b-461d-8b06-b504041d47ae","Type":"ContainerDied","Data":"a43e15d7839ea139a7f8d4cb33b6ff97a04f4908f0cc1afe4d68a84bccbc9bbf"} Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.045566 4769 scope.go:117] "RemoveContainer" containerID="982b649a3afce49266a3e1a1d1d1159a5d50005efe139ccba80edc41c8df7190" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.045732 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.084041 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.094728 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.096003 4769 scope.go:117] "RemoveContainer" containerID="c3e1572784f327d400712b3bc6a8708d34382dd15fab0a9dfd1e5cc385c3b86f" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109137 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:15 crc kubenswrapper[4769]: E1121 12:50:15.109523 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="sg-core" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109541 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="sg-core" Nov 21 12:50:15 crc kubenswrapper[4769]: E1121 12:50:15.109560 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="proxy-httpd" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109579 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="proxy-httpd" Nov 21 12:50:15 crc kubenswrapper[4769]: E1121 12:50:15.109607 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-notification-agent" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109614 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-notification-agent" Nov 21 12:50:15 crc kubenswrapper[4769]: E1121 12:50:15.109628 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-central-agent" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109635 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-central-agent" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="proxy-httpd" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109816 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-notification-agent" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109824 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="ceilometer-central-agent" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.109837 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" containerName="sg-core" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.111339 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.113382 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.113698 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.124125 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.128945 4769 scope.go:117] "RemoveContainer" containerID="ea4b142b7f6e56b03bff3b8b26c9b64e62de2d85817d06e9d10684dc1cbf5984" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147354 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-config-data\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-scripts\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-log-httpd\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjj7\" (UniqueName: \"kubernetes.io/projected/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-kube-api-access-bdjj7\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147653 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-run-httpd\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.147696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.217398 4769 scope.go:117] "RemoveContainer" containerID="8933a0712099de75728e7e8db188676a9fa4fb272412f70557ffbb2df1e03f91" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjj7\" (UniqueName: \"kubernetes.io/projected/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-kube-api-access-bdjj7\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-run-httpd\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-config-data\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-scripts\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.248723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-log-httpd\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.249117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-log-httpd\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.249596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-run-httpd\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.259204 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.261140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-config-data\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.264837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-scripts\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.267640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.292206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjj7\" (UniqueName: \"kubernetes.io/projected/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-kube-api-access-bdjj7\") pod \"ceilometer-0\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.302106 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e5fcd9e-4e5b-461d-8b06-b504041d47ae" path="/var/lib/kubelet/pods/1e5fcd9e-4e5b-461d-8b06-b504041d47ae/volumes" Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.445739 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:15 crc kubenswrapper[4769]: W1121 12:50:15.926538 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddb4c3aa_9953_43a3_ac4a_8633e1df528d.slice/crio-2af311e9de1d55920ff80957f1ab9875ce4da2740ae65e10a826d25f285e3456 WatchSource:0}: Error finding container 2af311e9de1d55920ff80957f1ab9875ce4da2740ae65e10a826d25f285e3456: Status 404 returned error can't find the container with id 2af311e9de1d55920ff80957f1ab9875ce4da2740ae65e10a826d25f285e3456 Nov 21 12:50:15 crc kubenswrapper[4769]: I1121 12:50:15.938376 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:16 crc kubenswrapper[4769]: I1121 12:50:16.068843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerStarted","Data":"2af311e9de1d55920ff80957f1ab9875ce4da2740ae65e10a826d25f285e3456"} Nov 21 12:50:16 crc kubenswrapper[4769]: I1121 12:50:16.070652 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:17 crc kubenswrapper[4769]: I1121 12:50:17.080989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerStarted","Data":"c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b"} Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.102786 4769 generic.go:334] "Generic (PLEG): container finished" podID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerID="75ddde4ab414b04db3c6011a307107f8aa9db7e0e7f8204ddabaec3e114446cf" exitCode=0 Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.102889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" event={"ID":"c289fd13-6b14-4e1b-a7ba-a80609f67b50","Type":"ContainerDied","Data":"75ddde4ab414b04db3c6011a307107f8aa9db7e0e7f8204ddabaec3e114446cf"} Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.347074 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.437614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-combined-ca-bundle\") pod \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.437684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xbkj\" (UniqueName: \"kubernetes.io/projected/c289fd13-6b14-4e1b-a7ba-a80609f67b50-kube-api-access-7xbkj\") pod \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.437758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-httpd-config\") pod \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.438288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-ovndb-tls-certs\") pod \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.438924 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-config\") pod \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\" (UID: \"c289fd13-6b14-4e1b-a7ba-a80609f67b50\") " Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.448440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c289fd13-6b14-4e1b-a7ba-a80609f67b50-kube-api-access-7xbkj" (OuterVolumeSpecName: "kube-api-access-7xbkj") pod "c289fd13-6b14-4e1b-a7ba-a80609f67b50" (UID: "c289fd13-6b14-4e1b-a7ba-a80609f67b50"). InnerVolumeSpecName "kube-api-access-7xbkj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.448526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "c289fd13-6b14-4e1b-a7ba-a80609f67b50" (UID: "c289fd13-6b14-4e1b-a7ba-a80609f67b50"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.523242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c289fd13-6b14-4e1b-a7ba-a80609f67b50" (UID: "c289fd13-6b14-4e1b-a7ba-a80609f67b50"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.531099 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "c289fd13-6b14-4e1b-a7ba-a80609f67b50" (UID: "c289fd13-6b14-4e1b-a7ba-a80609f67b50"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.534050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-config" (OuterVolumeSpecName: "config") pod "c289fd13-6b14-4e1b-a7ba-a80609f67b50" (UID: "c289fd13-6b14-4e1b-a7ba-a80609f67b50"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.541510 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.541598 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.541654 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7xbkj\" (UniqueName: \"kubernetes.io/projected/c289fd13-6b14-4e1b-a7ba-a80609f67b50-kube-api-access-7xbkj\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.541705 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:18 crc kubenswrapper[4769]: I1121 12:50:18.541765 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c289fd13-6b14-4e1b-a7ba-a80609f67b50-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.122237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" event={"ID":"c289fd13-6b14-4e1b-a7ba-a80609f67b50","Type":"ContainerDied","Data":"c29f81e3064c2fc720d4224b374154c0c949bc2862f8f6bf811ad22583a6b4a5"} Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.122604 4769 scope.go:117] "RemoveContainer" containerID="d5ca73a0a3d8fea095b80f2b3d0086e2f9cfcf022ce9f4f16ab08905d1f56385" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.122800 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5cf7b496c4-djs87" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.131259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerStarted","Data":"d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25"} Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.131292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerStarted","Data":"49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628"} Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.188095 4769 scope.go:117] "RemoveContainer" containerID="75ddde4ab414b04db3c6011a307107f8aa9db7e0e7f8204ddabaec3e114446cf" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.194049 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5cf7b496c4-djs87"] Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.207034 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5cf7b496c4-djs87"] Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.287656 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" path="/var/lib/kubelet/pods/c289fd13-6b14-4e1b-a7ba-a80609f67b50/volumes" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.990032 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-qwpbd"] Nov 21 12:50:19 crc kubenswrapper[4769]: E1121 12:50:19.992908 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-httpd" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.992931 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-httpd" Nov 21 12:50:19 crc kubenswrapper[4769]: E1121 12:50:19.992989 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-api" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.992996 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-api" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.995404 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-api" Nov 21 12:50:19 crc kubenswrapper[4769]: I1121 12:50:19.995434 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c289fd13-6b14-4e1b-a7ba-a80609f67b50" containerName="neutron-httpd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.010925 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.077787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdlth\" (UniqueName: \"kubernetes.io/projected/baab1431-f6a9-46a0-9e49-106d35249cbd-kube-api-access-kdlth\") pod \"nova-api-db-create-qwpbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.077900 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/baab1431-f6a9-46a0-9e49-106d35249cbd-operator-scripts\") pod \"nova-api-db-create-qwpbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.082051 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-qwpbd"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.096671 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.097919 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.099872 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.107238 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.128955 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-9ns8w"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.130356 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.151408 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-9ns8w"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.197318 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abcc22af-63ef-46ba-8bc8-e55f3b80de47-operator-scripts\") pod \"nova-cell0-db-create-9ns8w\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.197374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/baab1431-f6a9-46a0-9e49-106d35249cbd-operator-scripts\") pod \"nova-api-db-create-qwpbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.197398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvtzq\" (UniqueName: \"kubernetes.io/projected/abcc22af-63ef-46ba-8bc8-e55f3b80de47-kube-api-access-qvtzq\") pod \"nova-cell0-db-create-9ns8w\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.197425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aba5690-4f73-457a-b14d-973f6c1f5395-operator-scripts\") pod \"nova-api-46ff-account-create-g9zp6\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.197462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76b4n\" (UniqueName: \"kubernetes.io/projected/3aba5690-4f73-457a-b14d-973f6c1f5395-kube-api-access-76b4n\") pod \"nova-api-46ff-account-create-g9zp6\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.197502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kdlth\" (UniqueName: \"kubernetes.io/projected/baab1431-f6a9-46a0-9e49-106d35249cbd-kube-api-access-kdlth\") pod \"nova-api-db-create-qwpbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.198632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/baab1431-f6a9-46a0-9e49-106d35249cbd-operator-scripts\") pod \"nova-api-db-create-qwpbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.217275 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-7510-account-create-pb586"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.218444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.219521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdlth\" (UniqueName: \"kubernetes.io/projected/baab1431-f6a9-46a0-9e49-106d35249cbd-kube-api-access-kdlth\") pod \"nova-api-db-create-qwpbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.230851 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7h698"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.231759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.231986 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.249235 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7h698"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.258275 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-7510-account-create-pb586"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-76b4n\" (UniqueName: \"kubernetes.io/projected/3aba5690-4f73-457a-b14d-973f6c1f5395-kube-api-access-76b4n\") pod \"nova-api-46ff-account-create-g9zp6\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwpdx\" (UniqueName: \"kubernetes.io/projected/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-kube-api-access-rwpdx\") pod \"nova-cell0-7510-account-create-pb586\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299748 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc090da1-c588-4970-9514-98d3bc33f04b-operator-scripts\") pod \"nova-cell1-db-create-7h698\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-operator-scripts\") pod \"nova-cell0-7510-account-create-pb586\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7297\" (UniqueName: \"kubernetes.io/projected/fc090da1-c588-4970-9514-98d3bc33f04b-kube-api-access-r7297\") pod \"nova-cell1-db-create-7h698\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abcc22af-63ef-46ba-8bc8-e55f3b80de47-operator-scripts\") pod \"nova-cell0-db-create-9ns8w\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qvtzq\" (UniqueName: \"kubernetes.io/projected/abcc22af-63ef-46ba-8bc8-e55f3b80de47-kube-api-access-qvtzq\") pod \"nova-cell0-db-create-9ns8w\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.299958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aba5690-4f73-457a-b14d-973f6c1f5395-operator-scripts\") pod \"nova-api-46ff-account-create-g9zp6\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.303426 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aba5690-4f73-457a-b14d-973f6c1f5395-operator-scripts\") pod \"nova-api-46ff-account-create-g9zp6\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.304668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abcc22af-63ef-46ba-8bc8-e55f3b80de47-operator-scripts\") pod \"nova-cell0-db-create-9ns8w\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.319930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-76b4n\" (UniqueName: \"kubernetes.io/projected/3aba5690-4f73-457a-b14d-973f6c1f5395-kube-api-access-76b4n\") pod \"nova-api-46ff-account-create-g9zp6\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.337726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvtzq\" (UniqueName: \"kubernetes.io/projected/abcc22af-63ef-46ba-8bc8-e55f3b80de47-kube-api-access-qvtzq\") pod \"nova-cell0-db-create-9ns8w\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.374364 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.380327 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.401605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rwpdx\" (UniqueName: \"kubernetes.io/projected/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-kube-api-access-rwpdx\") pod \"nova-cell0-7510-account-create-pb586\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.401659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc090da1-c588-4970-9514-98d3bc33f04b-operator-scripts\") pod \"nova-cell1-db-create-7h698\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.401689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-operator-scripts\") pod \"nova-cell0-7510-account-create-pb586\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.401722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r7297\" (UniqueName: \"kubernetes.io/projected/fc090da1-c588-4970-9514-98d3bc33f04b-kube-api-access-r7297\") pod \"nova-cell1-db-create-7h698\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.406833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc090da1-c588-4970-9514-98d3bc33f04b-operator-scripts\") pod \"nova-cell1-db-create-7h698\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.407440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-operator-scripts\") pod \"nova-cell0-7510-account-create-pb586\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.411358 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.412612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.412969 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.414645 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.423817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj"] Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.425830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwpdx\" (UniqueName: \"kubernetes.io/projected/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-kube-api-access-rwpdx\") pod \"nova-cell0-7510-account-create-pb586\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.427887 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7297\" (UniqueName: \"kubernetes.io/projected/fc090da1-c588-4970-9514-98d3bc33f04b-kube-api-access-r7297\") pod \"nova-cell1-db-create-7h698\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.435268 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.503044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cfww\" (UniqueName: \"kubernetes.io/projected/2c1dc109-1108-4203-972e-641585fb07dd-kube-api-access-5cfww\") pod \"nova-cell1-5f64-account-create-c7xxj\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.503248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c1dc109-1108-4203-972e-641585fb07dd-operator-scripts\") pod \"nova-cell1-5f64-account-create-c7xxj\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.604662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c1dc109-1108-4203-972e-641585fb07dd-operator-scripts\") pod \"nova-cell1-5f64-account-create-c7xxj\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.605411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5cfww\" (UniqueName: \"kubernetes.io/projected/2c1dc109-1108-4203-972e-641585fb07dd-kube-api-access-5cfww\") pod \"nova-cell1-5f64-account-create-c7xxj\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.605633 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c1dc109-1108-4203-972e-641585fb07dd-operator-scripts\") pod \"nova-cell1-5f64-account-create-c7xxj\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.627413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cfww\" (UniqueName: \"kubernetes.io/projected/2c1dc109-1108-4203-972e-641585fb07dd-kube-api-access-5cfww\") pod \"nova-cell1-5f64-account-create-c7xxj\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.720039 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.752227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.951687 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-qwpbd"] Nov 21 12:50:20 crc kubenswrapper[4769]: W1121 12:50:20.952930 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaab1431_f6a9_46a0_9e49_106d35249cbd.slice/crio-26e4304407f5db8a85a9eab1321ff001ecf3ac8c05e2df0390185947362dc934 WatchSource:0}: Error finding container 26e4304407f5db8a85a9eab1321ff001ecf3ac8c05e2df0390185947362dc934: Status 404 returned error can't find the container with id 26e4304407f5db8a85a9eab1321ff001ecf3ac8c05e2df0390185947362dc934 Nov 21 12:50:20 crc kubenswrapper[4769]: I1121 12:50:20.961197 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6"] Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.002081 4769 scope.go:117] "RemoveContainer" containerID="ce9fdef6c0d68a88473f9d579c11dcead4337c6b87a38a6ba7ae0a2d85e86841" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.044400 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-9ns8w"] Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.054053 4769 scope.go:117] "RemoveContainer" containerID="2016abda21e152de0ecf12b4a36864158a88c66c7855057f3e6bbc05174cdfcb" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.138779 4769 scope.go:117] "RemoveContainer" containerID="9e2e1cc67c6aa2e34674953ae3b8c63657f8647ec532fa841a91efb8df6a4e32" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.190730 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7h698"] Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.196768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" event={"ID":"3aba5690-4f73-457a-b14d-973f6c1f5395","Type":"ContainerStarted","Data":"928251ebe6beb7a36beed215eddbcfb548509329a33469468035d2dc9bf8d04f"} Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.207214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" event={"ID":"abcc22af-63ef-46ba-8bc8-e55f3b80de47","Type":"ContainerStarted","Data":"84b97869b8261bb54bf7f203483db3b71e7a09a771b09436d7789d4b6486d543"} Nov 21 12:50:21 crc kubenswrapper[4769]: W1121 12:50:21.208314 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc090da1_c588_4970_9514_98d3bc33f04b.slice/crio-cf2d9c1a9f1066d02dd13c75812f98d33ffd19cea771efd39ae4e2436fdc5cab WatchSource:0}: Error finding container cf2d9c1a9f1066d02dd13c75812f98d33ffd19cea771efd39ae4e2436fdc5cab: Status 404 returned error can't find the container with id cf2d9c1a9f1066d02dd13c75812f98d33ffd19cea771efd39ae4e2436fdc5cab Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.222100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerStarted","Data":"14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c"} Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.222281 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-central-agent" containerID="cri-o://c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b" gracePeriod=30 Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.222930 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.223315 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="proxy-httpd" containerID="cri-o://14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c" gracePeriod=30 Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.223367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="sg-core" containerID="cri-o://d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25" gracePeriod=30 Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.223401 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-notification-agent" containerID="cri-o://49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628" gracePeriod=30 Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.232676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" event={"ID":"baab1431-f6a9-46a0-9e49-106d35249cbd","Type":"ContainerStarted","Data":"0fb56b386db294ec7923b59452273e29b10e760c042f1517b01540a6fa6e3d8d"} Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.232731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" event={"ID":"baab1431-f6a9-46a0-9e49-106d35249cbd","Type":"ContainerStarted","Data":"26e4304407f5db8a85a9eab1321ff001ecf3ac8c05e2df0390185947362dc934"} Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.247958 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.095499172 podStartE2EDuration="6.247934403s" podCreationTimestamp="2025-11-21 12:50:15 +0000 UTC" firstStartedPulling="2025-11-21 12:50:15.930336095 +0000 UTC m=+3574.630997913" lastFinishedPulling="2025-11-21 12:50:20.082771316 +0000 UTC m=+3578.783433144" observedRunningTime="2025-11-21 12:50:21.24378132 +0000 UTC m=+3579.944443138" watchObservedRunningTime="2025-11-21 12:50:21.247934403 +0000 UTC m=+3579.948596221" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.269390 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" podStartSLOduration=2.269373706 podStartE2EDuration="2.269373706s" podCreationTimestamp="2025-11-21 12:50:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:21.263515897 +0000 UTC m=+3579.964177715" watchObservedRunningTime="2025-11-21 12:50:21.269373706 +0000 UTC m=+3579.970035514" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.297946 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj"] Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.305145 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-7510-account-create-pb586"] Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.321013 4769 scope.go:117] "RemoveContainer" containerID="3f6cc4b6ffc17a62e421e7a52b3224ce48159a28e12100f0bd18bfaf15f4b93f" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.395503 4769 scope.go:117] "RemoveContainer" containerID="310943124bf0bbcbe253b2098687aa33b54b9832b04b4abe740312903a89255c" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.519560 4769 scope.go:117] "RemoveContainer" containerID="30cc782af112ceea951508724584bd46c90baf4a451c6d555408ea545c2d69cb" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.570389 4769 scope.go:117] "RemoveContainer" containerID="49bc58f1831922623e18c3eb5c0bcf86a02b029c43c0c21eb6d1776361d42264" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.607053 4769 scope.go:117] "RemoveContainer" containerID="422269e23c92dba5a740e096f70b861938f38d732472b1771370d1a725668bdc" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.642812 4769 scope.go:117] "RemoveContainer" containerID="970ed70182aee5ce4e2e0a18af5f95caf9f7fe5a886215c9d7cd9823d6abc38d" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.667578 4769 scope.go:117] "RemoveContainer" containerID="e43fc4d47f13fba7663df675f878c9ab6d36809a417f4c19ea834263800b56fd" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.696158 4769 scope.go:117] "RemoveContainer" containerID="d5fa890706c9ea442d5afe145f6c33660280b36ecba95bc06852333fdc3815ff" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.718898 4769 scope.go:117] "RemoveContainer" containerID="d6315c0f5d8daa33be1e1d824d7147ececdab46a837961a0fba132147a505347" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.745756 4769 scope.go:117] "RemoveContainer" containerID="9aefa9d52d14027efe0407875f87a49569f3107d82fda1cdb5c326040e5fb813" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.770361 4769 scope.go:117] "RemoveContainer" containerID="a18368bbfd1881b256f49fcd5b14d901fb12e9968b865524c3ba12b9efabb776" Nov 21 12:50:21 crc kubenswrapper[4769]: I1121 12:50:21.808015 4769 scope.go:117] "RemoveContainer" containerID="0220fa21ea5b11a9c3a0df2b8315ef935464c5bb63f37079b7b694d11055311d" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.043536 4769 scope.go:117] "RemoveContainer" containerID="59e1fc7f0fa8035ce829c4a7744c642e0845202fe1efdff995f30af59bb71b31" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.073252 4769 scope.go:117] "RemoveContainer" containerID="8824b7792340149c4c9fb2e1937391f25caf1777f672a6724006184cd308b26e" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.098860 4769 scope.go:117] "RemoveContainer" containerID="3cb2cd9f4c9df0b7853358fb778c165f8dc9823664fc57673e388d2641665032" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.231522 4769 scope.go:117] "RemoveContainer" containerID="325a7dcb1b018b58b35a4a7571675839e68bd954c5247fe18ba378aacd177b7f" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.305321 4769 scope.go:117] "RemoveContainer" containerID="7bbc416028492f8eb5355869268ae90a7ca52406ef851c659a75310f6b1e5fb8" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.308556 4769 generic.go:334] "Generic (PLEG): container finished" podID="baab1431-f6a9-46a0-9e49-106d35249cbd" containerID="0fb56b386db294ec7923b59452273e29b10e760c042f1517b01540a6fa6e3d8d" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.308618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" event={"ID":"baab1431-f6a9-46a0-9e49-106d35249cbd","Type":"ContainerDied","Data":"0fb56b386db294ec7923b59452273e29b10e760c042f1517b01540a6fa6e3d8d"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.316255 4769 generic.go:334] "Generic (PLEG): container finished" podID="fc090da1-c588-4970-9514-98d3bc33f04b" containerID="c4de56e28cd44ecb2bdb76585cd221feb54425c53947e8de3afe782a1a09d445" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.316323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" event={"ID":"fc090da1-c588-4970-9514-98d3bc33f04b","Type":"ContainerDied","Data":"c4de56e28cd44ecb2bdb76585cd221feb54425c53947e8de3afe782a1a09d445"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.316355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" event={"ID":"fc090da1-c588-4970-9514-98d3bc33f04b","Type":"ContainerStarted","Data":"cf2d9c1a9f1066d02dd13c75812f98d33ffd19cea771efd39ae4e2436fdc5cab"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.321556 4769 generic.go:334] "Generic (PLEG): container finished" podID="2c1dc109-1108-4203-972e-641585fb07dd" containerID="284da0eb346dede0f830af4e8869ce60bff7ae98f60c261427997c925e5b4f92" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.321609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" event={"ID":"2c1dc109-1108-4203-972e-641585fb07dd","Type":"ContainerDied","Data":"284da0eb346dede0f830af4e8869ce60bff7ae98f60c261427997c925e5b4f92"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.321631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" event={"ID":"2c1dc109-1108-4203-972e-641585fb07dd","Type":"ContainerStarted","Data":"74fcd5d426b80febbd8aa6dc58a65f1bfea8215cde55c65e8a5bab9e68a33590"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.333683 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerID="14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.333712 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerID="d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25" exitCode=2 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.333744 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerID="49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.333786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerDied","Data":"14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.333836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerDied","Data":"d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.333847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerDied","Data":"49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.336152 4769 generic.go:334] "Generic (PLEG): container finished" podID="3aba5690-4f73-457a-b14d-973f6c1f5395" containerID="5f12e98b420fd8e7477dfc4fad1219f4ad0cbc314ceac732235637f1ea97730e" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.336219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" event={"ID":"3aba5690-4f73-457a-b14d-973f6c1f5395","Type":"ContainerDied","Data":"5f12e98b420fd8e7477dfc4fad1219f4ad0cbc314ceac732235637f1ea97730e"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.338557 4769 scope.go:117] "RemoveContainer" containerID="7562f740e26699884921a47916494594b3f11a00d0f7ad28b5268a217bf687d7" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.344451 4769 generic.go:334] "Generic (PLEG): container finished" podID="abcc22af-63ef-46ba-8bc8-e55f3b80de47" containerID="90d823ccf096d44fcd1d92e7007a34f8c95038430879673015a1a3c004c36038" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.344500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" event={"ID":"abcc22af-63ef-46ba-8bc8-e55f3b80de47","Type":"ContainerDied","Data":"90d823ccf096d44fcd1d92e7007a34f8c95038430879673015a1a3c004c36038"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.347650 4769 generic.go:334] "Generic (PLEG): container finished" podID="676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" containerID="ab130fcfe45ea91d21b37e21fa6d550c65960ce37adba2920d40b200027481b6" exitCode=0 Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.347693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" event={"ID":"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c","Type":"ContainerDied","Data":"ab130fcfe45ea91d21b37e21fa6d550c65960ce37adba2920d40b200027481b6"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.347749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" event={"ID":"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c","Type":"ContainerStarted","Data":"dbca2686bf64409571159885b98a9464128cd20fdb7b76ea76da14adf1d3a186"} Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.377515 4769 scope.go:117] "RemoveContainer" containerID="d3d1d7821d4449d88e497d1e36e71f5304a668b4bfe41add2dcfd48fec53c39e" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.437410 4769 scope.go:117] "RemoveContainer" containerID="a102f19576e8278c04097c765e8038b43688aa36f74c9a0da64f7e8e62ff3fbc" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.460148 4769 scope.go:117] "RemoveContainer" containerID="4d2a28c2254339f07a7ea550acb8a0e054f6fdf405bb0a62a8c0ee3f91e0c6e9" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.483520 4769 scope.go:117] "RemoveContainer" containerID="e822b0af2c56c3f010908425fefbce190734501e7f1a4342834e41f83f873b6f" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.512058 4769 scope.go:117] "RemoveContainer" containerID="087b08fd07cdd3c9330ecef6e74bc27c2ac91fb0ec98c9342fef7d071b560a3c" Nov 21 12:50:22 crc kubenswrapper[4769]: I1121 12:50:22.531504 4769 scope.go:117] "RemoveContainer" containerID="b9b55ae79098551e9db710cb10db51d68298684e3c1142e64326952f537d2852" Nov 21 12:50:23 crc kubenswrapper[4769]: I1121 12:50:23.862573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:23 crc kubenswrapper[4769]: I1121 12:50:23.963233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-operator-scripts\") pod \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " Nov 21 12:50:23 crc kubenswrapper[4769]: I1121 12:50:23.963691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwpdx\" (UniqueName: \"kubernetes.io/projected/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-kube-api-access-rwpdx\") pod \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\" (UID: \"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c\") " Nov 21 12:50:23 crc kubenswrapper[4769]: I1121 12:50:23.965510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" (UID: "676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:50:23 crc kubenswrapper[4769]: I1121 12:50:23.970006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-kube-api-access-rwpdx" (OuterVolumeSpecName: "kube-api-access-rwpdx") pod "676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" (UID: "676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c"). InnerVolumeSpecName "kube-api-access-rwpdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.021234 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.025757 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.039347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.045829 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.053667 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.069648 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.069907 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rwpdx\" (UniqueName: \"kubernetes.io/projected/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c-kube-api-access-rwpdx\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.170949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76b4n\" (UniqueName: \"kubernetes.io/projected/3aba5690-4f73-457a-b14d-973f6c1f5395-kube-api-access-76b4n\") pod \"3aba5690-4f73-457a-b14d-973f6c1f5395\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdlth\" (UniqueName: \"kubernetes.io/projected/baab1431-f6a9-46a0-9e49-106d35249cbd-kube-api-access-kdlth\") pod \"baab1431-f6a9-46a0-9e49-106d35249cbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvtzq\" (UniqueName: \"kubernetes.io/projected/abcc22af-63ef-46ba-8bc8-e55f3b80de47-kube-api-access-qvtzq\") pod \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7297\" (UniqueName: \"kubernetes.io/projected/fc090da1-c588-4970-9514-98d3bc33f04b-kube-api-access-r7297\") pod \"fc090da1-c588-4970-9514-98d3bc33f04b\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aba5690-4f73-457a-b14d-973f6c1f5395-operator-scripts\") pod \"3aba5690-4f73-457a-b14d-973f6c1f5395\" (UID: \"3aba5690-4f73-457a-b14d-973f6c1f5395\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc090da1-c588-4970-9514-98d3bc33f04b-operator-scripts\") pod \"fc090da1-c588-4970-9514-98d3bc33f04b\" (UID: \"fc090da1-c588-4970-9514-98d3bc33f04b\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abcc22af-63ef-46ba-8bc8-e55f3b80de47-operator-scripts\") pod \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\" (UID: \"abcc22af-63ef-46ba-8bc8-e55f3b80de47\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cfww\" (UniqueName: \"kubernetes.io/projected/2c1dc109-1108-4203-972e-641585fb07dd-kube-api-access-5cfww\") pod \"2c1dc109-1108-4203-972e-641585fb07dd\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/baab1431-f6a9-46a0-9e49-106d35249cbd-operator-scripts\") pod \"baab1431-f6a9-46a0-9e49-106d35249cbd\" (UID: \"baab1431-f6a9-46a0-9e49-106d35249cbd\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.171587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c1dc109-1108-4203-972e-641585fb07dd-operator-scripts\") pod \"2c1dc109-1108-4203-972e-641585fb07dd\" (UID: \"2c1dc109-1108-4203-972e-641585fb07dd\") " Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.172370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baab1431-f6a9-46a0-9e49-106d35249cbd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "baab1431-f6a9-46a0-9e49-106d35249cbd" (UID: "baab1431-f6a9-46a0-9e49-106d35249cbd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.172491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1dc109-1108-4203-972e-641585fb07dd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2c1dc109-1108-4203-972e-641585fb07dd" (UID: "2c1dc109-1108-4203-972e-641585fb07dd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.172529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aba5690-4f73-457a-b14d-973f6c1f5395-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3aba5690-4f73-457a-b14d-973f6c1f5395" (UID: "3aba5690-4f73-457a-b14d-973f6c1f5395"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.172556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abcc22af-63ef-46ba-8bc8-e55f3b80de47-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "abcc22af-63ef-46ba-8bc8-e55f3b80de47" (UID: "abcc22af-63ef-46ba-8bc8-e55f3b80de47"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.172997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc090da1-c588-4970-9514-98d3bc33f04b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fc090da1-c588-4970-9514-98d3bc33f04b" (UID: "fc090da1-c588-4970-9514-98d3bc33f04b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.173278 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abcc22af-63ef-46ba-8bc8-e55f3b80de47-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.173336 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/baab1431-f6a9-46a0-9e49-106d35249cbd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.173350 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c1dc109-1108-4203-972e-641585fb07dd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.173361 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3aba5690-4f73-457a-b14d-973f6c1f5395-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.173374 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc090da1-c588-4970-9514-98d3bc33f04b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.179321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aba5690-4f73-457a-b14d-973f6c1f5395-kube-api-access-76b4n" (OuterVolumeSpecName: "kube-api-access-76b4n") pod "3aba5690-4f73-457a-b14d-973f6c1f5395" (UID: "3aba5690-4f73-457a-b14d-973f6c1f5395"). InnerVolumeSpecName "kube-api-access-76b4n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.179358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abcc22af-63ef-46ba-8bc8-e55f3b80de47-kube-api-access-qvtzq" (OuterVolumeSpecName: "kube-api-access-qvtzq") pod "abcc22af-63ef-46ba-8bc8-e55f3b80de47" (UID: "abcc22af-63ef-46ba-8bc8-e55f3b80de47"). InnerVolumeSpecName "kube-api-access-qvtzq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.182810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1dc109-1108-4203-972e-641585fb07dd-kube-api-access-5cfww" (OuterVolumeSpecName: "kube-api-access-5cfww") pod "2c1dc109-1108-4203-972e-641585fb07dd" (UID: "2c1dc109-1108-4203-972e-641585fb07dd"). InnerVolumeSpecName "kube-api-access-5cfww". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.185326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc090da1-c588-4970-9514-98d3bc33f04b-kube-api-access-r7297" (OuterVolumeSpecName: "kube-api-access-r7297") pod "fc090da1-c588-4970-9514-98d3bc33f04b" (UID: "fc090da1-c588-4970-9514-98d3bc33f04b"). InnerVolumeSpecName "kube-api-access-r7297". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.186295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baab1431-f6a9-46a0-9e49-106d35249cbd-kube-api-access-kdlth" (OuterVolumeSpecName: "kube-api-access-kdlth") pod "baab1431-f6a9-46a0-9e49-106d35249cbd" (UID: "baab1431-f6a9-46a0-9e49-106d35249cbd"). InnerVolumeSpecName "kube-api-access-kdlth". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.275311 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-76b4n\" (UniqueName: \"kubernetes.io/projected/3aba5690-4f73-457a-b14d-973f6c1f5395-kube-api-access-76b4n\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.275341 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kdlth\" (UniqueName: \"kubernetes.io/projected/baab1431-f6a9-46a0-9e49-106d35249cbd-kube-api-access-kdlth\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.275354 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qvtzq\" (UniqueName: \"kubernetes.io/projected/abcc22af-63ef-46ba-8bc8-e55f3b80de47-kube-api-access-qvtzq\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.275364 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r7297\" (UniqueName: \"kubernetes.io/projected/fc090da1-c588-4970-9514-98d3bc33f04b-kube-api-access-r7297\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.275376 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5cfww\" (UniqueName: \"kubernetes.io/projected/2c1dc109-1108-4203-972e-641585fb07dd-kube-api-access-5cfww\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.409984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" event={"ID":"baab1431-f6a9-46a0-9e49-106d35249cbd","Type":"ContainerDied","Data":"26e4304407f5db8a85a9eab1321ff001ecf3ac8c05e2df0390185947362dc934"} Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.410024 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26e4304407f5db8a85a9eab1321ff001ecf3ac8c05e2df0390185947362dc934" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.410095 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-qwpbd" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.418048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" event={"ID":"2c1dc109-1108-4203-972e-641585fb07dd","Type":"ContainerDied","Data":"74fcd5d426b80febbd8aa6dc58a65f1bfea8215cde55c65e8a5bab9e68a33590"} Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.418110 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.418074 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74fcd5d426b80febbd8aa6dc58a65f1bfea8215cde55c65e8a5bab9e68a33590" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.421575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" event={"ID":"fc090da1-c588-4970-9514-98d3bc33f04b","Type":"ContainerDied","Data":"cf2d9c1a9f1066d02dd13c75812f98d33ffd19cea771efd39ae4e2436fdc5cab"} Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.421599 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf2d9c1a9f1066d02dd13c75812f98d33ffd19cea771efd39ae4e2436fdc5cab" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.421589 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-7h698" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.423601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" event={"ID":"3aba5690-4f73-457a-b14d-973f6c1f5395","Type":"ContainerDied","Data":"928251ebe6beb7a36beed215eddbcfb548509329a33469468035d2dc9bf8d04f"} Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.423645 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="928251ebe6beb7a36beed215eddbcfb548509329a33469468035d2dc9bf8d04f" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.423728 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.428010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" event={"ID":"abcc22af-63ef-46ba-8bc8-e55f3b80de47","Type":"ContainerDied","Data":"84b97869b8261bb54bf7f203483db3b71e7a09a771b09436d7789d4b6486d543"} Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.428034 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84b97869b8261bb54bf7f203483db3b71e7a09a771b09436d7789d4b6486d543" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.428093 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-9ns8w" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.431968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" event={"ID":"676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c","Type":"ContainerDied","Data":"dbca2686bf64409571159885b98a9464128cd20fdb7b76ea76da14adf1d3a186"} Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.432022 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbca2686bf64409571159885b98a9464128cd20fdb7b76ea76da14adf1d3a186" Nov 21 12:50:24 crc kubenswrapper[4769]: I1121 12:50:24.432127 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-7510-account-create-pb586" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.544528 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc"] Nov 21 12:50:25 crc kubenswrapper[4769]: E1121 12:50:25.545180 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3aba5690-4f73-457a-b14d-973f6c1f5395" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545204 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aba5690-4f73-457a-b14d-973f6c1f5395" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: E1121 12:50:25.545214 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="baab1431-f6a9-46a0-9e49-106d35249cbd" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545220 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="baab1431-f6a9-46a0-9e49-106d35249cbd" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: E1121 12:50:25.545235 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2c1dc109-1108-4203-972e-641585fb07dd" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545243 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1dc109-1108-4203-972e-641585fb07dd" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: E1121 12:50:25.545258 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc090da1-c588-4970-9514-98d3bc33f04b" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545266 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc090da1-c588-4970-9514-98d3bc33f04b" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: E1121 12:50:25.545278 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545284 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: E1121 12:50:25.545294 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="abcc22af-63ef-46ba-8bc8-e55f3b80de47" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545299 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcc22af-63ef-46ba-8bc8-e55f3b80de47" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545466 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="baab1431-f6a9-46a0-9e49-106d35249cbd" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545479 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc090da1-c588-4970-9514-98d3bc33f04b" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545493 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3aba5690-4f73-457a-b14d-973f6c1f5395" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545502 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2c1dc109-1108-4203-972e-641585fb07dd" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545512 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" containerName="mariadb-account-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.545526 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="abcc22af-63ef-46ba-8bc8-e55f3b80de47" containerName="mariadb-database-create" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.546103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.549707 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.549784 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-xdbjd" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.549921 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.567898 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc"] Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.704573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-config-data\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.705049 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkqp\" (UniqueName: \"kubernetes.io/projected/cc22ff17-be18-4e46-b13e-a84868b694d1-kube-api-access-bhkqp\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.705101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.705175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-scripts\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.807268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkqp\" (UniqueName: \"kubernetes.io/projected/cc22ff17-be18-4e46-b13e-a84868b694d1-kube-api-access-bhkqp\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.807344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.807431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-scripts\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.807496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-config-data\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.813543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.814149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-config-data\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.815013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-scripts\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.824647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkqp\" (UniqueName: \"kubernetes.io/projected/cc22ff17-be18-4e46-b13e-a84868b694d1-kube-api-access-bhkqp\") pod \"nova-cell0-conductor-db-sync-fdllc\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.868964 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:25 crc kubenswrapper[4769]: I1121 12:50:25.889982 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.010874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-config-data\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.011215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-log-httpd\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.011251 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-scripts\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.011312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-combined-ca-bundle\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.011426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-sg-core-conf-yaml\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.011536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdjj7\" (UniqueName: \"kubernetes.io/projected/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-kube-api-access-bdjj7\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.011564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-run-httpd\") pod \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\" (UID: \"ddb4c3aa-9953-43a3-ac4a-8633e1df528d\") " Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.012475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.013296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.017394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-scripts" (OuterVolumeSpecName: "scripts") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.021097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-kube-api-access-bdjj7" (OuterVolumeSpecName: "kube-api-access-bdjj7") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "kube-api-access-bdjj7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.058311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.117436 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.117478 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.117489 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.117496 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.117509 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bdjj7\" (UniqueName: \"kubernetes.io/projected/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-kube-api-access-bdjj7\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.120266 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.128336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-config-data" (OuterVolumeSpecName: "config-data") pod "ddb4c3aa-9953-43a3-ac4a-8633e1df528d" (UID: "ddb4c3aa-9953-43a3-ac4a-8633e1df528d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.219230 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.219267 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ddb4c3aa-9953-43a3-ac4a-8633e1df528d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:26 crc kubenswrapper[4769]: W1121 12:50:26.329309 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc22ff17_be18_4e46_b13e_a84868b694d1.slice/crio-77f688273c9f6cb4b8b58b0cb5a51da043e8399fcd68ddc152f7a1a3807008cb WatchSource:0}: Error finding container 77f688273c9f6cb4b8b58b0cb5a51da043e8399fcd68ddc152f7a1a3807008cb: Status 404 returned error can't find the container with id 77f688273c9f6cb4b8b58b0cb5a51da043e8399fcd68ddc152f7a1a3807008cb Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.339891 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc"] Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.464271 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerID="c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b" exitCode=0 Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.464365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.464423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerDied","Data":"c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b"} Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.464528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ddb4c3aa-9953-43a3-ac4a-8633e1df528d","Type":"ContainerDied","Data":"2af311e9de1d55920ff80957f1ab9875ce4da2740ae65e10a826d25f285e3456"} Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.464591 4769 scope.go:117] "RemoveContainer" containerID="14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.466707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" event={"ID":"cc22ff17-be18-4e46-b13e-a84868b694d1","Type":"ContainerStarted","Data":"77f688273c9f6cb4b8b58b0cb5a51da043e8399fcd68ddc152f7a1a3807008cb"} Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.532621 4769 scope.go:117] "RemoveContainer" containerID="d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.551778 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.561809 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.561829 4769 scope.go:117] "RemoveContainer" containerID="49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.569825 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.570169 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-notification-agent" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570203 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-notification-agent" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.570224 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="proxy-httpd" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570232 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="proxy-httpd" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.570253 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="sg-core" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570258 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="sg-core" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.570282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-central-agent" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570288 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-central-agent" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570479 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="sg-core" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570511 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-central-agent" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570523 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="ceilometer-notification-agent" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.570545 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" containerName="proxy-httpd" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.572181 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.575723 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.575880 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.591521 4769 scope.go:117] "RemoveContainer" containerID="c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.597574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.633473 4769 scope.go:117] "RemoveContainer" containerID="14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.633805 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c\": container with ID starting with 14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c not found: ID does not exist" containerID="14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.633841 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c"} err="failed to get container status \"14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c\": rpc error: code = NotFound desc = could not find container \"14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c\": container with ID starting with 14413be2a5e72ab669c86e957f5e337df974c20fc1c3870223caf0568a05a05c not found: ID does not exist" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.633866 4769 scope.go:117] "RemoveContainer" containerID="d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.634353 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25\": container with ID starting with d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25 not found: ID does not exist" containerID="d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.634396 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25"} err="failed to get container status \"d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25\": rpc error: code = NotFound desc = could not find container \"d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25\": container with ID starting with d381eecbf6bc3732ac2e5f4ea1bc8e9c8cf8ba3bece63ccbd8d53abf9be2ee25 not found: ID does not exist" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.634425 4769 scope.go:117] "RemoveContainer" containerID="49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.635404 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628\": container with ID starting with 49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628 not found: ID does not exist" containerID="49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.635440 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628"} err="failed to get container status \"49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628\": rpc error: code = NotFound desc = could not find container \"49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628\": container with ID starting with 49d2e5ef7df69c1e9c450e9e49522b30252fb87ee418de42b4532bdf3bd9e628 not found: ID does not exist" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.635462 4769 scope.go:117] "RemoveContainer" containerID="c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b" Nov 21 12:50:26 crc kubenswrapper[4769]: E1121 12:50:26.635817 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b\": container with ID starting with c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b not found: ID does not exist" containerID="c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.635843 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b"} err="failed to get container status \"c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b\": rpc error: code = NotFound desc = could not find container \"c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b\": container with ID starting with c8cf79987b92c16944209d4ff77585263f00eeecd9871fbee884c7070abd218b not found: ID does not exist" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-scripts\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-config-data\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732768 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-run-httpd\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-log-httpd\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.732912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkpgv\" (UniqueName: \"kubernetes.io/projected/94b4ad5a-8820-47e9-8d00-2028f215fdcc-kube-api-access-lkpgv\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.835997 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-log-httpd\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.836122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lkpgv\" (UniqueName: \"kubernetes.io/projected/94b4ad5a-8820-47e9-8d00-2028f215fdcc-kube-api-access-lkpgv\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.836342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-scripts\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.836398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-config-data\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.836461 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.836523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.836571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-run-httpd\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.837045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-log-httpd\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.837185 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-run-httpd\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.840697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-config-data\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.842692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.843489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-scripts\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.843515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.861457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkpgv\" (UniqueName: \"kubernetes.io/projected/94b4ad5a-8820-47e9-8d00-2028f215fdcc-kube-api-access-lkpgv\") pod \"ceilometer-0\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:26 crc kubenswrapper[4769]: I1121 12:50:26.888078 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:27 crc kubenswrapper[4769]: I1121 12:50:27.287090 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb4c3aa-9953-43a3-ac4a-8633e1df528d" path="/var/lib/kubelet/pods/ddb4c3aa-9953-43a3-ac4a-8633e1df528d/volumes" Nov 21 12:50:27 crc kubenswrapper[4769]: W1121 12:50:27.423319 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94b4ad5a_8820_47e9_8d00_2028f215fdcc.slice/crio-d4ab0c5b12bb5068ab5d8698bfe7136b73128a3db3c14d0543e021a6547e0e21 WatchSource:0}: Error finding container d4ab0c5b12bb5068ab5d8698bfe7136b73128a3db3c14d0543e021a6547e0e21: Status 404 returned error can't find the container with id d4ab0c5b12bb5068ab5d8698bfe7136b73128a3db3c14d0543e021a6547e0e21 Nov 21 12:50:27 crc kubenswrapper[4769]: I1121 12:50:27.424284 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:27 crc kubenswrapper[4769]: I1121 12:50:27.483234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerStarted","Data":"d4ab0c5b12bb5068ab5d8698bfe7136b73128a3db3c14d0543e021a6547e0e21"} Nov 21 12:50:27 crc kubenswrapper[4769]: I1121 12:50:27.485296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" event={"ID":"cc22ff17-be18-4e46-b13e-a84868b694d1","Type":"ContainerStarted","Data":"1c7466aaba0b1515eee89c624912ec456062cdb9909b35273bb7fa0c1c12cdd9"} Nov 21 12:50:27 crc kubenswrapper[4769]: I1121 12:50:27.503334 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" podStartSLOduration=2.503313902 podStartE2EDuration="2.503313902s" podCreationTimestamp="2025-11-21 12:50:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:27.500164066 +0000 UTC m=+3586.200825914" watchObservedRunningTime="2025-11-21 12:50:27.503313902 +0000 UTC m=+3586.203975730" Nov 21 12:50:28 crc kubenswrapper[4769]: I1121 12:50:28.498766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerStarted","Data":"6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235"} Nov 21 12:50:28 crc kubenswrapper[4769]: I1121 12:50:28.788527 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:50:28 crc kubenswrapper[4769]: I1121 12:50:28.789076 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-log" containerID="cri-o://7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390" gracePeriod=30 Nov 21 12:50:28 crc kubenswrapper[4769]: I1121 12:50:28.789182 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-httpd" containerID="cri-o://079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06" gracePeriod=30 Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.513173 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerID="7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390" exitCode=143 Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.513277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5ab314e3-8554-422d-bb15-f3d706c39ef3","Type":"ContainerDied","Data":"7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390"} Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.516630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerStarted","Data":"99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf"} Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.516713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerStarted","Data":"ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7"} Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.722852 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.723223 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-log" containerID="cri-o://7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769" gracePeriod=30 Nov 21 12:50:29 crc kubenswrapper[4769]: I1121 12:50:29.723267 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-httpd" containerID="cri-o://f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050" gracePeriod=30 Nov 21 12:50:30 crc kubenswrapper[4769]: I1121 12:50:30.532458 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerID="7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769" exitCode=143 Nov 21 12:50:30 crc kubenswrapper[4769]: I1121 12:50:30.532553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7bd1e76c-ce79-4b90-8bbc-c2b676690d54","Type":"ContainerDied","Data":"7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769"} Nov 21 12:50:30 crc kubenswrapper[4769]: I1121 12:50:30.641566 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.547398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerStarted","Data":"34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea"} Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.547657 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-central-agent" containerID="cri-o://6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235" gracePeriod=30 Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.547820 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.547917 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-notification-agent" containerID="cri-o://ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7" gracePeriod=30 Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.547836 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="proxy-httpd" containerID="cri-o://34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea" gracePeriod=30 Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.547950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="sg-core" containerID="cri-o://99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf" gracePeriod=30 Nov 21 12:50:31 crc kubenswrapper[4769]: I1121 12:50:31.581843 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.564415228 podStartE2EDuration="5.581823262s" podCreationTimestamp="2025-11-21 12:50:26 +0000 UTC" firstStartedPulling="2025-11-21 12:50:27.427676644 +0000 UTC m=+3586.128338462" lastFinishedPulling="2025-11-21 12:50:30.445084678 +0000 UTC m=+3589.145746496" observedRunningTime="2025-11-21 12:50:31.57917762 +0000 UTC m=+3590.279839438" watchObservedRunningTime="2025-11-21 12:50:31.581823262 +0000 UTC m=+3590.282485080" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.399786 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.557842 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerID="079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06" exitCode=0 Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.557952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5ab314e3-8554-422d-bb15-f3d706c39ef3","Type":"ContainerDied","Data":"079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06"} Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.557980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5ab314e3-8554-422d-bb15-f3d706c39ef3","Type":"ContainerDied","Data":"43d6facdd7f327d508d48148a19b021f7c1830a80a9eb1b9d8691808efde21a0"} Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558012 4769 scope.go:117] "RemoveContainer" containerID="079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-config-data\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-httpd-run\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-logs\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x27l6\" (UniqueName: \"kubernetes.io/projected/5ab314e3-8554-422d-bb15-f3d706c39ef3-kube-api-access-x27l6\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-public-tls-certs\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-scripts\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-combined-ca-bundle\") pod \"5ab314e3-8554-422d-bb15-f3d706c39ef3\" (UID: \"5ab314e3-8554-422d-bb15-f3d706c39ef3\") " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.558905 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.559018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-logs" (OuterVolumeSpecName: "logs") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.560133 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.560247 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5ab314e3-8554-422d-bb15-f3d706c39ef3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.565108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-scripts" (OuterVolumeSpecName: "scripts") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.565299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab314e3-8554-422d-bb15-f3d706c39ef3-kube-api-access-x27l6" (OuterVolumeSpecName: "kube-api-access-x27l6") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "kube-api-access-x27l6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566392 4769 generic.go:334] "Generic (PLEG): container finished" podID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerID="34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea" exitCode=0 Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566424 4769 generic.go:334] "Generic (PLEG): container finished" podID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerID="99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf" exitCode=2 Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566432 4769 generic.go:334] "Generic (PLEG): container finished" podID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerID="ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7" exitCode=0 Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerDied","Data":"34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea"} Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerDied","Data":"99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf"} Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerDied","Data":"ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7"} Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.566759 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.588126 4769 scope.go:117] "RemoveContainer" containerID="7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.599046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.607954 4769 scope.go:117] "RemoveContainer" containerID="079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06" Nov 21 12:50:32 crc kubenswrapper[4769]: E1121 12:50:32.608593 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06\": container with ID starting with 079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06 not found: ID does not exist" containerID="079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.608645 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06"} err="failed to get container status \"079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06\": rpc error: code = NotFound desc = could not find container \"079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06\": container with ID starting with 079c996160e07716b4aa77c02765c2d98a400e9959402eb2c7c7892f4a368b06 not found: ID does not exist" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.608679 4769 scope.go:117] "RemoveContainer" containerID="7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390" Nov 21 12:50:32 crc kubenswrapper[4769]: E1121 12:50:32.609066 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390\": container with ID starting with 7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390 not found: ID does not exist" containerID="7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.609099 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390"} err="failed to get container status \"7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390\": rpc error: code = NotFound desc = could not find container \"7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390\": container with ID starting with 7d7b25dc2c92b006be3bbdd2d72bb0f8185960bed86a23e34ff36bcb0f64b390 not found: ID does not exist" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.614407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-config-data" (OuterVolumeSpecName: "config-data") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.628334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5ab314e3-8554-422d-bb15-f3d706c39ef3" (UID: "5ab314e3-8554-422d-bb15-f3d706c39ef3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.668104 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.668142 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.668155 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.668165 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.668174 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5ab314e3-8554-422d-bb15-f3d706c39ef3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.668183 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x27l6\" (UniqueName: \"kubernetes.io/projected/5ab314e3-8554-422d-bb15-f3d706c39ef3-kube-api-access-x27l6\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.694831 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.770099 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.899685 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.908263 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.925705 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:50:32 crc kubenswrapper[4769]: E1121 12:50:32.926168 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-log" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.926207 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-log" Nov 21 12:50:32 crc kubenswrapper[4769]: E1121 12:50:32.926257 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-httpd" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.926266 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-httpd" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.926459 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-log" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.926501 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" containerName="glance-httpd" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.927684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.934050 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.936557 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:50:32 crc kubenswrapper[4769]: I1121 12:50:32.963356 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.075888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076213 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-scripts\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngrl7\" (UniqueName: \"kubernetes.io/projected/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-kube-api-access-ngrl7\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-logs\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.076432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-config-data\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-logs\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-config-data\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-scripts\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ngrl7\" (UniqueName: \"kubernetes.io/projected/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-kube-api-access-ngrl7\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.178914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-logs\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.179095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.180152 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.185014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.196029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngrl7\" (UniqueName: \"kubernetes.io/projected/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-kube-api-access-ngrl7\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.196652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-config-data\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.197498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.197541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-scripts\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.228045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.287643 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab314e3-8554-422d-bb15-f3d706c39ef3" path="/var/lib/kubelet/pods/5ab314e3-8554-422d-bb15-f3d706c39ef3/volumes" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.321584 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.332778 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.487310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scbtc\" (UniqueName: \"kubernetes.io/projected/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-kube-api-access-scbtc\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.489106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-logs" (OuterVolumeSpecName: "logs") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.489233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-logs\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.489394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-combined-ca-bundle\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.489419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-httpd-run\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.489539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-config-data\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.489773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.490149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-scripts\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.490208 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.490259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-internal-tls-certs\") pod \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\" (UID: \"7bd1e76c-ce79-4b90-8bbc-c2b676690d54\") " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.491382 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.491396 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.493107 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-kube-api-access-scbtc" (OuterVolumeSpecName: "kube-api-access-scbtc") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "kube-api-access-scbtc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.496305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.496398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-scripts" (OuterVolumeSpecName: "scripts") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.534394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.547659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.548081 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-config-data" (OuterVolumeSpecName: "config-data") pod "7bd1e76c-ce79-4b90-8bbc-c2b676690d54" (UID: "7bd1e76c-ce79-4b90-8bbc-c2b676690d54"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.581054 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerID="f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050" exitCode=0 Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.581124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7bd1e76c-ce79-4b90-8bbc-c2b676690d54","Type":"ContainerDied","Data":"f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050"} Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.581152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7bd1e76c-ce79-4b90-8bbc-c2b676690d54","Type":"ContainerDied","Data":"82d9502f27d61f75c6f8d31724a0010c09a2811599001558e3db0c654eb5c807"} Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.581169 4769 scope.go:117] "RemoveContainer" containerID="f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.581275 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.592630 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.592657 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-scbtc\" (UniqueName: \"kubernetes.io/projected/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-kube-api-access-scbtc\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.592667 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.592678 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.592687 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bd1e76c-ce79-4b90-8bbc-c2b676690d54-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.592720 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.608741 4769 scope.go:117] "RemoveContainer" containerID="7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.650064 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.656088 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.671998 4769 scope.go:117] "RemoveContainer" containerID="f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050" Nov 21 12:50:33 crc kubenswrapper[4769]: E1121 12:50:33.672620 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050\": container with ID starting with f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050 not found: ID does not exist" containerID="f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.672649 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050"} err="failed to get container status \"f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050\": rpc error: code = NotFound desc = could not find container \"f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050\": container with ID starting with f393ece9062a139b28d87a8343e54e41b284311a1ff893fb08f2ac70d8349050 not found: ID does not exist" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.672693 4769 scope.go:117] "RemoveContainer" containerID="7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769" Nov 21 12:50:33 crc kubenswrapper[4769]: E1121 12:50:33.672942 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769\": container with ID starting with 7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769 not found: ID does not exist" containerID="7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.672979 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769"} err="failed to get container status \"7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769\": rpc error: code = NotFound desc = could not find container \"7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769\": container with ID starting with 7c6f91d6fffd554919d86d141e7f0dba5a5b1ea4ac69518a33a8915c03b5d769 not found: ID does not exist" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.688517 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.695378 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.713420 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:50:33 crc kubenswrapper[4769]: E1121 12:50:33.714168 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-log" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.714202 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-log" Nov 21 12:50:33 crc kubenswrapper[4769]: E1121 12:50:33.714229 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-httpd" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.714237 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-httpd" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.714564 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-httpd" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.714595 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" containerName="glance-log" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.716285 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.718672 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.718700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.728286 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:50:33 crc kubenswrapper[4769]: E1121 12:50:33.794174 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bd1e76c_ce79_4b90_8bbc_c2b676690d54.slice\": RecentStats: unable to find data in memory cache]" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.796992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-logs\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7ft\" (UniqueName: \"kubernetes.io/projected/8080f558-a5d1-46ad-94a9-0ff1301f5804-kube-api-access-hl7ft\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.797451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.831081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:50:33 crc kubenswrapper[4769]: W1121 12:50:33.839372 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded1b3bbe_ebd5_45ec_97ae_0cf9c55c0b17.slice/crio-3390ac9ccc273b8ab7a9553d884ea10015e81b9d0d571d687eaf6e4e9c30a985 WatchSource:0}: Error finding container 3390ac9ccc273b8ab7a9553d884ea10015e81b9d0d571d687eaf6e4e9c30a985: Status 404 returned error can't find the container with id 3390ac9ccc273b8ab7a9553d884ea10015e81b9d0d571d687eaf6e4e9c30a985 Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.904762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7ft\" (UniqueName: \"kubernetes.io/projected/8080f558-a5d1-46ad-94a9-0ff1301f5804-kube-api-access-hl7ft\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.904848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.904987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905046 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905151 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905370 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905381 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-logs\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.905935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-logs\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.910955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.911101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.912328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.912668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.927329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7ft\" (UniqueName: \"kubernetes.io/projected/8080f558-a5d1-46ad-94a9-0ff1301f5804-kube-api-access-hl7ft\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:33 crc kubenswrapper[4769]: I1121 12:50:33.934308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:34 crc kubenswrapper[4769]: I1121 12:50:34.041876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:34 crc kubenswrapper[4769]: I1121 12:50:34.566120 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:50:34 crc kubenswrapper[4769]: I1121 12:50:34.596555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17","Type":"ContainerStarted","Data":"873e53430b1e227afef2ace9b57dfc467cb87a2649ef1beee28aa9fe711472da"} Nov 21 12:50:34 crc kubenswrapper[4769]: I1121 12:50:34.596614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17","Type":"ContainerStarted","Data":"3390ac9ccc273b8ab7a9553d884ea10015e81b9d0d571d687eaf6e4e9c30a985"} Nov 21 12:50:34 crc kubenswrapper[4769]: I1121 12:50:34.597636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8080f558-a5d1-46ad-94a9-0ff1301f5804","Type":"ContainerStarted","Data":"41e8e655b810c4861254ee2a9b31afc2a305c4f13f4f9a9e2cc466a899c34a52"} Nov 21 12:50:35 crc kubenswrapper[4769]: I1121 12:50:35.286692 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd1e76c-ce79-4b90-8bbc-c2b676690d54" path="/var/lib/kubelet/pods/7bd1e76c-ce79-4b90-8bbc-c2b676690d54/volumes" Nov 21 12:50:35 crc kubenswrapper[4769]: I1121 12:50:35.611814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17","Type":"ContainerStarted","Data":"4961b788dec0f781a05b0997ab7a0494f693feee3fd0174fb448341577718271"} Nov 21 12:50:35 crc kubenswrapper[4769]: I1121 12:50:35.615400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8080f558-a5d1-46ad-94a9-0ff1301f5804","Type":"ContainerStarted","Data":"135808eed2723e1830341776c94b34c2fa4917f069e53ab955ed091d28d3c118"} Nov 21 12:50:35 crc kubenswrapper[4769]: I1121 12:50:35.641472 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.641449488 podStartE2EDuration="3.641449488s" podCreationTimestamp="2025-11-21 12:50:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:35.630618254 +0000 UTC m=+3594.331280082" watchObservedRunningTime="2025-11-21 12:50:35.641449488 +0000 UTC m=+3594.342111316" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.132432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.256687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-scripts\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.256764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-log-httpd\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.256900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-combined-ca-bundle\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.257026 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-sg-core-conf-yaml\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.257075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkpgv\" (UniqueName: \"kubernetes.io/projected/94b4ad5a-8820-47e9-8d00-2028f215fdcc-kube-api-access-lkpgv\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.257167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-config-data\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.257239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-run-httpd\") pod \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\" (UID: \"94b4ad5a-8820-47e9-8d00-2028f215fdcc\") " Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.257570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.257963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.258238 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.258273 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94b4ad5a-8820-47e9-8d00-2028f215fdcc-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.263544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b4ad5a-8820-47e9-8d00-2028f215fdcc-kube-api-access-lkpgv" (OuterVolumeSpecName: "kube-api-access-lkpgv") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "kube-api-access-lkpgv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.266550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-scripts" (OuterVolumeSpecName: "scripts") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.306688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.363320 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.363362 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.363388 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lkpgv\" (UniqueName: \"kubernetes.io/projected/94b4ad5a-8820-47e9-8d00-2028f215fdcc-kube-api-access-lkpgv\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.368306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.392632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-config-data" (OuterVolumeSpecName: "config-data") pod "94b4ad5a-8820-47e9-8d00-2028f215fdcc" (UID: "94b4ad5a-8820-47e9-8d00-2028f215fdcc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.465040 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.465081 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94b4ad5a-8820-47e9-8d00-2028f215fdcc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.629283 4769 generic.go:334] "Generic (PLEG): container finished" podID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerID="6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235" exitCode=0 Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.629354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerDied","Data":"6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235"} Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.629386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94b4ad5a-8820-47e9-8d00-2028f215fdcc","Type":"ContainerDied","Data":"d4ab0c5b12bb5068ab5d8698bfe7136b73128a3db3c14d0543e021a6547e0e21"} Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.629404 4769 scope.go:117] "RemoveContainer" containerID="34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.629413 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.633977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8080f558-a5d1-46ad-94a9-0ff1301f5804","Type":"ContainerStarted","Data":"18e3ecc27cceb2870d0fe8c24b902577016c1e6ef2f701635bf148ebcb5cd8e3"} Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.676635 4769 scope.go:117] "RemoveContainer" containerID="99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.681325 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.681300845 podStartE2EDuration="3.681300845s" podCreationTimestamp="2025-11-21 12:50:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:36.652774759 +0000 UTC m=+3595.353436637" watchObservedRunningTime="2025-11-21 12:50:36.681300845 +0000 UTC m=+3595.381962663" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.695239 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.750703 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.763423 4769 scope.go:117] "RemoveContainer" containerID="ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.770477 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.771119 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="proxy-httpd" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.771651 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="proxy-httpd" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.771871 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-central-agent" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.772036 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-central-agent" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.772240 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-notification-agent" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.772372 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-notification-agent" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.772597 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="sg-core" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.772679 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="sg-core" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.773001 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-notification-agent" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.773113 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="proxy-httpd" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.773212 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="sg-core" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.773305 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" containerName="ceilometer-central-agent" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.777089 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.781779 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.781948 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.781990 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.834747 4769 scope.go:117] "RemoveContainer" containerID="6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.854821 4769 scope.go:117] "RemoveContainer" containerID="34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.855372 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea\": container with ID starting with 34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea not found: ID does not exist" containerID="34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.855421 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea"} err="failed to get container status \"34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea\": rpc error: code = NotFound desc = could not find container \"34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea\": container with ID starting with 34492f00cf67f754be9f28264f81f898fac8fc126b08b6834f693dc7346dfcea not found: ID does not exist" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.855455 4769 scope.go:117] "RemoveContainer" containerID="99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.855830 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf\": container with ID starting with 99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf not found: ID does not exist" containerID="99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.855856 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf"} err="failed to get container status \"99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf\": rpc error: code = NotFound desc = could not find container \"99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf\": container with ID starting with 99dbd863ee4b7ff0358beb15e4739d3a659f612eabe6583f6f757c9a8e7d2fcf not found: ID does not exist" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.855871 4769 scope.go:117] "RemoveContainer" containerID="ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.856212 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7\": container with ID starting with ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7 not found: ID does not exist" containerID="ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.856242 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7"} err="failed to get container status \"ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7\": rpc error: code = NotFound desc = could not find container \"ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7\": container with ID starting with ff9f514debbabaa8a4dc6b631009cfab0302e31931028708a1712655115dd6a7 not found: ID does not exist" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.856260 4769 scope.go:117] "RemoveContainer" containerID="6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235" Nov 21 12:50:36 crc kubenswrapper[4769]: E1121 12:50:36.856515 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235\": container with ID starting with 6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235 not found: ID does not exist" containerID="6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.856536 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235"} err="failed to get container status \"6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235\": rpc error: code = NotFound desc = could not find container \"6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235\": container with ID starting with 6174d7f82f77c257449c8bb9ccffde7ea97d7cb3f56932fc1bbd0751a2aff235 not found: ID does not exist" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.874980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-log-httpd\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.875026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.875076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4rb6\" (UniqueName: \"kubernetes.io/projected/b667b0e6-5127-4b01-a124-c81ccc386e98-kube-api-access-s4rb6\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.875135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-scripts\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.875171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-config-data\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.875239 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.875283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-run-httpd\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s4rb6\" (UniqueName: \"kubernetes.io/projected/b667b0e6-5127-4b01-a124-c81ccc386e98-kube-api-access-s4rb6\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-scripts\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-config-data\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-run-httpd\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-log-httpd\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.976466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.978416 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-run-httpd\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.978674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-log-httpd\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.981874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.982588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-config-data\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.982695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.983841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-scripts\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:36 crc kubenswrapper[4769]: I1121 12:50:36.996640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4rb6\" (UniqueName: \"kubernetes.io/projected/b667b0e6-5127-4b01-a124-c81ccc386e98-kube-api-access-s4rb6\") pod \"ceilometer-0\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:37 crc kubenswrapper[4769]: I1121 12:50:37.136700 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:37 crc kubenswrapper[4769]: I1121 12:50:37.291688 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b4ad5a-8820-47e9-8d00-2028f215fdcc" path="/var/lib/kubelet/pods/94b4ad5a-8820-47e9-8d00-2028f215fdcc/volumes" Nov 21 12:50:37 crc kubenswrapper[4769]: I1121 12:50:37.621457 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:50:37 crc kubenswrapper[4769]: W1121 12:50:37.627846 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb667b0e6_5127_4b01_a124_c81ccc386e98.slice/crio-8cffa36a88c77605dc6034ac5cd2c0d41eb2e1239d4e428b4c19a13e2fa50c1d WatchSource:0}: Error finding container 8cffa36a88c77605dc6034ac5cd2c0d41eb2e1239d4e428b4c19a13e2fa50c1d: Status 404 returned error can't find the container with id 8cffa36a88c77605dc6034ac5cd2c0d41eb2e1239d4e428b4c19a13e2fa50c1d Nov 21 12:50:37 crc kubenswrapper[4769]: I1121 12:50:37.649622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerStarted","Data":"8cffa36a88c77605dc6034ac5cd2c0d41eb2e1239d4e428b4c19a13e2fa50c1d"} Nov 21 12:50:39 crc kubenswrapper[4769]: I1121 12:50:39.685218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerStarted","Data":"1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b"} Nov 21 12:50:40 crc kubenswrapper[4769]: I1121 12:50:40.699792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerStarted","Data":"acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee"} Nov 21 12:50:41 crc kubenswrapper[4769]: I1121 12:50:41.715864 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerStarted","Data":"4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177"} Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.333495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.335394 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.375718 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.391288 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.741558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerStarted","Data":"cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887"} Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.742019 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.742092 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:43 crc kubenswrapper[4769]: I1121 12:50:43.780210 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.834999593 podStartE2EDuration="7.78017233s" podCreationTimestamp="2025-11-21 12:50:36 +0000 UTC" firstStartedPulling="2025-11-21 12:50:37.631866554 +0000 UTC m=+3596.332528372" lastFinishedPulling="2025-11-21 12:50:42.577039251 +0000 UTC m=+3601.277701109" observedRunningTime="2025-11-21 12:50:43.772336267 +0000 UTC m=+3602.472998125" watchObservedRunningTime="2025-11-21 12:50:43.78017233 +0000 UTC m=+3602.480834148" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.042100 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.042161 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.077738 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.106974 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.775251 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc22ff17-be18-4e46-b13e-a84868b694d1" containerID="1c7466aaba0b1515eee89c624912ec456062cdb9909b35273bb7fa0c1c12cdd9" exitCode=0 Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.775503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" event={"ID":"cc22ff17-be18-4e46-b13e-a84868b694d1","Type":"ContainerDied","Data":"1c7466aaba0b1515eee89c624912ec456062cdb9909b35273bb7fa0c1c12cdd9"} Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.776376 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.776415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:44 crc kubenswrapper[4769]: I1121 12:50:44.776427 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:50:45 crc kubenswrapper[4769]: I1121 12:50:45.628790 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:45 crc kubenswrapper[4769]: I1121 12:50:45.633905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.155930 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.289911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhkqp\" (UniqueName: \"kubernetes.io/projected/cc22ff17-be18-4e46-b13e-a84868b694d1-kube-api-access-bhkqp\") pod \"cc22ff17-be18-4e46-b13e-a84868b694d1\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.290057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-combined-ca-bundle\") pod \"cc22ff17-be18-4e46-b13e-a84868b694d1\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.290222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-config-data\") pod \"cc22ff17-be18-4e46-b13e-a84868b694d1\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.290258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-scripts\") pod \"cc22ff17-be18-4e46-b13e-a84868b694d1\" (UID: \"cc22ff17-be18-4e46-b13e-a84868b694d1\") " Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.295522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-scripts" (OuterVolumeSpecName: "scripts") pod "cc22ff17-be18-4e46-b13e-a84868b694d1" (UID: "cc22ff17-be18-4e46-b13e-a84868b694d1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.308537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc22ff17-be18-4e46-b13e-a84868b694d1-kube-api-access-bhkqp" (OuterVolumeSpecName: "kube-api-access-bhkqp") pod "cc22ff17-be18-4e46-b13e-a84868b694d1" (UID: "cc22ff17-be18-4e46-b13e-a84868b694d1"). InnerVolumeSpecName "kube-api-access-bhkqp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.317473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc22ff17-be18-4e46-b13e-a84868b694d1" (UID: "cc22ff17-be18-4e46-b13e-a84868b694d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.344764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-config-data" (OuterVolumeSpecName: "config-data") pod "cc22ff17-be18-4e46-b13e-a84868b694d1" (UID: "cc22ff17-be18-4e46-b13e-a84868b694d1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.391912 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bhkqp\" (UniqueName: \"kubernetes.io/projected/cc22ff17-be18-4e46-b13e-a84868b694d1-kube-api-access-bhkqp\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.391951 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.391962 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.391973 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc22ff17-be18-4e46-b13e-a84868b694d1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.734427 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.812491 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.812520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" event={"ID":"cc22ff17-be18-4e46-b13e-a84868b694d1","Type":"ContainerDied","Data":"77f688273c9f6cb4b8b58b0cb5a51da043e8399fcd68ddc152f7a1a3807008cb"} Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.812593 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77f688273c9f6cb4b8b58b0cb5a51da043e8399fcd68ddc152f7a1a3807008cb" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.812536 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.848418 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.928933 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:50:46 crc kubenswrapper[4769]: E1121 12:50:46.929487 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc22ff17-be18-4e46-b13e-a84868b694d1" containerName="nova-cell0-conductor-db-sync" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.929505 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc22ff17-be18-4e46-b13e-a84868b694d1" containerName="nova-cell0-conductor-db-sync" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.929701 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc22ff17-be18-4e46-b13e-a84868b694d1" containerName="nova-cell0-conductor-db-sync" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.930402 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.934336 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.934775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-xdbjd" Nov 21 12:50:46 crc kubenswrapper[4769]: I1121 12:50:46.943783 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.010171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.010247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8x95\" (UniqueName: \"kubernetes.io/projected/aaae808b-de13-4edf-9c5b-4f5c554310c3-kube-api-access-f8x95\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.010345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.112583 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.112660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8x95\" (UniqueName: \"kubernetes.io/projected/aaae808b-de13-4edf-9c5b-4f5c554310c3-kube-api-access-f8x95\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.112797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.120098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.129067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.131662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8x95\" (UniqueName: \"kubernetes.io/projected/aaae808b-de13-4edf-9c5b-4f5c554310c3-kube-api-access-f8x95\") pod \"nova-cell0-conductor-0\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.256845 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.420034 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-6fg7x"] Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.422033 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.438280 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6fg7x"] Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.520253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-utilities\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.520569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-catalog-content\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.521273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srpt\" (UniqueName: \"kubernetes.io/projected/60bc162e-f1ba-497c-88da-235cf893ab08-kube-api-access-9srpt\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.622612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9srpt\" (UniqueName: \"kubernetes.io/projected/60bc162e-f1ba-497c-88da-235cf893ab08-kube-api-access-9srpt\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.622709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-utilities\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.622774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-catalog-content\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.623366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-catalog-content\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.623653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-utilities\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.647713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srpt\" (UniqueName: \"kubernetes.io/projected/60bc162e-f1ba-497c-88da-235cf893ab08-kube-api-access-9srpt\") pod \"certified-operators-6fg7x\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.766002 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.788540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:50:47 crc kubenswrapper[4769]: W1121 12:50:47.790475 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaae808b_de13_4edf_9c5b_4f5c554310c3.slice/crio-68806313bc0d696ee70dc7a5fc1b6b0061b2a3a0b705056c4159811a1b60b70c WatchSource:0}: Error finding container 68806313bc0d696ee70dc7a5fc1b6b0061b2a3a0b705056c4159811a1b60b70c: Status 404 returned error can't find the container with id 68806313bc0d696ee70dc7a5fc1b6b0061b2a3a0b705056c4159811a1b60b70c Nov 21 12:50:47 crc kubenswrapper[4769]: I1121 12:50:47.829352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"aaae808b-de13-4edf-9c5b-4f5c554310c3","Type":"ContainerStarted","Data":"68806313bc0d696ee70dc7a5fc1b6b0061b2a3a0b705056c4159811a1b60b70c"} Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.263644 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6fg7x"] Nov 21 12:50:48 crc kubenswrapper[4769]: W1121 12:50:48.268619 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bc162e_f1ba_497c_88da_235cf893ab08.slice/crio-203d8c63203e16b82d25ce183f6705bb64d98a58fc518e59412c8ae7a8325d8c WatchSource:0}: Error finding container 203d8c63203e16b82d25ce183f6705bb64d98a58fc518e59412c8ae7a8325d8c: Status 404 returned error can't find the container with id 203d8c63203e16b82d25ce183f6705bb64d98a58fc518e59412c8ae7a8325d8c Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.843566 4769 generic.go:334] "Generic (PLEG): container finished" podID="60bc162e-f1ba-497c-88da-235cf893ab08" containerID="aee55e10ca4f62d26ddc9ba2acff2e59da10c44aa3d45daadf88ab0cef9a0a45" exitCode=0 Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.843649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerDied","Data":"aee55e10ca4f62d26ddc9ba2acff2e59da10c44aa3d45daadf88ab0cef9a0a45"} Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.843717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerStarted","Data":"203d8c63203e16b82d25ce183f6705bb64d98a58fc518e59412c8ae7a8325d8c"} Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.846429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"aaae808b-de13-4edf-9c5b-4f5c554310c3","Type":"ContainerStarted","Data":"a1ae51ef02f81b2420686957b5a99348ffa6b8f86961430f2ff61eb879ede0b0"} Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.847064 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:48 crc kubenswrapper[4769]: I1121 12:50:48.927585 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.927555448 podStartE2EDuration="2.927555448s" podCreationTimestamp="2025-11-21 12:50:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:50:48.892682469 +0000 UTC m=+3607.593344297" watchObservedRunningTime="2025-11-21 12:50:48.927555448 +0000 UTC m=+3607.628217296" Nov 21 12:50:49 crc kubenswrapper[4769]: I1121 12:50:49.870919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerStarted","Data":"373999dfb7af8178949cbc5af581eaf55442d9b56b9d2aa291e1af30b1a1cbf9"} Nov 21 12:50:51 crc kubenswrapper[4769]: I1121 12:50:51.902650 4769 generic.go:334] "Generic (PLEG): container finished" podID="60bc162e-f1ba-497c-88da-235cf893ab08" containerID="373999dfb7af8178949cbc5af581eaf55442d9b56b9d2aa291e1af30b1a1cbf9" exitCode=0 Nov 21 12:50:51 crc kubenswrapper[4769]: I1121 12:50:51.902750 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerDied","Data":"373999dfb7af8178949cbc5af581eaf55442d9b56b9d2aa291e1af30b1a1cbf9"} Nov 21 12:50:52 crc kubenswrapper[4769]: I1121 12:50:52.918752 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerStarted","Data":"3bc9ccbd315fa94f258c7df4067abdc4487b29d64c3fbf3a03234b70c8054c92"} Nov 21 12:50:52 crc kubenswrapper[4769]: I1121 12:50:52.954741 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-6fg7x" podStartSLOduration=2.457166285 podStartE2EDuration="5.954721131s" podCreationTimestamp="2025-11-21 12:50:47 +0000 UTC" firstStartedPulling="2025-11-21 12:50:48.846447491 +0000 UTC m=+3607.547109349" lastFinishedPulling="2025-11-21 12:50:52.344002337 +0000 UTC m=+3611.044664195" observedRunningTime="2025-11-21 12:50:52.946153978 +0000 UTC m=+3611.646815806" watchObservedRunningTime="2025-11-21 12:50:52.954721131 +0000 UTC m=+3611.655382959" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.308576 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.767038 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.767109 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.871132 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.964470 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw"] Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.966485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.977008 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.978817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw"] Nov 21 12:50:57 crc kubenswrapper[4769]: I1121 12:50:57.983519 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.099244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-config-data\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.099353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-scripts\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.099400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.099477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4cqh\" (UniqueName: \"kubernetes.io/projected/16c492a8-bb87-4555-9440-eba03796e00d-kube-api-access-l4cqh\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.111643 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.118649 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.121158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.123757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.129640 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.178846 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.180206 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.185483 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-config-data\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jn9\" (UniqueName: \"kubernetes.io/projected/75e3a2cb-6e92-4505-9958-43dd085c122d-kube-api-access-r5jn9\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-scripts\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-config-data\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75e3a2cb-6e92-4505-9958-43dd085c122d-logs\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.204957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l4cqh\" (UniqueName: \"kubernetes.io/projected/16c492a8-bb87-4555-9440-eba03796e00d-kube-api-access-l4cqh\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.211878 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.221379 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6fg7x"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.230769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-scripts\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.242368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.242889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-config-data\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.245016 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.246447 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.251431 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.252931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4cqh\" (UniqueName: \"kubernetes.io/projected/16c492a8-bb87-4555-9440-eba03796e00d-kube-api-access-l4cqh\") pod \"nova-cell0-cell-mapping-7xqdw\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.263023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.270253 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.271910 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.281876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.300493 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.301545 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306198 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jn9\" (UniqueName: \"kubernetes.io/projected/75e3a2cb-6e92-4505-9958-43dd085c122d-kube-api-access-r5jn9\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf9nw\" (UniqueName: \"kubernetes.io/projected/4cd35bb9-a2a8-4d82-afac-944852461292-kube-api-access-vf9nw\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-config-data\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-config-data\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75e3a2cb-6e92-4505-9958-43dd085c122d-logs\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.306725 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.307173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75e3a2cb-6e92-4505-9958-43dd085c122d-logs\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.315921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-config-data\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.324657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.328035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jn9\" (UniqueName: \"kubernetes.io/projected/75e3a2cb-6e92-4505-9958-43dd085c122d-kube-api-access-r5jn9\") pod \"nova-api-0\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.408790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-logs\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vf9nw\" (UniqueName: \"kubernetes.io/projected/4cd35bb9-a2a8-4d82-afac-944852461292-kube-api-access-vf9nw\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-config-data\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-config-data\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmp2\" (UniqueName: \"kubernetes.io/projected/795b135b-c164-4f69-985f-fb86e3f8ac00-kube-api-access-drmp2\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.409392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcmrx\" (UniqueName: \"kubernetes.io/projected/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-kube-api-access-zcmrx\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.420028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.421033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-config-data\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.424830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf9nw\" (UniqueName: \"kubernetes.io/projected/4cd35bb9-a2a8-4d82-afac-944852461292-kube-api-access-vf9nw\") pod \"nova-scheduler-0\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.464426 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.512697 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.514283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zcmrx\" (UniqueName: \"kubernetes.io/projected/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-kube-api-access-zcmrx\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.514390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.514465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-logs\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.514617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-config-data\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.514803 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.515052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-logs\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.515273 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.515309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-drmp2\" (UniqueName: \"kubernetes.io/projected/795b135b-c164-4f69-985f-fb86e3f8ac00-kube-api-access-drmp2\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.520038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.530319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.530972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-config-data\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.531496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.533268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmp2\" (UniqueName: \"kubernetes.io/projected/795b135b-c164-4f69-985f-fb86e3f8ac00-kube-api-access-drmp2\") pod \"nova-cell1-novncproxy-0\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.540119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcmrx\" (UniqueName: \"kubernetes.io/projected/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-kube-api-access-zcmrx\") pod \"nova-metadata-0\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.694524 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.696405 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.805735 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.967006 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.968573 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.971611 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.971940 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.976359 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:50:58 crc kubenswrapper[4769]: I1121 12:50:58.994964 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc"] Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.029567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-scripts\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.029676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsqmw\" (UniqueName: \"kubernetes.io/projected/7fc565a6-9454-4f75-8b8d-e5f8f92db352-kube-api-access-fsqmw\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.029734 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.029811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-config-data\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.035934 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.076879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4cd35bb9-a2a8-4d82-afac-944852461292","Type":"ContainerStarted","Data":"34de4d3be86c72119923323ba8621ebde971962cbe6d52025d8f6404f98124c0"} Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.081882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" event={"ID":"16c492a8-bb87-4555-9440-eba03796e00d","Type":"ContainerStarted","Data":"03458585a08b0aa1b004caa52790066c579f09fe458e46b2530d5751fb4d9605"} Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.090488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75e3a2cb-6e92-4505-9958-43dd085c122d","Type":"ContainerStarted","Data":"46330f48f111293757a9e98f53153baed8342d9ecba74dbacb4add24d7d6cdae"} Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.133280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.133373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-config-data\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.133443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-scripts\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.133518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fsqmw\" (UniqueName: \"kubernetes.io/projected/7fc565a6-9454-4f75-8b8d-e5f8f92db352-kube-api-access-fsqmw\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.138373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.140482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-config-data\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.145768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-scripts\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.150296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsqmw\" (UniqueName: \"kubernetes.io/projected/7fc565a6-9454-4f75-8b8d-e5f8f92db352-kube-api-access-fsqmw\") pod \"nova-cell1-conductor-db-sync-72tdc\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.206998 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:50:59 crc kubenswrapper[4769]: W1121 12:50:59.216930 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb6f480_5f2f_484c_8cba_fc1b1e79f8b7.slice/crio-e03676c4d56e1574706a031632fd3a484f34d1e749bf5d63d2f567901e981224 WatchSource:0}: Error finding container e03676c4d56e1574706a031632fd3a484f34d1e749bf5d63d2f567901e981224: Status 404 returned error can't find the container with id e03676c4d56e1574706a031632fd3a484f34d1e749bf5d63d2f567901e981224 Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.290341 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.295073 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:50:59 crc kubenswrapper[4769]: I1121 12:50:59.592250 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc"] Nov 21 12:50:59 crc kubenswrapper[4769]: W1121 12:50:59.603297 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fc565a6_9454_4f75_8b8d_e5f8f92db352.slice/crio-8cf8c32e4ef561dc1da5c5b70ab18e9490c48d7fd83e1c7ef25b60cb3f47d172 WatchSource:0}: Error finding container 8cf8c32e4ef561dc1da5c5b70ab18e9490c48d7fd83e1c7ef25b60cb3f47d172: Status 404 returned error can't find the container with id 8cf8c32e4ef561dc1da5c5b70ab18e9490c48d7fd83e1c7ef25b60cb3f47d172 Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.101068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" event={"ID":"16c492a8-bb87-4555-9440-eba03796e00d","Type":"ContainerStarted","Data":"443284b39eb7c99b2eae5b93dc7f7ca28aac657ec2c0f48654d61f16df782ebe"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.103141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" event={"ID":"7fc565a6-9454-4f75-8b8d-e5f8f92db352","Type":"ContainerStarted","Data":"dae814cdc4659ba47db1c334b8f91c2afe6a611aee1323c2d533dbd4d0aabeab"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.103200 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" event={"ID":"7fc565a6-9454-4f75-8b8d-e5f8f92db352","Type":"ContainerStarted","Data":"8cf8c32e4ef561dc1da5c5b70ab18e9490c48d7fd83e1c7ef25b60cb3f47d172"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.104729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"795b135b-c164-4f69-985f-fb86e3f8ac00","Type":"ContainerStarted","Data":"99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.104754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"795b135b-c164-4f69-985f-fb86e3f8ac00","Type":"ContainerStarted","Data":"b7670efa1b48d92a9480ff120c3986dd28641ff03547c1774fc5dd4a87dfbc28"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.106385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75e3a2cb-6e92-4505-9958-43dd085c122d","Type":"ContainerStarted","Data":"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.106432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75e3a2cb-6e92-4505-9958-43dd085c122d","Type":"ContainerStarted","Data":"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.108118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7","Type":"ContainerStarted","Data":"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.108157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7","Type":"ContainerStarted","Data":"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.108166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7","Type":"ContainerStarted","Data":"e03676c4d56e1574706a031632fd3a484f34d1e749bf5d63d2f567901e981224"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.111328 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-6fg7x" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="registry-server" containerID="cri-o://3bc9ccbd315fa94f258c7df4067abdc4487b29d64c3fbf3a03234b70c8054c92" gracePeriod=2 Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.111469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4cd35bb9-a2a8-4d82-afac-944852461292","Type":"ContainerStarted","Data":"b00c8889f1ab9249647d21bfd3934572af7c96b6cebe57226c1e7b3141ed78ec"} Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.133952 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" podStartSLOduration=3.133928362 podStartE2EDuration="3.133928362s" podCreationTimestamp="2025-11-21 12:50:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:00.118966055 +0000 UTC m=+3618.819627873" watchObservedRunningTime="2025-11-21 12:51:00.133928362 +0000 UTC m=+3618.834590180" Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.150545 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.150530303 podStartE2EDuration="2.150530303s" podCreationTimestamp="2025-11-21 12:50:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:00.144626033 +0000 UTC m=+3618.845287851" watchObservedRunningTime="2025-11-21 12:51:00.150530303 +0000 UTC m=+3618.851192121" Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.170761 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.170740923 podStartE2EDuration="2.170740923s" podCreationTimestamp="2025-11-21 12:50:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:00.17024868 +0000 UTC m=+3618.870910518" watchObservedRunningTime="2025-11-21 12:51:00.170740923 +0000 UTC m=+3618.871402741" Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.231198 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.231165787 podStartE2EDuration="2.231165787s" podCreationTimestamp="2025-11-21 12:50:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:00.200045901 +0000 UTC m=+3618.900707719" watchObservedRunningTime="2025-11-21 12:51:00.231165787 +0000 UTC m=+3618.931827605" Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.232744 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" podStartSLOduration=2.23273499 podStartE2EDuration="2.23273499s" podCreationTimestamp="2025-11-21 12:50:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:00.224882336 +0000 UTC m=+3618.925544154" watchObservedRunningTime="2025-11-21 12:51:00.23273499 +0000 UTC m=+3618.933396808" Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.251994 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.251974233 podStartE2EDuration="2.251974233s" podCreationTimestamp="2025-11-21 12:50:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:00.24452356 +0000 UTC m=+3618.945185378" watchObservedRunningTime="2025-11-21 12:51:00.251974233 +0000 UTC m=+3618.952636051" Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.609350 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:00 crc kubenswrapper[4769]: I1121 12:51:00.625165 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.141056 4769 generic.go:334] "Generic (PLEG): container finished" podID="60bc162e-f1ba-497c-88da-235cf893ab08" containerID="3bc9ccbd315fa94f258c7df4067abdc4487b29d64c3fbf3a03234b70c8054c92" exitCode=0 Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.141114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerDied","Data":"3bc9ccbd315fa94f258c7df4067abdc4487b29d64c3fbf3a03234b70c8054c92"} Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.142259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6fg7x" event={"ID":"60bc162e-f1ba-497c-88da-235cf893ab08","Type":"ContainerDied","Data":"203d8c63203e16b82d25ce183f6705bb64d98a58fc518e59412c8ae7a8325d8c"} Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.142276 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="203d8c63203e16b82d25ce183f6705bb64d98a58fc518e59412c8ae7a8325d8c" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.147711 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.283780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-catalog-content\") pod \"60bc162e-f1ba-497c-88da-235cf893ab08\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.283929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-utilities\") pod \"60bc162e-f1ba-497c-88da-235cf893ab08\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.284094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9srpt\" (UniqueName: \"kubernetes.io/projected/60bc162e-f1ba-497c-88da-235cf893ab08-kube-api-access-9srpt\") pod \"60bc162e-f1ba-497c-88da-235cf893ab08\" (UID: \"60bc162e-f1ba-497c-88da-235cf893ab08\") " Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.285024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-utilities" (OuterVolumeSpecName: "utilities") pod "60bc162e-f1ba-497c-88da-235cf893ab08" (UID: "60bc162e-f1ba-497c-88da-235cf893ab08"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.293333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bc162e-f1ba-497c-88da-235cf893ab08-kube-api-access-9srpt" (OuterVolumeSpecName: "kube-api-access-9srpt") pod "60bc162e-f1ba-497c-88da-235cf893ab08" (UID: "60bc162e-f1ba-497c-88da-235cf893ab08"). InnerVolumeSpecName "kube-api-access-9srpt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.372711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "60bc162e-f1ba-497c-88da-235cf893ab08" (UID: "60bc162e-f1ba-497c-88da-235cf893ab08"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.397412 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9srpt\" (UniqueName: \"kubernetes.io/projected/60bc162e-f1ba-497c-88da-235cf893ab08-kube-api-access-9srpt\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.397449 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:01 crc kubenswrapper[4769]: I1121 12:51:01.397464 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/60bc162e-f1ba-497c-88da-235cf893ab08-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:02 crc kubenswrapper[4769]: I1121 12:51:02.153957 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6fg7x" Nov 21 12:51:02 crc kubenswrapper[4769]: I1121 12:51:02.154109 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-log" containerID="cri-o://1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5" gracePeriod=30 Nov 21 12:51:02 crc kubenswrapper[4769]: I1121 12:51:02.154297 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="795b135b-c164-4f69-985f-fb86e3f8ac00" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc" gracePeriod=30 Nov 21 12:51:02 crc kubenswrapper[4769]: I1121 12:51:02.154348 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-metadata" containerID="cri-o://89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499" gracePeriod=30 Nov 21 12:51:02 crc kubenswrapper[4769]: I1121 12:51:02.216952 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6fg7x"] Nov 21 12:51:02 crc kubenswrapper[4769]: I1121 12:51:02.226042 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-6fg7x"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.081780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.087656 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.170275 4769 generic.go:334] "Generic (PLEG): container finished" podID="795b135b-c164-4f69-985f-fb86e3f8ac00" containerID="99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc" exitCode=0 Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.170340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"795b135b-c164-4f69-985f-fb86e3f8ac00","Type":"ContainerDied","Data":"99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc"} Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.170357 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.170409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"795b135b-c164-4f69-985f-fb86e3f8ac00","Type":"ContainerDied","Data":"b7670efa1b48d92a9480ff120c3986dd28641ff03547c1774fc5dd4a87dfbc28"} Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.170435 4769 scope.go:117] "RemoveContainer" containerID="99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.179107 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerID="89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499" exitCode=0 Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.179149 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerID="1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5" exitCode=143 Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.179243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7","Type":"ContainerDied","Data":"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499"} Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.179281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7","Type":"ContainerDied","Data":"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5"} Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.179302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7","Type":"ContainerDied","Data":"e03676c4d56e1574706a031632fd3a484f34d1e749bf5d63d2f567901e981224"} Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.179371 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.219291 4769 scope.go:117] "RemoveContainer" containerID="99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.219811 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc\": container with ID starting with 99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc not found: ID does not exist" containerID="99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.219866 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc"} err="failed to get container status \"99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc\": rpc error: code = NotFound desc = could not find container \"99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc\": container with ID starting with 99e3314a0571aeb5358ac8e1423f6b3979085ec6909b0269dcbe4087afe6dbcc not found: ID does not exist" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.219900 4769 scope.go:117] "RemoveContainer" containerID="89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.238732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-logs\") pod \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.238786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drmp2\" (UniqueName: \"kubernetes.io/projected/795b135b-c164-4f69-985f-fb86e3f8ac00-kube-api-access-drmp2\") pod \"795b135b-c164-4f69-985f-fb86e3f8ac00\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.238807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcmrx\" (UniqueName: \"kubernetes.io/projected/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-kube-api-access-zcmrx\") pod \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.238867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-config-data\") pod \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.238913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-combined-ca-bundle\") pod \"795b135b-c164-4f69-985f-fb86e3f8ac00\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.238958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-combined-ca-bundle\") pod \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\" (UID: \"bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.239086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-config-data\") pod \"795b135b-c164-4f69-985f-fb86e3f8ac00\" (UID: \"795b135b-c164-4f69-985f-fb86e3f8ac00\") " Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.239415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-logs" (OuterVolumeSpecName: "logs") pod "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" (UID: "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.240336 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.241510 4769 scope.go:117] "RemoveContainer" containerID="1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.246404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-kube-api-access-zcmrx" (OuterVolumeSpecName: "kube-api-access-zcmrx") pod "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" (UID: "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7"). InnerVolumeSpecName "kube-api-access-zcmrx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.246515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795b135b-c164-4f69-985f-fb86e3f8ac00-kube-api-access-drmp2" (OuterVolumeSpecName: "kube-api-access-drmp2") pod "795b135b-c164-4f69-985f-fb86e3f8ac00" (UID: "795b135b-c164-4f69-985f-fb86e3f8ac00"). InnerVolumeSpecName "kube-api-access-drmp2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.263802 4769 scope.go:117] "RemoveContainer" containerID="89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.264300 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499\": container with ID starting with 89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499 not found: ID does not exist" containerID="89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.264343 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499"} err="failed to get container status \"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499\": rpc error: code = NotFound desc = could not find container \"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499\": container with ID starting with 89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499 not found: ID does not exist" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.264372 4769 scope.go:117] "RemoveContainer" containerID="1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.264873 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5\": container with ID starting with 1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5 not found: ID does not exist" containerID="1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.264912 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5"} err="failed to get container status \"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5\": rpc error: code = NotFound desc = could not find container \"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5\": container with ID starting with 1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5 not found: ID does not exist" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.264955 4769 scope.go:117] "RemoveContainer" containerID="89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.265250 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499"} err="failed to get container status \"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499\": rpc error: code = NotFound desc = could not find container \"89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499\": container with ID starting with 89ed6a8e119d8aa23641a7d1bdd1de1cda485d67be7af65985977e55e6c7b499 not found: ID does not exist" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.265295 4769 scope.go:117] "RemoveContainer" containerID="1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.265715 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5"} err="failed to get container status \"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5\": rpc error: code = NotFound desc = could not find container \"1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5\": container with ID starting with 1a61be373f75d8b05d8c1e0a7d9f909a988c1872794776af9e31acf22f0e2de5 not found: ID does not exist" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.272568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" (UID: "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.277616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "795b135b-c164-4f69-985f-fb86e3f8ac00" (UID: "795b135b-c164-4f69-985f-fb86e3f8ac00"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.278355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-config-data" (OuterVolumeSpecName: "config-data") pod "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" (UID: "bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.290853 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" path="/var/lib/kubelet/pods/60bc162e-f1ba-497c-88da-235cf893ab08/volumes" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.308254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-config-data" (OuterVolumeSpecName: "config-data") pod "795b135b-c164-4f69-985f-fb86e3f8ac00" (UID: "795b135b-c164-4f69-985f-fb86e3f8ac00"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.342121 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-drmp2\" (UniqueName: \"kubernetes.io/projected/795b135b-c164-4f69-985f-fb86e3f8ac00-kube-api-access-drmp2\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.342168 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zcmrx\" (UniqueName: \"kubernetes.io/projected/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-kube-api-access-zcmrx\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.342214 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.342234 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.342252 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.342270 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/795b135b-c164-4f69-985f-fb86e3f8ac00-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.513760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.535151 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.549337 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.558698 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.569910 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.580336 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.580884 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="registry-server" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.580903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="registry-server" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.580929 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="795b135b-c164-4f69-985f-fb86e3f8ac00" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.580938 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="795b135b-c164-4f69-985f-fb86e3f8ac00" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.580958 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="extract-utilities" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.580967 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="extract-utilities" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.581001 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="extract-content" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581009 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="extract-content" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.581021 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-metadata" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581029 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-metadata" Nov 21 12:51:03 crc kubenswrapper[4769]: E1121 12:51:03.581061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-log" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581079 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-log" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581359 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60bc162e-f1ba-497c-88da-235cf893ab08" containerName="registry-server" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581383 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-metadata" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581397 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" containerName="nova-metadata-log" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.581410 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="795b135b-c164-4f69-985f-fb86e3f8ac00" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.588163 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.593401 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.593928 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.594271 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.594396 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.598516 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.601566 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.601667 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.602163 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.603121 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.750690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.750930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/027fc0d8-3b71-47ad-8f40-4532389a2fa3-logs\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.750998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghp5w\" (UniqueName: \"kubernetes.io/projected/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-kube-api-access-ghp5w\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751096 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-config-data\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5k6\" (UniqueName: \"kubernetes.io/projected/027fc0d8-3b71-47ad-8f40-4532389a2fa3-kube-api-access-pn5k6\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.751979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.853973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5k6\" (UniqueName: \"kubernetes.io/projected/027fc0d8-3b71-47ad-8f40-4532389a2fa3-kube-api-access-pn5k6\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/027fc0d8-3b71-47ad-8f40-4532389a2fa3-logs\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ghp5w\" (UniqueName: \"kubernetes.io/projected/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-kube-api-access-ghp5w\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-config-data\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.854523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.856637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/027fc0d8-3b71-47ad-8f40-4532389a2fa3-logs\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.861801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.861918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.862471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.863010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.867810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-config-data\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.872678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.872921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5k6\" (UniqueName: \"kubernetes.io/projected/027fc0d8-3b71-47ad-8f40-4532389a2fa3-kube-api-access-pn5k6\") pod \"nova-metadata-0\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.874440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghp5w\" (UniqueName: \"kubernetes.io/projected/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-kube-api-access-ghp5w\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.881299 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.915855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:03 crc kubenswrapper[4769]: I1121 12:51:03.928093 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:04 crc kubenswrapper[4769]: W1121 12:51:04.430840 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod027fc0d8_3b71_47ad_8f40_4532389a2fa3.slice/crio-48320aaf6106ce8db63a3a6f8c2239e86bc23e3f9997748a2482acb8ed860470 WatchSource:0}: Error finding container 48320aaf6106ce8db63a3a6f8c2239e86bc23e3f9997748a2482acb8ed860470: Status 404 returned error can't find the container with id 48320aaf6106ce8db63a3a6f8c2239e86bc23e3f9997748a2482acb8ed860470 Nov 21 12:51:04 crc kubenswrapper[4769]: I1121 12:51:04.431405 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:04 crc kubenswrapper[4769]: I1121 12:51:04.482935 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:04 crc kubenswrapper[4769]: W1121 12:51:04.494082 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65b5a47f_40e2_4517_af4f_094aa8aa4ad1.slice/crio-6b46930957ac98f196b7845685fc6a854120308131efaa33e23258eea17b72ee WatchSource:0}: Error finding container 6b46930957ac98f196b7845685fc6a854120308131efaa33e23258eea17b72ee: Status 404 returned error can't find the container with id 6b46930957ac98f196b7845685fc6a854120308131efaa33e23258eea17b72ee Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.222487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"65b5a47f-40e2-4517-af4f-094aa8aa4ad1","Type":"ContainerStarted","Data":"814a769f00d0c46c2f7679380c85f2debf5f58aca2ca2bc1a7efee01f7a8d26e"} Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.222560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"65b5a47f-40e2-4517-af4f-094aa8aa4ad1","Type":"ContainerStarted","Data":"6b46930957ac98f196b7845685fc6a854120308131efaa33e23258eea17b72ee"} Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.225415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"027fc0d8-3b71-47ad-8f40-4532389a2fa3","Type":"ContainerStarted","Data":"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3"} Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.225483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"027fc0d8-3b71-47ad-8f40-4532389a2fa3","Type":"ContainerStarted","Data":"48320aaf6106ce8db63a3a6f8c2239e86bc23e3f9997748a2482acb8ed860470"} Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.267898 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.267872784 podStartE2EDuration="2.267872784s" podCreationTimestamp="2025-11-21 12:51:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:05.26003118 +0000 UTC m=+3623.960693048" watchObservedRunningTime="2025-11-21 12:51:05.267872784 +0000 UTC m=+3623.968534642" Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.296237 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="795b135b-c164-4f69-985f-fb86e3f8ac00" path="/var/lib/kubelet/pods/795b135b-c164-4f69-985f-fb86e3f8ac00/volumes" Nov 21 12:51:05 crc kubenswrapper[4769]: I1121 12:51:05.297448 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7" path="/var/lib/kubelet/pods/bfb6f480-5f2f-484c-8cba-fc1b1e79f8b7/volumes" Nov 21 12:51:06 crc kubenswrapper[4769]: I1121 12:51:06.241820 4769 generic.go:334] "Generic (PLEG): container finished" podID="16c492a8-bb87-4555-9440-eba03796e00d" containerID="443284b39eb7c99b2eae5b93dc7f7ca28aac657ec2c0f48654d61f16df782ebe" exitCode=0 Nov 21 12:51:06 crc kubenswrapper[4769]: I1121 12:51:06.243501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" event={"ID":"16c492a8-bb87-4555-9440-eba03796e00d","Type":"ContainerDied","Data":"443284b39eb7c99b2eae5b93dc7f7ca28aac657ec2c0f48654d61f16df782ebe"} Nov 21 12:51:06 crc kubenswrapper[4769]: I1121 12:51:06.251905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"027fc0d8-3b71-47ad-8f40-4532389a2fa3","Type":"ContainerStarted","Data":"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6"} Nov 21 12:51:06 crc kubenswrapper[4769]: I1121 12:51:06.308771 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.308744589 podStartE2EDuration="3.308744589s" podCreationTimestamp="2025-11-21 12:51:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:06.294347348 +0000 UTC m=+3624.995009206" watchObservedRunningTime="2025-11-21 12:51:06.308744589 +0000 UTC m=+3625.009406447" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.146155 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.661275 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.746547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-config-data\") pod \"16c492a8-bb87-4555-9440-eba03796e00d\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.746716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4cqh\" (UniqueName: \"kubernetes.io/projected/16c492a8-bb87-4555-9440-eba03796e00d-kube-api-access-l4cqh\") pod \"16c492a8-bb87-4555-9440-eba03796e00d\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.746850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-combined-ca-bundle\") pod \"16c492a8-bb87-4555-9440-eba03796e00d\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.746887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-scripts\") pod \"16c492a8-bb87-4555-9440-eba03796e00d\" (UID: \"16c492a8-bb87-4555-9440-eba03796e00d\") " Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.752404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-scripts" (OuterVolumeSpecName: "scripts") pod "16c492a8-bb87-4555-9440-eba03796e00d" (UID: "16c492a8-bb87-4555-9440-eba03796e00d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.753634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c492a8-bb87-4555-9440-eba03796e00d-kube-api-access-l4cqh" (OuterVolumeSpecName: "kube-api-access-l4cqh") pod "16c492a8-bb87-4555-9440-eba03796e00d" (UID: "16c492a8-bb87-4555-9440-eba03796e00d"). InnerVolumeSpecName "kube-api-access-l4cqh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.776935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16c492a8-bb87-4555-9440-eba03796e00d" (UID: "16c492a8-bb87-4555-9440-eba03796e00d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.797834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-config-data" (OuterVolumeSpecName: "config-data") pod "16c492a8-bb87-4555-9440-eba03796e00d" (UID: "16c492a8-bb87-4555-9440-eba03796e00d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.849463 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l4cqh\" (UniqueName: \"kubernetes.io/projected/16c492a8-bb87-4555-9440-eba03796e00d-kube-api-access-l4cqh\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.849500 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.849515 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:07 crc kubenswrapper[4769]: I1121 12:51:07.849528 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c492a8-bb87-4555-9440-eba03796e00d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.279897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" event={"ID":"16c492a8-bb87-4555-9440-eba03796e00d","Type":"ContainerDied","Data":"03458585a08b0aa1b004caa52790066c579f09fe458e46b2530d5751fb4d9605"} Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.279971 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03458585a08b0aa1b004caa52790066c579f09fe458e46b2530d5751fb4d9605" Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.279968 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw" Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.444693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.444964 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="4cd35bb9-a2a8-4d82-afac-944852461292" containerName="nova-scheduler-scheduler" containerID="cri-o://b00c8889f1ab9249647d21bfd3934572af7c96b6cebe57226c1e7b3141ed78ec" gracePeriod=30 Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.455899 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.456574 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-log" containerID="cri-o://34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898" gracePeriod=30 Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.456659 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-api" containerID="cri-o://2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1" gracePeriod=30 Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.508306 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.508798 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-metadata" containerID="cri-o://5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6" gracePeriod=30 Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.508640 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-log" containerID="cri-o://fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3" gracePeriod=30 Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.917106 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.917510 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:08 crc kubenswrapper[4769]: I1121 12:51:08.928551 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.010149 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.078125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-combined-ca-bundle\") pod \"75e3a2cb-6e92-4505-9958-43dd085c122d\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.078496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jn9\" (UniqueName: \"kubernetes.io/projected/75e3a2cb-6e92-4505-9958-43dd085c122d-kube-api-access-r5jn9\") pod \"75e3a2cb-6e92-4505-9958-43dd085c122d\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.078570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-config-data\") pod \"75e3a2cb-6e92-4505-9958-43dd085c122d\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.078721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75e3a2cb-6e92-4505-9958-43dd085c122d-logs\") pod \"75e3a2cb-6e92-4505-9958-43dd085c122d\" (UID: \"75e3a2cb-6e92-4505-9958-43dd085c122d\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.080157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e3a2cb-6e92-4505-9958-43dd085c122d-logs" (OuterVolumeSpecName: "logs") pod "75e3a2cb-6e92-4505-9958-43dd085c122d" (UID: "75e3a2cb-6e92-4505-9958-43dd085c122d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.082342 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.088055 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e3a2cb-6e92-4505-9958-43dd085c122d-kube-api-access-r5jn9" (OuterVolumeSpecName: "kube-api-access-r5jn9") pod "75e3a2cb-6e92-4505-9958-43dd085c122d" (UID: "75e3a2cb-6e92-4505-9958-43dd085c122d"). InnerVolumeSpecName "kube-api-access-r5jn9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.090241 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r5jn9\" (UniqueName: \"kubernetes.io/projected/75e3a2cb-6e92-4505-9958-43dd085c122d-kube-api-access-r5jn9\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.090296 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75e3a2cb-6e92-4505-9958-43dd085c122d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.130417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-config-data" (OuterVolumeSpecName: "config-data") pod "75e3a2cb-6e92-4505-9958-43dd085c122d" (UID: "75e3a2cb-6e92-4505-9958-43dd085c122d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.134277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75e3a2cb-6e92-4505-9958-43dd085c122d" (UID: "75e3a2cb-6e92-4505-9958-43dd085c122d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.191618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-nova-metadata-tls-certs\") pod \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.191946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-config-data\") pod \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.192054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-combined-ca-bundle\") pod \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.192684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/027fc0d8-3b71-47ad-8f40-4532389a2fa3-logs\") pod \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.192858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn5k6\" (UniqueName: \"kubernetes.io/projected/027fc0d8-3b71-47ad-8f40-4532389a2fa3-kube-api-access-pn5k6\") pod \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\" (UID: \"027fc0d8-3b71-47ad-8f40-4532389a2fa3\") " Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.192958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/027fc0d8-3b71-47ad-8f40-4532389a2fa3-logs" (OuterVolumeSpecName: "logs") pod "027fc0d8-3b71-47ad-8f40-4532389a2fa3" (UID: "027fc0d8-3b71-47ad-8f40-4532389a2fa3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.193446 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.193525 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/027fc0d8-3b71-47ad-8f40-4532389a2fa3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.193588 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75e3a2cb-6e92-4505-9958-43dd085c122d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.196104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/027fc0d8-3b71-47ad-8f40-4532389a2fa3-kube-api-access-pn5k6" (OuterVolumeSpecName: "kube-api-access-pn5k6") pod "027fc0d8-3b71-47ad-8f40-4532389a2fa3" (UID: "027fc0d8-3b71-47ad-8f40-4532389a2fa3"). InnerVolumeSpecName "kube-api-access-pn5k6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.224351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "027fc0d8-3b71-47ad-8f40-4532389a2fa3" (UID: "027fc0d8-3b71-47ad-8f40-4532389a2fa3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.230211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-config-data" (OuterVolumeSpecName: "config-data") pod "027fc0d8-3b71-47ad-8f40-4532389a2fa3" (UID: "027fc0d8-3b71-47ad-8f40-4532389a2fa3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.254392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "027fc0d8-3b71-47ad-8f40-4532389a2fa3" (UID: "027fc0d8-3b71-47ad-8f40-4532389a2fa3"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.291898 4769 generic.go:334] "Generic (PLEG): container finished" podID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerID="2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1" exitCode=0 Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.291948 4769 generic.go:334] "Generic (PLEG): container finished" podID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerID="34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898" exitCode=143 Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.292006 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75e3a2cb-6e92-4505-9958-43dd085c122d","Type":"ContainerDied","Data":"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1"} Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.292041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75e3a2cb-6e92-4505-9958-43dd085c122d","Type":"ContainerDied","Data":"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898"} Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.292063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75e3a2cb-6e92-4505-9958-43dd085c122d","Type":"ContainerDied","Data":"46330f48f111293757a9e98f53153baed8342d9ecba74dbacb4add24d7d6cdae"} Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.292089 4769 scope.go:117] "RemoveContainer" containerID="2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.292308 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.294871 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.294897 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.294906 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/027fc0d8-3b71-47ad-8f40-4532389a2fa3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.294919 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pn5k6\" (UniqueName: \"kubernetes.io/projected/027fc0d8-3b71-47ad-8f40-4532389a2fa3-kube-api-access-pn5k6\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.296139 4769 generic.go:334] "Generic (PLEG): container finished" podID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerID="5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6" exitCode=0 Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.296158 4769 generic.go:334] "Generic (PLEG): container finished" podID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerID="fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3" exitCode=143 Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.296173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"027fc0d8-3b71-47ad-8f40-4532389a2fa3","Type":"ContainerDied","Data":"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6"} Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.296201 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"027fc0d8-3b71-47ad-8f40-4532389a2fa3","Type":"ContainerDied","Data":"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3"} Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.296212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"027fc0d8-3b71-47ad-8f40-4532389a2fa3","Type":"ContainerDied","Data":"48320aaf6106ce8db63a3a6f8c2239e86bc23e3f9997748a2482acb8ed860470"} Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.296261 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.321542 4769 scope.go:117] "RemoveContainer" containerID="34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.369163 4769 scope.go:117] "RemoveContainer" containerID="2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.369780 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1\": container with ID starting with 2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1 not found: ID does not exist" containerID="2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.369827 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1"} err="failed to get container status \"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1\": rpc error: code = NotFound desc = could not find container \"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1\": container with ID starting with 2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.369855 4769 scope.go:117] "RemoveContainer" containerID="34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.371136 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898\": container with ID starting with 34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898 not found: ID does not exist" containerID="34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.371170 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898"} err="failed to get container status \"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898\": rpc error: code = NotFound desc = could not find container \"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898\": container with ID starting with 34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.371210 4769 scope.go:117] "RemoveContainer" containerID="2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.371626 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1"} err="failed to get container status \"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1\": rpc error: code = NotFound desc = could not find container \"2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1\": container with ID starting with 2e1e1d502dc1e51a9ef4fcc826e0a9749b35b064856dd77a0773e7905aa991e1 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.371676 4769 scope.go:117] "RemoveContainer" containerID="34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.372559 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898"} err="failed to get container status \"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898\": rpc error: code = NotFound desc = could not find container \"34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898\": container with ID starting with 34f330f667920f1dced062260f81638b22a38178f1a1b92be2ab43723f5d4898 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.372605 4769 scope.go:117] "RemoveContainer" containerID="5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.379563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.394835 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.404466 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.428342 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.443497 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.446533 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16c492a8-bb87-4555-9440-eba03796e00d" containerName="nova-manage" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446563 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c492a8-bb87-4555-9440-eba03796e00d" containerName="nova-manage" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.446583 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-log" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446594 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-log" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.446617 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-log" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446626 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-log" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.446636 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-api" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446644 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-api" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.446668 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-metadata" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446675 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-metadata" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16c492a8-bb87-4555-9440-eba03796e00d" containerName="nova-manage" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-log" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446920 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-metadata" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446938 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" containerName="nova-api-api" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.446954 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" containerName="nova-metadata-log" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.457158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.457527 4769 scope.go:117] "RemoveContainer" containerID="fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.460484 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.465154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.465423 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.474084 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.475859 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.479096 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.487606 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.494166 4769 scope.go:117] "RemoveContainer" containerID="5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.498682 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6\": container with ID starting with 5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6 not found: ID does not exist" containerID="5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.498731 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6"} err="failed to get container status \"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6\": rpc error: code = NotFound desc = could not find container \"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6\": container with ID starting with 5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.498770 4769 scope.go:117] "RemoveContainer" containerID="fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3" Nov 21 12:51:09 crc kubenswrapper[4769]: E1121 12:51:09.501356 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3\": container with ID starting with fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3 not found: ID does not exist" containerID="fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.501407 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3"} err="failed to get container status \"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3\": rpc error: code = NotFound desc = could not find container \"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3\": container with ID starting with fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.501435 4769 scope.go:117] "RemoveContainer" containerID="5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.502000 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6"} err="failed to get container status \"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6\": rpc error: code = NotFound desc = could not find container \"5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6\": container with ID starting with 5c5617c9d817761e2c73bf5cad228d4536f080627f875b68e6192a74ca2448d6 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.502028 4769 scope.go:117] "RemoveContainer" containerID="fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.502269 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3"} err="failed to get container status \"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3\": rpc error: code = NotFound desc = could not find container \"fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3\": container with ID starting with fb190e4da4484caaf422f3cbf45632ae82a13c0a4d3cc30d35cb25c91899a4b3 not found: ID does not exist" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkt9c\" (UniqueName: \"kubernetes.io/projected/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-kube-api-access-zkt9c\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-logs\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-logs\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d75nh\" (UniqueName: \"kubernetes.io/projected/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-kube-api-access-d75nh\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601752 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-config-data\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.601851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.602077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-config-data\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.602124 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.703649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.703715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-config-data\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.703732 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.703975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zkt9c\" (UniqueName: \"kubernetes.io/projected/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-kube-api-access-zkt9c\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704092 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-logs\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-logs\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d75nh\" (UniqueName: \"kubernetes.io/projected/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-kube-api-access-d75nh\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704372 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-config-data\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-logs\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.704846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-logs\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.708836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.709590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.710260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-config-data\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.710810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.712486 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-config-data\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.720555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d75nh\" (UniqueName: \"kubernetes.io/projected/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-kube-api-access-d75nh\") pod \"nova-api-0\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.721493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkt9c\" (UniqueName: \"kubernetes.io/projected/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-kube-api-access-zkt9c\") pod \"nova-metadata-0\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.786130 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:09 crc kubenswrapper[4769]: I1121 12:51:09.800520 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:10 crc kubenswrapper[4769]: I1121 12:51:10.214625 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:10 crc kubenswrapper[4769]: I1121 12:51:10.332894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8","Type":"ContainerStarted","Data":"6cb364f441623cd729c07eb61d01c6f696a2df216dcab1d3596da53934c24aa7"} Nov 21 12:51:10 crc kubenswrapper[4769]: W1121 12:51:10.371380 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b64bb07_6ced_4f23_bf40_b3a5f5ba7865.slice/crio-f4a5b37e3be78c9f1d914dd01b5e7de20819a3dac47ccb90a67ee24c6ef2d697 WatchSource:0}: Error finding container f4a5b37e3be78c9f1d914dd01b5e7de20819a3dac47ccb90a67ee24c6ef2d697: Status 404 returned error can't find the container with id f4a5b37e3be78c9f1d914dd01b5e7de20819a3dac47ccb90a67ee24c6ef2d697 Nov 21 12:51:10 crc kubenswrapper[4769]: I1121 12:51:10.371486 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.138863 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.139487 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="bd45f137-c772-405d-ab6a-c4c05513a801" containerName="kube-state-metrics" containerID="cri-o://2e04e7151a7ca0b706646be541412fbb11b5de3afd8e56bb32ee63fbb282060c" gracePeriod=30 Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.295461 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="027fc0d8-3b71-47ad-8f40-4532389a2fa3" path="/var/lib/kubelet/pods/027fc0d8-3b71-47ad-8f40-4532389a2fa3/volumes" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.300566 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e3a2cb-6e92-4505-9958-43dd085c122d" path="/var/lib/kubelet/pods/75e3a2cb-6e92-4505-9958-43dd085c122d/volumes" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.370548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8","Type":"ContainerStarted","Data":"4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.370616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8","Type":"ContainerStarted","Data":"39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.373817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865","Type":"ContainerStarted","Data":"567b9441e1e27697fb8f00b3dca199891e2d3f8b1cd6c6358812c0a6bcbd8691"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.374080 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865","Type":"ContainerStarted","Data":"5a35763039d93b1f80d4fa47c4b6b3e0cf2389991f7ccb4345b212a637b2b8a5"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.375129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865","Type":"ContainerStarted","Data":"f4a5b37e3be78c9f1d914dd01b5e7de20819a3dac47ccb90a67ee24c6ef2d697"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.376463 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd45f137-c772-405d-ab6a-c4c05513a801" containerID="2e04e7151a7ca0b706646be541412fbb11b5de3afd8e56bb32ee63fbb282060c" exitCode=2 Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.376606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd45f137-c772-405d-ab6a-c4c05513a801","Type":"ContainerDied","Data":"2e04e7151a7ca0b706646be541412fbb11b5de3afd8e56bb32ee63fbb282060c"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.378881 4769 generic.go:334] "Generic (PLEG): container finished" podID="4cd35bb9-a2a8-4d82-afac-944852461292" containerID="b00c8889f1ab9249647d21bfd3934572af7c96b6cebe57226c1e7b3141ed78ec" exitCode=0 Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.379060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4cd35bb9-a2a8-4d82-afac-944852461292","Type":"ContainerDied","Data":"b00c8889f1ab9249647d21bfd3934572af7c96b6cebe57226c1e7b3141ed78ec"} Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.417399 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.417379793 podStartE2EDuration="2.417379793s" podCreationTimestamp="2025-11-21 12:51:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:11.389498655 +0000 UTC m=+3630.090160483" watchObservedRunningTime="2025-11-21 12:51:11.417379793 +0000 UTC m=+3630.118041611" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.426446 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.432172 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.432148685 podStartE2EDuration="2.432148685s" podCreationTimestamp="2025-11-21 12:51:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:11.416878799 +0000 UTC m=+3630.117540617" watchObservedRunningTime="2025-11-21 12:51:11.432148685 +0000 UTC m=+3630.132810503" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.543184 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-combined-ca-bundle\") pod \"4cd35bb9-a2a8-4d82-afac-944852461292\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.543437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf9nw\" (UniqueName: \"kubernetes.io/projected/4cd35bb9-a2a8-4d82-afac-944852461292-kube-api-access-vf9nw\") pod \"4cd35bb9-a2a8-4d82-afac-944852461292\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.544248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-config-data\") pod \"4cd35bb9-a2a8-4d82-afac-944852461292\" (UID: \"4cd35bb9-a2a8-4d82-afac-944852461292\") " Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.557398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd35bb9-a2a8-4d82-afac-944852461292-kube-api-access-vf9nw" (OuterVolumeSpecName: "kube-api-access-vf9nw") pod "4cd35bb9-a2a8-4d82-afac-944852461292" (UID: "4cd35bb9-a2a8-4d82-afac-944852461292"). InnerVolumeSpecName "kube-api-access-vf9nw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.589676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-config-data" (OuterVolumeSpecName: "config-data") pod "4cd35bb9-a2a8-4d82-afac-944852461292" (UID: "4cd35bb9-a2a8-4d82-afac-944852461292"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.595435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4cd35bb9-a2a8-4d82-afac-944852461292" (UID: "4cd35bb9-a2a8-4d82-afac-944852461292"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.650931 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vf9nw\" (UniqueName: \"kubernetes.io/projected/4cd35bb9-a2a8-4d82-afac-944852461292-kube-api-access-vf9nw\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.651591 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.651701 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4cd35bb9-a2a8-4d82-afac-944852461292-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.714155 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.752530 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kghz\" (UniqueName: \"kubernetes.io/projected/bd45f137-c772-405d-ab6a-c4c05513a801-kube-api-access-5kghz\") pod \"bd45f137-c772-405d-ab6a-c4c05513a801\" (UID: \"bd45f137-c772-405d-ab6a-c4c05513a801\") " Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.756626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd45f137-c772-405d-ab6a-c4c05513a801-kube-api-access-5kghz" (OuterVolumeSpecName: "kube-api-access-5kghz") pod "bd45f137-c772-405d-ab6a-c4c05513a801" (UID: "bd45f137-c772-405d-ab6a-c4c05513a801"). InnerVolumeSpecName "kube-api-access-5kghz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:11 crc kubenswrapper[4769]: I1121 12:51:11.855854 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kghz\" (UniqueName: \"kubernetes.io/projected/bd45f137-c772-405d-ab6a-c4c05513a801-kube-api-access-5kghz\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.393302 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.393302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd45f137-c772-405d-ab6a-c4c05513a801","Type":"ContainerDied","Data":"eab37c286ce9b0379426b497de85f3bfc8ca9963c360633df7c5e86ebb0eec35"} Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.393723 4769 scope.go:117] "RemoveContainer" containerID="2e04e7151a7ca0b706646be541412fbb11b5de3afd8e56bb32ee63fbb282060c" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.396318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4cd35bb9-a2a8-4d82-afac-944852461292","Type":"ContainerDied","Data":"34de4d3be86c72119923323ba8621ebde971962cbe6d52025d8f6404f98124c0"} Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.396434 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.434915 4769 scope.go:117] "RemoveContainer" containerID="b00c8889f1ab9249647d21bfd3934572af7c96b6cebe57226c1e7b3141ed78ec" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.439296 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.458161 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.470268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.483101 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.490132 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: E1121 12:51:12.490738 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd45f137-c772-405d-ab6a-c4c05513a801" containerName="kube-state-metrics" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.490768 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd45f137-c772-405d-ab6a-c4c05513a801" containerName="kube-state-metrics" Nov 21 12:51:12 crc kubenswrapper[4769]: E1121 12:51:12.490812 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4cd35bb9-a2a8-4d82-afac-944852461292" containerName="nova-scheduler-scheduler" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.490825 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd35bb9-a2a8-4d82-afac-944852461292" containerName="nova-scheduler-scheduler" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.491177 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4cd35bb9-a2a8-4d82-afac-944852461292" containerName="nova-scheduler-scheduler" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.491270 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bd45f137-c772-405d-ab6a-c4c05513a801" containerName="kube-state-metrics" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.492282 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.497542 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.501716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.501834 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.511279 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.516271 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.518620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.524818 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.573988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.574068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.574334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-config-data\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.574457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh7p7\" (UniqueName: \"kubernetes.io/projected/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-api-access-gh7p7\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.574582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.574641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv8cj\" (UniqueName: \"kubernetes.io/projected/c000468c-0aeb-4e5b-b647-a225f1387d7d-kube-api-access-bv8cj\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.574707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-config-data\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gh7p7\" (UniqueName: \"kubernetes.io/projected/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-api-access-gh7p7\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bv8cj\" (UniqueName: \"kubernetes.io/projected/c000468c-0aeb-4e5b-b647-a225f1387d7d-kube-api-access-bv8cj\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.676964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.683708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.684653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-config-data\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.685158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.695267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.695473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.695857 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh7p7\" (UniqueName: \"kubernetes.io/projected/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-api-access-gh7p7\") pod \"kube-state-metrics-0\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.707063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv8cj\" (UniqueName: \"kubernetes.io/projected/c000468c-0aeb-4e5b-b647-a225f1387d7d-kube-api-access-bv8cj\") pod \"nova-scheduler-0\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.818313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:12 crc kubenswrapper[4769]: I1121 12:51:12.835021 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.085465 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.086160 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-central-agent" containerID="cri-o://1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b" gracePeriod=30 Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.086316 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="proxy-httpd" containerID="cri-o://cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887" gracePeriod=30 Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.086367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="sg-core" containerID="cri-o://4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177" gracePeriod=30 Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.086408 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-notification-agent" containerID="cri-o://acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee" gracePeriod=30 Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.303423 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cd35bb9-a2a8-4d82-afac-944852461292" path="/var/lib/kubelet/pods/4cd35bb9-a2a8-4d82-afac-944852461292/volumes" Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.304162 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd45f137-c772-405d-ab6a-c4c05513a801" path="/var/lib/kubelet/pods/bd45f137-c772-405d-ab6a-c4c05513a801/volumes" Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.357429 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.407458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c000468c-0aeb-4e5b-b647-a225f1387d7d","Type":"ContainerStarted","Data":"226e9992d5c033c5b282a2b8a2b92209416e01f0587586c7a0706f4b7ea01896"} Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.411911 4769 generic.go:334] "Generic (PLEG): container finished" podID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerID="4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177" exitCode=2 Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.411970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerDied","Data":"4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177"} Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.555544 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.928866 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:13 crc kubenswrapper[4769]: I1121 12:51:13.968644 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.429809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c000468c-0aeb-4e5b-b647-a225f1387d7d","Type":"ContainerStarted","Data":"e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc"} Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.437791 4769 generic.go:334] "Generic (PLEG): container finished" podID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerID="cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887" exitCode=0 Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.439894 4769 generic.go:334] "Generic (PLEG): container finished" podID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerID="1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b" exitCode=0 Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.437879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerDied","Data":"cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887"} Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.440202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerDied","Data":"1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b"} Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.444877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"abec82e3-8477-40cc-a42c-3a67fe46ecba","Type":"ContainerStarted","Data":"d4f1f5d51d650e636fc79d365a01d8f04b9fe6abb11ba80f5ac792ffad67501a"} Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.444956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"abec82e3-8477-40cc-a42c-3a67fe46ecba","Type":"ContainerStarted","Data":"cc8f88f52a0f5367d18e21fa7c0007474d4dfe798e8c246a5145046603d7972b"} Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.460567 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.460537758 podStartE2EDuration="2.460537758s" podCreationTimestamp="2025-11-21 12:51:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:14.454718849 +0000 UTC m=+3633.155380687" watchObservedRunningTime="2025-11-21 12:51:14.460537758 +0000 UTC m=+3633.161199576" Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.468782 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.485466 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.106309781 podStartE2EDuration="2.485446025s" podCreationTimestamp="2025-11-21 12:51:12 +0000 UTC" firstStartedPulling="2025-11-21 12:51:13.563608118 +0000 UTC m=+3632.264269936" lastFinishedPulling="2025-11-21 12:51:13.942744342 +0000 UTC m=+3632.643406180" observedRunningTime="2025-11-21 12:51:14.477676314 +0000 UTC m=+3633.178338142" watchObservedRunningTime="2025-11-21 12:51:14.485446025 +0000 UTC m=+3633.186107843" Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.786891 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:14 crc kubenswrapper[4769]: I1121 12:51:14.787441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:15 crc kubenswrapper[4769]: I1121 12:51:15.462871 4769 generic.go:334] "Generic (PLEG): container finished" podID="7fc565a6-9454-4f75-8b8d-e5f8f92db352" containerID="dae814cdc4659ba47db1c334b8f91c2afe6a611aee1323c2d533dbd4d0aabeab" exitCode=0 Nov 21 12:51:15 crc kubenswrapper[4769]: I1121 12:51:15.462977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" event={"ID":"7fc565a6-9454-4f75-8b8d-e5f8f92db352","Type":"ContainerDied","Data":"dae814cdc4659ba47db1c334b8f91c2afe6a611aee1323c2d533dbd4d0aabeab"} Nov 21 12:51:15 crc kubenswrapper[4769]: I1121 12:51:15.464286 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.372574 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.450763 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-run-httpd\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451219 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-combined-ca-bundle\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-config-data\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451218 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-log-httpd\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-sg-core-conf-yaml\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4rb6\" (UniqueName: \"kubernetes.io/projected/b667b0e6-5127-4b01-a124-c81ccc386e98-kube-api-access-s4rb6\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-scripts\") pod \"b667b0e6-5127-4b01-a124-c81ccc386e98\" (UID: \"b667b0e6-5127-4b01-a124-c81ccc386e98\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.451985 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.452322 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.452384 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b667b0e6-5127-4b01-a124-c81ccc386e98-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.459511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-scripts" (OuterVolumeSpecName: "scripts") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.459609 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b667b0e6-5127-4b01-a124-c81ccc386e98-kube-api-access-s4rb6" (OuterVolumeSpecName: "kube-api-access-s4rb6") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "kube-api-access-s4rb6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.502051 4769 generic.go:334] "Generic (PLEG): container finished" podID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerID="acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee" exitCode=0 Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.502638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerDied","Data":"acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee"} Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.503180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b667b0e6-5127-4b01-a124-c81ccc386e98","Type":"ContainerDied","Data":"8cffa36a88c77605dc6034ac5cd2c0d41eb2e1239d4e428b4c19a13e2fa50c1d"} Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.503236 4769 scope.go:117] "RemoveContainer" containerID="cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.502696 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.538206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.554265 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.554297 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.554309 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s4rb6\" (UniqueName: \"kubernetes.io/projected/b667b0e6-5127-4b01-a124-c81ccc386e98-kube-api-access-s4rb6\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.570781 4769 scope.go:117] "RemoveContainer" containerID="4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.577934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.591897 4769 scope.go:117] "RemoveContainer" containerID="acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.617515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-config-data" (OuterVolumeSpecName: "config-data") pod "b667b0e6-5127-4b01-a124-c81ccc386e98" (UID: "b667b0e6-5127-4b01-a124-c81ccc386e98"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.623364 4769 scope.go:117] "RemoveContainer" containerID="1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.654924 4769 scope.go:117] "RemoveContainer" containerID="cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.656096 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.656130 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b667b0e6-5127-4b01-a124-c81ccc386e98-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.657034 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887\": container with ID starting with cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887 not found: ID does not exist" containerID="cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.657134 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887"} err="failed to get container status \"cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887\": rpc error: code = NotFound desc = could not find container \"cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887\": container with ID starting with cc2b311c0365bdb9ba354130b053b37ea88b3621ae201bb75a8a31dfe2376887 not found: ID does not exist" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.657171 4769 scope.go:117] "RemoveContainer" containerID="4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.660347 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177\": container with ID starting with 4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177 not found: ID does not exist" containerID="4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.660390 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177"} err="failed to get container status \"4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177\": rpc error: code = NotFound desc = could not find container \"4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177\": container with ID starting with 4f99bca1530febf08439acd31d9db7fd9019e87941483ca7a8921ab69c9f6177 not found: ID does not exist" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.660417 4769 scope.go:117] "RemoveContainer" containerID="acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.660757 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee\": container with ID starting with acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee not found: ID does not exist" containerID="acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.660811 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee"} err="failed to get container status \"acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee\": rpc error: code = NotFound desc = could not find container \"acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee\": container with ID starting with acaeb635d4f30400c53c363ce46024c392e424756177032799fc1eea34f2dbee not found: ID does not exist" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.660828 4769 scope.go:117] "RemoveContainer" containerID="1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.661402 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b\": container with ID starting with 1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b not found: ID does not exist" containerID="1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.661428 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b"} err="failed to get container status \"1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b\": rpc error: code = NotFound desc = could not find container \"1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b\": container with ID starting with 1536a352a7e565288dc4f0208721a96ae96ab6f6b39dc9af699be8ddc9688d4b not found: ID does not exist" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.767073 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.855481 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.858083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-combined-ca-bundle\") pod \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.858131 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-scripts\") pod \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.858158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsqmw\" (UniqueName: \"kubernetes.io/projected/7fc565a6-9454-4f75-8b8d-e5f8f92db352-kube-api-access-fsqmw\") pod \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.858216 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-config-data\") pod \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\" (UID: \"7fc565a6-9454-4f75-8b8d-e5f8f92db352\") " Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.861949 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.869733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-scripts" (OuterVolumeSpecName: "scripts") pod "7fc565a6-9454-4f75-8b8d-e5f8f92db352" (UID: "7fc565a6-9454-4f75-8b8d-e5f8f92db352"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.870961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc565a6-9454-4f75-8b8d-e5f8f92db352-kube-api-access-fsqmw" (OuterVolumeSpecName: "kube-api-access-fsqmw") pod "7fc565a6-9454-4f75-8b8d-e5f8f92db352" (UID: "7fc565a6-9454-4f75-8b8d-e5f8f92db352"). InnerVolumeSpecName "kube-api-access-fsqmw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.903078 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.903944 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-notification-agent" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904015 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-notification-agent" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.904034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7fc565a6-9454-4f75-8b8d-e5f8f92db352" containerName="nova-cell1-conductor-db-sync" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904042 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc565a6-9454-4f75-8b8d-e5f8f92db352" containerName="nova-cell1-conductor-db-sync" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.904075 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-central-agent" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904083 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-central-agent" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.904103 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="proxy-httpd" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904109 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="proxy-httpd" Nov 21 12:51:16 crc kubenswrapper[4769]: E1121 12:51:16.904120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="sg-core" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904144 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="sg-core" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904427 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7fc565a6-9454-4f75-8b8d-e5f8f92db352" containerName="nova-cell1-conductor-db-sync" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904464 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-central-agent" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904473 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="sg-core" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904481 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="proxy-httpd" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.904489 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" containerName="ceilometer-notification-agent" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.906251 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.908355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-config-data" (OuterVolumeSpecName: "config-data") pod "7fc565a6-9454-4f75-8b8d-e5f8f92db352" (UID: "7fc565a6-9454-4f75-8b8d-e5f8f92db352"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.908689 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.908841 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.908903 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.922087 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.933502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7fc565a6-9454-4f75-8b8d-e5f8f92db352" (UID: "7fc565a6-9454-4f75-8b8d-e5f8f92db352"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.959863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/5b9c59b2-85cd-45c0-8e86-8af5db62de23-kube-api-access-bpbst\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-run-httpd\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960070 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-config-data\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-scripts\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960296 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-log-httpd\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960388 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960414 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960430 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fsqmw\" (UniqueName: \"kubernetes.io/projected/7fc565a6-9454-4f75-8b8d-e5f8f92db352-kube-api-access-fsqmw\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:16 crc kubenswrapper[4769]: I1121 12:51:16.960443 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7fc565a6-9454-4f75-8b8d-e5f8f92db352-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-run-httpd\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-config-data\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-scripts\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-log-httpd\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.061631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/5b9c59b2-85cd-45c0-8e86-8af5db62de23-kube-api-access-bpbst\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.062391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-run-httpd\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.063922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-log-httpd\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.066781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.067275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-scripts\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.067828 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.067905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.067941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-config-data\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.080866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/5b9c59b2-85cd-45c0-8e86-8af5db62de23-kube-api-access-bpbst\") pod \"ceilometer-0\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.299922 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b667b0e6-5127-4b01-a124-c81ccc386e98" path="/var/lib/kubelet/pods/b667b0e6-5127-4b01-a124-c81ccc386e98/volumes" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.321006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.525106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" event={"ID":"7fc565a6-9454-4f75-8b8d-e5f8f92db352","Type":"ContainerDied","Data":"8cf8c32e4ef561dc1da5c5b70ab18e9490c48d7fd83e1c7ef25b60cb3f47d172"} Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.525143 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cf8c32e4ef561dc1da5c5b70ab18e9490c48d7fd83e1c7ef25b60cb3f47d172" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.525218 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.567102 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.575182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.577774 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.577932 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.675220 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.675365 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.675415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ppqb\" (UniqueName: \"kubernetes.io/projected/1c2c59da-2c9a-45db-845a-b052ceb93993-kube-api-access-8ppqb\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.776537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.776665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.776710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8ppqb\" (UniqueName: \"kubernetes.io/projected/1c2c59da-2c9a-45db-845a-b052ceb93993-kube-api-access-8ppqb\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.781831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.783437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.803333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ppqb\" (UniqueName: \"kubernetes.io/projected/1c2c59da-2c9a-45db-845a-b052ceb93993-kube-api-access-8ppqb\") pod \"nova-cell1-conductor-0\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.835946 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.842350 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:17 crc kubenswrapper[4769]: W1121 12:51:17.847272 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b9c59b2_85cd_45c0_8e86_8af5db62de23.slice/crio-c7e69f99b7ef00b5a07c35b5fa3b20b971dc0864e80deb87c8eb3fceec44f6c6 WatchSource:0}: Error finding container c7e69f99b7ef00b5a07c35b5fa3b20b971dc0864e80deb87c8eb3fceec44f6c6: Status 404 returned error can't find the container with id c7e69f99b7ef00b5a07c35b5fa3b20b971dc0864e80deb87c8eb3fceec44f6c6 Nov 21 12:51:17 crc kubenswrapper[4769]: I1121 12:51:17.894756 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:18 crc kubenswrapper[4769]: I1121 12:51:18.422277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:51:18 crc kubenswrapper[4769]: I1121 12:51:18.546366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"1c2c59da-2c9a-45db-845a-b052ceb93993","Type":"ContainerStarted","Data":"710d2e0ffa351bac4d0eff1d1e76a6e3a87324384a2c53f389e82bdf348ef3f9"} Nov 21 12:51:18 crc kubenswrapper[4769]: I1121 12:51:18.548516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerStarted","Data":"c7e69f99b7ef00b5a07c35b5fa3b20b971dc0864e80deb87c8eb3fceec44f6c6"} Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.571228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"1c2c59da-2c9a-45db-845a-b052ceb93993","Type":"ContainerStarted","Data":"d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957"} Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.571848 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.573966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerStarted","Data":"34131a70d04b91827d223c566d59337878dbb542532a1a9c9ce7e78b252202c5"} Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.574000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerStarted","Data":"81b51135e333b3175ac97d6d842ba666c8e2c137e0fd6fcd43b1461e129f6a3a"} Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.606111 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.606083624 podStartE2EDuration="2.606083624s" podCreationTimestamp="2025-11-21 12:51:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:19.596110853 +0000 UTC m=+3638.296772681" watchObservedRunningTime="2025-11-21 12:51:19.606083624 +0000 UTC m=+3638.306745482" Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.786430 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.786487 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.801504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:19 crc kubenswrapper[4769]: I1121 12:51:19.801680 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:20 crc kubenswrapper[4769]: I1121 12:51:20.588094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerStarted","Data":"b40413e8c25392c4ebf5c8423bc99563f10d161f91972a9d54484ed713c46067"} Nov 21 12:51:20 crc kubenswrapper[4769]: I1121 12:51:20.801518 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.132:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:20 crc kubenswrapper[4769]: I1121 12:51:20.801560 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.132:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:20 crc kubenswrapper[4769]: I1121 12:51:20.883396 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.133:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:20 crc kubenswrapper[4769]: I1121 12:51:20.883397 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.133:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:22 crc kubenswrapper[4769]: I1121 12:51:22.616111 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerStarted","Data":"7f077860b2408554a8f233177aa4f4a336a9590a33617256ad8c0c932fdf71ff"} Nov 21 12:51:22 crc kubenswrapper[4769]: I1121 12:51:22.616675 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:22 crc kubenswrapper[4769]: I1121 12:51:22.644252 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.566921855 podStartE2EDuration="6.644241983s" podCreationTimestamp="2025-11-21 12:51:16 +0000 UTC" firstStartedPulling="2025-11-21 12:51:17.85100266 +0000 UTC m=+3636.551664498" lastFinishedPulling="2025-11-21 12:51:21.928322768 +0000 UTC m=+3640.628984626" observedRunningTime="2025-11-21 12:51:22.643738019 +0000 UTC m=+3641.344399877" watchObservedRunningTime="2025-11-21 12:51:22.644241983 +0000 UTC m=+3641.344903801" Nov 21 12:51:22 crc kubenswrapper[4769]: I1121 12:51:22.831493 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:22 crc kubenswrapper[4769]: I1121 12:51:22.835271 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:22 crc kubenswrapper[4769]: I1121 12:51:22.893718 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.077302 4769 scope.go:117] "RemoveContainer" containerID="d4ea3af4842648fb4ad7104c028c874cf1ffc79a30e861a191287a78d18c64ba" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.104425 4769 scope.go:117] "RemoveContainer" containerID="8ddb655d6fe8a329261b4a78e3030b8b3c518115d98ca16fb73b0978963b8c68" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.175587 4769 scope.go:117] "RemoveContainer" containerID="30ff22077c52b23945531587c6ab17c12f5dace9b120813b6ae1b86f680ee1cc" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.217858 4769 scope.go:117] "RemoveContainer" containerID="eb08559c754c092bc1c0d20287519cca4297fe379ae89270ff8f1adc6cf498ab" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.242380 4769 scope.go:117] "RemoveContainer" containerID="4c28531219c8efbaa37de55e1d8eed2042fb62ab2c238f6bf4c4988a3a8f43d7" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.301258 4769 scope.go:117] "RemoveContainer" containerID="c78c90ba9fd8184a542aba3937ae75f62712bcd2eea3b2202ea3d8d4bb615c62" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.330145 4769 scope.go:117] "RemoveContainer" containerID="619ccfe65b0cee9b2672cb225974f9f89105e1de9a911b41e5ef3c62af66fc65" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.391681 4769 scope.go:117] "RemoveContainer" containerID="61a3120144d8bfd40133bf667a68c3d2d5b7ef4d7a2e545a3a3733f8d504c34c" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.420241 4769 scope.go:117] "RemoveContainer" containerID="5e37766e0cc8f0454c5e8ceb91238c3d60d326c7563a0d29d8febda4bf390814" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.462533 4769 scope.go:117] "RemoveContainer" containerID="97a9e19b11e737a04c0983227e24c3355c7fc97cbc953b01c547aa972f3b1445" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.491120 4769 scope.go:117] "RemoveContainer" containerID="2f7f7f98a870dbf12ccacfebdd086b9adde83dc9bb77deff51dfff3258774418" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.524377 4769 scope.go:117] "RemoveContainer" containerID="c22b152459ac64dcc18bc3a178f69f96bcf6eb13092d379e4b03db1548875160" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.559340 4769 scope.go:117] "RemoveContainer" containerID="b1fda8208f729ca984f00f82d7ce234d4d3241e7f7ea100f7e732d4e58481d2d" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.582759 4769 scope.go:117] "RemoveContainer" containerID="169f6f0dc7f9175300da2ec97a1d9938bda7b7301f2f9d48cbd6fb6270944bc7" Nov 21 12:51:23 crc kubenswrapper[4769]: I1121 12:51:23.678427 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:27 crc kubenswrapper[4769]: I1121 12:51:27.936280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.422583 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg"] Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.423813 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.430327 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.430758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.442712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg"] Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.508729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-config-data\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.508827 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-scripts\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.508851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dkcl\" (UniqueName: \"kubernetes.io/projected/27994bbe-75df-4c59-bb4b-b1c8464659df-kube-api-access-6dkcl\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.508904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.611293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.612159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-config-data\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.612434 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-scripts\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.612625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6dkcl\" (UniqueName: \"kubernetes.io/projected/27994bbe-75df-4c59-bb4b-b1c8464659df-kube-api-access-6dkcl\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.620253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-config-data\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.624657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-scripts\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.630556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.634966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dkcl\" (UniqueName: \"kubernetes.io/projected/27994bbe-75df-4c59-bb4b-b1c8464659df-kube-api-access-6dkcl\") pod \"nova-cell1-cell-mapping-srdmg\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:28 crc kubenswrapper[4769]: I1121 12:51:28.743407 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.892244 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg"] Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.894397 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.895956 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.897088 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.906461 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.906570 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.911931 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:29 crc kubenswrapper[4769]: I1121 12:51:29.915895 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:30 crc kubenswrapper[4769]: I1121 12:51:30.909116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" event={"ID":"27994bbe-75df-4c59-bb4b-b1c8464659df","Type":"ContainerStarted","Data":"d5e7791f66a241b5726dea732e676438190334ed853ab3acc8fcf560559ab42e"} Nov 21 12:51:30 crc kubenswrapper[4769]: I1121 12:51:30.911723 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:30 crc kubenswrapper[4769]: I1121 12:51:30.911960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" event={"ID":"27994bbe-75df-4c59-bb4b-b1c8464659df","Type":"ContainerStarted","Data":"0820e85e369235e2a51f207a99648c18c11f019cbc8d2e79f4d1995f170f2a87"} Nov 21 12:51:30 crc kubenswrapper[4769]: I1121 12:51:30.913905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:30 crc kubenswrapper[4769]: I1121 12:51:30.916035 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:30 crc kubenswrapper[4769]: I1121 12:51:30.931490 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" podStartSLOduration=2.931469636 podStartE2EDuration="2.931469636s" podCreationTimestamp="2025-11-21 12:51:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:30.925272527 +0000 UTC m=+3649.625934385" watchObservedRunningTime="2025-11-21 12:51:30.931469636 +0000 UTC m=+3649.632131494" Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.693142 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.693525 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-central-agent" containerID="cri-o://81b51135e333b3175ac97d6d842ba666c8e2c137e0fd6fcd43b1461e129f6a3a" gracePeriod=30 Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.693571 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="proxy-httpd" containerID="cri-o://7f077860b2408554a8f233177aa4f4a336a9590a33617256ad8c0c932fdf71ff" gracePeriod=30 Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.693652 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-notification-agent" containerID="cri-o://34131a70d04b91827d223c566d59337878dbb542532a1a9c9ce7e78b252202c5" gracePeriod=30 Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.693656 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="sg-core" containerID="cri-o://b40413e8c25392c4ebf5c8423bc99563f10d161f91972a9d54484ed713c46067" gracePeriod=30 Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.705571 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.933024 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerID="7f077860b2408554a8f233177aa4f4a336a9590a33617256ad8c0c932fdf71ff" exitCode=0 Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.933053 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerID="b40413e8c25392c4ebf5c8423bc99563f10d161f91972a9d54484ed713c46067" exitCode=2 Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.933858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerDied","Data":"7f077860b2408554a8f233177aa4f4a336a9590a33617256ad8c0c932fdf71ff"} Nov 21 12:51:32 crc kubenswrapper[4769]: I1121 12:51:32.933889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerDied","Data":"b40413e8c25392c4ebf5c8423bc99563f10d161f91972a9d54484ed713c46067"} Nov 21 12:51:33 crc kubenswrapper[4769]: I1121 12:51:33.820141 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:33 crc kubenswrapper[4769]: I1121 12:51:33.947434 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerID="81b51135e333b3175ac97d6d842ba666c8e2c137e0fd6fcd43b1461e129f6a3a" exitCode=0 Nov 21 12:51:33 crc kubenswrapper[4769]: I1121 12:51:33.947650 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-log" containerID="cri-o://39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823" gracePeriod=30 Nov 21 12:51:33 crc kubenswrapper[4769]: I1121 12:51:33.947948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerDied","Data":"81b51135e333b3175ac97d6d842ba666c8e2c137e0fd6fcd43b1461e129f6a3a"} Nov 21 12:51:33 crc kubenswrapper[4769]: I1121 12:51:33.948310 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-api" containerID="cri-o://4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e" gracePeriod=30 Nov 21 12:51:34 crc kubenswrapper[4769]: I1121 12:51:34.958176 4769 generic.go:334] "Generic (PLEG): container finished" podID="27994bbe-75df-4c59-bb4b-b1c8464659df" containerID="d5e7791f66a241b5726dea732e676438190334ed853ab3acc8fcf560559ab42e" exitCode=0 Nov 21 12:51:34 crc kubenswrapper[4769]: I1121 12:51:34.958230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" event={"ID":"27994bbe-75df-4c59-bb4b-b1c8464659df","Type":"ContainerDied","Data":"d5e7791f66a241b5726dea732e676438190334ed853ab3acc8fcf560559ab42e"} Nov 21 12:51:34 crc kubenswrapper[4769]: I1121 12:51:34.961001 4769 generic.go:334] "Generic (PLEG): container finished" podID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerID="39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823" exitCode=143 Nov 21 12:51:34 crc kubenswrapper[4769]: I1121 12:51:34.961062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8","Type":"ContainerDied","Data":"39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823"} Nov 21 12:51:34 crc kubenswrapper[4769]: I1121 12:51:34.964479 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerID="34131a70d04b91827d223c566d59337878dbb542532a1a9c9ce7e78b252202c5" exitCode=0 Nov 21 12:51:34 crc kubenswrapper[4769]: I1121 12:51:34.964533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerDied","Data":"34131a70d04b91827d223c566d59337878dbb542532a1a9c9ce7e78b252202c5"} Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.093337 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-combined-ca-bundle\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194709 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/5b9c59b2-85cd-45c0-8e86-8af5db62de23-kube-api-access-bpbst\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-sg-core-conf-yaml\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-config-data\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194821 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-run-httpd\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-ceilometer-tls-certs\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-scripts\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.194968 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-log-httpd\") pod \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\" (UID: \"5b9c59b2-85cd-45c0-8e86-8af5db62de23\") " Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.195665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.195693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.200485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-scripts" (OuterVolumeSpecName: "scripts") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.201968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9c59b2-85cd-45c0-8e86-8af5db62de23-kube-api-access-bpbst" (OuterVolumeSpecName: "kube-api-access-bpbst") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "kube-api-access-bpbst". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.232694 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.261681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.296926 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/5b9c59b2-85cd-45c0-8e86-8af5db62de23-kube-api-access-bpbst\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.296957 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.296967 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.296978 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.296987 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.296995 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5b9c59b2-85cd-45c0-8e86-8af5db62de23-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.300387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.313900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-config-data" (OuterVolumeSpecName: "config-data") pod "5b9c59b2-85cd-45c0-8e86-8af5db62de23" (UID: "5b9c59b2-85cd-45c0-8e86-8af5db62de23"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.398302 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.398333 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b9c59b2-85cd-45c0-8e86-8af5db62de23-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.984069 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.984262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5b9c59b2-85cd-45c0-8e86-8af5db62de23","Type":"ContainerDied","Data":"c7e69f99b7ef00b5a07c35b5fa3b20b971dc0864e80deb87c8eb3fceec44f6c6"} Nov 21 12:51:35 crc kubenswrapper[4769]: I1121 12:51:35.984584 4769 scope.go:117] "RemoveContainer" containerID="7f077860b2408554a8f233177aa4f4a336a9590a33617256ad8c0c932fdf71ff" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.016042 4769 scope.go:117] "RemoveContainer" containerID="b40413e8c25392c4ebf5c8423bc99563f10d161f91972a9d54484ed713c46067" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.037661 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.044611 4769 scope.go:117] "RemoveContainer" containerID="34131a70d04b91827d223c566d59337878dbb542532a1a9c9ce7e78b252202c5" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.048840 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.084156 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:36 crc kubenswrapper[4769]: E1121 12:51:36.085627 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-central-agent" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.085655 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-central-agent" Nov 21 12:51:36 crc kubenswrapper[4769]: E1121 12:51:36.085684 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="proxy-httpd" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.085694 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="proxy-httpd" Nov 21 12:51:36 crc kubenswrapper[4769]: E1121 12:51:36.085716 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="sg-core" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.085726 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="sg-core" Nov 21 12:51:36 crc kubenswrapper[4769]: E1121 12:51:36.085747 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-notification-agent" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.085755 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-notification-agent" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.086002 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-notification-agent" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.086019 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="ceilometer-central-agent" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.086043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="proxy-httpd" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.086060 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" containerName="sg-core" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.088537 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.091816 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.094766 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.095917 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.102488 4769 scope.go:117] "RemoveContainer" containerID="81b51135e333b3175ac97d6d842ba666c8e2c137e0fd6fcd43b1461e129f6a3a" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.106148 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-scripts\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-config-data\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-run-httpd\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-log-httpd\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gffj8\" (UniqueName: \"kubernetes.io/projected/a56fc867-8d61-48c3-afb1-58589d785023-kube-api-access-gffj8\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.224837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.326869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-log-httpd\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327304 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gffj8\" (UniqueName: \"kubernetes.io/projected/a56fc867-8d61-48c3-afb1-58589d785023-kube-api-access-gffj8\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-scripts\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-config-data\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-log-httpd\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.327707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.329777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-run-httpd\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.330968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-run-httpd\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.335986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.335989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.339403 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-config-data\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.341875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.351295 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-scripts\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.353173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gffj8\" (UniqueName: \"kubernetes.io/projected/a56fc867-8d61-48c3-afb1-58589d785023-kube-api-access-gffj8\") pod \"ceilometer-0\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.417013 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.417952 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.555013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.634437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dkcl\" (UniqueName: \"kubernetes.io/projected/27994bbe-75df-4c59-bb4b-b1c8464659df-kube-api-access-6dkcl\") pod \"27994bbe-75df-4c59-bb4b-b1c8464659df\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.634601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-scripts\") pod \"27994bbe-75df-4c59-bb4b-b1c8464659df\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.634729 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-config-data\") pod \"27994bbe-75df-4c59-bb4b-b1c8464659df\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.634780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-combined-ca-bundle\") pod \"27994bbe-75df-4c59-bb4b-b1c8464659df\" (UID: \"27994bbe-75df-4c59-bb4b-b1c8464659df\") " Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.641929 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-scripts" (OuterVolumeSpecName: "scripts") pod "27994bbe-75df-4c59-bb4b-b1c8464659df" (UID: "27994bbe-75df-4c59-bb4b-b1c8464659df"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.642486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27994bbe-75df-4c59-bb4b-b1c8464659df-kube-api-access-6dkcl" (OuterVolumeSpecName: "kube-api-access-6dkcl") pod "27994bbe-75df-4c59-bb4b-b1c8464659df" (UID: "27994bbe-75df-4c59-bb4b-b1c8464659df"). InnerVolumeSpecName "kube-api-access-6dkcl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.675892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-config-data" (OuterVolumeSpecName: "config-data") pod "27994bbe-75df-4c59-bb4b-b1c8464659df" (UID: "27994bbe-75df-4c59-bb4b-b1c8464659df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.685981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "27994bbe-75df-4c59-bb4b-b1c8464659df" (UID: "27994bbe-75df-4c59-bb4b-b1c8464659df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.737414 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6dkcl\" (UniqueName: \"kubernetes.io/projected/27994bbe-75df-4c59-bb4b-b1c8464659df-kube-api-access-6dkcl\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.737470 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.737489 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.737507 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27994bbe-75df-4c59-bb4b-b1c8464659df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:36 crc kubenswrapper[4769]: W1121 12:51:36.871678 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda56fc867_8d61_48c3_afb1_58589d785023.slice/crio-362a0b221d87dccce7b9734082b8e897b99853a236cf7dca620141ff88caccdd WatchSource:0}: Error finding container 362a0b221d87dccce7b9734082b8e897b99853a236cf7dca620141ff88caccdd: Status 404 returned error can't find the container with id 362a0b221d87dccce7b9734082b8e897b99853a236cf7dca620141ff88caccdd Nov 21 12:51:36 crc kubenswrapper[4769]: I1121 12:51:36.872707 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.000691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" event={"ID":"27994bbe-75df-4c59-bb4b-b1c8464659df","Type":"ContainerDied","Data":"0820e85e369235e2a51f207a99648c18c11f019cbc8d2e79f4d1995f170f2a87"} Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.000737 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0820e85e369235e2a51f207a99648c18c11f019cbc8d2e79f4d1995f170f2a87" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.000777 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.002699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerStarted","Data":"362a0b221d87dccce7b9734082b8e897b99853a236cf7dca620141ff88caccdd"} Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.152629 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.153363 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" containerName="nova-scheduler-scheduler" containerID="cri-o://e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc" gracePeriod=30 Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.168936 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.169265 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-log" containerID="cri-o://5a35763039d93b1f80d4fa47c4b6b3e0cf2389991f7ccb4345b212a637b2b8a5" gracePeriod=30 Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.169370 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-metadata" containerID="cri-o://567b9441e1e27697fb8f00b3dca199891e2d3f8b1cd6c6358812c0a6bcbd8691" gracePeriod=30 Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.291803 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b9c59b2-85cd-45c0-8e86-8af5db62de23" path="/var/lib/kubelet/pods/5b9c59b2-85cd-45c0-8e86-8af5db62de23/volumes" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.650463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.759485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d75nh\" (UniqueName: \"kubernetes.io/projected/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-kube-api-access-d75nh\") pod \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.760566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-combined-ca-bundle\") pod \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.760636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-logs\") pod \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.760696 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-config-data\") pod \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\" (UID: \"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8\") " Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.761831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-logs" (OuterVolumeSpecName: "logs") pod "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" (UID: "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.762281 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.764203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-kube-api-access-d75nh" (OuterVolumeSpecName: "kube-api-access-d75nh") pod "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" (UID: "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8"). InnerVolumeSpecName "kube-api-access-d75nh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.788689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-config-data" (OuterVolumeSpecName: "config-data") pod "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" (UID: "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.811349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" (UID: "6cdb80c3-2af2-4190-9eb1-8a3c683f96f8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:37 crc kubenswrapper[4769]: E1121 12:51:37.840816 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:51:37 crc kubenswrapper[4769]: E1121 12:51:37.842470 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:51:37 crc kubenswrapper[4769]: E1121 12:51:37.844043 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:51:37 crc kubenswrapper[4769]: E1121 12:51:37.844133 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" containerName="nova-scheduler-scheduler" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.864309 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.864368 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.864381 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d75nh\" (UniqueName: \"kubernetes.io/projected/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8-kube-api-access-d75nh\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:37 crc kubenswrapper[4769]: I1121 12:51:37.998575 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.008155 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.024641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerStarted","Data":"d1cb939e2098cb5f72fda4142344bbc24adcb4fa59d5fa78c3af4c696545aaca"} Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.026423 4769 generic.go:334] "Generic (PLEG): container finished" podID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerID="4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e" exitCode=0 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.026485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8","Type":"ContainerDied","Data":"4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e"} Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.026509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6cdb80c3-2af2-4190-9eb1-8a3c683f96f8","Type":"ContainerDied","Data":"6cb364f441623cd729c07eb61d01c6f696a2df216dcab1d3596da53934c24aa7"} Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.026529 4769 scope.go:117] "RemoveContainer" containerID="4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.026659 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.066397 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerID="5a35763039d93b1f80d4fa47c4b6b3e0cf2389991f7ccb4345b212a637b2b8a5" exitCode=143 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.066444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865","Type":"ContainerDied","Data":"5a35763039d93b1f80d4fa47c4b6b3e0cf2389991f7ccb4345b212a637b2b8a5"} Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.082469 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.094315 4769 scope.go:117] "RemoveContainer" containerID="39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.094887 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.112715 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.124848 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.125051 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" containerName="memcached" containerID="cri-o://7bee2832b945087145ffcb590c83369ee975c70b4e0d11a7cf7bd12005f5cec2" gracePeriod=30 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.145825 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: E1121 12:51:38.146297 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27994bbe-75df-4c59-bb4b-b1c8464659df" containerName="nova-manage" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.146310 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="27994bbe-75df-4c59-bb4b-b1c8464659df" containerName="nova-manage" Nov 21 12:51:38 crc kubenswrapper[4769]: E1121 12:51:38.146339 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-api" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.146345 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-api" Nov 21 12:51:38 crc kubenswrapper[4769]: E1121 12:51:38.146359 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-log" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.146365 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-log" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.146522 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-api" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.146541 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" containerName="nova-api-log" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.146559 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="27994bbe-75df-4c59-bb4b-b1c8464659df" containerName="nova-manage" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.147517 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.157360 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.157646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.157853 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.193915 4769 scope.go:117] "RemoveContainer" containerID="4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e" Nov 21 12:51:38 crc kubenswrapper[4769]: E1121 12:51:38.211743 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e\": container with ID starting with 4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e not found: ID does not exist" containerID="4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.211788 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e"} err="failed to get container status \"4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e\": rpc error: code = NotFound desc = could not find container \"4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e\": container with ID starting with 4fff133757cc44a5e6945f38907a757bad15649d99ea2cc056bba0277a24cb8e not found: ID does not exist" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.211820 4769 scope.go:117] "RemoveContainer" containerID="39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823" Nov 21 12:51:38 crc kubenswrapper[4769]: E1121 12:51:38.215532 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823\": container with ID starting with 39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823 not found: ID does not exist" containerID="39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.215610 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823"} err="failed to get container status \"39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823\": rpc error: code = NotFound desc = could not find container \"39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823\": container with ID starting with 39aaca239f18cf6e0d7aa820dc82d5fabc5771dbd394f94a091925bc6160b823 not found: ID does not exist" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.228491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbt62\" (UniqueName: \"kubernetes.io/projected/23a5ec8e-ba2d-4836-83dc-0f95131d4838-kube-api-access-sbt62\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.228610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-internal-tls-certs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.228689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.228733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/23a5ec8e-ba2d-4836-83dc-0f95131d4838-logs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.228762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-public-tls-certs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.228819 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-config-data\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.238227 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.330657 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.331252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sbt62\" (UniqueName: \"kubernetes.io/projected/23a5ec8e-ba2d-4836-83dc-0f95131d4838-kube-api-access-sbt62\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.331318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-internal-tls-certs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.331358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.331384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/23a5ec8e-ba2d-4836-83dc-0f95131d4838-logs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.331407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-public-tls-certs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.331436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-config-data\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.335460 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/23a5ec8e-ba2d-4836-83dc-0f95131d4838-logs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.343860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-internal-tls-certs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.346776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-public-tls-certs\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.349318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.354591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-config-data\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.380709 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbt62\" (UniqueName: \"kubernetes.io/projected/23a5ec8e-ba2d-4836-83dc-0f95131d4838-kube-api-access-sbt62\") pod \"nova-api-0\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.479444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.530316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bpxnn"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.613852 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-djs2n"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.645324 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bpxnn"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.650991 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-djs2n"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.663239 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7c586"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.669452 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-7c586"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.678979 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.679904 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="openstack-network-exporter" containerID="cri-o://b29db688e2acae5247042350da5dc5728d4cb6e2c0f98b7fdad4bcb286591d34" gracePeriod=300 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.686075 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-xnpwk"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.740432 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-xnpwk"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.775649 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75gt6"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.777004 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.790200 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.799250 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75gt6"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.812769 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vzssb"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.814026 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.817079 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-d5w65"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.820085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.820326 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="ovsdbserver-sb" containerID="cri-o://bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5" gracePeriod=300 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.835207 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vzssb"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.846887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-config-data\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.846925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-db-sync-config-data\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.846956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-combined-ca-bundle\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.847089 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxfk\" (UniqueName: \"kubernetes.io/projected/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-kube-api-access-pmxfk\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.858782 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-d5w65"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.900146 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.900439 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="958a6399-8efa-4703-a612-528546972586" containerName="ovn-northd" containerID="cri-o://7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" gracePeriod=30 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.900851 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="958a6399-8efa-4703-a612-528546972586" containerName="openstack-network-exporter" containerID="cri-o://5c7c8df63643bb12b59eb23d35cf2050591d4e22ecfad274f62645c670517a20" gracePeriod=30 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.926235 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-wvb9n"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.927727 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.939355 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-wvb9n"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.949905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-config-data\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.949954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-db-sync-config-data\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.949986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-combined-ca-bundle\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-combined-ca-bundle\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxfk\" (UniqueName: \"kubernetes.io/projected/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-kube-api-access-pmxfk\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-scripts\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-combined-ca-bundle\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-config-data\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-logs\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-config-data\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8j4\" (UniqueName: \"kubernetes.io/projected/ce32d94f-d365-4adc-a1aa-362b3a0fceba-kube-api-access-xr8j4\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.950376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdkd9\" (UniqueName: \"kubernetes.io/projected/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-kube-api-access-fdkd9\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.965925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-db-sync-config-data\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.970378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-config-data\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.973487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-combined-ca-bundle\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.974217 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.975170 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="openstack-network-exporter" containerID="cri-o://c9ab3bc114246c79bbd1d600d35d80b2fb57760bc20868d0c5b0cf8435d11dbd" gracePeriod=300 Nov 21 12:51:38 crc kubenswrapper[4769]: I1121 12:51:38.993093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxfk\" (UniqueName: \"kubernetes.io/projected/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-kube-api-access-pmxfk\") pod \"glance-db-sync-75gt6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.039654 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerName="galera" containerID="cri-o://6bda79a077d92c7831c16878d761e913a69a5bfc58776708e95b6a11c60b0f20" gracePeriod=30 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/235b264a-c7e8-465d-a791-b01776cb8e77-etc-machine-id\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-config-data\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-config-data\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-scripts\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-logs\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059813 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-combined-ca-bundle\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-config-data\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-db-sync-config-data\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.059920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8j4\" (UniqueName: \"kubernetes.io/projected/ce32d94f-d365-4adc-a1aa-362b3a0fceba-kube-api-access-xr8j4\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.060008 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57wgn\" (UniqueName: \"kubernetes.io/projected/235b264a-c7e8-465d-a791-b01776cb8e77-kube-api-access-57wgn\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.060031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fdkd9\" (UniqueName: \"kubernetes.io/projected/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-kube-api-access-fdkd9\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.060151 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-combined-ca-bundle\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.060395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-logs\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.068563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-sg9sp"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.069062 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-sg9sp"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.070390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-scripts\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.070444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-config-data\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.070762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-combined-ca-bundle\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.071883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-config-data\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.073996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-scripts\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.101277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-combined-ca-bundle\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.101848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-combined-ca-bundle\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.104884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8j4\" (UniqueName: \"kubernetes.io/projected/ce32d94f-d365-4adc-a1aa-362b3a0fceba-kube-api-access-xr8j4\") pod \"keystone-db-sync-vzssb\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.108654 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="ovsdbserver-nb" containerID="cri-o://5a75dad19aa42c3760429244da833580790947a6560d35b71702d8af6e3b87e8" gracePeriod=300 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.110410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdkd9\" (UniqueName: \"kubernetes.io/projected/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-kube-api-access-fdkd9\") pod \"placement-db-sync-d5w65\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.128329 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="galera" containerID="cri-o://00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f" gracePeriod=29 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.140730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerStarted","Data":"9da402703eec3f97f365193285e16cda6e2051aef09bc6981334db3df005aa6c"} Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.140855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.154358 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184017 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-db-sync-config-data\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184726 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-57wgn\" (UniqueName: \"kubernetes.io/projected/235b264a-c7e8-465d-a791-b01776cb8e77-kube-api-access-57wgn\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/235b264a-c7e8-465d-a791-b01776cb8e77-etc-machine-id\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-config-data\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-scripts\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.184906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-combined-ca-bundle\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.189931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/235b264a-c7e8-465d-a791-b01776cb8e77-etc-machine-id\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.192461 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-8z8jj"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.193792 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.195112 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-combined-ca-bundle\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.195554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-db-sync-config-data\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.197112 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_297dac89-7b00-4c59-b9c7-20618457ff4f/ovsdbserver-sb/0.log" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.197144 4769 generic.go:334] "Generic (PLEG): container finished" podID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerID="b29db688e2acae5247042350da5dc5728d4cb6e2c0f98b7fdad4bcb286591d34" exitCode=2 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.197160 4769 generic.go:334] "Generic (PLEG): container finished" podID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerID="bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5" exitCode=143 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.197247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"297dac89-7b00-4c59-b9c7-20618457ff4f","Type":"ContainerDied","Data":"b29db688e2acae5247042350da5dc5728d4cb6e2c0f98b7fdad4bcb286591d34"} Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.197311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-config-data\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.197332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"297dac89-7b00-4c59-b9c7-20618457ff4f","Type":"ContainerDied","Data":"bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5"} Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.202133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-scripts\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.208964 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-8z8jj"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.211769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-57wgn\" (UniqueName: \"kubernetes.io/projected/235b264a-c7e8-465d-a791-b01776cb8e77-kube-api-access-57wgn\") pod \"cinder-db-sync-wvb9n\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.220030 4769 generic.go:334] "Generic (PLEG): container finished" podID="958a6399-8efa-4703-a612-528546972586" containerID="5c7c8df63643bb12b59eb23d35cf2050591d4e22ecfad274f62645c670517a20" exitCode=2 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.220063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"958a6399-8efa-4703-a612-528546972586","Type":"ContainerDied","Data":"5c7c8df63643bb12b59eb23d35cf2050591d4e22ecfad274f62645c670517a20"} Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.288712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-combined-ca-bundle\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.288771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kr42\" (UniqueName: \"kubernetes.io/projected/4b34285f-f704-420c-a395-eb7bcdaef6c5-kube-api-access-6kr42\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.288855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-config\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.323775 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021c214f-187f-4bec-9938-f41139eba221" path="/var/lib/kubelet/pods/021c214f-187f-4bec-9938-f41139eba221/volumes" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.326421 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2e8724-a026-4cb0-9c45-4059b9c42e91" path="/var/lib/kubelet/pods/4d2e8724-a026-4cb0-9c45-4059b9c42e91/volumes" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.326953 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5230efa8-6d27-4741-b21b-4b7abb304abf" path="/var/lib/kubelet/pods/5230efa8-6d27-4741-b21b-4b7abb304abf/volumes" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.330417 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cdb80c3-2af2-4190-9eb1-8a3c683f96f8" path="/var/lib/kubelet/pods/6cdb80c3-2af2-4190-9eb1-8a3c683f96f8/volumes" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.331666 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c477f4d1-5801-48f9-82bb-9808a7833249" path="/var/lib/kubelet/pods/c477f4d1-5801-48f9-82bb-9808a7833249/volumes" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.334471 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb43f65e-1c25-4b63-b1c6-6b4e196376a9" path="/var/lib/kubelet/pods/fb43f65e-1c25-4b63-b1c6-6b4e196376a9/volumes" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.352486 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.352700 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://814a769f00d0c46c2f7679380c85f2debf5f58aca2ca2bc1a7efee01f7a8d26e" gracePeriod=30 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.394232 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-config\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.394349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-combined-ca-bundle\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.394382 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6kr42\" (UniqueName: \"kubernetes.io/projected/4b34285f-f704-420c-a395-eb7bcdaef6c5-kube-api-access-6kr42\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.404523 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.407665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-config\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.408100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-combined-ca-bundle\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.434957 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.499415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kr42\" (UniqueName: \"kubernetes.io/projected/4b34285f-f704-420c-a395-eb7bcdaef6c5-kube-api-access-6kr42\") pod \"neutron-db-sync-8z8jj\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.567627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:51:39 crc kubenswrapper[4769]: W1121 12:51:39.579466 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a5ec8e_ba2d_4836_83dc_0f95131d4838.slice/crio-7d315bbc2a6b5960f3bd1a73d68993d47a16bd78a0db3a9bbe62d1172bda6a47 WatchSource:0}: Error finding container 7d315bbc2a6b5960f3bd1a73d68993d47a16bd78a0db3a9bbe62d1172bda6a47: Status 404 returned error can't find the container with id 7d315bbc2a6b5960f3bd1a73d68993d47a16bd78a0db3a9bbe62d1172bda6a47 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.600597 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.605336 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="abec82e3-8477-40cc-a42c-3a67fe46ecba" containerName="kube-state-metrics" containerID="cri-o://d4f1f5d51d650e636fc79d365a01d8f04b9fe6abb11ba80f5ac792ffad67501a" gracePeriod=30 Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.647528 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvrls"] Nov 21 12:51:39 crc kubenswrapper[4769]: E1121 12:51:39.676761 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5 is running failed: container process not found" containerID="bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:51:39 crc kubenswrapper[4769]: E1121 12:51:39.692104 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5 is running failed: container process not found" containerID="bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:51:39 crc kubenswrapper[4769]: E1121 12:51:39.693119 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5 is running failed: container process not found" containerID="bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:51:39 crc kubenswrapper[4769]: E1121 12:51:39.693163 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="ovsdbserver-sb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.753665 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvrls"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.858304 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ncqj5"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.933420 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ncqj5"] Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.982887 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_297dac89-7b00-4c59-b9c7-20618457ff4f/ovsdbserver-sb/0.log" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.983233 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.983351 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-hn7gb"] Nov 21 12:51:39 crc kubenswrapper[4769]: E1121 12:51:39.983828 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="openstack-network-exporter" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.983845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="openstack-network-exporter" Nov 21 12:51:39 crc kubenswrapper[4769]: E1121 12:51:39.983861 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="ovsdbserver-sb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.983867 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="ovsdbserver-sb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.984075 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="ovsdbserver-sb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.984094 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" containerName="openstack-network-exporter" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.984869 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.988461 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:51:39 crc kubenswrapper[4769]: I1121 12:51:39.989257 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.041390 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-b4xl4"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.042619 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.085889 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.085952 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-b4xl4"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091451 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-server" containerID="cri-o://89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091638 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="swift-recon-cron" containerID="cri-o://e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091677 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="rsync" containerID="cri-o://1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091710 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-expirer" containerID="cri-o://ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091738 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-updater" containerID="cri-o://f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091767 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-auditor" containerID="cri-o://71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091792 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-replicator" containerID="cri-o://ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091821 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-server" containerID="cri-o://9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091853 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-updater" containerID="cri-o://4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091883 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-auditor" containerID="cri-o://f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091914 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-replicator" containerID="cri-o://cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091941 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-server" containerID="cri-o://4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.091989 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-reaper" containerID="cri-o://34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092017 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-auditor" containerID="cri-o://ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092059 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-replicator" containerID="cri-o://81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814" gracePeriod=30 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092317 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-combined-ca-bundle\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-config\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-metrics-certs-tls-certs\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st8dh\" (UniqueName: \"kubernetes.io/projected/297dac89-7b00-4c59-b9c7-20618457ff4f-kube-api-access-st8dh\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-scripts\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdbserver-sb-tls-certs\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdb-rundir\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"297dac89-7b00-4c59-b9c7-20618457ff4f\" (UID: \"297dac89-7b00-4c59-b9c7-20618457ff4f\") " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.092951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-scripts\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-ring-data-devices\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-swiftconf\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-dispersionconf\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpld9\" (UniqueName: \"kubernetes.io/projected/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-kube-api-access-zpld9\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-combined-ca-bundle\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093218 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-etc-swift\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-config" (OuterVolumeSpecName: "config") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.093758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-scripts" (OuterVolumeSpecName: "scripts") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.096825 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.102336 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-hn7gb"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.181058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.183400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.197342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-ring-data-devices\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-swiftconf\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-dispersionconf\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zpld9\" (UniqueName: \"kubernetes.io/projected/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-kube-api-access-zpld9\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-db-sync-config-data\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-combined-ca-bundle\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crktb\" (UniqueName: \"kubernetes.io/projected/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-kube-api-access-crktb\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-etc-swift\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-scripts\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-combined-ca-bundle\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208847 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208860 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208881 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.208890 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297dac89-7b00-4c59-b9c7-20618457ff4f-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.210832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-ring-data-devices\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.213722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-etc-swift\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.214788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-scripts\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.218074 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297dac89-7b00-4c59-b9c7-20618457ff4f-kube-api-access-st8dh" (OuterVolumeSpecName: "kube-api-access-st8dh") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "kube-api-access-st8dh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.223765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-swiftconf\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.223914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-dispersionconf\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.229688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-combined-ca-bundle\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.232248 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-72tdc"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.251486 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpld9\" (UniqueName: \"kubernetes.io/projected/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-kube-api-access-zpld9\") pod \"swift-ring-rebalance-hn7gb\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.258263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"23a5ec8e-ba2d-4836-83dc-0f95131d4838","Type":"ContainerStarted","Data":"7d315bbc2a6b5960f3bd1a73d68993d47a16bd78a0db3a9bbe62d1172bda6a47"} Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.261647 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-fdllc"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.304082 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_297dac89-7b00-4c59-b9c7-20618457ff4f/ovsdbserver-sb/0.log" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.305153 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.309239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"297dac89-7b00-4c59-b9c7-20618457ff4f","Type":"ContainerDied","Data":"21e716519fae7de684c2c13a54996a4ecaf5208de44be09fae5e6f1fb3ea1a0b"} Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.309301 4769 scope.go:117] "RemoveContainer" containerID="b29db688e2acae5247042350da5dc5728d4cb6e2c0f98b7fdad4bcb286591d34" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.310212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-db-sync-config-data\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.310317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-crktb\" (UniqueName: \"kubernetes.io/projected/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-kube-api-access-crktb\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.310400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-combined-ca-bundle\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.313616 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-st8dh\" (UniqueName: \"kubernetes.io/projected/297dac89-7b00-4c59-b9c7-20618457ff4f-kube-api-access-st8dh\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.317521 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.319426 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.319914 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.336014 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.340567 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.341699 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.343022 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.355111 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.359010 4769 generic.go:334] "Generic (PLEG): container finished" podID="abec82e3-8477-40cc-a42c-3a67fe46ecba" containerID="d4f1f5d51d650e636fc79d365a01d8f04b9fe6abb11ba80f5ac792ffad67501a" exitCode=2 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.359151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"abec82e3-8477-40cc-a42c-3a67fe46ecba","Type":"ContainerDied","Data":"d4f1f5d51d650e636fc79d365a01d8f04b9fe6abb11ba80f5ac792ffad67501a"} Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.359921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-crktb\" (UniqueName: \"kubernetes.io/projected/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-kube-api-access-crktb\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.374873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-combined-ca-bundle\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.378628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-db-sync-config-data\") pod \"barbican-db-sync-b4xl4\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.403255 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.412558 4769 generic.go:334] "Generic (PLEG): container finished" podID="b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" containerID="7bee2832b945087145ffcb590c83369ee975c70b4e0d11a7cf7bd12005f5cec2" exitCode=0 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.412662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8","Type":"ContainerDied","Data":"7bee2832b945087145ffcb590c83369ee975c70b4e0d11a7cf7bd12005f5cec2"} Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.416424 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.430718 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.441265 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_47e271a1-6724-41f1-bb76-3ff682490126/ovsdbserver-nb/0.log" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.441316 4769 generic.go:334] "Generic (PLEG): container finished" podID="47e271a1-6724-41f1-bb76-3ff682490126" containerID="c9ab3bc114246c79bbd1d600d35d80b2fb57760bc20868d0c5b0cf8435d11dbd" exitCode=2 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.441333 4769 generic.go:334] "Generic (PLEG): container finished" podID="47e271a1-6724-41f1-bb76-3ff682490126" containerID="5a75dad19aa42c3760429244da833580790947a6560d35b71702d8af6e3b87e8" exitCode=143 Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.441356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47e271a1-6724-41f1-bb76-3ff682490126","Type":"ContainerDied","Data":"c9ab3bc114246c79bbd1d600d35d80b2fb57760bc20868d0c5b0cf8435d11dbd"} Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.441382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47e271a1-6724-41f1-bb76-3ff682490126","Type":"ContainerDied","Data":"5a75dad19aa42c3760429244da833580790947a6560d35b71702d8af6e3b87e8"} Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.445141 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.132:8775/\": read tcp 10.217.0.2:59978->10.217.1.132:8775: read: connection reset by peer" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.445176 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.132:8775/\": read tcp 10.217.0.2:59980->10.217.1.132:8775: read: connection reset by peer" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.470645 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.493001 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-config-data\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/e527d5f6-ee88-49ac-bf24-c584e56e456f-kube-api-access-jvmfd\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9gr\" (UniqueName: \"kubernetes.io/projected/3c4788f6-80ae-4302-a22f-72204167e813-kube-api-access-jb9gr\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-scripts\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-scripts\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-config-data\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.537728 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.571446 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75gt6"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-config-data\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/e527d5f6-ee88-49ac-bf24-c584e56e456f-kube-api-access-jvmfd\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9gr\" (UniqueName: \"kubernetes.io/projected/3c4788f6-80ae-4302-a22f-72204167e813-kube-api-access-jb9gr\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-scripts\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-scripts\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-config-data\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.640615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.647390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-scripts\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.649365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.649651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-scripts\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.663583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9gr\" (UniqueName: \"kubernetes.io/projected/3c4788f6-80ae-4302-a22f-72204167e813-kube-api-access-jb9gr\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.665646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-config-data\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.669502 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.678001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-config-data\") pod \"nova-cell0-conductor-db-sync-96xzf\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.679073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/e527d5f6-ee88-49ac-bf24-c584e56e456f-kube-api-access-jvmfd\") pod \"nova-cell1-conductor-db-sync-gd9hs\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.762571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.847965 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.903675 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vzssb"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.930251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-d5w65"] Nov 21 12:51:40 crc kubenswrapper[4769]: I1121 12:51:40.956967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "297dac89-7b00-4c59-b9c7-20618457ff4f" (UID: "297dac89-7b00-4c59-b9c7-20618457ff4f"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: W1121 12:51:41.006830 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d8a4433_faf4_4fc3_b6d9_6571fa54dcf2.slice/crio-e2b8819876dd6eb0395611b6237d22e3d81d4a69d15392ec3c05cec27cd594da WatchSource:0}: Error finding container e2b8819876dd6eb0395611b6237d22e3d81d4a69d15392ec3c05cec27cd594da: Status 404 returned error can't find the container with id e2b8819876dd6eb0395611b6237d22e3d81d4a69d15392ec3c05cec27cd594da Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.052738 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/297dac89-7b00-4c59-b9c7-20618457ff4f-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.211786 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.239780 4769 scope.go:117] "RemoveContainer" containerID="bfec78f611eaf95f501c66f66a4b21da93a5937db980485c09256d91b7664fc5" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.249456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.271840 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.309493 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.314678 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0752c05d-d9bd-4946-9948-22e4a3270c4b" path="/var/lib/kubelet/pods/0752c05d-d9bd-4946-9948-22e4a3270c4b/volumes" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.315265 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afb11a7-3376-4f3c-abea-50c5dd099a2a" path="/var/lib/kubelet/pods/0afb11a7-3376-4f3c-abea-50c5dd099a2a/volumes" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.315755 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fc565a6-9454-4f75-8b8d-e5f8f92db352" path="/var/lib/kubelet/pods/7fc565a6-9454-4f75-8b8d-e5f8f92db352/volumes" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.316724 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc22ff17-be18-4e46-b13e-a84868b694d1" path="/var/lib/kubelet/pods/cc22ff17-be18-4e46-b13e-a84868b694d1/volumes" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.317311 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.317345 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:51:41 crc kubenswrapper[4769]: E1121 12:51:41.319452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" containerName="memcached" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.319476 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" containerName="memcached" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.319694 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" containerName="memcached" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.320660 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.331361 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_47e271a1-6724-41f1-bb76-3ff682490126/ovsdbserver-nb/0.log" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.331434 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.331830 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.332001 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-5hmlz" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.332159 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.332288 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:51:41 crc kubenswrapper[4769]: E1121 12:51:41.336520 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:51:41 crc kubenswrapper[4769]: E1121 12:51:41.344514 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:51:41 crc kubenswrapper[4769]: E1121 12:51:41.366936 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:51:41 crc kubenswrapper[4769]: E1121 12:51:41.367017 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="958a6399-8efa-4703-a612-528546972586" containerName="ovn-northd" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.386651 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.466996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47e271a1-6724-41f1-bb76-3ff682490126-ovsdb-rundir\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-memcached-tls-certs\") pod \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4bvc\" (UniqueName: \"kubernetes.io/projected/47e271a1-6724-41f1-bb76-3ff682490126-kube-api-access-m4bvc\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-config-data\") pod \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467241 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-combined-ca-bundle\") pod \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467264 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl2lx\" (UniqueName: \"kubernetes.io/projected/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kube-api-access-sl2lx\") pod \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-combined-ca-bundle\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467305 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-scripts\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-metrics-certs-tls-certs\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467423 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-config\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.467442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kolla-config\") pod \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\" (UID: \"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8\") " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468202 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g5pk\" (UniqueName: \"kubernetes.io/projected/33ea1c8a-5107-4dc7-971b-6b8ad8230124-kube-api-access-9g5pk\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468526 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-config\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.468604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.474739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47e271a1-6724-41f1-bb76-3ff682490126-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.475681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-config" (OuterVolumeSpecName: "config") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.476139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-config-data" (OuterVolumeSpecName: "config-data") pod "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" (UID: "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.476684 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" (UID: "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.478706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-scripts" (OuterVolumeSpecName: "scripts") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.488240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e271a1-6724-41f1-bb76-3ff682490126-kube-api-access-m4bvc" (OuterVolumeSpecName: "kube-api-access-m4bvc") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "kube-api-access-m4bvc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.507927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" event={"ID":"ce32d94f-d365-4adc-a1aa-362b3a0fceba","Type":"ContainerStarted","Data":"faf15e7c107a743ac60fe76fa708c33ec0840339202e7d4cdfb7e2e7c5ce4932"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.523330 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerID="567b9441e1e27697fb8f00b3dca199891e2d3f8b1cd6c6358812c0a6bcbd8691" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.523602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865","Type":"ContainerDied","Data":"567b9441e1e27697fb8f00b3dca199891e2d3f8b1cd6c6358812c0a6bcbd8691"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.523895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kube-api-access-sl2lx" (OuterVolumeSpecName: "kube-api-access-sl2lx") pod "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" (UID: "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8"). InnerVolumeSpecName "kube-api-access-sl2lx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.535628 4769 generic.go:334] "Generic (PLEG): container finished" podID="c000468c-0aeb-4e5b-b647-a225f1387d7d" containerID="e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.535701 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c000468c-0aeb-4e5b-b647-a225f1387d7d","Type":"ContainerDied","Data":"e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.537421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.538584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75gt6" event={"ID":"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6","Type":"ContainerStarted","Data":"c00ec3f9c27833db7df79f2007d198279fd4eec66bbb7706074c9bf0a2543f53"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.544276 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_47e271a1-6724-41f1-bb76-3ff682490126/ovsdbserver-nb/0.log" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.544414 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.544553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"47e271a1-6724-41f1-bb76-3ff682490126","Type":"ContainerDied","Data":"1b09facd315f2fa0ddc56bcd35de4ebb71913aee9488969608cfb3d7903a5589"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.547086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerStarted","Data":"f3e12253f6a3278bcbea990d460a16694c0c45167d7d23ab99d5347d6993bb6f"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.549621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-d5w65" event={"ID":"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2","Type":"ContainerStarted","Data":"e2b8819876dd6eb0395611b6237d22e3d81d4a69d15392ec3c05cec27cd594da"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563208 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563236 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563243 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563250 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563256 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563264 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563270 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563276 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563282 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563288 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563294 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563299 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563305 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563310 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563388 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.563484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.565298 4769 generic.go:334] "Generic (PLEG): container finished" podID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerID="6bda79a077d92c7831c16878d761e913a69a5bfc58776708e95b6a11c60b0f20" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.565344 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c4b18f8d-32ef-4ac8-be62-61672fe8b645","Type":"ContainerDied","Data":"6bda79a077d92c7831c16878d761e913a69a5bfc58776708e95b6a11c60b0f20"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.566528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"b68bf7eb-b5ee-4bb0-be82-76c8c384aae8","Type":"ContainerDied","Data":"b2c761862dc0ed6cc2d542bdeda9c01033848c2db8ec50a699ba430544ea640e"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.566611 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570098 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9g5pk\" (UniqueName: \"kubernetes.io/projected/33ea1c8a-5107-4dc7-971b-6b8ad8230124-kube-api-access-9g5pk\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-config\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570359 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/47e271a1-6724-41f1-bb76-3ff682490126-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570370 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m4bvc\" (UniqueName: \"kubernetes.io/projected/47e271a1-6724-41f1-bb76-3ff682490126-kube-api-access-m4bvc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570382 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570399 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570409 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sl2lx\" (UniqueName: \"kubernetes.io/projected/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kube-api-access-sl2lx\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570418 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570426 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e271a1-6724-41f1-bb76-3ff682490126-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.570435 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.571816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.571918 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.573455 4769 generic.go:334] "Generic (PLEG): container finished" podID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" containerID="814a769f00d0c46c2f7679380c85f2debf5f58aca2ca2bc1a7efee01f7a8d26e" exitCode=0 Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.573564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"65b5a47f-40e2-4517-af4f-094aa8aa4ad1","Type":"ContainerDied","Data":"814a769f00d0c46c2f7679380c85f2debf5f58aca2ca2bc1a7efee01f7a8d26e"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.574241 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-config\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.578005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.584710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"23a5ec8e-ba2d-4836-83dc-0f95131d4838","Type":"ContainerStarted","Data":"072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748"} Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.585503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.592841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g5pk\" (UniqueName: \"kubernetes.io/projected/33ea1c8a-5107-4dc7-971b-6b8ad8230124-kube-api-access-9g5pk\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.601292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.601537 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.617548 4769 scope.go:117] "RemoveContainer" containerID="c9ab3bc114246c79bbd1d600d35d80b2fb57760bc20868d0c5b0cf8435d11dbd" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.631298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.672301 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.730518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-8z8jj"] Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.919414 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.941210 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" (UID: "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:41 crc kubenswrapper[4769]: I1121 12:51:41.983285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" (UID: "b68bf7eb-b5ee-4bb0-be82-76c8c384aae8"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.007213 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.007455 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.007466 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.017488 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.024617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.146232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.161432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.162352 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.171837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.175272 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.191885 4769 scope.go:117] "RemoveContainer" containerID="5a75dad19aa42c3760429244da833580790947a6560d35b71702d8af6e3b87e8" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.205230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-wvb9n"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-nova-novncproxy-tls-certs\") pod \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-vencrypt-tls-certs\") pod \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs\") pod \"47e271a1-6724-41f1-bb76-3ff682490126\" (UID: \"47e271a1-6724-41f1-bb76-3ff682490126\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghp5w\" (UniqueName: \"kubernetes.io/projected/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-kube-api-access-ghp5w\") pod \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-combined-ca-bundle\") pod \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.218684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-config-data\") pod \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\" (UID: \"65b5a47f-40e2-4517-af4f-094aa8aa4ad1\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.219301 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: W1121 12:51:42.219332 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/47e271a1-6724-41f1-bb76-3ff682490126/volumes/kubernetes.io~secret/ovsdbserver-nb-tls-certs Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.219346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "47e271a1-6724-41f1-bb76-3ff682490126" (UID: "47e271a1-6724-41f1-bb76-3ff682490126"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.255635 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.264757 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.269986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-kube-api-access-ghp5w" (OuterVolumeSpecName: "kube-api-access-ghp5w") pod "65b5a47f-40e2-4517-af4f-094aa8aa4ad1" (UID: "65b5a47f-40e2-4517-af4f-094aa8aa4ad1"). InnerVolumeSpecName "kube-api-access-ghp5w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-certs\") pod \"abec82e3-8477-40cc-a42c-3a67fe46ecba\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-combined-ca-bundle\") pod \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-operator-scripts\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-combined-ca-bundle\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-combined-ca-bundle\") pod \"abec82e3-8477-40cc-a42c-3a67fe46ecba\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kolla-config\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkt9c\" (UniqueName: \"kubernetes.io/projected/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-kube-api-access-zkt9c\") pod \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-galera-tls-certs\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh7p7\" (UniqueName: \"kubernetes.io/projected/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-api-access-gh7p7\") pod \"abec82e3-8477-40cc-a42c-3a67fe46ecba\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-logs\") pod \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d26b\" (UniqueName: \"kubernetes.io/projected/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kube-api-access-7d26b\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-nova-metadata-tls-certs\") pod \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-generated\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-config\") pod \"abec82e3-8477-40cc-a42c-3a67fe46ecba\" (UID: \"abec82e3-8477-40cc-a42c-3a67fe46ecba\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-default\") pod \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\" (UID: \"c4b18f8d-32ef-4ac8-be62-61672fe8b645\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.320839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-config-data\") pod \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\" (UID: \"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.321258 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/47e271a1-6724-41f1-bb76-3ff682490126-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.321271 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ghp5w\" (UniqueName: \"kubernetes.io/projected/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-kube-api-access-ghp5w\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.331301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-logs" (OuterVolumeSpecName: "logs") pod "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" (UID: "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.332529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.337625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.341804 4769 scope.go:117] "RemoveContainer" containerID="7bee2832b945087145ffcb590c83369ee975c70b4e0d11a7cf7bd12005f5cec2" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.346264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.346401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.352679 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.367265 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391245 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391698 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerName="mysql-bootstrap" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391715 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerName="mysql-bootstrap" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391732 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" containerName="nova-scheduler-scheduler" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391741 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" containerName="nova-scheduler-scheduler" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391753 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerName="galera" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391759 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerName="galera" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391773 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391779 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391787 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="abec82e3-8477-40cc-a42c-3a67fe46ecba" containerName="kube-state-metrics" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391793 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="abec82e3-8477-40cc-a42c-3a67fe46ecba" containerName="kube-state-metrics" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391805 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-log" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391811 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-log" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391826 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="openstack-network-exporter" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391833 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="openstack-network-exporter" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391855 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="ovsdbserver-nb" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391862 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="ovsdbserver-nb" Nov 21 12:51:42 crc kubenswrapper[4769]: E1121 12:51:42.391869 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-metadata" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.391876 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-metadata" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392058 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="ovsdbserver-nb" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392074 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392087 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47e271a1-6724-41f1-bb76-3ff682490126" containerName="openstack-network-exporter" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392099 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" containerName="galera" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392111 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-log" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392119 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="abec82e3-8477-40cc-a42c-3a67fe46ecba" containerName="kube-state-metrics" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392129 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" containerName="nova-metadata-metadata" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392137 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" containerName="nova-scheduler-scheduler" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.392805 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.404757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.404821 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.405009 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-khdxd" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.419331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-kube-api-access-zkt9c" (OuterVolumeSpecName: "kube-api-access-zkt9c") pod "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" (UID: "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865"). InnerVolumeSpecName "kube-api-access-zkt9c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.419905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-api-access-gh7p7" (OuterVolumeSpecName: "kube-api-access-gh7p7") pod "abec82e3-8477-40cc-a42c-3a67fe46ecba" (UID: "abec82e3-8477-40cc-a42c-3a67fe46ecba"). InnerVolumeSpecName "kube-api-access-gh7p7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.422164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-combined-ca-bundle\") pod \"c000468c-0aeb-4e5b-b647-a225f1387d7d\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.422225 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv8cj\" (UniqueName: \"kubernetes.io/projected/c000468c-0aeb-4e5b-b647-a225f1387d7d-kube-api-access-bv8cj\") pod \"c000468c-0aeb-4e5b-b647-a225f1387d7d\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.422370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-config-data\") pod \"c000468c-0aeb-4e5b-b647-a225f1387d7d\" (UID: \"c000468c-0aeb-4e5b-b647-a225f1387d7d\") " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423138 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423157 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zkt9c\" (UniqueName: \"kubernetes.io/projected/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-kube-api-access-zkt9c\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423169 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gh7p7\" (UniqueName: \"kubernetes.io/projected/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-api-access-gh7p7\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423178 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423200 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423209 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423217 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4b18f8d-32ef-4ac8-be62-61672fe8b645-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.423754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kube-api-access-7d26b" (OuterVolumeSpecName: "kube-api-access-7d26b") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "kube-api-access-7d26b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.425570 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.432616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c000468c-0aeb-4e5b-b647-a225f1387d7d-kube-api-access-bv8cj" (OuterVolumeSpecName: "kube-api-access-bv8cj") pod "c000468c-0aeb-4e5b-b647-a225f1387d7d" (UID: "c000468c-0aeb-4e5b-b647-a225f1387d7d"). InnerVolumeSpecName "kube-api-access-bv8cj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.513401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "mysql-db") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-kolla-config\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-combined-ca-bundle\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-config-data\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-memcached-tls-certs\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ws9x\" (UniqueName: \"kubernetes.io/projected/f7633e95-a9a0-413f-8827-a24a1f6b0272-kube-api-access-4ws9x\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525591 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bv8cj\" (UniqueName: \"kubernetes.io/projected/c000468c-0aeb-4e5b-b647-a225f1387d7d-kube-api-access-bv8cj\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525618 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.525629 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7d26b\" (UniqueName: \"kubernetes.io/projected/c4b18f8d-32ef-4ac8-be62-61672fe8b645-kube-api-access-7d26b\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.626965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-config-data\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.627012 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-memcached-tls-certs\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.627041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4ws9x\" (UniqueName: \"kubernetes.io/projected/f7633e95-a9a0-413f-8827-a24a1f6b0272-kube-api-access-4ws9x\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.627100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-kolla-config\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.627121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-combined-ca-bundle\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.632147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-kolla-config\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.632410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"23a5ec8e-ba2d-4836-83dc-0f95131d4838","Type":"ContainerStarted","Data":"44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.634418 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-config-data\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.668258 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-hn7gb"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.694015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-memcached-tls-certs\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.697473 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" event={"ID":"4b34285f-f704-420c-a395-eb7bcdaef6c5","Type":"ContainerStarted","Data":"d532ad5e987952a0900bf07e04b081ed6cda4a6d457ff8ccb8c86a10026aae27"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.697903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ws9x\" (UniqueName: \"kubernetes.io/projected/f7633e95-a9a0-413f-8827-a24a1f6b0272-kube-api-access-4ws9x\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.701078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-combined-ca-bundle\") pod \"memcached-0\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.705308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-b4xl4"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.710105 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.710091977 podStartE2EDuration="4.710091977s" podCreationTimestamp="2025-11-21 12:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:42.694200785 +0000 UTC m=+3661.394862593" watchObservedRunningTime="2025-11-21 12:51:42.710091977 +0000 UTC m=+3661.410753795" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.723557 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.723577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"65b5a47f-40e2-4517-af4f-094aa8aa4ad1","Type":"ContainerDied","Data":"6b46930957ac98f196b7845685fc6a854120308131efaa33e23258eea17b72ee"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.735587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8b64bb07-6ced-4f23-bf40-b3a5f5ba7865","Type":"ContainerDied","Data":"f4a5b37e3be78c9f1d914dd01b5e7de20819a3dac47ccb90a67ee24c6ef2d697"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.735671 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.743019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" event={"ID":"235b264a-c7e8-465d-a791-b01776cb8e77","Type":"ContainerStarted","Data":"468f4188106ceb315751e0e3f1635152e0b16652ba65d442a6f23dd92b35f05b"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.745092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"c4b18f8d-32ef-4ac8-be62-61672fe8b645","Type":"ContainerDied","Data":"7946b1ba8d9311c3e89abf1cb1dceaf194800bcd4e2fbea8b814f97a02b9a637"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.745199 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.747761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c000468c-0aeb-4e5b-b647-a225f1387d7d","Type":"ContainerDied","Data":"226e9992d5c033c5b282a2b8a2b92209416e01f0587586c7a0706f4b7ea01896"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.747893 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.748997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"abec82e3-8477-40cc-a42c-3a67fe46ecba","Type":"ContainerDied","Data":"cc8f88f52a0f5367d18e21fa7c0007474d4dfe798e8c246a5145046603d7972b"} Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.749017 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.832490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-config-data" (OuterVolumeSpecName: "config-data") pod "65b5a47f-40e2-4517-af4f-094aa8aa4ad1" (UID: "65b5a47f-40e2-4517-af4f-094aa8aa4ad1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.834466 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.853363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "65b5a47f-40e2-4517-af4f-094aa8aa4ad1" (UID: "65b5a47f-40e2-4517-af4f-094aa8aa4ad1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.857457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-config-data" (OuterVolumeSpecName: "config-data") pod "c000468c-0aeb-4e5b-b647-a225f1387d7d" (UID: "c000468c-0aeb-4e5b-b647-a225f1387d7d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.906968 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf"] Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.936107 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.936437 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:42 crc kubenswrapper[4769]: I1121 12:51:42.949168 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs"] Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.001258 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.021544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c000468c-0aeb-4e5b-b647-a225f1387d7d" (UID: "c000468c-0aeb-4e5b-b647-a225f1387d7d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.029462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "abec82e3-8477-40cc-a42c-3a67fe46ecba" (UID: "abec82e3-8477-40cc-a42c-3a67fe46ecba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.039061 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.039094 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.039104 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c000468c-0aeb-4e5b-b647-a225f1387d7d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.085433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "65b5a47f-40e2-4517-af4f-094aa8aa4ad1" (UID: "65b5a47f-40e2-4517-af4f-094aa8aa4ad1"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.134871 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.142156 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.192343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "65b5a47f-40e2-4517-af4f-094aa8aa4ad1" (UID: "65b5a47f-40e2-4517-af4f-094aa8aa4ad1"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.245604 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/65b5a47f-40e2-4517-af4f-094aa8aa4ad1-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.246962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "abec82e3-8477-40cc-a42c-3a67fe46ecba" (UID: "abec82e3-8477-40cc-a42c-3a67fe46ecba"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.247061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.267755 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" (UID: "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.294294 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-config-data" (OuterVolumeSpecName: "config-data") pod "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" (UID: "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.294817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "abec82e3-8477-40cc-a42c-3a67fe46ecba" (UID: "abec82e3-8477-40cc-a42c-3a67fe46ecba"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.302335 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="297dac89-7b00-4c59-b9c7-20618457ff4f" path="/var/lib/kubelet/pods/297dac89-7b00-4c59-b9c7-20618457ff4f/volumes" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.302964 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b68bf7eb-b5ee-4bb0-be82-76c8c384aae8" path="/var/lib/kubelet/pods/b68bf7eb-b5ee-4bb0-be82-76c8c384aae8/volumes" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.360567 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.363327 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.364057 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.364327 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.364598 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/abec82e3-8477-40cc-a42c-3a67fe46ecba-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.390330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" (UID: "8b64bb07-6ced-4f23-bf40-b3a5f5ba7865"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.468807 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.479993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "c4b18f8d-32ef-4ac8-be62-61672fe8b645" (UID: "c4b18f8d-32ef-4ac8-be62-61672fe8b645"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.587509 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b18f8d-32ef-4ac8-be62-61672fe8b645-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.701727 4769 scope.go:117] "RemoveContainer" containerID="814a769f00d0c46c2f7679380c85f2debf5f58aca2ca2bc1a7efee01f7a8d26e" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.773661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75gt6" event={"ID":"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6","Type":"ContainerStarted","Data":"87636c08827b45b1cf0db585cbd58ea33e909f36ea59c10b74779fbd9b27daf4"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.778371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"33ea1c8a-5107-4dc7-971b-6b8ad8230124","Type":"ContainerStarted","Data":"c65eb9c76c1f8a5257845ae06566429e11a6feea7540ac519a5e749d0d402adc"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.792051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" event={"ID":"ce32d94f-d365-4adc-a1aa-362b3a0fceba","Type":"ContainerStarted","Data":"ab11cc07b5380dc8fb62a559721f6d9273ace6edd4762e44863fc0d64e7ac1d2"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.792127 4769 scope.go:117] "RemoveContainer" containerID="567b9441e1e27697fb8f00b3dca199891e2d3f8b1cd6c6358812c0a6bcbd8691" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.804126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" event={"ID":"fe7a83cd-d17a-463f-b2cd-288865bc2f1c","Type":"ContainerStarted","Data":"0a0a1fe44c9641223b22c83aa9a9f8fca991dae7a814554ccc4ffa319e9f5f1e"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.807092 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-75gt6" podStartSLOduration=5.807065358 podStartE2EDuration="5.807065358s" podCreationTimestamp="2025-11-21 12:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:43.791936327 +0000 UTC m=+3662.492598145" watchObservedRunningTime="2025-11-21 12:51:43.807065358 +0000 UTC m=+3662.507727176" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.807341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" event={"ID":"e527d5f6-ee88-49ac-bf24-c584e56e456f","Type":"ContainerStarted","Data":"fa0c6e9be2d181b23d1c84c0b13f21eb411512d97a43d5e567d27edb9e492078"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.811843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" event={"ID":"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c","Type":"ContainerStarted","Data":"029198fb2c422300f7b716746f9ac1953703f1eb3b1ec6cc89ad7a6220e14a74"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.819820 4769 generic.go:334] "Generic (PLEG): container finished" podID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerID="00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f" exitCode=0 Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.819910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"657f116c-8e01-426a-b9e6-251c11c3c0b6","Type":"ContainerDied","Data":"00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.841860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-d5w65" event={"ID":"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2","Type":"ContainerStarted","Data":"43d32cc2500dd696e02f6890872da8344483fba20ae709be434f7eda1d0ba363"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.844052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" event={"ID":"3c4788f6-80ae-4302-a22f-72204167e813","Type":"ContainerStarted","Data":"aea35fe73df9762c915f05b95730d83ac2e194b87c982f526f668b45778faece"} Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.866215 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" podStartSLOduration=5.866196327 podStartE2EDuration="5.866196327s" podCreationTimestamp="2025-11-21 12:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:43.830932448 +0000 UTC m=+3662.531594266" watchObservedRunningTime="2025-11-21 12:51:43.866196327 +0000 UTC m=+3662.566858145" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.902396 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-khdxd" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.908284 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.913316 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-d5w65" podStartSLOduration=5.913294328 podStartE2EDuration="5.913294328s" podCreationTimestamp="2025-11-21 12:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:43.864491451 +0000 UTC m=+3662.565153269" watchObservedRunningTime="2025-11-21 12:51:43.913294328 +0000 UTC m=+3662.613956146" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.923827 4769 scope.go:117] "RemoveContainer" containerID="5a35763039d93b1f80d4fa47c4b6b3e0cf2389991f7ccb4345b212a637b2b8a5" Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.954242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:43 crc kubenswrapper[4769]: I1121 12:51:43.965263 4769 scope.go:117] "RemoveContainer" containerID="6bda79a077d92c7831c16878d761e913a69a5bfc58776708e95b6a11c60b0f20" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.031467 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.090690 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.112274 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.113712 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.118472 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.119655 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.132248 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.150043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.165569 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.167321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.171396 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.171563 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.172110 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.186446 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.205540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.239700 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.241475 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.247139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.247331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.247356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-api-access-gz8ml\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.247424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.254732 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.254791 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-dfvd9" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.254908 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.254988 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.269244 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.315782 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.336548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.348227 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.349943 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-api-access-gz8ml\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q86g2\" (UniqueName: \"kubernetes.io/projected/550e4721-ef58-4d97-a23d-12272e168ff9-kube-api-access-q86g2\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m796g\" (UniqueName: \"kubernetes.io/projected/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kube-api-access-m796g\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-config-data\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352965 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.352982 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353023 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/550e4721-ef58-4d97-a23d-12272e168ff9-logs\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.353179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.357486 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.358104 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-m5hz7" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.358244 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.363479 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.373691 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.410899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-api-access-gz8ml\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.410915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.411090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.411102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.419325 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerName="rabbitmq" containerID="cri-o://c13d74ce5dbd7f85d83030e818e88ade494f1c8ec1907c6617cc76ed83cd05db" gracePeriod=604794 Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454830 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.454993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q86g2\" (UniqueName: \"kubernetes.io/projected/550e4721-ef58-4d97-a23d-12272e168ff9-kube-api-access-q86g2\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m796g\" (UniqueName: \"kubernetes.io/projected/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kube-api-access-m796g\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-config-data\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/550e4721-ef58-4d97-a23d-12272e168ff9-logs\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455201 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mhbf\" (UniqueName: \"kubernetes.io/projected/b3669f04-8d90-4122-a048-12ac1cfc271e-kube-api-access-7mhbf\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-config\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.455603 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.458057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.461462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-config-data\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.464225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.464304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.464540 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/550e4721-ef58-4d97-a23d-12272e168ff9-logs\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.474216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.474498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.486692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.495848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.497554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q86g2\" (UniqueName: \"kubernetes.io/projected/550e4721-ef58-4d97-a23d-12272e168ff9-kube-api-access-q86g2\") pod \"nova-metadata-0\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.497872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m796g\" (UniqueName: \"kubernetes.io/projected/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kube-api-access-m796g\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.499273 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.512290 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerName="rabbitmq" containerID="cri-o://cc198110946fb67c2e80ec49d47496e089e3cd247ee736ce68afa9e2115fe25f" gracePeriod=604794 Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mhbf\" (UniqueName: \"kubernetes.io/projected/b3669f04-8d90-4122-a048-12ac1cfc271e-kube-api-access-7mhbf\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-config\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.557649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.558131 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.558136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.558870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-config\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.559049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.562154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.569038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.569311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.577922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mhbf\" (UniqueName: \"kubernetes.io/projected/b3669f04-8d90-4122-a048-12ac1cfc271e-kube-api-access-7mhbf\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.690118 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.750312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"openstack-cell1-galera-0\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.880611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" event={"ID":"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c","Type":"ContainerStarted","Data":"47fdb25b7dd3ebbda6ae3cc652d395c71966905f6a37ae41f7394d1693f339a6"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.886527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-nb-0\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.907203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerStarted","Data":"9bafda02bc384d03e4298a43e5cdaee8746fb660848f0e8c28ef21e9f33fdc5d"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.907625 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-central-agent" containerID="cri-o://d1cb939e2098cb5f72fda4142344bbc24adcb4fa59d5fa78c3af4c696545aaca" gracePeriod=30 Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.907981 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.908148 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="proxy-httpd" containerID="cri-o://9bafda02bc384d03e4298a43e5cdaee8746fb660848f0e8c28ef21e9f33fdc5d" gracePeriod=30 Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.908314 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="sg-core" containerID="cri-o://f3e12253f6a3278bcbea990d460a16694c0c45167d7d23ab99d5347d6993bb6f" gracePeriod=30 Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.908448 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-notification-agent" containerID="cri-o://9da402703eec3f97f365193285e16cda6e2051aef09bc6981334db3df005aa6c" gracePeriod=30 Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.910752 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" podStartSLOduration=5.910739912 podStartE2EDuration="5.910739912s" podCreationTimestamp="2025-11-21 12:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:44.910055474 +0000 UTC m=+3663.610717292" watchObservedRunningTime="2025-11-21 12:51:44.910739912 +0000 UTC m=+3663.611401730" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.927909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"657f116c-8e01-426a-b9e6-251c11c3c0b6","Type":"ContainerDied","Data":"ef73c16896ade7f410703f597f2bc72bfc2d9b2099ebdc64c489a06eacfd637b"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.928270 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef73c16896ade7f410703f597f2bc72bfc2d9b2099ebdc64c489a06eacfd637b" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.957775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" event={"ID":"235b264a-c7e8-465d-a791-b01776cb8e77","Type":"ContainerStarted","Data":"fe440698d4bf6426f16c562c14614ac51dba8c236c7e03beda6285499c405172"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.959844 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.47245698 podStartE2EDuration="8.959820308s" podCreationTimestamp="2025-11-21 12:51:36 +0000 UTC" firstStartedPulling="2025-11-21 12:51:36.877603771 +0000 UTC m=+3655.578265589" lastFinishedPulling="2025-11-21 12:51:42.364967099 +0000 UTC m=+3661.065628917" observedRunningTime="2025-11-21 12:51:44.940257715 +0000 UTC m=+3663.640919533" watchObservedRunningTime="2025-11-21 12:51:44.959820308 +0000 UTC m=+3663.660482126" Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.964840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f7633e95-a9a0-413f-8827-a24a1f6b0272","Type":"ContainerStarted","Data":"8ec3d7c4e2ac4637d0d03db5a2d210ee3903156b5da28c7420093eb7b79c4f0b"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.978376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" event={"ID":"3c4788f6-80ae-4302-a22f-72204167e813","Type":"ContainerStarted","Data":"b8c4ba213f58d9ecac6ff1b9f26579a4aba42889a393984e6851fb5f5ffb83c0"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.990988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" event={"ID":"e527d5f6-ee88-49ac-bf24-c584e56e456f","Type":"ContainerStarted","Data":"59b12c11a269cc8bbe3e6e4e210fdb2be762c7e4fb8a1b965510fb8cacd76729"} Nov 21 12:51:44 crc kubenswrapper[4769]: I1121 12:51:44.997101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" event={"ID":"4b34285f-f704-420c-a395-eb7bcdaef6c5","Type":"ContainerStarted","Data":"e008e0744d10c71887e2076dd5c66e9820507ab0e909e49b76a0cff5333369ac"} Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.002721 4769 scope.go:117] "RemoveContainer" containerID="c64b126a60282548e13a973028979a3592fed761a5c3091fcb1bac287021d838" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.023183 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" event={"ID":"fe7a83cd-d17a-463f-b2cd-288865bc2f1c","Type":"ContainerStarted","Data":"7b06a6a08b28e192436b433bd09d1e0b1ff8955de4c699f1501068b1b61f53d4"} Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.028903 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" podStartSLOduration=7.028879086 podStartE2EDuration="7.028879086s" podCreationTimestamp="2025-11-21 12:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:44.975066382 +0000 UTC m=+3663.675728210" watchObservedRunningTime="2025-11-21 12:51:45.028879086 +0000 UTC m=+3663.729540904" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.029618 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.046489 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" podStartSLOduration=5.046467515 podStartE2EDuration="5.046467515s" podCreationTimestamp="2025-11-21 12:51:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:44.993255067 +0000 UTC m=+3663.693916895" watchObservedRunningTime="2025-11-21 12:51:45.046467515 +0000 UTC m=+3663.747129333" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.051877 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" podStartSLOduration=5.051862061 podStartE2EDuration="5.051862061s" podCreationTimestamp="2025-11-21 12:51:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:45.008537043 +0000 UTC m=+3663.709198861" watchObservedRunningTime="2025-11-21 12:51:45.051862061 +0000 UTC m=+3663.752523889" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.056153 4769 scope.go:117] "RemoveContainer" containerID="e9d8e70da88b3418670e4df2644376985bde60d4d6afc3409cf2ae5806c0f7cc" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.062904 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" podStartSLOduration=6.062886121 podStartE2EDuration="6.062886121s" podCreationTimestamp="2025-11-21 12:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:45.028474135 +0000 UTC m=+3663.729135953" watchObservedRunningTime="2025-11-21 12:51:45.062886121 +0000 UTC m=+3663.763547939" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.063987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"33ea1c8a-5107-4dc7-971b-6b8ad8230124","Type":"ContainerStarted","Data":"696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4"} Nov 21 12:51:45 crc kubenswrapper[4769]: E1121 12:51:45.105807 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f is running failed: container process not found" containerID="00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:51:45 crc kubenswrapper[4769]: E1121 12:51:45.108935 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f is running failed: container process not found" containerID="00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.109288 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" podStartSLOduration=6.109262333 podStartE2EDuration="6.109262333s" podCreationTimestamp="2025-11-21 12:51:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:45.091156231 +0000 UTC m=+3663.791818049" watchObservedRunningTime="2025-11-21 12:51:45.109262333 +0000 UTC m=+3663.809924151" Nov 21 12:51:45 crc kubenswrapper[4769]: E1121 12:51:45.131800 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f is running failed: container process not found" containerID="00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:51:45 crc kubenswrapper[4769]: E1121 12:51:45.132251 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="galera" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.216034 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.241413 4769 scope.go:117] "RemoveContainer" containerID="d4f1f5d51d650e636fc79d365a01d8f04b9fe6abb11ba80f5ac792ffad67501a" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.242252 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.267802 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.297950 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e271a1-6724-41f1-bb76-3ff682490126" path="/var/lib/kubelet/pods/47e271a1-6724-41f1-bb76-3ff682490126/volumes" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.301658 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b64bb07-6ced-4f23-bf40-b3a5f5ba7865" path="/var/lib/kubelet/pods/8b64bb07-6ced-4f23-bf40-b3a5f5ba7865/volumes" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.302236 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abec82e3-8477-40cc-a42c-3a67fe46ecba" path="/var/lib/kubelet/pods/abec82e3-8477-40cc-a42c-3a67fe46ecba/volumes" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.315818 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b18f8d-32ef-4ac8-be62-61672fe8b645" path="/var/lib/kubelet/pods/c4b18f8d-32ef-4ac8-be62-61672fe8b645/volumes" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.321328 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.434941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-kolla-config\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435240 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk2rb\" (UniqueName: \"kubernetes.io/projected/657f116c-8e01-426a-b9e6-251c11c3c0b6-kube-api-access-mk2rb\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-default\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435360 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-galera-tls-certs\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-operator-scripts\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-generated\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.435550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-combined-ca-bundle\") pod \"657f116c-8e01-426a-b9e6-251c11c3c0b6\" (UID: \"657f116c-8e01-426a-b9e6-251c11c3c0b6\") " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.444418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.444953 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.445675 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.448689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.449098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.470931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657f116c-8e01-426a-b9e6-251c11c3c0b6-kube-api-access-mk2rb" (OuterVolumeSpecName: "kube-api-access-mk2rb") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "kube-api-access-mk2rb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.521780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.540039 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.540063 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.540073 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mk2rb\" (UniqueName: \"kubernetes.io/projected/657f116c-8e01-426a-b9e6-251c11c3c0b6-kube-api-access-mk2rb\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.540081 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.540101 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.540110 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/657f116c-8e01-426a-b9e6-251c11c3c0b6-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.623750 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.638116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.642381 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.642409 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.677896 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "657f116c-8e01-426a-b9e6-251c11c3c0b6" (UID: "657f116c-8e01-426a-b9e6-251c11c3c0b6"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.744490 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/657f116c-8e01-426a-b9e6-251c11c3c0b6-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:45 crc kubenswrapper[4769]: I1121 12:51:45.946827 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.084486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"33ea1c8a-5107-4dc7-971b-6b8ad8230124","Type":"ContainerStarted","Data":"8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091678 4769 generic.go:334] "Generic (PLEG): container finished" podID="a56fc867-8d61-48c3-afb1-58589d785023" containerID="9bafda02bc384d03e4298a43e5cdaee8746fb660848f0e8c28ef21e9f33fdc5d" exitCode=0 Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091709 4769 generic.go:334] "Generic (PLEG): container finished" podID="a56fc867-8d61-48c3-afb1-58589d785023" containerID="f3e12253f6a3278bcbea990d460a16694c0c45167d7d23ab99d5347d6993bb6f" exitCode=2 Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091739 4769 generic.go:334] "Generic (PLEG): container finished" podID="a56fc867-8d61-48c3-afb1-58589d785023" containerID="9da402703eec3f97f365193285e16cda6e2051aef09bc6981334db3df005aa6c" exitCode=0 Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091746 4769 generic.go:334] "Generic (PLEG): container finished" podID="a56fc867-8d61-48c3-afb1-58589d785023" containerID="d1cb939e2098cb5f72fda4142344bbc24adcb4fa59d5fa78c3af4c696545aaca" exitCode=0 Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerDied","Data":"9bafda02bc384d03e4298a43e5cdaee8746fb660848f0e8c28ef21e9f33fdc5d"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerDied","Data":"f3e12253f6a3278bcbea990d460a16694c0c45167d7d23ab99d5347d6993bb6f"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerDied","Data":"9da402703eec3f97f365193285e16cda6e2051aef09bc6981334db3df005aa6c"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.091855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerDied","Data":"d1cb939e2098cb5f72fda4142344bbc24adcb4fa59d5fa78c3af4c696545aaca"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.093724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b","Type":"ContainerStarted","Data":"6aea359f09d01b5a62affc14a7d2b168a392a1b591032e98e2bfc8112f71576a"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.097039 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.110158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f7633e95-a9a0-413f-8827-a24a1f6b0272","Type":"ContainerStarted","Data":"41a14b4ed09ee1207d1d3291f654c86f69aab747653e0204e5ea4dfc1e55435a"} Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.111714 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.205408 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=5.205389322 podStartE2EDuration="5.205389322s" podCreationTimestamp="2025-11-21 12:51:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:46.11194535 +0000 UTC m=+3664.812607168" watchObservedRunningTime="2025-11-21 12:51:46.205389322 +0000 UTC m=+3664.906051140" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.207686 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=4.207679214 podStartE2EDuration="4.207679214s" podCreationTimestamp="2025-11-21 12:51:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:46.198473224 +0000 UTC m=+3664.899135042" watchObservedRunningTime="2025-11-21 12:51:46.207679214 +0000 UTC m=+3664.908341032" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.270153 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.286274 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.300250 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: E1121 12:51:46.300764 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="mysql-bootstrap" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.300782 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="mysql-bootstrap" Nov 21 12:51:46 crc kubenswrapper[4769]: E1121 12:51:46.300841 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="galera" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.300847 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="galera" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.301048 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" containerName="galera" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.302119 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.307637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.308574 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.308813 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.309150 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-mlzpx" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.309278 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:51:46 crc kubenswrapper[4769]: E1121 12:51:46.342169 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:51:46 crc kubenswrapper[4769]: E1121 12:51:46.345655 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:51:46 crc kubenswrapper[4769]: E1121 12:51:46.347039 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:51:46 crc kubenswrapper[4769]: E1121 12:51:46.347069 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="958a6399-8efa-4703-a612-528546972586" containerName="ovn-northd" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.369845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.369897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kolla-config\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.369937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.369980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj69s\" (UniqueName: \"kubernetes.io/projected/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kube-api-access-tj69s\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.370029 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-default\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.370062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.370077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.370095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.375545 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.378029 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.475400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-ceilometer-tls-certs\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-log-httpd\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-sg-core-conf-yaml\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-run-httpd\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491544 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-scripts\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-config-data\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gffj8\" (UniqueName: \"kubernetes.io/projected/a56fc867-8d61-48c3-afb1-58589d785023-kube-api-access-gffj8\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.491754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-combined-ca-bundle\") pod \"a56fc867-8d61-48c3-afb1-58589d785023\" (UID: \"a56fc867-8d61-48c3-afb1-58589d785023\") " Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.492633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kolla-config\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tj69s\" (UniqueName: \"kubernetes.io/projected/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kube-api-access-tj69s\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.493973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-default\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.494138 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.494965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-default\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.497742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.498478 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.502150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-operator-scripts\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.502416 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-generated\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.502827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kolla-config\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.517154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.522610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-scripts" (OuterVolumeSpecName: "scripts") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.523055 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.526892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a56fc867-8d61-48c3-afb1-58589d785023-kube-api-access-gffj8" (OuterVolumeSpecName: "kube-api-access-gffj8") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "kube-api-access-gffj8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.548354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.549626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj69s\" (UniqueName: \"kubernetes.io/projected/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kube-api-access-tj69s\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.555537 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.575340 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.593513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.598690 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gffj8\" (UniqueName: \"kubernetes.io/projected/a56fc867-8d61-48c3-afb1-58589d785023-kube-api-access-gffj8\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.598709 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.598719 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a56fc867-8d61-48c3-afb1-58589d785023-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.598728 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.681250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.690574 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.700494 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.786333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-config-data" (OuterVolumeSpecName: "config-data") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.787523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a56fc867-8d61-48c3-afb1-58589d785023" (UID: "a56fc867-8d61-48c3-afb1-58589d785023"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.803777 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:46 crc kubenswrapper[4769]: I1121 12:51:46.803824 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a56fc867-8d61-48c3-afb1-58589d785023-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.130741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"550e4721-ef58-4d97-a23d-12272e168ff9","Type":"ContainerStarted","Data":"f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.131052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"550e4721-ef58-4d97-a23d-12272e168ff9","Type":"ContainerStarted","Data":"d978cddb9bd26a7ddc1619fc74fd8784d1e9567eea11d6a8371e22be5043d05c"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.136476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b","Type":"ContainerStarted","Data":"a9eca7120347e4bec827e52ab8d82c6ff74009f03fded58fd632f0e36692392e"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.136516 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.139062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"66e62dd9-2d31-4a8a-9214-406124ed2dd4","Type":"ContainerStarted","Data":"7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.139085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"66e62dd9-2d31-4a8a-9214-406124ed2dd4","Type":"ContainerStarted","Data":"9a5668795c1a27c7e86dfaf4f065636b7e4d0e9f45f83a8e7868559a941c8019"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.154683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a56fc867-8d61-48c3-afb1-58589d785023","Type":"ContainerDied","Data":"362a0b221d87dccce7b9734082b8e897b99853a236cf7dca620141ff88caccdd"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.154703 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.154736 4769 scope.go:117] "RemoveContainer" containerID="9bafda02bc384d03e4298a43e5cdaee8746fb660848f0e8c28ef21e9f33fdc5d" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.158159 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=3.774057172 podStartE2EDuration="4.158144411s" podCreationTimestamp="2025-11-21 12:51:43 +0000 UTC" firstStartedPulling="2025-11-21 12:51:45.682263451 +0000 UTC m=+3664.382925269" lastFinishedPulling="2025-11-21 12:51:46.06635069 +0000 UTC m=+3664.767012508" observedRunningTime="2025-11-21 12:51:47.152060025 +0000 UTC m=+3665.852721843" watchObservedRunningTime="2025-11-21 12:51:47.158144411 +0000 UTC m=+3665.858806219" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.168099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3669f04-8d90-4122-a048-12ac1cfc271e","Type":"ContainerStarted","Data":"9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.168142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3669f04-8d90-4122-a048-12ac1cfc271e","Type":"ContainerStarted","Data":"7934092c6a67eb150c09539c9e0bfc6b1998b181ff9565ae23317aed82e53a6a"} Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.233401 4769 scope.go:117] "RemoveContainer" containerID="f3e12253f6a3278bcbea990d460a16694c0c45167d7d23ab99d5347d6993bb6f" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.255641 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.256664 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.282286 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.315885 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657f116c-8e01-426a-b9e6-251c11c3c0b6" path="/var/lib/kubelet/pods/657f116c-8e01-426a-b9e6-251c11c3c0b6/volumes" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.316682 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a56fc867-8d61-48c3-afb1-58589d785023" path="/var/lib/kubelet/pods/a56fc867-8d61-48c3-afb1-58589d785023/volumes" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.318445 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:47 crc kubenswrapper[4769]: E1121 12:51:47.322020 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="sg-core" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.322067 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="sg-core" Nov 21 12:51:47 crc kubenswrapper[4769]: E1121 12:51:47.322083 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="proxy-httpd" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.322089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="proxy-httpd" Nov 21 12:51:47 crc kubenswrapper[4769]: E1121 12:51:47.322107 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-notification-agent" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.322113 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-notification-agent" Nov 21 12:51:47 crc kubenswrapper[4769]: E1121 12:51:47.322141 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-central-agent" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.322148 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-central-agent" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.324335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-central-agent" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.324441 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="sg-core" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.324456 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="ceilometer-notification-agent" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.324469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a56fc867-8d61-48c3-afb1-58589d785023" containerName="proxy-httpd" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.326926 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.326955 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.327035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.330026 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.330280 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.330550 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.331854 4769 scope.go:117] "RemoveContainer" containerID="9da402703eec3f97f365193285e16cda6e2051aef09bc6981334db3df005aa6c" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.411395 4769 scope.go:117] "RemoveContainer" containerID="d1cb939e2098cb5f72fda4142344bbc24adcb4fa59d5fa78c3af4c696545aaca" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.421749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.421825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-run-httpd\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.421877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctf2d\" (UniqueName: \"kubernetes.io/projected/a4ec3717-5736-415b-a2d1-46da29f8fde8-kube-api-access-ctf2d\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.421912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-log-httpd\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.421940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.422016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-scripts\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.422040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-config-data\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.422076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-scripts\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-config-data\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-run-httpd\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ctf2d\" (UniqueName: \"kubernetes.io/projected/a4ec3717-5736-415b-a2d1-46da29f8fde8-kube-api-access-ctf2d\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-log-httpd\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.524989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-run-httpd\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.525990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-log-httpd\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.530158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.530918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-scripts\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.536248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-config-data\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.537222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.539658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.540767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctf2d\" (UniqueName: \"kubernetes.io/projected/a4ec3717-5736-415b-a2d1-46da29f8fde8-kube-api-access-ctf2d\") pod \"ceilometer-0\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.664968 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.910802 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.911141 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.912022 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cinder-scheduler" containerStatusID={"Type":"cri-o","ID":"c9f25f7b58f2b214420ba3902aaacc67729bc24099f7643f8ebfecac08af7316"} pod="openstack-kuttl-tests/cinder-scheduler-0" containerMessage="Container cinder-scheduler failed liveness probe, will be restarted" Nov 21 12:51:47 crc kubenswrapper[4769]: I1121 12:51:47.912081 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" containerID="cri-o://c9f25f7b58f2b214420ba3902aaacc67729bc24099f7643f8ebfecac08af7316" gracePeriod=30 Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.122865 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:51:48 crc kubenswrapper[4769]: W1121 12:51:48.127596 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4ec3717_5736_415b_a2d1_46da29f8fde8.slice/crio-bc070821a1ed932826469b3560102bcd8aa87b9137f5db1b1e5e7bbf8009cc7b WatchSource:0}: Error finding container bc070821a1ed932826469b3560102bcd8aa87b9137f5db1b1e5e7bbf8009cc7b: Status 404 returned error can't find the container with id bc070821a1ed932826469b3560102bcd8aa87b9137f5db1b1e5e7bbf8009cc7b Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.178798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3669f04-8d90-4122-a048-12ac1cfc271e","Type":"ContainerStarted","Data":"29439527e32feb6edd091bf61a16faf87a7bea56a0f67603d5926070cae7ea09"} Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.179917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerStarted","Data":"bc070821a1ed932826469b3560102bcd8aa87b9137f5db1b1e5e7bbf8009cc7b"} Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.181877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"550e4721-ef58-4d97-a23d-12272e168ff9","Type":"ContainerStarted","Data":"5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7"} Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.191482 4769 generic.go:334] "Generic (PLEG): container finished" podID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerID="3472332fa29d15b6dfcf5ab1f5c6b97eef238a31c93ef2e45b2128688be47c95" exitCode=0 Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.191562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a2614ea4-9b84-4ab4-8e80-fe7a005e3322","Type":"ContainerDied","Data":"3472332fa29d15b6dfcf5ab1f5c6b97eef238a31c93ef2e45b2128688be47c95"} Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.191588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a2614ea4-9b84-4ab4-8e80-fe7a005e3322","Type":"ContainerStarted","Data":"e269a265bad817d3e3bea9948f1d3c06cc7b08ac79ff7c38ef1ca86592044a9d"} Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.193674 4769 generic.go:334] "Generic (PLEG): container finished" podID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerID="7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6" exitCode=0 Nov 21 12:51:48 crc kubenswrapper[4769]: I1121 12:51:48.193958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"66e62dd9-2d31-4a8a-9214-406124ed2dd4","Type":"ContainerDied","Data":"7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6"} Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.226240 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=4.226219185 podStartE2EDuration="4.226219185s" podCreationTimestamp="2025-11-21 12:51:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:48.206454888 +0000 UTC m=+3666.907116706" watchObservedRunningTime="2025-11-21 12:51:48.226219185 +0000 UTC m=+3666.926881013" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.256316 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.269015 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.275395 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=5.275372092 podStartE2EDuration="5.275372092s" podCreationTimestamp="2025-11-21 12:51:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:48.242399895 +0000 UTC m=+3666.943061733" watchObservedRunningTime="2025-11-21 12:51:48.275372092 +0000 UTC m=+3666.976033910" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.326660 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.481357 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:48.481857 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:49.217470 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_958a6399-8efa-4703-a612-528546972586/ovn-northd/0.log" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:49.217520 4769 generic.go:334] "Generic (PLEG): container finished" podID="958a6399-8efa-4703-a612-528546972586" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" exitCode=139 Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:49.218527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"958a6399-8efa-4703-a612-528546972586","Type":"ContainerDied","Data":"7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4"} Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:49.291556 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:49.493324 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.140:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:49 crc kubenswrapper[4769]: I1121 12:51:49.493448 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.140:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.069953 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_958a6399-8efa-4703-a612-528546972586/ovn-northd/0.log" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.070548 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188423 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6qbb\" (UniqueName: \"kubernetes.io/projected/958a6399-8efa-4703-a612-528546972586-kube-api-access-h6qbb\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-combined-ca-bundle\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188557 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-scripts\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-metrics-certs-tls-certs\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-config\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-ovn-northd-tls-certs\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.188983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/958a6399-8efa-4703-a612-528546972586-ovn-rundir\") pod \"958a6399-8efa-4703-a612-528546972586\" (UID: \"958a6399-8efa-4703-a612-528546972586\") " Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.189956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/958a6399-8efa-4703-a612-528546972586-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.190415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-scripts" (OuterVolumeSpecName: "scripts") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.191850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-config" (OuterVolumeSpecName: "config") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.209468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/958a6399-8efa-4703-a612-528546972586-kube-api-access-h6qbb" (OuterVolumeSpecName: "kube-api-access-h6qbb") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "kube-api-access-h6qbb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.217401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.217466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.239365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"66e62dd9-2d31-4a8a-9214-406124ed2dd4","Type":"ContainerStarted","Data":"7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb"} Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.247456 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_958a6399-8efa-4703-a612-528546972586/ovn-northd/0.log" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.247538 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"958a6399-8efa-4703-a612-528546972586","Type":"ContainerDied","Data":"93410b689e9d6f3630f576e7952d9b8846dbb4c8bdffe06160eac14af55976fa"} Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.247587 4769 scope.go:117] "RemoveContainer" containerID="5c7c8df63643bb12b59eb23d35cf2050591d4e22ecfad274f62645c670517a20" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.247619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.247734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.264564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a2614ea4-9b84-4ab4-8e80-fe7a005e3322","Type":"ContainerStarted","Data":"3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b"} Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.272302 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.291571 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.291684 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/958a6399-8efa-4703-a612-528546972586-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.291741 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h6qbb\" (UniqueName: \"kubernetes.io/projected/958a6399-8efa-4703-a612-528546972586-kube-api-access-h6qbb\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.291817 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.291881 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/958a6399-8efa-4703-a612-528546972586-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.310105 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.310081824 podStartE2EDuration="7.310081824s" podCreationTimestamp="2025-11-21 12:51:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:50.302512308 +0000 UTC m=+3669.003174126" watchObservedRunningTime="2025-11-21 12:51:50.310081824 +0000 UTC m=+3669.010743652" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.364668 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=4.364649629 podStartE2EDuration="4.364649629s" podCreationTimestamp="2025-11-21 12:51:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:50.349490937 +0000 UTC m=+3669.050152755" watchObservedRunningTime="2025-11-21 12:51:50.364649629 +0000 UTC m=+3669.065311447" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.409340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.447401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "958a6399-8efa-4703-a612-528546972586" (UID: "958a6399-8efa-4703-a612-528546972586"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.472764 4769 scope.go:117] "RemoveContainer" containerID="7fe357a525f4e6377de5fdd3db937307d8df0236af8b60488115ae9b70f923e4" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.502059 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.502099 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/958a6399-8efa-4703-a612-528546972586-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.637281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.648294 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.667240 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:51:50 crc kubenswrapper[4769]: E1121 12:51:50.667716 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="958a6399-8efa-4703-a612-528546972586" containerName="openstack-network-exporter" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.667731 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="958a6399-8efa-4703-a612-528546972586" containerName="openstack-network-exporter" Nov 21 12:51:50 crc kubenswrapper[4769]: E1121 12:51:50.667751 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="958a6399-8efa-4703-a612-528546972586" containerName="ovn-northd" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.667759 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="958a6399-8efa-4703-a612-528546972586" containerName="ovn-northd" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.667943 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="958a6399-8efa-4703-a612-528546972586" containerName="openstack-network-exporter" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.667967 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="958a6399-8efa-4703-a612-528546972586" containerName="ovn-northd" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.668977 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.673650 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-wwv28" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.676418 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.676611 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.676730 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.681917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.807539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-config\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.807620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.807646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.807672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftb8x\" (UniqueName: \"kubernetes.io/projected/e5513101-8910-4a2f-ac1e-734789ae3199-kube-api-access-ftb8x\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.807702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.807923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-scripts\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.808091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911693 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911729 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ftb8x\" (UniqueName: \"kubernetes.io/projected/e5513101-8910-4a2f-ac1e-734789ae3199-kube-api-access-ftb8x\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911767 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-scripts\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.911935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-config\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.912856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-config\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.913084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.914029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-scripts\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.921376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.921930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.929124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.953253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftb8x\" (UniqueName: \"kubernetes.io/projected/e5513101-8910-4a2f-ac1e-734789ae3199-kube-api-access-ftb8x\") pod \"ovn-northd-0\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:50 crc kubenswrapper[4769]: I1121 12:51:50.997732 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.342215 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="958a6399-8efa-4703-a612-528546972586" path="/var/lib/kubelet/pods/958a6399-8efa-4703-a612-528546972586/volumes" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.372592 4769 generic.go:334] "Generic (PLEG): container finished" podID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerID="c13d74ce5dbd7f85d83030e818e88ade494f1c8ec1907c6617cc76ed83cd05db" exitCode=0 Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.372691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc","Type":"ContainerDied","Data":"c13d74ce5dbd7f85d83030e818e88ade494f1c8ec1907c6617cc76ed83cd05db"} Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.426959 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.461220 4769 generic.go:334] "Generic (PLEG): container finished" podID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerID="cc198110946fb67c2e80ec49d47496e089e3cd247ee736ce68afa9e2115fe25f" exitCode=0 Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.461322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"66952fe6-66e9-40b4-93df-3e91438a78f9","Type":"ContainerDied","Data":"cc198110946fb67c2e80ec49d47496e089e3cd247ee736ce68afa9e2115fe25f"} Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.619059 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.658167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6s7s\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-kube-api-access-k6s7s\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.658453 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.658674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-confd\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.658783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-tls\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.658889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-plugins\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.659011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-plugins-conf\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.659134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/66952fe6-66e9-40b4-93df-3e91438a78f9-erlang-cookie-secret\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.659251 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-erlang-cookie\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.659382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/66952fe6-66e9-40b4-93df-3e91438a78f9-pod-info\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.659493 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-config-data\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.659602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-server-conf\") pod \"66952fe6-66e9-40b4-93df-3e91438a78f9\" (UID: \"66952fe6-66e9-40b4-93df-3e91438a78f9\") " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.661233 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.661284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.663230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.680532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66952fe6-66e9-40b4-93df-3e91438a78f9-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.681417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-kube-api-access-k6s7s" (OuterVolumeSpecName: "kube-api-access-k6s7s") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "kube-api-access-k6s7s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.682081 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.683495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66952fe6-66e9-40b4-93df-3e91438a78f9-pod-info" (OuterVolumeSpecName: "pod-info") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.686639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "persistence") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.722967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-config-data" (OuterVolumeSpecName: "config-data") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762654 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762684 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762693 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762701 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/66952fe6-66e9-40b4-93df-3e91438a78f9-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762711 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762721 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/66952fe6-66e9-40b4-93df-3e91438a78f9-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762728 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762737 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6s7s\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-kube-api-access-k6s7s\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.762757 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.815074 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.865531 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.869734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-server-conf" (OuterVolumeSpecName: "server-conf") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.927806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "66952fe6-66e9-40b4-93df-3e91438a78f9" (UID: "66952fe6-66e9-40b4-93df-3e91438a78f9"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.954506 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.968441 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/66952fe6-66e9-40b4-93df-3e91438a78f9-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:51 crc kubenswrapper[4769]: I1121 12:51:51.968474 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/66952fe6-66e9-40b4-93df-3e91438a78f9-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-server-conf\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-erlang-cookie\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-tls\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-confd\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-config-data\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-erlang-cookie-secret\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071813 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mc77\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-kube-api-access-4mc77\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-plugins-conf\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-pod-info\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.071941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-plugins\") pod \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\" (UID: \"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc\") " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.072995 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.095527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.105307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "persistence") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.106580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.120771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.124512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.140353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-pod-info" (OuterVolumeSpecName: "pod-info") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.153296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-kube-api-access-4mc77" (OuterVolumeSpecName: "kube-api-access-4mc77") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "kube-api-access-4mc77". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175723 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175754 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175777 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175786 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175797 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4mc77\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-kube-api-access-4mc77\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175806 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175815 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.175824 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.225373 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.264464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-server-conf" (OuterVolumeSpecName: "server-conf") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.277403 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.285290 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.359015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-config-data" (OuterVolumeSpecName: "config-data") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.380048 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.380421 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.545548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"c28c4cdd-a4ae-42cc-a725-69e189b7cbcc","Type":"ContainerDied","Data":"130aa547fd9b489a1df327794c079825b237df63b1243246c358c3fb8592a9ab"} Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.545598 4769 scope.go:117] "RemoveContainer" containerID="c13d74ce5dbd7f85d83030e818e88ade494f1c8ec1907c6617cc76ed83cd05db" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.545714 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.553905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"e5513101-8910-4a2f-ac1e-734789ae3199","Type":"ContainerStarted","Data":"fc7b803b7df5f95fa90c794ddf145549d7e70944936ef820b951a598fb83b1aa"} Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.562659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"66952fe6-66e9-40b4-93df-3e91438a78f9","Type":"ContainerDied","Data":"838df2b5538927682967837208229f474347a528b3e1d426323d2a6c49f6a7b6"} Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.562754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.570413 4769 scope.go:117] "RemoveContainer" containerID="fd6ca74f63b4756b4af38ee8899275ee4708f896235dd0666af05eb80cdb4c38" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.574482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerStarted","Data":"d35e3dc686e58546b5f1096d429aa7e1f686326bae7aad98f24ff965e3bba2f4"} Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.586117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" (UID: "c28c4cdd-a4ae-42cc-a725-69e189b7cbcc"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.605877 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.616311 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.641353 4769 scope.go:117] "RemoveContainer" containerID="cc198110946fb67c2e80ec49d47496e089e3cd247ee736ce68afa9e2115fe25f" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.641354 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: E1121 12:51:52.641938 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerName="setup-container" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.641963 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerName="setup-container" Nov 21 12:51:52 crc kubenswrapper[4769]: E1121 12:51:52.641983 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerName="rabbitmq" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.641991 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerName="rabbitmq" Nov 21 12:51:52 crc kubenswrapper[4769]: E1121 12:51:52.642048 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerName="setup-container" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.642054 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerName="setup-container" Nov 21 12:51:52 crc kubenswrapper[4769]: E1121 12:51:52.642068 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerName="rabbitmq" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.642075 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerName="rabbitmq" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.642256 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" containerName="rabbitmq" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.642285 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" containerName="rabbitmq" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.643355 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.648537 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.648673 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-vdwrv" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.649118 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.648856 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.649393 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.649547 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.651584 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.654009 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.656350 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.668242 4769 scope.go:117] "RemoveContainer" containerID="b51b6e0b818040d5aa0b770763e60d7c3a1de388a4d7bb2a5c13d6493c765d7c" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.687507 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.788955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789104 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e15176d9-214d-4f78-bb65-122a9db292d9-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e15176d9-214d-4f78-bb65-122a9db292d9-pod-info\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-server-conf\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsrg6\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-kube-api-access-hsrg6\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.789613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.872080 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.887516 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e15176d9-214d-4f78-bb65-122a9db292d9-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e15176d9-214d-4f78-bb65-122a9db292d9-pod-info\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-server-conf\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hsrg6\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-kube-api-access-hsrg6\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.891606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.895675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e15176d9-214d-4f78-bb65-122a9db292d9-pod-info\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.895919 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.898127 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.899699 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.900528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.902753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.903283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.903629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.903794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-server-conf\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.903895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.904635 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e15176d9-214d-4f78-bb65-122a9db292d9-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.904880 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.905014 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-rdvht" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.905147 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.905377 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.905542 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.905541 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.911063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.916649 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.928098 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.971325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsrg6\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-kube-api-access-hsrg6\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:52 crc kubenswrapper[4769]: I1121 12:51:52.983205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"rabbitmq-server-0\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.096844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-667lp\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-kube-api-access-667lp\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.198941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.199642 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-667lp\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-kube-api-access-667lp\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.200469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.200522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.200578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.201482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.201497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.201767 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.204616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.205335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.205742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.206068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.206228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.206487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.214519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.221564 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-667lp\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-kube-api-access-667lp\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.240244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.273604 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.298383 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66952fe6-66e9-40b4-93df-3e91438a78f9" path="/var/lib/kubelet/pods/66952fe6-66e9-40b4-93df-3e91438a78f9/volumes" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.299749 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c28c4cdd-a4ae-42cc-a725-69e189b7cbcc" path="/var/lib/kubelet/pods/c28c4cdd-a4ae-42cc-a725-69e189b7cbcc/volumes" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.523663 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.586727 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe7a83cd-d17a-463f-b2cd-288865bc2f1c" containerID="7b06a6a08b28e192436b433bd09d1e0b1ff8955de4c699f1501068b1b61f53d4" exitCode=0 Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.586820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" event={"ID":"fe7a83cd-d17a-463f-b2cd-288865bc2f1c","Type":"ContainerDied","Data":"7b06a6a08b28e192436b433bd09d1e0b1ff8955de4c699f1501068b1b61f53d4"} Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.592813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerStarted","Data":"a2f94d960ed5c537c806881a1fd01b547d7cfd1877bc19af16aa08747fa73fc0"} Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.593141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerStarted","Data":"38743498294a6069eeeca3d62431eaa8674c83aeac139a7ea249e20d4f41558a"} Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.596373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"e5513101-8910-4a2f-ac1e-734789ae3199","Type":"ContainerStarted","Data":"4696efcf5040808f1bdb82b9cdd33479ac7655978b307af206a4b0f0ce6957f7"} Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.596414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"e5513101-8910-4a2f-ac1e-734789ae3199","Type":"ContainerStarted","Data":"996cafc79b4404d5f72292d70273e4a9b3a218fbef0e41bea7d031337fc2bf24"} Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.597364 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.743710 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.7436909910000002 podStartE2EDuration="3.743690991s" podCreationTimestamp="2025-11-21 12:51:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:51:53.632009803 +0000 UTC m=+3672.332671621" watchObservedRunningTime="2025-11-21 12:51:53.743690991 +0000 UTC m=+3672.444352809" Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.755554 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:51:53 crc kubenswrapper[4769]: I1121 12:51:53.911415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:51:54 crc kubenswrapper[4769]: I1121 12:51:54.054483 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:51:54 crc kubenswrapper[4769]: I1121 12:51:54.616764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705","Type":"ContainerStarted","Data":"c31da4d2c8c0547295af46d0d7f41e4722ac3c8c51575ad1167e08eee6a63eb5"} Nov 21 12:51:54 crc kubenswrapper[4769]: I1121 12:51:54.619071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"e15176d9-214d-4f78-bb65-122a9db292d9","Type":"ContainerStarted","Data":"bfc7f1b8094e6d4bb2c7045e068b48ab5e7f32ad4f0bbc62a99167cc0b3978a9"} Nov 21 12:51:54 crc kubenswrapper[4769]: I1121 12:51:54.973840 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.044509 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-dispersionconf\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpld9\" (UniqueName: \"kubernetes.io/projected/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-kube-api-access-zpld9\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-etc-swift\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-scripts\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-ring-data-devices\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-combined-ca-bundle\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.143741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-swiftconf\") pod \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\" (UID: \"fe7a83cd-d17a-463f-b2cd-288865bc2f1c\") " Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.144571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.145072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.217443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.217800 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.244735 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.245055 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.246927 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.246955 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.285480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-kube-api-access-zpld9" (OuterVolumeSpecName: "kube-api-access-zpld9") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "kube-api-access-zpld9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.350354 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zpld9\" (UniqueName: \"kubernetes.io/projected/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-kube-api-access-zpld9\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.436757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.451906 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.640562 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.799881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-scripts" (OuterVolumeSpecName: "scripts") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.803040 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.526964909 podStartE2EDuration="8.803019592s" podCreationTimestamp="2025-11-21 12:51:47 +0000 UTC" firstStartedPulling="2025-11-21 12:51:48.130577483 +0000 UTC m=+3666.831239301" lastFinishedPulling="2025-11-21 12:51:54.406632175 +0000 UTC m=+3673.107293984" observedRunningTime="2025-11-21 12:51:55.752509448 +0000 UTC m=+3674.453171266" watchObservedRunningTime="2025-11-21 12:51:55.803019592 +0000 UTC m=+3674.503681400" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.807780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.809307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "fe7a83cd-d17a-463f-b2cd-288865bc2f1c" (UID: "fe7a83cd-d17a-463f-b2cd-288865bc2f1c"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.852908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"e15176d9-214d-4f78-bb65-122a9db292d9","Type":"ContainerStarted","Data":"4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d"} Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.852967 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.852986 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-qqg9f"] Nov 21 12:51:55 crc kubenswrapper[4769]: E1121 12:51:55.853525 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe7a83cd-d17a-463f-b2cd-288865bc2f1c" containerName="swift-ring-rebalance" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.853549 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7a83cd-d17a-463f-b2cd-288865bc2f1c" containerName="swift-ring-rebalance" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.853800 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe7a83cd-d17a-463f-b2cd-288865bc2f1c" containerName="swift-ring-rebalance" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.858003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-hn7gb" event={"ID":"fe7a83cd-d17a-463f-b2cd-288865bc2f1c","Type":"ContainerDied","Data":"0a0a1fe44c9641223b22c83aa9a9f8fca991dae7a814554ccc4ffa319e9f5f1e"} Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.858051 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a0a1fe44c9641223b22c83aa9a9f8fca991dae7a814554ccc4ffa319e9f5f1e" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.858071 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-qqg9f"] Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.858088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerStarted","Data":"9a5cd76504ee7e94872f2982cac0e9f6f18b134ed010c07ab1dd915d0e5b4ec0"} Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.858209 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.863097 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.863133 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.863150 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fe7a83cd-d17a-463f-b2cd-288865bc2f1c-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.880810 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.965585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-catalog-content\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.965648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-utilities\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:55 crc kubenswrapper[4769]: I1121 12:51:55.965675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhmn2\" (UniqueName: \"kubernetes.io/projected/b2a86b05-e894-4062-be58-cc31c9c44624-kube-api-access-jhmn2\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.067493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-catalog-content\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.067776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-utilities\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.067858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jhmn2\" (UniqueName: \"kubernetes.io/projected/b2a86b05-e894-4062-be58-cc31c9c44624-kube-api-access-jhmn2\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.068058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-catalog-content\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.068161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-utilities\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.086151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhmn2\" (UniqueName: \"kubernetes.io/projected/b2a86b05-e894-4062-be58-cc31c9c44624-kube-api-access-jhmn2\") pod \"redhat-marketplace-qqg9f\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.230365 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.153:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.230387 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.153:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.240714 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.680740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705","Type":"ContainerStarted","Data":"bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc"} Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.693654 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.694030 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.732997 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-qqg9f"] Nov 21 12:51:56 crc kubenswrapper[4769]: W1121 12:51:56.747285 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a86b05_e894_4062_be58_cc31c9c44624.slice/crio-ed4ce3b205e2476a9c7022a94d333b4d826e02326812424e239c40b1c7c38b01 WatchSource:0}: Error finding container ed4ce3b205e2476a9c7022a94d333b4d826e02326812424e239c40b1c7c38b01: Status 404 returned error can't find the container with id ed4ce3b205e2476a9c7022a94d333b4d826e02326812424e239c40b1c7c38b01 Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.813203 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:51:56 crc kubenswrapper[4769]: I1121 12:51:56.891667 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:57 crc kubenswrapper[4769]: I1121 12:51:57.692724 4769 generic.go:334] "Generic (PLEG): container finished" podID="b2a86b05-e894-4062-be58-cc31c9c44624" containerID="82dca222bc5e4e4c0aebb69b388c5f13f8e458eded4fac0ce7a9933c65cbfddc" exitCode=0 Nov 21 12:51:57 crc kubenswrapper[4769]: I1121 12:51:57.692817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qqg9f" event={"ID":"b2a86b05-e894-4062-be58-cc31c9c44624","Type":"ContainerDied","Data":"82dca222bc5e4e4c0aebb69b388c5f13f8e458eded4fac0ce7a9933c65cbfddc"} Nov 21 12:51:57 crc kubenswrapper[4769]: I1121 12:51:57.693377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qqg9f" event={"ID":"b2a86b05-e894-4062-be58-cc31c9c44624","Type":"ContainerStarted","Data":"ed4ce3b205e2476a9c7022a94d333b4d826e02326812424e239c40b1c7c38b01"} Nov 21 12:51:57 crc kubenswrapper[4769]: I1121 12:51:57.816040 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:51:58 crc kubenswrapper[4769]: I1121 12:51:58.706818 4769 generic.go:334] "Generic (PLEG): container finished" podID="e527d5f6-ee88-49ac-bf24-c584e56e456f" containerID="59b12c11a269cc8bbe3e6e4e210fdb2be762c7e4fb8a1b965510fb8cacd76729" exitCode=0 Nov 21 12:51:58 crc kubenswrapper[4769]: I1121 12:51:58.706935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" event={"ID":"e527d5f6-ee88-49ac-bf24-c584e56e456f","Type":"ContainerDied","Data":"59b12c11a269cc8bbe3e6e4e210fdb2be762c7e4fb8a1b965510fb8cacd76729"} Nov 21 12:51:58 crc kubenswrapper[4769]: I1121 12:51:58.710901 4769 generic.go:334] "Generic (PLEG): container finished" podID="b2a86b05-e894-4062-be58-cc31c9c44624" containerID="e935e108d9545526af2148e668ef8eda6f47dc3845ee58551297261a4925e2c7" exitCode=0 Nov 21 12:51:58 crc kubenswrapper[4769]: I1121 12:51:58.710958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qqg9f" event={"ID":"b2a86b05-e894-4062-be58-cc31c9c44624","Type":"ContainerDied","Data":"e935e108d9545526af2148e668ef8eda6f47dc3845ee58551297261a4925e2c7"} Nov 21 12:51:59 crc kubenswrapper[4769]: I1121 12:51:59.491430 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.140:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:59 crc kubenswrapper[4769]: I1121 12:51:59.491430 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.140:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:51:59 crc kubenswrapper[4769]: I1121 12:51:59.723038 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qqg9f" event={"ID":"b2a86b05-e894-4062-be58-cc31c9c44624","Type":"ContainerStarted","Data":"4647a97a7132f7b4f5e9913c33726eebe1c9f13532d5b3cbb000e60274f5346e"} Nov 21 12:51:59 crc kubenswrapper[4769]: I1121 12:51:59.769177 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-qqg9f" podStartSLOduration=3.305949481 podStartE2EDuration="4.769151195s" podCreationTimestamp="2025-11-21 12:51:55 +0000 UTC" firstStartedPulling="2025-11-21 12:51:57.695267628 +0000 UTC m=+3676.395929476" lastFinishedPulling="2025-11-21 12:51:59.158469372 +0000 UTC m=+3677.859131190" observedRunningTime="2025-11-21 12:51:59.747909577 +0000 UTC m=+3678.448571395" watchObservedRunningTime="2025-11-21 12:51:59.769151195 +0000 UTC m=+3678.469813053" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.120457 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.265177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-scripts\") pod \"e527d5f6-ee88-49ac-bf24-c584e56e456f\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.265233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-config-data\") pod \"e527d5f6-ee88-49ac-bf24-c584e56e456f\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.265294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/e527d5f6-ee88-49ac-bf24-c584e56e456f-kube-api-access-jvmfd\") pod \"e527d5f6-ee88-49ac-bf24-c584e56e456f\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.265384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-combined-ca-bundle\") pod \"e527d5f6-ee88-49ac-bf24-c584e56e456f\" (UID: \"e527d5f6-ee88-49ac-bf24-c584e56e456f\") " Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.289305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-scripts" (OuterVolumeSpecName: "scripts") pod "e527d5f6-ee88-49ac-bf24-c584e56e456f" (UID: "e527d5f6-ee88-49ac-bf24-c584e56e456f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.291390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e527d5f6-ee88-49ac-bf24-c584e56e456f-kube-api-access-jvmfd" (OuterVolumeSpecName: "kube-api-access-jvmfd") pod "e527d5f6-ee88-49ac-bf24-c584e56e456f" (UID: "e527d5f6-ee88-49ac-bf24-c584e56e456f"). InnerVolumeSpecName "kube-api-access-jvmfd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.311378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-config-data" (OuterVolumeSpecName: "config-data") pod "e527d5f6-ee88-49ac-bf24-c584e56e456f" (UID: "e527d5f6-ee88-49ac-bf24-c584e56e456f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.319174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e527d5f6-ee88-49ac-bf24-c584e56e456f" (UID: "e527d5f6-ee88-49ac-bf24-c584e56e456f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.368428 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.368505 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.368522 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/e527d5f6-ee88-49ac-bf24-c584e56e456f-kube-api-access-jvmfd\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.368534 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e527d5f6-ee88-49ac-bf24-c584e56e456f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.391334 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.391740 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-central-agent" containerID="cri-o://d35e3dc686e58546b5f1096d429aa7e1f686326bae7aad98f24ff965e3bba2f4" gracePeriod=30 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.391772 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="sg-core" containerID="cri-o://a2f94d960ed5c537c806881a1fd01b547d7cfd1877bc19af16aa08747fa73fc0" gracePeriod=30 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.391798 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-notification-agent" containerID="cri-o://38743498294a6069eeeca3d62431eaa8674c83aeac139a7ea249e20d4f41558a" gracePeriod=30 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.391820 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="proxy-httpd" containerID="cri-o://9a5cd76504ee7e94872f2982cac0e9f6f18b134ed010c07ab1dd915d0e5b4ec0" gracePeriod=30 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.748964 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.750708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs" event={"ID":"e527d5f6-ee88-49ac-bf24-c584e56e456f","Type":"ContainerDied","Data":"fa0c6e9be2d181b23d1c84c0b13f21eb411512d97a43d5e567d27edb9e492078"} Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.750754 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa0c6e9be2d181b23d1c84c0b13f21eb411512d97a43d5e567d27edb9e492078" Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.754623 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerID="9a5cd76504ee7e94872f2982cac0e9f6f18b134ed010c07ab1dd915d0e5b4ec0" exitCode=0 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.754657 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerID="a2f94d960ed5c537c806881a1fd01b547d7cfd1877bc19af16aa08747fa73fc0" exitCode=2 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.754672 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerID="38743498294a6069eeeca3d62431eaa8674c83aeac139a7ea249e20d4f41558a" exitCode=0 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.754691 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerID="d35e3dc686e58546b5f1096d429aa7e1f686326bae7aad98f24ff965e3bba2f4" exitCode=0 Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.756156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerDied","Data":"9a5cd76504ee7e94872f2982cac0e9f6f18b134ed010c07ab1dd915d0e5b4ec0"} Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.756219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerDied","Data":"a2f94d960ed5c537c806881a1fd01b547d7cfd1877bc19af16aa08747fa73fc0"} Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.756239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerDied","Data":"38743498294a6069eeeca3d62431eaa8674c83aeac139a7ea249e20d4f41558a"} Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.756253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerDied","Data":"d35e3dc686e58546b5f1096d429aa7e1f686326bae7aad98f24ff965e3bba2f4"} Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.801799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:52:00 crc kubenswrapper[4769]: I1121 12:52:00.802010 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="1c2c59da-2c9a-45db-845a-b052ceb93993" containerName="nova-cell1-conductor-conductor" containerID="cri-o://d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" gracePeriod=30 Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.028870 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.183639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-run-httpd\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.183761 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-ceilometer-tls-certs\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.183809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-sg-core-conf-yaml\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.183846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-log-httpd\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.183917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-config-data\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.183939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-scripts\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.184022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-combined-ca-bundle\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.184049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctf2d\" (UniqueName: \"kubernetes.io/projected/a4ec3717-5736-415b-a2d1-46da29f8fde8-kube-api-access-ctf2d\") pod \"a4ec3717-5736-415b-a2d1-46da29f8fde8\" (UID: \"a4ec3717-5736-415b-a2d1-46da29f8fde8\") " Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.184093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.184360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.185080 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.185102 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4ec3717-5736-415b-a2d1-46da29f8fde8-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.189292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-scripts" (OuterVolumeSpecName: "scripts") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.189837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ec3717-5736-415b-a2d1-46da29f8fde8-kube-api-access-ctf2d" (OuterVolumeSpecName: "kube-api-access-ctf2d") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "kube-api-access-ctf2d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.235326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.249315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.286865 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.286890 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.286899 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.286910 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ctf2d\" (UniqueName: \"kubernetes.io/projected/a4ec3717-5736-415b-a2d1-46da29f8fde8-kube-api-access-ctf2d\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.296342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.304055 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-config-data" (OuterVolumeSpecName: "config-data") pod "a4ec3717-5736-415b-a2d1-46da29f8fde8" (UID: "a4ec3717-5736-415b-a2d1-46da29f8fde8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.388679 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.388713 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4ec3717-5736-415b-a2d1-46da29f8fde8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.773544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4ec3717-5736-415b-a2d1-46da29f8fde8","Type":"ContainerDied","Data":"bc070821a1ed932826469b3560102bcd8aa87b9137f5db1b1e5e7bbf8009cc7b"} Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.773632 4769 scope.go:117] "RemoveContainer" containerID="9a5cd76504ee7e94872f2982cac0e9f6f18b134ed010c07ab1dd915d0e5b4ec0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.773647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.801127 4769 scope.go:117] "RemoveContainer" containerID="a2f94d960ed5c537c806881a1fd01b547d7cfd1877bc19af16aa08747fa73fc0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.853492 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.853651 4769 scope.go:117] "RemoveContainer" containerID="38743498294a6069eeeca3d62431eaa8674c83aeac139a7ea249e20d4f41558a" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.877426 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.889392 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:52:01 crc kubenswrapper[4769]: E1121 12:52:01.889897 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="proxy-httpd" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.889918 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="proxy-httpd" Nov 21 12:52:01 crc kubenswrapper[4769]: E1121 12:52:01.889936 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-central-agent" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.889945 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-central-agent" Nov 21 12:52:01 crc kubenswrapper[4769]: E1121 12:52:01.889986 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e527d5f6-ee88-49ac-bf24-c584e56e456f" containerName="nova-cell1-conductor-db-sync" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.889995 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e527d5f6-ee88-49ac-bf24-c584e56e456f" containerName="nova-cell1-conductor-db-sync" Nov 21 12:52:01 crc kubenswrapper[4769]: E1121 12:52:01.890030 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-notification-agent" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890039 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-notification-agent" Nov 21 12:52:01 crc kubenswrapper[4769]: E1121 12:52:01.890063 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="sg-core" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890072 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="sg-core" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890350 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e527d5f6-ee88-49ac-bf24-c584e56e456f" containerName="nova-cell1-conductor-db-sync" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890376 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="sg-core" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890388 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="proxy-httpd" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890408 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-notification-agent" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.890424 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" containerName="ceilometer-central-agent" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.892078 4769 scope.go:117] "RemoveContainer" containerID="d35e3dc686e58546b5f1096d429aa7e1f686326bae7aad98f24ff965e3bba2f4" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.892631 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.897662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.897998 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.898213 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.898419 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-run-httpd\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-scripts\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkr2l\" (UniqueName: \"kubernetes.io/projected/7b69cf86-c5aa-4cce-8122-35443043c210-kube-api-access-rkr2l\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-config-data\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:01 crc kubenswrapper[4769]: I1121 12:52:01.904423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-log-httpd\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.006009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-scripts\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.006427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rkr2l\" (UniqueName: \"kubernetes.io/projected/7b69cf86-c5aa-4cce-8122-35443043c210-kube-api-access-rkr2l\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.006844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-config-data\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.007361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.007389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.007426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-log-httpd\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.007534 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-run-httpd\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.007567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.008027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-run-httpd\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.008164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-log-httpd\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.011136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.012272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.012361 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-scripts\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.013101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-config-data\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.018732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.020752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkr2l\" (UniqueName: \"kubernetes.io/projected/7b69cf86-c5aa-4cce-8122-35443043c210-kube-api-access-rkr2l\") pod \"ceilometer-0\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.214633 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.722764 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:52:02 crc kubenswrapper[4769]: W1121 12:52:02.729771 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b69cf86_c5aa_4cce_8122_35443043c210.slice/crio-733e7da45a15f59169d05f6ba3ecb1d8411d66b37eba5468932b8ae3bb540782 WatchSource:0}: Error finding container 733e7da45a15f59169d05f6ba3ecb1d8411d66b37eba5468932b8ae3bb540782: Status 404 returned error can't find the container with id 733e7da45a15f59169d05f6ba3ecb1d8411d66b37eba5468932b8ae3bb540782 Nov 21 12:52:02 crc kubenswrapper[4769]: I1121 12:52:02.786004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerStarted","Data":"733e7da45a15f59169d05f6ba3ecb1d8411d66b37eba5468932b8ae3bb540782"} Nov 21 12:52:02 crc kubenswrapper[4769]: E1121 12:52:02.898642 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:52:02 crc kubenswrapper[4769]: E1121 12:52:02.900126 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:52:02 crc kubenswrapper[4769]: E1121 12:52:02.903762 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:52:02 crc kubenswrapper[4769]: E1121 12:52:02.903807 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="1c2c59da-2c9a-45db-845a-b052ceb93993" containerName="nova-cell1-conductor-conductor" Nov 21 12:52:03 crc kubenswrapper[4769]: I1121 12:52:03.293842 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ec3717-5736-415b-a2d1-46da29f8fde8" path="/var/lib/kubelet/pods/a4ec3717-5736-415b-a2d1-46da29f8fde8/volumes" Nov 21 12:52:03 crc kubenswrapper[4769]: I1121 12:52:03.804182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerStarted","Data":"471841b1522d24c8f23a3d9a330a2d294acea07c93a75761a7a56fc8ab69a617"} Nov 21 12:52:04 crc kubenswrapper[4769]: I1121 12:52:04.819789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerStarted","Data":"d8acee167036c7598559c585c217eef54cf47c0cf77300f652401eb4bd4c9aa6"} Nov 21 12:52:05 crc kubenswrapper[4769]: I1121 12:52:05.836067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerStarted","Data":"d375235b460a38fd29e4ec4d7f7911cdc95d3bde1fcd66fc54caf74325bf86be"} Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.078900 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.229602 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.153:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.229624 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.153:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.240848 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.241877 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.331402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.846569 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" containerID="43d32cc2500dd696e02f6890872da8344483fba20ae709be434f7eda1d0ba363" exitCode=0 Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.846659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-d5w65" event={"ID":"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2","Type":"ContainerDied","Data":"43d32cc2500dd696e02f6890872da8344483fba20ae709be434f7eda1d0ba363"} Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.849580 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce32d94f-d365-4adc-a1aa-362b3a0fceba" containerID="ab11cc07b5380dc8fb62a559721f6d9273ace6edd4762e44863fc0d64e7ac1d2" exitCode=0 Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.849693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" event={"ID":"ce32d94f-d365-4adc-a1aa-362b3a0fceba","Type":"ContainerDied","Data":"ab11cc07b5380dc8fb62a559721f6d9273ace6edd4762e44863fc0d64e7ac1d2"} Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.851848 4769 generic.go:334] "Generic (PLEG): container finished" podID="0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" containerID="47fdb25b7dd3ebbda6ae3cc652d395c71966905f6a37ae41f7394d1693f339a6" exitCode=0 Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.851923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" event={"ID":"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c","Type":"ContainerDied","Data":"47fdb25b7dd3ebbda6ae3cc652d395c71966905f6a37ae41f7394d1693f339a6"} Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.912759 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:52:06 crc kubenswrapper[4769]: I1121 12:52:06.964523 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-qqg9f"] Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.584895 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.733020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ppqb\" (UniqueName: \"kubernetes.io/projected/1c2c59da-2c9a-45db-845a-b052ceb93993-kube-api-access-8ppqb\") pod \"1c2c59da-2c9a-45db-845a-b052ceb93993\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.733132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-combined-ca-bundle\") pod \"1c2c59da-2c9a-45db-845a-b052ceb93993\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.733178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-config-data\") pod \"1c2c59da-2c9a-45db-845a-b052ceb93993\" (UID: \"1c2c59da-2c9a-45db-845a-b052ceb93993\") " Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.746724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2c59da-2c9a-45db-845a-b052ceb93993-kube-api-access-8ppqb" (OuterVolumeSpecName: "kube-api-access-8ppqb") pod "1c2c59da-2c9a-45db-845a-b052ceb93993" (UID: "1c2c59da-2c9a-45db-845a-b052ceb93993"). InnerVolumeSpecName "kube-api-access-8ppqb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.767610 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-config-data" (OuterVolumeSpecName: "config-data") pod "1c2c59da-2c9a-45db-845a-b052ceb93993" (UID: "1c2c59da-2c9a-45db-845a-b052ceb93993"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.778335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c2c59da-2c9a-45db-845a-b052ceb93993" (UID: "1c2c59da-2c9a-45db-845a-b052ceb93993"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.836979 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8ppqb\" (UniqueName: \"kubernetes.io/projected/1c2c59da-2c9a-45db-845a-b052ceb93993-kube-api-access-8ppqb\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.837013 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.837025 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c2c59da-2c9a-45db-845a-b052ceb93993-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.863551 4769 generic.go:334] "Generic (PLEG): container finished" podID="235b264a-c7e8-465d-a791-b01776cb8e77" containerID="fe440698d4bf6426f16c562c14614ac51dba8c236c7e03beda6285499c405172" exitCode=0 Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.863633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" event={"ID":"235b264a-c7e8-465d-a791-b01776cb8e77","Type":"ContainerDied","Data":"fe440698d4bf6426f16c562c14614ac51dba8c236c7e03beda6285499c405172"} Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.868072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerStarted","Data":"0b4a32a7919ab509364cdfc133e358ba7efdcdf58aa7e5177524a7d1c365d050"} Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.868749 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.871861 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c2c59da-2c9a-45db-845a-b052ceb93993" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" exitCode=0 Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.872782 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.883268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"1c2c59da-2c9a-45db-845a-b052ceb93993","Type":"ContainerDied","Data":"d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957"} Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.883309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"1c2c59da-2c9a-45db-845a-b052ceb93993","Type":"ContainerDied","Data":"710d2e0ffa351bac4d0eff1d1e76a6e3a87324384a2c53f389e82bdf348ef3f9"} Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.883331 4769 scope.go:117] "RemoveContainer" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" Nov 21 12:52:07 crc kubenswrapper[4769]: I1121 12:52:07.935439 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.015922382 podStartE2EDuration="6.935423307s" podCreationTimestamp="2025-11-21 12:52:01 +0000 UTC" firstStartedPulling="2025-11-21 12:52:02.73257071 +0000 UTC m=+3681.433232548" lastFinishedPulling="2025-11-21 12:52:06.652071615 +0000 UTC m=+3685.352733473" observedRunningTime="2025-11-21 12:52:07.926693639 +0000 UTC m=+3686.627355457" watchObservedRunningTime="2025-11-21 12:52:07.935423307 +0000 UTC m=+3686.636085125" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:07.995350 4769 scope.go:117] "RemoveContainer" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" Nov 21 12:52:08 crc kubenswrapper[4769]: E1121 12:52:07.995910 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957\": container with ID starting with d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957 not found: ID does not exist" containerID="d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:07.995935 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957"} err="failed to get container status \"d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957\": rpc error: code = NotFound desc = could not find container \"d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957\": container with ID starting with d45fcdec6f9275ccd240414a8c6a87fcaa5db4d2a07a256b21f2fd28ce998957 not found: ID does not exist" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.013890 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.032725 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.041914 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:52:08 crc kubenswrapper[4769]: E1121 12:52:08.042795 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c2c59da-2c9a-45db-845a-b052ceb93993" containerName="nova-cell1-conductor-conductor" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.042813 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2c59da-2c9a-45db-845a-b052ceb93993" containerName="nova-cell1-conductor-conductor" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.043185 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c2c59da-2c9a-45db-845a-b052ceb93993" containerName="nova-cell1-conductor-conductor" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.044764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.047826 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.057405 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.066720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.066784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.066813 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqtgz\" (UniqueName: \"kubernetes.io/projected/305f687e-8e30-410c-b78d-6fd4f2d9191a-kube-api-access-kqtgz\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.170583 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.170649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.170680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kqtgz\" (UniqueName: \"kubernetes.io/projected/305f687e-8e30-410c-b78d-6fd4f2d9191a-kube-api-access-kqtgz\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.184223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.185963 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.186476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqtgz\" (UniqueName: \"kubernetes.io/projected/305f687e-8e30-410c-b78d-6fd4f2d9191a-kube-api-access-kqtgz\") pod \"nova-cell1-conductor-0\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.336332 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.361146 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.393660 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.440862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.476735 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-config-data\") pod \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.476898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-combined-ca-bundle\") pod \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.477019 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr8j4\" (UniqueName: \"kubernetes.io/projected/ce32d94f-d365-4adc-a1aa-362b3a0fceba-kube-api-access-xr8j4\") pod \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\" (UID: \"ce32d94f-d365-4adc-a1aa-362b3a0fceba\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.480386 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.480806 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.481167 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce32d94f-d365-4adc-a1aa-362b3a0fceba-kube-api-access-xr8j4" (OuterVolumeSpecName: "kube-api-access-xr8j4") pod "ce32d94f-d365-4adc-a1aa-362b3a0fceba" (UID: "ce32d94f-d365-4adc-a1aa-362b3a0fceba"). InnerVolumeSpecName "kube-api-access-xr8j4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.492405 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.495497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.527244 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ce32d94f-d365-4adc-a1aa-362b3a0fceba" (UID: "ce32d94f-d365-4adc-a1aa-362b3a0fceba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.541322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-config-data" (OuterVolumeSpecName: "config-data") pod "ce32d94f-d365-4adc-a1aa-362b3a0fceba" (UID: "ce32d94f-d365-4adc-a1aa-362b3a0fceba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.578584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-scripts\") pod \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.578789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-config-data\") pod \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.578887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-db-sync-config-data\") pod \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.578940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-combined-ca-bundle\") pod \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.578959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-logs\") pod \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.579007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdkd9\" (UniqueName: \"kubernetes.io/projected/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-kube-api-access-fdkd9\") pod \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\" (UID: \"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.579356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-combined-ca-bundle\") pod \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.579412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crktb\" (UniqueName: \"kubernetes.io/projected/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-kube-api-access-crktb\") pod \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\" (UID: \"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c\") " Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.579522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-logs" (OuterVolumeSpecName: "logs") pod "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" (UID: "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.580231 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.580248 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.580258 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce32d94f-d365-4adc-a1aa-362b3a0fceba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.580269 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xr8j4\" (UniqueName: \"kubernetes.io/projected/ce32d94f-d365-4adc-a1aa-362b3a0fceba-kube-api-access-xr8j4\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.582628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-scripts" (OuterVolumeSpecName: "scripts") pod "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" (UID: "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.583218 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-kube-api-access-fdkd9" (OuterVolumeSpecName: "kube-api-access-fdkd9") pod "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" (UID: "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2"). InnerVolumeSpecName "kube-api-access-fdkd9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.585492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-kube-api-access-crktb" (OuterVolumeSpecName: "kube-api-access-crktb") pod "0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" (UID: "0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c"). InnerVolumeSpecName "kube-api-access-crktb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.585708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" (UID: "0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.609744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" (UID: "0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.617324 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-config-data" (OuterVolumeSpecName: "config-data") pod "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" (UID: "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.619770 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" (UID: "3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682013 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682046 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682055 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fdkd9\" (UniqueName: \"kubernetes.io/projected/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-kube-api-access-fdkd9\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682065 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682075 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-crktb\" (UniqueName: \"kubernetes.io/projected/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c-kube-api-access-crktb\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682084 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.682091 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.840544 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:52:08 crc kubenswrapper[4769]: W1121 12:52:08.850696 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod305f687e_8e30_410c_b78d_6fd4f2d9191a.slice/crio-7e361b31594b189df2045d4e88a65c6b2724cb53494825f51cedba9d15f2e466 WatchSource:0}: Error finding container 7e361b31594b189df2045d4e88a65c6b2724cb53494825f51cedba9d15f2e466: Status 404 returned error can't find the container with id 7e361b31594b189df2045d4e88a65c6b2724cb53494825f51cedba9d15f2e466 Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.910312 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-d5w65" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.911786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-d5w65" event={"ID":"3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2","Type":"ContainerDied","Data":"e2b8819876dd6eb0395611b6237d22e3d81d4a69d15392ec3c05cec27cd594da"} Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.911835 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2b8819876dd6eb0395611b6237d22e3d81d4a69d15392ec3c05cec27cd594da" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.917501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" event={"ID":"ce32d94f-d365-4adc-a1aa-362b3a0fceba","Type":"ContainerDied","Data":"faf15e7c107a743ac60fe76fa708c33ec0840339202e7d4cdfb7e2e7c5ce4932"} Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.917538 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faf15e7c107a743ac60fe76fa708c33ec0840339202e7d4cdfb7e2e7c5ce4932" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.917603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-vzssb" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.925651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"305f687e-8e30-410c-b78d-6fd4f2d9191a","Type":"ContainerStarted","Data":"7e361b31594b189df2045d4e88a65c6b2724cb53494825f51cedba9d15f2e466"} Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.945214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" event={"ID":"0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c","Type":"ContainerDied","Data":"029198fb2c422300f7b716746f9ac1953703f1eb3b1ec6cc89ad7a6220e14a74"} Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.945249 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="029198fb2c422300f7b716746f9ac1953703f1eb3b1ec6cc89ad7a6220e14a74" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.945314 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-b4xl4" Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.948619 4769 generic.go:334] "Generic (PLEG): container finished" podID="3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" containerID="87636c08827b45b1cf0db585cbd58ea33e909f36ea59c10b74779fbd9b27daf4" exitCode=0 Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.948689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75gt6" event={"ID":"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6","Type":"ContainerDied","Data":"87636c08827b45b1cf0db585cbd58ea33e909f36ea59c10b74779fbd9b27daf4"} Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.980434 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b34285f-f704-420c-a395-eb7bcdaef6c5" containerID="e008e0744d10c71887e2076dd5c66e9820507ab0e909e49b76a0cff5333369ac" exitCode=0 Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.980573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" event={"ID":"4b34285f-f704-420c-a395-eb7bcdaef6c5","Type":"ContainerDied","Data":"e008e0744d10c71887e2076dd5c66e9820507ab0e909e49b76a0cff5333369ac"} Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.980641 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-qqg9f" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="registry-server" containerID="cri-o://4647a97a7132f7b4f5e9913c33726eebe1c9f13532d5b3cbb000e60274f5346e" gracePeriod=2 Nov 21 12:52:08 crc kubenswrapper[4769]: I1121 12:52:08.996175 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.031106 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7bc74f485b-vm922"] Nov 21 12:52:09 crc kubenswrapper[4769]: E1121 12:52:09.031729 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" containerName="placement-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.031757 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" containerName="placement-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: E1121 12:52:09.031770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" containerName="barbican-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.031780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" containerName="barbican-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: E1121 12:52:09.031822 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce32d94f-d365-4adc-a1aa-362b3a0fceba" containerName="keystone-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.031831 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce32d94f-d365-4adc-a1aa-362b3a0fceba" containerName="keystone-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.032038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce32d94f-d365-4adc-a1aa-362b3a0fceba" containerName="keystone-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.032062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" containerName="barbican-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.032070 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" containerName="placement-db-sync" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.033270 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.047822 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.053579 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7bc74f485b-vm922"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.102851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7l7gg"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.142591 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-7l7gg"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-combined-ca-bundle\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-internal-tls-certs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-scripts\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c6sl\" (UniqueName: \"kubernetes.io/projected/e83044ec-e522-4705-baac-c8344c6bf994-kube-api-access-8c6sl\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e83044ec-e522-4705-baac-c8344c6bf994-logs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-config-data\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.198763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-public-tls-certs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.221265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.222986 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.255271 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.257143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-internal-tls-certs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-scripts\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8c6sl\" (UniqueName: \"kubernetes.io/projected/e83044ec-e522-4705-baac-c8344c6bf994-kube-api-access-8c6sl\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e83044ec-e522-4705-baac-c8344c6bf994-logs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301455 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-config-data\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-public-tls-certs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.301524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-combined-ca-bundle\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.321813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-internal-tls-certs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.324036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e83044ec-e522-4705-baac-c8344c6bf994-logs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.325348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-scripts\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.335231 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-config-data\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.352597 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c2c59da-2c9a-45db-845a-b052ceb93993" path="/var/lib/kubelet/pods/1c2c59da-2c9a-45db-845a-b052ceb93993/volumes" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.353139 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48598363-9c87-49d3-ac97-609138b72597" path="/var/lib/kubelet/pods/48598363-9c87-49d3-ac97-609138b72597/volumes" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.353700 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.353725 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.359034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-combined-ca-bundle\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.420905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c6sl\" (UniqueName: \"kubernetes.io/projected/e83044ec-e522-4705-baac-c8344c6bf994-kube-api-access-8c6sl\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.420925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-logs\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421082 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-combined-ca-bundle\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data-custom\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/587b6cbe-7e51-4177-a229-f6a608d0fcab-logs\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8dxp\" (UniqueName: \"kubernetes.io/projected/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-kube-api-access-p8dxp\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421392 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-combined-ca-bundle\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpgb\" (UniqueName: \"kubernetes.io/projected/587b6cbe-7e51-4177-a229-f6a608d0fcab-kube-api-access-xrpgb\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data-custom\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.421532 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.457833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-public-tls-certs\") pod \"placement-7bc74f485b-vm922\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.497088 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.497923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.545354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-logs\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.545418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-combined-ca-bundle\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.545446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.546541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data-custom\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.547481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/587b6cbe-7e51-4177-a229-f6a608d0fcab-logs\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.547563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p8dxp\" (UniqueName: \"kubernetes.io/projected/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-kube-api-access-p8dxp\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.548029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/587b6cbe-7e51-4177-a229-f6a608d0fcab-logs\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.548082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-logs\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.548239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-combined-ca-bundle\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.548275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpgb\" (UniqueName: \"kubernetes.io/projected/587b6cbe-7e51-4177-a229-f6a608d0fcab-kube-api-access-xrpgb\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.548332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.548350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data-custom\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.562190 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data-custom\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.566298 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.567330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.592771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data-custom\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.602001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-combined-ca-bundle\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.625770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-combined-ca-bundle\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.629114 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p8p22"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.630450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.632329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8dxp\" (UniqueName: \"kubernetes.io/projected/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-kube-api-access-p8dxp\") pod \"barbican-worker-76b75c57b9-74zx6\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.638552 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.640008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpgb\" (UniqueName: \"kubernetes.io/projected/587b6cbe-7e51-4177-a229-f6a608d0fcab-kube-api-access-xrpgb\") pod \"barbican-keystone-listener-695c9dfdfb-wrgb8\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.649013 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.661308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p8p22"] Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2g9z\" (UniqueName: \"kubernetes.io/projected/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-kube-api-access-c2g9z\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-internal-tls-certs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data-custom\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-public-tls-certs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-config-data\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-fernet-keys\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21b8e395-ab14-4f2c-a784-7ada05455d6a-logs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9j29\" (UniqueName: \"kubernetes.io/projected/21b8e395-ab14-4f2c-a784-7ada05455d6a-kube-api-access-k9j29\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-combined-ca-bundle\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-scripts\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-credential-keys\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.671676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-combined-ca-bundle\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.738067 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-credential-keys\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-combined-ca-bundle\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773838 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-internal-tls-certs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773863 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c2g9z\" (UniqueName: \"kubernetes.io/projected/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-kube-api-access-c2g9z\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-public-tls-certs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data-custom\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-config-data\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-fernet-keys\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.773980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21b8e395-ab14-4f2c-a784-7ada05455d6a-logs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.774003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9j29\" (UniqueName: \"kubernetes.io/projected/21b8e395-ab14-4f2c-a784-7ada05455d6a-kube-api-access-k9j29\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.774029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-combined-ca-bundle\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.774045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-scripts\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.774060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.776043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21b8e395-ab14-4f2c-a784-7ada05455d6a-logs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.780836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data-custom\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.783246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-internal-tls-certs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.788172 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.789627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-public-tls-certs\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.790958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-scripts\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.793397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-combined-ca-bundle\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.793976 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-fernet-keys\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.795717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-credential-keys\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.796673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-combined-ca-bundle\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.797261 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.798751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-config-data\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.801740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9j29\" (UniqueName: \"kubernetes.io/projected/21b8e395-ab14-4f2c-a784-7ada05455d6a-kube-api-access-k9j29\") pod \"barbican-api-86549cd56b-kdm4p\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.812819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2g9z\" (UniqueName: \"kubernetes.io/projected/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-kube-api-access-c2g9z\") pod \"keystone-bootstrap-p8p22\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.872756 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.915789 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.953756 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.981980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-scripts\") pod \"235b264a-c7e8-465d-a791-b01776cb8e77\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.982063 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/235b264a-c7e8-465d-a791-b01776cb8e77-etc-machine-id\") pod \"235b264a-c7e8-465d-a791-b01776cb8e77\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.982190 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57wgn\" (UniqueName: \"kubernetes.io/projected/235b264a-c7e8-465d-a791-b01776cb8e77-kube-api-access-57wgn\") pod \"235b264a-c7e8-465d-a791-b01776cb8e77\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.982265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-db-sync-config-data\") pod \"235b264a-c7e8-465d-a791-b01776cb8e77\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.982307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-config-data\") pod \"235b264a-c7e8-465d-a791-b01776cb8e77\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.982362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-combined-ca-bundle\") pod \"235b264a-c7e8-465d-a791-b01776cb8e77\" (UID: \"235b264a-c7e8-465d-a791-b01776cb8e77\") " Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.982596 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/235b264a-c7e8-465d-a791-b01776cb8e77-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "235b264a-c7e8-465d-a791-b01776cb8e77" (UID: "235b264a-c7e8-465d-a791-b01776cb8e77"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.986064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "235b264a-c7e8-465d-a791-b01776cb8e77" (UID: "235b264a-c7e8-465d-a791-b01776cb8e77"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:09 crc kubenswrapper[4769]: I1121 12:52:09.994346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/235b264a-c7e8-465d-a791-b01776cb8e77-kube-api-access-57wgn" (OuterVolumeSpecName: "kube-api-access-57wgn") pod "235b264a-c7e8-465d-a791-b01776cb8e77" (UID: "235b264a-c7e8-465d-a791-b01776cb8e77"). InnerVolumeSpecName "kube-api-access-57wgn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.009348 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.009377 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/235b264a-c7e8-465d-a791-b01776cb8e77-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.009387 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-57wgn\" (UniqueName: \"kubernetes.io/projected/235b264a-c7e8-465d-a791-b01776cb8e77-kube-api-access-57wgn\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.023034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-scripts" (OuterVolumeSpecName: "scripts") pod "235b264a-c7e8-465d-a791-b01776cb8e77" (UID: "235b264a-c7e8-465d-a791-b01776cb8e77"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.069793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "235b264a-c7e8-465d-a791-b01776cb8e77" (UID: "235b264a-c7e8-465d-a791-b01776cb8e77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.081607 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.081640 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.081652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"305f687e-8e30-410c-b78d-6fd4f2d9191a","Type":"ContainerStarted","Data":"833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9"} Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.091844 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.095151 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api-log" containerID="cri-o://d06a3f20f4817acf73144199db37518c37a6385128e56f2e054b001d2cb7acc8" gracePeriod=30 Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.095315 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api" containerID="cri-o://a07d5cb25170cc8787c0e0da9ae622529ba4ab9edf63668f30686bf481ea8583" gracePeriod=30 Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.108088 4769 generic.go:334] "Generic (PLEG): container finished" podID="b2a86b05-e894-4062-be58-cc31c9c44624" containerID="4647a97a7132f7b4f5e9913c33726eebe1c9f13532d5b3cbb000e60274f5346e" exitCode=0 Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.108156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qqg9f" event={"ID":"b2a86b05-e894-4062-be58-cc31c9c44624","Type":"ContainerDied","Data":"4647a97a7132f7b4f5e9913c33726eebe1c9f13532d5b3cbb000e60274f5346e"} Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.111734 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.111810 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.128165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" event={"ID":"235b264a-c7e8-465d-a791-b01776cb8e77","Type":"ContainerDied","Data":"468f4188106ceb315751e0e3f1635152e0b16652ba65d442a6f23dd92b35f05b"} Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.128220 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="468f4188106ceb315751e0e3f1635152e0b16652ba65d442a6f23dd92b35f05b" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.139820 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-wvb9n" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.146466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-config-data" (OuterVolumeSpecName: "config-data") pod "235b264a-c7e8-465d-a791-b01776cb8e77" (UID: "235b264a-c7e8-465d-a791-b01776cb8e77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.153349 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.167507 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.167483696 podStartE2EDuration="3.167483696s" podCreationTimestamp="2025-11-21 12:52:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:10.1069564 +0000 UTC m=+3688.807618218" watchObservedRunningTime="2025-11-21 12:52:10.167483696 +0000 UTC m=+3688.868145514" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.214643 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/235b264a-c7e8-465d-a791-b01776cb8e77-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.220312 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6"] Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.315464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-catalog-content\") pod \"b2a86b05-e894-4062-be58-cc31c9c44624\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.315856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhmn2\" (UniqueName: \"kubernetes.io/projected/b2a86b05-e894-4062-be58-cc31c9c44624-kube-api-access-jhmn2\") pod \"b2a86b05-e894-4062-be58-cc31c9c44624\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.315903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-utilities\") pod \"b2a86b05-e894-4062-be58-cc31c9c44624\" (UID: \"b2a86b05-e894-4062-be58-cc31c9c44624\") " Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.316902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-utilities" (OuterVolumeSpecName: "utilities") pod "b2a86b05-e894-4062-be58-cc31c9c44624" (UID: "b2a86b05-e894-4062-be58-cc31c9c44624"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.319453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a86b05-e894-4062-be58-cc31c9c44624-kube-api-access-jhmn2" (OuterVolumeSpecName: "kube-api-access-jhmn2") pod "b2a86b05-e894-4062-be58-cc31c9c44624" (UID: "b2a86b05-e894-4062-be58-cc31c9c44624"). InnerVolumeSpecName "kube-api-access-jhmn2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.335939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b2a86b05-e894-4062-be58-cc31c9c44624" (UID: "b2a86b05-e894-4062-be58-cc31c9c44624"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.419027 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jhmn2\" (UniqueName: \"kubernetes.io/projected/b2a86b05-e894-4062-be58-cc31c9c44624-kube-api-access-jhmn2\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.419432 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.419441 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b2a86b05-e894-4062-be58-cc31c9c44624-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.940595 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p8p22"] Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.943177 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.955899 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p"] Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.963014 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7bc74f485b-vm922"] Nov 21 12:52:10 crc kubenswrapper[4769]: I1121 12:52:10.990191 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.012737 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.042276 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.043489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp5lv\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-kube-api-access-wp5lv\") pod \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.043677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.043730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-lock\") pod \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.043781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") pod \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.043820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-cache\") pod \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\" (UID: \"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.045139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-lock" (OuterVolumeSpecName: "lock") pod "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.047217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "swift") pod "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.048461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-cache" (OuterVolumeSpecName: "cache") pod "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.061719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.081541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-kube-api-access-wp5lv" (OuterVolumeSpecName: "kube-api-access-wp5lv") pod "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" (UID: "85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469"). InnerVolumeSpecName "kube-api-access-wp5lv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.156546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-db-sync-config-data\") pod \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.156846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-combined-ca-bundle\") pod \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.156937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmxfk\" (UniqueName: \"kubernetes.io/projected/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-kube-api-access-pmxfk\") pod \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-combined-ca-bundle\") pod \"4b34285f-f704-420c-a395-eb7bcdaef6c5\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-config\") pod \"4b34285f-f704-420c-a395-eb7bcdaef6c5\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kr42\" (UniqueName: \"kubernetes.io/projected/4b34285f-f704-420c-a395-eb7bcdaef6c5-kube-api-access-6kr42\") pod \"4b34285f-f704-420c-a395-eb7bcdaef6c5\" (UID: \"4b34285f-f704-420c-a395-eb7bcdaef6c5\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-config-data\") pod \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\" (UID: \"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6\") " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157692 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157710 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157720 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157730 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.157741 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wp5lv\" (UniqueName: \"kubernetes.io/projected/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469-kube-api-access-wp5lv\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.171074 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-cd86bc48d-6ff2l"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.171256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" (UID: "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.171904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.172130 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-server" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.172452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="registry-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.172510 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="registry-server" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.172579 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" containerName="glance-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.172637 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" containerName="glance-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.172882 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.172947 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.172999 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="extract-content" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173049 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="extract-content" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173103 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b34285f-f704-420c-a395-eb7bcdaef6c5" containerName="neutron-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173172 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b34285f-f704-420c-a395-eb7bcdaef6c5" containerName="neutron-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173247 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173299 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-server" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173352 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173663 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173731 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173786 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173838 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-server" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173892 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.173942 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.173995 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-reaper" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.174052 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-reaper" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.174161 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-updater" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.174426 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-updater" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.174493 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-expirer" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.174549 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-expirer" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.174604 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.174658 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.174714 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.174765 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.174825 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="extract-utilities" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.174877 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="extract-utilities" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.175107 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="rsync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.175168 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="rsync" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.175252 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-updater" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.175317 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-updater" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.175373 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="235b264a-c7e8-465d-a791-b01776cb8e77" containerName="cinder-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.175422 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="235b264a-c7e8-465d-a791-b01776cb8e77" containerName="cinder-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: E1121 12:52:11.175474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="swift-recon-cron" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.175528 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="swift-recon-cron" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.176475 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-reaper" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.176567 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="rsync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.176637 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="swift-recon-cron" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.176811 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-kube-api-access-pmxfk" (OuterVolumeSpecName: "kube-api-access-pmxfk") pod "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" (UID: "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6"). InnerVolumeSpecName "kube-api-access-pmxfk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.176871 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4b34285f-f704-420c-a395-eb7bcdaef6c5" containerName="neutron-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.176973 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-updater" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177017 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="235b264a-c7e8-465d-a791-b01776cb8e77" containerName="cinder-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177047 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-updater" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177054 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" containerName="glance-db-sync" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177068 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177093 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177321 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177332 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="container-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177354 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177380 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-expirer" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177393 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-auditor" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177412 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="account-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177426 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" containerName="registry-server" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.177440 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerName="object-replicator" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.179674 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.191001 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b34285f-f704-420c-a395-eb7bcdaef6c5-kube-api-access-6kr42" (OuterVolumeSpecName: "kube-api-access-6kr42") pod "4b34285f-f704-420c-a395-eb7bcdaef6c5" (UID: "4b34285f-f704-420c-a395-eb7bcdaef6c5"). InnerVolumeSpecName "kube-api-access-6kr42". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.193386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" event={"ID":"587b6cbe-7e51-4177-a229-f6a608d0fcab","Type":"ContainerStarted","Data":"f4a3d8e9f01d6b529c40ed5951ac315879d74aed5e17109491940a54259e5248"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.208524 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-cd86bc48d-6ff2l"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.208891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" event={"ID":"21b8e395-ab14-4f2c-a784-7ada05455d6a","Type":"ContainerStarted","Data":"3e5c3332787d8d7ba65a93bc11386c7ce6f6aa9e52b8ac435c20f7ec5ba83d9e"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.214232 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c4788f6-80ae-4302-a22f-72204167e813" containerID="b8c4ba213f58d9ecac6ff1b9f26579a4aba42889a393984e6851fb5f5ffb83c0" exitCode=0 Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.214296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" event={"ID":"3c4788f6-80ae-4302-a22f-72204167e813","Type":"ContainerDied","Data":"b8c4ba213f58d9ecac6ff1b9f26579a4aba42889a393984e6851fb5f5ffb83c0"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.225635 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75gt6" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.226101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75gt6" event={"ID":"3cfd089a-f033-4eaa-8b56-bc4f6476a9f6","Type":"ContainerDied","Data":"c00ec3f9c27833db7df79f2007d198279fd4eec66bbb7706074c9bf0a2543f53"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.226130 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c00ec3f9c27833db7df79f2007d198279fd4eec66bbb7706074c9bf0a2543f53" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.241948 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qqg9f" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.241972 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qqg9f" event={"ID":"b2a86b05-e894-4062-be58-cc31c9c44624","Type":"ContainerDied","Data":"ed4ce3b205e2476a9c7022a94d333b4d826e02326812424e239c40b1c7c38b01"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.242028 4769 scope.go:117] "RemoveContainer" containerID="4647a97a7132f7b4f5e9913c33726eebe1c9f13532d5b3cbb000e60274f5346e" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.275839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72q5d\" (UniqueName: \"kubernetes.io/projected/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-kube-api-access-72q5d\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.275898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-ovndb-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.275931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-public-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-config\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-internal-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-httpd-config\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-combined-ca-bundle\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276606 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6kr42\" (UniqueName: \"kubernetes.io/projected/4b34285f-f704-420c-a395-eb7bcdaef6c5-kube-api-access-6kr42\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276631 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.276646 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pmxfk\" (UniqueName: \"kubernetes.io/projected/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-kube-api-access-pmxfk\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.292869 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.296632 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.324906 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.324979 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.327143 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" (UID: "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.327205 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b34285f-f704-420c-a395-eb7bcdaef6c5" (UID: "4b34285f-f704-420c-a395-eb7bcdaef6c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.329826 4769 generic.go:334] "Generic (PLEG): container finished" podID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" containerID="e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353" exitCode=137 Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.330103 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.330585 4769 scope.go:117] "RemoveContainer" containerID="e935e108d9545526af2148e668ef8eda6f47dc3845ee58551297261a4925e2c7" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.343172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-8z8jj" event={"ID":"4b34285f-f704-420c-a395-eb7bcdaef6c5","Type":"ContainerDied","Data":"d532ad5e987952a0900bf07e04b081ed6cda4a6d457ff8ccb8c86a10026aae27"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.343234 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d532ad5e987952a0900bf07e04b081ed6cda4a6d457ff8ccb8c86a10026aae27" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.343246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.343265 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-qqg9f"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.343281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469","Type":"ContainerDied","Data":"2ecf3e99c58dfbcf4138f3a99c9607306eebd7afbde246c178e89ba91fa9a9c4"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.343295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" event={"ID":"e83044ec-e522-4705-baac-c8344c6bf994","Type":"ContainerStarted","Data":"49c13610c6cab970970b86e8ddb88fe08f8264971df19bc066d4bea8780e5429"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.344747 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f4af21e-cf38-47ca-b541-60d52694c667" containerID="d06a3f20f4817acf73144199db37518c37a6385128e56f2e054b001d2cb7acc8" exitCode=143 Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.344863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0f4af21e-cf38-47ca-b541-60d52694c667","Type":"ContainerDied","Data":"d06a3f20f4817acf73144199db37518c37a6385128e56f2e054b001d2cb7acc8"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.348046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" event={"ID":"cc4942fd-77bd-4a9b-9cf3-b9db054394ba","Type":"ContainerStarted","Data":"daf3cd39bf64ee206f02c996c535db6bfcc988cf276d699ef7b69463a838cc15"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.352117 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" event={"ID":"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7","Type":"ContainerStarted","Data":"59f1379a9da6bfd5402457cd0d7bd4a5cdfddc543a7003038f3c89a2fc1575e1"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.352174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" event={"ID":"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7","Type":"ContainerStarted","Data":"251fe83d372c9a3a1b1f48054e052600a4b5dc7926941deac831b9171dbfa2ae"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.352185 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" event={"ID":"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7","Type":"ContainerStarted","Data":"1db4b8326bc764ae5425b084f07c055112247b48328180c89467fb7f679bf845"} Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.355480 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-qqg9f"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.373680 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" podStartSLOduration=2.373655089 podStartE2EDuration="2.373655089s" podCreationTimestamp="2025-11-21 12:52:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:11.372558249 +0000 UTC m=+3690.073220067" watchObservedRunningTime="2025-11-21 12:52:11.373655089 +0000 UTC m=+3690.074316907" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.378686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-httpd-config\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.378739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-combined-ca-bundle\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.383904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-72q5d\" (UniqueName: \"kubernetes.io/projected/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-kube-api-access-72q5d\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-ovndb-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-public-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-config\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-internal-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384836 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384905 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.384966 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.386352 4769 scope.go:117] "RemoveContainer" containerID="82dca222bc5e4e4c0aebb69b388c5f13f8e458eded4fac0ce7a9933c65cbfddc" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.398087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-combined-ca-bundle\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.401695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-config\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.434209 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-httpd-config\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.436221 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-public-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.440423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-ovndb-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.446587 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65c98777d4-j687l"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.446868 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker-log" containerID="cri-o://793e3f5d3767dec3f664f6d1182ce025e2b4d90e3869bb6f9c107c692d39e592" gracePeriod=30 Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.447376 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker" containerID="cri-o://5a67db22b21f6fb627583f9c459c934186dfe8b52304a49f003ca1fcc1e60287" gracePeriod=30 Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.451581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-internal-tls-certs\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.462062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-config" (OuterVolumeSpecName: "config") pod "4b34285f-f704-420c-a395-eb7bcdaef6c5" (UID: "4b34285f-f704-420c-a395-eb7bcdaef6c5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.464099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-72q5d\" (UniqueName: \"kubernetes.io/projected/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-kube-api-access-72q5d\") pod \"neutron-cd86bc48d-6ff2l\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.467180 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.484526 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.487617 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b34285f-f704-420c-a395-eb7bcdaef6c5-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.497432 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.521502 4769 scope.go:117] "RemoveContainer" containerID="e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.523340 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.523464 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.525541 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.537636 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.571356 4769 scope.go:117] "RemoveContainer" containerID="1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.642853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-config-data" (OuterVolumeSpecName: "config-data") pod "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" (UID: "3cfd089a-f033-4eaa-8b56-bc4f6476a9f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.647684 4769 scope.go:117] "RemoveContainer" containerID="ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.696500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-cache\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.696585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.696869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-lock\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.697031 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hsd\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-kube-api-access-96hsd\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.697109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-etc-swift\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.698162 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.799903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.800394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-lock\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.800445 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-96hsd\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-kube-api-access-96hsd\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.800472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-etc-swift\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.800592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-cache\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.801504 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-cache\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.801747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-lock\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.800174 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.806576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-etc-swift\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.823101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hsd\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-kube-api-access-96hsd\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.885282 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"swift-storage-0\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:11 crc kubenswrapper[4769]: I1121 12:52:11.972852 4769 scope.go:117] "RemoveContainer" containerID="f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.014686 4769 scope.go:117] "RemoveContainer" containerID="71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.053092 4769 scope.go:117] "RemoveContainer" containerID="ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.083156 4769 scope.go:117] "RemoveContainer" containerID="9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.142221 4769 scope.go:117] "RemoveContainer" containerID="4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.148079 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.168864 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-cd86bc48d-6ff2l"] Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.174355 4769 scope.go:117] "RemoveContainer" containerID="f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.227986 4769 scope.go:117] "RemoveContainer" containerID="cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.232111 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.232441 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-log" containerID="cri-o://873e53430b1e227afef2ace9b57dfc467cb87a2649ef1beee28aa9fe711472da" gracePeriod=30 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.232889 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-httpd" containerID="cri-o://4961b788dec0f781a05b0997ab7a0494f693feee3fd0174fb448341577718271" gracePeriod=30 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.287422 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.289546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-log" containerID="cri-o://135808eed2723e1830341776c94b34c2fa4917f069e53ab955ed091d28d3c118" gracePeriod=30 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.290151 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-httpd" containerID="cri-o://18e3ecc27cceb2870d0fe8c24b902577016c1e6ef2f701635bf148ebcb5cd8e3" gracePeriod=30 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.305460 4769 scope.go:117] "RemoveContainer" containerID="4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.408337 4769 scope.go:117] "RemoveContainer" containerID="34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.498466 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerID="873e53430b1e227afef2ace9b57dfc467cb87a2649ef1beee28aa9fe711472da" exitCode=143 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.498537 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17","Type":"ContainerDied","Data":"873e53430b1e227afef2ace9b57dfc467cb87a2649ef1beee28aa9fe711472da"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.503062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" event={"ID":"587b6cbe-7e51-4177-a229-f6a608d0fcab","Type":"ContainerStarted","Data":"2f2a598af5a736e9cdbff2debd4f3633eda1941244e9836110014879771d9804"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.503105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" event={"ID":"587b6cbe-7e51-4177-a229-f6a608d0fcab","Type":"ContainerStarted","Data":"45c1f1016f38de589ca1439d89399344dc5345a130823c71eec319c782975170"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.508084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" event={"ID":"cc4942fd-77bd-4a9b-9cf3-b9db054394ba","Type":"ContainerStarted","Data":"35456f335a35a75e2f8d6e6b745530938608d87ab79a81f06b5caf03df95018b"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.514475 4769 scope.go:117] "RemoveContainer" containerID="ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.516364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" event={"ID":"21b8e395-ab14-4f2c-a784-7ada05455d6a","Type":"ContainerStarted","Data":"87febf2672c90346b1c953c0e954d50a3c3a63e5e87364450e4974a741593acf"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.516520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" event={"ID":"21b8e395-ab14-4f2c-a784-7ada05455d6a","Type":"ContainerStarted","Data":"de406eaf4f5757c6739d9d00407c133d6d94ee5cc3e35eace72932b39b439552"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.516556 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.516656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.535212 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" podStartSLOduration=3.535179816 podStartE2EDuration="3.535179816s" podCreationTimestamp="2025-11-21 12:52:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:12.520975659 +0000 UTC m=+3691.221637477" watchObservedRunningTime="2025-11-21 12:52:12.535179816 +0000 UTC m=+3691.235841634" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.553233 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" podStartSLOduration=3.553212586 podStartE2EDuration="3.553212586s" podCreationTimestamp="2025-11-21 12:52:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:12.537779767 +0000 UTC m=+3691.238441585" watchObservedRunningTime="2025-11-21 12:52:12.553212586 +0000 UTC m=+3691.253874394" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.562241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" event={"ID":"e83044ec-e522-4705-baac-c8344c6bf994","Type":"ContainerStarted","Data":"4665ffb220f125aa21d913c977f50ba2763596793870e0ac1a0b0e1778d8e6ef"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.562602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" event={"ID":"e83044ec-e522-4705-baac-c8344c6bf994","Type":"ContainerStarted","Data":"233d86a221cce409fc188ed5baf739da4d887d23344238d4e622e1db444734f8"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.562633 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.562645 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.562818 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" event={"ID":"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b","Type":"ContainerStarted","Data":"a5cd19b41e676c0220e9b6e884fa438ad23b450510a077c4db4ce9aaa100b28c"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.565079 4769 scope.go:117] "RemoveContainer" containerID="81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.587979 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp"] Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.588256 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener-log" containerID="cri-o://6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c" gracePeriod=30 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.588358 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener" containerID="cri-o://8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8" gracePeriod=30 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.588720 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" podStartSLOduration=3.588710022 podStartE2EDuration="3.588710022s" podCreationTimestamp="2025-11-21 12:52:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:12.561834891 +0000 UTC m=+3691.262496709" watchObservedRunningTime="2025-11-21 12:52:12.588710022 +0000 UTC m=+3691.289371840" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.600068 4769 generic.go:334] "Generic (PLEG): container finished" podID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerID="793e3f5d3767dec3f664f6d1182ce025e2b4d90e3869bb6f9c107c692d39e592" exitCode=143 Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.600352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" event={"ID":"5d291823-8a89-4b29-bd20-3a10b05de58a","Type":"ContainerDied","Data":"793e3f5d3767dec3f664f6d1182ce025e2b4d90e3869bb6f9c107c692d39e592"} Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.622965 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" podStartSLOduration=4.6229479829999995 podStartE2EDuration="4.622947983s" podCreationTimestamp="2025-11-21 12:52:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:12.592231748 +0000 UTC m=+3691.292893566" watchObservedRunningTime="2025-11-21 12:52:12.622947983 +0000 UTC m=+3691.323609801" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.636202 4769 scope.go:117] "RemoveContainer" containerID="89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.673391 4769 scope.go:117] "RemoveContainer" containerID="e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.675921 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353\": container with ID starting with e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353 not found: ID does not exist" containerID="e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.675993 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353"} err="failed to get container status \"e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353\": rpc error: code = NotFound desc = could not find container \"e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353\": container with ID starting with e08723fdb02afad1a82bb39877edc6a92f80f867010732b00e29551aff530353 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.676023 4769 scope.go:117] "RemoveContainer" containerID="1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.676384 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be\": container with ID starting with 1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be not found: ID does not exist" containerID="1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.676430 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be"} err="failed to get container status \"1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be\": rpc error: code = NotFound desc = could not find container \"1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be\": container with ID starting with 1c92fe062ca9e9888ce2519eae86b14eb1f3253635bacde9871498c5e0b0e4be not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.676458 4769 scope.go:117] "RemoveContainer" containerID="ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.676845 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db\": container with ID starting with ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db not found: ID does not exist" containerID="ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.676867 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db"} err="failed to get container status \"ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db\": rpc error: code = NotFound desc = could not find container \"ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db\": container with ID starting with ac074afcea79d4053e21d5f56c686c6fc60573d9b0d68dcf676d9eba68c2f4db not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.676880 4769 scope.go:117] "RemoveContainer" containerID="f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.677063 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a\": container with ID starting with f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a not found: ID does not exist" containerID="f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.677098 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a"} err="failed to get container status \"f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a\": rpc error: code = NotFound desc = could not find container \"f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a\": container with ID starting with f36ab00098e20d630e2f1151771d6deaefa6dda54e6e0402f6a858ba2a2e232a not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.677115 4769 scope.go:117] "RemoveContainer" containerID="71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.679935 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025\": container with ID starting with 71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025 not found: ID does not exist" containerID="71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.680008 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025"} err="failed to get container status \"71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025\": rpc error: code = NotFound desc = could not find container \"71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025\": container with ID starting with 71279bccdc683a8ea4f8d40dae7c9d8a8cd9706ce86a9f2cf6697a36bdd9a025 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.680040 4769 scope.go:117] "RemoveContainer" containerID="ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.681988 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47\": container with ID starting with ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47 not found: ID does not exist" containerID="ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.682019 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47"} err="failed to get container status \"ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47\": rpc error: code = NotFound desc = could not find container \"ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47\": container with ID starting with ff1643c4123186893589142ac923fc6d75fab316ab12c7fb72503786890def47 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.682038 4769 scope.go:117] "RemoveContainer" containerID="9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.684622 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7\": container with ID starting with 9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7 not found: ID does not exist" containerID="9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.684681 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7"} err="failed to get container status \"9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7\": rpc error: code = NotFound desc = could not find container \"9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7\": container with ID starting with 9edd70fc1f4f6c8b95daa20f5960593abd5d7ead05406376278e647d9a42f1b7 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.684701 4769 scope.go:117] "RemoveContainer" containerID="4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.687420 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205\": container with ID starting with 4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205 not found: ID does not exist" containerID="4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.687467 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205"} err="failed to get container status \"4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205\": rpc error: code = NotFound desc = could not find container \"4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205\": container with ID starting with 4d2c2b52c4fa73423c489f05acfb366eabbdb5e98d43a9dae2890c721128d205 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.687483 4769 scope.go:117] "RemoveContainer" containerID="f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.693163 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c\": container with ID starting with f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c not found: ID does not exist" containerID="f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.693615 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c"} err="failed to get container status \"f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c\": rpc error: code = NotFound desc = could not find container \"f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c\": container with ID starting with f3a29a0d3651597a2bb7516feb755702a15812ce7e7070c147d4cbd802b0363c not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.693643 4769 scope.go:117] "RemoveContainer" containerID="cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.698550 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2\": container with ID starting with cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2 not found: ID does not exist" containerID="cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.698611 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2"} err="failed to get container status \"cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2\": rpc error: code = NotFound desc = could not find container \"cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2\": container with ID starting with cbbeb3f7199658b67115910d78c5f5fa439eb1045bea372592669c90780ea0c2 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.698653 4769 scope.go:117] "RemoveContainer" containerID="4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.699361 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b\": container with ID starting with 4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b not found: ID does not exist" containerID="4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.699395 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b"} err="failed to get container status \"4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b\": rpc error: code = NotFound desc = could not find container \"4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b\": container with ID starting with 4a53b703b16fb4e63c0674785950acd4bcf34112609248b1cca5d47e4233700b not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.699415 4769 scope.go:117] "RemoveContainer" containerID="34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.700320 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab\": container with ID starting with 34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab not found: ID does not exist" containerID="34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.700359 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab"} err="failed to get container status \"34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab\": rpc error: code = NotFound desc = could not find container \"34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab\": container with ID starting with 34283547b1f5b2f7b7219fcaaaa2726976250086fc44e70ae0ee9d450642bcab not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.700380 4769 scope.go:117] "RemoveContainer" containerID="ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.703060 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769\": container with ID starting with ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769 not found: ID does not exist" containerID="ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.703095 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769"} err="failed to get container status \"ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769\": rpc error: code = NotFound desc = could not find container \"ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769\": container with ID starting with ae9712369d6f45df24c6f1e3768712027e38b02b587e94aa80fde5d64aab7769 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.703116 4769 scope.go:117] "RemoveContainer" containerID="81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.703599 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814\": container with ID starting with 81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814 not found: ID does not exist" containerID="81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.703629 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814"} err="failed to get container status \"81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814\": rpc error: code = NotFound desc = could not find container \"81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814\": container with ID starting with 81fbeb841abb4bfe3f2d90afc57a9bb847656bbc4c2a5ff32634d01e93e32814 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.703646 4769 scope.go:117] "RemoveContainer" containerID="89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14" Nov 21 12:52:12 crc kubenswrapper[4769]: E1121 12:52:12.703872 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14\": container with ID starting with 89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14 not found: ID does not exist" containerID="89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.703903 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14"} err="failed to get container status \"89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14\": rpc error: code = NotFound desc = could not find container \"89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14\": container with ID starting with 89a948722c31a4d418ae120a10bccb54dd3737400ecf7702f19efa3484377f14 not found: ID does not exist" Nov 21 12:52:12 crc kubenswrapper[4769]: I1121 12:52:12.788656 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.105050 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.261890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-combined-ca-bundle\") pod \"3c4788f6-80ae-4302-a22f-72204167e813\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.262341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-config-data\") pod \"3c4788f6-80ae-4302-a22f-72204167e813\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.262617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb9gr\" (UniqueName: \"kubernetes.io/projected/3c4788f6-80ae-4302-a22f-72204167e813-kube-api-access-jb9gr\") pod \"3c4788f6-80ae-4302-a22f-72204167e813\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.262652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-scripts\") pod \"3c4788f6-80ae-4302-a22f-72204167e813\" (UID: \"3c4788f6-80ae-4302-a22f-72204167e813\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.272235 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4788f6-80ae-4302-a22f-72204167e813-kube-api-access-jb9gr" (OuterVolumeSpecName: "kube-api-access-jb9gr") pod "3c4788f6-80ae-4302-a22f-72204167e813" (UID: "3c4788f6-80ae-4302-a22f-72204167e813"). InnerVolumeSpecName "kube-api-access-jb9gr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.274319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-scripts" (OuterVolumeSpecName: "scripts") pod "3c4788f6-80ae-4302-a22f-72204167e813" (UID: "3c4788f6-80ae-4302-a22f-72204167e813"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.299130 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469" path="/var/lib/kubelet/pods/85dd3c13-8a5b-4d8a-a3e8-92c03ee5e469/volumes" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.300938 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2a86b05-e894-4062-be58-cc31c9c44624" path="/var/lib/kubelet/pods/b2a86b05-e894-4062-be58-cc31c9c44624/volumes" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.321111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c4788f6-80ae-4302-a22f-72204167e813" (UID: "3c4788f6-80ae-4302-a22f-72204167e813"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.322119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-config-data" (OuterVolumeSpecName: "config-data") pod "3c4788f6-80ae-4302-a22f-72204167e813" (UID: "3c4788f6-80ae-4302-a22f-72204167e813"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.376143 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jb9gr\" (UniqueName: \"kubernetes.io/projected/3c4788f6-80ae-4302-a22f-72204167e813-kube-api-access-jb9gr\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.376175 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.376402 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.376622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="aaae808b-de13-4edf-9c5b-4f5c554310c3" containerName="nova-cell0-conductor-conductor" containerID="cri-o://a1ae51ef02f81b2420686957b5a99348ffa6b8f86961430f2ff61eb879ede0b0" gracePeriod=30 Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.376189 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.383692 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c4788f6-80ae-4302-a22f-72204167e813-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.618451 4769 generic.go:334] "Generic (PLEG): container finished" podID="0a72248b-c557-4b25-b168-9b5022a81cec" containerID="6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c" exitCode=143 Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.618687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" event={"ID":"0a72248b-c557-4b25-b168-9b5022a81cec","Type":"ContainerDied","Data":"6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.621005 4769 generic.go:334] "Generic (PLEG): container finished" podID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerID="135808eed2723e1830341776c94b34c2fa4917f069e53ab955ed091d28d3c118" exitCode=143 Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.621054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8080f558-a5d1-46ad-94a9-0ff1301f5804","Type":"ContainerDied","Data":"135808eed2723e1830341776c94b34c2fa4917f069e53ab955ed091d28d3c118"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.622454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" event={"ID":"3c4788f6-80ae-4302-a22f-72204167e813","Type":"ContainerDied","Data":"aea35fe73df9762c915f05b95730d83ac2e194b87c982f526f668b45778faece"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.622482 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aea35fe73df9762c915f05b95730d83ac2e194b87c982f526f668b45778faece" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.622526 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.639271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" event={"ID":"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b","Type":"ContainerStarted","Data":"c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.639315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" event={"ID":"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b","Type":"ContainerStarted","Data":"4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.639365 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.644229 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f4af21e-cf38-47ca-b541-60d52694c667" containerID="a07d5cb25170cc8787c0e0da9ae622529ba4ab9edf63668f30686bf481ea8583" exitCode=0 Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.644282 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0f4af21e-cf38-47ca-b541-60d52694c667","Type":"ContainerDied","Data":"a07d5cb25170cc8787c0e0da9ae622529ba4ab9edf63668f30686bf481ea8583"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.646739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"21820468085f3cf013463501cb4db298d3fc627940f0c92b3f08219872331bee"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.646766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"1ccc56951cf265eacc5d84661707717cfd5870ebadfbbeb8597e00cb3d93fa11"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.646776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"f6bb5fdec2e26f7d8d675ab22f907d0148102761233c6425ffeb36b49b97cf0c"} Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.662044 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podc000468c-0aeb-4e5b-b647-a225f1387d7d"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podc000468c-0aeb-4e5b-b647-a225f1387d7d] : Timed out while waiting for systemd to remove kubepods-besteffort-podc000468c_0aeb_4e5b_b647_a225f1387d7d.slice" Nov 21 12:52:13 crc kubenswrapper[4769]: E1121 12:52:13.662084 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podc000468c-0aeb-4e5b-b647-a225f1387d7d] : unable to destroy cgroup paths for cgroup [kubepods besteffort podc000468c-0aeb-4e5b-b647-a225f1387d7d] : Timed out while waiting for systemd to remove kubepods-besteffort-podc000468c_0aeb_4e5b_b647_a225f1387d7d.slice" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.666782 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" podStartSLOduration=2.666761519 podStartE2EDuration="2.666761519s" podCreationTimestamp="2025-11-21 12:52:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:13.65538207 +0000 UTC m=+3692.356043888" watchObservedRunningTime="2025-11-21 12:52:13.666761519 +0000 UTC m=+3692.367423337" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.730376 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.745270 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod65b5a47f-40e2-4517-af4f-094aa8aa4ad1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod65b5a47f-40e2-4517-af4f-094aa8aa4ad1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod65b5a47f_40e2_4517_af4f_094aa8aa4ad1.slice" Nov 21 12:52:13 crc kubenswrapper[4769]: E1121 12:52:13.745337 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod65b5a47f-40e2-4517-af4f-094aa8aa4ad1] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod65b5a47f-40e2-4517-af4f-094aa8aa4ad1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod65b5a47f_40e2_4517_af4f_094aa8aa4ad1.slice" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.892909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-public-tls-certs\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.892986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4af21e-cf38-47ca-b541-60d52694c667-logs\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-scripts\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0f4af21e-cf38-47ca-b541-60d52694c667-etc-machine-id\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-combined-ca-bundle\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893358 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data-custom\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0f4af21e-cf38-47ca-b541-60d52694c667-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2lxs\" (UniqueName: \"kubernetes.io/projected/0f4af21e-cf38-47ca-b541-60d52694c667-kube-api-access-n2lxs\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-internal-tls-certs\") pod \"0f4af21e-cf38-47ca-b541-60d52694c667\" (UID: \"0f4af21e-cf38-47ca-b541-60d52694c667\") " Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.893619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4af21e-cf38-47ca-b541-60d52694c667-logs" (OuterVolumeSpecName: "logs") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.894945 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0f4af21e-cf38-47ca-b541-60d52694c667-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.894975 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4af21e-cf38-47ca-b541-60d52694c667-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.904029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f4af21e-cf38-47ca-b541-60d52694c667-kube-api-access-n2lxs" (OuterVolumeSpecName: "kube-api-access-n2lxs") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "kube-api-access-n2lxs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.908104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-scripts" (OuterVolumeSpecName: "scripts") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.925865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.952157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.958503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data" (OuterVolumeSpecName: "config-data") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.967919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.975331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0f4af21e-cf38-47ca-b541-60d52694c667" (UID: "0f4af21e-cf38-47ca-b541-60d52694c667"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997098 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997132 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997142 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997152 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997161 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997171 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n2lxs\" (UniqueName: \"kubernetes.io/projected/0f4af21e-cf38-47ca-b541-60d52694c667-kube-api-access-n2lxs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:13 crc kubenswrapper[4769]: I1121 12:52:13.997181 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f4af21e-cf38-47ca-b541-60d52694c667-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.653249 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.690257 4769 generic.go:334] "Generic (PLEG): container finished" podID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerID="5a67db22b21f6fb627583f9c459c934186dfe8b52304a49f003ca1fcc1e60287" exitCode=0 Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.690798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" event={"ID":"5d291823-8a89-4b29-bd20-3a10b05de58a","Type":"ContainerDied","Data":"5a67db22b21f6fb627583f9c459c934186dfe8b52304a49f003ca1fcc1e60287"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.690844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" event={"ID":"5d291823-8a89-4b29-bd20-3a10b05de58a","Type":"ContainerDied","Data":"c72081efe685740d8536221fef589996b49213d7a279b9cfc942983b88784bfe"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.690863 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c72081efe685740d8536221fef589996b49213d7a279b9cfc942983b88784bfe" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.699570 4769 generic.go:334] "Generic (PLEG): container finished" podID="0a72248b-c557-4b25-b168-9b5022a81cec" containerID="8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8" exitCode=0 Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.699625 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" event={"ID":"0a72248b-c557-4b25-b168-9b5022a81cec","Type":"ContainerDied","Data":"8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.699652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" event={"ID":"0a72248b-c557-4b25-b168-9b5022a81cec","Type":"ContainerDied","Data":"acd792357719b2fcee7e701739f39e166fab3b83d9509aa6b59b6d5da3bb0ce5"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.699672 4769 scope.go:117] "RemoveContainer" containerID="8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.699956 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.710703 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.710772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0f4af21e-cf38-47ca-b541-60d52694c667","Type":"ContainerDied","Data":"4495e43fbcd938f013f260a1aa28db803fd28e9d00e6f955253855290adff0a5"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719771 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"e26086b4183e76bc744b11509cca5bb4aef9eb6f6890bc99c8112654d2f4d82a"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"f745168b4e9bc49314d46d470a8a6b9d97a7ca1e17567933b5c8223545d657d5"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"9ffdf07b6ca311a612fe435c9d96f794f755c1b06d7c976066d7a9854520d7fd"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719963 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"fb3bb295c52508ab61ed6d4059c32909e643abc0d7b8c00eb3502e829c3783f7"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.719975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"32ca7892fd1380c714d6d0afeaa3000431822f1ee42afd0c21cf0741874b1826"} Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.739846 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.741131 4769 scope.go:117] "RemoveContainer" containerID="6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.767374 4769 scope.go:117] "RemoveContainer" containerID="8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.768074 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8\": container with ID starting with 8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8 not found: ID does not exist" containerID="8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.768117 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8"} err="failed to get container status \"8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8\": rpc error: code = NotFound desc = could not find container \"8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8\": container with ID starting with 8f7a7e745adf7158af4c790d2fe85d533711a3cb4ab730219e8dcec89e884cc8 not found: ID does not exist" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.768146 4769 scope.go:117] "RemoveContainer" containerID="6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.769337 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c\": container with ID starting with 6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c not found: ID does not exist" containerID="6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.769374 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c"} err="failed to get container status \"6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c\": rpc error: code = NotFound desc = could not find container \"6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c\": container with ID starting with 6f13680f49b976a8214a6e02357b50ac86ce408dd6f8a0ca3c8fc0482aab6e3c not found: ID does not exist" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.769398 4769 scope.go:117] "RemoveContainer" containerID="a07d5cb25170cc8787c0e0da9ae622529ba4ab9edf63668f30686bf481ea8583" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.784685 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.812610 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.813352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgt4p\" (UniqueName: \"kubernetes.io/projected/0a72248b-c557-4b25-b168-9b5022a81cec-kube-api-access-wgt4p\") pod \"0a72248b-c557-4b25-b168-9b5022a81cec\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.813376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-combined-ca-bundle\") pod \"0a72248b-c557-4b25-b168-9b5022a81cec\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.813460 4769 scope.go:117] "RemoveContainer" containerID="d06a3f20f4817acf73144199db37518c37a6385128e56f2e054b001d2cb7acc8" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.815572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data-custom\") pod \"0a72248b-c557-4b25-b168-9b5022a81cec\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.815634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a72248b-c557-4b25-b168-9b5022a81cec-logs\") pod \"0a72248b-c557-4b25-b168-9b5022a81cec\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.815684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data\") pod \"0a72248b-c557-4b25-b168-9b5022a81cec\" (UID: \"0a72248b-c557-4b25-b168-9b5022a81cec\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.851051 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.858331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a72248b-c557-4b25-b168-9b5022a81cec-logs" (OuterVolumeSpecName: "logs") pod "0a72248b-c557-4b25-b168-9b5022a81cec" (UID: "0a72248b-c557-4b25-b168-9b5022a81cec"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.859574 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0a72248b-c557-4b25-b168-9b5022a81cec" (UID: "0a72248b-c557-4b25-b168-9b5022a81cec"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.860114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a72248b-c557-4b25-b168-9b5022a81cec-kube-api-access-wgt4p" (OuterVolumeSpecName: "kube-api-access-wgt4p") pod "0a72248b-c557-4b25-b168-9b5022a81cec" (UID: "0a72248b-c557-4b25-b168-9b5022a81cec"). InnerVolumeSpecName "kube-api-access-wgt4p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.922936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-combined-ca-bundle\") pod \"5d291823-8a89-4b29-bd20-3a10b05de58a\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.923043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data-custom\") pod \"5d291823-8a89-4b29-bd20-3a10b05de58a\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.923125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbd5j\" (UniqueName: \"kubernetes.io/projected/5d291823-8a89-4b29-bd20-3a10b05de58a-kube-api-access-vbd5j\") pod \"5d291823-8a89-4b29-bd20-3a10b05de58a\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.923172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data\") pod \"5d291823-8a89-4b29-bd20-3a10b05de58a\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.923224 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d291823-8a89-4b29-bd20-3a10b05de58a-logs\") pod \"5d291823-8a89-4b29-bd20-3a10b05de58a\" (UID: \"5d291823-8a89-4b29-bd20-3a10b05de58a\") " Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.923970 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wgt4p\" (UniqueName: \"kubernetes.io/projected/0a72248b-c557-4b25-b168-9b5022a81cec-kube-api-access-wgt4p\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.923993 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.924006 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0a72248b-c557-4b25-b168-9b5022a81cec-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.927506 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.932575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5d291823-8a89-4b29-bd20-3a10b05de58a" (UID: "5d291823-8a89-4b29-bd20-3a10b05de58a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.937371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d291823-8a89-4b29-bd20-3a10b05de58a-kube-api-access-vbd5j" (OuterVolumeSpecName: "kube-api-access-vbd5j") pod "5d291823-8a89-4b29-bd20-3a10b05de58a" (UID: "5d291823-8a89-4b29-bd20-3a10b05de58a"). InnerVolumeSpecName "kube-api-access-vbd5j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.938086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d291823-8a89-4b29-bd20-3a10b05de58a-logs" (OuterVolumeSpecName: "logs") pod "5d291823-8a89-4b29-bd20-3a10b05de58a" (UID: "5d291823-8a89-4b29-bd20-3a10b05de58a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.949891 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a72248b-c557-4b25-b168-9b5022a81cec" (UID: "0a72248b-c557-4b25-b168-9b5022a81cec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.962125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5d291823-8a89-4b29-bd20-3a10b05de58a" (UID: "5d291823-8a89-4b29-bd20-3a10b05de58a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.964065 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.964568 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.964683 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.964749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api-log" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.964800 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api-log" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.964865 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.964923 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.965061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener-log" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener-log" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.965176 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965246 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.965312 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker-log" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965373 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker-log" Nov 21 12:52:14 crc kubenswrapper[4769]: E1121 12:52:14.965438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c4788f6-80ae-4302-a22f-72204167e813" containerName="nova-cell0-conductor-db-sync" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965494 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4788f6-80ae-4302-a22f-72204167e813" containerName="nova-cell0-conductor-db-sync" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965741 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965807 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.965965 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c4788f6-80ae-4302-a22f-72204167e813" containerName="nova-cell0-conductor-db-sync" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.966024 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" containerName="cinder-api-log" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.966133 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener-log" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.966221 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" containerName="barbican-worker-log" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.966280 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" containerName="barbican-keystone-listener" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.967455 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.971352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.975179 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.986719 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.988048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.989596 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data" (OuterVolumeSpecName: "config-data") pod "0a72248b-c557-4b25-b168-9b5022a81cec" (UID: "0a72248b-c557-4b25-b168-9b5022a81cec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.990576 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.990959 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.991086 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:52:14 crc kubenswrapper[4769]: I1121 12:52:14.994904 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.007081 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.016246 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.023608 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.025488 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.025511 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vbd5j\" (UniqueName: \"kubernetes.io/projected/5d291823-8a89-4b29-bd20-3a10b05de58a-kube-api-access-vbd5j\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.025521 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5d291823-8a89-4b29-bd20-3a10b05de58a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.025532 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.025541 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0a72248b-c557-4b25-b168-9b5022a81cec-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.025549 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.026182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.028770 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.029182 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.029457 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.031681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data" (OuterVolumeSpecName: "config-data") pod "5d291823-8a89-4b29-bd20-3a10b05de58a" (UID: "5d291823-8a89-4b29-bd20-3a10b05de58a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.037097 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.085880 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.099989 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-864b4d7f8c-btkpp"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.127300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.127494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.127649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.127783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data-custom\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.127964 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-scripts\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-logs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5r45\" (UniqueName: \"kubernetes.io/projected/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-kube-api-access-l5r45\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129756 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-public-tls-certs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-config-data\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.129969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-etc-machine-id\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.130050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.130078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhcr\" (UniqueName: \"kubernetes.io/projected/7155427b-59ba-48c3-bf11-c34dd9426b6c-kube-api-access-shhcr\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.130094 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-847gp\" (UniqueName: \"kubernetes.io/projected/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-kube-api-access-847gp\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.130360 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5d291823-8a89-4b29-bd20-3a10b05de58a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.232578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data-custom\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-scripts\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233675 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-logs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5r45\" (UniqueName: \"kubernetes.io/projected/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-kube-api-access-l5r45\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-public-tls-certs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-config-data\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-etc-machine-id\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-shhcr\" (UniqueName: \"kubernetes.io/projected/7155427b-59ba-48c3-bf11-c34dd9426b6c-kube-api-access-shhcr\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.233912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-847gp\" (UniqueName: \"kubernetes.io/projected/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-kube-api-access-847gp\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.235095 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.235805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-etc-machine-id\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.238699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-logs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.239629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.243599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.243659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.243793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-config-data\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.243869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-public-tls-certs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.243954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-scripts\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.244146 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data-custom\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.245102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.246428 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.252015 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.251982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.252606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.253177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.256927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-847gp\" (UniqueName: \"kubernetes.io/projected/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-kube-api-access-847gp\") pod \"nova-scheduler-0\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.262777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5r45\" (UniqueName: \"kubernetes.io/projected/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-kube-api-access-l5r45\") pod \"cinder-api-0\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.262781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhcr\" (UniqueName: \"kubernetes.io/projected/7155427b-59ba-48c3-bf11-c34dd9426b6c-kube-api-access-shhcr\") pod \"nova-cell1-novncproxy-0\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.293324 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a72248b-c557-4b25-b168-9b5022a81cec" path="/var/lib/kubelet/pods/0a72248b-c557-4b25-b168-9b5022a81cec/volumes" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.293942 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f4af21e-cf38-47ca-b541-60d52694c667" path="/var/lib/kubelet/pods/0f4af21e-cf38-47ca-b541-60d52694c667/volumes" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.294807 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b5a47f-40e2-4517-af4f-094aa8aa4ad1" path="/var/lib/kubelet/pods/65b5a47f-40e2-4517-af4f-094aa8aa4ad1/volumes" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.295717 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c000468c-0aeb-4e5b-b647-a225f1387d7d" path="/var/lib/kubelet/pods/c000468c-0aeb-4e5b-b647-a225f1387d7d/volumes" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.444776 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.455215 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.461744 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.791221 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerID="4961b788dec0f781a05b0997ab7a0494f693feee3fd0174fb448341577718271" exitCode=0 Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.791538 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17","Type":"ContainerDied","Data":"4961b788dec0f781a05b0997ab7a0494f693feee3fd0174fb448341577718271"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.799917 4769 generic.go:334] "Generic (PLEG): container finished" podID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerID="18e3ecc27cceb2870d0fe8c24b902577016c1e6ef2f701635bf148ebcb5cd8e3" exitCode=0 Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.800002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8080f558-a5d1-46ad-94a9-0ff1301f5804","Type":"ContainerDied","Data":"18e3ecc27cceb2870d0fe8c24b902577016c1e6ef2f701635bf148ebcb5cd8e3"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.821663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"b18fcced732571fdaf74bcc2322b16cde636569d18694efad32ecf13a5b6157d"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.821711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"bc1d08820888a328fae748ef4812e194104e9bb4a7454e3a39e99c3c3223bd80"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.821721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"23d3165d82d9747d4ed22655a6d81d291fe94942a2c349dff1450546b509c275"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.821731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"bedcad83e4334c7e83ddc8624d4e1318bb1a57e1e4708e86d301f18e2add935c"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.824547 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc4942fd-77bd-4a9b-9cf3-b9db054394ba" containerID="35456f335a35a75e2f8d6e6b745530938608d87ab79a81f06b5caf03df95018b" exitCode=0 Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.824605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" event={"ID":"cc4942fd-77bd-4a9b-9cf3-b9db054394ba","Type":"ContainerDied","Data":"35456f335a35a75e2f8d6e6b745530938608d87ab79a81f06b5caf03df95018b"} Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.828287 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65c98777d4-j687l" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.844115 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.891830 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65c98777d4-j687l"] Nov 21 12:52:15 crc kubenswrapper[4769]: I1121 12:52:15.900123 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65c98777d4-j687l"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.006954 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.115102 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-combined-ca-bundle\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-logs\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-config-data\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngrl7\" (UniqueName: \"kubernetes.io/projected/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-kube-api-access-ngrl7\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-httpd-run\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-public-tls-certs\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-scripts\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.153945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\" (UID: \"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.159876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-logs" (OuterVolumeSpecName: "logs") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.160773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-kube-api-access-ngrl7" (OuterVolumeSpecName: "kube-api-access-ngrl7") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "kube-api-access-ngrl7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.162170 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.169866 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.173086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-scripts" (OuterVolumeSpecName: "scripts") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.223108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.235340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.245771 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.259701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl7ft\" (UniqueName: \"kubernetes.io/projected/8080f558-a5d1-46ad-94a9-0ff1301f5804-kube-api-access-hl7ft\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.259789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-scripts\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.259843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-internal-tls-certs\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.259872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-config-data\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.259903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-logs\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.260237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-combined-ca-bundle\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.260299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-httpd-run\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.260385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"8080f558-a5d1-46ad-94a9-0ff1301f5804\" (UID: \"8080f558-a5d1-46ad-94a9-0ff1301f5804\") " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.261904 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.261921 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.261957 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ngrl7\" (UniqueName: \"kubernetes.io/projected/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-kube-api-access-ngrl7\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.261969 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.261982 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.261992 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.262014 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.266580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-config-data" (OuterVolumeSpecName: "config-data") pod "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" (UID: "ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.266968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-logs" (OuterVolumeSpecName: "logs") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.268682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.282390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.303571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-scripts" (OuterVolumeSpecName: "scripts") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.336066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8080f558-a5d1-46ad-94a9-0ff1301f5804-kube-api-access-hl7ft" (OuterVolumeSpecName: "kube-api-access-hl7ft") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "kube-api-access-hl7ft". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.354145 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.365015 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.365072 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.365851 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hl7ft\" (UniqueName: \"kubernetes.io/projected/8080f558-a5d1-46ad-94a9-0ff1301f5804-kube-api-access-hl7ft\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.365920 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.365948 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8080f558-a5d1-46ad-94a9-0ff1301f5804-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.365961 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.367595 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.422504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.441078 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.451179 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.461445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-config-data" (OuterVolumeSpecName: "config-data") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.468321 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.468380 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.468396 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.468410 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.484418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8080f558-a5d1-46ad-94a9-0ff1301f5804" (UID: "8080f558-a5d1-46ad-94a9-0ff1301f5804"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.570016 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8080f558-a5d1-46ad-94a9-0ff1301f5804-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:16 crc kubenswrapper[4769]: E1121 12:52:16.685370 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaae808b_de13_4edf_9c5b_4f5c554310c3.slice/crio-a1ae51ef02f81b2420686957b5a99348ffa6b8f86961430f2ff61eb879ede0b0.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.840518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17","Type":"ContainerDied","Data":"3390ac9ccc273b8ab7a9553d884ea10015e81b9d0d571d687eaf6e4e9c30a985"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.840855 4769 scope.go:117] "RemoveContainer" containerID="4961b788dec0f781a05b0997ab7a0494f693feee3fd0174fb448341577718271" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.841404 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.852867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8080f558-a5d1-46ad-94a9-0ff1301f5804","Type":"ContainerDied","Data":"41e8e655b810c4861254ee2a9b31afc2a305c4f13f4f9a9e2cc466a899c34a52"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.852940 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.861451 4769 generic.go:334] "Generic (PLEG): container finished" podID="aaae808b-de13-4edf-9c5b-4f5c554310c3" containerID="a1ae51ef02f81b2420686957b5a99348ffa6b8f86961430f2ff61eb879ede0b0" exitCode=0 Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.861521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"aaae808b-de13-4edf-9c5b-4f5c554310c3","Type":"ContainerDied","Data":"a1ae51ef02f81b2420686957b5a99348ffa6b8f86961430f2ff61eb879ede0b0"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.884140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"d954ec9f9fd375f8d21fbfc90930cf9f0e851e88125432c9f19c141bda5ec67e"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.884199 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"547b91c62af6867a861c1e2fbf267059684c898f2fcb3366746713087f93e5be"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.884214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"25a745b27d2c48104dfccc1ab9c9b443ce48a7712cdbd4f77cd19d5c615eaf78"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.889320 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84","Type":"ContainerStarted","Data":"e686765ff3087a1827e52a1bd4e64c4898fe251e72667190fb1654a800d6a7c1"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.890866 4769 scope.go:117] "RemoveContainer" containerID="873e53430b1e227afef2ace9b57dfc467cb87a2649ef1beee28aa9fe711472da" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.929591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7ccddfcd-9373-47fd-9d6f-b342b80aa22c","Type":"ContainerStarted","Data":"7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.929645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7ccddfcd-9373-47fd-9d6f-b342b80aa22c","Type":"ContainerStarted","Data":"773ac9368a5e4ea8464ea44919741f1a26dfbf8b55ef03b795f8ef389fb62151"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.946892 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.954539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7155427b-59ba-48c3-bf11-c34dd9426b6c","Type":"ContainerStarted","Data":"4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.954568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7155427b-59ba-48c3-bf11-c34dd9426b6c","Type":"ContainerStarted","Data":"d265ece429db4e983c177bbe0a469987980c9a32e5302f7adec6a0836dd3edf3"} Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.960277 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.970080 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: E1121 12:52:16.970680 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-log" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.970697 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-log" Nov 21 12:52:16 crc kubenswrapper[4769]: E1121 12:52:16.970716 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-httpd" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.970726 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-httpd" Nov 21 12:52:16 crc kubenswrapper[4769]: E1121 12:52:16.970744 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-log" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.970752 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-log" Nov 21 12:52:16 crc kubenswrapper[4769]: E1121 12:52:16.970773 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-httpd" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.970780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-httpd" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.971026 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-httpd" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.971063 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-httpd" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.971074 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" containerName="glance-log" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.971089 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" containerName="glance-log" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.982061 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.982440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.988815 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.989716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.990617 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-78dvp" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.990751 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:52:16 crc kubenswrapper[4769]: I1121 12:52:16.992615 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.013860 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.028180 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.031020 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.033383 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.035878 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.035857221 podStartE2EDuration="3.035857221s" podCreationTimestamp="2025-11-21 12:52:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:17.013721139 +0000 UTC m=+3695.714382957" watchObservedRunningTime="2025-11-21 12:52:17.035857221 +0000 UTC m=+3695.736519039" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.035975 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.050754 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.054323 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.054308613 podStartE2EDuration="3.054308613s" podCreationTimestamp="2025-11-21 12:52:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:17.04574687 +0000 UTC m=+3695.746408688" watchObservedRunningTime="2025-11-21 12:52:17.054308613 +0000 UTC m=+3695.754970421" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.093746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.093796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-config-data\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.093824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-scripts\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.093910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.093958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.094107 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-logs\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.094175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.094231 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bh8f\" (UniqueName: \"kubernetes.io/projected/a5c89536-0f0a-4f35-9ded-2885260ab201-kube-api-access-2bh8f\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.109646 4769 scope.go:117] "RemoveContainer" containerID="18e3ecc27cceb2870d0fe8c24b902577016c1e6ef2f701635bf148ebcb5cd8e3" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8n6\" (UniqueName: \"kubernetes.io/projected/ab455f5a-78d1-44d0-b6fa-263b24010aef-kube-api-access-sv8n6\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-logs\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.196544 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-config-data\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-config-data\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-scripts\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-scripts\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-logs\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198381 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2bh8f\" (UniqueName: \"kubernetes.io/projected/a5c89536-0f0a-4f35-9ded-2885260ab201-kube-api-access-2bh8f\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.198711 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.199181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-logs\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.199312 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.207314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.208067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-config-data\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.209060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-scripts\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.212920 4769 scope.go:117] "RemoveContainer" containerID="135808eed2723e1830341776c94b34c2fa4917f069e53ab955ed091d28d3c118" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.213912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bh8f\" (UniqueName: \"kubernetes.io/projected/a5c89536-0f0a-4f35-9ded-2885260ab201-kube-api-access-2bh8f\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.224584 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.239097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.277674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8n6\" (UniqueName: \"kubernetes.io/projected/ab455f5a-78d1-44d0-b6fa-263b24010aef-kube-api-access-sv8n6\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-logs\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-config-data\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.314971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.315084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-scripts\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.315570 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.315804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-logs\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.315994 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.321614 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.329507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.331667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-scripts\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.343887 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8n6\" (UniqueName: \"kubernetes.io/projected/ab455f5a-78d1-44d0-b6fa-263b24010aef-kube-api-access-sv8n6\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.349520 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-config-data\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.356091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.380582 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d291823-8a89-4b29-bd20-3a10b05de58a" path="/var/lib/kubelet/pods/5d291823-8a89-4b29-bd20-3a10b05de58a/volumes" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.381539 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8080f558-a5d1-46ad-94a9-0ff1301f5804" path="/var/lib/kubelet/pods/8080f558-a5d1-46ad-94a9-0ff1301f5804/volumes" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.387101 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17" path="/var/lib/kubelet/pods/ed1b3bbe-ebd5-45ec-97ae-0cf9c55c0b17/volumes" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.416319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-config-data\") pod \"aaae808b-de13-4edf-9c5b-4f5c554310c3\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.416439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-combined-ca-bundle\") pod \"aaae808b-de13-4edf-9c5b-4f5c554310c3\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.416508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8x95\" (UniqueName: \"kubernetes.io/projected/aaae808b-de13-4edf-9c5b-4f5c554310c3-kube-api-access-f8x95\") pod \"aaae808b-de13-4edf-9c5b-4f5c554310c3\" (UID: \"aaae808b-de13-4edf-9c5b-4f5c554310c3\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.432353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaae808b-de13-4edf-9c5b-4f5c554310c3-kube-api-access-f8x95" (OuterVolumeSpecName: "kube-api-access-f8x95") pod "aaae808b-de13-4edf-9c5b-4f5c554310c3" (UID: "aaae808b-de13-4edf-9c5b-4f5c554310c3"). InnerVolumeSpecName "kube-api-access-f8x95". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.436598 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.439130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-external-api-0\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.451772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-config-data" (OuterVolumeSpecName: "config-data") pod "aaae808b-de13-4edf-9c5b-4f5c554310c3" (UID: "aaae808b-de13-4edf-9c5b-4f5c554310c3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.455497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aaae808b-de13-4edf-9c5b-4f5c554310c3" (UID: "aaae808b-de13-4edf-9c5b-4f5c554310c3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.519729 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.519759 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f8x95\" (UniqueName: \"kubernetes.io/projected/aaae808b-de13-4edf-9c5b-4f5c554310c3-kube-api-access-f8x95\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.519771 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aaae808b-de13-4edf-9c5b-4f5c554310c3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.621235 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2g9z\" (UniqueName: \"kubernetes.io/projected/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-kube-api-access-c2g9z\") pod \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.621286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-credential-keys\") pod \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.621319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-config-data\") pod \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.621355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-fernet-keys\") pod \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.621374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-combined-ca-bundle\") pod \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.621419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-scripts\") pod \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\" (UID: \"cc4942fd-77bd-4a9b-9cf3-b9db054394ba\") " Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.639457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "cc4942fd-77bd-4a9b-9cf3-b9db054394ba" (UID: "cc4942fd-77bd-4a9b-9cf3-b9db054394ba"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.639902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-scripts" (OuterVolumeSpecName: "scripts") pod "cc4942fd-77bd-4a9b-9cf3-b9db054394ba" (UID: "cc4942fd-77bd-4a9b-9cf3-b9db054394ba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.640016 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-kube-api-access-c2g9z" (OuterVolumeSpecName: "kube-api-access-c2g9z") pod "cc4942fd-77bd-4a9b-9cf3-b9db054394ba" (UID: "cc4942fd-77bd-4a9b-9cf3-b9db054394ba"). InnerVolumeSpecName "kube-api-access-c2g9z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.642354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "cc4942fd-77bd-4a9b-9cf3-b9db054394ba" (UID: "cc4942fd-77bd-4a9b-9cf3-b9db054394ba"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.651973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc4942fd-77bd-4a9b-9cf3-b9db054394ba" (UID: "cc4942fd-77bd-4a9b-9cf3-b9db054394ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.658523 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.682383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-config-data" (OuterVolumeSpecName: "config-data") pod "cc4942fd-77bd-4a9b-9cf3-b9db054394ba" (UID: "cc4942fd-77bd-4a9b-9cf3-b9db054394ba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.732411 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c2g9z\" (UniqueName: \"kubernetes.io/projected/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-kube-api-access-c2g9z\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.747359 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.747389 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.747402 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.747415 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.747426 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc4942fd-77bd-4a9b-9cf3-b9db054394ba-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.814272 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:52:17 crc kubenswrapper[4769]: W1121 12:52:17.898866 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5c89536_0f0a_4f35_9ded_2885260ab201.slice/crio-83cd7f10622039d0ea8c6dd59b0be32304cda65241becd20968b33f2ca6d9264 WatchSource:0}: Error finding container 83cd7f10622039d0ea8c6dd59b0be32304cda65241becd20968b33f2ca6d9264: Status 404 returned error can't find the container with id 83cd7f10622039d0ea8c6dd59b0be32304cda65241becd20968b33f2ca6d9264 Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.965123 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-b54468f77-dq8cd"] Nov 21 12:52:17 crc kubenswrapper[4769]: E1121 12:52:17.965904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc4942fd-77bd-4a9b-9cf3-b9db054394ba" containerName="keystone-bootstrap" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.965921 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4942fd-77bd-4a9b-9cf3-b9db054394ba" containerName="keystone-bootstrap" Nov 21 12:52:17 crc kubenswrapper[4769]: E1121 12:52:17.965942 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="aaae808b-de13-4edf-9c5b-4f5c554310c3" containerName="nova-cell0-conductor-conductor" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.965948 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaae808b-de13-4edf-9c5b-4f5c554310c3" containerName="nova-cell0-conductor-conductor" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.966634 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc4942fd-77bd-4a9b-9cf3-b9db054394ba" containerName="keystone-bootstrap" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.966668 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="aaae808b-de13-4edf-9c5b-4f5c554310c3" containerName="nova-cell0-conductor-conductor" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.968644 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.990073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b54468f77-dq8cd"] Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.996974 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.996959 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-p8p22" event={"ID":"cc4942fd-77bd-4a9b-9cf3-b9db054394ba","Type":"ContainerDied","Data":"daf3cd39bf64ee206f02c996c535db6bfcc988cf276d699ef7b69463a838cc15"} Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.997174 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daf3cd39bf64ee206f02c996c535db6bfcc988cf276d699ef7b69463a838cc15" Nov 21 12:52:17 crc kubenswrapper[4769]: I1121 12:52:17.999389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84","Type":"ContainerStarted","Data":"51d2cd1befc7ba8b80348cc0ae0e4f598d71f1399c70839c9da3c1c8db09e3cf"} Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.024949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a5c89536-0f0a-4f35-9ded-2885260ab201","Type":"ContainerStarted","Data":"83cd7f10622039d0ea8c6dd59b0be32304cda65241becd20968b33f2ca6d9264"} Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.028836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.028838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"aaae808b-de13-4edf-9c5b-4f5c554310c3","Type":"ContainerDied","Data":"68806313bc0d696ee70dc7a5fc1b6b0061b2a3a0b705056c4159811a1b60b70c"} Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.029202 4769 scope.go:117] "RemoveContainer" containerID="a1ae51ef02f81b2420686957b5a99348ffa6b8f86961430f2ff61eb879ede0b0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.060181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-internal-tls-certs\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.060317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-combined-ca-bundle\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.060401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-scripts\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.062101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-credential-keys\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.062276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-public-tls-certs\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.062329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-config-data\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.062428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-fernet-keys\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.062500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jgrq\" (UniqueName: \"kubernetes.io/projected/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-kube-api-access-6jgrq\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.074578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerStarted","Data":"257dab1ffc061cbb231971f188cc3a64f672f447b3c3ab3367d25f7688ac3f1c"} Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.094055 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.105805 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.135829 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.137305 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.141122 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.153072 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=7.1530536829999996 podStartE2EDuration="7.153053683s" podCreationTimestamp="2025-11-21 12:52:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:18.121140895 +0000 UTC m=+3696.821802713" watchObservedRunningTime="2025-11-21 12:52:18.153053683 +0000 UTC m=+3696.853715501" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.160140 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.163904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-credential-keys\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.163982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-public-tls-certs\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.164008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-config-data\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.164029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-fernet-keys\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.164055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6jgrq\" (UniqueName: \"kubernetes.io/projected/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-kube-api-access-6jgrq\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.164122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-internal-tls-certs\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.164146 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-combined-ca-bundle\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.164168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-scripts\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.173501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-public-tls-certs\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.174016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-config-data\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.176114 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-combined-ca-bundle\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.176381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-internal-tls-certs\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.176780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-credential-keys\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.180830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-fernet-keys\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.181711 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-scripts\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.188664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jgrq\" (UniqueName: \"kubernetes.io/projected/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-kube-api-access-6jgrq\") pod \"keystone-b54468f77-dq8cd\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.197802 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:52:18 crc kubenswrapper[4769]: W1121 12:52:18.204828 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab455f5a_78d1_44d0_b6fa_263b24010aef.slice/crio-371aaf5b17f4613850311340f5b5eda468a9e30977264b3774ec4dec71713c77 WatchSource:0}: Error finding container 371aaf5b17f4613850311340f5b5eda468a9e30977264b3774ec4dec71713c77: Status 404 returned error can't find the container with id 371aaf5b17f4613850311340f5b5eda468a9e30977264b3774ec4dec71713c77 Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.266709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjd7h\" (UniqueName: \"kubernetes.io/projected/95266f8c-7cec-46ff-bc99-c6264c943d50-kube-api-access-qjd7h\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.267673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.267742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.280723 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w"] Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.293616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.307076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w"] Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.368247 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.371560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qjd7h\" (UniqueName: \"kubernetes.io/projected/95266f8c-7cec-46ff-bc99-c6264c943d50-kube-api-access-qjd7h\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.371799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.371836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.378715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.388358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.389662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjd7h\" (UniqueName: \"kubernetes.io/projected/95266f8c-7cec-46ff-bc99-c6264c943d50-kube-api-access-qjd7h\") pod \"nova-cell0-conductor-0\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.425639 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.473299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.473365 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.473424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-config\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.473697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gmwl\" (UniqueName: \"kubernetes.io/projected/d549d9ab-e972-47bb-b81e-7858377a6677-kube-api-access-4gmwl\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.476792 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.575253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.575349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.575415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-config\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.575574 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4gmwl\" (UniqueName: \"kubernetes.io/projected/d549d9ab-e972-47bb-b81e-7858377a6677-kube-api-access-4gmwl\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.576253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.576662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.576804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-config\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.595267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gmwl\" (UniqueName: \"kubernetes.io/projected/d549d9ab-e972-47bb-b81e-7858377a6677-kube-api-access-4gmwl\") pod \"dnsmasq-dnsmasq-7595fdc8b5-ddt9w\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.641148 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:18 crc kubenswrapper[4769]: I1121 12:52:18.929818 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b54468f77-dq8cd"] Nov 21 12:52:18 crc kubenswrapper[4769]: W1121 12:52:18.980840 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod020ca0e6_01ad_44de_abab_3fe5cfbba0e6.slice/crio-90283822b4a2753d8d17608e5ea272409854734a6f4efa5c98bbd2ab356c0a73 WatchSource:0}: Error finding container 90283822b4a2753d8d17608e5ea272409854734a6f4efa5c98bbd2ab356c0a73: Status 404 returned error can't find the container with id 90283822b4a2753d8d17608e5ea272409854734a6f4efa5c98bbd2ab356c0a73 Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.094316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84","Type":"ContainerStarted","Data":"c29954e20406b7668feafcdcb73866b526c3a9ddc7ee19889092e3d9d47c2b3a"} Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.095353 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.097900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ab455f5a-78d1-44d0-b6fa-263b24010aef","Type":"ContainerStarted","Data":"371aaf5b17f4613850311340f5b5eda468a9e30977264b3774ec4dec71713c77"} Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.099082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a5c89536-0f0a-4f35-9ded-2885260ab201","Type":"ContainerStarted","Data":"f95591b296f2a5cde1e9e641e145754b0dd77c285d9c10829d97e52eae66fe84"} Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.108489 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.138234 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.138204444 podStartE2EDuration="5.138204444s" podCreationTimestamp="2025-11-21 12:52:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:19.111369404 +0000 UTC m=+3697.812031232" watchObservedRunningTime="2025-11-21 12:52:19.138204444 +0000 UTC m=+3697.838866262" Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.142478 4769 generic.go:334] "Generic (PLEG): container finished" podID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerID="c9f25f7b58f2b214420ba3902aaacc67729bc24099f7643f8ebfecac08af7316" exitCode=137 Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.143889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerDied","Data":"c9f25f7b58f2b214420ba3902aaacc67729bc24099f7643f8ebfecac08af7316"} Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.176721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" event={"ID":"020ca0e6-01ad-44de-abab-3fe5cfbba0e6","Type":"ContainerStarted","Data":"90283822b4a2753d8d17608e5ea272409854734a6f4efa5c98bbd2ab356c0a73"} Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.223186 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w"] Nov 21 12:52:19 crc kubenswrapper[4769]: I1121 12:52:19.296571 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaae808b-de13-4edf-9c5b-4f5c554310c3" path="/var/lib/kubelet/pods/aaae808b-de13-4edf-9c5b-4f5c554310c3/volumes" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.188636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerStarted","Data":"9f9ad259087538c0306f1d97798a41b520312af244042bc9ef39d245715b3ff7"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.188727 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="probe" containerID="cri-o://c76d0fc31a5f2b3491cef248bb6e9202cec9d4c7115e247c897efe656fe502c2" gracePeriod=30 Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.188775 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" containerID="cri-o://9f9ad259087538c0306f1d97798a41b520312af244042bc9ef39d245715b3ff7" gracePeriod=30 Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.191003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" event={"ID":"020ca0e6-01ad-44de-abab-3fe5cfbba0e6","Type":"ContainerStarted","Data":"08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.191092 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.192838 4769 generic.go:334] "Generic (PLEG): container finished" podID="d549d9ab-e972-47bb-b81e-7858377a6677" containerID="72161a21ac90e3a5a679f990f2208e5b6e397a57919fe36d507bdd1e4c2c1ae6" exitCode=0 Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.192904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" event={"ID":"d549d9ab-e972-47bb-b81e-7858377a6677","Type":"ContainerDied","Data":"72161a21ac90e3a5a679f990f2208e5b6e397a57919fe36d507bdd1e4c2c1ae6"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.192932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" event={"ID":"d549d9ab-e972-47bb-b81e-7858377a6677","Type":"ContainerStarted","Data":"8c38026ded8ee2680d8a86dddfc805a2e9b209ec0f7600d86d7bce292ae78d71"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.195605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ab455f5a-78d1-44d0-b6fa-263b24010aef","Type":"ContainerStarted","Data":"0dd0d895f81dbc07e1ecb36491278731065fbfda83dce77e6c945bd1c681a349"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.195634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ab455f5a-78d1-44d0-b6fa-263b24010aef","Type":"ContainerStarted","Data":"c952ebc5aee8bdba73fde5488859cc033409d0401daf76157f0e137b9e0e411a"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.216002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a5c89536-0f0a-4f35-9ded-2885260ab201","Type":"ContainerStarted","Data":"e262a2e0a42afc1913632e50e4674554d2684b538e9894ce9884fbbc25208ba9"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.228273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"95266f8c-7cec-46ff-bc99-c6264c943d50","Type":"ContainerStarted","Data":"bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.228343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"95266f8c-7cec-46ff-bc99-c6264c943d50","Type":"ContainerStarted","Data":"7b0a99ec4413943be6d4aed6fb74ee171d87da628382c167f0bac303c390f077"} Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.228438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.260546 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.260522934 podStartE2EDuration="4.260522934s" podCreationTimestamp="2025-11-21 12:52:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:20.25962732 +0000 UTC m=+3698.960289138" watchObservedRunningTime="2025-11-21 12:52:20.260522934 +0000 UTC m=+3698.961184752" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.296991 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" podStartSLOduration=3.296945775 podStartE2EDuration="3.296945775s" podCreationTimestamp="2025-11-21 12:52:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:20.286175652 +0000 UTC m=+3698.986837470" watchObservedRunningTime="2025-11-21 12:52:20.296945775 +0000 UTC m=+3698.997607593" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.312639 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.312621492 podStartE2EDuration="2.312621492s" podCreationTimestamp="2025-11-21 12:52:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:20.309329642 +0000 UTC m=+3699.009991480" watchObservedRunningTime="2025-11-21 12:52:20.312621492 +0000 UTC m=+3699.013283310" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.341389 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.341368644 podStartE2EDuration="4.341368644s" podCreationTimestamp="2025-11-21 12:52:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:20.333375486 +0000 UTC m=+3699.034037304" watchObservedRunningTime="2025-11-21 12:52:20.341368644 +0000 UTC m=+3699.042030462" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.445273 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:20 crc kubenswrapper[4769]: I1121 12:52:20.456265 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.242066 4769 generic.go:334] "Generic (PLEG): container finished" podID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerID="c76d0fc31a5f2b3491cef248bb6e9202cec9d4c7115e247c897efe656fe502c2" exitCode=0 Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.242151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerDied","Data":"c76d0fc31a5f2b3491cef248bb6e9202cec9d4c7115e247c897efe656fe502c2"} Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.245371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" event={"ID":"d549d9ab-e972-47bb-b81e-7858377a6677","Type":"ContainerStarted","Data":"2e5af6caee329cd4044bb1bc25e636270904ca337e43a5bd9732ac3031b7e071"} Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.267146 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" podStartSLOduration=3.267121018 podStartE2EDuration="3.267121018s" podCreationTimestamp="2025-11-21 12:52:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:21.264825345 +0000 UTC m=+3699.965487163" watchObservedRunningTime="2025-11-21 12:52:21.267121018 +0000 UTC m=+3699.967782876" Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.330954 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.363206 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.434488 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv"] Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.435055 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api-log" containerID="cri-o://4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7" gracePeriod=30 Nov 21 12:52:21 crc kubenswrapper[4769]: I1121 12:52:21.436135 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api" containerID="cri-o://1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666" gracePeriod=30 Nov 21 12:52:22 crc kubenswrapper[4769]: I1121 12:52:22.281524 4769 generic.go:334] "Generic (PLEG): container finished" podID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerID="4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7" exitCode=143 Nov 21 12:52:22 crc kubenswrapper[4769]: I1121 12:52:22.282641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" event={"ID":"752b9e59-87a6-408f-8a3d-6f12449e03f0","Type":"ContainerDied","Data":"4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7"} Nov 21 12:52:22 crc kubenswrapper[4769]: I1121 12:52:22.284173 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.037475 4769 scope.go:117] "RemoveContainer" containerID="39a0b2e46884e18844e85585ca62a8980178fb4cfccdba4e1009961cba6c275c" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.078311 4769 scope.go:117] "RemoveContainer" containerID="1fa6d3e3808aac3344588a26f5acc8c073dc274c498c11b08709e3f7e70f2f8a" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.138536 4769 scope.go:117] "RemoveContainer" containerID="00ea298a31a0f440210eab661d18705555a7588a8e90ce57f60d9cb1cf6fc51f" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.174933 4769 scope.go:117] "RemoveContainer" containerID="3bff30276be14354820ba8ba4107daae246c512d6d17bcee716e03687536091c" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.225243 4769 scope.go:117] "RemoveContainer" containerID="1fa389cf388eba168045169c8ec4e81df1f2b4350309778456f3bd2729e1ee54" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.279349 4769 scope.go:117] "RemoveContainer" containerID="4e22ea228bd4e7295af13d1ec84eec80e46889925d9f59c2648baa6d634185f9" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.340318 4769 scope.go:117] "RemoveContainer" containerID="18d68e0ceba5d92cca0d815cffc64f84ca5574b67046925d76df13fff47bcfd2" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.361515 4769 scope.go:117] "RemoveContainer" containerID="fa17db7dda109607250ffcf2848b4eb8c590c6c8c657e77f08a21cde6c71544c" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.380899 4769 scope.go:117] "RemoveContainer" containerID="f60ee0115af7e774fb7a38b3b4775892d7d8749b8c18d11bb9542ddbd3e602bf" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.409076 4769 scope.go:117] "RemoveContainer" containerID="6c5df0f5565a0a8e26abaec9f5e0baacef7b8dc82ff4bd1b27c945357f6e89de" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.441877 4769 scope.go:117] "RemoveContainer" containerID="8cb918195a2da496d4cebc90d283625185cdf93939a6a1a014af5c164ec23e6e" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.474278 4769 scope.go:117] "RemoveContainer" containerID="e64383e9e28b8793e25f3e0cf88d3784c0f6f3d62df9ed582de13f9a54939bd3" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.496871 4769 scope.go:117] "RemoveContainer" containerID="c44b3e5451855a61065e3bc9d86fade0455d8776d80e8c21a3fbf0c80d547ebc" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.521245 4769 scope.go:117] "RemoveContainer" containerID="825fa2a50bc170ab3bce3b04c904bdabff205e7715de8a6cff509755d197fbdf" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.555242 4769 scope.go:117] "RemoveContainer" containerID="922026f24477774d131d19141cf1ed82430246c1c8751339467c909f4f231e6e" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.590932 4769 scope.go:117] "RemoveContainer" containerID="9aa63d7878d435b8c9508e2d472b50b0aa84bef0e411533648bc4dc50cc49174" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.618289 4769 scope.go:117] "RemoveContainer" containerID="b37dd98fa6bdd1e416c4efa33b95a2376a102e8ec9992a969e3acb0389717f44" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.620901 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.102:9311/healthcheck\": read tcp 10.217.0.2:60416->10.217.1.102:9311: read: connection reset by peer" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.621348 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.102:9311/healthcheck\": read tcp 10.217.0.2:60402->10.217.1.102:9311: read: connection reset by peer" Nov 21 12:52:24 crc kubenswrapper[4769]: I1121 12:52:24.666466 4769 scope.go:117] "RemoveContainer" containerID="b8bfa829c8dd3c315a645fb884c4e7ad741ffba4b6ed2775ea5322c540ff0cfc" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.053555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqmbh\" (UniqueName: \"kubernetes.io/projected/752b9e59-87a6-408f-8a3d-6f12449e03f0-kube-api-access-bqmbh\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140749 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-combined-ca-bundle\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140821 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/752b9e59-87a6-408f-8a3d-6f12449e03f0-logs\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-public-tls-certs\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data-custom\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.140931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-internal-tls-certs\") pod \"752b9e59-87a6-408f-8a3d-6f12449e03f0\" (UID: \"752b9e59-87a6-408f-8a3d-6f12449e03f0\") " Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.141353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/752b9e59-87a6-408f-8a3d-6f12449e03f0-logs" (OuterVolumeSpecName: "logs") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.146342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/752b9e59-87a6-408f-8a3d-6f12449e03f0-kube-api-access-bqmbh" (OuterVolumeSpecName: "kube-api-access-bqmbh") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "kube-api-access-bqmbh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.151320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.205310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.217909 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data" (OuterVolumeSpecName: "config-data") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.222336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.229401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "752b9e59-87a6-408f-8a3d-6f12449e03f0" (UID: "752b9e59-87a6-408f-8a3d-6f12449e03f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242817 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242862 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/752b9e59-87a6-408f-8a3d-6f12449e03f0-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242873 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242883 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242894 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242903 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bqmbh\" (UniqueName: \"kubernetes.io/projected/752b9e59-87a6-408f-8a3d-6f12449e03f0-kube-api-access-bqmbh\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.242912 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/752b9e59-87a6-408f-8a3d-6f12449e03f0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.331545 4769 generic.go:334] "Generic (PLEG): container finished" podID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerID="1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666" exitCode=0 Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.331588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" event={"ID":"752b9e59-87a6-408f-8a3d-6f12449e03f0","Type":"ContainerDied","Data":"1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666"} Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.331610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" event={"ID":"752b9e59-87a6-408f-8a3d-6f12449e03f0","Type":"ContainerDied","Data":"31a300749671599e3a7d5a0cd49638c2e8fa5d0288bb3ba27d4b43a0a5d4179b"} Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.331628 4769 scope.go:117] "RemoveContainer" containerID="1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.331745 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.372174 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv"] Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.379301 4769 scope.go:117] "RemoveContainer" containerID="4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.393223 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-69b6dffd55-glnsv"] Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.406625 4769 scope.go:117] "RemoveContainer" containerID="1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666" Nov 21 12:52:25 crc kubenswrapper[4769]: E1121 12:52:25.406970 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666\": container with ID starting with 1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666 not found: ID does not exist" containerID="1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.407011 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666"} err="failed to get container status \"1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666\": rpc error: code = NotFound desc = could not find container \"1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666\": container with ID starting with 1902d9f2bd9c06b69993c49b85f4dfa0aada3c9a9dd20d9048f982a96d918666 not found: ID does not exist" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.407041 4769 scope.go:117] "RemoveContainer" containerID="4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7" Nov 21 12:52:25 crc kubenswrapper[4769]: E1121 12:52:25.407320 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7\": container with ID starting with 4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7 not found: ID does not exist" containerID="4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.407350 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7"} err="failed to get container status \"4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7\": rpc error: code = NotFound desc = could not find container \"4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7\": container with ID starting with 4f93a00623847b218165d81073def9a7e759d035e91b1aaf4183083bf15211c7 not found: ID does not exist" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.445399 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.455838 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.474912 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:25 crc kubenswrapper[4769]: I1121 12:52:25.481905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:26 crc kubenswrapper[4769]: I1121 12:52:26.359700 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:52:26 crc kubenswrapper[4769]: I1121 12:52:26.374755 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.194443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.294063 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" path="/var/lib/kubelet/pods/752b9e59-87a6-408f-8a3d-6f12449e03f0/volumes" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.323752 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.323809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.353976 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.354832 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.386175 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.659933 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.659987 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.714149 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:27 crc kubenswrapper[4769]: I1121 12:52:27.714693 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.370755 4769 generic.go:334] "Generic (PLEG): container finished" podID="e15176d9-214d-4f78-bb65-122a9db292d9" containerID="4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d" exitCode=0 Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.370834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"e15176d9-214d-4f78-bb65-122a9db292d9","Type":"ContainerDied","Data":"4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d"} Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.382239 4769 generic.go:334] "Generic (PLEG): container finished" podID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerID="bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc" exitCode=0 Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.382308 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705","Type":"ContainerDied","Data":"bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc"} Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.386852 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.388495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.388845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.535527 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.643369 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.754315 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s"] Nov 21 12:52:28 crc kubenswrapper[4769]: I1121 12:52:28.755496 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerName="dnsmasq-dns" containerID="cri-o://a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8" gracePeriod=10 Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.124494 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.223557 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.223983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dnsmasq-svc\") pod \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.224109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-config\") pod \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.224250 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dns-swift-storage-0\") pod \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.224356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnh4x\" (UniqueName: \"kubernetes.io/projected/e7c1a815-ffde-4f64-85c1-281bb457b1fa-kube-api-access-rnh4x\") pod \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\" (UID: \"e7c1a815-ffde-4f64-85c1-281bb457b1fa\") " Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.229065 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.230503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c1a815-ffde-4f64-85c1-281bb457b1fa-kube-api-access-rnh4x" (OuterVolumeSpecName: "kube-api-access-rnh4x") pod "e7c1a815-ffde-4f64-85c1-281bb457b1fa" (UID: "e7c1a815-ffde-4f64-85c1-281bb457b1fa"). InnerVolumeSpecName "kube-api-access-rnh4x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.305878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "e7c1a815-ffde-4f64-85c1-281bb457b1fa" (UID: "e7c1a815-ffde-4f64-85c1-281bb457b1fa"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.318513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "e7c1a815-ffde-4f64-85c1-281bb457b1fa" (UID: "e7c1a815-ffde-4f64-85c1-281bb457b1fa"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.323748 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-config" (OuterVolumeSpecName: "config") pod "e7c1a815-ffde-4f64-85c1-281bb457b1fa" (UID: "e7c1a815-ffde-4f64-85c1-281bb457b1fa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.326718 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.326751 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rnh4x\" (UniqueName: \"kubernetes.io/projected/e7c1a815-ffde-4f64-85c1-281bb457b1fa-kube-api-access-rnh4x\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.326764 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.326774 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7c1a815-ffde-4f64-85c1-281bb457b1fa-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.397036 4769 generic.go:334] "Generic (PLEG): container finished" podID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerID="a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8" exitCode=0 Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.397090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.397116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" event={"ID":"e7c1a815-ffde-4f64-85c1-281bb457b1fa","Type":"ContainerDied","Data":"a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8"} Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.397161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s" event={"ID":"e7c1a815-ffde-4f64-85c1-281bb457b1fa","Type":"ContainerDied","Data":"1166f5fe23c000ff1b42785a70824acda59bb5febed8c10ea7175ed9e51bcf6b"} Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.397222 4769 scope.go:117] "RemoveContainer" containerID="a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.400820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705","Type":"ContainerStarted","Data":"37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca"} Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.401123 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.404044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"e15176d9-214d-4f78-bb65-122a9db292d9","Type":"ContainerStarted","Data":"c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2"} Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.404462 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.429410 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.429392111 podStartE2EDuration="37.429392111s" podCreationTimestamp="2025-11-21 12:51:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:29.428591359 +0000 UTC m=+3708.129253177" watchObservedRunningTime="2025-11-21 12:52:29.429392111 +0000 UTC m=+3708.130053929" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.457312 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.45729391 podStartE2EDuration="37.45729391s" podCreationTimestamp="2025-11-21 12:51:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:29.451985475 +0000 UTC m=+3708.152647313" watchObservedRunningTime="2025-11-21 12:52:29.45729391 +0000 UTC m=+3708.157955728" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.463659 4769 scope.go:117] "RemoveContainer" containerID="f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.483959 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s"] Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.492375 4769 scope.go:117] "RemoveContainer" containerID="a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8" Nov 21 12:52:29 crc kubenswrapper[4769]: E1121 12:52:29.492900 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8\": container with ID starting with a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8 not found: ID does not exist" containerID="a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.492967 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8"} err="failed to get container status \"a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8\": rpc error: code = NotFound desc = could not find container \"a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8\": container with ID starting with a6163c9102cdb30f1032f28dea587d910838705add9ec0ea1e60e4fac20f04b8 not found: ID does not exist" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.492998 4769 scope.go:117] "RemoveContainer" containerID="f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119" Nov 21 12:52:29 crc kubenswrapper[4769]: E1121 12:52:29.493409 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119\": container with ID starting with f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119 not found: ID does not exist" containerID="f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.493442 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119"} err="failed to get container status \"f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119\": rpc error: code = NotFound desc = could not find container \"f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119\": container with ID starting with f29190f00a259ccb61ceb68a5786aff0098bc4f8b7857a89c15adb280cf9a119 not found: ID does not exist" Nov 21 12:52:29 crc kubenswrapper[4769]: I1121 12:52:29.497944 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-699b4797df-q6n4s"] Nov 21 12:52:30 crc kubenswrapper[4769]: I1121 12:52:30.374423 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:30 crc kubenswrapper[4769]: I1121 12:52:30.417111 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:52:31 crc kubenswrapper[4769]: I1121 12:52:31.290389 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" path="/var/lib/kubelet/pods/e7c1a815-ffde-4f64-85c1-281bb457b1fa/volumes" Nov 21 12:52:32 crc kubenswrapper[4769]: I1121 12:52:32.227454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:52:40 crc kubenswrapper[4769]: I1121 12:52:40.709062 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:40 crc kubenswrapper[4769]: I1121 12:52:40.709693 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:52:40 crc kubenswrapper[4769]: I1121 12:52:40.825116 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7fc86bb567-hdclf"] Nov 21 12:52:40 crc kubenswrapper[4769]: I1121 12:52:40.825510 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-log" containerID="cri-o://1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1" gracePeriod=30 Nov 21 12:52:40 crc kubenswrapper[4769]: I1121 12:52:40.825554 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-api" containerID="cri-o://85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d" gracePeriod=30 Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.325386 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.325699 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.551085 4769 generic.go:334] "Generic (PLEG): container finished" podID="20f55126-1aa7-4b10-9858-a35e8a073286" containerID="1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1" exitCode=143 Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.551211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" event={"ID":"20f55126-1aa7-4b10-9858-a35e8a073286","Type":"ContainerDied","Data":"1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1"} Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.564783 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.644251 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5d976fd77c-mvv95"] Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.644587 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-api" containerID="cri-o://a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288" gracePeriod=30 Nov 21 12:52:41 crc kubenswrapper[4769]: I1121 12:52:41.644771 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-httpd" containerID="cri-o://f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e" gracePeriod=30 Nov 21 12:52:42 crc kubenswrapper[4769]: I1121 12:52:42.576365 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerID="f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e" exitCode=0 Nov 21 12:52:42 crc kubenswrapper[4769]: I1121 12:52:42.576415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" event={"ID":"cd529a0c-32c3-48c4-b835-f0ac206ec2d9","Type":"ContainerDied","Data":"f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e"} Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.291206 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.511447 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.106:9696/\": dial tcp 10.217.1.106:9696: connect: connection refused" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.526417 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.545401 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.558304 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-7xqdw"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.566585 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.566800 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7ccddfcd-9373-47fd-9d6f-b342b80aa22c" containerName="nova-scheduler-scheduler" containerID="cri-o://7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927" gracePeriod=30 Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.587015 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.587372 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" containerID="cri-o://f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f" gracePeriod=30 Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.587536 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" containerID="cri-o://5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7" gracePeriod=30 Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.623345 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.623766 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-log" containerID="cri-o://072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748" gracePeriod=30 Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.625545 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-api" containerID="cri-o://44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782" gracePeriod=30 Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.746782 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-f658g"] Nov 21 12:52:43 crc kubenswrapper[4769]: E1121 12:52:43.750355 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerName="init" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.750455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerName="init" Nov 21 12:52:43 crc kubenswrapper[4769]: E1121 12:52:43.750539 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.750603 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api" Nov 21 12:52:43 crc kubenswrapper[4769]: E1121 12:52:43.750679 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerName="dnsmasq-dns" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.750740 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerName="dnsmasq-dns" Nov 21 12:52:43 crc kubenswrapper[4769]: E1121 12:52:43.750812 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api-log" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.750870 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api-log" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.751183 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.754010 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e7c1a815-ffde-4f64-85c1-281bb457b1fa" containerName="dnsmasq-dns" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.754086 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="752b9e59-87a6-408f-8a3d-6f12449e03f0" containerName="barbican-api-log" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.755025 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.755247 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.759477 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.759676 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.764533 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-srdmg"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.768126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-f658g"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.829821 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.831290 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.833093 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.834251 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.840860 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd"] Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctxj\" (UniqueName: \"kubernetes.io/projected/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-kube-api-access-8ctxj\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-scripts\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-config-data\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-scripts\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-config-data\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:43 crc kubenswrapper[4769]: I1121 12:52:43.928356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc99d\" (UniqueName: \"kubernetes.io/projected/a0bcacd3-e87e-48de-91f8-dac91578f597-kube-api-access-hc99d\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctxj\" (UniqueName: \"kubernetes.io/projected/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-kube-api-access-8ctxj\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-scripts\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-config-data\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-scripts\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030388 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-config-data\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.030521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hc99d\" (UniqueName: \"kubernetes.io/projected/a0bcacd3-e87e-48de-91f8-dac91578f597-kube-api-access-hc99d\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.048387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.048751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.048878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-config-data\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.049692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc99d\" (UniqueName: \"kubernetes.io/projected/a0bcacd3-e87e-48de-91f8-dac91578f597-kube-api-access-hc99d\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.050757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-scripts\") pod \"nova-cell0-cell-mapping-f658g\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.051316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-scripts\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.053385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctxj\" (UniqueName: \"kubernetes.io/projected/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-kube-api-access-8ctxj\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.066952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-config-data\") pod \"nova-cell1-cell-mapping-hmxnd\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.101286 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.152356 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.407517 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f55126-1aa7-4b10-9858-a35e8a073286-logs\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-combined-ca-bundle\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-scripts\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-internal-tls-certs\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544870 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-config-data\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-public-tls-certs\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.544964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mvqg\" (UniqueName: \"kubernetes.io/projected/20f55126-1aa7-4b10-9858-a35e8a073286-kube-api-access-7mvqg\") pod \"20f55126-1aa7-4b10-9858-a35e8a073286\" (UID: \"20f55126-1aa7-4b10-9858-a35e8a073286\") " Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.545246 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f55126-1aa7-4b10-9858-a35e8a073286-logs" (OuterVolumeSpecName: "logs") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.545388 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20f55126-1aa7-4b10-9858-a35e8a073286-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.549734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-scripts" (OuterVolumeSpecName: "scripts") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.549886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f55126-1aa7-4b10-9858-a35e8a073286-kube-api-access-7mvqg" (OuterVolumeSpecName: "kube-api-access-7mvqg") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "kube-api-access-7mvqg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.594916 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.599748 4769 generic.go:334] "Generic (PLEG): container finished" podID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerID="072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748" exitCode=143 Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.599811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"23a5ec8e-ba2d-4836-83dc-0f95131d4838","Type":"ContainerDied","Data":"072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748"} Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.601807 4769 generic.go:334] "Generic (PLEG): container finished" podID="20f55126-1aa7-4b10-9858-a35e8a073286" containerID="85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d" exitCode=0 Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.601843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" event={"ID":"20f55126-1aa7-4b10-9858-a35e8a073286","Type":"ContainerDied","Data":"85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d"} Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.601860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" event={"ID":"20f55126-1aa7-4b10-9858-a35e8a073286","Type":"ContainerDied","Data":"adc24dff6ad45f1b8afd06b76fe46b777ec8c944d3db466c716c61f9a98baf7f"} Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.601875 4769 scope.go:117] "RemoveContainer" containerID="85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.601979 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fc86bb567-hdclf" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.605099 4769 generic.go:334] "Generic (PLEG): container finished" podID="550e4721-ef58-4d97-a23d-12272e168ff9" containerID="f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f" exitCode=143 Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.605139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"550e4721-ef58-4d97-a23d-12272e168ff9","Type":"ContainerDied","Data":"f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f"} Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.610919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-config-data" (OuterVolumeSpecName: "config-data") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.637951 4769 scope.go:117] "RemoveContainer" containerID="1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.652809 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.654026 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.654046 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.654057 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mvqg\" (UniqueName: \"kubernetes.io/projected/20f55126-1aa7-4b10-9858-a35e8a073286-kube-api-access-7mvqg\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.654070 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.654078 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.658216 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-f658g"] Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.660987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "20f55126-1aa7-4b10-9858-a35e8a073286" (UID: "20f55126-1aa7-4b10-9858-a35e8a073286"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.661754 4769 scope.go:117] "RemoveContainer" containerID="85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d" Nov 21 12:52:44 crc kubenswrapper[4769]: E1121 12:52:44.662231 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d\": container with ID starting with 85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d not found: ID does not exist" containerID="85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.662276 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d"} err="failed to get container status \"85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d\": rpc error: code = NotFound desc = could not find container \"85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d\": container with ID starting with 85342f20c18a5246201b098cc259d57d3d3983da171d0bedd0a4dcf8d169430d not found: ID does not exist" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.662303 4769 scope.go:117] "RemoveContainer" containerID="1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1" Nov 21 12:52:44 crc kubenswrapper[4769]: E1121 12:52:44.662573 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1\": container with ID starting with 1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1 not found: ID does not exist" containerID="1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1" Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.662613 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1"} err="failed to get container status \"1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1\": rpc error: code = NotFound desc = could not find container \"1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1\": container with ID starting with 1104bd8ded80027cc3ee3340844ca2b9eb4bd218f8797fc0bb0ff4bc2098f4d1 not found: ID does not exist" Nov 21 12:52:44 crc kubenswrapper[4769]: W1121 12:52:44.667545 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0bcacd3_e87e_48de_91f8_dac91578f597.slice/crio-76ae51685b3a0c109cedfa385b79433b8d230171b38221081d2de105eb2a74fc WatchSource:0}: Error finding container 76ae51685b3a0c109cedfa385b79433b8d230171b38221081d2de105eb2a74fc: Status 404 returned error can't find the container with id 76ae51685b3a0c109cedfa385b79433b8d230171b38221081d2de105eb2a74fc Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.756095 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f55126-1aa7-4b10-9858-a35e8a073286-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:44 crc kubenswrapper[4769]: W1121 12:52:44.773347 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cbae4c5_9a57_437f_bfb1_b574dcf2b6b5.slice/crio-b35fd8ca8144f4d0cdf53444beed6e6e1a8a6664df9dcb96338db1493b9a91e9 WatchSource:0}: Error finding container b35fd8ca8144f4d0cdf53444beed6e6e1a8a6664df9dcb96338db1493b9a91e9: Status 404 returned error can't find the container with id b35fd8ca8144f4d0cdf53444beed6e6e1a8a6664df9dcb96338db1493b9a91e9 Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.775218 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd"] Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.941057 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7fc86bb567-hdclf"] Nov 21 12:52:44 crc kubenswrapper[4769]: I1121 12:52:44.947608 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7fc86bb567-hdclf"] Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.289849 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16c492a8-bb87-4555-9440-eba03796e00d" path="/var/lib/kubelet/pods/16c492a8-bb87-4555-9440-eba03796e00d/volumes" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.293380 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" path="/var/lib/kubelet/pods/20f55126-1aa7-4b10-9858-a35e8a073286/volumes" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.294505 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27994bbe-75df-4c59-bb4b-b1c8464659df" path="/var/lib/kubelet/pods/27994bbe-75df-4c59-bb4b-b1c8464659df/volumes" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.353642 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.467479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-847gp\" (UniqueName: \"kubernetes.io/projected/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-kube-api-access-847gp\") pod \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.467700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-config-data\") pod \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.467770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-combined-ca-bundle\") pod \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\" (UID: \"7ccddfcd-9373-47fd-9d6f-b342b80aa22c\") " Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.473220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-kube-api-access-847gp" (OuterVolumeSpecName: "kube-api-access-847gp") pod "7ccddfcd-9373-47fd-9d6f-b342b80aa22c" (UID: "7ccddfcd-9373-47fd-9d6f-b342b80aa22c"). InnerVolumeSpecName "kube-api-access-847gp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.494018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ccddfcd-9373-47fd-9d6f-b342b80aa22c" (UID: "7ccddfcd-9373-47fd-9d6f-b342b80aa22c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.496631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-config-data" (OuterVolumeSpecName: "config-data") pod "7ccddfcd-9373-47fd-9d6f-b342b80aa22c" (UID: "7ccddfcd-9373-47fd-9d6f-b342b80aa22c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.569723 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.569756 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.569772 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-847gp\" (UniqueName: \"kubernetes.io/projected/7ccddfcd-9373-47fd-9d6f-b342b80aa22c-kube-api-access-847gp\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.615437 4769 generic.go:334] "Generic (PLEG): container finished" podID="7ccddfcd-9373-47fd-9d6f-b342b80aa22c" containerID="7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927" exitCode=0 Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.615490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7ccddfcd-9373-47fd-9d6f-b342b80aa22c","Type":"ContainerDied","Data":"7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927"} Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.615514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7ccddfcd-9373-47fd-9d6f-b342b80aa22c","Type":"ContainerDied","Data":"773ac9368a5e4ea8464ea44919741f1a26dfbf8b55ef03b795f8ef389fb62151"} Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.615528 4769 scope.go:117] "RemoveContainer" containerID="7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.615629 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.620777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" event={"ID":"a0bcacd3-e87e-48de-91f8-dac91578f597","Type":"ContainerStarted","Data":"d53484f7bd8cade24f9789c4a1a20b9564d815925dc7ebdf7395bac407f82a01"} Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.620826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" event={"ID":"a0bcacd3-e87e-48de-91f8-dac91578f597","Type":"ContainerStarted","Data":"76ae51685b3a0c109cedfa385b79433b8d230171b38221081d2de105eb2a74fc"} Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.623952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" event={"ID":"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5","Type":"ContainerStarted","Data":"7cfa53c7351428f14664fda5fd5b8b753e39bb09b268ac9e957fd393e13a6b01"} Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.624024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" event={"ID":"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5","Type":"ContainerStarted","Data":"b35fd8ca8144f4d0cdf53444beed6e6e1a8a6664df9dcb96338db1493b9a91e9"} Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.639795 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" podStartSLOduration=2.63978089 podStartE2EDuration="2.63978089s" podCreationTimestamp="2025-11-21 12:52:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:45.635498694 +0000 UTC m=+3724.336160542" watchObservedRunningTime="2025-11-21 12:52:45.63978089 +0000 UTC m=+3724.340442708" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.657535 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" podStartSLOduration=2.657517253 podStartE2EDuration="2.657517253s" podCreationTimestamp="2025-11-21 12:52:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:45.651391646 +0000 UTC m=+3724.352053464" watchObservedRunningTime="2025-11-21 12:52:45.657517253 +0000 UTC m=+3724.358179071" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.661276 4769 scope.go:117] "RemoveContainer" containerID="7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927" Nov 21 12:52:45 crc kubenswrapper[4769]: E1121 12:52:45.662603 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927\": container with ID starting with 7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927 not found: ID does not exist" containerID="7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.662708 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927"} err="failed to get container status \"7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927\": rpc error: code = NotFound desc = could not find container \"7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927\": container with ID starting with 7f1affe239558113e9802b5d22abf089f1db484611fd9605a488636a8691a927 not found: ID does not exist" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.677000 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.692314 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.700917 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:45 crc kubenswrapper[4769]: E1121 12:52:45.701725 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-api" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.701819 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-api" Nov 21 12:52:45 crc kubenswrapper[4769]: E1121 12:52:45.701902 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-log" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.701979 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-log" Nov 21 12:52:45 crc kubenswrapper[4769]: E1121 12:52:45.702055 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ccddfcd-9373-47fd-9d6f-b342b80aa22c" containerName="nova-scheduler-scheduler" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.702129 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ccddfcd-9373-47fd-9d6f-b342b80aa22c" containerName="nova-scheduler-scheduler" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.702380 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-api" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.702473 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ccddfcd-9373-47fd-9d6f-b342b80aa22c" containerName="nova-scheduler-scheduler" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.702539 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20f55126-1aa7-4b10-9858-a35e8a073286" containerName="placement-log" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.703250 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.705310 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.721672 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.780403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2frg\" (UniqueName: \"kubernetes.io/projected/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-kube-api-access-r2frg\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.781502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-config-data\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.781619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.883224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-config-data\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.883311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.883393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r2frg\" (UniqueName: \"kubernetes.io/projected/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-kube-api-access-r2frg\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.889430 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-config-data\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.897342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:45 crc kubenswrapper[4769]: I1121 12:52:45.902675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2frg\" (UniqueName: \"kubernetes.io/projected/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-kube-api-access-r2frg\") pod \"nova-scheduler-0\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:46 crc kubenswrapper[4769]: I1121 12:52:46.084055 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:46 crc kubenswrapper[4769]: I1121 12:52:46.627407 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:46 crc kubenswrapper[4769]: I1121 12:52:46.749973 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.153:8775/\": read tcp 10.217.0.2:48132->10.217.1.153:8775: read: connection reset by peer" Nov 21 12:52:46 crc kubenswrapper[4769]: I1121 12:52:46.750549 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.153:8775/\": read tcp 10.217.0.2:48140->10.217.1.153:8775: read: connection reset by peer" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.175226 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.202489 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.292417 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ccddfcd-9373-47fd-9d6f-b342b80aa22c" path="/var/lib/kubelet/pods/7ccddfcd-9373-47fd-9d6f-b342b80aa22c/volumes" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.318845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-combined-ca-bundle\") pod \"550e4721-ef58-4d97-a23d-12272e168ff9\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.318906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-config-data\") pod \"550e4721-ef58-4d97-a23d-12272e168ff9\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.318960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/550e4721-ef58-4d97-a23d-12272e168ff9-logs\") pod \"550e4721-ef58-4d97-a23d-12272e168ff9\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.318984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-combined-ca-bundle\") pod \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbt62\" (UniqueName: \"kubernetes.io/projected/23a5ec8e-ba2d-4836-83dc-0f95131d4838-kube-api-access-sbt62\") pod \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-public-tls-certs\") pod \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319091 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q86g2\" (UniqueName: \"kubernetes.io/projected/550e4721-ef58-4d97-a23d-12272e168ff9-kube-api-access-q86g2\") pod \"550e4721-ef58-4d97-a23d-12272e168ff9\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-config-data\") pod \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-nova-metadata-tls-certs\") pod \"550e4721-ef58-4d97-a23d-12272e168ff9\" (UID: \"550e4721-ef58-4d97-a23d-12272e168ff9\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/23a5ec8e-ba2d-4836-83dc-0f95131d4838-logs\") pod \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.319298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-internal-tls-certs\") pod \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\" (UID: \"23a5ec8e-ba2d-4836-83dc-0f95131d4838\") " Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.323711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a5ec8e-ba2d-4836-83dc-0f95131d4838-logs" (OuterVolumeSpecName: "logs") pod "23a5ec8e-ba2d-4836-83dc-0f95131d4838" (UID: "23a5ec8e-ba2d-4836-83dc-0f95131d4838"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.323801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550e4721-ef58-4d97-a23d-12272e168ff9-logs" (OuterVolumeSpecName: "logs") pod "550e4721-ef58-4d97-a23d-12272e168ff9" (UID: "550e4721-ef58-4d97-a23d-12272e168ff9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.347393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550e4721-ef58-4d97-a23d-12272e168ff9-kube-api-access-q86g2" (OuterVolumeSpecName: "kube-api-access-q86g2") pod "550e4721-ef58-4d97-a23d-12272e168ff9" (UID: "550e4721-ef58-4d97-a23d-12272e168ff9"). InnerVolumeSpecName "kube-api-access-q86g2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.351778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a5ec8e-ba2d-4836-83dc-0f95131d4838-kube-api-access-sbt62" (OuterVolumeSpecName: "kube-api-access-sbt62") pod "23a5ec8e-ba2d-4836-83dc-0f95131d4838" (UID: "23a5ec8e-ba2d-4836-83dc-0f95131d4838"). InnerVolumeSpecName "kube-api-access-sbt62". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.422610 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q86g2\" (UniqueName: \"kubernetes.io/projected/550e4721-ef58-4d97-a23d-12272e168ff9-kube-api-access-q86g2\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.422650 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/23a5ec8e-ba2d-4836-83dc-0f95131d4838-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.422664 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/550e4721-ef58-4d97-a23d-12272e168ff9-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.422676 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sbt62\" (UniqueName: \"kubernetes.io/projected/23a5ec8e-ba2d-4836-83dc-0f95131d4838-kube-api-access-sbt62\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.432072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "23a5ec8e-ba2d-4836-83dc-0f95131d4838" (UID: "23a5ec8e-ba2d-4836-83dc-0f95131d4838"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.432119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-config-data" (OuterVolumeSpecName: "config-data") pod "23a5ec8e-ba2d-4836-83dc-0f95131d4838" (UID: "23a5ec8e-ba2d-4836-83dc-0f95131d4838"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.447681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "23a5ec8e-ba2d-4836-83dc-0f95131d4838" (UID: "23a5ec8e-ba2d-4836-83dc-0f95131d4838"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.447800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-config-data" (OuterVolumeSpecName: "config-data") pod "550e4721-ef58-4d97-a23d-12272e168ff9" (UID: "550e4721-ef58-4d97-a23d-12272e168ff9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.451492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "550e4721-ef58-4d97-a23d-12272e168ff9" (UID: "550e4721-ef58-4d97-a23d-12272e168ff9"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.467368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "550e4721-ef58-4d97-a23d-12272e168ff9" (UID: "550e4721-ef58-4d97-a23d-12272e168ff9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.483936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "23a5ec8e-ba2d-4836-83dc-0f95131d4838" (UID: "23a5ec8e-ba2d-4836-83dc-0f95131d4838"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527760 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527791 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527814 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527822 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527831 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527839 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a5ec8e-ba2d-4836-83dc-0f95131d4838-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.527849 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/550e4721-ef58-4d97-a23d-12272e168ff9-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.662534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c","Type":"ContainerStarted","Data":"3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7"} Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.662590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c","Type":"ContainerStarted","Data":"312b3d75e8229a75e2e7ad8f211da332566fdd722c9c9e9753114fafc97541a7"} Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.669540 4769 generic.go:334] "Generic (PLEG): container finished" podID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerID="44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782" exitCode=0 Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.669711 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.672268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"23a5ec8e-ba2d-4836-83dc-0f95131d4838","Type":"ContainerDied","Data":"44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782"} Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.672340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"23a5ec8e-ba2d-4836-83dc-0f95131d4838","Type":"ContainerDied","Data":"7d315bbc2a6b5960f3bd1a73d68993d47a16bd78a0db3a9bbe62d1172bda6a47"} Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.672361 4769 scope.go:117] "RemoveContainer" containerID="44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.678529 4769 generic.go:334] "Generic (PLEG): container finished" podID="550e4721-ef58-4d97-a23d-12272e168ff9" containerID="5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7" exitCode=0 Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.678573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"550e4721-ef58-4d97-a23d-12272e168ff9","Type":"ContainerDied","Data":"5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7"} Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.678598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"550e4721-ef58-4d97-a23d-12272e168ff9","Type":"ContainerDied","Data":"d978cddb9bd26a7ddc1619fc74fd8784d1e9567eea11d6a8371e22be5043d05c"} Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.678755 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.745351 4769 scope.go:117] "RemoveContainer" containerID="072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.751614 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.75159631 podStartE2EDuration="2.75159631s" podCreationTimestamp="2025-11-21 12:52:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:47.72770016 +0000 UTC m=+3726.428361978" watchObservedRunningTime="2025-11-21 12:52:47.75159631 +0000 UTC m=+3726.452258128" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.855413 4769 scope.go:117] "RemoveContainer" containerID="44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.856716 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.857642 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782\": container with ID starting with 44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782 not found: ID does not exist" containerID="44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.857670 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782"} err="failed to get container status \"44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782\": rpc error: code = NotFound desc = could not find container \"44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782\": container with ID starting with 44be63602d1ddaebb3b2de371f490140eb014913b9ca23e78db57b915b201782 not found: ID does not exist" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.857697 4769 scope.go:117] "RemoveContainer" containerID="072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748" Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.859432 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748\": container with ID starting with 072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748 not found: ID does not exist" containerID="072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.859452 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748"} err="failed to get container status \"072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748\": rpc error: code = NotFound desc = could not find container \"072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748\": container with ID starting with 072bb4d6a535c17d732992cb8f033c762ff0bde074b48e0f62fe7cb8de259748 not found: ID does not exist" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.859465 4769 scope.go:117] "RemoveContainer" containerID="5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.874524 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.911709 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.912170 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-api" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912183 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-api" Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.912214 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912222 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.912270 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912277 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.912297 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-log" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912304 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-log" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912506 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-log" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912537 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-log" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912547 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" containerName="nova-api-api" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912563 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" containerName="nova-metadata-metadata" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.912786 4769 scope.go:117] "RemoveContainer" containerID="f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.913632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.916974 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.917128 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.923299 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.928466 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.942951 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.952558 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.954229 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.960926 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.961212 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.961376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.962046 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.966311 4769 scope.go:117] "RemoveContainer" containerID="5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7" Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.970555 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7\": container with ID starting with 5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7 not found: ID does not exist" containerID="5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.970598 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7"} err="failed to get container status \"5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7\": rpc error: code = NotFound desc = could not find container \"5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7\": container with ID starting with 5c7d031538a30ebb625c3648877e45218e31ed5fbd56477e6d2beecc6b7161d7 not found: ID does not exist" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.970621 4769 scope.go:117] "RemoveContainer" containerID="f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f" Nov 21 12:52:47 crc kubenswrapper[4769]: E1121 12:52:47.971723 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f\": container with ID starting with f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f not found: ID does not exist" containerID="f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f" Nov 21 12:52:47 crc kubenswrapper[4769]: I1121 12:52:47.971756 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f"} err="failed to get container status \"f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f\": rpc error: code = NotFound desc = could not find container \"f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f\": container with ID starting with f474bb0e0341811aabe2172bc7393989d0351c3e5c4cbbeadd7be4a744c1f93f not found: ID does not exist" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.038858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-config-data\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.038946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-internal-tls-certs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.038970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7qwc\" (UniqueName: \"kubernetes.io/projected/d18d9273-dbb7-4936-9e45-181fd8c9e56f-kube-api-access-d7qwc\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d18d9273-dbb7-4936-9e45-181fd8c9e56f-logs\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039020 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/085fb343-f055-46e9-88f5-1c2e0d698c93-logs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039328 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-public-tls-certs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8vt\" (UniqueName: \"kubernetes.io/projected/085fb343-f055-46e9-88f5-1c2e0d698c93-kube-api-access-bc8vt\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-config-data\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.039699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.141834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8vt\" (UniqueName: \"kubernetes.io/projected/085fb343-f055-46e9-88f5-1c2e0d698c93-kube-api-access-bc8vt\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142001 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-config-data\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142052 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-config-data\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-internal-tls-certs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d7qwc\" (UniqueName: \"kubernetes.io/projected/d18d9273-dbb7-4936-9e45-181fd8c9e56f-kube-api-access-d7qwc\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d18d9273-dbb7-4936-9e45-181fd8c9e56f-logs\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/085fb343-f055-46e9-88f5-1c2e0d698c93-logs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.142631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-public-tls-certs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.143082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d18d9273-dbb7-4936-9e45-181fd8c9e56f-logs\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.143537 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/085fb343-f055-46e9-88f5-1c2e0d698c93-logs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.153488 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-internal-tls-certs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.153617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.154276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.155753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-config-data\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.159844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-public-tls-certs\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.160552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-config-data\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.163640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7qwc\" (UniqueName: \"kubernetes.io/projected/d18d9273-dbb7-4936-9e45-181fd8c9e56f-kube-api-access-d7qwc\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.167324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.179040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8vt\" (UniqueName: \"kubernetes.io/projected/085fb343-f055-46e9-88f5-1c2e0d698c93-kube-api-access-bc8vt\") pod \"nova-api-0\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.250315 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:48 crc kubenswrapper[4769]: I1121 12:52:48.274340 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:48.813445 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:48.916329 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.343928 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a5ec8e-ba2d-4836-83dc-0f95131d4838" path="/var/lib/kubelet/pods/23a5ec8e-ba2d-4836-83dc-0f95131d4838/volumes" Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.344879 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550e4721-ef58-4d97-a23d-12272e168ff9" path="/var/lib/kubelet/pods/550e4721-ef58-4d97-a23d-12272e168ff9/volumes" Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.741721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"085fb343-f055-46e9-88f5-1c2e0d698c93","Type":"ContainerStarted","Data":"f0cf558e04b5a24d020bd87c55f7bb96e5808c3412d70a0f864cec2d9f64c588"} Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.742051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"085fb343-f055-46e9-88f5-1c2e0d698c93","Type":"ContainerStarted","Data":"02a1d828ffa693482b44808b39674c33c711772a9268d30d38dee0d53ad8c27e"} Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.742061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"085fb343-f055-46e9-88f5-1c2e0d698c93","Type":"ContainerStarted","Data":"b504351ee4d82843fd395391eb63b797127680bfa4d72093c9c0349643553349"} Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.756380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d18d9273-dbb7-4936-9e45-181fd8c9e56f","Type":"ContainerStarted","Data":"c31118e44926965b813463976eb43d15b158b694f16b3103272127651dd0276f"} Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.756413 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d18d9273-dbb7-4936-9e45-181fd8c9e56f","Type":"ContainerStarted","Data":"6425874b62d60a9e2aefec1e27497841c0cb275c0d4d547436b570d7309247e2"} Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.756423 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d18d9273-dbb7-4936-9e45-181fd8c9e56f","Type":"ContainerStarted","Data":"002391270a78dd4c289de8fddec1e79abd94b07f10f26b46c7da9c0066ec6fbd"} Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.775656 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.775640961 podStartE2EDuration="2.775640961s" podCreationTimestamp="2025-11-21 12:52:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:49.771599321 +0000 UTC m=+3728.472261139" watchObservedRunningTime="2025-11-21 12:52:49.775640961 +0000 UTC m=+3728.476302779" Nov 21 12:52:49 crc kubenswrapper[4769]: I1121 12:52:49.799035 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.799020177 podStartE2EDuration="2.799020177s" podCreationTimestamp="2025-11-21 12:52:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:49.797986778 +0000 UTC m=+3728.498648596" watchObservedRunningTime="2025-11-21 12:52:49.799020177 +0000 UTC m=+3728.499682135" Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.014200 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.063826 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-75dd64ff8d-6p889"] Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.064041 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" podUID="8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" containerName="keystone-api" containerID="cri-o://c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175" gracePeriod=30 Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.771574 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0bcacd3-e87e-48de-91f8-dac91578f597" containerID="d53484f7bd8cade24f9789c4a1a20b9564d815925dc7ebdf7395bac407f82a01" exitCode=0 Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.771663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" event={"ID":"a0bcacd3-e87e-48de-91f8-dac91578f597","Type":"ContainerDied","Data":"d53484f7bd8cade24f9789c4a1a20b9564d815925dc7ebdf7395bac407f82a01"} Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.774318 4769 generic.go:334] "Generic (PLEG): container finished" podID="7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" containerID="7cfa53c7351428f14664fda5fd5b8b753e39bb09b268ac9e957fd393e13a6b01" exitCode=0 Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.774373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" event={"ID":"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5","Type":"ContainerDied","Data":"7cfa53c7351428f14664fda5fd5b8b753e39bb09b268ac9e957fd393e13a6b01"} Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.778552 4769 generic.go:334] "Generic (PLEG): container finished" podID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerID="9f9ad259087538c0306f1d97798a41b520312af244042bc9ef39d245715b3ff7" exitCode=137 Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.778595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerDied","Data":"9f9ad259087538c0306f1d97798a41b520312af244042bc9ef39d245715b3ff7"} Nov 21 12:52:50 crc kubenswrapper[4769]: I1121 12:52:50.778634 4769 scope.go:117] "RemoveContainer" containerID="c9f25f7b58f2b214420ba3902aaacc67729bc24099f7643f8ebfecac08af7316" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.084402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.137718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.225613 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-combined-ca-bundle\") pod \"4db4811a-d420-4b48-a312-db8f5c3424bb\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.226038 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data\") pod \"4db4811a-d420-4b48-a312-db8f5c3424bb\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.226102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgdrt\" (UniqueName: \"kubernetes.io/projected/4db4811a-d420-4b48-a312-db8f5c3424bb-kube-api-access-jgdrt\") pod \"4db4811a-d420-4b48-a312-db8f5c3424bb\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.226203 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4db4811a-d420-4b48-a312-db8f5c3424bb-etc-machine-id\") pod \"4db4811a-d420-4b48-a312-db8f5c3424bb\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.226282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-scripts\") pod \"4db4811a-d420-4b48-a312-db8f5c3424bb\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.226349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4db4811a-d420-4b48-a312-db8f5c3424bb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4db4811a-d420-4b48-a312-db8f5c3424bb" (UID: "4db4811a-d420-4b48-a312-db8f5c3424bb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.226403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data-custom\") pod \"4db4811a-d420-4b48-a312-db8f5c3424bb\" (UID: \"4db4811a-d420-4b48-a312-db8f5c3424bb\") " Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.227211 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4db4811a-d420-4b48-a312-db8f5c3424bb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.231075 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-scripts" (OuterVolumeSpecName: "scripts") pod "4db4811a-d420-4b48-a312-db8f5c3424bb" (UID: "4db4811a-d420-4b48-a312-db8f5c3424bb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.231463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db4811a-d420-4b48-a312-db8f5c3424bb-kube-api-access-jgdrt" (OuterVolumeSpecName: "kube-api-access-jgdrt") pod "4db4811a-d420-4b48-a312-db8f5c3424bb" (UID: "4db4811a-d420-4b48-a312-db8f5c3424bb"). InnerVolumeSpecName "kube-api-access-jgdrt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.239898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4db4811a-d420-4b48-a312-db8f5c3424bb" (UID: "4db4811a-d420-4b48-a312-db8f5c3424bb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.301048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4db4811a-d420-4b48-a312-db8f5c3424bb" (UID: "4db4811a-d420-4b48-a312-db8f5c3424bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.329685 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.329725 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jgdrt\" (UniqueName: \"kubernetes.io/projected/4db4811a-d420-4b48-a312-db8f5c3424bb-kube-api-access-jgdrt\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.329738 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.329750 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.340276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data" (OuterVolumeSpecName: "config-data") pod "4db4811a-d420-4b48-a312-db8f5c3424bb" (UID: "4db4811a-d420-4b48-a312-db8f5c3424bb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.431675 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db4811a-d420-4b48-a312-db8f5c3424bb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.796965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"4db4811a-d420-4b48-a312-db8f5c3424bb","Type":"ContainerDied","Data":"2c966ba78741a30da78df96f078611ead8dc0b707a4c051f69bbf98efddcd714"} Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.797029 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.797034 4769 scope.go:117] "RemoveContainer" containerID="9f9ad259087538c0306f1d97798a41b520312af244042bc9ef39d245715b3ff7" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.862434 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.870227 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.877879 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:52:51 crc kubenswrapper[4769]: E1121 12:52:51.878346 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.878359 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" Nov 21 12:52:51 crc kubenswrapper[4769]: E1121 12:52:51.878369 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="probe" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.878375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="probe" Nov 21 12:52:51 crc kubenswrapper[4769]: E1121 12:52:51.878394 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.878400 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.878620 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="probe" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.878631 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.878640 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" containerName="cinder-scheduler" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.879647 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.882057 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.885516 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.897836 4769 scope.go:117] "RemoveContainer" containerID="c76d0fc31a5f2b3491cef248bb6e9202cec9d4c7115e247c897efe656fe502c2" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.954665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c895594-ffd6-4dde-b02c-f949e3ead50f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.954719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.954773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cxp\" (UniqueName: \"kubernetes.io/projected/1c895594-ffd6-4dde-b02c-f949e3ead50f-kube-api-access-z6cxp\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.954816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.954865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:51 crc kubenswrapper[4769]: I1121 12:52:51.954914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.057451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cxp\" (UniqueName: \"kubernetes.io/projected/1c895594-ffd6-4dde-b02c-f949e3ead50f-kube-api-access-z6cxp\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.057560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.057708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.057798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.057937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c895594-ffd6-4dde-b02c-f949e3ead50f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.057990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.063102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.063138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.063183 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c895594-ffd6-4dde-b02c-f949e3ead50f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.063253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.063651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.091238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cxp\" (UniqueName: \"kubernetes.io/projected/1c895594-ffd6-4dde-b02c-f949e3ead50f-kube-api-access-z6cxp\") pod \"cinder-scheduler-0\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.198108 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.224862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.267338 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-config-data\") pod \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.267388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-combined-ca-bundle\") pod \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.267448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-scripts\") pod \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.267502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ctxj\" (UniqueName: \"kubernetes.io/projected/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-kube-api-access-8ctxj\") pod \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\" (UID: \"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.278468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-kube-api-access-8ctxj" (OuterVolumeSpecName: "kube-api-access-8ctxj") pod "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" (UID: "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5"). InnerVolumeSpecName "kube-api-access-8ctxj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.282435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-scripts" (OuterVolumeSpecName: "scripts") pod "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" (UID: "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.310924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" (UID: "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.313059 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.319741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-config-data" (OuterVolumeSpecName: "config-data") pod "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" (UID: "7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.368933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-combined-ca-bundle\") pod \"a0bcacd3-e87e-48de-91f8-dac91578f597\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.368998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-config-data\") pod \"a0bcacd3-e87e-48de-91f8-dac91578f597\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.369070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hc99d\" (UniqueName: \"kubernetes.io/projected/a0bcacd3-e87e-48de-91f8-dac91578f597-kube-api-access-hc99d\") pod \"a0bcacd3-e87e-48de-91f8-dac91578f597\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.369105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-scripts\") pod \"a0bcacd3-e87e-48de-91f8-dac91578f597\" (UID: \"a0bcacd3-e87e-48de-91f8-dac91578f597\") " Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.369580 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.369593 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.369602 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.369611 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8ctxj\" (UniqueName: \"kubernetes.io/projected/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5-kube-api-access-8ctxj\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.372544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bcacd3-e87e-48de-91f8-dac91578f597-kube-api-access-hc99d" (OuterVolumeSpecName: "kube-api-access-hc99d") pod "a0bcacd3-e87e-48de-91f8-dac91578f597" (UID: "a0bcacd3-e87e-48de-91f8-dac91578f597"). InnerVolumeSpecName "kube-api-access-hc99d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.372900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-scripts" (OuterVolumeSpecName: "scripts") pod "a0bcacd3-e87e-48de-91f8-dac91578f597" (UID: "a0bcacd3-e87e-48de-91f8-dac91578f597"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.394703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a0bcacd3-e87e-48de-91f8-dac91578f597" (UID: "a0bcacd3-e87e-48de-91f8-dac91578f597"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.403319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-config-data" (OuterVolumeSpecName: "config-data") pod "a0bcacd3-e87e-48de-91f8-dac91578f597" (UID: "a0bcacd3-e87e-48de-91f8-dac91578f597"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.471521 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.471758 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.471769 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hc99d\" (UniqueName: \"kubernetes.io/projected/a0bcacd3-e87e-48de-91f8-dac91578f597-kube-api-access-hc99d\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.471779 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a0bcacd3-e87e-48de-91f8-dac91578f597-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.678319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:52:52 crc kubenswrapper[4769]: W1121 12:52:52.691605 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c895594_ffd6_4dde_b02c_f949e3ead50f.slice/crio-b456ae53b71a6f49af290ee5570607eedea6eaf1d117142017f13a23d188f617 WatchSource:0}: Error finding container b456ae53b71a6f49af290ee5570607eedea6eaf1d117142017f13a23d188f617: Status 404 returned error can't find the container with id b456ae53b71a6f49af290ee5570607eedea6eaf1d117142017f13a23d188f617 Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.807663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c895594-ffd6-4dde-b02c-f949e3ead50f","Type":"ContainerStarted","Data":"b456ae53b71a6f49af290ee5570607eedea6eaf1d117142017f13a23d188f617"} Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.814108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" event={"ID":"a0bcacd3-e87e-48de-91f8-dac91578f597","Type":"ContainerDied","Data":"76ae51685b3a0c109cedfa385b79433b8d230171b38221081d2de105eb2a74fc"} Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.814182 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ae51685b3a0c109cedfa385b79433b8d230171b38221081d2de105eb2a74fc" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.814361 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-f658g" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.819801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" event={"ID":"7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5","Type":"ContainerDied","Data":"b35fd8ca8144f4d0cdf53444beed6e6e1a8a6664df9dcb96338db1493b9a91e9"} Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.819843 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b35fd8ca8144f4d0cdf53444beed6e6e1a8a6664df9dcb96338db1493b9a91e9" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.819898 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd" Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.997260 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.997501 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-log" containerID="cri-o://02a1d828ffa693482b44808b39674c33c711772a9268d30d38dee0d53ad8c27e" gracePeriod=30 Nov 21 12:52:52 crc kubenswrapper[4769]: I1121 12:52:52.997583 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-api" containerID="cri-o://f0cf558e04b5a24d020bd87c55f7bb96e5808c3412d70a0f864cec2d9f64c588" gracePeriod=30 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.052951 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.053177 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" containerName="nova-scheduler-scheduler" containerID="cri-o://3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7" gracePeriod=30 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.092518 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.092725 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-log" containerID="cri-o://6425874b62d60a9e2aefec1e27497841c0cb275c0d4d547436b570d7309247e2" gracePeriod=30 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.093166 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-metadata" containerID="cri-o://c31118e44926965b813463976eb43d15b158b694f16b3103272127651dd0276f" gracePeriod=30 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.250852 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.251212 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.284619 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db4811a-d420-4b48-a312-db8f5c3424bb" path="/var/lib/kubelet/pods/4db4811a-d420-4b48-a312-db8f5c3424bb/volumes" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.594413 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn"] Nov 21 12:52:53 crc kubenswrapper[4769]: E1121 12:52:53.594874 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0bcacd3-e87e-48de-91f8-dac91578f597" containerName="nova-manage" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.594891 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bcacd3-e87e-48de-91f8-dac91578f597" containerName="nova-manage" Nov 21 12:52:53 crc kubenswrapper[4769]: E1121 12:52:53.594909 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" containerName="nova-manage" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.594915 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" containerName="nova-manage" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.595120 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" containerName="nova-manage" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.595144 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0bcacd3-e87e-48de-91f8-dac91578f597" containerName="nova-manage" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.596226 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.618551 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn"] Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.645029 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-public-tls-certs\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-credential-keys\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-config-data\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-scripts\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-combined-ca-bundle\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv67j\" (UniqueName: \"kubernetes.io/projected/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-kube-api-access-qv67j\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-fernet-keys\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.693969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-internal-tls-certs\") pod \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\" (UID: \"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8\") " Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-public-tls-certs\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-etc-swift\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-internal-tls-certs\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-log-httpd\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv82p\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-kube-api-access-bv82p\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-config-data\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-combined-ca-bundle\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.694508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-run-httpd\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.700123 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-scripts" (OuterVolumeSpecName: "scripts") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.700483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.703814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.708367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-kube-api-access-qv67j" (OuterVolumeSpecName: "kube-api-access-qv67j") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "kube-api-access-qv67j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.745341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.761123 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-config-data" (OuterVolumeSpecName: "config-data") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.784500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-log-httpd\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bv82p\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-kube-api-access-bv82p\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-config-data\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795729 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-combined-ca-bundle\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-run-httpd\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-public-tls-certs\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-etc-swift\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-internal-tls-certs\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795959 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795970 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795982 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795991 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.795999 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.796007 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.796362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-log-httpd\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.796414 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qv67j\" (UniqueName: \"kubernetes.io/projected/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-kube-api-access-qv67j\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.796679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-run-httpd\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.800966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-combined-ca-bundle\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.803132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-public-tls-certs\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.806913 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-config-data\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.807497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-etc-swift\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.811083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv82p\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-kube-api-access-bv82p\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.813810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" (UID: "8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.814914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-internal-tls-certs\") pod \"swift-proxy-66565b6698-fw9wn\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.849568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c895594-ffd6-4dde-b02c-f949e3ead50f","Type":"ContainerStarted","Data":"e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.860007 4769 generic.go:334] "Generic (PLEG): container finished" podID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerID="f0cf558e04b5a24d020bd87c55f7bb96e5808c3412d70a0f864cec2d9f64c588" exitCode=0 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.860038 4769 generic.go:334] "Generic (PLEG): container finished" podID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerID="02a1d828ffa693482b44808b39674c33c711772a9268d30d38dee0d53ad8c27e" exitCode=143 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.860078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"085fb343-f055-46e9-88f5-1c2e0d698c93","Type":"ContainerDied","Data":"f0cf558e04b5a24d020bd87c55f7bb96e5808c3412d70a0f864cec2d9f64c588"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.860105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"085fb343-f055-46e9-88f5-1c2e0d698c93","Type":"ContainerDied","Data":"02a1d828ffa693482b44808b39674c33c711772a9268d30d38dee0d53ad8c27e"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.861551 4769 generic.go:334] "Generic (PLEG): container finished" podID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerID="c31118e44926965b813463976eb43d15b158b694f16b3103272127651dd0276f" exitCode=0 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.861563 4769 generic.go:334] "Generic (PLEG): container finished" podID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerID="6425874b62d60a9e2aefec1e27497841c0cb275c0d4d547436b570d7309247e2" exitCode=143 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.861592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d18d9273-dbb7-4936-9e45-181fd8c9e56f","Type":"ContainerDied","Data":"c31118e44926965b813463976eb43d15b158b694f16b3103272127651dd0276f"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.861606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d18d9273-dbb7-4936-9e45-181fd8c9e56f","Type":"ContainerDied","Data":"6425874b62d60a9e2aefec1e27497841c0cb275c0d4d547436b570d7309247e2"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.862519 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" containerID="c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175" exitCode=0 Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.862537 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" event={"ID":"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8","Type":"ContainerDied","Data":"c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.862550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" event={"ID":"8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8","Type":"ContainerDied","Data":"0dcaa9a60f5078fdaedd7051c5d0ac6d4abd940269ae9def01e344a16eaa228a"} Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.862566 4769 scope.go:117] "RemoveContainer" containerID="c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.862821 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dd64ff8d-6p889" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.898434 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.905114 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-75dd64ff8d-6p889"] Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.912828 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-75dd64ff8d-6p889"] Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.925529 4769 scope.go:117] "RemoveContainer" containerID="c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175" Nov 21 12:52:53 crc kubenswrapper[4769]: E1121 12:52:53.925957 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175\": container with ID starting with c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175 not found: ID does not exist" containerID="c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.925995 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175"} err="failed to get container status \"c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175\": rpc error: code = NotFound desc = could not find container \"c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175\": container with ID starting with c072bb0103deecef2325e52140a763cfab07c97a79fea5dc26a96831b67cd175 not found: ID does not exist" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.951202 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:53 crc kubenswrapper[4769]: I1121 12:52:53.957043 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.016059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc8vt\" (UniqueName: \"kubernetes.io/projected/085fb343-f055-46e9-88f5-1c2e0d698c93-kube-api-access-bc8vt\") pod \"085fb343-f055-46e9-88f5-1c2e0d698c93\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.016181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-internal-tls-certs\") pod \"085fb343-f055-46e9-88f5-1c2e0d698c93\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.016230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/085fb343-f055-46e9-88f5-1c2e0d698c93-logs\") pod \"085fb343-f055-46e9-88f5-1c2e0d698c93\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.016260 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-combined-ca-bundle\") pod \"085fb343-f055-46e9-88f5-1c2e0d698c93\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.016388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-public-tls-certs\") pod \"085fb343-f055-46e9-88f5-1c2e0d698c93\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.016434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-config-data\") pod \"085fb343-f055-46e9-88f5-1c2e0d698c93\" (UID: \"085fb343-f055-46e9-88f5-1c2e0d698c93\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.018352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085fb343-f055-46e9-88f5-1c2e0d698c93-logs" (OuterVolumeSpecName: "logs") pod "085fb343-f055-46e9-88f5-1c2e0d698c93" (UID: "085fb343-f055-46e9-88f5-1c2e0d698c93"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.026338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085fb343-f055-46e9-88f5-1c2e0d698c93-kube-api-access-bc8vt" (OuterVolumeSpecName: "kube-api-access-bc8vt") pod "085fb343-f055-46e9-88f5-1c2e0d698c93" (UID: "085fb343-f055-46e9-88f5-1c2e0d698c93"). InnerVolumeSpecName "kube-api-access-bc8vt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.045584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-config-data" (OuterVolumeSpecName: "config-data") pod "085fb343-f055-46e9-88f5-1c2e0d698c93" (UID: "085fb343-f055-46e9-88f5-1c2e0d698c93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.048939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "085fb343-f055-46e9-88f5-1c2e0d698c93" (UID: "085fb343-f055-46e9-88f5-1c2e0d698c93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.074291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "085fb343-f055-46e9-88f5-1c2e0d698c93" (UID: "085fb343-f055-46e9-88f5-1c2e0d698c93"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.090317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "085fb343-f055-46e9-88f5-1c2e0d698c93" (UID: "085fb343-f055-46e9-88f5-1c2e0d698c93"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.118354 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.118389 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/085fb343-f055-46e9-88f5-1c2e0d698c93-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.118402 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.118413 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.118425 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085fb343-f055-46e9-88f5-1c2e0d698c93-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.118437 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bc8vt\" (UniqueName: \"kubernetes.io/projected/085fb343-f055-46e9-88f5-1c2e0d698c93-kube-api-access-bc8vt\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.225385 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.225633 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="f0778bb1-d136-493d-8628-7836f4dcb341" containerName="openstackclient" containerID="cri-o://7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6" gracePeriod=2 Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.230489 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="f0778bb1-d136-493d-8628-7836f4dcb341" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.239150 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.247913 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:52:54 crc kubenswrapper[4769]: E1121 12:52:54.248473 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-log" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248498 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-log" Nov 21 12:52:54 crc kubenswrapper[4769]: E1121 12:52:54.248522 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-api" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248531 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-api" Nov 21 12:52:54 crc kubenswrapper[4769]: E1121 12:52:54.248552 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" containerName="keystone-api" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248559 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" containerName="keystone-api" Nov 21 12:52:54 crc kubenswrapper[4769]: E1121 12:52:54.248575 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0778bb1-d136-493d-8628-7836f4dcb341" containerName="openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248580 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0778bb1-d136-493d-8628-7836f4dcb341" containerName="openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248786 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0778bb1-d136-493d-8628-7836f4dcb341" containerName="openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248821 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-api" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248833 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" containerName="keystone-api" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.248853 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" containerName="nova-api-log" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.249624 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.258305 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.326567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-combined-ca-bundle\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.326978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.327108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9c4\" (UniqueName: \"kubernetes.io/projected/34ffb6e3-3335-41fe-a8f9-c2366177ab92-kube-api-access-cs9c4\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.327145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config-secret\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.431254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-combined-ca-bundle\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.432109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.432245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9c4\" (UniqueName: \"kubernetes.io/projected/34ffb6e3-3335-41fe-a8f9-c2366177ab92-kube-api-access-cs9c4\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.432284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config-secret\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.433432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.436406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-combined-ca-bundle\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.437967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config-secret\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.454834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9c4\" (UniqueName: \"kubernetes.io/projected/34ffb6e3-3335-41fe-a8f9-c2366177ab92-kube-api-access-cs9c4\") pod \"openstackclient\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.516409 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.598313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.620956 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn"] Nov 21 12:52:54 crc kubenswrapper[4769]: W1121 12:52:54.630414 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c40b75d_e715_4735_84f7_65a4a9b9ebe1.slice/crio-9c91893279cbf0e7894e22ee60ce64a990c7c11ac1faee5c010bd23de877becf WatchSource:0}: Error finding container 9c91893279cbf0e7894e22ee60ce64a990c7c11ac1faee5c010bd23de877becf: Status 404 returned error can't find the container with id 9c91893279cbf0e7894e22ee60ce64a990c7c11ac1faee5c010bd23de877becf Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.634784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-combined-ca-bundle\") pod \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.634849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d18d9273-dbb7-4936-9e45-181fd8c9e56f-logs\") pod \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.634996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-config-data\") pod \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.635091 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-nova-metadata-tls-certs\") pod \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.635142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7qwc\" (UniqueName: \"kubernetes.io/projected/d18d9273-dbb7-4936-9e45-181fd8c9e56f-kube-api-access-d7qwc\") pod \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\" (UID: \"d18d9273-dbb7-4936-9e45-181fd8c9e56f\") " Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.637047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18d9273-dbb7-4936-9e45-181fd8c9e56f-logs" (OuterVolumeSpecName: "logs") pod "d18d9273-dbb7-4936-9e45-181fd8c9e56f" (UID: "d18d9273-dbb7-4936-9e45-181fd8c9e56f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.640879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18d9273-dbb7-4936-9e45-181fd8c9e56f-kube-api-access-d7qwc" (OuterVolumeSpecName: "kube-api-access-d7qwc") pod "d18d9273-dbb7-4936-9e45-181fd8c9e56f" (UID: "d18d9273-dbb7-4936-9e45-181fd8c9e56f"). InnerVolumeSpecName "kube-api-access-d7qwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.670314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d18d9273-dbb7-4936-9e45-181fd8c9e56f" (UID: "d18d9273-dbb7-4936-9e45-181fd8c9e56f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.684420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-config-data" (OuterVolumeSpecName: "config-data") pod "d18d9273-dbb7-4936-9e45-181fd8c9e56f" (UID: "d18d9273-dbb7-4936-9e45-181fd8c9e56f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.731825 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d18d9273-dbb7-4936-9e45-181fd8c9e56f" (UID: "d18d9273-dbb7-4936-9e45-181fd8c9e56f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.738347 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.738377 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d7qwc\" (UniqueName: \"kubernetes.io/projected/d18d9273-dbb7-4936-9e45-181fd8c9e56f-kube-api-access-d7qwc\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.738386 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.738395 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d18d9273-dbb7-4936-9e45-181fd8c9e56f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.738406 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d18d9273-dbb7-4936-9e45-181fd8c9e56f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.897932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" event={"ID":"6c40b75d-e715-4735-84f7-65a4a9b9ebe1","Type":"ContainerStarted","Data":"9c91893279cbf0e7894e22ee60ce64a990c7c11ac1faee5c010bd23de877becf"} Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.910177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c895594-ffd6-4dde-b02c-f949e3ead50f","Type":"ContainerStarted","Data":"220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567"} Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.910853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.915329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"085fb343-f055-46e9-88f5-1c2e0d698c93","Type":"ContainerDied","Data":"b504351ee4d82843fd395391eb63b797127680bfa4d72093c9c0349643553349"} Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.915359 4769 scope.go:117] "RemoveContainer" containerID="f0cf558e04b5a24d020bd87c55f7bb96e5808c3412d70a0f864cec2d9f64c588" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.915455 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.929465 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.929444904 podStartE2EDuration="3.929444904s" podCreationTimestamp="2025-11-21 12:52:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:54.927528652 +0000 UTC m=+3733.628190480" watchObservedRunningTime="2025-11-21 12:52:54.929444904 +0000 UTC m=+3733.630106722" Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.934828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d18d9273-dbb7-4936-9e45-181fd8c9e56f","Type":"ContainerDied","Data":"002391270a78dd4c289de8fddec1e79abd94b07f10f26b46c7da9c0066ec6fbd"} Nov 21 12:52:54 crc kubenswrapper[4769]: I1121 12:52:54.934910 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.054418 4769 scope.go:117] "RemoveContainer" containerID="02a1d828ffa693482b44808b39674c33c711772a9268d30d38dee0d53ad8c27e" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.087045 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.107682 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.118777 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.128663 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.137169 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: E1121 12:52:55.137769 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-metadata" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.137793 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-metadata" Nov 21 12:52:55 crc kubenswrapper[4769]: E1121 12:52:55.137827 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-log" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.137834 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-log" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.138045 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-metadata" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.138088 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" containerName="nova-metadata-log" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.139429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.141782 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.142486 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.142666 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.157875 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.160299 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.164622 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.164867 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.171260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.198001 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.252757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-config-data\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.252864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-internal-tls-certs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.252897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.252961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-config-data\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-logs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253117 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-public-tls-certs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253226 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/997ee964-de30-4b1b-b360-a31378e9a928-logs\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt4lm\" (UniqueName: \"kubernetes.io/projected/997ee964-de30-4b1b-b360-a31378e9a928-kube-api-access-vt4lm\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpwx4\" (UniqueName: \"kubernetes.io/projected/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-kube-api-access-tpwx4\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.253617 4769 scope.go:117] "RemoveContainer" containerID="c31118e44926965b813463976eb43d15b158b694f16b3103272127651dd0276f" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.287161 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085fb343-f055-46e9-88f5-1c2e0d698c93" path="/var/lib/kubelet/pods/085fb343-f055-46e9-88f5-1c2e0d698c93/volumes" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.287876 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8" path="/var/lib/kubelet/pods/8b2227b4-f0f5-41a8-8825-c0a9e44c0bb8/volumes" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.288402 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18d9273-dbb7-4936-9e45-181fd8c9e56f" path="/var/lib/kubelet/pods/d18d9273-dbb7-4936-9e45-181fd8c9e56f/volumes" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.300444 4769 scope.go:117] "RemoveContainer" containerID="6425874b62d60a9e2aefec1e27497841c0cb275c0d4d547436b570d7309247e2" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/997ee964-de30-4b1b-b360-a31378e9a928-logs\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vt4lm\" (UniqueName: \"kubernetes.io/projected/997ee964-de30-4b1b-b360-a31378e9a928-kube-api-access-vt4lm\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tpwx4\" (UniqueName: \"kubernetes.io/projected/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-kube-api-access-tpwx4\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-config-data\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-internal-tls-certs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-config-data\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.358963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-logs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.359015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-public-tls-certs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.364262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.364870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/997ee964-de30-4b1b-b360-a31378e9a928-logs\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.367206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-config-data\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.369101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.369590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-logs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.370307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-public-tls-certs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.372755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-internal-tls-certs\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.375454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.376454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-config-data\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.383773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpwx4\" (UniqueName: \"kubernetes.io/projected/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-kube-api-access-tpwx4\") pod \"nova-api-0\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.384655 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt4lm\" (UniqueName: \"kubernetes.io/projected/997ee964-de30-4b1b-b360-a31378e9a928-kube-api-access-vt4lm\") pod \"nova-metadata-0\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.470648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.473966 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.479632 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.485208 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.562963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-ovndb-tls-certs\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563331 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2frg\" (UniqueName: \"kubernetes.io/projected/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-kube-api-access-r2frg\") pod \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-httpd-config\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-internal-tls-certs\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-public-tls-certs\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-combined-ca-bundle\") pod \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563549 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcrd8\" (UniqueName: \"kubernetes.io/projected/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-kube-api-access-jcrd8\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-config-data\") pod \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\" (UID: \"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-combined-ca-bundle\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.563653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-config\") pod \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\" (UID: \"cd529a0c-32c3-48c4-b835-f0ac206ec2d9\") " Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.600356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-kube-api-access-jcrd8" (OuterVolumeSpecName: "kube-api-access-jcrd8") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "kube-api-access-jcrd8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.630470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.634003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-kube-api-access-r2frg" (OuterVolumeSpecName: "kube-api-access-r2frg") pod "2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" (UID: "2e0f7145-48ec-4e3a-a163-2c2a293c7a9c"). InnerVolumeSpecName "kube-api-access-r2frg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.656598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-config-data" (OuterVolumeSpecName: "config-data") pod "2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" (UID: "2e0f7145-48ec-4e3a-a163-2c2a293c7a9c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.666330 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jcrd8\" (UniqueName: \"kubernetes.io/projected/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-kube-api-access-jcrd8\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.666361 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.666372 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r2frg\" (UniqueName: \"kubernetes.io/projected/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-kube-api-access-r2frg\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.666381 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.672350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.696490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-config" (OuterVolumeSpecName: "config") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.702765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" (UID: "2e0f7145-48ec-4e3a-a163-2c2a293c7a9c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.704928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.712653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.738719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "cd529a0c-32c3-48c4-b835-f0ac206ec2d9" (UID: "cd529a0c-32c3-48c4-b835-f0ac206ec2d9"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.767784 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.767814 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.767827 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.767837 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.767847 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd529a0c-32c3-48c4-b835-f0ac206ec2d9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.767856 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.949147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" event={"ID":"6c40b75d-e715-4735-84f7-65a4a9b9ebe1","Type":"ContainerStarted","Data":"d06f8830f020cf9e4f184f92c3dc2b75c5102487cf705fc57d48622df0863b4a"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.949218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" event={"ID":"6c40b75d-e715-4735-84f7-65a4a9b9ebe1","Type":"ContainerStarted","Data":"218808c308af3762e58b075e9b7db61231df55471cb35507c64dcc678e681429"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.949312 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.950578 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" containerID="3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7" exitCode=0 Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.950668 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.951661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c","Type":"ContainerDied","Data":"3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.951715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2e0f7145-48ec-4e3a-a163-2c2a293c7a9c","Type":"ContainerDied","Data":"312b3d75e8229a75e2e7ad8f211da332566fdd722c9c9e9753114fafc97541a7"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.951756 4769 scope.go:117] "RemoveContainer" containerID="3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.958720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"34ffb6e3-3335-41fe-a8f9-c2366177ab92","Type":"ContainerStarted","Data":"d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.958767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"34ffb6e3-3335-41fe-a8f9-c2366177ab92","Type":"ContainerStarted","Data":"3fa14e09e2bea4161c7fb8f072c1dead90d74eba375efd30366b5b93cc9da31c"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.967903 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerID="a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288" exitCode=0 Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.968253 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.968612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" event={"ID":"cd529a0c-32c3-48c4-b835-f0ac206ec2d9","Type":"ContainerDied","Data":"a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.968646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5d976fd77c-mvv95" event={"ID":"cd529a0c-32c3-48c4-b835-f0ac206ec2d9","Type":"ContainerDied","Data":"c71550174a9ea210d2ef0071b0d23a2a9d854dea5ee7b0a2f045c81f4e9337de"} Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.983362 4769 scope.go:117] "RemoveContainer" containerID="3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7" Nov 21 12:52:55 crc kubenswrapper[4769]: E1121 12:52:55.984061 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7\": container with ID starting with 3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7 not found: ID does not exist" containerID="3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.984121 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7"} err="failed to get container status \"3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7\": rpc error: code = NotFound desc = could not find container \"3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7\": container with ID starting with 3d9c649de7964836f13203b9bb3f5794fc93a3e9eb06ed59e34ee9498ee6f2f7 not found: ID does not exist" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.984154 4769 scope.go:117] "RemoveContainer" containerID="f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e" Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.989331 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:52:55 crc kubenswrapper[4769]: W1121 12:52:55.995050 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87e1294e_e6ee_46df_ab5b_9be0e1d34fce.slice/crio-ba8d8c1338b8723829427d8424e4b68a66f1c7e7d06213d090aad126381cb53c WatchSource:0}: Error finding container ba8d8c1338b8723829427d8424e4b68a66f1c7e7d06213d090aad126381cb53c: Status 404 returned error can't find the container with id ba8d8c1338b8723829427d8424e4b68a66f1c7e7d06213d090aad126381cb53c Nov 21 12:52:55 crc kubenswrapper[4769]: I1121 12:52:55.996072 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" podStartSLOduration=2.996053179 podStartE2EDuration="2.996053179s" podCreationTimestamp="2025-11-21 12:52:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:55.974004929 +0000 UTC m=+3734.674666747" watchObservedRunningTime="2025-11-21 12:52:55.996053179 +0000 UTC m=+3734.696714987" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.002496 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.002478043 podStartE2EDuration="2.002478043s" podCreationTimestamp="2025-11-21 12:52:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:55.994810705 +0000 UTC m=+3734.695472563" watchObservedRunningTime="2025-11-21 12:52:56.002478043 +0000 UTC m=+3734.703139861" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.029518 4769 scope.go:117] "RemoveContainer" containerID="a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.029575 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.064637 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076242 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:56 crc kubenswrapper[4769]: E1121 12:52:56.076696 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-api" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076708 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-api" Nov 21 12:52:56 crc kubenswrapper[4769]: E1121 12:52:56.076715 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-httpd" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076721 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-httpd" Nov 21 12:52:56 crc kubenswrapper[4769]: E1121 12:52:56.076745 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" containerName="nova-scheduler-scheduler" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076751 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" containerName="nova-scheduler-scheduler" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076922 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-httpd" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076938 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" containerName="neutron-api" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.076978 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" containerName="nova-scheduler-scheduler" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.077653 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.079503 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.100535 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.110821 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5d976fd77c-mvv95"] Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.119214 4769 scope.go:117] "RemoveContainer" containerID="f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.119269 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5d976fd77c-mvv95"] Nov 21 12:52:56 crc kubenswrapper[4769]: E1121 12:52:56.120654 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e\": container with ID starting with f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e not found: ID does not exist" containerID="f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.120749 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e"} err="failed to get container status \"f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e\": rpc error: code = NotFound desc = could not find container \"f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e\": container with ID starting with f43b3cab0da1bcbe09e5f422670966de043805c105b8b8a4833f6e1234f3b85e not found: ID does not exist" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.120823 4769 scope.go:117] "RemoveContainer" containerID="a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288" Nov 21 12:52:56 crc kubenswrapper[4769]: E1121 12:52:56.121438 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288\": container with ID starting with a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288 not found: ID does not exist" containerID="a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.121529 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288"} err="failed to get container status \"a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288\": rpc error: code = NotFound desc = could not find container \"a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288\": container with ID starting with a89af6b3a512db476d0de041debf88506c09a7e912a6d765576bd6ddbf624288 not found: ID does not exist" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.126584 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.192302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.192388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-config-data\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.192423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqrp\" (UniqueName: \"kubernetes.io/projected/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-kube-api-access-4jqrp\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.299119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-config-data\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.299261 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqrp\" (UniqueName: \"kubernetes.io/projected/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-kube-api-access-4jqrp\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.299470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.304605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-config-data\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.314232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.317803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqrp\" (UniqueName: \"kubernetes.io/projected/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-kube-api-access-4jqrp\") pod \"nova-scheduler-0\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.549671 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.589753 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.720636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9s7k\" (UniqueName: \"kubernetes.io/projected/f0778bb1-d136-493d-8628-7836f4dcb341-kube-api-access-p9s7k\") pod \"f0778bb1-d136-493d-8628-7836f4dcb341\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.720756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config\") pod \"f0778bb1-d136-493d-8628-7836f4dcb341\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.720785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config-secret\") pod \"f0778bb1-d136-493d-8628-7836f4dcb341\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.720812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-combined-ca-bundle\") pod \"f0778bb1-d136-493d-8628-7836f4dcb341\" (UID: \"f0778bb1-d136-493d-8628-7836f4dcb341\") " Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.761802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0778bb1-d136-493d-8628-7836f4dcb341-kube-api-access-p9s7k" (OuterVolumeSpecName: "kube-api-access-p9s7k") pod "f0778bb1-d136-493d-8628-7836f4dcb341" (UID: "f0778bb1-d136-493d-8628-7836f4dcb341"). InnerVolumeSpecName "kube-api-access-p9s7k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.784047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "f0778bb1-d136-493d-8628-7836f4dcb341" (UID: "f0778bb1-d136-493d-8628-7836f4dcb341"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.802943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0778bb1-d136-493d-8628-7836f4dcb341" (UID: "f0778bb1-d136-493d-8628-7836f4dcb341"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.828144 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p9s7k\" (UniqueName: \"kubernetes.io/projected/f0778bb1-d136-493d-8628-7836f4dcb341-kube-api-access-p9s7k\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.828201 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.828215 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.845103 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "f0778bb1-d136-493d-8628-7836f4dcb341" (UID: "f0778bb1-d136-493d-8628-7836f4dcb341"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.930385 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/f0778bb1-d136-493d-8628-7836f4dcb341-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.981583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"997ee964-de30-4b1b-b360-a31378e9a928","Type":"ContainerStarted","Data":"96a303aa15155229cf130a82c16bcfb0538f8f8c12939a45a9e393309f450584"} Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.981816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"997ee964-de30-4b1b-b360-a31378e9a928","Type":"ContainerStarted","Data":"00d6102d4abb045db2facb715c86e75cbcd2e801918144412da17a2c8e417105"} Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.981830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"997ee964-de30-4b1b-b360-a31378e9a928","Type":"ContainerStarted","Data":"de163a8801a0f78408650bdafa7bef423f7263b563dd58f1225e9ec198d94d73"} Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.982868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"87e1294e-e6ee-46df-ab5b-9be0e1d34fce","Type":"ContainerStarted","Data":"825fde2ca35f95e01a5c9436725847015102c06aba8e5dd857197d11e8d414ef"} Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.982887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"87e1294e-e6ee-46df-ab5b-9be0e1d34fce","Type":"ContainerStarted","Data":"be007bb72efc89e59a76c05ac55638b4a65dac9c75d8f6a0053f9e0834a25238"} Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.982896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"87e1294e-e6ee-46df-ab5b-9be0e1d34fce","Type":"ContainerStarted","Data":"ba8d8c1338b8723829427d8424e4b68a66f1c7e7d06213d090aad126381cb53c"} Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.985326 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0778bb1-d136-493d-8628-7836f4dcb341" containerID="7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6" exitCode=137 Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.985341 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.985583 4769 scope.go:117] "RemoveContainer" containerID="7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6" Nov 21 12:52:56 crc kubenswrapper[4769]: I1121 12:52:56.985807 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.007149 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="f0778bb1-d136-493d-8628-7836f4dcb341" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.010157 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.010146356 podStartE2EDuration="2.010146356s" podCreationTimestamp="2025-11-21 12:52:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:57.003711241 +0000 UTC m=+3735.704373059" watchObservedRunningTime="2025-11-21 12:52:57.010146356 +0000 UTC m=+3735.710808174" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.018306 4769 scope.go:117] "RemoveContainer" containerID="7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6" Nov 21 12:52:57 crc kubenswrapper[4769]: E1121 12:52:57.018768 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6\": container with ID starting with 7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6 not found: ID does not exist" containerID="7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.018800 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6"} err="failed to get container status \"7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6\": rpc error: code = NotFound desc = could not find container \"7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6\": container with ID starting with 7ac91a275cfb1945868f76762785001f851b4b85158f1476ec2e37044f6577a6 not found: ID does not exist" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.042419 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.042396703 podStartE2EDuration="2.042396703s" podCreationTimestamp="2025-11-21 12:52:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:57.036592985 +0000 UTC m=+3735.737254803" watchObservedRunningTime="2025-11-21 12:52:57.042396703 +0000 UTC m=+3735.743058531" Nov 21 12:52:57 crc kubenswrapper[4769]: W1121 12:52:57.056322 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a788ac5_aa39_45cc_b04f_3b8e0e819ef7.slice/crio-7b41b2b87b91f33453e8c0cedb31174b3cb418d56ec68bee949d69d37d9b1090 WatchSource:0}: Error finding container 7b41b2b87b91f33453e8c0cedb31174b3cb418d56ec68bee949d69d37d9b1090: Status 404 returned error can't find the container with id 7b41b2b87b91f33453e8c0cedb31174b3cb418d56ec68bee949d69d37d9b1090 Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.057956 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.199915 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.285161 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e0f7145-48ec-4e3a-a163-2c2a293c7a9c" path="/var/lib/kubelet/pods/2e0f7145-48ec-4e3a-a163-2c2a293c7a9c/volumes" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.285922 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd529a0c-32c3-48c4-b835-f0ac206ec2d9" path="/var/lib/kubelet/pods/cd529a0c-32c3-48c4-b835-f0ac206ec2d9/volumes" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.286505 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0778bb1-d136-493d-8628-7836f4dcb341" path="/var/lib/kubelet/pods/f0778bb1-d136-493d-8628-7836f4dcb341/volumes" Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.998391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7","Type":"ContainerStarted","Data":"6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d"} Nov 21 12:52:57 crc kubenswrapper[4769]: I1121 12:52:57.998447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7","Type":"ContainerStarted","Data":"7b41b2b87b91f33453e8c0cedb31174b3cb418d56ec68bee949d69d37d9b1090"} Nov 21 12:52:58 crc kubenswrapper[4769]: I1121 12:52:58.023152 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.023135063 podStartE2EDuration="2.023135063s" podCreationTimestamp="2025-11-21 12:52:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:52:58.017802378 +0000 UTC m=+3736.718464196" watchObservedRunningTime="2025-11-21 12:52:58.023135063 +0000 UTC m=+3736.723796871" Nov 21 12:53:00 crc kubenswrapper[4769]: I1121 12:53:00.474541 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:00 crc kubenswrapper[4769]: I1121 12:53:00.476293 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:01 crc kubenswrapper[4769]: I1121 12:53:01.551237 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:53:02 crc kubenswrapper[4769]: I1121 12:53:02.457608 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:53:03 crc kubenswrapper[4769]: I1121 12:53:03.966514 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:53:03 crc kubenswrapper[4769]: I1121 12:53:03.968781 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:53:04 crc kubenswrapper[4769]: I1121 12:53:04.121593 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4"] Nov 21 12:53:04 crc kubenswrapper[4769]: I1121 12:53:04.121931 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-httpd" containerID="cri-o://e443bde35cc5c72a9d863814eea6feb91d2e9e7e0af2b2bb509ab3d14afe8b01" gracePeriod=30 Nov 21 12:53:04 crc kubenswrapper[4769]: I1121 12:53:04.122099 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-server" containerID="cri-o://bef5aac01593326ea08b3a1560628380143c94bfdad8949356e08ca13749ec81" gracePeriod=30 Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.100175 4769 generic.go:334] "Generic (PLEG): container finished" podID="263ef7b9-093f-464d-96b8-515171a2d93c" containerID="bef5aac01593326ea08b3a1560628380143c94bfdad8949356e08ca13749ec81" exitCode=0 Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.100465 4769 generic.go:334] "Generic (PLEG): container finished" podID="263ef7b9-093f-464d-96b8-515171a2d93c" containerID="e443bde35cc5c72a9d863814eea6feb91d2e9e7e0af2b2bb509ab3d14afe8b01" exitCode=0 Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.100246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" event={"ID":"263ef7b9-093f-464d-96b8-515171a2d93c","Type":"ContainerDied","Data":"bef5aac01593326ea08b3a1560628380143c94bfdad8949356e08ca13749ec81"} Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.100509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" event={"ID":"263ef7b9-093f-464d-96b8-515171a2d93c","Type":"ContainerDied","Data":"e443bde35cc5c72a9d863814eea6feb91d2e9e7e0af2b2bb509ab3d14afe8b01"} Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.224445 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.321740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-etc-swift\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.321791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-internal-tls-certs\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.321896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx9m9\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-kube-api-access-xx9m9\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.321969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-config-data\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.322031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-public-tls-certs\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.322069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-run-httpd\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.322128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-combined-ca-bundle\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.322208 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-log-httpd\") pod \"263ef7b9-093f-464d-96b8-515171a2d93c\" (UID: \"263ef7b9-093f-464d-96b8-515171a2d93c\") " Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.324623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.328557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.332426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-kube-api-access-xx9m9" (OuterVolumeSpecName: "kube-api-access-xx9m9") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "kube-api-access-xx9m9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.348677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.381979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-config-data" (OuterVolumeSpecName: "config-data") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.385988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.387409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.394703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "263ef7b9-093f-464d-96b8-515171a2d93c" (UID: "263ef7b9-093f-464d-96b8-515171a2d93c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423821 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423849 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423860 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xx9m9\" (UniqueName: \"kubernetes.io/projected/263ef7b9-093f-464d-96b8-515171a2d93c-kube-api-access-xx9m9\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423870 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423879 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423888 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423896 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/263ef7b9-093f-464d-96b8-515171a2d93c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.423903 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/263ef7b9-093f-464d-96b8-515171a2d93c-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.471962 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.472013 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.474868 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:05 crc kubenswrapper[4769]: I1121 12:53:05.474955 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.114300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" event={"ID":"263ef7b9-093f-464d-96b8-515171a2d93c","Type":"ContainerDied","Data":"b792da0f6383416d5d9cdc5c94a908c852125ae88b2215f5e4590462d961fc70"} Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.114369 4769 scope.go:117] "RemoveContainer" containerID="bef5aac01593326ea08b3a1560628380143c94bfdad8949356e08ca13749ec81" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.114375 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.151786 4769 scope.go:117] "RemoveContainer" containerID="e443bde35cc5c72a9d863814eea6feb91d2e9e7e0af2b2bb509ab3d14afe8b01" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.183172 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4"] Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.191824 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66667fb49-bqwl4"] Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.484322 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.192:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.484628 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.192:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.495286 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.193:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.495334 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.193:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.550811 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:53:06 crc kubenswrapper[4769]: I1121 12:53:06.592019 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:53:07 crc kubenswrapper[4769]: I1121 12:53:07.164717 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:53:07 crc kubenswrapper[4769]: I1121 12:53:07.294587 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" path="/var/lib/kubelet/pods/263ef7b9-093f-464d-96b8-515171a2d93c/volumes" Nov 21 12:53:11 crc kubenswrapper[4769]: I1121 12:53:11.325891 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 12:53:11 crc kubenswrapper[4769]: I1121 12:53:11.326793 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 12:53:11 crc kubenswrapper[4769]: I1121 12:53:11.326873 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 12:53:11 crc kubenswrapper[4769]: I1121 12:53:11.327819 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 12:53:11 crc kubenswrapper[4769]: I1121 12:53:11.327929 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" gracePeriod=600 Nov 21 12:53:11 crc kubenswrapper[4769]: E1121 12:53:11.457389 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:53:12 crc kubenswrapper[4769]: I1121 12:53:12.195633 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" exitCode=0 Nov 21 12:53:12 crc kubenswrapper[4769]: I1121 12:53:12.195703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d"} Nov 21 12:53:12 crc kubenswrapper[4769]: I1121 12:53:12.195752 4769 scope.go:117] "RemoveContainer" containerID="6450126284f2853982969dd408b7da0c051c6c8c0e976974a4cad5517598b69f" Nov 21 12:53:12 crc kubenswrapper[4769]: I1121 12:53:12.196768 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:53:12 crc kubenswrapper[4769]: E1121 12:53:12.197255 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.482547 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.487979 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.488830 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.489015 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.490409 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.491936 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:15 crc kubenswrapper[4769]: I1121 12:53:15.500491 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:16 crc kubenswrapper[4769]: I1121 12:53:16.250402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:16 crc kubenswrapper[4769]: I1121 12:53:16.258518 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:16 crc kubenswrapper[4769]: I1121 12:53:16.259629 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.470554 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.506901 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.507108 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" containerName="openstackclient" containerID="cri-o://d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2" gracePeriod=2 Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.529886 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:53:18 crc kubenswrapper[4769]: E1121 12:53:18.631628 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:18 crc kubenswrapper[4769]: E1121 12:53:18.631692 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data podName:8a91e2b2-acf3-4556-9adb-d6ce7a0dd705 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:19.131673099 +0000 UTC m=+3757.832334907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data") pod "rabbitmq-cell1-server-0" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.640904 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-g8sst"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.685345 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-g8sst"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.762397 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-px7d7"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.771054 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-px7d7"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.799574 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-5ml5l"] Nov 21 12:53:18 crc kubenswrapper[4769]: E1121 12:53:18.800062 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-server" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.800074 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-server" Nov 21 12:53:18 crc kubenswrapper[4769]: E1121 12:53:18.800089 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" containerName="openstackclient" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.800095 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" containerName="openstackclient" Nov 21 12:53:18 crc kubenswrapper[4769]: E1121 12:53:18.800108 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-httpd" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.800115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-httpd" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.800392 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-httpd" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.800408 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" containerName="openstackclient" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.800419 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="263ef7b9-093f-464d-96b8-515171a2d93c" containerName="proxy-server" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.801071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.802999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.817747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-5ml5l"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.850348 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-5xjxs"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.877414 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-5xjxs"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.906249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-1f1d-account-create-grcs2"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.945877 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-1f1d-account-create-grcs2"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.953848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l7dg\" (UniqueName: \"kubernetes.io/projected/2104c14c-16c5-4732-951f-dbde5da48b75-kube-api-access-9l7dg\") pod \"cinder-0e56-account-create-5ml5l\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.954007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2104c14c-16c5-4732-951f-dbde5da48b75-operator-scripts\") pod \"cinder-0e56-account-create-5ml5l\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.961857 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.962455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="openstack-network-exporter" containerID="cri-o://29439527e32feb6edd091bf61a16faf87a7bea56a0f67603d5926070cae7ea09" gracePeriod=300 Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.983428 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4"] Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.984979 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:18 crc kubenswrapper[4769]: I1121 12:53:18.995278 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.015582 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5148-account-create-lq5hp"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.030048 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5148-account-create-lq5hp"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.044076 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.044853 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="openstack-network-exporter" containerID="cri-o://8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a" gracePeriod=300 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.057560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9l7dg\" (UniqueName: \"kubernetes.io/projected/2104c14c-16c5-4732-951f-dbde5da48b75-kube-api-access-9l7dg\") pod \"cinder-0e56-account-create-5ml5l\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.057698 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2104c14c-16c5-4732-951f-dbde5da48b75-operator-scripts\") pod \"cinder-0e56-account-create-5ml5l\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.058690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2104c14c-16c5-4732-951f-dbde5da48b75-operator-scripts\") pod \"cinder-0e56-account-create-5ml5l\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.060120 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p4rps"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.070522 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-wvb9n"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.089057 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p4rps"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.105481 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-wvb9n"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.108836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l7dg\" (UniqueName: \"kubernetes.io/projected/2104c14c-16c5-4732-951f-dbde5da48b75-kube-api-access-9l7dg\") pod \"cinder-0e56-account-create-5ml5l\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.125591 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement5148-account-delete-tmw49"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.126955 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.141830 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.148154 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-d5w65"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.159348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e8a67f8-1ea8-401e-8f61-66db57f69b22-operator-scripts\") pod \"barbican1f1d-account-delete-v2mp4\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.159391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvd9v\" (UniqueName: \"kubernetes.io/projected/5e8a67f8-1ea8-401e-8f61-66db57f69b22-kube-api-access-bvd9v\") pod \"barbican1f1d-account-delete-v2mp4\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: E1121 12:53:19.159582 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:19 crc kubenswrapper[4769]: E1121 12:53:19.159624 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data podName:8a91e2b2-acf3-4556-9adb-d6ce7a0dd705 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:20.159611057 +0000 UTC m=+3758.860272875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data") pod "rabbitmq-cell1-server-0" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.161474 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-d5w65"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.183785 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-033b-account-create-482ff"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.191962 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement5148-account-delete-tmw49"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.197527 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="ovsdbserver-nb" containerID="cri-o://9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027" gracePeriod=300 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.215159 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-033b-account-create-482ff"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.234842 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s2t92"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.262734 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="ovsdbserver-sb" containerID="cri-o://696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4" gracePeriod=300 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.262852 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-s2t92"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.263786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktxww\" (UniqueName: \"kubernetes.io/projected/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-kube-api-access-ktxww\") pod \"placement5148-account-delete-tmw49\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.263851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e8a67f8-1ea8-401e-8f61-66db57f69b22-operator-scripts\") pod \"barbican1f1d-account-delete-v2mp4\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.263873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bvd9v\" (UniqueName: \"kubernetes.io/projected/5e8a67f8-1ea8-401e-8f61-66db57f69b22-kube-api-access-bvd9v\") pod \"barbican1f1d-account-delete-v2mp4\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.263929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-operator-scripts\") pod \"placement5148-account-delete-tmw49\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.264692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e8a67f8-1ea8-401e-8f61-66db57f69b22-operator-scripts\") pod \"barbican1f1d-account-delete-v2mp4\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.303771 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170d353a-c12f-4e7a-b173-37444306e05e" path="/var/lib/kubelet/pods/170d353a-c12f-4e7a-b173-37444306e05e/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.305771 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="235b264a-c7e8-465d-a791-b01776cb8e77" path="/var/lib/kubelet/pods/235b264a-c7e8-465d-a791-b01776cb8e77/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.306489 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2" path="/var/lib/kubelet/pods/3d8a4433-faf4-4fc3-b6d9-6571fa54dcf2/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.308950 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a15364d-dc05-4a50-a1c4-473f7393eff7" path="/var/lib/kubelet/pods/4a15364d-dc05-4a50-a1c4-473f7393eff7/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.309641 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f69cef9-9def-4679-81e4-95d61cdc8135" path="/var/lib/kubelet/pods/7f69cef9-9def-4679-81e4-95d61cdc8135/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.310352 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946c079a-b406-4924-a4de-cce549b51be1" path="/var/lib/kubelet/pods/946c079a-b406-4924-a4de-cce549b51be1/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.320009 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8fb94e-bf69-434a-b0d1-60bd7129eec1" path="/var/lib/kubelet/pods/9c8fb94e-bf69-434a-b0d1-60bd7129eec1/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.322519 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98251c5-0166-4aae-8fb0-9bdc52b45c26" path="/var/lib/kubelet/pods/c98251c5-0166-4aae-8fb0-9bdc52b45c26/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.323276 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcebadd9-e29b-494a-9578-1fc3312e728c" path="/var/lib/kubelet/pods/dcebadd9-e29b-494a-9578-1fc3312e728c/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.325278 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f77e1839-a878-4f8b-95b8-50f268ba8902" path="/var/lib/kubelet/pods/f77e1839-a878-4f8b-95b8-50f268ba8902/volumes" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.328879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvd9v\" (UniqueName: \"kubernetes.io/projected/5e8a67f8-1ea8-401e-8f61-66db57f69b22-kube-api-access-bvd9v\") pod \"barbican1f1d-account-delete-v2mp4\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.339281 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.339377 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder0e56-account-delete-d4flh"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.340985 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.344621 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder0e56-account-delete-d4flh"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.366845 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-operator-scripts\") pod \"placement5148-account-delete-tmw49\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.366969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ktxww\" (UniqueName: \"kubernetes.io/projected/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-kube-api-access-ktxww\") pod \"placement5148-account-delete-tmw49\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.367618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-operator-scripts\") pod \"placement5148-account-delete-tmw49\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.370100 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-9kpql"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.372063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.385094 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.400624 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="ovn-northd" containerID="cri-o://996cafc79b4404d5f72292d70273e4a9b3a218fbef0e41bea7d031337fc2bf24" gracePeriod=30 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.400877 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="openstack-network-exporter" containerID="cri-o://4696efcf5040808f1bdb82b9cdd33479ac7655978b307af206a4b0f0ce6957f7" gracePeriod=30 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.404597 4769 generic.go:334] "Generic (PLEG): container finished" podID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerID="29439527e32feb6edd091bf61a16faf87a7bea56a0f67603d5926070cae7ea09" exitCode=2 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.404704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3669f04-8d90-4122-a048-12ac1cfc271e","Type":"ContainerDied","Data":"29439527e32feb6edd091bf61a16faf87a7bea56a0f67603d5926070cae7ea09"} Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.484103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a356cff0-bccc-49fc-a3c1-21cdcf16f714-operator-scripts\") pod \"nova-api-db-create-9kpql\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.484442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqsvz\" (UniqueName: \"kubernetes.io/projected/a356cff0-bccc-49fc-a3c1-21cdcf16f714-kube-api-access-fqsvz\") pod \"nova-api-db-create-9kpql\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.484579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38af882b-baa9-4fff-bb77-941070a30942-operator-scripts\") pod \"cinder0e56-account-delete-d4flh\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.484613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kllkx\" (UniqueName: \"kubernetes.io/projected/38af882b-baa9-4fff-bb77-941070a30942-kube-api-access-kllkx\") pod \"cinder0e56-account-delete-d4flh\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: E1121 12:53:19.485897 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:53:19 crc kubenswrapper[4769]: E1121 12:53:19.486153 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data podName:e15176d9-214d-4f78-bb65-122a9db292d9 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:19.986135601 +0000 UTC m=+3758.686797409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data") pod "rabbitmq-server-0" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9") : configmap "rabbitmq-config-data" not found Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.507097 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_33ea1c8a-5107-4dc7-971b-6b8ad8230124/ovsdbserver-sb/0.log" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.507171 4769 generic.go:334] "Generic (PLEG): container finished" podID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerID="8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a" exitCode=2 Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.507226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"33ea1c8a-5107-4dc7-971b-6b8ad8230124","Type":"ContainerDied","Data":"8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a"} Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.522627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktxww\" (UniqueName: \"kubernetes.io/projected/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-kube-api-access-ktxww\") pod \"placement5148-account-delete-tmw49\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.578008 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-9kpql"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.589602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38af882b-baa9-4fff-bb77-941070a30942-operator-scripts\") pod \"cinder0e56-account-delete-d4flh\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.589677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kllkx\" (UniqueName: \"kubernetes.io/projected/38af882b-baa9-4fff-bb77-941070a30942-kube-api-access-kllkx\") pod \"cinder0e56-account-delete-d4flh\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.589904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a356cff0-bccc-49fc-a3c1-21cdcf16f714-operator-scripts\") pod \"nova-api-db-create-9kpql\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.589949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fqsvz\" (UniqueName: \"kubernetes.io/projected/a356cff0-bccc-49fc-a3c1-21cdcf16f714-kube-api-access-fqsvz\") pod \"nova-api-db-create-9kpql\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.590615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38af882b-baa9-4fff-bb77-941070a30942-operator-scripts\") pod \"cinder0e56-account-delete-d4flh\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.610886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a356cff0-bccc-49fc-a3c1-21cdcf16f714-operator-scripts\") pod \"nova-api-db-create-9kpql\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.619635 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.632123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqsvz\" (UniqueName: \"kubernetes.io/projected/a356cff0-bccc-49fc-a3c1-21cdcf16f714-kube-api-access-fqsvz\") pod \"nova-api-db-create-9kpql\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.656722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kllkx\" (UniqueName: \"kubernetes.io/projected/38af882b-baa9-4fff-bb77-941070a30942-kube-api-access-kllkx\") pod \"cinder0e56-account-delete-d4flh\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.669363 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-hn7gb"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.704556 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-hn7gb"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.712065 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.717603 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-b4xl4"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.740808 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.741369 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-b4xl4"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.753452 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron033b-account-delete-cvrd4"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.754919 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.762933 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-8z8jj"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.777693 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-8z8jj"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.800634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.808128 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron033b-account-delete-cvrd4"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.827115 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-5kmlk"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.833615 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-5kmlk"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.851678 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-0893-account-create-nsdxt"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.863974 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-0893-account-create-nsdxt"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.872258 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance0893-account-delete-tlgw8"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.873651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.882064 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance0893-account-delete-tlgw8"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.898955 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi46ff-account-delete-gp48v"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.900410 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.900505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdq2\" (UniqueName: \"kubernetes.io/projected/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-kube-api-access-2cdq2\") pod \"neutron033b-account-delete-cvrd4\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.900588 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-operator-scripts\") pod \"neutron033b-account-delete-cvrd4\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.912016 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-qwpbd"] Nov 21 12:53:19 crc kubenswrapper[4769]: I1121 12:53:19.936339 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi46ff-account-delete-gp48v"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.003135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdq2\" (UniqueName: \"kubernetes.io/projected/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-kube-api-access-2cdq2\") pod \"neutron033b-account-delete-cvrd4\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.003457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/057ccf26-b606-4673-9512-c2f4df0b137e-operator-scripts\") pod \"novaapi46ff-account-delete-gp48v\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.003508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-operator-scripts\") pod \"neutron033b-account-delete-cvrd4\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.003558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvmd9\" (UniqueName: \"kubernetes.io/projected/2b6e8af9-6035-4a4a-9589-caaea3cab523-kube-api-access-zvmd9\") pod \"glance0893-account-delete-tlgw8\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.003579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b6e8af9-6035-4a4a-9589-caaea3cab523-operator-scripts\") pod \"glance0893-account-delete-tlgw8\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.003621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxqdd\" (UniqueName: \"kubernetes.io/projected/057ccf26-b606-4673-9512-c2f4df0b137e-kube-api-access-dxqdd\") pod \"novaapi46ff-account-delete-gp48v\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.003751 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.003801 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data podName:e15176d9-214d-4f78-bb65-122a9db292d9 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:21.003780653 +0000 UTC m=+3759.704442471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data") pod "rabbitmq-server-0" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9") : configmap "rabbitmq-config-data" not found Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.004863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-operator-scripts\") pod \"neutron033b-account-delete-cvrd4\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.015151 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-qwpbd"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.030606 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75gt6"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.031375 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdq2\" (UniqueName: \"kubernetes.io/projected/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-kube-api-access-2cdq2\") pod \"neutron033b-account-delete-cvrd4\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.050867 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75gt6"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.072620 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.073061 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="probe" containerID="cri-o://220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.073006 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="cinder-scheduler" containerID="cri-o://e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.084978 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.094735 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-46ff-account-create-g9zp6"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.105680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/057ccf26-b606-4673-9512-c2f4df0b137e-operator-scripts\") pod \"novaapi46ff-account-delete-gp48v\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.105781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zvmd9\" (UniqueName: \"kubernetes.io/projected/2b6e8af9-6035-4a4a-9589-caaea3cab523-kube-api-access-zvmd9\") pod \"glance0893-account-delete-tlgw8\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.105803 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b6e8af9-6035-4a4a-9589-caaea3cab523-operator-scripts\") pod \"glance0893-account-delete-tlgw8\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.105841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dxqdd\" (UniqueName: \"kubernetes.io/projected/057ccf26-b606-4673-9512-c2f4df0b137e-kube-api-access-dxqdd\") pod \"novaapi46ff-account-delete-gp48v\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.106636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/057ccf26-b606-4673-9512-c2f4df0b137e-operator-scripts\") pod \"novaapi46ff-account-delete-gp48v\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.107284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b6e8af9-6035-4a4a-9589-caaea3cab523-operator-scripts\") pod \"glance0893-account-delete-tlgw8\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.129299 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7h698"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.134806 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.136150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxqdd\" (UniqueName: \"kubernetes.io/projected/057ccf26-b606-4673-9512-c2f4df0b137e-kube-api-access-dxqdd\") pod \"novaapi46ff-account-delete-gp48v\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.153316 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-7h698"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.158580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvmd9\" (UniqueName: \"kubernetes.io/projected/2b6e8af9-6035-4a4a-9589-caaea3cab523-kube-api-access-zvmd9\") pod \"glance0893-account-delete-tlgw8\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.165626 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.166179 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api-log" containerID="cri-o://51d2cd1befc7ba8b80348cc0ae0e4f598d71f1399c70839c9da3c1c8db09e3cf" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.166408 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api" containerID="cri-o://c29954e20406b7668feafcdcb73866b526c3a9ddc7ee19889092e3d9d47c2b3a" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.198406 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-9ns8w"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.208917 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-9ns8w"] Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.210769 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.210855 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data podName:8a91e2b2-acf3-4556-9adb-d6ce7a0dd705 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:22.210818939 +0000 UTC m=+3760.911480757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data") pod "rabbitmq-cell1-server-0" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.245970 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7bc74f485b-vm922"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.246363 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-log" containerID="cri-o://233d86a221cce409fc188ed5baf739da4d887d23344238d4e622e1db444734f8" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.247017 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-api" containerID="cri-o://4665ffb220f125aa21d913c977f50ba2763596793870e0ac1a0b0e1778d8e6ef" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.260558 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell07510-account-delete-r64n4"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.263030 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.270691 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.285839 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027 is running failed: container process not found" containerID="9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.287217 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027 is running failed: container process not found" containerID="9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.292283 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell07510-account-delete-r64n4"] Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.305883 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027 is running failed: container process not found" containerID="9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.305946 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="ovsdbserver-nb" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.313801 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.326778 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-5f64-account-create-c7xxj"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.333416 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.333871 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-server" containerID="cri-o://1ccc56951cf265eacc5d84661707717cfd5870ebadfbbeb8597e00cb3d93fa11" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334263 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="swift-recon-cron" containerID="cri-o://257dab1ffc061cbb231971f188cc3a64f672f447b3c3ab3367d25f7688ac3f1c" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334304 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="rsync" containerID="cri-o://d954ec9f9fd375f8d21fbfc90930cf9f0e851e88125432c9f19c141bda5ec67e" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334334 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-expirer" containerID="cri-o://547b91c62af6867a861c1e2fbf267059684c898f2fcb3366746713087f93e5be" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334365 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-updater" containerID="cri-o://25a745b27d2c48104dfccc1ab9c9b443ce48a7712cdbd4f77cd19d5c615eaf78" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334391 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-auditor" containerID="cri-o://b18fcced732571fdaf74bcc2322b16cde636569d18694efad32ecf13a5b6157d" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334417 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-replicator" containerID="cri-o://bc1d08820888a328fae748ef4812e194104e9bb4a7454e3a39e99c3c3223bd80" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334449 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-server" containerID="cri-o://23d3165d82d9747d4ed22655a6d81d291fe94942a2c349dff1450546b509c275" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334480 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-updater" containerID="cri-o://bedcad83e4334c7e83ddc8624d4e1318bb1a57e1e4708e86d301f18e2add935c" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334508 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-auditor" containerID="cri-o://e26086b4183e76bc744b11509cca5bb4aef9eb6f6890bc99c8112654d2f4d82a" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334547 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-replicator" containerID="cri-o://f745168b4e9bc49314d46d470a8a6b9d97a7ca1e17567933b5c8223545d657d5" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334573 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-server" containerID="cri-o://9ffdf07b6ca311a612fe435c9d96f794f755c1b06d7c976066d7a9854520d7fd" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334601 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-reaper" containerID="cri-o://fb3bb295c52508ab61ed6d4059c32909e643abc0d7b8c00eb3502e829c3783f7" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334628 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-auditor" containerID="cri-o://32ca7892fd1380c714d6d0afeaa3000431822f1ee42afd0c21cf0741874b1826" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.334654 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-replicator" containerID="cri-o://21820468085f3cf013463501cb4db298d3fc627940f0c92b3f08219872331bee" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.345788 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.353393 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-f658g"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.379908 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-f658g"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.435246 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_33ea1c8a-5107-4dc7-971b-6b8ad8230124/ovsdbserver-sb/0.log" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.453820 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.478833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-metrics-certs-tls-certs\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.478896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-scripts\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.478934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.478961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g5pk\" (UniqueName: \"kubernetes.io/projected/33ea1c8a-5107-4dc7-971b-6b8ad8230124-kube-api-access-9g5pk\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.478989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdb-rundir\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.479020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-config\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.479048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdbserver-sb-tls-certs\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.479075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-combined-ca-bundle\") pod \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\" (UID: \"33ea1c8a-5107-4dc7-971b-6b8ad8230124\") " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.481310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-config" (OuterVolumeSpecName: "config") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.489020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.490542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64qx\" (UniqueName: \"kubernetes.io/projected/58c422da-2667-4d11-b5b5-115706d66b58-kube-api-access-p64qx\") pod \"novacell07510-account-delete-r64n4\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.490988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58c422da-2667-4d11-b5b5-115706d66b58-operator-scripts\") pod \"novacell07510-account-delete-r64n4\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.491170 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.491203 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.517718 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-scripts" (OuterVolumeSpecName: "scripts") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.533347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ea1c8a-5107-4dc7-971b-6b8ad8230124-kube-api-access-9g5pk" (OuterVolumeSpecName: "kube-api-access-9g5pk") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "kube-api-access-9g5pk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.651350 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_e5513101-8910-4a2f-ac1e-734789ae3199/ovn-northd/0.log" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.651398 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5513101-8910-4a2f-ac1e-734789ae3199" containerID="4696efcf5040808f1bdb82b9cdd33479ac7655978b307af206a4b0f0ce6957f7" exitCode=2 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.651415 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5513101-8910-4a2f-ac1e-734789ae3199" containerID="996cafc79b4404d5f72292d70273e4a9b3a218fbef0e41bea7d031337fc2bf24" exitCode=143 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.651515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"e5513101-8910-4a2f-ac1e-734789ae3199","Type":"ContainerDied","Data":"4696efcf5040808f1bdb82b9cdd33479ac7655978b307af206a4b0f0ce6957f7"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.651545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"e5513101-8910-4a2f-ac1e-734789ae3199","Type":"ContainerDied","Data":"996cafc79b4404d5f72292d70273e4a9b3a218fbef0e41bea7d031337fc2bf24"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.653367 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v"] Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.658310 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="ovsdbserver-sb" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.658333 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="ovsdbserver-sb" Nov 21 12:53:20 crc kubenswrapper[4769]: E1121 12:53:20.658362 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="openstack-network-exporter" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.658369 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="openstack-network-exporter" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.676795 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="openstack-network-exporter" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.677291 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerName="ovsdbserver-sb" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.680295 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.702105 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-7510-account-create-pb586"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.706923 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.706960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.721249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.724036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p64qx\" (UniqueName: \"kubernetes.io/projected/58c422da-2667-4d11-b5b5-115706d66b58-kube-api-access-p64qx\") pod \"novacell07510-account-delete-r64n4\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.745368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58c422da-2667-4d11-b5b5-115706d66b58-operator-scripts\") pod \"novacell07510-account-delete-r64n4\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.745538 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.745559 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/33ea1c8a-5107-4dc7-971b-6b8ad8230124-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.745582 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.745593 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9g5pk\" (UniqueName: \"kubernetes.io/projected/33ea1c8a-5107-4dc7-971b-6b8ad8230124-kube-api-access-9g5pk\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.774618 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.774821 4769 generic.go:334] "Generic (PLEG): container finished" podID="e83044ec-e522-4705-baac-c8344c6bf994" containerID="233d86a221cce409fc188ed5baf739da4d887d23344238d4e622e1db444734f8" exitCode=143 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.774895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" event={"ID":"e83044ec-e522-4705-baac-c8344c6bf994","Type":"ContainerDied","Data":"233d86a221cce409fc188ed5baf739da4d887d23344238d4e622e1db444734f8"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.787793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58c422da-2667-4d11-b5b5-115706d66b58-operator-scripts\") pod \"novacell07510-account-delete-r64n4\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.800359 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64qx\" (UniqueName: \"kubernetes.io/projected/58c422da-2667-4d11-b5b5-115706d66b58-kube-api-access-p64qx\") pod \"novacell07510-account-delete-r64n4\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.803549 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_33ea1c8a-5107-4dc7-971b-6b8ad8230124/ovsdbserver-sb/0.log" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.803594 4769 generic.go:334] "Generic (PLEG): container finished" podID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" containerID="696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4" exitCode=143 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.803646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"33ea1c8a-5107-4dc7-971b-6b8ad8230124","Type":"ContainerDied","Data":"696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.803675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"33ea1c8a-5107-4dc7-971b-6b8ad8230124","Type":"ContainerDied","Data":"c65eb9c76c1f8a5257845ae06566429e11a6feea7540ac519a5e749d0d402adc"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.803692 4769 scope.go:117] "RemoveContainer" containerID="8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.803827 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.836312 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-hmxnd"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.842368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.848085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f25b4\" (UniqueName: \"kubernetes.io/projected/13de8ad4-38e7-432c-8502-dbbcc423f446-kube-api-access-f25b4\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.848130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.848241 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.848306 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.883542 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="bc1d08820888a328fae748ef4812e194104e9bb4a7454e3a39e99c3c3223bd80" exitCode=0 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.883574 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="e26086b4183e76bc744b11509cca5bb4aef9eb6f6890bc99c8112654d2f4d82a" exitCode=0 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.883646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"bc1d08820888a328fae748ef4812e194104e9bb4a7454e3a39e99c3c3223bd80"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.883693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"e26086b4183e76bc744b11509cca5bb4aef9eb6f6890bc99c8112654d2f4d82a"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.900681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.916254 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-7510-account-create-pb586"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.919402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "33ea1c8a-5107-4dc7-971b-6b8ad8230124" (UID: "33ea1c8a-5107-4dc7-971b-6b8ad8230124"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.931778 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b3669f04-8d90-4122-a048-12ac1cfc271e/ovsdbserver-nb/0.log" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.931828 4769 generic.go:334] "Generic (PLEG): container finished" podID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerID="9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027" exitCode=143 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.932021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3669f04-8d90-4122-a048-12ac1cfc271e","Type":"ContainerDied","Data":"9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.935434 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.951395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.951532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.951803 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f25b4\" (UniqueName: \"kubernetes.io/projected/13de8ad4-38e7-432c-8502-dbbcc423f446-kube-api-access-f25b4\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.951862 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.951873 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/33ea1c8a-5107-4dc7-971b-6b8ad8230124-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.955969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.956875 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerID="51d2cd1befc7ba8b80348cc0ae0e4f598d71f1399c70839c9da3c1c8db09e3cf" exitCode=143 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.956920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84","Type":"ContainerDied","Data":"51d2cd1befc7ba8b80348cc0ae0e4f598d71f1399c70839c9da3c1c8db09e3cf"} Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.958036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.970619 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_e5513101-8910-4a2f-ac1e-734789ae3199/ovn-northd/0.log" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.970720 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.990245 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-cd86bc48d-6ff2l"] Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.990545 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-api" containerID="cri-o://4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec" gracePeriod=30 Nov 21 12:53:20 crc kubenswrapper[4769]: I1121 12:53:20.990689 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-httpd" containerID="cri-o://c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:20.993219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f25b4\" (UniqueName: \"kubernetes.io/projected/13de8ad4-38e7-432c-8502-dbbcc423f446-kube-api-access-f25b4\") pod \"dnsmasq-dnsmasq-84b9f45d47-qxg2v\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-scripts\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-rundir\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-metrics-certs-tls-certs\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-combined-ca-bundle\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-northd-tls-certs\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-config\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.055922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftb8x\" (UniqueName: \"kubernetes.io/projected/e5513101-8910-4a2f-ac1e-734789ae3199-kube-api-access-ftb8x\") pod \"e5513101-8910-4a2f-ac1e-734789ae3199\" (UID: \"e5513101-8910-4a2f-ac1e-734789ae3199\") " Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.056498 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.056548 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data podName:e15176d9-214d-4f78-bb65-122a9db292d9 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:23.056533105 +0000 UTC m=+3761.757194923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data") pod "rabbitmq-server-0" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9") : configmap "rabbitmq-config-data" not found Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.057882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.058228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-scripts" (OuterVolumeSpecName: "scripts") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.058347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-config" (OuterVolumeSpecName: "config") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.066888 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.067929 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.068744 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-httpd" containerID="cri-o://0dd0d895f81dbc07e1ecb36491278731065fbfda83dce77e6c945bd1c681a349" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.069282 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-log" containerID="cri-o://c952ebc5aee8bdba73fde5488859cc033409d0401daf76157f0e137b9e0e411a" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.076550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5513101-8910-4a2f-ac1e-734789ae3199-kube-api-access-ftb8x" (OuterVolumeSpecName: "kube-api-access-ftb8x") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "kube-api-access-ftb8x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.097983 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.098370 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-log" containerID="cri-o://f95591b296f2a5cde1e9e641e145754b0dd77c285d9c10829d97e52eae66fe84" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.098898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-httpd" containerID="cri-o://e262a2e0a42afc1913632e50e4674554d2684b538e9894ce9884fbbc25208ba9" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.106221 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.109727 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.180:9292/healthcheck\": EOF" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.109728 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.180:9292/healthcheck\": EOF" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.110776 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.179:9292/healthcheck\": EOF" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.129687 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b3669f04-8d90-4122-a048-12ac1cfc271e/ovsdbserver-nb/0.log" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.129814 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.130799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.131117 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-log" containerID="cri-o://00d6102d4abb045db2facb715c86e75cbcd2e801918144412da17a2c8e417105" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.131272 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-metadata" containerID="cri-o://96a303aa15155229cf130a82c16bcfb0538f8f8c12939a45a9e393309f450584" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.139816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.148287 4769 scope.go:117] "RemoveContainer" containerID="696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.161673 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-combined-ca-bundle\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.161751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mhbf\" (UniqueName: \"kubernetes.io/projected/b3669f04-8d90-4122-a048-12ac1cfc271e-kube-api-access-7mhbf\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.161806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-scripts\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.161834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.161935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdb-rundir\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.162000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdbserver-nb-tls-certs\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.162017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-metrics-certs-tls-certs\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.162049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-config\") pod \"b3669f04-8d90-4122-a048-12ac1cfc271e\" (UID: \"b3669f04-8d90-4122-a048-12ac1cfc271e\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.165532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-config" (OuterVolumeSpecName: "config") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.168557 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.168790 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-log" containerID="cri-o://be007bb72efc89e59a76c05ac55638b4a65dac9c75d8f6a0053f9e0834a25238" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.168945 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-api" containerID="cri-o://825fde2ca35f95e01a5c9436725847015102c06aba8e5dd857197d11e8d414ef" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.169332 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.169363 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.169535 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.169555 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5513101-8910-4a2f-ac1e-734789ae3199-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.169575 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ftb8x\" (UniqueName: \"kubernetes.io/projected/e5513101-8910-4a2f-ac1e-734789ae3199-kube-api-access-ftb8x\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.169688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-scripts" (OuterVolumeSpecName: "scripts") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.171597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.173320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.175965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3669f04-8d90-4122-a048-12ac1cfc271e-kube-api-access-7mhbf" (OuterVolumeSpecName: "kube-api-access-7mhbf") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "kube-api-access-7mhbf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.201908 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.201965 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.202150 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener-log" containerID="cri-o://45c1f1016f38de589ca1439d89399344dc5345a130823c71eec319c782975170" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.202936 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener" containerID="cri-o://2f2a598af5a736e9cdbff2debd4f3633eda1941244e9836110014879771d9804" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.207547 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.209567 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker" containerID="cri-o://59f1379a9da6bfd5402457cd0d7bd4a5cdfddc543a7003038f3c89a2fc1575e1" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.209675 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker-log" containerID="cri-o://251fe83d372c9a3a1b1f48054e052600a4b5dc7926941deac831b9171dbfa2ae" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.231516 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.231734 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api-log" containerID="cri-o://de406eaf4f5757c6739d9d00407c133d6d94ee5cc3e35eace72932b39b439552" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.232109 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api" containerID="cri-o://87febf2672c90346b1c953c0e954d50a3c3a63e5e87364450e4974a741593acf" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.258508 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.261699 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="rabbitmq" containerID="cri-o://37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca" gracePeriod=604800 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.269858 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.271076 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mhbf\" (UniqueName: \"kubernetes.io/projected/b3669f04-8d90-4122-a048-12ac1cfc271e-kube-api-access-7mhbf\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.271092 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.271111 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.271121 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.271130 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3669f04-8d90-4122-a048-12ac1cfc271e-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.282070 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-gd9hs"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.312756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.331557 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c" path="/var/lib/kubelet/pods/0a6cc6fb-4b1c-4fe4-b5c0-620523f5531c/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.332104 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1dc109-1108-4203-972e-641585fb07dd" path="/var/lib/kubelet/pods/2c1dc109-1108-4203-972e-641585fb07dd/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.339486 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aba5690-4f73-457a-b14d-973f6c1f5395" path="/var/lib/kubelet/pods/3aba5690-4f73-457a-b14d-973f6c1f5395/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.340006 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cfd089a-f033-4eaa-8b56-bc4f6476a9f6" path="/var/lib/kubelet/pods/3cfd089a-f033-4eaa-8b56-bc4f6476a9f6/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.340767 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b34285f-f704-420c-a395-eb7bcdaef6c5" path="/var/lib/kubelet/pods/4b34285f-f704-420c-a395-eb7bcdaef6c5/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.349083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.349256 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="rabbitmq" containerID="cri-o://c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2" gracePeriod=604800 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.350279 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c" path="/var/lib/kubelet/pods/676d3f9e-2cc1-4887-a5d0-e7227d6c4c1c/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.352141 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5" path="/var/lib/kubelet/pods/7cbae4c5-9a57-437f-bfb1-b574dcf2b6b5/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.359116 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ce7265-f42a-41d0-b298-f7eed9fb59e0" path="/var/lib/kubelet/pods/95ce7265-f42a-41d0-b298-f7eed9fb59e0/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.363542 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bcacd3-e87e-48de-91f8-dac91578f597" path="/var/lib/kubelet/pods/a0bcacd3-e87e-48de-91f8-dac91578f597/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.364041 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abcc22af-63ef-46ba-8bc8-e55f3b80de47" path="/var/lib/kubelet/pods/abcc22af-63ef-46ba-8bc8-e55f3b80de47/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.366660 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18665eb-d9cc-4c23-bd26-79c45741fe22" path="/var/lib/kubelet/pods/b18665eb-d9cc-4c23-bd26-79c45741fe22/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.372121 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baab1431-f6a9-46a0-9e49-106d35249cbd" path="/var/lib/kubelet/pods/baab1431-f6a9-46a0-9e49-106d35249cbd/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.372659 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e527d5f6-ee88-49ac-bf24-c584e56e456f" path="/var/lib/kubelet/pods/e527d5f6-ee88-49ac-bf24-c584e56e456f/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.373147 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc090da1-c588-4970-9514-98d3bc33f04b" path="/var/lib/kubelet/pods/fc090da1-c588-4970-9514-98d3bc33f04b/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.374446 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7a83cd-d17a-463f-b2cd-288865bc2f1c" path="/var/lib/kubelet/pods/fe7a83cd-d17a-463f-b2cd-288865bc2f1c/volumes" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.374643 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.380914 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.380948 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.380959 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.412035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.423318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "e5513101-8910-4a2f-ac1e-734789ae3199" (UID: "e5513101-8910-4a2f-ac1e-734789ae3199"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.477668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "b3669f04-8d90-4122-a048-12ac1cfc271e" (UID: "b3669f04-8d90-4122-a048-12ac1cfc271e"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.488749 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5513101-8910-4a2f-ac1e-734789ae3199-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.489136 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.489152 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3669f04-8d90-4122-a048-12ac1cfc271e-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510595 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510654 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510667 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510687 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-96xzf"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510707 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510724 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-5ml5l"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510761 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510786 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510816 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder0e56-account-delete-d4flh"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510829 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement5148-account-delete-tmw49"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510842 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510854 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-9kpql"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.510866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron033b-account-delete-cvrd4"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.511628 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-central-agent" containerID="cri-o://471841b1522d24c8f23a3d9a330a2d294acea07c93a75761a7a56fc8ab69a617" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.513018 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="305f687e-8e30-410c-b78d-6fd4f2d9191a" containerName="nova-cell1-conductor-conductor" containerID="cri-o://833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.513339 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerName="nova-cell0-conductor-conductor" containerID="cri-o://bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.513561 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="7155427b-59ba-48c3-bf11-c34dd9426b6c" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.513784 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerName="nova-scheduler-scheduler" containerID="cri-o://6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.513968 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" containerName="kube-state-metrics" containerID="cri-o://a9eca7120347e4bec827e52ab8d82c6ff74009f03fded58fd632f0e36692392e" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.514249 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="proxy-httpd" containerID="cri-o://0b4a32a7919ab509364cdfc133e358ba7efdcdf58aa7e5177524a7d1c365d050" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.515049 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="sg-core" containerID="cri-o://d375235b460a38fd29e4ec4d7f7911cdc95d3bde1fcd66fc54caf74325bf86be" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.515112 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-notification-agent" containerID="cri-o://d8acee167036c7598559c585c217eef54cf47c0cf77300f652401eb4bd4c9aa6" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.521712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance0893-account-delete-tlgw8"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.543330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.576315 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.609891 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerName="galera" containerID="cri-o://7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb" gracePeriod=30 Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.616607 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.625561 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.630262 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.630352 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerName="nova-scheduler-scheduler" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.643855 4769 scope.go:117] "RemoveContainer" containerID="8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a" Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.648044 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a\": container with ID starting with 8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a not found: ID does not exist" containerID="8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.648087 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a"} err="failed to get container status \"8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a\": rpc error: code = NotFound desc = could not find container \"8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a\": container with ID starting with 8c0fcedef15cfafeceda7bbd9e1f26e2a9b2393e1cbb5a60fbf8a4be4c76d48a not found: ID does not exist" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.648116 4769 scope.go:117] "RemoveContainer" containerID="696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4" Nov 21 12:53:21 crc kubenswrapper[4769]: E1121 12:53:21.648666 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4\": container with ID starting with 696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4 not found: ID does not exist" containerID="696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.648687 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4"} err="failed to get container status \"696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4\": rpc error: code = NotFound desc = could not find container \"696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4\": container with ID starting with 696c5d5c3c6c6b64889b25f28ba6bfbb9c89804b5faa79f1858c711320fdd1e4 not found: ID does not exist" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.720914 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi46ff-account-delete-gp48v"] Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.801923 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.920010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-combined-ca-bundle\") pod \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.920118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs9c4\" (UniqueName: \"kubernetes.io/projected/34ffb6e3-3335-41fe-a8f9-c2366177ab92-kube-api-access-cs9c4\") pod \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.920154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config\") pod \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.920265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config-secret\") pod \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\" (UID: \"34ffb6e3-3335-41fe-a8f9-c2366177ab92\") " Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.948483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ffb6e3-3335-41fe-a8f9-c2366177ab92-kube-api-access-cs9c4" (OuterVolumeSpecName: "kube-api-access-cs9c4") pod "34ffb6e3-3335-41fe-a8f9-c2366177ab92" (UID: "34ffb6e3-3335-41fe-a8f9-c2366177ab92"). InnerVolumeSpecName "kube-api-access-cs9c4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.962374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "34ffb6e3-3335-41fe-a8f9-c2366177ab92" (UID: "34ffb6e3-3335-41fe-a8f9-c2366177ab92"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:21 crc kubenswrapper[4769]: I1121 12:53:21.993525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34ffb6e3-3335-41fe-a8f9-c2366177ab92" (UID: "34ffb6e3-3335-41fe-a8f9-c2366177ab92"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.020476 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerID="251fe83d372c9a3a1b1f48054e052600a4b5dc7926941deac831b9171dbfa2ae" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.020574 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" event={"ID":"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7","Type":"ContainerDied","Data":"251fe83d372c9a3a1b1f48054e052600a4b5dc7926941deac831b9171dbfa2ae"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.022733 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.022772 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cs9c4\" (UniqueName: \"kubernetes.io/projected/34ffb6e3-3335-41fe-a8f9-c2366177ab92-kube-api-access-cs9c4\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.022789 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.028534 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerID="c952ebc5aee8bdba73fde5488859cc033409d0401daf76157f0e137b9e0e411a" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.028609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ab455f5a-78d1-44d0-b6fa-263b24010aef","Type":"ContainerDied","Data":"c952ebc5aee8bdba73fde5488859cc033409d0401daf76157f0e137b9e0e411a"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.043104 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b69cf86-c5aa-4cce-8122-35443043c210" containerID="0b4a32a7919ab509364cdfc133e358ba7efdcdf58aa7e5177524a7d1c365d050" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.043138 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b69cf86-c5aa-4cce-8122-35443043c210" containerID="d375235b460a38fd29e4ec4d7f7911cdc95d3bde1fcd66fc54caf74325bf86be" exitCode=2 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.043148 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b69cf86-c5aa-4cce-8122-35443043c210" containerID="471841b1522d24c8f23a3d9a330a2d294acea07c93a75761a7a56fc8ab69a617" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.043247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerDied","Data":"0b4a32a7919ab509364cdfc133e358ba7efdcdf58aa7e5177524a7d1c365d050"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.043276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerDied","Data":"d375235b460a38fd29e4ec4d7f7911cdc95d3bde1fcd66fc54caf74325bf86be"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.043286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerDied","Data":"471841b1522d24c8f23a3d9a330a2d294acea07c93a75761a7a56fc8ab69a617"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.054929 4769 generic.go:334] "Generic (PLEG): container finished" podID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerID="be007bb72efc89e59a76c05ac55638b4a65dac9c75d8f6a0053f9e0834a25238" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.055093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"87e1294e-e6ee-46df-ab5b-9be0e1d34fce","Type":"ContainerDied","Data":"be007bb72efc89e59a76c05ac55638b4a65dac9c75d8f6a0053f9e0834a25238"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.092224 4769 generic.go:334] "Generic (PLEG): container finished" podID="997ee964-de30-4b1b-b360-a31378e9a928" containerID="00d6102d4abb045db2facb715c86e75cbcd2e801918144412da17a2c8e417105" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.093354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"997ee964-de30-4b1b-b360-a31378e9a928","Type":"ContainerDied","Data":"00d6102d4abb045db2facb715c86e75cbcd2e801918144412da17a2c8e417105"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.114783 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.127966 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="d954ec9f9fd375f8d21fbfc90930cf9f0e851e88125432c9f19c141bda5ec67e" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.127998 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="547b91c62af6867a861c1e2fbf267059684c898f2fcb3366746713087f93e5be" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128005 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="25a745b27d2c48104dfccc1ab9c9b443ce48a7712cdbd4f77cd19d5c615eaf78" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128014 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="b18fcced732571fdaf74bcc2322b16cde636569d18694efad32ecf13a5b6157d" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128022 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="23d3165d82d9747d4ed22655a6d81d291fe94942a2c349dff1450546b509c275" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128029 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="bedcad83e4334c7e83ddc8624d4e1318bb1a57e1e4708e86d301f18e2add935c" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128036 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="f745168b4e9bc49314d46d470a8a6b9d97a7ca1e17567933b5c8223545d657d5" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128042 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="9ffdf07b6ca311a612fe435c9d96f794f755c1b06d7c976066d7a9854520d7fd" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128049 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="fb3bb295c52508ab61ed6d4059c32909e643abc0d7b8c00eb3502e829c3783f7" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128056 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="32ca7892fd1380c714d6d0afeaa3000431822f1ee42afd0c21cf0741874b1826" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128063 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="21820468085f3cf013463501cb4db298d3fc627940f0c92b3f08219872331bee" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128070 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="1ccc56951cf265eacc5d84661707717cfd5870ebadfbbeb8597e00cb3d93fa11" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"d954ec9f9fd375f8d21fbfc90930cf9f0e851e88125432c9f19c141bda5ec67e"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"547b91c62af6867a861c1e2fbf267059684c898f2fcb3366746713087f93e5be"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"25a745b27d2c48104dfccc1ab9c9b443ce48a7712cdbd4f77cd19d5c615eaf78"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"b18fcced732571fdaf74bcc2322b16cde636569d18694efad32ecf13a5b6157d"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128175 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"23d3165d82d9747d4ed22655a6d81d291fe94942a2c349dff1450546b509c275"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"bedcad83e4334c7e83ddc8624d4e1318bb1a57e1e4708e86d301f18e2add935c"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"f745168b4e9bc49314d46d470a8a6b9d97a7ca1e17567933b5c8223545d657d5"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"9ffdf07b6ca311a612fe435c9d96f794f755c1b06d7c976066d7a9854520d7fd"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"fb3bb295c52508ab61ed6d4059c32909e643abc0d7b8c00eb3502e829c3783f7"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"32ca7892fd1380c714d6d0afeaa3000431822f1ee42afd0c21cf0741874b1826"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"21820468085f3cf013463501cb4db298d3fc627940f0c92b3f08219872331bee"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.128285 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"1ccc56951cf265eacc5d84661707717cfd5870ebadfbbeb8597e00cb3d93fa11"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.140044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" event={"ID":"21b8e395-ab14-4f2c-a784-7ada05455d6a","Type":"ContainerDied","Data":"de406eaf4f5757c6739d9d00407c133d6d94ee5cc3e35eace72932b39b439552"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.140101 4769 generic.go:334] "Generic (PLEG): container finished" podID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerID="de406eaf4f5757c6739d9d00407c133d6d94ee5cc3e35eace72932b39b439552" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.142801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" event={"ID":"057ccf26-b606-4673-9512-c2f4df0b137e","Type":"ContainerStarted","Data":"4e03166550aeac8969d502db54418e96171df37dd28ff9c456e3c4623c510872"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.145059 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" containerID="a9eca7120347e4bec827e52ab8d82c6ff74009f03fded58fd632f0e36692392e" exitCode=2 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.145114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b","Type":"ContainerDied","Data":"a9eca7120347e4bec827e52ab8d82c6ff74009f03fded58fd632f0e36692392e"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.150829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" event={"ID":"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55","Type":"ContainerStarted","Data":"f0ba6bf80103678f558bb06d905997de28b303f75f29ed06ee844990b19ec65b"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.164620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "34ffb6e3-3335-41fe-a8f9-c2366177ab92" (UID: "34ffb6e3-3335-41fe-a8f9-c2366177ab92"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.169460 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerID="220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.169506 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerID="e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.169513 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.169601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c895594-ffd6-4dde-b02c-f949e3ead50f","Type":"ContainerDied","Data":"220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.169639 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c895594-ffd6-4dde-b02c-f949e3ead50f","Type":"ContainerDied","Data":"e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.169655 4769 scope.go:117] "RemoveContainer" containerID="220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.189983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" event={"ID":"2b6e8af9-6035-4a4a-9589-caaea3cab523","Type":"ContainerStarted","Data":"7647884c3bf4794a25ce3b7ce88e8bbb0c436a74878dd6c42ae9274ea56d4c0a"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.226957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-combined-ca-bundle\") pod \"1c895594-ffd6-4dde-b02c-f949e3ead50f\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.227066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data\") pod \"1c895594-ffd6-4dde-b02c-f949e3ead50f\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.227141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data-custom\") pod \"1c895594-ffd6-4dde-b02c-f949e3ead50f\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.227252 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6cxp\" (UniqueName: \"kubernetes.io/projected/1c895594-ffd6-4dde-b02c-f949e3ead50f-kube-api-access-z6cxp\") pod \"1c895594-ffd6-4dde-b02c-f949e3ead50f\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.227286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-scripts\") pod \"1c895594-ffd6-4dde-b02c-f949e3ead50f\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.227313 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c895594-ffd6-4dde-b02c-f949e3ead50f-etc-machine-id\") pod \"1c895594-ffd6-4dde-b02c-f949e3ead50f\" (UID: \"1c895594-ffd6-4dde-b02c-f949e3ead50f\") " Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.227727 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/34ffb6e3-3335-41fe-a8f9-c2366177ab92-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: E1121 12:53:22.227796 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:22 crc kubenswrapper[4769]: E1121 12:53:22.227842 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data podName:8a91e2b2-acf3-4556-9adb-d6ce7a0dd705 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:26.227828301 +0000 UTC m=+3764.928490119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data") pod "rabbitmq-cell1-server-0" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.231403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1c895594-ffd6-4dde-b02c-f949e3ead50f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1c895594-ffd6-4dde-b02c-f949e3ead50f" (UID: "1c895594-ffd6-4dde-b02c-f949e3ead50f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.239548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" event={"ID":"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43","Type":"ContainerStarted","Data":"876abc7964e6df9c639dbcbfe6f5f3153368d3a7313b89c9ca863928c6991d2d"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.260495 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_e5513101-8910-4a2f-ac1e-734789ae3199/ovn-northd/0.log" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.260645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"e5513101-8910-4a2f-ac1e-734789ae3199","Type":"ContainerDied","Data":"fc7b803b7df5f95fa90c794ddf145549d7e70944936ef820b951a598fb83b1aa"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.260953 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.264906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1c895594-ffd6-4dde-b02c-f949e3ead50f" (UID: "1c895594-ffd6-4dde-b02c-f949e3ead50f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.279508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-scripts" (OuterVolumeSpecName: "scripts") pod "1c895594-ffd6-4dde-b02c-f949e3ead50f" (UID: "1c895594-ffd6-4dde-b02c-f949e3ead50f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.281464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c895594-ffd6-4dde-b02c-f949e3ead50f-kube-api-access-z6cxp" (OuterVolumeSpecName: "kube-api-access-z6cxp") pod "1c895594-ffd6-4dde-b02c-f949e3ead50f" (UID: "1c895594-ffd6-4dde-b02c-f949e3ead50f"). InnerVolumeSpecName "kube-api-access-z6cxp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.286606 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn"] Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.286950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-httpd" containerID="cri-o://218808c308af3762e58b075e9b7db61231df55471cb35507c64dcc678e681429" gracePeriod=30 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.287108 4769 generic.go:334] "Generic (PLEG): container finished" podID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerID="f95591b296f2a5cde1e9e641e145754b0dd77c285d9c10829d97e52eae66fe84" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.287226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a5c89536-0f0a-4f35-9ded-2885260ab201","Type":"ContainerDied","Data":"f95591b296f2a5cde1e9e641e145754b0dd77c285d9c10829d97e52eae66fe84"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.287572 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-server" containerID="cri-o://d06f8830f020cf9e4f184f92c3dc2b75c5102487cf705fc57d48622df0863b4a" gracePeriod=30 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.318485 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell07510-account-delete-r64n4"] Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.319584 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b3669f04-8d90-4122-a048-12ac1cfc271e/ovsdbserver-nb/0.log" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.319685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"b3669f04-8d90-4122-a048-12ac1cfc271e","Type":"ContainerDied","Data":"7934092c6a67eb150c09539c9e0bfc6b1998b181ff9565ae23317aed82e53a6a"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.319779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.325513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" event={"ID":"5e8a67f8-1ea8-401e-8f61-66db57f69b22","Type":"ContainerStarted","Data":"7cc507fa13f42fb1544289a9d39a42304ff77dd93d48b0da04e3360ae51e1914"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.329646 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.329672 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z6cxp\" (UniqueName: \"kubernetes.io/projected/1c895594-ffd6-4dde-b02c-f949e3ead50f-kube-api-access-z6cxp\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.329681 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.329689 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c895594-ffd6-4dde-b02c-f949e3ead50f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.342804 4769 generic.go:334] "Generic (PLEG): container finished" podID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" containerID="d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2" exitCode=137 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.342915 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.406291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" event={"ID":"2104c14c-16c5-4732-951f-dbde5da48b75","Type":"ContainerStarted","Data":"586f57c13eed16209cb4b80d49cf3793003bd64aa5113a1a91f7db529cc53b55"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.425868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" event={"ID":"38af882b-baa9-4fff-bb77-941070a30942","Type":"ContainerStarted","Data":"5c7cf127164c402c1e9fd4992862d9f768fcacb654e52bde4f71a85afda95bb4"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.432929 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerID="c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3" exitCode=0 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.433016 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" event={"ID":"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b","Type":"ContainerDied","Data":"c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.443881 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" event={"ID":"a356cff0-bccc-49fc-a3c1-21cdcf16f714","Type":"ContainerStarted","Data":"c01e06108579fca4aeddeccbac5426b5e2a54bd763f50b6b56f4299e842200f6"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.457246 4769 generic.go:334] "Generic (PLEG): container finished" podID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerID="45c1f1016f38de589ca1439d89399344dc5345a130823c71eec319c782975170" exitCode=143 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.457330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" event={"ID":"587b6cbe-7e51-4177-a229-f6a608d0fcab","Type":"ContainerDied","Data":"45c1f1016f38de589ca1439d89399344dc5345a130823c71eec319c782975170"} Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.543126 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" podStartSLOduration=4.543103822 podStartE2EDuration="4.543103822s" podCreationTimestamp="2025-11-21 12:53:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:22.425933357 +0000 UTC m=+3761.126595175" watchObservedRunningTime="2025-11-21 12:53:22.543103822 +0000 UTC m=+3761.243765640" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.553631 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v"] Nov 21 12:53:22 crc kubenswrapper[4769]: W1121 12:53:22.635029 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13de8ad4_38e7_432c_8502_dbbcc423f446.slice/crio-48dba01234b5a01ad19391b921c58afe2e01fb28fb053150e35d8252c5b8d304 WatchSource:0}: Error finding container 48dba01234b5a01ad19391b921c58afe2e01fb28fb053150e35d8252c5b8d304: Status 404 returned error can't find the container with id 48dba01234b5a01ad19391b921c58afe2e01fb28fb053150e35d8252c5b8d304 Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.637475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c895594-ffd6-4dde-b02c-f949e3ead50f" (UID: "1c895594-ffd6-4dde-b02c-f949e3ead50f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.672511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data" (OuterVolumeSpecName: "config-data") pod "1c895594-ffd6-4dde-b02c-f949e3ead50f" (UID: "1c895594-ffd6-4dde-b02c-f949e3ead50f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.738766 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:22 crc kubenswrapper[4769]: I1121 12:53:22.738803 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c895594-ffd6-4dde-b02c-f949e3ead50f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.145506 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.145844 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data podName:e15176d9-214d-4f78-bb65-122a9db292d9 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:27.145827885 +0000 UTC m=+3765.846489703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data") pod "rabbitmq-server-0" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9") : configmap "rabbitmq-config-data" not found Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.163214 4769 scope.go:117] "RemoveContainer" containerID="e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.272282 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.272504 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="f7633e95-a9a0-413f-8827-a24a1f6b0272" containerName="memcached" containerID="cri-o://41a14b4ed09ee1207d1d3291f654c86f69aab747653e0204e5ea4dfc1e55435a" gracePeriod=30 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.282164 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.159:5671: connect: connection refused" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.315644 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33ea1c8a-5107-4dc7-971b-6b8ad8230124" path="/var/lib/kubelet/pods/33ea1c8a-5107-4dc7-971b-6b8ad8230124/volumes" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.316442 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" path="/var/lib/kubelet/pods/34ffb6e3-3335-41fe-a8f9-c2366177ab92/volumes" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.316498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.316949 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c4788f6-80ae-4302-a22f-72204167e813" path="/var/lib/kubelet/pods/3c4788f6-80ae-4302-a22f-72204167e813/volumes" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.318334 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-j4h4v"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.318361 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-j4h4v"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.367604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-certs\") pod \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.367710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-config\") pod \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.367745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-api-access-gz8ml\") pod \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.367767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-combined-ca-bundle\") pod \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\" (UID: \"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.378616 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tfd6s"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.393272 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.398486 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.402845 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.402933 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="305f687e-8e30-410c-b78d-6fd4f2d9191a" containerName="nova-cell1-conductor-conductor" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.417074 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-api-access-gz8ml" (OuterVolumeSpecName: "kube-api-access-gz8ml") pod "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" (UID: "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b"). InnerVolumeSpecName "kube-api-access-gz8ml". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.427887 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tfd6s"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.433004 4769 scope.go:117] "RemoveContainer" containerID="220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.444361 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567\": container with ID starting with 220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567 not found: ID does not exist" containerID="220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.444418 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567"} err="failed to get container status \"220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567\": rpc error: code = NotFound desc = could not find container \"220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567\": container with ID starting with 220911b9a93d897aadff426b2b297c44b35ff66a6fc6b2450057708b464fc567 not found: ID does not exist" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.444448 4769 scope.go:117] "RemoveContainer" containerID="e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.448358 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075\": container with ID starting with e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075 not found: ID does not exist" containerID="e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.448389 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075"} err="failed to get container status \"e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075\": rpc error: code = NotFound desc = could not find container \"e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075\": container with ID starting with e979505d260aa99313e4b6c8d778c91a774566bfc3daba1dca828c9fad781075 not found: ID does not exist" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.448409 4769 scope.go:117] "RemoveContainer" containerID="4696efcf5040808f1bdb82b9cdd33479ac7655978b307af206a4b0f0ce6957f7" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.448576 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-f9zmz"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449010 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="openstack-network-exporter" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449022 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="openstack-network-exporter" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449035 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="openstack-network-exporter" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449042 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="openstack-network-exporter" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449064 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="probe" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449070 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="probe" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449077 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="ovsdbserver-nb" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449083 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="ovsdbserver-nb" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449097 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" containerName="kube-state-metrics" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449103 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" containerName="kube-state-metrics" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449114 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="cinder-scheduler" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449121 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="cinder-scheduler" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.449140 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="ovn-northd" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.449146 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="ovn-northd" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462404 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="openstack-network-exporter" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462447 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="ovsdbserver-nb" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462467 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" containerName="ovn-northd" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462489 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" containerName="openstack-network-exporter" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462506 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="probe" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462514 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" containerName="kube-state-metrics" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.462533 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" containerName="cinder-scheduler" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.470271 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.473518 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone80e8-account-delete-np5dv"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.474811 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.479125 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gz8ml\" (UniqueName: \"kubernetes.io/projected/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-api-access-gz8ml\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.498250 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vzssb"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.501626 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.516272 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.532850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" (UID: "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.534858 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.165:5671: connect: connection refused" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.580012 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.603244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.603355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.603601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8wzr\" (UniqueName: \"kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.603661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjg8g\" (UniqueName: \"kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.603886 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.616997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p8p22"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.625507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b","Type":"ContainerDied","Data":"6aea359f09d01b5a62affc14a7d2b168a392a1b591032e98e2bfc8112f71576a"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.625744 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.648469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" (UID: "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.649700 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-p8p22"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.672006 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.672211 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerName="nova-cell0-conductor-conductor" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.674214 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" (UID: "9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.675342 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerID="59f1379a9da6bfd5402457cd0d7bd4a5cdfddc543a7003038f3c89a2fc1575e1" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.675492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" event={"ID":"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7","Type":"ContainerDied","Data":"59f1379a9da6bfd5402457cd0d7bd4a5cdfddc543a7003038f3c89a2fc1575e1"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.675531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" event={"ID":"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7","Type":"ContainerDied","Data":"1db4b8326bc764ae5425b084f07c055112247b48328180c89467fb7f679bf845"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.675558 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1db4b8326bc764ae5425b084f07c055112247b48328180c89467fb7f679bf845" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.677436 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.717562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-config-data\") pod \"7155427b-59ba-48c3-bf11-c34dd9426b6c\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.717653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-combined-ca-bundle\") pod \"7155427b-59ba-48c3-bf11-c34dd9426b6c\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.717731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shhcr\" (UniqueName: \"kubernetes.io/projected/7155427b-59ba-48c3-bf11-c34dd9426b6c-kube-api-access-shhcr\") pod \"7155427b-59ba-48c3-bf11-c34dd9426b6c\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.717946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-vencrypt-tls-certs\") pod \"7155427b-59ba-48c3-bf11-c34dd9426b6c\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.717996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-nova-novncproxy-tls-certs\") pod \"7155427b-59ba-48c3-bf11-c34dd9426b6c\" (UID: \"7155427b-59ba-48c3-bf11-c34dd9426b6c\") " Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.718748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wzr\" (UniqueName: \"kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.718816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjg8g\" (UniqueName: \"kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.718960 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.719026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.719119 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.719138 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.722551 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerID="d06f8830f020cf9e4f184f92c3dc2b75c5102487cf705fc57d48622df0863b4a" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.722603 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerID="218808c308af3762e58b075e9b7db61231df55471cb35507c64dcc678e681429" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.722774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" event={"ID":"6c40b75d-e715-4735-84f7-65a4a9b9ebe1","Type":"ContainerDied","Data":"d06f8830f020cf9e4f184f92c3dc2b75c5102487cf705fc57d48622df0863b4a"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.722840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" event={"ID":"6c40b75d-e715-4735-84f7-65a4a9b9ebe1","Type":"ContainerDied","Data":"218808c308af3762e58b075e9b7db61231df55471cb35507c64dcc678e681429"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.722854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" event={"ID":"6c40b75d-e715-4735-84f7-65a4a9b9ebe1","Type":"ContainerDied","Data":"9c91893279cbf0e7894e22ee60ce64a990c7c11ac1faee5c010bd23de877becf"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.722872 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c91893279cbf0e7894e22ee60ce64a990c7c11ac1faee5c010bd23de877becf" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.726936 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.727022 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:24.226995478 +0000 UTC m=+3762.927657296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : configmap "openstack-scripts" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.738341 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zjg8g for pod openstack-kuttl-tests/keystone-80e8-account-create-f9zmz: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.738493 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:24.238459526 +0000 UTC m=+3762.939121344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zjg8g" (UniqueName: "kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.752613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7155427b-59ba-48c3-bf11-c34dd9426b6c-kube-api-access-shhcr" (OuterVolumeSpecName: "kube-api-access-shhcr") pod "7155427b-59ba-48c3-bf11-c34dd9426b6c" (UID: "7155427b-59ba-48c3-bf11-c34dd9426b6c"). InnerVolumeSpecName "kube-api-access-shhcr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.759298 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.759436 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:24.25939861 +0000 UTC m=+3762.960060428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : configmap "openstack-scripts" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.761304 4769 projected.go:194] Error preparing data for projected volume kube-api-access-r8wzr for pod openstack-kuttl-tests/keystone80e8-account-delete-np5dv: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:23 crc kubenswrapper[4769]: E1121 12:53:23.761378 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:24.261356693 +0000 UTC m=+3762.962018511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r8wzr" (UniqueName: "kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.806510 4769 scope.go:117] "RemoveContainer" containerID="996cafc79b4404d5f72292d70273e4a9b3a218fbef0e41bea7d031337fc2bf24" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.818371 4769 generic.go:334] "Generic (PLEG): container finished" podID="2104c14c-16c5-4732-951f-dbde5da48b75" containerID="9abca5a1547c532a9bdf107f2a2b0bc3f3154329ca0abd5b15f2900c039961bb" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.818475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" event={"ID":"2104c14c-16c5-4732-951f-dbde5da48b75","Type":"ContainerDied","Data":"9abca5a1547c532a9bdf107f2a2b0bc3f3154329ca0abd5b15f2900c039961bb"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.828707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7155427b-59ba-48c3-bf11-c34dd9426b6c" (UID: "7155427b-59ba-48c3-bf11-c34dd9426b6c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.875893 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-shhcr\" (UniqueName: \"kubernetes.io/projected/7155427b-59ba-48c3-bf11-c34dd9426b6c-kube-api-access-shhcr\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.875926 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.885583 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b54468f77-dq8cd"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.885851 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" podUID="020ca0e6-01ad-44de-abab-3fe5cfbba0e6" containerName="keystone-api" containerID="cri-o://08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4" gracePeriod=30 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.911643 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.924082 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b69cf86-c5aa-4cce-8122-35443043c210" containerID="d8acee167036c7598559c585c217eef54cf47c0cf77300f652401eb4bd4c9aa6" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.924278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerDied","Data":"d8acee167036c7598559c585c217eef54cf47c0cf77300f652401eb4bd4c9aa6"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.924334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7b69cf86-c5aa-4cce-8122-35443043c210","Type":"ContainerDied","Data":"733e7da45a15f59169d05f6ba3ecb1d8411d66b37eba5468932b8ae3bb540782"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.924346 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="733e7da45a15f59169d05f6ba3ecb1d8411d66b37eba5468932b8ae3bb540782" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.953513 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.953612 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-f9zmz"] Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.955773 4769 generic.go:334] "Generic (PLEG): container finished" podID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerID="7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.955872 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.959994 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.970372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"66e62dd9-2d31-4a8a-9214-406124ed2dd4","Type":"ContainerDied","Data":"7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.970407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"66e62dd9-2d31-4a8a-9214-406124ed2dd4","Type":"ContainerDied","Data":"9a5668795c1a27c7e86dfaf4f065636b7e4d0e9f45f83a8e7868559a941c8019"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.970425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c895594-ffd6-4dde-b02c-f949e3ead50f","Type":"ContainerDied","Data":"b456ae53b71a6f49af290ee5570607eedea6eaf1d117142017f13a23d188f617"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.976168 4769 generic.go:334] "Generic (PLEG): container finished" podID="c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" containerID="612c5ae970fcd87f778bc7fcd3d3715634ab6c8b86ab76e616be4a11f0253487" exitCode=0 Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.976270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" event={"ID":"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43","Type":"ContainerDied","Data":"612c5ae970fcd87f778bc7fcd3d3715634ab6c8b86ab76e616be4a11f0253487"} Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.976468 4769 scope.go:117] "RemoveContainer" containerID="29439527e32feb6edd091bf61a16faf87a7bea56a0f67603d5926070cae7ea09" Nov 21 12:53:23 crc kubenswrapper[4769]: I1121 12:53:23.994269 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-vzssb"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.000299 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.000353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" event={"ID":"13de8ad4-38e7-432c-8502-dbbcc423f446","Type":"ContainerStarted","Data":"48dba01234b5a01ad19391b921c58afe2e01fb28fb053150e35d8252c5b8d304"} Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.010452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.010572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" event={"ID":"58c422da-2667-4d11-b5b5-115706d66b58","Type":"ContainerStarted","Data":"b5a69fcec1ba3b338809a924597a26c4f5027736494fb3182ef2cd9aa753dc6d"} Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.011992 4769 generic.go:334] "Generic (PLEG): container finished" podID="7155427b-59ba-48c3-bf11-c34dd9426b6c" containerID="4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad" exitCode=0 Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.012016 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7155427b-59ba-48c3-bf11-c34dd9426b6c","Type":"ContainerDied","Data":"4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad"} Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.012032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7155427b-59ba-48c3-bf11-c34dd9426b6c","Type":"ContainerDied","Data":"d265ece429db4e983c177bbe0a469987980c9a32e5302f7adec6a0836dd3edf3"} Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.012071 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.017760 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone80e8-account-delete-np5dv"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.040636 4769 scope.go:117] "RemoveContainer" containerID="9e6d1fa72ca66cc0b9192174b15b9fdb50ef483a1972c455af113c8ba473a027" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.041581 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.178:8776/healthcheck\": read tcp 10.217.0.2:34784->10.217.1.178:8776: read: connection reset by peer" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.065781 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder0e56-account-delete-d4flh"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.067360 4769 scope.go:117] "RemoveContainer" containerID="d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.081836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv82p\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-kube-api-access-bv82p\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082202 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-generated\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-config-data\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-combined-ca-bundle\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082317 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-scripts\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082399 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-log-httpd\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-etc-swift\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082457 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-combined-ca-bundle\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-operator-scripts\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-run-httpd\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082606 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-internal-tls-certs\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-sg-core-conf-yaml\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082671 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-run-httpd\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-config-data\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-galera-tls-certs\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-ceilometer-tls-certs\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-log-httpd\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-combined-ca-bundle\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kolla-config\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m796g\" (UniqueName: \"kubernetes.io/projected/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kube-api-access-m796g\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkr2l\" (UniqueName: \"kubernetes.io/projected/7b69cf86-c5aa-4cce-8122-35443043c210-kube-api-access-rkr2l\") pod \"7b69cf86-c5aa-4cce-8122-35443043c210\" (UID: \"7b69cf86-c5aa-4cce-8122-35443043c210\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-default\") pod \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\" (UID: \"66e62dd9-2d31-4a8a-9214-406124ed2dd4\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.082922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-public-tls-certs\") pod \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\" (UID: \"6c40b75d-e715-4735-84f7-65a4a9b9ebe1\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.085779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.097132 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.097759 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.099796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.099899 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.100430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.097927 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-5ml5l"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.110320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.117164 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.117647 4769 scope.go:117] "RemoveContainer" containerID="d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2" Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.118017 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2\": container with ID starting with d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2 not found: ID does not exist" containerID="d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.118088 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2"} err="failed to get container status \"d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2\": rpc error: code = NotFound desc = could not find container \"d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2\": container with ID starting with d2dd1a418e2005de2d2864d290ecd025450eaf5b9f5965de4ef533939ef5f2a2 not found: ID does not exist" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.118137 4769 scope.go:117] "RemoveContainer" containerID="a9eca7120347e4bec827e52ab8d82c6ff74009f03fded58fd632f0e36692392e" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.141432 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-f9zmz"] Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.142144 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zjg8g operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" podUID="878afaf4-5555-4258-a0fb-a41798f792b0" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.148014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-scripts" (OuterVolumeSpecName: "scripts") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.166105 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone80e8-account-delete-np5dv"] Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.167527 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-r8wzr operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" podUID="a4942ef7-6b85-4f9c-a8e0-c80a57e06c61" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.173025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kube-api-access-m796g" (OuterVolumeSpecName: "kube-api-access-m796g") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "kube-api-access-m796g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.176713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b69cf86-c5aa-4cce-8122-35443043c210-kube-api-access-rkr2l" (OuterVolumeSpecName: "kube-api-access-rkr2l") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "kube-api-access-rkr2l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.179759 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.180239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-kube-api-access-bv82p" (OuterVolumeSpecName: "kube-api-access-bv82p") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "kube-api-access-bv82p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.185966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data\") pod \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.186062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data-custom\") pod \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.186614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-combined-ca-bundle\") pod \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.186762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-logs\") pod \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.186932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8dxp\" (UniqueName: \"kubernetes.io/projected/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-kube-api-access-p8dxp\") pod \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\" (UID: \"8d296da6-cbfd-4923-9e93-dbfbd2d4bee7\") " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187788 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187804 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187816 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187828 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187840 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187849 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187861 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7b69cf86-c5aa-4cce-8122-35443043c210-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187870 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187880 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m796g\" (UniqueName: \"kubernetes.io/projected/66e62dd9-2d31-4a8a-9214-406124ed2dd4-kube-api-access-m796g\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187902 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rkr2l\" (UniqueName: \"kubernetes.io/projected/7b69cf86-c5aa-4cce-8122-35443043c210-kube-api-access-rkr2l\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187914 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187929 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bv82p\" (UniqueName: \"kubernetes.io/projected/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-kube-api-access-bv82p\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187939 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/66e62dd9-2d31-4a8a-9214-406124ed2dd4-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.187932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-logs" (OuterVolumeSpecName: "logs") pod "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" (UID: "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.199270 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.211276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" (UID: "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.212447 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement5148-account-delete-tmw49"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.231526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "mysql-db") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.238330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-kube-api-access-p8dxp" (OuterVolumeSpecName: "kube-api-access-p8dxp") pod "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" (UID: "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7"). InnerVolumeSpecName "kube-api-access-p8dxp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.255488 4769 scope.go:117] "RemoveContainer" containerID="7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.258834 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.263922 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.283117 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron033b-account-delete-cvrd4"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.285613 4769 scope.go:117] "RemoveContainer" containerID="7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wzr\" (UniqueName: \"kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjg8g\" (UniqueName: \"kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289674 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289693 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p8dxp\" (UniqueName: \"kubernetes.io/projected/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-kube-api-access-p8dxp\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289717 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.289727 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.290315 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.290358 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.290375 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:25.290358639 +0000 UTC m=+3763.991020457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : configmap "openstack-scripts" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.290429 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:25.290408521 +0000 UTC m=+3763.991070339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : configmap "openstack-scripts" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.295378 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zjg8g for pod openstack-kuttl-tests/keystone-80e8-account-create-f9zmz: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.295458 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:25.295424936 +0000 UTC m=+3763.996086754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjg8g" (UniqueName: "kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.296938 4769 projected.go:194] Error preparing data for projected volume kube-api-access-r8wzr for pod openstack-kuttl-tests/keystone80e8-account-delete-np5dv: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:24 crc kubenswrapper[4769]: E1121 12:53:24.297010 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:25.296999178 +0000 UTC m=+3763.997660996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8wzr" (UniqueName: "kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.299718 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance0893-account-delete-tlgw8"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.343545 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-9kpql"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.363284 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi46ff-account-delete-gp48v"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.369071 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.385608 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.392521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "7155427b-59ba-48c3-bf11-c34dd9426b6c" (UID: "7155427b-59ba-48c3-bf11-c34dd9426b6c"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.425741 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell07510-account-delete-r64n4"] Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.496108 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.917895 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.172:9311/healthcheck\": dial tcp 10.217.1.172:9311: connect: connection refused" Nov 21 12:53:24 crc kubenswrapper[4769]: I1121 12:53:24.918330 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.172:9311/healthcheck\": dial tcp 10.217.1.172:9311: connect: connection refused" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.077355 4769 generic.go:334] "Generic (PLEG): container finished" podID="f7633e95-a9a0-413f-8827-a24a1f6b0272" containerID="41a14b4ed09ee1207d1d3291f654c86f69aab747653e0204e5ea4dfc1e55435a" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.077420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f7633e95-a9a0-413f-8827-a24a1f6b0272","Type":"ContainerDied","Data":"41a14b4ed09ee1207d1d3291f654c86f69aab747653e0204e5ea4dfc1e55435a"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.084952 4769 generic.go:334] "Generic (PLEG): container finished" podID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerID="2f2a598af5a736e9cdbff2debd4f3633eda1941244e9836110014879771d9804" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.085027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" event={"ID":"587b6cbe-7e51-4177-a229-f6a608d0fcab","Type":"ContainerDied","Data":"2f2a598af5a736e9cdbff2debd4f3633eda1941244e9836110014879771d9804"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.087533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-config-data" (OuterVolumeSpecName: "config-data") pod "7155427b-59ba-48c3-bf11-c34dd9426b6c" (UID: "7155427b-59ba-48c3-bf11-c34dd9426b6c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.089929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" event={"ID":"5e8a67f8-1ea8-401e-8f61-66db57f69b22","Type":"ContainerStarted","Data":"a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.090183 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" podUID="5e8a67f8-1ea8-401e-8f61-66db57f69b22" containerName="mariadb-account-delete" containerID="cri-o://a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6" gracePeriod=30 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.100694 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerID="c29954e20406b7668feafcdcb73866b526c3a9ddc7ee19889092e3d9d47c2b3a" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.100820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84","Type":"ContainerDied","Data":"c29954e20406b7668feafcdcb73866b526c3a9ddc7ee19889092e3d9d47c2b3a"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.100879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84","Type":"ContainerDied","Data":"e686765ff3087a1827e52a1bd4e64c4898fe251e72667190fb1654a800d6a7c1"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.100896 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e686765ff3087a1827e52a1bd4e64c4898fe251e72667190fb1654a800d6a7c1" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.115494 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.122154 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" podStartSLOduration=7.122134391 podStartE2EDuration="7.122134391s" podCreationTimestamp="2025-11-21 12:53:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:25.118927945 +0000 UTC m=+3763.819589763" watchObservedRunningTime="2025-11-21 12:53:25.122134391 +0000 UTC m=+3763.822796209" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.125911 4769 generic.go:334] "Generic (PLEG): container finished" podID="e83044ec-e522-4705-baac-c8344c6bf994" containerID="4665ffb220f125aa21d913c977f50ba2763596793870e0ac1a0b0e1778d8e6ef" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.125997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" event={"ID":"e83044ec-e522-4705-baac-c8344c6bf994","Type":"ContainerDied","Data":"4665ffb220f125aa21d913c977f50ba2763596793870e0ac1a0b0e1778d8e6ef"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.160996 4769 generic.go:334] "Generic (PLEG): container finished" podID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerID="825fde2ca35f95e01a5c9436725847015102c06aba8e5dd857197d11e8d414ef" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.161272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"87e1294e-e6ee-46df-ab5b-9be0e1d34fce","Type":"ContainerDied","Data":"825fde2ca35f95e01a5c9436725847015102c06aba8e5dd857197d11e8d414ef"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.186410 4769 generic.go:334] "Generic (PLEG): container finished" podID="997ee964-de30-4b1b-b360-a31378e9a928" containerID="96a303aa15155229cf130a82c16bcfb0538f8f8c12939a45a9e393309f450584" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.186644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"997ee964-de30-4b1b-b360-a31378e9a928","Type":"ContainerDied","Data":"96a303aa15155229cf130a82c16bcfb0538f8f8c12939a45a9e393309f450584"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.191328 4769 generic.go:334] "Generic (PLEG): container finished" podID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerID="87febf2672c90346b1c953c0e954d50a3c3a63e5e87364450e4974a741593acf" exitCode=0 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.191397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" event={"ID":"21b8e395-ab14-4f2c-a784-7ada05455d6a","Type":"ContainerDied","Data":"87febf2672c90346b1c953c0e954d50a3c3a63e5e87364450e4974a741593acf"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.195897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" event={"ID":"38af882b-baa9-4fff-bb77-941070a30942","Type":"ContainerStarted","Data":"61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.196036 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" podUID="38af882b-baa9-4fff-bb77-941070a30942" containerName="mariadb-account-delete" containerID="cri-o://61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831" gracePeriod=30 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.198164 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="galera" containerID="cri-o://3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b" gracePeriod=29 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.202852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" event={"ID":"58c422da-2667-4d11-b5b5-115706d66b58","Type":"ContainerStarted","Data":"068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.203086 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" podUID="58c422da-2667-4d11-b5b5-115706d66b58" containerName="mariadb-account-delete" containerID="cri-o://068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e" gracePeriod=30 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.224967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" event={"ID":"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55","Type":"ContainerStarted","Data":"0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.225016 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" podUID="1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" containerName="mariadb-account-delete" containerID="cri-o://0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632" gracePeriod=30 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.230556 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" podStartSLOduration=6.230529591 podStartE2EDuration="6.230529591s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:25.224438977 +0000 UTC m=+3763.925100795" watchObservedRunningTime="2025-11-21 12:53:25.230529591 +0000 UTC m=+3763.931191409" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.244552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "7155427b-59ba-48c3-bf11-c34dd9426b6c" (UID: "7155427b-59ba-48c3-bf11-c34dd9426b6c"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.248799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" event={"ID":"057ccf26-b606-4673-9512-c2f4df0b137e","Type":"ContainerStarted","Data":"3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4"} Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.248877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.248978 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" podUID="057ccf26-b606-4673-9512-c2f4df0b137e" containerName="mariadb-account-delete" containerID="cri-o://3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4" gracePeriod=30 Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.249134 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.249248 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.249313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.249350 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.252168 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" podStartSLOduration=6.252145143 podStartE2EDuration="6.252145143s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:25.247287532 +0000 UTC m=+3763.947949350" watchObservedRunningTime="2025-11-21 12:53:25.252145143 +0000 UTC m=+3763.952806961" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.270958 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" podStartSLOduration=6.2709234689999995 podStartE2EDuration="6.270923469s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:25.264555377 +0000 UTC m=+3763.965217205" watchObservedRunningTime="2025-11-21 12:53:25.270923469 +0000 UTC m=+3763.971585287" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.273845 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.318622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjg8g\" (UniqueName: \"kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.318733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.318769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.318844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wzr\" (UniqueName: \"kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.318891 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7155427b-59ba-48c3-bf11-c34dd9426b6c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.318905 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.319424 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.319477 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:27.319463546 +0000 UTC m=+3766.020125364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : configmap "openstack-scripts" not found Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.319513 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.319535 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:27.319529628 +0000 UTC m=+3766.020191446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : configmap "openstack-scripts" not found Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.324730 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c373181-218c-40fb-a082-14594e5181a1" path="/var/lib/kubelet/pods/4c373181-218c-40fb-a082-14594e5181a1/volumes" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.325616 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="791a2a08-f5a6-4684-8297-ce0e7fea58f3" path="/var/lib/kubelet/pods/791a2a08-f5a6-4684-8297-ce0e7fea58f3/volumes" Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.326588 4769 projected.go:194] Error preparing data for projected volume kube-api-access-r8wzr for pod openstack-kuttl-tests/keystone80e8-account-delete-np5dv: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.326702 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:27.32667471 +0000 UTC m=+3766.027336528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8wzr" (UniqueName: "kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.326756 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zjg8g for pod openstack-kuttl-tests/keystone-80e8-account-create-f9zmz: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:25 crc kubenswrapper[4769]: E1121 12:53:25.326788 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:27.326778443 +0000 UTC m=+3766.027440261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjg8g" (UniqueName: "kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.327839 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b" path="/var/lib/kubelet/pods/9f75d0bd-ecaf-4c40-8efa-b4d7bcb87b3b/volumes" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.328037 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" podStartSLOduration=6.326805774 podStartE2EDuration="6.326805774s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:25.316492576 +0000 UTC m=+3764.017154394" watchObservedRunningTime="2025-11-21 12:53:25.326805774 +0000 UTC m=+3764.027467592" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.328590 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3669f04-8d90-4122-a048-12ac1cfc271e" path="/var/lib/kubelet/pods/b3669f04-8d90-4122-a048-12ac1cfc271e/volumes" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.329238 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc4942fd-77bd-4a9b-9cf3-b9db054394ba" path="/var/lib/kubelet/pods/cc4942fd-77bd-4a9b-9cf3-b9db054394ba/volumes" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.339384 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce32d94f-d365-4adc-a1aa-362b3a0fceba" path="/var/lib/kubelet/pods/ce32d94f-d365-4adc-a1aa-362b3a0fceba/volumes" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.478585 4769 scope.go:117] "RemoveContainer" containerID="4d1e33667932b6f6212ea7d17989c1963d17079c3c91caf651f6b9513f57a612" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.541043 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.585393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.637744 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.637771 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.696708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.703278 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" (UID: "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.722447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data" (OuterVolumeSpecName: "config-data") pod "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" (UID: "8d296da6-cbfd-4923-9e93-dbfbd2d4bee7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.733502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.735120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.737451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.739846 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.739872 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.739987 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.740000 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.740011 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.740019 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.748351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-config-data" (OuterVolumeSpecName: "config-data") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.756371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "66e62dd9-2d31-4a8a-9214-406124ed2dd4" (UID: "66e62dd9-2d31-4a8a-9214-406124ed2dd4"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.768852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6c40b75d-e715-4735-84f7-65a4a9b9ebe1" (UID: "6c40b75d-e715-4735-84f7-65a4a9b9ebe1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.814557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-config-data" (OuterVolumeSpecName: "config-data") pod "7b69cf86-c5aa-4cce-8122-35443043c210" (UID: "7b69cf86-c5aa-4cce-8122-35443043c210"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.849583 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.849945 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/66e62dd9-2d31-4a8a-9214-406124ed2dd4-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.850371 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c40b75d-e715-4735-84f7-65a4a9b9ebe1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:25 crc kubenswrapper[4769]: I1121 12:53:25.850394 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b69cf86-c5aa-4cce-8122-35443043c210-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.258126 4769 generic.go:334] "Generic (PLEG): container finished" podID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerID="aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38" exitCode=0 Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.258374 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.258510 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data podName:8a91e2b2-acf3-4556-9adb-d6ce7a0dd705 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:34.258492116 +0000 UTC m=+3772.959153934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data") pod "rabbitmq-cell1-server-0" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705") : configmap "rabbitmq-cell1-config-data" not found Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.273229 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" podUID="a356cff0-bccc-49fc-a3c1-21cdcf16f714" containerName="mariadb-database-create" containerID="cri-o://bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09" gracePeriod=30 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.277314 4769 generic.go:334] "Generic (PLEG): container finished" podID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" exitCode=0 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.278786 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerID="0dd0d895f81dbc07e1ecb36491278731065fbfda83dce77e6c945bd1c681a349" exitCode=0 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.318867 4769 generic.go:334] "Generic (PLEG): container finished" podID="305f687e-8e30-410c-b78d-6fd4f2d9191a" containerID="833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9" exitCode=0 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.323506 4769 generic.go:334] "Generic (PLEG): container finished" podID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerID="e262a2e0a42afc1913632e50e4674554d2684b538e9894ce9884fbbc25208ba9" exitCode=0 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.331455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" podUID="2b6e8af9-6035-4a4a-9589-caaea3cab523" containerName="mariadb-account-delete" containerID="cri-o://2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d" gracePeriod=30 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.334064 4769 generic.go:334] "Generic (PLEG): container finished" podID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerID="3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b" exitCode=0 Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.334087 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" podStartSLOduration=7.334067672 podStartE2EDuration="7.334067672s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:26.326486908 +0000 UTC m=+3765.027148726" watchObservedRunningTime="2025-11-21 12:53:26.334067672 +0000 UTC m=+3765.034729490" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.354587 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" podStartSLOduration=7.354570204 podStartE2EDuration="7.354570204s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:26.350116014 +0000 UTC m=+3765.050777852" watchObservedRunningTime="2025-11-21 12:53:26.354570204 +0000 UTC m=+3765.055232022" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.551732 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d is running failed: container process not found" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.552575 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d is running failed: container process not found" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.553234 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d is running failed: container process not found" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.553306 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerName="nova-scheduler-scheduler" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.686279 4769 scope.go:117] "RemoveContainer" containerID="7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.686899 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb\": container with ID starting with 7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb not found: ID does not exist" containerID="7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.686960 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb"} err="failed to get container status \"7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb\": rpc error: code = NotFound desc = could not find container \"7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb\": container with ID starting with 7d49669c573626a2e24bf8078c307d4eed302bfa22d23f3f4aa41de2f33721eb not found: ID does not exist" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.687010 4769 scope.go:117] "RemoveContainer" containerID="7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.687756 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6\": container with ID starting with 7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6 not found: ID does not exist" containerID="7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.687808 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6"} err="failed to get container status \"7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6\": rpc error: code = NotFound desc = could not find container \"7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6\": container with ID starting with 7a80f2f812007857595fc0cfdd0f06cee303492d73a474a73a128814a17d7fa6 not found: ID does not exist" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.687841 4769 scope.go:117] "RemoveContainer" containerID="4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.692341 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b is running failed: container process not found" containerID="3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.692947 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b is running failed: container process not found" containerID="3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.693749 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b is running failed: container process not found" containerID="3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.693812 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="galera" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.704437 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.43s" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" event={"ID":"13de8ad4-38e7-432c-8502-dbbcc423f446","Type":"ContainerDied","Data":"aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"997ee964-de30-4b1b-b360-a31378e9a928","Type":"ContainerDied","Data":"de163a8801a0f78408650bdafa7bef423f7263b563dd58f1225e9ec198d94d73"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704795 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de163a8801a0f78408650bdafa7bef423f7263b563dd58f1225e9ec198d94d73" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" event={"ID":"a356cff0-bccc-49fc-a3c1-21cdcf16f714","Type":"ContainerStarted","Data":"bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" event={"ID":"587b6cbe-7e51-4177-a229-f6a608d0fcab","Type":"ContainerDied","Data":"f4a3d8e9f01d6b529c40ed5951ac315879d74aed5e17109491940a54259e5248"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704924 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4a3d8e9f01d6b529c40ed5951ac315879d74aed5e17109491940a54259e5248" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7","Type":"ContainerDied","Data":"6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7","Type":"ContainerDied","Data":"7b41b2b87b91f33453e8c0cedb31174b3cb418d56ec68bee949d69d37d9b1090"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704982 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b41b2b87b91f33453e8c0cedb31174b3cb418d56ec68bee949d69d37d9b1090" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.704997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ab455f5a-78d1-44d0-b6fa-263b24010aef","Type":"ContainerDied","Data":"0dd0d895f81dbc07e1ecb36491278731065fbfda83dce77e6c945bd1c681a349"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ab455f5a-78d1-44d0-b6fa-263b24010aef","Type":"ContainerDied","Data":"371aaf5b17f4613850311340f5b5eda468a9e30977264b3774ec4dec71713c77"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705042 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="371aaf5b17f4613850311340f5b5eda468a9e30977264b3774ec4dec71713c77" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" event={"ID":"21b8e395-ab14-4f2c-a784-7ada05455d6a","Type":"ContainerDied","Data":"3e5c3332787d8d7ba65a93bc11386c7ce6f6aa9e52b8ac435c20f7ec5ba83d9e"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705082 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e5c3332787d8d7ba65a93bc11386c7ce6f6aa9e52b8ac435c20f7ec5ba83d9e" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f7633e95-a9a0-413f-8827-a24a1f6b0272","Type":"ContainerDied","Data":"8ec3d7c4e2ac4637d0d03db5a2d210ee3903156b5da28c7420093eb7b79c4f0b"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705117 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ec3d7c4e2ac4637d0d03db5a2d210ee3903156b5da28c7420093eb7b79c4f0b" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705132 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"305f687e-8e30-410c-b78d-6fd4f2d9191a","Type":"ContainerDied","Data":"833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"305f687e-8e30-410c-b78d-6fd4f2d9191a","Type":"ContainerDied","Data":"7e361b31594b189df2045d4e88a65c6b2724cb53494825f51cedba9d15f2e466"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705266 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e361b31594b189df2045d4e88a65c6b2724cb53494825f51cedba9d15f2e466" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a5c89536-0f0a-4f35-9ded-2885260ab201","Type":"ContainerDied","Data":"e262a2e0a42afc1913632e50e4674554d2684b538e9894ce9884fbbc25208ba9"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705308 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"a5c89536-0f0a-4f35-9ded-2885260ab201","Type":"ContainerDied","Data":"83cd7f10622039d0ea8c6dd59b0be32304cda65241becd20968b33f2ca6d9264"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705323 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83cd7f10622039d0ea8c6dd59b0be32304cda65241becd20968b33f2ca6d9264" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"87e1294e-e6ee-46df-ab5b-9be0e1d34fce","Type":"ContainerDied","Data":"ba8d8c1338b8723829427d8424e4b68a66f1c7e7d06213d090aad126381cb53c"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705356 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba8d8c1338b8723829427d8424e4b68a66f1c7e7d06213d090aad126381cb53c" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" event={"ID":"2b6e8af9-6035-4a4a-9589-caaea3cab523","Type":"ContainerStarted","Data":"2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a2614ea4-9b84-4ab4-8e80-fe7a005e3322","Type":"ContainerDied","Data":"3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"a2614ea4-9b84-4ab4-8e80-fe7a005e3322","Type":"ContainerDied","Data":"e269a265bad817d3e3bea9948f1d3c06cc7b08ac79ff7c38ef1ca86592044a9d"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705454 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e269a265bad817d3e3bea9948f1d3c06cc7b08ac79ff7c38ef1ca86592044a9d" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" event={"ID":"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43","Type":"ContainerDied","Data":"876abc7964e6df9c639dbcbfe6f5f3153368d3a7313b89c9ca863928c6991d2d"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705491 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="876abc7964e6df9c639dbcbfe6f5f3153368d3a7313b89c9ca863928c6991d2d" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" event={"ID":"2104c14c-16c5-4732-951f-dbde5da48b75","Type":"ContainerDied","Data":"586f57c13eed16209cb4b80d49cf3793003bd64aa5113a1a91f7db529cc53b55"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705526 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="586f57c13eed16209cb4b80d49cf3793003bd64aa5113a1a91f7db529cc53b55" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.705534 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" event={"ID":"e83044ec-e522-4705-baac-c8344c6bf994","Type":"ContainerDied","Data":"49c13610c6cab970970b86e8ddb88fe08f8264971df19bc066d4bea8780e5429"} Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.705573 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49c13610c6cab970970b86e8ddb88fe08f8264971df19bc066d4bea8780e5429" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.742570 4769 scope.go:117] "RemoveContainer" containerID="cac4f60a12a1c0952946fc47e09ab4f62a97adbf88ffcb17d9d4c65a64c4d1f1" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.762466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.789240 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.792537 4769 scope.go:117] "RemoveContainer" containerID="4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad" Nov 21 12:53:26 crc kubenswrapper[4769]: E1121 12:53:26.792895 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad\": container with ID starting with 4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad not found: ID does not exist" containerID="4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.792945 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad"} err="failed to get container status \"4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad\": rpc error: code = NotFound desc = could not find container \"4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad\": container with ID starting with 4ba0a0ed53421e1b96a10656d9ad099ba247fd62b42e56981a8cd5d51127f5ad not found: ID does not exist" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.830484 4769 scope.go:117] "RemoveContainer" containerID="c30fb1219810f1f1186fa3d6e117b216245d01de60bc27de74cd429346301a5f" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.850050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c6sl\" (UniqueName: \"kubernetes.io/projected/e83044ec-e522-4705-baac-c8344c6bf994-kube-api-access-8c6sl\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-scripts\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5r45\" (UniqueName: \"kubernetes.io/projected/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-kube-api-access-l5r45\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-scripts\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-public-tls-certs\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874831 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-internal-tls-certs\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.874977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-combined-ca-bundle\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.875338 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.876126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-etc-machine-id\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.876307 4769 scope.go:117] "RemoveContainer" containerID="9f009b2ef78b2f741b1eddf9695c1b778a9c9fa04c65bb647bb63c0745e67d0c" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.876774 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-combined-ca-bundle\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.877083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-internal-tls-certs\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.877398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-public-tls-certs\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.877554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data-custom\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.877631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-logs\") pod \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\" (UID: \"1c629d36-bc3d-4c54-b61b-d27cf0cb1d84\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.877705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-config-data\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.877799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e83044ec-e522-4705-baac-c8344c6bf994-logs\") pod \"e83044ec-e522-4705-baac-c8344c6bf994\" (UID: \"e83044ec-e522-4705-baac-c8344c6bf994\") " Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.878387 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.883456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.889561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.891509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-scripts" (OuterVolumeSpecName: "scripts") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.891640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-scripts" (OuterVolumeSpecName: "scripts") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.893114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83044ec-e522-4705-baac-c8344c6bf994-logs" (OuterVolumeSpecName: "logs") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.895091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-kube-api-access-l5r45" (OuterVolumeSpecName: "kube-api-access-l5r45") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "kube-api-access-l5r45". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.895939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-logs" (OuterVolumeSpecName: "logs") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.901477 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.906638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e83044ec-e522-4705-baac-c8344c6bf994-kube-api-access-8c6sl" (OuterVolumeSpecName: "kube-api-access-8c6sl") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "kube-api-access-8c6sl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.908978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.914127 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.916251 4769 scope.go:117] "RemoveContainer" containerID="acf6f669a9a4324de2c555ba73c82a682c2313f586002009031b52594b9b72e4" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.920928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.949284 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.960011 4769 scope.go:117] "RemoveContainer" containerID="5c30e4792f341d93e32cceba812c233f2e7efd7eadf925001bafd200eb65a313" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.962250 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.967885 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.976302 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn"] Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982138 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982166 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982176 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e83044ec-e522-4705-baac-c8344c6bf994-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982236 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8c6sl\" (UniqueName: \"kubernetes.io/projected/e83044ec-e522-4705-baac-c8344c6bf994-kube-api-access-8c6sl\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982246 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982254 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l5r45\" (UniqueName: \"kubernetes.io/projected/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-kube-api-access-l5r45\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982262 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982271 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.982278 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:26 crc kubenswrapper[4769]: I1121 12:53:26.984778 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.008319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.008434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.028258 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-66565b6698-fw9wn"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.031557 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.031561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.034569 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.034338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.034758 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.045428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data" (OuterVolumeSpecName: "config-data") pod "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" (UID: "1c629d36-bc3d-4c54-b61b-d27cf0cb1d84"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.052403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-config-data" (OuterVolumeSpecName: "config-data") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.054515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.057883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.058920 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.063513 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.069368 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.073312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e83044ec-e522-4705-baac-c8344c6bf994" (UID: "e83044ec-e522-4705-baac-c8344c6bf994"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.074113 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.079939 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.081925 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21b8e395-ab14-4f2c-a784-7ada05455d6a-logs\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083704 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-combined-ca-bundle\") pod \"997ee964-de30-4b1b-b360-a31378e9a928\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-public-tls-certs\") pod \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-kolla-config\") pod \"f7633e95-a9a0-413f-8827-a24a1f6b0272\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083818 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/997ee964-de30-4b1b-b360-a31378e9a928-logs\") pod \"997ee964-de30-4b1b-b360-a31378e9a928\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt4lm\" (UniqueName: \"kubernetes.io/projected/997ee964-de30-4b1b-b360-a31378e9a928-kube-api-access-vt4lm\") pod \"997ee964-de30-4b1b-b360-a31378e9a928\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-config-data\") pod \"f7633e95-a9a0-413f-8827-a24a1f6b0272\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-combined-ca-bundle\") pod \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-internal-tls-certs\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-nova-metadata-tls-certs\") pod \"997ee964-de30-4b1b-b360-a31378e9a928\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-config-data\") pod \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.083991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-internal-tls-certs\") pod \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data-custom\") pod \"587b6cbe-7e51-4177-a229-f6a608d0fcab\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9j29\" (UniqueName: \"kubernetes.io/projected/21b8e395-ab14-4f2c-a784-7ada05455d6a-kube-api-access-k9j29\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ws9x\" (UniqueName: \"kubernetes.io/projected/f7633e95-a9a0-413f-8827-a24a1f6b0272-kube-api-access-4ws9x\") pod \"f7633e95-a9a0-413f-8827-a24a1f6b0272\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/587b6cbe-7e51-4177-a229-f6a608d0fcab-logs\") pod \"587b6cbe-7e51-4177-a229-f6a608d0fcab\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-combined-ca-bundle\") pod \"f7633e95-a9a0-413f-8827-a24a1f6b0272\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-combined-ca-bundle\") pod \"587b6cbe-7e51-4177-a229-f6a608d0fcab\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data-custom\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpwx4\" (UniqueName: \"kubernetes.io/projected/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-kube-api-access-tpwx4\") pod \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-memcached-tls-certs\") pod \"f7633e95-a9a0-413f-8827-a24a1f6b0272\" (UID: \"f7633e95-a9a0-413f-8827-a24a1f6b0272\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-combined-ca-bundle\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084254 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-config-data\") pod \"997ee964-de30-4b1b-b360-a31378e9a928\" (UID: \"997ee964-de30-4b1b-b360-a31378e9a928\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-public-tls-certs\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrpgb\" (UniqueName: \"kubernetes.io/projected/587b6cbe-7e51-4177-a229-f6a608d0fcab-kube-api-access-xrpgb\") pod \"587b6cbe-7e51-4177-a229-f6a608d0fcab\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data\") pod \"587b6cbe-7e51-4177-a229-f6a608d0fcab\" (UID: \"587b6cbe-7e51-4177-a229-f6a608d0fcab\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-logs\") pod \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\" (UID: \"87e1294e-e6ee-46df-ab5b-9be0e1d34fce\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data\") pod \"21b8e395-ab14-4f2c-a784-7ada05455d6a\" (UID: \"21b8e395-ab14-4f2c-a784-7ada05455d6a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084729 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084746 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084756 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084765 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084775 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084784 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.084793 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e83044ec-e522-4705-baac-c8344c6bf994-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.088299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587b6cbe-7e51-4177-a229-f6a608d0fcab-logs" (OuterVolumeSpecName: "logs") pod "587b6cbe-7e51-4177-a229-f6a608d0fcab" (UID: "587b6cbe-7e51-4177-a229-f6a608d0fcab"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.089633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-logs" (OuterVolumeSpecName: "logs") pod "87e1294e-e6ee-46df-ab5b-9be0e1d34fce" (UID: "87e1294e-e6ee-46df-ab5b-9be0e1d34fce"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.091432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b8e395-ab14-4f2c-a784-7ada05455d6a-kube-api-access-k9j29" (OuterVolumeSpecName: "kube-api-access-k9j29") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "kube-api-access-k9j29". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.092315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-config-data" (OuterVolumeSpecName: "config-data") pod "f7633e95-a9a0-413f-8827-a24a1f6b0272" (UID: "f7633e95-a9a0-413f-8827-a24a1f6b0272"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.092731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "f7633e95-a9a0-413f-8827-a24a1f6b0272" (UID: "f7633e95-a9a0-413f-8827-a24a1f6b0272"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.093094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/997ee964-de30-4b1b-b360-a31378e9a928-logs" (OuterVolumeSpecName: "logs") pod "997ee964-de30-4b1b-b360-a31378e9a928" (UID: "997ee964-de30-4b1b-b360-a31378e9a928"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.095906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/997ee964-de30-4b1b-b360-a31378e9a928-kube-api-access-vt4lm" (OuterVolumeSpecName: "kube-api-access-vt4lm") pod "997ee964-de30-4b1b-b360-a31378e9a928" (UID: "997ee964-de30-4b1b-b360-a31378e9a928"). InnerVolumeSpecName "kube-api-access-vt4lm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.105383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b8e395-ab14-4f2c-a784-7ada05455d6a-logs" (OuterVolumeSpecName: "logs") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.105641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-kube-api-access-tpwx4" (OuterVolumeSpecName: "kube-api-access-tpwx4") pod "87e1294e-e6ee-46df-ab5b-9be0e1d34fce" (UID: "87e1294e-e6ee-46df-ab5b-9be0e1d34fce"). InnerVolumeSpecName "kube-api-access-tpwx4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.111797 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.125083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587b6cbe-7e51-4177-a229-f6a608d0fcab-kube-api-access-xrpgb" (OuterVolumeSpecName: "kube-api-access-xrpgb") pod "587b6cbe-7e51-4177-a229-f6a608d0fcab" (UID: "587b6cbe-7e51-4177-a229-f6a608d0fcab"). InnerVolumeSpecName "kube-api-access-xrpgb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.133801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7633e95-a9a0-413f-8827-a24a1f6b0272-kube-api-access-4ws9x" (OuterVolumeSpecName: "kube-api-access-4ws9x") pod "f7633e95-a9a0-413f-8827-a24a1f6b0272" (UID: "f7633e95-a9a0-413f-8827-a24a1f6b0272"). InnerVolumeSpecName "kube-api-access-4ws9x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.167131 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "587b6cbe-7e51-4177-a229-f6a608d0fcab" (UID: "587b6cbe-7e51-4177-a229-f6a608d0fcab"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2104c14c-16c5-4732-951f-dbde5da48b75-operator-scripts\") pod \"2104c14c-16c5-4732-951f-dbde5da48b75\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-logs\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-galera-tls-certs\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-config-data\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-config-data\") pod \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-operator-scripts\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-config-data\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bh8f\" (UniqueName: \"kubernetes.io/projected/a5c89536-0f0a-4f35-9ded-2885260ab201-kube-api-access-2bh8f\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqtgz\" (UniqueName: \"kubernetes.io/projected/305f687e-8e30-410c-b78d-6fd4f2d9191a-kube-api-access-kqtgz\") pod \"305f687e-8e30-410c-b78d-6fd4f2d9191a\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-public-tls-certs\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-logs\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktxww\" (UniqueName: \"kubernetes.io/projected/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-kube-api-access-ktxww\") pod \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-httpd-run\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.185987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l7dg\" (UniqueName: \"kubernetes.io/projected/2104c14c-16c5-4732-951f-dbde5da48b75-kube-api-access-9l7dg\") pod \"2104c14c-16c5-4732-951f-dbde5da48b75\" (UID: \"2104c14c-16c5-4732-951f-dbde5da48b75\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-httpd-run\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-scripts\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-combined-ca-bundle\") pod \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv8n6\" (UniqueName: \"kubernetes.io/projected/ab455f5a-78d1-44d0-b6fa-263b24010aef-kube-api-access-sv8n6\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-combined-ca-bundle\") pod \"305f687e-8e30-410c-b78d-6fd4f2d9191a\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-combined-ca-bundle\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186033 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2104c14c-16c5-4732-951f-dbde5da48b75-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2104c14c-16c5-4732-951f-dbde5da48b75" (UID: "2104c14c-16c5-4732-951f-dbde5da48b75"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-combined-ca-bundle\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-scripts\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-default\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"ab455f5a-78d1-44d0-b6fa-263b24010aef\" (UID: \"ab455f5a-78d1-44d0-b6fa-263b24010aef\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-operator-scripts\") pod \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\" (UID: \"c87fc5bb-aceb-45d9-883d-5ffc9b65ea43\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186574 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj69s\" (UniqueName: \"kubernetes.io/projected/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kube-api-access-tj69s\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jqrp\" (UniqueName: \"kubernetes.io/projected/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-kube-api-access-4jqrp\") pod \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\" (UID: \"8a788ac5-aa39-45cc-b04f-3b8e0e819ef7\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186635 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-internal-tls-certs\") pod \"a5c89536-0f0a-4f35-9ded-2885260ab201\" (UID: \"a5c89536-0f0a-4f35-9ded-2885260ab201\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-config-data\") pod \"305f687e-8e30-410c-b78d-6fd4f2d9191a\" (UID: \"305f687e-8e30-410c-b78d-6fd4f2d9191a\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kolla-config\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-combined-ca-bundle\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-generated\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.186797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\" (UID: \"a2614ea4-9b84-4ab4-8e80-fe7a005e3322\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187673 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187702 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k9j29\" (UniqueName: \"kubernetes.io/projected/21b8e395-ab14-4f2c-a784-7ada05455d6a-kube-api-access-k9j29\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187714 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4ws9x\" (UniqueName: \"kubernetes.io/projected/f7633e95-a9a0-413f-8827-a24a1f6b0272-kube-api-access-4ws9x\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187724 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/587b6cbe-7e51-4177-a229-f6a608d0fcab-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187736 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187748 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tpwx4\" (UniqueName: \"kubernetes.io/projected/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-kube-api-access-tpwx4\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187759 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xrpgb\" (UniqueName: \"kubernetes.io/projected/587b6cbe-7e51-4177-a229-f6a608d0fcab-kube-api-access-xrpgb\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187769 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187778 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2104c14c-16c5-4732-951f-dbde5da48b75-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187788 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/21b8e395-ab14-4f2c-a784-7ada05455d6a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187797 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187805 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/997ee964-de30-4b1b-b360-a31378e9a928-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187814 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vt4lm\" (UniqueName: \"kubernetes.io/projected/997ee964-de30-4b1b-b360-a31378e9a928-kube-api-access-vt4lm\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.187823 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f7633e95-a9a0-413f-8827-a24a1f6b0272-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.187872 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.187914 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data podName:e15176d9-214d-4f78-bb65-122a9db292d9 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:35.187898848 +0000 UTC m=+3773.888560666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data") pod "rabbitmq-server-0" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9") : configmap "rabbitmq-config-data" not found Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.190847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" (UID: "c87fc5bb-aceb-45d9-883d-5ffc9b65ea43"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.192406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-logs" (OuterVolumeSpecName: "logs") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.192415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.192780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.196380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7633e95-a9a0-413f-8827-a24a1f6b0272" (UID: "f7633e95-a9a0-413f-8827-a24a1f6b0272"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.197247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.197452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.201903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-logs" (OuterVolumeSpecName: "logs") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.202929 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.203374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.205771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-kube-api-access-4jqrp" (OuterVolumeSpecName: "kube-api-access-4jqrp") pod "8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" (UID: "8a788ac5-aa39-45cc-b04f-3b8e0e819ef7"). InnerVolumeSpecName "kube-api-access-4jqrp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.210357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kube-api-access-tj69s" (OuterVolumeSpecName: "kube-api-access-tj69s") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "kube-api-access-tj69s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.210506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.211145 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-kube-api-access-ktxww" (OuterVolumeSpecName: "kube-api-access-ktxww") pod "c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" (UID: "c87fc5bb-aceb-45d9-883d-5ffc9b65ea43"). InnerVolumeSpecName "kube-api-access-ktxww". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.215898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-scripts" (OuterVolumeSpecName: "scripts") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.215842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.219099 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305f687e-8e30-410c-b78d-6fd4f2d9191a-kube-api-access-kqtgz" (OuterVolumeSpecName: "kube-api-access-kqtgz") pod "305f687e-8e30-410c-b78d-6fd4f2d9191a" (UID: "305f687e-8e30-410c-b78d-6fd4f2d9191a"). InnerVolumeSpecName "kube-api-access-kqtgz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.222612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-scripts" (OuterVolumeSpecName: "scripts") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.222651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.222869 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2104c14c-16c5-4732-951f-dbde5da48b75-kube-api-access-9l7dg" (OuterVolumeSpecName: "kube-api-access-9l7dg") pod "2104c14c-16c5-4732-951f-dbde5da48b75" (UID: "2104c14c-16c5-4732-951f-dbde5da48b75"). InnerVolumeSpecName "kube-api-access-9l7dg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.228342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c89536-0f0a-4f35-9ded-2885260ab201-kube-api-access-2bh8f" (OuterVolumeSpecName: "kube-api-access-2bh8f") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "kube-api-access-2bh8f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.231487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-config-data" (OuterVolumeSpecName: "config-data") pod "87e1294e-e6ee-46df-ab5b-9be0e1d34fce" (UID: "87e1294e-e6ee-46df-ab5b-9be0e1d34fce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.244878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "587b6cbe-7e51-4177-a229-f6a608d0fcab" (UID: "587b6cbe-7e51-4177-a229-f6a608d0fcab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.245034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab455f5a-78d1-44d0-b6fa-263b24010aef-kube-api-access-sv8n6" (OuterVolumeSpecName: "kube-api-access-sv8n6") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "kube-api-access-sv8n6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.262534 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-config-data" (OuterVolumeSpecName: "config-data") pod "997ee964-de30-4b1b-b360-a31378e9a928" (UID: "997ee964-de30-4b1b-b360-a31378e9a928"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.263535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "997ee964-de30-4b1b-b360-a31378e9a928" (UID: "997ee964-de30-4b1b-b360-a31378e9a928"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.270403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.279561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data" (OuterVolumeSpecName: "config-data") pod "587b6cbe-7e51-4177-a229-f6a608d0fcab" (UID: "587b6cbe-7e51-4177-a229-f6a608d0fcab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.286750 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" path="/var/lib/kubelet/pods/66e62dd9-2d31-4a8a-9214-406124ed2dd4/volumes" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.287595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "87e1294e-e6ee-46df-ab5b-9be0e1d34fce" (UID: "87e1294e-e6ee-46df-ab5b-9be0e1d34fce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.287809 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" path="/var/lib/kubelet/pods/6c40b75d-e715-4735-84f7-65a4a9b9ebe1/volumes" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.288817 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7155427b-59ba-48c3-bf11-c34dd9426b6c" path="/var/lib/kubelet/pods/7155427b-59ba-48c3-bf11-c34dd9426b6c/volumes" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289883 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289904 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289916 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289940 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289951 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289960 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tj69s\" (UniqueName: \"kubernetes.io/projected/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kube-api-access-tj69s\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289971 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4jqrp\" (UniqueName: \"kubernetes.io/projected/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-kube-api-access-4jqrp\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289980 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289989 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.289998 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290019 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290029 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290039 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290049 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290058 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2bh8f\" (UniqueName: \"kubernetes.io/projected/a5c89536-0f0a-4f35-9ded-2885260ab201-kube-api-access-2bh8f\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290068 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kqtgz\" (UniqueName: \"kubernetes.io/projected/305f687e-8e30-410c-b78d-6fd4f2d9191a-kube-api-access-kqtgz\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290076 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290084 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290103 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290114 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ktxww\" (UniqueName: \"kubernetes.io/projected/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43-kube-api-access-ktxww\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290124 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/a5c89536-0f0a-4f35-9ded-2885260ab201-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290134 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290155 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ab455f5a-78d1-44d0-b6fa-263b24010aef-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290165 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9l7dg\" (UniqueName: \"kubernetes.io/projected/2104c14c-16c5-4732-951f-dbde5da48b75-kube-api-access-9l7dg\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290174 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290183 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sv8n6\" (UniqueName: \"kubernetes.io/projected/ab455f5a-78d1-44d0-b6fa-263b24010aef-kube-api-access-sv8n6\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290207 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290217 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/587b6cbe-7e51-4177-a229-f6a608d0fcab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290226 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.290319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data" (OuterVolumeSpecName: "config-data") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.291026 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" path="/var/lib/kubelet/pods/7b69cf86-c5aa-4cce-8122-35443043c210/volumes" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.302651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-config-data" (OuterVolumeSpecName: "config-data") pod "8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" (UID: "8a788ac5-aa39-45cc-b04f-3b8e0e819ef7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.323432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.323910 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.324445 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.328832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "305f687e-8e30-410c-b78d-6fd4f2d9191a" (UID: "305f687e-8e30-410c-b78d-6fd4f2d9191a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.330161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-config-data" (OuterVolumeSpecName: "config-data") pod "305f687e-8e30-410c-b78d-6fd4f2d9191a" (UID: "305f687e-8e30-410c-b78d-6fd4f2d9191a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.332352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "997ee964-de30-4b1b-b360-a31378e9a928" (UID: "997ee964-de30-4b1b-b360-a31378e9a928"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.340475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.346338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.353711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.359327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.360098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "f7633e95-a9a0-413f-8827-a24a1f6b0272" (UID: "f7633e95-a9a0-413f-8827-a24a1f6b0272"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.360566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" event={"ID":"13de8ad4-38e7-432c-8502-dbbcc423f446","Type":"ContainerStarted","Data":"10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d"} Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.360761 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.362696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.362898 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.362980 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363098 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363254 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363277 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-0e56-account-create-5ml5l" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363967 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement5148-account-delete-tmw49" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.364014 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.363284 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.364515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.364620 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.364678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bc74f485b-vm922" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.364707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.364760 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.375080 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.389381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-config-data" (OuterVolumeSpecName: "config-data") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.393927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wzr\" (UniqueName: \"kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.393980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zjg8g\" (UniqueName: \"kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.394049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts\") pod \"keystone80e8-account-delete-np5dv\" (UID: \"a4942ef7-6b85-4f9c-a8e0-c80a57e06c61\") " pod="openstack-kuttl-tests/keystone80e8-account-delete-np5dv" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.394092 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts\") pod \"keystone-80e8-account-create-f9zmz\" (UID: \"878afaf4-5555-4258-a0fb-a41798f792b0\") " pod="openstack-kuttl-tests/keystone-80e8-account-create-f9zmz" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396822 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396845 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396855 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396867 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396876 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396885 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396895 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/997ee964-de30-4b1b-b360-a31378e9a928-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396931 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396940 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396966 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396977 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7633e95-a9a0-413f-8827-a24a1f6b0272-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396986 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.396996 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.397005 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.397013 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/305f687e-8e30-410c-b78d-6fd4f2d9191a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.397089 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.397141 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:31.397125663 +0000 UTC m=+3770.097787481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : configmap "openstack-scripts" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.398153 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.398239 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:31.398221252 +0000 UTC m=+3770.098883070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : configmap "openstack-scripts" not found Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.400775 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "87e1294e-e6ee-46df-ab5b-9be0e1d34fce" (UID: "87e1294e-e6ee-46df-ab5b-9be0e1d34fce"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.402673 4769 projected.go:194] Error preparing data for projected volume kube-api-access-r8wzr for pod openstack-kuttl-tests/keystone80e8-account-delete-np5dv: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.402742 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr podName:a4942ef7-6b85-4f9c-a8e0-c80a57e06c61 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:31.402722943 +0000 UTC m=+3770.103384761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8wzr" (UniqueName: "kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr") pod "keystone80e8-account-delete-np5dv" (UID: "a4942ef7-6b85-4f9c-a8e0-c80a57e06c61") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.402795 4769 projected.go:194] Error preparing data for projected volume kube-api-access-zjg8g for pod openstack-kuttl-tests/keystone-80e8-account-create-f9zmz: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:27 crc kubenswrapper[4769]: E1121 12:53:27.402821 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g podName:878afaf4-5555-4258-a0fb-a41798f792b0 nodeName:}" failed. No retries permitted until 2025-11-21 12:53:31.402814446 +0000 UTC m=+3770.103476264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjg8g" (UniqueName: "kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g") pod "keystone-80e8-account-create-f9zmz" (UID: "878afaf4-5555-4258-a0fb-a41798f792b0") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.408059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "87e1294e-e6ee-46df-ab5b-9be0e1d34fce" (UID: "87e1294e-e6ee-46df-ab5b-9be0e1d34fce"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.408222 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" podStartSLOduration=8.40817172 podStartE2EDuration="8.40817172s" podCreationTimestamp="2025-11-21 12:53:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:53:27.403521915 +0000 UTC m=+3766.104183733" watchObservedRunningTime="2025-11-21 12:53:27.40817172 +0000 UTC m=+3766.108833528" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.409493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" (UID: "8a788ac5-aa39-45cc-b04f-3b8e0e819ef7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.413443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "21b8e395-ab14-4f2c-a784-7ada05455d6a" (UID: "21b8e395-ab14-4f2c-a784-7ada05455d6a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.437083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "a2614ea4-9b84-4ab4-8e80-fe7a005e3322" (UID: "a2614ea4-9b84-4ab4-8e80-fe7a005e3322"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.437223 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ab455f5a-78d1-44d0-b6fa-263b24010aef" (UID: "ab455f5a-78d1-44d0-b6fa-263b24010aef"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.437981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-config-data" (OuterVolumeSpecName: "config-data") pod "a5c89536-0f0a-4f35-9ded-2885260ab201" (UID: "a5c89536-0f0a-4f35-9ded-2885260ab201"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498248 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a2614ea4-9b84-4ab4-8e80-fe7a005e3322-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498305 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498314 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5c89536-0f0a-4f35-9ded-2885260ab201-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498323 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab455f5a-78d1-44d0-b6fa-263b24010aef-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498331 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b8e395-ab14-4f2c-a784-7ada05455d6a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498340 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87e1294e-e6ee-46df-ab5b-9be0e1d34fce-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.498366 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.835860 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.890404 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.902905 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.909381 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.910436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-fernet-keys\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.910634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-combined-ca-bundle\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.910884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-internal-tls-certs\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.911065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-public-tls-certs\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.911222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-credential-keys\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.911303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-config-data\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.911439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jgrq\" (UniqueName: \"kubernetes.io/projected/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-kube-api-access-6jgrq\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.911543 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-scripts\") pod \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\" (UID: \"020ca0e6-01ad-44de-abab-3fe5cfbba0e6\") " Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.916173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.920243 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.929814 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-5ml5l"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.932242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-kube-api-access-6jgrq" (OuterVolumeSpecName: "kube-api-access-6jgrq") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "kube-api-access-6jgrq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.932783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.938597 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-0e56-account-create-5ml5l"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.944838 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-scripts" (OuterVolumeSpecName: "scripts") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.952498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.968668 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.980067 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:53:27 crc kubenswrapper[4769]: I1121 12:53:27.992020 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.002853 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement5148-account-delete-tmw49"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.012239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-config-data" (OuterVolumeSpecName: "config-data") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.012432 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement5148-account-delete-tmw49"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.023359 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6jgrq\" (UniqueName: \"kubernetes.io/projected/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-kube-api-access-6jgrq\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.023391 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.023401 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.023414 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.023423 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.028777 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone80e8-account-delete-np5dv"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.030793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.036181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.037081 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone80e8-account-delete-np5dv"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.049342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.053381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "020ca0e6-01ad-44de-abab-3fe5cfbba0e6" (UID: "020ca0e6-01ad-44de-abab-3fe5cfbba0e6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.057827 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-695c9dfdfb-wrgb8"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.075561 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.104207 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-f9zmz"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.111637 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-80e8-account-create-f9zmz"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.114882 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.120915 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7bc74f485b-vm922"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.126053 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.126090 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.126104 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r8wzr\" (UniqueName: \"kubernetes.io/projected/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61-kube-api-access-r8wzr\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.126117 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.126129 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/020ca0e6-01ad-44de-abab-3fe5cfbba0e6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.128134 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7bc74f485b-vm922"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.134555 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.140909 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-86549cd56b-kdm4p"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.150385 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.156085 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.162008 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.167313 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.172943 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.178721 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.184458 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.189442 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.194622 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.199438 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e15176d9-214d-4f78-bb65-122a9db292d9-pod-info\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-plugins-conf\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-667lp\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-kube-api-access-667lp\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227372 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-confd\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-pod-info\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-erlang-cookie\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227541 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e15176d9-214d-4f78-bb65-122a9db292d9-erlang-cookie-secret\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-tls\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-plugins\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-erlang-cookie\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-erlang-cookie-secret\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-plugins\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsrg6\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-kube-api-access-hsrg6\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-server-conf\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-plugins-conf\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-server-conf\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-tls\") pod \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\" (UID: \"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.227860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-confd\") pod \"e15176d9-214d-4f78-bb65-122a9db292d9\" (UID: \"e15176d9-214d-4f78-bb65-122a9db292d9\") " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.228137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.228168 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zjg8g\" (UniqueName: \"kubernetes.io/projected/878afaf4-5555-4258-a0fb-a41798f792b0-kube-api-access-zjg8g\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.228246 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/878afaf4-5555-4258-a0fb-a41798f792b0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.228480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.228995 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.230018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.230285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.230491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e15176d9-214d-4f78-bb65-122a9db292d9-pod-info" (OuterVolumeSpecName: "pod-info") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.231378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.231408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-kube-api-access-667lp" (OuterVolumeSpecName: "kube-api-access-667lp") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "kube-api-access-667lp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.231411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "persistence") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.233042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15176d9-214d-4f78-bb65-122a9db292d9-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.233280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-pod-info" (OuterVolumeSpecName: "pod-info") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.233660 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "persistence") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.234124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.234664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-kube-api-access-hsrg6" (OuterVolumeSpecName: "kube-api-access-hsrg6") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "kube-api-access-hsrg6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.236215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.236898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.251818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data" (OuterVolumeSpecName: "config-data") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.253096 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data" (OuterVolumeSpecName: "config-data") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.267982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-server-conf" (OuterVolumeSpecName: "server-conf") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.269204 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-server-conf" (OuterVolumeSpecName: "server-conf") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.307042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" (UID: "8a91e2b2-acf3-4556-9adb-d6ce7a0dd705"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.310052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "e15176d9-214d-4f78-bb65-122a9db292d9" (UID: "e15176d9-214d-4f78-bb65-122a9db292d9"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330170 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e15176d9-214d-4f78-bb65-122a9db292d9-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330220 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330231 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330243 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330253 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330264 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330276 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hsrg6\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-kube-api-access-hsrg6\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330284 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330293 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330303 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330311 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330318 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330326 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e15176d9-214d-4f78-bb65-122a9db292d9-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330335 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e15176d9-214d-4f78-bb65-122a9db292d9-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330344 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e15176d9-214d-4f78-bb65-122a9db292d9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330353 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330361 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-667lp\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-kube-api-access-667lp\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330369 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330377 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330385 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330417 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.330429 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.348772 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.349727 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.373729 4769 generic.go:334] "Generic (PLEG): container finished" podID="e15176d9-214d-4f78-bb65-122a9db292d9" containerID="c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2" exitCode=0 Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.373775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"e15176d9-214d-4f78-bb65-122a9db292d9","Type":"ContainerDied","Data":"c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2"} Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.373810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.374158 4769 scope.go:117] "RemoveContainer" containerID="c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.374140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"e15176d9-214d-4f78-bb65-122a9db292d9","Type":"ContainerDied","Data":"bfc7f1b8094e6d4bb2c7045e068b48ab5e7f32ad4f0bbc62a99167cc0b3978a9"} Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.377531 4769 generic.go:334] "Generic (PLEG): container finished" podID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerID="37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca" exitCode=0 Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.377634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705","Type":"ContainerDied","Data":"37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca"} Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.377670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8a91e2b2-acf3-4556-9adb-d6ce7a0dd705","Type":"ContainerDied","Data":"c31da4d2c8c0547295af46d0d7f41e4722ac3c8c51575ad1167e08eee6a63eb5"} Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.378157 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.381947 4769 generic.go:334] "Generic (PLEG): container finished" podID="020ca0e6-01ad-44de-abab-3fe5cfbba0e6" containerID="08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4" exitCode=0 Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.381988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" event={"ID":"020ca0e6-01ad-44de-abab-3fe5cfbba0e6","Type":"ContainerDied","Data":"08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4"} Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.382032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" event={"ID":"020ca0e6-01ad-44de-abab-3fe5cfbba0e6","Type":"ContainerDied","Data":"90283822b4a2753d8d17608e5ea272409854734a6f4efa5c98bbd2ab356c0a73"} Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.382095 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b54468f77-dq8cd" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.409755 4769 scope.go:117] "RemoveContainer" containerID="4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.437305 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.437403 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.449348 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b54468f77-dq8cd"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.453648 4769 scope.go:117] "RemoveContainer" containerID="c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2" Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.454996 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2\": container with ID starting with c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2 not found: ID does not exist" containerID="c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.455046 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2"} err="failed to get container status \"c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2\": rpc error: code = NotFound desc = could not find container \"c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2\": container with ID starting with c9245238201e27394f2da607c2100dcf1e779c87c23b7957edc84617a1e74ae2 not found: ID does not exist" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.455077 4769 scope.go:117] "RemoveContainer" containerID="4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d" Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.455535 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d\": container with ID starting with 4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d not found: ID does not exist" containerID="4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.455584 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d"} err="failed to get container status \"4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d\": rpc error: code = NotFound desc = could not find container \"4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d\": container with ID starting with 4db233f95af11fc338bd872cadf870a50dacaefddd1036d492d03855b4f1da2d not found: ID does not exist" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.455614 4769 scope.go:117] "RemoveContainer" containerID="37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.470219 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-b54468f77-dq8cd"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.487284 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.490334 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.494295 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.495344 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.496772 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.496833 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerName="nova-cell0-conductor-conductor" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.500635 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.501418 4769 scope.go:117] "RemoveContainer" containerID="bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.505332 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.520948 4769 scope.go:117] "RemoveContainer" containerID="37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca" Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.522737 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca\": container with ID starting with 37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca not found: ID does not exist" containerID="37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.522781 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca"} err="failed to get container status \"37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca\": rpc error: code = NotFound desc = could not find container \"37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca\": container with ID starting with 37cfe75572fbc6124efdc9a04406f4accd2fb8ecb4d6e1c29dfef8566e2cf5ca not found: ID does not exist" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.522808 4769 scope.go:117] "RemoveContainer" containerID="bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc" Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.523124 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc\": container with ID starting with bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc not found: ID does not exist" containerID="bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.523143 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc"} err="failed to get container status \"bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc\": rpc error: code = NotFound desc = could not find container \"bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc\": container with ID starting with bc07eae1acc2687a651f2741c8c67ff77f140615a0aa0a154f561de675f9d1bc not found: ID does not exist" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.523156 4769 scope.go:117] "RemoveContainer" containerID="08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.605298 4769 scope.go:117] "RemoveContainer" containerID="08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4" Nov 21 12:53:28 crc kubenswrapper[4769]: E1121 12:53:28.605931 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4\": container with ID starting with 08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4 not found: ID does not exist" containerID="08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4" Nov 21 12:53:28 crc kubenswrapper[4769]: I1121 12:53:28.605997 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4"} err="failed to get container status \"08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4\": rpc error: code = NotFound desc = could not find container \"08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4\": container with ID starting with 08e9bbf605a477e669bd994505e50ac0d89093e574a1c2d441af89c7f3eed4a4 not found: ID does not exist" Nov 21 12:53:29 crc kubenswrapper[4769]: E1121 12:53:29.030768 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95266f8c_7cec_46ff_bc99_c6264c943d50.slice/crio-bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95266f8c_7cec_46ff_bc99_c6264c943d50.slice/crio-conmon-bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.289354 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="020ca0e6-01ad-44de-abab-3fe5cfbba0e6" path="/var/lib/kubelet/pods/020ca0e6-01ad-44de-abab-3fe5cfbba0e6/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.290560 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" path="/var/lib/kubelet/pods/1c629d36-bc3d-4c54-b61b-d27cf0cb1d84/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.300160 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2104c14c-16c5-4732-951f-dbde5da48b75" path="/var/lib/kubelet/pods/2104c14c-16c5-4732-951f-dbde5da48b75/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.300674 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" path="/var/lib/kubelet/pods/21b8e395-ab14-4f2c-a784-7ada05455d6a/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.301173 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305f687e-8e30-410c-b78d-6fd4f2d9191a" path="/var/lib/kubelet/pods/305f687e-8e30-410c-b78d-6fd4f2d9191a/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.302128 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" path="/var/lib/kubelet/pods/587b6cbe-7e51-4177-a229-f6a608d0fcab/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.302543 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878afaf4-5555-4258-a0fb-a41798f792b0" path="/var/lib/kubelet/pods/878afaf4-5555-4258-a0fb-a41798f792b0/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.302847 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" path="/var/lib/kubelet/pods/87e1294e-e6ee-46df-ab5b-9be0e1d34fce/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.303776 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" path="/var/lib/kubelet/pods/8a788ac5-aa39-45cc-b04f-3b8e0e819ef7/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.304397 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" path="/var/lib/kubelet/pods/8a91e2b2-acf3-4556-9adb-d6ce7a0dd705/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.304916 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="997ee964-de30-4b1b-b360-a31378e9a928" path="/var/lib/kubelet/pods/997ee964-de30-4b1b-b360-a31378e9a928/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.305967 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" path="/var/lib/kubelet/pods/a2614ea4-9b84-4ab4-8e80-fe7a005e3322/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.306382 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4942ef7-6b85-4f9c-a8e0-c80a57e06c61" path="/var/lib/kubelet/pods/a4942ef7-6b85-4f9c-a8e0-c80a57e06c61/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.306716 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" path="/var/lib/kubelet/pods/a5c89536-0f0a-4f35-9ded-2885260ab201/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.307995 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" path="/var/lib/kubelet/pods/ab455f5a-78d1-44d0-b6fa-263b24010aef/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.308690 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" path="/var/lib/kubelet/pods/c87fc5bb-aceb-45d9-883d-5ffc9b65ea43/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.309847 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" path="/var/lib/kubelet/pods/e15176d9-214d-4f78-bb65-122a9db292d9/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.310642 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e83044ec-e522-4705-baac-c8344c6bf994" path="/var/lib/kubelet/pods/e83044ec-e522-4705-baac-c8344c6bf994/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.311262 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7633e95-a9a0-413f-8827-a24a1f6b0272" path="/var/lib/kubelet/pods/f7633e95-a9a0-413f-8827-a24a1f6b0272/volumes" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.375337 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.407394 4769 generic.go:334] "Generic (PLEG): container finished" podID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" exitCode=0 Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.407462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"95266f8c-7cec-46ff-bc99-c6264c943d50","Type":"ContainerDied","Data":"bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28"} Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.407488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"95266f8c-7cec-46ff-bc99-c6264c943d50","Type":"ContainerDied","Data":"7b0a99ec4413943be6d4aed6fb74ee171d87da628382c167f0bac303c390f077"} Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.407507 4769 scope.go:117] "RemoveContainer" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.407614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.432661 4769 scope.go:117] "RemoveContainer" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" Nov 21 12:53:29 crc kubenswrapper[4769]: E1121 12:53:29.433110 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28\": container with ID starting with bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28 not found: ID does not exist" containerID="bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.433149 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28"} err="failed to get container status \"bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28\": rpc error: code = NotFound desc = could not find container \"bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28\": container with ID starting with bdd4341617e8b8bb05d8bdcbf5750f22a58df678571f1ee1bf2d3ee618704d28 not found: ID does not exist" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.565284 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjd7h\" (UniqueName: \"kubernetes.io/projected/95266f8c-7cec-46ff-bc99-c6264c943d50-kube-api-access-qjd7h\") pod \"95266f8c-7cec-46ff-bc99-c6264c943d50\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.565862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-config-data\") pod \"95266f8c-7cec-46ff-bc99-c6264c943d50\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.565932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-combined-ca-bundle\") pod \"95266f8c-7cec-46ff-bc99-c6264c943d50\" (UID: \"95266f8c-7cec-46ff-bc99-c6264c943d50\") " Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.572323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95266f8c-7cec-46ff-bc99-c6264c943d50-kube-api-access-qjd7h" (OuterVolumeSpecName: "kube-api-access-qjd7h") pod "95266f8c-7cec-46ff-bc99-c6264c943d50" (UID: "95266f8c-7cec-46ff-bc99-c6264c943d50"). InnerVolumeSpecName "kube-api-access-qjd7h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.601516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "95266f8c-7cec-46ff-bc99-c6264c943d50" (UID: "95266f8c-7cec-46ff-bc99-c6264c943d50"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.609232 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-config-data" (OuterVolumeSpecName: "config-data") pod "95266f8c-7cec-46ff-bc99-c6264c943d50" (UID: "95266f8c-7cec-46ff-bc99-c6264c943d50"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.669723 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qjd7h\" (UniqueName: \"kubernetes.io/projected/95266f8c-7cec-46ff-bc99-c6264c943d50-kube-api-access-qjd7h\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.669810 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.669840 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95266f8c-7cec-46ff-bc99-c6264c943d50-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.754539 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:53:29 crc kubenswrapper[4769]: I1121 12:53:29.762068 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:53:30 crc kubenswrapper[4769]: I1121 12:53:30.464171 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.178:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:30 crc kubenswrapper[4769]: I1121 12:53:30.475297 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.193:8775/\": context deadline exceeded" Nov 21 12:53:30 crc kubenswrapper[4769]: I1121 12:53:30.475393 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.193:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.069817 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.170759 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w"] Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.172546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" containerName="dnsmasq-dns" containerID="cri-o://2e5af6caee329cd4044bb1bc25e636270904ca337e43a5bd9732ac3031b7e071" gracePeriod=10 Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.298307 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" path="/var/lib/kubelet/pods/95266f8c-7cec-46ff-bc99-c6264c943d50/volumes" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.447266 4769 generic.go:334] "Generic (PLEG): container finished" podID="d549d9ab-e972-47bb-b81e-7858377a6677" containerID="2e5af6caee329cd4044bb1bc25e636270904ca337e43a5bd9732ac3031b7e071" exitCode=0 Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.447322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" event={"ID":"d549d9ab-e972-47bb-b81e-7858377a6677","Type":"ContainerDied","Data":"2e5af6caee329cd4044bb1bc25e636270904ca337e43a5bd9732ac3031b7e071"} Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.737880 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.912748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gmwl\" (UniqueName: \"kubernetes.io/projected/d549d9ab-e972-47bb-b81e-7858377a6677-kube-api-access-4gmwl\") pod \"d549d9ab-e972-47bb-b81e-7858377a6677\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.912915 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dns-swift-storage-0\") pod \"d549d9ab-e972-47bb-b81e-7858377a6677\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.913034 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-config\") pod \"d549d9ab-e972-47bb-b81e-7858377a6677\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.913143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dnsmasq-svc\") pod \"d549d9ab-e972-47bb-b81e-7858377a6677\" (UID: \"d549d9ab-e972-47bb-b81e-7858377a6677\") " Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.932967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d549d9ab-e972-47bb-b81e-7858377a6677-kube-api-access-4gmwl" (OuterVolumeSpecName: "kube-api-access-4gmwl") pod "d549d9ab-e972-47bb-b81e-7858377a6677" (UID: "d549d9ab-e972-47bb-b81e-7858377a6677"). InnerVolumeSpecName "kube-api-access-4gmwl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.958659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "d549d9ab-e972-47bb-b81e-7858377a6677" (UID: "d549d9ab-e972-47bb-b81e-7858377a6677"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.974933 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-config" (OuterVolumeSpecName: "config") pod "d549d9ab-e972-47bb-b81e-7858377a6677" (UID: "d549d9ab-e972-47bb-b81e-7858377a6677"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:31 crc kubenswrapper[4769]: I1121 12:53:31.987904 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "d549d9ab-e972-47bb-b81e-7858377a6677" (UID: "d549d9ab-e972-47bb-b81e-7858377a6677"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.015910 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4gmwl\" (UniqueName: \"kubernetes.io/projected/d549d9ab-e972-47bb-b81e-7858377a6677-kube-api-access-4gmwl\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.015985 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.016002 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.016015 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d549d9ab-e972-47bb-b81e-7858377a6677-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.462041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" event={"ID":"d549d9ab-e972-47bb-b81e-7858377a6677","Type":"ContainerDied","Data":"8c38026ded8ee2680d8a86dddfc805a2e9b209ec0f7600d86d7bce292ae78d71"} Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.462110 4769 scope.go:117] "RemoveContainer" containerID="2e5af6caee329cd4044bb1bc25e636270904ca337e43a5bd9732ac3031b7e071" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.462227 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.517308 4769 scope.go:117] "RemoveContainer" containerID="72161a21ac90e3a5a679f990f2208e5b6e397a57919fe36d507bdd1e4c2c1ae6" Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.524990 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w"] Nov 21 12:53:32 crc kubenswrapper[4769]: I1121 12:53:32.541302 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7595fdc8b5-ddt9w"] Nov 21 12:53:33 crc kubenswrapper[4769]: I1121 12:53:33.285400 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" path="/var/lib/kubelet/pods/d549d9ab-e972-47bb-b81e-7858377a6677/volumes" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.175437 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.294742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-public-tls-certs\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.294833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-ovndb-tls-certs\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.294895 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72q5d\" (UniqueName: \"kubernetes.io/projected/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-kube-api-access-72q5d\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.294953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-config\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.295026 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-combined-ca-bundle\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.295072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-internal-tls-certs\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.295095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-httpd-config\") pod \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\" (UID: \"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b\") " Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.300623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.302881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-kube-api-access-72q5d" (OuterVolumeSpecName: "kube-api-access-72q5d") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "kube-api-access-72q5d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.366844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.374340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.375420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-config" (OuterVolumeSpecName: "config") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.379679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.380398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" (UID: "8f99fa56-6bf9-4fbb-a9b4-56fdb210808b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398583 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398637 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398655 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-72q5d\" (UniqueName: \"kubernetes.io/projected/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-kube-api-access-72q5d\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398669 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398681 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398720 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.398734 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.545172 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerID="4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec" exitCode=0 Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.545242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" event={"ID":"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b","Type":"ContainerDied","Data":"4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec"} Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.545273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" event={"ID":"8f99fa56-6bf9-4fbb-a9b4-56fdb210808b","Type":"ContainerDied","Data":"a5cd19b41e676c0220e9b6e884fa438ad23b450510a077c4db4ce9aaa100b28c"} Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.545293 4769 scope.go:117] "RemoveContainer" containerID="c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.546008 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cd86bc48d-6ff2l" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.576044 4769 scope.go:117] "RemoveContainer" containerID="4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.610771 4769 scope.go:117] "RemoveContainer" containerID="c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.615714 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-cd86bc48d-6ff2l"] Nov 21 12:53:36 crc kubenswrapper[4769]: E1121 12:53:36.615836 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3\": container with ID starting with c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3 not found: ID does not exist" containerID="c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.615912 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3"} err="failed to get container status \"c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3\": rpc error: code = NotFound desc = could not find container \"c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3\": container with ID starting with c0163c4352246478f109c3d74e4d2f38ecc14b5a7d71b8741328e96793fc1de3 not found: ID does not exist" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.615961 4769 scope.go:117] "RemoveContainer" containerID="4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec" Nov 21 12:53:36 crc kubenswrapper[4769]: E1121 12:53:36.616642 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec\": container with ID starting with 4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec not found: ID does not exist" containerID="4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.616924 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec"} err="failed to get container status \"4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec\": rpc error: code = NotFound desc = could not find container \"4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec\": container with ID starting with 4f6f3425c86563d64ec951a36cc4ca0a1475f89428481335ca3c2f246e6f7aec not found: ID does not exist" Nov 21 12:53:36 crc kubenswrapper[4769]: I1121 12:53:36.630021 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-cd86bc48d-6ff2l"] Nov 21 12:53:37 crc kubenswrapper[4769]: I1121 12:53:37.290501 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" path="/var/lib/kubelet/pods/8f99fa56-6bf9-4fbb-a9b4-56fdb210808b/volumes" Nov 21 12:53:41 crc kubenswrapper[4769]: I1121 12:53:41.274953 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:53:41 crc kubenswrapper[4769]: E1121 12:53:41.276153 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.708091 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerID="257dab1ffc061cbb231971f188cc3a64f672f447b3c3ab3367d25f7688ac3f1c" exitCode=137 Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.708179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"257dab1ffc061cbb231971f188cc3a64f672f447b3c3ab3367d25f7688ac3f1c"} Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.783308 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-lock\") pod \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96hsd\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-kube-api-access-96hsd\") pod \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936290 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-etc-swift\") pod \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-cache\") pod \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\" (UID: \"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6\") " Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-lock" (OuterVolumeSpecName: "lock") pod "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" (UID: "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.936990 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.937421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-cache" (OuterVolumeSpecName: "cache") pod "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" (UID: "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.942128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "swift") pod "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" (UID: "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.942220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" (UID: "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:50 crc kubenswrapper[4769]: I1121 12:53:50.944275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-kube-api-access-96hsd" (OuterVolumeSpecName: "kube-api-access-96hsd") pod "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" (UID: "bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6"). InnerVolumeSpecName "kube-api-access-96hsd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.038430 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.038481 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.038494 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-96hsd\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-kube-api-access-96hsd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.038504 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.055489 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.139833 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.728900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6","Type":"ContainerDied","Data":"f6bb5fdec2e26f7d8d675ab22f907d0148102761233c6425ffeb36b49b97cf0c"} Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.729003 4769 scope.go:117] "RemoveContainer" containerID="257dab1ffc061cbb231971f188cc3a64f672f447b3c3ab3367d25f7688ac3f1c" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.729039 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.802436 4769 scope.go:117] "RemoveContainer" containerID="d954ec9f9fd375f8d21fbfc90930cf9f0e851e88125432c9f19c141bda5ec67e" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.850337 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.881518 4769 scope.go:117] "RemoveContainer" containerID="547b91c62af6867a861c1e2fbf267059684c898f2fcb3366746713087f93e5be" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.882688 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.932355 4769 scope.go:117] "RemoveContainer" containerID="25a745b27d2c48104dfccc1ab9c9b443ce48a7712cdbd4f77cd19d5c615eaf78" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.970536 4769 scope.go:117] "RemoveContainer" containerID="b18fcced732571fdaf74bcc2322b16cde636569d18694efad32ecf13a5b6157d" Nov 21 12:53:51 crc kubenswrapper[4769]: I1121 12:53:51.989676 4769 scope.go:117] "RemoveContainer" containerID="bc1d08820888a328fae748ef4812e194104e9bb4a7454e3a39e99c3c3223bd80" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.009471 4769 scope.go:117] "RemoveContainer" containerID="23d3165d82d9747d4ed22655a6d81d291fe94942a2c349dff1450546b509c275" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.036061 4769 scope.go:117] "RemoveContainer" containerID="bedcad83e4334c7e83ddc8624d4e1318bb1a57e1e4708e86d301f18e2add935c" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.054533 4769 scope.go:117] "RemoveContainer" containerID="e26086b4183e76bc744b11509cca5bb4aef9eb6f6890bc99c8112654d2f4d82a" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.080067 4769 scope.go:117] "RemoveContainer" containerID="f745168b4e9bc49314d46d470a8a6b9d97a7ca1e17567933b5c8223545d657d5" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.108883 4769 scope.go:117] "RemoveContainer" containerID="9ffdf07b6ca311a612fe435c9d96f794f755c1b06d7c976066d7a9854520d7fd" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.127802 4769 scope.go:117] "RemoveContainer" containerID="fb3bb295c52508ab61ed6d4059c32909e643abc0d7b8c00eb3502e829c3783f7" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.152236 4769 scope.go:117] "RemoveContainer" containerID="32ca7892fd1380c714d6d0afeaa3000431822f1ee42afd0c21cf0741874b1826" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.178097 4769 scope.go:117] "RemoveContainer" containerID="21820468085f3cf013463501cb4db298d3fc627940f0c92b3f08219872331bee" Nov 21 12:53:52 crc kubenswrapper[4769]: I1121 12:53:52.196335 4769 scope.go:117] "RemoveContainer" containerID="1ccc56951cf265eacc5d84661707717cfd5870ebadfbbeb8597e00cb3d93fa11" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.122312 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pode5513101-8910-4a2f-ac1e-734789ae3199"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pode5513101-8910-4a2f-ac1e-734789ae3199] : Timed out while waiting for systemd to remove kubepods-besteffort-pode5513101_8910_4a2f_ac1e_734789ae3199.slice" Nov 21 12:53:53 crc kubenswrapper[4769]: E1121 12:53:53.122376 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pode5513101-8910-4a2f-ac1e-734789ae3199] : unable to destroy cgroup paths for cgroup [kubepods besteffort pode5513101-8910-4a2f-ac1e-734789ae3199] : Timed out while waiting for systemd to remove kubepods-besteffort-pode5513101_8910_4a2f_ac1e_734789ae3199.slice" pod="openstack-kuttl-tests/ovn-northd-0" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.132694 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod34ffb6e3-3335-41fe-a8f9-c2366177ab92"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod34ffb6e3-3335-41fe-a8f9-c2366177ab92] : Timed out while waiting for systemd to remove kubepods-besteffort-pod34ffb6e3_3335_41fe_a8f9_c2366177ab92.slice" Nov 21 12:53:53 crc kubenswrapper[4769]: E1121 12:53:53.132733 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod34ffb6e3-3335-41fe-a8f9-c2366177ab92] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod34ffb6e3-3335-41fe-a8f9-c2366177ab92] : Timed out while waiting for systemd to remove kubepods-besteffort-pod34ffb6e3_3335_41fe_a8f9_c2366177ab92.slice" pod="openstack-kuttl-tests/openstackclient" podUID="34ffb6e3-3335-41fe-a8f9-c2366177ab92" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.285682 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" path="/var/lib/kubelet/pods/bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6/volumes" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.367113 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod1c895594-ffd6-4dde-b02c-f949e3ead50f"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod1c895594-ffd6-4dde-b02c-f949e3ead50f] : Timed out while waiting for systemd to remove kubepods-besteffort-pod1c895594_ffd6_4dde_b02c_f949e3ead50f.slice" Nov 21 12:53:53 crc kubenswrapper[4769]: E1121 12:53:53.367556 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod1c895594-ffd6-4dde-b02c-f949e3ead50f] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod1c895594-ffd6-4dde-b02c-f949e3ead50f] : Timed out while waiting for systemd to remove kubepods-besteffort-pod1c895594_ffd6_4dde_b02c_f949e3ead50f.slice" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.765706 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.766620 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.767125 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.856151 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.875903 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.884849 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:53:53 crc kubenswrapper[4769]: I1121 12:53:53.893106 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.303026 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c895594-ffd6-4dde-b02c-f949e3ead50f" path="/var/lib/kubelet/pods/1c895594-ffd6-4dde-b02c-f949e3ead50f/volumes" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.304240 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5513101-8910-4a2f-ac1e-734789ae3199" path="/var/lib/kubelet/pods/e5513101-8910-4a2f-ac1e-734789ae3199/volumes" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.471079 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.192:8774/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.471286 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.192:8774/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.639121 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.653032 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.683677 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.704042 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kllkx\" (UniqueName: \"kubernetes.io/projected/38af882b-baa9-4fff-bb77-941070a30942-kube-api-access-kllkx\") pod \"38af882b-baa9-4fff-bb77-941070a30942\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716361 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvd9v\" (UniqueName: \"kubernetes.io/projected/5e8a67f8-1ea8-401e-8f61-66db57f69b22-kube-api-access-bvd9v\") pod \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38af882b-baa9-4fff-bb77-941070a30942-operator-scripts\") pod \"38af882b-baa9-4fff-bb77-941070a30942\" (UID: \"38af882b-baa9-4fff-bb77-941070a30942\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716444 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdq2\" (UniqueName: \"kubernetes.io/projected/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-kube-api-access-2cdq2\") pod \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-operator-scripts\") pod \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\" (UID: \"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e8a67f8-1ea8-401e-8f61-66db57f69b22-operator-scripts\") pod \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\" (UID: \"5e8a67f8-1ea8-401e-8f61-66db57f69b22\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.716540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58c422da-2667-4d11-b5b5-115706d66b58-operator-scripts\") pod \"58c422da-2667-4d11-b5b5-115706d66b58\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.718007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58c422da-2667-4d11-b5b5-115706d66b58-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "58c422da-2667-4d11-b5b5-115706d66b58" (UID: "58c422da-2667-4d11-b5b5-115706d66b58"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.719256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" (UID: "1b8ef1c0-ec47-4f03-b37d-d413d1d0de55"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.719821 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e8a67f8-1ea8-401e-8f61-66db57f69b22-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5e8a67f8-1ea8-401e-8f61-66db57f69b22" (UID: "5e8a67f8-1ea8-401e-8f61-66db57f69b22"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.722046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38af882b-baa9-4fff-bb77-941070a30942-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "38af882b-baa9-4fff-bb77-941070a30942" (UID: "38af882b-baa9-4fff-bb77-941070a30942"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.725668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38af882b-baa9-4fff-bb77-941070a30942-kube-api-access-kllkx" (OuterVolumeSpecName: "kube-api-access-kllkx") pod "38af882b-baa9-4fff-bb77-941070a30942" (UID: "38af882b-baa9-4fff-bb77-941070a30942"). InnerVolumeSpecName "kube-api-access-kllkx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.730287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-kube-api-access-2cdq2" (OuterVolumeSpecName: "kube-api-access-2cdq2") pod "1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" (UID: "1b8ef1c0-ec47-4f03-b37d-d413d1d0de55"). InnerVolumeSpecName "kube-api-access-2cdq2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.741329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8a67f8-1ea8-401e-8f61-66db57f69b22-kube-api-access-bvd9v" (OuterVolumeSpecName: "kube-api-access-bvd9v") pod "5e8a67f8-1ea8-401e-8f61-66db57f69b22" (UID: "5e8a67f8-1ea8-401e-8f61-66db57f69b22"). InnerVolumeSpecName "kube-api-access-bvd9v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.778559 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.793311 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e8a67f8-1ea8-401e-8f61-66db57f69b22" containerID="a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6" exitCode=137 Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.793406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" event={"ID":"5e8a67f8-1ea8-401e-8f61-66db57f69b22","Type":"ContainerDied","Data":"a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.793402 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.793443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4" event={"ID":"5e8a67f8-1ea8-401e-8f61-66db57f69b22","Type":"ContainerDied","Data":"7cc507fa13f42fb1544289a9d39a42304ff77dd93d48b0da04e3360ae51e1914"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.793458 4769 scope.go:117] "RemoveContainer" containerID="a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.798057 4769 generic.go:334] "Generic (PLEG): container finished" podID="057ccf26-b606-4673-9512-c2f4df0b137e" containerID="3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4" exitCode=137 Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.798270 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.799154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" event={"ID":"057ccf26-b606-4673-9512-c2f4df0b137e","Type":"ContainerDied","Data":"3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.799266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi46ff-account-delete-gp48v" event={"ID":"057ccf26-b606-4673-9512-c2f4df0b137e","Type":"ContainerDied","Data":"4e03166550aeac8969d502db54418e96171df37dd28ff9c456e3c4623c510872"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.800693 4769 generic.go:334] "Generic (PLEG): container finished" podID="38af882b-baa9-4fff-bb77-941070a30942" containerID="61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831" exitCode=137 Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.800753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" event={"ID":"38af882b-baa9-4fff-bb77-941070a30942","Type":"ContainerDied","Data":"61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.800776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" event={"ID":"38af882b-baa9-4fff-bb77-941070a30942","Type":"ContainerDied","Data":"5c7cf127164c402c1e9fd4992862d9f768fcacb654e52bde4f71a85afda95bb4"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.800827 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder0e56-account-delete-d4flh" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.805360 4769 generic.go:334] "Generic (PLEG): container finished" podID="58c422da-2667-4d11-b5b5-115706d66b58" containerID="068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e" exitCode=137 Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.805526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" event={"ID":"58c422da-2667-4d11-b5b5-115706d66b58","Type":"ContainerDied","Data":"068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.805621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" event={"ID":"58c422da-2667-4d11-b5b5-115706d66b58","Type":"ContainerDied","Data":"b5a69fcec1ba3b338809a924597a26c4f5027736494fb3182ef2cd9aa753dc6d"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.805746 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell07510-account-delete-r64n4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.818085 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p64qx\" (UniqueName: \"kubernetes.io/projected/58c422da-2667-4d11-b5b5-115706d66b58-kube-api-access-p64qx\") pod \"58c422da-2667-4d11-b5b5-115706d66b58\" (UID: \"58c422da-2667-4d11-b5b5-115706d66b58\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.818331 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/057ccf26-b606-4673-9512-c2f4df0b137e-operator-scripts\") pod \"057ccf26-b606-4673-9512-c2f4df0b137e\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.818934 4769 scope.go:117] "RemoveContainer" containerID="a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxqdd\" (UniqueName: \"kubernetes.io/projected/057ccf26-b606-4673-9512-c2f4df0b137e-kube-api-access-dxqdd\") pod \"057ccf26-b606-4673-9512-c2f4df0b137e\" (UID: \"057ccf26-b606-4673-9512-c2f4df0b137e\") " Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819606 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58c422da-2667-4d11-b5b5-115706d66b58-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819625 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kllkx\" (UniqueName: \"kubernetes.io/projected/38af882b-baa9-4fff-bb77-941070a30942-kube-api-access-kllkx\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819636 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bvd9v\" (UniqueName: \"kubernetes.io/projected/5e8a67f8-1ea8-401e-8f61-66db57f69b22-kube-api-access-bvd9v\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819646 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/38af882b-baa9-4fff-bb77-941070a30942-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819655 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2cdq2\" (UniqueName: \"kubernetes.io/projected/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-kube-api-access-2cdq2\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819665 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819676 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5e8a67f8-1ea8-401e-8f61-66db57f69b22-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/057ccf26-b606-4673-9512-c2f4df0b137e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "057ccf26-b606-4673-9512-c2f4df0b137e" (UID: "057ccf26-b606-4673-9512-c2f4df0b137e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: E1121 12:53:55.819874 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6\": container with ID starting with a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6 not found: ID does not exist" containerID="a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819906 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6"} err="failed to get container status \"a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6\": rpc error: code = NotFound desc = could not find container \"a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6\": container with ID starting with a489696e725fea1fdb78885ae6fd17b45546b13619f9849d6dcdbb64239844d6 not found: ID does not exist" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.819931 4769 scope.go:117] "RemoveContainer" containerID="3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.825360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057ccf26-b606-4673-9512-c2f4df0b137e-kube-api-access-dxqdd" (OuterVolumeSpecName: "kube-api-access-dxqdd") pod "057ccf26-b606-4673-9512-c2f4df0b137e" (UID: "057ccf26-b606-4673-9512-c2f4df0b137e"). InnerVolumeSpecName "kube-api-access-dxqdd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.825370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58c422da-2667-4d11-b5b5-115706d66b58-kube-api-access-p64qx" (OuterVolumeSpecName: "kube-api-access-p64qx") pod "58c422da-2667-4d11-b5b5-115706d66b58" (UID: "58c422da-2667-4d11-b5b5-115706d66b58"). InnerVolumeSpecName "kube-api-access-p64qx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.825424 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" containerID="0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632" exitCode=137 Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.825474 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.825475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" event={"ID":"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55","Type":"ContainerDied","Data":"0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.825517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron033b-account-delete-cvrd4" event={"ID":"1b8ef1c0-ec47-4f03-b37d-d413d1d0de55","Type":"ContainerDied","Data":"f0ba6bf80103678f558bb06d905997de28b303f75f29ed06ee844990b19ec65b"} Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.844795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.848940 4769 scope.go:117] "RemoveContainer" containerID="3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4" Nov 21 12:53:55 crc kubenswrapper[4769]: E1121 12:53:55.849377 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4\": container with ID starting with 3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4 not found: ID does not exist" containerID="3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.849409 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4"} err="failed to get container status \"3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4\": rpc error: code = NotFound desc = could not find container \"3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4\": container with ID starting with 3a4ad00e76f4de87c7564a7689fdae63a5e043d4c96645ffe7601e75df3398e4 not found: ID does not exist" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.849429 4769 scope.go:117] "RemoveContainer" containerID="61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.851394 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican1f1d-account-delete-v2mp4"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.862832 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder0e56-account-delete-d4flh"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.881440 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder0e56-account-delete-d4flh"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.884109 4769 scope.go:117] "RemoveContainer" containerID="61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831" Nov 21 12:53:55 crc kubenswrapper[4769]: E1121 12:53:55.884875 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831\": container with ID starting with 61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831 not found: ID does not exist" containerID="61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.884980 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831"} err="failed to get container status \"61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831\": rpc error: code = NotFound desc = could not find container \"61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831\": container with ID starting with 61f42b4dbe7ff426e0516175c87e9d42e4a781c60e16384f28f67e3a775f9831 not found: ID does not exist" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.885101 4769 scope.go:117] "RemoveContainer" containerID="068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.888531 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron033b-account-delete-cvrd4"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.896046 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron033b-account-delete-cvrd4"] Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.901888 4769 scope.go:117] "RemoveContainer" containerID="068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e" Nov 21 12:53:55 crc kubenswrapper[4769]: E1121 12:53:55.902460 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e\": container with ID starting with 068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e not found: ID does not exist" containerID="068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.902507 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e"} err="failed to get container status \"068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e\": rpc error: code = NotFound desc = could not find container \"068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e\": container with ID starting with 068693662ca32fb03bde431132d01c919137659709100a3fafa2f91ac8c0b37e not found: ID does not exist" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.902537 4769 scope.go:117] "RemoveContainer" containerID="0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.919053 4769 scope.go:117] "RemoveContainer" containerID="0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632" Nov 21 12:53:55 crc kubenswrapper[4769]: E1121 12:53:55.919479 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632\": container with ID starting with 0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632 not found: ID does not exist" containerID="0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.919522 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632"} err="failed to get container status \"0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632\": rpc error: code = NotFound desc = could not find container \"0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632\": container with ID starting with 0821d0278be84df4b8a514c25e09d10f562199c5a0a30fd023daa865e18e3632 not found: ID does not exist" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.920604 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dxqdd\" (UniqueName: \"kubernetes.io/projected/057ccf26-b606-4673-9512-c2f4df0b137e-kube-api-access-dxqdd\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.920626 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p64qx\" (UniqueName: \"kubernetes.io/projected/58c422da-2667-4d11-b5b5-115706d66b58-kube-api-access-p64qx\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:55 crc kubenswrapper[4769]: I1121 12:53:55.920638 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/057ccf26-b606-4673-9512-c2f4df0b137e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.171835 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell07510-account-delete-r64n4"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.183964 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell07510-account-delete-r64n4"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.194914 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi46ff-account-delete-gp48v"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.201725 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi46ff-account-delete-gp48v"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.273973 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:53:56 crc kubenswrapper[4769]: E1121 12:53:56.274300 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.688633 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.728680 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.770128 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8d296da6-cbfd-4923-9e93-dbfbd2d4bee7"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8d296da6-cbfd-4923-9e93-dbfbd2d4bee7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8d296da6_cbfd_4923_9e93_dbfbd2d4bee7.slice" Nov 21 12:53:56 crc kubenswrapper[4769]: E1121 12:53:56.770225 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod8d296da6-cbfd-4923-9e93-dbfbd2d4bee7] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod8d296da6-cbfd-4923-9e93-dbfbd2d4bee7] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8d296da6_cbfd_4923_9e93_dbfbd2d4bee7.slice" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.835509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqsvz\" (UniqueName: \"kubernetes.io/projected/a356cff0-bccc-49fc-a3c1-21cdcf16f714-kube-api-access-fqsvz\") pod \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.835592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvmd9\" (UniqueName: \"kubernetes.io/projected/2b6e8af9-6035-4a4a-9589-caaea3cab523-kube-api-access-zvmd9\") pod \"2b6e8af9-6035-4a4a-9589-caaea3cab523\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.835619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b6e8af9-6035-4a4a-9589-caaea3cab523-operator-scripts\") pod \"2b6e8af9-6035-4a4a-9589-caaea3cab523\" (UID: \"2b6e8af9-6035-4a4a-9589-caaea3cab523\") " Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.835657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a356cff0-bccc-49fc-a3c1-21cdcf16f714-operator-scripts\") pod \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\" (UID: \"a356cff0-bccc-49fc-a3c1-21cdcf16f714\") " Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836297 4769 generic.go:334] "Generic (PLEG): container finished" podID="2b6e8af9-6035-4a4a-9589-caaea3cab523" containerID="2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d" exitCode=137 Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" event={"ID":"2b6e8af9-6035-4a4a-9589-caaea3cab523","Type":"ContainerDied","Data":"2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d"} Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" event={"ID":"2b6e8af9-6035-4a4a-9589-caaea3cab523","Type":"ContainerDied","Data":"7647884c3bf4794a25ce3b7ce88e8bbb0c436a74878dd6c42ae9274ea56d4c0a"} Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836397 4769 scope.go:117] "RemoveContainer" containerID="2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6e8af9-6035-4a4a-9589-caaea3cab523-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2b6e8af9-6035-4a4a-9589-caaea3cab523" (UID: "2b6e8af9-6035-4a4a-9589-caaea3cab523"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a356cff0-bccc-49fc-a3c1-21cdcf16f714-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a356cff0-bccc-49fc-a3c1-21cdcf16f714" (UID: "a356cff0-bccc-49fc-a3c1-21cdcf16f714"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.836529 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance0893-account-delete-tlgw8" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.842329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6e8af9-6035-4a4a-9589-caaea3cab523-kube-api-access-zvmd9" (OuterVolumeSpecName: "kube-api-access-zvmd9") pod "2b6e8af9-6035-4a4a-9589-caaea3cab523" (UID: "2b6e8af9-6035-4a4a-9589-caaea3cab523"). InnerVolumeSpecName "kube-api-access-zvmd9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.842547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a356cff0-bccc-49fc-a3c1-21cdcf16f714-kube-api-access-fqsvz" (OuterVolumeSpecName: "kube-api-access-fqsvz") pod "a356cff0-bccc-49fc-a3c1-21cdcf16f714" (UID: "a356cff0-bccc-49fc-a3c1-21cdcf16f714"). InnerVolumeSpecName "kube-api-access-fqsvz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.853031 4769 generic.go:334] "Generic (PLEG): container finished" podID="a356cff0-bccc-49fc-a3c1-21cdcf16f714" containerID="bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09" exitCode=137 Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.853115 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.853133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" event={"ID":"a356cff0-bccc-49fc-a3c1-21cdcf16f714","Type":"ContainerDied","Data":"bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09"} Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.853184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-9kpql" event={"ID":"a356cff0-bccc-49fc-a3c1-21cdcf16f714","Type":"ContainerDied","Data":"c01e06108579fca4aeddeccbac5426b5e2a54bd763f50b6b56f4299e842200f6"} Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.854521 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.856617 4769 scope.go:117] "RemoveContainer" containerID="2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d" Nov 21 12:53:56 crc kubenswrapper[4769]: E1121 12:53:56.857221 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d\": container with ID starting with 2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d not found: ID does not exist" containerID="2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.857261 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d"} err="failed to get container status \"2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d\": rpc error: code = NotFound desc = could not find container \"2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d\": container with ID starting with 2d69d790f0b6949d604679d6065d4c126b665ad60e1fd22d983119c10c8a934d not found: ID does not exist" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.857286 4769 scope.go:117] "RemoveContainer" containerID="bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.881398 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.883257 4769 scope.go:117] "RemoveContainer" containerID="bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09" Nov 21 12:53:56 crc kubenswrapper[4769]: E1121 12:53:56.884357 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09\": container with ID starting with bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09 not found: ID does not exist" containerID="bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.884390 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09"} err="failed to get container status \"bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09\": rpc error: code = NotFound desc = could not find container \"bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09\": container with ID starting with bd142c08d30fe41a8723b9c599bb1b40e50ff6ec43cc395bc6cdb8f49c73ac09 not found: ID does not exist" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.896685 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-76b75c57b9-74zx6"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.904929 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-9kpql"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.910275 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-9kpql"] Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.937267 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fqsvz\" (UniqueName: \"kubernetes.io/projected/a356cff0-bccc-49fc-a3c1-21cdcf16f714-kube-api-access-fqsvz\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.937295 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zvmd9\" (UniqueName: \"kubernetes.io/projected/2b6e8af9-6035-4a4a-9589-caaea3cab523-kube-api-access-zvmd9\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.937307 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b6e8af9-6035-4a4a-9589-caaea3cab523-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:56 crc kubenswrapper[4769]: I1121 12:53:56.937315 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a356cff0-bccc-49fc-a3c1-21cdcf16f714-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.179888 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance0893-account-delete-tlgw8"] Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.188482 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance0893-account-delete-tlgw8"] Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.284627 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="057ccf26-b606-4673-9512-c2f4df0b137e" path="/var/lib/kubelet/pods/057ccf26-b606-4673-9512-c2f4df0b137e/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.285133 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" path="/var/lib/kubelet/pods/1b8ef1c0-ec47-4f03-b37d-d413d1d0de55/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.285621 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6e8af9-6035-4a4a-9589-caaea3cab523" path="/var/lib/kubelet/pods/2b6e8af9-6035-4a4a-9589-caaea3cab523/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.286088 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38af882b-baa9-4fff-bb77-941070a30942" path="/var/lib/kubelet/pods/38af882b-baa9-4fff-bb77-941070a30942/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.286999 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58c422da-2667-4d11-b5b5-115706d66b58" path="/var/lib/kubelet/pods/58c422da-2667-4d11-b5b5-115706d66b58/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.287471 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e8a67f8-1ea8-401e-8f61-66db57f69b22" path="/var/lib/kubelet/pods/5e8a67f8-1ea8-401e-8f61-66db57f69b22/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.287957 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" path="/var/lib/kubelet/pods/8d296da6-cbfd-4923-9e93-dbfbd2d4bee7/volumes" Nov 21 12:53:57 crc kubenswrapper[4769]: I1121 12:53:57.288885 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a356cff0-bccc-49fc-a3c1-21cdcf16f714" path="/var/lib/kubelet/pods/a356cff0-bccc-49fc-a3c1-21cdcf16f714/volumes" Nov 21 12:54:03 crc kubenswrapper[4769]: I1121 12:54:03.939141 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-22crx"] Nov 21 12:54:03 crc kubenswrapper[4769]: I1121 12:54:03.946978 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-22crx"] Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.058837 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-5hprj"] Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.059995 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7155427b-59ba-48c3-bf11-c34dd9426b6c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060050 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7155427b-59ba-48c3-bf11-c34dd9426b6c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060099 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-updater" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-updater" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060138 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7633e95-a9a0-413f-8827-a24a1f6b0272" containerName="memcached" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7633e95-a9a0-413f-8827-a24a1f6b0272" containerName="memcached" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060176 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="38af882b-baa9-4fff-bb77-941070a30942" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060228 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="38af882b-baa9-4fff-bb77-941070a30942" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060252 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="rabbitmq" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="rabbitmq" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060304 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060323 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060352 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060366 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060387 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060419 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="proxy-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060432 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="proxy-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060454 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerName="galera" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060466 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerName="galera" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060493 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e8a67f8-1ea8-401e-8f61-66db57f69b22" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060508 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e8a67f8-1ea8-401e-8f61-66db57f69b22" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060615 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060634 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060657 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="sg-core" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060671 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="sg-core" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060698 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060711 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060731 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060744 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060773 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060788 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060804 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-notification-agent" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060816 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-notification-agent" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060846 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerName="mysql-bootstrap" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060878 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerName="mysql-bootstrap" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060916 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060935 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-api" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.060965 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.060978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061001 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061014 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061032 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061044 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061076 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061101 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061131 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-reaper" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061144 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-reaper" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061158 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="057ccf26-b606-4673-9512-c2f4df0b137e" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061171 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="057ccf26-b606-4673-9512-c2f4df0b137e" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061235 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061249 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061290 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061317 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061344 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061358 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061377 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061412 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061425 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-api" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061450 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-updater" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061463 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-updater" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061499 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="galera" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061513 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="galera" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061528 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061542 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061563 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061575 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-server" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061603 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="swift-recon-cron" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061617 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="swift-recon-cron" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061637 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061651 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061672 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2b6e8af9-6035-4a4a-9589-caaea3cab523" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061686 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6e8af9-6035-4a4a-9589-caaea3cab523" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061700 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="305f687e-8e30-410c-b78d-6fd4f2d9191a" containerName="nova-cell1-conductor-conductor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="305f687e-8e30-410c-b78d-6fd4f2d9191a" containerName="nova-cell1-conductor-conductor" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061730 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061743 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-server" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061762 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061775 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061795 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="setup-container" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061809 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="setup-container" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.061832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.061844 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-server" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062040 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" containerName="dnsmasq-dns" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062053 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" containerName="dnsmasq-dns" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062071 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="58c422da-2667-4d11-b5b5-115706d66b58" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062084 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="58c422da-2667-4d11-b5b5-115706d66b58" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062099 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="setup-container" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062135 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="setup-container" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062154 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="020ca0e6-01ad-44de-abab-3fe5cfbba0e6" containerName="keystone-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062167 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="020ca0e6-01ad-44de-abab-3fe5cfbba0e6" containerName="keystone-api" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062256 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062284 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062320 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="rsync" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062337 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="rsync" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062364 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener-log" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062394 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2104c14c-16c5-4732-951f-dbde5da48b75" containerName="mariadb-account-create" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2104c14c-16c5-4732-951f-dbde5da48b75" containerName="mariadb-account-create" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062427 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062440 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-server" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062467 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-central-agent" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062480 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-central-agent" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062499 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="rabbitmq" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062512 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="rabbitmq" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062527 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062540 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062559 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a356cff0-bccc-49fc-a3c1-21cdcf16f714" containerName="mariadb-database-create" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062572 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a356cff0-bccc-49fc-a3c1-21cdcf16f714" containerName="mariadb-database-create" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062598 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="mysql-bootstrap" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062610 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="mysql-bootstrap" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062629 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-expirer" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062642 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-expirer" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062662 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" containerName="init" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062695 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" containerName="init" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062711 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerName="nova-cell0-conductor-conductor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062724 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerName="nova-cell0-conductor-conductor" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062741 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-metadata" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062754 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-metadata" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062773 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerName="nova-scheduler-scheduler" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062786 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerName="nova-scheduler-scheduler" Nov 21 12:54:04 crc kubenswrapper[4769]: E1121 12:54:04.062804 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.062817 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063109 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063133 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66e62dd9-2d31-4a8a-9214-406124ed2dd4" containerName="galera" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063157 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="sg-core" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063179 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063230 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063255 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-expirer" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063274 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7633e95-a9a0-413f-8827-a24a1f6b0272" containerName="memcached" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063296 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-reaper" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063310 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-metadata" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063325 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063343 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063362 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="305f687e-8e30-410c-b78d-6fd4f2d9191a" containerName="nova-cell1-conductor-conductor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063383 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-updater" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063403 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="swift-recon-cron" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063416 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063434 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e8a67f8-1ea8-401e-8f61-66db57f69b22" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063483 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2104c14c-16c5-4732-951f-dbde5da48b75" containerName="mariadb-account-create" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="58c422da-2667-4d11-b5b5-115706d66b58" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063523 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063541 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95266f8c-7cec-46ff-bc99-c6264c943d50" containerName="nova-cell0-conductor-conductor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063564 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063587 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-updater" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063602 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a2614ea4-9b84-4ab4-8e80-fe7a005e3322" containerName="galera" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063625 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="38af882b-baa9-4fff-bb77-941070a30942" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063650 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21b8e395-ab14-4f2c-a784-7ada05455d6a" containerName="barbican-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063673 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="587b6cbe-7e51-4177-a229-f6a608d0fcab" containerName="barbican-keystone-listener" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063697 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-notification-agent" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063714 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c87fc5bb-aceb-45d9-883d-5ffc9b65ea43" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063730 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063745 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f99fa56-6bf9-4fbb-a9b4-56fdb210808b" containerName="neutron-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063760 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063783 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7155427b-59ba-48c3-bf11-c34dd9426b6c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063798 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="ceilometer-central-agent" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063814 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063835 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063859 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2b6e8af9-6035-4a4a-9589-caaea3cab523" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063881 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="container-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063900 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="997ee964-de30-4b1b-b360-a31378e9a928" containerName="nova-metadata-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063915 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="87e1294e-e6ee-46df-ab5b-9be0e1d34fce" containerName="nova-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063930 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e83044ec-e522-4705-baac-c8344c6bf994" containerName="placement-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063948 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b8ef1c0-ec47-4f03-b37d-d413d1d0de55" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063964 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d549d9ab-e972-47bb-b81e-7858377a6677" containerName="dnsmasq-dns" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.063980 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="057ccf26-b606-4673-9512-c2f4df0b137e" containerName="mariadb-account-delete" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064002 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="020ca0e6-01ad-44de-abab-3fe5cfbba0e6" containerName="keystone-api" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064021 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8a788ac5-aa39-45cc-b04f-3b8e0e819ef7" containerName="nova-scheduler-scheduler" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064036 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a5c89536-0f0a-4f35-9ded-2885260ab201" containerName="glance-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064052 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064068 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-replicator" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064083 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e15176d9-214d-4f78-bb65-122a9db292d9" containerName="rabbitmq" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064100 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab455f5a-78d1-44d0-b6fa-263b24010aef" containerName="glance-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064117 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064133 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c629d36-bc3d-4c54-b61b-d27cf0cb1d84" containerName="cinder-api-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064148 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="rsync" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064167 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8a91e2b2-acf3-4556-9adb-d6ce7a0dd705" containerName="rabbitmq" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064212 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="account-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064231 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a356cff0-bccc-49fc-a3c1-21cdcf16f714" containerName="mariadb-database-create" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064249 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c40b75d-e715-4735-84f7-65a4a9b9ebe1" containerName="proxy-server" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064264 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d296da6-cbfd-4923-9e93-dbfbd2d4bee7" containerName="barbican-worker-log" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064279 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b69cf86-c5aa-4cce-8122-35443043c210" containerName="proxy-httpd" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.064300 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd8a543-f3e6-44b5-994e-afb7cd5c5cb6" containerName="object-auditor" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.065109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.069240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-5hprj"] Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.073513 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.073652 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.073716 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.073824 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.159723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/cda6c9d2-36f4-4792-836c-c0ee796bcf78-crc-storage\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.159774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77825\" (UniqueName: \"kubernetes.io/projected/cda6c9d2-36f4-4792-836c-c0ee796bcf78-kube-api-access-77825\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.159794 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/cda6c9d2-36f4-4792-836c-c0ee796bcf78-node-mnt\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.261340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/cda6c9d2-36f4-4792-836c-c0ee796bcf78-crc-storage\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.261389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-77825\" (UniqueName: \"kubernetes.io/projected/cda6c9d2-36f4-4792-836c-c0ee796bcf78-kube-api-access-77825\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.261409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/cda6c9d2-36f4-4792-836c-c0ee796bcf78-node-mnt\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.261719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/cda6c9d2-36f4-4792-836c-c0ee796bcf78-node-mnt\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.262319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/cda6c9d2-36f4-4792-836c-c0ee796bcf78-crc-storage\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.289304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-77825\" (UniqueName: \"kubernetes.io/projected/cda6c9d2-36f4-4792-836c-c0ee796bcf78-kube-api-access-77825\") pod \"crc-storage-crc-5hprj\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.398004 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.853693 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-5hprj"] Nov 21 12:54:04 crc kubenswrapper[4769]: I1121 12:54:04.972116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-5hprj" event={"ID":"cda6c9d2-36f4-4792-836c-c0ee796bcf78","Type":"ContainerStarted","Data":"b91a266d57da69c9c2ecd229411bce27e16b58ff0f9f50811a44e72c54d49069"} Nov 21 12:54:05 crc kubenswrapper[4769]: I1121 12:54:05.291075 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbcab3d8-d2b6-442a-ba8c-658494968b8f" path="/var/lib/kubelet/pods/dbcab3d8-d2b6-442a-ba8c-658494968b8f/volumes" Nov 21 12:54:05 crc kubenswrapper[4769]: I1121 12:54:05.988598 4769 generic.go:334] "Generic (PLEG): container finished" podID="cda6c9d2-36f4-4792-836c-c0ee796bcf78" containerID="dc6181ce343e2ac32ac1c80a418929bd90f6b97c8565cb06d4e03c9a70a744ea" exitCode=0 Nov 21 12:54:05 crc kubenswrapper[4769]: I1121 12:54:05.988707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-5hprj" event={"ID":"cda6c9d2-36f4-4792-836c-c0ee796bcf78","Type":"ContainerDied","Data":"dc6181ce343e2ac32ac1c80a418929bd90f6b97c8565cb06d4e03c9a70a744ea"} Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.381213 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.529874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/cda6c9d2-36f4-4792-836c-c0ee796bcf78-crc-storage\") pod \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.529989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77825\" (UniqueName: \"kubernetes.io/projected/cda6c9d2-36f4-4792-836c-c0ee796bcf78-kube-api-access-77825\") pod \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.530022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/cda6c9d2-36f4-4792-836c-c0ee796bcf78-node-mnt\") pod \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\" (UID: \"cda6c9d2-36f4-4792-836c-c0ee796bcf78\") " Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.530442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/cda6c9d2-36f4-4792-836c-c0ee796bcf78-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "cda6c9d2-36f4-4792-836c-c0ee796bcf78" (UID: "cda6c9d2-36f4-4792-836c-c0ee796bcf78"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.543567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cda6c9d2-36f4-4792-836c-c0ee796bcf78-kube-api-access-77825" (OuterVolumeSpecName: "kube-api-access-77825") pod "cda6c9d2-36f4-4792-836c-c0ee796bcf78" (UID: "cda6c9d2-36f4-4792-836c-c0ee796bcf78"). InnerVolumeSpecName "kube-api-access-77825". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.586549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda6c9d2-36f4-4792-836c-c0ee796bcf78-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "cda6c9d2-36f4-4792-836c-c0ee796bcf78" (UID: "cda6c9d2-36f4-4792-836c-c0ee796bcf78"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.631426 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/cda6c9d2-36f4-4792-836c-c0ee796bcf78-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.631455 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-77825\" (UniqueName: \"kubernetes.io/projected/cda6c9d2-36f4-4792-836c-c0ee796bcf78-kube-api-access-77825\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:07 crc kubenswrapper[4769]: I1121 12:54:07.631465 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/cda6c9d2-36f4-4792-836c-c0ee796bcf78-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:08 crc kubenswrapper[4769]: I1121 12:54:08.013235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-5hprj" event={"ID":"cda6c9d2-36f4-4792-836c-c0ee796bcf78","Type":"ContainerDied","Data":"b91a266d57da69c9c2ecd229411bce27e16b58ff0f9f50811a44e72c54d49069"} Nov 21 12:54:08 crc kubenswrapper[4769]: I1121 12:54:08.013281 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b91a266d57da69c9c2ecd229411bce27e16b58ff0f9f50811a44e72c54d49069" Nov 21 12:54:08 crc kubenswrapper[4769]: I1121 12:54:08.013754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5hprj" Nov 21 12:54:10 crc kubenswrapper[4769]: I1121 12:54:10.964244 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-5hprj"] Nov 21 12:54:10 crc kubenswrapper[4769]: I1121 12:54:10.973481 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-5hprj"] Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.097963 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-jlmzv"] Nov 21 12:54:11 crc kubenswrapper[4769]: E1121 12:54:11.098456 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cda6c9d2-36f4-4792-836c-c0ee796bcf78" containerName="storage" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.098478 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda6c9d2-36f4-4792-836c-c0ee796bcf78" containerName="storage" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.098778 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cda6c9d2-36f4-4792-836c-c0ee796bcf78" containerName="storage" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.099883 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.103090 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.104597 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.105623 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.105926 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.110331 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-jlmzv"] Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.190686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfsp\" (UniqueName: \"kubernetes.io/projected/68607dca-d1e2-466f-aa70-d84ae050d603-kube-api-access-xvfsp\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.190835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/68607dca-d1e2-466f-aa70-d84ae050d603-node-mnt\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.190929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/68607dca-d1e2-466f-aa70-d84ae050d603-crc-storage\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.274463 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:54:11 crc kubenswrapper[4769]: E1121 12:54:11.274878 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.291664 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda6c9d2-36f4-4792-836c-c0ee796bcf78" path="/var/lib/kubelet/pods/cda6c9d2-36f4-4792-836c-c0ee796bcf78/volumes" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.292474 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfsp\" (UniqueName: \"kubernetes.io/projected/68607dca-d1e2-466f-aa70-d84ae050d603-kube-api-access-xvfsp\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.292554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/68607dca-d1e2-466f-aa70-d84ae050d603-node-mnt\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.292631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/68607dca-d1e2-466f-aa70-d84ae050d603-crc-storage\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.292788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/68607dca-d1e2-466f-aa70-d84ae050d603-node-mnt\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.293731 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/68607dca-d1e2-466f-aa70-d84ae050d603-crc-storage\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.318060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfsp\" (UniqueName: \"kubernetes.io/projected/68607dca-d1e2-466f-aa70-d84ae050d603-kube-api-access-xvfsp\") pod \"crc-storage-crc-jlmzv\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.440542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:11 crc kubenswrapper[4769]: I1121 12:54:11.769255 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-jlmzv"] Nov 21 12:54:12 crc kubenswrapper[4769]: I1121 12:54:12.056592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jlmzv" event={"ID":"68607dca-d1e2-466f-aa70-d84ae050d603","Type":"ContainerStarted","Data":"c42d437e1686bc9471f559e9a18ee439b8ff13ba3444f87782b6696d56e39f82"} Nov 21 12:54:13 crc kubenswrapper[4769]: I1121 12:54:13.073541 4769 generic.go:334] "Generic (PLEG): container finished" podID="68607dca-d1e2-466f-aa70-d84ae050d603" containerID="939224dc1fb26ae1eb3c9cc9e6e89da81192c1ccd30605f25a9b4ff6b61186e0" exitCode=0 Nov 21 12:54:13 crc kubenswrapper[4769]: I1121 12:54:13.073662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jlmzv" event={"ID":"68607dca-d1e2-466f-aa70-d84ae050d603","Type":"ContainerDied","Data":"939224dc1fb26ae1eb3c9cc9e6e89da81192c1ccd30605f25a9b4ff6b61186e0"} Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.503695 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.702486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvfsp\" (UniqueName: \"kubernetes.io/projected/68607dca-d1e2-466f-aa70-d84ae050d603-kube-api-access-xvfsp\") pod \"68607dca-d1e2-466f-aa70-d84ae050d603\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.702611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/68607dca-d1e2-466f-aa70-d84ae050d603-crc-storage\") pod \"68607dca-d1e2-466f-aa70-d84ae050d603\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.702638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/68607dca-d1e2-466f-aa70-d84ae050d603-node-mnt\") pod \"68607dca-d1e2-466f-aa70-d84ae050d603\" (UID: \"68607dca-d1e2-466f-aa70-d84ae050d603\") " Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.702984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/68607dca-d1e2-466f-aa70-d84ae050d603-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "68607dca-d1e2-466f-aa70-d84ae050d603" (UID: "68607dca-d1e2-466f-aa70-d84ae050d603"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.703898 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/68607dca-d1e2-466f-aa70-d84ae050d603-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.733485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68607dca-d1e2-466f-aa70-d84ae050d603-kube-api-access-xvfsp" (OuterVolumeSpecName: "kube-api-access-xvfsp") pod "68607dca-d1e2-466f-aa70-d84ae050d603" (UID: "68607dca-d1e2-466f-aa70-d84ae050d603"). InnerVolumeSpecName "kube-api-access-xvfsp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.739773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68607dca-d1e2-466f-aa70-d84ae050d603-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "68607dca-d1e2-466f-aa70-d84ae050d603" (UID: "68607dca-d1e2-466f-aa70-d84ae050d603"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.805441 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/68607dca-d1e2-466f-aa70-d84ae050d603-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:14 crc kubenswrapper[4769]: I1121 12:54:14.806362 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xvfsp\" (UniqueName: \"kubernetes.io/projected/68607dca-d1e2-466f-aa70-d84ae050d603-kube-api-access-xvfsp\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:15 crc kubenswrapper[4769]: I1121 12:54:15.112874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jlmzv" event={"ID":"68607dca-d1e2-466f-aa70-d84ae050d603","Type":"ContainerDied","Data":"c42d437e1686bc9471f559e9a18ee439b8ff13ba3444f87782b6696d56e39f82"} Nov 21 12:54:15 crc kubenswrapper[4769]: I1121 12:54:15.112940 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c42d437e1686bc9471f559e9a18ee439b8ff13ba3444f87782b6696d56e39f82" Nov 21 12:54:15 crc kubenswrapper[4769]: I1121 12:54:15.112943 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jlmzv" Nov 21 12:54:24 crc kubenswrapper[4769]: I1121 12:54:24.273985 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:54:24 crc kubenswrapper[4769]: E1121 12:54:24.274620 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.238701 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:54:25 crc kubenswrapper[4769]: E1121 12:54:25.239058 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68607dca-d1e2-466f-aa70-d84ae050d603" containerName="storage" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.239077 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68607dca-d1e2-466f-aa70-d84ae050d603" containerName="storage" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.239246 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68607dca-d1e2-466f-aa70-d84ae050d603" containerName="storage" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.240133 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.242577 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.242891 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.243247 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.243748 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-9rkmj" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.244745 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.262719 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.391753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/48a5313d-540b-4d62-8511-8154abf0acca-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.392281 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgjps\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-kube-api-access-zgjps\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.392680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-server-conf\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.392856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.392954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.393307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.393434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.393506 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.393562 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/48a5313d-540b-4d62-8511-8154abf0acca-pod-info\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.494820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/48a5313d-540b-4d62-8511-8154abf0acca-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zgjps\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-kube-api-access-zgjps\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-server-conf\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/48a5313d-540b-4d62-8511-8154abf0acca-pod-info\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.495858 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.496099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.496343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.497073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.501351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-server-conf\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.504330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/48a5313d-540b-4d62-8511-8154abf0acca-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.504475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/48a5313d-540b-4d62-8511-8154abf0acca-pod-info\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.506015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.514239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgjps\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-kube-api-access-zgjps\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.524117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.553967 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.562886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.567434 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.567660 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-999rt" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.567814 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.567982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.568105 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.568480 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.590615 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.700811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.700886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.700928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.700952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279f45ed-32ec-46a1-999e-eb8136b76df5-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.701065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.701102 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279f45ed-32ec-46a1-999e-eb8136b76df5-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.701160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.701183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g77dx\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-kube-api-access-g77dx\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.701332 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279f45ed-32ec-46a1-999e-eb8136b76df5-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279f45ed-32ec-46a1-999e-eb8136b76df5-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g77dx\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-kube-api-access-g77dx\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.802705 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.804352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.804827 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.805271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.805749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.805974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.808587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279f45ed-32ec-46a1-999e-eb8136b76df5-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.810795 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279f45ed-32ec-46a1-999e-eb8136b76df5-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.811793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.837458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g77dx\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-kube-api-access-g77dx\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.838275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:25 crc kubenswrapper[4769]: I1121 12:54:25.994859 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.047900 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:54:26 crc kubenswrapper[4769]: W1121 12:54:26.066055 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a5313d_540b_4d62_8511_8154abf0acca.slice/crio-63741e999445cf78c5688857783a91c2bddaf1b82b482006c7d1903dbd901594 WatchSource:0}: Error finding container 63741e999445cf78c5688857783a91c2bddaf1b82b482006c7d1903dbd901594: Status 404 returned error can't find the container with id 63741e999445cf78c5688857783a91c2bddaf1b82b482006c7d1903dbd901594 Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.248004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"48a5313d-540b-4d62-8511-8154abf0acca","Type":"ContainerStarted","Data":"63741e999445cf78c5688857783a91c2bddaf1b82b482006c7d1903dbd901594"} Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.487607 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:54:26 crc kubenswrapper[4769]: W1121 12:54:26.490154 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279f45ed_32ec_46a1_999e_eb8136b76df5.slice/crio-00faa8478947ee940c57633d3ce40373549ba4b0d99c009c069c1e4c2c1064ac WatchSource:0}: Error finding container 00faa8478947ee940c57633d3ce40373549ba4b0d99c009c069c1e4c2c1064ac: Status 404 returned error can't find the container with id 00faa8478947ee940c57633d3ce40373549ba4b0d99c009c069c1e4c2c1064ac Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.886167 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.888837 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.891488 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.892093 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.892685 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.892682 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-n8kjm" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.909351 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 12:54:26 crc kubenswrapper[4769]: I1121 12:54:26.921730 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-default\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgm6\" (UniqueName: \"kubernetes.io/projected/fb742bc1-0b2d-4699-8172-31d54051b8b3-kube-api-access-fhgm6\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019908 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-kolla-config\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-operator-scripts\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.019984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-generated\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-kolla-config\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-operator-scripts\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-generated\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-default\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.121761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgm6\" (UniqueName: \"kubernetes.io/projected/fb742bc1-0b2d-4699-8172-31d54051b8b3-kube-api-access-fhgm6\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.123333 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.123945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-generated\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.124715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-default\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.125300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-kolla-config\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.126045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-operator-scripts\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.180476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgm6\" (UniqueName: \"kubernetes.io/projected/fb742bc1-0b2d-4699-8172-31d54051b8b3-kube-api-access-fhgm6\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.180495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.181888 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.208673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.218448 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.219418 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.221343 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.221755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-hqthj" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.253136 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.258458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279f45ed-32ec-46a1-999e-eb8136b76df5","Type":"ContainerStarted","Data":"00faa8478947ee940c57633d3ce40373549ba4b0d99c009c069c1e4c2c1064ac"} Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.326103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llnz7\" (UniqueName: \"kubernetes.io/projected/f19f65b0-2588-4629-8d78-d8ba857f4506-kube-api-access-llnz7\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.326177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-config-data\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.326253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-kolla-config\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.427821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-llnz7\" (UniqueName: \"kubernetes.io/projected/f19f65b0-2588-4629-8d78-d8ba857f4506-kube-api-access-llnz7\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.427886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-config-data\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.427927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-kolla-config\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.428844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-kolla-config\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.428899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-config-data\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.443739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-llnz7\" (UniqueName: \"kubernetes.io/projected/f19f65b0-2588-4629-8d78-d8ba857f4506-kube-api-access-llnz7\") pod \"memcached-0\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.508809 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.592718 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:27 crc kubenswrapper[4769]: I1121 12:54:27.999603 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: W1121 12:54:28.009040 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb742bc1_0b2d_4699_8172_31d54051b8b3.slice/crio-fc4558cd730e3d0ed996ca5ebf206d9a905a7f03513fb404835d46a19a7ea2ee WatchSource:0}: Error finding container fc4558cd730e3d0ed996ca5ebf206d9a905a7f03513fb404835d46a19a7ea2ee: Status 404 returned error can't find the container with id fc4558cd730e3d0ed996ca5ebf206d9a905a7f03513fb404835d46a19a7ea2ee Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.051009 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.060608 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.061230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.064294 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-65rwf" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.105865 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.153080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4mhb\" (UniqueName: \"kubernetes.io/projected/51ac2346-14cd-4422-b90e-ac25515d74c2-kube-api-access-d4mhb\") pod \"kube-state-metrics-0\" (UID: \"51ac2346-14cd-4422-b90e-ac25515d74c2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.171290 4769 scope.go:117] "RemoveContainer" containerID="1f1c1d750a1c62c56df46d8aced8c03683225f44d00bdab5b2e426f5b5e01eed" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.204211 4769 scope.go:117] "RemoveContainer" containerID="1777960e9cb1495cb5d97b2949474133b4ccd62645768da9412f06e3de2ab1f0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.236882 4769 scope.go:117] "RemoveContainer" containerID="3f720586ed80081e76d8251c9915ba9fd1a64ff5d387fa47c3fc68b843f05c03" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.254118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d4mhb\" (UniqueName: \"kubernetes.io/projected/51ac2346-14cd-4422-b90e-ac25515d74c2-kube-api-access-d4mhb\") pod \"kube-state-metrics-0\" (UID: \"51ac2346-14cd-4422-b90e-ac25515d74c2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.257345 4769 scope.go:117] "RemoveContainer" containerID="ff9d9cc40052d71cc1eeb40acde6ac84123ec85d569ab58709b7cd259bad7a16" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.269482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"48a5313d-540b-4d62-8511-8154abf0acca","Type":"ContainerStarted","Data":"e8102b1e073a94e992e30c03d9f62e84b8808c8ec83c853496cf97787e11d9af"} Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.274469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279f45ed-32ec-46a1-999e-eb8136b76df5","Type":"ContainerStarted","Data":"f843c77497dc9e9b693850577427cce1b7ec48f68e36a8d3c1bfbcc30ad52176"} Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.275890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4mhb\" (UniqueName: \"kubernetes.io/projected/51ac2346-14cd-4422-b90e-ac25515d74c2-kube-api-access-d4mhb\") pod \"kube-state-metrics-0\" (UID: \"51ac2346-14cd-4422-b90e-ac25515d74c2\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.277387 4769 scope.go:117] "RemoveContainer" containerID="15c7bdeedb34a102ed075bb23f3febe22baf993c6933a35af89e033a1eb597a5" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.280101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"fb742bc1-0b2d-4699-8172-31d54051b8b3","Type":"ContainerStarted","Data":"1231301552e82cb68aacb40f4513da0dae8d119fc03036b59fad953c207b9765"} Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.280140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"fb742bc1-0b2d-4699-8172-31d54051b8b3","Type":"ContainerStarted","Data":"fc4558cd730e3d0ed996ca5ebf206d9a905a7f03513fb404835d46a19a7ea2ee"} Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.286845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f19f65b0-2588-4629-8d78-d8ba857f4506","Type":"ContainerStarted","Data":"3291ca59e581d8188a9be433dc53c05ad6102f59b42770b6f81df910d30c66fd"} Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.286889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f19f65b0-2588-4629-8d78-d8ba857f4506","Type":"ContainerStarted","Data":"625627ed2022d7fbe969bc14477e4fd98296a4bd8c82984a5c49462c6421c3b3"} Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.287113 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.300522 4769 scope.go:117] "RemoveContainer" containerID="8e7738f507454bf36d660c076c58850a6cff176248838c52c6b6febfb8ff005b" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.317038 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.3170209640000001 podStartE2EDuration="1.317020964s" podCreationTimestamp="2025-11-21 12:54:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:28.307854327 +0000 UTC m=+3827.008516135" watchObservedRunningTime="2025-11-21 12:54:28.317020964 +0000 UTC m=+3827.017682782" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.330244 4769 scope.go:117] "RemoveContainer" containerID="8c95e665d2e9d6f8634866e2f45de59008d367ad271ebe8a63e05f4d90376f9f" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.352153 4769 scope.go:117] "RemoveContainer" containerID="8ebee137a50a5ba33cfccf6429ea78d0e04cb3861589e7b06d15107d88b3d78e" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.372387 4769 scope.go:117] "RemoveContainer" containerID="00e3a65d4f7d52e447c1ff77a25e911e6dd8c7e25f5c8fe366729a358fd9154f" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.395644 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.406512 4769 scope.go:117] "RemoveContainer" containerID="f89912feee1f15f4e386d1ae4c699514cbd9622e9359f46ba518ea6857e3e5b7" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.446260 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.448462 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.451607 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xpkvg" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.451980 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.452095 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.452227 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.455703 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.536527 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.538254 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.539834 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-6t2fb" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.540176 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.540406 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.544817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.561861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.561915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.561968 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.561986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.562003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fptp\" (UniqueName: \"kubernetes.io/projected/a413893e-4d16-4422-9d8f-0a3d98578734-kube-api-access-8fptp\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.562032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.562056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.562093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxqrm\" (UniqueName: \"kubernetes.io/projected/537bd39d-da67-4aea-a004-b41392f866d7-kube-api-access-hxqrm\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664321 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-config\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/537bd39d-da67-4aea-a004-b41392f866d7-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8fptp\" (UniqueName: \"kubernetes.io/projected/a413893e-4d16-4422-9d8f-0a3d98578734-kube-api-access-8fptp\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/537bd39d-da67-4aea-a004-b41392f866d7-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.664793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.665284 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.666012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.666310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.667004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.667468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.671539 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.682747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.690861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fptp\" (UniqueName: \"kubernetes.io/projected/a413893e-4d16-4422-9d8f-0a3d98578734-kube-api-access-8fptp\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.706628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.724471 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.726153 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.729832 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.729960 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.733425 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-k78dv" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.753810 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.785774 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.786950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/537bd39d-da67-4aea-a004-b41392f866d7-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.787022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.787065 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.787083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/537bd39d-da67-4aea-a004-b41392f866d7-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.787125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hxqrm\" (UniqueName: \"kubernetes.io/projected/537bd39d-da67-4aea-a004-b41392f866d7-kube-api-access-hxqrm\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.787152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-config\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.788094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-config\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.788372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/537bd39d-da67-4aea-a004-b41392f866d7-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.789226 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.789580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.823477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxqrm\" (UniqueName: \"kubernetes.io/projected/537bd39d-da67-4aea-a004-b41392f866d7-kube-api-access-hxqrm\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.825572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/537bd39d-da67-4aea-a004-b41392f866d7-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.883651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.892011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.892088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzz9\" (UniqueName: \"kubernetes.io/projected/e208ea95-1e47-4b72-aaa7-43ea37d076bc-kube-api-access-tmzz9\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.892116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e208ea95-1e47-4b72-aaa7-43ea37d076bc-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.892171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-config\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.892221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.892243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e208ea95-1e47-4b72-aaa7-43ea37d076bc-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.913469 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 12:54:28 crc kubenswrapper[4769]: W1121 12:54:28.926132 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51ac2346_14cd_4422_b90e_ac25515d74c2.slice/crio-dc56d267eab991fcb3faaa6d518ac3aacff47f7a9fe9edf63c35c4b335bdaa10 WatchSource:0}: Error finding container dc56d267eab991fcb3faaa6d518ac3aacff47f7a9fe9edf63c35c4b335bdaa10: Status 404 returned error can't find the container with id dc56d267eab991fcb3faaa6d518ac3aacff47f7a9fe9edf63c35c4b335bdaa10 Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.994955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.995052 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzz9\" (UniqueName: \"kubernetes.io/projected/e208ea95-1e47-4b72-aaa7-43ea37d076bc-kube-api-access-tmzz9\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.995072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e208ea95-1e47-4b72-aaa7-43ea37d076bc-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.995123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-config\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.995154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.995169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e208ea95-1e47-4b72-aaa7-43ea37d076bc-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.995716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e208ea95-1e47-4b72-aaa7-43ea37d076bc-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.996648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-config\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.996809 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:28 crc kubenswrapper[4769]: I1121 12:54:28.996815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.013184 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e208ea95-1e47-4b72-aaa7-43ea37d076bc-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.016518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.038908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzz9\" (UniqueName: \"kubernetes.io/projected/e208ea95-1e47-4b72-aaa7-43ea37d076bc-kube-api-access-tmzz9\") pod \"ovsdbserver-sb-0\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.184294 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.198932 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.298702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"51ac2346-14cd-4422-b90e-ac25515d74c2","Type":"ContainerStarted","Data":"dc56d267eab991fcb3faaa6d518ac3aacff47f7a9fe9edf63c35c4b335bdaa10"} Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.392904 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 12:54:29 crc kubenswrapper[4769]: W1121 12:54:29.407043 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda413893e_4d16_4422_9d8f_0a3d98578734.slice/crio-0ad52e339e423e12fb434440f60df77e7253d156d7970e58abf38dd06f1d9b28 WatchSource:0}: Error finding container 0ad52e339e423e12fb434440f60df77e7253d156d7970e58abf38dd06f1d9b28: Status 404 returned error can't find the container with id 0ad52e339e423e12fb434440f60df77e7253d156d7970e58abf38dd06f1d9b28 Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.638582 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:54:29 crc kubenswrapper[4769]: W1121 12:54:29.643912 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod537bd39d_da67_4aea_a004_b41392f866d7.slice/crio-6644aca49364994fccd3efc5a7705f23243dd46e2a3b6d950c8525124632d105 WatchSource:0}: Error finding container 6644aca49364994fccd3efc5a7705f23243dd46e2a3b6d950c8525124632d105: Status 404 returned error can't find the container with id 6644aca49364994fccd3efc5a7705f23243dd46e2a3b6d950c8525124632d105 Nov 21 12:54:29 crc kubenswrapper[4769]: I1121 12:54:29.723207 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.338508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"a413893e-4d16-4422-9d8f-0a3d98578734","Type":"ContainerStarted","Data":"ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.339301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"a413893e-4d16-4422-9d8f-0a3d98578734","Type":"ContainerStarted","Data":"0ad52e339e423e12fb434440f60df77e7253d156d7970e58abf38dd06f1d9b28"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.348674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"537bd39d-da67-4aea-a004-b41392f866d7","Type":"ContainerStarted","Data":"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.348706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"537bd39d-da67-4aea-a004-b41392f866d7","Type":"ContainerStarted","Data":"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.348717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"537bd39d-da67-4aea-a004-b41392f866d7","Type":"ContainerStarted","Data":"6644aca49364994fccd3efc5a7705f23243dd46e2a3b6d950c8525124632d105"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.354905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"e208ea95-1e47-4b72-aaa7-43ea37d076bc","Type":"ContainerStarted","Data":"25d330d93ecbe38c5c832faacebc3d6ee5cb5119178d0c043e0d401c18e97ddb"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.354936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"e208ea95-1e47-4b72-aaa7-43ea37d076bc","Type":"ContainerStarted","Data":"0541f5831d3b72ec53bc09054a4aa848a34a6d0154a074cb2577083cb474d7f2"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.354946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"e208ea95-1e47-4b72-aaa7-43ea37d076bc","Type":"ContainerStarted","Data":"3c046a095b18c33424a0daad47428bf71dcc193c8237a73fdf8fbc6f4d09068b"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.366031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"51ac2346-14cd-4422-b90e-ac25515d74c2","Type":"ContainerStarted","Data":"023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79"} Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.366290 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.390958 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.390928418 podStartE2EDuration="3.390928418s" podCreationTimestamp="2025-11-21 12:54:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:30.38913487 +0000 UTC m=+3829.089796688" watchObservedRunningTime="2025-11-21 12:54:30.390928418 +0000 UTC m=+3829.091590266" Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.411500 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.411473532 podStartE2EDuration="3.411473532s" podCreationTimestamp="2025-11-21 12:54:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:30.407605027 +0000 UTC m=+3829.108266865" watchObservedRunningTime="2025-11-21 12:54:30.411473532 +0000 UTC m=+3829.112135370" Nov 21 12:54:30 crc kubenswrapper[4769]: I1121 12:54:30.432782 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.000630646 podStartE2EDuration="2.432695353s" podCreationTimestamp="2025-11-21 12:54:28 +0000 UTC" firstStartedPulling="2025-11-21 12:54:28.933479535 +0000 UTC m=+3827.634141353" lastFinishedPulling="2025-11-21 12:54:29.365544252 +0000 UTC m=+3828.066206060" observedRunningTime="2025-11-21 12:54:30.430268378 +0000 UTC m=+3829.130930196" watchObservedRunningTime="2025-11-21 12:54:30.432695353 +0000 UTC m=+3829.133357211" Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.185762 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.200459 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.266126 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.272844 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.391342 4769 generic.go:334] "Generic (PLEG): container finished" podID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerID="1231301552e82cb68aacb40f4513da0dae8d119fc03036b59fad953c207b9765" exitCode=0 Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.391486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"fb742bc1-0b2d-4699-8172-31d54051b8b3","Type":"ContainerDied","Data":"1231301552e82cb68aacb40f4513da0dae8d119fc03036b59fad953c207b9765"} Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.391665 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:32 crc kubenswrapper[4769]: I1121 12:54:32.392311 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:33 crc kubenswrapper[4769]: I1121 12:54:33.407305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"fb742bc1-0b2d-4699-8172-31d54051b8b3","Type":"ContainerStarted","Data":"8fc9f2c1ab4028ce5e693ffad5e61ab730f5b37f730df26f975a8b1640279b35"} Nov 21 12:54:33 crc kubenswrapper[4769]: I1121 12:54:33.410022 4769 generic.go:334] "Generic (PLEG): container finished" podID="a413893e-4d16-4422-9d8f-0a3d98578734" containerID="ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66" exitCode=0 Nov 21 12:54:33 crc kubenswrapper[4769]: I1121 12:54:33.410718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"a413893e-4d16-4422-9d8f-0a3d98578734","Type":"ContainerDied","Data":"ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66"} Nov 21 12:54:33 crc kubenswrapper[4769]: I1121 12:54:33.476439 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.476420957 podStartE2EDuration="8.476420957s" podCreationTimestamp="2025-11-21 12:54:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:33.468932396 +0000 UTC m=+3832.169594254" watchObservedRunningTime="2025-11-21 12:54:33.476420957 +0000 UTC m=+3832.177082775" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.260909 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.279617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.432046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"a413893e-4d16-4422-9d8f-0a3d98578734","Type":"ContainerStarted","Data":"5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd"} Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.454514 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.45449706 podStartE2EDuration="7.45449706s" podCreationTimestamp="2025-11-21 12:54:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:34.450163633 +0000 UTC m=+3833.150825461" watchObservedRunningTime="2025-11-21 12:54:34.45449706 +0000 UTC m=+3833.155158878" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.559383 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.561108 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.563683 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-5l6g6" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.563939 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.564126 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.608769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxwr\" (UniqueName: \"kubernetes.io/projected/488cd419-abc4-436c-9407-e577b7158bb2-kube-api-access-qhxwr\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.608814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/488cd419-abc4-436c-9407-e577b7158bb2-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.608840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-config\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.608876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-scripts\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.608905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/488cd419-abc4-436c-9407-e577b7158bb2-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.618499 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.710156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxwr\" (UniqueName: \"kubernetes.io/projected/488cd419-abc4-436c-9407-e577b7158bb2-kube-api-access-qhxwr\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.710249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/488cd419-abc4-436c-9407-e577b7158bb2-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.710300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-config\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.710399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-scripts\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.711289 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-config\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.711378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-scripts\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.711560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/488cd419-abc4-436c-9407-e577b7158bb2-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.712900 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/488cd419-abc4-436c-9407-e577b7158bb2-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.718125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/488cd419-abc4-436c-9407-e577b7158bb2-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.728131 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxwr\" (UniqueName: \"kubernetes.io/projected/488cd419-abc4-436c-9407-e577b7158bb2-kube-api-access-qhxwr\") pod \"ovn-northd-0\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:34 crc kubenswrapper[4769]: I1121 12:54:34.907311 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:35 crc kubenswrapper[4769]: W1121 12:54:35.362979 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod488cd419_abc4_436c_9407_e577b7158bb2.slice/crio-0648f68ef7284ec1abf32e9bc57d121dba8138636cf76331920d4b3202cf641e WatchSource:0}: Error finding container 0648f68ef7284ec1abf32e9bc57d121dba8138636cf76331920d4b3202cf641e: Status 404 returned error can't find the container with id 0648f68ef7284ec1abf32e9bc57d121dba8138636cf76331920d4b3202cf641e Nov 21 12:54:35 crc kubenswrapper[4769]: I1121 12:54:35.363965 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:54:35 crc kubenswrapper[4769]: I1121 12:54:35.444205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"488cd419-abc4-436c-9407-e577b7158bb2","Type":"ContainerStarted","Data":"0648f68ef7284ec1abf32e9bc57d121dba8138636cf76331920d4b3202cf641e"} Nov 21 12:54:36 crc kubenswrapper[4769]: I1121 12:54:36.274563 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:54:36 crc kubenswrapper[4769]: E1121 12:54:36.275323 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:54:36 crc kubenswrapper[4769]: I1121 12:54:36.460745 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"488cd419-abc4-436c-9407-e577b7158bb2","Type":"ContainerStarted","Data":"83838d4f23a10ef752127c7eb1ff5a204e3b2dc6b9a0ba9c0fee13105c2a50e2"} Nov 21 12:54:36 crc kubenswrapper[4769]: I1121 12:54:36.460805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"488cd419-abc4-436c-9407-e577b7158bb2","Type":"ContainerStarted","Data":"776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb"} Nov 21 12:54:36 crc kubenswrapper[4769]: I1121 12:54:36.460931 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:36 crc kubenswrapper[4769]: I1121 12:54:36.491780 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.491731427 podStartE2EDuration="2.491731427s" podCreationTimestamp="2025-11-21 12:54:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:36.490319529 +0000 UTC m=+3835.190981387" watchObservedRunningTime="2025-11-21 12:54:36.491731427 +0000 UTC m=+3835.192393285" Nov 21 12:54:37 crc kubenswrapper[4769]: I1121 12:54:37.509891 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:37 crc kubenswrapper[4769]: I1121 12:54:37.509983 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:37 crc kubenswrapper[4769]: I1121 12:54:37.594981 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:54:37 crc kubenswrapper[4769]: I1121 12:54:37.608040 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:38 crc kubenswrapper[4769]: I1121 12:54:38.400747 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 12:54:38 crc kubenswrapper[4769]: I1121 12:54:38.550326 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 12:54:38 crc kubenswrapper[4769]: I1121 12:54:38.786432 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:38 crc kubenswrapper[4769]: I1121 12:54:38.786506 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.465013 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.471394 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.473699 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-5hjdr" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.474499 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.474822 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.474930 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.519430 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.598508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.598620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-lock\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.598668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.598685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-cache\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.598767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv95f\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-kube-api-access-dv95f\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.700355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.700416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-cache\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.700512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dv95f\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-kube-api-access-dv95f\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.700560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: E1121 12:54:39.700568 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:54:39 crc kubenswrapper[4769]: E1121 12:54:39.700599 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.700626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-lock\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: E1121 12:54:39.700661 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift podName:518a86ab-f04b-4ee1-9bba-13e68dd3367f nodeName:}" failed. No retries permitted until 2025-11-21 12:54:40.20064129 +0000 UTC m=+3838.901303208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift") pod "swift-storage-0" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f") : configmap "swift-ring-files" not found Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.700863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-cache\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.701120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-lock\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.701292 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.723105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv95f\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-kube-api-access-dv95f\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:39 crc kubenswrapper[4769]: I1121 12:54:39.724127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:40 crc kubenswrapper[4769]: I1121 12:54:40.209086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:40 crc kubenswrapper[4769]: E1121 12:54:40.209361 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:54:40 crc kubenswrapper[4769]: E1121 12:54:40.209401 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:54:40 crc kubenswrapper[4769]: E1121 12:54:40.209493 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift podName:518a86ab-f04b-4ee1-9bba-13e68dd3367f nodeName:}" failed. No retries permitted until 2025-11-21 12:54:41.209461904 +0000 UTC m=+3839.910123762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift") pod "swift-storage-0" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f") : configmap "swift-ring-files" not found Nov 21 12:54:41 crc kubenswrapper[4769]: I1121 12:54:41.044873 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:41 crc kubenswrapper[4769]: I1121 12:54:41.194693 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 12:54:41 crc kubenswrapper[4769]: I1121 12:54:41.228271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:41 crc kubenswrapper[4769]: E1121 12:54:41.228597 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:54:41 crc kubenswrapper[4769]: E1121 12:54:41.228622 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:54:41 crc kubenswrapper[4769]: E1121 12:54:41.228692 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift podName:518a86ab-f04b-4ee1-9bba-13e68dd3367f nodeName:}" failed. No retries permitted until 2025-11-21 12:54:43.228668084 +0000 UTC m=+3841.929329932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift") pod "swift-storage-0" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f") : configmap "swift-ring-files" not found Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.264301 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:43 crc kubenswrapper[4769]: E1121 12:54:43.264533 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:54:43 crc kubenswrapper[4769]: E1121 12:54:43.264858 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:54:43 crc kubenswrapper[4769]: E1121 12:54:43.264929 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift podName:518a86ab-f04b-4ee1-9bba-13e68dd3367f nodeName:}" failed. No retries permitted until 2025-11-21 12:54:47.264905104 +0000 UTC m=+3845.965566932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift") pod "swift-storage-0" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f") : configmap "swift-ring-files" not found Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.375155 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dbmlk"] Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.376304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dbmlk"] Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.376389 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.413703 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.414259 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.414470 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475427 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-dispersionconf\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-swiftconf\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-combined-ca-bundle\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9b2161b8-5f77-4c61-b867-312c5d81b401-etc-swift\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475608 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-scripts\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fnp\" (UniqueName: \"kubernetes.io/projected/9b2161b8-5f77-4c61-b867-312c5d81b401-kube-api-access-r2fnp\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.475684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-ring-data-devices\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.577225 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-scripts\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9b2161b8-5f77-4c61-b867-312c5d81b401-etc-swift\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578055 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-scripts\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9b2161b8-5f77-4c61-b867-312c5d81b401-etc-swift\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fnp\" (UniqueName: \"kubernetes.io/projected/9b2161b8-5f77-4c61-b867-312c5d81b401-kube-api-access-r2fnp\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-ring-data-devices\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-dispersionconf\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-swiftconf\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.578712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-combined-ca-bundle\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.579332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-ring-data-devices\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.584822 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-dispersionconf\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.584985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-combined-ca-bundle\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.585723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-swiftconf\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.598764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fnp\" (UniqueName: \"kubernetes.io/projected/9b2161b8-5f77-4c61-b867-312c5d81b401-kube-api-access-r2fnp\") pod \"swift-ring-rebalance-dbmlk\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.742923 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-5hjdr" Nov 21 12:54:43 crc kubenswrapper[4769]: I1121 12:54:43.751844 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:44 crc kubenswrapper[4769]: I1121 12:54:44.235434 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dbmlk"] Nov 21 12:54:44 crc kubenswrapper[4769]: W1121 12:54:44.245599 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b2161b8_5f77_4c61_b867_312c5d81b401.slice/crio-bcf481d4dfb0e6c219ca2f183bf0b8c2b857a417796ec4b5630b1abb04dc6a5e WatchSource:0}: Error finding container bcf481d4dfb0e6c219ca2f183bf0b8c2b857a417796ec4b5630b1abb04dc6a5e: Status 404 returned error can't find the container with id bcf481d4dfb0e6c219ca2f183bf0b8c2b857a417796ec4b5630b1abb04dc6a5e Nov 21 12:54:44 crc kubenswrapper[4769]: I1121 12:54:44.549100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" event={"ID":"9b2161b8-5f77-4c61-b867-312c5d81b401","Type":"ContainerStarted","Data":"31ca482243e2d16fefa82e2b4157ef9a354e917c04961391d3d8fea490b18f20"} Nov 21 12:54:44 crc kubenswrapper[4769]: I1121 12:54:44.549566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" event={"ID":"9b2161b8-5f77-4c61-b867-312c5d81b401","Type":"ContainerStarted","Data":"bcf481d4dfb0e6c219ca2f183bf0b8c2b857a417796ec4b5630b1abb04dc6a5e"} Nov 21 12:54:45 crc kubenswrapper[4769]: I1121 12:54:45.601514 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" podStartSLOduration=2.601486914 podStartE2EDuration="2.601486914s" podCreationTimestamp="2025-11-21 12:54:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:45.591874345 +0000 UTC m=+3844.292536203" watchObservedRunningTime="2025-11-21 12:54:45.601486914 +0000 UTC m=+3844.302148772" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.130488 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-zpmwl"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.132310 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.139533 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-zpmwl"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.228384 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-325c-account-create-hcf9m"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.229734 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.235667 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-325c-account-create-hcf9m"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.236335 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.241689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5hwg\" (UniqueName: \"kubernetes.io/projected/7b176fcd-3880-43c5-9870-9d985cdce6c1-kube-api-access-t5hwg\") pod \"keystone-db-create-zpmwl\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.244889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b176fcd-3880-43c5-9870-9d985cdce6c1-operator-scripts\") pod \"keystone-db-create-zpmwl\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.275101 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:54:47 crc kubenswrapper[4769]: E1121 12:54:47.275395 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.346782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/336f85cd-816e-42bc-b7cb-28df388e09e0-operator-scripts\") pod \"keystone-325c-account-create-hcf9m\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.346859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrx9m\" (UniqueName: \"kubernetes.io/projected/336f85cd-816e-42bc-b7cb-28df388e09e0-kube-api-access-qrx9m\") pod \"keystone-325c-account-create-hcf9m\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.347003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t5hwg\" (UniqueName: \"kubernetes.io/projected/7b176fcd-3880-43c5-9870-9d985cdce6c1-kube-api-access-t5hwg\") pod \"keystone-db-create-zpmwl\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.347067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.347163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b176fcd-3880-43c5-9870-9d985cdce6c1-operator-scripts\") pod \"keystone-db-create-zpmwl\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: E1121 12:54:47.347627 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 12:54:47 crc kubenswrapper[4769]: E1121 12:54:47.347661 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 12:54:47 crc kubenswrapper[4769]: E1121 12:54:47.347705 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift podName:518a86ab-f04b-4ee1-9bba-13e68dd3367f nodeName:}" failed. No retries permitted until 2025-11-21 12:54:55.347689332 +0000 UTC m=+3854.048351150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift") pod "swift-storage-0" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f") : configmap "swift-ring-files" not found Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.348420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b176fcd-3880-43c5-9870-9d985cdce6c1-operator-scripts\") pod \"keystone-db-create-zpmwl\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.379891 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5hwg\" (UniqueName: \"kubernetes.io/projected/7b176fcd-3880-43c5-9870-9d985cdce6c1-kube-api-access-t5hwg\") pod \"keystone-db-create-zpmwl\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.449608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/336f85cd-816e-42bc-b7cb-28df388e09e0-operator-scripts\") pod \"keystone-325c-account-create-hcf9m\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.449669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qrx9m\" (UniqueName: \"kubernetes.io/projected/336f85cd-816e-42bc-b7cb-28df388e09e0-kube-api-access-qrx9m\") pod \"keystone-325c-account-create-hcf9m\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.450889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/336f85cd-816e-42bc-b7cb-28df388e09e0-operator-scripts\") pod \"keystone-325c-account-create-hcf9m\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.461545 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-nbzc8"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.462962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.465794 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.468104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrx9m\" (UniqueName: \"kubernetes.io/projected/336f85cd-816e-42bc-b7cb-28df388e09e0-kube-api-access-qrx9m\") pod \"keystone-325c-account-create-hcf9m\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.473374 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-nbzc8"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.551504 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-operator-scripts\") pod \"placement-db-create-nbzc8\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.551784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsgzm\" (UniqueName: \"kubernetes.io/projected/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-kube-api-access-wsgzm\") pod \"placement-db-create-nbzc8\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.557470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.604608 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-d614-account-create-pc76c"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.606172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.610427 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.615432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d614-account-create-pc76c"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.654049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wsgzm\" (UniqueName: \"kubernetes.io/projected/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-kube-api-access-wsgzm\") pod \"placement-db-create-nbzc8\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.654099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-operator-scripts\") pod \"placement-db-create-nbzc8\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.655229 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-operator-scripts\") pod \"placement-db-create-nbzc8\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.678269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsgzm\" (UniqueName: \"kubernetes.io/projected/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-kube-api-access-wsgzm\") pod \"placement-db-create-nbzc8\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.755270 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kct6\" (UniqueName: \"kubernetes.io/projected/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-kube-api-access-6kct6\") pod \"placement-d614-account-create-pc76c\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.755342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-operator-scripts\") pod \"placement-d614-account-create-pc76c\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.762319 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-kp6nm"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.763634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.769533 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kp6nm"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.848744 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-6ada-account-create-k47t9"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.856447 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6kct6\" (UniqueName: \"kubernetes.io/projected/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-kube-api-access-6kct6\") pod \"placement-d614-account-create-pc76c\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.856536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-operator-scripts\") pod \"placement-d614-account-create-pc76c\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.856570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbn7\" (UniqueName: \"kubernetes.io/projected/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-kube-api-access-wfbn7\") pod \"glance-db-create-kp6nm\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.856663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-operator-scripts\") pod \"glance-db-create-kp6nm\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.857716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-operator-scripts\") pod \"placement-d614-account-create-pc76c\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.859350 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-6ada-account-create-k47t9"] Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.859439 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.861015 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.873264 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.884885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kct6\" (UniqueName: \"kubernetes.io/projected/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-kube-api-access-6kct6\") pod \"placement-d614-account-create-pc76c\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.957917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79ee2529-fb13-498b-9926-3eae2785b291-operator-scripts\") pod \"glance-6ada-account-create-k47t9\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.958006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5lpp\" (UniqueName: \"kubernetes.io/projected/79ee2529-fb13-498b-9926-3eae2785b291-kube-api-access-w5lpp\") pod \"glance-6ada-account-create-k47t9\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.958061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbn7\" (UniqueName: \"kubernetes.io/projected/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-kube-api-access-wfbn7\") pod \"glance-db-create-kp6nm\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.958134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-operator-scripts\") pod \"glance-db-create-kp6nm\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.959093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-operator-scripts\") pod \"glance-db-create-kp6nm\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.974576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbn7\" (UniqueName: \"kubernetes.io/projected/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-kube-api-access-wfbn7\") pod \"glance-db-create-kp6nm\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:47 crc kubenswrapper[4769]: I1121 12:54:47.986105 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:47.999960 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-zpmwl"] Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.058974 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-325c-account-create-hcf9m"] Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.059516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79ee2529-fb13-498b-9926-3eae2785b291-operator-scripts\") pod \"glance-6ada-account-create-k47t9\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.059594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w5lpp\" (UniqueName: \"kubernetes.io/projected/79ee2529-fb13-498b-9926-3eae2785b291-kube-api-access-w5lpp\") pod \"glance-6ada-account-create-k47t9\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.061346 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79ee2529-fb13-498b-9926-3eae2785b291-operator-scripts\") pod \"glance-6ada-account-create-k47t9\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.076260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5lpp\" (UniqueName: \"kubernetes.io/projected/79ee2529-fb13-498b-9926-3eae2785b291-kube-api-access-w5lpp\") pod \"glance-6ada-account-create-k47t9\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.083546 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.182146 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.365893 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-nbzc8"] Nov 21 12:54:48 crc kubenswrapper[4769]: W1121 12:54:48.387858 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45bcad3a_f59b_4baa_8140_9f0e60d4e6bd.slice/crio-54c2283e5c048970b61b5925f875540e27718c97fe446076d31df4bd066160ee WatchSource:0}: Error finding container 54c2283e5c048970b61b5925f875540e27718c97fe446076d31df4bd066160ee: Status 404 returned error can't find the container with id 54c2283e5c048970b61b5925f875540e27718c97fe446076d31df4bd066160ee Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.468722 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d614-account-create-pc76c"] Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.546803 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kp6nm"] Nov 21 12:54:48 crc kubenswrapper[4769]: W1121 12:54:48.549906 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03dd0a0c_1143_4bcc_90f8_c536bc9a093d.slice/crio-4c420d322085703ca1e5bb45db82b6941ed8a1cfd444ac7676b840d57cd1a969 WatchSource:0}: Error finding container 4c420d322085703ca1e5bb45db82b6941ed8a1cfd444ac7676b840d57cd1a969: Status 404 returned error can't find the container with id 4c420d322085703ca1e5bb45db82b6941ed8a1cfd444ac7676b840d57cd1a969 Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.614820 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b176fcd-3880-43c5-9870-9d985cdce6c1" containerID="8d474a775599b7d2be9e4de978bbd1e95d6ff53a635bc194018f15af66da94c6" exitCode=0 Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.615393 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" event={"ID":"7b176fcd-3880-43c5-9870-9d985cdce6c1","Type":"ContainerDied","Data":"8d474a775599b7d2be9e4de978bbd1e95d6ff53a635bc194018f15af66da94c6"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.615424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" event={"ID":"7b176fcd-3880-43c5-9870-9d985cdce6c1","Type":"ContainerStarted","Data":"3c92c5511e45cf7dd219417c6cc1b3706b55f51f2bddeec24608d282e66c9bed"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.618408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kp6nm" event={"ID":"03dd0a0c-1143-4bcc-90f8-c536bc9a093d","Type":"ContainerStarted","Data":"4c420d322085703ca1e5bb45db82b6941ed8a1cfd444ac7676b840d57cd1a969"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.620898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" event={"ID":"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1","Type":"ContainerStarted","Data":"1d9e968ab969656656db7d3d552caa0f4e29c8d54497276b9f9db28a7db11a75"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.623088 4769 generic.go:334] "Generic (PLEG): container finished" podID="336f85cd-816e-42bc-b7cb-28df388e09e0" containerID="8bc64f2099fb08eab1df9f4db849d1c6a526706b9dd6f09592c76126a33ea3e2" exitCode=0 Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.623129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" event={"ID":"336f85cd-816e-42bc-b7cb-28df388e09e0","Type":"ContainerDied","Data":"8bc64f2099fb08eab1df9f4db849d1c6a526706b9dd6f09592c76126a33ea3e2"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.623147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" event={"ID":"336f85cd-816e-42bc-b7cb-28df388e09e0","Type":"ContainerStarted","Data":"bd794604f108cd5ed1beed266cd3348ab71a5df17071cda656e20d38030a4fd5"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.625988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-nbzc8" event={"ID":"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd","Type":"ContainerStarted","Data":"54c2283e5c048970b61b5925f875540e27718c97fe446076d31df4bd066160ee"} Nov 21 12:54:48 crc kubenswrapper[4769]: I1121 12:54:48.656485 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-6ada-account-create-k47t9"] Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.645421 4769 generic.go:334] "Generic (PLEG): container finished" podID="99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" containerID="91c08359a4a3b7197670e49229241ba86e888eb0f0b0b9b31df12278ea6b5a0d" exitCode=0 Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.645786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" event={"ID":"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1","Type":"ContainerDied","Data":"91c08359a4a3b7197670e49229241ba86e888eb0f0b0b9b31df12278ea6b5a0d"} Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.649018 4769 generic.go:334] "Generic (PLEG): container finished" podID="45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" containerID="9949e9ef9b1107a1590a250088615ecd83b94806a7cceefbd1201ed5fec486cc" exitCode=0 Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.649111 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-nbzc8" event={"ID":"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd","Type":"ContainerDied","Data":"9949e9ef9b1107a1590a250088615ecd83b94806a7cceefbd1201ed5fec486cc"} Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.652912 4769 generic.go:334] "Generic (PLEG): container finished" podID="03dd0a0c-1143-4bcc-90f8-c536bc9a093d" containerID="ea88c34f4f767ae82634b83d833c9cdd37a815c7848479d30054c74da558fc5e" exitCode=0 Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.653015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kp6nm" event={"ID":"03dd0a0c-1143-4bcc-90f8-c536bc9a093d","Type":"ContainerDied","Data":"ea88c34f4f767ae82634b83d833c9cdd37a815c7848479d30054c74da558fc5e"} Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.657179 4769 generic.go:334] "Generic (PLEG): container finished" podID="79ee2529-fb13-498b-9926-3eae2785b291" containerID="c0d774f2d7f30d17936103dad2cec4bf017f5f0005c120eff453784baeeb232d" exitCode=0 Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.657267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" event={"ID":"79ee2529-fb13-498b-9926-3eae2785b291","Type":"ContainerDied","Data":"c0d774f2d7f30d17936103dad2cec4bf017f5f0005c120eff453784baeeb232d"} Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.657317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" event={"ID":"79ee2529-fb13-498b-9926-3eae2785b291","Type":"ContainerStarted","Data":"608c3935ad3079b0ba2c3f5a7260c62c00b2450846b96dc5f3d8f731ebe42b3f"} Nov 21 12:54:49 crc kubenswrapper[4769]: I1121 12:54:49.997198 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.148201 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.208327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrx9m\" (UniqueName: \"kubernetes.io/projected/336f85cd-816e-42bc-b7cb-28df388e09e0-kube-api-access-qrx9m\") pod \"336f85cd-816e-42bc-b7cb-28df388e09e0\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.208366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/336f85cd-816e-42bc-b7cb-28df388e09e0-operator-scripts\") pod \"336f85cd-816e-42bc-b7cb-28df388e09e0\" (UID: \"336f85cd-816e-42bc-b7cb-28df388e09e0\") " Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.208989 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/336f85cd-816e-42bc-b7cb-28df388e09e0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "336f85cd-816e-42bc-b7cb-28df388e09e0" (UID: "336f85cd-816e-42bc-b7cb-28df388e09e0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.209086 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/336f85cd-816e-42bc-b7cb-28df388e09e0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.213701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336f85cd-816e-42bc-b7cb-28df388e09e0-kube-api-access-qrx9m" (OuterVolumeSpecName: "kube-api-access-qrx9m") pod "336f85cd-816e-42bc-b7cb-28df388e09e0" (UID: "336f85cd-816e-42bc-b7cb-28df388e09e0"). InnerVolumeSpecName "kube-api-access-qrx9m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.240005 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.310583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b176fcd-3880-43c5-9870-9d985cdce6c1-operator-scripts\") pod \"7b176fcd-3880-43c5-9870-9d985cdce6c1\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.310854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5hwg\" (UniqueName: \"kubernetes.io/projected/7b176fcd-3880-43c5-9870-9d985cdce6c1-kube-api-access-t5hwg\") pod \"7b176fcd-3880-43c5-9870-9d985cdce6c1\" (UID: \"7b176fcd-3880-43c5-9870-9d985cdce6c1\") " Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.312866 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qrx9m\" (UniqueName: \"kubernetes.io/projected/336f85cd-816e-42bc-b7cb-28df388e09e0-kube-api-access-qrx9m\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.313800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b176fcd-3880-43c5-9870-9d985cdce6c1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7b176fcd-3880-43c5-9870-9d985cdce6c1" (UID: "7b176fcd-3880-43c5-9870-9d985cdce6c1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.315560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b176fcd-3880-43c5-9870-9d985cdce6c1-kube-api-access-t5hwg" (OuterVolumeSpecName: "kube-api-access-t5hwg") pod "7b176fcd-3880-43c5-9870-9d985cdce6c1" (UID: "7b176fcd-3880-43c5-9870-9d985cdce6c1"). InnerVolumeSpecName "kube-api-access-t5hwg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.414780 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b176fcd-3880-43c5-9870-9d985cdce6c1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.415102 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t5hwg\" (UniqueName: \"kubernetes.io/projected/7b176fcd-3880-43c5-9870-9d985cdce6c1-kube-api-access-t5hwg\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.670855 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.671901 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-325c-account-create-hcf9m" event={"ID":"336f85cd-816e-42bc-b7cb-28df388e09e0","Type":"ContainerDied","Data":"bd794604f108cd5ed1beed266cd3348ab71a5df17071cda656e20d38030a4fd5"} Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.671943 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd794604f108cd5ed1beed266cd3348ab71a5df17071cda656e20d38030a4fd5" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.676384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" event={"ID":"7b176fcd-3880-43c5-9870-9d985cdce6c1","Type":"ContainerDied","Data":"3c92c5511e45cf7dd219417c6cc1b3706b55f51f2bddeec24608d282e66c9bed"} Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.676436 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c92c5511e45cf7dd219417c6cc1b3706b55f51f2bddeec24608d282e66c9bed" Nov 21 12:54:50 crc kubenswrapper[4769]: I1121 12:54:50.678639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-zpmwl" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.010805 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.131630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-operator-scripts\") pod \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.131668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfbn7\" (UniqueName: \"kubernetes.io/projected/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-kube-api-access-wfbn7\") pod \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\" (UID: \"03dd0a0c-1143-4bcc-90f8-c536bc9a093d\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.132787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "03dd0a0c-1143-4bcc-90f8-c536bc9a093d" (UID: "03dd0a0c-1143-4bcc-90f8-c536bc9a093d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.133701 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.138457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-kube-api-access-wfbn7" (OuterVolumeSpecName: "kube-api-access-wfbn7") pod "03dd0a0c-1143-4bcc-90f8-c536bc9a093d" (UID: "03dd0a0c-1143-4bcc-90f8-c536bc9a093d"). InnerVolumeSpecName "kube-api-access-wfbn7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.197475 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.216609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.233488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-operator-scripts\") pod \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.233568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsgzm\" (UniqueName: \"kubernetes.io/projected/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-kube-api-access-wsgzm\") pod \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\" (UID: \"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.233876 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.233887 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wfbn7\" (UniqueName: \"kubernetes.io/projected/03dd0a0c-1143-4bcc-90f8-c536bc9a093d-kube-api-access-wfbn7\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.235081 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" (UID: "45bcad3a-f59b-4baa-8140-9f0e60d4e6bd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.237707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-kube-api-access-wsgzm" (OuterVolumeSpecName: "kube-api-access-wsgzm") pod "45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" (UID: "45bcad3a-f59b-4baa-8140-9f0e60d4e6bd"). InnerVolumeSpecName "kube-api-access-wsgzm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.335602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79ee2529-fb13-498b-9926-3eae2785b291-operator-scripts\") pod \"79ee2529-fb13-498b-9926-3eae2785b291\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.335677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-operator-scripts\") pod \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.335761 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kct6\" (UniqueName: \"kubernetes.io/projected/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-kube-api-access-6kct6\") pod \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\" (UID: \"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.335836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5lpp\" (UniqueName: \"kubernetes.io/projected/79ee2529-fb13-498b-9926-3eae2785b291-kube-api-access-w5lpp\") pod \"79ee2529-fb13-498b-9926-3eae2785b291\" (UID: \"79ee2529-fb13-498b-9926-3eae2785b291\") " Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.336641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ee2529-fb13-498b-9926-3eae2785b291-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "79ee2529-fb13-498b-9926-3eae2785b291" (UID: "79ee2529-fb13-498b-9926-3eae2785b291"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.336665 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.336692 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wsgzm\" (UniqueName: \"kubernetes.io/projected/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd-kube-api-access-wsgzm\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.336661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" (UID: "99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.339505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ee2529-fb13-498b-9926-3eae2785b291-kube-api-access-w5lpp" (OuterVolumeSpecName: "kube-api-access-w5lpp") pod "79ee2529-fb13-498b-9926-3eae2785b291" (UID: "79ee2529-fb13-498b-9926-3eae2785b291"). InnerVolumeSpecName "kube-api-access-w5lpp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.339948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-kube-api-access-6kct6" (OuterVolumeSpecName: "kube-api-access-6kct6") pod "99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" (UID: "99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1"). InnerVolumeSpecName "kube-api-access-6kct6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.438011 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w5lpp\" (UniqueName: \"kubernetes.io/projected/79ee2529-fb13-498b-9926-3eae2785b291-kube-api-access-w5lpp\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.438049 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/79ee2529-fb13-498b-9926-3eae2785b291-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.438058 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.438066 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6kct6\" (UniqueName: \"kubernetes.io/projected/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1-kube-api-access-6kct6\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.693577 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-kp6nm" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.693484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-kp6nm" event={"ID":"03dd0a0c-1143-4bcc-90f8-c536bc9a093d","Type":"ContainerDied","Data":"4c420d322085703ca1e5bb45db82b6941ed8a1cfd444ac7676b840d57cd1a969"} Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.694005 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c420d322085703ca1e5bb45db82b6941ed8a1cfd444ac7676b840d57cd1a969" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.696065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" event={"ID":"79ee2529-fb13-498b-9926-3eae2785b291","Type":"ContainerDied","Data":"608c3935ad3079b0ba2c3f5a7260c62c00b2450846b96dc5f3d8f731ebe42b3f"} Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.696123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-6ada-account-create-k47t9" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.696214 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="608c3935ad3079b0ba2c3f5a7260c62c00b2450846b96dc5f3d8f731ebe42b3f" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.699433 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b2161b8-5f77-4c61-b867-312c5d81b401" containerID="31ca482243e2d16fefa82e2b4157ef9a354e917c04961391d3d8fea490b18f20" exitCode=0 Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.699481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" event={"ID":"9b2161b8-5f77-4c61-b867-312c5d81b401","Type":"ContainerDied","Data":"31ca482243e2d16fefa82e2b4157ef9a354e917c04961391d3d8fea490b18f20"} Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.702542 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.702620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d614-account-create-pc76c" event={"ID":"99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1","Type":"ContainerDied","Data":"1d9e968ab969656656db7d3d552caa0f4e29c8d54497276b9f9db28a7db11a75"} Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.702658 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d9e968ab969656656db7d3d552caa0f4e29c8d54497276b9f9db28a7db11a75" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.705824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-nbzc8" event={"ID":"45bcad3a-f59b-4baa-8140-9f0e60d4e6bd","Type":"ContainerDied","Data":"54c2283e5c048970b61b5925f875540e27718c97fe446076d31df4bd066160ee"} Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.705862 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54c2283e5c048970b61b5925f875540e27718c97fe446076d31df4bd066160ee" Nov 21 12:54:51 crc kubenswrapper[4769]: I1121 12:54:51.705928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-nbzc8" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.073565 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-gzzdx"] Nov 21 12:54:53 crc kubenswrapper[4769]: E1121 12:54:53.074267 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="03dd0a0c-1143-4bcc-90f8-c536bc9a093d" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074283 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="03dd0a0c-1143-4bcc-90f8-c536bc9a093d" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: E1121 12:54:53.074301 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074310 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: E1121 12:54:53.074331 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074340 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: E1121 12:54:53.074352 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="79ee2529-fb13-498b-9926-3eae2785b291" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074360 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ee2529-fb13-498b-9926-3eae2785b291" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: E1121 12:54:53.074377 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="336f85cd-816e-42bc-b7cb-28df388e09e0" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074385 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="336f85cd-816e-42bc-b7cb-28df388e09e0" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: E1121 12:54:53.074404 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b176fcd-3880-43c5-9870-9d985cdce6c1" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074412 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b176fcd-3880-43c5-9870-9d985cdce6c1" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074610 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074628 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="03dd0a0c-1143-4bcc-90f8-c536bc9a093d" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074643 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b176fcd-3880-43c5-9870-9d985cdce6c1" containerName="mariadb-database-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074657 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074677 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="336f85cd-816e-42bc-b7cb-28df388e09e0" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.074688 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="79ee2529-fb13-498b-9926-3eae2785b291" containerName="mariadb-account-create" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.075403 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.078845 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.079268 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-p27px" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.082633 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-gzzdx"] Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.126836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-combined-ca-bundle\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-swiftconf\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2fnp\" (UniqueName: \"kubernetes.io/projected/9b2161b8-5f77-4c61-b867-312c5d81b401-kube-api-access-r2fnp\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9b2161b8-5f77-4c61-b867-312c5d81b401-etc-swift\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168580 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-ring-data-devices\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-scripts\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-dispersionconf\") pod \"9b2161b8-5f77-4c61-b867-312c5d81b401\" (UID: \"9b2161b8-5f77-4c61-b867-312c5d81b401\") " Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-config-data\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-db-sync-config-data\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqq9h\" (UniqueName: \"kubernetes.io/projected/41edb57b-8e02-45c7-81ab-cad3d0d85c77-kube-api-access-fqq9h\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.168986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-combined-ca-bundle\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.169342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.170047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b2161b8-5f77-4c61-b867-312c5d81b401-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.174485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2161b8-5f77-4c61-b867-312c5d81b401-kube-api-access-r2fnp" (OuterVolumeSpecName: "kube-api-access-r2fnp") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "kube-api-access-r2fnp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.182575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.193914 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-scripts" (OuterVolumeSpecName: "scripts") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.197410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.205607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9b2161b8-5f77-4c61-b867-312c5d81b401" (UID: "9b2161b8-5f77-4c61-b867-312c5d81b401"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.270782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-config-data\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.270854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-db-sync-config-data\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.270886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fqq9h\" (UniqueName: \"kubernetes.io/projected/41edb57b-8e02-45c7-81ab-cad3d0d85c77-kube-api-access-fqq9h\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.270914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-combined-ca-bundle\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271021 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271033 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271042 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/9b2161b8-5f77-4c61-b867-312c5d81b401-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271051 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r2fnp\" (UniqueName: \"kubernetes.io/projected/9b2161b8-5f77-4c61-b867-312c5d81b401-kube-api-access-r2fnp\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271061 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/9b2161b8-5f77-4c61-b867-312c5d81b401-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271072 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.271080 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9b2161b8-5f77-4c61-b867-312c5d81b401-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.275135 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-config-data\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.276999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-combined-ca-bundle\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.288805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-db-sync-config-data\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.293440 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqq9h\" (UniqueName: \"kubernetes.io/projected/41edb57b-8e02-45c7-81ab-cad3d0d85c77-kube-api-access-fqq9h\") pod \"glance-db-sync-gzzdx\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.437046 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.729171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" event={"ID":"9b2161b8-5f77-4c61-b867-312c5d81b401","Type":"ContainerDied","Data":"bcf481d4dfb0e6c219ca2f183bf0b8c2b857a417796ec4b5630b1abb04dc6a5e"} Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.729639 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcf481d4dfb0e6c219ca2f183bf0b8c2b857a417796ec4b5630b1abb04dc6a5e" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.729482 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-dbmlk" Nov 21 12:54:53 crc kubenswrapper[4769]: I1121 12:54:53.916113 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-gzzdx"] Nov 21 12:54:54 crc kubenswrapper[4769]: I1121 12:54:54.741506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" event={"ID":"41edb57b-8e02-45c7-81ab-cad3d0d85c77","Type":"ContainerStarted","Data":"05f6d69cc73fb3fb3aa0dd35b5abfaa3be869a37e98aad7ef01468a29fb7cb20"} Nov 21 12:54:54 crc kubenswrapper[4769]: I1121 12:54:54.742018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" event={"ID":"41edb57b-8e02-45c7-81ab-cad3d0d85c77","Type":"ContainerStarted","Data":"d83e01f36b3ab0cc01b4d2ae8c4c30ebfaf332ee7807d92743b99d1c949cbef0"} Nov 21 12:54:54 crc kubenswrapper[4769]: I1121 12:54:54.759049 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" podStartSLOduration=1.759031617 podStartE2EDuration="1.759031617s" podCreationTimestamp="2025-11-21 12:54:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:54.755097401 +0000 UTC m=+3853.455759219" watchObservedRunningTime="2025-11-21 12:54:54.759031617 +0000 UTC m=+3853.459693435" Nov 21 12:54:55 crc kubenswrapper[4769]: I1121 12:54:55.418080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:55 crc kubenswrapper[4769]: I1121 12:54:55.430988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"swift-storage-0\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:55 crc kubenswrapper[4769]: I1121 12:54:55.696814 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:54:56 crc kubenswrapper[4769]: I1121 12:54:56.204243 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:54:56 crc kubenswrapper[4769]: W1121 12:54:56.217082 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod518a86ab_f04b_4ee1_9bba_13e68dd3367f.slice/crio-cb0206b5364a5a45cf48ca7ca50f4a34967626d0505ea4b126d83bf87cec25e0 WatchSource:0}: Error finding container cb0206b5364a5a45cf48ca7ca50f4a34967626d0505ea4b126d83bf87cec25e0: Status 404 returned error can't find the container with id cb0206b5364a5a45cf48ca7ca50f4a34967626d0505ea4b126d83bf87cec25e0 Nov 21 12:54:56 crc kubenswrapper[4769]: I1121 12:54:56.766605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"19cae6c40c04f2d0b6aa8a7acdbccbe3b0829f9be0af252bfb2442dd0e24a934"} Nov 21 12:54:56 crc kubenswrapper[4769]: I1121 12:54:56.766655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"f3c41189207483bed741fbe1eca04b77d12b0a5d653df610f2d21a60b9a3a52e"} Nov 21 12:54:56 crc kubenswrapper[4769]: I1121 12:54:56.766667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"cb0206b5364a5a45cf48ca7ca50f4a34967626d0505ea4b126d83bf87cec25e0"} Nov 21 12:54:57 crc kubenswrapper[4769]: I1121 12:54:57.780036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"6e418a77e087210f81458a321f94daae19a012f31eb05c53218977f73c0c7ecb"} Nov 21 12:54:57 crc kubenswrapper[4769]: I1121 12:54:57.780082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"4a53429063a1abad29db3e93af022c9698bde19d8f26120ed10411fc798631b2"} Nov 21 12:54:57 crc kubenswrapper[4769]: I1121 12:54:57.780093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"7658acd3127c093ed6b53623fb41ae6ed83614172dec592ab8d7bd54e99d122c"} Nov 21 12:54:57 crc kubenswrapper[4769]: I1121 12:54:57.780102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"48aaa1398a01cfdf10e3e994a6b204b33ab3cbffa345e750ec9e6fb4459d9b6a"} Nov 21 12:54:58 crc kubenswrapper[4769]: I1121 12:54:58.799311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"ae730ab8fb5d7e35b715a5162b533d15ac439a26f800265a1333b62a112c5d1e"} Nov 21 12:54:58 crc kubenswrapper[4769]: I1121 12:54:58.799571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"a413b78de0d50873bb41e7a995c611bfdee6d291a98621d94c00ac3bc624cb52"} Nov 21 12:54:58 crc kubenswrapper[4769]: I1121 12:54:58.799583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"e26b4cb65ba7c4dbcd4dcb1eb2abb174ebfbfd08960a9e959fef0d9f09596514"} Nov 21 12:54:58 crc kubenswrapper[4769]: I1121 12:54:58.799592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"6a29f76a44115ba58e6d5a4148557676be04e40e200d9bf5daaa2fb476cf3f7b"} Nov 21 12:54:58 crc kubenswrapper[4769]: I1121 12:54:58.799601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"4afbb1d41d0984afaa018a0eeadb6bdb8b8c1c3a685f776c033e7063720abe7f"} Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.813262 4769 generic.go:334] "Generic (PLEG): container finished" podID="48a5313d-540b-4d62-8511-8154abf0acca" containerID="e8102b1e073a94e992e30c03d9f62e84b8808c8ec83c853496cf97787e11d9af" exitCode=0 Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.813749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"48a5313d-540b-4d62-8511-8154abf0acca","Type":"ContainerDied","Data":"e8102b1e073a94e992e30c03d9f62e84b8808c8ec83c853496cf97787e11d9af"} Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.828789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"92a838ac1402ea733ff16d45dc7cadef991e4de13e448a4e4f43472db87a572a"} Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.828846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"48ac78290719a28b8a65fb2b1e00ce46444a0022eb4974d5f57bbf6a9cbc83ea"} Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.828860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"f765683feb2e0f1426e0b16abb61222a212032fa7183cd04c6c236404896b156"} Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.828876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerStarted","Data":"f5df53c59e1375fac0d8b0375bc81d73bacd1a0151d23df40f8e6bfd65223e20"} Nov 21 12:54:59 crc kubenswrapper[4769]: I1121 12:54:59.911133 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=21.911117465 podStartE2EDuration="21.911117465s" podCreationTimestamp="2025-11-21 12:54:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:54:59.90537332 +0000 UTC m=+3858.606035158" watchObservedRunningTime="2025-11-21 12:54:59.911117465 +0000 UTC m=+3858.611779283" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.088020 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w"] Nov 21 12:55:00 crc kubenswrapper[4769]: E1121 12:55:00.088637 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b2161b8-5f77-4c61-b867-312c5d81b401" containerName="swift-ring-rebalance" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.088659 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2161b8-5f77-4c61-b867-312c5d81b401" containerName="swift-ring-rebalance" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.088932 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b2161b8-5f77-4c61-b867-312c5d81b401" containerName="swift-ring-rebalance" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.090485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.094623 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.108073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w"] Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.202385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-config\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.202688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.202816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.202893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8tj\" (UniqueName: \"kubernetes.io/projected/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-kube-api-access-fm8tj\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.274393 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:55:00 crc kubenswrapper[4769]: E1121 12:55:00.274710 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.304128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.304181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8tj\" (UniqueName: \"kubernetes.io/projected/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-kube-api-access-fm8tj\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.304275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-config\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.304385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.305442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.305449 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.305689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-config\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.322513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8tj\" (UniqueName: \"kubernetes.io/projected/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-kube-api-access-fm8tj\") pod \"dnsmasq-dnsmasq-5d7d7bd4b7-ml55w\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.424616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.846123 4769 generic.go:334] "Generic (PLEG): container finished" podID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerID="f843c77497dc9e9b693850577427cce1b7ec48f68e36a8d3c1bfbcc30ad52176" exitCode=0 Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.846254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279f45ed-32ec-46a1-999e-eb8136b76df5","Type":"ContainerDied","Data":"f843c77497dc9e9b693850577427cce1b7ec48f68e36a8d3c1bfbcc30ad52176"} Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.850205 4769 generic.go:334] "Generic (PLEG): container finished" podID="41edb57b-8e02-45c7-81ab-cad3d0d85c77" containerID="05f6d69cc73fb3fb3aa0dd35b5abfaa3be869a37e98aad7ef01468a29fb7cb20" exitCode=0 Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.850292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" event={"ID":"41edb57b-8e02-45c7-81ab-cad3d0d85c77","Type":"ContainerDied","Data":"05f6d69cc73fb3fb3aa0dd35b5abfaa3be869a37e98aad7ef01468a29fb7cb20"} Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.854285 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"48a5313d-540b-4d62-8511-8154abf0acca","Type":"ContainerStarted","Data":"a9406414b96be5316ab9bee81dc5ccd2d6f8d44630478e05d518adee9f641ca4"} Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.855739 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.902854 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w"] Nov 21 12:55:00 crc kubenswrapper[4769]: I1121 12:55:00.909982 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.909969425 podStartE2EDuration="36.909969425s" podCreationTimestamp="2025-11-21 12:54:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:00.904328143 +0000 UTC m=+3859.604989971" watchObservedRunningTime="2025-11-21 12:55:00.909969425 +0000 UTC m=+3859.610631253" Nov 21 12:55:01 crc kubenswrapper[4769]: I1121 12:55:01.894038 4769 generic.go:334] "Generic (PLEG): container finished" podID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerID="9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8" exitCode=0 Nov 21 12:55:01 crc kubenswrapper[4769]: I1121 12:55:01.894643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" event={"ID":"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd","Type":"ContainerDied","Data":"9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8"} Nov 21 12:55:01 crc kubenswrapper[4769]: I1121 12:55:01.894689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" event={"ID":"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd","Type":"ContainerStarted","Data":"d75724acd6cef73b6e489b3d57d23266115753fcbc48a1c7b4df76e73cd1550f"} Nov 21 12:55:01 crc kubenswrapper[4769]: I1121 12:55:01.902742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279f45ed-32ec-46a1-999e-eb8136b76df5","Type":"ContainerStarted","Data":"bb7913ca5ec0f188e66436ec552e90fbe1261d1870b97d0f697d6b766befad1a"} Nov 21 12:55:01 crc kubenswrapper[4769]: I1121 12:55:01.903233 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:55:01 crc kubenswrapper[4769]: I1121 12:55:01.953106 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.953080479 podStartE2EDuration="37.953080479s" podCreationTimestamp="2025-11-21 12:54:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:01.948316971 +0000 UTC m=+3860.648978799" watchObservedRunningTime="2025-11-21 12:55:01.953080479 +0000 UTC m=+3860.653742337" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.298862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.442610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-db-sync-config-data\") pod \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.442699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-combined-ca-bundle\") pod \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.442792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-config-data\") pod \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.442952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqq9h\" (UniqueName: \"kubernetes.io/projected/41edb57b-8e02-45c7-81ab-cad3d0d85c77-kube-api-access-fqq9h\") pod \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\" (UID: \"41edb57b-8e02-45c7-81ab-cad3d0d85c77\") " Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.447530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41edb57b-8e02-45c7-81ab-cad3d0d85c77-kube-api-access-fqq9h" (OuterVolumeSpecName: "kube-api-access-fqq9h") pod "41edb57b-8e02-45c7-81ab-cad3d0d85c77" (UID: "41edb57b-8e02-45c7-81ab-cad3d0d85c77"). InnerVolumeSpecName "kube-api-access-fqq9h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.447948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "41edb57b-8e02-45c7-81ab-cad3d0d85c77" (UID: "41edb57b-8e02-45c7-81ab-cad3d0d85c77"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.475857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "41edb57b-8e02-45c7-81ab-cad3d0d85c77" (UID: "41edb57b-8e02-45c7-81ab-cad3d0d85c77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.492513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-config-data" (OuterVolumeSpecName: "config-data") pod "41edb57b-8e02-45c7-81ab-cad3d0d85c77" (UID: "41edb57b-8e02-45c7-81ab-cad3d0d85c77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.544282 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fqq9h\" (UniqueName: \"kubernetes.io/projected/41edb57b-8e02-45c7-81ab-cad3d0d85c77-kube-api-access-fqq9h\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.544316 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.544326 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.544335 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/41edb57b-8e02-45c7-81ab-cad3d0d85c77-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.920136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.920127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-gzzdx" event={"ID":"41edb57b-8e02-45c7-81ab-cad3d0d85c77","Type":"ContainerDied","Data":"d83e01f36b3ab0cc01b4d2ae8c4c30ebfaf332ee7807d92743b99d1c949cbef0"} Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.920229 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d83e01f36b3ab0cc01b4d2ae8c4c30ebfaf332ee7807d92743b99d1c949cbef0" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.925735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" event={"ID":"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd","Type":"ContainerStarted","Data":"b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8"} Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.925811 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:02 crc kubenswrapper[4769]: I1121 12:55:02.954372 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" podStartSLOduration=2.954348456 podStartE2EDuration="2.954348456s" podCreationTimestamp="2025-11-21 12:55:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:02.948996572 +0000 UTC m=+3861.649658420" watchObservedRunningTime="2025-11-21 12:55:02.954348456 +0000 UTC m=+3861.655010314" Nov 21 12:55:10 crc kubenswrapper[4769]: I1121 12:55:10.426488 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:55:10 crc kubenswrapper[4769]: I1121 12:55:10.510089 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v"] Nov 21 12:55:10 crc kubenswrapper[4769]: I1121 12:55:10.510479 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerName="dnsmasq-dns" containerID="cri-o://10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d" gracePeriod=10 Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.020838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.027477 4769 generic.go:334] "Generic (PLEG): container finished" podID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerID="10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d" exitCode=0 Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.027545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" event={"ID":"13de8ad4-38e7-432c-8502-dbbcc423f446","Type":"ContainerDied","Data":"10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d"} Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.027567 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.027600 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v" event={"ID":"13de8ad4-38e7-432c-8502-dbbcc423f446","Type":"ContainerDied","Data":"48dba01234b5a01ad19391b921c58afe2e01fb28fb053150e35d8252c5b8d304"} Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.027630 4769 scope.go:117] "RemoveContainer" containerID="10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.062294 4769 scope.go:117] "RemoveContainer" containerID="aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.096622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f25b4\" (UniqueName: \"kubernetes.io/projected/13de8ad4-38e7-432c-8502-dbbcc423f446-kube-api-access-f25b4\") pod \"13de8ad4-38e7-432c-8502-dbbcc423f446\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.096785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-dnsmasq-svc\") pod \"13de8ad4-38e7-432c-8502-dbbcc423f446\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.096938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-config\") pod \"13de8ad4-38e7-432c-8502-dbbcc423f446\" (UID: \"13de8ad4-38e7-432c-8502-dbbcc423f446\") " Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.104536 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13de8ad4-38e7-432c-8502-dbbcc423f446-kube-api-access-f25b4" (OuterVolumeSpecName: "kube-api-access-f25b4") pod "13de8ad4-38e7-432c-8502-dbbcc423f446" (UID: "13de8ad4-38e7-432c-8502-dbbcc423f446"). InnerVolumeSpecName "kube-api-access-f25b4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.106473 4769 scope.go:117] "RemoveContainer" containerID="10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d" Nov 21 12:55:11 crc kubenswrapper[4769]: E1121 12:55:11.109323 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d\": container with ID starting with 10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d not found: ID does not exist" containerID="10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.109388 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d"} err="failed to get container status \"10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d\": rpc error: code = NotFound desc = could not find container \"10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d\": container with ID starting with 10d47e0c5ec9bfc92944e24956bf83595acbc57ec32babfcf9c9579ae965384d not found: ID does not exist" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.109417 4769 scope.go:117] "RemoveContainer" containerID="aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38" Nov 21 12:55:11 crc kubenswrapper[4769]: E1121 12:55:11.109837 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38\": container with ID starting with aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38 not found: ID does not exist" containerID="aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.109888 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38"} err="failed to get container status \"aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38\": rpc error: code = NotFound desc = could not find container \"aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38\": container with ID starting with aea9134efc68cc68108adf96a53f129092456a85d34ea03ec1ef1bfa541fea38 not found: ID does not exist" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.165341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "13de8ad4-38e7-432c-8502-dbbcc423f446" (UID: "13de8ad4-38e7-432c-8502-dbbcc423f446"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.170339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-config" (OuterVolumeSpecName: "config") pod "13de8ad4-38e7-432c-8502-dbbcc423f446" (UID: "13de8ad4-38e7-432c-8502-dbbcc423f446"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.198903 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.198927 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13de8ad4-38e7-432c-8502-dbbcc423f446-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.198938 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f25b4\" (UniqueName: \"kubernetes.io/projected/13de8ad4-38e7-432c-8502-dbbcc423f446-kube-api-access-f25b4\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.358959 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v"] Nov 21 12:55:11 crc kubenswrapper[4769]: I1121 12:55:11.366327 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-qxg2v"] Nov 21 12:55:13 crc kubenswrapper[4769]: I1121 12:55:13.290912 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" path="/var/lib/kubelet/pods/13de8ad4-38e7-432c-8502-dbbcc423f446/volumes" Nov 21 12:55:14 crc kubenswrapper[4769]: I1121 12:55:14.275045 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:55:14 crc kubenswrapper[4769]: E1121 12:55:14.275617 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.573510 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.936985 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gwz95"] Nov 21 12:55:15 crc kubenswrapper[4769]: E1121 12:55:15.937535 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerName="dnsmasq-dns" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.937552 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerName="dnsmasq-dns" Nov 21 12:55:15 crc kubenswrapper[4769]: E1121 12:55:15.937584 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerName="init" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.937591 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerName="init" Nov 21 12:55:15 crc kubenswrapper[4769]: E1121 12:55:15.937603 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="41edb57b-8e02-45c7-81ab-cad3d0d85c77" containerName="glance-db-sync" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.937609 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="41edb57b-8e02-45c7-81ab-cad3d0d85c77" containerName="glance-db-sync" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.937752 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="41edb57b-8e02-45c7-81ab-cad3d0d85c77" containerName="glance-db-sync" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.937766 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="13de8ad4-38e7-432c-8502-dbbcc423f446" containerName="dnsmasq-dns" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.938261 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.946277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gwz95"] Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.995602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e25a1e25-5a23-4241-bf27-234419d09917-operator-scripts\") pod \"cinder-db-create-gwz95\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.995666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqbds\" (UniqueName: \"kubernetes.io/projected/e25a1e25-5a23-4241-bf27-234419d09917-kube-api-access-dqbds\") pod \"cinder-db-create-gwz95\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:15 crc kubenswrapper[4769]: I1121 12:55:15.998028 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.085413 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6cgv7"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.086542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.092785 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.093900 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.097828 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6cgv7"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.098436 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.098862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e25a1e25-5a23-4241-bf27-234419d09917-operator-scripts\") pod \"cinder-db-create-gwz95\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.098935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dqbds\" (UniqueName: \"kubernetes.io/projected/e25a1e25-5a23-4241-bf27-234419d09917-kube-api-access-dqbds\") pod \"cinder-db-create-gwz95\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.103287 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e25a1e25-5a23-4241-bf27-234419d09917-operator-scripts\") pod \"cinder-db-create-gwz95\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.108108 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.144123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqbds\" (UniqueName: \"kubernetes.io/projected/e25a1e25-5a23-4241-bf27-234419d09917-kube-api-access-dqbds\") pod \"cinder-db-create-gwz95\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.160519 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-ffwt6"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.162107 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.167636 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-72a2-account-create-mf92j"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.172911 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.175616 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.175877 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-ffwt6"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.183326 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-72a2-account-create-mf92j"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.201135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53fb7874-5587-4186-8a29-038a560144f3-operator-scripts\") pod \"neutron-1fd2-account-create-kz9d2\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.201292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d101a14e-7629-487a-a3de-be159255102f-operator-scripts\") pod \"barbican-db-create-6cgv7\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.201376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8vr\" (UniqueName: \"kubernetes.io/projected/d101a14e-7629-487a-a3de-be159255102f-kube-api-access-gn8vr\") pod \"barbican-db-create-6cgv7\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.201400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnml\" (UniqueName: \"kubernetes.io/projected/53fb7874-5587-4186-8a29-038a560144f3-kube-api-access-qvnml\") pod \"neutron-1fd2-account-create-kz9d2\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.265443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d101a14e-7629-487a-a3de-be159255102f-operator-scripts\") pod \"barbican-db-create-6cgv7\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jng5m\" (UniqueName: \"kubernetes.io/projected/abc3fa26-faf8-4114-994c-5eb77049a843-kube-api-access-jng5m\") pod \"cinder-72a2-account-create-mf92j\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abc3fa26-faf8-4114-994c-5eb77049a843-operator-scripts\") pod \"cinder-72a2-account-create-mf92j\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrgtt\" (UniqueName: \"kubernetes.io/projected/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-kube-api-access-wrgtt\") pod \"neutron-db-create-ffwt6\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8vr\" (UniqueName: \"kubernetes.io/projected/d101a14e-7629-487a-a3de-be159255102f-kube-api-access-gn8vr\") pod \"barbican-db-create-6cgv7\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnml\" (UniqueName: \"kubernetes.io/projected/53fb7874-5587-4186-8a29-038a560144f3-kube-api-access-qvnml\") pod \"neutron-1fd2-account-create-kz9d2\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53fb7874-5587-4186-8a29-038a560144f3-operator-scripts\") pod \"neutron-1fd2-account-create-kz9d2\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.303712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-operator-scripts\") pod \"neutron-db-create-ffwt6\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.304692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d101a14e-7629-487a-a3de-be159255102f-operator-scripts\") pod \"barbican-db-create-6cgv7\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.305266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53fb7874-5587-4186-8a29-038a560144f3-operator-scripts\") pod \"neutron-1fd2-account-create-kz9d2\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.346280 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-mnnzq"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.347571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.357277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-mnnzq"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.358722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnml\" (UniqueName: \"kubernetes.io/projected/53fb7874-5587-4186-8a29-038a560144f3-kube-api-access-qvnml\") pod \"neutron-1fd2-account-create-kz9d2\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.361582 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.361890 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-2ng29" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.362002 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.362110 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.365496 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-bf23-account-create-f9d9f"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.367353 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.375419 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.385814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-bf23-account-create-f9d9f"] Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.409934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jng5m\" (UniqueName: \"kubernetes.io/projected/abc3fa26-faf8-4114-994c-5eb77049a843-kube-api-access-jng5m\") pod \"cinder-72a2-account-create-mf92j\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.425826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abc3fa26-faf8-4114-994c-5eb77049a843-operator-scripts\") pod \"cinder-72a2-account-create-mf92j\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.426125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wrgtt\" (UniqueName: \"kubernetes.io/projected/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-kube-api-access-wrgtt\") pod \"neutron-db-create-ffwt6\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.426370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-operator-scripts\") pod \"neutron-db-create-ffwt6\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.426451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-combined-ca-bundle\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.426547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-config-data\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.426658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58nz5\" (UniqueName: \"kubernetes.io/projected/a9a6ec6a-4204-472b-a384-abda04d850e1-kube-api-access-58nz5\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.417839 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.427924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abc3fa26-faf8-4114-994c-5eb77049a843-operator-scripts\") pod \"cinder-72a2-account-create-mf92j\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.425760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8vr\" (UniqueName: \"kubernetes.io/projected/d101a14e-7629-487a-a3de-be159255102f-kube-api-access-gn8vr\") pod \"barbican-db-create-6cgv7\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.429622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-operator-scripts\") pod \"neutron-db-create-ffwt6\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.451784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrgtt\" (UniqueName: \"kubernetes.io/projected/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-kube-api-access-wrgtt\") pod \"neutron-db-create-ffwt6\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.460770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jng5m\" (UniqueName: \"kubernetes.io/projected/abc3fa26-faf8-4114-994c-5eb77049a843-kube-api-access-jng5m\") pod \"cinder-72a2-account-create-mf92j\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.479632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.501659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.534697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-combined-ca-bundle\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.534748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-config-data\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.534788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-58nz5\" (UniqueName: \"kubernetes.io/projected/a9a6ec6a-4204-472b-a384-abda04d850e1-kube-api-access-58nz5\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.534852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-operator-scripts\") pod \"barbican-bf23-account-create-f9d9f\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.534877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg9lh\" (UniqueName: \"kubernetes.io/projected/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-kube-api-access-gg9lh\") pod \"barbican-bf23-account-create-f9d9f\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.545932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-combined-ca-bundle\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.553078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-config-data\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.569648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nz5\" (UniqueName: \"kubernetes.io/projected/a9a6ec6a-4204-472b-a384-abda04d850e1-kube-api-access-58nz5\") pod \"keystone-db-sync-mnnzq\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.636987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-operator-scripts\") pod \"barbican-bf23-account-create-f9d9f\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.637024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gg9lh\" (UniqueName: \"kubernetes.io/projected/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-kube-api-access-gg9lh\") pod \"barbican-bf23-account-create-f9d9f\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.638478 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-operator-scripts\") pod \"barbican-bf23-account-create-f9d9f\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.655798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg9lh\" (UniqueName: \"kubernetes.io/projected/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-kube-api-access-gg9lh\") pod \"barbican-bf23-account-create-f9d9f\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.715392 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.762004 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.790067 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:16 crc kubenswrapper[4769]: I1121 12:55:16.942462 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gwz95"] Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.024326 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2"] Nov 21 12:55:17 crc kubenswrapper[4769]: W1121 12:55:17.035597 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53fb7874_5587_4186_8a29_038a560144f3.slice/crio-923f80c7954c74f0d1230ae9281919527b2188ccdc0dedfadfae606a907efb85 WatchSource:0}: Error finding container 923f80c7954c74f0d1230ae9281919527b2188ccdc0dedfadfae606a907efb85: Status 404 returned error can't find the container with id 923f80c7954c74f0d1230ae9281919527b2188ccdc0dedfadfae606a907efb85 Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.089890 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-72a2-account-create-mf92j"] Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.106418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gwz95" event={"ID":"e25a1e25-5a23-4241-bf27-234419d09917","Type":"ContainerStarted","Data":"56b888d5703cb6399523b4211419bcaf2e320d9806357676f7a0919aa3105d06"} Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.106463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gwz95" event={"ID":"e25a1e25-5a23-4241-bf27-234419d09917","Type":"ContainerStarted","Data":"2cb4b7b8d5e40d80e9c4350b9be731d387ca56bd4d0bce839ac8e50f0c54182d"} Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.110749 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-ffwt6"] Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.132707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" event={"ID":"53fb7874-5587-4186-8a29-038a560144f3","Type":"ContainerStarted","Data":"923f80c7954c74f0d1230ae9281919527b2188ccdc0dedfadfae606a907efb85"} Nov 21 12:55:17 crc kubenswrapper[4769]: W1121 12:55:17.137096 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f0df705_b5cf_4e4c_a84c_7cc14831b77f.slice/crio-f43247c7cecc2c5ad5d3f21b88452e394799e6859b0f0fda0fcce329fa7bcd6b WatchSource:0}: Error finding container f43247c7cecc2c5ad5d3f21b88452e394799e6859b0f0fda0fcce329fa7bcd6b: Status 404 returned error can't find the container with id f43247c7cecc2c5ad5d3f21b88452e394799e6859b0f0fda0fcce329fa7bcd6b Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.138341 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-gwz95" podStartSLOduration=2.138327633 podStartE2EDuration="2.138327633s" podCreationTimestamp="2025-11-21 12:55:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:17.122516797 +0000 UTC m=+3875.823178605" watchObservedRunningTime="2025-11-21 12:55:17.138327633 +0000 UTC m=+3875.838989451" Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.303323 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6cgv7"] Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.309949 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-mnnzq"] Nov 21 12:55:17 crc kubenswrapper[4769]: I1121 12:55:17.326353 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-bf23-account-create-f9d9f"] Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.174292 4769 generic.go:334] "Generic (PLEG): container finished" podID="765d38de-7be6-4a5f-b8c9-8e89bdaada8e" containerID="985ffcd4298c7325d61270be42f82b8c1efd77b6038db3af765cdfb8b25bbfd4" exitCode=0 Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.174324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" event={"ID":"765d38de-7be6-4a5f-b8c9-8e89bdaada8e","Type":"ContainerDied","Data":"985ffcd4298c7325d61270be42f82b8c1efd77b6038db3af765cdfb8b25bbfd4"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.174438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" event={"ID":"765d38de-7be6-4a5f-b8c9-8e89bdaada8e","Type":"ContainerStarted","Data":"3b4b92bb811b8c1dec8055492ccd2faa33bdf3ef5aef27c2780433bedd8922af"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.180204 4769 generic.go:334] "Generic (PLEG): container finished" podID="abc3fa26-faf8-4114-994c-5eb77049a843" containerID="5c58a3c586bb01b0ff3618afbadf6d287facf1097648599c8356593f738597e1" exitCode=0 Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.180281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" event={"ID":"abc3fa26-faf8-4114-994c-5eb77049a843","Type":"ContainerDied","Data":"5c58a3c586bb01b0ff3618afbadf6d287facf1097648599c8356593f738597e1"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.180302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" event={"ID":"abc3fa26-faf8-4114-994c-5eb77049a843","Type":"ContainerStarted","Data":"8bf993536442105b51bdc3124bbc6d487378769f5def56dd3c05a6854a94f80d"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.184936 4769 generic.go:334] "Generic (PLEG): container finished" podID="e25a1e25-5a23-4241-bf27-234419d09917" containerID="56b888d5703cb6399523b4211419bcaf2e320d9806357676f7a0919aa3105d06" exitCode=0 Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.185209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gwz95" event={"ID":"e25a1e25-5a23-4241-bf27-234419d09917","Type":"ContainerDied","Data":"56b888d5703cb6399523b4211419bcaf2e320d9806357676f7a0919aa3105d06"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.189791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" event={"ID":"a9a6ec6a-4204-472b-a384-abda04d850e1","Type":"ContainerStarted","Data":"458ea4746c499faed0a5b2993bb3da8d5dd6f67e434205828c4e365397b026bc"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.189893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" event={"ID":"a9a6ec6a-4204-472b-a384-abda04d850e1","Type":"ContainerStarted","Data":"956c0b36f4157e3a22083c7bcea4e8a681535c9370188e88f7286be1a5dbfb31"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.200433 4769 generic.go:334] "Generic (PLEG): container finished" podID="d101a14e-7629-487a-a3de-be159255102f" containerID="8d6633181fe3adae179d055ca25157a1b90a8dd34414442064540f0eebac32bc" exitCode=0 Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.200523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" event={"ID":"d101a14e-7629-487a-a3de-be159255102f","Type":"ContainerDied","Data":"8d6633181fe3adae179d055ca25157a1b90a8dd34414442064540f0eebac32bc"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.200700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" event={"ID":"d101a14e-7629-487a-a3de-be159255102f","Type":"ContainerStarted","Data":"98be634596fbe09252acf5d61bff4e7bcea521bc49a06f5980f6640855987cb0"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.209145 4769 generic.go:334] "Generic (PLEG): container finished" podID="53fb7874-5587-4186-8a29-038a560144f3" containerID="c8cadff964386a6ce191b7dae0b8a20df38f9c6c042be677e7e7160284220358" exitCode=0 Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.209497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" event={"ID":"53fb7874-5587-4186-8a29-038a560144f3","Type":"ContainerDied","Data":"c8cadff964386a6ce191b7dae0b8a20df38f9c6c042be677e7e7160284220358"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.213774 4769 generic.go:334] "Generic (PLEG): container finished" podID="7f0df705-b5cf-4e4c-a84c-7cc14831b77f" containerID="251a87ace601cb995275147980b339cedc2e7c43220b9cd68d79fe828a92b352" exitCode=0 Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.213820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" event={"ID":"7f0df705-b5cf-4e4c-a84c-7cc14831b77f","Type":"ContainerDied","Data":"251a87ace601cb995275147980b339cedc2e7c43220b9cd68d79fe828a92b352"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.213845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" event={"ID":"7f0df705-b5cf-4e4c-a84c-7cc14831b77f","Type":"ContainerStarted","Data":"f43247c7cecc2c5ad5d3f21b88452e394799e6859b0f0fda0fcce329fa7bcd6b"} Nov 21 12:55:18 crc kubenswrapper[4769]: I1121 12:55:18.291814 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" podStartSLOduration=2.291795589 podStartE2EDuration="2.291795589s" podCreationTimestamp="2025-11-21 12:55:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:18.286105145 +0000 UTC m=+3876.986766963" watchObservedRunningTime="2025-11-21 12:55:18.291795589 +0000 UTC m=+3876.992457407" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.615716 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.690040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53fb7874-5587-4186-8a29-038a560144f3-operator-scripts\") pod \"53fb7874-5587-4186-8a29-038a560144f3\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.690116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvnml\" (UniqueName: \"kubernetes.io/projected/53fb7874-5587-4186-8a29-038a560144f3-kube-api-access-qvnml\") pod \"53fb7874-5587-4186-8a29-038a560144f3\" (UID: \"53fb7874-5587-4186-8a29-038a560144f3\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.690923 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53fb7874-5587-4186-8a29-038a560144f3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "53fb7874-5587-4186-8a29-038a560144f3" (UID: "53fb7874-5587-4186-8a29-038a560144f3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.700427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fb7874-5587-4186-8a29-038a560144f3-kube-api-access-qvnml" (OuterVolumeSpecName: "kube-api-access-qvnml") pod "53fb7874-5587-4186-8a29-038a560144f3" (UID: "53fb7874-5587-4186-8a29-038a560144f3"). InnerVolumeSpecName "kube-api-access-qvnml". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.797114 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53fb7874-5587-4186-8a29-038a560144f3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.797151 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qvnml\" (UniqueName: \"kubernetes.io/projected/53fb7874-5587-4186-8a29-038a560144f3-kube-api-access-qvnml\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.853447 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.858621 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.867626 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.875745 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.881355 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.898426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqbds\" (UniqueName: \"kubernetes.io/projected/e25a1e25-5a23-4241-bf27-234419d09917-kube-api-access-dqbds\") pod \"e25a1e25-5a23-4241-bf27-234419d09917\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.898535 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-operator-scripts\") pod \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.898591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e25a1e25-5a23-4241-bf27-234419d09917-operator-scripts\") pod \"e25a1e25-5a23-4241-bf27-234419d09917\" (UID: \"e25a1e25-5a23-4241-bf27-234419d09917\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.898676 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jng5m\" (UniqueName: \"kubernetes.io/projected/abc3fa26-faf8-4114-994c-5eb77049a843-kube-api-access-jng5m\") pod \"abc3fa26-faf8-4114-994c-5eb77049a843\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.898737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abc3fa26-faf8-4114-994c-5eb77049a843-operator-scripts\") pod \"abc3fa26-faf8-4114-994c-5eb77049a843\" (UID: \"abc3fa26-faf8-4114-994c-5eb77049a843\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.898819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrgtt\" (UniqueName: \"kubernetes.io/projected/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-kube-api-access-wrgtt\") pod \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\" (UID: \"7f0df705-b5cf-4e4c-a84c-7cc14831b77f\") " Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.899247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e25a1e25-5a23-4241-bf27-234419d09917-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e25a1e25-5a23-4241-bf27-234419d09917" (UID: "e25a1e25-5a23-4241-bf27-234419d09917"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.899287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abc3fa26-faf8-4114-994c-5eb77049a843-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "abc3fa26-faf8-4114-994c-5eb77049a843" (UID: "abc3fa26-faf8-4114-994c-5eb77049a843"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.900471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7f0df705-b5cf-4e4c-a84c-7cc14831b77f" (UID: "7f0df705-b5cf-4e4c-a84c-7cc14831b77f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.903393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25a1e25-5a23-4241-bf27-234419d09917-kube-api-access-dqbds" (OuterVolumeSpecName: "kube-api-access-dqbds") pod "e25a1e25-5a23-4241-bf27-234419d09917" (UID: "e25a1e25-5a23-4241-bf27-234419d09917"). InnerVolumeSpecName "kube-api-access-dqbds". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.903847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-kube-api-access-wrgtt" (OuterVolumeSpecName: "kube-api-access-wrgtt") pod "7f0df705-b5cf-4e4c-a84c-7cc14831b77f" (UID: "7f0df705-b5cf-4e4c-a84c-7cc14831b77f"). InnerVolumeSpecName "kube-api-access-wrgtt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:19 crc kubenswrapper[4769]: I1121 12:55:19.907743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc3fa26-faf8-4114-994c-5eb77049a843-kube-api-access-jng5m" (OuterVolumeSpecName: "kube-api-access-jng5m") pod "abc3fa26-faf8-4114-994c-5eb77049a843" (UID: "abc3fa26-faf8-4114-994c-5eb77049a843"). InnerVolumeSpecName "kube-api-access-jng5m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:19.999959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-operator-scripts\") pod \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d101a14e-7629-487a-a3de-be159255102f-operator-scripts\") pod \"d101a14e-7629-487a-a3de-be159255102f\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg9lh\" (UniqueName: \"kubernetes.io/projected/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-kube-api-access-gg9lh\") pod \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\" (UID: \"765d38de-7be6-4a5f-b8c9-8e89bdaada8e\") " Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn8vr\" (UniqueName: \"kubernetes.io/projected/d101a14e-7629-487a-a3de-be159255102f-kube-api-access-gn8vr\") pod \"d101a14e-7629-487a-a3de-be159255102f\" (UID: \"d101a14e-7629-487a-a3de-be159255102f\") " Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "765d38de-7be6-4a5f-b8c9-8e89bdaada8e" (UID: "765d38de-7be6-4a5f-b8c9-8e89bdaada8e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000634 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dqbds\" (UniqueName: \"kubernetes.io/projected/e25a1e25-5a23-4241-bf27-234419d09917-kube-api-access-dqbds\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000666 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000685 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000704 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e25a1e25-5a23-4241-bf27-234419d09917-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000722 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jng5m\" (UniqueName: \"kubernetes.io/projected/abc3fa26-faf8-4114-994c-5eb77049a843-kube-api-access-jng5m\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000742 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/abc3fa26-faf8-4114-994c-5eb77049a843-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000760 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wrgtt\" (UniqueName: \"kubernetes.io/projected/7f0df705-b5cf-4e4c-a84c-7cc14831b77f-kube-api-access-wrgtt\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.000751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d101a14e-7629-487a-a3de-be159255102f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d101a14e-7629-487a-a3de-be159255102f" (UID: "d101a14e-7629-487a-a3de-be159255102f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.003541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d101a14e-7629-487a-a3de-be159255102f-kube-api-access-gn8vr" (OuterVolumeSpecName: "kube-api-access-gn8vr") pod "d101a14e-7629-487a-a3de-be159255102f" (UID: "d101a14e-7629-487a-a3de-be159255102f"). InnerVolumeSpecName "kube-api-access-gn8vr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.003873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-kube-api-access-gg9lh" (OuterVolumeSpecName: "kube-api-access-gg9lh") pod "765d38de-7be6-4a5f-b8c9-8e89bdaada8e" (UID: "765d38de-7be6-4a5f-b8c9-8e89bdaada8e"). InnerVolumeSpecName "kube-api-access-gg9lh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.102715 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d101a14e-7629-487a-a3de-be159255102f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.102804 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gg9lh\" (UniqueName: \"kubernetes.io/projected/765d38de-7be6-4a5f-b8c9-8e89bdaada8e-kube-api-access-gg9lh\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.102830 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gn8vr\" (UniqueName: \"kubernetes.io/projected/d101a14e-7629-487a-a3de-be159255102f-kube-api-access-gn8vr\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.254431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" event={"ID":"53fb7874-5587-4186-8a29-038a560144f3","Type":"ContainerDied","Data":"923f80c7954c74f0d1230ae9281919527b2188ccdc0dedfadfae606a907efb85"} Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.254510 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="923f80c7954c74f0d1230ae9281919527b2188ccdc0dedfadfae606a907efb85" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.254532 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.258355 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.258349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-ffwt6" event={"ID":"7f0df705-b5cf-4e4c-a84c-7cc14831b77f","Type":"ContainerDied","Data":"f43247c7cecc2c5ad5d3f21b88452e394799e6859b0f0fda0fcce329fa7bcd6b"} Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.258491 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f43247c7cecc2c5ad5d3f21b88452e394799e6859b0f0fda0fcce329fa7bcd6b" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.260861 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.260901 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-bf23-account-create-f9d9f" event={"ID":"765d38de-7be6-4a5f-b8c9-8e89bdaada8e","Type":"ContainerDied","Data":"3b4b92bb811b8c1dec8055492ccd2faa33bdf3ef5aef27c2780433bedd8922af"} Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.261885 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b4b92bb811b8c1dec8055492ccd2faa33bdf3ef5aef27c2780433bedd8922af" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.262681 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" event={"ID":"abc3fa26-faf8-4114-994c-5eb77049a843","Type":"ContainerDied","Data":"8bf993536442105b51bdc3124bbc6d487378769f5def56dd3c05a6854a94f80d"} Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.262714 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bf993536442105b51bdc3124bbc6d487378769f5def56dd3c05a6854a94f80d" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.262728 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-72a2-account-create-mf92j" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.264373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-gwz95" event={"ID":"e25a1e25-5a23-4241-bf27-234419d09917","Type":"ContainerDied","Data":"2cb4b7b8d5e40d80e9c4350b9be731d387ca56bd4d0bce839ac8e50f0c54182d"} Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.264413 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb4b7b8d5e40d80e9c4350b9be731d387ca56bd4d0bce839ac8e50f0c54182d" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.264457 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-gwz95" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.266641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" event={"ID":"d101a14e-7629-487a-a3de-be159255102f","Type":"ContainerDied","Data":"98be634596fbe09252acf5d61bff4e7bcea521bc49a06f5980f6640855987cb0"} Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.266668 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98be634596fbe09252acf5d61bff4e7bcea521bc49a06f5980f6640855987cb0" Nov 21 12:55:20 crc kubenswrapper[4769]: I1121 12:55:20.266826 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6cgv7" Nov 21 12:55:21 crc kubenswrapper[4769]: I1121 12:55:21.279945 4769 generic.go:334] "Generic (PLEG): container finished" podID="a9a6ec6a-4204-472b-a384-abda04d850e1" containerID="458ea4746c499faed0a5b2993bb3da8d5dd6f67e434205828c4e365397b026bc" exitCode=0 Nov 21 12:55:21 crc kubenswrapper[4769]: I1121 12:55:21.289436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" event={"ID":"a9a6ec6a-4204-472b-a384-abda04d850e1","Type":"ContainerDied","Data":"458ea4746c499faed0a5b2993bb3da8d5dd6f67e434205828c4e365397b026bc"} Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.713443 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.749775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58nz5\" (UniqueName: \"kubernetes.io/projected/a9a6ec6a-4204-472b-a384-abda04d850e1-kube-api-access-58nz5\") pod \"a9a6ec6a-4204-472b-a384-abda04d850e1\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.749878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-config-data\") pod \"a9a6ec6a-4204-472b-a384-abda04d850e1\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.749980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-combined-ca-bundle\") pod \"a9a6ec6a-4204-472b-a384-abda04d850e1\" (UID: \"a9a6ec6a-4204-472b-a384-abda04d850e1\") " Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.762503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9a6ec6a-4204-472b-a384-abda04d850e1-kube-api-access-58nz5" (OuterVolumeSpecName: "kube-api-access-58nz5") pod "a9a6ec6a-4204-472b-a384-abda04d850e1" (UID: "a9a6ec6a-4204-472b-a384-abda04d850e1"). InnerVolumeSpecName "kube-api-access-58nz5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.794301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a9a6ec6a-4204-472b-a384-abda04d850e1" (UID: "a9a6ec6a-4204-472b-a384-abda04d850e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.814531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-config-data" (OuterVolumeSpecName: "config-data") pod "a9a6ec6a-4204-472b-a384-abda04d850e1" (UID: "a9a6ec6a-4204-472b-a384-abda04d850e1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.853081 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-58nz5\" (UniqueName: \"kubernetes.io/projected/a9a6ec6a-4204-472b-a384-abda04d850e1-kube-api-access-58nz5\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.853128 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:22 crc kubenswrapper[4769]: I1121 12:55:22.853194 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9a6ec6a-4204-472b-a384-abda04d850e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.310328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" event={"ID":"a9a6ec6a-4204-472b-a384-abda04d850e1","Type":"ContainerDied","Data":"956c0b36f4157e3a22083c7bcea4e8a681535c9370188e88f7286be1a5dbfb31"} Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.310981 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="956c0b36f4157e3a22083c7bcea4e8a681535c9370188e88f7286be1a5dbfb31" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.310527 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-mnnzq" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.490583 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fjvrk"] Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491003 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d101a14e-7629-487a-a3de-be159255102f" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d101a14e-7629-487a-a3de-be159255102f" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491048 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f0df705-b5cf-4e4c-a84c-7cc14831b77f" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491058 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f0df705-b5cf-4e4c-a84c-7cc14831b77f" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491073 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="765d38de-7be6-4a5f-b8c9-8e89bdaada8e" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491081 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="765d38de-7be6-4a5f-b8c9-8e89bdaada8e" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491101 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53fb7874-5587-4186-8a29-038a560144f3" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491111 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fb7874-5587-4186-8a29-038a560144f3" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491122 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a9a6ec6a-4204-472b-a384-abda04d850e1" containerName="keystone-db-sync" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491130 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9a6ec6a-4204-472b-a384-abda04d850e1" containerName="keystone-db-sync" Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491147 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e25a1e25-5a23-4241-bf27-234419d09917" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491156 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25a1e25-5a23-4241-bf27-234419d09917" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: E1121 12:55:23.491192 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="abc3fa26-faf8-4114-994c-5eb77049a843" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491203 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc3fa26-faf8-4114-994c-5eb77049a843" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491432 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e25a1e25-5a23-4241-bf27-234419d09917" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491446 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a9a6ec6a-4204-472b-a384-abda04d850e1" containerName="keystone-db-sync" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491465 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d101a14e-7629-487a-a3de-be159255102f" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491487 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="765d38de-7be6-4a5f-b8c9-8e89bdaada8e" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53fb7874-5587-4186-8a29-038a560144f3" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491510 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="abc3fa26-faf8-4114-994c-5eb77049a843" containerName="mariadb-account-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.491530 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f0df705-b5cf-4e4c-a84c-7cc14831b77f" containerName="mariadb-database-create" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.492193 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.495323 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.495365 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.495621 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.495717 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-2ng29" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.495968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.496012 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fjvrk"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.567514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-scripts\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.567705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64zbp\" (UniqueName: \"kubernetes.io/projected/7b54c5f7-af92-4e55-b050-6a6a39831e2e-kube-api-access-64zbp\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.567758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-config-data\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.567793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-credential-keys\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.567841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-fernet-keys\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.567921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-combined-ca-bundle\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.668009 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669261 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-combined-ca-bundle\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-scripts\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-64zbp\" (UniqueName: \"kubernetes.io/projected/7b54c5f7-af92-4e55-b050-6a6a39831e2e-kube-api-access-64zbp\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-config-data\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-credential-keys\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-fernet-keys\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.669973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.676808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-scripts\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.680252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-combined-ca-bundle\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.680502 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-config-data\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.682678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-fernet-keys\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.686655 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.686776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-credential-keys\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.687006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.692735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-64zbp\" (UniqueName: \"kubernetes.io/projected/7b54c5f7-af92-4e55-b050-6a6a39831e2e-kube-api-access-64zbp\") pod \"keystone-bootstrap-fjvrk\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.704442 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cwd5x"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.705750 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.710909 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.713395 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.713761 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.713977 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-shv2w" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.739475 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-zpnxl"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.740895 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.750281 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.751401 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-pp5k7" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.752468 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.769945 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cwd5x"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72svx\" (UniqueName: \"kubernetes.io/projected/a904a050-78bd-475e-ba7d-3920dd17667d-kube-api-access-72svx\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-combined-ca-bundle\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjrss\" (UniqueName: \"kubernetes.io/projected/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-kube-api-access-wjrss\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770386 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ced52c5e-301d-4df1-b23a-adf5bcc799d0-etc-machine-id\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-run-httpd\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-log-httpd\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-scripts\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6q8d\" (UniqueName: \"kubernetes.io/projected/ced52c5e-301d-4df1-b23a-adf5bcc799d0-kube-api-access-x6q8d\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-db-sync-config-data\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-scripts\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770562 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-config-data\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-config-data\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-config\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.770647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-combined-ca-bundle\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.798805 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-xdw85"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.803385 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.812448 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.812777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.812935 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-49w48" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.817043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-zpnxl"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.817614 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.844379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-xdw85"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.857135 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-tbndb"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.858337 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.862610 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.863243 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-bdmvn" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.863390 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-tbndb"] Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.892549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-combined-ca-bundle\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.892637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-combined-ca-bundle\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.892800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-72svx\" (UniqueName: \"kubernetes.io/projected/a904a050-78bd-475e-ba7d-3920dd17667d-kube-api-access-72svx\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d39f3af-a61c-4977-a2bb-031a88e8919d-logs\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-combined-ca-bundle\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjrss\" (UniqueName: \"kubernetes.io/projected/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-kube-api-access-wjrss\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ced52c5e-301d-4df1-b23a-adf5bcc799d0-etc-machine-id\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-run-httpd\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-log-httpd\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-scripts\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x6q8d\" (UniqueName: \"kubernetes.io/projected/ced52c5e-301d-4df1-b23a-adf5bcc799d0-kube-api-access-x6q8d\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.893982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-db-sync-config-data\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-scripts\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-config-data\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894427 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-scripts\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-config-data\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-config-data\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-config\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.894815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrz8\" (UniqueName: \"kubernetes.io/projected/9d39f3af-a61c-4977-a2bb-031a88e8919d-kube-api-access-gfrz8\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.901772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-scripts\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.908703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ced52c5e-301d-4df1-b23a-adf5bcc799d0-etc-machine-id\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.909318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-run-httpd\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.909714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-log-httpd\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.911518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-config\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.913920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-combined-ca-bundle\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.920870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6q8d\" (UniqueName: \"kubernetes.io/projected/ced52c5e-301d-4df1-b23a-adf5bcc799d0-kube-api-access-x6q8d\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.926596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-config-data\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.927555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-combined-ca-bundle\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.927923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-db-sync-config-data\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.928030 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-config-data\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.930867 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-scripts\") pod \"cinder-db-sync-zpnxl\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.935895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjrss\" (UniqueName: \"kubernetes.io/projected/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-kube-api-access-wjrss\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.941709 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.946468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.957763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-72svx\" (UniqueName: \"kubernetes.io/projected/a904a050-78bd-475e-ba7d-3920dd17667d-kube-api-access-72svx\") pod \"neutron-db-sync-cwd5x\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.999469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-combined-ca-bundle\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.999536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d39f3af-a61c-4977-a2bb-031a88e8919d-logs\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:23 crc kubenswrapper[4769]: I1121 12:55:23.999643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx99f\" (UniqueName: \"kubernetes.io/projected/03376352-fca7-4c04-a7f3-eea86de9c93f-kube-api-access-rx99f\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:23.999672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-config-data\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:23.999701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-scripts\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:23.999728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-combined-ca-bundle\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:23.999768 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-db-sync-config-data\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:23.999796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrz8\" (UniqueName: \"kubernetes.io/projected/9d39f3af-a61c-4977-a2bb-031a88e8919d-kube-api-access-gfrz8\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.000878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d39f3af-a61c-4977-a2bb-031a88e8919d-logs\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.006236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-scripts\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.006990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-combined-ca-bundle\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.012223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-config-data\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.025853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrz8\" (UniqueName: \"kubernetes.io/projected/9d39f3af-a61c-4977-a2bb-031a88e8919d-kube-api-access-gfrz8\") pod \"placement-db-sync-xdw85\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.061296 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.073524 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.090787 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.101364 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-combined-ca-bundle\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.102055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-db-sync-config-data\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.102149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rx99f\" (UniqueName: \"kubernetes.io/projected/03376352-fca7-4c04-a7f3-eea86de9c93f-kube-api-access-rx99f\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.107469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-db-sync-config-data\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.113124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-combined-ca-bundle\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.118843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx99f\" (UniqueName: \"kubernetes.io/projected/03376352-fca7-4c04-a7f3-eea86de9c93f-kube-api-access-rx99f\") pod \"barbican-db-sync-tbndb\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.145042 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.294047 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.330418 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fjvrk"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.387251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.439850 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cwd5x"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.471718 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.509364 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.510877 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.511662 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.517309 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.520306 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.520448 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-p27px" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.596237 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.600566 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.603622 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.605700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-logs\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-config-data\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-scripts\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.614848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mr8m\" (UniqueName: \"kubernetes.io/projected/f977b109-5630-4e79-a74e-91e0a06cab0b-kube-api-access-5mr8m\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-config-data\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-logs\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-scripts\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5mr8m\" (UniqueName: \"kubernetes.io/projected/f977b109-5630-4e79-a74e-91e0a06cab0b-kube-api-access-5mr8m\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqsz8\" (UniqueName: \"kubernetes.io/projected/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-kube-api-access-tqsz8\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-logs\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.717705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.718174 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.722545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.722784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-logs\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.725336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-scripts\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.735155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-config-data\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.736076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.741882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mr8m\" (UniqueName: \"kubernetes.io/projected/f977b109-5630-4e79-a74e-91e0a06cab0b-kube-api-access-5mr8m\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.746135 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-tbndb"] Nov 21 12:55:24 crc kubenswrapper[4769]: W1121 12:55:24.763784 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03376352_fca7_4c04_a7f3_eea86de9c93f.slice/crio-a36c9cd2487422954c84b367e70203d109516ab8050261c6f696ce382e21399a WatchSource:0}: Error finding container a36c9cd2487422954c84b367e70203d109516ab8050261c6f696ce382e21399a: Status 404 returned error can't find the container with id a36c9cd2487422954c84b367e70203d109516ab8050261c6f696ce382e21399a Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.766048 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-zpnxl"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.792541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.816533 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-xdw85"] Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.818747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tqsz8\" (UniqueName: \"kubernetes.io/projected/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-kube-api-access-tqsz8\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.818835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.818907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.818933 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.818983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-logs\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.819022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.819060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.824274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.826081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.826499 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.826700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-logs\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.833373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.846011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.851888 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqsz8\" (UniqueName: \"kubernetes.io/projected/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-kube-api-access-tqsz8\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.857570 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.882102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:24 crc kubenswrapper[4769]: I1121 12:55:24.941550 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.274412 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:55:25 crc kubenswrapper[4769]: E1121 12:55:25.276054 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.331161 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:55:25 crc kubenswrapper[4769]: W1121 12:55:25.340691 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf977b109_5630_4e79_a74e_91e0a06cab0b.slice/crio-1f55c17ca8ce772fddcee25516342967fb7e60eac8bb46ff8967a9629718c5c3 WatchSource:0}: Error finding container 1f55c17ca8ce772fddcee25516342967fb7e60eac8bb46ff8967a9629718c5c3: Status 404 returned error can't find the container with id 1f55c17ca8ce772fddcee25516342967fb7e60eac8bb46ff8967a9629718c5c3 Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.362150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" event={"ID":"a904a050-78bd-475e-ba7d-3920dd17667d","Type":"ContainerStarted","Data":"2b03ca11dd61eff9c513aab44f92368ac1bd82202aeb0f327da2c7cf0f1701f7"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.362241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" event={"ID":"a904a050-78bd-475e-ba7d-3920dd17667d","Type":"ContainerStarted","Data":"7511d08bf046eeb5b6c982d83b0ca063be2e5ac6615b08512226b161926d27e0"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.365989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" event={"ID":"ced52c5e-301d-4df1-b23a-adf5bcc799d0","Type":"ContainerStarted","Data":"9f35cdd32b68fc02c62955ccf826fff07e1e7cbf876dc9ac965159e7a61c2981"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.368113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerStarted","Data":"3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.368140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerStarted","Data":"bc5bcf98e2653295b6fc0feff18cc9ab7021dea561000eab7489c29cb7d50e08"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.369992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-xdw85" event={"ID":"9d39f3af-a61c-4977-a2bb-031a88e8919d","Type":"ContainerStarted","Data":"5c8204a666e532ed6bef6c5b2a3add2b2de12d729842a2c5d3eee5dc2b7db804"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.370018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-xdw85" event={"ID":"9d39f3af-a61c-4977-a2bb-031a88e8919d","Type":"ContainerStarted","Data":"a4ce324f95f5ebc2f63b86ee09a669241692447ea9d445a2bb80fc6cc9da2baf"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.373437 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" event={"ID":"7b54c5f7-af92-4e55-b050-6a6a39831e2e","Type":"ContainerStarted","Data":"7cd46d6488e5848c7d8e0100e91bf525a45ba9303ee9e5ab4338cfbfdb820db4"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.373491 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" event={"ID":"7b54c5f7-af92-4e55-b050-6a6a39831e2e","Type":"ContainerStarted","Data":"1400673c2f64eba1c07ee5e5d3d8d0e2a02080c8a551331d94275067ef48a15d"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.378446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" event={"ID":"03376352-fca7-4c04-a7f3-eea86de9c93f","Type":"ContainerStarted","Data":"b1471d63fe07e1ae9d8c7f40dce0c4b51542597f24d21667b137c9212924f813"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.378477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" event={"ID":"03376352-fca7-4c04-a7f3-eea86de9c93f","Type":"ContainerStarted","Data":"a36c9cd2487422954c84b367e70203d109516ab8050261c6f696ce382e21399a"} Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.379925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" podStartSLOduration=2.379907857 podStartE2EDuration="2.379907857s" podCreationTimestamp="2025-11-21 12:55:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:25.375086897 +0000 UTC m=+3884.075748715" watchObservedRunningTime="2025-11-21 12:55:25.379907857 +0000 UTC m=+3884.080569675" Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.396460 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" podStartSLOduration=2.396443952 podStartE2EDuration="2.396443952s" podCreationTimestamp="2025-11-21 12:55:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:25.390100271 +0000 UTC m=+3884.090762089" watchObservedRunningTime="2025-11-21 12:55:25.396443952 +0000 UTC m=+3884.097105770" Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.405960 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-xdw85" podStartSLOduration=2.405944668 podStartE2EDuration="2.405944668s" podCreationTimestamp="2025-11-21 12:55:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:25.403597015 +0000 UTC m=+3884.104258833" watchObservedRunningTime="2025-11-21 12:55:25.405944668 +0000 UTC m=+3884.106606486" Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.444641 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" podStartSLOduration=2.4446265 podStartE2EDuration="2.4446265s" podCreationTimestamp="2025-11-21 12:55:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:25.443729775 +0000 UTC m=+3884.144391583" watchObservedRunningTime="2025-11-21 12:55:25.4446265 +0000 UTC m=+3884.145288318" Nov 21 12:55:25 crc kubenswrapper[4769]: W1121 12:55:25.478434 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a8722ea_6ace_4e78_8e62_6e3a0d09d6c4.slice/crio-9f4320e27e29ed8192f5bc7974c6ce0af565b7b6898ac37edccea26192bf96a5 WatchSource:0}: Error finding container 9f4320e27e29ed8192f5bc7974c6ce0af565b7b6898ac37edccea26192bf96a5: Status 404 returned error can't find the container with id 9f4320e27e29ed8192f5bc7974c6ce0af565b7b6898ac37edccea26192bf96a5 Nov 21 12:55:25 crc kubenswrapper[4769]: I1121 12:55:25.478928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.392570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f977b109-5630-4e79-a74e-91e0a06cab0b","Type":"ContainerStarted","Data":"8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d"} Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.393139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f977b109-5630-4e79-a74e-91e0a06cab0b","Type":"ContainerStarted","Data":"1f55c17ca8ce772fddcee25516342967fb7e60eac8bb46ff8967a9629718c5c3"} Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.394462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" event={"ID":"ced52c5e-301d-4df1-b23a-adf5bcc799d0","Type":"ContainerStarted","Data":"fb31b3f33e76224a37d9ae0cf893eee2602e2915af1470389bcf9d4c7c56cebb"} Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.402246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerStarted","Data":"cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8"} Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.404258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4","Type":"ContainerStarted","Data":"ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869"} Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.404283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4","Type":"ContainerStarted","Data":"9f4320e27e29ed8192f5bc7974c6ce0af565b7b6898ac37edccea26192bf96a5"} Nov 21 12:55:26 crc kubenswrapper[4769]: I1121 12:55:26.418435 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" podStartSLOduration=3.418417905 podStartE2EDuration="3.418417905s" podCreationTimestamp="2025-11-21 12:55:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:26.415715223 +0000 UTC m=+3885.116377041" watchObservedRunningTime="2025-11-21 12:55:26.418417905 +0000 UTC m=+3885.119079723" Nov 21 12:55:27 crc kubenswrapper[4769]: I1121 12:55:27.418184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4","Type":"ContainerStarted","Data":"53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5"} Nov 21 12:55:27 crc kubenswrapper[4769]: I1121 12:55:27.421108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f977b109-5630-4e79-a74e-91e0a06cab0b","Type":"ContainerStarted","Data":"361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199"} Nov 21 12:55:27 crc kubenswrapper[4769]: I1121 12:55:27.423539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerStarted","Data":"04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73"} Nov 21 12:55:27 crc kubenswrapper[4769]: I1121 12:55:27.455791 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.455774844 podStartE2EDuration="3.455774844s" podCreationTimestamp="2025-11-21 12:55:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:27.45115653 +0000 UTC m=+3886.151818348" watchObservedRunningTime="2025-11-21 12:55:27.455774844 +0000 UTC m=+3886.156436662" Nov 21 12:55:27 crc kubenswrapper[4769]: I1121 12:55:27.497852 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.497830407 podStartE2EDuration="3.497830407s" podCreationTimestamp="2025-11-21 12:55:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:27.490645493 +0000 UTC m=+3886.191307321" watchObservedRunningTime="2025-11-21 12:55:27.497830407 +0000 UTC m=+3886.198492235" Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.441356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerStarted","Data":"aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670"} Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.442121 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.444701 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d39f3af-a61c-4977-a2bb-031a88e8919d" containerID="5c8204a666e532ed6bef6c5b2a3add2b2de12d729842a2c5d3eee5dc2b7db804" exitCode=0 Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.444812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-xdw85" event={"ID":"9d39f3af-a61c-4977-a2bb-031a88e8919d","Type":"ContainerDied","Data":"5c8204a666e532ed6bef6c5b2a3add2b2de12d729842a2c5d3eee5dc2b7db804"} Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.446909 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b54c5f7-af92-4e55-b050-6a6a39831e2e" containerID="7cd46d6488e5848c7d8e0100e91bf525a45ba9303ee9e5ab4338cfbfdb820db4" exitCode=0 Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.446974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" event={"ID":"7b54c5f7-af92-4e55-b050-6a6a39831e2e","Type":"ContainerDied","Data":"7cd46d6488e5848c7d8e0100e91bf525a45ba9303ee9e5ab4338cfbfdb820db4"} Nov 21 12:55:28 crc kubenswrapper[4769]: I1121 12:55:28.468370 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.861281089 podStartE2EDuration="5.468348925s" podCreationTimestamp="2025-11-21 12:55:23 +0000 UTC" firstStartedPulling="2025-11-21 12:55:24.471425299 +0000 UTC m=+3883.172087117" lastFinishedPulling="2025-11-21 12:55:28.078493105 +0000 UTC m=+3886.779154953" observedRunningTime="2025-11-21 12:55:28.463087933 +0000 UTC m=+3887.163749781" watchObservedRunningTime="2025-11-21 12:55:28.468348925 +0000 UTC m=+3887.169010783" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.092687 4769 scope.go:117] "RemoveContainer" containerID="ac1d28f6a30651500d68da8d2c890eabacee90404daebf055d65bfc1c71f765d" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.131851 4769 scope.go:117] "RemoveContainer" containerID="73d48851f9d09d3e64cdac01b0e9d74453b46a2867eca7ec9a8de9ae016bda20" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.207925 4769 scope.go:117] "RemoveContainer" containerID="b0908c9c3af2001c2d00836d863694814344699e5b0d6ad7bd11ef283fb433ea" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.261300 4769 scope.go:117] "RemoveContainer" containerID="5a67db22b21f6fb627583f9c459c934186dfe8b52304a49f003ca1fcc1e60287" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.281794 4769 scope.go:117] "RemoveContainer" containerID="ac5f4a5d6424277be7cc254709ccdb759c0d43a21062e8e81885e0fb08cb7196" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.324694 4769 scope.go:117] "RemoveContainer" containerID="b031c526f4a33dd319db8596c815b15225728574ac48474464c6cc8899a74f6a" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.343078 4769 scope.go:117] "RemoveContainer" containerID="e3a7f70262734abaefda74e103f8ed7d134dbd726f9d6d6125eee86de39036e8" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.376489 4769 scope.go:117] "RemoveContainer" containerID="51dfee9453dc993615898ea64d0e65dd3dd38078e1a79604cce71fe21db745b6" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.398717 4769 scope.go:117] "RemoveContainer" containerID="79d372547989d83e9b92ed42c5448f7c26f7dcdb2ef8213f0c8ee892bf44abd9" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.453660 4769 scope.go:117] "RemoveContainer" containerID="6fa27cb583cbd4188d2f2a620e64742637d5b8d379b12edd0bdb077e5eb9ffca" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.470634 4769 generic.go:334] "Generic (PLEG): container finished" podID="03376352-fca7-4c04-a7f3-eea86de9c93f" containerID="b1471d63fe07e1ae9d8c7f40dce0c4b51542597f24d21667b137c9212924f813" exitCode=0 Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.470692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" event={"ID":"03376352-fca7-4c04-a7f3-eea86de9c93f","Type":"ContainerDied","Data":"b1471d63fe07e1ae9d8c7f40dce0c4b51542597f24d21667b137c9212924f813"} Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.512766 4769 scope.go:117] "RemoveContainer" containerID="9b51c56e4d1a42f7ba94a30c1777308a93a42f8c0640ed36f283697fac54f9af" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.562387 4769 scope.go:117] "RemoveContainer" containerID="793e3f5d3767dec3f664f6d1182ce025e2b4d90e3869bb6f9c107c692d39e592" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.582463 4769 scope.go:117] "RemoveContainer" containerID="ddfcf65be0f1acda17774c4f889ecb6e3e0fabe803b8caab5a54ff6245f67805" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.660866 4769 scope.go:117] "RemoveContainer" containerID="c0a9278f41ba47ecce94c3a744ee61b82f624c0e5841c37351d0b8b056b76e50" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.688991 4769 scope.go:117] "RemoveContainer" containerID="2d8b485001e264ddab1b92ee57a4f20e66d019d3bb9558bb5b4a5dbc988a0127" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.744030 4769 scope.go:117] "RemoveContainer" containerID="dcf75b7ed39b2a1f6fe8e8444f434d5291168d1debb86cabd9bffb3d5db705a1" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.801373 4769 scope.go:117] "RemoveContainer" containerID="94b53d32059958589c61ac3291152dbf4b5f4564bf4f215bb296e3208e8a3fcf" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.860794 4769 scope.go:117] "RemoveContainer" containerID="2c6797e76df0bc1b98206b7e04f78628fca119a8b8f31052a5808d8ac8459c09" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.901730 4769 scope.go:117] "RemoveContainer" containerID="d7e08c5cb9f88f9d70830a71eb265d5c8c3cc00c5d73426e2ca9f97e58cbf25e" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.909875 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:29 crc kubenswrapper[4769]: I1121 12:55:29.967105 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.025139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-scripts\") pod \"9d39f3af-a61c-4977-a2bb-031a88e8919d\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.025287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d39f3af-a61c-4977-a2bb-031a88e8919d-logs\") pod \"9d39f3af-a61c-4977-a2bb-031a88e8919d\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.025362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-combined-ca-bundle\") pod \"9d39f3af-a61c-4977-a2bb-031a88e8919d\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.025436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfrz8\" (UniqueName: \"kubernetes.io/projected/9d39f3af-a61c-4977-a2bb-031a88e8919d-kube-api-access-gfrz8\") pod \"9d39f3af-a61c-4977-a2bb-031a88e8919d\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.025465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-config-data\") pod \"9d39f3af-a61c-4977-a2bb-031a88e8919d\" (UID: \"9d39f3af-a61c-4977-a2bb-031a88e8919d\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.027110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d39f3af-a61c-4977-a2bb-031a88e8919d-logs" (OuterVolumeSpecName: "logs") pod "9d39f3af-a61c-4977-a2bb-031a88e8919d" (UID: "9d39f3af-a61c-4977-a2bb-031a88e8919d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.031544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d39f3af-a61c-4977-a2bb-031a88e8919d-kube-api-access-gfrz8" (OuterVolumeSpecName: "kube-api-access-gfrz8") pod "9d39f3af-a61c-4977-a2bb-031a88e8919d" (UID: "9d39f3af-a61c-4977-a2bb-031a88e8919d"). InnerVolumeSpecName "kube-api-access-gfrz8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.031566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-scripts" (OuterVolumeSpecName: "scripts") pod "9d39f3af-a61c-4977-a2bb-031a88e8919d" (UID: "9d39f3af-a61c-4977-a2bb-031a88e8919d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.060799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-config-data" (OuterVolumeSpecName: "config-data") pod "9d39f3af-a61c-4977-a2bb-031a88e8919d" (UID: "9d39f3af-a61c-4977-a2bb-031a88e8919d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.064346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d39f3af-a61c-4977-a2bb-031a88e8919d" (UID: "9d39f3af-a61c-4977-a2bb-031a88e8919d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.126891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-combined-ca-bundle\") pod \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.126935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-config-data\") pod \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.127072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-credential-keys\") pod \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.127148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-scripts\") pod \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.127621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-fernet-keys\") pod \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.127685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64zbp\" (UniqueName: \"kubernetes.io/projected/7b54c5f7-af92-4e55-b050-6a6a39831e2e-kube-api-access-64zbp\") pod \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\" (UID: \"7b54c5f7-af92-4e55-b050-6a6a39831e2e\") " Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.128685 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9d39f3af-a61c-4977-a2bb-031a88e8919d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.128761 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.128779 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gfrz8\" (UniqueName: \"kubernetes.io/projected/9d39f3af-a61c-4977-a2bb-031a88e8919d-kube-api-access-gfrz8\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.128791 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.128801 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d39f3af-a61c-4977-a2bb-031a88e8919d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.129746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "7b54c5f7-af92-4e55-b050-6a6a39831e2e" (UID: "7b54c5f7-af92-4e55-b050-6a6a39831e2e"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.130871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-scripts" (OuterVolumeSpecName: "scripts") pod "7b54c5f7-af92-4e55-b050-6a6a39831e2e" (UID: "7b54c5f7-af92-4e55-b050-6a6a39831e2e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.132906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b54c5f7-af92-4e55-b050-6a6a39831e2e-kube-api-access-64zbp" (OuterVolumeSpecName: "kube-api-access-64zbp") pod "7b54c5f7-af92-4e55-b050-6a6a39831e2e" (UID: "7b54c5f7-af92-4e55-b050-6a6a39831e2e"). InnerVolumeSpecName "kube-api-access-64zbp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.133672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "7b54c5f7-af92-4e55-b050-6a6a39831e2e" (UID: "7b54c5f7-af92-4e55-b050-6a6a39831e2e"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.161379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-config-data" (OuterVolumeSpecName: "config-data") pod "7b54c5f7-af92-4e55-b050-6a6a39831e2e" (UID: "7b54c5f7-af92-4e55-b050-6a6a39831e2e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.173337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b54c5f7-af92-4e55-b050-6a6a39831e2e" (UID: "7b54c5f7-af92-4e55-b050-6a6a39831e2e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.230225 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-64zbp\" (UniqueName: \"kubernetes.io/projected/7b54c5f7-af92-4e55-b050-6a6a39831e2e-kube-api-access-64zbp\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.230268 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.230282 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.230295 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.230305 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.230315 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7b54c5f7-af92-4e55-b050-6a6a39831e2e-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.490808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" event={"ID":"7b54c5f7-af92-4e55-b050-6a6a39831e2e","Type":"ContainerDied","Data":"1400673c2f64eba1c07ee5e5d3d8d0e2a02080c8a551331d94275067ef48a15d"} Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.490857 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1400673c2f64eba1c07ee5e5d3d8d0e2a02080c8a551331d94275067ef48a15d" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.490922 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-fjvrk" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.493678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-xdw85" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.498326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-xdw85" event={"ID":"9d39f3af-a61c-4977-a2bb-031a88e8919d","Type":"ContainerDied","Data":"a4ce324f95f5ebc2f63b86ee09a669241692447ea9d445a2bb80fc6cc9da2baf"} Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.498389 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4ce324f95f5ebc2f63b86ee09a669241692447ea9d445a2bb80fc6cc9da2baf" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.658990 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fjvrk"] Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.671635 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-fjvrk"] Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.689206 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-664777594-l8qtg"] Nov 21 12:55:30 crc kubenswrapper[4769]: E1121 12:55:30.689881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d39f3af-a61c-4977-a2bb-031a88e8919d" containerName="placement-db-sync" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.689901 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d39f3af-a61c-4977-a2bb-031a88e8919d" containerName="placement-db-sync" Nov 21 12:55:30 crc kubenswrapper[4769]: E1121 12:55:30.689947 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b54c5f7-af92-4e55-b050-6a6a39831e2e" containerName="keystone-bootstrap" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.689955 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b54c5f7-af92-4e55-b050-6a6a39831e2e" containerName="keystone-bootstrap" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.690277 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b54c5f7-af92-4e55-b050-6a6a39831e2e" containerName="keystone-bootstrap" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.690302 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d39f3af-a61c-4977-a2bb-031a88e8919d" containerName="placement-db-sync" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.691351 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.693352 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.695551 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-49w48" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.695876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.696390 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-664777594-l8qtg"] Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.759498 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-bp8bh"] Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.761049 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.764306 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-2ng29" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.764384 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.764465 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.764516 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.766966 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.772013 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-bp8bh"] Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzjxj\" (UniqueName: \"kubernetes.io/projected/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-kube-api-access-nzjxj\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-combined-ca-bundle\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-config-data\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-scripts\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-combined-ca-bundle\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-credential-keys\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-fernet-keys\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.844977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-config-data\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.845006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-logs\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.845022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-scripts\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.845127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w96mj\" (UniqueName: \"kubernetes.io/projected/959b21b1-bcd8-49eb-baa6-03ddf9b73516-kube-api-access-w96mj\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.869742 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-credential-keys\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-fernet-keys\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-config-data\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-logs\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-scripts\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w96mj\" (UniqueName: \"kubernetes.io/projected/959b21b1-bcd8-49eb-baa6-03ddf9b73516-kube-api-access-w96mj\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nzjxj\" (UniqueName: \"kubernetes.io/projected/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-kube-api-access-nzjxj\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-combined-ca-bundle\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-config-data\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-scripts\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.947657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-combined-ca-bundle\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.953178 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-logs\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.953733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-combined-ca-bundle\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.954625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-config-data\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.954868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-scripts\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.954921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-fernet-keys\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.956042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-scripts\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.956940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-credential-keys\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.957792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-config-data\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.958747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-combined-ca-bundle\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.966310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w96mj\" (UniqueName: \"kubernetes.io/projected/959b21b1-bcd8-49eb-baa6-03ddf9b73516-kube-api-access-w96mj\") pod \"keystone-bootstrap-bp8bh\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:30 crc kubenswrapper[4769]: I1121 12:55:30.968004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzjxj\" (UniqueName: \"kubernetes.io/projected/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-kube-api-access-nzjxj\") pod \"placement-664777594-l8qtg\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.015372 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.048598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-combined-ca-bundle\") pod \"03376352-fca7-4c04-a7f3-eea86de9c93f\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.048952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx99f\" (UniqueName: \"kubernetes.io/projected/03376352-fca7-4c04-a7f3-eea86de9c93f-kube-api-access-rx99f\") pod \"03376352-fca7-4c04-a7f3-eea86de9c93f\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.049780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-db-sync-config-data\") pod \"03376352-fca7-4c04-a7f3-eea86de9c93f\" (UID: \"03376352-fca7-4c04-a7f3-eea86de9c93f\") " Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.053566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03376352-fca7-4c04-a7f3-eea86de9c93f-kube-api-access-rx99f" (OuterVolumeSpecName: "kube-api-access-rx99f") pod "03376352-fca7-4c04-a7f3-eea86de9c93f" (UID: "03376352-fca7-4c04-a7f3-eea86de9c93f"). InnerVolumeSpecName "kube-api-access-rx99f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.053874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "03376352-fca7-4c04-a7f3-eea86de9c93f" (UID: "03376352-fca7-4c04-a7f3-eea86de9c93f"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.076841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03376352-fca7-4c04-a7f3-eea86de9c93f" (UID: "03376352-fca7-4c04-a7f3-eea86de9c93f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.081252 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.154797 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.154840 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rx99f\" (UniqueName: \"kubernetes.io/projected/03376352-fca7-4c04-a7f3-eea86de9c93f-kube-api-access-rx99f\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.154859 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/03376352-fca7-4c04-a7f3-eea86de9c93f-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.294147 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b54c5f7-af92-4e55-b050-6a6a39831e2e" path="/var/lib/kubelet/pods/7b54c5f7-af92-4e55-b050-6a6a39831e2e/volumes" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.472849 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-664777594-l8qtg"] Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.510789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-664777594-l8qtg" event={"ID":"1272b297-f9c9-4aee-9d3c-228c03e7ee3a","Type":"ContainerStarted","Data":"b2ff1b1a49e309aa64a5c9503fc951d2e6cf4a8fdb9710888efbd10f0a2fc690"} Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.513792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" event={"ID":"03376352-fca7-4c04-a7f3-eea86de9c93f","Type":"ContainerDied","Data":"a36c9cd2487422954c84b367e70203d109516ab8050261c6f696ce382e21399a"} Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.513821 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a36c9cd2487422954c84b367e70203d109516ab8050261c6f696ce382e21399a" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.513903 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-tbndb" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.592417 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-bp8bh"] Nov 21 12:55:31 crc kubenswrapper[4769]: W1121 12:55:31.603917 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod959b21b1_bcd8_49eb_baa6_03ddf9b73516.slice/crio-dec094a6574680d50cbefcdc029f1d1682863c2df9407ba83c6cb611e8c53525 WatchSource:0}: Error finding container dec094a6574680d50cbefcdc029f1d1682863c2df9407ba83c6cb611e8c53525: Status 404 returned error can't find the container with id dec094a6574680d50cbefcdc029f1d1682863c2df9407ba83c6cb611e8c53525 Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.651930 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv"] Nov 21 12:55:31 crc kubenswrapper[4769]: E1121 12:55:31.652397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="03376352-fca7-4c04-a7f3-eea86de9c93f" containerName="barbican-db-sync" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.652414 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="03376352-fca7-4c04-a7f3-eea86de9c93f" containerName="barbican-db-sync" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.652661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="03376352-fca7-4c04-a7f3-eea86de9c93f" containerName="barbican-db-sync" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.655579 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.659243 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-bdmvn" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.660056 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.660931 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.686252 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-54d98cf849-m295z"] Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.687938 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.691420 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.694325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv"] Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.705987 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54d98cf849-m295z"] Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769472 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data-custom\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2kf\" (UniqueName: \"kubernetes.io/projected/dc015826-af03-4f13-a223-5727adc49539-kube-api-access-hj2kf\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-combined-ca-bundle\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d356c900-ff80-42a0-8fd8-8b68c06f9f15-logs\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc015826-af03-4f13-a223-5727adc49539-logs\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769681 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-combined-ca-bundle\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7k92\" (UniqueName: \"kubernetes.io/projected/d356c900-ff80-42a0-8fd8-8b68c06f9f15-kube-api-access-w7k92\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.769789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data-custom\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.792127 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql"] Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.794250 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.799944 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.807301 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql"] Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.870907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w7k92\" (UniqueName: \"kubernetes.io/projected/d356c900-ff80-42a0-8fd8-8b68c06f9f15-kube-api-access-w7k92\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.870973 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data-custom\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data-custom\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871136 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2kf\" (UniqueName: \"kubernetes.io/projected/dc015826-af03-4f13-a223-5727adc49539-kube-api-access-hj2kf\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-combined-ca-bundle\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871211 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d356c900-ff80-42a0-8fd8-8b68c06f9f15-logs\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc015826-af03-4f13-a223-5727adc49539-logs\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-combined-ca-bundle\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.871989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d356c900-ff80-42a0-8fd8-8b68c06f9f15-logs\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.873024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc015826-af03-4f13-a223-5727adc49539-logs\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.877499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data-custom\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.877939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.878219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.880275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-combined-ca-bundle\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.883372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-combined-ca-bundle\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.883791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data-custom\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.886453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7k92\" (UniqueName: \"kubernetes.io/projected/d356c900-ff80-42a0-8fd8-8b68c06f9f15-kube-api-access-w7k92\") pod \"barbican-keystone-listener-548b4f9566-42xxv\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.887027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2kf\" (UniqueName: \"kubernetes.io/projected/dc015826-af03-4f13-a223-5727adc49539-kube-api-access-hj2kf\") pod \"barbican-worker-54d98cf849-m295z\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.974970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data-custom\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.975021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcr8n\" (UniqueName: \"kubernetes.io/projected/c0568707-e35d-472d-8fd4-2e2695e84153-kube-api-access-rcr8n\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.975052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0568707-e35d-472d-8fd4-2e2695e84153-logs\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.975102 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-combined-ca-bundle\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.975243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:31 crc kubenswrapper[4769]: I1121 12:55:31.993221 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.039570 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.078459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rcr8n\" (UniqueName: \"kubernetes.io/projected/c0568707-e35d-472d-8fd4-2e2695e84153-kube-api-access-rcr8n\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.078515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0568707-e35d-472d-8fd4-2e2695e84153-logs\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.078560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-combined-ca-bundle\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.078647 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.078682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data-custom\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.087501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0568707-e35d-472d-8fd4-2e2695e84153-logs\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.109562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcr8n\" (UniqueName: \"kubernetes.io/projected/c0568707-e35d-472d-8fd4-2e2695e84153-kube-api-access-rcr8n\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.110244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.110283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-combined-ca-bundle\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.110841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data-custom\") pod \"barbican-api-9fd657ffb-f4pql\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.122562 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.532935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-664777594-l8qtg" event={"ID":"1272b297-f9c9-4aee-9d3c-228c03e7ee3a","Type":"ContainerStarted","Data":"dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585"} Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.533526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-664777594-l8qtg" event={"ID":"1272b297-f9c9-4aee-9d3c-228c03e7ee3a","Type":"ContainerStarted","Data":"4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23"} Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.533671 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.533694 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.535344 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" event={"ID":"959b21b1-bcd8-49eb-baa6-03ddf9b73516","Type":"ContainerStarted","Data":"c16b3ecd9658e96b43ee9f1c10e74fc9f1462820d41d8d348d6545431b19f11b"} Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.535368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" event={"ID":"959b21b1-bcd8-49eb-baa6-03ddf9b73516","Type":"ContainerStarted","Data":"dec094a6574680d50cbefcdc029f1d1682863c2df9407ba83c6cb611e8c53525"} Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.546211 4769 generic.go:334] "Generic (PLEG): container finished" podID="ced52c5e-301d-4df1-b23a-adf5bcc799d0" containerID="fb31b3f33e76224a37d9ae0cf893eee2602e2915af1470389bcf9d4c7c56cebb" exitCode=0 Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.546256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" event={"ID":"ced52c5e-301d-4df1-b23a-adf5bcc799d0","Type":"ContainerDied","Data":"fb31b3f33e76224a37d9ae0cf893eee2602e2915af1470389bcf9d4c7c56cebb"} Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.571391 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-664777594-l8qtg" podStartSLOduration=2.571180214 podStartE2EDuration="2.571180214s" podCreationTimestamp="2025-11-21 12:55:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:32.560315021 +0000 UTC m=+3891.260976849" watchObservedRunningTime="2025-11-21 12:55:32.571180214 +0000 UTC m=+3891.271842022" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.581450 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" podStartSLOduration=2.58142956 podStartE2EDuration="2.58142956s" podCreationTimestamp="2025-11-21 12:55:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:32.573891647 +0000 UTC m=+3891.274553465" watchObservedRunningTime="2025-11-21 12:55:32.58142956 +0000 UTC m=+3891.282091378" Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.598564 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv"] Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.708681 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54d98cf849-m295z"] Nov 21 12:55:32 crc kubenswrapper[4769]: W1121 12:55:32.711788 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc015826_af03_4f13_a223_5727adc49539.slice/crio-b8ec67bc3d5dfc2d8d6b031cd6793c15e52755146cc976cfa2b67bca0f8dd8d4 WatchSource:0}: Error finding container b8ec67bc3d5dfc2d8d6b031cd6793c15e52755146cc976cfa2b67bca0f8dd8d4: Status 404 returned error can't find the container with id b8ec67bc3d5dfc2d8d6b031cd6793c15e52755146cc976cfa2b67bca0f8dd8d4 Nov 21 12:55:32 crc kubenswrapper[4769]: I1121 12:55:32.726609 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql"] Nov 21 12:55:32 crc kubenswrapper[4769]: W1121 12:55:32.727850 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0568707_e35d_472d_8fd4_2e2695e84153.slice/crio-3d1bb2e71473946b89e83d71386f84093fcc2d79e6056155f3100732d3286b94 WatchSource:0}: Error finding container 3d1bb2e71473946b89e83d71386f84093fcc2d79e6056155f3100732d3286b94: Status 404 returned error can't find the container with id 3d1bb2e71473946b89e83d71386f84093fcc2d79e6056155f3100732d3286b94 Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.556894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" event={"ID":"dc015826-af03-4f13-a223-5727adc49539","Type":"ContainerStarted","Data":"11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.557181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" event={"ID":"dc015826-af03-4f13-a223-5727adc49539","Type":"ContainerStarted","Data":"eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.557228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" event={"ID":"dc015826-af03-4f13-a223-5727adc49539","Type":"ContainerStarted","Data":"b8ec67bc3d5dfc2d8d6b031cd6793c15e52755146cc976cfa2b67bca0f8dd8d4"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.560505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" event={"ID":"c0568707-e35d-472d-8fd4-2e2695e84153","Type":"ContainerStarted","Data":"bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.560842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" event={"ID":"c0568707-e35d-472d-8fd4-2e2695e84153","Type":"ContainerStarted","Data":"4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.560859 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.560868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" event={"ID":"c0568707-e35d-472d-8fd4-2e2695e84153","Type":"ContainerStarted","Data":"3d1bb2e71473946b89e83d71386f84093fcc2d79e6056155f3100732d3286b94"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.560879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.562503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" event={"ID":"d356c900-ff80-42a0-8fd8-8b68c06f9f15","Type":"ContainerStarted","Data":"263f5c44cb0b771d5ce3f06fb6b1c7e79a81ff51f09e29ac300432ce655f8173"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.562541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" event={"ID":"d356c900-ff80-42a0-8fd8-8b68c06f9f15","Type":"ContainerStarted","Data":"cbe64a043e09323dce82a6d1651d291a65b156e4e6c4418c987958992612dcad"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.562553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" event={"ID":"d356c900-ff80-42a0-8fd8-8b68c06f9f15","Type":"ContainerStarted","Data":"ff9f24a6850423ad08d504b9af0c4511512d3628b3b7efc08884d41aa25581f8"} Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.579601 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" podStartSLOduration=2.579579562 podStartE2EDuration="2.579579562s" podCreationTimestamp="2025-11-21 12:55:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:33.578966415 +0000 UTC m=+3892.279628233" watchObservedRunningTime="2025-11-21 12:55:33.579579562 +0000 UTC m=+3892.280241390" Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.599487 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" podStartSLOduration=2.599470767 podStartE2EDuration="2.599470767s" podCreationTimestamp="2025-11-21 12:55:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:33.596457156 +0000 UTC m=+3892.297118974" watchObservedRunningTime="2025-11-21 12:55:33.599470767 +0000 UTC m=+3892.300132585" Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.616417 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" podStartSLOduration=2.616399333 podStartE2EDuration="2.616399333s" podCreationTimestamp="2025-11-21 12:55:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:33.612769366 +0000 UTC m=+3892.313431184" watchObservedRunningTime="2025-11-21 12:55:33.616399333 +0000 UTC m=+3892.317061161" Nov 21 12:55:33 crc kubenswrapper[4769]: I1121 12:55:33.911044 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.017577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-scripts\") pod \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.017973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6q8d\" (UniqueName: \"kubernetes.io/projected/ced52c5e-301d-4df1-b23a-adf5bcc799d0-kube-api-access-x6q8d\") pod \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.018003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ced52c5e-301d-4df1-b23a-adf5bcc799d0-etc-machine-id\") pod \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.018032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-combined-ca-bundle\") pod \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.018089 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-config-data\") pod \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.018151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-db-sync-config-data\") pod \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\" (UID: \"ced52c5e-301d-4df1-b23a-adf5bcc799d0\") " Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.018174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ced52c5e-301d-4df1-b23a-adf5bcc799d0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ced52c5e-301d-4df1-b23a-adf5bcc799d0" (UID: "ced52c5e-301d-4df1-b23a-adf5bcc799d0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.018519 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ced52c5e-301d-4df1-b23a-adf5bcc799d0-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.027382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-scripts" (OuterVolumeSpecName: "scripts") pod "ced52c5e-301d-4df1-b23a-adf5bcc799d0" (UID: "ced52c5e-301d-4df1-b23a-adf5bcc799d0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.027394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "ced52c5e-301d-4df1-b23a-adf5bcc799d0" (UID: "ced52c5e-301d-4df1-b23a-adf5bcc799d0"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.027425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced52c5e-301d-4df1-b23a-adf5bcc799d0-kube-api-access-x6q8d" (OuterVolumeSpecName: "kube-api-access-x6q8d") pod "ced52c5e-301d-4df1-b23a-adf5bcc799d0" (UID: "ced52c5e-301d-4df1-b23a-adf5bcc799d0"). InnerVolumeSpecName "kube-api-access-x6q8d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.063168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ced52c5e-301d-4df1-b23a-adf5bcc799d0" (UID: "ced52c5e-301d-4df1-b23a-adf5bcc799d0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.075054 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-config-data" (OuterVolumeSpecName: "config-data") pod "ced52c5e-301d-4df1-b23a-adf5bcc799d0" (UID: "ced52c5e-301d-4df1-b23a-adf5bcc799d0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.119675 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.119980 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x6q8d\" (UniqueName: \"kubernetes.io/projected/ced52c5e-301d-4df1-b23a-adf5bcc799d0-kube-api-access-x6q8d\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.120072 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.120150 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.120247 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/ced52c5e-301d-4df1-b23a-adf5bcc799d0-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.574993 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" event={"ID":"ced52c5e-301d-4df1-b23a-adf5bcc799d0","Type":"ContainerDied","Data":"9f35cdd32b68fc02c62955ccf826fff07e1e7cbf876dc9ac965159e7a61c2981"} Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.575098 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f35cdd32b68fc02c62955ccf826fff07e1e7cbf876dc9ac965159e7a61c2981" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.575113 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-zpnxl" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.815294 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:55:34 crc kubenswrapper[4769]: E1121 12:55:34.815941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ced52c5e-301d-4df1-b23a-adf5bcc799d0" containerName="cinder-db-sync" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.815953 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced52c5e-301d-4df1-b23a-adf5bcc799d0" containerName="cinder-db-sync" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.816133 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ced52c5e-301d-4df1-b23a-adf5bcc799d0" containerName="cinder-db-sync" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.817305 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.820785 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.820943 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.821612 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.822889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.824037 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-pp5k7" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.858022 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.860164 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.919520 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.923976 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.936097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.936181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.936220 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2927q\" (UniqueName: \"kubernetes.io/projected/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-kube-api-access-2927q\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.936301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-scripts\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.936350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.936388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.947531 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.947567 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:34 crc kubenswrapper[4769]: I1121 12:55:34.987794 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.013305 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.037833 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038787 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2927q\" (UniqueName: \"kubernetes.io/projected/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-kube-api-access-2927q\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-scripts\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.038883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.040413 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.044561 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-scripts\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.045814 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.046005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.046715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.046828 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.058027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2927q\" (UniqueName: \"kubernetes.io/projected/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-kube-api-access-2927q\") pod \"cinder-scheduler-0\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.086020 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.140649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data-custom\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.140745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qps6q\" (UniqueName: \"kubernetes.io/projected/f00f0d0d-e0f5-483c-8995-658e9a5d5389-kube-api-access-qps6q\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.140886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f00f0d0d-e0f5-483c-8995-658e9a5d5389-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.140958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-scripts\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.141025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f00f0d0d-e0f5-483c-8995-658e9a5d5389-logs\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.141110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.141215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.141574 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.242950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qps6q\" (UniqueName: \"kubernetes.io/projected/f00f0d0d-e0f5-483c-8995-658e9a5d5389-kube-api-access-qps6q\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.243029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f00f0d0d-e0f5-483c-8995-658e9a5d5389-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.243062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-scripts\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.243093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f00f0d0d-e0f5-483c-8995-658e9a5d5389-logs\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.243121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.243153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.243187 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data-custom\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.245600 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f00f0d0d-e0f5-483c-8995-658e9a5d5389-etc-machine-id\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.249244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.249487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f00f0d0d-e0f5-483c-8995-658e9a5d5389-logs\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.249622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-scripts\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.250670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data-custom\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.254009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.276823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qps6q\" (UniqueName: \"kubernetes.io/projected/f00f0d0d-e0f5-483c-8995-658e9a5d5389-kube-api-access-qps6q\") pod \"cinder-api-0\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.419890 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.588874 4769 generic.go:334] "Generic (PLEG): container finished" podID="959b21b1-bcd8-49eb-baa6-03ddf9b73516" containerID="c16b3ecd9658e96b43ee9f1c10e74fc9f1462820d41d8d348d6545431b19f11b" exitCode=0 Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.588938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" event={"ID":"959b21b1-bcd8-49eb-baa6-03ddf9b73516","Type":"ContainerDied","Data":"c16b3ecd9658e96b43ee9f1c10e74fc9f1462820d41d8d348d6545431b19f11b"} Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.590958 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.591004 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.591018 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.591028 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.592730 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:55:35 crc kubenswrapper[4769]: W1121 12:55:35.600293 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded80d6c8_9e92_431d_9a46_6d9f4c9be521.slice/crio-0dbbecf471a48320610ec039a7f5dd3ac320d9f0c9288bfe0b727aa0ba119fbb WatchSource:0}: Error finding container 0dbbecf471a48320610ec039a7f5dd3ac320d9f0c9288bfe0b727aa0ba119fbb: Status 404 returned error can't find the container with id 0dbbecf471a48320610ec039a7f5dd3ac320d9f0c9288bfe0b727aa0ba119fbb Nov 21 12:55:35 crc kubenswrapper[4769]: I1121 12:55:35.909030 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:55:35 crc kubenswrapper[4769]: W1121 12:55:35.911891 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf00f0d0d_e0f5_483c_8995_658e9a5d5389.slice/crio-69ca6f26d0096f1b968f43aff354b2a57b0ce71242a3ffecbdcebfeb24e735af WatchSource:0}: Error finding container 69ca6f26d0096f1b968f43aff354b2a57b0ce71242a3ffecbdcebfeb24e735af: Status 404 returned error can't find the container with id 69ca6f26d0096f1b968f43aff354b2a57b0ce71242a3ffecbdcebfeb24e735af Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.612729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f00f0d0d-e0f5-483c-8995-658e9a5d5389","Type":"ContainerStarted","Data":"8ca909f079592c78269c081787685adb1952af8d28386bb544cd418938c66fab"} Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.612969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f00f0d0d-e0f5-483c-8995-658e9a5d5389","Type":"ContainerStarted","Data":"69ca6f26d0096f1b968f43aff354b2a57b0ce71242a3ffecbdcebfeb24e735af"} Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.615886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ed80d6c8-9e92-431d-9a46-6d9f4c9be521","Type":"ContainerStarted","Data":"5ce9df7a8f70352518e8d22d0a196dbbe29dccbd53f21e9e7d8b11179abd82e0"} Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.616039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ed80d6c8-9e92-431d-9a46-6d9f4c9be521","Type":"ContainerStarted","Data":"0dbbecf471a48320610ec039a7f5dd3ac320d9f0c9288bfe0b727aa0ba119fbb"} Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.925565 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.984878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-combined-ca-bundle\") pod \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.984931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-config-data\") pod \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.985045 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-fernet-keys\") pod \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.985104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-credential-keys\") pod \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.985233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w96mj\" (UniqueName: \"kubernetes.io/projected/959b21b1-bcd8-49eb-baa6-03ddf9b73516-kube-api-access-w96mj\") pod \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.985811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-scripts\") pod \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\" (UID: \"959b21b1-bcd8-49eb-baa6-03ddf9b73516\") " Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.995315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "959b21b1-bcd8-49eb-baa6-03ddf9b73516" (UID: "959b21b1-bcd8-49eb-baa6-03ddf9b73516"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.995675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "959b21b1-bcd8-49eb-baa6-03ddf9b73516" (UID: "959b21b1-bcd8-49eb-baa6-03ddf9b73516"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.995981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-scripts" (OuterVolumeSpecName: "scripts") pod "959b21b1-bcd8-49eb-baa6-03ddf9b73516" (UID: "959b21b1-bcd8-49eb-baa6-03ddf9b73516"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.999690 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.999723 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:36 crc kubenswrapper[4769]: I1121 12:55:36.999737 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.006438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959b21b1-bcd8-49eb-baa6-03ddf9b73516-kube-api-access-w96mj" (OuterVolumeSpecName: "kube-api-access-w96mj") pod "959b21b1-bcd8-49eb-baa6-03ddf9b73516" (UID: "959b21b1-bcd8-49eb-baa6-03ddf9b73516"). InnerVolumeSpecName "kube-api-access-w96mj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.025381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "959b21b1-bcd8-49eb-baa6-03ddf9b73516" (UID: "959b21b1-bcd8-49eb-baa6-03ddf9b73516"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.063278 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-config-data" (OuterVolumeSpecName: "config-data") pod "959b21b1-bcd8-49eb-baa6-03ddf9b73516" (UID: "959b21b1-bcd8-49eb-baa6-03ddf9b73516"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.101588 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.101619 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/959b21b1-bcd8-49eb-baa6-03ddf9b73516-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.101629 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w96mj\" (UniqueName: \"kubernetes.io/projected/959b21b1-bcd8-49eb-baa6-03ddf9b73516-kube-api-access-w96mj\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.278029 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:55:37 crc kubenswrapper[4769]: E1121 12:55:37.278273 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.569422 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.647280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ed80d6c8-9e92-431d-9a46-6d9f4c9be521","Type":"ContainerStarted","Data":"1228ced0201a117c2761c96225ab19319009b828626d077abe625a633e51ffef"} Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.654638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" event={"ID":"959b21b1-bcd8-49eb-baa6-03ddf9b73516","Type":"ContainerDied","Data":"dec094a6574680d50cbefcdc029f1d1682863c2df9407ba83c6cb611e8c53525"} Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.654677 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dec094a6574680d50cbefcdc029f1d1682863c2df9407ba83c6cb611e8c53525" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.654749 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-bp8bh" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.666067 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.667221 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.6672077610000002 podStartE2EDuration="3.667207761s" podCreationTimestamp="2025-11-21 12:55:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:37.66233049 +0000 UTC m=+3896.362992308" watchObservedRunningTime="2025-11-21 12:55:37.667207761 +0000 UTC m=+3896.367869579" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.667256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f00f0d0d-e0f5-483c-8995-658e9a5d5389","Type":"ContainerStarted","Data":"1198cba46a4bef26b5da0b4696489013c112c4e4647c0e4e818ceddb85e8d4c4"} Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.667283 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.697970 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=2.697954129 podStartE2EDuration="2.697954129s" podCreationTimestamp="2025-11-21 12:55:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:37.690278192 +0000 UTC m=+3896.390940010" watchObservedRunningTime="2025-11-21 12:55:37.697954129 +0000 UTC m=+3896.398615947" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.765290 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx"] Nov 21 12:55:37 crc kubenswrapper[4769]: E1121 12:55:37.765641 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="959b21b1-bcd8-49eb-baa6-03ddf9b73516" containerName="keystone-bootstrap" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.765658 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="959b21b1-bcd8-49eb-baa6-03ddf9b73516" containerName="keystone-bootstrap" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.765869 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="959b21b1-bcd8-49eb-baa6-03ddf9b73516" containerName="keystone-bootstrap" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.766434 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.768862 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.770200 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.770262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-2ng29" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.770453 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.782431 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.782534 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.838084 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx"] Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.909575 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.914013 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-combined-ca-bundle\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.914141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-config-data\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.914219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-credential-keys\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.914373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-scripts\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.914439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvvx\" (UniqueName: \"kubernetes.io/projected/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-kube-api-access-wtvvx\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.914528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-fernet-keys\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:37 crc kubenswrapper[4769]: I1121 12:55:37.926693 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.016340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-config-data\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.016644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-credential-keys\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.016665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-scripts\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.016688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvvx\" (UniqueName: \"kubernetes.io/projected/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-kube-api-access-wtvvx\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.016718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-fernet-keys\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.016759 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-combined-ca-bundle\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.025081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-config-data\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.028497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-scripts\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.031819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-credential-keys\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.032058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-fernet-keys\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.036685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-combined-ca-bundle\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.053741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvvx\" (UniqueName: \"kubernetes.io/projected/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-kube-api-access-wtvvx\") pod \"keystone-56ff9ff65d-s2vlx\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.081594 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.570748 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx"] Nov 21 12:55:38 crc kubenswrapper[4769]: W1121 12:55:38.577083 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5a4059b_4a4a_4cb0_b7d3_d05cc404a7b5.slice/crio-6168358ab8831885771f8e8f0cf076024524f992ce67c7645958eb4fbcec79fb WatchSource:0}: Error finding container 6168358ab8831885771f8e8f0cf076024524f992ce67c7645958eb4fbcec79fb: Status 404 returned error can't find the container with id 6168358ab8831885771f8e8f0cf076024524f992ce67c7645958eb4fbcec79fb Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.685027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" event={"ID":"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5","Type":"ContainerStarted","Data":"6168358ab8831885771f8e8f0cf076024524f992ce67c7645958eb4fbcec79fb"} Nov 21 12:55:38 crc kubenswrapper[4769]: I1121 12:55:38.822209 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:39 crc kubenswrapper[4769]: I1121 12:55:39.696506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" event={"ID":"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5","Type":"ContainerStarted","Data":"bb53c5332774166691e3c581de6245cfeccf3a0874c0709c0b343e5f0b4beff8"} Nov 21 12:55:39 crc kubenswrapper[4769]: I1121 12:55:39.718906 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" podStartSLOduration=2.718888938 podStartE2EDuration="2.718888938s" podCreationTimestamp="2025-11-21 12:55:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:39.711568421 +0000 UTC m=+3898.412230239" watchObservedRunningTime="2025-11-21 12:55:39.718888938 +0000 UTC m=+3898.419550746" Nov 21 12:55:40 crc kubenswrapper[4769]: I1121 12:55:40.141802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:40 crc kubenswrapper[4769]: I1121 12:55:40.547670 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:55:40 crc kubenswrapper[4769]: I1121 12:55:40.709873 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:55:42 crc kubenswrapper[4769]: I1121 12:55:42.736751 4769 generic.go:334] "Generic (PLEG): container finished" podID="a904a050-78bd-475e-ba7d-3920dd17667d" containerID="2b03ca11dd61eff9c513aab44f92368ac1bd82202aeb0f327da2c7cf0f1701f7" exitCode=0 Nov 21 12:55:42 crc kubenswrapper[4769]: I1121 12:55:42.736817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" event={"ID":"a904a050-78bd-475e-ba7d-3920dd17667d","Type":"ContainerDied","Data":"2b03ca11dd61eff9c513aab44f92368ac1bd82202aeb0f327da2c7cf0f1701f7"} Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.097574 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.225273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-combined-ca-bundle\") pod \"a904a050-78bd-475e-ba7d-3920dd17667d\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.225348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72svx\" (UniqueName: \"kubernetes.io/projected/a904a050-78bd-475e-ba7d-3920dd17667d-kube-api-access-72svx\") pod \"a904a050-78bd-475e-ba7d-3920dd17667d\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.225416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-config\") pod \"a904a050-78bd-475e-ba7d-3920dd17667d\" (UID: \"a904a050-78bd-475e-ba7d-3920dd17667d\") " Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.230648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a904a050-78bd-475e-ba7d-3920dd17667d-kube-api-access-72svx" (OuterVolumeSpecName: "kube-api-access-72svx") pod "a904a050-78bd-475e-ba7d-3920dd17667d" (UID: "a904a050-78bd-475e-ba7d-3920dd17667d"). InnerVolumeSpecName "kube-api-access-72svx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.255505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-config" (OuterVolumeSpecName: "config") pod "a904a050-78bd-475e-ba7d-3920dd17667d" (UID: "a904a050-78bd-475e-ba7d-3920dd17667d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.271994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a904a050-78bd-475e-ba7d-3920dd17667d" (UID: "a904a050-78bd-475e-ba7d-3920dd17667d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.328337 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.328373 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-72svx\" (UniqueName: \"kubernetes.io/projected/a904a050-78bd-475e-ba7d-3920dd17667d-kube-api-access-72svx\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.328390 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a904a050-78bd-475e-ba7d-3920dd17667d-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.760185 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" event={"ID":"a904a050-78bd-475e-ba7d-3920dd17667d","Type":"ContainerDied","Data":"7511d08bf046eeb5b6c982d83b0ca063be2e5ac6615b08512226b161926d27e0"} Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.760325 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7511d08bf046eeb5b6c982d83b0ca063be2e5ac6615b08512226b161926d27e0" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.760291 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cwd5x" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.990247 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7756664b4b-7s9gh"] Nov 21 12:55:44 crc kubenswrapper[4769]: E1121 12:55:44.990963 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a904a050-78bd-475e-ba7d-3920dd17667d" containerName="neutron-db-sync" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.990978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a904a050-78bd-475e-ba7d-3920dd17667d" containerName="neutron-db-sync" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.991151 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a904a050-78bd-475e-ba7d-3920dd17667d" containerName="neutron-db-sync" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.992089 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.996475 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.996740 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 12:55:44 crc kubenswrapper[4769]: I1121 12:55:44.996904 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-shv2w" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.013466 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7756664b4b-7s9gh"] Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.146183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9s8\" (UniqueName: \"kubernetes.io/projected/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-kube-api-access-6b9s8\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.146248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-httpd-config\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.146296 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-config\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.146317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-combined-ca-bundle\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.248286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-combined-ca-bundle\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.248414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9s8\" (UniqueName: \"kubernetes.io/projected/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-kube-api-access-6b9s8\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.248445 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-httpd-config\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.248506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-config\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.254106 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-config\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.262347 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-combined-ca-bundle\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.271874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9s8\" (UniqueName: \"kubernetes.io/projected/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-kube-api-access-6b9s8\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.272043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-httpd-config\") pod \"neutron-7756664b4b-7s9gh\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.335257 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.381121 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:55:45 crc kubenswrapper[4769]: I1121 12:55:45.851731 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7756664b4b-7s9gh"] Nov 21 12:55:46 crc kubenswrapper[4769]: I1121 12:55:46.783271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" event={"ID":"32857629-7f0b-49f3-b3cc-6de4ab3db5bb","Type":"ContainerStarted","Data":"7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82"} Nov 21 12:55:46 crc kubenswrapper[4769]: I1121 12:55:46.783709 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:55:46 crc kubenswrapper[4769]: I1121 12:55:46.783725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" event={"ID":"32857629-7f0b-49f3-b3cc-6de4ab3db5bb","Type":"ContainerStarted","Data":"5aa33a1915af89c555f9dc997de37651a9b32a85cf3879217af8d4d6d8e837db"} Nov 21 12:55:46 crc kubenswrapper[4769]: I1121 12:55:46.783736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" event={"ID":"32857629-7f0b-49f3-b3cc-6de4ab3db5bb","Type":"ContainerStarted","Data":"7311037badb073788d2774f7c1788f7ebecdad22c666e3af35bfaf162f6f879c"} Nov 21 12:55:46 crc kubenswrapper[4769]: I1121 12:55:46.804828 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" podStartSLOduration=2.804804688 podStartE2EDuration="2.804804688s" podCreationTimestamp="2025-11-21 12:55:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:55:46.800150213 +0000 UTC m=+3905.500812051" watchObservedRunningTime="2025-11-21 12:55:46.804804688 +0000 UTC m=+3905.505466506" Nov 21 12:55:47 crc kubenswrapper[4769]: I1121 12:55:47.233436 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:55:51 crc kubenswrapper[4769]: I1121 12:55:51.274642 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:55:51 crc kubenswrapper[4769]: E1121 12:55:51.275744 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:55:54 crc kubenswrapper[4769]: I1121 12:55:54.068313 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:02 crc kubenswrapper[4769]: I1121 12:56:02.050568 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:56:02 crc kubenswrapper[4769]: I1121 12:56:02.201964 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:56:06 crc kubenswrapper[4769]: I1121 12:56:06.274303 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:56:06 crc kubenswrapper[4769]: E1121 12:56:06.275263 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:56:09 crc kubenswrapper[4769]: I1121 12:56:09.524931 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.654686 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.656244 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.658446 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.659059 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-tbl8j" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.659412 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.670419 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.705945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.706042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.706083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config-secret\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.706155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7xn\" (UniqueName: \"kubernetes.io/projected/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-kube-api-access-qb7xn\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.751758 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:12 crc kubenswrapper[4769]: E1121 12:56:12.752836 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-qb7xn openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="7eb8c036-bf2e-4886-bbd2-a8d561669fd4" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.760337 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.766517 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.768642 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.770601 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config-secret\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808421 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpp9l\" (UniqueName: \"kubernetes.io/projected/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-kube-api-access-vpp9l\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7xn\" (UniqueName: \"kubernetes.io/projected/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-kube-api-access-qb7xn\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808509 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808584 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config-secret\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.808602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-combined-ca-bundle\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.810256 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: E1121 12:56:12.810900 4769 projected.go:194] Error preparing data for projected volume kube-api-access-qb7xn for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (7eb8c036-bf2e-4886-bbd2-a8d561669fd4) does not match the UID in record. The object might have been deleted and then recreated Nov 21 12:56:12 crc kubenswrapper[4769]: E1121 12:56:12.810981 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-kube-api-access-qb7xn podName:7eb8c036-bf2e-4886-bbd2-a8d561669fd4 nodeName:}" failed. No retries permitted until 2025-11-21 12:56:13.310958351 +0000 UTC m=+3932.011620259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qb7xn" (UniqueName: "kubernetes.io/projected/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-kube-api-access-qb7xn") pod "openstackclient" (UID: "7eb8c036-bf2e-4886-bbd2-a8d561669fd4") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (7eb8c036-bf2e-4886-bbd2-a8d561669fd4) does not match the UID in record. The object might have been deleted and then recreated Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.816051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config-secret\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.816228 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.909592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vpp9l\" (UniqueName: \"kubernetes.io/projected/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-kube-api-access-vpp9l\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.909747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.909788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config-secret\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.909812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-combined-ca-bundle\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.910571 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.918211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-combined-ca-bundle\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.920608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config-secret\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:12 crc kubenswrapper[4769]: I1121 12:56:12.935161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpp9l\" (UniqueName: \"kubernetes.io/projected/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-kube-api-access-vpp9l\") pod \"openstackclient\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.091133 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.096527 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.103851 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="7eb8c036-bf2e-4886-bbd2-a8d561669fd4" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.117671 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.218132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-combined-ca-bundle\") pod \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.219069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config-secret\") pod \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.219162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config\") pod \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\" (UID: \"7eb8c036-bf2e-4886-bbd2-a8d561669fd4\") " Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.219547 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qb7xn\" (UniqueName: \"kubernetes.io/projected/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-kube-api-access-qb7xn\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.220181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "7eb8c036-bf2e-4886-bbd2-a8d561669fd4" (UID: "7eb8c036-bf2e-4886-bbd2-a8d561669fd4"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.224601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "7eb8c036-bf2e-4886-bbd2-a8d561669fd4" (UID: "7eb8c036-bf2e-4886-bbd2-a8d561669fd4"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.224615 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7eb8c036-bf2e-4886-bbd2-a8d561669fd4" (UID: "7eb8c036-bf2e-4886-bbd2-a8d561669fd4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.298869 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eb8c036-bf2e-4886-bbd2-a8d561669fd4" path="/var/lib/kubelet/pods/7eb8c036-bf2e-4886-bbd2-a8d561669fd4/volumes" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.325471 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.325501 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.325512 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7eb8c036-bf2e-4886-bbd2-a8d561669fd4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:13 crc kubenswrapper[4769]: I1121 12:56:13.484456 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 12:56:14 crc kubenswrapper[4769]: I1121 12:56:14.108687 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 12:56:14 crc kubenswrapper[4769]: I1121 12:56:14.109722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a","Type":"ContainerStarted","Data":"bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c"} Nov 21 12:56:14 crc kubenswrapper[4769]: I1121 12:56:14.109769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a","Type":"ContainerStarted","Data":"11a445aa40682d20bd721e36c7f3d828e455cfca60e20ed8dc530f7e961157c5"} Nov 21 12:56:14 crc kubenswrapper[4769]: I1121 12:56:14.132271 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.132256937 podStartE2EDuration="2.132256937s" podCreationTimestamp="2025-11-21 12:56:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:14.127867879 +0000 UTC m=+3932.828529697" watchObservedRunningTime="2025-11-21 12:56:14.132256937 +0000 UTC m=+3932.832918755" Nov 21 12:56:14 crc kubenswrapper[4769]: I1121 12:56:14.135584 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="7eb8c036-bf2e-4886-bbd2-a8d561669fd4" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" Nov 21 12:56:15 crc kubenswrapper[4769]: I1121 12:56:15.347244 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:56:16 crc kubenswrapper[4769]: I1121 12:56:16.974232 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-5645df8756-s688r"] Nov 21 12:56:16 crc kubenswrapper[4769]: I1121 12:56:16.976054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:16 crc kubenswrapper[4769]: I1121 12:56:16.987062 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 12:56:16 crc kubenswrapper[4769]: I1121 12:56:16.998551 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5645df8756-s688r"] Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.050477 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.050998 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-central-agent" containerID="cri-o://3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059" gracePeriod=30 Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.051037 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="proxy-httpd" containerID="cri-o://aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670" gracePeriod=30 Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.051079 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-notification-agent" containerID="cri-o://cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8" gracePeriod=30 Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.051098 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="sg-core" containerID="cri-o://04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73" gracePeriod=30 Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.086179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcfr\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-kube-api-access-2tcfr\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.086285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-etc-swift\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.086306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-combined-ca-bundle\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.086330 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-config-data\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.086361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-log-httpd\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.086388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-run-httpd\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.187827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcfr\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-kube-api-access-2tcfr\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.187958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-etc-swift\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.187983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-combined-ca-bundle\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.188021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-config-data\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.188069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-log-httpd\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.188111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-run-httpd\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.188787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-log-httpd\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.188858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-run-httpd\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.196639 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-etc-swift\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.196808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-combined-ca-bundle\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.199813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-config-data\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.218863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcfr\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-kube-api-access-2tcfr\") pod \"swift-proxy-5645df8756-s688r\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.296027 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:17 crc kubenswrapper[4769]: I1121 12:56:17.779374 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5645df8756-s688r"] Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.165910 4769 generic.go:334] "Generic (PLEG): container finished" podID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerID="aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670" exitCode=0 Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.166330 4769 generic.go:334] "Generic (PLEG): container finished" podID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerID="04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73" exitCode=2 Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.166340 4769 generic.go:334] "Generic (PLEG): container finished" podID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerID="3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059" exitCode=0 Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.165981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerDied","Data":"aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670"} Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.166404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerDied","Data":"04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73"} Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.166417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerDied","Data":"3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059"} Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.168579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" event={"ID":"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608","Type":"ContainerStarted","Data":"b958084b22d5e5c902b0d39ef3707faa4343759b5d121c4d9ef3c4e372fc80e6"} Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.168610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" event={"ID":"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608","Type":"ContainerStarted","Data":"19bc3a3a55df070217867d614628c40efce1bbe851e66f4050b95927b73686d0"} Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.836138 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-combined-ca-bundle\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-scripts\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-config-data\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-log-httpd\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916788 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-sg-core-conf-yaml\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-run-httpd\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.916884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjrss\" (UniqueName: \"kubernetes.io/projected/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-kube-api-access-wjrss\") pod \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\" (UID: \"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06\") " Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.917561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.918230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.920934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-kube-api-access-wjrss" (OuterVolumeSpecName: "kube-api-access-wjrss") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "kube-api-access-wjrss". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.936350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-scripts" (OuterVolumeSpecName: "scripts") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.947098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:18 crc kubenswrapper[4769]: I1121 12:56:18.992467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.018373 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.018411 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.018426 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.018439 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.018454 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjrss\" (UniqueName: \"kubernetes.io/projected/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-kube-api-access-wjrss\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.018467 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.022799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-config-data" (OuterVolumeSpecName: "config-data") pod "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" (UID: "9dd798b1-f0f8-4b9a-914e-1a16bcc6df06"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.126736 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.180358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" event={"ID":"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608","Type":"ContainerStarted","Data":"a1c627ae9438d556354ccf2473d66d3b2a1e469c12e1c9c9e9594c8f78139e19"} Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.180470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.182658 4769 generic.go:334] "Generic (PLEG): container finished" podID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerID="cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8" exitCode=0 Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.182688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerDied","Data":"cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8"} Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.182706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9dd798b1-f0f8-4b9a-914e-1a16bcc6df06","Type":"ContainerDied","Data":"bc5bcf98e2653295b6fc0feff18cc9ab7021dea561000eab7489c29cb7d50e08"} Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.182724 4769 scope.go:117] "RemoveContainer" containerID="aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.182767 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.275251 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" podStartSLOduration=3.27523206 podStartE2EDuration="3.27523206s" podCreationTimestamp="2025-11-21 12:56:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:19.206425796 +0000 UTC m=+3937.907087614" watchObservedRunningTime="2025-11-21 12:56:19.27523206 +0000 UTC m=+3937.975893878" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.300770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.306210 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.307134 4769 scope.go:117] "RemoveContainer" containerID="04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.313779 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.314158 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-notification-agent" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314169 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-notification-agent" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.314179 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="sg-core" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314200 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="sg-core" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.314218 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="proxy-httpd" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314224 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="proxy-httpd" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.314235 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-central-agent" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314241 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-central-agent" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314397 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-notification-agent" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314418 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="ceilometer-central-agent" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314431 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="proxy-httpd" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.314441 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" containerName="sg-core" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.342965 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.343054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.346776 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.346942 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.349717 4769 scope.go:117] "RemoveContainer" containerID="cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.380384 4769 scope.go:117] "RemoveContainer" containerID="3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.396736 4769 scope.go:117] "RemoveContainer" containerID="aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.397114 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670\": container with ID starting with aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670 not found: ID does not exist" containerID="aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.397143 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670"} err="failed to get container status \"aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670\": rpc error: code = NotFound desc = could not find container \"aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670\": container with ID starting with aa160c853cdfa3907d52260bbb5a9e0bab38e07a99b30195625db9c7eadc8670 not found: ID does not exist" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.397163 4769 scope.go:117] "RemoveContainer" containerID="04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.397468 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73\": container with ID starting with 04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73 not found: ID does not exist" containerID="04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.397619 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73"} err="failed to get container status \"04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73\": rpc error: code = NotFound desc = could not find container \"04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73\": container with ID starting with 04116b5ed1524808a363886303a73e1707801c03bf3bf9f25dcfe53edc94bb73 not found: ID does not exist" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.397633 4769 scope.go:117] "RemoveContainer" containerID="cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.398080 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8\": container with ID starting with cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8 not found: ID does not exist" containerID="cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.398125 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8"} err="failed to get container status \"cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8\": rpc error: code = NotFound desc = could not find container \"cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8\": container with ID starting with cbb352cc25c29a0fe676052ede3a98ae3a6a2dcaa4a7e5a276b0856a7eb27ff8 not found: ID does not exist" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.398377 4769 scope.go:117] "RemoveContainer" containerID="3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059" Nov 21 12:56:19 crc kubenswrapper[4769]: E1121 12:56:19.398620 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059\": container with ID starting with 3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059 not found: ID does not exist" containerID="3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.398656 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059"} err="failed to get container status \"3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059\": rpc error: code = NotFound desc = could not find container \"3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059\": container with ID starting with 3dfe7945b7376c879ab9f770c02391fdd6a5b40713f25fe2374816f707d85059 not found: ID does not exist" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-run-httpd\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-scripts\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-config-data\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-log-httpd\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.440748 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv9vm\" (UniqueName: \"kubernetes.io/projected/c65ffe7a-5dd0-4add-adff-1524662d122f-kube-api-access-wv9vm\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-run-httpd\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-scripts\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-config-data\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541842 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-log-httpd\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.541882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wv9vm\" (UniqueName: \"kubernetes.io/projected/c65ffe7a-5dd0-4add-adff-1524662d122f-kube-api-access-wv9vm\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.542174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-run-httpd\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.542297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-log-httpd\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.546210 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.547573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.547879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-scripts\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.557039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-config-data\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.572587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv9vm\" (UniqueName: \"kubernetes.io/projected/c65ffe7a-5dd0-4add-adff-1524662d122f-kube-api-access-wv9vm\") pod \"ceilometer-0\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:19 crc kubenswrapper[4769]: I1121 12:56:19.676870 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.158831 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:20 crc kubenswrapper[4769]: W1121 12:56:20.159368 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc65ffe7a_5dd0_4add_adff_1524662d122f.slice/crio-e38426d5286fa43edb21d362f3d137c43d251a3c593ca4dfbc96fc42dbd4dc8f WatchSource:0}: Error finding container e38426d5286fa43edb21d362f3d137c43d251a3c593ca4dfbc96fc42dbd4dc8f: Status 404 returned error can't find the container with id e38426d5286fa43edb21d362f3d137c43d251a3c593ca4dfbc96fc42dbd4dc8f Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.196596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerStarted","Data":"e38426d5286fa43edb21d362f3d137c43d251a3c593ca4dfbc96fc42dbd4dc8f"} Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.202259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.545820 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-mdx5r"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.546971 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.557470 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-mdx5r"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.653471 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-k9rvb"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.654635 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.660574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-k9rvb"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.685424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvddv\" (UniqueName: \"kubernetes.io/projected/21f24dc8-4e44-4bcb-85dc-d4305b95b314-kube-api-access-wvddv\") pod \"nova-api-db-create-mdx5r\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.685484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21f24dc8-4e44-4bcb-85dc-d4305b95b314-operator-scripts\") pod \"nova-api-db-create-mdx5r\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.744535 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.745990 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.751831 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jqjbl"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.752414 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.753065 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.782884 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.786792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvddv\" (UniqueName: \"kubernetes.io/projected/21f24dc8-4e44-4bcb-85dc-d4305b95b314-kube-api-access-wvddv\") pod \"nova-api-db-create-mdx5r\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.786846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21f24dc8-4e44-4bcb-85dc-d4305b95b314-operator-scripts\") pod \"nova-api-db-create-mdx5r\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.786919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2167ed6-d838-4905-83fb-082532bb6ccd-operator-scripts\") pod \"nova-api-8be8-account-create-6nwxd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.786939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-operator-scripts\") pod \"nova-cell0-db-create-k9rvb\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.786957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc2t5\" (UniqueName: \"kubernetes.io/projected/a2167ed6-d838-4905-83fb-082532bb6ccd-kube-api-access-bc2t5\") pod \"nova-api-8be8-account-create-6nwxd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.786996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnmvx\" (UniqueName: \"kubernetes.io/projected/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-kube-api-access-cnmvx\") pod \"nova-cell0-db-create-k9rvb\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.787927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21f24dc8-4e44-4bcb-85dc-d4305b95b314-operator-scripts\") pod \"nova-api-db-create-mdx5r\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.796250 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jqjbl"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.803615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvddv\" (UniqueName: \"kubernetes.io/projected/21f24dc8-4e44-4bcb-85dc-d4305b95b314-kube-api-access-wvddv\") pod \"nova-api-db-create-mdx5r\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.887109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.888651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk559\" (UniqueName: \"kubernetes.io/projected/6df0c335-4ec7-47b4-8d67-c7b1221a8669-kube-api-access-tk559\") pod \"nova-cell1-db-create-jqjbl\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.888721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6df0c335-4ec7-47b4-8d67-c7b1221a8669-operator-scripts\") pod \"nova-cell1-db-create-jqjbl\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.888864 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2167ed6-d838-4905-83fb-082532bb6ccd-operator-scripts\") pod \"nova-api-8be8-account-create-6nwxd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.888892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-operator-scripts\") pod \"nova-cell0-db-create-k9rvb\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.888917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bc2t5\" (UniqueName: \"kubernetes.io/projected/a2167ed6-d838-4905-83fb-082532bb6ccd-kube-api-access-bc2t5\") pod \"nova-api-8be8-account-create-6nwxd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.888960 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cnmvx\" (UniqueName: \"kubernetes.io/projected/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-kube-api-access-cnmvx\") pod \"nova-cell0-db-create-k9rvb\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.889875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-operator-scripts\") pod \"nova-cell0-db-create-k9rvb\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.889870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2167ed6-d838-4905-83fb-082532bb6ccd-operator-scripts\") pod \"nova-api-8be8-account-create-6nwxd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.905922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc2t5\" (UniqueName: \"kubernetes.io/projected/a2167ed6-d838-4905-83fb-082532bb6ccd-kube-api-access-bc2t5\") pod \"nova-api-8be8-account-create-6nwxd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.910700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnmvx\" (UniqueName: \"kubernetes.io/projected/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-kube-api-access-cnmvx\") pod \"nova-cell0-db-create-k9rvb\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.951971 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.953174 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.956517 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.971358 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr"] Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.990917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tk559\" (UniqueName: \"kubernetes.io/projected/6df0c335-4ec7-47b4-8d67-c7b1221a8669-kube-api-access-tk559\") pod \"nova-cell1-db-create-jqjbl\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.990970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6df0c335-4ec7-47b4-8d67-c7b1221a8669-operator-scripts\") pod \"nova-cell1-db-create-jqjbl\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:20 crc kubenswrapper[4769]: I1121 12:56:20.991554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6df0c335-4ec7-47b4-8d67-c7b1221a8669-operator-scripts\") pod \"nova-cell1-db-create-jqjbl\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.006467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk559\" (UniqueName: \"kubernetes.io/projected/6df0c335-4ec7-47b4-8d67-c7b1221a8669-kube-api-access-tk559\") pod \"nova-cell1-db-create-jqjbl\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.079717 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.093208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkzn\" (UniqueName: \"kubernetes.io/projected/bfd9c065-229c-4597-ac3c-53df4caeb6df-kube-api-access-njkzn\") pod \"nova-cell0-09b6-account-create-684wr\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.093262 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfd9c065-229c-4597-ac3c-53df4caeb6df-operator-scripts\") pod \"nova-cell0-09b6-account-create-684wr\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.096172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.153844 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94"] Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.155054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.158917 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.159738 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.160482 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94"] Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.195544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/664d5c8d-12e4-4894-943e-6b411a9888ea-operator-scripts\") pod \"nova-cell1-e823-account-create-hwn94\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.195591 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-njkzn\" (UniqueName: \"kubernetes.io/projected/bfd9c065-229c-4597-ac3c-53df4caeb6df-kube-api-access-njkzn\") pod \"nova-cell0-09b6-account-create-684wr\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.195616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfd9c065-229c-4597-ac3c-53df4caeb6df-operator-scripts\") pod \"nova-cell0-09b6-account-create-684wr\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.195766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzw4g\" (UniqueName: \"kubernetes.io/projected/664d5c8d-12e4-4894-943e-6b411a9888ea-kube-api-access-dzw4g\") pod \"nova-cell1-e823-account-create-hwn94\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.197528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfd9c065-229c-4597-ac3c-53df4caeb6df-operator-scripts\") pod \"nova-cell0-09b6-account-create-684wr\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.217485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkzn\" (UniqueName: \"kubernetes.io/projected/bfd9c065-229c-4597-ac3c-53df4caeb6df-kube-api-access-njkzn\") pod \"nova-cell0-09b6-account-create-684wr\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.259548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerStarted","Data":"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0"} Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.270939 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.275752 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:56:21 crc kubenswrapper[4769]: E1121 12:56:21.275984 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.297594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dzw4g\" (UniqueName: \"kubernetes.io/projected/664d5c8d-12e4-4894-943e-6b411a9888ea-kube-api-access-dzw4g\") pod \"nova-cell1-e823-account-create-hwn94\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.297702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/664d5c8d-12e4-4894-943e-6b411a9888ea-operator-scripts\") pod \"nova-cell1-e823-account-create-hwn94\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.298450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/664d5c8d-12e4-4894-943e-6b411a9888ea-operator-scripts\") pod \"nova-cell1-e823-account-create-hwn94\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.303830 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd798b1-f0f8-4b9a-914e-1a16bcc6df06" path="/var/lib/kubelet/pods/9dd798b1-f0f8-4b9a-914e-1a16bcc6df06/volumes" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.334387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzw4g\" (UniqueName: \"kubernetes.io/projected/664d5c8d-12e4-4894-943e-6b411a9888ea-kube-api-access-dzw4g\") pod \"nova-cell1-e823-account-create-hwn94\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.385019 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-mdx5r"] Nov 21 12:56:21 crc kubenswrapper[4769]: W1121 12:56:21.417693 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21f24dc8_4e44_4bcb_85dc_d4305b95b314.slice/crio-c06924a11b86ee7854fe2bc62aa92ef27d9e05daa39ffe7e583a0194929a1803 WatchSource:0}: Error finding container c06924a11b86ee7854fe2bc62aa92ef27d9e05daa39ffe7e583a0194929a1803: Status 404 returned error can't find the container with id c06924a11b86ee7854fe2bc62aa92ef27d9e05daa39ffe7e583a0194929a1803 Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.607493 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-k9rvb"] Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.611594 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.725325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd"] Nov 21 12:56:21 crc kubenswrapper[4769]: W1121 12:56:21.729762 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2167ed6_d838_4905_83fb_082532bb6ccd.slice/crio-1550f2b3d8c96517c347ed50e4447d47461404bd2b4b8d06ec8f6cb605cce874 WatchSource:0}: Error finding container 1550f2b3d8c96517c347ed50e4447d47461404bd2b4b8d06ec8f6cb605cce874: Status 404 returned error can't find the container with id 1550f2b3d8c96517c347ed50e4447d47461404bd2b4b8d06ec8f6cb605cce874 Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.812953 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jqjbl"] Nov 21 12:56:21 crc kubenswrapper[4769]: I1121 12:56:21.890312 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr"] Nov 21 12:56:21 crc kubenswrapper[4769]: W1121 12:56:21.899090 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfd9c065_229c_4597_ac3c_53df4caeb6df.slice/crio-69988b2581ddb77750e867375b5b6e0b22414843390aa0236f0b3dfd4d02c555 WatchSource:0}: Error finding container 69988b2581ddb77750e867375b5b6e0b22414843390aa0236f0b3dfd4d02c555: Status 404 returned error can't find the container with id 69988b2581ddb77750e867375b5b6e0b22414843390aa0236f0b3dfd4d02c555 Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.089072 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94"] Nov 21 12:56:22 crc kubenswrapper[4769]: W1121 12:56:22.116426 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod664d5c8d_12e4_4894_943e_6b411a9888ea.slice/crio-dc0dda0f8567faef09fadc5b945433f6492e3a7309ff8477fe95e080f1449e4b WatchSource:0}: Error finding container dc0dda0f8567faef09fadc5b945433f6492e3a7309ff8477fe95e080f1449e4b: Status 404 returned error can't find the container with id dc0dda0f8567faef09fadc5b945433f6492e3a7309ff8477fe95e080f1449e4b Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.282620 4769 generic.go:334] "Generic (PLEG): container finished" podID="21f24dc8-4e44-4bcb-85dc-d4305b95b314" containerID="5f2c6296771bebd6476572b96e6a27f08386be45002551337cedf2f3a969803a" exitCode=0 Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.282687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" event={"ID":"21f24dc8-4e44-4bcb-85dc-d4305b95b314","Type":"ContainerDied","Data":"5f2c6296771bebd6476572b96e6a27f08386be45002551337cedf2f3a969803a"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.282712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" event={"ID":"21f24dc8-4e44-4bcb-85dc-d4305b95b314","Type":"ContainerStarted","Data":"c06924a11b86ee7854fe2bc62aa92ef27d9e05daa39ffe7e583a0194929a1803"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.284573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" event={"ID":"664d5c8d-12e4-4894-943e-6b411a9888ea","Type":"ContainerStarted","Data":"dc0dda0f8567faef09fadc5b945433f6492e3a7309ff8477fe95e080f1449e4b"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.287520 4769 generic.go:334] "Generic (PLEG): container finished" podID="1df45abb-28ef-44a7-8aed-e2abc29e4c1b" containerID="e82bebafe49096e435c0dd57a5f6a57489def808fba98b7994117b127c6bd030" exitCode=0 Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.287581 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" event={"ID":"1df45abb-28ef-44a7-8aed-e2abc29e4c1b","Type":"ContainerDied","Data":"e82bebafe49096e435c0dd57a5f6a57489def808fba98b7994117b127c6bd030"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.287607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" event={"ID":"1df45abb-28ef-44a7-8aed-e2abc29e4c1b","Type":"ContainerStarted","Data":"1fad750e66058a7abb018b92626249e5f5cb09ee6f31fda91e5c4dcf8908cd70"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.290447 4769 generic.go:334] "Generic (PLEG): container finished" podID="6df0c335-4ec7-47b4-8d67-c7b1221a8669" containerID="ea98990946f6e13004e105026761e632adf8e74527437de77db5c0ea24401b5f" exitCode=0 Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.290499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" event={"ID":"6df0c335-4ec7-47b4-8d67-c7b1221a8669","Type":"ContainerDied","Data":"ea98990946f6e13004e105026761e632adf8e74527437de77db5c0ea24401b5f"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.290516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" event={"ID":"6df0c335-4ec7-47b4-8d67-c7b1221a8669","Type":"ContainerStarted","Data":"d668ce84c566ba74d32ec1a69c25037c40bc1b86522edf48a53bacc240bdb73e"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.296618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" event={"ID":"bfd9c065-229c-4597-ac3c-53df4caeb6df","Type":"ContainerStarted","Data":"c48c0fa7db76af44b50d1b10d1c38f06d2fbe872922aa4cf98886b69cfa04990"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.296660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" event={"ID":"bfd9c065-229c-4597-ac3c-53df4caeb6df","Type":"ContainerStarted","Data":"69988b2581ddb77750e867375b5b6e0b22414843390aa0236f0b3dfd4d02c555"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.300682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerStarted","Data":"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.300713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerStarted","Data":"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.301898 4769 generic.go:334] "Generic (PLEG): container finished" podID="a2167ed6-d838-4905-83fb-082532bb6ccd" containerID="4e61ab989053b7a5dc9e0134ebea1f10dba9dc527f26287d20e71c4f9840f4be" exitCode=0 Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.301926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" event={"ID":"a2167ed6-d838-4905-83fb-082532bb6ccd","Type":"ContainerDied","Data":"4e61ab989053b7a5dc9e0134ebea1f10dba9dc527f26287d20e71c4f9840f4be"} Nov 21 12:56:22 crc kubenswrapper[4769]: I1121 12:56:22.301942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" event={"ID":"a2167ed6-d838-4905-83fb-082532bb6ccd","Type":"ContainerStarted","Data":"1550f2b3d8c96517c347ed50e4447d47461404bd2b4b8d06ec8f6cb605cce874"} Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.118992 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.316438 4769 generic.go:334] "Generic (PLEG): container finished" podID="664d5c8d-12e4-4894-943e-6b411a9888ea" containerID="e2b92f8169576b1223af4924d42600948f0987f54b867cf7ff872ba44141dc3a" exitCode=0 Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.316509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" event={"ID":"664d5c8d-12e4-4894-943e-6b411a9888ea","Type":"ContainerDied","Data":"e2b92f8169576b1223af4924d42600948f0987f54b867cf7ff872ba44141dc3a"} Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.317956 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfd9c065-229c-4597-ac3c-53df4caeb6df" containerID="c48c0fa7db76af44b50d1b10d1c38f06d2fbe872922aa4cf98886b69cfa04990" exitCode=0 Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.318168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" event={"ID":"bfd9c065-229c-4597-ac3c-53df4caeb6df","Type":"ContainerDied","Data":"c48c0fa7db76af44b50d1b10d1c38f06d2fbe872922aa4cf98886b69cfa04990"} Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.696484 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.747952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6df0c335-4ec7-47b4-8d67-c7b1221a8669-operator-scripts\") pod \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.748098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk559\" (UniqueName: \"kubernetes.io/projected/6df0c335-4ec7-47b4-8d67-c7b1221a8669-kube-api-access-tk559\") pod \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\" (UID: \"6df0c335-4ec7-47b4-8d67-c7b1221a8669\") " Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.749641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df0c335-4ec7-47b4-8d67-c7b1221a8669-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6df0c335-4ec7-47b4-8d67-c7b1221a8669" (UID: "6df0c335-4ec7-47b4-8d67-c7b1221a8669"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.767938 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df0c335-4ec7-47b4-8d67-c7b1221a8669-kube-api-access-tk559" (OuterVolumeSpecName: "kube-api-access-tk559") pod "6df0c335-4ec7-47b4-8d67-c7b1221a8669" (UID: "6df0c335-4ec7-47b4-8d67-c7b1221a8669"). InnerVolumeSpecName "kube-api-access-tk559". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.850112 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6df0c335-4ec7-47b4-8d67-c7b1221a8669-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.850394 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tk559\" (UniqueName: \"kubernetes.io/projected/6df0c335-4ec7-47b4-8d67-c7b1221a8669-kube-api-access-tk559\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.932981 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.936109 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.945996 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:23 crc kubenswrapper[4769]: I1121 12:56:23.952478 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.051971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21f24dc8-4e44-4bcb-85dc-d4305b95b314-operator-scripts\") pod \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc2t5\" (UniqueName: \"kubernetes.io/projected/a2167ed6-d838-4905-83fb-082532bb6ccd-kube-api-access-bc2t5\") pod \"a2167ed6-d838-4905-83fb-082532bb6ccd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvddv\" (UniqueName: \"kubernetes.io/projected/21f24dc8-4e44-4bcb-85dc-d4305b95b314-kube-api-access-wvddv\") pod \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\" (UID: \"21f24dc8-4e44-4bcb-85dc-d4305b95b314\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njkzn\" (UniqueName: \"kubernetes.io/projected/bfd9c065-229c-4597-ac3c-53df4caeb6df-kube-api-access-njkzn\") pod \"bfd9c065-229c-4597-ac3c-53df4caeb6df\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2167ed6-d838-4905-83fb-082532bb6ccd-operator-scripts\") pod \"a2167ed6-d838-4905-83fb-082532bb6ccd\" (UID: \"a2167ed6-d838-4905-83fb-082532bb6ccd\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfd9c065-229c-4597-ac3c-53df4caeb6df-operator-scripts\") pod \"bfd9c065-229c-4597-ac3c-53df4caeb6df\" (UID: \"bfd9c065-229c-4597-ac3c-53df4caeb6df\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-operator-scripts\") pod \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnmvx\" (UniqueName: \"kubernetes.io/projected/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-kube-api-access-cnmvx\") pod \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\" (UID: \"1df45abb-28ef-44a7-8aed-e2abc29e4c1b\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052528 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f24dc8-4e44-4bcb-85dc-d4305b95b314-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "21f24dc8-4e44-4bcb-85dc-d4305b95b314" (UID: "21f24dc8-4e44-4bcb-85dc-d4305b95b314"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052870 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/21f24dc8-4e44-4bcb-85dc-d4305b95b314-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.052973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd9c065-229c-4597-ac3c-53df4caeb6df-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bfd9c065-229c-4597-ac3c-53df4caeb6df" (UID: "bfd9c065-229c-4597-ac3c-53df4caeb6df"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.053271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1df45abb-28ef-44a7-8aed-e2abc29e4c1b" (UID: "1df45abb-28ef-44a7-8aed-e2abc29e4c1b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.053323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2167ed6-d838-4905-83fb-082532bb6ccd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a2167ed6-d838-4905-83fb-082532bb6ccd" (UID: "a2167ed6-d838-4905-83fb-082532bb6ccd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.055661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2167ed6-d838-4905-83fb-082532bb6ccd-kube-api-access-bc2t5" (OuterVolumeSpecName: "kube-api-access-bc2t5") pod "a2167ed6-d838-4905-83fb-082532bb6ccd" (UID: "a2167ed6-d838-4905-83fb-082532bb6ccd"). InnerVolumeSpecName "kube-api-access-bc2t5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.056140 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-kube-api-access-cnmvx" (OuterVolumeSpecName: "kube-api-access-cnmvx") pod "1df45abb-28ef-44a7-8aed-e2abc29e4c1b" (UID: "1df45abb-28ef-44a7-8aed-e2abc29e4c1b"). InnerVolumeSpecName "kube-api-access-cnmvx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.056211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f24dc8-4e44-4bcb-85dc-d4305b95b314-kube-api-access-wvddv" (OuterVolumeSpecName: "kube-api-access-wvddv") pod "21f24dc8-4e44-4bcb-85dc-d4305b95b314" (UID: "21f24dc8-4e44-4bcb-85dc-d4305b95b314"). InnerVolumeSpecName "kube-api-access-wvddv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.056799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd9c065-229c-4597-ac3c-53df4caeb6df-kube-api-access-njkzn" (OuterVolumeSpecName: "kube-api-access-njkzn") pod "bfd9c065-229c-4597-ac3c-53df4caeb6df" (UID: "bfd9c065-229c-4597-ac3c-53df4caeb6df"). InnerVolumeSpecName "kube-api-access-njkzn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154592 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a2167ed6-d838-4905-83fb-082532bb6ccd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154621 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bfd9c065-229c-4597-ac3c-53df4caeb6df-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154630 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154668 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cnmvx\" (UniqueName: \"kubernetes.io/projected/1df45abb-28ef-44a7-8aed-e2abc29e4c1b-kube-api-access-cnmvx\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154682 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bc2t5\" (UniqueName: \"kubernetes.io/projected/a2167ed6-d838-4905-83fb-082532bb6ccd-kube-api-access-bc2t5\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154693 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wvddv\" (UniqueName: \"kubernetes.io/projected/21f24dc8-4e44-4bcb-85dc-d4305b95b314-kube-api-access-wvddv\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.154704 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-njkzn\" (UniqueName: \"kubernetes.io/projected/bfd9c065-229c-4597-ac3c-53df4caeb6df-kube-api-access-njkzn\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.344092 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.344142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr" event={"ID":"bfd9c065-229c-4597-ac3c-53df4caeb6df","Type":"ContainerDied","Data":"69988b2581ddb77750e867375b5b6e0b22414843390aa0236f0b3dfd4d02c555"} Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.344215 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69988b2581ddb77750e867375b5b6e0b22414843390aa0236f0b3dfd4d02c555" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.351203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerStarted","Data":"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c"} Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.351623 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-central-agent" containerID="cri-o://ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" gracePeriod=30 Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.351784 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.352364 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="proxy-httpd" containerID="cri-o://09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" gracePeriod=30 Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.352510 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="sg-core" containerID="cri-o://7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" gracePeriod=30 Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.352634 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-notification-agent" containerID="cri-o://beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" gracePeriod=30 Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.358896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" event={"ID":"a2167ed6-d838-4905-83fb-082532bb6ccd","Type":"ContainerDied","Data":"1550f2b3d8c96517c347ed50e4447d47461404bd2b4b8d06ec8f6cb605cce874"} Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.358933 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1550f2b3d8c96517c347ed50e4447d47461404bd2b4b8d06ec8f6cb605cce874" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.358987 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.364546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" event={"ID":"21f24dc8-4e44-4bcb-85dc-d4305b95b314","Type":"ContainerDied","Data":"c06924a11b86ee7854fe2bc62aa92ef27d9e05daa39ffe7e583a0194929a1803"} Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.364583 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c06924a11b86ee7854fe2bc62aa92ef27d9e05daa39ffe7e583a0194929a1803" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.364641 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-mdx5r" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.377160 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.995278174 podStartE2EDuration="5.377126395s" podCreationTimestamp="2025-11-21 12:56:19 +0000 UTC" firstStartedPulling="2025-11-21 12:56:20.161866428 +0000 UTC m=+3938.862528266" lastFinishedPulling="2025-11-21 12:56:23.543714669 +0000 UTC m=+3942.244376487" observedRunningTime="2025-11-21 12:56:24.372737416 +0000 UTC m=+3943.073399234" watchObservedRunningTime="2025-11-21 12:56:24.377126395 +0000 UTC m=+3943.077788203" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.377869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" event={"ID":"1df45abb-28ef-44a7-8aed-e2abc29e4c1b","Type":"ContainerDied","Data":"1fad750e66058a7abb018b92626249e5f5cb09ee6f31fda91e5c4dcf8908cd70"} Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.377907 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fad750e66058a7abb018b92626249e5f5cb09ee6f31fda91e5c4dcf8908cd70" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.377882 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-k9rvb" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.379860 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.380326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-jqjbl" event={"ID":"6df0c335-4ec7-47b4-8d67-c7b1221a8669","Type":"ContainerDied","Data":"d668ce84c566ba74d32ec1a69c25037c40bc1b86522edf48a53bacc240bdb73e"} Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.380361 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d668ce84c566ba74d32ec1a69c25037c40bc1b86522edf48a53bacc240bdb73e" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.828476 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.872580 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/664d5c8d-12e4-4894-943e-6b411a9888ea-operator-scripts\") pod \"664d5c8d-12e4-4894-943e-6b411a9888ea\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.872731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzw4g\" (UniqueName: \"kubernetes.io/projected/664d5c8d-12e4-4894-943e-6b411a9888ea-kube-api-access-dzw4g\") pod \"664d5c8d-12e4-4894-943e-6b411a9888ea\" (UID: \"664d5c8d-12e4-4894-943e-6b411a9888ea\") " Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.874003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/664d5c8d-12e4-4894-943e-6b411a9888ea-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "664d5c8d-12e4-4894-943e-6b411a9888ea" (UID: "664d5c8d-12e4-4894-943e-6b411a9888ea"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.881276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664d5c8d-12e4-4894-943e-6b411a9888ea-kube-api-access-dzw4g" (OuterVolumeSpecName: "kube-api-access-dzw4g") pod "664d5c8d-12e4-4894-943e-6b411a9888ea" (UID: "664d5c8d-12e4-4894-943e-6b411a9888ea"). InnerVolumeSpecName "kube-api-access-dzw4g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.974818 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dzw4g\" (UniqueName: \"kubernetes.io/projected/664d5c8d-12e4-4894-943e-6b411a9888ea-kube-api-access-dzw4g\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:24 crc kubenswrapper[4769]: I1121 12:56:24.974854 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/664d5c8d-12e4-4894-943e-6b411a9888ea-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.090095 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-combined-ca-bundle\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-scripts\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-sg-core-conf-yaml\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-run-httpd\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-config-data\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-log-httpd\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv9vm\" (UniqueName: \"kubernetes.io/projected/c65ffe7a-5dd0-4add-adff-1524662d122f-kube-api-access-wv9vm\") pod \"c65ffe7a-5dd0-4add-adff-1524662d122f\" (UID: \"c65ffe7a-5dd0-4add-adff-1524662d122f\") " Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.178809 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.181915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65ffe7a-5dd0-4add-adff-1524662d122f-kube-api-access-wv9vm" (OuterVolumeSpecName: "kube-api-access-wv9vm") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "kube-api-access-wv9vm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.183843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.184341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-scripts" (OuterVolumeSpecName: "scripts") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.223322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.280076 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.280110 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.280119 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c65ffe7a-5dd0-4add-adff-1524662d122f-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.280130 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wv9vm\" (UniqueName: \"kubernetes.io/projected/c65ffe7a-5dd0-4add-adff-1524662d122f-kube-api-access-wv9vm\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.280141 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.289287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.301957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-config-data" (OuterVolumeSpecName: "config-data") pod "c65ffe7a-5dd0-4add-adff-1524662d122f" (UID: "c65ffe7a-5dd0-4add-adff-1524662d122f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.381751 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.381783 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65ffe7a-5dd0-4add-adff-1524662d122f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.391424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" event={"ID":"664d5c8d-12e4-4894-943e-6b411a9888ea","Type":"ContainerDied","Data":"dc0dda0f8567faef09fadc5b945433f6492e3a7309ff8477fe95e080f1449e4b"} Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.391463 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc0dda0f8567faef09fadc5b945433f6492e3a7309ff8477fe95e080f1449e4b" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.391438 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395003 4769 generic.go:334] "Generic (PLEG): container finished" podID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" exitCode=0 Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395028 4769 generic.go:334] "Generic (PLEG): container finished" podID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" exitCode=2 Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395037 4769 generic.go:334] "Generic (PLEG): container finished" podID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" exitCode=0 Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395046 4769 generic.go:334] "Generic (PLEG): container finished" podID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" exitCode=0 Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395058 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerDied","Data":"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c"} Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395086 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerDied","Data":"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060"} Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerDied","Data":"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560"} Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerDied","Data":"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0"} Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c65ffe7a-5dd0-4add-adff-1524662d122f","Type":"ContainerDied","Data":"e38426d5286fa43edb21d362f3d137c43d251a3c593ca4dfbc96fc42dbd4dc8f"} Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.395172 4769 scope.go:117] "RemoveContainer" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.413064 4769 scope.go:117] "RemoveContainer" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.423571 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.437196 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.441549 4769 scope.go:117] "RemoveContainer" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.456931 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457305 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="proxy-httpd" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457322 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="proxy-httpd" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457343 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-notification-agent" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457350 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-notification-agent" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457371 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-central-agent" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457377 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-central-agent" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457386 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfd9c065-229c-4597-ac3c-53df4caeb6df" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457392 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd9c065-229c-4597-ac3c-53df4caeb6df" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457400 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6df0c335-4ec7-47b4-8d67-c7b1221a8669" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457408 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df0c335-4ec7-47b4-8d67-c7b1221a8669" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457416 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="664d5c8d-12e4-4894-943e-6b411a9888ea" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457424 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="664d5c8d-12e4-4894-943e-6b411a9888ea" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457440 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a2167ed6-d838-4905-83fb-082532bb6ccd" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457448 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2167ed6-d838-4905-83fb-082532bb6ccd" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457457 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="21f24dc8-4e44-4bcb-85dc-d4305b95b314" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457464 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f24dc8-4e44-4bcb-85dc-d4305b95b314" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457477 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1df45abb-28ef-44a7-8aed-e2abc29e4c1b" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457483 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df45abb-28ef-44a7-8aed-e2abc29e4c1b" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.457491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="sg-core" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457496 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="sg-core" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-notification-agent" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457672 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="ceilometer-central-agent" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457680 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfd9c065-229c-4597-ac3c-53df4caeb6df" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457691 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="664d5c8d-12e4-4894-943e-6b411a9888ea" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457701 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1df45abb-28ef-44a7-8aed-e2abc29e4c1b" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457721 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="sg-core" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457730 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" containerName="proxy-httpd" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457742 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a2167ed6-d838-4905-83fb-082532bb6ccd" containerName="mariadb-account-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457752 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6df0c335-4ec7-47b4-8d67-c7b1221a8669" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.457759 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="21f24dc8-4e44-4bcb-85dc-d4305b95b314" containerName="mariadb-database-create" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.459407 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.462372 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.462623 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.469038 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.478574 4769 scope.go:117] "RemoveContainer" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-run-httpd\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483741 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkl54\" (UniqueName: \"kubernetes.io/projected/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-kube-api-access-pkl54\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-scripts\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-log-httpd\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.483895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-config-data\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.506870 4769 scope.go:117] "RemoveContainer" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.507276 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": container with ID starting with 09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c not found: ID does not exist" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.507331 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c"} err="failed to get container status \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": rpc error: code = NotFound desc = could not find container \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": container with ID starting with 09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.507356 4769 scope.go:117] "RemoveContainer" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.507790 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": container with ID starting with 7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060 not found: ID does not exist" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.507828 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060"} err="failed to get container status \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": rpc error: code = NotFound desc = could not find container \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": container with ID starting with 7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.507855 4769 scope.go:117] "RemoveContainer" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.508397 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": container with ID starting with beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560 not found: ID does not exist" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.508427 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560"} err="failed to get container status \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": rpc error: code = NotFound desc = could not find container \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": container with ID starting with beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.508449 4769 scope.go:117] "RemoveContainer" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" Nov 21 12:56:25 crc kubenswrapper[4769]: E1121 12:56:25.508756 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": container with ID starting with ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0 not found: ID does not exist" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.508779 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0"} err="failed to get container status \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": rpc error: code = NotFound desc = could not find container \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": container with ID starting with ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.508795 4769 scope.go:117] "RemoveContainer" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.508986 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c"} err="failed to get container status \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": rpc error: code = NotFound desc = could not find container \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": container with ID starting with 09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.509009 4769 scope.go:117] "RemoveContainer" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.509317 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060"} err="failed to get container status \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": rpc error: code = NotFound desc = could not find container \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": container with ID starting with 7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.509379 4769 scope.go:117] "RemoveContainer" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.509600 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560"} err="failed to get container status \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": rpc error: code = NotFound desc = could not find container \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": container with ID starting with beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.509621 4769 scope.go:117] "RemoveContainer" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.509988 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0"} err="failed to get container status \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": rpc error: code = NotFound desc = could not find container \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": container with ID starting with ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.510006 4769 scope.go:117] "RemoveContainer" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.510403 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c"} err="failed to get container status \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": rpc error: code = NotFound desc = could not find container \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": container with ID starting with 09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.510422 4769 scope.go:117] "RemoveContainer" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.510722 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060"} err="failed to get container status \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": rpc error: code = NotFound desc = could not find container \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": container with ID starting with 7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.510749 4769 scope.go:117] "RemoveContainer" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.511035 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560"} err="failed to get container status \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": rpc error: code = NotFound desc = could not find container \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": container with ID starting with beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.511054 4769 scope.go:117] "RemoveContainer" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.511263 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0"} err="failed to get container status \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": rpc error: code = NotFound desc = could not find container \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": container with ID starting with ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.511288 4769 scope.go:117] "RemoveContainer" containerID="09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.511844 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c"} err="failed to get container status \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": rpc error: code = NotFound desc = could not find container \"09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c\": container with ID starting with 09f3b7e0fc4888b966c5707c485881eb5a83e3822352c05cd5b425432cfce74c not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.511867 4769 scope.go:117] "RemoveContainer" containerID="7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.512574 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060"} err="failed to get container status \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": rpc error: code = NotFound desc = could not find container \"7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060\": container with ID starting with 7cd41efe800ab7cdfd0d59039ee0e5327da8e30226efc8af1d9520b3ad440060 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.512629 4769 scope.go:117] "RemoveContainer" containerID="beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.512929 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560"} err="failed to get container status \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": rpc error: code = NotFound desc = could not find container \"beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560\": container with ID starting with beaef919c3cbe5e2e055e19483dbe5ec75c68d385a63d425c13c55e911e98560 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.512951 4769 scope.go:117] "RemoveContainer" containerID="ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.513184 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0"} err="failed to get container status \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": rpc error: code = NotFound desc = could not find container \"ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0\": container with ID starting with ffb71b4241ed9bf869d0a1ca80e4f0a3aea2ddcf4014158cf19f0a6b793c81f0 not found: ID does not exist" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.585945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pkl54\" (UniqueName: \"kubernetes.io/projected/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-kube-api-access-pkl54\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.585999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-scripts\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-log-httpd\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-config-data\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586308 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-run-httpd\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-log-httpd\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.586876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-run-httpd\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.590219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-scripts\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.590613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.590726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.591177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-config-data\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.607060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkl54\" (UniqueName: \"kubernetes.io/projected/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-kube-api-access-pkl54\") pod \"ceilometer-0\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:25 crc kubenswrapper[4769]: I1121 12:56:25.784193 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.127321 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf"] Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.128678 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.130630 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.131153 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-56w8n" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.131177 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.149438 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf"] Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.194340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-config-data\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.194429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.194497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-scripts\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.194527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvhfv\" (UniqueName: \"kubernetes.io/projected/dcee01e0-4947-4f89-8958-ebb9873c87f1-kube-api-access-wvhfv\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.239125 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.295676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-config-data\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.295774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.295832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-scripts\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.295934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvhfv\" (UniqueName: \"kubernetes.io/projected/dcee01e0-4947-4f89-8958-ebb9873c87f1-kube-api-access-wvhfv\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.301098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-scripts\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.301505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.303107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-config-data\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.310438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvhfv\" (UniqueName: \"kubernetes.io/projected/dcee01e0-4947-4f89-8958-ebb9873c87f1-kube-api-access-wvhfv\") pod \"nova-cell0-conductor-db-sync-jwctf\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.410331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerStarted","Data":"2c76d2460a4b0aa0b50057e834ba20e78ffd1ad96ddab9edd2b90ead837986c5"} Nov 21 12:56:26 crc kubenswrapper[4769]: I1121 12:56:26.446135 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:26.735697 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:26.982715 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf"] Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.289596 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65ffe7a-5dd0-4add-adff-1524662d122f" path="/var/lib/kubelet/pods/c65ffe7a-5dd0-4add-adff-1524662d122f/volumes" Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.302656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.303946 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.429909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerStarted","Data":"10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef"} Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.432723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" event={"ID":"dcee01e0-4947-4f89-8958-ebb9873c87f1","Type":"ContainerStarted","Data":"55c1d62b8b284d53ae533a8ff5c21ba8e49af1df3170b3a22f56fbcb00754192"} Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.432754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" event={"ID":"dcee01e0-4947-4f89-8958-ebb9873c87f1","Type":"ContainerStarted","Data":"e485fe393f64a52bdc4fc8c5aa0e71e5d7f5a3194dbe04ac67f2598e1f8ea96b"} Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.449129 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" podStartSLOduration=1.44911466 podStartE2EDuration="1.44911466s" podCreationTimestamp="2025-11-21 12:56:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:27.44427615 +0000 UTC m=+3946.144937978" watchObservedRunningTime="2025-11-21 12:56:27.44911466 +0000 UTC m=+3946.149776478" Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.865840 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.866296 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-log" containerID="cri-o://8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d" gracePeriod=30 Nov 21 12:56:27 crc kubenswrapper[4769]: I1121 12:56:27.866389 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-httpd" containerID="cri-o://361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199" gracePeriod=30 Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.446358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerStarted","Data":"7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043"} Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.446707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerStarted","Data":"5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4"} Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.449015 4769 generic.go:334] "Generic (PLEG): container finished" podID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerID="8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d" exitCode=143 Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.449109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f977b109-5630-4e79-a74e-91e0a06cab0b","Type":"ContainerDied","Data":"8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d"} Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.773555 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.773794 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-log" containerID="cri-o://ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869" gracePeriod=30 Nov 21 12:56:28 crc kubenswrapper[4769]: I1121 12:56:28.773936 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-httpd" containerID="cri-o://53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5" gracePeriod=30 Nov 21 12:56:29 crc kubenswrapper[4769]: I1121 12:56:29.460490 4769 generic.go:334] "Generic (PLEG): container finished" podID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerID="ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869" exitCode=143 Nov 21 12:56:29 crc kubenswrapper[4769]: I1121 12:56:29.460546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4","Type":"ContainerDied","Data":"ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869"} Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.219586 4769 scope.go:117] "RemoveContainer" containerID="5f12e98b420fd8e7477dfc4fad1219f4ad0cbc314ceac732235637f1ea97730e" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.260364 4769 scope.go:117] "RemoveContainer" containerID="0fb56b386db294ec7923b59452273e29b10e760c042f1517b01540a6fa6e3d8d" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.310356 4769 scope.go:117] "RemoveContainer" containerID="ab130fcfe45ea91d21b37e21fa6d550c65960ce37adba2920d40b200027481b6" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.335451 4769 scope.go:117] "RemoveContainer" containerID="c4de56e28cd44ecb2bdb76585cd221feb54425c53947e8de3afe782a1a09d445" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.356458 4769 scope.go:117] "RemoveContainer" containerID="90d823ccf096d44fcd1d92e7007a34f8c95038430879673015a1a3c004c36038" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.377785 4769 scope.go:117] "RemoveContainer" containerID="284da0eb346dede0f830af4e8869ce60bff7ae98f60c261427997c925e5b4f92" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.396011 4769 scope.go:117] "RemoveContainer" containerID="1c7466aaba0b1515eee89c624912ec456062cdb9909b35273bb7fa0c1c12cdd9" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.496459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerStarted","Data":"7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503"} Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.496551 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-central-agent" containerID="cri-o://10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef" gracePeriod=30 Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.496604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.496582 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="proxy-httpd" containerID="cri-o://7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503" gracePeriod=30 Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.496646 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="sg-core" containerID="cri-o://7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043" gracePeriod=30 Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.496665 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-notification-agent" containerID="cri-o://5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4" gracePeriod=30 Nov 21 12:56:30 crc kubenswrapper[4769]: I1121 12:56:30.521490 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.104284894 podStartE2EDuration="5.521467686s" podCreationTimestamp="2025-11-21 12:56:25 +0000 UTC" firstStartedPulling="2025-11-21 12:56:26.250844259 +0000 UTC m=+3944.951506077" lastFinishedPulling="2025-11-21 12:56:29.668027041 +0000 UTC m=+3948.368688869" observedRunningTime="2025-11-21 12:56:30.514374595 +0000 UTC m=+3949.215036423" watchObservedRunningTime="2025-11-21 12:56:30.521467686 +0000 UTC m=+3949.222129504" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.432039 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.528660 4769 generic.go:334] "Generic (PLEG): container finished" podID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerID="361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199" exitCode=0 Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.528703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f977b109-5630-4e79-a74e-91e0a06cab0b","Type":"ContainerDied","Data":"361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199"} Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.528715 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.528756 4769 scope.go:117] "RemoveContainer" containerID="361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.528743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f977b109-5630-4e79-a74e-91e0a06cab0b","Type":"ContainerDied","Data":"1f55c17ca8ce772fddcee25516342967fb7e60eac8bb46ff8967a9629718c5c3"} Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.531628 4769 generic.go:334] "Generic (PLEG): container finished" podID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerID="7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503" exitCode=0 Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.531665 4769 generic.go:334] "Generic (PLEG): container finished" podID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerID="7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043" exitCode=2 Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.531675 4769 generic.go:334] "Generic (PLEG): container finished" podID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerID="5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4" exitCode=0 Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.531692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerDied","Data":"7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503"} Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.531725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerDied","Data":"7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043"} Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.531736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerDied","Data":"5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4"} Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.551510 4769 scope.go:117] "RemoveContainer" containerID="8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.572725 4769 scope.go:117] "RemoveContainer" containerID="361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199" Nov 21 12:56:31 crc kubenswrapper[4769]: E1121 12:56:31.573275 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199\": container with ID starting with 361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199 not found: ID does not exist" containerID="361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.573320 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199"} err="failed to get container status \"361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199\": rpc error: code = NotFound desc = could not find container \"361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199\": container with ID starting with 361d2d1b7fb7918c2cc57a780cab942b2b4af85dfc934f72d55a39e6fabd5199 not found: ID does not exist" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.573349 4769 scope.go:117] "RemoveContainer" containerID="8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d" Nov 21 12:56:31 crc kubenswrapper[4769]: E1121 12:56:31.573682 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d\": container with ID starting with 8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d not found: ID does not exist" containerID="8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.573733 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d"} err="failed to get container status \"8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d\": rpc error: code = NotFound desc = could not find container \"8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d\": container with ID starting with 8b7a71f3135e66b44e73d5f4bd1b1edb43c09e73a1f97222c03821f4d51d784d not found: ID does not exist" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.590634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-config-data\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.590724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mr8m\" (UniqueName: \"kubernetes.io/projected/f977b109-5630-4e79-a74e-91e0a06cab0b-kube-api-access-5mr8m\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.590810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-combined-ca-bundle\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.590869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-scripts\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.590958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-logs\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.591056 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-httpd-run\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.591126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"f977b109-5630-4e79-a74e-91e0a06cab0b\" (UID: \"f977b109-5630-4e79-a74e-91e0a06cab0b\") " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.591572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-logs" (OuterVolumeSpecName: "logs") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.591782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.596883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f977b109-5630-4e79-a74e-91e0a06cab0b-kube-api-access-5mr8m" (OuterVolumeSpecName: "kube-api-access-5mr8m") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "kube-api-access-5mr8m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.597410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-scripts" (OuterVolumeSpecName: "scripts") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.597493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.625275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.650152 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-config-data" (OuterVolumeSpecName: "config-data") pod "f977b109-5630-4e79-a74e-91e0a06cab0b" (UID: "f977b109-5630-4e79-a74e-91e0a06cab0b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.693792 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.694119 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5mr8m\" (UniqueName: \"kubernetes.io/projected/f977b109-5630-4e79-a74e-91e0a06cab0b-kube-api-access-5mr8m\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.694131 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.694140 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f977b109-5630-4e79-a74e-91e0a06cab0b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.694149 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.694159 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f977b109-5630-4e79-a74e-91e0a06cab0b-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.694193 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.716971 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.795334 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.859530 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.867820 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.880388 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:56:31 crc kubenswrapper[4769]: E1121 12:56:31.880760 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-log" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.880777 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-log" Nov 21 12:56:31 crc kubenswrapper[4769]: E1121 12:56:31.880805 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-httpd" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.880815 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-httpd" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.881004 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-httpd" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.881025 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" containerName="glance-log" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.882161 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.883819 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:56:31 crc kubenswrapper[4769]: I1121 12:56:31.893912 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-scripts\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-config-data\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62qhq\" (UniqueName: \"kubernetes.io/projected/83541dda-7a5e-4390-beba-4fa7bc472a8d-kube-api-access-62qhq\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-logs\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998476 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:31.998578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-scripts\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-config-data\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-62qhq\" (UniqueName: \"kubernetes.io/projected/83541dda-7a5e-4390-beba-4fa7bc472a8d-kube-api-access-62qhq\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-logs\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.100831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.101018 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.101488 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-logs\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.104271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.105813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-config-data\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.106534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-scripts\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.135008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.139148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-62qhq\" (UniqueName: \"kubernetes.io/projected/83541dda-7a5e-4390-beba-4fa7bc472a8d-kube-api-access-62qhq\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.176091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.217563 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.273838 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:56:32 crc kubenswrapper[4769]: E1121 12:56:32.274274 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.330860 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421559 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-logs\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-httpd-run\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqsz8\" (UniqueName: \"kubernetes.io/projected/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-kube-api-access-tqsz8\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-config-data\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-combined-ca-bundle\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-scripts\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.421931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\" (UID: \"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4\") " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.423700 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-logs" (OuterVolumeSpecName: "logs") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.423931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.429322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.429424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-kube-api-access-tqsz8" (OuterVolumeSpecName: "kube-api-access-tqsz8") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "kube-api-access-tqsz8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.429511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-scripts" (OuterVolumeSpecName: "scripts") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.464192 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.478715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-config-data" (OuterVolumeSpecName: "config-data") pod "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" (UID: "7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524111 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524144 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524155 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tqsz8\" (UniqueName: \"kubernetes.io/projected/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-kube-api-access-tqsz8\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524167 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524177 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524188 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.524229 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.542985 4769 generic.go:334] "Generic (PLEG): container finished" podID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerID="53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5" exitCode=0 Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.543035 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.543041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4","Type":"ContainerDied","Data":"53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5"} Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.543085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4","Type":"ContainerDied","Data":"9f4320e27e29ed8192f5bc7974c6ce0af565b7b6898ac37edccea26192bf96a5"} Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.543595 4769 scope.go:117] "RemoveContainer" containerID="53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.544236 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.571410 4769 scope.go:117] "RemoveContainer" containerID="ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.584770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.606572 4769 scope.go:117] "RemoveContainer" containerID="53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5" Nov 21 12:56:32 crc kubenswrapper[4769]: E1121 12:56:32.607018 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5\": container with ID starting with 53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5 not found: ID does not exist" containerID="53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.607050 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5"} err="failed to get container status \"53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5\": rpc error: code = NotFound desc = could not find container \"53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5\": container with ID starting with 53d1bda17ffed8639bbd3b2b65b09a29e47f420fc30c760a0594ee61a43db1e5 not found: ID does not exist" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.607069 4769 scope.go:117] "RemoveContainer" containerID="ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869" Nov 21 12:56:32 crc kubenswrapper[4769]: E1121 12:56:32.607335 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869\": container with ID starting with ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869 not found: ID does not exist" containerID="ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.607365 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869"} err="failed to get container status \"ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869\": rpc error: code = NotFound desc = could not find container \"ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869\": container with ID starting with ae9abcfe2a80ee2b30a538893530a2c1c738e75806d3ea3433c2a89c15e27869 not found: ID does not exist" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.611830 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.618880 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:56:32 crc kubenswrapper[4769]: E1121 12:56:32.619352 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-httpd" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.619368 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-httpd" Nov 21 12:56:32 crc kubenswrapper[4769]: E1121 12:56:32.619391 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-log" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.619400 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-log" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.619637 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-log" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.619681 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" containerName="glance-httpd" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.621012 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.623037 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.627094 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.627768 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.696789 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:56:32 crc kubenswrapper[4769]: W1121 12:56:32.702270 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83541dda_7a5e_4390_beba_4fa7bc472a8d.slice/crio-d1bcaa1a2ebce1a4066913bf9aeabe77a12d4e71d3b6e1fbd3230b31b275823a WatchSource:0}: Error finding container d1bcaa1a2ebce1a4066913bf9aeabe77a12d4e71d3b6e1fbd3230b31b275823a: Status 404 returned error can't find the container with id d1bcaa1a2ebce1a4066913bf9aeabe77a12d4e71d3b6e1fbd3230b31b275823a Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.728828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.728916 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-logs\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.728970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.729001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.729044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.729119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfd2g\" (UniqueName: \"kubernetes.io/projected/c8dd19be-92f0-4348-9515-f5a8654256f7-kube-api-access-wfd2g\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.729206 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-logs\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830433 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wfd2g\" (UniqueName: \"kubernetes.io/projected/c8dd19be-92f0-4348-9515-f5a8654256f7-kube-api-access-wfd2g\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.830773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.831107 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.836436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-logs\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.836899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.841991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.842845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-config-data\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.848626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-scripts\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.856588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfd2g\" (UniqueName: \"kubernetes.io/projected/c8dd19be-92f0-4348-9515-f5a8654256f7-kube-api-access-wfd2g\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.866777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:32 crc kubenswrapper[4769]: I1121 12:56:32.946501 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:33 crc kubenswrapper[4769]: I1121 12:56:33.285129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4" path="/var/lib/kubelet/pods/7a8722ea-6ace-4e78-8e62-6e3a0d09d6c4/volumes" Nov 21 12:56:33 crc kubenswrapper[4769]: I1121 12:56:33.286777 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f977b109-5630-4e79-a74e-91e0a06cab0b" path="/var/lib/kubelet/pods/f977b109-5630-4e79-a74e-91e0a06cab0b/volumes" Nov 21 12:56:33 crc kubenswrapper[4769]: I1121 12:56:33.447820 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:56:33 crc kubenswrapper[4769]: I1121 12:56:33.563343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c8dd19be-92f0-4348-9515-f5a8654256f7","Type":"ContainerStarted","Data":"c330da28611db2069d4893241d925fac73efdddb6d73f5da94f2b763f05f941c"} Nov 21 12:56:33 crc kubenswrapper[4769]: I1121 12:56:33.566847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83541dda-7a5e-4390-beba-4fa7bc472a8d","Type":"ContainerStarted","Data":"57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62"} Nov 21 12:56:33 crc kubenswrapper[4769]: I1121 12:56:33.566892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83541dda-7a5e-4390-beba-4fa7bc472a8d","Type":"ContainerStarted","Data":"d1bcaa1a2ebce1a4066913bf9aeabe77a12d4e71d3b6e1fbd3230b31b275823a"} Nov 21 12:56:34 crc kubenswrapper[4769]: I1121 12:56:34.578250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83541dda-7a5e-4390-beba-4fa7bc472a8d","Type":"ContainerStarted","Data":"c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168"} Nov 21 12:56:34 crc kubenswrapper[4769]: I1121 12:56:34.580575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c8dd19be-92f0-4348-9515-f5a8654256f7","Type":"ContainerStarted","Data":"fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d"} Nov 21 12:56:34 crc kubenswrapper[4769]: I1121 12:56:34.580596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c8dd19be-92f0-4348-9515-f5a8654256f7","Type":"ContainerStarted","Data":"09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985"} Nov 21 12:56:34 crc kubenswrapper[4769]: I1121 12:56:34.607870 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.6078553810000002 podStartE2EDuration="3.607855381s" podCreationTimestamp="2025-11-21 12:56:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:34.600072052 +0000 UTC m=+3953.300733870" watchObservedRunningTime="2025-11-21 12:56:34.607855381 +0000 UTC m=+3953.308517199" Nov 21 12:56:34 crc kubenswrapper[4769]: I1121 12:56:34.620804 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=2.62078997 podStartE2EDuration="2.62078997s" podCreationTimestamp="2025-11-21 12:56:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:34.617379938 +0000 UTC m=+3953.318041746" watchObservedRunningTime="2025-11-21 12:56:34.62078997 +0000 UTC m=+3953.321451788" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.602211 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.621596 4769 generic.go:334] "Generic (PLEG): container finished" podID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerID="10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef" exitCode=0 Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.621643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerDied","Data":"10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef"} Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.621687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e","Type":"ContainerDied","Data":"2c76d2460a4b0aa0b50057e834ba20e78ffd1ad96ddab9edd2b90ead837986c5"} Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.621646 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.621710 4769 scope.go:117] "RemoveContainer" containerID="7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.661995 4769 scope.go:117] "RemoveContainer" containerID="7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.693845 4769 scope.go:117] "RemoveContainer" containerID="5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.713188 4769 scope.go:117] "RemoveContainer" containerID="10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.726689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-combined-ca-bundle\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.726766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-config-data\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.726808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkl54\" (UniqueName: \"kubernetes.io/projected/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-kube-api-access-pkl54\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.726876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-run-httpd\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.726962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-log-httpd\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.727002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-scripts\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.727031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-sg-core-conf-yaml\") pod \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\" (UID: \"9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e\") " Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.727540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.727668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.737379 4769 scope.go:117] "RemoveContainer" containerID="7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.740482 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503\": container with ID starting with 7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503 not found: ID does not exist" containerID="7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.740554 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503"} err="failed to get container status \"7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503\": rpc error: code = NotFound desc = could not find container \"7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503\": container with ID starting with 7d67a9165584e2822410b201c6925ed66d6827920f42d0299daed2e149783503 not found: ID does not exist" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.740597 4769 scope.go:117] "RemoveContainer" containerID="7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.741038 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043\": container with ID starting with 7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043 not found: ID does not exist" containerID="7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.741085 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043"} err="failed to get container status \"7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043\": rpc error: code = NotFound desc = could not find container \"7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043\": container with ID starting with 7af9478cf2f478dc364ee1fdd79ecbd11f86fc0371b380280540e491ced05043 not found: ID does not exist" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.741118 4769 scope.go:117] "RemoveContainer" containerID="5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.741427 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4\": container with ID starting with 5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4 not found: ID does not exist" containerID="5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.741460 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4"} err="failed to get container status \"5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4\": rpc error: code = NotFound desc = could not find container \"5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4\": container with ID starting with 5bf9b21f191ad0508b0c5fb9970adc14ea53327f6431b9e3a4a7e53e9c2a10d4 not found: ID does not exist" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.741478 4769 scope.go:117] "RemoveContainer" containerID="10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.741795 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef\": container with ID starting with 10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef not found: ID does not exist" containerID="10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.741839 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef"} err="failed to get container status \"10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef\": rpc error: code = NotFound desc = could not find container \"10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef\": container with ID starting with 10928930ba846a5b9e131950d896dc3dac56743f414fa46b038c75464bf9eaef not found: ID does not exist" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.743429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-kube-api-access-pkl54" (OuterVolumeSpecName: "kube-api-access-pkl54") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "kube-api-access-pkl54". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.745024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-scripts" (OuterVolumeSpecName: "scripts") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.762606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.806850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.829403 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.829440 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pkl54\" (UniqueName: \"kubernetes.io/projected/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-kube-api-access-pkl54\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.829453 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.829461 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.829470 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.829479 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.846865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-config-data" (OuterVolumeSpecName: "config-data") pod "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" (UID: "9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.931631 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.970690 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.979899 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.998258 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.999057 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="sg-core" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="sg-core" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.999120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-central-agent" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999128 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-central-agent" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.999186 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-notification-agent" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999205 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-notification-agent" Nov 21 12:56:37 crc kubenswrapper[4769]: E1121 12:56:37.999224 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="proxy-httpd" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999230 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="proxy-httpd" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999575 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-central-agent" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999625 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="sg-core" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999650 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="ceilometer-notification-agent" Nov 21 12:56:37 crc kubenswrapper[4769]: I1121 12:56:37.999664 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" containerName="proxy-httpd" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.003691 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.008770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.010264 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.011471 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.134703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.134783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-config-data\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.134955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hk9h\" (UniqueName: \"kubernetes.io/projected/cae13457-503f-4464-88f7-0f662542c7ea-kube-api-access-8hk9h\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.135018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-scripts\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.135067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-run-httpd\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.135146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.135340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-log-httpd\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.237342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.237424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-config-data\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.237469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8hk9h\" (UniqueName: \"kubernetes.io/projected/cae13457-503f-4464-88f7-0f662542c7ea-kube-api-access-8hk9h\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.237497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-scripts\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.237520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-run-httpd\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.238257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.238285 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-log-httpd\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.238755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-run-httpd\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.239032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-log-httpd\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.244466 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.246983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.247769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-scripts\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.249071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-config-data\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.267170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hk9h\" (UniqueName: \"kubernetes.io/projected/cae13457-503f-4464-88f7-0f662542c7ea-kube-api-access-8hk9h\") pod \"ceilometer-0\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.334602 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.640061 4769 generic.go:334] "Generic (PLEG): container finished" podID="dcee01e0-4947-4f89-8958-ebb9873c87f1" containerID="55c1d62b8b284d53ae533a8ff5c21ba8e49af1df3170b3a22f56fbcb00754192" exitCode=0 Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.640160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" event={"ID":"dcee01e0-4947-4f89-8958-ebb9873c87f1","Type":"ContainerDied","Data":"55c1d62b8b284d53ae533a8ff5c21ba8e49af1df3170b3a22f56fbcb00754192"} Nov 21 12:56:38 crc kubenswrapper[4769]: I1121 12:56:38.860307 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:39 crc kubenswrapper[4769]: I1121 12:56:39.302416 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e" path="/var/lib/kubelet/pods/9511ec18-f0c5-4d0b-9f03-b0ebdcb1774e/volumes" Nov 21 12:56:39 crc kubenswrapper[4769]: I1121 12:56:39.650095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerStarted","Data":"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b"} Nov 21 12:56:39 crc kubenswrapper[4769]: I1121 12:56:39.650140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerStarted","Data":"0e341f3f7bebfee1ee0e8dd4185583fcca74b2fe2d484f8be10c2f47290a0a26"} Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.014678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.077830 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-combined-ca-bundle\") pod \"dcee01e0-4947-4f89-8958-ebb9873c87f1\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.077905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-scripts\") pod \"dcee01e0-4947-4f89-8958-ebb9873c87f1\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.078022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-config-data\") pod \"dcee01e0-4947-4f89-8958-ebb9873c87f1\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.078054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvhfv\" (UniqueName: \"kubernetes.io/projected/dcee01e0-4947-4f89-8958-ebb9873c87f1-kube-api-access-wvhfv\") pod \"dcee01e0-4947-4f89-8958-ebb9873c87f1\" (UID: \"dcee01e0-4947-4f89-8958-ebb9873c87f1\") " Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.082853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-scripts" (OuterVolumeSpecName: "scripts") pod "dcee01e0-4947-4f89-8958-ebb9873c87f1" (UID: "dcee01e0-4947-4f89-8958-ebb9873c87f1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.084232 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcee01e0-4947-4f89-8958-ebb9873c87f1-kube-api-access-wvhfv" (OuterVolumeSpecName: "kube-api-access-wvhfv") pod "dcee01e0-4947-4f89-8958-ebb9873c87f1" (UID: "dcee01e0-4947-4f89-8958-ebb9873c87f1"). InnerVolumeSpecName "kube-api-access-wvhfv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.107121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-config-data" (OuterVolumeSpecName: "config-data") pod "dcee01e0-4947-4f89-8958-ebb9873c87f1" (UID: "dcee01e0-4947-4f89-8958-ebb9873c87f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.109429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcee01e0-4947-4f89-8958-ebb9873c87f1" (UID: "dcee01e0-4947-4f89-8958-ebb9873c87f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.181048 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.181142 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wvhfv\" (UniqueName: \"kubernetes.io/projected/dcee01e0-4947-4f89-8958-ebb9873c87f1-kube-api-access-wvhfv\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.181166 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.181224 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcee01e0-4947-4f89-8958-ebb9873c87f1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.669083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerStarted","Data":"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa"} Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.671159 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" event={"ID":"dcee01e0-4947-4f89-8958-ebb9873c87f1","Type":"ContainerDied","Data":"e485fe393f64a52bdc4fc8c5aa0e71e5d7f5a3194dbe04ac67f2598e1f8ea96b"} Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.671187 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e485fe393f64a52bdc4fc8c5aa0e71e5d7f5a3194dbe04ac67f2598e1f8ea96b" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.671282 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.742277 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:40 crc kubenswrapper[4769]: E1121 12:56:40.742651 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dcee01e0-4947-4f89-8958-ebb9873c87f1" containerName="nova-cell0-conductor-db-sync" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.742667 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcee01e0-4947-4f89-8958-ebb9873c87f1" containerName="nova-cell0-conductor-db-sync" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.742836 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dcee01e0-4947-4f89-8958-ebb9873c87f1" containerName="nova-cell0-conductor-db-sync" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.746390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.748568 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-56w8n" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.748853 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.767039 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.893156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.893242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb5wd\" (UniqueName: \"kubernetes.io/projected/254db443-35de-49a2-82bf-4c1f4fff72dc-kube-api-access-pb5wd\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.893311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.995100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pb5wd\" (UniqueName: \"kubernetes.io/projected/254db443-35de-49a2-82bf-4c1f4fff72dc-kube-api-access-pb5wd\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.995503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.995580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:40 crc kubenswrapper[4769]: I1121 12:56:40.998285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:41 crc kubenswrapper[4769]: I1121 12:56:41.000639 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:41 crc kubenswrapper[4769]: I1121 12:56:41.013576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb5wd\" (UniqueName: \"kubernetes.io/projected/254db443-35de-49a2-82bf-4c1f4fff72dc-kube-api-access-pb5wd\") pod \"nova-cell0-conductor-0\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:41 crc kubenswrapper[4769]: I1121 12:56:41.064518 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:41 crc kubenswrapper[4769]: I1121 12:56:41.515178 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:41 crc kubenswrapper[4769]: W1121 12:56:41.524924 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod254db443_35de_49a2_82bf_4c1f4fff72dc.slice/crio-796362ff0bff47735d402cb5ed62746832fb1ba0167477f6cdb47ebb3617ca21 WatchSource:0}: Error finding container 796362ff0bff47735d402cb5ed62746832fb1ba0167477f6cdb47ebb3617ca21: Status 404 returned error can't find the container with id 796362ff0bff47735d402cb5ed62746832fb1ba0167477f6cdb47ebb3617ca21 Nov 21 12:56:41 crc kubenswrapper[4769]: I1121 12:56:41.696841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerStarted","Data":"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4"} Nov 21 12:56:41 crc kubenswrapper[4769]: I1121 12:56:41.699951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"254db443-35de-49a2-82bf-4c1f4fff72dc","Type":"ContainerStarted","Data":"796362ff0bff47735d402cb5ed62746832fb1ba0167477f6cdb47ebb3617ca21"} Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.219127 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.219443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.257680 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.291746 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.715226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerStarted","Data":"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b"} Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.715588 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.717529 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"254db443-35de-49a2-82bf-4c1f4fff72dc","Type":"ContainerStarted","Data":"3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea"} Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.717960 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.717994 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.741242 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.577193398 podStartE2EDuration="5.741222002s" podCreationTimestamp="2025-11-21 12:56:37 +0000 UTC" firstStartedPulling="2025-11-21 12:56:38.867668768 +0000 UTC m=+3957.568330576" lastFinishedPulling="2025-11-21 12:56:42.031697362 +0000 UTC m=+3960.732359180" observedRunningTime="2025-11-21 12:56:42.734511291 +0000 UTC m=+3961.435173119" watchObservedRunningTime="2025-11-21 12:56:42.741222002 +0000 UTC m=+3961.441883820" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.779600 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.779572144 podStartE2EDuration="2.779572144s" podCreationTimestamp="2025-11-21 12:56:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:42.758435685 +0000 UTC m=+3961.459097513" watchObservedRunningTime="2025-11-21 12:56:42.779572144 +0000 UTC m=+3961.480233992" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.947903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.947983 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:42 crc kubenswrapper[4769]: I1121 12:56:42.998942 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:43 crc kubenswrapper[4769]: I1121 12:56:43.003636 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:43 crc kubenswrapper[4769]: I1121 12:56:43.730114 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:43 crc kubenswrapper[4769]: I1121 12:56:43.734422 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:43 crc kubenswrapper[4769]: I1121 12:56:43.734469 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:44 crc kubenswrapper[4769]: I1121 12:56:44.466981 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:44 crc kubenswrapper[4769]: I1121 12:56:44.562961 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:56:45 crc kubenswrapper[4769]: I1121 12:56:45.273909 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:56:45 crc kubenswrapper[4769]: E1121 12:56:45.274219 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:56:45 crc kubenswrapper[4769]: I1121 12:56:45.518166 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:45 crc kubenswrapper[4769]: I1121 12:56:45.532880 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:45 crc kubenswrapper[4769]: I1121 12:56:45.726524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:56:45 crc kubenswrapper[4769]: I1121 12:56:45.750772 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="254db443-35de-49a2-82bf-4c1f4fff72dc" containerName="nova-cell0-conductor-conductor" containerID="cri-o://3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" gracePeriod=30 Nov 21 12:56:46 crc kubenswrapper[4769]: E1121 12:56:46.066604 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:56:46 crc kubenswrapper[4769]: E1121 12:56:46.068014 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:56:46 crc kubenswrapper[4769]: E1121 12:56:46.069305 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:56:46 crc kubenswrapper[4769]: E1121 12:56:46.069338 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="254db443-35de-49a2-82bf-4c1f4fff72dc" containerName="nova-cell0-conductor-conductor" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.241956 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.427831 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb5wd\" (UniqueName: \"kubernetes.io/projected/254db443-35de-49a2-82bf-4c1f4fff72dc-kube-api-access-pb5wd\") pod \"254db443-35de-49a2-82bf-4c1f4fff72dc\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.428273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-combined-ca-bundle\") pod \"254db443-35de-49a2-82bf-4c1f4fff72dc\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.428379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-config-data\") pod \"254db443-35de-49a2-82bf-4c1f4fff72dc\" (UID: \"254db443-35de-49a2-82bf-4c1f4fff72dc\") " Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.434730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254db443-35de-49a2-82bf-4c1f4fff72dc-kube-api-access-pb5wd" (OuterVolumeSpecName: "kube-api-access-pb5wd") pod "254db443-35de-49a2-82bf-4c1f4fff72dc" (UID: "254db443-35de-49a2-82bf-4c1f4fff72dc"). InnerVolumeSpecName "kube-api-access-pb5wd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.456913 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "254db443-35de-49a2-82bf-4c1f4fff72dc" (UID: "254db443-35de-49a2-82bf-4c1f4fff72dc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.470292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-config-data" (OuterVolumeSpecName: "config-data") pod "254db443-35de-49a2-82bf-4c1f4fff72dc" (UID: "254db443-35de-49a2-82bf-4c1f4fff72dc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.530375 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pb5wd\" (UniqueName: \"kubernetes.io/projected/254db443-35de-49a2-82bf-4c1f4fff72dc-kube-api-access-pb5wd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.530410 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.530420 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/254db443-35de-49a2-82bf-4c1f4fff72dc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.590810 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.591283 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="sg-core" containerID="cri-o://94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4" gracePeriod=30 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.591328 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="proxy-httpd" containerID="cri-o://315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b" gracePeriod=30 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.591364 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-notification-agent" containerID="cri-o://519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa" gracePeriod=30 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.591811 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-central-agent" containerID="cri-o://e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b" gracePeriod=30 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.772165 4769 generic.go:334] "Generic (PLEG): container finished" podID="254db443-35de-49a2-82bf-4c1f4fff72dc" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" exitCode=0 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.772235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"254db443-35de-49a2-82bf-4c1f4fff72dc","Type":"ContainerDied","Data":"3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea"} Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.772303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"254db443-35de-49a2-82bf-4c1f4fff72dc","Type":"ContainerDied","Data":"796362ff0bff47735d402cb5ed62746832fb1ba0167477f6cdb47ebb3617ca21"} Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.772250 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.772324 4769 scope.go:117] "RemoveContainer" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.775522 4769 generic.go:334] "Generic (PLEG): container finished" podID="cae13457-503f-4464-88f7-0f662542c7ea" containerID="315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b" exitCode=0 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.775543 4769 generic.go:334] "Generic (PLEG): container finished" podID="cae13457-503f-4464-88f7-0f662542c7ea" containerID="94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4" exitCode=2 Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.775561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerDied","Data":"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b"} Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.775583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerDied","Data":"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4"} Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.795868 4769 scope.go:117] "RemoveContainer" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" Nov 21 12:56:47 crc kubenswrapper[4769]: E1121 12:56:47.796639 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea\": container with ID starting with 3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea not found: ID does not exist" containerID="3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.796704 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea"} err="failed to get container status \"3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea\": rpc error: code = NotFound desc = could not find container \"3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea\": container with ID starting with 3e163fa275908b5a17ae80ea5fce8b61117b64b1d0398c6c1f3caa59abce96ea not found: ID does not exist" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.813854 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.821105 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.838417 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:47 crc kubenswrapper[4769]: E1121 12:56:47.838808 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="254db443-35de-49a2-82bf-4c1f4fff72dc" containerName="nova-cell0-conductor-conductor" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.838824 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="254db443-35de-49a2-82bf-4c1f4fff72dc" containerName="nova-cell0-conductor-conductor" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.839013 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="254db443-35de-49a2-82bf-4c1f4fff72dc" containerName="nova-cell0-conductor-conductor" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.839649 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.841824 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-56w8n" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.842221 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.850586 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.939365 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knjkx\" (UniqueName: \"kubernetes.io/projected/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-kube-api-access-knjkx\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.939431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:47 crc kubenswrapper[4769]: I1121 12:56:47.939483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.040555 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-knjkx\" (UniqueName: \"kubernetes.io/projected/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-kube-api-access-knjkx\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.040605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.040658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.045346 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.047685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.060509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-knjkx\" (UniqueName: \"kubernetes.io/projected/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-kube-api-access-knjkx\") pod \"nova-cell0-conductor-0\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.155957 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.590114 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.707728 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:56:48 crc kubenswrapper[4769]: W1121 12:56:48.719794 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4ef9eb_ffdd_4eb6_8726_4ebee296f251.slice/crio-6cb957df34b81ceb4f63354d7be8fe06917c8e01aad1b2d6538bfaaa3f7934f9 WatchSource:0}: Error finding container 6cb957df34b81ceb4f63354d7be8fe06917c8e01aad1b2d6538bfaaa3f7934f9: Status 404 returned error can't find the container with id 6cb957df34b81ceb4f63354d7be8fe06917c8e01aad1b2d6538bfaaa3f7934f9 Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-combined-ca-bundle\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-config-data\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-sg-core-conf-yaml\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-log-httpd\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hk9h\" (UniqueName: \"kubernetes.io/projected/cae13457-503f-4464-88f7-0f662542c7ea-kube-api-access-8hk9h\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751915 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-scripts\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.751996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-run-httpd\") pod \"cae13457-503f-4464-88f7-0f662542c7ea\" (UID: \"cae13457-503f-4464-88f7-0f662542c7ea\") " Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.752534 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.752650 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.755311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-scripts" (OuterVolumeSpecName: "scripts") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.755928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae13457-503f-4464-88f7-0f662542c7ea-kube-api-access-8hk9h" (OuterVolumeSpecName: "kube-api-access-8hk9h") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "kube-api-access-8hk9h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795108 4769 generic.go:334] "Generic (PLEG): container finished" podID="cae13457-503f-4464-88f7-0f662542c7ea" containerID="519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa" exitCode=0 Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795139 4769 generic.go:334] "Generic (PLEG): container finished" podID="cae13457-503f-4464-88f7-0f662542c7ea" containerID="e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b" exitCode=0 Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerDied","Data":"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa"} Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerDied","Data":"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b"} Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"cae13457-503f-4464-88f7-0f662542c7ea","Type":"ContainerDied","Data":"0e341f3f7bebfee1ee0e8dd4185583fcca74b2fe2d484f8be10c2f47290a0a26"} Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795255 4769 scope.go:117] "RemoveContainer" containerID="315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.795363 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.797703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251","Type":"ContainerStarted","Data":"6cb957df34b81ceb4f63354d7be8fe06917c8e01aad1b2d6538bfaaa3f7934f9"} Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.803804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.827995 4769 scope.go:117] "RemoveContainer" containerID="94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.849784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.852388 4769 scope.go:117] "RemoveContainer" containerID="519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.853486 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.853503 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.853512 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.853523 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8hk9h\" (UniqueName: \"kubernetes.io/projected/cae13457-503f-4464-88f7-0f662542c7ea-kube-api-access-8hk9h\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.853531 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.853539 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/cae13457-503f-4464-88f7-0f662542c7ea-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.877608 4769 scope.go:117] "RemoveContainer" containerID="e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.886429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-config-data" (OuterVolumeSpecName: "config-data") pod "cae13457-503f-4464-88f7-0f662542c7ea" (UID: "cae13457-503f-4464-88f7-0f662542c7ea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.955418 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cae13457-503f-4464-88f7-0f662542c7ea-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.989788 4769 scope.go:117] "RemoveContainer" containerID="315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b" Nov 21 12:56:48 crc kubenswrapper[4769]: E1121 12:56:48.990615 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b\": container with ID starting with 315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b not found: ID does not exist" containerID="315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.990661 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b"} err="failed to get container status \"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b\": rpc error: code = NotFound desc = could not find container \"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b\": container with ID starting with 315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.990687 4769 scope.go:117] "RemoveContainer" containerID="94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4" Nov 21 12:56:48 crc kubenswrapper[4769]: E1121 12:56:48.991040 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4\": container with ID starting with 94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4 not found: ID does not exist" containerID="94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.991073 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4"} err="failed to get container status \"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4\": rpc error: code = NotFound desc = could not find container \"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4\": container with ID starting with 94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4 not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.991096 4769 scope.go:117] "RemoveContainer" containerID="519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa" Nov 21 12:56:48 crc kubenswrapper[4769]: E1121 12:56:48.991427 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa\": container with ID starting with 519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa not found: ID does not exist" containerID="519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.991472 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa"} err="failed to get container status \"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa\": rpc error: code = NotFound desc = could not find container \"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa\": container with ID starting with 519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.991506 4769 scope.go:117] "RemoveContainer" containerID="e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b" Nov 21 12:56:48 crc kubenswrapper[4769]: E1121 12:56:48.991802 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b\": container with ID starting with e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b not found: ID does not exist" containerID="e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.991828 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b"} err="failed to get container status \"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b\": rpc error: code = NotFound desc = could not find container \"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b\": container with ID starting with e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.991843 4769 scope.go:117] "RemoveContainer" containerID="315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.992100 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b"} err="failed to get container status \"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b\": rpc error: code = NotFound desc = could not find container \"315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b\": container with ID starting with 315dded95cc615b8f0665beab69bdd49c8cfbbfa6d24a7206e30b6299bb4d28b not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.992121 4769 scope.go:117] "RemoveContainer" containerID="94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.992524 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4"} err="failed to get container status \"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4\": rpc error: code = NotFound desc = could not find container \"94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4\": container with ID starting with 94335bf2e6df42853127a53995ce14de84d18b9791236f062f2abdff4ae751a4 not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.992554 4769 scope.go:117] "RemoveContainer" containerID="519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.992772 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa"} err="failed to get container status \"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa\": rpc error: code = NotFound desc = could not find container \"519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa\": container with ID starting with 519b862f94424aa95b3349ea39e487ab5d39129fbb8f6e0d1dc6bc1d8d885faa not found: ID does not exist" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.992796 4769 scope.go:117] "RemoveContainer" containerID="e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b" Nov 21 12:56:48 crc kubenswrapper[4769]: I1121 12:56:48.993335 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b"} err="failed to get container status \"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b\": rpc error: code = NotFound desc = could not find container \"e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b\": container with ID starting with e18b58b8b085db4568cb3d8edf373027cfb27da8aaa265b4676010a1e1a6c89b not found: ID does not exist" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.137423 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.149135 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.174169 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:49 crc kubenswrapper[4769]: E1121 12:56:49.174776 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-central-agent" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.174797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-central-agent" Nov 21 12:56:49 crc kubenswrapper[4769]: E1121 12:56:49.174863 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-notification-agent" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.174877 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-notification-agent" Nov 21 12:56:49 crc kubenswrapper[4769]: E1121 12:56:49.174910 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="sg-core" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.174922 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="sg-core" Nov 21 12:56:49 crc kubenswrapper[4769]: E1121 12:56:49.174954 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="proxy-httpd" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.174967 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="proxy-httpd" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.175347 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="proxy-httpd" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.175368 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="sg-core" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.175387 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-central-agent" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.175405 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cae13457-503f-4464-88f7-0f662542c7ea" containerName="ceilometer-notification-agent" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.178434 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.180455 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.180839 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.190151 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.287659 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="254db443-35de-49a2-82bf-4c1f4fff72dc" path="/var/lib/kubelet/pods/254db443-35de-49a2-82bf-4c1f4fff72dc/volumes" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.288616 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cae13457-503f-4464-88f7-0f662542c7ea" path="/var/lib/kubelet/pods/cae13457-503f-4464-88f7-0f662542c7ea/volumes" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-run-httpd\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-scripts\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-config-data\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-log-httpd\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.365612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczlk\" (UniqueName: \"kubernetes.io/projected/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-kube-api-access-gczlk\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-log-httpd\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467226 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gczlk\" (UniqueName: \"kubernetes.io/projected/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-kube-api-access-gczlk\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-run-httpd\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-scripts\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.467837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-config-data\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.468501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-log-httpd\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.468511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-run-httpd\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.474078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-scripts\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.475317 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.486044 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczlk\" (UniqueName: \"kubernetes.io/projected/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-kube-api-access-gczlk\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.486053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.491607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-config-data\") pod \"ceilometer-0\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.512237 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.817560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251","Type":"ContainerStarted","Data":"3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5"} Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.817892 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:49 crc kubenswrapper[4769]: I1121 12:56:49.838367 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.838345903 podStartE2EDuration="2.838345903s" podCreationTimestamp="2025-11-21 12:56:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:49.830688847 +0000 UTC m=+3968.531350685" watchObservedRunningTime="2025-11-21 12:56:49.838345903 +0000 UTC m=+3968.539007731" Nov 21 12:56:50 crc kubenswrapper[4769]: I1121 12:56:50.017500 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:56:50 crc kubenswrapper[4769]: W1121 12:56:50.018541 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0dd7e89_a967_4d43_90b3_72375a0fe9fe.slice/crio-a71ad6d91c5fefbaf09d17b0dcc6004a139fa18938a2e9cc7a26031d0de533db WatchSource:0}: Error finding container a71ad6d91c5fefbaf09d17b0dcc6004a139fa18938a2e9cc7a26031d0de533db: Status 404 returned error can't find the container with id a71ad6d91c5fefbaf09d17b0dcc6004a139fa18938a2e9cc7a26031d0de533db Nov 21 12:56:50 crc kubenswrapper[4769]: I1121 12:56:50.836104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerStarted","Data":"6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd"} Nov 21 12:56:50 crc kubenswrapper[4769]: I1121 12:56:50.836433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerStarted","Data":"a71ad6d91c5fefbaf09d17b0dcc6004a139fa18938a2e9cc7a26031d0de533db"} Nov 21 12:56:51 crc kubenswrapper[4769]: I1121 12:56:51.849996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerStarted","Data":"bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54"} Nov 21 12:56:52 crc kubenswrapper[4769]: I1121 12:56:52.880992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerStarted","Data":"00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504"} Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.197874 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.729799 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp"] Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.732783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.735262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.736024 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.747185 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp"] Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.858072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.858203 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-config-data\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.858258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-scripts\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.858329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mshv\" (UniqueName: \"kubernetes.io/projected/8e2bc39c-225d-4b16-a84e-c337dab1e11a-kube-api-access-2mshv\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.867051 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.868609 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.876064 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.894126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.899003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerStarted","Data":"60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800"} Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.899140 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.924609 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.77949428 podStartE2EDuration="4.924588455s" podCreationTimestamp="2025-11-21 12:56:49 +0000 UTC" firstStartedPulling="2025-11-21 12:56:50.026669435 +0000 UTC m=+3968.727331263" lastFinishedPulling="2025-11-21 12:56:53.17176362 +0000 UTC m=+3971.872425438" observedRunningTime="2025-11-21 12:56:53.922095588 +0000 UTC m=+3972.622757406" watchObservedRunningTime="2025-11-21 12:56:53.924588455 +0000 UTC m=+3972.625250273" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.959586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2mshv\" (UniqueName: \"kubernetes.io/projected/8e2bc39c-225d-4b16-a84e-c337dab1e11a-kube-api-access-2mshv\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.959849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.959957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-config-data\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.960050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-scripts\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.975101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-scripts\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.980753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-config-data\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:53 crc kubenswrapper[4769]: I1121 12:56:53.989377 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mshv\" (UniqueName: \"kubernetes.io/projected/8e2bc39c-225d-4b16-a84e-c337dab1e11a-kube-api-access-2mshv\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.015719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-lrcmp\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.037552 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.053347 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.053701 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.062633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.065051 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-config-data\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.065172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6197195-72dc-4c08-9238-345b07c4fcc7-logs\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.065274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.065312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8l9\" (UniqueName: \"kubernetes.io/projected/c6197195-72dc-4c08-9238-345b07c4fcc7-kube-api-access-7d8l9\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.093122 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.095384 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.100885 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.107776 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.115526 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.121572 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.122806 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.133635 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.141221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.166359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.166413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/425b7409-541d-4f57-808d-49a462d79069-logs\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.166462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-config-data\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.166826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6197195-72dc-4c08-9238-345b07c4fcc7-logs\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.166947 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9pd\" (UniqueName: \"kubernetes.io/projected/425b7409-541d-4f57-808d-49a462d79069-kube-api-access-5x9pd\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.167075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxm7x\" (UniqueName: \"kubernetes.io/projected/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-kube-api-access-sxm7x\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.167178 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-config-data\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.167288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.167385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-config-data\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.167467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8l9\" (UniqueName: \"kubernetes.io/projected/c6197195-72dc-4c08-9238-345b07c4fcc7-kube-api-access-7d8l9\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.167548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.169445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6197195-72dc-4c08-9238-345b07c4fcc7-logs\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.174510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-config-data\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.177372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.185846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8l9\" (UniqueName: \"kubernetes.io/projected/c6197195-72dc-4c08-9238-345b07c4fcc7-kube-api-access-7d8l9\") pod \"nova-api-0\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.187807 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sxm7x\" (UniqueName: \"kubernetes.io/projected/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-kube-api-access-sxm7x\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhqd\" (UniqueName: \"kubernetes.io/projected/5c004188-8379-4fca-8d50-f293586ce6f5-kube-api-access-sjhqd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-config-data\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-config-data\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269894 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.269976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/425b7409-541d-4f57-808d-49a462d79069-logs\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.270177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9pd\" (UniqueName: \"kubernetes.io/projected/425b7409-541d-4f57-808d-49a462d79069-kube-api-access-5x9pd\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.270267 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.272704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/425b7409-541d-4f57-808d-49a462d79069-logs\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.280845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-config-data\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.287018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.287908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-config-data\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.288281 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.290936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxm7x\" (UniqueName: \"kubernetes.io/projected/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-kube-api-access-sxm7x\") pod \"nova-scheduler-0\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.291058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9pd\" (UniqueName: \"kubernetes.io/projected/425b7409-541d-4f57-808d-49a462d79069-kube-api-access-5x9pd\") pod \"nova-metadata-0\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.371375 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.371651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhqd\" (UniqueName: \"kubernetes.io/projected/5c004188-8379-4fca-8d50-f293586ce6f5-kube-api-access-sjhqd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.371713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.380892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.387125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.405497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhqd\" (UniqueName: \"kubernetes.io/projected/5c004188-8379-4fca-8d50-f293586ce6f5-kube-api-access-sjhqd\") pod \"nova-cell1-novncproxy-0\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.417830 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.454370 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.673989 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.701617 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.846082 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.910651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" event={"ID":"8e2bc39c-225d-4b16-a84e-c337dab1e11a","Type":"ContainerStarted","Data":"e6219a874feeee63ec22cb8e24ebd48530da08779528ac96d7b33b5b87c32189"} Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.912615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c6197195-72dc-4c08-9238-345b07c4fcc7","Type":"ContainerStarted","Data":"899a276e116cb02fbad7b0c090e09891719d0d029a4362be8c61d0e561084209"} Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.918124 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.919678 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.921417 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.921611 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.930337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg"] Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.964406 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:56:54 crc kubenswrapper[4769]: W1121 12:56:54.970847 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod425b7409_541d_4f57_808d_49a462d79069.slice/crio-a0ec44108e02cb4e81a6fa2368a4d08b5795bbe201084c94330d244fce83cdfb WatchSource:0}: Error finding container a0ec44108e02cb4e81a6fa2368a4d08b5795bbe201084c94330d244fce83cdfb: Status 404 returned error can't find the container with id a0ec44108e02cb4e81a6fa2368a4d08b5795bbe201084c94330d244fce83cdfb Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.988760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-scripts\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.988865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-config-data\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.988897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:54 crc kubenswrapper[4769]: I1121 12:56:54.988926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wksd5\" (UniqueName: \"kubernetes.io/projected/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-kube-api-access-wksd5\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.090650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-scripts\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.090955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-config-data\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.090984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.091005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wksd5\" (UniqueName: \"kubernetes.io/projected/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-kube-api-access-wksd5\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.099150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-config-data\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.104176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-scripts\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.108993 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wksd5\" (UniqueName: \"kubernetes.io/projected/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-kube-api-access-wksd5\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.109011 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.113897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-tnrdg\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: W1121 12:56:55.118563 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfabb8c75_7057_4f7d_9f34_5d1cfe7a1df3.slice/crio-96418f71513b72bf777a0f4ed75eaa2c07c1584ca58446ec3d6894e28a5b7f5e WatchSource:0}: Error finding container 96418f71513b72bf777a0f4ed75eaa2c07c1584ca58446ec3d6894e28a5b7f5e: Status 404 returned error can't find the container with id 96418f71513b72bf777a0f4ed75eaa2c07c1584ca58446ec3d6894e28a5b7f5e Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.258595 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.302947 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.800998 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg"] Nov 21 12:56:55 crc kubenswrapper[4769]: W1121 12:56:55.802226 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98ea61cb_c8c3_454f_adda_9ea32d7a2a93.slice/crio-37c709a5a36170f2bbdcffdc65acae1071f27b2542867de9229df701f494ec16 WatchSource:0}: Error finding container 37c709a5a36170f2bbdcffdc65acae1071f27b2542867de9229df701f494ec16: Status 404 returned error can't find the container with id 37c709a5a36170f2bbdcffdc65acae1071f27b2542867de9229df701f494ec16 Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.925130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c6197195-72dc-4c08-9238-345b07c4fcc7","Type":"ContainerStarted","Data":"2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.925170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c6197195-72dc-4c08-9238-345b07c4fcc7","Type":"ContainerStarted","Data":"8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.934797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3","Type":"ContainerStarted","Data":"eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.934845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3","Type":"ContainerStarted","Data":"96418f71513b72bf777a0f4ed75eaa2c07c1584ca58446ec3d6894e28a5b7f5e"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.940851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"425b7409-541d-4f57-808d-49a462d79069","Type":"ContainerStarted","Data":"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.940916 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"425b7409-541d-4f57-808d-49a462d79069","Type":"ContainerStarted","Data":"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.940926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"425b7409-541d-4f57-808d-49a462d79069","Type":"ContainerStarted","Data":"a0ec44108e02cb4e81a6fa2368a4d08b5795bbe201084c94330d244fce83cdfb"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.943411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" event={"ID":"98ea61cb-c8c3-454f-adda-9ea32d7a2a93","Type":"ContainerStarted","Data":"37c709a5a36170f2bbdcffdc65acae1071f27b2542867de9229df701f494ec16"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.945451 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.945435911 podStartE2EDuration="2.945435911s" podCreationTimestamp="2025-11-21 12:56:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:55.939364737 +0000 UTC m=+3974.640026555" watchObservedRunningTime="2025-11-21 12:56:55.945435911 +0000 UTC m=+3974.646097729" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.946710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5c004188-8379-4fca-8d50-f293586ce6f5","Type":"ContainerStarted","Data":"865aea95541c123f54deceb22fc360e44124b9c0047ace97f10a3a293953765a"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.946745 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5c004188-8379-4fca-8d50-f293586ce6f5","Type":"ContainerStarted","Data":"fda319671db953e677c2eb8511ef61f4e08edcb62d7be200ff6330d71e28325d"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.951130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" event={"ID":"8e2bc39c-225d-4b16-a84e-c337dab1e11a","Type":"ContainerStarted","Data":"3187d0f1f1fba23fac9aa4ceed66b66ee842149aa45e5a10a298eed771fd2728"} Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.954933 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.954918076 podStartE2EDuration="1.954918076s" podCreationTimestamp="2025-11-21 12:56:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:55.954061933 +0000 UTC m=+3974.654723771" watchObservedRunningTime="2025-11-21 12:56:55.954918076 +0000 UTC m=+3974.655579894" Nov 21 12:56:55 crc kubenswrapper[4769]: I1121 12:56:55.978882 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.978840361 podStartE2EDuration="1.978840361s" podCreationTimestamp="2025-11-21 12:56:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:55.975054619 +0000 UTC m=+3974.675716437" watchObservedRunningTime="2025-11-21 12:56:55.978840361 +0000 UTC m=+3974.679502189" Nov 21 12:56:56 crc kubenswrapper[4769]: I1121 12:56:56.019648 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.019623269 podStartE2EDuration="3.019623269s" podCreationTimestamp="2025-11-21 12:56:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:55.989656172 +0000 UTC m=+3974.690317990" watchObservedRunningTime="2025-11-21 12:56:56.019623269 +0000 UTC m=+3974.720285087" Nov 21 12:56:56 crc kubenswrapper[4769]: I1121 12:56:56.029107 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" podStartSLOduration=3.029092064 podStartE2EDuration="3.029092064s" podCreationTimestamp="2025-11-21 12:56:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:56.010702699 +0000 UTC m=+3974.711364507" watchObservedRunningTime="2025-11-21 12:56:56.029092064 +0000 UTC m=+3974.729753882" Nov 21 12:56:56 crc kubenswrapper[4769]: I1121 12:56:56.966773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" event={"ID":"98ea61cb-c8c3-454f-adda-9ea32d7a2a93","Type":"ContainerStarted","Data":"cdde02ce4036440411d8d1df10f13867e6a6b641a38bd7af5c09b414fc6643b7"} Nov 21 12:56:56 crc kubenswrapper[4769]: I1121 12:56:56.984915 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" podStartSLOduration=2.984894026 podStartE2EDuration="2.984894026s" podCreationTimestamp="2025-11-21 12:56:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:56:56.978560706 +0000 UTC m=+3975.679222524" watchObservedRunningTime="2025-11-21 12:56:56.984894026 +0000 UTC m=+3975.685555844" Nov 21 12:56:58 crc kubenswrapper[4769]: I1121 12:56:58.275086 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:56:58 crc kubenswrapper[4769]: E1121 12:56:58.276140 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:56:59 crc kubenswrapper[4769]: I1121 12:56:59.418626 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:59 crc kubenswrapper[4769]: I1121 12:56:59.418763 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:56:59 crc kubenswrapper[4769]: I1121 12:56:59.454941 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:56:59 crc kubenswrapper[4769]: I1121 12:56:59.674700 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:57:02 crc kubenswrapper[4769]: I1121 12:57:02.032019 4769 generic.go:334] "Generic (PLEG): container finished" podID="8e2bc39c-225d-4b16-a84e-c337dab1e11a" containerID="3187d0f1f1fba23fac9aa4ceed66b66ee842149aa45e5a10a298eed771fd2728" exitCode=0 Nov 21 12:57:02 crc kubenswrapper[4769]: I1121 12:57:02.032136 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" event={"ID":"8e2bc39c-225d-4b16-a84e-c337dab1e11a","Type":"ContainerDied","Data":"3187d0f1f1fba23fac9aa4ceed66b66ee842149aa45e5a10a298eed771fd2728"} Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.050334 4769 generic.go:334] "Generic (PLEG): container finished" podID="98ea61cb-c8c3-454f-adda-9ea32d7a2a93" containerID="cdde02ce4036440411d8d1df10f13867e6a6b641a38bd7af5c09b414fc6643b7" exitCode=0 Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.050443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" event={"ID":"98ea61cb-c8c3-454f-adda-9ea32d7a2a93","Type":"ContainerDied","Data":"cdde02ce4036440411d8d1df10f13867e6a6b641a38bd7af5c09b414fc6643b7"} Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.524646 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.570879 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mshv\" (UniqueName: \"kubernetes.io/projected/8e2bc39c-225d-4b16-a84e-c337dab1e11a-kube-api-access-2mshv\") pod \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.570982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-combined-ca-bundle\") pod \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.571074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-config-data\") pod \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.571215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-scripts\") pod \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\" (UID: \"8e2bc39c-225d-4b16-a84e-c337dab1e11a\") " Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.576932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-scripts" (OuterVolumeSpecName: "scripts") pod "8e2bc39c-225d-4b16-a84e-c337dab1e11a" (UID: "8e2bc39c-225d-4b16-a84e-c337dab1e11a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.577114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2bc39c-225d-4b16-a84e-c337dab1e11a-kube-api-access-2mshv" (OuterVolumeSpecName: "kube-api-access-2mshv") pod "8e2bc39c-225d-4b16-a84e-c337dab1e11a" (UID: "8e2bc39c-225d-4b16-a84e-c337dab1e11a"). InnerVolumeSpecName "kube-api-access-2mshv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.603220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-config-data" (OuterVolumeSpecName: "config-data") pod "8e2bc39c-225d-4b16-a84e-c337dab1e11a" (UID: "8e2bc39c-225d-4b16-a84e-c337dab1e11a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.614161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e2bc39c-225d-4b16-a84e-c337dab1e11a" (UID: "8e2bc39c-225d-4b16-a84e-c337dab1e11a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.674091 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2mshv\" (UniqueName: \"kubernetes.io/projected/8e2bc39c-225d-4b16-a84e-c337dab1e11a-kube-api-access-2mshv\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.674126 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.674167 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:03 crc kubenswrapper[4769]: I1121 12:57:03.674180 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e2bc39c-225d-4b16-a84e-c337dab1e11a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.074385 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.080872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp" event={"ID":"8e2bc39c-225d-4b16-a84e-c337dab1e11a","Type":"ContainerDied","Data":"e6219a874feeee63ec22cb8e24ebd48530da08779528ac96d7b33b5b87c32189"} Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.080955 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6219a874feeee63ec22cb8e24ebd48530da08779528ac96d7b33b5b87c32189" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.189086 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.189544 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.359061 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.359313 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" containerName="nova-scheduler-scheduler" containerID="cri-o://eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00" gracePeriod=30 Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.386455 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.390603 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.390840 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-log" containerID="cri-o://aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152" gracePeriod=30 Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.391270 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-metadata" containerID="cri-o://7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e" gracePeriod=30 Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.573256 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.596304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-scripts\") pod \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.596760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-combined-ca-bundle\") pod \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.596880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wksd5\" (UniqueName: \"kubernetes.io/projected/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-kube-api-access-wksd5\") pod \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.597041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-config-data\") pod \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\" (UID: \"98ea61cb-c8c3-454f-adda-9ea32d7a2a93\") " Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.606381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-kube-api-access-wksd5" (OuterVolumeSpecName: "kube-api-access-wksd5") pod "98ea61cb-c8c3-454f-adda-9ea32d7a2a93" (UID: "98ea61cb-c8c3-454f-adda-9ea32d7a2a93"). InnerVolumeSpecName "kube-api-access-wksd5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.620283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-scripts" (OuterVolumeSpecName: "scripts") pod "98ea61cb-c8c3-454f-adda-9ea32d7a2a93" (UID: "98ea61cb-c8c3-454f-adda-9ea32d7a2a93"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.631252 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-config-data" (OuterVolumeSpecName: "config-data") pod "98ea61cb-c8c3-454f-adda-9ea32d7a2a93" (UID: "98ea61cb-c8c3-454f-adda-9ea32d7a2a93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.674672 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.688414 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.702521 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.702564 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wksd5\" (UniqueName: \"kubernetes.io/projected/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-kube-api-access-wksd5\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.702588 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:04 crc kubenswrapper[4769]: E1121 12:57:04.705850 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod425b7409_541d_4f57_808d_49a462d79069.slice/crio-conmon-aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod425b7409_541d_4f57_808d_49a462d79069.slice/crio-aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.728987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "98ea61cb-c8c3-454f-adda-9ea32d7a2a93" (UID: "98ea61cb-c8c3-454f-adda-9ea32d7a2a93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.807852 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98ea61cb-c8c3-454f-adda-9ea32d7a2a93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:04 crc kubenswrapper[4769]: I1121 12:57:04.947904 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.011907 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/425b7409-541d-4f57-808d-49a462d79069-logs\") pod \"425b7409-541d-4f57-808d-49a462d79069\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.012029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x9pd\" (UniqueName: \"kubernetes.io/projected/425b7409-541d-4f57-808d-49a462d79069-kube-api-access-5x9pd\") pod \"425b7409-541d-4f57-808d-49a462d79069\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.012291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/425b7409-541d-4f57-808d-49a462d79069-logs" (OuterVolumeSpecName: "logs") pod "425b7409-541d-4f57-808d-49a462d79069" (UID: "425b7409-541d-4f57-808d-49a462d79069"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.012334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-combined-ca-bundle\") pod \"425b7409-541d-4f57-808d-49a462d79069\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.012429 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-config-data\") pod \"425b7409-541d-4f57-808d-49a462d79069\" (UID: \"425b7409-541d-4f57-808d-49a462d79069\") " Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.012987 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/425b7409-541d-4f57-808d-49a462d79069-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.017920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425b7409-541d-4f57-808d-49a462d79069-kube-api-access-5x9pd" (OuterVolumeSpecName: "kube-api-access-5x9pd") pod "425b7409-541d-4f57-808d-49a462d79069" (UID: "425b7409-541d-4f57-808d-49a462d79069"). InnerVolumeSpecName "kube-api-access-5x9pd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.034749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "425b7409-541d-4f57-808d-49a462d79069" (UID: "425b7409-541d-4f57-808d-49a462d79069"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.046970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-config-data" (OuterVolumeSpecName: "config-data") pod "425b7409-541d-4f57-808d-49a462d79069" (UID: "425b7409-541d-4f57-808d-49a462d79069"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.093800 4769 generic.go:334] "Generic (PLEG): container finished" podID="425b7409-541d-4f57-808d-49a462d79069" containerID="7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e" exitCode=0 Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.093856 4769 generic.go:334] "Generic (PLEG): container finished" podID="425b7409-541d-4f57-808d-49a462d79069" containerID="aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152" exitCode=143 Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.093950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"425b7409-541d-4f57-808d-49a462d79069","Type":"ContainerDied","Data":"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e"} Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.093992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"425b7409-541d-4f57-808d-49a462d79069","Type":"ContainerDied","Data":"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152"} Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.094014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"425b7409-541d-4f57-808d-49a462d79069","Type":"ContainerDied","Data":"a0ec44108e02cb4e81a6fa2368a4d08b5795bbe201084c94330d244fce83cdfb"} Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.094044 4769 scope.go:117] "RemoveContainer" containerID="7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.094258 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.103969 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-api" containerID="cri-o://2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702" gracePeriod=30 Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.103989 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.104024 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-log" containerID="cri-o://8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c" gracePeriod=30 Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.103552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg" event={"ID":"98ea61cb-c8c3-454f-adda-9ea32d7a2a93","Type":"ContainerDied","Data":"37c709a5a36170f2bbdcffdc65acae1071f27b2542867de9229df701f494ec16"} Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.109299 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37c709a5a36170f2bbdcffdc65acae1071f27b2542867de9229df701f494ec16" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.111565 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.102:8774/\": EOF" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.111780 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.102:8774/\": EOF" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.115008 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.115060 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5x9pd\" (UniqueName: \"kubernetes.io/projected/425b7409-541d-4f57-808d-49a462d79069-kube-api-access-5x9pd\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.115081 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/425b7409-541d-4f57-808d-49a462d79069-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.121497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.182537 4769 scope.go:117] "RemoveContainer" containerID="aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.184847 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.197247 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.239263 4769 scope.go:117] "RemoveContainer" containerID="7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.240683 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:05 crc kubenswrapper[4769]: E1121 12:57:05.241072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e2bc39c-225d-4b16-a84e-c337dab1e11a" containerName="nova-manage" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241087 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2bc39c-225d-4b16-a84e-c337dab1e11a" containerName="nova-manage" Nov 21 12:57:05 crc kubenswrapper[4769]: E1121 12:57:05.241111 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98ea61cb-c8c3-454f-adda-9ea32d7a2a93" containerName="nova-cell1-conductor-db-sync" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241119 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ea61cb-c8c3-454f-adda-9ea32d7a2a93" containerName="nova-cell1-conductor-db-sync" Nov 21 12:57:05 crc kubenswrapper[4769]: E1121 12:57:05.241138 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-log" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241145 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-log" Nov 21 12:57:05 crc kubenswrapper[4769]: E1121 12:57:05.241165 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-metadata" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241170 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-metadata" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241346 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e2bc39c-225d-4b16-a84e-c337dab1e11a" containerName="nova-manage" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241369 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-log" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241380 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="425b7409-541d-4f57-808d-49a462d79069" containerName="nova-metadata-metadata" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.241392 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="98ea61cb-c8c3-454f-adda-9ea32d7a2a93" containerName="nova-cell1-conductor-db-sync" Nov 21 12:57:05 crc kubenswrapper[4769]: E1121 12:57:05.262625 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e\": container with ID starting with 7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e not found: ID does not exist" containerID="7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.262667 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e"} err="failed to get container status \"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e\": rpc error: code = NotFound desc = could not find container \"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e\": container with ID starting with 7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e not found: ID does not exist" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.262705 4769 scope.go:117] "RemoveContainer" containerID="aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152" Nov 21 12:57:05 crc kubenswrapper[4769]: E1121 12:57:05.263342 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152\": container with ID starting with aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152 not found: ID does not exist" containerID="aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.263421 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152"} err="failed to get container status \"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152\": rpc error: code = NotFound desc = could not find container \"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152\": container with ID starting with aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152 not found: ID does not exist" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.263447 4769 scope.go:117] "RemoveContainer" containerID="7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.264497 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e"} err="failed to get container status \"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e\": rpc error: code = NotFound desc = could not find container \"7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e\": container with ID starting with 7f6b3f664e164a2fbada0d180bbcbdbd8b07b177e2867ca84156e4f2cb82d48e not found: ID does not exist" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.264523 4769 scope.go:117] "RemoveContainer" containerID="aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.264836 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152"} err="failed to get container status \"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152\": rpc error: code = NotFound desc = could not find container \"aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152\": container with ID starting with aa5e73e14978b18b655ed57d8849f7b4adf87d4a6f8e3040deb093f9a4468152 not found: ID does not exist" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.281408 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.284821 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.307618 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="425b7409-541d-4f57-808d-49a462d79069" path="/var/lib/kubelet/pods/425b7409-541d-4f57-808d-49a462d79069/volumes" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.308254 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.311730 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.313305 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.318022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw47w\" (UniqueName: \"kubernetes.io/projected/e5eeb59a-af21-4f53-b551-f9cca621e17b-kube-api-access-hw47w\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.318113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.318148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-config-data\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.318163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5eeb59a-af21-4f53-b551-f9cca621e17b-logs\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.327609 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.336542 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.420260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.420373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hw47w\" (UniqueName: \"kubernetes.io/projected/e5eeb59a-af21-4f53-b551-f9cca621e17b-kube-api-access-hw47w\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.420431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.420531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29bgf\" (UniqueName: \"kubernetes.io/projected/6ded5830-49b2-42ca-9a78-50a831417844-kube-api-access-29bgf\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.420937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.421040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-config-data\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.421077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5eeb59a-af21-4f53-b551-f9cca621e17b-logs\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.421826 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5eeb59a-af21-4f53-b551-f9cca621e17b-logs\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.426123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-config-data\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.428272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.456269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw47w\" (UniqueName: \"kubernetes.io/projected/e5eeb59a-af21-4f53-b551-f9cca621e17b-kube-api-access-hw47w\") pod \"nova-metadata-0\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.523950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.524093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.524159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-29bgf\" (UniqueName: \"kubernetes.io/projected/6ded5830-49b2-42ca-9a78-50a831417844-kube-api-access-29bgf\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.529702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.530129 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.548683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-29bgf\" (UniqueName: \"kubernetes.io/projected/6ded5830-49b2-42ca-9a78-50a831417844-kube-api-access-29bgf\") pod \"nova-cell1-conductor-0\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.605953 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:05 crc kubenswrapper[4769]: I1121 12:57:05.631499 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:06 crc kubenswrapper[4769]: I1121 12:57:06.093023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:57:06 crc kubenswrapper[4769]: W1121 12:57:06.095414 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ded5830_49b2_42ca_9a78_50a831417844.slice/crio-fbc4f20a3c106d5ad410e4536161f2bf5af4a193212cdd9abecec48939ea3b10 WatchSource:0}: Error finding container fbc4f20a3c106d5ad410e4536161f2bf5af4a193212cdd9abecec48939ea3b10: Status 404 returned error can't find the container with id fbc4f20a3c106d5ad410e4536161f2bf5af4a193212cdd9abecec48939ea3b10 Nov 21 12:57:06 crc kubenswrapper[4769]: I1121 12:57:06.136489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"6ded5830-49b2-42ca-9a78-50a831417844","Type":"ContainerStarted","Data":"fbc4f20a3c106d5ad410e4536161f2bf5af4a193212cdd9abecec48939ea3b10"} Nov 21 12:57:06 crc kubenswrapper[4769]: I1121 12:57:06.144485 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerID="8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c" exitCode=143 Nov 21 12:57:06 crc kubenswrapper[4769]: I1121 12:57:06.146028 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c6197195-72dc-4c08-9238-345b07c4fcc7","Type":"ContainerDied","Data":"8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c"} Nov 21 12:57:06 crc kubenswrapper[4769]: I1121 12:57:06.156985 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:06 crc kubenswrapper[4769]: I1121 12:57:06.981653 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.061705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-combined-ca-bundle\") pod \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.061786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-config-data\") pod \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.061843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxm7x\" (UniqueName: \"kubernetes.io/projected/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-kube-api-access-sxm7x\") pod \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\" (UID: \"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3\") " Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.068344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-kube-api-access-sxm7x" (OuterVolumeSpecName: "kube-api-access-sxm7x") pod "fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" (UID: "fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3"). InnerVolumeSpecName "kube-api-access-sxm7x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.089570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" (UID: "fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.105371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-config-data" (OuterVolumeSpecName: "config-data") pod "fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" (UID: "fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.157500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"6ded5830-49b2-42ca-9a78-50a831417844","Type":"ContainerStarted","Data":"4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721"} Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.157599 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.161484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e5eeb59a-af21-4f53-b551-f9cca621e17b","Type":"ContainerStarted","Data":"373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca"} Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.161528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e5eeb59a-af21-4f53-b551-f9cca621e17b","Type":"ContainerStarted","Data":"88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9"} Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.161546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e5eeb59a-af21-4f53-b551-f9cca621e17b","Type":"ContainerStarted","Data":"14bf0cde330be674570fa8153fa484bd5b5a4ecad6e567a4760bd98e6aeebad7"} Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.163047 4769 generic.go:334] "Generic (PLEG): container finished" podID="fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" containerID="eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00" exitCode=0 Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.163116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3","Type":"ContainerDied","Data":"eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00"} Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.163141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3","Type":"ContainerDied","Data":"96418f71513b72bf777a0f4ed75eaa2c07c1584ca58446ec3d6894e28a5b7f5e"} Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.163162 4769 scope.go:117] "RemoveContainer" containerID="eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.163283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.164916 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.164976 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.165005 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sxm7x\" (UniqueName: \"kubernetes.io/projected/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3-kube-api-access-sxm7x\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.183206 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.183165309 podStartE2EDuration="2.183165309s" podCreationTimestamp="2025-11-21 12:57:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:07.173657143 +0000 UTC m=+3985.874318961" watchObservedRunningTime="2025-11-21 12:57:07.183165309 +0000 UTC m=+3985.883827137" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.223762 4769 scope.go:117] "RemoveContainer" containerID="eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.224263 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-wxz48"] Nov 21 12:57:07 crc kubenswrapper[4769]: E1121 12:57:07.224648 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" containerName="nova-scheduler-scheduler" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.224665 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" containerName="nova-scheduler-scheduler" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.224887 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" containerName="nova-scheduler-scheduler" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.227327 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: E1121 12:57:07.227591 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00\": container with ID starting with eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00 not found: ID does not exist" containerID="eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.227630 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00"} err="failed to get container status \"eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00\": rpc error: code = NotFound desc = could not find container \"eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00\": container with ID starting with eb2d193743cdee78979789c41bd92722034c80e021b48198c6f27d7aea351f00 not found: ID does not exist" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.233787 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.233762721 podStartE2EDuration="2.233762721s" podCreationTimestamp="2025-11-21 12:57:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:07.205183802 +0000 UTC m=+3985.905845630" watchObservedRunningTime="2025-11-21 12:57:07.233762721 +0000 UTC m=+3985.934424539" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.249618 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-wxz48"] Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.264151 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.267818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8x8n\" (UniqueName: \"kubernetes.io/projected/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-kube-api-access-d8x8n\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.267939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-catalog-content\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.268001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-utilities\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.285644 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.285685 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.287063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.289380 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.307910 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.369953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-utilities\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.370043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-config-data\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.370117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d8x8n\" (UniqueName: \"kubernetes.io/projected/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-kube-api-access-d8x8n\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.370243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfr5\" (UniqueName: \"kubernetes.io/projected/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-kube-api-access-kcfr5\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.370276 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-catalog-content\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.370309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.371005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-utilities\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.371046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-catalog-content\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.389724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8x8n\" (UniqueName: \"kubernetes.io/projected/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-kube-api-access-d8x8n\") pod \"community-operators-wxz48\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.471877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfr5\" (UniqueName: \"kubernetes.io/projected/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-kube-api-access-kcfr5\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.471942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.471998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-config-data\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.474941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-config-data\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.477235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.498185 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfr5\" (UniqueName: \"kubernetes.io/projected/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-kube-api-access-kcfr5\") pod \"nova-scheduler-0\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.584645 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:07 crc kubenswrapper[4769]: I1121 12:57:07.624764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:08 crc kubenswrapper[4769]: I1121 12:57:08.104005 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-wxz48"] Nov 21 12:57:08 crc kubenswrapper[4769]: I1121 12:57:08.181449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerStarted","Data":"7bf86ae297a6157ab76b5134170b7f52278c50c82abf4d90bc6665e88543518f"} Nov 21 12:57:08 crc kubenswrapper[4769]: I1121 12:57:08.202972 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:09 crc kubenswrapper[4769]: I1121 12:57:09.195230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d","Type":"ContainerStarted","Data":"de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e"} Nov 21 12:57:09 crc kubenswrapper[4769]: I1121 12:57:09.195695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d","Type":"ContainerStarted","Data":"a04515530fe9e840829f8939ada0ff52fe4aa184dfe5ada65a2afd48cacc5187"} Nov 21 12:57:09 crc kubenswrapper[4769]: I1121 12:57:09.200070 4769 generic.go:334] "Generic (PLEG): container finished" podID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerID="14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda" exitCode=0 Nov 21 12:57:09 crc kubenswrapper[4769]: I1121 12:57:09.200118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerDied","Data":"14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda"} Nov 21 12:57:09 crc kubenswrapper[4769]: I1121 12:57:09.264505 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.264484004 podStartE2EDuration="2.264484004s" podCreationTimestamp="2025-11-21 12:57:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:09.223524511 +0000 UTC m=+3987.924186369" watchObservedRunningTime="2025-11-21 12:57:09.264484004 +0000 UTC m=+3987.965145832" Nov 21 12:57:09 crc kubenswrapper[4769]: I1121 12:57:09.291985 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3" path="/var/lib/kubelet/pods/fabb8c75-7057-4f7d-9f34-5d1cfe7a1df3/volumes" Nov 21 12:57:10 crc kubenswrapper[4769]: I1121 12:57:10.211696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerStarted","Data":"ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19"} Nov 21 12:57:10 crc kubenswrapper[4769]: I1121 12:57:10.275107 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:57:10 crc kubenswrapper[4769]: E1121 12:57:10.275671 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:57:10 crc kubenswrapper[4769]: I1121 12:57:10.606971 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:10 crc kubenswrapper[4769]: I1121 12:57:10.607012 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.038743 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.170922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-combined-ca-bundle\") pod \"c6197195-72dc-4c08-9238-345b07c4fcc7\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.171305 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-config-data\") pod \"c6197195-72dc-4c08-9238-345b07c4fcc7\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.171522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8l9\" (UniqueName: \"kubernetes.io/projected/c6197195-72dc-4c08-9238-345b07c4fcc7-kube-api-access-7d8l9\") pod \"c6197195-72dc-4c08-9238-345b07c4fcc7\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.171646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6197195-72dc-4c08-9238-345b07c4fcc7-logs\") pod \"c6197195-72dc-4c08-9238-345b07c4fcc7\" (UID: \"c6197195-72dc-4c08-9238-345b07c4fcc7\") " Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.172657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6197195-72dc-4c08-9238-345b07c4fcc7-logs" (OuterVolumeSpecName: "logs") pod "c6197195-72dc-4c08-9238-345b07c4fcc7" (UID: "c6197195-72dc-4c08-9238-345b07c4fcc7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.177791 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6197195-72dc-4c08-9238-345b07c4fcc7-kube-api-access-7d8l9" (OuterVolumeSpecName: "kube-api-access-7d8l9") pod "c6197195-72dc-4c08-9238-345b07c4fcc7" (UID: "c6197195-72dc-4c08-9238-345b07c4fcc7"). InnerVolumeSpecName "kube-api-access-7d8l9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.204077 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6197195-72dc-4c08-9238-345b07c4fcc7" (UID: "c6197195-72dc-4c08-9238-345b07c4fcc7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.221433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-config-data" (OuterVolumeSpecName: "config-data") pod "c6197195-72dc-4c08-9238-345b07c4fcc7" (UID: "c6197195-72dc-4c08-9238-345b07c4fcc7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.229655 4769 generic.go:334] "Generic (PLEG): container finished" podID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerID="ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19" exitCode=0 Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.229716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerDied","Data":"ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19"} Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.240413 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerID="2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702" exitCode=0 Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.240485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c6197195-72dc-4c08-9238-345b07c4fcc7","Type":"ContainerDied","Data":"2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702"} Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.240645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c6197195-72dc-4c08-9238-345b07c4fcc7","Type":"ContainerDied","Data":"899a276e116cb02fbad7b0c090e09891719d0d029a4362be8c61d0e561084209"} Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.240557 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.240710 4769 scope.go:117] "RemoveContainer" containerID="2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.274485 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7d8l9\" (UniqueName: \"kubernetes.io/projected/c6197195-72dc-4c08-9238-345b07c4fcc7-kube-api-access-7d8l9\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.275282 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c6197195-72dc-4c08-9238-345b07c4fcc7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.275315 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.275329 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6197195-72dc-4c08-9238-345b07c4fcc7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.322915 4769 scope.go:117] "RemoveContainer" containerID="8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.335639 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.365904 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.385074 4769 scope.go:117] "RemoveContainer" containerID="2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.385298 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:11 crc kubenswrapper[4769]: E1121 12:57:11.385714 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702\": container with ID starting with 2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702 not found: ID does not exist" containerID="2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.385757 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702"} err="failed to get container status \"2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702\": rpc error: code = NotFound desc = could not find container \"2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702\": container with ID starting with 2aa2e813cdd7fe498b3df7e723118b421583e7d9d64161935f9d865f9e2e5702 not found: ID does not exist" Nov 21 12:57:11 crc kubenswrapper[4769]: E1121 12:57:11.385800 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-api" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.385819 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-api" Nov 21 12:57:11 crc kubenswrapper[4769]: E1121 12:57:11.385854 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-log" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.385806 4769 scope.go:117] "RemoveContainer" containerID="8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.385864 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-log" Nov 21 12:57:11 crc kubenswrapper[4769]: E1121 12:57:11.386166 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c\": container with ID starting with 8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c not found: ID does not exist" containerID="8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.386183 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-log" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.386226 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" containerName="nova-api-api" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.386199 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c"} err="failed to get container status \"8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c\": rpc error: code = NotFound desc = could not find container \"8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c\": container with ID starting with 8a0f3a653c88a470a4d2d10f3e02de4ef00c6b8108557cc8e52ff4b32c4d6d3c not found: ID does not exist" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.387528 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.390267 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.393970 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.483961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t98x\" (UniqueName: \"kubernetes.io/projected/b98d507a-4ea5-45ae-accd-b47e4b42f14e-kube-api-access-6t98x\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.484081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-config-data\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.484101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.484157 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b98d507a-4ea5-45ae-accd-b47e4b42f14e-logs\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.585616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b98d507a-4ea5-45ae-accd-b47e4b42f14e-logs\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.585721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6t98x\" (UniqueName: \"kubernetes.io/projected/b98d507a-4ea5-45ae-accd-b47e4b42f14e-kube-api-access-6t98x\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.585794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-config-data\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.585809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.586316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b98d507a-4ea5-45ae-accd-b47e4b42f14e-logs\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.593810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-config-data\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.595783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.613423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t98x\" (UniqueName: \"kubernetes.io/projected/b98d507a-4ea5-45ae-accd-b47e4b42f14e-kube-api-access-6t98x\") pod \"nova-api-0\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:11 crc kubenswrapper[4769]: I1121 12:57:11.705988 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:12 crc kubenswrapper[4769]: I1121 12:57:12.236682 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:12 crc kubenswrapper[4769]: W1121 12:57:12.246854 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb98d507a_4ea5_45ae_accd_b47e4b42f14e.slice/crio-28dc02261e0f19adf80201af4e6e643cf2970d509b34710bc25d279a24cb3930 WatchSource:0}: Error finding container 28dc02261e0f19adf80201af4e6e643cf2970d509b34710bc25d279a24cb3930: Status 404 returned error can't find the container with id 28dc02261e0f19adf80201af4e6e643cf2970d509b34710bc25d279a24cb3930 Nov 21 12:57:12 crc kubenswrapper[4769]: I1121 12:57:12.254289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerStarted","Data":"95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54"} Nov 21 12:57:12 crc kubenswrapper[4769]: I1121 12:57:12.275977 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-wxz48" podStartSLOduration=2.72029763 podStartE2EDuration="5.275937179s" podCreationTimestamp="2025-11-21 12:57:07 +0000 UTC" firstStartedPulling="2025-11-21 12:57:09.206533913 +0000 UTC m=+3987.907195761" lastFinishedPulling="2025-11-21 12:57:11.762173452 +0000 UTC m=+3990.462835310" observedRunningTime="2025-11-21 12:57:12.272393533 +0000 UTC m=+3990.973055361" watchObservedRunningTime="2025-11-21 12:57:12.275937179 +0000 UTC m=+3990.976599007" Nov 21 12:57:12 crc kubenswrapper[4769]: I1121 12:57:12.625734 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:13 crc kubenswrapper[4769]: I1121 12:57:13.270784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b98d507a-4ea5-45ae-accd-b47e4b42f14e","Type":"ContainerStarted","Data":"797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155"} Nov 21 12:57:13 crc kubenswrapper[4769]: I1121 12:57:13.270837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b98d507a-4ea5-45ae-accd-b47e4b42f14e","Type":"ContainerStarted","Data":"23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f"} Nov 21 12:57:13 crc kubenswrapper[4769]: I1121 12:57:13.270852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b98d507a-4ea5-45ae-accd-b47e4b42f14e","Type":"ContainerStarted","Data":"28dc02261e0f19adf80201af4e6e643cf2970d509b34710bc25d279a24cb3930"} Nov 21 12:57:13 crc kubenswrapper[4769]: I1121 12:57:13.288644 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6197195-72dc-4c08-9238-345b07c4fcc7" path="/var/lib/kubelet/pods/c6197195-72dc-4c08-9238-345b07c4fcc7/volumes" Nov 21 12:57:13 crc kubenswrapper[4769]: I1121 12:57:13.303532 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.303514973 podStartE2EDuration="2.303514973s" podCreationTimestamp="2025-11-21 12:57:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:13.301603311 +0000 UTC m=+3992.002265129" watchObservedRunningTime="2025-11-21 12:57:13.303514973 +0000 UTC m=+3992.004176801" Nov 21 12:57:15 crc kubenswrapper[4769]: I1121 12:57:15.607029 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:15 crc kubenswrapper[4769]: I1121 12:57:15.607698 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:15 crc kubenswrapper[4769]: I1121 12:57:15.689355 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.295363 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l"] Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.297909 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.302084 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.306324 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.308808 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l"] Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.394127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.394225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-config-data\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.394262 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-882ms\" (UniqueName: \"kubernetes.io/projected/31c0493a-baa8-4d36-8d5f-1b5f678c9758-kube-api-access-882ms\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.394322 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-scripts\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.496709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-882ms\" (UniqueName: \"kubernetes.io/projected/31c0493a-baa8-4d36-8d5f-1b5f678c9758-kube-api-access-882ms\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.496802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-scripts\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.496884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.496929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-config-data\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.504634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.507442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-config-data\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.509592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-scripts\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.528604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-882ms\" (UniqueName: \"kubernetes.io/projected/31c0493a-baa8-4d36-8d5f-1b5f678c9758-kube-api-access-882ms\") pod \"nova-cell1-cell-mapping-g7p8l\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.628161 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.690429 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.0.107:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:16 crc kubenswrapper[4769]: I1121 12:57:16.690581 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.0.107:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.154153 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l"] Nov 21 12:57:17 crc kubenswrapper[4769]: W1121 12:57:17.167577 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31c0493a_baa8_4d36_8d5f_1b5f678c9758.slice/crio-74a083b4dbebb1065866bd1865590c949f6187689cd6f16e3ca75dc9bf185396 WatchSource:0}: Error finding container 74a083b4dbebb1065866bd1865590c949f6187689cd6f16e3ca75dc9bf185396: Status 404 returned error can't find the container with id 74a083b4dbebb1065866bd1865590c949f6187689cd6f16e3ca75dc9bf185396 Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.320335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" event={"ID":"31c0493a-baa8-4d36-8d5f-1b5f678c9758","Type":"ContainerStarted","Data":"74a083b4dbebb1065866bd1865590c949f6187689cd6f16e3ca75dc9bf185396"} Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.585701 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.585781 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.626059 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.655793 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:17 crc kubenswrapper[4769]: I1121 12:57:17.675080 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:18 crc kubenswrapper[4769]: I1121 12:57:18.338247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" event={"ID":"31c0493a-baa8-4d36-8d5f-1b5f678c9758","Type":"ContainerStarted","Data":"fd1f4ae5ee466e0378b8e87f3e3b3a73507dd1bdaa889a19ead72be3a73c3fea"} Nov 21 12:57:18 crc kubenswrapper[4769]: I1121 12:57:18.374052 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" podStartSLOduration=2.374024354 podStartE2EDuration="2.374024354s" podCreationTimestamp="2025-11-21 12:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:18.364790235 +0000 UTC m=+3997.065452143" watchObservedRunningTime="2025-11-21 12:57:18.374024354 +0000 UTC m=+3997.074686212" Nov 21 12:57:18 crc kubenswrapper[4769]: I1121 12:57:18.391735 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:18 crc kubenswrapper[4769]: I1121 12:57:18.418248 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:18 crc kubenswrapper[4769]: I1121 12:57:18.482574 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-wxz48"] Nov 21 12:57:19 crc kubenswrapper[4769]: I1121 12:57:19.519073 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:20 crc kubenswrapper[4769]: I1121 12:57:20.363496 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-wxz48" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="registry-server" containerID="cri-o://95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54" gracePeriod=2 Nov 21 12:57:20 crc kubenswrapper[4769]: I1121 12:57:20.883643 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.006876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8x8n\" (UniqueName: \"kubernetes.io/projected/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-kube-api-access-d8x8n\") pod \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.007071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-catalog-content\") pod \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.007334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-utilities\") pod \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\" (UID: \"74cf2c7e-9a53-43e1-9a98-f01e57b4044d\") " Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.010143 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-utilities" (OuterVolumeSpecName: "utilities") pod "74cf2c7e-9a53-43e1-9a98-f01e57b4044d" (UID: "74cf2c7e-9a53-43e1-9a98-f01e57b4044d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.014619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-kube-api-access-d8x8n" (OuterVolumeSpecName: "kube-api-access-d8x8n") pod "74cf2c7e-9a53-43e1-9a98-f01e57b4044d" (UID: "74cf2c7e-9a53-43e1-9a98-f01e57b4044d"). InnerVolumeSpecName "kube-api-access-d8x8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.110619 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d8x8n\" (UniqueName: \"kubernetes.io/projected/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-kube-api-access-d8x8n\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.110679 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.376072 4769 generic.go:334] "Generic (PLEG): container finished" podID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerID="95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54" exitCode=0 Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.376136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wxz48" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.376132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerDied","Data":"95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54"} Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.376712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wxz48" event={"ID":"74cf2c7e-9a53-43e1-9a98-f01e57b4044d","Type":"ContainerDied","Data":"7bf86ae297a6157ab76b5134170b7f52278c50c82abf4d90bc6665e88543518f"} Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.376757 4769 scope.go:117] "RemoveContainer" containerID="95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.412866 4769 scope.go:117] "RemoveContainer" containerID="ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.458770 4769 scope.go:117] "RemoveContainer" containerID="14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.518662 4769 scope.go:117] "RemoveContainer" containerID="95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54" Nov 21 12:57:21 crc kubenswrapper[4769]: E1121 12:57:21.519331 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54\": container with ID starting with 95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54 not found: ID does not exist" containerID="95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.519378 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54"} err="failed to get container status \"95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54\": rpc error: code = NotFound desc = could not find container \"95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54\": container with ID starting with 95de4f83ede6a9dc2f58ec8a0073a1b54665c65637b3d13b8928f4a09eb40e54 not found: ID does not exist" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.519411 4769 scope.go:117] "RemoveContainer" containerID="ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19" Nov 21 12:57:21 crc kubenswrapper[4769]: E1121 12:57:21.520807 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19\": container with ID starting with ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19 not found: ID does not exist" containerID="ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.520853 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19"} err="failed to get container status \"ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19\": rpc error: code = NotFound desc = could not find container \"ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19\": container with ID starting with ba16a78fe39d9fbe3a0e625ad1abc0ad3661dd1b883f32974d6cb8d5130dae19 not found: ID does not exist" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.520884 4769 scope.go:117] "RemoveContainer" containerID="14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda" Nov 21 12:57:21 crc kubenswrapper[4769]: E1121 12:57:21.521358 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda\": container with ID starting with 14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda not found: ID does not exist" containerID="14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.521432 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda"} err="failed to get container status \"14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda\": rpc error: code = NotFound desc = could not find container \"14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda\": container with ID starting with 14021d206edfbb286a39ff8034781f9d9a430e8269ec68366df2a2fe79b4bbda not found: ID does not exist" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.706758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:21 crc kubenswrapper[4769]: I1121 12:57:21.706827 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.015364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "74cf2c7e-9a53-43e1-9a98-f01e57b4044d" (UID: "74cf2c7e-9a53-43e1-9a98-f01e57b4044d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.032834 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/74cf2c7e-9a53-43e1-9a98-f01e57b4044d-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.313548 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-wxz48"] Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.323309 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-wxz48"] Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.389980 4769 generic.go:334] "Generic (PLEG): container finished" podID="31c0493a-baa8-4d36-8d5f-1b5f678c9758" containerID="fd1f4ae5ee466e0378b8e87f3e3b3a73507dd1bdaa889a19ead72be3a73c3fea" exitCode=0 Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.390040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" event={"ID":"31c0493a-baa8-4d36-8d5f-1b5f678c9758","Type":"ContainerDied","Data":"fd1f4ae5ee466e0378b8e87f3e3b3a73507dd1bdaa889a19ead72be3a73c3fea"} Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.789388 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.111:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:22 crc kubenswrapper[4769]: I1121 12:57:22.790130 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.111:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.291681 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" path="/var/lib/kubelet/pods/74cf2c7e-9a53-43e1-9a98-f01e57b4044d/volumes" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.828290 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.906073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-scripts\") pod \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.906156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-config-data\") pod \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.906248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-882ms\" (UniqueName: \"kubernetes.io/projected/31c0493a-baa8-4d36-8d5f-1b5f678c9758-kube-api-access-882ms\") pod \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.906346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-combined-ca-bundle\") pod \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\" (UID: \"31c0493a-baa8-4d36-8d5f-1b5f678c9758\") " Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.912300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c0493a-baa8-4d36-8d5f-1b5f678c9758-kube-api-access-882ms" (OuterVolumeSpecName: "kube-api-access-882ms") pod "31c0493a-baa8-4d36-8d5f-1b5f678c9758" (UID: "31c0493a-baa8-4d36-8d5f-1b5f678c9758"). InnerVolumeSpecName "kube-api-access-882ms". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.914597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-scripts" (OuterVolumeSpecName: "scripts") pod "31c0493a-baa8-4d36-8d5f-1b5f678c9758" (UID: "31c0493a-baa8-4d36-8d5f-1b5f678c9758"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.916085 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.916124 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-882ms\" (UniqueName: \"kubernetes.io/projected/31c0493a-baa8-4d36-8d5f-1b5f678c9758-kube-api-access-882ms\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.942395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-config-data" (OuterVolumeSpecName: "config-data") pod "31c0493a-baa8-4d36-8d5f-1b5f678c9758" (UID: "31c0493a-baa8-4d36-8d5f-1b5f678c9758"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:23 crc kubenswrapper[4769]: I1121 12:57:23.960153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "31c0493a-baa8-4d36-8d5f-1b5f678c9758" (UID: "31c0493a-baa8-4d36-8d5f-1b5f678c9758"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.018407 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.018460 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31c0493a-baa8-4d36-8d5f-1b5f678c9758-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.273962 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:57:24 crc kubenswrapper[4769]: E1121 12:57:24.274311 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.427145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" event={"ID":"31c0493a-baa8-4d36-8d5f-1b5f678c9758","Type":"ContainerDied","Data":"74a083b4dbebb1065866bd1865590c949f6187689cd6f16e3ca75dc9bf185396"} Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.427673 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74a083b4dbebb1065866bd1865590c949f6187689cd6f16e3ca75dc9bf185396" Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.427233 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l" Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.628185 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.628670 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-log" containerID="cri-o://23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f" gracePeriod=30 Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.628900 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-api" containerID="cri-o://797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155" gracePeriod=30 Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.644975 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.645247 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" containerName="nova-scheduler-scheduler" containerID="cri-o://de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" gracePeriod=30 Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.670309 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.670701 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-log" containerID="cri-o://88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9" gracePeriod=30 Nov 21 12:57:24 crc kubenswrapper[4769]: I1121 12:57:24.671031 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-metadata" containerID="cri-o://373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca" gracePeriod=30 Nov 21 12:57:25 crc kubenswrapper[4769]: I1121 12:57:25.452240 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerID="88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9" exitCode=143 Nov 21 12:57:25 crc kubenswrapper[4769]: I1121 12:57:25.452245 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e5eeb59a-af21-4f53-b551-f9cca621e17b","Type":"ContainerDied","Data":"88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9"} Nov 21 12:57:25 crc kubenswrapper[4769]: I1121 12:57:25.462414 4769 generic.go:334] "Generic (PLEG): container finished" podID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerID="23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f" exitCode=143 Nov 21 12:57:25 crc kubenswrapper[4769]: I1121 12:57:25.462464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b98d507a-4ea5-45ae-accd-b47e4b42f14e","Type":"ContainerDied","Data":"23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f"} Nov 21 12:57:27 crc kubenswrapper[4769]: E1121 12:57:27.629511 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:57:27 crc kubenswrapper[4769]: E1121 12:57:27.633577 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:57:27 crc kubenswrapper[4769]: E1121 12:57:27.635870 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:57:27 crc kubenswrapper[4769]: E1121 12:57:27.635930 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" containerName="nova-scheduler-scheduler" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.341043 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.353703 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.499383 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerID="373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca" exitCode=0 Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.499424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.499492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e5eeb59a-af21-4f53-b551-f9cca621e17b","Type":"ContainerDied","Data":"373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca"} Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.499559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e5eeb59a-af21-4f53-b551-f9cca621e17b","Type":"ContainerDied","Data":"14bf0cde330be674570fa8153fa484bd5b5a4ecad6e567a4760bd98e6aeebad7"} Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.499593 4769 scope.go:117] "RemoveContainer" containerID="373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.502417 4769 generic.go:334] "Generic (PLEG): container finished" podID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerID="797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155" exitCode=0 Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.502464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b98d507a-4ea5-45ae-accd-b47e4b42f14e","Type":"ContainerDied","Data":"797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155"} Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.502495 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b98d507a-4ea5-45ae-accd-b47e4b42f14e","Type":"ContainerDied","Data":"28dc02261e0f19adf80201af4e6e643cf2970d509b34710bc25d279a24cb3930"} Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.502577 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t98x\" (UniqueName: \"kubernetes.io/projected/b98d507a-4ea5-45ae-accd-b47e4b42f14e-kube-api-access-6t98x\") pod \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-config-data\") pod \"e5eeb59a-af21-4f53-b551-f9cca621e17b\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-combined-ca-bundle\") pod \"e5eeb59a-af21-4f53-b551-f9cca621e17b\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-combined-ca-bundle\") pod \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520662 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b98d507a-4ea5-45ae-accd-b47e4b42f14e-logs\") pod \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw47w\" (UniqueName: \"kubernetes.io/projected/e5eeb59a-af21-4f53-b551-f9cca621e17b-kube-api-access-hw47w\") pod \"e5eeb59a-af21-4f53-b551-f9cca621e17b\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-config-data\") pod \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\" (UID: \"b98d507a-4ea5-45ae-accd-b47e4b42f14e\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.520856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5eeb59a-af21-4f53-b551-f9cca621e17b-logs\") pod \"e5eeb59a-af21-4f53-b551-f9cca621e17b\" (UID: \"e5eeb59a-af21-4f53-b551-f9cca621e17b\") " Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.522022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5eeb59a-af21-4f53-b551-f9cca621e17b-logs" (OuterVolumeSpecName: "logs") pod "e5eeb59a-af21-4f53-b551-f9cca621e17b" (UID: "e5eeb59a-af21-4f53-b551-f9cca621e17b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.522346 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5eeb59a-af21-4f53-b551-f9cca621e17b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.524273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b98d507a-4ea5-45ae-accd-b47e4b42f14e-logs" (OuterVolumeSpecName: "logs") pod "b98d507a-4ea5-45ae-accd-b47e4b42f14e" (UID: "b98d507a-4ea5-45ae-accd-b47e4b42f14e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.529115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b98d507a-4ea5-45ae-accd-b47e4b42f14e-kube-api-access-6t98x" (OuterVolumeSpecName: "kube-api-access-6t98x") pod "b98d507a-4ea5-45ae-accd-b47e4b42f14e" (UID: "b98d507a-4ea5-45ae-accd-b47e4b42f14e"). InnerVolumeSpecName "kube-api-access-6t98x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.536444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5eeb59a-af21-4f53-b551-f9cca621e17b-kube-api-access-hw47w" (OuterVolumeSpecName: "kube-api-access-hw47w") pod "e5eeb59a-af21-4f53-b551-f9cca621e17b" (UID: "e5eeb59a-af21-4f53-b551-f9cca621e17b"). InnerVolumeSpecName "kube-api-access-hw47w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.544529 4769 scope.go:117] "RemoveContainer" containerID="88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.549537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-config-data" (OuterVolumeSpecName: "config-data") pod "b98d507a-4ea5-45ae-accd-b47e4b42f14e" (UID: "b98d507a-4ea5-45ae-accd-b47e4b42f14e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.557386 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b98d507a-4ea5-45ae-accd-b47e4b42f14e" (UID: "b98d507a-4ea5-45ae-accd-b47e4b42f14e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.566574 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-config-data" (OuterVolumeSpecName: "config-data") pod "e5eeb59a-af21-4f53-b551-f9cca621e17b" (UID: "e5eeb59a-af21-4f53-b551-f9cca621e17b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.569620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5eeb59a-af21-4f53-b551-f9cca621e17b" (UID: "e5eeb59a-af21-4f53-b551-f9cca621e17b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.592403 4769 scope.go:117] "RemoveContainer" containerID="373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.592994 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca\": container with ID starting with 373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca not found: ID does not exist" containerID="373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.593070 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca"} err="failed to get container status \"373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca\": rpc error: code = NotFound desc = could not find container \"373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca\": container with ID starting with 373be00c53795737ba6e062453ad29c5b5a7489df709485cd3acd4fb62d0abca not found: ID does not exist" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.593088 4769 scope.go:117] "RemoveContainer" containerID="88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.593428 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9\": container with ID starting with 88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9 not found: ID does not exist" containerID="88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.593496 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9"} err="failed to get container status \"88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9\": rpc error: code = NotFound desc = could not find container \"88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9\": container with ID starting with 88f1a12c2ae10a21fbf17e21e2ccdf329c46f599708e9d378954f7bb0b4807c9 not found: ID does not exist" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.593543 4769 scope.go:117] "RemoveContainer" containerID="797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.620827 4769 scope.go:117] "RemoveContainer" containerID="23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624772 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624815 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624835 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b98d507a-4ea5-45ae-accd-b47e4b42f14e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624857 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hw47w\" (UniqueName: \"kubernetes.io/projected/e5eeb59a-af21-4f53-b551-f9cca621e17b-kube-api-access-hw47w\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624877 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b98d507a-4ea5-45ae-accd-b47e4b42f14e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624897 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6t98x\" (UniqueName: \"kubernetes.io/projected/b98d507a-4ea5-45ae-accd-b47e4b42f14e-kube-api-access-6t98x\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.624914 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5eeb59a-af21-4f53-b551-f9cca621e17b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.650825 4769 scope.go:117] "RemoveContainer" containerID="797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.651424 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155\": container with ID starting with 797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155 not found: ID does not exist" containerID="797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.651456 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155"} err="failed to get container status \"797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155\": rpc error: code = NotFound desc = could not find container \"797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155\": container with ID starting with 797caa88a74492644c7e9a8982ab8057332b541edf388cb6630662f1470dd155 not found: ID does not exist" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.651478 4769 scope.go:117] "RemoveContainer" containerID="23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.651913 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f\": container with ID starting with 23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f not found: ID does not exist" containerID="23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.651983 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f"} err="failed to get container status \"23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f\": rpc error: code = NotFound desc = could not find container \"23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f\": container with ID starting with 23ff4dff66561416c5928ff830a623492ebc6d87a4a78bdca024fcc215f8d95f not found: ID does not exist" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.860376 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.895630 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.916506 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.924172 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.930592 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931045 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="extract-utilities" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931065 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="extract-utilities" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-log" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-log" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931117 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-metadata" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931124 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-metadata" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931136 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-log" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931141 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-log" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931155 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="registry-server" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931161 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="registry-server" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931171 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="31c0493a-baa8-4d36-8d5f-1b5f678c9758" containerName="nova-manage" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931178 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c0493a-baa8-4d36-8d5f-1b5f678c9758" containerName="nova-manage" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931211 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-api" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931218 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-api" Nov 21 12:57:28 crc kubenswrapper[4769]: E1121 12:57:28.931231 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="extract-content" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931237 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="extract-content" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931411 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="74cf2c7e-9a53-43e1-9a98-f01e57b4044d" containerName="registry-server" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931423 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-log" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931434 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-log" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931444 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" containerName="nova-api-api" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" containerName="nova-metadata-metadata" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.931469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="31c0493a-baa8-4d36-8d5f-1b5f678c9758" containerName="nova-manage" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.932448 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.935036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.938253 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.940262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.942371 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.944841 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:28 crc kubenswrapper[4769]: I1121 12:57:28.952865 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxjfn\" (UniqueName: \"kubernetes.io/projected/d8249847-5e97-4b9d-b86e-88758d4f29a8-kube-api-access-nxjfn\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032102 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8249847-5e97-4b9d-b86e-88758d4f29a8-logs\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-config-data\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52pq\" (UniqueName: \"kubernetes.io/projected/4aae878d-4ff7-41f3-b5ce-540752cfc218-kube-api-access-k52pq\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-config-data\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4aae878d-4ff7-41f3-b5ce-540752cfc218-logs\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.032893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.134528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.134624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-config-data\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.134674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4aae878d-4ff7-41f3-b5ce-540752cfc218-logs\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.134696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.134736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nxjfn\" (UniqueName: \"kubernetes.io/projected/d8249847-5e97-4b9d-b86e-88758d4f29a8-kube-api-access-nxjfn\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.134778 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8249847-5e97-4b9d-b86e-88758d4f29a8-logs\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.135412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4aae878d-4ff7-41f3-b5ce-540752cfc218-logs\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.135498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8249847-5e97-4b9d-b86e-88758d4f29a8-logs\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.135563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-config-data\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.135641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k52pq\" (UniqueName: \"kubernetes.io/projected/4aae878d-4ff7-41f3-b5ce-540752cfc218-kube-api-access-k52pq\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.140879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.141268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-config-data\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.151611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.152382 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-config-data\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.155915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxjfn\" (UniqueName: \"kubernetes.io/projected/d8249847-5e97-4b9d-b86e-88758d4f29a8-kube-api-access-nxjfn\") pod \"nova-api-0\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.157125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52pq\" (UniqueName: \"kubernetes.io/projected/4aae878d-4ff7-41f3-b5ce-540752cfc218-kube-api-access-k52pq\") pod \"nova-metadata-0\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.272363 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.287391 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b98d507a-4ea5-45ae-accd-b47e4b42f14e" path="/var/lib/kubelet/pods/b98d507a-4ea5-45ae-accd-b47e4b42f14e/volumes" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.288239 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5eeb59a-af21-4f53-b551-f9cca621e17b" path="/var/lib/kubelet/pods/e5eeb59a-af21-4f53-b551-f9cca621e17b/volumes" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.290715 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.665248 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:57:29 crc kubenswrapper[4769]: W1121 12:57:29.688539 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aae878d_4ff7_41f3_b5ce_540752cfc218.slice/crio-3c1a401c715975078a9726835cbb5458dcd1fda4d419b340911ec8ce119da90e WatchSource:0}: Error finding container 3c1a401c715975078a9726835cbb5458dcd1fda4d419b340911ec8ce119da90e: Status 404 returned error can't find the container with id 3c1a401c715975078a9726835cbb5458dcd1fda4d419b340911ec8ce119da90e Nov 21 12:57:29 crc kubenswrapper[4769]: I1121 12:57:29.777697 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.079971 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.154432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcfr5\" (UniqueName: \"kubernetes.io/projected/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-kube-api-access-kcfr5\") pod \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.154709 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-config-data\") pod \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.154766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-combined-ca-bundle\") pod \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\" (UID: \"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d\") " Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.161431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-kube-api-access-kcfr5" (OuterVolumeSpecName: "kube-api-access-kcfr5") pod "202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" (UID: "202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d"). InnerVolumeSpecName "kube-api-access-kcfr5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.219337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" (UID: "202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.223524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-config-data" (OuterVolumeSpecName: "config-data") pod "202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" (UID: "202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.257302 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.257335 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.257347 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kcfr5\" (UniqueName: \"kubernetes.io/projected/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d-kube-api-access-kcfr5\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.539005 4769 generic.go:334] "Generic (PLEG): container finished" podID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" exitCode=0 Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.539057 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.539106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d","Type":"ContainerDied","Data":"de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.539200 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d","Type":"ContainerDied","Data":"a04515530fe9e840829f8939ada0ff52fe4aa184dfe5ada65a2afd48cacc5187"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.539223 4769 scope.go:117] "RemoveContainer" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.541422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4aae878d-4ff7-41f3-b5ce-540752cfc218","Type":"ContainerStarted","Data":"2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.541477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4aae878d-4ff7-41f3-b5ce-540752cfc218","Type":"ContainerStarted","Data":"6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.541500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4aae878d-4ff7-41f3-b5ce-540752cfc218","Type":"ContainerStarted","Data":"3c1a401c715975078a9726835cbb5458dcd1fda4d419b340911ec8ce119da90e"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.543354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d8249847-5e97-4b9d-b86e-88758d4f29a8","Type":"ContainerStarted","Data":"cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.543776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d8249847-5e97-4b9d-b86e-88758d4f29a8","Type":"ContainerStarted","Data":"472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.543793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d8249847-5e97-4b9d-b86e-88758d4f29a8","Type":"ContainerStarted","Data":"36c7761da9689653bcbc74d81b4cbac8b503b2e8d89bc4bc2f9f818db47e8d8a"} Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.563723 4769 scope.go:117] "RemoveContainer" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" Nov 21 12:57:30 crc kubenswrapper[4769]: E1121 12:57:30.564255 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e\": container with ID starting with de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e not found: ID does not exist" containerID="de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.564306 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e"} err="failed to get container status \"de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e\": rpc error: code = NotFound desc = could not find container \"de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e\": container with ID starting with de5e50fea9862cbe91a73c512e1adc06d546ee87983b2004d85b16719e2b662e not found: ID does not exist" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.574230 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.574208773 podStartE2EDuration="2.574208773s" podCreationTimestamp="2025-11-21 12:57:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:30.564110991 +0000 UTC m=+4009.264772819" watchObservedRunningTime="2025-11-21 12:57:30.574208773 +0000 UTC m=+4009.274870591" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.595345 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.595325161 podStartE2EDuration="2.595325161s" podCreationTimestamp="2025-11-21 12:57:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:30.594131089 +0000 UTC m=+4009.294792917" watchObservedRunningTime="2025-11-21 12:57:30.595325161 +0000 UTC m=+4009.295986989" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.634928 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.654288 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.664781 4769 scope.go:117] "RemoveContainer" containerID="3bc9ccbd315fa94f258c7df4067abdc4487b29d64c3fbf3a03234b70c8054c92" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.664897 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:30 crc kubenswrapper[4769]: E1121 12:57:30.665391 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" containerName="nova-scheduler-scheduler" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.665409 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" containerName="nova-scheduler-scheduler" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.665780 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" containerName="nova-scheduler-scheduler" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.666423 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.669554 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.678898 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.697090 4769 scope.go:117] "RemoveContainer" containerID="aee55e10ca4f62d26ddc9ba2acff2e59da10c44aa3d45daadf88ab0cef9a0a45" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.725348 4769 scope.go:117] "RemoveContainer" containerID="d5e7791f66a241b5726dea732e676438190334ed853ab3acc8fcf560559ab42e" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.762386 4769 scope.go:117] "RemoveContainer" containerID="dae814cdc4659ba47db1c334b8f91c2afe6a611aee1323c2d533dbd4d0aabeab" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.769003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.769055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-config-data\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.769118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjtgv\" (UniqueName: \"kubernetes.io/projected/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-kube-api-access-wjtgv\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.808974 4769 scope.go:117] "RemoveContainer" containerID="443284b39eb7c99b2eae5b93dc7f7ca28aac657ec2c0f48654d61f16df782ebe" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.851637 4769 scope.go:117] "RemoveContainer" containerID="373999dfb7af8178949cbc5af581eaf55442d9b56b9d2aa291e1af30b1a1cbf9" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.871936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.872020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-config-data\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.872102 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjtgv\" (UniqueName: \"kubernetes.io/projected/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-kube-api-access-wjtgv\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.877553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-config-data\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.877729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.896047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjtgv\" (UniqueName: \"kubernetes.io/projected/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-kube-api-access-wjtgv\") pod \"nova-scheduler-0\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:30 crc kubenswrapper[4769]: I1121 12:57:30.995765 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:31 crc kubenswrapper[4769]: I1121 12:57:31.292511 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d" path="/var/lib/kubelet/pods/202ffe61-53cd-4aad-ba9a-f6fcdb7e5f0d/volumes" Nov 21 12:57:31 crc kubenswrapper[4769]: I1121 12:57:31.623118 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:57:31 crc kubenswrapper[4769]: W1121 12:57:31.623357 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1752e2cd_263b_4ba2_81c0_aaaa8a5a3f21.slice/crio-fbd87c7dbc47c2c7bcf5c4dfbef6f6cf48d497b579010b404a16d04f185c2fd9 WatchSource:0}: Error finding container fbd87c7dbc47c2c7bcf5c4dfbef6f6cf48d497b579010b404a16d04f185c2fd9: Status 404 returned error can't find the container with id fbd87c7dbc47c2c7bcf5c4dfbef6f6cf48d497b579010b404a16d04f185c2fd9 Nov 21 12:57:32 crc kubenswrapper[4769]: I1121 12:57:32.577996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21","Type":"ContainerStarted","Data":"9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c"} Nov 21 12:57:32 crc kubenswrapper[4769]: I1121 12:57:32.578587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21","Type":"ContainerStarted","Data":"fbd87c7dbc47c2c7bcf5c4dfbef6f6cf48d497b579010b404a16d04f185c2fd9"} Nov 21 12:57:32 crc kubenswrapper[4769]: I1121 12:57:32.618644 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.618618343 podStartE2EDuration="2.618618343s" podCreationTimestamp="2025-11-21 12:57:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:57:32.607651877 +0000 UTC m=+4011.308313735" watchObservedRunningTime="2025-11-21 12:57:32.618618343 +0000 UTC m=+4011.319280201" Nov 21 12:57:34 crc kubenswrapper[4769]: I1121 12:57:34.274460 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:34 crc kubenswrapper[4769]: I1121 12:57:34.275476 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:35 crc kubenswrapper[4769]: I1121 12:57:35.275122 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:57:35 crc kubenswrapper[4769]: E1121 12:57:35.276253 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:57:35 crc kubenswrapper[4769]: I1121 12:57:35.995870 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:39 crc kubenswrapper[4769]: I1121 12:57:39.293075 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:39 crc kubenswrapper[4769]: I1121 12:57:39.293478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:39 crc kubenswrapper[4769]: I1121 12:57:39.293502 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:39 crc kubenswrapper[4769]: I1121 12:57:39.293523 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:40 crc kubenswrapper[4769]: I1121 12:57:40.437599 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.114:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:40 crc kubenswrapper[4769]: I1121 12:57:40.437682 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.0.113:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:40 crc kubenswrapper[4769]: I1121 12:57:40.437781 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.114:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:40 crc kubenswrapper[4769]: I1121 12:57:40.437776 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.0.113:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:57:40 crc kubenswrapper[4769]: I1121 12:57:40.996856 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:41 crc kubenswrapper[4769]: I1121 12:57:41.049251 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:41 crc kubenswrapper[4769]: I1121 12:57:41.746667 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.286976 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-dgsbm"] Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.290117 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.296027 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dgsbm"] Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.389679 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjz6t\" (UniqueName: \"kubernetes.io/projected/59b72dc7-05bf-4d96-a534-624e8c72826d-kube-api-access-jjz6t\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.390099 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-utilities\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.390127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-catalog-content\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.491591 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jjz6t\" (UniqueName: \"kubernetes.io/projected/59b72dc7-05bf-4d96-a534-624e8c72826d-kube-api-access-jjz6t\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.491721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-utilities\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.491744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-catalog-content\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.492283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-catalog-content\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.492369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-utilities\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.512010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjz6t\" (UniqueName: \"kubernetes.io/projected/59b72dc7-05bf-4d96-a534-624e8c72826d-kube-api-access-jjz6t\") pod \"redhat-operators-dgsbm\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:44 crc kubenswrapper[4769]: I1121 12:57:44.618589 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:45 crc kubenswrapper[4769]: I1121 12:57:45.083979 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-dgsbm"] Nov 21 12:57:45 crc kubenswrapper[4769]: I1121 12:57:45.780910 4769 generic.go:334] "Generic (PLEG): container finished" podID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerID="4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295" exitCode=0 Nov 21 12:57:45 crc kubenswrapper[4769]: I1121 12:57:45.781302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerDied","Data":"4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295"} Nov 21 12:57:45 crc kubenswrapper[4769]: I1121 12:57:45.781340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerStarted","Data":"9240719c59315b0a0e5024d89c4b4f3a8b68b5cd1a5fcc89023fa48c85bfc45f"} Nov 21 12:57:47 crc kubenswrapper[4769]: I1121 12:57:47.803535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerStarted","Data":"0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be"} Nov 21 12:57:48 crc kubenswrapper[4769]: I1121 12:57:48.824113 4769 generic.go:334] "Generic (PLEG): container finished" podID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerID="0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be" exitCode=0 Nov 21 12:57:48 crc kubenswrapper[4769]: I1121 12:57:48.824252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerDied","Data":"0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be"} Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.296277 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.296366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.296440 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.297550 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.300541 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.300657 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.301248 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.302725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.837203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerStarted","Data":"6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18"} Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.837950 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.843447 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:57:49 crc kubenswrapper[4769]: I1121 12:57:49.873334 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-dgsbm" podStartSLOduration=2.391893619 podStartE2EDuration="5.873300831s" podCreationTimestamp="2025-11-21 12:57:44 +0000 UTC" firstStartedPulling="2025-11-21 12:57:45.784436328 +0000 UTC m=+4024.485098176" lastFinishedPulling="2025-11-21 12:57:49.26584356 +0000 UTC m=+4027.966505388" observedRunningTime="2025-11-21 12:57:49.865171932 +0000 UTC m=+4028.565833760" watchObservedRunningTime="2025-11-21 12:57:49.873300831 +0000 UTC m=+4028.573962659" Nov 21 12:57:50 crc kubenswrapper[4769]: I1121 12:57:50.274618 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:57:50 crc kubenswrapper[4769]: E1121 12:57:50.274932 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.253921 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.254638 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-central-agent" containerID="cri-o://6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd" gracePeriod=30 Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.255067 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="proxy-httpd" containerID="cri-o://60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800" gracePeriod=30 Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.255114 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="sg-core" containerID="cri-o://00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504" gracePeriod=30 Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.255147 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-notification-agent" containerID="cri-o://bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54" gracePeriod=30 Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.865721 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerID="60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800" exitCode=0 Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.866015 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerID="00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504" exitCode=2 Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.865809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerDied","Data":"60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800"} Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.866062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerDied","Data":"00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504"} Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.866076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerDied","Data":"6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd"} Nov 21 12:57:52 crc kubenswrapper[4769]: I1121 12:57:52.866027 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerID="6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd" exitCode=0 Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.545716 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.618970 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.620473 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-log-httpd\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-scripts\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-sg-core-conf-yaml\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-run-httpd\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gczlk\" (UniqueName: \"kubernetes.io/projected/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-kube-api-access-gczlk\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-combined-ca-bundle\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.707517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-config-data\") pod \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\" (UID: \"e0dd7e89-a967-4d43-90b3-72375a0fe9fe\") " Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.710124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.710460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.713782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-kube-api-access-gczlk" (OuterVolumeSpecName: "kube-api-access-gczlk") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "kube-api-access-gczlk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.714317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-scripts" (OuterVolumeSpecName: "scripts") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.735964 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.788662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.809645 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.809680 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.809983 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.810024 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.810043 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.810060 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gczlk\" (UniqueName: \"kubernetes.io/projected/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-kube-api-access-gczlk\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.815866 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-config-data" (OuterVolumeSpecName: "config-data") pod "e0dd7e89-a967-4d43-90b3-72375a0fe9fe" (UID: "e0dd7e89-a967-4d43-90b3-72375a0fe9fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.899037 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.901679 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerID="bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54" exitCode=0 Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.901854 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerDied","Data":"bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54"} Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.901929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e0dd7e89-a967-4d43-90b3-72375a0fe9fe","Type":"ContainerDied","Data":"a71ad6d91c5fefbaf09d17b0dcc6004a139fa18938a2e9cc7a26031d0de533db"} Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.901964 4769 scope.go:117] "RemoveContainer" containerID="60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.913786 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0dd7e89-a967-4d43-90b3-72375a0fe9fe-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.947469 4769 scope.go:117] "RemoveContainer" containerID="00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.965753 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.973256 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994142 4769 scope.go:117] "RemoveContainer" containerID="bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994286 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:57:54 crc kubenswrapper[4769]: E1121 12:57:54.994675 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-notification-agent" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994690 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-notification-agent" Nov 21 12:57:54 crc kubenswrapper[4769]: E1121 12:57:54.994716 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="proxy-httpd" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994723 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="proxy-httpd" Nov 21 12:57:54 crc kubenswrapper[4769]: E1121 12:57:54.994742 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="sg-core" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994748 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="sg-core" Nov 21 12:57:54 crc kubenswrapper[4769]: E1121 12:57:54.994758 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-central-agent" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994764 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-central-agent" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994939 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-notification-agent" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994956 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="ceilometer-central-agent" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994978 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="proxy-httpd" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.994987 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" containerName="sg-core" Nov 21 12:57:54 crc kubenswrapper[4769]: I1121 12:57:54.996716 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.000046 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.000284 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.011142 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbp7\" (UniqueName: \"kubernetes.io/projected/0c1391c1-afa5-489e-8f4d-4e409a35d72d-kube-api-access-6rbp7\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-config-data\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-log-httpd\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-run-httpd\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.016900 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-scripts\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.032238 4769 scope.go:117] "RemoveContainer" containerID="6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.051387 4769 scope.go:117] "RemoveContainer" containerID="60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800" Nov 21 12:57:55 crc kubenswrapper[4769]: E1121 12:57:55.051814 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800\": container with ID starting with 60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800 not found: ID does not exist" containerID="60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.051857 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800"} err="failed to get container status \"60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800\": rpc error: code = NotFound desc = could not find container \"60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800\": container with ID starting with 60d3d50b203a8ab16bf4474f1c9295f78f473acc3bf46b39a74dc81be5bb5800 not found: ID does not exist" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.051885 4769 scope.go:117] "RemoveContainer" containerID="00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504" Nov 21 12:57:55 crc kubenswrapper[4769]: E1121 12:57:55.052286 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504\": container with ID starting with 00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504 not found: ID does not exist" containerID="00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.052321 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504"} err="failed to get container status \"00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504\": rpc error: code = NotFound desc = could not find container \"00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504\": container with ID starting with 00508ba8f0afdfb40725a8da5b035ed5e6c8425e0c8be8bcb064a3c59a6c8504 not found: ID does not exist" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.052346 4769 scope.go:117] "RemoveContainer" containerID="bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54" Nov 21 12:57:55 crc kubenswrapper[4769]: E1121 12:57:55.052574 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54\": container with ID starting with bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54 not found: ID does not exist" containerID="bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.052600 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54"} err="failed to get container status \"bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54\": rpc error: code = NotFound desc = could not find container \"bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54\": container with ID starting with bf1285fa49d827b891ea1a5e7e7675c62f51c748d129e162aa72be9bff4e3e54 not found: ID does not exist" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.052615 4769 scope.go:117] "RemoveContainer" containerID="6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd" Nov 21 12:57:55 crc kubenswrapper[4769]: E1121 12:57:55.052883 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd\": container with ID starting with 6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd not found: ID does not exist" containerID="6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.052906 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd"} err="failed to get container status \"6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd\": rpc error: code = NotFound desc = could not find container \"6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd\": container with ID starting with 6442aa8c9764328260e7ad2f5cef5cc51e10a079bd7f34efb991f2ddb4773ecd not found: ID does not exist" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbp7\" (UniqueName: \"kubernetes.io/projected/0c1391c1-afa5-489e-8f4d-4e409a35d72d-kube-api-access-6rbp7\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-config-data\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-log-httpd\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124574 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-run-httpd\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.124623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-scripts\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.126627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-run-httpd\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.126675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-log-httpd\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.127902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-scripts\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.128570 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.129340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.133175 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-config-data\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.143454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbp7\" (UniqueName: \"kubernetes.io/projected/0c1391c1-afa5-489e-8f4d-4e409a35d72d-kube-api-access-6rbp7\") pod \"ceilometer-0\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.288048 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0dd7e89-a967-4d43-90b3-72375a0fe9fe" path="/var/lib/kubelet/pods/e0dd7e89-a967-4d43-90b3-72375a0fe9fe/volumes" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.320768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.679442 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-dgsbm" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="registry-server" probeResult="failure" output=< Nov 21 12:57:55 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 12:57:55 crc kubenswrapper[4769]: > Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.740123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:57:55 crc kubenswrapper[4769]: I1121 12:57:55.916575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerStarted","Data":"a1cf3b2566838000fad267c4b34a2ab8de6128f4cfc3555fc3e7a3ebdef4fc5a"} Nov 21 12:57:57 crc kubenswrapper[4769]: I1121 12:57:57.945176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerStarted","Data":"c9bf58af7f215c63d1ef37fef205e8d4ffcac33867b0167534e3c1d69fd7a3d0"} Nov 21 12:57:57 crc kubenswrapper[4769]: I1121 12:57:57.945900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerStarted","Data":"a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24"} Nov 21 12:57:58 crc kubenswrapper[4769]: I1121 12:57:58.957514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerStarted","Data":"3d42a4556277f4b66cfad1d44bd67efdfddb19a0674d546e69e44481a7043aa2"} Nov 21 12:57:59 crc kubenswrapper[4769]: I1121 12:57:59.971202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerStarted","Data":"b3335f0750906eb115787d3d3b664e09e9d64172330caf278916f526fa90a49f"} Nov 21 12:57:59 crc kubenswrapper[4769]: I1121 12:57:59.971572 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:57:59 crc kubenswrapper[4769]: I1121 12:57:59.991054 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.13005179 podStartE2EDuration="5.991039564s" podCreationTimestamp="2025-11-21 12:57:54 +0000 UTC" firstStartedPulling="2025-11-21 12:57:55.746172861 +0000 UTC m=+4034.446834679" lastFinishedPulling="2025-11-21 12:57:59.607160625 +0000 UTC m=+4038.307822453" observedRunningTime="2025-11-21 12:57:59.989689448 +0000 UTC m=+4038.690351266" watchObservedRunningTime="2025-11-21 12:57:59.991039564 +0000 UTC m=+4038.691701382" Nov 21 12:58:04 crc kubenswrapper[4769]: I1121 12:58:04.699946 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:58:04 crc kubenswrapper[4769]: I1121 12:58:04.764234 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:58:04 crc kubenswrapper[4769]: I1121 12:58:04.935155 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dgsbm"] Nov 21 12:58:05 crc kubenswrapper[4769]: I1121 12:58:05.274568 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:58:05 crc kubenswrapper[4769]: E1121 12:58:05.275325 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.044277 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-dgsbm" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="registry-server" containerID="cri-o://6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18" gracePeriod=2 Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.601281 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.771893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-catalog-content\") pod \"59b72dc7-05bf-4d96-a534-624e8c72826d\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.772039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjz6t\" (UniqueName: \"kubernetes.io/projected/59b72dc7-05bf-4d96-a534-624e8c72826d-kube-api-access-jjz6t\") pod \"59b72dc7-05bf-4d96-a534-624e8c72826d\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.772067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-utilities\") pod \"59b72dc7-05bf-4d96-a534-624e8c72826d\" (UID: \"59b72dc7-05bf-4d96-a534-624e8c72826d\") " Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.772879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-utilities" (OuterVolumeSpecName: "utilities") pod "59b72dc7-05bf-4d96-a534-624e8c72826d" (UID: "59b72dc7-05bf-4d96-a534-624e8c72826d"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.781134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b72dc7-05bf-4d96-a534-624e8c72826d-kube-api-access-jjz6t" (OuterVolumeSpecName: "kube-api-access-jjz6t") pod "59b72dc7-05bf-4d96-a534-624e8c72826d" (UID: "59b72dc7-05bf-4d96-a534-624e8c72826d"). InnerVolumeSpecName "kube-api-access-jjz6t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.844049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "59b72dc7-05bf-4d96-a534-624e8c72826d" (UID: "59b72dc7-05bf-4d96-a534-624e8c72826d"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.874688 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.874735 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jjz6t\" (UniqueName: \"kubernetes.io/projected/59b72dc7-05bf-4d96-a534-624e8c72826d-kube-api-access-jjz6t\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:06 crc kubenswrapper[4769]: I1121 12:58:06.874758 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/59b72dc7-05bf-4d96-a534-624e8c72826d-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.056412 4769 generic.go:334] "Generic (PLEG): container finished" podID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerID="6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18" exitCode=0 Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.056467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerDied","Data":"6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18"} Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.056485 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-dgsbm" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.056506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-dgsbm" event={"ID":"59b72dc7-05bf-4d96-a534-624e8c72826d","Type":"ContainerDied","Data":"9240719c59315b0a0e5024d89c4b4f3a8b68b5cd1a5fcc89023fa48c85bfc45f"} Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.056536 4769 scope.go:117] "RemoveContainer" containerID="6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.081748 4769 scope.go:117] "RemoveContainer" containerID="0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.101181 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-dgsbm"] Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.112011 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-dgsbm"] Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.114806 4769 scope.go:117] "RemoveContainer" containerID="4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.154541 4769 scope.go:117] "RemoveContainer" containerID="6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18" Nov 21 12:58:07 crc kubenswrapper[4769]: E1121 12:58:07.155034 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18\": container with ID starting with 6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18 not found: ID does not exist" containerID="6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.155062 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18"} err="failed to get container status \"6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18\": rpc error: code = NotFound desc = could not find container \"6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18\": container with ID starting with 6241fa868dfc2e8a2ce09a80b7099b1527036941d8761a6ffb9dd0be8000ce18 not found: ID does not exist" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.155083 4769 scope.go:117] "RemoveContainer" containerID="0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be" Nov 21 12:58:07 crc kubenswrapper[4769]: E1121 12:58:07.155439 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be\": container with ID starting with 0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be not found: ID does not exist" containerID="0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.155462 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be"} err="failed to get container status \"0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be\": rpc error: code = NotFound desc = could not find container \"0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be\": container with ID starting with 0cc6172f1d67de8bcb82178a3d87e1d82f7069c68ed88a42f311a452c8a111be not found: ID does not exist" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.155475 4769 scope.go:117] "RemoveContainer" containerID="4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295" Nov 21 12:58:07 crc kubenswrapper[4769]: E1121 12:58:07.155761 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295\": container with ID starting with 4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295 not found: ID does not exist" containerID="4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.155782 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295"} err="failed to get container status \"4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295\": rpc error: code = NotFound desc = could not find container \"4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295\": container with ID starting with 4218832dda931ac8167d4da1f6aa4da296df6ea7b8fa8cdec6067677dfc1f295 not found: ID does not exist" Nov 21 12:58:07 crc kubenswrapper[4769]: I1121 12:58:07.289762 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" path="/var/lib/kubelet/pods/59b72dc7-05bf-4d96-a534-624e8c72826d/volumes" Nov 21 12:58:16 crc kubenswrapper[4769]: I1121 12:58:16.273735 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 12:58:17 crc kubenswrapper[4769]: I1121 12:58:17.180793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"7da5fdce4fbae9f3b258b796977753d26bbb86ca1b6a9d778fdf42dd01683bfe"} Nov 21 12:58:25 crc kubenswrapper[4769]: I1121 12:58:25.325944 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.332142 4769 scope.go:117] "RemoveContainer" containerID="e262a2e0a42afc1913632e50e4674554d2684b538e9894ce9884fbbc25208ba9" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.363039 4769 scope.go:117] "RemoveContainer" containerID="d375235b460a38fd29e4ec4d7f7911cdc95d3bde1fcd66fc54caf74325bf86be" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.390623 4769 scope.go:117] "RemoveContainer" containerID="0b4a32a7919ab509364cdfc133e358ba7efdcdf58aa7e5177524a7d1c365d050" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.419828 4769 scope.go:117] "RemoveContainer" containerID="b8c4ba213f58d9ecac6ff1b9f26579a4aba42889a393984e6851fb5f5ffb83c0" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.482680 4769 scope.go:117] "RemoveContainer" containerID="833709ff534d43dc048cf3fac4eddd82601928d7ae54f5763021f992f7a39bc9" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.519322 4769 scope.go:117] "RemoveContainer" containerID="fe440698d4bf6426f16c562c14614ac51dba8c236c7e03beda6285499c405172" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.571029 4769 scope.go:117] "RemoveContainer" containerID="e008e0744d10c71887e2076dd5c66e9820507ab0e909e49b76a0cff5333369ac" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.605203 4769 scope.go:117] "RemoveContainer" containerID="c952ebc5aee8bdba73fde5488859cc033409d0401daf76157f0e137b9e0e411a" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.629812 4769 scope.go:117] "RemoveContainer" containerID="d8acee167036c7598559c585c217eef54cf47c0cf77300f652401eb4bd4c9aa6" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.652096 4769 scope.go:117] "RemoveContainer" containerID="59b12c11a269cc8bbe3e6e4e210fdb2be762c7e4fb8a1b965510fb8cacd76729" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.699280 4769 scope.go:117] "RemoveContainer" containerID="43d32cc2500dd696e02f6890872da8344483fba20ae709be434f7eda1d0ba363" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.734709 4769 scope.go:117] "RemoveContainer" containerID="87febf2672c90346b1c953c0e954d50a3c3a63e5e87364450e4974a741593acf" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.765820 4769 scope.go:117] "RemoveContainer" containerID="45c1f1016f38de589ca1439d89399344dc5345a130823c71eec319c782975170" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.788332 4769 scope.go:117] "RemoveContainer" containerID="471841b1522d24c8f23a3d9a330a2d294acea07c93a75761a7a56fc8ab69a617" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.808869 4769 scope.go:117] "RemoveContainer" containerID="3fbbcedf203f4f7faab30b9fca7a6bd6b185605fefe1b8336f7e7bffd71cf05b" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.828230 4769 scope.go:117] "RemoveContainer" containerID="ab11cc07b5380dc8fb62a559721f6d9273ace6edd4762e44863fc0d64e7ac1d2" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.870173 4769 scope.go:117] "RemoveContainer" containerID="87636c08827b45b1cf0db585cbd58ea33e909f36ea59c10b74779fbd9b27daf4" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.924431 4769 scope.go:117] "RemoveContainer" containerID="4665ffb220f125aa21d913c977f50ba2763596793870e0ac1a0b0e1778d8e6ef" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.946590 4769 scope.go:117] "RemoveContainer" containerID="233d86a221cce409fc188ed5baf739da4d887d23344238d4e622e1db444734f8" Nov 21 12:58:31 crc kubenswrapper[4769]: I1121 12:58:31.966109 4769 scope.go:117] "RemoveContainer" containerID="c29954e20406b7668feafcdcb73866b526c3a9ddc7ee19889092e3d9d47c2b3a" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.038735 4769 scope.go:117] "RemoveContainer" containerID="0dd0d895f81dbc07e1ecb36491278731065fbfda83dce77e6c945bd1c681a349" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.104671 4769 scope.go:117] "RemoveContainer" containerID="f95591b296f2a5cde1e9e641e145754b0dd77c285d9c10829d97e52eae66fe84" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.150945 4769 scope.go:117] "RemoveContainer" containerID="47fdb25b7dd3ebbda6ae3cc652d395c71966905f6a37ae41f7394d1693f339a6" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.178810 4769 scope.go:117] "RemoveContainer" containerID="51d2cd1befc7ba8b80348cc0ae0e4f598d71f1399c70839c9da3c1c8db09e3cf" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.212178 4769 scope.go:117] "RemoveContainer" containerID="3472332fa29d15b6dfcf5ab1f5c6b97eef238a31c93ef2e45b2128688be47c95" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.252255 4769 scope.go:117] "RemoveContainer" containerID="7b06a6a08b28e192436b433bd09d1e0b1ff8955de4c699f1501068b1b61f53d4" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.271974 4769 scope.go:117] "RemoveContainer" containerID="59f1379a9da6bfd5402457cd0d7bd4a5cdfddc543a7003038f3c89a2fc1575e1" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.296286 4769 scope.go:117] "RemoveContainer" containerID="41a14b4ed09ee1207d1d3291f654c86f69aab747653e0204e5ea4dfc1e55435a" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.316479 4769 scope.go:117] "RemoveContainer" containerID="de406eaf4f5757c6739d9d00407c133d6d94ee5cc3e35eace72932b39b439552" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.333182 4769 scope.go:117] "RemoveContainer" containerID="251fe83d372c9a3a1b1f48054e052600a4b5dc7926941deac831b9171dbfa2ae" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.351911 4769 scope.go:117] "RemoveContainer" containerID="2f2a598af5a736e9cdbff2debd4f3633eda1941244e9836110014879771d9804" Nov 21 12:58:32 crc kubenswrapper[4769]: I1121 12:58:32.369269 4769 scope.go:117] "RemoveContainer" containerID="35456f335a35a75e2f8d6e6b745530938608d87ab79a81f06b5caf03df95018b" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.544068 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.544870 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="cinder-scheduler" containerID="cri-o://5ce9df7a8f70352518e8d22d0a196dbbe29dccbd53f21e9e7d8b11179abd82e0" gracePeriod=30 Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.544948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="probe" containerID="cri-o://1228ced0201a117c2761c96225ab19319009b828626d077abe625a633e51ffef" gracePeriod=30 Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.581716 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.646367 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd"] Nov 21 12:58:38 crc kubenswrapper[4769]: E1121 12:58:38.647285 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="registry-server" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.647297 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="registry-server" Nov 21 12:58:38 crc kubenswrapper[4769]: E1121 12:58:38.647327 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="extract-content" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.647333 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="extract-content" Nov 21 12:58:38 crc kubenswrapper[4769]: E1121 12:58:38.647351 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="extract-utilities" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.647359 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="extract-utilities" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.649778 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="59b72dc7-05bf-4d96-a534-624e8c72826d" containerName="registry-server" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.668624 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.697762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.697868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-combined-ca-bundle\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.697892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-logs\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.697925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data-custom\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.697966 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgrq\" (UniqueName: \"kubernetes.io/projected/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-kube-api-access-tcgrq\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.721035 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.721565 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api-log" containerID="cri-o://8ca909f079592c78269c081787685adb1952af8d28386bb544cd418938c66fab" gracePeriod=30 Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.721708 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api" containerID="cri-o://1198cba46a4bef26b5da0b4696489013c112c4e4647c0e4e818ceddb85e8d4c4" gracePeriod=30 Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.785523 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-75db774dfc-shstm"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.787233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.799066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-combined-ca-bundle\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.799113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-logs\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.799157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data-custom\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.799207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgrq\" (UniqueName: \"kubernetes.io/projected/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-kube-api-access-tcgrq\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.799258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.800433 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-logs\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.813642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-combined-ca-bundle\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.816261 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.826161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.826179 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data-custom\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.838336 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-75db774dfc-shstm"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.868241 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgrq\" (UniqueName: \"kubernetes.io/projected/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-kube-api-access-tcgrq\") pod \"barbican-keystone-listener-56f474c98b-xtrwd\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.890708 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-75db774dfc-shstm"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.900996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-combined-ca-bundle\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.901043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data-custom\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.901088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9mm\" (UniqueName: \"kubernetes.io/projected/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-kube-api-access-nc9mm\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.901129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.901148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-logs\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.916776 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.917418 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:58:38 crc kubenswrapper[4769]: E1121 12:58:38.939526 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data config-data-custom kube-api-access-nc9mm logs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" podUID="fb6d6f7d-3af6-44ff-a71d-ca5574256c10" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.956611 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.958334 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.971568 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.971767 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerName="nova-cell0-conductor-conductor" containerID="cri-o://3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" gracePeriod=30 Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.997215 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2"] Nov 21 12:58:38 crc kubenswrapper[4769]: I1121 12:58:38.999279 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9mm\" (UniqueName: \"kubernetes.io/projected/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-kube-api-access-nc9mm\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-logs\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e40287e-d24f-490a-980a-0f82128eb7d2-logs\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data-custom\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z2vr\" (UniqueName: \"kubernetes.io/projected/4e40287e-d24f-490a-980a-0f82128eb7d2-kube-api-access-5z2vr\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-combined-ca-bundle\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data-custom\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.003697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-combined-ca-bundle\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.006593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-logs\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.031512 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.033847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-combined-ca-bundle\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.040265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.042085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data-custom\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.067669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9mm\" (UniqueName: \"kubernetes.io/projected/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-kube-api-access-nc9mm\") pod \"barbican-worker-75db774dfc-shstm\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.069257 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.069497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" containerName="nova-scheduler-scheduler" containerID="cri-o://9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" gracePeriod=30 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.086335 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.105827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e40287e-d24f-490a-980a-0f82128eb7d2-logs\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.105902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data-custom\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.105940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data-custom\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.105965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.105985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9brm\" (UniqueName: \"kubernetes.io/projected/14a04cbb-912b-4efe-820a-56aa5150ae5c-kube-api-access-d9brm\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.106003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14a04cbb-912b-4efe-820a-56aa5150ae5c-logs\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.106023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5z2vr\" (UniqueName: \"kubernetes.io/projected/4e40287e-d24f-490a-980a-0f82128eb7d2-kube-api-access-5z2vr\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.106046 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.106071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-combined-ca-bundle\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.106093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-combined-ca-bundle\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.106762 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e40287e-d24f-490a-980a-0f82128eb7d2-logs\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.111548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.115816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data-custom\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.123258 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.124592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.139845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-combined-ca-bundle\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.163487 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.170425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z2vr\" (UniqueName: \"kubernetes.io/projected/4e40287e-d24f-490a-980a-0f82128eb7d2-kube-api-access-5z2vr\") pod \"barbican-worker-665f4bd6cf-zd4c7\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.175173 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7946bd886d-x52gg"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.176783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.184791 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.185091 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-log" containerID="cri-o://472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0" gracePeriod=30 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.185247 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-api" containerID="cri-o://cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c" gracePeriod=30 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-scripts\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-httpd-config\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-combined-ca-bundle\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmgv\" (UniqueName: \"kubernetes.io/projected/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-kube-api-access-dkmgv\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-combined-ca-bundle\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-config-data\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-credential-keys\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data-custom\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d9brm\" (UniqueName: \"kubernetes.io/projected/14a04cbb-912b-4efe-820a-56aa5150ae5c-kube-api-access-d9brm\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14a04cbb-912b-4efe-820a-56aa5150ae5c-logs\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-fernet-keys\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-config\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-combined-ca-bundle\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.209924 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dvjd\" (UniqueName: \"kubernetes.io/projected/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-kube-api-access-8dvjd\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.215128 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data-custom\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.215981 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7946bd886d-x52gg"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.216053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14a04cbb-912b-4efe-820a-56aa5150ae5c-logs\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.238248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-combined-ca-bundle\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.244617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9brm\" (UniqueName: \"kubernetes.io/projected/14a04cbb-912b-4efe-820a-56aa5150ae5c-kube-api-access-d9brm\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.245587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data\") pod \"barbican-keystone-listener-568fb8b7b6-lddp2\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.263482 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.263761 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-log" containerID="cri-o://6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea" gracePeriod=30 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.264262 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-metadata" containerID="cri-o://2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e" gracePeriod=30 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.290151 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.0.113:8775/\": EOF" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.290281 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.0.113:8775/\": EOF" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-httpd-config\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-combined-ca-bundle\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmgv\" (UniqueName: \"kubernetes.io/projected/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-kube-api-access-dkmgv\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-combined-ca-bundle\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-config-data\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-credential-keys\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-fernet-keys\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-config\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8dvjd\" (UniqueName: \"kubernetes.io/projected/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-kube-api-access-8dvjd\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.312755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-scripts\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.328575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-httpd-config\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.330793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-credential-keys\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.331444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-combined-ca-bundle\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.333979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-combined-ca-bundle\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.334376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-config\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.336602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-fernet-keys\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.337265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-config-data\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.347665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-scripts\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.353935 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.354656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.378666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dvjd\" (UniqueName: \"kubernetes.io/projected/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-kube-api-access-8dvjd\") pod \"keystone-6b7d9d67cc-2wc94\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.379781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmgv\" (UniqueName: \"kubernetes.io/projected/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-kube-api-access-dkmgv\") pod \"neutron-7946bd886d-x52gg\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.401312 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.409254 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.410944 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.427537 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.429338 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.441277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.452492 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.476289 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.523947 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.524786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.524850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-combined-ca-bundle\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.524868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.524888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9cq\" (UniqueName: \"kubernetes.io/projected/9bcac63b-2c20-48f8-81cb-cf34894fdcda-kube-api-access-kq9cq\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.524910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9f10777-813f-47bb-951d-c78284390239-logs\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.525012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data-custom\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.525035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data-custom\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.525055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-combined-ca-bundle\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.525095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9bcac63b-2c20-48f8-81cb-cf34894fdcda-logs\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.525155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8wb\" (UniqueName: \"kubernetes.io/projected/e9f10777-813f-47bb-951d-c78284390239-kube-api-access-fr8wb\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.557169 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.558607 4769 generic.go:334] "Generic (PLEG): container finished" podID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerID="6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea" exitCode=143 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.558679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4aae878d-4ff7-41f3-b5ce-540752cfc218","Type":"ContainerDied","Data":"6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea"} Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.586933 4769 generic.go:334] "Generic (PLEG): container finished" podID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerID="472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0" exitCode=143 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.587259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d8249847-5e97-4b9d-b86e-88758d4f29a8","Type":"ContainerDied","Data":"472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0"} Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9bcac63b-2c20-48f8-81cb-cf34894fdcda-logs\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8wb\" (UniqueName: \"kubernetes.io/projected/e9f10777-813f-47bb-951d-c78284390239-kube-api-access-fr8wb\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630448 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-combined-ca-bundle\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9cq\" (UniqueName: \"kubernetes.io/projected/9bcac63b-2c20-48f8-81cb-cf34894fdcda-kube-api-access-kq9cq\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9f10777-813f-47bb-951d-c78284390239-logs\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data-custom\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data-custom\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.630605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-combined-ca-bundle\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.631672 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.631917 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5c004188-8379-4fca-8d50-f293586ce6f5" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://865aea95541c123f54deceb22fc360e44124b9c0047ace97f10a3a293953765a" gracePeriod=30 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.632801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9f10777-813f-47bb-951d-c78284390239-logs\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.633343 4769 generic.go:334] "Generic (PLEG): container finished" podID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerID="8ca909f079592c78269c081787685adb1952af8d28386bb544cd418938c66fab" exitCode=143 Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.633405 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.636320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9bcac63b-2c20-48f8-81cb-cf34894fdcda-logs\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.636379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f00f0d0d-e0f5-483c-8995-658e9a5d5389","Type":"ContainerDied","Data":"8ca909f079592c78269c081787685adb1952af8d28386bb544cd418938c66fab"} Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.648758 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.653775 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.654933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.659996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data-custom\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.663599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9cq\" (UniqueName: \"kubernetes.io/projected/9bcac63b-2c20-48f8-81cb-cf34894fdcda-kube-api-access-kq9cq\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.665765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8wb\" (UniqueName: \"kubernetes.io/projected/e9f10777-813f-47bb-951d-c78284390239-kube-api-access-fr8wb\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.665881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.666632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-combined-ca-bundle\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.667617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data-custom\") pod \"barbican-keystone-listener-6c5997bc98-qtzqm\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.670356 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-g7p8l"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.670826 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-combined-ca-bundle\") pod \"barbican-api-75f4c578fb-4g42h\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.679324 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5c004188-8379-4fca-8d50-f293586ce6f5" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"http://10.217.0.105:6080/vnc_lite.html\": dial tcp 10.217.0.105:6080: connect: connection refused" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.732001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data-custom\") pod \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.732102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-combined-ca-bundle\") pod \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.732126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc9mm\" (UniqueName: \"kubernetes.io/projected/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-kube-api-access-nc9mm\") pod \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.732162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-logs\") pod \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.732302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data\") pod \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\" (UID: \"fb6d6f7d-3af6-44ff-a71d-ca5574256c10\") " Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.735775 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data" (OuterVolumeSpecName: "config-data") pod "fb6d6f7d-3af6-44ff-a71d-ca5574256c10" (UID: "fb6d6f7d-3af6-44ff-a71d-ca5574256c10"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.736019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-logs" (OuterVolumeSpecName: "logs") pod "fb6d6f7d-3af6-44ff-a71d-ca5574256c10" (UID: "fb6d6f7d-3af6-44ff-a71d-ca5574256c10"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.740284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fb6d6f7d-3af6-44ff-a71d-ca5574256c10" (UID: "fb6d6f7d-3af6-44ff-a71d-ca5574256c10"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.740429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb6d6f7d-3af6-44ff-a71d-ca5574256c10" (UID: "fb6d6f7d-3af6-44ff-a71d-ca5574256c10"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.742134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-kube-api-access-nc9mm" (OuterVolumeSpecName: "kube-api-access-nc9mm") pod "fb6d6f7d-3af6-44ff-a71d-ca5574256c10" (UID: "fb6d6f7d-3af6-44ff-a71d-ca5574256c10"). InnerVolumeSpecName "kube-api-access-nc9mm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.746231 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.767348 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.837646 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.837675 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.837685 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.837700 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nc9mm\" (UniqueName: \"kubernetes.io/projected/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-kube-api-access-nc9mm\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.837710 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fb6d6f7d-3af6-44ff-a71d-ca5574256c10-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.880349 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc"] Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.882878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.887832 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.888290 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.968610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-config-data\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.968688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-scripts\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.968725 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:39 crc kubenswrapper[4769]: I1121 12:58:39.968992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tq52\" (UniqueName: \"kubernetes.io/projected/55145a65-9d78-41d7-a8eb-74bf51851190-kube-api-access-5tq52\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.005610 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.033394 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.063961 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2"] Nov 21 12:58:40 crc kubenswrapper[4769]: W1121 12:58:40.070427 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f89fc41_2862_4ea7_aaf8_47bc125c9ab8.slice/crio-376ae7adc0d024c6d6b95a20af828ed053e42d7143b9d6ce1c0e41a14622fe48 WatchSource:0}: Error finding container 376ae7adc0d024c6d6b95a20af828ed053e42d7143b9d6ce1c0e41a14622fe48: Status 404 returned error can't find the container with id 376ae7adc0d024c6d6b95a20af828ed053e42d7143b9d6ce1c0e41a14622fe48 Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.071451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5tq52\" (UniqueName: \"kubernetes.io/projected/55145a65-9d78-41d7-a8eb-74bf51851190-kube-api-access-5tq52\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.071507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-config-data\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.071528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-scripts\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.071571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.079479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-scripts\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.085085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-config-data\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.092612 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.109657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tq52\" (UniqueName: \"kubernetes.io/projected/55145a65-9d78-41d7-a8eb-74bf51851190-kube-api-access-5tq52\") pod \"nova-cell1-cell-mapping-brbjc\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.400526 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.436892 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94"] Nov 21 12:58:40 crc kubenswrapper[4769]: W1121 12:58:40.464518 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ced1c7f_b633_4f38_b821_f8eb9cf9b630.slice/crio-d8bba3acfbce64bf337d7b3a6dbab7e462e3220ea8b446b1242d3a52c3d3604b WatchSource:0}: Error finding container d8bba3acfbce64bf337d7b3a6dbab7e462e3220ea8b446b1242d3a52c3d3604b: Status 404 returned error can't find the container with id d8bba3acfbce64bf337d7b3a6dbab7e462e3220ea8b446b1242d3a52c3d3604b Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.509932 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.539843 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.540058 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="f19f65b0-2588-4629-8d78-d8ba857f4506" containerName="memcached" containerID="cri-o://3291ca59e581d8188a9be433dc53c05ad6102f59b42770b6f81df910d30c66fd" gracePeriod=30 Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.640475 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.640980 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-log" containerID="cri-o://57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62" gracePeriod=30 Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.641502 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-httpd" containerID="cri-o://c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168" gracePeriod=30 Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.661877 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerID="1228ced0201a117c2761c96225ab19319009b828626d077abe625a633e51ffef" exitCode=0 Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.662125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ed80d6c8-9e92-431d-9a46-6d9f4c9be521","Type":"ContainerDied","Data":"1228ced0201a117c2761c96225ab19319009b828626d077abe625a633e51ffef"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.669472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" event={"ID":"14a04cbb-912b-4efe-820a-56aa5150ae5c","Type":"ContainerStarted","Data":"528de19b839ac92f8cac0dad7947e159b3d2704936cdbfe12fea13a57d82b571"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.669513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" event={"ID":"14a04cbb-912b-4efe-820a-56aa5150ae5c","Type":"ContainerStarted","Data":"865b6f9a3c9bdee2802eeb9c177b37673fa2fb64d4f4c25469d93c0871de37db"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.682654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" event={"ID":"4e40287e-d24f-490a-980a-0f82128eb7d2","Type":"ContainerStarted","Data":"d741b3d808106aff5b56fc58b5f28690774cfe341b9b305c13eaad2c36f81eb3"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.691749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" event={"ID":"9ced1c7f-b633-4f38-b821-f8eb9cf9b630","Type":"ContainerStarted","Data":"d8bba3acfbce64bf337d7b3a6dbab7e462e3220ea8b446b1242d3a52c3d3604b"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.706966 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-75db774dfc-shstm" Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.712216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" event={"ID":"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8","Type":"ContainerStarted","Data":"08f461aac05c605db54671fcc51feb3a9cd18ea03a631927fafecfc23b718a44"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.712262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" event={"ID":"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8","Type":"ContainerStarted","Data":"376ae7adc0d024c6d6b95a20af828ed053e42d7143b9d6ce1c0e41a14622fe48"} Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.888501 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-75db774dfc-shstm"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.946664 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-75db774dfc-shstm"] Nov 21 12:58:40 crc kubenswrapper[4769]: I1121 12:58:40.962799 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7946bd886d-x52gg"] Nov 21 12:58:41 crc kubenswrapper[4769]: E1121 12:58:41.011568 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:58:41 crc kubenswrapper[4769]: E1121 12:58:41.020363 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.039792 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.040117 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-log" containerID="cri-o://09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.040342 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-httpd" containerID="cri-o://fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.064375 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm"] Nov 21 12:58:41 crc kubenswrapper[4769]: E1121 12:58:41.075870 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 12:58:41 crc kubenswrapper[4769]: E1121 12:58:41.076139 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" containerName="nova-scheduler-scheduler" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.104342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.104820 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-server" containerID="cri-o://f3c41189207483bed741fbe1eca04b77d12b0a5d653df610f2d21a60b9a3a52e" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.104873 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-server" containerID="cri-o://e26b4cb65ba7c4dbcd4dcb1eb2abb174ebfbfd08960a9e959fef0d9f09596514" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.104941 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-updater" containerID="cri-o://6a29f76a44115ba58e6d5a4148557676be04e40e200d9bf5daaa2fb476cf3f7b" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.104981 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-auditor" containerID="cri-o://4afbb1d41d0984afaa018a0eeadb6bdb8b8c1c3a685f776c033e7063720abe7f" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105014 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-replicator" containerID="cri-o://6e418a77e087210f81458a321f94daae19a012f31eb05c53218977f73c0c7ecb" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105052 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-server" containerID="cri-o://4a53429063a1abad29db3e93af022c9698bde19d8f26120ed10411fc798631b2" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105080 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-reaper" containerID="cri-o://7658acd3127c093ed6b53623fb41ae6ed83614172dec592ab8d7bd54e99d122c" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105132 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-auditor" containerID="cri-o://48aaa1398a01cfdf10e3e994a6b204b33ab3cbffa345e750ec9e6fb4459d9b6a" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105161 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-replicator" containerID="cri-o://19cae6c40c04f2d0b6aa8a7acdbccbe3b0829f9be0af252bfb2442dd0e24a934" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105222 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-expirer" containerID="cri-o://f765683feb2e0f1426e0b16abb61222a212032fa7183cd04c6c236404896b156" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105254 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="swift-recon-cron" containerID="cri-o://92a838ac1402ea733ff16d45dc7cadef991e4de13e448a4e4f43472db87a572a" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105256 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-updater" containerID="cri-o://f5df53c59e1375fac0d8b0375bc81d73bacd1a0151d23df40f8e6bfd65223e20" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105281 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="rsync" containerID="cri-o://48ac78290719a28b8a65fb2b1e00ce46444a0022eb4974d5f57bbf6a9cbc83ea" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105299 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-auditor" containerID="cri-o://ae730ab8fb5d7e35b715a5162b533d15ac439a26f800265a1333b62a112c5d1e" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.105326 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-replicator" containerID="cri-o://a413b78de0d50873bb41e7a995c611bfdee6d291a98621d94c00ac3bc624cb52" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.124987 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.171300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.177719 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.223028 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="rabbitmq" containerID="cri-o://a9406414b96be5316ab9bee81dc5ccd2d6f8d44630478e05d518adee9f641ca4" gracePeriod=604798 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.472041 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c0493a-baa8-4d36-8d5f-1b5f678c9758" path="/var/lib/kubelet/pods/31c0493a-baa8-4d36-8d5f-1b5f678c9758/volumes" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.472853 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb6d6f7d-3af6-44ff-a71d-ca5574256c10" path="/var/lib/kubelet/pods/fb6d6f7d-3af6-44ff-a71d-ca5574256c10/volumes" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.473220 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-84b444c894-pd4jt"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.474554 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7946bd886d-x52gg"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.474573 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-84b444c894-pd4jt"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.474584 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-bfffc88b6-kqz6h"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.480631 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.481077 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.490606 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-bfffc88b6-kqz6h"] Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-httpd-config\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-credential-keys\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-combined-ca-bundle\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g67dt\" (UniqueName: \"kubernetes.io/projected/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-kube-api-access-g67dt\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-config-data\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624201 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42n9s\" (UniqueName: \"kubernetes.io/projected/0156a1b9-6b80-4297-8d9e-d65152984ecf-kube-api-access-42n9s\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624224 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-scripts\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-fernet-keys\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-config\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.624390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-combined-ca-bundle\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-httpd-config\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-credential-keys\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-combined-ca-bundle\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-config-data\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g67dt\" (UniqueName: \"kubernetes.io/projected/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-kube-api-access-g67dt\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-42n9s\" (UniqueName: \"kubernetes.io/projected/0156a1b9-6b80-4297-8d9e-d65152984ecf-kube-api-access-42n9s\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-scripts\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-fernet-keys\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-config\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.726864 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-combined-ca-bundle\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.735831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-httpd-config\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.750034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-combined-ca-bundle\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.751942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-combined-ca-bundle\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.751973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-fernet-keys\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.752287 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-credential-keys\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.752631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-scripts\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.754461 4769 generic.go:334] "Generic (PLEG): container finished" podID="f19f65b0-2588-4629-8d78-d8ba857f4506" containerID="3291ca59e581d8188a9be433dc53c05ad6102f59b42770b6f81df910d30c66fd" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.754529 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f19f65b0-2588-4629-8d78-d8ba857f4506","Type":"ContainerDied","Data":"3291ca59e581d8188a9be433dc53c05ad6102f59b42770b6f81df910d30c66fd"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.782045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-config\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.782617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-config-data\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.783405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g67dt\" (UniqueName: \"kubernetes.io/projected/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-kube-api-access-g67dt\") pod \"keystone-84b444c894-pd4jt\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.785653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-42n9s\" (UniqueName: \"kubernetes.io/projected/0156a1b9-6b80-4297-8d9e-d65152984ecf-kube-api-access-42n9s\") pod \"neutron-bfffc88b6-kqz6h\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.792888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" event={"ID":"e9f10777-813f-47bb-951d-c78284390239","Type":"ContainerStarted","Data":"5554db9172d9b99fe4f9c347602089211c503cf5287fb1877ed7fa51dc736876"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.800950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" event={"ID":"45e04521-ef96-4028-9f3b-3b0bafbe2a8d","Type":"ContainerStarted","Data":"942c34f335fe1883be11f81cde7374286770b9eabdcf158947fcbb69a216e83b"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.825894 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="48ac78290719a28b8a65fb2b1e00ce46444a0022eb4974d5f57bbf6a9cbc83ea" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826159 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="f765683feb2e0f1426e0b16abb61222a212032fa7183cd04c6c236404896b156" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826168 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="f5df53c59e1375fac0d8b0375bc81d73bacd1a0151d23df40f8e6bfd65223e20" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826176 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="ae730ab8fb5d7e35b715a5162b533d15ac439a26f800265a1333b62a112c5d1e" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826182 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="a413b78de0d50873bb41e7a995c611bfdee6d291a98621d94c00ac3bc624cb52" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826205 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="6a29f76a44115ba58e6d5a4148557676be04e40e200d9bf5daaa2fb476cf3f7b" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826214 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="4afbb1d41d0984afaa018a0eeadb6bdb8b8c1c3a685f776c033e7063720abe7f" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826220 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="7658acd3127c093ed6b53623fb41ae6ed83614172dec592ab8d7bd54e99d122c" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826228 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="19cae6c40c04f2d0b6aa8a7acdbccbe3b0829f9be0af252bfb2442dd0e24a934" exitCode=0 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"48ac78290719a28b8a65fb2b1e00ce46444a0022eb4974d5f57bbf6a9cbc83ea"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"f765683feb2e0f1426e0b16abb61222a212032fa7183cd04c6c236404896b156"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"f5df53c59e1375fac0d8b0375bc81d73bacd1a0151d23df40f8e6bfd65223e20"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"ae730ab8fb5d7e35b715a5162b533d15ac439a26f800265a1333b62a112c5d1e"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"a413b78de0d50873bb41e7a995c611bfdee6d291a98621d94c00ac3bc624cb52"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"6a29f76a44115ba58e6d5a4148557676be04e40e200d9bf5daaa2fb476cf3f7b"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"4afbb1d41d0984afaa018a0eeadb6bdb8b8c1c3a685f776c033e7063720abe7f"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"7658acd3127c093ed6b53623fb41ae6ed83614172dec592ab8d7bd54e99d122c"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.826358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"19cae6c40c04f2d0b6aa8a7acdbccbe3b0829f9be0af252bfb2442dd0e24a934"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.848059 4769 generic.go:334] "Generic (PLEG): container finished" podID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerID="57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62" exitCode=143 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.848137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83541dda-7a5e-4390-beba-4fa7bc472a8d","Type":"ContainerDied","Data":"57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.893604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" event={"ID":"14a04cbb-912b-4efe-820a-56aa5150ae5c","Type":"ContainerStarted","Data":"6164032da3c84d3e4e7f81f08212961d826c131dd4b8fce339cb2977daf4ef49"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.893876 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener-log" containerID="cri-o://528de19b839ac92f8cac0dad7947e159b3d2704936cdbfe12fea13a57d82b571" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.894058 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener" containerID="cri-o://6164032da3c84d3e4e7f81f08212961d826c131dd4b8fce339cb2977daf4ef49" gracePeriod=30 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.902036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" event={"ID":"55145a65-9d78-41d7-a8eb-74bf51851190","Type":"ContainerStarted","Data":"0e8c27fa69a0fff5b8260cc6b980f50111ebe0f27a5a6d88d3f0f96ef81fc5ce"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.927876 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" podStartSLOduration=3.927861499 podStartE2EDuration="3.927861499s" podCreationTimestamp="2025-11-21 12:58:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:41.926991355 +0000 UTC m=+4080.627653173" watchObservedRunningTime="2025-11-21 12:58:41.927861499 +0000 UTC m=+4080.628523317" Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.930633 4769 generic.go:334] "Generic (PLEG): container finished" podID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerID="09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985" exitCode=143 Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.930764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c8dd19be-92f0-4348-9515-f5a8654256f7","Type":"ContainerDied","Data":"09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.951833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" event={"ID":"9bcac63b-2c20-48f8-81cb-cf34894fdcda","Type":"ContainerStarted","Data":"5ae77bcfd0bb10b5bfb4a59b3ac5821e62c2b4f233f76f1761e94d705e532cf0"} Nov 21 12:58:41 crc kubenswrapper[4769]: I1121 12:58:41.991531 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.038516 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.277847 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="rabbitmq" containerID="cri-o://bb7913ca5ec0f188e66436ec552e90fbe1261d1870b97d0f697d6b766befad1a" gracePeriod=604798 Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.572469 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api" probeResult="failure" output="Get \"http://10.217.1.249:8776/healthcheck\": read tcp 10.217.0.2:60512->10.217.1.249:8776: read: connection reset by peer" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.594109 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.658930 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-config-data\") pod \"f19f65b0-2588-4629-8d78-d8ba857f4506\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.658973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llnz7\" (UniqueName: \"kubernetes.io/projected/f19f65b0-2588-4629-8d78-d8ba857f4506-kube-api-access-llnz7\") pod \"f19f65b0-2588-4629-8d78-d8ba857f4506\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.658994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-kolla-config\") pod \"f19f65b0-2588-4629-8d78-d8ba857f4506\" (UID: \"f19f65b0-2588-4629-8d78-d8ba857f4506\") " Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.659773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-config-data" (OuterVolumeSpecName: "config-data") pod "f19f65b0-2588-4629-8d78-d8ba857f4506" (UID: "f19f65b0-2588-4629-8d78-d8ba857f4506"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.660272 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "f19f65b0-2588-4629-8d78-d8ba857f4506" (UID: "f19f65b0-2588-4629-8d78-d8ba857f4506"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.667432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19f65b0-2588-4629-8d78-d8ba857f4506-kube-api-access-llnz7" (OuterVolumeSpecName: "kube-api-access-llnz7") pod "f19f65b0-2588-4629-8d78-d8ba857f4506" (UID: "f19f65b0-2588-4629-8d78-d8ba857f4506"). InnerVolumeSpecName "kube-api-access-llnz7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.712796 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.780541 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.780573 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-llnz7\" (UniqueName: \"kubernetes.io/projected/f19f65b0-2588-4629-8d78-d8ba857f4506-kube-api-access-llnz7\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.780584 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f19f65b0-2588-4629-8d78-d8ba857f4506-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.881511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-combined-ca-bundle\") pod \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.881646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-config-data\") pod \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.881844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjtgv\" (UniqueName: \"kubernetes.io/projected/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-kube-api-access-wjtgv\") pod \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\" (UID: \"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21\") " Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.935613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-kube-api-access-wjtgv" (OuterVolumeSpecName: "kube-api-access-wjtgv") pod "1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" (UID: "1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21"). InnerVolumeSpecName "kube-api-access-wjtgv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:42 crc kubenswrapper[4769]: I1121 12:58:42.983874 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjtgv\" (UniqueName: \"kubernetes.io/projected/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-kube-api-access-wjtgv\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.005965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" event={"ID":"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8","Type":"ContainerStarted","Data":"4e318af89f022e0d78c68eb8f7a7f3908c2625db2c637810bad9fc2884a949e3"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.006098 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener-log" containerID="cri-o://08f461aac05c605db54671fcc51feb3a9cd18ea03a631927fafecfc23b718a44" gracePeriod=30 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.006442 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener" containerID="cri-o://4e318af89f022e0d78c68eb8f7a7f3908c2625db2c637810bad9fc2884a949e3" gracePeriod=30 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.022558 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerID="5ce9df7a8f70352518e8d22d0a196dbbe29dccbd53f21e9e7d8b11179abd82e0" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.022619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ed80d6c8-9e92-431d-9a46-6d9f4c9be521","Type":"ContainerDied","Data":"5ce9df7a8f70352518e8d22d0a196dbbe29dccbd53f21e9e7d8b11179abd82e0"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.030037 4769 generic.go:334] "Generic (PLEG): container finished" podID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerID="528de19b839ac92f8cac0dad7947e159b3d2704936cdbfe12fea13a57d82b571" exitCode=143 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.030094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" event={"ID":"14a04cbb-912b-4efe-820a-56aa5150ae5c","Type":"ContainerDied","Data":"528de19b839ac92f8cac0dad7947e159b3d2704936cdbfe12fea13a57d82b571"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.033135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" event={"ID":"4e40287e-d24f-490a-980a-0f82128eb7d2","Type":"ContainerStarted","Data":"43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.050071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" event={"ID":"9ced1c7f-b633-4f38-b821-f8eb9cf9b630","Type":"ContainerStarted","Data":"69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.050226 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" podUID="9ced1c7f-b633-4f38-b821-f8eb9cf9b630" containerName="keystone-api" containerID="cri-o://69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6" gracePeriod=30 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.050326 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.073863 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" podStartSLOduration=5.073840262 podStartE2EDuration="5.073840262s" podCreationTimestamp="2025-11-21 12:58:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:43.036667031 +0000 UTC m=+4081.737328869" watchObservedRunningTime="2025-11-21 12:58:43.073840262 +0000 UTC m=+4081.774502080" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.101228 4769 generic.go:334] "Generic (PLEG): container finished" podID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.101334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21","Type":"ContainerDied","Data":"9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.101377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21","Type":"ContainerDied","Data":"fbd87c7dbc47c2c7bcf5c4dfbef6f6cf48d497b579010b404a16d04f185c2fd9"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.101394 4769 scope.go:117] "RemoveContainer" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.101563 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.108921 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" podStartSLOduration=5.108901386 podStartE2EDuration="5.108901386s" podCreationTimestamp="2025-11-21 12:58:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:43.064510171 +0000 UTC m=+4081.765171989" watchObservedRunningTime="2025-11-21 12:58:43.108901386 +0000 UTC m=+4081.809563204" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.130263 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c004188-8379-4fca-8d50-f293586ce6f5" containerID="865aea95541c123f54deceb22fc360e44124b9c0047ace97f10a3a293953765a" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.130340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5c004188-8379-4fca-8d50-f293586ce6f5","Type":"ContainerDied","Data":"865aea95541c123f54deceb22fc360e44124b9c0047ace97f10a3a293953765a"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.158023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" event={"ID":"45e04521-ef96-4028-9f3b-3b0bafbe2a8d","Type":"ContainerStarted","Data":"daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c"} Nov 21 12:58:43 crc kubenswrapper[4769]: E1121 12:58:43.166899 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:58:43 crc kubenswrapper[4769]: E1121 12:58:43.185543 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187077 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="e26b4cb65ba7c4dbcd4dcb1eb2abb174ebfbfd08960a9e959fef0d9f09596514" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187098 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="6e418a77e087210f81458a321f94daae19a012f31eb05c53218977f73c0c7ecb" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187107 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="4a53429063a1abad29db3e93af022c9698bde19d8f26120ed10411fc798631b2" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187114 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="48aaa1398a01cfdf10e3e994a6b204b33ab3cbffa345e750ec9e6fb4459d9b6a" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187120 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="f3c41189207483bed741fbe1eca04b77d12b0a5d653df610f2d21a60b9a3a52e" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"e26b4cb65ba7c4dbcd4dcb1eb2abb174ebfbfd08960a9e959fef0d9f09596514"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"6e418a77e087210f81458a321f94daae19a012f31eb05c53218977f73c0c7ecb"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"4a53429063a1abad29db3e93af022c9698bde19d8f26120ed10411fc798631b2"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"48aaa1398a01cfdf10e3e994a6b204b33ab3cbffa345e750ec9e6fb4459d9b6a"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.187351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"f3c41189207483bed741fbe1eca04b77d12b0a5d653df610f2d21a60b9a3a52e"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.188804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-config-data" (OuterVolumeSpecName: "config-data") pod "1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" (UID: "1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:43 crc kubenswrapper[4769]: E1121 12:58:43.189273 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:58:43 crc kubenswrapper[4769]: E1121 12:58:43.189326 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerName="nova-cell0-conductor-conductor" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.189821 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-bfffc88b6-kqz6h"] Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.193069 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.198326 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-84b444c894-pd4jt"] Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.257894 4769 generic.go:334] "Generic (PLEG): container finished" podID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerID="1198cba46a4bef26b5da0b4696489013c112c4e4647c0e4e818ceddb85e8d4c4" exitCode=0 Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.257995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f00f0d0d-e0f5-483c-8995-658e9a5d5389","Type":"ContainerDied","Data":"1198cba46a4bef26b5da0b4696489013c112c4e4647c0e4e818ceddb85e8d4c4"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.261065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f19f65b0-2588-4629-8d78-d8ba857f4506","Type":"ContainerDied","Data":"625627ed2022d7fbe969bc14477e4fd98296a4bd8c82984a5c49462c6421c3b3"} Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.261134 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.296512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" (UID: "1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.404962 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.793935 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.833847 4769 scope.go:117] "RemoveContainer" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" Nov 21 12:58:43 crc kubenswrapper[4769]: E1121 12:58:43.841345 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c\": container with ID starting with 9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c not found: ID does not exist" containerID="9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.841387 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c"} err="failed to get container status \"9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c\": rpc error: code = NotFound desc = could not find container \"9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c\": container with ID starting with 9a5eb175aebbcf704f09ae2a8445bb0fe4832def657bfdda5a8dcc3a31b7249c not found: ID does not exist" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.841412 4769 scope.go:117] "RemoveContainer" containerID="3291ca59e581d8188a9be433dc53c05ad6102f59b42770b6f81df910d30c66fd" Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.936157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-config-data\") pod \"5c004188-8379-4fca-8d50-f293586ce6f5\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.936356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjhqd\" (UniqueName: \"kubernetes.io/projected/5c004188-8379-4fca-8d50-f293586ce6f5-kube-api-access-sjhqd\") pod \"5c004188-8379-4fca-8d50-f293586ce6f5\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.936378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-combined-ca-bundle\") pod \"5c004188-8379-4fca-8d50-f293586ce6f5\" (UID: \"5c004188-8379-4fca-8d50-f293586ce6f5\") " Nov 21 12:58:43 crc kubenswrapper[4769]: I1121 12:58:43.950142 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c004188-8379-4fca-8d50-f293586ce6f5-kube-api-access-sjhqd" (OuterVolumeSpecName: "kube-api-access-sjhqd") pod "5c004188-8379-4fca-8d50-f293586ce6f5" (UID: "5c004188-8379-4fca-8d50-f293586ce6f5"). InnerVolumeSpecName "kube-api-access-sjhqd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.041519 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sjhqd\" (UniqueName: \"kubernetes.io/projected/5c004188-8379-4fca-8d50-f293586ce6f5-kube-api-access-sjhqd\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.048750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c004188-8379-4fca-8d50-f293586ce6f5" (UID: "5c004188-8379-4fca-8d50-f293586ce6f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.060841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-config-data" (OuterVolumeSpecName: "config-data") pod "5c004188-8379-4fca-8d50-f293586ce6f5" (UID: "5c004188-8379-4fca-8d50-f293586ce6f5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.067477 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.142842 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data-custom\") pod \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.143468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-combined-ca-bundle\") pod \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.143584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data\") pod \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.143711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-scripts\") pod \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.143831 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2927q\" (UniqueName: \"kubernetes.io/projected/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-kube-api-access-2927q\") pod \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.143964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-etc-machine-id\") pod \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\" (UID: \"ed80d6c8-9e92-431d-9a46-6d9f4c9be521\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.145159 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.145412 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c004188-8379-4fca-8d50-f293586ce6f5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.145513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ed80d6c8-9e92-431d-9a46-6d9f4c9be521" (UID: "ed80d6c8-9e92-431d-9a46-6d9f4c9be521"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.152000 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-kube-api-access-2927q" (OuterVolumeSpecName: "kube-api-access-2927q") pod "ed80d6c8-9e92-431d-9a46-6d9f4c9be521" (UID: "ed80d6c8-9e92-431d-9a46-6d9f4c9be521"). InnerVolumeSpecName "kube-api-access-2927q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.152015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ed80d6c8-9e92-431d-9a46-6d9f4c9be521" (UID: "ed80d6c8-9e92-431d-9a46-6d9f4c9be521"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.154345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-scripts" (OuterVolumeSpecName: "scripts") pod "ed80d6c8-9e92-431d-9a46-6d9f4c9be521" (UID: "ed80d6c8-9e92-431d-9a46-6d9f4c9be521"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.171161 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.175155 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.193913 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.198880 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f00f0d0d-e0f5-483c-8995-658e9a5d5389-etc-machine-id\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248651 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f00f0d0d-e0f5-483c-8995-658e9a5d5389-logs\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-combined-ca-bundle\") pod \"d8249847-5e97-4b9d-b86e-88758d4f29a8\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-config-data\") pod \"d8249847-5e97-4b9d-b86e-88758d4f29a8\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qps6q\" (UniqueName: \"kubernetes.io/projected/f00f0d0d-e0f5-483c-8995-658e9a5d5389-kube-api-access-qps6q\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-scripts\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.248998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data-custom\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.249030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-combined-ca-bundle\") pod \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\" (UID: \"f00f0d0d-e0f5-483c-8995-658e9a5d5389\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.249773 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.249791 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.249802 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.249811 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2927q\" (UniqueName: \"kubernetes.io/projected/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-kube-api-access-2927q\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.254901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f00f0d0d-e0f5-483c-8995-658e9a5d5389-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.257587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00f0d0d-e0f5-483c-8995-658e9a5d5389-logs" (OuterVolumeSpecName: "logs") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.309844 4769 generic.go:334] "Generic (PLEG): container finished" podID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerID="cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c" exitCode=0 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.309911 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d8249847-5e97-4b9d-b86e-88758d4f29a8","Type":"ContainerDied","Data":"cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.310014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d8249847-5e97-4b9d-b86e-88758d4f29a8","Type":"ContainerDied","Data":"36c7761da9689653bcbc74d81b4cbac8b503b2e8d89bc4bc2f9f818db47e8d8a"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.310040 4769 scope.go:117] "RemoveContainer" containerID="cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.310177 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.318634 4769 generic.go:334] "Generic (PLEG): container finished" podID="9ced1c7f-b633-4f38-b821-f8eb9cf9b630" containerID="69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6" exitCode=0 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.318716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" event={"ID":"9ced1c7f-b633-4f38-b821-f8eb9cf9b630","Type":"ContainerDied","Data":"69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.318746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" event={"ID":"9ced1c7f-b633-4f38-b821-f8eb9cf9b630","Type":"ContainerDied","Data":"d8bba3acfbce64bf337d7b3a6dbab7e462e3220ea8b446b1242d3a52c3d3604b"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.318810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.327486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" event={"ID":"4e40287e-d24f-490a-980a-0f82128eb7d2","Type":"ContainerStarted","Data":"6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.332933 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-scripts" (OuterVolumeSpecName: "scripts") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.333087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" event={"ID":"55145a65-9d78-41d7-a8eb-74bf51851190","Type":"ContainerStarted","Data":"1e354112d0c49340b8976062f563e0f86b3710f5c63746af8f9e5f541fbd1149"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.345558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00f0d0d-e0f5-483c-8995-658e9a5d5389-kube-api-access-qps6q" (OuterVolumeSpecName: "kube-api-access-qps6q") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "kube-api-access-qps6q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.345998 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" podStartSLOduration=6.345985454 podStartE2EDuration="6.345985454s" podCreationTimestamp="2025-11-21 12:58:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:44.345557673 +0000 UTC m=+4083.046219491" watchObservedRunningTime="2025-11-21 12:58:44.345985454 +0000 UTC m=+4083.046647272" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-config-data\") pod \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-scripts\") pod \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k52pq\" (UniqueName: \"kubernetes.io/projected/4aae878d-4ff7-41f3-b5ce-540752cfc218-kube-api-access-k52pq\") pod \"4aae878d-4ff7-41f3-b5ce-540752cfc218\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352652 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerID="08f461aac05c605db54671fcc51feb3a9cd18ea03a631927fafecfc23b718a44" exitCode=143 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dvjd\" (UniqueName: \"kubernetes.io/projected/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-kube-api-access-8dvjd\") pod \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" event={"ID":"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8","Type":"ContainerDied","Data":"08f461aac05c605db54671fcc51feb3a9cd18ea03a631927fafecfc23b718a44"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-fernet-keys\") pod \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-config-data\") pod \"4aae878d-4ff7-41f3-b5ce-540752cfc218\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4aae878d-4ff7-41f3-b5ce-540752cfc218-logs\") pod \"4aae878d-4ff7-41f3-b5ce-540752cfc218\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352882 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxjfn\" (UniqueName: \"kubernetes.io/projected/d8249847-5e97-4b9d-b86e-88758d4f29a8-kube-api-access-nxjfn\") pod \"d8249847-5e97-4b9d-b86e-88758d4f29a8\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.354059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.352902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-combined-ca-bundle\") pod \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8249847-5e97-4b9d-b86e-88758d4f29a8-logs\") pod \"d8249847-5e97-4b9d-b86e-88758d4f29a8\" (UID: \"d8249847-5e97-4b9d-b86e-88758d4f29a8\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-combined-ca-bundle\") pod \"4aae878d-4ff7-41f3-b5ce-540752cfc218\" (UID: \"4aae878d-4ff7-41f3-b5ce-540752cfc218\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-credential-keys\") pod \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\" (UID: \"9ced1c7f-b633-4f38-b821-f8eb9cf9b630\") " Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358833 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qps6q\" (UniqueName: \"kubernetes.io/projected/f00f0d0d-e0f5-483c-8995-658e9a5d5389-kube-api-access-qps6q\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358848 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358858 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358867 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f00f0d0d-e0f5-483c-8995-658e9a5d5389-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.358875 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f00f0d0d-e0f5-483c-8995-658e9a5d5389-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.364412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" event={"ID":"3c195dbf-9a18-4d12-a66d-0fa74d151b2d","Type":"ContainerStarted","Data":"47b6bc697e3500829ddf4b84a70336662dc022903409d028fab3717f819ca183"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.366533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aae878d-4ff7-41f3-b5ce-540752cfc218-logs" (OuterVolumeSpecName: "logs") pod "4aae878d-4ff7-41f3-b5ce-540752cfc218" (UID: "4aae878d-4ff7-41f3-b5ce-540752cfc218"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.375080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8249847-5e97-4b9d-b86e-88758d4f29a8-logs" (OuterVolumeSpecName: "logs") pod "d8249847-5e97-4b9d-b86e-88758d4f29a8" (UID: "d8249847-5e97-4b9d-b86e-88758d4f29a8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.389054 4769 scope.go:117] "RemoveContainer" containerID="472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.389920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" event={"ID":"e9f10777-813f-47bb-951d-c78284390239","Type":"ContainerStarted","Data":"eacab1816caa9472de1b1ff2272a52617b31c3ed7a01468b68054c598fa0b900"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.390333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-kube-api-access-8dvjd" (OuterVolumeSpecName: "kube-api-access-8dvjd") pod "9ced1c7f-b633-4f38-b821-f8eb9cf9b630" (UID: "9ced1c7f-b633-4f38-b821-f8eb9cf9b630"). InnerVolumeSpecName "kube-api-access-8dvjd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.394635 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" podStartSLOduration=5.394620854 podStartE2EDuration="5.394620854s" podCreationTimestamp="2025-11-21 12:58:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:44.372484088 +0000 UTC m=+4083.073145906" watchObservedRunningTime="2025-11-21 12:58:44.394620854 +0000 UTC m=+4083.095282672" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.403678 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-scripts" (OuterVolumeSpecName: "scripts") pod "9ced1c7f-b633-4f38-b821-f8eb9cf9b630" (UID: "9ced1c7f-b633-4f38-b821-f8eb9cf9b630"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.406007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aae878d-4ff7-41f3-b5ce-540752cfc218-kube-api-access-k52pq" (OuterVolumeSpecName: "kube-api-access-k52pq") pod "4aae878d-4ff7-41f3-b5ce-540752cfc218" (UID: "4aae878d-4ff7-41f3-b5ce-540752cfc218"). InnerVolumeSpecName "kube-api-access-k52pq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.407075 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ed80d6c8-9e92-431d-9a46-6d9f4c9be521","Type":"ContainerDied","Data":"0dbbecf471a48320610ec039a7f5dd3ac320d9f0c9288bfe0b727aa0ba119fbb"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.407435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.413504 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5c004188-8379-4fca-8d50-f293586ce6f5","Type":"ContainerDied","Data":"fda319671db953e677c2eb8511ef61f4e08edcb62d7be200ff6330d71e28325d"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.413543 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.417283 4769 scope.go:117] "RemoveContainer" containerID="cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.417964 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c\": container with ID starting with cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c not found: ID does not exist" containerID="cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.417992 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c"} err="failed to get container status \"cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c\": rpc error: code = NotFound desc = could not find container \"cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c\": container with ID starting with cbdccd503e4212d962ff32d08b7c0b49e8da5ddd9cfc49b3d0ef1ea87c13ec0c not found: ID does not exist" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.418034 4769 scope.go:117] "RemoveContainer" containerID="472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.418376 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0\": container with ID starting with 472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0 not found: ID does not exist" containerID="472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.418399 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0"} err="failed to get container status \"472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0\": rpc error: code = NotFound desc = could not find container \"472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0\": container with ID starting with 472072842ddd2b337b9e7c5e67049646f028589ea205b595a42e7417c17318a0 not found: ID does not exist" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.418411 4769 scope.go:117] "RemoveContainer" containerID="69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.421200 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"f00f0d0d-e0f5-483c-8995-658e9a5d5389","Type":"ContainerDied","Data":"69ca6f26d0096f1b968f43aff354b2a57b0ce71242a3ffecbdcebfeb24e735af"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.421288 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.424412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "9ced1c7f-b633-4f38-b821-f8eb9cf9b630" (UID: "9ced1c7f-b633-4f38-b821-f8eb9cf9b630"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.425054 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8249847-5e97-4b9d-b86e-88758d4f29a8-kube-api-access-nxjfn" (OuterVolumeSpecName: "kube-api-access-nxjfn") pod "d8249847-5e97-4b9d-b86e-88758d4f29a8" (UID: "d8249847-5e97-4b9d-b86e-88758d4f29a8"). InnerVolumeSpecName "kube-api-access-nxjfn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.430174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" event={"ID":"9bcac63b-2c20-48f8-81cb-cf34894fdcda","Type":"ContainerStarted","Data":"8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.433381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" event={"ID":"0156a1b9-6b80-4297-8d9e-d65152984ecf","Type":"ContainerStarted","Data":"4d19ef2f4ec7f1f456c931758e9f2a00d83658bb7afe6eaed591287da7e5b41c"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.433616 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54d98cf849-m295z"] Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.433859 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker-log" containerID="cri-o://eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b" gracePeriod=30 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.433878 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker" containerID="cri-o://11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490" gracePeriod=30 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.445726 4769 generic.go:334] "Generic (PLEG): container finished" podID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerID="2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e" exitCode=0 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.445803 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4aae878d-4ff7-41f3-b5ce-540752cfc218","Type":"ContainerDied","Data":"2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.445838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4aae878d-4ff7-41f3-b5ce-540752cfc218","Type":"ContainerDied","Data":"3c1a401c715975078a9726835cbb5458dcd1fda4d419b340911ec8ce119da90e"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.445926 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.446513 4769 scope.go:117] "RemoveContainer" containerID="69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.450818 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6\": container with ID starting with 69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6 not found: ID does not exist" containerID="69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.450866 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6"} err="failed to get container status \"69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6\": rpc error: code = NotFound desc = could not find container \"69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6\": container with ID starting with 69cf094a043b8e0a5217dbb8d1d641297766c7484555cbfc90f43b525c73ddf6 not found: ID does not exist" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.451025 4769 scope.go:117] "RemoveContainer" containerID="1228ced0201a117c2761c96225ab19319009b828626d077abe625a633e51ffef" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.453497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" event={"ID":"45e04521-ef96-4028-9f3b-3b0bafbe2a8d","Type":"ContainerStarted","Data":"4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56"} Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.453787 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-api" containerID="cri-o://daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c" gracePeriod=30 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.453997 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.454035 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-httpd" containerID="cri-o://4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56" gracePeriod=30 Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.456255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "9ced1c7f-b633-4f38-b821-f8eb9cf9b630" (UID: "9ced1c7f-b633-4f38-b821-f8eb9cf9b630"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460881 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4aae878d-4ff7-41f3-b5ce-540752cfc218-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460924 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nxjfn\" (UniqueName: \"kubernetes.io/projected/d8249847-5e97-4b9d-b86e-88758d4f29a8-kube-api-access-nxjfn\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460936 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8249847-5e97-4b9d-b86e-88758d4f29a8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460947 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460955 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460964 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k52pq\" (UniqueName: \"kubernetes.io/projected/4aae878d-4ff7-41f3-b5ce-540752cfc218-kube-api-access-k52pq\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460972 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8dvjd\" (UniqueName: \"kubernetes.io/projected/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-kube-api-access-8dvjd\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.460999 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.472299 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.486320 4769 scope.go:117] "RemoveContainer" containerID="5ce9df7a8f70352518e8d22d0a196dbbe29dccbd53f21e9e7d8b11179abd82e0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.492258 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.500411 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.500869 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="cinder-scheduler" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.500889 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="cinder-scheduler" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.500908 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" containerName="nova-scheduler-scheduler" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.500916 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" containerName="nova-scheduler-scheduler" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.500932 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.500938 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.500956 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-log" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.500964 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-log" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.500973 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="probe" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.500979 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="probe" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.500994 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-log" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501001 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-log" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.501010 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-api" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501016 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-api" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.501029 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api-log" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501035 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api-log" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.501051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ced1c7f-b633-4f38-b821-f8eb9cf9b630" containerName="keystone-api" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501057 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ced1c7f-b633-4f38-b821-f8eb9cf9b630" containerName="keystone-api" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.501066 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-metadata" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501072 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-metadata" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.501081 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f19f65b0-2588-4629-8d78-d8ba857f4506" containerName="memcached" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501087 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19f65b0-2588-4629-8d78-d8ba857f4506" containerName="memcached" Nov 21 12:58:44 crc kubenswrapper[4769]: E1121 12:58:44.501102 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c004188-8379-4fca-8d50-f293586ce6f5" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501108 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c004188-8379-4fca-8d50-f293586ce6f5" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501309 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-api" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501324 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="cinder-scheduler" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501330 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" containerName="probe" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501343 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api-log" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501353 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" containerName="nova-scheduler-scheduler" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501365 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" containerName="nova-api-log" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501374 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-log" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501384 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" containerName="nova-metadata-metadata" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501395 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ced1c7f-b633-4f38-b821-f8eb9cf9b630" containerName="keystone-api" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501406 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f19f65b0-2588-4629-8d78-d8ba857f4506" containerName="memcached" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" containerName="cinder-api" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.501423 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c004188-8379-4fca-8d50-f293586ce6f5" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.502068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.502730 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" podStartSLOduration=5.5027131350000005 podStartE2EDuration="5.502713135s" podCreationTimestamp="2025-11-21 12:58:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:44.482636825 +0000 UTC m=+4083.183298643" watchObservedRunningTime="2025-11-21 12:58:44.502713135 +0000 UTC m=+4083.203374953" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.505688 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.523932 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.545328 4769 scope.go:117] "RemoveContainer" containerID="865aea95541c123f54deceb22fc360e44124b9c0047ace97f10a3a293953765a" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.633600 4769 scope.go:117] "RemoveContainer" containerID="1198cba46a4bef26b5da0b4696489013c112c4e4647c0e4e818ceddb85e8d4c4" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.664945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnj87\" (UniqueName: \"kubernetes.io/projected/71d38cdc-dd99-42cf-8209-3b623241460f-kube-api-access-mnj87\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.665032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.665063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.766716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.766758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.766860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mnj87\" (UniqueName: \"kubernetes.io/projected/71d38cdc-dd99-42cf-8209-3b623241460f-kube-api-access-mnj87\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.776317 4769 scope.go:117] "RemoveContainer" containerID="8ca909f079592c78269c081787685adb1952af8d28386bb544cd418938c66fab" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.777740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.780555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.800264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnj87\" (UniqueName: \"kubernetes.io/projected/71d38cdc-dd99-42cf-8209-3b623241460f-kube-api-access-mnj87\") pod \"nova-cell1-novncproxy-0\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.815489 4769 scope.go:117] "RemoveContainer" containerID="2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.824037 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.861750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.869671 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.901306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8249847-5e97-4b9d-b86e-88758d4f29a8" (UID: "d8249847-5e97-4b9d-b86e-88758d4f29a8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.954147 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-config-data" (OuterVolumeSpecName: "config-data") pod "9ced1c7f-b633-4f38-b821-f8eb9cf9b630" (UID: "9ced1c7f-b633-4f38-b821-f8eb9cf9b630"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.972962 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.973099 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:44 crc kubenswrapper[4769]: I1121 12:58:44.997652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-config-data" (OuterVolumeSpecName: "config-data") pod "d8249847-5e97-4b9d-b86e-88758d4f29a8" (UID: "d8249847-5e97-4b9d-b86e-88758d4f29a8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.051953 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7884675778-6tm7r"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.053640 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.056046 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.058046 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.076010 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8249847-5e97-4b9d-b86e-88758d4f29a8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.087303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-config-data" (OuterVolumeSpecName: "config-data") pod "4aae878d-4ff7-41f3-b5ce-540752cfc218" (UID: "4aae878d-4ff7-41f3-b5ce-540752cfc218"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.086214 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4aae878d-4ff7-41f3-b5ce-540752cfc218" (UID: "4aae878d-4ff7-41f3-b5ce-540752cfc218"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.091021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed80d6c8-9e92-431d-9a46-6d9f4c9be521" (UID: "ed80d6c8-9e92-431d-9a46-6d9f4c9be521"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.112564 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7884675778-6tm7r"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.187662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9ced1c7f-b633-4f38-b821-f8eb9cf9b630" (UID: "9ced1c7f-b633-4f38-b821-f8eb9cf9b630"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-scripts\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-public-tls-certs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcdj\" (UniqueName: \"kubernetes.io/projected/e313d2d2-cd28-431b-9811-836f1fbf6366-kube-api-access-7kcdj\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-combined-ca-bundle\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e313d2d2-cd28-431b-9811-836f1fbf6366-logs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-internal-tls-certs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-config-data\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190789 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190801 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190810 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ced1c7f-b633-4f38-b821-f8eb9cf9b630-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.190854 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aae878d-4ff7-41f3-b5ce-540752cfc218-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.206728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data" (OuterVolumeSpecName: "config-data") pod "f00f0d0d-e0f5-483c-8995-658e9a5d5389" (UID: "f00f0d0d-e0f5-483c-8995-658e9a5d5389"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.236116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data" (OuterVolumeSpecName: "config-data") pod "ed80d6c8-9e92-431d-9a46-6d9f4c9be521" (UID: "ed80d6c8-9e92-431d-9a46-6d9f4c9be521"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302051 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-scripts\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302098 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-public-tls-certs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302201 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcdj\" (UniqueName: \"kubernetes.io/projected/e313d2d2-cd28-431b-9811-836f1fbf6366-kube-api-access-7kcdj\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-combined-ca-bundle\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e313d2d2-cd28-431b-9811-836f1fbf6366-logs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-internal-tls-certs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-config-data\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302385 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f00f0d0d-e0f5-483c-8995-658e9a5d5389-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.302398 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed80d6c8-9e92-431d-9a46-6d9f4c9be521-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.316656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-scripts\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.323915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-internal-tls-certs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.324505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-config-data\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.324797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-public-tls-certs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.325276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcdj\" (UniqueName: \"kubernetes.io/projected/e313d2d2-cd28-431b-9811-836f1fbf6366-kube-api-access-7kcdj\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.325577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-combined-ca-bundle\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.337346 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c004188-8379-4fca-8d50-f293586ce6f5" path="/var/lib/kubelet/pods/5c004188-8379-4fca-8d50-f293586ce6f5/volumes" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.342513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e313d2d2-cd28-431b-9811-836f1fbf6366-logs\") pod \"placement-7884675778-6tm7r\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.364505 4769 scope.go:117] "RemoveContainer" containerID="6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.478179 4769 generic.go:334] "Generic (PLEG): container finished" podID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerID="4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56" exitCode=0 Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.478232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" event={"ID":"45e04521-ef96-4028-9f3b-3b0bafbe2a8d","Type":"ContainerDied","Data":"4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.497028 4769 scope.go:117] "RemoveContainer" containerID="2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.497142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" event={"ID":"0156a1b9-6b80-4297-8d9e-d65152984ecf","Type":"ContainerStarted","Data":"3961233e5077e340a7507fc024283b37b1a598f4d7445ba78b61388af803bd95"} Nov 21 12:58:45 crc kubenswrapper[4769]: E1121 12:58:45.498022 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e\": container with ID starting with 2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e not found: ID does not exist" containerID="2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.498053 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e"} err="failed to get container status \"2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e\": rpc error: code = NotFound desc = could not find container \"2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e\": container with ID starting with 2ab1561459724ee6b0cd3c1f4dd882c787355f88a6536ee26c65e1d1d456668e not found: ID does not exist" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.498087 4769 scope.go:117] "RemoveContainer" containerID="6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea" Nov 21 12:58:45 crc kubenswrapper[4769]: E1121 12:58:45.499988 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea\": container with ID starting with 6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea not found: ID does not exist" containerID="6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.500026 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea"} err="failed to get container status \"6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea\": rpc error: code = NotFound desc = could not find container \"6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea\": container with ID starting with 6473bc3b9f7afbadebf048e70756cb70b65578a38078b655114d7cc36bc17dea not found: ID does not exist" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.502636 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.514538 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.521642 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.524947 4769 generic.go:334] "Generic (PLEG): container finished" podID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerID="c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168" exitCode=0 Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.525029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83541dda-7a5e-4390-beba-4fa7bc472a8d","Type":"ContainerDied","Data":"c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.525066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83541dda-7a5e-4390-beba-4fa7bc472a8d","Type":"ContainerDied","Data":"d1bcaa1a2ebce1a4066913bf9aeabe77a12d4e71d3b6e1fbd3230b31b275823a"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.525089 4769 scope.go:117] "RemoveContainer" containerID="c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.525306 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.544232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" event={"ID":"e9f10777-813f-47bb-951d-c78284390239","Type":"ContainerStarted","Data":"1e508ad993b5115412e41bfa11f9901df434ab56ba54cffa656ae4a468fc1e8c"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.562300 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.562943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" event={"ID":"3c195dbf-9a18-4d12-a66d-0fa74d151b2d","Type":"ContainerStarted","Data":"47ddfab13e050c6075670774c42a97aa4e98b58d71072a7c0251aefa892f8cf4"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.563965 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.571416 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.209:5672: connect: connection refused" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.574532 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc015826-af03-4f13-a223-5727adc49539" containerID="eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b" exitCode=143 Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.574608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" event={"ID":"dc015826-af03-4f13-a223-5727adc49539","Type":"ContainerDied","Data":"eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.597344 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.620443 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6b7d9d67cc-2wc94"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-combined-ca-bundle\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-logs\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621085 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-config-data\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62qhq\" (UniqueName: \"kubernetes.io/projected/83541dda-7a5e-4390-beba-4fa7bc472a8d-kube-api-access-62qhq\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621305 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-scripts\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.621387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-httpd-run\") pod \"83541dda-7a5e-4390-beba-4fa7bc472a8d\" (UID: \"83541dda-7a5e-4390-beba-4fa7bc472a8d\") " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.623350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.633578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-logs" (OuterVolumeSpecName: "logs") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.656087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" event={"ID":"9bcac63b-2c20-48f8-81cb-cf34894fdcda","Type":"ContainerStarted","Data":"0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f"} Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.656124 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.656459 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.656685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.657013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83541dda-7a5e-4390-beba-4fa7bc472a8d-kube-api-access-62qhq" (OuterVolumeSpecName: "kube-api-access-62qhq") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "kube-api-access-62qhq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.670623 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: E1121 12:58:45.671019 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-log" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.671032 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-log" Nov 21 12:58:45 crc kubenswrapper[4769]: E1121 12:58:45.671065 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-httpd" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.671071 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-httpd" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.679008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-scripts" (OuterVolumeSpecName: "scripts") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.685458 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-log" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.685520 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" containerName="glance-httpd" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.693263 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.704362 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.722997 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-62qhq\" (UniqueName: \"kubernetes.io/projected/83541dda-7a5e-4390-beba-4fa7bc472a8d-kube-api-access-62qhq\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.723044 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.723054 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.723063 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.723073 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83541dda-7a5e-4390-beba-4fa7bc472a8d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.757773 4769 scope.go:117] "RemoveContainer" containerID="57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.773371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.779695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-config-data" (OuterVolumeSpecName: "config-data") pod "83541dda-7a5e-4390-beba-4fa7bc472a8d" (UID: "83541dda-7a5e-4390-beba-4fa7bc472a8d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.782544 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.814771 4769 scope.go:117] "RemoveContainer" containerID="c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.814756 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: E1121 12:58:45.817044 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168\": container with ID starting with c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168 not found: ID does not exist" containerID="c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.817095 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168"} err="failed to get container status \"c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168\": rpc error: code = NotFound desc = could not find container \"c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168\": container with ID starting with c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168 not found: ID does not exist" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.817124 4769 scope.go:117] "RemoveContainer" containerID="57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62" Nov 21 12:58:45 crc kubenswrapper[4769]: E1121 12:58:45.817479 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62\": container with ID starting with 57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62 not found: ID does not exist" containerID="57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.817514 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62"} err="failed to get container status \"57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62\": rpc error: code = NotFound desc = could not find container \"57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62\": container with ID starting with 57306124f6a364487199703d8068f0ba528111ad8c39ee686ff5f66148d5ff62 not found: ID does not exist" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.833668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fdca9489-1f75-4aa3-9ff8-2426aea19580-logs\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.833929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.834083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhwhx\" (UniqueName: \"kubernetes.io/projected/fdca9489-1f75-4aa3-9ff8-2426aea19580-kube-api-access-jhwhx\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.834146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-config-data\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.833936 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.840297 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.840329 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83541dda-7a5e-4390-beba-4fa7bc472a8d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.842120 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.853254 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.875105 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.921975 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.925855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.928478 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.928693 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-pp5k7" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.928723 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.929564 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.942211 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwhx\" (UniqueName: \"kubernetes.io/projected/fdca9489-1f75-4aa3-9ff8-2426aea19580-kube-api-access-jhwhx\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.942263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-config-data\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.942368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fdca9489-1f75-4aa3-9ff8-2426aea19580-logs\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.942423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.942480 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.943515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fdca9489-1f75-4aa3-9ff8-2426aea19580-logs\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.947298 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.957445 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.966523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.975773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-config-data\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.978912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhwhx\" (UniqueName: \"kubernetes.io/projected/fdca9489-1f75-4aa3-9ff8-2426aea19580-kube-api-access-jhwhx\") pod \"nova-api-0\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.980085 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.981727 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.983807 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:58:45 crc kubenswrapper[4769]: I1121 12:58:45.995522 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.210:5672: connect: connection refused" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.002272 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.017144 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.028828 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.041534 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.042136 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" podStartSLOduration=7.042114415 podStartE2EDuration="7.042114415s" podCreationTimestamp="2025-11-21 12:58:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:45.67397103 +0000 UTC m=+4084.374632848" watchObservedRunningTime="2025-11-21 12:58:46.042114415 +0000 UTC m=+4084.742776233" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/410ba7d8-09d6-4e06-894e-c2b7b490e896-logs\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgsf7\" (UniqueName: \"kubernetes.io/projected/410ba7d8-09d6-4e06-894e-c2b7b490e896-kube-api-access-vgsf7\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-scripts\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data-custom\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043606 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.043669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/410ba7d8-09d6-4e06-894e-c2b7b490e896-etc-machine-id\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.045633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.058226 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.062651 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.062877 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener-log" containerID="cri-o://cbe64a043e09323dce82a6d1651d291a65b156e4e6c4418c987958992612dcad" gracePeriod=30 Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.062982 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener" containerID="cri-o://263f5c44cb0b771d5ce3f06fb6b1c7e79a81ff51f09e29ac300432ce655f8173" gracePeriod=30 Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.072470 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" podStartSLOduration=5.072449611 podStartE2EDuration="5.072449611s" podCreationTimestamp="2025-11-21 12:58:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:45.69476268 +0000 UTC m=+4084.395424498" watchObservedRunningTime="2025-11-21 12:58:46.072449611 +0000 UTC m=+4084.773111429" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.073250 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.101292 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" podStartSLOduration=7.101255317 podStartE2EDuration="7.101255317s" podCreationTimestamp="2025-11-21 12:58:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:45.756654767 +0000 UTC m=+4084.457316585" watchObservedRunningTime="2025-11-21 12:58:46.101255317 +0000 UTC m=+4084.801917135" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149325 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/410ba7d8-09d6-4e06-894e-c2b7b490e896-etc-machine-id\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149377 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-config-data\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9acf18f4-b5c4-4243-abd0-bec516c660dc-logs\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149489 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/410ba7d8-09d6-4e06-894e-c2b7b490e896-logs\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vgsf7\" (UniqueName: \"kubernetes.io/projected/410ba7d8-09d6-4e06-894e-c2b7b490e896-kube-api-access-vgsf7\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-scripts\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b0d62447-0070-4c77-b67e-702596a3cacf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-scripts\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149698 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data-custom\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfv4\" (UniqueName: \"kubernetes.io/projected/9acf18f4-b5c4-4243-abd0-bec516c660dc-kube-api-access-pzfv4\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zp4t\" (UniqueName: \"kubernetes.io/projected/b0d62447-0070-4c77-b67e-702596a3cacf-kube-api-access-5zp4t\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.149878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/410ba7d8-09d6-4e06-894e-c2b7b490e896-etc-machine-id\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.150219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/410ba7d8-09d6-4e06-894e-c2b7b490e896-logs\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.153715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.156282 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-scripts\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.160683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data-custom\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.164087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.165273 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgsf7\" (UniqueName: \"kubernetes.io/projected/410ba7d8-09d6-4e06-894e-c2b7b490e896-kube-api-access-vgsf7\") pod \"cinder-api-0\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.165329 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.178101 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.180410 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.182825 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.194928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.250993 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-logs\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-config-data\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9acf18f4-b5c4-4243-abd0-bec516c660dc-logs\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-config-data\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4dlp\" (UniqueName: \"kubernetes.io/projected/48f30235-6b42-49cf-ad48-3153c6f6c542-kube-api-access-f4dlp\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b0d62447-0070-4c77-b67e-702596a3cacf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-scripts\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-scripts\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfv4\" (UniqueName: \"kubernetes.io/projected/9acf18f4-b5c4-4243-abd0-bec516c660dc-kube-api-access-pzfv4\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5zp4t\" (UniqueName: \"kubernetes.io/projected/b0d62447-0070-4c77-b67e-702596a3cacf-kube-api-access-5zp4t\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.251717 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.254876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.255092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b0d62447-0070-4c77-b67e-702596a3cacf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.255710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9acf18f4-b5c4-4243-abd0-bec516c660dc-logs\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.260880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.265648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-config-data\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.266000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.266452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.267444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-scripts\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.276695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfv4\" (UniqueName: \"kubernetes.io/projected/9acf18f4-b5c4-4243-abd0-bec516c660dc-kube-api-access-pzfv4\") pod \"nova-metadata-0\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.279841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zp4t\" (UniqueName: \"kubernetes.io/projected/b0d62447-0070-4c77-b67e-702596a3cacf-kube-api-access-5zp4t\") pod \"cinder-scheduler-0\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-config-data\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353272 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f4dlp\" (UniqueName: \"kubernetes.io/projected/48f30235-6b42-49cf-ad48-3153c6f6c542-kube-api-access-f4dlp\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-scripts\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-logs\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.353971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-logs\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.354599 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.355163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.362138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.363783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-scripts\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.364624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-config-data\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.384506 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.387535 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4dlp\" (UniqueName: \"kubernetes.io/projected/48f30235-6b42-49cf-ad48-3153c6f6c542-kube-api-access-f4dlp\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.407124 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7884675778-6tm7r"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.407909 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.450752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.467804 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.469294 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.498866 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-logs\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-combined-ca-bundle\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-httpd-run\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-scripts\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-config-data\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfd2g\" (UniqueName: \"kubernetes.io/projected/c8dd19be-92f0-4348-9515-f5a8654256f7-kube-api-access-wfd2g\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.563707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"c8dd19be-92f0-4348-9515-f5a8654256f7\" (UID: \"c8dd19be-92f0-4348-9515-f5a8654256f7\") " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.565800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.566086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-logs" (OuterVolumeSpecName: "logs") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.575077 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8dd19be-92f0-4348-9515-f5a8654256f7-kube-api-access-wfd2g" (OuterVolumeSpecName: "kube-api-access-wfd2g") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "kube-api-access-wfd2g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.575810 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-scripts" (OuterVolumeSpecName: "scripts") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.576201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.628376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-config-data" (OuterVolumeSpecName: "config-data") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.631431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c8dd19be-92f0-4348-9515-f5a8654256f7" (UID: "c8dd19be-92f0-4348-9515-f5a8654256f7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667368 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667404 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wfd2g\" (UniqueName: \"kubernetes.io/projected/c8dd19be-92f0-4348-9515-f5a8654256f7-kube-api-access-wfd2g\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667445 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667454 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667462 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667473 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/c8dd19be-92f0-4348-9515-f5a8654256f7-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.667480 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c8dd19be-92f0-4348-9515-f5a8654256f7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.699730 4769 generic.go:334] "Generic (PLEG): container finished" podID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerID="cbe64a043e09323dce82a6d1651d291a65b156e4e6c4418c987958992612dcad" exitCode=143 Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.699805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" event={"ID":"d356c900-ff80-42a0-8fd8-8b68c06f9f15","Type":"ContainerDied","Data":"cbe64a043e09323dce82a6d1651d291a65b156e4e6c4418c987958992612dcad"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.704741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" event={"ID":"e313d2d2-cd28-431b-9811-836f1fbf6366","Type":"ContainerStarted","Data":"8df7ab0ed096615c3a03864eb162ea084fde71c8115d34b5b639a348915032ce"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.712559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"71d38cdc-dd99-42cf-8209-3b623241460f","Type":"ContainerStarted","Data":"4383c77ac33031afa0f9cbf076884c862a483bcca4ca15adeb907dd8d8536424"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.712610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"71d38cdc-dd99-42cf-8209-3b623241460f","Type":"ContainerStarted","Data":"d46789075587c67f639a94fa0e5db8993803b968bcb8717859d2165c87af6d8c"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.714677 4769 generic.go:334] "Generic (PLEG): container finished" podID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerID="fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d" exitCode=0 Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.714738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c8dd19be-92f0-4348-9515-f5a8654256f7","Type":"ContainerDied","Data":"fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.714763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"c8dd19be-92f0-4348-9515-f5a8654256f7","Type":"ContainerDied","Data":"c330da28611db2069d4893241d925fac73efdddb6d73f5da94f2b763f05f941c"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.714779 4769 scope.go:117] "RemoveContainer" containerID="fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.714871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.729372 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.733578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" event={"ID":"0156a1b9-6b80-4297-8d9e-d65152984ecf","Type":"ContainerStarted","Data":"f2c496750b2defb80faafb4859f48f358acb5a87e3f40783a37864cc3543ae9a"} Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.734004 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.735263 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.737986 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.737963925 podStartE2EDuration="2.737963925s" podCreationTimestamp="2025-11-21 12:58:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:46.730415802 +0000 UTC m=+4085.431077620" watchObservedRunningTime="2025-11-21 12:58:46.737963925 +0000 UTC m=+4085.438625743" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.764599 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" podStartSLOduration=5.764573042 podStartE2EDuration="5.764573042s" podCreationTimestamp="2025-11-21 12:58:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:46.759171056 +0000 UTC m=+4085.459832874" watchObservedRunningTime="2025-11-21 12:58:46.764573042 +0000 UTC m=+4085.465234860" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.780045 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.807348 4769 scope.go:117] "RemoveContainer" containerID="09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.812900 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.883128 4769 scope.go:117] "RemoveContainer" containerID="fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d" Nov 21 12:58:46 crc kubenswrapper[4769]: E1121 12:58:46.885873 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d\": container with ID starting with fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d not found: ID does not exist" containerID="fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.885954 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d"} err="failed to get container status \"fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d\": rpc error: code = NotFound desc = could not find container \"fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d\": container with ID starting with fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d not found: ID does not exist" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.886004 4769 scope.go:117] "RemoveContainer" containerID="09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985" Nov 21 12:58:46 crc kubenswrapper[4769]: E1121 12:58:46.887588 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985\": container with ID starting with 09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985 not found: ID does not exist" containerID="09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.887646 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985"} err="failed to get container status \"09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985\": rpc error: code = NotFound desc = could not find container \"09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985\": container with ID starting with 09b7a8bda419934e7347f20a5ad4c45f7268bc579d4dd716e50e39f4b4016985 not found: ID does not exist" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.887679 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.909050 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: E1121 12:58:46.910796 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-log" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.910819 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-log" Nov 21 12:58:46 crc kubenswrapper[4769]: E1121 12:58:46.910855 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-httpd" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.910864 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-httpd" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.911277 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-log" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.911308 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" containerName="glance-httpd" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.912764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.916992 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.924123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-logs\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g8gm\" (UniqueName: \"kubernetes.io/projected/75618a38-3d78-4f4c-9a05-88b0ce060be6-kube-api-access-8g8gm\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:46 crc kubenswrapper[4769]: I1121 12:58:46.996738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.016555 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100331 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8g8gm\" (UniqueName: \"kubernetes.io/projected/75618a38-3d78-4f4c-9a05-88b0ce060be6-kube-api-access-8g8gm\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100494 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-logs\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.100565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.102280 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.108125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.109772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.104764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.110512 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-logs\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.115831 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.124402 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.124706 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-central-agent" containerID="cri-o://a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24" gracePeriod=30 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.125129 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="proxy-httpd" containerID="cri-o://b3335f0750906eb115787d3d3b664e09e9d64172330caf278916f526fa90a49f" gracePeriod=30 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.125203 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="sg-core" containerID="cri-o://3d42a4556277f4b66cfad1d44bd67efdfddb19a0674d546e69e44481a7043aa2" gracePeriod=30 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.125254 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-notification-agent" containerID="cri-o://c9bf58af7f215c63d1ef37fef205e8d4ffcac33867b0167534e3c1d69fd7a3d0" gracePeriod=30 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.129740 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.133976 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g8gm\" (UniqueName: \"kubernetes.io/projected/75618a38-3d78-4f4c-9a05-88b0ce060be6-kube-api-access-8g8gm\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.196403 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.249943 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.264504 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.294239 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aae878d-4ff7-41f3-b5ce-540752cfc218" path="/var/lib/kubelet/pods/4aae878d-4ff7-41f3-b5ce-540752cfc218/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.295735 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83541dda-7a5e-4390-beba-4fa7bc472a8d" path="/var/lib/kubelet/pods/83541dda-7a5e-4390-beba-4fa7bc472a8d/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.296800 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ced1c7f-b633-4f38-b821-f8eb9cf9b630" path="/var/lib/kubelet/pods/9ced1c7f-b633-4f38-b821-f8eb9cf9b630/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.298284 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8dd19be-92f0-4348-9515-f5a8654256f7" path="/var/lib/kubelet/pods/c8dd19be-92f0-4348-9515-f5a8654256f7/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.299133 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8249847-5e97-4b9d-b86e-88758d4f29a8" path="/var/lib/kubelet/pods/d8249847-5e97-4b9d-b86e-88758d4f29a8/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.299876 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed80d6c8-9e92-431d-9a46-6d9f4c9be521" path="/var/lib/kubelet/pods/ed80d6c8-9e92-431d-9a46-6d9f4c9be521/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.301387 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f00f0d0d-e0f5-483c-8995-658e9a5d5389" path="/var/lib/kubelet/pods/f00f0d0d-e0f5-483c-8995-658e9a5d5389/volumes" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.446097 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.785127 4769 generic.go:334] "Generic (PLEG): container finished" podID="48a5313d-540b-4d62-8511-8154abf0acca" containerID="a9406414b96be5316ab9bee81dc5ccd2d6f8d44630478e05d518adee9f641ca4" exitCode=0 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.786156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"48a5313d-540b-4d62-8511-8154abf0acca","Type":"ContainerDied","Data":"a9406414b96be5316ab9bee81dc5ccd2d6f8d44630478e05d518adee9f641ca4"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.788773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"410ba7d8-09d6-4e06-894e-c2b7b490e896","Type":"ContainerStarted","Data":"fb6128521b1462a7800ba557dd78b33ff16442d0bf1f39bd76b1086785d2ca6c"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.790931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"fdca9489-1f75-4aa3-9ff8-2426aea19580","Type":"ContainerStarted","Data":"8010277e0a4b83b0272da4237679de55021faf35a532ecf9e62716dce081a624"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.790953 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"fdca9489-1f75-4aa3-9ff8-2426aea19580","Type":"ContainerStarted","Data":"c1ec28aa51234b08b2d83e4ebea5227e0f0bc1c15a1e19eb2225819f66087dc7"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.793404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b0d62447-0070-4c77-b67e-702596a3cacf","Type":"ContainerStarted","Data":"e6edb90a9069fc917ecb154f6c2a112900924569337f1234a97a5301efff23a1"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.799715 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerID="b3335f0750906eb115787d3d3b664e09e9d64172330caf278916f526fa90a49f" exitCode=0 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.799750 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerID="3d42a4556277f4b66cfad1d44bd67efdfddb19a0674d546e69e44481a7043aa2" exitCode=2 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.799759 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerID="a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24" exitCode=0 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.799802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerDied","Data":"b3335f0750906eb115787d3d3b664e09e9d64172330caf278916f526fa90a49f"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.799828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerDied","Data":"3d42a4556277f4b66cfad1d44bd67efdfddb19a0674d546e69e44481a7043aa2"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.799878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerDied","Data":"a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.802515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48f30235-6b42-49cf-ad48-3153c6f6c542","Type":"ContainerStarted","Data":"9788dec5309145d9bb78726d5858d127b77aa5790810c5bfd9db12e6b4df0f08"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.808456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" event={"ID":"e313d2d2-cd28-431b-9811-836f1fbf6366","Type":"ContainerStarted","Data":"7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.808489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" event={"ID":"e313d2d2-cd28-431b-9811-836f1fbf6366","Type":"ContainerStarted","Data":"7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.808960 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.809051 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.811983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9acf18f4-b5c4-4243-abd0-bec516c660dc","Type":"ContainerStarted","Data":"f7f27ced0dabcf32a81f0366255353f16e33951fcde176ff859161f9d295b315"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.815965 4769 generic.go:334] "Generic (PLEG): container finished" podID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerID="263f5c44cb0b771d5ce3f06fb6b1c7e79a81ff51f09e29ac300432ce655f8173" exitCode=0 Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.817893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" event={"ID":"d356c900-ff80-42a0-8fd8-8b68c06f9f15","Type":"ContainerDied","Data":"263f5c44cb0b771d5ce3f06fb6b1c7e79a81ff51f09e29ac300432ce655f8173"} Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.835573 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" podStartSLOduration=2.835555786 podStartE2EDuration="2.835555786s" podCreationTimestamp="2025-11-21 12:58:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:47.824103668 +0000 UTC m=+4086.524765486" watchObservedRunningTime="2025-11-21 12:58:47.835555786 +0000 UTC m=+4086.536217604" Nov 21 12:58:47 crc kubenswrapper[4769]: I1121 12:58:47.970571 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:58:48 crc kubenswrapper[4769]: E1121 12:58:48.156978 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5 is running failed: container process not found" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:58:48 crc kubenswrapper[4769]: E1121 12:58:48.159855 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5 is running failed: container process not found" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:58:48 crc kubenswrapper[4769]: E1121 12:58:48.160112 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5 is running failed: container process not found" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:58:48 crc kubenswrapper[4769]: E1121 12:58:48.160151 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerName="nova-cell0-conductor-conductor" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.281470 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.358943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data\") pod \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.359001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d356c900-ff80-42a0-8fd8-8b68c06f9f15-logs\") pod \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.359049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-combined-ca-bundle\") pod \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.359113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data-custom\") pod \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.359367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7k92\" (UniqueName: \"kubernetes.io/projected/d356c900-ff80-42a0-8fd8-8b68c06f9f15-kube-api-access-w7k92\") pod \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\" (UID: \"d356c900-ff80-42a0-8fd8-8b68c06f9f15\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.359750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d356c900-ff80-42a0-8fd8-8b68c06f9f15-logs" (OuterVolumeSpecName: "logs") pod "d356c900-ff80-42a0-8fd8-8b68c06f9f15" (UID: "d356c900-ff80-42a0-8fd8-8b68c06f9f15"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.359964 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d356c900-ff80-42a0-8fd8-8b68c06f9f15-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.388342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d356c900-ff80-42a0-8fd8-8b68c06f9f15" (UID: "d356c900-ff80-42a0-8fd8-8b68c06f9f15"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.401084 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d356c900-ff80-42a0-8fd8-8b68c06f9f15-kube-api-access-w7k92" (OuterVolumeSpecName: "kube-api-access-w7k92") pod "d356c900-ff80-42a0-8fd8-8b68c06f9f15" (UID: "d356c900-ff80-42a0-8fd8-8b68c06f9f15"). InnerVolumeSpecName "kube-api-access-w7k92". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.470694 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w7k92\" (UniqueName: \"kubernetes.io/projected/d356c900-ff80-42a0-8fd8-8b68c06f9f15-kube-api-access-w7k92\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.470731 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.528573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data" (OuterVolumeSpecName: "config-data") pod "d356c900-ff80-42a0-8fd8-8b68c06f9f15" (UID: "d356c900-ff80-42a0-8fd8-8b68c06f9f15"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.528586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d356c900-ff80-42a0-8fd8-8b68c06f9f15" (UID: "d356c900-ff80-42a0-8fd8-8b68c06f9f15"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.558405 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.572877 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.573049 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d356c900-ff80-42a0-8fd8-8b68c06f9f15-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.582550 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.685848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-plugins-conf\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.685914 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-plugins\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.685934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-confd\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.685969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc015826-af03-4f13-a223-5727adc49539-logs\") pod \"dc015826-af03-4f13-a223-5727adc49539\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgjps\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-kube-api-access-zgjps\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj2kf\" (UniqueName: \"kubernetes.io/projected/dc015826-af03-4f13-a223-5727adc49539-kube-api-access-hj2kf\") pod \"dc015826-af03-4f13-a223-5727adc49539\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686165 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-erlang-cookie\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/48a5313d-540b-4d62-8511-8154abf0acca-pod-info\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-combined-ca-bundle\") pod \"dc015826-af03-4f13-a223-5727adc49539\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data-custom\") pod \"dc015826-af03-4f13-a223-5727adc49539\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data\") pod \"dc015826-af03-4f13-a223-5727adc49539\" (UID: \"dc015826-af03-4f13-a223-5727adc49539\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-server-conf\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/48a5313d-540b-4d62-8511-8154abf0acca-erlang-cookie-secret\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"48a5313d-540b-4d62-8511-8154abf0acca\" (UID: \"48a5313d-540b-4d62-8511-8154abf0acca\") " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.686513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc015826-af03-4f13-a223-5727adc49539-logs" (OuterVolumeSpecName: "logs") pod "dc015826-af03-4f13-a223-5727adc49539" (UID: "dc015826-af03-4f13-a223-5727adc49539"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.687048 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc015826-af03-4f13-a223-5727adc49539-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.687470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.687681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.697842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.729513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "persistence") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.729643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc015826-af03-4f13-a223-5727adc49539-kube-api-access-hj2kf" (OuterVolumeSpecName: "kube-api-access-hj2kf") pod "dc015826-af03-4f13-a223-5727adc49539" (UID: "dc015826-af03-4f13-a223-5727adc49539"). InnerVolumeSpecName "kube-api-access-hj2kf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.729696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48a5313d-540b-4d62-8511-8154abf0acca-pod-info" (OuterVolumeSpecName: "pod-info") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.729805 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dc015826-af03-4f13-a223-5727adc49539" (UID: "dc015826-af03-4f13-a223-5727adc49539"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.748066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-kube-api-access-zgjps" (OuterVolumeSpecName: "kube-api-access-zgjps") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "kube-api-access-zgjps". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.783917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a5313d-540b-4d62-8511-8154abf0acca-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789108 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zgjps\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-kube-api-access-zgjps\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789133 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hj2kf\" (UniqueName: \"kubernetes.io/projected/dc015826-af03-4f13-a223-5727adc49539-kube-api-access-hj2kf\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789143 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789152 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/48a5313d-540b-4d62-8511-8154abf0acca-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789161 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789169 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/48a5313d-540b-4d62-8511-8154abf0acca-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789217 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789229 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.789237 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.830386 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc015826-af03-4f13-a223-5727adc49539" (UID: "dc015826-af03-4f13-a223-5727adc49539"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.869579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-server-conf" (OuterVolumeSpecName: "server-conf") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.894510 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.894538 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/48a5313d-540b-4d62-8511-8154abf0acca-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.894870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75618a38-3d78-4f4c-9a05-88b0ce060be6","Type":"ContainerStarted","Data":"306ea4965005a5c6200a42ee061d4c30376356b0ba3f5450316988a7991eaccf"} Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.901769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"410ba7d8-09d6-4e06-894e-c2b7b490e896","Type":"ContainerStarted","Data":"c1f8cee72fec018dfde56d2f7e8cbe5d1e29c22acdf13b93e17f08641898c58c"} Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.908511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" event={"ID":"d356c900-ff80-42a0-8fd8-8b68c06f9f15","Type":"ContainerDied","Data":"ff9f24a6850423ad08d504b9af0c4511512d3628b3b7efc08884d41aa25581f8"} Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.908575 4769 scope.go:117] "RemoveContainer" containerID="263f5c44cb0b771d5ce3f06fb6b1c7e79a81ff51f09e29ac300432ce655f8173" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.908698 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.935353 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc015826-af03-4f13-a223-5727adc49539" containerID="11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490" exitCode=0 Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.936245 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.936977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" event={"ID":"dc015826-af03-4f13-a223-5727adc49539","Type":"ContainerDied","Data":"11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490"} Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.939527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54d98cf849-m295z" event={"ID":"dc015826-af03-4f13-a223-5727adc49539","Type":"ContainerDied","Data":"b8ec67bc3d5dfc2d8d6b031cd6793c15e52755146cc976cfa2b67bca0f8dd8d4"} Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.953731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"48a5313d-540b-4d62-8511-8154abf0acca","Type":"ContainerDied","Data":"63741e999445cf78c5688857783a91c2bddaf1b82b482006c7d1903dbd901594"} Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.953801 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.995982 4769 generic.go:334] "Generic (PLEG): container finished" podID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerID="bb7913ca5ec0f188e66436ec552e90fbe1261d1870b97d0f697d6b766befad1a" exitCode=0 Nov 21 12:58:48 crc kubenswrapper[4769]: I1121 12:58:48.996063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279f45ed-32ec-46a1-999e-eb8136b76df5","Type":"ContainerDied","Data":"bb7913ca5ec0f188e66436ec552e90fbe1261d1870b97d0f697d6b766befad1a"} Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.013094 4769 generic.go:334] "Generic (PLEG): container finished" podID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" exitCode=0 Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.013164 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251","Type":"ContainerDied","Data":"3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5"} Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.021088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9acf18f4-b5c4-4243-abd0-bec516c660dc","Type":"ContainerStarted","Data":"e9db392f2b142e40ec0e04767efbf652a5b72e74fb44c00d16f4008efac1ee15"} Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.024350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"fdca9489-1f75-4aa3-9ff8-2426aea19580","Type":"ContainerStarted","Data":"98ae86c4cbf0f7a34be7e5556d6121ed39746b91ef7bedf80017b51275fb4170"} Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.055062 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.05504759 podStartE2EDuration="4.05504759s" podCreationTimestamp="2025-11-21 12:58:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:49.046604433 +0000 UTC m=+4087.747266251" watchObservedRunningTime="2025-11-21 12:58:49.05504759 +0000 UTC m=+4087.755709398" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.078234 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.082413 4769 generic.go:334] "Generic (PLEG): container finished" podID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerID="c9bf58af7f215c63d1ef37fef205e8d4ffcac33867b0167534e3c1d69fd7a3d0" exitCode=0 Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.083345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerDied","Data":"c9bf58af7f215c63d1ef37fef205e8d4ffcac33867b0167534e3c1d69fd7a3d0"} Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.097511 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.142478 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.142455444 podStartE2EDuration="4.142455444s" podCreationTimestamp="2025-11-21 12:58:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:49.077027392 +0000 UTC m=+4087.777689230" watchObservedRunningTime="2025-11-21 12:58:49.142455444 +0000 UTC m=+4087.843117262" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.333291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data" (OuterVolumeSpecName: "config-data") pod "dc015826-af03-4f13-a223-5727adc49539" (UID: "dc015826-af03-4f13-a223-5727adc49539"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.367354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "48a5313d-540b-4d62-8511-8154abf0acca" (UID: "48a5313d-540b-4d62-8511-8154abf0acca"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.411322 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc015826-af03-4f13-a223-5727adc49539-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.411358 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/48a5313d-540b-4d62-8511-8154abf0acca-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.463333 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.470846 4769 scope.go:117] "RemoveContainer" containerID="cbe64a043e09323dce82a6d1651d291a65b156e4e6c4418c987958992612dcad" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.494070 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.529641 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.531955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knjkx\" (UniqueName: \"kubernetes.io/projected/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-kube-api-access-knjkx\") pod \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.532128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-config-data\") pod \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.532157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-combined-ca-bundle\") pod \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\" (UID: \"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.537878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-kube-api-access-knjkx" (OuterVolumeSpecName: "kube-api-access-knjkx") pod "5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" (UID: "5a4ef9eb-ffdd-4eb6-8726-4ebee296f251"). InnerVolumeSpecName "kube-api-access-knjkx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.597332 4769 scope.go:117] "RemoveContainer" containerID="11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.602163 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.624385 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634206 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634285 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-confd\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-server-conf\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-run-httpd\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634404 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-sg-core-conf-yaml\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634459 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279f45ed-32ec-46a1-999e-eb8136b76df5-erlang-cookie-secret\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634478 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-log-httpd\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279f45ed-32ec-46a1-999e-eb8136b76df5-pod-info\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rbp7\" (UniqueName: \"kubernetes.io/projected/0c1391c1-afa5-489e-8f4d-4e409a35d72d-kube-api-access-6rbp7\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-scripts\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-plugins-conf\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-config-data\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-plugins\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634678 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-erlang-cookie\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634696 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g77dx\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-kube-api-access-g77dx\") pod \"279f45ed-32ec-46a1-999e-eb8136b76df5\" (UID: \"279f45ed-32ec-46a1-999e-eb8136b76df5\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.634714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-combined-ca-bundle\") pod \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\" (UID: \"0c1391c1-afa5-489e-8f4d-4e409a35d72d\") " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.635046 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-knjkx\" (UniqueName: \"kubernetes.io/projected/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-kube-api-access-knjkx\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.638566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.646907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.647307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.649936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" (UID: "5a4ef9eb-ffdd-4eb6-8726-4ebee296f251"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.655366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.655439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.659499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1391c1-afa5-489e-8f4d-4e409a35d72d-kube-api-access-6rbp7" (OuterVolumeSpecName: "kube-api-access-6rbp7") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "kube-api-access-6rbp7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.663341 4769 scope.go:117] "RemoveContainer" containerID="eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.674571 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.680894 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-notification-agent" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.680947 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-notification-agent" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.680961 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerName="nova-cell0-conductor-conductor" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.680967 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerName="nova-cell0-conductor-conductor" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.680975 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker-log" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.681000 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker-log" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.681009 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="sg-core" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682063 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="sg-core" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682077 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener-log" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682084 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener-log" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682093 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="proxy-httpd" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="proxy-httpd" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682138 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="rabbitmq" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682144 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="rabbitmq" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682160 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="setup-container" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682167 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="setup-container" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682179 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="rabbitmq" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682210 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="rabbitmq" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682225 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682232 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682243 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="setup-container" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682250 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="setup-container" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682266 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-central-agent" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682302 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-central-agent" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.682319 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682327 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682623 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-central-agent" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682644 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" containerName="rabbitmq" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682668 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="ceilometer-notification-agent" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48a5313d-540b-4d62-8511-8154abf0acca" containerName="rabbitmq" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682713 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" containerName="nova-cell0-conductor-conductor" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682724 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682735 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="proxy-httpd" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682747 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" containerName="barbican-keystone-listener-log" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682753 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" containerName="sg-core" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.682781 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc015826-af03-4f13-a223-5727adc49539" containerName="barbican-worker-log" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.684069 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.685928 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.692643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/279f45ed-32ec-46a1-999e-eb8136b76df5-pod-info" (OuterVolumeSpecName: "pod-info") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.692947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279f45ed-32ec-46a1-999e-eb8136b76df5-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.692951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "persistence") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.693159 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.693203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-kube-api-access-g77dx" (OuterVolumeSpecName: "kube-api-access-g77dx") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "kube-api-access-g77dx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.693213 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.693227 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.693297 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.694630 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-scripts" (OuterVolumeSpecName: "scripts") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.696541 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-9rkmj" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.702270 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.703025 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54d98cf849-m295z"] Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.726882 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54d98cf849-m295z"] Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvb4c\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-kube-api-access-cvb4c\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736201 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736241 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-server-conf\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736266 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/320ae09e-4eaf-4abe-a5b2-554d1408238c-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/320ae09e-4eaf-4abe-a5b2-554d1408238c-pod-info\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736470 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/279f45ed-32ec-46a1-999e-eb8136b76df5-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736481 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736490 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736499 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/279f45ed-32ec-46a1-999e-eb8136b76df5-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736508 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6rbp7\" (UniqueName: \"kubernetes.io/projected/0c1391c1-afa5-489e-8f4d-4e409a35d72d-kube-api-access-6rbp7\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736517 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736525 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736535 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736545 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736555 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g77dx\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-kube-api-access-g77dx\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736574 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.736583 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c1391c1-afa5-489e-8f4d-4e409a35d72d-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.744401 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.803346 4769 scope.go:117] "RemoveContainer" containerID="11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.811315 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490\": container with ID starting with 11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490 not found: ID does not exist" containerID="11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.811358 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490"} err="failed to get container status \"11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490\": rpc error: code = NotFound desc = could not find container \"11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490\": container with ID starting with 11454cb6fd331c947d92c6206a78ffec3aca719a4fd661181e6e1ac52e7fd490 not found: ID does not exist" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.811383 4769 scope.go:117] "RemoveContainer" containerID="eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b" Nov 21 12:58:49 crc kubenswrapper[4769]: E1121 12:58:49.815453 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b\": container with ID starting with eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b not found: ID does not exist" containerID="eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.815499 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b"} err="failed to get container status \"eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b\": rpc error: code = NotFound desc = could not find container \"eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b\": container with ID starting with eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b not found: ID does not exist" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.815542 4769 scope.go:117] "RemoveContainer" containerID="a9406414b96be5316ab9bee81dc5ccd2d6f8d44630478e05d518adee9f641ca4" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.824939 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cvb4c\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-kube-api-access-cvb4c\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-server-conf\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/320ae09e-4eaf-4abe-a5b2-554d1408238c-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/320ae09e-4eaf-4abe-a5b2-554d1408238c-pod-info\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.841732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.842587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.843716 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.846807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.847082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.847614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-server-conf\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.850026 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.852425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.855578 4769 scope.go:117] "RemoveContainer" containerID="e8102b1e073a94e992e30c03d9f62e84b8808c8ec83c853496cf97787e11d9af" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.858465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-config-data" (OuterVolumeSpecName: "config-data") pod "5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" (UID: "5a4ef9eb-ffdd-4eb6-8726-4ebee296f251"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.858572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/320ae09e-4eaf-4abe-a5b2-554d1408238c-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.861794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/320ae09e-4eaf-4abe-a5b2-554d1408238c-pod-info\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.865061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvb4c\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-kube-api-access-cvb4c\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.891478 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.902613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.932355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.943994 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.944029 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.944041 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:49 crc kubenswrapper[4769]: I1121 12:58:49.950691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-server-conf" (OuterVolumeSpecName: "server-conf") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.021022 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.032388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.045302 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-config-data" (OuterVolumeSpecName: "config-data") pod "0c1391c1-afa5-489e-8f4d-4e409a35d72d" (UID: "0c1391c1-afa5-489e-8f4d-4e409a35d72d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.047755 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/279f45ed-32ec-46a1-999e-eb8136b76df5-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.047790 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.047801 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c1391c1-afa5-489e-8f4d-4e409a35d72d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.073249 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "279f45ed-32ec-46a1-999e-eb8136b76df5" (UID: "279f45ed-32ec-46a1-999e-eb8136b76df5"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.149848 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/279f45ed-32ec-46a1-999e-eb8136b76df5-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.164139 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0c1391c1-afa5-489e-8f4d-4e409a35d72d","Type":"ContainerDied","Data":"a1cf3b2566838000fad267c4b34a2ab8de6128f4cfc3555fc3e7a3ebdef4fc5a"} Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.164216 4769 scope.go:117] "RemoveContainer" containerID="b3335f0750906eb115787d3d3b664e09e9d64172330caf278916f526fa90a49f" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.164742 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.180932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"279f45ed-32ec-46a1-999e-eb8136b76df5","Type":"ContainerDied","Data":"00faa8478947ee940c57633d3ce40373549ba4b0d99c009c069c1e4c2c1064ac"} Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.181014 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.193441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5a4ef9eb-ffdd-4eb6-8726-4ebee296f251","Type":"ContainerDied","Data":"6cb957df34b81ceb4f63354d7be8fe06917c8e01aad1b2d6538bfaaa3f7934f9"} Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.193530 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.204168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9acf18f4-b5c4-4243-abd0-bec516c660dc","Type":"ContainerStarted","Data":"d85c406322e37fd4111d45bb14eedb47d967be28d6d32adb88147e4df7df8479"} Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.239343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75618a38-3d78-4f4c-9a05-88b0ce060be6","Type":"ContainerStarted","Data":"92e20085d1f56e45e9b1939575457cb299f3d1fba665ee7798171ab39c01648e"} Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.259766 4769 scope.go:117] "RemoveContainer" containerID="3d42a4556277f4b66cfad1d44bd67efdfddb19a0674d546e69e44481a7043aa2" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.262830 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.294485 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.313042 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.316041 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.328522 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.328818 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.337548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b0d62447-0070-4c77-b67e-702596a3cacf","Type":"ContainerStarted","Data":"54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b"} Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.342840 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.368150 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.376714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-run-httpd\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.376803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srnpk\" (UniqueName: \"kubernetes.io/projected/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-kube-api-access-srnpk\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.376837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-scripts\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.377385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.377484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.377544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-config-data\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.377650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-log-httpd\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.380364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.395067 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.432298 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.436665 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.445904 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.446203 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.452488 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.454042 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.454316 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.455166 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.455419 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.455553 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-999rt" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.455590 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.455735 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.455784 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.459456 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.463654 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.481644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-config-data\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.481737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-log-httpd\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.481964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-run-httpd\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.482351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srnpk\" (UniqueName: \"kubernetes.io/projected/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-kube-api-access-srnpk\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.483039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-scripts\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.482925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-run-httpd\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.482632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-log-httpd\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.483477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.483919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.493350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-scripts\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.499733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.501016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.501624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-config-data\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.519725 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srnpk\" (UniqueName: \"kubernetes.io/projected/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-kube-api-access-srnpk\") pod \"ceilometer-0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.552444 4769 scope.go:117] "RemoveContainer" containerID="c9bf58af7f215c63d1ef37fef205e8d4ffcac33867b0167534e3c1d69fd7a3d0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.586424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.586638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.586781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.586851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.586941 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.587009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.587084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9aa39735-6ebc-412a-ae3c-bfb951dc599b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.587166 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.587251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.587350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrs77\" (UniqueName: \"kubernetes.io/projected/4038fb5d-3a41-41bc-b028-2ef32732fec8-kube-api-access-mrs77\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.588868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9aa39735-6ebc-412a-ae3c-bfb951dc599b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.588967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.589285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.589739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89znh\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-kube-api-access-89znh\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.615423 4769 scope.go:117] "RemoveContainer" containerID="a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.642688 4769 scope.go:117] "RemoveContainer" containerID="bb7913ca5ec0f188e66436ec552e90fbe1261d1870b97d0f697d6b766befad1a" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9aa39735-6ebc-412a-ae3c-bfb951dc599b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mrs77\" (UniqueName: \"kubernetes.io/projected/4038fb5d-3a41-41bc-b028-2ef32732fec8-kube-api-access-mrs77\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9aa39735-6ebc-412a-ae3c-bfb951dc599b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.692654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-89znh\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-kube-api-access-89znh\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.693841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.694414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.695450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.696058 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.698684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.704746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9aa39735-6ebc-412a-ae3c-bfb951dc599b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.706060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.706878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.708755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-89znh\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-kube-api-access-89znh\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.710257 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9aa39735-6ebc-412a-ae3c-bfb951dc599b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.710954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.711952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.723264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.723787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrs77\" (UniqueName: \"kubernetes.io/projected/4038fb5d-3a41-41bc-b028-2ef32732fec8-kube-api-access-mrs77\") pod \"nova-cell0-conductor-0\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.745439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.753637 4769 scope.go:117] "RemoveContainer" containerID="f843c77497dc9e9b693850577427cce1b7ec48f68e36a8d3c1bfbcc30ad52176" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.800801 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.802843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.815365 4769 scope.go:117] "RemoveContainer" containerID="3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.832802 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:58:50 crc kubenswrapper[4769]: I1121 12:58:50.841765 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.300376 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1391c1-afa5-489e-8f4d-4e409a35d72d" path="/var/lib/kubelet/pods/0c1391c1-afa5-489e-8f4d-4e409a35d72d/volumes" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.301764 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279f45ed-32ec-46a1-999e-eb8136b76df5" path="/var/lib/kubelet/pods/279f45ed-32ec-46a1-999e-eb8136b76df5/volumes" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.302938 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a5313d-540b-4d62-8511-8154abf0acca" path="/var/lib/kubelet/pods/48a5313d-540b-4d62-8511-8154abf0acca/volumes" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.303499 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4ef9eb-ffdd-4eb6-8726-4ebee296f251" path="/var/lib/kubelet/pods/5a4ef9eb-ffdd-4eb6-8726-4ebee296f251/volumes" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.304648 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc015826-af03-4f13-a223-5727adc49539" path="/var/lib/kubelet/pods/dc015826-af03-4f13-a223-5727adc49539/volumes" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.374080 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b0d62447-0070-4c77-b67e-702596a3cacf","Type":"ContainerStarted","Data":"31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d"} Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.403104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48f30235-6b42-49cf-ad48-3153c6f6c542","Type":"ContainerStarted","Data":"16e599ac25444568bec0868946286298a0c586bedd720ee6698bf3c1f6881eb9"} Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.407723 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=6.407704152 podStartE2EDuration="6.407704152s" podCreationTimestamp="2025-11-21 12:58:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:51.396727277 +0000 UTC m=+4090.097389095" watchObservedRunningTime="2025-11-21 12:58:51.407704152 +0000 UTC m=+4090.108365960" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.408742 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.409680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75618a38-3d78-4f4c-9a05-88b0ce060be6","Type":"ContainerStarted","Data":"53cc0e37c1e453c63bc64710e5b72338490988d6b45b6b6634056af829222170"} Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.423238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"410ba7d8-09d6-4e06-894e-c2b7b490e896","Type":"ContainerStarted","Data":"c80d4b620975884e05c11ceb27303ac1a2b3583afc75dd1610a3fc8677556f13"} Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.424156 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.433665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"320ae09e-4eaf-4abe-a5b2-554d1408238c","Type":"ContainerStarted","Data":"73f9d870dd6e8c93297daf64c08a9ff4c380424eaf671ced2c1a15d0856871ac"} Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.437349 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.43732786 podStartE2EDuration="5.43732786s" podCreationTimestamp="2025-11-21 12:58:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:51.426453417 +0000 UTC m=+4090.127115235" watchObservedRunningTime="2025-11-21 12:58:51.43732786 +0000 UTC m=+4090.137989678" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.458808 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=6.458789638 podStartE2EDuration="6.458789638s" podCreationTimestamp="2025-11-21 12:58:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:51.447320419 +0000 UTC m=+4090.147982237" watchObservedRunningTime="2025-11-21 12:58:51.458789638 +0000 UTC m=+4090.159451446" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.470280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.470332 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.559018 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.576661 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 12:58:51 crc kubenswrapper[4769]: I1121 12:58:51.889910 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.110938 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.260722 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.353745 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql"] Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.354180 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api-log" containerID="cri-o://4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356" gracePeriod=30 Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.354269 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api" containerID="cri-o://bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506" gracePeriod=30 Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.458768 4769 generic.go:334] "Generic (PLEG): container finished" podID="55145a65-9d78-41d7-a8eb-74bf51851190" containerID="1e354112d0c49340b8976062f563e0f86b3710f5c63746af8f9e5f541fbd1149" exitCode=0 Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.458846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" event={"ID":"55145a65-9d78-41d7-a8eb-74bf51851190","Type":"ContainerDied","Data":"1e354112d0c49340b8976062f563e0f86b3710f5c63746af8f9e5f541fbd1149"} Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.461539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"4038fb5d-3a41-41bc-b028-2ef32732fec8","Type":"ContainerStarted","Data":"8c5562641c674070bc98f884f8e6731454282a0119e09abf1501d1bc2f6bf7a1"} Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.463986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerStarted","Data":"f1911df0463f5f6521ebda779f26d157b23401a40e3bc632947b7eb7e947a2af"} Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.491595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48f30235-6b42-49cf-ad48-3153c6f6c542","Type":"ContainerStarted","Data":"e45f73eb8512fffa53269041f9095bc3a7dad12e398ef818420241fe14475f1f"} Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.502698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"9aa39735-6ebc-412a-ae3c-bfb951dc599b","Type":"ContainerStarted","Data":"7722bfe9f18c6156f970ed08a122e7a777d2e8aedfa607337b78dd120b1b6bfe"} Nov 21 12:58:52 crc kubenswrapper[4769]: I1121 12:58:52.519908 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.519888456 podStartE2EDuration="6.519888456s" podCreationTimestamp="2025-11-21 12:58:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:52.509884337 +0000 UTC m=+4091.210546165" watchObservedRunningTime="2025-11-21 12:58:52.519888456 +0000 UTC m=+4091.220550274" Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.227196 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.512680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"9aa39735-6ebc-412a-ae3c-bfb951dc599b","Type":"ContainerStarted","Data":"f34b59991bbcde373cfc57e89fd862cdaa711ae7091f5c6be779d1fc1a3f0a84"} Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.514435 4769 generic.go:334] "Generic (PLEG): container finished" podID="c0568707-e35d-472d-8fd4-2e2695e84153" containerID="4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356" exitCode=143 Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.514518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" event={"ID":"c0568707-e35d-472d-8fd4-2e2695e84153","Type":"ContainerDied","Data":"4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356"} Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.516961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"320ae09e-4eaf-4abe-a5b2-554d1408238c","Type":"ContainerStarted","Data":"345427c0cfe355aef6549b93b6c2016b9d88dcb1b2ffb4cdfe63847d10db0527"} Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.522555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"4038fb5d-3a41-41bc-b028-2ef32732fec8","Type":"ContainerStarted","Data":"46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203"} Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.522696 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.526134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerStarted","Data":"c71b4af322f7f66c7e5fa3665f348d41bdef2e4738e4cba5337526b93971da66"} Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.526179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerStarted","Data":"a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55"} Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.588756 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.588728562 podStartE2EDuration="3.588728562s" podCreationTimestamp="2025-11-21 12:58:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:53.572979698 +0000 UTC m=+4092.273641506" watchObservedRunningTime="2025-11-21 12:58:53.588728562 +0000 UTC m=+4092.289390380" Nov 21 12:58:53 crc kubenswrapper[4769]: I1121 12:58:53.944598 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.089747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-config-data\") pod \"55145a65-9d78-41d7-a8eb-74bf51851190\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.089981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tq52\" (UniqueName: \"kubernetes.io/projected/55145a65-9d78-41d7-a8eb-74bf51851190-kube-api-access-5tq52\") pod \"55145a65-9d78-41d7-a8eb-74bf51851190\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.090025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-scripts\") pod \"55145a65-9d78-41d7-a8eb-74bf51851190\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.090903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-combined-ca-bundle\") pod \"55145a65-9d78-41d7-a8eb-74bf51851190\" (UID: \"55145a65-9d78-41d7-a8eb-74bf51851190\") " Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.095425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-scripts" (OuterVolumeSpecName: "scripts") pod "55145a65-9d78-41d7-a8eb-74bf51851190" (UID: "55145a65-9d78-41d7-a8eb-74bf51851190"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.095539 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55145a65-9d78-41d7-a8eb-74bf51851190-kube-api-access-5tq52" (OuterVolumeSpecName: "kube-api-access-5tq52") pod "55145a65-9d78-41d7-a8eb-74bf51851190" (UID: "55145a65-9d78-41d7-a8eb-74bf51851190"). InnerVolumeSpecName "kube-api-access-5tq52". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.120997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-config-data" (OuterVolumeSpecName: "config-data") pod "55145a65-9d78-41d7-a8eb-74bf51851190" (UID: "55145a65-9d78-41d7-a8eb-74bf51851190"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.123235 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "55145a65-9d78-41d7-a8eb-74bf51851190" (UID: "55145a65-9d78-41d7-a8eb-74bf51851190"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.193338 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5tq52\" (UniqueName: \"kubernetes.io/projected/55145a65-9d78-41d7-a8eb-74bf51851190-kube-api-access-5tq52\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.193389 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.193400 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.193411 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55145a65-9d78-41d7-a8eb-74bf51851190-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.433119 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.433480 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="openstack-network-exporter" containerID="cri-o://13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d" gracePeriod=300 Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.492483 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.493053 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="ovn-northd" containerID="cri-o://776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb" gracePeriod=30 Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.493514 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="openstack-network-exporter" containerID="cri-o://83838d4f23a10ef752127c7eb1ff5a204e3b2dc6b9a0ba9c0fee13105c2a50e2" gracePeriod=30 Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.511215 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="ovsdbserver-nb" containerID="cri-o://bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867" gracePeriod=300 Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.537135 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.538389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc" event={"ID":"55145a65-9d78-41d7-a8eb-74bf51851190","Type":"ContainerDied","Data":"0e8c27fa69a0fff5b8260cc6b980f50111ebe0f27a5a6d88d3f0f96ef81fc5ce"} Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.538430 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e8c27fa69a0fff5b8260cc6b980f50111ebe0f27a5a6d88d3f0f96ef81fc5ce" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.544852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerStarted","Data":"3f2650816c0f69b4482827ad4399c43b72c31b02233419faeda1255cf30ab396"} Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.828767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.843254 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:54 crc kubenswrapper[4769]: E1121 12:58:54.943445 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:58:54 crc kubenswrapper[4769]: E1121 12:58:54.946142 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:58:54 crc kubenswrapper[4769]: E1121 12:58:54.967420 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 12:58:54 crc kubenswrapper[4769]: E1121 12:58:54.967493 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="ovn-northd" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.982817 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_537bd39d-da67-4aea-a004-b41392f866d7/ovsdbserver-nb/0.log" Nov 21 12:58:54 crc kubenswrapper[4769]: I1121 12:58:54.982888 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.145204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/537bd39d-da67-4aea-a004-b41392f866d7-combined-ca-bundle\") pod \"537bd39d-da67-4aea-a004-b41392f866d7\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.145466 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/537bd39d-da67-4aea-a004-b41392f866d7-ovsdb-rundir\") pod \"537bd39d-da67-4aea-a004-b41392f866d7\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.145578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-config\") pod \"537bd39d-da67-4aea-a004-b41392f866d7\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.145675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxqrm\" (UniqueName: \"kubernetes.io/projected/537bd39d-da67-4aea-a004-b41392f866d7-kube-api-access-hxqrm\") pod \"537bd39d-da67-4aea-a004-b41392f866d7\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.145756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"537bd39d-da67-4aea-a004-b41392f866d7\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.145927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-scripts\") pod \"537bd39d-da67-4aea-a004-b41392f866d7\" (UID: \"537bd39d-da67-4aea-a004-b41392f866d7\") " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.146746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-scripts" (OuterVolumeSpecName: "scripts") pod "537bd39d-da67-4aea-a004-b41392f866d7" (UID: "537bd39d-da67-4aea-a004-b41392f866d7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.147117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537bd39d-da67-4aea-a004-b41392f866d7-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "537bd39d-da67-4aea-a004-b41392f866d7" (UID: "537bd39d-da67-4aea-a004-b41392f866d7"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.147462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-config" (OuterVolumeSpecName: "config") pod "537bd39d-da67-4aea-a004-b41392f866d7" (UID: "537bd39d-da67-4aea-a004-b41392f866d7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.151770 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "537bd39d-da67-4aea-a004-b41392f866d7" (UID: "537bd39d-da67-4aea-a004-b41392f866d7"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.165633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537bd39d-da67-4aea-a004-b41392f866d7-kube-api-access-hxqrm" (OuterVolumeSpecName: "kube-api-access-hxqrm") pod "537bd39d-da67-4aea-a004-b41392f866d7" (UID: "537bd39d-da67-4aea-a004-b41392f866d7"). InnerVolumeSpecName "kube-api-access-hxqrm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.177150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/537bd39d-da67-4aea-a004-b41392f866d7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "537bd39d-da67-4aea-a004-b41392f866d7" (UID: "537bd39d-da67-4aea-a004-b41392f866d7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.255002 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.255386 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/537bd39d-da67-4aea-a004-b41392f866d7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.255401 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/537bd39d-da67-4aea-a004-b41392f866d7-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.255413 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/537bd39d-da67-4aea-a004-b41392f866d7-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.255427 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hxqrm\" (UniqueName: \"kubernetes.io/projected/537bd39d-da67-4aea-a004-b41392f866d7-kube-api-access-hxqrm\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.255471 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.291744 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.357457 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.570382 4769 generic.go:334] "Generic (PLEG): container finished" podID="488cd419-abc4-436c-9407-e577b7158bb2" containerID="83838d4f23a10ef752127c7eb1ff5a204e3b2dc6b9a0ba9c0fee13105c2a50e2" exitCode=2 Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.570466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"488cd419-abc4-436c-9407-e577b7158bb2","Type":"ContainerDied","Data":"83838d4f23a10ef752127c7eb1ff5a204e3b2dc6b9a0ba9c0fee13105c2a50e2"} Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.582301 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_537bd39d-da67-4aea-a004-b41392f866d7/ovsdbserver-nb/0.log" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.582355 4769 generic.go:334] "Generic (PLEG): container finished" podID="537bd39d-da67-4aea-a004-b41392f866d7" containerID="13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d" exitCode=2 Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.582377 4769 generic.go:334] "Generic (PLEG): container finished" podID="537bd39d-da67-4aea-a004-b41392f866d7" containerID="bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867" exitCode=143 Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.583281 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.583446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"537bd39d-da67-4aea-a004-b41392f866d7","Type":"ContainerDied","Data":"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d"} Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.583487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"537bd39d-da67-4aea-a004-b41392f866d7","Type":"ContainerDied","Data":"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867"} Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.583501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"537bd39d-da67-4aea-a004-b41392f866d7","Type":"ContainerDied","Data":"6644aca49364994fccd3efc5a7705f23243dd46e2a3b6d950c8525124632d105"} Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.583519 4769 scope.go:117] "RemoveContainer" containerID="13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.605271 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.783308 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.806624 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.816319 4769 scope.go:117] "RemoveContainer" containerID="bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830220 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:58:55 crc kubenswrapper[4769]: E1121 12:58:55.830572 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="ovsdbserver-nb" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830588 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="ovsdbserver-nb" Nov 21 12:58:55 crc kubenswrapper[4769]: E1121 12:58:55.830625 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="55145a65-9d78-41d7-a8eb-74bf51851190" containerName="nova-manage" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830632 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="55145a65-9d78-41d7-a8eb-74bf51851190" containerName="nova-manage" Nov 21 12:58:55 crc kubenswrapper[4769]: E1121 12:58:55.830653 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="openstack-network-exporter" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830661 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="openstack-network-exporter" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830823 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="55145a65-9d78-41d7-a8eb-74bf51851190" containerName="nova-manage" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830846 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="openstack-network-exporter" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.830865 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="537bd39d-da67-4aea-a004-b41392f866d7" containerName="ovsdbserver-nb" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.831773 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.835772 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.835905 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.836078 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.836211 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.836314 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-6t2fb" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.856325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.874414 4769 scope.go:117] "RemoveContainer" containerID="13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d" Nov 21 12:58:55 crc kubenswrapper[4769]: E1121 12:58:55.875083 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d\": container with ID starting with 13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d not found: ID does not exist" containerID="13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875108 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d"} err="failed to get container status \"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d\": rpc error: code = NotFound desc = could not find container \"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d\": container with ID starting with 13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d not found: ID does not exist" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875127 4769 scope.go:117] "RemoveContainer" containerID="bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867" Nov 21 12:58:55 crc kubenswrapper[4769]: E1121 12:58:55.875333 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867\": container with ID starting with bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867 not found: ID does not exist" containerID="bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875348 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867"} err="failed to get container status \"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867\": rpc error: code = NotFound desc = could not find container \"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867\": container with ID starting with bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867 not found: ID does not exist" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875369 4769 scope.go:117] "RemoveContainer" containerID="13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875518 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d"} err="failed to get container status \"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d\": rpc error: code = NotFound desc = could not find container \"13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d\": container with ID starting with 13e34f1856c6c3a8e306f12e488a47946b0f7e51af955890f0815518019c567d not found: ID does not exist" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875529 4769 scope.go:117] "RemoveContainer" containerID="bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.875659 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867"} err="failed to get container status \"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867\": rpc error: code = NotFound desc = could not find container \"bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867\": container with ID starting with bf95dc824f4ff0da801cea8addc6a709e901d04deff3906ab98471dfe42d2867 not found: ID does not exist" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-config\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.977975 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dkn\" (UniqueName: \"kubernetes.io/projected/705d3da4-5e5b-4fa0-b043-7d49a598a013-kube-api-access-z9dkn\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:55 crc kubenswrapper[4769]: I1121 12:58:55.978023 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.074579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.074618 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dkn\" (UniqueName: \"kubernetes.io/projected/705d3da4-5e5b-4fa0-b043-7d49a598a013-kube-api-access-z9dkn\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-config\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.083478 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.087649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.088166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-config\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.088437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.100815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.101340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dkn\" (UniqueName: \"kubernetes.io/projected/705d3da4-5e5b-4fa0-b043-7d49a598a013-kube-api-access-z9dkn\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.110240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.129683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.166126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.255825 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.393837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0568707-e35d-472d-8fd4-2e2695e84153-logs\") pod \"c0568707-e35d-472d-8fd4-2e2695e84153\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.393880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-combined-ca-bundle\") pod \"c0568707-e35d-472d-8fd4-2e2695e84153\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.393946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data\") pod \"c0568707-e35d-472d-8fd4-2e2695e84153\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.394025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data-custom\") pod \"c0568707-e35d-472d-8fd4-2e2695e84153\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.394044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcr8n\" (UniqueName: \"kubernetes.io/projected/c0568707-e35d-472d-8fd4-2e2695e84153-kube-api-access-rcr8n\") pod \"c0568707-e35d-472d-8fd4-2e2695e84153\" (UID: \"c0568707-e35d-472d-8fd4-2e2695e84153\") " Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.394440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0568707-e35d-472d-8fd4-2e2695e84153-logs" (OuterVolumeSpecName: "logs") pod "c0568707-e35d-472d-8fd4-2e2695e84153" (UID: "c0568707-e35d-472d-8fd4-2e2695e84153"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.394681 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0568707-e35d-472d-8fd4-2e2695e84153-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.397664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0568707-e35d-472d-8fd4-2e2695e84153-kube-api-access-rcr8n" (OuterVolumeSpecName: "kube-api-access-rcr8n") pod "c0568707-e35d-472d-8fd4-2e2695e84153" (UID: "c0568707-e35d-472d-8fd4-2e2695e84153"). InnerVolumeSpecName "kube-api-access-rcr8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.426136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c0568707-e35d-472d-8fd4-2e2695e84153" (UID: "c0568707-e35d-472d-8fd4-2e2695e84153"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.457339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0568707-e35d-472d-8fd4-2e2695e84153" (UID: "c0568707-e35d-472d-8fd4-2e2695e84153"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.468743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.471659 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.471707 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.475481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data" (OuterVolumeSpecName: "config-data") pod "c0568707-e35d-472d-8fd4-2e2695e84153" (UID: "c0568707-e35d-472d-8fd4-2e2695e84153"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.501317 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.501351 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.501361 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c0568707-e35d-472d-8fd4-2e2695e84153-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.501370 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rcr8n\" (UniqueName: \"kubernetes.io/projected/c0568707-e35d-472d-8fd4-2e2695e84153-kube-api-access-rcr8n\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.503244 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.503282 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.566842 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.579823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.649952 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.695679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerStarted","Data":"988e4211b3c097b1875f9a8e347ca7fc99a23fdd6074ff6222bae4e629fc4d53"} Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.695781 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-central-agent" containerID="cri-o://a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55" gracePeriod=30 Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.695901 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="proxy-httpd" containerID="cri-o://988e4211b3c097b1875f9a8e347ca7fc99a23fdd6074ff6222bae4e629fc4d53" gracePeriod=30 Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.695950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="sg-core" containerID="cri-o://3f2650816c0f69b4482827ad4399c43b72c31b02233419faeda1255cf30ab396" gracePeriod=30 Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.696036 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-notification-agent" containerID="cri-o://c71b4af322f7f66c7e5fa3665f348d41bdef2e4738e4cba5337526b93971da66" gracePeriod=30 Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.696127 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.731466 4769 generic.go:334] "Generic (PLEG): container finished" podID="c0568707-e35d-472d-8fd4-2e2695e84153" containerID="bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506" exitCode=0 Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.731636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" event={"ID":"c0568707-e35d-472d-8fd4-2e2695e84153","Type":"ContainerDied","Data":"bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506"} Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.731769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" event={"ID":"c0568707-e35d-472d-8fd4-2e2695e84153","Type":"ContainerDied","Data":"3d1bb2e71473946b89e83d71386f84093fcc2d79e6056155f3100732d3286b94"} Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.731792 4769 scope.go:117] "RemoveContainer" containerID="bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.732463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.755950 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.757557 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.779266 4769 scope.go:117] "RemoveContainer" containerID="4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.806031 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.777198986 podStartE2EDuration="6.806014161s" podCreationTimestamp="2025-11-21 12:58:50 +0000 UTC" firstStartedPulling="2025-11-21 12:58:51.603064364 +0000 UTC m=+4090.303726182" lastFinishedPulling="2025-11-21 12:58:55.631879539 +0000 UTC m=+4094.332541357" observedRunningTime="2025-11-21 12:58:56.721133776 +0000 UTC m=+4095.421795594" watchObservedRunningTime="2025-11-21 12:58:56.806014161 +0000 UTC m=+4095.506675969" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.860744 4769 scope.go:117] "RemoveContainer" containerID="bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506" Nov 21 12:58:56 crc kubenswrapper[4769]: E1121 12:58:56.862095 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506\": container with ID starting with bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506 not found: ID does not exist" containerID="bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.862136 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506"} err="failed to get container status \"bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506\": rpc error: code = NotFound desc = could not find container \"bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506\": container with ID starting with bef01a603f4489c524940f1bf646f18e4e10fce268eccdeb094dcfacdc792506 not found: ID does not exist" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.862163 4769 scope.go:117] "RemoveContainer" containerID="4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356" Nov 21 12:58:56 crc kubenswrapper[4769]: E1121 12:58:56.865645 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356\": container with ID starting with 4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356 not found: ID does not exist" containerID="4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356" Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.865684 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356"} err="failed to get container status \"4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356\": rpc error: code = NotFound desc = could not find container \"4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356\": container with ID starting with 4a7ddb5fb8886e6998aedf196bd95f73256ac512797e983609a4c02babcca356 not found: ID does not exist" Nov 21 12:58:56 crc kubenswrapper[4769]: E1121 12:58:56.868412 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/e9c31d193ba8a56612f06f4e73028aab5774a915ea3d7bd362a308da00262f3e/diff" to get inode usage: stat /var/lib/containers/storage/overlay/e9c31d193ba8a56612f06f4e73028aab5774a915ea3d7bd362a308da00262f3e/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/ceilometer-central-agent/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/ceilometer-central-agent/0.log: no such file or directory Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.871694 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql"] Nov 21 12:58:56 crc kubenswrapper[4769]: I1121 12:58:56.917157 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fd657ffb-f4pql"] Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.021496 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.160447 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.131:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.160829 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.131:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.250928 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.250968 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.294694 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="537bd39d-da67-4aea-a004-b41392f866d7" path="/var/lib/kubelet/pods/537bd39d-da67-4aea-a004-b41392f866d7/volumes" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.295306 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" path="/var/lib/kubelet/pods/c0568707-e35d-472d-8fd4-2e2695e84153/volumes" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.303136 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.307725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.554348 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.0.134:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.554358 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.0.134:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 12:58:57 crc kubenswrapper[4769]: E1121 12:58:57.575307 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/c6c898495e80c24c4e2767820c5e013cc7588623d33eb8d17db384c757b9af79/diff" to get inode usage: stat /var/lib/containers/storage/overlay/c6c898495e80c24c4e2767820c5e013cc7588623d33eb8d17db384c757b9af79/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/ceilometer-notification-agent/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/ceilometer-notification-agent/0.log: no such file or directory Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.790379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"705d3da4-5e5b-4fa0-b043-7d49a598a013","Type":"ContainerStarted","Data":"cd424d607f3bf1109e3e6231401239ad4185865bfab083821d5096ba0543287a"} Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.790432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"705d3da4-5e5b-4fa0-b043-7d49a598a013","Type":"ContainerStarted","Data":"e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b"} Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.790442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"705d3da4-5e5b-4fa0-b043-7d49a598a013","Type":"ContainerStarted","Data":"2a07f8276ad4a202e020cf0602d1cfef6e60d8f1e0df8d6025e948764f38d44e"} Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.802759 4769 generic.go:334] "Generic (PLEG): container finished" podID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerID="988e4211b3c097b1875f9a8e347ca7fc99a23fdd6074ff6222bae4e629fc4d53" exitCode=0 Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.802787 4769 generic.go:334] "Generic (PLEG): container finished" podID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerID="3f2650816c0f69b4482827ad4399c43b72c31b02233419faeda1255cf30ab396" exitCode=2 Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.802797 4769 generic.go:334] "Generic (PLEG): container finished" podID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerID="c71b4af322f7f66c7e5fa3665f348d41bdef2e4738e4cba5337526b93971da66" exitCode=0 Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.802832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerDied","Data":"988e4211b3c097b1875f9a8e347ca7fc99a23fdd6074ff6222bae4e629fc4d53"} Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.802856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerDied","Data":"3f2650816c0f69b4482827ad4399c43b72c31b02233419faeda1255cf30ab396"} Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.802866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerDied","Data":"c71b4af322f7f66c7e5fa3665f348d41bdef2e4738e4cba5337526b93971da66"} Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.804926 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.805467 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:58:57 crc kubenswrapper[4769]: I1121 12:58:57.811197 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.811168392 podStartE2EDuration="2.811168392s" podCreationTimestamp="2025-11-21 12:58:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:58:57.810142374 +0000 UTC m=+4096.510804192" watchObservedRunningTime="2025-11-21 12:58:57.811168392 +0000 UTC m=+4096.511830200" Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.267956 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.268690 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="openstack-network-exporter" containerID="cri-o://25d330d93ecbe38c5c832faacebc3d6ee5cb5119178d0c043e0d401c18e97ddb" gracePeriod=300 Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.336841 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="ovsdbserver-sb" containerID="cri-o://0541f5831d3b72ec53bc09054a4aa848a34a6d0154a074cb2577083cb474d7f2" gracePeriod=300 Nov 21 12:58:58 crc kubenswrapper[4769]: E1121 12:58:58.553139 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/100652e7ddfe983f9fa76e2322b6d303892eb55f5f834e42a38dc2776aab719e/diff" to get inode usage: stat /var/lib/containers/storage/overlay/100652e7ddfe983f9fa76e2322b6d303892eb55f5f834e42a38dc2776aab719e/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/sg-core/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/sg-core/0.log: no such file or directory Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.849432 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/ovn-northd/0.log" Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.849473 4769 generic.go:334] "Generic (PLEG): container finished" podID="488cd419-abc4-436c-9407-e577b7158bb2" containerID="776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb" exitCode=139 Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.849537 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"488cd419-abc4-436c-9407-e577b7158bb2","Type":"ContainerDied","Data":"776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb"} Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.873388 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/ovsdbserver-sb/0.log" Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.873670 4769 generic.go:334] "Generic (PLEG): container finished" podID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerID="25d330d93ecbe38c5c832faacebc3d6ee5cb5119178d0c043e0d401c18e97ddb" exitCode=2 Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.873685 4769 generic.go:334] "Generic (PLEG): container finished" podID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerID="0541f5831d3b72ec53bc09054a4aa848a34a6d0154a074cb2577083cb474d7f2" exitCode=143 Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.874667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"e208ea95-1e47-4b72-aaa7-43ea37d076bc","Type":"ContainerDied","Data":"25d330d93ecbe38c5c832faacebc3d6ee5cb5119178d0c043e0d401c18e97ddb"} Nov 21 12:58:58 crc kubenswrapper[4769]: I1121 12:58:58.874690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"e208ea95-1e47-4b72-aaa7-43ea37d076bc","Type":"ContainerDied","Data":"0541f5831d3b72ec53bc09054a4aa848a34a6d0154a074cb2577083cb474d7f2"} Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.167835 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/ovsdbserver-sb/0.log" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.167906 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.308912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e208ea95-1e47-4b72-aaa7-43ea37d076bc-ovsdb-rundir\") pod \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.308983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-scripts\") pod \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.309124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e208ea95-1e47-4b72-aaa7-43ea37d076bc-combined-ca-bundle\") pod \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.309146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-config\") pod \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.309208 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmzz9\" (UniqueName: \"kubernetes.io/projected/e208ea95-1e47-4b72-aaa7-43ea37d076bc-kube-api-access-tmzz9\") pod \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.309227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\" (UID: \"e208ea95-1e47-4b72-aaa7-43ea37d076bc\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.310111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-config" (OuterVolumeSpecName: "config") pod "e208ea95-1e47-4b72-aaa7-43ea37d076bc" (UID: "e208ea95-1e47-4b72-aaa7-43ea37d076bc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.310842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e208ea95-1e47-4b72-aaa7-43ea37d076bc-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "e208ea95-1e47-4b72-aaa7-43ea37d076bc" (UID: "e208ea95-1e47-4b72-aaa7-43ea37d076bc"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.311075 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-scripts" (OuterVolumeSpecName: "scripts") pod "e208ea95-1e47-4b72-aaa7-43ea37d076bc" (UID: "e208ea95-1e47-4b72-aaa7-43ea37d076bc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.314479 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e208ea95-1e47-4b72-aaa7-43ea37d076bc-kube-api-access-tmzz9" (OuterVolumeSpecName: "kube-api-access-tmzz9") pod "e208ea95-1e47-4b72-aaa7-43ea37d076bc" (UID: "e208ea95-1e47-4b72-aaa7-43ea37d076bc"). InnerVolumeSpecName "kube-api-access-tmzz9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.318884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "e208ea95-1e47-4b72-aaa7-43ea37d076bc" (UID: "e208ea95-1e47-4b72-aaa7-43ea37d076bc"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.345329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e208ea95-1e47-4b72-aaa7-43ea37d076bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e208ea95-1e47-4b72-aaa7-43ea37d076bc" (UID: "e208ea95-1e47-4b72-aaa7-43ea37d076bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.417350 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e208ea95-1e47-4b72-aaa7-43ea37d076bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.417386 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.417398 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tmzz9\" (UniqueName: \"kubernetes.io/projected/e208ea95-1e47-4b72-aaa7-43ea37d076bc-kube-api-access-tmzz9\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.417419 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.417430 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e208ea95-1e47-4b72-aaa7-43ea37d076bc-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.417438 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e208ea95-1e47-4b72-aaa7-43ea37d076bc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.451778 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.471903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.492393 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.492494 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.517068 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.523729 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.589377 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/ovn-northd/0.log" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.589492 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-scripts\") pod \"488cd419-abc4-436c-9407-e577b7158bb2\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-config\") pod \"488cd419-abc4-436c-9407-e577b7158bb2\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/488cd419-abc4-436c-9407-e577b7158bb2-ovn-rundir\") pod \"488cd419-abc4-436c-9407-e577b7158bb2\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhxwr\" (UniqueName: \"kubernetes.io/projected/488cd419-abc4-436c-9407-e577b7158bb2-kube-api-access-qhxwr\") pod \"488cd419-abc4-436c-9407-e577b7158bb2\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727431 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/488cd419-abc4-436c-9407-e577b7158bb2-combined-ca-bundle\") pod \"488cd419-abc4-436c-9407-e577b7158bb2\" (UID: \"488cd419-abc4-436c-9407-e577b7158bb2\") " Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-scripts" (OuterVolumeSpecName: "scripts") pod "488cd419-abc4-436c-9407-e577b7158bb2" (UID: "488cd419-abc4-436c-9407-e577b7158bb2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.727787 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.728240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/488cd419-abc4-436c-9407-e577b7158bb2-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "488cd419-abc4-436c-9407-e577b7158bb2" (UID: "488cd419-abc4-436c-9407-e577b7158bb2"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.728251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-config" (OuterVolumeSpecName: "config") pod "488cd419-abc4-436c-9407-e577b7158bb2" (UID: "488cd419-abc4-436c-9407-e577b7158bb2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.734371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/488cd419-abc4-436c-9407-e577b7158bb2-kube-api-access-qhxwr" (OuterVolumeSpecName: "kube-api-access-qhxwr") pod "488cd419-abc4-436c-9407-e577b7158bb2" (UID: "488cd419-abc4-436c-9407-e577b7158bb2"). InnerVolumeSpecName "kube-api-access-qhxwr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.750616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/488cd419-abc4-436c-9407-e577b7158bb2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "488cd419-abc4-436c-9407-e577b7158bb2" (UID: "488cd419-abc4-436c-9407-e577b7158bb2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.770163 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/e8dda4a5811ea86e17acfedae87b926769ee94838bc9730d686ffd0ad24b29d2/diff" to get inode usage: stat /var/lib/containers/storage/overlay/e8dda4a5811ea86e17acfedae87b926769ee94838bc9730d686ffd0ad24b29d2/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/proxy-httpd/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ceilometer-0_0c1391c1-afa5-489e-8f4d-4e409a35d72d/proxy-httpd/0.log: no such file or directory Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.780043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.835588 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488cd419-abc4-436c-9407-e577b7158bb2-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.835623 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/488cd419-abc4-436c-9407-e577b7158bb2-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.835638 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qhxwr\" (UniqueName: \"kubernetes.io/projected/488cd419-abc4-436c-9407-e577b7158bb2-kube-api-access-qhxwr\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.835647 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/488cd419-abc4-436c-9407-e577b7158bb2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.885146 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/ovsdbserver-sb/0.log" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.885613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"e208ea95-1e47-4b72-aaa7-43ea37d076bc","Type":"ContainerDied","Data":"3c046a095b18c33424a0daad47428bf71dcc193c8237a73fdf8fbc6f4d09068b"} Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.885620 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.885652 4769 scope.go:117] "RemoveContainer" containerID="25d330d93ecbe38c5c832faacebc3d6ee5cb5119178d0c043e0d401c18e97ddb" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.888026 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/ovn-northd/0.log" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.888095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"488cd419-abc4-436c-9407-e577b7158bb2","Type":"ContainerDied","Data":"0648f68ef7284ec1abf32e9bc57d121dba8138636cf76331920d4b3202cf641e"} Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.888157 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.888178 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.888292 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.905823 4769 scope.go:117] "RemoveContainer" containerID="0541f5831d3b72ec53bc09054a4aa848a34a6d0154a074cb2577083cb474d7f2" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.933468 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.938180 4769 scope.go:117] "RemoveContainer" containerID="83838d4f23a10ef752127c7eb1ff5a204e3b2dc6b9a0ba9c0fee13105c2a50e2" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.957285 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.971693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.983943 4769 scope.go:117] "RemoveContainer" containerID="776727bb7f53e01282424b3e1bf0dffe2de9f48301cf06e668444deea20663cb" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.985623 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993030 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.993741 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="ovn-northd" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993754 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="ovn-northd" Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.993767 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993773 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api" Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.993788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="ovsdbserver-sb" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993795 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="ovsdbserver-sb" Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.993809 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api-log" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api-log" Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.993834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="openstack-network-exporter" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993841 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="openstack-network-exporter" Nov 21 12:58:59 crc kubenswrapper[4769]: E1121 12:58:59.993852 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="openstack-network-exporter" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.993858 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="openstack-network-exporter" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.994033 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="openstack-network-exporter" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.994045 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="ovn-northd" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.994055 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api-log" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.994072 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" containerName="ovsdbserver-sb" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.994080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c0568707-e35d-472d-8fd4-2e2695e84153" containerName="barbican-api" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.994097 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="488cd419-abc4-436c-9407-e577b7158bb2" containerName="openstack-network-exporter" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.995077 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.998518 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-k78dv" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.998800 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.998836 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 12:58:59 crc kubenswrapper[4769]: I1121 12:58:59.998948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.001137 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.003781 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.004834 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.005612 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.005733 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-5l6g6" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.006776 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.007426 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.014804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:59:00 crc kubenswrapper[4769]: E1121 12:59:00.081560 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/3c2a456f6b737275f336793d08a3c741353495b25a30b03fd1d243fea78886b0/diff" to get inode usage: stat /var/lib/containers/storage/overlay/3c2a456f6b737275f336793d08a3c741353495b25a30b03fd1d243fea78886b0/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_rabbitmq-server-0_48a5313d-540b-4d62-8511-8154abf0acca/rabbitmq/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_rabbitmq-server-0_48a5313d-540b-4d62-8511-8154abf0acca/rabbitmq/0.log: no such file or directory Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.140951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.140997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv44s\" (UniqueName: \"kubernetes.io/projected/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-kube-api-access-sv44s\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-scripts\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141147 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141213 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-config\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx7nr\" (UniqueName: \"kubernetes.io/projected/358b6f0c-4310-4a43-9b1b-090cdb219e42-kube-api-access-cx7nr\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-config\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.141341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243364 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sv44s\" (UniqueName: \"kubernetes.io/projected/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-kube-api-access-sv44s\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-scripts\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-config\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cx7nr\" (UniqueName: \"kubernetes.io/projected/358b6f0c-4310-4a43-9b1b-090cdb219e42-kube-api-access-cx7nr\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.243968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.244016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-config\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.245732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.245966 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.246031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-config\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.246584 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.247789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-scripts\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.248230 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.249933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-config\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.251293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.252586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.252816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.253015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.253363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.260035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.266997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx7nr\" (UniqueName: \"kubernetes.io/projected/358b6f0c-4310-4a43-9b1b-090cdb219e42-kube-api-access-cx7nr\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.273041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.280670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv44s\" (UniqueName: \"kubernetes.io/projected/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-kube-api-access-sv44s\") pod \"ovn-northd-0\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.288157 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.304871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.319593 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.330627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.837714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.853583 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.881954 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.915522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8","Type":"ContainerStarted","Data":"47eb8fee85dd7f0df1610f86720fc21bcbfbeb2c9d6d85a51f6b26b1067dba53"} Nov 21 12:59:00 crc kubenswrapper[4769]: I1121 12:59:00.918671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358b6f0c-4310-4a43-9b1b-090cdb219e42","Type":"ContainerStarted","Data":"ff6b7f2c6f196fd8f3e62d469d3029a36b28398f838e96028d14bc67b5d00936"} Nov 21 12:59:01 crc kubenswrapper[4769]: E1121 12:59:01.065497 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/7508663f8ae7ad6c70f987d4921e6223587d2d12f2e1a16040a820273fc51abf/diff" to get inode usage: stat /var/lib/containers/storage/overlay/7508663f8ae7ad6c70f987d4921e6223587d2d12f2e1a16040a820273fc51abf/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_279f45ed-32ec-46a1-999e-eb8136b76df5/rabbitmq/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_279f45ed-32ec-46a1-999e-eb8136b76df5/rabbitmq/0.log: no such file or directory Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.289596 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="488cd419-abc4-436c-9407-e577b7158bb2" path="/var/lib/kubelet/pods/488cd419-abc4-436c-9407-e577b7158bb2/volumes" Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.290489 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e208ea95-1e47-4b72-aaa7-43ea37d076bc" path="/var/lib/kubelet/pods/e208ea95-1e47-4b72-aaa7-43ea37d076bc/volumes" Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.470252 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.929929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8","Type":"ContainerStarted","Data":"ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7"} Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.930297 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.930311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8","Type":"ContainerStarted","Data":"934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d"} Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.932692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358b6f0c-4310-4a43-9b1b-090cdb219e42","Type":"ContainerStarted","Data":"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc"} Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.932736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358b6f0c-4310-4a43-9b1b-090cdb219e42","Type":"ContainerStarted","Data":"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4"} Nov 21 12:59:01 crc kubenswrapper[4769]: I1121 12:59:01.954649 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.954628685 podStartE2EDuration="2.954628685s" podCreationTimestamp="2025-11-21 12:58:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:01.948376667 +0000 UTC m=+4100.649038495" watchObservedRunningTime="2025-11-21 12:59:01.954628685 +0000 UTC m=+4100.655290503" Nov 21 12:59:02 crc kubenswrapper[4769]: I1121 12:59:02.515822 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:59:02 crc kubenswrapper[4769]: I1121 12:59:02.554029 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.554007348 podStartE2EDuration="3.554007348s" podCreationTimestamp="2025-11-21 12:58:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:01.984545601 +0000 UTC m=+4100.685207419" watchObservedRunningTime="2025-11-21 12:59:02.554007348 +0000 UTC m=+4101.254669166" Nov 21 12:59:02 crc kubenswrapper[4769]: I1121 12:59:02.585306 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 12:59:03 crc kubenswrapper[4769]: I1121 12:59:03.320508 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:05 crc kubenswrapper[4769]: I1121 12:59:05.319713 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.082666 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.083348 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.084761 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.088683 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.369642 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.427443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.479646 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.482584 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.483046 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.988291 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.992181 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:06 crc kubenswrapper[4769]: I1121 12:59:06.993741 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.543084 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f"] Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.544980 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.546920 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.548008 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.559879 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f"] Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623278 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-logs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-combined-ca-bundle\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-public-tls-certs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qxmw\" (UniqueName: \"kubernetes.io/projected/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-kube-api-access-6qxmw\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-internal-tls-certs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.623713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data-custom\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-logs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-combined-ca-bundle\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-public-tls-certs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6qxmw\" (UniqueName: \"kubernetes.io/projected/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-kube-api-access-6qxmw\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725324 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-internal-tls-certs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data-custom\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.725940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-logs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.731841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data-custom\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.732373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.732388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-public-tls-certs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.734987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-internal-tls-certs\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.740856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-combined-ca-bundle\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.741900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qxmw\" (UniqueName: \"kubernetes.io/projected/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-kube-api-access-6qxmw\") pod \"barbican-api-5545dfbddd-4nh7f\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:08 crc kubenswrapper[4769]: I1121 12:59:08.867573 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:09 crc kubenswrapper[4769]: I1121 12:59:09.334684 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f"] Nov 21 12:59:09 crc kubenswrapper[4769]: I1121 12:59:09.526903 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-httpd" probeResult="failure" output="Get \"http://10.217.0.123:9696/\": dial tcp 10.217.0.123:9696: connect: connection refused" Nov 21 12:59:10 crc kubenswrapper[4769]: I1121 12:59:10.033317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" event={"ID":"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6","Type":"ContainerStarted","Data":"c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366"} Nov 21 12:59:10 crc kubenswrapper[4769]: I1121 12:59:10.033378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" event={"ID":"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6","Type":"ContainerStarted","Data":"1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4"} Nov 21 12:59:10 crc kubenswrapper[4769]: I1121 12:59:10.033398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" event={"ID":"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6","Type":"ContainerStarted","Data":"95ff776ae8de0e6dea2aea5655d4399de138bbd7162cde05f536bb2080fea1f8"} Nov 21 12:59:10 crc kubenswrapper[4769]: I1121 12:59:10.034949 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:10 crc kubenswrapper[4769]: I1121 12:59:10.034994 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:10 crc kubenswrapper[4769]: I1121 12:59:10.064755 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" podStartSLOduration=2.064735238 podStartE2EDuration="2.064735238s" podCreationTimestamp="2025-11-21 12:59:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:10.060686169 +0000 UTC m=+4108.761348027" watchObservedRunningTime="2025-11-21 12:59:10.064735238 +0000 UTC m=+4108.765397066" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.016092 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.075002 4769 generic.go:334] "Generic (PLEG): container finished" podID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerID="6164032da3c84d3e4e7f81f08212961d826c131dd4b8fce339cb2977daf4ef49" exitCode=137 Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.075099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" event={"ID":"14a04cbb-912b-4efe-820a-56aa5150ae5c","Type":"ContainerDied","Data":"6164032da3c84d3e4e7f81f08212961d826c131dd4b8fce339cb2977daf4ef49"} Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.084148 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7756664b4b-7s9gh"] Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.084373 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-api" containerID="cri-o://5aa33a1915af89c555f9dc997de37651a9b32a85cf3879217af8d4d6d8e837db" gracePeriod=30 Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.084472 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-httpd" containerID="cri-o://7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82" gracePeriod=30 Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.113640 4769 generic.go:334] "Generic (PLEG): container finished" podID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerID="92a838ac1402ea733ff16d45dc7cadef991e4de13e448a4e4f43472db87a572a" exitCode=137 Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.114739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"92a838ac1402ea733ff16d45dc7cadef991e4de13e448a4e4f43472db87a572a"} Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.280879 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.412127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") pod \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.412494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv95f\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-kube-api-access-dv95f\") pod \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.412705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.412772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-cache\") pod \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.412809 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-lock\") pod \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\" (UID: \"518a86ab-f04b-4ee1-9bba-13e68dd3367f\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.413710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-lock" (OuterVolumeSpecName: "lock") pod "518a86ab-f04b-4ee1-9bba-13e68dd3367f" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.414527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-cache" (OuterVolumeSpecName: "cache") pod "518a86ab-f04b-4ee1-9bba-13e68dd3367f" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.417481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-kube-api-access-dv95f" (OuterVolumeSpecName: "kube-api-access-dv95f") pod "518a86ab-f04b-4ee1-9bba-13e68dd3367f" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f"). InnerVolumeSpecName "kube-api-access-dv95f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.418295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "518a86ab-f04b-4ee1-9bba-13e68dd3367f" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.420365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "swift") pod "518a86ab-f04b-4ee1-9bba-13e68dd3367f" (UID: "518a86ab-f04b-4ee1-9bba-13e68dd3367f"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.488555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.514824 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dv95f\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-kube-api-access-dv95f\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.514897 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.514908 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-cache\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.514920 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/518a86ab-f04b-4ee1-9bba-13e68dd3367f-lock\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.514930 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/518a86ab-f04b-4ee1-9bba-13e68dd3367f-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.593689 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.622864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14a04cbb-912b-4efe-820a-56aa5150ae5c-logs\") pod \"14a04cbb-912b-4efe-820a-56aa5150ae5c\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.623073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data\") pod \"14a04cbb-912b-4efe-820a-56aa5150ae5c\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.623116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9brm\" (UniqueName: \"kubernetes.io/projected/14a04cbb-912b-4efe-820a-56aa5150ae5c-kube-api-access-d9brm\") pod \"14a04cbb-912b-4efe-820a-56aa5150ae5c\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.623154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data-custom\") pod \"14a04cbb-912b-4efe-820a-56aa5150ae5c\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.623174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-combined-ca-bundle\") pod \"14a04cbb-912b-4efe-820a-56aa5150ae5c\" (UID: \"14a04cbb-912b-4efe-820a-56aa5150ae5c\") " Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.623913 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a04cbb-912b-4efe-820a-56aa5150ae5c-logs" (OuterVolumeSpecName: "logs") pod "14a04cbb-912b-4efe-820a-56aa5150ae5c" (UID: "14a04cbb-912b-4efe-820a-56aa5150ae5c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.624483 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.626917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a04cbb-912b-4efe-820a-56aa5150ae5c-kube-api-access-d9brm" (OuterVolumeSpecName: "kube-api-access-d9brm") pod "14a04cbb-912b-4efe-820a-56aa5150ae5c" (UID: "14a04cbb-912b-4efe-820a-56aa5150ae5c"). InnerVolumeSpecName "kube-api-access-d9brm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.639788 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "14a04cbb-912b-4efe-820a-56aa5150ae5c" (UID: "14a04cbb-912b-4efe-820a-56aa5150ae5c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.653350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14a04cbb-912b-4efe-820a-56aa5150ae5c" (UID: "14a04cbb-912b-4efe-820a-56aa5150ae5c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.679090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data" (OuterVolumeSpecName: "config-data") pod "14a04cbb-912b-4efe-820a-56aa5150ae5c" (UID: "14a04cbb-912b-4efe-820a-56aa5150ae5c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.727224 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/14a04cbb-912b-4efe-820a-56aa5150ae5c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.727278 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.727302 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d9brm\" (UniqueName: \"kubernetes.io/projected/14a04cbb-912b-4efe-820a-56aa5150ae5c-kube-api-access-d9brm\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.727326 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:12 crc kubenswrapper[4769]: I1121 12:59:12.727345 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14a04cbb-912b-4efe-820a-56aa5150ae5c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.131064 4769 generic.go:334] "Generic (PLEG): container finished" podID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerID="7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82" exitCode=0 Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.131125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" event={"ID":"32857629-7f0b-49f3-b3cc-6de4ab3db5bb","Type":"ContainerDied","Data":"7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82"} Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.134947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" event={"ID":"14a04cbb-912b-4efe-820a-56aa5150ae5c","Type":"ContainerDied","Data":"865b6f9a3c9bdee2802eeb9c177b37673fa2fb64d4f4c25469d93c0871de37db"} Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.135002 4769 scope.go:117] "RemoveContainer" containerID="6164032da3c84d3e4e7f81f08212961d826c131dd4b8fce339cb2977daf4ef49" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.135264 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.151900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"518a86ab-f04b-4ee1-9bba-13e68dd3367f","Type":"ContainerDied","Data":"cb0206b5364a5a45cf48ca7ca50f4a34967626d0505ea4b126d83bf87cec25e0"} Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.152068 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.164757 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerID="4e318af89f022e0d78c68eb8f7a7f3908c2625db2c637810bad9fc2884a949e3" exitCode=137 Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.164798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" event={"ID":"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8","Type":"ContainerDied","Data":"4e318af89f022e0d78c68eb8f7a7f3908c2625db2c637810bad9fc2884a949e3"} Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.194809 4769 scope.go:117] "RemoveContainer" containerID="528de19b839ac92f8cac0dad7947e159b3d2704936cdbfe12fea13a57d82b571" Nov 21 12:59:13 crc kubenswrapper[4769]: W1121 12:59:13.202656 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/system.slice/system-systemd\\x2dcoredump.slice/systemd-coredump@6-304282-0.service": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/system.slice/system-systemd\x2dcoredump.slice/systemd-coredump@6-304282-0.service: no such file or directory Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.212969 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2"] Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.224038 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-568fb8b7b6-lddp2"] Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.233734 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.242754 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.244998 4769 scope.go:117] "RemoveContainer" containerID="92a838ac1402ea733ff16d45dc7cadef991e4de13e448a4e4f43472db87a572a" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.264712 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265160 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-server" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-server" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265196 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="rsync" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265202 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="rsync" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265212 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-updater" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265219 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-updater" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265244 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-expirer" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265253 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-expirer" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265264 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265284 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-updater" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265290 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-updater" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265299 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener-log" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265305 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener-log" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265317 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265323 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265330 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-server" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265335 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-server" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-server" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-server" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265364 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="swift-recon-cron" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265370 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="swift-recon-cron" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265388 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265396 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265415 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265420 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265434 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265440 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265449 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-reaper" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265454 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-reaper" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.265466 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265471 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265652 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-reaper" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265671 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-updater" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265680 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265695 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265705 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-server" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265715 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="container-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265727 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-expirer" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265736 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265741 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-updater" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265751 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265763 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="swift-recon-cron" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265773 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-server" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265781 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" containerName="barbican-keystone-listener-log" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="object-replicator" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265801 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-server" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265807 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="account-auditor" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.265819 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" containerName="rsync" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.272223 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.279492 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.294352 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded80d6c8_9e92_431d_9a46_6d9f4c9be521.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aae878d_4ff7_41f3_b5ce_540752cfc218.slice/crio-3c1a401c715975078a9726835cbb5458dcd1fda4d419b340911ec8ce119da90e\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf00f0d0d_e0f5_483c_8995_658e9a5d5389.slice/crio-69ca6f26d0096f1b968f43aff354b2a57b0ce71242a3ffecbdcebfeb24e735af\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc015826_af03_4f13_a223_5727adc49539.slice/crio-eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aae878d_4ff7_41f3_b5ce_540752cfc218.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc015826_af03_4f13_a223_5727adc49539.slice/crio-conmon-eb7cb76c790a8d07f4bc96ca68c3018082dc47f38ca0783baa9c678b3b936e4b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e04521_ef96_4028_9f3b_3b0bafbe2a8d.slice/crio-conmon-4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8dd19be_92f0_4348_9515_f5a8654256f7.slice/crio-conmon-fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83541dda_7a5e_4390_beba_4fa7bc472a8d.slice/crio-c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc015826_af03_4f13_a223_5727adc49539.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice/crio-a1cf3b2566838000fad267c4b34a2ab8de6128f4cfc3555fc3e7a3ebdef4fc5a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c004188_8379_4fca_8d50_f293586ce6f5.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice/crio-conmon-a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice/crio-conmon-3d42a4556277f4b66cfad1d44bd67efdfddb19a0674d546e69e44481a7043aa2.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf00f0d0d_e0f5_483c_8995_658e9a5d5389.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice/crio-a842aeb27ae175a7dc4d9b8ebb7afe9e1895b37213de754ae6285b0dac11bb24.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83541dda_7a5e_4390_beba_4fa7bc472a8d.slice/crio-d1bcaa1a2ebce1a4066913bf9aeabe77a12d4e71d3b6e1fbd3230b31b275823a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8249847_5e97_4b9d_b86e_88758d4f29a8.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83541dda_7a5e_4390_beba_4fa7bc472a8d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279f45ed_32ec_46a1_999e_eb8136b76df5.slice/crio-conmon-bb7913ca5ec0f188e66436ec552e90fbe1261d1870b97d0f697d6b766befad1a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8249847_5e97_4b9d_b86e_88758d4f29a8.slice/crio-36c7761da9689653bcbc74d81b4cbac8b503b2e8d89bc4bc2f9f818db47e8d8a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice/crio-conmon-b3335f0750906eb115787d3d3b664e09e9d64172330caf278916f526fa90a49f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8dd19be_92f0_4348_9515_f5a8654256f7.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c004188_8379_4fca_8d50_f293586ce6f5.slice/crio-fda319671db953e677c2eb8511ef61f4e08edcb62d7be200ff6330d71e28325d\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e04521_ef96_4028_9f3b_3b0bafbe2a8d.slice/crio-4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded80d6c8_9e92_431d_9a46_6d9f4c9be521.slice/crio-0dbbecf471a48320610ec039a7f5dd3ac320d9f0c9288bfe0b727aa0ba119fbb\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1391c1_afa5_489e_8f4d_4e409a35d72d.slice/crio-c9bf58af7f215c63d1ef37fef205e8d4ffcac33867b0167534e3c1d69fd7a3d0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8dd19be_92f0_4348_9515_f5a8654256f7.slice/crio-c330da28611db2069d4893241d925fac73efdddb6d73f5da94f2b763f05f941c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ced1c7f_b633_4f38_b821_f8eb9cf9b630.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd356c900_ff80_42a0_8fd8_8b68c06f9f15.slice/crio-ff9f24a6850423ad08d504b9af0c4511512d3628b3b7efc08884d41aa25581f8\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd356c900_ff80_42a0_8fd8_8b68c06f9f15.slice/crio-cbe64a043e09323dce82a6d1651d291a65b156e4e6c4418c987958992612dcad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ced1c7f_b633_4f38_b821_f8eb9cf9b630.slice/crio-d8bba3acfbce64bf337d7b3a6dbab7e462e3220ea8b446b1242d3a52c3d3604b\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8dd19be_92f0_4348_9515_f5a8654256f7.slice/crio-fb39d7a1fe3d6dda5c5d38e23c551fe7333695ce905754a942a0fca7771fbd6d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279f45ed_32ec_46a1_999e_eb8136b76df5.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd356c900_ff80_42a0_8fd8_8b68c06f9f15.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83541dda_7a5e_4390_beba_4fa7bc472a8d.slice/crio-conmon-c5472bbb818ca2dd3f8f864aaeedadfa9d26e9f02d36ce72c50a387c5a76a168.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4ef9eb_ffdd_4eb6_8726_4ebee296f251.slice/crio-conmon-3b9f35c4eb724e9484b1c9f0cb15aaa246a991ac72d15d0dd67f8652cedb72a5.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.332568 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a04cbb-912b-4efe-820a-56aa5150ae5c" path="/var/lib/kubelet/pods/14a04cbb-912b-4efe-820a-56aa5150ae5c/volumes" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.333506 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518a86ab-f04b-4ee1-9bba-13e68dd3367f" path="/var/lib/kubelet/pods/518a86ab-f04b-4ee1-9bba-13e68dd3367f/volumes" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.335394 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.389735 4769 scope.go:117] "RemoveContainer" containerID="48ac78290719a28b8a65fb2b1e00ce46444a0022eb4974d5f57bbf6a9cbc83ea" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.417662 4769 scope.go:117] "RemoveContainer" containerID="f765683feb2e0f1426e0b16abb61222a212032fa7183cd04c6c236404896b156" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.439366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-lock\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.439418 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-cache\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.439440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.439468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-etc-swift\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.439559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r27l7\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-kube-api-access-r27l7\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.516041 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.527893 4769 scope.go:117] "RemoveContainer" containerID="f5df53c59e1375fac0d8b0375bc81d73bacd1a0151d23df40f8e6bfd65223e20" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.544652 4769 scope.go:117] "RemoveContainer" containerID="ae730ab8fb5d7e35b715a5162b533d15ac439a26f800265a1333b62a112c5d1e" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.546249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-lock\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.546508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-cache\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.546638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.546976 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.546786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-lock\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.548166 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-etc-swift\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.548720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-cache\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.552018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r27l7\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-kube-api-access-r27l7\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.557911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-etc-swift\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.572078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r27l7\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-kube-api-access-r27l7\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.595721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"swift-storage-0\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.635500 4769 scope.go:117] "RemoveContainer" containerID="a413b78de0d50873bb41e7a995c611bfdee6d291a98621d94c00ac3bc624cb52" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.652064 4769 scope.go:117] "RemoveContainer" containerID="e26b4cb65ba7c4dbcd4dcb1eb2abb174ebfbfd08960a9e959fef0d9f09596514" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.653009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-logs\") pod \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.653118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcgrq\" (UniqueName: \"kubernetes.io/projected/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-kube-api-access-tcgrq\") pod \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.653160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data\") pod \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.653182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data-custom\") pod \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.653373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-combined-ca-bundle\") pod \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\" (UID: \"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8\") " Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.654613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-logs" (OuterVolumeSpecName: "logs") pod "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" (UID: "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.657311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-kube-api-access-tcgrq" (OuterVolumeSpecName: "kube-api-access-tcgrq") pod "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" (UID: "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8"). InnerVolumeSpecName "kube-api-access-tcgrq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.658393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" (UID: "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.670414 4769 scope.go:117] "RemoveContainer" containerID="6a29f76a44115ba58e6d5a4148557676be04e40e200d9bf5daaa2fb476cf3f7b" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.678403 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.679101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" (UID: "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.688102 4769 scope.go:117] "RemoveContainer" containerID="4afbb1d41d0984afaa018a0eeadb6bdb8b8c1c3a685f776c033e7063720abe7f" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.718652 4769 scope.go:117] "RemoveContainer" containerID="6e418a77e087210f81458a321f94daae19a012f31eb05c53218977f73c0c7ecb" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.719891 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data" (OuterVolumeSpecName: "config-data") pod "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" (UID: "8f89fc41-2862-4ea7-aaf8-47bc125c9ab8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.749599 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podf19f65b0-2588-4629-8d78-d8ba857f4506"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podf19f65b0-2588-4629-8d78-d8ba857f4506] : Timed out while waiting for systemd to remove kubepods-besteffort-podf19f65b0_2588_4629_8d78_d8ba857f4506.slice" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.749685 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podf19f65b0-2588-4629-8d78-d8ba857f4506] : unable to destroy cgroup paths for cgroup [kubepods besteffort podf19f65b0-2588-4629-8d78-d8ba857f4506] : Timed out while waiting for systemd to remove kubepods-besteffort-podf19f65b0_2588_4629_8d78_d8ba857f4506.slice" pod="openstack-kuttl-tests/memcached-0" podUID="f19f65b0-2588-4629-8d78-d8ba857f4506" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.749879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.754442 4769 scope.go:117] "RemoveContainer" containerID="4a53429063a1abad29db3e93af022c9698bde19d8f26120ed10411fc798631b2" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.755886 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.755912 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.755928 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tcgrq\" (UniqueName: \"kubernetes.io/projected/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-kube-api-access-tcgrq\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.755942 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.755954 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.756234 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21] : Timed out while waiting for systemd to remove kubepods-besteffort-pod1752e2cd_263b_4ba2_81c0_aaaa8a5a3f21.slice" Nov 21 12:59:13 crc kubenswrapper[4769]: E1121 12:59:13.756273 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21] : Timed out while waiting for systemd to remove kubepods-besteffort-pod1752e2cd_263b_4ba2_81c0_aaaa8a5a3f21.slice" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.801534 4769 scope.go:117] "RemoveContainer" containerID="7658acd3127c093ed6b53623fb41ae6ed83614172dec592ab8d7bd54e99d122c" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.812118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx"] Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.812366 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" podUID="f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" containerName="keystone-api" containerID="cri-o://bb53c5332774166691e3c581de6245cfeccf3a0874c0709c0b343e5f0b4beff8" gracePeriod=30 Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.846776 4769 scope.go:117] "RemoveContainer" containerID="48aaa1398a01cfdf10e3e994a6b204b33ab3cbffa345e750ec9e6fb4459d9b6a" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.870953 4769 scope.go:117] "RemoveContainer" containerID="19cae6c40c04f2d0b6aa8a7acdbccbe3b0829f9be0af252bfb2442dd0e24a934" Nov 21 12:59:13 crc kubenswrapper[4769]: I1121 12:59:13.893661 4769 scope.go:117] "RemoveContainer" containerID="f3c41189207483bed741fbe1eca04b77d12b0a5d653df610f2d21a60b9a3a52e" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.180856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" event={"ID":"8f89fc41-2862-4ea7-aaf8-47bc125c9ab8","Type":"ContainerDied","Data":"376ae7adc0d024c6d6b95a20af828ed053e42d7143b9d6ce1c0e41a14622fe48"} Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.180912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.180998 4769 scope.go:117] "RemoveContainer" containerID="4e318af89f022e0d78c68eb8f7a7f3908c2625db2c637810bad9fc2884a949e3" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.189720 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.191693 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.218350 4769 scope.go:117] "RemoveContainer" containerID="08f461aac05c605db54671fcc51feb3a9cd18ea03a631927fafecfc23b718a44" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.276138 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.330326 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.351594 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.367867 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.379385 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.385436 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: E1121 12:59:14.385973 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener-log" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.385993 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener-log" Nov 21 12:59:14 crc kubenswrapper[4769]: E1121 12:59:14.386025 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.386033 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.386332 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.386359 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" containerName="barbican-keystone-listener-log" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.387256 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.389202 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.389480 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.390323 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-hqthj" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.395801 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.407520 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.408824 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.410531 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.420319 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.430746 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-56f474c98b-xtrwd"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.438655 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.472836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-combined-ca-bundle\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.473066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-kolla-config\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.473106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-memcached-tls-certs\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.473376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdfr5\" (UniqueName: \"kubernetes.io/projected/24948f97-9424-4a52-82ed-a901848d4018-kube-api-access-pdfr5\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.473500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-config-data\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-kolla-config\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-memcached-tls-certs\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-config-data\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pdfr5\" (UniqueName: \"kubernetes.io/projected/24948f97-9424-4a52-82ed-a901848d4018-kube-api-access-pdfr5\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqx9l\" (UniqueName: \"kubernetes.io/projected/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-kube-api-access-bqx9l\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575652 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-config-data\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.575972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.576031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-combined-ca-bundle\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.576726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-kolla-config\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.576772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-config-data\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.582952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-memcached-tls-certs\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.583099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-combined-ca-bundle\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.597614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdfr5\" (UniqueName: \"kubernetes.io/projected/24948f97-9424-4a52-82ed-a901848d4018-kube-api-access-pdfr5\") pod \"memcached-0\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.678036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.678212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-config-data\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.678292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bqx9l\" (UniqueName: \"kubernetes.io/projected/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-kube-api-access-bqx9l\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.682778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.683659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-config-data\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.699623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqx9l\" (UniqueName: \"kubernetes.io/projected/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-kube-api-access-bqx9l\") pod \"nova-scheduler-0\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.783324 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.803693 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.932716 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7946bd886d-x52gg_45e04521-ef96-4028-9f3b-3b0bafbe2a8d/neutron-api/0.log" Nov 21 12:59:14 crc kubenswrapper[4769]: I1121 12:59:14.933636 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.088850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-httpd-config\") pod \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.088937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkmgv\" (UniqueName: \"kubernetes.io/projected/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-kube-api-access-dkmgv\") pod \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.088999 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-combined-ca-bundle\") pod \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.089374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-config\") pod \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\" (UID: \"45e04521-ef96-4028-9f3b-3b0bafbe2a8d\") " Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.094793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-kube-api-access-dkmgv" (OuterVolumeSpecName: "kube-api-access-dkmgv") pod "45e04521-ef96-4028-9f3b-3b0bafbe2a8d" (UID: "45e04521-ef96-4028-9f3b-3b0bafbe2a8d"). InnerVolumeSpecName "kube-api-access-dkmgv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.096041 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "45e04521-ef96-4028-9f3b-3b0bafbe2a8d" (UID: "45e04521-ef96-4028-9f3b-3b0bafbe2a8d"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.141291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45e04521-ef96-4028-9f3b-3b0bafbe2a8d" (UID: "45e04521-ef96-4028-9f3b-3b0bafbe2a8d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.148835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-config" (OuterVolumeSpecName: "config") pod "45e04521-ef96-4028-9f3b-3b0bafbe2a8d" (UID: "45e04521-ef96-4028-9f3b-3b0bafbe2a8d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.191862 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.191893 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dkmgv\" (UniqueName: \"kubernetes.io/projected/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-kube-api-access-dkmgv\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.191904 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.191913 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/45e04521-ef96-4028-9f3b-3b0bafbe2a8d-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.200263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"deafe43b3d4d64225e6b802c037e2c0eb88c52d4439dfb1cc07a0d5890be7916"} Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.200317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"6f0b78af199089faaf58ebca8cb5f22eb2d60a7a7a77f8784dffda080f9fbf3f"} Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.200330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"a6c4f377379bf48e842d63b21ab1e15c9c3f3600ee88effa1c081489c0ab8bce"} Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.200343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"c117f6edb318232be5460fffe4ccf0d63d7ba3a7c1d0f9d99bb1d0fe20e7b2cb"} Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.224513 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7946bd886d-x52gg_45e04521-ef96-4028-9f3b-3b0bafbe2a8d/neutron-api/0.log" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.224568 4769 generic.go:334] "Generic (PLEG): container finished" podID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerID="daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c" exitCode=137 Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.224602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" event={"ID":"45e04521-ef96-4028-9f3b-3b0bafbe2a8d","Type":"ContainerDied","Data":"daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c"} Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.224630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" event={"ID":"45e04521-ef96-4028-9f3b-3b0bafbe2a8d","Type":"ContainerDied","Data":"942c34f335fe1883be11f81cde7374286770b9eabdcf158947fcbb69a216e83b"} Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.224648 4769 scope.go:117] "RemoveContainer" containerID="4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.224759 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7946bd886d-x52gg" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.259963 4769 scope.go:117] "RemoveContainer" containerID="daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.272450 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7946bd886d-x52gg"] Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.289850 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21" path="/var/lib/kubelet/pods/1752e2cd-263b-4ba2-81c0-aaaa8a5a3f21/volumes" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.290873 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f89fc41-2862-4ea7-aaf8-47bc125c9ab8" path="/var/lib/kubelet/pods/8f89fc41-2862-4ea7-aaf8-47bc125c9ab8/volumes" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.291993 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19f65b0-2588-4629-8d78-d8ba857f4506" path="/var/lib/kubelet/pods/f19f65b0-2588-4629-8d78-d8ba857f4506/volumes" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.292956 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7946bd886d-x52gg"] Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.297881 4769 scope.go:117] "RemoveContainer" containerID="4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56" Nov 21 12:59:15 crc kubenswrapper[4769]: E1121 12:59:15.301567 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56\": container with ID starting with 4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56 not found: ID does not exist" containerID="4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.301634 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56"} err="failed to get container status \"4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56\": rpc error: code = NotFound desc = could not find container \"4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56\": container with ID starting with 4cf6bda0226ca1afa7c80a882aaf2e6181d1773b3b065c61c8d6fe798b9caf56 not found: ID does not exist" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.301679 4769 scope.go:117] "RemoveContainer" containerID="daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c" Nov 21 12:59:15 crc kubenswrapper[4769]: E1121 12:59:15.305478 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c\": container with ID starting with daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c not found: ID does not exist" containerID="daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.305544 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c"} err="failed to get container status \"daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c\": rpc error: code = NotFound desc = could not find container \"daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c\": container with ID starting with daed22ba1d8dbc9c4c69d468039bb5dbf3c9d492ddbc992080f160e9f86da87c not found: ID does not exist" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.338791 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-httpd" probeResult="failure" output="Get \"http://10.217.1.251:9696/\": dial tcp 10.217.1.251:9696: connect: connection refused" Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.342069 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.410690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:15 crc kubenswrapper[4769]: I1121 12:59:15.432053 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.247587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b61ccb84-4f33-4f62-ab1a-986f3e1974fe","Type":"ContainerStarted","Data":"8bb012949d2cad0c01d59453979805304af08b33a2f7c2094edd9b64e0b2d594"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.247950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b61ccb84-4f33-4f62-ab1a-986f3e1974fe","Type":"ContainerStarted","Data":"71dd30ff5da5447f8e572efbf788f05d2d21e0d84245feb7432eab131ed77d30"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.249486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"24948f97-9424-4a52-82ed-a901848d4018","Type":"ContainerStarted","Data":"febfee118e9eed487e0935be09ceee0423f97b88427df8ddff82bc0e98f6bfc0"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.249531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"24948f97-9424-4a52-82ed-a901848d4018","Type":"ContainerStarted","Data":"8d8e059661ed31fa43e3d83b8b19ae0d7a37bf64c4832309b64b516913c9fd94"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.249570 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.257279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"18e9cdfaea2562b46fb2532590de989615ad928caf86009809eabc04316d798e"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.257313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"db8f14bf60e6abcd8f658b1dd66c729d7d27295d4512e63ee31508a2702f6a29"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.257325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"ad8b93236f1c04b4834204f689352897f5e359f758e41c0f748bf1c686222b23"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.257333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"41a602203e83d0e6af60e006c173309fc07c2e6fd0a50b4197767953343be373"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.257341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"237b1e0dd3912ca9a6e59c9e9f218820ab4bd1fe785b529e25ed9dbf82687350"} Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.270462 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.270447592 podStartE2EDuration="2.270447592s" podCreationTimestamp="2025-11-21 12:59:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:16.265414827 +0000 UTC m=+4114.966076645" watchObservedRunningTime="2025-11-21 12:59:16.270447592 +0000 UTC m=+4114.971109410" Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.582596 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.606291 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.606274117 podStartE2EDuration="2.606274117s" podCreationTimestamp="2025-11-21 12:59:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:16.293588035 +0000 UTC m=+4114.994249853" watchObservedRunningTime="2025-11-21 12:59:16.606274117 +0000 UTC m=+4115.306935925" Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.679953 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.736061 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-664777594-l8qtg"] Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.736322 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-664777594-l8qtg" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-log" containerID="cri-o://4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23" gracePeriod=30 Nov 21 12:59:16 crc kubenswrapper[4769]: I1121 12:59:16.736405 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-664777594-l8qtg" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-api" containerID="cri-o://dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585" gracePeriod=30 Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.313181 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" path="/var/lib/kubelet/pods/45e04521-ef96-4028-9f3b-3b0bafbe2a8d/volumes" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.324444 4769 generic.go:334] "Generic (PLEG): container finished" podID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerID="4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23" exitCode=143 Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.324543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-664777594-l8qtg" event={"ID":"1272b297-f9c9-4aee-9d3c-228c03e7ee3a","Type":"ContainerDied","Data":"4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23"} Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.341440 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" containerID="bb53c5332774166691e3c581de6245cfeccf3a0874c0709c0b343e5f0b4beff8" exitCode=0 Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.341530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" event={"ID":"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5","Type":"ContainerDied","Data":"bb53c5332774166691e3c581de6245cfeccf3a0874c0709c0b343e5f0b4beff8"} Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.390280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"9a52877dedfb5d79b8df000b889d7dd6422bebef829bd516f3330ad7b9f3238e"} Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.390327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"d1fee3cbfc0a272e339e8452f5cd513ca9d2bd696ec42b72e02227a659be5d10"} Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.390340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"047ecb31f533715cada52cbcc20c476844351e8972f43e1c7b9f6fcc82610ee3"} Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.390349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"3027ddbe8ffc6b6ab8af00f2f3f13952c5d706fb3b1c4fbb764ea98e2f0acc4e"} Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.581116 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.648226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-config-data\") pod \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.648283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-scripts\") pod \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.648335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-combined-ca-bundle\") pod \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.648502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-fernet-keys\") pod \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.648537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-credential-keys\") pod \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.648554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtvvx\" (UniqueName: \"kubernetes.io/projected/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-kube-api-access-wtvvx\") pod \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\" (UID: \"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5\") " Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.662929 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" (UID: "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.662960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" (UID: "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.663000 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-scripts" (OuterVolumeSpecName: "scripts") pod "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" (UID: "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.668411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-kube-api-access-wtvvx" (OuterVolumeSpecName: "kube-api-access-wtvvx") pod "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" (UID: "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5"). InnerVolumeSpecName "kube-api-access-wtvvx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.708291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" (UID: "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.726832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-config-data" (OuterVolumeSpecName: "config-data") pod "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" (UID: "f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.750983 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.751231 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.751314 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wtvvx\" (UniqueName: \"kubernetes.io/projected/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-kube-api-access-wtvvx\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.751387 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.751470 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:17 crc kubenswrapper[4769]: I1121 12:59:17.751549 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.402007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" event={"ID":"f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5","Type":"ContainerDied","Data":"6168358ab8831885771f8e8f0cf076024524f992ce67c7645958eb4fbcec79fb"} Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.403377 4769 scope.go:117] "RemoveContainer" containerID="bb53c5332774166691e3c581de6245cfeccf3a0874c0709c0b343e5f0b4beff8" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.402024 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.410551 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"d34893141bac7e14324235e7119164d8ef9d53ebb6113bfc39439d542249d903"} Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.410588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"f1f3a59139be3889aef6f9a4490858cda0b7511988c72fae3bf1dc6a34a4348b"} Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.410599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerStarted","Data":"31d592f452e6dd5bd46a420b62746166664e4fc3c34f70bd4a19053d8d50d5a6"} Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.440485 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=5.440470105 podStartE2EDuration="5.440470105s" podCreationTimestamp="2025-11-21 12:59:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:18.436743905 +0000 UTC m=+4117.137405723" watchObservedRunningTime="2025-11-21 12:59:18.440470105 +0000 UTC m=+4117.141131923" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.462961 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx"] Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.478292 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-56ff9ff65d-s2vlx"] Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559221 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km"] Nov 21 12:59:18 crc kubenswrapper[4769]: E1121 12:59:18.559641 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" containerName="keystone-api" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559659 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" containerName="keystone-api" Nov 21 12:59:18 crc kubenswrapper[4769]: E1121 12:59:18.559673 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-httpd" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559679 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-httpd" Nov 21 12:59:18 crc kubenswrapper[4769]: E1121 12:59:18.559694 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-api" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559700 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-api" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559916 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" containerName="keystone-api" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559938 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-api" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.559949 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45e04521-ef96-4028-9f3b-3b0bafbe2a8d" containerName="neutron-httpd" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.560892 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.583346 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km"] Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.667844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.667996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-config\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.668048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.668075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9w48\" (UniqueName: \"kubernetes.io/projected/f901f005-737d-4660-95ab-a115d6a371d4-kube-api-access-w9w48\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.769533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.769585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w9w48\" (UniqueName: \"kubernetes.io/projected/f901f005-737d-4660-95ab-a115d6a371d4-kube-api-access-w9w48\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.769640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.769720 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-config\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.770680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.770800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.771180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-config\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.788295 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9w48\" (UniqueName: \"kubernetes.io/projected/f901f005-737d-4660-95ab-a115d6a371d4-kube-api-access-w9w48\") pod \"dnsmasq-dnsmasq-6497b78855-rm5km\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:18 crc kubenswrapper[4769]: I1121 12:59:18.876070 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.296427 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5" path="/var/lib/kubelet/pods/f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5/volumes" Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.354245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km"] Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.426043 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podd356c900-ff80-42a0-8fd8-8b68c06f9f15"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podd356c900-ff80-42a0-8fd8-8b68c06f9f15] : Timed out while waiting for systemd to remove kubepods-besteffort-podd356c900_ff80_42a0_8fd8_8b68c06f9f15.slice" Nov 21 12:59:19 crc kubenswrapper[4769]: E1121 12:59:19.426099 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podd356c900-ff80-42a0-8fd8-8b68c06f9f15] : unable to destroy cgroup paths for cgroup [kubepods besteffort podd356c900-ff80-42a0-8fd8-8b68c06f9f15] : Timed out while waiting for systemd to remove kubepods-besteffort-podd356c900_ff80_42a0_8fd8_8b68c06f9f15.slice" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.431572 4769 generic.go:334] "Generic (PLEG): container finished" podID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerID="8bb012949d2cad0c01d59453979805304af08b33a2f7c2094edd9b64e0b2d594" exitCode=1 Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.431638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b61ccb84-4f33-4f62-ab1a-986f3e1974fe","Type":"ContainerDied","Data":"8bb012949d2cad0c01d59453979805304af08b33a2f7c2094edd9b64e0b2d594"} Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.432304 4769 scope.go:117] "RemoveContainer" containerID="8bb012949d2cad0c01d59453979805304af08b33a2f7c2094edd9b64e0b2d594" Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.433613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" event={"ID":"f901f005-737d-4660-95ab-a115d6a371d4","Type":"ContainerStarted","Data":"7aaa12c2e6725de79568da150da77225f6e0b912794350cbf14c293a129d3bef"} Nov 21 12:59:19 crc kubenswrapper[4769]: I1121 12:59:19.804200 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.283121 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.390653 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.398691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-scripts\") pod \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.398765 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzjxj\" (UniqueName: \"kubernetes.io/projected/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-kube-api-access-nzjxj\") pod \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.398884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-logs\") pod \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.398908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-config-data\") pod \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.398984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-combined-ca-bundle\") pod \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\" (UID: \"1272b297-f9c9-4aee-9d3c-228c03e7ee3a\") " Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.399300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-logs" (OuterVolumeSpecName: "logs") pod "1272b297-f9c9-4aee-9d3c-228c03e7ee3a" (UID: "1272b297-f9c9-4aee-9d3c-228c03e7ee3a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.399815 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.406776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-scripts" (OuterVolumeSpecName: "scripts") pod "1272b297-f9c9-4aee-9d3c-228c03e7ee3a" (UID: "1272b297-f9c9-4aee-9d3c-228c03e7ee3a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.419552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-kube-api-access-nzjxj" (OuterVolumeSpecName: "kube-api-access-nzjxj") pod "1272b297-f9c9-4aee-9d3c-228c03e7ee3a" (UID: "1272b297-f9c9-4aee-9d3c-228c03e7ee3a"). InnerVolumeSpecName "kube-api-access-nzjxj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.452796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b61ccb84-4f33-4f62-ab1a-986f3e1974fe","Type":"ContainerStarted","Data":"0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69"} Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.454619 4769 generic.go:334] "Generic (PLEG): container finished" podID="f901f005-737d-4660-95ab-a115d6a371d4" containerID="4b49cbc2b0f1ca3dc97f3d65b7b58d2a12f8244814f013ff9b00e5d0384e4339" exitCode=0 Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.454685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" event={"ID":"f901f005-737d-4660-95ab-a115d6a371d4","Type":"ContainerDied","Data":"4b49cbc2b0f1ca3dc97f3d65b7b58d2a12f8244814f013ff9b00e5d0384e4339"} Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.458006 4769 generic.go:334] "Generic (PLEG): container finished" podID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerID="dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585" exitCode=0 Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.458073 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.458835 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-664777594-l8qtg" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.458975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-664777594-l8qtg" event={"ID":"1272b297-f9c9-4aee-9d3c-228c03e7ee3a","Type":"ContainerDied","Data":"dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585"} Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.458995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-664777594-l8qtg" event={"ID":"1272b297-f9c9-4aee-9d3c-228c03e7ee3a","Type":"ContainerDied","Data":"b2ff1b1a49e309aa64a5c9503fc951d2e6cf4a8fdb9710888efbd10f0a2fc690"} Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.459009 4769 scope.go:117] "RemoveContainer" containerID="dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.463703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-config-data" (OuterVolumeSpecName: "config-data") pod "1272b297-f9c9-4aee-9d3c-228c03e7ee3a" (UID: "1272b297-f9c9-4aee-9d3c-228c03e7ee3a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.466658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1272b297-f9c9-4aee-9d3c-228c03e7ee3a" (UID: "1272b297-f9c9-4aee-9d3c-228c03e7ee3a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.501931 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.501960 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.501969 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.501979 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzjxj\" (UniqueName: \"kubernetes.io/projected/1272b297-f9c9-4aee-9d3c-228c03e7ee3a-kube-api-access-nzjxj\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.612219 4769 scope.go:117] "RemoveContainer" containerID="4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.621217 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv"] Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.631272 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-548b4f9566-42xxv"] Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.635547 4769 scope.go:117] "RemoveContainer" containerID="dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585" Nov 21 12:59:20 crc kubenswrapper[4769]: E1121 12:59:20.636549 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585\": container with ID starting with dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585 not found: ID does not exist" containerID="dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.636580 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585"} err="failed to get container status \"dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585\": rpc error: code = NotFound desc = could not find container \"dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585\": container with ID starting with dba66fbb6bf315e5193906ee3db768317dcceb2e8b99ce94290b0e2635896585 not found: ID does not exist" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.636602 4769 scope.go:117] "RemoveContainer" containerID="4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23" Nov 21 12:59:20 crc kubenswrapper[4769]: E1121 12:59:20.636907 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23\": container with ID starting with 4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23 not found: ID does not exist" containerID="4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.636928 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23"} err="failed to get container status \"4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23\": rpc error: code = NotFound desc = could not find container \"4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23\": container with ID starting with 4ecb3f810208b7da6b29e2d4f767a2d5b4b38abdb048b43b040a9744136f0c23 not found: ID does not exist" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.694839 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.750409 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h"] Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.750630 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api-log" containerID="cri-o://8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a" gracePeriod=30 Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.750677 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api" containerID="cri-o://0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f" gracePeriod=30 Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.800248 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-664777594-l8qtg"] Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.807173 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-664777594-l8qtg"] Nov 21 12:59:20 crc kubenswrapper[4769]: I1121 12:59:20.808376 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.0.138:3000/\": dial tcp 10.217.0.138:3000: connect: connection refused" Nov 21 12:59:21 crc kubenswrapper[4769]: I1121 12:59:21.288168 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" path="/var/lib/kubelet/pods/1272b297-f9c9-4aee-9d3c-228c03e7ee3a/volumes" Nov 21 12:59:21 crc kubenswrapper[4769]: I1121 12:59:21.289115 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d356c900-ff80-42a0-8fd8-8b68c06f9f15" path="/var/lib/kubelet/pods/d356c900-ff80-42a0-8fd8-8b68c06f9f15/volumes" Nov 21 12:59:21 crc kubenswrapper[4769]: I1121 12:59:21.471533 4769 generic.go:334] "Generic (PLEG): container finished" podID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerID="8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a" exitCode=143 Nov 21 12:59:21 crc kubenswrapper[4769]: I1121 12:59:21.471600 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" event={"ID":"9bcac63b-2c20-48f8-81cb-cf34894fdcda","Type":"ContainerDied","Data":"8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a"} Nov 21 12:59:21 crc kubenswrapper[4769]: I1121 12:59:21.477276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" event={"ID":"f901f005-737d-4660-95ab-a115d6a371d4","Type":"ContainerStarted","Data":"9d09609f8a78c57935de97573ab4cb14d5fbcb75ede9525de9e7ebb04b8d1d6c"} Nov 21 12:59:21 crc kubenswrapper[4769]: I1121 12:59:21.505906 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" podStartSLOduration=3.505860464 podStartE2EDuration="3.505860464s" podCreationTimestamp="2025-11-21 12:59:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:21.498113406 +0000 UTC m=+4120.198775224" watchObservedRunningTime="2025-11-21 12:59:21.505860464 +0000 UTC m=+4120.206522322" Nov 21 12:59:22 crc kubenswrapper[4769]: I1121 12:59:22.509173 4769 generic.go:334] "Generic (PLEG): container finished" podID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerID="0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69" exitCode=1 Nov 21 12:59:22 crc kubenswrapper[4769]: I1121 12:59:22.509459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b61ccb84-4f33-4f62-ab1a-986f3e1974fe","Type":"ContainerDied","Data":"0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69"} Nov 21 12:59:22 crc kubenswrapper[4769]: I1121 12:59:22.510266 4769 scope.go:117] "RemoveContainer" containerID="8bb012949d2cad0c01d59453979805304af08b33a2f7c2094edd9b64e0b2d594" Nov 21 12:59:22 crc kubenswrapper[4769]: I1121 12:59:22.511122 4769 scope.go:117] "RemoveContainer" containerID="0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69" Nov 21 12:59:22 crc kubenswrapper[4769]: I1121 12:59:22.511292 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:22 crc kubenswrapper[4769]: E1121 12:59:22.511611 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(b61ccb84-4f33-4f62-ab1a-986f3e1974fe)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.415936 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.554617 4769 generic.go:334] "Generic (PLEG): container finished" podID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerID="0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f" exitCode=0 Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.554660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" event={"ID":"9bcac63b-2c20-48f8-81cb-cf34894fdcda","Type":"ContainerDied","Data":"0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f"} Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.554691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" event={"ID":"9bcac63b-2c20-48f8-81cb-cf34894fdcda","Type":"ContainerDied","Data":"5ae77bcfd0bb10b5bfb4a59b3ac5821e62c2b4f233f76f1761e94d705e532cf0"} Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.554698 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.554709 4769 scope.go:117] "RemoveContainer" containerID="0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.579679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-combined-ca-bundle\") pod \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.579713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data-custom\") pod \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.579824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data\") pod \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.579847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9cq\" (UniqueName: \"kubernetes.io/projected/9bcac63b-2c20-48f8-81cb-cf34894fdcda-kube-api-access-kq9cq\") pod \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.579910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9bcac63b-2c20-48f8-81cb-cf34894fdcda-logs\") pod \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\" (UID: \"9bcac63b-2c20-48f8-81cb-cf34894fdcda\") " Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.580778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcac63b-2c20-48f8-81cb-cf34894fdcda-logs" (OuterVolumeSpecName: "logs") pod "9bcac63b-2c20-48f8-81cb-cf34894fdcda" (UID: "9bcac63b-2c20-48f8-81cb-cf34894fdcda"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.581016 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9bcac63b-2c20-48f8-81cb-cf34894fdcda-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.585703 4769 scope.go:117] "RemoveContainer" containerID="8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.586349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcac63b-2c20-48f8-81cb-cf34894fdcda-kube-api-access-kq9cq" (OuterVolumeSpecName: "kube-api-access-kq9cq") pod "9bcac63b-2c20-48f8-81cb-cf34894fdcda" (UID: "9bcac63b-2c20-48f8-81cb-cf34894fdcda"). InnerVolumeSpecName "kube-api-access-kq9cq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.588675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9bcac63b-2c20-48f8-81cb-cf34894fdcda" (UID: "9bcac63b-2c20-48f8-81cb-cf34894fdcda"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.635491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data" (OuterVolumeSpecName: "config-data") pod "9bcac63b-2c20-48f8-81cb-cf34894fdcda" (UID: "9bcac63b-2c20-48f8-81cb-cf34894fdcda"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.637220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9bcac63b-2c20-48f8-81cb-cf34894fdcda" (UID: "9bcac63b-2c20-48f8-81cb-cf34894fdcda"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.681928 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.681963 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.681972 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9bcac63b-2c20-48f8-81cb-cf34894fdcda-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.681982 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kq9cq\" (UniqueName: \"kubernetes.io/projected/9bcac63b-2c20-48f8-81cb-cf34894fdcda-kube-api-access-kq9cq\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.784815 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.812758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.813105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.813153 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.813164 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.814244 4769 scope.go:117] "RemoveContainer" containerID="0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69" Nov 21 12:59:24 crc kubenswrapper[4769]: E1121 12:59:24.814551 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(b61ccb84-4f33-4f62-ab1a-986f3e1974fe)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.822773 4769 scope.go:117] "RemoveContainer" containerID="0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f" Nov 21 12:59:24 crc kubenswrapper[4769]: E1121 12:59:24.823237 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f\": container with ID starting with 0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f not found: ID does not exist" containerID="0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.823271 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f"} err="failed to get container status \"0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f\": rpc error: code = NotFound desc = could not find container \"0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f\": container with ID starting with 0f209b51c643f25a9da047c71c774e48d7af5ca728cf992825c4e48baeab1b1f not found: ID does not exist" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.823296 4769 scope.go:117] "RemoveContainer" containerID="8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a" Nov 21 12:59:24 crc kubenswrapper[4769]: E1121 12:59:24.823517 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a\": container with ID starting with 8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a not found: ID does not exist" containerID="8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.823548 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a"} err="failed to get container status \"8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a\": rpc error: code = NotFound desc = could not find container \"8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a\": container with ID starting with 8e93338afc93a73141ebb21959b7a5dfa1fbdeaa4d42cc5521d76ecdb7b7a63a not found: ID does not exist" Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.899978 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h"] Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.906496 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-75f4c578fb-4g42h"] Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.925125 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.925362 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" containerID="cri-o://46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" gracePeriod=30 Nov 21 12:59:24 crc kubenswrapper[4769]: I1121 12:59:24.942439 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.012537 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.012926 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="probe" containerID="cri-o://31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.012836 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="cinder-scheduler" containerID="cri-o://54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.077230 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.077464 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api-log" containerID="cri-o://c1f8cee72fec018dfde56d2f7e8cbe5d1e29c22acdf13b93e17f08641898c58c" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.077579 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api" containerID="cri-o://c80d4b620975884e05c11ceb27303ac1a2b3583afc75dd1610a3fc8677556f13" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.116718 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.116940 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="6ded5830-49b2-42ca-9a78-50a831417844" containerName="nova-cell1-conductor-conductor" containerID="cri-o://4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.127648 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-bp8bh"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.136105 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-bp8bh"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.188217 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.188452 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-log" containerID="cri-o://16e599ac25444568bec0868946286298a0c586bedd720ee6698bf3c1f6881eb9" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.188641 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-httpd" containerID="cri-o://e45f73eb8512fffa53269041f9095bc3a7dad12e398ef818420241fe14475f1f" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.235687 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dsj6v"] Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.236089 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-api" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236106 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-api" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.236124 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-log" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236130 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-log" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.236151 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.236169 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api-log" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236175 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api-log" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236365 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-log" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236386 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api-log" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236394 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1272b297-f9c9-4aee-9d3c-228c03e7ee3a" containerName="placement-api" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.236408 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" containerName="barbican-api" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.237069 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.240422 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.263446 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dsj6v"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.293047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-combined-ca-bundle\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.293155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-credential-keys\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.293182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-fernet-keys\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.293247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-scripts\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.293304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdsd\" (UniqueName: \"kubernetes.io/projected/b7e7755d-72e1-4e20-a67b-04f8e88feafd-kube-api-access-wpdsd\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.293329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-config-data\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.330266 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959b21b1-bcd8-49eb-baa6-03ddf9b73516" path="/var/lib/kubelet/pods/959b21b1-bcd8-49eb-baa6-03ddf9b73516/volumes" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.330833 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bcac63b-2c20-48f8-81cb-cf34894fdcda" path="/var/lib/kubelet/pods/9bcac63b-2c20-48f8-81cb-cf34894fdcda/volumes" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.331432 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.332913 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.349336 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.350966 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.398260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-fernet-keys\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-scripts\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-combined-ca-bundle\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdsd\" (UniqueName: \"kubernetes.io/projected/b7e7755d-72e1-4e20-a67b-04f8e88feafd-kube-api-access-wpdsd\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403830 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-config-data\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403870 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data-custom\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-combined-ca-bundle\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.403999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.404061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzkw\" (UniqueName: \"kubernetes.io/projected/f9a99993-e243-4bcc-8b63-08db8159c08e-kube-api-access-4mzkw\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.404088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a99993-e243-4bcc-8b63-08db8159c08e-logs\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.404113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-credential-keys\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.417128 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-scripts\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.417485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-fernet-keys\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.417521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-credential-keys\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.419242 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.423092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-config-data\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.423622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-combined-ca-bundle\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.429735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdsd\" (UniqueName: \"kubernetes.io/projected/b7e7755d-72e1-4e20-a67b-04f8e88feafd-kube-api-access-wpdsd\") pod \"keystone-bootstrap-dsj6v\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.447246 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.468417 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.468700 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-log" containerID="cri-o://92e20085d1f56e45e9b1939575457cb299f3d1fba665ee7798171ab39c01648e" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.468884 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-httpd" containerID="cri-o://53cc0e37c1e453c63bc64710e5b72338490988d6b45b6b6634056af829222170" gracePeriod=30 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.493815 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.496548 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511117 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-public-tls-certs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ba8264d-24bb-4930-9aec-8e5ffd496a02-logs\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511203 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511220 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data-custom\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511241 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-internal-tls-certs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzkw\" (UniqueName: \"kubernetes.io/projected/f9a99993-e243-4bcc-8b63-08db8159c08e-kube-api-access-4mzkw\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a99993-e243-4bcc-8b63-08db8159c08e-logs\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data-custom\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-combined-ca-bundle\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511421 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/acf6329b-cf5f-41e5-bf05-d4161a7c1115-logs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-combined-ca-bundle\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87xrv\" (UniqueName: \"kubernetes.io/projected/acf6329b-cf5f-41e5-bf05-d4161a7c1115-kube-api-access-87xrv\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data-custom\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9lm2\" (UniqueName: \"kubernetes.io/projected/9ba8264d-24bb-4930-9aec-8e5ffd496a02-kube-api-access-j9lm2\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.511539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-combined-ca-bundle\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.514906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a99993-e243-4bcc-8b63-08db8159c08e-logs\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.518921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.523662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-combined-ca-bundle\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.524172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data-custom\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.552913 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzkw\" (UniqueName: \"kubernetes.io/projected/f9a99993-e243-4bcc-8b63-08db8159c08e-kube-api-access-4mzkw\") pod \"barbican-worker-65b7b4f47-hskb8\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.560414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.594276 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-77df7c767d-c55bj"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.596040 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.606663 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.606853 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.606964 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.631264 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf"] Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.640507 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.679673 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.689625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/acf6329b-cf5f-41e5-bf05-d4161a7c1115-logs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.698630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-combined-ca-bundle\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.698865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-87xrv\" (UniqueName: \"kubernetes.io/projected/acf6329b-cf5f-41e5-bf05-d4161a7c1115-kube-api-access-87xrv\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j9lm2\" (UniqueName: \"kubernetes.io/projected/9ba8264d-24bb-4930-9aec-8e5ffd496a02-kube-api-access-j9lm2\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-combined-ca-bundle\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-public-tls-certs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ba8264d-24bb-4930-9aec-8e5ffd496a02-logs\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699460 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data-custom\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-internal-tls-certs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.699880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data-custom\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.700769 4769 generic.go:334] "Generic (PLEG): container finished" podID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerID="c1f8cee72fec018dfde56d2f7e8cbe5d1e29c22acdf13b93e17f08641898c58c" exitCode=143 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.700896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"410ba7d8-09d6-4e06-894e-c2b7b490e896","Type":"ContainerDied","Data":"c1f8cee72fec018dfde56d2f7e8cbe5d1e29c22acdf13b93e17f08641898c58c"} Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.714879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ba8264d-24bb-4930-9aec-8e5ffd496a02-logs\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.695245 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.716612 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/acf6329b-cf5f-41e5-bf05-d4161a7c1115-logs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.719551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data-custom\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.722848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.724536 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data-custom\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.724795 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-internal-tls-certs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.725021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-public-tls-certs\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.725632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.726130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-combined-ca-bundle\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.727822 4769 generic.go:334] "Generic (PLEG): container finished" podID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerID="345427c0cfe355aef6549b93b6c2016b9d88dcb1b2ffb4cdfe63847d10db0527" exitCode=0 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.727889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"320ae09e-4eaf-4abe-a5b2-554d1408238c","Type":"ContainerDied","Data":"345427c0cfe355aef6549b93b6c2016b9d88dcb1b2ffb4cdfe63847d10db0527"} Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.728497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-combined-ca-bundle\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.737437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-87xrv\" (UniqueName: \"kubernetes.io/projected/acf6329b-cf5f-41e5-bf05-d4161a7c1115-kube-api-access-87xrv\") pod \"barbican-api-f7fb79d5d-bjwdf\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.739853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-77df7c767d-c55bj"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.753754 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-69c6595758-mbcv7"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.754807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9lm2\" (UniqueName: \"kubernetes.io/projected/9ba8264d-24bb-4930-9aec-8e5ffd496a02-kube-api-access-j9lm2\") pod \"barbican-keystone-listener-76d8f95f96-pbpb7\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.766324 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.766397 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="6ded5830-49b2-42ca-9a78-50a831417844" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.767415 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.801499 4769 generic.go:334] "Generic (PLEG): container finished" podID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerID="16e599ac25444568bec0868946286298a0c586bedd720ee6698bf3c1f6881eb9" exitCode=143 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.801601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48f30235-6b42-49cf-ad48-3153c6f6c542","Type":"ContainerDied","Data":"16e599ac25444568bec0868946286298a0c586bedd720ee6698bf3c1f6881eb9"} Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.802604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-public-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.802645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-internal-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.802676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-httpd-config\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.802891 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-combined-ca-bundle\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.802914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-ovndb-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.802950 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-config\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.803003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9cx\" (UniqueName: \"kubernetes.io/projected/c5d78831-4a38-4935-8074-25d822e2a4db-kube-api-access-tv9cx\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.803630 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-69c6595758-mbcv7"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.832102 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.843563 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerID="f34b59991bbcde373cfc57e89fd862cdaa711ae7091f5c6be779d1fc1a3f0a84" exitCode=0 Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.844263 4769 scope.go:117] "RemoveContainer" containerID="0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.844539 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(b61ccb84-4f33-4f62-ab1a-986f3e1974fe)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.844882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"9aa39735-6ebc-412a-ae3c-bfb951dc599b","Type":"ContainerDied","Data":"f34b59991bbcde373cfc57e89fd862cdaa711ae7091f5c6be779d1fc1a3f0a84"} Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.861672 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.868309 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.880333 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9cx\" (UniqueName: \"kubernetes.io/projected/c5d78831-4a38-4935-8074-25d822e2a4db-kube-api-access-tv9cx\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904230 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-public-tls-certs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-scripts\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-config-data\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-public-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904388 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-internal-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-httpd-config\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-combined-ca-bundle\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-ovndb-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzbj\" (UniqueName: \"kubernetes.io/projected/d436c6c4-abe9-40db-9de9-27d86c3b96d4-kube-api-access-hvzbj\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-internal-tls-certs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-combined-ca-bundle\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-config\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.904610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d436c6c4-abe9-40db-9de9-27d86c3b96d4-logs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.932149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-internal-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.940150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-ovndb-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.948855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-combined-ca-bundle\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.951464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-config\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.954347 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-httpd-config\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.955488 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9cx\" (UniqueName: \"kubernetes.io/projected/c5d78831-4a38-4935-8074-25d822e2a4db-kube-api-access-tv9cx\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.959607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-public-tls-certs\") pod \"neutron-77df7c767d-c55bj\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.960636 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:25 crc kubenswrapper[4769]: E1121 12:59:25.960718 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:25 crc kubenswrapper[4769]: I1121 12:59:25.994848 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.007985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzbj\" (UniqueName: \"kubernetes.io/projected/d436c6c4-abe9-40db-9de9-27d86c3b96d4-kube-api-access-hvzbj\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.008034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-internal-tls-certs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.008075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-combined-ca-bundle\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.008093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d436c6c4-abe9-40db-9de9-27d86c3b96d4-logs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.008161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-public-tls-certs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.008243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-scripts\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.008278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-config-data\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.016785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-combined-ca-bundle\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.020409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-config-data\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.020644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-scripts\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.020883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d436c6c4-abe9-40db-9de9-27d86c3b96d4-logs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.021610 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-public-tls-certs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.022685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-internal-tls-certs\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.047168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzbj\" (UniqueName: \"kubernetes.io/projected/d436c6c4-abe9-40db-9de9-27d86c3b96d4-kube-api-access-hvzbj\") pod \"placement-69c6595758-mbcv7\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.130891 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.438251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dsj6v"] Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.550767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7"] Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.564613 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8"] Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.718886 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf"] Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.728880 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-77df7c767d-c55bj"] Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.865240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" event={"ID":"b7e7755d-72e1-4e20-a67b-04f8e88feafd","Type":"ContainerStarted","Data":"63376b49d4b416472eee3c331b92f4c2fd2007cda9f997730c9cf82e90686d98"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.865284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" event={"ID":"b7e7755d-72e1-4e20-a67b-04f8e88feafd","Type":"ContainerStarted","Data":"91a114e2386d6e9132367324e212d66301c0626f2fc1370ef1d7f61994d3e797"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.879087 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-69c6595758-mbcv7"] Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.886310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"320ae09e-4eaf-4abe-a5b2-554d1408238c","Type":"ContainerStarted","Data":"c41750e7a7807c4e32b883afabce7adbe8d426799c1398065cfe0183bb5ebe60"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.886641 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.889542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" event={"ID":"9ba8264d-24bb-4930-9aec-8e5ffd496a02","Type":"ContainerStarted","Data":"53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.889574 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" event={"ID":"9ba8264d-24bb-4930-9aec-8e5ffd496a02","Type":"ContainerStarted","Data":"873d3b194a2742bf00c9bb49011606366dd601d68661c0b220f753d93a22261e"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.891374 4769 generic.go:334] "Generic (PLEG): container finished" podID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerID="92e20085d1f56e45e9b1939575457cb299f3d1fba665ee7798171ab39c01648e" exitCode=143 Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.891443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75618a38-3d78-4f4c-9a05-88b0ce060be6","Type":"ContainerDied","Data":"92e20085d1f56e45e9b1939575457cb299f3d1fba665ee7798171ab39c01648e"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.896198 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" event={"ID":"acf6329b-cf5f-41e5-bf05-d4161a7c1115","Type":"ContainerStarted","Data":"237593433a6151fb3207bb057d914841d64608f5f1c8af3967e8bf8b017c0b9b"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.901422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" event={"ID":"f9a99993-e243-4bcc-8b63-08db8159c08e","Type":"ContainerStarted","Data":"ddfc3bcadea69926d8cf09532e60669670aae259c806242b33d123a646aff58f"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.910459 4769 generic.go:334] "Generic (PLEG): container finished" podID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerID="a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55" exitCode=137 Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.910552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerDied","Data":"a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.911321 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.911298844 podStartE2EDuration="37.911298844s" podCreationTimestamp="2025-11-21 12:58:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:26.907296027 +0000 UTC m=+4125.607957855" watchObservedRunningTime="2025-11-21 12:59:26.911298844 +0000 UTC m=+4125.611960662" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.916223 4769 generic.go:334] "Generic (PLEG): container finished" podID="b0d62447-0070-4c77-b67e-702596a3cacf" containerID="31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d" exitCode=0 Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.916297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b0d62447-0070-4c77-b67e-702596a3cacf","Type":"ContainerDied","Data":"31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.919324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"9aa39735-6ebc-412a-ae3c-bfb951dc599b","Type":"ContainerStarted","Data":"ebca932f14860b8c8f46de6239a88b5264cda4562a46d7028c3f7f82265b5841"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.919540 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.921831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" event={"ID":"c5d78831-4a38-4935-8074-25d822e2a4db","Type":"ContainerStarted","Data":"54f7e9b21bb75d241954fdb034d0682fc09767be073c1f12fef5547027a734d2"} Nov 21 12:59:26 crc kubenswrapper[4769]: I1121 12:59:26.975584 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.975536445 podStartE2EDuration="36.975536445s" podCreationTimestamp="2025-11-21 12:58:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:26.943494542 +0000 UTC m=+4125.644156360" watchObservedRunningTime="2025-11-21 12:59:26.975536445 +0000 UTC m=+4125.676198263" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.398403 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.435868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-combined-ca-bundle\") pod \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.436262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqx9l\" (UniqueName: \"kubernetes.io/projected/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-kube-api-access-bqx9l\") pod \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.436306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-config-data\") pod \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\" (UID: \"b61ccb84-4f33-4f62-ab1a-986f3e1974fe\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.447294 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.451399 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-kube-api-access-bqx9l" (OuterVolumeSpecName: "kube-api-access-bqx9l") pod "b61ccb84-4f33-4f62-ab1a-986f3e1974fe" (UID: "b61ccb84-4f33-4f62-ab1a-986f3e1974fe"). InnerVolumeSpecName "kube-api-access-bqx9l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-run-httpd\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-combined-ca-bundle\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-log-httpd\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srnpk\" (UniqueName: \"kubernetes.io/projected/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-kube-api-access-srnpk\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-sg-core-conf-yaml\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-config-data\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.538993 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-scripts\") pod \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\" (UID: \"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0\") " Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.539514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.539654 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bqx9l\" (UniqueName: \"kubernetes.io/projected/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-kube-api-access-bqx9l\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.540640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.551635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-scripts" (OuterVolumeSpecName: "scripts") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.552392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-kube-api-access-srnpk" (OuterVolumeSpecName: "kube-api-access-srnpk") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "kube-api-access-srnpk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.603872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b61ccb84-4f33-4f62-ab1a-986f3e1974fe" (UID: "b61ccb84-4f33-4f62-ab1a-986f3e1974fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.641178 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.641219 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srnpk\" (UniqueName: \"kubernetes.io/projected/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-kube-api-access-srnpk\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.641228 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.641239 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.641247 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.671015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-config-data" (OuterVolumeSpecName: "config-data") pod "b61ccb84-4f33-4f62-ab1a-986f3e1974fe" (UID: "b61ccb84-4f33-4f62-ab1a-986f3e1974fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.727795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.743464 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b61ccb84-4f33-4f62-ab1a-986f3e1974fe-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.743494 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.810284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.843719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-config-data" (OuterVolumeSpecName: "config-data") pod "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" (UID: "1683331d-7238-4b3e-b37b-5d5c1cc3b6b0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.845040 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.934278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1683331d-7238-4b3e-b37b-5d5c1cc3b6b0","Type":"ContainerDied","Data":"f1911df0463f5f6521ebda779f26d157b23401a40e3bc632947b7eb7e947a2af"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.934521 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.934641 4769 scope.go:117] "RemoveContainer" containerID="988e4211b3c097b1875f9a8e347ca7fc99a23fdd6074ff6222bae4e629fc4d53" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.939513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" event={"ID":"c5d78831-4a38-4935-8074-25d822e2a4db","Type":"ContainerStarted","Data":"56c8ac7ed57b9cc0fdfc177e6000ff8cf3f9a100ecb27379432b3353fab8c0a0"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.939655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" event={"ID":"c5d78831-4a38-4935-8074-25d822e2a4db","Type":"ContainerStarted","Data":"ff26fa2a207ee8a00f21c5304aa1bb9a79037310e96f45d6dd9fed60d774aa67"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.940642 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.945386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" event={"ID":"d436c6c4-abe9-40db-9de9-27d86c3b96d4","Type":"ContainerStarted","Data":"44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.945422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" event={"ID":"d436c6c4-abe9-40db-9de9-27d86c3b96d4","Type":"ContainerStarted","Data":"a2e4842d1fb34f871401225ae96786351cab0a14a102e9497cde1f57ea2c6b97"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.946382 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.947662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" event={"ID":"9ba8264d-24bb-4930-9aec-8e5ffd496a02","Type":"ContainerStarted","Data":"22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.950399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b61ccb84-4f33-4f62-ab1a-986f3e1974fe","Type":"ContainerDied","Data":"71dd30ff5da5447f8e572efbf788f05d2d21e0d84245feb7432eab131ed77d30"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.950460 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.957647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" event={"ID":"acf6329b-cf5f-41e5-bf05-d4161a7c1115","Type":"ContainerStarted","Data":"39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.957748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" event={"ID":"acf6329b-cf5f-41e5-bf05-d4161a7c1115","Type":"ContainerStarted","Data":"d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.958438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.958524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.961036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" event={"ID":"f9a99993-e243-4bcc-8b63-08db8159c08e","Type":"ContainerStarted","Data":"6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.962042 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" event={"ID":"f9a99993-e243-4bcc-8b63-08db8159c08e","Type":"ContainerStarted","Data":"145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8"} Nov 21 12:59:27 crc kubenswrapper[4769]: I1121 12:59:27.977049 4769 scope.go:117] "RemoveContainer" containerID="3f2650816c0f69b4482827ad4399c43b72c31b02233419faeda1255cf30ab396" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.051046 4769 scope.go:117] "RemoveContainer" containerID="c71b4af322f7f66c7e5fa3665f348d41bdef2e4738e4cba5337526b93971da66" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.057465 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" podStartSLOduration=3.055383018 podStartE2EDuration="3.055383018s" podCreationTimestamp="2025-11-21 12:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:27.964903891 +0000 UTC m=+4126.665565709" watchObservedRunningTime="2025-11-21 12:59:28.055383018 +0000 UTC m=+4126.756044836" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.113648 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" podStartSLOduration=3.113629406 podStartE2EDuration="3.113629406s" podCreationTimestamp="2025-11-21 12:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:28.004375164 +0000 UTC m=+4126.705036982" watchObservedRunningTime="2025-11-21 12:59:28.113629406 +0000 UTC m=+4126.814291224" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.139352 4769 scope.go:117] "RemoveContainer" containerID="a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.147630 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" podStartSLOduration=3.147616002 podStartE2EDuration="3.147616002s" podCreationTimestamp="2025-11-21 12:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:28.081870631 +0000 UTC m=+4126.782532449" watchObservedRunningTime="2025-11-21 12:59:28.147616002 +0000 UTC m=+4126.848277820" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.149424 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.149694 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker-log" containerID="cri-o://43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2" gracePeriod=30 Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.149814 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker" containerID="cri-o://6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d" gracePeriod=30 Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.178340 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" podStartSLOduration=3.178324579 podStartE2EDuration="3.178324579s" podCreationTimestamp="2025-11-21 12:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:28.137672844 +0000 UTC m=+4126.838334662" watchObservedRunningTime="2025-11-21 12:59:28.178324579 +0000 UTC m=+4126.878986397" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.182717 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" podStartSLOduration=3.182708317 podStartE2EDuration="3.182708317s" podCreationTimestamp="2025-11-21 12:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:28.164802865 +0000 UTC m=+4126.865464683" watchObservedRunningTime="2025-11-21 12:59:28.182708317 +0000 UTC m=+4126.883370135" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.196273 4769 scope.go:117] "RemoveContainer" containerID="0ad1bd7a17ef5714a395c8c1ee877132edf2a5983146227054f46c079764bf69" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.197046 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.197385 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener-log" containerID="cri-o://eacab1816caa9472de1b1ff2272a52617b31c3ed7a01468b68054c598fa0b900" gracePeriod=30 Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.197438 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener" containerID="cri-o://1e508ad993b5115412e41bfa11f9901df434ab56ba54cffa656ae4a468fc1e8c" gracePeriod=30 Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.202957 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.210704 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.214577 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.222824 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.260874 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: E1121 12:59:28.261329 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="proxy-httpd" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261341 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="proxy-httpd" Nov 21 12:59:28 crc kubenswrapper[4769]: E1121 12:59:28.261371 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-notification-agent" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261378 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-notification-agent" Nov 21 12:59:28 crc kubenswrapper[4769]: E1121 12:59:28.261400 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-central-agent" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-central-agent" Nov 21 12:59:28 crc kubenswrapper[4769]: E1121 12:59:28.261416 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="sg-core" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261422 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="sg-core" Nov 21 12:59:28 crc kubenswrapper[4769]: E1121 12:59:28.261437 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerName="nova-scheduler-scheduler" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261442 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerName="nova-scheduler-scheduler" Nov 21 12:59:28 crc kubenswrapper[4769]: E1121 12:59:28.261455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerName="nova-scheduler-scheduler" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261461 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerName="nova-scheduler-scheduler" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261622 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-central-agent" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261641 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="ceilometer-notification-agent" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261652 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="sg-core" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261664 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerName="nova-scheduler-scheduler" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261681 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" containerName="nova-scheduler-scheduler" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.261692 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" containerName="proxy-httpd" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.263400 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.287092 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.288460 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.288524 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.308231 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.308423 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.318300 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.386917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.389320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-config-data\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.390104 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wlk\" (UniqueName: \"kubernetes.io/projected/f0f49554-2f2a-481e-8e6e-873cec67b892-kube-api-access-b5wlk\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.395250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-run-httpd\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.395473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-scripts\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.395583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.395718 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.395867 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-log-httpd\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.395958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.396209 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l65k\" (UniqueName: \"kubernetes.io/projected/9cc134fb-086d-4593-a7e0-2a14633735ae-kube-api-access-5l65k\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.403238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-config-data\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.507788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.507918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5l65k\" (UniqueName: \"kubernetes.io/projected/9cc134fb-086d-4593-a7e0-2a14633735ae-kube-api-access-5l65k\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.507990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-config-data\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wlk\" (UniqueName: \"kubernetes.io/projected/f0f49554-2f2a-481e-8e6e-873cec67b892-kube-api-access-b5wlk\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-config-data\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-run-httpd\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-scripts\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508256 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-log-httpd\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.508651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-log-httpd\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.511169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-run-httpd\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.524263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.524689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.525083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-config-data\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.525999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-scripts\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.541932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.542941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-config-data\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.544942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l65k\" (UniqueName: \"kubernetes.io/projected/9cc134fb-086d-4593-a7e0-2a14633735ae-kube-api-access-5l65k\") pod \"ceilometer-0\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.547644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wlk\" (UniqueName: \"kubernetes.io/projected/f0f49554-2f2a-481e-8e6e-873cec67b892-kube-api-access-b5wlk\") pod \"nova-scheduler-0\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.598986 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api" probeResult="failure" output="Get \"http://10.217.0.132:8776/healthcheck\": read tcp 10.217.0.2:35454->10.217.0.132:8776: read: connection reset by peer" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.626802 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.751738 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.879370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.942386 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w"] Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.943787 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerName="dnsmasq-dns" containerID="cri-o://b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8" gracePeriod=10 Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.993158 4769 generic.go:334] "Generic (PLEG): container finished" podID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerID="43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2" exitCode=143 Nov 21 12:59:28 crc kubenswrapper[4769]: I1121 12:59:28.993439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" event={"ID":"4e40287e-d24f-490a-980a-0f82128eb7d2","Type":"ContainerDied","Data":"43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2"} Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.002415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" event={"ID":"d436c6c4-abe9-40db-9de9-27d86c3b96d4","Type":"ContainerStarted","Data":"b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6"} Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.003600 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.003622 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.008463 4769 generic.go:334] "Generic (PLEG): container finished" podID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerID="c80d4b620975884e05c11ceb27303ac1a2b3583afc75dd1610a3fc8677556f13" exitCode=0 Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.008529 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"410ba7d8-09d6-4e06-894e-c2b7b490e896","Type":"ContainerDied","Data":"c80d4b620975884e05c11ceb27303ac1a2b3583afc75dd1610a3fc8677556f13"} Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.027407 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9f10777-813f-47bb-951d-c78284390239" containerID="eacab1816caa9472de1b1ff2272a52617b31c3ed7a01468b68054c598fa0b900" exitCode=143 Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.028276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" event={"ID":"e9f10777-813f-47bb-951d-c78284390239","Type":"ContainerDied","Data":"eacab1816caa9472de1b1ff2272a52617b31c3ed7a01468b68054c598fa0b900"} Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.285334 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1683331d-7238-4b3e-b37b-5d5c1cc3b6b0" path="/var/lib/kubelet/pods/1683331d-7238-4b3e-b37b-5d5c1cc3b6b0/volumes" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.286091 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b61ccb84-4f33-4f62-ab1a-986f3e1974fe" path="/var/lib/kubelet/pods/b61ccb84-4f33-4f62-ab1a-986f3e1974fe/volumes" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.364974 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" podStartSLOduration=4.364952987 podStartE2EDuration="4.364952987s" podCreationTimestamp="2025-11-21 12:59:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:29.029701538 +0000 UTC m=+4127.730363346" watchObservedRunningTime="2025-11-21 12:59:29.364952987 +0000 UTC m=+4128.065614805" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.375291 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.444958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.448473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.530617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.530727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data-custom\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.530769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/410ba7d8-09d6-4e06-894e-c2b7b490e896-etc-machine-id\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.530814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-scripts\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.530876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/410ba7d8-09d6-4e06-894e-c2b7b490e896-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.530929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/410ba7d8-09d6-4e06-894e-c2b7b490e896-logs\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.531077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-combined-ca-bundle\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.531128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgsf7\" (UniqueName: \"kubernetes.io/projected/410ba7d8-09d6-4e06-894e-c2b7b490e896-kube-api-access-vgsf7\") pod \"410ba7d8-09d6-4e06-894e-c2b7b490e896\" (UID: \"410ba7d8-09d6-4e06-894e-c2b7b490e896\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.531580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410ba7d8-09d6-4e06-894e-c2b7b490e896-logs" (OuterVolumeSpecName: "logs") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.531637 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/410ba7d8-09d6-4e06-894e-c2b7b490e896-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.534715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.535470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-scripts" (OuterVolumeSpecName: "scripts") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.536086 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.539389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410ba7d8-09d6-4e06-894e-c2b7b490e896-kube-api-access-vgsf7" (OuterVolumeSpecName: "kube-api-access-vgsf7") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "kube-api-access-vgsf7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.581923 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.621572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data" (OuterVolumeSpecName: "config-data") pod "410ba7d8-09d6-4e06-894e-c2b7b490e896" (UID: "410ba7d8-09d6-4e06-894e-c2b7b490e896"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.632820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dns-swift-storage-0\") pod \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.632995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm8tj\" (UniqueName: \"kubernetes.io/projected/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-kube-api-access-fm8tj\") pod \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.633589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dnsmasq-svc\") pod \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.633649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-config\") pod \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\" (UID: \"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd\") " Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.634093 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.634104 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.634113 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/410ba7d8-09d6-4e06-894e-c2b7b490e896-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.634122 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.634140 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vgsf7\" (UniqueName: \"kubernetes.io/projected/410ba7d8-09d6-4e06-894e-c2b7b490e896-kube-api-access-vgsf7\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.634148 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410ba7d8-09d6-4e06-894e-c2b7b490e896-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.636736 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-kube-api-access-fm8tj" (OuterVolumeSpecName: "kube-api-access-fm8tj") pod "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" (UID: "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd"). InnerVolumeSpecName "kube-api-access-fm8tj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.735960 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fm8tj\" (UniqueName: \"kubernetes.io/projected/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-kube-api-access-fm8tj\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.763792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-config" (OuterVolumeSpecName: "config") pod "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" (UID: "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.765300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" (UID: "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.776171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" (UID: "6847ac12-d5e2-4722-bd09-f9bfa9ce21bd"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 12:59:29 crc kubenswrapper[4769]: E1121 12:59:29.809971 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/5f626cf2b82ef34f0d2a25a3f5c63e21c0c7808a43bac2af5adc3e75b437ba44/diff" to get inode usage: stat /var/lib/containers/storage/overlay/5f626cf2b82ef34f0d2a25a3f5c63e21c0c7808a43bac2af5adc3e75b437ba44/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_537bd39d-da67-4aea-a004-b41392f866d7/ovsdbserver-nb/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_537bd39d-da67-4aea-a004-b41392f866d7/ovsdbserver-nb/0.log: no such file or directory Nov 21 12:59:29 crc kubenswrapper[4769]: E1121 12:59:29.826943 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/21eb12d32b6675ad3576494d8dbd64025134f0591443b26867c9bd13b686ac26/diff" to get inode usage: stat /var/lib/containers/storage/overlay/21eb12d32b6675ad3576494d8dbd64025134f0591443b26867c9bd13b686ac26/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/ovsdbserver-sb/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/ovsdbserver-sb/0.log: no such file or directory Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.838484 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.838526 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: I1121 12:59:29.838536 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:29 crc kubenswrapper[4769]: E1121 12:59:29.968023 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/0e7202ff71c33bcb56f1723e820fc1628459697d26914753d7135b6aca48b935/diff" to get inode usage: stat /var/lib/containers/storage/overlay/0e7202ff71c33bcb56f1723e820fc1628459697d26914753d7135b6aca48b935/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/openstack-network-exporter/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_e208ea95-1e47-4b72-aaa7-43ea37d076bc/openstack-network-exporter/0.log: no such file or directory Nov 21 12:59:29 crc kubenswrapper[4769]: E1121 12:59:29.996550 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/93650dc87c9f30cbc8a44e95ebe15b62e715d1e808dc8df05b0a9eccdcfca889/diff" to get inode usage: stat /var/lib/containers/storage/overlay/93650dc87c9f30cbc8a44e95ebe15b62e715d1e808dc8df05b0a9eccdcfca889/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_537bd39d-da67-4aea-a004-b41392f866d7/openstack-network-exporter/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_537bd39d-da67-4aea-a004-b41392f866d7/openstack-network-exporter/0.log: no such file or directory Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.040507 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.049382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"410ba7d8-09d6-4e06-894e-c2b7b490e896","Type":"ContainerDied","Data":"fb6128521b1462a7800ba557dd78b33ff16442d0bf1f39bd76b1086785d2ca6c"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.049466 4769 scope.go:117] "RemoveContainer" containerID="c80d4b620975884e05c11ceb27303ac1a2b3583afc75dd1610a3fc8677556f13" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.075435 4769 generic.go:334] "Generic (PLEG): container finished" podID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerID="5aa33a1915af89c555f9dc997de37651a9b32a85cf3879217af8d4d6d8e837db" exitCode=0 Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.075496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" event={"ID":"32857629-7f0b-49f3-b3cc-6de4ab3db5bb","Type":"ContainerDied","Data":"5aa33a1915af89c555f9dc997de37651a9b32a85cf3879217af8d4d6d8e837db"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.075522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" event={"ID":"32857629-7f0b-49f3-b3cc-6de4ab3db5bb","Type":"ContainerDied","Data":"7311037badb073788d2774f7c1788f7ebecdad22c666e3af35bfaf162f6f879c"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.075535 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7311037badb073788d2774f7c1788f7ebecdad22c666e3af35bfaf162f6f879c" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.078028 4769 generic.go:334] "Generic (PLEG): container finished" podID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerID="b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8" exitCode=0 Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.078078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" event={"ID":"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd","Type":"ContainerDied","Data":"b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.078101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" event={"ID":"6847ac12-d5e2-4722-bd09-f9bfa9ce21bd","Type":"ContainerDied","Data":"d75724acd6cef73b6e489b3d57d23266115753fcbc48a1c7b4df76e73cd1550f"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.078172 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.088564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f0f49554-2f2a-481e-8e6e-873cec67b892","Type":"ContainerStarted","Data":"8913702c01c208c39e982e6b23b567bb96fe782782b673c093ba3983b87c923d"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.088603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f0f49554-2f2a-481e-8e6e-873cec67b892","Type":"ContainerStarted","Data":"cdf8ee9b3e5e81e5847d84111e06fce495c592d2fbd150dfe252580b992bfaa6"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.099053 4769 generic.go:334] "Generic (PLEG): container finished" podID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerID="e45f73eb8512fffa53269041f9095bc3a7dad12e398ef818420241fe14475f1f" exitCode=0 Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.099114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48f30235-6b42-49cf-ad48-3153c6f6c542","Type":"ContainerDied","Data":"e45f73eb8512fffa53269041f9095bc3a7dad12e398ef818420241fe14475f1f"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.101650 4769 generic.go:334] "Generic (PLEG): container finished" podID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerID="53cc0e37c1e453c63bc64710e5b72338490988d6b45b6b6634056af829222170" exitCode=0 Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.101695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75618a38-3d78-4f4c-9a05-88b0ce060be6","Type":"ContainerDied","Data":"53cc0e37c1e453c63bc64710e5b72338490988d6b45b6b6634056af829222170"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.103323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerStarted","Data":"51efc6c9f85adae3966fc67f73196cb4ce1d9b8c973068b4f846b7e1218d2854"} Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.120386 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.120368822 podStartE2EDuration="2.120368822s" podCreationTimestamp="2025-11-21 12:59:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:30.113956439 +0000 UTC m=+4128.814618257" watchObservedRunningTime="2025-11-21 12:59:30.120368822 +0000 UTC m=+4128.821030640" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.150567 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.169300 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.176316 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.184437 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194246 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.194696 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-httpd" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194714 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-httpd" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.194726 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerName="init" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194734 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerName="init" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.194750 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194756 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.194770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerName="dnsmasq-dns" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194777 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerName="dnsmasq-dns" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.194790 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-api" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194796 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-api" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.194822 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api-log" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.194828 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api-log" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.195009 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api-log" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.195021 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" containerName="dnsmasq-dns" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.195029 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-httpd" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.195043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" containerName="cinder-api" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.195061 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" containerName="neutron-api" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.196209 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.198735 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.198955 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.200005 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.207307 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d7d7bd4b7-ml55w"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.209529 4769 scope.go:117] "RemoveContainer" containerID="c1f8cee72fec018dfde56d2f7e8cbe5d1e29c22acdf13b93e17f08641898c58c" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.215162 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.247992 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-httpd-config\") pod \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-combined-ca-bundle\") pod \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b9s8\" (UniqueName: \"kubernetes.io/projected/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-kube-api-access-6b9s8\") pod \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248235 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-config\") pod \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\" (UID: \"32857629-7f0b-49f3-b3cc-6de4ab3db5bb\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-scripts\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-public-tls-certs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-etc-machine-id\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248794 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data-custom\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ljzj\" (UniqueName: \"kubernetes.io/projected/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-kube-api-access-5ljzj\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.248910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-logs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.252716 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-kube-api-access-6b9s8" (OuterVolumeSpecName: "kube-api-access-6b9s8") pod "32857629-7f0b-49f3-b3cc-6de4ab3db5bb" (UID: "32857629-7f0b-49f3-b3cc-6de4ab3db5bb"). InnerVolumeSpecName "kube-api-access-6b9s8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.254877 4769 scope.go:117] "RemoveContainer" containerID="b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.277671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "32857629-7f0b-49f3-b3cc-6de4ab3db5bb" (UID: "32857629-7f0b-49f3-b3cc-6de4ab3db5bb"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.356938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.357763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-scripts\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.357796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-public-tls-certs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.357820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-etc-machine-id\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.357892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data-custom\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.357911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljzj\" (UniqueName: \"kubernetes.io/projected/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-kube-api-access-5ljzj\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.358014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-logs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.358081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.358108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.358471 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6b9s8\" (UniqueName: \"kubernetes.io/projected/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-kube-api-access-6b9s8\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.358484 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.362792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-logs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.362838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-etc-machine-id\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.369340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-public-tls-certs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.372471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data-custom\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.372747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.374062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-scripts\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.376295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-config" (OuterVolumeSpecName: "config") pod "32857629-7f0b-49f3-b3cc-6de4ab3db5bb" (UID: "32857629-7f0b-49f3-b3cc-6de4ab3db5bb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.376464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32857629-7f0b-49f3-b3cc-6de4ab3db5bb" (UID: "32857629-7f0b-49f3-b3cc-6de4ab3db5bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.376880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.382091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.389602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ljzj\" (UniqueName: \"kubernetes.io/projected/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-kube-api-access-5ljzj\") pod \"cinder-api-0\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.459864 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-config\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.459886 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32857629-7f0b-49f3-b3cc-6de4ab3db5bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.485780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.522308 4769 scope.go:117] "RemoveContainer" containerID="9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.529285 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.561964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-scripts\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.563945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.563996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-httpd-run\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.564082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-logs\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.564141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-combined-ca-bundle\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.564569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g8gm\" (UniqueName: \"kubernetes.io/projected/75618a38-3d78-4f4c-9a05-88b0ce060be6-kube-api-access-8g8gm\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.564591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.564619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-config-data\") pod \"75618a38-3d78-4f4c-9a05-88b0ce060be6\" (UID: \"75618a38-3d78-4f4c-9a05-88b0ce060be6\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.569691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-logs" (OuterVolumeSpecName: "logs") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.571636 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.571659 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75618a38-3d78-4f4c-9a05-88b0ce060be6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.572879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-scripts" (OuterVolumeSpecName: "scripts") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.572997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.574839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75618a38-3d78-4f4c-9a05-88b0ce060be6-kube-api-access-8g8gm" (OuterVolumeSpecName: "kube-api-access-8g8gm") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "kube-api-access-8g8gm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.595834 4769 scope.go:117] "RemoveContainer" containerID="b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.599390 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8\": container with ID starting with b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8 not found: ID does not exist" containerID="b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.599426 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8"} err="failed to get container status \"b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8\": rpc error: code = NotFound desc = could not find container \"b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8\": container with ID starting with b6f62c0033feb8fc79aa13d1f1de9ddcc0f2daa89cd228fd60e0a4f7cdcb2ef8 not found: ID does not exist" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.599465 4769 scope.go:117] "RemoveContainer" containerID="9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.610722 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8\": container with ID starting with 9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8 not found: ID does not exist" containerID="9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.610757 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8"} err="failed to get container status \"9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8\": rpc error: code = NotFound desc = could not find container \"9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8\": container with ID starting with 9f1224ab924eef6bf627aea98bc75e507625a0995532296576a9aaa921a5f3c8 not found: ID does not exist" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.653315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.655155 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.662392 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.671470 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.674345 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.674377 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8g8gm\" (UniqueName: \"kubernetes.io/projected/75618a38-3d78-4f4c-9a05-88b0ce060be6-kube-api-access-8g8gm\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.674389 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.674415 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.675512 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.675592 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="6ded5830-49b2-42ca-9a78-50a831417844" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.676941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-config-data" (OuterVolumeSpecName: "config-data") pod "75618a38-3d78-4f4c-9a05-88b0ce060be6" (UID: "75618a38-3d78-4f4c-9a05-88b0ce060be6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.709841 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-scripts\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777606 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-combined-ca-bundle\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-config-data\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-logs\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777914 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4dlp\" (UniqueName: \"kubernetes.io/projected/48f30235-6b42-49cf-ad48-3153c6f6c542-kube-api-access-f4dlp\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777970 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.777994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-httpd-run\") pod \"48f30235-6b42-49cf-ad48-3153c6f6c542\" (UID: \"48f30235-6b42-49cf-ad48-3153c6f6c542\") " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.778467 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75618a38-3d78-4f4c-9a05-88b0ce060be6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.778490 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.779082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.779755 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-logs" (OuterVolumeSpecName: "logs") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.782404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-scripts" (OuterVolumeSpecName: "scripts") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.785908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.786655 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f30235-6b42-49cf-ad48-3153c6f6c542-kube-api-access-f4dlp" (OuterVolumeSpecName: "kube-api-access-f4dlp") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "kube-api-access-f4dlp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.820070 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.848989 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.858399 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.861646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-config-data" (OuterVolumeSpecName: "config-data") pod "48f30235-6b42-49cf-ad48-3153c6f6c542" (UID: "48f30235-6b42-49cf-ad48-3153c6f6c542"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.864374 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:30 crc kubenswrapper[4769]: E1121 12:59:30.864419 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881332 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881373 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881386 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48f30235-6b42-49cf-ad48-3153c6f6c542-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881395 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881405 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f4dlp\" (UniqueName: \"kubernetes.io/projected/48f30235-6b42-49cf-ad48-3153c6f6c542-kube-api-access-f4dlp\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881432 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.881442 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/48f30235-6b42-49cf-ad48-3153c6f6c542-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.901623 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 12:59:30 crc kubenswrapper[4769]: I1121 12:59:30.983522 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.116716 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.116701 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"75618a38-3d78-4f4c-9a05-88b0ce060be6","Type":"ContainerDied","Data":"306ea4965005a5c6200a42ee061d4c30376356b0ba3f5450316988a7991eaccf"} Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.116875 4769 scope.go:117] "RemoveContainer" containerID="53cc0e37c1e453c63bc64710e5b72338490988d6b45b6b6634056af829222170" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.118696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerStarted","Data":"8c4738c53a865331578fe8f6d3a8b21985e427be9a00757ea5624feb34316755"} Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.124122 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.133539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"48f30235-6b42-49cf-ad48-3153c6f6c542","Type":"ContainerDied","Data":"9788dec5309145d9bb78726d5858d127b77aa5790810c5bfd9db12e6b4df0f08"} Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.133633 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7756664b4b-7s9gh" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.206571 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.315545 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410ba7d8-09d6-4e06-894e-c2b7b490e896" path="/var/lib/kubelet/pods/410ba7d8-09d6-4e06-894e-c2b7b490e896/volumes" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.316511 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6847ac12-d5e2-4722-bd09-f9bfa9ce21bd" path="/var/lib/kubelet/pods/6847ac12-d5e2-4722-bd09-f9bfa9ce21bd/volumes" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.399289 4769 scope.go:117] "RemoveContainer" containerID="92e20085d1f56e45e9b1939575457cb299f3d1fba665ee7798171ab39c01648e" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.450281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.470219 4769 scope.go:117] "RemoveContainer" containerID="e45f73eb8512fffa53269041f9095bc3a7dad12e398ef818420241fe14475f1f" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.475341 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.489082 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.489689 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-httpd" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.489713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-httpd" Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.489739 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-log" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.489756 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-log" Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.489785 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-httpd" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.489795 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-httpd" Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.489808 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-log" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.489816 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-log" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.490058 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-log" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.490083 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-httpd" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.490276 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" containerName="glance-httpd" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.490309 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" containerName="glance-log" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.491659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.502279 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.503009 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.503181 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-p27px" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.503426 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.503540 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.509457 4769 scope.go:117] "RemoveContainer" containerID="16e599ac25444568bec0868946286298a0c586bedd720ee6698bf3c1f6881eb9" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.511877 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.532244 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.539453 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7756664b4b-7s9gh"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.549287 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7756664b4b-7s9gh"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.551137 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.554976 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.555376 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6ded5830-49b2-42ca-9a78-50a831417844" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.555392 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ded5830-49b2-42ca-9a78-50a831417844" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.555571 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6ded5830-49b2-42ca-9a78-50a831417844" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.557385 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.559179 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.559456 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.565267 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.595983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-config-data\") pod \"6ded5830-49b2-42ca-9a78-50a831417844\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-combined-ca-bundle\") pod \"6ded5830-49b2-42ca-9a78-50a831417844\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596106 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29bgf\" (UniqueName: \"kubernetes.io/projected/6ded5830-49b2-42ca-9a78-50a831417844-kube-api-access-29bgf\") pod \"6ded5830-49b2-42ca-9a78-50a831417844\" (UID: \"6ded5830-49b2-42ca-9a78-50a831417844\") " Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596396 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n878f\" (UniqueName: \"kubernetes.io/projected/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-kube-api-access-n878f\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-config-data\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-scripts\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-logs\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbjq\" (UniqueName: \"kubernetes.io/projected/b1510c24-a296-4443-b9a6-237c100402a1-kube-api-access-hhbjq\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.596721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-logs\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.603400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ded5830-49b2-42ca-9a78-50a831417844-kube-api-access-29bgf" (OuterVolumeSpecName: "kube-api-access-29bgf") pod "6ded5830-49b2-42ca-9a78-50a831417844" (UID: "6ded5830-49b2-42ca-9a78-50a831417844"). InnerVolumeSpecName "kube-api-access-29bgf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.646168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-config-data" (OuterVolumeSpecName: "config-data") pod "6ded5830-49b2-42ca-9a78-50a831417844" (UID: "6ded5830-49b2-42ca-9a78-50a831417844"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.669784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ded5830-49b2-42ca-9a78-50a831417844" (UID: "6ded5830-49b2-42ca-9a78-50a831417844"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699474 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699693 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-logs\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbjq\" (UniqueName: \"kubernetes.io/projected/b1510c24-a296-4443-b9a6-237c100402a1-kube-api-access-hhbjq\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-logs\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699845 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n878f\" (UniqueName: \"kubernetes.io/projected/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-kube-api-access-n878f\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699967 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.699988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-config-data\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-scripts\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700222 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700234 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ded5830-49b2-42ca-9a78-50a831417844-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700245 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-29bgf\" (UniqueName: \"kubernetes.io/projected/6ded5830-49b2-42ca-9a78-50a831417844-kube-api-access-29bgf\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700962 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-logs\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.700974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-logs\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.701020 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.701256 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.701745 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.706311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.706457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-scripts\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.708699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.709856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-config-data\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.710428 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.712746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.712999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.716294 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/ed68f05c56acb11d7639bd89b025c28be3614129711d8fdb9746cf5aaed2cbfe/diff" to get inode usage: stat /var/lib/containers/storage/overlay/ed68f05c56acb11d7639bd89b025c28be3614129711d8fdb9746cf5aaed2cbfe/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_placement-664777594-l8qtg_1272b297-f9c9-4aee-9d3c-228c03e7ee3a/placement-log/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_placement-664777594-l8qtg_1272b297-f9c9-4aee-9d3c-228c03e7ee3a/placement-log/0.log: no such file or directory Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.721983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n878f\" (UniqueName: \"kubernetes.io/projected/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-kube-api-access-n878f\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.727271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.727631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbjq\" (UniqueName: \"kubernetes.io/projected/b1510c24-a296-4443-b9a6-237c100402a1-kube-api-access-hhbjq\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.751715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.756647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.822992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:31 crc kubenswrapper[4769]: E1121 12:59:31.907885 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/9ca18f807b9f78313e75c742683a0cb055d174b027379eaece49739c3a200d76/diff" to get inode usage: stat /var/lib/containers/storage/overlay/9ca18f807b9f78313e75c742683a0cb055d174b027379eaece49739c3a200d76/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_placement-664777594-l8qtg_1272b297-f9c9-4aee-9d3c-228c03e7ee3a/placement-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_placement-664777594-l8qtg_1272b297-f9c9-4aee-9d3c-228c03e7ee3a/placement-api/0.log: no such file or directory Nov 21 12:59:31 crc kubenswrapper[4769]: I1121 12:59:31.964539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.156058 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"09da4a70-f95f-4080-b7d4-b3ce7ede34c1","Type":"ContainerStarted","Data":"af009266358960d2a563c010192404ec300e3d322b0d6a118f6f9e9b56978335"} Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.156348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"09da4a70-f95f-4080-b7d4-b3ce7ede34c1","Type":"ContainerStarted","Data":"1096630c81d73ec1dbbcd5888b5081183afdbef45e0224d3604307a24871f2d6"} Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.159484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerStarted","Data":"c5330bf85a3fafb45998e6bad561c4f632928d087d74aeca6c3b2df40473c484"} Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.162889 4769 generic.go:334] "Generic (PLEG): container finished" podID="b7e7755d-72e1-4e20-a67b-04f8e88feafd" containerID="63376b49d4b416472eee3c331b92f4c2fd2007cda9f997730c9cf82e90686d98" exitCode=0 Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.162938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" event={"ID":"b7e7755d-72e1-4e20-a67b-04f8e88feafd","Type":"ContainerDied","Data":"63376b49d4b416472eee3c331b92f4c2fd2007cda9f997730c9cf82e90686d98"} Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.163214 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.172546 4769 generic.go:334] "Generic (PLEG): container finished" podID="6ded5830-49b2-42ca-9a78-50a831417844" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" exitCode=0 Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.172608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"6ded5830-49b2-42ca-9a78-50a831417844","Type":"ContainerDied","Data":"4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721"} Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.172629 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"6ded5830-49b2-42ca-9a78-50a831417844","Type":"ContainerDied","Data":"fbc4f20a3c106d5ad410e4536161f2bf5af4a193212cdd9abecec48939ea3b10"} Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.172648 4769 scope.go:117] "RemoveContainer" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.172738 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.283518 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.290891 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.309836 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.322599 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.310180 4769 scope.go:117] "RemoveContainer" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.332287 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:32 crc kubenswrapper[4769]: E1121 12:59:32.332352 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721\": container with ID starting with 4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721 not found: ID does not exist" containerID="4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.332419 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721"} err="failed to get container status \"4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721\": rpc error: code = NotFound desc = could not find container \"4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721\": container with ID starting with 4c35b3ae569de1ca41b08a09b11e05c9becb294adf72cb5e2b10458490c1d721 not found: ID does not exist" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.332677 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.436144 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.436282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjhd\" (UniqueName: \"kubernetes.io/projected/e8720015-7f08-4b65-918c-db82e7df6f66-kube-api-access-vhjhd\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.436320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.500110 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.538435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjhd\" (UniqueName: \"kubernetes.io/projected/e8720015-7f08-4b65-918c-db82e7df6f66-kube-api-access-vhjhd\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.538490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.538560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.544939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.546507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.555694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjhd\" (UniqueName: \"kubernetes.io/projected/e8720015-7f08-4b65-918c-db82e7df6f66-kube-api-access-vhjhd\") pod \"nova-cell1-conductor-0\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.706502 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.794996 4769 scope.go:117] "RemoveContainer" containerID="7cfa53c7351428f14664fda5fd5b8b753e39bb09b268ac9e957fd393e13a6b01" Nov 21 12:59:32 crc kubenswrapper[4769]: E1121 12:59:32.820864 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/749d08d6fe92024d98a294b725c5ff9a37b369798a1936e022420c7b7e3bbb6e/diff" to get inode usage: stat /var/lib/containers/storage/overlay/749d08d6fe92024d98a294b725c5ff9a37b369798a1936e022420c7b7e3bbb6e/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-api-9fd657ffb-f4pql_c0568707-e35d-472d-8fd4-2e2695e84153/barbican-api-log/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-api-9fd657ffb-f4pql_c0568707-e35d-472d-8fd4-2e2695e84153/barbican-api-log/0.log: no such file or directory Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.859030 4769 scope.go:117] "RemoveContainer" containerID="d53484f7bd8cade24f9789c4a1a20b9564d815925dc7ebdf7395bac407f82a01" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.948359 4769 scope.go:117] "RemoveContainer" containerID="d06f8830f020cf9e4f184f92c3dc2b75c5102487cf705fc57d48622df0863b4a" Nov 21 12:59:32 crc kubenswrapper[4769]: I1121 12:59:32.978483 4769 scope.go:117] "RemoveContainer" containerID="218808c308af3762e58b075e9b7db61231df55471cb35507c64dcc678e681429" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.039599 4769 scope.go:117] "RemoveContainer" containerID="612c5ae970fcd87f778bc7fcd3d3715634ab6c8b86ab76e616be4a11f0253487" Nov 21 12:59:33 crc kubenswrapper[4769]: E1121 12:59:33.054951 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/6a0a55de4f7013bf7c5044a07eda3ae525544b501c23b6371e241b95ea42da49/diff" to get inode usage: stat /var/lib/containers/storage/overlay/6a0a55de4f7013bf7c5044a07eda3ae525544b501c23b6371e241b95ea42da49/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-api-9fd657ffb-f4pql_c0568707-e35d-472d-8fd4-2e2695e84153/barbican-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-api-9fd657ffb-f4pql_c0568707-e35d-472d-8fd4-2e2695e84153/barbican-api/0.log: no such file or directory Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.083823 4769 scope.go:117] "RemoveContainer" containerID="be007bb72efc89e59a76c05ac55638b4a65dac9c75d8f6a0053f9e0834a25238" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.111934 4769 scope.go:117] "RemoveContainer" containerID="00d6102d4abb045db2facb715c86e75cbcd2e801918144412da17a2c8e417105" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.255238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerStarted","Data":"451106a7954c4b42f51f972ee9c3a54f69a0103163fd7fcd9af5e4d4f8db139f"} Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.267209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"09da4a70-f95f-4080-b7d4-b3ce7ede34c1","Type":"ContainerStarted","Data":"40685a2f76271238d87ffc258be2c0c73baffaec2773e0f9ce1d9d608bb49941"} Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.268062 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.286374 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32857629-7f0b-49f3-b3cc-6de4ab3db5bb" path="/var/lib/kubelet/pods/32857629-7f0b-49f3-b3cc-6de4ab3db5bb/volumes" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.294629 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f30235-6b42-49cf-ad48-3153c6f6c542" path="/var/lib/kubelet/pods/48f30235-6b42-49cf-ad48-3153c6f6c542/volumes" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.295596 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ded5830-49b2-42ca-9a78-50a831417844" path="/var/lib/kubelet/pods/6ded5830-49b2-42ca-9a78-50a831417844/volumes" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.296152 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75618a38-3d78-4f4c-9a05-88b0ce060be6" path="/var/lib/kubelet/pods/75618a38-3d78-4f4c-9a05-88b0ce060be6/volumes" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.299661 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.299644597 podStartE2EDuration="3.299644597s" podCreationTimestamp="2025-11-21 12:59:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:33.288101136 +0000 UTC m=+4131.988762954" watchObservedRunningTime="2025-11-21 12:59:33.299644597 +0000 UTC m=+4132.000306415" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.303931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b1510c24-a296-4443-b9a6-237c100402a1","Type":"ContainerStarted","Data":"19f0b0bcbb899350b2b83a2a2def359ff91ccb980719b7ac5ac27917a642d044"} Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.303966 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.303984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b1510c24-a296-4443-b9a6-237c100402a1","Type":"ContainerStarted","Data":"2034f6b0658fb1bc0a0d520d1ca03e448e305933ce7bde20334f4fe87ed8349f"} Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.303997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5dffcaa1-afe1-43af-8ccb-1237aa971d6c","Type":"ContainerStarted","Data":"ac277d823e5036f3c3037adc91d3611b2299b9c848721ae01066eacd436baeb2"} Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.304007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5dffcaa1-afe1-43af-8ccb-1237aa971d6c","Type":"ContainerStarted","Data":"d647b8a334fd602ef525ab8192dc573b9519394cbc2753c1296fa59b37c96f20"} Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.389635 4769 scope.go:117] "RemoveContainer" containerID="9abca5a1547c532a9bdf107f2a2b0bc3f3154329ca0abd5b15f2900c039961bb" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.458443 4769 scope.go:117] "RemoveContainer" containerID="6165f82de2e596e8765af559b9bd2fd749dbc2fca011275af0d8da1762b9442d" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.485698 4769 scope.go:117] "RemoveContainer" containerID="96a303aa15155229cf130a82c16bcfb0538f8f8c12939a45a9e393309f450584" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.537703 4769 scope.go:117] "RemoveContainer" containerID="825fde2ca35f95e01a5c9436725847015102c06aba8e5dd857197d11e8d414ef" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.625878 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.680623 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-combined-ca-bundle\") pod \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.682058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-credential-keys\") pod \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.682095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-scripts\") pod \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.682264 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpdsd\" (UniqueName: \"kubernetes.io/projected/b7e7755d-72e1-4e20-a67b-04f8e88feafd-kube-api-access-wpdsd\") pod \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.682299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-config-data\") pod \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.682321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-fernet-keys\") pod \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\" (UID: \"b7e7755d-72e1-4e20-a67b-04f8e88feafd\") " Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.689318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-scripts" (OuterVolumeSpecName: "scripts") pod "b7e7755d-72e1-4e20-a67b-04f8e88feafd" (UID: "b7e7755d-72e1-4e20-a67b-04f8e88feafd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.690753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "b7e7755d-72e1-4e20-a67b-04f8e88feafd" (UID: "b7e7755d-72e1-4e20-a67b-04f8e88feafd"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.690777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e7755d-72e1-4e20-a67b-04f8e88feafd-kube-api-access-wpdsd" (OuterVolumeSpecName: "kube-api-access-wpdsd") pod "b7e7755d-72e1-4e20-a67b-04f8e88feafd" (UID: "b7e7755d-72e1-4e20-a67b-04f8e88feafd"). InnerVolumeSpecName "kube-api-access-wpdsd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.691568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "b7e7755d-72e1-4e20-a67b-04f8e88feafd" (UID: "b7e7755d-72e1-4e20-a67b-04f8e88feafd"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.710479 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b7e7755d-72e1-4e20-a67b-04f8e88feafd" (UID: "b7e7755d-72e1-4e20-a67b-04f8e88feafd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.711594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-config-data" (OuterVolumeSpecName: "config-data") pod "b7e7755d-72e1-4e20-a67b-04f8e88feafd" (UID: "b7e7755d-72e1-4e20-a67b-04f8e88feafd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.753384 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.785042 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.785070 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.785080 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wpdsd\" (UniqueName: \"kubernetes.io/projected/b7e7755d-72e1-4e20-a67b-04f8e88feafd-kube-api-access-wpdsd\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.785089 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.785097 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:33 crc kubenswrapper[4769]: I1121 12:59:33.785107 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b7e7755d-72e1-4e20-a67b-04f8e88feafd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.272315 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-584546f6d8-2mpwd"] Nov 21 12:59:34 crc kubenswrapper[4769]: E1121 12:59:34.272985 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7e7755d-72e1-4e20-a67b-04f8e88feafd" containerName="keystone-bootstrap" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.273004 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e7755d-72e1-4e20-a67b-04f8e88feafd" containerName="keystone-bootstrap" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.273220 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b7e7755d-72e1-4e20-a67b-04f8e88feafd" containerName="keystone-bootstrap" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.274931 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.285025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.285949 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-public-tls-certs\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-scripts\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmvcn\" (UniqueName: \"kubernetes.io/projected/051a5615-1d34-436f-980d-f2b3408bc139-kube-api-access-pmvcn\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-config-data\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-credential-keys\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-internal-tls-certs\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-combined-ca-bundle\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.294951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-fernet-keys\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.295917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-584546f6d8-2mpwd"] Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.329516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5dffcaa1-afe1-43af-8ccb-1237aa971d6c","Type":"ContainerStarted","Data":"9e3ef90f84d9f9dfeca8d5caac2d6ca840a8002a6abc730d5e882c57a0035f93"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.341525 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerID="8913702c01c208c39e982e6b23b567bb96fe782782b673c093ba3983b87c923d" exitCode=1 Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.341627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f0f49554-2f2a-481e-8e6e-873cec67b892","Type":"ContainerDied","Data":"8913702c01c208c39e982e6b23b567bb96fe782782b673c093ba3983b87c923d"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.345553 4769 scope.go:117] "RemoveContainer" containerID="8913702c01c208c39e982e6b23b567bb96fe782782b673c093ba3983b87c923d" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.356925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerStarted","Data":"b8b2ca3240f8f7e7551606fddda9d98f39ccb3b0a93256814513d65e302ae85e"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.357179 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.363392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" event={"ID":"b7e7755d-72e1-4e20-a67b-04f8e88feafd","Type":"ContainerDied","Data":"91a114e2386d6e9132367324e212d66301c0626f2fc1370ef1d7f61994d3e797"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.363436 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91a114e2386d6e9132367324e212d66301c0626f2fc1370ef1d7f61994d3e797" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.363502 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dsj6v" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.390023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b1510c24-a296-4443-b9a6-237c100402a1","Type":"ContainerStarted","Data":"7ab702e2147d6315099f76b750890646912be5b10762830746117eb2a025e4a0"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.394876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8720015-7f08-4b65-918c-db82e7df6f66","Type":"ContainerStarted","Data":"61f41e5ccf0e1f6233bdd4ea52a5621f97a895ae4552e2944b9eaab8a6bd8d03"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.394926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8720015-7f08-4b65-918c-db82e7df6f66","Type":"ContainerStarted","Data":"8898589ec8fd61db92b48bfbe5b49571fb15e1ae524670f93c209482a6b25ed4"} Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.395646 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-credential-keys\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396433 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-internal-tls-certs\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-combined-ca-bundle\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-fernet-keys\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-public-tls-certs\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396613 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-scripts\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pmvcn\" (UniqueName: \"kubernetes.io/projected/051a5615-1d34-436f-980d-f2b3408bc139-kube-api-access-pmvcn\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.396673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-config-data\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.401495 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.401477082 podStartE2EDuration="3.401477082s" podCreationTimestamp="2025-11-21 12:59:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:34.37726245 +0000 UTC m=+4133.077924268" watchObservedRunningTime="2025-11-21 12:59:34.401477082 +0000 UTC m=+4133.102138900" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.402031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-credential-keys\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.407848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-combined-ca-bundle\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.408304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-internal-tls-certs\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.422086 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-scripts\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.426815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-public-tls-certs\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.427289 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.081711471 podStartE2EDuration="6.427272107s" podCreationTimestamp="2025-11-21 12:59:28 +0000 UTC" firstStartedPulling="2025-11-21 12:59:29.387876954 +0000 UTC m=+4128.088538772" lastFinishedPulling="2025-11-21 12:59:33.73343759 +0000 UTC m=+4132.434099408" observedRunningTime="2025-11-21 12:59:34.409278342 +0000 UTC m=+4133.109940160" watchObservedRunningTime="2025-11-21 12:59:34.427272107 +0000 UTC m=+4133.127933925" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.428722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-fernet-keys\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.435885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-config-data\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.442555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmvcn\" (UniqueName: \"kubernetes.io/projected/051a5615-1d34-436f-980d-f2b3408bc139-kube-api-access-pmvcn\") pod \"keystone-584546f6d8-2mpwd\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.467740 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.467721876 podStartE2EDuration="3.467721876s" podCreationTimestamp="2025-11-21 12:59:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:34.435761236 +0000 UTC m=+4133.136423064" watchObservedRunningTime="2025-11-21 12:59:34.467721876 +0000 UTC m=+4133.168383694" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.476517 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.476439691 podStartE2EDuration="2.476439691s" podCreationTimestamp="2025-11-21 12:59:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:34.460906813 +0000 UTC m=+4133.161568631" watchObservedRunningTime="2025-11-21 12:59:34.476439691 +0000 UTC m=+4133.177101499" Nov 21 12:59:34 crc kubenswrapper[4769]: I1121 12:59:34.636859 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:35 crc kubenswrapper[4769]: I1121 12:59:35.127808 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-584546f6d8-2mpwd"] Nov 21 12:59:35 crc kubenswrapper[4769]: I1121 12:59:35.440816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f0f49554-2f2a-481e-8e6e-873cec67b892","Type":"ContainerStarted","Data":"7ec26c21b9f03e31f476170f68b4505d9aab0b31f87e06b76dde2d255d424295"} Nov 21 12:59:35 crc kubenswrapper[4769]: I1121 12:59:35.444071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" event={"ID":"051a5615-1d34-436f-980d-f2b3408bc139","Type":"ContainerStarted","Data":"fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd"} Nov 21 12:59:35 crc kubenswrapper[4769]: I1121 12:59:35.444174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" event={"ID":"051a5615-1d34-436f-980d-f2b3408bc139","Type":"ContainerStarted","Data":"45055e9a252fb55c12afceb094eb9119e09d576225e2e264bfe505a1e7352565"} Nov 21 12:59:35 crc kubenswrapper[4769]: I1121 12:59:35.444275 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 12:59:35 crc kubenswrapper[4769]: I1121 12:59:35.476008 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" podStartSLOduration=1.475989122 podStartE2EDuration="1.475989122s" podCreationTimestamp="2025-11-21 12:59:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:35.467649257 +0000 UTC m=+4134.168311075" watchObservedRunningTime="2025-11-21 12:59:35.475989122 +0000 UTC m=+4134.176650930" Nov 21 12:59:35 crc kubenswrapper[4769]: E1121 12:59:35.502099 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/56fb1807c76f8ed4e4fb615de501519181eb883ecde60eee9b50dbed70c88b4a/diff" to get inode usage: stat /var/lib/containers/storage/overlay/56fb1807c76f8ed4e4fb615de501519181eb883ecde60eee9b50dbed70c88b4a/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/ovn-northd/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/ovn-northd/0.log: no such file or directory Nov 21 12:59:35 crc kubenswrapper[4769]: E1121 12:59:35.658346 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/5a0b23e49475cf107792246d6d1955ed97b504de66a944243ac8ea5823922792/diff" to get inode usage: stat /var/lib/containers/storage/overlay/5a0b23e49475cf107792246d6d1955ed97b504de66a944243ac8ea5823922792/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/openstack-network-exporter/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_ovn-northd-0_488cd419-abc4-436c-9407-e577b7158bb2/openstack-network-exporter/0.log: no such file or directory Nov 21 12:59:35 crc kubenswrapper[4769]: E1121 12:59:35.844274 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:35 crc kubenswrapper[4769]: E1121 12:59:35.846996 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:35 crc kubenswrapper[4769]: E1121 12:59:35.850725 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:35 crc kubenswrapper[4769]: E1121 12:59:35.850763 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:36 crc kubenswrapper[4769]: I1121 12:59:36.456342 4769 generic.go:334] "Generic (PLEG): container finished" podID="e8720015-7f08-4b65-918c-db82e7df6f66" containerID="61f41e5ccf0e1f6233bdd4ea52a5621f97a895ae4552e2944b9eaab8a6bd8d03" exitCode=1 Nov 21 12:59:36 crc kubenswrapper[4769]: I1121 12:59:36.456390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8720015-7f08-4b65-918c-db82e7df6f66","Type":"ContainerDied","Data":"61f41e5ccf0e1f6233bdd4ea52a5621f97a895ae4552e2944b9eaab8a6bd8d03"} Nov 21 12:59:36 crc kubenswrapper[4769]: I1121 12:59:36.458081 4769 scope.go:117] "RemoveContainer" containerID="61f41e5ccf0e1f6233bdd4ea52a5621f97a895ae4552e2944b9eaab8a6bd8d03" Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.203874 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.211544 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.312825 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f"] Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.313057 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api-log" containerID="cri-o://1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4" gracePeriod=30 Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.313177 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api" containerID="cri-o://c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366" gracePeriod=30 Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.469979 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerID="7ec26c21b9f03e31f476170f68b4505d9aab0b31f87e06b76dde2d255d424295" exitCode=1 Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.470066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f0f49554-2f2a-481e-8e6e-873cec67b892","Type":"ContainerDied","Data":"7ec26c21b9f03e31f476170f68b4505d9aab0b31f87e06b76dde2d255d424295"} Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.471327 4769 scope.go:117] "RemoveContainer" containerID="8913702c01c208c39e982e6b23b567bb96fe782782b673c093ba3983b87c923d" Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.472004 4769 scope.go:117] "RemoveContainer" containerID="7ec26c21b9f03e31f476170f68b4505d9aab0b31f87e06b76dde2d255d424295" Nov 21 12:59:37 crc kubenswrapper[4769]: E1121 12:59:37.472306 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(f0f49554-2f2a-481e-8e6e-873cec67b892)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.475975 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerID="1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4" exitCode=143 Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.476047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" event={"ID":"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6","Type":"ContainerDied","Data":"1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4"} Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.478434 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8720015-7f08-4b65-918c-db82e7df6f66","Type":"ContainerStarted","Data":"46c2cb7fdf0e377891a6a22386e3279d1210a68ef1ca28d5fa8a0798998cbf01"} Nov 21 12:59:37 crc kubenswrapper[4769]: I1121 12:59:37.478554 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:38 crc kubenswrapper[4769]: E1121 12:59:38.729836 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/86e0dff06477a927c4d2f82e92690676c8bdcd053ec1c404f6b02f6c91ef6741/diff" to get inode usage: stat /var/lib/containers/storage/overlay/86e0dff06477a927c4d2f82e92690676c8bdcd053ec1c404f6b02f6c91ef6741/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_keystone-56ff9ff65d-s2vlx_f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5/keystone-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_keystone-56ff9ff65d-s2vlx_f5a4059b-4a4a-4cb0-b7d3-d05cc404a7b5/keystone-api/0.log: no such file or directory Nov 21 12:59:38 crc kubenswrapper[4769]: I1121 12:59:38.753802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:38 crc kubenswrapper[4769]: I1121 12:59:38.753889 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:38 crc kubenswrapper[4769]: I1121 12:59:38.753912 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:38 crc kubenswrapper[4769]: I1121 12:59:38.753929 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:38 crc kubenswrapper[4769]: I1121 12:59:38.755293 4769 scope.go:117] "RemoveContainer" containerID="7ec26c21b9f03e31f476170f68b4505d9aab0b31f87e06b76dde2d255d424295" Nov 21 12:59:38 crc kubenswrapper[4769]: E1121 12:59:38.755720 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(f0f49554-2f2a-481e-8e6e-873cec67b892)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" Nov 21 12:59:39 crc kubenswrapper[4769]: I1121 12:59:39.504497 4769 generic.go:334] "Generic (PLEG): container finished" podID="e8720015-7f08-4b65-918c-db82e7df6f66" containerID="46c2cb7fdf0e377891a6a22386e3279d1210a68ef1ca28d5fa8a0798998cbf01" exitCode=1 Nov 21 12:59:39 crc kubenswrapper[4769]: I1121 12:59:39.504563 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8720015-7f08-4b65-918c-db82e7df6f66","Type":"ContainerDied","Data":"46c2cb7fdf0e377891a6a22386e3279d1210a68ef1ca28d5fa8a0798998cbf01"} Nov 21 12:59:39 crc kubenswrapper[4769]: I1121 12:59:39.505055 4769 scope.go:117] "RemoveContainer" containerID="61f41e5ccf0e1f6233bdd4ea52a5621f97a895ae4552e2944b9eaab8a6bd8d03" Nov 21 12:59:39 crc kubenswrapper[4769]: I1121 12:59:39.506462 4769 scope.go:117] "RemoveContainer" containerID="46c2cb7fdf0e377891a6a22386e3279d1210a68ef1ca28d5fa8a0798998cbf01" Nov 21 12:59:39 crc kubenswrapper[4769]: E1121 12:59:39.507133 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(e8720015-7f08-4b65-918c-db82e7df6f66)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.030779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.067409 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/0f0b02b05e9cb661ac797a0140c87dc9853b7a4c17675c7c06e55761d22a6fa2/diff" to get inode usage: stat /var/lib/containers/storage/overlay/0f0b02b05e9cb661ac797a0140c87dc9853b7a4c17675c7c06e55761d22a6fa2/diff: no such file or directory, extraDiskErr: Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.519633 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp"] Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.533721 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-lrcmp"] Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.595241 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/42c02a7ee4a32844fab7565c7b3f1b7680b427a945cfbd5f8e4cbfcc21997c39/diff" to get inode usage: stat /var/lib/containers/storage/overlay/42c02a7ee4a32844fab7565c7b3f1b7680b427a945cfbd5f8e4cbfcc21997c39/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-568fb8b7b6-lddp2_14a04cbb-912b-4efe-820a-56aa5150ae5c/barbican-keystone-listener/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-568fb8b7b6-lddp2_14a04cbb-912b-4efe-820a-56aa5150ae5c/barbican-keystone-listener/0.log: no such file or directory Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.600966 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.640089 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.640672 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-log" containerID="cri-o://8010277e0a4b83b0272da4237679de55021faf35a532ecf9e62716dce081a624" gracePeriod=30 Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.640789 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-api" containerID="cri-o://98ae86c4cbf0f7a34be7e5556d6121ed39746b91ef7bedf80017b51275fb4170" gracePeriod=30 Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.671047 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.671337 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-log" containerID="cri-o://e9db392f2b142e40ec0e04767efbf652a5b72e74fb44c00d16f4008efac1ee15" gracePeriod=30 Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.671458 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-metadata" containerID="cri-o://d85c406322e37fd4111d45bb14eedb47d967be28d6d32adb88147e4df7df8479" gracePeriod=30 Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.808811 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.144:9311/healthcheck\": read tcp 10.217.0.2:45170->10.217.0.144:9311: read: connection reset by peer" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.809089 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.144:9311/healthcheck\": read tcp 10.217.0.2:45174->10.217.0.144:9311: read: connection reset by peer" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.838419 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.847195 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.852526 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.875818 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.875892 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.910652 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b"] Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.911881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.917753 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.917969 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 12:59:40 crc kubenswrapper[4769]: I1121 12:59:40.924761 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b"] Nov 21 12:59:40 crc kubenswrapper[4769]: E1121 12:59:40.981442 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/9bc93ebb6e8729025cbb024ba56b1a86716322b42b9d41d8eea6bd9383d694cd/diff" to get inode usage: stat /var/lib/containers/storage/overlay/9bc93ebb6e8729025cbb024ba56b1a86716322b42b9d41d8eea6bd9383d694cd/diff: no such file or directory, extraDiskErr: Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.044132 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.046322 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.046432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-scripts\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.046467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-config-data\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.046497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c67pl\" (UniqueName: \"kubernetes.io/projected/6b65b1c4-b942-42e4-b0fd-bcad16c35679-kube-api-access-c67pl\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.076216 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.085991 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.086166 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="71d38cdc-dd99-42cf-8209-3b623241460f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://4383c77ac33031afa0f9cbf076884c862a483bcca4ca15adeb907dd8d8536424" gracePeriod=30 Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5wlk\" (UniqueName: \"kubernetes.io/projected/f0f49554-2f2a-481e-8e6e-873cec67b892-kube-api-access-b5wlk\") pod \"f0f49554-2f2a-481e-8e6e-873cec67b892\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-config-data\") pod \"f0f49554-2f2a-481e-8e6e-873cec67b892\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-combined-ca-bundle\") pod \"f0f49554-2f2a-481e-8e6e-873cec67b892\" (UID: \"f0f49554-2f2a-481e-8e6e-873cec67b892\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c67pl\" (UniqueName: \"kubernetes.io/projected/6b65b1c4-b942-42e4-b0fd-bcad16c35679-kube-api-access-c67pl\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-scripts\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.148869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-config-data\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.154884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-scripts\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.155125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.155512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f49554-2f2a-481e-8e6e-873cec67b892-kube-api-access-b5wlk" (OuterVolumeSpecName: "kube-api-access-b5wlk") pod "f0f49554-2f2a-481e-8e6e-873cec67b892" (UID: "f0f49554-2f2a-481e-8e6e-873cec67b892"). InnerVolumeSpecName "kube-api-access-b5wlk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.155969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-config-data\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.191596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c67pl\" (UniqueName: \"kubernetes.io/projected/6b65b1c4-b942-42e4-b0fd-bcad16c35679-kube-api-access-c67pl\") pod \"nova-cell0-cell-mapping-hcn2b\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.194818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-config-data" (OuterVolumeSpecName: "config-data") pod "f0f49554-2f2a-481e-8e6e-873cec67b892" (UID: "f0f49554-2f2a-481e-8e6e-873cec67b892"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.216080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0f49554-2f2a-481e-8e6e-873cec67b892" (UID: "f0f49554-2f2a-481e-8e6e-873cec67b892"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.235901 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.256316 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b5wlk\" (UniqueName: \"kubernetes.io/projected/f0f49554-2f2a-481e-8e6e-873cec67b892-kube-api-access-b5wlk\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.256399 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.256413 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0f49554-2f2a-481e-8e6e-873cec67b892-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.302985 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2bc39c-225d-4b16-a84e-c337dab1e11a" path="/var/lib/kubelet/pods/8e2bc39c-225d-4b16-a84e-c337dab1e11a/volumes" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.305780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357210 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-internal-tls-certs\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-combined-ca-bundle\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-logs\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357530 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-public-tls-certs\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data-custom\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.357594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qxmw\" (UniqueName: \"kubernetes.io/projected/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-kube-api-access-6qxmw\") pod \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\" (UID: \"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.358603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-logs" (OuterVolumeSpecName: "logs") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.361638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-kube-api-access-6qxmw" (OuterVolumeSpecName: "kube-api-access-6qxmw") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "kube-api-access-6qxmw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.362839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.385526 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.404426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.459021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-config-data\") pod \"e8720015-7f08-4b65-918c-db82e7df6f66\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.466410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhjhd\" (UniqueName: \"kubernetes.io/projected/e8720015-7f08-4b65-918c-db82e7df6f66-kube-api-access-vhjhd\") pod \"e8720015-7f08-4b65-918c-db82e7df6f66\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.466496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-combined-ca-bundle\") pod \"e8720015-7f08-4b65-918c-db82e7df6f66\" (UID: \"e8720015-7f08-4b65-918c-db82e7df6f66\") " Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.469098 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.469239 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.469256 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.469272 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6qxmw\" (UniqueName: \"kubernetes.io/projected/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-kube-api-access-6qxmw\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.482467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.482735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8720015-7f08-4b65-918c-db82e7df6f66-kube-api-access-vhjhd" (OuterVolumeSpecName: "kube-api-access-vhjhd") pod "e8720015-7f08-4b65-918c-db82e7df6f66" (UID: "e8720015-7f08-4b65-918c-db82e7df6f66"). InnerVolumeSpecName "kube-api-access-vhjhd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.482978 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/7270159abf95093bdd5a50c02eae21ce708be02b78b10067e606091cbf868f61/diff" to get inode usage: stat /var/lib/containers/storage/overlay/7270159abf95093bdd5a50c02eae21ce708be02b78b10067e606091cbf868f61/diff: no such file or directory, extraDiskErr: Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.508084 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-config-data" (OuterVolumeSpecName: "config-data") pod "e8720015-7f08-4b65-918c-db82e7df6f66" (UID: "e8720015-7f08-4b65-918c-db82e7df6f66"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.530369 4769 generic.go:334] "Generic (PLEG): container finished" podID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerID="8010277e0a4b83b0272da4237679de55021faf35a532ecf9e62716dce081a624" exitCode=143 Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.530426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"fdca9489-1f75-4aa3-9ff8-2426aea19580","Type":"ContainerDied","Data":"8010277e0a4b83b0272da4237679de55021faf35a532ecf9e62716dce081a624"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.533289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f0f49554-2f2a-481e-8e6e-873cec67b892","Type":"ContainerDied","Data":"cdf8ee9b3e5e81e5847d84111e06fce495c592d2fbd150dfe252580b992bfaa6"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.533330 4769 scope.go:117] "RemoveContainer" containerID="7ec26c21b9f03e31f476170f68b4505d9aab0b31f87e06b76dde2d255d424295" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.533345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8720015-7f08-4b65-918c-db82e7df6f66" (UID: "e8720015-7f08-4b65-918c-db82e7df6f66"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.533443 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.537451 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerID="c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366" exitCode=0 Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.537596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" event={"ID":"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6","Type":"ContainerDied","Data":"c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.537618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" event={"ID":"9c2c6f1c-ec4a-4960-9a5d-8c81723991b6","Type":"ContainerDied","Data":"95ff776ae8de0e6dea2aea5655d4399de138bbd7162cde05f536bb2080fea1f8"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.537691 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.542141 4769 generic.go:334] "Generic (PLEG): container finished" podID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerID="e9db392f2b142e40ec0e04767efbf652a5b72e74fb44c00d16f4008efac1ee15" exitCode=143 Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.542205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9acf18f4-b5c4-4243-abd0-bec516c660dc","Type":"ContainerDied","Data":"e9db392f2b142e40ec0e04767efbf652a5b72e74fb44c00d16f4008efac1ee15"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.544031 4769 generic.go:334] "Generic (PLEG): container finished" podID="71d38cdc-dd99-42cf-8209-3b623241460f" containerID="4383c77ac33031afa0f9cbf076884c862a483bcca4ca15adeb907dd8d8536424" exitCode=0 Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.544078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"71d38cdc-dd99-42cf-8209-3b623241460f","Type":"ContainerDied","Data":"4383c77ac33031afa0f9cbf076884c862a483bcca4ca15adeb907dd8d8536424"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.545286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"e8720015-7f08-4b65-918c-db82e7df6f66","Type":"ContainerDied","Data":"8898589ec8fd61db92b48bfbe5b49571fb15e1ae524670f93c209482a6b25ed4"} Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.545362 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.547990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.555057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data" (OuterVolumeSpecName: "config-data") pod "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" (UID: "9c2c6f1c-ec4a-4960-9a5d-8c81723991b6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.570516 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.570545 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.570554 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.570564 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vhjhd\" (UniqueName: \"kubernetes.io/projected/e8720015-7f08-4b65-918c-db82e7df6f66-kube-api-access-vhjhd\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.570575 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.570583 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8720015-7f08-4b65-918c-db82e7df6f66-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.589768 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.594950 4769 scope.go:117] "RemoveContainer" containerID="c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.598867 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.614341 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.626726 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.627339 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627355 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.627374 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api-log" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627381 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api-log" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.627395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerName="nova-scheduler-scheduler" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerName="nova-scheduler-scheduler" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.627418 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627424 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.627444 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerName="nova-scheduler-scheduler" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerName="nova-scheduler-scheduler" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.627457 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627463 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627647 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerName="nova-scheduler-scheduler" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627657 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627666 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" containerName="nova-cell1-conductor-conductor" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627678 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" containerName="nova-scheduler-scheduler" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627692 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.627703 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" containerName="barbican-api-log" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.628363 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.632620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.635899 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.641349 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/84009e3b670baef5dfe6b15a2f0650167a3d9c71b7f3f877bec5cc25146e2437/diff" to get inode usage: stat /var/lib/containers/storage/overlay/84009e3b670baef5dfe6b15a2f0650167a3d9c71b7f3f877bec5cc25146e2437/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-56f474c98b-xtrwd_8f89fc41-2862-4ea7-aaf8-47bc125c9ab8/barbican-keystone-listener/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-56f474c98b-xtrwd_8f89fc41-2862-4ea7-aaf8-47bc125c9ab8/barbican-keystone-listener/0.log: no such file or directory Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.641491 4769 scope.go:117] "RemoveContainer" containerID="1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.647498 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.655847 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.657764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.659339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.660994 4769 scope.go:117] "RemoveContainer" containerID="c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.663161 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.663624 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366\": container with ID starting with c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366 not found: ID does not exist" containerID="c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.663644 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366"} err="failed to get container status \"c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366\": rpc error: code = NotFound desc = could not find container \"c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366\": container with ID starting with c4a5441aaa2261a2c2cfddcbab1ee2dbe0e2509e78968a49d28a6d20950ae366 not found: ID does not exist" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.663660 4769 scope.go:117] "RemoveContainer" containerID="1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.663849 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4\": container with ID starting with 1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4 not found: ID does not exist" containerID="1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.663865 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4"} err="failed to get container status \"1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4\": rpc error: code = NotFound desc = could not find container \"1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4\": container with ID starting with 1959d06ed13710e8a819691ca6485e29dff513b733e62db1d3f97c22724171d4 not found: ID does not exist" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.663876 4769 scope.go:117] "RemoveContainer" containerID="46c2cb7fdf0e377891a6a22386e3279d1210a68ef1ca28d5fa8a0798998cbf01" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.681183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6xhb\" (UniqueName: \"kubernetes.io/projected/8334f117-6214-484d-b055-c14c4ad418fd-kube-api-access-t6xhb\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.681270 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.681383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-config-data\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: E1121 12:59:41.718846 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/1ac8038ab691364c4af306dda35029906477f57d95b9e4e18f375b543743f49b/diff" to get inode usage: stat /var/lib/containers/storage/overlay/1ac8038ab691364c4af306dda35029906477f57d95b9e4e18f375b543743f49b/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_neutron-7946bd886d-x52gg_45e04521-ef96-4028-9f3b-3b0bafbe2a8d/neutron-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_neutron-7946bd886d-x52gg_45e04521-ef96-4028-9f3b-3b0bafbe2a8d/neutron-api/0.log: no such file or directory Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.782638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.782688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-config-data\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.782743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t6xhb\" (UniqueName: \"kubernetes.io/projected/8334f117-6214-484d-b055-c14c4ad418fd-kube-api-access-t6xhb\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.782921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngtd\" (UniqueName: \"kubernetes.io/projected/774dcba4-ce12-497b-aa79-c08d2d903ac3-kube-api-access-2ngtd\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.782951 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.782989 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.787464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-config-data\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.790358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.804351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6xhb\" (UniqueName: \"kubernetes.io/projected/8334f117-6214-484d-b055-c14c4ad418fd-kube-api-access-t6xhb\") pod \"nova-scheduler-0\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.823725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.823767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.883445 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.884304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.885023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.885145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngtd\" (UniqueName: \"kubernetes.io/projected/774dcba4-ce12-497b-aa79-c08d2d903ac3-kube-api-access-2ngtd\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.885255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.891160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.891786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.907559 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.926907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngtd\" (UniqueName: \"kubernetes.io/projected/774dcba4-ce12-497b-aa79-c08d2d903ac3-kube-api-access-2ngtd\") pod \"nova-cell1-conductor-0\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.950778 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.964339 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.965713 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.965760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.981769 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5545dfbddd-4nh7f"] Nov 21 12:59:41 crc kubenswrapper[4769]: I1121 12:59:41.993086 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.021075 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.046532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.055399 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.088828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-config-data\") pod \"71d38cdc-dd99-42cf-8209-3b623241460f\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.088961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnj87\" (UniqueName: \"kubernetes.io/projected/71d38cdc-dd99-42cf-8209-3b623241460f-kube-api-access-mnj87\") pod \"71d38cdc-dd99-42cf-8209-3b623241460f\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.089050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-combined-ca-bundle\") pod \"71d38cdc-dd99-42cf-8209-3b623241460f\" (UID: \"71d38cdc-dd99-42cf-8209-3b623241460f\") " Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.096160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d38cdc-dd99-42cf-8209-3b623241460f-kube-api-access-mnj87" (OuterVolumeSpecName: "kube-api-access-mnj87") pod "71d38cdc-dd99-42cf-8209-3b623241460f" (UID: "71d38cdc-dd99-42cf-8209-3b623241460f"). InnerVolumeSpecName "kube-api-access-mnj87". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.125258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-config-data" (OuterVolumeSpecName: "config-data") pod "71d38cdc-dd99-42cf-8209-3b623241460f" (UID: "71d38cdc-dd99-42cf-8209-3b623241460f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.145699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "71d38cdc-dd99-42cf-8209-3b623241460f" (UID: "71d38cdc-dd99-42cf-8209-3b623241460f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.190841 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.190867 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71d38cdc-dd99-42cf-8209-3b623241460f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.190877 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mnj87\" (UniqueName: \"kubernetes.io/projected/71d38cdc-dd99-42cf-8209-3b623241460f-kube-api-access-mnj87\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.485428 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.555910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8334f117-6214-484d-b055-c14c4ad418fd","Type":"ContainerStarted","Data":"d6679dab0badef235977803381b5ae5b6a505ef93af54d4d153a3e0feb8c783f"} Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.563764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" event={"ID":"6b65b1c4-b942-42e4-b0fd-bcad16c35679","Type":"ContainerStarted","Data":"c754b80c250c6c28991616d6c623ea906d7dde0efcff135b51f0c5fce662b816"} Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.563813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" event={"ID":"6b65b1c4-b942-42e4-b0fd-bcad16c35679","Type":"ContainerStarted","Data":"75dd0615f7892b438fc21e4c3008deb04223e68342ac992dc071fd96f6dc4d8d"} Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.566824 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.567728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"71d38cdc-dd99-42cf-8209-3b623241460f","Type":"ContainerDied","Data":"d46789075587c67f639a94fa0e5db8993803b968bcb8717859d2165c87af6d8c"} Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.567773 4769 scope.go:117] "RemoveContainer" containerID="4383c77ac33031afa0f9cbf076884c862a483bcca4ca15adeb907dd8d8536424" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.573816 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.573857 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.573871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.573885 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.586310 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.652523 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" podStartSLOduration=2.652505511 podStartE2EDuration="2.652505511s" podCreationTimestamp="2025-11-21 12:59:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:42.592434243 +0000 UTC m=+4141.293096061" watchObservedRunningTime="2025-11-21 12:59:42.652505511 +0000 UTC m=+4141.353167329" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.658191 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.665944 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.677856 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:59:42 crc kubenswrapper[4769]: E1121 12:59:42.678246 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="71d38cdc-dd99-42cf-8209-3b623241460f" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.678261 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d38cdc-dd99-42cf-8209-3b623241460f" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.678437 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="71d38cdc-dd99-42cf-8209-3b623241460f" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.679044 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.682358 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.682668 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.688669 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.697239 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:59:42 crc kubenswrapper[4769]: E1121 12:59:42.712098 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/2eec4231f00bd037e0147251977f3afb0bddaa09e858370e96b659fed8076db2/diff" to get inode usage: stat /var/lib/containers/storage/overlay/2eec4231f00bd037e0147251977f3afb0bddaa09e858370e96b659fed8076db2/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-api-75f4c578fb-4g42h_9bcac63b-2c20-48f8-81cb-cf34894fdcda/barbican-api-log/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-api-75f4c578fb-4g42h_9bcac63b-2c20-48f8-81cb-cf34894fdcda/barbican-api-log/0.log: no such file or directory Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.805170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.805585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.805617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.805698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7br8\" (UniqueName: \"kubernetes.io/projected/016b6cd7-0a17-469d-a11d-9362cbc066dc-kube-api-access-r7br8\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.805722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.910220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r7br8\" (UniqueName: \"kubernetes.io/projected/016b6cd7-0a17-469d-a11d-9362cbc066dc-kube-api-access-r7br8\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.910264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.910329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.910380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.910413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.927714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.929233 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.929365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.935023 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:42 crc kubenswrapper[4769]: I1121 12:59:42.948829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7br8\" (UniqueName: \"kubernetes.io/projected/016b6cd7-0a17-469d-a11d-9362cbc066dc-kube-api-access-r7br8\") pod \"nova-cell1-novncproxy-0\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.014655 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.066233 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.105593 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.121815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data-custom\") pod \"b0d62447-0070-4c77-b67e-702596a3cacf\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.121945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-combined-ca-bundle\") pod \"b0d62447-0070-4c77-b67e-702596a3cacf\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.121984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data\") pod \"b0d62447-0070-4c77-b67e-702596a3cacf\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.122142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b0d62447-0070-4c77-b67e-702596a3cacf-etc-machine-id\") pod \"b0d62447-0070-4c77-b67e-702596a3cacf\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.122222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zp4t\" (UniqueName: \"kubernetes.io/projected/b0d62447-0070-4c77-b67e-702596a3cacf-kube-api-access-5zp4t\") pod \"b0d62447-0070-4c77-b67e-702596a3cacf\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.122247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-scripts\") pod \"b0d62447-0070-4c77-b67e-702596a3cacf\" (UID: \"b0d62447-0070-4c77-b67e-702596a3cacf\") " Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.123313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b0d62447-0070-4c77-b67e-702596a3cacf-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "b0d62447-0070-4c77-b67e-702596a3cacf" (UID: "b0d62447-0070-4c77-b67e-702596a3cacf"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.136092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b0d62447-0070-4c77-b67e-702596a3cacf" (UID: "b0d62447-0070-4c77-b67e-702596a3cacf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.161560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d62447-0070-4c77-b67e-702596a3cacf-kube-api-access-5zp4t" (OuterVolumeSpecName: "kube-api-access-5zp4t") pod "b0d62447-0070-4c77-b67e-702596a3cacf" (UID: "b0d62447-0070-4c77-b67e-702596a3cacf"). InnerVolumeSpecName "kube-api-access-5zp4t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:43 crc kubenswrapper[4769]: I1121 12:59:43.161686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-scripts" (OuterVolumeSpecName: "scripts") pod "b0d62447-0070-4c77-b67e-702596a3cacf" (UID: "b0d62447-0070-4c77-b67e-702596a3cacf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.226120 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/b0d62447-0070-4c77-b67e-702596a3cacf-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.226150 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5zp4t\" (UniqueName: \"kubernetes.io/projected/b0d62447-0070-4c77-b67e-702596a3cacf-kube-api-access-5zp4t\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.226166 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.226177 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.283280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data" (OuterVolumeSpecName: "config-data") pod "b0d62447-0070-4c77-b67e-702596a3cacf" (UID: "b0d62447-0070-4c77-b67e-702596a3cacf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.327505 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.339071 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d38cdc-dd99-42cf-8209-3b623241460f" path="/var/lib/kubelet/pods/71d38cdc-dd99-42cf-8209-3b623241460f/volumes" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.345205 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2c6f1c-ec4a-4960-9a5d-8c81723991b6" path="/var/lib/kubelet/pods/9c2c6f1c-ec4a-4960-9a5d-8c81723991b6/volumes" Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.346655 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/fba5ff45cd77eb23e65c9c7a39ba311f2c6a42b87846b057b1962ac00a210f96/diff" to get inode usage: stat /var/lib/containers/storage/overlay/fba5ff45cd77eb23e65c9c7a39ba311f2c6a42b87846b057b1962ac00a210f96/diff: no such file or directory, extraDiskErr: Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.347557 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8720015-7f08-4b65-918c-db82e7df6f66" path="/var/lib/kubelet/pods/e8720015-7f08-4b65-918c-db82e7df6f66/volumes" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.349414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b0d62447-0070-4c77-b67e-702596a3cacf" (UID: "b0d62447-0070-4c77-b67e-702596a3cacf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.351159 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f49554-2f2a-481e-8e6e-873cec67b892" path="/var/lib/kubelet/pods/f0f49554-2f2a-481e-8e6e-873cec67b892/volumes" Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.358961 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/ee7b61527c998d4bc7311dd0e8e17e22d644c5aaa4dfae1fcc2b510375e393c3/diff" to get inode usage: stat /var/lib/containers/storage/overlay/ee7b61527c998d4bc7311dd0e8e17e22d644c5aaa4dfae1fcc2b510375e393c3/diff: no such file or directory, extraDiskErr: Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.358988 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/c7ff849ba2eed469d58533b2b92e9f5ac3c24f24a0c24664ce5442283349e6a4/diff" to get inode usage: stat /var/lib/containers/storage/overlay/c7ff849ba2eed469d58533b2b92e9f5ac3c24f24a0c24664ce5442283349e6a4/diff: no such file or directory, extraDiskErr: Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.375915 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/b9e0e7416840a3d072629b9e00b4130f18d0d16cc7e4c77196d633a9dcf087e8/diff" to get inode usage: stat /var/lib/containers/storage/overlay/b9e0e7416840a3d072629b9e00b4130f18d0d16cc7e4c77196d633a9dcf087e8/diff: no such file or directory, extraDiskErr: Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.382526 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/1036d2f52061ccaa0fcf486e0be1806c53b0952e5a4e7af50d2b5ec2dc9d0a2a/diff" to get inode usage: stat /var/lib/containers/storage/overlay/1036d2f52061ccaa0fcf486e0be1806c53b0952e5a4e7af50d2b5ec2dc9d0a2a/diff: no such file or directory, extraDiskErr: Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.425576 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/b1704a5236a3890e3242dbd150418ae821a3351a2a7a4cdb6aeaf95bc3b74602/diff" to get inode usage: stat /var/lib/containers/storage/overlay/b1704a5236a3890e3242dbd150418ae821a3351a2a7a4cdb6aeaf95bc3b74602/diff: no such file or directory, extraDiskErr: Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.431931 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0d62447-0070-4c77-b67e-702596a3cacf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.586158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"774dcba4-ce12-497b-aa79-c08d2d903ac3","Type":"ContainerStarted","Data":"59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.586224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"774dcba4-ce12-497b-aa79-c08d2d903ac3","Type":"ContainerStarted","Data":"8ebf84ded7418db351ce949c1ff78fd5e1d2d86169feed37c6d5da06559e7d34"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.588035 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.589484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8334f117-6214-484d-b055-c14c4ad418fd","Type":"ContainerStarted","Data":"8ee1c20ae298bb2932c3dc208bdaf37b97110dd2028cb224f590b261735a05a4"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.601249 4769 generic.go:334] "Generic (PLEG): container finished" podID="b0d62447-0070-4c77-b67e-702596a3cacf" containerID="54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b" exitCode=0 Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.602149 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.602781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b0d62447-0070-4c77-b67e-702596a3cacf","Type":"ContainerDied","Data":"54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.602808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"b0d62447-0070-4c77-b67e-702596a3cacf","Type":"ContainerDied","Data":"e6edb90a9069fc917ecb154f6c2a112900924569337f1234a97a5301efff23a1"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.602838 4769 scope.go:117] "RemoveContainer" containerID="31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.618145 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.618119757 podStartE2EDuration="2.618119757s" podCreationTimestamp="2025-11-21 12:59:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:43.603552584 +0000 UTC m=+4142.304214422" watchObservedRunningTime="2025-11-21 12:59:43.618119757 +0000 UTC m=+4142.318781595" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.632971 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.632928276 podStartE2EDuration="2.632928276s" podCreationTimestamp="2025-11-21 12:59:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:43.620800339 +0000 UTC m=+4142.321462157" watchObservedRunningTime="2025-11-21 12:59:43.632928276 +0000 UTC m=+4142.333590094" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.638377 4769 scope.go:117] "RemoveContainer" containerID="54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.659284 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.666574 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.675771 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.676171 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="cinder-scheduler" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.676184 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="cinder-scheduler" Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.676223 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="probe" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.676230 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="probe" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.676425 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="cinder-scheduler" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.676448 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" containerName="probe" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.677476 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.684007 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.687427 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.700122 4769 scope.go:117] "RemoveContainer" containerID="31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d" Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.700630 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d\": container with ID starting with 31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d not found: ID does not exist" containerID="31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.700695 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d"} err="failed to get container status \"31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d\": rpc error: code = NotFound desc = could not find container \"31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d\": container with ID starting with 31835f159513e8c0b809d7ea12533c0deaeab66699fab7addc8d2fbef545672d not found: ID does not exist" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.700746 4769 scope.go:117] "RemoveContainer" containerID="54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b" Nov 21 12:59:44 crc kubenswrapper[4769]: E1121 12:59:43.701286 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b\": container with ID starting with 54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b not found: ID does not exist" containerID="54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.701312 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b"} err="failed to get container status \"54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b\": rpc error: code = NotFound desc = could not find container \"54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b\": container with ID starting with 54e882ccc0decb893c2b1bccfe24a8f55064bd515ee5704a1e91642e6aca772b not found: ID does not exist" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.840022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.840078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.840108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.840147 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a784a6a4-b4b4-4133-b747-46431dce82a5-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.840167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-scripts\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.840385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjk6l\" (UniqueName: \"kubernetes.io/projected/a784a6a4-b4b4-4133-b747-46431dce82a5-kube-api-access-cjk6l\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.942302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.942744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.942800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.942823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a784a6a4-b4b4-4133-b747-46431dce82a5-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.942841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-scripts\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.942921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cjk6l\" (UniqueName: \"kubernetes.io/projected/a784a6a4-b4b4-4133-b747-46431dce82a5-kube-api-access-cjk6l\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.946337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a784a6a4-b4b4-4133-b747-46431dce82a5-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.952771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-scripts\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.954679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.956206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.959630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjk6l\" (UniqueName: \"kubernetes.io/projected/a784a6a4-b4b4-4133-b747-46431dce82a5-kube-api-access-cjk6l\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.974833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:43.997489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.143515 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"http://10.217.0.134:8775/\": read tcp 10.217.0.2:42288->10.217.0.134:8775: read: connection reset by peer" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.143637 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-log" probeResult="failure" output="Get \"http://10.217.0.134:8775/\": read tcp 10.217.0.2:42278->10.217.0.134:8775: read: connection reset by peer" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.598359 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.617896 4769 generic.go:334] "Generic (PLEG): container finished" podID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerID="d85c406322e37fd4111d45bb14eedb47d967be28d6d32adb88147e4df7df8479" exitCode=0 Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.617987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9acf18f4-b5c4-4243-abd0-bec516c660dc","Type":"ContainerDied","Data":"d85c406322e37fd4111d45bb14eedb47d967be28d6d32adb88147e4df7df8479"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.623474 4769 generic.go:334] "Generic (PLEG): container finished" podID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerID="98ae86c4cbf0f7a34be7e5556d6121ed39746b91ef7bedf80017b51275fb4170" exitCode=0 Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.623517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"fdca9489-1f75-4aa3-9ff8-2426aea19580","Type":"ContainerDied","Data":"98ae86c4cbf0f7a34be7e5556d6121ed39746b91ef7bedf80017b51275fb4170"} Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.626805 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.634689 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9acf18f4-b5c4-4243-abd0-bec516c660dc-logs\") pod \"9acf18f4-b5c4-4243-abd0-bec516c660dc\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-config-data\") pod \"fdca9489-1f75-4aa3-9ff8-2426aea19580\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzfv4\" (UniqueName: \"kubernetes.io/projected/9acf18f4-b5c4-4243-abd0-bec516c660dc-kube-api-access-pzfv4\") pod \"9acf18f4-b5c4-4243-abd0-bec516c660dc\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fdca9489-1f75-4aa3-9ff8-2426aea19580-logs\") pod \"fdca9489-1f75-4aa3-9ff8-2426aea19580\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-combined-ca-bundle\") pod \"9acf18f4-b5c4-4243-abd0-bec516c660dc\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-config-data\") pod \"9acf18f4-b5c4-4243-abd0-bec516c660dc\" (UID: \"9acf18f4-b5c4-4243-abd0-bec516c660dc\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-combined-ca-bundle\") pod \"fdca9489-1f75-4aa3-9ff8-2426aea19580\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.757614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhwhx\" (UniqueName: \"kubernetes.io/projected/fdca9489-1f75-4aa3-9ff8-2426aea19580-kube-api-access-jhwhx\") pod \"fdca9489-1f75-4aa3-9ff8-2426aea19580\" (UID: \"fdca9489-1f75-4aa3-9ff8-2426aea19580\") " Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.758936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9acf18f4-b5c4-4243-abd0-bec516c660dc-logs" (OuterVolumeSpecName: "logs") pod "9acf18f4-b5c4-4243-abd0-bec516c660dc" (UID: "9acf18f4-b5c4-4243-abd0-bec516c660dc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.767664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdca9489-1f75-4aa3-9ff8-2426aea19580-kube-api-access-jhwhx" (OuterVolumeSpecName: "kube-api-access-jhwhx") pod "fdca9489-1f75-4aa3-9ff8-2426aea19580" (UID: "fdca9489-1f75-4aa3-9ff8-2426aea19580"). InnerVolumeSpecName "kube-api-access-jhwhx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.772417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdca9489-1f75-4aa3-9ff8-2426aea19580-logs" (OuterVolumeSpecName: "logs") pod "fdca9489-1f75-4aa3-9ff8-2426aea19580" (UID: "fdca9489-1f75-4aa3-9ff8-2426aea19580"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.786351 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.789127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9acf18f4-b5c4-4243-abd0-bec516c660dc-kube-api-access-pzfv4" (OuterVolumeSpecName: "kube-api-access-pzfv4") pod "9acf18f4-b5c4-4243-abd0-bec516c660dc" (UID: "9acf18f4-b5c4-4243-abd0-bec516c660dc"). InnerVolumeSpecName "kube-api-access-pzfv4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.807713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fdca9489-1f75-4aa3-9ff8-2426aea19580" (UID: "fdca9489-1f75-4aa3-9ff8-2426aea19580"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.809369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-config-data" (OuterVolumeSpecName: "config-data") pod "fdca9489-1f75-4aa3-9ff8-2426aea19580" (UID: "fdca9489-1f75-4aa3-9ff8-2426aea19580"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.829443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9acf18f4-b5c4-4243-abd0-bec516c660dc" (UID: "9acf18f4-b5c4-4243-abd0-bec516c660dc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859465 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859806 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jhwhx\" (UniqueName: \"kubernetes.io/projected/fdca9489-1f75-4aa3-9ff8-2426aea19580-kube-api-access-jhwhx\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859820 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9acf18f4-b5c4-4243-abd0-bec516c660dc-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859829 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdca9489-1f75-4aa3-9ff8-2426aea19580-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859841 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pzfv4\" (UniqueName: \"kubernetes.io/projected/9acf18f4-b5c4-4243-abd0-bec516c660dc-kube-api-access-pzfv4\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859849 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fdca9489-1f75-4aa3-9ff8-2426aea19580-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.859857 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.865530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-config-data" (OuterVolumeSpecName: "config-data") pod "9acf18f4-b5c4-4243-abd0-bec516c660dc" (UID: "9acf18f4-b5c4-4243-abd0-bec516c660dc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.936347 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.936449 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:59:44 crc kubenswrapper[4769]: I1121 12:59:44.966417 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9acf18f4-b5c4-4243-abd0-bec516c660dc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.194865 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.195455 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.286677 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d62447-0070-4c77-b67e-702596a3cacf" path="/var/lib/kubelet/pods/b0d62447-0070-4c77-b67e-702596a3cacf/volumes" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.529966 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 12:59:45 crc kubenswrapper[4769]: W1121 12:59:45.594344 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c2c6f1c_ec4a_4960_9a5d_8c81723991b6.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c2c6f1c_ec4a_4960_9a5d_8c81723991b6.slice: no such file or directory Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.716002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9acf18f4-b5c4-4243-abd0-bec516c660dc","Type":"ContainerDied","Data":"f7f27ced0dabcf32a81f0366255353f16e33951fcde176ff859161f9d295b315"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.716323 4769 scope.go:117] "RemoveContainer" containerID="d85c406322e37fd4111d45bb14eedb47d967be28d6d32adb88147e4df7df8479" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.716083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.740700 4769 generic.go:334] "Generic (PLEG): container finished" podID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" exitCode=0 Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.740788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"4038fb5d-3a41-41bc-b028-2ef32732fec8","Type":"ContainerDied","Data":"46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.751477 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.783740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"fdca9489-1f75-4aa3-9ff8-2426aea19580","Type":"ContainerDied","Data":"c1ec28aa51234b08b2d83e4ebea5227e0f0bc1c15a1e19eb2225819f66087dc7"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.783850 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.796944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"016b6cd7-0a17-469d-a11d-9362cbc066dc","Type":"ContainerStarted","Data":"a98f2249e532d44c8d3a24a2dc7be29499bfbabb1862d9b22de2c9a8054e43a1"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.796987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"016b6cd7-0a17-469d-a11d-9362cbc066dc","Type":"ContainerStarted","Data":"b09b5aefe74560ef370542c34cfb2c39bc31a948bd40e4330d7e2044f4068ebb"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.803226 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.805033 4769 generic.go:334] "Generic (PLEG): container finished" podID="8334f117-6214-484d-b055-c14c4ad418fd" containerID="8ee1c20ae298bb2932c3dc208bdaf37b97110dd2028cb224f590b261735a05a4" exitCode=1 Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.805129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8334f117-6214-484d-b055-c14c4ad418fd","Type":"ContainerDied","Data":"8ee1c20ae298bb2932c3dc208bdaf37b97110dd2028cb224f590b261735a05a4"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.805813 4769 scope.go:117] "RemoveContainer" containerID="8ee1c20ae298bb2932c3dc208bdaf37b97110dd2028cb224f590b261735a05a4" Nov 21 12:59:45 crc kubenswrapper[4769]: W1121 12:59:45.816915 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb61ccb84_4f33_4f62_ab1a_986f3e1974fe.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb61ccb84_4f33_4f62_ab1a_986f3e1974fe.slice: no such file or directory Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.833299 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.833829 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-log" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.833845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-log" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.833866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-api" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.833872 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-api" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.833890 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-metadata" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.833896 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-metadata" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.833909 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-log" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.833914 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-log" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.834118 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-metadata" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.834137 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" containerName="nova-metadata-log" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.834147 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-log" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.834156 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" containerName="nova-api-api" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.836784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a784a6a4-b4b4-4133-b747-46431dce82a5","Type":"ContainerStarted","Data":"a451ce9dd4327aa992c1114370fedcdc326e7000078725422e2cf2c0251dec29"} Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.836961 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.840983 4769 scope.go:117] "RemoveContainer" containerID="e9db392f2b142e40ec0e04767efbf652a5b72e74fb44c00d16f4008efac1ee15" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.849484 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203 is running failed: container process not found" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.853169 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.857485 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203 is running failed: container process not found" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.858103 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.863101 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.863079179 podStartE2EDuration="3.863079179s" podCreationTimestamp="2025-11-21 12:59:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:45.818772846 +0000 UTC m=+4144.519434664" watchObservedRunningTime="2025-11-21 12:59:45.863079179 +0000 UTC m=+4144.563740997" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.865243 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.865587 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203 is running failed: container process not found" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.865652 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:45 crc kubenswrapper[4769]: I1121 12:59:45.868613 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.934787 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32857629_7f0b_49f3_b3cc_6de4ab3db5bb.slice/crio-conmon-7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa39735_6ebc_412a_ae3c_bfb951dc599b.slice/crio-conmon-f34b59991bbcde373cfc57e89fd862cdaa711ae7091f5c6be779d1fc1a3f0a84.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14a04cbb_912b_4efe_820a_56aa5150ae5c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod518a86ab_f04b_4ee1_9bba_13e68dd3367f.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32857629_7f0b_49f3_b3cc_6de4ab3db5bb.slice/crio-7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1683331d_7238_4b3e_b37b_5d5c1cc3b6b0.slice/crio-a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod518a86ab_f04b_4ee1_9bba_13e68dd3367f.slice/crio-92a838ac1402ea733ff16d45dc7cadef991e4de13e448a4e4f43472db87a572a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14a04cbb_912b_4efe_820a_56aa5150ae5c.slice/crio-conmon-6164032da3c84d3e4e7f81f08212961d826c131dd4b8fce339cb2977daf4ef49.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14a04cbb_912b_4efe_820a_56aa5150ae5c.slice/crio-865b6f9a3c9bdee2802eeb9c177b37673fa2fb64d4f4c25469d93c0871de37db\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f89fc41_2862_4ea7_aaf8_47bc125c9ab8.slice/crio-conmon-4e318af89f022e0d78c68eb8f7a7f3908c2625db2c637810bad9fc2884a949e3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1683331d_7238_4b3e_b37b_5d5c1cc3b6b0.slice/crio-conmon-a24017a754ca726e1b7541c39f3a8ac1341a03f06c813d92e67022803bac7c55.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod518a86ab_f04b_4ee1_9bba_13e68dd3367f.slice/crio-cb0206b5364a5a45cf48ca7ca50f4a34967626d0505ea4b126d83bf87cec25e0\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa39735_6ebc_412a_ae3c_bfb951dc599b.slice/crio-f34b59991bbcde373cfc57e89fd862cdaa711ae7091f5c6be779d1fc1a3f0a84.scope\": RecentStats: unable to find data in memory cache]" Nov 21 12:59:45 crc kubenswrapper[4769]: E1121 12:59:45.987464 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: , extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_neutron-7756664b4b-7s9gh_32857629-7f0b-49f3-b3cc-6de4ab3db5bb/neutron-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_neutron-7756664b4b-7s9gh_32857629-7f0b-49f3-b3cc-6de4ab3db5bb/neutron-api/0.log: no such file or directory Nov 21 12:59:46 crc kubenswrapper[4769]: W1121 12:59:46.007315 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7e7755d_72e1_4e20_a67b_04f8e88feafd.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7e7755d_72e1_4e20_a67b_04f8e88feafd.slice: no such file or directory Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.016898 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.035969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-config-data\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.036121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.036383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzr7n\" (UniqueName: \"kubernetes.io/projected/d9a1db91-dfee-4a30-a948-9b98f0866e95-kube-api-access-gzr7n\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.036493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9a1db91-dfee-4a30-a948-9b98f0866e95-logs\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.036528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.049173 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.079071 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.111632 4769 scope.go:117] "RemoveContainer" containerID="98ae86c4cbf0f7a34be7e5556d6121ed39746b91ef7bedf80017b51275fb4170" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.113037 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.120325 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.122622 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.135893 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.141276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.148351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.148508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gzr7n\" (UniqueName: \"kubernetes.io/projected/d9a1db91-dfee-4a30-a948-9b98f0866e95-kube-api-access-gzr7n\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.148573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9a1db91-dfee-4a30-a948-9b98f0866e95-logs\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.148597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.148648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-config-data\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.150944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9a1db91-dfee-4a30-a948-9b98f0866e95-logs\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.157777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.157901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-config-data\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.157927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.172463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzr7n\" (UniqueName: \"kubernetes.io/projected/d9a1db91-dfee-4a30-a948-9b98f0866e95-kube-api-access-gzr7n\") pod \"nova-metadata-0\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.184758 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:46 crc kubenswrapper[4769]: W1121 12:59:46.198314 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0f49554_2f2a_481e_8e6e_873cec67b892.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0f49554_2f2a_481e_8e6e_873cec67b892.slice: no such file or directory Nov 21 12:59:46 crc kubenswrapper[4769]: W1121 12:59:46.248772 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8720015_7f08_4b65_918c_db82e7df6f66.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8720015_7f08_4b65_918c_db82e7df6f66.slice: no such file or directory Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.249496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-combined-ca-bundle\") pod \"4038fb5d-3a41-41bc-b028-2ef32732fec8\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.249756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrs77\" (UniqueName: \"kubernetes.io/projected/4038fb5d-3a41-41bc-b028-2ef32732fec8-kube-api-access-mrs77\") pod \"4038fb5d-3a41-41bc-b028-2ef32732fec8\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.254359 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-config-data\") pod \"4038fb5d-3a41-41bc-b028-2ef32732fec8\" (UID: \"4038fb5d-3a41-41bc-b028-2ef32732fec8\") " Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.255852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.255953 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-internal-tls-certs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.255979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7de24140-f0ff-4e17-b5cc-f91f617c8a33-logs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.256006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4038fb5d-3a41-41bc-b028-2ef32732fec8-kube-api-access-mrs77" (OuterVolumeSpecName: "kube-api-access-mrs77") pod "4038fb5d-3a41-41bc-b028-2ef32732fec8" (UID: "4038fb5d-3a41-41bc-b028-2ef32732fec8"). InnerVolumeSpecName "kube-api-access-mrs77". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.256023 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-config-data\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.256136 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfn7m\" (UniqueName: \"kubernetes.io/projected/7de24140-f0ff-4e17-b5cc-f91f617c8a33-kube-api-access-bfn7m\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.256321 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-public-tls-certs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.256480 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mrs77\" (UniqueName: \"kubernetes.io/projected/4038fb5d-3a41-41bc-b028-2ef32732fec8-kube-api-access-mrs77\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.261439 4769 scope.go:117] "RemoveContainer" containerID="8010277e0a4b83b0272da4237679de55021faf35a532ecf9e62716dce081a624" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.292069 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4038fb5d-3a41-41bc-b028-2ef32732fec8" (UID: "4038fb5d-3a41-41bc-b028-2ef32732fec8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.294036 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-config-data" (OuterVolumeSpecName: "config-data") pod "4038fb5d-3a41-41bc-b028-2ef32732fec8" (UID: "4038fb5d-3a41-41bc-b028-2ef32732fec8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-public-tls-certs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-internal-tls-certs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7de24140-f0ff-4e17-b5cc-f91f617c8a33-logs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-config-data\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bfn7m\" (UniqueName: \"kubernetes.io/projected/7de24140-f0ff-4e17-b5cc-f91f617c8a33-kube-api-access-bfn7m\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360586 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.360600 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4038fb5d-3a41-41bc-b028-2ef32732fec8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.361975 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7de24140-f0ff-4e17-b5cc-f91f617c8a33-logs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.367341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.367706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-config-data\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.369673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-public-tls-certs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.373407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-internal-tls-certs\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.383728 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfn7m\" (UniqueName: \"kubernetes.io/projected/7de24140-f0ff-4e17-b5cc-f91f617c8a33-kube-api-access-bfn7m\") pod \"nova-api-0\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.388454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.449749 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.845447 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.846278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"4038fb5d-3a41-41bc-b028-2ef32732fec8","Type":"ContainerDied","Data":"8c5562641c674070bc98f884f8e6731454282a0119e09abf1501d1bc2f6bf7a1"} Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.846342 4769 scope.go:117] "RemoveContainer" containerID="46006ec78abac757d12b9716b4d91851d4aae4fa3f2b00d70bb3a8771cd88203" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.871451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8334f117-6214-484d-b055-c14c4ad418fd","Type":"ContainerStarted","Data":"280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c"} Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.887730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a784a6a4-b4b4-4133-b747-46431dce82a5","Type":"ContainerStarted","Data":"422b5c076b7276c472dfd77dc0e0326c5d93d0634a9e8b5adec4b2739ba09f77"} Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.887799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a784a6a4-b4b4-4133-b747-46431dce82a5","Type":"ContainerStarted","Data":"fd6c613f64ef206587c06c6e0e3f6c4a769a9ad5115b62b885c20e5c1a800799"} Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.936235 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.936213911 podStartE2EDuration="3.936213911s" podCreationTimestamp="2025-11-21 12:59:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:46.922265485 +0000 UTC m=+4145.622927303" watchObservedRunningTime="2025-11-21 12:59:46.936213911 +0000 UTC m=+4145.636875729" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.951805 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:46 crc kubenswrapper[4769]: I1121 12:59:46.987425 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.017021 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.025584 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:59:47 crc kubenswrapper[4769]: E1121 12:59:47.027551 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.027570 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.028131 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" containerName="nova-cell0-conductor-conductor" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.029036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.032496 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.048267 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.072266 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.091810 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.204242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75z4f\" (UniqueName: \"kubernetes.io/projected/58c34dd3-526f-4fb0-ae03-45f3137e51e9-kube-api-access-75z4f\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.204527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.204949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.285382 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4038fb5d-3a41-41bc-b028-2ef32732fec8" path="/var/lib/kubelet/pods/4038fb5d-3a41-41bc-b028-2ef32732fec8/volumes" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.286148 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9acf18f4-b5c4-4243-abd0-bec516c660dc" path="/var/lib/kubelet/pods/9acf18f4-b5c4-4243-abd0-bec516c660dc/volumes" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.286753 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdca9489-1f75-4aa3-9ff8-2426aea19580" path="/var/lib/kubelet/pods/fdca9489-1f75-4aa3-9ff8-2426aea19580/volumes" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.306479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.307620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75z4f\" (UniqueName: \"kubernetes.io/projected/58c34dd3-526f-4fb0-ae03-45f3137e51e9-kube-api-access-75z4f\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.307732 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.317977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.318021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.330763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75z4f\" (UniqueName: \"kubernetes.io/projected/58c34dd3-526f-4fb0-ae03-45f3137e51e9-kube-api-access-75z4f\") pod \"nova-cell0-conductor-0\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.522650 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.921065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9a1db91-dfee-4a30-a948-9b98f0866e95","Type":"ContainerStarted","Data":"451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c"} Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.921452 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9a1db91-dfee-4a30-a948-9b98f0866e95","Type":"ContainerStarted","Data":"9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6"} Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.921464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9a1db91-dfee-4a30-a948-9b98f0866e95","Type":"ContainerStarted","Data":"06976c10939ea5a0da8e41e1ac70fc43ed5b1056194d870912f826f8232df6a0"} Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.927604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7de24140-f0ff-4e17-b5cc-f91f617c8a33","Type":"ContainerStarted","Data":"ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71"} Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.927635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7de24140-f0ff-4e17-b5cc-f91f617c8a33","Type":"ContainerStarted","Data":"d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956"} Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.927644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7de24140-f0ff-4e17-b5cc-f91f617c8a33","Type":"ContainerStarted","Data":"d2addb9350bcf2af614889f85aed96611ed409d8dee35e785dbe15e2ebd72b82"} Nov 21 12:59:47 crc kubenswrapper[4769]: I1121 12:59:47.943002 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.942981105 podStartE2EDuration="2.942981105s" podCreationTimestamp="2025-11-21 12:59:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:47.937533099 +0000 UTC m=+4146.638194917" watchObservedRunningTime="2025-11-21 12:59:47.942981105 +0000 UTC m=+4146.643642923" Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.016362 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.094734 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.094717062 podStartE2EDuration="3.094717062s" podCreationTimestamp="2025-11-21 12:59:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:47.961564186 +0000 UTC m=+4146.662226004" watchObservedRunningTime="2025-11-21 12:59:48.094717062 +0000 UTC m=+4146.795378880" Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.095793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 12:59:48 crc kubenswrapper[4769]: W1121 12:59:48.100558 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58c34dd3_526f_4fb0_ae03_45f3137e51e9.slice/crio-77bea137aa5cbd60abeae2d11e257ce5d268d9b487b582d9ec49d3e63a8adb97 WatchSource:0}: Error finding container 77bea137aa5cbd60abeae2d11e257ce5d268d9b487b582d9ec49d3e63a8adb97: Status 404 returned error can't find the container with id 77bea137aa5cbd60abeae2d11e257ce5d268d9b487b582d9ec49d3e63a8adb97 Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.957359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"58c34dd3-526f-4fb0-ae03-45f3137e51e9","Type":"ContainerStarted","Data":"61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353"} Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.957712 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.957732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"58c34dd3-526f-4fb0-ae03-45f3137e51e9","Type":"ContainerStarted","Data":"77bea137aa5cbd60abeae2d11e257ce5d268d9b487b582d9ec49d3e63a8adb97"} Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.960156 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b65b1c4-b942-42e4-b0fd-bcad16c35679" containerID="c754b80c250c6c28991616d6c623ea906d7dde0efcff135b51f0c5fce662b816" exitCode=0 Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.960252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" event={"ID":"6b65b1c4-b942-42e4-b0fd-bcad16c35679","Type":"ContainerDied","Data":"c754b80c250c6c28991616d6c623ea906d7dde0efcff135b51f0c5fce662b816"} Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.962668 4769 generic.go:334] "Generic (PLEG): container finished" podID="8334f117-6214-484d-b055-c14c4ad418fd" containerID="280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c" exitCode=1 Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.962699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8334f117-6214-484d-b055-c14c4ad418fd","Type":"ContainerDied","Data":"280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c"} Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.962783 4769 scope.go:117] "RemoveContainer" containerID="8ee1c20ae298bb2932c3dc208bdaf37b97110dd2028cb224f590b261735a05a4" Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.963990 4769 scope.go:117] "RemoveContainer" containerID="280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c" Nov 21 12:59:48 crc kubenswrapper[4769]: E1121 12:59:48.964779 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(8334f117-6214-484d-b055-c14c4ad418fd)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8334f117-6214-484d-b055-c14c4ad418fd" Nov 21 12:59:48 crc kubenswrapper[4769]: I1121 12:59:48.997654 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:49 crc kubenswrapper[4769]: I1121 12:59:49.013357 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.013325252 podStartE2EDuration="3.013325252s" podCreationTimestamp="2025-11-21 12:59:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 12:59:48.986763347 +0000 UTC m=+4147.687425195" watchObservedRunningTime="2025-11-21 12:59:49.013325252 +0000 UTC m=+4147.713987110" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.318388 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.491781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-scripts\") pod \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.491842 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c67pl\" (UniqueName: \"kubernetes.io/projected/6b65b1c4-b942-42e4-b0fd-bcad16c35679-kube-api-access-c67pl\") pod \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.491902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-combined-ca-bundle\") pod \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.492074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-config-data\") pod \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\" (UID: \"6b65b1c4-b942-42e4-b0fd-bcad16c35679\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.499425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-scripts" (OuterVolumeSpecName: "scripts") pod "6b65b1c4-b942-42e4-b0fd-bcad16c35679" (UID: "6b65b1c4-b942-42e4-b0fd-bcad16c35679"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.500515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b65b1c4-b942-42e4-b0fd-bcad16c35679-kube-api-access-c67pl" (OuterVolumeSpecName: "kube-api-access-c67pl") pod "6b65b1c4-b942-42e4-b0fd-bcad16c35679" (UID: "6b65b1c4-b942-42e4-b0fd-bcad16c35679"). InnerVolumeSpecName "kube-api-access-c67pl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.527089 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b65b1c4-b942-42e4-b0fd-bcad16c35679" (UID: "6b65b1c4-b942-42e4-b0fd-bcad16c35679"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.535799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-config-data" (OuterVolumeSpecName: "config-data") pod "6b65b1c4-b942-42e4-b0fd-bcad16c35679" (UID: "6b65b1c4-b942-42e4-b0fd-bcad16c35679"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.570016 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.595225 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.595274 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.595336 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c67pl\" (UniqueName: \"kubernetes.io/projected/6b65b1c4-b942-42e4-b0fd-bcad16c35679-kube-api-access-c67pl\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.595358 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b65b1c4-b942-42e4-b0fd-bcad16c35679-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.696448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z2vr\" (UniqueName: \"kubernetes.io/projected/4e40287e-d24f-490a-980a-0f82128eb7d2-kube-api-access-5z2vr\") pod \"4e40287e-d24f-490a-980a-0f82128eb7d2\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.696633 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-combined-ca-bundle\") pod \"4e40287e-d24f-490a-980a-0f82128eb7d2\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.696668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e40287e-d24f-490a-980a-0f82128eb7d2-logs\") pod \"4e40287e-d24f-490a-980a-0f82128eb7d2\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.696755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data\") pod \"4e40287e-d24f-490a-980a-0f82128eb7d2\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.696790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data-custom\") pod \"4e40287e-d24f-490a-980a-0f82128eb7d2\" (UID: \"4e40287e-d24f-490a-980a-0f82128eb7d2\") " Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.697226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e40287e-d24f-490a-980a-0f82128eb7d2-logs" (OuterVolumeSpecName: "logs") pod "4e40287e-d24f-490a-980a-0f82128eb7d2" (UID: "4e40287e-d24f-490a-980a-0f82128eb7d2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.697571 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e40287e-d24f-490a-980a-0f82128eb7d2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.700038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4e40287e-d24f-490a-980a-0f82128eb7d2" (UID: "4e40287e-d24f-490a-980a-0f82128eb7d2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.702136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e40287e-d24f-490a-980a-0f82128eb7d2-kube-api-access-5z2vr" (OuterVolumeSpecName: "kube-api-access-5z2vr") pod "4e40287e-d24f-490a-980a-0f82128eb7d2" (UID: "4e40287e-d24f-490a-980a-0f82128eb7d2"). InnerVolumeSpecName "kube-api-access-5z2vr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.722845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e40287e-d24f-490a-980a-0f82128eb7d2" (UID: "4e40287e-d24f-490a-980a-0f82128eb7d2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.768768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data" (OuterVolumeSpecName: "config-data") pod "4e40287e-d24f-490a-980a-0f82128eb7d2" (UID: "4e40287e-d24f-490a-980a-0f82128eb7d2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.800458 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.800502 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.800527 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5z2vr\" (UniqueName: \"kubernetes.io/projected/4e40287e-d24f-490a-980a-0f82128eb7d2-kube-api-access-5z2vr\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.800547 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e40287e-d24f-490a-980a-0f82128eb7d2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.997973 4769 generic.go:334] "Generic (PLEG): container finished" podID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerID="6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d" exitCode=0 Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.998071 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.998133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" event={"ID":"4e40287e-d24f-490a-980a-0f82128eb7d2","Type":"ContainerDied","Data":"6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d"} Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.998237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7" event={"ID":"4e40287e-d24f-490a-980a-0f82128eb7d2","Type":"ContainerDied","Data":"d741b3d808106aff5b56fc58b5f28690774cfe341b9b305c13eaad2c36f81eb3"} Nov 21 12:59:50 crc kubenswrapper[4769]: I1121 12:59:50.998270 4769 scope.go:117] "RemoveContainer" containerID="6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.002822 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" event={"ID":"6b65b1c4-b942-42e4-b0fd-bcad16c35679","Type":"ContainerDied","Data":"75dd0615f7892b438fc21e4c3008deb04223e68342ac992dc071fd96f6dc4d8d"} Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.002919 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75dd0615f7892b438fc21e4c3008deb04223e68342ac992dc071fd96f6dc4d8d" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.003027 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.042705 4769 scope.go:117] "RemoveContainer" containerID="43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.077332 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7"] Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.090633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-665f4bd6cf-zd4c7"] Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.095085 4769 scope.go:117] "RemoveContainer" containerID="6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d" Nov 21 12:59:51 crc kubenswrapper[4769]: E1121 12:59:51.095737 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d\": container with ID starting with 6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d not found: ID does not exist" containerID="6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.095923 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d"} err="failed to get container status \"6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d\": rpc error: code = NotFound desc = could not find container \"6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d\": container with ID starting with 6a0f3a4a9775dc46f95560bea81dc10520f428ca584f95ff3957f21e36115f4d not found: ID does not exist" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.096216 4769 scope.go:117] "RemoveContainer" containerID="43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2" Nov 21 12:59:51 crc kubenswrapper[4769]: E1121 12:59:51.096806 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2\": container with ID starting with 43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2 not found: ID does not exist" containerID="43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.096871 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2"} err="failed to get container status \"43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2\": rpc error: code = NotFound desc = could not find container \"43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2\": container with ID starting with 43bfefc1c2b50382dfd55b9bf57b7cc579823b8aab32d1c3d40bc5b5068cfeb2 not found: ID does not exist" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.290616 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" path="/var/lib/kubelet/pods/4e40287e-d24f-490a-980a-0f82128eb7d2/volumes" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.389131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.389174 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.952028 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.952115 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.952144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:51 crc kubenswrapper[4769]: I1121 12:59:51.953240 4769 scope.go:117] "RemoveContainer" containerID="280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c" Nov 21 12:59:51 crc kubenswrapper[4769]: E1121 12:59:51.953972 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(8334f117-6214-484d-b055-c14c4ad418fd)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8334f117-6214-484d-b055-c14c4ad418fd" Nov 21 12:59:52 crc kubenswrapper[4769]: I1121 12:59:52.021697 4769 scope.go:117] "RemoveContainer" containerID="280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c" Nov 21 12:59:52 crc kubenswrapper[4769]: E1121 12:59:52.022456 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(8334f117-6214-484d-b055-c14c4ad418fd)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8334f117-6214-484d-b055-c14c4ad418fd" Nov 21 12:59:52 crc kubenswrapper[4769]: I1121 12:59:52.045790 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.016109 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.048589 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9f10777-813f-47bb-951d-c78284390239" containerID="1e508ad993b5115412e41bfa11f9901df434ab56ba54cffa656ae4a468fc1e8c" exitCode=0 Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.048656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" event={"ID":"e9f10777-813f-47bb-951d-c78284390239","Type":"ContainerDied","Data":"1e508ad993b5115412e41bfa11f9901df434ab56ba54cffa656ae4a468fc1e8c"} Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.062898 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.112690 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.318576 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.369558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr8wb\" (UniqueName: \"kubernetes.io/projected/e9f10777-813f-47bb-951d-c78284390239-kube-api-access-fr8wb\") pod \"e9f10777-813f-47bb-951d-c78284390239\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.369637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9f10777-813f-47bb-951d-c78284390239-logs\") pod \"e9f10777-813f-47bb-951d-c78284390239\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.369680 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data-custom\") pod \"e9f10777-813f-47bb-951d-c78284390239\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.369772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data\") pod \"e9f10777-813f-47bb-951d-c78284390239\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.369814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-combined-ca-bundle\") pod \"e9f10777-813f-47bb-951d-c78284390239\" (UID: \"e9f10777-813f-47bb-951d-c78284390239\") " Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.401403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9f10777-813f-47bb-951d-c78284390239-logs" (OuterVolumeSpecName: "logs") pod "e9f10777-813f-47bb-951d-c78284390239" (UID: "e9f10777-813f-47bb-951d-c78284390239"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.471573 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e9f10777-813f-47bb-951d-c78284390239-logs\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.640387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e9f10777-813f-47bb-951d-c78284390239" (UID: "e9f10777-813f-47bb-951d-c78284390239"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.640784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9f10777-813f-47bb-951d-c78284390239-kube-api-access-fr8wb" (OuterVolumeSpecName: "kube-api-access-fr8wb") pod "e9f10777-813f-47bb-951d-c78284390239" (UID: "e9f10777-813f-47bb-951d-c78284390239"). InnerVolumeSpecName "kube-api-access-fr8wb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.648561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e9f10777-813f-47bb-951d-c78284390239" (UID: "e9f10777-813f-47bb-951d-c78284390239"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.674685 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.674735 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fr8wb\" (UniqueName: \"kubernetes.io/projected/e9f10777-813f-47bb-951d-c78284390239-kube-api-access-fr8wb\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.674758 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.675966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data" (OuterVolumeSpecName: "config-data") pod "e9f10777-813f-47bb-951d-c78284390239" (UID: "e9f10777-813f-47bb-951d-c78284390239"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:53 crc kubenswrapper[4769]: I1121 12:59:53.777421 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e9f10777-813f-47bb-951d-c78284390239-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.068723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" event={"ID":"e9f10777-813f-47bb-951d-c78284390239","Type":"ContainerDied","Data":"5554db9172d9b99fe4f9c347602089211c503cf5287fb1877ed7fa51dc736876"} Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.068768 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm" Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.069145 4769 scope.go:117] "RemoveContainer" containerID="1e508ad993b5115412e41bfa11f9901df434ab56ba54cffa656ae4a468fc1e8c" Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.122330 4769 scope.go:117] "RemoveContainer" containerID="eacab1816caa9472de1b1ff2272a52617b31c3ed7a01468b68054c598fa0b900" Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.173319 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm"] Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.188267 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c5997bc98-qtzqm"] Nov 21 12:59:54 crc kubenswrapper[4769]: I1121 12:59:54.258838 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 12:59:55 crc kubenswrapper[4769]: I1121 12:59:55.294576 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9f10777-813f-47bb-951d-c78284390239" path="/var/lib/kubelet/pods/e9f10777-813f-47bb-951d-c78284390239/volumes" Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.019455 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.103875 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-bfffc88b6-kqz6h"] Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.104097 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-api" containerID="cri-o://3961233e5077e340a7507fc024283b37b1a598f4d7445ba78b61388af803bd95" gracePeriod=30 Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.104224 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-httpd" containerID="cri-o://f2c496750b2defb80faafb4859f48f358acb5a87e3f40783a37864cc3543ae9a" gracePeriod=30 Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.389074 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.389351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.450094 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:56 crc kubenswrapper[4769]: I1121 12:59:56.450131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.103711 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.111580 4769 generic.go:334] "Generic (PLEG): container finished" podID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerID="f2c496750b2defb80faafb4859f48f358acb5a87e3f40783a37864cc3543ae9a" exitCode=0 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.111624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" event={"ID":"0156a1b9-6b80-4297-8d9e-d65152984ecf","Type":"ContainerDied","Data":"f2c496750b2defb80faafb4859f48f358acb5a87e3f40783a37864cc3543ae9a"} Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.193531 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.303454 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7884675778-6tm7r"] Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.303686 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-log" containerID="cri-o://7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c" gracePeriod=30 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.304003 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-api" containerID="cri-o://7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8" gracePeriod=30 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.415587 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.167:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.415902 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.167:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.468321 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.168:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.468579 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.168:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.572385 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.781916 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc"] Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.789948 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-brbjc"] Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.824223 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.824562 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-log" containerID="cri-o://d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956" gracePeriod=30 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.824702 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-api" containerID="cri-o://ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71" gracePeriod=30 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.832823 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.858775 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.858986 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-log" containerID="cri-o://9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6" gracePeriod=30 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.859394 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-metadata" containerID="cri-o://451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c" gracePeriod=30 Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.998786 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv"] Nov 21 12:59:57 crc kubenswrapper[4769]: E1121 12:59:57.999258 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener-log" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999275 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener-log" Nov 21 12:59:57 crc kubenswrapper[4769]: E1121 12:59:57.999292 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker-log" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999299 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker-log" Nov 21 12:59:57 crc kubenswrapper[4769]: E1121 12:59:57.999326 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999332 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker" Nov 21 12:59:57 crc kubenswrapper[4769]: E1121 12:59:57.999342 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999348 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener" Nov 21 12:59:57 crc kubenswrapper[4769]: E1121 12:59:57.999373 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b65b1c4-b942-42e4-b0fd-bcad16c35679" containerName="nova-manage" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b65b1c4-b942-42e4-b0fd-bcad16c35679" containerName="nova-manage" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999584 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker-log" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999606 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999613 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e40287e-d24f-490a-980a-0f82128eb7d2" containerName="barbican-worker" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999624 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9f10777-813f-47bb-951d-c78284390239" containerName="barbican-keystone-listener-log" Nov 21 12:59:57 crc kubenswrapper[4769]: I1121 12:59:57.999641 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b65b1c4-b942-42e4-b0fd-bcad16c35679" containerName="nova-manage" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.000306 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.006471 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.006772 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.007747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv"] Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.125710 4769 generic.go:334] "Generic (PLEG): container finished" podID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerID="7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c" exitCode=143 Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.125777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" event={"ID":"e313d2d2-cd28-431b-9811-836f1fbf6366","Type":"ContainerDied","Data":"7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c"} Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.127811 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerID="9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6" exitCode=143 Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.127860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9a1db91-dfee-4a30-a948-9b98f0866e95","Type":"ContainerDied","Data":"9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6"} Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.129434 4769 generic.go:334] "Generic (PLEG): container finished" podID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerID="d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956" exitCode=143 Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.130264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7de24140-f0ff-4e17-b5cc-f91f617c8a33","Type":"ContainerDied","Data":"d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956"} Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.176060 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndvk5\" (UniqueName: \"kubernetes.io/projected/49e7cc24-75ec-4591-97d7-e9af865edc01-kube-api-access-ndvk5\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.176137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-config-data\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.176180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.176217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-scripts\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.277781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ndvk5\" (UniqueName: \"kubernetes.io/projected/49e7cc24-75ec-4591-97d7-e9af865edc01-kube-api-access-ndvk5\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.277891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-config-data\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.277920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.277942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-scripts\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.288003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-config-data\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.288480 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-scripts\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.290148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.296614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndvk5\" (UniqueName: \"kubernetes.io/projected/49e7cc24-75ec-4591-97d7-e9af865edc01-kube-api-access-ndvk5\") pod \"nova-cell1-cell-mapping-lgrxv\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.300367 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.374751 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.382265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-combined-ca-bundle\") pod \"8334f117-6214-484d-b055-c14c4ad418fd\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.382491 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6xhb\" (UniqueName: \"kubernetes.io/projected/8334f117-6214-484d-b055-c14c4ad418fd-kube-api-access-t6xhb\") pod \"8334f117-6214-484d-b055-c14c4ad418fd\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.382747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-config-data\") pod \"8334f117-6214-484d-b055-c14c4ad418fd\" (UID: \"8334f117-6214-484d-b055-c14c4ad418fd\") " Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.388342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8334f117-6214-484d-b055-c14c4ad418fd-kube-api-access-t6xhb" (OuterVolumeSpecName: "kube-api-access-t6xhb") pod "8334f117-6214-484d-b055-c14c4ad418fd" (UID: "8334f117-6214-484d-b055-c14c4ad418fd"). InnerVolumeSpecName "kube-api-access-t6xhb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.392433 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t6xhb\" (UniqueName: \"kubernetes.io/projected/8334f117-6214-484d-b055-c14c4ad418fd-kube-api-access-t6xhb\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.424648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-config-data" (OuterVolumeSpecName: "config-data") pod "8334f117-6214-484d-b055-c14c4ad418fd" (UID: "8334f117-6214-484d-b055-c14c4ad418fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.454295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8334f117-6214-484d-b055-c14c4ad418fd" (UID: "8334f117-6214-484d-b055-c14c4ad418fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.498629 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.498726 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8334f117-6214-484d-b055-c14c4ad418fd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.632808 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 12:59:58 crc kubenswrapper[4769]: I1121 12:59:58.853299 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv"] Nov 21 12:59:58 crc kubenswrapper[4769]: W1121 12:59:58.879752 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49e7cc24_75ec_4591_97d7_e9af865edc01.slice/crio-ab0ed3fb93b54ff5643f89c8632679f8f831b77e36d17b3f7d721c50fc9c81e1 WatchSource:0}: Error finding container ab0ed3fb93b54ff5643f89c8632679f8f831b77e36d17b3f7d721c50fc9c81e1: Status 404 returned error can't find the container with id ab0ed3fb93b54ff5643f89c8632679f8f831b77e36d17b3f7d721c50fc9c81e1 Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.140862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8334f117-6214-484d-b055-c14c4ad418fd","Type":"ContainerDied","Data":"d6679dab0badef235977803381b5ae5b6a505ef93af54d4d153a3e0feb8c783f"} Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.141172 4769 scope.go:117] "RemoveContainer" containerID="280ece798b7d1d9cde4026c664f5e528d1dd84a5f42bb12d23c129840c81160c" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.140969 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.142690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" event={"ID":"49e7cc24-75ec-4591-97d7-e9af865edc01","Type":"ContainerStarted","Data":"ab0ed3fb93b54ff5643f89c8632679f8f831b77e36d17b3f7d721c50fc9c81e1"} Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.197719 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.209221 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.248626 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:59 crc kubenswrapper[4769]: E1121 12:59:59.249052 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8334f117-6214-484d-b055-c14c4ad418fd" containerName="nova-scheduler-scheduler" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.249068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8334f117-6214-484d-b055-c14c4ad418fd" containerName="nova-scheduler-scheduler" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.249284 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8334f117-6214-484d-b055-c14c4ad418fd" containerName="nova-scheduler-scheduler" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.249304 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8334f117-6214-484d-b055-c14c4ad418fd" containerName="nova-scheduler-scheduler" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.249961 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.256628 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.262635 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.288697 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55145a65-9d78-41d7-a8eb-74bf51851190" path="/var/lib/kubelet/pods/55145a65-9d78-41d7-a8eb-74bf51851190/volumes" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.289220 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8334f117-6214-484d-b055-c14c4ad418fd" path="/var/lib/kubelet/pods/8334f117-6214-484d-b055-c14c4ad418fd/volumes" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.417920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2h4\" (UniqueName: \"kubernetes.io/projected/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-kube-api-access-jz2h4\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.418386 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-config-data\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.418488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.520220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-config-data\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.520480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.520592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2h4\" (UniqueName: \"kubernetes.io/projected/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-kube-api-access-jz2h4\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.526017 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-config-data\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.526057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.540005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2h4\" (UniqueName: \"kubernetes.io/projected/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-kube-api-access-jz2h4\") pod \"nova-scheduler-0\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 12:59:59 crc kubenswrapper[4769]: I1121 12:59:59.581614 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.027063 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:00 crc kubenswrapper[4769]: W1121 13:00:00.032843 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4393b133_167b_4e5a_b5d5_fbd2fc8233f1.slice/crio-dde1f4b4dc0bef58dfcfa69a20d53536d99d52440d630034fbb518e820cbea94 WatchSource:0}: Error finding container dde1f4b4dc0bef58dfcfa69a20d53536d99d52440d630034fbb518e820cbea94: Status 404 returned error can't find the container with id dde1f4b4dc0bef58dfcfa69a20d53536d99d52440d630034fbb518e820cbea94 Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.154279 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697"] Nov 21 13:00:00 crc kubenswrapper[4769]: E1121 13:00:00.158395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8334f117-6214-484d-b055-c14c4ad418fd" containerName="nova-scheduler-scheduler" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.158414 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8334f117-6214-484d-b055-c14c4ad418fd" containerName="nova-scheduler-scheduler" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.160454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.165496 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.165717 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.181982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697"] Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.194975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" event={"ID":"49e7cc24-75ec-4591-97d7-e9af865edc01","Type":"ContainerStarted","Data":"5b248861d8dc1ceff01552d436e92eca2c6cd665662bced4f2680a10022fae09"} Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.198162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4393b133-167b-4e5a-b5d5-fbd2fc8233f1","Type":"ContainerStarted","Data":"dde1f4b4dc0bef58dfcfa69a20d53536d99d52440d630034fbb518e820cbea94"} Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.201476 4769 generic.go:334] "Generic (PLEG): container finished" podID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerID="3961233e5077e340a7507fc024283b37b1a598f4d7445ba78b61388af803bd95" exitCode=0 Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.201514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" event={"ID":"0156a1b9-6b80-4297-8d9e-d65152984ecf","Type":"ContainerDied","Data":"3961233e5077e340a7507fc024283b37b1a598f4d7445ba78b61388af803bd95"} Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.217531 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" podStartSLOduration=3.217489446 podStartE2EDuration="3.217489446s" podCreationTimestamp="2025-11-21 12:59:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:00.212135592 +0000 UTC m=+4158.912797410" watchObservedRunningTime="2025-11-21 13:00:00.217489446 +0000 UTC m=+4158.918151264" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.278403 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.337711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2674ce4f-ef2f-45b7-8b99-3d16811f726e-config-volume\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.337770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/2674ce4f-ef2f-45b7-8b99-3d16811f726e-secret-volume\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.337908 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdwl\" (UniqueName: \"kubernetes.io/projected/2674ce4f-ef2f-45b7-8b99-3d16811f726e-kube-api-access-xtdwl\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.439962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-httpd-config\") pod \"0156a1b9-6b80-4297-8d9e-d65152984ecf\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.440082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-config\") pod \"0156a1b9-6b80-4297-8d9e-d65152984ecf\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.440123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42n9s\" (UniqueName: \"kubernetes.io/projected/0156a1b9-6b80-4297-8d9e-d65152984ecf-kube-api-access-42n9s\") pod \"0156a1b9-6b80-4297-8d9e-d65152984ecf\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.440278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-combined-ca-bundle\") pod \"0156a1b9-6b80-4297-8d9e-d65152984ecf\" (UID: \"0156a1b9-6b80-4297-8d9e-d65152984ecf\") " Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.440603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/2674ce4f-ef2f-45b7-8b99-3d16811f726e-secret-volume\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.440863 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdwl\" (UniqueName: \"kubernetes.io/projected/2674ce4f-ef2f-45b7-8b99-3d16811f726e-kube-api-access-xtdwl\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.441215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2674ce4f-ef2f-45b7-8b99-3d16811f726e-config-volume\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.442016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2674ce4f-ef2f-45b7-8b99-3d16811f726e-config-volume\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.444410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/2674ce4f-ef2f-45b7-8b99-3d16811f726e-secret-volume\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.445134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0156a1b9-6b80-4297-8d9e-d65152984ecf-kube-api-access-42n9s" (OuterVolumeSpecName: "kube-api-access-42n9s") pod "0156a1b9-6b80-4297-8d9e-d65152984ecf" (UID: "0156a1b9-6b80-4297-8d9e-d65152984ecf"). InnerVolumeSpecName "kube-api-access-42n9s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.446837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "0156a1b9-6b80-4297-8d9e-d65152984ecf" (UID: "0156a1b9-6b80-4297-8d9e-d65152984ecf"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.460126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdwl\" (UniqueName: \"kubernetes.io/projected/2674ce4f-ef2f-45b7-8b99-3d16811f726e-kube-api-access-xtdwl\") pod \"collect-profiles-29395500-hp697\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.495939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-config" (OuterVolumeSpecName: "config") pod "0156a1b9-6b80-4297-8d9e-d65152984ecf" (UID: "0156a1b9-6b80-4297-8d9e-d65152984ecf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.528819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0156a1b9-6b80-4297-8d9e-d65152984ecf" (UID: "0156a1b9-6b80-4297-8d9e-d65152984ecf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.529177 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.539398 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.539964 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="51ac2346-14cd-4422-b90e-ac25515d74c2" containerName="kube-state-metrics" containerID="cri-o://023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79" gracePeriod=30 Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.542876 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.542895 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.542906 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-42n9s\" (UniqueName: \"kubernetes.io/projected/0156a1b9-6b80-4297-8d9e-d65152984ecf-kube-api-access-42n9s\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.542916 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0156a1b9-6b80-4297-8d9e-d65152984ecf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.603985 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.604222 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-central-agent" containerID="cri-o://8c4738c53a865331578fe8f6d3a8b21985e427be9a00757ea5624feb34316755" gracePeriod=30 Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.604612 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="proxy-httpd" containerID="cri-o://b8b2ca3240f8f7e7551606fddda9d98f39ccb3b0a93256814513d65e302ae85e" gracePeriod=30 Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.604665 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="sg-core" containerID="cri-o://451106a7954c4b42f51f972ee9c3a54f69a0103163fd7fcd9af5e4d4f8db139f" gracePeriod=30 Nov 21 13:00:00 crc kubenswrapper[4769]: I1121 13:00:00.604697 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-notification-agent" containerID="cri-o://c5330bf85a3fafb45998e6bad561c4f632928d087d74aeca6c3b2df40473c484" gracePeriod=30 Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.007267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.095025 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.156565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4mhb\" (UniqueName: \"kubernetes.io/projected/51ac2346-14cd-4422-b90e-ac25515d74c2-kube-api-access-d4mhb\") pod \"51ac2346-14cd-4422-b90e-ac25515d74c2\" (UID: \"51ac2346-14cd-4422-b90e-ac25515d74c2\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.164890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ac2346-14cd-4422-b90e-ac25515d74c2-kube-api-access-d4mhb" (OuterVolumeSpecName: "kube-api-access-d4mhb") pod "51ac2346-14cd-4422-b90e-ac25515d74c2" (UID: "51ac2346-14cd-4422-b90e-ac25515d74c2"). InnerVolumeSpecName "kube-api-access-d4mhb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.182365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.228184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" event={"ID":"0156a1b9-6b80-4297-8d9e-d65152984ecf","Type":"ContainerDied","Data":"4d19ef2f4ec7f1f456c931758e9f2a00d83658bb7afe6eaed591287da7e5b41c"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.228304 4769 scope.go:117] "RemoveContainer" containerID="f2c496750b2defb80faafb4859f48f358acb5a87e3f40783a37864cc3543ae9a" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.228515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfffc88b6-kqz6h" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.231496 4769 generic.go:334] "Generic (PLEG): container finished" podID="51ac2346-14cd-4422-b90e-ac25515d74c2" containerID="023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79" exitCode=2 Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.231575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"51ac2346-14cd-4422-b90e-ac25515d74c2","Type":"ContainerDied","Data":"023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.231602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"51ac2346-14cd-4422-b90e-ac25515d74c2","Type":"ContainerDied","Data":"dc56d267eab991fcb3faaa6d518ac3aacff47f7a9fe9edf63c35c4b335bdaa10"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.233534 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.234696 4769 generic.go:334] "Generic (PLEG): container finished" podID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerID="7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8" exitCode=0 Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.234774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" event={"ID":"e313d2d2-cd28-431b-9811-836f1fbf6366","Type":"ContainerDied","Data":"7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.234805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" event={"ID":"e313d2d2-cd28-431b-9811-836f1fbf6366","Type":"ContainerDied","Data":"8df7ab0ed096615c3a03864eb162ea084fde71c8115d34b5b639a348915032ce"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.234907 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7884675778-6tm7r" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.240384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" event={"ID":"2674ce4f-ef2f-45b7-8b99-3d16811f726e","Type":"ContainerStarted","Data":"602949594af70aff37aa832778c707fad7981bacb947c2d6669a33f9e9729741"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.250958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4393b133-167b-4e5a-b5d5-fbd2fc8233f1","Type":"ContainerStarted","Data":"31cd3945b33f7d5a01059617d47313fc4c46adbe87edb17acd58b87e4eeb57ac"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.256643 4769 generic.go:334] "Generic (PLEG): container finished" podID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerID="b8b2ca3240f8f7e7551606fddda9d98f39ccb3b0a93256814513d65e302ae85e" exitCode=0 Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.256677 4769 generic.go:334] "Generic (PLEG): container finished" podID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerID="451106a7954c4b42f51f972ee9c3a54f69a0103163fd7fcd9af5e4d4f8db139f" exitCode=2 Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.256686 4769 generic.go:334] "Generic (PLEG): container finished" podID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerID="8c4738c53a865331578fe8f6d3a8b21985e427be9a00757ea5624feb34316755" exitCode=0 Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.257164 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerDied","Data":"b8b2ca3240f8f7e7551606fddda9d98f39ccb3b0a93256814513d65e302ae85e"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.257228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerDied","Data":"451106a7954c4b42f51f972ee9c3a54f69a0103163fd7fcd9af5e4d4f8db139f"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.257274 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerDied","Data":"8c4738c53a865331578fe8f6d3a8b21985e427be9a00757ea5624feb34316755"} Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e313d2d2-cd28-431b-9811-836f1fbf6366-logs\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-config-data\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259201 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-internal-tls-certs\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259324 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kcdj\" (UniqueName: \"kubernetes.io/projected/e313d2d2-cd28-431b-9811-836f1fbf6366-kube-api-access-7kcdj\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-combined-ca-bundle\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-public-tls-certs\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.259682 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-scripts\") pod \"e313d2d2-cd28-431b-9811-836f1fbf6366\" (UID: \"e313d2d2-cd28-431b-9811-836f1fbf6366\") " Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.261220 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d4mhb\" (UniqueName: \"kubernetes.io/projected/51ac2346-14cd-4422-b90e-ac25515d74c2-kube-api-access-d4mhb\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.265337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e313d2d2-cd28-431b-9811-836f1fbf6366-logs" (OuterVolumeSpecName: "logs") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.265714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-scripts" (OuterVolumeSpecName: "scripts") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.266855 4769 scope.go:117] "RemoveContainer" containerID="3961233e5077e340a7507fc024283b37b1a598f4d7445ba78b61388af803bd95" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.267122 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e313d2d2-cd28-431b-9811-836f1fbf6366-kube-api-access-7kcdj" (OuterVolumeSpecName: "kube-api-access-7kcdj") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "kube-api-access-7kcdj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.301595 4769 scope.go:117] "RemoveContainer" containerID="023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.330386 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-bfffc88b6-kqz6h"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.330477 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-bfffc88b6-kqz6h"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.331459 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.331442317 podStartE2EDuration="2.331442317s" podCreationTimestamp="2025-11-21 12:59:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:01.276739684 +0000 UTC m=+4159.977401502" watchObservedRunningTime="2025-11-21 13:00:01.331442317 +0000 UTC m=+4160.032104135" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.337959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.360713 4769 scope.go:117] "RemoveContainer" containerID="023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.361655 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79\": container with ID starting with 023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79 not found: ID does not exist" containerID="023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.361768 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79"} err="failed to get container status \"023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79\": rpc error: code = NotFound desc = could not find container \"023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79\": container with ID starting with 023ca75d07494b69f5e8db609d7c49f48f701052f2e3e379c014ea17db64ed79 not found: ID does not exist" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.361801 4769 scope.go:117] "RemoveContainer" containerID="7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.362906 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7kcdj\" (UniqueName: \"kubernetes.io/projected/e313d2d2-cd28-431b-9811-836f1fbf6366-kube-api-access-7kcdj\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.362926 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.362935 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.362943 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e313d2d2-cd28-431b-9811-836f1fbf6366-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.363695 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.374075 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.379447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-config-data" (OuterVolumeSpecName: "config-data") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.385071 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.385650 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51ac2346-14cd-4422-b90e-ac25515d74c2" containerName="kube-state-metrics" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.385678 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ac2346-14cd-4422-b90e-ac25515d74c2" containerName="kube-state-metrics" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.385701 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-api" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.385709 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-api" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.385723 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-httpd" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.385732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-httpd" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.385755 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-log" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.385765 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-log" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.385786 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-api" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.387629 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-api" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.387918 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-log" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.387956 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" containerName="placement-api" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.387986 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51ac2346-14cd-4422-b90e-ac25515d74c2" containerName="kube-state-metrics" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.388001 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-httpd" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.388015 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" containerName="neutron-api" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.388855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.390971 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.391789 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.392757 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.409387 4769 scope.go:117] "RemoveContainer" containerID="7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.410299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.421687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e313d2d2-cd28-431b-9811-836f1fbf6366" (UID: "e313d2d2-cd28-431b-9811-836f1fbf6366"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.464856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.464919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.465051 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.465163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzth6\" (UniqueName: \"kubernetes.io/projected/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-api-access-xzth6\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.465466 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.465482 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.465495 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e313d2d2-cd28-431b-9811-836f1fbf6366-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.561645 4769 scope.go:117] "RemoveContainer" containerID="7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.564863 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8\": container with ID starting with 7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8 not found: ID does not exist" containerID="7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.564897 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8"} err="failed to get container status \"7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8\": rpc error: code = NotFound desc = could not find container \"7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8\": container with ID starting with 7f69bf0bae1d1407404a760f8270af93e7f027cb926b4be6e3e26ba1196a47f8 not found: ID does not exist" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.564920 4769 scope.go:117] "RemoveContainer" containerID="7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c" Nov 21 13:00:01 crc kubenswrapper[4769]: E1121 13:00:01.565167 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c\": container with ID starting with 7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c not found: ID does not exist" containerID="7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.565183 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c"} err="failed to get container status \"7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c\": rpc error: code = NotFound desc = could not find container \"7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c\": container with ID starting with 7cc3f7fc34649c660d862de26211ef31f5c0b19b128ae37aa6be5b331e27009c not found: ID does not exist" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.566620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.566651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.566685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.566718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xzth6\" (UniqueName: \"kubernetes.io/projected/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-api-access-xzth6\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.570268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.571580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.572130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.586662 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7884675778-6tm7r"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.589304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzth6\" (UniqueName: \"kubernetes.io/projected/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-api-access-xzth6\") pod \"kube-state-metrics-0\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.593982 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7884675778-6tm7r"] Nov 21 13:00:01 crc kubenswrapper[4769]: I1121 13:00:01.712357 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:02 crc kubenswrapper[4769]: I1121 13:00:02.202313 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:00:02 crc kubenswrapper[4769]: I1121 13:00:02.276148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"25f25039-7e44-4cc7-ad8c-71b8fcca9754","Type":"ContainerStarted","Data":"74b811ad5ffeebe2e1a3c97c0f33b50905755e57c28709670195598fdff5a36c"} Nov 21 13:00:02 crc kubenswrapper[4769]: I1121 13:00:02.279386 4769 generic.go:334] "Generic (PLEG): container finished" podID="2674ce4f-ef2f-45b7-8b99-3d16811f726e" containerID="b9292bb49fd9a196c9162d9187172c396d9b9bc2e5501ed3a34901f217f5ca84" exitCode=0 Nov 21 13:00:02 crc kubenswrapper[4769]: I1121 13:00:02.279514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" event={"ID":"2674ce4f-ef2f-45b7-8b99-3d16811f726e","Type":"ContainerDied","Data":"b9292bb49fd9a196c9162d9187172c396d9b9bc2e5501ed3a34901f217f5ca84"} Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.355151 4769 generic.go:334] "Generic (PLEG): container finished" podID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerID="31cd3945b33f7d5a01059617d47313fc4c46adbe87edb17acd58b87e4eeb57ac" exitCode=1 Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.374083 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0156a1b9-6b80-4297-8d9e-d65152984ecf" path="/var/lib/kubelet/pods/0156a1b9-6b80-4297-8d9e-d65152984ecf/volumes" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.382252 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ac2346-14cd-4422-b90e-ac25515d74c2" path="/var/lib/kubelet/pods/51ac2346-14cd-4422-b90e-ac25515d74c2/volumes" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.384981 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e313d2d2-cd28-431b-9811-836f1fbf6366" path="/var/lib/kubelet/pods/e313d2d2-cd28-431b-9811-836f1fbf6366/volumes" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.385804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4393b133-167b-4e5a-b5d5-fbd2fc8233f1","Type":"ContainerDied","Data":"31cd3945b33f7d5a01059617d47313fc4c46adbe87edb17acd58b87e4eeb57ac"} Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.385858 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.385880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"25f25039-7e44-4cc7-ad8c-71b8fcca9754","Type":"ContainerStarted","Data":"70daa102a861275c35f930b6033259033eba08c1da7955b936329103d21f485e"} Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.386495 4769 scope.go:117] "RemoveContainer" containerID="31cd3945b33f7d5a01059617d47313fc4c46adbe87edb17acd58b87e4eeb57ac" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.407077 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.009688607 podStartE2EDuration="2.407059369s" podCreationTimestamp="2025-11-21 13:00:01 +0000 UTC" firstStartedPulling="2025-11-21 13:00:02.215944489 +0000 UTC m=+4160.916606307" lastFinishedPulling="2025-11-21 13:00:02.613315251 +0000 UTC m=+4161.313977069" observedRunningTime="2025-11-21 13:00:03.403529474 +0000 UTC m=+4162.104191302" watchObservedRunningTime="2025-11-21 13:00:03.407059369 +0000 UTC m=+4162.107721187" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.920728 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.930327 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:03 crc kubenswrapper[4769]: I1121 13:00:03.934364 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/2674ce4f-ef2f-45b7-8b99-3d16811f726e-secret-volume\") pod \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-combined-ca-bundle\") pod \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-internal-tls-certs\") pod \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtdwl\" (UniqueName: \"kubernetes.io/projected/2674ce4f-ef2f-45b7-8b99-3d16811f726e-kube-api-access-xtdwl\") pod \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-config-data\") pod \"d9a1db91-dfee-4a30-a948-9b98f0866e95\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-config-data\") pod \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9a1db91-dfee-4a30-a948-9b98f0866e95-logs\") pod \"d9a1db91-dfee-4a30-a948-9b98f0866e95\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2674ce4f-ef2f-45b7-8b99-3d16811f726e-config-volume\") pod \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\" (UID: \"2674ce4f-ef2f-45b7-8b99-3d16811f726e\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-combined-ca-bundle\") pod \"d9a1db91-dfee-4a30-a948-9b98f0866e95\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-nova-metadata-tls-certs\") pod \"d9a1db91-dfee-4a30-a948-9b98f0866e95\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-public-tls-certs\") pod \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7de24140-f0ff-4e17-b5cc-f91f617c8a33-logs\") pod \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzr7n\" (UniqueName: \"kubernetes.io/projected/d9a1db91-dfee-4a30-a948-9b98f0866e95-kube-api-access-gzr7n\") pod \"d9a1db91-dfee-4a30-a948-9b98f0866e95\" (UID: \"d9a1db91-dfee-4a30-a948-9b98f0866e95\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.052733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfn7m\" (UniqueName: \"kubernetes.io/projected/7de24140-f0ff-4e17-b5cc-f91f617c8a33-kube-api-access-bfn7m\") pod \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\" (UID: \"7de24140-f0ff-4e17-b5cc-f91f617c8a33\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.054127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a1db91-dfee-4a30-a948-9b98f0866e95-logs" (OuterVolumeSpecName: "logs") pod "d9a1db91-dfee-4a30-a948-9b98f0866e95" (UID: "d9a1db91-dfee-4a30-a948-9b98f0866e95"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.054724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2674ce4f-ef2f-45b7-8b99-3d16811f726e-config-volume" (OuterVolumeSpecName: "config-volume") pod "2674ce4f-ef2f-45b7-8b99-3d16811f726e" (UID: "2674ce4f-ef2f-45b7-8b99-3d16811f726e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.055013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de24140-f0ff-4e17-b5cc-f91f617c8a33-logs" (OuterVolumeSpecName: "logs") pod "7de24140-f0ff-4e17-b5cc-f91f617c8a33" (UID: "7de24140-f0ff-4e17-b5cc-f91f617c8a33"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.062947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a1db91-dfee-4a30-a948-9b98f0866e95-kube-api-access-gzr7n" (OuterVolumeSpecName: "kube-api-access-gzr7n") pod "d9a1db91-dfee-4a30-a948-9b98f0866e95" (UID: "d9a1db91-dfee-4a30-a948-9b98f0866e95"). InnerVolumeSpecName "kube-api-access-gzr7n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.066386 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2674ce4f-ef2f-45b7-8b99-3d16811f726e-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "2674ce4f-ef2f-45b7-8b99-3d16811f726e" (UID: "2674ce4f-ef2f-45b7-8b99-3d16811f726e"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.066497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de24140-f0ff-4e17-b5cc-f91f617c8a33-kube-api-access-bfn7m" (OuterVolumeSpecName: "kube-api-access-bfn7m") pod "7de24140-f0ff-4e17-b5cc-f91f617c8a33" (UID: "7de24140-f0ff-4e17-b5cc-f91f617c8a33"). InnerVolumeSpecName "kube-api-access-bfn7m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.066648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2674ce4f-ef2f-45b7-8b99-3d16811f726e-kube-api-access-xtdwl" (OuterVolumeSpecName: "kube-api-access-xtdwl") pod "2674ce4f-ef2f-45b7-8b99-3d16811f726e" (UID: "2674ce4f-ef2f-45b7-8b99-3d16811f726e"). InnerVolumeSpecName "kube-api-access-xtdwl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.081026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-config-data" (OuterVolumeSpecName: "config-data") pod "d9a1db91-dfee-4a30-a948-9b98f0866e95" (UID: "d9a1db91-dfee-4a30-a948-9b98f0866e95"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.087507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-config-data" (OuterVolumeSpecName: "config-data") pod "7de24140-f0ff-4e17-b5cc-f91f617c8a33" (UID: "7de24140-f0ff-4e17-b5cc-f91f617c8a33"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.090295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d9a1db91-dfee-4a30-a948-9b98f0866e95" (UID: "d9a1db91-dfee-4a30-a948-9b98f0866e95"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.102044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7de24140-f0ff-4e17-b5cc-f91f617c8a33" (UID: "7de24140-f0ff-4e17-b5cc-f91f617c8a33"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.124883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7de24140-f0ff-4e17-b5cc-f91f617c8a33" (UID: "7de24140-f0ff-4e17-b5cc-f91f617c8a33"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.132279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7de24140-f0ff-4e17-b5cc-f91f617c8a33" (UID: "7de24140-f0ff-4e17-b5cc-f91f617c8a33"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.146521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d9a1db91-dfee-4a30-a948-9b98f0866e95" (UID: "d9a1db91-dfee-4a30-a948-9b98f0866e95"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154426 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154464 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7de24140-f0ff-4e17-b5cc-f91f617c8a33-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154482 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gzr7n\" (UniqueName: \"kubernetes.io/projected/d9a1db91-dfee-4a30-a948-9b98f0866e95-kube-api-access-gzr7n\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154499 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bfn7m\" (UniqueName: \"kubernetes.io/projected/7de24140-f0ff-4e17-b5cc-f91f617c8a33-kube-api-access-bfn7m\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154512 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/2674ce4f-ef2f-45b7-8b99-3d16811f726e-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154523 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154593 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154612 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xtdwl\" (UniqueName: \"kubernetes.io/projected/2674ce4f-ef2f-45b7-8b99-3d16811f726e-kube-api-access-xtdwl\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154652 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154665 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7de24140-f0ff-4e17-b5cc-f91f617c8a33-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154676 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9a1db91-dfee-4a30-a948-9b98f0866e95-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154717 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2674ce4f-ef2f-45b7-8b99-3d16811f726e-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154730 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.154741 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9a1db91-dfee-4a30-a948-9b98f0866e95-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.446122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4393b133-167b-4e5a-b5d5-fbd2fc8233f1","Type":"ContainerStarted","Data":"7589f4af917aa81fef3b34260f8a63301abe18e29717f76311008fc3ebe60b75"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.456715 4769 generic.go:334] "Generic (PLEG): container finished" podID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerID="c5330bf85a3fafb45998e6bad561c4f632928d087d74aeca6c3b2df40473c484" exitCode=0 Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.457511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerDied","Data":"c5330bf85a3fafb45998e6bad561c4f632928d087d74aeca6c3b2df40473c484"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.464326 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerID="451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c" exitCode=0 Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.464432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9a1db91-dfee-4a30-a948-9b98f0866e95","Type":"ContainerDied","Data":"451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.464474 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9a1db91-dfee-4a30-a948-9b98f0866e95","Type":"ContainerDied","Data":"06976c10939ea5a0da8e41e1ac70fc43ed5b1056194d870912f826f8232df6a0"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.464502 4769 scope.go:117] "RemoveContainer" containerID="451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.465237 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.499431 4769 generic.go:334] "Generic (PLEG): container finished" podID="49e7cc24-75ec-4591-97d7-e9af865edc01" containerID="5b248861d8dc1ceff01552d436e92eca2c6cd665662bced4f2680a10022fae09" exitCode=0 Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.499576 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" event={"ID":"49e7cc24-75ec-4591-97d7-e9af865edc01","Type":"ContainerDied","Data":"5b248861d8dc1ceff01552d436e92eca2c6cd665662bced4f2680a10022fae09"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.507084 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.505888 4769 generic.go:334] "Generic (PLEG): container finished" podID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerID="ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71" exitCode=0 Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.511093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7de24140-f0ff-4e17-b5cc-f91f617c8a33","Type":"ContainerDied","Data":"ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.511147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7de24140-f0ff-4e17-b5cc-f91f617c8a33","Type":"ContainerDied","Data":"d2addb9350bcf2af614889f85aed96611ed409d8dee35e785dbe15e2ebd72b82"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.529499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.529552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697" event={"ID":"2674ce4f-ef2f-45b7-8b99-3d16811f726e","Type":"ContainerDied","Data":"602949594af70aff37aa832778c707fad7981bacb947c2d6669a33f9e9729741"} Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.529583 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="602949594af70aff37aa832778c707fad7981bacb947c2d6669a33f9e9729741" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.568327 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.579735 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.591069 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.591270 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.594556 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.608394 4769 scope.go:117] "RemoveContainer" containerID="9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.635920 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.642117 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-log" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-log" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.642255 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-log" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642275 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-log" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.642303 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-metadata" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642312 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-metadata" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.642329 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2674ce4f-ef2f-45b7-8b99-3d16811f726e" containerName="collect-profiles" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642338 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2674ce4f-ef2f-45b7-8b99-3d16811f726e" containerName="collect-profiles" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.642353 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-api" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642365 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-api" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642777 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-metadata" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642817 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-log" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642835 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" containerName="nova-metadata-log" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642844 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" containerName="nova-api-api" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.642853 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2674ce4f-ef2f-45b7-8b99-3d16811f726e" containerName="collect-profiles" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.649231 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.659954 4769 scope.go:117] "RemoveContainer" containerID="451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.659993 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.660095 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.662302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.665093 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.665337 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c\": container with ID starting with 451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c not found: ID does not exist" containerID="451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.666849 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c"} err="failed to get container status \"451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c\": rpc error: code = NotFound desc = could not find container \"451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c\": container with ID starting with 451dab27565e8cafcabaadbd46c00a0aefc2c373180a82198752f15ee08b3c2c not found: ID does not exist" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.666896 4769 scope.go:117] "RemoveContainer" containerID="9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.667565 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6\": container with ID starting with 9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6 not found: ID does not exist" containerID="9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.667609 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6"} err="failed to get container status \"9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6\": rpc error: code = NotFound desc = could not find container \"9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6\": container with ID starting with 9cf33bf774529c2c0978523ed9dfe4efe7a2efe52ef9efb2b65ff5d009465ac6 not found: ID does not exist" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.667638 4769 scope.go:117] "RemoveContainer" containerID="ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.667946 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.668314 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.670546 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.670923 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.693333 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.772613 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.778638 4769 scope.go:117] "RemoveContainer" containerID="d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.779769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.779824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.779930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-config-data\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.779991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klc9b\" (UniqueName: \"kubernetes.io/projected/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-kube-api-access-klc9b\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780029 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-internal-tls-certs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgpzb\" (UniqueName: \"kubernetes.io/projected/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-kube-api-access-lgpzb\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-logs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-logs\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-config-data\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.780357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-public-tls-certs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.798120 4769 scope.go:117] "RemoveContainer" containerID="ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.798624 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71\": container with ID starting with ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71 not found: ID does not exist" containerID="ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.798672 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71"} err="failed to get container status \"ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71\": rpc error: code = NotFound desc = could not find container \"ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71\": container with ID starting with ffb2722d9febb0c7d6f712789f448565db75a822683e935f7f714ddf67da2d71 not found: ID does not exist" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.798705 4769 scope.go:117] "RemoveContainer" containerID="d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956" Nov 21 13:00:04 crc kubenswrapper[4769]: E1121 13:00:04.799135 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956\": container with ID starting with d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956 not found: ID does not exist" containerID="d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.799223 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956"} err="failed to get container status \"d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956\": rpc error: code = NotFound desc = could not find container \"d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956\": container with ID starting with d43d95fec3efe27256f392017be9c14957105ec837ed4176743930becc486956 not found: ID does not exist" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-scripts\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-config-data\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-combined-ca-bundle\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881203 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-sg-core-conf-yaml\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-log-httpd\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881290 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-run-httpd\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l65k\" (UniqueName: \"kubernetes.io/projected/9cc134fb-086d-4593-a7e0-2a14633735ae-kube-api-access-5l65k\") pod \"9cc134fb-086d-4593-a7e0-2a14633735ae\" (UID: \"9cc134fb-086d-4593-a7e0-2a14633735ae\") " Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-logs\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-config-data\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-public-tls-certs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881770 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-config-data\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-klc9b\" (UniqueName: \"kubernetes.io/projected/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-kube-api-access-klc9b\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-internal-tls-certs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lgpzb\" (UniqueName: \"kubernetes.io/projected/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-kube-api-access-lgpzb\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.881906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-logs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.882105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.882306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-logs\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.882339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.882317 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-logs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.887401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-scripts" (OuterVolumeSpecName: "scripts") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.887708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-internal-tls-certs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.889006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc134fb-086d-4593-a7e0-2a14633735ae-kube-api-access-5l65k" (OuterVolumeSpecName: "kube-api-access-5l65k") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "kube-api-access-5l65k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.889433 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.889566 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.890093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.898475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-config-data\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.901603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-public-tls-certs\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.911609 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-config-data\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.911755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-klc9b\" (UniqueName: \"kubernetes.io/projected/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-kube-api-access-klc9b\") pod \"nova-api-0\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.913357 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgpzb\" (UniqueName: \"kubernetes.io/projected/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-kube-api-access-lgpzb\") pod \"nova-metadata-0\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.931040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.984392 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.984447 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5l65k\" (UniqueName: \"kubernetes.io/projected/9cc134fb-086d-4593-a7e0-2a14633735ae-kube-api-access-5l65k\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.985019 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.985041 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.985050 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/9cc134fb-086d-4593-a7e0-2a14633735ae-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:04 crc kubenswrapper[4769]: I1121 13:00:04.996289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.016645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.023944 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395455-x4597"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.032658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-config-data" (OuterVolumeSpecName: "config-data") pod "9cc134fb-086d-4593-a7e0-2a14633735ae" (UID: "9cc134fb-086d-4593-a7e0-2a14633735ae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.061540 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.069076 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.086762 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.086792 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9cc134fb-086d-4593-a7e0-2a14633735ae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.289034 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b124023-c81d-4e7e-a144-50f4fb1d1d67" path="/var/lib/kubelet/pods/1b124023-c81d-4e7e-a144-50f4fb1d1d67/volumes" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.290051 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de24140-f0ff-4e17-b5cc-f91f617c8a33" path="/var/lib/kubelet/pods/7de24140-f0ff-4e17-b5cc-f91f617c8a33/volumes" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.290959 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9a1db91-dfee-4a30-a948-9b98f0866e95" path="/var/lib/kubelet/pods/d9a1db91-dfee-4a30-a948-9b98f0866e95/volumes" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.545444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"9cc134fb-086d-4593-a7e0-2a14633735ae","Type":"ContainerDied","Data":"51efc6c9f85adae3966fc67f73196cb4ce1d9b8c973068b4f846b7e1218d2854"} Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.545876 4769 scope.go:117] "RemoveContainer" containerID="b8b2ca3240f8f7e7551606fddda9d98f39ccb3b0a93256814513d65e302ae85e" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.546061 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.572381 4769 scope.go:117] "RemoveContainer" containerID="451106a7954c4b42f51f972ee9c3a54f69a0103163fd7fcd9af5e4d4f8db139f" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.578057 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.601394 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.642300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.651043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.661626 4769 scope.go:117] "RemoveContainer" containerID="c5330bf85a3fafb45998e6bad561c4f632928d087d74aeca6c3b2df40473c484" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.672460 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:05 crc kubenswrapper[4769]: E1121 13:00:05.676626 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="proxy-httpd" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.676657 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="proxy-httpd" Nov 21 13:00:05 crc kubenswrapper[4769]: E1121 13:00:05.676682 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-central-agent" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.676688 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-central-agent" Nov 21 13:00:05 crc kubenswrapper[4769]: E1121 13:00:05.676725 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-notification-agent" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.676732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-notification-agent" Nov 21 13:00:05 crc kubenswrapper[4769]: E1121 13:00:05.676754 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="sg-core" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.676760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="sg-core" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.678011 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="proxy-httpd" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.678089 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="sg-core" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.678114 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-central-agent" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.678138 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" containerName="ceilometer-notification-agent" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.688869 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.692077 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.692250 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.692345 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.709432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.780115 4769 scope.go:117] "RemoveContainer" containerID="8c4738c53a865331578fe8f6d3a8b21985e427be9a00757ea5624feb34316755" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-log-httpd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-scripts\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4dd\" (UniqueName: \"kubernetes.io/projected/86aa407d-6a73-4ac5-8665-6f8d63302e4d-kube-api-access-6k4dd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-run-httpd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.805641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-config-data\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4dd\" (UniqueName: \"kubernetes.io/projected/86aa407d-6a73-4ac5-8665-6f8d63302e4d-kube-api-access-6k4dd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-run-httpd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-config-data\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-log-httpd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907771 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.907811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-scripts\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.908589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-run-httpd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.908938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-log-httpd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.914456 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.915203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.915417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-config-data\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.924448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.925031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.929405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-scripts\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:05 crc kubenswrapper[4769]: I1121 13:00:05.936806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4dd\" (UniqueName: \"kubernetes.io/projected/86aa407d-6a73-4ac5-8665-6f8d63302e4d-kube-api-access-6k4dd\") pod \"ceilometer-0\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.009141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-scripts\") pod \"49e7cc24-75ec-4591-97d7-e9af865edc01\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.009212 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndvk5\" (UniqueName: \"kubernetes.io/projected/49e7cc24-75ec-4591-97d7-e9af865edc01-kube-api-access-ndvk5\") pod \"49e7cc24-75ec-4591-97d7-e9af865edc01\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.009266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-combined-ca-bundle\") pod \"49e7cc24-75ec-4591-97d7-e9af865edc01\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.009886 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-config-data\") pod \"49e7cc24-75ec-4591-97d7-e9af865edc01\" (UID: \"49e7cc24-75ec-4591-97d7-e9af865edc01\") " Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.012631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-scripts" (OuterVolumeSpecName: "scripts") pod "49e7cc24-75ec-4591-97d7-e9af865edc01" (UID: "49e7cc24-75ec-4591-97d7-e9af865edc01"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.013023 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e7cc24-75ec-4591-97d7-e9af865edc01-kube-api-access-ndvk5" (OuterVolumeSpecName: "kube-api-access-ndvk5") pod "49e7cc24-75ec-4591-97d7-e9af865edc01" (UID: "49e7cc24-75ec-4591-97d7-e9af865edc01"). InnerVolumeSpecName "kube-api-access-ndvk5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.051837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-config-data" (OuterVolumeSpecName: "config-data") pod "49e7cc24-75ec-4591-97d7-e9af865edc01" (UID: "49e7cc24-75ec-4591-97d7-e9af865edc01"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.068760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "49e7cc24-75ec-4591-97d7-e9af865edc01" (UID: "49e7cc24-75ec-4591-97d7-e9af865edc01"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.080314 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.115195 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.115224 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.115236 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ndvk5\" (UniqueName: \"kubernetes.io/projected/49e7cc24-75ec-4591-97d7-e9af865edc01-kube-api-access-ndvk5\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.115247 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49e7cc24-75ec-4591-97d7-e9af865edc01-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.283698 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.336292 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-84b444c894-pd4jt"] Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.336498 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" podUID="3c195dbf-9a18-4d12-a66d-0fa74d151b2d" containerName="keystone-api" containerID="cri-o://47ddfab13e050c6075670774c42a97aa4e98b58d71072a7c0251aefa892f8cf4" gracePeriod=30 Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.522815 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:06 crc kubenswrapper[4769]: W1121 13:00:06.527268 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86aa407d_6a73_4ac5_8665_6f8d63302e4d.slice/crio-9c34154fd13bba593fc0a466fda3df6ad1677c22d5d015d881b477e83a035b3a WatchSource:0}: Error finding container 9c34154fd13bba593fc0a466fda3df6ad1677c22d5d015d881b477e83a035b3a: Status 404 returned error can't find the container with id 9c34154fd13bba593fc0a466fda3df6ad1677c22d5d015d881b477e83a035b3a Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.557722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"15834ae6-2e6d-438b-8f13-4fece8d5a0ad","Type":"ContainerStarted","Data":"425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.557770 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"15834ae6-2e6d-438b-8f13-4fece8d5a0ad","Type":"ContainerStarted","Data":"7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.557781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"15834ae6-2e6d-438b-8f13-4fece8d5a0ad","Type":"ContainerStarted","Data":"93ec4323058f7f62c38e5d584cff604a45c1fa490e17dae05de42a6f93703129"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.560211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerStarted","Data":"9c34154fd13bba593fc0a466fda3df6ad1677c22d5d015d881b477e83a035b3a"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.562311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfba5cd5-406e-453b-b1f8-934f9ed75dd8","Type":"ContainerStarted","Data":"8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.562341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfba5cd5-406e-453b-b1f8-934f9ed75dd8","Type":"ContainerStarted","Data":"34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.562350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfba5cd5-406e-453b-b1f8-934f9ed75dd8","Type":"ContainerStarted","Data":"339ce2a162ca4a57350448a854f02eaf14c5065e7a769de3254660125b4c3849"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.563692 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.563717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv" event={"ID":"49e7cc24-75ec-4591-97d7-e9af865edc01","Type":"ContainerDied","Data":"ab0ed3fb93b54ff5643f89c8632679f8f831b77e36d17b3f7d721c50fc9c81e1"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.563774 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab0ed3fb93b54ff5643f89c8632679f8f831b77e36d17b3f7d721c50fc9c81e1" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.569201 4769 generic.go:334] "Generic (PLEG): container finished" podID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerID="7589f4af917aa81fef3b34260f8a63301abe18e29717f76311008fc3ebe60b75" exitCode=1 Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.569252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4393b133-167b-4e5a-b5d5-fbd2fc8233f1","Type":"ContainerDied","Data":"7589f4af917aa81fef3b34260f8a63301abe18e29717f76311008fc3ebe60b75"} Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.569307 4769 scope.go:117] "RemoveContainer" containerID="31cd3945b33f7d5a01059617d47313fc4c46adbe87edb17acd58b87e4eeb57ac" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.569974 4769 scope.go:117] "RemoveContainer" containerID="7589f4af917aa81fef3b34260f8a63301abe18e29717f76311008fc3ebe60b75" Nov 21 13:00:06 crc kubenswrapper[4769]: E1121 13:00:06.570234 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(4393b133-167b-4e5a-b5d5-fbd2fc8233f1)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.579555 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.579539371 podStartE2EDuration="2.579539371s" podCreationTimestamp="2025-11-21 13:00:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:06.573228061 +0000 UTC m=+4165.273889879" watchObservedRunningTime="2025-11-21 13:00:06.579539371 +0000 UTC m=+4165.280201189" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.612397 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.612362145 podStartE2EDuration="2.612362145s" podCreationTimestamp="2025-11-21 13:00:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:06.607580086 +0000 UTC m=+4165.308241914" watchObservedRunningTime="2025-11-21 13:00:06.612362145 +0000 UTC m=+4165.313023963" Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.693202 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.702025 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:06 crc kubenswrapper[4769]: I1121 13:00:06.725204 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:07 crc kubenswrapper[4769]: I1121 13:00:07.299755 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc134fb-086d-4593-a7e0-2a14633735ae" path="/var/lib/kubelet/pods/9cc134fb-086d-4593-a7e0-2a14633735ae/volumes" Nov 21 13:00:07 crc kubenswrapper[4769]: I1121 13:00:07.582317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerStarted","Data":"d4ba11bc2c5175317f3ea50d6435de5762c8087102807a2d83a528cbe9837e96"} Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.011340 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.050628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz2h4\" (UniqueName: \"kubernetes.io/projected/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-kube-api-access-jz2h4\") pod \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.050685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-config-data\") pod \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.050760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-combined-ca-bundle\") pod \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\" (UID: \"4393b133-167b-4e5a-b5d5-fbd2fc8233f1\") " Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.056486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-kube-api-access-jz2h4" (OuterVolumeSpecName: "kube-api-access-jz2h4") pod "4393b133-167b-4e5a-b5d5-fbd2fc8233f1" (UID: "4393b133-167b-4e5a-b5d5-fbd2fc8233f1"). InnerVolumeSpecName "kube-api-access-jz2h4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.082865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-config-data" (OuterVolumeSpecName: "config-data") pod "4393b133-167b-4e5a-b5d5-fbd2fc8233f1" (UID: "4393b133-167b-4e5a-b5d5-fbd2fc8233f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.086444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4393b133-167b-4e5a-b5d5-fbd2fc8233f1" (UID: "4393b133-167b-4e5a-b5d5-fbd2fc8233f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.152928 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jz2h4\" (UniqueName: \"kubernetes.io/projected/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-kube-api-access-jz2h4\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.152965 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.152977 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4393b133-167b-4e5a-b5d5-fbd2fc8233f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.609161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4393b133-167b-4e5a-b5d5-fbd2fc8233f1","Type":"ContainerDied","Data":"dde1f4b4dc0bef58dfcfa69a20d53536d99d52440d630034fbb518e820cbea94"} Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.609175 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.609278 4769 scope.go:117] "RemoveContainer" containerID="7589f4af917aa81fef3b34260f8a63301abe18e29717f76311008fc3ebe60b75" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.612767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerStarted","Data":"d53d60f009ea304c81bf404c12b309b0021ba2f7eb3af01faec520c38556fd27"} Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.612892 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-log" containerID="cri-o://34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103" gracePeriod=30 Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.612995 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-metadata" containerID="cri-o://8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88" gracePeriod=30 Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.613062 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-api" containerID="cri-o://425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3" gracePeriod=30 Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.613064 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-log" containerID="cri-o://7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506" gracePeriod=30 Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.729594 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.751789 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.819250 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:08 crc kubenswrapper[4769]: E1121 13:00:08.819718 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerName="nova-scheduler-scheduler" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.819734 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerName="nova-scheduler-scheduler" Nov 21 13:00:08 crc kubenswrapper[4769]: E1121 13:00:08.819748 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="49e7cc24-75ec-4591-97d7-e9af865edc01" containerName="nova-manage" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.819754 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e7cc24-75ec-4591-97d7-e9af865edc01" containerName="nova-manage" Nov 21 13:00:08 crc kubenswrapper[4769]: E1121 13:00:08.819793 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerName="nova-scheduler-scheduler" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.819799 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerName="nova-scheduler-scheduler" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.819975 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerName="nova-scheduler-scheduler" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.819996 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="49e7cc24-75ec-4591-97d7-e9af865edc01" containerName="nova-manage" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.820019 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" containerName="nova-scheduler-scheduler" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.820696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.825529 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.825606 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.868233 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.868292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f7tj\" (UniqueName: \"kubernetes.io/projected/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-kube-api-access-6f7tj\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.868394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-config-data\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.970015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-config-data\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.970107 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.970137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6f7tj\" (UniqueName: \"kubernetes.io/projected/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-kube-api-access-6f7tj\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.998439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-config-data\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:08 crc kubenswrapper[4769]: I1121 13:00:08.998439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f7tj\" (UniqueName: \"kubernetes.io/projected/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-kube-api-access-6f7tj\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.000768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.148596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.292223 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4393b133-167b-4e5a-b5d5-fbd2fc8233f1" path="/var/lib/kubelet/pods/4393b133-167b-4e5a-b5d5-fbd2fc8233f1/volumes" Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.607265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.637080 4769 generic.go:334] "Generic (PLEG): container finished" podID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerID="7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506" exitCode=143 Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.637131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"15834ae6-2e6d-438b-8f13-4fece8d5a0ad","Type":"ContainerDied","Data":"7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506"} Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.641451 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c195dbf-9a18-4d12-a66d-0fa74d151b2d" containerID="47ddfab13e050c6075670774c42a97aa4e98b58d71072a7c0251aefa892f8cf4" exitCode=0 Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.641509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" event={"ID":"3c195dbf-9a18-4d12-a66d-0fa74d151b2d","Type":"ContainerDied","Data":"47ddfab13e050c6075670774c42a97aa4e98b58d71072a7c0251aefa892f8cf4"} Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.646081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerStarted","Data":"4c5918b5577dd0780532ed7b52d01d3b99c6c0ba464eaf43803a3eb8a71178de"} Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.650168 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerID="34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103" exitCode=143 Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.650250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfba5cd5-406e-453b-b1f8-934f9ed75dd8","Type":"ContainerDied","Data":"34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103"} Nov 21 13:00:09 crc kubenswrapper[4769]: W1121 13:00:09.653622 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb5d3ac4_b6cb_442a_8cd3_e0d4cefc8e88.slice/crio-10b655c97466442cfb6587b4acd0f83d8c235e0b32f7fd3d02faafbe86a01e26 WatchSource:0}: Error finding container 10b655c97466442cfb6587b4acd0f83d8c235e0b32f7fd3d02faafbe86a01e26: Status 404 returned error can't find the container with id 10b655c97466442cfb6587b4acd0f83d8c235e0b32f7fd3d02faafbe86a01e26 Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.898216 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.915157 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.917326 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.917538 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" containerName="nova-cell0-conductor-conductor" containerID="cri-o://61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" gracePeriod=30 Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.942948 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.943220 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="016b6cd7-0a17-469d-a11d-9362cbc066dc" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a98f2249e532d44c8d3a24a2dc7be29499bfbabb1862d9b22de2c9a8054e43a1" gracePeriod=30 Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.970447 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:09 crc kubenswrapper[4769]: I1121 13:00:09.970648 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="774dcba4-ce12-497b-aa79-c08d2d903ac3" containerName="nova-cell1-conductor-conductor" containerID="cri-o://59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" gracePeriod=30 Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.003023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-combined-ca-bundle\") pod \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.003070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g67dt\" (UniqueName: \"kubernetes.io/projected/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-kube-api-access-g67dt\") pod \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.003091 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-fernet-keys\") pod \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.003247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-scripts\") pod \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.003278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-config-data\") pod \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.003345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-credential-keys\") pod \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\" (UID: \"3c195dbf-9a18-4d12-a66d-0fa74d151b2d\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.016418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-kube-api-access-g67dt" (OuterVolumeSpecName: "kube-api-access-g67dt") pod "3c195dbf-9a18-4d12-a66d-0fa74d151b2d" (UID: "3c195dbf-9a18-4d12-a66d-0fa74d151b2d"). InnerVolumeSpecName "kube-api-access-g67dt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.017383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "3c195dbf-9a18-4d12-a66d-0fa74d151b2d" (UID: "3c195dbf-9a18-4d12-a66d-0fa74d151b2d"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.023164 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-scripts" (OuterVolumeSpecName: "scripts") pod "3c195dbf-9a18-4d12-a66d-0fa74d151b2d" (UID: "3c195dbf-9a18-4d12-a66d-0fa74d151b2d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.023198 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "3c195dbf-9a18-4d12-a66d-0fa74d151b2d" (UID: "3c195dbf-9a18-4d12-a66d-0fa74d151b2d"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.044268 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c195dbf-9a18-4d12-a66d-0fa74d151b2d" (UID: "3c195dbf-9a18-4d12-a66d-0fa74d151b2d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.046527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-config-data" (OuterVolumeSpecName: "config-data") pod "3c195dbf-9a18-4d12-a66d-0fa74d151b2d" (UID: "3c195dbf-9a18-4d12-a66d-0fa74d151b2d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.061915 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.061968 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.105539 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.105577 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.105592 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.105607 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.105625 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g67dt\" (UniqueName: \"kubernetes.io/projected/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-kube-api-access-g67dt\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.105640 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3c195dbf-9a18-4d12-a66d-0fa74d151b2d-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.635414 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.646549 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.693491 4769 generic.go:334] "Generic (PLEG): container finished" podID="016b6cd7-0a17-469d-a11d-9362cbc066dc" containerID="a98f2249e532d44c8d3a24a2dc7be29499bfbabb1862d9b22de2c9a8054e43a1" exitCode=0 Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.693605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"016b6cd7-0a17-469d-a11d-9362cbc066dc","Type":"ContainerDied","Data":"a98f2249e532d44c8d3a24a2dc7be29499bfbabb1862d9b22de2c9a8054e43a1"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.722902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerStarted","Data":"69b4fecc77e825dc387b98ad732274c431263b9c81e3a77af1a8e578f7d2edf9"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.723007 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-internal-tls-certs\") pod \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgpzb\" (UniqueName: \"kubernetes.io/projected/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-kube-api-access-lgpzb\") pod \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746397 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-public-tls-certs\") pod \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-config-data\") pod \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-nova-metadata-tls-certs\") pod \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-logs\") pod \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746600 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-config-data\") pod \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-logs\") pod \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746664 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klc9b\" (UniqueName: \"kubernetes.io/projected/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-kube-api-access-klc9b\") pod \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-combined-ca-bundle\") pod \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\" (UID: \"bfba5cd5-406e-453b-b1f8-934f9ed75dd8\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.746708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-combined-ca-bundle\") pod \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\" (UID: \"15834ae6-2e6d-438b-8f13-4fece8d5a0ad\") " Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.758199 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-kube-api-access-lgpzb" (OuterVolumeSpecName: "kube-api-access-lgpzb") pod "bfba5cd5-406e-453b-b1f8-934f9ed75dd8" (UID: "bfba5cd5-406e-453b-b1f8-934f9ed75dd8"). InnerVolumeSpecName "kube-api-access-lgpzb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.759122 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-logs" (OuterVolumeSpecName: "logs") pod "15834ae6-2e6d-438b-8f13-4fece8d5a0ad" (UID: "15834ae6-2e6d-438b-8f13-4fece8d5a0ad"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.759674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-logs" (OuterVolumeSpecName: "logs") pod "bfba5cd5-406e-453b-b1f8-934f9ed75dd8" (UID: "bfba5cd5-406e-453b-b1f8-934f9ed75dd8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.763568 4769 generic.go:334] "Generic (PLEG): container finished" podID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerID="8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88" exitCode=0 Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.763688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfba5cd5-406e-453b-b1f8-934f9ed75dd8","Type":"ContainerDied","Data":"8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.763727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"bfba5cd5-406e-453b-b1f8-934f9ed75dd8","Type":"ContainerDied","Data":"339ce2a162ca4a57350448a854f02eaf14c5065e7a769de3254660125b4c3849"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.763750 4769 scope.go:117] "RemoveContainer" containerID="8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.779720 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.783072 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.129841072 podStartE2EDuration="5.783053091s" podCreationTimestamp="2025-11-21 13:00:05 +0000 UTC" firstStartedPulling="2025-11-21 13:00:06.529455672 +0000 UTC m=+4165.230117490" lastFinishedPulling="2025-11-21 13:00:10.182667691 +0000 UTC m=+4168.883329509" observedRunningTime="2025-11-21 13:00:10.780510073 +0000 UTC m=+4169.481171891" watchObservedRunningTime="2025-11-21 13:00:10.783053091 +0000 UTC m=+4169.483714909" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.784694 4769 generic.go:334] "Generic (PLEG): container finished" podID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerID="425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3" exitCode=0 Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.785083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.785765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"15834ae6-2e6d-438b-8f13-4fece8d5a0ad","Type":"ContainerDied","Data":"425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.785839 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"15834ae6-2e6d-438b-8f13-4fece8d5a0ad","Type":"ContainerDied","Data":"93ec4323058f7f62c38e5d584cff604a45c1fa490e17dae05de42a6f93703129"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.787947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" event={"ID":"3c195dbf-9a18-4d12-a66d-0fa74d151b2d","Type":"ContainerDied","Data":"47b6bc697e3500829ddf4b84a70336662dc022903409d028fab3717f819ca183"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.788404 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-84b444c894-pd4jt" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.790586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88","Type":"ContainerStarted","Data":"c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.790637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88","Type":"ContainerStarted","Data":"10b655c97466442cfb6587b4acd0f83d8c235e0b32f7fd3d02faafbe86a01e26"} Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.790784 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" containerName="nova-scheduler-scheduler" containerID="cri-o://c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09" gracePeriod=30 Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.821512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-kube-api-access-klc9b" (OuterVolumeSpecName: "kube-api-access-klc9b") pod "15834ae6-2e6d-438b-8f13-4fece8d5a0ad" (UID: "15834ae6-2e6d-438b-8f13-4fece8d5a0ad"). InnerVolumeSpecName "kube-api-access-klc9b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.831345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-config-data" (OuterVolumeSpecName: "config-data") pod "bfba5cd5-406e-453b-b1f8-934f9ed75dd8" (UID: "bfba5cd5-406e-453b-b1f8-934f9ed75dd8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.840899 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.840880119 podStartE2EDuration="2.840880119s" podCreationTimestamp="2025-11-21 13:00:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:10.828941057 +0000 UTC m=+4169.529602885" watchObservedRunningTime="2025-11-21 13:00:10.840880119 +0000 UTC m=+4169.541541937" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.849555 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lgpzb\" (UniqueName: \"kubernetes.io/projected/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-kube-api-access-lgpzb\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.849586 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.849597 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.849607 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.849616 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-klc9b\" (UniqueName: \"kubernetes.io/projected/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-kube-api-access-klc9b\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.865416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "15834ae6-2e6d-438b-8f13-4fece8d5a0ad" (UID: "15834ae6-2e6d-438b-8f13-4fece8d5a0ad"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.868677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-config-data" (OuterVolumeSpecName: "config-data") pod "15834ae6-2e6d-438b-8f13-4fece8d5a0ad" (UID: "15834ae6-2e6d-438b-8f13-4fece8d5a0ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.874346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "15834ae6-2e6d-438b-8f13-4fece8d5a0ad" (UID: "15834ae6-2e6d-438b-8f13-4fece8d5a0ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.886130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bfba5cd5-406e-453b-b1f8-934f9ed75dd8" (UID: "bfba5cd5-406e-453b-b1f8-934f9ed75dd8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.888890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "15834ae6-2e6d-438b-8f13-4fece8d5a0ad" (UID: "15834ae6-2e6d-438b-8f13-4fece8d5a0ad"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.899641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "bfba5cd5-406e-453b-b1f8-934f9ed75dd8" (UID: "bfba5cd5-406e-453b-b1f8-934f9ed75dd8"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.929515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.933242 4769 scope.go:117] "RemoveContainer" containerID="34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.941826 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-84b444c894-pd4jt"] Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.948391 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-84b444c894-pd4jt"] Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.952731 4769 scope.go:117] "RemoveContainer" containerID="8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88" Nov 21 13:00:10 crc kubenswrapper[4769]: E1121 13:00:10.953835 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88\": container with ID starting with 8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88 not found: ID does not exist" containerID="8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.953888 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88"} err="failed to get container status \"8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88\": rpc error: code = NotFound desc = could not find container \"8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88\": container with ID starting with 8d8159d31afb23a33df2691ed595f978fbd90bb4fb939dbbe89b3aa26cc18d88 not found: ID does not exist" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.953915 4769 scope.go:117] "RemoveContainer" containerID="34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103" Nov 21 13:00:10 crc kubenswrapper[4769]: E1121 13:00:10.954586 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103\": container with ID starting with 34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103 not found: ID does not exist" containerID="34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.954634 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103"} err="failed to get container status \"34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103\": rpc error: code = NotFound desc = could not find container \"34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103\": container with ID starting with 34729c11fc6ea18872abbc39d00623eafe56534f24848593b89ba60db7332103 not found: ID does not exist" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.954662 4769 scope.go:117] "RemoveContainer" containerID="425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.955518 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.955540 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.955554 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.955564 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.955575 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bfba5cd5-406e-453b-b1f8-934f9ed75dd8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.955583 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15834ae6-2e6d-438b-8f13-4fece8d5a0ad-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:10 crc kubenswrapper[4769]: I1121 13:00:10.979520 4769 scope.go:117] "RemoveContainer" containerID="7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.006159 4769 scope.go:117] "RemoveContainer" containerID="425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.006696 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3\": container with ID starting with 425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3 not found: ID does not exist" containerID="425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.006737 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3"} err="failed to get container status \"425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3\": rpc error: code = NotFound desc = could not find container \"425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3\": container with ID starting with 425982ff73af86626ee957fe4b4325c2e7685883e488f9875472f7986c3312a3 not found: ID does not exist" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.006763 4769 scope.go:117] "RemoveContainer" containerID="7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.007057 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506\": container with ID starting with 7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506 not found: ID does not exist" containerID="7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.007081 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506"} err="failed to get container status \"7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506\": rpc error: code = NotFound desc = could not find container \"7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506\": container with ID starting with 7f7138da532d596c1c1ba560f68776be02c9ffc16ff2bc93e447b96ac5924506 not found: ID does not exist" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.007096 4769 scope.go:117] "RemoveContainer" containerID="47ddfab13e050c6075670774c42a97aa4e98b58d71072a7c0251aefa892f8cf4" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.056505 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-nova-novncproxy-tls-certs\") pod \"016b6cd7-0a17-469d-a11d-9362cbc066dc\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.056588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7br8\" (UniqueName: \"kubernetes.io/projected/016b6cd7-0a17-469d-a11d-9362cbc066dc-kube-api-access-r7br8\") pod \"016b6cd7-0a17-469d-a11d-9362cbc066dc\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.056658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-config-data\") pod \"016b6cd7-0a17-469d-a11d-9362cbc066dc\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.056713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs\") pod \"016b6cd7-0a17-469d-a11d-9362cbc066dc\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.056777 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-combined-ca-bundle\") pod \"016b6cd7-0a17-469d-a11d-9362cbc066dc\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.063390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016b6cd7-0a17-469d-a11d-9362cbc066dc-kube-api-access-r7br8" (OuterVolumeSpecName: "kube-api-access-r7br8") pod "016b6cd7-0a17-469d-a11d-9362cbc066dc" (UID: "016b6cd7-0a17-469d-a11d-9362cbc066dc"). InnerVolumeSpecName "kube-api-access-r7br8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.091133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-config-data" (OuterVolumeSpecName: "config-data") pod "016b6cd7-0a17-469d-a11d-9362cbc066dc" (UID: "016b6cd7-0a17-469d-a11d-9362cbc066dc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.091173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "016b6cd7-0a17-469d-a11d-9362cbc066dc" (UID: "016b6cd7-0a17-469d-a11d-9362cbc066dc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.137213 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.141517 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.159215 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.159241 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r7br8\" (UniqueName: \"kubernetes.io/projected/016b6cd7-0a17-469d-a11d-9362cbc066dc-kube-api-access-r7br8\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.159250 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.175807 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.185369 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.192003 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs podName:016b6cd7-0a17-469d-a11d-9362cbc066dc nodeName:}" failed. No retries permitted until 2025-11-21 13:00:11.691977865 +0000 UTC m=+4170.392639683 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs") pod "016b6cd7-0a17-469d-a11d-9362cbc066dc" (UID: "016b6cd7-0a17-469d-a11d-9362cbc066dc") : error deleting /var/lib/kubelet/pods/016b6cd7-0a17-469d-a11d-9362cbc066dc/volume-subpaths: remove /var/lib/kubelet/pods/016b6cd7-0a17-469d-a11d-9362cbc066dc/volume-subpaths: no such file or directory Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.195797 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.196366 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-log" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196384 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-log" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.196395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-metadata" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196402 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-metadata" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.196417 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="016b6cd7-0a17-469d-a11d-9362cbc066dc" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196429 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="016b6cd7-0a17-469d-a11d-9362cbc066dc" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.196449 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c195dbf-9a18-4d12-a66d-0fa74d151b2d" containerName="keystone-api" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196455 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c195dbf-9a18-4d12-a66d-0fa74d151b2d" containerName="keystone-api" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.196479 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-api" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196486 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-api" Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.196498 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-log" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196503 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-log" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196679 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-api" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196690 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-metadata" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196706 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" containerName="nova-api-log" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196716 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="016b6cd7-0a17-469d-a11d-9362cbc066dc" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196731 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c195dbf-9a18-4d12-a66d-0fa74d151b2d" containerName="keystone-api" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.196743 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" containerName="nova-metadata-log" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.197740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.198505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "016b6cd7-0a17-469d-a11d-9362cbc066dc" (UID: "016b6cd7-0a17-469d-a11d-9362cbc066dc"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.202556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.202579 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.214443 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.225379 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.227112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.231347 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.231543 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.231664 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.240159 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261280 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4eab576c-8718-41de-a0de-d85b206edba4-logs\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-config-data\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqhn\" (UniqueName: \"kubernetes.io/projected/4eab576c-8718-41de-a0de-d85b206edba4-kube-api-access-2wqhn\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3e7dddc-897c-488c-900c-512dc610df64-logs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-config-data\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-public-tls-certs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7bw\" (UniqueName: \"kubernetes.io/projected/e3e7dddc-897c-488c-900c-512dc610df64-kube-api-access-ct7bw\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.261713 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.285140 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15834ae6-2e6d-438b-8f13-4fece8d5a0ad" path="/var/lib/kubelet/pods/15834ae6-2e6d-438b-8f13-4fece8d5a0ad/volumes" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.286149 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c195dbf-9a18-4d12-a66d-0fa74d151b2d" path="/var/lib/kubelet/pods/3c195dbf-9a18-4d12-a66d-0fa74d151b2d/volumes" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.286916 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfba5cd5-406e-453b-b1f8-934f9ed75dd8" path="/var/lib/kubelet/pods/bfba5cd5-406e-453b-b1f8-934f9ed75dd8/volumes" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.362726 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-public-tls-certs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7bw\" (UniqueName: \"kubernetes.io/projected/e3e7dddc-897c-488c-900c-512dc610df64-kube-api-access-ct7bw\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4eab576c-8718-41de-a0de-d85b206edba4-logs\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-config-data\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqhn\" (UniqueName: \"kubernetes.io/projected/4eab576c-8718-41de-a0de-d85b206edba4-kube-api-access-2wqhn\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363346 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3e7dddc-897c-488c-900c-512dc610df64-logs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-config-data\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.363520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.364723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4eab576c-8718-41de-a0de-d85b206edba4-logs\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.365364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3e7dddc-897c-488c-900c-512dc610df64-logs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.367118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-public-tls-certs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.370892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.373853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.375597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-config-data\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.377203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-config-data\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.377560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.379009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.379627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7bw\" (UniqueName: \"kubernetes.io/projected/e3e7dddc-897c-488c-900c-512dc610df64-kube-api-access-ct7bw\") pod \"nova-api-0\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.389864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqhn\" (UniqueName: \"kubernetes.io/projected/4eab576c-8718-41de-a0de-d85b206edba4-kube-api-access-2wqhn\") pod \"nova-metadata-0\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.465091 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.465819 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.534632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.537473 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.730678 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.776754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs\") pod \"016b6cd7-0a17-469d-a11d-9362cbc066dc\" (UID: \"016b6cd7-0a17-469d-a11d-9362cbc066dc\") " Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.783587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "016b6cd7-0a17-469d-a11d-9362cbc066dc" (UID: "016b6cd7-0a17-469d-a11d-9362cbc066dc"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.808819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"016b6cd7-0a17-469d-a11d-9362cbc066dc","Type":"ContainerDied","Data":"b09b5aefe74560ef370542c34cfb2c39bc31a948bd40e4330d7e2044f4068ebb"} Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.808869 4769 scope.go:117] "RemoveContainer" containerID="a98f2249e532d44c8d3a24a2dc7be29499bfbabb1862d9b22de2c9a8054e43a1" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.809065 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.849179 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.864561 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.872323 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.873527 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.875903 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.877850 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.880400 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/016b6cd7-0a17-469d-a11d-9362cbc066dc-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.881518 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.883053 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.983372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.983423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.983453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqql\" (UniqueName: \"kubernetes.io/projected/97649518-fe2e-4273-9062-b5730a0edc17-kube-api-access-lpqql\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.983494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.983512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:11 crc kubenswrapper[4769]: W1121 13:00:11.992988 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3e7dddc_897c_488c_900c_512dc610df64.slice/crio-5b7bee835d240c5849a170f91070f94e36576bd7c53a590bf7a92fc44a74c5f5 WatchSource:0}: Error finding container 5b7bee835d240c5849a170f91070f94e36576bd7c53a590bf7a92fc44a74c5f5: Status 404 returned error can't find the container with id 5b7bee835d240c5849a170f91070f94e36576bd7c53a590bf7a92fc44a74c5f5 Nov 21 13:00:11 crc kubenswrapper[4769]: I1121 13:00:11.995128 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.996547 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:11 crc kubenswrapper[4769]: E1121 13:00:11.999408 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:12 crc kubenswrapper[4769]: E1121 13:00:12.000949 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:12 crc kubenswrapper[4769]: E1121 13:00:12.001020 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="774dcba4-ce12-497b-aa79-c08d2d903ac3" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.085368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.085683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.086354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqql\" (UniqueName: \"kubernetes.io/projected/97649518-fe2e-4273-9062-b5730a0edc17-kube-api-access-lpqql\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.086402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.086424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.093797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.094262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.096342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.099508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.106804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqql\" (UniqueName: \"kubernetes.io/projected/97649518-fe2e-4273-9062-b5730a0edc17-kube-api-access-lpqql\") pod \"nova-cell1-novncproxy-0\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.164851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.206476 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:12 crc kubenswrapper[4769]: E1121 13:00:12.534711 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:12 crc kubenswrapper[4769]: E1121 13:00:12.536241 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:12 crc kubenswrapper[4769]: E1121 13:00:12.537558 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:12 crc kubenswrapper[4769]: E1121 13:00:12.537609 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.679343 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:12 crc kubenswrapper[4769]: W1121 13:00:12.682390 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97649518_fe2e_4273_9062_b5730a0edc17.slice/crio-4fdb25e62a846d97a9bbd6f1d4e981c1ef233de8964bdab9e25f6eec00ed99fd WatchSource:0}: Error finding container 4fdb25e62a846d97a9bbd6f1d4e981c1ef233de8964bdab9e25f6eec00ed99fd: Status 404 returned error can't find the container with id 4fdb25e62a846d97a9bbd6f1d4e981c1ef233de8964bdab9e25f6eec00ed99fd Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.825154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e3e7dddc-897c-488c-900c-512dc610df64","Type":"ContainerStarted","Data":"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.825455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e3e7dddc-897c-488c-900c-512dc610df64","Type":"ContainerStarted","Data":"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.825467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e3e7dddc-897c-488c-900c-512dc610df64","Type":"ContainerStarted","Data":"5b7bee835d240c5849a170f91070f94e36576bd7c53a590bf7a92fc44a74c5f5"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.825455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-log" containerID="cri-o://5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06" gracePeriod=30 Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.825620 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-api" containerID="cri-o://2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10" gracePeriod=30 Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.830108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4eab576c-8718-41de-a0de-d85b206edba4","Type":"ContainerStarted","Data":"906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.830154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4eab576c-8718-41de-a0de-d85b206edba4","Type":"ContainerStarted","Data":"3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.830168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4eab576c-8718-41de-a0de-d85b206edba4","Type":"ContainerStarted","Data":"6bc531cca67dd2ca4391ce13ab128912102284949cd0f5f50591cf148c1ea0c5"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.830217 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-log" containerID="cri-o://3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e" gracePeriod=30 Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.830250 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-metadata" containerID="cri-o://906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e" gracePeriod=30 Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.840148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"97649518-fe2e-4273-9062-b5730a0edc17","Type":"ContainerStarted","Data":"4fdb25e62a846d97a9bbd6f1d4e981c1ef233de8964bdab9e25f6eec00ed99fd"} Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.868034 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=1.868017564 podStartE2EDuration="1.868017564s" podCreationTimestamp="2025-11-21 13:00:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:12.864618472 +0000 UTC m=+4171.565280290" watchObservedRunningTime="2025-11-21 13:00:12.868017564 +0000 UTC m=+4171.568679382" Nov 21 13:00:12 crc kubenswrapper[4769]: I1121 13:00:12.871467 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.871461496 podStartE2EDuration="1.871461496s" podCreationTimestamp="2025-11-21 13:00:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:12.847781809 +0000 UTC m=+4171.548443657" watchObservedRunningTime="2025-11-21 13:00:12.871461496 +0000 UTC m=+4171.572123314" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.030780 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.031052 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-central-agent" containerID="cri-o://d4ba11bc2c5175317f3ea50d6435de5762c8087102807a2d83a528cbe9837e96" gracePeriod=30 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.031149 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="sg-core" containerID="cri-o://4c5918b5577dd0780532ed7b52d01d3b99c6c0ba464eaf43803a3eb8a71178de" gracePeriod=30 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.031259 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-notification-agent" containerID="cri-o://d53d60f009ea304c81bf404c12b309b0021ba2f7eb3af01faec520c38556fd27" gracePeriod=30 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.031427 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="proxy-httpd" containerID="cri-o://69b4fecc77e825dc387b98ad732274c431263b9c81e3a77af1a8e578f7d2edf9" gracePeriod=30 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.126266 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.249088 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj"] Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.252238 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.254940 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.255472 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.297056 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016b6cd7-0a17-469d-a11d-9362cbc066dc" path="/var/lib/kubelet/pods/016b6cd7-0a17-469d-a11d-9362cbc066dc/volumes" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.297686 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj"] Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314213 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-run-httpd\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-combined-ca-bundle\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-etc-swift\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-internal-tls-certs\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppgnh\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-kube-api-access-ppgnh\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-config-data\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-public-tls-certs\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.314528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-log-httpd\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.351337 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.415919 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-public-tls-certs\") pod \"e3e7dddc-897c-488c-900c-512dc610df64\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.415975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-internal-tls-certs\") pod \"e3e7dddc-897c-488c-900c-512dc610df64\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct7bw\" (UniqueName: \"kubernetes.io/projected/e3e7dddc-897c-488c-900c-512dc610df64-kube-api-access-ct7bw\") pod \"e3e7dddc-897c-488c-900c-512dc610df64\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3e7dddc-897c-488c-900c-512dc610df64-logs\") pod \"e3e7dddc-897c-488c-900c-512dc610df64\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-combined-ca-bundle\") pod \"e3e7dddc-897c-488c-900c-512dc610df64\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-config-data\") pod \"e3e7dddc-897c-488c-900c-512dc610df64\" (UID: \"e3e7dddc-897c-488c-900c-512dc610df64\") " Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-run-httpd\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-combined-ca-bundle\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-etc-swift\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-internal-tls-certs\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ppgnh\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-kube-api-access-ppgnh\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-config-data\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-public-tls-certs\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.416749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-log-httpd\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.417130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-log-httpd\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.420871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-run-httpd\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.422739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e7dddc-897c-488c-900c-512dc610df64-logs" (OuterVolumeSpecName: "logs") pod "e3e7dddc-897c-488c-900c-512dc610df64" (UID: "e3e7dddc-897c-488c-900c-512dc610df64"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.424042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-internal-tls-certs\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.424549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e7dddc-897c-488c-900c-512dc610df64-kube-api-access-ct7bw" (OuterVolumeSpecName: "kube-api-access-ct7bw") pod "e3e7dddc-897c-488c-900c-512dc610df64" (UID: "e3e7dddc-897c-488c-900c-512dc610df64"). InnerVolumeSpecName "kube-api-access-ct7bw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.424829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-public-tls-certs\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.426113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-etc-swift\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.432252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-config-data\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.438483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppgnh\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-kube-api-access-ppgnh\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.440311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-combined-ca-bundle\") pod \"swift-proxy-7b9d9c6dfd-8zmwj\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.459277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-config-data" (OuterVolumeSpecName: "config-data") pod "e3e7dddc-897c-488c-900c-512dc610df64" (UID: "e3e7dddc-897c-488c-900c-512dc610df64"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.481270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e3e7dddc-897c-488c-900c-512dc610df64" (UID: "e3e7dddc-897c-488c-900c-512dc610df64"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.482520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e3e7dddc-897c-488c-900c-512dc610df64" (UID: "e3e7dddc-897c-488c-900c-512dc610df64"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.513656 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e3e7dddc-897c-488c-900c-512dc610df64" (UID: "e3e7dddc-897c-488c-900c-512dc610df64"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.518090 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.518117 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.518130 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ct7bw\" (UniqueName: \"kubernetes.io/projected/e3e7dddc-897c-488c-900c-512dc610df64-kube-api-access-ct7bw\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.518147 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3e7dddc-897c-488c-900c-512dc610df64-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.518158 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.518169 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3e7dddc-897c-488c-900c-512dc610df64-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.587591 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.870883 4769 generic.go:334] "Generic (PLEG): container finished" podID="4eab576c-8718-41de-a0de-d85b206edba4" containerID="3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e" exitCode=143 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.871080 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4eab576c-8718-41de-a0de-d85b206edba4","Type":"ContainerDied","Data":"3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883079 4769 generic.go:334] "Generic (PLEG): container finished" podID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerID="69b4fecc77e825dc387b98ad732274c431263b9c81e3a77af1a8e578f7d2edf9" exitCode=0 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883104 4769 generic.go:334] "Generic (PLEG): container finished" podID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerID="4c5918b5577dd0780532ed7b52d01d3b99c6c0ba464eaf43803a3eb8a71178de" exitCode=2 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883111 4769 generic.go:334] "Generic (PLEG): container finished" podID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerID="d53d60f009ea304c81bf404c12b309b0021ba2f7eb3af01faec520c38556fd27" exitCode=0 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883118 4769 generic.go:334] "Generic (PLEG): container finished" podID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerID="d4ba11bc2c5175317f3ea50d6435de5762c8087102807a2d83a528cbe9837e96" exitCode=0 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerDied","Data":"69b4fecc77e825dc387b98ad732274c431263b9c81e3a77af1a8e578f7d2edf9"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerDied","Data":"4c5918b5577dd0780532ed7b52d01d3b99c6c0ba464eaf43803a3eb8a71178de"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerDied","Data":"d53d60f009ea304c81bf404c12b309b0021ba2f7eb3af01faec520c38556fd27"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.883247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerDied","Data":"d4ba11bc2c5175317f3ea50d6435de5762c8087102807a2d83a528cbe9837e96"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.886741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"97649518-fe2e-4273-9062-b5730a0edc17","Type":"ContainerStarted","Data":"337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891230 4769 generic.go:334] "Generic (PLEG): container finished" podID="e3e7dddc-897c-488c-900c-512dc610df64" containerID="2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10" exitCode=0 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891249 4769 generic.go:334] "Generic (PLEG): container finished" podID="e3e7dddc-897c-488c-900c-512dc610df64" containerID="5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06" exitCode=143 Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e3e7dddc-897c-488c-900c-512dc610df64","Type":"ContainerDied","Data":"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e3e7dddc-897c-488c-900c-512dc610df64","Type":"ContainerDied","Data":"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e3e7dddc-897c-488c-900c-512dc610df64","Type":"ContainerDied","Data":"5b7bee835d240c5849a170f91070f94e36576bd7c53a590bf7a92fc44a74c5f5"} Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891312 4769 scope.go:117] "RemoveContainer" containerID="2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.891465 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.912927 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.912905215 podStartE2EDuration="2.912905215s" podCreationTimestamp="2025-11-21 13:00:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:13.906569344 +0000 UTC m=+4172.607231162" watchObservedRunningTime="2025-11-21 13:00:13.912905215 +0000 UTC m=+4172.613567033" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.945077 4769 scope.go:117] "RemoveContainer" containerID="5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.945822 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.956276 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.977303 4769 scope.go:117] "RemoveContainer" containerID="2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.977432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.978713 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10\": container with ID starting with 2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10 not found: ID does not exist" containerID="2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.978762 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10"} err="failed to get container status \"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10\": rpc error: code = NotFound desc = could not find container \"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10\": container with ID starting with 2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10 not found: ID does not exist" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.978799 4769 scope.go:117] "RemoveContainer" containerID="5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.979135 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06\": container with ID starting with 5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06 not found: ID does not exist" containerID="5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.979168 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06"} err="failed to get container status \"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06\": rpc error: code = NotFound desc = could not find container \"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06\": container with ID starting with 5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06 not found: ID does not exist" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.979245 4769 scope.go:117] "RemoveContainer" containerID="2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.979510 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10"} err="failed to get container status \"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10\": rpc error: code = NotFound desc = could not find container \"2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10\": container with ID starting with 2d95d08bcce76dd163d2a90987ee40444c28b01ce934ae259382c7f796b04c10 not found: ID does not exist" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.979527 4769 scope.go:117] "RemoveContainer" containerID="5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.980100 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06"} err="failed to get container status \"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06\": rpc error: code = NotFound desc = could not find container \"5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06\": container with ID starting with 5f94dffbe1f35e5c820108788856d849cdc57fa371500d9528295c1e418d4f06 not found: ID does not exist" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.996465 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.997136 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="sg-core" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="sg-core" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.997176 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="proxy-httpd" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997198 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="proxy-httpd" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.997213 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-notification-agent" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997219 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-notification-agent" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.997232 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-api" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997237 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-api" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.997251 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-central-agent" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997257 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-central-agent" Nov 21 13:00:13 crc kubenswrapper[4769]: E1121 13:00:13.997272 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-log" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997277 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-log" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997465 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-log" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="proxy-httpd" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997507 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-central-agent" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997519 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e3e7dddc-897c-488c-900c-512dc610df64" containerName="nova-api-api" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997530 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="sg-core" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.997543 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" containerName="ceilometer-notification-agent" Nov 21 13:00:13 crc kubenswrapper[4769]: I1121 13:00:13.998746 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.001288 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.001440 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.001472 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.020953 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025357 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-log-httpd\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-ceilometer-tls-certs\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-run-httpd\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k4dd\" (UniqueName: \"kubernetes.io/projected/86aa407d-6a73-4ac5-8665-6f8d63302e4d-kube-api-access-6k4dd\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-scripts\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-combined-ca-bundle\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-config-data\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-sg-core-conf-yaml\") pod \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\" (UID: \"86aa407d-6a73-4ac5-8665-6f8d63302e4d\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-config-data\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/271908c0-3c66-454e-9dd0-d75cdb71a788-logs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025752 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwb8z\" (UniqueName: \"kubernetes.io/projected/271908c0-3c66-454e-9dd0-d75cdb71a788-kube-api-access-mwb8z\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-internal-tls-certs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.025857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-public-tls-certs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.026519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.029037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.031587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-scripts" (OuterVolumeSpecName: "scripts") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: W1121 13:00:14.036701 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod397a49d3_b26e_45f8_88d7_c5d37062391a.slice/crio-3125cf5edeb435e18d9ecf5c97fe08b7efd3104c2704dcc8dfff726727cd8f70 WatchSource:0}: Error finding container 3125cf5edeb435e18d9ecf5c97fe08b7efd3104c2704dcc8dfff726727cd8f70: Status 404 returned error can't find the container with id 3125cf5edeb435e18d9ecf5c97fe08b7efd3104c2704dcc8dfff726727cd8f70 Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.036992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86aa407d-6a73-4ac5-8665-6f8d63302e4d-kube-api-access-6k4dd" (OuterVolumeSpecName: "kube-api-access-6k4dd") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "kube-api-access-6k4dd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.040205 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj"] Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.108067 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.123009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.126597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.128611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-config-data\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.128665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/271908c0-3c66-454e-9dd0-d75cdb71a788-logs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.128972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/271908c0-3c66-454e-9dd0-d75cdb71a788-logs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.128845 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mwb8z\" (UniqueName: \"kubernetes.io/projected/271908c0-3c66-454e-9dd0-d75cdb71a788-kube-api-access-mwb8z\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.130527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-internal-tls-certs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.130563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.130614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-public-tls-certs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131027 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6k4dd\" (UniqueName: \"kubernetes.io/projected/86aa407d-6a73-4ac5-8665-6f8d63302e4d-kube-api-access-6k4dd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131048 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131349 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131445 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131465 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131483 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.131496 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/86aa407d-6a73-4ac5-8665-6f8d63302e4d-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.138026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-internal-tls-certs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.138821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-public-tls-certs\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.143325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.147836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-config-data\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.148821 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.152615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwb8z\" (UniqueName: \"kubernetes.io/projected/271908c0-3c66-454e-9dd0-d75cdb71a788-kube-api-access-mwb8z\") pod \"nova-api-0\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.191058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-config-data" (OuterVolumeSpecName: "config-data") pod "86aa407d-6a73-4ac5-8665-6f8d63302e4d" (UID: "86aa407d-6a73-4ac5-8665-6f8d63302e4d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.232865 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/86aa407d-6a73-4ac5-8665-6f8d63302e4d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.328152 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.328834 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.757741 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.902066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"86aa407d-6a73-4ac5-8665-6f8d63302e4d","Type":"ContainerDied","Data":"9c34154fd13bba593fc0a466fda3df6ad1677c22d5d015d881b477e83a035b3a"} Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.902114 4769 scope.go:117] "RemoveContainer" containerID="69b4fecc77e825dc387b98ad732274c431263b9c81e3a77af1a8e578f7d2edf9" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.902279 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.910905 4769 generic.go:334] "Generic (PLEG): container finished" podID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" exitCode=0 Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.910961 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.910987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"58c34dd3-526f-4fb0-ae03-45f3137e51e9","Type":"ContainerDied","Data":"61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353"} Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.911062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"58c34dd3-526f-4fb0-ae03-45f3137e51e9","Type":"ContainerDied","Data":"77bea137aa5cbd60abeae2d11e257ce5d268d9b487b582d9ec49d3e63a8adb97"} Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.913096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" event={"ID":"397a49d3-b26e-45f8-88d7-c5d37062391a","Type":"ContainerStarted","Data":"4e56e41163f425fd97aa596c4d90c368de03eca2a265ead670dbe976b107d8e4"} Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.913134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" event={"ID":"397a49d3-b26e-45f8-88d7-c5d37062391a","Type":"ContainerStarted","Data":"cb17545442ff5c398e436edf991e85194bfbac9725d461de1af5917847eff80b"} Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.913144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" event={"ID":"397a49d3-b26e-45f8-88d7-c5d37062391a","Type":"ContainerStarted","Data":"3125cf5edeb435e18d9ecf5c97fe08b7efd3104c2704dcc8dfff726727cd8f70"} Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.913888 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.913920 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.915341 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="97649518-fe2e-4273-9062-b5730a0edc17" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076" gracePeriod=30 Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.929083 4769 scope.go:117] "RemoveContainer" containerID="4c5918b5577dd0780532ed7b52d01d3b99c6c0ba464eaf43803a3eb8a71178de" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.945056 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" podStartSLOduration=1.945041113 podStartE2EDuration="1.945041113s" podCreationTimestamp="2025-11-21 13:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:14.939045042 +0000 UTC m=+4173.639706870" watchObservedRunningTime="2025-11-21 13:00:14.945041113 +0000 UTC m=+4173.645702941" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.952717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-combined-ca-bundle\") pod \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.952908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-config-data\") pod \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.952947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75z4f\" (UniqueName: \"kubernetes.io/projected/58c34dd3-526f-4fb0-ae03-45f3137e51e9-kube-api-access-75z4f\") pod \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\" (UID: \"58c34dd3-526f-4fb0-ae03-45f3137e51e9\") " Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.961009 4769 scope.go:117] "RemoveContainer" containerID="d53d60f009ea304c81bf404c12b309b0021ba2f7eb3af01faec520c38556fd27" Nov 21 13:00:14 crc kubenswrapper[4769]: I1121 13:00:14.978299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58c34dd3-526f-4fb0-ae03-45f3137e51e9-kube-api-access-75z4f" (OuterVolumeSpecName: "kube-api-access-75z4f") pod "58c34dd3-526f-4fb0-ae03-45f3137e51e9" (UID: "58c34dd3-526f-4fb0-ae03-45f3137e51e9"). InnerVolumeSpecName "kube-api-access-75z4f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.000347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "58c34dd3-526f-4fb0-ae03-45f3137e51e9" (UID: "58c34dd3-526f-4fb0-ae03-45f3137e51e9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.002467 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.015321 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.027057 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: E1121 13:00:15.027547 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.027561 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.027839 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.028962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-config-data" (OuterVolumeSpecName: "config-data") pod "58c34dd3-526f-4fb0-ae03-45f3137e51e9" (UID: "58c34dd3-526f-4fb0-ae03-45f3137e51e9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.029544 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.032376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.033539 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.034174 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.035618 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.042846 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.056075 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.056115 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/58c34dd3-526f-4fb0-ae03-45f3137e51e9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.056132 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75z4f\" (UniqueName: \"kubernetes.io/projected/58c34dd3-526f-4fb0-ae03-45f3137e51e9-kube-api-access-75z4f\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.089344 4769 scope.go:117] "RemoveContainer" containerID="d4ba11bc2c5175317f3ea50d6435de5762c8087102807a2d83a528cbe9837e96" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.115815 4769 scope.go:117] "RemoveContainer" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.141121 4769 scope.go:117] "RemoveContainer" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" Nov 21 13:00:15 crc kubenswrapper[4769]: E1121 13:00:15.141551 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353\": container with ID starting with 61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353 not found: ID does not exist" containerID="61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.141600 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353"} err="failed to get container status \"61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353\": rpc error: code = NotFound desc = could not find container \"61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353\": container with ID starting with 61cf261b26d346c0e196e613738a46a7dd6376ab541da1795ae1d2fc3b6ca353 not found: ID does not exist" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-scripts\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158201 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d58tz\" (UniqueName: \"kubernetes.io/projected/7c94188a-0e51-4352-af56-ad50d392510d-kube-api-access-d58tz\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-config-data\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-run-httpd\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.158729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-log-httpd\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.247898 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.256849 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-log-httpd\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-scripts\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261482 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d58tz\" (UniqueName: \"kubernetes.io/projected/7c94188a-0e51-4352-af56-ad50d392510d-kube-api-access-d58tz\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-config-data\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.261708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-run-httpd\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.262298 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-run-httpd\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.265437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.266883 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.269819 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.270262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-log-httpd\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.271801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-scripts\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.277627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-config-data\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.278478 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.279013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.287814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.288260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d58tz\" (UniqueName: \"kubernetes.io/projected/7c94188a-0e51-4352-af56-ad50d392510d-kube-api-access-d58tz\") pod \"ceilometer-0\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.290964 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58c34dd3-526f-4fb0-ae03-45f3137e51e9" path="/var/lib/kubelet/pods/58c34dd3-526f-4fb0-ae03-45f3137e51e9/volumes" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.291730 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86aa407d-6a73-4ac5-8665-6f8d63302e4d" path="/var/lib/kubelet/pods/86aa407d-6a73-4ac5-8665-6f8d63302e4d/volumes" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.292766 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3e7dddc-897c-488c-900c-512dc610df64" path="/var/lib/kubelet/pods/e3e7dddc-897c-488c-900c-512dc610df64/volumes" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.293825 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.323766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.391599 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.464303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-config-data\") pod \"774dcba4-ce12-497b-aa79-c08d2d903ac3\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.464365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ngtd\" (UniqueName: \"kubernetes.io/projected/774dcba4-ce12-497b-aa79-c08d2d903ac3-kube-api-access-2ngtd\") pod \"774dcba4-ce12-497b-aa79-c08d2d903ac3\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.464448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-combined-ca-bundle\") pod \"774dcba4-ce12-497b-aa79-c08d2d903ac3\" (UID: \"774dcba4-ce12-497b-aa79-c08d2d903ac3\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.464773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.464902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.464935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ng58\" (UniqueName: \"kubernetes.io/projected/437363a7-1dfd-43b6-9a05-242289d51290-kube-api-access-5ng58\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.470624 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774dcba4-ce12-497b-aa79-c08d2d903ac3-kube-api-access-2ngtd" (OuterVolumeSpecName: "kube-api-access-2ngtd") pod "774dcba4-ce12-497b-aa79-c08d2d903ac3" (UID: "774dcba4-ce12-497b-aa79-c08d2d903ac3"). InnerVolumeSpecName "kube-api-access-2ngtd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.513352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-config-data" (OuterVolumeSpecName: "config-data") pod "774dcba4-ce12-497b-aa79-c08d2d903ac3" (UID: "774dcba4-ce12-497b-aa79-c08d2d903ac3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.513378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "774dcba4-ce12-497b-aa79-c08d2d903ac3" (UID: "774dcba4-ce12-497b-aa79-c08d2d903ac3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.566647 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.566723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5ng58\" (UniqueName: \"kubernetes.io/projected/437363a7-1dfd-43b6-9a05-242289d51290-kube-api-access-5ng58\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.566788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.566904 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.566916 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2ngtd\" (UniqueName: \"kubernetes.io/projected/774dcba4-ce12-497b-aa79-c08d2d903ac3-kube-api-access-2ngtd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.566927 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/774dcba4-ce12-497b-aa79-c08d2d903ac3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.573951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.575338 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.589381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ng58\" (UniqueName: \"kubernetes.io/projected/437363a7-1dfd-43b6-9a05-242289d51290-kube-api-access-5ng58\") pod \"nova-cell0-conductor-0\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.617774 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.723844 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.876659 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-config-data\") pod \"97649518-fe2e-4273-9062-b5730a0edc17\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.877009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-vencrypt-tls-certs\") pod \"97649518-fe2e-4273-9062-b5730a0edc17\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.877073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-nova-novncproxy-tls-certs\") pod \"97649518-fe2e-4273-9062-b5730a0edc17\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.877111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-combined-ca-bundle\") pod \"97649518-fe2e-4273-9062-b5730a0edc17\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.877144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpqql\" (UniqueName: \"kubernetes.io/projected/97649518-fe2e-4273-9062-b5730a0edc17-kube-api-access-lpqql\") pod \"97649518-fe2e-4273-9062-b5730a0edc17\" (UID: \"97649518-fe2e-4273-9062-b5730a0edc17\") " Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.894328 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97649518-fe2e-4273-9062-b5730a0edc17-kube-api-access-lpqql" (OuterVolumeSpecName: "kube-api-access-lpqql") pod "97649518-fe2e-4273-9062-b5730a0edc17" (UID: "97649518-fe2e-4273-9062-b5730a0edc17"). InnerVolumeSpecName "kube-api-access-lpqql". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.898114 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.920325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-config-data" (OuterVolumeSpecName: "config-data") pod "97649518-fe2e-4273-9062-b5730a0edc17" (UID: "97649518-fe2e-4273-9062-b5730a0edc17"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.930324 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97649518-fe2e-4273-9062-b5730a0edc17" (UID: "97649518-fe2e-4273-9062-b5730a0edc17"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.965635 4769 generic.go:334] "Generic (PLEG): container finished" podID="97649518-fe2e-4273-9062-b5730a0edc17" containerID="337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076" exitCode=0 Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.965762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"97649518-fe2e-4273-9062-b5730a0edc17","Type":"ContainerDied","Data":"337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.965837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"97649518-fe2e-4273-9062-b5730a0edc17","Type":"ContainerDied","Data":"4fdb25e62a846d97a9bbd6f1d4e981c1ef233de8964bdab9e25f6eec00ed99fd"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.965908 4769 scope.go:117] "RemoveContainer" containerID="337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.966045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:15 crc kubenswrapper[4769]: W1121 13:00:15.968449 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c94188a_0e51_4352_af56_ad50d392510d.slice/crio-48c9c1e8efeb4c975f46fbc866ed3d5f4b2579006916b7ef196d35659e2a1dd0 WatchSource:0}: Error finding container 48c9c1e8efeb4c975f46fbc866ed3d5f4b2579006916b7ef196d35659e2a1dd0: Status 404 returned error can't find the container with id 48c9c1e8efeb4c975f46fbc866ed3d5f4b2579006916b7ef196d35659e2a1dd0 Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.969851 4769 generic.go:334] "Generic (PLEG): container finished" podID="774dcba4-ce12-497b-aa79-c08d2d903ac3" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" exitCode=0 Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.969909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"774dcba4-ce12-497b-aa79-c08d2d903ac3","Type":"ContainerDied","Data":"59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.969937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"774dcba4-ce12-497b-aa79-c08d2d903ac3","Type":"ContainerDied","Data":"8ebf84ded7418db351ce949c1ff78fd5e1d2d86169feed37c6d5da06559e7d34"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.969986 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.975205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"271908c0-3c66-454e-9dd0-d75cdb71a788","Type":"ContainerStarted","Data":"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.975237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"271908c0-3c66-454e-9dd0-d75cdb71a788","Type":"ContainerStarted","Data":"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.975250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"271908c0-3c66-454e-9dd0-d75cdb71a788","Type":"ContainerStarted","Data":"a702d7e85479f1e8bf90b5cb6ddbfbd58dffa843ba193664fd768ac9a995b5ac"} Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.975341 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-log" containerID="cri-o://1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32" gracePeriod=30 Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.975428 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-api" containerID="cri-o://a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465" gracePeriod=30 Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.992458 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.992477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "97649518-fe2e-4273-9062-b5730a0edc17" (UID: "97649518-fe2e-4273-9062-b5730a0edc17"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.993939 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.997071 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.997086 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lpqql\" (UniqueName: \"kubernetes.io/projected/97649518-fe2e-4273-9062-b5730a0edc17-kube-api-access-lpqql\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.997097 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:15 crc kubenswrapper[4769]: I1121 13:00:15.999245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "97649518-fe2e-4273-9062-b5730a0edc17" (UID: "97649518-fe2e-4273-9062-b5730a0edc17"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.005269 4769 scope.go:117] "RemoveContainer" containerID="337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076" Nov 21 13:00:16 crc kubenswrapper[4769]: E1121 13:00:16.005765 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076\": container with ID starting with 337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076 not found: ID does not exist" containerID="337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.005844 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076"} err="failed to get container status \"337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076\": rpc error: code = NotFound desc = could not find container \"337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076\": container with ID starting with 337561d14d22070e6e521b7baa52f838f000671bade7798f8efb9a47ef6ab076 not found: ID does not exist" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.005901 4769 scope.go:117] "RemoveContainer" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.040369 4769 scope.go:117] "RemoveContainer" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" Nov 21 13:00:16 crc kubenswrapper[4769]: E1121 13:00:16.042067 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3\": container with ID starting with 59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3 not found: ID does not exist" containerID="59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.042220 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3"} err="failed to get container status \"59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3\": rpc error: code = NotFound desc = could not find container \"59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3\": container with ID starting with 59457e492c65bb189f33be85588210a31b4237abdd5f59141c208b08a30d06e3 not found: ID does not exist" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.051244 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.051229355 podStartE2EDuration="3.051229355s" podCreationTimestamp="2025-11-21 13:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:16.021137094 +0000 UTC m=+4174.721798912" watchObservedRunningTime="2025-11-21 13:00:16.051229355 +0000 UTC m=+4174.751891173" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.087851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.098843 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/97649518-fe2e-4273-9062-b5730a0edc17-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.099259 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.108840 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: E1121 13:00:16.109349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="774dcba4-ce12-497b-aa79-c08d2d903ac3" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.109363 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="774dcba4-ce12-497b-aa79-c08d2d903ac3" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:16 crc kubenswrapper[4769]: E1121 13:00:16.109398 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97649518-fe2e-4273-9062-b5730a0edc17" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.109406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97649518-fe2e-4273-9062-b5730a0edc17" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.109586 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="97649518-fe2e-4273-9062-b5730a0edc17" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.109605 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="774dcba4-ce12-497b-aa79-c08d2d903ac3" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.110277 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.117736 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.133431 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.176869 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.204480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.204873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.204977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wmrv\" (UniqueName: \"kubernetes.io/projected/fabf6607-e925-4874-a6f7-6a208f73022a-kube-api-access-9wmrv\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.306249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.306316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmrv\" (UniqueName: \"kubernetes.io/projected/fabf6607-e925-4874-a6f7-6a208f73022a-kube-api-access-9wmrv\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.306401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.312999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.314998 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.331174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wmrv\" (UniqueName: \"kubernetes.io/projected/fabf6607-e925-4874-a6f7-6a208f73022a-kube-api-access-9wmrv\") pod \"nova-cell1-conductor-0\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.336795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.347491 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.364746 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.366061 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.374824 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.376976 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.377090 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.377346 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.448763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.509853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.509905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.509974 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f32c73bf-f749-40ff-a102-7e7e1412c0f8-kube-api-access-kqnqv\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.510023 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.510054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.535408 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.535470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.566904 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.611383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.611432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.611476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.611508 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.611566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f32c73bf-f749-40ff-a102-7e7e1412c0f8-kube-api-access-kqnqv\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.616507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.617166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.618255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.630387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f32c73bf-f749-40ff-a102-7e7e1412c0f8-kube-api-access-kqnqv\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.639838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.699637 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.712201 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-config-data\") pod \"271908c0-3c66-454e-9dd0-d75cdb71a788\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.712320 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-combined-ca-bundle\") pod \"271908c0-3c66-454e-9dd0-d75cdb71a788\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.712410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-internal-tls-certs\") pod \"271908c0-3c66-454e-9dd0-d75cdb71a788\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.712435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/271908c0-3c66-454e-9dd0-d75cdb71a788-logs\") pod \"271908c0-3c66-454e-9dd0-d75cdb71a788\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.712454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwb8z\" (UniqueName: \"kubernetes.io/projected/271908c0-3c66-454e-9dd0-d75cdb71a788-kube-api-access-mwb8z\") pod \"271908c0-3c66-454e-9dd0-d75cdb71a788\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.712559 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-public-tls-certs\") pod \"271908c0-3c66-454e-9dd0-d75cdb71a788\" (UID: \"271908c0-3c66-454e-9dd0-d75cdb71a788\") " Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.715630 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271908c0-3c66-454e-9dd0-d75cdb71a788-logs" (OuterVolumeSpecName: "logs") pod "271908c0-3c66-454e-9dd0-d75cdb71a788" (UID: "271908c0-3c66-454e-9dd0-d75cdb71a788"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.715993 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/271908c0-3c66-454e-9dd0-d75cdb71a788-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.729402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271908c0-3c66-454e-9dd0-d75cdb71a788-kube-api-access-mwb8z" (OuterVolumeSpecName: "kube-api-access-mwb8z") pod "271908c0-3c66-454e-9dd0-d75cdb71a788" (UID: "271908c0-3c66-454e-9dd0-d75cdb71a788"). InnerVolumeSpecName "kube-api-access-mwb8z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.774493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "271908c0-3c66-454e-9dd0-d75cdb71a788" (UID: "271908c0-3c66-454e-9dd0-d75cdb71a788"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.774541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-config-data" (OuterVolumeSpecName: "config-data") pod "271908c0-3c66-454e-9dd0-d75cdb71a788" (UID: "271908c0-3c66-454e-9dd0-d75cdb71a788"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.809227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "271908c0-3c66-454e-9dd0-d75cdb71a788" (UID: "271908c0-3c66-454e-9dd0-d75cdb71a788"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.813392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "271908c0-3c66-454e-9dd0-d75cdb71a788" (UID: "271908c0-3c66-454e-9dd0-d75cdb71a788"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.817333 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.817379 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.817391 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.817400 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/271908c0-3c66-454e-9dd0-d75cdb71a788-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.817410 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mwb8z\" (UniqueName: \"kubernetes.io/projected/271908c0-3c66-454e-9dd0-d75cdb71a788-kube-api-access-mwb8z\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.914453 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.952236 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.972747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:16 crc kubenswrapper[4769]: I1121 13:00:16.982351 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019594 4769 generic.go:334] "Generic (PLEG): container finished" podID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerID="a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465" exitCode=0 Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019626 4769 generic.go:334] "Generic (PLEG): container finished" podID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerID="1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32" exitCode=143 Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"271908c0-3c66-454e-9dd0-d75cdb71a788","Type":"ContainerDied","Data":"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"271908c0-3c66-454e-9dd0-d75cdb71a788","Type":"ContainerDied","Data":"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"271908c0-3c66-454e-9dd0-d75cdb71a788","Type":"ContainerDied","Data":"a702d7e85479f1e8bf90b5cb6ddbfbd58dffa843ba193664fd768ac9a995b5ac"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019725 4769 scope.go:117] "RemoveContainer" containerID="a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.019823 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.030756 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerStarted","Data":"b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.030794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerStarted","Data":"48c9c1e8efeb4c975f46fbc866ed3d5f4b2579006916b7ef196d35659e2a1dd0"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.031803 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fabf6607-e925-4874-a6f7-6a208f73022a","Type":"ContainerStarted","Data":"f0850eb2329330bfba20afa8013f8b0db4a1333f6fe8dc27ca0678dcac7cf98d"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.038760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"437363a7-1dfd-43b6-9a05-242289d51290","Type":"ContainerStarted","Data":"f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.038798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"437363a7-1dfd-43b6-9a05-242289d51290","Type":"ContainerStarted","Data":"81b4b971c5634a1878ae983c83b3f511b06a3cfb7194210f3c19f4b01c7bd3a2"} Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.038939 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.064869 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.064843304 podStartE2EDuration="2.064843304s" podCreationTimestamp="2025-11-21 13:00:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:17.053103657 +0000 UTC m=+4175.753765475" watchObservedRunningTime="2025-11-21 13:00:17.064843304 +0000 UTC m=+4175.765505122" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.071153 4769 scope.go:117] "RemoveContainer" containerID="1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.104643 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.118779 4769 scope.go:117] "RemoveContainer" containerID="a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465" Nov 21 13:00:17 crc kubenswrapper[4769]: E1121 13:00:17.120807 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465\": container with ID starting with a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465 not found: ID does not exist" containerID="a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.120837 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465"} err="failed to get container status \"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465\": rpc error: code = NotFound desc = could not find container \"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465\": container with ID starting with a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465 not found: ID does not exist" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.120857 4769 scope.go:117] "RemoveContainer" containerID="1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32" Nov 21 13:00:17 crc kubenswrapper[4769]: E1121 13:00:17.121201 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32\": container with ID starting with 1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32 not found: ID does not exist" containerID="1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.121228 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32"} err="failed to get container status \"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32\": rpc error: code = NotFound desc = could not find container \"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32\": container with ID starting with 1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32 not found: ID does not exist" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.121242 4769 scope.go:117] "RemoveContainer" containerID="a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.121581 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465"} err="failed to get container status \"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465\": rpc error: code = NotFound desc = could not find container \"a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465\": container with ID starting with a3e4767532eacb5e8efd48bfe5b84f34687bec8f348d0554b574a12ce64a3465 not found: ID does not exist" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.121601 4769 scope.go:117] "RemoveContainer" containerID="1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.122109 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32"} err="failed to get container status \"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32\": rpc error: code = NotFound desc = could not find container \"1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32\": container with ID starting with 1da1fcfd45ea21ebbde25b6fe69f4af2c34e748071d8c549d076e15019bd8f32 not found: ID does not exist" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.133234 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.142005 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: E1121 13:00:17.142583 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-log" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.142636 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-log" Nov 21 13:00:17 crc kubenswrapper[4769]: E1121 13:00:17.142707 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-api" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.142719 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-api" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.142977 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-api" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.143036 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" containerName="nova-api-log" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.144416 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.146823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.146869 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.147561 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.149694 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.188256 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: W1121 13:00:17.191521 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf32c73bf_f749_40ff_a102_7e7e1412c0f8.slice/crio-463d27ead44f79a39b19aead76f58107f0c5ea8952f7b6c8e6ea3276baee405e WatchSource:0}: Error finding container 463d27ead44f79a39b19aead76f58107f0c5ea8952f7b6c8e6ea3276baee405e: Status 404 returned error can't find the container with id 463d27ead44f79a39b19aead76f58107f0c5ea8952f7b6c8e6ea3276baee405e Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.287254 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="271908c0-3c66-454e-9dd0-d75cdb71a788" path="/var/lib/kubelet/pods/271908c0-3c66-454e-9dd0-d75cdb71a788/volumes" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.290159 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774dcba4-ce12-497b-aa79-c08d2d903ac3" path="/var/lib/kubelet/pods/774dcba4-ce12-497b-aa79-c08d2d903ac3/volumes" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.291061 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97649518-fe2e-4273-9062-b5730a0edc17" path="/var/lib/kubelet/pods/97649518-fe2e-4273-9062-b5730a0edc17/volumes" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.332731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.332785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.332822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-config-data\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.332921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqdz\" (UniqueName: \"kubernetes.io/projected/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-kube-api-access-nhqdz\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.332985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-logs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.333021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-public-tls-certs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.434371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.434415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.434448 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-config-data\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.434485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqdz\" (UniqueName: \"kubernetes.io/projected/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-kube-api-access-nhqdz\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.434521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-logs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.434539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-public-tls-certs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.435618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-logs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.438829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-public-tls-certs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.439156 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-config-data\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.439578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.439811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.459703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqdz\" (UniqueName: \"kubernetes.io/projected/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-kube-api-access-nhqdz\") pod \"nova-api-0\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.477007 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:17 crc kubenswrapper[4769]: I1121 13:00:17.977324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:00:17 crc kubenswrapper[4769]: W1121 13:00:17.981097 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93ff2c8a_0d89_42ea_bf5a_8928949f45f5.slice/crio-57bb9b422f1e9e5fd36eef1777a136e4ff94c63f22d5c1f2d433a14d210fe30d WatchSource:0}: Error finding container 57bb9b422f1e9e5fd36eef1777a136e4ff94c63f22d5c1f2d433a14d210fe30d: Status 404 returned error can't find the container with id 57bb9b422f1e9e5fd36eef1777a136e4ff94c63f22d5c1f2d433a14d210fe30d Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.060685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"93ff2c8a-0d89-42ea-bf5a-8928949f45f5","Type":"ContainerStarted","Data":"57bb9b422f1e9e5fd36eef1777a136e4ff94c63f22d5c1f2d433a14d210fe30d"} Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.077077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerStarted","Data":"4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9"} Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.077133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerStarted","Data":"bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc"} Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.086219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fabf6607-e925-4874-a6f7-6a208f73022a","Type":"ContainerStarted","Data":"63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d"} Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.086298 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" containerID="cri-o://63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" gracePeriod=30 Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.086354 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.092239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32c73bf-f749-40ff-a102-7e7e1412c0f8","Type":"ContainerStarted","Data":"a1e11a154c6872b8be3a330b82f81aca6a964f81b1d4643523979961390e0b2f"} Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.092295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32c73bf-f749-40ff-a102-7e7e1412c0f8","Type":"ContainerStarted","Data":"463d27ead44f79a39b19aead76f58107f0c5ea8952f7b6c8e6ea3276baee405e"} Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.092309 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="f32c73bf-f749-40ff-a102-7e7e1412c0f8" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a1e11a154c6872b8be3a330b82f81aca6a964f81b1d4643523979961390e0b2f" gracePeriod=30 Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.092429 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" containerID="cri-o://f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" gracePeriod=30 Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.101856 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.101840122 podStartE2EDuration="2.101840122s" podCreationTimestamp="2025-11-21 13:00:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:18.099766127 +0000 UTC m=+4176.800427945" watchObservedRunningTime="2025-11-21 13:00:18.101840122 +0000 UTC m=+4176.802501940" Nov 21 13:00:18 crc kubenswrapper[4769]: I1121 13:00:18.120171 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.120156716 podStartE2EDuration="2.120156716s" podCreationTimestamp="2025-11-21 13:00:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:18.116852767 +0000 UTC m=+4176.817514585" watchObservedRunningTime="2025-11-21 13:00:18.120156716 +0000 UTC m=+4176.820818534" Nov 21 13:00:19 crc kubenswrapper[4769]: I1121 13:00:19.101781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"93ff2c8a-0d89-42ea-bf5a-8928949f45f5","Type":"ContainerStarted","Data":"02efc9c3fec36d6b1b0eff3340763771cd222e2a3d33e5bc23ff7890c47108ce"} Nov 21 13:00:19 crc kubenswrapper[4769]: I1121 13:00:19.102149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"93ff2c8a-0d89-42ea-bf5a-8928949f45f5","Type":"ContainerStarted","Data":"c544c917dd6e2d302bedf189bf2e810df12ac84a603b727fb7df892acd3f80ed"} Nov 21 13:00:19 crc kubenswrapper[4769]: I1121 13:00:19.133836 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.133801785 podStartE2EDuration="2.133801785s" podCreationTimestamp="2025-11-21 13:00:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:19.125511912 +0000 UTC m=+4177.826173750" watchObservedRunningTime="2025-11-21 13:00:19.133801785 +0000 UTC m=+4177.834463603" Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.121268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerStarted","Data":"8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca"} Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.121658 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.121478 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-notification-agent" containerID="cri-o://bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc" gracePeriod=30 Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.121459 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-central-agent" containerID="cri-o://b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5" gracePeriod=30 Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.121503 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="proxy-httpd" containerID="cri-o://8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca" gracePeriod=30 Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.121569 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="sg-core" containerID="cri-o://4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9" gracePeriod=30 Nov 21 13:00:20 crc kubenswrapper[4769]: I1121 13:00:20.160984 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.610312302 podStartE2EDuration="6.160955079s" podCreationTimestamp="2025-11-21 13:00:14 +0000 UTC" firstStartedPulling="2025-11-21 13:00:15.971688942 +0000 UTC m=+4174.672350760" lastFinishedPulling="2025-11-21 13:00:19.522331719 +0000 UTC m=+4178.222993537" observedRunningTime="2025-11-21 13:00:20.153420976 +0000 UTC m=+4178.854082814" watchObservedRunningTime="2025-11-21 13:00:20.160955079 +0000 UTC m=+4178.861616937" Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.135156 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c94188a-0e51-4352-af56-ad50d392510d" containerID="8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca" exitCode=0 Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.135467 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c94188a-0e51-4352-af56-ad50d392510d" containerID="4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9" exitCode=2 Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.135477 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c94188a-0e51-4352-af56-ad50d392510d" containerID="bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc" exitCode=0 Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.135500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerDied","Data":"8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca"} Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.135529 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerDied","Data":"4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9"} Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.135541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerDied","Data":"bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc"} Nov 21 13:00:21 crc kubenswrapper[4769]: I1121 13:00:21.700315 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:23 crc kubenswrapper[4769]: I1121 13:00:23.597060 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:23 crc kubenswrapper[4769]: I1121 13:00:23.600411 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:00:23 crc kubenswrapper[4769]: I1121 13:00:23.720180 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5645df8756-s688r"] Nov 21 13:00:23 crc kubenswrapper[4769]: I1121 13:00:23.720474 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-httpd" containerID="cri-o://b958084b22d5e5c902b0d39ef3707faa4343759b5d121c4d9ef3c4e372fc80e6" gracePeriod=30 Nov 21 13:00:23 crc kubenswrapper[4769]: I1121 13:00:23.721134 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-server" containerID="cri-o://a1c627ae9438d556354ccf2473d66d3b2a1e469c12e1c9c9e9594c8f78139e19" gracePeriod=30 Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.176575 4769 generic.go:334] "Generic (PLEG): container finished" podID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerID="a1c627ae9438d556354ccf2473d66d3b2a1e469c12e1c9c9e9594c8f78139e19" exitCode=0 Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.176606 4769 generic.go:334] "Generic (PLEG): container finished" podID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerID="b958084b22d5e5c902b0d39ef3707faa4343759b5d121c4d9ef3c4e372fc80e6" exitCode=0 Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.177541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" event={"ID":"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608","Type":"ContainerDied","Data":"a1c627ae9438d556354ccf2473d66d3b2a1e469c12e1c9c9e9594c8f78139e19"} Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.177570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" event={"ID":"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608","Type":"ContainerDied","Data":"b958084b22d5e5c902b0d39ef3707faa4343759b5d121c4d9ef3c4e372fc80e6"} Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.591118 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.713438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-etc-swift\") pod \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.713478 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-combined-ca-bundle\") pod \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.713572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-log-httpd\") pod \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.713604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-run-httpd\") pod \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.713646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-config-data\") pod \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.713664 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tcfr\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-kube-api-access-2tcfr\") pod \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\" (UID: \"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608\") " Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.714044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" (UID: "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.714128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" (UID: "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.714649 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.714689 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.719254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" (UID: "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.748960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-kube-api-access-2tcfr" (OuterVolumeSpecName: "kube-api-access-2tcfr") pod "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" (UID: "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608"). InnerVolumeSpecName "kube-api-access-2tcfr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.816307 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2tcfr\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-kube-api-access-2tcfr\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.816344 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.823496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-config-data" (OuterVolumeSpecName: "config-data") pod "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" (UID: "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.860527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" (UID: "744d6ac0-f9fd-4e4c-8b42-b12ef1b53608"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.917837 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:24 crc kubenswrapper[4769]: I1121 13:00:24.917871 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.186707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" event={"ID":"744d6ac0-f9fd-4e4c-8b42-b12ef1b53608","Type":"ContainerDied","Data":"19bc3a3a55df070217867d614628c40efce1bbe851e66f4050b95927b73686d0"} Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.186751 4769 scope.go:117] "RemoveContainer" containerID="a1c627ae9438d556354ccf2473d66d3b2a1e469c12e1c9c9e9594c8f78139e19" Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.186861 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5645df8756-s688r" Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.215602 4769 scope.go:117] "RemoveContainer" containerID="b958084b22d5e5c902b0d39ef3707faa4343759b5d121c4d9ef3c4e372fc80e6" Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.224460 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5645df8756-s688r"] Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.233260 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5645df8756-s688r"] Nov 21 13:00:25 crc kubenswrapper[4769]: I1121 13:00:25.285044 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" path="/var/lib/kubelet/pods/744d6ac0-f9fd-4e4c-8b42-b12ef1b53608/volumes" Nov 21 13:00:25 crc kubenswrapper[4769]: E1121 13:00:25.620676 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:25 crc kubenswrapper[4769]: E1121 13:00:25.622570 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:25 crc kubenswrapper[4769]: E1121 13:00:25.623921 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:25 crc kubenswrapper[4769]: E1121 13:00:25.623956 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:26 crc kubenswrapper[4769]: E1121 13:00:26.451796 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:26 crc kubenswrapper[4769]: E1121 13:00:26.454728 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:26 crc kubenswrapper[4769]: E1121 13:00:26.456335 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:26 crc kubenswrapper[4769]: E1121 13:00:26.456402 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:26 crc kubenswrapper[4769]: I1121 13:00:26.965773 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.062563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-run-httpd\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.062693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-sg-core-conf-yaml\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.062781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d58tz\" (UniqueName: \"kubernetes.io/projected/7c94188a-0e51-4352-af56-ad50d392510d-kube-api-access-d58tz\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.062873 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-ceilometer-tls-certs\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.062946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-log-httpd\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.063059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-config-data\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.063086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.063175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-scripts\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.063322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-combined-ca-bundle\") pod \"7c94188a-0e51-4352-af56-ad50d392510d\" (UID: \"7c94188a-0e51-4352-af56-ad50d392510d\") " Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.064357 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.065644 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.080076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c94188a-0e51-4352-af56-ad50d392510d-kube-api-access-d58tz" (OuterVolumeSpecName: "kube-api-access-d58tz") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "kube-api-access-d58tz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.080608 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-scripts" (OuterVolumeSpecName: "scripts") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.113065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.142505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.166388 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.166703 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7c94188a-0e51-4352-af56-ad50d392510d-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.166826 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.166951 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.167064 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d58tz\" (UniqueName: \"kubernetes.io/projected/7c94188a-0e51-4352-af56-ad50d392510d-kube-api-access-d58tz\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.187413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.196661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-config-data" (OuterVolumeSpecName: "config-data") pod "7c94188a-0e51-4352-af56-ad50d392510d" (UID: "7c94188a-0e51-4352-af56-ad50d392510d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.218943 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c94188a-0e51-4352-af56-ad50d392510d" containerID="b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5" exitCode=0 Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.218995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerDied","Data":"b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5"} Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.219027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7c94188a-0e51-4352-af56-ad50d392510d","Type":"ContainerDied","Data":"48c9c1e8efeb4c975f46fbc866ed3d5f4b2579006916b7ef196d35659e2a1dd0"} Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.219048 4769 scope.go:117] "RemoveContainer" containerID="8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.219971 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.244997 4769 scope.go:117] "RemoveContainer" containerID="4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.270079 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.270223 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c94188a-0e51-4352-af56-ad50d392510d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.294542 4769 scope.go:117] "RemoveContainer" containerID="bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.305154 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.305266 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.329658 4769 scope.go:117] "RemoveContainer" containerID="b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.378628 4769 scope.go:117] "RemoveContainer" containerID="8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380161 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.380807 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="sg-core" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380828 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="sg-core" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.380853 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-httpd" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380861 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-httpd" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.380902 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-notification-agent" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380911 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-notification-agent" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.380928 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="proxy-httpd" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380936 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="proxy-httpd" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.380948 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-server" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380956 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-server" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.380968 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-central-agent" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.380976 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-central-agent" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381209 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-httpd" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381231 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="sg-core" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381249 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="proxy-httpd" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381271 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-central-agent" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381283 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="744d6ac0-f9fd-4e4c-8b42-b12ef1b53608" containerName="proxy-server" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381298 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c94188a-0e51-4352-af56-ad50d392510d" containerName="ceilometer-notification-agent" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.381531 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca\": container with ID starting with 8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca not found: ID does not exist" containerID="8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381621 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca"} err="failed to get container status \"8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca\": rpc error: code = NotFound desc = could not find container \"8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca\": container with ID starting with 8ebda35ef6cef5f698d3ce7135387225986c31f5a7a6ca1fa211d459290c61ca not found: ID does not exist" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.381707 4769 scope.go:117] "RemoveContainer" containerID="4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.385382 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.388161 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.388882 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9\": container with ID starting with 4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9 not found: ID does not exist" containerID="4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.388930 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9"} err="failed to get container status \"4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9\": rpc error: code = NotFound desc = could not find container \"4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9\": container with ID starting with 4cc40511a62e8e4109abdf8eba5b7465ccc41a471ae814cec15db38dd122e1f9 not found: ID does not exist" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.388959 4769 scope.go:117] "RemoveContainer" containerID="bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.389266 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.389482 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc\": container with ID starting with bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc not found: ID does not exist" containerID="bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.389551 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc"} err="failed to get container status \"bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc\": rpc error: code = NotFound desc = could not find container \"bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc\": container with ID starting with bcdf8752604a8631a2ac247c7b01494f3e3b8b14c5d37a825a732c6b0c3175fc not found: ID does not exist" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.389593 4769 scope.go:117] "RemoveContainer" containerID="b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.390637 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:00:27 crc kubenswrapper[4769]: E1121 13:00:27.391253 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5\": container with ID starting with b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5 not found: ID does not exist" containerID="b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.391379 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5"} err="failed to get container status \"b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5\": rpc error: code = NotFound desc = could not find container \"b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5\": container with ID starting with b713415b8e867be1ab15f969141ac13f236ed6bbb368939ddcd8fb6c5800f6d5 not found: ID does not exist" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.392498 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.473963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-config-data\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcmlq\" (UniqueName: \"kubernetes.io/projected/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-kube-api-access-dcmlq\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-scripts\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-log-httpd\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.474706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-run-httpd\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.478302 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.478339 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.576517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.576916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.576962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dcmlq\" (UniqueName: \"kubernetes.io/projected/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-kube-api-access-dcmlq\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.576988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-scripts\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.577041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-log-httpd\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.577116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-run-httpd\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.577212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.577243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-config-data\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.578746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-run-httpd\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.578800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-log-httpd\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.584346 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.585303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-config-data\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.586418 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-scripts\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.587574 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.588511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.600685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcmlq\" (UniqueName: \"kubernetes.io/projected/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-kube-api-access-dcmlq\") pod \"ceilometer-0\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:27 crc kubenswrapper[4769]: I1121 13:00:27.713113 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:28 crc kubenswrapper[4769]: I1121 13:00:28.273906 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:00:28 crc kubenswrapper[4769]: I1121 13:00:28.300661 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:00:28 crc kubenswrapper[4769]: I1121 13:00:28.493501 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.187:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:00:28 crc kubenswrapper[4769]: I1121 13:00:28.493559 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.187:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:00:29 crc kubenswrapper[4769]: I1121 13:00:29.254965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerStarted","Data":"44d99dd463ffaac00fd75a3598f2d6466b372fcd567be135e4c6dc8366dc4a48"} Nov 21 13:00:29 crc kubenswrapper[4769]: I1121 13:00:29.303094 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c94188a-0e51-4352-af56-ad50d392510d" path="/var/lib/kubelet/pods/7c94188a-0e51-4352-af56-ad50d392510d/volumes" Nov 21 13:00:30 crc kubenswrapper[4769]: I1121 13:00:30.267615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerStarted","Data":"4f928b644488d4a360447741ffe8fedd5c00337fe2eaba4fa016957e725491e2"} Nov 21 13:00:30 crc kubenswrapper[4769]: E1121 13:00:30.621537 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:30 crc kubenswrapper[4769]: E1121 13:00:30.624019 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:30 crc kubenswrapper[4769]: E1121 13:00:30.626010 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:30 crc kubenswrapper[4769]: E1121 13:00:30.626054 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:31 crc kubenswrapper[4769]: I1121 13:00:31.295407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerStarted","Data":"d053a37dbdd2a57dda79a762d52fcccf37c4606694e35ee18c386a0f4920d3d1"} Nov 21 13:00:31 crc kubenswrapper[4769]: E1121 13:00:31.453124 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:31 crc kubenswrapper[4769]: E1121 13:00:31.455592 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:31 crc kubenswrapper[4769]: E1121 13:00:31.457611 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:31 crc kubenswrapper[4769]: E1121 13:00:31.457645 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:32 crc kubenswrapper[4769]: I1121 13:00:32.298691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerStarted","Data":"c445a56c6e8faf1352fa571c77899599bfa33d8e9f320242b15676c75b7a1c41"} Nov 21 13:00:33 crc kubenswrapper[4769]: I1121 13:00:33.320379 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerStarted","Data":"7d9318bf8c25495f7148a04e86c1b278caa519b9123ecdcf89fc09403b562cd1"} Nov 21 13:00:33 crc kubenswrapper[4769]: I1121 13:00:33.321348 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:00:33 crc kubenswrapper[4769]: I1121 13:00:33.398445 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.835649527 podStartE2EDuration="6.398423154s" podCreationTimestamp="2025-11-21 13:00:27 +0000 UTC" firstStartedPulling="2025-11-21 13:00:28.300385152 +0000 UTC m=+4187.001046990" lastFinishedPulling="2025-11-21 13:00:32.863158769 +0000 UTC m=+4191.563820617" observedRunningTime="2025-11-21 13:00:33.398388253 +0000 UTC m=+4192.099050091" watchObservedRunningTime="2025-11-21 13:00:33.398423154 +0000 UTC m=+4192.099084972" Nov 21 13:00:34 crc kubenswrapper[4769]: I1121 13:00:34.472628 4769 scope.go:117] "RemoveContainer" containerID="02cc1f796dfba269f92633364bb02dd8fd9b9eea72f6f9f4591e92bd0e8de721" Nov 21 13:00:34 crc kubenswrapper[4769]: I1121 13:00:34.531079 4769 scope.go:117] "RemoveContainer" containerID="dc6181ce343e2ac32ac1c80a418929bd90f6b97c8565cb06d4e03c9a70a744ea" Nov 21 13:00:35 crc kubenswrapper[4769]: E1121 13:00:35.620705 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:35 crc kubenswrapper[4769]: E1121 13:00:35.622415 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:35 crc kubenswrapper[4769]: E1121 13:00:35.624211 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:35 crc kubenswrapper[4769]: E1121 13:00:35.624266 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:36 crc kubenswrapper[4769]: E1121 13:00:36.452108 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:36 crc kubenswrapper[4769]: E1121 13:00:36.454678 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:36 crc kubenswrapper[4769]: E1121 13:00:36.456757 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:36 crc kubenswrapper[4769]: E1121 13:00:36.456801 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:37 crc kubenswrapper[4769]: I1121 13:00:37.498903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:37 crc kubenswrapper[4769]: I1121 13:00:37.499633 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:37 crc kubenswrapper[4769]: I1121 13:00:37.502143 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:37 crc kubenswrapper[4769]: I1121 13:00:37.514681 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:38 crc kubenswrapper[4769]: I1121 13:00:38.397497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:38 crc kubenswrapper[4769]: I1121 13:00:38.408568 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:00:40 crc kubenswrapper[4769]: E1121 13:00:40.620315 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:40 crc kubenswrapper[4769]: E1121 13:00:40.621904 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:40 crc kubenswrapper[4769]: E1121 13:00:40.623563 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:40 crc kubenswrapper[4769]: E1121 13:00:40.623600 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.286951 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.325221 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.325296 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.406325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f7tj\" (UniqueName: \"kubernetes.io/projected/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-kube-api-access-6f7tj\") pod \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.406579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-combined-ca-bundle\") pod \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.406649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-config-data\") pod \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\" (UID: \"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88\") " Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.415819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-kube-api-access-6f7tj" (OuterVolumeSpecName: "kube-api-access-6f7tj") pod "db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" (UID: "db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88"). InnerVolumeSpecName "kube-api-access-6f7tj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.427629 4769 generic.go:334] "Generic (PLEG): container finished" podID="db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" containerID="c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09" exitCode=137 Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.427680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88","Type":"ContainerDied","Data":"c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09"} Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.427710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88","Type":"ContainerDied","Data":"10b655c97466442cfb6587b4acd0f83d8c235e0b32f7fd3d02faafbe86a01e26"} Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.427730 4769 scope.go:117] "RemoveContainer" containerID="c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.427868 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.432871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-config-data" (OuterVolumeSpecName: "config-data") pod "db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" (UID: "db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:41 crc kubenswrapper[4769]: E1121 13:00:41.451249 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:41 crc kubenswrapper[4769]: E1121 13:00:41.454435 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.456371 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" (UID: "db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:41 crc kubenswrapper[4769]: E1121 13:00:41.457100 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:41 crc kubenswrapper[4769]: E1121 13:00:41.457148 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.509382 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6f7tj\" (UniqueName: \"kubernetes.io/projected/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-kube-api-access-6f7tj\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.509423 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.509436 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.552278 4769 scope.go:117] "RemoveContainer" containerID="c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09" Nov 21 13:00:41 crc kubenswrapper[4769]: E1121 13:00:41.552951 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09\": container with ID starting with c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09 not found: ID does not exist" containerID="c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.553010 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09"} err="failed to get container status \"c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09\": rpc error: code = NotFound desc = could not find container \"c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09\": container with ID starting with c37c21211937f744a0e50bb1637845241eeecd4fb859b97bf288f680e1080b09 not found: ID does not exist" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.777399 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.788033 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.797909 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:41 crc kubenswrapper[4769]: E1121 13:00:41.798446 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" containerName="nova-scheduler-scheduler" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.798481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" containerName="nova-scheduler-scheduler" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.798766 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" containerName="nova-scheduler-scheduler" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.799777 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.801713 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.843345 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.925355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhf6\" (UniqueName: \"kubernetes.io/projected/d1a91e92-f4a2-4279-aa88-caf6df42d841-kube-api-access-zbhf6\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.925461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:41 crc kubenswrapper[4769]: I1121 13:00:41.925548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-config-data\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.027394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-config-data\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.027557 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhf6\" (UniqueName: \"kubernetes.io/projected/d1a91e92-f4a2-4279-aa88-caf6df42d841-kube-api-access-zbhf6\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.027612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.033846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.041793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-config-data\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.052708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhf6\" (UniqueName: \"kubernetes.io/projected/d1a91e92-f4a2-4279-aa88-caf6df42d841-kube-api-access-zbhf6\") pod \"nova-scheduler-0\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.137344 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:42 crc kubenswrapper[4769]: I1121 13:00:42.670938 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.315381 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88" path="/var/lib/kubelet/pods/db5d3ac4-b6cb-442a-8cd3-e0d4cefc8e88/volumes" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.335063 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.450943 4769 generic.go:334] "Generic (PLEG): container finished" podID="4eab576c-8718-41de-a0de-d85b206edba4" containerID="906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e" exitCode=137 Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.451050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4eab576c-8718-41de-a0de-d85b206edba4","Type":"ContainerDied","Data":"906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e"} Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.451112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"4eab576c-8718-41de-a0de-d85b206edba4","Type":"ContainerDied","Data":"6bc531cca67dd2ca4391ce13ab128912102284949cd0f5f50591cf148c1ea0c5"} Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.451135 4769 scope.go:117] "RemoveContainer" containerID="906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.451369 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.454169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d1a91e92-f4a2-4279-aa88-caf6df42d841","Type":"ContainerStarted","Data":"0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3"} Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.454202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d1a91e92-f4a2-4279-aa88-caf6df42d841","Type":"ContainerStarted","Data":"404d5c9f5b2b0c6e04d1e94fbeca1c07e8f4c4f393ee17b76b87282dc54b0def"} Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.471805 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.471789453 podStartE2EDuration="2.471789453s" podCreationTimestamp="2025-11-21 13:00:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:43.468226487 +0000 UTC m=+4202.168888335" watchObservedRunningTime="2025-11-21 13:00:43.471789453 +0000 UTC m=+4202.172451261" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.476812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-nova-metadata-tls-certs\") pod \"4eab576c-8718-41de-a0de-d85b206edba4\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.476924 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wqhn\" (UniqueName: \"kubernetes.io/projected/4eab576c-8718-41de-a0de-d85b206edba4-kube-api-access-2wqhn\") pod \"4eab576c-8718-41de-a0de-d85b206edba4\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.476954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-config-data\") pod \"4eab576c-8718-41de-a0de-d85b206edba4\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.476982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-combined-ca-bundle\") pod \"4eab576c-8718-41de-a0de-d85b206edba4\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.477062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4eab576c-8718-41de-a0de-d85b206edba4-logs\") pod \"4eab576c-8718-41de-a0de-d85b206edba4\" (UID: \"4eab576c-8718-41de-a0de-d85b206edba4\") " Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.477867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eab576c-8718-41de-a0de-d85b206edba4-logs" (OuterVolumeSpecName: "logs") pod "4eab576c-8718-41de-a0de-d85b206edba4" (UID: "4eab576c-8718-41de-a0de-d85b206edba4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.483482 4769 scope.go:117] "RemoveContainer" containerID="3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.488288 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eab576c-8718-41de-a0de-d85b206edba4-kube-api-access-2wqhn" (OuterVolumeSpecName: "kube-api-access-2wqhn") pod "4eab576c-8718-41de-a0de-d85b206edba4" (UID: "4eab576c-8718-41de-a0de-d85b206edba4"). InnerVolumeSpecName "kube-api-access-2wqhn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.515955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4eab576c-8718-41de-a0de-d85b206edba4" (UID: "4eab576c-8718-41de-a0de-d85b206edba4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.520746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-config-data" (OuterVolumeSpecName: "config-data") pod "4eab576c-8718-41de-a0de-d85b206edba4" (UID: "4eab576c-8718-41de-a0de-d85b206edba4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.527025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "4eab576c-8718-41de-a0de-d85b206edba4" (UID: "4eab576c-8718-41de-a0de-d85b206edba4"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.579138 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.579333 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2wqhn\" (UniqueName: \"kubernetes.io/projected/4eab576c-8718-41de-a0de-d85b206edba4-kube-api-access-2wqhn\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.579425 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.579498 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eab576c-8718-41de-a0de-d85b206edba4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.579574 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4eab576c-8718-41de-a0de-d85b206edba4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.612635 4769 scope.go:117] "RemoveContainer" containerID="906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e" Nov 21 13:00:43 crc kubenswrapper[4769]: E1121 13:00:43.614424 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e\": container with ID starting with 906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e not found: ID does not exist" containerID="906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.614501 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e"} err="failed to get container status \"906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e\": rpc error: code = NotFound desc = could not find container \"906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e\": container with ID starting with 906b2b853ed3af62aa7be0fbe8cb085b3c06a812d98844bf7e2ceeca115dfa5e not found: ID does not exist" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.614536 4769 scope.go:117] "RemoveContainer" containerID="3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e" Nov 21 13:00:43 crc kubenswrapper[4769]: E1121 13:00:43.615048 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e\": container with ID starting with 3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e not found: ID does not exist" containerID="3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.615155 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e"} err="failed to get container status \"3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e\": rpc error: code = NotFound desc = could not find container \"3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e\": container with ID starting with 3408a43f2a900b026faf49ca8cdf74a617905fdff07f5f0870f331bf564b269e not found: ID does not exist" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.801497 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.814702 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.854258 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:43 crc kubenswrapper[4769]: E1121 13:00:43.855050 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-metadata" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.855157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-metadata" Nov 21 13:00:43 crc kubenswrapper[4769]: E1121 13:00:43.855288 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-log" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.855366 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-log" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.855683 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-metadata" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.855783 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4eab576c-8718-41de-a0de-d85b206edba4" containerName="nova-metadata-log" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.860804 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.866164 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.866340 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.870605 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.992700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.992829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn2zv\" (UniqueName: \"kubernetes.io/projected/9f4bc5d5-860a-4468-b80f-9123698c878a-kube-api-access-sn2zv\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.992879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f4bc5d5-860a-4468-b80f-9123698c878a-logs\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.992979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:43 crc kubenswrapper[4769]: I1121 13:00:43.993138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-config-data\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.095469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.095535 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sn2zv\" (UniqueName: \"kubernetes.io/projected/9f4bc5d5-860a-4468-b80f-9123698c878a-kube-api-access-sn2zv\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.095564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f4bc5d5-860a-4468-b80f-9123698c878a-logs\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.095595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.095639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-config-data\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.096457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f4bc5d5-860a-4468-b80f-9123698c878a-logs\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.101181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-config-data\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.116182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.116254 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.120802 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn2zv\" (UniqueName: \"kubernetes.io/projected/9f4bc5d5-860a-4468-b80f-9123698c878a-kube-api-access-sn2zv\") pod \"nova-metadata-0\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.180580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:44 crc kubenswrapper[4769]: I1121 13:00:44.688454 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:00:45 crc kubenswrapper[4769]: I1121 13:00:45.295357 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eab576c-8718-41de-a0de-d85b206edba4" path="/var/lib/kubelet/pods/4eab576c-8718-41de-a0de-d85b206edba4/volumes" Nov 21 13:00:45 crc kubenswrapper[4769]: I1121 13:00:45.475657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9f4bc5d5-860a-4468-b80f-9123698c878a","Type":"ContainerStarted","Data":"f1fbf5e59ab31384810106fd8eb0d8f6321c4b8aee8f6b186fb705b0eba28c27"} Nov 21 13:00:45 crc kubenswrapper[4769]: I1121 13:00:45.475933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9f4bc5d5-860a-4468-b80f-9123698c878a","Type":"ContainerStarted","Data":"acf6967aae48774e24ef815db07b3dc8328b53a6b6ca1f2f72a1960900f5df92"} Nov 21 13:00:45 crc kubenswrapper[4769]: I1121 13:00:45.475945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9f4bc5d5-860a-4468-b80f-9123698c878a","Type":"ContainerStarted","Data":"9040b7541841f0fa3ae914b7568165087b89600f3fba2e8728210adb245fe075"} Nov 21 13:00:45 crc kubenswrapper[4769]: I1121 13:00:45.505315 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.50529474 podStartE2EDuration="2.50529474s" podCreationTimestamp="2025-11-21 13:00:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:45.498014404 +0000 UTC m=+4204.198676242" watchObservedRunningTime="2025-11-21 13:00:45.50529474 +0000 UTC m=+4204.205956568" Nov 21 13:00:45 crc kubenswrapper[4769]: E1121 13:00:45.620304 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:45 crc kubenswrapper[4769]: E1121 13:00:45.623366 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:45 crc kubenswrapper[4769]: E1121 13:00:45.625661 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:45 crc kubenswrapper[4769]: E1121 13:00:45.625711 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:46 crc kubenswrapper[4769]: E1121 13:00:46.452711 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:46 crc kubenswrapper[4769]: E1121 13:00:46.454690 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:46 crc kubenswrapper[4769]: E1121 13:00:46.457941 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:00:46 crc kubenswrapper[4769]: E1121 13:00:46.458027 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:47 crc kubenswrapper[4769]: I1121 13:00:47.138478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:48 crc kubenswrapper[4769]: E1121 13:00:48.434352 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod437363a7_1dfd_43b6_9a05_242289d51290.slice/crio-f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf32c73bf_f749_40ff_a102_7e7e1412c0f8.slice/crio-conmon-a1e11a154c6872b8be3a330b82f81aca6a964f81b1d4643523979961390e0b2f.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.519141 4769 generic.go:334] "Generic (PLEG): container finished" podID="fabf6607-e925-4874-a6f7-6a208f73022a" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" exitCode=137 Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.519230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fabf6607-e925-4874-a6f7-6a208f73022a","Type":"ContainerDied","Data":"63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d"} Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.524467 4769 generic.go:334] "Generic (PLEG): container finished" podID="437363a7-1dfd-43b6-9a05-242289d51290" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" exitCode=137 Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.524537 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"437363a7-1dfd-43b6-9a05-242289d51290","Type":"ContainerDied","Data":"f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18"} Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.526663 4769 generic.go:334] "Generic (PLEG): container finished" podID="f32c73bf-f749-40ff-a102-7e7e1412c0f8" containerID="a1e11a154c6872b8be3a330b82f81aca6a964f81b1d4643523979961390e0b2f" exitCode=137 Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.526764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32c73bf-f749-40ff-a102-7e7e1412c0f8","Type":"ContainerDied","Data":"a1e11a154c6872b8be3a330b82f81aca6a964f81b1d4643523979961390e0b2f"} Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.659384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.665259 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.689606 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-combined-ca-bundle\") pod \"437363a7-1dfd-43b6-9a05-242289d51290\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.689685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f32c73bf-f749-40ff-a102-7e7e1412c0f8-kube-api-access-kqnqv\") pod \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.689775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-config-data\") pod \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.698135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f32c73bf-f749-40ff-a102-7e7e1412c0f8-kube-api-access-kqnqv" (OuterVolumeSpecName: "kube-api-access-kqnqv") pod "f32c73bf-f749-40ff-a102-7e7e1412c0f8" (UID: "f32c73bf-f749-40ff-a102-7e7e1412c0f8"). InnerVolumeSpecName "kube-api-access-kqnqv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.729998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.747116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-config-data" (OuterVolumeSpecName: "config-data") pod "f32c73bf-f749-40ff-a102-7e7e1412c0f8" (UID: "f32c73bf-f749-40ff-a102-7e7e1412c0f8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.765876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "437363a7-1dfd-43b6-9a05-242289d51290" (UID: "437363a7-1dfd-43b6-9a05-242289d51290"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.790946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-config-data\") pod \"437363a7-1dfd-43b6-9a05-242289d51290\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.790989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-combined-ca-bundle\") pod \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.791041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ng58\" (UniqueName: \"kubernetes.io/projected/437363a7-1dfd-43b6-9a05-242289d51290-kube-api-access-5ng58\") pod \"437363a7-1dfd-43b6-9a05-242289d51290\" (UID: \"437363a7-1dfd-43b6-9a05-242289d51290\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.791105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-nova-novncproxy-tls-certs\") pod \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.791234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-vencrypt-tls-certs\") pod \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\" (UID: \"f32c73bf-f749-40ff-a102-7e7e1412c0f8\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.792695 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.792765 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.792823 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kqnqv\" (UniqueName: \"kubernetes.io/projected/f32c73bf-f749-40ff-a102-7e7e1412c0f8-kube-api-access-kqnqv\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.795738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/437363a7-1dfd-43b6-9a05-242289d51290-kube-api-access-5ng58" (OuterVolumeSpecName: "kube-api-access-5ng58") pod "437363a7-1dfd-43b6-9a05-242289d51290" (UID: "437363a7-1dfd-43b6-9a05-242289d51290"). InnerVolumeSpecName "kube-api-access-5ng58". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.816201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f32c73bf-f749-40ff-a102-7e7e1412c0f8" (UID: "f32c73bf-f749-40ff-a102-7e7e1412c0f8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.818957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-config-data" (OuterVolumeSpecName: "config-data") pod "437363a7-1dfd-43b6-9a05-242289d51290" (UID: "437363a7-1dfd-43b6-9a05-242289d51290"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.840521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "f32c73bf-f749-40ff-a102-7e7e1412c0f8" (UID: "f32c73bf-f749-40ff-a102-7e7e1412c0f8"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.853551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "f32c73bf-f749-40ff-a102-7e7e1412c0f8" (UID: "f32c73bf-f749-40ff-a102-7e7e1412c0f8"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.894161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-config-data\") pod \"fabf6607-e925-4874-a6f7-6a208f73022a\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.894636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wmrv\" (UniqueName: \"kubernetes.io/projected/fabf6607-e925-4874-a6f7-6a208f73022a-kube-api-access-9wmrv\") pod \"fabf6607-e925-4874-a6f7-6a208f73022a\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.894726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-combined-ca-bundle\") pod \"fabf6607-e925-4874-a6f7-6a208f73022a\" (UID: \"fabf6607-e925-4874-a6f7-6a208f73022a\") " Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.895468 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.895499 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.895515 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/437363a7-1dfd-43b6-9a05-242289d51290-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.895530 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5ng58\" (UniqueName: \"kubernetes.io/projected/437363a7-1dfd-43b6-9a05-242289d51290-kube-api-access-5ng58\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.895546 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f32c73bf-f749-40ff-a102-7e7e1412c0f8-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.898162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabf6607-e925-4874-a6f7-6a208f73022a-kube-api-access-9wmrv" (OuterVolumeSpecName: "kube-api-access-9wmrv") pod "fabf6607-e925-4874-a6f7-6a208f73022a" (UID: "fabf6607-e925-4874-a6f7-6a208f73022a"). InnerVolumeSpecName "kube-api-access-9wmrv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.918919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-config-data" (OuterVolumeSpecName: "config-data") pod "fabf6607-e925-4874-a6f7-6a208f73022a" (UID: "fabf6607-e925-4874-a6f7-6a208f73022a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.921172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fabf6607-e925-4874-a6f7-6a208f73022a" (UID: "fabf6607-e925-4874-a6f7-6a208f73022a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.997299 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9wmrv\" (UniqueName: \"kubernetes.io/projected/fabf6607-e925-4874-a6f7-6a208f73022a-kube-api-access-9wmrv\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.997359 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:48 crc kubenswrapper[4769]: I1121 13:00:48.997373 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fabf6607-e925-4874-a6f7-6a208f73022a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.181653 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.181715 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.543356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f32c73bf-f749-40ff-a102-7e7e1412c0f8","Type":"ContainerDied","Data":"463d27ead44f79a39b19aead76f58107f0c5ea8952f7b6c8e6ea3276baee405e"} Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.543515 4769 scope.go:117] "RemoveContainer" containerID="a1e11a154c6872b8be3a330b82f81aca6a964f81b1d4643523979961390e0b2f" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.544148 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.548353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fabf6607-e925-4874-a6f7-6a208f73022a","Type":"ContainerDied","Data":"f0850eb2329330bfba20afa8013f8b0db4a1333f6fe8dc27ca0678dcac7cf98d"} Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.548406 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.552085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"437363a7-1dfd-43b6-9a05-242289d51290","Type":"ContainerDied","Data":"81b4b971c5634a1878ae983c83b3f511b06a3cfb7194210f3c19f4b01c7bd3a2"} Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.552232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.596799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.603086 4769 scope.go:117] "RemoveContainer" containerID="63a21c60d7adc8616177159e8f837b9c841a46510da988453ba2de13d3b21b8d" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.620400 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.639444 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.656358 4769 scope.go:117] "RemoveContainer" containerID="f4d0ebf5396f42965301d005ccae12b526152acd88296ca678fa6ada04fbee18" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.666958 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.682774 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: E1121 13:00:49.685024 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.685054 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:49 crc kubenswrapper[4769]: E1121 13:00:49.685069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.685079 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:49 crc kubenswrapper[4769]: E1121 13:00:49.685112 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f32c73bf-f749-40ff-a102-7e7e1412c0f8" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.685120 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f32c73bf-f749-40ff-a102-7e7e1412c0f8" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.685410 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f32c73bf-f749-40ff-a102-7e7e1412c0f8" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.685445 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" containerName="nova-cell1-conductor-conductor" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.685457 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="437363a7-1dfd-43b6-9a05-242289d51290" containerName="nova-cell0-conductor-conductor" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.686236 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.690867 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.691108 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.692141 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.692444 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.698149 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.714726 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.724157 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.725440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.727715 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.731760 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.733227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.734576 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.741337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.749793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.826614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vdn9\" (UniqueName: \"kubernetes.io/projected/80493384-e023-40a6-bac4-16a270ce4876-kube-api-access-2vdn9\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.826713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.826799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.826847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-986pp\" (UniqueName: \"kubernetes.io/projected/52e37e21-a610-455a-bb12-c5ab8f7a824d-kube-api-access-986pp\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827332 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d2w2\" (UniqueName: \"kubernetes.io/projected/f92f9178-636b-41c7-9468-54183e16a0a0-kube-api-access-5d2w2\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.827551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.929658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.929745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.929858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.929903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-986pp\" (UniqueName: \"kubernetes.io/projected/52e37e21-a610-455a-bb12-c5ab8f7a824d-kube-api-access-986pp\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.929983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.930033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.930100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5d2w2\" (UniqueName: \"kubernetes.io/projected/f92f9178-636b-41c7-9468-54183e16a0a0-kube-api-access-5d2w2\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.930157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.930283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.930343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2vdn9\" (UniqueName: \"kubernetes.io/projected/80493384-e023-40a6-bac4-16a270ce4876-kube-api-access-2vdn9\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.930386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.937343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.938309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.938360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.938690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.937168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.939781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.940084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.940941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.951604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d2w2\" (UniqueName: \"kubernetes.io/projected/f92f9178-636b-41c7-9468-54183e16a0a0-kube-api-access-5d2w2\") pod \"nova-cell0-conductor-0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.952733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vdn9\" (UniqueName: \"kubernetes.io/projected/80493384-e023-40a6-bac4-16a270ce4876-kube-api-access-2vdn9\") pod \"nova-cell1-conductor-0\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:49 crc kubenswrapper[4769]: I1121 13:00:49.959395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-986pp\" (UniqueName: \"kubernetes.io/projected/52e37e21-a610-455a-bb12-c5ab8f7a824d-kube-api-access-986pp\") pod \"nova-cell1-novncproxy-0\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.010945 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.049354 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.057625 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.322111 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.394169 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:00:50 crc kubenswrapper[4769]: W1121 13:00:50.415901 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80493384_e023_40a6_bac4_16a270ce4876.slice/crio-749ae4f86dde11c711d58979426d945c908dfeb24a029b10dec7b5e9e3050266 WatchSource:0}: Error finding container 749ae4f86dde11c711d58979426d945c908dfeb24a029b10dec7b5e9e3050266: Status 404 returned error can't find the container with id 749ae4f86dde11c711d58979426d945c908dfeb24a029b10dec7b5e9e3050266 Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.575797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"80493384-e023-40a6-bac4-16a270ce4876","Type":"ContainerStarted","Data":"39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b"} Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.575861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"80493384-e023-40a6-bac4-16a270ce4876","Type":"ContainerStarted","Data":"749ae4f86dde11c711d58979426d945c908dfeb24a029b10dec7b5e9e3050266"} Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.575926 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.581590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52e37e21-a610-455a-bb12-c5ab8f7a824d","Type":"ContainerStarted","Data":"a216beb58561c45c325c7f118d87f7d0a929d030f189e19d53aa0d57fca8de8e"} Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.581629 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52e37e21-a610-455a-bb12-c5ab8f7a824d","Type":"ContainerStarted","Data":"b1141f4510ec3bec05e095b3d44c84c98d88bdce4e4181c6914d22f467b7b0f5"} Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.594029 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=1.5940148710000002 podStartE2EDuration="1.594014871s" podCreationTimestamp="2025-11-21 13:00:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:50.589462409 +0000 UTC m=+4209.290124217" watchObservedRunningTime="2025-11-21 13:00:50.594014871 +0000 UTC m=+4209.294676689" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.609706 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.609668073 podStartE2EDuration="1.609668073s" podCreationTimestamp="2025-11-21 13:00:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:50.602232252 +0000 UTC m=+4209.302894080" watchObservedRunningTime="2025-11-21 13:00:50.609668073 +0000 UTC m=+4209.310329891" Nov 21 13:00:50 crc kubenswrapper[4769]: I1121 13:00:50.677339 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:00:51 crc kubenswrapper[4769]: I1121 13:00:51.295804 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="437363a7-1dfd-43b6-9a05-242289d51290" path="/var/lib/kubelet/pods/437363a7-1dfd-43b6-9a05-242289d51290/volumes" Nov 21 13:00:51 crc kubenswrapper[4769]: I1121 13:00:51.297591 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f32c73bf-f749-40ff-a102-7e7e1412c0f8" path="/var/lib/kubelet/pods/f32c73bf-f749-40ff-a102-7e7e1412c0f8/volumes" Nov 21 13:00:51 crc kubenswrapper[4769]: I1121 13:00:51.298663 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabf6607-e925-4874-a6f7-6a208f73022a" path="/var/lib/kubelet/pods/fabf6607-e925-4874-a6f7-6a208f73022a/volumes" Nov 21 13:00:51 crc kubenswrapper[4769]: I1121 13:00:51.599114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f92f9178-636b-41c7-9468-54183e16a0a0","Type":"ContainerStarted","Data":"d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54"} Nov 21 13:00:51 crc kubenswrapper[4769]: I1121 13:00:51.599166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f92f9178-636b-41c7-9468-54183e16a0a0","Type":"ContainerStarted","Data":"947cda57518b1ae45ef3246b43ba6555bbd92d2c3c56efe07b1b1382c74e9fe4"} Nov 21 13:00:51 crc kubenswrapper[4769]: I1121 13:00:51.600025 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:52 crc kubenswrapper[4769]: I1121 13:00:52.137815 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:52 crc kubenswrapper[4769]: I1121 13:00:52.192447 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:52 crc kubenswrapper[4769]: I1121 13:00:52.212751 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.212735026 podStartE2EDuration="3.212735026s" podCreationTimestamp="2025-11-21 13:00:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:00:51.619475689 +0000 UTC m=+4210.320137547" watchObservedRunningTime="2025-11-21 13:00:52.212735026 +0000 UTC m=+4210.913396844" Nov 21 13:00:52 crc kubenswrapper[4769]: I1121 13:00:52.641430 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:00:54 crc kubenswrapper[4769]: I1121 13:00:54.181525 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:54 crc kubenswrapper[4769]: I1121 13:00:54.181879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:00:55 crc kubenswrapper[4769]: I1121 13:00:55.011376 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:00:55 crc kubenswrapper[4769]: I1121 13:00:55.091882 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:00:55 crc kubenswrapper[4769]: I1121 13:00:55.102166 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:00:55 crc kubenswrapper[4769]: I1121 13:00:55.200325 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.190:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:00:55 crc kubenswrapper[4769]: I1121 13:00:55.200323 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.190:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:00:57 crc kubenswrapper[4769]: I1121 13:00:57.726486 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.011638 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.048245 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.165265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-cron-29395501-sk5q6"] Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.172150 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.220977 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29395501-sk5q6"] Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.282468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-fernet-keys\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.282551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-combined-ca-bundle\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.282610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-config-data\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.282820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmd8\" (UniqueName: \"kubernetes.io/projected/410a432a-acfa-4408-bff4-31b60d8f6903-kube-api-access-fjmd8\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.384776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmd8\" (UniqueName: \"kubernetes.io/projected/410a432a-acfa-4408-bff4-31b60d8f6903-kube-api-access-fjmd8\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.384828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-fernet-keys\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.384850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-combined-ca-bundle\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.384871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-config-data\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.391419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-fernet-keys\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.391957 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-config-data\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.395988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-combined-ca-bundle\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.412252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmd8\" (UniqueName: \"kubernetes.io/projected/410a432a-acfa-4408-bff4-31b60d8f6903-kube-api-access-fjmd8\") pod \"keystone-cron-29395501-sk5q6\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.509837 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.713703 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:00 crc kubenswrapper[4769]: I1121 13:01:00.847793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29395501-sk5q6"] Nov 21 13:01:00 crc kubenswrapper[4769]: W1121 13:01:00.849889 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410a432a_acfa_4408_bff4_31b60d8f6903.slice/crio-51df47194903ca09e334409e1709610e0aa17b80cc18271a7877ddac2468178f WatchSource:0}: Error finding container 51df47194903ca09e334409e1709610e0aa17b80cc18271a7877ddac2468178f: Status 404 returned error can't find the container with id 51df47194903ca09e334409e1709610e0aa17b80cc18271a7877ddac2468178f Nov 21 13:01:01 crc kubenswrapper[4769]: I1121 13:01:01.702284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" event={"ID":"410a432a-acfa-4408-bff4-31b60d8f6903","Type":"ContainerStarted","Data":"cb2c948ceb0f7a4cebc6751c19c9c37f6327d597116dc92fd967943a92275ae4"} Nov 21 13:01:01 crc kubenswrapper[4769]: I1121 13:01:01.702565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" event={"ID":"410a432a-acfa-4408-bff4-31b60d8f6903","Type":"ContainerStarted","Data":"51df47194903ca09e334409e1709610e0aa17b80cc18271a7877ddac2468178f"} Nov 21 13:01:01 crc kubenswrapper[4769]: I1121 13:01:01.727107 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" podStartSLOduration=1.7270924810000001 podStartE2EDuration="1.727092481s" podCreationTimestamp="2025-11-21 13:01:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:01.720427401 +0000 UTC m=+4220.421089219" watchObservedRunningTime="2025-11-21 13:01:01.727092481 +0000 UTC m=+4220.427754299" Nov 21 13:01:03 crc kubenswrapper[4769]: I1121 13:01:03.738091 4769 generic.go:334] "Generic (PLEG): container finished" podID="410a432a-acfa-4408-bff4-31b60d8f6903" containerID="cb2c948ceb0f7a4cebc6751c19c9c37f6327d597116dc92fd967943a92275ae4" exitCode=0 Nov 21 13:01:03 crc kubenswrapper[4769]: I1121 13:01:03.738429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" event={"ID":"410a432a-acfa-4408-bff4-31b60d8f6903","Type":"ContainerDied","Data":"cb2c948ceb0f7a4cebc6751c19c9c37f6327d597116dc92fd967943a92275ae4"} Nov 21 13:01:04 crc kubenswrapper[4769]: I1121 13:01:04.189475 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:04 crc kubenswrapper[4769]: I1121 13:01:04.190872 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:04 crc kubenswrapper[4769]: I1121 13:01:04.201307 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:04 crc kubenswrapper[4769]: I1121 13:01:04.757582 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.175867 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.309615 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjmd8\" (UniqueName: \"kubernetes.io/projected/410a432a-acfa-4408-bff4-31b60d8f6903-kube-api-access-fjmd8\") pod \"410a432a-acfa-4408-bff4-31b60d8f6903\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.309676 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-fernet-keys\") pod \"410a432a-acfa-4408-bff4-31b60d8f6903\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.309893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-combined-ca-bundle\") pod \"410a432a-acfa-4408-bff4-31b60d8f6903\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.309922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-config-data\") pod \"410a432a-acfa-4408-bff4-31b60d8f6903\" (UID: \"410a432a-acfa-4408-bff4-31b60d8f6903\") " Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.316653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410a432a-acfa-4408-bff4-31b60d8f6903-kube-api-access-fjmd8" (OuterVolumeSpecName: "kube-api-access-fjmd8") pod "410a432a-acfa-4408-bff4-31b60d8f6903" (UID: "410a432a-acfa-4408-bff4-31b60d8f6903"). InnerVolumeSpecName "kube-api-access-fjmd8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.327741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "410a432a-acfa-4408-bff4-31b60d8f6903" (UID: "410a432a-acfa-4408-bff4-31b60d8f6903"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.344100 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "410a432a-acfa-4408-bff4-31b60d8f6903" (UID: "410a432a-acfa-4408-bff4-31b60d8f6903"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.387780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-config-data" (OuterVolumeSpecName: "config-data") pod "410a432a-acfa-4408-bff4-31b60d8f6903" (UID: "410a432a-acfa-4408-bff4-31b60d8f6903"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.411880 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.411905 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.411915 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fjmd8\" (UniqueName: \"kubernetes.io/projected/410a432a-acfa-4408-bff4-31b60d8f6903-kube-api-access-fjmd8\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.411925 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/410a432a-acfa-4408-bff4-31b60d8f6903-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.766331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.766330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-cron-29395501-sk5q6" event={"ID":"410a432a-acfa-4408-bff4-31b60d8f6903","Type":"ContainerDied","Data":"51df47194903ca09e334409e1709610e0aa17b80cc18271a7877ddac2468178f"} Nov 21 13:01:05 crc kubenswrapper[4769]: I1121 13:01:05.766396 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51df47194903ca09e334409e1709610e0aa17b80cc18271a7877ddac2468178f" Nov 21 13:01:10 crc kubenswrapper[4769]: I1121 13:01:10.974089 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:10 crc kubenswrapper[4769]: I1121 13:01:10.974866 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="openstack-network-exporter" containerID="cri-o://cd424d607f3bf1109e3e6231401239ad4185865bfab083821d5096ba0543287a" gracePeriod=300 Nov 21 13:01:10 crc kubenswrapper[4769]: I1121 13:01:10.998872 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:10 crc kubenswrapper[4769]: I1121 13:01:10.999129 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d1a91e92-f4a2-4279-aa88-caf6df42d841" containerName="nova-scheduler-scheduler" containerID="cri-o://0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.031245 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.031516 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="ovn-northd" containerID="cri-o://934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.031930 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="openstack-network-exporter" containerID="cri-o://ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.051323 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2"] Nov 21 13:01:11 crc kubenswrapper[4769]: E1121 13:01:11.051806 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="410a432a-acfa-4408-bff4-31b60d8f6903" containerName="keystone-cron" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.051823 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="410a432a-acfa-4408-bff4-31b60d8f6903" containerName="keystone-cron" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.052032 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="410a432a-acfa-4408-bff4-31b60d8f6903" containerName="keystone-cron" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.053580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.078512 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.080113 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.144304 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.144551 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-log" containerID="cri-o://acf6967aae48774e24ef815db07b3dc8328b53a6b6ca1f2f72a1960900f5df92" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.144724 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-metadata" containerID="cri-o://f1fbf5e59ab31384810106fd8eb0d8f6321c4b8aee8f6b186fb705b0eba28c27" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.170794 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data-custom\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.170885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljrcn\" (UniqueName: \"kubernetes.io/projected/9239d708-5ee4-40e4-ae65-cfdc903874f3-kube-api-access-ljrcn\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.170907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-logs\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.170933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-combined-ca-bundle\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.170963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.170990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4t6\" (UniqueName: \"kubernetes.io/projected/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-kube-api-access-ww4t6\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.171008 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data-custom\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.171024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-combined-ca-bundle\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.171052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9239d708-5ee4-40e4-ae65-cfdc903874f3-logs\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.171091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.212254 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.241016 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.258036 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.258261 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" containerName="openstackclient" containerID="cri-o://bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c" gracePeriod=2 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ljrcn\" (UniqueName: \"kubernetes.io/projected/9239d708-5ee4-40e4-ae65-cfdc903874f3-kube-api-access-ljrcn\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-logs\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-combined-ca-bundle\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4t6\" (UniqueName: \"kubernetes.io/projected/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-kube-api-access-ww4t6\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data-custom\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-combined-ca-bundle\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9239d708-5ee4-40e4-ae65-cfdc903874f3-logs\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.272903 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data-custom\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.277767 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.278628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-logs\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.279269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9239d708-5ee4-40e4-ae65-cfdc903874f3-logs\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.288065 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data-custom\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.338558 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data-custom\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.339575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.339752 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="ovsdbserver-nb" containerID="cri-o://e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b" gracePeriod=300 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.340040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-combined-ca-bundle\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.340633 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-combined-ca-bundle\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.340906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.343604 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.343642 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.366825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4t6\" (UniqueName: \"kubernetes.io/projected/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-kube-api-access-ww4t6\") pod \"barbican-keystone-listener-849765d566-kngb8\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.406518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljrcn\" (UniqueName: \"kubernetes.io/projected/9239d708-5ee4-40e4-ae65-cfdc903874f3-kube-api-access-ljrcn\") pod \"barbican-worker-577595dd45-4fsf2\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: E1121 13:01:11.472402 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b is running failed: container process not found" containerID="e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:01:11 crc kubenswrapper[4769]: E1121 13:01:11.481136 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b is running failed: container process not found" containerID="e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:01:11 crc kubenswrapper[4769]: E1121 13:01:11.488407 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b is running failed: container process not found" containerID="e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:01:11 crc kubenswrapper[4769]: E1121 13:01:11.488482 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="ovsdbserver-nb" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.497463 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.497506 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.497523 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.497800 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="24948f97-9424-4a52-82ed-a901848d4018" containerName="memcached" containerID="cri-o://febfee118e9eed487e0935be09ceee0423f97b88427df8ddff82bc0e98f6bfc0" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.498256 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="cinder-scheduler" containerID="cri-o://fd6c613f64ef206587c06c6e0e3f6c4a769a9ad5115b62b885c20e5c1a800799" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.498290 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="probe" containerID="cri-o://422b5c076b7276c472dfd77dc0e0326c5d93d0634a9e8b5adec4b2739ba09f77" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.550496 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.556246 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:01:11 crc kubenswrapper[4769]: E1121 13:01:11.556720 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" containerName="openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.556731 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" containerName="openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.558792 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" containerName="openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.559558 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.578878 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.579292 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.619776 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.620269 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-log" containerID="cri-o://ac277d823e5036f3c3037adc91d3611b2299b9c848721ae01066eacd436baeb2" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.620392 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-httpd" containerID="cri-o://9e3ef90f84d9f9dfeca8d5caac2d6ca840a8002a6abc730d5e882c57a0035f93" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.630079 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.630392 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-log" containerID="cri-o://c544c917dd6e2d302bedf189bf2e810df12ac84a603b727fb7df892acd3f80ed" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.630573 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-api" containerID="cri-o://02efc9c3fec36d6b1b0eff3340763771cd222e2a3d33e5bc23ff7890c47108ce" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.650686 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.650960 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api-log" containerID="cri-o://af009266358960d2a563c010192404ec300e3d322b0d6a118f6f9e9b56978335" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.651171 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api" containerID="cri-o://40685a2f76271238d87ffc258be2c0c73baffaec2773e0f9ce1d9d608bb49941" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.669840 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.670164 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f92f9178-636b-41c7-9468-54183e16a0a0" containerName="nova-cell0-conductor-conductor" containerID="cri-o://d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.682693 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.684337 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.697113 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7584c7766-9n2mj"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.698920 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.706956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mbp7\" (UniqueName: \"kubernetes.io/projected/9e3ae579-d4ee-4c52-b835-adb607df1176-kube-api-access-7mbp7\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.707079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.707123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config-secret\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.709998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.713103 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.734864 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7584c7766-9n2mj"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.762021 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.776342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.777527 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="openstack-network-exporter" containerID="cri-o://d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc" gracePeriod=300 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.789168 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.789967 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="52e37e21-a610-455a-bb12-c5ab8f7a824d" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a216beb58561c45c325c7f118d87f7d0a929d030f189e19d53aa0d57fca8de8e" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.800390 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.812579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config-secret\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-scripts\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813214 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-public-tls-certs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813321 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-combined-ca-bundle\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-combined-ca-bundle\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27c8\" (UniqueName: \"kubernetes.io/projected/032f278a-33da-49e9-a3e1-54d565bff7ca-kube-api-access-v27c8\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/032f278a-33da-49e9-a3e1-54d565bff7ca-logs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813418 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data-custom\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mbp7\" (UniqueName: \"kubernetes.io/projected/9e3ae579-d4ee-4c52-b835-adb607df1176-kube-api-access-7mbp7\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-internal-tls-certs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rn5\" (UniqueName: \"kubernetes.io/projected/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-kube-api-access-b6rn5\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-logs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-internal-tls-certs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-config-data\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.813777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-public-tls-certs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.814612 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.815293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.828420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.829897 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-548d54c446-vgqdr"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.832505 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.840109 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-548d54c446-vgqdr"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.840446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config-secret\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.840698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mbp7\" (UniqueName: \"kubernetes.io/projected/9e3ae579-d4ee-4c52-b835-adb607df1176-kube-api-access-7mbp7\") pod \"openstackclient\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.844404 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_705d3da4-5e5b-4fa0-b043-7d49a598a013/ovsdbserver-nb/0.log" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.844440 4769 generic.go:334] "Generic (PLEG): container finished" podID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerID="cd424d607f3bf1109e3e6231401239ad4185865bfab083821d5096ba0543287a" exitCode=2 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.844458 4769 generic.go:334] "Generic (PLEG): container finished" podID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerID="e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b" exitCode=143 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.844496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"705d3da4-5e5b-4fa0-b043-7d49a598a013","Type":"ContainerDied","Data":"cd424d607f3bf1109e3e6231401239ad4185865bfab083821d5096ba0543287a"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.844516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"705d3da4-5e5b-4fa0-b043-7d49a598a013","Type":"ContainerDied","Data":"e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.847952 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6f48d8578c-kdj4r"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.851917 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.853559 4769 generic.go:334] "Generic (PLEG): container finished" podID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerID="af009266358960d2a563c010192404ec300e3d322b0d6a118f6f9e9b56978335" exitCode=143 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.853615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"09da4a70-f95f-4080-b7d4-b3ce7ede34c1","Type":"ContainerDied","Data":"af009266358960d2a563c010192404ec300e3d322b0d6a118f6f9e9b56978335"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.862388 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="ovsdbserver-sb" containerID="cri-o://0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4" gracePeriod=300 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.868592 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6f48d8578c-kdj4r"] Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.870036 4769 generic.go:334] "Generic (PLEG): container finished" podID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerID="ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7" exitCode=2 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.870116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8","Type":"ContainerDied","Data":"ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.890986 4769 generic.go:334] "Generic (PLEG): container finished" podID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerID="c544c917dd6e2d302bedf189bf2e810df12ac84a603b727fb7df892acd3f80ed" exitCode=143 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.891047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"93ff2c8a-0d89-42ea-bf5a-8928949f45f5","Type":"ContainerDied","Data":"c544c917dd6e2d302bedf189bf2e810df12ac84a603b727fb7df892acd3f80ed"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.893561 4769 generic.go:334] "Generic (PLEG): container finished" podID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerID="ac277d823e5036f3c3037adc91d3611b2299b9c848721ae01066eacd436baeb2" exitCode=143 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.893634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5dffcaa1-afe1-43af-8ccb-1237aa971d6c","Type":"ContainerDied","Data":"ac277d823e5036f3c3037adc91d3611b2299b9c848721ae01066eacd436baeb2"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.903457 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerID="acf6967aae48774e24ef815db07b3dc8328b53a6b6ca1f2f72a1960900f5df92" exitCode=143 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.903598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9f4bc5d5-860a-4468-b80f-9123698c878a","Type":"ContainerDied","Data":"acf6967aae48774e24ef815db07b3dc8328b53a6b6ca1f2f72a1960900f5df92"} Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.903667 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-log" containerID="cri-o://19f0b0bcbb899350b2b83a2a2def359ff91ccb980719b7ac5ac27917a642d044" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.903768 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-httpd" containerID="cri-o://7ab702e2147d6315099f76b750890646912be5b10762830746117eb2a025e4a0" gracePeriod=30 Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-internal-tls-certs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rn5\" (UniqueName: \"kubernetes.io/projected/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-kube-api-access-b6rn5\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-ovndb-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-scripts\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-httpd-config\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-logs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-internal-tls-certs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-config-data\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-config-data\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-public-tls-certs\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919608 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-fernet-keys\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-public-tls-certs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-combined-ca-bundle\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-internal-tls-certs\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sptmk\" (UniqueName: \"kubernetes.io/projected/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-kube-api-access-sptmk\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-scripts\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-public-tls-certs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-combined-ca-bundle\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-config\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hshrb\" (UniqueName: \"kubernetes.io/projected/e5f96b2f-5d0c-4fc9-bf04-574534677fec-kube-api-access-hshrb\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-combined-ca-bundle\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-combined-ca-bundle\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-public-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-credential-keys\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v27c8\" (UniqueName: \"kubernetes.io/projected/032f278a-33da-49e9-a3e1-54d565bff7ca-kube-api-access-v27c8\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919943 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/032f278a-33da-49e9-a3e1-54d565bff7ca-logs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-internal-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.919983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data-custom\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.925154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-logs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.926003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data-custom\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.926072 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-internal-tls-certs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.933301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.933894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/032f278a-33da-49e9-a3e1-54d565bff7ca-logs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.934628 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.934920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-config-data\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.940666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-combined-ca-bundle\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.944842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-public-tls-certs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.946309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-combined-ca-bundle\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.950037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rn5\" (UniqueName: \"kubernetes.io/projected/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-kube-api-access-b6rn5\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.952899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-internal-tls-certs\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.954376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27c8\" (UniqueName: \"kubernetes.io/projected/032f278a-33da-49e9-a3e1-54d565bff7ca-kube-api-access-v27c8\") pod \"barbican-api-574c8df6f6-7vgsx\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.967834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-scripts\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:11 crc kubenswrapper[4769]: I1121 13:01:11.968243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-public-tls-certs\") pod \"placement-7584c7766-9n2mj\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.027446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-fernet-keys\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.027500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-combined-ca-bundle\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.027524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-internal-tls-certs\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.027544 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sptmk\" (UniqueName: \"kubernetes.io/projected/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-kube-api-access-sptmk\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.034469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-combined-ca-bundle\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.037838 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-config\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.037898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hshrb\" (UniqueName: \"kubernetes.io/projected/e5f96b2f-5d0c-4fc9-bf04-574534677fec-kube-api-access-hshrb\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-public-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-credential-keys\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038195 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-internal-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-ovndb-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-scripts\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-httpd-config\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-config-data\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.038515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-public-tls-certs\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.045513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-fernet-keys\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.055352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-internal-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.058417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-internal-tls-certs\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.058864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-combined-ca-bundle\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.061001 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerName="galera" containerID="cri-o://8fc9f2c1ab4028ce5e693ffad5e61ab730f5b37f730df26f975a8b1640279b35" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.061149 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" containerName="galera" containerID="cri-o://5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.065100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-public-tls-certs\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.067746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-config\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.071771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hshrb\" (UniqueName: \"kubernetes.io/projected/e5f96b2f-5d0c-4fc9-bf04-574534677fec-kube-api-access-hshrb\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.072042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-combined-ca-bundle\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.072200 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sptmk\" (UniqueName: \"kubernetes.io/projected/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-kube-api-access-sptmk\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.072636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-config-data\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.072653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-public-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.073117 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.079206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-ovndb-tls-certs\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.079501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-credential-keys\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.079929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-httpd-config\") pod \"neutron-548d54c446-vgqdr\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.097521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-scripts\") pod \"keystone-6f48d8578c-kdj4r\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.108519 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:12 crc kubenswrapper[4769]: E1121 13:01:12.171336 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.175241 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:12 crc kubenswrapper[4769]: E1121 13:01:12.224323 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:01:12 crc kubenswrapper[4769]: E1121 13:01:12.227361 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:01:12 crc kubenswrapper[4769]: E1121 13:01:12.227431 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d1a91e92-f4a2-4279-aa88-caf6df42d841" containerName="nova-scheduler-scheduler" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.272324 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.362530 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2"] Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.370780 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8"] Nov 21 13:01:12 crc kubenswrapper[4769]: W1121 13:01:12.434479 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9239d708_5ee4_40e4_ae65_cfdc903874f3.slice/crio-dc9a2c1452befe62377bb952ff5fdb9822993ed50ff5b8e2556fc3f8179890d9 WatchSource:0}: Error finding container dc9a2c1452befe62377bb952ff5fdb9822993ed50ff5b8e2556fc3f8179890d9: Status 404 returned error can't find the container with id dc9a2c1452befe62377bb952ff5fdb9822993ed50ff5b8e2556fc3f8179890d9 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.466934 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.467487 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="80493384-e023-40a6-bac4-16a270ce4876" containerName="nova-cell1-conductor-conductor" containerID="cri-o://39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.625533 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_705d3da4-5e5b-4fa0-b043-7d49a598a013/ovsdbserver-nb/0.log" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.625962 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.649030 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.649333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-central-agent" containerID="cri-o://4f928b644488d4a360447741ffe8fedd5c00337fe2eaba4fa016957e725491e2" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.649367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="proxy-httpd" containerID="cri-o://7d9318bf8c25495f7148a04e86c1b278caa519b9123ecdcf89fc09403b562cd1" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.649447 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="sg-core" containerID="cri-o://c445a56c6e8faf1352fa571c77899599bfa33d8e9f320242b15676c75b7a1c41" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.649487 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-notification-agent" containerID="cri-o://d053a37dbdd2a57dda79a762d52fcccf37c4606694e35ee18c386a0f4920d3d1" gracePeriod=30 Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.775583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdb-rundir\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.775717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-combined-ca-bundle\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.775758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-config\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.775776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.775878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-scripts\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.776109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9dkn\" (UniqueName: \"kubernetes.io/projected/705d3da4-5e5b-4fa0-b043-7d49a598a013-kube-api-access-z9dkn\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.776149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-metrics-certs-tls-certs\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.776169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdbserver-nb-tls-certs\") pod \"705d3da4-5e5b-4fa0-b043-7d49a598a013\" (UID: \"705d3da4-5e5b-4fa0-b043-7d49a598a013\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.777535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.778031 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-scripts" (OuterVolumeSpecName: "scripts") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.778537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-config" (OuterVolumeSpecName: "config") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.783728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.794405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705d3da4-5e5b-4fa0-b043-7d49a598a013-kube-api-access-z9dkn" (OuterVolumeSpecName: "kube-api-access-z9dkn") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "kube-api-access-z9dkn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.822959 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_358b6f0c-4310-4a43-9b1b-090cdb219e42/ovsdbserver-sb/0.log" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.823098 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.833792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.883128 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.883163 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z9dkn\" (UniqueName: \"kubernetes.io/projected/705d3da4-5e5b-4fa0-b043-7d49a598a013-kube-api-access-z9dkn\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.883172 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.883182 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.883203 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/705d3da4-5e5b-4fa0-b043-7d49a598a013-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.883225 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-metrics-certs-tls-certs\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984500 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdb-rundir\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-scripts\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-combined-ca-bundle\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdbserver-sb-tls-certs\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx7nr\" (UniqueName: \"kubernetes.io/projected/358b6f0c-4310-4a43-9b1b-090cdb219e42-kube-api-access-cx7nr\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.984751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-config\") pod \"358b6f0c-4310-4a43-9b1b-090cdb219e42\" (UID: \"358b6f0c-4310-4a43-9b1b-090cdb219e42\") " Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.987433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-scripts" (OuterVolumeSpecName: "scripts") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:12 crc kubenswrapper[4769]: I1121 13:01:12.990444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:12.997017 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-config" (OuterVolumeSpecName: "config") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.001091 4769 generic.go:334] "Generic (PLEG): container finished" podID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerID="422b5c076b7276c472dfd77dc0e0326c5d93d0634a9e8b5adec4b2739ba09f77" exitCode=0 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.001216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a784a6a4-b4b4-4133-b747-46431dce82a5","Type":"ContainerDied","Data":"422b5c076b7276c472dfd77dc0e0326c5d93d0634a9e8b5adec4b2739ba09f77"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.012782 4769 generic.go:334] "Generic (PLEG): container finished" podID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerID="7d9318bf8c25495f7148a04e86c1b278caa519b9123ecdcf89fc09403b562cd1" exitCode=0 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.012820 4769 generic.go:334] "Generic (PLEG): container finished" podID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerID="c445a56c6e8faf1352fa571c77899599bfa33d8e9f320242b15676c75b7a1c41" exitCode=2 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.012891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerDied","Data":"7d9318bf8c25495f7148a04e86c1b278caa519b9123ecdcf89fc09403b562cd1"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.012933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerDied","Data":"c445a56c6e8faf1352fa571c77899599bfa33d8e9f320242b15676c75b7a1c41"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.014099 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.023738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.054830 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_705d3da4-5e5b-4fa0-b043-7d49a598a013/ovsdbserver-nb/0.log" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.054919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"705d3da4-5e5b-4fa0-b043-7d49a598a013","Type":"ContainerDied","Data":"2a07f8276ad4a202e020cf0602d1cfef6e60d8f1e0df8d6025e948764f38d44e"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.054960 4769 scope.go:117] "RemoveContainer" containerID="cd424d607f3bf1109e3e6231401239ad4185865bfab083821d5096ba0543287a" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.055095 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.057271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358b6f0c-4310-4a43-9b1b-090cdb219e42-kube-api-access-cx7nr" (OuterVolumeSpecName: "kube-api-access-cx7nr") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "kube-api-access-cx7nr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.061104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" event={"ID":"9239d708-5ee4-40e4-ae65-cfdc903874f3","Type":"ContainerStarted","Data":"dc9a2c1452befe62377bb952ff5fdb9822993ed50ff5b8e2556fc3f8179890d9"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.087075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdfr5\" (UniqueName: \"kubernetes.io/projected/24948f97-9424-4a52-82ed-a901848d4018-kube-api-access-pdfr5\") pod \"24948f97-9424-4a52-82ed-a901848d4018\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.087168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-config-data\") pod \"24948f97-9424-4a52-82ed-a901848d4018\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.087321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-combined-ca-bundle\") pod \"24948f97-9424-4a52-82ed-a901848d4018\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.087431 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-memcached-tls-certs\") pod \"24948f97-9424-4a52-82ed-a901848d4018\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.087522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-kolla-config\") pod \"24948f97-9424-4a52-82ed-a901848d4018\" (UID: \"24948f97-9424-4a52-82ed-a901848d4018\") " Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.090615 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-config-data" (OuterVolumeSpecName: "config-data") pod "24948f97-9424-4a52-82ed-a901848d4018" (UID: "24948f97-9424-4a52-82ed-a901848d4018"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.097134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "24948f97-9424-4a52-82ed-a901848d4018" (UID: "24948f97-9424-4a52-82ed-a901848d4018"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102124 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cx7nr\" (UniqueName: \"kubernetes.io/projected/358b6f0c-4310-4a43-9b1b-090cdb219e42-kube-api-access-cx7nr\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102151 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102167 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102212 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102222 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102230 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/358b6f0c-4310-4a43-9b1b-090cdb219e42-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.102964 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/24948f97-9424-4a52-82ed-a901848d4018-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.103015 4769 generic.go:334] "Generic (PLEG): container finished" podID="52e37e21-a610-455a-bb12-c5ab8f7a824d" containerID="a216beb58561c45c325c7f118d87f7d0a929d030f189e19d53aa0d57fca8de8e" exitCode=0 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.103071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52e37e21-a610-455a-bb12-c5ab8f7a824d","Type":"ContainerDied","Data":"a216beb58561c45c325c7f118d87f7d0a929d030f189e19d53aa0d57fca8de8e"} Nov 21 13:01:13 crc kubenswrapper[4769]: W1121 13:01:13.123648 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60ce8c85_ca65_4f19_9c4a_f81f515f5ae0.slice/crio-049446bda5a733e070fc27757ba963bf2e38e109da80dee2b5aa73e0b6146264 WatchSource:0}: Error finding container 049446bda5a733e070fc27757ba963bf2e38e109da80dee2b5aa73e0b6146264: Status 404 returned error can't find the container with id 049446bda5a733e070fc27757ba963bf2e38e109da80dee2b5aa73e0b6146264 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.123983 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1510c24-a296-4443-b9a6-237c100402a1" containerID="19f0b0bcbb899350b2b83a2a2def359ff91ccb980719b7ac5ac27917a642d044" exitCode=143 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.124029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b1510c24-a296-4443-b9a6-237c100402a1","Type":"ContainerDied","Data":"19f0b0bcbb899350b2b83a2a2def359ff91ccb980719b7ac5ac27917a642d044"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.132396 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7584c7766-9n2mj"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.136968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24948f97-9424-4a52-82ed-a901848d4018-kube-api-access-pdfr5" (OuterVolumeSpecName: "kube-api-access-pdfr5") pod "24948f97-9424-4a52-82ed-a901848d4018" (UID: "24948f97-9424-4a52-82ed-a901848d4018"). InnerVolumeSpecName "kube-api-access-pdfr5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.146053 4769 scope.go:117] "RemoveContainer" containerID="e6f47040b709a9b7e288210f7dd3a8e4e4d41e0d0fe2a8c16dbc0e5195322b9b" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.146518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-548d54c446-vgqdr"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.147507 4769 generic.go:334] "Generic (PLEG): container finished" podID="24948f97-9424-4a52-82ed-a901848d4018" containerID="febfee118e9eed487e0935be09ceee0423f97b88427df8ddff82bc0e98f6bfc0" exitCode=0 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.147563 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"24948f97-9424-4a52-82ed-a901848d4018","Type":"ContainerDied","Data":"febfee118e9eed487e0935be09ceee0423f97b88427df8ddff82bc0e98f6bfc0"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.147804 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156542 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_358b6f0c-4310-4a43-9b1b-090cdb219e42/ovsdbserver-sb/0.log" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156593 4769 generic.go:334] "Generic (PLEG): container finished" podID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerID="d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc" exitCode=2 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156613 4769 generic.go:334] "Generic (PLEG): container finished" podID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerID="0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4" exitCode=143 Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358b6f0c-4310-4a43-9b1b-090cdb219e42","Type":"ContainerDied","Data":"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358b6f0c-4310-4a43-9b1b-090cdb219e42","Type":"ContainerDied","Data":"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"358b6f0c-4310-4a43-9b1b-090cdb219e42","Type":"ContainerDied","Data":"ff6b7f2c6f196fd8f3e62d469d3029a36b28398f838e96028d14bc67b5d00936"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.156696 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.159232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" event={"ID":"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10","Type":"ContainerStarted","Data":"9bc39aaab42eee5bcc7d9097754476566dcc742d443a01fbb77c62164857d1d3"} Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.205802 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pdfr5\" (UniqueName: \"kubernetes.io/projected/24948f97-9424-4a52-82ed-a901848d4018-kube-api-access-pdfr5\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.236859 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.276212 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.308996 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.309029 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.388804 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.410875 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.458598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "24948f97-9424-4a52-82ed-a901848d4018" (UID: "24948f97-9424-4a52-82ed-a901848d4018"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.512467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "705d3da4-5e5b-4fa0-b043-7d49a598a013" (UID: "705d3da4-5e5b-4fa0-b043-7d49a598a013"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.517427 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/705d3da4-5e5b-4fa0-b043-7d49a598a013-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.517459 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.553882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.563655 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: W1121 13:01:13.600657 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b71c1a7_9cac_4999_a86d_ef9dd005cd51.slice/crio-adaa17d8d84d2f758f0c597417e346eeb3099f5eec94aa47ed7b52ed8c05915d WatchSource:0}: Error finding container adaa17d8d84d2f758f0c597417e346eeb3099f5eec94aa47ed7b52ed8c05915d: Status 404 returned error can't find the container with id adaa17d8d84d2f758f0c597417e346eeb3099f5eec94aa47ed7b52ed8c05915d Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.607318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "358b6f0c-4310-4a43-9b1b-090cdb219e42" (UID: "358b6f0c-4310-4a43-9b1b-090cdb219e42"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.607452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "24948f97-9424-4a52-82ed-a901848d4018" (UID: "24948f97-9424-4a52-82ed-a901848d4018"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.621948 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.621982 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.621995 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/24948f97-9424-4a52-82ed-a901848d4018-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.622004 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/358b6f0c-4310-4a43-9b1b-090cdb219e42-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.782518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.782578 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.782589 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6f48d8578c-kdj4r"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.843702 4769 scope.go:117] "RemoveContainer" containerID="febfee118e9eed487e0935be09ceee0423f97b88427df8ddff82bc0e98f6bfc0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.900673 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.934836 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.950177 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.966351 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:13 crc kubenswrapper[4769]: E1121 13:01:13.967106 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24948f97-9424-4a52-82ed-a901848d4018" containerName="memcached" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967128 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="24948f97-9424-4a52-82ed-a901848d4018" containerName="memcached" Nov 21 13:01:13 crc kubenswrapper[4769]: E1121 13:01:13.967142 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="52e37e21-a610-455a-bb12-c5ab8f7a824d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967149 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e37e21-a610-455a-bb12-c5ab8f7a824d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:13 crc kubenswrapper[4769]: E1121 13:01:13.967163 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="ovsdbserver-sb" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967171 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="ovsdbserver-sb" Nov 21 13:01:13 crc kubenswrapper[4769]: E1121 13:01:13.967212 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="openstack-network-exporter" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967220 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="openstack-network-exporter" Nov 21 13:01:13 crc kubenswrapper[4769]: E1121 13:01:13.967251 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="openstack-network-exporter" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967259 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="openstack-network-exporter" Nov 21 13:01:13 crc kubenswrapper[4769]: E1121 13:01:13.967282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="ovsdbserver-nb" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967289 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="ovsdbserver-nb" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967520 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="52e37e21-a610-455a-bb12-c5ab8f7a824d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967542 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="ovsdbserver-sb" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967549 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" containerName="openstack-network-exporter" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967574 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="openstack-network-exporter" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967587 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" containerName="ovsdbserver-nb" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.967602 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="24948f97-9424-4a52-82ed-a901848d4018" containerName="memcached" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.969063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.970636 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-6t2fb" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.971302 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.971496 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.971627 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:01:13 crc kubenswrapper[4769]: I1121 13:01:13.998043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.020023 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.023234 4769 scope.go:117] "RemoveContainer" containerID="d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.023578 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.032478 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-nova-novncproxy-tls-certs\") pod \"52e37e21-a610-455a-bb12-c5ab8f7a824d\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.032630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-986pp\" (UniqueName: \"kubernetes.io/projected/52e37e21-a610-455a-bb12-c5ab8f7a824d-kube-api-access-986pp\") pod \"52e37e21-a610-455a-bb12-c5ab8f7a824d\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.032675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-config-data\") pod \"52e37e21-a610-455a-bb12-c5ab8f7a824d\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.032778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-combined-ca-bundle\") pod \"52e37e21-a610-455a-bb12-c5ab8f7a824d\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.032959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-vencrypt-tls-certs\") pod \"52e37e21-a610-455a-bb12-c5ab8f7a824d\" (UID: \"52e37e21-a610-455a-bb12-c5ab8f7a824d\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-config\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.033926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvj6\" (UniqueName: \"kubernetes.io/projected/4f636b17-3f16-433a-b5a1-7ec47c877774-kube-api-access-vnvj6\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.063484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52e37e21-a610-455a-bb12-c5ab8f7a824d-kube-api-access-986pp" (OuterVolumeSpecName: "kube-api-access-986pp") pod "52e37e21-a610-455a-bb12-c5ab8f7a824d" (UID: "52e37e21-a610-455a-bb12-c5ab8f7a824d"). InnerVolumeSpecName "kube-api-access-986pp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.093496 4769 scope.go:117] "RemoveContainer" containerID="0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.097804 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.099967 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.116091 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-operator-scripts\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config\") pod \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-default\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fptp\" (UniqueName: \"kubernetes.io/projected/a413893e-4d16-4422-9d8f-0a3d98578734-kube-api-access-8fptp\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-combined-ca-bundle\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-combined-ca-bundle\") pod \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-generated\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-kolla-config\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-galera-tls-certs\") pod \"a413893e-4d16-4422-9d8f-0a3d98578734\" (UID: \"a413893e-4d16-4422-9d8f-0a3d98578734\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config-secret\") pod \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.139761 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpp9l\" (UniqueName: \"kubernetes.io/projected/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-kube-api-access-vpp9l\") pod \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\" (UID: \"0781bd72-3fe4-4e94-aa2b-cc3f577ab70a\") " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-config\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvj6\" (UniqueName: \"kubernetes.io/projected/4f636b17-3f16-433a-b5a1-7ec47c877774-kube-api-access-vnvj6\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.140872 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-986pp\" (UniqueName: \"kubernetes.io/projected/52e37e21-a610-455a-bb12-c5ab8f7a824d-kube-api-access-986pp\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.148551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.149005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.149900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.151042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-config\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.151118 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.153047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.153725 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:14 crc kubenswrapper[4769]: E1121 13:01:14.154821 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" containerName="mysql-bootstrap" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.154842 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" containerName="mysql-bootstrap" Nov 21 13:01:14 crc kubenswrapper[4769]: E1121 13:01:14.154907 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" containerName="galera" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.154915 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" containerName="galera" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.155465 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" containerName="galera" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.156639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a413893e-4d16-4422-9d8f-0a3d98578734-kube-api-access-8fptp" (OuterVolumeSpecName: "kube-api-access-8fptp") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "kube-api-access-8fptp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.156735 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.157999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.158632 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.158994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.159905 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-hqthj" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.160169 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.216399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.217484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-kube-api-access-vpp9l" (OuterVolumeSpecName: "kube-api-access-vpp9l") pod "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" (UID: "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a"). InnerVolumeSpecName "kube-api-access-vpp9l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.217678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.218129 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvj6\" (UniqueName: \"kubernetes.io/projected/4f636b17-3f16-433a-b5a1-7ec47c877774-kube-api-access-vnvj6\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.218907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.232003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-config-data" (OuterVolumeSpecName: "config-data") pod "52e37e21-a610-455a-bb12-c5ab8f7a824d" (UID: "52e37e21-a610-455a-bb12-c5ab8f7a824d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.234611 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.234611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"52e37e21-a610-455a-bb12-c5ab8f7a824d","Type":"ContainerDied","Data":"b1141f4510ec3bec05e095b3d44c84c98d88bdce4e4181c6914d22f467b7b0f5"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.258535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" event={"ID":"9239d708-5ee4-40e4-ae65-cfdc903874f3","Type":"ContainerStarted","Data":"05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.262371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-memcached-tls-certs\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.262515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vphwc\" (UniqueName: \"kubernetes.io/projected/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kube-api-access-vphwc\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.262550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kolla-config\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.262808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-config-data\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.262855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-combined-ca-bundle\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263225 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" event={"ID":"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10","Type":"ContainerStarted","Data":"d96d5a3d9c316962b35ba1fa7f9d314612460d96fc2a350d8150a874ca24d9ec"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263727 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263745 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8fptp\" (UniqueName: \"kubernetes.io/projected/a413893e-4d16-4422-9d8f-0a3d98578734-kube-api-access-8fptp\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263763 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a413893e-4d16-4422-9d8f-0a3d98578734-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263775 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263785 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263859 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vpp9l\" (UniqueName: \"kubernetes.io/projected/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-kube-api-access-vpp9l\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.263878 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a413893e-4d16-4422-9d8f-0a3d98578734-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.284250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" event={"ID":"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0","Type":"ContainerStarted","Data":"049446bda5a733e070fc27757ba963bf2e38e109da80dee2b5aa73e0b6146264"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.288500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "mysql-db") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.299361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"9e3ae579-d4ee-4c52-b835-adb607df1176","Type":"ContainerStarted","Data":"117d8761cac64b7aaff687862da55a52887d5d0004cd5bbb98883d971aaec95b"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.320130 4769 generic.go:334] "Generic (PLEG): container finished" podID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerID="d053a37dbdd2a57dda79a762d52fcccf37c4606694e35ee18c386a0f4920d3d1" exitCode=0 Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.320162 4769 generic.go:334] "Generic (PLEG): container finished" podID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerID="4f928b644488d4a360447741ffe8fedd5c00337fe2eaba4fa016957e725491e2" exitCode=0 Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.320243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerDied","Data":"d053a37dbdd2a57dda79a762d52fcccf37c4606694e35ee18c386a0f4920d3d1"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.320272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerDied","Data":"4f928b644488d4a360447741ffe8fedd5c00337fe2eaba4fa016957e725491e2"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.320314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6","Type":"ContainerDied","Data":"44d99dd463ffaac00fd75a3598f2d6466b372fcd567be135e4c6dc8366dc4a48"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.320325 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44d99dd463ffaac00fd75a3598f2d6466b372fcd567be135e4c6dc8366dc4a48" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.323872 4769 generic.go:334] "Generic (PLEG): container finished" podID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" containerID="bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c" exitCode=137 Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.323981 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.327008 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.328255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" event={"ID":"8b71c1a7-9cac-4999-a86d-ef9dd005cd51","Type":"ContainerStarted","Data":"adaa17d8d84d2f758f0c597417e346eeb3099f5eec94aa47ed7b52ed8c05915d"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.334142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" event={"ID":"e5f96b2f-5d0c-4fc9-bf04-574534677fec","Type":"ContainerStarted","Data":"bbff853c420bfd7298bea7cb6253a943ca8c034f8792980d5859ef69091d86c3"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.348708 4769 generic.go:334] "Generic (PLEG): container finished" podID="a413893e-4d16-4422-9d8f-0a3d98578734" containerID="5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd" exitCode=0 Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.348774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"a413893e-4d16-4422-9d8f-0a3d98578734","Type":"ContainerDied","Data":"5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.348797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"a413893e-4d16-4422-9d8f-0a3d98578734","Type":"ContainerDied","Data":"0ad52e339e423e12fb434440f60df77e7253d156d7970e58abf38dd06f1d9b28"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.348871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.355916 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" event={"ID":"032f278a-33da-49e9-a3e1-54d565bff7ca","Type":"ContainerStarted","Data":"acd47200da700f8d6342bee4b93c3e85e35ba83f8257a1750aa6d6abbc2c3d23"} Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.366503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-config-data\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.366555 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-combined-ca-bundle\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.366610 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-memcached-tls-certs\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.366653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vphwc\" (UniqueName: \"kubernetes.io/projected/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kube-api-access-vphwc\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.366671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kolla-config\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.366758 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.368715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-config-data\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.371092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kolla-config\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.391106 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-memcached-tls-certs\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.391111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-combined-ca-bundle\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.396152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vphwc\" (UniqueName: \"kubernetes.io/projected/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kube-api-access-vphwc\") pod \"memcached-0\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.450746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52e37e21-a610-455a-bb12-c5ab8f7a824d" (UID: "52e37e21-a610-455a-bb12-c5ab8f7a824d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.468864 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.497719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "52e37e21-a610-455a-bb12-c5ab8f7a824d" (UID: "52e37e21-a610-455a-bb12-c5ab8f7a824d"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.505367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" (UID: "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.510939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.567477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.570749 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.570870 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.570903 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.618802 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.665936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" (UID: "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.673453 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.674100 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.690368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "52e37e21-a610-455a-bb12-c5ab8f7a824d" (UID: "52e37e21-a610-455a-bb12-c5ab8f7a824d"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.698343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" (UID: "0781bd72-3fe4-4e94-aa2b-cc3f577ab70a"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.701359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "a413893e-4d16-4422-9d8f-0a3d98578734" (UID: "a413893e-4d16-4422-9d8f-0a3d98578734"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.776332 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/52e37e21-a610-455a-bb12-c5ab8f7a824d-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.776369 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/a413893e-4d16-4422-9d8f-0a3d98578734-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:14 crc kubenswrapper[4769]: I1121 13:01:14.776379 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.056894 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.058440 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.059478 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.060658 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.060704 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="80493384-e023-40a6-bac4-16a270ce4876" containerName="nova-cell1-conductor-conductor" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.063422 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.064846 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.065426 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f92f9178-636b-41c7-9468-54183e16a0a0" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.293243 4769 scope.go:117] "RemoveContainer" containerID="d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.296809 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc\": container with ID starting with d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc not found: ID does not exist" containerID="d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.296853 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc"} err="failed to get container status \"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc\": rpc error: code = NotFound desc = could not find container \"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc\": container with ID starting with d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc not found: ID does not exist" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.296877 4769 scope.go:117] "RemoveContainer" containerID="0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.298265 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4\": container with ID starting with 0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4 not found: ID does not exist" containerID="0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.298308 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4"} err="failed to get container status \"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4\": rpc error: code = NotFound desc = could not find container \"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4\": container with ID starting with 0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4 not found: ID does not exist" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.298335 4769 scope.go:117] "RemoveContainer" containerID="d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.299613 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" path="/var/lib/kubelet/pods/0781bd72-3fe4-4e94-aa2b-cc3f577ab70a/volumes" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.300494 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc"} err="failed to get container status \"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc\": rpc error: code = NotFound desc = could not find container \"d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc\": container with ID starting with d70136239ba1f50075124f716c91316d20b83883a77defe42b9f36bb597be7bc not found: ID does not exist" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.300518 4769 scope.go:117] "RemoveContainer" containerID="0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.300655 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24948f97-9424-4a52-82ed-a901848d4018" path="/var/lib/kubelet/pods/24948f97-9424-4a52-82ed-a901848d4018/volumes" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.301338 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4"} err="failed to get container status \"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4\": rpc error: code = NotFound desc = could not find container \"0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4\": container with ID starting with 0517ec901a73ead367479dafee3f8903a26df85fb82ad416e9d28ca65045d4f4 not found: ID does not exist" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.301366 4769 scope.go:117] "RemoveContainer" containerID="a216beb58561c45c325c7f118d87f7d0a929d030f189e19d53aa0d57fca8de8e" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.301529 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="705d3da4-5e5b-4fa0-b043-7d49a598a013" path="/var/lib/kubelet/pods/705d3da4-5e5b-4fa0-b043-7d49a598a013/volumes" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.340521 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.341909 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.345363 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.345419 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="ovn-northd" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.368697 4769 generic.go:334] "Generic (PLEG): container finished" podID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerID="fd6c613f64ef206587c06c6e0e3f6c4a769a9ad5115b62b885c20e5c1a800799" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.368758 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a784a6a4-b4b4-4133-b747-46431dce82a5","Type":"ContainerDied","Data":"fd6c613f64ef206587c06c6e0e3f6c4a769a9ad5115b62b885c20e5c1a800799"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.368783 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"a784a6a4-b4b4-4133-b747-46431dce82a5","Type":"ContainerDied","Data":"a451ce9dd4327aa992c1114370fedcdc326e7000078725422e2cf2c0251dec29"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.368794 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a451ce9dd4327aa992c1114370fedcdc326e7000078725422e2cf2c0251dec29" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.391781 4769 generic.go:334] "Generic (PLEG): container finished" podID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerID="8fc9f2c1ab4028ce5e693ffad5e61ab730f5b37f730df26f975a8b1640279b35" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.391886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"fb742bc1-0b2d-4699-8172-31d54051b8b3","Type":"ContainerDied","Data":"8fc9f2c1ab4028ce5e693ffad5e61ab730f5b37f730df26f975a8b1640279b35"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.391938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"fb742bc1-0b2d-4699-8172-31d54051b8b3","Type":"ContainerDied","Data":"fc4558cd730e3d0ed996ca5ebf206d9a905a7f03513fb404835d46a19a7ea2ee"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.391957 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc4558cd730e3d0ed996ca5ebf206d9a905a7f03513fb404835d46a19a7ea2ee" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.393870 4769 generic.go:334] "Generic (PLEG): container finished" podID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerID="02efc9c3fec36d6b1b0eff3340763771cd222e2a3d33e5bc23ff7890c47108ce" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.393907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"93ff2c8a-0d89-42ea-bf5a-8928949f45f5","Type":"ContainerDied","Data":"02efc9c3fec36d6b1b0eff3340763771cd222e2a3d33e5bc23ff7890c47108ce"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.395015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" event={"ID":"e5f96b2f-5d0c-4fc9-bf04-574534677fec","Type":"ContainerStarted","Data":"782e45113e125d9bcbbd6f234c532a25460bd4974f2220fab39c91945e29dcb3"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.397551 4769 generic.go:334] "Generic (PLEG): container finished" podID="d1a91e92-f4a2-4279-aa88-caf6df42d841" containerID="0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.397651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d1a91e92-f4a2-4279-aa88-caf6df42d841","Type":"ContainerDied","Data":"0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.397686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d1a91e92-f4a2-4279-aa88-caf6df42d841","Type":"ContainerDied","Data":"404d5c9f5b2b0c6e04d1e94fbeca1c07e8f4c4f393ee17b76b87282dc54b0def"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.398569 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="404d5c9f5b2b0c6e04d1e94fbeca1c07e8f4c4f393ee17b76b87282dc54b0def" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.422997 4769 generic.go:334] "Generic (PLEG): container finished" podID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerID="9e3ef90f84d9f9dfeca8d5caac2d6ca840a8002a6abc730d5e882c57a0035f93" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.423079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5dffcaa1-afe1-43af-8ccb-1237aa971d6c","Type":"ContainerDied","Data":"9e3ef90f84d9f9dfeca8d5caac2d6ca840a8002a6abc730d5e882c57a0035f93"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.423105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"5dffcaa1-afe1-43af-8ccb-1237aa971d6c","Type":"ContainerDied","Data":"d647b8a334fd602ef525ab8192dc573b9519394cbc2753c1296fa59b37c96f20"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.423137 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d647b8a334fd602ef525ab8192dc573b9519394cbc2753c1296fa59b37c96f20" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.428381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" event={"ID":"9239d708-5ee4-40e4-ae65-cfdc903874f3","Type":"ContainerStarted","Data":"f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.444445 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" podStartSLOduration=5.4444298 podStartE2EDuration="5.4444298s" podCreationTimestamp="2025-11-21 13:01:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:15.442554109 +0000 UTC m=+4234.143215927" watchObservedRunningTime="2025-11-21 13:01:15.4444298 +0000 UTC m=+4234.145091618" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.454816 4769 generic.go:334] "Generic (PLEG): container finished" podID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerID="40685a2f76271238d87ffc258be2c0c73baffaec2773e0f9ce1d9d608bb49941" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.454903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"09da4a70-f95f-4080-b7d4-b3ce7ede34c1","Type":"ContainerDied","Data":"40685a2f76271238d87ffc258be2c0c73baffaec2773e0f9ce1d9d608bb49941"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.472027 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8"] Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.472267 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker-log" containerID="cri-o://145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8" gracePeriod=30 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.472694 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker" containerID="cri-o://6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554" gracePeriod=30 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.477611 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1510c24-a296-4443-b9a6-237c100402a1" containerID="7ab702e2147d6315099f76b750890646912be5b10762830746117eb2a025e4a0" exitCode=0 Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.477636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b1510c24-a296-4443-b9a6-237c100402a1","Type":"ContainerDied","Data":"7ab702e2147d6315099f76b750890646912be5b10762830746117eb2a025e4a0"} Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.810291 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="0781bd72-3fe4-4e94-aa2b-cc3f577ab70a" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.835669 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.837510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.854584 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.855629 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.863283 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.872854 4769 scope.go:117] "RemoveContainer" containerID="bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.874259 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.874828 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-notification-agent" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.874841 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-notification-agent" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.874864 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="proxy-httpd" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.874871 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="proxy-httpd" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.874883 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-central-agent" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.874890 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-central-agent" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.874907 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="sg-core" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.874913 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="sg-core" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.875124 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="sg-core" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.875144 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-central-agent" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.875164 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="ceilometer-notification-agent" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.875178 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" containerName="proxy-httpd" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.876414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.889022 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xpkvg" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.889304 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.889393 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.889488 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.889677 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.904153 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.190:8775/\": read tcp 10.217.0.2:60238->10.217.0.190:8775: read: connection reset by peer" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.904448 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.190:8775/\": read tcp 10.217.0.2:60224->10.217.0.190:8775: read: connection reset by peer" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.907049 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.912609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.914797 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.918817 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.930439 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.939568 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.945394 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.962337 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963293 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerName="mysql-bootstrap" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963311 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerName="mysql-bootstrap" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963329 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-log" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963334 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-log" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="probe" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963352 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="probe" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963363 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-api" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963368 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-api" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963383 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-log" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-log" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963411 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="cinder-scheduler" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963419 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="cinder-scheduler" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerName="galera" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963445 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerName="galera" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963454 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d1a91e92-f4a2-4279-aa88-caf6df42d841" containerName="nova-scheduler-scheduler" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963459 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a91e92-f4a2-4279-aa88-caf6df42d841" containerName="nova-scheduler-scheduler" Nov 21 13:01:15 crc kubenswrapper[4769]: E1121 13:01:15.963469 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-httpd" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963474 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-httpd" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963653 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-log" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963671 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d1a91e92-f4a2-4279-aa88-caf6df42d841" containerName="nova-scheduler-scheduler" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963682 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-httpd" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963690 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="probe" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" containerName="galera" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963706 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" containerName="cinder-scheduler" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963714 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" containerName="nova-api-api" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.963726 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" containerName="glance-log" Nov 21 13:01:15 crc kubenswrapper[4769]: I1121 13:01:15.964455 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.001946 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.003996 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.004108 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.004861 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.004908 4769 scope.go:117] "RemoveContainer" containerID="bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c" Nov 21 13:01:16 crc kubenswrapper[4769]: E1121 13:01:16.006303 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c\": container with ID starting with bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c not found: ID does not exist" containerID="bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.006352 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c"} err="failed to get container status \"bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c\": rpc error: code = NotFound desc = could not find container \"bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c\": container with ID starting with bb3a3bc22cc4bf753b64eab4725e8bb33da0033c5bda010a936bfa34be602a8c not found: ID does not exist" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.006379 4769 scope.go:117] "RemoveContainer" containerID="5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.006499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.038365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.066428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a784a6a4-b4b4-4133-b747-46431dce82a5-etc-machine-id\") pod \"a784a6a4-b4b4-4133-b747-46431dce82a5\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.066496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-combined-ca-bundle\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.066531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-galera-tls-certs\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.067940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-config-data\") pod \"d1a91e92-f4a2-4279-aa88-caf6df42d841\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.068169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data-custom\") pod \"a784a6a4-b4b4-4133-b747-46431dce82a5\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.068244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data\") pod \"a784a6a4-b4b4-4133-b747-46431dce82a5\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.068750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-internal-tls-certs\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n878f\" (UniqueName: \"kubernetes.io/projected/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-kube-api-access-n878f\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-scripts\") pod \"a784a6a4-b4b4-4133-b747-46431dce82a5\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069471 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-sg-core-conf-yaml\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjk6l\" (UniqueName: \"kubernetes.io/projected/a784a6a4-b4b4-4133-b747-46431dce82a5-kube-api-access-cjk6l\") pod \"a784a6a4-b4b4-4133-b747-46431dce82a5\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcmlq\" (UniqueName: \"kubernetes.io/projected/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-kube-api-access-dcmlq\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.069878 4769 scope.go:117] "RemoveContainer" containerID="ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-config-data\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-combined-ca-bundle\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-scripts\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070483 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-ceilometer-tls-certs\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070512 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-operator-scripts\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-combined-ca-bundle\") pod \"a784a6a4-b4b4-4133-b747-46431dce82a5\" (UID: \"a784a6a4-b4b4-4133-b747-46431dce82a5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-kolla-config\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.070593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.072217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-httpd-run\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.072612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-generated\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.073160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-combined-ca-bundle\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.073476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhgm6\" (UniqueName: \"kubernetes.io/projected/fb742bc1-0b2d-4699-8172-31d54051b8b3-kube-api-access-fhgm6\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.073503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-run-httpd\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.074241 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-logs\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.076027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-combined-ca-bundle\") pod \"d1a91e92-f4a2-4279-aa88-caf6df42d841\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.076073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-scripts\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.076097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-log-httpd\") pod \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\" (UID: \"b19a9c0b-0847-4a51-a267-5ad85f4fa9f6\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.076136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbhf6\" (UniqueName: \"kubernetes.io/projected/d1a91e92-f4a2-4279-aa88-caf6df42d841-kube-api-access-zbhf6\") pod \"d1a91e92-f4a2-4279-aa88-caf6df42d841\" (UID: \"d1a91e92-f4a2-4279-aa88-caf6df42d841\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.076159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-config-data\") pod \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\" (UID: \"5dffcaa1-afe1-43af-8ccb-1237aa971d6c\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.076205 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-default\") pod \"fb742bc1-0b2d-4699-8172-31d54051b8b3\" (UID: \"fb742bc1-0b2d-4699-8172-31d54051b8b3\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.080598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a784a6a4-b4b4-4133-b747-46431dce82a5-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "a784a6a4-b4b4-4133-b747-46431dce82a5" (UID: "a784a6a4-b4b4-4133-b747-46431dce82a5"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.089816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.092376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.092498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.092609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.092714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.098232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.098404 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.098698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vmz\" (UniqueName: \"kubernetes.io/projected/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-kube-api-access-m8vmz\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.098899 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.099493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.099689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.099801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.100597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzpmx\" (UniqueName: \"kubernetes.io/projected/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kube-api-access-rzpmx\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.100649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.102349 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.102376 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a784a6a4-b4b4-4133-b747-46431dce82a5-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.100104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.103091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.103532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.147338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.151169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-logs" (OuterVolumeSpecName: "logs") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.151447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.185299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ljzj\" (UniqueName: \"kubernetes.io/projected/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-kube-api-access-5ljzj\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205661 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-etc-machine-id\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-internal-tls-certs\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data-custom\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-public-tls-certs\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-combined-ca-bundle\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-public-tls-certs\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.205981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-config-data\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-config-data\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhqdz\" (UniqueName: \"kubernetes.io/projected/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-kube-api-access-nhqdz\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhbjq\" (UniqueName: \"kubernetes.io/projected/b1510c24-a296-4443-b9a6-237c100402a1-kube-api-access-hhbjq\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-scripts\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-httpd-run\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.206233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-logs\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.207348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-public-tls-certs\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.207428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-logs\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.207458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-scripts\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.207488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-logs\") pod \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\" (UID: \"09da4a70-f95f-4080-b7d4-b3ce7ede34c1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.207515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-internal-tls-certs\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.207570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-combined-ca-bundle\") pod \"b1510c24-a296-4443-b9a6-237c100402a1\" (UID: \"b1510c24-a296-4443-b9a6-237c100402a1\") " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rzpmx\" (UniqueName: \"kubernetes.io/projected/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kube-api-access-rzpmx\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vmz\" (UniqueName: \"kubernetes.io/projected/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-kube-api-access-m8vmz\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208825 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208842 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/fb742bc1-0b2d-4699-8172-31d54051b8b3-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208855 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208866 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208879 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208890 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.208900 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/fb742bc1-0b2d-4699-8172-31d54051b8b3-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.210181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.218493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.221491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-logs" (OuterVolumeSpecName: "logs") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.223571 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.227267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.231062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.236170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.238291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.241535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-logs" (OuterVolumeSpecName: "logs") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.242090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.242264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.247715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.251452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-logs" (OuterVolumeSpecName: "logs") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.251598 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vmz\" (UniqueName: \"kubernetes.io/projected/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-kube-api-access-m8vmz\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.252142 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzpmx\" (UniqueName: \"kubernetes.io/projected/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kube-api-access-rzpmx\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.279919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.280167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.283613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.317587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-kube-api-access-nhqdz" (OuterVolumeSpecName: "kube-api-access-nhqdz") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "kube-api-access-nhqdz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.317609 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-scripts" (OuterVolumeSpecName: "scripts") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.317669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.317688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.317739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a91e92-f4a2-4279-aa88-caf6df42d841-kube-api-access-zbhf6" (OuterVolumeSpecName: "kube-api-access-zbhf6") pod "d1a91e92-f4a2-4279-aa88-caf6df42d841" (UID: "d1a91e92-f4a2-4279-aa88-caf6df42d841"). InnerVolumeSpecName "kube-api-access-zbhf6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.317750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a784a6a4-b4b4-4133-b747-46431dce82a5-kube-api-access-cjk6l" (OuterVolumeSpecName: "kube-api-access-cjk6l") pod "a784a6a4-b4b4-4133-b747-46431dce82a5" (UID: "a784a6a4-b4b4-4133-b747-46431dce82a5"). InnerVolumeSpecName "kube-api-access-cjk6l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.321356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-scripts" (OuterVolumeSpecName: "scripts") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.323281 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1510c24-a296-4443-b9a6-237c100402a1-kube-api-access-hhbjq" (OuterVolumeSpecName: "kube-api-access-hhbjq") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "kube-api-access-hhbjq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.323363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-kube-api-access-5ljzj" (OuterVolumeSpecName: "kube-api-access-5ljzj") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "kube-api-access-5ljzj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.323395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-kube-api-access-dcmlq" (OuterVolumeSpecName: "kube-api-access-dcmlq") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "kube-api-access-dcmlq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.324399 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-scripts" (OuterVolumeSpecName: "scripts") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.325092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-scripts" (OuterVolumeSpecName: "scripts") pod "a784a6a4-b4b4-4133-b747-46431dce82a5" (UID: "a784a6a4-b4b4-4133-b747-46431dce82a5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.325550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.330005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb742bc1-0b2d-4699-8172-31d54051b8b3-kube-api-access-fhgm6" (OuterVolumeSpecName: "kube-api-access-fhgm6") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "kube-api-access-fhgm6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.341314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a784a6a4-b4b4-4133-b747-46431dce82a5" (UID: "a784a6a4-b4b4-4133-b747-46431dce82a5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.341478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-scripts" (OuterVolumeSpecName: "scripts") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.328519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-kube-api-access-n878f" (OuterVolumeSpecName: "kube-api-access-n878f") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "kube-api-access-n878f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342452 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342474 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1510c24-a296-4443-b9a6-237c100402a1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342486 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fhgm6\" (UniqueName: \"kubernetes.io/projected/fb742bc1-0b2d-4699-8172-31d54051b8b3-kube-api-access-fhgm6\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342498 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342509 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342517 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342526 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342535 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zbhf6\" (UniqueName: \"kubernetes.io/projected/d1a91e92-f4a2-4279-aa88-caf6df42d841-kube-api-access-zbhf6\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342544 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5ljzj\" (UniqueName: \"kubernetes.io/projected/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-kube-api-access-5ljzj\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342553 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342564 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342587 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342597 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n878f\" (UniqueName: \"kubernetes.io/projected/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-kube-api-access-n878f\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342608 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342617 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342627 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cjk6l\" (UniqueName: \"kubernetes.io/projected/a784a6a4-b4b4-4133-b747-46431dce82a5-kube-api-access-cjk6l\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342637 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dcmlq\" (UniqueName: \"kubernetes.io/projected/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-kube-api-access-dcmlq\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342646 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342654 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nhqdz\" (UniqueName: \"kubernetes.io/projected/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-kube-api-access-nhqdz\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342663 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hhbjq\" (UniqueName: \"kubernetes.io/projected/b1510c24-a296-4443-b9a6-237c100402a1-kube-api-access-hhbjq\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342676 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342684 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.342772 4769 scope.go:117] "RemoveContainer" containerID="5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd" Nov 21 13:01:16 crc kubenswrapper[4769]: E1121 13:01:16.352445 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd\": container with ID starting with 5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd not found: ID does not exist" containerID="5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.352520 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd"} err="failed to get container status \"5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd\": rpc error: code = NotFound desc = could not find container \"5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd\": container with ID starting with 5873e7ca83e5db52ffb323ed843b368a5a9e05982a7f8976842da0e21d416ccd not found: ID does not exist" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.352548 4769 scope.go:117] "RemoveContainer" containerID="ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66" Nov 21 13:01:16 crc kubenswrapper[4769]: E1121 13:01:16.355210 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66\": container with ID starting with ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66 not found: ID does not exist" containerID="ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.355359 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66"} err="failed to get container status \"ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66\": rpc error: code = NotFound desc = could not find container \"ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66\": container with ID starting with ed4724005c03ca8070f3ef6778038997c45c5efac4a149a8f2b5a43f6aaf1d66 not found: ID does not exist" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.405996 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.437335 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.442756 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.444014 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.444042 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.471989 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.501582 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerID="f1fbf5e59ab31384810106fd8eb0d8f6321c4b8aee8f6b186fb705b0eba28c27" exitCode=0 Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.501665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9f4bc5d5-860a-4468-b80f-9123698c878a","Type":"ContainerDied","Data":"f1fbf5e59ab31384810106fd8eb0d8f6321c4b8aee8f6b186fb705b0eba28c27"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.507098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"09da4a70-f95f-4080-b7d4-b3ce7ede34c1","Type":"ContainerDied","Data":"1096630c81d73ec1dbbcd5888b5081183afdbef45e0224d3604307a24871f2d6"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.507145 4769 scope.go:117] "RemoveContainer" containerID="40685a2f76271238d87ffc258be2c0c73baffaec2773e0f9ce1d9d608bb49941" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.507310 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.508562 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.524791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" event={"ID":"032f278a-33da-49e9-a3e1-54d565bff7ca","Type":"ContainerStarted","Data":"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.525081 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.525444 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.527794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" event={"ID":"8b71c1a7-9cac-4999-a86d-ef9dd005cd51","Type":"ContainerStarted","Data":"ca112281091f134f063a730f0d05455846dd4539dd38263b6eb303013005f234"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.527999 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.545814 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.548153 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.561351 4769 generic.go:334] "Generic (PLEG): container finished" podID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerID="145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8" exitCode=143 Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.561412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" event={"ID":"f9a99993-e243-4bcc-8b63-08db8159c08e","Type":"ContainerDied","Data":"145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.562828 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.562881 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.563163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.573251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b1510c24-a296-4443-b9a6-237c100402a1","Type":"ContainerDied","Data":"2034f6b0658fb1bc0a0d520d1ca03e448e305933ce7bde20334f4fe87ed8349f"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.573362 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.586216 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" podStartSLOduration=5.58620046 podStartE2EDuration="5.58620046s" podCreationTimestamp="2025-11-21 13:01:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:16.578633376 +0000 UTC m=+4235.279295194" watchObservedRunningTime="2025-11-21 13:01:16.58620046 +0000 UTC m=+4235.286862278" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.599545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"93ff2c8a-0d89-42ea-bf5a-8928949f45f5","Type":"ContainerDied","Data":"57bb9b422f1e9e5fd36eef1777a136e4ff94c63f22d5c1f2d433a14d210fe30d"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.599638 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.623168 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" podStartSLOduration=5.623152135 podStartE2EDuration="5.623152135s" podCreationTimestamp="2025-11-21 13:01:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:16.608622444 +0000 UTC m=+4235.309284262" watchObservedRunningTime="2025-11-21 13:01:16.623152135 +0000 UTC m=+4235.323813953" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.645574 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" event={"ID":"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0","Type":"ContainerStarted","Data":"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.650168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.660053 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.666416 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.666478 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.673239 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.677124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"9e3ae579-d4ee-4c52-b835-adb607df1176","Type":"ContainerStarted","Data":"ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.682625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.683288 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-config-data" (OuterVolumeSpecName: "config-data") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.689349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d1a91e92-f4a2-4279-aa88-caf6df42d841" (UID: "d1a91e92-f4a2-4279-aa88-caf6df42d841"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.703736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" event={"ID":"e5f96b2f-5d0c-4fc9-bf04-574534677fec","Type":"ContainerStarted","Data":"25f655eaa92541082059d40d76acd14ee48aa601c9f514e6fad079f6985ed66f"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.704846 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.713022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.716609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.717708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" event={"ID":"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10","Type":"ContainerStarted","Data":"cbb5c0eb7f259acc3323bb8b5c8d9c401022227da65a83cfa64853886e2cb033"} Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.718169 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.718390 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.718573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.718714 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.724900 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=5.724884925 podStartE2EDuration="5.724884925s" podCreationTimestamp="2025-11-21 13:01:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:16.710788315 +0000 UTC m=+4235.411450133" watchObservedRunningTime="2025-11-21 13:01:16.724884925 +0000 UTC m=+4235.425546743" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.803487 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" podStartSLOduration=5.803467471 podStartE2EDuration="5.803467471s" podCreationTimestamp="2025-11-21 13:01:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:16.7918986 +0000 UTC m=+4235.492560418" watchObservedRunningTime="2025-11-21 13:01:16.803467471 +0000 UTC m=+4235.504129289" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.805592 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.805618 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.805630 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.805640 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.828226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.878210 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.889641 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.901551 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" podStartSLOduration=6.901528532 podStartE2EDuration="6.901528532s" podCreationTimestamp="2025-11-21 13:01:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:16.87062848 +0000 UTC m=+4235.571290298" watchObservedRunningTime="2025-11-21 13:01:16.901528532 +0000 UTC m=+4235.602190350" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.910517 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.938282 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7"] Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.942382 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener" containerID="cri-o://22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0" gracePeriod=30 Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.944819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener-log" containerID="cri-o://53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa" gracePeriod=30 Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.969177 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:16 crc kubenswrapper[4769]: I1121 13:01:16.989310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "fb742bc1-0b2d-4699-8172-31d54051b8b3" (UID: "fb742bc1-0b2d-4699-8172-31d54051b8b3"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.011088 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.013145 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.013172 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.013183 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/fb742bc1-0b2d-4699-8172-31d54051b8b3-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.048428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.095441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-config-data" (OuterVolumeSpecName: "config-data") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.114596 4769 scope.go:117] "RemoveContainer" containerID="af009266358960d2a563c010192404ec300e3d322b0d6a118f6f9e9b56978335" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.117060 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.117081 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.127235 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.138479 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146233 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:17 crc kubenswrapper[4769]: E1121 13:01:17.146722 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146734 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api" Nov 21 13:01:17 crc kubenswrapper[4769]: E1121 13:01:17.146750 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-httpd" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146757 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-httpd" Nov 21 13:01:17 crc kubenswrapper[4769]: E1121 13:01:17.146773 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api-log" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146779 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api-log" Nov 21 13:01:17 crc kubenswrapper[4769]: E1121 13:01:17.146792 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-log" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146799 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-log" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146959 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146974 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-httpd" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.146990 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api-log" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.147001 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1510c24-a296-4443-b9a6-237c100402a1" containerName="glance-log" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.185794 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.185896 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.209304 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.209592 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-n8kjm" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.209804 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.210643 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-default\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218565 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-operator-scripts\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-generated\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kolla-config\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22vkh\" (UniqueName: \"kubernetes.io/projected/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kube-api-access-22vkh\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.218704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.291889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-config-data" (OuterVolumeSpecName: "config-data") pod "d1a91e92-f4a2-4279-aa88-caf6df42d841" (UID: "d1a91e92-f4a2-4279-aa88-caf6df42d841"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.311328 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52e37e21-a610-455a-bb12-c5ab8f7a824d" path="/var/lib/kubelet/pods/52e37e21-a610-455a-bb12-c5ab8f7a824d/volumes" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.313450 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a413893e-4d16-4422-9d8f-0a3d98578734" path="/var/lib/kubelet/pods/a413893e-4d16-4422-9d8f-0a3d98578734/volumes" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.314292 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb742bc1-0b2d-4699-8172-31d54051b8b3" path="/var/lib/kubelet/pods/fb742bc1-0b2d-4699-8172-31d54051b8b3/volumes" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-default\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-operator-scripts\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-generated\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kolla-config\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-22vkh\" (UniqueName: \"kubernetes.io/projected/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kube-api-access-22vkh\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.319934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.320049 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1a91e92-f4a2-4279-aa88-caf6df42d841-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.321437 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.331496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-generated\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.331663 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-config-data" (OuterVolumeSpecName: "config-data") pod "5dffcaa1-afe1-43af-8ccb-1237aa971d6c" (UID: "5dffcaa1-afe1-43af-8ccb-1237aa971d6c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.333764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kolla-config\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.333758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-operator-scripts\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.336503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-default\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.341784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.346704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.353279 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-22vkh\" (UniqueName: \"kubernetes.io/projected/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kube-api-access-22vkh\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.366547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.432181 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.432221 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5dffcaa1-afe1-43af-8ccb-1237aa971d6c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.538922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.582875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle\") pod \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\" (UID: \"93ff2c8a-0d89-42ea-bf5a-8928949f45f5\") " Nov 21 13:01:17 crc kubenswrapper[4769]: W1121 13:01:17.591819 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/93ff2c8a-0d89-42ea-bf5a-8928949f45f5/volumes/kubernetes.io~secret/combined-ca-bundle Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.591859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93ff2c8a-0d89-42ea-bf5a-8928949f45f5" (UID: "93ff2c8a-0d89-42ea-bf5a-8928949f45f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.607292 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93ff2c8a-0d89-42ea-bf5a-8928949f45f5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.771444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.818260 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.906234 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.919607 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.929460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a784a6a4-b4b4-4133-b747-46431dce82a5" (UID: "a784a6a4-b4b4-4133-b747-46431dce82a5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.931133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data" (OuterVolumeSpecName: "config-data") pod "09da4a70-f95f-4080-b7d4-b3ce7ede34c1" (UID: "09da4a70-f95f-4080-b7d4-b3ce7ede34c1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.931337 4769 generic.go:334] "Generic (PLEG): container finished" podID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerID="53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa" exitCode=143 Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.940312 4769 generic.go:334] "Generic (PLEG): container finished" podID="f92f9178-636b-41c7-9468-54183e16a0a0" containerID="d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54" exitCode=0 Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.974325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b1510c24-a296-4443-b9a6-237c100402a1" (UID: "b1510c24-a296-4443-b9a6-237c100402a1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:17 crc kubenswrapper[4769]: I1121 13:01:17.984222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.007568 4769 generic.go:334] "Generic (PLEG): container finished" podID="80493384-e023-40a6-bac4-16a270ce4876" containerID="39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b" exitCode=0 Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.028094 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09da4a70-f95f-4080-b7d4-b3ce7ede34c1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.028118 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1510c24-a296-4443-b9a6-237c100402a1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.028141 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.033617 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" podStartSLOduration=7.033573251 podStartE2EDuration="7.033573251s" podCreationTimestamp="2025-11-21 13:01:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:17.947134633 +0000 UTC m=+4236.647796451" watchObservedRunningTime="2025-11-21 13:01:18.033573251 +0000 UTC m=+4236.734235069" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.084227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data" (OuterVolumeSpecName: "config-data") pod "a784a6a4-b4b4-4133-b747-46431dce82a5" (UID: "a784a6a4-b4b4-4133-b747-46431dce82a5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.084984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-config-data" (OuterVolumeSpecName: "config-data") pod "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" (UID: "b19a9c0b-0847-4a51-a267-5ad85f4fa9f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.131030 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.131391 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a784a6a4-b4b4-4133-b747-46431dce82a5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.219291 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.219331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f","Type":"ContainerStarted","Data":"2a8fe60b85877cb12d928a93d4bee3d487ae3b5da0f7c59e19a4549b577a5213"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.219356 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.219372 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.219382 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.219395 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.221636 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223557 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2626dcd1-c6c3-4be2-b971-1e34ddab332f","Type":"ContainerStarted","Data":"71975b537e093071a7e8a79537c520e6cd0a2fbfa4109d415920acb878055764"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"9f4bc5d5-860a-4468-b80f-9123698c878a","Type":"ContainerDied","Data":"9040b7541841f0fa3ae914b7568165087b89600f3fba2e8728210adb245fe075"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223616 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9040b7541841f0fa3ae914b7568165087b89600f3fba2e8728210adb245fe075" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223625 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" event={"ID":"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0","Type":"ContainerStarted","Data":"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" event={"ID":"9ba8264d-24bb-4930-9aec-8e5ffd496a02","Type":"ContainerDied","Data":"53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223659 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f92f9178-636b-41c7-9468-54183e16a0a0","Type":"ContainerDied","Data":"d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223686 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd","Type":"ContainerStarted","Data":"19fb01126d5aedd51ab0ed4f20a178a792408ac2108a335db59e0094c2315bfe"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223708 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223719 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7584c7766-9n2mj"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"80493384-e023-40a6-bac4-16a270ce4876","Type":"ContainerDied","Data":"39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223742 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4f636b17-3f16-433a-b5a1-7ec47c877774","Type":"ContainerStarted","Data":"c4073c03ac9a31547971d88933c4c4d1df784075c7c6426b3b456ea52754df7e"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.223764 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.225985 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" event={"ID":"032f278a-33da-49e9-a3e1-54d565bff7ca","Type":"ContainerStarted","Data":"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660"} Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.226008 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-84c64569fd-l8k8s"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.227357 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.227374 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-84c64569fd-l8k8s"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.227452 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.238902 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.239049 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.239386 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.264696 4769 scope.go:117] "RemoveContainer" containerID="7ab702e2147d6315099f76b750890646912be5b10762830746117eb2a025e4a0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.345519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjbnd\" (UniqueName: \"kubernetes.io/projected/438a784a-03b1-4561-87c2-f01538a59ab0-kube-api-access-tjbnd\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.345599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.345644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-public-tls-certs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.345682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.345724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khx7\" (UniqueName: \"kubernetes.io/projected/6af1865c-3e9f-4329-bc4b-94679b29dfee-kube-api-access-7khx7\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.345767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-scripts\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/438a784a-03b1-4561-87c2-f01538a59ab0-logs\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-logs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-combined-ca-bundle\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data-custom\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-combined-ca-bundle\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6af1865c-3e9f-4329-bc4b-94679b29dfee-logs\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.346967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data-custom\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data-custom\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-combined-ca-bundle\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-public-tls-certs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dm5f\" (UniqueName: \"kubernetes.io/projected/9db4c881-e68a-4263-ba89-475028eef465-kube-api-access-5dm5f\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9db4c881-e68a-4263-ba89-475028eef465-logs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-internal-tls-certs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-config-data\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-internal-tls-certs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-combined-ca-bundle\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.347540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg6nn\" (UniqueName: \"kubernetes.io/projected/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-kube-api-access-bg6nn\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.430398 4769 scope.go:117] "RemoveContainer" containerID="19f0b0bcbb899350b2b83a2a2def359ff91ccb980719b7ac5ac27917a642d044" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data-custom\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448647 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-combined-ca-bundle\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-public-tls-certs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5dm5f\" (UniqueName: \"kubernetes.io/projected/9db4c881-e68a-4263-ba89-475028eef465-kube-api-access-5dm5f\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9db4c881-e68a-4263-ba89-475028eef465-logs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-internal-tls-certs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-config-data\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448764 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-internal-tls-certs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-combined-ca-bundle\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bg6nn\" (UniqueName: \"kubernetes.io/projected/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-kube-api-access-bg6nn\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tjbnd\" (UniqueName: \"kubernetes.io/projected/438a784a-03b1-4561-87c2-f01538a59ab0-kube-api-access-tjbnd\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448864 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-public-tls-certs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448900 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7khx7\" (UniqueName: \"kubernetes.io/projected/6af1865c-3e9f-4329-bc4b-94679b29dfee-kube-api-access-7khx7\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448940 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-scripts\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/438a784a-03b1-4561-87c2-f01538a59ab0-logs\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-logs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.448996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-combined-ca-bundle\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.449014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data-custom\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.449069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-combined-ca-bundle\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.449092 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6af1865c-3e9f-4329-bc4b-94679b29dfee-logs\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.449116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data-custom\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.451497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-logs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.451878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9db4c881-e68a-4263-ba89-475028eef465-logs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.456211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6af1865c-3e9f-4329-bc4b-94679b29dfee-logs\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.456980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/438a784a-03b1-4561-87c2-f01538a59ab0-logs\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.457547 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-internal-tls-certs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.459432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data-custom\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.459881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data-custom\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.460691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-config-data\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.461082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-combined-ca-bundle\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.466757 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.468419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-public-tls-certs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.471623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-combined-ca-bundle\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.472021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data-custom\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.472800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-public-tls-certs\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.473988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-combined-ca-bundle\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.476860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khx7\" (UniqueName: \"kubernetes.io/projected/6af1865c-3e9f-4329-bc4b-94679b29dfee-kube-api-access-7khx7\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.477248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-combined-ca-bundle\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.477477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.478556 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dm5f\" (UniqueName: \"kubernetes.io/projected/9db4c881-e68a-4263-ba89-475028eef465-kube-api-access-5dm5f\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.480517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-internal-tls-certs\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.480986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.481000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjbnd\" (UniqueName: \"kubernetes.io/projected/438a784a-03b1-4561-87c2-f01538a59ab0-kube-api-access-tjbnd\") pod \"barbican-worker-5fc9bd79f-l2nmx\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.481973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data\") pod \"barbican-keystone-listener-74b485df6b-p74zg\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.486340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-scripts\") pod \"placement-84c64569fd-l8k8s\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.506731 4769 scope.go:117] "RemoveContainer" containerID="02efc9c3fec36d6b1b0eff3340763771cd222e2a3d33e5bc23ff7890c47108ce" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.514505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg6nn\" (UniqueName: \"kubernetes.io/projected/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-kube-api-access-bg6nn\") pod \"barbican-api-7fcdff58d8-ttzgn\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.550493 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn2zv\" (UniqueName: \"kubernetes.io/projected/9f4bc5d5-860a-4468-b80f-9123698c878a-kube-api-access-sn2zv\") pod \"9f4bc5d5-860a-4468-b80f-9123698c878a\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.550714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-nova-metadata-tls-certs\") pod \"9f4bc5d5-860a-4468-b80f-9123698c878a\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.550952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-config-data\") pod \"9f4bc5d5-860a-4468-b80f-9123698c878a\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.551068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f4bc5d5-860a-4468-b80f-9123698c878a-logs\") pod \"9f4bc5d5-860a-4468-b80f-9123698c878a\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.551145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-combined-ca-bundle\") pod \"9f4bc5d5-860a-4468-b80f-9123698c878a\" (UID: \"9f4bc5d5-860a-4468-b80f-9123698c878a\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.552513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f4bc5d5-860a-4468-b80f-9123698c878a-logs" (OuterVolumeSpecName: "logs") pod "9f4bc5d5-860a-4468-b80f-9123698c878a" (UID: "9f4bc5d5-860a-4468-b80f-9123698c878a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.563478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4bc5d5-860a-4468-b80f-9123698c878a-kube-api-access-sn2zv" (OuterVolumeSpecName: "kube-api-access-sn2zv") pod "9f4bc5d5-860a-4468-b80f-9123698c878a" (UID: "9f4bc5d5-860a-4468-b80f-9123698c878a"). InnerVolumeSpecName "kube-api-access-sn2zv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.584601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-config-data" (OuterVolumeSpecName: "config-data") pod "9f4bc5d5-860a-4468-b80f-9123698c878a" (UID: "9f4bc5d5-860a-4468-b80f-9123698c878a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.590812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f4bc5d5-860a-4468-b80f-9123698c878a" (UID: "9f4bc5d5-860a-4468-b80f-9123698c878a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.632157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "9f4bc5d5-860a-4468-b80f-9123698c878a" (UID: "9f4bc5d5-860a-4468-b80f-9123698c878a"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.653650 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sn2zv\" (UniqueName: \"kubernetes.io/projected/9f4bc5d5-860a-4468-b80f-9123698c878a-kube-api-access-sn2zv\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.653680 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.653690 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.653700 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f4bc5d5-860a-4468-b80f-9123698c878a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.653709 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f4bc5d5-860a-4468-b80f-9123698c878a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.680393 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.703877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.706667 4769 scope.go:117] "RemoveContainer" containerID="c544c917dd6e2d302bedf189bf2e810df12ac84a603b727fb7df892acd3f80ed" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.708455 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.747373 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.754552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vdn9\" (UniqueName: \"kubernetes.io/projected/80493384-e023-40a6-bac4-16a270ce4876-kube-api-access-2vdn9\") pod \"80493384-e023-40a6-bac4-16a270ce4876\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.754886 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-combined-ca-bundle\") pod \"80493384-e023-40a6-bac4-16a270ce4876\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.755124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-config-data\") pod \"80493384-e023-40a6-bac4-16a270ce4876\" (UID: \"80493384-e023-40a6-bac4-16a270ce4876\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.776544 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: E1121 13:01:18.777301 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-log" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.777324 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-log" Nov 21 13:01:18 crc kubenswrapper[4769]: E1121 13:01:18.777338 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="80493384-e023-40a6-bac4-16a270ce4876" containerName="nova-cell1-conductor-conductor" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.777346 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="80493384-e023-40a6-bac4-16a270ce4876" containerName="nova-cell1-conductor-conductor" Nov 21 13:01:18 crc kubenswrapper[4769]: E1121 13:01:18.777391 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-metadata" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.777398 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-metadata" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.778492 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-log" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.778520 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" containerName="nova-metadata-metadata" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.778551 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="80493384-e023-40a6-bac4-16a270ce4876" containerName="nova-cell1-conductor-conductor" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.790023 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.790966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80493384-e023-40a6-bac4-16a270ce4876-kube-api-access-2vdn9" (OuterVolumeSpecName: "kube-api-access-2vdn9") pod "80493384-e023-40a6-bac4-16a270ce4876" (UID: "80493384-e023-40a6-bac4-16a270ce4876"). InnerVolumeSpecName "kube-api-access-2vdn9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.794029 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.794330 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.794633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.818750 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.819516 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.835571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.837764 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.848606 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.856531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data\") pod \"f92f9178-636b-41c7-9468-54183e16a0a0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.856602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-combined-ca-bundle\") pod \"f92f9178-636b-41c7-9468-54183e16a0a0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.856725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d2w2\" (UniqueName: \"kubernetes.io/projected/f92f9178-636b-41c7-9468-54183e16a0a0-kube-api-access-5d2w2\") pod \"f92f9178-636b-41c7-9468-54183e16a0a0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.857124 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-config-data\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.857180 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.857208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkhvb\" (UniqueName: \"kubernetes.io/projected/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-kube-api-access-tkhvb\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.859249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-public-tls-certs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.859479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.859545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-logs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.859611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.859708 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2vdn9\" (UniqueName: \"kubernetes.io/projected/80493384-e023-40a6-bac4-16a270ce4876-kube-api-access-2vdn9\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.883383 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.891488 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.896623 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.922214 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92f9178-636b-41c7-9468-54183e16a0a0-kube-api-access-5d2w2" (OuterVolumeSpecName: "kube-api-access-5d2w2") pod "f92f9178-636b-41c7-9468-54183e16a0a0" (UID: "f92f9178-636b-41c7-9468-54183e16a0a0"). InnerVolumeSpecName "kube-api-access-5d2w2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.941982 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.954308 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: E1121 13:01:18.954945 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f92f9178-636b-41c7-9468-54183e16a0a0" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.954963 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92f9178-636b-41c7-9468-54183e16a0a0" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.955176 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f92f9178-636b-41c7-9468-54183e16a0a0" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.956456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.960607 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.960968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-p27px" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.961738 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.961954 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.962855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.963049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-config-data\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.963132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tkhvb\" (UniqueName: \"kubernetes.io/projected/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-kube-api-access-tkhvb\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.969490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-public-tls-certs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.969683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.969804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-logs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.970010 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5d2w2\" (UniqueName: \"kubernetes.io/projected/f92f9178-636b-41c7-9468-54183e16a0a0-kube-api-access-5d2w2\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.971605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-logs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.979868 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.980575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-config-data\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.983320 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.985568 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.987997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-internal-tls-certs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:18 crc kubenswrapper[4769]: I1121 13:01:18.998710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.000584 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkhvb\" (UniqueName: \"kubernetes.io/projected/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-kube-api-access-tkhvb\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.005780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-public-tls-certs\") pod \"nova-api-0\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.008130 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.045504 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074144 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcb6\" (UniqueName: \"kubernetes.io/projected/124eddb7-85ff-499a-a117-f9efd7b4c8fa-kube-api-access-mfcb6\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-config-data\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr84s\" (UniqueName: \"kubernetes.io/projected/1b17ed17-ae28-4189-84ea-977b0803d0ad-kube-api-access-wr84s\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-config-data\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.074987 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.075036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-logs\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.075068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-scripts\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.075101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.110912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f92f9178-636b-41c7-9468-54183e16a0a0","Type":"ContainerDied","Data":"947cda57518b1ae45ef3246b43ba6555bbd92d2c3c56efe07b1b1382c74e9fe4"} Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.110966 4769 scope.go:117] "RemoveContainer" containerID="d948780d968431f71ea686c027817ed7a2fee1e7d450aa61423b2e8dad598e54" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.111082 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.117574 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.135249 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.186639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.187370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"80493384-e023-40a6-bac4-16a270ce4876","Type":"ContainerDied","Data":"749ae4f86dde11c711d58979426d945c908dfeb24a029b10dec7b5e9e3050266"} Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wr84s\" (UniqueName: \"kubernetes.io/projected/1b17ed17-ae28-4189-84ea-977b0803d0ad-kube-api-access-wr84s\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-config-data\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-logs\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-scripts\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcb6\" (UniqueName: \"kubernetes.io/projected/124eddb7-85ff-499a-a117-f9efd7b4c8fa-kube-api-access-mfcb6\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-config-data\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.191803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-logs\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.192086 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.193214 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.199907 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api-log" containerID="cri-o://f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329" gracePeriod=30 Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.202169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.204622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-log" containerID="cri-o://d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4" gracePeriod=30 Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.205371 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api" containerID="cri-o://663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660" gracePeriod=30 Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.205619 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-api" containerID="cri-o://cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7" gracePeriod=30 Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.211865 4769 scope.go:117] "RemoveContainer" containerID="39d7818110107c3e3964adffe522611e9adf3d41afb542ac932eecb753827f5b" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.212560 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.229058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-config-data\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.243439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.247125 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.255121 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.265253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcb6\" (UniqueName: \"kubernetes.io/projected/124eddb7-85ff-499a-a117-f9efd7b4c8fa-kube-api-access-mfcb6\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.270521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.273364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-config-data" (OuterVolumeSpecName: "config-data") pod "80493384-e023-40a6-bac4-16a270ce4876" (UID: "80493384-e023-40a6-bac4-16a270ce4876"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.273448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-config-data\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.280871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr84s\" (UniqueName: \"kubernetes.io/projected/1b17ed17-ae28-4189-84ea-977b0803d0ad-kube-api-access-wr84s\") pod \"nova-scheduler-0\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.283058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-scripts\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.304168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.305046 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dffcaa1-afe1-43af-8ccb-1237aa971d6c" path="/var/lib/kubelet/pods/5dffcaa1-afe1-43af-8ccb-1237aa971d6c/volumes" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.306046 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ff2c8a-0d89-42ea-bf5a-8928949f45f5" path="/var/lib/kubelet/pods/93ff2c8a-0d89-42ea-bf5a-8928949f45f5/volumes" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.307287 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a784a6a4-b4b4-4133-b747-46431dce82a5" path="/var/lib/kubelet/pods/a784a6a4-b4b4-4133-b747-46431dce82a5/volumes" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.309597 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19a9c0b-0847-4a51-a267-5ad85f4fa9f6" path="/var/lib/kubelet/pods/b19a9c0b-0847-4a51-a267-5ad85f4fa9f6/volumes" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.312484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data" (OuterVolumeSpecName: "config-data") pod "f92f9178-636b-41c7-9468-54183e16a0a0" (UID: "f92f9178-636b-41c7-9468-54183e16a0a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.312872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.351168 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a91e92-f4a2-4279-aa88-caf6df42d841" path="/var/lib/kubelet/pods/d1a91e92-f4a2-4279-aa88-caf6df42d841/volumes" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.367146 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "80493384-e023-40a6-bac4-16a270ce4876" (UID: "80493384-e023-40a6-bac4-16a270ce4876"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.373611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data\") pod \"f92f9178-636b-41c7-9468-54183e16a0a0\" (UID: \"f92f9178-636b-41c7-9468-54183e16a0a0\") " Nov 21 13:01:19 crc kubenswrapper[4769]: W1121 13:01:19.375046 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/f92f9178-636b-41c7-9468-54183e16a0a0/volumes/kubernetes.io~secret/config-data Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.375082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data" (OuterVolumeSpecName: "config-data") pod "f92f9178-636b-41c7-9468-54183e16a0a0" (UID: "f92f9178-636b-41c7-9468-54183e16a0a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.377453 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.382805 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.382842 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.382862 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80493384-e023-40a6-bac4-16a270ce4876-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.402425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f92f9178-636b-41c7-9468-54183e16a0a0" (UID: "f92f9178-636b-41c7-9468-54183e16a0a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.509717 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f92f9178-636b-41c7-9468-54183e16a0a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.589886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: E1121 13:01:19.646671 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60ce8c85_ca65_4f19_9c4a_f81f515f5ae0.slice/crio-cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod032f278a_33da_49e9_a3e1_54d565bff7ca.slice/crio-663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60ce8c85_ca65_4f19_9c4a_f81f515f5ae0.slice/crio-conmon-cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60ce8c85_ca65_4f19_9c4a_f81f515f5ae0.slice/crio-d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.739839 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.742010 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.742033 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.742044 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.742612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.743380 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.743403 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.743414 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.744455 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.744479 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.744491 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.744499 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-84c64569fd-l8k8s"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.744550 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.744623 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.746409 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.749749 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.749804 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.749988 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.750011 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-pp5k7" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.750147 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.750332 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.750429 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.750788 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.752795 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:01:19 crc kubenswrapper[4769]: W1121 13:01:19.771592 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9db4c881_e68a_4263_ba89_475028eef465.slice/crio-b9b569e255df3d2aab001535b10c2765bf74c1e79abd69ad04b8c3e38ce44a21 WatchSource:0}: Error finding container b9b569e255df3d2aab001535b10c2765bf74c1e79abd69ad04b8c3e38ce44a21: Status 404 returned error can't find the container with id b9b569e255df3d2aab001535b10c2765bf74c1e79abd69ad04b8c3e38ce44a21 Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-scripts\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821241 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-config-data\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821266 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rh2\" (UniqueName: \"kubernetes.io/projected/16ae2cef-55b9-48d2-b780-88b76f881353-kube-api-access-29rh2\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821281 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-scripts\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data-custom\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821328 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-public-tls-certs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821363 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbp7\" (UniqueName: \"kubernetes.io/projected/e0ae5f4d-ce46-4306-84d7-b800ea504b34-kube-api-access-2tbp7\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-scripts\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821418 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9344ddbe-d473-4b29-bbad-d660062ce129-etc-machine-id\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821509 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/9344ddbe-d473-4b29-bbad-d660062ce129-kube-api-access-b7wq6\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9344ddbe-d473-4b29-bbad-d660062ce129-logs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-run-httpd\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-log-httpd\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e0ae5f4d-ce46-4306-84d7-b800ea504b34-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.821668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: W1121 13:01:19.894738 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a0a5091_1ddf_441c_99e8_e21346e9ee66.slice/crio-3a89f8bb433f5a7e6b3dca0a8fb3fe2db1c4f01b1d0f3e6799507b418b43c8a1 WatchSource:0}: Error finding container 3a89f8bb433f5a7e6b3dca0a8fb3fe2db1c4f01b1d0f3e6799507b418b43c8a1: Status 404 returned error can't find the container with id 3a89f8bb433f5a7e6b3dca0a8fb3fe2db1c4f01b1d0f3e6799507b418b43c8a1 Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.920563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.923773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.929174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.931572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.931671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/9344ddbe-d473-4b29-bbad-d660062ce129-kube-api-access-b7wq6\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.931760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9344ddbe-d473-4b29-bbad-d660062ce129-logs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.929082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.932104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9344ddbe-d473-4b29-bbad-d660062ce129-logs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.932537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-run-httpd\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.933064 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-log-httpd\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.933015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-run-httpd\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.933381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-log-httpd\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.933784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e0ae5f4d-ce46-4306-84d7-b800ea504b34-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-scripts\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-config-data\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-29rh2\" (UniqueName: \"kubernetes.io/projected/16ae2cef-55b9-48d2-b780-88b76f881353-kube-api-access-29rh2\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-scripts\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.936989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data-custom\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-public-tls-certs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2tbp7\" (UniqueName: \"kubernetes.io/projected/e0ae5f4d-ce46-4306-84d7-b800ea504b34-kube-api-access-2tbp7\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-scripts\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9344ddbe-d473-4b29-bbad-d660062ce129-etc-machine-id\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.937867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.935776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e0ae5f4d-ce46-4306-84d7-b800ea504b34-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.934523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.939765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9344ddbe-d473-4b29-bbad-d660062ce129-etc-machine-id\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.944317 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-public-tls-certs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.944829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.944992 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.945219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.948829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-scripts\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.949279 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data-custom\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.951910 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.952844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/9344ddbe-d473-4b29-bbad-d660062ce129-kube-api-access-b7wq6\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.953595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.954931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-scripts\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.955172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.955494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-scripts\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.956547 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.956924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-config-data\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.959554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rh2\" (UniqueName: \"kubernetes.io/projected/16ae2cef-55b9-48d2-b780-88b76f881353-kube-api-access-29rh2\") pod \"ceilometer-0\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.960290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tbp7\" (UniqueName: \"kubernetes.io/projected/e0ae5f4d-ce46-4306-84d7-b800ea504b34-kube-api-access-2tbp7\") pod \"cinder-scheduler-0\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.969794 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.971960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.976406 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.979511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:19 crc kubenswrapper[4769]: I1121 13:01:19.998148 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.006075 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx"] Nov 21 13:01:20 crc kubenswrapper[4769]: W1121 13:01:20.042369 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod438a784a_03b1_4561_87c2_f01538a59ab0.slice/crio-4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573 WatchSource:0}: Error finding container 4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573: Status 404 returned error can't find the container with id 4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.080518 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.119572 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.120921 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.142374 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcbq7\" (UniqueName: \"kubernetes.io/projected/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-kube-api-access-qcbq7\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.142439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.142590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.146520 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.149340 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.217426 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" containerID="76d915e2f64b0cb5ec71fd460d043289e8d84dd4e39ed70d34d181efaf2a02ec" exitCode=0 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.217517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd","Type":"ContainerDied","Data":"76d915e2f64b0cb5ec71fd460d043289e8d84dd4e39ed70d34d181efaf2a02ec"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.218899 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.220042 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" event={"ID":"6af1865c-3e9f-4329-bc4b-94679b29dfee","Type":"ContainerStarted","Data":"d5515ad48f659a1a60cc9fe13f680ac6237bf842dfb98ff9d702f3ca53023710"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.227397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f","Type":"ContainerStarted","Data":"f341fcaca6459d670a2242a65ed25922301cd163b2716e0d80044de3edcb5021"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.230439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" event={"ID":"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5","Type":"ContainerStarted","Data":"55704538d6e41cd3ac6e0523ca1211e8012d509ffe8dedda60af0ec667b35d23"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.241812 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.243976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-config-data\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.244046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-public-tls-certs\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.244069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-internal-tls-certs\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.244132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v27c8\" (UniqueName: \"kubernetes.io/projected/032f278a-33da-49e9-a3e1-54d565bff7ca-kube-api-access-v27c8\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data-custom\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-public-tls-certs\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-combined-ca-bundle\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-scripts\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245830 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-internal-tls-certs\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6rn5\" (UniqueName: \"kubernetes.io/projected/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-kube-api-access-b6rn5\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-combined-ca-bundle\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/032f278a-33da-49e9-a3e1-54d565bff7ca-logs\") pod \"032f278a-33da-49e9-a3e1-54d565bff7ca\" (UID: \"032f278a-33da-49e9-a3e1-54d565bff7ca\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.245971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-logs\") pod \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\" (UID: \"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.246309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.246387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qcbq7\" (UniqueName: \"kubernetes.io/projected/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-kube-api-access-qcbq7\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.246438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.247156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032f278a-33da-49e9-a3e1-54d565bff7ca-logs" (OuterVolumeSpecName: "logs") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.247405 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/032f278a-33da-49e9-a3e1-54d565bff7ca-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.247579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-logs" (OuterVolumeSpecName: "logs") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.253249 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.264997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.266143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2626dcd1-c6c3-4be2-b971-1e34ddab332f","Type":"ContainerStarted","Data":"9ba56948b0116a1dd20c6b4fc9325e357153ca76ebc8a4724a14930537551dcd"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.266456 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.267256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-kube-api-access-b6rn5" (OuterVolumeSpecName: "kube-api-access-b6rn5") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "kube-api-access-b6rn5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.269662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-scripts" (OuterVolumeSpecName: "scripts") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.288311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3a0a5091-1ddf-441c-99e8-e21346e9ee66","Type":"ContainerStarted","Data":"3a89f8bb433f5a7e6b3dca0a8fb3fe2db1c4f01b1d0f3e6799507b418b43c8a1"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.288577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.289799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcbq7\" (UniqueName: \"kubernetes.io/projected/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-kube-api-access-qcbq7\") pod \"nova-cell0-conductor-0\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.290812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" event={"ID":"9db4c881-e68a-4263-ba89-475028eef465","Type":"ContainerStarted","Data":"b9b569e255df3d2aab001535b10c2765bf74c1e79abd69ad04b8c3e38ce44a21"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.298838 4769 generic.go:334] "Generic (PLEG): container finished" podID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerID="cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7" exitCode=0 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.298956 4769 generic.go:334] "Generic (PLEG): container finished" podID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerID="d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4" exitCode=143 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.299031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" event={"ID":"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0","Type":"ContainerDied","Data":"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.299067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" event={"ID":"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0","Type":"ContainerDied","Data":"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.299078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" event={"ID":"60ce8c85-ca65-4f19-9c4a-f81f515f5ae0","Type":"ContainerDied","Data":"049446bda5a733e070fc27757ba963bf2e38e109da80dee2b5aa73e0b6146264"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.299098 4769 scope.go:117] "RemoveContainer" containerID="cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.299383 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7584c7766-9n2mj" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.304704 4769 generic.go:334] "Generic (PLEG): container finished" podID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerID="663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660" exitCode=0 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.304737 4769 generic.go:334] "Generic (PLEG): container finished" podID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerID="f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329" exitCode=143 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.304812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" event={"ID":"032f278a-33da-49e9-a3e1-54d565bff7ca","Type":"ContainerDied","Data":"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.304838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" event={"ID":"032f278a-33da-49e9-a3e1-54d565bff7ca","Type":"ContainerDied","Data":"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.304848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" event={"ID":"032f278a-33da-49e9-a3e1-54d565bff7ca","Type":"ContainerDied","Data":"acd47200da700f8d6342bee4b93c3e85e35ba83f8257a1750aa6d6abbc2c3d23"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.304925 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.308342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" event={"ID":"438a784a-03b1-4561-87c2-f01538a59ab0","Type":"ContainerStarted","Data":"4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.319216 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=5.319181137 podStartE2EDuration="5.319181137s" podCreationTimestamp="2025-11-21 13:01:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:20.254558147 +0000 UTC m=+4238.955219965" watchObservedRunningTime="2025-11-21 13:01:20.319181137 +0000 UTC m=+4239.019842955" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.322933 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032f278a-33da-49e9-a3e1-54d565bff7ca-kube-api-access-v27c8" (OuterVolumeSpecName: "kube-api-access-v27c8") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "kube-api-access-v27c8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.324436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4f636b17-3f16-433a-b5a1-7ec47c877774","Type":"ContainerStarted","Data":"3706207bc4f56be71c0236303069ea66a0c9cd39c384d2d045bc11fa03ea3010"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.324567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4f636b17-3f16-433a-b5a1-7ec47c877774","Type":"ContainerStarted","Data":"c277579ec893fc4292c243ac98434e9bb42389c14690eb4a8d13bfa7587253f0"} Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.325266 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="openstack-network-exporter" containerID="cri-o://c277579ec893fc4292c243ac98434e9bb42389c14690eb4a8d13bfa7587253f0" gracePeriod=300 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.340990 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=6.340971124 podStartE2EDuration="6.340971124s" podCreationTimestamp="2025-11-21 13:01:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:20.289302203 +0000 UTC m=+4238.989964021" watchObservedRunningTime="2025-11-21 13:01:20.340971124 +0000 UTC m=+4239.041632932" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.350649 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.352447 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.355224 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.360182 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.360266 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="ovn-northd" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.369330 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v27c8\" (UniqueName: \"kubernetes.io/projected/032f278a-33da-49e9-a3e1-54d565bff7ca-kube-api-access-v27c8\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.373037 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.374829 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.374852 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.374866 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b6rn5\" (UniqueName: \"kubernetes.io/projected/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-kube-api-access-b6rn5\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.391181 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=7.391160296 podStartE2EDuration="7.391160296s" podCreationTimestamp="2025-11-21 13:01:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:20.354135689 +0000 UTC m=+4239.054797507" watchObservedRunningTime="2025-11-21 13:01:20.391160296 +0000 UTC m=+4239.091822114" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.410721 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.445455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.460400 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.473400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: W1121 13:01:20.475014 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod124eddb7_85ff_499a_a117_f9efd7b4c8fa.slice/crio-75f923ec8507d048d28ecf8f1adfe013af1299e2fa18bc3ea151a1c984c9ebb1 WatchSource:0}: Error finding container 75f923ec8507d048d28ecf8f1adfe013af1299e2fa18bc3ea151a1c984c9ebb1: Status 404 returned error can't find the container with id 75f923ec8507d048d28ecf8f1adfe013af1299e2fa18bc3ea151a1c984c9ebb1 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.476522 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.476546 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.476555 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.493699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.507710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-config-data" (OuterVolumeSpecName: "config-data") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.520412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data" (OuterVolumeSpecName: "config-data") pod "032f278a-33da-49e9-a3e1-54d565bff7ca" (UID: "032f278a-33da-49e9-a3e1-54d565bff7ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.530516 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.157:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.535454 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="ovsdbserver-nb" containerID="cri-o://3706207bc4f56be71c0236303069ea66a0c9cd39c384d2d045bc11fa03ea3010" gracePeriod=300 Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.546500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.578488 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.578652 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.578732 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/032f278a-33da-49e9-a3e1-54d565bff7ca-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.578789 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.601227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" (UID: "60ce8c85-ca65-4f19-9c4a-f81f515f5ae0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.687946 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.731341 4769 scope.go:117] "RemoveContainer" containerID="d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.801331 4769 scope.go:117] "RemoveContainer" containerID="cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7" Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.801799 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7\": container with ID starting with cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7 not found: ID does not exist" containerID="cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.801871 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7"} err="failed to get container status \"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7\": rpc error: code = NotFound desc = could not find container \"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7\": container with ID starting with cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.801897 4769 scope.go:117] "RemoveContainer" containerID="d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4" Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.802227 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4\": container with ID starting with d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4 not found: ID does not exist" containerID="d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.802248 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4"} err="failed to get container status \"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4\": rpc error: code = NotFound desc = could not find container \"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4\": container with ID starting with d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.802261 4769 scope.go:117] "RemoveContainer" containerID="cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.802496 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7"} err="failed to get container status \"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7\": rpc error: code = NotFound desc = could not find container \"cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7\": container with ID starting with cc38de908d44b29b3c1c744ee275657c927db50baeae41f204660b1966a282c7 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.802509 4769 scope.go:117] "RemoveContainer" containerID="d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.803061 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4"} err="failed to get container status \"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4\": rpc error: code = NotFound desc = could not find container \"d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4\": container with ID starting with d8caff5fd480eca3e6d30c7f66249bee3de941cedc46fda3ce6727b15c7cb3f4 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.803080 4769 scope.go:117] "RemoveContainer" containerID="663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.803997 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.837948 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.862589 4769 scope.go:117] "RemoveContainer" containerID="f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.894095 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.894969 4769 scope.go:117] "RemoveContainer" containerID="663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660" Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.908913 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660\": container with ID starting with 663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660 not found: ID does not exist" containerID="663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.908962 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660"} err="failed to get container status \"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660\": rpc error: code = NotFound desc = could not find container \"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660\": container with ID starting with 663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.908986 4769 scope.go:117] "RemoveContainer" containerID="f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329" Nov 21 13:01:20 crc kubenswrapper[4769]: E1121 13:01:20.909319 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329\": container with ID starting with f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329 not found: ID does not exist" containerID="f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.909343 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329"} err="failed to get container status \"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329\": rpc error: code = NotFound desc = could not find container \"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329\": container with ID starting with f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.909355 4769 scope.go:117] "RemoveContainer" containerID="663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.910301 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660"} err="failed to get container status \"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660\": rpc error: code = NotFound desc = could not find container \"663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660\": container with ID starting with 663be79a975e83d25a83490db3cf2ac09c6058849746ac27bac9639b31da4660 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.910344 4769 scope.go:117] "RemoveContainer" containerID="f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.910541 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329"} err="failed to get container status \"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329\": rpc error: code = NotFound desc = could not find container \"f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329\": container with ID starting with f0070b0e715fb0534ee6fe317229e75c2e7858253fe31f45cf73d9efce3b5329 not found: ID does not exist" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.928533 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-574c8df6f6-7vgsx"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.944393 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.972549 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7584c7766-9n2mj"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.977176 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7584c7766-9n2mj"] Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kolla-config\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzpmx\" (UniqueName: \"kubernetes.io/projected/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kube-api-access-rzpmx\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-galera-tls-certs\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-default\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-combined-ca-bundle\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994519 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-operator-scripts\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.994582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-generated\") pod \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\" (UID: \"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd\") " Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.995516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.995594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.995820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:20 crc kubenswrapper[4769]: I1121 13:01:20.996248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.031356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.040233 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kube-api-access-rzpmx" (OuterVolumeSpecName: "kube-api-access-rzpmx") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "kube-api-access-rzpmx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.044716 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "mysql-db") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.048426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" (UID: "e5735642-e5f1-4fe2-9d28-9b8ef8e321cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106563 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106598 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106609 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106617 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rzpmx\" (UniqueName: \"kubernetes.io/projected/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-kube-api-access-rzpmx\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106625 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106636 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106644 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.106673 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.273380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.335358 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" path="/var/lib/kubelet/pods/032f278a-33da-49e9-a3e1-54d565bff7ca/volumes" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.337410 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09da4a70-f95f-4080-b7d4-b3ce7ede34c1" path="/var/lib/kubelet/pods/09da4a70-f95f-4080-b7d4-b3ce7ede34c1/volumes" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.338307 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" path="/var/lib/kubelet/pods/60ce8c85-ca65-4f19-9c4a-f81f515f5ae0/volumes" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.339429 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92f9178-636b-41c7-9468-54183e16a0a0" path="/var/lib/kubelet/pods/f92f9178-636b-41c7-9468-54183e16a0a0/volumes" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.341371 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.371297 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.377935 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:01:21 crc kubenswrapper[4769]: E1121 13:01:21.390594 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api-log" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.390631 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api-log" Nov 21 13:01:21 crc kubenswrapper[4769]: E1121 13:01:21.390647 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-api" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.390654 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-api" Nov 21 13:01:21 crc kubenswrapper[4769]: E1121 13:01:21.390666 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.390672 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api" Nov 21 13:01:21 crc kubenswrapper[4769]: E1121 13:01:21.390689 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-log" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.390696 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-log" Nov 21 13:01:21 crc kubenswrapper[4769]: E1121 13:01:21.390717 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" containerName="mysql-bootstrap" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.390724 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" containerName="mysql-bootstrap" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.390994 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-log" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.391005 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60ce8c85-ca65-4f19-9c4a-f81f515f5ae0" containerName="placement-api" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.391020 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.391030 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" containerName="mysql-bootstrap" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.391040 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="032f278a-33da-49e9-a3e1-54d565bff7ca" containerName="barbican-api-log" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.392035 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.392067 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.392143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.403062 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.416548 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.420477 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.420584 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.426830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b17ed17-ae28-4189-84ea-977b0803d0ad","Type":"ContainerStarted","Data":"11b8bfb4006074affd4104c6b00cace28f222d993b1543a0f10df4332d7daea9"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.438317 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.492106 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.505313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" event={"ID":"438a784a-03b1-4561-87c2-f01538a59ab0","Type":"ContainerStarted","Data":"29e40571c70fc388e9bc006af0adb8d2eee8ac89c0c617ee3dc948670dd09df1"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.517756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.522802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4759ef3d-e00f-42ee-9964-82553f02b530-logs\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.522879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data-custom\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.522951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd176a47-2143-45c9-85a5-ab6a32848a86-logs\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.522999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nbkl\" (UniqueName: \"kubernetes.io/projected/bd176a47-2143-45c9-85a5-ab6a32848a86-kube-api-access-7nbkl\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.523018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.523044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbc9c\" (UniqueName: \"kubernetes.io/projected/4759ef3d-e00f-42ee-9964-82553f02b530-kube-api-access-xbc9c\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.523063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.523081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data-custom\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.523101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-combined-ca-bundle\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.523147 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-combined-ca-bundle\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.527463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" event={"ID":"9db4c881-e68a-4263-ba89-475028eef465","Type":"ContainerStarted","Data":"bdb249d34231152d8b7ad61f684b9efd0a9548cb75cec2f4c6c0c39a45f1b094"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.557240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.656940 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4f636b17-3f16-433a-b5a1-7ec47c877774/ovsdbserver-nb/0.log" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657043 4769 generic.go:334] "Generic (PLEG): container finished" podID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerID="c277579ec893fc4292c243ac98434e9bb42389c14690eb4a8d13bfa7587253f0" exitCode=2 Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657088 4769 generic.go:334] "Generic (PLEG): container finished" podID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerID="3706207bc4f56be71c0236303069ea66a0c9cd39c384d2d045bc11fa03ea3010" exitCode=143 Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4f636b17-3f16-433a-b5a1-7ec47c877774","Type":"ContainerDied","Data":"c277579ec893fc4292c243ac98434e9bb42389c14690eb4a8d13bfa7587253f0"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4f636b17-3f16-433a-b5a1-7ec47c877774","Type":"ContainerDied","Data":"3706207bc4f56be71c0236303069ea66a0c9cd39c384d2d045bc11fa03ea3010"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-combined-ca-bundle\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657339 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4759ef3d-e00f-42ee-9964-82553f02b530-logs\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data-custom\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd176a47-2143-45c9-85a5-ab6a32848a86-logs\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7nbkl\" (UniqueName: \"kubernetes.io/projected/bd176a47-2143-45c9-85a5-ab6a32848a86-kube-api-access-7nbkl\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657783 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xbc9c\" (UniqueName: \"kubernetes.io/projected/4759ef3d-e00f-42ee-9964-82553f02b530-kube-api-access-xbc9c\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data-custom\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-combined-ca-bundle\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.657304 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4f636b17-3f16-433a-b5a1-7ec47c877774","Type":"ContainerDied","Data":"c4073c03ac9a31547971d88933c4c4d1df784075c7c6426b3b456ea52754df7e"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.659597 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4073c03ac9a31547971d88933c4c4d1df784075c7c6426b3b456ea52754df7e" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.664081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data-custom\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.681739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd176a47-2143-45c9-85a5-ab6a32848a86-logs\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.710254 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-84c64569fd-l8k8s"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.710352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"124eddb7-85ff-499a-a117-f9efd7b4c8fa","Type":"ContainerStarted","Data":"75f923ec8507d048d28ecf8f1adfe013af1299e2fa18bc3ea151a1c984c9ebb1"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.721871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4759ef3d-e00f-42ee-9964-82553f02b530-logs\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.772039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.786221 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-combined-ca-bundle\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.786739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-combined-ca-bundle\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.877548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbc9c\" (UniqueName: \"kubernetes.io/projected/4759ef3d-e00f-42ee-9964-82553f02b530-kube-api-access-xbc9c\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.894829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data-custom\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.895161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data\") pod \"barbican-worker-bf8dddb95-6885s\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.895438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nbkl\" (UniqueName: \"kubernetes.io/projected/bd176a47-2143-45c9-85a5-ab6a32848a86-kube-api-access-7nbkl\") pod \"barbican-keystone-listener-6c47ddb6fd-kdb6s\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.951547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5","Type":"ContainerStarted","Data":"ff6a6598c93de0037338ad8b95c7942d14d21f4666f64e426355d30fe0b92839"} Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.989314 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.990086 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4f636b17-3f16-433a-b5a1-7ec47c877774/ovsdbserver-nb/0.log" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.990166 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:21 crc kubenswrapper[4769]: I1121 13:01:21.990825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerStarted","Data":"d4f812a4c6d83c0204103d8c178eb36b4745ad8e80cbdc3bfd869a6e46a556b1"} Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.045868 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.048044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3a0a5091-1ddf-441c-99e8-e21346e9ee66","Type":"ContainerStarted","Data":"12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884"} Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.048254 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="3a0a5091-1ddf-441c-99e8-e21346e9ee66" containerName="mysql-bootstrap" containerID="cri-o://12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884" gracePeriod=30 Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.058456 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v"] Nov 21 13:01:22 crc kubenswrapper[4769]: E1121 13:01:22.059518 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="openstack-network-exporter" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.059537 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="openstack-network-exporter" Nov 21 13:01:22 crc kubenswrapper[4769]: E1121 13:01:22.059549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="ovsdbserver-nb" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.059555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="ovsdbserver-nb" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.059751 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="openstack-network-exporter" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.059769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" containerName="ovsdbserver-nb" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.060884 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.114283 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7fdbb7969d-2vcpx"] Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.116116 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v"] Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.116229 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-scripts\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-config\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-metrics-certs-tls-certs\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnvj6\" (UniqueName: \"kubernetes.io/projected/4f636b17-3f16-433a-b5a1-7ec47c877774-kube-api-access-vnvj6\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdb-rundir\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-combined-ca-bundle\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.117837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdbserver-nb-tls-certs\") pod \"4f636b17-3f16-433a-b5a1-7ec47c877774\" (UID: \"4f636b17-3f16-433a-b5a1-7ec47c877774\") " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.123667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.124273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-scripts" (OuterVolumeSpecName: "scripts") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.125600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.126023 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-config" (OuterVolumeSpecName: "config") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.139303 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7fdbb7969d-2vcpx"] Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.175523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" event={"ID":"6af1865c-3e9f-4329-bc4b-94679b29dfee","Type":"ContainerStarted","Data":"16c21f5695a703b6ad19745e0a324df14249e8842eca08b316f77ece5e852478"} Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.175857 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener-log" containerID="cri-o://16c21f5695a703b6ad19745e0a324df14249e8842eca08b316f77ece5e852478" gracePeriod=30 Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.176046 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener" containerID="cri-o://7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3" gracePeriod=30 Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-internal-tls-certs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-combined-ca-bundle\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfkv\" (UniqueName: \"kubernetes.io/projected/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-kube-api-access-5hfkv\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data-custom\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-logs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-combined-ca-bundle\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-scripts\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2m5\" (UniqueName: \"kubernetes.io/projected/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-kube-api-access-9z2m5\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-config-data\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-internal-tls-certs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-public-tls-certs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-public-tls-certs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-logs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.220745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.232586 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.232626 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f636b17-3f16-433a-b5a1-7ec47c877774-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.232662 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.232677 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.232923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" event={"ID":"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5","Type":"ContainerStarted","Data":"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71"} Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.256149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f636b17-3f16-433a-b5a1-7ec47c877774-kube-api-access-vnvj6" (OuterVolumeSpecName: "kube-api-access-vnvj6") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "kube-api-access-vnvj6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.257524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"e5735642-e5f1-4fe2-9d28-9b8ef8e321cd","Type":"ContainerDied","Data":"19fb01126d5aedd51ab0ed4f20a178a792408ac2108a335db59e0094c2315bfe"} Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.257639 4769 scope.go:117] "RemoveContainer" containerID="76d915e2f64b0cb5ec71fd460d043289e8d84dd4e39ed70d34d181efaf2a02ec" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.258247 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.262230 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.271052 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" podStartSLOduration=5.271024565 podStartE2EDuration="5.271024565s" podCreationTimestamp="2025-11-21 13:01:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:22.255757974 +0000 UTC m=+4240.956419792" watchObservedRunningTime="2025-11-21 13:01:22.271024565 +0000 UTC m=+4240.971686383" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.336296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-scripts\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.336363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2m5\" (UniqueName: \"kubernetes.io/projected/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-kube-api-access-9z2m5\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.336391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-config-data\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.338842 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-internal-tls-certs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.338962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-public-tls-certs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.339042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-public-tls-certs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.339760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-logs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.339841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.339912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-internal-tls-certs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.339953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-combined-ca-bundle\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.339984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfkv\" (UniqueName: \"kubernetes.io/projected/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-kube-api-access-5hfkv\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.340010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data-custom\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.340093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-logs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.341694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-combined-ca-bundle\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.341801 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vnvj6\" (UniqueName: \"kubernetes.io/projected/4f636b17-3f16-433a-b5a1-7ec47c877774-kube-api-access-vnvj6\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.342896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-logs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.350314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-config-data\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.353700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-logs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.353787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-scripts\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.366399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-internal-tls-certs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.371604 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-internal-tls-certs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.375577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-public-tls-certs\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.376717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-combined-ca-bundle\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.385125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-combined-ca-bundle\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.385138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-public-tls-certs\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.385745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data-custom\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.387977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfkv\" (UniqueName: \"kubernetes.io/projected/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-kube-api-access-5hfkv\") pod \"placement-7fdbb7969d-2vcpx\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.388038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2m5\" (UniqueName: \"kubernetes.io/projected/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-kube-api-access-9z2m5\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.392058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data\") pod \"barbican-api-6c87cc565b-k6h5v\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.449815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.450963 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.532008 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.557247 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.802659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.830231 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "4f636b17-3f16-433a-b5a1-7ec47c877774" (UID: "4f636b17-3f16-433a-b5a1-7ec47c877774"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.870853 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.870883 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f636b17-3f16-433a-b5a1-7ec47c877774-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:22 crc kubenswrapper[4769]: I1121 13:01:22.905337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s"] Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.003471 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.329113 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.329455 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.439791 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.440756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.440974 4769 generic.go:334] "Generic (PLEG): container finished" podID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerID="16c21f5695a703b6ad19745e0a324df14249e8842eca08b316f77ece5e852478" exitCode=143 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.441130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" event={"ID":"6af1865c-3e9f-4329-bc4b-94679b29dfee","Type":"ContainerDied","Data":"16c21f5695a703b6ad19745e0a324df14249e8842eca08b316f77ece5e852478"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.441238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" event={"ID":"6af1865c-3e9f-4329-bc4b-94679b29dfee","Type":"ContainerStarted","Data":"7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.493934 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.504065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" event={"ID":"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5","Type":"ContainerStarted","Data":"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.504213 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api-log" containerID="cri-o://90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71" gracePeriod=30 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.504441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.504461 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.504489 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api" containerID="cri-o://fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e" gracePeriod=30 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.508039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-generated\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.508079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data-custom\") pod \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.508103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-combined-ca-bundle\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.508132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data\") pod \"f9a99993-e243-4bcc-8b63-08db8159c08e\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.508156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ba8264d-24bb-4930-9aec-8e5ffd496a02-logs\") pod \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.508175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data\") pod \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.509889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a99993-e243-4bcc-8b63-08db8159c08e-logs\") pod \"f9a99993-e243-4bcc-8b63-08db8159c08e\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.509923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.509940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-combined-ca-bundle\") pod \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.509966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-combined-ca-bundle\") pod \"f9a99993-e243-4bcc-8b63-08db8159c08e\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.509997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-default\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data-custom\") pod \"f9a99993-e243-4bcc-8b63-08db8159c08e\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-operator-scripts\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mzkw\" (UniqueName: \"kubernetes.io/projected/f9a99993-e243-4bcc-8b63-08db8159c08e-kube-api-access-4mzkw\") pod \"f9a99993-e243-4bcc-8b63-08db8159c08e\" (UID: \"f9a99993-e243-4bcc-8b63-08db8159c08e\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22vkh\" (UniqueName: \"kubernetes.io/projected/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kube-api-access-22vkh\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9lm2\" (UniqueName: \"kubernetes.io/projected/9ba8264d-24bb-4930-9aec-8e5ffd496a02-kube-api-access-j9lm2\") pod \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\" (UID: \"9ba8264d-24bb-4930-9aec-8e5ffd496a02\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kolla-config\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.510204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-galera-tls-certs\") pod \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\" (UID: \"3a0a5091-1ddf-441c-99e8-e21346e9ee66\") " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.515979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.517720 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.519348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.519577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a99993-e243-4bcc-8b63-08db8159c08e-logs" (OuterVolumeSpecName: "logs") pod "f9a99993-e243-4bcc-8b63-08db8159c08e" (UID: "f9a99993-e243-4bcc-8b63-08db8159c08e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.520547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba8264d-24bb-4930-9aec-8e5ffd496a02-logs" (OuterVolumeSpecName: "logs") pod "9ba8264d-24bb-4930-9aec-8e5ffd496a02" (UID: "9ba8264d-24bb-4930-9aec-8e5ffd496a02"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.520808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9344ddbe-d473-4b29-bbad-d660062ce129","Type":"ContainerStarted","Data":"6f8db81a21ad22a6b8f6c6c487a20948ccbdd15866716d32dc304341e8628cfb"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.520877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.553726 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9ba8264d-24bb-4930-9aec-8e5ffd496a02" (UID: "9ba8264d-24bb-4930-9aec-8e5ffd496a02"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.562571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"124eddb7-85ff-499a-a117-f9efd7b4c8fa","Type":"ContainerStarted","Data":"f9091ab6402e1d92bcf8d022635ec6854fa2357218e1be4d6f4af236808f1d92"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.573428 4769 generic.go:334] "Generic (PLEG): container finished" podID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerID="22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0" exitCode=0 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.573504 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" event={"ID":"9ba8264d-24bb-4930-9aec-8e5ffd496a02","Type":"ContainerDied","Data":"22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.573534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" event={"ID":"9ba8264d-24bb-4930-9aec-8e5ffd496a02","Type":"ContainerDied","Data":"873d3b194a2742bf00c9bb49011606366dd601d68661c0b220f753d93a22261e"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.573551 4769 scope.go:117] "RemoveContainer" containerID="22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.573696 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.599028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f9a99993-e243-4bcc-8b63-08db8159c08e" (UID: "f9a99993-e243-4bcc-8b63-08db8159c08e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.600127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kube-api-access-22vkh" (OuterVolumeSpecName: "kube-api-access-22vkh") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "kube-api-access-22vkh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.601092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.604050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a99993-e243-4bcc-8b63-08db8159c08e-kube-api-access-4mzkw" (OuterVolumeSpecName: "kube-api-access-4mzkw") pod "f9a99993-e243-4bcc-8b63-08db8159c08e" (UID: "f9a99993-e243-4bcc-8b63-08db8159c08e"). InnerVolumeSpecName "kube-api-access-4mzkw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611346 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-22vkh\" (UniqueName: \"kubernetes.io/projected/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kube-api-access-22vkh\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611375 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611386 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611395 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611406 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611415 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9ba8264d-24bb-4930-9aec-8e5ffd496a02-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611426 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9a99993-e243-4bcc-8b63-08db8159c08e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611434 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611442 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a0a5091-1ddf-441c-99e8-e21346e9ee66-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611450 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.611459 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4mzkw\" (UniqueName: \"kubernetes.io/projected/f9a99993-e243-4bcc-8b63-08db8159c08e-kube-api-access-4mzkw\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.614669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5","Type":"ContainerStarted","Data":"8a776922f421501eed8f23f3054dcb68e8702bc13cd949ed25eef524ae3db811"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.624389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba8264d-24bb-4930-9aec-8e5ffd496a02-kube-api-access-j9lm2" (OuterVolumeSpecName: "kube-api-access-j9lm2") pod "9ba8264d-24bb-4930-9aec-8e5ffd496a02" (UID: "9ba8264d-24bb-4930-9aec-8e5ffd496a02"). InnerVolumeSpecName "kube-api-access-j9lm2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.624454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.647136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3a0a5091-1ddf-441c-99e8-e21346e9ee66" (UID: "3a0a5091-1ddf-441c-99e8-e21346e9ee66"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.660503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9ba8264d-24bb-4930-9aec-8e5ffd496a02" (UID: "9ba8264d-24bb-4930-9aec-8e5ffd496a02"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.672031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" event={"ID":"4759ef3d-e00f-42ee-9964-82553f02b530","Type":"ContainerStarted","Data":"af439801b2493befa74f374bcfae45541fd93b02c79703b135f4f32365c45c3f"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.708816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c1258bfb-c652-4c29-b9c1-0e4e205aa94c","Type":"ContainerStarted","Data":"8c59ea5550d4e9a57e4be3d9e664b043d6017fc306a5410f9daf71a474abc896"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.713302 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j9lm2\" (UniqueName: \"kubernetes.io/projected/9ba8264d-24bb-4930-9aec-8e5ffd496a02-kube-api-access-j9lm2\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.713330 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0a5091-1ddf-441c-99e8-e21346e9ee66-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.713352 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.713362 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.717687 4769 generic.go:334] "Generic (PLEG): container finished" podID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerID="6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554" exitCode=0 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.717789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" event={"ID":"f9a99993-e243-4bcc-8b63-08db8159c08e","Type":"ContainerDied","Data":"6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.717821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" event={"ID":"f9a99993-e243-4bcc-8b63-08db8159c08e","Type":"ContainerDied","Data":"ddfc3bcadea69926d8cf09532e60669670aae259c806242b33d123a646aff58f"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.717898 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.774341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e0ae5f4d-ce46-4306-84d7-b800ea504b34","Type":"ContainerStarted","Data":"af0fd61a51da8b4b24d7f54cab037b32aae5bb7022bb57ea2806104b8b3f0535"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.825781 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a0a5091-1ddf-441c-99e8-e21346e9ee66" containerID="12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884" exitCode=0 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.825929 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.826333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3a0a5091-1ddf-441c-99e8-e21346e9ee66","Type":"ContainerDied","Data":"12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.826371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"3a0a5091-1ddf-441c-99e8-e21346e9ee66","Type":"ContainerDied","Data":"3a89f8bb433f5a7e6b3dca0a8fb3fe2db1c4f01b1d0f3e6799507b418b43c8a1"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.838552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s"] Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.848575 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" podStartSLOduration=6.8485488310000004 podStartE2EDuration="6.848548831s" podCreationTimestamp="2025-11-21 13:01:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:23.755026942 +0000 UTC m=+4242.455688760" watchObservedRunningTime="2025-11-21 13:01:23.848548831 +0000 UTC m=+4242.549210639" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.881424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f9a99993-e243-4bcc-8b63-08db8159c08e" (UID: "f9a99993-e243-4bcc-8b63-08db8159c08e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.890700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" event={"ID":"438a784a-03b1-4561-87c2-f01538a59ab0","Type":"ContainerStarted","Data":"a00def91be98af9694b5aab9edfbc7ae261ba45918af57cb36ca71973d4479e5"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.890770 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker" containerID="cri-o://a00def91be98af9694b5aab9edfbc7ae261ba45918af57cb36ca71973d4479e5" gracePeriod=30 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.890763 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker-log" containerID="cri-o://29e40571c70fc388e9bc006af0adb8d2eee8ac89c0c617ee3dc948670dd09df1" gracePeriod=30 Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.926734 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.931590 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data" (OuterVolumeSpecName: "config-data") pod "9ba8264d-24bb-4930-9aec-8e5ffd496a02" (UID: "9ba8264d-24bb-4930-9aec-8e5ffd496a02"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.931647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b17ed17-ae28-4189-84ea-977b0803d0ad","Type":"ContainerStarted","Data":"fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87"} Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.932381 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.947013 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.957686 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.969339 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.986525 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:23 crc kubenswrapper[4769]: E1121 13:01:23.986959 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener-log" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.986972 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener-log" Nov 21 13:01:23 crc kubenswrapper[4769]: E1121 13:01:23.986994 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987000 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker" Nov 21 13:01:23 crc kubenswrapper[4769]: E1121 13:01:23.987016 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a0a5091-1ddf-441c-99e8-e21346e9ee66" containerName="mysql-bootstrap" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987023 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a0a5091-1ddf-441c-99e8-e21346e9ee66" containerName="mysql-bootstrap" Nov 21 13:01:23 crc kubenswrapper[4769]: E1121 13:01:23.987037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker-log" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker-log" Nov 21 13:01:23 crc kubenswrapper[4769]: E1121 13:01:23.987056 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987061 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987255 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker-log" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987268 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" containerName="barbican-worker" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987283 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987299 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a0a5091-1ddf-441c-99e8-e21346e9ee66" containerName="mysql-bootstrap" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.987309 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" containerName="barbican-keystone-listener-log" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.988378 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.994092 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.994393 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.994563 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:01:23 crc kubenswrapper[4769]: I1121 13:01:23.994737 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xpkvg" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.002221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.035906 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9ba8264d-24bb-4930-9aec-8e5ffd496a02-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.062148 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.054558 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" podStartSLOduration=7.054537999 podStartE2EDuration="7.054537999s" podCreationTimestamp="2025-11-21 13:01:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:23.922629266 +0000 UTC m=+4242.623291084" watchObservedRunningTime="2025-11-21 13:01:24.054537999 +0000 UTC m=+4242.755199817" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.078693 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=6.078625238 podStartE2EDuration="6.078625238s" podCreationTimestamp="2025-11-21 13:01:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:23.989546509 +0000 UTC m=+4242.690208327" watchObservedRunningTime="2025-11-21 13:01:24.078625238 +0000 UTC m=+4242.779287056" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.079352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data" (OuterVolumeSpecName: "config-data") pod "f9a99993-e243-4bcc-8b63-08db8159c08e" (UID: "f9a99993-e243-4bcc-8b63-08db8159c08e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.142142 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.166747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/048b3b15-392d-49b6-87e3-251369ff8245-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.166832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.166969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/048b3b15-392d-49b6-87e3-251369ff8245-kube-api-access-tgbdx\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.187530 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.202388 4769 scope.go:117] "RemoveContainer" containerID="53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.204263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.204401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.204548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.204578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.215169 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9a99993-e243-4bcc-8b63-08db8159c08e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.251965 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.308975 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.319762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/048b3b15-392d-49b6-87e3-251369ff8245-kube-api-access-tgbdx\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.320143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.320283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.320316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.320369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.320393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.322713 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.323222 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/048b3b15-392d-49b6-87e3-251369ff8245-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.323309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.351788 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.353460 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.363342 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.363688 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.363842 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-6t2fb" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.364121 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.367245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.374392 4769 scope.go:117] "RemoveContainer" containerID="22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0" Nov 21 13:01:24 crc kubenswrapper[4769]: E1121 13:01:24.378392 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0\": container with ID starting with 22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0 not found: ID does not exist" containerID="22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.378435 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0"} err="failed to get container status \"22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0\": rpc error: code = NotFound desc = could not find container \"22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0\": container with ID starting with 22e5ecf7ac71f3941f7d6e336f75631c61c5cbbd3868be37359d7aadd7e9adf0 not found: ID does not exist" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.378462 4769 scope.go:117] "RemoveContainer" containerID="53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa" Nov 21 13:01:24 crc kubenswrapper[4769]: E1121 13:01:24.378880 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa\": container with ID starting with 53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa not found: ID does not exist" containerID="53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.378989 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa"} err="failed to get container status \"53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa\": rpc error: code = NotFound desc = could not find container \"53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa\": container with ID starting with 53976e64b319ff1a676f1caa234c50bca1ff405e00d7da8683247ce2498003fa not found: ID does not exist" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.379064 4769 scope.go:117] "RemoveContainer" containerID="6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.379295 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.382453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.383773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.385445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.385715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/048b3b15-392d-49b6-87e3-251369ff8245-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.411008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/048b3b15-392d-49b6-87e3-251369ff8245-kube-api-access-tgbdx\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.419735 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.433512 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.434907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.440842 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.450446 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.452485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.456073 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.456776 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.456800 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-n8kjm" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.456950 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.457062 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.465449 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76d8f95f96-pbpb7"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.478966 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.497569 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7fdbb7969d-2vcpx"] Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527162 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527203 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd58z\" (UniqueName: \"kubernetes.io/projected/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-kube-api-access-jd58z\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.527357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-config\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.629477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-generated\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.629973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-operator-scripts\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jd58z\" (UniqueName: \"kubernetes.io/projected/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-kube-api-access-jd58z\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz92r\" (UniqueName: \"kubernetes.io/projected/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kube-api-access-rz92r\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.631301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.630743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kolla-config\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.631510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-default\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.631564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-config\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.631729 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.632323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.632750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-config\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.651530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.653432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.653864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd58z\" (UniqueName: \"kubernetes.io/projected/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-kube-api-access-jd58z\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.660591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.736950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-operator-scripts\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rz92r\" (UniqueName: \"kubernetes.io/projected/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kube-api-access-rz92r\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kolla-config\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737301 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-default\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-generated\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.737582 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.738245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-generated\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.739442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-operator-scripts\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.740476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-default\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.740528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kolla-config\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.749968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.750370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.760686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz92r\" (UniqueName: \"kubernetes.io/projected/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kube-api-access-rz92r\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.802621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.806068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.828373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:24 crc kubenswrapper[4769]: I1121 13:01:24.991972 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.005430 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8"] Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.022537 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-65b7b4f47-hskb8"] Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.031546 4769 scope.go:117] "RemoveContainer" containerID="145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.059449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" event={"ID":"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0","Type":"ContainerStarted","Data":"9b6bbf733d6763f0dfc1dbf2bd90da6184437b57978cde5ef42ed446706c9d7a"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.067822 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.069321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" event={"ID":"c63b4809-e3ab-4dd6-b92f-d9444de2ba77","Type":"ContainerStarted","Data":"9c206e65d138ce4a4070f268d892e50d57dd63a227d93f27d578f47a07765bc9"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.083644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" event={"ID":"bd176a47-2143-45c9-85a5-ab6a32848a86","Type":"ContainerStarted","Data":"c7d15563af38f74e6fa9a5ecdde1379c569ac10dd311b504d05f4547b677ff86"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.084027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" event={"ID":"bd176a47-2143-45c9-85a5-ab6a32848a86","Type":"ContainerStarted","Data":"80e1b70c3c78505fc9368883e94e8ca4a0d4761b51f7679cece305838286cd6a"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.097973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.102676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e0ae5f4d-ce46-4306-84d7-b800ea504b34","Type":"ContainerStarted","Data":"f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.106030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerStarted","Data":"201a9f2c4f13f04e66109ef734f982f85b10c14cf3ed10eb663e83d230fe7555"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.111066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" event={"ID":"9db4c881-e68a-4263-ba89-475028eef465","Type":"ContainerStarted","Data":"4e5178bbc7660e09cfcee3b800b1741645b66fab332b85d296a918c21794e620"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.111336 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-log" containerID="cri-o://bdb249d34231152d8b7ad61f684b9efd0a9548cb75cec2f4c6c0c39a45f1b094" gracePeriod=30 Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.111380 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.111478 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-api" containerID="cri-o://4e5178bbc7660e09cfcee3b800b1741645b66fab332b85d296a918c21794e620" gracePeriod=30 Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.117208 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c1258bfb-c652-4c29-b9c1-0e4e205aa94c","Type":"ContainerStarted","Data":"1b01aedc61dc564f94350dee844d3f4a7ce300a26c19025ab287f72fae15d0cf"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.117973 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.120577 4769 scope.go:117] "RemoveContainer" containerID="6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554" Nov 21 13:01:25 crc kubenswrapper[4769]: E1121 13:01:25.121402 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554\": container with ID starting with 6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554 not found: ID does not exist" containerID="6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.121482 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554"} err="failed to get container status \"6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554\": rpc error: code = NotFound desc = could not find container \"6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554\": container with ID starting with 6eeedd4dbfb2f422df392e6bf9b94fdd31c6a418e8a5fcb4dd8720d1c32f3554 not found: ID does not exist" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.121527 4769 scope.go:117] "RemoveContainer" containerID="145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.121776 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.122457 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8/ovn-northd/0.log" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.122553 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:25 crc kubenswrapper[4769]: E1121 13:01:25.122729 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8\": container with ID starting with 145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8 not found: ID does not exist" containerID="145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.122766 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8"} err="failed to get container status \"145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8\": rpc error: code = NotFound desc = could not find container \"145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8\": container with ID starting with 145a43da17e2c11bc1a19f1567335992d145d0776caba656f7ce60eda430e4a8 not found: ID does not exist" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.122794 4769 scope.go:117] "RemoveContainer" containerID="12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.123468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" event={"ID":"4759ef3d-e00f-42ee-9964-82553f02b530","Type":"ContainerStarted","Data":"926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.154780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9344ddbe-d473-4b29-bbad-d660062ce129","Type":"ContainerStarted","Data":"f34ab6568f06309407fdb93913cc585b0a8bd43811dad9934a33208c086a413d"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.212827 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8/ovn-northd/0.log" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.212895 4769 generic.go:334] "Generic (PLEG): container finished" podID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" exitCode=139 Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.213104 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.214015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8","Type":"ContainerDied","Data":"934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.214045 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8","Type":"ContainerDied","Data":"47eb8fee85dd7f0df1610f86720fc21bcbfbeb2c9d6d85a51f6b26b1067dba53"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.221915 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=6.221893989 podStartE2EDuration="6.221893989s" podCreationTimestamp="2025-11-21 13:01:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:25.191284525 +0000 UTC m=+4243.891946343" watchObservedRunningTime="2025-11-21 13:01:25.221893989 +0000 UTC m=+4243.922555807" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.239214 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" podStartSLOduration=8.239179674 podStartE2EDuration="8.239179674s" podCreationTimestamp="2025-11-21 13:01:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:25.1413477 +0000 UTC m=+4243.842009518" watchObservedRunningTime="2025-11-21 13:01:25.239179674 +0000 UTC m=+4243.939841492" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-public-tls-certs\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg6nn\" (UniqueName: \"kubernetes.io/projected/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-kube-api-access-bg6nn\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv44s\" (UniqueName: \"kubernetes.io/projected/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-kube-api-access-sv44s\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-internal-tls-certs\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-northd-tls-certs\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data-custom\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.257922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-rundir\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.258006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-combined-ca-bundle\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.258029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-metrics-certs-tls-certs\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.258059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-scripts\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.258089 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-combined-ca-bundle\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.258110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-logs\") pod \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\" (UID: \"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.258132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-config\") pod \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\" (UID: \"36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8\") " Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.260733 4769 generic.go:334] "Generic (PLEG): container finished" podID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerID="fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e" exitCode=0 Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.260769 4769 generic.go:334] "Generic (PLEG): container finished" podID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerID="90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71" exitCode=143 Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.260892 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.263017 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-logs" (OuterVolumeSpecName: "logs") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.263565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.263627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" event={"ID":"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5","Type":"ContainerDied","Data":"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.263660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" event={"ID":"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5","Type":"ContainerDied","Data":"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.263671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn" event={"ID":"3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5","Type":"ContainerDied","Data":"55704538d6e41cd3ac6e0523ca1211e8012d509ffe8dedda60af0ec667b35d23"} Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.280827 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7fdbb7969d-2vcpx"] Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.289604 4769 generic.go:334] "Generic (PLEG): container finished" podID="438a784a-03b1-4561-87c2-f01538a59ab0" containerID="29e40571c70fc388e9bc006af0adb8d2eee8ac89c0c617ee3dc948670dd09df1" exitCode=143 Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.294416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-config" (OuterVolumeSpecName: "config") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.294885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-scripts" (OuterVolumeSpecName: "scripts") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.321681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-kube-api-access-sv44s" (OuterVolumeSpecName: "kube-api-access-sv44s") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "kube-api-access-sv44s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.362938 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sv44s\" (UniqueName: \"kubernetes.io/projected/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-kube-api-access-sv44s\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.362972 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.362987 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.363000 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.363011 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.391629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.393615 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a0a5091-1ddf-441c-99e8-e21346e9ee66" path="/var/lib/kubelet/pods/3a0a5091-1ddf-441c-99e8-e21346e9ee66/volumes" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.399128 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f636b17-3f16-433a-b5a1-7ec47c877774" path="/var/lib/kubelet/pods/4f636b17-3f16-433a-b5a1-7ec47c877774/volumes" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.401112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-kube-api-access-bg6nn" (OuterVolumeSpecName: "kube-api-access-bg6nn") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "kube-api-access-bg6nn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.401732 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ba8264d-24bb-4930-9aec-8e5ffd496a02" path="/var/lib/kubelet/pods/9ba8264d-24bb-4930-9aec-8e5ffd496a02/volumes" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.409601 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=7.409581364 podStartE2EDuration="7.409581364s" podCreationTimestamp="2025-11-21 13:01:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:25.37490527 +0000 UTC m=+4244.075567078" watchObservedRunningTime="2025-11-21 13:01:25.409581364 +0000 UTC m=+4244.110243172" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.410301 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5735642-e5f1-4fe2-9d28-9b8ef8e321cd" path="/var/lib/kubelet/pods/e5735642-e5f1-4fe2-9d28-9b8ef8e321cd/volumes" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.413024 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a99993-e243-4bcc-8b63-08db8159c08e" path="/var/lib/kubelet/pods/f9a99993-e243-4bcc-8b63-08db8159c08e/volumes" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.433093 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=7.433073777 podStartE2EDuration="7.433073777s" podCreationTimestamp="2025-11-21 13:01:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:25.405432762 +0000 UTC m=+4244.106094580" watchObservedRunningTime="2025-11-21 13:01:25.433073777 +0000 UTC m=+4244.133735595" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.450400 4769 scope.go:117] "RemoveContainer" containerID="12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884" Nov 21 13:01:25 crc kubenswrapper[4769]: E1121 13:01:25.450783 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884\": container with ID starting with 12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884 not found: ID does not exist" containerID="12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.450812 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884"} err="failed to get container status \"12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884\": rpc error: code = NotFound desc = could not find container \"12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884\": container with ID starting with 12a3dbcce1745f18bde4b0d4121a53ffce12d566c453e796e57b8be514c67884 not found: ID does not exist" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.450833 4769 scope.go:117] "RemoveContainer" containerID="ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.465279 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bg6nn\" (UniqueName: \"kubernetes.io/projected/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-kube-api-access-bg6nn\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:25 crc kubenswrapper[4769]: I1121 13:01:25.465308 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.177688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.196729 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.208278 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.289338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.299059 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.299096 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.338757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.358406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data" (OuterVolumeSpecName: "config-data") pod "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" (UID: "3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.386798 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.401160 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.401207 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.401219 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.407076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" (UID: "36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.436083 4769 generic.go:334] "Generic (PLEG): container finished" podID="9db4c881-e68a-4263-ba89-475028eef465" containerID="4e5178bbc7660e09cfcee3b800b1741645b66fab332b85d296a918c21794e620" exitCode=0 Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.436117 4769 generic.go:334] "Generic (PLEG): container finished" podID="9db4c881-e68a-4263-ba89-475028eef465" containerID="bdb249d34231152d8b7ad61f684b9efd0a9548cb75cec2f4c6c0c39a45f1b094" exitCode=143 Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.507106 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" podStartSLOduration=5.507086752 podStartE2EDuration="5.507086752s" podCreationTimestamp="2025-11-21 13:01:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:26.50031389 +0000 UTC m=+4245.200975698" watchObservedRunningTime="2025-11-21 13:01:26.507086752 +0000 UTC m=+4245.207748570" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.511320 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.513827 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.232s" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.513876 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.513895 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.513941 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.513980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" event={"ID":"438a784a-03b1-4561-87c2-f01538a59ab0","Type":"ContainerDied","Data":"29e40571c70fc388e9bc006af0adb8d2eee8ac89c0c617ee3dc948670dd09df1"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"124eddb7-85ff-499a-a117-f9efd7b4c8fa","Type":"ContainerStarted","Data":"fa81b6373af9d8da44f2db174a05dc3c2827332cb15530db622102fe7983077d"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5","Type":"ContainerStarted","Data":"a570510f2e22dd7e2d8ef68c63e6d87c8dba3324744aa5c53ed57c69979b6e7a"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514030 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-dddd4ff94-nfq6g"] Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.514372 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="openstack-network-exporter" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514388 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="openstack-network-exporter" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.514402 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="ovn-northd" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514409 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="ovn-northd" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.514421 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api-log" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api-log" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.514446 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514452 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514621 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514634 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="openstack-network-exporter" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514653 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" containerName="ovn-northd" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.514664 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" containerName="barbican-api-log" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" event={"ID":"9db4c881-e68a-4263-ba89-475028eef465","Type":"ContainerDied","Data":"4e5178bbc7660e09cfcee3b800b1741645b66fab332b85d296a918c21794e620"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515587 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-dddd4ff94-nfq6g"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" event={"ID":"9db4c881-e68a-4263-ba89-475028eef465","Type":"ContainerDied","Data":"bdb249d34231152d8b7ad61f684b9efd0a9548cb75cec2f4c6c0c39a45f1b094"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" event={"ID":"9db4c881-e68a-4263-ba89-475028eef465","Type":"ContainerDied","Data":"b9b569e255df3d2aab001535b10c2765bf74c1e79abd69ad04b8c3e38ce44a21"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515621 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b569e255df3d2aab001535b10c2765bf74c1e79abd69ad04b8c3e38ce44a21" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" event={"ID":"c63b4809-e3ab-4dd6-b92f-d9444de2ba77","Type":"ContainerStarted","Data":"fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"53ea8f17-e44c-4381-8339-f8cdbd0ea290","Type":"ContainerStarted","Data":"2b73502f8081675a5ff8d7a5f8b1ce99f5c7fef44f581f453fcba2d7d1071157"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerStarted","Data":"1b8e9ccb22761288a2f0095aa29e2180498a63676ee7448abe205cf16cf8a34d"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515695 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" event={"ID":"4759ef3d-e00f-42ee-9964-82553f02b530","Type":"ContainerStarted","Data":"34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515717 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-dddd4ff94-nfq6g"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"644337c4-0fc4-45b6-8c46-0c0d86ced1d9","Type":"ContainerStarted","Data":"94096a0f2f956b3db7d84a184d2dc54bbaea687ec12f0d9c7fbfa26e5897e664"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.515739 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7cff5df8b-24kk2"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.517936 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-dddd4ff94-nfq6g" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.517951 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7cff5df8b-24kk2"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.517985 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.518002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" event={"ID":"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0","Type":"ContainerStarted","Data":"ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.518014 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.518040 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.527204 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" event={"ID":"bd176a47-2143-45c9-85a5-ab6a32848a86","Type":"ContainerStarted","Data":"cab074cf17b3d5b37ba09f5bb242cd52223a16513444fa2e9c42eacd2f71b783"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.529549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"048b3b15-392d-49b6-87e3-251369ff8245","Type":"ContainerStarted","Data":"32b7e1d588a26608c4ff2226d22e817f3a1e57b94f575235d707f2b8683c7f31"} Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.542794 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.543484 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker-log" containerID="cri-o://05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2" gracePeriod=30 Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.543558 4769 scope.go:117] "RemoveContainer" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.543570 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker" containerID="cri-o://f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828" gracePeriod=30 Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.551203 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.587766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.618741 4769 scope.go:117] "RemoveContainer" containerID="ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.618969 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.643033 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7\": container with ID starting with ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7 not found: ID does not exist" containerID="ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.643096 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7"} err="failed to get container status \"ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7\": rpc error: code = NotFound desc = could not find container \"ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7\": container with ID starting with ca362c755c524230f8bf80280d8666d9f1f4f05dec42d9986c850bb9d5d24da7 not found: ID does not exist" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.643123 4769 scope.go:117] "RemoveContainer" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.647940 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d\": container with ID starting with 934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d not found: ID does not exist" containerID="934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.647971 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d"} err="failed to get container status \"934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d\": rpc error: code = NotFound desc = could not find container \"934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d\": container with ID starting with 934b38b5b8df7f869a360765503bd493352a8ad0204017f67112cb35e23b351d not found: ID does not exist" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.647991 4769 scope.go:117] "RemoveContainer" containerID="fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.720975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-public-tls-certs\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.721012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-internal-tls-certs\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.721159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-combined-ca-bundle\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.721295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-scripts\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.721321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dm5f\" (UniqueName: \"kubernetes.io/projected/9db4c881-e68a-4263-ba89-475028eef465-kube-api-access-5dm5f\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.721395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-config-data\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.721419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9db4c881-e68a-4263-ba89-475028eef465-logs\") pod \"9db4c881-e68a-4263-ba89-475028eef465\" (UID: \"9db4c881-e68a-4263-ba89-475028eef465\") " Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722173 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-scripts\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw8tn\" (UniqueName: \"kubernetes.io/projected/218614a7-f338-4843-88ca-47a21998b61a-kube-api-access-cw8tn\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-internal-tls-certs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722365 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-config-data\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/218614a7-f338-4843-88ca-47a21998b61a-logs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722568 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-public-tls-certs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.722606 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-combined-ca-bundle\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.723458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db4c881-e68a-4263-ba89-475028eef465-logs" (OuterVolumeSpecName: "logs") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.724117 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-dddd4ff94-nfq6g" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.745661 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9db4c881-e68a-4263-ba89-475028eef465-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.752558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db4c881-e68a-4263-ba89-475028eef465-kube-api-access-5dm5f" (OuterVolumeSpecName: "kube-api-access-5dm5f") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "kube-api-access-5dm5f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.757334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-scripts" (OuterVolumeSpecName: "scripts") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.824326 4769 scope.go:117] "RemoveContainer" containerID="90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-config-data\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/218614a7-f338-4843-88ca-47a21998b61a-logs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-public-tls-certs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-combined-ca-bundle\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851720 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-scripts\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cw8tn\" (UniqueName: \"kubernetes.io/projected/218614a7-f338-4843-88ca-47a21998b61a-kube-api-access-cw8tn\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-internal-tls-certs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851846 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.851873 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5dm5f\" (UniqueName: \"kubernetes.io/projected/9db4c881-e68a-4263-ba89-475028eef465-kube-api-access-5dm5f\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.855482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/218614a7-f338-4843-88ca-47a21998b61a-logs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.975452 4769 scope.go:117] "RemoveContainer" containerID="fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.976610 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e\": container with ID starting with fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e not found: ID does not exist" containerID="fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.976660 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e"} err="failed to get container status \"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e\": rpc error: code = NotFound desc = could not find container \"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e\": container with ID starting with fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e not found: ID does not exist" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.976689 4769 scope.go:117] "RemoveContainer" containerID="90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71" Nov 21 13:01:26 crc kubenswrapper[4769]: E1121 13:01:26.979546 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71\": container with ID starting with 90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71 not found: ID does not exist" containerID="90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.979585 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71"} err="failed to get container status \"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71\": rpc error: code = NotFound desc = could not find container \"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71\": container with ID starting with 90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71 not found: ID does not exist" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.979611 4769 scope.go:117] "RemoveContainer" containerID="fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.981106 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e"} err="failed to get container status \"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e\": rpc error: code = NotFound desc = could not find container \"fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e\": container with ID starting with fbaf63299615cadaebf3c0a3401226c5678e0cf24bd93a54bb6ae8dbe1b0b69e not found: ID does not exist" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.981137 4769 scope.go:117] "RemoveContainer" containerID="90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71" Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.985548 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:26 crc kubenswrapper[4769]: I1121 13:01:26.987061 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71"} err="failed to get container status \"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71\": rpc error: code = NotFound desc = could not find container \"90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71\": container with ID starting with 90729f6b77c81958e3054bff4c9bda56330bad9f608a0959b5d6e56d0feefb71 not found: ID does not exist" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.014959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-public-tls-certs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.031785 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.032035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-scripts\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.032418 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-internal-tls-certs\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.032938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-config-data\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.034794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-combined-ca-bundle\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.049824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw8tn\" (UniqueName: \"kubernetes.io/projected/218614a7-f338-4843-88ca-47a21998b61a-kube-api-access-cw8tn\") pod \"placement-7cff5df8b-24kk2\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.053412 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.110371 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.112604 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" podStartSLOduration=6.11259086 podStartE2EDuration="6.11259086s" podCreationTimestamp="2025-11-21 13:01:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:26.719543715 +0000 UTC m=+4245.420205533" watchObservedRunningTime="2025-11-21 13:01:27.11259086 +0000 UTC m=+4245.813252678" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.166566 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.167227 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener-log" containerID="cri-o://d96d5a3d9c316962b35ba1fa7f9d314612460d96fc2a350d8150a874ca24d9ec" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.167778 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener" containerID="cri-o://cbb5c0eb7f259acc3323bb8b5c8d9c401022227da65a83cfa64853886e2cb033" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.183253 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6f48d8578c-kdj4r"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.183890 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" containerName="keystone-api" containerID="cri-o://ca112281091f134f063a730f0d05455846dd4539dd38263b6eb303013005f234" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.210300 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.219264 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.224793 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fcdff58d8-ttzgn"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.231249 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-b8487dc5f-wtb2g"] Nov 21 13:01:27 crc kubenswrapper[4769]: E1121 13:01:27.231725 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-log" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.231749 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-log" Nov 21 13:01:27 crc kubenswrapper[4769]: E1121 13:01:27.231781 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-api" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.231789 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-api" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.231974 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-log" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.231998 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9db4c881-e68a-4263-ba89-475028eef465" containerName="placement-api" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.232762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.241169 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-internal-tls-certs\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266806 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-scripts\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-public-tls-certs\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-fernet-keys\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-credential-keys\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-config-data\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.266954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7gnc\" (UniqueName: \"kubernetes.io/projected/2f877573-99ba-420d-8977-eed7e339e9c3-kube-api-access-k7gnc\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.267006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-combined-ca-bundle\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.271130 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b8487dc5f-wtb2g"] Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.303622 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5" path="/var/lib/kubelet/pods/3aeb5eea-dc72-4e4a-b55e-60727d3fa4c5/volumes" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.368853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-combined-ca-bundle\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.369957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-internal-tls-certs\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.370639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-scripts\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.370735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-public-tls-certs\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.370844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-fernet-keys\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.370919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-credential-keys\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.371003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-config-data\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.371072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k7gnc\" (UniqueName: \"kubernetes.io/projected/2f877573-99ba-420d-8977-eed7e339e9c3-kube-api-access-k7gnc\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.377182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-scripts\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.379647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-internal-tls-certs\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.380143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-combined-ca-bundle\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.380794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-credential-keys\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.382314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-public-tls-certs\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.404344 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.201:5000/v3\": read tcp 10.217.0.2:55992->10.217.0.201:5000: read: connection reset by peer" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.407863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-fernet-keys\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.411472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-config-data\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.424964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7gnc\" (UniqueName: \"kubernetes.io/projected/2f877573-99ba-420d-8977-eed7e339e9c3-kube-api-access-k7gnc\") pod \"keystone-b8487dc5f-wtb2g\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.549468 4769 generic.go:334] "Generic (PLEG): container finished" podID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerID="d96d5a3d9c316962b35ba1fa7f9d314612460d96fc2a350d8150a874ca24d9ec" exitCode=143 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.552635 4769 generic.go:334] "Generic (PLEG): container finished" podID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" containerID="ca112281091f134f063a730f0d05455846dd4539dd38263b6eb303013005f234" exitCode=0 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.558264 4769 generic.go:334] "Generic (PLEG): container finished" podID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerID="05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2" exitCode=143 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.561527 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="c1258bfb-c652-4c29-b9c1-0e4e205aa94c" containerName="nova-cell0-conductor-conductor" containerID="cri-o://1b01aedc61dc564f94350dee844d3f4a7ce300a26c19025ab287f72fae15d0cf" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.562509 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-log" containerID="cri-o://f9091ab6402e1d92bcf8d022635ec6854fa2357218e1be4d6f4af236808f1d92" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.563579 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" containerName="memcached" containerID="cri-o://9ba56948b0116a1dd20c6b4fc9325e357153ca76ebc8a4724a14930537551dcd" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.563638 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-dddd4ff94-nfq6g" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.563663 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-84c64569fd-l8k8s" Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.563718 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-httpd" containerID="cri-o://fa81b6373af9d8da44f2db174a05dc3c2827332cb15530db622102fe7983077d" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.564089 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-log" containerID="cri-o://8a776922f421501eed8f23f3054dcb68e8702bc13cd949ed25eef524ae3db811" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.564614 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-api" containerID="cri-o://a570510f2e22dd7e2d8ef68c63e6d87c8dba3324744aa5c53ed57c69979b6e7a" gracePeriod=30 Nov 21 13:01:27 crc kubenswrapper[4769]: I1121 13:01:27.564719 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1b17ed17-ae28-4189-84ea-977b0803d0ad" containerName="nova-scheduler-scheduler" containerID="cri-o://fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87" gracePeriod=30 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.066773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-config-data" (OuterVolumeSpecName: "config-data") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.094685 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.374295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.404051 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.526201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.586368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9db4c881-e68a-4263-ba89-475028eef465" (UID: "9db4c881-e68a-4263-ba89-475028eef465"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.611599 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.611635 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9db4c881-e68a-4263-ba89-475028eef465-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.618013 4769 generic.go:334] "Generic (PLEG): container finished" podID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerID="a570510f2e22dd7e2d8ef68c63e6d87c8dba3324744aa5c53ed57c69979b6e7a" exitCode=0 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.618047 4769 generic.go:334] "Generic (PLEG): container finished" podID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerID="8a776922f421501eed8f23f3054dcb68e8702bc13cd949ed25eef524ae3db811" exitCode=143 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.663152 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-log" containerID="cri-o://ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d" gracePeriod=30 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.663437 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-api" containerID="cri-o://afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d" gracePeriod=30 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.699645 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" podStartSLOduration=7.699629922 podStartE2EDuration="7.699629922s" podCreationTimestamp="2025-11-21 13:01:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:28.698705217 +0000 UTC m=+4247.399367045" watchObservedRunningTime="2025-11-21 13:01:28.699629922 +0000 UTC m=+4247.400291740" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.701559 4769 generic.go:334] "Generic (PLEG): container finished" podID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerID="fa81b6373af9d8da44f2db174a05dc3c2827332cb15530db622102fe7983077d" exitCode=0 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.701604 4769 generic.go:334] "Generic (PLEG): container finished" podID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerID="f9091ab6402e1d92bcf8d022635ec6854fa2357218e1be4d6f4af236808f1d92" exitCode=143 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.757811 4769 generic.go:334] "Generic (PLEG): container finished" podID="c1258bfb-c652-4c29-b9c1-0e4e205aa94c" containerID="1b01aedc61dc564f94350dee844d3f4a7ce300a26c19025ab287f72fae15d0cf" exitCode=1 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.802170 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podStartSLOduration=7.802143323 podStartE2EDuration="7.802143323s" podCreationTimestamp="2025-11-21 13:01:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:28.792044051 +0000 UTC m=+4247.492705869" watchObservedRunningTime="2025-11-21 13:01:28.802143323 +0000 UTC m=+4247.502805141" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.839393 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api" containerID="cri-o://c1f050df11eba52bd781dbf6c341b922e4db007bc6dd8c6f678c7cf3be732729" gracePeriod=30 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.840021 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api-log" containerID="cri-o://f34ab6568f06309407fdb93913cc585b0a8bd43811dad9934a33208c086a413d" gracePeriod=30 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.853281 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://f341fcaca6459d670a2242a65ed25922301cd163b2716e0d80044de3edcb5021" gracePeriod=30 Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.892896 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=10.892863007 podStartE2EDuration="10.892863007s" podCreationTimestamp="2025-11-21 13:01:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:28.89186919 +0000 UTC m=+4247.592531008" watchObservedRunningTime="2025-11-21 13:01:28.892863007 +0000 UTC m=+4247.593524825" Nov 21 13:01:28 crc kubenswrapper[4769]: I1121 13:01:28.948583 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=10.948560087 podStartE2EDuration="10.948560087s" podCreationTimestamp="2025-11-21 13:01:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:28.924891019 +0000 UTC m=+4247.625552827" watchObservedRunningTime="2025-11-21 13:01:28.948560087 +0000 UTC m=+4247.649221905" Nov 21 13:01:29 crc kubenswrapper[4769]: E1121 13:01:29.083357 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.81s" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.083704 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.083786 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-548d54c446-vgqdr"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.083809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.083819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" event={"ID":"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10","Type":"ContainerDied","Data":"d96d5a3d9c316962b35ba1fa7f9d314612460d96fc2a350d8150a874ca24d9ec"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.083840 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.085733 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-api" containerID="cri-o://782e45113e125d9bcbbd6f234c532a25460bd4974f2220fab39c91945e29dcb3" gracePeriod=30 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.086074 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-httpd" containerID="cri-o://25f655eaa92541082059d40d76acd14ee48aa601c9f514e6fad079f6985ed66f" gracePeriod=30 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087145 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087173 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087214 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" event={"ID":"8b71c1a7-9cac-4999-a86d-ef9dd005cd51","Type":"ContainerDied","Data":"ca112281091f134f063a730f0d05455846dd4539dd38263b6eb303013005f234"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" event={"ID":"9239d708-5ee4-40e4-ae65-cfdc903874f3","Type":"ContainerDied","Data":"05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087256 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087274 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7cff5df8b-24kk2"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5","Type":"ContainerDied","Data":"a570510f2e22dd7e2d8ef68c63e6d87c8dba3324744aa5c53ed57c69979b6e7a"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5","Type":"ContainerDied","Data":"8a776922f421501eed8f23f3054dcb68e8702bc13cd949ed25eef524ae3db811"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" event={"ID":"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0","Type":"ContainerStarted","Data":"afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"124eddb7-85ff-499a-a117-f9efd7b4c8fa","Type":"ContainerDied","Data":"fa81b6373af9d8da44f2db174a05dc3c2827332cb15530db622102fe7983077d"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"124eddb7-85ff-499a-a117-f9efd7b4c8fa","Type":"ContainerDied","Data":"f9091ab6402e1d92bcf8d022635ec6854fa2357218e1be4d6f4af236808f1d92"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" event={"ID":"8b71c1a7-9cac-4999-a86d-ef9dd005cd51","Type":"ContainerDied","Data":"adaa17d8d84d2f758f0c597417e346eeb3099f5eec94aa47ed7b52ed8c05915d"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087355 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adaa17d8d84d2f758f0c597417e346eeb3099f5eec94aa47ed7b52ed8c05915d" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c1258bfb-c652-4c29-b9c1-0e4e205aa94c","Type":"ContainerDied","Data":"1b01aedc61dc564f94350dee844d3f4a7ce300a26c19025ab287f72fae15d0cf"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"c1258bfb-c652-4c29-b9c1-0e4e205aa94c","Type":"ContainerDied","Data":"8c59ea5550d4e9a57e4be3d9e664b043d6017fc306a5410f9daf71a474abc896"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087388 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c59ea5550d4e9a57e4be3d9e664b043d6017fc306a5410f9daf71a474abc896" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" event={"ID":"c63b4809-e3ab-4dd6-b92f-d9444de2ba77","Type":"ContainerStarted","Data":"835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"53ea8f17-e44c-4381-8339-f8cdbd0ea290","Type":"ContainerStarted","Data":"1ea72bf39e671062876f3a49594a7eaab1401ac55d84f0d55d4827a0a71b971a"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"048b3b15-392d-49b6-87e3-251369ff8245","Type":"ContainerStarted","Data":"da2031c946515e399e1dc12cb82a0e466c31c5e0432295a09da279e5be042e4a"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e0ae5f4d-ce46-4306-84d7-b800ea504b34","Type":"ContainerStarted","Data":"c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087437 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" event={"ID":"218614a7-f338-4843-88ca-47a21998b61a","Type":"ContainerStarted","Data":"e0cc973ab7891c80c878753c536837aaa43cec7b6f8aaea29a9008a4dd3182a3"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9344ddbe-d473-4b29-bbad-d660062ce129","Type":"ContainerStarted","Data":"c1f050df11eba52bd781dbf6c341b922e4db007bc6dd8c6f678c7cf3be732729"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"644337c4-0fc4-45b6-8c46-0c0d86ced1d9","Type":"ContainerStarted","Data":"ef5e9758432f36103d00a2f7757bc93ffc6125c50c879643217b3d76e6f3a55c"} Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.087517 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.116459 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.200:9696/\": read tcp 10.217.0.2:42802->10.217.0.200:9696: read: connection reset by peer" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.149619 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.169547 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.187106 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-84c64569fd-l8k8s"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.206124 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-84c64569fd-l8k8s"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-combined-ca-bundle\") pod \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229387 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-config-data\") pod \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229624 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcbq7\" (UniqueName: \"kubernetes.io/projected/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-kube-api-access-qcbq7\") pod \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\" (UID: \"c1258bfb-c652-4c29-b9c1-0e4e205aa94c\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-internal-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dlm5\" (UniqueName: \"kubernetes.io/projected/bdca1044-7937-42ab-af75-4060e6c949f1-kube-api-access-8dlm5\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-httpd-config\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.229985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-ovndb-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.230016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-config\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.230092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-combined-ca-bundle\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.230158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-public-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.238816 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.246217 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-dddd4ff94-nfq6g"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.258549 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-dddd4ff94-nfq6g"] Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.299865 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9db4c881-e68a-4263-ba89-475028eef465" path="/var/lib/kubelet/pods/9db4c881-e68a-4263-ba89-475028eef465/volumes" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.335908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-internal-tls-certs\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.335994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-credential-keys\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-public-tls-certs\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-config-data\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-combined-ca-bundle\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-fernet-keys\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sptmk\" (UniqueName: \"kubernetes.io/projected/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-kube-api-access-sptmk\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336332 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-scripts\") pod \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\" (UID: \"8b71c1a7-9cac-4999-a86d-ef9dd005cd51\") " Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-httpd-config\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-ovndb-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-config\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-combined-ca-bundle\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-public-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-internal-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.336929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlm5\" (UniqueName: \"kubernetes.io/projected/bdca1044-7937-42ab-af75-4060e6c949f1-kube-api-access-8dlm5\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.339921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-kube-api-access-qcbq7" (OuterVolumeSpecName: "kube-api-access-qcbq7") pod "c1258bfb-c652-4c29-b9c1-0e4e205aa94c" (UID: "c1258bfb-c652-4c29-b9c1-0e4e205aa94c"). InnerVolumeSpecName "kube-api-access-qcbq7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.358844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-httpd-config\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.361925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-combined-ca-bundle\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.400488 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-config\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.400664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-public-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.401299 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-internal-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.425659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-ovndb-tls-certs\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.426743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlm5\" (UniqueName: \"kubernetes.io/projected/bdca1044-7937-42ab-af75-4060e6c949f1-kube-api-access-8dlm5\") pod \"neutron-7b6cc894c8-5jzcv\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.434241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-kube-api-access-sptmk" (OuterVolumeSpecName: "kube-api-access-sptmk") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "kube-api-access-sptmk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.439862 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sptmk\" (UniqueName: \"kubernetes.io/projected/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-kube-api-access-sptmk\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.439885 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qcbq7\" (UniqueName: \"kubernetes.io/projected/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-kube-api-access-qcbq7\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.448171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.460874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-scripts" (OuterVolumeSpecName: "scripts") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.463317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.543821 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.543851 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.543866 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.765261 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.848813 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-config-data" (OuterVolumeSpecName: "config-data") pod "c1258bfb-c652-4c29-b9c1-0e4e205aa94c" (UID: "c1258bfb-c652-4c29-b9c1-0e4e205aa94c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.849908 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.849959 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.863180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c1258bfb-c652-4c29-b9c1-0e4e205aa94c" (UID: "c1258bfb-c652-4c29-b9c1-0e4e205aa94c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.891291 4769 generic.go:334] "Generic (PLEG): container finished" podID="d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" containerID="f341fcaca6459d670a2242a65ed25922301cd163b2716e0d80044de3edcb5021" exitCode=0 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.905572 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerID="25f655eaa92541082059d40d76acd14ee48aa601c9f514e6fad079f6985ed66f" exitCode=0 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.913787 4769 generic.go:334] "Generic (PLEG): container finished" podID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerID="1ea72bf39e671062876f3a49594a7eaab1401ac55d84f0d55d4827a0a71b971a" exitCode=0 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.918742 4769 generic.go:334] "Generic (PLEG): container finished" podID="048b3b15-392d-49b6-87e3-251369ff8245" containerID="da2031c946515e399e1dc12cb82a0e466c31c5e0432295a09da279e5be042e4a" exitCode=0 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.922241 4769 generic.go:334] "Generic (PLEG): container finished" podID="9344ddbe-d473-4b29-bbad-d660062ce129" containerID="c1f050df11eba52bd781dbf6c341b922e4db007bc6dd8c6f678c7cf3be732729" exitCode=0 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.922269 4769 generic.go:334] "Generic (PLEG): container finished" podID="9344ddbe-d473-4b29-bbad-d660062ce129" containerID="f34ab6568f06309407fdb93913cc585b0a8bd43811dad9934a33208c086a413d" exitCode=143 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.924427 4769 generic.go:334] "Generic (PLEG): container finished" podID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" containerID="9ba56948b0116a1dd20c6b4fc9325e357153ca76ebc8a4724a14930537551dcd" exitCode=0 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.937528 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-config-data" (OuterVolumeSpecName: "config-data") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.954008 4769 generic.go:334] "Generic (PLEG): container finished" podID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerID="ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d" exitCode=143 Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.955344 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.955616 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.962404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.965236 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1258bfb-c652-4c29-b9c1-0e4e205aa94c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:29 crc kubenswrapper[4769]: I1121 13:01:29.966971 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.074931 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.118438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8b71c1a7-9cac-4999-a86d-ef9dd005cd51" (UID: "8b71c1a7-9cac-4999-a86d-ef9dd005cd51"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.120358 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=6.120339956 podStartE2EDuration="6.120339956s" podCreationTimestamp="2025-11-21 13:01:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:30.073857064 +0000 UTC m=+4248.774518872" watchObservedRunningTime="2025-11-21 13:01:30.120339956 +0000 UTC m=+4248.821001774" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.178760 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b71c1a7-9cac-4999-a86d-ef9dd005cd51-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.613658 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628099 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.628439 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.355s" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5","Type":"ContainerDied","Data":"ff6a6598c93de0037338ad8b95c7942d14d21f4666f64e426355d30fe0b92839"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628544 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628615 4769 scope.go:117] "RemoveContainer" containerID="a570510f2e22dd7e2d8ef68c63e6d87c8dba3324744aa5c53ed57c69979b6e7a" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628628 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerStarted","Data":"007b6932620e2fa87cdf87c8813ed45bfb01f6c4ee988d7cb7c204affcd27165"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f","Type":"ContainerDied","Data":"f341fcaca6459d670a2242a65ed25922301cd163b2716e0d80044de3edcb5021"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628694 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" event={"ID":"e5f96b2f-5d0c-4fc9-bf04-574534677fec","Type":"ContainerDied","Data":"25f655eaa92541082059d40d76acd14ee48aa601c9f514e6fad079f6985ed66f"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"124eddb7-85ff-499a-a117-f9efd7b4c8fa","Type":"ContainerDied","Data":"75f923ec8507d048d28ecf8f1adfe013af1299e2fa18bc3ea151a1c984c9ebb1"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628742 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75f923ec8507d048d28ecf8f1adfe013af1299e2fa18bc3ea151a1c984c9ebb1" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"53ea8f17-e44c-4381-8339-f8cdbd0ea290","Type":"ContainerDied","Data":"1ea72bf39e671062876f3a49594a7eaab1401ac55d84f0d55d4827a0a71b971a"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628800 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"048b3b15-392d-49b6-87e3-251369ff8245","Type":"ContainerDied","Data":"da2031c946515e399e1dc12cb82a0e466c31c5e0432295a09da279e5be042e4a"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9344ddbe-d473-4b29-bbad-d660062ce129","Type":"ContainerDied","Data":"c1f050df11eba52bd781dbf6c341b922e4db007bc6dd8c6f678c7cf3be732729"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9344ddbe-d473-4b29-bbad-d660062ce129","Type":"ContainerDied","Data":"f34ab6568f06309407fdb93913cc585b0a8bd43811dad9934a33208c086a413d"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2626dcd1-c6c3-4be2-b971-1e34ddab332f","Type":"ContainerDied","Data":"9ba56948b0116a1dd20c6b4fc9325e357153ca76ebc8a4724a14930537551dcd"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"644337c4-0fc4-45b6-8c46-0c0d86ced1d9","Type":"ContainerStarted","Data":"54433d0c86cea293d287cb9e88d02af159fe2b1f1d242d923aa17f9ec65c6e1b"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.628994 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-b8487dc5f-wtb2g"] Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.629025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" event={"ID":"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0","Type":"ContainerDied","Data":"ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d"} Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.643780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.708481 4769 scope.go:117] "RemoveContainer" containerID="8a776922f421501eed8f23f3054dcb68e8702bc13cd949ed25eef524ae3db811" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.811279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-logs\") pod \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.813848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfcb6\" (UniqueName: \"kubernetes.io/projected/124eddb7-85ff-499a-a117-f9efd7b4c8fa-kube-api-access-mfcb6\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-config-data\") pod \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-combined-ca-bundle\") pod \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-httpd-run\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-config-data\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-internal-tls-certs\") pod \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-internal-tls-certs\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-logs\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-public-tls-certs\") pod \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814613 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkhvb\" (UniqueName: \"kubernetes.io/projected/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-kube-api-access-tkhvb\") pod \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\" (UID: \"a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-combined-ca-bundle\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814735 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.814774 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-scripts\") pod \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\" (UID: \"124eddb7-85ff-499a-a117-f9efd7b4c8fa\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.825011 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.812497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-logs" (OuterVolumeSpecName: "logs") pod "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" (UID: "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.824319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-logs" (OuterVolumeSpecName: "logs") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.825793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.840334 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.844623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.844752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-kube-api-access-tkhvb" (OuterVolumeSpecName: "kube-api-access-tkhvb") pod "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" (UID: "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5"). InnerVolumeSpecName "kube-api-access-tkhvb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.848795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-scripts" (OuterVolumeSpecName: "scripts") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.852275 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.865407 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.865883 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1258bfb-c652-4c29-b9c1-0e4e205aa94c" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.865897 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1258bfb-c652-4c29-b9c1-0e4e205aa94c" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.865946 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-httpd" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.865953 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-httpd" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.865964 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.865969 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.865996 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-api" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866023 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-api" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.866033 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866039 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api-log" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.866056 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" containerName="keystone-api" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866061 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" containerName="keystone-api" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.866072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-log" Nov 21 13:01:30 crc kubenswrapper[4769]: E1121 13:01:30.866110 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866116 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866394 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866413 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-httpd" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866447 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" containerName="cinder-api" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-api" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866473 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" containerName="keystone-api" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866486 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" containerName="glance-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c1258bfb-c652-4c29-b9c1-0e4e205aa94c" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.866529 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" containerName="nova-api-log" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.867204 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.870506 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.882739 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.894746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124eddb7-85ff-499a-a117-f9efd7b4c8fa-kube-api-access-mfcb6" (OuterVolumeSpecName: "kube-api-access-mfcb6") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "kube-api-access-mfcb6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.914141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.915741 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.922141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-combined-ca-bundle\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.922251 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-internal-tls-certs\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.922388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9344ddbe-d473-4b29-bbad-d660062ce129-etc-machine-id\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.922918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/9344ddbe-d473-4b29-bbad-d660062ce129-kube-api-access-b7wq6\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.922985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9344ddbe-d473-4b29-bbad-d660062ce129-logs\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-scripts\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923166 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data-custom\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923213 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-public-tls-certs\") pod \"9344ddbe-d473-4b29-bbad-d660062ce129\" (UID: \"9344ddbe-d473-4b29-bbad-d660062ce129\") " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923755 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923775 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/124eddb7-85ff-499a-a117-f9efd7b4c8fa-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923789 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tkhvb\" (UniqueName: \"kubernetes.io/projected/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-kube-api-access-tkhvb\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923818 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923832 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923845 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.923855 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mfcb6\" (UniqueName: \"kubernetes.io/projected/124eddb7-85ff-499a-a117-f9efd7b4c8fa-kube-api-access-mfcb6\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.928051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9344ddbe-d473-4b29-bbad-d660062ce129-logs" (OuterVolumeSpecName: "logs") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.928121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9344ddbe-d473-4b29-bbad-d660062ce129-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.947431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.993227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9344ddbe-d473-4b29-bbad-d660062ce129-kube-api-access-b7wq6" (OuterVolumeSpecName: "kube-api-access-b7wq6") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "kube-api-access-b7wq6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:30 crc kubenswrapper[4769]: I1121 13:01:30.993457 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.004035 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.017818 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" event={"ID":"218614a7-f338-4843-88ca-47a21998b61a","Type":"ContainerStarted","Data":"ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f"} Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.024607 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8vmz\" (UniqueName: \"kubernetes.io/projected/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-kube-api-access-m8vmz\") pod \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.024819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-combined-ca-bundle\") pod \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kolla-config\") pod \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-combined-ca-bundle\") pod \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-config-data\") pod \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025330 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-memcached-tls-certs\") pod \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-nova-novncproxy-tls-certs\") pod \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025540 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-vencrypt-tls-certs\") pod \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vphwc\" (UniqueName: \"kubernetes.io/projected/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kube-api-access-vphwc\") pod \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\" (UID: \"2626dcd1-c6c3-4be2-b971-1e34ddab332f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.025699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-config-data\") pod \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\" (UID: \"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f\") " Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026168 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wjj\" (UniqueName: \"kubernetes.io/projected/d853692a-149a-4845-9f5b-36b451683066-kube-api-access-q9wjj\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026600 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9344ddbe-d473-4b29-bbad-d660062ce129-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026678 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026760 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9344ddbe-d473-4b29-bbad-d660062ce129-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.026839 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/9344ddbe-d473-4b29-bbad-d660062ce129-kube-api-access-b7wq6\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.027908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-config-data" (OuterVolumeSpecName: "config-data") pod "2626dcd1-c6c3-4be2-b971-1e34ddab332f" (UID: "2626dcd1-c6c3-4be2-b971-1e34ddab332f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.032607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "2626dcd1-c6c3-4be2-b971-1e34ddab332f" (UID: "2626dcd1-c6c3-4be2-b971-1e34ddab332f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.033536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"9344ddbe-d473-4b29-bbad-d660062ce129","Type":"ContainerDied","Data":"6f8db81a21ad22a6b8f6c6c487a20948ccbdd15866716d32dc304341e8628cfb"} Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.033591 4769 scope.go:117] "RemoveContainer" containerID="c1f050df11eba52bd781dbf6c341b922e4db007bc6dd8c6f678c7cf3be732729" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.033724 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.042544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f","Type":"ContainerDied","Data":"2a8fe60b85877cb12d928a93d4bee3d487ae3b5da0f7c59e19a4549b577a5213"} Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.042656 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.046958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-scripts" (OuterVolumeSpecName: "scripts") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.049642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"2626dcd1-c6c3-4be2-b971-1e34ddab332f","Type":"ContainerDied","Data":"71975b537e093071a7e8a79537c520e6cd0a2fbfa4109d415920acb878055764"} Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.049714 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.050912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.051112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" event={"ID":"2f877573-99ba-420d-8977-eed7e339e9c3","Type":"ContainerStarted","Data":"83f6bcbd3f73f7a772231cdd65915918e162cd7110ffd723b1235d77b4684595"} Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.061863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kube-api-access-vphwc" (OuterVolumeSpecName: "kube-api-access-vphwc") pod "2626dcd1-c6c3-4be2-b971-1e34ddab332f" (UID: "2626dcd1-c6c3-4be2-b971-1e34ddab332f"). InnerVolumeSpecName "kube-api-access-vphwc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.073480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-kube-api-access-m8vmz" (OuterVolumeSpecName: "kube-api-access-m8vmz") pod "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" (UID: "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f"). InnerVolumeSpecName "kube-api-access-m8vmz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.096658 4769 scope.go:117] "RemoveContainer" containerID="f34ab6568f06309407fdb93913cc585b0a8bd43811dad9934a33208c086a413d" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.124366 4769 scope.go:117] "RemoveContainer" containerID="f341fcaca6459d670a2242a65ed25922301cd163b2716e0d80044de3edcb5021" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wjj\" (UniqueName: \"kubernetes.io/projected/d853692a-149a-4845-9f5b-36b451683066-kube-api-access-q9wjj\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141804 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vphwc\" (UniqueName: \"kubernetes.io/projected/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kube-api-access-vphwc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141821 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m8vmz\" (UniqueName: \"kubernetes.io/projected/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-kube-api-access-m8vmz\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141831 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141840 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2626dcd1-c6c3-4be2-b971-1e34ddab332f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.141849 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.149466 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.150752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.168323 4769 scope.go:117] "RemoveContainer" containerID="9ba56948b0116a1dd20c6b4fc9325e357153ca76ebc8a4724a14930537551dcd" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.168697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wjj\" (UniqueName: \"kubernetes.io/projected/d853692a-149a-4845-9f5b-36b451683066-kube-api-access-q9wjj\") pod \"nova-cell0-conductor-0\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.188829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-config-data" (OuterVolumeSpecName: "config-data") pod "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" (UID: "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.244904 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.244982 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.317757 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1258bfb-c652-4c29-b9c1-0e4e205aa94c" path="/var/lib/kubelet/pods/c1258bfb-c652-4c29-b9c1-0e4e205aa94c/volumes" Nov 21 13:01:31 crc kubenswrapper[4769]: W1121 13:01:31.327968 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdca1044_7937_42ab_af75_4060e6c949f1.slice/crio-94be8d1d8b421c203ce0aacb55cbcb689f09264c55425401a4a1fc8457110c2d WatchSource:0}: Error finding container 94be8d1d8b421c203ce0aacb55cbcb689f09264c55425401a4a1fc8457110c2d: Status 404 returned error can't find the container with id 94be8d1d8b421c203ce0aacb55cbcb689f09264c55425401a4a1fc8457110c2d Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.440439 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.450674 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.500066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.543845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" (UID: "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.554953 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.554987 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.564780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" (UID: "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.590643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" (UID: "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.618224 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" (UID: "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.619327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-config-data" (OuterVolumeSpecName: "config-data") pod "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" (UID: "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.628329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2626dcd1-c6c3-4be2-b971-1e34ddab332f" (UID: "2626dcd1-c6c3-4be2-b971-1e34ddab332f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.635162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" (UID: "a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.647576 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.648883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656365 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656392 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656404 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656416 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656425 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656434 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656448 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.656458 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.680883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data" (OuterVolumeSpecName: "config-data") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.687826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.702466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "2626dcd1-c6c3-4be2-b971-1e34ddab332f" (UID: "2626dcd1-c6c3-4be2-b971-1e34ddab332f"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.716708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" (UID: "d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.725058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9344ddbe-d473-4b29-bbad-d660062ce129" (UID: "9344ddbe-d473-4b29-bbad-d660062ce129"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.725168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-config-data" (OuterVolumeSpecName: "config-data") pod "124eddb7-85ff-499a-a117-f9efd7b4c8fa" (UID: "124eddb7-85ff-499a-a117-f9efd7b4c8fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.757629 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/2626dcd1-c6c3-4be2-b971-1e34ddab332f-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.757844 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.757904 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.757989 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/124eddb7-85ff-499a-a117-f9efd7b4c8fa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.758045 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.758105 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9344ddbe-d473-4b29-bbad-d660062ce129-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.833205 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv"] Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.833259 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:31 crc kubenswrapper[4769]: I1121 13:01:31.833404 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.127953 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"53ea8f17-e44c-4381-8339-f8cdbd0ea290","Type":"ContainerStarted","Data":"5103bfeb6e2ec90a8d2df4a9be6027cee2234f1db18364a4a6da13fa852d6e7b"} Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.153246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" event={"ID":"218614a7-f338-4843-88ca-47a21998b61a","Type":"ContainerStarted","Data":"c4b3623ca74fdc895adcd4776d2cae1037057822d2d7f94d5bb1675e8a71d160"} Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.153358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.153446 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.185832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" event={"ID":"2f877573-99ba-420d-8977-eed7e339e9c3","Type":"ContainerStarted","Data":"0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517"} Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.187273 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.194446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" event={"ID":"bdca1044-7937-42ab-af75-4060e6c949f1","Type":"ContainerStarted","Data":"94be8d1d8b421c203ce0aacb55cbcb689f09264c55425401a4a1fc8457110c2d"} Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.209535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"048b3b15-392d-49b6-87e3-251369ff8245","Type":"ContainerStarted","Data":"7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018"} Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.214395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d853692a-149a-4845-9f5b-36b451683066","Type":"ContainerStarted","Data":"ebf904080b9406ba3e9f9a9c472f1140e498aa308ddb8571f3bcac00c003dd17"} Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.235841 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.23581827 podStartE2EDuration="8.23581827s" podCreationTimestamp="2025-11-21 13:01:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:32.16342346 +0000 UTC m=+4250.864085288" watchObservedRunningTime="2025-11-21 13:01:32.23581827 +0000 UTC m=+4250.936480088" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.248651 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.258354 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podStartSLOduration=7.258335386 podStartE2EDuration="7.258335386s" podCreationTimestamp="2025-11-21 13:01:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:32.194180648 +0000 UTC m=+4250.894842476" watchObservedRunningTime="2025-11-21 13:01:32.258335386 +0000 UTC m=+4250.958997204" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.261441 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" podStartSLOduration=6.26143343 podStartE2EDuration="6.26143343s" podCreationTimestamp="2025-11-21 13:01:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:32.224507365 +0000 UTC m=+4250.925169183" watchObservedRunningTime="2025-11-21 13:01:32.26143343 +0000 UTC m=+4250.962095248" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.268151 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=9.26813969 podStartE2EDuration="9.26813969s" podCreationTimestamp="2025-11-21 13:01:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:32.255812888 +0000 UTC m=+4250.956474706" watchObservedRunningTime="2025-11-21 13:01:32.26813969 +0000 UTC m=+4250.968801508" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.353429 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.509097 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.521277 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.536535 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: E1121 13:01:32.537210 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" containerName="memcached" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.537307 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" containerName="memcached" Nov 21 13:01:32 crc kubenswrapper[4769]: E1121 13:01:32.537394 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.537450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.537730 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" containerName="memcached" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.537797 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.539271 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.546995 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.547218 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.547326 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.566858 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.589471 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2129199a-a7af-4a97-8205-8276aa63e2b2-logs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtxs\" (UniqueName: \"kubernetes.io/projected/2129199a-a7af-4a97-8205-8276aa63e2b2-kube-api-access-lbtxs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data-custom\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-scripts\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2129199a-a7af-4a97-8205-8276aa63e2b2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.599826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.613568 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.625275 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.627259 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.637562 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.640761 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.641130 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-hqthj" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.641199 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.654382 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.667230 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.675263 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.685875 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.694741 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.696456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.701871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbm5s\" (UniqueName: \"kubernetes.io/projected/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kube-api-access-hbm5s\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.701941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data-custom\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kolla-config\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-scripts\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2129199a-a7af-4a97-8205-8276aa63e2b2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702226 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-memcached-tls-certs\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.702359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.704508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2129199a-a7af-4a97-8205-8276aa63e2b2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.708361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2129199a-a7af-4a97-8205-8276aa63e2b2-logs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.708673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtxs\" (UniqueName: \"kubernetes.io/projected/2129199a-a7af-4a97-8205-8276aa63e2b2-kube-api-access-lbtxs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.708708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.708758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-config-data\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.708820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-combined-ca-bundle\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.710796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.710807 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.711292 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.711470 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.711932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2129199a-a7af-4a97-8205-8276aa63e2b2-logs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.712238 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.712319 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.713585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-scripts\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.724814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.730769 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.732781 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.734036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.737650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.737703 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.737897 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.737914 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.744389 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.745709 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtxs\" (UniqueName: \"kubernetes.io/projected/2129199a-a7af-4a97-8205-8276aa63e2b2-kube-api-access-lbtxs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.746126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.746217 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data-custom\") pod \"cinder-api-0\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.784331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.786368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.790384 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.790706 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-p27px" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.790904 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.791048 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.804408 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.825630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-config-data\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.825710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kolla-config\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-internal-tls-certs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8s7j\" (UniqueName: \"kubernetes.io/projected/f36efa69-0b27-49a4-9109-a09dfe6a68f1-kube-api-access-p8s7j\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-memcached-tls-certs\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75add1bd-8dee-41f1-89a0-26510fee38b4-logs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-public-tls-certs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827638 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-config-data\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827679 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-combined-ca-bundle\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmh8n\" (UniqueName: \"kubernetes.io/projected/75add1bd-8dee-41f1-89a0-26510fee38b4-kube-api-access-hmh8n\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.827755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hbm5s\" (UniqueName: \"kubernetes.io/projected/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kube-api-access-hbm5s\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.833582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-config-data\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.842516 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kolla-config\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.856678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbm5s\" (UniqueName: \"kubernetes.io/projected/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kube-api-access-hbm5s\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.857890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-memcached-tls-certs\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.863772 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.865621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-combined-ca-bundle\") pod \"memcached-0\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.928843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75add1bd-8dee-41f1-89a0-26510fee38b4-logs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.928893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-public-tls-certs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.928947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.928971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hmh8n\" (UniqueName: \"kubernetes.io/projected/75add1bd-8dee-41f1-89a0-26510fee38b4-kube-api-access-hmh8n\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.928995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-config-data\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p467\" (UniqueName: \"kubernetes.io/projected/b31d6545-ddad-4fcf-b60d-47be899c6768-kube-api-access-7p467\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-internal-tls-certs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929206 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p8s7j\" (UniqueName: \"kubernetes.io/projected/f36efa69-0b27-49a4-9109-a09dfe6a68f1-kube-api-access-p8s7j\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929243 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929288 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-logs\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.929769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75add1bd-8dee-41f1-89a0-26510fee38b4-logs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.935330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-internal-tls-certs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.937098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-public-tls-certs\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.938772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.943976 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.944309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.944815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-config-data\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.948885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.951768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.956580 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.959591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8s7j\" (UniqueName: \"kubernetes.io/projected/f36efa69-0b27-49a4-9109-a09dfe6a68f1-kube-api-access-p8s7j\") pod \"nova-cell1-novncproxy-0\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:32 crc kubenswrapper[4769]: I1121 13:01:32.962224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmh8n\" (UniqueName: \"kubernetes.io/projected/75add1bd-8dee-41f1-89a0-26510fee38b4-kube-api-access-hmh8n\") pod \"nova-api-0\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.053175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-logs\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.053258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.053590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.053641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.053831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.053987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7p467\" (UniqueName: \"kubernetes.io/projected/b31d6545-ddad-4fcf-b60d-47be899c6768-kube-api-access-7p467\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.054179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.054236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.055575 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.056030 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-logs\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.057997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.063056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.078126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p467\" (UniqueName: \"kubernetes.io/projected/b31d6545-ddad-4fcf-b60d-47be899c6768-kube-api-access-7p467\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.102006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.102634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.109482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.122601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.217015 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.243485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.248634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" event={"ID":"bdca1044-7937-42ab-af75-4060e6c949f1","Type":"ContainerStarted","Data":"7bef60add7b2824d9f607e5306c621eac4d7e7c48130292a5c29c88a5e08a7fa"} Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.252568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerStarted","Data":"11c9b3c2964411321ab7fce27737a9fa382471af54e7c0833a597b9c9a3e0f41"} Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.252731 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-central-agent" containerID="cri-o://201a9f2c4f13f04e66109ef734f982f85b10c14cf3ed10eb663e83d230fe7555" gracePeriod=30 Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.252989 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.253313 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="proxy-httpd" containerID="cri-o://11c9b3c2964411321ab7fce27737a9fa382471af54e7c0833a597b9c9a3e0f41" gracePeriod=30 Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.253357 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="sg-core" containerID="cri-o://007b6932620e2fa87cdf87c8813ed45bfb01f6c4ee988d7cb7c204affcd27165" gracePeriod=30 Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.253392 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-notification-agent" containerID="cri-o://1b8e9ccb22761288a2f0095aa29e2180498a63676ee7448abe205cf16cf8a34d" gracePeriod=30 Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.256307 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.264554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d853692a-149a-4845-9f5b-36b451683066","Type":"ContainerStarted","Data":"ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743"} Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.264646 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="openstack-network-exporter" containerID="cri-o://54433d0c86cea293d287cb9e88d02af159fe2b1f1d242d923aa17f9ec65c6e1b" gracePeriod=300 Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.264845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.306919 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124eddb7-85ff-499a-a117-f9efd7b4c8fa" path="/var/lib/kubelet/pods/124eddb7-85ff-499a-a117-f9efd7b4c8fa/volumes" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.307870 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" path="/var/lib/kubelet/pods/2626dcd1-c6c3-4be2-b971-1e34ddab332f/volumes" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.307875 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=5.318485217 podStartE2EDuration="15.307674858s" podCreationTimestamp="2025-11-21 13:01:18 +0000 UTC" firstStartedPulling="2025-11-21 13:01:20.918290273 +0000 UTC m=+4239.618952091" lastFinishedPulling="2025-11-21 13:01:30.907479914 +0000 UTC m=+4249.608141732" observedRunningTime="2025-11-21 13:01:33.291358148 +0000 UTC m=+4251.992019966" watchObservedRunningTime="2025-11-21 13:01:33.307674858 +0000 UTC m=+4252.008336666" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.308640 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9344ddbe-d473-4b29-bbad-d660062ce129" path="/var/lib/kubelet/pods/9344ddbe-d473-4b29-bbad-d660062ce129/volumes" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.311882 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5" path="/var/lib/kubelet/pods/a311fc48-76d9-4ce7-9d9b-a2b8bd338fe5/volumes" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.312459 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f" path="/var/lib/kubelet/pods/d01b7f03-99a6-4253-9fb5-07d9f0fb1f3f/volumes" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.419992 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=3.419969042 podStartE2EDuration="3.419969042s" podCreationTimestamp="2025-11-21 13:01:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:33.378473824 +0000 UTC m=+4252.079135642" watchObservedRunningTime="2025-11-21 13:01:33.419969042 +0000 UTC m=+4252.120630860" Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.443487 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.454380 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="ovsdbserver-nb" containerID="cri-o://ef5e9758432f36103d00a2f7757bc93ffc6125c50c879643217b3d76e6f3a55c" gracePeriod=300 Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.684882 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:33 crc kubenswrapper[4769]: I1121 13:01:33.996528 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.034096 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.092598 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.307318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b31d6545-ddad-4fcf-b60d-47be899c6768","Type":"ContainerStarted","Data":"6a3bf757d4e5bfaef66381e8649137db0c9d29990d491a35b84c23df8aea4a14"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.308944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f36efa69-0b27-49a4-9109-a09dfe6a68f1","Type":"ContainerStarted","Data":"46737894b1231ae82f2fb2523e53f69343d7863cb87a1264ec511a2ab1e4c2f5"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.313592 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_644337c4-0fc4-45b6-8c46-0c0d86ced1d9/ovsdbserver-nb/0.log" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.313630 4769 generic.go:334] "Generic (PLEG): container finished" podID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerID="54433d0c86cea293d287cb9e88d02af159fe2b1f1d242d923aa17f9ec65c6e1b" exitCode=2 Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.313644 4769 generic.go:334] "Generic (PLEG): container finished" podID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerID="ef5e9758432f36103d00a2f7757bc93ffc6125c50c879643217b3d76e6f3a55c" exitCode=143 Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.313690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"644337c4-0fc4-45b6-8c46-0c0d86ced1d9","Type":"ContainerDied","Data":"54433d0c86cea293d287cb9e88d02af159fe2b1f1d242d923aa17f9ec65c6e1b"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.313707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"644337c4-0fc4-45b6-8c46-0c0d86ced1d9","Type":"ContainerDied","Data":"ef5e9758432f36103d00a2f7757bc93ffc6125c50c879643217b3d76e6f3a55c"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.323118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2129199a-a7af-4a97-8205-8276aa63e2b2","Type":"ContainerStarted","Data":"a8153665763dcbcdd228ecd6d532997e4dc44e8202c53fb7ed29ebd858f2b278"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.352996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"44c2164d-04ed-4bc7-a71f-e54cc74d7d32","Type":"ContainerStarted","Data":"b5f9ce791b7321a9f19d3aae9c8edbcbb4a9859cc45eef1099ed7974705e0493"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.356157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75add1bd-8dee-41f1-89a0-26510fee38b4","Type":"ContainerStarted","Data":"0296806317e177ea9a0781ed46693800fa4afed17e0b0d56943fc4c2291c99ea"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.358716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" event={"ID":"bdca1044-7937-42ab-af75-4060e6c949f1","Type":"ContainerStarted","Data":"ffe644618260af24e558ade27a0ed29fae7f0c409a4b0d8a1a7b5ddf61f93f4d"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.359368 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373685 4769 generic.go:334] "Generic (PLEG): container finished" podID="16ae2cef-55b9-48d2-b780-88b76f881353" containerID="11c9b3c2964411321ab7fce27737a9fa382471af54e7c0833a597b9c9a3e0f41" exitCode=0 Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373719 4769 generic.go:334] "Generic (PLEG): container finished" podID="16ae2cef-55b9-48d2-b780-88b76f881353" containerID="007b6932620e2fa87cdf87c8813ed45bfb01f6c4ee988d7cb7c204affcd27165" exitCode=2 Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373726 4769 generic.go:334] "Generic (PLEG): container finished" podID="16ae2cef-55b9-48d2-b780-88b76f881353" containerID="1b8e9ccb22761288a2f0095aa29e2180498a63676ee7448abe205cf16cf8a34d" exitCode=0 Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373733 4769 generic.go:334] "Generic (PLEG): container finished" podID="16ae2cef-55b9-48d2-b780-88b76f881353" containerID="201a9f2c4f13f04e66109ef734f982f85b10c14cf3ed10eb663e83d230fe7555" exitCode=0 Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerDied","Data":"11c9b3c2964411321ab7fce27737a9fa382471af54e7c0833a597b9c9a3e0f41"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerDied","Data":"007b6932620e2fa87cdf87c8813ed45bfb01f6c4ee988d7cb7c204affcd27165"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerDied","Data":"1b8e9ccb22761288a2f0095aa29e2180498a63676ee7448abe205cf16cf8a34d"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.373856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerDied","Data":"201a9f2c4f13f04e66109ef734f982f85b10c14cf3ed10eb663e83d230fe7555"} Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.394237 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" podStartSLOduration=7.39421994 podStartE2EDuration="7.39421994s" podCreationTimestamp="2025-11-21 13:01:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:34.387704325 +0000 UTC m=+4253.088366143" watchObservedRunningTime="2025-11-21 13:01:34.39421994 +0000 UTC m=+4253.094881758" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.780106 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_644337c4-0fc4-45b6-8c46-0c0d86ced1d9/ovsdbserver-nb/0.log" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.780544 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.817464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-metrics-certs-tls-certs\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.818531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-combined-ca-bundle\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.818625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.818756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdb-rundir\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.818843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-scripts\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.818925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd58z\" (UniqueName: \"kubernetes.io/projected/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-kube-api-access-jd58z\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.819102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdbserver-nb-tls-certs\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.819178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-config\") pod \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\" (UID: \"644337c4-0fc4-45b6-8c46-0c0d86ced1d9\") " Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.822525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.830950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-scripts" (OuterVolumeSpecName: "scripts") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.831734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-config" (OuterVolumeSpecName: "config") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.848710 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.850361 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.850472 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.880208 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-kube-api-access-jd58z" (OuterVolumeSpecName: "kube-api-access-jd58z") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "kube-api-access-jd58z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.880608 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:34 crc kubenswrapper[4769]: E1121 13:01:34.946467 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:48118->38.102.83.227:40411: write tcp 38.102.83.227:48118->38.102.83.227:40411: write: broken pipe Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.952216 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jd58z\" (UniqueName: \"kubernetes.io/projected/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-kube-api-access-jd58z\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:34 crc kubenswrapper[4769]: I1121 13:01:34.952388 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.028658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.065545 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.069409 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.071178 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.092994 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.101103 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.101152 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.161331 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.167198 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.195572 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.215:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.258737 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.267948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-log-httpd\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268056 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-config-data\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-scripts\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-sg-core-conf-yaml\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29rh2\" (UniqueName: \"kubernetes.io/projected/16ae2cef-55b9-48d2-b780-88b76f881353-kube-api-access-29rh2\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-run-httpd\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-ceilometer-tls-certs\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-combined-ca-bundle\") pod \"16ae2cef-55b9-48d2-b780-88b76f881353\" (UID: \"16ae2cef-55b9-48d2-b780-88b76f881353\") " Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.268733 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.272160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.279518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.297870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-scripts" (OuterVolumeSpecName: "scripts") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.301290 4769 scope.go:117] "RemoveContainer" containerID="8fc9f2c1ab4028ce5e693ffad5e61ab730f5b37f730df26f975a8b1640279b35" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.315073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ae2cef-55b9-48d2-b780-88b76f881353-kube-api-access-29rh2" (OuterVolumeSpecName: "kube-api-access-29rh2") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "kube-api-access-29rh2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.373693 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-29rh2\" (UniqueName: \"kubernetes.io/projected/16ae2cef-55b9-48d2-b780-88b76f881353-kube-api-access-29rh2\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.377059 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.377093 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/16ae2cef-55b9-48d2-b780-88b76f881353-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.377104 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.424168 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.452054 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_644337c4-0fc4-45b6-8c46-0c0d86ced1d9/ovsdbserver-nb/0.log" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.452228 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.494017 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.49400347 podStartE2EDuration="3.49400347s" podCreationTimestamp="2025-11-21 13:01:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:35.483559299 +0000 UTC m=+4254.184221137" watchObservedRunningTime="2025-11-21 13:01:35.49400347 +0000 UTC m=+4254.194665288" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.657350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.685415 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.841994 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842118 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"16ae2cef-55b9-48d2-b780-88b76f881353","Type":"ContainerDied","Data":"d4f812a4c6d83c0204103d8c178eb36b4745ad8e80cbdc3bfd869a6e46a556b1"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b31d6545-ddad-4fcf-b60d-47be899c6768","Type":"ContainerStarted","Data":"18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f36efa69-0b27-49a4-9109-a09dfe6a68f1","Type":"ContainerStarted","Data":"c940edb7d176e873d94bc4b037a01135aa30338de7d0c1de39b270a899fcf6c7"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842201 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"644337c4-0fc4-45b6-8c46-0c0d86ced1d9","Type":"ContainerDied","Data":"94096a0f2f956b3db7d84a184d2dc54bbaea687ec12f0d9c7fbfa26e5897e664"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2129199a-a7af-4a97-8205-8276aa63e2b2","Type":"ContainerStarted","Data":"b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"44c2164d-04ed-4bc7-a71f-e54cc74d7d32","Type":"ContainerStarted","Data":"9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75add1bd-8dee-41f1-89a0-26510fee38b4","Type":"ContainerStarted","Data":"157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585"} Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.842561 4769 scope.go:117] "RemoveContainer" containerID="11c9b3c2964411321ab7fce27737a9fa382471af54e7c0833a597b9c9a3e0f41" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.869357 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="2626dcd1-c6c3-4be2-b971-1e34ddab332f" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.203:11211: i/o timeout" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.915871 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=3.915853922 podStartE2EDuration="3.915853922s" podCreationTimestamp="2025-11-21 13:01:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:35.514680197 +0000 UTC m=+4254.215342015" watchObservedRunningTime="2025-11-21 13:01:35.915853922 +0000 UTC m=+4254.616515740" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.939776 4769 scope.go:117] "RemoveContainer" containerID="7cd46d6488e5848c7d8e0100e91bf525a45ba9303ee9e5ab4338cfbfdb820db4" Nov 21 13:01:35 crc kubenswrapper[4769]: I1121 13:01:35.958079 4769 scope.go:117] "RemoveContainer" containerID="007b6932620e2fa87cdf87c8813ed45bfb01f6c4ee988d7cb7c204affcd27165" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.002784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.003829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "644337c4-0fc4-45b6-8c46-0c0d86ced1d9" (UID: "644337c4-0fc4-45b6-8c46-0c0d86ced1d9"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.023242 4769 scope.go:117] "RemoveContainer" containerID="1b8e9ccb22761288a2f0095aa29e2180498a63676ee7448abe205cf16cf8a34d" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.052247 4769 scope.go:117] "RemoveContainer" containerID="c16b3ecd9658e96b43ee9f1c10e74fc9f1462820d41d8d348d6545431b19f11b" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.094715 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.094749 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/644337c4-0fc4-45b6-8c46-0c0d86ced1d9-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.157346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-config-data" (OuterVolumeSpecName: "config-data") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.181057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16ae2cef-55b9-48d2-b780-88b76f881353" (UID: "16ae2cef-55b9-48d2-b780-88b76f881353"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.196461 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.196502 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16ae2cef-55b9-48d2-b780-88b76f881353-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.343621 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.371925 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.386137 4769 scope.go:117] "RemoveContainer" containerID="201a9f2c4f13f04e66109ef734f982f85b10c14cf3ed10eb663e83d230fe7555" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.388876 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: E1121 13:01:36.389281 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-central-agent" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389293 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-central-agent" Nov 21 13:01:36 crc kubenswrapper[4769]: E1121 13:01:36.389321 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-notification-agent" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389327 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-notification-agent" Nov 21 13:01:36 crc kubenswrapper[4769]: E1121 13:01:36.389355 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="proxy-httpd" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389362 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="proxy-httpd" Nov 21 13:01:36 crc kubenswrapper[4769]: E1121 13:01:36.389373 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="ovsdbserver-nb" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389380 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="ovsdbserver-nb" Nov 21 13:01:36 crc kubenswrapper[4769]: E1121 13:01:36.389393 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="sg-core" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="sg-core" Nov 21 13:01:36 crc kubenswrapper[4769]: E1121 13:01:36.389416 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="openstack-network-exporter" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389421 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="openstack-network-exporter" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389588 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-central-agent" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389603 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="ceilometer-notification-agent" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389616 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="sg-core" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389627 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="openstack-network-exporter" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389640 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" containerName="proxy-httpd" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.389651 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" containerName="ovsdbserver-nb" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.391290 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.397818 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.398252 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.398401 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-6t2fb" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.398537 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.398662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.409889 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.422265 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.477126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.504795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.504877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.504926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-config\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.504983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.505018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.505089 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.505143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbq5\" (UniqueName: \"kubernetes.io/projected/7995cfb3-14d8-4487-b7aa-a2582bc19c52-kube-api-access-bjbq5\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.505298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.506108 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.511592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.517739 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.519334 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.519587 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.546641 4769 scope.go:117] "RemoveContainer" containerID="1231301552e82cb68aacb40f4513da0dae8d119fc03036b59fad953c207b9765" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.546978 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.548860 4769 scope.go:117] "RemoveContainer" containerID="54433d0c86cea293d287cb9e88d02af159fe2b1f1d242d923aa17f9ec65c6e1b" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.571103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75add1bd-8dee-41f1-89a0-26510fee38b4","Type":"ContainerStarted","Data":"f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e"} Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-config\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.610818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbq5\" (UniqueName: \"kubernetes.io/projected/7995cfb3-14d8-4487-b7aa-a2582bc19c52-kube-api-access-bjbq5\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.612721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.614397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.614793 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.617554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-config\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.624027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.629305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.633060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.636145 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.6361217 podStartE2EDuration="4.6361217s" podCreationTimestamp="2025-11-21 13:01:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:36.605838385 +0000 UTC m=+4255.306500193" watchObservedRunningTime="2025-11-21 13:01:36.6361217 +0000 UTC m=+4255.336783518" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.642649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbq5\" (UniqueName: \"kubernetes.io/projected/7995cfb3-14d8-4487-b7aa-a2582bc19c52-kube-api-access-bjbq5\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.668553 4769 scope.go:117] "RemoveContainer" containerID="ef5e9758432f36103d00a2f7757bc93ffc6125c50c879643217b3d76e6f3a55c" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.692156 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.713633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-config-data\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.713772 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-scripts\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.713795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-run-httpd\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.713859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.713999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.714111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.714199 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sdcr\" (UniqueName: \"kubernetes.io/projected/c38788ea-0eb8-4e69-927c-c0f01dd339e2-kube-api-access-8sdcr\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.714235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-log-httpd\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.760943 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.787568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-scripts\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-run-httpd\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818635 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8sdcr\" (UniqueName: \"kubernetes.io/projected/c38788ea-0eb8-4e69-927c-c0f01dd339e2-kube-api-access-8sdcr\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-log-httpd\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.818744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-config-data\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.819766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-run-httpd\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.821714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-log-httpd\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.826874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.827959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-scripts\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.829123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.834232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.878680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-config-data\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.886318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sdcr\" (UniqueName: \"kubernetes.io/projected/c38788ea-0eb8-4e69-927c-c0f01dd339e2-kube-api-access-8sdcr\") pod \"ceilometer-0\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:36 crc kubenswrapper[4769]: I1121 13:01:36.917726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:37 crc kubenswrapper[4769]: E1121 13:01:37.248493 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743 is running failed: container process not found" containerID="ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:37 crc kubenswrapper[4769]: E1121 13:01:37.254319 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743 is running failed: container process not found" containerID="ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:37 crc kubenswrapper[4769]: E1121 13:01:37.254716 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743 is running failed: container process not found" containerID="ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:37 crc kubenswrapper[4769]: E1121 13:01:37.254812 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743 is running failed: container process not found" probeType="Liveness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.272839 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.291842 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ae2cef-55b9-48d2-b780-88b76f881353" path="/var/lib/kubelet/pods/16ae2cef-55b9-48d2-b780-88b76f881353/volumes" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.293254 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="644337c4-0fc4-45b6-8c46-0c0d86ced1d9" path="/var/lib/kubelet/pods/644337c4-0fc4-45b6-8c46-0c0d86ced1d9/volumes" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.314245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.333491 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:37 crc kubenswrapper[4769]: W1121 13:01:37.337599 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc38788ea_0eb8_4e69_927c_c0f01dd339e2.slice/crio-248f4e5e8b5affb5898d9da422db89293c559718e1679f02d5d31c1f464c2363 WatchSource:0}: Error finding container 248f4e5e8b5affb5898d9da422db89293c559718e1679f02d5d31c1f464c2363: Status 404 returned error can't find the container with id 248f4e5e8b5affb5898d9da422db89293c559718e1679f02d5d31c1f464c2363 Nov 21 13:01:37 crc kubenswrapper[4769]: W1121 13:01:37.355682 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice/crio-f5780806f4062ce45066444dd463c4754eac4c6d59f1f66b137c481b6e59e4a4 WatchSource:0}: Error finding container f5780806f4062ce45066444dd463c4754eac4c6d59f1f66b137c481b6e59e4a4: Status 404 returned error can't find the container with id f5780806f4062ce45066444dd463c4754eac4c6d59f1f66b137c481b6e59e4a4 Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.377549 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.381756 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.220:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.381774 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.220:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.593243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b31d6545-ddad-4fcf-b60d-47be899c6768","Type":"ContainerStarted","Data":"43037d63719c54f059d0bbbce7005e49220a7a30b477272d7e72153c16868ca2"} Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.599780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2129199a-a7af-4a97-8205-8276aa63e2b2","Type":"ContainerStarted","Data":"64953335061db058d8b5b7da6ce6f1df4249d55f50d09d06a5a5f56ae42c523a"} Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.600003 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.604691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7995cfb3-14d8-4487-b7aa-a2582bc19c52","Type":"ContainerStarted","Data":"f5780806f4062ce45066444dd463c4754eac4c6d59f1f66b137c481b6e59e4a4"} Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.606392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerStarted","Data":"248f4e5e8b5affb5898d9da422db89293c559718e1679f02d5d31c1f464c2363"} Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.613806 4769 generic.go:334] "Generic (PLEG): container finished" podID="d853692a-149a-4845-9f5b-36b451683066" containerID="ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743" exitCode=1 Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.614273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d853692a-149a-4845-9f5b-36b451683066","Type":"ContainerDied","Data":"ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743"} Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.615224 4769 scope.go:117] "RemoveContainer" containerID="ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.651992 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.65197611 podStartE2EDuration="5.65197611s" podCreationTimestamp="2025-11-21 13:01:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:37.625451925 +0000 UTC m=+4256.326113733" watchObservedRunningTime="2025-11-21 13:01:37.65197611 +0000 UTC m=+4256.352637918" Nov 21 13:01:37 crc kubenswrapper[4769]: I1121 13:01:37.662019 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.66199797 podStartE2EDuration="5.66199797s" podCreationTimestamp="2025-11-21 13:01:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:37.645168566 +0000 UTC m=+4256.345830384" watchObservedRunningTime="2025-11-21 13:01:37.66199797 +0000 UTC m=+4256.362659788" Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.244131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.354329 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.220:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.354349 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.220:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.629349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7995cfb3-14d8-4487-b7aa-a2582bc19c52","Type":"ContainerStarted","Data":"b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752"} Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.629650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7995cfb3-14d8-4487-b7aa-a2582bc19c52","Type":"ContainerStarted","Data":"76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c"} Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.633982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d853692a-149a-4845-9f5b-36b451683066","Type":"ContainerStarted","Data":"095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78"} Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.634471 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.636420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerStarted","Data":"445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6"} Nov 21 13:01:38 crc kubenswrapper[4769]: I1121 13:01:38.652381 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.652364372 podStartE2EDuration="2.652364372s" podCreationTimestamp="2025-11-21 13:01:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:38.647313656 +0000 UTC m=+4257.347975474" watchObservedRunningTime="2025-11-21 13:01:38.652364372 +0000 UTC m=+4257.353026190" Nov 21 13:01:39 crc kubenswrapper[4769]: I1121 13:01:39.649867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerStarted","Data":"3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3"} Nov 21 13:01:39 crc kubenswrapper[4769]: I1121 13:01:39.788496 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.178380 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.236360 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.215:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.375809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.469151 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf"] Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.470020 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api-log" containerID="cri-o://d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9" gracePeriod=30 Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.470690 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api" containerID="cri-o://39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d" gracePeriod=30 Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.610317 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.646684 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.661679 4769 generic.go:334] "Generic (PLEG): container finished" podID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerID="d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9" exitCode=143 Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.661744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" event={"ID":"acf6329b-cf5f-41e5-bf05-d4161a7c1115","Type":"ContainerDied","Data":"d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9"} Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.664391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerStarted","Data":"125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc"} Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.664585 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="cinder-scheduler" containerID="cri-o://f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c" gracePeriod=30 Nov 21 13:01:40 crc kubenswrapper[4769]: I1121 13:01:40.665316 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="probe" containerID="cri-o://c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1" gracePeriod=30 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.325330 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.325624 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.325664 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.326408 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"7da5fdce4fbae9f3b258b796977753d26bbb86ca1b6a9d778fdf42dd01683bfe"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.326464 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://7da5fdce4fbae9f3b258b796977753d26bbb86ca1b6a9d778fdf42dd01683bfe" gracePeriod=600 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.423011 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.680136 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="7da5fdce4fbae9f3b258b796977753d26bbb86ca1b6a9d778fdf42dd01683bfe" exitCode=0 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.680583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"7da5fdce4fbae9f3b258b796977753d26bbb86ca1b6a9d778fdf42dd01683bfe"} Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.680614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8"} Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.680635 4769 scope.go:117] "RemoveContainer" containerID="4555b82a7924bf2149ebc475cdd34ef304dfc8d61c04b6b56b5f3eee9a616a9d" Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.687311 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerID="c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1" exitCode=0 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.687381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e0ae5f4d-ce46-4306-84d7-b800ea504b34","Type":"ContainerDied","Data":"c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1"} Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.701347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerStarted","Data":"a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7"} Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.701704 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="proxy-httpd" containerID="cri-o://a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7" gracePeriod=30 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.701732 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="sg-core" containerID="cri-o://125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc" gracePeriod=30 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.701786 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-notification-agent" containerID="cri-o://3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3" gracePeriod=30 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.701900 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.701912 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-central-agent" containerID="cri-o://445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6" gracePeriod=30 Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.741351 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.850013863 podStartE2EDuration="5.741329805s" podCreationTimestamp="2025-11-21 13:01:36 +0000 UTC" firstStartedPulling="2025-11-21 13:01:37.359135943 +0000 UTC m=+4256.059797761" lastFinishedPulling="2025-11-21 13:01:41.250451885 +0000 UTC m=+4259.951113703" observedRunningTime="2025-11-21 13:01:41.734680155 +0000 UTC m=+4260.435341973" watchObservedRunningTime="2025-11-21 13:01:41.741329805 +0000 UTC m=+4260.441991623" Nov 21 13:01:41 crc kubenswrapper[4769]: I1121 13:01:41.788978 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.179408 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.200:9696/\": dial tcp 10.217.0.200:9696: connect: connection refused" Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.713302 4769 generic.go:334] "Generic (PLEG): container finished" podID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerID="a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7" exitCode=0 Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.722631 4769 generic.go:334] "Generic (PLEG): container finished" podID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerID="125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc" exitCode=2 Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.722668 4769 generic.go:334] "Generic (PLEG): container finished" podID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerID="3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3" exitCode=0 Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.713339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerDied","Data":"a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7"} Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.722804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerDied","Data":"125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc"} Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.722820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerDied","Data":"3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3"} Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.846314 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.922729 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:42 crc kubenswrapper[4769]: I1121 13:01:42.961401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.109274 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.109902 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-log" containerID="cri-o://157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585" gracePeriod=30 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.110601 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-api" containerID="cri-o://f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e" gracePeriod=30 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.122366 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.129022 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="f36efa69-0b27-49a4-9109-a09dfe6a68f1" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://c940edb7d176e873d94bc4b037a01135aa30338de7d0c1de39b270a899fcf6c7" gracePeriod=30 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.257692 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.258767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.345984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.364622 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv"] Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.364874 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-api" containerID="cri-o://7bef60add7b2824d9f607e5306c621eac4d7e7c48130292a5c29c88a5e08a7fa" gracePeriod=30 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.365415 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-httpd" containerID="cri-o://ffe644618260af24e558ade27a0ed29fae7f0c409a4b0d8a1a7b5ddf61f93f4d" gracePeriod=30 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.410889 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-77b48987cd-zvgbz"] Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.412581 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-config\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-combined-ca-bundle\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-internal-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-httpd-config\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-public-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-ovndb-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.430583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6kcr\" (UniqueName: \"kubernetes.io/projected/496a8880-f116-4e6b-b59a-ade8af828e74-kube-api-access-h6kcr\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.437468 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.466901 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.479320 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-77b48987cd-zvgbz"] Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.531742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-combined-ca-bundle\") pod \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.540694 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tbp7\" (UniqueName: \"kubernetes.io/projected/e0ae5f4d-ce46-4306-84d7-b800ea504b34-kube-api-access-2tbp7\") pod \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.540722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-scripts\") pod \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.540748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data\") pod \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.540770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e0ae5f4d-ce46-4306-84d7-b800ea504b34-etc-machine-id\") pod \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.540868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data-custom\") pod \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\" (UID: \"e0ae5f4d-ce46-4306-84d7-b800ea504b34\") " Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.541340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e0ae5f4d-ce46-4306-84d7-b800ea504b34-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e0ae5f4d-ce46-4306-84d7-b800ea504b34" (UID: "e0ae5f4d-ce46-4306-84d7-b800ea504b34"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.541890 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-public-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.541934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-ovndb-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.542131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6kcr\" (UniqueName: \"kubernetes.io/projected/496a8880-f116-4e6b-b59a-ade8af828e74-kube-api-access-h6kcr\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.542217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-config\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.542241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-combined-ca-bundle\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.542333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-internal-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.542383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-httpd-config\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.542446 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e0ae5f4d-ce46-4306-84d7-b800ea504b34-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.570670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-ovndb-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.576987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-internal-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.581526 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-combined-ca-bundle\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.584433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e0ae5f4d-ce46-4306-84d7-b800ea504b34" (UID: "e0ae5f4d-ce46-4306-84d7-b800ea504b34"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.584586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ae5f4d-ce46-4306-84d7-b800ea504b34-kube-api-access-2tbp7" (OuterVolumeSpecName: "kube-api-access-2tbp7") pod "e0ae5f4d-ce46-4306-84d7-b800ea504b34" (UID: "e0ae5f4d-ce46-4306-84d7-b800ea504b34"). InnerVolumeSpecName "kube-api-access-2tbp7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.584652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-scripts" (OuterVolumeSpecName: "scripts") pod "e0ae5f4d-ce46-4306-84d7-b800ea504b34" (UID: "e0ae5f4d-ce46-4306-84d7-b800ea504b34"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.585369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-config\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.585964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-public-tls-certs\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.586794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-httpd-config\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.607997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6kcr\" (UniqueName: \"kubernetes.io/projected/496a8880-f116-4e6b-b59a-ade8af828e74-kube-api-access-h6kcr\") pod \"neutron-77b48987cd-zvgbz\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.654498 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.654540 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2tbp7\" (UniqueName: \"kubernetes.io/projected/e0ae5f4d-ce46-4306-84d7-b800ea504b34-kube-api-access-2tbp7\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.654551 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.774410 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.795307 4769 generic.go:334] "Generic (PLEG): container finished" podID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerID="157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585" exitCode=143 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.795395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75add1bd-8dee-41f1-89a0-26510fee38b4","Type":"ContainerDied","Data":"157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585"} Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.800003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0ae5f4d-ce46-4306-84d7-b800ea504b34" (UID: "e0ae5f4d-ce46-4306-84d7-b800ea504b34"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.817631 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerID="f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c" exitCode=0 Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.818170 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.818542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e0ae5f4d-ce46-4306-84d7-b800ea504b34","Type":"ContainerDied","Data":"f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c"} Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.818571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e0ae5f4d-ce46-4306-84d7-b800ea504b34","Type":"ContainerDied","Data":"af0fd61a51da8b4b24d7f54cab037b32aae5bb7022bb57ea2806104b8b3f0535"} Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.818587 4769 scope.go:117] "RemoveContainer" containerID="c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.819008 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.819326 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.829463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data" (OuterVolumeSpecName: "config-data") pod "e0ae5f4d-ce46-4306-84d7-b800ea504b34" (UID: "e0ae5f4d-ce46-4306-84d7-b800ea504b34"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.847714 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.228:9696/\": read tcp 10.217.0.2:54036->10.217.0.228:9696: read: connection reset by peer" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.858584 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.858613 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ae5f4d-ce46-4306-84d7-b800ea504b34-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.889662 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod358b6f0c-4310-4a43-9b1b-090cdb219e42"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod358b6f0c-4310-4a43-9b1b-090cdb219e42] : Timed out while waiting for systemd to remove kubepods-besteffort-pod358b6f0c_4310_4a43_9b1b_090cdb219e42.slice" Nov 21 13:01:43 crc kubenswrapper[4769]: E1121 13:01:43.889881 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod358b6f0c-4310-4a43-9b1b-090cdb219e42] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod358b6f0c-4310-4a43-9b1b-090cdb219e42] : Timed out while waiting for systemd to remove kubepods-besteffort-pod358b6f0c_4310_4a43_9b1b_090cdb219e42.slice" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.913549 4769 scope.go:117] "RemoveContainer" containerID="f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.988346 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.152:9311/healthcheck\": read tcp 10.217.0.2:37648->10.217.0.152:9311: read: connection reset by peer" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.988351 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.152:9311/healthcheck\": read tcp 10.217.0.2:37664->10.217.0.152:9311: read: connection reset by peer" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.996383 4769 scope.go:117] "RemoveContainer" containerID="c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1" Nov 21 13:01:43 crc kubenswrapper[4769]: E1121 13:01:43.999366 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1\": container with ID starting with c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1 not found: ID does not exist" containerID="c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.999409 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1"} err="failed to get container status \"c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1\": rpc error: code = NotFound desc = could not find container \"c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1\": container with ID starting with c5ddbf0c7fd017b223c1299cfbc00437cd33cd20420b107be7dcd40f369470e1 not found: ID does not exist" Nov 21 13:01:43 crc kubenswrapper[4769]: I1121 13:01:43.999438 4769 scope.go:117] "RemoveContainer" containerID="f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c" Nov 21 13:01:44 crc kubenswrapper[4769]: E1121 13:01:43.999928 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c\": container with ID starting with f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c not found: ID does not exist" containerID="f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:43.999975 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c"} err="failed to get container status \"f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c\": rpc error: code = NotFound desc = could not find container \"f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c\": container with ID starting with f46c838da491af26b14826a6fecc2c490268eb698342947a8853a6d87df1033c not found: ID does not exist" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.214367 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.272658 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.291604 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:44 crc kubenswrapper[4769]: E1121 13:01:44.292708 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="probe" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.292812 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="probe" Nov 21 13:01:44 crc kubenswrapper[4769]: E1121 13:01:44.292895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="cinder-scheduler" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.292987 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="cinder-scheduler" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.293461 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="cinder-scheduler" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.293546 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" containerName="probe" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.295132 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.309392 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.322339 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.337382 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-77b48987cd-zvgbz"] Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.493567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-scripts\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.494462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtxb\" (UniqueName: \"kubernetes.io/projected/d4176877-d6cd-461d-9165-c3f65579b54f-kube-api-access-2xtxb\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.494552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.494593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4176877-d6cd-461d-9165-c3f65579b54f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.494644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.494675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.597431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-scripts\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.597779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtxb\" (UniqueName: \"kubernetes.io/projected/d4176877-d6cd-461d-9165-c3f65579b54f-kube-api-access-2xtxb\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.597821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.597852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4176877-d6cd-461d-9165-c3f65579b54f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.597889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.597911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.600347 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4176877-d6cd-461d-9165-c3f65579b54f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.600758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-scripts\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.601081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.604796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.606985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.618916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtxb\" (UniqueName: \"kubernetes.io/projected/d4176877-d6cd-461d-9165-c3f65579b54f-kube-api-access-2xtxb\") pod \"cinder-scheduler-0\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.690432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.783924 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.804088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-config-data\") pod \"75add1bd-8dee-41f1-89a0-26510fee38b4\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.804247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmh8n\" (UniqueName: \"kubernetes.io/projected/75add1bd-8dee-41f1-89a0-26510fee38b4-kube-api-access-hmh8n\") pod \"75add1bd-8dee-41f1-89a0-26510fee38b4\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.804353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75add1bd-8dee-41f1-89a0-26510fee38b4-logs\") pod \"75add1bd-8dee-41f1-89a0-26510fee38b4\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.804404 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-public-tls-certs\") pod \"75add1bd-8dee-41f1-89a0-26510fee38b4\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.804527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-internal-tls-certs\") pod \"75add1bd-8dee-41f1-89a0-26510fee38b4\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.804564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-combined-ca-bundle\") pod \"75add1bd-8dee-41f1-89a0-26510fee38b4\" (UID: \"75add1bd-8dee-41f1-89a0-26510fee38b4\") " Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.805161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75add1bd-8dee-41f1-89a0-26510fee38b4-logs" (OuterVolumeSpecName: "logs") pod "75add1bd-8dee-41f1-89a0-26510fee38b4" (UID: "75add1bd-8dee-41f1-89a0-26510fee38b4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.818934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75add1bd-8dee-41f1-89a0-26510fee38b4-kube-api-access-hmh8n" (OuterVolumeSpecName: "kube-api-access-hmh8n") pod "75add1bd-8dee-41f1-89a0-26510fee38b4" (UID: "75add1bd-8dee-41f1-89a0-26510fee38b4"). InnerVolumeSpecName "kube-api-access-hmh8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.874418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" event={"ID":"496a8880-f116-4e6b-b59a-ade8af828e74","Type":"ContainerStarted","Data":"2cc48925b7f80f7fbc48f701a4d462c22adeb3c63c0eb977a0e1b8b558faf121"} Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.874456 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.892762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-config-data" (OuterVolumeSpecName: "config-data") pod "75add1bd-8dee-41f1-89a0-26510fee38b4" (UID: "75add1bd-8dee-41f1-89a0-26510fee38b4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.897571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75add1bd-8dee-41f1-89a0-26510fee38b4" (UID: "75add1bd-8dee-41f1-89a0-26510fee38b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.914211 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.920384 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.920484 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.920510 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hmh8n\" (UniqueName: \"kubernetes.io/projected/75add1bd-8dee-41f1-89a0-26510fee38b4-kube-api-access-hmh8n\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.920533 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/75add1bd-8dee-41f1-89a0-26510fee38b4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.921720 4769 generic.go:334] "Generic (PLEG): container finished" podID="f36efa69-0b27-49a4-9109-a09dfe6a68f1" containerID="c940edb7d176e873d94bc4b037a01135aa30338de7d0c1de39b270a899fcf6c7" exitCode=0 Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.921914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f36efa69-0b27-49a4-9109-a09dfe6a68f1","Type":"ContainerDied","Data":"c940edb7d176e873d94bc4b037a01135aa30338de7d0c1de39b270a899fcf6c7"} Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.921946 4769 scope.go:117] "RemoveContainer" containerID="c940edb7d176e873d94bc4b037a01135aa30338de7d0c1de39b270a899fcf6c7" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.948704 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-548d54c446-vgqdr_e5f96b2f-5d0c-4fc9-bf04-574534677fec/neutron-api/0.log" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.948752 4769 generic.go:334] "Generic (PLEG): container finished" podID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerID="782e45113e125d9bcbbd6f234c532a25460bd4974f2220fab39c91945e29dcb3" exitCode=1 Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.948841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" event={"ID":"e5f96b2f-5d0c-4fc9-bf04-574534677fec","Type":"ContainerDied","Data":"782e45113e125d9bcbbd6f234c532a25460bd4974f2220fab39c91945e29dcb3"} Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.989154 4769 generic.go:334] "Generic (PLEG): container finished" podID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerID="f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e" exitCode=0 Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.989243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75add1bd-8dee-41f1-89a0-26510fee38b4","Type":"ContainerDied","Data":"f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e"} Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.989270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"75add1bd-8dee-41f1-89a0-26510fee38b4","Type":"ContainerDied","Data":"0296806317e177ea9a0781ed46693800fa4afed17e0b0d56943fc4c2291c99ea"} Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.989323 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.990401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "75add1bd-8dee-41f1-89a0-26510fee38b4" (UID: "75add1bd-8dee-41f1-89a0-26510fee38b4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:44 crc kubenswrapper[4769]: I1121 13:01:44.991699 4769 scope.go:117] "RemoveContainer" containerID="f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.005568 4769 generic.go:334] "Generic (PLEG): container finished" podID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerID="39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d" exitCode=0 Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.005682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" event={"ID":"acf6329b-cf5f-41e5-bf05-d4161a7c1115","Type":"ContainerDied","Data":"39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d"} Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.005708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" event={"ID":"acf6329b-cf5f-41e5-bf05-d4161a7c1115","Type":"ContainerDied","Data":"237593433a6151fb3207bb057d914841d64608f5f1c8af3967e8bf8b017c0b9b"} Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.005765 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-nova-novncproxy-tls-certs\") pod \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data-custom\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-combined-ca-bundle\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8s7j\" (UniqueName: \"kubernetes.io/projected/f36efa69-0b27-49a4-9109-a09dfe6a68f1-kube-api-access-p8s7j\") pod \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-vencrypt-tls-certs\") pod \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87xrv\" (UniqueName: \"kubernetes.io/projected/acf6329b-cf5f-41e5-bf05-d4161a7c1115-kube-api-access-87xrv\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-combined-ca-bundle\") pod \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-public-tls-certs\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022597 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-internal-tls-certs\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.022755 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "75add1bd-8dee-41f1-89a0-26510fee38b4" (UID: "75add1bd-8dee-41f1-89a0-26510fee38b4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.023374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-config-data\") pod \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\" (UID: \"f36efa69-0b27-49a4-9109-a09dfe6a68f1\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.023397 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/acf6329b-cf5f-41e5-bf05-d4161a7c1115-logs\") pod \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\" (UID: \"acf6329b-cf5f-41e5-bf05-d4161a7c1115\") " Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.026497 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.026598 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf6329b-cf5f-41e5-bf05-d4161a7c1115-kube-api-access-87xrv" (OuterVolumeSpecName: "kube-api-access-87xrv") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "kube-api-access-87xrv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.026521 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/75add1bd-8dee-41f1-89a0-26510fee38b4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.027639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf6329b-cf5f-41e5-bf05-d4161a7c1115-logs" (OuterVolumeSpecName: "logs") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.030040 4769 generic.go:334] "Generic (PLEG): container finished" podID="bdca1044-7937-42ab-af75-4060e6c949f1" containerID="ffe644618260af24e558ade27a0ed29fae7f0c409a4b0d8a1a7b5ddf61f93f4d" exitCode=0 Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.030156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" event={"ID":"bdca1044-7937-42ab-af75-4060e6c949f1","Type":"ContainerDied","Data":"ffe644618260af24e558ade27a0ed29fae7f0c409a4b0d8a1a7b5ddf61f93f4d"} Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.036666 4769 scope.go:117] "RemoveContainer" containerID="157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.057074 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.057219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f36efa69-0b27-49a4-9109-a09dfe6a68f1-kube-api-access-p8s7j" (OuterVolumeSpecName: "kube-api-access-p8s7j") pod "f36efa69-0b27-49a4-9109-a09dfe6a68f1" (UID: "f36efa69-0b27-49a4-9109-a09dfe6a68f1"). InnerVolumeSpecName "kube-api-access-p8s7j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.065498 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.130468 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/acf6329b-cf5f-41e5-bf05-d4161a7c1115-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.135135 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.135324 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p8s7j\" (UniqueName: \"kubernetes.io/projected/f36efa69-0b27-49a4-9109-a09dfe6a68f1-kube-api-access-p8s7j\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.135389 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-87xrv\" (UniqueName: \"kubernetes.io/projected/acf6329b-cf5f-41e5-bf05-d4161a7c1115-kube-api-access-87xrv\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.151201 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.179954 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.199289 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.199723 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api-log" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.199735 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api-log" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.199745 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f36efa69-0b27-49a4-9109-a09dfe6a68f1" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.199753 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f36efa69-0b27-49a4-9109-a09dfe6a68f1" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.199772 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.199779 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.199790 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.199797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-api" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.199840 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-log" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.199848 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-log" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.200041 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f36efa69-0b27-49a4-9109-a09dfe6a68f1" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.200056 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.200068 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api-log" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.200098 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" containerName="barbican-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.200110 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" containerName="nova-api-log" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.201162 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.210833 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.211025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-k78dv" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.211134 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.211271 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.223703 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.237742 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.239801 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.283296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.283361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-config-data" (OuterVolumeSpecName: "config-data") pod "f36efa69-0b27-49a4-9109-a09dfe6a68f1" (UID: "f36efa69-0b27-49a4-9109-a09dfe6a68f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.283518 4769 scope.go:117] "RemoveContainer" containerID="f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.283973 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e\": container with ID starting with f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e not found: ID does not exist" containerID="f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.284006 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e"} err="failed to get container status \"f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e\": rpc error: code = NotFound desc = could not find container \"f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e\": container with ID starting with f33cb2afd774d123df7fc539a5066baed995dc1f2b706eaf38c892a70a86297e not found: ID does not exist" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.284028 4769 scope.go:117] "RemoveContainer" containerID="157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.284690 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585\": container with ID starting with 157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585 not found: ID does not exist" containerID="157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.284711 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585"} err="failed to get container status \"157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585\": rpc error: code = NotFound desc = could not find container \"157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585\": container with ID starting with 157eeaabc2baf3dfa22fda4d23dcda906aacda21f686e45ce504fedf98cb2585 not found: ID does not exist" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.284727 4769 scope.go:117] "RemoveContainer" containerID="39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.282111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f36efa69-0b27-49a4-9109-a09dfe6a68f1" (UID: "f36efa69-0b27-49a4-9109-a09dfe6a68f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.321828 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358b6f0c-4310-4a43-9b1b-090cdb219e42" path="/var/lib/kubelet/pods/358b6f0c-4310-4a43-9b1b-090cdb219e42/volumes" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.333330 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ae5f4d-ce46-4306-84d7-b800ea504b34" path="/var/lib/kubelet/pods/e0ae5f4d-ce46-4306-84d7-b800ea504b34/volumes" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.335961 4769 scope.go:117] "RemoveContainer" containerID="d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.342894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.342928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-combined-ca-bundle\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.342956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data-custom\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.342974 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.342996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.343015 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.343040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.343072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.343087 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-public-tls-certs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.343108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-internal-tls-certs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.343162 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6788b7d4-ead9-4e17-8f26-b23369e1332b-logs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.344835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz2hh\" (UniqueName: \"kubernetes.io/projected/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-kube-api-access-mz2hh\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.344864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.344882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77zlg\" (UniqueName: \"kubernetes.io/projected/6788b7d4-ead9-4e17-8f26-b23369e1332b-kube-api-access-77zlg\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.345085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-config\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.345330 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.345343 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.345353 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.383357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.429892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data" (OuterVolumeSpecName: "config-data") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-config\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-combined-ca-bundle\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data-custom\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.448958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-public-tls-certs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-internal-tls-certs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6788b7d4-ead9-4e17-8f26-b23369e1332b-logs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mz2hh\" (UniqueName: \"kubernetes.io/projected/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-kube-api-access-mz2hh\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-77zlg\" (UniqueName: \"kubernetes.io/projected/6788b7d4-ead9-4e17-8f26-b23369e1332b-kube-api-access-77zlg\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.449814 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.461252 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.452443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6788b7d4-ead9-4e17-8f26-b23369e1332b-logs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.459972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-combined-ca-bundle\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.460447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "f36efa69-0b27-49a4-9109-a09dfe6a68f1" (UID: "f36efa69-0b27-49a4-9109-a09dfe6a68f1"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.460768 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.462494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.461067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.461300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.450383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-config\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.460981 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-internal-tls-certs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.480966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.489878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.489878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data-custom\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.490464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-77zlg\" (UniqueName: \"kubernetes.io/projected/6788b7d4-ead9-4e17-8f26-b23369e1332b-kube-api-access-77zlg\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.492272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz2hh\" (UniqueName: \"kubernetes.io/projected/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-kube-api-access-mz2hh\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.504646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-public-tls-certs\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.506132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data\") pod \"barbican-api-7799b4b44-d9rn5\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.565710 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.572874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "f36efa69-0b27-49a4-9109-a09dfe6a68f1" (UID: "f36efa69-0b27-49a4-9109-a09dfe6a68f1"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.597328 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "acf6329b-cf5f-41e5-bf05-d4161a7c1115" (UID: "acf6329b-cf5f-41e5-bf05-d4161a7c1115"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.604865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.668522 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6329b-cf5f-41e5-bf05-d4161a7c1115-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.668565 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/f36efa69-0b27-49a4-9109-a09dfe6a68f1-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.673712 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.673789 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.673812 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.708365 4769 scope.go:117] "RemoveContainer" containerID="39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.715505 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d\": container with ID starting with 39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d not found: ID does not exist" containerID="39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.715566 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d"} err="failed to get container status \"39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d\": rpc error: code = NotFound desc = could not find container \"39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d\": container with ID starting with 39567fd1f66281c502d92dfddc3217a10e4870ea7945bb40aa7b74a8a1423c9d not found: ID does not exist" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.715593 4769 scope.go:117] "RemoveContainer" containerID="d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.716012 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9\": container with ID starting with d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9 not found: ID does not exist" containerID="d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.716033 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9"} err="failed to get container status \"d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9\": rpc error: code = NotFound desc = could not find container \"d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9\": container with ID starting with d3c4f0eacf7105789012d7dea2bc89fd370c8ce41a9f814e6b3fddb2db45abe9 not found: ID does not exist" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.721442 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.731541 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.817336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chmr\" (UniqueName: \"kubernetes.io/projected/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-kube-api-access-2chmr\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-logs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-internal-tls-certs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-public-tls-certs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-combined-ca-bundle\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.819644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data-custom\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.824260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.832355 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-548d54c446-vgqdr_e5f96b2f-5d0c-4fc9-bf04-574534677fec/neutron-api/0.log" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.832879 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.861408 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.879035 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f7fb79d5d-bjwdf"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.896988 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.900179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.914977 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.923685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-logs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.923797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-internal-tls-certs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.923931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-public-tls-certs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.924056 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-combined-ca-bundle\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.924132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.924343 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data-custom\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.924565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2chmr\" (UniqueName: \"kubernetes.io/projected/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-kube-api-access-2chmr\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.929959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-logs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.937415 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.937894 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-httpd" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.937907 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-httpd" Nov 21 13:01:45 crc kubenswrapper[4769]: E1121 13:01:45.937941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.937948 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.938154 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-httpd" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.938169 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" containerName="neutron-api" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.939162 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.942513 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.943649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-combined-ca-bundle\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.945942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-internal-tls-certs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.945978 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.946166 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.954643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data-custom\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.955662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-public-tls-certs\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.955767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:45 crc kubenswrapper[4769]: I1121 13:01:45.968943 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chmr\" (UniqueName: \"kubernetes.io/projected/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-kube-api-access-2chmr\") pod \"barbican-api-7b865965cb-xpfpr\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.000689 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hshrb\" (UniqueName: \"kubernetes.io/projected/e5f96b2f-5d0c-4fc9-bf04-574534677fec-kube-api-access-hshrb\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-combined-ca-bundle\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-ovndb-tls-certs\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-config\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-internal-tls-certs\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026673 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-httpd-config\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026709 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-public-tls-certs\") pod \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\" (UID: \"e5f96b2f-5d0c-4fc9-bf04-574534677fec\") " Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-public-tls-certs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l72gr\" (UniqueName: \"kubernetes.io/projected/b824f9ca-bdca-4673-939a-9bf4e3846140-kube-api-access-l72gr\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b824f9ca-bdca-4673-939a-9bf4e3846140-logs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.026981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-config-data\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.027042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.043559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:46 crc kubenswrapper[4769]: I1121 13:01:46.076482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f96b2f-5d0c-4fc9-bf04-574534677fec-kube-api-access-hshrb" (OuterVolumeSpecName: "kube-api-access-hshrb") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "kube-api-access-hshrb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.114912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" event={"ID":"496a8880-f116-4e6b-b59a-ade8af828e74","Type":"ContainerStarted","Data":"5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef"} Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.114978 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" event={"ID":"496a8880-f116-4e6b-b59a-ade8af828e74","Type":"ContainerStarted","Data":"70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20"} Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.115026 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.131793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-config-data\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-public-tls-certs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132375 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l72gr\" (UniqueName: \"kubernetes.io/projected/b824f9ca-bdca-4673-939a-9bf4e3846140-kube-api-access-l72gr\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b824f9ca-bdca-4673-939a-9bf4e3846140-logs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132606 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hshrb\" (UniqueName: \"kubernetes.io/projected/e5f96b2f-5d0c-4fc9-bf04-574534677fec-kube-api-access-hshrb\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.132618 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.136561 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b824f9ca-bdca-4673-939a-9bf4e3846140-logs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.150737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"f36efa69-0b27-49a4-9109-a09dfe6a68f1","Type":"ContainerDied","Data":"46737894b1231ae82f2fb2523e53f69343d7863cb87a1264ec511a2ab1e4c2f5"} Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.150837 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.154933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-public-tls-certs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.155893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.163502 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.181781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-internal-tls-certs\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: E1121 13:01:46.181857 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/45f7f7c2c88e3c3539b1146336fac9ab959d2c0916d23d4aeba9d0f7f3f39441/diff" to get inode usage: stat /var/lib/containers/storage/overlay/45f7f7c2c88e3c3539b1146336fac9ab959d2c0916d23d4aeba9d0f7f3f39441/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-api-f7fb79d5d-bjwdf_acf6329b-cf5f-41e5-bf05-d4161a7c1115/barbican-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-api-f7fb79d5d-bjwdf_acf6329b-cf5f-41e5-bf05-d4161a7c1115/barbican-api/0.log: no such file or directory Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.188590 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-548d54c446-vgqdr_e5f96b2f-5d0c-4fc9-bf04-574534677fec/neutron-api/0.log" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.188650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" event={"ID":"e5f96b2f-5d0c-4fc9-bf04-574534677fec","Type":"ContainerDied","Data":"bbff853c420bfd7298bea7cb6253a943ca8c034f8792980d5859ef69091d86c3"} Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.188683 4769 scope.go:117] "RemoveContainer" containerID="25f655eaa92541082059d40d76acd14ee48aa601c9f514e6fad079f6985ed66f" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.188786 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-548d54c446-vgqdr" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.221416 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" podStartSLOduration=3.221395423 podStartE2EDuration="3.221395423s" podCreationTimestamp="2025-11-21 13:01:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:46.147553454 +0000 UTC m=+4264.848215282" watchObservedRunningTime="2025-11-21 13:01:46.221395423 +0000 UTC m=+4264.922057241" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.223316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.224013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-config-data\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.228506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4176877-d6cd-461d-9165-c3f65579b54f","Type":"ContainerStarted","Data":"6540e86d91b1f376bc91897fedea0eddfeeb5b36d0ee68d2067bbe668cece1db"} Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.230768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l72gr\" (UniqueName: \"kubernetes.io/projected/b824f9ca-bdca-4673-939a-9bf4e3846140-kube-api-access-l72gr\") pod \"nova-api-0\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.245005 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.248144 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.248156 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.258244 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.259682 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.263787 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.263911 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.264064 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.280674 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.294726 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.344426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.344546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.345632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.345666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gbp\" (UniqueName: \"kubernetes.io/projected/ba949ad8-33f8-406b-990b-d2038698556d-kube-api-access-x7gbp\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.347177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.385251 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.422363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.422396 4769 scope.go:117] "RemoveContainer" containerID="782e45113e125d9bcbbd6f234c532a25460bd4974f2220fab39c91945e29dcb3" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.425669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-config" (OuterVolumeSpecName: "config") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.461532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.461618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.461654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gbp\" (UniqueName: \"kubernetes.io/projected/ba949ad8-33f8-406b-990b-d2038698556d-kube-api-access-x7gbp\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.461743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.462254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.463104 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.464852 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.465731 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.465746 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.497559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.497739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.500805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gbp\" (UniqueName: \"kubernetes.io/projected/ba949ad8-33f8-406b-990b-d2038698556d-kube-api-access-x7gbp\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.501157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.501403 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.550348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.556332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "e5f96b2f-5d0c-4fc9-bf04-574534677fec" (UID: "e5f96b2f-5d0c-4fc9-bf04-574534677fec"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.567600 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.567628 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f96b2f-5d0c-4fc9-bf04-574534677fec-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.624701 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.879995 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-548d54c446-vgqdr"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:46.895488 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-548d54c446-vgqdr"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.333954 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75add1bd-8dee-41f1-89a0-26510fee38b4" path="/var/lib/kubelet/pods/75add1bd-8dee-41f1-89a0-26510fee38b4/volumes" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.335118 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf6329b-cf5f-41e5-bf05-d4161a7c1115" path="/var/lib/kubelet/pods/acf6329b-cf5f-41e5-bf05-d4161a7c1115/volumes" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.335769 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f96b2f-5d0c-4fc9-bf04-574534677fec" path="/var/lib/kubelet/pods/e5f96b2f-5d0c-4fc9-bf04-574534677fec/volumes" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.342990 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f36efa69-0b27-49a4-9109-a09dfe6a68f1" path="/var/lib/kubelet/pods/f36efa69-0b27-49a4-9109-a09dfe6a68f1/volumes" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.344845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.352441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4176877-d6cd-461d-9165-c3f65579b54f","Type":"ContainerStarted","Data":"ac2cb2f2c5096316953ace0d17c575b39a8d88d06d2ade9108f9c62ce7750e39"} Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.352500 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.745722 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.750366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.891450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.912154 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.935853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:47 crc kubenswrapper[4769]: I1121 13:01:47.980949 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr"] Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.119122 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.333906 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.369490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" event={"ID":"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b","Type":"ContainerStarted","Data":"94743a7e85e15f2d8bde9c3c6d711b8fd038807ec22190e2b88b7cb336c3c565"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.381674 4769 generic.go:334] "Generic (PLEG): container finished" podID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerID="445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6" exitCode=0 Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.381754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerDied","Data":"445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.381824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c38788ea-0eb8-4e69-927c-c0f01dd339e2","Type":"ContainerDied","Data":"248f4e5e8b5affb5898d9da422db89293c559718e1679f02d5d31c1f464c2363"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.381844 4769 scope.go:117] "RemoveContainer" containerID="a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.382477 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.389089 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" event={"ID":"6788b7d4-ead9-4e17-8f26-b23369e1332b","Type":"ContainerStarted","Data":"7a21b002362952b6536084ca50d36a886040e3a77ff41eb0c74c93bee117aa18"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.389144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" event={"ID":"6788b7d4-ead9-4e17-8f26-b23369e1332b","Type":"ContainerStarted","Data":"9bde13eac9abb561deb742c29244f2626d42dcf10c0cffa06e45eea0797dbc74"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.390562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ba949ad8-33f8-406b-990b-d2038698556d","Type":"ContainerStarted","Data":"3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.390584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ba949ad8-33f8-406b-990b-d2038698556d","Type":"ContainerStarted","Data":"8d3215e7032e7b488f8503cb0ea3a87c8e3cf4a60fc363ce177d98a58395fb62"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.396309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b824f9ca-bdca-4673-939a-9bf4e3846140","Type":"ContainerStarted","Data":"130465e96aaf25dfe6599c50e77a5c45f49f9013ac0c94c1d5aee250a1240fce"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.396350 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b824f9ca-bdca-4673-939a-9bf4e3846140","Type":"ContainerStarted","Data":"e3c8d845e21204eeae1c5c7d13e72c6a9a6a58a2f5047c1ce52cc9e1cef48b92"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.398470 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1","Type":"ContainerStarted","Data":"52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.398496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1","Type":"ContainerStarted","Data":"af2bd30412ec9611d5a4c0bd8ae9ece60ec279fb657992a020baf998615281d6"} Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.415041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-combined-ca-bundle\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.415229 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-run-httpd\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.415256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-sg-core-conf-yaml\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.415816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-config-data\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.415945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-ceilometer-tls-certs\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.415975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sdcr\" (UniqueName: \"kubernetes.io/projected/c38788ea-0eb8-4e69-927c-c0f01dd339e2-kube-api-access-8sdcr\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.416065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-log-httpd\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.416115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-scripts\") pod \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\" (UID: \"c38788ea-0eb8-4e69-927c-c0f01dd339e2\") " Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.417982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.419135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.437975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-scripts" (OuterVolumeSpecName: "scripts") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.452587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c38788ea-0eb8-4e69-927c-c0f01dd339e2-kube-api-access-8sdcr" (OuterVolumeSpecName: "kube-api-access-8sdcr") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "kube-api-access-8sdcr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.463026 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb1510c24-a296-4443-b9a6-237c100402a1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb1510c24-a296-4443-b9a6-237c100402a1] : Timed out while waiting for systemd to remove kubepods-besteffort-podb1510c24_a296_4443_b9a6_237c100402a1.slice" Nov 21 13:01:48 crc kubenswrapper[4769]: E1121 13:01:48.463077 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podb1510c24-a296-4443-b9a6-237c100402a1] : unable to destroy cgroup paths for cgroup [kubepods besteffort podb1510c24-a296-4443-b9a6-237c100402a1] : Timed out while waiting for systemd to remove kubepods-besteffort-podb1510c24_a296_4443_b9a6_237c100402a1.slice" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b1510c24-a296-4443-b9a6-237c100402a1" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.520197 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.520220 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8sdcr\" (UniqueName: \"kubernetes.io/projected/c38788ea-0eb8-4e69-927c-c0f01dd339e2-kube-api-access-8sdcr\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.520336 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c38788ea-0eb8-4e69-927c-c0f01dd339e2-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.520345 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.595535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.621863 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.642312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.672245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.689399 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb19a9c0b-0847-4a51-a267-5ad85f4fa9f6"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb19a9c0b-0847-4a51-a267-5ad85f4fa9f6] : Timed out while waiting for systemd to remove kubepods-besteffort-podb19a9c0b_0847_4a51_a267_5ad85f4fa9f6.slice" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.714360 4769 scope.go:117] "RemoveContainer" containerID="125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.726561 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.726595 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.750567 4769 scope.go:117] "RemoveContainer" containerID="3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.787398 4769 scope.go:117] "RemoveContainer" containerID="445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.905860 4769 scope.go:117] "RemoveContainer" containerID="a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7" Nov 21 13:01:48 crc kubenswrapper[4769]: E1121 13:01:48.906169 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7\": container with ID starting with a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7 not found: ID does not exist" containerID="a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.906223 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7"} err="failed to get container status \"a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7\": rpc error: code = NotFound desc = could not find container \"a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7\": container with ID starting with a8bfb4865043fef388fadbda45c324b128e59ea96750e29b4d2648666baf10a7 not found: ID does not exist" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.906245 4769 scope.go:117] "RemoveContainer" containerID="125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc" Nov 21 13:01:48 crc kubenswrapper[4769]: E1121 13:01:48.906482 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc\": container with ID starting with 125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc not found: ID does not exist" containerID="125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.906504 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc"} err="failed to get container status \"125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc\": rpc error: code = NotFound desc = could not find container \"125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc\": container with ID starting with 125a5d7021a20693cb4921cf7cca8e12ef3f9b38c8fc4cd8059ac56d9d7fd9bc not found: ID does not exist" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.906538 4769 scope.go:117] "RemoveContainer" containerID="3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3" Nov 21 13:01:48 crc kubenswrapper[4769]: E1121 13:01:48.906739 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3\": container with ID starting with 3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3 not found: ID does not exist" containerID="3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.906780 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3"} err="failed to get container status \"3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3\": rpc error: code = NotFound desc = could not find container \"3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3\": container with ID starting with 3cebfbf767e8e2f6c7241008afaa65024c6f86ab9faa52b3251b217cfd2727e3 not found: ID does not exist" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.906795 4769 scope.go:117] "RemoveContainer" containerID="445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6" Nov 21 13:01:48 crc kubenswrapper[4769]: E1121 13:01:48.906995 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6\": container with ID starting with 445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6 not found: ID does not exist" containerID="445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6" Nov 21 13:01:48 crc kubenswrapper[4769]: I1121 13:01:48.907015 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6"} err="failed to get container status \"445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6\": rpc error: code = NotFound desc = could not find container \"445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6\": container with ID starting with 445840a1cf93a930e791dfc60c846dde652b6446e8728941402ed4bef35851a6 not found: ID does not exist" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.048772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-config-data" (OuterVolumeSpecName: "config-data") pod "c38788ea-0eb8-4e69-927c-c0f01dd339e2" (UID: "c38788ea-0eb8-4e69-927c-c0f01dd339e2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.132886 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c38788ea-0eb8-4e69-927c-c0f01dd339e2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.318289 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.318275019 podStartE2EDuration="3.318275019s" podCreationTimestamp="2025-11-21 13:01:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:48.412911846 +0000 UTC m=+4267.113573664" watchObservedRunningTime="2025-11-21 13:01:49.318275019 +0000 UTC m=+4268.018936837" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.322287 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.339426 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.382724 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: E1121 13:01:49.383167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="proxy-httpd" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383183 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="proxy-httpd" Nov 21 13:01:49 crc kubenswrapper[4769]: E1121 13:01:49.383227 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-central-agent" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383234 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-central-agent" Nov 21 13:01:49 crc kubenswrapper[4769]: E1121 13:01:49.383244 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="sg-core" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383250 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="sg-core" Nov 21 13:01:49 crc kubenswrapper[4769]: E1121 13:01:49.383263 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-notification-agent" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383283 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-notification-agent" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383464 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="sg-core" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383481 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="proxy-httpd" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383502 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-central-agent" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.383514 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" containerName="ceilometer-notification-agent" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.385416 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.406148 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.406386 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.407755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.411177 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.431773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b824f9ca-bdca-4673-939a-9bf4e3846140","Type":"ContainerStarted","Data":"882bd9b382d4b56ecc2b1ba9508f4579099c555cd9c308acd2c708e63e237d1b"} Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.437421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1","Type":"ContainerStarted","Data":"afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa"} Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.442701 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wrqw\" (UniqueName: \"kubernetes.io/projected/94e6440b-ad01-43d0-be1b-aed47b440656-kube-api-access-9wrqw\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.442758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.442795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-log-httpd\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.442870 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-config-data\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.442900 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-run-httpd\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.442942 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.443009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.443072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-scripts\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.450865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" event={"ID":"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b","Type":"ContainerStarted","Data":"cd23d0bbe0b15d7111fd1bbd2fae548337dbf4503db5e22999ab07463ee507e5"} Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.450910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" event={"ID":"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b","Type":"ContainerStarted","Data":"b2c18272f1827009a30ad1293ce54279df006ccb9d1dcbf1e125ec9efe5d804a"} Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.451149 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.452314 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.461116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4176877-d6cd-461d-9165-c3f65579b54f","Type":"ContainerStarted","Data":"e70eee6b79eed9a80ae259c0914e64f7e3e75f1da47eec8813211d66e1ce35d5"} Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.474093 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api-log" containerID="cri-o://7a21b002362952b6536084ca50d36a886040e3a77ff41eb0c74c93bee117aa18" gracePeriod=30 Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.474309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" event={"ID":"6788b7d4-ead9-4e17-8f26-b23369e1332b","Type":"ContainerStarted","Data":"ba6f1b25c33ec2cc518581742d2779899bdef16d4eeffa133336c77d062a52cd"} Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.474780 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.475339 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.475359 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.475390 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api" containerID="cri-o://ba6f1b25c33ec2cc518581742d2779899bdef16d4eeffa133336c77d062a52cd" gracePeriod=30 Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.477716 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.477708183 podStartE2EDuration="4.477708183s" podCreationTimestamp="2025-11-21 13:01:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:49.475983787 +0000 UTC m=+4268.176645605" watchObservedRunningTime="2025-11-21 13:01:49.477708183 +0000 UTC m=+4268.178370001" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.523496 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=4.523480306 podStartE2EDuration="4.523480306s" podCreationTimestamp="2025-11-21 13:01:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:49.515862761 +0000 UTC m=+4268.216524579" watchObservedRunningTime="2025-11-21 13:01:49.523480306 +0000 UTC m=+4268.224142124" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-scripts\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrqw\" (UniqueName: \"kubernetes.io/projected/94e6440b-ad01-43d0-be1b-aed47b440656-kube-api-access-9wrqw\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-log-httpd\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-config-data\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-run-httpd\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.561976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.562059 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.565238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-run-httpd\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.568021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-log-httpd\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.583285 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.583268316 podStartE2EDuration="5.583268316s" podCreationTimestamp="2025-11-21 13:01:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:49.558741065 +0000 UTC m=+4268.259402883" watchObservedRunningTime="2025-11-21 13:01:49.583268316 +0000 UTC m=+4268.283930134" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.590672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-scripts\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.597586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-config-data\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.597152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.599567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.600920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.612851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wrqw\" (UniqueName: \"kubernetes.io/projected/94e6440b-ad01-43d0-be1b-aed47b440656-kube-api-access-9wrqw\") pod \"ceilometer-0\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.621331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.636889 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.666615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-logs\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.666671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data-custom\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.666771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.666815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-combined-ca-bundle\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.666858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjjhv\" (UniqueName: \"kubernetes.io/projected/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-kube-api-access-fjjhv\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.673336 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.673546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="44c2164d-04ed-4bc7-a71f-e54cc74d7d32" containerName="memcached" containerID="cri-o://9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5" gracePeriod=30 Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.697054 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.705146 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" podStartSLOduration=4.705126858 podStartE2EDuration="4.705126858s" podCreationTimestamp="2025-11-21 13:01:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:49.61202383 +0000 UTC m=+4268.312685648" watchObservedRunningTime="2025-11-21 13:01:49.705126858 +0000 UTC m=+4268.405788676" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.735231 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod9f4bc5d5-860a-4468-b80f-9123698c878a"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod9f4bc5d5-860a-4468-b80f-9123698c878a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod9f4bc5d5_860a_4468_b80f_9123698c878a.slice" Nov 21 13:01:49 crc kubenswrapper[4769]: E1121 13:01:49.735282 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod9f4bc5d5-860a-4468-b80f-9123698c878a] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod9f4bc5d5-860a-4468-b80f-9123698c878a] : Timed out while waiting for systemd to remove kubepods-besteffort-pod9f4bc5d5_860a_4468_b80f_9123698c878a.slice" pod="openstack-kuttl-tests/nova-metadata-0" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.747402 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.749224 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768073 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-logs\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data-custom\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-combined-ca-bundle\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-combined-ca-bundle\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data-custom\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fjjhv\" (UniqueName: \"kubernetes.io/projected/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-kube-api-access-fjjhv\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-logs\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fr7p\" (UniqueName: \"kubernetes.io/projected/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-kube-api-access-4fr7p\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.768802 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-logs\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.777581 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.778182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.779915 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" podStartSLOduration=4.779896762 podStartE2EDuration="4.779896762s" podCreationTimestamp="2025-11-21 13:01:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:49.67364201 +0000 UTC m=+4268.374303828" watchObservedRunningTime="2025-11-21 13:01:49.779896762 +0000 UTC m=+4268.480558580" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.788500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-combined-ca-bundle\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.788586 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.795150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.795237 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod80493384-e023-40a6-bac4-16a270ce4876"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod80493384-e023-40a6-bac4-16a270ce4876] : Timed out while waiting for systemd to remove kubepods-besteffort-pod80493384_e023_40a6_bac4_16a270ce4876.slice" Nov 21 13:01:49 crc kubenswrapper[4769]: E1121 13:01:49.795266 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod80493384-e023-40a6-bac4-16a270ce4876] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod80493384-e023-40a6-bac4-16a270ce4876] : Timed out while waiting for systemd to remove kubepods-besteffort-pod80493384_e023_40a6_bac4_16a270ce4876.slice" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="80493384-e023-40a6-bac4-16a270ce4876" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.799815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data-custom\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.812928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjjhv\" (UniqueName: \"kubernetes.io/projected/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-kube-api-access-fjjhv\") pod \"barbican-worker-c765b8f79-7w4vh\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.847663 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.847946 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api-log" containerID="cri-o://b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75" gracePeriod=30 Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.848070 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" containerID="cri-o://64953335061db058d8b5b7da6ce6f1df4249d55f50d09d06a5a5f56ae42c523a" gracePeriod=30 Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.869125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data-custom\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.869227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-logs\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.869261 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4fr7p\" (UniqueName: \"kubernetes.io/projected/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-kube-api-access-4fr7p\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.869278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.869319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-combined-ca-bundle\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.874508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-logs\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.874625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-combined-ca-bundle\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.880694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.883047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data-custom\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.927771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fr7p\" (UniqueName: \"kubernetes.io/projected/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-kube-api-access-4fr7p\") pod \"barbican-keystone-listener-6bd66c966b-rbblf\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.957506 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.961353 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.230:8776/healthcheck\": EOF" Nov 21 13:01:49 crc kubenswrapper[4769]: I1121 13:01:49.997118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.013639 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.018271 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.055256 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.056277 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="openstack-network-exporter" containerID="cri-o://b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752" gracePeriod=300 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.060236 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.061953 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.067295 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.067439 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.115310 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.169702 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181157 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6pn\" (UniqueName: \"kubernetes.io/projected/b581db1b-0a9b-4010-81d8-5cc9563d71a3-kube-api-access-rk6pn\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181213 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-scripts\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-config-data\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.181628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-logs\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.192829 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.193052 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-log" containerID="cri-o://18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.193497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-httpd" containerID="cri-o://43037d63719c54f059d0bbbce7005e49220a7a30b477272d7e72153c16868ca2" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.226261 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.238338 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7cff5df8b-24kk2"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.238587 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-log" containerID="cri-o://ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.239041 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-api" containerID="cri-o://c4b3623ca74fdc895adcd4776d2cae1037057822d2d7f94d5bb1675e8a71d160" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.283569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.283796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-scripts\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.283862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.283886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-config-data\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.283918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-logs\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.283967 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.284010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.284026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6pn\" (UniqueName: \"kubernetes.io/projected/b581db1b-0a9b-4010-81d8-5cc9563d71a3-kube-api-access-rk6pn\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.294602 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.296532 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.299662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.303008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-logs\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.315506 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="ovsdbserver-nb" containerID="cri-o://76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c" gracePeriod=300 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.315793 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.226:8778/\": EOF" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.316060 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.226:8778/\": EOF" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.324403 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.365265 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6746c44b58-657qd"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.367181 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.378840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.382062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.382563 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-scripts\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.382643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-config-data\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.382834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.383433 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6pn\" (UniqueName: \"kubernetes.io/projected/b581db1b-0a9b-4010-81d8-5cc9563d71a3-kube-api-access-rk6pn\") pod \"glance-default-external-api-0\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.392426 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.392702 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.397315 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.446927 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6746c44b58-657qd"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-internal-tls-certs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-public-tls-certs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-scripts\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490535 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjht\" (UniqueName: \"kubernetes.io/projected/2e62f83c-f27a-469a-bc38-0f20b3db209a-kube-api-access-hcjht\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c2mz\" (UniqueName: \"kubernetes.io/projected/88f54396-564d-48eb-a4c9-8b56b3a30a86-kube-api-access-9c2mz\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-public-tls-certs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490657 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-combined-ca-bundle\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-internal-tls-certs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88f54396-564d-48eb-a4c9-8b56b3a30a86-logs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-combined-ca-bundle\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-config-data\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e62f83c-f27a-469a-bc38-0f20b3db209a-logs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.490992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data-custom\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.519301 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7995cfb3-14d8-4487-b7aa-a2582bc19c52/ovsdbserver-nb/0.log" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.519347 4769 generic.go:334] "Generic (PLEG): container finished" podID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerID="b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752" exitCode=2 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.519365 4769 generic.go:334] "Generic (PLEG): container finished" podID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerID="76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c" exitCode=143 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.519445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7995cfb3-14d8-4487-b7aa-a2582bc19c52","Type":"ContainerDied","Data":"b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752"} Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.519471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7995cfb3-14d8-4487-b7aa-a2582bc19c52","Type":"ContainerDied","Data":"76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c"} Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.543539 4769 generic.go:334] "Generic (PLEG): container finished" podID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerID="18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1" exitCode=143 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.543628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b31d6545-ddad-4fcf-b60d-47be899c6768","Type":"ContainerDied","Data":"18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1"} Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.548340 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.572562 4769 generic.go:334] "Generic (PLEG): container finished" podID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerID="b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75" exitCode=143 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.572637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2129199a-a7af-4a97-8205-8276aa63e2b2","Type":"ContainerDied","Data":"b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75"} Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data-custom\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-internal-tls-certs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-public-tls-certs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-scripts\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjht\" (UniqueName: \"kubernetes.io/projected/2e62f83c-f27a-469a-bc38-0f20b3db209a-kube-api-access-hcjht\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9c2mz\" (UniqueName: \"kubernetes.io/projected/88f54396-564d-48eb-a4c9-8b56b3a30a86-kube-api-access-9c2mz\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595576 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-public-tls-certs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-combined-ca-bundle\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-internal-tls-certs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88f54396-564d-48eb-a4c9-8b56b3a30a86-logs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595770 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-combined-ca-bundle\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-config-data\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e62f83c-f27a-469a-bc38-0f20b3db209a-logs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.595876 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.603888 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.614419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88f54396-564d-48eb-a4c9-8b56b3a30a86-logs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.617793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e62f83c-f27a-469a-bc38-0f20b3db209a-logs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.619699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-combined-ca-bundle\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.624446 4769 generic.go:334] "Generic (PLEG): container finished" podID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerID="7a21b002362952b6536084ca50d36a886040e3a77ff41eb0c74c93bee117aa18" exitCode=143 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.625869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" event={"ID":"6788b7d4-ead9-4e17-8f26-b23369e1332b","Type":"ContainerDied","Data":"7a21b002362952b6536084ca50d36a886040e3a77ff41eb0c74c93bee117aa18"} Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.625940 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.627779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-internal-tls-certs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.628563 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-internal-tls-certs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.628896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data-custom\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.628942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-public-tls-certs\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.630336 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="ba949ad8-33f8-406b-990b-d2038698556d" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.630518 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.633089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-public-tls-certs\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.633328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-scripts\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.633856 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.646769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c2mz\" (UniqueName: \"kubernetes.io/projected/88f54396-564d-48eb-a4c9-8b56b3a30a86-kube-api-access-9c2mz\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.685292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjht\" (UniqueName: \"kubernetes.io/projected/2e62f83c-f27a-469a-bc38-0f20b3db209a-kube-api-access-hcjht\") pod \"barbican-api-7d7bfdf7c8-j5j7f\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.686059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-combined-ca-bundle\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.687364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-config-data\") pod \"placement-6746c44b58-657qd\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.703672 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="048b3b15-392d-49b6-87e3-251369ff8245" containerName="galera" containerID="cri-o://7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.704741 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.717086 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.725630 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.861210 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-77b48987cd-zvgbz"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.861440 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-api" containerID="cri-o://70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.861927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-httpd" containerID="cri-o://5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.871837 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.879711 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.880076 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" containerID="cri-o://095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.899267 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b8487dc5f-wtb2g"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.899519 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" podUID="2f877573-99ba-420d-8977-eed7e339e9c3" containerName="keystone-api" containerID="cri-o://0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517" gracePeriod=30 Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.900982 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.917477 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7898c584c4-qbqkt"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.918963 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.933391 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7898c584c4-qbqkt"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.962361 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6b5b775646-kx2zh"] Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.964166 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:50 crc kubenswrapper[4769]: I1121 13:01:50.991711 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6b5b775646-kx2zh"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.004730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-combined-ca-bundle\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.004818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-public-tls-certs\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.004847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-fernet-keys\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.064084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-scripts\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.064327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsq4k\" (UniqueName: \"kubernetes.io/projected/d5d88bb8-6d29-45d5-a769-94947f8042d5-kube-api-access-wsq4k\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.064446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-internal-tls-certs\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.064541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-credential-keys\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.064593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-config-data\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.070499 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.094429 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.109939 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.117069 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerName="galera" containerID="cri-o://5103bfeb6e2ec90a8d2df4a9be6027cee2234f1db18364a4a6da13fa852d6e7b" gracePeriod=30 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.126757 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.129876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.132913 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" podUID="2f877573-99ba-420d-8977-eed7e339e9c3" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.227:5000/v3\": read tcp 10.217.0.2:35982->10.217.0.227:5000: read: connection reset by peer" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.133245 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.133326 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.148591 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.155284 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.166943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-internal-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.166995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-credential-keys\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-config-data\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-config\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-combined-ca-bundle\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-public-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-public-tls-certs\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-fernet-keys\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-scripts\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-ovndb-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wsq4k\" (UniqueName: \"kubernetes.io/projected/d5d88bb8-6d29-45d5-a769-94947f8042d5-kube-api-access-wsq4k\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-httpd-config\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-combined-ca-bundle\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5phvj\" (UniqueName: \"kubernetes.io/projected/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-kube-api-access-5phvj\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.167375 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-internal-tls-certs\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.173906 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.185084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-fernet-keys\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.185400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-scripts\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.186428 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-combined-ca-bundle\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.192361 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-credential-keys\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.192699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-internal-tls-certs\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.192885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-config-data\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.195018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsq4k\" (UniqueName: \"kubernetes.io/projected/d5d88bb8-6d29-45d5-a769-94947f8042d5-kube-api-access-wsq4k\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.213677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-public-tls-certs\") pod \"keystone-7898c584c4-qbqkt\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.216227 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.218060 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.230932 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.242020 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270321 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98hn\" (UniqueName: \"kubernetes.io/projected/cfbba950-7b66-4271-929f-d81ed58141a6-kube-api-access-q98hn\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-internal-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270382 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfbba950-7b66-4271-929f-d81ed58141a6-logs\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-config\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-config-data\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.270520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-public-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.274683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-internal-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.275140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-ovndb-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.275209 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-httpd-config\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.275231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-combined-ca-bundle\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.275265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5phvj\" (UniqueName: \"kubernetes.io/projected/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-kube-api-access-5phvj\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.275699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-config\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.281610 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.291263 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.293000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-ovndb-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.293212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-public-tls-certs\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.294740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-httpd-config\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.296427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5phvj\" (UniqueName: \"kubernetes.io/projected/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-kube-api-access-5phvj\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.304986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-combined-ca-bundle\") pod \"neutron-6b5b775646-kx2zh\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.327050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.356553 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.380425 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.380576 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-config-data\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384168 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384282 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q98hn\" (UniqueName: \"kubernetes.io/projected/cfbba950-7b66-4271-929f-d81ed58141a6-kube-api-access-q98hn\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5hjv\" (UniqueName: \"kubernetes.io/projected/a58794b2-3db0-4930-84f4-d8757325a776-kube-api-access-l5hjv\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfbba950-7b66-4271-929f-d81ed58141a6-logs\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384355 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384396 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.384765 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80493384-e023-40a6-bac4-16a270ce4876" path="/var/lib/kubelet/pods/80493384-e023-40a6-bac4-16a270ce4876/volumes" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.385721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfbba950-7b66-4271-929f-d81ed58141a6-logs\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.386101 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4bc5d5-860a-4468-b80f-9123698c878a" path="/var/lib/kubelet/pods/9f4bc5d5-860a-4468-b80f-9123698c878a/volumes" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.389160 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1510c24-a296-4443-b9a6-237c100402a1" path="/var/lib/kubelet/pods/b1510c24-a296-4443-b9a6-237c100402a1/volumes" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.390028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.390306 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c38788ea-0eb8-4e69-927c-c0f01dd339e2" path="/var/lib/kubelet/pods/c38788ea-0eb8-4e69-927c-c0f01dd339e2/volumes" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.391152 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.391203 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.391219 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.398109 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.400767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-config-data\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.431278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98hn\" (UniqueName: \"kubernetes.io/projected/cfbba950-7b66-4271-929f-d81ed58141a6-kube-api-access-q98hn\") pod \"nova-metadata-0\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.491500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hjv\" (UniqueName: \"kubernetes.io/projected/a58794b2-3db0-4930-84f4-d8757325a776-kube-api-access-l5hjv\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.491587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.491672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.504867 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.506130 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.507003 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.512180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5hjv\" (UniqueName: \"kubernetes.io/projected/a58794b2-3db0-4930-84f4-d8757325a776-kube-api-access-l5hjv\") pod \"nova-cell1-conductor-0\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.616233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.631599 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.636081 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.683826 4769 generic.go:334] "Generic (PLEG): container finished" podID="496a8880-f116-4e6b-b59a-ade8af828e74" containerID="5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef" exitCode=0 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.683906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" event={"ID":"496a8880-f116-4e6b-b59a-ade8af828e74","Type":"ContainerDied","Data":"5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.692976 4769 generic.go:334] "Generic (PLEG): container finished" podID="2f877573-99ba-420d-8977-eed7e339e9c3" containerID="0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517" exitCode=0 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.693041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" event={"ID":"2f877573-99ba-420d-8977-eed7e339e9c3","Type":"ContainerDied","Data":"0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.694133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" event={"ID":"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee","Type":"ContainerStarted","Data":"335fecc71e6d6e02f1d9ed3dec5729eb94eb025038fc5b8bf58f8c7f02132e87"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.695065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerStarted","Data":"4a0794f708d6531cf1e5fd49588a248d21b7a2abdd4f5097052539dd12356481"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.696527 4769 generic.go:334] "Generic (PLEG): container finished" podID="218614a7-f338-4843-88ca-47a21998b61a" containerID="ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f" exitCode=143 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.696564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" event={"ID":"218614a7-f338-4843-88ca-47a21998b61a","Type":"ContainerDied","Data":"ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.724292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" event={"ID":"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa","Type":"ContainerStarted","Data":"706ac72be3e4b9017fdb526fb2d1dd0112435bedde53132e7e8c2c654664da06"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.725711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b581db1b-0a9b-4010-81d8-5cc9563d71a3","Type":"ContainerStarted","Data":"ecbf289db133aa6b02e2ad4d22b0485f1374290b07b6fcfd07aa471c523ffa5d"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.727000 4769 generic.go:334] "Generic (PLEG): container finished" podID="44c2164d-04ed-4bc7-a71f-e54cc74d7d32" containerID="9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5" exitCode=0 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.727052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"44c2164d-04ed-4bc7-a71f-e54cc74d7d32","Type":"ContainerDied","Data":"9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.728473 4769 generic.go:334] "Generic (PLEG): container finished" podID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerID="ba6f1b25c33ec2cc518581742d2779899bdef16d4eeffa133336c77d062a52cd" exitCode=0 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.728565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" event={"ID":"6788b7d4-ead9-4e17-8f26-b23369e1332b","Type":"ContainerDied","Data":"ba6f1b25c33ec2cc518581742d2779899bdef16d4eeffa133336c77d062a52cd"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.742481 4769 generic.go:334] "Generic (PLEG): container finished" podID="048b3b15-392d-49b6-87e3-251369ff8245" containerID="7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018" exitCode=0 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.743417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"048b3b15-392d-49b6-87e3-251369ff8245","Type":"ContainerDied","Data":"7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018"} Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.743725 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api-log" containerID="cri-o://b2c18272f1827009a30ad1293ce54279df006ccb9d1dcbf1e125ec9efe5d804a" gracePeriod=30 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.743948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api" containerID="cri-o://cd23d0bbe0b15d7111fd1bbd2fae548337dbf4503db5e22999ab07463ee507e5" gracePeriod=30 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.744138 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-log" containerID="cri-o://130465e96aaf25dfe6599c50e77a5c45f49f9013ac0c94c1d5aee250a1240fce" gracePeriod=30 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.744296 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-api" containerID="cri-o://882bd9b382d4b56ecc2b1ba9508f4579099c555cd9c308acd2c708e63e237d1b" gracePeriod=30 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.744330 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="openstack-network-exporter" containerID="cri-o://afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa" gracePeriod=300 Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.790559 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c is running failed: container process not found" containerID="76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.791553 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c is running failed: container process not found" containerID="76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.791817 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c is running failed: container process not found" containerID="76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:01:51 crc kubenswrapper[4769]: E1121 13:01:51.791846 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="ovsdbserver-nb" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.901952 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="ovsdbserver-sb" containerID="cri-o://52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871" gracePeriod=300 Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.907127 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7995cfb3-14d8-4487-b7aa-a2582bc19c52/ovsdbserver-nb/0.log" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.908375 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.909300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdbserver-nb-tls-certs\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.909352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjbq5\" (UniqueName: \"kubernetes.io/projected/7995cfb3-14d8-4487-b7aa-a2582bc19c52-kube-api-access-bjbq5\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.917776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-config\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.917827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.917855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-scripts\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.919041 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-scripts" (OuterVolumeSpecName: "scripts") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.919958 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.921532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-config" (OuterVolumeSpecName: "config") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.921765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7995cfb3-14d8-4487-b7aa-a2582bc19c52-kube-api-access-bjbq5" (OuterVolumeSpecName: "kube-api-access-bjbq5") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "kube-api-access-bjbq5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:51 crc kubenswrapper[4769]: I1121 13:01:51.931713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.021933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-metrics-certs-tls-certs\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.022016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdb-rundir\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.022054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-combined-ca-bundle\") pod \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\" (UID: \"7995cfb3-14d8-4487-b7aa-a2582bc19c52\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.022935 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bjbq5\" (UniqueName: \"kubernetes.io/projected/7995cfb3-14d8-4487-b7aa-a2582bc19c52-kube-api-access-bjbq5\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.022953 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7995cfb3-14d8-4487-b7aa-a2582bc19c52-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.023098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.022973 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.118319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.119032 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.126102 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.126132 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.126143 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.299400 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.321500 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-config-data\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-fernet-keys\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-scripts\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-internal-tls-certs\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7gnc\" (UniqueName: \"kubernetes.io/projected/2f877573-99ba-420d-8977-eed7e339e9c3-kube-api-access-k7gnc\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-credential-keys\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-public-tls-certs\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.329891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-combined-ca-bundle\") pod \"2f877573-99ba-420d-8977-eed7e339e9c3\" (UID: \"2f877573-99ba-420d-8977-eed7e339e9c3\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.401659 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f"] Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.426720 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6746c44b58-657qd"] Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.446237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-config-data\") pod \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.446357 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-memcached-tls-certs\") pod \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.446391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-combined-ca-bundle\") pod \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.446892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbm5s\" (UniqueName: \"kubernetes.io/projected/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kube-api-access-hbm5s\") pod \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.446985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kolla-config\") pod \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\" (UID: \"44c2164d-04ed-4bc7-a71f-e54cc74d7d32\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.447176 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-config-data" (OuterVolumeSpecName: "config-data") pod "44c2164d-04ed-4bc7-a71f-e54cc74d7d32" (UID: "44c2164d-04ed-4bc7-a71f-e54cc74d7d32"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.447573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "44c2164d-04ed-4bc7-a71f-e54cc74d7d32" (UID: "44c2164d-04ed-4bc7-a71f-e54cc74d7d32"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.448026 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.448043 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.452078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f877573-99ba-420d-8977-eed7e339e9c3-kube-api-access-k7gnc" (OuterVolumeSpecName: "kube-api-access-k7gnc") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "kube-api-access-k7gnc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.452369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.456356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.462724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kube-api-access-hbm5s" (OuterVolumeSpecName: "kube-api-access-hbm5s") pod "44c2164d-04ed-4bc7-a71f-e54cc74d7d32" (UID: "44c2164d-04ed-4bc7-a71f-e54cc74d7d32"). InnerVolumeSpecName "kube-api-access-hbm5s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.474958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-scripts" (OuterVolumeSpecName: "scripts") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.550289 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.550482 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.550563 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hbm5s\" (UniqueName: \"kubernetes.io/projected/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-kube-api-access-hbm5s\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.550659 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.550735 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k7gnc\" (UniqueName: \"kubernetes.io/projected/2f877573-99ba-420d-8977-eed7e339e9c3-kube-api-access-k7gnc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.550857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.615908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-config-data" (OuterVolumeSpecName: "config-data") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.649203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "44c2164d-04ed-4bc7-a71f-e54cc74d7d32" (UID: "44c2164d-04ed-4bc7-a71f-e54cc74d7d32"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.654165 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.654212 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.654224 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.697519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "7995cfb3-14d8-4487-b7aa-a2582bc19c52" (UID: "7995cfb3-14d8-4487-b7aa-a2582bc19c52"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.701818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.732374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "44c2164d-04ed-4bc7-a71f-e54cc74d7d32" (UID: "44c2164d-04ed-4bc7-a71f-e54cc74d7d32"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.733931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.758435 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.758467 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/44c2164d-04ed-4bc7-a71f-e54cc74d7d32-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.758479 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7995cfb3-14d8-4487-b7aa-a2582bc19c52-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.758491 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.768383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2f877573-99ba-420d-8977-eed7e339e9c3" (UID: "2f877573-99ba-420d-8977-eed7e339e9c3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.783759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerStarted","Data":"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.791780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" event={"ID":"2f877573-99ba-420d-8977-eed7e339e9c3","Type":"ContainerDied","Data":"83f6bcbd3f73f7a772231cdd65915918e162cd7110ffd723b1235d77b4684595"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.791875 4769 scope.go:117] "RemoveContainer" containerID="0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.792003 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-b8487dc5f-wtb2g" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.819500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" event={"ID":"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee","Type":"ContainerStarted","Data":"ef702362ac97811d88701d056a5bfcc0ee1bcd5907f6131f2f9141e276cda6e1"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.819679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" event={"ID":"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee","Type":"ContainerStarted","Data":"aad63fcc475367f2d5f90522ff68e0393ee97ef209867e40a88c30862be1ea5c"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.823681 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" event={"ID":"88f54396-564d-48eb-a4c9-8b56b3a30a86","Type":"ContainerStarted","Data":"318f9aebd6600201aa92ea565bb7aa07957b24804426cd9c24ed11a20b80fa30"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.827890 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_7995cfb3-14d8-4487-b7aa-a2582bc19c52/ovsdbserver-nb/0.log" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.827989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"7995cfb3-14d8-4487-b7aa-a2582bc19c52","Type":"ContainerDied","Data":"f5780806f4062ce45066444dd463c4754eac4c6d59f1f66b137c481b6e59e4a4"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.828264 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.842269 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1/ovsdbserver-sb/0.log" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.842315 4769 generic.go:334] "Generic (PLEG): container finished" podID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerID="afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa" exitCode=2 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.843965 4769 generic.go:334] "Generic (PLEG): container finished" podID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerID="52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871" exitCode=143 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.844051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1","Type":"ContainerDied","Data":"afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.844079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1","Type":"ContainerDied","Data":"52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.852860 4769 generic.go:334] "Generic (PLEG): container finished" podID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerID="5103bfeb6e2ec90a8d2df4a9be6027cee2234f1db18364a4a6da13fa852d6e7b" exitCode=0 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.852920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"53ea8f17-e44c-4381-8339-f8cdbd0ea290","Type":"ContainerDied","Data":"5103bfeb6e2ec90a8d2df4a9be6027cee2234f1db18364a4a6da13fa852d6e7b"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.852944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"53ea8f17-e44c-4381-8339-f8cdbd0ea290","Type":"ContainerDied","Data":"2b73502f8081675a5ff8d7a5f8b1ce99f5c7fef44f581f453fcba2d7d1071157"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.852956 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b73502f8081675a5ff8d7a5f8b1ce99f5c7fef44f581f453fcba2d7d1071157" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.855662 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" podStartSLOduration=3.855631988 podStartE2EDuration="3.855631988s" podCreationTimestamp="2025-11-21 13:01:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:52.833217994 +0000 UTC m=+4271.533879812" watchObservedRunningTime="2025-11-21 13:01:52.855631988 +0000 UTC m=+4271.556293806" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.868824 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f877573-99ba-420d-8977-eed7e339e9c3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.872070 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerStarted","Data":"8d295dfd69794fa90ab3503bfab63b6feebce92b71151d7070ef61b9c67750c7"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.898869 4769 generic.go:334] "Generic (PLEG): container finished" podID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerID="882bd9b382d4b56ecc2b1ba9508f4579099c555cd9c308acd2c708e63e237d1b" exitCode=0 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.898901 4769 generic.go:334] "Generic (PLEG): container finished" podID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerID="130465e96aaf25dfe6599c50e77a5c45f49f9013ac0c94c1d5aee250a1240fce" exitCode=143 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.898962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b824f9ca-bdca-4673-939a-9bf4e3846140","Type":"ContainerDied","Data":"882bd9b382d4b56ecc2b1ba9508f4579099c555cd9c308acd2c708e63e237d1b"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.898983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b824f9ca-bdca-4673-939a-9bf4e3846140","Type":"ContainerDied","Data":"130465e96aaf25dfe6599c50e77a5c45f49f9013ac0c94c1d5aee250a1240fce"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.916626 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.918263 4769 generic.go:334] "Generic (PLEG): container finished" podID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerID="7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3" exitCode=137 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.918334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" event={"ID":"6af1865c-3e9f-4329-bc4b-94679b29dfee","Type":"ContainerDied","Data":"7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.923045 4769 generic.go:334] "Generic (PLEG): container finished" podID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerID="cd23d0bbe0b15d7111fd1bbd2fae548337dbf4503db5e22999ab07463ee507e5" exitCode=0 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.923078 4769 generic.go:334] "Generic (PLEG): container finished" podID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerID="b2c18272f1827009a30ad1293ce54279df006ccb9d1dcbf1e125ec9efe5d804a" exitCode=143 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.923120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" event={"ID":"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b","Type":"ContainerDied","Data":"cd23d0bbe0b15d7111fd1bbd2fae548337dbf4503db5e22999ab07463ee507e5"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.923144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" event={"ID":"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b","Type":"ContainerDied","Data":"b2c18272f1827009a30ad1293ce54279df006ccb9d1dcbf1e125ec9efe5d804a"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.926597 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s"] Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.926775 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker-log" containerID="cri-o://926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680" gracePeriod=30 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.926858 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker" containerID="cri-o://34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a" gracePeriod=30 Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.946861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" event={"ID":"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa","Type":"ContainerStarted","Data":"55f82e9c6199c77cf2e0cc7b0e9fea9ed3aedf3da9123595b1632784fb783213"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.947170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" event={"ID":"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa","Type":"ContainerStarted","Data":"15538b8e01b92058053f9e4635ba6d618ed95de58086ae02492ffb2f9b47a188"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.947835 4769 scope.go:117] "RemoveContainer" containerID="b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.970104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-config-data-default\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.970351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-kolla-config\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.971465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-galera-tls-certs\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.971568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.972528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-combined-ca-bundle\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.972669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/048b3b15-392d-49b6-87e3-251369ff8245-kube-api-access-tgbdx\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.972762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-operator-scripts\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.972834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/048b3b15-392d-49b6-87e3-251369ff8245-config-data-generated\") pod \"048b3b15-392d-49b6-87e3-251369ff8245\" (UID: \"048b3b15-392d-49b6-87e3-251369ff8245\") " Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.976751 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.977162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"44c2164d-04ed-4bc7-a71f-e54cc74d7d32","Type":"ContainerDied","Data":"b5f9ce791b7321a9f19d3aae9c8edbcbb4a9859cc45eef1099ed7974705e0493"} Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.977256 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.980811 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.984961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.986355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/048b3b15-392d-49b6-87e3-251369ff8245-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:52 crc kubenswrapper[4769]: I1121 13:01:52.994676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.008051 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.012392 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.012708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" event={"ID":"6788b7d4-ead9-4e17-8f26-b23369e1332b","Type":"ContainerDied","Data":"9bde13eac9abb561deb742c29244f2626d42dcf10c0cffa06e45eea0797dbc74"} Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.014506 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.022183 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-b8487dc5f-wtb2g"] Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.024149 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.045457 4769 scope.go:117] "RemoveContainer" containerID="76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.055852 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-b8487dc5f-wtb2g"] Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.070542 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.070914 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="048b3b15-392d-49b6-87e3-251369ff8245" containerName="galera" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.070931 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="048b3b15-392d-49b6-87e3-251369ff8245" containerName="galera" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.070949 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerName="mysql-bootstrap" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.070955 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerName="mysql-bootstrap" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.070970 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="44c2164d-04ed-4bc7-a71f-e54cc74d7d32" containerName="memcached" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.070975 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c2164d-04ed-4bc7-a71f-e54cc74d7d32" containerName="memcached" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.070983 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="048b3b15-392d-49b6-87e3-251369ff8245" containerName="mysql-bootstrap" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.070989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="048b3b15-392d-49b6-87e3-251369ff8245" containerName="mysql-bootstrap" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.070999 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071004 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-api" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071013 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api-log" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071018 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api-log" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071030 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071036 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071058 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="openstack-network-exporter" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071065 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="openstack-network-exporter" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071077 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-log" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071082 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-log" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071091 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="ovsdbserver-nb" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="ovsdbserver-nb" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071109 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerName="galera" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerName="galera" Nov 21 13:01:53 crc kubenswrapper[4769]: E1121 13:01:53.071128 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f877573-99ba-420d-8977-eed7e339e9c3" containerName="keystone-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071134 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f877573-99ba-420d-8977-eed7e339e9c3" containerName="keystone-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071319 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071336 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="048b3b15-392d-49b6-87e3-251369ff8245" containerName="galera" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071357 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" containerName="galera" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071363 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="ovsdbserver-nb" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071374 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f877573-99ba-420d-8977-eed7e339e9c3" containerName="keystone-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071382 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-api" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071389 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" containerName="barbican-api-log" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071401 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" containerName="openstack-network-exporter" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071409 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="44c2164d-04ed-4bc7-a71f-e54cc74d7d32" containerName="memcached" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.071419 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" containerName="nova-api-log" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.072606 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.075137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"048b3b15-392d-49b6-87e3-251369ff8245","Type":"ContainerDied","Data":"32b7e1d588a26608c4ff2226d22e817f3a1e57b94f575235d707f2b8683c7f31"} Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.075422 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.075985 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b824f9ca-bdca-4673-939a-9bf4e3846140-logs\") pod \"b824f9ca-bdca-4673-939a-9bf4e3846140\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076478 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-config-data\") pod \"b824f9ca-bdca-4673-939a-9bf4e3846140\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-default\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-combined-ca-bundle\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-internal-tls-certs\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-galera-tls-certs\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data-custom\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076734 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l72gr\" (UniqueName: \"kubernetes.io/projected/b824f9ca-bdca-4673-939a-9bf4e3846140-kube-api-access-l72gr\") pod \"b824f9ca-bdca-4673-939a-9bf4e3846140\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77zlg\" (UniqueName: \"kubernetes.io/projected/6788b7d4-ead9-4e17-8f26-b23369e1332b-kube-api-access-77zlg\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-public-tls-certs\") pod \"b824f9ca-bdca-4673-939a-9bf4e3846140\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-operator-scripts\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-generated\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kolla-config\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.076986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-public-tls-certs\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz92r\" (UniqueName: \"kubernetes.io/projected/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kube-api-access-rz92r\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-combined-ca-bundle\") pod \"b824f9ca-bdca-4673-939a-9bf4e3846140\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-combined-ca-bundle\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6788b7d4-ead9-4e17-8f26-b23369e1332b-logs\") pod \"6788b7d4-ead9-4e17-8f26-b23369e1332b\" (UID: \"6788b7d4-ead9-4e17-8f26-b23369e1332b\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-internal-tls-certs\") pod \"b824f9ca-bdca-4673-939a-9bf4e3846140\" (UID: \"b824f9ca-bdca-4673-939a-9bf4e3846140\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\" (UID: \"53ea8f17-e44c-4381-8339-f8cdbd0ea290\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077947 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077963 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/048b3b15-392d-49b6-87e3-251369ff8245-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077972 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.077982 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/048b3b15-392d-49b6-87e3-251369ff8245-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.084627 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.084924 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-6t2fb" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.089942 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.090184 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b824f9ca-bdca-4673-939a-9bf4e3846140-logs" (OuterVolumeSpecName: "logs") pod "b824f9ca-bdca-4673-939a-9bf4e3846140" (UID: "b824f9ca-bdca-4673-939a-9bf4e3846140"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.095527 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" podStartSLOduration=4.095512909 podStartE2EDuration="4.095512909s" podCreationTimestamp="2025-11-21 13:01:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:53.027116047 +0000 UTC m=+4271.727777865" watchObservedRunningTime="2025-11-21 13:01:53.095512909 +0000 UTC m=+4271.796174727" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.099556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.114459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6788b7d4-ead9-4e17-8f26-b23369e1332b-logs" (OuterVolumeSpecName: "logs") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.120711 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.122071 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.122946 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.123921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.139249 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1/ovsdbserver-sb/0.log" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.139494 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.151631 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kube-api-access-rz92r" (OuterVolumeSpecName: "kube-api-access-rz92r") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "kube-api-access-rz92r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.151768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b824f9ca-bdca-4673-939a-9bf4e3846140-kube-api-access-l72gr" (OuterVolumeSpecName: "kube-api-access-l72gr") pod "b824f9ca-bdca-4673-939a-9bf4e3846140" (UID: "b824f9ca-bdca-4673-939a-9bf4e3846140"). InnerVolumeSpecName "kube-api-access-l72gr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.158250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.171663 4769 scope.go:117] "RemoveContainer" containerID="9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.172678 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s"] Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.172874 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener-log" containerID="cri-o://c7d15563af38f74e6fa9a5ecdde1379c569ac10dd311b504d05f4547b677ff86" gracePeriod=30 Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.172946 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener" containerID="cri-o://cab074cf17b3d5b37ba09f5bb242cd52223a16513444fa2e9c42eacd2f71b783" gracePeriod=30 Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.192109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-config\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.194638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdb-rundir\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.195106 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.195390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdbserver-sb-tls-certs\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.195486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-metrics-certs-tls-certs\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.195542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-combined-ca-bundle\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.195627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-scripts\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.195691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz2hh\" (UniqueName: \"kubernetes.io/projected/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-kube-api-access-mz2hh\") pod \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\" (UID: \"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1\") " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-config\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196352 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmx9v\" (UniqueName: \"kubernetes.io/projected/ed6e1205-4575-417d-9b21-529dc83d8657-kube-api-access-fmx9v\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.193545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-config" (OuterVolumeSpecName: "config") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.196889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197038 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b824f9ca-bdca-4673-939a-9bf4e3846140-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197061 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197075 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197089 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l72gr\" (UniqueName: \"kubernetes.io/projected/b824f9ca-bdca-4673-939a-9bf4e3846140-kube-api-access-l72gr\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197100 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197115 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197126 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/53ea8f17-e44c-4381-8339-f8cdbd0ea290-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197139 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197151 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rz92r\" (UniqueName: \"kubernetes.io/projected/53ea8f17-e44c-4381-8339-f8cdbd0ea290-kube-api-access-rz92r\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.197162 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6788b7d4-ead9-4e17-8f26-b23369e1332b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.199567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-scripts" (OuterVolumeSpecName: "scripts") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.213601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/048b3b15-392d-49b6-87e3-251369ff8245-kube-api-access-tgbdx" (OuterVolumeSpecName: "kube-api-access-tgbdx") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "kube-api-access-tgbdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.238726 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6788b7d4-ead9-4e17-8f26-b23369e1332b-kube-api-access-77zlg" (OuterVolumeSpecName: "kube-api-access-77zlg") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "kube-api-access-77zlg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.245289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.261407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.263597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-kube-api-access-mz2hh" (OuterVolumeSpecName: "kube-api-access-mz2hh") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "kube-api-access-mz2hh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fmx9v\" (UniqueName: \"kubernetes.io/projected/ed6e1205-4575-417d-9b21-529dc83d8657-kube-api-access-fmx9v\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313679 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-config\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313936 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-77zlg\" (UniqueName: \"kubernetes.io/projected/6788b7d4-ead9-4e17-8f26-b23369e1332b-kube-api-access-77zlg\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313962 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313978 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.313988 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.314002 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mz2hh\" (UniqueName: \"kubernetes.io/projected/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-kube-api-access-mz2hh\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.314012 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tgbdx\" (UniqueName: \"kubernetes.io/projected/048b3b15-392d-49b6-87e3-251369ff8245-kube-api-access-tgbdx\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.314022 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.319199 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.328858 4769 scope.go:117] "RemoveContainer" containerID="ba6f1b25c33ec2cc518581742d2779899bdef16d4eeffa133336c77d062a52cd" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.331413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.331762 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.332114 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-config\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.407131 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.412592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.412902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.421951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmx9v\" (UniqueName: \"kubernetes.io/projected/ed6e1205-4575-417d-9b21-529dc83d8657-kube-api-access-fmx9v\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.453426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "mysql-db") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.531615 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.716920 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.751311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-config-data" (OuterVolumeSpecName: "config-data") pod "b824f9ca-bdca-4673-939a-9bf4e3846140" (UID: "b824f9ca-bdca-4673-939a-9bf4e3846140"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.769761 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f877573-99ba-420d-8977-eed7e339e9c3" path="/var/lib/kubelet/pods/2f877573-99ba-420d-8977-eed7e339e9c3/volumes" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.772167 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7995cfb3-14d8-4487-b7aa-a2582bc19c52" path="/var/lib/kubelet/pods/7995cfb3-14d8-4487-b7aa-a2582bc19c52/volumes" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.790146 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.790170 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.841097 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.893437 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.975948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:53 crc kubenswrapper[4769]: I1121 13:01:53.993500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b824f9ca-bdca-4673-939a-9bf4e3846140" (UID: "b824f9ca-bdca-4673-939a-9bf4e3846140"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:53.996699 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:53.996970 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.013554 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b824f9ca-bdca-4673-939a-9bf4e3846140" (UID: "b824f9ca-bdca-4673-939a-9bf4e3846140"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.101237 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.110464 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.160720 4769 generic.go:334] "Generic (PLEG): container finished" podID="4759ef3d-e00f-42ee-9964-82553f02b530" containerID="926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680" exitCode=143 Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.164294 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerID="c7d15563af38f74e6fa9a5ecdde1379c569ac10dd311b504d05f4547b677ff86" exitCode=143 Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.173546 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.188636 4769 generic.go:334] "Generic (PLEG): container finished" podID="438a784a-03b1-4561-87c2-f01538a59ab0" containerID="a00def91be98af9694b5aab9edfbc7ae261ba45918af57cb36ca71973d4479e5" exitCode=137 Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.195469 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1/ovsdbserver-sb/0.log" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.195610 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.198586 4769 generic.go:334] "Generic (PLEG): container finished" podID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerID="43037d63719c54f059d0bbbce7005e49220a7a30b477272d7e72153c16868ca2" exitCode=0 Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.198698 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.199281 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.202439 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.667466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.688832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.724769 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.766153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.816595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.829524 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.829553 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.834883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "53ea8f17-e44c-4381-8339-f8cdbd0ea290" (UID: "53ea8f17-e44c-4381-8339-f8cdbd0ea290"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.870511 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.879410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "048b3b15-392d-49b6-87e3-251369ff8245" (UID: "048b3b15-392d-49b6-87e3-251369ff8245"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.879496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.900062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b824f9ca-bdca-4673-939a-9bf4e3846140" (UID: "b824f9ca-bdca-4673-939a-9bf4e3846140"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.931435 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.931461 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b824f9ca-bdca-4673-939a-9bf4e3846140-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.931472 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/048b3b15-392d-49b6-87e3-251369ff8245-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.931481 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.931490 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/53ea8f17-e44c-4381-8339-f8cdbd0ea290-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.934298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data" (OuterVolumeSpecName: "config-data") pod "6788b7d4-ead9-4e17-8f26-b23369e1332b" (UID: "6788b7d4-ead9-4e17-8f26-b23369e1332b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.951613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.954798 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" (UID: "9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:54 crc kubenswrapper[4769]: I1121 13:01:54.957593 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.032798 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6788b7d4-ead9-4e17-8f26-b23369e1332b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.032837 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.032850 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.214261 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.929s" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214651 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerStarted","Data":"21a4a1dc149df594b0a1a3b5a0b0dcae67675266d82bcda3ba230f092fa2cbb1"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214822 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" event={"ID":"4759ef3d-e00f-42ee-9964-82553f02b530","Type":"ContainerDied","Data":"926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214850 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" event={"ID":"bd176a47-2143-45c9-85a5-ab6a32848a86","Type":"ContainerDied","Data":"c7d15563af38f74e6fa9a5ecdde1379c569ac10dd311b504d05f4547b677ff86"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" event={"ID":"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b","Type":"ContainerDied","Data":"94743a7e85e15f2d8bde9c3c6d711b8fd038807ec22190e2b88b7cb336c3c565"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214908 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94743a7e85e15f2d8bde9c3c6d711b8fd038807ec22190e2b88b7cb336c3c565" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b581db1b-0a9b-4010-81d8-5cc9563d71a3","Type":"ContainerStarted","Data":"f13a8683802b5d9e611d43e469d02267689a05163b11522dc4abb9f12a1252fc"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214938 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.214960 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.215474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="ovsdbserver-sb" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.215494 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="ovsdbserver-sb" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.215508 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="openstack-network-exporter" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.215516 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="openstack-network-exporter" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.215800 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="ovsdbserver-sb" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.215829 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" containerName="openstack-network-exporter" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.216853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b824f9ca-bdca-4673-939a-9bf4e3846140","Type":"ContainerDied","Data":"e3c8d845e21204eeae1c5c7d13e72c6a9a6a58a2f5047c1ce52cc9e1cef48b92"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" event={"ID":"1b0b0b34-a9b3-4bff-927f-003d8869e1b5","Type":"ContainerStarted","Data":"f142fc1a7af7995a74098f6693c8837bc10d580aa16b73de14c30ab3ce4ab784"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" event={"ID":"d5d88bb8-6d29-45d5-a769-94947f8042d5","Type":"ContainerStarted","Data":"347c164822cbe4bc0ffb28ec07084e8d17fca56f96717506dcc46a465f29bce5"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225457 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7898c584c4-qbqkt"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" event={"ID":"438a784a-03b1-4561-87c2-f01538a59ab0","Type":"ContainerDied","Data":"a00def91be98af9694b5aab9edfbc7ae261ba45918af57cb36ca71973d4479e5"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" event={"ID":"6af1865c-3e9f-4329-bc4b-94679b29dfee","Type":"ContainerDied","Data":"d5515ad48f659a1a60cc9fe13f680ac6237bf842dfb98ff9d702f3ca53023710"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225879 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5515ad48f659a1a60cc9fe13f680ac6237bf842dfb98ff9d702f3ca53023710" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225893 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6b5b775646-kx2zh"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfbba950-7b66-4271-929f-d81ed58141a6","Type":"ContainerStarted","Data":"67507292ba4b44eab8a04b58d13fdcd53d4c06881dcae66e5e04b65730c2f91a"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1","Type":"ContainerDied","Data":"af2bd30412ec9611d5a4c0bd8ae9ece60ec279fb657992a020baf998615281d6"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b31d6545-ddad-4fcf-b60d-47be899c6768","Type":"ContainerDied","Data":"43037d63719c54f059d0bbbce7005e49220a7a30b477272d7e72153c16868ca2"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225964 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.225980 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.228037 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.228731 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-hqthj" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.228920 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.245496 4769 scope.go:117] "RemoveContainer" containerID="7a21b002362952b6536084ca50d36a886040e3a77ff41eb0c74c93bee117aa18" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.246278 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-combined-ca-bundle\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.246359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-memcached-tls-certs\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.246457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ngt\" (UniqueName: \"kubernetes.io/projected/85ecd4b2-b5ed-4780-993a-2433bae3b108-kube-api-access-52ngt\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.246512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-config-data\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.246553 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-kolla-config\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.248421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b31d6545-ddad-4fcf-b60d-47be899c6768","Type":"ContainerDied","Data":"6a3bf757d4e5bfaef66381e8649137db0c9d29990d491a35b84c23df8aea4a14"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.248452 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a3bf757d4e5bfaef66381e8649137db0c9d29990d491a35b84c23df8aea4a14" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.251507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" event={"ID":"438a784a-03b1-4561-87c2-f01538a59ab0","Type":"ContainerDied","Data":"4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.251542 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.258399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" event={"ID":"88f54396-564d-48eb-a4c9-8b56b3a30a86","Type":"ContainerStarted","Data":"b8900e332a6cab927466aed3dc0c84d4a85c129a31cf973f2717f915c544d21e"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.259996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerStarted","Data":"5a23ca9d8c578198505c4aeaa9c9e552783a6c07551851baad340e52214ec296"} Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.292733 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c2164d-04ed-4bc7-a71f-e54cc74d7d32" path="/var/lib/kubelet/pods/44c2164d-04ed-4bc7-a71f-e54cc74d7d32/volumes" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.344382 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.348286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-memcached-tls-certs\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.348360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-52ngt\" (UniqueName: \"kubernetes.io/projected/85ecd4b2-b5ed-4780-993a-2433bae3b108-kube-api-access-52ngt\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.349367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-config-data\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.349405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-kolla-config\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.349511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-combined-ca-bundle\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.349912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-config-data\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.350559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-kolla-config\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.355207 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-combined-ca-bundle\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.355267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-memcached-tls-certs\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.366049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ngt\" (UniqueName: \"kubernetes.io/projected/85ecd4b2-b5ed-4780-993a-2433bae3b108-kube-api-access-52ngt\") pod \"memcached-0\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.399586 4769 scope.go:117] "RemoveContainer" containerID="7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.450844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-public-tls-certs\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.451031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-logs\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.451054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-internal-tls-certs\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.451079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2chmr\" (UniqueName: \"kubernetes.io/projected/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-kube-api-access-2chmr\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.451116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.451133 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data-custom\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.451161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-combined-ca-bundle\") pod \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\" (UID: \"fc9ee1d2-edd5-4be8-9dc8-073dc798c06b\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.452082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-logs" (OuterVolumeSpecName: "logs") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.454779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-kube-api-access-2chmr" (OuterVolumeSpecName: "kube-api-access-2chmr") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "kube-api-access-2chmr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.455454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.467042 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.489445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.515940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.541149 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.551732 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.554393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7khx7\" (UniqueName: \"kubernetes.io/projected/6af1865c-3e9f-4329-bc4b-94679b29dfee-kube-api-access-7khx7\") pod \"6af1865c-3e9f-4329-bc4b-94679b29dfee\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.554852 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6af1865c-3e9f-4329-bc4b-94679b29dfee-logs\") pod \"6af1865c-3e9f-4329-bc4b-94679b29dfee\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.555009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-combined-ca-bundle\") pod \"6af1865c-3e9f-4329-bc4b-94679b29dfee\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.555070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data\") pod \"6af1865c-3e9f-4329-bc4b-94679b29dfee\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.555180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data-custom\") pod \"6af1865c-3e9f-4329-bc4b-94679b29dfee\" (UID: \"6af1865c-3e9f-4329-bc4b-94679b29dfee\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.555821 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af1865c-3e9f-4329-bc4b-94679b29dfee-logs" (OuterVolumeSpecName: "logs") pod "6af1865c-3e9f-4329-bc4b-94679b29dfee" (UID: "6af1865c-3e9f-4329-bc4b-94679b29dfee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556493 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556519 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556534 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2chmr\" (UniqueName: \"kubernetes.io/projected/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-kube-api-access-2chmr\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556547 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556558 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556567 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.556578 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6af1865c-3e9f-4329-bc4b-94679b29dfee-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.559226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6af1865c-3e9f-4329-bc4b-94679b29dfee" (UID: "6af1865c-3e9f-4329-bc4b-94679b29dfee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.559334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af1865c-3e9f-4329-bc4b-94679b29dfee-kube-api-access-7khx7" (OuterVolumeSpecName: "kube-api-access-7khx7") pod "6af1865c-3e9f-4329-bc4b-94679b29dfee" (UID: "6af1865c-3e9f-4329-bc4b-94679b29dfee"). InnerVolumeSpecName "kube-api-access-7khx7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.582107 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.583314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data" (OuterVolumeSpecName: "config-data") pod "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" (UID: "fc9ee1d2-edd5-4be8-9dc8-073dc798c06b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.620080 4769 scope.go:117] "RemoveContainer" containerID="da2031c946515e399e1dc12cb82a0e466c31c5e0432295a09da279e5be042e4a" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.647344 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-config-data\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-httpd-run\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p467\" (UniqueName: \"kubernetes.io/projected/b31d6545-ddad-4fcf-b60d-47be899c6768-kube-api-access-7p467\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657919 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-internal-tls-certs\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-logs\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.657950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-combined-ca-bundle\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.658035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-scripts\") pod \"b31d6545-ddad-4fcf-b60d-47be899c6768\" (UID: \"b31d6545-ddad-4fcf-b60d-47be899c6768\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.658777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-logs" (OuterVolumeSpecName: "logs") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.658861 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7khx7\" (UniqueName: \"kubernetes.io/projected/6af1865c-3e9f-4329-bc4b-94679b29dfee-kube-api-access-7khx7\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.658848 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.658885 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.658923 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.696416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6af1865c-3e9f-4329-bc4b-94679b29dfee" (UID: "6af1865c-3e9f-4329-bc4b-94679b29dfee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.704152 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-scripts" (OuterVolumeSpecName: "scripts") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.716740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.718382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31d6545-ddad-4fcf-b60d-47be899c6768-kube-api-access-7p467" (OuterVolumeSpecName: "kube-api-access-7p467") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "kube-api-access-7p467". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.748911 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.749993 4769 scope.go:117] "RemoveContainer" containerID="882bd9b382d4b56ecc2b1ba9508f4579099c555cd9c308acd2c708e63e237d1b" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.757281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.763455 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.764037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/438a784a-03b1-4561-87c2-f01538a59ab0-logs\") pod \"438a784a-03b1-4561-87c2-f01538a59ab0\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.764132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-combined-ca-bundle\") pod \"438a784a-03b1-4561-87c2-f01538a59ab0\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.764156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjbnd\" (UniqueName: \"kubernetes.io/projected/438a784a-03b1-4561-87c2-f01538a59ab0-kube-api-access-tjbnd\") pod \"438a784a-03b1-4561-87c2-f01538a59ab0\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.764200 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data\") pod \"438a784a-03b1-4561-87c2-f01538a59ab0\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.764228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data-custom\") pod \"438a784a-03b1-4561-87c2-f01538a59ab0\" (UID: \"438a784a-03b1-4561-87c2-f01538a59ab0\") " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765274 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765291 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765300 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765309 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7p467\" (UniqueName: \"kubernetes.io/projected/b31d6545-ddad-4fcf-b60d-47be899c6768-kube-api-access-7p467\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765328 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765338 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b31d6545-ddad-4fcf-b60d-47be899c6768-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.765527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438a784a-03b1-4561-87c2-f01538a59ab0-logs" (OuterVolumeSpecName: "logs") pod "438a784a-03b1-4561-87c2-f01538a59ab0" (UID: "438a784a-03b1-4561-87c2-f01538a59ab0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771161 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771720 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771739 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener-log" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-httpd" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771756 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-httpd" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771771 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771778 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771796 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771803 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771814 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771820 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-log" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771830 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771837 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api-log" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771848 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771853 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api" Nov 21 13:01:55 crc kubenswrapper[4769]: E1121 13:01:55.771865 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.771871 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772165 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772183 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" containerName="barbican-worker" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772217 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772231 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772242 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" containerName="barbican-api" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772251 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener-log" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772260 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" containerName="glance-httpd" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.772277 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" containerName="barbican-keystone-listener" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.773409 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.774309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "438a784a-03b1-4561-87c2-f01538a59ab0" (UID: "438a784a-03b1-4561-87c2-f01538a59ab0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.781159 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.781510 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.781723 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xpkvg" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.781729 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.785385 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.818761 4769 scope.go:117] "RemoveContainer" containerID="130465e96aaf25dfe6599c50e77a5c45f49f9013ac0c94c1d5aee250a1240fce" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.822749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438a784a-03b1-4561-87c2-f01538a59ab0-kube-api-access-tjbnd" (OuterVolumeSpecName: "kube-api-access-tjbnd") pod "438a784a-03b1-4561-87c2-f01538a59ab0" (UID: "438a784a-03b1-4561-87c2-f01538a59ab0"). InnerVolumeSpecName "kube-api-access-tjbnd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv47j\" (UniqueName: \"kubernetes.io/projected/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kube-api-access-sv47j\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867713 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/438a784a-03b1-4561-87c2-f01538a59ab0-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867730 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tjbnd\" (UniqueName: \"kubernetes.io/projected/438a784a-03b1-4561-87c2-f01538a59ab0-kube-api-access-tjbnd\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.867744 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sv47j\" (UniqueName: \"kubernetes.io/projected/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kube-api-access-sv47j\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.969614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.970318 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.970379 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.970612 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.971600 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.972899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.983135 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:55 crc kubenswrapper[4769]: I1121 13:01:55.983220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.000236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv47j\" (UniqueName: \"kubernetes.io/projected/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kube-api-access-sv47j\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.094650 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.173648 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: E1121 13:01:56.247791 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78 is running failed: container process not found" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:56 crc kubenswrapper[4769]: E1121 13:01:56.248506 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78 is running failed: container process not found" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:56 crc kubenswrapper[4769]: E1121 13:01:56.248795 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78 is running failed: container process not found" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:01:56 crc kubenswrapper[4769]: E1121 13:01:56.248835 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.298618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" event={"ID":"d5d88bb8-6d29-45d5-a769-94947f8042d5","Type":"ContainerStarted","Data":"2465c158e2d817cb7bc35ffb28fe2d3575288f9f7d533fb03c47e9a127895ff6"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.299089 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.304018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"ed6e1205-4575-417d-9b21-529dc83d8657","Type":"ContainerStarted","Data":"4caf1238d934341f8b0f95abf5b0dfb56033e1c8a602e0c171bff7c2a7dc088c"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.307475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" event={"ID":"88f54396-564d-48eb-a4c9-8b56b3a30a86","Type":"ContainerStarted","Data":"3dc1702410d782636a419124528d71a4e6d560d05c7c8db5e683d9502531dd1f"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.307903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.309073 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.312667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerStarted","Data":"2446d018456dbfaf4f5d3159c0d600b5aa579075f8cfe813f5c3b9eb5b4c191d"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.313009 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.317392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" event={"ID":"1b0b0b34-a9b3-4bff-927f-003d8869e1b5","Type":"ContainerStarted","Data":"6380cc4238b2ebe2414e3e527bb9b9ac858f9b5c2b818d5a059f2686c4427044"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.320022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"openstack-cell1-galera-0\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.348715 4769 generic.go:334] "Generic (PLEG): container finished" podID="d853692a-149a-4845-9f5b-36b451683066" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" exitCode=0 Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.348769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d853692a-149a-4845-9f5b-36b451683066","Type":"ContainerDied","Data":"095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.348862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d853692a-149a-4845-9f5b-36b451683066","Type":"ContainerDied","Data":"ebf904080b9406ba3e9f9a9c472f1140e498aa308ddb8571f3bcac00c003dd17"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.348885 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebf904080b9406ba3e9f9a9c472f1140e498aa308ddb8571f3bcac00c003dd17" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.355026 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.355277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfbba950-7b66-4271-929f-d81ed58141a6","Type":"ContainerStarted","Data":"c84ad1172babe28f337a6ea6bd0cd1d1ca034f9e9a596ffa2ee4bdd1e09fb169"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.376307 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerStarted","Data":"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4"} Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.376340 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.376445 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.383032 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.383164 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.400353 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.412394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "438a784a-03b1-4561-87c2-f01538a59ab0" (UID: "438a784a-03b1-4561-87c2-f01538a59ab0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.416021 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" podStartSLOduration=6.416002187 podStartE2EDuration="6.416002187s" podCreationTimestamp="2025-11-21 13:01:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:56.322056487 +0000 UTC m=+4275.022718305" watchObservedRunningTime="2025-11-21 13:01:56.416002187 +0000 UTC m=+4275.116664005" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.425399 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.435303 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" podStartSLOduration=6.435281426 podStartE2EDuration="6.435281426s" podCreationTimestamp="2025-11-21 13:01:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:56.360942224 +0000 UTC m=+4275.061604042" watchObservedRunningTime="2025-11-21 13:01:56.435281426 +0000 UTC m=+4275.135943244" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.442311 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data" (OuterVolumeSpecName: "config-data") pod "6af1865c-3e9f-4329-bc4b-94679b29dfee" (UID: "6af1865c-3e9f-4329-bc4b-94679b29dfee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.445744 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=6.445730228 podStartE2EDuration="6.445730228s" podCreationTimestamp="2025-11-21 13:01:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:56.387269393 +0000 UTC m=+4275.087931211" watchObservedRunningTime="2025-11-21 13:01:56.445730228 +0000 UTC m=+4275.146392046" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.473177 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-config-data" (OuterVolumeSpecName: "config-data") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.482353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b31d6545-ddad-4fcf-b60d-47be899c6768" (UID: "b31d6545-ddad-4fcf-b60d-47be899c6768"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.495371 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.495404 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6af1865c-3e9f-4329-bc4b-94679b29dfee-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.495414 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.495449 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.495458 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b31d6545-ddad-4fcf-b60d-47be899c6768-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.500585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data" (OuterVolumeSpecName: "config-data") pod "438a784a-03b1-4561-87c2-f01538a59ab0" (UID: "438a784a-03b1-4561-87c2-f01538a59ab0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.520842 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8] : Timed out while waiting for systemd to remove kubepods-besteffort-pod36c4a807_6b45_4e9d_a0b3_0a531b2fa9a8.slice" Nov 21 13:01:56 crc kubenswrapper[4769]: E1121 13:01:56.520896 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8] : Timed out while waiting for systemd to remove kubepods-besteffort-pod36c4a807_6b45_4e9d_a0b3_0a531b2fa9a8.slice" pod="openstack-kuttl-tests/ovn-northd-0" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.600254 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/438a784a-03b1-4561-87c2-f01538a59ab0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.739064 4769 scope.go:117] "RemoveContainer" containerID="afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.797987 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.907060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-combined-ca-bundle\") pod \"d853692a-149a-4845-9f5b-36b451683066\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.907157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9wjj\" (UniqueName: \"kubernetes.io/projected/d853692a-149a-4845-9f5b-36b451683066-kube-api-access-q9wjj\") pod \"d853692a-149a-4845-9f5b-36b451683066\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.907319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-config-data\") pod \"d853692a-149a-4845-9f5b-36b451683066\" (UID: \"d853692a-149a-4845-9f5b-36b451683066\") " Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.928588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d853692a-149a-4845-9f5b-36b451683066-kube-api-access-q9wjj" (OuterVolumeSpecName: "kube-api-access-q9wjj") pod "d853692a-149a-4845-9f5b-36b451683066" (UID: "d853692a-149a-4845-9f5b-36b451683066"). InnerVolumeSpecName "kube-api-access-q9wjj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.929021 4769 scope.go:117] "RemoveContainer" containerID="52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871" Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.980837 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr"] Nov 21 13:01:56 crc kubenswrapper[4769]: I1121 13:01:56.991387 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7b865965cb-xpfpr"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.009851 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q9wjj\" (UniqueName: \"kubernetes.io/projected/d853692a-149a-4845-9f5b-36b451683066-kube-api-access-q9wjj\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.030037 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.070705 4769 scope.go:117] "RemoveContainer" containerID="ce52af3fb926af5db12b7d83d89faf2633c266034d9f6e60ab8c6c0e896f0743" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.072816 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74b485df6b-p74zg"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.087350 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.087405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d853692a-149a-4845-9f5b-36b451683066" (UID: "d853692a-149a-4845-9f5b-36b451683066"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.094158 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-config-data" (OuterVolumeSpecName: "config-data") pod "d853692a-149a-4845-9f5b-36b451683066" (UID: "d853692a-149a-4845-9f5b-36b451683066"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.094516 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5fc9bd79f-l2nmx"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.102634 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.112934 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.112967 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d853692a-149a-4845-9f5b-36b451683066-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.115459 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.123618 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: E1121 13:01:57.124075 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.124089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:57 crc kubenswrapper[4769]: E1121 13:01:57.124114 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.124122 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.124674 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.125269 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d853692a-149a-4845-9f5b-36b451683066" containerName="nova-cell0-conductor-conductor" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.130843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.136590 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.136811 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.157217 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.176584 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-logs\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214159 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntdjk\" (UniqueName: \"kubernetes.io/projected/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-kube-api-access-ntdjk\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.214683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.288875 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="048b3b15-392d-49b6-87e3-251369ff8245" path="/var/lib/kubelet/pods/048b3b15-392d-49b6-87e3-251369ff8245/volumes" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.289508 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="438a784a-03b1-4561-87c2-f01538a59ab0" path="/var/lib/kubelet/pods/438a784a-03b1-4561-87c2-f01538a59ab0/volumes" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.290075 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af1865c-3e9f-4329-bc4b-94679b29dfee" path="/var/lib/kubelet/pods/6af1865c-3e9f-4329-bc4b-94679b29dfee/volumes" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.292988 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31d6545-ddad-4fcf-b60d-47be899c6768" path="/var/lib/kubelet/pods/b31d6545-ddad-4fcf-b60d-47be899c6768/volumes" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.293908 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9ee1d2-edd5-4be8-9dc8-073dc798c06b" path="/var/lib/kubelet/pods/fc9ee1d2-edd5-4be8-9dc8-073dc798c06b/volumes" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.317453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ntdjk\" (UniqueName: \"kubernetes.io/projected/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-kube-api-access-ntdjk\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.317519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.318658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-logs\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.319075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.319297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.319932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.320172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-logs\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.321162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.321239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.321292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.321715 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.325964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.335853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntdjk\" (UniqueName: \"kubernetes.io/projected/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-kube-api-access-ntdjk\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.337472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-scripts\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.338214 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-config-data\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.338701 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.421117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"glance-default-internal-api-0\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.430515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.431244 4769 generic.go:334] "Generic (PLEG): container finished" podID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerID="cbb5c0eb7f259acc3323bb8b5c8d9c401022227da65a83cfa64853886e2cb033" exitCode=137 Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.431291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" event={"ID":"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10","Type":"ContainerDied","Data":"cbb5c0eb7f259acc3323bb8b5c8d9c401022227da65a83cfa64853886e2cb033"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.435913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"ed6e1205-4575-417d-9b21-529dc83d8657","Type":"ContainerStarted","Data":"c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.451308 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerID="cab074cf17b3d5b37ba09f5bb242cd52223a16513444fa2e9c42eacd2f71b783" exitCode=0 Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.451445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" event={"ID":"bd176a47-2143-45c9-85a5-ab6a32848a86","Type":"ContainerDied","Data":"cab074cf17b3d5b37ba09f5bb242cd52223a16513444fa2e9c42eacd2f71b783"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.458347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerStarted","Data":"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.459511 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.459539 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.462938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"85ecd4b2-b5ed-4780-993a-2433bae3b108","Type":"ContainerStarted","Data":"5913565eff79975fb6128d5e833d4bf2c848a17163e329a7cc6d6af59f0010dc"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.462969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"85ecd4b2-b5ed-4780-993a-2433bae3b108","Type":"ContainerStarted","Data":"3ed227092f9c16f36851393f66523eb1328c41b6f8f8942ec0f76d4a4dfef547"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.463588 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.465790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" event={"ID":"1b0b0b34-a9b3-4bff-927f-003d8869e1b5","Type":"ContainerStarted","Data":"d753aa6fab713fea9f2a6b44ac5416eee7d5a96225297555633984c3d5e91db0"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.466284 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.467734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfbba950-7b66-4271-929f-d81ed58141a6","Type":"ContainerStarted","Data":"3ad645cf8690c7e4ae8e0ff281c40e184f73046c19b3fcbb9d042efab077e060"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.475645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b581db1b-0a9b-4010-81d8-5cc9563d71a3","Type":"ContainerStarted","Data":"437bbdd83dd6e2debbfe8cbe6849af0f7a425dea5e196acc93e2df3a4c79628a"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.478486 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podStartSLOduration=7.47846923 podStartE2EDuration="7.47846923s" podCreationTimestamp="2025-11-21 13:01:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:57.475715896 +0000 UTC m=+4276.176377714" watchObservedRunningTime="2025-11-21 13:01:57.47846923 +0000 UTC m=+4276.179131048" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.492607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e47277e-4b55-48b1-ac84-e1d6249ecf96","Type":"ContainerStarted","Data":"9217dd0ccdcdd19d8aa2b8d872c426b2ba18f62091f5d697032473cea2fbce76"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.518435 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podStartSLOduration=7.5184158960000005 podStartE2EDuration="7.518415896s" podCreationTimestamp="2025-11-21 13:01:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:57.492443956 +0000 UTC m=+4276.193105764" watchObservedRunningTime="2025-11-21 13:01:57.518415896 +0000 UTC m=+4276.219077714" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.532657 4769 generic.go:334] "Generic (PLEG): container finished" podID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerID="f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828" exitCode=137 Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.536931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" event={"ID":"9239d708-5ee4-40e4-ae65-cfdc903874f3","Type":"ContainerDied","Data":"f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.536987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" event={"ID":"9239d708-5ee4-40e4-ae65-cfdc903874f3","Type":"ContainerDied","Data":"dc9a2c1452befe62377bb952ff5fdb9822993ed50ff5b8e2556fc3f8179890d9"} Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.537009 4769 scope.go:117] "RemoveContainer" containerID="f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.537796 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.537904 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.538126 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.562453 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=8.562430531 podStartE2EDuration="8.562430531s" podCreationTimestamp="2025-11-21 13:01:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:57.520785349 +0000 UTC m=+4276.221447167" watchObservedRunningTime="2025-11-21 13:01:57.562430531 +0000 UTC m=+4276.263092349" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.592935 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=7.592911292 podStartE2EDuration="7.592911292s" podCreationTimestamp="2025-11-21 13:01:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:57.558081744 +0000 UTC m=+4276.258743562" watchObservedRunningTime="2025-11-21 13:01:57.592911292 +0000 UTC m=+4276.293573110" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.604062 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=4.604043841 podStartE2EDuration="4.604043841s" podCreationTimestamp="2025-11-21 13:01:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:57.582099961 +0000 UTC m=+4276.282761779" watchObservedRunningTime="2025-11-21 13:01:57.604043841 +0000 UTC m=+4276.304705659" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.635297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data-custom\") pod \"9239d708-5ee4-40e4-ae65-cfdc903874f3\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.635358 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9239d708-5ee4-40e4-ae65-cfdc903874f3-logs\") pod \"9239d708-5ee4-40e4-ae65-cfdc903874f3\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.635391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljrcn\" (UniqueName: \"kubernetes.io/projected/9239d708-5ee4-40e4-ae65-cfdc903874f3-kube-api-access-ljrcn\") pod \"9239d708-5ee4-40e4-ae65-cfdc903874f3\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.635516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-combined-ca-bundle\") pod \"9239d708-5ee4-40e4-ae65-cfdc903874f3\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.635543 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data\") pod \"9239d708-5ee4-40e4-ae65-cfdc903874f3\" (UID: \"9239d708-5ee4-40e4-ae65-cfdc903874f3\") " Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.643199 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9239d708-5ee4-40e4-ae65-cfdc903874f3-logs" (OuterVolumeSpecName: "logs") pod "9239d708-5ee4-40e4-ae65-cfdc903874f3" (UID: "9239d708-5ee4-40e4-ae65-cfdc903874f3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.687343 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.687684 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9239d708-5ee4-40e4-ae65-cfdc903874f3" (UID: "9239d708-5ee4-40e4-ae65-cfdc903874f3"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.697572 4769 scope.go:117] "RemoveContainer" containerID="05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.712385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9239d708-5ee4-40e4-ae65-cfdc903874f3-kube-api-access-ljrcn" (OuterVolumeSpecName: "kube-api-access-ljrcn") pod "9239d708-5ee4-40e4-ae65-cfdc903874f3" (UID: "9239d708-5ee4-40e4-ae65-cfdc903874f3"). InnerVolumeSpecName "kube-api-access-ljrcn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.734575 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.738328 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.738345 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9239d708-5ee4-40e4-ae65-cfdc903874f3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.738355 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ljrcn\" (UniqueName: \"kubernetes.io/projected/9239d708-5ee4-40e4-ae65-cfdc903874f3-kube-api-access-ljrcn\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.746115 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.753510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data" (OuterVolumeSpecName: "config-data") pod "9239d708-5ee4-40e4-ae65-cfdc903874f3" (UID: "9239d708-5ee4-40e4-ae65-cfdc903874f3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.762377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9239d708-5ee4-40e4-ae65-cfdc903874f3" (UID: "9239d708-5ee4-40e4-ae65-cfdc903874f3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.768414 4769 scope.go:117] "RemoveContainer" containerID="f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828" Nov 21 13:01:57 crc kubenswrapper[4769]: E1121 13:01:57.773508 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828\": container with ID starting with f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828 not found: ID does not exist" containerID="f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.773551 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828"} err="failed to get container status \"f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828\": rpc error: code = NotFound desc = could not find container \"f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828\": container with ID starting with f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828 not found: ID does not exist" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.773575 4769 scope.go:117] "RemoveContainer" containerID="05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2" Nov 21 13:01:57 crc kubenswrapper[4769]: E1121 13:01:57.777457 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2\": container with ID starting with 05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2 not found: ID does not exist" containerID="05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.777492 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2"} err="failed to get container status \"05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2\": rpc error: code = NotFound desc = could not find container \"05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2\": container with ID starting with 05b5e666d3cba771aaded0cfd1003e1ec4f68a57cc7abf1b24734b7a053633d2 not found: ID does not exist" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.788252 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: E1121 13:01:57.788743 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker-log" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.788767 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker-log" Nov 21 13:01:57 crc kubenswrapper[4769]: E1121 13:01:57.788807 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.788814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.789007 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker-log" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.789037 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" containerName="barbican-worker" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.790083 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.794578 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.794689 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.794757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-5l6g6" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.795310 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.835541 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-scripts\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sqt7\" (UniqueName: \"kubernetes.io/projected/af2b42df-4d9d-403f-9aac-87d7005ad082-kube-api-access-4sqt7\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839916 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-config\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.839998 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.840058 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.840073 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9239d708-5ee4-40e4-ae65-cfdc903874f3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.859496 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.875236 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.230:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.876470 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.889441 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.890831 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.895174 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.917468 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.938240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.938293 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-577595dd45-4fsf2"] Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-config\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946561 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9m56\" (UniqueName: \"kubernetes.io/projected/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-kube-api-access-v9m56\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-scripts\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4sqt7\" (UniqueName: \"kubernetes.io/projected/af2b42df-4d9d-403f-9aac-87d7005ad082-kube-api-access-4sqt7\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.946711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.947201 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.948808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-scripts\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.948850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-config\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.952671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.954072 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.962963 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:57 crc kubenswrapper[4769]: I1121 13:01:57.967152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sqt7\" (UniqueName: \"kubernetes.io/projected/af2b42df-4d9d-403f-9aac-87d7005ad082-kube-api-access-4sqt7\") pod \"ovn-northd-0\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.077625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.077852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.077930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v9m56\" (UniqueName: \"kubernetes.io/projected/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-kube-api-access-v9m56\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.096969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.097421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.106648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9m56\" (UniqueName: \"kubernetes.io/projected/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-kube-api-access-v9m56\") pod \"nova-cell0-conductor-0\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.122071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.205077 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.242003 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.244499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.256898 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.374551 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4759ef3d-e00f-42ee-9964-82553f02b530-logs\") pod \"4759ef3d-e00f-42ee-9964-82553f02b530\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-combined-ca-bundle\") pod \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data\") pod \"4759ef3d-e00f-42ee-9964-82553f02b530\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data\") pod \"bd176a47-2143-45c9-85a5-ab6a32848a86\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data-custom\") pod \"bd176a47-2143-45c9-85a5-ab6a32848a86\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data-custom\") pod \"4759ef3d-e00f-42ee-9964-82553f02b530\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385482 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww4t6\" (UniqueName: \"kubernetes.io/projected/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-kube-api-access-ww4t6\") pod \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-combined-ca-bundle\") pod \"4759ef3d-e00f-42ee-9964-82553f02b530\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nbkl\" (UniqueName: \"kubernetes.io/projected/bd176a47-2143-45c9-85a5-ab6a32848a86-kube-api-access-7nbkl\") pod \"bd176a47-2143-45c9-85a5-ab6a32848a86\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data\") pod \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data-custom\") pod \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-logs\") pod \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\" (UID: \"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd176a47-2143-45c9-85a5-ab6a32848a86-logs\") pod \"bd176a47-2143-45c9-85a5-ab6a32848a86\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbc9c\" (UniqueName: \"kubernetes.io/projected/4759ef3d-e00f-42ee-9964-82553f02b530-kube-api-access-xbc9c\") pod \"4759ef3d-e00f-42ee-9964-82553f02b530\" (UID: \"4759ef3d-e00f-42ee-9964-82553f02b530\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-combined-ca-bundle\") pod \"bd176a47-2143-45c9-85a5-ab6a32848a86\" (UID: \"bd176a47-2143-45c9-85a5-ab6a32848a86\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.385764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4759ef3d-e00f-42ee-9964-82553f02b530-logs" (OuterVolumeSpecName: "logs") pod "4759ef3d-e00f-42ee-9964-82553f02b530" (UID: "4759ef3d-e00f-42ee-9964-82553f02b530"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.386181 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4759ef3d-e00f-42ee-9964-82553f02b530-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.392016 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-logs" (OuterVolumeSpecName: "logs") pod "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" (UID: "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.392141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd176a47-2143-45c9-85a5-ab6a32848a86-logs" (OuterVolumeSpecName: "logs") pod "bd176a47-2143-45c9-85a5-ab6a32848a86" (UID: "bd176a47-2143-45c9-85a5-ab6a32848a86"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.393115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" (UID: "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.395851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-kube-api-access-ww4t6" (OuterVolumeSpecName: "kube-api-access-ww4t6") pod "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" (UID: "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10"). InnerVolumeSpecName "kube-api-access-ww4t6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.405226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bd176a47-2143-45c9-85a5-ab6a32848a86" (UID: "bd176a47-2143-45c9-85a5-ab6a32848a86"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.405626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd176a47-2143-45c9-85a5-ab6a32848a86-kube-api-access-7nbkl" (OuterVolumeSpecName: "kube-api-access-7nbkl") pod "bd176a47-2143-45c9-85a5-ab6a32848a86" (UID: "bd176a47-2143-45c9-85a5-ab6a32848a86"). InnerVolumeSpecName "kube-api-access-7nbkl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.406981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4759ef3d-e00f-42ee-9964-82553f02b530" (UID: "4759ef3d-e00f-42ee-9964-82553f02b530"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.434027 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4759ef3d-e00f-42ee-9964-82553f02b530-kube-api-access-xbc9c" (OuterVolumeSpecName: "kube-api-access-xbc9c") pod "4759ef3d-e00f-42ee-9964-82553f02b530" (UID: "4759ef3d-e00f-42ee-9964-82553f02b530"). InnerVolumeSpecName "kube-api-access-xbc9c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.496247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-combined-ca-bundle\") pod \"1b17ed17-ae28-4189-84ea-977b0803d0ad\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.496699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr84s\" (UniqueName: \"kubernetes.io/projected/1b17ed17-ae28-4189-84ea-977b0803d0ad-kube-api-access-wr84s\") pod \"1b17ed17-ae28-4189-84ea-977b0803d0ad\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.496789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-config-data\") pod \"1b17ed17-ae28-4189-84ea-977b0803d0ad\" (UID: \"1b17ed17-ae28-4189-84ea-977b0803d0ad\") " Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497420 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd176a47-2143-45c9-85a5-ab6a32848a86-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497451 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xbc9c\" (UniqueName: \"kubernetes.io/projected/4759ef3d-e00f-42ee-9964-82553f02b530-kube-api-access-xbc9c\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497462 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497471 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497479 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ww4t6\" (UniqueName: \"kubernetes.io/projected/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-kube-api-access-ww4t6\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497487 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7nbkl\" (UniqueName: \"kubernetes.io/projected/bd176a47-2143-45c9-85a5-ab6a32848a86-kube-api-access-7nbkl\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497495 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.497519 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.500281 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.503634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4759ef3d-e00f-42ee-9964-82553f02b530" (UID: "4759ef3d-e00f-42ee-9964-82553f02b530"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.513917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd176a47-2143-45c9-85a5-ab6a32848a86" (UID: "bd176a47-2143-45c9-85a5-ab6a32848a86"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.514182 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b17ed17-ae28-4189-84ea-977b0803d0ad-kube-api-access-wr84s" (OuterVolumeSpecName: "kube-api-access-wr84s") pod "1b17ed17-ae28-4189-84ea-977b0803d0ad" (UID: "1b17ed17-ae28-4189-84ea-977b0803d0ad"). InnerVolumeSpecName "kube-api-access-wr84s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.521505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data" (OuterVolumeSpecName: "config-data") pod "bd176a47-2143-45c9-85a5-ab6a32848a86" (UID: "bd176a47-2143-45c9-85a5-ab6a32848a86"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.536331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" (UID: "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.553301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data" (OuterVolumeSpecName: "config-data") pod "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" (UID: "b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.564836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" event={"ID":"b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10","Type":"ContainerDied","Data":"9bc39aaab42eee5bcc7d9097754476566dcc742d443a01fbb77c62164857d1d3"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.564887 4769 scope.go:117] "RemoveContainer" containerID="cbb5c0eb7f259acc3323bb8b5c8d9c401022227da65a83cfa64853886e2cb033" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.565004 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.565455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b17ed17-ae28-4189-84ea-977b0803d0ad" (UID: "1b17ed17-ae28-4189-84ea-977b0803d0ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.576560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"ed6e1205-4575-417d-9b21-529dc83d8657","Type":"ContainerStarted","Data":"8dc7ca31c97aaa0fbc2ec5667cb2256ab26fad754d649fb90c79e49d352028cf"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.586827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data" (OuterVolumeSpecName: "config-data") pod "4759ef3d-e00f-42ee-9964-82553f02b530" (UID: "4759ef3d-e00f-42ee-9964-82553f02b530"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.592304 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b17ed17-ae28-4189-84ea-977b0803d0ad" containerID="fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87" exitCode=137 Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.592407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b17ed17-ae28-4189-84ea-977b0803d0ad","Type":"ContainerDied","Data":"fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.592439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b17ed17-ae28-4189-84ea-977b0803d0ad","Type":"ContainerDied","Data":"11b8bfb4006074affd4104c6b00cace28f222d993b1543a0f10df4332d7daea9"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.592511 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.595156 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=6.595137821 podStartE2EDuration="6.595137821s" podCreationTimestamp="2025-11-21 13:01:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:58.594628177 +0000 UTC m=+4277.295289995" watchObservedRunningTime="2025-11-21 13:01:58.595137821 +0000 UTC m=+4277.295799639" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599545 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599575 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599583 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599592 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4759ef3d-e00f-42ee-9964-82553f02b530-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599603 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599612 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599623 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wr84s\" (UniqueName: \"kubernetes.io/projected/1b17ed17-ae28-4189-84ea-977b0803d0ad-kube-api-access-wr84s\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.599635 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd176a47-2143-45c9-85a5-ab6a32848a86-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.610859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-config-data" (OuterVolumeSpecName: "config-data") pod "1b17ed17-ae28-4189-84ea-977b0803d0ad" (UID: "1b17ed17-ae28-4189-84ea-977b0803d0ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.635709 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerID="d3a2152c08150448f236510b02f8edc967b1bd0b0973670263479ee50304ebf5" exitCode=0 Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.635800 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e47277e-4b55-48b1-ac84-e1d6249ecf96","Type":"ContainerDied","Data":"d3a2152c08150448f236510b02f8edc967b1bd0b0973670263479ee50304ebf5"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.645531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" event={"ID":"bd176a47-2143-45c9-85a5-ab6a32848a86","Type":"ContainerDied","Data":"80e1b70c3c78505fc9368883e94e8ca4a0d4761b51f7679cece305838286cd6a"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.645609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.677109 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.696044 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-849765d566-kngb8"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.696829 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.221:8778/\": EOF" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.696889 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.221:8778/\": EOF" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.700040 4769 generic.go:334] "Generic (PLEG): container finished" podID="4759ef3d-e00f-42ee-9964-82553f02b530" containerID="34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a" exitCode=0 Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.700384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.700427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" event={"ID":"4759ef3d-e00f-42ee-9964-82553f02b530","Type":"ContainerDied","Data":"34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.700459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s" event={"ID":"4759ef3d-e00f-42ee-9964-82553f02b530","Type":"ContainerDied","Data":"af439801b2493befa74f374bcfae45541fd93b02c79703b135f4f32365c45c3f"} Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.701623 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b17ed17-ae28-4189-84ea-977b0803d0ad-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.710316 4769 scope.go:117] "RemoveContainer" containerID="d96d5a3d9c316962b35ba1fa7f9d314612460d96fc2a350d8150a874ca24d9ec" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.725911 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.743884 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6c47ddb6fd-kdb6s"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.753399 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.762234 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-bf8dddb95-6885s"] Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.763474 4769 scope.go:117] "RemoveContainer" containerID="fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.837039 4769 scope.go:117] "RemoveContainer" containerID="fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87" Nov 21 13:01:58 crc kubenswrapper[4769]: E1121 13:01:58.839655 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87\": container with ID starting with fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87 not found: ID does not exist" containerID="fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.839702 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87"} err="failed to get container status \"fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87\": rpc error: code = NotFound desc = could not find container \"fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87\": container with ID starting with fcc5297e9748b03c83ab169a397d5c1848e39399321cc2c2a49a310ebf173a87 not found: ID does not exist" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.839741 4769 scope.go:117] "RemoveContainer" containerID="cab074cf17b3d5b37ba09f5bb242cd52223a16513444fa2e9c42eacd2f71b783" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.944400 4769 scope.go:117] "RemoveContainer" containerID="c7d15563af38f74e6fa9a5ecdde1379c569ac10dd311b504d05f4547b677ff86" Nov 21 13:01:58 crc kubenswrapper[4769]: I1121 13:01:58.981327 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.085149 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.097479 4769 scope.go:117] "RemoveContainer" containerID="34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.211214 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.239388 4769 scope.go:117] "RemoveContainer" containerID="926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.241081 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.261608 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262068 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262080 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262098 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262105 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker-log" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262119 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262125 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener-log" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262142 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262148 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262160 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b17ed17-ae28-4189-84ea-977b0803d0ad" containerName="nova-scheduler-scheduler" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262165 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b17ed17-ae28-4189-84ea-977b0803d0ad" containerName="nova-scheduler-scheduler" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262183 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.262229 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262235 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262438 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262454 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" containerName="barbican-keystone-listener" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262491 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" containerName="barbican-keystone-listener-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262505 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b17ed17-ae28-4189-84ea-977b0803d0ad" containerName="nova-scheduler-scheduler" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262517 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker-log" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.262531 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" containerName="barbican-worker" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.263838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.267778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.305129 4769 scope.go:117] "RemoveContainer" containerID="34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.306522 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a\": container with ID starting with 34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a not found: ID does not exist" containerID="34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.306580 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a"} err="failed to get container status \"34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a\": rpc error: code = NotFound desc = could not find container \"34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a\": container with ID starting with 34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a not found: ID does not exist" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.306619 4769 scope.go:117] "RemoveContainer" containerID="926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680" Nov 21 13:01:59 crc kubenswrapper[4769]: E1121 13:01:59.307051 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680\": container with ID starting with 926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680 not found: ID does not exist" containerID="926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.307074 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680"} err="failed to get container status \"926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680\": rpc error: code = NotFound desc = could not find container \"926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680\": container with ID starting with 926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680 not found: ID does not exist" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.308753 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b17ed17-ae28-4189-84ea-977b0803d0ad" path="/var/lib/kubelet/pods/1b17ed17-ae28-4189-84ea-977b0803d0ad/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.310622 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8" path="/var/lib/kubelet/pods/36c4a807-6b45-4e9d-a0b3-0a531b2fa9a8/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.311583 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4759ef3d-e00f-42ee-9964-82553f02b530" path="/var/lib/kubelet/pods/4759ef3d-e00f-42ee-9964-82553f02b530/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.317780 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qdvp\" (UniqueName: \"kubernetes.io/projected/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-kube-api-access-5qdvp\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.318136 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9239d708-5ee4-40e4-ae65-cfdc903874f3" path="/var/lib/kubelet/pods/9239d708-5ee4-40e4-ae65-cfdc903874f3/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.318235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-config-data\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.318359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.319085 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10" path="/var/lib/kubelet/pods/b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.319716 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd176a47-2143-45c9-85a5-ab6a32848a86" path="/var/lib/kubelet/pods/bd176a47-2143-45c9-85a5-ab6a32848a86/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.320859 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d853692a-149a-4845-9f5b-36b451683066" path="/var/lib/kubelet/pods/d853692a-149a-4845-9f5b-36b451683066/volumes" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.321480 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.353358 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.419838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-scripts\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.419931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-combined-ca-bundle\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-config-data\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-logs\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-internal-tls-certs\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hfkv\" (UniqueName: \"kubernetes.io/projected/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-kube-api-access-5hfkv\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-public-tls-certs\") pod \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\" (UID: \"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0\") " Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-config-data\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.420628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5qdvp\" (UniqueName: \"kubernetes.io/projected/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-kube-api-access-5qdvp\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.421732 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-logs" (OuterVolumeSpecName: "logs") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.429280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-scripts" (OuterVolumeSpecName: "scripts") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.438300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-config-data\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.438597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-kube-api-access-5hfkv" (OuterVolumeSpecName: "kube-api-access-5hfkv") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "kube-api-access-5hfkv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.438728 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.439308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qdvp\" (UniqueName: \"kubernetes.io/projected/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-kube-api-access-5qdvp\") pod \"nova-scheduler-0\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.523156 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5hfkv\" (UniqueName: \"kubernetes.io/projected/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-kube-api-access-5hfkv\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.523198 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.523208 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.530874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-config-data" (OuterVolumeSpecName: "config-data") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.531076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.582038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.596510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.606137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" (UID: "be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.624988 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.625011 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.625020 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.625028 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.818135 4769 generic.go:334] "Generic (PLEG): container finished" podID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerID="afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d" exitCode=137 Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.818247 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.818267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" event={"ID":"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0","Type":"ContainerDied","Data":"afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.818849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7fdbb7969d-2vcpx" event={"ID":"be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0","Type":"ContainerDied","Data":"9b6bbf733d6763f0dfc1dbf2bd90da6184437b57978cde5ef42ed446706c9d7a"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.818869 4769 scope.go:117] "RemoveContainer" containerID="afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.825083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e47277e-4b55-48b1-ac84-e1d6249ecf96","Type":"ContainerStarted","Data":"549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.837886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerStarted","Data":"2dfe53b5effac76f3aed6f44b3e9acc0b27e400ad94ea0fa90b97f1a0f6df8e8"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.837937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerStarted","Data":"bb23c021c4b58f724a4254c6d1f145c6844099c8c4b6e949dc5c93224bb75a01"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.839017 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.841844 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.867170 4769 generic.go:334] "Generic (PLEG): container finished" podID="a58794b2-3db0-4930-84f4-d8757325a776" containerID="2446d018456dbfaf4f5d3159c0d600b5aa579075f8cfe813f5c3b9eb5b4c191d" exitCode=1 Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.867240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerDied","Data":"2446d018456dbfaf4f5d3159c0d600b5aa579075f8cfe813f5c3b9eb5b4c191d"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.867687 4769 scope.go:117] "RemoveContainer" containerID="2446d018456dbfaf4f5d3159c0d600b5aa579075f8cfe813f5c3b9eb5b4c191d" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.877623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6","Type":"ContainerStarted","Data":"adc4e088af3f8340facbf46612ba74f63a0c996426c7f0f1136f9ecb61116a20"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.877710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6","Type":"ContainerStarted","Data":"a072a434dfc39e5ce32ab5b3677f4216904fc8dea195721f0d1adfc91d5a2972"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.890778 4769 scope.go:117] "RemoveContainer" containerID="ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.910238 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=4.910213964 podStartE2EDuration="4.910213964s" podCreationTimestamp="2025-11-21 13:01:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:59.8566041 +0000 UTC m=+4278.557265918" watchObservedRunningTime="2025-11-21 13:01:59.910213964 +0000 UTC m=+4278.610875782" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.923858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"af2b42df-4d9d-403f-9aac-87d7005ad082","Type":"ContainerStarted","Data":"590e228d49d05abb2be4d1a84c6f2163c933790fed2e99c43fe83a46e2d9ea93"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.923895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"af2b42df-4d9d-403f-9aac-87d7005ad082","Type":"ContainerStarted","Data":"abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.923909 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.923919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"af2b42df-4d9d-403f-9aac-87d7005ad082","Type":"ContainerStarted","Data":"95c53942f7f6aad9fecdd36ef7e073cf9fc1c692b6f4390fee72928580ecebfc"} Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.937925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.93790621 podStartE2EDuration="2.93790621s" podCreationTimestamp="2025-11-21 13:01:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:59.917673935 +0000 UTC m=+4278.618335753" watchObservedRunningTime="2025-11-21 13:01:59.93790621 +0000 UTC m=+4278.638568018" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.960038 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:01:59 crc kubenswrapper[4769]: I1121 13:01:59.990330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7fdbb7969d-2vcpx"] Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.005784 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7fdbb7969d-2vcpx"] Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.023204 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.023169306 podStartE2EDuration="3.023169306s" podCreationTimestamp="2025-11-21 13:01:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:01:59.990298111 +0000 UTC m=+4278.690959929" watchObservedRunningTime="2025-11-21 13:02:00.023169306 +0000 UTC m=+4278.723831124" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.125539 4769 scope.go:117] "RemoveContainer" containerID="afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d" Nov 21 13:02:00 crc kubenswrapper[4769]: E1121 13:02:00.137331 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d\": container with ID starting with afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d not found: ID does not exist" containerID="afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.137393 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d"} err="failed to get container status \"afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d\": rpc error: code = NotFound desc = could not find container \"afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d\": container with ID starting with afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d not found: ID does not exist" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.137419 4769 scope.go:117] "RemoveContainer" containerID="ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d" Nov 21 13:02:00 crc kubenswrapper[4769]: E1121 13:02:00.140568 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d\": container with ID starting with ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d not found: ID does not exist" containerID="ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.140597 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d"} err="failed to get container status \"ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d\": rpc error: code = NotFound desc = could not find container \"ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d\": container with ID starting with ee1664c29c724f3293ede4c18458dbddb16fde32c275cd2ddc1001d3a79e7a4d not found: ID does not exist" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.240245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.393381 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.393429 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.444757 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.450803 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.623089 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.228:9696/\": dial tcp 10.217.0.228:9696: connect: connection refused" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.631559 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8b71c1a7-9cac-4999-a86d-ef9dd005cd51"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8b71c1a7-9cac-4999-a86d-ef9dd005cd51] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8b71c1a7_9cac_4999_a86d_ef9dd005cd51.slice" Nov 21 13:02:00 crc kubenswrapper[4769]: E1121 13:02:00.631617 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod8b71c1a7-9cac-4999-a86d-ef9dd005cd51] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod8b71c1a7-9cac-4999-a86d-ef9dd005cd51] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8b71c1a7_9cac_4999_a86d_ef9dd005cd51.slice" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.637797 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.933829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63886233-7dcb-4bfa-acb9-3d7dffb0fb33","Type":"ContainerStarted","Data":"e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826"} Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.933891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63886233-7dcb-4bfa-acb9-3d7dffb0fb33","Type":"ContainerStarted","Data":"77a149087e4b36487c8154ff1a16bbcfdfbaf75fe7f4ce69de6fbedb2aae75e8"} Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.936234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6","Type":"ContainerStarted","Data":"78d0d12329ad5d4ba8fca9096f6dbb32b7737e92d32adee26a00e90783337bab"} Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.940802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerStarted","Data":"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde"} Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.943482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerStarted","Data":"da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48"} Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.943683 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6f48d8578c-kdj4r" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.944826 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.944867 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.958507 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:02:00 crc kubenswrapper[4769]: I1121 13:02:00.984271 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.984249567 podStartE2EDuration="1.984249567s" podCreationTimestamp="2025-11-21 13:01:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:00.972746307 +0000 UTC m=+4279.673408125" watchObservedRunningTime="2025-11-21 13:02:00.984249567 +0000 UTC m=+4279.684911405" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.007856 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.060280 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.060262624 podStartE2EDuration="4.060262624s" podCreationTimestamp="2025-11-21 13:01:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:01.057368526 +0000 UTC m=+4279.758030354" watchObservedRunningTime="2025-11-21 13:02:01.060262624 +0000 UTC m=+4279.760924442" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.078954 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6f48d8578c-kdj4r"] Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.086633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6f48d8578c-kdj4r"] Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.304927 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b71c1a7-9cac-4999-a86d-ef9dd005cd51" path="/var/lib/kubelet/pods/8b71c1a7-9cac-4999-a86d-ef9dd005cd51/volumes" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.305652 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" path="/var/lib/kubelet/pods/be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0/volumes" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.616930 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.618320 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.618343 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.618379 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.636752 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.960380 4769 generic.go:334] "Generic (PLEG): container finished" podID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerID="2dfe53b5effac76f3aed6f44b3e9acc0b27e400ad94ea0fa90b97f1a0f6df8e8" exitCode=1 Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.960590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerDied","Data":"2dfe53b5effac76f3aed6f44b3e9acc0b27e400ad94ea0fa90b97f1a0f6df8e8"} Nov 21 13:02:01 crc kubenswrapper[4769]: I1121 13:02:01.961053 4769 scope.go:117] "RemoveContainer" containerID="2dfe53b5effac76f3aed6f44b3e9acc0b27e400ad94ea0fa90b97f1a0f6df8e8" Nov 21 13:02:02 crc kubenswrapper[4769]: I1121 13:02:02.631352 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:02 crc kubenswrapper[4769]: I1121 13:02:02.631377 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:02 crc kubenswrapper[4769]: I1121 13:02:02.876465 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.230:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:02 crc kubenswrapper[4769]: I1121 13:02:02.877536 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.039090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerStarted","Data":"176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6"} Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.040023 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.052960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerStarted","Data":"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c"} Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.053167 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-central-agent" containerID="cri-o://1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" gracePeriod=30 Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.053858 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="proxy-httpd" containerID="cri-o://6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" gracePeriod=30 Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.053964 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.054018 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-notification-agent" containerID="cri-o://74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" gracePeriod=30 Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.054069 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="sg-core" containerID="cri-o://01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" gracePeriod=30 Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.073433 4769 generic.go:334] "Generic (PLEG): container finished" podID="a58794b2-3db0-4930-84f4-d8757325a776" containerID="da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48" exitCode=1 Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.074557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerDied","Data":"da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48"} Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.074611 4769 scope.go:117] "RemoveContainer" containerID="2446d018456dbfaf4f5d3159c0d600b5aa579075f8cfe813f5c3b9eb5b4c191d" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.074752 4769 scope.go:117] "RemoveContainer" containerID="da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48" Nov 21 13:02:03 crc kubenswrapper[4769]: E1121 13:02:03.074967 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(a58794b2-3db0-4930-84f4-d8757325a776)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.097343 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.156745802 podStartE2EDuration="14.09732136s" podCreationTimestamp="2025-11-21 13:01:49 +0000 UTC" firstStartedPulling="2025-11-21 13:01:50.857260598 +0000 UTC m=+4269.557922426" lastFinishedPulling="2025-11-21 13:02:01.797836166 +0000 UTC m=+4280.498497984" observedRunningTime="2025-11-21 13:02:03.074512355 +0000 UTC m=+4281.775174173" watchObservedRunningTime="2025-11-21 13:02:03.09732136 +0000 UTC m=+4281.797983178" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.127147 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.600795 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.637599 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.686317 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.230:8776/healthcheck\": read tcp 10.217.0.2:35012->10.217.0.230:8776: read: connection reset by peer" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.755324 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.226:8778/\": read tcp 10.217.0.2:39932->10.217.0.226:8778: read: connection reset by peer" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.755448 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.226:8778/\": read tcp 10.217.0.2:39916->10.217.0.226:8778: read: connection reset by peer" Nov 21 13:02:03 crc kubenswrapper[4769]: I1121 13:02:03.921446 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.027550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-log-httpd\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.027917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-combined-ca-bundle\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.027971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-config-data\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-ceilometer-tls-certs\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-sg-core-conf-yaml\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-scripts\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wrqw\" (UniqueName: \"kubernetes.io/projected/94e6440b-ad01-43d0-be1b-aed47b440656-kube-api-access-9wrqw\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-run-httpd\") pod \"94e6440b-ad01-43d0-be1b-aed47b440656\" (UID: \"94e6440b-ad01-43d0-be1b-aed47b440656\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028837 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.028851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.049675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-scripts" (OuterVolumeSpecName: "scripts") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.049970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e6440b-ad01-43d0-be1b-aed47b440656-kube-api-access-9wrqw" (OuterVolumeSpecName: "kube-api-access-9wrqw") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "kube-api-access-9wrqw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.074117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.114169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.134497 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.134523 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.134533 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9wrqw\" (UniqueName: \"kubernetes.io/projected/94e6440b-ad01-43d0-be1b-aed47b440656-kube-api-access-9wrqw\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.134542 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/94e6440b-ad01-43d0-be1b-aed47b440656-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.134552 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175325 4769 generic.go:334] "Generic (PLEG): container finished" podID="94e6440b-ad01-43d0-be1b-aed47b440656" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" exitCode=0 Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175363 4769 generic.go:334] "Generic (PLEG): container finished" podID="94e6440b-ad01-43d0-be1b-aed47b440656" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" exitCode=2 Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175373 4769 generic.go:334] "Generic (PLEG): container finished" podID="94e6440b-ad01-43d0-be1b-aed47b440656" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" exitCode=0 Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175382 4769 generic.go:334] "Generic (PLEG): container finished" podID="94e6440b-ad01-43d0-be1b-aed47b440656" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" exitCode=0 Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerDied","Data":"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerDied","Data":"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerDied","Data":"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerDied","Data":"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"94e6440b-ad01-43d0-be1b-aed47b440656","Type":"ContainerDied","Data":"4a0794f708d6531cf1e5fd49588a248d21b7a2abdd4f5097052539dd12356481"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175576 4769 scope.go:117] "RemoveContainer" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.175718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.186491 4769 scope.go:117] "RemoveContainer" containerID="da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.187034 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(a58794b2-3db0-4930-84f4-d8757325a776)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.212733 4769 generic.go:334] "Generic (PLEG): container finished" podID="218614a7-f338-4843-88ca-47a21998b61a" containerID="c4b3623ca74fdc895adcd4776d2cae1037057822d2d7f94d5bb1675e8a71d160" exitCode=0 Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.213168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" event={"ID":"218614a7-f338-4843-88ca-47a21998b61a","Type":"ContainerDied","Data":"c4b3623ca74fdc895adcd4776d2cae1037057822d2d7f94d5bb1675e8a71d160"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.227962 4769 generic.go:334] "Generic (PLEG): container finished" podID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerID="64953335061db058d8b5b7da6ce6f1df4249d55f50d09d06a5a5f56ae42c523a" exitCode=0 Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.228904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2129199a-a7af-4a97-8205-8276aa63e2b2","Type":"ContainerDied","Data":"64953335061db058d8b5b7da6ce6f1df4249d55f50d09d06a5a5f56ae42c523a"} Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.267269 4769 scope.go:117] "RemoveContainer" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.328807 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.332755 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-config-data" (OuterVolumeSpecName: "config-data") pod "94e6440b-ad01-43d0-be1b-aed47b440656" (UID: "94e6440b-ad01-43d0-be1b-aed47b440656"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.337381 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.337409 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94e6440b-ad01-43d0-be1b-aed47b440656-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.345552 4769 scope.go:117] "RemoveContainer" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.358998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.381291 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.406439 4769 scope.go:117] "RemoveContainer" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.407300 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.443891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-config-data\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.443954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/218614a7-f338-4843-88ca-47a21998b61a-logs\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.443971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-scripts\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.443997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-internal-tls-certs\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-internal-tls-certs\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-scripts\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbtxs\" (UniqueName: \"kubernetes.io/projected/2129199a-a7af-4a97-8205-8276aa63e2b2-kube-api-access-lbtxs\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data-custom\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444308 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-combined-ca-bundle\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-public-tls-certs\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2129199a-a7af-4a97-8205-8276aa63e2b2-etc-machine-id\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-public-tls-certs\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw8tn\" (UniqueName: \"kubernetes.io/projected/218614a7-f338-4843-88ca-47a21998b61a-kube-api-access-cw8tn\") pod \"218614a7-f338-4843-88ca-47a21998b61a\" (UID: \"218614a7-f338-4843-88ca-47a21998b61a\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444523 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-combined-ca-bundle\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.444589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2129199a-a7af-4a97-8205-8276aa63e2b2-logs\") pod \"2129199a-a7af-4a97-8205-8276aa63e2b2\" (UID: \"2129199a-a7af-4a97-8205-8276aa63e2b2\") " Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.445778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2129199a-a7af-4a97-8205-8276aa63e2b2-logs" (OuterVolumeSpecName: "logs") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.446228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2129199a-a7af-4a97-8205-8276aa63e2b2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.446279 4769 scope.go:117] "RemoveContainer" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.448479 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": container with ID starting with 6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c not found: ID does not exist" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.448527 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c"} err="failed to get container status \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": rpc error: code = NotFound desc = could not find container \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": container with ID starting with 6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.448551 4769 scope.go:117] "RemoveContainer" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.454362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/218614a7-f338-4843-88ca-47a21998b61a-logs" (OuterVolumeSpecName: "logs") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.461653 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": container with ID starting with 01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde not found: ID does not exist" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.461694 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde"} err="failed to get container status \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": rpc error: code = NotFound desc = could not find container \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": container with ID starting with 01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.461721 4769 scope.go:117] "RemoveContainer" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.462130 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": container with ID starting with 74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4 not found: ID does not exist" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.462265 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4"} err="failed to get container status \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": rpc error: code = NotFound desc = could not find container \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": container with ID starting with 74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.462357 4769 scope.go:117] "RemoveContainer" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.462629 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": container with ID starting with 1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908 not found: ID does not exist" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.462701 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908"} err="failed to get container status \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": rpc error: code = NotFound desc = could not find container \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": container with ID starting with 1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.462762 4769 scope.go:117] "RemoveContainer" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.463581 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c"} err="failed to get container status \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": rpc error: code = NotFound desc = could not find container \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": container with ID starting with 6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.463679 4769 scope.go:117] "RemoveContainer" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.463914 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde"} err="failed to get container status \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": rpc error: code = NotFound desc = could not find container \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": container with ID starting with 01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.463982 4769 scope.go:117] "RemoveContainer" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.464226 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4"} err="failed to get container status \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": rpc error: code = NotFound desc = could not find container \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": container with ID starting with 74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.464298 4769 scope.go:117] "RemoveContainer" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.468394 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908"} err="failed to get container status \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": rpc error: code = NotFound desc = could not find container \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": container with ID starting with 1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.468444 4769 scope.go:117] "RemoveContainer" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.468588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-scripts" (OuterVolumeSpecName: "scripts") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.469740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2129199a-a7af-4a97-8205-8276aa63e2b2-kube-api-access-lbtxs" (OuterVolumeSpecName: "kube-api-access-lbtxs") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "kube-api-access-lbtxs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.469854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.471394 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c"} err="failed to get container status \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": rpc error: code = NotFound desc = could not find container \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": container with ID starting with 6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.471427 4769 scope.go:117] "RemoveContainer" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.475282 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde"} err="failed to get container status \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": rpc error: code = NotFound desc = could not find container \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": container with ID starting with 01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.475311 4769 scope.go:117] "RemoveContainer" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.475388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218614a7-f338-4843-88ca-47a21998b61a-kube-api-access-cw8tn" (OuterVolumeSpecName: "kube-api-access-cw8tn") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "kube-api-access-cw8tn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.475643 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4"} err="failed to get container status \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": rpc error: code = NotFound desc = could not find container \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": container with ID starting with 74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.475688 4769 scope.go:117] "RemoveContainer" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.477112 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908"} err="failed to get container status \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": rpc error: code = NotFound desc = could not find container \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": container with ID starting with 1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.477133 4769 scope.go:117] "RemoveContainer" containerID="6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.478552 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c"} err="failed to get container status \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": rpc error: code = NotFound desc = could not find container \"6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c\": container with ID starting with 6b082af727b68bc18460107fd8ced501f8a2cdb99d84cf61cbb36c2c9bb91b6c not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.478587 4769 scope.go:117] "RemoveContainer" containerID="01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.480804 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde"} err="failed to get container status \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": rpc error: code = NotFound desc = could not find container \"01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde\": container with ID starting with 01ced07e3bbd5d91337d20b5995035c811f3d31d9b4ad7fcd7ec50147051bbde not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.480827 4769 scope.go:117] "RemoveContainer" containerID="74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.482132 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4"} err="failed to get container status \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": rpc error: code = NotFound desc = could not find container \"74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4\": container with ID starting with 74a43dbc98e94f8bb9028fa04cbfcc2775d303f457d5f8e22958f1d7d9408ca4 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.482159 4769 scope.go:117] "RemoveContainer" containerID="1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.483609 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908"} err="failed to get container status \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": rpc error: code = NotFound desc = could not find container \"1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908\": container with ID starting with 1182327529ce0ca01b2cc160e28690f71501f2fcbca90d61951d71602e138908 not found: ID does not exist" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.493924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-scripts" (OuterVolumeSpecName: "scripts") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.537169 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546556 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/218614a7-f338-4843-88ca-47a21998b61a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546585 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546593 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546603 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lbtxs\" (UniqueName: \"kubernetes.io/projected/2129199a-a7af-4a97-8205-8276aa63e2b2-kube-api-access-lbtxs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546612 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546621 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2129199a-a7af-4a97-8205-8276aa63e2b2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546630 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cw8tn\" (UniqueName: \"kubernetes.io/projected/218614a7-f338-4843-88ca-47a21998b61a-kube-api-access-cw8tn\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.546638 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2129199a-a7af-4a97-8205-8276aa63e2b2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.560029 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.560405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564052 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564497 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-log" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564516 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-log" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564528 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564534 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-central-agent" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564557 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-central-agent" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564568 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-log" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564574 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-log" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564587 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api-log" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564592 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api-log" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564607 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-api" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564613 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-api" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564630 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-notification-agent" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564636 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-notification-agent" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564653 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="proxy-httpd" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564658 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="proxy-httpd" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564666 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-api" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564672 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-api" Nov 21 13:02:04 crc kubenswrapper[4769]: E1121 13:02:04.564685 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="sg-core" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564691 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="sg-core" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564859 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-log" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="218614a7-f338-4843-88ca-47a21998b61a" containerName="placement-api" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564897 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="sg-core" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-api" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564916 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be4dd66c-3cc4-49f8-acb3-fb2fb19bf0b0" containerName="placement-log" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564923 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" containerName="cinder-api-log" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564933 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-notification-agent" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564942 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="ceilometer-central-agent" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.564954 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" containerName="proxy-httpd" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.566711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.568780 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.569497 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.570614 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.571316 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.578289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.590219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.597825 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.629408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.648795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.648873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gw6h\" (UniqueName: \"kubernetes.io/projected/baaa3a6b-bea8-4973-8fc9-e8062aca3293-kube-api-access-6gw6h\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.648907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.648925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-run-httpd\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.648970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-log-httpd\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-config-data\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-scripts\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649107 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649117 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649125 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.649136 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.654289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data" (OuterVolumeSpecName: "config-data") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.655241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2129199a-a7af-4a97-8205-8276aa63e2b2" (UID: "2129199a-a7af-4a97-8205-8276aa63e2b2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.675690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-config-data" (OuterVolumeSpecName: "config-data") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.729747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "218614a7-f338-4843-88ca-47a21998b61a" (UID: "218614a7-f338-4843-88ca-47a21998b61a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.750997 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751073 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-config-data\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-scripts\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751209 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6gw6h\" (UniqueName: \"kubernetes.io/projected/baaa3a6b-bea8-4973-8fc9-e8062aca3293-kube-api-access-6gw6h\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-run-httpd\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-log-httpd\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751531 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751553 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2129199a-a7af-4a97-8205-8276aa63e2b2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751570 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.751583 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/218614a7-f338-4843-88ca-47a21998b61a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.752149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-run-httpd\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.752165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-log-httpd\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.754583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.754972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.755335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-scripts\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.755561 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.755651 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.756150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-config-data\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.769011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gw6h\" (UniqueName: \"kubernetes.io/projected/baaa3a6b-bea8-4973-8fc9-e8062aca3293-kube-api-access-6gw6h\") pod \"ceilometer-0\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.880372 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.884407 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:04 crc kubenswrapper[4769]: I1121 13:02:04.927423 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.238649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2129199a-a7af-4a97-8205-8276aa63e2b2","Type":"ContainerDied","Data":"a8153665763dcbcdd228ecd6d532997e4dc44e8202c53fb7ed29ebd858f2b278"} Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.238962 4769 scope.go:117] "RemoveContainer" containerID="64953335061db058d8b5b7da6ce6f1df4249d55f50d09d06a5a5f56ae42c523a" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.238685 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.245131 4769 generic.go:334] "Generic (PLEG): container finished" podID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerID="176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6" exitCode=1 Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.245223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerDied","Data":"176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6"} Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.245784 4769 scope.go:117] "RemoveContainer" containerID="176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6" Nov 21 13:02:05 crc kubenswrapper[4769]: E1121 13:02:05.246112 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(5415ebc2-eb7c-4b71-bd45-97674d0fe30d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.251310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" event={"ID":"218614a7-f338-4843-88ca-47a21998b61a","Type":"ContainerDied","Data":"e0cc973ab7891c80c878753c536837aaa43cec7b6f8aaea29a9008a4dd3182a3"} Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.251373 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7cff5df8b-24kk2" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.251919 4769 scope.go:117] "RemoveContainer" containerID="da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48" Nov 21 13:02:05 crc kubenswrapper[4769]: E1121 13:02:05.252253 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(a58794b2-3db0-4930-84f4-d8757325a776)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.274074 4769 scope.go:117] "RemoveContainer" containerID="b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.289374 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e6440b-ad01-43d0-be1b-aed47b440656" path="/var/lib/kubelet/pods/94e6440b-ad01-43d0-be1b-aed47b440656/volumes" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.319929 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.324535 4769 scope.go:117] "RemoveContainer" containerID="2dfe53b5effac76f3aed6f44b3e9acc0b27e400ad94ea0fa90b97f1a0f6df8e8" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.341621 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.384249 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.386029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.388387 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.388702 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.389715 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.399839 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.409459 4769 scope.go:117] "RemoveContainer" containerID="c4b3623ca74fdc895adcd4776d2cae1037057822d2d7f94d5bb1675e8a71d160" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.411252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7cff5df8b-24kk2"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.419236 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7cff5df8b-24kk2"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.430236 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.463320 4769 scope.go:117] "RemoveContainer" containerID="ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468476 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fj8\" (UniqueName: \"kubernetes.io/projected/db45f877-263f-4e73-bbb6-3ad67a038d51-kube-api-access-j9fj8\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468764 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/db45f877-263f-4e73-bbb6-3ad67a038d51-etc-machine-id\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db45f877-263f-4e73-bbb6-3ad67a038d51-logs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-scripts\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468900 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data-custom\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-public-tls-certs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.468938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.570848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fj8\" (UniqueName: \"kubernetes.io/projected/db45f877-263f-4e73-bbb6-3ad67a038d51-kube-api-access-j9fj8\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.571683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/db45f877-263f-4e73-bbb6-3ad67a038d51-etc-machine-id\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.571739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.572421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db45f877-263f-4e73-bbb6-3ad67a038d51-logs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.572553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.572607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-scripts\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.572645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data-custom\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.572688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-public-tls-certs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.572724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.576949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/db45f877-263f-4e73-bbb6-3ad67a038d51-etc-machine-id\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.577145 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db45f877-263f-4e73-bbb6-3ad67a038d51-logs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.582217 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.584469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.586117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-public-tls-certs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.587841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.589743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data-custom\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.592646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-scripts\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.594929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fj8\" (UniqueName: \"kubernetes.io/projected/db45f877-263f-4e73-bbb6-3ad67a038d51-kube-api-access-j9fj8\") pod \"cinder-api-0\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.710107 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:05 crc kubenswrapper[4769]: I1121 13:02:05.752402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.265459 4769 scope.go:117] "RemoveContainer" containerID="176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6" Nov 21 13:02:06 crc kubenswrapper[4769]: E1121 13:02:06.266428 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(5415ebc2-eb7c-4b71-bd45-97674d0fe30d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.267288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerStarted","Data":"16ac3f25f797543f3a4421777f0ed71bcc701d15c84766bce191378378bb6f92"} Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.267317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerStarted","Data":"b22637058300d360e4c3896a7222df78eeb543080552425bd152451b052b0c7d"} Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.298784 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.422305 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.422418 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:02:06 crc kubenswrapper[4769]: I1121 13:02:06.596384 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.205787 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.301686 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2129199a-a7af-4a97-8205-8276aa63e2b2" path="/var/lib/kubelet/pods/2129199a-a7af-4a97-8205-8276aa63e2b2/volumes" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.303103 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="218614a7-f338-4843-88ca-47a21998b61a" path="/var/lib/kubelet/pods/218614a7-f338-4843-88ca-47a21998b61a/volumes" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.305022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerStarted","Data":"bd29017142e379cd07f0c23e656020c1d9bc483947d032f985a430b05c10983f"} Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.312128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerStarted","Data":"48c84c865b545339e66a477d36f73605efc66f27b41aee6990f8a335880ea6a5"} Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.312179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerStarted","Data":"e56af2f699b3a697b72150e2c4715731729c124214eb05a3f1f746c6bd77f23c"} Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.312710 4769 scope.go:117] "RemoveContainer" containerID="176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6" Nov 21 13:02:07 crc kubenswrapper[4769]: E1121 13:02:07.313043 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(5415ebc2-eb7c-4b71-bd45-97674d0fe30d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.402964 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.694285 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.695053 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.725379 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.732432 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:07 crc kubenswrapper[4769]: I1121 13:02:07.742810 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:08 crc kubenswrapper[4769]: I1121 13:02:08.321450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerStarted","Data":"860aa39f3d510033c18f62bcaf780145bec3561404269a87bf8a75451aa3b8b4"} Nov 21 13:02:08 crc kubenswrapper[4769]: I1121 13:02:08.325725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerStarted","Data":"d7618f7f9f59ae5a8ca5ceefed75a3547af7dcb9231077854eb2bc6ac250dd86"} Nov 21 13:02:08 crc kubenswrapper[4769]: I1121 13:02:08.325758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:08 crc kubenswrapper[4769]: I1121 13:02:08.325771 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:08 crc kubenswrapper[4769]: I1121 13:02:08.325927 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:08 crc kubenswrapper[4769]: I1121 13:02:08.348969 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.348945941 podStartE2EDuration="3.348945941s" podCreationTimestamp="2025-11-21 13:02:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:08.346287509 +0000 UTC m=+4287.046949367" watchObservedRunningTime="2025-11-21 13:02:08.348945941 +0000 UTC m=+4287.049607799" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.339445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerStarted","Data":"63839ee29ce86f60790b658dc6484e56b915abf826038230883b7d4fa5781183"} Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.340741 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.369073 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.084064431 podStartE2EDuration="5.369056512s" podCreationTimestamp="2025-11-21 13:02:04 +0000 UTC" firstStartedPulling="2025-11-21 13:02:05.420649045 +0000 UTC m=+4284.121310863" lastFinishedPulling="2025-11-21 13:02:08.705641106 +0000 UTC m=+4287.406302944" observedRunningTime="2025-11-21 13:02:09.361899409 +0000 UTC m=+4288.062561217" watchObservedRunningTime="2025-11-21 13:02:09.369056512 +0000 UTC m=+4288.069718330" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.587026 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-pqlk9"] Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.589776 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.597984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.609678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-pqlk9"] Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.685297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-utilities\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.685423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ncf\" (UniqueName: \"kubernetes.io/projected/ac87d062-4974-4010-a37f-677a15250ad2-kube-api-access-w6ncf\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.685528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-catalog-content\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.701623 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.760366 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.788774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ncf\" (UniqueName: \"kubernetes.io/projected/ac87d062-4974-4010-a37f-677a15250ad2-kube-api-access-w6ncf\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.789061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-catalog-content\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.789149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-utilities\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.789654 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-utilities\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.789744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-catalog-content\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.821871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ncf\" (UniqueName: \"kubernetes.io/projected/ac87d062-4974-4010-a37f-677a15250ad2-kube-api-access-w6ncf\") pod \"certified-operators-pqlk9\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.921396 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.932395 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:09 crc kubenswrapper[4769]: I1121 13:02:09.957878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.376131 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.376498 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.452815 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.694981 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-pqlk9"] Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.722375 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.863901 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:10 crc kubenswrapper[4769]: I1121 13:02:10.987402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:02:11 crc kubenswrapper[4769]: I1121 13:02:11.385127 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac87d062-4974-4010-a37f-677a15250ad2" containerID="8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996" exitCode=0 Nov 21 13:02:11 crc kubenswrapper[4769]: I1121 13:02:11.386262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerDied","Data":"8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996"} Nov 21 13:02:11 crc kubenswrapper[4769]: I1121 13:02:11.386325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerStarted","Data":"c63482a47ebef54366babfc0ad168cb3bc52dfa386c25a1615e1b639661868fa"} Nov 21 13:02:12 crc kubenswrapper[4769]: I1121 13:02:12.400066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerStarted","Data":"f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc"} Nov 21 13:02:12 crc kubenswrapper[4769]: I1121 13:02:12.625428 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:12 crc kubenswrapper[4769]: I1121 13:02:12.625434 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:12 crc kubenswrapper[4769]: I1121 13:02:12.729396 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:13 crc kubenswrapper[4769]: I1121 13:02:13.226830 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:02:13 crc kubenswrapper[4769]: W1121 13:02:13.428088 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a8880_f116_4e6b_b59a_ade8af828e74.slice/crio-conmon-5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a8880_f116_4e6b_b59a_ade8af828e74.slice/crio-conmon-5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef.scope: no such file or directory Nov 21 13:02:13 crc kubenswrapper[4769]: W1121 13:02:13.428225 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6788b7d4_ead9_4e17_8f26_b23369e1332b.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6788b7d4_ead9_4e17_8f26_b23369e1332b.slice: no such file or directory Nov 21 13:02:13 crc kubenswrapper[4769]: W1121 13:02:13.428317 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a8880_f116_4e6b_b59a_ade8af828e74.slice/crio-5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a8880_f116_4e6b_b59a_ade8af828e74.slice/crio-5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef.scope: no such file or directory Nov 21 13:02:13 crc kubenswrapper[4769]: W1121 13:02:13.428335 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc9ee1d2_edd5_4be8_9dc8_073dc798c06b.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc9ee1d2_edd5_4be8_9dc8_073dc798c06b.slice: no such file or directory Nov 21 13:02:13 crc kubenswrapper[4769]: W1121 13:02:13.428387 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb824f9ca_bdca_4673_939a_9bf4e3846140.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb824f9ca_bdca_4673_939a_9bf4e3846140.slice: no such file or directory Nov 21 13:02:13 crc kubenswrapper[4769]: I1121 13:02:13.776177 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.237:9696/\": dial tcp 10.217.0.237:9696: connect: connection refused" Nov 21 13:02:14 crc kubenswrapper[4769]: E1121 13:02:14.051451 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/61dde5267a31da7311a3a4c23b968f807ed6faddbf8ad89da4d3c1edc3c14e15/diff" to get inode usage: stat /var/lib/containers/storage/overlay/61dde5267a31da7311a3a4c23b968f807ed6faddbf8ad89da4d3c1edc3c14e15/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_neutron-548d54c446-vgqdr_e5f96b2f-5d0c-4fc9-bf04-574534677fec/neutron-api/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_neutron-548d54c446-vgqdr_e5f96b2f-5d0c-4fc9-bf04-574534677fec/neutron-api/0.log: no such file or directory Nov 21 13:02:14 crc kubenswrapper[4769]: E1121 13:02:14.098588 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/6942435b2d867d4dd3df3bf1ea341be17ec2c52e515334bf1f5e59ce4e83e0fd/diff" to get inode usage: stat /var/lib/containers/storage/overlay/6942435b2d867d4dd3df3bf1ea341be17ec2c52e515334bf1f5e59ce4e83e0fd/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-worker-577595dd45-4fsf2_9239d708-5ee4-40e4-ae65-cfdc903874f3/barbican-worker/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-worker-577595dd45-4fsf2_9239d708-5ee4-40e4-ae65-cfdc903874f3/barbican-worker/0.log: no such file or directory Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.421142 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b6cc894c8-5jzcv_bdca1044-7937-42ab-af75-4060e6c949f1/neutron-api/0.log" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.421244 4769 generic.go:334] "Generic (PLEG): container finished" podID="bdca1044-7937-42ab-af75-4060e6c949f1" containerID="7bef60add7b2824d9f607e5306c621eac4d7e7c48130292a5c29c88a5e08a7fa" exitCode=137 Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.421275 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" event={"ID":"bdca1044-7937-42ab-af75-4060e6c949f1","Type":"ContainerDied","Data":"7bef60add7b2824d9f607e5306c621eac4d7e7c48130292a5c29c88a5e08a7fa"} Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.656757 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b6cc894c8-5jzcv_bdca1044-7937-42ab-af75-4060e6c949f1/neutron-api/0.log" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.657177 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.700860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dlm5\" (UniqueName: \"kubernetes.io/projected/bdca1044-7937-42ab-af75-4060e6c949f1-kube-api-access-8dlm5\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.701140 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-internal-tls-certs\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.701299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-combined-ca-bundle\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.701426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-httpd-config\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.701537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-public-tls-certs\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.701624 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-config\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.701767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-ovndb-tls-certs\") pod \"bdca1044-7937-42ab-af75-4060e6c949f1\" (UID: \"bdca1044-7937-42ab-af75-4060e6c949f1\") " Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.709493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdca1044-7937-42ab-af75-4060e6c949f1-kube-api-access-8dlm5" (OuterVolumeSpecName: "kube-api-access-8dlm5") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "kube-api-access-8dlm5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.709996 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.765547 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.765829 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.767240 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="barbican-api-log" containerStatusID={"Type":"cri-o","ID":"5a23ca9d8c578198505c4aeaa9c9e552783a6c07551851baad340e52214ec296"} pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" containerMessage="Container barbican-api-log failed liveness probe, will be restarted" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.767499 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" containerID="cri-o://5a23ca9d8c578198505c4aeaa9c9e552783a6c07551851baad340e52214ec296" gracePeriod=30 Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.788431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.804270 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8dlm5\" (UniqueName: \"kubernetes.io/projected/bdca1044-7937-42ab-af75-4060e6c949f1-kube-api-access-8dlm5\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.804612 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.804723 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.811475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-config" (OuterVolumeSpecName: "config") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.811569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.831958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.837817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "bdca1044-7937-42ab-af75-4060e6c949f1" (UID: "bdca1044-7937-42ab-af75-4060e6c949f1"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.908785 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.908866 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.908881 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.908893 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bdca1044-7937-42ab-af75-4060e6c949f1-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.969489 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:14 crc kubenswrapper[4769]: I1121 13:02:14.969536 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:15 crc kubenswrapper[4769]: E1121 13:02:15.300496 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/56bf5c0413195711e6bee2c0e64eaf6457d44d4467b3f7be6de0dcb5af346236/diff" to get inode usage: stat /var/lib/containers/storage/overlay/56bf5c0413195711e6bee2c0e64eaf6457d44d4467b3f7be6de0dcb5af346236/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-849765d566-kngb8_b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10/barbican-keystone-listener/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_barbican-keystone-listener-849765d566-kngb8_b77766a4-b6ac-4d30-aa7e-4ebfa6ef7a10/barbican-keystone-listener/0.log: no such file or directory Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.436643 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerID="5a23ca9d8c578198505c4aeaa9c9e552783a6c07551851baad340e52214ec296" exitCode=143 Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.436724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerDied","Data":"5a23ca9d8c578198505c4aeaa9c9e552783a6c07551851baad340e52214ec296"} Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.436755 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerStarted","Data":"f06e86b2623816620c859348769585c2a59493cbb86d9ee499fa62cc4059634f"} Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.436827 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.441165 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac87d062-4974-4010-a37f-677a15250ad2" containerID="f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc" exitCode=0 Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.441241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerDied","Data":"f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc"} Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.446274 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7b6cc894c8-5jzcv_bdca1044-7937-42ab-af75-4060e6c949f1/neutron-api/0.log" Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.446312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" event={"ID":"bdca1044-7937-42ab-af75-4060e6c949f1","Type":"ContainerDied","Data":"94be8d1d8b421c203ce0aacb55cbcb689f09264c55425401a4a1fc8457110c2d"} Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.446337 4769 scope.go:117] "RemoveContainer" containerID="ffe644618260af24e558ade27a0ed29fae7f0c409a4b0d8a1a7b5ddf61f93f4d" Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.446439 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv" Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.485603 4769 scope.go:117] "RemoveContainer" containerID="7bef60add7b2824d9f607e5306c621eac4d7e7c48130292a5c29c88a5e08a7fa" Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.506491 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv"] Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.525727 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7b6cc894c8-5jzcv"] Nov 21 13:02:15 crc kubenswrapper[4769]: I1121 13:02:15.727404 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:16 crc kubenswrapper[4769]: I1121 13:02:16.463688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerStarted","Data":"2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab"} Nov 21 13:02:16 crc kubenswrapper[4769]: I1121 13:02:16.494468 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-pqlk9" podStartSLOduration=3.037549781 podStartE2EDuration="7.494449091s" podCreationTimestamp="2025-11-21 13:02:09 +0000 UTC" firstStartedPulling="2025-11-21 13:02:11.387237489 +0000 UTC m=+4290.087899307" lastFinishedPulling="2025-11-21 13:02:15.844136799 +0000 UTC m=+4294.544798617" observedRunningTime="2025-11-21 13:02:16.492764646 +0000 UTC m=+4295.193426474" watchObservedRunningTime="2025-11-21 13:02:16.494449091 +0000 UTC m=+4295.195110909" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.155374 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-xl2wk"] Nov 21 13:02:17 crc kubenswrapper[4769]: E1121 13:02:17.155768 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-httpd" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.155780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-httpd" Nov 21 13:02:17 crc kubenswrapper[4769]: E1121 13:02:17.155813 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-api" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.155819 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-api" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.155988 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-httpd" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.156010 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" containerName="neutron-api" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.157358 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.183251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-xl2wk"] Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.259030 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffzpg\" (UniqueName: \"kubernetes.io/projected/4807a22c-f63d-4c79-a393-a02c0f08fdcc-kube-api-access-ffzpg\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.259131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-catalog-content\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.259215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-utilities\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.286227 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdca1044-7937-42ab-af75-4060e6c949f1" path="/var/lib/kubelet/pods/bdca1044-7937-42ab-af75-4060e6c949f1/volumes" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.361184 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-catalog-content\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.361277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-utilities\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.361461 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ffzpg\" (UniqueName: \"kubernetes.io/projected/4807a22c-f63d-4c79-a393-a02c0f08fdcc-kube-api-access-ffzpg\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.361876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-catalog-content\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.361936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-utilities\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.386443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffzpg\" (UniqueName: \"kubernetes.io/projected/4807a22c-f63d-4c79-a393-a02c0f08fdcc-kube-api-access-ffzpg\") pod \"redhat-marketplace-xl2wk\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.484128 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.734410 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.734779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.734852 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.735502 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="barbican-api" containerStatusID={"Type":"cri-o","ID":"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f"} pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" containerMessage="Container barbican-api failed liveness probe, will be restarted" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.735530 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" containerID="cri-o://826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f" gracePeriod=30 Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.745622 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": EOF" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.745725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:17 crc kubenswrapper[4769]: I1121 13:02:17.747777 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": EOF" Nov 21 13:02:18 crc kubenswrapper[4769]: I1121 13:02:18.000507 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-xl2wk"] Nov 21 13:02:18 crc kubenswrapper[4769]: I1121 13:02:18.485758 4769 generic.go:334] "Generic (PLEG): container finished" podID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerID="56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585" exitCode=0 Nov 21 13:02:18 crc kubenswrapper[4769]: I1121 13:02:18.485797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerDied","Data":"56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585"} Nov 21 13:02:18 crc kubenswrapper[4769]: I1121 13:02:18.485821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerStarted","Data":"595c90b2600d8f092a6fb5c472db1b33697bf55d60a7e59f0ce3585e5bc2f79d"} Nov 21 13:02:19 crc kubenswrapper[4769]: I1121 13:02:19.275516 4769 scope.go:117] "RemoveContainer" containerID="da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48" Nov 21 13:02:19 crc kubenswrapper[4769]: I1121 13:02:19.500254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerStarted","Data":"f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d"} Nov 21 13:02:19 crc kubenswrapper[4769]: E1121 13:02:19.652038 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:49032->38.102.83.227:40411: write tcp 38.102.83.227:49032->38.102.83.227:40411: write: connection reset by peer Nov 21 13:02:19 crc kubenswrapper[4769]: I1121 13:02:19.718372 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:19 crc kubenswrapper[4769]: I1121 13:02:19.959246 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:19 crc kubenswrapper[4769]: I1121 13:02:19.960845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:20 crc kubenswrapper[4769]: I1121 13:02:20.011466 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:20 crc kubenswrapper[4769]: I1121 13:02:20.274581 4769 scope.go:117] "RemoveContainer" containerID="176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6" Nov 21 13:02:20 crc kubenswrapper[4769]: I1121 13:02:20.440969 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:20 crc kubenswrapper[4769]: I1121 13:02:20.515321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerStarted","Data":"d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad"} Nov 21 13:02:20 crc kubenswrapper[4769]: I1121 13:02:20.515874 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:20 crc kubenswrapper[4769]: I1121 13:02:20.715351 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:20 crc kubenswrapper[4769]: E1121 13:02:20.871420 4769 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/e9934e87297aa79f3a6951e218a7cc8956156769621090f9967b389a36256b9f/diff" to get inode usage: stat /var/lib/containers/storage/overlay/e9934e87297aa79f3a6951e218a7cc8956156769621090f9967b389a36256b9f/diff: no such file or directory, extraDiskErr: could not stat "/var/log/pods/openstack-kuttl-tests_nova-scheduler-0_1b17ed17-ae28-4189-84ea-977b0803d0ad/nova-scheduler-scheduler/0.log" to get inode usage: stat /var/log/pods/openstack-kuttl-tests_nova-scheduler-0_1b17ed17-ae28-4189-84ea-977b0803d0ad/nova-scheduler-scheduler/0.log: no such file or directory Nov 21 13:02:20 crc kubenswrapper[4769]: W1121 13:02:20.987090 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-af2bd30412ec9611d5a4c0bd8ae9ece60ec279fb657992a020baf998615281d6": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-af2bd30412ec9611d5a4c0bd8ae9ece60ec279fb657992a020baf998615281d6: no such file or directory Nov 21 13:02:20 crc kubenswrapper[4769]: W1121 13:02:20.987145 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-conmon-52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-conmon-52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871.scope: no such file or directory Nov 21 13:02:20 crc kubenswrapper[4769]: W1121 13:02:20.987174 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-52da8333ee27a9bcc6572700b3d09f490a1573df6022977927c5635d48895871.scope: no such file or directory Nov 21 13:02:20 crc kubenswrapper[4769]: W1121 13:02:20.991171 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-conmon-afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-conmon-afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa.scope: no such file or directory Nov 21 13:02:20 crc kubenswrapper[4769]: W1121 13:02:20.991240 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice/crio-afd6eb4a486e988392c83097d63ff0f0c7c8ecdb820e6365b9b22dfcdcda6ffa.scope: no such file or directory Nov 21 13:02:20 crc kubenswrapper[4769]: W1121 13:02:20.991316 4769 watcher.go:93] Error while processing event ("/sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94e6440b_ad01_43d0_be1b_aed47b440656.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94e6440b_ad01_43d0_be1b_aed47b440656.slice: no such file or directory Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.362079 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.362931 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-api" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.363136 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.402912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:21 crc kubenswrapper[4769]: E1121 13:02:21.486476 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb31d6545_ddad_4fcf_b60d_47be899c6768.slice/crio-conmon-18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod048b3b15_392d_49b6_87e3_251369ff8245.slice/crio-7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba949ad8_33f8_406b_990b_d2038698556d.slice/crio-conmon-3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9239d708_5ee4_40e4_ae65_cfdc903874f3.slice/crio-dc9a2c1452befe62377bb952ff5fdb9822993ed50ff5b8e2556fc3f8179890d9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4759ef3d_e00f_42ee_9964_82553f02b530.slice/crio-926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2129199a_a7af_4a97_8205_8276aa63e2b2.slice/crio-conmon-b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f877573_99ba_420d_8977_eed7e339e9c3.slice/crio-0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd176a47_2143_45c9_85a5_ab6a32848a86.slice/crio-c7d15563af38f74e6fa9a5ecdde1379c569ac10dd311b504d05f4547b677ff86.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod218614a7_f338_4843_88ca_47a21998b61a.slice/crio-ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53ea8f17_e44c_4381_8339_f8cdbd0ea290.slice/crio-2b73502f8081675a5ff8d7a5f8b1ce99f5c7fef44f581f453fcba2d7d1071157\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f877573_99ba_420d_8977_eed7e339e9c3.slice/crio-83f6bcbd3f73f7a772231cdd65915918e162cd7110ffd723b1235d77b4684595\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod048b3b15_392d_49b6_87e3_251369ff8245.slice/crio-conmon-7510097d02f57e709dc354d6dd01aff447ecbb4fccd5f370e828ea443f981018.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6af1865c_3e9f_4329_bc4b_94679b29dfee.slice/crio-conmon-7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4759ef3d_e00f_42ee_9964_82553f02b530.slice/crio-conmon-34ecfc7ab2e82f878f6576eaa9b386267547325a539e42ed9da03c7b3c20e96a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice/crio-conmon-76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6af1865c_3e9f_4329_bc4b_94679b29dfee.slice/crio-7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a8880_f116_4e6b_b59a_ade8af828e74.slice/crio-conmon-70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod218614a7_f338_4843_88ca_47a21998b61a.slice/crio-conmon-c4b3623ca74fdc895adcd4776d2cae1037057822d2d7f94d5bb1675e8a71d160.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f877573_99ba_420d_8977_eed7e339e9c3.slice/crio-conmon-0a2559720b694e2bb1df14146dceb85df8ba08a4d99de6b48b04a0bcbdd7b517.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice/crio-conmon-b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb31d6545_ddad_4fcf_b60d_47be899c6768.slice/crio-6a3bf757d4e5bfaef66381e8649137db0c9d29990d491a35b84c23df8aea4a14\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod438a784a_03b1_4561_87c2_f01538a59ab0.slice/crio-a00def91be98af9694b5aab9edfbc7ae261ba45918af57cb36ca71973d4479e5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6af1865c_3e9f_4329_bc4b_94679b29dfee.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4759ef3d_e00f_42ee_9964_82553f02b530.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4759ef3d_e00f_42ee_9964_82553f02b530.slice/crio-af439801b2493befa74f374bcfae45541fd93b02c79703b135f4f32365c45c3f\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod438a784a_03b1_4561_87c2_f01538a59ab0.slice/crio-4316bcec98397b8e85ad55ec78b574da9bd733dddd2e61e12a2ea0c8117fb573\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44c2164d_04ed_4bc7_a71f_e54cc74d7d32.slice/crio-conmon-9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53ea8f17_e44c_4381_8339_f8cdbd0ea290.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44c2164d_04ed_4bc7_a71f_e54cc74d7d32.slice/crio-9d013af3dd3c359a95a4a89b2d934208b48d7807aa3282319031bbce0ab3b3d5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba949ad8_33f8_406b_990b_d2038698556d.slice/crio-3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f877573_99ba_420d_8977_eed7e339e9c3.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdca1044_7937_42ab_af75_4060e6c949f1.slice/crio-7bef60add7b2824d9f607e5306c621eac4d7e7c48130292a5c29c88a5e08a7fa.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod218614a7_f338_4843_88ca_47a21998b61a.slice/crio-conmon-ee40d8ba2d67d5618b638714d2ce7c6e212ac68e092708eb13e1373ce32b367f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod048b3b15_392d_49b6_87e3_251369ff8245.slice/crio-32b7e1d588a26608c4ff2226d22e817f3a1e57b94f575235d707f2b8683c7f31\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9239d708_5ee4_40e4_ae65_cfdc903874f3.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice/crio-f5780806f4062ce45066444dd463c4754eac4c6d59f1f66b137c481b6e59e4a4\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2129199a_a7af_4a97_8205_8276aa63e2b2.slice/crio-conmon-64953335061db058d8b5b7da6ce6f1df4249d55f50d09d06a5a5f56ae42c523a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdca1044_7937_42ab_af75_4060e6c949f1.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod496a8880_f116_4e6b_b59a_ade8af828e74.slice/crio-70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb31d6545_ddad_4fcf_b60d_47be899c6768.slice/crio-18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd853692a_149a_4845_9f5b_36b451683066.slice/crio-conmon-095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9239d708_5ee4_40e4_ae65_cfdc903874f3.slice/crio-f94c97fb895d56dbfa5ad3417820ee07a5fb3a7930726e57f0f13e1ac9b64828.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb77766a4_b6ac_4d30_aa7e_4ebfa6ef7a10.slice/crio-conmon-cbb5c0eb7f259acc3323bb8b5c8d9c401022227da65a83cfa64853886e2cb033.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44c2164d_04ed_4bc7_a71f_e54cc74d7d32.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice/crio-b0b57027434a7e93f10bbdb9ff9422881558003a295dd6f7418dd32d8483e752.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2129199a_a7af_4a97_8205_8276aa63e2b2.slice/crio-b4ad764c83bed4e5a337317fb7b442784d4713df4663e273034c01c213cabf75.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2129199a_a7af_4a97_8205_8276aa63e2b2.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd176a47_2143_45c9_85a5_ab6a32848a86.slice/crio-80e1b70c3c78505fc9368883e94e8ca4a0d4761b51f7679cece305838286cd6a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe4dd66c_3cc4_49f8_acb3_fb2fb19bf0b0.slice/crio-afbe5d21c39ec5fcce9159c699c32264b39f336df313fe23429c77656860423d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44c2164d_04ed_4bc7_a71f_e54cc74d7d32.slice/crio-b5f9ce791b7321a9f19d3aae9c8edbcbb4a9859cc45eef1099ed7974705e0493\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7995cfb3_14d8_4487_b7aa_a2582bc19c52.slice/crio-76d90f996d9429f3dad12ff58e5b5f532eec8f09006eb3e41fd545b24804077c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4759ef3d_e00f_42ee_9964_82553f02b530.slice/crio-conmon-926251e48b6b6d69a4f1fc758d3aba5caf94eb2ad71d5f5f4735f17b70e6c680.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb31d6545_ddad_4fcf_b60d_47be899c6768.slice/crio-conmon-43037d63719c54f059d0bbbce7005e49220a7a30b477272d7e72153c16868ca2.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb77766a4_b6ac_4d30_aa7e_4ebfa6ef7a10.slice\": RecentStats: unable to find data in memory cache]" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.561701 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-77b48987cd-zvgbz_496a8880-f116-4e6b-b59a-ade8af828e74/neutron-api/0.log" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.561739 4769 generic.go:334] "Generic (PLEG): container finished" podID="496a8880-f116-4e6b-b59a-ade8af828e74" containerID="70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20" exitCode=137 Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.561784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" event={"ID":"496a8880-f116-4e6b-b59a-ade8af828e74","Type":"ContainerDied","Data":"70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20"} Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.561809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" event={"ID":"496a8880-f116-4e6b-b59a-ade8af828e74","Type":"ContainerDied","Data":"2cc48925b7f80f7fbc48f701a4d462c22adeb3c63c0eb977a0e1b8b558faf121"} Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.561820 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cc48925b7f80f7fbc48f701a4d462c22adeb3c63c0eb977a0e1b8b558faf121" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.565397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerStarted","Data":"e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181"} Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.565588 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.567958 4769 generic.go:334] "Generic (PLEG): container finished" podID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerID="f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d" exitCode=0 Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.568019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerDied","Data":"f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d"} Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.570742 4769 generic.go:334] "Generic (PLEG): container finished" podID="ba949ad8-33f8-406b-990b-d2038698556d" containerID="3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90" exitCode=137 Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.571688 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.571724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ba949ad8-33f8-406b-990b-d2038698556d","Type":"ContainerDied","Data":"3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90"} Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.571756 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"ba949ad8-33f8-406b-990b-d2038698556d","Type":"ContainerDied","Data":"8d3215e7032e7b488f8503cb0ea3a87c8e3cf4a60fc363ce177d98a58395fb62"} Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.571771 4769 scope.go:117] "RemoveContainer" containerID="3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.579877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7gbp\" (UniqueName: \"kubernetes.io/projected/ba949ad8-33f8-406b-990b-d2038698556d-kube-api-access-x7gbp\") pod \"ba949ad8-33f8-406b-990b-d2038698556d\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.580013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-config-data\") pod \"ba949ad8-33f8-406b-990b-d2038698556d\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.580062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-vencrypt-tls-certs\") pod \"ba949ad8-33f8-406b-990b-d2038698556d\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.580137 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-combined-ca-bundle\") pod \"ba949ad8-33f8-406b-990b-d2038698556d\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.580197 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-nova-novncproxy-tls-certs\") pod \"ba949ad8-33f8-406b-990b-d2038698556d\" (UID: \"ba949ad8-33f8-406b-990b-d2038698556d\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.581005 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-77b48987cd-zvgbz_496a8880-f116-4e6b-b59a-ade8af828e74/neutron-api/0.log" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.581441 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.602157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba949ad8-33f8-406b-990b-d2038698556d-kube-api-access-x7gbp" (OuterVolumeSpecName: "kube-api-access-x7gbp") pod "ba949ad8-33f8-406b-990b-d2038698556d" (UID: "ba949ad8-33f8-406b-990b-d2038698556d"). InnerVolumeSpecName "kube-api-access-x7gbp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.634270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-config-data" (OuterVolumeSpecName: "config-data") pod "ba949ad8-33f8-406b-990b-d2038698556d" (UID: "ba949ad8-33f8-406b-990b-d2038698556d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.658212 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.667454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ba949ad8-33f8-406b-990b-d2038698556d" (UID: "ba949ad8-33f8-406b-990b-d2038698556d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.682830 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-combined-ca-bundle\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.682979 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-config\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-internal-tls-certs\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-ovndb-tls-certs\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683165 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-httpd-config\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683218 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6kcr\" (UniqueName: \"kubernetes.io/projected/496a8880-f116-4e6b-b59a-ade8af828e74-kube-api-access-h6kcr\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-public-tls-certs\") pod \"496a8880-f116-4e6b-b59a-ade8af828e74\" (UID: \"496a8880-f116-4e6b-b59a-ade8af828e74\") " Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683826 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683843 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x7gbp\" (UniqueName: \"kubernetes.io/projected/ba949ad8-33f8-406b-990b-d2038698556d-kube-api-access-x7gbp\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.683853 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.684603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "ba949ad8-33f8-406b-990b-d2038698556d" (UID: "ba949ad8-33f8-406b-990b-d2038698556d"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.714579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496a8880-f116-4e6b-b59a-ade8af828e74-kube-api-access-h6kcr" (OuterVolumeSpecName: "kube-api-access-h6kcr") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "kube-api-access-h6kcr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.718638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.724372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "ba949ad8-33f8-406b-990b-d2038698556d" (UID: "ba949ad8-33f8-406b-990b-d2038698556d"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.756352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.792396 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.792435 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.792445 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h6kcr\" (UniqueName: \"kubernetes.io/projected/496a8880-f116-4e6b-b59a-ade8af828e74-kube-api-access-h6kcr\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.792456 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.792466 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba949ad8-33f8-406b-990b-d2038698556d-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.792578 4769 scope.go:117] "RemoveContainer" containerID="3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90" Nov 21 13:02:21 crc kubenswrapper[4769]: E1121 13:02:21.794882 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90\": container with ID starting with 3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90 not found: ID does not exist" containerID="3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.794917 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90"} err="failed to get container status \"3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90\": rpc error: code = NotFound desc = could not find container \"3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90\": container with ID starting with 3fff837b551eba0896b0f54e2fe9a5c01d96185533a5c760f816cafcecc15e90 not found: ID does not exist" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.807304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.818668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.837394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-config" (OuterVolumeSpecName: "config") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.860950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "496a8880-f116-4e6b-b59a-ade8af828e74" (UID: "496a8880-f116-4e6b-b59a-ade8af828e74"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.900958 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.900994 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.901004 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.901018 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/496a8880-f116-4e6b-b59a-ade8af828e74-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.910362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.915602 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.923414 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:02:21 crc kubenswrapper[4769]: E1121 13:02:21.923850 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-httpd" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.923867 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-httpd" Nov 21 13:02:21 crc kubenswrapper[4769]: E1121 13:02:21.923886 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-api" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.923893 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-api" Nov 21 13:02:21 crc kubenswrapper[4769]: E1121 13:02:21.923924 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ba949ad8-33f8-406b-990b-d2038698556d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.923930 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba949ad8-33f8-406b-990b-d2038698556d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.924101 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-api" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.924118 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ba949ad8-33f8-406b-990b-d2038698556d" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.924137 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" containerName="neutron-httpd" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.924760 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.927982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.928028 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.928246 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:02:21 crc kubenswrapper[4769]: I1121 13:02:21.933343 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.104361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.105242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.105337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.105441 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.105584 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnth5\" (UniqueName: \"kubernetes.io/projected/26b2657a-8faa-447c-910f-441ec806eda0-kube-api-access-fnth5\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.207048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.207167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fnth5\" (UniqueName: \"kubernetes.io/projected/26b2657a-8faa-447c-910f-441ec806eda0-kube-api-access-fnth5\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.207211 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.207239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.207258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.215031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.215378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.217179 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.220737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.237086 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnth5\" (UniqueName: \"kubernetes.io/projected/26b2657a-8faa-447c-910f-441ec806eda0-kube-api-access-fnth5\") pod \"nova-cell1-novncproxy-0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.242660 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.591248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerStarted","Data":"30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1"} Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.625542 4769 generic.go:334] "Generic (PLEG): container finished" podID="a58794b2-3db0-4930-84f4-d8757325a776" containerID="d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad" exitCode=1 Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.626579 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77b48987cd-zvgbz" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.626721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerDied","Data":"d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad"} Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.626827 4769 scope.go:117] "RemoveContainer" containerID="da120ad278951eee9bd026e7afb972ce016c483deec31d9b54192fa2d0282f48" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.627204 4769 scope.go:117] "RemoveContainer" containerID="d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad" Nov 21 13:02:22 crc kubenswrapper[4769]: E1121 13:02:22.627504 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(a58794b2-3db0-4930-84f4-d8757325a776)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.629063 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-xl2wk" podStartSLOduration=2.094834927 podStartE2EDuration="5.62905038s" podCreationTimestamp="2025-11-21 13:02:17 +0000 UTC" firstStartedPulling="2025-11-21 13:02:18.487349808 +0000 UTC m=+4297.188011636" lastFinishedPulling="2025-11-21 13:02:22.021565271 +0000 UTC m=+4300.722227089" observedRunningTime="2025-11-21 13:02:22.618422224 +0000 UTC m=+4301.319084042" watchObservedRunningTime="2025-11-21 13:02:22.62905038 +0000 UTC m=+4301.329712198" Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.722357 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-77b48987cd-zvgbz"] Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.735044 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-77b48987cd-zvgbz"] Nov 21 13:02:22 crc kubenswrapper[4769]: W1121 13:02:22.894580 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26b2657a_8faa_447c_910f_441ec806eda0.slice/crio-a6160733942693776fdda500e1dd2aa3a5cb2bbaad54711a85c454dd5aba0305 WatchSource:0}: Error finding container a6160733942693776fdda500e1dd2aa3a5cb2bbaad54711a85c454dd5aba0305: Status 404 returned error can't find the container with id a6160733942693776fdda500e1dd2aa3a5cb2bbaad54711a85c454dd5aba0305 Nov 21 13:02:22 crc kubenswrapper[4769]: I1121 13:02:22.915518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.118493 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.118538 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.118532 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.284282 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="496a8880-f116-4e6b-b59a-ade8af828e74" path="/var/lib/kubelet/pods/496a8880-f116-4e6b-b59a-ade8af828e74/volumes" Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.285095 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba949ad8-33f8-406b-990b-d2038698556d" path="/var/lib/kubelet/pods/ba949ad8-33f8-406b-990b-d2038698556d/volumes" Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.402527 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.502075 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-584546f6d8-2mpwd"] Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.502500 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" podUID="051a5615-1d34-436f-980d-f2b3408bc139" containerName="keystone-api" containerID="cri-o://fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd" gracePeriod=30 Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.638560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"26b2657a-8faa-447c-910f-441ec806eda0","Type":"ContainerStarted","Data":"4d8a297c93e8b508a0b27f72009d8b1cf1375e71882fa3cf1db35146dcd6e5e7"} Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.638601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"26b2657a-8faa-447c-910f-441ec806eda0","Type":"ContainerStarted","Data":"a6160733942693776fdda500e1dd2aa3a5cb2bbaad54711a85c454dd5aba0305"} Nov 21 13:02:23 crc kubenswrapper[4769]: I1121 13:02:23.661866 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.661844062 podStartE2EDuration="2.661844062s" podCreationTimestamp="2025-11-21 13:02:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:23.654147495 +0000 UTC m=+4302.354809323" watchObservedRunningTime="2025-11-21 13:02:23.661844062 +0000 UTC m=+4302.362505890" Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.637355 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.638402 4769 scope.go:117] "RemoveContainer" containerID="d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad" Nov 21 13:02:24 crc kubenswrapper[4769]: E1121 13:02:24.638625 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(a58794b2-3db0-4930-84f4-d8757325a776)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.658420 4769 generic.go:334] "Generic (PLEG): container finished" podID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerID="e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181" exitCode=1 Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.658652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerDied","Data":"e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181"} Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.658710 4769 scope.go:117] "RemoveContainer" containerID="176c0baae1897ae55f842d8c4a948fd0a87e7c69a8d73be7a62eaa647d8d43c6" Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.659483 4769 scope.go:117] "RemoveContainer" containerID="e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181" Nov 21 13:02:24 crc kubenswrapper[4769]: E1121 13:02:24.659779 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(5415ebc2-eb7c-4b71-bd45-97674d0fe30d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" Nov 21 13:02:24 crc kubenswrapper[4769]: I1121 13:02:24.724419 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.053379 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.206483 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.217994 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice" Nov 21 13:02:25 crc kubenswrapper[4769]: E1121 13:02:25.218095 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.231251 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod6788b7d4-ead9-4e17-8f26-b23369e1332b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod6788b7d4-ead9-4e17-8f26-b23369e1332b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6788b7d4_ead9_4e17_8f26_b23369e1332b.slice" Nov 21 13:02:25 crc kubenswrapper[4769]: E1121 13:02:25.231656 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod6788b7d4-ead9-4e17-8f26-b23369e1332b] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod6788b7d4-ead9-4e17-8f26-b23369e1332b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6788b7d4_ead9_4e17_8f26_b23369e1332b.slice" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.341701 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podb824f9ca-bdca-4673-939a-9bf4e3846140"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podb824f9ca-bdca-4673-939a-9bf4e3846140] : Timed out while waiting for systemd to remove kubepods-besteffort-podb824f9ca_bdca_4673_939a_9bf4e3846140.slice" Nov 21 13:02:25 crc kubenswrapper[4769]: E1121 13:02:25.341764 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort podb824f9ca-bdca-4673-939a-9bf4e3846140] : unable to destroy cgroup paths for cgroup [kubepods besteffort podb824f9ca-bdca-4673-939a-9bf4e3846140] : Timed out while waiting for systemd to remove kubepods-besteffort-podb824f9ca_bdca_4673_939a_9bf4e3846140.slice" pod="openstack-kuttl-tests/nova-api-0" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.344579 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod53ea8f17-e44c-4381-8339-f8cdbd0ea290"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod53ea8f17-e44c-4381-8339-f8cdbd0ea290] : Timed out while waiting for systemd to remove kubepods-besteffort-pod53ea8f17_e44c_4381_8339_f8cdbd0ea290.slice" Nov 21 13:02:25 crc kubenswrapper[4769]: E1121 13:02:25.344626 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod53ea8f17-e44c-4381-8339-f8cdbd0ea290] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod53ea8f17-e44c-4381-8339-f8cdbd0ea290] : Timed out while waiting for systemd to remove kubepods-besteffort-pod53ea8f17_e44c_4381_8339_f8cdbd0ea290.slice" pod="openstack-kuttl-tests/openstack-galera-0" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.575552 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod9ab5c7da_49e6_4b82_be4d_b059b2ffb6f1.slice" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.676010 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.676034 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.676087 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.676318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.677513 4769 scope.go:117] "RemoveContainer" containerID="e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181" Nov 21 13:02:25 crc kubenswrapper[4769]: E1121 13:02:25.678025 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(5415ebc2-eb7c-4b71-bd45-97674d0fe30d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.720583 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.720970 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.721651 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.753836 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.766083 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.804896 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.829584 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7799b4b44-d9rn5"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.845303 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.853728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.856421 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-n8kjm" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.856556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.856927 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.857069 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.868987 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.879876 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.887288 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.889387 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.893266 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.894135 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.894372 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.900077 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.918149 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.927781 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.934758 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.944739 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.946453 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.948669 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-k78dv" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.948865 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.960603 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.980853 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:02:25 crc kubenswrapper[4769]: I1121 13:02:25.983246 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.001389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.001607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-internal-tls-certs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.001716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl5pc\" (UniqueName: \"kubernetes.io/projected/71adc54e-068a-472d-8d1e-99360bc87d82-kube-api-access-hl5pc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.003820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.004048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.004299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.004633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-kolla-config\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.004984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-operator-scripts\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.005144 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-default\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.005272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-config-data\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.005428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-public-tls-certs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.005567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64ms9\" (UniqueName: \"kubernetes.io/projected/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-kube-api-access-64ms9\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.005696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-generated\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.005881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-logs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.023884 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-pqlk9"] Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.024151 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-pqlk9" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="registry-server" containerID="cri-o://2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab" gracePeriod=2 Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107645 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107750 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-operator-scripts\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107778 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-default\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-config-data\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-public-tls-certs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-64ms9\" (UniqueName: \"kubernetes.io/projected/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-kube-api-access-64ms9\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-generated\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58a4b306-e429-4353-acae-c0243a0fef30-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.107959 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-logs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/58a4b306-e429-4353-acae-c0243a0fef30-kube-api-access-vqb97\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-internal-tls-certs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hl5pc\" (UniqueName: \"kubernetes.io/projected/71adc54e-068a-472d-8d1e-99360bc87d82-kube-api-access-hl5pc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-kolla-config\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.108329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-config\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.109751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-default\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.110091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-generated\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.110262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-logs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.111536 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.111602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-operator-scripts\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.111774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-kolla-config\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.114900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.115085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-config-data\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.116504 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-internal-tls-certs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.117099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-public-tls-certs\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.117597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.118259 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.126551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl5pc\" (UniqueName: \"kubernetes.io/projected/71adc54e-068a-472d-8d1e-99360bc87d82-kube-api-access-hl5pc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.138568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-64ms9\" (UniqueName: \"kubernetes.io/projected/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-kube-api-access-64ms9\") pod \"nova-api-0\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.150789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"openstack-galera-0\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.174605 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.209489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.210164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.210294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.210394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.210411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-config\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.210616 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.211484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.211857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.212037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.212151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-config\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.212557 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58a4b306-e429-4353-acae-c0243a0fef30-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.212824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/58a4b306-e429-4353-acae-c0243a0fef30-kube-api-access-vqb97\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.213638 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58a4b306-e429-4353-acae-c0243a0fef30-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.216146 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.216398 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.224070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.244220 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.244449 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" containerName="openstackclient" containerID="cri-o://ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55" gracePeriod=2 Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.250958 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9e3ae579-d4ee-4c52-b835-adb607df1176" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.256204 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.263482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.269981 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:02:26 crc kubenswrapper[4769]: E1121 13:02:26.270391 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" containerName="openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.270404 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" containerName="openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.270641 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" containerName="openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.271406 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.278413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/58a4b306-e429-4353-acae-c0243a0fef30-kube-api-access-vqb97\") pod \"ovsdbserver-sb-0\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.288038 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.418149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.418639 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp6x4\" (UniqueName: \"kubernetes.io/projected/bf1c5df9-318c-49fb-b9c6-f6b182865084-kube-api-access-dp6x4\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.418678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config-secret\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.418703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-combined-ca-bundle\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.521429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config-secret\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.522356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-combined-ca-bundle\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.522596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.522643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dp6x4\" (UniqueName: \"kubernetes.io/projected/bf1c5df9-318c-49fb-b9c6-f6b182865084-kube-api-access-dp6x4\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.523569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.527001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-combined-ca-bundle\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.527450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config-secret\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.549775 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp6x4\" (UniqueName: \"kubernetes.io/projected/bf1c5df9-318c-49fb-b9c6-f6b182865084-kube-api-access-dp6x4\") pod \"openstackclient\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.573607 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.610795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.690125 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.697039 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac87d062-4974-4010-a37f-677a15250ad2" containerID="2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab" exitCode=0 Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.697078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerDied","Data":"2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab"} Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.697103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-pqlk9" event={"ID":"ac87d062-4974-4010-a37f-677a15250ad2","Type":"ContainerDied","Data":"c63482a47ebef54366babfc0ad168cb3bc52dfa386c25a1615e1b639661868fa"} Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.697120 4769 scope.go:117] "RemoveContainer" containerID="2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.697276 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-pqlk9" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.743536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6ncf\" (UniqueName: \"kubernetes.io/projected/ac87d062-4974-4010-a37f-677a15250ad2-kube-api-access-w6ncf\") pod \"ac87d062-4974-4010-a37f-677a15250ad2\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.743628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-utilities\") pod \"ac87d062-4974-4010-a37f-677a15250ad2\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.743708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-catalog-content\") pod \"ac87d062-4974-4010-a37f-677a15250ad2\" (UID: \"ac87d062-4974-4010-a37f-677a15250ad2\") " Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.749947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-utilities" (OuterVolumeSpecName: "utilities") pod "ac87d062-4974-4010-a37f-677a15250ad2" (UID: "ac87d062-4974-4010-a37f-677a15250ad2"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.765687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac87d062-4974-4010-a37f-677a15250ad2-kube-api-access-w6ncf" (OuterVolumeSpecName: "kube-api-access-w6ncf") pod "ac87d062-4974-4010-a37f-677a15250ad2" (UID: "ac87d062-4974-4010-a37f-677a15250ad2"). InnerVolumeSpecName "kube-api-access-w6ncf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.847588 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w6ncf\" (UniqueName: \"kubernetes.io/projected/ac87d062-4974-4010-a37f-677a15250ad2-kube-api-access-w6ncf\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.847623 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.863876 4769 scope.go:117] "RemoveContainer" containerID="f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.879245 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.889068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ac87d062-4974-4010-a37f-677a15250ad2" (UID: "ac87d062-4974-4010-a37f-677a15250ad2"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.912289 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:02:26 crc kubenswrapper[4769]: W1121 13:02:26.931855 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod321bbb3c_1ebe_41b4_bdd6_07f0bd2d38d3.slice/crio-9603d9e2a481c063dcd1b5ca6a29af1f6440f38fff69ab6f1275b54d00a54c7b WatchSource:0}: Error finding container 9603d9e2a481c063dcd1b5ca6a29af1f6440f38fff69ab6f1275b54d00a54c7b: Status 404 returned error can't find the container with id 9603d9e2a481c063dcd1b5ca6a29af1f6440f38fff69ab6f1275b54d00a54c7b Nov 21 13:02:26 crc kubenswrapper[4769]: I1121 13:02:26.950073 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ac87d062-4974-4010-a37f-677a15250ad2-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.061988 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-pqlk9"] Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.069454 4769 scope.go:117] "RemoveContainer" containerID="8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.071795 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-pqlk9"] Nov 21 13:02:27 crc kubenswrapper[4769]: W1121 13:02:27.075243 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58a4b306_e429_4353_acae_c0243a0fef30.slice/crio-a249528c0cabf3c7b4aef19a146709192bf69b6c1a9312454e3166ed5249dfb3 WatchSource:0}: Error finding container a249528c0cabf3c7b4aef19a146709192bf69b6c1a9312454e3166ed5249dfb3: Status 404 returned error can't find the container with id a249528c0cabf3c7b4aef19a146709192bf69b6c1a9312454e3166ed5249dfb3 Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.088650 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.121695 4769 scope.go:117] "RemoveContainer" containerID="2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab" Nov 21 13:02:27 crc kubenswrapper[4769]: E1121 13:02:27.127448 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab\": container with ID starting with 2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab not found: ID does not exist" containerID="2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.127485 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab"} err="failed to get container status \"2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab\": rpc error: code = NotFound desc = could not find container \"2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab\": container with ID starting with 2285f7a536e4cb35b3803ee1964d2d4fa4260dc385e7d7260ed5dcafc002f6ab not found: ID does not exist" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.127514 4769 scope.go:117] "RemoveContainer" containerID="f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc" Nov 21 13:02:27 crc kubenswrapper[4769]: E1121 13:02:27.127989 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc\": container with ID starting with f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc not found: ID does not exist" containerID="f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.128032 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc"} err="failed to get container status \"f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc\": rpc error: code = NotFound desc = could not find container \"f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc\": container with ID starting with f522956ecdf3981978d394806bffe68d25deaf2585f37edc47f61e1f7762f1fc not found: ID does not exist" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.128046 4769 scope.go:117] "RemoveContainer" containerID="8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996" Nov 21 13:02:27 crc kubenswrapper[4769]: E1121 13:02:27.128460 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996\": container with ID starting with 8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996 not found: ID does not exist" containerID="8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.128481 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996"} err="failed to get container status \"8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996\": rpc error: code = NotFound desc = could not find container \"8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996\": container with ID starting with 8be65f522c233f764c00d31b9c657a6b5a4a96f4842337da1a958d26ffec9996 not found: ID does not exist" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.243016 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.285172 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53ea8f17-e44c-4381-8339-f8cdbd0ea290" path="/var/lib/kubelet/pods/53ea8f17-e44c-4381-8339-f8cdbd0ea290/volumes" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.285854 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6788b7d4-ead9-4e17-8f26-b23369e1332b" path="/var/lib/kubelet/pods/6788b7d4-ead9-4e17-8f26-b23369e1332b/volumes" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.287317 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1" path="/var/lib/kubelet/pods/9ab5c7da-49e6-4b82-be4d-b059b2ffb6f1/volumes" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.288295 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac87d062-4974-4010-a37f-677a15250ad2" path="/var/lib/kubelet/pods/ac87d062-4974-4010-a37f-677a15250ad2/volumes" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.289103 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b824f9ca-bdca-4673-939a-9bf4e3846140" path="/var/lib/kubelet/pods/b824f9ca-bdca-4673-939a-9bf4e3846140/volumes" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.385135 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.486572 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.487677 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.500611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.559903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.562965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-credential-keys\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-combined-ca-bundle\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-config-data\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563140 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-fernet-keys\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmvcn\" (UniqueName: \"kubernetes.io/projected/051a5615-1d34-436f-980d-f2b3408bc139-kube-api-access-pmvcn\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-scripts\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-internal-tls-certs\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.563410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-public-tls-certs\") pod \"051a5615-1d34-436f-980d-f2b3408bc139\" (UID: \"051a5615-1d34-436f-980d-f2b3408bc139\") " Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.567766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.568585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.568605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-scripts" (OuterVolumeSpecName: "scripts") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.570834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/051a5615-1d34-436f-980d-f2b3408bc139-kube-api-access-pmvcn" (OuterVolumeSpecName: "kube-api-access-pmvcn") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "kube-api-access-pmvcn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.641904 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.664234 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-config-data" (OuterVolumeSpecName: "config-data") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.665599 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pmvcn\" (UniqueName: \"kubernetes.io/projected/051a5615-1d34-436f-980d-f2b3408bc139-kube-api-access-pmvcn\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.665643 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.665656 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.665668 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.665679 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.665691 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.677472 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.693135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "051a5615-1d34-436f-980d-f2b3408bc139" (UID: "051a5615-1d34-436f-980d-f2b3408bc139"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.712481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3","Type":"ContainerStarted","Data":"21db3ba2938be2dd85f3abb4ebc4b8eadc339476e57de06bd385cc815422e188"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.712532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3","Type":"ContainerStarted","Data":"9603d9e2a481c063dcd1b5ca6a29af1f6440f38fff69ab6f1275b54d00a54c7b"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.716390 4769 generic.go:334] "Generic (PLEG): container finished" podID="71adc54e-068a-472d-8d1e-99360bc87d82" containerID="9641d34e9f6c75dfc91e06309f3de8e5bfc0f4ea613a26df62959c1b55985ac6" exitCode=0 Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.716457 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"71adc54e-068a-472d-8d1e-99360bc87d82","Type":"ContainerDied","Data":"9641d34e9f6c75dfc91e06309f3de8e5bfc0f4ea613a26df62959c1b55985ac6"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.716482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"71adc54e-068a-472d-8d1e-99360bc87d82","Type":"ContainerStarted","Data":"e2dd24ad9683733eb8ab96aa86c3bd8a4ef3b69494d0e32166d3dc0739614f8a"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.719612 4769 generic.go:334] "Generic (PLEG): container finished" podID="051a5615-1d34-436f-980d-f2b3408bc139" containerID="fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd" exitCode=0 Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.719657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" event={"ID":"051a5615-1d34-436f-980d-f2b3408bc139","Type":"ContainerDied","Data":"fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.719675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" event={"ID":"051a5615-1d34-436f-980d-f2b3408bc139","Type":"ContainerDied","Data":"45055e9a252fb55c12afceb094eb9119e09d576225e2e264bfe505a1e7352565"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.719693 4769 scope.go:117] "RemoveContainer" containerID="fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.719815 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-584546f6d8-2mpwd" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.733641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"bf1c5df9-318c-49fb-b9c6-f6b182865084","Type":"ContainerStarted","Data":"3b6481c8eb9cf9d40e9f203aceb608afc5c2efa8b3102aaac342795fb92050b7"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.739577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58a4b306-e429-4353-acae-c0243a0fef30","Type":"ContainerStarted","Data":"6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.739626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58a4b306-e429-4353-acae-c0243a0fef30","Type":"ContainerStarted","Data":"a249528c0cabf3c7b4aef19a146709192bf69b6c1a9312454e3166ed5249dfb3"} Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.767036 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.767064 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/051a5615-1d34-436f-980d-f2b3408bc139-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.772259 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-584546f6d8-2mpwd"] Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.780041 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-584546f6d8-2mpwd"] Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.785051 4769 scope.go:117] "RemoveContainer" containerID="fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd" Nov 21 13:02:27 crc kubenswrapper[4769]: E1121 13:02:27.785543 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd\": container with ID starting with fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd not found: ID does not exist" containerID="fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.785655 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd"} err="failed to get container status \"fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd\": rpc error: code = NotFound desc = could not find container \"fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd\": container with ID starting with fcc0d677c3cd9077774f5509b9a33c5d4daeb7e051c4a615954429584d8f32bd not found: ID does not exist" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.789271 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.789250059 podStartE2EDuration="2.789250059s" podCreationTimestamp="2025-11-21 13:02:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:27.776686591 +0000 UTC m=+4306.477348409" watchObservedRunningTime="2025-11-21 13:02:27.789250059 +0000 UTC m=+4306.489911867" Nov 21 13:02:27 crc kubenswrapper[4769]: I1121 13:02:27.809877 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.119698 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.586639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.681630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-combined-ca-bundle\") pod \"9e3ae579-d4ee-4c52-b835-adb607df1176\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.681685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mbp7\" (UniqueName: \"kubernetes.io/projected/9e3ae579-d4ee-4c52-b835-adb607df1176-kube-api-access-7mbp7\") pod \"9e3ae579-d4ee-4c52-b835-adb607df1176\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.681764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config\") pod \"9e3ae579-d4ee-4c52-b835-adb607df1176\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.681817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config-secret\") pod \"9e3ae579-d4ee-4c52-b835-adb607df1176\" (UID: \"9e3ae579-d4ee-4c52-b835-adb607df1176\") " Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.694400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3ae579-d4ee-4c52-b835-adb607df1176-kube-api-access-7mbp7" (OuterVolumeSpecName: "kube-api-access-7mbp7") pod "9e3ae579-d4ee-4c52-b835-adb607df1176" (UID: "9e3ae579-d4ee-4c52-b835-adb607df1176"). InnerVolumeSpecName "kube-api-access-7mbp7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.730318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e3ae579-d4ee-4c52-b835-adb607df1176" (UID: "9e3ae579-d4ee-4c52-b835-adb607df1176"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.744847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "9e3ae579-d4ee-4c52-b835-adb607df1176" (UID: "9e3ae579-d4ee-4c52-b835-adb607df1176"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.759730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "9e3ae579-d4ee-4c52-b835-adb607df1176" (UID: "9e3ae579-d4ee-4c52-b835-adb607df1176"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.770130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58a4b306-e429-4353-acae-c0243a0fef30","Type":"ContainerStarted","Data":"9149a77a3fefc62b0bcc4f17a966b585e50ad757b668d6c5c43eff2fae813e6d"} Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.772850 4769 generic.go:334] "Generic (PLEG): container finished" podID="9e3ae579-d4ee-4c52-b835-adb607df1176" containerID="ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55" exitCode=137 Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.772913 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.772944 4769 scope.go:117] "RemoveContainer" containerID="ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.775152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3","Type":"ContainerStarted","Data":"17a0033d45d49e6501b7b9b022c2c8851d6e3871e8e0d99fbb3bfcd7f46dc800"} Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.779815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"71adc54e-068a-472d-8d1e-99360bc87d82","Type":"ContainerStarted","Data":"a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da"} Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.784600 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.784642 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mbp7\" (UniqueName: \"kubernetes.io/projected/9e3ae579-d4ee-4c52-b835-adb607df1176-kube-api-access-7mbp7\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.784657 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.784670 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e3ae579-d4ee-4c52-b835-adb607df1176-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.790246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"bf1c5df9-318c-49fb-b9c6-f6b182865084","Type":"ContainerStarted","Data":"8ac98b40303c61f8e3f6c0257994b1437a671acb4350dbdf920975c731300ed7"} Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.811950 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.811926899 podStartE2EDuration="3.811926899s" podCreationTimestamp="2025-11-21 13:02:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:28.797005257 +0000 UTC m=+4307.497667075" watchObservedRunningTime="2025-11-21 13:02:28.811926899 +0000 UTC m=+4307.512588717" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.828983 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=3.828944287 podStartE2EDuration="3.828944287s" podCreationTimestamp="2025-11-21 13:02:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:28.819477362 +0000 UTC m=+4307.520139220" watchObservedRunningTime="2025-11-21 13:02:28.828944287 +0000 UTC m=+4307.529606125" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.837738 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.837714573 podStartE2EDuration="2.837714573s" podCreationTimestamp="2025-11-21 13:02:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:28.836103599 +0000 UTC m=+4307.536765417" watchObservedRunningTime="2025-11-21 13:02:28.837714573 +0000 UTC m=+4307.538376391" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.839057 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9e3ae579-d4ee-4c52-b835-adb607df1176" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.847144 4769 scope.go:117] "RemoveContainer" containerID="ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55" Nov 21 13:02:28 crc kubenswrapper[4769]: E1121 13:02:28.851641 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55\": container with ID starting with ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55 not found: ID does not exist" containerID="ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55" Nov 21 13:02:28 crc kubenswrapper[4769]: I1121 13:02:28.851704 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55"} err="failed to get container status \"ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55\": rpc error: code = NotFound desc = could not find container \"ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55\": container with ID starting with ca416a1282fb0b917e66addfe8e3aeef48a6089f3d1fab62c3a77954d5230e55 not found: ID does not exist" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.286822 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="051a5615-1d34-436f-980d-f2b3408bc139" path="/var/lib/kubelet/pods/051a5615-1d34-436f-980d-f2b3408bc139/volumes" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.288067 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e3ae579-d4ee-4c52-b835-adb607df1176" path="/var/lib/kubelet/pods/9e3ae579-d4ee-4c52-b835-adb607df1176/volumes" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.574621 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.728398 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.728480 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.729290 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cinder-api" containerStatusID={"Type":"cri-o","ID":"d7618f7f9f59ae5a8ca5ceefed75a3547af7dcb9231077854eb2bc6ac250dd86"} pod="openstack-kuttl-tests/cinder-api-0" containerMessage="Container cinder-api failed liveness probe, will be restarted" Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.729331 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" containerID="cri-o://d7618f7f9f59ae5a8ca5ceefed75a3547af7dcb9231077854eb2bc6ac250dd86" gracePeriod=30 Nov 21 13:02:29 crc kubenswrapper[4769]: I1121 13:02:29.734166 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": EOF" Nov 21 13:02:30 crc kubenswrapper[4769]: I1121 13:02:30.097700 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:30 crc kubenswrapper[4769]: I1121 13:02:30.157263 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-xl2wk"] Nov 21 13:02:30 crc kubenswrapper[4769]: I1121 13:02:30.721678 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:30 crc kubenswrapper[4769]: I1121 13:02:30.722378 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:30 crc kubenswrapper[4769]: I1121 13:02:30.826526 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-xl2wk" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="registry-server" containerID="cri-o://30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1" gracePeriod=2 Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.177769 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": read tcp 10.217.0.2:36144->10.217.0.249:9311: read: connection reset by peer" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.177790 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": read tcp 10.217.0.2:36130->10.217.0.249:9311: read: connection reset by peer" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.177818 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": read tcp 10.217.0.2:52296->10.217.0.249:9311: read: connection reset by peer" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.177867 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.178236 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": dial tcp 10.217.0.249:9311: connect: connection refused" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.428290 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.544021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-catalog-content\") pod \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.544392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffzpg\" (UniqueName: \"kubernetes.io/projected/4807a22c-f63d-4c79-a393-a02c0f08fdcc-kube-api-access-ffzpg\") pod \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.544418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-utilities\") pod \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\" (UID: \"4807a22c-f63d-4c79-a393-a02c0f08fdcc\") " Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.545342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-utilities" (OuterVolumeSpecName: "utilities") pod "4807a22c-f63d-4c79-a393-a02c0f08fdcc" (UID: "4807a22c-f63d-4c79-a393-a02c0f08fdcc"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.554169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4807a22c-f63d-4c79-a393-a02c0f08fdcc-kube-api-access-ffzpg" (OuterVolumeSpecName: "kube-api-access-ffzpg") pod "4807a22c-f63d-4c79-a393-a02c0f08fdcc" (UID: "4807a22c-f63d-4c79-a393-a02c0f08fdcc"). InnerVolumeSpecName "kube-api-access-ffzpg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.573729 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.577722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4807a22c-f63d-4c79-a393-a02c0f08fdcc" (UID: "4807a22c-f63d-4c79-a393-a02c0f08fdcc"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.645926 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.645977 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ffzpg\" (UniqueName: \"kubernetes.io/projected/4807a22c-f63d-4c79-a393-a02c0f08fdcc-kube-api-access-ffzpg\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.645987 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4807a22c-f63d-4c79-a393-a02c0f08fdcc-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.840796 4769 generic.go:334] "Generic (PLEG): container finished" podID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerID="30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1" exitCode=0 Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.840873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerDied","Data":"30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1"} Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.840881 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-xl2wk" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.840901 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-xl2wk" event={"ID":"4807a22c-f63d-4c79-a393-a02c0f08fdcc","Type":"ContainerDied","Data":"595c90b2600d8f092a6fb5c472db1b33697bf55d60a7e59f0ce3585e5bc2f79d"} Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.840912 4769 scope.go:117] "RemoveContainer" containerID="30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.845316 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerID="826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f" exitCode=0 Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.845373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerDied","Data":"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f"} Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.845440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerStarted","Data":"2e822914c896f2a2619b3e222e80f4493bdf9e2c950d034bcd95b9ee1c181e2b"} Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.845901 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="barbican-api-log" containerStatusID={"Type":"cri-o","ID":"f06e86b2623816620c859348769585c2a59493cbb86d9ee499fa62cc4059634f"} pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" containerMessage="Container barbican-api-log failed liveness probe, will be restarted" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.845931 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": dial tcp 10.217.0.249:9311: connect: connection refused" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.846216 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" containerID="cri-o://f06e86b2623816620c859348769585c2a59493cbb86d9ee499fa62cc4059634f" gracePeriod=30 Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.846302 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": dial tcp 10.217.0.249:9311: connect: connection refused" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.922391 4769 scope.go:117] "RemoveContainer" containerID="f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d" Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.937594 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-xl2wk"] Nov 21 13:02:31 crc kubenswrapper[4769]: I1121 13:02:31.965572 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-xl2wk"] Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.190694 4769 scope.go:117] "RemoveContainer" containerID="56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.242839 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.264807 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.406516 4769 scope.go:117] "RemoveContainer" containerID="30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1" Nov 21 13:02:32 crc kubenswrapper[4769]: E1121 13:02:32.407084 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1\": container with ID starting with 30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1 not found: ID does not exist" containerID="30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.407435 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1"} err="failed to get container status \"30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1\": rpc error: code = NotFound desc = could not find container \"30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1\": container with ID starting with 30db224181f4985387ae7616e4cf36f62111af0b9907a6d82131d86be7f1fff1 not found: ID does not exist" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.407587 4769 scope.go:117] "RemoveContainer" containerID="f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d" Nov 21 13:02:32 crc kubenswrapper[4769]: E1121 13:02:32.408137 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d\": container with ID starting with f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d not found: ID does not exist" containerID="f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.408225 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d"} err="failed to get container status \"f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d\": rpc error: code = NotFound desc = could not find container \"f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d\": container with ID starting with f6df8e526413e6ba422095cd1ffbec2f669e83dc1ccd496c66d77317247d095d not found: ID does not exist" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.408261 4769 scope.go:117] "RemoveContainer" containerID="56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585" Nov 21 13:02:32 crc kubenswrapper[4769]: E1121 13:02:32.408690 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585\": container with ID starting with 56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585 not found: ID does not exist" containerID="56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.408746 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585"} err="failed to get container status \"56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585\": rpc error: code = NotFound desc = could not find container \"56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585\": container with ID starting with 56c03c9bdab37531931aa11ad55a821105452e788fbaab1a99679fc64a5ed585 not found: ID does not exist" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.625404 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.625450 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.640014 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.863402 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerID="f06e86b2623816620c859348769585c2a59493cbb86d9ee499fa62cc4059634f" exitCode=143 Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.863548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerDied","Data":"f06e86b2623816620c859348769585c2a59493cbb86d9ee499fa62cc4059634f"} Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.863641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerStarted","Data":"9e6873d47fd60aeedf468a0fc9f95d327d75e9110dacc0bc539c33daff8e7f0a"} Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.863707 4769 scope.go:117] "RemoveContainer" containerID="5a23ca9d8c578198505c4aeaa9c9e552783a6c07551851baad340e52214ec296" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.864388 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.864669 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.895971 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:02:32 crc kubenswrapper[4769]: I1121 13:02:32.911498 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:02:33 crc kubenswrapper[4769]: I1121 13:02:33.285003 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" path="/var/lib/kubelet/pods/4807a22c-f63d-4c79-a393-a02c0f08fdcc/volumes" Nov 21 13:02:34 crc kubenswrapper[4769]: I1121 13:02:34.734714 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:34 crc kubenswrapper[4769]: I1121 13:02:34.895921 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:35 crc kubenswrapper[4769]: I1121 13:02:35.099162 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.175144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.175203 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.210485 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.210640 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.262168 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.275646 4769 scope.go:117] "RemoveContainer" containerID="d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad" Nov 21 13:02:36 crc kubenswrapper[4769]: E1121 13:02:36.276418 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(a58794b2-3db0-4930-84f4-d8757325a776)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" Nov 21 13:02:36 crc kubenswrapper[4769]: I1121 13:02:36.983231 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:02:37 crc kubenswrapper[4769]: I1121 13:02:37.222500 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.11:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:37 crc kubenswrapper[4769]: I1121 13:02:37.222592 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.11:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:37 crc kubenswrapper[4769]: I1121 13:02:37.274345 4769 scope.go:117] "RemoveContainer" containerID="e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181" Nov 21 13:02:37 crc kubenswrapper[4769]: E1121 13:02:37.274621 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(5415ebc2-eb7c-4b71-bd45-97674d0fe30d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" Nov 21 13:02:37 crc kubenswrapper[4769]: E1121 13:02:37.293453 4769 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 38.102.83.227:47556->38.102.83.227:40411: read tcp 38.102.83.227:47556->38.102.83.227:40411: read: connection reset by peer Nov 21 13:02:37 crc kubenswrapper[4769]: E1121 13:02:37.293637 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:47556->38.102.83.227:40411: write tcp 38.102.83.227:47556->38.102.83.227:40411: write: broken pipe Nov 21 13:02:37 crc kubenswrapper[4769]: I1121 13:02:37.637033 4769 scope.go:117] "RemoveContainer" containerID="5aa33a1915af89c555f9dc997de37651a9b32a85cf3879217af8d4d6d8e837db" Nov 21 13:02:37 crc kubenswrapper[4769]: I1121 13:02:37.677042 4769 scope.go:117] "RemoveContainer" containerID="7ed04f0bb03ed1aa6e017d2d8870a4aaabdd2f769438a59114beb16841912b82" Nov 21 13:02:39 crc kubenswrapper[4769]: I1121 13:02:39.735612 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:40 crc kubenswrapper[4769]: I1121 13:02:40.099989 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.043725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.117036 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.179401 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v"] Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.179635 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" containerID="cri-o://fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead" gracePeriod=30 Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.179921 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" containerID="cri-o://835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314" gracePeriod=30 Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.184646 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.208325 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.307913 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-69c6595758-mbcv7"] Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.308280 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-log" containerID="cri-o://44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16" gracePeriod=30 Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.308793 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-api" containerID="cri-o://b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6" gracePeriod=30 Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.624448 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.624448 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.992795 4769 generic.go:334] "Generic (PLEG): container finished" podID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerID="fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead" exitCode=143 Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.992876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" event={"ID":"c63b4809-e3ab-4dd6-b92f-d9444de2ba77","Type":"ContainerDied","Data":"fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead"} Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.995844 4769 generic.go:334] "Generic (PLEG): container finished" podID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerID="44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16" exitCode=143 Nov 21 13:02:42 crc kubenswrapper[4769]: I1121 13:02:42.996306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" event={"ID":"d436c6c4-abe9-40db-9de9-27d86c3b96d4","Type":"ContainerDied","Data":"44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16"} Nov 21 13:02:43 crc kubenswrapper[4769]: I1121 13:02:43.230197 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": read tcp 10.217.0.2:42580->10.217.1.6:8776: read: connection reset by peer" Nov 21 13:02:43 crc kubenswrapper[4769]: I1121 13:02:43.230702 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": dial tcp 10.217.1.6:8776: connect: connection refused" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.015909 4769 generic.go:334] "Generic (PLEG): container finished" podID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerID="d7618f7f9f59ae5a8ca5ceefed75a3547af7dcb9231077854eb2bc6ac250dd86" exitCode=0 Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.016113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerDied","Data":"d7618f7f9f59ae5a8ca5ceefed75a3547af7dcb9231077854eb2bc6ac250dd86"} Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.929434 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb"] Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.931318 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="registry-server" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.931436 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="registry-server" Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.931536 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="registry-server" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.931703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="registry-server" Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.931823 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="extract-content" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.931943 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="extract-content" Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.932034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="extract-utilities" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.933172 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="extract-utilities" Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.933309 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="extract-content" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.933399 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="extract-content" Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.933480 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="extract-utilities" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.933558 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="extract-utilities" Nov 21 13:02:44 crc kubenswrapper[4769]: E1121 13:02:44.933654 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="051a5615-1d34-436f-980d-f2b3408bc139" containerName="keystone-api" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.933731 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="051a5615-1d34-436f-980d-f2b3408bc139" containerName="keystone-api" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.934061 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="051a5615-1d34-436f-980d-f2b3408bc139" containerName="keystone-api" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.934224 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4807a22c-f63d-4c79-a393-a02c0f08fdcc" containerName="registry-server" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.934327 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac87d062-4974-4010-a37f-677a15250ad2" containerName="registry-server" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.935721 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:44 crc kubenswrapper[4769]: I1121 13:02:44.943750 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb"] Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.026850 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerStarted","Data":"d11f3c2a669302fbe745c8db3072c55f23ffdb9065c07477980577bdfc291096"} Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.027008 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.046950 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvfwg\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-kube-api-access-zvfwg\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-run-httpd\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047105 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-internal-tls-certs\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047126 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-etc-swift\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-config-data\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-log-httpd\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-combined-ca-bundle\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.047546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-public-tls-certs\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.100853 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.238:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.149889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-internal-tls-certs\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.149945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-etc-swift\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.149986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-config-data\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.150043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-log-httpd\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.150069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-combined-ca-bundle\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.150108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-public-tls-certs\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.150421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfwg\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-kube-api-access-zvfwg\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.150760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-log-httpd\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.152541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-run-httpd\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.154443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-run-httpd\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.180618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-config-data\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.180889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-combined-ca-bundle\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.181125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-public-tls-certs\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.191930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-internal-tls-certs\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.192640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvfwg\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-kube-api-access-zvfwg\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.196529 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-etc-swift\") pod \"swift-proxy-7d4466f676-gspmb\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.312551 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.371821 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.220:9311/healthcheck\": read tcp 10.217.0.2:43894->10.217.0.220:9311: read: connection reset by peer" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.371888 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.220:9311/healthcheck\": read tcp 10.217.0.2:43882->10.217.0.220:9311: read: connection reset by peer" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.821889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb"] Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.878483 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.975993 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z2m5\" (UniqueName: \"kubernetes.io/projected/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-kube-api-access-9z2m5\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.976105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-internal-tls-certs\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.976157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-combined-ca-bundle\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.976204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.976296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data-custom\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.976322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-logs\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.976352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-public-tls-certs\") pod \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\" (UID: \"c63b4809-e3ab-4dd6-b92f-d9444de2ba77\") " Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.977855 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-logs" (OuterVolumeSpecName: "logs") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.981958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-kube-api-access-9z2m5" (OuterVolumeSpecName: "kube-api-access-9z2m5") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "kube-api-access-9z2m5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.983548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:45 crc kubenswrapper[4769]: I1121 13:02:45.985959 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.031573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.036776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" event={"ID":"256d7c47-f6a4-48f9-80c6-c1b2ed07af66","Type":"ContainerStarted","Data":"6c3c73d7d98bc7e4d13ea5035d99a32892b2d469257fd72f68f429c4ed69f7a9"} Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.039003 4769 generic.go:334] "Generic (PLEG): container finished" podID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerID="835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314" exitCode=0 Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.039054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" event={"ID":"c63b4809-e3ab-4dd6-b92f-d9444de2ba77","Type":"ContainerDied","Data":"835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314"} Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.039073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" event={"ID":"c63b4809-e3ab-4dd6-b92f-d9444de2ba77","Type":"ContainerDied","Data":"9c206e65d138ce4a4070f268d892e50d57dd63a227d93f27d578f47a07765bc9"} Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.039101 4769 scope.go:117] "RemoveContainer" containerID="835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.039224 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.042411 4769 generic.go:334] "Generic (PLEG): container finished" podID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerID="b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6" exitCode=0 Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.042481 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.042534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" event={"ID":"d436c6c4-abe9-40db-9de9-27d86c3b96d4","Type":"ContainerDied","Data":"b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6"} Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.042553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-69c6595758-mbcv7" event={"ID":"d436c6c4-abe9-40db-9de9-27d86c3b96d4","Type":"ContainerDied","Data":"a2e4842d1fb34f871401225ae96786351cab0a14a102e9497cde1f57ea2c6b97"} Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.066822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data" (OuterVolumeSpecName: "config-data") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.068336 4769 scope.go:117] "RemoveContainer" containerID="fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.070638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-internal-tls-certs\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-combined-ca-bundle\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d436c6c4-abe9-40db-9de9-27d86c3b96d4-logs\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-public-tls-certs\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078242 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-config-data\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvzbj\" (UniqueName: \"kubernetes.io/projected/d436c6c4-abe9-40db-9de9-27d86c3b96d4-kube-api-access-hvzbj\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078344 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-scripts\") pod \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\" (UID: \"d436c6c4-abe9-40db-9de9-27d86c3b96d4\") " Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.078920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d436c6c4-abe9-40db-9de9-27d86c3b96d4-logs" (OuterVolumeSpecName: "logs") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079703 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9z2m5\" (UniqueName: \"kubernetes.io/projected/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-kube-api-access-9z2m5\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079725 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079735 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079746 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d436c6c4-abe9-40db-9de9-27d86c3b96d4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079755 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079764 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.079772 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.082573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c63b4809-e3ab-4dd6-b92f-d9444de2ba77" (UID: "c63b4809-e3ab-4dd6-b92f-d9444de2ba77"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.083566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-scripts" (OuterVolumeSpecName: "scripts") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.085044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d436c6c4-abe9-40db-9de9-27d86c3b96d4-kube-api-access-hvzbj" (OuterVolumeSpecName: "kube-api-access-hvzbj") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "kube-api-access-hvzbj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.089930 4769 scope.go:117] "RemoveContainer" containerID="835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314" Nov 21 13:02:46 crc kubenswrapper[4769]: E1121 13:02:46.090540 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314\": container with ID starting with 835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314 not found: ID does not exist" containerID="835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.090570 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314"} err="failed to get container status \"835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314\": rpc error: code = NotFound desc = could not find container \"835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314\": container with ID starting with 835383f378e68d8b6af4f8755d42c66e48a36e35f6b9cc49b35a46ee21f70314 not found: ID does not exist" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.090593 4769 scope.go:117] "RemoveContainer" containerID="fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead" Nov 21 13:02:46 crc kubenswrapper[4769]: E1121 13:02:46.090861 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead\": container with ID starting with fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead not found: ID does not exist" containerID="fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.090887 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead"} err="failed to get container status \"fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead\": rpc error: code = NotFound desc = could not find container \"fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead\": container with ID starting with fe26b0afb2cb5f4c1b15eab2b71ffe2a69ccc5b1e5674500681ba463a894fead not found: ID does not exist" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.090900 4769 scope.go:117] "RemoveContainer" containerID="b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.130140 4769 scope.go:117] "RemoveContainer" containerID="44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.135881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.153337 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.158765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-config-data" (OuterVolumeSpecName: "config-data") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.160999 4769 scope.go:117] "RemoveContainer" containerID="b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6" Nov 21 13:02:46 crc kubenswrapper[4769]: E1121 13:02:46.161468 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6\": container with ID starting with b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6 not found: ID does not exist" containerID="b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.161501 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6"} err="failed to get container status \"b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6\": rpc error: code = NotFound desc = could not find container \"b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6\": container with ID starting with b8e63aacd6c90eb2ef03535ccac22843d69f41a7f03ba903ca556023bdee0ef6 not found: ID does not exist" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.161520 4769 scope.go:117] "RemoveContainer" containerID="44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16" Nov 21 13:02:46 crc kubenswrapper[4769]: E1121 13:02:46.161763 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16\": container with ID starting with 44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16 not found: ID does not exist" containerID="44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.161786 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16"} err="failed to get container status \"44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16\": rpc error: code = NotFound desc = could not find container \"44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16\": container with ID starting with 44e28c0e2defc25662d560122fd165a63bb666859345a72a6f2fadc2a25cda16 not found: ID does not exist" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.181902 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.181935 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hvzbj\" (UniqueName: \"kubernetes.io/projected/d436c6c4-abe9-40db-9de9-27d86c3b96d4-kube-api-access-hvzbj\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.181947 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.181958 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.181972 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c63b4809-e3ab-4dd6-b92f-d9444de2ba77-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.255465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.256772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d436c6c4-abe9-40db-9de9-27d86c3b96d4" (UID: "d436c6c4-abe9-40db-9de9-27d86c3b96d4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.266234 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.275581 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.277391 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.284036 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.284067 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d436c6c4-abe9-40db-9de9-27d86c3b96d4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.285639 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.288603 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.383542 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-69c6595758-mbcv7"] Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.398446 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-69c6595758-mbcv7"] Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.407579 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v"] Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.416526 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6c87cc565b-k6h5v"] Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.549273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.549668 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="proxy-httpd" containerID="cri-o://63839ee29ce86f60790b658dc6484e56b915abf826038230883b7d4fa5781183" gracePeriod=30 Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.549703 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="sg-core" containerID="cri-o://860aa39f3d510033c18f62bcaf780145bec3561404269a87bf8a75451aa3b8b4" gracePeriod=30 Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.549686 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-notification-agent" containerID="cri-o://bd29017142e379cd07f0c23e656020c1d9bc483947d032f985a430b05c10983f" gracePeriod=30 Nov 21 13:02:46 crc kubenswrapper[4769]: I1121 13:02:46.549950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-central-agent" containerID="cri-o://16ac3f25f797543f3a4421777f0ed71bcc701d15c84766bce191378378bb6f92" gracePeriod=30 Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.060372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" event={"ID":"256d7c47-f6a4-48f9-80c6-c1b2ed07af66","Type":"ContainerStarted","Data":"668900431d1316c86682af73c5e2c3814c2b0c7d9ccaa62187e8292a784d519a"} Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.060924 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.060964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" event={"ID":"256d7c47-f6a4-48f9-80c6-c1b2ed07af66","Type":"ContainerStarted","Data":"ddc90bd377ffdf27f3a7269fc2566ba60fbf855baacb72d57166e52de1a5840f"} Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.060997 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.067142 4769 generic.go:334] "Generic (PLEG): container finished" podID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerID="63839ee29ce86f60790b658dc6484e56b915abf826038230883b7d4fa5781183" exitCode=0 Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.067227 4769 generic.go:334] "Generic (PLEG): container finished" podID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerID="860aa39f3d510033c18f62bcaf780145bec3561404269a87bf8a75451aa3b8b4" exitCode=2 Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.067253 4769 generic.go:334] "Generic (PLEG): container finished" podID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerID="16ac3f25f797543f3a4421777f0ed71bcc701d15c84766bce191378378bb6f92" exitCode=0 Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.067588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerDied","Data":"63839ee29ce86f60790b658dc6484e56b915abf826038230883b7d4fa5781183"} Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.067721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerDied","Data":"860aa39f3d510033c18f62bcaf780145bec3561404269a87bf8a75451aa3b8b4"} Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.067843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerDied","Data":"16ac3f25f797543f3a4421777f0ed71bcc701d15c84766bce191378378bb6f92"} Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.068008 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" containerID="cri-o://ac2cb2f2c5096316953ace0d17c575b39a8d88d06d2ade9108f9c62ce7750e39" gracePeriod=30 Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.068086 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.068040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="probe" containerID="cri-o://e70eee6b79eed9a80ae259c0914e64f7e3e75f1da47eec8813211d66e1ce35d5" gracePeriod=30 Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.075627 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.089877 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podStartSLOduration=3.089857095 podStartE2EDuration="3.089857095s" podCreationTimestamp="2025-11-21 13:02:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:47.088549399 +0000 UTC m=+4325.789211217" watchObservedRunningTime="2025-11-21 13:02:47.089857095 +0000 UTC m=+4325.790518923" Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.300807 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" path="/var/lib/kubelet/pods/c63b4809-e3ab-4dd6-b92f-d9444de2ba77/volumes" Nov 21 13:02:47 crc kubenswrapper[4769]: I1121 13:02:47.301446 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" path="/var/lib/kubelet/pods/d436c6c4-abe9-40db-9de9-27d86c3b96d4/volumes" Nov 21 13:02:48 crc kubenswrapper[4769]: I1121 13:02:48.091935 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4176877-d6cd-461d-9165-c3f65579b54f" containerID="e70eee6b79eed9a80ae259c0914e64f7e3e75f1da47eec8813211d66e1ce35d5" exitCode=0 Nov 21 13:02:48 crc kubenswrapper[4769]: I1121 13:02:48.092169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4176877-d6cd-461d-9165-c3f65579b54f","Type":"ContainerDied","Data":"e70eee6b79eed9a80ae259c0914e64f7e3e75f1da47eec8813211d66e1ce35d5"} Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.121760 4769 generic.go:334] "Generic (PLEG): container finished" podID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerID="bd29017142e379cd07f0c23e656020c1d9bc483947d032f985a430b05c10983f" exitCode=0 Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.121840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerDied","Data":"bd29017142e379cd07f0c23e656020c1d9bc483947d032f985a430b05c10983f"} Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.274522 4769 scope.go:117] "RemoveContainer" containerID="e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181" Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.274995 4769 scope.go:117] "RemoveContainer" containerID="d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad" Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.925505 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-config-data\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-sg-core-conf-yaml\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-log-httpd\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-ceilometer-tls-certs\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-scripts\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994444 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-run-httpd\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gw6h\" (UniqueName: \"kubernetes.io/projected/baaa3a6b-bea8-4973-8fc9-e8062aca3293-kube-api-access-6gw6h\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-combined-ca-bundle\") pod \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\" (UID: \"baaa3a6b-bea8-4973-8fc9-e8062aca3293\") " Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994649 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.994999 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:50 crc kubenswrapper[4769]: I1121 13:02:50.995015 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/baaa3a6b-bea8-4973-8fc9-e8062aca3293-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.000847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-scripts" (OuterVolumeSpecName: "scripts") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.007126 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baaa3a6b-bea8-4973-8fc9-e8062aca3293-kube-api-access-6gw6h" (OuterVolumeSpecName: "kube-api-access-6gw6h") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "kube-api-access-6gw6h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.049211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.091699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.097042 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6gw6h\" (UniqueName: \"kubernetes.io/projected/baaa3a6b-bea8-4973-8fc9-e8062aca3293-kube-api-access-6gw6h\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.097066 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.097074 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.097083 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.122263 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.136478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerStarted","Data":"f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f"} Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.139253 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.158469 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.161104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"baaa3a6b-bea8-4973-8fc9-e8062aca3293","Type":"ContainerDied","Data":"b22637058300d360e4c3896a7222df78eeb543080552425bd152451b052b0c7d"} Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.161153 4769 scope.go:117] "RemoveContainer" containerID="63839ee29ce86f60790b658dc6484e56b915abf826038230883b7d4fa5781183" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.171922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-config-data" (OuterVolumeSpecName: "config-data") pod "baaa3a6b-bea8-4973-8fc9-e8062aca3293" (UID: "baaa3a6b-bea8-4973-8fc9-e8062aca3293"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.181132 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4176877-d6cd-461d-9165-c3f65579b54f" containerID="ac2cb2f2c5096316953ace0d17c575b39a8d88d06d2ade9108f9c62ce7750e39" exitCode=0 Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.181351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4176877-d6cd-461d-9165-c3f65579b54f","Type":"ContainerDied","Data":"ac2cb2f2c5096316953ace0d17c575b39a8d88d06d2ade9108f9c62ce7750e39"} Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.185593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerStarted","Data":"1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2"} Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.189298 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.210349 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.210383 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baaa3a6b-bea8-4973-8fc9-e8062aca3293-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.245498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.253257 4769 scope.go:117] "RemoveContainer" containerID="860aa39f3d510033c18f62bcaf780145bec3561404269a87bf8a75451aa3b8b4" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.304529 4769 scope.go:117] "RemoveContainer" containerID="bd29017142e379cd07f0c23e656020c1d9bc483947d032f985a430b05c10983f" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.311067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4176877-d6cd-461d-9165-c3f65579b54f-etc-machine-id\") pod \"d4176877-d6cd-461d-9165-c3f65579b54f\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.311229 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xtxb\" (UniqueName: \"kubernetes.io/projected/d4176877-d6cd-461d-9165-c3f65579b54f-kube-api-access-2xtxb\") pod \"d4176877-d6cd-461d-9165-c3f65579b54f\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.311311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data-custom\") pod \"d4176877-d6cd-461d-9165-c3f65579b54f\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.311370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-scripts\") pod \"d4176877-d6cd-461d-9165-c3f65579b54f\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.311405 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data\") pod \"d4176877-d6cd-461d-9165-c3f65579b54f\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.311482 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-combined-ca-bundle\") pod \"d4176877-d6cd-461d-9165-c3f65579b54f\" (UID: \"d4176877-d6cd-461d-9165-c3f65579b54f\") " Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.316413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4176877-d6cd-461d-9165-c3f65579b54f-kube-api-access-2xtxb" (OuterVolumeSpecName: "kube-api-access-2xtxb") pod "d4176877-d6cd-461d-9165-c3f65579b54f" (UID: "d4176877-d6cd-461d-9165-c3f65579b54f"). InnerVolumeSpecName "kube-api-access-2xtxb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.316456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d4176877-d6cd-461d-9165-c3f65579b54f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d4176877-d6cd-461d-9165-c3f65579b54f" (UID: "d4176877-d6cd-461d-9165-c3f65579b54f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.317098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-scripts" (OuterVolumeSpecName: "scripts") pod "d4176877-d6cd-461d-9165-c3f65579b54f" (UID: "d4176877-d6cd-461d-9165-c3f65579b54f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.318510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d4176877-d6cd-461d-9165-c3f65579b54f" (UID: "d4176877-d6cd-461d-9165-c3f65579b54f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.338015 4769 scope.go:117] "RemoveContainer" containerID="16ac3f25f797543f3a4421777f0ed71bcc701d15c84766bce191378378bb6f92" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.352965 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.389168 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4176877-d6cd-461d-9165-c3f65579b54f" (UID: "d4176877-d6cd-461d-9165-c3f65579b54f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.421007 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.421036 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.421047 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d4176877-d6cd-461d-9165-c3f65579b54f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.421055 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2xtxb\" (UniqueName: \"kubernetes.io/projected/d4176877-d6cd-461d-9165-c3f65579b54f-kube-api-access-2xtxb\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.421064 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.432037 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-77df7c767d-c55bj"] Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.432267 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-api" containerID="cri-o://ff26fa2a207ee8a00f21c5304aa1bb9a79037310e96f45d6dd9fed60d774aa67" gracePeriod=30 Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.432721 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-httpd" containerID="cri-o://56c8ac7ed57b9cc0fdfc177e6000ff8cf3f9a100ecb27379432b3353fab8c0a0" gracePeriod=30 Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.487527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data" (OuterVolumeSpecName: "config-data") pod "d4176877-d6cd-461d-9165-c3f65579b54f" (UID: "d4176877-d6cd-461d-9165-c3f65579b54f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.492872 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.505692 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.518937 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519346 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519363 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519386 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="probe" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519393 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="probe" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519402 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519408 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519419 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-notification-agent" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519425 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-notification-agent" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519437 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519442 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-central-agent" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519470 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-central-agent" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519481 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="proxy-httpd" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519486 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="proxy-httpd" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519495 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-api" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519501 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-api" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519513 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="sg-core" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="sg-core" Nov 21 13:02:51 crc kubenswrapper[4769]: E1121 13:02:51.519532 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-log" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519538 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-log" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519710 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api-log" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519725 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="proxy-httpd" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519736 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-notification-agent" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519750 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="probe" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519763 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-log" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519770 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c63b4809-e3ab-4dd6-b92f-d9444de2ba77" containerName="barbican-api" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519780 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="sg-core" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519788 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" containerName="ceilometer-central-agent" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519800 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d436c6c4-abe9-40db-9de9-27d86c3b96d4" containerName="placement-api" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.519816 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" containerName="cinder-scheduler" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.522260 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.523080 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4176877-d6cd-461d-9165-c3f65579b54f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.524514 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.526064 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.526230 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.529821 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.626580 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.629929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630010 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-scripts\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-run-httpd\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-log-httpd\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgc9q\" (UniqueName: \"kubernetes.io/projected/2fd709dc-5ec6-4bdd-b227-47e7208301f4-kube-api-access-zgc9q\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-config-data\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.630391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.633027 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.633699 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.731974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-run-httpd\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-log-httpd\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zgc9q\" (UniqueName: \"kubernetes.io/projected/2fd709dc-5ec6-4bdd-b227-47e7208301f4-kube-api-access-zgc9q\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732139 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-config-data\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-scripts\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-run-httpd\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.732667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-log-httpd\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.736817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.736983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.737386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-scripts\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.738798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-config-data\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.741909 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.748612 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgc9q\" (UniqueName: \"kubernetes.io/projected/2fd709dc-5ec6-4bdd-b227-47e7208301f4-kube-api-access-zgc9q\") pod \"ceilometer-0\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:51 crc kubenswrapper[4769]: I1121 13:02:51.848707 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.212409 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5d78831-4a38-4935-8074-25d822e2a4db" containerID="56c8ac7ed57b9cc0fdfc177e6000ff8cf3f9a100ecb27379432b3353fab8c0a0" exitCode=0 Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.212806 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" event={"ID":"c5d78831-4a38-4935-8074-25d822e2a4db","Type":"ContainerDied","Data":"56c8ac7ed57b9cc0fdfc177e6000ff8cf3f9a100ecb27379432b3353fab8c0a0"} Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.218375 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.218436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"d4176877-d6cd-461d-9165-c3f65579b54f","Type":"ContainerDied","Data":"6540e86d91b1f376bc91897fedea0eddfeeb5b36d0ee68d2067bbe668cece1db"} Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.218471 4769 scope.go:117] "RemoveContainer" containerID="e70eee6b79eed9a80ae259c0914e64f7e3e75f1da47eec8813211d66e1ce35d5" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.233844 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.277725 4769 scope.go:117] "RemoveContainer" containerID="ac2cb2f2c5096316953ace0d17c575b39a8d88d06d2ade9108f9c62ce7750e39" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.331291 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.371765 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.390694 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.392918 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.394886 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.433393 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.446991 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.466254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.466385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.466411 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnp4l\" (UniqueName: \"kubernetes.io/projected/10af4f12-f920-4eef-bc05-b9e10a4bc83e-kube-api-access-jnp4l\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.466618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/10af4f12-f920-4eef-bc05-b9e10a4bc83e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.466660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-scripts\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.466714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jnp4l\" (UniqueName: \"kubernetes.io/projected/10af4f12-f920-4eef-bc05-b9e10a4bc83e-kube-api-access-jnp4l\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568321 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/10af4f12-f920-4eef-bc05-b9e10a4bc83e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-scripts\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.568535 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/10af4f12-f920-4eef-bc05-b9e10a4bc83e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.573599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-scripts\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.573949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.575677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.585946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.589889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnp4l\" (UniqueName: \"kubernetes.io/projected/10af4f12-f920-4eef-bc05-b9e10a4bc83e-kube-api-access-jnp4l\") pod \"cinder-scheduler-0\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:52 crc kubenswrapper[4769]: I1121 13:02:52.728776 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:53 crc kubenswrapper[4769]: I1121 13:02:53.035902 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:02:53 crc kubenswrapper[4769]: I1121 13:02:53.221676 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:02:53 crc kubenswrapper[4769]: I1121 13:02:53.240354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerStarted","Data":"7831c9097a041d65632c254ee1c11941a242c3ed8e10171cb517c82b9d986263"} Nov 21 13:02:53 crc kubenswrapper[4769]: I1121 13:02:53.240686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerStarted","Data":"d280c4a8ec344af69d137a45d18ec9bb042073abbbb9880363928bfef58425d2"} Nov 21 13:02:53 crc kubenswrapper[4769]: I1121 13:02:53.293025 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baaa3a6b-bea8-4973-8fc9-e8062aca3293" path="/var/lib/kubelet/pods/baaa3a6b-bea8-4973-8fc9-e8062aca3293/volumes" Nov 21 13:02:53 crc kubenswrapper[4769]: I1121 13:02:53.294877 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4176877-d6cd-461d-9165-c3f65579b54f" path="/var/lib/kubelet/pods/d4176877-d6cd-461d-9165-c3f65579b54f/volumes" Nov 21 13:02:54 crc kubenswrapper[4769]: I1121 13:02:54.280006 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"10af4f12-f920-4eef-bc05-b9e10a4bc83e","Type":"ContainerStarted","Data":"f4648ef48e02b69b5ba0994108b42d604e490454d8293eabe62259bff04bb9dc"} Nov 21 13:02:54 crc kubenswrapper[4769]: I1121 13:02:54.280846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"10af4f12-f920-4eef-bc05-b9e10a4bc83e","Type":"ContainerStarted","Data":"c9e3841ee1c9728836869cdb9bde2c413ed658c353f97d7dc39be30355769c9a"} Nov 21 13:02:54 crc kubenswrapper[4769]: I1121 13:02:54.284314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerStarted","Data":"39e70cc150e898b13cde320e2a371f6f6678d9d3ae0368c4793dfb8c9ff670aa"} Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.298991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"10af4f12-f920-4eef-bc05-b9e10a4bc83e","Type":"ContainerStarted","Data":"3ff7d8741fbd7c54e8c1592e987b6e5f7442db7d0abd90263abe6b64fc6b67d0"} Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.304799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerStarted","Data":"8dd0961bbecbb5ebf75b6a14a2d90472208c8a692c422433717604077c287f9e"} Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.325401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.325644 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.325627356 podStartE2EDuration="3.325627356s" podCreationTimestamp="2025-11-21 13:02:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:02:55.321566827 +0000 UTC m=+4334.022228655" watchObservedRunningTime="2025-11-21 13:02:55.325627356 +0000 UTC m=+4334.026289174" Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.326268 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.419659 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj"] Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.420122 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-httpd" containerID="cri-o://cb17545442ff5c398e436edf991e85194bfbac9725d461de1af5917847eff80b" gracePeriod=30 Nov 21 13:02:55 crc kubenswrapper[4769]: I1121 13:02:55.420361 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-server" containerID="cri-o://4e56e41163f425fd97aa596c4d90c368de03eca2a265ead670dbe976b107d8e4" gracePeriod=30 Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.000594 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.153:9696/\": dial tcp 10.217.0.153:9696: connect: connection refused" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.315255 4769 generic.go:334] "Generic (PLEG): container finished" podID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerID="4e56e41163f425fd97aa596c4d90c368de03eca2a265ead670dbe976b107d8e4" exitCode=0 Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.315460 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" event={"ID":"397a49d3-b26e-45f8-88d7-c5d37062391a","Type":"ContainerDied","Data":"4e56e41163f425fd97aa596c4d90c368de03eca2a265ead670dbe976b107d8e4"} Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.317492 4769 generic.go:334] "Generic (PLEG): container finished" podID="c5d78831-4a38-4935-8074-25d822e2a4db" containerID="ff26fa2a207ee8a00f21c5304aa1bb9a79037310e96f45d6dd9fed60d774aa67" exitCode=0 Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.318415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" event={"ID":"c5d78831-4a38-4935-8074-25d822e2a4db","Type":"ContainerDied","Data":"ff26fa2a207ee8a00f21c5304aa1bb9a79037310e96f45d6dd9fed60d774aa67"} Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.587355 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.666278 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-public-tls-certs\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv9cx\" (UniqueName: \"kubernetes.io/projected/c5d78831-4a38-4935-8074-25d822e2a4db-kube-api-access-tv9cx\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-ovndb-tls-certs\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-httpd-config\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-config\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-combined-ca-bundle\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.752866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-internal-tls-certs\") pod \"c5d78831-4a38-4935-8074-25d822e2a4db\" (UID: \"c5d78831-4a38-4935-8074-25d822e2a4db\") " Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.760338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.760782 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d78831-4a38-4935-8074-25d822e2a4db-kube-api-access-tv9cx" (OuterVolumeSpecName: "kube-api-access-tv9cx") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "kube-api-access-tv9cx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.829425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-config" (OuterVolumeSpecName: "config") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.830294 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.839850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.840052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "c5d78831-4a38-4935-8074-25d822e2a4db" (UID: "c5d78831-4a38-4935-8074-25d822e2a4db"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855900 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855922 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855931 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855943 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855952 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855961 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tv9cx\" (UniqueName: \"kubernetes.io/projected/c5d78831-4a38-4935-8074-25d822e2a4db-kube-api-access-tv9cx\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:56 crc kubenswrapper[4769]: I1121 13:02:56.855972 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/c5d78831-4a38-4935-8074-25d822e2a4db-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.329058 4769 generic.go:334] "Generic (PLEG): container finished" podID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerID="cb17545442ff5c398e436edf991e85194bfbac9725d461de1af5917847eff80b" exitCode=0 Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.329138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" event={"ID":"397a49d3-b26e-45f8-88d7-c5d37062391a","Type":"ContainerDied","Data":"cb17545442ff5c398e436edf991e85194bfbac9725d461de1af5917847eff80b"} Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.332127 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.332133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-77df7c767d-c55bj" event={"ID":"c5d78831-4a38-4935-8074-25d822e2a4db","Type":"ContainerDied","Data":"54f7e9b21bb75d241954fdb034d0682fc09767be073c1f12fef5547027a734d2"} Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.332202 4769 scope.go:117] "RemoveContainer" containerID="56c8ac7ed57b9cc0fdfc177e6000ff8cf3f9a100ecb27379432b3353fab8c0a0" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.337301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerStarted","Data":"cc1f1b68710e629475619e1da7750098b33d32cf27f93ef72ab35193ee1e2adb"} Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.338146 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.362577 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-77df7c767d-c55bj"] Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.374281 4769 scope.go:117] "RemoveContainer" containerID="ff26fa2a207ee8a00f21c5304aa1bb9a79037310e96f45d6dd9fed60d774aa67" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.380359 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-77df7c767d-c55bj"] Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.387559 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.670396122 podStartE2EDuration="6.387540901s" podCreationTimestamp="2025-11-21 13:02:51 +0000 UTC" firstStartedPulling="2025-11-21 13:02:52.359671356 +0000 UTC m=+4331.060333174" lastFinishedPulling="2025-11-21 13:02:56.076816135 +0000 UTC m=+4334.777477953" observedRunningTime="2025-11-21 13:02:57.3722786 +0000 UTC m=+4336.072940428" watchObservedRunningTime="2025-11-21 13:02:57.387540901 +0000 UTC m=+4336.088202719" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.729791 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.875798 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.978990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-etc-swift\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-log-httpd\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-internal-tls-certs\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-combined-ca-bundle\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-public-tls-certs\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-config-data\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-run-httpd\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppgnh\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-kube-api-access-ppgnh\") pod \"397a49d3-b26e-45f8-88d7-c5d37062391a\" (UID: \"397a49d3-b26e-45f8-88d7-c5d37062391a\") " Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.979697 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.980010 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.980031 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/397a49d3-b26e-45f8-88d7-c5d37062391a-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:57 crc kubenswrapper[4769]: I1121 13:02:57.991438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-kube-api-access-ppgnh" (OuterVolumeSpecName: "kube-api-access-ppgnh") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "kube-api-access-ppgnh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.004996 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.061180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.066955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-config-data" (OuterVolumeSpecName: "config-data") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.076767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.081784 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.081821 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.081834 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.081845 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.081859 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ppgnh\" (UniqueName: \"kubernetes.io/projected/397a49d3-b26e-45f8-88d7-c5d37062391a-kube-api-access-ppgnh\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.101779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "397a49d3-b26e-45f8-88d7-c5d37062391a" (UID: "397a49d3-b26e-45f8-88d7-c5d37062391a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.183395 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/397a49d3-b26e-45f8-88d7-c5d37062391a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.247121 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.355774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" event={"ID":"397a49d3-b26e-45f8-88d7-c5d37062391a","Type":"ContainerDied","Data":"3125cf5edeb435e18d9ecf5c97fe08b7efd3104c2704dcc8dfff726727cd8f70"} Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.355847 4769 scope.go:117] "RemoveContainer" containerID="4e56e41163f425fd97aa596c4d90c368de03eca2a265ead670dbe976b107d8e4" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.355853 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.384911 4769 scope.go:117] "RemoveContainer" containerID="cb17545442ff5c398e436edf991e85194bfbac9725d461de1af5917847eff80b" Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.429596 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj"] Nov 21 13:02:58 crc kubenswrapper[4769]: I1121 13:02:58.438339 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7b9d9c6dfd-8zmwj"] Nov 21 13:02:59 crc kubenswrapper[4769]: I1121 13:02:59.285305 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" path="/var/lib/kubelet/pods/397a49d3-b26e-45f8-88d7-c5d37062391a/volumes" Nov 21 13:02:59 crc kubenswrapper[4769]: I1121 13:02:59.286832 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" path="/var/lib/kubelet/pods/c5d78831-4a38-4935-8074-25d822e2a4db/volumes" Nov 21 13:03:02 crc kubenswrapper[4769]: I1121 13:03:02.959284 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:03:08 crc kubenswrapper[4769]: E1121 13:03:08.229361 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:39216->38.102.83.227:40411: write tcp 38.102.83.227:39216->38.102.83.227:40411: write: broken pipe Nov 21 13:03:10 crc kubenswrapper[4769]: E1121 13:03:10.679424 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:39332->38.102.83.227:40411: write tcp 38.102.83.227:39332->38.102.83.227:40411: write: broken pipe Nov 21 13:03:18 crc kubenswrapper[4769]: E1121 13:03:18.140533 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:39574->38.102.83.227:40411: write tcp 38.102.83.227:39574->38.102.83.227:40411: write: connection reset by peer Nov 21 13:03:21 crc kubenswrapper[4769]: E1121 13:03:21.005023 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:57082->38.102.83.227:40411: write tcp 38.102.83.227:57082->38.102.83.227:40411: write: broken pipe Nov 21 13:03:21 crc kubenswrapper[4769]: I1121 13:03:21.858604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:03:23 crc kubenswrapper[4769]: E1121 13:03:23.294405 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:57144->38.102.83.227:40411: write tcp 38.102.83.227:57144->38.102.83.227:40411: write: broken pipe Nov 21 13:03:24 crc kubenswrapper[4769]: E1121 13:03:24.668765 4769 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 38.102.83.227:57210->38.102.83.227:40411: read tcp 38.102.83.227:57210->38.102.83.227:40411: read: connection reset by peer Nov 21 13:03:38 crc kubenswrapper[4769]: I1121 13:03:38.318442 4769 scope.go:117] "RemoveContainer" containerID="3187d0f1f1fba23fac9aa4ceed66b66ee842149aa45e5a10a298eed771fd2728" Nov 21 13:03:38 crc kubenswrapper[4769]: I1121 13:03:38.388495 4769 scope.go:117] "RemoveContainer" containerID="fd1f4ae5ee466e0378b8e87f3e3b3a73507dd1bdaa889a19ead72be3a73c3fea" Nov 21 13:03:41 crc kubenswrapper[4769]: I1121 13:03:41.325154 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:03:41 crc kubenswrapper[4769]: I1121 13:03:41.325759 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:03:47 crc kubenswrapper[4769]: I1121 13:03:47.719296 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:03:47 crc kubenswrapper[4769]: E1121 13:03:47.832351 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:47 crc kubenswrapper[4769]: E1121 13:03:47.832416 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data podName:9aa39735-6ebc-412a-ae3c-bfb951dc599b nodeName:}" failed. No retries permitted until 2025-11-21 13:03:48.332400672 +0000 UTC m=+4387.033062490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data") pod "rabbitmq-cell1-server-0" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:47 crc kubenswrapper[4769]: I1121 13:03:47.854142 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:03:47 crc kubenswrapper[4769]: I1121 13:03:47.854472 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" containerName="openstackclient" containerID="cri-o://8ac98b40303c61f8e3f6c0257994b1437a671acb4350dbdf920975c731300ed7" gracePeriod=2 Nov 21 13:03:47 crc kubenswrapper[4769]: I1121 13:03:47.877395 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.032295 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder72a2-account-delete-9dc89"] Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.032987 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-server" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033006 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-server" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.033061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-httpd" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-httpd" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.033086 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-api" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033092 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-api" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.033106 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-httpd" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033112 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-httpd" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.033132 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" containerName="openstackclient" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033138 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" containerName="openstackclient" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033495 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-httpd" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033532 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" containerName="openstackclient" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033560 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c5d78831-4a38-4935-8074-25d822e2a4db" containerName="neutron-api" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033576 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-httpd" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.033585 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="397a49d3-b26e-45f8-88d7-c5d37062391a" containerName="proxy-server" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.034435 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.063749 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder72a2-account-delete-9dc89"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.095656 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.096092 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="openstack-network-exporter" containerID="cri-o://9149a77a3fefc62b0bcc4f17a966b585e50ad757b668d6c5c43eff2fae813e6d" gracePeriod=300 Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.135872 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.137184 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.147296 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e6443119-0dca-440c-bb46-ab52b91c0ef5-operator-scripts\") pod \"cinder72a2-account-delete-9dc89\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.147414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfr96\" (UniqueName: \"kubernetes.io/projected/e6443119-0dca-440c-bb46-ab52b91c0ef5-kube-api-access-bfr96\") pod \"cinder72a2-account-delete-9dc89\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.237489 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.238136 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="openstack-network-exporter" containerID="cri-o://8dc7ca31c97aaa0fbc2ec5667cb2256ab26fad754d649fb90c79e49d352028cf" gracePeriod=300 Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.249099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bfr96\" (UniqueName: \"kubernetes.io/projected/e6443119-0dca-440c-bb46-ab52b91c0ef5-kube-api-access-bfr96\") pod \"cinder72a2-account-delete-9dc89\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.249263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e6443119-0dca-440c-bb46-ab52b91c0ef5-operator-scripts\") pod \"cinder72a2-account-delete-9dc89\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.249369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/08c20fd4-12d3-483c-85e3-b766adb4a666-operator-scripts\") pod \"neutron1fd2-account-delete-f8ncl\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.249402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54nbh\" (UniqueName: \"kubernetes.io/projected/08c20fd4-12d3-483c-85e3-b766adb4a666-kube-api-access-54nbh\") pod \"neutron1fd2-account-delete-f8ncl\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.256085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e6443119-0dca-440c-bb46-ab52b91c0ef5-operator-scripts\") pod \"cinder72a2-account-delete-9dc89\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.278354 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.287923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfr96\" (UniqueName: \"kubernetes.io/projected/e6443119-0dca-440c-bb46-ab52b91c0ef5-kube-api-access-bfr96\") pod \"cinder72a2-account-delete-9dc89\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.311430 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance6ada-account-delete-bwjtq"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.312756 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.327952 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance6ada-account-delete-bwjtq"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.340383 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-zpnxl"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.353134 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-zpnxl"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.354420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/08c20fd4-12d3-483c-85e3-b766adb4a666-operator-scripts\") pod \"neutron1fd2-account-delete-f8ncl\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.354454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-54nbh\" (UniqueName: \"kubernetes.io/projected/08c20fd4-12d3-483c-85e3-b766adb4a666-kube-api-access-54nbh\") pod \"neutron1fd2-account-delete-f8ncl\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.354673 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.354711 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data podName:9aa39735-6ebc-412a-ae3c-bfb951dc599b nodeName:}" failed. No retries permitted until 2025-11-21 13:03:49.354697547 +0000 UTC m=+4388.055359365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data") pod "rabbitmq-cell1-server-0" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.355688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/08c20fd4-12d3-483c-85e3-b766adb4a666-operator-scripts\") pod \"neutron1fd2-account-delete-f8ncl\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.369049 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.411143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-54nbh\" (UniqueName: \"kubernetes.io/projected/08c20fd4-12d3-483c-85e3-b766adb4a666-kube-api-access-54nbh\") pod \"neutron1fd2-account-delete-f8ncl\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.416891 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placementd614-account-delete-2n8wr"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.428772 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.456949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9gs\" (UniqueName: \"kubernetes.io/projected/700428ca-7063-46bf-82da-64a8750a80bf-kube-api-access-tt9gs\") pod \"glance6ada-account-delete-bwjtq\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.457108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/700428ca-7063-46bf-82da-64a8750a80bf-operator-scripts\") pod \"glance6ada-account-delete-bwjtq\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.458729 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.459257 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.459304 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data podName:320ae09e-4eaf-4abe-a5b2-554d1408238c nodeName:}" failed. No retries permitted until 2025-11-21 13:03:48.959289123 +0000 UTC m=+4387.659950941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data") pod "rabbitmq-server-0" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c") : configmap "rabbitmq-config-data" not found Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.471276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementd614-account-delete-2n8wr"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.537283 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell009b6-account-delete-d2gqm"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.538543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.539456 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="ovsdbserver-sb" containerID="cri-o://6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6" gracePeriod=300 Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.558743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9gs\" (UniqueName: \"kubernetes.io/projected/700428ca-7063-46bf-82da-64a8750a80bf-kube-api-access-tt9gs\") pod \"glance6ada-account-delete-bwjtq\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.558888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqxb\" (UniqueName: \"kubernetes.io/projected/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-kube-api-access-ppqxb\") pod \"placementd614-account-delete-2n8wr\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.558970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/700428ca-7063-46bf-82da-64a8750a80bf-operator-scripts\") pod \"glance6ada-account-delete-bwjtq\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.559013 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-operator-scripts\") pod \"placementd614-account-delete-2n8wr\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.560479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/700428ca-7063-46bf-82da-64a8750a80bf-operator-scripts\") pod \"glance6ada-account-delete-bwjtq\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.596118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.596346 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" containerID="cri-o://abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" gracePeriod=30 Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.596697 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="openstack-network-exporter" containerID="cri-o://590e228d49d05abb2be4d1a84c6f2163c933790fed2e99c43fe83a46e2d9ea93" gracePeriod=30 Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.634519 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell009b6-account-delete-d2gqm"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.655210 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9gs\" (UniqueName: \"kubernetes.io/projected/700428ca-7063-46bf-82da-64a8750a80bf-kube-api-access-tt9gs\") pod \"glance6ada-account-delete-bwjtq\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.661247 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi8be8-account-delete-pbx97"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.663328 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.678784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be6bed2f-f542-4c99-a04e-6648f91f77bd-operator-scripts\") pod \"novacell009b6-account-delete-d2gqm\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.679008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqxb\" (UniqueName: \"kubernetes.io/projected/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-kube-api-access-ppqxb\") pod \"placementd614-account-delete-2n8wr\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.679125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr575\" (UniqueName: \"kubernetes.io/projected/be6bed2f-f542-4c99-a04e-6648f91f77bd-kube-api-access-pr575\") pod \"novacell009b6-account-delete-d2gqm\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.679283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-operator-scripts\") pod \"placementd614-account-delete-2n8wr\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.680117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-operator-scripts\") pod \"placementd614-account-delete-2n8wr\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.702284 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi8be8-account-delete-pbx97"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.710228 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="ovsdbserver-nb" containerID="cri-o://c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424" gracePeriod=300 Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.710968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqxb\" (UniqueName: \"kubernetes.io/projected/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-kube-api-access-ppqxb\") pod \"placementd614-account-delete-2n8wr\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.714888 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cwd5x"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.728451 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cwd5x"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.740153 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.782071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvnbl\" (UniqueName: \"kubernetes.io/projected/e1b96194-f3f1-4529-8d7b-2dc929cc6540-kube-api-access-bvnbl\") pod \"novaapi8be8-account-delete-pbx97\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.782232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1b96194-f3f1-4529-8d7b-2dc929cc6540-operator-scripts\") pod \"novaapi8be8-account-delete-pbx97\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.782457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be6bed2f-f542-4c99-a04e-6648f91f77bd-operator-scripts\") pod \"novacell009b6-account-delete-d2gqm\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.782599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pr575\" (UniqueName: \"kubernetes.io/projected/be6bed2f-f542-4c99-a04e-6648f91f77bd-kube-api-access-pr575\") pod \"novacell009b6-account-delete-d2gqm\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.783006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.784790 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be6bed2f-f542-4c99-a04e-6648f91f77bd-operator-scripts\") pod \"novacell009b6-account-delete-d2gqm\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.802451 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.822797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr575\" (UniqueName: \"kubernetes.io/projected/be6bed2f-f542-4c99-a04e-6648f91f77bd-kube-api-access-pr575\") pod \"novacell009b6-account-delete-d2gqm\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.840888 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.853810 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.876309 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.876896 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.892542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnbl\" (UniqueName: \"kubernetes.io/projected/e1b96194-f3f1-4529-8d7b-2dc929cc6540-kube-api-access-bvnbl\") pod \"novaapi8be8-account-delete-pbx97\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.892601 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1b96194-f3f1-4529-8d7b-2dc929cc6540-operator-scripts\") pod \"novaapi8be8-account-delete-pbx97\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.897207 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1b96194-f3f1-4529-8d7b-2dc929cc6540-operator-scripts\") pod \"novaapi8be8-account-delete-pbx97\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.964481 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-gzzdx"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.971774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnbl\" (UniqueName: \"kubernetes.io/projected/e1b96194-f3f1-4529-8d7b-2dc929cc6540-kube-api-access-bvnbl\") pod \"novaapi8be8-account-delete-pbx97\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.995358 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-gzzdx"] Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.997225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-operator-scripts\") pod \"barbicanbf23-account-delete-tmdnt\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:48 crc kubenswrapper[4769]: I1121 13:03:48.997306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75xdp\" (UniqueName: \"kubernetes.io/projected/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-kube-api-access-75xdp\") pod \"barbicanbf23-account-delete-tmdnt\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.998012 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:03:48 crc kubenswrapper[4769]: E1121 13:03:48.998064 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data podName:320ae09e-4eaf-4abe-a5b2-554d1408238c nodeName:}" failed. No retries permitted until 2025-11-21 13:03:49.998048382 +0000 UTC m=+4388.698710200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data") pod "rabbitmq-server-0" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c") : configmap "rabbitmq-config-data" not found Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.045437 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-xdw85"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.068231 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-xdw85"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.076499 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed6e1205-4575-417d-9b21-529dc83d8657" containerID="8dc7ca31c97aaa0fbc2ec5667cb2256ab26fad754d649fb90c79e49d352028cf" exitCode=2 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.076553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"ed6e1205-4575-417d-9b21-529dc83d8657","Type":"ContainerDied","Data":"8dc7ca31c97aaa0fbc2ec5667cb2256ab26fad754d649fb90c79e49d352028cf"} Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.079683 4769 generic.go:334] "Generic (PLEG): container finished" podID="58a4b306-e429-4353-acae-c0243a0fef30" containerID="9149a77a3fefc62b0bcc4f17a966b585e50ad757b668d6c5c43eff2fae813e6d" exitCode=2 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.079705 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58a4b306-e429-4353-acae-c0243a0fef30","Type":"ContainerDied","Data":"9149a77a3fefc62b0bcc4f17a966b585e50ad757b668d6c5c43eff2fae813e6d"} Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.084131 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.101291 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hcn2b"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.102577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-operator-scripts\") pod \"barbicanbf23-account-delete-tmdnt\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.102660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75xdp\" (UniqueName: \"kubernetes.io/projected/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-kube-api-access-75xdp\") pod \"barbicanbf23-account-delete-tmdnt\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.108219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-operator-scripts\") pod \"barbicanbf23-account-delete-tmdnt\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.132579 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.132924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75xdp\" (UniqueName: \"kubernetes.io/projected/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-kube-api-access-75xdp\") pod \"barbicanbf23-account-delete-tmdnt\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.148713 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-lgrxv"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.148768 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.148948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api-log" containerID="cri-o://48c84c865b545339e66a477d36f73605efc66f27b41aee6990f8a335880ea6a5" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.149346 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" containerID="cri-o://d11f3c2a669302fbe745c8db3072c55f23ffdb9065c07477980577bdfc291096" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.171845 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.192259 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.192479 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="cinder-scheduler" containerID="cri-o://f4648ef48e02b69b5ba0994108b42d604e490454d8293eabe62259bff04bb9dc" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.192771 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="probe" containerID="cri-o://3ff7d8741fbd7c54e8c1592e987b6e5f7442db7d0abd90263abe6b64fc6b67d0" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.253041 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:03:49 crc kubenswrapper[4769]: E1121 13:03:49.417769 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:49 crc kubenswrapper[4769]: E1121 13:03:49.418006 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data podName:9aa39735-6ebc-412a-ae3c-bfb951dc599b nodeName:}" failed. No retries permitted until 2025-11-21 13:03:51.417991921 +0000 UTC m=+4390.118653739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data") pod "rabbitmq-cell1-server-0" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.450933 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41edb57b-8e02-45c7-81ab-cad3d0d85c77" path="/var/lib/kubelet/pods/41edb57b-8e02-45c7-81ab-cad3d0d85c77/volumes" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.451804 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49e7cc24-75ec-4591-97d7-e9af865edc01" path="/var/lib/kubelet/pods/49e7cc24-75ec-4591-97d7-e9af865edc01/volumes" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.452409 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b65b1c4-b942-42e4-b0fd-bcad16c35679" path="/var/lib/kubelet/pods/6b65b1c4-b942-42e4-b0fd-bcad16c35679/volumes" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.462462 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d39f3af-a61c-4977-a2bb-031a88e8919d" path="/var/lib/kubelet/pods/9d39f3af-a61c-4977-a2bb-031a88e8919d/volumes" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.463597 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a904a050-78bd-475e-ba7d-3920dd17667d" path="/var/lib/kubelet/pods/a904a050-78bd-475e-ba7d-3920dd17667d/volumes" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.464214 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced52c5e-301d-4df1-b23a-adf5bcc799d0" path="/var/lib/kubelet/pods/ced52c5e-301d-4df1-b23a-adf5bcc799d0/volumes" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.464973 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-tbndb"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.464997 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-tbndb"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.465013 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder72a2-account-delete-9dc89"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.536069 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.536595 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-server" containerID="cri-o://a6c4f377379bf48e842d63b21ab1e15c9c3f3600ee88effa1c081489c0ab8bce" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537017 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="swift-recon-cron" containerID="cri-o://d34893141bac7e14324235e7119164d8ef9d53ebb6113bfc39439d542249d903" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537064 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="rsync" containerID="cri-o://f1f3a59139be3889aef6f9a4490858cda0b7511988c72fae3bf1dc6a34a4348b" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537094 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-expirer" containerID="cri-o://31d592f452e6dd5bd46a420b62746166664e4fc3c34f70bd4a19053d8d50d5a6" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-updater" containerID="cri-o://9a52877dedfb5d79b8df000b889d7dd6422bebef829bd516f3330ad7b9f3238e" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537155 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-auditor" containerID="cri-o://d1fee3cbfc0a272e339e8452f5cd513ca9d2bd696ec42b72e02227a659be5d10" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537200 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-replicator" containerID="cri-o://047ecb31f533715cada52cbcc20c476844351e8972f43e1c7b9f6fcc82610ee3" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537241 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-server" containerID="cri-o://3027ddbe8ffc6b6ab8af00f2f3f13952c5d706fb3b1c4fbb764ea98e2f0acc4e" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537273 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-updater" containerID="cri-o://18e9cdfaea2562b46fb2532590de989615ad928caf86009809eabc04316d798e" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537304 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-auditor" containerID="cri-o://db8f14bf60e6abcd8f658b1dd66c729d7d27295d4512e63ee31508a2702f6a29" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537334 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-replicator" containerID="cri-o://ad8b93236f1c04b4834204f689352897f5e359f758e41c0f748bf1c686222b23" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537362 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-server" containerID="cri-o://41a602203e83d0e6af60e006c173309fc07c2e6fd0a50b4197767953343be373" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537390 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-reaper" containerID="cri-o://237b1e0dd3912ca9a6e59c9e9f218820ab4bd1fe785b529e25ed9dbf82687350" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537418 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-auditor" containerID="cri-o://deafe43b3d4d64225e6b802c037e2c0eb88c52d4439dfb1cc07a0d5890be7916" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.537448 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-replicator" containerID="cri-o://6f0b78af199089faaf58ebca8cb5f22eb2d60a7a7a77f8784dffda080f9fbf3f" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.592726 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dbmlk"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.622099 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-dbmlk"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.644161 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6b5b775646-kx2zh"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.644458 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-api" containerID="cri-o://6380cc4238b2ebe2414e3e527bb9b9ac858f9b5c2b818d5a059f2686c4427044" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.644576 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" containerID="cri-o://d753aa6fab713fea9f2a6b44ac5416eee7d5a96225297555633984c3d5e91db0" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.660650 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.662962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.694841 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6746c44b58-657qd"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.695721 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-log" containerID="cri-o://b8900e332a6cab927466aed3dc0c84d4a85c129a31cf973f2717f915c544d21e" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.696294 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-api" containerID="cri-o://3dc1702410d782636a419124528d71a4e6d560d05c7c8db5e683d9502531dd1f" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.701482 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.738306 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.739529 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-central-agent" containerID="cri-o://7831c9097a041d65632c254ee1c11941a242c3ed8e10171cb517c82b9d986263" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.739950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="sg-core" containerID="cri-o://8dd0961bbecbb5ebf75b6a14a2d90472208c8a692c422433717604077c287f9e" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.739970 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-notification-agent" containerID="cri-o://39e70cc150e898b13cde320e2a371f6f6678d9d3ae0368c4793dfb8c9ff670aa" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.740028 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="proxy-httpd" containerID="cri-o://cc1f1b68710e629475619e1da7750098b33d32cf27f93ef72ab35193ee1e2adb" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.779119 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.779410 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-log" containerID="cri-o://adc4e088af3f8340facbf46612ba74f63a0c996426c7f0f1136f9ecb61116a20" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.779907 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-httpd" containerID="cri-o://78d0d12329ad5d4ba8fca9096f6dbb32b7737e92d32adee26a00e90783337bab" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.788207 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" probeResult="failure" output="command timed out" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.829104 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.829244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.829265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqfg\" (UniqueName: \"kubernetes.io/projected/d5127b7f-d74b-4bc4-a513-ad82dc118d18-kube-api-access-mmqfg\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.867398 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.867648 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-log" containerID="cri-o://f13a8683802b5d9e611d43e469d02267689a05163b11522dc4abb9f12a1252fc" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.868081 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-httpd" containerID="cri-o://437bbdd83dd6e2debbfe8cbe6849af0f7a425dea5e196acc93e2df3a4c79628a" gracePeriod=30 Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.887863 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.931031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.931345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqfg\" (UniqueName: \"kubernetes.io/projected/d5127b7f-d74b-4bc4-a513-ad82dc118d18-kube-api-access-mmqfg\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.931441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.932063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.932186 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.955092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqfg\" (UniqueName: \"kubernetes.io/projected/d5127b7f-d74b-4bc4-a513-ad82dc118d18-kube-api-access-mmqfg\") pod \"dnsmasq-dnsmasq-84b9f45d47-lbxt5\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:49 crc kubenswrapper[4769]: E1121 13:03:49.959855 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424 is running failed: container process not found" containerID="c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:03:49 crc kubenswrapper[4769]: E1121 13:03:49.964881 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424 is running failed: container process not found" containerID="c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:03:49 crc kubenswrapper[4769]: E1121 13:03:49.965222 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424 is running failed: container process not found" containerID="c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:03:49 crc kubenswrapper[4769]: E1121 13:03:49.965249 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="ovsdbserver-nb" Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.988166 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl"] Nov 21 13:03:49 crc kubenswrapper[4769]: I1121 13:03:49.995582 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="rabbitmq" containerID="cri-o://ebca932f14860b8c8f46de6239a88b5264cda4562a46d7028c3f7f82265b5841" gracePeriod=604800 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.001159 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.001608 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-log" containerID="cri-o://21db3ba2938be2dd85f3abb4ebc4b8eadc339476e57de06bd385cc815422e188" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.001921 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-api" containerID="cri-o://17a0033d45d49e6501b7b9b022c2c8851d6e3871e8e0d99fbb3bfcd7f46dc800" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: E1121 13:03:50.034065 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:03:50 crc kubenswrapper[4769]: E1121 13:03:50.035885 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data podName:320ae09e-4eaf-4abe-a5b2-554d1408238c nodeName:}" failed. No retries permitted until 2025-11-21 13:03:52.03586351 +0000 UTC m=+4390.736525328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data") pod "rabbitmq-server-0" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c") : configmap "rabbitmq-config-data" not found Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.075241 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.075489 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" containerID="cri-o://c84ad1172babe28f337a6ea6bd0cd1d1ca034f9e9a596ffa2ee4bdd1e09fb169" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.075899 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" containerID="cri-o://3ad645cf8690c7e4ae8e0ff281c40e184f73046c19b3fcbb9d042efab077e060" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.102427 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell009b6-account-delete-d2gqm"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.113796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" event={"ID":"08c20fd4-12d3-483c-85e3-b766adb4a666","Type":"ContainerStarted","Data":"05aba310eed75123bc79dd2275154bf77f16c6ac73bb1b94c70c49c75335f197"} Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.115656 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_ed6e1205-4575-417d-9b21-529dc83d8657/ovsdbserver-nb/0.log" Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.115691 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed6e1205-4575-417d-9b21-529dc83d8657" containerID="c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424" exitCode=143 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.115734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"ed6e1205-4575-417d-9b21-529dc83d8657","Type":"ContainerDied","Data":"c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424"} Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.135907 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.144379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placementd614-account-delete-2n8wr"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.149491 4769 generic.go:334] "Generic (PLEG): container finished" podID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerID="590e228d49d05abb2be4d1a84c6f2163c933790fed2e99c43fe83a46e2d9ea93" exitCode=2 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.149559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"af2b42df-4d9d-403f-9aac-87d7005ad082","Type":"ContainerDied","Data":"590e228d49d05abb2be4d1a84c6f2163c933790fed2e99c43fe83a46e2d9ea93"} Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.151956 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance6ada-account-delete-bwjtq"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.159403 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.164885 4769 generic.go:334] "Generic (PLEG): container finished" podID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerID="48c84c865b545339e66a477d36f73605efc66f27b41aee6990f8a335880ea6a5" exitCode=143 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.164936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerDied","Data":"48c84c865b545339e66a477d36f73605efc66f27b41aee6990f8a335880ea6a5"} Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.174845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" event={"ID":"e6443119-0dca-440c-bb46-ab52b91c0ef5","Type":"ContainerStarted","Data":"51a087ebb4f100b7a97eedb553cb517dd47fce69e2caf65465ac66b5d869d679"} Nov 21 13:03:50 crc kubenswrapper[4769]: W1121 13:03:50.181230 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77cf2fdd_2fc0_4db3_b1cc_6962a8de9e83.slice/crio-a7bfc9dbb38faca3e271a52660af81a93db2fa4ed0df99b4917cc92260432ff6 WatchSource:0}: Error finding container a7bfc9dbb38faca3e271a52660af81a93db2fa4ed0df99b4917cc92260432ff6: Status 404 returned error can't find the container with id a7bfc9dbb38faca3e271a52660af81a93db2fa4ed0df99b4917cc92260432ff6 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.364486 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi8be8-account-delete-pbx97"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.394242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.405937 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jqjbl"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.429391 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-e823-account-create-hwn94"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.445070 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jqjbl"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.516520 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.568264 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.644563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.645145 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" containerID="cri-o://ddc90bd377ffdf27f3a7269fc2566ba60fbf855baacb72d57166e52de1a5840f" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.659256 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" containerID="cri-o://668900431d1316c86682af73c5e2c3814c2b0c7d9ccaa62187e8292a784d519a" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.785533 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.786013 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" containerName="kube-state-metrics" containerID="cri-o://70daa102a861275c35f930b6033259033eba08c1da7955b936329103d21f485e" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.824661 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.824909 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="26b2657a-8faa-447c-910f-441ec806eda0" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://4d8a297c93e8b508a0b27f72009d8b1cf1375e71882fa3cf1db35146dcd6e5e7" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.833605 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.139:5671: connect: connection refused" Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.845249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.845489 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker-log" containerID="cri-o://aad63fcc475367f2d5f90522ff68e0393ee97ef209867e40a88c30862be1ea5c" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.845849 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker" containerID="cri-o://ef702362ac97811d88701d056a5bfcc0ee1bcd5907f6131f2f9141e276cda6e1" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.855492 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.855678 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" containerID="cri-o://e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.869571 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.869833 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener-log" containerID="cri-o://15538b8e01b92058053f9e4635ba6d618ed95de58086ae02492ffb2f9b47a188" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.870244 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener" containerID="cri-o://55f82e9c6199c77cf2e0cc7b0e9fea9ed3aedf3da9123595b1632784fb783213" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.878606 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="rabbitmq" containerID="cri-o://c41750e7a7807c4e32b883afabce7adbe8d426799c1398065cfe0183bb5ebe60" gracePeriod=604800 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.902652 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.902946 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" containerID="cri-o://2e822914c896f2a2619b3e222e80f4493bdf9e2c950d034bcd95b9ee1c181e2b" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.903447 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" containerID="cri-o://9e6873d47fd60aeedf468a0fc9f95d327d75e9110dacc0bc539c33daff8e7f0a" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.912969 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.913154 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" containerID="cri-o://f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" gracePeriod=30 Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.928838 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.931465 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-tnrdg"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.958699 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:03:50 crc kubenswrapper[4769]: I1121 13:03:50.960406 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" containerID="cri-o://1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" gracePeriod=30 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.018306 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.020744 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="galera" containerID="cri-o://549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" gracePeriod=30 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.063452 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-jwctf"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.186317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" event={"ID":"be6bed2f-f542-4c99-a04e-6648f91f77bd","Type":"ContainerStarted","Data":"0ce46819b800289617bd3b82f060839b69fbdbd1dd57e7a03b4d6aa730a4877d"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.202131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfbba950-7b66-4271-929f-d81ed58141a6","Type":"ContainerDied","Data":"c84ad1172babe28f337a6ea6bd0cd1d1ca034f9e9a596ffa2ee4bdd1e09fb169"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.204092 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfbba950-7b66-4271-929f-d81ed58141a6" containerID="c84ad1172babe28f337a6ea6bd0cd1d1ca034f9e9a596ffa2ee4bdd1e09fb169" exitCode=143 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.206117 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" event={"ID":"700428ca-7063-46bf-82da-64a8750a80bf","Type":"ContainerStarted","Data":"87386234418f8f135490de56c6cbb9e08fa95ac1ebb8da21ab75c0548ba9960d"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.219429 4769 generic.go:334] "Generic (PLEG): container finished" podID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerID="f13a8683802b5d9e611d43e469d02267689a05163b11522dc4abb9f12a1252fc" exitCode=143 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.219499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b581db1b-0a9b-4010-81d8-5cc9563d71a3","Type":"ContainerDied","Data":"f13a8683802b5d9e611d43e469d02267689a05163b11522dc4abb9f12a1252fc"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.227218 4769 generic.go:334] "Generic (PLEG): container finished" podID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerID="b8900e332a6cab927466aed3dc0c84d4a85c129a31cf973f2717f915c544d21e" exitCode=143 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.227363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" event={"ID":"88f54396-564d-48eb-a4c9-8b56b3a30a86","Type":"ContainerDied","Data":"b8900e332a6cab927466aed3dc0c84d4a85c129a31cf973f2717f915c544d21e"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.231994 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" event={"ID":"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd","Type":"ContainerStarted","Data":"d43e1356564145d0e544a1a973c3021593430c8804fd7ceb9fd5563f77dd1492"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.233862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" event={"ID":"e1b96194-f3f1-4529-8d7b-2dc929cc6540","Type":"ContainerStarted","Data":"eeaa4dfafb059524262e618fb9a9c35b7230e5f6771d708544f0bcd56a129ffa"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.237831 4769 generic.go:334] "Generic (PLEG): container finished" podID="bf1c5df9-318c-49fb-b9c6-f6b182865084" containerID="8ac98b40303c61f8e3f6c0257994b1437a671acb4350dbdf920975c731300ed7" exitCode=137 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.239838 4769 generic.go:334] "Generic (PLEG): container finished" podID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerID="cc1f1b68710e629475619e1da7750098b33d32cf27f93ef72ab35193ee1e2adb" exitCode=0 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.239857 4769 generic.go:334] "Generic (PLEG): container finished" podID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerID="8dd0961bbecbb5ebf75b6a14a2d90472208c8a692c422433717604077c287f9e" exitCode=2 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.239883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerDied","Data":"cc1f1b68710e629475619e1da7750098b33d32cf27f93ef72ab35193ee1e2adb"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.239898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerDied","Data":"8dd0961bbecbb5ebf75b6a14a2d90472208c8a692c422433717604077c287f9e"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.240752 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" event={"ID":"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83","Type":"ContainerStarted","Data":"a7bfc9dbb38faca3e271a52660af81a93db2fa4ed0df99b4917cc92260432ff6"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.242127 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_58a4b306-e429-4353-acae-c0243a0fef30/ovsdbserver-sb/0.log" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.242156 4769 generic.go:334] "Generic (PLEG): container finished" podID="58a4b306-e429-4353-acae-c0243a0fef30" containerID="6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6" exitCode=143 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.242199 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58a4b306-e429-4353-acae-c0243a0fef30","Type":"ContainerDied","Data":"6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.253715 4769 generic.go:334] "Generic (PLEG): container finished" podID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerID="adc4e088af3f8340facbf46612ba74f63a0c996426c7f0f1136f9ecb61116a20" exitCode=143 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.253763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6","Type":"ContainerDied","Data":"adc4e088af3f8340facbf46612ba74f63a0c996426c7f0f1136f9ecb61116a20"} Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.298168 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03376352-fca7-4c04-a7f3-eea86de9c93f" path="/var/lib/kubelet/pods/03376352-fca7-4c04-a7f3-eea86de9c93f/volumes" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.299016 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="664d5c8d-12e4-4894-943e-6b411a9888ea" path="/var/lib/kubelet/pods/664d5c8d-12e4-4894-943e-6b411a9888ea/volumes" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.299882 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df0c335-4ec7-47b4-8d67-c7b1221a8669" path="/var/lib/kubelet/pods/6df0c335-4ec7-47b4-8d67-c7b1221a8669/volumes" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.301633 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98ea61cb-c8c3-454f-adda-9ea32d7a2a93" path="/var/lib/kubelet/pods/98ea61cb-c8c3-454f-adda-9ea32d7a2a93/volumes" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.307434 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b2161b8-5f77-4c61-b867-312c5d81b401" path="/var/lib/kubelet/pods/9b2161b8-5f77-4c61-b867-312c5d81b401/volumes" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.308826 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcee01e0-4947-4f89-8958-ebb9873c87f1" path="/var/lib/kubelet/pods/dcee01e0-4947-4f89-8958-ebb9873c87f1/volumes" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.309616 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.311488 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" containerID="cri-o://5913565eff79975fb6128d5e833d4bf2c848a17163e329a7cc6d6af59f0010dc" gracePeriod=30 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.338141 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.251:9696/\": dial tcp 10.217.0.251:9696: connect: connection refused" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.340251 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dsj6v"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.348574 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dsj6v"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.390230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.469375 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-mnnzq"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.479009 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-mnnzq"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.486744 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29395501-sk5q6"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.491636 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-cron-29395501-sk5q6"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.501479 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.501551 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data podName:9aa39735-6ebc-412a-ae3c-bfb951dc599b nodeName:}" failed. No retries permitted until 2025-11-21 13:03:55.501534178 +0000 UTC m=+4394.202195996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data") pod "rabbitmq-cell1-server-0" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.522247 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.541559 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7898c584c4-qbqkt"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.542364 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" podUID="d5d88bb8-6d29-45d5-a769-94947f8042d5" containerName="keystone-api" containerID="cri-o://2465c158e2d817cb7bc35ffb28fe2d3575288f9f7d533fb03c47e9a127895ff6" gracePeriod=30 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.549109 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-zpmwl"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.554399 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-zpmwl"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.567096 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-325c-account-create-hcf9m"] Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.573169 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-325c-account-create-hcf9m"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.575571 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6 is running failed: container process not found" containerID="6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.576166 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6 is running failed: container process not found" containerID="6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.576571 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6 is running failed: container process not found" containerID="6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.576601 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="ovsdbserver-sb" Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.639136 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.641557 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.648367 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:51 crc kubenswrapper[4769]: E1121 13:03:51.648527 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.698056 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="galera" containerID="cri-o://a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" gracePeriod=30 Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.713041 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" containerName="kube-state-metrics" probeResult="failure" output="Get \"https://10.217.0.173:8081/readyz\": dial tcp 10.217.0.173:8081: connect: connection refused" Nov 21 13:03:51 crc kubenswrapper[4769]: I1121 13:03:51.850940 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.15:3000/\": dial tcp 10.217.1.15:3000: connect: connection refused" Nov 21 13:03:52 crc kubenswrapper[4769]: E1121 13:03:52.111819 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:03:52 crc kubenswrapper[4769]: E1121 13:03:52.111959 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data podName:320ae09e-4eaf-4abe-a5b2-554d1408238c nodeName:}" failed. No retries permitted until 2025-11-21 13:03:56.111922385 +0000 UTC m=+4394.812584273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data") pod "rabbitmq-server-0" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c") : configmap "rabbitmq-config-data" not found Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.243844 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="26b2657a-8faa-447c-910f-441ec806eda0" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.9:6080/vnc_lite.html\": dial tcp 10.217.1.9:6080: connect: connection refused" Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.270620 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerID="9e6873d47fd60aeedf468a0fc9f95d327d75e9110dacc0bc539c33daff8e7f0a" exitCode=143 Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.270694 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerDied","Data":"9e6873d47fd60aeedf468a0fc9f95d327d75e9110dacc0bc539c33daff8e7f0a"} Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.270740 4769 scope.go:117] "RemoveContainer" containerID="f06e86b2623816620c859348769585c2a59493cbb86d9ee499fa62cc4059634f" Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.273384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" event={"ID":"d5127b7f-d74b-4bc4-a513-ad82dc118d18","Type":"ContainerStarted","Data":"baa1d05fa73a1db32dcef145d4e5120b18b7af148b073e411c7117f1fb97fc77"} Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.275058 4769 generic.go:334] "Generic (PLEG): container finished" podID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" containerID="70daa102a861275c35f930b6033259033eba08c1da7955b936329103d21f485e" exitCode=2 Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.275142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"25f25039-7e44-4cc7-ad8c-71b8fcca9754","Type":"ContainerDied","Data":"70daa102a861275c35f930b6033259033eba08c1da7955b936329103d21f485e"} Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.277058 4769 generic.go:334] "Generic (PLEG): container finished" podID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerID="15538b8e01b92058053f9e4635ba6d618ed95de58086ae02492ffb2f9b47a188" exitCode=143 Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.277179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" event={"ID":"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa","Type":"ContainerDied","Data":"15538b8e01b92058053f9e4635ba6d618ed95de58086ae02492ffb2f9b47a188"} Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.282034 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="047ecb31f533715cada52cbcc20c476844351e8972f43e1c7b9f6fcc82610ee3" exitCode=0 Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.282067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"047ecb31f533715cada52cbcc20c476844351e8972f43e1c7b9f6fcc82610ee3"} Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.334349 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": read tcp 10.217.0.2:47506->10.217.1.6:8776: read: connection reset by peer" Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.867667 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.248:8778/\": read tcp 10.217.0.2:44266->10.217.0.248:8778: read: connection reset by peer" Nov 21 13:03:52 crc kubenswrapper[4769]: I1121 13:03:52.867715 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.248:8778/\": read tcp 10.217.0.2:44250->10.217.0.248:8778: read: connection reset by peer" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.019692 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gwz95"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.027486 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-gwz95"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.044243 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder72a2-account-delete-9dc89"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.050937 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-72a2-account-create-mf92j"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.063638 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-72a2-account-create-mf92j"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.102692 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-ffwt6"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.103533 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.247:9292/healthcheck\": read tcp 10.217.0.2:49054->10.217.0.247:9292: read: connection reset by peer" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.103551 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.247:9292/healthcheck\": read tcp 10.217.0.2:49066->10.217.0.247:9292: read: connection reset by peer" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.123480 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-ffwt6"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.130474 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.135293 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.135444 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.141002 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.144724 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-1fd2-account-create-kz9d2"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.149841 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.149916 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.217140 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.286318 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.298439 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:53 crc kubenswrapper[4769]: E1121 13:03:53.298539 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.307066 4769 generic.go:334] "Generic (PLEG): container finished" podID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerID="7831c9097a041d65632c254ee1c11941a242c3ed8e10171cb517c82b9d986263" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.307698 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="336f85cd-816e-42bc-b7cb-28df388e09e0" path="/var/lib/kubelet/pods/336f85cd-816e-42bc-b7cb-28df388e09e0/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.308342 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410a432a-acfa-4408-bff4-31b60d8f6903" path="/var/lib/kubelet/pods/410a432a-acfa-4408-bff4-31b60d8f6903/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.310794 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53fb7874-5587-4186-8a29-038a560144f3" path="/var/lib/kubelet/pods/53fb7874-5587-4186-8a29-038a560144f3/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.311371 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b176fcd-3880-43c5-9870-9d985cdce6c1" path="/var/lib/kubelet/pods/7b176fcd-3880-43c5-9870-9d985cdce6c1/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.312497 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f0df705-b5cf-4e4c-a84c-7cc14831b77f" path="/var/lib/kubelet/pods/7f0df705-b5cf-4e4c-a84c-7cc14831b77f/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.313037 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9a6ec6a-4204-472b-a384-abda04d850e1" path="/var/lib/kubelet/pods/a9a6ec6a-4204-472b-a384-abda04d850e1/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.313625 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc3fa26-faf8-4114-994c-5eb77049a843" path="/var/lib/kubelet/pods/abc3fa26-faf8-4114-994c-5eb77049a843/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317111 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="31d592f452e6dd5bd46a420b62746166664e4fc3c34f70bd4a19053d8d50d5a6" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317225 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="d1fee3cbfc0a272e339e8452f5cd513ca9d2bd696ec42b72e02227a659be5d10" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317287 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="3027ddbe8ffc6b6ab8af00f2f3f13952c5d706fb3b1c4fbb764ea98e2f0acc4e" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317353 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="18e9cdfaea2562b46fb2532590de989615ad928caf86009809eabc04316d798e" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317502 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="ad8b93236f1c04b4834204f689352897f5e359f758e41c0f748bf1c686222b23" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317612 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="237b1e0dd3912ca9a6e59c9e9f218820ab4bd1fe785b529e25ed9dbf82687350" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317673 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="deafe43b3d4d64225e6b802c037e2c0eb88c52d4439dfb1cc07a0d5890be7916" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.317143 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7e7755d-72e1-4e20-a67b-04f8e88feafd" path="/var/lib/kubelet/pods/b7e7755d-72e1-4e20-a67b-04f8e88feafd/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.319132 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25a1e25-5a23-4241-bf27-234419d09917" path="/var/lib/kubelet/pods/e25a1e25-5a23-4241-bf27-234419d09917/volumes" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.320791 4769 generic.go:334] "Generic (PLEG): container finished" podID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerID="21db3ba2938be2dd85f3abb4ebc4b8eadc339476e57de06bd385cc815422e188" exitCode=143 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324123 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kp6nm"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerDied","Data":"7831c9097a041d65632c254ee1c11941a242c3ed8e10171cb517c82b9d986263"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324158 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerID="d753aa6fab713fea9f2a6b44ac5416eee7d5a96225297555633984c3d5e91db0" exitCode=0 Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"31d592f452e6dd5bd46a420b62746166664e4fc3c34f70bd4a19053d8d50d5a6"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"d1fee3cbfc0a272e339e8452f5cd513ca9d2bd696ec42b72e02227a659be5d10"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"3027ddbe8ffc6b6ab8af00f2f3f13952c5d706fb3b1c4fbb764ea98e2f0acc4e"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324315 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-kp6nm"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"18e9cdfaea2562b46fb2532590de989615ad928caf86009809eabc04316d798e"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"ad8b93236f1c04b4834204f689352897f5e359f758e41c0f748bf1c686222b23"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"237b1e0dd3912ca9a6e59c9e9f218820ab4bd1fe785b529e25ed9dbf82687350"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"deafe43b3d4d64225e6b802c037e2c0eb88c52d4439dfb1cc07a0d5890be7916"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3","Type":"ContainerDied","Data":"21db3ba2938be2dd85f3abb4ebc4b8eadc339476e57de06bd385cc815422e188"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.324398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" event={"ID":"1b0b0b34-a9b3-4bff-927f-003d8869e1b5","Type":"ContainerDied","Data":"d753aa6fab713fea9f2a6b44ac5416eee7d5a96225297555633984c3d5e91db0"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.330392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" event={"ID":"e6443119-0dca-440c-bb46-ab52b91c0ef5","Type":"ContainerStarted","Data":"2a4994e7882706e095fb7f6e13493c2b454d9e22bcbc23aa2324636d5a50bf96"} Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.343713 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance6ada-account-delete-bwjtq"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.356373 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-6ada-account-create-k47t9"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.360503 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": read tcp 10.217.0.2:34624->10.217.0.252:8775: read: connection reset by peer" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.360503 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": read tcp 10.217.0.2:34616->10.217.0.252:8775: read: connection reset by peer" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.365029 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-6ada-account-create-k47t9"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.478465 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-nbzc8"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.486895 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_ed6e1205-4575-417d-9b21-529dc83d8657/ovsdbserver-nb/0.log" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.486963 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.488038 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-nbzc8"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.501373 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementd614-account-delete-2n8wr"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.512278 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d614-account-create-pc76c"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.520918 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-d614-account-create-pc76c"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.563974 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-k9rvb"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.570791 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-k9rvb"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.596888 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.615242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell009b6-account-delete-d2gqm"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.623822 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-09b6-account-create-684wr"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.634478 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-mdx5r"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.640499 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-mdx5r"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.646342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi8be8-account-delete-pbx97"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmx9v\" (UniqueName: \"kubernetes.io/projected/ed6e1205-4575-417d-9b21-529dc83d8657-kube-api-access-fmx9v\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-combined-ca-bundle\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-metrics-certs-tls-certs\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-config\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-scripts\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdb-rundir\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.648470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdbserver-nb-tls-certs\") pod \"ed6e1205-4575-417d-9b21-529dc83d8657\" (UID: \"ed6e1205-4575-417d-9b21-529dc83d8657\") " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.649208 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-config" (OuterVolumeSpecName: "config") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.651093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-scripts" (OuterVolumeSpecName: "scripts") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.651347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.653398 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.660277 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-8be8-account-create-6nwxd"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.665936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.671075 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6e1205-4575-417d-9b21-529dc83d8657-kube-api-access-fmx9v" (OuterVolumeSpecName: "kube-api-access-fmx9v") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "kube-api-access-fmx9v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.682026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.736235 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.740060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "ed6e1205-4575-417d-9b21-529dc83d8657" (UID: "ed6e1205-4575-417d-9b21-529dc83d8657"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750382 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fmx9v\" (UniqueName: \"kubernetes.io/projected/ed6e1205-4575-417d-9b21-529dc83d8657-kube-api-access-fmx9v\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750411 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750424 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750438 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750450 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ed6e1205-4575-417d-9b21-529dc83d8657-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750461 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750473 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6e1205-4575-417d-9b21-529dc83d8657-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.750506 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.783301 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.822801 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6cgv7"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.826744 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6cgv7"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.844098 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.849557 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-bf23-account-create-f9d9f"] Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.851409 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:53 crc kubenswrapper[4769]: I1121 13:03:53.855092 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-bf23-account-create-f9d9f"] Nov 21 13:03:54 crc kubenswrapper[4769]: E1121 13:03:54.600335 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:03:54 crc kubenswrapper[4769]: E1121 13:03:54.602500 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:03:54 crc kubenswrapper[4769]: E1121 13:03:54.603891 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:03:54 crc kubenswrapper[4769]: E1121 13:03:54.603970 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873686 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="f1f3a59139be3889aef6f9a4490858cda0b7511988c72fae3bf1dc6a34a4348b" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873723 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="9a52877dedfb5d79b8df000b889d7dd6422bebef829bd516f3330ad7b9f3238e" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873734 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="db8f14bf60e6abcd8f658b1dd66c729d7d27295d4512e63ee31508a2702f6a29" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873743 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="41a602203e83d0e6af60e006c173309fc07c2e6fd0a50b4197767953343be373" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873752 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="6f0b78af199089faaf58ebca8cb5f22eb2d60a7a7a77f8784dffda080f9fbf3f" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873763 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="a6c4f377379bf48e842d63b21ab1e15c9c3f3600ee88effa1c081489c0ab8bce" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"f1f3a59139be3889aef6f9a4490858cda0b7511988c72fae3bf1dc6a34a4348b"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"9a52877dedfb5d79b8df000b889d7dd6422bebef829bd516f3330ad7b9f3238e"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873857 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"db8f14bf60e6abcd8f658b1dd66c729d7d27295d4512e63ee31508a2702f6a29"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"41a602203e83d0e6af60e006c173309fc07c2e6fd0a50b4197767953343be373"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"6f0b78af199089faaf58ebca8cb5f22eb2d60a7a7a77f8784dffda080f9fbf3f"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.873894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"a6c4f377379bf48e842d63b21ab1e15c9c3f3600ee88effa1c081489c0ab8bce"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.876970 4769 generic.go:334] "Generic (PLEG): container finished" podID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerID="d11f3c2a669302fbe745c8db3072c55f23ffdb9065c07477980577bdfc291096" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.877023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerDied","Data":"d11f3c2a669302fbe745c8db3072c55f23ffdb9065c07477980577bdfc291096"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.879784 4769 generic.go:334] "Generic (PLEG): container finished" podID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerID="3ff7d8741fbd7c54e8c1592e987b6e5f7442db7d0abd90263abe6b64fc6b67d0" exitCode=0 Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.879865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"10af4f12-f920-4eef-bc05-b9e10a4bc83e","Type":"ContainerDied","Data":"3ff7d8741fbd7c54e8c1592e987b6e5f7442db7d0abd90263abe6b64fc6b67d0"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.883301 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_ed6e1205-4575-417d-9b21-529dc83d8657/ovsdbserver-nb/0.log" Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.883362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"ed6e1205-4575-417d-9b21-529dc83d8657","Type":"ContainerDied","Data":"4caf1238d934341f8b0f95abf5b0dfb56033e1c8a602e0c171bff7c2a7dc088c"} Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.883457 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.922684 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:03:54 crc kubenswrapper[4769]: I1121 13:03:54.932844 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.227658 4769 scope.go:117] "RemoveContainer" containerID="d7618f7f9f59ae5a8ca5ceefed75a3547af7dcb9231077854eb2bc6ac250dd86" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.284281 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03dd0a0c-1143-4bcc-90f8-c536bc9a093d" path="/var/lib/kubelet/pods/03dd0a0c-1143-4bcc-90f8-c536bc9a093d/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.284997 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1df45abb-28ef-44a7-8aed-e2abc29e4c1b" path="/var/lib/kubelet/pods/1df45abb-28ef-44a7-8aed-e2abc29e4c1b/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.285529 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f24dc8-4e44-4bcb-85dc-d4305b95b314" path="/var/lib/kubelet/pods/21f24dc8-4e44-4bcb-85dc-d4305b95b314/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.286044 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45bcad3a-f59b-4baa-8140-9f0e60d4e6bd" path="/var/lib/kubelet/pods/45bcad3a-f59b-4baa-8140-9f0e60d4e6bd/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.287274 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="765d38de-7be6-4a5f-b8c9-8e89bdaada8e" path="/var/lib/kubelet/pods/765d38de-7be6-4a5f-b8c9-8e89bdaada8e/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.287826 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ee2529-fb13-498b-9926-3eae2785b291" path="/var/lib/kubelet/pods/79ee2529-fb13-498b-9926-3eae2785b291/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.288340 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1" path="/var/lib/kubelet/pods/99bb3ce4-d6d9-4e2f-bb87-f0c2bec529f1/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.289396 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2167ed6-d838-4905-83fb-082532bb6ccd" path="/var/lib/kubelet/pods/a2167ed6-d838-4905-83fb-082532bb6ccd/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.289892 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd9c065-229c-4597-ac3c-53df4caeb6df" path="/var/lib/kubelet/pods/bfd9c065-229c-4597-ac3c-53df4caeb6df/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.290399 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d101a14e-7629-487a-a3de-be159255102f" path="/var/lib/kubelet/pods/d101a14e-7629-487a-a3de-be159255102f/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.291404 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" path="/var/lib/kubelet/pods/ed6e1205-4575-417d-9b21-529dc83d8657/volumes" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.314238 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.14:8080/healthcheck\": dial tcp 10.217.1.14:8080: connect: connection refused" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.314311 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.14:8080/healthcheck\": dial tcp 10.217.1.14:8080: connect: connection refused" Nov 21 13:03:55 crc kubenswrapper[4769]: E1121 13:03:55.584771 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:55 crc kubenswrapper[4769]: E1121 13:03:55.584848 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data podName:9aa39735-6ebc-412a-ae3c-bfb951dc599b nodeName:}" failed. No retries permitted until 2025-11-21 13:04:03.584829807 +0000 UTC m=+4402.285491625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data") pod "rabbitmq-cell1-server-0" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.710972 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.6:8776/healthcheck\": dial tcp 10.217.1.6:8776: connect: connection refused" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.718209 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": dial tcp 10.217.0.249:9311: connect: connection refused" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.718255 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.249:9311/healthcheck\": dial tcp 10.217.0.249:9311: connect: connection refused" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.750788 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.255:11211: connect: connection refused" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.893857 4769 generic.go:334] "Generic (PLEG): container finished" podID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerID="668900431d1316c86682af73c5e2c3814c2b0c7d9ccaa62187e8292a784d519a" exitCode=0 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.893886 4769 generic.go:334] "Generic (PLEG): container finished" podID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerID="ddc90bd377ffdf27f3a7269fc2566ba60fbf855baacb72d57166e52de1a5840f" exitCode=0 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.893918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" event={"ID":"256d7c47-f6a4-48f9-80c6-c1b2ed07af66","Type":"ContainerDied","Data":"668900431d1316c86682af73c5e2c3814c2b0c7d9ccaa62187e8292a784d519a"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.893942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" event={"ID":"256d7c47-f6a4-48f9-80c6-c1b2ed07af66","Type":"ContainerDied","Data":"ddc90bd377ffdf27f3a7269fc2566ba60fbf855baacb72d57166e52de1a5840f"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.895357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" event={"ID":"700428ca-7063-46bf-82da-64a8750a80bf","Type":"ContainerStarted","Data":"9f8b2d98d0e0ee7078a1bdd9cd21ce7958c6903539d695204b11e4b9d6eeb02b"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.896554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"25f25039-7e44-4cc7-ad8c-71b8fcca9754","Type":"ContainerDied","Data":"74b811ad5ffeebe2e1a3c97c0f33b50905755e57c28709670195598fdff5a36c"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.896576 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74b811ad5ffeebe2e1a3c97c0f33b50905755e57c28709670195598fdff5a36c" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.897668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" event={"ID":"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83","Type":"ContainerStarted","Data":"9fa8327e6e8d806bf11d9602d91c3f0d3debe041f9014af31a38940c83990ca8"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.899127 4769 generic.go:334] "Generic (PLEG): container finished" podID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerID="17a0033d45d49e6501b7b9b022c2c8851d6e3871e8e0d99fbb3bfcd7f46dc800" exitCode=0 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.899165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3","Type":"ContainerDied","Data":"17a0033d45d49e6501b7b9b022c2c8851d6e3871e8e0d99fbb3bfcd7f46dc800"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.900337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" event={"ID":"e1b96194-f3f1-4529-8d7b-2dc929cc6540","Type":"ContainerStarted","Data":"067c5582156cb08f723de5f6ec265fd033219ae2219b39489ff86d1aaa13a3cc"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.902013 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_58a4b306-e429-4353-acae-c0243a0fef30/ovsdbserver-sb/0.log" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.902064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"58a4b306-e429-4353-acae-c0243a0fef30","Type":"ContainerDied","Data":"a249528c0cabf3c7b4aef19a146709192bf69b6c1a9312454e3166ed5249dfb3"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.902079 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a249528c0cabf3c7b4aef19a146709192bf69b6c1a9312454e3166ed5249dfb3" Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.903506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" event={"ID":"be6bed2f-f542-4c99-a04e-6648f91f77bd","Type":"ContainerStarted","Data":"173f6eebe5a2b179ae89434575bcd6df314f469ec514f899b6a2fc6d43f54755"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.904712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" event={"ID":"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd","Type":"ContainerStarted","Data":"7b071e24c29473c7329454b36aac2bd7f1188914ac2d17f049380579eb0104bf"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.905831 4769 generic.go:334] "Generic (PLEG): container finished" podID="26b2657a-8faa-447c-910f-441ec806eda0" containerID="4d8a297c93e8b508a0b27f72009d8b1cf1375e71882fa3cf1db35146dcd6e5e7" exitCode=0 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.905882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"26b2657a-8faa-447c-910f-441ec806eda0","Type":"ContainerDied","Data":"4d8a297c93e8b508a0b27f72009d8b1cf1375e71882fa3cf1db35146dcd6e5e7"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.907078 4769 generic.go:334] "Generic (PLEG): container finished" podID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerID="5913565eff79975fb6128d5e833d4bf2c848a17163e329a7cc6d6af59f0010dc" exitCode=0 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.907127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"85ecd4b2-b5ed-4780-993a-2433bae3b108","Type":"ContainerDied","Data":"5913565eff79975fb6128d5e833d4bf2c848a17163e329a7cc6d6af59f0010dc"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.908272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" event={"ID":"d5127b7f-d74b-4bc4-a513-ad82dc118d18","Type":"ContainerStarted","Data":"c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.909375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" event={"ID":"08c20fd4-12d3-483c-85e3-b766adb4a666","Type":"ContainerStarted","Data":"cdeb13eef771eb3318512613edb264c48e95caaa758c6ae51a2a0328bc69f2da"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.910904 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerID="2e822914c896f2a2619b3e222e80f4493bdf9e2c950d034bcd95b9ee1c181e2b" exitCode=0 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.910949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerDied","Data":"2e822914c896f2a2619b3e222e80f4493bdf9e2c950d034bcd95b9ee1c181e2b"} Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.913908 4769 generic.go:334] "Generic (PLEG): container finished" podID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerID="aad63fcc475367f2d5f90522ff68e0393ee97ef209867e40a88c30862be1ea5c" exitCode=143 Nov 21 13:03:55 crc kubenswrapper[4769]: I1121 13:03:55.913953 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" event={"ID":"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee","Type":"ContainerDied","Data":"aad63fcc475367f2d5f90522ff68e0393ee97ef209867e40a88c30862be1ea5c"} Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.103905 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.111579 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_58a4b306-e429-4353-acae-c0243a0fef30/ovsdbserver-sb/0.log" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.111628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.120685 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.177045 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.180155 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.181460 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.181489 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="galera" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.197375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-scripts\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.197424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-ovsdbserver-sb-tls-certs\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.197468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.197559 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-certs\") pod \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-config\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198331 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzth6\" (UniqueName: \"kubernetes.io/projected/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-api-access-xzth6\") pod \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-scripts" (OuterVolumeSpecName: "scripts") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-combined-ca-bundle\") pod \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-combined-ca-bundle\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-metrics-certs-tls-certs\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-config\") pod \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\" (UID: \"25f25039-7e44-4cc7-ad8c-71b8fcca9754\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198548 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58a4b306-e429-4353-acae-c0243a0fef30-ovsdb-rundir\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/58a4b306-e429-4353-acae-c0243a0fef30-kube-api-access-vqb97\") pod \"58a4b306-e429-4353-acae-c0243a0fef30\" (UID: \"58a4b306-e429-4353-acae-c0243a0fef30\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.198882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-config" (OuterVolumeSpecName: "config") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.199336 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.199355 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58a4b306-e429-4353-acae-c0243a0fef30-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.199540 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.199584 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data podName:320ae09e-4eaf-4abe-a5b2-554d1408238c nodeName:}" failed. No retries permitted until 2025-11-21 13:04:04.199570442 +0000 UTC m=+4402.900232260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data") pod "rabbitmq-server-0" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c") : configmap "rabbitmq-config-data" not found Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.199809 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a4b306-e429-4353-acae-c0243a0fef30-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.204421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a4b306-e429-4353-acae-c0243a0fef30-kube-api-access-vqb97" (OuterVolumeSpecName: "kube-api-access-vqb97") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "kube-api-access-vqb97". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.205882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-api-access-xzth6" (OuterVolumeSpecName: "kube-api-access-xzth6") pod "25f25039-7e44-4cc7-ad8c-71b8fcca9754" (UID: "25f25039-7e44-4cc7-ad8c-71b8fcca9754"). InnerVolumeSpecName "kube-api-access-xzth6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.206219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.217179 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.11:8774/\": dial tcp 10.217.1.11:8774: connect: connection refused" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.217320 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.11:8774/\": dial tcp 10.217.1.11:8774: connect: connection refused" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.231352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25f25039-7e44-4cc7-ad8c-71b8fcca9754" (UID: "25f25039-7e44-4cc7-ad8c-71b8fcca9754"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.239009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "25f25039-7e44-4cc7-ad8c-71b8fcca9754" (UID: "25f25039-7e44-4cc7-ad8c-71b8fcca9754"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.251717 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config-secret\") pod \"bf1c5df9-318c-49fb-b9c6-f6b182865084\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config\") pod \"bf1c5df9-318c-49fb-b9c6-f6b182865084\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-combined-ca-bundle\") pod \"bf1c5df9-318c-49fb-b9c6-f6b182865084\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp6x4\" (UniqueName: \"kubernetes.io/projected/bf1c5df9-318c-49fb-b9c6-f6b182865084-kube-api-access-dp6x4\") pod \"bf1c5df9-318c-49fb-b9c6-f6b182865084\" (UID: \"bf1c5df9-318c-49fb-b9c6-f6b182865084\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300940 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300957 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/58a4b306-e429-4353-acae-c0243a0fef30-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300968 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/58a4b306-e429-4353-acae-c0243a0fef30-kube-api-access-vqb97\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300987 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.300997 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xzth6\" (UniqueName: \"kubernetes.io/projected/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-api-access-xzth6\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.301006 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.301015 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.320949 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.378545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.378682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1c5df9-318c-49fb-b9c6-f6b182865084-kube-api-access-dp6x4" (OuterVolumeSpecName: "kube-api-access-dp6x4") pod "bf1c5df9-318c-49fb-b9c6-f6b182865084" (UID: "bf1c5df9-318c-49fb-b9c6-f6b182865084"). InnerVolumeSpecName "kube-api-access-dp6x4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.381966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "bf1c5df9-318c-49fb-b9c6-f6b182865084" (UID: "bf1c5df9-318c-49fb-b9c6-f6b182865084"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.382145 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf1c5df9-318c-49fb-b9c6-f6b182865084" (UID: "bf1c5df9-318c-49fb-b9c6-f6b182865084"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.387466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "58a4b306-e429-4353-acae-c0243a0fef30" (UID: "58a4b306-e429-4353-acae-c0243a0fef30"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.390175 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "25f25039-7e44-4cc7-ad8c-71b8fcca9754" (UID: "25f25039-7e44-4cc7-ad8c-71b8fcca9754"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402358 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f25039-7e44-4cc7-ad8c-71b8fcca9754-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402387 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402397 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402406 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402416 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dp6x4\" (UniqueName: \"kubernetes.io/projected/bf1c5df9-318c-49fb-b9c6-f6b182865084-kube-api-access-dp6x4\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402426 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58a4b306-e429-4353-acae-c0243a0fef30-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.402526 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.411641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "bf1c5df9-318c-49fb-b9c6-f6b182865084" (UID: "bf1c5df9-318c-49fb-b9c6-f6b182865084"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.411644 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.415356 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.418668 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.418769 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="galera" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.504552 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/bf1c5df9-318c-49fb-b9c6-f6b182865084-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.593831 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.619948 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": dial tcp 10.217.0.252:8775: connect: connection refused" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.620048 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": dial tcp 10.217.0.252:8775: connect: connection refused" Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.647631 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.649924 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.657468 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:03:56 crc kubenswrapper[4769]: E1121 13:03:56.657541 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.712841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-internal-tls-certs\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.713402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcjht\" (UniqueName: \"kubernetes.io/projected/2e62f83c-f27a-469a-bc38-0f20b3db209a-kube-api-access-hcjht\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.713495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data-custom\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.713630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.713650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-public-tls-certs\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.713722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e62f83c-f27a-469a-bc38-0f20b3db209a-logs\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.713761 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-combined-ca-bundle\") pod \"2e62f83c-f27a-469a-bc38-0f20b3db209a\" (UID: \"2e62f83c-f27a-469a-bc38-0f20b3db209a\") " Nov 21 13:03:56 crc kubenswrapper[4769]: I1121 13:03:56.723667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e62f83c-f27a-469a-bc38-0f20b3db209a-logs" (OuterVolumeSpecName: "logs") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.753676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.765217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e62f83c-f27a-469a-bc38-0f20b3db209a-kube-api-access-hcjht" (OuterVolumeSpecName: "kube-api-access-hcjht") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "kube-api-access-hcjht". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.775538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.815116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data" (OuterVolumeSpecName: "config-data") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.826036 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.826067 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e62f83c-f27a-469a-bc38-0f20b3db209a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.826075 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.826085 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hcjht\" (UniqueName: \"kubernetes.io/projected/2e62f83c-f27a-469a-bc38-0f20b3db209a-kube-api-access-hcjht\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.826093 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.849724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.849767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2e62f83c-f27a-469a-bc38-0f20b3db209a" (UID: "2e62f83c-f27a-469a-bc38-0f20b3db209a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.927924 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.927944 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e62f83c-f27a-469a-bc38-0f20b3db209a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.932320 4769 generic.go:334] "Generic (PLEG): container finished" podID="e1b96194-f3f1-4529-8d7b-2dc929cc6540" containerID="067c5582156cb08f723de5f6ec265fd033219ae2219b39489ff86d1aaa13a3cc" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.932401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" event={"ID":"e1b96194-f3f1-4529-8d7b-2dc929cc6540","Type":"ContainerDied","Data":"067c5582156cb08f723de5f6ec265fd033219ae2219b39489ff86d1aaa13a3cc"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.934203 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6443119-0dca-440c-bb46-ab52b91c0ef5" containerID="2a4994e7882706e095fb7f6e13493c2b454d9e22bcbc23aa2324636d5a50bf96" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.934237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" event={"ID":"e6443119-0dca-440c-bb46-ab52b91c0ef5","Type":"ContainerDied","Data":"2a4994e7882706e095fb7f6e13493c2b454d9e22bcbc23aa2324636d5a50bf96"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.936086 4769 generic.go:334] "Generic (PLEG): container finished" podID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerID="437bbdd83dd6e2debbfe8cbe6849af0f7a425dea5e196acc93e2df3a4c79628a" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.936118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b581db1b-0a9b-4010-81d8-5cc9563d71a3","Type":"ContainerDied","Data":"437bbdd83dd6e2debbfe8cbe6849af0f7a425dea5e196acc93e2df3a4c79628a"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.939286 4769 generic.go:334] "Generic (PLEG): container finished" podID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.939330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerDied","Data":"1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.945053 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.958279 4769 generic.go:334] "Generic (PLEG): container finished" podID="08c20fd4-12d3-483c-85e3-b766adb4a666" containerID="cdeb13eef771eb3318512613edb264c48e95caaa758c6ae51a2a0328bc69f2da" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.958355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" event={"ID":"08c20fd4-12d3-483c-85e3-b766adb4a666","Type":"ContainerDied","Data":"cdeb13eef771eb3318512613edb264c48e95caaa758c6ae51a2a0328bc69f2da"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.964407 4769 generic.go:334] "Generic (PLEG): container finished" podID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerID="3dc1702410d782636a419124528d71a4e6d560d05c7c8db5e683d9502531dd1f" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.964484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" event={"ID":"88f54396-564d-48eb-a4c9-8b56b3a30a86","Type":"ContainerDied","Data":"3dc1702410d782636a419124528d71a4e6d560d05c7c8db5e683d9502531dd1f"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.970117 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5d88bb8-6d29-45d5-a769-94947f8042d5" containerID="2465c158e2d817cb7bc35ffb28fe2d3575288f9f7d533fb03c47e9a127895ff6" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.972390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" event={"ID":"d5d88bb8-6d29-45d5-a769-94947f8042d5","Type":"ContainerDied","Data":"2465c158e2d817cb7bc35ffb28fe2d3575288f9f7d533fb03c47e9a127895ff6"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.973507 4769 generic.go:334] "Generic (PLEG): container finished" podID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerID="f4648ef48e02b69b5ba0994108b42d604e490454d8293eabe62259bff04bb9dc" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.973565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"10af4f12-f920-4eef-bc05-b9e10a4bc83e","Type":"ContainerDied","Data":"f4648ef48e02b69b5ba0994108b42d604e490454d8293eabe62259bff04bb9dc"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.977201 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfbba950-7b66-4271-929f-d81ed58141a6" containerID="3ad645cf8690c7e4ae8e0ff281c40e184f73046c19b3fcbb9d042efab077e060" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.977267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfbba950-7b66-4271-929f-d81ed58141a6","Type":"ContainerDied","Data":"3ad645cf8690c7e4ae8e0ff281c40e184f73046c19b3fcbb9d042efab077e060"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.978875 4769 generic.go:334] "Generic (PLEG): container finished" podID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerID="78d0d12329ad5d4ba8fca9096f6dbb32b7737e92d32adee26a00e90783337bab" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.978972 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6","Type":"ContainerDied","Data":"78d0d12329ad5d4ba8fca9096f6dbb32b7737e92d32adee26a00e90783337bab"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.980116 4769 generic.go:334] "Generic (PLEG): container finished" podID="06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" containerID="7b071e24c29473c7329454b36aac2bd7f1188914ac2d17f049380579eb0104bf" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.980216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" event={"ID":"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd","Type":"ContainerDied","Data":"7b071e24c29473c7329454b36aac2bd7f1188914ac2d17f049380579eb0104bf"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.984463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" event={"ID":"2e62f83c-f27a-469a-bc38-0f20b3db209a","Type":"ContainerDied","Data":"8d295dfd69794fa90ab3503bfab63b6feebce92b71151d7070ef61b9c67750c7"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.984528 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.986769 4769 generic.go:334] "Generic (PLEG): container finished" podID="be6bed2f-f542-4c99-a04e-6648f91f77bd" containerID="173f6eebe5a2b179ae89434575bcd6df314f469ec514f899b6a2fc6d43f54755" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:56.986841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" event={"ID":"be6bed2f-f542-4c99-a04e-6648f91f77bd","Type":"ContainerDied","Data":"173f6eebe5a2b179ae89434575bcd6df314f469ec514f899b6a2fc6d43f54755"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.023139 4769 generic.go:334] "Generic (PLEG): container finished" podID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerID="39e70cc150e898b13cde320e2a371f6f6678d9d3ae0368c4793dfb8c9ff670aa" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.023248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerDied","Data":"39e70cc150e898b13cde320e2a371f6f6678d9d3ae0368c4793dfb8c9ff670aa"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.031580 4769 generic.go:334] "Generic (PLEG): container finished" podID="77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" containerID="9fa8327e6e8d806bf11d9602d91c3f0d3debe041f9014af31a38940c83990ca8" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.032419 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.032532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" event={"ID":"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83","Type":"ContainerDied","Data":"9fa8327e6e8d806bf11d9602d91c3f0d3debe041f9014af31a38940c83990ca8"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.032597 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.032657 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" podUID="700428ca-7063-46bf-82da-64a8750a80bf" containerName="mariadb-account-delete" containerID="cri-o://9f8b2d98d0e0ee7078a1bdd9cd21ce7958c6903539d695204b11e4b9d6eeb02b" gracePeriod=30 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.090043 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" podStartSLOduration=9.090025501 podStartE2EDuration="9.090025501s" podCreationTimestamp="2025-11-21 13:03:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:03:57.078711017 +0000 UTC m=+4395.779372835" watchObservedRunningTime="2025-11-21 13:03:57.090025501 +0000 UTC m=+4395.790687319" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.296790 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1c5df9-318c-49fb-b9c6-f6b182865084" path="/var/lib/kubelet/pods/bf1c5df9-318c-49fb-b9c6-f6b182865084/volumes" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.696477 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.1:9292/healthcheck\": dial tcp 10.217.1.1:9292: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:57.696504 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.1:9292/healthcheck\": dial tcp 10.217.1.1:9292: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.049656 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_af2b42df-4d9d-403f-9aac-87d7005ad082/ovn-northd/0.log" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.049729 4769 generic.go:334] "Generic (PLEG): container finished" podID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" exitCode=139 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.049849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"af2b42df-4d9d-403f-9aac-87d7005ad082","Type":"ContainerDied","Data":"abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.052615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"26b2657a-8faa-447c-910f-441ec806eda0","Type":"ContainerDied","Data":"a6160733942693776fdda500e1dd2aa3a5cb2bbaad54711a85c454dd5aba0305"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.052676 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6160733942693776fdda500e1dd2aa3a5cb2bbaad54711a85c454dd5aba0305" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.055427 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerID="c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.055463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" event={"ID":"d5127b7f-d74b-4bc4-a513-ad82dc118d18","Type":"ContainerDied","Data":"c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4"} Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.122955 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.123870 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.124863 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.124960 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.207135 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.207618 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.208105 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:58.208147 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.651687 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.661076 4769 scope.go:117] "RemoveContainer" containerID="8dc7ca31c97aaa0fbc2ec5667cb2256ab26fad754d649fb90c79e49d352028cf" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.744889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.758496 4769 scope.go:117] "RemoveContainer" containerID="c270fe201f1851bc0dd25ad1914c794d83854d43667b315379c11b76ae338424" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.772053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-config-data\") pod \"26b2657a-8faa-447c-910f-441ec806eda0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.772149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-nova-novncproxy-tls-certs\") pod \"26b2657a-8faa-447c-910f-441ec806eda0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.772260 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnth5\" (UniqueName: \"kubernetes.io/projected/26b2657a-8faa-447c-910f-441ec806eda0-kube-api-access-fnth5\") pod \"26b2657a-8faa-447c-910f-441ec806eda0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.772326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-vencrypt-tls-certs\") pod \"26b2657a-8faa-447c-910f-441ec806eda0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.772386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-combined-ca-bundle\") pod \"26b2657a-8faa-447c-910f-441ec806eda0\" (UID: \"26b2657a-8faa-447c-910f-441ec806eda0\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.778205 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b2657a-8faa-447c-910f-441ec806eda0-kube-api-access-fnth5" (OuterVolumeSpecName: "kube-api-access-fnth5") pod "26b2657a-8faa-447c-910f-441ec806eda0" (UID: "26b2657a-8faa-447c-910f-441ec806eda0"). InnerVolumeSpecName "kube-api-access-fnth5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.805177 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.813303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-config-data" (OuterVolumeSpecName: "config-data") pod "26b2657a-8faa-447c-910f-441ec806eda0" (UID: "26b2657a-8faa-447c-910f-441ec806eda0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.813792 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7d7bfdf7c8-j5j7f"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.819484 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.822144 4769 scope.go:117] "RemoveContainer" containerID="826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.824150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26b2657a-8faa-447c-910f-441ec806eda0" (UID: "26b2657a-8faa-447c-910f-441ec806eda0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.824384 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.845879 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.853394 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.855488 4769 scope.go:117] "RemoveContainer" containerID="e231d0260df00350646ea032f7ee690eb5d6dcd72025704aead9ce21fc2e0181" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.866641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "26b2657a-8faa-447c-910f-441ec806eda0" (UID: "26b2657a-8faa-447c-910f-441ec806eda0"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.869011 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "26b2657a-8faa-447c-910f-441ec806eda0" (UID: "26b2657a-8faa-447c-910f-441ec806eda0"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874512 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9fj8\" (UniqueName: \"kubernetes.io/projected/db45f877-263f-4e73-bbb6-3ad67a038d51-kube-api-access-j9fj8\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-public-tls-certs\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874706 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-internal-tls-certs\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-scripts\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-combined-ca-bundle\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/db45f877-263f-4e73-bbb6-3ad67a038d51-etc-machine-id\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data-custom\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.874916 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db45f877-263f-4e73-bbb6-3ad67a038d51-logs\") pod \"db45f877-263f-4e73-bbb6-3ad67a038d51\" (UID: \"db45f877-263f-4e73-bbb6-3ad67a038d51\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/db45f877-263f-4e73-bbb6-3ad67a038d51-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875900 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fnth5\" (UniqueName: \"kubernetes.io/projected/26b2657a-8faa-447c-910f-441ec806eda0-kube-api-access-fnth5\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875914 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875924 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/db45f877-263f-4e73-bbb6-3ad67a038d51-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875935 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875942 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.875951 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/26b2657a-8faa-447c-910f-441ec806eda0-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.876277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db45f877-263f-4e73-bbb6-3ad67a038d51-logs" (OuterVolumeSpecName: "logs") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.877979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db45f877-263f-4e73-bbb6-3ad67a038d51-kube-api-access-j9fj8" (OuterVolumeSpecName: "kube-api-access-j9fj8") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "kube-api-access-j9fj8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.879552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-scripts" (OuterVolumeSpecName: "scripts") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.885288 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.903811 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.924985 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.925452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data" (OuterVolumeSpecName: "config-data") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.931974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "db45f877-263f-4e73-bbb6-3ad67a038d51" (UID: "db45f877-263f-4e73-bbb6-3ad67a038d51"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978108 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j9fj8\" (UniqueName: \"kubernetes.io/projected/db45f877-263f-4e73-bbb6-3ad67a038d51-kube-api-access-j9fj8\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978130 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978139 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978166 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978175 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978208 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978223 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/db45f877-263f-4e73-bbb6-3ad67a038d51-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:58.978234 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db45f877-263f-4e73-bbb6-3ad67a038d51-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.071621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"db45f877-263f-4e73-bbb6-3ad67a038d51","Type":"ContainerDied","Data":"e56af2f699b3a697b72150e2c4715731729c124214eb05a3f1f746c6bd77f23c"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.071635 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.077972 4769 generic.go:334] "Generic (PLEG): container finished" podID="700428ca-7063-46bf-82da-64a8750a80bf" containerID="9f8b2d98d0e0ee7078a1bdd9cd21ce7958c6903539d695204b11e4b9d6eeb02b" exitCode=1 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.078023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" event={"ID":"700428ca-7063-46bf-82da-64a8750a80bf","Type":"ContainerDied","Data":"9f8b2d98d0e0ee7078a1bdd9cd21ce7958c6903539d695204b11e4b9d6eeb02b"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.080067 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.128424 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.137102 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.143669 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.148650 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.299136 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" path="/var/lib/kubelet/pods/25f25039-7e44-4cc7-ad8c-71b8fcca9754/volumes" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.300122 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b2657a-8faa-447c-910f-441ec806eda0" path="/var/lib/kubelet/pods/26b2657a-8faa-447c-910f-441ec806eda0/volumes" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.300906 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" path="/var/lib/kubelet/pods/2e62f83c-f27a-469a-bc38-0f20b3db209a/volumes" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.301904 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a4b306-e429-4353-acae-c0243a0fef30" path="/var/lib/kubelet/pods/58a4b306-e429-4353-acae-c0243a0fef30/volumes" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.303413 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" path="/var/lib/kubelet/pods/db45f877-263f-4e73-bbb6-3ad67a038d51/volumes" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.590702 4769 scope.go:117] "RemoveContainer" containerID="8ac98b40303c61f8e3f6c0257994b1437a671acb4350dbdf920975c731300ed7" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:59.599821 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:59.600158 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:59.600420 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:59.600485 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.611337 4769 scope.go:117] "RemoveContainer" containerID="9e6873d47fd60aeedf468a0fc9f95d327d75e9110dacc0bc539c33daff8e7f0a" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.635114 4769 scope.go:117] "RemoveContainer" containerID="2e822914c896f2a2619b3e222e80f4493bdf9e2c950d034bcd95b9ee1c181e2b" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.659100 4769 scope.go:117] "RemoveContainer" containerID="826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:03:59.659473 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f\": container with ID starting with 826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f not found: ID does not exist" containerID="826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.659538 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f"} err="failed to get container status \"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f\": rpc error: code = NotFound desc = could not find container \"826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f\": container with ID starting with 826941c9ddcb6dd94de0794b45005fe5d9b295603352484780616b1f73e0235f not found: ID does not exist" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.659562 4769 scope.go:117] "RemoveContainer" containerID="d11f3c2a669302fbe745c8db3072c55f23ffdb9065c07477980577bdfc291096" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:03:59.678240 4769 scope.go:117] "RemoveContainer" containerID="48c84c865b545339e66a477d36f73605efc66f27b41aee6990f8a335880ea6a5" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.024709 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.137:5671: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.104461 4769 generic.go:334] "Generic (PLEG): container finished" podID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerID="ef702362ac97811d88701d056a5bfcc0ee1bcd5907f6131f2f9141e276cda6e1" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.104516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" event={"ID":"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee","Type":"ContainerDied","Data":"ef702362ac97811d88701d056a5bfcc0ee1bcd5907f6131f2f9141e276cda6e1"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.113288 4769 generic.go:334] "Generic (PLEG): container finished" podID="a58794b2-3db0-4930-84f4-d8757325a776" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.113347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerDied","Data":"f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.113387 4769 scope.go:117] "RemoveContainer" containerID="d9871fa1bdbb74b991bcca645c7f0fe9f532c835ed6b1b6b6c533a83941246ad" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.117183 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" event={"ID":"d5127b7f-d74b-4bc4-a513-ad82dc118d18","Type":"ContainerStarted","Data":"9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.117657 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.122611 4769 generic.go:334] "Generic (PLEG): container finished" podID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerID="55f82e9c6199c77cf2e0cc7b0e9fea9ed3aedf3da9123595b1632784fb783213" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.122678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" event={"ID":"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa","Type":"ContainerDied","Data":"55f82e9c6199c77cf2e0cc7b0e9fea9ed3aedf3da9123595b1632784fb783213"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.124889 4769 generic.go:334] "Generic (PLEG): container finished" podID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.124917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63886233-7dcb-4bfa-acb9-3d7dffb0fb33","Type":"ContainerDied","Data":"e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.157062 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" podStartSLOduration=11.157027802 podStartE2EDuration="11.157027802s" podCreationTimestamp="2025-11-21 13:03:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:04:00.149127379 +0000 UTC m=+4398.849789207" watchObservedRunningTime="2025-11-21 13:04:00.157027802 +0000 UTC m=+4398.857689660" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:00.833695 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.139:5671: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:01.617853 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": dial tcp 10.217.0.252:8775: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:01.617871 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": dial tcp 10.217.0.252:8775: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:01.618001 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:01.618614 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:01.637480 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:01.638098 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:01.638828 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:01.638896 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:02.243794 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="26b2657a-8faa-447c-910f-441ec806eda0" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.9:6080/vnc_lite.html\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.123507 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.124050 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.124413 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.124470 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.206961 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.207673 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.208489 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.208631 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.683843 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:03.683936 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data podName:9aa39735-6ebc-412a-ae3c-bfb951dc599b nodeName:}" failed. No retries permitted until 2025-11-21 13:04:19.683916158 +0000 UTC m=+4418.384577986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data") pod "rabbitmq-cell1-server-0" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:04.184891 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerID="ebca932f14860b8c8f46de6239a88b5264cda4562a46d7028c3f7f82265b5841" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:04.184979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"9aa39735-6ebc-412a-ae3c-bfb951dc599b","Type":"ContainerDied","Data":"ebca932f14860b8c8f46de6239a88b5264cda4562a46d7028c3f7f82265b5841"} Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.266449 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa39735_6ebc_412a_ae3c_bfb951dc599b.slice/crio-conmon-ebca932f14860b8c8f46de6239a88b5264cda4562a46d7028c3f7f82265b5841.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.297093 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.297346 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data podName:320ae09e-4eaf-4abe-a5b2-554d1408238c nodeName:}" failed. No retries permitted until 2025-11-21 13:04:20.297325446 +0000 UTC m=+4418.997987254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data") pod "rabbitmq-server-0" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c") : configmap "rabbitmq-config-data" not found Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.598838 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.599637 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.600378 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:04.600491 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:05.139636 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:05.215153 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km"] Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:05.215482 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" podUID="f901f005-737d-4660-95ab-a115d6a371d4" containerName="dnsmasq-dns" containerID="cri-o://9d09609f8a78c57935de97573ab4cb14d5fbcb75ede9525de9e7ebb04b8d1d6c" gracePeriod=10 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:05.313811 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.14:8080/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:05.314064 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.14:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:05.751183 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.255:11211: i/o timeout" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.178335 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.180557 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.182004 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.182076 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="galera" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:06.232355 4769 generic.go:334] "Generic (PLEG): container finished" podID="f901f005-737d-4660-95ab-a115d6a371d4" containerID="9d09609f8a78c57935de97573ab4cb14d5fbcb75ede9525de9e7ebb04b8d1d6c" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:06.232506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" event={"ID":"f901f005-737d-4660-95ab-a115d6a371d4","Type":"ContainerDied","Data":"9d09609f8a78c57935de97573ab4cb14d5fbcb75ede9525de9e7ebb04b8d1d6c"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:06.235546 4769 generic.go:334] "Generic (PLEG): container finished" podID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerID="c41750e7a7807c4e32b883afabce7adbe8d426799c1398065cfe0183bb5ebe60" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:06.235614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"320ae09e-4eaf-4abe-a5b2-554d1408238c","Type":"ContainerDied","Data":"c41750e7a7807c4e32b883afabce7adbe8d426799c1398065cfe0183bb5ebe60"} Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.404041 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.406770 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.408226 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.408319 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="galera" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:06.617058 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": dial tcp 10.217.0.252:8775: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:06.617208 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.252:8775/\": dial tcp 10.217.0.252:8775: connect: connection refused" Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.638367 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.639164 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.639509 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:07 crc kubenswrapper[4769]: E1121 13:04:06.639643 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.263624 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" exitCode=0 Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.263685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e47277e-4b55-48b1-ac84-e1d6249ecf96","Type":"ContainerDied","Data":"549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80"} Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.533708 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.541217 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.580810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52ngt\" (UniqueName: \"kubernetes.io/projected/85ecd4b2-b5ed-4780-993a-2433bae3b108-kube-api-access-52ngt\") pod \"85ecd4b2-b5ed-4780-993a-2433bae3b108\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.580907 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-config-data\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.580958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-run-httpd\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-etc-swift\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-kolla-config\") pod \"85ecd4b2-b5ed-4780-993a-2433bae3b108\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581219 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-combined-ca-bundle\") pod \"85ecd4b2-b5ed-4780-993a-2433bae3b108\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-config-data\") pod \"85ecd4b2-b5ed-4780-993a-2433bae3b108\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-log-httpd\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-memcached-tls-certs\") pod \"85ecd4b2-b5ed-4780-993a-2433bae3b108\" (UID: \"85ecd4b2-b5ed-4780-993a-2433bae3b108\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581368 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-public-tls-certs\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvfwg\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-kube-api-access-zvfwg\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581451 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-internal-tls-certs\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.581486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-combined-ca-bundle\") pod \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\" (UID: \"256d7c47-f6a4-48f9-80c6-c1b2ed07af66\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.582069 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-config-data" (OuterVolumeSpecName: "config-data") pod "85ecd4b2-b5ed-4780-993a-2433bae3b108" (UID: "85ecd4b2-b5ed-4780-993a-2433bae3b108"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.582402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.582986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.584707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "85ecd4b2-b5ed-4780-993a-2433bae3b108" (UID: "85ecd4b2-b5ed-4780-993a-2433bae3b108"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.602094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-kube-api-access-zvfwg" (OuterVolumeSpecName: "kube-api-access-zvfwg") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "kube-api-access-zvfwg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.602202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ecd4b2-b5ed-4780-993a-2433bae3b108-kube-api-access-52ngt" (OuterVolumeSpecName: "kube-api-access-52ngt") pod "85ecd4b2-b5ed-4780-993a-2433bae3b108" (UID: "85ecd4b2-b5ed-4780-993a-2433bae3b108"). InnerVolumeSpecName "kube-api-access-52ngt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.602184 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.640746 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "85ecd4b2-b5ed-4780-993a-2433bae3b108" (UID: "85ecd4b2-b5ed-4780-993a-2433bae3b108"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.642383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.646298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.662895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "85ecd4b2-b5ed-4780-993a-2433bae3b108" (UID: "85ecd4b2-b5ed-4780-993a-2433bae3b108"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.672349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-config-data" (OuterVolumeSpecName: "config-data") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.675845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "256d7c47-f6a4-48f9-80c6-c1b2ed07af66" (UID: "256d7c47-f6a4-48f9-80c6-c1b2ed07af66"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684125 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684162 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zvfwg\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-kube-api-access-zvfwg\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684206 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684223 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684237 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-52ngt\" (UniqueName: \"kubernetes.io/projected/85ecd4b2-b5ed-4780-993a-2433bae3b108-kube-api-access-52ngt\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684254 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684269 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684285 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684300 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684317 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/85ecd4b2-b5ed-4780-993a-2433bae3b108-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684332 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/85ecd4b2-b5ed-4780-993a-2433bae3b108-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.684342 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/256d7c47-f6a4-48f9-80c6-c1b2ed07af66-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.718811 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.785424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/08c20fd4-12d3-483c-85e3-b766adb4a666-operator-scripts\") pod \"08c20fd4-12d3-483c-85e3-b766adb4a666\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.785699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54nbh\" (UniqueName: \"kubernetes.io/projected/08c20fd4-12d3-483c-85e3-b766adb4a666-kube-api-access-54nbh\") pod \"08c20fd4-12d3-483c-85e3-b766adb4a666\" (UID: \"08c20fd4-12d3-483c-85e3-b766adb4a666\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.787124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08c20fd4-12d3-483c-85e3-b766adb4a666-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "08c20fd4-12d3-483c-85e3-b766adb4a666" (UID: "08c20fd4-12d3-483c-85e3-b766adb4a666"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.792477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c20fd4-12d3-483c-85e3-b766adb4a666-kube-api-access-54nbh" (OuterVolumeSpecName: "kube-api-access-54nbh") pod "08c20fd4-12d3-483c-85e3-b766adb4a666" (UID: "08c20fd4-12d3-483c-85e3-b766adb4a666"). InnerVolumeSpecName "kube-api-access-54nbh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.846275 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.887958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnp4l\" (UniqueName: \"kubernetes.io/projected/10af4f12-f920-4eef-bc05-b9e10a4bc83e-kube-api-access-jnp4l\") pod \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.888266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-scripts\") pod \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.888382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data\") pod \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.888503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data-custom\") pod \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.888620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/10af4f12-f920-4eef-bc05-b9e10a4bc83e-etc-machine-id\") pod \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.888773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-combined-ca-bundle\") pod \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\" (UID: \"10af4f12-f920-4eef-bc05-b9e10a4bc83e\") " Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.888879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/10af4f12-f920-4eef-bc05-b9e10a4bc83e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "10af4f12-f920-4eef-bc05-b9e10a4bc83e" (UID: "10af4f12-f920-4eef-bc05-b9e10a4bc83e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.889742 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-54nbh\" (UniqueName: \"kubernetes.io/projected/08c20fd4-12d3-483c-85e3-b766adb4a666-kube-api-access-54nbh\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.889896 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/10af4f12-f920-4eef-bc05-b9e10a4bc83e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.889988 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/08c20fd4-12d3-483c-85e3-b766adb4a666-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.893938 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "10af4f12-f920-4eef-bc05-b9e10a4bc83e" (UID: "10af4f12-f920-4eef-bc05-b9e10a4bc83e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.893959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-scripts" (OuterVolumeSpecName: "scripts") pod "10af4f12-f920-4eef-bc05-b9e10a4bc83e" (UID: "10af4f12-f920-4eef-bc05-b9e10a4bc83e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:07 crc kubenswrapper[4769]: I1121 13:04:07.901551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10af4f12-f920-4eef-bc05-b9e10a4bc83e-kube-api-access-jnp4l" (OuterVolumeSpecName: "kube-api-access-jnp4l") pod "10af4f12-f920-4eef-bc05-b9e10a4bc83e" (UID: "10af4f12-f920-4eef-bc05-b9e10a4bc83e"). InnerVolumeSpecName "kube-api-access-jnp4l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.002699 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jnp4l\" (UniqueName: \"kubernetes.io/projected/10af4f12-f920-4eef-bc05-b9e10a4bc83e-kube-api-access-jnp4l\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.002744 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.002757 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.051022 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_af2b42df-4d9d-403f-9aac-87d7005ad082/ovn-northd/0.log" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.051102 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.099312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10af4f12-f920-4eef-bc05-b9e10a4bc83e" (UID: "10af4f12-f920-4eef-bc05-b9e10a4bc83e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.104597 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.138628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.147577 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.147700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.152310 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.174031 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.185051 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.187501 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.198260 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205232 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-config\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-metrics-certs-tls-certs\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205429 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-combined-ca-bundle\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205557 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sqt7\" (UniqueName: \"kubernetes.io/projected/af2b42df-4d9d-403f-9aac-87d7005ad082-kube-api-access-4sqt7\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-rundir\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-northd-tls-certs\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.205702 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-scripts\") pod \"af2b42df-4d9d-403f-9aac-87d7005ad082\" (UID: \"af2b42df-4d9d-403f-9aac-87d7005ad082\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.206607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-scripts" (OuterVolumeSpecName: "scripts") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.206936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.207034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-config" (OuterVolumeSpecName: "config") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: E1121 13:04:08.209532 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:08 crc kubenswrapper[4769]: E1121 13:04:08.210229 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.211100 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:04:08 crc kubenswrapper[4769]: E1121 13:04:08.211335 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:04:08 crc kubenswrapper[4769]: E1121 13:04:08.211478 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.212334 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.228498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.231893 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfbba950-7b66-4271-929f-d81ed58141a6-logs\") pod \"cfbba950-7b66-4271-929f-d81ed58141a6\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308615 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-internal-tls-certs\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt9gs\" (UniqueName: \"kubernetes.io/projected/700428ca-7063-46bf-82da-64a8750a80bf-kube-api-access-tt9gs\") pod \"700428ca-7063-46bf-82da-64a8750a80bf\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-combined-ca-bundle\") pod \"cfbba950-7b66-4271-929f-d81ed58141a6\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308842 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-plugins-conf\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data-custom\") pod \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.308981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfr96\" (UniqueName: \"kubernetes.io/projected/e6443119-0dca-440c-bb46-ab52b91c0ef5-kube-api-access-bfr96\") pod \"e6443119-0dca-440c-bb46-ab52b91c0ef5\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-nova-metadata-tls-certs\") pod \"cfbba950-7b66-4271-929f-d81ed58141a6\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-confd\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-logs\") pod \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1b96194-f3f1-4529-8d7b-2dc929cc6540-operator-scripts\") pod \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-server-conf\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-scripts\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjjhv\" (UniqueName: \"kubernetes.io/projected/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-kube-api-access-fjjhv\") pod \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-erlang-cookie\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.309971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvnbl\" (UniqueName: \"kubernetes.io/projected/e1b96194-f3f1-4529-8d7b-2dc929cc6540-kube-api-access-bvnbl\") pod \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\" (UID: \"e1b96194-f3f1-4529-8d7b-2dc929cc6540\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q98hn\" (UniqueName: \"kubernetes.io/projected/cfbba950-7b66-4271-929f-d81ed58141a6-kube-api-access-q98hn\") pod \"cfbba950-7b66-4271-929f-d81ed58141a6\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/320ae09e-4eaf-4abe-a5b2-554d1408238c-erlang-cookie-secret\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-public-tls-certs\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-plugins\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9aa39735-6ebc-412a-ae3c-bfb951dc599b-erlang-cookie-secret\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsq4k\" (UniqueName: \"kubernetes.io/projected/d5d88bb8-6d29-45d5-a769-94947f8042d5-kube-api-access-wsq4k\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-credential-keys\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310802 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-plugins-conf\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310879 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.310955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-server-conf\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-plugins\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-tls\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311165 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-erlang-cookie\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data\") pod \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-combined-ca-bundle\") pod \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\" (UID: \"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-fernet-keys\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311493 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/700428ca-7063-46bf-82da-64a8750a80bf-operator-scripts\") pod \"700428ca-7063-46bf-82da-64a8750a80bf\" (UID: \"700428ca-7063-46bf-82da-64a8750a80bf\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e6443119-0dca-440c-bb46-ab52b91c0ef5-operator-scripts\") pod \"e6443119-0dca-440c-bb46-ab52b91c0ef5\" (UID: \"e6443119-0dca-440c-bb46-ab52b91c0ef5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/320ae09e-4eaf-4abe-a5b2-554d1408238c-pod-info\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-confd\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvb4c\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-kube-api-access-cvb4c\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311914 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"320ae09e-4eaf-4abe-a5b2-554d1408238c\" (UID: \"320ae09e-4eaf-4abe-a5b2-554d1408238c\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.311996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89znh\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-kube-api-access-89znh\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-config-data\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-config-data\") pod \"cfbba950-7b66-4271-929f-d81ed58141a6\" (UID: \"cfbba950-7b66-4271-929f-d81ed58141a6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312235 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9aa39735-6ebc-412a-ae3c-bfb951dc599b-pod-info\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312320 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-combined-ca-bundle\") pod \"d5d88bb8-6d29-45d5-a769-94947f8042d5\" (UID: \"d5d88bb8-6d29-45d5-a769-94947f8042d5\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-tls\") pod \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\" (UID: \"9aa39735-6ebc-412a-ae3c-bfb951dc599b\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312766 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312828 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.312888 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2b42df-4d9d-403f-9aac-87d7005ad082-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.313953 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/700428ca-7063-46bf-82da-64a8750a80bf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "700428ca-7063-46bf-82da-64a8750a80bf" (UID: "700428ca-7063-46bf-82da-64a8750a80bf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.320495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.321129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" event={"ID":"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa","Type":"ContainerDied","Data":"706ac72be3e4b9017fdb526fb2d1dd0112435bedde53132e7e8c2c654664da06"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.321268 4769 scope.go:117] "RemoveContainer" containerID="55f82e9c6199c77cf2e0cc7b0e9fea9ed3aedf3da9123595b1632784fb783213" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.321511 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.321697 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b96194-f3f1-4529-8d7b-2dc929cc6540-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e1b96194-f3f1-4529-8d7b-2dc929cc6540" (UID: "e1b96194-f3f1-4529-8d7b-2dc929cc6540"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.322081 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbba950-7b66-4271-929f-d81ed58141a6-logs" (OuterVolumeSpecName: "logs") pod "cfbba950-7b66-4271-929f-d81ed58141a6" (UID: "cfbba950-7b66-4271-929f-d81ed58141a6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.324762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.325473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.326277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6443119-0dca-440c-bb46-ab52b91c0ef5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e6443119-0dca-440c-bb46-ab52b91c0ef5" (UID: "e6443119-0dca-440c-bb46-ab52b91c0ef5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.326660 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.328885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" event={"ID":"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd","Type":"ContainerDied","Data":"d43e1356564145d0e544a1a973c3021593430c8804fd7ceb9fd5563f77dd1492"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.329011 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.329498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.329722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.330079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-logs" (OuterVolumeSpecName: "logs") pod "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" (UID: "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.338389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" event={"ID":"256d7c47-f6a4-48f9-80c6-c1b2ed07af66","Type":"ContainerDied","Data":"6c3c73d7d98bc7e4d13ea5035d99a32892b2d469257fd72f68f429c4ed69f7a9"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.338552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.349066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" event={"ID":"514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee","Type":"ContainerDied","Data":"335fecc71e6d6e02f1d9ed3dec5729eb94eb025038fc5b8bf58f8c7f02132e87"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.349208 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.351071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"320ae09e-4eaf-4abe-a5b2-554d1408238c","Type":"ContainerDied","Data":"73f9d870dd6e8c93297daf64c08a9ff4c380424eaf671ced2c1a15d0856871ac"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.351138 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.354172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" event={"ID":"e1b96194-f3f1-4529-8d7b-2dc929cc6540","Type":"ContainerDied","Data":"eeaa4dfafb059524262e618fb9a9c35b7230e5f6771d708544f0bcd56a129ffa"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.354283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi8be8-account-delete-pbx97" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.363351 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.363771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"9aa39735-6ebc-412a-ae3c-bfb951dc599b","Type":"ContainerDied","Data":"7722bfe9f18c6156f970ed08a122e7a777d2e8aedfa607337b78dd120b1b6bfe"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.365554 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.365757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7898c584c4-qbqkt" event={"ID":"d5d88bb8-6d29-45d5-a769-94947f8042d5","Type":"ContainerDied","Data":"347c164822cbe4bc0ffb28ec07084e8d17fca56f96717506dcc46a465f29bce5"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.367153 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cfbba950-7b66-4271-929f-d81ed58141a6","Type":"ContainerDied","Data":"67507292ba4b44eab8a04b58d13fdcd53d4c06881dcae66e5e04b65730c2f91a"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.367161 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.368345 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.368355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6","Type":"ContainerDied","Data":"a072a434dfc39e5ce32ab5b3677f4216904fc8dea195721f0d1adfc91d5a2972"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.373275 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_af2b42df-4d9d-403f-9aac-87d7005ad082/ovn-northd/0.log" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.373346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"af2b42df-4d9d-403f-9aac-87d7005ad082","Type":"ContainerDied","Data":"95c53942f7f6aad9fecdd36ef7e073cf9fc1c692b6f4390fee72928580ecebfc"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.373400 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.380721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"85ecd4b2-b5ed-4780-993a-2433bae3b108","Type":"ContainerDied","Data":"3ed227092f9c16f36851393f66523eb1328c41b6f8f8942ec0f76d4a4dfef547"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.380840 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.388746 4769 generic.go:334] "Generic (PLEG): container finished" podID="71adc54e-068a-472d-8d1e-99360bc87d82" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" exitCode=0 Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.388899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"71adc54e-068a-472d-8d1e-99360bc87d82","Type":"ContainerDied","Data":"a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.393300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" event={"ID":"e6443119-0dca-440c-bb46-ab52b91c0ef5","Type":"ContainerDied","Data":"51a087ebb4f100b7a97eedb553cb517dd47fce69e2caf65465ac66b5d869d679"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.393322 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder72a2-account-delete-9dc89" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.395866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3","Type":"ContainerDied","Data":"9603d9e2a481c063dcd1b5ca6a29af1f6440f38fff69ab6f1275b54d00a54c7b"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.395950 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.398380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"10af4f12-f920-4eef-bc05-b9e10a4bc83e","Type":"ContainerDied","Data":"c9e3841ee1c9728836869cdb9bde2c413ed658c353f97d7dc39be30355769c9a"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.398459 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.400824 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.400826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl" event={"ID":"08c20fd4-12d3-483c-85e3-b766adb4a666","Type":"ContainerDied","Data":"05aba310eed75123bc79dd2275154bf77f16c6ac73bb1b94c70c49c75335f197"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.411812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" event={"ID":"700428ca-7063-46bf-82da-64a8750a80bf","Type":"ContainerDied","Data":"87386234418f8f135490de56c6cbb9e08fa95ac1ebb8da21ab75c0548ba9960d"} Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.411883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance6ada-account-delete-bwjtq" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-public-tls-certs\") pod \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-combined-ca-bundle\") pod \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-internal-tls-certs\") pod \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75xdp\" (UniqueName: \"kubernetes.io/projected/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-kube-api-access-75xdp\") pod \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413779 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntdjk\" (UniqueName: \"kubernetes.io/projected/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-kube-api-access-ntdjk\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-internal-tls-certs\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-config-data\") pod \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-operator-scripts\") pod \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\" (UID: \"06c8a0b8-3e88-432a-a18a-0d3f5afa05fd\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-combined-ca-bundle\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.413997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fr7p\" (UniqueName: \"kubernetes.io/projected/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-kube-api-access-4fr7p\") pod \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-httpd-run\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data\") pod \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-config-data\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-logs\") pod \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data-custom\") pod \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414197 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-logs\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414243 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-combined-ca-bundle\") pod \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-scripts\") pod \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\" (UID: \"50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414331 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64ms9\" (UniqueName: \"kubernetes.io/projected/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-kube-api-access-64ms9\") pod \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\" (UID: \"321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414405 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-logs\") pod \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\" (UID: \"3edbd8bc-deec-47cb-a33d-afda2f3fc1fa\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414712 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414731 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414743 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414753 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414763 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414772 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/700428ca-7063-46bf-82da-64a8750a80bf-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414781 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e6443119-0dca-440c-bb46-ab52b91c0ef5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414790 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cfbba950-7b66-4271-929f-d81ed58141a6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414798 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414807 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.414816 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e1b96194-f3f1-4529-8d7b-2dc929cc6540-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.417536 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" (UID: "06c8a0b8-3e88-432a-a18a-0d3f5afa05fd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.418091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-logs" (OuterVolumeSpecName: "logs") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.418595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.418861 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.419372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-logs" (OuterVolumeSpecName: "logs") pod "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" (UID: "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.419696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-logs" (OuterVolumeSpecName: "logs") pod "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" (UID: "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.429830 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.442240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.450264 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.455874 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.464806 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron1fd2-account-delete-f8ncl"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.482928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2b42df-4d9d-403f-9aac-87d7005ad082-kube-api-access-4sqt7" (OuterVolumeSpecName: "kube-api-access-4sqt7") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "kube-api-access-4sqt7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.483952 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.483956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9aa39735-6ebc-412a-ae3c-bfb951dc599b-pod-info" (OuterVolumeSpecName: "pod-info") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.484026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b96194-f3f1-4529-8d7b-2dc929cc6540-kube-api-access-bvnbl" (OuterVolumeSpecName: "kube-api-access-bvnbl") pod "e1b96194-f3f1-4529-8d7b-2dc929cc6540" (UID: "e1b96194-f3f1-4529-8d7b-2dc929cc6540"). InnerVolumeSpecName "kube-api-access-bvnbl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.484066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d88bb8-6d29-45d5-a769-94947f8042d5-kube-api-access-wsq4k" (OuterVolumeSpecName: "kube-api-access-wsq4k") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "kube-api-access-wsq4k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.484502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/320ae09e-4eaf-4abe-a5b2-554d1408238c-pod-info" (OuterVolumeSpecName: "pod-info") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.484687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "persistence") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.484781 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.485497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-kube-api-access-89znh" (OuterVolumeSpecName: "kube-api-access-89znh") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "kube-api-access-89znh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.486110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.486130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.486613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfbba950-7b66-4271-929f-d81ed58141a6-kube-api-access-q98hn" (OuterVolumeSpecName: "kube-api-access-q98hn") pod "cfbba950-7b66-4271-929f-d81ed58141a6" (UID: "cfbba950-7b66-4271-929f-d81ed58141a6"). InnerVolumeSpecName "kube-api-access-q98hn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.486930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6443119-0dca-440c-bb46-ab52b91c0ef5-kube-api-access-bfr96" (OuterVolumeSpecName: "kube-api-access-bfr96") pod "e6443119-0dca-440c-bb46-ab52b91c0ef5" (UID: "e6443119-0dca-440c-bb46-ab52b91c0ef5"). InnerVolumeSpecName "kube-api-access-bfr96". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.487565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/700428ca-7063-46bf-82da-64a8750a80bf-kube-api-access-tt9gs" (OuterVolumeSpecName: "kube-api-access-tt9gs") pod "700428ca-7063-46bf-82da-64a8750a80bf" (UID: "700428ca-7063-46bf-82da-64a8750a80bf"). InnerVolumeSpecName "kube-api-access-tt9gs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.487641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-kube-api-access-cvb4c" (OuterVolumeSpecName: "kube-api-access-cvb4c") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "kube-api-access-cvb4c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.487659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" (UID: "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.487697 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-scripts" (OuterVolumeSpecName: "scripts") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.488802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "persistence") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.488858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/320ae09e-4eaf-4abe-a5b2-554d1408238c-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.489579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-kube-api-access-fjjhv" (OuterVolumeSpecName: "kube-api-access-fjjhv") pod "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" (UID: "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee"). InnerVolumeSpecName "kube-api-access-fjjhv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.489974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" (UID: "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.490654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-kube-api-access-75xdp" (OuterVolumeSpecName: "kube-api-access-75xdp") pod "06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" (UID: "06c8a0b8-3e88-432a-a18a-0d3f5afa05fd"). InnerVolumeSpecName "kube-api-access-75xdp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.491244 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "glance") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.492615 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-kube-api-access-4fr7p" (OuterVolumeSpecName: "kube-api-access-4fr7p") pod "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" (UID: "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa"). InnerVolumeSpecName "kube-api-access-4fr7p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.493226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-kube-api-access-64ms9" (OuterVolumeSpecName: "kube-api-access-64ms9") pod "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" (UID: "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3"). InnerVolumeSpecName "kube-api-access-64ms9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.493272 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-scripts" (OuterVolumeSpecName: "scripts") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.494630 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-kube-api-access-ntdjk" (OuterVolumeSpecName: "kube-api-access-ntdjk") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "kube-api-access-ntdjk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.494897 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aa39735-6ebc-412a-ae3c-bfb951dc599b-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.500410 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.511078 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522330 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522357 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522367 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522379 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fjjhv\" (UniqueName: \"kubernetes.io/projected/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-kube-api-access-fjjhv\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522388 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bvnbl\" (UniqueName: \"kubernetes.io/projected/e1b96194-f3f1-4529-8d7b-2dc929cc6540-kube-api-access-bvnbl\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522396 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q98hn\" (UniqueName: \"kubernetes.io/projected/cfbba950-7b66-4271-929f-d81ed58141a6-kube-api-access-q98hn\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522405 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/320ae09e-4eaf-4abe-a5b2-554d1408238c-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522427 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522438 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522447 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/9aa39735-6ebc-412a-ae3c-bfb951dc599b-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522456 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wsq4k\" (UniqueName: \"kubernetes.io/projected/d5d88bb8-6d29-45d5-a769-94947f8042d5-kube-api-access-wsq4k\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522464 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522472 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522481 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522490 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-64ms9\" (UniqueName: \"kubernetes.io/projected/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-kube-api-access-64ms9\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522499 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522511 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522521 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522530 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/320ae09e-4eaf-4abe-a5b2-554d1408238c-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522539 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cvb4c\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-kube-api-access-cvb4c\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522552 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522560 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4sqt7\" (UniqueName: \"kubernetes.io/projected/af2b42df-4d9d-403f-9aac-87d7005ad082-kube-api-access-4sqt7\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522570 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-89znh\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-kube-api-access-89znh\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522579 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75xdp\" (UniqueName: \"kubernetes.io/projected/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-kube-api-access-75xdp\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522588 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/9aa39735-6ebc-412a-ae3c-bfb951dc599b-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522596 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ntdjk\" (UniqueName: \"kubernetes.io/projected/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-kube-api-access-ntdjk\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522604 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522613 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tt9gs\" (UniqueName: \"kubernetes.io/projected/700428ca-7063-46bf-82da-64a8750a80bf-kube-api-access-tt9gs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522622 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bfr96\" (UniqueName: \"kubernetes.io/projected/e6443119-0dca-440c-bb46-ab52b91c0ef5-kube-api-access-bfr96\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522631 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522640 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522649 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4fr7p\" (UniqueName: \"kubernetes.io/projected/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-kube-api-access-4fr7p\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.522657 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.528616 4769 scope.go:117] "RemoveContainer" containerID="15538b8e01b92058053f9e4635ba6d618ed95de58086ae02492ffb2f9b47a188" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.535318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.541150 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.561766 4769 scope.go:117] "RemoveContainer" containerID="7b071e24c29473c7329454b36aac2bd7f1188914ac2d17f049380579eb0104bf" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.561944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.577147 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.599492 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.602945 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.603127 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.604927 4769 scope.go:117] "RemoveContainer" containerID="668900431d1316c86682af73c5e2c3814c2b0c7d9ccaa62187e8292a784d519a" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.615255 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.617308 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.623871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5hjv\" (UniqueName: \"kubernetes.io/projected/a58794b2-3db0-4930-84f4-d8757325a776-kube-api-access-l5hjv\") pod \"a58794b2-3db0-4930-84f4-d8757325a776\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.623992 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-combined-ca-bundle\") pod \"a58794b2-3db0-4930-84f4-d8757325a776\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.624136 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-config-data\") pod \"a58794b2-3db0-4930-84f4-d8757325a776\" (UID: \"a58794b2-3db0-4930-84f4-d8757325a776\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.624221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-operator-scripts\") pod \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.624259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppqxb\" (UniqueName: \"kubernetes.io/projected/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-kube-api-access-ppqxb\") pod \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\" (UID: \"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.624518 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.624534 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.627641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" (UID: "77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.635308 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" (UID: "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.635738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.643412 4769 scope.go:117] "RemoveContainer" containerID="ddc90bd377ffdf27f3a7269fc2566ba60fbf855baacb72d57166e52de1a5840f" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.652815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a58794b2-3db0-4930-84f4-d8757325a776-kube-api-access-l5hjv" (OuterVolumeSpecName: "kube-api-access-l5hjv") pod "a58794b2-3db0-4930-84f4-d8757325a776" (UID: "a58794b2-3db0-4930-84f4-d8757325a776"). InnerVolumeSpecName "kube-api-access-l5hjv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.654332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-kube-api-access-ppqxb" (OuterVolumeSpecName: "kube-api-access-ppqxb") pod "77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" (UID: "77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83"). InnerVolumeSpecName "kube-api-access-ppqxb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.654542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cfbba950-7b66-4271-929f-d81ed58141a6" (UID: "cfbba950-7b66-4271-929f-d81ed58141a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.684760 4769 scope.go:117] "RemoveContainer" containerID="ef702362ac97811d88701d056a5bfcc0ee1bcd5907f6131f2f9141e276cda6e1" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.700245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-config-data" (OuterVolumeSpecName: "config-data") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.718747 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.720425 4769 scope.go:117] "RemoveContainer" containerID="aad63fcc475367f2d5f90522ff68e0393ee97ef209867e40a88c30862be1ea5c" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dnsmasq-svc\") pod \"f901f005-737d-4660-95ab-a115d6a371d4\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-combined-ca-bundle\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726212 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr575\" (UniqueName: \"kubernetes.io/projected/be6bed2f-f542-4c99-a04e-6648f91f77bd-kube-api-access-pr575\") pod \"be6bed2f-f542-4c99-a04e-6648f91f77bd\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-config-data\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-run-httpd\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88f54396-564d-48eb-a4c9-8b56b3a30a86-logs\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dns-swift-storage-0\") pod \"f901f005-737d-4660-95ab-a115d6a371d4\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-log-httpd\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be6bed2f-f542-4c99-a04e-6648f91f77bd-operator-scripts\") pod \"be6bed2f-f542-4c99-a04e-6648f91f77bd\" (UID: \"be6bed2f-f542-4c99-a04e-6648f91f77bd\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-combined-ca-bundle\") pod \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-combined-ca-bundle\") pod \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-config-data\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk6pn\" (UniqueName: \"kubernetes.io/projected/b581db1b-0a9b-4010-81d8-5cc9563d71a3-kube-api-access-rk6pn\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-config\") pod \"f901f005-737d-4660-95ab-a115d6a371d4\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-config-data\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-httpd-run\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-config-data\") pod \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9w48\" (UniqueName: \"kubernetes.io/projected/f901f005-737d-4660-95ab-a115d6a371d4-kube-api-access-w9w48\") pod \"f901f005-737d-4660-95ab-a115d6a371d4\" (UID: \"f901f005-737d-4660-95ab-a115d6a371d4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qdvp\" (UniqueName: \"kubernetes.io/projected/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-kube-api-access-5qdvp\") pod \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-scripts\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726742 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-ceilometer-tls-certs\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-internal-tls-certs\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-combined-ca-bundle\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726800 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-public-tls-certs\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-logs\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-scripts\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-scripts\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgc9q\" (UniqueName: \"kubernetes.io/projected/2fd709dc-5ec6-4bdd-b227-47e7208301f4-kube-api-access-zgc9q\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.726996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-config-data\") pod \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\" (UID: \"63886233-7dcb-4bfa-acb9-3d7dffb0fb33\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9m56\" (UniqueName: \"kubernetes.io/projected/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-kube-api-access-v9m56\") pod \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\" (UID: \"5415ebc2-eb7c-4b71-bd45-97674d0fe30d\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-combined-ca-bundle\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c2mz\" (UniqueName: \"kubernetes.io/projected/88f54396-564d-48eb-a4c9-8b56b3a30a86-kube-api-access-9c2mz\") pod \"88f54396-564d-48eb-a4c9-8b56b3a30a86\" (UID: \"88f54396-564d-48eb-a4c9-8b56b3a30a86\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727089 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-sg-core-conf-yaml\") pod \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\" (UID: \"2fd709dc-5ec6-4bdd-b227-47e7208301f4\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-public-tls-certs\") pod \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\" (UID: \"b581db1b-0a9b-4010-81d8-5cc9563d71a3\") " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727379 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727391 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727400 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727410 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727420 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727430 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ppqxb\" (UniqueName: \"kubernetes.io/projected/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83-kube-api-access-ppqxb\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727439 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l5hjv\" (UniqueName: \"kubernetes.io/projected/a58794b2-3db0-4930-84f4-d8757325a776-kube-api-access-l5hjv\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.727449 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.733802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-logs" (OuterVolumeSpecName: "logs") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.740978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-server-conf" (OuterVolumeSpecName: "server-conf") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.741387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.742877 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be6bed2f-f542-4c99-a04e-6648f91f77bd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "be6bed2f-f542-4c99-a04e-6648f91f77bd" (UID: "be6bed2f-f542-4c99-a04e-6648f91f77bd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.746888 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f54396-564d-48eb-a4c9-8b56b3a30a86-logs" (OuterVolumeSpecName: "logs") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.752883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.756438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.769470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "glance") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.771582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.781171 4769 scope.go:117] "RemoveContainer" containerID="c41750e7a7807c4e32b883afabce7adbe8d426799c1398065cfe0183bb5ebe60" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.784244 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi8be8-account-delete-pbx97"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.785439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data" (OuterVolumeSpecName: "config-data") pod "10af4f12-f920-4eef-bc05-b9e10a4bc83e" (UID: "10af4f12-f920-4eef-bc05-b9e10a4bc83e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.785860 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-kube-api-access-v9m56" (OuterVolumeSpecName: "kube-api-access-v9m56") pod "5415ebc2-eb7c-4b71-bd45-97674d0fe30d" (UID: "5415ebc2-eb7c-4b71-bd45-97674d0fe30d"). InnerVolumeSpecName "kube-api-access-v9m56". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.790761 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi8be8-account-delete-pbx97"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.792826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f901f005-737d-4660-95ab-a115d6a371d4-kube-api-access-w9w48" (OuterVolumeSpecName: "kube-api-access-w9w48") pod "f901f005-737d-4660-95ab-a115d6a371d4" (UID: "f901f005-737d-4660-95ab-a115d6a371d4"). InnerVolumeSpecName "kube-api-access-w9w48". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.792898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd709dc-5ec6-4bdd-b227-47e7208301f4-kube-api-access-zgc9q" (OuterVolumeSpecName: "kube-api-access-zgc9q") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "kube-api-access-zgc9q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.794146 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f54396-564d-48eb-a4c9-8b56b3a30a86-kube-api-access-9c2mz" (OuterVolumeSpecName: "kube-api-access-9c2mz") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "kube-api-access-9c2mz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.794893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6bed2f-f542-4c99-a04e-6648f91f77bd-kube-api-access-pr575" (OuterVolumeSpecName: "kube-api-access-pr575") pod "be6bed2f-f542-4c99-a04e-6648f91f77bd" (UID: "be6bed2f-f542-4c99-a04e-6648f91f77bd"). InnerVolumeSpecName "kube-api-access-pr575". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.795318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-scripts" (OuterVolumeSpecName: "scripts") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.795695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-kube-api-access-5qdvp" (OuterVolumeSpecName: "kube-api-access-5qdvp") pod "63886233-7dcb-4bfa-acb9-3d7dffb0fb33" (UID: "63886233-7dcb-4bfa-acb9-3d7dffb0fb33"). InnerVolumeSpecName "kube-api-access-5qdvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.795919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-scripts" (OuterVolumeSpecName: "scripts") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.804364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-scripts" (OuterVolumeSpecName: "scripts") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.804500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b581db1b-0a9b-4010-81d8-5cc9563d71a3-kube-api-access-rk6pn" (OuterVolumeSpecName: "kube-api-access-rk6pn") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "kube-api-access-rk6pn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.816583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" (UID: "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.820237 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833421 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833475 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833486 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w9w48\" (UniqueName: \"kubernetes.io/projected/f901f005-737d-4660-95ab-a115d6a371d4-kube-api-access-w9w48\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833497 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/10af4f12-f920-4eef-bc05-b9e10a4bc83e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833506 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5qdvp\" (UniqueName: \"kubernetes.io/projected/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-kube-api-access-5qdvp\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833514 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833522 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b581db1b-0a9b-4010-81d8-5cc9563d71a3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833530 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833538 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833546 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833555 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833564 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zgc9q\" (UniqueName: \"kubernetes.io/projected/2fd709dc-5ec6-4bdd-b227-47e7208301f4-kube-api-access-zgc9q\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833574 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v9m56\" (UniqueName: \"kubernetes.io/projected/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-kube-api-access-v9m56\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833584 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9c2mz\" (UniqueName: \"kubernetes.io/projected/88f54396-564d-48eb-a4c9-8b56b3a30a86-kube-api-access-9c2mz\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833595 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pr575\" (UniqueName: \"kubernetes.io/projected/be6bed2f-f542-4c99-a04e-6648f91f77bd-kube-api-access-pr575\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833606 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833615 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/88f54396-564d-48eb-a4c9-8b56b3a30a86-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833624 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2fd709dc-5ec6-4bdd-b227-47e7208301f4-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833634 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be6bed2f-f542-4c99-a04e-6648f91f77bd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833644 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.833652 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rk6pn\" (UniqueName: \"kubernetes.io/projected/b581db1b-0a9b-4010-81d8-5cc9563d71a3-kube-api-access-rk6pn\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.848520 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbicanbf23-account-delete-tmdnt"] Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.849005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-config-data" (OuterVolumeSpecName: "config-data") pod "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" (UID: "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.868444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-config-data" (OuterVolumeSpecName: "config-data") pod "cfbba950-7b66-4271-929f-d81ed58141a6" (UID: "cfbba950-7b66-4271-929f-d81ed58141a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.872555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.878913 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data" (OuterVolumeSpecName: "config-data") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.893441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-config-data" (OuterVolumeSpecName: "config-data") pod "a58794b2-3db0-4930-84f4-d8757325a776" (UID: "a58794b2-3db0-4930-84f4-d8757325a776"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.895735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a58794b2-3db0-4930-84f4-d8757325a776" (UID: "a58794b2-3db0-4930-84f4-d8757325a776"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.897498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data" (OuterVolumeSpecName: "config-data") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.915661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-config-data" (OuterVolumeSpecName: "config-data") pod "5415ebc2-eb7c-4b71-bd45-97674d0fe30d" (UID: "5415ebc2-eb7c-4b71-bd45-97674d0fe30d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.924794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935337 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935369 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935383 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935395 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935407 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/320ae09e-4eaf-4abe-a5b2-554d1408238c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935417 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935427 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935438 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.935448 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a58794b2-3db0-4930-84f4-d8757325a776-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:08 crc kubenswrapper[4769]: I1121 13:04:08.946370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" (UID: "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.034492 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.039141 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.039307 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.080541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.089575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-config-data" (OuterVolumeSpecName: "config-data") pod "63886233-7dcb-4bfa-acb9-3d7dffb0fb33" (UID: "63886233-7dcb-4bfa-acb9-3d7dffb0fb33"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.090919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5415ebc2-eb7c-4b71-bd45-97674d0fe30d" (UID: "5415ebc2-eb7c-4b71-bd45-97674d0fe30d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.093483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.093567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "cfbba950-7b66-4271-929f-d81ed58141a6" (UID: "cfbba950-7b66-4271-929f-d81ed58141a6"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.094029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d5d88bb8-6d29-45d5-a769-94947f8042d5" (UID: "d5d88bb8-6d29-45d5-a769-94947f8042d5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.094715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "63886233-7dcb-4bfa-acb9-3d7dffb0fb33" (UID: "63886233-7dcb-4bfa-acb9-3d7dffb0fb33"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.096633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-server-conf" (OuterVolumeSpecName: "server-conf") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.103808 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" (UID: "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.104729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data" (OuterVolumeSpecName: "config-data") pod "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" (UID: "3edbd8bc-deec-47cb-a33d-afda2f3fc1fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.118256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "af2b42df-4d9d-403f-9aac-87d7005ad082" (UID: "af2b42df-4d9d-403f-9aac-87d7005ad082"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.118946 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data" (OuterVolumeSpecName: "config-data") pod "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" (UID: "514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.121518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.125993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.132927 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" (UID: "321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.133164 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "f901f005-737d-4660-95ab-a115d6a371d4" (UID: "f901f005-737d-4660-95ab-a115d6a371d4"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141347 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141364 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141376 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5415ebc2-eb7c-4b71-bd45-97674d0fe30d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141389 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141401 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141414 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141425 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbba950-7b66-4271-929f-d81ed58141a6-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141438 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141449 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141460 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/9aa39735-6ebc-412a-ae3c-bfb951dc599b-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141471 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d88bb8-6d29-45d5-a769-94947f8042d5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141482 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/af2b42df-4d9d-403f-9aac-87d7005ad082-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141493 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63886233-7dcb-4bfa-acb9-3d7dffb0fb33-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141504 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141515 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141526 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.141569 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.148713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.151723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-config-data" (OuterVolumeSpecName: "config-data") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.155529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.164054 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-config-data" (OuterVolumeSpecName: "config-data") pod "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" (UID: "50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.167674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "f901f005-737d-4660-95ab-a115d6a371d4" (UID: "f901f005-737d-4660-95ab-a115d6a371d4"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.167863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-config" (OuterVolumeSpecName: "config") pod "f901f005-737d-4660-95ab-a115d6a371d4" (UID: "f901f005-737d-4660-95ab-a115d6a371d4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.181901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-config-data" (OuterVolumeSpecName: "config-data") pod "b581db1b-0a9b-4010-81d8-5cc9563d71a3" (UID: "b581db1b-0a9b-4010-81d8-5cc9563d71a3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.183241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.183407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "320ae09e-4eaf-4abe-a5b2-554d1408238c" (UID: "320ae09e-4eaf-4abe-a5b2-554d1408238c"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.184094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.185325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "9aa39735-6ebc-412a-ae3c-bfb951dc599b" (UID: "9aa39735-6ebc-412a-ae3c-bfb951dc599b"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.205218 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "88f54396-564d-48eb-a4c9-8b56b3a30a86" (UID: "88f54396-564d-48eb-a4c9-8b56b3a30a86"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.209851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-config-data" (OuterVolumeSpecName: "config-data") pod "2fd709dc-5ec6-4bdd-b227-47e7208301f4" (UID: "2fd709dc-5ec6-4bdd-b227-47e7208301f4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243562 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243585 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/9aa39735-6ebc-412a-ae3c-bfb951dc599b-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243595 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243604 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243614 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243623 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243653 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f901f005-737d-4660-95ab-a115d6a371d4-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243665 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b581db1b-0a9b-4010-81d8-5cc9563d71a3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243674 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/320ae09e-4eaf-4abe-a5b2-554d1408238c-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243682 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd709dc-5ec6-4bdd-b227-47e7208301f4-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243691 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243700 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/88f54396-564d-48eb-a4c9-8b56b3a30a86-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.243708 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.295158 4769 scope.go:117] "RemoveContainer" containerID="345427c0cfe355aef6549b93b6c2016b9d88dcb1b2ffb4cdfe63847d10db0527" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.298779 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" path="/var/lib/kubelet/pods/06c8a0b8-3e88-432a-a18a-0d3f5afa05fd/volumes" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.299375 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c20fd4-12d3-483c-85e3-b766adb4a666" path="/var/lib/kubelet/pods/08c20fd4-12d3-483c-85e3-b766adb4a666/volumes" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.299896 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" path="/var/lib/kubelet/pods/256d7c47-f6a4-48f9-80c6-c1b2ed07af66/volumes" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.300930 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" path="/var/lib/kubelet/pods/85ecd4b2-b5ed-4780-993a-2433bae3b108/volumes" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.301543 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b96194-f3f1-4529-8d7b-2dc929cc6540" path="/var/lib/kubelet/pods/e1b96194-f3f1-4529-8d7b-2dc929cc6540/volumes" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.309042 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder72a2-account-delete-9dc89"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.322633 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.324469 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder72a2-account-delete-9dc89"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.341886 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.356360 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.363177 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6bd66c966b-rbblf"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.367895 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance6ada-account-delete-bwjtq"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.376652 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance6ada-account-delete-bwjtq"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.384028 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.389298 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.430670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"71adc54e-068a-472d-8d1e-99360bc87d82","Type":"ContainerDied","Data":"e2dd24ad9683733eb8ab96aa86c3bd8a4ef3b69494d0e32166d3dc0739614f8a"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.430776 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.434657 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.434661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"63886233-7dcb-4bfa-acb9-3d7dffb0fb33","Type":"ContainerDied","Data":"77a149087e4b36487c8154ff1a16bbcfdfbaf75fe7f4ce69de6fbedb2aae75e8"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.436759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" event={"ID":"be6bed2f-f542-4c99-a04e-6648f91f77bd","Type":"ContainerDied","Data":"0ce46819b800289617bd3b82f060839b69fbdbd1dd57e7a03b4d6aa730a4877d"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.436856 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell009b6-account-delete-d2gqm" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.437448 4769 scope.go:117] "RemoveContainer" containerID="067c5582156cb08f723de5f6ec265fd033219ae2219b39489ff86d1aaa13a3cc" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.442414 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.442419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2fd709dc-5ec6-4bdd-b227-47e7208301f4","Type":"ContainerDied","Data":"d280c4a8ec344af69d137a45d18ec9bb042073abbbb9880363928bfef58425d2"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-operator-scripts\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-galera-tls-certs\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446623 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-operator-scripts\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-default\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446682 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-generated\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446720 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-kolla-config\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv47j\" (UniqueName: \"kubernetes.io/projected/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kube-api-access-sv47j\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446802 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-combined-ca-bundle\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-combined-ca-bundle\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kolla-config\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-galera-tls-certs\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-default\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl5pc\" (UniqueName: \"kubernetes.io/projected/71adc54e-068a-472d-8d1e-99360bc87d82-kube-api-access-hl5pc\") pod \"71adc54e-068a-472d-8d1e-99360bc87d82\" (UID: \"71adc54e-068a-472d-8d1e-99360bc87d82\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.446965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-generated\") pod \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\" (UID: \"2e47277e-4b55-48b1-ac84-e1d6249ecf96\") " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.447487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.447648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"5415ebc2-eb7c-4b71-bd45-97674d0fe30d","Type":"ContainerDied","Data":"bb23c021c4b58f724a4254c6d1f145c6844099c8c4b6e949dc5c93224bb75a01"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.447742 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.451956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.452643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.452832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.453970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.454353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.454375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.455294 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.456646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71adc54e-068a-472d-8d1e-99360bc87d82-kube-api-access-hl5pc" (OuterVolumeSpecName: "kube-api-access-hl5pc") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "kube-api-access-hl5pc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.458699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kube-api-access-sv47j" (OuterVolumeSpecName: "kube-api-access-sv47j") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "kube-api-access-sv47j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.461323 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.461476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"2e47277e-4b55-48b1-ac84-e1d6249ecf96","Type":"ContainerDied","Data":"9217dd0ccdcdd19d8aa2b8d872c426b2ba18f62091f5d697032473cea2fbce76"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.463915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a58794b2-3db0-4930-84f4-d8757325a776","Type":"ContainerDied","Data":"21a4a1dc149df594b0a1a3b5a0b0dcae67675266d82bcda3ba230f092fa2cbb1"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.464066 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.468178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" event={"ID":"77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83","Type":"ContainerDied","Data":"a7bfc9dbb38faca3e271a52660af81a93db2fa4ed0df99b4917cc92260432ff6"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.468401 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placementd614-account-delete-2n8wr" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.471439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"b581db1b-0a9b-4010-81d8-5cc9563d71a3","Type":"ContainerDied","Data":"ecbf289db133aa6b02e2ad4d22b0485f1374290b07b6fcfd07aa471c523ffa5d"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.471468 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.472437 4769 scope.go:117] "RemoveContainer" containerID="ebca932f14860b8c8f46de6239a88b5264cda4562a46d7028c3f7f82265b5841" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.475349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" event={"ID":"88f54396-564d-48eb-a4c9-8b56b3a30a86","Type":"ContainerDied","Data":"318f9aebd6600201aa92ea565bb7aa07957b24804426cd9c24ed11a20b80fa30"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.475435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6746c44b58-657qd" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.479975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" event={"ID":"f901f005-737d-4660-95ab-a115d6a371d4","Type":"ContainerDied","Data":"7aaa12c2e6725de79568da150da77225f6e0b912794350cbf14c293a129d3bef"} Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.480070 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.485984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "mysql-db") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.486904 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.492392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "mysql-db") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.506887 4769 scope.go:117] "RemoveContainer" containerID="f34b59991bbcde373cfc57e89fd862cdaa711ae7091f5c6be779d1fc1a3f0a84" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.509467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.528464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "2e47277e-4b55-48b1-ac84-e1d6249ecf96" (UID: "2e47277e-4b55-48b1-ac84-e1d6249ecf96"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.539835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "71adc54e-068a-472d-8d1e-99360bc87d82" (UID: "71adc54e-068a-472d-8d1e-99360bc87d82"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.539898 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.548950 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.548996 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549016 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hl5pc\" (UniqueName: \"kubernetes.io/projected/71adc54e-068a-472d-8d1e-99360bc87d82-kube-api-access-hl5pc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549029 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/2e47277e-4b55-48b1-ac84-e1d6249ecf96-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549045 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549060 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549073 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549085 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549098 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/71adc54e-068a-472d-8d1e-99360bc87d82-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549110 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/71adc54e-068a-472d-8d1e-99360bc87d82-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549122 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sv47j\" (UniqueName: \"kubernetes.io/projected/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kube-api-access-sv47j\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549777 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549803 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e47277e-4b55-48b1-ac84-e1d6249ecf96-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549817 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549829 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/2e47277e-4b55-48b1-ac84-e1d6249ecf96-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.549840 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/71adc54e-068a-472d-8d1e-99360bc87d82-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.552391 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.561251 4769 scope.go:117] "RemoveContainer" containerID="2465c158e2d817cb7bc35ffb28fe2d3575288f9f7d533fb03c47e9a127895ff6" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.567347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.572500 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.574387 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.578890 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.581373 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.603630 4769 scope.go:117] "RemoveContainer" containerID="3ad645cf8690c7e4ae8e0ff281c40e184f73046c19b3fcbb9d042efab077e060" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.628162 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.641561 4769 scope.go:117] "RemoveContainer" containerID="c84ad1172babe28f337a6ea6bd0cd1d1ca034f9e9a596ffa2ee4bdd1e09fb169" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.642978 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.650578 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-c765b8f79-7w4vh"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.651344 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.651377 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.660853 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.663888 4769 scope.go:117] "RemoveContainer" containerID="78d0d12329ad5d4ba8fca9096f6dbb32b7737e92d32adee26a00e90783337bab" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.669291 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.680293 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7898c584c4-qbqkt"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.690382 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7898c584c4-qbqkt"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.698622 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.699456 4769 scope.go:117] "RemoveContainer" containerID="adc4e088af3f8340facbf46612ba74f63a0c996426c7f0f1136f9ecb61116a20" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.707310 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.713693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.722739 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.725176 4769 scope.go:117] "RemoveContainer" containerID="590e228d49d05abb2be4d1a84c6f2163c933790fed2e99c43fe83a46e2d9ea93" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.728851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.734983 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.739821 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.746483 4769 scope.go:117] "RemoveContainer" containerID="abe321c6cb98e14046fa98c53f7836806aa37647c75a4c4fc78f9a200acbf223" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.752842 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.760566 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.768357 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.774245 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placementd614-account-delete-2n8wr"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.784249 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placementd614-account-delete-2n8wr"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.800500 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell009b6-account-delete-d2gqm"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.805137 4769 scope.go:117] "RemoveContainer" containerID="5913565eff79975fb6128d5e833d4bf2c848a17163e329a7cc6d6af59f0010dc" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.810588 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell009b6-account-delete-d2gqm"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.817646 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.818716 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6497b78855-rm5km"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.823268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6746c44b58-657qd"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.825501 4769 scope.go:117] "RemoveContainer" containerID="2a4994e7882706e095fb7f6e13493c2b454d9e22bcbc23aa2324636d5a50bf96" Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.829788 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6746c44b58-657qd"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.834685 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.839211 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.843871 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.848805 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.853611 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.857825 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.862083 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:04:09 crc kubenswrapper[4769]: I1121 13:04:09.866276 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.299282 4769 scope.go:117] "RemoveContainer" containerID="17a0033d45d49e6501b7b9b022c2c8851d6e3871e8e0d99fbb3bfcd7f46dc800" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.314915 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.14:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.315140 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-7d4466f676-gspmb" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.14:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.362885 4769 scope.go:117] "RemoveContainer" containerID="21db3ba2938be2dd85f3abb4ebc4b8eadc339476e57de06bd385cc815422e188" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.418702 4769 scope.go:117] "RemoveContainer" containerID="3ff7d8741fbd7c54e8c1592e987b6e5f7442db7d0abd90263abe6b64fc6b67d0" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.457779 4769 scope.go:117] "RemoveContainer" containerID="f4648ef48e02b69b5ba0994108b42d604e490454d8293eabe62259bff04bb9dc" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.485080 4769 scope.go:117] "RemoveContainer" containerID="cdeb13eef771eb3318512613edb264c48e95caaa758c6ae51a2a0328bc69f2da" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.516808 4769 scope.go:117] "RemoveContainer" containerID="9f8b2d98d0e0ee7078a1bdd9cd21ce7958c6903539d695204b11e4b9d6eeb02b" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.573064 4769 scope.go:117] "RemoveContainer" containerID="a07145f1fe2f019e2cc7cafdcb420d76ece544dcc0b55e1e95626f2cdeee55da" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.606004 4769 scope.go:117] "RemoveContainer" containerID="9641d34e9f6c75dfc91e06309f3de8e5bfc0f4ea613a26df62959c1b55985ac6" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.630039 4769 scope.go:117] "RemoveContainer" containerID="e6df9ca67b9b6239113e112e70c4b1e230d33f595e603439419e82b7c0194826" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.678936 4769 scope.go:117] "RemoveContainer" containerID="173f6eebe5a2b179ae89434575bcd6df314f469ec514f899b6a2fc6d43f54755" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.749310 4769 scope.go:117] "RemoveContainer" containerID="cc1f1b68710e629475619e1da7750098b33d32cf27f93ef72ab35193ee1e2adb" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.751482 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.255:11211: i/o timeout" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.784808 4769 scope.go:117] "RemoveContainer" containerID="8dd0961bbecbb5ebf75b6a14a2d90472208c8a692c422433717604077c287f9e" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.820477 4769 scope.go:117] "RemoveContainer" containerID="39e70cc150e898b13cde320e2a371f6f6678d9d3ae0368c4793dfb8c9ff670aa" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.844814 4769 scope.go:117] "RemoveContainer" containerID="7831c9097a041d65632c254ee1c11941a242c3ed8e10171cb517c82b9d986263" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.869407 4769 scope.go:117] "RemoveContainer" containerID="1afb224f261a32ce0d114259cd621c219c37a68b202fac714802462a2ef0d6c2" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.900343 4769 scope.go:117] "RemoveContainer" containerID="549b8bcfb54d338e37347ff143591f86fbe05623c991f1bd831ba02c7124da80" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.948091 4769 scope.go:117] "RemoveContainer" containerID="d3a2152c08150448f236510b02f8edc967b1bd0b0973670263479ee50304ebf5" Nov 21 13:04:10 crc kubenswrapper[4769]: I1121 13:04:10.999273 4769 scope.go:117] "RemoveContainer" containerID="f8f7e1d7b824e07eac14d06f8560bf36a09a9aeb31307af45a055621163dce2f" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.027446 4769 scope.go:117] "RemoveContainer" containerID="9fa8327e6e8d806bf11d9602d91c3f0d3debe041f9014af31a38940c83990ca8" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.056059 4769 scope.go:117] "RemoveContainer" containerID="437bbdd83dd6e2debbfe8cbe6849af0f7a425dea5e196acc93e2df3a4c79628a" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.100128 4769 scope.go:117] "RemoveContainer" containerID="f13a8683802b5d9e611d43e469d02267689a05163b11522dc4abb9f12a1252fc" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.126241 4769 scope.go:117] "RemoveContainer" containerID="3dc1702410d782636a419124528d71a4e6d560d05c7c8db5e683d9502531dd1f" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.152603 4769 scope.go:117] "RemoveContainer" containerID="b8900e332a6cab927466aed3dc0c84d4a85c129a31cf973f2717f915c544d21e" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.187425 4769 scope.go:117] "RemoveContainer" containerID="9d09609f8a78c57935de97573ab4cb14d5fbcb75ede9525de9e7ebb04b8d1d6c" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.217215 4769 scope.go:117] "RemoveContainer" containerID="4b49cbc2b0f1ca3dc97f3d65b7b58d2a12f8244814f013ff9b00e5d0384e4339" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.291174 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" path="/var/lib/kubelet/pods/10af4f12-f920-4eef-bc05-b9e10a4bc83e/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.293020 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" path="/var/lib/kubelet/pods/2e47277e-4b55-48b1-ac84-e1d6249ecf96/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.294720 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" path="/var/lib/kubelet/pods/2fd709dc-5ec6-4bdd-b227-47e7208301f4/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.297857 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" path="/var/lib/kubelet/pods/320ae09e-4eaf-4abe-a5b2-554d1408238c/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.299181 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" path="/var/lib/kubelet/pods/321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.301460 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" path="/var/lib/kubelet/pods/3edbd8bc-deec-47cb-a33d-afda2f3fc1fa/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.302841 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" path="/var/lib/kubelet/pods/50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.305420 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" path="/var/lib/kubelet/pods/514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.306612 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" path="/var/lib/kubelet/pods/5415ebc2-eb7c-4b71-bd45-97674d0fe30d/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.307723 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" path="/var/lib/kubelet/pods/63886233-7dcb-4bfa-acb9-3d7dffb0fb33/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.309625 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="700428ca-7063-46bf-82da-64a8750a80bf" path="/var/lib/kubelet/pods/700428ca-7063-46bf-82da-64a8750a80bf/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.310901 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" path="/var/lib/kubelet/pods/71adc54e-068a-472d-8d1e-99360bc87d82/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.312174 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" path="/var/lib/kubelet/pods/77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.313623 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" path="/var/lib/kubelet/pods/88f54396-564d-48eb-a4c9-8b56b3a30a86/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.315622 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" path="/var/lib/kubelet/pods/9aa39735-6ebc-412a-ae3c-bfb951dc599b/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.317930 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a58794b2-3db0-4930-84f4-d8757325a776" path="/var/lib/kubelet/pods/a58794b2-3db0-4930-84f4-d8757325a776/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.319422 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" path="/var/lib/kubelet/pods/af2b42df-4d9d-403f-9aac-87d7005ad082/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.321741 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" path="/var/lib/kubelet/pods/b581db1b-0a9b-4010-81d8-5cc9563d71a3/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.323440 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be6bed2f-f542-4c99-a04e-6648f91f77bd" path="/var/lib/kubelet/pods/be6bed2f-f542-4c99-a04e-6648f91f77bd/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.324696 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" path="/var/lib/kubelet/pods/cfbba950-7b66-4271-929f-d81ed58141a6/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.326273 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.326411 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.327222 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d88bb8-6d29-45d5-a769-94947f8042d5" path="/var/lib/kubelet/pods/d5d88bb8-6d29-45d5-a769-94947f8042d5/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.328731 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6443119-0dca-440c-bb46-ab52b91c0ef5" path="/var/lib/kubelet/pods/e6443119-0dca-440c-bb46-ab52b91c0ef5/volumes" Nov 21 13:04:11 crc kubenswrapper[4769]: I1121 13:04:11.330012 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f901f005-737d-4660-95ab-a115d6a371d4" path="/var/lib/kubelet/pods/f901f005-737d-4660-95ab-a115d6a371d4/volumes" Nov 21 13:04:20 crc kubenswrapper[4769]: I1121 13:04:20.712595 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6b5b775646-kx2zh_1b0b0b34-a9b3-4bff-927f-003d8869e1b5/neutron-api/0.log" Nov 21 13:04:20 crc kubenswrapper[4769]: I1121 13:04:20.713228 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerID="6380cc4238b2ebe2414e3e527bb9b9ac858f9b5c2b818d5a059f2686c4427044" exitCode=137 Nov 21 13:04:20 crc kubenswrapper[4769]: I1121 13:04:20.713337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" event={"ID":"1b0b0b34-a9b3-4bff-927f-003d8869e1b5","Type":"ContainerDied","Data":"6380cc4238b2ebe2414e3e527bb9b9ac858f9b5c2b818d5a059f2686c4427044"} Nov 21 13:04:20 crc kubenswrapper[4769]: I1121 13:04:20.718483 4769 generic.go:334] "Generic (PLEG): container finished" podID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerID="d34893141bac7e14324235e7119164d8ef9d53ebb6113bfc39439d542249d903" exitCode=137 Nov 21 13:04:20 crc kubenswrapper[4769]: I1121 13:04:20.718520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"d34893141bac7e14324235e7119164d8ef9d53ebb6113bfc39439d542249d903"} Nov 21 13:04:20 crc kubenswrapper[4769]: I1121 13:04:20.916418 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.064084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-lock\") pod \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.064178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-cache\") pod \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.064255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.064356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-etc-swift\") pod \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.064398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r27l7\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-kube-api-access-r27l7\") pod \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\" (UID: \"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.064894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-lock" (OuterVolumeSpecName: "lock") pod "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" (UID: "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.065455 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-cache" (OuterVolumeSpecName: "cache") pod "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" (UID: "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.070352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "swift") pod "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" (UID: "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.070352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-kube-api-access-r27l7" (OuterVolumeSpecName: "kube-api-access-r27l7") pod "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" (UID: "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e"). InnerVolumeSpecName "kube-api-access-r27l7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.070914 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" (UID: "ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.174985 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.175033 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r27l7\" (UniqueName: \"kubernetes.io/projected/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-kube-api-access-r27l7\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.175048 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-lock\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.175059 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e-cache\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.175100 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.195735 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.276120 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.397662 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6b5b775646-kx2zh_1b0b0b34-a9b3-4bff-927f-003d8869e1b5/neutron-api/0.log" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.397756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.478932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-ovndb-tls-certs\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.478987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-httpd-config\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.479048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5phvj\" (UniqueName: \"kubernetes.io/projected/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-kube-api-access-5phvj\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.479086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-internal-tls-certs\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.479114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-combined-ca-bundle\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.479210 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-config\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.479300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-public-tls-certs\") pod \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\" (UID: \"1b0b0b34-a9b3-4bff-927f-003d8869e1b5\") " Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.482615 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.484696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-kube-api-access-5phvj" (OuterVolumeSpecName: "kube-api-access-5phvj") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "kube-api-access-5phvj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.528734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.529447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.529466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.529773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-config" (OuterVolumeSpecName: "config") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.554772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "1b0b0b34-a9b3-4bff-927f-003d8869e1b5" (UID: "1b0b0b34-a9b3-4bff-927f-003d8869e1b5"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581334 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581369 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581378 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581388 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5phvj\" (UniqueName: \"kubernetes.io/projected/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-kube-api-access-5phvj\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581399 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581413 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.581425 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b0b0b34-a9b3-4bff-927f-003d8869e1b5-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.740132 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.740039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e","Type":"ContainerDied","Data":"c117f6edb318232be5460fffe4ccf0d63d7ba3a7c1d0f9d99bb1d0fe20e7b2cb"} Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.740709 4769 scope.go:117] "RemoveContainer" containerID="d34893141bac7e14324235e7119164d8ef9d53ebb6113bfc39439d542249d903" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.747473 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6b5b775646-kx2zh_1b0b0b34-a9b3-4bff-927f-003d8869e1b5/neutron-api/0.log" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.747560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" event={"ID":"1b0b0b34-a9b3-4bff-927f-003d8869e1b5","Type":"ContainerDied","Data":"f142fc1a7af7995a74098f6693c8837bc10d580aa16b73de14c30ab3ce4ab784"} Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.747675 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.783104 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.788252 4769 scope.go:117] "RemoveContainer" containerID="f1f3a59139be3889aef6f9a4490858cda0b7511988c72fae3bf1dc6a34a4348b" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.801989 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.813768 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6b5b775646-kx2zh"] Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.822869 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6b5b775646-kx2zh"] Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.828102 4769 scope.go:117] "RemoveContainer" containerID="31d592f452e6dd5bd46a420b62746166664e4fc3c34f70bd4a19053d8d50d5a6" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.915769 4769 scope.go:117] "RemoveContainer" containerID="9a52877dedfb5d79b8df000b889d7dd6422bebef829bd516f3330ad7b9f3238e" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.943172 4769 scope.go:117] "RemoveContainer" containerID="d1fee3cbfc0a272e339e8452f5cd513ca9d2bd696ec42b72e02227a659be5d10" Nov 21 13:04:21 crc kubenswrapper[4769]: I1121 13:04:21.970479 4769 scope.go:117] "RemoveContainer" containerID="047ecb31f533715cada52cbcc20c476844351e8972f43e1c7b9f6fcc82610ee3" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.000530 4769 scope.go:117] "RemoveContainer" containerID="3027ddbe8ffc6b6ab8af00f2f3f13952c5d706fb3b1c4fbb764ea98e2f0acc4e" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.032952 4769 scope.go:117] "RemoveContainer" containerID="18e9cdfaea2562b46fb2532590de989615ad928caf86009809eabc04316d798e" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.065043 4769 scope.go:117] "RemoveContainer" containerID="db8f14bf60e6abcd8f658b1dd66c729d7d27295d4512e63ee31508a2702f6a29" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.106480 4769 scope.go:117] "RemoveContainer" containerID="ad8b93236f1c04b4834204f689352897f5e359f758e41c0f748bf1c686222b23" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.131680 4769 scope.go:117] "RemoveContainer" containerID="41a602203e83d0e6af60e006c173309fc07c2e6fd0a50b4197767953343be373" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.162534 4769 scope.go:117] "RemoveContainer" containerID="237b1e0dd3912ca9a6e59c9e9f218820ab4bd1fe785b529e25ed9dbf82687350" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.181308 4769 scope.go:117] "RemoveContainer" containerID="deafe43b3d4d64225e6b802c037e2c0eb88c52d4439dfb1cc07a0d5890be7916" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.199664 4769 scope.go:117] "RemoveContainer" containerID="6f0b78af199089faaf58ebca8cb5f22eb2d60a7a7a77f8784dffda080f9fbf3f" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.217167 4769 scope.go:117] "RemoveContainer" containerID="a6c4f377379bf48e842d63b21ab1e15c9c3f3600ee88effa1c081489c0ab8bce" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.234077 4769 scope.go:117] "RemoveContainer" containerID="d753aa6fab713fea9f2a6b44ac5416eee7d5a96225297555633984c3d5e91db0" Nov 21 13:04:22 crc kubenswrapper[4769]: I1121 13:04:22.258462 4769 scope.go:117] "RemoveContainer" containerID="6380cc4238b2ebe2414e3e527bb9b9ac858f9b5c2b818d5a059f2686c4427044" Nov 21 13:04:23 crc kubenswrapper[4769]: I1121 13:04:23.290546 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" path="/var/lib/kubelet/pods/1b0b0b34-a9b3-4bff-927f-003d8869e1b5/volumes" Nov 21 13:04:23 crc kubenswrapper[4769]: I1121 13:04:23.291832 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" path="/var/lib/kubelet/pods/ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e/volumes" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.632497 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-jlmzv"] Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.638724 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-jlmzv"] Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.773499 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-88d2c"] Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.773915 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="ovsdbserver-sb" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.773945 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="ovsdbserver-sb" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.773971 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.773983 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774000 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="08c20fd4-12d3-483c-85e3-b766adb4a666" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774013 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c20fd4-12d3-483c-85e3-b766adb4a666" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774035 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774046 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774058 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774088 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774099 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774116 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774128 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774146 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774159 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774176 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774208 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-server" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774230 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774242 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774256 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="700428ca-7063-46bf-82da-64a8750a80bf" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774268 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="700428ca-7063-46bf-82da-64a8750a80bf" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774285 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774296 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774347 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6443119-0dca-440c-bb46-ab52b91c0ef5" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774360 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6443119-0dca-440c-bb46-ab52b91c0ef5" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774376 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774405 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774415 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774433 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774444 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774471 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774487 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774497 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774510 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774521 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774536 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1b96194-f3f1-4529-8d7b-2dc929cc6540" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b96194-f3f1-4529-8d7b-2dc929cc6540" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774566 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774596 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774607 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774622 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f901f005-737d-4660-95ab-a115d6a371d4" containerName="dnsmasq-dns" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774633 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f901f005-737d-4660-95ab-a115d6a371d4" containerName="dnsmasq-dns" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774656 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-central-agent" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774667 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-central-agent" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774689 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774700 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774713 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774726 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774744 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774757 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774779 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774790 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774803 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="proxy-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774813 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="proxy-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774835 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5d88bb8-6d29-45d5-a769-94947f8042d5" containerName="keystone-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774846 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d88bb8-6d29-45d5-a769-94947f8042d5" containerName="keystone-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774859 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774869 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-reaper" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774891 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-reaper" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774902 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774912 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774926 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774958 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.774978 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="galera" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.774989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="galera" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775009 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775020 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775033 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-expirer" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-expirer" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775062 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="26b2657a-8faa-447c-910f-441ec806eda0" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775073 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b2657a-8faa-447c-910f-441ec806eda0" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775096 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775108 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775130 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775157 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="mysql-bootstrap" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775206 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="mysql-bootstrap" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775229 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="probe" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775241 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="probe" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775260 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be6bed2f-f542-4c99-a04e-6648f91f77bd" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775271 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6bed2f-f542-4c99-a04e-6648f91f77bd" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775283 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" containerName="kube-state-metrics" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775294 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" containerName="kube-state-metrics" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775308 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="ovsdbserver-nb" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775318 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="ovsdbserver-nb" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775340 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775351 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775371 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775382 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775394 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="rsync" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775405 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="rsync" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775424 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775436 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-server" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775466 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775480 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="mysql-bootstrap" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="mysql-bootstrap" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775513 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775524 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775541 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775551 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775568 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="cinder-scheduler" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775578 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="cinder-scheduler" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775589 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="setup-container" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775600 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="setup-container" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-notification-agent" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775626 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-notification-agent" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775638 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="rabbitmq" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775650 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="rabbitmq" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775673 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="sg-core" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775684 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="sg-core" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775696 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-updater" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775708 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-updater" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775724 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775735 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775750 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775761 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775778 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-updater" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775790 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-updater" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775807 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="setup-container" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775818 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="setup-container" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775843 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775858 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="galera" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775881 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="galera" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="rabbitmq" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775952 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="rabbitmq" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.775973 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.775984 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776003 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776014 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776048 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776067 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776077 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776094 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776108 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776124 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776135 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776148 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776160 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776181 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776230 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="swift-recon-cron" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776241 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="swift-recon-cron" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776260 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776271 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776286 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776296 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-server" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776314 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f901f005-737d-4660-95ab-a115d6a371d4" containerName="init" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776327 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f901f005-737d-4660-95ab-a115d6a371d4" containerName="init" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776340 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776351 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-api" Nov 21 13:04:31 crc kubenswrapper[4769]: E1121 13:04:31.776367 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776378 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-notification-agent" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776718 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776739 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776751 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1b96194-f3f1-4529-8d7b-2dc929cc6540" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776771 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776785 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776801 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776825 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776846 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="85ecd4b2-b5ed-4780-993a-2433bae3b108" containerName="memcached" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776864 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="cinder-scheduler" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776887 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="sg-core" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776908 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776920 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25f25039-7e44-4cc7-ad8c-71b8fcca9754" containerName="kube-state-metrics" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776939 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.776988 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-updater" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777008 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777025 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="10af4f12-f920-4eef-bc05-b9e10a4bc83e" containerName="probe" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777048 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="50f1c4b4-0b25-4ca6-b214-ee2b406c7bc6" containerName="glance-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777067 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777082 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777103 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="06c8a0b8-3e88-432a-a18a-0d3f5afa05fd" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777123 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777145 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777164 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-auditor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777183 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="320ae09e-4eaf-4abe-a5b2-554d1408238c" containerName="rabbitmq" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777229 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af2b42df-4d9d-403f-9aac-87d7005ad082" containerName="ovn-northd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777246 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777267 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-expirer" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777287 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9aa39735-6ebc-412a-ae3c-bfb951dc599b" containerName="rabbitmq" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777302 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777320 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6443119-0dca-440c-bb46-ab52b91c0ef5" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777331 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777348 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777391 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f901f005-737d-4660-95ab-a115d6a371d4" containerName="dnsmasq-dns" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777402 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="88f54396-564d-48eb-a4c9-8b56b3a30a86" containerName="placement-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777418 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e47277e-4b55-48b1-ac84-e1d6249ecf96" containerName="galera" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777431 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed6e1205-4575-417d-9b21-529dc83d8657" containerName="ovsdbserver-nb" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777444 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777462 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="700428ca-7063-46bf-82da-64a8750a80bf" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777475 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777494 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-metadata" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777509 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777531 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777546 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b581db1b-0a9b-4010-81d8-5cc9563d71a3" containerName="glance-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777561 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be6bed2f-f542-4c99-a04e-6648f91f77bd" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777577 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777596 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777616 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="514d9ac7-4ddd-46fd-815c-4f6d0f2f66ee" containerName="barbican-worker-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777631 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfbba950-7b66-4271-929f-d81ed58141a6" containerName="nova-metadata-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777643 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="ovsdbserver-sb" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777665 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="ceilometer-central-agent" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777682 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3edbd8bc-deec-47cb-a33d-afda2f3fc1fa" containerName="barbican-keystone-listener" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777714 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="321bbb3c-1ebe-41b4-bdd6-07f0bd2d38d3" containerName="nova-api-log" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777736 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5d88bb8-6d29-45d5-a769-94947f8042d5" containerName="keystone-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777753 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2fd709dc-5ec6-4bdd-b227-47e7208301f4" containerName="proxy-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777771 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="26b2657a-8faa-447c-910f-441ec806eda0" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777807 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-updater" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777819 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777834 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777847 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777865 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="71adc54e-068a-472d-8d1e-99360bc87d82" containerName="galera" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777879 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="object-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777896 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-httpd" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777916 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db45f877-263f-4e73-bbb6-3ad67a038d51" containerName="cinder-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777932 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="256d7c47-f6a4-48f9-80c6-c1b2ed07af66" containerName="proxy-server" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777947 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="container-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777960 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="58a4b306-e429-4353-acae-c0243a0fef30" containerName="openstack-network-exporter" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777972 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="swift-recon-cron" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.777989 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="63886233-7dcb-4bfa-acb9-3d7dffb0fb33" containerName="nova-scheduler-scheduler" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.778024 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="08c20fd4-12d3-483c-85e3-b766adb4a666" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.778038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-replicator" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.778050 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="account-reaper" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.778068 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="77cf2fdd-2fc0-4db3-b1cc-6962a8de9e83" containerName="mariadb-account-delete" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.778079 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ddf1685f-751c-4d4e-bb4b-f6c3964f3f1e" containerName="rsync" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.778099 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.780331 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.782219 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-88d2c"] Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.783594 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.784109 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.784615 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.788122 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.844997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5ss\" (UniqueName: \"kubernetes.io/projected/c2d3f706-c691-4b3a-92e1-694da8986f79-kube-api-access-hk5ss\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.845156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2d3f706-c691-4b3a-92e1-694da8986f79-crc-storage\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.845334 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2d3f706-c691-4b3a-92e1-694da8986f79-node-mnt\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.946902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2d3f706-c691-4b3a-92e1-694da8986f79-crc-storage\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.946974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2d3f706-c691-4b3a-92e1-694da8986f79-node-mnt\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.947011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5ss\" (UniqueName: \"kubernetes.io/projected/c2d3f706-c691-4b3a-92e1-694da8986f79-kube-api-access-hk5ss\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.947318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2d3f706-c691-4b3a-92e1-694da8986f79-node-mnt\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.947754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2d3f706-c691-4b3a-92e1-694da8986f79-crc-storage\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:31 crc kubenswrapper[4769]: I1121 13:04:31.967906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5ss\" (UniqueName: \"kubernetes.io/projected/c2d3f706-c691-4b3a-92e1-694da8986f79-kube-api-access-hk5ss\") pod \"crc-storage-crc-88d2c\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:32 crc kubenswrapper[4769]: I1121 13:04:32.099271 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:32 crc kubenswrapper[4769]: I1121 13:04:32.505546 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-88d2c"] Nov 21 13:04:32 crc kubenswrapper[4769]: I1121 13:04:32.871011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-88d2c" event={"ID":"c2d3f706-c691-4b3a-92e1-694da8986f79","Type":"ContainerStarted","Data":"20085d8229a1cd934186981a2719e8bbec334eecb7f671f5d414c31ee538ac86"} Nov 21 13:04:33 crc kubenswrapper[4769]: I1121 13:04:33.284005 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68607dca-d1e2-466f-aa70-d84ae050d603" path="/var/lib/kubelet/pods/68607dca-d1e2-466f-aa70-d84ae050d603/volumes" Nov 21 13:04:33 crc kubenswrapper[4769]: I1121 13:04:33.883136 4769 generic.go:334] "Generic (PLEG): container finished" podID="c2d3f706-c691-4b3a-92e1-694da8986f79" containerID="66656c0edf4fd040ee5af751d0839bdf1870710fae7b1d5dbdf5ae35ebda62e1" exitCode=0 Nov 21 13:04:33 crc kubenswrapper[4769]: I1121 13:04:33.883255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-88d2c" event={"ID":"c2d3f706-c691-4b3a-92e1-694da8986f79","Type":"ContainerDied","Data":"66656c0edf4fd040ee5af751d0839bdf1870710fae7b1d5dbdf5ae35ebda62e1"} Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.234544 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.323468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2d3f706-c691-4b3a-92e1-694da8986f79-crc-storage\") pod \"c2d3f706-c691-4b3a-92e1-694da8986f79\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.323573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2d3f706-c691-4b3a-92e1-694da8986f79-node-mnt\") pod \"c2d3f706-c691-4b3a-92e1-694da8986f79\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.323691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk5ss\" (UniqueName: \"kubernetes.io/projected/c2d3f706-c691-4b3a-92e1-694da8986f79-kube-api-access-hk5ss\") pod \"c2d3f706-c691-4b3a-92e1-694da8986f79\" (UID: \"c2d3f706-c691-4b3a-92e1-694da8986f79\") " Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.323801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c2d3f706-c691-4b3a-92e1-694da8986f79-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "c2d3f706-c691-4b3a-92e1-694da8986f79" (UID: "c2d3f706-c691-4b3a-92e1-694da8986f79"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.324071 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c2d3f706-c691-4b3a-92e1-694da8986f79-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.338365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d3f706-c691-4b3a-92e1-694da8986f79-kube-api-access-hk5ss" (OuterVolumeSpecName: "kube-api-access-hk5ss") pod "c2d3f706-c691-4b3a-92e1-694da8986f79" (UID: "c2d3f706-c691-4b3a-92e1-694da8986f79"). InnerVolumeSpecName "kube-api-access-hk5ss". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.342635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d3f706-c691-4b3a-92e1-694da8986f79-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "c2d3f706-c691-4b3a-92e1-694da8986f79" (UID: "c2d3f706-c691-4b3a-92e1-694da8986f79"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.425694 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hk5ss\" (UniqueName: \"kubernetes.io/projected/c2d3f706-c691-4b3a-92e1-694da8986f79-kube-api-access-hk5ss\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.425748 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c2d3f706-c691-4b3a-92e1-694da8986f79-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.907681 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-88d2c" event={"ID":"c2d3f706-c691-4b3a-92e1-694da8986f79","Type":"ContainerDied","Data":"20085d8229a1cd934186981a2719e8bbec334eecb7f671f5d414c31ee538ac86"} Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.907733 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20085d8229a1cd934186981a2719e8bbec334eecb7f671f5d414c31ee538ac86" Nov 21 13:04:35 crc kubenswrapper[4769]: I1121 13:04:35.907788 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-88d2c" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.613767 4769 scope.go:117] "RemoveContainer" containerID="9949e9ef9b1107a1590a250088615ecd83b94806a7cceefbd1201ed5fec486cc" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.657057 4769 scope.go:117] "RemoveContainer" containerID="251a87ace601cb995275147980b339cedc2e7c43220b9cd68d79fe828a92b352" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.714448 4769 scope.go:117] "RemoveContainer" containerID="55c1d62b8b284d53ae533a8ff5c21ba8e49af1df3170b3a22f56fbcb00754192" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.789131 4769 scope.go:117] "RemoveContainer" containerID="985ffcd4298c7325d61270be42f82b8c1efd77b6038db3af765cdfb8b25bbfd4" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.792343 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-88d2c"] Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.803432 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-88d2c"] Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.813430 4769 scope.go:117] "RemoveContainer" containerID="8d6633181fe3adae179d055ca25157a1b90a8dd34414442064540f0eebac32bc" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.848431 4769 scope.go:117] "RemoveContainer" containerID="5f2c6296771bebd6476572b96e6a27f08386be45002551337cedf2f3a969803a" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.877301 4769 scope.go:117] "RemoveContainer" containerID="91c08359a4a3b7197670e49229241ba86e888eb0f0b0b9b31df12278ea6b5a0d" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.911014 4769 scope.go:117] "RemoveContainer" containerID="c0d774f2d7f30d17936103dad2cec4bf017f5f0005c120eff453784baeeb232d" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.917793 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-5gjsp"] Nov 21 13:04:38 crc kubenswrapper[4769]: E1121 13:04:38.918100 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c2d3f706-c691-4b3a-92e1-694da8986f79" containerName="storage" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918119 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d3f706-c691-4b3a-92e1-694da8986f79" containerName="storage" Nov 21 13:04:38 crc kubenswrapper[4769]: E1121 13:04:38.918137 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918148 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e62f83c-f27a-469a-bc38-0f20b3db209a" containerName="barbican-api-log" Nov 21 13:04:38 crc kubenswrapper[4769]: E1121 13:04:38.918181 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918207 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5415ebc2-eb7c-4b71-bd45-97674d0fe30d" containerName="nova-cell0-conductor-conductor" Nov 21 13:04:38 crc kubenswrapper[4769]: E1121 13:04:38.918225 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918235 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918393 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c2d3f706-c691-4b3a-92e1-694da8986f79" containerName="storage" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918421 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a58794b2-3db0-4930-84f4-d8757325a776" containerName="nova-cell1-conductor-conductor" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.918977 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.921585 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.922747 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.922851 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.922927 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:04:38 crc kubenswrapper[4769]: I1121 13:04:38.934463 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-5gjsp"] Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.006437 4769 scope.go:117] "RemoveContainer" containerID="cdde02ce4036440411d8d1df10f13867e6a6b641a38bd7af5c09b414fc6643b7" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.021859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-node-mnt\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.021932 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7m5\" (UniqueName: \"kubernetes.io/projected/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-kube-api-access-fq7m5\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.021970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-crc-storage\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.043022 4769 scope.go:117] "RemoveContainer" containerID="5c8204a666e532ed6bef6c5b2a3add2b2de12d729842a2c5d3eee5dc2b7db804" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.076762 4769 scope.go:117] "RemoveContainer" containerID="ea88c34f4f767ae82634b83d833c9cdd37a815c7848479d30054c74da558fc5e" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.104301 4769 scope.go:117] "RemoveContainer" containerID="8bc64f2099fb08eab1df9f4db849d1c6a526706b9dd6f09592c76126a33ea3e2" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.123551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-node-mnt\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.123741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7m5\" (UniqueName: \"kubernetes.io/projected/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-kube-api-access-fq7m5\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.123812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-crc-storage\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.123883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-node-mnt\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.124823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-crc-storage\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.141077 4769 scope.go:117] "RemoveContainer" containerID="b1471d63fe07e1ae9d8c7f40dce0c4b51542597f24d21667b137c9212924f813" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.161825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7m5\" (UniqueName: \"kubernetes.io/projected/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-kube-api-access-fq7m5\") pod \"crc-storage-crc-5gjsp\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.185152 4769 scope.go:117] "RemoveContainer" containerID="8d474a775599b7d2be9e4de978bbd1e95d6ff53a635bc194018f15af66da94c6" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.214294 4769 scope.go:117] "RemoveContainer" containerID="e2b92f8169576b1223af4924d42600948f0987f54b867cf7ff872ba44141dc3a" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.249672 4769 scope.go:117] "RemoveContainer" containerID="ea98990946f6e13004e105026761e632adf8e74527437de77db5c0ea24401b5f" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.274497 4769 scope.go:117] "RemoveContainer" containerID="2b03ca11dd61eff9c513aab44f92368ac1bd82202aeb0f327da2c7cf0f1701f7" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.282832 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.287652 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d3f706-c691-4b3a-92e1-694da8986f79" path="/var/lib/kubelet/pods/c2d3f706-c691-4b3a-92e1-694da8986f79/volumes" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.339201 4769 scope.go:117] "RemoveContainer" containerID="5c58a3c586bb01b0ff3618afbadf6d287facf1097648599c8356593f738597e1" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.361563 4769 scope.go:117] "RemoveContainer" containerID="c8cadff964386a6ce191b7dae0b8a20df38f9c6c042be677e7e7160284220358" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.388108 4769 scope.go:117] "RemoveContainer" containerID="fb31b3f33e76224a37d9ae0cf893eee2602e2915af1470389bcf9d4c7c56cebb" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.444564 4769 scope.go:117] "RemoveContainer" containerID="05f6d69cc73fb3fb3aa0dd35b5abfaa3be869a37e98aad7ef01468a29fb7cb20" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.491165 4769 scope.go:117] "RemoveContainer" containerID="31ca482243e2d16fefa82e2b4157ef9a354e917c04961391d3d8fea490b18f20" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.531046 4769 scope.go:117] "RemoveContainer" containerID="939224dc1fb26ae1eb3c9cc9e6e89da81192c1ccd30605f25a9b4ff6b61186e0" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.553811 4769 scope.go:117] "RemoveContainer" containerID="c48c0fa7db76af44b50d1b10d1c38f06d2fbe872922aa4cf98886b69cfa04990" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.583765 4769 scope.go:117] "RemoveContainer" containerID="458ea4746c499faed0a5b2993bb3da8d5dd6f67e434205828c4e365397b026bc" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.609049 4769 scope.go:117] "RemoveContainer" containerID="4e61ab989053b7a5dc9e0134ebea1f10dba9dc527f26287d20e71c4f9840f4be" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.625176 4769 scope.go:117] "RemoveContainer" containerID="e82bebafe49096e435c0dd57a5f6a57489def808fba98b7994117b127c6bd030" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.646763 4769 scope.go:117] "RemoveContainer" containerID="56b888d5703cb6399523b4211419bcaf2e320d9806357676f7a0919aa3105d06" Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.725043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-5gjsp"] Nov 21 13:04:39 crc kubenswrapper[4769]: W1121 13:04:39.739426 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod546f1ee0_ab53_4793_b5df_792ddcdc8bc7.slice/crio-bb4cddf4ff219b78efb50fae459ea12391fa6a8816873ebf44a7843b4755617c WatchSource:0}: Error finding container bb4cddf4ff219b78efb50fae459ea12391fa6a8816873ebf44a7843b4755617c: Status 404 returned error can't find the container with id bb4cddf4ff219b78efb50fae459ea12391fa6a8816873ebf44a7843b4755617c Nov 21 13:04:39 crc kubenswrapper[4769]: I1121 13:04:39.967774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-5gjsp" event={"ID":"546f1ee0-ab53-4793-b5df-792ddcdc8bc7","Type":"ContainerStarted","Data":"bb4cddf4ff219b78efb50fae459ea12391fa6a8816873ebf44a7843b4755617c"} Nov 21 13:04:41 crc kubenswrapper[4769]: I1121 13:04:41.325561 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:04:41 crc kubenswrapper[4769]: I1121 13:04:41.325656 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:04:41 crc kubenswrapper[4769]: I1121 13:04:41.325725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:04:41 crc kubenswrapper[4769]: I1121 13:04:41.326740 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:04:41 crc kubenswrapper[4769]: I1121 13:04:41.326822 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" gracePeriod=600 Nov 21 13:04:42 crc kubenswrapper[4769]: E1121 13:04:42.001894 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:04:42 crc kubenswrapper[4769]: I1121 13:04:42.018356 4769 generic.go:334] "Generic (PLEG): container finished" podID="546f1ee0-ab53-4793-b5df-792ddcdc8bc7" containerID="a3494c786bde02a64a6245c32ced4dadcc14b680d66453e245dcebb53a862c8f" exitCode=0 Nov 21 13:04:42 crc kubenswrapper[4769]: I1121 13:04:42.018444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-5gjsp" event={"ID":"546f1ee0-ab53-4793-b5df-792ddcdc8bc7","Type":"ContainerDied","Data":"a3494c786bde02a64a6245c32ced4dadcc14b680d66453e245dcebb53a862c8f"} Nov 21 13:04:42 crc kubenswrapper[4769]: I1121 13:04:42.023298 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" exitCode=0 Nov 21 13:04:42 crc kubenswrapper[4769]: I1121 13:04:42.023339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8"} Nov 21 13:04:42 crc kubenswrapper[4769]: I1121 13:04:42.023371 4769 scope.go:117] "RemoveContainer" containerID="7da5fdce4fbae9f3b258b796977753d26bbb86ca1b6a9d778fdf42dd01683bfe" Nov 21 13:04:42 crc kubenswrapper[4769]: I1121 13:04:42.023845 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:04:42 crc kubenswrapper[4769]: E1121 13:04:42.024172 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.370011 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.401296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq7m5\" (UniqueName: \"kubernetes.io/projected/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-kube-api-access-fq7m5\") pod \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.401365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-node-mnt\") pod \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.401430 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-crc-storage\") pod \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\" (UID: \"546f1ee0-ab53-4793-b5df-792ddcdc8bc7\") " Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.401817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "546f1ee0-ab53-4793-b5df-792ddcdc8bc7" (UID: "546f1ee0-ab53-4793-b5df-792ddcdc8bc7"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.411506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-kube-api-access-fq7m5" (OuterVolumeSpecName: "kube-api-access-fq7m5") pod "546f1ee0-ab53-4793-b5df-792ddcdc8bc7" (UID: "546f1ee0-ab53-4793-b5df-792ddcdc8bc7"). InnerVolumeSpecName "kube-api-access-fq7m5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.446115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "546f1ee0-ab53-4793-b5df-792ddcdc8bc7" (UID: "546f1ee0-ab53-4793-b5df-792ddcdc8bc7"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.503636 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.503675 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fq7m5\" (UniqueName: \"kubernetes.io/projected/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-kube-api-access-fq7m5\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:43 crc kubenswrapper[4769]: I1121 13:04:43.503691 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/546f1ee0-ab53-4793-b5df-792ddcdc8bc7-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:04:44 crc kubenswrapper[4769]: I1121 13:04:44.062218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-5gjsp" event={"ID":"546f1ee0-ab53-4793-b5df-792ddcdc8bc7","Type":"ContainerDied","Data":"bb4cddf4ff219b78efb50fae459ea12391fa6a8816873ebf44a7843b4755617c"} Nov 21 13:04:44 crc kubenswrapper[4769]: I1121 13:04:44.062691 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb4cddf4ff219b78efb50fae459ea12391fa6a8816873ebf44a7843b4755617c" Nov 21 13:04:44 crc kubenswrapper[4769]: I1121 13:04:44.062318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-5gjsp" Nov 21 13:04:51 crc kubenswrapper[4769]: I1121 13:04:51.330156 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6b5b775646-kx2zh" podUID="1b0b0b34-a9b3-4bff-927f-003d8869e1b5" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.251:9696/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:54 crc kubenswrapper[4769]: I1121 13:04:54.274484 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:04:54 crc kubenswrapper[4769]: E1121 13:04:54.275094 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:04:55 crc kubenswrapper[4769]: I1121 13:04:55.249415 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://localhost:1936/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 21 13:04:55 crc kubenswrapper[4769]: I1121 13:04:55.249465 4769 patch_prober.go:28] interesting pod/router-default-5444994796-g9x6j container/router namespace/openshift-ingress: Liveness probe status=failure output="Get \"http://localhost:1936/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 21 13:04:55 crc kubenswrapper[4769]: I1121 13:04:55.249543 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:55 crc kubenswrapper[4769]: I1121 13:04:55.249481 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-ingress/router-default-5444994796-g9x6j" podUID="00a56ef7-97e4-4bf8-97b9-8b8df884a29b" containerName="router" probeResult="failure" output="Get \"http://localhost:1936/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.678915 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:04:56 crc kubenswrapper[4769]: E1121 13:04:56.679770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="546f1ee0-ab53-4793-b5df-792ddcdc8bc7" containerName="storage" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.679786 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="546f1ee0-ab53-4793-b5df-792ddcdc8bc7" containerName="storage" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.679962 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="546f1ee0-ab53-4793-b5df-792ddcdc8bc7" containerName="storage" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.680911 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.685598 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.686174 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.688752 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.689263 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.689466 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-pdmmr" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.689553 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.689559 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.703738 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802764 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2qmc\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-kube-api-access-d2qmc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-pod-info\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-server-conf\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.802958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.803066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.905145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.905862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.906007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d2qmc\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-kube-api-access-d2qmc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.906178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-pod-info\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.906326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-server-conf\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.906772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.906948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.907153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.907408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.907524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.907703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.907989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-server-conf\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.907239 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.906832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.908909 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.909629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.910559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.912103 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.912520 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-pod-info\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.914801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.923255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.928173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2qmc\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-kube-api-access-d2qmc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.942586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"rabbitmq-server-0\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.996243 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:04:56 crc kubenswrapper[4769]: I1121 13:04:56.997833 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.002564 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.002576 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.002853 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.002933 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.003047 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.003265 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.003583 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-r5d4f" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.011235 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.011420 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111509 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kksd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-kube-api-access-2kksd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.111637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2kksd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-kube-api-access-2kksd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213601 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.213658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.214179 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.214308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.214496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.215316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.216637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.218496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.252368 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.479463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.479886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.480611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.480930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kksd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-kube-api-access-2kksd\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.495910 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.540351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.557976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:04:57 crc kubenswrapper[4769]: I1121 13:04:57.989617 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:04:57 crc kubenswrapper[4769]: W1121 13:04:57.996463 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bcbff3_ef6f_466b_81ad_7aa2093adbed.slice/crio-be26784bc0e1e80a68099f741d5ebf123609c93dc40811f63737cf6bafad91b5 WatchSource:0}: Error finding container be26784bc0e1e80a68099f741d5ebf123609c93dc40811f63737cf6bafad91b5: Status 404 returned error can't find the container with id be26784bc0e1e80a68099f741d5ebf123609c93dc40811f63737cf6bafad91b5 Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.210122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a","Type":"ContainerStarted","Data":"37719618a1b278ab1568e31f187fc214fd2694c7727105c5d81b0220b9fb5c0f"} Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.211242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d9bcbff3-ef6f-466b-81ad-7aa2093adbed","Type":"ContainerStarted","Data":"be26784bc0e1e80a68099f741d5ebf123609c93dc40811f63737cf6bafad91b5"} Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.506663 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.508505 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.510354 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.511224 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.511584 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.511728 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ktmdt" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.526110 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.537068 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640209 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-default\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mlj\" (UniqueName: \"kubernetes.io/projected/6145220b-07ba-4cc8-8d16-392394c634b4-kube-api-access-57mlj\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640350 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.640601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-kolla-config\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.741911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742067 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-kolla-config\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-default\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-57mlj\" (UniqueName: \"kubernetes.io/projected/6145220b-07ba-4cc8-8d16-392394c634b4-kube-api-access-57mlj\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742557 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.742770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.743223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-kolla-config\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.743752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-default\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.744183 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.779773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.780247 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:58 crc kubenswrapper[4769]: I1121 13:04:58.781712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mlj\" (UniqueName: \"kubernetes.io/projected/6145220b-07ba-4cc8-8d16-392394c634b4-kube-api-access-57mlj\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.002357 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.136968 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.237017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a","Type":"ContainerStarted","Data":"818bae63b54b75b9d153ca690e3037b23b533cf1c060f6ad7f600755e4c4b69d"} Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.559835 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.950518 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.952482 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.955563 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.955851 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.955933 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.956296 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xl2bf" Nov 21 13:04:59 crc kubenswrapper[4769]: I1121 13:04:59.972535 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062220 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2nlw\" (UniqueName: \"kubernetes.io/projected/93345448-c057-46bc-8671-d56938d5fe7c-kube-api-access-p2nlw\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.062732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93345448-c057-46bc-8671-d56938d5fe7c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93345448-c057-46bc-8671-d56938d5fe7c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164637 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p2nlw\" (UniqueName: \"kubernetes.io/projected/93345448-c057-46bc-8671-d56938d5fe7c-kube-api-access-p2nlw\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.164851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.165850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.166168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93345448-c057-46bc-8671-d56938d5fe7c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.166174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.166380 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.166750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.171954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.172577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.192028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2nlw\" (UniqueName: \"kubernetes.io/projected/93345448-c057-46bc-8671-d56938d5fe7c-kube-api-access-p2nlw\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.208283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.247678 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d9bcbff3-ef6f-466b-81ad-7aa2093adbed","Type":"ContainerStarted","Data":"d4d4b9d9b6b372178b453dedb9cc896b7d516d5d20376643b3cbc00f070c99ca"} Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.248991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"6145220b-07ba-4cc8-8d16-392394c634b4","Type":"ContainerStarted","Data":"5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a"} Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.249025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"6145220b-07ba-4cc8-8d16-392394c634b4","Type":"ContainerStarted","Data":"7b9f74dabf755ce6bf81ae46dece95ad52f4f3676d9ab930bd46b802addc3be3"} Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.308723 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.394059 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.395242 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.397816 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.397936 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.397974 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-p5kzh" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.405729 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.468877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.468926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-config-data\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.468947 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.468988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhvx\" (UniqueName: \"kubernetes.io/projected/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kube-api-access-wfhvx\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.469030 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kolla-config\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.572658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kolla-config\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.573021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.573065 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-config-data\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.573090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.573162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhvx\" (UniqueName: \"kubernetes.io/projected/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kube-api-access-wfhvx\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.573799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kolla-config\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.574095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-config-data\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.578176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-combined-ca-bundle\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.579763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-memcached-tls-certs\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.589955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhvx\" (UniqueName: \"kubernetes.io/projected/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kube-api-access-wfhvx\") pod \"memcached-0\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.724252 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:00 crc kubenswrapper[4769]: I1121 13:05:00.858143 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:05:00 crc kubenswrapper[4769]: W1121 13:05:00.864655 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93345448_c057_46bc_8671_d56938d5fe7c.slice/crio-a018de458e52764bcb1e8f56159270dda9ef8d490ec9ba52e175c3dacecbd795 WatchSource:0}: Error finding container a018de458e52764bcb1e8f56159270dda9ef8d490ec9ba52e175c3dacecbd795: Status 404 returned error can't find the container with id a018de458e52764bcb1e8f56159270dda9ef8d490ec9ba52e175c3dacecbd795 Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.257761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93345448-c057-46bc-8671-d56938d5fe7c","Type":"ContainerStarted","Data":"e2acabd00eaf5a2f1787efae4711c4f59f02926ecccc2f7b38603d1b4c5b548d"} Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.258057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93345448-c057-46bc-8671-d56938d5fe7c","Type":"ContainerStarted","Data":"a018de458e52764bcb1e8f56159270dda9ef8d490ec9ba52e175c3dacecbd795"} Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.325768 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:05:01 crc kubenswrapper[4769]: W1121 13:05:01.366547 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod250a479c_b739_45d3_b2e6_a1bcae7b6c5e.slice/crio-fe1dbf377aba49990d52738db1cbc7ba379921d655a6721b2e7afc8d9c3197fe WatchSource:0}: Error finding container fe1dbf377aba49990d52738db1cbc7ba379921d655a6721b2e7afc8d9c3197fe: Status 404 returned error can't find the container with id fe1dbf377aba49990d52738db1cbc7ba379921d655a6721b2e7afc8d9c3197fe Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.874310 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.875619 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.877829 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-j4rpd" Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.893035 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.894253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb4jq\" (UniqueName: \"kubernetes.io/projected/8cdee706-08c6-49d7-a7ca-7a96d66d078f-kube-api-access-wb4jq\") pod \"kube-state-metrics-0\" (UID: \"8cdee706-08c6-49d7-a7ca-7a96d66d078f\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:01 crc kubenswrapper[4769]: I1121 13:05:01.996382 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wb4jq\" (UniqueName: \"kubernetes.io/projected/8cdee706-08c6-49d7-a7ca-7a96d66d078f-kube-api-access-wb4jq\") pod \"kube-state-metrics-0\" (UID: \"8cdee706-08c6-49d7-a7ca-7a96d66d078f\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:02 crc kubenswrapper[4769]: I1121 13:05:02.012577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb4jq\" (UniqueName: \"kubernetes.io/projected/8cdee706-08c6-49d7-a7ca-7a96d66d078f-kube-api-access-wb4jq\") pod \"kube-state-metrics-0\" (UID: \"8cdee706-08c6-49d7-a7ca-7a96d66d078f\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:02 crc kubenswrapper[4769]: I1121 13:05:02.193244 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:02 crc kubenswrapper[4769]: I1121 13:05:02.272280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"250a479c-b739-45d3-b2e6-a1bcae7b6c5e","Type":"ContainerStarted","Data":"98139e6a8e29733e902f8cf7d136372fe32d44600bdbc461eee226216f8b9932"} Nov 21 13:05:02 crc kubenswrapper[4769]: I1121 13:05:02.272329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"250a479c-b739-45d3-b2e6-a1bcae7b6c5e","Type":"ContainerStarted","Data":"fe1dbf377aba49990d52738db1cbc7ba379921d655a6721b2e7afc8d9c3197fe"} Nov 21 13:05:02 crc kubenswrapper[4769]: I1121 13:05:02.682815 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.682797609 podStartE2EDuration="2.682797609s" podCreationTimestamp="2025-11-21 13:05:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:02.325414184 +0000 UTC m=+4461.026076002" watchObservedRunningTime="2025-11-21 13:05:02.682797609 +0000 UTC m=+4461.383459447" Nov 21 13:05:02 crc kubenswrapper[4769]: I1121 13:05:02.688855 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:05:02 crc kubenswrapper[4769]: W1121 13:05:02.700353 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cdee706_08c6_49d7_a7ca_7a96d66d078f.slice/crio-92c6c92d9b17fb25ad6c31542e98fee6bb486765695af983393b1963e29c582e WatchSource:0}: Error finding container 92c6c92d9b17fb25ad6c31542e98fee6bb486765695af983393b1963e29c582e: Status 404 returned error can't find the container with id 92c6c92d9b17fb25ad6c31542e98fee6bb486765695af983393b1963e29c582e Nov 21 13:05:03 crc kubenswrapper[4769]: I1121 13:05:03.284341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8cdee706-08c6-49d7-a7ca-7a96d66d078f","Type":"ContainerStarted","Data":"92c6c92d9b17fb25ad6c31542e98fee6bb486765695af983393b1963e29c582e"} Nov 21 13:05:03 crc kubenswrapper[4769]: I1121 13:05:03.284407 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:04 crc kubenswrapper[4769]: I1121 13:05:04.290999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8cdee706-08c6-49d7-a7ca-7a96d66d078f","Type":"ContainerStarted","Data":"aeccfb853b8fe5c2e960a416503d671e9a494ea1be79bdc76eb093ba3cdc8e76"} Nov 21 13:05:04 crc kubenswrapper[4769]: I1121 13:05:04.304985 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.544917704 podStartE2EDuration="3.304965772s" podCreationTimestamp="2025-11-21 13:05:01 +0000 UTC" firstStartedPulling="2025-11-21 13:05:02.7025378 +0000 UTC m=+4461.403199618" lastFinishedPulling="2025-11-21 13:05:03.462585868 +0000 UTC m=+4462.163247686" observedRunningTime="2025-11-21 13:05:04.303628906 +0000 UTC m=+4463.004290724" watchObservedRunningTime="2025-11-21 13:05:04.304965772 +0000 UTC m=+4463.005627590" Nov 21 13:05:05 crc kubenswrapper[4769]: I1121 13:05:05.297280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.041463 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.043454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.045605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.045796 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-pgj9p" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.045882 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.045958 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.045997 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.049497 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.191972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-config\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.192593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c6cw\" (UniqueName: \"kubernetes.io/projected/bec1e4a8-03fa-4c5e-89d3-2c49de338969-kube-api-access-6c6cw\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.274328 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:05:08 crc kubenswrapper[4769]: E1121 13:05:08.274703 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.293877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.293961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6c6cw\" (UniqueName: \"kubernetes.io/projected/bec1e4a8-03fa-4c5e-89d3-2c49de338969-kube-api-access-6c6cw\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294201 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294223 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-config\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.294635 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.295650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.297103 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-config\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.297669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.680180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.680340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c6cw\" (UniqueName: \"kubernetes.io/projected/bec1e4a8-03fa-4c5e-89d3-2c49de338969-kube-api-access-6c6cw\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.680861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.683083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.722877 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.766802 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.768605 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.774519 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.775576 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.776433 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.776510 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.776649 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-cgndj" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903438 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvhd\" (UniqueName: \"kubernetes.io/projected/4952f86e-29ef-4153-b621-577be22af8ee-kube-api-access-bzvhd\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903517 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-config\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903565 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903606 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903681 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4952f86e-29ef-4153-b621-577be22af8ee-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.903749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:08 crc kubenswrapper[4769]: I1121 13:05:08.965412 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.005120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.005918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.006236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4952f86e-29ef-4153-b621-577be22af8ee-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.006505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.006797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvhd\" (UniqueName: \"kubernetes.io/projected/4952f86e-29ef-4153-b621-577be22af8ee-kube-api-access-bzvhd\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.007033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-config\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.007354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.007644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.008268 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.009328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4952f86e-29ef-4153-b621-577be22af8ee-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.007164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.008368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-config\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.010108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.010220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.015111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.029803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvhd\" (UniqueName: \"kubernetes.io/projected/4952f86e-29ef-4153-b621-577be22af8ee-kube-api-access-bzvhd\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.055959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.105178 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.417839 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:05:09 crc kubenswrapper[4769]: I1121 13:05:09.557634 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:05:09 crc kubenswrapper[4769]: W1121 13:05:09.558217 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4952f86e_29ef_4153_b621_577be22af8ee.slice/crio-6679d269ccade2f2de01a388d0df2bd2d99ddad01f7afbb4d812e6abfb3b03e0 WatchSource:0}: Error finding container 6679d269ccade2f2de01a388d0df2bd2d99ddad01f7afbb4d812e6abfb3b03e0: Status 404 returned error can't find the container with id 6679d269ccade2f2de01a388d0df2bd2d99ddad01f7afbb4d812e6abfb3b03e0 Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.349075 4769 generic.go:334] "Generic (PLEG): container finished" podID="6145220b-07ba-4cc8-8d16-392394c634b4" containerID="5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a" exitCode=0 Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.349169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"6145220b-07ba-4cc8-8d16-392394c634b4","Type":"ContainerDied","Data":"5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.352909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"4952f86e-29ef-4153-b621-577be22af8ee","Type":"ContainerStarted","Data":"b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.352979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"4952f86e-29ef-4153-b621-577be22af8ee","Type":"ContainerStarted","Data":"dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.353005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"4952f86e-29ef-4153-b621-577be22af8ee","Type":"ContainerStarted","Data":"6679d269ccade2f2de01a388d0df2bd2d99ddad01f7afbb4d812e6abfb3b03e0"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.355731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"bec1e4a8-03fa-4c5e-89d3-2c49de338969","Type":"ContainerStarted","Data":"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.355970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"bec1e4a8-03fa-4c5e-89d3-2c49de338969","Type":"ContainerStarted","Data":"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.355983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"bec1e4a8-03fa-4c5e-89d3-2c49de338969","Type":"ContainerStarted","Data":"b78fe5e34150e8bbaa8fb47342e0c53b59008d6589f062559b1dbc4293497035"} Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.416439 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.416416518 podStartE2EDuration="3.416416518s" podCreationTimestamp="2025-11-21 13:05:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:10.397699204 +0000 UTC m=+4469.098361032" watchObservedRunningTime="2025-11-21 13:05:10.416416518 +0000 UTC m=+4469.117078336" Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.418143 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.4181348639999998 podStartE2EDuration="3.418134864s" podCreationTimestamp="2025-11-21 13:05:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:10.416215222 +0000 UTC m=+4469.116877030" watchObservedRunningTime="2025-11-21 13:05:10.418134864 +0000 UTC m=+4469.118796682" Nov 21 13:05:10 crc kubenswrapper[4769]: I1121 13:05:10.725995 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:05:11 crc kubenswrapper[4769]: I1121 13:05:11.364482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"6145220b-07ba-4cc8-8d16-392394c634b4","Type":"ContainerStarted","Data":"33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b"} Nov 21 13:05:11 crc kubenswrapper[4769]: I1121 13:05:11.367053 4769 generic.go:334] "Generic (PLEG): container finished" podID="93345448-c057-46bc-8671-d56938d5fe7c" containerID="e2acabd00eaf5a2f1787efae4711c4f59f02926ecccc2f7b38603d1b4c5b548d" exitCode=0 Nov 21 13:05:11 crc kubenswrapper[4769]: I1121 13:05:11.367124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93345448-c057-46bc-8671-d56938d5fe7c","Type":"ContainerDied","Data":"e2acabd00eaf5a2f1787efae4711c4f59f02926ecccc2f7b38603d1b4c5b548d"} Nov 21 13:05:11 crc kubenswrapper[4769]: I1121 13:05:11.399583 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=14.399565523 podStartE2EDuration="14.399565523s" podCreationTimestamp="2025-11-21 13:04:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:11.399509152 +0000 UTC m=+4470.100171020" watchObservedRunningTime="2025-11-21 13:05:11.399565523 +0000 UTC m=+4470.100227341" Nov 21 13:05:11 crc kubenswrapper[4769]: I1121 13:05:11.965922 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:12 crc kubenswrapper[4769]: I1121 13:05:12.105940 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:12 crc kubenswrapper[4769]: I1121 13:05:12.152444 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:12 crc kubenswrapper[4769]: I1121 13:05:12.208850 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:05:12 crc kubenswrapper[4769]: I1121 13:05:12.375661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93345448-c057-46bc-8671-d56938d5fe7c","Type":"ContainerStarted","Data":"49b1ec9e3c0381340351f26dba6772c0e34d3ab6dbbe1b747ac82c529711d4f8"} Nov 21 13:05:12 crc kubenswrapper[4769]: I1121 13:05:12.375902 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:12 crc kubenswrapper[4769]: I1121 13:05:12.398428 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=14.398406831 podStartE2EDuration="14.398406831s" podCreationTimestamp="2025-11-21 13:04:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:12.392869182 +0000 UTC m=+4471.093531010" watchObservedRunningTime="2025-11-21 13:05:12.398406831 +0000 UTC m=+4471.099068649" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.365377 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.376433 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.380675 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.380784 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.380875 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.381927 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-949st" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.385941 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.483962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.484053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.484082 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-cache\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.484133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-lock\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.484223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-857h2\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-kube-api-access-857h2\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.586219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-857h2\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-kube-api-access-857h2\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: E1121 13:05:13.588444 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:05:13 crc kubenswrapper[4769]: E1121 13:05:13.588485 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:05:13 crc kubenswrapper[4769]: E1121 13:05:13.588557 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift podName:7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881 nodeName:}" failed. No retries permitted until 2025-11-21 13:05:14.088535539 +0000 UTC m=+4472.789197357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift") pod "swift-storage-0" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881") : configmap "swift-ring-files" not found Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.588938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.589075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.589432 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.589582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-cache\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.589674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-lock\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.590134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-cache\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.590208 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-lock\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.610709 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-857h2\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-kube-api-access-857h2\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.612561 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.739675 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-lkmwv"] Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.740750 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.743163 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.743802 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.749654 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-lkmwv"] Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.751515 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-combined-ca-bundle\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbpnt\" (UniqueName: \"kubernetes.io/projected/612ef882-152a-4bb0-9abb-93354e9eecf6-kube-api-access-rbpnt\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-swiftconf\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792842 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-dispersionconf\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-ring-data-devices\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-scripts\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.792914 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/612ef882-152a-4bb0-9abb-93354e9eecf6-etc-swift\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.894394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-ring-data-devices\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-scripts\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/612ef882-152a-4bb0-9abb-93354e9eecf6-etc-swift\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-combined-ca-bundle\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rbpnt\" (UniqueName: \"kubernetes.io/projected/612ef882-152a-4bb0-9abb-93354e9eecf6-kube-api-access-rbpnt\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-swiftconf\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-dispersionconf\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-scripts\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-ring-data-devices\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.895407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/612ef882-152a-4bb0-9abb-93354e9eecf6-etc-swift\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.899901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-swiftconf\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.900568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-dispersionconf\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.909297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-combined-ca-bundle\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.927382 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbpnt\" (UniqueName: \"kubernetes.io/projected/612ef882-152a-4bb0-9abb-93354e9eecf6-kube-api-access-rbpnt\") pod \"swift-ring-rebalance-lkmwv\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:13 crc kubenswrapper[4769]: I1121 13:05:13.966298 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:14 crc kubenswrapper[4769]: I1121 13:05:14.059729 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:14 crc kubenswrapper[4769]: I1121 13:05:14.098618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:14 crc kubenswrapper[4769]: E1121 13:05:14.098904 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:05:14 crc kubenswrapper[4769]: E1121 13:05:14.098957 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:05:14 crc kubenswrapper[4769]: E1121 13:05:14.099056 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift podName:7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881 nodeName:}" failed. No retries permitted until 2025-11-21 13:05:15.099025976 +0000 UTC m=+4473.799687794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift") pod "swift-storage-0" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881") : configmap "swift-ring-files" not found Nov 21 13:05:14 crc kubenswrapper[4769]: I1121 13:05:14.146524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:05:14 crc kubenswrapper[4769]: I1121 13:05:14.584805 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-lkmwv"] Nov 21 13:05:14 crc kubenswrapper[4769]: W1121 13:05:14.590545 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod612ef882_152a_4bb0_9abb_93354e9eecf6.slice/crio-a198e99bdc125228346ddbc05d64be1ba565028de98becbbc0db863fc1b604dd WatchSource:0}: Error finding container a198e99bdc125228346ddbc05d64be1ba565028de98becbbc0db863fc1b604dd: Status 404 returned error can't find the container with id a198e99bdc125228346ddbc05d64be1ba565028de98becbbc0db863fc1b604dd Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.008578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.064341 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.117060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:15 crc kubenswrapper[4769]: E1121 13:05:15.117419 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:05:15 crc kubenswrapper[4769]: E1121 13:05:15.117451 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:05:15 crc kubenswrapper[4769]: E1121 13:05:15.117521 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift podName:7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881 nodeName:}" failed. No retries permitted until 2025-11-21 13:05:17.117500253 +0000 UTC m=+4475.818162141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift") pod "swift-storage-0" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881") : configmap "swift-ring-files" not found Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.364508 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.365724 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.369325 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.369571 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-bfttk" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.377387 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.378368 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.380462 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.430552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" event={"ID":"612ef882-152a-4bb0-9abb-93354e9eecf6","Type":"ContainerStarted","Data":"1d5bf3c89845d6b83aaf03360240aa273fade74369502bfe934ff30f9e1dbc9d"} Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.430596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" event={"ID":"612ef882-152a-4bb0-9abb-93354e9eecf6","Type":"ContainerStarted","Data":"a198e99bdc125228346ddbc05d64be1ba565028de98becbbc0db863fc1b604dd"} Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.450846 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" podStartSLOduration=2.450825899 podStartE2EDuration="2.450825899s" podCreationTimestamp="2025-11-21 13:05:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:15.443836541 +0000 UTC m=+4474.144498369" watchObservedRunningTime="2025-11-21 13:05:15.450825899 +0000 UTC m=+4474.151487727" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.523893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.523950 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.524008 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzzz4\" (UniqueName: \"kubernetes.io/projected/6222811e-baf2-451d-ac8f-d1e666f4e514-kube-api-access-pzzz4\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.524042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.524113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-scripts\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.524135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-config\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.524152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.625960 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pzzz4\" (UniqueName: \"kubernetes.io/projected/6222811e-baf2-451d-ac8f-d1e666f4e514-kube-api-access-pzzz4\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.626044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.626112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-scripts\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.626137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-config\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.626153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.626216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.626262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.627863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.628035 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-scripts\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.643390 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-config\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.645244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.645519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.645901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.654387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzzz4\" (UniqueName: \"kubernetes.io/projected/6222811e-baf2-451d-ac8f-d1e666f4e514-kube-api-access-pzzz4\") pod \"ovn-northd-0\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:15 crc kubenswrapper[4769]: I1121 13:05:15.687873 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:16 crc kubenswrapper[4769]: I1121 13:05:16.114758 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:05:16 crc kubenswrapper[4769]: W1121 13:05:16.115354 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6222811e_baf2_451d_ac8f_d1e666f4e514.slice/crio-ba231d0edb8a6fb6963050ea02e3ee135c1057ee55fb62a856cda9ed9312f14e WatchSource:0}: Error finding container ba231d0edb8a6fb6963050ea02e3ee135c1057ee55fb62a856cda9ed9312f14e: Status 404 returned error can't find the container with id ba231d0edb8a6fb6963050ea02e3ee135c1057ee55fb62a856cda9ed9312f14e Nov 21 13:05:16 crc kubenswrapper[4769]: I1121 13:05:16.443314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6222811e-baf2-451d-ac8f-d1e666f4e514","Type":"ContainerStarted","Data":"db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a"} Nov 21 13:05:16 crc kubenswrapper[4769]: I1121 13:05:16.443856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6222811e-baf2-451d-ac8f-d1e666f4e514","Type":"ContainerStarted","Data":"ba231d0edb8a6fb6963050ea02e3ee135c1057ee55fb62a856cda9ed9312f14e"} Nov 21 13:05:17 crc kubenswrapper[4769]: I1121 13:05:17.156279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:17 crc kubenswrapper[4769]: E1121 13:05:17.156513 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:05:17 crc kubenswrapper[4769]: E1121 13:05:17.156544 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:05:17 crc kubenswrapper[4769]: E1121 13:05:17.156601 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift podName:7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881 nodeName:}" failed. No retries permitted until 2025-11-21 13:05:21.156580893 +0000 UTC m=+4479.857242781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift") pod "swift-storage-0" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881") : configmap "swift-ring-files" not found Nov 21 13:05:17 crc kubenswrapper[4769]: I1121 13:05:17.452324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6222811e-baf2-451d-ac8f-d1e666f4e514","Type":"ContainerStarted","Data":"5cc3284e6ba0a8f3c784bd1e20d2ddd32cbcfbdfa8f2a81da74b3c1598e1325e"} Nov 21 13:05:17 crc kubenswrapper[4769]: I1121 13:05:17.452670 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:17 crc kubenswrapper[4769]: I1121 13:05:17.477027 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.476974391 podStartE2EDuration="2.476974391s" podCreationTimestamp="2025-11-21 13:05:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:17.466286303 +0000 UTC m=+4476.166948131" watchObservedRunningTime="2025-11-21 13:05:17.476974391 +0000 UTC m=+4476.177636219" Nov 21 13:05:19 crc kubenswrapper[4769]: I1121 13:05:19.137425 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:05:19 crc kubenswrapper[4769]: I1121 13:05:19.137515 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:05:19 crc kubenswrapper[4769]: I1121 13:05:19.271464 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:05:19 crc kubenswrapper[4769]: I1121 13:05:19.586530 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.280784 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4v45s"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.281755 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.290815 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4v45s"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.309859 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.309945 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.395504 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-1c88-account-create-2mqhl"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.396735 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.398429 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.402666 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-1c88-account-create-2mqhl"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.418271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lplw2\" (UniqueName: \"kubernetes.io/projected/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-kube-api-access-lplw2\") pod \"keystone-db-create-4v45s\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.418390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-operator-scripts\") pod \"keystone-db-create-4v45s\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.423714 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.520319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lplw2\" (UniqueName: \"kubernetes.io/projected/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-kube-api-access-lplw2\") pod \"keystone-db-create-4v45s\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.520401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-operator-scripts\") pod \"keystone-db-create-4v45s\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.520447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f012a00e-b09d-4c32-9308-b225a8d17807-operator-scripts\") pod \"keystone-1c88-account-create-2mqhl\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.520483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x457x\" (UniqueName: \"kubernetes.io/projected/f012a00e-b09d-4c32-9308-b225a8d17807-kube-api-access-x457x\") pod \"keystone-1c88-account-create-2mqhl\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.521296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-operator-scripts\") pod \"keystone-db-create-4v45s\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.548020 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lplw2\" (UniqueName: \"kubernetes.io/projected/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-kube-api-access-lplw2\") pod \"keystone-db-create-4v45s\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.550718 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.591478 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-9vbvz"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.593052 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.615931 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-9vbvz"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.621599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f012a00e-b09d-4c32-9308-b225a8d17807-operator-scripts\") pod \"keystone-1c88-account-create-2mqhl\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.621660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x457x\" (UniqueName: \"kubernetes.io/projected/f012a00e-b09d-4c32-9308-b225a8d17807-kube-api-access-x457x\") pod \"keystone-1c88-account-create-2mqhl\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.623758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f012a00e-b09d-4c32-9308-b225a8d17807-operator-scripts\") pod \"keystone-1c88-account-create-2mqhl\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.665422 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.667640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x457x\" (UniqueName: \"kubernetes.io/projected/f012a00e-b09d-4c32-9308-b225a8d17807-kube-api-access-x457x\") pod \"keystone-1c88-account-create-2mqhl\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.695096 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-1832-account-create-zf699"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.696531 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.701819 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.712224 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-1832-account-create-zf699"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.713670 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.723176 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19a2ebfe-495d-4429-b763-894dcfc7f6c9-operator-scripts\") pod \"placement-db-create-9vbvz\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.723283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x56g\" (UniqueName: \"kubernetes.io/projected/19a2ebfe-495d-4429-b763-894dcfc7f6c9-kube-api-access-8x56g\") pod \"placement-db-create-9vbvz\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.824867 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c92747c-5699-4802-8c1d-afe79205840d-operator-scripts\") pod \"placement-1832-account-create-zf699\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.825059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt65w\" (UniqueName: \"kubernetes.io/projected/3c92747c-5699-4802-8c1d-afe79205840d-kube-api-access-qt65w\") pod \"placement-1832-account-create-zf699\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.825088 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19a2ebfe-495d-4429-b763-894dcfc7f6c9-operator-scripts\") pod \"placement-db-create-9vbvz\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.825113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8x56g\" (UniqueName: \"kubernetes.io/projected/19a2ebfe-495d-4429-b763-894dcfc7f6c9-kube-api-access-8x56g\") pod \"placement-db-create-9vbvz\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.826011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19a2ebfe-495d-4429-b763-894dcfc7f6c9-operator-scripts\") pod \"placement-db-create-9vbvz\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.854879 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-2p5mj"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.856267 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.854886 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x56g\" (UniqueName: \"kubernetes.io/projected/19a2ebfe-495d-4429-b763-894dcfc7f6c9-kube-api-access-8x56g\") pod \"placement-db-create-9vbvz\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.864472 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2p5mj"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.912442 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.926245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c92747c-5699-4802-8c1d-afe79205840d-operator-scripts\") pod \"placement-1832-account-create-zf699\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.926297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-operator-scripts\") pod \"glance-db-create-2p5mj\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.926366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df8jm\" (UniqueName: \"kubernetes.io/projected/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-kube-api-access-df8jm\") pod \"glance-db-create-2p5mj\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.926392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qt65w\" (UniqueName: \"kubernetes.io/projected/3c92747c-5699-4802-8c1d-afe79205840d-kube-api-access-qt65w\") pod \"placement-1832-account-create-zf699\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.927247 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c92747c-5699-4802-8c1d-afe79205840d-operator-scripts\") pod \"placement-1832-account-create-zf699\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.951854 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt65w\" (UniqueName: \"kubernetes.io/projected/3c92747c-5699-4802-8c1d-afe79205840d-kube-api-access-qt65w\") pod \"placement-1832-account-create-zf699\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.998007 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-2383-account-create-sg7tw"] Nov 21 13:05:20 crc kubenswrapper[4769]: I1121 13:05:20.999827 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.003178 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.007969 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2383-account-create-sg7tw"] Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.028568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-df8jm\" (UniqueName: \"kubernetes.io/projected/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-kube-api-access-df8jm\") pod \"glance-db-create-2p5mj\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.028696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-operator-scripts\") pod \"glance-db-create-2p5mj\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.033496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-operator-scripts\") pod \"glance-db-create-2p5mj\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.045801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-df8jm\" (UniqueName: \"kubernetes.io/projected/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-kube-api-access-df8jm\") pod \"glance-db-create-2p5mj\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.120354 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.130464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6693c70-1cb4-40a9-96d3-1935284ae324-operator-scripts\") pod \"glance-2383-account-create-sg7tw\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.130521 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2m8g\" (UniqueName: \"kubernetes.io/projected/a6693c70-1cb4-40a9-96d3-1935284ae324-kube-api-access-w2m8g\") pod \"glance-2383-account-create-sg7tw\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.134690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4v45s"] Nov 21 13:05:21 crc kubenswrapper[4769]: W1121 13:05:21.163491 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda88ab4e8_0911_46cc_b88d_8c9b4870ed31.slice/crio-60a90a13b5ef14c87fae8c733f2397819b8869ca61a8e70089e9c6bff6141d69 WatchSource:0}: Error finding container 60a90a13b5ef14c87fae8c733f2397819b8869ca61a8e70089e9c6bff6141d69: Status 404 returned error can't find the container with id 60a90a13b5ef14c87fae8c733f2397819b8869ca61a8e70089e9c6bff6141d69 Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.177227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.191987 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-1c88-account-create-2mqhl"] Nov 21 13:05:21 crc kubenswrapper[4769]: W1121 13:05:21.202598 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf012a00e_b09d_4c32_9308_b225a8d17807.slice/crio-f64cc0018ff35f1bde0ca51db045017086ab45b25b4897558d52acf43454590c WatchSource:0}: Error finding container f64cc0018ff35f1bde0ca51db045017086ab45b25b4897558d52acf43454590c: Status 404 returned error can't find the container with id f64cc0018ff35f1bde0ca51db045017086ab45b25b4897558d52acf43454590c Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.232519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6693c70-1cb4-40a9-96d3-1935284ae324-operator-scripts\") pod \"glance-2383-account-create-sg7tw\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.232578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2m8g\" (UniqueName: \"kubernetes.io/projected/a6693c70-1cb4-40a9-96d3-1935284ae324-kube-api-access-w2m8g\") pod \"glance-2383-account-create-sg7tw\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.232606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:21 crc kubenswrapper[4769]: E1121 13:05:21.232805 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:05:21 crc kubenswrapper[4769]: E1121 13:05:21.232818 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:05:21 crc kubenswrapper[4769]: E1121 13:05:21.232859 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift podName:7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881 nodeName:}" failed. No retries permitted until 2025-11-21 13:05:29.232844523 +0000 UTC m=+4487.933506341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift") pod "swift-storage-0" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881") : configmap "swift-ring-files" not found Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.233165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6693c70-1cb4-40a9-96d3-1935284ae324-operator-scripts\") pod \"glance-2383-account-create-sg7tw\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.250074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2m8g\" (UniqueName: \"kubernetes.io/projected/a6693c70-1cb4-40a9-96d3-1935284ae324-kube-api-access-w2m8g\") pod \"glance-2383-account-create-sg7tw\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.324671 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.352530 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-9vbvz"] Nov 21 13:05:21 crc kubenswrapper[4769]: W1121 13:05:21.359543 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19a2ebfe_495d_4429_b763_894dcfc7f6c9.slice/crio-efe5efc9289c2a4832dd9944d70d0a14528888d73e3ab4ce5c1ec39cb91a0171 WatchSource:0}: Error finding container efe5efc9289c2a4832dd9944d70d0a14528888d73e3ab4ce5c1ec39cb91a0171: Status 404 returned error can't find the container with id efe5efc9289c2a4832dd9944d70d0a14528888d73e3ab4ce5c1ec39cb91a0171 Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.499362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4v45s" event={"ID":"a88ab4e8-0911-46cc-b88d-8c9b4870ed31","Type":"ContainerStarted","Data":"93378f632b019d9c7e10bfcefe379529c75465a1167d0ebf281da8b3624044e4"} Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.499407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4v45s" event={"ID":"a88ab4e8-0911-46cc-b88d-8c9b4870ed31","Type":"ContainerStarted","Data":"60a90a13b5ef14c87fae8c733f2397819b8869ca61a8e70089e9c6bff6141d69"} Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.504343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" event={"ID":"f012a00e-b09d-4c32-9308-b225a8d17807","Type":"ContainerStarted","Data":"7f5aa071bec205a5807a7c135c63cdb3bb788608a28ba64531eac1d1513154f2"} Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.504386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" event={"ID":"f012a00e-b09d-4c32-9308-b225a8d17807","Type":"ContainerStarted","Data":"f64cc0018ff35f1bde0ca51db045017086ab45b25b4897558d52acf43454590c"} Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.540236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-9vbvz" event={"ID":"19a2ebfe-495d-4429-b763-894dcfc7f6c9","Type":"ContainerStarted","Data":"efe5efc9289c2a4832dd9944d70d0a14528888d73e3ab4ce5c1ec39cb91a0171"} Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.574690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-1832-account-create-zf699"] Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.671616 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2p5mj"] Nov 21 13:05:21 crc kubenswrapper[4769]: W1121 13:05:21.677657 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5690e3ba_c822_4d9a_bb27_6ec578fc3c20.slice/crio-bd2eaacb2a59091658a8ede5cd37fe56b1f1fb00689668379ae70be75f144b82 WatchSource:0}: Error finding container bd2eaacb2a59091658a8ede5cd37fe56b1f1fb00689668379ae70be75f144b82: Status 404 returned error can't find the container with id bd2eaacb2a59091658a8ede5cd37fe56b1f1fb00689668379ae70be75f144b82 Nov 21 13:05:21 crc kubenswrapper[4769]: I1121 13:05:21.807637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-2383-account-create-sg7tw"] Nov 21 13:05:21 crc kubenswrapper[4769]: W1121 13:05:21.809651 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6693c70_1cb4_40a9_96d3_1935284ae324.slice/crio-6ec5c9906033da78876af2810fddf07d0a6a5e079f0c3caf7e454d752151d35c WatchSource:0}: Error finding container 6ec5c9906033da78876af2810fddf07d0a6a5e079f0c3caf7e454d752151d35c: Status 404 returned error can't find the container with id 6ec5c9906033da78876af2810fddf07d0a6a5e079f0c3caf7e454d752151d35c Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.273704 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:05:22 crc kubenswrapper[4769]: E1121 13:05:22.274060 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.559719 4769 generic.go:334] "Generic (PLEG): container finished" podID="a88ab4e8-0911-46cc-b88d-8c9b4870ed31" containerID="93378f632b019d9c7e10bfcefe379529c75465a1167d0ebf281da8b3624044e4" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.559879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4v45s" event={"ID":"a88ab4e8-0911-46cc-b88d-8c9b4870ed31","Type":"ContainerDied","Data":"93378f632b019d9c7e10bfcefe379529c75465a1167d0ebf281da8b3624044e4"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.566802 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c92747c-5699-4802-8c1d-afe79205840d" containerID="9d5e0152b42519827753f8cc93604b2128f655276348458c8ae4584439f28528" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.566913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" event={"ID":"3c92747c-5699-4802-8c1d-afe79205840d","Type":"ContainerDied","Data":"9d5e0152b42519827753f8cc93604b2128f655276348458c8ae4584439f28528"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.567001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" event={"ID":"3c92747c-5699-4802-8c1d-afe79205840d","Type":"ContainerStarted","Data":"a5856dfc2d753772bcfa3d4805823de2302792bcf819bd4e94ae173037e8e5a4"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.568955 4769 generic.go:334] "Generic (PLEG): container finished" podID="5690e3ba-c822-4d9a-bb27-6ec578fc3c20" containerID="d8ba6d2a6dd8ed7dcc45678bd09db2a44e1a5aa13b6ad7304a1220f00bce0698" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.569053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-2p5mj" event={"ID":"5690e3ba-c822-4d9a-bb27-6ec578fc3c20","Type":"ContainerDied","Data":"d8ba6d2a6dd8ed7dcc45678bd09db2a44e1a5aa13b6ad7304a1220f00bce0698"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.569096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-2p5mj" event={"ID":"5690e3ba-c822-4d9a-bb27-6ec578fc3c20","Type":"ContainerStarted","Data":"bd2eaacb2a59091658a8ede5cd37fe56b1f1fb00689668379ae70be75f144b82"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.571967 4769 generic.go:334] "Generic (PLEG): container finished" podID="f012a00e-b09d-4c32-9308-b225a8d17807" containerID="7f5aa071bec205a5807a7c135c63cdb3bb788608a28ba64531eac1d1513154f2" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.572032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" event={"ID":"f012a00e-b09d-4c32-9308-b225a8d17807","Type":"ContainerDied","Data":"7f5aa071bec205a5807a7c135c63cdb3bb788608a28ba64531eac1d1513154f2"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.574125 4769 generic.go:334] "Generic (PLEG): container finished" podID="19a2ebfe-495d-4429-b763-894dcfc7f6c9" containerID="5057923bd9ee853e309f0550164e19b5bf5397f8de264bbf30b905b34e4d78e2" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.574240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-9vbvz" event={"ID":"19a2ebfe-495d-4429-b763-894dcfc7f6c9","Type":"ContainerDied","Data":"5057923bd9ee853e309f0550164e19b5bf5397f8de264bbf30b905b34e4d78e2"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.576490 4769 generic.go:334] "Generic (PLEG): container finished" podID="a6693c70-1cb4-40a9-96d3-1935284ae324" containerID="ac83bc611844805895bb08ac671d85349e2b7aa3ab033f68699e3255af87f04c" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.576579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" event={"ID":"a6693c70-1cb4-40a9-96d3-1935284ae324","Type":"ContainerDied","Data":"ac83bc611844805895bb08ac671d85349e2b7aa3ab033f68699e3255af87f04c"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.576614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" event={"ID":"a6693c70-1cb4-40a9-96d3-1935284ae324","Type":"ContainerStarted","Data":"6ec5c9906033da78876af2810fddf07d0a6a5e079f0c3caf7e454d752151d35c"} Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.578562 4769 generic.go:334] "Generic (PLEG): container finished" podID="612ef882-152a-4bb0-9abb-93354e9eecf6" containerID="1d5bf3c89845d6b83aaf03360240aa273fade74369502bfe934ff30f9e1dbc9d" exitCode=0 Nov 21 13:05:22 crc kubenswrapper[4769]: I1121 13:05:22.578627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" event={"ID":"612ef882-152a-4bb0-9abb-93354e9eecf6","Type":"ContainerDied","Data":"1d5bf3c89845d6b83aaf03360240aa273fade74369502bfe934ff30f9e1dbc9d"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.094398 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-swiftconf\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196234 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-ring-data-devices\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-combined-ca-bundle\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbpnt\" (UniqueName: \"kubernetes.io/projected/612ef882-152a-4bb0-9abb-93354e9eecf6-kube-api-access-rbpnt\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-scripts\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/612ef882-152a-4bb0-9abb-93354e9eecf6-etc-swift\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.196478 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-dispersionconf\") pod \"612ef882-152a-4bb0-9abb-93354e9eecf6\" (UID: \"612ef882-152a-4bb0-9abb-93354e9eecf6\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.197074 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.197844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612ef882-152a-4bb0-9abb-93354e9eecf6-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.201850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612ef882-152a-4bb0-9abb-93354e9eecf6-kube-api-access-rbpnt" (OuterVolumeSpecName: "kube-api-access-rbpnt") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "kube-api-access-rbpnt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.209442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.224319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.226456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-scripts" (OuterVolumeSpecName: "scripts") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.229295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "612ef882-152a-4bb0-9abb-93354e9eecf6" (UID: "612ef882-152a-4bb0-9abb-93354e9eecf6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298086 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298116 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298126 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rbpnt\" (UniqueName: \"kubernetes.io/projected/612ef882-152a-4bb0-9abb-93354e9eecf6-kube-api-access-rbpnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298138 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/612ef882-152a-4bb0-9abb-93354e9eecf6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298146 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/612ef882-152a-4bb0-9abb-93354e9eecf6-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298153 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.298162 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/612ef882-152a-4bb0-9abb-93354e9eecf6-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.311266 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.320076 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.336446 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.352761 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.366424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.369888 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-operator-scripts\") pod \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-operator-scripts\") pod \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c92747c-5699-4802-8c1d-afe79205840d-operator-scripts\") pod \"3c92747c-5699-4802-8c1d-afe79205840d\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x457x\" (UniqueName: \"kubernetes.io/projected/f012a00e-b09d-4c32-9308-b225a8d17807-kube-api-access-x457x\") pod \"f012a00e-b09d-4c32-9308-b225a8d17807\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400607 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f012a00e-b09d-4c32-9308-b225a8d17807-operator-scripts\") pod \"f012a00e-b09d-4c32-9308-b225a8d17807\" (UID: \"f012a00e-b09d-4c32-9308-b225a8d17807\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2m8g\" (UniqueName: \"kubernetes.io/projected/a6693c70-1cb4-40a9-96d3-1935284ae324-kube-api-access-w2m8g\") pod \"a6693c70-1cb4-40a9-96d3-1935284ae324\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x56g\" (UniqueName: \"kubernetes.io/projected/19a2ebfe-495d-4429-b763-894dcfc7f6c9-kube-api-access-8x56g\") pod \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19a2ebfe-495d-4429-b763-894dcfc7f6c9-operator-scripts\") pod \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\" (UID: \"19a2ebfe-495d-4429-b763-894dcfc7f6c9\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df8jm\" (UniqueName: \"kubernetes.io/projected/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-kube-api-access-df8jm\") pod \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\" (UID: \"5690e3ba-c822-4d9a-bb27-6ec578fc3c20\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt65w\" (UniqueName: \"kubernetes.io/projected/3c92747c-5699-4802-8c1d-afe79205840d-kube-api-access-qt65w\") pod \"3c92747c-5699-4802-8c1d-afe79205840d\" (UID: \"3c92747c-5699-4802-8c1d-afe79205840d\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6693c70-1cb4-40a9-96d3-1935284ae324-operator-scripts\") pod \"a6693c70-1cb4-40a9-96d3-1935284ae324\" (UID: \"a6693c70-1cb4-40a9-96d3-1935284ae324\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.400859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lplw2\" (UniqueName: \"kubernetes.io/projected/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-kube-api-access-lplw2\") pod \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\" (UID: \"a88ab4e8-0911-46cc-b88d-8c9b4870ed31\") " Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.401006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a88ab4e8-0911-46cc-b88d-8c9b4870ed31" (UID: "a88ab4e8-0911-46cc-b88d-8c9b4870ed31"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.401739 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.402640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a2ebfe-495d-4429-b763-894dcfc7f6c9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "19a2ebfe-495d-4429-b763-894dcfc7f6c9" (UID: "19a2ebfe-495d-4429-b763-894dcfc7f6c9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.402671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f012a00e-b09d-4c32-9308-b225a8d17807-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f012a00e-b09d-4c32-9308-b225a8d17807" (UID: "f012a00e-b09d-4c32-9308-b225a8d17807"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.402703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c92747c-5699-4802-8c1d-afe79205840d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3c92747c-5699-4802-8c1d-afe79205840d" (UID: "3c92747c-5699-4802-8c1d-afe79205840d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.403028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6693c70-1cb4-40a9-96d3-1935284ae324-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a6693c70-1cb4-40a9-96d3-1935284ae324" (UID: "a6693c70-1cb4-40a9-96d3-1935284ae324"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.403212 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5690e3ba-c822-4d9a-bb27-6ec578fc3c20" (UID: "5690e3ba-c822-4d9a-bb27-6ec578fc3c20"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.404744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6693c70-1cb4-40a9-96d3-1935284ae324-kube-api-access-w2m8g" (OuterVolumeSpecName: "kube-api-access-w2m8g") pod "a6693c70-1cb4-40a9-96d3-1935284ae324" (UID: "a6693c70-1cb4-40a9-96d3-1935284ae324"). InnerVolumeSpecName "kube-api-access-w2m8g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.405463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c92747c-5699-4802-8c1d-afe79205840d-kube-api-access-qt65w" (OuterVolumeSpecName: "kube-api-access-qt65w") pod "3c92747c-5699-4802-8c1d-afe79205840d" (UID: "3c92747c-5699-4802-8c1d-afe79205840d"). InnerVolumeSpecName "kube-api-access-qt65w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.405778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f012a00e-b09d-4c32-9308-b225a8d17807-kube-api-access-x457x" (OuterVolumeSpecName: "kube-api-access-x457x") pod "f012a00e-b09d-4c32-9308-b225a8d17807" (UID: "f012a00e-b09d-4c32-9308-b225a8d17807"). InnerVolumeSpecName "kube-api-access-x457x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.405993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-kube-api-access-df8jm" (OuterVolumeSpecName: "kube-api-access-df8jm") pod "5690e3ba-c822-4d9a-bb27-6ec578fc3c20" (UID: "5690e3ba-c822-4d9a-bb27-6ec578fc3c20"). InnerVolumeSpecName "kube-api-access-df8jm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.406432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a2ebfe-495d-4429-b763-894dcfc7f6c9-kube-api-access-8x56g" (OuterVolumeSpecName: "kube-api-access-8x56g") pod "19a2ebfe-495d-4429-b763-894dcfc7f6c9" (UID: "19a2ebfe-495d-4429-b763-894dcfc7f6c9"). InnerVolumeSpecName "kube-api-access-8x56g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.408052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-kube-api-access-lplw2" (OuterVolumeSpecName: "kube-api-access-lplw2") pod "a88ab4e8-0911-46cc-b88d-8c9b4870ed31" (UID: "a88ab4e8-0911-46cc-b88d-8c9b4870ed31"). InnerVolumeSpecName "kube-api-access-lplw2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503735 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503774 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c92747c-5699-4802-8c1d-afe79205840d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503785 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x457x\" (UniqueName: \"kubernetes.io/projected/f012a00e-b09d-4c32-9308-b225a8d17807-kube-api-access-x457x\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503795 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f012a00e-b09d-4c32-9308-b225a8d17807-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503804 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w2m8g\" (UniqueName: \"kubernetes.io/projected/a6693c70-1cb4-40a9-96d3-1935284ae324-kube-api-access-w2m8g\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503815 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/19a2ebfe-495d-4429-b763-894dcfc7f6c9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503823 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8x56g\" (UniqueName: \"kubernetes.io/projected/19a2ebfe-495d-4429-b763-894dcfc7f6c9-kube-api-access-8x56g\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503832 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-df8jm\" (UniqueName: \"kubernetes.io/projected/5690e3ba-c822-4d9a-bb27-6ec578fc3c20-kube-api-access-df8jm\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503840 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qt65w\" (UniqueName: \"kubernetes.io/projected/3c92747c-5699-4802-8c1d-afe79205840d-kube-api-access-qt65w\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503849 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a6693c70-1cb4-40a9-96d3-1935284ae324-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.503857 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lplw2\" (UniqueName: \"kubernetes.io/projected/a88ab4e8-0911-46cc-b88d-8c9b4870ed31-kube-api-access-lplw2\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.608376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" event={"ID":"612ef882-152a-4bb0-9abb-93354e9eecf6","Type":"ContainerDied","Data":"a198e99bdc125228346ddbc05d64be1ba565028de98becbbc0db863fc1b604dd"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.608450 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a198e99bdc125228346ddbc05d64be1ba565028de98becbbc0db863fc1b604dd" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.608463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-lkmwv" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.611293 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4v45s" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.611295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4v45s" event={"ID":"a88ab4e8-0911-46cc-b88d-8c9b4870ed31","Type":"ContainerDied","Data":"60a90a13b5ef14c87fae8c733f2397819b8869ca61a8e70089e9c6bff6141d69"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.611603 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60a90a13b5ef14c87fae8c733f2397819b8869ca61a8e70089e9c6bff6141d69" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.614838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" event={"ID":"3c92747c-5699-4802-8c1d-afe79205840d","Type":"ContainerDied","Data":"a5856dfc2d753772bcfa3d4805823de2302792bcf819bd4e94ae173037e8e5a4"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.614862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-1832-account-create-zf699" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.614897 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5856dfc2d753772bcfa3d4805823de2302792bcf819bd4e94ae173037e8e5a4" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.618020 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-2p5mj" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.618010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-2p5mj" event={"ID":"5690e3ba-c822-4d9a-bb27-6ec578fc3c20","Type":"ContainerDied","Data":"bd2eaacb2a59091658a8ede5cd37fe56b1f1fb00689668379ae70be75f144b82"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.618089 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd2eaacb2a59091658a8ede5cd37fe56b1f1fb00689668379ae70be75f144b82" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.620960 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.620976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1c88-account-create-2mqhl" event={"ID":"f012a00e-b09d-4c32-9308-b225a8d17807","Type":"ContainerDied","Data":"f64cc0018ff35f1bde0ca51db045017086ab45b25b4897558d52acf43454590c"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.621148 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f64cc0018ff35f1bde0ca51db045017086ab45b25b4897558d52acf43454590c" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.624547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-9vbvz" event={"ID":"19a2ebfe-495d-4429-b763-894dcfc7f6c9","Type":"ContainerDied","Data":"efe5efc9289c2a4832dd9944d70d0a14528888d73e3ab4ce5c1ec39cb91a0171"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.624620 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efe5efc9289c2a4832dd9944d70d0a14528888d73e3ab4ce5c1ec39cb91a0171" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.624559 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-9vbvz" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.627770 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" event={"ID":"a6693c70-1cb4-40a9-96d3-1935284ae324","Type":"ContainerDied","Data":"6ec5c9906033da78876af2810fddf07d0a6a5e079f0c3caf7e454d752151d35c"} Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.627826 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ec5c9906033da78876af2810fddf07d0a6a5e079f0c3caf7e454d752151d35c" Nov 21 13:05:24 crc kubenswrapper[4769]: I1121 13:05:24.627857 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-2383-account-create-sg7tw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215049 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75vgw"] Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215761 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a6693c70-1cb4-40a9-96d3-1935284ae324" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215776 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6693c70-1cb4-40a9-96d3-1935284ae324" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215798 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="612ef882-152a-4bb0-9abb-93354e9eecf6" containerName="swift-ring-rebalance" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215805 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="612ef882-152a-4bb0-9abb-93354e9eecf6" containerName="swift-ring-rebalance" Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215816 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5690e3ba-c822-4d9a-bb27-6ec578fc3c20" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215822 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5690e3ba-c822-4d9a-bb27-6ec578fc3c20" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215845 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f012a00e-b09d-4c32-9308-b225a8d17807" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215851 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f012a00e-b09d-4c32-9308-b225a8d17807" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215859 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19a2ebfe-495d-4429-b763-894dcfc7f6c9" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215866 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a2ebfe-495d-4429-b763-894dcfc7f6c9" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215878 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c92747c-5699-4802-8c1d-afe79205840d" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215884 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c92747c-5699-4802-8c1d-afe79205840d" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: E1121 13:05:26.215897 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a88ab4e8-0911-46cc-b88d-8c9b4870ed31" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.215903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a88ab4e8-0911-46cc-b88d-8c9b4870ed31" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216059 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a88ab4e8-0911-46cc-b88d-8c9b4870ed31" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216074 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c92747c-5699-4802-8c1d-afe79205840d" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216098 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="19a2ebfe-495d-4429-b763-894dcfc7f6c9" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216107 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5690e3ba-c822-4d9a-bb27-6ec578fc3c20" containerName="mariadb-database-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216121 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f012a00e-b09d-4c32-9308-b225a8d17807" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216132 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a6693c70-1cb4-40a9-96d3-1935284ae324" containerName="mariadb-account-create" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216144 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="612ef882-152a-4bb0-9abb-93354e9eecf6" containerName="swift-ring-rebalance" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.216923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.219304 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.219381 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-x7k8k" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.227961 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75vgw"] Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.334277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-config-data\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.334683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-db-sync-config-data\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.334792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-combined-ca-bundle\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.334851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt87k\" (UniqueName: \"kubernetes.io/projected/3906bc17-ab23-4a75-8272-0404c19616ec-kube-api-access-tt87k\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.436299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-config-data\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.436459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-db-sync-config-data\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.436526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-combined-ca-bundle\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.436569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tt87k\" (UniqueName: \"kubernetes.io/projected/3906bc17-ab23-4a75-8272-0404c19616ec-kube-api-access-tt87k\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.444894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-db-sync-config-data\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.449376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-combined-ca-bundle\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.449883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-config-data\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.460805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt87k\" (UniqueName: \"kubernetes.io/projected/3906bc17-ab23-4a75-8272-0404c19616ec-kube-api-access-tt87k\") pod \"glance-db-sync-75vgw\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:26 crc kubenswrapper[4769]: I1121 13:05:26.544039 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:27 crc kubenswrapper[4769]: I1121 13:05:27.057821 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75vgw"] Nov 21 13:05:27 crc kubenswrapper[4769]: W1121 13:05:27.058239 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3906bc17_ab23_4a75_8272_0404c19616ec.slice/crio-120a8f8adb356a9c1ba5dcc30a2f003040f86ba6a1422dba9e52a5be0f9b87da WatchSource:0}: Error finding container 120a8f8adb356a9c1ba5dcc30a2f003040f86ba6a1422dba9e52a5be0f9b87da: Status 404 returned error can't find the container with id 120a8f8adb356a9c1ba5dcc30a2f003040f86ba6a1422dba9e52a5be0f9b87da Nov 21 13:05:27 crc kubenswrapper[4769]: I1121 13:05:27.659156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75vgw" event={"ID":"3906bc17-ab23-4a75-8272-0404c19616ec","Type":"ContainerStarted","Data":"120a8f8adb356a9c1ba5dcc30a2f003040f86ba6a1422dba9e52a5be0f9b87da"} Nov 21 13:05:28 crc kubenswrapper[4769]: I1121 13:05:28.688631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75vgw" event={"ID":"3906bc17-ab23-4a75-8272-0404c19616ec","Type":"ContainerStarted","Data":"b78b8fd0295425f6ca1365ceb094c05bdf1f41c1a1412bcab48e93d6f50625b9"} Nov 21 13:05:28 crc kubenswrapper[4769]: I1121 13:05:28.719326 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-75vgw" podStartSLOduration=2.719290586 podStartE2EDuration="2.719290586s" podCreationTimestamp="2025-11-21 13:05:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:28.717891888 +0000 UTC m=+4487.418553736" watchObservedRunningTime="2025-11-21 13:05:28.719290586 +0000 UTC m=+4487.419952414" Nov 21 13:05:29 crc kubenswrapper[4769]: I1121 13:05:29.293538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:29 crc kubenswrapper[4769]: I1121 13:05:29.300836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"swift-storage-0\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:29 crc kubenswrapper[4769]: I1121 13:05:29.599324 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:05:30 crc kubenswrapper[4769]: I1121 13:05:30.233386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:05:30 crc kubenswrapper[4769]: I1121 13:05:30.710297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0"} Nov 21 13:05:30 crc kubenswrapper[4769]: I1121 13:05:30.710347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"90aad20e65322c46bf1536bb3ea244951cbd0ac88923e4b1f836518fd4fb857e"} Nov 21 13:05:30 crc kubenswrapper[4769]: I1121 13:05:30.766080 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.724540 4769 generic.go:334] "Generic (PLEG): container finished" podID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerID="818bae63b54b75b9d153ca690e3037b23b533cf1c060f6ad7f600755e4c4b69d" exitCode=0 Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.724654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a","Type":"ContainerDied","Data":"818bae63b54b75b9d153ca690e3037b23b533cf1c060f6ad7f600755e4c4b69d"} Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.735894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5"} Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.735956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5"} Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.735979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb"} Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.739604 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerID="d4d4b9d9b6b372178b453dedb9cc896b7d516d5d20376643b3cbc00f070c99ca" exitCode=0 Nov 21 13:05:31 crc kubenswrapper[4769]: I1121 13:05:31.739676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d9bcbff3-ef6f-466b-81ad-7aa2093adbed","Type":"ContainerDied","Data":"d4d4b9d9b6b372178b453dedb9cc896b7d516d5d20376643b3cbc00f070c99ca"} Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.763795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00"} Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.764170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75"} Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.766073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d9bcbff3-ef6f-466b-81ad-7aa2093adbed","Type":"ContainerStarted","Data":"5d26239474a3e16cffea4e7314aafddd0ff19c871879a7013a25f4969633a000"} Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.766312 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.771891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a","Type":"ContainerStarted","Data":"f2e9d93c5241ce1a455f474ad9b632082ce2e117c0bcf9d7d95727dd36b98d63"} Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.772105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.792815 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.792794242 podStartE2EDuration="37.792794242s" podCreationTimestamp="2025-11-21 13:04:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:32.786502602 +0000 UTC m=+4491.487164420" watchObservedRunningTime="2025-11-21 13:05:32.792794242 +0000 UTC m=+4491.493456060" Nov 21 13:05:32 crc kubenswrapper[4769]: I1121 13:05:32.815810 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.815786601 podStartE2EDuration="37.815786601s" podCreationTimestamp="2025-11-21 13:04:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:32.811390453 +0000 UTC m=+4491.512052281" watchObservedRunningTime="2025-11-21 13:05:32.815786601 +0000 UTC m=+4491.516448419" Nov 21 13:05:33 crc kubenswrapper[4769]: I1121 13:05:33.802642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6"} Nov 21 13:05:33 crc kubenswrapper[4769]: I1121 13:05:33.803996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b"} Nov 21 13:05:33 crc kubenswrapper[4769]: I1121 13:05:33.804088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e"} Nov 21 13:05:33 crc kubenswrapper[4769]: I1121 13:05:33.804174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1"} Nov 21 13:05:34 crc kubenswrapper[4769]: I1121 13:05:34.815824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45"} Nov 21 13:05:34 crc kubenswrapper[4769]: I1121 13:05:34.816466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461"} Nov 21 13:05:34 crc kubenswrapper[4769]: I1121 13:05:34.816485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10"} Nov 21 13:05:34 crc kubenswrapper[4769]: I1121 13:05:34.816497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81"} Nov 21 13:05:34 crc kubenswrapper[4769]: I1121 13:05:34.816508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerStarted","Data":"f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401"} Nov 21 13:05:34 crc kubenswrapper[4769]: I1121 13:05:34.856814 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=22.856795373 podStartE2EDuration="22.856795373s" podCreationTimestamp="2025-11-21 13:05:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:34.847017719 +0000 UTC m=+4493.547679537" watchObservedRunningTime="2025-11-21 13:05:34.856795373 +0000 UTC m=+4493.557457191" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.021250 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5"] Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.022672 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.028670 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.034979 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5"] Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.186237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.186308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjz2h\" (UniqueName: \"kubernetes.io/projected/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-kube-api-access-pjz2h\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.186398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-config\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.186448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.287771 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.287830 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pjz2h\" (UniqueName: \"kubernetes.io/projected/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-kube-api-access-pjz2h\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.287901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-config\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.287938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.288738 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.288952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.289206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-config\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.312133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjz2h\" (UniqueName: \"kubernetes.io/projected/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-kube-api-access-pjz2h\") pod \"dnsmasq-dnsmasq-74bb965b7c-f6fg5\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.351013 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:35 crc kubenswrapper[4769]: I1121 13:05:35.841156 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5"] Nov 21 13:05:36 crc kubenswrapper[4769]: I1121 13:05:36.853613 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerID="406e35566d065b822f0e62b3641e02958ff64fd9f7e30e125653368b62346762" exitCode=0 Nov 21 13:05:36 crc kubenswrapper[4769]: I1121 13:05:36.853695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" event={"ID":"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce","Type":"ContainerDied","Data":"406e35566d065b822f0e62b3641e02958ff64fd9f7e30e125653368b62346762"} Nov 21 13:05:36 crc kubenswrapper[4769]: I1121 13:05:36.854337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" event={"ID":"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce","Type":"ContainerStarted","Data":"b8094a0044d3fbbafe530f48515f9d119dd2bb0b815817ee1324b010e6d9e625"} Nov 21 13:05:37 crc kubenswrapper[4769]: I1121 13:05:37.274583 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:05:37 crc kubenswrapper[4769]: E1121 13:05:37.274955 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:05:37 crc kubenswrapper[4769]: I1121 13:05:37.865998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" event={"ID":"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce","Type":"ContainerStarted","Data":"4611b8e31f314c4f66d31e042a0171cd4db8c5b5d20f84c9f6e9a794c7383ed9"} Nov 21 13:05:37 crc kubenswrapper[4769]: I1121 13:05:37.868027 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:37 crc kubenswrapper[4769]: I1121 13:05:37.895084 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" podStartSLOduration=3.89506505 podStartE2EDuration="3.89506505s" podCreationTimestamp="2025-11-21 13:05:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:37.890306712 +0000 UTC m=+4496.590968540" watchObservedRunningTime="2025-11-21 13:05:37.89506505 +0000 UTC m=+4496.595726868" Nov 21 13:05:40 crc kubenswrapper[4769]: I1121 13:05:40.737923 4769 scope.go:117] "RemoveContainer" containerID="63376b49d4b416472eee3c331b92f4c2fd2007cda9f997730c9cf82e90686d98" Nov 21 13:05:40 crc kubenswrapper[4769]: I1121 13:05:40.793358 4769 scope.go:117] "RemoveContainer" containerID="ac277d823e5036f3c3037adc91d3611b2299b9c848721ae01066eacd436baeb2" Nov 21 13:05:40 crc kubenswrapper[4769]: I1121 13:05:40.827670 4769 scope.go:117] "RemoveContainer" containerID="1e354112d0c49340b8976062f563e0f86b3710f5c63746af8f9e5f541fbd1149" Nov 21 13:05:40 crc kubenswrapper[4769]: I1121 13:05:40.867736 4769 scope.go:117] "RemoveContainer" containerID="9e3ef90f84d9f9dfeca8d5caac2d6ca840a8002a6abc730d5e882c57a0035f93" Nov 21 13:05:43 crc kubenswrapper[4769]: I1121 13:05:43.936365 4769 generic.go:334] "Generic (PLEG): container finished" podID="3906bc17-ab23-4a75-8272-0404c19616ec" containerID="b78b8fd0295425f6ca1365ceb094c05bdf1f41c1a1412bcab48e93d6f50625b9" exitCode=0 Nov 21 13:05:43 crc kubenswrapper[4769]: I1121 13:05:43.936421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75vgw" event={"ID":"3906bc17-ab23-4a75-8272-0404c19616ec","Type":"ContainerDied","Data":"b78b8fd0295425f6ca1365ceb094c05bdf1f41c1a1412bcab48e93d6f50625b9"} Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.286838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.352395 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.353647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-config-data\") pod \"3906bc17-ab23-4a75-8272-0404c19616ec\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.353827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-combined-ca-bundle\") pod \"3906bc17-ab23-4a75-8272-0404c19616ec\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.353888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-db-sync-config-data\") pod \"3906bc17-ab23-4a75-8272-0404c19616ec\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.353990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt87k\" (UniqueName: \"kubernetes.io/projected/3906bc17-ab23-4a75-8272-0404c19616ec-kube-api-access-tt87k\") pod \"3906bc17-ab23-4a75-8272-0404c19616ec\" (UID: \"3906bc17-ab23-4a75-8272-0404c19616ec\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.361387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "3906bc17-ab23-4a75-8272-0404c19616ec" (UID: "3906bc17-ab23-4a75-8272-0404c19616ec"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.361491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3906bc17-ab23-4a75-8272-0404c19616ec-kube-api-access-tt87k" (OuterVolumeSpecName: "kube-api-access-tt87k") pod "3906bc17-ab23-4a75-8272-0404c19616ec" (UID: "3906bc17-ab23-4a75-8272-0404c19616ec"). InnerVolumeSpecName "kube-api-access-tt87k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.393508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3906bc17-ab23-4a75-8272-0404c19616ec" (UID: "3906bc17-ab23-4a75-8272-0404c19616ec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.439440 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5"] Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.439666 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerName="dnsmasq-dns" containerID="cri-o://9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340" gracePeriod=10 Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.457763 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-config-data" (OuterVolumeSpecName: "config-data") pod "3906bc17-ab23-4a75-8272-0404c19616ec" (UID: "3906bc17-ab23-4a75-8272-0404c19616ec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.459850 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.459881 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.459897 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tt87k\" (UniqueName: \"kubernetes.io/projected/3906bc17-ab23-4a75-8272-0404c19616ec-kube-api-access-tt87k\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.459912 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3906bc17-ab23-4a75-8272-0404c19616ec-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.818040 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.868439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmqfg\" (UniqueName: \"kubernetes.io/projected/d5127b7f-d74b-4bc4-a513-ad82dc118d18-kube-api-access-mmqfg\") pod \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.868584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-config\") pod \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.868688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-dnsmasq-svc\") pod \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\" (UID: \"d5127b7f-d74b-4bc4-a513-ad82dc118d18\") " Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.874861 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5127b7f-d74b-4bc4-a513-ad82dc118d18-kube-api-access-mmqfg" (OuterVolumeSpecName: "kube-api-access-mmqfg") pod "d5127b7f-d74b-4bc4-a513-ad82dc118d18" (UID: "d5127b7f-d74b-4bc4-a513-ad82dc118d18"). InnerVolumeSpecName "kube-api-access-mmqfg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.923398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "d5127b7f-d74b-4bc4-a513-ad82dc118d18" (UID: "d5127b7f-d74b-4bc4-a513-ad82dc118d18"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.923443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-config" (OuterVolumeSpecName: "config") pod "d5127b7f-d74b-4bc4-a513-ad82dc118d18" (UID: "d5127b7f-d74b-4bc4-a513-ad82dc118d18"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.954953 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-75vgw" event={"ID":"3906bc17-ab23-4a75-8272-0404c19616ec","Type":"ContainerDied","Data":"120a8f8adb356a9c1ba5dcc30a2f003040f86ba6a1422dba9e52a5be0f9b87da"} Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.955004 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="120a8f8adb356a9c1ba5dcc30a2f003040f86ba6a1422dba9e52a5be0f9b87da" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.955024 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-75vgw" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.957559 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerID="9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340" exitCode=0 Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.957594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" event={"ID":"d5127b7f-d74b-4bc4-a513-ad82dc118d18","Type":"ContainerDied","Data":"9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340"} Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.957620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" event={"ID":"d5127b7f-d74b-4bc4-a513-ad82dc118d18","Type":"ContainerDied","Data":"baa1d05fa73a1db32dcef145d4e5120b18b7af148b073e411c7117f1fb97fc77"} Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.957637 4769 scope.go:117] "RemoveContainer" containerID="9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.957650 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.970821 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.970855 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d5127b7f-d74b-4bc4-a513-ad82dc118d18-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:45 crc kubenswrapper[4769]: I1121 13:05:45.970870 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mmqfg\" (UniqueName: \"kubernetes.io/projected/d5127b7f-d74b-4bc4-a513-ad82dc118d18-kube-api-access-mmqfg\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.012876 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5"] Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.013120 4769 scope.go:117] "RemoveContainer" containerID="c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4" Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.018803 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-lbxt5"] Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.038313 4769 scope.go:117] "RemoveContainer" containerID="9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340" Nov 21 13:05:46 crc kubenswrapper[4769]: E1121 13:05:46.038953 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340\": container with ID starting with 9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340 not found: ID does not exist" containerID="9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340" Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.038989 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340"} err="failed to get container status \"9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340\": rpc error: code = NotFound desc = could not find container \"9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340\": container with ID starting with 9c38134cf55c5bcd0d9cbd8eb7c0990422b04a922d16aadcf865ddd6187b4340 not found: ID does not exist" Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.039015 4769 scope.go:117] "RemoveContainer" containerID="c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4" Nov 21 13:05:46 crc kubenswrapper[4769]: E1121 13:05:46.039488 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4\": container with ID starting with c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4 not found: ID does not exist" containerID="c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4" Nov 21 13:05:46 crc kubenswrapper[4769]: I1121 13:05:46.039530 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4"} err="failed to get container status \"c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4\": rpc error: code = NotFound desc = could not find container \"c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4\": container with ID starting with c84fa339fb4c2424eeaf7339b9acf7d174b0df41917ab7d69290cc057b7054e4 not found: ID does not exist" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.013485 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.283242 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" path="/var/lib/kubelet/pods/d5127b7f-d74b-4bc4-a513-ad82dc118d18/volumes" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.366287 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bbfjf"] Nov 21 13:05:47 crc kubenswrapper[4769]: E1121 13:05:47.366685 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerName="init" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.366703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerName="init" Nov 21 13:05:47 crc kubenswrapper[4769]: E1121 13:05:47.366720 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerName="dnsmasq-dns" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.366727 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerName="dnsmasq-dns" Nov 21 13:05:47 crc kubenswrapper[4769]: E1121 13:05:47.366759 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3906bc17-ab23-4a75-8272-0404c19616ec" containerName="glance-db-sync" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.366767 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3906bc17-ab23-4a75-8272-0404c19616ec" containerName="glance-db-sync" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.366976 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5127b7f-d74b-4bc4-a513-ad82dc118d18" containerName="dnsmasq-dns" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.367002 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3906bc17-ab23-4a75-8272-0404c19616ec" containerName="glance-db-sync" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.367694 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.375473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bbfjf"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.387427 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-ff83-account-create-pjrnr"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.388761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.393097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d7a4145-54f2-4346-9f48-f678f702a24e-operator-scripts\") pod \"cinder-db-create-bbfjf\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.393227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tc8p\" (UniqueName: \"kubernetes.io/projected/6d7a4145-54f2-4346-9f48-f678f702a24e-kube-api-access-5tc8p\") pod \"cinder-db-create-bbfjf\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.394037 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.402353 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-ff83-account-create-pjrnr"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.475322 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-lshv4"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.476351 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.493874 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.494170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-operator-scripts\") pod \"cinder-ff83-account-create-pjrnr\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.494282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8tf\" (UniqueName: \"kubernetes.io/projected/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-kube-api-access-rr8tf\") pod \"cinder-ff83-account-create-pjrnr\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.494331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52c123b-e469-4987-836c-bd30d57e71bc-operator-scripts\") pod \"neutron-db-create-lshv4\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.494400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d7a4145-54f2-4346-9f48-f678f702a24e-operator-scripts\") pod \"cinder-db-create-bbfjf\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.494444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7phl\" (UniqueName: \"kubernetes.io/projected/a52c123b-e469-4987-836c-bd30d57e71bc-kube-api-access-d7phl\") pod \"neutron-db-create-lshv4\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.494512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5tc8p\" (UniqueName: \"kubernetes.io/projected/6d7a4145-54f2-4346-9f48-f678f702a24e-kube-api-access-5tc8p\") pod \"cinder-db-create-bbfjf\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.495134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d7a4145-54f2-4346-9f48-f678f702a24e-operator-scripts\") pod \"cinder-db-create-bbfjf\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.495695 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.498303 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.505949 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-lshv4"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.516943 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.540294 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tc8p\" (UniqueName: \"kubernetes.io/projected/6d7a4145-54f2-4346-9f48-f678f702a24e-kube-api-access-5tc8p\") pod \"cinder-db-create-bbfjf\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.574875 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.586335 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7wtrh"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.588380 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.601752 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px7fw\" (UniqueName: \"kubernetes.io/projected/efb2fa88-6221-4ecf-84c3-e6778228e2fd-kube-api-access-px7fw\") pod \"barbican-db-create-7wtrh\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.601809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-operator-scripts\") pod \"cinder-ff83-account-create-pjrnr\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.601862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8tf\" (UniqueName: \"kubernetes.io/projected/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-kube-api-access-rr8tf\") pod \"cinder-ff83-account-create-pjrnr\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.601907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52c123b-e469-4987-836c-bd30d57e71bc-operator-scripts\") pod \"neutron-db-create-lshv4\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.602032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efb2fa88-6221-4ecf-84c3-e6778228e2fd-operator-scripts\") pod \"barbican-db-create-7wtrh\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.602058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d7phl\" (UniqueName: \"kubernetes.io/projected/a52c123b-e469-4987-836c-bd30d57e71bc-kube-api-access-d7phl\") pod \"neutron-db-create-lshv4\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.602095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-operator-scripts\") pod \"neutron-aaf3-account-create-mc2pj\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.602142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7r6b\" (UniqueName: \"kubernetes.io/projected/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-kube-api-access-w7r6b\") pod \"neutron-aaf3-account-create-mc2pj\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.603515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52c123b-e469-4987-836c-bd30d57e71bc-operator-scripts\") pod \"neutron-db-create-lshv4\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.603672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-operator-scripts\") pod \"cinder-ff83-account-create-pjrnr\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.622128 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-b23d-account-create-f45zl"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.623384 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.627803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7phl\" (UniqueName: \"kubernetes.io/projected/a52c123b-e469-4987-836c-bd30d57e71bc-kube-api-access-d7phl\") pod \"neutron-db-create-lshv4\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.628401 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.629524 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7wtrh"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.631898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8tf\" (UniqueName: \"kubernetes.io/projected/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-kube-api-access-rr8tf\") pod \"cinder-ff83-account-create-pjrnr\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.649516 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-b23d-account-create-f45zl"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.665729 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h2w9n"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.666932 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.671121 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.671354 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.671389 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.671579 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-n6lk4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.689800 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h2w9n"] Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.690164 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-px7fw\" (UniqueName: \"kubernetes.io/projected/efb2fa88-6221-4ecf-84c3-e6778228e2fd-kube-api-access-px7fw\") pod \"barbican-db-create-7wtrh\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-config-data\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8k4\" (UniqueName: \"kubernetes.io/projected/4c942925-3923-4f5e-ac7e-a1cfaeaad438-kube-api-access-zb8k4\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702769 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-combined-ca-bundle\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efb2fa88-6221-4ecf-84c3-e6778228e2fd-operator-scripts\") pod \"barbican-db-create-7wtrh\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-operator-scripts\") pod \"neutron-aaf3-account-create-mc2pj\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/082d07f1-32ad-4b86-a0df-d03cadc19d40-operator-scripts\") pod \"barbican-b23d-account-create-f45zl\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mv2r\" (UniqueName: \"kubernetes.io/projected/082d07f1-32ad-4b86-a0df-d03cadc19d40-kube-api-access-5mv2r\") pod \"barbican-b23d-account-create-f45zl\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.702895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w7r6b\" (UniqueName: \"kubernetes.io/projected/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-kube-api-access-w7r6b\") pod \"neutron-aaf3-account-create-mc2pj\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.703734 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-operator-scripts\") pod \"neutron-aaf3-account-create-mc2pj\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.704077 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.704712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efb2fa88-6221-4ecf-84c3-e6778228e2fd-operator-scripts\") pod \"barbican-db-create-7wtrh\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.718273 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-px7fw\" (UniqueName: \"kubernetes.io/projected/efb2fa88-6221-4ecf-84c3-e6778228e2fd-kube-api-access-px7fw\") pod \"barbican-db-create-7wtrh\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.719785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7r6b\" (UniqueName: \"kubernetes.io/projected/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-kube-api-access-w7r6b\") pod \"neutron-aaf3-account-create-mc2pj\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.793627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.804511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/082d07f1-32ad-4b86-a0df-d03cadc19d40-operator-scripts\") pod \"barbican-b23d-account-create-f45zl\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.804567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5mv2r\" (UniqueName: \"kubernetes.io/projected/082d07f1-32ad-4b86-a0df-d03cadc19d40-kube-api-access-5mv2r\") pod \"barbican-b23d-account-create-f45zl\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.804641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-config-data\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.804668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8k4\" (UniqueName: \"kubernetes.io/projected/4c942925-3923-4f5e-ac7e-a1cfaeaad438-kube-api-access-zb8k4\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.804716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-combined-ca-bundle\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.806407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/082d07f1-32ad-4b86-a0df-d03cadc19d40-operator-scripts\") pod \"barbican-b23d-account-create-f45zl\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.812227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-config-data\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.813036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-combined-ca-bundle\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.816617 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.837712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mv2r\" (UniqueName: \"kubernetes.io/projected/082d07f1-32ad-4b86-a0df-d03cadc19d40-kube-api-access-5mv2r\") pod \"barbican-b23d-account-create-f45zl\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.846774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8k4\" (UniqueName: \"kubernetes.io/projected/4c942925-3923-4f5e-ac7e-a1cfaeaad438-kube-api-access-zb8k4\") pod \"keystone-db-sync-h2w9n\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:47 crc kubenswrapper[4769]: I1121 13:05:47.911441 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.070745 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.096002 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.275444 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:05:48 crc kubenswrapper[4769]: E1121 13:05:48.276007 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.341412 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-ff83-account-create-pjrnr"] Nov 21 13:05:48 crc kubenswrapper[4769]: W1121 13:05:48.367756 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d7a4145_54f2_4346_9f48_f678f702a24e.slice/crio-67ff287b038ff3eedd516b511b89e28765e91881622512a5e6e909d0ea27c77d WatchSource:0}: Error finding container 67ff287b038ff3eedd516b511b89e28765e91881622512a5e6e909d0ea27c77d: Status 404 returned error can't find the container with id 67ff287b038ff3eedd516b511b89e28765e91881622512a5e6e909d0ea27c77d Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.368637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bbfjf"] Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.529875 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-lshv4"] Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.574024 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj"] Nov 21 13:05:48 crc kubenswrapper[4769]: W1121 13:05:48.590412 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9dc3feb_5411_4bf4_be54_4ba3a549bf4c.slice/crio-dd40cb51433451bcbb322f69a4d446630a31e555fe06a2433add28b5172b44d0 WatchSource:0}: Error finding container dd40cb51433451bcbb322f69a4d446630a31e555fe06a2433add28b5172b44d0: Status 404 returned error can't find the container with id dd40cb51433451bcbb322f69a4d446630a31e555fe06a2433add28b5172b44d0 Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.674365 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h2w9n"] Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.686395 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7wtrh"] Nov 21 13:05:48 crc kubenswrapper[4769]: W1121 13:05:48.686795 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c942925_3923_4f5e_ac7e_a1cfaeaad438.slice/crio-affcfed25274731b47f788f0e693d8d0c104f3e933078cde4b73eb0f6720127e WatchSource:0}: Error finding container affcfed25274731b47f788f0e693d8d0c104f3e933078cde4b73eb0f6720127e: Status 404 returned error can't find the container with id affcfed25274731b47f788f0e693d8d0c104f3e933078cde4b73eb0f6720127e Nov 21 13:05:48 crc kubenswrapper[4769]: W1121 13:05:48.697614 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod082d07f1_32ad_4b86_a0df_d03cadc19d40.slice/crio-91b1bb9d33ac392c6c1da4a2c43a91c9b6cb2264725d3b6ff50dc4bb94fcd26c WatchSource:0}: Error finding container 91b1bb9d33ac392c6c1da4a2c43a91c9b6cb2264725d3b6ff50dc4bb94fcd26c: Status 404 returned error can't find the container with id 91b1bb9d33ac392c6c1da4a2c43a91c9b6cb2264725d3b6ff50dc4bb94fcd26c Nov 21 13:05:48 crc kubenswrapper[4769]: I1121 13:05:48.707510 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-b23d-account-create-f45zl"] Nov 21 13:05:48 crc kubenswrapper[4769]: E1121 13:05:48.796441 4769 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 38.102.83.227:58676->38.102.83.227:40411: read tcp 38.102.83.227:58676->38.102.83.227:40411: read: connection reset by peer Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.042431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" event={"ID":"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c","Type":"ContainerStarted","Data":"01ee754882a2a7c2e21f86b803eb4b436bae6c6fcfce1259b0b4661de7ee1d94"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.042728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" event={"ID":"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c","Type":"ContainerStarted","Data":"dd40cb51433451bcbb322f69a4d446630a31e555fe06a2433add28b5172b44d0"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.044789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" event={"ID":"4c942925-3923-4f5e-ac7e-a1cfaeaad438","Type":"ContainerStarted","Data":"a800be49870924b40b94fb5f9c6f7fcbfd92178e134a580cf172fe15bb3a5eeb"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.044826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" event={"ID":"4c942925-3923-4f5e-ac7e-a1cfaeaad438","Type":"ContainerStarted","Data":"affcfed25274731b47f788f0e693d8d0c104f3e933078cde4b73eb0f6720127e"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.047060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-lshv4" event={"ID":"a52c123b-e469-4987-836c-bd30d57e71bc","Type":"ContainerStarted","Data":"9599ec0ce31c3444a165662ff0efc585b182b0d77b1e0161507e607312e525c0"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.047085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-lshv4" event={"ID":"a52c123b-e469-4987-836c-bd30d57e71bc","Type":"ContainerStarted","Data":"ccab5bd1df5112988ab3e39c991fee5d6f865efe9baf1e98c2ad4496f9c09822"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.048739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" event={"ID":"082d07f1-32ad-4b86-a0df-d03cadc19d40","Type":"ContainerStarted","Data":"9da075ecf9ee34fdc525494974b9adf17d7c63f8487aa860902fc100114a05af"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.048910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" event={"ID":"082d07f1-32ad-4b86-a0df-d03cadc19d40","Type":"ContainerStarted","Data":"91b1bb9d33ac392c6c1da4a2c43a91c9b6cb2264725d3b6ff50dc4bb94fcd26c"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.050056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" event={"ID":"efb2fa88-6221-4ecf-84c3-e6778228e2fd","Type":"ContainerStarted","Data":"8d2e4ac033827d7b74fff887c5c5024a842ae24b94188dce29c765e8e5c92714"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.056611 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" podStartSLOduration=2.056595539 podStartE2EDuration="2.056595539s" podCreationTimestamp="2025-11-21 13:05:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:49.053183158 +0000 UTC m=+4507.753864116" watchObservedRunningTime="2025-11-21 13:05:49.056595539 +0000 UTC m=+4507.757257367" Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.057583 4769 generic.go:334] "Generic (PLEG): container finished" podID="69cfd29a-66d8-4e85-a2a0-46b1d849bc54" containerID="74c188d249634a04165a894b0b0c441b858767e33bd194d2baf231f0be89bd3a" exitCode=0 Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.057668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" event={"ID":"69cfd29a-66d8-4e85-a2a0-46b1d849bc54","Type":"ContainerDied","Data":"74c188d249634a04165a894b0b0c441b858767e33bd194d2baf231f0be89bd3a"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.057694 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" event={"ID":"69cfd29a-66d8-4e85-a2a0-46b1d849bc54","Type":"ContainerStarted","Data":"0317f82fef5af70634f7a02d9dfe1ffaaf00bd02a8dcdbe3878aacab01976eb3"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.059696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" event={"ID":"6d7a4145-54f2-4346-9f48-f678f702a24e","Type":"ContainerStarted","Data":"0df3a4bcad79b259fd39b601b6fc1624c9ffb07be587d4fc43b262e4ea242181"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.059746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" event={"ID":"6d7a4145-54f2-4346-9f48-f678f702a24e","Type":"ContainerStarted","Data":"67ff287b038ff3eedd516b511b89e28765e91881622512a5e6e909d0ea27c77d"} Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.075379 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" podStartSLOduration=2.075360905 podStartE2EDuration="2.075360905s" podCreationTimestamp="2025-11-21 13:05:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:49.066070315 +0000 UTC m=+4507.766732153" watchObservedRunningTime="2025-11-21 13:05:49.075360905 +0000 UTC m=+4507.776022733" Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.089383 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" podStartSLOduration=2.089364482 podStartE2EDuration="2.089364482s" podCreationTimestamp="2025-11-21 13:05:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:49.080008 +0000 UTC m=+4507.780669828" watchObservedRunningTime="2025-11-21 13:05:49.089364482 +0000 UTC m=+4507.790026300" Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.095606 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-lshv4" podStartSLOduration=2.095586089 podStartE2EDuration="2.095586089s" podCreationTimestamp="2025-11-21 13:05:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:49.092520547 +0000 UTC m=+4507.793182385" watchObservedRunningTime="2025-11-21 13:05:49.095586089 +0000 UTC m=+4507.796247907" Nov 21 13:05:49 crc kubenswrapper[4769]: I1121 13:05:49.114122 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" podStartSLOduration=2.112178876 podStartE2EDuration="2.112178876s" podCreationTimestamp="2025-11-21 13:05:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:49.107624964 +0000 UTC m=+4507.808286782" watchObservedRunningTime="2025-11-21 13:05:49.112178876 +0000 UTC m=+4507.812840694" Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.069520 4769 generic.go:334] "Generic (PLEG): container finished" podID="a52c123b-e469-4987-836c-bd30d57e71bc" containerID="9599ec0ce31c3444a165662ff0efc585b182b0d77b1e0161507e607312e525c0" exitCode=0 Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.069605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-lshv4" event={"ID":"a52c123b-e469-4987-836c-bd30d57e71bc","Type":"ContainerDied","Data":"9599ec0ce31c3444a165662ff0efc585b182b0d77b1e0161507e607312e525c0"} Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.071173 4769 generic.go:334] "Generic (PLEG): container finished" podID="082d07f1-32ad-4b86-a0df-d03cadc19d40" containerID="9da075ecf9ee34fdc525494974b9adf17d7c63f8487aa860902fc100114a05af" exitCode=0 Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.071215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" event={"ID":"082d07f1-32ad-4b86-a0df-d03cadc19d40","Type":"ContainerDied","Data":"9da075ecf9ee34fdc525494974b9adf17d7c63f8487aa860902fc100114a05af"} Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.073020 4769 generic.go:334] "Generic (PLEG): container finished" podID="efb2fa88-6221-4ecf-84c3-e6778228e2fd" containerID="318205313ca28fc0e7fc191ab8be8bed44fd5a257ffddc0f272394dde627e1fd" exitCode=0 Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.073082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" event={"ID":"efb2fa88-6221-4ecf-84c3-e6778228e2fd","Type":"ContainerDied","Data":"318205313ca28fc0e7fc191ab8be8bed44fd5a257ffddc0f272394dde627e1fd"} Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.075651 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d7a4145-54f2-4346-9f48-f678f702a24e" containerID="0df3a4bcad79b259fd39b601b6fc1624c9ffb07be587d4fc43b262e4ea242181" exitCode=0 Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.075757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" event={"ID":"6d7a4145-54f2-4346-9f48-f678f702a24e","Type":"ContainerDied","Data":"0df3a4bcad79b259fd39b601b6fc1624c9ffb07be587d4fc43b262e4ea242181"} Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.078539 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" containerID="01ee754882a2a7c2e21f86b803eb4b436bae6c6fcfce1259b0b4661de7ee1d94" exitCode=0 Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.078775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" event={"ID":"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c","Type":"ContainerDied","Data":"01ee754882a2a7c2e21f86b803eb4b436bae6c6fcfce1259b0b4661de7ee1d94"} Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.495426 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.565694 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr8tf\" (UniqueName: \"kubernetes.io/projected/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-kube-api-access-rr8tf\") pod \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.565890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-operator-scripts\") pod \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\" (UID: \"69cfd29a-66d8-4e85-a2a0-46b1d849bc54\") " Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.566656 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "69cfd29a-66d8-4e85-a2a0-46b1d849bc54" (UID: "69cfd29a-66d8-4e85-a2a0-46b1d849bc54"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.587543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-kube-api-access-rr8tf" (OuterVolumeSpecName: "kube-api-access-rr8tf") pod "69cfd29a-66d8-4e85-a2a0-46b1d849bc54" (UID: "69cfd29a-66d8-4e85-a2a0-46b1d849bc54"). InnerVolumeSpecName "kube-api-access-rr8tf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.667790 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rr8tf\" (UniqueName: \"kubernetes.io/projected/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-kube-api-access-rr8tf\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:50 crc kubenswrapper[4769]: I1121 13:05:50.667836 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69cfd29a-66d8-4e85-a2a0-46b1d849bc54-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.093496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" event={"ID":"69cfd29a-66d8-4e85-a2a0-46b1d849bc54","Type":"ContainerDied","Data":"0317f82fef5af70634f7a02d9dfe1ffaaf00bd02a8dcdbe3878aacab01976eb3"} Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.093859 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0317f82fef5af70634f7a02d9dfe1ffaaf00bd02a8dcdbe3878aacab01976eb3" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.093609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-ff83-account-create-pjrnr" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.495261 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.636022 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.644362 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.660608 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.673322 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.684177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7r6b\" (UniqueName: \"kubernetes.io/projected/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-kube-api-access-w7r6b\") pod \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.684322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-operator-scripts\") pod \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\" (UID: \"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.685019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" (UID: "d9dc3feb-5411-4bf4-be54-4ba3a549bf4c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.688839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-kube-api-access-w7r6b" (OuterVolumeSpecName: "kube-api-access-w7r6b") pod "d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" (UID: "d9dc3feb-5411-4bf4-be54-4ba3a549bf4c"). InnerVolumeSpecName "kube-api-access-w7r6b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efb2fa88-6221-4ecf-84c3-e6778228e2fd-operator-scripts\") pod \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tc8p\" (UniqueName: \"kubernetes.io/projected/6d7a4145-54f2-4346-9f48-f678f702a24e-kube-api-access-5tc8p\") pod \"6d7a4145-54f2-4346-9f48-f678f702a24e\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/082d07f1-32ad-4b86-a0df-d03cadc19d40-operator-scripts\") pod \"082d07f1-32ad-4b86-a0df-d03cadc19d40\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7phl\" (UniqueName: \"kubernetes.io/projected/a52c123b-e469-4987-836c-bd30d57e71bc-kube-api-access-d7phl\") pod \"a52c123b-e469-4987-836c-bd30d57e71bc\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d7a4145-54f2-4346-9f48-f678f702a24e-operator-scripts\") pod \"6d7a4145-54f2-4346-9f48-f678f702a24e\" (UID: \"6d7a4145-54f2-4346-9f48-f678f702a24e\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786839 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px7fw\" (UniqueName: \"kubernetes.io/projected/efb2fa88-6221-4ecf-84c3-e6778228e2fd-kube-api-access-px7fw\") pod \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\" (UID: \"efb2fa88-6221-4ecf-84c3-e6778228e2fd\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52c123b-e469-4987-836c-bd30d57e71bc-operator-scripts\") pod \"a52c123b-e469-4987-836c-bd30d57e71bc\" (UID: \"a52c123b-e469-4987-836c-bd30d57e71bc\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.786952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mv2r\" (UniqueName: \"kubernetes.io/projected/082d07f1-32ad-4b86-a0df-d03cadc19d40-kube-api-access-5mv2r\") pod \"082d07f1-32ad-4b86-a0df-d03cadc19d40\" (UID: \"082d07f1-32ad-4b86-a0df-d03cadc19d40\") " Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082d07f1-32ad-4b86-a0df-d03cadc19d40-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "082d07f1-32ad-4b86-a0df-d03cadc19d40" (UID: "082d07f1-32ad-4b86-a0df-d03cadc19d40"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a52c123b-e469-4987-836c-bd30d57e71bc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a52c123b-e469-4987-836c-bd30d57e71bc" (UID: "a52c123b-e469-4987-836c-bd30d57e71bc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d7a4145-54f2-4346-9f48-f678f702a24e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6d7a4145-54f2-4346-9f48-f678f702a24e" (UID: "6d7a4145-54f2-4346-9f48-f678f702a24e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787768 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w7r6b\" (UniqueName: \"kubernetes.io/projected/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-kube-api-access-w7r6b\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787783 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787792 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/082d07f1-32ad-4b86-a0df-d03cadc19d40-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787802 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6d7a4145-54f2-4346-9f48-f678f702a24e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.787811 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a52c123b-e469-4987-836c-bd30d57e71bc-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.788899 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb2fa88-6221-4ecf-84c3-e6778228e2fd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "efb2fa88-6221-4ecf-84c3-e6778228e2fd" (UID: "efb2fa88-6221-4ecf-84c3-e6778228e2fd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.789934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52c123b-e469-4987-836c-bd30d57e71bc-kube-api-access-d7phl" (OuterVolumeSpecName: "kube-api-access-d7phl") pod "a52c123b-e469-4987-836c-bd30d57e71bc" (UID: "a52c123b-e469-4987-836c-bd30d57e71bc"). InnerVolumeSpecName "kube-api-access-d7phl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.790779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb2fa88-6221-4ecf-84c3-e6778228e2fd-kube-api-access-px7fw" (OuterVolumeSpecName: "kube-api-access-px7fw") pod "efb2fa88-6221-4ecf-84c3-e6778228e2fd" (UID: "efb2fa88-6221-4ecf-84c3-e6778228e2fd"). InnerVolumeSpecName "kube-api-access-px7fw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.791424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082d07f1-32ad-4b86-a0df-d03cadc19d40-kube-api-access-5mv2r" (OuterVolumeSpecName: "kube-api-access-5mv2r") pod "082d07f1-32ad-4b86-a0df-d03cadc19d40" (UID: "082d07f1-32ad-4b86-a0df-d03cadc19d40"). InnerVolumeSpecName "kube-api-access-5mv2r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.796623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7a4145-54f2-4346-9f48-f678f702a24e-kube-api-access-5tc8p" (OuterVolumeSpecName: "kube-api-access-5tc8p") pod "6d7a4145-54f2-4346-9f48-f678f702a24e" (UID: "6d7a4145-54f2-4346-9f48-f678f702a24e"). InnerVolumeSpecName "kube-api-access-5tc8p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.888840 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5mv2r\" (UniqueName: \"kubernetes.io/projected/082d07f1-32ad-4b86-a0df-d03cadc19d40-kube-api-access-5mv2r\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.888893 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efb2fa88-6221-4ecf-84c3-e6778228e2fd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.888910 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5tc8p\" (UniqueName: \"kubernetes.io/projected/6d7a4145-54f2-4346-9f48-f678f702a24e-kube-api-access-5tc8p\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.888926 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d7phl\" (UniqueName: \"kubernetes.io/projected/a52c123b-e469-4987-836c-bd30d57e71bc-kube-api-access-d7phl\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:51 crc kubenswrapper[4769]: I1121 13:05:51.888942 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-px7fw\" (UniqueName: \"kubernetes.io/projected/efb2fa88-6221-4ecf-84c3-e6778228e2fd-kube-api-access-px7fw\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.104359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" event={"ID":"6d7a4145-54f2-4346-9f48-f678f702a24e","Type":"ContainerDied","Data":"67ff287b038ff3eedd516b511b89e28765e91881622512a5e6e909d0ea27c77d"} Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.104400 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67ff287b038ff3eedd516b511b89e28765e91881622512a5e6e909d0ea27c77d" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.104450 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bbfjf" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.107061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" event={"ID":"d9dc3feb-5411-4bf4-be54-4ba3a549bf4c","Type":"ContainerDied","Data":"dd40cb51433451bcbb322f69a4d446630a31e555fe06a2433add28b5172b44d0"} Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.107088 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.107100 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd40cb51433451bcbb322f69a4d446630a31e555fe06a2433add28b5172b44d0" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.109372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-lshv4" event={"ID":"a52c123b-e469-4987-836c-bd30d57e71bc","Type":"ContainerDied","Data":"ccab5bd1df5112988ab3e39c991fee5d6f865efe9baf1e98c2ad4496f9c09822"} Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.109473 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccab5bd1df5112988ab3e39c991fee5d6f865efe9baf1e98c2ad4496f9c09822" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.109388 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-lshv4" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.110884 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" event={"ID":"082d07f1-32ad-4b86-a0df-d03cadc19d40","Type":"ContainerDied","Data":"91b1bb9d33ac392c6c1da4a2c43a91c9b6cb2264725d3b6ff50dc4bb94fcd26c"} Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.110917 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91b1bb9d33ac392c6c1da4a2c43a91c9b6cb2264725d3b6ff50dc4bb94fcd26c" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.110966 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-b23d-account-create-f45zl" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.119265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" event={"ID":"efb2fa88-6221-4ecf-84c3-e6778228e2fd","Type":"ContainerDied","Data":"8d2e4ac033827d7b74fff887c5c5024a842ae24b94188dce29c765e8e5c92714"} Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.119297 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d2e4ac033827d7b74fff887c5c5024a842ae24b94188dce29c765e8e5c92714" Nov 21 13:05:52 crc kubenswrapper[4769]: I1121 13:05:52.119342 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-7wtrh" Nov 21 13:05:53 crc kubenswrapper[4769]: I1121 13:05:53.136725 4769 generic.go:334] "Generic (PLEG): container finished" podID="4c942925-3923-4f5e-ac7e-a1cfaeaad438" containerID="a800be49870924b40b94fb5f9c6f7fcbfd92178e134a580cf172fe15bb3a5eeb" exitCode=0 Nov 21 13:05:53 crc kubenswrapper[4769]: I1121 13:05:53.136835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" event={"ID":"4c942925-3923-4f5e-ac7e-a1cfaeaad438","Type":"ContainerDied","Data":"a800be49870924b40b94fb5f9c6f7fcbfd92178e134a580cf172fe15bb3a5eeb"} Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.527515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.546345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-combined-ca-bundle\") pod \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.546550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-config-data\") pod \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.546886 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb8k4\" (UniqueName: \"kubernetes.io/projected/4c942925-3923-4f5e-ac7e-a1cfaeaad438-kube-api-access-zb8k4\") pod \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\" (UID: \"4c942925-3923-4f5e-ac7e-a1cfaeaad438\") " Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.555616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c942925-3923-4f5e-ac7e-a1cfaeaad438-kube-api-access-zb8k4" (OuterVolumeSpecName: "kube-api-access-zb8k4") pod "4c942925-3923-4f5e-ac7e-a1cfaeaad438" (UID: "4c942925-3923-4f5e-ac7e-a1cfaeaad438"). InnerVolumeSpecName "kube-api-access-zb8k4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.580618 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4c942925-3923-4f5e-ac7e-a1cfaeaad438" (UID: "4c942925-3923-4f5e-ac7e-a1cfaeaad438"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.600059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-config-data" (OuterVolumeSpecName: "config-data") pod "4c942925-3923-4f5e-ac7e-a1cfaeaad438" (UID: "4c942925-3923-4f5e-ac7e-a1cfaeaad438"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.649523 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.649588 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c942925-3923-4f5e-ac7e-a1cfaeaad438-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:54 crc kubenswrapper[4769]: I1121 13:05:54.649612 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zb8k4\" (UniqueName: \"kubernetes.io/projected/4c942925-3923-4f5e-ac7e-a1cfaeaad438-kube-api-access-zb8k4\") on node \"crc\" DevicePath \"\"" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.164955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" event={"ID":"4c942925-3923-4f5e-ac7e-a1cfaeaad438","Type":"ContainerDied","Data":"affcfed25274731b47f788f0e693d8d0c104f3e933078cde4b73eb0f6720127e"} Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.165495 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="affcfed25274731b47f788f0e693d8d0c104f3e933078cde4b73eb0f6720127e" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.165115 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h2w9n" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.393680 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4ngfz"] Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394003 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394019 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394044 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="efb2fa88-6221-4ecf-84c3-e6778228e2fd" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394050 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb2fa88-6221-4ecf-84c3-e6778228e2fd" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394060 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="082d07f1-32ad-4b86-a0df-d03cadc19d40" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394066 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="082d07f1-32ad-4b86-a0df-d03cadc19d40" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d7a4145-54f2-4346-9f48-f678f702a24e" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7a4145-54f2-4346-9f48-f678f702a24e" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394101 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4c942925-3923-4f5e-ac7e-a1cfaeaad438" containerName="keystone-db-sync" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394108 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c942925-3923-4f5e-ac7e-a1cfaeaad438" containerName="keystone-db-sync" Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394119 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="69cfd29a-66d8-4e85-a2a0-46b1d849bc54" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394124 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="69cfd29a-66d8-4e85-a2a0-46b1d849bc54" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: E1121 13:05:55.394131 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a52c123b-e469-4987-836c-bd30d57e71bc" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a52c123b-e469-4987-836c-bd30d57e71bc" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394292 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4c942925-3923-4f5e-ac7e-a1cfaeaad438" containerName="keystone-db-sync" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394303 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a52c123b-e469-4987-836c-bd30d57e71bc" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394314 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d7a4145-54f2-4346-9f48-f678f702a24e" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394325 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="082d07f1-32ad-4b86-a0df-d03cadc19d40" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="69cfd29a-66d8-4e85-a2a0-46b1d849bc54" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394345 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" containerName="mariadb-account-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.394357 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="efb2fa88-6221-4ecf-84c3-e6778228e2fd" containerName="mariadb-database-create" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.395052 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.401791 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.402014 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.402272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-n6lk4" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.403633 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.403969 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.469937 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4ngfz"] Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.491274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-scripts\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.491320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-fernet-keys\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.491344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-combined-ca-bundle\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.491422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-credential-keys\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.491451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvh5l\" (UniqueName: \"kubernetes.io/projected/80553aa8-7365-4268-a23b-e638e327dcb3-kube-api-access-bvh5l\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.491480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-config-data\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.578957 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f9pm7"] Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.580131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.584427 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.587380 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-6dw2f" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.588265 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.591260 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pkcr\" (UniqueName: \"kubernetes.io/projected/871ef20e-db69-407c-bf2b-0adde206d6ef-kube-api-access-2pkcr\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-credential-keys\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-config-data\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bvh5l\" (UniqueName: \"kubernetes.io/projected/80553aa8-7365-4268-a23b-e638e327dcb3-kube-api-access-bvh5l\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-config-data\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/871ef20e-db69-407c-bf2b-0adde206d6ef-logs\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-scripts\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-fernet-keys\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-combined-ca-bundle\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592363 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-combined-ca-bundle\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.592390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-scripts\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.593361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.595007 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.600853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-credential-keys\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.606585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-combined-ca-bundle\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.606906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-scripts\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.607922 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f9pm7"] Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.608108 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.611787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-config-data\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.613715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvh5l\" (UniqueName: \"kubernetes.io/projected/80553aa8-7365-4268-a23b-e638e327dcb3-kube-api-access-bvh5l\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.618701 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.638005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-fernet-keys\") pod \"keystone-bootstrap-4ngfz\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.693874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-run-httpd\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.693932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2pkcr\" (UniqueName: \"kubernetes.io/projected/871ef20e-db69-407c-bf2b-0adde206d6ef-kube-api-access-2pkcr\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.693964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-config-data\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.693996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.694037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-config-data\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.694798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/871ef20e-db69-407c-bf2b-0adde206d6ef-logs\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.694841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6x26\" (UniqueName: \"kubernetes.io/projected/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-kube-api-access-q6x26\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.694873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.694986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-combined-ca-bundle\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.695033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-scripts\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.695068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-log-httpd\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.695088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-scripts\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.695473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/871ef20e-db69-407c-bf2b-0adde206d6ef-logs\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.699862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-config-data\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.706701 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-scripts\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.710594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-combined-ca-bundle\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.720793 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.722094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pkcr\" (UniqueName: \"kubernetes.io/projected/871ef20e-db69-407c-bf2b-0adde206d6ef-kube-api-access-2pkcr\") pod \"placement-db-sync-f9pm7\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.795700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.796153 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-config-data\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.796246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q6x26\" (UniqueName: \"kubernetes.io/projected/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-kube-api-access-q6x26\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.796952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.797909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-log-httpd\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.798057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-scripts\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.798135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-run-httpd\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.798656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-log-httpd\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.799176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-run-httpd\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.801005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.802267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-config-data\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.808946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-scripts\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.814742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.817411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6x26\" (UniqueName: \"kubernetes.io/projected/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-kube-api-access-q6x26\") pod \"ceilometer-0\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:55 crc kubenswrapper[4769]: I1121 13:05:55.994738 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.104629 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.208258 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4ngfz"] Nov 21 13:05:56 crc kubenswrapper[4769]: W1121 13:05:56.234661 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80553aa8_7365_4268_a23b_e638e327dcb3.slice/crio-ae683d373f889cb216b7155f5f345a29f9ed034acf4ce124243a1b49dda8801e WatchSource:0}: Error finding container ae683d373f889cb216b7155f5f345a29f9ed034acf4ce124243a1b49dda8801e: Status 404 returned error can't find the container with id ae683d373f889cb216b7155f5f345a29f9ed034acf4ce124243a1b49dda8801e Nov 21 13:05:56 crc kubenswrapper[4769]: W1121 13:05:56.421823 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod871ef20e_db69_407c_bf2b_0adde206d6ef.slice/crio-b056c85ebd48061a67d7271e55cbe25bceb72685556ca669b17c0593478321d7 WatchSource:0}: Error finding container b056c85ebd48061a67d7271e55cbe25bceb72685556ca669b17c0593478321d7: Status 404 returned error can't find the container with id b056c85ebd48061a67d7271e55cbe25bceb72685556ca669b17c0593478321d7 Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.428386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f9pm7"] Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.470868 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.474878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.477273 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.513136 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.513360 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-x7k8k" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.513410 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.513505 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.547356 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.559688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.562369 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.563998 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.613961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spzrj\" (UniqueName: \"kubernetes.io/projected/4d80964a-f221-41ee-9036-08580cbc27a6-kube-api-access-spzrj\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-config-data\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-scripts\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-logs\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614173 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.614304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.616488 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:05:56 crc kubenswrapper[4769]: W1121 13:05:56.618352 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod845d7f3c_b4a7_4e8e_8878_3c40feb541fe.slice/crio-cba95faa5a736cfce87b162e43dcf2b57bd2f3a8db9eb7fec23f28d12de5f59b WatchSource:0}: Error finding container cba95faa5a736cfce87b162e43dcf2b57bd2f3a8db9eb7fec23f28d12de5f59b: Status 404 returned error can't find the container with id cba95faa5a736cfce87b162e43dcf2b57bd2f3a8db9eb7fec23f28d12de5f59b Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.630164 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.646530 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.716345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-spzrj\" (UniqueName: \"kubernetes.io/projected/4d80964a-f221-41ee-9036-08580cbc27a6-kube-api-access-spzrj\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.716673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-config-data\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.716715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.716739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717222 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-scripts\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717255 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-logs\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-logs\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717452 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vrtw\" (UniqueName: \"kubernetes.io/projected/6c09ccae-15b1-4125-bb6d-5c56e534b078-kube-api-access-8vrtw\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.717490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.719479 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.719678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-logs\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.719729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.724397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-scripts\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.725660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.730595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-config-data\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.731750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.735371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-spzrj\" (UniqueName: \"kubernetes.io/projected/4d80964a-f221-41ee-9036-08580cbc27a6-kube-api-access-spzrj\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.747860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.818812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.818855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.818882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.818906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-logs\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.818926 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.818976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.819000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8vrtw\" (UniqueName: \"kubernetes.io/projected/6c09ccae-15b1-4125-bb6d-5c56e534b078-kube-api-access-8vrtw\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.819018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.820396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-logs\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.820616 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.822999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.824548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.825493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.829322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.829333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.837837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vrtw\" (UniqueName: \"kubernetes.io/projected/6c09ccae-15b1-4125-bb6d-5c56e534b078-kube-api-access-8vrtw\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.845860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.899478 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:05:56 crc kubenswrapper[4769]: I1121 13:05:56.988145 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.202990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerStarted","Data":"cba95faa5a736cfce87b162e43dcf2b57bd2f3a8db9eb7fec23f28d12de5f59b"} Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.212953 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" event={"ID":"80553aa8-7365-4268-a23b-e638e327dcb3","Type":"ContainerStarted","Data":"8ed0a33aba937f755915b2fc4c92fe0b0b6d471286df9b04d3cd29b5ae2019b2"} Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.212999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" event={"ID":"80553aa8-7365-4268-a23b-e638e327dcb3","Type":"ContainerStarted","Data":"ae683d373f889cb216b7155f5f345a29f9ed034acf4ce124243a1b49dda8801e"} Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.216251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" event={"ID":"871ef20e-db69-407c-bf2b-0adde206d6ef","Type":"ContainerStarted","Data":"bd16965684eae98ffc96ff430f636f692e5238ffdcf429acca920276a0096550"} Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.216292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" event={"ID":"871ef20e-db69-407c-bf2b-0adde206d6ef","Type":"ContainerStarted","Data":"b056c85ebd48061a67d7271e55cbe25bceb72685556ca669b17c0593478321d7"} Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.266554 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" podStartSLOduration=2.266530914 podStartE2EDuration="2.266530914s" podCreationTimestamp="2025-11-21 13:05:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:57.260485401 +0000 UTC m=+4515.961147219" watchObservedRunningTime="2025-11-21 13:05:57.266530914 +0000 UTC m=+4515.967192742" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.271132 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" podStartSLOduration=2.271112487 podStartE2EDuration="2.271112487s" podCreationTimestamp="2025-11-21 13:05:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:05:57.23444199 +0000 UTC m=+4515.935103818" watchObservedRunningTime="2025-11-21 13:05:57.271112487 +0000 UTC m=+4515.971774305" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.375141 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:05:57 crc kubenswrapper[4769]: W1121 13:05:57.380578 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d80964a_f221_41ee_9036_08580cbc27a6.slice/crio-64771474420adda9f35db25a59765cc76d1a8ef6e01c34804d1d3ee8a23a63cc WatchSource:0}: Error finding container 64771474420adda9f35db25a59765cc76d1a8ef6e01c34804d1d3ee8a23a63cc: Status 404 returned error can't find the container with id 64771474420adda9f35db25a59765cc76d1a8ef6e01c34804d1d3ee8a23a63cc Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.486375 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:05:57 crc kubenswrapper[4769]: W1121 13:05:57.491674 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c09ccae_15b1_4125_bb6d_5c56e534b078.slice/crio-e90f8acfe23b82ab91bf223f1a23e371859491a399b5cc5f387b91beb61134e5 WatchSource:0}: Error finding container e90f8acfe23b82ab91bf223f1a23e371859491a399b5cc5f387b91beb61134e5: Status 404 returned error can't find the container with id e90f8acfe23b82ab91bf223f1a23e371859491a399b5cc5f387b91beb61134e5 Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.730358 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-z4n4m"] Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.731605 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.758523 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.759949 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-llfwb" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.766939 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-z4n4m"] Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.771296 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.845058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.852143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-combined-ca-bundle\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.852252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/79d74527-af39-47db-bf0c-cbc8279db923-etc-machine-id\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.852305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-scripts\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.852402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-db-sync-config-data\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.852512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-config-data\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.852560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdkj6\" (UniqueName: \"kubernetes.io/projected/79d74527-af39-47db-bf0c-cbc8279db923-kube-api-access-hdkj6\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.886953 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.913175 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.956614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/79d74527-af39-47db-bf0c-cbc8279db923-etc-machine-id\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.957138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-scripts\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.957302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-db-sync-config-data\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.957352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-config-data\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.957385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hdkj6\" (UniqueName: \"kubernetes.io/projected/79d74527-af39-47db-bf0c-cbc8279db923-kube-api-access-hdkj6\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.957435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-combined-ca-bundle\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.956997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/79d74527-af39-47db-bf0c-cbc8279db923-etc-machine-id\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.963270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-config-data\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.965747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-scripts\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.972555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-combined-ca-bundle\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.981496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdkj6\" (UniqueName: \"kubernetes.io/projected/79d74527-af39-47db-bf0c-cbc8279db923-kube-api-access-hdkj6\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:57 crc kubenswrapper[4769]: I1121 13:05:57.987330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-db-sync-config-data\") pod \"cinder-db-sync-z4n4m\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.030812 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqkjd"] Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.032009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.037883 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-krdlc" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.038311 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.049242 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqkjd"] Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.077931 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-qr457"] Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.079176 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.083300 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.083607 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-xr28b" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.084085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.089519 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.115610 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-qr457"] Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.160448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-db-sync-config-data\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.160527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsd9d\" (UniqueName: \"kubernetes.io/projected/cf189434-e3fa-4580-8375-2558a80d4110-kube-api-access-fsd9d\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.160620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-config\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.160647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-combined-ca-bundle\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.160697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-combined-ca-bundle\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.160719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgcsg\" (UniqueName: \"kubernetes.io/projected/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-kube-api-access-hgcsg\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.228160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4d80964a-f221-41ee-9036-08580cbc27a6","Type":"ContainerStarted","Data":"64771474420adda9f35db25a59765cc76d1a8ef6e01c34804d1d3ee8a23a63cc"} Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.232824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6c09ccae-15b1-4125-bb6d-5c56e534b078","Type":"ContainerStarted","Data":"e90f8acfe23b82ab91bf223f1a23e371859491a399b5cc5f387b91beb61134e5"} Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.246532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerStarted","Data":"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5"} Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.246588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerStarted","Data":"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54"} Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.264127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-db-sync-config-data\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.264219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fsd9d\" (UniqueName: \"kubernetes.io/projected/cf189434-e3fa-4580-8375-2558a80d4110-kube-api-access-fsd9d\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.264386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-config\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.264415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-combined-ca-bundle\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.264446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-combined-ca-bundle\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.264465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcsg\" (UniqueName: \"kubernetes.io/projected/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-kube-api-access-hgcsg\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.272078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-db-sync-config-data\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.272853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-combined-ca-bundle\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.278686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-combined-ca-bundle\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.281829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-config\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.283837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsd9d\" (UniqueName: \"kubernetes.io/projected/cf189434-e3fa-4580-8375-2558a80d4110-kube-api-access-fsd9d\") pod \"barbican-db-sync-cqkjd\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.288025 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgcsg\" (UniqueName: \"kubernetes.io/projected/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-kube-api-access-hgcsg\") pod \"neutron-db-sync-qr457\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.346691 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.406783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:05:58 crc kubenswrapper[4769]: I1121 13:05:58.596917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-z4n4m"] Nov 21 13:05:59 crc kubenswrapper[4769]: I1121 13:05:58.866249 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-qr457"] Nov 21 13:05:59 crc kubenswrapper[4769]: I1121 13:05:58.963929 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqkjd"] Nov 21 13:05:59 crc kubenswrapper[4769]: I1121 13:05:59.256383 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6c09ccae-15b1-4125-bb6d-5c56e534b078","Type":"ContainerStarted","Data":"44b0acbda05b17f41fa84764abed75f90553281275fccdcc1dd2e73fd151b20b"} Nov 21 13:05:59 crc kubenswrapper[4769]: I1121 13:05:59.257602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" event={"ID":"79d74527-af39-47db-bf0c-cbc8279db923","Type":"ContainerStarted","Data":"f5cbb6be1058de58e84f152746a06e1ce174b33769e0ce7ed0eae67602f71e19"} Nov 21 13:05:59 crc kubenswrapper[4769]: I1121 13:05:59.262626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4d80964a-f221-41ee-9036-08580cbc27a6","Type":"ContainerStarted","Data":"1cd386014096eac0cdf21dbc34921d21612c850d03674a188bc2faaca9111307"} Nov 21 13:05:59 crc kubenswrapper[4769]: I1121 13:05:59.274955 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:05:59 crc kubenswrapper[4769]: E1121 13:05:59.275230 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:05:59 crc kubenswrapper[4769]: W1121 13:05:59.493757 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d7b6f0e_c00f_41d0_a40c_b2778737bd01.slice/crio-6bde960bfc5f4456e24ff3a3b6c525d629431e28871994b59cd81b823ff7d61c WatchSource:0}: Error finding container 6bde960bfc5f4456e24ff3a3b6c525d629431e28871994b59cd81b823ff7d61c: Status 404 returned error can't find the container with id 6bde960bfc5f4456e24ff3a3b6c525d629431e28871994b59cd81b823ff7d61c Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.272519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4d80964a-f221-41ee-9036-08580cbc27a6","Type":"ContainerStarted","Data":"5cb8bbce19ac0ceafe6b9ec7f4c5c1f19b411bb776829969ce2910ca25f6d8af"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.272620 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-log" containerID="cri-o://1cd386014096eac0cdf21dbc34921d21612c850d03674a188bc2faaca9111307" gracePeriod=30 Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.272687 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-httpd" containerID="cri-o://5cb8bbce19ac0ceafe6b9ec7f4c5c1f19b411bb776829969ce2910ca25f6d8af" gracePeriod=30 Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.277322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6c09ccae-15b1-4125-bb6d-5c56e534b078","Type":"ContainerStarted","Data":"7ac1b0f9a0ea046fc1d0a8b25bc99c736d938e044e4a1495b65444706590afb8"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.277432 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-log" containerID="cri-o://44b0acbda05b17f41fa84764abed75f90553281275fccdcc1dd2e73fd151b20b" gracePeriod=30 Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.277537 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-httpd" containerID="cri-o://7ac1b0f9a0ea046fc1d0a8b25bc99c736d938e044e4a1495b65444706590afb8" gracePeriod=30 Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.287679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" event={"ID":"cf189434-e3fa-4580-8375-2558a80d4110","Type":"ContainerStarted","Data":"9c09e34129e450d3235f71c7f47fa027430be6695e0ad775fde53c82a561d2f1"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.287708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" event={"ID":"cf189434-e3fa-4580-8375-2558a80d4110","Type":"ContainerStarted","Data":"d69b2bd3394a443eb2fad24ff73887e4e3541991ce5558904fb57e1d214fd93e"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.294343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-qr457" event={"ID":"4d7b6f0e-c00f-41d0-a40c-b2778737bd01","Type":"ContainerStarted","Data":"b2ad67c9d01720b0dad7ae6daae691076f860bbc3a696c34ac116a3ec21267e8"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.294389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-qr457" event={"ID":"4d7b6f0e-c00f-41d0-a40c-b2778737bd01","Type":"ContainerStarted","Data":"6bde960bfc5f4456e24ff3a3b6c525d629431e28871994b59cd81b823ff7d61c"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.295958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" event={"ID":"79d74527-af39-47db-bf0c-cbc8279db923","Type":"ContainerStarted","Data":"267ade2d6a9db457b9d33049d1a504f14771153c3278657faede3de73a013513"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.299768 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerStarted","Data":"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.300642 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.300628929 podStartE2EDuration="5.300628929s" podCreationTimestamp="2025-11-21 13:05:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:00.296718784 +0000 UTC m=+4518.997380592" watchObservedRunningTime="2025-11-21 13:06:00.300628929 +0000 UTC m=+4519.001290757" Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.302097 4769 generic.go:334] "Generic (PLEG): container finished" podID="80553aa8-7365-4268-a23b-e638e327dcb3" containerID="8ed0a33aba937f755915b2fc4c92fe0b0b6d471286df9b04d3cd29b5ae2019b2" exitCode=0 Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.302165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" event={"ID":"80553aa8-7365-4268-a23b-e638e327dcb3","Type":"ContainerDied","Data":"8ed0a33aba937f755915b2fc4c92fe0b0b6d471286df9b04d3cd29b5ae2019b2"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.304296 4769 generic.go:334] "Generic (PLEG): container finished" podID="871ef20e-db69-407c-bf2b-0adde206d6ef" containerID="bd16965684eae98ffc96ff430f636f692e5238ffdcf429acca920276a0096550" exitCode=0 Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.306103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" event={"ID":"871ef20e-db69-407c-bf2b-0adde206d6ef","Type":"ContainerDied","Data":"bd16965684eae98ffc96ff430f636f692e5238ffdcf429acca920276a0096550"} Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.325535 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" podStartSLOduration=3.325501389 podStartE2EDuration="3.325501389s" podCreationTimestamp="2025-11-21 13:05:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:00.324485502 +0000 UTC m=+4519.025147330" watchObservedRunningTime="2025-11-21 13:06:00.325501389 +0000 UTC m=+4519.026163227" Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.352746 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.352730132 podStartE2EDuration="5.352730132s" podCreationTimestamp="2025-11-21 13:05:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:00.346423612 +0000 UTC m=+4519.047085430" watchObservedRunningTime="2025-11-21 13:06:00.352730132 +0000 UTC m=+4519.053391940" Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.368447 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" podStartSLOduration=3.368430255 podStartE2EDuration="3.368430255s" podCreationTimestamp="2025-11-21 13:05:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:00.360980594 +0000 UTC m=+4519.061642412" watchObservedRunningTime="2025-11-21 13:06:00.368430255 +0000 UTC m=+4519.069092063" Nov 21 13:06:00 crc kubenswrapper[4769]: I1121 13:06:00.380180 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-qr457" podStartSLOduration=2.380159011 podStartE2EDuration="2.380159011s" podCreationTimestamp="2025-11-21 13:05:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:00.376989536 +0000 UTC m=+4519.077651354" watchObservedRunningTime="2025-11-21 13:06:00.380159011 +0000 UTC m=+4519.080820829" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.314240 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerID="7ac1b0f9a0ea046fc1d0a8b25bc99c736d938e044e4a1495b65444706590afb8" exitCode=0 Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.315215 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerID="44b0acbda05b17f41fa84764abed75f90553281275fccdcc1dd2e73fd151b20b" exitCode=143 Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.315303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6c09ccae-15b1-4125-bb6d-5c56e534b078","Type":"ContainerDied","Data":"7ac1b0f9a0ea046fc1d0a8b25bc99c736d938e044e4a1495b65444706590afb8"} Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.315371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6c09ccae-15b1-4125-bb6d-5c56e534b078","Type":"ContainerDied","Data":"44b0acbda05b17f41fa84764abed75f90553281275fccdcc1dd2e73fd151b20b"} Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.315451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6c09ccae-15b1-4125-bb6d-5c56e534b078","Type":"ContainerDied","Data":"e90f8acfe23b82ab91bf223f1a23e371859491a399b5cc5f387b91beb61134e5"} Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.315509 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e90f8acfe23b82ab91bf223f1a23e371859491a399b5cc5f387b91beb61134e5" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.317164 4769 generic.go:334] "Generic (PLEG): container finished" podID="4d80964a-f221-41ee-9036-08580cbc27a6" containerID="5cb8bbce19ac0ceafe6b9ec7f4c5c1f19b411bb776829969ce2910ca25f6d8af" exitCode=0 Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.317257 4769 generic.go:334] "Generic (PLEG): container finished" podID="4d80964a-f221-41ee-9036-08580cbc27a6" containerID="1cd386014096eac0cdf21dbc34921d21612c850d03674a188bc2faaca9111307" exitCode=143 Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.317316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4d80964a-f221-41ee-9036-08580cbc27a6","Type":"ContainerDied","Data":"5cb8bbce19ac0ceafe6b9ec7f4c5c1f19b411bb776829969ce2910ca25f6d8af"} Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.318122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4d80964a-f221-41ee-9036-08580cbc27a6","Type":"ContainerDied","Data":"1cd386014096eac0cdf21dbc34921d21612c850d03674a188bc2faaca9111307"} Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.318263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"4d80964a-f221-41ee-9036-08580cbc27a6","Type":"ContainerDied","Data":"64771474420adda9f35db25a59765cc76d1a8ef6e01c34804d1d3ee8a23a63cc"} Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.318334 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64771474420adda9f35db25a59765cc76d1a8ef6e01c34804d1d3ee8a23a63cc" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.477501 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.484586 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.545707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.545772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-config-data\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.545823 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-logs\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.545927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-public-tls-certs\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.545955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spzrj\" (UniqueName: \"kubernetes.io/projected/4d80964a-f221-41ee-9036-08580cbc27a6-kube-api-access-spzrj\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.545999 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-scripts\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.546036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-combined-ca-bundle\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.546077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-httpd-run\") pod \"4d80964a-f221-41ee-9036-08580cbc27a6\" (UID: \"4d80964a-f221-41ee-9036-08580cbc27a6\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.546620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.549921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.552634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d80964a-f221-41ee-9036-08580cbc27a6-kube-api-access-spzrj" (OuterVolumeSpecName: "kube-api-access-spzrj") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "kube-api-access-spzrj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.553154 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-scripts" (OuterVolumeSpecName: "scripts") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.553375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-logs" (OuterVolumeSpecName: "logs") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.647737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-httpd-run\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.647841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vrtw\" (UniqueName: \"kubernetes.io/projected/6c09ccae-15b1-4125-bb6d-5c56e534b078-kube-api-access-8vrtw\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.647863 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-logs\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.647903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-config-data\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.647950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-internal-tls-certs\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-scripts\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-combined-ca-bundle\") pod \"6c09ccae-15b1-4125-bb6d-5c56e534b078\" (UID: \"6c09ccae-15b1-4125-bb6d-5c56e534b078\") " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648590 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-spzrj\" (UniqueName: \"kubernetes.io/projected/4d80964a-f221-41ee-9036-08580cbc27a6-kube-api-access-spzrj\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648613 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648624 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648634 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648662 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.648678 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d80964a-f221-41ee-9036-08580cbc27a6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.649479 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-logs" (OuterVolumeSpecName: "logs") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.703934 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.707773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-scripts" (OuterVolumeSpecName: "scripts") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.752646 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.752981 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6c09ccae-15b1-4125-bb6d-5c56e534b078-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.752995 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.778563 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.781968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c09ccae-15b1-4125-bb6d-5c56e534b078-kube-api-access-8vrtw" (OuterVolumeSpecName: "kube-api-access-8vrtw") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "kube-api-access-8vrtw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.785290 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.785966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.793298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.806873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-config-data" (OuterVolumeSpecName: "config-data") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.828519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-config-data" (OuterVolumeSpecName: "config-data") pod "4d80964a-f221-41ee-9036-08580cbc27a6" (UID: "4d80964a-f221-41ee-9036-08580cbc27a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.852477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6c09ccae-15b1-4125-bb6d-5c56e534b078" (UID: "6c09ccae-15b1-4125-bb6d-5c56e534b078"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854349 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854369 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854380 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854390 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854399 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854408 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8vrtw\" (UniqueName: \"kubernetes.io/projected/6c09ccae-15b1-4125-bb6d-5c56e534b078-kube-api-access-8vrtw\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854417 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c09ccae-15b1-4125-bb6d-5c56e534b078-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.854425 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d80964a-f221-41ee-9036-08580cbc27a6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.872614 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.955971 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.979488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:06:01 crc kubenswrapper[4769]: I1121 13:06:01.983172 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-scripts\") pod \"80553aa8-7365-4268-a23b-e638e327dcb3\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057328 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-config-data\") pod \"80553aa8-7365-4268-a23b-e638e327dcb3\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057377 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-credential-keys\") pod \"80553aa8-7365-4268-a23b-e638e327dcb3\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvh5l\" (UniqueName: \"kubernetes.io/projected/80553aa8-7365-4268-a23b-e638e327dcb3-kube-api-access-bvh5l\") pod \"80553aa8-7365-4268-a23b-e638e327dcb3\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/871ef20e-db69-407c-bf2b-0adde206d6ef-logs\") pod \"871ef20e-db69-407c-bf2b-0adde206d6ef\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-combined-ca-bundle\") pod \"871ef20e-db69-407c-bf2b-0adde206d6ef\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057800 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-scripts\") pod \"871ef20e-db69-407c-bf2b-0adde206d6ef\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-config-data\") pod \"871ef20e-db69-407c-bf2b-0adde206d6ef\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pkcr\" (UniqueName: \"kubernetes.io/projected/871ef20e-db69-407c-bf2b-0adde206d6ef-kube-api-access-2pkcr\") pod \"871ef20e-db69-407c-bf2b-0adde206d6ef\" (UID: \"871ef20e-db69-407c-bf2b-0adde206d6ef\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-fernet-keys\") pod \"80553aa8-7365-4268-a23b-e638e327dcb3\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.057893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-combined-ca-bundle\") pod \"80553aa8-7365-4268-a23b-e638e327dcb3\" (UID: \"80553aa8-7365-4268-a23b-e638e327dcb3\") " Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.058365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871ef20e-db69-407c-bf2b-0adde206d6ef-logs" (OuterVolumeSpecName: "logs") pod "871ef20e-db69-407c-bf2b-0adde206d6ef" (UID: "871ef20e-db69-407c-bf2b-0adde206d6ef"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.061118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-scripts" (OuterVolumeSpecName: "scripts") pod "80553aa8-7365-4268-a23b-e638e327dcb3" (UID: "80553aa8-7365-4268-a23b-e638e327dcb3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.061275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-scripts" (OuterVolumeSpecName: "scripts") pod "871ef20e-db69-407c-bf2b-0adde206d6ef" (UID: "871ef20e-db69-407c-bf2b-0adde206d6ef"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.062867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "80553aa8-7365-4268-a23b-e638e327dcb3" (UID: "80553aa8-7365-4268-a23b-e638e327dcb3"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.063327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871ef20e-db69-407c-bf2b-0adde206d6ef-kube-api-access-2pkcr" (OuterVolumeSpecName: "kube-api-access-2pkcr") pod "871ef20e-db69-407c-bf2b-0adde206d6ef" (UID: "871ef20e-db69-407c-bf2b-0adde206d6ef"). InnerVolumeSpecName "kube-api-access-2pkcr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.063412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80553aa8-7365-4268-a23b-e638e327dcb3-kube-api-access-bvh5l" (OuterVolumeSpecName: "kube-api-access-bvh5l") pod "80553aa8-7365-4268-a23b-e638e327dcb3" (UID: "80553aa8-7365-4268-a23b-e638e327dcb3"). InnerVolumeSpecName "kube-api-access-bvh5l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.063517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "80553aa8-7365-4268-a23b-e638e327dcb3" (UID: "80553aa8-7365-4268-a23b-e638e327dcb3"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.079785 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-config-data" (OuterVolumeSpecName: "config-data") pod "80553aa8-7365-4268-a23b-e638e327dcb3" (UID: "80553aa8-7365-4268-a23b-e638e327dcb3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.083109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-config-data" (OuterVolumeSpecName: "config-data") pod "871ef20e-db69-407c-bf2b-0adde206d6ef" (UID: "871ef20e-db69-407c-bf2b-0adde206d6ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.088824 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "80553aa8-7365-4268-a23b-e638e327dcb3" (UID: "80553aa8-7365-4268-a23b-e638e327dcb3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.089005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "871ef20e-db69-407c-bf2b-0adde206d6ef" (UID: "871ef20e-db69-407c-bf2b-0adde206d6ef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159863 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159910 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159930 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2pkcr\" (UniqueName: \"kubernetes.io/projected/871ef20e-db69-407c-bf2b-0adde206d6ef-kube-api-access-2pkcr\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159946 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159958 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159970 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159984 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.159998 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/80553aa8-7365-4268-a23b-e638e327dcb3-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.160010 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bvh5l\" (UniqueName: \"kubernetes.io/projected/80553aa8-7365-4268-a23b-e638e327dcb3-kube-api-access-bvh5l\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.160022 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/871ef20e-db69-407c-bf2b-0adde206d6ef-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.160033 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/871ef20e-db69-407c-bf2b-0adde206d6ef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.329225 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.329241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4ngfz" event={"ID":"80553aa8-7365-4268-a23b-e638e327dcb3","Type":"ContainerDied","Data":"ae683d373f889cb216b7155f5f345a29f9ed034acf4ce124243a1b49dda8801e"} Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.329292 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae683d373f889cb216b7155f5f345a29f9ed034acf4ce124243a1b49dda8801e" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.330683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" event={"ID":"871ef20e-db69-407c-bf2b-0adde206d6ef","Type":"ContainerDied","Data":"b056c85ebd48061a67d7271e55cbe25bceb72685556ca669b17c0593478321d7"} Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.330705 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b056c85ebd48061a67d7271e55cbe25bceb72685556ca669b17c0593478321d7" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.330756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-f9pm7" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerStarted","Data":"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df"} Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340580 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340618 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340640 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-central-agent" containerID="cri-o://e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" gracePeriod=30 Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340697 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="proxy-httpd" containerID="cri-o://eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" gracePeriod=30 Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340727 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="sg-core" containerID="cri-o://25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" gracePeriod=30 Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.340897 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-notification-agent" containerID="cri-o://5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" gracePeriod=30 Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.373790 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.66263043 podStartE2EDuration="7.373769617s" podCreationTimestamp="2025-11-21 13:05:55 +0000 UTC" firstStartedPulling="2025-11-21 13:05:56.62990616 +0000 UTC m=+4515.330567978" lastFinishedPulling="2025-11-21 13:06:01.341045347 +0000 UTC m=+4520.041707165" observedRunningTime="2025-11-21 13:06:02.367426007 +0000 UTC m=+4521.068087825" watchObservedRunningTime="2025-11-21 13:06:02.373769617 +0000 UTC m=+4521.074431435" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.403744 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.410018 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.416200 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.427222 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433284 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: E1121 13:06:02.433749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="871ef20e-db69-407c-bf2b-0adde206d6ef" containerName="placement-db-sync" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433772 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="871ef20e-db69-407c-bf2b-0adde206d6ef" containerName="placement-db-sync" Nov 21 13:06:02 crc kubenswrapper[4769]: E1121 13:06:02.433789 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-log" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433798 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-log" Nov 21 13:06:02 crc kubenswrapper[4769]: E1121 13:06:02.433819 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="80553aa8-7365-4268-a23b-e638e327dcb3" containerName="keystone-bootstrap" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433827 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="80553aa8-7365-4268-a23b-e638e327dcb3" containerName="keystone-bootstrap" Nov 21 13:06:02 crc kubenswrapper[4769]: E1121 13:06:02.433834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-httpd" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433841 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-httpd" Nov 21 13:06:02 crc kubenswrapper[4769]: E1121 13:06:02.433863 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-log" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433871 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-log" Nov 21 13:06:02 crc kubenswrapper[4769]: E1121 13:06:02.433898 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-httpd" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.433905 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-httpd" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.434104 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-log" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.434125 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-httpd" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.434139 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="80553aa8-7365-4268-a23b-e638e327dcb3" containerName="keystone-bootstrap" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.434154 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="871ef20e-db69-407c-bf2b-0adde206d6ef" containerName="placement-db-sync" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.434178 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" containerName="glance-httpd" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.434201 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" containerName="glance-log" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.435294 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.439650 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.439839 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.442151 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-x7k8k" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.443635 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.488101 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.495260 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.497105 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.499532 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.500605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.515866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-scripts\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567833 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4tp\" (UniqueName: \"kubernetes.io/projected/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-kube-api-access-jp4tp\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hkkb\" (UniqueName: \"kubernetes.io/projected/b1a44c8c-1b3f-4002-8650-9092eba38890-kube-api-access-9hkkb\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.567979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-logs\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.568013 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-config-data\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.568036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.568072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.568146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.568170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.568185 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-logs\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.616349 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4ngfz"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.625341 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4ngfz"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.630480 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.632113 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.633779 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.633948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.634932 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.635613 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.635947 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-6dw2f" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.661918 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-logs\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-scripts\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4tp\" (UniqueName: \"kubernetes.io/projected/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-kube-api-access-jp4tp\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9hkkb\" (UniqueName: \"kubernetes.io/projected/b1a44c8c-1b3f-4002-8650-9092eba38890-kube-api-access-9hkkb\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-logs\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-config-data\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.670050 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.670096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.670454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-logs\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.671448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.672001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-logs\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.669755 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.675461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.678067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.687888 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.689305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.696483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-config-data\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.700977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-scripts\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.701861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.705240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.714742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hkkb\" (UniqueName: \"kubernetes.io/projected/b1a44c8c-1b3f-4002-8650-9092eba38890-kube-api-access-9hkkb\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.717999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4tp\" (UniqueName: \"kubernetes.io/projected/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-kube-api-access-jp4tp\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.718374 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckmvs"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.719443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.723136 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.723479 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.723623 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.723777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-n6lk4" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.725070 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.729203 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.729504 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.730653 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckmvs"] Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.771973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-logs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.772182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.772314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-config-data\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.772400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-scripts\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.772494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-combined-ca-bundle\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.772612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.772642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sp4q\" (UniqueName: \"kubernetes.io/projected/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-kube-api-access-4sp4q\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.809508 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.818966 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-scripts\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-config-data\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-combined-ca-bundle\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-credential-keys\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-fernet-keys\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4sp4q\" (UniqueName: \"kubernetes.io/projected/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-kube-api-access-4sp4q\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-combined-ca-bundle\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874965 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-config-data\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.874994 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-logs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.875044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvpk\" (UniqueName: \"kubernetes.io/projected/174d4344-c28a-4ec2-bd00-9562557ed4bc-kube-api-access-qxvpk\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.875092 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.875119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-scripts\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.875642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-logs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.879859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-scripts\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.879861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.879943 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.879972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-combined-ca-bundle\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.881757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-config-data\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.890208 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sp4q\" (UniqueName: \"kubernetes.io/projected/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-kube-api-access-4sp4q\") pod \"placement-5cb98c4cd6-nfsfh\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.975833 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.977294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-combined-ca-bundle\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.977349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-config-data\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.977391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvpk\" (UniqueName: \"kubernetes.io/projected/174d4344-c28a-4ec2-bd00-9562557ed4bc-kube-api-access-qxvpk\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.977443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-scripts\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.977510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-credential-keys\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.977548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-fernet-keys\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.986031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-combined-ca-bundle\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.986329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-scripts\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.987654 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-credential-keys\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.990164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-fernet-keys\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.996824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-config-data\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:02 crc kubenswrapper[4769]: I1121 13:06:02.997386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvpk\" (UniqueName: \"kubernetes.io/projected/174d4344-c28a-4ec2-bd00-9562557ed4bc-kube-api-access-qxvpk\") pod \"keystone-bootstrap-ckmvs\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.211311 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.236832 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.283164 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d80964a-f221-41ee-9036-08580cbc27a6" path="/var/lib/kubelet/pods/4d80964a-f221-41ee-9036-08580cbc27a6/volumes" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.284026 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c09ccae-15b1-4125-bb6d-5c56e534b078" path="/var/lib/kubelet/pods/6c09ccae-15b1-4125-bb6d-5c56e534b078/volumes" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.284708 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80553aa8-7365-4268-a23b-e638e327dcb3" path="/var/lib/kubelet/pods/80553aa8-7365-4268-a23b-e638e327dcb3/volumes" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-log-httpd\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-config-data\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-scripts\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-sg-core-conf-yaml\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6x26\" (UniqueName: \"kubernetes.io/projected/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-kube-api-access-q6x26\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-run-httpd\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.287711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-combined-ca-bundle\") pod \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\" (UID: \"845d7f3c-b4a7-4e8e-8878-3c40feb541fe\") " Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.294301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-scripts" (OuterVolumeSpecName: "scripts") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.294518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.296433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.298492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-kube-api-access-q6x26" (OuterVolumeSpecName: "kube-api-access-q6x26") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "kube-api-access-q6x26". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.341491 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.344069 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: W1121 13:06:03.345603 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode165180a_fd0c_4373_aed2_1ea6a8dd7e91.slice/crio-32775c500c8d1081b468f48ae7e88261208c7a17fc4f905cf4dd83b9d17e6ae9 WatchSource:0}: Error finding container 32775c500c8d1081b468f48ae7e88261208c7a17fc4f905cf4dd83b9d17e6ae9: Status 404 returned error can't find the container with id 32775c500c8d1081b468f48ae7e88261208c7a17fc4f905cf4dd83b9d17e6ae9 Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.376909 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.384460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387277 4769 generic.go:334] "Generic (PLEG): container finished" podID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" exitCode=0 Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387317 4769 generic.go:334] "Generic (PLEG): container finished" podID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" exitCode=2 Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387327 4769 generic.go:334] "Generic (PLEG): container finished" podID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" exitCode=0 Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387362 4769 generic.go:334] "Generic (PLEG): container finished" podID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" exitCode=0 Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerDied","Data":"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df"} Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerDied","Data":"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b"} Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387465 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerDied","Data":"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5"} Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerDied","Data":"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54"} Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"845d7f3c-b4a7-4e8e-8878-3c40feb541fe","Type":"ContainerDied","Data":"cba95faa5a736cfce87b162e43dcf2b57bd2f3a8db9eb7fec23f28d12de5f59b"} Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387507 4769 scope.go:117] "RemoveContainer" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.387678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.389955 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q6x26\" (UniqueName: \"kubernetes.io/projected/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-kube-api-access-q6x26\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.389978 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.389989 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.390000 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.390012 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.390021 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.419415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-config-data" (OuterVolumeSpecName: "config-data") pod "845d7f3c-b4a7-4e8e-8878-3c40feb541fe" (UID: "845d7f3c-b4a7-4e8e-8878-3c40feb541fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.425034 4769 scope.go:117] "RemoveContainer" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.452893 4769 scope.go:117] "RemoveContainer" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.518151 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845d7f3c-b4a7-4e8e-8878-3c40feb541fe-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.519051 4769 scope.go:117] "RemoveContainer" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.581886 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.589385 4769 scope.go:117] "RemoveContainer" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.589808 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": container with ID starting with eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df not found: ID does not exist" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.589863 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df"} err="failed to get container status \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": rpc error: code = NotFound desc = could not find container \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": container with ID starting with eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.589898 4769 scope.go:117] "RemoveContainer" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.590521 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": container with ID starting with 25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b not found: ID does not exist" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.590552 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b"} err="failed to get container status \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": rpc error: code = NotFound desc = could not find container \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": container with ID starting with 25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.590569 4769 scope.go:117] "RemoveContainer" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.590726 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": container with ID starting with 5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5 not found: ID does not exist" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.590751 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5"} err="failed to get container status \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": rpc error: code = NotFound desc = could not find container \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": container with ID starting with 5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.590765 4769 scope.go:117] "RemoveContainer" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.602481 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": container with ID starting with e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54 not found: ID does not exist" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.602537 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54"} err="failed to get container status \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": rpc error: code = NotFound desc = could not find container \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": container with ID starting with e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.602565 4769 scope.go:117] "RemoveContainer" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.604166 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df"} err="failed to get container status \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": rpc error: code = NotFound desc = could not find container \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": container with ID starting with eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.604213 4769 scope.go:117] "RemoveContainer" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.610325 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b"} err="failed to get container status \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": rpc error: code = NotFound desc = could not find container \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": container with ID starting with 25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.610377 4769 scope.go:117] "RemoveContainer" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.612335 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5"} err="failed to get container status \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": rpc error: code = NotFound desc = could not find container \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": container with ID starting with 5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.612385 4769 scope.go:117] "RemoveContainer" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.616430 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54"} err="failed to get container status \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": rpc error: code = NotFound desc = could not find container \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": container with ID starting with e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.616466 4769 scope.go:117] "RemoveContainer" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.626398 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df"} err="failed to get container status \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": rpc error: code = NotFound desc = could not find container \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": container with ID starting with eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.626440 4769 scope.go:117] "RemoveContainer" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.632829 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b"} err="failed to get container status \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": rpc error: code = NotFound desc = could not find container \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": container with ID starting with 25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.632870 4769 scope.go:117] "RemoveContainer" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.640326 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5"} err="failed to get container status \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": rpc error: code = NotFound desc = could not find container \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": container with ID starting with 5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.640374 4769 scope.go:117] "RemoveContainer" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.644276 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54"} err="failed to get container status \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": rpc error: code = NotFound desc = could not find container \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": container with ID starting with e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.644307 4769 scope.go:117] "RemoveContainer" containerID="eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.652816 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df"} err="failed to get container status \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": rpc error: code = NotFound desc = could not find container \"eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df\": container with ID starting with eafcc0b9db3b92499d165a7963ceb941c70662ba612b61833d8f2fc9e9e5a8df not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.652860 4769 scope.go:117] "RemoveContainer" containerID="25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.656284 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b"} err="failed to get container status \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": rpc error: code = NotFound desc = could not find container \"25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b\": container with ID starting with 25426a1ce7b84f115798d2adab8c42fb98f679bef549e6de32969654e23f3b6b not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.656317 4769 scope.go:117] "RemoveContainer" containerID="5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.696377 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5"} err="failed to get container status \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": rpc error: code = NotFound desc = could not find container \"5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5\": container with ID starting with 5633486ae644a571c741ecd435be16f30b865bc59a06ed3fadfc57f919b46dc5 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.696421 4769 scope.go:117] "RemoveContainer" containerID="e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.707338 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54"} err="failed to get container status \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": rpc error: code = NotFound desc = could not find container \"e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54\": container with ID starting with e02edac8ac3edd6187ecd390fab685d92377456c5c5b5fb104427be28cfbab54 not found: ID does not exist" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.781011 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.790004 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.816279 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckmvs"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.822298 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.822683 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="proxy-httpd" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.822695 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="proxy-httpd" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.822718 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="sg-core" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.824841 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="sg-core" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.824876 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-central-agent" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.824885 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-central-agent" Nov 21 13:06:03 crc kubenswrapper[4769]: E1121 13:06:03.824894 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-notification-agent" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.824900 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-notification-agent" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.825066 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-central-agent" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.825086 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="proxy-httpd" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.825100 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="sg-core" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.825118 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" containerName="ceilometer-notification-agent" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.832236 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.832625 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.834883 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.835158 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjhzl\" (UniqueName: \"kubernetes.io/projected/4930ac51-2d41-497c-a563-d70b8090cead-kube-api-access-rjhzl\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-log-httpd\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-scripts\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-run-httpd\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-config-data\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:03 crc kubenswrapper[4769]: I1121 13:06:03.928933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030419 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-run-httpd\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-config-data\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rjhzl\" (UniqueName: \"kubernetes.io/projected/4930ac51-2d41-497c-a563-d70b8090cead-kube-api-access-rjhzl\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-log-httpd\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-scripts\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.030908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-run-httpd\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.031085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-log-httpd\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.034618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.035062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.035668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-scripts\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.037757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-config-data\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.047307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjhzl\" (UniqueName: \"kubernetes.io/projected/4930ac51-2d41-497c-a563-d70b8090cead-kube-api-access-rjhzl\") pod \"ceilometer-0\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.198429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.404686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b1a44c8c-1b3f-4002-8650-9092eba38890","Type":"ContainerStarted","Data":"eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.405067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b1a44c8c-1b3f-4002-8650-9092eba38890","Type":"ContainerStarted","Data":"6161612e877ffc16ce851a706415f111235cffefa417fe73edd0819542ff86e1"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.409508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" event={"ID":"6b07ece4-f42b-4b10-9c27-51b2f210ff9c","Type":"ContainerStarted","Data":"e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.409554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" event={"ID":"6b07ece4-f42b-4b10-9c27-51b2f210ff9c","Type":"ContainerStarted","Data":"382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.409564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" event={"ID":"6b07ece4-f42b-4b10-9c27-51b2f210ff9c","Type":"ContainerStarted","Data":"0347245903a4e1cc155bec4ed51f5ad065850d9da57d5d7dfff0233069364c40"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.409675 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.409986 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.414836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" event={"ID":"174d4344-c28a-4ec2-bd00-9562557ed4bc","Type":"ContainerStarted","Data":"c4bc0a9f2961e86bc7ef87ceccf472d3807e9aebc30013d37d525b5565b00a05"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.414872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" event={"ID":"174d4344-c28a-4ec2-bd00-9562557ed4bc","Type":"ContainerStarted","Data":"0de19b1bc9ab41d484f75ebd49d84e0ad22f71ed2ecbeaef135307ed0b093f9b"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.421349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e165180a-fd0c-4373-aed2-1ea6a8dd7e91","Type":"ContainerStarted","Data":"87cf2ddf1a99e6efe63f7bb15f2d315f31cd9dbf512a45a8508cb8d90a0303d9"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.421377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e165180a-fd0c-4373-aed2-1ea6a8dd7e91","Type":"ContainerStarted","Data":"32775c500c8d1081b468f48ae7e88261208c7a17fc4f905cf4dd83b9d17e6ae9"} Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.434127 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" podStartSLOduration=2.43410632 podStartE2EDuration="2.43410632s" podCreationTimestamp="2025-11-21 13:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:04.427582874 +0000 UTC m=+4523.128244692" watchObservedRunningTime="2025-11-21 13:06:04.43410632 +0000 UTC m=+4523.134768138" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.446049 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" podStartSLOduration=2.446033221 podStartE2EDuration="2.446033221s" podCreationTimestamp="2025-11-21 13:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:04.445446765 +0000 UTC m=+4523.146108573" watchObservedRunningTime="2025-11-21 13:06:04.446033221 +0000 UTC m=+4523.146695039" Nov 21 13:06:04 crc kubenswrapper[4769]: I1121 13:06:04.687651 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:04 crc kubenswrapper[4769]: W1121 13:06:04.704038 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4930ac51_2d41_497c_a563_d70b8090cead.slice/crio-ce779cf995c407bd33b6294ac4f95dc954395d1a897753acd5e464c3a0924ac3 WatchSource:0}: Error finding container ce779cf995c407bd33b6294ac4f95dc954395d1a897753acd5e464c3a0924ac3: Status 404 returned error can't find the container with id ce779cf995c407bd33b6294ac4f95dc954395d1a897753acd5e464c3a0924ac3 Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.289129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845d7f3c-b4a7-4e8e-8878-3c40feb541fe" path="/var/lib/kubelet/pods/845d7f3c-b4a7-4e8e-8878-3c40feb541fe/volumes" Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.451612 4769 generic.go:334] "Generic (PLEG): container finished" podID="cf189434-e3fa-4580-8375-2558a80d4110" containerID="9c09e34129e450d3235f71c7f47fa027430be6695e0ad775fde53c82a561d2f1" exitCode=0 Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.451713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" event={"ID":"cf189434-e3fa-4580-8375-2558a80d4110","Type":"ContainerDied","Data":"9c09e34129e450d3235f71c7f47fa027430be6695e0ad775fde53c82a561d2f1"} Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.456466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e165180a-fd0c-4373-aed2-1ea6a8dd7e91","Type":"ContainerStarted","Data":"b891c565e76b9494353fcdcbe809fe3b252a046220e933a441169a11153e8285"} Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.458046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerStarted","Data":"ce779cf995c407bd33b6294ac4f95dc954395d1a897753acd5e464c3a0924ac3"} Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.460415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b1a44c8c-1b3f-4002-8650-9092eba38890","Type":"ContainerStarted","Data":"93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb"} Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.539298 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.539262341 podStartE2EDuration="3.539262341s" podCreationTimestamp="2025-11-21 13:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:05.505478431 +0000 UTC m=+4524.206140259" watchObservedRunningTime="2025-11-21 13:06:05.539262341 +0000 UTC m=+4524.239924159" Nov 21 13:06:05 crc kubenswrapper[4769]: I1121 13:06:05.546688 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.54666494 podStartE2EDuration="3.54666494s" podCreationTimestamp="2025-11-21 13:06:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:05.528009348 +0000 UTC m=+4524.228671186" watchObservedRunningTime="2025-11-21 13:06:05.54666494 +0000 UTC m=+4524.247326758" Nov 21 13:06:06 crc kubenswrapper[4769]: I1121 13:06:06.472106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerStarted","Data":"8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7"} Nov 21 13:06:06 crc kubenswrapper[4769]: I1121 13:06:06.908410 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.007467 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsd9d\" (UniqueName: \"kubernetes.io/projected/cf189434-e3fa-4580-8375-2558a80d4110-kube-api-access-fsd9d\") pod \"cf189434-e3fa-4580-8375-2558a80d4110\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.007877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-db-sync-config-data\") pod \"cf189434-e3fa-4580-8375-2558a80d4110\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.007962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-combined-ca-bundle\") pod \"cf189434-e3fa-4580-8375-2558a80d4110\" (UID: \"cf189434-e3fa-4580-8375-2558a80d4110\") " Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.012617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "cf189434-e3fa-4580-8375-2558a80d4110" (UID: "cf189434-e3fa-4580-8375-2558a80d4110"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.013072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf189434-e3fa-4580-8375-2558a80d4110-kube-api-access-fsd9d" (OuterVolumeSpecName: "kube-api-access-fsd9d") pod "cf189434-e3fa-4580-8375-2558a80d4110" (UID: "cf189434-e3fa-4580-8375-2558a80d4110"). InnerVolumeSpecName "kube-api-access-fsd9d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.034120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cf189434-e3fa-4580-8375-2558a80d4110" (UID: "cf189434-e3fa-4580-8375-2558a80d4110"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.109981 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.110020 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf189434-e3fa-4580-8375-2558a80d4110-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.110031 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fsd9d\" (UniqueName: \"kubernetes.io/projected/cf189434-e3fa-4580-8375-2558a80d4110-kube-api-access-fsd9d\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.486490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerStarted","Data":"3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807"} Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.490243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" event={"ID":"cf189434-e3fa-4580-8375-2558a80d4110","Type":"ContainerDied","Data":"d69b2bd3394a443eb2fad24ff73887e4e3541991ce5558904fb57e1d214fd93e"} Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.490277 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqkjd" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.490295 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d69b2bd3394a443eb2fad24ff73887e4e3541991ce5558904fb57e1d214fd93e" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.493445 4769 generic.go:334] "Generic (PLEG): container finished" podID="174d4344-c28a-4ec2-bd00-9562557ed4bc" containerID="c4bc0a9f2961e86bc7ef87ceccf472d3807e9aebc30013d37d525b5565b00a05" exitCode=0 Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.493713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" event={"ID":"174d4344-c28a-4ec2-bd00-9562557ed4bc","Type":"ContainerDied","Data":"c4bc0a9f2961e86bc7ef87ceccf472d3807e9aebc30013d37d525b5565b00a05"} Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.791708 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-545977b555-smlds"] Nov 21 13:06:07 crc kubenswrapper[4769]: E1121 13:06:07.792596 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cf189434-e3fa-4580-8375-2558a80d4110" containerName="barbican-db-sync" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.792610 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf189434-e3fa-4580-8375-2558a80d4110" containerName="barbican-db-sync" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.792795 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cf189434-e3fa-4580-8375-2558a80d4110" containerName="barbican-db-sync" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.793806 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.799967 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.800787 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.801555 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-krdlc" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.813872 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4"] Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.815234 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.817659 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.836260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-545977b555-smlds"] Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-combined-ca-bundle\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5e07bca-8e97-48d0-92bc-088424ad3566-logs\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851211 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdx4m\" (UniqueName: \"kubernetes.io/projected/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-kube-api-access-xdx4m\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28hp7\" (UniqueName: \"kubernetes.io/projected/d5e07bca-8e97-48d0-92bc-088424ad3566-kube-api-access-28hp7\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851265 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data-custom\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851318 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data-custom\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851385 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-combined-ca-bundle\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.851408 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-logs\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.856204 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4"] Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955220 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data-custom\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955276 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-combined-ca-bundle\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-logs\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955410 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-combined-ca-bundle\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5e07bca-8e97-48d0-92bc-088424ad3566-logs\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xdx4m\" (UniqueName: \"kubernetes.io/projected/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-kube-api-access-xdx4m\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-28hp7\" (UniqueName: \"kubernetes.io/projected/d5e07bca-8e97-48d0-92bc-088424ad3566-kube-api-access-28hp7\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.955542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data-custom\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.960086 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5e07bca-8e97-48d0-92bc-088424ad3566-logs\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.960424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-logs\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.964232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-combined-ca-bundle\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.964243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data-custom\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.964917 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-combined-ca-bundle\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.966043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data-custom\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.966545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.989445 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h"] Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.989922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-28hp7\" (UniqueName: \"kubernetes.io/projected/d5e07bca-8e97-48d0-92bc-088424ad3566-kube-api-access-28hp7\") pod \"barbican-keystone-listener-549d5d9cc4-l2wf4\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.992592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:07 crc kubenswrapper[4769]: I1121 13:06:07.994249 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdx4m\" (UniqueName: \"kubernetes.io/projected/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-kube-api-access-xdx4m\") pod \"barbican-worker-545977b555-smlds\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.026083 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h"] Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.026214 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.028896 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.056544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-combined-ca-bundle\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.056622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-logs\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.056814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.056934 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data-custom\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.056979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gfpx\" (UniqueName: \"kubernetes.io/projected/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-kube-api-access-7gfpx\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.114257 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.135907 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.157845 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-combined-ca-bundle\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.157907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-logs\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.157956 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.157991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data-custom\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.158010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7gfpx\" (UniqueName: \"kubernetes.io/projected/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-kube-api-access-7gfpx\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.159157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-logs\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.166606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data-custom\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.166686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-combined-ca-bundle\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.167470 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.174822 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gfpx\" (UniqueName: \"kubernetes.io/projected/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-kube-api-access-7gfpx\") pod \"barbican-api-64dd759dc4-2cf5h\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.420022 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.504874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerStarted","Data":"38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2"} Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.548282 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-545977b555-smlds"] Nov 21 13:06:08 crc kubenswrapper[4769]: I1121 13:06:08.698000 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4"] Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.008864 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.180747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-fernet-keys\") pod \"174d4344-c28a-4ec2-bd00-9562557ed4bc\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.180825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxvpk\" (UniqueName: \"kubernetes.io/projected/174d4344-c28a-4ec2-bd00-9562557ed4bc-kube-api-access-qxvpk\") pod \"174d4344-c28a-4ec2-bd00-9562557ed4bc\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.180883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-combined-ca-bundle\") pod \"174d4344-c28a-4ec2-bd00-9562557ed4bc\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.180947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-scripts\") pod \"174d4344-c28a-4ec2-bd00-9562557ed4bc\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.181082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-credential-keys\") pod \"174d4344-c28a-4ec2-bd00-9562557ed4bc\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.181113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-config-data\") pod \"174d4344-c28a-4ec2-bd00-9562557ed4bc\" (UID: \"174d4344-c28a-4ec2-bd00-9562557ed4bc\") " Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.193332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "174d4344-c28a-4ec2-bd00-9562557ed4bc" (UID: "174d4344-c28a-4ec2-bd00-9562557ed4bc"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.205396 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-scripts" (OuterVolumeSpecName: "scripts") pod "174d4344-c28a-4ec2-bd00-9562557ed4bc" (UID: "174d4344-c28a-4ec2-bd00-9562557ed4bc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.215500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/174d4344-c28a-4ec2-bd00-9562557ed4bc-kube-api-access-qxvpk" (OuterVolumeSpecName: "kube-api-access-qxvpk") pod "174d4344-c28a-4ec2-bd00-9562557ed4bc" (UID: "174d4344-c28a-4ec2-bd00-9562557ed4bc"). InnerVolumeSpecName "kube-api-access-qxvpk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.227174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "174d4344-c28a-4ec2-bd00-9562557ed4bc" (UID: "174d4344-c28a-4ec2-bd00-9562557ed4bc"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.235422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-config-data" (OuterVolumeSpecName: "config-data") pod "174d4344-c28a-4ec2-bd00-9562557ed4bc" (UID: "174d4344-c28a-4ec2-bd00-9562557ed4bc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.285748 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.285778 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.285789 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.285798 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.285808 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qxvpk\" (UniqueName: \"kubernetes.io/projected/174d4344-c28a-4ec2-bd00-9562557ed4bc-kube-api-access-qxvpk\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.291400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "174d4344-c28a-4ec2-bd00-9562557ed4bc" (UID: "174d4344-c28a-4ec2-bd00-9562557ed4bc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.307766 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h"] Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.388126 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174d4344-c28a-4ec2-bd00-9562557ed4bc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.529846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" event={"ID":"34d9b7a1-331f-4fb4-af14-8b1f5eac551f","Type":"ContainerStarted","Data":"561304b20e3cc09db149d545cd2946b998e28ae08b9b4a65a22774775af003d9"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.529937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" event={"ID":"34d9b7a1-331f-4fb4-af14-8b1f5eac551f","Type":"ContainerStarted","Data":"4c684dae9414fbb059418016a2b44cb6a70903a535b97610d33a15b8daf702f0"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.532122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" event={"ID":"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d","Type":"ContainerStarted","Data":"a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.532165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" event={"ID":"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d","Type":"ContainerStarted","Data":"78e7fdb4dbc7898b4fc72ba103837107092071fafff96b19f1f51095fdc5eab3"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.534736 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.534730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-ckmvs" event={"ID":"174d4344-c28a-4ec2-bd00-9562557ed4bc","Type":"ContainerDied","Data":"0de19b1bc9ab41d484f75ebd49d84e0ad22f71ed2ecbeaef135307ed0b093f9b"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.534875 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0de19b1bc9ab41d484f75ebd49d84e0ad22f71ed2ecbeaef135307ed0b093f9b" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.538273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" event={"ID":"d5e07bca-8e97-48d0-92bc-088424ad3566","Type":"ContainerStarted","Data":"a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.538338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" event={"ID":"d5e07bca-8e97-48d0-92bc-088424ad3566","Type":"ContainerStarted","Data":"b333809b061bb187404ceac06c15cfaec8862c2363a5c75e87ff6702afc27282"} Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.661182 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5675c77c96-r99x8"] Nov 21 13:06:09 crc kubenswrapper[4769]: E1121 13:06:09.661559 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="174d4344-c28a-4ec2-bd00-9562557ed4bc" containerName="keystone-bootstrap" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.661578 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="174d4344-c28a-4ec2-bd00-9562557ed4bc" containerName="keystone-bootstrap" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.661766 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="174d4344-c28a-4ec2-bd00-9562557ed4bc" containerName="keystone-bootstrap" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.662333 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.664152 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.664370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.664646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.665317 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.665563 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-n6lk4" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.668370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.682216 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5675c77c96-r99x8"] Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-combined-ca-bundle\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-credential-keys\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797322 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-config-data\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95zls\" (UniqueName: \"kubernetes.io/projected/619cbb7a-cb38-4111-a1c4-e681e36233ab-kube-api-access-95zls\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797441 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-public-tls-certs\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-internal-tls-certs\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-fernet-keys\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.797524 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-scripts\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-internal-tls-certs\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899591 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-fernet-keys\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-scripts\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-combined-ca-bundle\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-credential-keys\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-config-data\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-95zls\" (UniqueName: \"kubernetes.io/projected/619cbb7a-cb38-4111-a1c4-e681e36233ab-kube-api-access-95zls\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.899917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-public-tls-certs\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.904323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-scripts\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.904425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-credential-keys\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.905490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-internal-tls-certs\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.905742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-combined-ca-bundle\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.905902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-fernet-keys\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.907810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-public-tls-certs\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.910840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-config-data\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.921799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zls\" (UniqueName: \"kubernetes.io/projected/619cbb7a-cb38-4111-a1c4-e681e36233ab-kube-api-access-95zls\") pod \"keystone-5675c77c96-r99x8\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:09 crc kubenswrapper[4769]: I1121 13:06:09.979582 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.273835 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:06:10 crc kubenswrapper[4769]: E1121 13:06:10.274096 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.439394 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq"] Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.443357 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.446404 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.446441 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.459158 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq"] Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.564524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" event={"ID":"34d9b7a1-331f-4fb4-af14-8b1f5eac551f","Type":"ContainerStarted","Data":"eb18b051a214916baee7970903bde33fae95110afb173063aa4b3c8980344411"} Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.564800 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.564818 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.567519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" event={"ID":"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d","Type":"ContainerStarted","Data":"b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597"} Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.569591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" event={"ID":"d5e07bca-8e97-48d0-92bc-088424ad3566","Type":"ContainerStarted","Data":"8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039"} Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54gkc\" (UniqueName: \"kubernetes.io/projected/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-kube-api-access-54gkc\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-combined-ca-bundle\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613290 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-logs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.613456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data-custom\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.621956 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" podStartSLOduration=3.621933672 podStartE2EDuration="3.621933672s" podCreationTimestamp="2025-11-21 13:06:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:10.586806006 +0000 UTC m=+4529.287467824" watchObservedRunningTime="2025-11-21 13:06:10.621933672 +0000 UTC m=+4529.322595490" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.635783 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" podStartSLOduration=3.635759534 podStartE2EDuration="3.635759534s" podCreationTimestamp="2025-11-21 13:06:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:10.604434561 +0000 UTC m=+4529.305096379" watchObservedRunningTime="2025-11-21 13:06:10.635759534 +0000 UTC m=+4529.336421342" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.644892 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" podStartSLOduration=3.64487267 podStartE2EDuration="3.64487267s" podCreationTimestamp="2025-11-21 13:06:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:10.618602642 +0000 UTC m=+4529.319264460" watchObservedRunningTime="2025-11-21 13:06:10.64487267 +0000 UTC m=+4529.345534498" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.716977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-logs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.717069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data-custom\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.717164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.717205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.717237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-54gkc\" (UniqueName: \"kubernetes.io/projected/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-kube-api-access-54gkc\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.717303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-combined-ca-bundle\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.717351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.719155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-logs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.723711 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.730602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-combined-ca-bundle\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.730917 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data-custom\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.731324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.734665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-54gkc\" (UniqueName: \"kubernetes.io/projected/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-kube-api-access-54gkc\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.736205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs\") pod \"barbican-api-7ff6cb4844-z2dlq\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.918057 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:10 crc kubenswrapper[4769]: I1121 13:06:10.936767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5675c77c96-r99x8"] Nov 21 13:06:10 crc kubenswrapper[4769]: W1121 13:06:10.942733 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod619cbb7a_cb38_4111_a1c4_e681e36233ab.slice/crio-6e2e98c4a5a536645e88ee7d61abebc32df36bbfb8cea3b533d583a61bc3af3d WatchSource:0}: Error finding container 6e2e98c4a5a536645e88ee7d61abebc32df36bbfb8cea3b533d583a61bc3af3d: Status 404 returned error can't find the container with id 6e2e98c4a5a536645e88ee7d61abebc32df36bbfb8cea3b533d583a61bc3af3d Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.368172 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq"] Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.609510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" event={"ID":"491af14f-6c9a-4c2a-8d91-bea7d7735b8b","Type":"ContainerStarted","Data":"8ac7c8cc818f3b0c2665bbd8d4d29e73b0a9c1dc1efd3197d5741d4d1d929907"} Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.609825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" event={"ID":"491af14f-6c9a-4c2a-8d91-bea7d7735b8b","Type":"ContainerStarted","Data":"32ac5e93c6f5986ae54fb9328d0dfa24e87e9ed7d289ad8dc80d29648c705df1"} Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.612417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" event={"ID":"619cbb7a-cb38-4111-a1c4-e681e36233ab","Type":"ContainerStarted","Data":"5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5"} Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.612455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" event={"ID":"619cbb7a-cb38-4111-a1c4-e681e36233ab","Type":"ContainerStarted","Data":"6e2e98c4a5a536645e88ee7d61abebc32df36bbfb8cea3b533d583a61bc3af3d"} Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.612871 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.617248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerStarted","Data":"2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758"} Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.617961 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.641396 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" podStartSLOduration=2.6413764950000003 podStartE2EDuration="2.641376495s" podCreationTimestamp="2025-11-21 13:06:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:11.63043171 +0000 UTC m=+4530.331093528" watchObservedRunningTime="2025-11-21 13:06:11.641376495 +0000 UTC m=+4530.342038313" Nov 21 13:06:11 crc kubenswrapper[4769]: I1121 13:06:11.657565 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.554304746 podStartE2EDuration="8.65754378s" podCreationTimestamp="2025-11-21 13:06:03 +0000 UTC" firstStartedPulling="2025-11-21 13:06:04.709461125 +0000 UTC m=+4523.410122943" lastFinishedPulling="2025-11-21 13:06:10.812700159 +0000 UTC m=+4529.513361977" observedRunningTime="2025-11-21 13:06:11.650606863 +0000 UTC m=+4530.351268681" watchObservedRunningTime="2025-11-21 13:06:11.65754378 +0000 UTC m=+4530.358205598" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.627498 4769 generic.go:334] "Generic (PLEG): container finished" podID="79d74527-af39-47db-bf0c-cbc8279db923" containerID="267ade2d6a9db457b9d33049d1a504f14771153c3278657faede3de73a013513" exitCode=0 Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.628405 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" event={"ID":"79d74527-af39-47db-bf0c-cbc8279db923","Type":"ContainerDied","Data":"267ade2d6a9db457b9d33049d1a504f14771153c3278657faede3de73a013513"} Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.631886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" event={"ID":"491af14f-6c9a-4c2a-8d91-bea7d7735b8b","Type":"ContainerStarted","Data":"263209e6e99bea049c297f4ae79528351ec7d169f959e143b96a2f8a50222170"} Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.632115 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.632313 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.665938 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" podStartSLOduration=2.665923085 podStartE2EDuration="2.665923085s" podCreationTimestamp="2025-11-21 13:06:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:12.662709598 +0000 UTC m=+4531.363371416" watchObservedRunningTime="2025-11-21 13:06:12.665923085 +0000 UTC m=+4531.366584903" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.810371 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.810419 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.820519 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.820771 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.878872 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.937626 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.944482 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:12 crc kubenswrapper[4769]: I1121 13:06:12.950025 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:13 crc kubenswrapper[4769]: I1121 13:06:13.646440 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:13 crc kubenswrapper[4769]: I1121 13:06:13.646758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:13 crc kubenswrapper[4769]: I1121 13:06:13.646779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:13 crc kubenswrapper[4769]: I1121 13:06:13.646794 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.049499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.117437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-db-sync-config-data\") pod \"79d74527-af39-47db-bf0c-cbc8279db923\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.117538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-combined-ca-bundle\") pod \"79d74527-af39-47db-bf0c-cbc8279db923\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.117676 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/79d74527-af39-47db-bf0c-cbc8279db923-etc-machine-id\") pod \"79d74527-af39-47db-bf0c-cbc8279db923\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.117712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-scripts\") pod \"79d74527-af39-47db-bf0c-cbc8279db923\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.117749 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-config-data\") pod \"79d74527-af39-47db-bf0c-cbc8279db923\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.117816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdkj6\" (UniqueName: \"kubernetes.io/projected/79d74527-af39-47db-bf0c-cbc8279db923-kube-api-access-hdkj6\") pod \"79d74527-af39-47db-bf0c-cbc8279db923\" (UID: \"79d74527-af39-47db-bf0c-cbc8279db923\") " Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.118274 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/79d74527-af39-47db-bf0c-cbc8279db923-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "79d74527-af39-47db-bf0c-cbc8279db923" (UID: "79d74527-af39-47db-bf0c-cbc8279db923"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.125547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "79d74527-af39-47db-bf0c-cbc8279db923" (UID: "79d74527-af39-47db-bf0c-cbc8279db923"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.131304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-scripts" (OuterVolumeSpecName: "scripts") pod "79d74527-af39-47db-bf0c-cbc8279db923" (UID: "79d74527-af39-47db-bf0c-cbc8279db923"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.136505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d74527-af39-47db-bf0c-cbc8279db923-kube-api-access-hdkj6" (OuterVolumeSpecName: "kube-api-access-hdkj6") pod "79d74527-af39-47db-bf0c-cbc8279db923" (UID: "79d74527-af39-47db-bf0c-cbc8279db923"). InnerVolumeSpecName "kube-api-access-hdkj6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.178568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "79d74527-af39-47db-bf0c-cbc8279db923" (UID: "79d74527-af39-47db-bf0c-cbc8279db923"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.190438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-config-data" (OuterVolumeSpecName: "config-data") pod "79d74527-af39-47db-bf0c-cbc8279db923" (UID: "79d74527-af39-47db-bf0c-cbc8279db923"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.219564 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/79d74527-af39-47db-bf0c-cbc8279db923-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.219596 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.219605 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.219615 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hdkj6\" (UniqueName: \"kubernetes.io/projected/79d74527-af39-47db-bf0c-cbc8279db923-kube-api-access-hdkj6\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.219626 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.219634 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79d74527-af39-47db-bf0c-cbc8279db923-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.654918 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.668259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-z4n4m" event={"ID":"79d74527-af39-47db-bf0c-cbc8279db923","Type":"ContainerDied","Data":"f5cbb6be1058de58e84f152746a06e1ce174b33769e0ce7ed0eae67602f71e19"} Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.668338 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5cbb6be1058de58e84f152746a06e1ce174b33769e0ce7ed0eae67602f71e19" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.957746 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:14 crc kubenswrapper[4769]: E1121 13:06:14.958437 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="79d74527-af39-47db-bf0c-cbc8279db923" containerName="cinder-db-sync" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.958469 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d74527-af39-47db-bf0c-cbc8279db923" containerName="cinder-db-sync" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.958673 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="79d74527-af39-47db-bf0c-cbc8279db923" containerName="cinder-db-sync" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.959672 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.962485 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.962650 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.962757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-llfwb" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.962904 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:06:14 crc kubenswrapper[4769]: I1121 13:06:14.980050 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.035349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/55cd7967-3e65-4d19-8741-58256e6e760c-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.035401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-scripts\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.035423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4v7q\" (UniqueName: \"kubernetes.io/projected/55cd7967-3e65-4d19-8741-58256e6e760c-kube-api-access-m4v7q\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.035460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.035493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.035564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.056737 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.058100 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.059827 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.069673 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137174 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137231 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data-custom\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/55cd7967-3e65-4d19-8741-58256e6e760c-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-scripts\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m4v7q\" (UniqueName: \"kubernetes.io/projected/55cd7967-3e65-4d19-8741-58256e6e760c-kube-api-access-m4v7q\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-scripts\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7thtv\" (UniqueName: \"kubernetes.io/projected/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-kube-api-access-7thtv\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-logs\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.137544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/55cd7967-3e65-4d19-8741-58256e6e760c-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.144459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.145364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.147290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-scripts\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.155932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.157790 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4v7q\" (UniqueName: \"kubernetes.io/projected/55cd7967-3e65-4d19-8741-58256e6e760c-kube-api-access-m4v7q\") pod \"cinder-scheduler-0\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238434 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data-custom\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-scripts\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7thtv\" (UniqueName: \"kubernetes.io/projected/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-kube-api-access-7thtv\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-logs\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.238696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.239508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-logs\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.239598 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-etc-machine-id\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.241932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data-custom\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.242619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-scripts\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.246615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.248055 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.257834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7thtv\" (UniqueName: \"kubernetes.io/projected/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-kube-api-access-7thtv\") pod \"cinder-api-0\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.284581 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.376519 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.668023 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.668289 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.796920 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.946626 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.946727 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.948836 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.949425 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:15 crc kubenswrapper[4769]: I1121 13:06:15.981625 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:16 crc kubenswrapper[4769]: I1121 13:06:16.217425 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:06:16 crc kubenswrapper[4769]: I1121 13:06:16.787328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"55cd7967-3e65-4d19-8741-58256e6e760c","Type":"ContainerStarted","Data":"08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957"} Nov 21 13:06:16 crc kubenswrapper[4769]: I1121 13:06:16.787371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"55cd7967-3e65-4d19-8741-58256e6e760c","Type":"ContainerStarted","Data":"677015d095c8aa77b36a3d2fd02af9ed48626c38262a431a8a801ca33d119ef1"} Nov 21 13:06:16 crc kubenswrapper[4769]: I1121 13:06:16.798475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5","Type":"ContainerStarted","Data":"107f023f3286865143afe15f57637d4855961f41a25be6bae0c9ae9c0805feb1"} Nov 21 13:06:17 crc kubenswrapper[4769]: I1121 13:06:17.355046 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:17 crc kubenswrapper[4769]: I1121 13:06:17.808782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5","Type":"ContainerStarted","Data":"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c"} Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.818897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"55cd7967-3e65-4d19-8741-58256e6e760c","Type":"ContainerStarted","Data":"5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85"} Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.820859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5","Type":"ContainerStarted","Data":"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f"} Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.821025 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api-log" containerID="cri-o://1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c" gracePeriod=30 Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.821107 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.821078 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api" containerID="cri-o://ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f" gracePeriod=30 Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.843343 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.843324696 podStartE2EDuration="4.843324696s" podCreationTimestamp="2025-11-21 13:06:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:18.840060798 +0000 UTC m=+4537.540722616" watchObservedRunningTime="2025-11-21 13:06:18.843324696 +0000 UTC m=+4537.543986514" Nov 21 13:06:18 crc kubenswrapper[4769]: I1121 13:06:18.862991 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.862978075 podStartE2EDuration="3.862978075s" podCreationTimestamp="2025-11-21 13:06:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:18.857146488 +0000 UTC m=+4537.557808316" watchObservedRunningTime="2025-11-21 13:06:18.862978075 +0000 UTC m=+4537.563639893" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.431424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.543904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-logs\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.544018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-scripts\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.544087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.544218 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-combined-ca-bundle\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.544273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7thtv\" (UniqueName: \"kubernetes.io/projected/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-kube-api-access-7thtv\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.544402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-logs" (OuterVolumeSpecName: "logs") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.544906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-etc-machine-id\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.545062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data-custom\") pod \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\" (UID: \"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5\") " Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.545254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.545837 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.545879 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.549686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-kube-api-access-7thtv" (OuterVolumeSpecName: "kube-api-access-7thtv") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "kube-api-access-7thtv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.549864 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.550156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-scripts" (OuterVolumeSpecName: "scripts") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.580835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.596335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data" (OuterVolumeSpecName: "config-data") pod "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" (UID: "d7ff3e39-5bee-41f0-8a40-29ed09a81bb5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.647393 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.647422 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.647432 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.647444 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7thtv\" (UniqueName: \"kubernetes.io/projected/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-kube-api-access-7thtv\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.647453 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.832324 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerID="ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f" exitCode=0 Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.832579 4769 generic.go:334] "Generic (PLEG): container finished" podID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerID="1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c" exitCode=143 Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.832381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5","Type":"ContainerDied","Data":"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f"} Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.833630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5","Type":"ContainerDied","Data":"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c"} Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.833648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"d7ff3e39-5bee-41f0-8a40-29ed09a81bb5","Type":"ContainerDied","Data":"107f023f3286865143afe15f57637d4855961f41a25be6bae0c9ae9c0805feb1"} Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.833669 4769 scope.go:117] "RemoveContainer" containerID="ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.832423 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.838380 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.860631 4769 scope.go:117] "RemoveContainer" containerID="1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.897627 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.897730 4769 scope.go:117] "RemoveContainer" containerID="ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f" Nov 21 13:06:19 crc kubenswrapper[4769]: E1121 13:06:19.898238 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f\": container with ID starting with ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f not found: ID does not exist" containerID="ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.898286 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f"} err="failed to get container status \"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f\": rpc error: code = NotFound desc = could not find container \"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f\": container with ID starting with ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f not found: ID does not exist" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.898317 4769 scope.go:117] "RemoveContainer" containerID="1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c" Nov 21 13:06:19 crc kubenswrapper[4769]: E1121 13:06:19.904363 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c\": container with ID starting with 1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c not found: ID does not exist" containerID="1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.904420 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c"} err="failed to get container status \"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c\": rpc error: code = NotFound desc = could not find container \"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c\": container with ID starting with 1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c not found: ID does not exist" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.904452 4769 scope.go:117] "RemoveContainer" containerID="ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.905764 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f"} err="failed to get container status \"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f\": rpc error: code = NotFound desc = could not find container \"ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f\": container with ID starting with ec9337056f6d54769e7a8cce81e5fbdea90f94aaaa81594a001b3a5c1f08035f not found: ID does not exist" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.905806 4769 scope.go:117] "RemoveContainer" containerID="1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.911066 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c"} err="failed to get container status \"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c\": rpc error: code = NotFound desc = could not find container \"1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c\": container with ID starting with 1a045fe8357b7b4335593907b9c6e6da207beee881e9f33bd77d6606d7adbe8c not found: ID does not exist" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.922370 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.943459 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:19 crc kubenswrapper[4769]: E1121 13:06:19.943937 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api-log" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.943961 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api-log" Nov 21 13:06:19 crc kubenswrapper[4769]: E1121 13:06:19.943995 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.944006 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.944229 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api-log" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.944253 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" containerName="cinder-api" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.945203 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.948156 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.948847 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.949006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:06:19 crc kubenswrapper[4769]: I1121 13:06:19.954842 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055280 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrzj\" (UniqueName: \"kubernetes.io/projected/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-kube-api-access-wvrzj\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-scripts\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055509 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-logs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055529 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data-custom\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.055594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-logs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157419 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data-custom\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrzj\" (UniqueName: \"kubernetes.io/projected/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-kube-api-access-wvrzj\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-scripts\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.157955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-logs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.158175 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.162071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.162209 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data-custom\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.162461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.162661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-scripts\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.163334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.164710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.182412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrzj\" (UniqueName: \"kubernetes.io/projected/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-kube-api-access-wvrzj\") pod \"cinder-api-0\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.194370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.284758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.317228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:20 crc kubenswrapper[4769]: I1121 13:06:20.933426 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:06:21 crc kubenswrapper[4769]: I1121 13:06:21.290911 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7ff3e39-5bee-41f0-8a40-29ed09a81bb5" path="/var/lib/kubelet/pods/d7ff3e39-5bee-41f0-8a40-29ed09a81bb5/volumes" Nov 21 13:06:21 crc kubenswrapper[4769]: I1121 13:06:21.870685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d","Type":"ContainerStarted","Data":"30d652a9a49d090d723d66f02b0ab264256a633cb21c77bfd004d1c5f0a489bc"} Nov 21 13:06:21 crc kubenswrapper[4769]: I1121 13:06:21.871086 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d","Type":"ContainerStarted","Data":"c38d26559a7a24ec353e39c4c18897d2b4d84a1b979cfd211e39fec33fa1d0cb"} Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.275173 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:06:22 crc kubenswrapper[4769]: E1121 13:06:22.275473 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.366631 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.428442 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.488384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h"] Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.488652 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api-log" containerID="cri-o://561304b20e3cc09db149d545cd2946b998e28ae08b9b4a65a22774775af003d9" gracePeriod=30 Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.488792 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api" containerID="cri-o://eb18b051a214916baee7970903bde33fae95110afb173063aa4b3c8980344411" gracePeriod=30 Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.879794 4769 generic.go:334] "Generic (PLEG): container finished" podID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerID="561304b20e3cc09db149d545cd2946b998e28ae08b9b4a65a22774775af003d9" exitCode=143 Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.879862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" event={"ID":"34d9b7a1-331f-4fb4-af14-8b1f5eac551f","Type":"ContainerDied","Data":"561304b20e3cc09db149d545cd2946b998e28ae08b9b4a65a22774775af003d9"} Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.881931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d","Type":"ContainerStarted","Data":"c77a0ea94735b319c12892e52033c1d8879ac78c6cf76d01a1f3e0e415d6e302"} Nov 21 13:06:22 crc kubenswrapper[4769]: I1121 13:06:22.905339 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.905315372 podStartE2EDuration="3.905315372s" podCreationTimestamp="2025-11-21 13:06:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:22.901221742 +0000 UTC m=+4541.601883590" watchObservedRunningTime="2025-11-21 13:06:22.905315372 +0000 UTC m=+4541.605977200" Nov 21 13:06:23 crc kubenswrapper[4769]: I1121 13:06:23.896147 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.507471 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.585648 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.670013 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.68:9311/healthcheck\": read tcp 10.217.0.2:55310->10.217.1.68:9311: read: connection reset by peer" Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.670053 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.68:9311/healthcheck\": read tcp 10.217.0.2:55302->10.217.1.68:9311: read: connection reset by peer" Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.923844 4769 generic.go:334] "Generic (PLEG): container finished" podID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerID="eb18b051a214916baee7970903bde33fae95110afb173063aa4b3c8980344411" exitCode=0 Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.923890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" event={"ID":"34d9b7a1-331f-4fb4-af14-8b1f5eac551f","Type":"ContainerDied","Data":"eb18b051a214916baee7970903bde33fae95110afb173063aa4b3c8980344411"} Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.924352 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="cinder-scheduler" containerID="cri-o://08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957" gracePeriod=30 Nov 21 13:06:25 crc kubenswrapper[4769]: I1121 13:06:25.924371 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="probe" containerID="cri-o://5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85" gracePeriod=30 Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.679625 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.826502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-logs\") pod \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.826569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data-custom\") pod \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.826659 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data\") pod \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.826722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gfpx\" (UniqueName: \"kubernetes.io/projected/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-kube-api-access-7gfpx\") pod \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.826840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-combined-ca-bundle\") pod \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\" (UID: \"34d9b7a1-331f-4fb4-af14-8b1f5eac551f\") " Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.826962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-logs" (OuterVolumeSpecName: "logs") pod "34d9b7a1-331f-4fb4-af14-8b1f5eac551f" (UID: "34d9b7a1-331f-4fb4-af14-8b1f5eac551f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.827307 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.835119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "34d9b7a1-331f-4fb4-af14-8b1f5eac551f" (UID: "34d9b7a1-331f-4fb4-af14-8b1f5eac551f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.836477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-kube-api-access-7gfpx" (OuterVolumeSpecName: "kube-api-access-7gfpx") pod "34d9b7a1-331f-4fb4-af14-8b1f5eac551f" (UID: "34d9b7a1-331f-4fb4-af14-8b1f5eac551f"). InnerVolumeSpecName "kube-api-access-7gfpx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.867118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34d9b7a1-331f-4fb4-af14-8b1f5eac551f" (UID: "34d9b7a1-331f-4fb4-af14-8b1f5eac551f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.885693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data" (OuterVolumeSpecName: "config-data") pod "34d9b7a1-331f-4fb4-af14-8b1f5eac551f" (UID: "34d9b7a1-331f-4fb4-af14-8b1f5eac551f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.929133 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.929180 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.929228 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7gfpx\" (UniqueName: \"kubernetes.io/projected/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-kube-api-access-7gfpx\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.929245 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34d9b7a1-331f-4fb4-af14-8b1f5eac551f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.937270 4769 generic.go:334] "Generic (PLEG): container finished" podID="55cd7967-3e65-4d19-8741-58256e6e760c" containerID="5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85" exitCode=0 Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.937317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"55cd7967-3e65-4d19-8741-58256e6e760c","Type":"ContainerDied","Data":"5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85"} Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.939219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" event={"ID":"34d9b7a1-331f-4fb4-af14-8b1f5eac551f","Type":"ContainerDied","Data":"4c684dae9414fbb059418016a2b44cb6a70903a535b97610d33a15b8daf702f0"} Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.939258 4769 scope.go:117] "RemoveContainer" containerID="eb18b051a214916baee7970903bde33fae95110afb173063aa4b3c8980344411" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.939347 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.964767 4769 scope.go:117] "RemoveContainer" containerID="561304b20e3cc09db149d545cd2946b998e28ae08b9b4a65a22774775af003d9" Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.983697 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h"] Nov 21 13:06:26 crc kubenswrapper[4769]: I1121 13:06:26.991170 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-64dd759dc4-2cf5h"] Nov 21 13:06:27 crc kubenswrapper[4769]: I1121 13:06:27.284451 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" path="/var/lib/kubelet/pods/34d9b7a1-331f-4fb4-af14-8b1f5eac551f/volumes" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.835311 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.969444 4769 generic.go:334] "Generic (PLEG): container finished" podID="55cd7967-3e65-4d19-8741-58256e6e760c" containerID="08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957" exitCode=0 Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.969490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"55cd7967-3e65-4d19-8741-58256e6e760c","Type":"ContainerDied","Data":"08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957"} Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.969515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"55cd7967-3e65-4d19-8741-58256e6e760c","Type":"ContainerDied","Data":"677015d095c8aa77b36a3d2fd02af9ed48626c38262a431a8a801ca33d119ef1"} Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.969531 4769 scope.go:117] "RemoveContainer" containerID="5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.969653 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/55cd7967-3e65-4d19-8741-58256e6e760c-etc-machine-id\") pod \"55cd7967-3e65-4d19-8741-58256e6e760c\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4v7q\" (UniqueName: \"kubernetes.io/projected/55cd7967-3e65-4d19-8741-58256e6e760c-kube-api-access-m4v7q\") pod \"55cd7967-3e65-4d19-8741-58256e6e760c\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data\") pod \"55cd7967-3e65-4d19-8741-58256e6e760c\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/55cd7967-3e65-4d19-8741-58256e6e760c-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "55cd7967-3e65-4d19-8741-58256e6e760c" (UID: "55cd7967-3e65-4d19-8741-58256e6e760c"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data-custom\") pod \"55cd7967-3e65-4d19-8741-58256e6e760c\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-combined-ca-bundle\") pod \"55cd7967-3e65-4d19-8741-58256e6e760c\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-scripts\") pod \"55cd7967-3e65-4d19-8741-58256e6e760c\" (UID: \"55cd7967-3e65-4d19-8741-58256e6e760c\") " Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.973972 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/55cd7967-3e65-4d19-8741-58256e6e760c-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.979438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "55cd7967-3e65-4d19-8741-58256e6e760c" (UID: "55cd7967-3e65-4d19-8741-58256e6e760c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.980089 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cd7967-3e65-4d19-8741-58256e6e760c-kube-api-access-m4v7q" (OuterVolumeSpecName: "kube-api-access-m4v7q") pod "55cd7967-3e65-4d19-8741-58256e6e760c" (UID: "55cd7967-3e65-4d19-8741-58256e6e760c"). InnerVolumeSpecName "kube-api-access-m4v7q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:28 crc kubenswrapper[4769]: I1121 13:06:28.980902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-scripts" (OuterVolumeSpecName: "scripts") pod "55cd7967-3e65-4d19-8741-58256e6e760c" (UID: "55cd7967-3e65-4d19-8741-58256e6e760c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.009776 4769 scope.go:117] "RemoveContainer" containerID="08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.041888 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "55cd7967-3e65-4d19-8741-58256e6e760c" (UID: "55cd7967-3e65-4d19-8741-58256e6e760c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.066017 4769 scope.go:117] "RemoveContainer" containerID="5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85" Nov 21 13:06:29 crc kubenswrapper[4769]: E1121 13:06:29.066807 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85\": container with ID starting with 5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85 not found: ID does not exist" containerID="5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.066854 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85"} err="failed to get container status \"5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85\": rpc error: code = NotFound desc = could not find container \"5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85\": container with ID starting with 5dd8cee20788fb00c123af9dae3d2b9614bd726c2e8c6589084af69fbb095a85 not found: ID does not exist" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.066883 4769 scope.go:117] "RemoveContainer" containerID="08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957" Nov 21 13:06:29 crc kubenswrapper[4769]: E1121 13:06:29.067422 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957\": container with ID starting with 08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957 not found: ID does not exist" containerID="08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.067553 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957"} err="failed to get container status \"08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957\": rpc error: code = NotFound desc = could not find container \"08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957\": container with ID starting with 08667fa573ea4b47ef32b299f01e0e93daff72269f59cf146952430e57456957 not found: ID does not exist" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.075717 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.075742 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.075752 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.075762 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m4v7q\" (UniqueName: \"kubernetes.io/projected/55cd7967-3e65-4d19-8741-58256e6e760c-kube-api-access-m4v7q\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.096354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data" (OuterVolumeSpecName: "config-data") pod "55cd7967-3e65-4d19-8741-58256e6e760c" (UID: "55cd7967-3e65-4d19-8741-58256e6e760c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.177017 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/55cd7967-3e65-4d19-8741-58256e6e760c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.308317 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.314923 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.342136 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:29 crc kubenswrapper[4769]: E1121 13:06:29.342715 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api-log" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.342740 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api-log" Nov 21 13:06:29 crc kubenswrapper[4769]: E1121 13:06:29.342762 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.342770 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api" Nov 21 13:06:29 crc kubenswrapper[4769]: E1121 13:06:29.342797 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="cinder-scheduler" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.342806 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="cinder-scheduler" Nov 21 13:06:29 crc kubenswrapper[4769]: E1121 13:06:29.342865 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="probe" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.342875 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="probe" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.343091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.343158 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34d9b7a1-331f-4fb4-af14-8b1f5eac551f" containerName="barbican-api-log" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.343172 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="cinder-scheduler" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.343203 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" containerName="probe" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.344425 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.349628 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.351982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.481602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.481675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.481828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.482078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxhdx\" (UniqueName: \"kubernetes.io/projected/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-kube-api-access-rxhdx\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.482111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-scripts\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.482236 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.583702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.583881 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhdx\" (UniqueName: \"kubernetes.io/projected/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-kube-api-access-rxhdx\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.583919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-scripts\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.583988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.584048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.584146 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.584664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.588537 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.589064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-scripts\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.589845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.591981 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.603150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhdx\" (UniqueName: \"kubernetes.io/projected/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-kube-api-access-rxhdx\") pod \"cinder-scheduler-0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:29 crc kubenswrapper[4769]: I1121 13:06:29.670554 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:30 crc kubenswrapper[4769]: I1121 13:06:30.149552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:06:31 crc kubenswrapper[4769]: I1121 13:06:31.011762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerStarted","Data":"51fd8e3831d48efa1564568c19a1e9850f88f95af140e12bda169fa31a6855d7"} Nov 21 13:06:31 crc kubenswrapper[4769]: I1121 13:06:31.012004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerStarted","Data":"f5aebbfca2aa4cd57950b710ed2af629f4844e352160a019a90c26ace7e5d883"} Nov 21 13:06:31 crc kubenswrapper[4769]: I1121 13:06:31.287700 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55cd7967-3e65-4d19-8741-58256e6e760c" path="/var/lib/kubelet/pods/55cd7967-3e65-4d19-8741-58256e6e760c/volumes" Nov 21 13:06:32 crc kubenswrapper[4769]: I1121 13:06:32.029305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerStarted","Data":"f06769b438aa181e2a18ea6fed91e271fefff21495eaf2a2fa79d35fa2fbe544"} Nov 21 13:06:32 crc kubenswrapper[4769]: I1121 13:06:32.290797 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:06:32 crc kubenswrapper[4769]: I1121 13:06:32.329928 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.329909766 podStartE2EDuration="3.329909766s" podCreationTimestamp="2025-11-21 13:06:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:32.061393495 +0000 UTC m=+4550.762055313" watchObservedRunningTime="2025-11-21 13:06:32.329909766 +0000 UTC m=+4551.030571594" Nov 21 13:06:33 crc kubenswrapper[4769]: I1121 13:06:33.295285 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:06:33 crc kubenswrapper[4769]: E1121 13:06:33.295790 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:06:34 crc kubenswrapper[4769]: I1121 13:06:34.200896 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:34 crc kubenswrapper[4769]: I1121 13:06:34.206504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:34 crc kubenswrapper[4769]: I1121 13:06:34.214173 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:06:34 crc kubenswrapper[4769]: I1121 13:06:34.671321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:38 crc kubenswrapper[4769]: I1121 13:06:38.092604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-qr457" event={"ID":"4d7b6f0e-c00f-41d0-a40c-b2778737bd01","Type":"ContainerDied","Data":"b2ad67c9d01720b0dad7ae6daae691076f860bbc3a696c34ac116a3ec21267e8"} Nov 21 13:06:38 crc kubenswrapper[4769]: I1121 13:06:38.092644 4769 generic.go:334] "Generic (PLEG): container finished" podID="4d7b6f0e-c00f-41d0-a40c-b2778737bd01" containerID="b2ad67c9d01720b0dad7ae6daae691076f860bbc3a696c34ac116a3ec21267e8" exitCode=0 Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.567473 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.726013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-combined-ca-bundle\") pod \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.726184 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-config\") pod \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.726279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgcsg\" (UniqueName: \"kubernetes.io/projected/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-kube-api-access-hgcsg\") pod \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\" (UID: \"4d7b6f0e-c00f-41d0-a40c-b2778737bd01\") " Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.738743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-kube-api-access-hgcsg" (OuterVolumeSpecName: "kube-api-access-hgcsg") pod "4d7b6f0e-c00f-41d0-a40c-b2778737bd01" (UID: "4d7b6f0e-c00f-41d0-a40c-b2778737bd01"). InnerVolumeSpecName "kube-api-access-hgcsg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.748394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-config" (OuterVolumeSpecName: "config") pod "4d7b6f0e-c00f-41d0-a40c-b2778737bd01" (UID: "4d7b6f0e-c00f-41d0-a40c-b2778737bd01"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.763287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4d7b6f0e-c00f-41d0-a40c-b2778737bd01" (UID: "4d7b6f0e-c00f-41d0-a40c-b2778737bd01"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.827827 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hgcsg\" (UniqueName: \"kubernetes.io/projected/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-kube-api-access-hgcsg\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.827881 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.827896 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d7b6f0e-c00f-41d0-a40c-b2778737bd01-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:39 crc kubenswrapper[4769]: I1121 13:06:39.847309 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.120333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-qr457" event={"ID":"4d7b6f0e-c00f-41d0-a40c-b2778737bd01","Type":"ContainerDied","Data":"6bde960bfc5f4456e24ff3a3b6c525d629431e28871994b59cd81b823ff7d61c"} Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.120376 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bde960bfc5f4456e24ff3a3b6c525d629431e28871994b59cd81b823ff7d61c" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.120447 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-qr457" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.390375 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-79c66f4f97-wrp26"] Nov 21 13:06:40 crc kubenswrapper[4769]: E1121 13:06:40.391653 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4d7b6f0e-c00f-41d0-a40c-b2778737bd01" containerName="neutron-db-sync" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.391786 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7b6f0e-c00f-41d0-a40c-b2778737bd01" containerName="neutron-db-sync" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.392136 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4d7b6f0e-c00f-41d0-a40c-b2778737bd01" containerName="neutron-db-sync" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.393687 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.395807 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.395939 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-xr28b" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.395950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.396258 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.402862 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-79c66f4f97-wrp26"] Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.538686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7ctl\" (UniqueName: \"kubernetes.io/projected/14cb44ec-35a4-41a8-ab6a-71b74294616b-kube-api-access-f7ctl\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.538735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-ovndb-tls-certs\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.538775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-config\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.538940 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-combined-ca-bundle\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.539249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-httpd-config\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.641133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-httpd-config\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.642043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f7ctl\" (UniqueName: \"kubernetes.io/projected/14cb44ec-35a4-41a8-ab6a-71b74294616b-kube-api-access-f7ctl\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.642085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-ovndb-tls-certs\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.642232 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-config\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.642324 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-combined-ca-bundle\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.645660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-ovndb-tls-certs\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.653012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-config\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.653106 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-combined-ca-bundle\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.659122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-httpd-config\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.659614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7ctl\" (UniqueName: \"kubernetes.io/projected/14cb44ec-35a4-41a8-ab6a-71b74294616b-kube-api-access-f7ctl\") pod \"neutron-79c66f4f97-wrp26\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.746354 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:40 crc kubenswrapper[4769]: I1121 13:06:40.960848 4769 scope.go:117] "RemoveContainer" containerID="c445a56c6e8faf1352fa571c77899599bfa33d8e9f320242b15676c75b7a1c41" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.382126 4769 scope.go:117] "RemoveContainer" containerID="422b5c076b7276c472dfd77dc0e0326c5d93d0634a9e8b5adec4b2739ba09f77" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.404584 4769 scope.go:117] "RemoveContainer" containerID="7d9318bf8c25495f7148a04e86c1b278caa519b9123ecdcf89fc09403b562cd1" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.428447 4769 scope.go:117] "RemoveContainer" containerID="70daa102a861275c35f930b6033259033eba08c1da7955b936329103d21f485e" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.448744 4769 scope.go:117] "RemoveContainer" containerID="fd6c613f64ef206587c06c6e0e3f6c4a769a9ad5115b62b885c20e5c1a800799" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.471727 4769 scope.go:117] "RemoveContainer" containerID="4f928b644488d4a360447741ffe8fedd5c00337fe2eaba4fa016957e725491e2" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.496828 4769 scope.go:117] "RemoveContainer" containerID="5b248861d8dc1ceff01552d436e92eca2c6cd665662bced4f2680a10022fae09" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.550320 4769 scope.go:117] "RemoveContainer" containerID="d053a37dbdd2a57dda79a762d52fcccf37c4606694e35ee18c386a0f4920d3d1" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.571738 4769 scope.go:117] "RemoveContainer" containerID="c754b80c250c6c28991616d6c623ea906d7dde0efcff135b51f0c5fce662b816" Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.585917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-79c66f4f97-wrp26"] Nov 21 13:06:41 crc kubenswrapper[4769]: W1121 13:06:41.609506 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14cb44ec_35a4_41a8_ab6a_71b74294616b.slice/crio-74ca1287a99c366fb64bb4a50f0e77d9cb089067d1768324e4825217a0ea26df WatchSource:0}: Error finding container 74ca1287a99c366fb64bb4a50f0e77d9cb089067d1768324e4825217a0ea26df: Status 404 returned error can't find the container with id 74ca1287a99c366fb64bb4a50f0e77d9cb089067d1768324e4825217a0ea26df Nov 21 13:06:41 crc kubenswrapper[4769]: I1121 13:06:41.972108 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:06:42 crc kubenswrapper[4769]: I1121 13:06:42.141355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" event={"ID":"14cb44ec-35a4-41a8-ab6a-71b74294616b","Type":"ContainerStarted","Data":"74ca1287a99c366fb64bb4a50f0e77d9cb089067d1768324e4825217a0ea26df"} Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.162719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" event={"ID":"14cb44ec-35a4-41a8-ab6a-71b74294616b","Type":"ContainerStarted","Data":"aeb3a01da4c103652197d406181980d88f7cf0220d3fe57c7434d01d15f94499"} Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.167137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" event={"ID":"14cb44ec-35a4-41a8-ab6a-71b74294616b","Type":"ContainerStarted","Data":"0c258dc89c6ad6876241d9a2ec02c56859e3577dbc9ee65730edfade9b75b3e0"} Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.167221 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.188585 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" podStartSLOduration=3.1885674489999998 podStartE2EDuration="3.188567449s" podCreationTimestamp="2025-11-21 13:06:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:43.179260529 +0000 UTC m=+4561.879922367" watchObservedRunningTime="2025-11-21 13:06:43.188567449 +0000 UTC m=+4561.889229267" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.603379 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7cb6877b78-6gzcc"] Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.604766 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.607147 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.607611 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.623777 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7cb6877b78-6gzcc"] Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-internal-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-ovndb-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-httpd-config\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-config\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-combined-ca-bundle\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspw2\" (UniqueName: \"kubernetes.io/projected/66f33c4c-4a03-4c53-a741-6ad15373c8d8-kube-api-access-fspw2\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.702859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-public-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-combined-ca-bundle\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fspw2\" (UniqueName: \"kubernetes.io/projected/66f33c4c-4a03-4c53-a741-6ad15373c8d8-kube-api-access-fspw2\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804231 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-public-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-internal-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-ovndb-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804334 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-httpd-config\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.804370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-config\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.812173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-config\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.814100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-internal-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.814977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-httpd-config\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.816501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-ovndb-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.818051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-combined-ca-bundle\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.824362 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-public-tls-certs\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.831309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspw2\" (UniqueName: \"kubernetes.io/projected/66f33c4c-4a03-4c53-a741-6ad15373c8d8-kube-api-access-fspw2\") pod \"neutron-7cb6877b78-6gzcc\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:43 crc kubenswrapper[4769]: I1121 13:06:43.920416 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:44 crc kubenswrapper[4769]: I1121 13:06:44.445364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7cb6877b78-6gzcc"] Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.192977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" event={"ID":"66f33c4c-4a03-4c53-a741-6ad15373c8d8","Type":"ContainerStarted","Data":"4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4"} Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.193495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.193508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" event={"ID":"66f33c4c-4a03-4c53-a741-6ad15373c8d8","Type":"ContainerStarted","Data":"a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25"} Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.193519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" event={"ID":"66f33c4c-4a03-4c53-a741-6ad15373c8d8","Type":"ContainerStarted","Data":"c4e8a46b70b7b887f0b95cb02b0a38e38609eb81679d0a661870bd491c8fc7d6"} Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.213249 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" podStartSLOduration=2.213233402 podStartE2EDuration="2.213233402s" podCreationTimestamp="2025-11-21 13:06:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:45.209092671 +0000 UTC m=+4563.909754499" watchObservedRunningTime="2025-11-21 13:06:45.213233402 +0000 UTC m=+4563.913895220" Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.981439 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4"] Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.982934 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.985091 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.985113 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 13:06:45 crc kubenswrapper[4769]: I1121 13:06:45.985259 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.008514 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4"] Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvtvv\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-kube-api-access-xvtvv\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-internal-tls-certs\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-combined-ca-bundle\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-config-data\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-run-httpd\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050562 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-etc-swift\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-log-httpd\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.050632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-public-tls-certs\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvtvv\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-kube-api-access-xvtvv\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-internal-tls-certs\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152652 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-combined-ca-bundle\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-config-data\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-run-httpd\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-etc-swift\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-log-httpd\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.152859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-public-tls-certs\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.154404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-run-httpd\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.154530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-log-httpd\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.159172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-internal-tls-certs\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.160074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-config-data\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.160236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-combined-ca-bundle\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.160564 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-etc-swift\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.160592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-public-tls-certs\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.179987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvtvv\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-kube-api-access-xvtvv\") pod \"swift-proxy-789d76b4f8-lgqr4\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.273805 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:06:46 crc kubenswrapper[4769]: E1121 13:06:46.274319 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.302251 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.745520 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.748258 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.750358 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.750716 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.751661 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-v8rvf" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.767807 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.852376 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4"] Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.890284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.890397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-combined-ca-bundle\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.890449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqm5\" (UniqueName: \"kubernetes.io/projected/72c08d5f-4fce-4541-9649-1a24c14b9524-kube-api-access-wzqm5\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.890551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config-secret\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.993264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-combined-ca-bundle\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.993326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqm5\" (UniqueName: \"kubernetes.io/projected/72c08d5f-4fce-4541-9649-1a24c14b9524-kube-api-access-wzqm5\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.993365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config-secret\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.993440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.994232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.998374 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-combined-ca-bundle\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:46 crc kubenswrapper[4769]: I1121 13:06:46.999793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config-secret\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:47 crc kubenswrapper[4769]: I1121 13:06:47.018881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqm5\" (UniqueName: \"kubernetes.io/projected/72c08d5f-4fce-4541-9649-1a24c14b9524-kube-api-access-wzqm5\") pod \"openstackclient\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:47 crc kubenswrapper[4769]: I1121 13:06:47.089518 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:06:47 crc kubenswrapper[4769]: I1121 13:06:47.247808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" event={"ID":"96370f55-1a3c-4023-b59b-5702856f0192","Type":"ContainerStarted","Data":"2cfc347d39ad0f86dd559e8d66234bcb38d810d8807c0228d01fc9f3d53831b5"} Nov 21 13:06:47 crc kubenswrapper[4769]: I1121 13:06:47.248345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" event={"ID":"96370f55-1a3c-4023-b59b-5702856f0192","Type":"ContainerStarted","Data":"60b7a5fb1ccac538202a02e0282cb66c92c483cc3676f6b6b63f4aa159a40226"} Nov 21 13:06:47 crc kubenswrapper[4769]: W1121 13:06:47.564774 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72c08d5f_4fce_4541_9649_1a24c14b9524.slice/crio-5ac010a7770a1664d5c9a1334205654a63923132e03992770dc5560419ded729 WatchSource:0}: Error finding container 5ac010a7770a1664d5c9a1334205654a63923132e03992770dc5560419ded729: Status 404 returned error can't find the container with id 5ac010a7770a1664d5c9a1334205654a63923132e03992770dc5560419ded729 Nov 21 13:06:47 crc kubenswrapper[4769]: I1121 13:06:47.565797 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.038242 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.038804 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-central-agent" containerID="cri-o://8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7" gracePeriod=30 Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.038873 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="proxy-httpd" containerID="cri-o://2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758" gracePeriod=30 Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.038973 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-notification-agent" containerID="cri-o://3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807" gracePeriod=30 Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.038886 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="sg-core" containerID="cri-o://38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2" gracePeriod=30 Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.279795 4769 generic.go:334] "Generic (PLEG): container finished" podID="4930ac51-2d41-497c-a563-d70b8090cead" containerID="2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758" exitCode=0 Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.279827 4769 generic.go:334] "Generic (PLEG): container finished" podID="4930ac51-2d41-497c-a563-d70b8090cead" containerID="38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2" exitCode=2 Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.279892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerDied","Data":"2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758"} Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.279917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerDied","Data":"38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2"} Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.281870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"72c08d5f-4fce-4541-9649-1a24c14b9524","Type":"ContainerStarted","Data":"b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6"} Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.281899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"72c08d5f-4fce-4541-9649-1a24c14b9524","Type":"ContainerStarted","Data":"5ac010a7770a1664d5c9a1334205654a63923132e03992770dc5560419ded729"} Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.284607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" event={"ID":"96370f55-1a3c-4023-b59b-5702856f0192","Type":"ContainerStarted","Data":"49853b2d4b4be27a262d79e0727dbb40515dd28bbab25415aefb0a1bc3c9abb0"} Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.285466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.285577 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.303968 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.303945912 podStartE2EDuration="2.303945912s" podCreationTimestamp="2025-11-21 13:06:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:48.293989164 +0000 UTC m=+4566.994650982" watchObservedRunningTime="2025-11-21 13:06:48.303945912 +0000 UTC m=+4567.004607730" Nov 21 13:06:48 crc kubenswrapper[4769]: I1121 13:06:48.316940 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" podStartSLOduration=3.316925262 podStartE2EDuration="3.316925262s" podCreationTimestamp="2025-11-21 13:06:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:06:48.313573791 +0000 UTC m=+4567.014235609" watchObservedRunningTime="2025-11-21 13:06:48.316925262 +0000 UTC m=+4567.017587080" Nov 21 13:06:49 crc kubenswrapper[4769]: I1121 13:06:49.295900 4769 generic.go:334] "Generic (PLEG): container finished" podID="4930ac51-2d41-497c-a563-d70b8090cead" containerID="8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7" exitCode=0 Nov 21 13:06:49 crc kubenswrapper[4769]: I1121 13:06:49.302897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerDied","Data":"8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7"} Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.251297 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.333135 4769 generic.go:334] "Generic (PLEG): container finished" podID="4930ac51-2d41-497c-a563-d70b8090cead" containerID="3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807" exitCode=0 Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.333175 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerDied","Data":"3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807"} Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.333217 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4930ac51-2d41-497c-a563-d70b8090cead","Type":"ContainerDied","Data":"ce779cf995c407bd33b6294ac4f95dc954395d1a897753acd5e464c3a0924ac3"} Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.333233 4769 scope.go:117] "RemoveContainer" containerID="2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.333350 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.354113 4769 scope.go:117] "RemoveContainer" containerID="38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.373127 4769 scope.go:117] "RemoveContainer" containerID="3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389133 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-sg-core-conf-yaml\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389219 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-combined-ca-bundle\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389251 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjhzl\" (UniqueName: \"kubernetes.io/projected/4930ac51-2d41-497c-a563-d70b8090cead-kube-api-access-rjhzl\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-config-data\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389315 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-log-httpd\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-run-httpd\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.389526 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-scripts\") pod \"4930ac51-2d41-497c-a563-d70b8090cead\" (UID: \"4930ac51-2d41-497c-a563-d70b8090cead\") " Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.390569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.390999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.393516 4769 scope.go:117] "RemoveContainer" containerID="8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.411354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-scripts" (OuterVolumeSpecName: "scripts") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.414171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4930ac51-2d41-497c-a563-d70b8090cead-kube-api-access-rjhzl" (OuterVolumeSpecName: "kube-api-access-rjhzl") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "kube-api-access-rjhzl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.419262 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.479028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.491877 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.491913 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.491922 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.491933 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rjhzl\" (UniqueName: \"kubernetes.io/projected/4930ac51-2d41-497c-a563-d70b8090cead-kube-api-access-rjhzl\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.491946 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.491956 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4930ac51-2d41-497c-a563-d70b8090cead-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.497998 4769 scope.go:117] "RemoveContainer" containerID="2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.498445 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758\": container with ID starting with 2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758 not found: ID does not exist" containerID="2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.498479 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758"} err="failed to get container status \"2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758\": rpc error: code = NotFound desc = could not find container \"2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758\": container with ID starting with 2a56c2053ab9cf2257372c564b9c4f18ae0a1e5c078cc787471acd7781478758 not found: ID does not exist" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.498522 4769 scope.go:117] "RemoveContainer" containerID="38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.498748 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2\": container with ID starting with 38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2 not found: ID does not exist" containerID="38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.498772 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2"} err="failed to get container status \"38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2\": rpc error: code = NotFound desc = could not find container \"38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2\": container with ID starting with 38f9da18ebb5cbafdf60ef4b4beceb2dd295f8f156e9b8e9df22fc35810e70b2 not found: ID does not exist" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.498789 4769 scope.go:117] "RemoveContainer" containerID="3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.498999 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807\": container with ID starting with 3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807 not found: ID does not exist" containerID="3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.499027 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807"} err="failed to get container status \"3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807\": rpc error: code = NotFound desc = could not find container \"3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807\": container with ID starting with 3d89b751bdd480bb59c579d87898a9ee2854cb0cea969f2e01fb4accae0d2807 not found: ID does not exist" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.499045 4769 scope.go:117] "RemoveContainer" containerID="8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.499496 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7\": container with ID starting with 8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7 not found: ID does not exist" containerID="8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.499531 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7"} err="failed to get container status \"8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7\": rpc error: code = NotFound desc = could not find container \"8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7\": container with ID starting with 8259ea0a5cafbacee899f31d43d20d8b56673a0db9ab9ae1bbe2d3d1ec0ba5e7 not found: ID does not exist" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.500358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-config-data" (OuterVolumeSpecName: "config-data") pod "4930ac51-2d41-497c-a563-d70b8090cead" (UID: "4930ac51-2d41-497c-a563-d70b8090cead"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.594068 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4930ac51-2d41-497c-a563-d70b8090cead-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.666655 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.679837 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.690927 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.691458 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="proxy-httpd" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691484 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="proxy-httpd" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.691549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-notification-agent" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691559 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-notification-agent" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.691582 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-central-agent" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691589 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-central-agent" Nov 21 13:06:51 crc kubenswrapper[4769]: E1121 13:06:51.691609 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="sg-core" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691617 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="sg-core" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691850 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-central-agent" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="proxy-httpd" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691898 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="ceilometer-notification-agent" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.691915 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4930ac51-2d41-497c-a563-d70b8090cead" containerName="sg-core" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.694005 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.697833 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.697869 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.698434 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-log-httpd\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-scripts\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ltjx\" (UniqueName: \"kubernetes.io/projected/c47986ed-b399-49b0-84ac-611393c62d46-kube-api-access-7ltjx\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-config-data\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.797755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-run-httpd\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.898765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7ltjx\" (UniqueName: \"kubernetes.io/projected/c47986ed-b399-49b0-84ac-611393c62d46-kube-api-access-7ltjx\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.898859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-config-data\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.898909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-run-httpd\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.898968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-log-httpd\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.899002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-scripts\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.899094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.899145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.899798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-run-httpd\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:51 crc kubenswrapper[4769]: I1121 13:06:51.900009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-log-httpd\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.280653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.281572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.281615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-config-data\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.281756 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ltjx\" (UniqueName: \"kubernetes.io/projected/c47986ed-b399-49b0-84ac-611393c62d46-kube-api-access-7ltjx\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.281923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-scripts\") pod \"ceilometer-0\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.313126 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:06:52 crc kubenswrapper[4769]: I1121 13:06:52.804735 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:52 crc kubenswrapper[4769]: W1121 13:06:52.809463 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc47986ed_b399_49b0_84ac_611393c62d46.slice/crio-437d910ac8516105efde697db99df7f10cedeeb866a3f5851d48d10f35f16f3c WatchSource:0}: Error finding container 437d910ac8516105efde697db99df7f10cedeeb866a3f5851d48d10f35f16f3c: Status 404 returned error can't find the container with id 437d910ac8516105efde697db99df7f10cedeeb866a3f5851d48d10f35f16f3c Nov 21 13:06:53 crc kubenswrapper[4769]: I1121 13:06:53.287725 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4930ac51-2d41-497c-a563-d70b8090cead" path="/var/lib/kubelet/pods/4930ac51-2d41-497c-a563-d70b8090cead/volumes" Nov 21 13:06:53 crc kubenswrapper[4769]: I1121 13:06:53.385715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerStarted","Data":"437d910ac8516105efde697db99df7f10cedeeb866a3f5851d48d10f35f16f3c"} Nov 21 13:06:54 crc kubenswrapper[4769]: I1121 13:06:54.400141 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerStarted","Data":"fe77c8cab8e41b2931ec900f38ba8b23304025225e91198d0727e79d26d7d555"} Nov 21 13:06:54 crc kubenswrapper[4769]: I1121 13:06:54.512320 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:06:55 crc kubenswrapper[4769]: I1121 13:06:55.413150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerStarted","Data":"66bca669d8ea9118fa3178c699895e871a68ff7763bd079e60ed05a9f51943f2"} Nov 21 13:06:56 crc kubenswrapper[4769]: I1121 13:06:56.309732 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:56 crc kubenswrapper[4769]: I1121 13:06:56.311503 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:06:59 crc kubenswrapper[4769]: I1121 13:06:59.454306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerStarted","Data":"c16b1266fe27597517e6a1869fec7c8a950aec3d5cd2114f6a4607aa17066195"} Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.274053 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:07:01 crc kubenswrapper[4769]: E1121 13:07:01.274588 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.472740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerStarted","Data":"42a475748e836ee2c9440e177155ef68cb9e7299fd3f6c02ebd741681580b4a2"} Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.472892 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-central-agent" containerID="cri-o://fe77c8cab8e41b2931ec900f38ba8b23304025225e91198d0727e79d26d7d555" gracePeriod=30 Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.473131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.473418 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="proxy-httpd" containerID="cri-o://42a475748e836ee2c9440e177155ef68cb9e7299fd3f6c02ebd741681580b4a2" gracePeriod=30 Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.473468 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="sg-core" containerID="cri-o://c16b1266fe27597517e6a1869fec7c8a950aec3d5cd2114f6a4607aa17066195" gracePeriod=30 Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.473517 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-notification-agent" containerID="cri-o://66bca669d8ea9118fa3178c699895e871a68ff7763bd079e60ed05a9f51943f2" gracePeriod=30 Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.505530 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.64939157 podStartE2EDuration="10.505507237s" podCreationTimestamp="2025-11-21 13:06:51 +0000 UTC" firstStartedPulling="2025-11-21 13:06:52.811362003 +0000 UTC m=+4571.512023821" lastFinishedPulling="2025-11-21 13:07:00.66747767 +0000 UTC m=+4579.368139488" observedRunningTime="2025-11-21 13:07:01.493047992 +0000 UTC m=+4580.193709820" watchObservedRunningTime="2025-11-21 13:07:01.505507237 +0000 UTC m=+4580.206169065" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.689312 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-5kbfw"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.690675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.716276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-5kbfw"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.782574 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-59tqv"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.783957 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.818903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27slc\" (UniqueName: \"kubernetes.io/projected/53d1c317-3210-468d-a3e9-35a00fb5ac2a-kube-api-access-27slc\") pod \"nova-api-db-create-5kbfw\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.819355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53d1c317-3210-468d-a3e9-35a00fb5ac2a-operator-scripts\") pod \"nova-api-db-create-5kbfw\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.837504 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-558e-account-create-hmv5l"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.845039 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.848516 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.865220 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-59tqv"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.877598 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-558e-account-create-hmv5l"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.904594 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-k6r6q"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.905957 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.913574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-k6r6q"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.922843 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmsfn\" (UniqueName: \"kubernetes.io/projected/78023dc4-0be7-430f-af00-2a55d14d88b4-kube-api-access-jmsfn\") pod \"nova-cell0-db-create-59tqv\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.923872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53d1c317-3210-468d-a3e9-35a00fb5ac2a-operator-scripts\") pod \"nova-api-db-create-5kbfw\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.924128 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/78023dc4-0be7-430f-af00-2a55d14d88b4-operator-scripts\") pod \"nova-cell0-db-create-59tqv\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.924271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-27slc\" (UniqueName: \"kubernetes.io/projected/53d1c317-3210-468d-a3e9-35a00fb5ac2a-kube-api-access-27slc\") pod \"nova-api-db-create-5kbfw\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.924634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53d1c317-3210-468d-a3e9-35a00fb5ac2a-operator-scripts\") pod \"nova-api-db-create-5kbfw\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.941852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-27slc\" (UniqueName: \"kubernetes.io/projected/53d1c317-3210-468d-a3e9-35a00fb5ac2a-kube-api-access-27slc\") pod \"nova-api-db-create-5kbfw\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.989090 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p"] Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.990662 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.992941 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 13:07:01 crc kubenswrapper[4769]: I1121 13:07:01.997575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p"] Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.026492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jmsfn\" (UniqueName: \"kubernetes.io/projected/78023dc4-0be7-430f-af00-2a55d14d88b4-kube-api-access-jmsfn\") pod \"nova-cell0-db-create-59tqv\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.026570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjjr\" (UniqueName: \"kubernetes.io/projected/d6b05393-7377-44ab-85d2-ac8a93060492-kube-api-access-nbjjr\") pod \"nova-cell1-db-create-k6r6q\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.026600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-operator-scripts\") pod \"nova-api-558e-account-create-hmv5l\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.026631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mgs5\" (UniqueName: \"kubernetes.io/projected/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-kube-api-access-4mgs5\") pod \"nova-api-558e-account-create-hmv5l\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.026770 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/78023dc4-0be7-430f-af00-2a55d14d88b4-operator-scripts\") pod \"nova-cell0-db-create-59tqv\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.026841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6b05393-7377-44ab-85d2-ac8a93060492-operator-scripts\") pod \"nova-cell1-db-create-k6r6q\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.027446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/78023dc4-0be7-430f-af00-2a55d14d88b4-operator-scripts\") pod \"nova-cell0-db-create-59tqv\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.032470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.046920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmsfn\" (UniqueName: \"kubernetes.io/projected/78023dc4-0be7-430f-af00-2a55d14d88b4-kube-api-access-jmsfn\") pod \"nova-cell0-db-create-59tqv\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.098886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.129683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjjr\" (UniqueName: \"kubernetes.io/projected/d6b05393-7377-44ab-85d2-ac8a93060492-kube-api-access-nbjjr\") pod \"nova-cell1-db-create-k6r6q\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.129733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-operator-scripts\") pod \"nova-api-558e-account-create-hmv5l\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.129774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgs5\" (UniqueName: \"kubernetes.io/projected/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-kube-api-access-4mgs5\") pod \"nova-api-558e-account-create-hmv5l\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.129823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6b05393-7377-44ab-85d2-ac8a93060492-operator-scripts\") pod \"nova-cell1-db-create-k6r6q\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.129872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11ccf025-4f3b-46f4-9853-8a6db7008c07-operator-scripts\") pod \"nova-cell0-9288-account-create-r9x9p\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.129896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxs9q\" (UniqueName: \"kubernetes.io/projected/11ccf025-4f3b-46f4-9853-8a6db7008c07-kube-api-access-wxs9q\") pod \"nova-cell0-9288-account-create-r9x9p\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.131160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6b05393-7377-44ab-85d2-ac8a93060492-operator-scripts\") pod \"nova-cell1-db-create-k6r6q\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.132011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-operator-scripts\") pod \"nova-api-558e-account-create-hmv5l\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.187699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mgs5\" (UniqueName: \"kubernetes.io/projected/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-kube-api-access-4mgs5\") pod \"nova-api-558e-account-create-hmv5l\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.196391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjjr\" (UniqueName: \"kubernetes.io/projected/d6b05393-7377-44ab-85d2-ac8a93060492-kube-api-access-nbjjr\") pod \"nova-cell1-db-create-k6r6q\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.207697 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj"] Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.208917 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.212954 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.220986 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj"] Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.232014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11ccf025-4f3b-46f4-9853-8a6db7008c07-operator-scripts\") pod \"nova-cell0-9288-account-create-r9x9p\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.232069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wxs9q\" (UniqueName: \"kubernetes.io/projected/11ccf025-4f3b-46f4-9853-8a6db7008c07-kube-api-access-wxs9q\") pod \"nova-cell0-9288-account-create-r9x9p\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.232771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11ccf025-4f3b-46f4-9853-8a6db7008c07-operator-scripts\") pod \"nova-cell0-9288-account-create-r9x9p\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.254213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxs9q\" (UniqueName: \"kubernetes.io/projected/11ccf025-4f3b-46f4-9853-8a6db7008c07-kube-api-access-wxs9q\") pod \"nova-cell0-9288-account-create-r9x9p\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.333919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbmf\" (UniqueName: \"kubernetes.io/projected/480cabd9-af74-4901-b68a-0c45bef090f5-kube-api-access-skbmf\") pod \"nova-cell1-8c08-account-create-znbwj\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.334062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/480cabd9-af74-4901-b68a-0c45bef090f5-operator-scripts\") pod \"nova-cell1-8c08-account-create-znbwj\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.435991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-skbmf\" (UniqueName: \"kubernetes.io/projected/480cabd9-af74-4901-b68a-0c45bef090f5-kube-api-access-skbmf\") pod \"nova-cell1-8c08-account-create-znbwj\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.436137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/480cabd9-af74-4901-b68a-0c45bef090f5-operator-scripts\") pod \"nova-cell1-8c08-account-create-znbwj\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.436954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/480cabd9-af74-4901-b68a-0c45bef090f5-operator-scripts\") pod \"nova-cell1-8c08-account-create-znbwj\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.474512 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491292 4769 generic.go:334] "Generic (PLEG): container finished" podID="c47986ed-b399-49b0-84ac-611393c62d46" containerID="42a475748e836ee2c9440e177155ef68cb9e7299fd3f6c02ebd741681580b4a2" exitCode=0 Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491332 4769 generic.go:334] "Generic (PLEG): container finished" podID="c47986ed-b399-49b0-84ac-611393c62d46" containerID="c16b1266fe27597517e6a1869fec7c8a950aec3d5cd2114f6a4607aa17066195" exitCode=2 Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491343 4769 generic.go:334] "Generic (PLEG): container finished" podID="c47986ed-b399-49b0-84ac-611393c62d46" containerID="66bca669d8ea9118fa3178c699895e871a68ff7763bd079e60ed05a9f51943f2" exitCode=0 Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491353 4769 generic.go:334] "Generic (PLEG): container finished" podID="c47986ed-b399-49b0-84ac-611393c62d46" containerID="fe77c8cab8e41b2931ec900f38ba8b23304025225e91198d0727e79d26d7d555" exitCode=0 Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerDied","Data":"42a475748e836ee2c9440e177155ef68cb9e7299fd3f6c02ebd741681580b4a2"} Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerDied","Data":"c16b1266fe27597517e6a1869fec7c8a950aec3d5cd2114f6a4607aa17066195"} Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerDied","Data":"66bca669d8ea9118fa3178c699895e871a68ff7763bd079e60ed05a9f51943f2"} Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.491438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerDied","Data":"fe77c8cab8e41b2931ec900f38ba8b23304025225e91198d0727e79d26d7d555"} Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.494846 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.513280 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.621078 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-5kbfw"] Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.707772 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-59tqv"] Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.778961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbmf\" (UniqueName: \"kubernetes.io/projected/480cabd9-af74-4901-b68a-0c45bef090f5-kube-api-access-skbmf\") pod \"nova-cell1-8c08-account-create-znbwj\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: I1121 13:07:02.831113 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:02 crc kubenswrapper[4769]: W1121 13:07:02.884598 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53d1c317_3210_468d_a3e9_35a00fb5ac2a.slice/crio-6eaa1f354707a602c0d62df160d231db5f94b50f12fc5e233f922235b60f83db WatchSource:0}: Error finding container 6eaa1f354707a602c0d62df160d231db5f94b50f12fc5e233f922235b60f83db: Status 404 returned error can't find the container with id 6eaa1f354707a602c0d62df160d231db5f94b50f12fc5e233f922235b60f83db Nov 21 13:07:02 crc kubenswrapper[4769]: W1121 13:07:02.885697 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78023dc4_0be7_430f_af00_2a55d14d88b4.slice/crio-24deacdc5eeafe815c923389edec09f3856427c5d4c83876c1b0ee97d3ea2eb4 WatchSource:0}: Error finding container 24deacdc5eeafe815c923389edec09f3856427c5d4c83876c1b0ee97d3ea2eb4: Status 404 returned error can't find the container with id 24deacdc5eeafe815c923389edec09f3856427c5d4c83876c1b0ee97d3ea2eb4 Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.074543 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.253001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-run-httpd\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.253333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-sg-core-conf-yaml\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.253412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.254040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-combined-ca-bundle\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.254119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-log-httpd\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.254178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ltjx\" (UniqueName: \"kubernetes.io/projected/c47986ed-b399-49b0-84ac-611393c62d46-kube-api-access-7ltjx\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.254226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-scripts\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.254266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-config-data\") pod \"c47986ed-b399-49b0-84ac-611393c62d46\" (UID: \"c47986ed-b399-49b0-84ac-611393c62d46\") " Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.254708 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.255492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.260462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-scripts" (OuterVolumeSpecName: "scripts") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.266924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c47986ed-b399-49b0-84ac-611393c62d46-kube-api-access-7ltjx" (OuterVolumeSpecName: "kube-api-access-7ltjx") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "kube-api-access-7ltjx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.290468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.357519 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.357549 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/c47986ed-b399-49b0-84ac-611393c62d46-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.357563 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7ltjx\" (UniqueName: \"kubernetes.io/projected/c47986ed-b399-49b0-84ac-611393c62d46-kube-api-access-7ltjx\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.357576 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.359102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.389571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-config-data" (OuterVolumeSpecName: "config-data") pod "c47986ed-b399-49b0-84ac-611393c62d46" (UID: "c47986ed-b399-49b0-84ac-611393c62d46"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.394129 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.459688 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.459722 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c47986ed-b399-49b0-84ac-611393c62d46-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.499060 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-558e-account-create-hmv5l"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.504635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"c47986ed-b399-49b0-84ac-611393c62d46","Type":"ContainerDied","Data":"437d910ac8516105efde697db99df7f10cedeeb866a3f5851d48d10f35f16f3c"} Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.504682 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.504707 4769 scope.go:117] "RemoveContainer" containerID="42a475748e836ee2c9440e177155ef68cb9e7299fd3f6c02ebd741681580b4a2" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.507460 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" event={"ID":"11ccf025-4f3b-46f4-9853-8a6db7008c07","Type":"ContainerStarted","Data":"dd296ac50932b175069d2dad710f61f68970f8b19aeca5bd63aef906afe0e052"} Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.517360 4769 generic.go:334] "Generic (PLEG): container finished" podID="78023dc4-0be7-430f-af00-2a55d14d88b4" containerID="0ede93cfcedc5b730fc364279a516a0ac8430755b385354b583d7fecd4c4ed2b" exitCode=0 Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.517415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" event={"ID":"78023dc4-0be7-430f-af00-2a55d14d88b4","Type":"ContainerDied","Data":"0ede93cfcedc5b730fc364279a516a0ac8430755b385354b583d7fecd4c4ed2b"} Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.517436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" event={"ID":"78023dc4-0be7-430f-af00-2a55d14d88b4","Type":"ContainerStarted","Data":"24deacdc5eeafe815c923389edec09f3856427c5d4c83876c1b0ee97d3ea2eb4"} Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.520898 4769 generic.go:334] "Generic (PLEG): container finished" podID="53d1c317-3210-468d-a3e9-35a00fb5ac2a" containerID="630b09fc44a905b1df9534dd63c47b371a6650e61c2ada95422d930e2a39e5d0" exitCode=0 Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.520961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" event={"ID":"53d1c317-3210-468d-a3e9-35a00fb5ac2a","Type":"ContainerDied","Data":"630b09fc44a905b1df9534dd63c47b371a6650e61c2ada95422d930e2a39e5d0"} Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.520986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" event={"ID":"53d1c317-3210-468d-a3e9-35a00fb5ac2a","Type":"ContainerStarted","Data":"6eaa1f354707a602c0d62df160d231db5f94b50f12fc5e233f922235b60f83db"} Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.537483 4769 scope.go:117] "RemoveContainer" containerID="c16b1266fe27597517e6a1869fec7c8a950aec3d5cd2114f6a4607aa17066195" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.565485 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.573213 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.600925 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:03 crc kubenswrapper[4769]: E1121 13:07:03.601634 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-central-agent" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601688 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-central-agent" Nov 21 13:07:03 crc kubenswrapper[4769]: E1121 13:07:03.601705 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="sg-core" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="sg-core" Nov 21 13:07:03 crc kubenswrapper[4769]: E1121 13:07:03.601726 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-notification-agent" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-notification-agent" Nov 21 13:07:03 crc kubenswrapper[4769]: E1121 13:07:03.601745 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="proxy-httpd" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601750 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="proxy-httpd" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601934 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="sg-core" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601954 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-notification-agent" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601965 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="ceilometer-central-agent" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.601978 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c47986ed-b399-49b0-84ac-611393c62d46" containerName="proxy-httpd" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.604141 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.608153 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.608445 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.609386 4769 scope.go:117] "RemoveContainer" containerID="66bca669d8ea9118fa3178c699895e871a68ff7763bd079e60ed05a9f51943f2" Nov 21 13:07:03 crc kubenswrapper[4769]: W1121 13:07:03.640622 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod480cabd9_af74_4901_b68a_0c45bef090f5.slice/crio-d94ef5c5e4918e6a87bc59790c832c335906c6e5e8345287b8080e0a899cb5ac WatchSource:0}: Error finding container d94ef5c5e4918e6a87bc59790c832c335906c6e5e8345287b8080e0a899cb5ac: Status 404 returned error can't find the container with id d94ef5c5e4918e6a87bc59790c832c335906c6e5e8345287b8080e0a899cb5ac Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.658908 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.676627 4769 scope.go:117] "RemoveContainer" containerID="fe77c8cab8e41b2931ec900f38ba8b23304025225e91198d0727e79d26d7d555" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.678034 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.707578 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-k6r6q"] Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgkkt\" (UniqueName: \"kubernetes.io/projected/dc552cf4-09bf-474e-b669-b83b93faf7cc-kube-api-access-fgkkt\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769800 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-config-data\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-log-httpd\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-scripts\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769899 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.769915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-run-httpd\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-log-httpd\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-scripts\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873433 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-run-httpd\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkkt\" (UniqueName: \"kubernetes.io/projected/dc552cf4-09bf-474e-b669-b83b93faf7cc-kube-api-access-fgkkt\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-config-data\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.873923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-log-httpd\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.874140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-run-httpd\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.879968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.881906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-scripts\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.883656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.889073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-config-data\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.899823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkkt\" (UniqueName: \"kubernetes.io/projected/dc552cf4-09bf-474e-b669-b83b93faf7cc-kube-api-access-fgkkt\") pod \"ceilometer-0\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:03 crc kubenswrapper[4769]: I1121 13:07:03.944676 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.423721 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:04 crc kubenswrapper[4769]: W1121 13:07:04.482772 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc552cf4_09bf_474e_b669_b83b93faf7cc.slice/crio-adf415213a1d78c5cbd763ff258005b97e1acb49f648baff948243851c04b940 WatchSource:0}: Error finding container adf415213a1d78c5cbd763ff258005b97e1acb49f648baff948243851c04b940: Status 404 returned error can't find the container with id adf415213a1d78c5cbd763ff258005b97e1acb49f648baff948243851c04b940 Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.532431 4769 generic.go:334] "Generic (PLEG): container finished" podID="11ccf025-4f3b-46f4-9853-8a6db7008c07" containerID="98fa8fad19d35ab5261db85d75889bb666b8f577808831d2497851c06e4f6148" exitCode=0 Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.532494 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" event={"ID":"11ccf025-4f3b-46f4-9853-8a6db7008c07","Type":"ContainerDied","Data":"98fa8fad19d35ab5261db85d75889bb666b8f577808831d2497851c06e4f6148"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.535136 4769 generic.go:334] "Generic (PLEG): container finished" podID="6026dc8b-c8b7-46ef-8af8-a3902f2db94b" containerID="bbdb4389df758ad4f1de57e0bf913d0e0a703f7bd23214fdc23f1781fd689ae1" exitCode=0 Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.535214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" event={"ID":"6026dc8b-c8b7-46ef-8af8-a3902f2db94b","Type":"ContainerDied","Data":"bbdb4389df758ad4f1de57e0bf913d0e0a703f7bd23214fdc23f1781fd689ae1"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.535311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" event={"ID":"6026dc8b-c8b7-46ef-8af8-a3902f2db94b","Type":"ContainerStarted","Data":"9b50938b19f9af395479db285b9a6e0bc85eec56573abb6892b99055d24452e8"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.537848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerStarted","Data":"adf415213a1d78c5cbd763ff258005b97e1acb49f648baff948243851c04b940"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.539595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" event={"ID":"d6b05393-7377-44ab-85d2-ac8a93060492","Type":"ContainerStarted","Data":"6b002a16fee0b7c04f60dcc573e09454ec74d7777fc4112eb630fb3aeac97e8f"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.539636 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" event={"ID":"d6b05393-7377-44ab-85d2-ac8a93060492","Type":"ContainerStarted","Data":"e3a20ee10c389a3dbab5461db18a0820996e4c05c9ec133e981000f6b5dd055a"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.542154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" event={"ID":"480cabd9-af74-4901-b68a-0c45bef090f5","Type":"ContainerStarted","Data":"92fad9c5ab2b64db4adf9719700f72d5abb28d8704ea800d220e90c5c8ebde58"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.542197 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" event={"ID":"480cabd9-af74-4901-b68a-0c45bef090f5","Type":"ContainerStarted","Data":"d94ef5c5e4918e6a87bc59790c832c335906c6e5e8345287b8080e0a899cb5ac"} Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.586624 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" podStartSLOduration=3.586605358 podStartE2EDuration="3.586605358s" podCreationTimestamp="2025-11-21 13:07:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:04.570281298 +0000 UTC m=+4583.270943116" watchObservedRunningTime="2025-11-21 13:07:04.586605358 +0000 UTC m=+4583.287267176" Nov 21 13:07:04 crc kubenswrapper[4769]: I1121 13:07:04.606388 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" podStartSLOduration=2.60637083 podStartE2EDuration="2.60637083s" podCreationTimestamp="2025-11-21 13:07:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:04.603648847 +0000 UTC m=+4583.304310665" watchObservedRunningTime="2025-11-21 13:07:04.60637083 +0000 UTC m=+4583.307032648" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.184965 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.191071 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.291577 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c47986ed-b399-49b0-84ac-611393c62d46" path="/var/lib/kubelet/pods/c47986ed-b399-49b0-84ac-611393c62d46/volumes" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.302777 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/78023dc4-0be7-430f-af00-2a55d14d88b4-operator-scripts\") pod \"78023dc4-0be7-430f-af00-2a55d14d88b4\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.302828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27slc\" (UniqueName: \"kubernetes.io/projected/53d1c317-3210-468d-a3e9-35a00fb5ac2a-kube-api-access-27slc\") pod \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.303093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53d1c317-3210-468d-a3e9-35a00fb5ac2a-operator-scripts\") pod \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\" (UID: \"53d1c317-3210-468d-a3e9-35a00fb5ac2a\") " Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.303153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmsfn\" (UniqueName: \"kubernetes.io/projected/78023dc4-0be7-430f-af00-2a55d14d88b4-kube-api-access-jmsfn\") pod \"78023dc4-0be7-430f-af00-2a55d14d88b4\" (UID: \"78023dc4-0be7-430f-af00-2a55d14d88b4\") " Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.303493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78023dc4-0be7-430f-af00-2a55d14d88b4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "78023dc4-0be7-430f-af00-2a55d14d88b4" (UID: "78023dc4-0be7-430f-af00-2a55d14d88b4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.303696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d1c317-3210-468d-a3e9-35a00fb5ac2a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "53d1c317-3210-468d-a3e9-35a00fb5ac2a" (UID: "53d1c317-3210-468d-a3e9-35a00fb5ac2a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.307812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78023dc4-0be7-430f-af00-2a55d14d88b4-kube-api-access-jmsfn" (OuterVolumeSpecName: "kube-api-access-jmsfn") pod "78023dc4-0be7-430f-af00-2a55d14d88b4" (UID: "78023dc4-0be7-430f-af00-2a55d14d88b4"). InnerVolumeSpecName "kube-api-access-jmsfn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.309434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53d1c317-3210-468d-a3e9-35a00fb5ac2a-kube-api-access-27slc" (OuterVolumeSpecName: "kube-api-access-27slc") pod "53d1c317-3210-468d-a3e9-35a00fb5ac2a" (UID: "53d1c317-3210-468d-a3e9-35a00fb5ac2a"). InnerVolumeSpecName "kube-api-access-27slc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.405261 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/53d1c317-3210-468d-a3e9-35a00fb5ac2a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.405298 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jmsfn\" (UniqueName: \"kubernetes.io/projected/78023dc4-0be7-430f-af00-2a55d14d88b4-kube-api-access-jmsfn\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.405309 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/78023dc4-0be7-430f-af00-2a55d14d88b4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.405320 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-27slc\" (UniqueName: \"kubernetes.io/projected/53d1c317-3210-468d-a3e9-35a00fb5ac2a-kube-api-access-27slc\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.552246 4769 generic.go:334] "Generic (PLEG): container finished" podID="480cabd9-af74-4901-b68a-0c45bef090f5" containerID="92fad9c5ab2b64db4adf9719700f72d5abb28d8704ea800d220e90c5c8ebde58" exitCode=0 Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.552326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" event={"ID":"480cabd9-af74-4901-b68a-0c45bef090f5","Type":"ContainerDied","Data":"92fad9c5ab2b64db4adf9719700f72d5abb28d8704ea800d220e90c5c8ebde58"} Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.554245 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.554250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-59tqv" event={"ID":"78023dc4-0be7-430f-af00-2a55d14d88b4","Type":"ContainerDied","Data":"24deacdc5eeafe815c923389edec09f3856427c5d4c83876c1b0ee97d3ea2eb4"} Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.554348 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24deacdc5eeafe815c923389edec09f3856427c5d4c83876c1b0ee97d3ea2eb4" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.556065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" event={"ID":"53d1c317-3210-468d-a3e9-35a00fb5ac2a","Type":"ContainerDied","Data":"6eaa1f354707a602c0d62df160d231db5f94b50f12fc5e233f922235b60f83db"} Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.556092 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eaa1f354707a602c0d62df160d231db5f94b50f12fc5e233f922235b60f83db" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.556117 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-5kbfw" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.557763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerStarted","Data":"beb8128bd45470c7cd8adccf78171fa97161ff7f76842b47b39e7fd6a8cd21d0"} Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.559245 4769 generic.go:334] "Generic (PLEG): container finished" podID="d6b05393-7377-44ab-85d2-ac8a93060492" containerID="6b002a16fee0b7c04f60dcc573e09454ec74d7777fc4112eb630fb3aeac97e8f" exitCode=0 Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.559294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" event={"ID":"d6b05393-7377-44ab-85d2-ac8a93060492","Type":"ContainerDied","Data":"6b002a16fee0b7c04f60dcc573e09454ec74d7777fc4112eb630fb3aeac97e8f"} Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.973525 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:05 crc kubenswrapper[4769]: I1121 13:07:05.978957 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.117068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mgs5\" (UniqueName: \"kubernetes.io/projected/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-kube-api-access-4mgs5\") pod \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.117377 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-operator-scripts\") pod \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\" (UID: \"6026dc8b-c8b7-46ef-8af8-a3902f2db94b\") " Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.117468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxs9q\" (UniqueName: \"kubernetes.io/projected/11ccf025-4f3b-46f4-9853-8a6db7008c07-kube-api-access-wxs9q\") pod \"11ccf025-4f3b-46f4-9853-8a6db7008c07\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.117553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11ccf025-4f3b-46f4-9853-8a6db7008c07-operator-scripts\") pod \"11ccf025-4f3b-46f4-9853-8a6db7008c07\" (UID: \"11ccf025-4f3b-46f4-9853-8a6db7008c07\") " Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.118383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6026dc8b-c8b7-46ef-8af8-a3902f2db94b" (UID: "6026dc8b-c8b7-46ef-8af8-a3902f2db94b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.118503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ccf025-4f3b-46f4-9853-8a6db7008c07-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "11ccf025-4f3b-46f4-9853-8a6db7008c07" (UID: "11ccf025-4f3b-46f4-9853-8a6db7008c07"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.123714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-kube-api-access-4mgs5" (OuterVolumeSpecName: "kube-api-access-4mgs5") pod "6026dc8b-c8b7-46ef-8af8-a3902f2db94b" (UID: "6026dc8b-c8b7-46ef-8af8-a3902f2db94b"). InnerVolumeSpecName "kube-api-access-4mgs5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.123756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ccf025-4f3b-46f4-9853-8a6db7008c07-kube-api-access-wxs9q" (OuterVolumeSpecName: "kube-api-access-wxs9q") pod "11ccf025-4f3b-46f4-9853-8a6db7008c07" (UID: "11ccf025-4f3b-46f4-9853-8a6db7008c07"). InnerVolumeSpecName "kube-api-access-wxs9q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.221042 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4mgs5\" (UniqueName: \"kubernetes.io/projected/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-kube-api-access-4mgs5\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.221091 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6026dc8b-c8b7-46ef-8af8-a3902f2db94b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.221103 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wxs9q\" (UniqueName: \"kubernetes.io/projected/11ccf025-4f3b-46f4-9853-8a6db7008c07-kube-api-access-wxs9q\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.221113 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/11ccf025-4f3b-46f4-9853-8a6db7008c07-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.570470 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.570466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p" event={"ID":"11ccf025-4f3b-46f4-9853-8a6db7008c07","Type":"ContainerDied","Data":"dd296ac50932b175069d2dad710f61f68970f8b19aeca5bd63aef906afe0e052"} Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.570652 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd296ac50932b175069d2dad710f61f68970f8b19aeca5bd63aef906afe0e052" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.571912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" event={"ID":"6026dc8b-c8b7-46ef-8af8-a3902f2db94b","Type":"ContainerDied","Data":"9b50938b19f9af395479db285b9a6e0bc85eec56573abb6892b99055d24452e8"} Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.571946 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-558e-account-create-hmv5l" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.571954 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b50938b19f9af395479db285b9a6e0bc85eec56573abb6892b99055d24452e8" Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.573447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerStarted","Data":"6d20b04dc41825e44c83eca9315d62bacb7f08b19533558d3016be0b112d1a5b"} Nov 21 13:07:06 crc kubenswrapper[4769]: I1121 13:07:06.924329 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.037755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skbmf\" (UniqueName: \"kubernetes.io/projected/480cabd9-af74-4901-b68a-0c45bef090f5-kube-api-access-skbmf\") pod \"480cabd9-af74-4901-b68a-0c45bef090f5\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.038102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/480cabd9-af74-4901-b68a-0c45bef090f5-operator-scripts\") pod \"480cabd9-af74-4901-b68a-0c45bef090f5\" (UID: \"480cabd9-af74-4901-b68a-0c45bef090f5\") " Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.038393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/480cabd9-af74-4901-b68a-0c45bef090f5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "480cabd9-af74-4901-b68a-0c45bef090f5" (UID: "480cabd9-af74-4901-b68a-0c45bef090f5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.038938 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/480cabd9-af74-4901-b68a-0c45bef090f5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.041677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480cabd9-af74-4901-b68a-0c45bef090f5-kube-api-access-skbmf" (OuterVolumeSpecName: "kube-api-access-skbmf") pod "480cabd9-af74-4901-b68a-0c45bef090f5" (UID: "480cabd9-af74-4901-b68a-0c45bef090f5"). InnerVolumeSpecName "kube-api-access-skbmf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.062102 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.140655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbjjr\" (UniqueName: \"kubernetes.io/projected/d6b05393-7377-44ab-85d2-ac8a93060492-kube-api-access-nbjjr\") pod \"d6b05393-7377-44ab-85d2-ac8a93060492\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.140994 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6b05393-7377-44ab-85d2-ac8a93060492-operator-scripts\") pod \"d6b05393-7377-44ab-85d2-ac8a93060492\" (UID: \"d6b05393-7377-44ab-85d2-ac8a93060492\") " Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.141358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b05393-7377-44ab-85d2-ac8a93060492-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d6b05393-7377-44ab-85d2-ac8a93060492" (UID: "d6b05393-7377-44ab-85d2-ac8a93060492"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.141605 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d6b05393-7377-44ab-85d2-ac8a93060492-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.141677 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-skbmf\" (UniqueName: \"kubernetes.io/projected/480cabd9-af74-4901-b68a-0c45bef090f5-kube-api-access-skbmf\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.143408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b05393-7377-44ab-85d2-ac8a93060492-kube-api-access-nbjjr" (OuterVolumeSpecName: "kube-api-access-nbjjr") pod "d6b05393-7377-44ab-85d2-ac8a93060492" (UID: "d6b05393-7377-44ab-85d2-ac8a93060492"). InnerVolumeSpecName "kube-api-access-nbjjr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.243325 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nbjjr\" (UniqueName: \"kubernetes.io/projected/d6b05393-7377-44ab-85d2-ac8a93060492-kube-api-access-nbjjr\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336157 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc"] Nov 21 13:07:07 crc kubenswrapper[4769]: E1121 13:07:07.336553 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="480cabd9-af74-4901-b68a-0c45bef090f5" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336568 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="480cabd9-af74-4901-b68a-0c45bef090f5" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: E1121 13:07:07.336584 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6b05393-7377-44ab-85d2-ac8a93060492" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336597 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b05393-7377-44ab-85d2-ac8a93060492" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: E1121 13:07:07.336608 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6026dc8b-c8b7-46ef-8af8-a3902f2db94b" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336615 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6026dc8b-c8b7-46ef-8af8-a3902f2db94b" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: E1121 13:07:07.336644 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11ccf025-4f3b-46f4-9853-8a6db7008c07" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336651 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ccf025-4f3b-46f4-9853-8a6db7008c07" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: E1121 13:07:07.336662 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78023dc4-0be7-430f-af00-2a55d14d88b4" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336668 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78023dc4-0be7-430f-af00-2a55d14d88b4" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: E1121 13:07:07.336677 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="53d1c317-3210-468d-a3e9-35a00fb5ac2a" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336682 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d1c317-3210-468d-a3e9-35a00fb5ac2a" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336840 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6026dc8b-c8b7-46ef-8af8-a3902f2db94b" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336853 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="11ccf025-4f3b-46f4-9853-8a6db7008c07" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336870 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6b05393-7377-44ab-85d2-ac8a93060492" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336883 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="53d1c317-3210-468d-a3e9-35a00fb5ac2a" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336894 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="480cabd9-af74-4901-b68a-0c45bef090f5" containerName="mariadb-account-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.336907 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78023dc4-0be7-430f-af00-2a55d14d88b4" containerName="mariadb-database-create" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.337462 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.340501 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-ng22d" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.340712 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.341399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.345699 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc"] Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.447500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-scripts\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.447571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.447630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-286v2\" (UniqueName: \"kubernetes.io/projected/c3bfa54a-e28e-4914-8cff-800df74c7a21-kube-api-access-286v2\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.447659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-config-data\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.549082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-286v2\" (UniqueName: \"kubernetes.io/projected/c3bfa54a-e28e-4914-8cff-800df74c7a21-kube-api-access-286v2\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.549167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-config-data\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.549260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-scripts\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.549292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.554871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.555074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-config-data\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.555558 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-scripts\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.570773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-286v2\" (UniqueName: \"kubernetes.io/projected/c3bfa54a-e28e-4914-8cff-800df74c7a21-kube-api-access-286v2\") pod \"nova-cell0-conductor-db-sync-ldjcc\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.583263 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.583280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-k6r6q" event={"ID":"d6b05393-7377-44ab-85d2-ac8a93060492","Type":"ContainerDied","Data":"e3a20ee10c389a3dbab5461db18a0820996e4c05c9ec133e981000f6b5dd055a"} Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.583318 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3a20ee10c389a3dbab5461db18a0820996e4c05c9ec133e981000f6b5dd055a" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.584799 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.584860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj" event={"ID":"480cabd9-af74-4901-b68a-0c45bef090f5","Type":"ContainerDied","Data":"d94ef5c5e4918e6a87bc59790c832c335906c6e5e8345287b8080e0a899cb5ac"} Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.585042 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d94ef5c5e4918e6a87bc59790c832c335906c6e5e8345287b8080e0a899cb5ac" Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.587887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerStarted","Data":"2c204f56e3fcd893a5d7e6929912e89cd9cc57a42e85e0f894f4bffedc3e9028"} Nov 21 13:07:07 crc kubenswrapper[4769]: I1121 13:07:07.671682 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.188942 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc"] Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.600696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" event={"ID":"c3bfa54a-e28e-4914-8cff-800df74c7a21","Type":"ContainerStarted","Data":"e5c850067e6dc734296c14a3a39e614a776748728e46009b22ee9adf1e1b288d"} Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.601904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" event={"ID":"c3bfa54a-e28e-4914-8cff-800df74c7a21","Type":"ContainerStarted","Data":"cc5a736288443f50ea0ef41df74c857aacb805bf1764d86e6aa0dfa772804077"} Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.604331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerStarted","Data":"58dce04cb8a3779cc5444df38aee1a213d7ff8ed0e735fe9632e0eb1218bcf8b"} Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.605323 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.625918 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" podStartSLOduration=1.6258410300000001 podStartE2EDuration="1.62584103s" podCreationTimestamp="2025-11-21 13:07:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:08.617416953 +0000 UTC m=+4587.318078781" watchObservedRunningTime="2025-11-21 13:07:08.62584103 +0000 UTC m=+4587.326502848" Nov 21 13:07:08 crc kubenswrapper[4769]: I1121 13:07:08.649583 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.059643507 podStartE2EDuration="5.649558589s" podCreationTimestamp="2025-11-21 13:07:03 +0000 UTC" firstStartedPulling="2025-11-21 13:07:04.486144533 +0000 UTC m=+4583.186806371" lastFinishedPulling="2025-11-21 13:07:08.076059625 +0000 UTC m=+4586.776721453" observedRunningTime="2025-11-21 13:07:08.642802687 +0000 UTC m=+4587.343464505" watchObservedRunningTime="2025-11-21 13:07:08.649558589 +0000 UTC m=+4587.350220407" Nov 21 13:07:10 crc kubenswrapper[4769]: I1121 13:07:10.754602 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:07:13 crc kubenswrapper[4769]: I1121 13:07:13.941226 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:07:14 crc kubenswrapper[4769]: I1121 13:07:14.046951 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-79c66f4f97-wrp26"] Nov 21 13:07:14 crc kubenswrapper[4769]: I1121 13:07:14.047236 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-api" containerID="cri-o://0c258dc89c6ad6876241d9a2ec02c56859e3577dbc9ee65730edfade9b75b3e0" gracePeriod=30 Nov 21 13:07:14 crc kubenswrapper[4769]: I1121 13:07:14.047820 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-httpd" containerID="cri-o://aeb3a01da4c103652197d406181980d88f7cf0220d3fe57c7434d01d15f94499" gracePeriod=30 Nov 21 13:07:14 crc kubenswrapper[4769]: I1121 13:07:14.667902 4769 generic.go:334] "Generic (PLEG): container finished" podID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerID="aeb3a01da4c103652197d406181980d88f7cf0220d3fe57c7434d01d15f94499" exitCode=0 Nov 21 13:07:14 crc kubenswrapper[4769]: I1121 13:07:14.667979 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" event={"ID":"14cb44ec-35a4-41a8-ab6a-71b74294616b","Type":"ContainerDied","Data":"aeb3a01da4c103652197d406181980d88f7cf0220d3fe57c7434d01d15f94499"} Nov 21 13:07:15 crc kubenswrapper[4769]: I1121 13:07:15.696140 4769 generic.go:334] "Generic (PLEG): container finished" podID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerID="0c258dc89c6ad6876241d9a2ec02c56859e3577dbc9ee65730edfade9b75b3e0" exitCode=0 Nov 21 13:07:15 crc kubenswrapper[4769]: I1121 13:07:15.696239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" event={"ID":"14cb44ec-35a4-41a8-ab6a-71b74294616b","Type":"ContainerDied","Data":"0c258dc89c6ad6876241d9a2ec02c56859e3577dbc9ee65730edfade9b75b3e0"} Nov 21 13:07:15 crc kubenswrapper[4769]: I1121 13:07:15.977801 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.115700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7ctl\" (UniqueName: \"kubernetes.io/projected/14cb44ec-35a4-41a8-ab6a-71b74294616b-kube-api-access-f7ctl\") pod \"14cb44ec-35a4-41a8-ab6a-71b74294616b\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.115744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-combined-ca-bundle\") pod \"14cb44ec-35a4-41a8-ab6a-71b74294616b\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.115806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-httpd-config\") pod \"14cb44ec-35a4-41a8-ab6a-71b74294616b\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.115860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-config\") pod \"14cb44ec-35a4-41a8-ab6a-71b74294616b\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.115925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-ovndb-tls-certs\") pod \"14cb44ec-35a4-41a8-ab6a-71b74294616b\" (UID: \"14cb44ec-35a4-41a8-ab6a-71b74294616b\") " Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.123368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "14cb44ec-35a4-41a8-ab6a-71b74294616b" (UID: "14cb44ec-35a4-41a8-ab6a-71b74294616b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.124936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14cb44ec-35a4-41a8-ab6a-71b74294616b-kube-api-access-f7ctl" (OuterVolumeSpecName: "kube-api-access-f7ctl") pod "14cb44ec-35a4-41a8-ab6a-71b74294616b" (UID: "14cb44ec-35a4-41a8-ab6a-71b74294616b"). InnerVolumeSpecName "kube-api-access-f7ctl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.175847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14cb44ec-35a4-41a8-ab6a-71b74294616b" (UID: "14cb44ec-35a4-41a8-ab6a-71b74294616b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.176470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-config" (OuterVolumeSpecName: "config") pod "14cb44ec-35a4-41a8-ab6a-71b74294616b" (UID: "14cb44ec-35a4-41a8-ab6a-71b74294616b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.188409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "14cb44ec-35a4-41a8-ab6a-71b74294616b" (UID: "14cb44ec-35a4-41a8-ab6a-71b74294616b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.217870 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f7ctl\" (UniqueName: \"kubernetes.io/projected/14cb44ec-35a4-41a8-ab6a-71b74294616b-kube-api-access-f7ctl\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.218106 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.218212 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.218282 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.218342 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/14cb44ec-35a4-41a8-ab6a-71b74294616b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.274288 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:07:16 crc kubenswrapper[4769]: E1121 13:07:16.274740 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.706596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" event={"ID":"14cb44ec-35a4-41a8-ab6a-71b74294616b","Type":"ContainerDied","Data":"74ca1287a99c366fb64bb4a50f0e77d9cb089067d1768324e4825217a0ea26df"} Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.707635 4769 scope.go:117] "RemoveContainer" containerID="aeb3a01da4c103652197d406181980d88f7cf0220d3fe57c7434d01d15f94499" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.706772 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-79c66f4f97-wrp26" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.743701 4769 scope.go:117] "RemoveContainer" containerID="0c258dc89c6ad6876241d9a2ec02c56859e3577dbc9ee65730edfade9b75b3e0" Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.748686 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-79c66f4f97-wrp26"] Nov 21 13:07:16 crc kubenswrapper[4769]: I1121 13:07:16.756749 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-79c66f4f97-wrp26"] Nov 21 13:07:17 crc kubenswrapper[4769]: I1121 13:07:17.286936 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" path="/var/lib/kubelet/pods/14cb44ec-35a4-41a8-ab6a-71b74294616b/volumes" Nov 21 13:07:22 crc kubenswrapper[4769]: I1121 13:07:22.289691 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:07:22 crc kubenswrapper[4769]: I1121 13:07:22.290559 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-log" containerID="cri-o://87cf2ddf1a99e6efe63f7bb15f2d315f31cd9dbf512a45a8508cb8d90a0303d9" gracePeriod=30 Nov 21 13:07:22 crc kubenswrapper[4769]: I1121 13:07:22.290687 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-httpd" containerID="cri-o://b891c565e76b9494353fcdcbe809fe3b252a046220e933a441169a11153e8285" gracePeriod=30 Nov 21 13:07:22 crc kubenswrapper[4769]: I1121 13:07:22.776124 4769 generic.go:334] "Generic (PLEG): container finished" podID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerID="87cf2ddf1a99e6efe63f7bb15f2d315f31cd9dbf512a45a8508cb8d90a0303d9" exitCode=143 Nov 21 13:07:22 crc kubenswrapper[4769]: I1121 13:07:22.776179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e165180a-fd0c-4373-aed2-1ea6a8dd7e91","Type":"ContainerDied","Data":"87cf2ddf1a99e6efe63f7bb15f2d315f31cd9dbf512a45a8508cb8d90a0303d9"} Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.180584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.181598 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-central-agent" containerID="cri-o://beb8128bd45470c7cd8adccf78171fa97161ff7f76842b47b39e7fd6a8cd21d0" gracePeriod=30 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.181719 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="proxy-httpd" containerID="cri-o://58dce04cb8a3779cc5444df38aee1a213d7ff8ed0e735fe9632e0eb1218bcf8b" gracePeriod=30 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.181769 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="sg-core" containerID="cri-o://2c204f56e3fcd893a5d7e6929912e89cd9cc57a42e85e0f894f4bffedc3e9028" gracePeriod=30 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.181891 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-notification-agent" containerID="cri-o://6d20b04dc41825e44c83eca9315d62bacb7f08b19533558d3016be0b112d1a5b" gracePeriod=30 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.191797 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.390900 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.391235 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-log" containerID="cri-o://eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a" gracePeriod=30 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.391756 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-httpd" containerID="cri-o://93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb" gracePeriod=30 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.787599 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerID="eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a" exitCode=143 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.787676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b1a44c8c-1b3f-4002-8650-9092eba38890","Type":"ContainerDied","Data":"eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a"} Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.794950 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerID="58dce04cb8a3779cc5444df38aee1a213d7ff8ed0e735fe9632e0eb1218bcf8b" exitCode=0 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.794988 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerID="2c204f56e3fcd893a5d7e6929912e89cd9cc57a42e85e0f894f4bffedc3e9028" exitCode=2 Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.794984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerDied","Data":"58dce04cb8a3779cc5444df38aee1a213d7ff8ed0e735fe9632e0eb1218bcf8b"} Nov 21 13:07:23 crc kubenswrapper[4769]: I1121 13:07:23.795035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerDied","Data":"2c204f56e3fcd893a5d7e6929912e89cd9cc57a42e85e0f894f4bffedc3e9028"} Nov 21 13:07:24 crc kubenswrapper[4769]: I1121 13:07:24.807521 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerID="beb8128bd45470c7cd8adccf78171fa97161ff7f76842b47b39e7fd6a8cd21d0" exitCode=0 Nov 21 13:07:24 crc kubenswrapper[4769]: I1121 13:07:24.807642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerDied","Data":"beb8128bd45470c7cd8adccf78171fa97161ff7f76842b47b39e7fd6a8cd21d0"} Nov 21 13:07:25 crc kubenswrapper[4769]: I1121 13:07:25.819112 4769 generic.go:334] "Generic (PLEG): container finished" podID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerID="b891c565e76b9494353fcdcbe809fe3b252a046220e933a441169a11153e8285" exitCode=0 Nov 21 13:07:25 crc kubenswrapper[4769]: I1121 13:07:25.819165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e165180a-fd0c-4373-aed2-1ea6a8dd7e91","Type":"ContainerDied","Data":"b891c565e76b9494353fcdcbe809fe3b252a046220e933a441169a11153e8285"} Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.831835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e165180a-fd0c-4373-aed2-1ea6a8dd7e91","Type":"ContainerDied","Data":"32775c500c8d1081b468f48ae7e88261208c7a17fc4f905cf4dd83b9d17e6ae9"} Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.832250 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32775c500c8d1081b468f48ae7e88261208c7a17fc4f905cf4dd83b9d17e6ae9" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.835117 4769 generic.go:334] "Generic (PLEG): container finished" podID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerID="6d20b04dc41825e44c83eca9315d62bacb7f08b19533558d3016be0b112d1a5b" exitCode=0 Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.835169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerDied","Data":"6d20b04dc41825e44c83eca9315d62bacb7f08b19533558d3016be0b112d1a5b"} Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.870538 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.934885 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-combined-ca-bundle\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-public-tls-certs\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-config-data\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp4tp\" (UniqueName: \"kubernetes.io/projected/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-kube-api-access-jp4tp\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-scripts\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935203 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-logs\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.935270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-httpd-run\") pod \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\" (UID: \"e165180a-fd0c-4373-aed2-1ea6a8dd7e91\") " Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.936337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.937027 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-logs" (OuterVolumeSpecName: "logs") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.944041 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.944494 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-scripts" (OuterVolumeSpecName: "scripts") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.948341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-kube-api-access-jp4tp" (OuterVolumeSpecName: "kube-api-access-jp4tp") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "kube-api-access-jp4tp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.966372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:26 crc kubenswrapper[4769]: I1121 13:07:26.994110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:26.999086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-config-data" (OuterVolumeSpecName: "config-data") pod "e165180a-fd0c-4373-aed2-1ea6a8dd7e91" (UID: "e165180a-fd0c-4373-aed2-1ea6a8dd7e91"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037234 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037257 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037267 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jp4tp\" (UniqueName: \"kubernetes.io/projected/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-kube-api-access-jp4tp\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037279 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037310 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037319 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037327 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.037335 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e165180a-fd0c-4373-aed2-1ea6a8dd7e91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.057445 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.139306 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.328282 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.413273 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.443956 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-combined-ca-bundle\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.444023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-log-httpd\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.444060 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgkkt\" (UniqueName: \"kubernetes.io/projected/dc552cf4-09bf-474e-b669-b83b93faf7cc-kube-api-access-fgkkt\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.444169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-config-data\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.444351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-sg-core-conf-yaml\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.444379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-scripts\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.444434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-run-httpd\") pod \"dc552cf4-09bf-474e-b669-b83b93faf7cc\" (UID: \"dc552cf4-09bf-474e-b669-b83b93faf7cc\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.445291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.446586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.465445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc552cf4-09bf-474e-b669-b83b93faf7cc-kube-api-access-fgkkt" (OuterVolumeSpecName: "kube-api-access-fgkkt") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "kube-api-access-fgkkt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.474326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-scripts" (OuterVolumeSpecName: "scripts") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.480264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.527847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.545705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-config-data\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.545822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-internal-tls-certs\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.545898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.545939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-scripts\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.545996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-combined-ca-bundle\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-logs\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546038 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-httpd-run\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hkkb\" (UniqueName: \"kubernetes.io/projected/b1a44c8c-1b3f-4002-8650-9092eba38890-kube-api-access-9hkkb\") pod \"b1a44c8c-1b3f-4002-8650-9092eba38890\" (UID: \"b1a44c8c-1b3f-4002-8650-9092eba38890\") " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546443 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546460 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546470 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fgkkt\" (UniqueName: \"kubernetes.io/projected/dc552cf4-09bf-474e-b669-b83b93faf7cc-kube-api-access-fgkkt\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546479 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546488 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.546496 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dc552cf4-09bf-474e-b669-b83b93faf7cc-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.548138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-logs" (OuterVolumeSpecName: "logs") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.548797 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.549506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-scripts" (OuterVolumeSpecName: "scripts") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.551614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1a44c8c-1b3f-4002-8650-9092eba38890-kube-api-access-9hkkb" (OuterVolumeSpecName: "kube-api-access-9hkkb") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "kube-api-access-9hkkb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.557423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-config-data" (OuterVolumeSpecName: "config-data") pod "dc552cf4-09bf-474e-b669-b83b93faf7cc" (UID: "dc552cf4-09bf-474e-b669-b83b93faf7cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.571556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.597034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.597612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-config-data" (OuterVolumeSpecName: "config-data") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.598237 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b1a44c8c-1b3f-4002-8650-9092eba38890" (UID: "b1a44c8c-1b3f-4002-8650-9092eba38890"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648574 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648614 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648628 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc552cf4-09bf-474e-b669-b83b93faf7cc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648640 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648654 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648664 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b1a44c8c-1b3f-4002-8650-9092eba38890-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648674 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9hkkb\" (UniqueName: \"kubernetes.io/projected/b1a44c8c-1b3f-4002-8650-9092eba38890-kube-api-access-9hkkb\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648685 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.648695 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a44c8c-1b3f-4002-8650-9092eba38890-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.672848 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.750758 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.851765 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.852004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"dc552cf4-09bf-474e-b669-b83b93faf7cc","Type":"ContainerDied","Data":"adf415213a1d78c5cbd763ff258005b97e1acb49f648baff948243851c04b940"} Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.852048 4769 scope.go:117] "RemoveContainer" containerID="58dce04cb8a3779cc5444df38aee1a213d7ff8ed0e735fe9632e0eb1218bcf8b" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.858095 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerID="93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb" exitCode=0 Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.858337 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.859170 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.859250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b1a44c8c-1b3f-4002-8650-9092eba38890","Type":"ContainerDied","Data":"93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb"} Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.859704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b1a44c8c-1b3f-4002-8650-9092eba38890","Type":"ContainerDied","Data":"6161612e877ffc16ce851a706415f111235cffefa417fe73edd0819542ff86e1"} Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.887854 4769 scope.go:117] "RemoveContainer" containerID="2c204f56e3fcd893a5d7e6929912e89cd9cc57a42e85e0f894f4bffedc3e9028" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.901383 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.911655 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.919718 4769 scope.go:117] "RemoveContainer" containerID="6d20b04dc41825e44c83eca9315d62bacb7f08b19533558d3016be0b112d1a5b" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.939275 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.956348 4769 scope.go:117] "RemoveContainer" containerID="beb8128bd45470c7cd8adccf78171fa97161ff7f76842b47b39e7fd6a8cd21d0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.962776 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963287 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-notification-agent" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963305 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-notification-agent" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-log" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-log" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963365 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="proxy-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963373 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="proxy-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963382 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="sg-core" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="sg-core" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963399 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-central-agent" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-central-agent" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963424 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-api" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963430 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-api" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963445 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963454 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963467 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963474 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963498 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: E1121 13:07:27.963510 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-log" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-log" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963709 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-log" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963728 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963746 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="14cb44ec-35a4-41a8-ab6a-71b74294616b" containerName="neutron-api" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963760 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="sg-core" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963770 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963784 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-central-agent" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963808 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" containerName="glance-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963817 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" containerName="glance-log" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963832 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="proxy-httpd" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.963848 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" containerName="ceilometer-notification-agent" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.965009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.969157 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.969468 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-x7k8k" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.969755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.972403 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.977123 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.982984 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.990616 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.993931 4769 scope.go:117] "RemoveContainer" containerID="93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb" Nov 21 13:07:27 crc kubenswrapper[4769]: I1121 13:07:27.999013 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.000728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.005069 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.007085 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.007380 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.011796 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.011993 4769 scope.go:117] "RemoveContainer" containerID="eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.016277 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.019636 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.021782 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.023427 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.025961 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.037442 4769 scope.go:117] "RemoveContainer" containerID="93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb" Nov 21 13:07:28 crc kubenswrapper[4769]: E1121 13:07:28.040805 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb\": container with ID starting with 93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb not found: ID does not exist" containerID="93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.040840 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb"} err="failed to get container status \"93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb\": rpc error: code = NotFound desc = could not find container \"93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb\": container with ID starting with 93df77c17bbdd0795e198db37116a0ce3fad211002ff4b4113c5d70409cc5acb not found: ID does not exist" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.040865 4769 scope.go:117] "RemoveContainer" containerID="eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a" Nov 21 13:07:28 crc kubenswrapper[4769]: E1121 13:07:28.041871 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a\": container with ID starting with eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a not found: ID does not exist" containerID="eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.041896 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a"} err="failed to get container status \"eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a\": rpc error: code = NotFound desc = could not find container \"eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a\": container with ID starting with eaa94967ee2a9ad6234307406da4005d2d5b60884845e500caa41a7869b3643a not found: ID does not exist" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rtj\" (UniqueName: \"kubernetes.io/projected/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-kube-api-access-86rtj\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-config-data\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-scripts\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-log-httpd\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-run-httpd\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbjxx\" (UniqueName: \"kubernetes.io/projected/05f2ed02-a3b2-4013-a943-3700138b6b7e-kube-api-access-mbjxx\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.058946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-logs\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-logs\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6kg\" (UniqueName: \"kubernetes.io/projected/f157e621-8379-4c96-b7dc-57fcdda5d0c4-kube-api-access-5t6kg\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-scripts\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.059341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-config-data\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.160954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-config-data\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-scripts\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-log-httpd\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-run-httpd\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mbjxx\" (UniqueName: \"kubernetes.io/projected/05f2ed02-a3b2-4013-a943-3700138b6b7e-kube-api-access-mbjxx\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-logs\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-logs\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161244 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6kg\" (UniqueName: \"kubernetes.io/projected/f157e621-8379-4c96-b7dc-57fcdda5d0c4-kube-api-access-5t6kg\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-scripts\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161410 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-config-data\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.161476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-86rtj\" (UniqueName: \"kubernetes.io/projected/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-kube-api-access-86rtj\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.162514 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.162863 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.163376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.163412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-logs\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.164353 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.165271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-log-httpd\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.166215 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-scripts\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.167245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-run-httpd\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.167762 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-logs\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.170721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.172269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.172827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.173316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-config-data\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.174239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-scripts\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.174589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.175710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.176148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-config-data\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.176906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.181116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbjxx\" (UniqueName: \"kubernetes.io/projected/05f2ed02-a3b2-4013-a943-3700138b6b7e-kube-api-access-mbjxx\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.181705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.184685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rtj\" (UniqueName: \"kubernetes.io/projected/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-kube-api-access-86rtj\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.187328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.188358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6kg\" (UniqueName: \"kubernetes.io/projected/f157e621-8379-4c96-b7dc-57fcdda5d0c4-kube-api-access-5t6kg\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.194615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.198423 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.293322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.324747 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.335827 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.836096 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.869980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"05f2ed02-a3b2-4013-a943-3700138b6b7e","Type":"ContainerStarted","Data":"8af84cb3f1cfbf684d942b65726f1099dd3d78093ef7056bc57f39d0e6b849c7"} Nov 21 13:07:28 crc kubenswrapper[4769]: I1121 13:07:28.938849 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.080591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:07:29 crc kubenswrapper[4769]: W1121 13:07:29.090782 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d0edd87_3aa8_4e6e_9d17_50f4ebe509e1.slice/crio-e547908dbdfab4f17c2a5b0e8815a93f5840e0e20f3de064e6e07947d8c3a0f1 WatchSource:0}: Error finding container e547908dbdfab4f17c2a5b0e8815a93f5840e0e20f3de064e6e07947d8c3a0f1: Status 404 returned error can't find the container with id e547908dbdfab4f17c2a5b0e8815a93f5840e0e20f3de064e6e07947d8c3a0f1 Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.290490 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1a44c8c-1b3f-4002-8650-9092eba38890" path="/var/lib/kubelet/pods/b1a44c8c-1b3f-4002-8650-9092eba38890/volumes" Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.291396 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc552cf4-09bf-474e-b669-b83b93faf7cc" path="/var/lib/kubelet/pods/dc552cf4-09bf-474e-b669-b83b93faf7cc/volumes" Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.292983 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e165180a-fd0c-4373-aed2-1ea6a8dd7e91" path="/var/lib/kubelet/pods/e165180a-fd0c-4373-aed2-1ea6a8dd7e91/volumes" Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.884167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f157e621-8379-4c96-b7dc-57fcdda5d0c4","Type":"ContainerStarted","Data":"faaa6e9f854fa0504bbc4faf568136dd8c73c925ce7bbd0d9b8d4afc2cc3d66e"} Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.884417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f157e621-8379-4c96-b7dc-57fcdda5d0c4","Type":"ContainerStarted","Data":"d3cd3f9df8fde2609f0cdaa200c852331a270c96d66c56b137f2fef9247f5fa2"} Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.886277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"05f2ed02-a3b2-4013-a943-3700138b6b7e","Type":"ContainerStarted","Data":"b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56"} Nov 21 13:07:29 crc kubenswrapper[4769]: I1121 13:07:29.888216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerStarted","Data":"e547908dbdfab4f17c2a5b0e8815a93f5840e0e20f3de064e6e07947d8c3a0f1"} Nov 21 13:07:30 crc kubenswrapper[4769]: I1121 13:07:30.273907 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:07:30 crc kubenswrapper[4769]: E1121 13:07:30.274543 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:07:30 crc kubenswrapper[4769]: I1121 13:07:30.910359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f157e621-8379-4c96-b7dc-57fcdda5d0c4","Type":"ContainerStarted","Data":"618c6394b6f71ec340da52668c44606f16215359e0e5b885e2704e7e86e8a30e"} Nov 21 13:07:30 crc kubenswrapper[4769]: I1121 13:07:30.915745 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"05f2ed02-a3b2-4013-a943-3700138b6b7e","Type":"ContainerStarted","Data":"f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436"} Nov 21 13:07:30 crc kubenswrapper[4769]: I1121 13:07:30.918101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerStarted","Data":"7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1"} Nov 21 13:07:30 crc kubenswrapper[4769]: I1121 13:07:30.918213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerStarted","Data":"130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07"} Nov 21 13:07:30 crc kubenswrapper[4769]: I1121 13:07:30.948422 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.948404345 podStartE2EDuration="3.948404345s" podCreationTimestamp="2025-11-21 13:07:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:30.941611583 +0000 UTC m=+4609.642273401" watchObservedRunningTime="2025-11-21 13:07:30.948404345 +0000 UTC m=+4609.649066163" Nov 21 13:07:31 crc kubenswrapper[4769]: I1121 13:07:31.930369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerStarted","Data":"0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676"} Nov 21 13:07:33 crc kubenswrapper[4769]: I1121 13:07:33.332071 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.332043194 podStartE2EDuration="6.332043194s" podCreationTimestamp="2025-11-21 13:07:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:30.98012424 +0000 UTC m=+4609.680786058" watchObservedRunningTime="2025-11-21 13:07:33.332043194 +0000 UTC m=+4612.032705012" Nov 21 13:07:33 crc kubenswrapper[4769]: I1121 13:07:33.949202 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerStarted","Data":"cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07"} Nov 21 13:07:33 crc kubenswrapper[4769]: I1121 13:07:33.949338 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:33 crc kubenswrapper[4769]: I1121 13:07:33.984448 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.099119685 podStartE2EDuration="6.984430473s" podCreationTimestamp="2025-11-21 13:07:27 +0000 UTC" firstStartedPulling="2025-11-21 13:07:29.095148468 +0000 UTC m=+4607.795810276" lastFinishedPulling="2025-11-21 13:07:32.980459256 +0000 UTC m=+4611.681121064" observedRunningTime="2025-11-21 13:07:33.981632137 +0000 UTC m=+4612.682293955" watchObservedRunningTime="2025-11-21 13:07:33.984430473 +0000 UTC m=+4612.685092291" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.295659 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.296650 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.325490 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.325542 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.337900 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.344930 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.374716 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:38 crc kubenswrapper[4769]: I1121 13:07:38.390301 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:39 crc kubenswrapper[4769]: I1121 13:07:39.018383 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:39 crc kubenswrapper[4769]: I1121 13:07:39.018803 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:39 crc kubenswrapper[4769]: I1121 13:07:39.018868 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:39 crc kubenswrapper[4769]: I1121 13:07:39.018893 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:40 crc kubenswrapper[4769]: I1121 13:07:40.894965 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:40 crc kubenswrapper[4769]: I1121 13:07:40.901744 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:07:40 crc kubenswrapper[4769]: I1121 13:07:40.958845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:40 crc kubenswrapper[4769]: I1121 13:07:40.976280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:07:41 crc kubenswrapper[4769]: I1121 13:07:41.968263 4769 scope.go:117] "RemoveContainer" containerID="5103bfeb6e2ec90a8d2df4a9be6027cee2234f1db18364a4a6da13fa852d6e7b" Nov 21 13:07:41 crc kubenswrapper[4769]: I1121 13:07:41.991634 4769 scope.go:117] "RemoveContainer" containerID="1b01aedc61dc564f94350dee844d3f4a7ce300a26c19025ab287f72fae15d0cf" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.018441 4769 scope.go:117] "RemoveContainer" containerID="0e437bb579132d6d52ead854dbc93b7a588de56b7990e866986909eb0ae0e6f3" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.040826 4769 scope.go:117] "RemoveContainer" containerID="f9091ab6402e1d92bcf8d022635ec6854fa2357218e1be4d6f4af236808f1d92" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.057266 4769 scope.go:117] "RemoveContainer" containerID="bdb249d34231152d8b7ad61f684b9efd0a9548cb75cec2f4c6c0c39a45f1b094" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.084372 4769 scope.go:117] "RemoveContainer" containerID="cb2c948ceb0f7a4cebc6751c19c9c37f6327d597116dc92fd967943a92275ae4" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.123782 4769 scope.go:117] "RemoveContainer" containerID="acf6967aae48774e24ef815db07b3dc8328b53a6b6ca1f2f72a1960900f5df92" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.153634 4769 scope.go:117] "RemoveContainer" containerID="1ea72bf39e671062876f3a49594a7eaab1401ac55d84f0d55d4827a0a71b971a" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.177651 4769 scope.go:117] "RemoveContainer" containerID="4e5178bbc7660e09cfcee3b800b1741645b66fab332b85d296a918c21794e620" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.227665 4769 scope.go:117] "RemoveContainer" containerID="18763f231736066d7b271883c663de5e1fd798909086b9da270de410a8af74a1" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.251338 4769 scope.go:117] "RemoveContainer" containerID="7f22b3cac355c4ed3a08c89edac1382ea60db6ae00933981f54d3dd1110d9eb3" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.274435 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:07:42 crc kubenswrapper[4769]: E1121 13:07:42.274690 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.282000 4769 scope.go:117] "RemoveContainer" containerID="3706207bc4f56be71c0236303069ea66a0c9cd39c384d2d045bc11fa03ea3010" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.307738 4769 scope.go:117] "RemoveContainer" containerID="ca112281091f134f063a730f0d05455846dd4539dd38263b6eb303013005f234" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.383773 4769 scope.go:117] "RemoveContainer" containerID="f1fbf5e59ab31384810106fd8eb0d8f6321c4b8aee8f6b186fb705b0eba28c27" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.411154 4769 scope.go:117] "RemoveContainer" containerID="a00def91be98af9694b5aab9edfbc7ae261ba45918af57cb36ca71973d4479e5" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.444305 4769 scope.go:117] "RemoveContainer" containerID="29e40571c70fc388e9bc006af0adb8d2eee8ac89c0c617ee3dc948670dd09df1" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.462644 4769 scope.go:117] "RemoveContainer" containerID="c277579ec893fc4292c243ac98434e9bb42389c14690eb4a8d13bfa7587253f0" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.484985 4769 scope.go:117] "RemoveContainer" containerID="095dbeb632ec4a10367043956c1f349b440be363d145e7b11b29ddf7dc9d5e78" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.510174 4769 scope.go:117] "RemoveContainer" containerID="43037d63719c54f059d0bbbce7005e49220a7a30b477272d7e72153c16868ca2" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.537970 4769 scope.go:117] "RemoveContainer" containerID="fa81b6373af9d8da44f2db174a05dc3c2827332cb15530db622102fe7983077d" Nov 21 13:07:42 crc kubenswrapper[4769]: I1121 13:07:42.572918 4769 scope.go:117] "RemoveContainer" containerID="16c21f5695a703b6ad19745e0a324df14249e8842eca08b316f77ece5e852478" Nov 21 13:07:43 crc kubenswrapper[4769]: I1121 13:07:43.086174 4769 generic.go:334] "Generic (PLEG): container finished" podID="c3bfa54a-e28e-4914-8cff-800df74c7a21" containerID="e5c850067e6dc734296c14a3a39e614a776748728e46009b22ee9adf1e1b288d" exitCode=0 Nov 21 13:07:43 crc kubenswrapper[4769]: I1121 13:07:43.086272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" event={"ID":"c3bfa54a-e28e-4914-8cff-800df74c7a21","Type":"ContainerDied","Data":"e5c850067e6dc734296c14a3a39e614a776748728e46009b22ee9adf1e1b288d"} Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.468140 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.549301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-286v2\" (UniqueName: \"kubernetes.io/projected/c3bfa54a-e28e-4914-8cff-800df74c7a21-kube-api-access-286v2\") pod \"c3bfa54a-e28e-4914-8cff-800df74c7a21\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.549412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-combined-ca-bundle\") pod \"c3bfa54a-e28e-4914-8cff-800df74c7a21\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.549539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-config-data\") pod \"c3bfa54a-e28e-4914-8cff-800df74c7a21\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.549555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-scripts\") pod \"c3bfa54a-e28e-4914-8cff-800df74c7a21\" (UID: \"c3bfa54a-e28e-4914-8cff-800df74c7a21\") " Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.555302 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3bfa54a-e28e-4914-8cff-800df74c7a21-kube-api-access-286v2" (OuterVolumeSpecName: "kube-api-access-286v2") pod "c3bfa54a-e28e-4914-8cff-800df74c7a21" (UID: "c3bfa54a-e28e-4914-8cff-800df74c7a21"). InnerVolumeSpecName "kube-api-access-286v2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.555309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-scripts" (OuterVolumeSpecName: "scripts") pod "c3bfa54a-e28e-4914-8cff-800df74c7a21" (UID: "c3bfa54a-e28e-4914-8cff-800df74c7a21"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.580323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c3bfa54a-e28e-4914-8cff-800df74c7a21" (UID: "c3bfa54a-e28e-4914-8cff-800df74c7a21"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.591563 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-config-data" (OuterVolumeSpecName: "config-data") pod "c3bfa54a-e28e-4914-8cff-800df74c7a21" (UID: "c3bfa54a-e28e-4914-8cff-800df74c7a21"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.651832 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.651864 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.651874 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c3bfa54a-e28e-4914-8cff-800df74c7a21-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:44 crc kubenswrapper[4769]: I1121 13:07:44.651883 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-286v2\" (UniqueName: \"kubernetes.io/projected/c3bfa54a-e28e-4914-8cff-800df74c7a21-kube-api-access-286v2\") on node \"crc\" DevicePath \"\"" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.115526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" event={"ID":"c3bfa54a-e28e-4914-8cff-800df74c7a21","Type":"ContainerDied","Data":"cc5a736288443f50ea0ef41df74c857aacb805bf1764d86e6aa0dfa772804077"} Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.115585 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc5a736288443f50ea0ef41df74c857aacb805bf1764d86e6aa0dfa772804077" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.115601 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.229320 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:07:45 crc kubenswrapper[4769]: E1121 13:07:45.229954 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c3bfa54a-e28e-4914-8cff-800df74c7a21" containerName="nova-cell0-conductor-db-sync" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.229988 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bfa54a-e28e-4914-8cff-800df74c7a21" containerName="nova-cell0-conductor-db-sync" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.230403 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c3bfa54a-e28e-4914-8cff-800df74c7a21" containerName="nova-cell0-conductor-db-sync" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.231688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.235143 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-ng22d" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.236694 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.242205 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.366219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.366647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9k8\" (UniqueName: \"kubernetes.io/projected/6bc4ad50-e2dd-48ec-8af1-5145707c3026-kube-api-access-jr9k8\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.366922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.469661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.469795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9k8\" (UniqueName: \"kubernetes.io/projected/6bc4ad50-e2dd-48ec-8af1-5145707c3026-kube-api-access-jr9k8\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.469856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.475852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.481364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.513129 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9k8\" (UniqueName: \"kubernetes.io/projected/6bc4ad50-e2dd-48ec-8af1-5145707c3026-kube-api-access-jr9k8\") pod \"nova-cell0-conductor-0\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:45 crc kubenswrapper[4769]: I1121 13:07:45.559881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:46 crc kubenswrapper[4769]: I1121 13:07:46.066329 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:07:46 crc kubenswrapper[4769]: W1121 13:07:46.208837 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc4ad50_e2dd_48ec_8af1_5145707c3026.slice/crio-b3a0e4d8d7fa2670d663031864815e1d2da8dbf36ecd941c7996e95a8013bdff WatchSource:0}: Error finding container b3a0e4d8d7fa2670d663031864815e1d2da8dbf36ecd941c7996e95a8013bdff: Status 404 returned error can't find the container with id b3a0e4d8d7fa2670d663031864815e1d2da8dbf36ecd941c7996e95a8013bdff Nov 21 13:07:47 crc kubenswrapper[4769]: I1121 13:07:47.145760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6bc4ad50-e2dd-48ec-8af1-5145707c3026","Type":"ContainerStarted","Data":"63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe"} Nov 21 13:07:47 crc kubenswrapper[4769]: I1121 13:07:47.146383 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:47 crc kubenswrapper[4769]: I1121 13:07:47.146406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6bc4ad50-e2dd-48ec-8af1-5145707c3026","Type":"ContainerStarted","Data":"b3a0e4d8d7fa2670d663031864815e1d2da8dbf36ecd941c7996e95a8013bdff"} Nov 21 13:07:47 crc kubenswrapper[4769]: I1121 13:07:47.171492 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.171466345 podStartE2EDuration="2.171466345s" podCreationTimestamp="2025-11-21 13:07:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:47.163736557 +0000 UTC m=+4625.864398385" watchObservedRunningTime="2025-11-21 13:07:47.171466345 +0000 UTC m=+4625.872128173" Nov 21 13:07:55 crc kubenswrapper[4769]: I1121 13:07:55.274334 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:07:55 crc kubenswrapper[4769]: E1121 13:07:55.275693 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:07:55 crc kubenswrapper[4769]: I1121 13:07:55.613858 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.110696 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.112865 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.124612 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.125702 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.125924 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.263286 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.265033 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.267634 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.277867 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-scripts\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnsm\" (UniqueName: \"kubernetes.io/projected/a9947afc-b1ba-486e-be88-83ba66751c37-kube-api-access-wvnsm\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-config-data\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8c9f\" (UniqueName: \"kubernetes.io/projected/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-kube-api-access-x8c9f\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-config-data\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.284889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-logs\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.292850 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.297032 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.299324 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.337882 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.345859 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.347414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.349690 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.356751 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.386875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddvnq\" (UniqueName: \"kubernetes.io/projected/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-kube-api-access-ddvnq\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.386919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99sj\" (UniqueName: \"kubernetes.io/projected/9fc14456-7677-4380-85ac-5c1ef5ba37a0-kube-api-access-m99sj\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.386959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.386986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-config-data\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-logs\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387124 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-config-data\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387183 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-scripts\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnsm\" (UniqueName: \"kubernetes.io/projected/a9947afc-b1ba-486e-be88-83ba66751c37-kube-api-access-wvnsm\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-config-data\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387367 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x8c9f\" (UniqueName: \"kubernetes.io/projected/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-kube-api-access-x8c9f\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.387564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.389820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-logs\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.393402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-config-data\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.393417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.393904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.405383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-config-data\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.405745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-scripts\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.413873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8c9f\" (UniqueName: \"kubernetes.io/projected/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-kube-api-access-x8c9f\") pod \"nova-api-0\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.433359 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.436600 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.443433 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.466159 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.472179 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnsm\" (UniqueName: \"kubernetes.io/projected/a9947afc-b1ba-486e-be88-83ba66751c37-kube-api-access-wvnsm\") pod \"nova-cell0-cell-mapping-pwqlw\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.481771 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.527457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-config-data\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.528306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.529749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.529789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-logs\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.529853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-config-data\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.529970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.529994 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4pz2\" (UniqueName: \"kubernetes.io/projected/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-kube-api-access-n4pz2\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.530078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ddvnq\" (UniqueName: \"kubernetes.io/projected/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-kube-api-access-ddvnq\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.530099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m99sj\" (UniqueName: \"kubernetes.io/projected/9fc14456-7677-4380-85ac-5c1ef5ba37a0-kube-api-access-m99sj\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.530131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.533465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.534344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-config-data\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.543713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.549615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddvnq\" (UniqueName: \"kubernetes.io/projected/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-kube-api-access-ddvnq\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.549623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.550113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99sj\" (UniqueName: \"kubernetes.io/projected/9fc14456-7677-4380-85ac-5c1ef5ba37a0-kube-api-access-m99sj\") pod \"nova-scheduler-0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.585605 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.617001 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.632272 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.632362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-logs\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.632405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-config-data\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.632469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n4pz2\" (UniqueName: \"kubernetes.io/projected/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-kube-api-access-n4pz2\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.634591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-logs\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.638983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.639168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-config-data\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.664711 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4pz2\" (UniqueName: \"kubernetes.io/projected/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-kube-api-access-n4pz2\") pod \"nova-metadata-0\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.667825 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:07:56 crc kubenswrapper[4769]: I1121 13:07:56.923035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.010760 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw"] Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.261275 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.267106 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:07:57 crc kubenswrapper[4769]: W1121 13:07:57.267291 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce38955c_5fa8_4c19_9b5c_aa90e080bd78.slice/crio-ebe7eb9d14b551663a62a461b8942a26b54a56e4b096bb36d4d33f2cdbbf0a4a WatchSource:0}: Error finding container ebe7eb9d14b551663a62a461b8942a26b54a56e4b096bb36d4d33f2cdbbf0a4a: Status 404 returned error can't find the container with id ebe7eb9d14b551663a62a461b8942a26b54a56e4b096bb36d4d33f2cdbbf0a4a Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.295249 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn"] Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.300082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ce38955c-5fa8-4c19-9b5c-aa90e080bd78","Type":"ContainerStarted","Data":"ebe7eb9d14b551663a62a461b8942a26b54a56e4b096bb36d4d33f2cdbbf0a4a"} Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.300176 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.301500 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn"] Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.302270 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.303358 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.307257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" event={"ID":"a9947afc-b1ba-486e-be88-83ba66751c37","Type":"ContainerStarted","Data":"68498204ee4dd4d70c1ccec0918db4576ef3e0ae7c56967917201a9d63812d9a"} Nov 21 13:07:57 crc kubenswrapper[4769]: W1121 13:07:57.328524 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc79d9db3_fa83_4e01_bdff_799f10ecd9b9.slice/crio-dd53b821eb6526e3644112c66e8e7e1a30b72c2d076ec31c8b749e345e0b2207 WatchSource:0}: Error finding container dd53b821eb6526e3644112c66e8e7e1a30b72c2d076ec31c8b749e345e0b2207: Status 404 returned error can't find the container with id dd53b821eb6526e3644112c66e8e7e1a30b72c2d076ec31c8b749e345e0b2207 Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.334233 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:07:57 crc kubenswrapper[4769]: W1121 13:07:57.348221 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fc14456_7677_4380_85ac_5c1ef5ba37a0.slice/crio-205b07734e36f0678379a3f575c4ef724405e356c5112b60096603c9c5f1e54d WatchSource:0}: Error finding container 205b07734e36f0678379a3f575c4ef724405e356c5112b60096603c9c5f1e54d: Status 404 returned error can't find the container with id 205b07734e36f0678379a3f575c4ef724405e356c5112b60096603c9c5f1e54d Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.349543 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.449866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.450324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw95p\" (UniqueName: \"kubernetes.io/projected/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-kube-api-access-jw95p\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.450383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-scripts\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.450415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-config-data\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.553616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-scripts\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.553677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-config-data\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.553748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.553805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jw95p\" (UniqueName: \"kubernetes.io/projected/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-kube-api-access-jw95p\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.566965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-config-data\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.572667 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-scripts\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.572794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.605714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw95p\" (UniqueName: \"kubernetes.io/projected/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-kube-api-access-jw95p\") pod \"nova-cell1-conductor-db-sync-h8tjn\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:57 crc kubenswrapper[4769]: I1121 13:07:57.627723 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.090343 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn"] Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.316654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9fc14456-7677-4380-85ac-5c1ef5ba37a0","Type":"ContainerStarted","Data":"f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.316699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9fc14456-7677-4380-85ac-5c1ef5ba37a0","Type":"ContainerStarted","Data":"205b07734e36f0678379a3f575c4ef724405e356c5112b60096603c9c5f1e54d"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.319065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ce38955c-5fa8-4c19-9b5c-aa90e080bd78","Type":"ContainerStarted","Data":"69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.319100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ce38955c-5fa8-4c19-9b5c-aa90e080bd78","Type":"ContainerStarted","Data":"6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.321367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" event={"ID":"a9947afc-b1ba-486e-be88-83ba66751c37","Type":"ContainerStarted","Data":"28079413175ac0c62eb6bfc85d57b17ecb0e9f64ba592241bcf0e867a7026fc7"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.323085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" event={"ID":"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81","Type":"ContainerStarted","Data":"ecd3726cfa81aff917bd5bdc8db544db6efd4ab7aac38f9e297d3563609e64ee"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.323113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" event={"ID":"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81","Type":"ContainerStarted","Data":"1124725da4c487256fd81e0bdd11804855415939b01dd9baeaed21424462eeda"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.326905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b1550311-bd90-4a91-a2d0-ec7b2b2a6326","Type":"ContainerStarted","Data":"1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.327267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b1550311-bd90-4a91-a2d0-ec7b2b2a6326","Type":"ContainerStarted","Data":"06dcc91c9997a6d49f317407197c98daab0cb93ad9a92205acaf3eeaa6af70e2"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.329118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c79d9db3-fa83-4e01-bdff-799f10ecd9b9","Type":"ContainerStarted","Data":"727e48ea3638b91ec9afc41a762955cc8212cf71d6129e142c2cbd2d4fda78f0"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.329157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c79d9db3-fa83-4e01-bdff-799f10ecd9b9","Type":"ContainerStarted","Data":"47464cb4f9c29c0b7a22d462adacb55e61f37977af85f1484d17a548f3a6d76e"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.329169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c79d9db3-fa83-4e01-bdff-799f10ecd9b9","Type":"ContainerStarted","Data":"dd53b821eb6526e3644112c66e8e7e1a30b72c2d076ec31c8b749e345e0b2207"} Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.340709 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.340692211 podStartE2EDuration="2.340692211s" podCreationTimestamp="2025-11-21 13:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:58.335245145 +0000 UTC m=+4637.035906963" watchObservedRunningTime="2025-11-21 13:07:58.340692211 +0000 UTC m=+4637.041354029" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.350468 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.372615 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.372595561 podStartE2EDuration="2.372595561s" podCreationTimestamp="2025-11-21 13:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:58.361941824 +0000 UTC m=+4637.062603632" watchObservedRunningTime="2025-11-21 13:07:58.372595561 +0000 UTC m=+4637.073257379" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.392946 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" podStartSLOduration=1.392928458 podStartE2EDuration="1.392928458s" podCreationTimestamp="2025-11-21 13:07:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:58.383150615 +0000 UTC m=+4637.083812423" watchObservedRunningTime="2025-11-21 13:07:58.392928458 +0000 UTC m=+4637.093590276" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.415256 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.415239539 podStartE2EDuration="2.415239539s" podCreationTimestamp="2025-11-21 13:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:58.411021685 +0000 UTC m=+4637.111683543" watchObservedRunningTime="2025-11-21 13:07:58.415239539 +0000 UTC m=+4637.115901357" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.430534 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.43051714 podStartE2EDuration="2.43051714s" podCreationTimestamp="2025-11-21 13:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:58.429472092 +0000 UTC m=+4637.130133910" watchObservedRunningTime="2025-11-21 13:07:58.43051714 +0000 UTC m=+4637.131178958" Nov 21 13:07:58 crc kubenswrapper[4769]: I1121 13:07:58.448603 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" podStartSLOduration=2.448584677 podStartE2EDuration="2.448584677s" podCreationTimestamp="2025-11-21 13:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:07:58.44684728 +0000 UTC m=+4637.147509098" watchObservedRunningTime="2025-11-21 13:07:58.448584677 +0000 UTC m=+4637.149246495" Nov 21 13:07:59 crc kubenswrapper[4769]: I1121 13:07:59.831367 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:07:59 crc kubenswrapper[4769]: I1121 13:07:59.844171 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:08:00 crc kubenswrapper[4769]: I1121 13:08:00.368636 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="b1550311-bd90-4a91-a2d0-ec7b2b2a6326" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6" gracePeriod=30 Nov 21 13:08:00 crc kubenswrapper[4769]: I1121 13:08:00.369070 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-log" containerID="cri-o://47464cb4f9c29c0b7a22d462adacb55e61f37977af85f1484d17a548f3a6d76e" gracePeriod=30 Nov 21 13:08:00 crc kubenswrapper[4769]: I1121 13:08:00.369284 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-metadata" containerID="cri-o://727e48ea3638b91ec9afc41a762955cc8212cf71d6129e142c2cbd2d4fda78f0" gracePeriod=30 Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.378840 4769 generic.go:334] "Generic (PLEG): container finished" podID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerID="727e48ea3638b91ec9afc41a762955cc8212cf71d6129e142c2cbd2d4fda78f0" exitCode=0 Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.379217 4769 generic.go:334] "Generic (PLEG): container finished" podID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerID="47464cb4f9c29c0b7a22d462adacb55e61f37977af85f1484d17a548f3a6d76e" exitCode=143 Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.379244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c79d9db3-fa83-4e01-bdff-799f10ecd9b9","Type":"ContainerDied","Data":"727e48ea3638b91ec9afc41a762955cc8212cf71d6129e142c2cbd2d4fda78f0"} Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.379274 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c79d9db3-fa83-4e01-bdff-799f10ecd9b9","Type":"ContainerDied","Data":"47464cb4f9c29c0b7a22d462adacb55e61f37977af85f1484d17a548f3a6d76e"} Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.379287 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"c79d9db3-fa83-4e01-bdff-799f10ecd9b9","Type":"ContainerDied","Data":"dd53b821eb6526e3644112c66e8e7e1a30b72c2d076ec31c8b749e345e0b2207"} Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.379301 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd53b821eb6526e3644112c66e8e7e1a30b72c2d076ec31c8b749e345e0b2207" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.382069 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.456427 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-config-data\") pod \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.456518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4pz2\" (UniqueName: \"kubernetes.io/projected/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-kube-api-access-n4pz2\") pod \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.456545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-logs\") pod \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.456578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-combined-ca-bundle\") pod \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\" (UID: \"c79d9db3-fa83-4e01-bdff-799f10ecd9b9\") " Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.457201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-logs" (OuterVolumeSpecName: "logs") pod "c79d9db3-fa83-4e01-bdff-799f10ecd9b9" (UID: "c79d9db3-fa83-4e01-bdff-799f10ecd9b9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.463158 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-kube-api-access-n4pz2" (OuterVolumeSpecName: "kube-api-access-n4pz2") pod "c79d9db3-fa83-4e01-bdff-799f10ecd9b9" (UID: "c79d9db3-fa83-4e01-bdff-799f10ecd9b9"). InnerVolumeSpecName "kube-api-access-n4pz2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.491848 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-config-data" (OuterVolumeSpecName: "config-data") pod "c79d9db3-fa83-4e01-bdff-799f10ecd9b9" (UID: "c79d9db3-fa83-4e01-bdff-799f10ecd9b9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.494869 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c79d9db3-fa83-4e01-bdff-799f10ecd9b9" (UID: "c79d9db3-fa83-4e01-bdff-799f10ecd9b9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.559080 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n4pz2\" (UniqueName: \"kubernetes.io/projected/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-kube-api-access-n4pz2\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.559119 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.559129 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.559137 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c79d9db3-fa83-4e01-bdff-799f10ecd9b9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.618216 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:01 crc kubenswrapper[4769]: I1121 13:08:01.668581 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.380973 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.389818 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1550311-bd90-4a91-a2d0-ec7b2b2a6326" containerID="1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6" exitCode=0 Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.389905 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.392322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b1550311-bd90-4a91-a2d0-ec7b2b2a6326","Type":"ContainerDied","Data":"1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6"} Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.392371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b1550311-bd90-4a91-a2d0-ec7b2b2a6326","Type":"ContainerDied","Data":"06dcc91c9997a6d49f317407197c98daab0cb93ad9a92205acaf3eeaa6af70e2"} Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.392367 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.392392 4769 scope.go:117] "RemoveContainer" containerID="1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.438183 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.449075 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.456864 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:02 crc kubenswrapper[4769]: E1121 13:08:02.457487 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-metadata" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.457509 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-metadata" Nov 21 13:08:02 crc kubenswrapper[4769]: E1121 13:08:02.457538 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-log" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.457548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-log" Nov 21 13:08:02 crc kubenswrapper[4769]: E1121 13:08:02.457559 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1550311-bd90-4a91-a2d0-ec7b2b2a6326" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.457567 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1550311-bd90-4a91-a2d0-ec7b2b2a6326" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.457784 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1550311-bd90-4a91-a2d0-ec7b2b2a6326" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.457804 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-metadata" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.457818 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" containerName="nova-metadata-log" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.458776 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.462665 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.462889 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.476544 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.483986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-config-data\") pod \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.484124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddvnq\" (UniqueName: \"kubernetes.io/projected/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-kube-api-access-ddvnq\") pod \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.484218 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-combined-ca-bundle\") pod \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\" (UID: \"b1550311-bd90-4a91-a2d0-ec7b2b2a6326\") " Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.489495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-kube-api-access-ddvnq" (OuterVolumeSpecName: "kube-api-access-ddvnq") pod "b1550311-bd90-4a91-a2d0-ec7b2b2a6326" (UID: "b1550311-bd90-4a91-a2d0-ec7b2b2a6326"). InnerVolumeSpecName "kube-api-access-ddvnq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.587937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.587983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9fpx\" (UniqueName: \"kubernetes.io/projected/d9154caf-2441-445e-98dc-5972db94dbed-kube-api-access-h9fpx\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.588041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.588271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9154caf-2441-445e-98dc-5972db94dbed-logs\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.588494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-config-data\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.588643 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ddvnq\" (UniqueName: \"kubernetes.io/projected/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-kube-api-access-ddvnq\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.689878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9154caf-2441-445e-98dc-5972db94dbed-logs\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.690040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-config-data\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.690298 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9154caf-2441-445e-98dc-5972db94dbed-logs\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.690820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.690892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h9fpx\" (UniqueName: \"kubernetes.io/projected/d9154caf-2441-445e-98dc-5972db94dbed-kube-api-access-h9fpx\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.690985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.696021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-config-data\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.696982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.706881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.707712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9fpx\" (UniqueName: \"kubernetes.io/projected/d9154caf-2441-445e-98dc-5972db94dbed-kube-api-access-h9fpx\") pod \"nova-metadata-0\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.719305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-config-data" (OuterVolumeSpecName: "config-data") pod "b1550311-bd90-4a91-a2d0-ec7b2b2a6326" (UID: "b1550311-bd90-4a91-a2d0-ec7b2b2a6326"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.778802 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.793251 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.795362 4769 scope.go:117] "RemoveContainer" containerID="1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6" Nov 21 13:08:02 crc kubenswrapper[4769]: E1121 13:08:02.796134 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6\": container with ID starting with 1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6 not found: ID does not exist" containerID="1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.796227 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6"} err="failed to get container status \"1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6\": rpc error: code = NotFound desc = could not find container \"1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6\": container with ID starting with 1c2b27f38bf387025a46e8d15cab185ea28b02aeb9935abf2607cb39191998f6 not found: ID does not exist" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.801077 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b1550311-bd90-4a91-a2d0-ec7b2b2a6326" (UID: "b1550311-bd90-4a91-a2d0-ec7b2b2a6326"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.895294 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1550311-bd90-4a91-a2d0-ec7b2b2a6326-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.985421 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:08:02 crc kubenswrapper[4769]: I1121 13:08:02.985705 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="8cdee706-08c6-49d7-a7ca-7a96d66d078f" containerName="kube-state-metrics" containerID="cri-o://aeccfb853b8fe5c2e960a416503d671e9a494ea1be79bdc76eb093ba3cdc8e76" gracePeriod=30 Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.032854 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.046996 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.057936 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.059375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.061787 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.061884 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.062027 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.071083 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.201271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.201325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56rfz\" (UniqueName: \"kubernetes.io/projected/acd2a17a-d088-4084-959f-a544d6afdd27-kube-api-access-56rfz\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.201384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.201424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.201531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.288214 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1550311-bd90-4a91-a2d0-ec7b2b2a6326" path="/var/lib/kubelet/pods/b1550311-bd90-4a91-a2d0-ec7b2b2a6326/volumes" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.289833 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c79d9db3-fa83-4e01-bdff-799f10ecd9b9" path="/var/lib/kubelet/pods/c79d9db3-fa83-4e01-bdff-799f10ecd9b9/volumes" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.303588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.303665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.303704 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-56rfz\" (UniqueName: \"kubernetes.io/projected/acd2a17a-d088-4084-959f-a544d6afdd27-kube-api-access-56rfz\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.304572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.304650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.308161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.308828 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.308965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.313039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.321902 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-56rfz\" (UniqueName: \"kubernetes.io/projected/acd2a17a-d088-4084-959f-a544d6afdd27-kube-api-access-56rfz\") pod \"nova-cell1-novncproxy-0\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.404114 4769 generic.go:334] "Generic (PLEG): container finished" podID="8cdee706-08c6-49d7-a7ca-7a96d66d078f" containerID="aeccfb853b8fe5c2e960a416503d671e9a494ea1be79bdc76eb093ba3cdc8e76" exitCode=2 Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.404181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8cdee706-08c6-49d7-a7ca-7a96d66d078f","Type":"ContainerDied","Data":"aeccfb853b8fe5c2e960a416503d671e9a494ea1be79bdc76eb093ba3cdc8e76"} Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.536693 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:03 crc kubenswrapper[4769]: I1121 13:08:03.682166 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:03 crc kubenswrapper[4769]: W1121 13:08:03.701281 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9154caf_2441_445e_98dc_5972db94dbed.slice/crio-4fff6b62dadbafc8bb19b2b7c203ad77ba5afaecbcbb9b32afadadd5a884dad5 WatchSource:0}: Error finding container 4fff6b62dadbafc8bb19b2b7c203ad77ba5afaecbcbb9b32afadadd5a884dad5: Status 404 returned error can't find the container with id 4fff6b62dadbafc8bb19b2b7c203ad77ba5afaecbcbb9b32afadadd5a884dad5 Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.015921 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.057409 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.118366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb4jq\" (UniqueName: \"kubernetes.io/projected/8cdee706-08c6-49d7-a7ca-7a96d66d078f-kube-api-access-wb4jq\") pod \"8cdee706-08c6-49d7-a7ca-7a96d66d078f\" (UID: \"8cdee706-08c6-49d7-a7ca-7a96d66d078f\") " Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.121839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdee706-08c6-49d7-a7ca-7a96d66d078f-kube-api-access-wb4jq" (OuterVolumeSpecName: "kube-api-access-wb4jq") pod "8cdee706-08c6-49d7-a7ca-7a96d66d078f" (UID: "8cdee706-08c6-49d7-a7ca-7a96d66d078f"). InnerVolumeSpecName "kube-api-access-wb4jq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.220720 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wb4jq\" (UniqueName: \"kubernetes.io/projected/8cdee706-08c6-49d7-a7ca-7a96d66d078f-kube-api-access-wb4jq\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.426528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"acd2a17a-d088-4084-959f-a544d6afdd27","Type":"ContainerStarted","Data":"210e0d3959d5140c42cd8363d8d63eabe37d4811326b0a18a53c0f41aaa0e2ad"} Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.435206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9154caf-2441-445e-98dc-5972db94dbed","Type":"ContainerStarted","Data":"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7"} Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.435259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9154caf-2441-445e-98dc-5972db94dbed","Type":"ContainerStarted","Data":"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727"} Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.435273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9154caf-2441-445e-98dc-5972db94dbed","Type":"ContainerStarted","Data":"4fff6b62dadbafc8bb19b2b7c203ad77ba5afaecbcbb9b32afadadd5a884dad5"} Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.437493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"8cdee706-08c6-49d7-a7ca-7a96d66d078f","Type":"ContainerDied","Data":"92c6c92d9b17fb25ad6c31542e98fee6bb486765695af983393b1963e29c582e"} Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.437536 4769 scope.go:117] "RemoveContainer" containerID="aeccfb853b8fe5c2e960a416503d671e9a494ea1be79bdc76eb093ba3cdc8e76" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.437676 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.499474 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.4994534010000002 podStartE2EDuration="2.499453401s" podCreationTimestamp="2025-11-21 13:08:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:04.488402023 +0000 UTC m=+4643.189063851" watchObservedRunningTime="2025-11-21 13:08:04.499453401 +0000 UTC m=+4643.200115219" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.510428 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.525394 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.537647 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:08:04 crc kubenswrapper[4769]: E1121 13:08:04.538320 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8cdee706-08c6-49d7-a7ca-7a96d66d078f" containerName="kube-state-metrics" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.538350 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdee706-08c6-49d7-a7ca-7a96d66d078f" containerName="kube-state-metrics" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.538662 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8cdee706-08c6-49d7-a7ca-7a96d66d078f" containerName="kube-state-metrics" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.539654 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.541364 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.541931 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.553645 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.732349 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqxh6\" (UniqueName: \"kubernetes.io/projected/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-api-access-qqxh6\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.732433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.732575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.732639 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.834648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qqxh6\" (UniqueName: \"kubernetes.io/projected/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-api-access-qqxh6\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.834700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.834790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.834853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.841343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.843573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.852108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqxh6\" (UniqueName: \"kubernetes.io/projected/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-api-access-qqxh6\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.854084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.928213 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.931844 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.932165 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-central-agent" containerID="cri-o://130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07" gracePeriod=30 Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.932996 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="proxy-httpd" containerID="cri-o://cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07" gracePeriod=30 Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.933061 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="sg-core" containerID="cri-o://0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676" gracePeriod=30 Nov 21 13:08:04 crc kubenswrapper[4769]: I1121 13:08:04.933108 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-notification-agent" containerID="cri-o://7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1" gracePeriod=30 Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.288666 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cdee706-08c6-49d7-a7ca-7a96d66d078f" path="/var/lib/kubelet/pods/8cdee706-08c6-49d7-a7ca-7a96d66d078f/volumes" Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.426780 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:08:05 crc kubenswrapper[4769]: W1121 13:08:05.429335 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf073b942_59a2_4273_bd2c_fa4039a573bf.slice/crio-163928c7a1b4b21bdec964a82866f83e001a0a14a162aa69a91629b9e6b722ca WatchSource:0}: Error finding container 163928c7a1b4b21bdec964a82866f83e001a0a14a162aa69a91629b9e6b722ca: Status 404 returned error can't find the container with id 163928c7a1b4b21bdec964a82866f83e001a0a14a162aa69a91629b9e6b722ca Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.446765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"acd2a17a-d088-4084-959f-a544d6afdd27","Type":"ContainerStarted","Data":"b58d9e16ddc919310b309f5a62591e237d4d0d0c0d54affe7d1cb916da4fbae3"} Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.466026 4769 generic.go:334] "Generic (PLEG): container finished" podID="a9947afc-b1ba-486e-be88-83ba66751c37" containerID="28079413175ac0c62eb6bfc85d57b17ecb0e9f64ba592241bcf0e867a7026fc7" exitCode=0 Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.466174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" event={"ID":"a9947afc-b1ba-486e-be88-83ba66751c37","Type":"ContainerDied","Data":"28079413175ac0c62eb6bfc85d57b17ecb0e9f64ba592241bcf0e867a7026fc7"} Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.474775 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerID="cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07" exitCode=0 Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.474810 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerID="0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676" exitCode=2 Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.474891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerDied","Data":"cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07"} Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.474919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerDied","Data":"0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676"} Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.477500 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.477480108 podStartE2EDuration="2.477480108s" podCreationTimestamp="2025-11-21 13:08:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:05.471639271 +0000 UTC m=+4644.172301089" watchObservedRunningTime="2025-11-21 13:08:05.477480108 +0000 UTC m=+4644.178141926" Nov 21 13:08:05 crc kubenswrapper[4769]: I1121 13:08:05.477683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f073b942-59a2-4273-bd2c-fa4039a573bf","Type":"ContainerStarted","Data":"163928c7a1b4b21bdec964a82866f83e001a0a14a162aa69a91629b9e6b722ca"} Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.488063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f073b942-59a2-4273-bd2c-fa4039a573bf","Type":"ContainerStarted","Data":"518ea2dd9cf4cfc354793ae836c42ce25b9409750594dec001c8a6f3eb456bf2"} Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.488529 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.491137 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerID="130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07" exitCode=0 Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.491269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerDied","Data":"130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07"} Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.505519 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.048527006 podStartE2EDuration="2.505499782s" podCreationTimestamp="2025-11-21 13:08:04 +0000 UTC" firstStartedPulling="2025-11-21 13:08:05.432005204 +0000 UTC m=+4644.132667022" lastFinishedPulling="2025-11-21 13:08:05.88897798 +0000 UTC m=+4644.589639798" observedRunningTime="2025-11-21 13:08:06.505497682 +0000 UTC m=+4645.206159520" watchObservedRunningTime="2025-11-21 13:08:06.505499782 +0000 UTC m=+4645.206161600" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.587039 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.588184 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.668567 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.711287 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.815705 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.973521 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-combined-ca-bundle\") pod \"a9947afc-b1ba-486e-be88-83ba66751c37\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.973647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-scripts\") pod \"a9947afc-b1ba-486e-be88-83ba66751c37\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.973711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvnsm\" (UniqueName: \"kubernetes.io/projected/a9947afc-b1ba-486e-be88-83ba66751c37-kube-api-access-wvnsm\") pod \"a9947afc-b1ba-486e-be88-83ba66751c37\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.973728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-config-data\") pod \"a9947afc-b1ba-486e-be88-83ba66751c37\" (UID: \"a9947afc-b1ba-486e-be88-83ba66751c37\") " Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.979816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-scripts" (OuterVolumeSpecName: "scripts") pod "a9947afc-b1ba-486e-be88-83ba66751c37" (UID: "a9947afc-b1ba-486e-be88-83ba66751c37"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:06 crc kubenswrapper[4769]: I1121 13:08:06.989498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9947afc-b1ba-486e-be88-83ba66751c37-kube-api-access-wvnsm" (OuterVolumeSpecName: "kube-api-access-wvnsm") pod "a9947afc-b1ba-486e-be88-83ba66751c37" (UID: "a9947afc-b1ba-486e-be88-83ba66751c37"). InnerVolumeSpecName "kube-api-access-wvnsm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.007951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-config-data" (OuterVolumeSpecName: "config-data") pod "a9947afc-b1ba-486e-be88-83ba66751c37" (UID: "a9947afc-b1ba-486e-be88-83ba66751c37"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.010501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a9947afc-b1ba-486e-be88-83ba66751c37" (UID: "a9947afc-b1ba-486e-be88-83ba66751c37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.075539 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.075567 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.075578 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wvnsm\" (UniqueName: \"kubernetes.io/projected/a9947afc-b1ba-486e-be88-83ba66751c37-kube-api-access-wvnsm\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.075588 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a9947afc-b1ba-486e-be88-83ba66751c37-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.502107 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.502554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw" event={"ID":"a9947afc-b1ba-486e-be88-83ba66751c37","Type":"ContainerDied","Data":"68498204ee4dd4d70c1ccec0918db4576ef3e0ae7c56967917201a9d63812d9a"} Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.502572 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68498204ee4dd4d70c1ccec0918db4576ef3e0ae7c56967917201a9d63812d9a" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.544400 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.672535 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.672999 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.93:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.673070 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.93:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.693773 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.694032 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-log" containerID="cri-o://3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727" gracePeriod=30 Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.694096 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-metadata" containerID="cri-o://6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7" gracePeriod=30 Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.779159 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:07 crc kubenswrapper[4769]: I1121 13:08:07.779230 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.041528 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.300963 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.397682 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-nova-metadata-tls-certs\") pod \"d9154caf-2441-445e-98dc-5972db94dbed\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.398034 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-config-data\") pod \"d9154caf-2441-445e-98dc-5972db94dbed\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.398079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9154caf-2441-445e-98dc-5972db94dbed-logs\") pod \"d9154caf-2441-445e-98dc-5972db94dbed\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.398180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-combined-ca-bundle\") pod \"d9154caf-2441-445e-98dc-5972db94dbed\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.398333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9fpx\" (UniqueName: \"kubernetes.io/projected/d9154caf-2441-445e-98dc-5972db94dbed-kube-api-access-h9fpx\") pod \"d9154caf-2441-445e-98dc-5972db94dbed\" (UID: \"d9154caf-2441-445e-98dc-5972db94dbed\") " Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.400236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9154caf-2441-445e-98dc-5972db94dbed-logs" (OuterVolumeSpecName: "logs") pod "d9154caf-2441-445e-98dc-5972db94dbed" (UID: "d9154caf-2441-445e-98dc-5972db94dbed"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.405430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9154caf-2441-445e-98dc-5972db94dbed-kube-api-access-h9fpx" (OuterVolumeSpecName: "kube-api-access-h9fpx") pod "d9154caf-2441-445e-98dc-5972db94dbed" (UID: "d9154caf-2441-445e-98dc-5972db94dbed"). InnerVolumeSpecName "kube-api-access-h9fpx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.436282 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-config-data" (OuterVolumeSpecName: "config-data") pod "d9154caf-2441-445e-98dc-5972db94dbed" (UID: "d9154caf-2441-445e-98dc-5972db94dbed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.440750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d9154caf-2441-445e-98dc-5972db94dbed" (UID: "d9154caf-2441-445e-98dc-5972db94dbed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.462941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "d9154caf-2441-445e-98dc-5972db94dbed" (UID: "d9154caf-2441-445e-98dc-5972db94dbed"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.500132 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d9154caf-2441-445e-98dc-5972db94dbed-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.500163 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.500198 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h9fpx\" (UniqueName: \"kubernetes.io/projected/d9154caf-2441-445e-98dc-5972db94dbed-kube-api-access-h9fpx\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.500207 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.500215 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d9154caf-2441-445e-98dc-5972db94dbed-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510757 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9154caf-2441-445e-98dc-5972db94dbed" containerID="6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7" exitCode=0 Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510800 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9154caf-2441-445e-98dc-5972db94dbed" containerID="3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727" exitCode=143 Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510876 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9154caf-2441-445e-98dc-5972db94dbed","Type":"ContainerDied","Data":"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7"} Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9154caf-2441-445e-98dc-5972db94dbed","Type":"ContainerDied","Data":"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727"} Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d9154caf-2441-445e-98dc-5972db94dbed","Type":"ContainerDied","Data":"4fff6b62dadbafc8bb19b2b7c203ad77ba5afaecbcbb9b32afadadd5a884dad5"} Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.510979 4769 scope.go:117] "RemoveContainer" containerID="6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.511007 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-log" containerID="cri-o://6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7" gracePeriod=30 Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.511744 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-api" containerID="cri-o://69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7" gracePeriod=30 Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.536827 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.545771 4769 scope.go:117] "RemoveContainer" containerID="3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.568256 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.569361 4769 scope.go:117] "RemoveContainer" containerID="6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7" Nov 21 13:08:08 crc kubenswrapper[4769]: E1121 13:08:08.570581 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7\": container with ID starting with 6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7 not found: ID does not exist" containerID="6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.570742 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7"} err="failed to get container status \"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7\": rpc error: code = NotFound desc = could not find container \"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7\": container with ID starting with 6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7 not found: ID does not exist" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.570848 4769 scope.go:117] "RemoveContainer" containerID="3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727" Nov 21 13:08:08 crc kubenswrapper[4769]: E1121 13:08:08.571281 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727\": container with ID starting with 3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727 not found: ID does not exist" containerID="3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.571311 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727"} err="failed to get container status \"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727\": rpc error: code = NotFound desc = could not find container \"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727\": container with ID starting with 3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727 not found: ID does not exist" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.571335 4769 scope.go:117] "RemoveContainer" containerID="6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.571821 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7"} err="failed to get container status \"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7\": rpc error: code = NotFound desc = could not find container \"6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7\": container with ID starting with 6e59cc8a27af1f2e6b99633aed966688427dd9e787a75b24123eccf150f0edf7 not found: ID does not exist" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.571919 4769 scope.go:117] "RemoveContainer" containerID="3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.572254 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727"} err="failed to get container status \"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727\": rpc error: code = NotFound desc = could not find container \"3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727\": container with ID starting with 3163ec3edb490088ac1ddc9e4ec6a697523b1d49f2f5902ac0c92c4a59f04727 not found: ID does not exist" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.573079 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.591420 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:08 crc kubenswrapper[4769]: E1121 13:08:08.592096 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-metadata" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.592201 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-metadata" Nov 21 13:08:08 crc kubenswrapper[4769]: E1121 13:08:08.592282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-log" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.592335 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-log" Nov 21 13:08:08 crc kubenswrapper[4769]: E1121 13:08:08.592420 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a9947afc-b1ba-486e-be88-83ba66751c37" containerName="nova-manage" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.592474 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9947afc-b1ba-486e-be88-83ba66751c37" containerName="nova-manage" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.592707 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-log" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.592784 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9154caf-2441-445e-98dc-5972db94dbed" containerName="nova-metadata-metadata" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.592843 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a9947afc-b1ba-486e-be88-83ba66751c37" containerName="nova-manage" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.593905 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.596231 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.608037 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.614566 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.746730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.746857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e36181d2-406e-4430-b684-292a2731d286-logs\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.746881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.746928 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mztg9\" (UniqueName: \"kubernetes.io/projected/e36181d2-406e-4430-b684-292a2731d286-kube-api-access-mztg9\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.746945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-config-data\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.848334 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-config-data\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.848376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mztg9\" (UniqueName: \"kubernetes.io/projected/e36181d2-406e-4430-b684-292a2731d286-kube-api-access-mztg9\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.848475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.848530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e36181d2-406e-4430-b684-292a2731d286-logs\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.848545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.849268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e36181d2-406e-4430-b684-292a2731d286-logs\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.852147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-config-data\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.852174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.854149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.892757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mztg9\" (UniqueName: \"kubernetes.io/projected/e36181d2-406e-4430-b684-292a2731d286-kube-api-access-mztg9\") pod \"nova-metadata-0\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:08 crc kubenswrapper[4769]: I1121 13:08:08.918643 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:09 crc kubenswrapper[4769]: I1121 13:08:09.274433 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:08:09 crc kubenswrapper[4769]: E1121 13:08:09.275008 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:08:09 crc kubenswrapper[4769]: I1121 13:08:09.288876 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9154caf-2441-445e-98dc-5972db94dbed" path="/var/lib/kubelet/pods/d9154caf-2441-445e-98dc-5972db94dbed/volumes" Nov 21 13:08:09 crc kubenswrapper[4769]: W1121 13:08:09.515293 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode36181d2_406e_4430_b684_292a2731d286.slice/crio-cc97bd64d4e6a252e6c70d797a88bb026131e36a85e2562b8ebc70dd2a669b7b WatchSource:0}: Error finding container cc97bd64d4e6a252e6c70d797a88bb026131e36a85e2562b8ebc70dd2a669b7b: Status 404 returned error can't find the container with id cc97bd64d4e6a252e6c70d797a88bb026131e36a85e2562b8ebc70dd2a669b7b Nov 21 13:08:09 crc kubenswrapper[4769]: I1121 13:08:09.516471 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:09 crc kubenswrapper[4769]: I1121 13:08:09.522508 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerID="6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7" exitCode=143 Nov 21 13:08:09 crc kubenswrapper[4769]: I1121 13:08:09.522590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ce38955c-5fa8-4c19-9b5c-aa90e080bd78","Type":"ContainerDied","Data":"6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7"} Nov 21 13:08:09 crc kubenswrapper[4769]: I1121 13:08:09.523789 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" containerName="nova-scheduler-scheduler" containerID="cri-o://f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa" gracePeriod=30 Nov 21 13:08:10 crc kubenswrapper[4769]: I1121 13:08:10.534627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e36181d2-406e-4430-b684-292a2731d286","Type":"ContainerStarted","Data":"e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d"} Nov 21 13:08:10 crc kubenswrapper[4769]: I1121 13:08:10.534938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e36181d2-406e-4430-b684-292a2731d286","Type":"ContainerStarted","Data":"07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00"} Nov 21 13:08:10 crc kubenswrapper[4769]: I1121 13:08:10.534949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e36181d2-406e-4430-b684-292a2731d286","Type":"ContainerStarted","Data":"cc97bd64d4e6a252e6c70d797a88bb026131e36a85e2562b8ebc70dd2a669b7b"} Nov 21 13:08:10 crc kubenswrapper[4769]: I1121 13:08:10.549952 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.549935015 podStartE2EDuration="2.549935015s" podCreationTimestamp="2025-11-21 13:08:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:10.548329082 +0000 UTC m=+4649.248990900" watchObservedRunningTime="2025-11-21 13:08:10.549935015 +0000 UTC m=+4649.250596833" Nov 21 13:08:11 crc kubenswrapper[4769]: E1121 13:08:11.671720 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:08:11 crc kubenswrapper[4769]: E1121 13:08:11.674110 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:08:11 crc kubenswrapper[4769]: E1121 13:08:11.675591 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:08:11 crc kubenswrapper[4769]: E1121 13:08:11.675650 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" containerName="nova-scheduler-scheduler" Nov 21 13:08:12 crc kubenswrapper[4769]: I1121 13:08:12.558067 4769 generic.go:334] "Generic (PLEG): container finished" podID="d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" containerID="ecd3726cfa81aff917bd5bdc8db544db6efd4ab7aac38f9e297d3563609e64ee" exitCode=0 Nov 21 13:08:12 crc kubenswrapper[4769]: I1121 13:08:12.558114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" event={"ID":"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81","Type":"ContainerDied","Data":"ecd3726cfa81aff917bd5bdc8db544db6efd4ab7aac38f9e297d3563609e64ee"} Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.347094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.435580 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8c9f\" (UniqueName: \"kubernetes.io/projected/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-kube-api-access-x8c9f\") pod \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.435785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-logs\") pod \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.435834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-config-data\") pod \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.435920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-combined-ca-bundle\") pod \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\" (UID: \"ce38955c-5fa8-4c19-9b5c-aa90e080bd78\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.436525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-logs" (OuterVolumeSpecName: "logs") pod "ce38955c-5fa8-4c19-9b5c-aa90e080bd78" (UID: "ce38955c-5fa8-4c19-9b5c-aa90e080bd78"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.437031 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.441138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-kube-api-access-x8c9f" (OuterVolumeSpecName: "kube-api-access-x8c9f") pod "ce38955c-5fa8-4c19-9b5c-aa90e080bd78" (UID: "ce38955c-5fa8-4c19-9b5c-aa90e080bd78"). InnerVolumeSpecName "kube-api-access-x8c9f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.469957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-config-data" (OuterVolumeSpecName: "config-data") pod "ce38955c-5fa8-4c19-9b5c-aa90e080bd78" (UID: "ce38955c-5fa8-4c19-9b5c-aa90e080bd78"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.486457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ce38955c-5fa8-4c19-9b5c-aa90e080bd78" (UID: "ce38955c-5fa8-4c19-9b5c-aa90e080bd78"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.536907 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.538253 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x8c9f\" (UniqueName: \"kubernetes.io/projected/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-kube-api-access-x8c9f\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.538300 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.538312 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce38955c-5fa8-4c19-9b5c-aa90e080bd78-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.552503 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.555393 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.574609 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerID="7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1" exitCode=0 Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.574687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerDied","Data":"7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1"} Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.574704 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.574720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1","Type":"ContainerDied","Data":"e547908dbdfab4f17c2a5b0e8815a93f5840e0e20f3de064e6e07947d8c3a0f1"} Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.574744 4769 scope.go:117] "RemoveContainer" containerID="cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.579399 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerID="69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7" exitCode=0 Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.579458 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.579508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ce38955c-5fa8-4c19-9b5c-aa90e080bd78","Type":"ContainerDied","Data":"69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7"} Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.579533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ce38955c-5fa8-4c19-9b5c-aa90e080bd78","Type":"ContainerDied","Data":"ebe7eb9d14b551663a62a461b8942a26b54a56e4b096bb36d4d33f2cdbbf0a4a"} Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.607972 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.617577 4769 scope.go:117] "RemoveContainer" containerID="0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.638921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-scripts\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-run-httpd\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86rtj\" (UniqueName: \"kubernetes.io/projected/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-kube-api-access-86rtj\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-config-data\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-log-httpd\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-combined-ca-bundle\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-sg-core-conf-yaml\") pod \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\" (UID: \"8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1\") " Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.639911 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.640254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.640783 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.640806 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.646225 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-kube-api-access-86rtj" (OuterVolumeSpecName: "kube-api-access-86rtj") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "kube-api-access-86rtj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.649620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-scripts" (OuterVolumeSpecName: "scripts") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.663858 4769 scope.go:117] "RemoveContainer" containerID="7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.664593 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.684853 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.695341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711166 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.711631 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="proxy-httpd" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711649 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="proxy-httpd" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.711670 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-api" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711677 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-api" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.711699 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="sg-core" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711705 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="sg-core" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.711732 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-notification-agent" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711741 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-notification-agent" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.711765 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-central-agent" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711771 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-central-agent" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.711785 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-log" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711791 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-log" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711952 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="sg-core" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711963 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-notification-agent" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711977 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="proxy-httpd" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.711990 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-log" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.712002 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" containerName="nova-api-api" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.712013 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" containerName="ceilometer-central-agent" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.713258 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.723009 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.727695 4769 scope.go:117] "RemoveContainer" containerID="130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.737591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.742303 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.742334 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-86rtj\" (UniqueName: \"kubernetes.io/projected/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-kube-api-access-86rtj\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.742346 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.767856 4769 scope.go:117] "RemoveContainer" containerID="cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.768658 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07\": container with ID starting with cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07 not found: ID does not exist" containerID="cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.768694 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07"} err="failed to get container status \"cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07\": rpc error: code = NotFound desc = could not find container \"cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07\": container with ID starting with cb941b569343d4d4b2a2abdca09c6cbb45633df2fb6e14bf30e3fbe4d4bccc07 not found: ID does not exist" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.768722 4769 scope.go:117] "RemoveContainer" containerID="0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.768957 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676\": container with ID starting with 0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676 not found: ID does not exist" containerID="0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.768979 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676"} err="failed to get container status \"0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676\": rpc error: code = NotFound desc = could not find container \"0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676\": container with ID starting with 0c82972dcaab6be929f1935684868b2e9addd99a97d0f0443a7f6f947abf8676 not found: ID does not exist" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.768992 4769 scope.go:117] "RemoveContainer" containerID="7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.769192 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1\": container with ID starting with 7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1 not found: ID does not exist" containerID="7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.769227 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1"} err="failed to get container status \"7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1\": rpc error: code = NotFound desc = could not find container \"7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1\": container with ID starting with 7a715cc122dd2784d9168cda564efe592bd8a11ddd7240201f2f5a2f9e7605a1 not found: ID does not exist" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.769241 4769 scope.go:117] "RemoveContainer" containerID="130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.769467 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07\": container with ID starting with 130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07 not found: ID does not exist" containerID="130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.769496 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07"} err="failed to get container status \"130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07\": rpc error: code = NotFound desc = could not find container \"130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07\": container with ID starting with 130a2745b7c420dc2286a0c2cb81b2cdf3dc4e27ce93534f9149e31273c55c07 not found: ID does not exist" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.769510 4769 scope.go:117] "RemoveContainer" containerID="69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.792794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.796742 4769 scope.go:117] "RemoveContainer" containerID="6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.819299 4769 scope.go:117] "RemoveContainer" containerID="69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.820028 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7\": container with ID starting with 69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7 not found: ID does not exist" containerID="69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.820063 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7"} err="failed to get container status \"69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7\": rpc error: code = NotFound desc = could not find container \"69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7\": container with ID starting with 69490a54f78acf5f1a2c619043bb2af8263fc3afeb57a16379c31d44026b18f7 not found: ID does not exist" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.820091 4769 scope.go:117] "RemoveContainer" containerID="6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.820612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-config-data" (OuterVolumeSpecName: "config-data") pod "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" (UID: "8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:13 crc kubenswrapper[4769]: E1121 13:08:13.820660 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7\": container with ID starting with 6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7 not found: ID does not exist" containerID="6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.820693 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7"} err="failed to get container status \"6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7\": rpc error: code = NotFound desc = could not find container \"6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7\": container with ID starting with 6aebd861d86365a03ff56f3d024883bdf200967f9d6b306961bfc02d7b1b43c7 not found: ID does not exist" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.847699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70583dd1-815a-40d2-ab1b-e8c454a238e3-logs\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.847790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9gh\" (UniqueName: \"kubernetes.io/projected/70583dd1-815a-40d2-ab1b-e8c454a238e3-kube-api-access-nc9gh\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.847912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-config-data\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.848037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.848170 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.848224 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.921548 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.922528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.932870 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.950217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.950293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70583dd1-815a-40d2-ab1b-e8c454a238e3-logs\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.950330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9gh\" (UniqueName: \"kubernetes.io/projected/70583dd1-815a-40d2-ab1b-e8c454a238e3-kube-api-access-nc9gh\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.950400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-config-data\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.950902 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.951175 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70583dd1-815a-40d2-ab1b-e8c454a238e3-logs\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.954559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.957300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-config-data\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.972970 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.974368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9gh\" (UniqueName: \"kubernetes.io/projected/70583dd1-815a-40d2-ab1b-e8c454a238e3-kube-api-access-nc9gh\") pod \"nova-api-0\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.976693 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.979094 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.979365 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.979427 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:08:13 crc kubenswrapper[4769]: I1121 13:08:13.989869 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.047150 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.047749 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.051579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.051970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-config-data\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.052063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tg7b\" (UniqueName: \"kubernetes.io/projected/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-kube-api-access-7tg7b\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.052271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-scripts\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.052323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.052355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-run-httpd\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.052451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-log-httpd\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.052491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.153475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-config-data\") pod \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.153539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-combined-ca-bundle\") pod \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.153608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-scripts\") pod \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.153630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw95p\" (UniqueName: \"kubernetes.io/projected/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-kube-api-access-jw95p\") pod \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\" (UID: \"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.154110 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.154167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-config-data\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.154286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7tg7b\" (UniqueName: \"kubernetes.io/projected/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-kube-api-access-7tg7b\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.154352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-scripts\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.156654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.156760 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-run-httpd\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.157762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-log-httpd\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.158147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-run-httpd\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.159098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-config-data\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.161524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.161987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-scripts\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.168496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.167879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-log-httpd\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.172980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.179889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.179930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tg7b\" (UniqueName: \"kubernetes.io/projected/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-kube-api-access-7tg7b\") pod \"ceilometer-0\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.207872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-scripts" (OuterVolumeSpecName: "scripts") pod "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" (UID: "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.208936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-kube-api-access-jw95p" (OuterVolumeSpecName: "kube-api-access-jw95p") pod "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" (UID: "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81"). InnerVolumeSpecName "kube-api-access-jw95p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.213587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-config-data" (OuterVolumeSpecName: "config-data") pod "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" (UID: "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.213740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.233480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" (UID: "d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.270340 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.270675 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jw95p\" (UniqueName: \"kubernetes.io/projected/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-kube-api-access-jw95p\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.270700 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.270712 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:14 crc kubenswrapper[4769]: W1121 13:08:14.591136 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70583dd1_815a_40d2_ab1b_e8c454a238e3.slice/crio-9a58debca31c6a424602413718a721ce6d957468208557564c8245e6d6b4a584 WatchSource:0}: Error finding container 9a58debca31c6a424602413718a721ce6d957468208557564c8245e6d6b4a584: Status 404 returned error can't find the container with id 9a58debca31c6a424602413718a721ce6d957468208557564c8245e6d6b4a584 Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.592839 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.606676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" event={"ID":"d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81","Type":"ContainerDied","Data":"1124725da4c487256fd81e0bdd11804855415939b01dd9baeaed21424462eeda"} Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.606716 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1124725da4c487256fd81e0bdd11804855415939b01dd9baeaed21424462eeda" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.606781 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.610841 4769 generic.go:334] "Generic (PLEG): container finished" podID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" containerID="f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa" exitCode=0 Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.612210 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9fc14456-7677-4380-85ac-5c1ef5ba37a0","Type":"ContainerDied","Data":"f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa"} Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.661572 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:08:14 crc kubenswrapper[4769]: E1121 13:08:14.662587 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" containerName="nova-cell1-conductor-db-sync" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.662703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" containerName="nova-cell1-conductor-db-sync" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.663110 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" containerName="nova-cell1-conductor-db-sync" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.667790 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.671674 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.702890 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.743559 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.789812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.789996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qtv\" (UniqueName: \"kubernetes.io/projected/627e86c1-37a7-4d28-8b5e-022989d3febf-kube-api-access-t9qtv\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.790071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.859951 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.891952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.892046 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qtv\" (UniqueName: \"kubernetes.io/projected/627e86c1-37a7-4d28-8b5e-022989d3febf-kube-api-access-t9qtv\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.892075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.898965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.899971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.910817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qtv\" (UniqueName: \"kubernetes.io/projected/627e86c1-37a7-4d28-8b5e-022989d3febf-kube-api-access-t9qtv\") pod \"nova-cell1-conductor-0\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.938669 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.992973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m99sj\" (UniqueName: \"kubernetes.io/projected/9fc14456-7677-4380-85ac-5c1ef5ba37a0-kube-api-access-m99sj\") pod \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.993329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-combined-ca-bundle\") pod \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.993426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-config-data\") pod \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\" (UID: \"9fc14456-7677-4380-85ac-5c1ef5ba37a0\") " Nov 21 13:08:14 crc kubenswrapper[4769]: I1121 13:08:14.996331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc14456-7677-4380-85ac-5c1ef5ba37a0-kube-api-access-m99sj" (OuterVolumeSpecName: "kube-api-access-m99sj") pod "9fc14456-7677-4380-85ac-5c1ef5ba37a0" (UID: "9fc14456-7677-4380-85ac-5c1ef5ba37a0"). InnerVolumeSpecName "kube-api-access-m99sj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.013953 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.025393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9fc14456-7677-4380-85ac-5c1ef5ba37a0" (UID: "9fc14456-7677-4380-85ac-5c1ef5ba37a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.031406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-config-data" (OuterVolumeSpecName: "config-data") pod "9fc14456-7677-4380-85ac-5c1ef5ba37a0" (UID: "9fc14456-7677-4380-85ac-5c1ef5ba37a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.098427 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m99sj\" (UniqueName: \"kubernetes.io/projected/9fc14456-7677-4380-85ac-5c1ef5ba37a0-kube-api-access-m99sj\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.098450 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.098462 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fc14456-7677-4380-85ac-5c1ef5ba37a0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.289023 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1" path="/var/lib/kubelet/pods/8d0edd87-3aa8-4e6e-9d17-50f4ebe509e1/volumes" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.290776 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce38955c-5fa8-4c19-9b5c-aa90e080bd78" path="/var/lib/kubelet/pods/ce38955c-5fa8-4c19-9b5c-aa90e080bd78/volumes" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.523989 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.624011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"627e86c1-37a7-4d28-8b5e-022989d3febf","Type":"ContainerStarted","Data":"1e1960a885dfbe9e3e827998b8251ea5db103763d05eec5815956f321adaad08"} Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.625507 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerStarted","Data":"353fd6e479e090406081012bdd03f614dfc498669a796ac259546651a0e54d71"} Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.628527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9fc14456-7677-4380-85ac-5c1ef5ba37a0","Type":"ContainerDied","Data":"205b07734e36f0678379a3f575c4ef724405e356c5112b60096603c9c5f1e54d"} Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.628545 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.628570 4769 scope.go:117] "RemoveContainer" containerID="f8e0d7534339d8ca90b5b6c8350e5601cf932ff1e70be39dcd78bbb2dc7186aa" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.631318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70583dd1-815a-40d2-ab1b-e8c454a238e3","Type":"ContainerStarted","Data":"aca567cc9252a4f2719ea1a244640ab40582cfe6f79a67b0801220d8be403ae1"} Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.631425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70583dd1-815a-40d2-ab1b-e8c454a238e3","Type":"ContainerStarted","Data":"6627a3495abaad9f07ed657025985bd62fc736bcd5756fa5a7c9758cf64d8caa"} Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.631442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70583dd1-815a-40d2-ab1b-e8c454a238e3","Type":"ContainerStarted","Data":"9a58debca31c6a424602413718a721ce6d957468208557564c8245e6d6b4a584"} Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.664831 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.664810133 podStartE2EDuration="2.664810133s" podCreationTimestamp="2025-11-21 13:08:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:15.648638508 +0000 UTC m=+4654.349300326" watchObservedRunningTime="2025-11-21 13:08:15.664810133 +0000 UTC m=+4654.365471951" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.680042 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.693627 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.703835 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:15 crc kubenswrapper[4769]: E1121 13:08:15.704293 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" containerName="nova-scheduler-scheduler" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.704305 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" containerName="nova-scheduler-scheduler" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.704508 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" containerName="nova-scheduler-scheduler" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.705138 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.711316 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.712572 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.813498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-config-data\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.813679 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.813735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r989\" (UniqueName: \"kubernetes.io/projected/8bd9786a-17b8-49f4-8036-147394bab405-kube-api-access-2r989\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.915474 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.915775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2r989\" (UniqueName: \"kubernetes.io/projected/8bd9786a-17b8-49f4-8036-147394bab405-kube-api-access-2r989\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.915906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-config-data\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.920126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.920408 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-config-data\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:15 crc kubenswrapper[4769]: I1121 13:08:15.940899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r989\" (UniqueName: \"kubernetes.io/projected/8bd9786a-17b8-49f4-8036-147394bab405-kube-api-access-2r989\") pod \"nova-scheduler-0\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:16 crc kubenswrapper[4769]: I1121 13:08:16.041830 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:16 crc kubenswrapper[4769]: I1121 13:08:16.530126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:16 crc kubenswrapper[4769]: I1121 13:08:16.646689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"627e86c1-37a7-4d28-8b5e-022989d3febf","Type":"ContainerStarted","Data":"d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83"} Nov 21 13:08:16 crc kubenswrapper[4769]: I1121 13:08:16.646760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:16 crc kubenswrapper[4769]: I1121 13:08:16.668933 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.668915853 podStartE2EDuration="2.668915853s" podCreationTimestamp="2025-11-21 13:08:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:16.661243336 +0000 UTC m=+4655.361905174" watchObservedRunningTime="2025-11-21 13:08:16.668915853 +0000 UTC m=+4655.369577671" Nov 21 13:08:16 crc kubenswrapper[4769]: W1121 13:08:16.783284 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bd9786a_17b8_49f4_8036_147394bab405.slice/crio-f889ed60ed7144c901a6fca9b6bd3969356da56a5e658aed534004422066c834 WatchSource:0}: Error finding container f889ed60ed7144c901a6fca9b6bd3969356da56a5e658aed534004422066c834: Status 404 returned error can't find the container with id f889ed60ed7144c901a6fca9b6bd3969356da56a5e658aed534004422066c834 Nov 21 13:08:17 crc kubenswrapper[4769]: I1121 13:08:17.287586 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc14456-7677-4380-85ac-5c1ef5ba37a0" path="/var/lib/kubelet/pods/9fc14456-7677-4380-85ac-5c1ef5ba37a0/volumes" Nov 21 13:08:17 crc kubenswrapper[4769]: I1121 13:08:17.667126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerStarted","Data":"31d2dafe0b4ee331e4ebe610d68369ecf5beecd9111b6b4339acc5ffa361a49c"} Nov 21 13:08:17 crc kubenswrapper[4769]: I1121 13:08:17.672381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8bd9786a-17b8-49f4-8036-147394bab405","Type":"ContainerStarted","Data":"2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27"} Nov 21 13:08:17 crc kubenswrapper[4769]: I1121 13:08:17.672433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8bd9786a-17b8-49f4-8036-147394bab405","Type":"ContainerStarted","Data":"f889ed60ed7144c901a6fca9b6bd3969356da56a5e658aed534004422066c834"} Nov 21 13:08:17 crc kubenswrapper[4769]: I1121 13:08:17.704743 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.704718096 podStartE2EDuration="2.704718096s" podCreationTimestamp="2025-11-21 13:08:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:17.687670177 +0000 UTC m=+4656.388331995" watchObservedRunningTime="2025-11-21 13:08:17.704718096 +0000 UTC m=+4656.405379914" Nov 21 13:08:18 crc kubenswrapper[4769]: I1121 13:08:18.919260 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:18 crc kubenswrapper[4769]: I1121 13:08:18.919639 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:19 crc kubenswrapper[4769]: I1121 13:08:19.931454 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.101:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:19 crc kubenswrapper[4769]: I1121 13:08:19.931488 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.101:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.050097 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.523955 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp"] Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.526230 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.528022 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.533538 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.549710 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp"] Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.612918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-scripts\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.613017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-config-data\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.613041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.613141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvrfx\" (UniqueName: \"kubernetes.io/projected/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-kube-api-access-bvrfx\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.709719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerStarted","Data":"581596f34f2364d8e8795909393a4caf2ffcc599d1a4465167646c1581f36d30"} Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.714697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-scripts\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.714817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-config-data\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.714856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.714942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bvrfx\" (UniqueName: \"kubernetes.io/projected/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-kube-api-access-bvrfx\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.728336 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-config-data\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.730718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-scripts\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.730746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvrfx\" (UniqueName: \"kubernetes.io/projected/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-kube-api-access-bvrfx\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.733288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-8jfdp\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:20 crc kubenswrapper[4769]: I1121 13:08:20.860569 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:21 crc kubenswrapper[4769]: I1121 13:08:21.046777 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:21 crc kubenswrapper[4769]: I1121 13:08:21.274095 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:08:21 crc kubenswrapper[4769]: E1121 13:08:21.274415 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:08:21 crc kubenswrapper[4769]: I1121 13:08:21.342156 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp"] Nov 21 13:08:21 crc kubenswrapper[4769]: I1121 13:08:21.724014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" event={"ID":"9f5ee83a-68a6-403a-ba3b-9a0ec176f548","Type":"ContainerStarted","Data":"c49f996cd8f2b925b8e088db038ea2872831d0a5e43b00e93307e83f9cbd863f"} Nov 21 13:08:22 crc kubenswrapper[4769]: I1121 13:08:22.739098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerStarted","Data":"c1ebd8d5cb1d72b5a8e7ec9fe5b6677cd103675c4d27911480bbb805a6fb5662"} Nov 21 13:08:22 crc kubenswrapper[4769]: I1121 13:08:22.741714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" event={"ID":"9f5ee83a-68a6-403a-ba3b-9a0ec176f548","Type":"ContainerStarted","Data":"b1acd400de4f042bd8f6d4420cd2ff0208eea01c5a3248ff7d3e9502b75f56f8"} Nov 21 13:08:23 crc kubenswrapper[4769]: I1121 13:08:23.312473 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" podStartSLOduration=3.312448486 podStartE2EDuration="3.312448486s" podCreationTimestamp="2025-11-21 13:08:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:22.760164444 +0000 UTC m=+4661.460826262" watchObservedRunningTime="2025-11-21 13:08:23.312448486 +0000 UTC m=+4662.013110314" Nov 21 13:08:24 crc kubenswrapper[4769]: I1121 13:08:24.048823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:24 crc kubenswrapper[4769]: I1121 13:08:24.048905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:24 crc kubenswrapper[4769]: I1121 13:08:24.763556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerStarted","Data":"60577edb23c797bef02378f147bfee1bac701e4d7b6410bca737c4b9035362a9"} Nov 21 13:08:24 crc kubenswrapper[4769]: I1121 13:08:24.763977 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:24 crc kubenswrapper[4769]: I1121 13:08:24.786581 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.191605481 podStartE2EDuration="11.786562653s" podCreationTimestamp="2025-11-21 13:08:13 +0000 UTC" firstStartedPulling="2025-11-21 13:08:14.74891737 +0000 UTC m=+4653.449579188" lastFinishedPulling="2025-11-21 13:08:24.343874532 +0000 UTC m=+4663.044536360" observedRunningTime="2025-11-21 13:08:24.78234757 +0000 UTC m=+4663.483009418" watchObservedRunningTime="2025-11-21 13:08:24.786562653 +0000 UTC m=+4663.487224471" Nov 21 13:08:25 crc kubenswrapper[4769]: I1121 13:08:25.131368 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.102:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:25 crc kubenswrapper[4769]: I1121 13:08:25.131401 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.102:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:26 crc kubenswrapper[4769]: I1121 13:08:26.042205 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:26 crc kubenswrapper[4769]: I1121 13:08:26.092974 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:26 crc kubenswrapper[4769]: I1121 13:08:26.837216 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:27 crc kubenswrapper[4769]: I1121 13:08:27.823207 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f5ee83a-68a6-403a-ba3b-9a0ec176f548" containerID="b1acd400de4f042bd8f6d4420cd2ff0208eea01c5a3248ff7d3e9502b75f56f8" exitCode=0 Nov 21 13:08:27 crc kubenswrapper[4769]: I1121 13:08:27.823256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" event={"ID":"9f5ee83a-68a6-403a-ba3b-9a0ec176f548","Type":"ContainerDied","Data":"b1acd400de4f042bd8f6d4420cd2ff0208eea01c5a3248ff7d3e9502b75f56f8"} Nov 21 13:08:28 crc kubenswrapper[4769]: I1121 13:08:28.928814 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:28 crc kubenswrapper[4769]: I1121 13:08:28.935421 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:28 crc kubenswrapper[4769]: I1121 13:08:28.937873 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.702387 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.833445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-combined-ca-bundle\") pod \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.833515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-config-data\") pod \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.833561 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvrfx\" (UniqueName: \"kubernetes.io/projected/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-kube-api-access-bvrfx\") pod \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.833631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-scripts\") pod \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\" (UID: \"9f5ee83a-68a6-403a-ba3b-9a0ec176f548\") " Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.841183 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-kube-api-access-bvrfx" (OuterVolumeSpecName: "kube-api-access-bvrfx") pod "9f5ee83a-68a6-403a-ba3b-9a0ec176f548" (UID: "9f5ee83a-68a6-403a-ba3b-9a0ec176f548"). InnerVolumeSpecName "kube-api-access-bvrfx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.841940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-scripts" (OuterVolumeSpecName: "scripts") pod "9f5ee83a-68a6-403a-ba3b-9a0ec176f548" (UID: "9f5ee83a-68a6-403a-ba3b-9a0ec176f548"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.882058 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.882124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp" event={"ID":"9f5ee83a-68a6-403a-ba3b-9a0ec176f548","Type":"ContainerDied","Data":"c49f996cd8f2b925b8e088db038ea2872831d0a5e43b00e93307e83f9cbd863f"} Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.882169 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c49f996cd8f2b925b8e088db038ea2872831d0a5e43b00e93307e83f9cbd863f" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.904672 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.906251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-config-data" (OuterVolumeSpecName: "config-data") pod "9f5ee83a-68a6-403a-ba3b-9a0ec176f548" (UID: "9f5ee83a-68a6-403a-ba3b-9a0ec176f548"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.910100 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f5ee83a-68a6-403a-ba3b-9a0ec176f548" (UID: "9f5ee83a-68a6-403a-ba3b-9a0ec176f548"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.935306 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.935336 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.935346 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bvrfx\" (UniqueName: \"kubernetes.io/projected/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-kube-api-access-bvrfx\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:29 crc kubenswrapper[4769]: I1121 13:08:29.935354 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9f5ee83a-68a6-403a-ba3b-9a0ec176f548-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.136467 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.136693 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-log" containerID="cri-o://6627a3495abaad9f07ed657025985bd62fc736bcd5756fa5a7c9758cf64d8caa" gracePeriod=30 Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.137127 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-api" containerID="cri-o://aca567cc9252a4f2719ea1a244640ab40582cfe6f79a67b0801220d8be403ae1" gracePeriod=30 Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.156572 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.156762 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8bd9786a-17b8-49f4-8036-147394bab405" containerName="nova-scheduler-scheduler" containerID="cri-o://2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" gracePeriod=30 Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.167896 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.891748 4769 generic.go:334] "Generic (PLEG): container finished" podID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerID="6627a3495abaad9f07ed657025985bd62fc736bcd5756fa5a7c9758cf64d8caa" exitCode=143 Nov 21 13:08:30 crc kubenswrapper[4769]: I1121 13:08:30.891838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70583dd1-815a-40d2-ab1b-e8c454a238e3","Type":"ContainerDied","Data":"6627a3495abaad9f07ed657025985bd62fc736bcd5756fa5a7c9758cf64d8caa"} Nov 21 13:08:31 crc kubenswrapper[4769]: E1121 13:08:31.044300 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:08:31 crc kubenswrapper[4769]: E1121 13:08:31.046288 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:08:31 crc kubenswrapper[4769]: E1121 13:08:31.047771 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:08:31 crc kubenswrapper[4769]: E1121 13:08:31.047804 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8bd9786a-17b8-49f4-8036-147394bab405" containerName="nova-scheduler-scheduler" Nov 21 13:08:31 crc kubenswrapper[4769]: I1121 13:08:31.899622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-log" containerID="cri-o://07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00" gracePeriod=30 Nov 21 13:08:31 crc kubenswrapper[4769]: I1121 13:08:31.899687 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-metadata" containerID="cri-o://e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d" gracePeriod=30 Nov 21 13:08:32 crc kubenswrapper[4769]: I1121 13:08:32.913612 4769 generic.go:334] "Generic (PLEG): container finished" podID="e36181d2-406e-4430-b684-292a2731d286" containerID="07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00" exitCode=143 Nov 21 13:08:32 crc kubenswrapper[4769]: I1121 13:08:32.913715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e36181d2-406e-4430-b684-292a2731d286","Type":"ContainerDied","Data":"07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00"} Nov 21 13:08:33 crc kubenswrapper[4769]: I1121 13:08:33.931848 4769 generic.go:334] "Generic (PLEG): container finished" podID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerID="aca567cc9252a4f2719ea1a244640ab40582cfe6f79a67b0801220d8be403ae1" exitCode=0 Nov 21 13:08:33 crc kubenswrapper[4769]: I1121 13:08:33.931921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70583dd1-815a-40d2-ab1b-e8c454a238e3","Type":"ContainerDied","Data":"aca567cc9252a4f2719ea1a244640ab40582cfe6f79a67b0801220d8be403ae1"} Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.243949 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.312869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-combined-ca-bundle\") pod \"70583dd1-815a-40d2-ab1b-e8c454a238e3\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.313032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-config-data\") pod \"70583dd1-815a-40d2-ab1b-e8c454a238e3\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.313096 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70583dd1-815a-40d2-ab1b-e8c454a238e3-logs\") pod \"70583dd1-815a-40d2-ab1b-e8c454a238e3\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.313177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc9gh\" (UniqueName: \"kubernetes.io/projected/70583dd1-815a-40d2-ab1b-e8c454a238e3-kube-api-access-nc9gh\") pod \"70583dd1-815a-40d2-ab1b-e8c454a238e3\" (UID: \"70583dd1-815a-40d2-ab1b-e8c454a238e3\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.315025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70583dd1-815a-40d2-ab1b-e8c454a238e3-logs" (OuterVolumeSpecName: "logs") pod "70583dd1-815a-40d2-ab1b-e8c454a238e3" (UID: "70583dd1-815a-40d2-ab1b-e8c454a238e3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.321907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70583dd1-815a-40d2-ab1b-e8c454a238e3-kube-api-access-nc9gh" (OuterVolumeSpecName: "kube-api-access-nc9gh") pod "70583dd1-815a-40d2-ab1b-e8c454a238e3" (UID: "70583dd1-815a-40d2-ab1b-e8c454a238e3"). InnerVolumeSpecName "kube-api-access-nc9gh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.341259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "70583dd1-815a-40d2-ab1b-e8c454a238e3" (UID: "70583dd1-815a-40d2-ab1b-e8c454a238e3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.343835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-config-data" (OuterVolumeSpecName: "config-data") pod "70583dd1-815a-40d2-ab1b-e8c454a238e3" (UID: "70583dd1-815a-40d2-ab1b-e8c454a238e3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.415362 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nc9gh\" (UniqueName: \"kubernetes.io/projected/70583dd1-815a-40d2-ab1b-e8c454a238e3-kube-api-access-nc9gh\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.415400 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.415413 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/70583dd1-815a-40d2-ab1b-e8c454a238e3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.415424 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/70583dd1-815a-40d2-ab1b-e8c454a238e3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.594527 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.723159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r989\" (UniqueName: \"kubernetes.io/projected/8bd9786a-17b8-49f4-8036-147394bab405-kube-api-access-2r989\") pod \"8bd9786a-17b8-49f4-8036-147394bab405\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.723891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-combined-ca-bundle\") pod \"8bd9786a-17b8-49f4-8036-147394bab405\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.723970 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-config-data\") pod \"8bd9786a-17b8-49f4-8036-147394bab405\" (UID: \"8bd9786a-17b8-49f4-8036-147394bab405\") " Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.729670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bd9786a-17b8-49f4-8036-147394bab405-kube-api-access-2r989" (OuterVolumeSpecName: "kube-api-access-2r989") pod "8bd9786a-17b8-49f4-8036-147394bab405" (UID: "8bd9786a-17b8-49f4-8036-147394bab405"). InnerVolumeSpecName "kube-api-access-2r989". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.747466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-config-data" (OuterVolumeSpecName: "config-data") pod "8bd9786a-17b8-49f4-8036-147394bab405" (UID: "8bd9786a-17b8-49f4-8036-147394bab405"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.766672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8bd9786a-17b8-49f4-8036-147394bab405" (UID: "8bd9786a-17b8-49f4-8036-147394bab405"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.826145 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2r989\" (UniqueName: \"kubernetes.io/projected/8bd9786a-17b8-49f4-8036-147394bab405-kube-api-access-2r989\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.826178 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.826199 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bd9786a-17b8-49f4-8036-147394bab405-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.944697 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bd9786a-17b8-49f4-8036-147394bab405" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" exitCode=0 Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.944770 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.944824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8bd9786a-17b8-49f4-8036-147394bab405","Type":"ContainerDied","Data":"2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27"} Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.944911 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8bd9786a-17b8-49f4-8036-147394bab405","Type":"ContainerDied","Data":"f889ed60ed7144c901a6fca9b6bd3969356da56a5e658aed534004422066c834"} Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.944944 4769 scope.go:117] "RemoveContainer" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.949766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"70583dd1-815a-40d2-ab1b-e8c454a238e3","Type":"ContainerDied","Data":"9a58debca31c6a424602413718a721ce6d957468208557564c8245e6d6b4a584"} Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.949883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.968553 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.101:8775/\": read tcp 10.217.0.2:54322->10.217.1.101:8775: read: connection reset by peer" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.968563 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.101:8775/\": read tcp 10.217.0.2:54314->10.217.1.101:8775: read: connection reset by peer" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.985553 4769 scope.go:117] "RemoveContainer" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" Nov 21 13:08:34 crc kubenswrapper[4769]: E1121 13:08:34.986035 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27\": container with ID starting with 2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27 not found: ID does not exist" containerID="2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.986087 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27"} err="failed to get container status \"2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27\": rpc error: code = NotFound desc = could not find container \"2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27\": container with ID starting with 2f31da2c1e9dcf693fbaa0f4c85d3dff794614f1f6e0e9c17a7283156e759d27 not found: ID does not exist" Nov 21 13:08:34 crc kubenswrapper[4769]: I1121 13:08:34.986116 4769 scope.go:117] "RemoveContainer" containerID="aca567cc9252a4f2719ea1a244640ab40582cfe6f79a67b0801220d8be403ae1" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.013249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.030770 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.043249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.066897 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.066976 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: E1121 13:08:35.067341 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bd9786a-17b8-49f4-8036-147394bab405" containerName="nova-scheduler-scheduler" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067353 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd9786a-17b8-49f4-8036-147394bab405" containerName="nova-scheduler-scheduler" Nov 21 13:08:35 crc kubenswrapper[4769]: E1121 13:08:35.067367 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f5ee83a-68a6-403a-ba3b-9a0ec176f548" containerName="nova-manage" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5ee83a-68a6-403a-ba3b-9a0ec176f548" containerName="nova-manage" Nov 21 13:08:35 crc kubenswrapper[4769]: E1121 13:08:35.067385 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-log" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067391 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-log" Nov 21 13:08:35 crc kubenswrapper[4769]: E1121 13:08:35.067413 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-api" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067419 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-api" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067652 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-log" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067705 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8bd9786a-17b8-49f4-8036-147394bab405" containerName="nova-scheduler-scheduler" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067717 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f5ee83a-68a6-403a-ba3b-9a0ec176f548" containerName="nova-manage" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.067729 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" containerName="nova-api-api" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.069025 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.069127 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.077752 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.078903 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.081806 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.083257 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.098866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.116949 4769 scope.go:117] "RemoveContainer" containerID="6627a3495abaad9f07ed657025985bd62fc736bcd5756fa5a7c9758cf64d8caa" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbs7\" (UniqueName: \"kubernetes.io/projected/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-kube-api-access-wfbs7\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-config-data\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-config-data\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-logs\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.132453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnt6\" (UniqueName: \"kubernetes.io/projected/9aaa614d-7f10-480d-be9a-293f7959b164-kube-api-access-7vnt6\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235233 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbs7\" (UniqueName: \"kubernetes.io/projected/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-kube-api-access-wfbs7\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-config-data\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-config-data\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-logs\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.235513 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnt6\" (UniqueName: \"kubernetes.io/projected/9aaa614d-7f10-480d-be9a-293f7959b164-kube-api-access-7vnt6\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.236752 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-logs\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.240899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.241301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.241501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-config-data\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.241987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-config-data\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.265929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbs7\" (UniqueName: \"kubernetes.io/projected/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-kube-api-access-wfbs7\") pod \"nova-api-0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.275537 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:08:35 crc kubenswrapper[4769]: E1121 13:08:35.275822 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.277663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnt6\" (UniqueName: \"kubernetes.io/projected/9aaa614d-7f10-480d-be9a-293f7959b164-kube-api-access-7vnt6\") pod \"nova-scheduler-0\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.286174 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70583dd1-815a-40d2-ab1b-e8c454a238e3" path="/var/lib/kubelet/pods/70583dd1-815a-40d2-ab1b-e8c454a238e3/volumes" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.287441 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bd9786a-17b8-49f4-8036-147394bab405" path="/var/lib/kubelet/pods/8bd9786a-17b8-49f4-8036-147394bab405/volumes" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.422572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.433092 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.537154 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.642160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mztg9\" (UniqueName: \"kubernetes.io/projected/e36181d2-406e-4430-b684-292a2731d286-kube-api-access-mztg9\") pod \"e36181d2-406e-4430-b684-292a2731d286\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.642348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-nova-metadata-tls-certs\") pod \"e36181d2-406e-4430-b684-292a2731d286\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.642426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-config-data\") pod \"e36181d2-406e-4430-b684-292a2731d286\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.642568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e36181d2-406e-4430-b684-292a2731d286-logs\") pod \"e36181d2-406e-4430-b684-292a2731d286\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.642667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-combined-ca-bundle\") pod \"e36181d2-406e-4430-b684-292a2731d286\" (UID: \"e36181d2-406e-4430-b684-292a2731d286\") " Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.643954 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e36181d2-406e-4430-b684-292a2731d286-logs" (OuterVolumeSpecName: "logs") pod "e36181d2-406e-4430-b684-292a2731d286" (UID: "e36181d2-406e-4430-b684-292a2731d286"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.650012 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36181d2-406e-4430-b684-292a2731d286-kube-api-access-mztg9" (OuterVolumeSpecName: "kube-api-access-mztg9") pod "e36181d2-406e-4430-b684-292a2731d286" (UID: "e36181d2-406e-4430-b684-292a2731d286"). InnerVolumeSpecName "kube-api-access-mztg9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.669497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-config-data" (OuterVolumeSpecName: "config-data") pod "e36181d2-406e-4430-b684-292a2731d286" (UID: "e36181d2-406e-4430-b684-292a2731d286"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.674526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e36181d2-406e-4430-b684-292a2731d286" (UID: "e36181d2-406e-4430-b684-292a2731d286"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.721320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e36181d2-406e-4430-b684-292a2731d286" (UID: "e36181d2-406e-4430-b684-292a2731d286"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.745397 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.745465 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mztg9\" (UniqueName: \"kubernetes.io/projected/e36181d2-406e-4430-b684-292a2731d286-kube-api-access-mztg9\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.745481 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.745494 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e36181d2-406e-4430-b684-292a2731d286-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.745508 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e36181d2-406e-4430-b684-292a2731d286-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.888560 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.904499 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:08:35 crc kubenswrapper[4769]: W1121 13:08:35.905823 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aaa614d_7f10_480d_be9a_293f7959b164.slice/crio-38838936207c4da870b49a0af78f9d0994d8e6bdcdddbb34ec355af22b0a502e WatchSource:0}: Error finding container 38838936207c4da870b49a0af78f9d0994d8e6bdcdddbb34ec355af22b0a502e: Status 404 returned error can't find the container with id 38838936207c4da870b49a0af78f9d0994d8e6bdcdddbb34ec355af22b0a502e Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.959574 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9aaa614d-7f10-480d-be9a-293f7959b164","Type":"ContainerStarted","Data":"38838936207c4da870b49a0af78f9d0994d8e6bdcdddbb34ec355af22b0a502e"} Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.962596 4769 generic.go:334] "Generic (PLEG): container finished" podID="e36181d2-406e-4430-b684-292a2731d286" containerID="e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d" exitCode=0 Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.962654 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.962645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e36181d2-406e-4430-b684-292a2731d286","Type":"ContainerDied","Data":"e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d"} Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.962735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e36181d2-406e-4430-b684-292a2731d286","Type":"ContainerDied","Data":"cc97bd64d4e6a252e6c70d797a88bb026131e36a85e2562b8ebc70dd2a669b7b"} Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.962783 4769 scope.go:117] "RemoveContainer" containerID="e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d" Nov 21 13:08:35 crc kubenswrapper[4769]: I1121 13:08:35.967222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0","Type":"ContainerStarted","Data":"d7e371ade109317124a4bdedd4f5aa7704c4dc2162650c782391c7907121e1c0"} Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.019060 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.028669 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.044904 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:36 crc kubenswrapper[4769]: E1121 13:08:36.045621 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-log" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.045646 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-log" Nov 21 13:08:36 crc kubenswrapper[4769]: E1121 13:08:36.045665 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-metadata" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.045672 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-metadata" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.046012 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-metadata" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.046038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e36181d2-406e-4430-b684-292a2731d286" containerName="nova-metadata-log" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.047285 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.047539 4769 scope.go:117] "RemoveContainer" containerID="07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.050745 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.050890 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.072016 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.093189 4769 scope.go:117] "RemoveContainer" containerID="e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d" Nov 21 13:08:36 crc kubenswrapper[4769]: E1121 13:08:36.093780 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d\": container with ID starting with e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d not found: ID does not exist" containerID="e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.093861 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d"} err="failed to get container status \"e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d\": rpc error: code = NotFound desc = could not find container \"e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d\": container with ID starting with e81c125ea0016abb23a0feabe774d37d8f823952cc2d5220773fda8baea41c0d not found: ID does not exist" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.093912 4769 scope.go:117] "RemoveContainer" containerID="07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00" Nov 21 13:08:36 crc kubenswrapper[4769]: E1121 13:08:36.094351 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00\": container with ID starting with 07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00 not found: ID does not exist" containerID="07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.094398 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00"} err="failed to get container status \"07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00\": rpc error: code = NotFound desc = could not find container \"07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00\": container with ID starting with 07f0c59da5fd21b7546bfc71e06325744c037c2b24370cd72fdd497e7cbddb00 not found: ID does not exist" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.152251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/066dc797-82a6-41d9-a8db-783d732b26ed-logs\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.152398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvnnn\" (UniqueName: \"kubernetes.io/projected/066dc797-82a6-41d9-a8db-783d732b26ed-kube-api-access-mvnnn\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.152494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-config-data\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.152680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.152809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.254305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/066dc797-82a6-41d9-a8db-783d732b26ed-logs\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.254390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mvnnn\" (UniqueName: \"kubernetes.io/projected/066dc797-82a6-41d9-a8db-783d732b26ed-kube-api-access-mvnnn\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.254416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-config-data\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.254484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.254512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.254912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/066dc797-82a6-41d9-a8db-783d732b26ed-logs\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.258521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.258878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.260527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-config-data\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.269874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvnnn\" (UniqueName: \"kubernetes.io/projected/066dc797-82a6-41d9-a8db-783d732b26ed-kube-api-access-mvnnn\") pod \"nova-metadata-0\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.385009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:36 crc kubenswrapper[4769]: W1121 13:08:36.684519 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod066dc797_82a6_41d9_a8db_783d732b26ed.slice/crio-88a4071cdf3dcb7374dd70f83d7963c9d5d7660f3a66892c15d60c0fd6ae7180 WatchSource:0}: Error finding container 88a4071cdf3dcb7374dd70f83d7963c9d5d7660f3a66892c15d60c0fd6ae7180: Status 404 returned error can't find the container with id 88a4071cdf3dcb7374dd70f83d7963c9d5d7660f3a66892c15d60c0fd6ae7180 Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.685778 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.978592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"066dc797-82a6-41d9-a8db-783d732b26ed","Type":"ContainerStarted","Data":"7b658a4a7a4b597623de7e7823282d42d5e01fbca41f202db2f4e2e219101942"} Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.979003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"066dc797-82a6-41d9-a8db-783d732b26ed","Type":"ContainerStarted","Data":"88a4071cdf3dcb7374dd70f83d7963c9d5d7660f3a66892c15d60c0fd6ae7180"} Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.983328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0","Type":"ContainerStarted","Data":"c596321e97e8c108fa7b333df21d61cd8c8cd7a40323a039156ca8b9cab57bf7"} Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.983367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0","Type":"ContainerStarted","Data":"64c43b131f0d5a583ef0b0e139c2a8de1ff2a476b278094a4243c177cbe76bed"} Nov 21 13:08:36 crc kubenswrapper[4769]: I1121 13:08:36.985468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9aaa614d-7f10-480d-be9a-293f7959b164","Type":"ContainerStarted","Data":"47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a"} Nov 21 13:08:37 crc kubenswrapper[4769]: I1121 13:08:37.007903 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.007887531 podStartE2EDuration="2.007887531s" podCreationTimestamp="2025-11-21 13:08:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:37.000139332 +0000 UTC m=+4675.700801160" watchObservedRunningTime="2025-11-21 13:08:37.007887531 +0000 UTC m=+4675.708549349" Nov 21 13:08:37 crc kubenswrapper[4769]: I1121 13:08:37.026710 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.026690198 podStartE2EDuration="2.026690198s" podCreationTimestamp="2025-11-21 13:08:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:37.01638754 +0000 UTC m=+4675.717049358" watchObservedRunningTime="2025-11-21 13:08:37.026690198 +0000 UTC m=+4675.727352016" Nov 21 13:08:37 crc kubenswrapper[4769]: I1121 13:08:37.284435 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36181d2-406e-4430-b684-292a2731d286" path="/var/lib/kubelet/pods/e36181d2-406e-4430-b684-292a2731d286/volumes" Nov 21 13:08:38 crc kubenswrapper[4769]: I1121 13:08:38.012409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"066dc797-82a6-41d9-a8db-783d732b26ed","Type":"ContainerStarted","Data":"8492af9af790ac21f80c3388e456304325713e7ce73812df5f74ebff91bcacde"} Nov 21 13:08:38 crc kubenswrapper[4769]: I1121 13:08:38.057825 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.057803485 podStartE2EDuration="2.057803485s" podCreationTimestamp="2025-11-21 13:08:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:08:38.046473449 +0000 UTC m=+4676.747135327" watchObservedRunningTime="2025-11-21 13:08:38.057803485 +0000 UTC m=+4676.758465313" Nov 21 13:08:40 crc kubenswrapper[4769]: I1121 13:08:40.433465 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:41 crc kubenswrapper[4769]: I1121 13:08:41.385896 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:41 crc kubenswrapper[4769]: I1121 13:08:41.386528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.003447 4769 scope.go:117] "RemoveContainer" containerID="6d524a124cabb7b65c45a13f6b10f66546b97a399e1b3230fc8222899f4e57c6" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.033223 4769 scope.go:117] "RemoveContainer" containerID="9149a77a3fefc62b0bcc4f17a966b585e50ad757b668d6c5c43eff2fae813e6d" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.071746 4769 scope.go:117] "RemoveContainer" containerID="cd23d0bbe0b15d7111fd1bbd2fae548337dbf4503db5e22999ab07463ee507e5" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.106144 4769 scope.go:117] "RemoveContainer" containerID="b2c18272f1827009a30ad1293ce54279df006ccb9d1dcbf1e125ec9efe5d804a" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.135925 4769 scope.go:117] "RemoveContainer" containerID="70ca0e7ac3b8445b0425c47e16f74574494bd814f5f73601837d9523280c3f20" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.167411 4769 scope.go:117] "RemoveContainer" containerID="4d8a297c93e8b508a0b27f72009d8b1cf1375e71882fa3cf1db35146dcd6e5e7" Nov 21 13:08:43 crc kubenswrapper[4769]: I1121 13:08:43.223238 4769 scope.go:117] "RemoveContainer" containerID="5c77f7256d442dd09404dd9e623b4e1e80f758d4c04e440ae3639121c0c354ef" Nov 21 13:08:44 crc kubenswrapper[4769]: I1121 13:08:44.220802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:08:45 crc kubenswrapper[4769]: I1121 13:08:45.423253 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:45 crc kubenswrapper[4769]: I1121 13:08:45.423337 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:45 crc kubenswrapper[4769]: I1121 13:08:45.434068 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:45 crc kubenswrapper[4769]: I1121 13:08:45.460501 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:46 crc kubenswrapper[4769]: I1121 13:08:46.126765 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:08:46 crc kubenswrapper[4769]: I1121 13:08:46.385873 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:46 crc kubenswrapper[4769]: I1121 13:08:46.385923 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:46 crc kubenswrapper[4769]: I1121 13:08:46.506634 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.107:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:46 crc kubenswrapper[4769]: I1121 13:08:46.506725 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.107:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:47 crc kubenswrapper[4769]: I1121 13:08:47.468406 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.109:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:47 crc kubenswrapper[4769]: I1121 13:08:47.468426 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.109:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:08:50 crc kubenswrapper[4769]: I1121 13:08:50.283267 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:08:50 crc kubenswrapper[4769]: E1121 13:08:50.284592 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:08:55 crc kubenswrapper[4769]: I1121 13:08:55.739808 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:55 crc kubenswrapper[4769]: I1121 13:08:55.740617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:55 crc kubenswrapper[4769]: I1121 13:08:55.742360 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:55 crc kubenswrapper[4769]: I1121 13:08:55.742382 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:55 crc kubenswrapper[4769]: I1121 13:08:55.751915 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:55 crc kubenswrapper[4769]: I1121 13:08:55.754750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:08:56 crc kubenswrapper[4769]: I1121 13:08:56.398820 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:56 crc kubenswrapper[4769]: I1121 13:08:56.399756 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:56 crc kubenswrapper[4769]: I1121 13:08:56.415713 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:56 crc kubenswrapper[4769]: I1121 13:08:56.740760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:08:57 crc kubenswrapper[4769]: I1121 13:08:57.730654 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:08:57 crc kubenswrapper[4769]: I1121 13:08:57.730952 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-central-agent" containerID="cri-o://31d2dafe0b4ee331e4ebe610d68369ecf5beecd9111b6b4339acc5ffa361a49c" gracePeriod=30 Nov 21 13:08:57 crc kubenswrapper[4769]: I1121 13:08:57.731019 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="proxy-httpd" containerID="cri-o://60577edb23c797bef02378f147bfee1bac701e4d7b6410bca737c4b9035362a9" gracePeriod=30 Nov 21 13:08:57 crc kubenswrapper[4769]: I1121 13:08:57.731025 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="sg-core" containerID="cri-o://c1ebd8d5cb1d72b5a8e7ec9fe5b6677cd103675c4d27911480bbb805a6fb5662" gracePeriod=30 Nov 21 13:08:57 crc kubenswrapper[4769]: I1121 13:08:57.731041 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-notification-agent" containerID="cri-o://581596f34f2364d8e8795909393a4caf2ffcc599d1a4465167646c1581f36d30" gracePeriod=30 Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.230936 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.756821 4769 generic.go:334] "Generic (PLEG): container finished" podID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerID="60577edb23c797bef02378f147bfee1bac701e4d7b6410bca737c4b9035362a9" exitCode=0 Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.756853 4769 generic.go:334] "Generic (PLEG): container finished" podID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerID="c1ebd8d5cb1d72b5a8e7ec9fe5b6677cd103675c4d27911480bbb805a6fb5662" exitCode=2 Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.756864 4769 generic.go:334] "Generic (PLEG): container finished" podID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerID="31d2dafe0b4ee331e4ebe610d68369ecf5beecd9111b6b4339acc5ffa361a49c" exitCode=0 Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.756915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerDied","Data":"60577edb23c797bef02378f147bfee1bac701e4d7b6410bca737c4b9035362a9"} Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.756960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerDied","Data":"c1ebd8d5cb1d72b5a8e7ec9fe5b6677cd103675c4d27911480bbb805a6fb5662"} Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.756973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerDied","Data":"31d2dafe0b4ee331e4ebe610d68369ecf5beecd9111b6b4339acc5ffa361a49c"} Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.757039 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-log" containerID="cri-o://64c43b131f0d5a583ef0b0e139c2a8de1ff2a476b278094a4243c177cbe76bed" gracePeriod=30 Nov 21 13:08:58 crc kubenswrapper[4769]: I1121 13:08:58.757175 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-api" containerID="cri-o://c596321e97e8c108fa7b333df21d61cd8c8cd7a40323a039156ca8b9cab57bf7" gracePeriod=30 Nov 21 13:08:59 crc kubenswrapper[4769]: I1121 13:08:59.773729 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerID="64c43b131f0d5a583ef0b0e139c2a8de1ff2a476b278094a4243c177cbe76bed" exitCode=143 Nov 21 13:08:59 crc kubenswrapper[4769]: I1121 13:08:59.773827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0","Type":"ContainerDied","Data":"64c43b131f0d5a583ef0b0e139c2a8de1ff2a476b278094a4243c177cbe76bed"} Nov 21 13:09:02 crc kubenswrapper[4769]: I1121 13:09:02.273871 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:09:02 crc kubenswrapper[4769]: E1121 13:09:02.274343 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:09:02 crc kubenswrapper[4769]: I1121 13:09:02.811523 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerID="c596321e97e8c108fa7b333df21d61cd8c8cd7a40323a039156ca8b9cab57bf7" exitCode=0 Nov 21 13:09:02 crc kubenswrapper[4769]: I1121 13:09:02.812030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0","Type":"ContainerDied","Data":"c596321e97e8c108fa7b333df21d61cd8c8cd7a40323a039156ca8b9cab57bf7"} Nov 21 13:09:02 crc kubenswrapper[4769]: I1121 13:09:02.816495 4769 generic.go:334] "Generic (PLEG): container finished" podID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerID="581596f34f2364d8e8795909393a4caf2ffcc599d1a4465167646c1581f36d30" exitCode=0 Nov 21 13:09:02 crc kubenswrapper[4769]: I1121 13:09:02.816543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerDied","Data":"581596f34f2364d8e8795909393a4caf2ffcc599d1a4465167646c1581f36d30"} Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.315101 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.443112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-config-data\") pod \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.443167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfbs7\" (UniqueName: \"kubernetes.io/projected/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-kube-api-access-wfbs7\") pod \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.443335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-logs\") pod \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.443364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-combined-ca-bundle\") pod \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\" (UID: \"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.444300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-logs" (OuterVolumeSpecName: "logs") pod "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" (UID: "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.449601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-kube-api-access-wfbs7" (OuterVolumeSpecName: "kube-api-access-wfbs7") pod "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" (UID: "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0"). InnerVolumeSpecName "kube-api-access-wfbs7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.472538 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.475698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" (UID: "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.513559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-config-data" (OuterVolumeSpecName: "config-data") pod "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" (UID: "0f4e55d2-5557-45f3-9ab1-0a8cb5017df0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-log-httpd\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-ceilometer-tls-certs\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-combined-ca-bundle\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-scripts\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-sg-core-conf-yaml\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-config-data\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-run-httpd\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tg7b\" (UniqueName: \"kubernetes.io/projected/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-kube-api-access-7tg7b\") pod \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\" (UID: \"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc\") " Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548958 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548975 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wfbs7\" (UniqueName: \"kubernetes.io/projected/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-kube-api-access-wfbs7\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548986 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.548996 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.554307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.555177 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-scripts" (OuterVolumeSpecName: "scripts") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.622758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.644859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-kube-api-access-7tg7b" (OuterVolumeSpecName: "kube-api-access-7tg7b") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "kube-api-access-7tg7b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.646664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.653060 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.653111 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.653133 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7tg7b\" (UniqueName: \"kubernetes.io/projected/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-kube-api-access-7tg7b\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.653150 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.653166 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.653607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.671079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-config-data" (OuterVolumeSpecName: "config-data") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.683111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" (UID: "12d4f58e-8bbb-4bc2-a053-453bf9d51ecc"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.754542 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.754578 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.754591 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.832212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"12d4f58e-8bbb-4bc2-a053-453bf9d51ecc","Type":"ContainerDied","Data":"353fd6e479e090406081012bdd03f614dfc498669a796ac259546651a0e54d71"} Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.832273 4769 scope.go:117] "RemoveContainer" containerID="60577edb23c797bef02378f147bfee1bac701e4d7b6410bca737c4b9035362a9" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.832654 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.834377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"0f4e55d2-5557-45f3-9ab1-0a8cb5017df0","Type":"ContainerDied","Data":"d7e371ade109317124a4bdedd4f5aa7704c4dc2162650c782391c7907121e1c0"} Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.834964 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.867978 4769 scope.go:117] "RemoveContainer" containerID="c1ebd8d5cb1d72b5a8e7ec9fe5b6677cd103675c4d27911480bbb805a6fb5662" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.889876 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.894161 4769 scope.go:117] "RemoveContainer" containerID="581596f34f2364d8e8795909393a4caf2ffcc599d1a4465167646c1581f36d30" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.915965 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.923371 4769 scope.go:117] "RemoveContainer" containerID="31d2dafe0b4ee331e4ebe610d68369ecf5beecd9111b6b4339acc5ffa361a49c" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.932734 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.939996 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: E1121 13:09:03.940415 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="proxy-httpd" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940429 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="proxy-httpd" Nov 21 13:09:03 crc kubenswrapper[4769]: E1121 13:09:03.940467 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-api" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940475 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-api" Nov 21 13:09:03 crc kubenswrapper[4769]: E1121 13:09:03.940502 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-notification-agent" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940508 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-notification-agent" Nov 21 13:09:03 crc kubenswrapper[4769]: E1121 13:09:03.940515 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="sg-core" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940521 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="sg-core" Nov 21 13:09:03 crc kubenswrapper[4769]: E1121 13:09:03.940530 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-log" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940536 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-log" Nov 21 13:09:03 crc kubenswrapper[4769]: E1121 13:09:03.940546 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-central-agent" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940551 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-central-agent" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940752 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-api" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940772 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="sg-core" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940783 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-notification-agent" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940791 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" containerName="nova-api-log" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940799 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="ceilometer-central-agent" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.940810 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" containerName="proxy-httpd" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.941811 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.963658 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.963739 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.963751 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.965858 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.968802 4769 scope.go:117] "RemoveContainer" containerID="c596321e97e8c108fa7b333df21d61cd8c8cd7a40323a039156ca8b9cab57bf7" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.968865 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969212 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-internal-tls-certs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-logs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969439 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-public-tls-certs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-config-data\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcq4l\" (UniqueName: \"kubernetes.io/projected/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-kube-api-access-bcq4l\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969614 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.969620 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:09:03 crc kubenswrapper[4769]: I1121 13:09:03.977655 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.001306 4769 scope.go:117] "RemoveContainer" containerID="64c43b131f0d5a583ef0b0e139c2a8de1ff2a476b278094a4243c177cbe76bed" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.012873 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-run-httpd\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-logs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-public-tls-certs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-config-data\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-config-data\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.071986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bcq4l\" (UniqueName: \"kubernetes.io/projected/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-kube-api-access-bcq4l\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-log-httpd\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-scripts\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-logs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpp7\" (UniqueName: \"kubernetes.io/projected/96dfbc55-a61b-4afd-980e-6f39834b9b46-kube-api-access-lrpp7\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.072879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-internal-tls-certs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.076117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-public-tls-certs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.077030 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-config-data\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.077937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-internal-tls-certs\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.078906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.086065 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcq4l\" (UniqueName: \"kubernetes.io/projected/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-kube-api-access-bcq4l\") pod \"nova-api-0\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-scripts\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpp7\" (UniqueName: \"kubernetes.io/projected/96dfbc55-a61b-4afd-980e-6f39834b9b46-kube-api-access-lrpp7\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-run-httpd\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-config-data\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.174732 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-log-httpd\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.175293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-log-httpd\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.175560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-run-httpd\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.179917 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.179951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.180941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-config-data\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.183104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.183691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-scripts\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.196140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpp7\" (UniqueName: \"kubernetes.io/projected/96dfbc55-a61b-4afd-980e-6f39834b9b46-kube-api-access-lrpp7\") pod \"ceilometer-0\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.294331 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.306648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.807756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.849950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerStarted","Data":"74b959cc5008142e8bf2debe6b1ca1ea91dddf649500b6e03bf5a0caca8a5972"} Nov 21 13:09:04 crc kubenswrapper[4769]: W1121 13:09:04.868959 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefa3e39f_ae21_4cf3_b57b_8da9fdfc5527.slice/crio-e66ae2238a13513c26a27b5cd5cb2ca9a2e238ff50ad9b593ab12fdafa2a0620 WatchSource:0}: Error finding container e66ae2238a13513c26a27b5cd5cb2ca9a2e238ff50ad9b593ab12fdafa2a0620: Status 404 returned error can't find the container with id e66ae2238a13513c26a27b5cd5cb2ca9a2e238ff50ad9b593ab12fdafa2a0620 Nov 21 13:09:04 crc kubenswrapper[4769]: I1121 13:09:04.870738 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:09:05 crc kubenswrapper[4769]: I1121 13:09:05.293904 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f4e55d2-5557-45f3-9ab1-0a8cb5017df0" path="/var/lib/kubelet/pods/0f4e55d2-5557-45f3-9ab1-0a8cb5017df0/volumes" Nov 21 13:09:05 crc kubenswrapper[4769]: I1121 13:09:05.295164 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d4f58e-8bbb-4bc2-a053-453bf9d51ecc" path="/var/lib/kubelet/pods/12d4f58e-8bbb-4bc2-a053-453bf9d51ecc/volumes" Nov 21 13:09:05 crc kubenswrapper[4769]: I1121 13:09:05.863281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527","Type":"ContainerStarted","Data":"11063f90162151039946f4a96bcca396ecf40151a84b3dc6c9a038a4225d3105"} Nov 21 13:09:05 crc kubenswrapper[4769]: I1121 13:09:05.863718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527","Type":"ContainerStarted","Data":"b0c81123338e28a790f83597d594930e9982b6b022c2f17f56c6e28e8fad5957"} Nov 21 13:09:05 crc kubenswrapper[4769]: I1121 13:09:05.863744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527","Type":"ContainerStarted","Data":"e66ae2238a13513c26a27b5cd5cb2ca9a2e238ff50ad9b593ab12fdafa2a0620"} Nov 21 13:09:05 crc kubenswrapper[4769]: I1121 13:09:05.889728 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.88970652 podStartE2EDuration="2.88970652s" podCreationTimestamp="2025-11-21 13:09:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:09:05.877719058 +0000 UTC m=+4704.578380886" watchObservedRunningTime="2025-11-21 13:09:05.88970652 +0000 UTC m=+4704.590368348" Nov 21 13:09:07 crc kubenswrapper[4769]: I1121 13:09:07.882721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerStarted","Data":"3e220a36fa9d819077f84712d7dedfa2481855a2e10a3d1ecb87157981096242"} Nov 21 13:09:09 crc kubenswrapper[4769]: I1121 13:09:09.919017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerStarted","Data":"5a91d4d64e9bd672d925fc8d8e3da8463c35624b3858c061c4ebdb2f5ff8b912"} Nov 21 13:09:10 crc kubenswrapper[4769]: I1121 13:09:10.929035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerStarted","Data":"ced88ab95b4468da6e88b7a415c25c316de3a9d662b4850e1dd49a8d950fde7f"} Nov 21 13:09:13 crc kubenswrapper[4769]: I1121 13:09:13.961487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerStarted","Data":"bb8e8d4434e7fcb78eca9fe7ff98490c76a42697d207ce2d28782c55bb2addf9"} Nov 21 13:09:13 crc kubenswrapper[4769]: I1121 13:09:13.962287 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:13 crc kubenswrapper[4769]: I1121 13:09:13.981031 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.081108486 podStartE2EDuration="10.981005172s" podCreationTimestamp="2025-11-21 13:09:03 +0000 UTC" firstStartedPulling="2025-11-21 13:09:04.825085552 +0000 UTC m=+4703.525747380" lastFinishedPulling="2025-11-21 13:09:12.724982228 +0000 UTC m=+4711.425644066" observedRunningTime="2025-11-21 13:09:13.979490791 +0000 UTC m=+4712.680152649" watchObservedRunningTime="2025-11-21 13:09:13.981005172 +0000 UTC m=+4712.681667030" Nov 21 13:09:14 crc kubenswrapper[4769]: I1121 13:09:14.295251 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:14 crc kubenswrapper[4769]: I1121 13:09:14.295634 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:15 crc kubenswrapper[4769]: I1121 13:09:15.274521 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:09:15 crc kubenswrapper[4769]: E1121 13:09:15.274776 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:09:15 crc kubenswrapper[4769]: I1121 13:09:15.309393 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.110:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:09:15 crc kubenswrapper[4769]: I1121 13:09:15.309402 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.110:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:09:24 crc kubenswrapper[4769]: I1121 13:09:24.311110 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:24 crc kubenswrapper[4769]: I1121 13:09:24.312457 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:24 crc kubenswrapper[4769]: I1121 13:09:24.314105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:24 crc kubenswrapper[4769]: I1121 13:09:24.322504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:25 crc kubenswrapper[4769]: I1121 13:09:25.105811 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:25 crc kubenswrapper[4769]: I1121 13:09:25.113384 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:09:30 crc kubenswrapper[4769]: I1121 13:09:30.274383 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:09:30 crc kubenswrapper[4769]: E1121 13:09:30.275431 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:09:34 crc kubenswrapper[4769]: I1121 13:09:34.351825 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:09:44 crc kubenswrapper[4769]: I1121 13:09:44.274713 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:09:45 crc kubenswrapper[4769]: I1121 13:09:45.310560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"1b1f2c1e2837e5ce0cc2c156af60fed23afef95bb5d7d7c049b7a0edff9bcd61"} Nov 21 13:09:50 crc kubenswrapper[4769]: I1121 13:09:50.792452 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:09:50 crc kubenswrapper[4769]: I1121 13:09:50.925856 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="93345448-c057-46bc-8671-d56938d5fe7c" containerName="galera" containerID="cri-o://49b1ec9e3c0381340351f26dba6772c0e34d3ab6dbbe1b747ac82c529711d4f8" gracePeriod=30 Nov 21 13:09:52 crc kubenswrapper[4769]: I1121 13:09:52.384496 4769 generic.go:334] "Generic (PLEG): container finished" podID="93345448-c057-46bc-8671-d56938d5fe7c" containerID="49b1ec9e3c0381340351f26dba6772c0e34d3ab6dbbe1b747ac82c529711d4f8" exitCode=0 Nov 21 13:09:52 crc kubenswrapper[4769]: I1121 13:09:52.384548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93345448-c057-46bc-8671-d56938d5fe7c","Type":"ContainerDied","Data":"49b1ec9e3c0381340351f26dba6772c0e34d3ab6dbbe1b747ac82c529711d4f8"} Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.608851 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.679940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-config-data-default\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-combined-ca-bundle\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-kolla-config\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93345448-c057-46bc-8671-d56938d5fe7c-config-data-generated\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-galera-tls-certs\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-operator-scripts\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2nlw\" (UniqueName: \"kubernetes.io/projected/93345448-c057-46bc-8671-d56938d5fe7c-kube-api-access-p2nlw\") pod \"93345448-c057-46bc-8671-d56938d5fe7c\" (UID: \"93345448-c057-46bc-8671-d56938d5fe7c\") " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93345448-c057-46bc-8671-d56938d5fe7c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.680983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.681215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.681846 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.691443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93345448-c057-46bc-8671-d56938d5fe7c-kube-api-access-p2nlw" (OuterVolumeSpecName: "kube-api-access-p2nlw") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "kube-api-access-p2nlw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.703283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.722360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783813 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783854 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783872 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p2nlw\" (UniqueName: \"kubernetes.io/projected/93345448-c057-46bc-8671-d56938d5fe7c-kube-api-access-p2nlw\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783885 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783897 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783909 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/93345448-c057-46bc-8671-d56938d5fe7c-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.783920 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/93345448-c057-46bc-8671-d56938d5fe7c-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.812735 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:09:53 crc kubenswrapper[4769]: I1121 13:09:53.886473 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.412649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"93345448-c057-46bc-8671-d56938d5fe7c","Type":"ContainerDied","Data":"a018de458e52764bcb1e8f56159270dda9ef8d490ec9ba52e175c3dacecbd795"} Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.412696 4769 scope.go:117] "RemoveContainer" containerID="49b1ec9e3c0381340351f26dba6772c0e34d3ab6dbbe1b747ac82c529711d4f8" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.412779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.425823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "93345448-c057-46bc-8671-d56938d5fe7c" (UID: "93345448-c057-46bc-8671-d56938d5fe7c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.474333 4769 scope.go:117] "RemoveContainer" containerID="e2acabd00eaf5a2f1787efae4711c4f59f02926ecccc2f7b38603d1b4c5b548d" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.501745 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/93345448-c057-46bc-8671-d56938d5fe7c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.518662 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.657021 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="galera" containerID="cri-o://33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" gracePeriod=30 Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.750037 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.762391 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.787657 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:09:54 crc kubenswrapper[4769]: E1121 13:09:54.788116 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93345448-c057-46bc-8671-d56938d5fe7c" containerName="mysql-bootstrap" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.788139 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93345448-c057-46bc-8671-d56938d5fe7c" containerName="mysql-bootstrap" Nov 21 13:09:54 crc kubenswrapper[4769]: E1121 13:09:54.788185 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93345448-c057-46bc-8671-d56938d5fe7c" containerName="galera" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.788213 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93345448-c057-46bc-8671-d56938d5fe7c" containerName="galera" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.788444 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93345448-c057-46bc-8671-d56938d5fe7c" containerName="galera" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.789725 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.795324 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.796968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xl2bf" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.796997 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.800713 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.857108 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910211 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910653 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910752 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9cs7\" (UniqueName: \"kubernetes.io/projected/294817fb-c857-4d11-9a12-23546ad1e93c-kube-api-access-n9cs7\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:54 crc kubenswrapper[4769]: I1121 13:09:54.910803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.011995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.012630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.012772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.012893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.013015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.013084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.013320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n9cs7\" (UniqueName: \"kubernetes.io/projected/294817fb-c857-4d11-9a12-23546ad1e93c-kube-api-access-n9cs7\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.013589 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.013690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.014267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.013448 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.014350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.015350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.284238 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93345448-c057-46bc-8671-d56938d5fe7c" path="/var/lib/kubelet/pods/93345448-c057-46bc-8671-d56938d5fe7c/volumes" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.480053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.480668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.481146 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9cs7\" (UniqueName: \"kubernetes.io/projected/294817fb-c857-4d11-9a12-23546ad1e93c-kube-api-access-n9cs7\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.524675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:55 crc kubenswrapper[4769]: I1121 13:09:55.709318 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:09:56 crc kubenswrapper[4769]: I1121 13:09:56.205057 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:09:56 crc kubenswrapper[4769]: I1121 13:09:56.438277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"294817fb-c857-4d11-9a12-23546ad1e93c","Type":"ContainerStarted","Data":"d0c6a0e2ad2ab953cd999de97e1c4bf8feb342f2dfb60931a57d6469938f266b"} Nov 21 13:09:56 crc kubenswrapper[4769]: I1121 13:09:56.714113 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 13:09:57 crc kubenswrapper[4769]: I1121 13:09:57.447988 4769 generic.go:334] "Generic (PLEG): container finished" podID="294817fb-c857-4d11-9a12-23546ad1e93c" containerID="d180ac2119a9c9c91fd65d818a8dc57ed95e8640fa4206f7aa74e66bb5f2cbd8" exitCode=0 Nov 21 13:09:57 crc kubenswrapper[4769]: I1121 13:09:57.448083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"294817fb-c857-4d11-9a12-23546ad1e93c","Type":"ContainerDied","Data":"d180ac2119a9c9c91fd65d818a8dc57ed95e8640fa4206f7aa74e66bb5f2cbd8"} Nov 21 13:09:57 crc kubenswrapper[4769]: I1121 13:09:57.785868 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:09:57 crc kubenswrapper[4769]: I1121 13:09:57.787289 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="openstack-network-exporter" containerID="cri-o://7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701" gracePeriod=300 Nov 21 13:09:57 crc kubenswrapper[4769]: I1121 13:09:57.853948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="ovsdbserver-nb" containerID="cri-o://d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c" gracePeriod=300 Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.242581 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_bec1e4a8-03fa-4c5e-89d3-2c49de338969/ovsdbserver-nb/0.log" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.242657 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.381826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-combined-ca-bundle\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.381866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-metrics-certs-tls-certs\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.381929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-scripts\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.381948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c6cw\" (UniqueName: \"kubernetes.io/projected/bec1e4a8-03fa-4c5e-89d3-2c49de338969-kube-api-access-6c6cw\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.381984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-config\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.382080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.382139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdbserver-nb-tls-certs\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.382179 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdb-rundir\") pod \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\" (UID: \"bec1e4a8-03fa-4c5e-89d3-2c49de338969\") " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.382557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-scripts" (OuterVolumeSpecName: "scripts") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.382672 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.382730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-config" (OuterVolumeSpecName: "config") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.382735 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:09:58.882715697 +0000 UTC m=+4757.583377525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-public-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.382749 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.382810 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:09:58.882793079 +0000 UTC m=+4757.583454897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-internal-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.383038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.388499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec1e4a8-03fa-4c5e-89d3-2c49de338969-kube-api-access-6c6cw" (OuterVolumeSpecName: "kube-api-access-6c6cw") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "kube-api-access-6c6cw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.395010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.428942 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459767 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_bec1e4a8-03fa-4c5e-89d3-2c49de338969/ovsdbserver-nb/0.log" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459819 4769 generic.go:334] "Generic (PLEG): container finished" podID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerID="7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701" exitCode=2 Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459839 4769 generic.go:334] "Generic (PLEG): container finished" podID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerID="d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c" exitCode=143 Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"bec1e4a8-03fa-4c5e-89d3-2c49de338969","Type":"ContainerDied","Data":"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701"} Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"bec1e4a8-03fa-4c5e-89d3-2c49de338969","Type":"ContainerDied","Data":"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c"} Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"bec1e4a8-03fa-4c5e-89d3-2c49de338969","Type":"ContainerDied","Data":"b78fe5e34150e8bbaa8fb47342e0c53b59008d6589f062559b1dbc4293497035"} Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.459941 4769 scope.go:117] "RemoveContainer" containerID="7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.460086 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.467033 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"294817fb-c857-4d11-9a12-23546ad1e93c","Type":"ContainerStarted","Data":"35a27014b7bbefcddd074ae7ea1e912e548d4d18cd4e291e89cd2c0a2927042e"} Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.485634 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.485694 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.485709 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.485724 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.485737 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/bec1e4a8-03fa-4c5e-89d3-2c49de338969-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.485748 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6c6cw\" (UniqueName: \"kubernetes.io/projected/bec1e4a8-03fa-4c5e-89d3-2c49de338969-kube-api-access-6c6cw\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.497248 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=4.497231101 podStartE2EDuration="4.497231101s" podCreationTimestamp="2025-11-21 13:09:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:09:58.49459766 +0000 UTC m=+4757.195259478" watchObservedRunningTime="2025-11-21 13:09:58.497231101 +0000 UTC m=+4757.197892919" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.516731 4769 scope.go:117] "RemoveContainer" containerID="d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.527795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.535446 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "bec1e4a8-03fa-4c5e-89d3-2c49de338969" (UID: "bec1e4a8-03fa-4c5e-89d3-2c49de338969"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.553588 4769 scope.go:117] "RemoveContainer" containerID="7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701" Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.554004 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701\": container with ID starting with 7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701 not found: ID does not exist" containerID="7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.554057 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701"} err="failed to get container status \"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701\": rpc error: code = NotFound desc = could not find container \"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701\": container with ID starting with 7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701 not found: ID does not exist" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.554100 4769 scope.go:117] "RemoveContainer" containerID="d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c" Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.554906 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c\": container with ID starting with d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c not found: ID does not exist" containerID="d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.555039 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c"} err="failed to get container status \"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c\": rpc error: code = NotFound desc = could not find container \"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c\": container with ID starting with d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c not found: ID does not exist" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.555136 4769 scope.go:117] "RemoveContainer" containerID="7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.555627 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701"} err="failed to get container status \"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701\": rpc error: code = NotFound desc = could not find container \"7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701\": container with ID starting with 7a970fdc222541c218a4159fbcf49f1f32473283d139c825e47425513d5fc701 not found: ID does not exist" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.555733 4769 scope.go:117] "RemoveContainer" containerID="d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.556102 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c"} err="failed to get container status \"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c\": rpc error: code = NotFound desc = could not find container \"d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c\": container with ID starting with d5b0ea3a6610983eb25e97d0a39e5d2e10ee80e061facfa1a305c3326e11c10c not found: ID does not exist" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.566253 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.587991 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.588040 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bec1e4a8-03fa-4c5e-89d3-2c49de338969-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.588049 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.827270 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.843519 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.854774 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.855299 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="openstack-network-exporter" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.855317 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="openstack-network-exporter" Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.855340 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="ovsdbserver-nb" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.855346 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="ovsdbserver-nb" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.855531 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="ovsdbserver-nb" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.855547 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" containerName="openstack-network-exporter" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.856742 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.859069 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.859339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-pgj9p" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.859520 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.861787 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:09:58 crc kubenswrapper[4769]: I1121 13:09:58.873749 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.901416 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.901730 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:09:59.901707223 +0000 UTC m=+4758.602369061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-internal-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.901426 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:09:58 crc kubenswrapper[4769]: E1121 13:09:58.901960 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:09:59.90194859 +0000 UTC m=+4758.602610428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-public-svc" not found Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-config\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shfj7\" (UniqueName: \"kubernetes.io/projected/8f101464-9ac6-48d4-848f-d0c89472105f-kube-api-access-shfj7\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003522 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.003549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.106322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.106441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.106572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.106773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.106824 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.106985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.107301 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.107423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-config\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.107463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-shfj7\" (UniqueName: \"kubernetes.io/projected/8f101464-9ac6-48d4-848f-d0c89472105f-kube-api-access-shfj7\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.107769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.108355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-config\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.109110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.113745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.113770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.113832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.140944 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.140982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-shfj7\" (UniqueName: \"kubernetes.io/projected/8f101464-9ac6-48d4-848f-d0c89472105f-kube-api-access-shfj7\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.143739 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.148921 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.149117 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="galera" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.168070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.221483 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.299654 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec1e4a8-03fa-4c5e-89d3-2c49de338969" path="/var/lib/kubelet/pods/bec1e4a8-03fa-4c5e-89d3-2c49de338969/volumes" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.300485 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.300857 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="openstack-network-exporter" containerID="cri-o://b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78" gracePeriod=300 Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.392249 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="ovsdbserver-sb" containerID="cri-o://dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206" gracePeriod=300 Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.478636 4769 generic.go:334] "Generic (PLEG): container finished" podID="4952f86e-29ef-4153-b621-577be22af8ee" containerID="b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78" exitCode=2 Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.478718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"4952f86e-29ef-4153-b621-577be22af8ee","Type":"ContainerDied","Data":"b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78"} Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.697846 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.738265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.928490 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.928553 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.928877 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:10:01.928851503 +0000 UTC m=+4760.629513381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-internal-svc" not found Nov 21 13:09:59 crc kubenswrapper[4769]: E1121 13:09:59.928955 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:10:01.928930345 +0000 UTC m=+4760.629592163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-public-svc" not found Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.933390 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_4952f86e-29ef-4153-b621-577be22af8ee/ovsdbserver-sb/0.log" Nov 21 13:09:59 crc kubenswrapper[4769]: I1121 13:09:59.933490 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.029740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-metrics-certs-tls-certs\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.030721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-ovsdbserver-sb-tls-certs\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.030787 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-config\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.030815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzvhd\" (UniqueName: \"kubernetes.io/projected/4952f86e-29ef-4153-b621-577be22af8ee-kube-api-access-bzvhd\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.030841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-scripts\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.030893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4952f86e-29ef-4153-b621-577be22af8ee-ovsdb-rundir\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.030960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-combined-ca-bundle\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.031069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"4952f86e-29ef-4153-b621-577be22af8ee\" (UID: \"4952f86e-29ef-4153-b621-577be22af8ee\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.034148 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4952f86e-29ef-4153-b621-577be22af8ee-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.034669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-scripts" (OuterVolumeSpecName: "scripts") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.036245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-config" (OuterVolumeSpecName: "config") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.040160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.048064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4952f86e-29ef-4153-b621-577be22af8ee-kube-api-access-bzvhd" (OuterVolumeSpecName: "kube-api-access-bzvhd") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "kube-api-access-bzvhd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.070867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.136129 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.136153 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bzvhd\" (UniqueName: \"kubernetes.io/projected/4952f86e-29ef-4153-b621-577be22af8ee-kube-api-access-bzvhd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.136164 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4952f86e-29ef-4153-b621-577be22af8ee-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.136172 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4952f86e-29ef-4153-b621-577be22af8ee-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.136204 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.136234 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.139113 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.143629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "4952f86e-29ef-4153-b621-577be22af8ee" (UID: "4952f86e-29ef-4153-b621-577be22af8ee"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.169418 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.238701 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.239151 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.239300 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4952f86e-29ef-4153-b621-577be22af8ee-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.494531 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_4952f86e-29ef-4153-b621-577be22af8ee/ovsdbserver-sb/0.log" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.494595 4769 generic.go:334] "Generic (PLEG): container finished" podID="4952f86e-29ef-4153-b621-577be22af8ee" containerID="dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206" exitCode=143 Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.494709 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.494863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"4952f86e-29ef-4153-b621-577be22af8ee","Type":"ContainerDied","Data":"dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206"} Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.494965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"4952f86e-29ef-4153-b621-577be22af8ee","Type":"ContainerDied","Data":"6679d269ccade2f2de01a388d0df2bd2d99ddad01f7afbb4d812e6abfb3b03e0"} Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.495069 4769 scope.go:117] "RemoveContainer" containerID="b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.500584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"8f101464-9ac6-48d4-848f-d0c89472105f","Type":"ContainerStarted","Data":"0b3ae92b0c7d37bfc34422d5068cc9e9445a375fa2e038de30538d8e0f460f37"} Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.500623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"8f101464-9ac6-48d4-848f-d0c89472105f","Type":"ContainerStarted","Data":"9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824"} Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.500637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"8f101464-9ac6-48d4-848f-d0c89472105f","Type":"ContainerStarted","Data":"2131a52fe986e0d347ad49dcf56fd8bbf44228b7a27dcc262997581b9d0e71c6"} Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.531768 4769 scope.go:117] "RemoveContainer" containerID="dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.541063 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.541043369 podStartE2EDuration="2.541043369s" podCreationTimestamp="2025-11-21 13:09:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:00.53031558 +0000 UTC m=+4759.230977408" watchObservedRunningTime="2025-11-21 13:10:00.541043369 +0000 UTC m=+4759.241705197" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.579265 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.593852 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.603964 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:00 crc kubenswrapper[4769]: E1121 13:10:00.604444 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="openstack-network-exporter" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.604462 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="openstack-network-exporter" Nov 21 13:10:00 crc kubenswrapper[4769]: E1121 13:10:00.604492 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="ovsdbserver-sb" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.604499 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="ovsdbserver-sb" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.604682 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="ovsdbserver-sb" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.604707 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4952f86e-29ef-4153-b621-577be22af8ee" containerName="openstack-network-exporter" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.605678 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.607398 4769 scope.go:117] "RemoveContainer" containerID="b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78" Nov 21 13:10:00 crc kubenswrapper[4769]: E1121 13:10:00.607817 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78\": container with ID starting with b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78 not found: ID does not exist" containerID="b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.607853 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78"} err="failed to get container status \"b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78\": rpc error: code = NotFound desc = could not find container \"b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78\": container with ID starting with b2877d6bbc06136736e25886896703dff65b0f308d136f86ee9398dfde400a78 not found: ID does not exist" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.607879 4769 scope.go:117] "RemoveContainer" containerID="dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206" Nov 21 13:10:00 crc kubenswrapper[4769]: E1121 13:10:00.608098 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206\": container with ID starting with dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206 not found: ID does not exist" containerID="dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.608129 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206"} err="failed to get container status \"dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206\": rpc error: code = NotFound desc = could not find container \"dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206\": container with ID starting with dfa6a3c6648b7d8375294ac093bd2392a3407804fe6c8ae05a24b9c844ad9206 not found: ID does not exist" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.608204 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.608487 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-cgndj" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.609147 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.611662 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.617324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.653151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.653309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.653400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.653563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-config\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.654471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jhkk\" (UniqueName: \"kubernetes.io/projected/1486d261-3fdd-44ad-8dc7-2c8882e668e0-kube-api-access-6jhkk\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.654513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.654646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.655277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-config\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6jhkk\" (UniqueName: \"kubernetes.io/projected/1486d261-3fdd-44ad-8dc7-2c8882e668e0-kube-api-access-6jhkk\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.757795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.758626 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.760335 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-config\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.760467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.760633 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.770143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.786804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.794083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.796384 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jhkk\" (UniqueName: \"kubernetes.io/projected/1486d261-3fdd-44ad-8dc7-2c8882e668e0-kube-api-access-6jhkk\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.849487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.947256 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.983836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-galera-tls-certs\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.983906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-combined-ca-bundle\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.983970 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-operator-scripts\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.984037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-generated\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.984147 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-kolla-config\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.984249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57mlj\" (UniqueName: \"kubernetes.io/projected/6145220b-07ba-4cc8-8d16-392394c634b4-kube-api-access-57mlj\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.984280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.984311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-default\") pod \"6145220b-07ba-4cc8-8d16-392394c634b4\" (UID: \"6145220b-07ba-4cc8-8d16-392394c634b4\") " Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.985568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.985831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.987594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.989919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.992564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6145220b-07ba-4cc8-8d16-392394c634b4-kube-api-access-57mlj" (OuterVolumeSpecName: "kube-api-access-57mlj") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "kube-api-access-57mlj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:00 crc kubenswrapper[4769]: I1121 13:10:00.997297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.020372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.054035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "6145220b-07ba-4cc8-8d16-392394c634b4" (UID: "6145220b-07ba-4cc8-8d16-392394c634b4"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.067140 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.080989 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.081269 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="ovn-northd" containerID="cri-o://db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a" gracePeriod=30 Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.081387 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="openstack-network-exporter" containerID="cri-o://5cc3284e6ba0a8f3c784bd1e20d2ddd32cbcfbdfa8f2a81da74b3c1598e1325e" gracePeriod=30 Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086867 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086911 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6145220b-07ba-4cc8-8d16-392394c634b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086922 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086932 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086944 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086954 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-57mlj\" (UniqueName: \"kubernetes.io/projected/6145220b-07ba-4cc8-8d16-392394c634b4-kube-api-access-57mlj\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086976 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.086985 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6145220b-07ba-4cc8-8d16-392394c634b4-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.116383 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.189568 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.302952 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4952f86e-29ef-4153-b621-577be22af8ee" path="/var/lib/kubelet/pods/4952f86e-29ef-4153-b621-577be22af8ee/volumes" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.522940 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.524094 4769 generic.go:334] "Generic (PLEG): container finished" podID="6145220b-07ba-4cc8-8d16-392394c634b4" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" exitCode=0 Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.524299 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.524360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"6145220b-07ba-4cc8-8d16-392394c634b4","Type":"ContainerDied","Data":"33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b"} Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.524421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"6145220b-07ba-4cc8-8d16-392394c634b4","Type":"ContainerDied","Data":"7b9f74dabf755ce6bf81ae46dece95ad52f4f3676d9ab930bd46b802addc3be3"} Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.524445 4769 scope.go:117] "RemoveContainer" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" Nov 21 13:10:01 crc kubenswrapper[4769]: W1121 13:10:01.528150 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1486d261_3fdd_44ad_8dc7_2c8882e668e0.slice/crio-6331981c2534fce59b9d4c2a6188eff9a8741769a8158ca19f841b99ba0bdfa2 WatchSource:0}: Error finding container 6331981c2534fce59b9d4c2a6188eff9a8741769a8158ca19f841b99ba0bdfa2: Status 404 returned error can't find the container with id 6331981c2534fce59b9d4c2a6188eff9a8741769a8158ca19f841b99ba0bdfa2 Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.531990 4769 generic.go:334] "Generic (PLEG): container finished" podID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerID="5cc3284e6ba0a8f3c784bd1e20d2ddd32cbcfbdfa8f2a81da74b3c1598e1325e" exitCode=2 Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.532476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6222811e-baf2-451d-ac8f-d1e666f4e514","Type":"ContainerDied","Data":"5cc3284e6ba0a8f3c784bd1e20d2ddd32cbcfbdfa8f2a81da74b3c1598e1325e"} Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.571413 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.573053 4769 scope.go:117] "RemoveContainer" containerID="5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.588416 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.607292 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:01 crc kubenswrapper[4769]: E1121 13:10:01.607751 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="mysql-bootstrap" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.607770 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="mysql-bootstrap" Nov 21 13:10:01 crc kubenswrapper[4769]: E1121 13:10:01.607802 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="galera" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.607809 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="galera" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.607984 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" containerName="galera" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.609398 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.620600 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.623871 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.624071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ktmdt" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.624256 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.624574 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-generated\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-operator-scripts\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l58jr\" (UniqueName: \"kubernetes.io/projected/813a8fa8-2b10-49ef-b98c-cdc429588409-kube-api-access-l58jr\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700843 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-default\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.700946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-kolla-config\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.737009 4769 scope.go:117] "RemoveContainer" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" Nov 21 13:10:01 crc kubenswrapper[4769]: E1121 13:10:01.738115 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b\": container with ID starting with 33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b not found: ID does not exist" containerID="33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.738168 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b"} err="failed to get container status \"33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b\": rpc error: code = NotFound desc = could not find container \"33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b\": container with ID starting with 33a470ec414051b90860bea38555dc230848c18f8eb287e8d1da8a05c8c7e69b not found: ID does not exist" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.738222 4769 scope.go:117] "RemoveContainer" containerID="5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a" Nov 21 13:10:01 crc kubenswrapper[4769]: E1121 13:10:01.738648 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a\": container with ID starting with 5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a not found: ID does not exist" containerID="5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.738686 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a"} err="failed to get container status \"5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a\": rpc error: code = NotFound desc = could not find container \"5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a\": container with ID starting with 5a2b660ab903d1eb0b00a1a420385c20be5b4b0b8133087d91c75a40f9de699a not found: ID does not exist" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.802709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.802801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l58jr\" (UniqueName: \"kubernetes.io/projected/813a8fa8-2b10-49ef-b98c-cdc429588409-kube-api-access-l58jr\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.802869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-default\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.802996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-kolla-config\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.803094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.803208 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.803936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.803993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-generated\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.804094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-kolla-config\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.804114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-operator-scripts\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.804172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-default\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.804904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-generated\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.806596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-operator-scripts\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.825050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.825801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.827774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58jr\" (UniqueName: \"kubernetes.io/projected/813a8fa8-2b10-49ef-b98c-cdc429588409-kube-api-access-l58jr\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:01 crc kubenswrapper[4769]: I1121 13:10:01.847150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:02 crc kubenswrapper[4769]: E1121 13:10:02.006866 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:10:02 crc kubenswrapper[4769]: E1121 13:10:02.007375 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:10:06.007356115 +0000 UTC m=+4764.708017933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-internal-svc" not found Nov 21 13:10:02 crc kubenswrapper[4769]: E1121 13:10:02.008023 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:10:02 crc kubenswrapper[4769]: E1121 13:10:02.008071 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:10:06.008057614 +0000 UTC m=+4764.708719432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-public-svc" not found Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.085659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.223334 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.545957 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1486d261-3fdd-44ad-8dc7-2c8882e668e0","Type":"ContainerStarted","Data":"48998bda1fb8acdbd427740ccc12bc85ba1904e0f8affd592bea32b41ab14237"} Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.546021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1486d261-3fdd-44ad-8dc7-2c8882e668e0","Type":"ContainerStarted","Data":"c294267ea69e42cea00928adc9b9b52bcbd318388d14cf8be304d38333f21b9d"} Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.546039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1486d261-3fdd-44ad-8dc7-2c8882e668e0","Type":"ContainerStarted","Data":"6331981c2534fce59b9d4c2a6188eff9a8741769a8158ca19f841b99ba0bdfa2"} Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.595711 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.595686958 podStartE2EDuration="2.595686958s" podCreationTimestamp="2025-11-21 13:10:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:02.580518479 +0000 UTC m=+4761.281180327" watchObservedRunningTime="2025-11-21 13:10:02.595686958 +0000 UTC m=+4761.296348776" Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.625621 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:02 crc kubenswrapper[4769]: W1121 13:10:02.627223 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod813a8fa8_2b10_49ef_b98c_cdc429588409.slice/crio-3f7c8ecaec972b7da49f1e8d9f063cbb6593ffed613ad0f2e20331e5216b593d WatchSource:0}: Error finding container 3f7c8ecaec972b7da49f1e8d9f063cbb6593ffed613ad0f2e20331e5216b593d: Status 404 returned error can't find the container with id 3f7c8ecaec972b7da49f1e8d9f063cbb6593ffed613ad0f2e20331e5216b593d Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.709791 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" probeResult="failure" output="HTTP probe failed with statuscode: 500" Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.710379 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.711233 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cinder-scheduler" containerStatusID={"Type":"cri-o","ID":"51fd8e3831d48efa1564568c19a1e9850f88f95af140e12bda169fa31a6855d7"} pod="openstack-kuttl-tests/cinder-scheduler-0" containerMessage="Container cinder-scheduler failed liveness probe, will be restarted" Nov 21 13:10:02 crc kubenswrapper[4769]: I1121 13:10:02.711307 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" containerID="cri-o://51fd8e3831d48efa1564568c19a1e9850f88f95af140e12bda169fa31a6855d7" gracePeriod=30 Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.291019 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6145220b-07ba-4cc8-8d16-392394c634b4" path="/var/lib/kubelet/pods/6145220b-07ba-4cc8-8d16-392394c634b4/volumes" Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.560027 4769 generic.go:334] "Generic (PLEG): container finished" podID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerID="7bfabe64b58db48d6f6909baa3f0bc60ebe5850e7b21025073d7527441d78f73" exitCode=0 Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.560089 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"813a8fa8-2b10-49ef-b98c-cdc429588409","Type":"ContainerDied","Data":"7bfabe64b58db48d6f6909baa3f0bc60ebe5850e7b21025073d7527441d78f73"} Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.560155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"813a8fa8-2b10-49ef-b98c-cdc429588409","Type":"ContainerStarted","Data":"3f7c8ecaec972b7da49f1e8d9f063cbb6593ffed613ad0f2e20331e5216b593d"} Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.957982 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.960555 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-central-agent" containerID="cri-o://3e220a36fa9d819077f84712d7dedfa2481855a2e10a3d1ecb87157981096242" gracePeriod=30 Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.960681 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="proxy-httpd" containerID="cri-o://bb8e8d4434e7fcb78eca9fe7ff98490c76a42697d207ce2d28782c55bb2addf9" gracePeriod=30 Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.960723 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="sg-core" containerID="cri-o://ced88ab95b4468da6e88b7a415c25c316de3a9d662b4850e1dd49a8d950fde7f" gracePeriod=30 Nov 21 13:10:03 crc kubenswrapper[4769]: I1121 13:10:03.960755 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-notification-agent" containerID="cri-o://5a91d4d64e9bd672d925fc8d8e3da8463c35624b3858c061c4ebdb2f5ff8b912" gracePeriod=30 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.068703 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.101731 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.101929 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" containerName="memcached" containerID="cri-o://98139e6a8e29733e902f8cf7d136372fe32d44600bdbc461eee226216f8b9932" gracePeriod=30 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.171969 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.190931 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.191293 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-httpd" containerID="cri-o://f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436" gracePeriod=30 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.191455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-log" containerID="cri-o://b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56" gracePeriod=30 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.224220 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.303977 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.304213 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-log" containerID="cri-o://faaa6e9f854fa0504bbc4faf568136dd8c73c925ce7bbd0d9b8d4afc2cc3d66e" gracePeriod=30 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.304632 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-httpd" containerID="cri-o://618c6394b6f71ec340da52668c44606f16215359e0e5b885e2704e7e86e8a30e" gracePeriod=30 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.327866 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.111:3000/\": dial tcp 10.217.1.111:3000: connect: connection refused" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.449242 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-787f78dcf9-fpk6h"] Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.450523 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.466543 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-787f78dcf9-fpk6h"] Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.573222 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-combined-ca-bundle\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.573533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-config-data\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.573663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-public-tls-certs\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.573781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k28f9\" (UniqueName: \"kubernetes.io/projected/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-kube-api-access-k28f9\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.573915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-credential-keys\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.574031 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-scripts\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.574140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-internal-tls-certs\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.574583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-fernet-keys\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.592364 4769 generic.go:334] "Generic (PLEG): container finished" podID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerID="bb8e8d4434e7fcb78eca9fe7ff98490c76a42697d207ce2d28782c55bb2addf9" exitCode=0 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.592608 4769 generic.go:334] "Generic (PLEG): container finished" podID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerID="ced88ab95b4468da6e88b7a415c25c316de3a9d662b4850e1dd49a8d950fde7f" exitCode=2 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.592790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerDied","Data":"bb8e8d4434e7fcb78eca9fe7ff98490c76a42697d207ce2d28782c55bb2addf9"} Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.592892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerDied","Data":"ced88ab95b4468da6e88b7a415c25c316de3a9d662b4850e1dd49a8d950fde7f"} Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.604637 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"813a8fa8-2b10-49ef-b98c-cdc429588409","Type":"ContainerStarted","Data":"36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576"} Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.606848 4769 generic.go:334] "Generic (PLEG): container finished" podID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerID="faaa6e9f854fa0504bbc4faf568136dd8c73c925ce7bbd0d9b8d4afc2cc3d66e" exitCode=143 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.606924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f157e621-8379-4c96-b7dc-57fcdda5d0c4","Type":"ContainerDied","Data":"faaa6e9f854fa0504bbc4faf568136dd8c73c925ce7bbd0d9b8d4afc2cc3d66e"} Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.609970 4769 generic.go:334] "Generic (PLEG): container finished" podID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerID="b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56" exitCode=143 Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.610465 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"05f2ed02-a3b2-4013-a943-3700138b6b7e","Type":"ContainerDied","Data":"b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56"} Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.610955 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.676551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-combined-ca-bundle\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.676730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-config-data\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.676807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-public-tls-certs\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.676872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k28f9\" (UniqueName: \"kubernetes.io/projected/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-kube-api-access-k28f9\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.676981 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-credential-keys\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.677009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-scripts\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.677034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-internal-tls-certs\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.677068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-fernet-keys\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.683182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-combined-ca-bundle\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.683672 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-fernet-keys\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.683961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-credential-keys\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.685787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-internal-tls-certs\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.685836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-public-tls-certs\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.686066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-scripts\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.689251 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-config-data\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.708337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k28f9\" (UniqueName: \"kubernetes.io/projected/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-kube-api-access-k28f9\") pod \"keystone-787f78dcf9-fpk6h\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:04 crc kubenswrapper[4769]: I1121 13:10:04.792401 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.380923 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.402856 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.402905 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs podName:6b07ece4-f42b-4b10-9c27-51b2f210ff9c nodeName:}" failed. No retries permitted until 2025-11-21 13:10:05.902892344 +0000 UTC m=+4764.603554162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs") pod "placement-5cb98c4cd6-nfsfh" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c") : secret "cert-placement-public-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.403495 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.403519 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs podName:6b07ece4-f42b-4b10-9c27-51b2f210ff9c nodeName:}" failed. No retries permitted until 2025-11-21 13:10:05.90351157 +0000 UTC m=+4764.604173388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs") pod "placement-5cb98c4cd6-nfsfh" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c") : secret "cert-placement-internal-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.422218 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=4.422203344 podStartE2EDuration="4.422203344s" podCreationTimestamp="2025-11-21 13:10:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:04.635829357 +0000 UTC m=+4763.336491175" watchObservedRunningTime="2025-11-21 13:10:05.422203344 +0000 UTC m=+4764.122865162" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.459153 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.624310 4769 generic.go:334] "Generic (PLEG): container finished" podID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" containerID="98139e6a8e29733e902f8cf7d136372fe32d44600bdbc461eee226216f8b9932" exitCode=0 Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.624412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"250a479c-b739-45d3-b2e6-a1bcae7b6c5e","Type":"ContainerDied","Data":"98139e6a8e29733e902f8cf7d136372fe32d44600bdbc461eee226216f8b9932"} Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.627954 4769 generic.go:334] "Generic (PLEG): container finished" podID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerID="3e220a36fa9d819077f84712d7dedfa2481855a2e10a3d1ecb87157981096242" exitCode=0 Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.627988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerDied","Data":"3e220a36fa9d819077f84712d7dedfa2481855a2e10a3d1ecb87157981096242"} Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.694326 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.698739 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.699530 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-787f78dcf9-fpk6h"] Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.700208 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.700292 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="ovn-northd" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.709480 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.709531 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.730005 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" containerName="memcached" probeResult="failure" output="dial tcp 10.217.1.31:11211: connect: connection refused" Nov 21 13:10:05 crc kubenswrapper[4769]: I1121 13:10:05.840784 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.916032 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.916138 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs podName:6b07ece4-f42b-4b10-9c27-51b2f210ff9c nodeName:}" failed. No retries permitted until 2025-11-21 13:10:06.916113985 +0000 UTC m=+4765.616775883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs") pod "placement-5cb98c4cd6-nfsfh" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c") : secret "cert-placement-public-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.916135 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:10:05 crc kubenswrapper[4769]: E1121 13:10:05.916204 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs podName:6b07ece4-f42b-4b10-9c27-51b2f210ff9c nodeName:}" failed. No retries permitted until 2025-11-21 13:10:06.916177266 +0000 UTC m=+4765.616839084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs") pod "placement-5cb98c4cd6-nfsfh" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c") : secret "cert-placement-internal-svc" not found Nov 21 13:10:06 crc kubenswrapper[4769]: E1121 13:10:06.030851 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:10:06 crc kubenswrapper[4769]: E1121 13:10:06.031340 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:10:14.031321137 +0000 UTC m=+4772.731982955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-public-svc" not found Nov 21 13:10:06 crc kubenswrapper[4769]: E1121 13:10:06.031744 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:10:06 crc kubenswrapper[4769]: E1121 13:10:06.031776 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs podName:491af14f-6c9a-4c2a-8d91-bea7d7735b8b nodeName:}" failed. No retries permitted until 2025-11-21 13:10:14.031766689 +0000 UTC m=+4772.732428507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs") pod "barbican-api-7ff6cb4844-z2dlq" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b") : secret "cert-barbican-internal-svc" not found Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.114351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.285171 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.348375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kolla-config\") pod \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.348491 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-memcached-tls-certs\") pod \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.348556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfhvx\" (UniqueName: \"kubernetes.io/projected/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kube-api-access-wfhvx\") pod \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.348696 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-combined-ca-bundle\") pod \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.348722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-config-data\") pod \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\" (UID: \"250a479c-b739-45d3-b2e6-a1bcae7b6c5e\") " Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.348869 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "250a479c-b739-45d3-b2e6-a1bcae7b6c5e" (UID: "250a479c-b739-45d3-b2e6-a1bcae7b6c5e"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.349297 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.350412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-config-data" (OuterVolumeSpecName: "config-data") pod "250a479c-b739-45d3-b2e6-a1bcae7b6c5e" (UID: "250a479c-b739-45d3-b2e6-a1bcae7b6c5e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.356227 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kube-api-access-wfhvx" (OuterVolumeSpecName: "kube-api-access-wfhvx") pod "250a479c-b739-45d3-b2e6-a1bcae7b6c5e" (UID: "250a479c-b739-45d3-b2e6-a1bcae7b6c5e"). InnerVolumeSpecName "kube-api-access-wfhvx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.384473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "250a479c-b739-45d3-b2e6-a1bcae7b6c5e" (UID: "250a479c-b739-45d3-b2e6-a1bcae7b6c5e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.430606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "250a479c-b739-45d3-b2e6-a1bcae7b6c5e" (UID: "250a479c-b739-45d3-b2e6-a1bcae7b6c5e"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.451216 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.451252 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wfhvx\" (UniqueName: \"kubernetes.io/projected/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-kube-api-access-wfhvx\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.451262 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:06 crc kubenswrapper[4769]: I1121 13:10:06.451271 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/250a479c-b739-45d3-b2e6-a1bcae7b6c5e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.639265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"250a479c-b739-45d3-b2e6-a1bcae7b6c5e","Type":"ContainerDied","Data":"fe1dbf377aba49990d52738db1cbc7ba379921d655a6721b2e7afc8d9c3197fe"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.639274 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.642624 4769 scope.go:117] "RemoveContainer" containerID="98139e6a8e29733e902f8cf7d136372fe32d44600bdbc461eee226216f8b9932" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.644606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" event={"ID":"6b787f72-180e-4e93-bcd9-ea0185a4d6d8","Type":"ContainerStarted","Data":"d95224c39d2e18fe8d01b1b884a95a32a76c453ffaee51ec40ac31199f6c21fb"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.644646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" event={"ID":"6b787f72-180e-4e93-bcd9-ea0185a4d6d8","Type":"ContainerStarted","Data":"caf7d55f9de41b63fbfc71255d7c46e796e9cc9a5e2cb336a4f4fa49eb212714"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.645023 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.654575 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6222811e-baf2-451d-ac8f-d1e666f4e514/ovn-northd/0.log" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.654637 4769 generic.go:334] "Generic (PLEG): container finished" podID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerID="db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a" exitCode=139 Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.655122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6222811e-baf2-451d-ac8f-d1e666f4e514","Type":"ContainerDied","Data":"db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.667899 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" podStartSLOduration=2.6678831179999998 podStartE2EDuration="2.667883118s" podCreationTimestamp="2025-11-21 13:10:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:06.662912564 +0000 UTC m=+4765.363574382" watchObservedRunningTime="2025-11-21 13:10:06.667883118 +0000 UTC m=+4765.368544926" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.736635 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.810481 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.823098 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.830799 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:06.831247 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" containerName="memcached" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.831259 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" containerName="memcached" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.831473 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" containerName="memcached" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.832098 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.838056 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.838274 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-p5kzh" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.838821 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.840552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.958570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-memcached-tls-certs\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.958620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-config-data\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.958976 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-kolla-config\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.959172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-combined-ca-bundle\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:06.959346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzk9l\" (UniqueName: \"kubernetes.io/projected/39098700-4859-439d-a783-c9867fc7bcce-kube-api-access-wzk9l\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:06.959544 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:06.959588 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs podName:6b07ece4-f42b-4b10-9c27-51b2f210ff9c nodeName:}" failed. No retries permitted until 2025-11-21 13:10:08.959575503 +0000 UTC m=+4767.660237321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs") pod "placement-5cb98c4cd6-nfsfh" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c") : secret "cert-placement-public-svc" not found Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.061246 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-kolla-config\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.061657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-combined-ca-bundle\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.061723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wzk9l\" (UniqueName: \"kubernetes.io/projected/39098700-4859-439d-a783-c9867fc7bcce-kube-api-access-wzk9l\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.061776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-memcached-tls-certs\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.061794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-config-data\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.063320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-config-data\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.063724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-kolla-config\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.181077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-memcached-tls-certs\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.186832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-combined-ca-bundle\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.187995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzk9l\" (UniqueName: \"kubernetes.io/projected/39098700-4859-439d-a783-c9867fc7bcce-kube-api-access-wzk9l\") pod \"memcached-0\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.271204 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6222811e-baf2-451d-ac8f-d1e666f4e514/ovn-northd/0.log" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.271267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.289717 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="250a479c-b739-45d3-b2e6-a1bcae7b6c5e" path="/var/lib/kubelet/pods/250a479c-b739-45d3-b2e6-a1bcae7b6c5e/volumes" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-config\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzzz4\" (UniqueName: \"kubernetes.io/projected/6222811e-baf2-451d-ac8f-d1e666f4e514-kube-api-access-pzzz4\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-northd-tls-certs\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-rundir\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-metrics-certs-tls-certs\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-scripts\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.366938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-combined-ca-bundle\") pod \"6222811e-baf2-451d-ac8f-d1e666f4e514\" (UID: \"6222811e-baf2-451d-ac8f-d1e666f4e514\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.367444 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.367654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-config" (OuterVolumeSpecName: "config") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.367703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-scripts" (OuterVolumeSpecName: "scripts") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.368061 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.368109 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6222811e-baf2-451d-ac8f-d1e666f4e514-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.368127 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.370854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6222811e-baf2-451d-ac8f-d1e666f4e514-kube-api-access-pzzz4" (OuterVolumeSpecName: "kube-api-access-pzzz4") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "kube-api-access-pzzz4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.421452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.453481 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.465500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.470824 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.470859 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.470874 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pzzz4\" (UniqueName: \"kubernetes.io/projected/6222811e-baf2-451d-ac8f-d1e666f4e514-kube-api-access-pzzz4\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.494310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6222811e-baf2-451d-ac8f-d1e666f4e514" (UID: "6222811e-baf2-451d-ac8f-d1e666f4e514"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.574947 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6222811e-baf2-451d-ac8f-d1e666f4e514-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.689467 4769 generic.go:334] "Generic (PLEG): container finished" podID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerID="5a91d4d64e9bd672d925fc8d8e3da8463c35624b3858c061c4ebdb2f5ff8b912" exitCode=0 Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.689564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerDied","Data":"5a91d4d64e9bd672d925fc8d8e3da8463c35624b3858c061c4ebdb2f5ff8b912"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.695528 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6222811e-baf2-451d-ac8f-d1e666f4e514/ovn-northd/0.log" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.695610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6222811e-baf2-451d-ac8f-d1e666f4e514","Type":"ContainerDied","Data":"ba231d0edb8a6fb6963050ea02e3ee135c1057ee55fb62a856cda9ed9312f14e"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.695647 4769 scope.go:117] "RemoveContainer" containerID="5cc3284e6ba0a8f3c784bd1e20d2ddd32cbcfbdfa8f2a81da74b3c1598e1325e" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.695749 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.729607 4769 generic.go:334] "Generic (PLEG): container finished" podID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerID="618c6394b6f71ec340da52668c44606f16215359e0e5b885e2704e7e86e8a30e" exitCode=0 Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.729683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f157e621-8379-4c96-b7dc-57fcdda5d0c4","Type":"ContainerDied","Data":"618c6394b6f71ec340da52668c44606f16215359e0e5b885e2704e7e86e8a30e"} Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.866854 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.871224 4769 scope.go:117] "RemoveContainer" containerID="db865370d5284e4adc11356a4bae4b89582b5574b119417f44cc1c90a9a89e5a" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.873677 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.890285 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.910160 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:07.910994 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-central-agent" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911007 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-central-agent" Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:07.911059 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="proxy-httpd" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911066 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="proxy-httpd" Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:07.911091 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="ovn-northd" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="ovn-northd" Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:07.911138 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-notification-agent" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911145 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-notification-agent" Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:07.911154 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="sg-core" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911159 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="sg-core" Nov 21 13:10:07 crc kubenswrapper[4769]: E1121 13:10:07.911173 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="openstack-network-exporter" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911178 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="openstack-network-exporter" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911421 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-notification-agent" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911463 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="openstack-network-exporter" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911479 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" containerName="ovn-northd" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911487 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="sg-core" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911498 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="proxy-httpd" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.911528 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" containerName="ceilometer-central-agent" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.912992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.924878 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.925004 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.925046 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.925226 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-bfttk" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.933996 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.946677 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7f99cd444b-5ml4j"] Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.955432 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-combined-ca-bundle\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-log-httpd\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-ceilometer-tls-certs\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982749 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-sg-core-conf-yaml\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-run-httpd\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-config-data\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrpp7\" (UniqueName: \"kubernetes.io/projected/96dfbc55-a61b-4afd-980e-6f39834b9b46-kube-api-access-lrpp7\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.982918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-scripts\") pod \"96dfbc55-a61b-4afd-980e-6f39834b9b46\" (UID: \"96dfbc55-a61b-4afd-980e-6f39834b9b46\") " Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-combined-ca-bundle\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-internal-tls-certs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2nqp\" (UniqueName: \"kubernetes.io/projected/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-kube-api-access-b2nqp\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983535 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-config-data\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-scripts\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xswl\" (UniqueName: \"kubernetes.io/projected/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-kube-api-access-6xswl\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-scripts\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-config\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-logs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983752 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.983808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-public-tls-certs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.985711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:07 crc kubenswrapper[4769]: I1121 13:10:07.986220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.029858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-scripts" (OuterVolumeSpecName: "scripts") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.060707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96dfbc55-a61b-4afd-980e-6f39834b9b46-kube-api-access-lrpp7" (OuterVolumeSpecName: "kube-api-access-lrpp7") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "kube-api-access-lrpp7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.081413 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7f99cd444b-5ml4j"] Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.087401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.092764 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.092892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-public-tls-certs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.102540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.102594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-combined-ca-bundle\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.102656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-internal-tls-certs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.106907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.106952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.106978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b2nqp\" (UniqueName: \"kubernetes.io/projected/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-kube-api-access-b2nqp\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.107001 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-config-data\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.107056 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-scripts\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.107085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6xswl\" (UniqueName: \"kubernetes.io/projected/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-kube-api-access-6xswl\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113337 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-scripts\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113404 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-config\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-logs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113620 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113636 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113650 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lrpp7\" (UniqueName: \"kubernetes.io/projected/96dfbc55-a61b-4afd-980e-6f39834b9b46-kube-api-access-lrpp7\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113662 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.113674 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96dfbc55-a61b-4afd-980e-6f39834b9b46-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.114064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-logs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.114685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.119136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.119201 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-config-data\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.119951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-public-tls-certs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.120026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-scripts\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.120226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-config\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.122268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.122699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.127038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-scripts\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.133014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2nqp\" (UniqueName: \"kubernetes.io/projected/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-kube-api-access-b2nqp\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.135868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-internal-tls-certs\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.142846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-combined-ca-bundle\") pod \"placement-7f99cd444b-5ml4j\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.146414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xswl\" (UniqueName: \"kubernetes.io/projected/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-kube-api-access-6xswl\") pod \"ovn-northd-0\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.149923 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.156364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.161766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.195613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-config-data" (OuterVolumeSpecName: "config-data") pod "96dfbc55-a61b-4afd-980e-6f39834b9b46" (UID: "96dfbc55-a61b-4afd-980e-6f39834b9b46"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.214746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t6kg\" (UniqueName: \"kubernetes.io/projected/f157e621-8379-4c96-b7dc-57fcdda5d0c4-kube-api-access-5t6kg\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215024 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-scripts\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215101 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-combined-ca-bundle\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-logs\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-config-data\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-httpd-run\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-combined-ca-bundle\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215607 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-httpd-run\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-scripts\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-public-tls-certs\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbjxx\" (UniqueName: \"kubernetes.io/projected/05f2ed02-a3b2-4013-a943-3700138b6b7e-kube-api-access-mbjxx\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.215960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-config-data\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.216065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.216132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-logs\") pod \"05f2ed02-a3b2-4013-a943-3700138b6b7e\" (UID: \"05f2ed02-a3b2-4013-a943-3700138b6b7e\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.216231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.216318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-internal-tls-certs\") pod \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\" (UID: \"f157e621-8379-4c96-b7dc-57fcdda5d0c4\") " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.216760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.216970 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.217106 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.217169 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.217244 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.217300 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.217370 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96dfbc55-a61b-4afd-980e-6f39834b9b46-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.217288 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-logs" (OuterVolumeSpecName: "logs") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.219604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-scripts" (OuterVolumeSpecName: "scripts") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.220398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.221780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.225364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-logs" (OuterVolumeSpecName: "logs") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.229580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-scripts" (OuterVolumeSpecName: "scripts") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.233442 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f2ed02-a3b2-4013-a943-3700138b6b7e-kube-api-access-mbjxx" (OuterVolumeSpecName: "kube-api-access-mbjxx") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "kube-api-access-mbjxx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.242449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f157e621-8379-4c96-b7dc-57fcdda5d0c4-kube-api-access-5t6kg" (OuterVolumeSpecName: "kube-api-access-5t6kg") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "kube-api-access-5t6kg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.260344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.268306 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.269935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.284441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.298647 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.305826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-config-data" (OuterVolumeSpecName: "config-data") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.309999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-config-data" (OuterVolumeSpecName: "config-data") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.310447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "05f2ed02-a3b2-4013-a943-3700138b6b7e" (UID: "05f2ed02-a3b2-4013-a943-3700138b6b7e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.310532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f157e621-8379-4c96-b7dc-57fcdda5d0c4" (UID: "f157e621-8379-4c96-b7dc-57fcdda5d0c4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318727 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318752 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318764 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mbjxx\" (UniqueName: \"kubernetes.io/projected/05f2ed02-a3b2-4013-a943-3700138b6b7e-kube-api-access-mbjxx\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318773 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318794 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318803 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05f2ed02-a3b2-4013-a943-3700138b6b7e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318815 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318824 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318833 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5t6kg\" (UniqueName: \"kubernetes.io/projected/f157e621-8379-4c96-b7dc-57fcdda5d0c4-kube-api-access-5t6kg\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318841 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318849 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f157e621-8379-4c96-b7dc-57fcdda5d0c4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318858 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f157e621-8379-4c96-b7dc-57fcdda5d0c4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318868 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.318881 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05f2ed02-a3b2-4013-a943-3700138b6b7e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.340331 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.342680 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.421329 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.421678 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.759686 4769 generic.go:334] "Generic (PLEG): container finished" podID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerID="51fd8e3831d48efa1564568c19a1e9850f88f95af140e12bda169fa31a6855d7" exitCode=0 Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.760108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerDied","Data":"51fd8e3831d48efa1564568c19a1e9850f88f95af140e12bda169fa31a6855d7"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.775572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f157e621-8379-4c96-b7dc-57fcdda5d0c4","Type":"ContainerDied","Data":"d3cd3f9df8fde2609f0cdaa200c852331a270c96d66c56b137f2fef9247f5fa2"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.775621 4769 scope.go:117] "RemoveContainer" containerID="618c6394b6f71ec340da52668c44606f16215359e0e5b885e2704e7e86e8a30e" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.775750 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.797095 4769 generic.go:334] "Generic (PLEG): container finished" podID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerID="f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436" exitCode=0 Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.797206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"05f2ed02-a3b2-4013-a943-3700138b6b7e","Type":"ContainerDied","Data":"f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.797232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"05f2ed02-a3b2-4013-a943-3700138b6b7e","Type":"ContainerDied","Data":"8af84cb3f1cfbf684d942b65726f1099dd3d78093ef7056bc57f39d0e6b849c7"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.797298 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.832787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"39098700-4859-439d-a783-c9867fc7bcce","Type":"ContainerStarted","Data":"7f8c35933458931eadb2725a167371798e62f1201feaa4bd4c65d6c2775bda89"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.832833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"39098700-4859-439d-a783-c9867fc7bcce","Type":"ContainerStarted","Data":"1bc0ddd0acc4697ef9089b265a3ef36c962b9b28894410b79a3dc7bbb0c74925"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.832867 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.839982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.852738 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7f99cd444b-5ml4j"] Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.871815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"96dfbc55-a61b-4afd-980e-6f39834b9b46","Type":"ContainerDied","Data":"74b959cc5008142e8bf2debe6b1ca1ea91dddf649500b6e03bf5a0caca8a5972"} Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.871920 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:08 crc kubenswrapper[4769]: I1121 13:10:08.874454 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.874442969 podStartE2EDuration="2.874442969s" podCreationTimestamp="2025-11-21 13:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:08.863274969 +0000 UTC m=+4767.563936787" watchObservedRunningTime="2025-11-21 13:10:08.874442969 +0000 UTC m=+4767.575104787" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.011309 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.036066 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.051240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.068949 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.078490 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: E1121 13:10:09.078965 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-log" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.078978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-log" Nov 21 13:10:09 crc kubenswrapper[4769]: E1121 13:10:09.078997 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-httpd" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079003 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-httpd" Nov 21 13:10:09 crc kubenswrapper[4769]: E1121 13:10:09.079023 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-httpd" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079029 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-httpd" Nov 21 13:10:09 crc kubenswrapper[4769]: E1121 13:10:09.079037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-log" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079042 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-log" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079238 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-log" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079252 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" containerName="glance-httpd" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079267 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-httpd" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.079274 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" containerName="glance-log" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.080870 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.086829 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.091170 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.091421 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.091551 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.097845 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.105387 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.107039 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.109817 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.110041 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.115700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.115924 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-x7k8k" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.130137 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-scripts\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9njm\" (UniqueName: \"kubernetes.io/projected/a42113d3-c795-4552-b3ef-77094804c28b-kube-api-access-x9njm\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-run-httpd\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-log-httpd\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.136887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-config-data\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.142928 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.144972 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.147432 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.147614 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.154387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.170564 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-logs\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hlv\" (UniqueName: \"kubernetes.io/projected/47ccb784-6503-4ea9-b097-28db6c8fb25b-kube-api-access-f8hlv\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-config-data\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-scripts\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.239972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-scripts\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240120 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x9njm\" (UniqueName: \"kubernetes.io/projected/a42113d3-c795-4552-b3ef-77094804c28b-kube-api-access-x9njm\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-logs\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240233 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5gfm\" (UniqueName: \"kubernetes.io/projected/e6db24c5-2c0f-4034-93c9-d7cde95605ba-kube-api-access-d5gfm\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-run-httpd\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-config-data\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-log-httpd\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.240664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.242690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-run-httpd\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.243793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-log-httpd\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.247599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.247714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.249143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-scripts\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.251982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.256012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-config-data\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.267009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9njm\" (UniqueName: \"kubernetes.io/projected/a42113d3-c795-4552-b3ef-77094804c28b-kube-api-access-x9njm\") pod \"ceilometer-0\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.303970 4769 scope.go:117] "RemoveContainer" containerID="faaa6e9f854fa0504bbc4faf568136dd8c73c925ce7bbd0d9b8d4afc2cc3d66e" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.311118 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f2ed02-a3b2-4013-a943-3700138b6b7e" path="/var/lib/kubelet/pods/05f2ed02-a3b2-4013-a943-3700138b6b7e/volumes" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.315794 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6222811e-baf2-451d-ac8f-d1e666f4e514" path="/var/lib/kubelet/pods/6222811e-baf2-451d-ac8f-d1e666f4e514/volumes" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.327328 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96dfbc55-a61b-4afd-980e-6f39834b9b46" path="/var/lib/kubelet/pods/96dfbc55-a61b-4afd-980e-6f39834b9b46/volumes" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.351621 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f157e621-8379-4c96-b7dc-57fcdda5d0c4" path="/var/lib/kubelet/pods/f157e621-8379-4c96-b7dc-57fcdda5d0c4/volumes" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.358234 4769 scope.go:117] "RemoveContainer" containerID="f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.387963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.388045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-logs\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.388078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.388129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.388174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d5gfm\" (UniqueName: \"kubernetes.io/projected/e6db24c5-2c0f-4034-93c9-d7cde95605ba-kube-api-access-d5gfm\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.388235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.388257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389064 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-config-data\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389232 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-logs\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hlv\" (UniqueName: \"kubernetes.io/projected/47ccb784-6503-4ea9-b097-28db6c8fb25b-kube-api-access-f8hlv\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-scripts\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.389460 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.390243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-logs\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.390727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.394744 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.395067 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.396497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.401078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-scripts\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.402610 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.403532 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-logs\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.405930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.406589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.406590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-config-data\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.410676 4769 scope.go:117] "RemoveContainer" containerID="b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.410811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.420787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.423864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hlv\" (UniqueName: \"kubernetes.io/projected/47ccb784-6503-4ea9-b097-28db6c8fb25b-kube-api-access-f8hlv\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.429972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5gfm\" (UniqueName: \"kubernetes.io/projected/e6db24c5-2c0f-4034-93c9-d7cde95605ba-kube-api-access-d5gfm\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.431982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.435733 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.453367 4769 scope.go:117] "RemoveContainer" containerID="f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436" Nov 21 13:10:09 crc kubenswrapper[4769]: E1121 13:10:09.455386 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436\": container with ID starting with f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436 not found: ID does not exist" containerID="f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.455428 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436"} err="failed to get container status \"f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436\": rpc error: code = NotFound desc = could not find container \"f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436\": container with ID starting with f30f5448f0d5658eb739f96ac3ae7fd931eaae72d6d3abd5bfee632000b7f436 not found: ID does not exist" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.455452 4769 scope.go:117] "RemoveContainer" containerID="b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56" Nov 21 13:10:09 crc kubenswrapper[4769]: E1121 13:10:09.456400 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56\": container with ID starting with b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56 not found: ID does not exist" containerID="b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.456463 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56"} err="failed to get container status \"b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56\": rpc error: code = NotFound desc = could not find container \"b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56\": container with ID starting with b88e7c2077d03bf703f6dea4f64af6ca9fab77174c840c5aff1f73b71e8fdf56 not found: ID does not exist" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.456497 4769 scope.go:117] "RemoveContainer" containerID="bb8e8d4434e7fcb78eca9fe7ff98490c76a42697d207ce2d28782c55bb2addf9" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.474217 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.476939 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.477458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.490399 4769 scope.go:117] "RemoveContainer" containerID="ced88ab95b4468da6e88b7a415c25c316de3a9d662b4850e1dd49a8d950fde7f" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.541676 4769 scope.go:117] "RemoveContainer" containerID="5a91d4d64e9bd672d925fc8d8e3da8463c35624b3858c061c4ebdb2f5ff8b912" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.594638 4769 scope.go:117] "RemoveContainer" containerID="3e220a36fa9d819077f84712d7dedfa2481855a2e10a3d1ecb87157981096242" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.773456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.860447 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.913465 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"47ccb784-6503-4ea9-b097-28db6c8fb25b","Type":"ContainerStarted","Data":"ac3671b249ddcc8a13d94ee992ea074bda7b309f9b8e66d7a443e864449ef560"} Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.920529 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" event={"ID":"89da9de0-4b00-4ae1-a996-a9e9305ae1d7","Type":"ContainerStarted","Data":"5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81"} Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.920585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" event={"ID":"89da9de0-4b00-4ae1-a996-a9e9305ae1d7","Type":"ContainerStarted","Data":"7085214baebcb31aed065e1aa04c78b5b8aa229e420f6fb36e411b88188984ff"} Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.938783 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerStarted","Data":"77638a49b42c7b2e1d004ebe4a18219687776b3d561e7fc5eeed45b1604c04ad"} Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.950269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33","Type":"ContainerStarted","Data":"a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c"} Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.950310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33","Type":"ContainerStarted","Data":"237d8f3698a71efce53eacf17db0182a6732daeb3d2632cbbf4621c426275951"} Nov 21 13:10:09 crc kubenswrapper[4769]: I1121 13:10:09.986927 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.297730 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:10 crc kubenswrapper[4769]: W1121 13:10:10.313621 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6db24c5_2c0f_4034_93c9_d7cde95605ba.slice/crio-7112e256a6471e5637957a84a445d8624fea155be4d22888ddc869365672938f WatchSource:0}: Error finding container 7112e256a6471e5637957a84a445d8624fea155be4d22888ddc869365672938f: Status 404 returned error can't find the container with id 7112e256a6471e5637957a84a445d8624fea155be4d22888ddc869365672938f Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.962344 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33","Type":"ContainerStarted","Data":"897a1af3649915f08a7ae9b1d676845e372af7765e3237f17f4a369729200330"} Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.962802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.964594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e6db24c5-2c0f-4034-93c9-d7cde95605ba","Type":"ContainerStarted","Data":"7112e256a6471e5637957a84a445d8624fea155be4d22888ddc869365672938f"} Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.968228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"47ccb784-6503-4ea9-b097-28db6c8fb25b","Type":"ContainerStarted","Data":"cb3923d25f99d933be32dc55d82648d548e91b6407688fcb0700212da6e727b1"} Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.977293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" event={"ID":"89da9de0-4b00-4ae1-a996-a9e9305ae1d7","Type":"ContainerStarted","Data":"7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225"} Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.977347 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.977364 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.981426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerStarted","Data":"32dba385a6291c4fcb9077039705a3f966b6fa1a9e16d8c9126d27f8627b95a3"} Nov 21 13:10:10 crc kubenswrapper[4769]: I1121 13:10:10.982712 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.982700582 podStartE2EDuration="3.982700582s" podCreationTimestamp="2025-11-21 13:10:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:10.98227669 +0000 UTC m=+4769.682938538" watchObservedRunningTime="2025-11-21 13:10:10.982700582 +0000 UTC m=+4769.683362400" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.014148 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" podStartSLOduration=4.014128168 podStartE2EDuration="4.014128168s" podCreationTimestamp="2025-11-21 13:10:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:11.013937523 +0000 UTC m=+4769.714599331" watchObservedRunningTime="2025-11-21 13:10:11.014128168 +0000 UTC m=+4769.714789986" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.432368 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6"] Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.434725 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.439753 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6"] Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.532838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.532960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data-custom\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.532983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-public-tls-certs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.533008 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-logs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.533032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-internal-tls-certs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.533090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-combined-ca-bundle\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.533134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w872v\" (UniqueName: \"kubernetes.io/projected/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-kube-api-access-w872v\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.634603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data-custom\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.634892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-public-tls-certs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.634921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-logs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.635427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-internal-tls-certs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.635438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-logs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.635578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-combined-ca-bundle\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.635707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w872v\" (UniqueName: \"kubernetes.io/projected/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-kube-api-access-w872v\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.635788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.639064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data-custom\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.639483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.639854 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-public-tls-certs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.641642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-internal-tls-certs\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.651236 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-combined-ca-bundle\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.652000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w872v\" (UniqueName: \"kubernetes.io/projected/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-kube-api-access-w872v\") pod \"barbican-api-cf45fdbd4-qcsd6\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.759118 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:11 crc kubenswrapper[4769]: I1121 13:10:11.995562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"47ccb784-6503-4ea9-b097-28db6c8fb25b","Type":"ContainerStarted","Data":"4fbb2110cc107d67bf9a75444de10b1988f7775f90f500070f6fff7082cb1538"} Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.002640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e6db24c5-2c0f-4034-93c9-d7cde95605ba","Type":"ContainerStarted","Data":"e9c3760b3340a8f5225e25164f4a7becd07ce0c5e96e490e6ec0d1f0d873fcfd"} Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.002684 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e6db24c5-2c0f-4034-93c9-d7cde95605ba","Type":"ContainerStarted","Data":"a7458b92fbfea5394d07612e2f11871fcb7c3088206fe41432ca27127eb0ba08"} Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.035761 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.035740809 podStartE2EDuration="3.035740809s" podCreationTimestamp="2025-11-21 13:10:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:12.024430555 +0000 UTC m=+4770.725092393" watchObservedRunningTime="2025-11-21 13:10:12.035740809 +0000 UTC m=+4770.736402627" Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.064244 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.064221836 podStartE2EDuration="3.064221836s" podCreationTimestamp="2025-11-21 13:10:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:12.05099144 +0000 UTC m=+4770.751653278" watchObservedRunningTime="2025-11-21 13:10:12.064221836 +0000 UTC m=+4770.764883674" Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.086292 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.086342 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.156832 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:12 crc kubenswrapper[4769]: I1121 13:10:12.224397 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6"] Nov 21 13:10:12 crc kubenswrapper[4769]: W1121 13:10:12.227572 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode57a77a1_67d5_4ffd_b7d6_58eb0aa40b44.slice/crio-c6ba7e83fb1a942f6b40793badf36831ad762617ffde89ae8b792994e3b5d89f WatchSource:0}: Error finding container c6ba7e83fb1a942f6b40793badf36831ad762617ffde89ae8b792994e3b5d89f: Status 404 returned error can't find the container with id c6ba7e83fb1a942f6b40793badf36831ad762617ffde89ae8b792994e3b5d89f Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.012214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerStarted","Data":"10ab10ccdd652346bb0224d390acd267d226a1f32bd19924396d40d7bf78e3a8"} Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.014305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" event={"ID":"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44","Type":"ContainerStarted","Data":"cfed229987ebde7e17bf4f1a499869f53af3ef4ff549445cc5ef7364efbb1e99"} Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.014362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" event={"ID":"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44","Type":"ContainerStarted","Data":"23c203dfa8a6a64d620f64078b1238c64be721c1942ca5179fed636fcb886e28"} Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.014375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" event={"ID":"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44","Type":"ContainerStarted","Data":"c6ba7e83fb1a942f6b40793badf36831ad762617ffde89ae8b792994e3b5d89f"} Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.014748 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.014953 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.113421 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:13 crc kubenswrapper[4769]: I1121 13:10:13.141078 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" podStartSLOduration=2.141056815 podStartE2EDuration="2.141056815s" podCreationTimestamp="2025-11-21 13:10:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:13.043492118 +0000 UTC m=+4771.744153936" watchObservedRunningTime="2025-11-21 13:10:13.141056815 +0000 UTC m=+4771.841718633" Nov 21 13:10:14 crc kubenswrapper[4769]: I1121 13:10:14.033247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerStarted","Data":"6c6a770fb25bfd1257b6284863ebad819245ef1d7727257e1043d9f66bd0465f"} Nov 21 13:10:14 crc kubenswrapper[4769]: E1121 13:10:14.401110 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:10:14 crc kubenswrapper[4769]: E1121 13:10:14.401214 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs podName:7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d nodeName:}" failed. No retries permitted until 2025-11-21 13:10:14.901169088 +0000 UTC m=+4773.601831076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs") pod "cinder-api-0" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d") : secret "cert-cinder-public-svc" not found Nov 21 13:10:14 crc kubenswrapper[4769]: I1121 13:10:14.671293 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:14 crc kubenswrapper[4769]: I1121 13:10:14.734580 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:14 crc kubenswrapper[4769]: E1121 13:10:14.911406 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:10:14 crc kubenswrapper[4769]: E1121 13:10:14.911477 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs podName:7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d nodeName:}" failed. No retries permitted until 2025-11-21 13:10:15.91146274 +0000 UTC m=+4774.612124558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs") pod "cinder-api-0" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d") : secret "cert-cinder-public-svc" not found Nov 21 13:10:15 crc kubenswrapper[4769]: I1121 13:10:15.048525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerStarted","Data":"d5826e02cd238dcbabbf671c366cb1be4ee2028cc737d163e9a9446630327198"} Nov 21 13:10:15 crc kubenswrapper[4769]: I1121 13:10:15.180215 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:15 crc kubenswrapper[4769]: I1121 13:10:15.180435 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api" containerID="cri-o://c77a0ea94735b319c12892e52033c1d8879ac78c6cf76d01a1f3e0e415d6e302" gracePeriod=30 Nov 21 13:10:15 crc kubenswrapper[4769]: I1121 13:10:15.180576 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api-log" containerID="cri-o://30d652a9a49d090d723d66f02b0ab264256a633cb21c77bfd004d1c5f0a489bc" gracePeriod=30 Nov 21 13:10:16 crc kubenswrapper[4769]: I1121 13:10:16.061468 4769 generic.go:334] "Generic (PLEG): container finished" podID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerID="30d652a9a49d090d723d66f02b0ab264256a633cb21c77bfd004d1c5f0a489bc" exitCode=143 Nov 21 13:10:16 crc kubenswrapper[4769]: I1121 13:10:16.061583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d","Type":"ContainerDied","Data":"30d652a9a49d090d723d66f02b0ab264256a633cb21c77bfd004d1c5f0a489bc"} Nov 21 13:10:16 crc kubenswrapper[4769]: I1121 13:10:16.066964 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.190301 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.190896 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="ovn-northd" containerID="cri-o://a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.191308 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="openstack-network-exporter" containerID="cri-o://897a1af3649915f08a7ae9b1d676845e372af7765e3237f17f4a369729200330" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.204768 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.207265 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.216221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.267796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-combined-ca-bundle\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.267848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data-custom\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.267892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbws\" (UniqueName: \"kubernetes.io/projected/bcbe4d3d-cecf-48f5-84c3-436b5442228b-kube-api-access-2nbws\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.267985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcbe4d3d-cecf-48f5-84c3-436b5442228b-logs\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.268003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.316646 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.317001 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="openstack-network-exporter" containerID="cri-o://0b3ae92b0c7d37bfc34422d5068cc9e9445a375fa2e038de30538d8e0f460f37" gracePeriod=300 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.348263 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.350532 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.361620 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.362014 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="probe" containerID="cri-o://f06769b438aa181e2a18ea6fed91e271fefff21495eaf2a2fa79d35fa2fbe544" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.362243 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" containerID="cri-o://77638a49b42c7b2e1d004ebe4a18219687776b3d561e7fc5eeed45b1604c04ad" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.370322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcbe4d3d-cecf-48f5-84c3-436b5442228b-logs\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.370374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.370434 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-combined-ca-bundle\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.370464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data-custom\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.370510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbws\" (UniqueName: \"kubernetes.io/projected/bcbe4d3d-cecf-48f5-84c3-436b5442228b-kube-api-access-2nbws\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.371998 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcbe4d3d-cecf-48f5-84c3-436b5442228b-logs\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.383607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data-custom\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.389026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-combined-ca-bundle\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.450575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.460319 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.466431 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbws\" (UniqueName: \"kubernetes.io/projected/bcbe4d3d-cecf-48f5-84c3-436b5442228b-kube-api-access-2nbws\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.472075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data-custom\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.472118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-combined-ca-bundle\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.472152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.472289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7cml\" (UniqueName: \"kubernetes.io/projected/347ea447-ef20-4550-8ad9-be274e65ad9e-kube-api-access-k7cml\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.472324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/347ea447-ef20-4550-8ad9-be274e65ad9e-logs\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.532485 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.532995 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api-log" containerID="cri-o://23c203dfa8a6a64d620f64078b1238c64be721c1942ca5179fed636fcb886e28" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.533396 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api" containerID="cri-o://cfed229987ebde7e17bf4f1a499869f53af3ef4ff549445cc5ef7364efbb1e99" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.570180 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.123:9311/healthcheck\": read tcp 10.217.0.2:42778->10.217.1.123:9311: read: connection reset by peer" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.572565 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.123:9311/healthcheck\": read tcp 10.217.0.2:42776->10.217.1.123:9311: read: connection reset by peer" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.574018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k7cml\" (UniqueName: \"kubernetes.io/projected/347ea447-ef20-4550-8ad9-be274e65ad9e-kube-api-access-k7cml\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.574088 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/347ea447-ef20-4550-8ad9-be274e65ad9e-logs\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.574169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data-custom\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.574227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-combined-ca-bundle\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.574277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.575164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/347ea447-ef20-4550-8ad9-be274e65ad9e-logs\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.581306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-combined-ca-bundle\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.588802 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data-custom\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.599461 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.601573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.603781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7cml\" (UniqueName: \"kubernetes.io/projected/347ea447-ef20-4550-8ad9-be274e65ad9e-kube-api-access-k7cml\") pod \"barbican-worker-7c8db7c54f-9vf85\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.622000 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.624289 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.635535 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.644265 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7f99cd444b-5ml4j"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.644700 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-log" containerID="cri-o://5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.645320 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-api" containerID="cri-o://7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.676223 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.676554 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="openstack-network-exporter" containerID="cri-o://48998bda1fb8acdbd427740ccc12bc85ba1904e0f8affd592bea32b41ab14237" gracePeriod=300 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.682104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data\") pod \"barbican-keystone-listener-7b5c95756d-r9vg8\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.699266 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.721565 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.723111 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-746497cdbb-48258"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.724877 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.779850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-internal-tls-certs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.786980 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.786990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98bvz\" (UniqueName: \"kubernetes.io/projected/2cae97f7-9440-4fc6-8c35-15fab8987634-kube-api-access-98bvz\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.787557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cae97f7-9440-4fc6-8c35-15fab8987634-logs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.787589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data-custom\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.787655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.787710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-combined-ca-bundle\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.787758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-public-tls-certs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.879245 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="ovsdbserver-nb" containerID="cri-o://9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824" gracePeriod=300 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.879777 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.900353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491eddfd-964e-4de3-940f-e22d3f0d2c29-logs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.900634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nlh4\" (UniqueName: \"kubernetes.io/projected/491eddfd-964e-4de3-940f-e22d3f0d2c29-kube-api-access-4nlh4\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.900687 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-internal-tls-certs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.901307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-98bvz\" (UniqueName: \"kubernetes.io/projected/2cae97f7-9440-4fc6-8c35-15fab8987634-kube-api-access-98bvz\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.901475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.901627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-config-data\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.901663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-scripts\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.901691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-internal-tls-certs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.901801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cae97f7-9440-4fc6-8c35-15fab8987634-logs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.902359 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cae97f7-9440-4fc6-8c35-15fab8987634-logs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.902874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data-custom\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.904708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-public-tls-certs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.904835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.904942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-combined-ca-bundle\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.905042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-public-tls-certs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.914577 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-746497cdbb-48258"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.929471 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-combined-ca-bundle\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.936891 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-98bvz\" (UniqueName: \"kubernetes.io/projected/2cae97f7-9440-4fc6-8c35-15fab8987634-kube-api-access-98bvz\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.975271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.981782 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-internal-tls-certs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.981854 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.982078 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-log" containerID="cri-o://b0c81123338e28a790f83597d594930e9982b6b022c2f17f56c6e28e8fad5957" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.982538 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-api" containerID="cri-o://11063f90162151039946f4a96bcca396ecf40151a84b3dc6c9a038a4225d3105" gracePeriod=30 Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.994007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-public-tls-certs\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:17 crc kubenswrapper[4769]: I1121 13:10:17.999707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data-custom\") pod \"barbican-api-779bc9b6f8-swz8s\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.006756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-config-data\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.006796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-scripts\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.006815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-internal-tls-certs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.006859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-public-tls-certs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.006915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491eddfd-964e-4de3-940f-e22d3f0d2c29-logs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.006954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4nlh4\" (UniqueName: \"kubernetes.io/projected/491eddfd-964e-4de3-940f-e22d3f0d2c29-kube-api-access-4nlh4\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.007000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.021491 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.021717 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" containerName="nova-scheduler-scheduler" containerID="cri-o://47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.022575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491eddfd-964e-4de3-940f-e22d3f0d2c29-logs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.049276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.049594 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerName="nova-cell0-conductor-conductor" containerID="cri-o://63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.054018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-internal-tls-certs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.068015 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.078069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-public-tls-certs\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.078366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-scripts\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.092892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-config-data\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.094684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nlh4\" (UniqueName: \"kubernetes.io/projected/491eddfd-964e-4de3-940f-e22d3f0d2c29-kube-api-access-4nlh4\") pod \"placement-746497cdbb-48258\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.116548 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.117087 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-log" containerID="cri-o://7b658a4a7a4b597623de7e7823282d42d5e01fbca41f202db2f4e2e219101942" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.117467 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-metadata" containerID="cri-o://8492af9af790ac21f80c3388e456304325713e7ce73812df5f74ebff91bcacde" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.134500 4769 generic.go:334] "Generic (PLEG): container finished" podID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerID="897a1af3649915f08a7ae9b1d676845e372af7765e3237f17f4a369729200330" exitCode=2 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.134600 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33","Type":"ContainerDied","Data":"897a1af3649915f08a7ae9b1d676845e372af7765e3237f17f4a369729200330"} Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.136740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.183438 4769 generic.go:334] "Generic (PLEG): container finished" podID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerID="48998bda1fb8acdbd427740ccc12bc85ba1904e0f8affd592bea32b41ab14237" exitCode=2 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.183530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1486d261-3fdd-44ad-8dc7-2c8882e668e0","Type":"ContainerDied","Data":"48998bda1fb8acdbd427740ccc12bc85ba1904e0f8affd592bea32b41ab14237"} Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.190486 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.190710 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-log" containerID="cri-o://a7458b92fbfea5394d07612e2f11871fcb7c3088206fe41432ca27127eb0ba08" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.191106 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-httpd" containerID="cri-o://e9c3760b3340a8f5225e25164f4a7becd07ce0c5e96e490e6ec0d1f0d873fcfd" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.227709 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.227893 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerName="nova-cell1-conductor-conductor" containerID="cri-o://d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.246789 4769 generic.go:334] "Generic (PLEG): container finished" podID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerID="5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81" exitCode=143 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.246925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" event={"ID":"89da9de0-4b00-4ae1-a996-a9e9305ae1d7","Type":"ContainerDied","Data":"5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81"} Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.257998 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="ovsdbserver-sb" containerID="cri-o://c294267ea69e42cea00928adc9b9b52bcbd318388d14cf8be304d38333f21b9d" gracePeriod=300 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.259041 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.312448 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.313239 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-log" containerID="cri-o://cb3923d25f99d933be32dc55d82648d548e91b6407688fcb0700212da6e727b1" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.313688 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-httpd" containerID="cri-o://4fbb2110cc107d67bf9a75444de10b1988f7775f90f500070f6fff7082cb1538" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.360786 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6f699bcfc4-4pddg"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.362553 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.365811 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_8f101464-9ac6-48d4-848f-d0c89472105f/ovsdbserver-nb/0.log" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.365839 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f101464-9ac6-48d4-848f-d0c89472105f" containerID="0b3ae92b0c7d37bfc34422d5068cc9e9445a375fa2e038de30538d8e0f460f37" exitCode=2 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.365855 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f101464-9ac6-48d4-848f-d0c89472105f" containerID="9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824" exitCode=143 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.365906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"8f101464-9ac6-48d4-848f-d0c89472105f","Type":"ContainerDied","Data":"0b3ae92b0c7d37bfc34422d5068cc9e9445a375fa2e038de30538d8e0f460f37"} Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.365926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"8f101464-9ac6-48d4-848f-d0c89472105f","Type":"ContainerDied","Data":"9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824"} Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.392160 4769 generic.go:334] "Generic (PLEG): container finished" podID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerID="23c203dfa8a6a64d620f64078b1238c64be721c1942ca5179fed636fcb886e28" exitCode=143 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.392372 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="39098700-4859-439d-a783-c9867fc7bcce" containerName="memcached" containerID="cri-o://7f8c35933458931eadb2725a167371798e62f1201feaa4bd4c65d6c2775bda89" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.392621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" event={"ID":"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44","Type":"ContainerDied","Data":"23c203dfa8a6a64d620f64078b1238c64be721c1942ca5179fed636fcb886e28"} Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.423258 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6f699bcfc4-4pddg"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.426350 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="galera" containerID="cri-o://36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-config\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-httpd-config\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-ovndb-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blxh6\" (UniqueName: \"kubernetes.io/projected/933cf65a-d662-413c-8b6f-fa4145f20373-kube-api-access-blxh6\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-public-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-internal-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.432923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-combined-ca-bundle\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.439453 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-787f78dcf9-fpk6h"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.449040 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" podUID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" containerName="keystone-api" containerID="cri-o://d95224c39d2e18fe8d01b1b884a95a32a76c453ffaee51ec40ac31199f6c21fb" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.485073 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-846ccd89dd-j22ct"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.487902 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.512957 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.73:8776/healthcheck\": read tcp 10.217.0.2:53834->10.217.1.73:8776: read: connection reset by peer" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.530061 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-846ccd89dd-j22ct"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-config\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-httpd-config\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-ovndb-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-blxh6\" (UniqueName: \"kubernetes.io/projected/933cf65a-d662-413c-8b6f-fa4145f20373-kube-api-access-blxh6\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-public-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-internal-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.534757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-combined-ca-bundle\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.549279 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-internal-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.549407 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-combined-ca-bundle\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.549450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-public-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.549696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-config\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.556218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-ovndb-tls-certs\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.562061 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.562448 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://b58d9e16ddc919310b309f5a62591e237d4d0d0c0d54affe7d1cb916da4fbae3" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.587941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-httpd-config\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.588072 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" containerName="galera" containerID="cri-o://35a27014b7bbefcddd074ae7ea1e912e548d4d18cd4e291e89cd2c0a2927042e" gracePeriod=30 Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.590782 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-blxh6\" (UniqueName: \"kubernetes.io/projected/933cf65a-d662-413c-8b6f-fa4145f20373-kube-api-access-blxh6\") pod \"neutron-6f699bcfc4-4pddg\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-public-tls-certs\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-scripts\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-credential-keys\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-combined-ca-bundle\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-config-data\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtwpx\" (UniqueName: \"kubernetes.io/projected/dbb0650d-c5a5-4749-b8ca-642300da8535-kube-api-access-jtwpx\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-internal-tls-certs\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.637766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-fernet-keys\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.737964 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.739874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-credential-keys\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-combined-ca-bundle\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740285 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-config-data\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jtwpx\" (UniqueName: \"kubernetes.io/projected/dbb0650d-c5a5-4749-b8ca-642300da8535-kube-api-access-jtwpx\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-internal-tls-certs\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740660 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-fernet-keys\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-public-tls-certs\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.740913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-scripts\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.747843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-config-data\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.748804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-scripts\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.752630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-credential-keys\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.754666 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.754765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-public-tls-certs\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.762410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-fernet-keys\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.769510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-combined-ca-bundle\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.776653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-internal-tls-certs\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.779533 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtwpx\" (UniqueName: \"kubernetes.io/projected/dbb0650d-c5a5-4749-b8ca-642300da8535-kube-api-access-jtwpx\") pod \"keystone-846ccd89dd-j22ct\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.780902 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.99:6080/vnc_lite.html\": read tcp 10.217.0.2:41726->10.217.1.99:6080: read: connection reset by peer" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.814632 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85"] Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.889703 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:18 crc kubenswrapper[4769]: I1121 13:10:18.903320 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" podUID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.116:5000/v3\": read tcp 10.217.0.2:47610->10.217.1.116:5000: read: connection reset by peer" Nov 21 13:10:18 crc kubenswrapper[4769]: W1121 13:10:18.911143 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod347ea447_ef20_4550_8ad9_be274e65ad9e.slice/crio-303396ce35f05722bc6ae9fe1f722de686efc85e4b06d72b5725085878128a9a WatchSource:0}: Error finding container 303396ce35f05722bc6ae9fe1f722de686efc85e4b06d72b5725085878128a9a: Status 404 returned error can't find the container with id 303396ce35f05722bc6ae9fe1f722de686efc85e4b06d72b5725085878128a9a Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.019418 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-746497cdbb-48258"] Nov 21 13:10:19 crc kubenswrapper[4769]: E1121 13:10:19.224642 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824 is running failed: container process not found" containerID="9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:10:19 crc kubenswrapper[4769]: E1121 13:10:19.243317 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824 is running failed: container process not found" containerID="9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:10:19 crc kubenswrapper[4769]: E1121 13:10:19.253409 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824 is running failed: container process not found" containerID="9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:10:19 crc kubenswrapper[4769]: E1121 13:10:19.253478 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="ovsdbserver-nb" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.351978 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s"] Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.425682 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" containerID="d95224c39d2e18fe8d01b1b884a95a32a76c453ffaee51ec40ac31199f6c21fb" exitCode=0 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.425769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" event={"ID":"6b787f72-180e-4e93-bcd9-ea0185a4d6d8","Type":"ContainerDied","Data":"d95224c39d2e18fe8d01b1b884a95a32a76c453ffaee51ec40ac31199f6c21fb"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.446694 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_1486d261-3fdd-44ad-8dc7-2c8882e668e0/ovsdbserver-sb/0.log" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.446747 4769 generic.go:334] "Generic (PLEG): container finished" podID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerID="c294267ea69e42cea00928adc9b9b52bcbd318388d14cf8be304d38333f21b9d" exitCode=143 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.446819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1486d261-3fdd-44ad-8dc7-2c8882e668e0","Type":"ContainerDied","Data":"c294267ea69e42cea00928adc9b9b52bcbd318388d14cf8be304d38333f21b9d"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.475368 4769 generic.go:334] "Generic (PLEG): container finished" podID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerID="b0c81123338e28a790f83597d594930e9982b6b022c2f17f56c6e28e8fad5957" exitCode=143 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.475461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527","Type":"ContainerDied","Data":"b0c81123338e28a790f83597d594930e9982b6b022c2f17f56c6e28e8fad5957"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.495981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" event={"ID":"2cae97f7-9440-4fc6-8c35-15fab8987634","Type":"ContainerStarted","Data":"681d76daf64324a735824abdfeabeb5fa48e0f6b64e2551791c493a5c8163952"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.498643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" event={"ID":"bcbe4d3d-cecf-48f5-84c3-436b5442228b","Type":"ContainerStarted","Data":"ce01450bdf6c6c44abd340e42784748f443114ae9dcc374ef4a870ecff3bfce1"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.517604 4769 generic.go:334] "Generic (PLEG): container finished" podID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerID="f06769b438aa181e2a18ea6fed91e271fefff21495eaf2a2fa79d35fa2fbe544" exitCode=0 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.517709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerDied","Data":"f06769b438aa181e2a18ea6fed91e271fefff21495eaf2a2fa79d35fa2fbe544"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.527304 4769 generic.go:334] "Generic (PLEG): container finished" podID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerID="c77a0ea94735b319c12892e52033c1d8879ac78c6cf76d01a1f3e0e415d6e302" exitCode=0 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.527374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d","Type":"ContainerDied","Data":"c77a0ea94735b319c12892e52033c1d8879ac78c6cf76d01a1f3e0e415d6e302"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.563103 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerID="e9c3760b3340a8f5225e25164f4a7becd07ce0c5e96e490e6ec0d1f0d873fcfd" exitCode=0 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.563134 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerID="a7458b92fbfea5394d07612e2f11871fcb7c3088206fe41432ca27127eb0ba08" exitCode=143 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.563224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e6db24c5-2c0f-4034-93c9-d7cde95605ba","Type":"ContainerDied","Data":"e9c3760b3340a8f5225e25164f4a7becd07ce0c5e96e490e6ec0d1f0d873fcfd"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.563249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e6db24c5-2c0f-4034-93c9-d7cde95605ba","Type":"ContainerDied","Data":"a7458b92fbfea5394d07612e2f11871fcb7c3088206fe41432ca27127eb0ba08"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.576750 4769 generic.go:334] "Generic (PLEG): container finished" podID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerID="4fbb2110cc107d67bf9a75444de10b1988f7775f90f500070f6fff7082cb1538" exitCode=0 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.576779 4769 generic.go:334] "Generic (PLEG): container finished" podID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerID="cb3923d25f99d933be32dc55d82648d548e91b6407688fcb0700212da6e727b1" exitCode=143 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.576833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"47ccb784-6503-4ea9-b097-28db6c8fb25b","Type":"ContainerDied","Data":"4fbb2110cc107d67bf9a75444de10b1988f7775f90f500070f6fff7082cb1538"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.576861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"47ccb784-6503-4ea9-b097-28db6c8fb25b","Type":"ContainerDied","Data":"cb3923d25f99d933be32dc55d82648d548e91b6407688fcb0700212da6e727b1"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.621543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" event={"ID":"347ea447-ef20-4550-8ad9-be274e65ad9e","Type":"ContainerStarted","Data":"303396ce35f05722bc6ae9fe1f722de686efc85e4b06d72b5725085878128a9a"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.664525 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6f699bcfc4-4pddg"] Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.664702 4769 generic.go:334] "Generic (PLEG): container finished" podID="066dc797-82a6-41d9-a8db-783d732b26ed" containerID="7b658a4a7a4b597623de7e7823282d42d5e01fbca41f202db2f4e2e219101942" exitCode=143 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.664727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"066dc797-82a6-41d9-a8db-783d732b26ed","Type":"ContainerDied","Data":"7b658a4a7a4b597623de7e7823282d42d5e01fbca41f202db2f4e2e219101942"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.666221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-746497cdbb-48258" event={"ID":"491eddfd-964e-4de3-940f-e22d3f0d2c29","Type":"ContainerStarted","Data":"e15f8869eb179524b1508efc5c8950470a1d0eff41d416977c0a253277e4466d"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.668039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerStarted","Data":"5d7e44340687c45b4ecbefb05ee05a1c82868ddcb8d9a1bdd9d533de5b41128c"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.668180 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-central-agent" containerID="cri-o://10ab10ccdd652346bb0224d390acd267d226a1f32bd19924396d40d7bf78e3a8" gracePeriod=30 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.668440 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.668698 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="proxy-httpd" containerID="cri-o://5d7e44340687c45b4ecbefb05ee05a1c82868ddcb8d9a1bdd9d533de5b41128c" gracePeriod=30 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.668741 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="sg-core" containerID="cri-o://d5826e02cd238dcbabbf671c366cb1be4ee2028cc737d163e9a9446630327198" gracePeriod=30 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.668776 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-notification-agent" containerID="cri-o://6c6a770fb25bfd1257b6284863ebad819245ef1d7727257e1043d9f66bd0465f" gracePeriod=30 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.708070 4769 generic.go:334] "Generic (PLEG): container finished" podID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerID="cfed229987ebde7e17bf4f1a499869f53af3ef4ff549445cc5ef7364efbb1e99" exitCode=0 Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.708180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" event={"ID":"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44","Type":"ContainerDied","Data":"cfed229987ebde7e17bf4f1a499869f53af3ef4ff549445cc5ef7364efbb1e99"} Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.737070 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.706578354 podStartE2EDuration="10.737045728s" podCreationTimestamp="2025-11-21 13:10:09 +0000 UTC" firstStartedPulling="2025-11-21 13:10:09.988773616 +0000 UTC m=+4768.689435434" lastFinishedPulling="2025-11-21 13:10:17.01924099 +0000 UTC m=+4775.719902808" observedRunningTime="2025-11-21 13:10:19.708555651 +0000 UTC m=+4778.409217469" watchObservedRunningTime="2025-11-21 13:10:19.737045728 +0000 UTC m=+4778.437707546" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.798543 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_8f101464-9ac6-48d4-848f-d0c89472105f/ovsdbserver-nb/0.log" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.798619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.870708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-combined-ca-bundle\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-config\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shfj7\" (UniqueName: \"kubernetes.io/projected/8f101464-9ac6-48d4-848f-d0c89472105f-kube-api-access-shfj7\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-scripts\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdb-rundir\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdbserver-nb-tls-certs\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.871636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-metrics-certs-tls-certs\") pod \"8f101464-9ac6-48d4-848f-d0c89472105f\" (UID: \"8f101464-9ac6-48d4-848f-d0c89472105f\") " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.873298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-scripts" (OuterVolumeSpecName: "scripts") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.875743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-config" (OuterVolumeSpecName: "config") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.877780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.882842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.883737 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f101464-9ac6-48d4-848f-d0c89472105f-kube-api-access-shfj7" (OuterVolumeSpecName: "kube-api-access-shfj7") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "kube-api-access-shfj7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.938757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.974605 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.974640 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.974653 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.974666 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-shfj7\" (UniqueName: \"kubernetes.io/projected/8f101464-9ac6-48d4-848f-d0c89472105f-kube-api-access-shfj7\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.974674 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8f101464-9ac6-48d4-848f-d0c89472105f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:19 crc kubenswrapper[4769]: I1121 13:10:19.974683 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:20 crc kubenswrapper[4769]: E1121 13:10:20.049175 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:20 crc kubenswrapper[4769]: E1121 13:10:20.050725 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:20 crc kubenswrapper[4769]: E1121 13:10:20.054926 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:20 crc kubenswrapper[4769]: E1121 13:10:20.055000 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerName="nova-cell1-conductor-conductor" Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.162442 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.184335 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-846ccd89dd-j22ct"] Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.189924 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.230219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.250684 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "8f101464-9ac6-48d4-848f-d0c89472105f" (UID: "8f101464-9ac6-48d4-848f-d0c89472105f"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.291377 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:20 crc kubenswrapper[4769]: I1121 13:10:20.291417 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f101464-9ac6-48d4-848f-d0c89472105f-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.435282 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.435974 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.436324 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.436353 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" containerName="nova-scheduler-scheduler" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.536215 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.553700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.571109 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.576731 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.607981 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:20.608044 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-combined-ca-bundle\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-internal-tls-certs\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611397 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611469 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5gfm\" (UniqueName: \"kubernetes.io/projected/e6db24c5-2c0f-4034-93c9-d7cde95605ba-kube-api-access-d5gfm\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-scripts\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-logs\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-public-tls-certs\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data-custom\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-internal-tls-certs\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w872v\" (UniqueName: \"kubernetes.io/projected/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-kube-api-access-w872v\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-config-data\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611800 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-httpd-run\") pod \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\" (UID: \"e6db24c5-2c0f-4034-93c9-d7cde95605ba\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-logs\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.611977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-combined-ca-bundle\") pod \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\" (UID: \"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.614728 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_1486d261-3fdd-44ad-8dc7-2c8882e668e0/ovsdbserver-sb/0.log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.614793 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.622388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.622812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-logs" (OuterVolumeSpecName: "logs") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.629716 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.630032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.630573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-logs" (OuterVolumeSpecName: "logs") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.649649 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6db24c5-2c0f-4034-93c9-d7cde95605ba-kube-api-access-d5gfm" (OuterVolumeSpecName: "kube-api-access-d5gfm") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "kube-api-access-d5gfm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.660784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.662766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-kube-api-access-w872v" (OuterVolumeSpecName: "kube-api-access-w872v") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "kube-api-access-w872v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.669049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-scripts" (OuterVolumeSpecName: "scripts") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-internal-tls-certs\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-metrics-certs-tls-certs\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-scripts\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-etc-machine-id\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-scripts\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvrzj\" (UniqueName: \"kubernetes.io/projected/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-kube-api-access-wvrzj\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdbserver-sb-tls-certs\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726882 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data-custom\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdb-rundir\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-combined-ca-bundle\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.726965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-logs\") pod \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\" (UID: \"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727008 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jhkk\" (UniqueName: \"kubernetes.io/projected/1486d261-3fdd-44ad-8dc7-2c8882e668e0-kube-api-access-6jhkk\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-config\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-combined-ca-bundle\") pod \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\" (UID: \"1486d261-3fdd-44ad-8dc7-2c8882e668e0\") " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727495 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727508 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727518 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w872v\" (UniqueName: \"kubernetes.io/projected/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-kube-api-access-w872v\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727528 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e6db24c5-2c0f-4034-93c9-d7cde95605ba-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727537 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727557 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727565 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d5gfm\" (UniqueName: \"kubernetes.io/projected/e6db24c5-2c0f-4034-93c9-d7cde95605ba-kube-api-access-d5gfm\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.727575 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.739428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-scripts" (OuterVolumeSpecName: "scripts") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.739437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.739495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.756282 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-config" (OuterVolumeSpecName: "config") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.765844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-logs" (OuterVolumeSpecName: "logs") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.830663 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.830688 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.830700 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1486d261-3fdd-44ad-8dc7-2c8882e668e0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.830708 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.830718 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.856478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" event={"ID":"bcbe4d3d-cecf-48f5-84c3-436b5442228b","Type":"ContainerStarted","Data":"01fc349f22783f08743b711022c71ba577b7b162773d7722adb2fde2c56261c6"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.919765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" event={"ID":"933cf65a-d662-413c-8b6f-fa4145f20373","Type":"ContainerStarted","Data":"16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.919821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" event={"ID":"933cf65a-d662-413c-8b6f-fa4145f20373","Type":"ContainerStarted","Data":"bbad7d76b64104941c1bfe290f78e5a3986af803ae84bf9e8df68db6ebea0563"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.929526 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aaa614d-7f10-480d-be9a-293f7959b164" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.929586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9aaa614d-7f10-480d-be9a-293f7959b164","Type":"ContainerDied","Data":"47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.972737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d","Type":"ContainerDied","Data":"c38d26559a7a24ec353e39c4c18897d2b4d84a1b979cfd211e39fec33fa1d0cb"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.972787 4769 scope.go:117] "RemoveContainer" containerID="c77a0ea94735b319c12892e52033c1d8879ac78c6cf76d01a1f3e0e415d6e302" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.972928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.990480 4769 generic.go:334] "Generic (PLEG): container finished" podID="acd2a17a-d088-4084-959f-a544d6afdd27" containerID="b58d9e16ddc919310b309f5a62591e237d4d0d0c0d54affe7d1cb916da4fbae3" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:20.990536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"acd2a17a-d088-4084-959f-a544d6afdd27","Type":"ContainerDied","Data":"b58d9e16ddc919310b309f5a62591e237d4d0d0c0d54affe7d1cb916da4fbae3"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.002856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" event={"ID":"347ea447-ef20-4550-8ad9-be274e65ad9e","Type":"ContainerStarted","Data":"aafcb2fe94defa7138324db37ddfa0cc79921bf4dc7287a684357415cbc47472"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.012759 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_8f101464-9ac6-48d4-848f-d0c89472105f/ovsdbserver-nb/0.log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.012932 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.015078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"8f101464-9ac6-48d4-848f-d0c89472105f","Type":"ContainerDied","Data":"2131a52fe986e0d347ad49dcf56fd8bbf44228b7a27dcc262997581b9d0e71c6"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.021738 4769 scope.go:117] "RemoveContainer" containerID="30d652a9a49d090d723d66f02b0ab264256a633cb21c77bfd004d1c5f0a489bc" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.031597 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" event={"ID":"e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44","Type":"ContainerDied","Data":"c6ba7e83fb1a942f6b40793badf36831ad762617ffde89ae8b792994e3b5d89f"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.031678 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.033987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" event={"ID":"2cae97f7-9440-4fc6-8c35-15fab8987634","Type":"ContainerStarted","Data":"14cd5599654e80e3b56cbc85d4913754f76181a0d736b82cfebc34744d8c3b72"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043428 4769 generic.go:334] "Generic (PLEG): container finished" podID="a42113d3-c795-4552-b3ef-77094804c28b" containerID="5d7e44340687c45b4ecbefb05ee05a1c82868ddcb8d9a1bdd9d533de5b41128c" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043664 4769 generic.go:334] "Generic (PLEG): container finished" podID="a42113d3-c795-4552-b3ef-77094804c28b" containerID="d5826e02cd238dcbabbf671c366cb1be4ee2028cc737d163e9a9446630327198" exitCode=2 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043674 4769 generic.go:334] "Generic (PLEG): container finished" podID="a42113d3-c795-4552-b3ef-77094804c28b" containerID="6c6a770fb25bfd1257b6284863ebad819245ef1d7727257e1043d9f66bd0465f" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043681 4769 generic.go:334] "Generic (PLEG): container finished" podID="a42113d3-c795-4552-b3ef-77094804c28b" containerID="10ab10ccdd652346bb0224d390acd267d226a1f32bd19924396d40d7bf78e3a8" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerDied","Data":"5d7e44340687c45b4ecbefb05ee05a1c82868ddcb8d9a1bdd9d533de5b41128c"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerDied","Data":"d5826e02cd238dcbabbf671c366cb1be4ee2028cc737d163e9a9446630327198"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerDied","Data":"6c6a770fb25bfd1257b6284863ebad819245ef1d7727257e1043d9f66bd0465f"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.043777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerDied","Data":"10ab10ccdd652346bb0224d390acd267d226a1f32bd19924396d40d7bf78e3a8"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.050357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e6db24c5-2c0f-4034-93c9-d7cde95605ba","Type":"ContainerDied","Data":"7112e256a6471e5637957a84a445d8624fea155be4d22888ddc869365672938f"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.050482 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.066053 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_1486d261-3fdd-44ad-8dc7-2c8882e668e0/ovsdbserver-sb/0.log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.066130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"1486d261-3fdd-44ad-8dc7-2c8882e668e0","Type":"ContainerDied","Data":"6331981c2534fce59b9d4c2a6188eff9a8741769a8158ca19f841b99ba0bdfa2"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.066138 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.068099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-746497cdbb-48258" event={"ID":"491eddfd-964e-4de3-940f-e22d3f0d2c29","Type":"ContainerStarted","Data":"dd9565562c127fc67102981469d2b4ced7a5404a7d3cae22bbc58af0f92e0a38"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.076745 4769 generic.go:334] "Generic (PLEG): container finished" podID="39098700-4859-439d-a783-c9867fc7bcce" containerID="7f8c35933458931eadb2725a167371798e62f1201feaa4bd4c65d6c2775bda89" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.076800 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"39098700-4859-439d-a783-c9867fc7bcce","Type":"ContainerDied","Data":"7f8c35933458931eadb2725a167371798e62f1201feaa4bd4c65d6c2775bda89"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.077841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" event={"ID":"dbb0650d-c5a5-4749-b8ca-642300da8535","Type":"ContainerStarted","Data":"96380511604c4120a96799d8617dea4fc729a21945815028b38cca98c8cd081f"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.181249 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.181625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1486d261-3fdd-44ad-8dc7-2c8882e668e0-kube-api-access-6jhkk" (OuterVolumeSpecName: "kube-api-access-6jhkk") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "kube-api-access-6jhkk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.182381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-kube-api-access-wvrzj" (OuterVolumeSpecName: "kube-api-access-wvrzj") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "kube-api-access-wvrzj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.182754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.193082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-scripts" (OuterVolumeSpecName: "scripts") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.233342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.249594 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wvrzj\" (UniqueName: \"kubernetes.io/projected/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-kube-api-access-wvrzj\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.249618 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.249641 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.249654 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6jhkk\" (UniqueName: \"kubernetes.io/projected/1486d261-3fdd-44ad-8dc7-2c8882e668e0-kube-api-access-6jhkk\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.249664 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.249672 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.265398 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.352441 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.401702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.458443 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.504436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.504768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data" (OuterVolumeSpecName: "config-data") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.517238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.530443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-config-data" (OuterVolumeSpecName: "config-data") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.545523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data" (OuterVolumeSpecName: "config-data") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.555319 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.560039 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.560062 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.560071 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.560083 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.560092 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.560101 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.561352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.563456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.568648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" (UID: "7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.588044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" (UID: "e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.591950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e6db24c5-2c0f-4034-93c9-d7cde95605ba" (UID: "e6db24c5-2c0f-4034-93c9-d7cde95605ba"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.605023 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.624126 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "1486d261-3fdd-44ad-8dc7-2c8882e668e0" (UID: "1486d261-3fdd-44ad-8dc7-2c8882e668e0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.625482 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.109:8775/\": read tcp 10.217.0.2:58392->10.217.1.109:8775: read: connection reset by peer" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.625497 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.109:8775/\": read tcp 10.217.0.2:58382->10.217.1.109:8775: read: connection reset by peer" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.662670 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.663028 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1486d261-3fdd-44ad-8dc7-2c8882e668e0-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.663038 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.663052 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.663060 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6db24c5-2c0f-4034-93c9-d7cde95605ba-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.663072 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.663099 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.810157 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.816580 4769 scope.go:117] "RemoveContainer" containerID="0b3ae92b0c7d37bfc34422d5068cc9e9445a375fa2e038de30538d8e0f460f37" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.823369 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.839390 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.839842 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="ovsdbserver-nb" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.839858 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="ovsdbserver-nb" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.839877 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.839885 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-log" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.839895 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="ovsdbserver-sb" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.839903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="ovsdbserver-sb" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.839931 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api-log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.839942 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api-log" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.839954 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="openstack-network-exporter" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.839962 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="openstack-network-exporter" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.840002 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-httpd" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840009 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-httpd" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.840019 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.840059 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="openstack-network-exporter" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840067 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="openstack-network-exporter" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.840077 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api-log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840084 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api-log" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:21.840095 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840102 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840350 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api-log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840375 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="openstack-network-exporter" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840391 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="ovsdbserver-nb" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840406 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" containerName="ovsdbserver-sb" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840432 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" containerName="openstack-network-exporter" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840441 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" containerName="barbican-api-log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840459 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-httpd" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840470 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" containerName="glance-log" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.840480 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.841898 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.855444 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.855716 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-pgj9p" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.856508 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.859341 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.861335 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.877128 4769 scope.go:117] "RemoveContainer" containerID="9bc12ab92bfbbd1319fbfb9d89bd6ae6e84b13e2de616bcdbec2db306a652824" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.881577 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893396 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-config\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qr8l\" (UniqueName: \"kubernetes.io/projected/852be43e-77fe-4edf-ba14-fe226cfce274-kube-api-access-9qr8l\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893712 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.893855 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.911841 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.918761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.923697 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.923868 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.924169 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.930432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996541 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-config\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9qr8l\" (UniqueName: \"kubernetes.io/projected/852be43e-77fe-4edf-ba14-fe226cfce274-kube-api-access-9qr8l\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.996897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.997976 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.998631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.000225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:21.999211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-config\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.007889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.008595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.008647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.020755 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qr8l\" (UniqueName: \"kubernetes.io/projected/852be43e-77fe-4edf-ba14-fe226cfce274-kube-api-access-9qr8l\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.059330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"ovsdbserver-nb-0\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:22.088643 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576 is running failed: container process not found" containerID="36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:22.089608 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576 is running failed: container process not found" containerID="36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:22.090302 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576 is running failed: container process not found" containerID="36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:22.090339 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="galera" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.095105 4769 generic.go:334] "Generic (PLEG): container finished" podID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerID="11063f90162151039946f4a96bcca396ecf40151a84b3dc6c9a038a4225d3105" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.095158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527","Type":"ContainerDied","Data":"11063f90162151039946f4a96bcca396ecf40151a84b3dc6c9a038a4225d3105"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.097841 4769 generic.go:334] "Generic (PLEG): container finished" podID="294817fb-c857-4d11-9a12-23546ad1e93c" containerID="35a27014b7bbefcddd074ae7ea1e912e548d4d18cd4e291e89cd2c0a2927042e" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.097885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"294817fb-c857-4d11-9a12-23546ad1e93c","Type":"ContainerDied","Data":"35a27014b7bbefcddd074ae7ea1e912e548d4d18cd4e291e89cd2c0a2927042e"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a385bef9-6879-4869-845e-06b5316937c2-logs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data-custom\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098657 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a385bef9-6879-4869-845e-06b5316937c2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-scripts\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.098773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlsd5\" (UniqueName: \"kubernetes.io/projected/a385bef9-6879-4869-845e-06b5316937c2-kube-api-access-hlsd5\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.101792 4769 generic.go:334] "Generic (PLEG): container finished" podID="066dc797-82a6-41d9-a8db-783d732b26ed" containerID="8492af9af790ac21f80c3388e456304325713e7ce73812df5f74ebff91bcacde" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.101843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"066dc797-82a6-41d9-a8db-783d732b26ed","Type":"ContainerDied","Data":"8492af9af790ac21f80c3388e456304325713e7ce73812df5f74ebff91bcacde"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.103799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" event={"ID":"dbb0650d-c5a5-4749-b8ca-642300da8535","Type":"ContainerStarted","Data":"de60df9b83d974676643990b8f723b82df66a50899862f2d4142a3a12c8b8f89"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.104527 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.117385 4769 generic.go:334] "Generic (PLEG): container finished" podID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerID="36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576" exitCode=0 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.117422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"813a8fa8-2b10-49ef-b98c-cdc429588409","Type":"ContainerDied","Data":"36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.172304 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.204987 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" podStartSLOduration=4.204955826 podStartE2EDuration="4.204955826s" podCreationTimestamp="2025-11-21 13:10:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:22.139682549 +0000 UTC m=+4780.840344367" watchObservedRunningTime="2025-11-21 13:10:22.204955826 +0000 UTC m=+4780.905617644" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a385bef9-6879-4869-845e-06b5316937c2-logs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data-custom\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a385bef9-6879-4869-845e-06b5316937c2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-scripts\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.206813 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hlsd5\" (UniqueName: \"kubernetes.io/projected/a385bef9-6879-4869-845e-06b5316937c2-kube-api-access-hlsd5\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.209588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a385bef9-6879-4869-845e-06b5316937c2-etc-machine-id\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.212030 4769 scope.go:117] "RemoveContainer" containerID="cfed229987ebde7e17bf4f1a499869f53af3ef4ff549445cc5ef7364efbb1e99" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.218122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a385bef9-6879-4869-845e-06b5316937c2-logs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.231611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-scripts\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.232552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data-custom\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.232714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlsd5\" (UniqueName: \"kubernetes.io/projected/a385bef9-6879-4869-845e-06b5316937c2-kube-api-access-hlsd5\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.246628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.251811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.252265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.259293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-public-tls-certs\") pod \"cinder-api-0\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.290477 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.298531 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.306329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.315125 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.317124 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.323844 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-cf45fdbd4-qcsd6"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.325554 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.325618 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-cgndj" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.325824 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.326629 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.333556 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.343876 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.353057 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.360457 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.363072 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.366814 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.367154 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.367441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.412658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-config\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.412694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.412743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.412770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jxt\" (UniqueName: \"kubernetes.io/projected/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-kube-api-access-77jxt\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.412929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.413159 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.413372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.413415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.415526 4769 scope.go:117] "RemoveContainer" containerID="23c203dfa8a6a64d620f64078b1238c64be721c1942ca5179fed636fcb886e28" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.455531 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="39098700-4859-439d-a783-c9867fc7bcce" containerName="memcached" probeResult="failure" output="dial tcp 10.217.1.117:11211: connect: connection refused" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.458696 4769 scope.go:117] "RemoveContainer" containerID="e9c3760b3340a8f5225e25164f4a7becd07ce0c5e96e490e6ec0d1f0d873fcfd" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.497506 4769 scope.go:117] "RemoveContainer" containerID="a7458b92fbfea5394d07612e2f11871fcb7c3088206fe41432ca27127eb0ba08" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.514232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515738 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-config\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-77jxt\" (UniqueName: \"kubernetes.io/projected/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-kube-api-access-77jxt\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.515985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.516009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-logs\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.516025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.516054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.516080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.516099 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mdrh\" (UniqueName: \"kubernetes.io/projected/8491287b-46fd-4729-8ab0-8080b38a38f3-kube-api-access-7mdrh\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.516858 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.517184 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-config\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.517524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.518229 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.522545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.523674 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.527559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.537419 4769 scope.go:117] "RemoveContainer" containerID="48998bda1fb8acdbd427740ccc12bc85ba1904e0f8affd592bea32b41ab14237" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.554065 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jxt\" (UniqueName: \"kubernetes.io/projected/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-kube-api-access-77jxt\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.560606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-sb-0\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.617890 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.617933 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.617984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.618002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.618043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-logs\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.618060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.618098 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7mdrh\" (UniqueName: \"kubernetes.io/projected/8491287b-46fd-4729-8ab0-8080b38a38f3-kube-api-access-7mdrh\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.618130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.618818 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.619114 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.622977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-logs\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.631526 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.635081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.635399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.635904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mdrh\" (UniqueName: \"kubernetes.io/projected/8491287b-46fd-4729-8ab0-8080b38a38f3-kube-api-access-7mdrh\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.654452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.680401 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.693322 4769 scope.go:117] "RemoveContainer" containerID="c294267ea69e42cea00928adc9b9b52bcbd318388d14cf8be304d38333f21b9d" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.718701 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:22.758639 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.155223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-746497cdbb-48258" event={"ID":"491eddfd-964e-4de3-940f-e22d3f0d2c29","Type":"ContainerStarted","Data":"647be020514c515af3e277477946fbc1c5d789a27386a56e5af3700f76bd321d"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.162397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" event={"ID":"2cae97f7-9440-4fc6-8c35-15fab8987634","Type":"ContainerStarted","Data":"32ee2ea07569326f7865d37227adde1c3380cbbff935de16eb86abc4ea6eb67c"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.166863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" event={"ID":"bcbe4d3d-cecf-48f5-84c3-436b5442228b","Type":"ContainerStarted","Data":"e15abbadf3e48c577ca2118a1b46f14868fc0a17cf1a74a3b2c023b947133f5c"} Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:23.272300 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:23.275371 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:23.277318 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:10:24 crc kubenswrapper[4769]: E1121 13:10:23.277380 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="ovn-northd" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.289449 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1486d261-3fdd-44ad-8dc7-2c8882e668e0" path="/var/lib/kubelet/pods/1486d261-3fdd-44ad-8dc7-2c8882e668e0/volumes" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.290388 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" path="/var/lib/kubelet/pods/7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d/volumes" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.292334 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f101464-9ac6-48d4-848f-d0c89472105f" path="/var/lib/kubelet/pods/8f101464-9ac6-48d4-848f-d0c89472105f/volumes" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.293588 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44" path="/var/lib/kubelet/pods/e57a77a1-67d5-4ffd-b7d6-58eb0aa40b44/volumes" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.294487 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6db24c5-2c0f-4034-93c9-d7cde95605ba" path="/var/lib/kubelet/pods/e6db24c5-2c0f-4034-93c9-d7cde95605ba/volumes" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:23.537330 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.99:6080/vnc_lite.html\": dial tcp 10.217.1.99:6080: connect: connection refused" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.189067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" event={"ID":"933cf65a-d662-413c-8b6f-fa4145f20373","Type":"ContainerStarted","Data":"0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.189809 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.199747 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" event={"ID":"347ea447-ef20-4550-8ad9-be274e65ad9e","Type":"ContainerStarted","Data":"db66bc499117548016d3663ec3a8733b3464af3a068ea1055c43a9cd91cdc128"} Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.200717 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.202169 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.223000 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" podStartSLOduration=7.22298309 podStartE2EDuration="7.22298309s" podCreationTimestamp="2025-11-21 13:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:24.213642228 +0000 UTC m=+4782.914304056" watchObservedRunningTime="2025-11-21 13:10:24.22298309 +0000 UTC m=+4782.923644908" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.234330 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" podStartSLOduration=7.234311265 podStartE2EDuration="7.234311265s" podCreationTimestamp="2025-11-21 13:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:24.231113978 +0000 UTC m=+4782.931775806" watchObservedRunningTime="2025-11-21 13:10:24.234311265 +0000 UTC m=+4782.934973083" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.258310 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" podStartSLOduration=7.254408286 podStartE2EDuration="7.254408286s" podCreationTimestamp="2025-11-21 13:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:24.249844063 +0000 UTC m=+4782.950505881" watchObservedRunningTime="2025-11-21 13:10:24.254408286 +0000 UTC m=+4782.955070114" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.303629 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-545977b555-smlds"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.304011 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker-log" containerID="cri-o://a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60" gracePeriod=30 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.304131 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker" containerID="cri-o://b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597" gracePeriod=30 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.317807 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podStartSLOduration=7.317785943 podStartE2EDuration="7.317785943s" podCreationTimestamp="2025-11-21 13:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:24.282068601 +0000 UTC m=+4782.982730419" watchObservedRunningTime="2025-11-21 13:10:24.317785943 +0000 UTC m=+4783.018447761" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.339313 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podStartSLOduration=7.339294182 podStartE2EDuration="7.339294182s" podCreationTimestamp="2025-11-21 13:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:24.316725534 +0000 UTC m=+4783.017387352" watchObservedRunningTime="2025-11-21 13:10:24.339294182 +0000 UTC m=+4783.039956000" Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.339737 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4"] Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.340035 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener-log" containerID="cri-o://a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c" gracePeriod=30 Nov 21 13:10:24 crc kubenswrapper[4769]: I1121 13:10:24.340580 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener" containerID="cri-o://8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039" gracePeriod=30 Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.015235 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83 is running failed: container process not found" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.016434 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83 is running failed: container process not found" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.017930 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83 is running failed: container process not found" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.018074 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerName="nova-cell1-conductor-conductor" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.226113 4769 generic.go:334] "Generic (PLEG): container finished" podID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerID="a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60" exitCode=143 Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.226291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" event={"ID":"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d","Type":"ContainerDied","Data":"a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60"} Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.236963 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" exitCode=0 Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.237044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6bc4ad50-e2dd-48ec-8af1-5145707c3026","Type":"ContainerDied","Data":"63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe"} Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.244346 4769 generic.go:334] "Generic (PLEG): container finished" podID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" exitCode=0 Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.244416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"627e86c1-37a7-4d28-8b5e-022989d3febf","Type":"ContainerDied","Data":"d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83"} Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.247818 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerID="a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c" exitCode=143 Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.248992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" event={"ID":"d5e07bca-8e97-48d0-92bc-088424ad3566","Type":"ContainerDied","Data":"a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c"} Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.317997 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="7cd69e91-2c3a-4ee5-acf3-b3c2cd146a9d" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.73:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.445987 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.446437 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.450164 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.450299 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" containerName="nova-scheduler-scheduler" Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.561831 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe is running failed: container process not found" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.562614 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe is running failed: container process not found" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.562846 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe is running failed: container process not found" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:25 crc kubenswrapper[4769]: E1121 13:10:25.562874 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.673117 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.701957 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.705428 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.718783 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.731917 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.733342 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.754603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.793006 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.809683 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.826314 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.834297 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.846643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-public-tls-certs\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.846758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-logs\") pod \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.846865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-default\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.846935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-config-data\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-generated\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-config-data\") pod \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-memcached-tls-certs\") pod \"39098700-4859-439d-a783-c9867fc7bcce\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847260 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-generated\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-run-httpd\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-httpd-run\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-kolla-config\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-galera-tls-certs\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847635 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-combined-ca-bundle\") pod \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847696 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9njm\" (UniqueName: \"kubernetes.io/projected/a42113d3-c795-4552-b3ef-77094804c28b-kube-api-access-x9njm\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.847757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-combined-ca-bundle\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.859651 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-log-httpd\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.859734 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9cs7\" (UniqueName: \"kubernetes.io/projected/294817fb-c857-4d11-9a12-23546ad1e93c-kube-api-access-n9cs7\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.859806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzk9l\" (UniqueName: \"kubernetes.io/projected/39098700-4859-439d-a783-c9867fc7bcce-kube-api-access-wzk9l\") pod \"39098700-4859-439d-a783-c9867fc7bcce\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.859866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-sg-core-conf-yaml\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.859935 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l58jr\" (UniqueName: \"kubernetes.io/projected/813a8fa8-2b10-49ef-b98c-cdc429588409-kube-api-access-l58jr\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8hlv\" (UniqueName: \"kubernetes.io/projected/47ccb784-6503-4ea9-b097-28db6c8fb25b-kube-api-access-f8hlv\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-default\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-logs\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-combined-ca-bundle\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-config-data\") pod \"9aaa614d-7f10-480d-be9a-293f7959b164\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-config-data\") pod \"39098700-4859-439d-a783-c9867fc7bcce\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860449 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-kolla-config\") pod \"39098700-4859-439d-a783-c9867fc7bcce\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860574 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcq4l\" (UniqueName: \"kubernetes.io/projected/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-kube-api-access-bcq4l\") pod \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-combined-ca-bundle\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-internal-tls-certs\") pod \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-scripts\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.860932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-ceilometer-tls-certs\") pod \"a42113d3-c795-4552-b3ef-77094804c28b\" (UID: \"a42113d3-c795-4552-b3ef-77094804c28b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vnt6\" (UniqueName: \"kubernetes.io/projected/9aaa614d-7f10-480d-be9a-293f7959b164-kube-api-access-7vnt6\") pod \"9aaa614d-7f10-480d-be9a-293f7959b164\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861101 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-public-tls-certs\") pod \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\" (UID: \"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-scripts\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-galera-tls-certs\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861328 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-combined-ca-bundle\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-combined-ca-bundle\") pod \"9aaa614d-7f10-480d-be9a-293f7959b164\" (UID: \"9aaa614d-7f10-480d-be9a-293f7959b164\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-kolla-config\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-operator-scripts\") pod \"813a8fa8-2b10-49ef-b98c-cdc429588409\" (UID: \"813a8fa8-2b10-49ef-b98c-cdc429588409\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-config-data\") pod \"47ccb784-6503-4ea9-b097-28db6c8fb25b\" (UID: \"47ccb784-6503-4ea9-b097-28db6c8fb25b\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-combined-ca-bundle\") pod \"39098700-4859-439d-a783-c9867fc7bcce\" (UID: \"39098700-4859-439d-a783-c9867fc7bcce\") " Nov 21 13:10:25 crc kubenswrapper[4769]: I1121 13:10:25.861799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-operator-scripts\") pod \"294817fb-c857-4d11-9a12-23546ad1e93c\" (UID: \"294817fb-c857-4d11-9a12-23546ad1e93c\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.854586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.855110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.855367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.855728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.856073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.865543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.875516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-logs" (OuterVolumeSpecName: "logs") pod "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" (UID: "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.881428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.881893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.894714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.910516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.948710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-logs" (OuterVolumeSpecName: "logs") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.949290 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-config-data" (OuterVolumeSpecName: "config-data") pod "39098700-4859-439d-a783-c9867fc7bcce" (UID: "39098700-4859-439d-a783-c9867fc7bcce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.955144 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-scripts" (OuterVolumeSpecName: "scripts") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.955750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42113d3-c795-4552-b3ef-77094804c28b-kube-api-access-x9njm" (OuterVolumeSpecName: "kube-api-access-x9njm") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "kube-api-access-x9njm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.957441 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.960692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "39098700-4859-439d-a783-c9867fc7bcce" (UID: "39098700-4859-439d-a783-c9867fc7bcce"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.969646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-scripts" (OuterVolumeSpecName: "scripts") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.969826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-kube-api-access-bcq4l" (OuterVolumeSpecName: "kube-api-access-bcq4l") pod "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" (UID: "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527"). InnerVolumeSpecName "kube-api-access-bcq4l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:25.999834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39098700-4859-439d-a783-c9867fc7bcce-kube-api-access-wzk9l" (OuterVolumeSpecName: "kube-api-access-wzk9l") pod "39098700-4859-439d-a783-c9867fc7bcce" (UID: "39098700-4859-439d-a783-c9867fc7bcce"). InnerVolumeSpecName "kube-api-access-wzk9l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.000010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.001032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvnnn\" (UniqueName: \"kubernetes.io/projected/066dc797-82a6-41d9-a8db-783d732b26ed-kube-api-access-mvnnn\") pod \"066dc797-82a6-41d9-a8db-783d732b26ed\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.001172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56rfz\" (UniqueName: \"kubernetes.io/projected/acd2a17a-d088-4084-959f-a544d6afdd27-kube-api-access-56rfz\") pod \"acd2a17a-d088-4084-959f-a544d6afdd27\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.001267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-scripts\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.001355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-config-data\") pod \"627e86c1-37a7-4d28-8b5e-022989d3febf\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.001619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-nova-metadata-tls-certs\") pod \"066dc797-82a6-41d9-a8db-783d732b26ed\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.001940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-nova-novncproxy-tls-certs\") pod \"acd2a17a-d088-4084-959f-a544d6afdd27\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-credential-keys\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002067 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-combined-ca-bundle\") pod \"627e86c1-37a7-4d28-8b5e-022989d3febf\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-config-data\") pod \"acd2a17a-d088-4084-959f-a544d6afdd27\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9qtv\" (UniqueName: \"kubernetes.io/projected/627e86c1-37a7-4d28-8b5e-022989d3febf-kube-api-access-t9qtv\") pod \"627e86c1-37a7-4d28-8b5e-022989d3febf\" (UID: \"627e86c1-37a7-4d28-8b5e-022989d3febf\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002202 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-combined-ca-bundle\") pod \"066dc797-82a6-41d9-a8db-783d732b26ed\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-public-tls-certs\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-config-data\") pod \"066dc797-82a6-41d9-a8db-783d732b26ed\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-combined-ca-bundle\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-fernet-keys\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-vencrypt-tls-certs\") pod \"acd2a17a-d088-4084-959f-a544d6afdd27\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-config-data\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/066dc797-82a6-41d9-a8db-783d732b26ed-logs\") pod \"066dc797-82a6-41d9-a8db-783d732b26ed\" (UID: \"066dc797-82a6-41d9-a8db-783d732b26ed\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-internal-tls-certs\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k28f9\" (UniqueName: \"kubernetes.io/projected/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-kube-api-access-k28f9\") pod \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\" (UID: \"6b787f72-180e-4e93-bcd9-ea0185a4d6d8\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.002612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-combined-ca-bundle\") pod \"acd2a17a-d088-4084-959f-a544d6afdd27\" (UID: \"acd2a17a-d088-4084-959f-a544d6afdd27\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003208 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003238 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003254 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bcq4l\" (UniqueName: \"kubernetes.io/projected/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-kube-api-access-bcq4l\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003265 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003324 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003334 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003344 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003354 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003364 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003373 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003406 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/813a8fa8-2b10-49ef-b98c-cdc429588409-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003415 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003424 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003433 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003441 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/813a8fa8-2b10-49ef-b98c-cdc429588409-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003450 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x9njm\" (UniqueName: \"kubernetes.io/projected/a42113d3-c795-4552-b3ef-77094804c28b-kube-api-access-x9njm\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003458 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a42113d3-c795-4552-b3ef-77094804c28b-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003484 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wzk9l\" (UniqueName: \"kubernetes.io/projected/39098700-4859-439d-a783-c9867fc7bcce-kube-api-access-wzk9l\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003493 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/294817fb-c857-4d11-9a12-23546ad1e93c-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003501 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ccb784-6503-4ea9-b097-28db6c8fb25b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.003510 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/39098700-4859-439d-a783-c9867fc7bcce-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.009907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066dc797-82a6-41d9-a8db-783d732b26ed-logs" (OuterVolumeSpecName: "logs") pod "066dc797-82a6-41d9-a8db-783d732b26ed" (UID: "066dc797-82a6-41d9-a8db-783d732b26ed"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.048759 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813a8fa8-2b10-49ef-b98c-cdc429588409-kube-api-access-l58jr" (OuterVolumeSpecName: "kube-api-access-l58jr") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "kube-api-access-l58jr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.048817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aaa614d-7f10-480d-be9a-293f7959b164-kube-api-access-7vnt6" (OuterVolumeSpecName: "kube-api-access-7vnt6") pod "9aaa614d-7f10-480d-be9a-293f7959b164" (UID: "9aaa614d-7f10-480d-be9a-293f7959b164"). InnerVolumeSpecName "kube-api-access-7vnt6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.049239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ccb784-6503-4ea9-b097-28db6c8fb25b-kube-api-access-f8hlv" (OuterVolumeSpecName: "kube-api-access-f8hlv") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "kube-api-access-f8hlv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.068624 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294817fb-c857-4d11-9a12-23546ad1e93c-kube-api-access-n9cs7" (OuterVolumeSpecName: "kube-api-access-n9cs7") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "kube-api-access-n9cs7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.094338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-scripts" (OuterVolumeSpecName: "scripts") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.097276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.097398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd2a17a-d088-4084-959f-a544d6afdd27-kube-api-access-56rfz" (OuterVolumeSpecName: "kube-api-access-56rfz") pod "acd2a17a-d088-4084-959f-a544d6afdd27" (UID: "acd2a17a-d088-4084-959f-a544d6afdd27"). InnerVolumeSpecName "kube-api-access-56rfz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.098476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066dc797-82a6-41d9-a8db-783d732b26ed-kube-api-access-mvnnn" (OuterVolumeSpecName: "kube-api-access-mvnnn") pod "066dc797-82a6-41d9-a8db-783d732b26ed" (UID: "066dc797-82a6-41d9-a8db-783d732b26ed"). InnerVolumeSpecName "kube-api-access-mvnnn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.099546 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-kube-api-access-k28f9" (OuterVolumeSpecName: "kube-api-access-k28f9") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "kube-api-access-k28f9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.106493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627e86c1-37a7-4d28-8b5e-022989d3febf-kube-api-access-t9qtv" (OuterVolumeSpecName: "kube-api-access-t9qtv") pod "627e86c1-37a7-4d28-8b5e-022989d3febf" (UID: "627e86c1-37a7-4d28-8b5e-022989d3febf"). InnerVolumeSpecName "kube-api-access-t9qtv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.107950 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f8hlv\" (UniqueName: \"kubernetes.io/projected/47ccb784-6503-4ea9-b097-28db6c8fb25b-kube-api-access-f8hlv\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.107984 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.107997 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7vnt6\" (UniqueName: \"kubernetes.io/projected/9aaa614d-7f10-480d-be9a-293f7959b164-kube-api-access-7vnt6\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108011 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t9qtv\" (UniqueName: \"kubernetes.io/projected/627e86c1-37a7-4d28-8b5e-022989d3febf-kube-api-access-t9qtv\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108022 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/066dc797-82a6-41d9-a8db-783d732b26ed-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108036 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k28f9\" (UniqueName: \"kubernetes.io/projected/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-kube-api-access-k28f9\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108047 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mvnnn\" (UniqueName: \"kubernetes.io/projected/066dc797-82a6-41d9-a8db-783d732b26ed-kube-api-access-mvnnn\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108059 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-56rfz\" (UniqueName: \"kubernetes.io/projected/acd2a17a-d088-4084-959f-a544d6afdd27-kube-api-access-56rfz\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108070 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108084 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n9cs7\" (UniqueName: \"kubernetes.io/projected/294817fb-c857-4d11-9a12-23546ad1e93c-kube-api-access-n9cs7\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.108095 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l58jr\" (UniqueName: \"kubernetes.io/projected/813a8fa8-2b10-49ef-b98c-cdc429588409-kube-api-access-l58jr\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.111202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.111767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.120504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.204771 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" (UID: "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.209712 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.209754 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.209769 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.209778 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.212482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-config-data" (OuterVolumeSpecName: "config-data") pod "066dc797-82a6-41d9-a8db-783d732b26ed" (UID: "066dc797-82a6-41d9-a8db-783d732b26ed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.219437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.233902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.237235 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "39098700-4859-439d-a783-c9867fc7bcce" (UID: "39098700-4859-439d-a783-c9867fc7bcce"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.246216 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-config-data" (OuterVolumeSpecName: "config-data") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.256328 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "627e86c1-37a7-4d28-8b5e-022989d3febf" (UID: "627e86c1-37a7-4d28-8b5e-022989d3febf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.276339 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.276060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"acd2a17a-d088-4084-959f-a544d6afdd27","Type":"ContainerDied","Data":"210e0d3959d5140c42cd8363d8d63eabe37d4811326b0a18a53c0f41aaa0e2ad"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.276588 4769 scope.go:117] "RemoveContainer" containerID="b58d9e16ddc919310b309f5a62591e237d4d0d0c0d54affe7d1cb916da4fbae3" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.280821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"39098700-4859-439d-a783-c9867fc7bcce","Type":"ContainerDied","Data":"1bc0ddd0acc4697ef9089b265a3ef36c962b9b28894410b79a3dc7bbb0c74925"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.280950 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.285019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"066dc797-82a6-41d9-a8db-783d732b26ed","Type":"ContainerDied","Data":"88a4071cdf3dcb7374dd70f83d7963c9d5d7660f3a66892c15d60c0fd6ae7180"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.285634 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.293518 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.294593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a42113d3-c795-4552-b3ef-77094804c28b","Type":"ContainerDied","Data":"32dba385a6291c4fcb9077039705a3f966b6fa1a9e16d8c9126d27f8627b95a3"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.300266 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.300696 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33/ovn-northd/0.log" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.300775 4769 generic.go:334] "Generic (PLEG): container finished" podID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerID="a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c" exitCode=139 Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.300928 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33","Type":"ContainerDied","Data":"a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.315032 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.322370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"47ccb784-6503-4ea9-b097-28db6c8fb25b","Type":"ContainerDied","Data":"ac3671b249ddcc8a13d94ee992ea074bda7b309f9b8e66d7a443e864449ef560"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.342078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"efa3e39f-ae21-4cf3-b57b-8da9fdfc5527","Type":"ContainerDied","Data":"e66ae2238a13513c26a27b5cd5cb2ca9a2e238ff50ad9b593ab12fdafa2a0620"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.340997 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.322465 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.342264 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.345255 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.345397 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.345484 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.345554 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.345608 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.345962 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6bc4ad50-e2dd-48ec-8af1-5145707c3026","Type":"ContainerDied","Data":"b3a0e4d8d7fa2670d663031864815e1d2da8dbf36ecd941c7996e95a8013bdff"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.346090 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3a0e4d8d7fa2670d663031864815e1d2da8dbf36ecd941c7996e95a8013bdff" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.348054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"627e86c1-37a7-4d28-8b5e-022989d3febf","Type":"ContainerDied","Data":"1e1960a885dfbe9e3e827998b8251ea5db103763d05eec5815956f321adaad08"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.348273 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.352250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"294817fb-c857-4d11-9a12-23546ad1e93c","Type":"ContainerDied","Data":"d0c6a0e2ad2ab953cd999de97e1c4bf8feb342f2dfb60931a57d6469938f266b"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.352647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.353221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.353994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.354607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" event={"ID":"6b787f72-180e-4e93-bcd9-ea0185a4d6d8","Type":"ContainerDied","Data":"caf7d55f9de41b63fbfc71255d7c46e796e9cc9a5e2cb336a4f4fa49eb212714"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.354755 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-787f78dcf9-fpk6h" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.361508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.364623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"9aaa614d-7f10-480d-be9a-293f7959b164","Type":"ContainerDied","Data":"38838936207c4da870b49a0af78f9d0994d8e6bdcdddbb34ec355af22b0a502e"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.367995 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "066dc797-82a6-41d9-a8db-783d732b26ed" (UID: "066dc797-82a6-41d9-a8db-783d732b26ed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.368472 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.373387 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.373598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"813a8fa8-2b10-49ef-b98c-cdc429588409","Type":"ContainerDied","Data":"3f7c8ecaec972b7da49f1e8d9f063cbb6593ffed613ad0f2e20331e5216b593d"} Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.385455 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.412599 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "acd2a17a-d088-4084-959f-a544d6afdd27" (UID: "acd2a17a-d088-4084-959f-a544d6afdd27"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.421361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "066dc797-82a6-41d9-a8db-783d732b26ed" (UID: "066dc797-82a6-41d9-a8db-783d732b26ed"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.422415 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.432637 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" (UID: "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.436076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453210 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453236 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453245 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453259 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453273 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453285 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453294 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453306 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/066dc797-82a6-41d9-a8db-783d732b26ed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.453315 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.460707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.470003 4769 scope.go:117] "RemoveContainer" containerID="7f8c35933458931eadb2725a167371798e62f1201feaa4bd4c65d6c2775bda89" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.481165 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "39098700-4859-439d-a783-c9867fc7bcce" (UID: "39098700-4859-439d-a783-c9867fc7bcce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: W1121 13:10:26.482762 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda385bef9_6879_4869_845e_06b5316937c2.slice/crio-c5ae4a66e4edb17b9c04637b63040a00f6b4217da7e8c9509e7888a504342cf8 WatchSource:0}: Error finding container c5ae4a66e4edb17b9c04637b63040a00f6b4217da7e8c9509e7888a504342cf8: Status 404 returned error can't find the container with id c5ae4a66e4edb17b9c04637b63040a00f6b4217da7e8c9509e7888a504342cf8 Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.500817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.505709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.524520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "813a8fa8-2b10-49ef-b98c-cdc429588409" (UID: "813a8fa8-2b10-49ef-b98c-cdc429588409"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.536634 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.553141 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.554688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr9k8\" (UniqueName: \"kubernetes.io/projected/6bc4ad50-e2dd-48ec-8af1-5145707c3026-kube-api-access-jr9k8\") pod \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.555027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-config-data\") pod \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.555220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-combined-ca-bundle\") pod \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\" (UID: \"6bc4ad50-e2dd-48ec-8af1-5145707c3026\") " Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.555817 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/813a8fa8-2b10-49ef-b98c-cdc429588409-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.555936 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.556021 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.556130 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39098700-4859-439d-a783-c9867fc7bcce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.563450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.574605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc4ad50-e2dd-48ec-8af1-5145707c3026-kube-api-access-jr9k8" (OuterVolumeSpecName: "kube-api-access-jr9k8") pod "6bc4ad50-e2dd-48ec-8af1-5145707c3026" (UID: "6bc4ad50-e2dd-48ec-8af1-5145707c3026"). InnerVolumeSpecName "kube-api-access-jr9k8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.574824 4769 scope.go:117] "RemoveContainer" containerID="8492af9af790ac21f80c3388e456304325713e7ce73812df5f74ebff91bcacde" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.599977 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-config-data" (OuterVolumeSpecName: "config-data") pod "acd2a17a-d088-4084-959f-a544d6afdd27" (UID: "acd2a17a-d088-4084-959f-a544d6afdd27"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.630977 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9aaa614d-7f10-480d-be9a-293f7959b164" (UID: "9aaa614d-7f10-480d-be9a-293f7959b164"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.657198 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.657244 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.657256 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jr9k8\" (UniqueName: \"kubernetes.io/projected/6bc4ad50-e2dd-48ec-8af1-5145707c3026-kube-api-access-jr9k8\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.663452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.705898 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-config-data" (OuterVolumeSpecName: "config-data") pod "9aaa614d-7f10-480d-be9a-293f7959b164" (UID: "9aaa614d-7f10-480d-be9a-293f7959b164"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.706167 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-config-data" (OuterVolumeSpecName: "config-data") pod "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" (UID: "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.708823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6b787f72-180e-4e93-bcd9-ea0185a4d6d8" (UID: "6b787f72-180e-4e93-bcd9-ea0185a4d6d8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.758993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" (UID: "efa3e39f-ae21-4cf3-b57b-8da9fdfc5527"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.759302 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aaa614d-7f10-480d-be9a-293f7959b164-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.759325 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.759337 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.759348 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b787f72-180e-4e93-bcd9-ea0185a4d6d8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.759356 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.800393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-config-data" (OuterVolumeSpecName: "config-data") pod "627e86c1-37a7-4d28-8b5e-022989d3febf" (UID: "627e86c1-37a7-4d28-8b5e-022989d3febf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.802082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "acd2a17a-d088-4084-959f-a544d6afdd27" (UID: "acd2a17a-d088-4084-959f-a544d6afdd27"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.814126 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "294817fb-c857-4d11-9a12-23546ad1e93c" (UID: "294817fb-c857-4d11-9a12-23546ad1e93c"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.824762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "acd2a17a-d088-4084-959f-a544d6afdd27" (UID: "acd2a17a-d088-4084-959f-a544d6afdd27"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.833477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-config-data" (OuterVolumeSpecName: "config-data") pod "6bc4ad50-e2dd-48ec-8af1-5145707c3026" (UID: "6bc4ad50-e2dd-48ec-8af1-5145707c3026"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.852032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6bc4ad50-e2dd-48ec-8af1-5145707c3026" (UID: "6bc4ad50-e2dd-48ec-8af1-5145707c3026"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-config-data" (OuterVolumeSpecName: "config-data") pod "47ccb784-6503-4ea9-b097-28db6c8fb25b" (UID: "47ccb784-6503-4ea9-b097-28db6c8fb25b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862773 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862797 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862806 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/294817fb-c857-4d11-9a12-23546ad1e93c-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862814 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ccb784-6503-4ea9-b097-28db6c8fb25b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862824 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/acd2a17a-d088-4084-959f-a544d6afdd27-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862832 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/627e86c1-37a7-4d28-8b5e-022989d3febf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.862843 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6bc4ad50-e2dd-48ec-8af1-5145707c3026-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.888765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.903928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-config-data" (OuterVolumeSpecName: "config-data") pod "a42113d3-c795-4552-b3ef-77094804c28b" (UID: "a42113d3-c795-4552-b3ef-77094804c28b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.964884 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:26 crc kubenswrapper[4769]: I1121 13:10:26.964913 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a42113d3-c795-4552-b3ef-77094804c28b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.049556 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.119:8778/\": EOF" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.089523 4769 scope.go:117] "RemoveContainer" containerID="7b658a4a7a4b597623de7e7823282d42d5e01fbca41f202db2f4e2e219101942" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.197525 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33/ovn-northd/0.log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.197603 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.247070 4769 scope.go:117] "RemoveContainer" containerID="5d7e44340687c45b4ecbefb05ee05a1c82868ddcb8d9a1bdd9d533de5b41128c" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.259852 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.268889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-metrics-certs-tls-certs\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.269004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-config\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.269088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-scripts\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.269121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xswl\" (UniqueName: \"kubernetes.io/projected/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-kube-api-access-6xswl\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.269152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-northd-tls-certs\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.269203 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-combined-ca-bundle\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.269927 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-config" (OuterVolumeSpecName: "config") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.271010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-rundir\") pod \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\" (UID: \"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.271877 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.272495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.272880 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-scripts" (OuterVolumeSpecName: "scripts") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.376327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-logs\") pod \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.376498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data-custom\") pod \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.376534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdx4m\" (UniqueName: \"kubernetes.io/projected/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-kube-api-access-xdx4m\") pod \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.376564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data\") pod \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.377012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-combined-ca-bundle\") pod \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\" (UID: \"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.377544 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.377558 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.378485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-kube-api-access-6xswl" (OuterVolumeSpecName: "kube-api-access-6xswl") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "kube-api-access-6xswl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.392765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-logs" (OuterVolumeSpecName: "logs") pod "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" (UID: "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.396736 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.403328 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.405497 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.411433 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.422502 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.423419 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.423445 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker-log" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.423464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.423491 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.423594 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.423676 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-log" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.423689 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.423699 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424002 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" containerName="mysql-bootstrap" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424023 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" containerName="mysql-bootstrap" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424041 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="39098700-4859-439d-a783-c9867fc7bcce" containerName="memcached" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424049 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="39098700-4859-439d-a783-c9867fc7bcce" containerName="memcached" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424088 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="galera" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424099 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="galera" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424118 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-api" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424125 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-api" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424137 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424144 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-log" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424181 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" containerName="galera" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424219 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" containerName="galera" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424236 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424244 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424262 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="sg-core" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="sg-core" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" containerName="nova-scheduler-scheduler" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424312 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" containerName="nova-scheduler-scheduler" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424324 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" containerName="keystone-api" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424331 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" containerName="keystone-api" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424346 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-httpd" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-httpd" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424583 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-metadata" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424596 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-metadata" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-notification-agent" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424622 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-notification-agent" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424657 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="proxy-httpd" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424665 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="proxy-httpd" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424678 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424687 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-log" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424698 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="openstack-network-exporter" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424706 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="openstack-network-exporter" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424717 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerName="nova-cell1-conductor-conductor" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424746 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerName="nova-cell1-conductor-conductor" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424757 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="mysql-bootstrap" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424765 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="mysql-bootstrap" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424784 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="ovn-northd" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424792 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="ovn-northd" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.424803 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-central-agent" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.424834 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-central-agent" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425232 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="openstack-network-exporter" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425255 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="39098700-4859-439d-a783-c9867fc7bcce" containerName="memcached" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425347 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425357 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-metadata" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425372 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425384 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-central-agent" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425424 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425434 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="sg-core" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425443 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" containerName="nova-api-api" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425453 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" containerName="keystone-api" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425464 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="proxy-httpd" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425477 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" containerName="ovn-northd" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425508 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" containerName="galera" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425518 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" containerName="nova-scheduler-scheduler" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425531 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425543 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" containerName="galera" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425540 4769 scope.go:117] "RemoveContainer" containerID="d5826e02cd238dcbabbf671c366cb1be4ee2028cc737d163e9a9446630327198" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425556 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425672 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" containerName="nova-metadata-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425695 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a42113d3-c795-4552-b3ef-77094804c28b" containerName="ceilometer-notification-agent" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425705 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" containerName="nova-cell1-conductor-conductor" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425715 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" containerName="glance-httpd" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.425726 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerName="barbican-worker" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.426431 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.429122 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.435340 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.449805 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.461335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" (UID: "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.461576 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.477716 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.480730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvmh\" (UniqueName: \"kubernetes.io/projected/4fa29008-f566-42ca-b07b-24909ba55a2e-kube-api-access-xkvmh\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.480841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.480871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-config-data\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.480949 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6xswl\" (UniqueName: \"kubernetes.io/projected/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-kube-api-access-6xswl\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.480962 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.480972 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.487484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-kube-api-access-xdx4m" (OuterVolumeSpecName: "kube-api-access-xdx4m") pod "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" (UID: "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d"). InnerVolumeSpecName "kube-api-access-xdx4m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.487568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8491287b-46fd-4729-8ab0-8080b38a38f3","Type":"ContainerStarted","Data":"c96cd236611d3654e4ff99f4db0ea7dcdee0c64c42c97ff6957f201edc5b1cdd"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.487741 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.490656 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.490985 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.495194 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.497081 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.505935 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.506136 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.506322 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.506556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ktmdt" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.509720 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.531824 4769 scope.go:117] "RemoveContainer" containerID="6c6a770fb25bfd1257b6284863ebad819245ef1d7727257e1043d9f66bd0465f" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.557073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607","Type":"ContainerStarted","Data":"1b3ad52197bc10ecb54fad2d9e894942092776a84f76eec3f65ba10983b7f034"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.582895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.582953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-config-data\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.583017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvmh\" (UniqueName: \"kubernetes.io/projected/4fa29008-f566-42ca-b07b-24909ba55a2e-kube-api-access-xkvmh\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.583135 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xdx4m\" (UniqueName: \"kubernetes.io/projected/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-kube-api-access-xdx4m\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.592206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.613711 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.630573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvmh\" (UniqueName: \"kubernetes.io/projected/4fa29008-f566-42ca-b07b-24909ba55a2e-kube-api-access-xkvmh\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.630786 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.632710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-config-data\") pod \"nova-scheduler-0\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.640820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"852be43e-77fe-4edf-ba14-fe226cfce274","Type":"ContainerStarted","Data":"6aaf4255cf71c9bb94ce80912bb8fec5a1fe5ddd1d36afc62f44c577c5ecd229"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.648384 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.668451 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.676291 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33/ovn-northd/0.log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.676366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33","Type":"ContainerDied","Data":"237d8f3698a71efce53eacf17db0182a6732daeb3d2632cbbf4621c426275951"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.676469 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.683918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kolla-config\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.683946 4769 generic.go:334] "Generic (PLEG): container finished" podID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" containerID="b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597" exitCode=0 Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.683979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrjq\" (UniqueName: \"kubernetes.io/projected/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kube-api-access-zcrjq\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.683999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" event={"ID":"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d","Type":"ContainerDied","Data":"b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" event={"ID":"78c7cf5b-aab5-4faf-8194-ab8e3f538a6d","Type":"ContainerDied","Data":"78e7fdb4dbc7898b4fc72ba103837107092071fafff96b19f1f51095fdc5eab3"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gvr\" (UniqueName: \"kubernetes.io/projected/8ddd5f84-24dd-43ff-957b-388116a08570-kube-api-access-p4gvr\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684068 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684133 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684164 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-545977b555-smlds" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.684516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-config-data\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.688170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ddd5f84-24dd-43ff-957b-388116a08570-logs\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.688405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-default\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.688588 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.689836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.695996 4769 generic.go:334] "Generic (PLEG): container finished" podID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerID="8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039" exitCode=0 Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.696226 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.696424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" event={"ID":"d5e07bca-8e97-48d0-92bc-088424ad3566","Type":"ContainerDied","Data":"8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.701183 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.703803 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a385bef9-6879-4869-845e-06b5316937c2","Type":"ContainerStarted","Data":"c5ae4a66e4edb17b9c04637b63040a00f6b4217da7e8c9509e7888a504342cf8"} Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.709247 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.716517 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.119:8778/\": net/http: TLS handshake timeout" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.719398 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.719936 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.719953 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener" Nov 21 13:10:27 crc kubenswrapper[4769]: E1121 13:10:27.719985 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.719992 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.720195 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener-log" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.720250 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" containerName="barbican-keystone-listener" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.722106 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.726606 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.727720 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.728505 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.741850 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.751911 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.760624 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.762231 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.764697 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.764809 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.764855 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.773044 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.775239 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.784422 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.786156 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.794837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.795543 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-combined-ca-bundle\") pod \"d5e07bca-8e97-48d0-92bc-088424ad3566\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.795612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data\") pod \"d5e07bca-8e97-48d0-92bc-088424ad3566\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.795751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data-custom\") pod \"d5e07bca-8e97-48d0-92bc-088424ad3566\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.795778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5e07bca-8e97-48d0-92bc-088424ad3566-logs\") pod \"d5e07bca-8e97-48d0-92bc-088424ad3566\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.795803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28hp7\" (UniqueName: \"kubernetes.io/projected/d5e07bca-8e97-48d0-92bc-088424ad3566-kube-api-access-28hp7\") pod \"d5e07bca-8e97-48d0-92bc-088424ad3566\" (UID: \"d5e07bca-8e97-48d0-92bc-088424ad3566\") " Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.796076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.796133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kolla-config\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.796199 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrjq\" (UniqueName: \"kubernetes.io/projected/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kube-api-access-zcrjq\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gvr\" (UniqueName: \"kubernetes.io/projected/8ddd5f84-24dd-43ff-957b-388116a08570-kube-api-access-p4gvr\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-config-data\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801778 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ddd5f84-24dd-43ff-957b-388116a08570-logs\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-default\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.801959 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.799527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kolla-config\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.796947 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.797242 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.798579 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.800367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e07bca-8e97-48d0-92bc-088424ad3566-logs" (OuterVolumeSpecName: "logs") pod "d5e07bca-8e97-48d0-92bc-088424ad3566" (UID: "d5e07bca-8e97-48d0-92bc-088424ad3566"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.808198 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.814388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ddd5f84-24dd-43ff-957b-388116a08570-logs\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.814997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-default\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.815198 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.815238 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.819977 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" (UID: "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.820583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.820698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.828735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-config-data\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.829328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrjq\" (UniqueName: \"kubernetes.io/projected/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kube-api-access-zcrjq\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.829807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gvr\" (UniqueName: \"kubernetes.io/projected/8ddd5f84-24dd-43ff-957b-388116a08570-kube-api-access-p4gvr\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.834196 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.838078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.838301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.842809 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.848722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e07bca-8e97-48d0-92bc-088424ad3566-kube-api-access-28hp7" (OuterVolumeSpecName: "kube-api-access-28hp7") pod "d5e07bca-8e97-48d0-92bc-088424ad3566" (UID: "d5e07bca-8e97-48d0-92bc-088424ad3566"). InnerVolumeSpecName "kube-api-access-28hp7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.848889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d5e07bca-8e97-48d0-92bc-088424ad3566" (UID: "d5e07bca-8e97-48d0-92bc-088424ad3566"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.855618 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.857710 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.860804 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.861019 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.879749 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-787f78dcf9-fpk6h"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.894951 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-787f78dcf9-fpk6h"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-run-httpd\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgk5v\" (UniqueName: \"kubernetes.io/projected/4447c27b-0c4c-444a-981a-df468fe19b6e-kube-api-access-hgk5v\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904653 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-log-httpd\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904710 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-config-data\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wvlr\" (UniqueName: \"kubernetes.io/projected/a4b95613-8dcb-4a9f-86c1-825050bcc265-kube-api-access-5wvlr\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904966 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-scripts\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.904990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs578\" (UniqueName: \"kubernetes.io/projected/60f31c55-36c3-4986-b9f8-432f4f055d75-kube-api-access-fs578\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.905072 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.905083 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.905094 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d5e07bca-8e97-48d0-92bc-088424ad3566-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.905106 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-28hp7\" (UniqueName: \"kubernetes.io/projected/d5e07bca-8e97-48d0-92bc-088424ad3566-kube-api-access-28hp7\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.913940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.928470 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.975770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:27 crc kubenswrapper[4769]: I1121 13:10:27.996025 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.000050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" (UID: "a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.000739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d5e07bca-8e97-48d0-92bc-088424ad3566" (UID: "d5e07bca-8e97-48d0-92bc-088424ad3566"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.002886 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-scripts\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-scripts\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fs578\" (UniqueName: \"kubernetes.io/projected/60f31c55-36c3-4986-b9f8-432f4f055d75-kube-api-access-fs578\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009188 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcv2p\" (UniqueName: \"kubernetes.io/projected/5e4e94a5-7681-4dba-9c88-23c4673511e6-kube-api-access-fcv2p\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009308 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-run-httpd\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hgk5v\" (UniqueName: \"kubernetes.io/projected/4447c27b-0c4c-444a-981a-df468fe19b6e-kube-api-access-hgk5v\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-log-httpd\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-logs\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009510 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-config-data\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009535 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.009569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-config-data\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5wvlr\" (UniqueName: \"kubernetes.io/projected/a4b95613-8dcb-4a9f-86c1-825050bcc265-kube-api-access-5wvlr\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011426 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011437 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.011448 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.017651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.019285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.021815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-scripts\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.021869 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.023392 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.024446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-run-httpd\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.026882 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.029669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.029738 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.029971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-log-httpd\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.041509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-config-data\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.043752 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.044696 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.051071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.058980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.059716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.067982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs578\" (UniqueName: \"kubernetes.io/projected/60f31c55-36c3-4986-b9f8-432f4f055d75-kube-api-access-fs578\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.074773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.074882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.083619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wvlr\" (UniqueName: \"kubernetes.io/projected/a4b95613-8dcb-4a9f-86c1-825050bcc265-kube-api-access-5wvlr\") pod \"ceilometer-0\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.083787 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.100783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data" (OuterVolumeSpecName: "config-data") pod "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" (UID: "78c7cf5b-aab5-4faf-8194-ab8e3f538a6d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.101532 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgk5v\" (UniqueName: \"kubernetes.io/projected/4447c27b-0c4c-444a-981a-df468fe19b6e-kube-api-access-hgk5v\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.109450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.109522 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113199 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-logs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-scripts\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-config-data\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pltcs\" (UniqueName: \"kubernetes.io/projected/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-kube-api-access-pltcs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fcv2p\" (UniqueName: \"kubernetes.io/projected/5e4e94a5-7681-4dba-9c88-23c4673511e6-kube-api-access-fcv2p\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-public-tls-certs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113461 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-internal-tls-certs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-logs\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-config-data\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113636 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.113964 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.117067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.117663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-logs\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.128370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-scripts\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.128808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.147150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-config-data\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.147462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.152851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.178907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcv2p\" (UniqueName: \"kubernetes.io/projected/5e4e94a5-7681-4dba-9c88-23c4673511e6-kube-api-access-fcv2p\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.186892 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.208706 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.208811 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.209374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data" (OuterVolumeSpecName: "config-data") pod "d5e07bca-8e97-48d0-92bc-088424ad3566" (UID: "d5e07bca-8e97-48d0-92bc-088424ad3566"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.212426 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.212576 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.212652 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.212715 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-p5kzh" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.216224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-public-tls-certs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.216279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-internal-tls-certs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.220358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-logs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.220612 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.220657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-config-data\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.220729 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pltcs\" (UniqueName: \"kubernetes.io/projected/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-kube-api-access-pltcs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.220832 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d5e07bca-8e97-48d0-92bc-088424ad3566-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.223290 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.227819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-internal-tls-certs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.228095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-logs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.229053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-public-tls-certs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.231950 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.234904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-config-data\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.237841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.237933 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.241524 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.241660 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xl2bf" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.242450 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.245343 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.257089 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.263731 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.263770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.264793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pltcs\" (UniqueName: \"kubernetes.io/projected/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-kube-api-access-pltcs\") pod \"nova-api-0\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.268641 4769 scope.go:117] "RemoveContainer" containerID="10ab10ccdd652346bb0224d390acd267d226a1f32bd19924396d40d7bf78e3a8" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.294878 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.318482 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2t2\" (UniqueName: \"kubernetes.io/projected/81a1df2f-958e-452c-968a-9e20c8fb6669-kube-api-access-mk2t2\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-kolla-config\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvphg\" (UniqueName: \"kubernetes.io/projected/28b4c080-d344-4492-b6aa-909d533fec32-kube-api-access-cvphg\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/28b4c080-d344-4492-b6aa-909d533fec32-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-memcached-tls-certs\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-combined-ca-bundle\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342834 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-config-data\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.342893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.351591 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.465737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2t2\" (UniqueName: \"kubernetes.io/projected/81a1df2f-958e-452c-968a-9e20c8fb6669-kube-api-access-mk2t2\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-kolla-config\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cvphg\" (UniqueName: \"kubernetes.io/projected/28b4c080-d344-4492-b6aa-909d533fec32-kube-api-access-cvphg\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466742 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/28b4c080-d344-4492-b6aa-909d533fec32-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.466859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.467095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-memcached-tls-certs\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.467138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-combined-ca-bundle\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.467163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-config-data\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.467219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.473976 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.475318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.476559 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.481747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-kolla-config\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.483441 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-config-data\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.486115 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.488786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/28b4c080-d344-4492-b6aa-909d533fec32-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.531982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-memcached-tls-certs\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.532082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.542013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-combined-ca-bundle\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.542582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.544276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2t2\" (UniqueName: \"kubernetes.io/projected/81a1df2f-958e-452c-968a-9e20c8fb6669-kube-api-access-mk2t2\") pod \"memcached-0\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.547142 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvphg\" (UniqueName: \"kubernetes.io/projected/28b4c080-d344-4492-b6aa-909d533fec32-kube-api-access-cvphg\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.560784 4769 scope.go:117] "RemoveContainer" containerID="4fbb2110cc107d67bf9a75444de10b1988f7775f90f500070f6fff7082cb1538" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.584085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.667279 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.680616 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.699262 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.700707 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.705626 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.714833 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.735495 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.776976 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whfpx\" (UniqueName: \"kubernetes.io/projected/f5b6a13f-243f-4eb4-868d-039a2c527c0b-kube-api-access-whfpx\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.777056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.777139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.781985 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"852be43e-77fe-4edf-ba14-fe226cfce274","Type":"ContainerStarted","Data":"35c9b30387654c1f32651b1cf7f65ac9652dc6e47ad5eff620152c7c2d14fcce"} Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.839720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4" event={"ID":"d5e07bca-8e97-48d0-92bc-088424ad3566","Type":"ContainerDied","Data":"b333809b061bb187404ceac06c15cfaec8862c2363a5c75e87ff6702afc27282"} Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.850145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607","Type":"ContainerStarted","Data":"721d6911a1b3ec564dc67fa869793d0b76441f9ba55852b8ac8fa47a47dbc90c"} Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.870585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4fa29008-f566-42ca-b07b-24909ba55a2e","Type":"ContainerStarted","Data":"59f8ed1fa9472cb8fb5d1a57cf8a287575362a7274916239704bcc5c1f35d35f"} Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.881985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-whfpx\" (UniqueName: \"kubernetes.io/projected/f5b6a13f-243f-4eb4-868d-039a2c527c0b-kube-api-access-whfpx\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.882041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.882841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.923393 4769 scope.go:117] "RemoveContainer" containerID="cb3923d25f99d933be32dc55d82648d548e91b6407688fcb0700212da6e727b1" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.942581 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-545977b555-smlds"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.959596 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-545977b555-smlds"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.976256 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.992350 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.997991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-whfpx\" (UniqueName: \"kubernetes.io/projected/f5b6a13f-243f-4eb4-868d-039a2c527c0b-kube-api-access-whfpx\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.998866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:28 crc kubenswrapper[4769]: I1121 13:10:28.999445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.006984 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.008829 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.017337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.017631 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.017857 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.017985 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.018145 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-bfttk" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.025490 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.038022 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-549d5d9cc4-l2wf4"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.041252 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.063162 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: W1121 13:10:29.106470 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddd5f84_24dd_43ff_957b_388116a08570.slice/crio-77f7ef64608c5fa5197001b7913747361d2f13ae5f8f58883759cf5b3b6c8c7d WatchSource:0}: Error finding container 77f7ef64608c5fa5197001b7913747361d2f13ae5f8f58883759cf5b3b6c8c7d: Status 404 returned error can't find the container with id 77f7ef64608c5fa5197001b7913747361d2f13ae5f8f58883759cf5b3b6c8c7d Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.111498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.111669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.111916 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.112024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-scripts\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.112127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d7h4\" (UniqueName: \"kubernetes.io/projected/6e99fec8-485c-4729-bb82-623b8cd00824-kube-api-access-5d7h4\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.112163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-config\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.112262 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.167597 4769 scope.go:117] "RemoveContainer" containerID="11063f90162151039946f4a96bcca396ecf40151a84b3dc6c9a038a4225d3105" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218171 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-scripts\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5d7h4\" (UniqueName: \"kubernetes.io/projected/6e99fec8-485c-4729-bb82-623b8cd00824-kube-api-access-5d7h4\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-config\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218720 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.218765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.221833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.223759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-config\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.224488 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-scripts\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.226538 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.227007 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.235175 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.238278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.243603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.258836 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.259858 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d7h4\" (UniqueName: \"kubernetes.io/projected/6e99fec8-485c-4729-bb82-623b8cd00824-kube-api-access-5d7h4\") pod \"ovn-northd-0\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.268704 4769 scope.go:117] "RemoveContainer" containerID="b0c81123338e28a790f83597d594930e9982b6b022c2f17f56c6e28e8fad5957" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.275060 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.297303 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.315554 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.323992 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="066dc797-82a6-41d9-a8db-783d732b26ed" path="/var/lib/kubelet/pods/066dc797-82a6-41d9-a8db-783d732b26ed/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.325005 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294817fb-c857-4d11-9a12-23546ad1e93c" path="/var/lib/kubelet/pods/294817fb-c857-4d11-9a12-23546ad1e93c/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.326234 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39098700-4859-439d-a783-c9867fc7bcce" path="/var/lib/kubelet/pods/39098700-4859-439d-a783-c9867fc7bcce/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.327572 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ccb784-6503-4ea9-b097-28db6c8fb25b" path="/var/lib/kubelet/pods/47ccb784-6503-4ea9-b097-28db6c8fb25b/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.328298 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="627e86c1-37a7-4d28-8b5e-022989d3febf" path="/var/lib/kubelet/pods/627e86c1-37a7-4d28-8b5e-022989d3febf/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.328828 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b787f72-180e-4e93-bcd9-ea0185a4d6d8" path="/var/lib/kubelet/pods/6b787f72-180e-4e93-bcd9-ea0185a4d6d8/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.329826 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc4ad50-e2dd-48ec-8af1-5145707c3026" path="/var/lib/kubelet/pods/6bc4ad50-e2dd-48ec-8af1-5145707c3026/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.330473 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78c7cf5b-aab5-4faf-8194-ab8e3f538a6d" path="/var/lib/kubelet/pods/78c7cf5b-aab5-4faf-8194-ab8e3f538a6d/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.332646 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="813a8fa8-2b10-49ef-b98c-cdc429588409" path="/var/lib/kubelet/pods/813a8fa8-2b10-49ef-b98c-cdc429588409/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.333371 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aaa614d-7f10-480d-be9a-293f7959b164" path="/var/lib/kubelet/pods/9aaa614d-7f10-480d-be9a-293f7959b164/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.333894 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42113d3-c795-4552-b3ef-77094804c28b" path="/var/lib/kubelet/pods/a42113d3-c795-4552-b3ef-77094804c28b/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.336968 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33" path="/var/lib/kubelet/pods/a98a4a98-1ca0-4faa-8e8d-e8b49ac25c33/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.359636 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd2a17a-d088-4084-959f-a544d6afdd27" path="/var/lib/kubelet/pods/acd2a17a-d088-4084-959f-a544d6afdd27/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.362292 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.371323 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e07bca-8e97-48d0-92bc-088424ad3566" path="/var/lib/kubelet/pods/d5e07bca-8e97-48d0-92bc-088424ad3566/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.372136 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa3e39f-ae21-4cf3-b57b-8da9fdfc5527" path="/var/lib/kubelet/pods/efa3e39f-ae21-4cf3-b57b-8da9fdfc5527/volumes" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.506545 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.548045 4769 scope.go:117] "RemoveContainer" containerID="d7c28a3aa864075ba7f607a050fbb25251442b5ba4a8c1ce09bbe18994650e83" Nov 21 13:10:29 crc kubenswrapper[4769]: W1121 13:10:29.629957 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4b95613_8dcb_4a9f_86c1_825050bcc265.slice/crio-85fa9e2f74b2c884cf055aedf2540238940c901539238d17979903006ccb25f2 WatchSource:0}: Error finding container 85fa9e2f74b2c884cf055aedf2540238940c901539238d17979903006ccb25f2: Status 404 returned error can't find the container with id 85fa9e2f74b2c884cf055aedf2540238940c901539238d17979903006ccb25f2 Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.726889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.733937 4769 scope.go:117] "RemoveContainer" containerID="35a27014b7bbefcddd074ae7ea1e912e548d4d18cd4e291e89cd2c0a2927042e" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.756700 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.833668 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.931360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8491287b-46fd-4729-8ab0-8080b38a38f3","Type":"ContainerStarted","Data":"0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164"} Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.957417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607","Type":"ContainerStarted","Data":"09166ec9c62fa77d0613bc7dadc17139475d45c65088a2c6159406d713c6b7c6"} Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.961836 4769 scope.go:117] "RemoveContainer" containerID="d180ac2119a9c9c91fd65d818a8dc57ed95e8640fa4206f7aa74e66bb5f2cbd8" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.962567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8ddd5f84-24dd-43ff-957b-388116a08570","Type":"ContainerStarted","Data":"bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c"} Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.962662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8ddd5f84-24dd-43ff-957b-388116a08570","Type":"ContainerStarted","Data":"77f7ef64608c5fa5197001b7913747361d2f13ae5f8f58883759cf5b3b6c8c7d"} Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.972225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a385bef9-6879-4869-845e-06b5316937c2","Type":"ContainerStarted","Data":"fc814fc069cbd1e190c895ce856d73e19225e77df6f0e97c56dd9906d2ec82af"} Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.977155 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=7.977141434 podStartE2EDuration="7.977141434s" podCreationTimestamp="2025-11-21 13:10:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:29.974584795 +0000 UTC m=+4788.675246603" watchObservedRunningTime="2025-11-21 13:10:29.977141434 +0000 UTC m=+4788.677803252" Nov 21 13:10:29 crc kubenswrapper[4769]: I1121 13:10:29.981968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"60f31c55-36c3-4986-b9f8-432f4f055d75","Type":"ContainerStarted","Data":"597c7c8d3551426aebf31c6868e24e6f79a11ff8ac7235fa20811a08e36faa38"} Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.008264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerStarted","Data":"85fa9e2f74b2c884cf055aedf2540238940c901539238d17979903006ccb25f2"} Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.017214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4fa29008-f566-42ca-b07b-24909ba55a2e","Type":"ContainerStarted","Data":"defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db"} Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.022595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"852be43e-77fe-4edf-ba14-fe226cfce274","Type":"ContainerStarted","Data":"d51c1c0606b4847e6a8a7725c715a026f637f8e548ff6f2d4587137bf4b3c14a"} Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.053962 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=9.053940752 podStartE2EDuration="9.053940752s" podCreationTimestamp="2025-11-21 13:10:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:30.045905506 +0000 UTC m=+4788.746567324" watchObservedRunningTime="2025-11-21 13:10:30.053940752 +0000 UTC m=+4788.754602570" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.433602 4769 scope.go:117] "RemoveContainer" containerID="d95224c39d2e18fe8d01b1b884a95a32a76c453ffaee51ec40ac31199f6c21fb" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.507705 4769 scope.go:117] "RemoveContainer" containerID="47363a031ddf28af7fb00b04f23a655bf487e8fcc6fad5661121efaef431ad1a" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.538284 4769 scope.go:117] "RemoveContainer" containerID="36b50e3f9bb03ca228f47adf1376811a1c7e1456d6437ab63fccc9df1cf06576" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.609988 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.610137 4769 scope.go:117] "RemoveContainer" containerID="7bfabe64b58db48d6f6909baa3f0bc60ebe5850e7b21025073d7527441d78f73" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.734845 4769 scope.go:117] "RemoveContainer" containerID="897a1af3649915f08a7ae9b1d676845e372af7765e3237f17f4a369729200330" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.742437 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:30 crc kubenswrapper[4769]: W1121 13:10:30.746338 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28b4c080_d344_4492_b6aa_909d533fec32.slice/crio-dbe028ecc6b10f34cd174f47cd09b9102c0dfe5310e21c5cc27007d7d4b09649 WatchSource:0}: Error finding container dbe028ecc6b10f34cd174f47cd09b9102c0dfe5310e21c5cc27007d7d4b09649: Status 404 returned error can't find the container with id dbe028ecc6b10f34cd174f47cd09b9102c0dfe5310e21c5cc27007d7d4b09649 Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.752522 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.858707 4769 scope.go:117] "RemoveContainer" containerID="a7e63585d81617cd7b45c1f48edef8e35024b7277438bcdd5a865b7d1f5d9c5c" Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.883831 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:10:30 crc kubenswrapper[4769]: I1121 13:10:30.905182 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.007295 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.033456 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.041606 4769 scope.go:117] "RemoveContainer" containerID="b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597" Nov 21 13:10:31 crc kubenswrapper[4769]: W1121 13:10:31.044133 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4447c27b_0c4c_444a_981a_df468fe19b6e.slice/crio-a69fb0a8a93f45e9210c9957d2b4731e233da7ede2d4e2fcc3857e2209ac0f4c WatchSource:0}: Error finding container a69fb0a8a93f45e9210c9957d2b4731e233da7ede2d4e2fcc3857e2209ac0f4c: Status 404 returned error can't find the container with id a69fb0a8a93f45e9210c9957d2b4731e233da7ede2d4e2fcc3857e2209ac0f4c Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.060292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8491287b-46fd-4729-8ab0-8080b38a38f3","Type":"ContainerStarted","Data":"f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.087436 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=9.087416354 podStartE2EDuration="9.087416354s" podCreationTimestamp="2025-11-21 13:10:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:31.085570854 +0000 UTC m=+4789.786232672" watchObservedRunningTime="2025-11-21 13:10:31.087416354 +0000 UTC m=+4789.788078172" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.089220 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8ddd5f84-24dd-43ff-957b-388116a08570","Type":"ContainerStarted","Data":"da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.099085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"28b4c080-d344-4492-b6aa-909d533fec32","Type":"ContainerStarted","Data":"dbe028ecc6b10f34cd174f47cd09b9102c0dfe5310e21c5cc27007d7d4b09649"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.100553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerStarted","Data":"8098984b8040d2e9025fe01f36eee46aeab3991446b8878795477b09f13572c0"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.102181 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"60f31c55-36c3-4986-b9f8-432f4f055d75","Type":"ContainerStarted","Data":"c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.111501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"45f57e1d-5fbf-42c7-9f34-fa747091c0c2","Type":"ContainerStarted","Data":"bd152b236b1911bbb6bb725a0044c8857eb6c66fdcb07f291a40fdb79241e38a"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.124764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5e4e94a5-7681-4dba-9c88-23c4673511e6","Type":"ContainerStarted","Data":"b9cc0c56eacbe783cf310915caedb62f8fdaabbafd9063d53d770de97b81a1af"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.137081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"81a1df2f-958e-452c-968a-9e20c8fb6669","Type":"ContainerStarted","Data":"4148f371230e4ab5d317808106b7320a319d1b91881289738a7bae1ddf2da27b"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.153775 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=4.153757911 podStartE2EDuration="4.153757911s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:31.152647051 +0000 UTC m=+4789.853308869" watchObservedRunningTime="2025-11-21 13:10:31.153757911 +0000 UTC m=+4789.854419729" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.161103 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.161085089 podStartE2EDuration="4.161085089s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:31.125249903 +0000 UTC m=+4789.825911721" watchObservedRunningTime="2025-11-21 13:10:31.161085089 +0000 UTC m=+4789.861746907" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.175545 4769 generic.go:334] "Generic (PLEG): container finished" podID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerID="74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f" exitCode=0 Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.176505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1","Type":"ContainerDied","Data":"74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.176557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1","Type":"ContainerStarted","Data":"5e091aeb83f00dce501ba309a2093ad2c9eae1d4a805e8cd560e2d4e154f8f5c"} Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.177597 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.199097 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=4.199081681 podStartE2EDuration="4.199081681s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:31.196530843 +0000 UTC m=+4789.897192661" watchObservedRunningTime="2025-11-21 13:10:31.199081681 +0000 UTC m=+4789.899743499" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.243982 4769 scope.go:117] "RemoveContainer" containerID="a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.257855 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.315926 4769 scope.go:117] "RemoveContainer" containerID="b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597" Nov 21 13:10:31 crc kubenswrapper[4769]: E1121 13:10:31.318827 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597\": container with ID starting with b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597 not found: ID does not exist" containerID="b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.318868 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597"} err="failed to get container status \"b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597\": rpc error: code = NotFound desc = could not find container \"b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597\": container with ID starting with b5227a766211432021636d408d6bc1ae0b66b8712da9c5950487e82b26d9b597 not found: ID does not exist" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.318895 4769 scope.go:117] "RemoveContainer" containerID="a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60" Nov 21 13:10:31 crc kubenswrapper[4769]: E1121 13:10:31.319272 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60\": container with ID starting with a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60 not found: ID does not exist" containerID="a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.319361 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60"} err="failed to get container status \"a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60\": rpc error: code = NotFound desc = could not find container \"a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60\": container with ID starting with a4188d87c069240fb1c0c5fcfe625b201f0479d51794d1c2fa54ef25690c4d60 not found: ID does not exist" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.319425 4769 scope.go:117] "RemoveContainer" containerID="8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.378333 4769 scope.go:117] "RemoveContainer" containerID="a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.419395 4769 scope.go:117] "RemoveContainer" containerID="8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039" Nov 21 13:10:31 crc kubenswrapper[4769]: E1121 13:10:31.420338 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039\": container with ID starting with 8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039 not found: ID does not exist" containerID="8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.420379 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039"} err="failed to get container status \"8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039\": rpc error: code = NotFound desc = could not find container \"8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039\": container with ID starting with 8c7f2bcd3f3759815b5a5457aa3574ffb5af93a929e4ef3bfa38d5ac8ed10039 not found: ID does not exist" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.420406 4769 scope.go:117] "RemoveContainer" containerID="a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c" Nov 21 13:10:31 crc kubenswrapper[4769]: E1121 13:10:31.421610 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c\": container with ID starting with a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c not found: ID does not exist" containerID="a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.421648 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c"} err="failed to get container status \"a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c\": rpc error: code = NotFound desc = could not find container \"a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c\": container with ID starting with a3fbe14dabde008f4010b047d210c63a95c141a0b762413b0738e096e546d94c not found: ID does not exist" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.719551 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:31 crc kubenswrapper[4769]: I1121 13:10:31.769962 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.112402 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.175433 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.223145 4769 generic.go:334] "Generic (PLEG): container finished" podID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerID="7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225" exitCode=0 Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.223322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" event={"ID":"89da9de0-4b00-4ae1-a996-a9e9305ae1d7","Type":"ContainerDied","Data":"7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.223635 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.223648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" event={"ID":"89da9de0-4b00-4ae1-a996-a9e9305ae1d7","Type":"ContainerDied","Data":"7085214baebcb31aed065e1aa04c78b5b8aa229e420f6fb36e411b88188984ff"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.223330 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7f99cd444b-5ml4j" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.224347 4769 scope.go:117] "RemoveContainer" containerID="7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.228827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-config-data\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.228877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-scripts\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.228904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-combined-ca-bundle\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.228939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-logs\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.228998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-public-tls-certs\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.229107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-internal-tls-certs\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.229140 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2nqp\" (UniqueName: \"kubernetes.io/projected/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-kube-api-access-b2nqp\") pod \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\" (UID: \"89da9de0-4b00-4ae1-a996-a9e9305ae1d7\") " Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.232947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-logs" (OuterVolumeSpecName: "logs") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.239150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"81a1df2f-958e-452c-968a-9e20c8fb6669","Type":"ContainerStarted","Data":"5d691d554f00fca7fad6d3b5b95e5bbf915c57b162f38257da99697702858589"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.239580 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.239636 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-kube-api-access-b2nqp" (OuterVolumeSpecName: "kube-api-access-b2nqp") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "kube-api-access-b2nqp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.255752 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-scripts" (OuterVolumeSpecName: "scripts") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.281622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerStarted","Data":"6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.282217 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.286433 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.286825 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.311114 4769 scope.go:117] "RemoveContainer" containerID="5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.311617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6e99fec8-485c-4729-bb82-623b8cd00824","Type":"ContainerStarted","Data":"6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.311653 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6e99fec8-485c-4729-bb82-623b8cd00824","Type":"ContainerStarted","Data":"e132cf9a7d7b7acd6efa2dbe0e767cd8287eaf1185f6fe30ab1cee501a4e4edc"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.326649 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=5.326623127 podStartE2EDuration="5.326623127s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:32.319973448 +0000 UTC m=+4791.020635266" watchObservedRunningTime="2025-11-21 13:10:32.326623127 +0000 UTC m=+4791.027284945" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.334083 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.334115 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.334128 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b2nqp\" (UniqueName: \"kubernetes.io/projected/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-kube-api-access-b2nqp\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.335467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"45f57e1d-5fbf-42c7-9f34-fa747091c0c2","Type":"ContainerStarted","Data":"ea2904c509111773753e8b4f3752ef32c2f9670f1a1f373bb2ccb33275a378cd"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.335503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"45f57e1d-5fbf-42c7-9f34-fa747091c0c2","Type":"ContainerStarted","Data":"23f8a542b5d7c1f93785908528c3c12d30a32293a4d0181ea48c7161f77868c7"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.346447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.358493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerStarted","Data":"94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.358539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerStarted","Data":"a69fb0a8a93f45e9210c9957d2b4731e233da7ede2d4e2fcc3857e2209ac0f4c"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.359146 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.359986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerStarted","Data":"9a4778b350a270984c137eb79a4d2db49d7069ed5606fd6f17bc387e9d8944ef"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.361149 4769 generic.go:334] "Generic (PLEG): container finished" podID="28b4c080-d344-4492-b6aa-909d533fec32" containerID="08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e" exitCode=0 Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.361215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"28b4c080-d344-4492-b6aa-909d533fec32","Type":"ContainerDied","Data":"08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.372521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1","Type":"ContainerStarted","Data":"8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.414946 4769 scope.go:117] "RemoveContainer" containerID="7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.421907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a385bef9-6879-4869-845e-06b5316937c2","Type":"ContainerStarted","Data":"6f516748fbf8b1d29979e55b145e153cb75e694f3ca4dbb5d5c0ec744eb5a0fe"} Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.422136 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api-log" containerID="cri-o://fc814fc069cbd1e190c895ce856d73e19225e77df6f0e97c56dd9906d2ec82af" gracePeriod=30 Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.422321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.422410 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api" containerID="cri-o://6f516748fbf8b1d29979e55b145e153cb75e694f3ca4dbb5d5c0ec744eb5a0fe" gracePeriod=30 Nov 21 13:10:32 crc kubenswrapper[4769]: E1121 13:10:32.433825 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225\": container with ID starting with 7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225 not found: ID does not exist" containerID="7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.433873 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225"} err="failed to get container status \"7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225\": rpc error: code = NotFound desc = could not find container \"7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225\": container with ID starting with 7462003bdde56831ebca058123282080a62e5ae3fad429185a1e5567aadd6225 not found: ID does not exist" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.433897 4769 scope.go:117] "RemoveContainer" containerID="5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.436256 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: E1121 13:10:32.436611 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81\": container with ID starting with 5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81 not found: ID does not exist" containerID="5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.436657 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81"} err="failed to get container status \"5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81\": rpc error: code = NotFound desc = could not find container \"5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81\": container with ID starting with 5b23c76e1aaff1d0230c2353dd0a7685124eba71263784577b9e5c2564cbda81 not found: ID does not exist" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.440916 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.451285 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=4.451267695 podStartE2EDuration="4.451267695s" podCreationTimestamp="2025-11-21 13:10:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:32.376651414 +0000 UTC m=+4791.077313232" watchObservedRunningTime="2025-11-21 13:10:32.451267695 +0000 UTC m=+4791.151929513" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.454384 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=5.454372818 podStartE2EDuration="5.454372818s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:32.445394586 +0000 UTC m=+4791.146056404" watchObservedRunningTime="2025-11-21 13:10:32.454372818 +0000 UTC m=+4791.155034636" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.471332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-config-data" (OuterVolumeSpecName: "config-data") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.527516 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.537494 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.539236 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.540639 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.556943 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=5.556923561 podStartE2EDuration="5.556923561s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:32.5383338 +0000 UTC m=+4791.238995618" watchObservedRunningTime="2025-11-21 13:10:32.556923561 +0000 UTC m=+4791.257585379" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.642345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "89da9de0-4b00-4ae1-a996-a9e9305ae1d7" (UID: "89da9de0-4b00-4ae1-a996-a9e9305ae1d7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.644351 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89da9de0-4b00-4ae1-a996-a9e9305ae1d7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.669546 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=5.669527434 podStartE2EDuration="5.669527434s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:32.613608078 +0000 UTC m=+4791.314269896" watchObservedRunningTime="2025-11-21 13:10:32.669527434 +0000 UTC m=+4791.370189252" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.705681 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=11.705660188 podStartE2EDuration="11.705660188s" podCreationTimestamp="2025-11-21 13:10:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:32.679287197 +0000 UTC m=+4791.379949035" watchObservedRunningTime="2025-11-21 13:10:32.705660188 +0000 UTC m=+4791.406322006" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.766408 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.766447 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.776301 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.900522 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.903751 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7f99cd444b-5ml4j"] Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.916792 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7f99cd444b-5ml4j"] Nov 21 13:10:32 crc kubenswrapper[4769]: I1121 13:10:32.926124 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.273573 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.273861 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.299483 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" path="/var/lib/kubelet/pods/89da9de0-4b00-4ae1-a996-a9e9305ae1d7/volumes" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.303936 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.303995 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.481419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"28b4c080-d344-4492-b6aa-909d533fec32","Type":"ContainerStarted","Data":"454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a"} Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.511480 4769 generic.go:334] "Generic (PLEG): container finished" podID="a385bef9-6879-4869-845e-06b5316937c2" containerID="6f516748fbf8b1d29979e55b145e153cb75e694f3ca4dbb5d5c0ec744eb5a0fe" exitCode=0 Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.511537 4769 generic.go:334] "Generic (PLEG): container finished" podID="a385bef9-6879-4869-845e-06b5316937c2" containerID="fc814fc069cbd1e190c895ce856d73e19225e77df6f0e97c56dd9906d2ec82af" exitCode=143 Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.511628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a385bef9-6879-4869-845e-06b5316937c2","Type":"ContainerDied","Data":"6f516748fbf8b1d29979e55b145e153cb75e694f3ca4dbb5d5c0ec744eb5a0fe"} Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.511654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a385bef9-6879-4869-845e-06b5316937c2","Type":"ContainerDied","Data":"fc814fc069cbd1e190c895ce856d73e19225e77df6f0e97c56dd9906d2ec82af"} Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.515746 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=6.515735861 podStartE2EDuration="6.515735861s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:33.513754528 +0000 UTC m=+4792.214416346" watchObservedRunningTime="2025-11-21 13:10:33.515735861 +0000 UTC m=+4792.216397679" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.532734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6e99fec8-485c-4729-bb82-623b8cd00824","Type":"ContainerStarted","Data":"a5aad00ff05c150b93f70bd16b1ceeef86ed5980b761b995801e435b824bf874"} Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.533513 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.542532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerStarted","Data":"9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675"} Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.547387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5e4e94a5-7681-4dba-9c88-23c4673511e6","Type":"ContainerStarted","Data":"873b2156865008f4291604f305057144026f4ae1f066b89bc5c688084e077533"} Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.547424 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.547878 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.567431 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=5.567406803 podStartE2EDuration="5.567406803s" podCreationTimestamp="2025-11-21 13:10:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:33.552353707 +0000 UTC m=+4792.253015525" watchObservedRunningTime="2025-11-21 13:10:33.567406803 +0000 UTC m=+4792.268068621" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.664897 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-public-tls-certs\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782459 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-internal-tls-certs\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-scripts\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a385bef9-6879-4869-845e-06b5316937c2-etc-machine-id\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782666 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-combined-ca-bundle\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlsd5\" (UniqueName: \"kubernetes.io/projected/a385bef9-6879-4869-845e-06b5316937c2-kube-api-access-hlsd5\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a385bef9-6879-4869-845e-06b5316937c2-logs\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.782741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data-custom\") pod \"a385bef9-6879-4869-845e-06b5316937c2\" (UID: \"a385bef9-6879-4869-845e-06b5316937c2\") " Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.783080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a385bef9-6879-4869-845e-06b5316937c2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.783547 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/a385bef9-6879-4869-845e-06b5316937c2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.801150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a385bef9-6879-4869-845e-06b5316937c2-kube-api-access-hlsd5" (OuterVolumeSpecName: "kube-api-access-hlsd5") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "kube-api-access-hlsd5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.827863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a385bef9-6879-4869-845e-06b5316937c2-logs" (OuterVolumeSpecName: "logs") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.848437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-scripts" (OuterVolumeSpecName: "scripts") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.863212 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.863665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.884783 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.884815 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hlsd5\" (UniqueName: \"kubernetes.io/projected/a385bef9-6879-4869-845e-06b5316937c2-kube-api-access-hlsd5\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.884827 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.884836 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a385bef9-6879-4869-845e-06b5316937c2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.884844 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.917369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.922862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data" (OuterVolumeSpecName: "config-data") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.938663 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a385bef9-6879-4869-845e-06b5316937c2" (UID: "a385bef9-6879-4869-845e-06b5316937c2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.986456 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.986496 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:33 crc kubenswrapper[4769]: I1121 13:10:33.986514 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a385bef9-6879-4869-845e-06b5316937c2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.042609 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.557415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"a385bef9-6879-4869-845e-06b5316937c2","Type":"ContainerDied","Data":"c5ae4a66e4edb17b9c04637b63040a00f6b4217da7e8c9509e7888a504342cf8"} Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.557423 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.557761 4769 scope.go:117] "RemoveContainer" containerID="6f516748fbf8b1d29979e55b145e153cb75e694f3ca4dbb5d5c0ec744eb5a0fe" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.560454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5e4e94a5-7681-4dba-9c88-23c4673511e6","Type":"ContainerStarted","Data":"73ef3fc058d2a0a57ad2bac828877997113b978b36b4263da816db65eea21bec"} Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.589359 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=7.589339413 podStartE2EDuration="7.589339413s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:34.586121637 +0000 UTC m=+4793.286783455" watchObservedRunningTime="2025-11-21 13:10:34.589339413 +0000 UTC m=+4793.290001241" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.597140 4769 scope.go:117] "RemoveContainer" containerID="fc814fc069cbd1e190c895ce856d73e19225e77df6f0e97c56dd9906d2ec82af" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.632512 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.652494 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.668390 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:34 crc kubenswrapper[4769]: E1121 13:10:34.669178 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-api" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669273 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-api" Nov 21 13:10:34 crc kubenswrapper[4769]: E1121 13:10:34.669341 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api-log" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669389 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api-log" Nov 21 13:10:34 crc kubenswrapper[4769]: E1121 13:10:34.669447 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-log" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669525 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-log" Nov 21 13:10:34 crc kubenswrapper[4769]: E1121 13:10:34.669591 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669640 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669852 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-api" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669928 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.669991 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="89da9de0-4b00-4ae1-a996-a9e9305ae1d7" containerName="placement-log" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.670048 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a385bef9-6879-4869-845e-06b5316937c2" containerName="cinder-api-log" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.671137 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.677619 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.677808 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.677953 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.679773 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701057 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-public-tls-certs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhd26\" (UniqueName: \"kubernetes.io/projected/637bec3e-e202-490a-b451-9596f3f86b73-kube-api-access-xhd26\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data-custom\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701492 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-scripts\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/637bec3e-e202-490a-b451-9596f3f86b73-etc-machine-id\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.701569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/637bec3e-e202-490a-b451-9596f3f86b73-logs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.803294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804378 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-public-tls-certs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xhd26\" (UniqueName: \"kubernetes.io/projected/637bec3e-e202-490a-b451-9596f3f86b73-kube-api-access-xhd26\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data-custom\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-scripts\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/637bec3e-e202-490a-b451-9596f3f86b73-etc-machine-id\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.804993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/637bec3e-e202-490a-b451-9596f3f86b73-logs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.805578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/637bec3e-e202-490a-b451-9596f3f86b73-logs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.806544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/637bec3e-e202-490a-b451-9596f3f86b73-etc-machine-id\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.809744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.810673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data-custom\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.815074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.820024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-scripts\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.829715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhd26\" (UniqueName: \"kubernetes.io/projected/637bec3e-e202-490a-b451-9596f3f86b73-kube-api-access-xhd26\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.831796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-public-tls-certs\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:34 crc kubenswrapper[4769]: I1121 13:10:34.835627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.002955 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.257253 4769 log.go:32] "ExecSync cmd from runtime service failed" err=< Nov 21 13:10:35 crc kubenswrapper[4769]: rpc error: code = Unknown desc = command error: setns `mnt`: Bad file descriptor Nov 21 13:10:35 crc kubenswrapper[4769]: fail startup Nov 21 13:10:35 crc kubenswrapper[4769]: , stdout: , stderr: , exit code -1 Nov 21 13:10:35 crc kubenswrapper[4769]: > containerID="94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.260612 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9 is running failed: container process not found" containerID="94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.261424 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9 is running failed: container process not found" containerID="94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.261457 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9 is running failed: container process not found" probeType="Liveness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.302054 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a385bef9-6879-4869-845e-06b5316937c2" path="/var/lib/kubelet/pods/a385bef9-6879-4869-845e-06b5316937c2/volumes" Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.316946 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920 is running failed: container process not found" containerID="6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.317459 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920 is running failed: container process not found" containerID="6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.318094 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920 is running failed: container process not found" containerID="6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:35 crc kubenswrapper[4769]: E1121 13:10:35.318126 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920 is running failed: container process not found" probeType="Liveness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.555007 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.595999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerStarted","Data":"1d623dc794ddb57c8c416420ccb01eb9b4d33c16c471a747a95e74fb8ff1f279"} Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.598668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"637bec3e-e202-490a-b451-9596f3f86b73","Type":"ContainerStarted","Data":"9d8c53ed0eae26a0d098db1792649e06050f2f66dad2c48d18b259e1071cf471"} Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.600848 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerID="6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920" exitCode=1 Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.600911 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerDied","Data":"6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920"} Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.601514 4769 scope.go:117] "RemoveContainer" containerID="6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920" Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.624434 4769 generic.go:334] "Generic (PLEG): container finished" podID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerID="94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9" exitCode=1 Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.624544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerDied","Data":"94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9"} Nov 21 13:10:35 crc kubenswrapper[4769]: I1121 13:10:35.624972 4769 scope.go:117] "RemoveContainer" containerID="94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9" Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.643473 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerStarted","Data":"05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4"} Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.644262 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.646343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerStarted","Data":"1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b"} Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.647387 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.651838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"637bec3e-e202-490a-b451-9596f3f86b73","Type":"ContainerStarted","Data":"39240e6a8a90c38b0d866fb78bc1c32be5f74c19dac63d3bd1dcf5b2e5eeef3f"} Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.695304 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:36 crc kubenswrapper[4769]: I1121 13:10:36.696186 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:37 crc kubenswrapper[4769]: I1121 13:10:37.295376 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:37 crc kubenswrapper[4769]: I1121 13:10:37.295429 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:37 crc kubenswrapper[4769]: I1121 13:10:37.670353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"637bec3e-e202-490a-b451-9596f3f86b73","Type":"ContainerStarted","Data":"876e72db585aa92494a4050fcc14bc0d99eba0e90d774c3a3319e792eda5680f"} Nov 21 13:10:37 crc kubenswrapper[4769]: I1121 13:10:37.670678 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:37 crc kubenswrapper[4769]: I1121 13:10:37.703449 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.703432555 podStartE2EDuration="3.703432555s" podCreationTimestamp="2025-11-21 13:10:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:37.698538333 +0000 UTC m=+4796.399200161" watchObservedRunningTime="2025-11-21 13:10:37.703432555 +0000 UTC m=+4796.404094373" Nov 21 13:10:37 crc kubenswrapper[4769]: I1121 13:10:37.775962 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.263005 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.296539 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.297098 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.302494 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.302528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.323565 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.323622 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.418391 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.683801 4769 generic.go:334] "Generic (PLEG): container finished" podID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerID="1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b" exitCode=1 Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.683864 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerDied","Data":"1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b"} Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.683895 4769 scope.go:117] "RemoveContainer" containerID="94133b52d009e9cac9210e8a5d06ec66148d496a0c79594fdfc952bf1ad1ebc9" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.684612 4769 scope.go:117] "RemoveContainer" containerID="1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b" Nov 21 13:10:38 crc kubenswrapper[4769]: E1121 13:10:38.684998 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(4447c27b-0c4c-444a-981a-df468fe19b6e)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.687852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerStarted","Data":"25ba5b27062f1568ba7b9b7588cdef03b351d97989e70bfc22e3b666ece3192a"} Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.687890 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.732388 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.746701 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=4.043171043 podStartE2EDuration="11.746683108s" podCreationTimestamp="2025-11-21 13:10:27 +0000 UTC" firstStartedPulling="2025-11-21 13:10:29.757430297 +0000 UTC m=+4788.458092115" lastFinishedPulling="2025-11-21 13:10:37.460942362 +0000 UTC m=+4796.161604180" observedRunningTime="2025-11-21 13:10:38.744670134 +0000 UTC m=+4797.445331952" watchObservedRunningTime="2025-11-21 13:10:38.746683108 +0000 UTC m=+4797.447344926" Nov 21 13:10:38 crc kubenswrapper[4769]: I1121 13:10:38.813126 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.042291 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.067379 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.227690 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.227744 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.260077 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.260133 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.272443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.297485 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.297646 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.298768 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.298810 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.322375 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.135:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.322398 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.135:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.443131 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.458454 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.471894 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.535864 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.536100 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-log" containerID="cri-o://0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.536179 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-httpd" containerID="cri-o://f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.617703 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6f699bcfc4-4pddg"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.618283 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-httpd" containerID="cri-o://0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.618264 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-api" containerID="cri-o://16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.635061 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-846ccd89dd-j22ct"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.635333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" podUID="dbb0650d-c5a5-4749-b8ca-642300da8535" containerName="keystone-api" containerID="cri-o://de60df9b83d974676643990b8f723b82df66a50899862f2d4142a3a12c8b8f89" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.659247 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8576757c54-nblzm"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.661591 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.683281 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" podUID="dbb0650d-c5a5-4749-b8ca-642300da8535" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.129:5000/v3\": EOF" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.683990 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6986bbf45b-vgn4n"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.686029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-fernet-keys\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717565 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g7hm\" (UniqueName: \"kubernetes.io/projected/9be129cd-9422-434a-b2aa-0d9c3d8423e0-kube-api-access-7g7hm\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-internal-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-credential-keys\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-scripts\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-public-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-config\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-httpd-config\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717741 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-internal-tls-certs\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n289s\" (UniqueName: \"kubernetes.io/projected/9d48ea37-164f-4a8b-955d-b3b7416672de-kube-api-access-n289s\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-combined-ca-bundle\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-ovndb-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-config-data\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-combined-ca-bundle\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.717909 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-public-tls-certs\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.724291 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6986bbf45b-vgn4n"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.753417 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerID="05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4" exitCode=1 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.753510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerDied","Data":"05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4"} Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.753542 4769 scope.go:117] "RemoveContainer" containerID="6d60141a33eb88e07a12b4dbbdcff14c949425d0ec6b3e1a3eb931d212379920" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.754209 4769 scope.go:117] "RemoveContainer" containerID="05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4" Nov 21 13:10:39 crc kubenswrapper[4769]: E1121 13:10:39.754426 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(f5b6a13f-243f-4eb4-868d-039a2c527c0b)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.771406 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-log" containerID="cri-o://23f8a542b5d7c1f93785908528c3c12d30a32293a4d0181ea48c7161f77868c7" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.776281 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-api" containerID="cri-o://ea2904c509111773753e8b4f3752ef32c2f9670f1a1f373bb2ccb33275a378cd" gracePeriod=30 Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.776742 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.777346 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.788645 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.141:8774/\": EOF" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.802515 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.141:8774/\": EOF" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.821249 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8576757c54-nblzm"] Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.821678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n289s\" (UniqueName: \"kubernetes.io/projected/9d48ea37-164f-4a8b-955d-b3b7416672de-kube-api-access-n289s\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.821906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-combined-ca-bundle\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-ovndb-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-config-data\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-combined-ca-bundle\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-public-tls-certs\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-fernet-keys\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7g7hm\" (UniqueName: \"kubernetes.io/projected/9be129cd-9422-434a-b2aa-0d9c3d8423e0-kube-api-access-7g7hm\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822330 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-internal-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-credential-keys\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-scripts\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822453 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-public-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-config\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-httpd-config\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.822555 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-internal-tls-certs\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.858403 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.858468 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.994780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-public-tls-certs\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.994981 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-credential-keys\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.995826 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-combined-ca-bundle\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.997606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-scripts\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:39 crc kubenswrapper[4769]: I1121 13:10:39.999559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-fernet-keys\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:39.999888 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-combined-ca-bundle\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.004216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-config-data\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.005851 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-httpd-config\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.011470 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-ovndb-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.011613 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-internal-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.011837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n289s\" (UniqueName: \"kubernetes.io/projected/9d48ea37-164f-4a8b-955d-b3b7416672de-kube-api-access-n289s\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.011946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-config\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.011971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g7hm\" (UniqueName: \"kubernetes.io/projected/9be129cd-9422-434a-b2aa-0d9c3d8423e0-kube-api-access-7g7hm\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.016290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-internal-tls-certs\") pod \"keystone-6986bbf45b-vgn4n\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.028067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-public-tls-certs\") pod \"neutron-8576757c54-nblzm\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.046712 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.207010 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.287527 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.742348 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6986bbf45b-vgn4n"] Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.800808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" event={"ID":"9be129cd-9422-434a-b2aa-0d9c3d8423e0","Type":"ContainerStarted","Data":"071a2edf793e5b603f789af202c88539eda751c78d2e2b2f36c623e6b29daafc"} Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.812380 4769 generic.go:334] "Generic (PLEG): container finished" podID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerID="23f8a542b5d7c1f93785908528c3c12d30a32293a4d0181ea48c7161f77868c7" exitCode=143 Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.812451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"45f57e1d-5fbf-42c7-9f34-fa747091c0c2","Type":"ContainerDied","Data":"23f8a542b5d7c1f93785908528c3c12d30a32293a4d0181ea48c7161f77868c7"} Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.821815 4769 generic.go:334] "Generic (PLEG): container finished" podID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerID="0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164" exitCode=143 Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.821890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8491287b-46fd-4729-8ab0-8080b38a38f3","Type":"ContainerDied","Data":"0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164"} Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.832730 4769 generic.go:334] "Generic (PLEG): container finished" podID="933cf65a-d662-413c-8b6f-fa4145f20373" containerID="0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71" exitCode=0 Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.833733 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" event={"ID":"933cf65a-d662-413c-8b6f-fa4145f20373","Type":"ContainerDied","Data":"0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71"} Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.834329 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-log" containerID="cri-o://873b2156865008f4291604f305057144026f4ae1f066b89bc5c688084e077533" gracePeriod=30 Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.835111 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-httpd" containerID="cri-o://73ef3fc058d2a0a57ad2bac828877997113b978b36b4263da816db65eea21bec" gracePeriod=30 Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.844177 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.844635 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.140:9292/healthcheck\": EOF" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.846064 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.140:9292/healthcheck\": EOF" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.871116 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.906995 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8576757c54-nblzm"] Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.965999 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq"] Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.966425 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api" containerID="cri-o://263209e6e99bea049c297f4ae79528351ec7d169f959e143b96a2f8a50222170" gracePeriod=30 Nov 21 13:10:40 crc kubenswrapper[4769]: I1121 13:10:40.967013 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api-log" containerID="cri-o://8ac7c8cc818f3b0c2665bbd8d4d29e73b0a9c1dc1efd3197d5741d4d1d929907" gracePeriod=30 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.228289 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.229135 4769 scope.go:117] "RemoveContainer" containerID="1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b" Nov 21 13:10:41 crc kubenswrapper[4769]: E1121 13:10:41.229393 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(4447c27b-0c4c-444a-981a-df468fe19b6e)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.316281 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.318073 4769 scope.go:117] "RemoveContainer" containerID="05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4" Nov 21 13:10:41 crc kubenswrapper[4769]: E1121 13:10:41.318387 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(f5b6a13f-243f-4eb4-868d-039a2c527c0b)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.632705 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.632920 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api-log" containerID="cri-o://39240e6a8a90c38b0d866fb78bc1c32be5f74c19dac63d3bd1dcf5b2e5eeef3f" gracePeriod=30 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.633363 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api" containerID="cri-o://876e72db585aa92494a4050fcc14bc0d99eba0e90d774c3a3319e792eda5680f" gracePeriod=30 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.790510 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.790753 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="81a1df2f-958e-452c-968a-9e20c8fb6669" containerName="memcached" containerID="cri-o://5d691d554f00fca7fad6d3b5b95e5bbf915c57b162f38257da99697702858589" gracePeriod=30 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.852872 4769 generic.go:334] "Generic (PLEG): container finished" podID="637bec3e-e202-490a-b451-9596f3f86b73" containerID="39240e6a8a90c38b0d866fb78bc1c32be5f74c19dac63d3bd1dcf5b2e5eeef3f" exitCode=143 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.852971 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"637bec3e-e202-490a-b451-9596f3f86b73","Type":"ContainerDied","Data":"39240e6a8a90c38b0d866fb78bc1c32be5f74c19dac63d3bd1dcf5b2e5eeef3f"} Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.858019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" event={"ID":"9d48ea37-164f-4a8b-955d-b3b7416672de","Type":"ContainerStarted","Data":"39ef7e4397f48731bce48b78715be96da4f74652e9ed100f8863f7a964cc1dcd"} Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.858069 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" event={"ID":"9d48ea37-164f-4a8b-955d-b3b7416672de","Type":"ContainerStarted","Data":"ad316cd297d469811f90f20d5a9291e27e398bed853cbb51c068a42938236b32"} Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.860646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" event={"ID":"9be129cd-9422-434a-b2aa-0d9c3d8423e0","Type":"ContainerStarted","Data":"33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8"} Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.862308 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.894338 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" podStartSLOduration=2.894315694 podStartE2EDuration="2.894315694s" podCreationTimestamp="2025-11-21 13:10:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:41.885494217 +0000 UTC m=+4800.586156035" watchObservedRunningTime="2025-11-21 13:10:41.894315694 +0000 UTC m=+4800.594977512" Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.903494 4769 generic.go:334] "Generic (PLEG): container finished" podID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerID="8ac7c8cc818f3b0c2665bbd8d4d29e73b0a9c1dc1efd3197d5741d4d1d929907" exitCode=143 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.903560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" event={"ID":"491af14f-6c9a-4c2a-8d91-bea7d7735b8b","Type":"ContainerDied","Data":"8ac7c8cc818f3b0c2665bbd8d4d29e73b0a9c1dc1efd3197d5741d4d1d929907"} Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.912467 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerID="873b2156865008f4291604f305057144026f4ae1f066b89bc5c688084e077533" exitCode=143 Nov 21 13:10:41 crc kubenswrapper[4769]: I1121 13:10:41.913173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5e4e94a5-7681-4dba-9c88-23c4673511e6","Type":"ContainerDied","Data":"873b2156865008f4291604f305057144026f4ae1f066b89bc5c688084e077533"} Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.952836 4769 generic.go:334] "Generic (PLEG): container finished" podID="637bec3e-e202-490a-b451-9596f3f86b73" containerID="876e72db585aa92494a4050fcc14bc0d99eba0e90d774c3a3319e792eda5680f" exitCode=0 Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.953138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"637bec3e-e202-490a-b451-9596f3f86b73","Type":"ContainerDied","Data":"876e72db585aa92494a4050fcc14bc0d99eba0e90d774c3a3319e792eda5680f"} Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.958014 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.958239 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-log" containerID="cri-o://bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c" gracePeriod=30 Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.958537 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-metadata" containerID="cri-o://da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1" gracePeriod=30 Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.963101 4769 generic.go:334] "Generic (PLEG): container finished" podID="81a1df2f-958e-452c-968a-9e20c8fb6669" containerID="5d691d554f00fca7fad6d3b5b95e5bbf915c57b162f38257da99697702858589" exitCode=0 Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.963156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"81a1df2f-958e-452c-968a-9e20c8fb6669","Type":"ContainerDied","Data":"5d691d554f00fca7fad6d3b5b95e5bbf915c57b162f38257da99697702858589"} Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.996273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" event={"ID":"9d48ea37-164f-4a8b-955d-b3b7416672de","Type":"ContainerStarted","Data":"6edfc81cd3befd0a3b3f3414ada3d4fd0e7a79eacffd642f5a5c8b38558ae6b2"} Nov 21 13:10:42 crc kubenswrapper[4769]: I1121 13:10:42.996362 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.063459 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.100926 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" podStartSLOduration=4.100905208 podStartE2EDuration="4.100905208s" podCreationTimestamp="2025-11-21 13:10:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:43.048536277 +0000 UTC m=+4801.749198095" watchObservedRunningTime="2025-11-21 13:10:43.100905208 +0000 UTC m=+4801.801567026" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.155762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-internal-tls-certs\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.155823 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/637bec3e-e202-490a-b451-9596f3f86b73-logs\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.155890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-public-tls-certs\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.155923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhd26\" (UniqueName: \"kubernetes.io/projected/637bec3e-e202-490a-b451-9596f3f86b73-kube-api-access-xhd26\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.155990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data-custom\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.156065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-combined-ca-bundle\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.156132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/637bec3e-e202-490a-b451-9596f3f86b73-etc-machine-id\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.156173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-scripts\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.156221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data\") pod \"637bec3e-e202-490a-b451-9596f3f86b73\" (UID: \"637bec3e-e202-490a-b451-9596f3f86b73\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.164078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.171478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/637bec3e-e202-490a-b451-9596f3f86b73-logs" (OuterVolumeSpecName: "logs") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.171918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/637bec3e-e202-490a-b451-9596f3f86b73-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.181699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-scripts" (OuterVolumeSpecName: "scripts") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.187742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/637bec3e-e202-490a-b451-9596f3f86b73-kube-api-access-xhd26" (OuterVolumeSpecName: "kube-api-access-xhd26") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "kube-api-access-xhd26". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.262771 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xhd26\" (UniqueName: \"kubernetes.io/projected/637bec3e-e202-490a-b451-9596f3f86b73-kube-api-access-xhd26\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.262812 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.262851 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/637bec3e-e202-490a-b451-9596f3f86b73-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.262871 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.262884 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/637bec3e-e202-490a-b451-9596f3f86b73-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.271505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.278325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.305989 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.350890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data" (OuterVolumeSpecName: "config-data") pod "637bec3e-e202-490a-b451-9596f3f86b73" (UID: "637bec3e-e202-490a-b451-9596f3f86b73"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.367388 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.367425 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.367435 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.367445 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/637bec3e-e202-490a-b451-9596f3f86b73-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.470520 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.558392 4769 scope.go:117] "RemoveContainer" containerID="66656c0edf4fd040ee5af751d0839bdf1870710fae7b1d5dbdf5ae35ebda62e1" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.583633 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-combined-ca-bundle\") pod \"81a1df2f-958e-452c-968a-9e20c8fb6669\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.583694 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-config-data\") pod \"81a1df2f-958e-452c-968a-9e20c8fb6669\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.583721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-memcached-tls-certs\") pod \"81a1df2f-958e-452c-968a-9e20c8fb6669\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.583940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-kolla-config\") pod \"81a1df2f-958e-452c-968a-9e20c8fb6669\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.583974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk2t2\" (UniqueName: \"kubernetes.io/projected/81a1df2f-958e-452c-968a-9e20c8fb6669-kube-api-access-mk2t2\") pod \"81a1df2f-958e-452c-968a-9e20c8fb6669\" (UID: \"81a1df2f-958e-452c-968a-9e20c8fb6669\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.584690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-config-data" (OuterVolumeSpecName: "config-data") pod "81a1df2f-958e-452c-968a-9e20c8fb6669" (UID: "81a1df2f-958e-452c-968a-9e20c8fb6669"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.586600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "81a1df2f-958e-452c-968a-9e20c8fb6669" (UID: "81a1df2f-958e-452c-968a-9e20c8fb6669"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.601082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a1df2f-958e-452c-968a-9e20c8fb6669-kube-api-access-mk2t2" (OuterVolumeSpecName: "kube-api-access-mk2t2") pod "81a1df2f-958e-452c-968a-9e20c8fb6669" (UID: "81a1df2f-958e-452c-968a-9e20c8fb6669"). InnerVolumeSpecName "kube-api-access-mk2t2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.634348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "81a1df2f-958e-452c-968a-9e20c8fb6669" (UID: "81a1df2f-958e-452c-968a-9e20c8fb6669"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.686643 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.689810 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.690803 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/81a1df2f-958e-452c-968a-9e20c8fb6669-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.690957 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mk2t2\" (UniqueName: \"kubernetes.io/projected/81a1df2f-958e-452c-968a-9e20c8fb6669-kube-api-access-mk2t2\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.701378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "81a1df2f-958e-452c-968a-9e20c8fb6669" (UID: "81a1df2f-958e-452c-968a-9e20c8fb6669"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.761105 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.792520 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/81a1df2f-958e-452c-968a-9e20c8fb6669-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.893857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-config-data\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-scripts\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-logs\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mdrh\" (UniqueName: \"kubernetes.io/projected/8491287b-46fd-4729-8ab0-8080b38a38f3-kube-api-access-7mdrh\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-combined-ca-bundle\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-httpd-run\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.894671 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-internal-tls-certs\") pod \"8491287b-46fd-4729-8ab0-8080b38a38f3\" (UID: \"8491287b-46fd-4729-8ab0-8080b38a38f3\") " Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.895126 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-logs" (OuterVolumeSpecName: "logs") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.895392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.904364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-scripts" (OuterVolumeSpecName: "scripts") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.904453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8491287b-46fd-4729-8ab0-8080b38a38f3-kube-api-access-7mdrh" (OuterVolumeSpecName: "kube-api-access-7mdrh") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "kube-api-access-7mdrh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.905351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.954372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.986380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-746497cdbb-48258"] Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.989622 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.989818 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" containerID="cri-o://dd9565562c127fc67102981469d2b4ced7a5404a7d3cae22bbc58af0f92e0a38" gracePeriod=30 Nov 21 13:10:43 crc kubenswrapper[4769]: I1121 13:10:43.990497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-api" containerID="cri-o://647be020514c515af3e277477946fbc1c5d789a27386a56e5af3700f76bd321d" gracePeriod=30 Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.000356 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.000386 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.000395 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.004526 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mdrh\" (UniqueName: \"kubernetes.io/projected/8491287b-46fd-4729-8ab0-8080b38a38f3-kube-api-access-7mdrh\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.004551 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.004560 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8491287b-46fd-4729-8ab0-8080b38a38f3-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.008431 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.127:8778/\": EOF" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.009861 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.127:8778/\": EOF" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.010081 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-65dcdc4bdb-k65m8"] Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.012308 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="81a1df2f-958e-452c-968a-9e20c8fb6669" containerName="memcached" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.012330 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a1df2f-958e-452c-968a-9e20c8fb6669" containerName="memcached" Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.012338 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.012344 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api" Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.012362 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api-log" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.012367 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api-log" Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.012397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-httpd" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.012403 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-httpd" Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.012422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-log" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.012427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-log" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.016125 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="81a1df2f-958e-452c-968a-9e20c8fb6669" containerName="memcached" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.016152 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api-log" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.016177 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="637bec3e-e202-490a-b451-9596f3f86b73" containerName="cinder-api" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.016204 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-httpd" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.016211 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerName="glance-log" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.018446 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.026094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-config-data" (OuterVolumeSpecName: "config-data") pod "8491287b-46fd-4729-8ab0-8080b38a38f3" (UID: "8491287b-46fd-4729-8ab0-8080b38a38f3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.036183 4769 generic.go:334] "Generic (PLEG): container finished" podID="8491287b-46fd-4729-8ab0-8080b38a38f3" containerID="f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32" exitCode=0 Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.036343 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.046041 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.047274 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8491287b-46fd-4729-8ab0-8080b38a38f3","Type":"ContainerDied","Data":"f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32"} Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.047312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"8491287b-46fd-4729-8ab0-8080b38a38f3","Type":"ContainerDied","Data":"c96cd236611d3654e4ff99f4db0ea7dcdee0c64c42c97ff6957f201edc5b1cdd"} Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.047332 4769 scope.go:117] "RemoveContainer" containerID="f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.047515 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.051337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"81a1df2f-958e-452c-968a-9e20c8fb6669","Type":"ContainerDied","Data":"4148f371230e4ab5d317808106b7320a319d1b91881289738a7bae1ddf2da27b"} Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.051533 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.055806 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-65dcdc4bdb-k65m8"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.064286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"637bec3e-e202-490a-b451-9596f3f86b73","Type":"ContainerDied","Data":"9d8c53ed0eae26a0d098db1792649e06050f2f66dad2c48d18b259e1071cf471"} Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.064462 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.084799 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ddd5f84-24dd-43ff-957b-388116a08570" containerID="bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c" exitCode=143 Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.085934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8ddd5f84-24dd-43ff-957b-388116a08570","Type":"ContainerDied","Data":"bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c"} Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.107340 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.107373 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.107384 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8491287b-46fd-4729-8ab0-8080b38a38f3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209559 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-internal-tls-certs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-combined-ca-bundle\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-config-data\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-logs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-scripts\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2kq\" (UniqueName: \"kubernetes.io/projected/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-kube-api-access-wp2kq\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.209898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-public-tls-certs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.215413 4769 scope.go:117] "RemoveContainer" containerID="0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.232206 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.280530 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.312046 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.313777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-logs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.313814 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.313880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-scripts\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.313930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2kq\" (UniqueName: \"kubernetes.io/projected/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-kube-api-access-wp2kq\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.314802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-public-tls-certs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.314828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-internal-tls-certs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.315047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-logs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.315115 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-combined-ca-bundle\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.315172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-config-data\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.325427 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.325646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.325920 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.334494 4769 scope.go:117] "RemoveContainer" containerID="f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.338167 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.343412 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32\": container with ID starting with f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32 not found: ID does not exist" containerID="f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.343500 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32"} err="failed to get container status \"f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32\": rpc error: code = NotFound desc = could not find container \"f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32\": container with ID starting with f8feb0f79347d7a726a2d72892e474383f1168d1d671776bd532f8de1cd77e32 not found: ID does not exist" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.343526 4769 scope.go:117] "RemoveContainer" containerID="0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.344341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-public-tls-certs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.344687 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-scripts\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: E1121 13:10:44.347325 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164\": container with ID starting with 0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164 not found: ID does not exist" containerID="0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.347364 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164"} err="failed to get container status \"0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164\": rpc error: code = NotFound desc = could not find container \"0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164\": container with ID starting with 0612bbe9fc86912dc5d5bbac14caa6a3fb291052e556fe052b00b1a8b71b0164 not found: ID does not exist" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.347385 4769 scope.go:117] "RemoveContainer" containerID="5d691d554f00fca7fad6d3b5b95e5bbf915c57b162f38257da99697702858589" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.353232 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.353923 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-internal-tls-certs\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.354468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-combined-ca-bundle\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.355014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2kq\" (UniqueName: \"kubernetes.io/projected/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-kube-api-access-wp2kq\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.364453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-config-data\") pod \"placement-65dcdc4bdb-k65m8\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.364546 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.375392 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.387389 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.403632 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.406783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.409602 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.409749 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.415523 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.417595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/52a8d5cd-1b4e-4654-a190-57fc62882968-logs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.417699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data-custom\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.417825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-public-tls-certs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.418005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.418310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-scripts\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.418600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.418778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/52a8d5cd-1b4e-4654-a190-57fc62882968-etc-machine-id\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.419041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xchb9\" (UniqueName: \"kubernetes.io/projected/52a8d5cd-1b4e-4654-a190-57fc62882968-kube-api-access-xchb9\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.419085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.424937 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.428131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.430713 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-p5kzh" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.431005 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.432061 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.459314 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.478874 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.493130 4769 scope.go:117] "RemoveContainer" containerID="876e72db585aa92494a4050fcc14bc0d99eba0e90d774c3a3319e792eda5680f" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.505350 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-memcached-tls-certs\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/52a8d5cd-1b4e-4654-a190-57fc62882968-logs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data-custom\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsxq4\" (UniqueName: \"kubernetes.io/projected/87447b3d-8379-4b3f-8f75-91ea2fc591ea-kube-api-access-nsxq4\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-public-tls-certs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrq4q\" (UniqueName: \"kubernetes.io/projected/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kube-api-access-zrq4q\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kolla-config\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-scripts\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-scripts\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-combined-ca-bundle\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.523984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.524017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/52a8d5cd-1b4e-4654-a190-57fc62882968-etc-machine-id\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.524052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-logs\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.524109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-config-data\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.524135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-config-data\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.524167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xchb9\" (UniqueName: \"kubernetes.io/projected/52a8d5cd-1b4e-4654-a190-57fc62882968-kube-api-access-xchb9\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.525731 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/52a8d5cd-1b4e-4654-a190-57fc62882968-logs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.528143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.530985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-public-tls-certs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.533804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/52a8d5cd-1b4e-4654-a190-57fc62882968-etc-machine-id\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.537987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-scripts\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.541500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.542722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.550480 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xchb9\" (UniqueName: \"kubernetes.io/projected/52a8d5cd-1b4e-4654-a190-57fc62882968-kube-api-access-xchb9\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.550949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data-custom\") pod \"cinder-api-0\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.628692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-memcached-tls-certs\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.628798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nsxq4\" (UniqueName: \"kubernetes.io/projected/87447b3d-8379-4b3f-8f75-91ea2fc591ea-kube-api-access-nsxq4\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.628850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zrq4q\" (UniqueName: \"kubernetes.io/projected/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kube-api-access-zrq4q\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.628895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kolla-config\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.628921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.628964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-scripts\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-combined-ca-bundle\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-logs\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629151 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-config-data\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.629173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-config-data\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.636875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-scripts\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.637158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-logs\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.637940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-config-data\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.643410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.644283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.644356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kolla-config\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.644878 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.645509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-memcached-tls-certs\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.649958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.650120 4769 scope.go:117] "RemoveContainer" containerID="39240e6a8a90c38b0d866fb78bc1c32be5f74c19dac63d3bd1dcf5b2e5eeef3f" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.651051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-combined-ca-bundle\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.651144 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-config-data\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.664660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsxq4\" (UniqueName: \"kubernetes.io/projected/87447b3d-8379-4b3f-8f75-91ea2fc591ea-kube-api-access-nsxq4\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.697284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrq4q\" (UniqueName: \"kubernetes.io/projected/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kube-api-access-zrq4q\") pod \"memcached-0\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.718400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.808103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.809091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.845873 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.878120 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65dcdc4bdb-k65m8"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.903839 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5fb4445bb6-b7tmz"] Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.905624 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:44 crc kubenswrapper[4769]: I1121 13:10:44.953514 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5fb4445bb6-b7tmz"] Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.054267 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-config-data\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.054826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/554020cb-5fc6-4185-940f-4210d7c58422-logs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.054864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-scripts\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.054944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-combined-ca-bundle\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.055031 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-internal-tls-certs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.055072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlc8k\" (UniqueName: \"kubernetes.io/projected/554020cb-5fc6-4185-940f-4210d7c58422-kube-api-access-nlc8k\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.055101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-public-tls-certs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.133803 4769 generic.go:334] "Generic (PLEG): container finished" podID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerID="dd9565562c127fc67102981469d2b4ced7a5404a7d3cae22bbc58af0f92e0a38" exitCode=143 Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.133875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-746497cdbb-48258" event={"ID":"491eddfd-964e-4de3-940f-e22d3f0d2c29","Type":"ContainerDied","Data":"dd9565562c127fc67102981469d2b4ced7a5404a7d3cae22bbc58af0f92e0a38"} Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-config-data\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/554020cb-5fc6-4185-940f-4210d7c58422-logs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-scripts\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-combined-ca-bundle\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-internal-tls-certs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nlc8k\" (UniqueName: \"kubernetes.io/projected/554020cb-5fc6-4185-940f-4210d7c58422-kube-api-access-nlc8k\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.159714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-public-tls-certs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.178322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-scripts\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.178580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/554020cb-5fc6-4185-940f-4210d7c58422-logs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.179351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-internal-tls-certs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.180381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-public-tls-certs\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.184337 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-config-data\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.203666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-combined-ca-bundle\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.226103 4769 generic.go:334] "Generic (PLEG): container finished" podID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerID="263209e6e99bea049c297f4ae79528351ec7d169f959e143b96a2f8a50222170" exitCode=0 Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.226306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" event={"ID":"491af14f-6c9a-4c2a-8d91-bea7d7735b8b","Type":"ContainerDied","Data":"263209e6e99bea049c297f4ae79528351ec7d169f959e143b96a2f8a50222170"} Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.247309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlc8k\" (UniqueName: \"kubernetes.io/projected/554020cb-5fc6-4185-940f-4210d7c58422-kube-api-access-nlc8k\") pod \"placement-5fb4445bb6-b7tmz\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.357881 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="637bec3e-e202-490a-b451-9596f3f86b73" path="/var/lib/kubelet/pods/637bec3e-e202-490a-b451-9596f3f86b73/volumes" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.360523 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.361840 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a1df2f-958e-452c-968a-9e20c8fb6669" path="/var/lib/kubelet/pods/81a1df2f-958e-452c-968a-9e20c8fb6669/volumes" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.363883 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8491287b-46fd-4729-8ab0-8080b38a38f3" path="/var/lib/kubelet/pods/8491287b-46fd-4729-8ab0-8080b38a38f3/volumes" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.444334 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-logs\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-combined-ca-bundle\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data-custom\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.473645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54gkc\" (UniqueName: \"kubernetes.io/projected/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-kube-api-access-54gkc\") pod \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\" (UID: \"491af14f-6c9a-4c2a-8d91-bea7d7735b8b\") " Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.480017 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-kube-api-access-54gkc" (OuterVolumeSpecName: "kube-api-access-54gkc") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "kube-api-access-54gkc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.480457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-logs" (OuterVolumeSpecName: "logs") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.483623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.499098 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65dcdc4bdb-k65m8"] Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.552943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data" (OuterVolumeSpecName: "config-data") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.576627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.577590 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.577613 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-54gkc\" (UniqueName: \"kubernetes.io/projected/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-kube-api-access-54gkc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.577623 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.577631 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.577639 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.607363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.637685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "491af14f-6c9a-4c2a-8d91-bea7d7735b8b" (UID: "491af14f-6c9a-4c2a-8d91-bea7d7735b8b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.679939 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.679969 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491af14f-6c9a-4c2a-8d91-bea7d7735b8b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.699672 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.700092 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-central-agent" containerID="cri-o://9a4778b350a270984c137eb79a4d2db49d7069ed5606fd6f17bc387e9d8944ef" gracePeriod=30 Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.701318 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="proxy-httpd" containerID="cri-o://25ba5b27062f1568ba7b9b7588cdef03b351d97989e70bfc22e3b666ece3192a" gracePeriod=30 Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.701459 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="sg-core" containerID="cri-o://1d623dc794ddb57c8c416420ccb01eb9b4d33c16c471a747a95e74fb8ff1f279" gracePeriod=30 Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.701567 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-notification-agent" containerID="cri-o://9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675" gracePeriod=30 Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.753125 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.892091 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:10:45 crc kubenswrapper[4769]: I1121 13:10:45.905263 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.165098 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5fb4445bb6-b7tmz"] Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.181672 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-79785467cb-pt6w4"] Nov 21 13:10:46 crc kubenswrapper[4769]: E1121 13:10:46.182083 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.182100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api" Nov 21 13:10:46 crc kubenswrapper[4769]: E1121 13:10:46.182119 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api-log" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.182138 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api-log" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.182357 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.182381 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" containerName="barbican-api-log" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.189040 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.210007 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79785467cb-pt6w4"] Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.293754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-public-tls-certs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.293791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.293824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-internal-tls-certs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.293869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-logs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.293933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data-custom\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.293992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5blm\" (UniqueName: \"kubernetes.io/projected/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-kube-api-access-d5blm\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.294018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-combined-ca-bundle\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.359099 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.359314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq" event={"ID":"491af14f-6c9a-4c2a-8d91-bea7d7735b8b","Type":"ContainerDied","Data":"32ac5e93c6f5986ae54fb9328d0dfa24e87e9ed7d289ad8dc80d29648c705df1"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.359373 4769 scope.go:117] "RemoveContainer" containerID="263209e6e99bea049c297f4ae79528351ec7d169f959e143b96a2f8a50222170" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.375037 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerID="25ba5b27062f1568ba7b9b7588cdef03b351d97989e70bfc22e3b666ece3192a" exitCode=0 Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.375110 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerID="1d623dc794ddb57c8c416420ccb01eb9b4d33c16c471a747a95e74fb8ff1f279" exitCode=2 Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.375120 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerID="9a4778b350a270984c137eb79a4d2db49d7069ed5606fd6f17bc387e9d8944ef" exitCode=0 Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.375863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerDied","Data":"25ba5b27062f1568ba7b9b7588cdef03b351d97989e70bfc22e3b666ece3192a"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.375897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerDied","Data":"1d623dc794ddb57c8c416420ccb01eb9b4d33c16c471a747a95e74fb8ff1f279"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.375908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerDied","Data":"9a4778b350a270984c137eb79a4d2db49d7069ed5606fd6f17bc387e9d8944ef"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.379865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e30b9c3a-08b6-4d59-bf89-588e667ef25f","Type":"ContainerStarted","Data":"8453f68d7b5c7687792641d44b165ca7509e3d3387d6b9f02a51428c47490367"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.383851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87447b3d-8379-4b3f-8f75-91ea2fc591ea","Type":"ContainerStarted","Data":"bdcbfd1ce94d484a05fe52bd5bbe10d1c46c1adf2eab4c7265162a1f2eab4201"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.386519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" event={"ID":"0e428a8f-3f0d-428a-b327-cc3f2a15ca93","Type":"ContainerStarted","Data":"412b9c4c27073c68931948cf97c00f7c604e86cd839c18427528ee2903c2c719"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.386549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" event={"ID":"0e428a8f-3f0d-428a-b327-cc3f2a15ca93","Type":"ContainerStarted","Data":"9819c00e1f145c3e9541561d3c9bc8248d448c7c70eb60d410eac385945c0bbb"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.391444 4769 generic.go:334] "Generic (PLEG): container finished" podID="dbb0650d-c5a5-4749-b8ca-642300da8535" containerID="de60df9b83d974676643990b8f723b82df66a50899862f2d4142a3a12c8b8f89" exitCode=0 Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.391648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" event={"ID":"dbb0650d-c5a5-4749-b8ca-642300da8535","Type":"ContainerDied","Data":"de60df9b83d974676643990b8f723b82df66a50899862f2d4142a3a12c8b8f89"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.393934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerStarted","Data":"de86fb75e70c81c2c20a8ea4b8d36209fa7809ea9f1901494663e4b9b25ddc11"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d5blm\" (UniqueName: \"kubernetes.io/projected/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-kube-api-access-d5blm\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-combined-ca-bundle\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-public-tls-certs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395571 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-internal-tls-certs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-logs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.395790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data-custom\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.397507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-logs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.403710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" event={"ID":"554020cb-5fc6-4185-940f-4210d7c58422","Type":"ContainerStarted","Data":"086038a88ddad6217a3704615af13fdd802f0eb2f7bb02b3cd1849e1875cfdfc"} Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.418918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-combined-ca-bundle\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.420748 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-public-tls-certs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.420904 4769 scope.go:117] "RemoveContainer" containerID="8ac7c8cc818f3b0c2665bbd8d4d29e73b0a9c1dc1efd3197d5741d4d1d929907" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.421347 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data-custom\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.422489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.427866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-internal-tls-certs\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.429925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5blm\" (UniqueName: \"kubernetes.io/projected/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-kube-api-access-d5blm\") pod \"barbican-api-79785467cb-pt6w4\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.431650 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq"] Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.446489 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7ff6cb4844-z2dlq"] Nov 21 13:10:46 crc kubenswrapper[4769]: I1121 13:10:46.693923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:47 crc kubenswrapper[4769]: E1121 13:10:47.122995 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddd5f84_24dd_43ff_957b_388116a08570.slice/crio-da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod491af14f_6c9a_4c2a_8d91_bea7d7735b8b.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddd5f84_24dd_43ff_957b_388116a08570.slice/crio-conmon-da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod491af14f_6c9a_4c2a_8d91_bea7d7735b8b.slice/crio-32ac5e93c6f5986ae54fb9328d0dfa24e87e9ed7d289ad8dc80d29648c705df1\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4b95613_8dcb_4a9f_86c1_825050bcc265.slice/crio-conmon-9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4b95613_8dcb_4a9f_86c1_825050bcc265.slice/crio-9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.127561 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.224170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ddd5f84-24dd-43ff-957b-388116a08570-logs\") pod \"8ddd5f84-24dd-43ff-957b-388116a08570\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.224376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-nova-metadata-tls-certs\") pod \"8ddd5f84-24dd-43ff-957b-388116a08570\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.224408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4gvr\" (UniqueName: \"kubernetes.io/projected/8ddd5f84-24dd-43ff-957b-388116a08570-kube-api-access-p4gvr\") pod \"8ddd5f84-24dd-43ff-957b-388116a08570\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.224429 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-combined-ca-bundle\") pod \"8ddd5f84-24dd-43ff-957b-388116a08570\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.224524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-config-data\") pod \"8ddd5f84-24dd-43ff-957b-388116a08570\" (UID: \"8ddd5f84-24dd-43ff-957b-388116a08570\") " Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.236330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddd5f84-24dd-43ff-957b-388116a08570-logs" (OuterVolumeSpecName: "logs") pod "8ddd5f84-24dd-43ff-957b-388116a08570" (UID: "8ddd5f84-24dd-43ff-957b-388116a08570"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.254032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ddd5f84-24dd-43ff-957b-388116a08570-kube-api-access-p4gvr" (OuterVolumeSpecName: "kube-api-access-p4gvr") pod "8ddd5f84-24dd-43ff-957b-388116a08570" (UID: "8ddd5f84-24dd-43ff-957b-388116a08570"). InnerVolumeSpecName "kube-api-access-p4gvr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.260019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-config-data" (OuterVolumeSpecName: "config-data") pod "8ddd5f84-24dd-43ff-957b-388116a08570" (UID: "8ddd5f84-24dd-43ff-957b-388116a08570"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.330381 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p4gvr\" (UniqueName: \"kubernetes.io/projected/8ddd5f84-24dd-43ff-957b-388116a08570-kube-api-access-p4gvr\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.330691 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.330701 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8ddd5f84-24dd-43ff-957b-388116a08570-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.352541 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491af14f-6c9a-4c2a-8d91-bea7d7735b8b" path="/var/lib/kubelet/pods/491af14f-6c9a-4c2a-8d91-bea7d7735b8b/volumes" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.365619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8ddd5f84-24dd-43ff-957b-388116a08570" (UID: "8ddd5f84-24dd-43ff-957b-388116a08570"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.434960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87447b3d-8379-4b3f-8f75-91ea2fc591ea","Type":"ContainerStarted","Data":"2a4609450f8a9194b63550d4f501e76842cb87df6e87a7722dc004333a5a469c"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.436591 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.438318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" event={"ID":"0e428a8f-3f0d-428a-b327-cc3f2a15ca93","Type":"ContainerStarted","Data":"fe845a8be2450e88bdfcdeb4b8d70df954686fd7fec00ca6d73ccd648e0896d1"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.438429 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-log" containerID="cri-o://412b9c4c27073c68931948cf97c00f7c604e86cd839c18427528ee2903c2c719" gracePeriod=30 Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.438475 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.438592 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-api" containerID="cri-o://fe845a8be2450e88bdfcdeb4b8d70df954686fd7fec00ca6d73ccd648e0896d1" gracePeriod=30 Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.438770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.455641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" event={"ID":"554020cb-5fc6-4185-940f-4210d7c58422","Type":"ContainerStarted","Data":"a2935a55a0c5f438e8f50cb9b12402f1525361c791e6198d99d3c7813f69f9d1"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.455717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" event={"ID":"554020cb-5fc6-4185-940f-4210d7c58422","Type":"ContainerStarted","Data":"2ca8b06c3af120dd02e735b16a2ce782700c9797a0545898975dfe0e9fb7e4d2"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.458175 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.458262 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.464122 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerID="9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675" exitCode=0 Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.464223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerDied","Data":"9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.476004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e30b9c3a-08b6-4d59-bf89-588e667ef25f","Type":"ContainerStarted","Data":"6a8fc84d76468c2bf634196510f850fd13bdabbf01bb76bd79b43c2051c09ae6"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.476116 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.479683 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" podStartSLOduration=4.479662529 podStartE2EDuration="4.479662529s" podCreationTimestamp="2025-11-21 13:10:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:47.461563841 +0000 UTC m=+4806.162225659" watchObservedRunningTime="2025-11-21 13:10:47.479662529 +0000 UTC m=+4806.180324347" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.481713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerStarted","Data":"921af3a8df3310b4a813a396eeafa4a47e71d25f38d2695db22f35ded27941b5"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.497774 4769 generic.go:334] "Generic (PLEG): container finished" podID="8ddd5f84-24dd-43ff-957b-388116a08570" containerID="da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1" exitCode=0 Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.497832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8ddd5f84-24dd-43ff-957b-388116a08570","Type":"ContainerDied","Data":"da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.497864 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8ddd5f84-24dd-43ff-957b-388116a08570","Type":"ContainerDied","Data":"77f7ef64608c5fa5197001b7913747361d2f13ae5f8f58883759cf5b3b6c8c7d"} Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.497884 4769 scope.go:117] "RemoveContainer" containerID="da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.498000 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.499727 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" podStartSLOduration=3.499713039 podStartE2EDuration="3.499713039s" podCreationTimestamp="2025-11-21 13:10:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:47.487730346 +0000 UTC m=+4806.188392184" watchObservedRunningTime="2025-11-21 13:10:47.499713039 +0000 UTC m=+4806.200374857" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.519585 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=3.5195635039999997 podStartE2EDuration="3.519563504s" podCreationTimestamp="2025-11-21 13:10:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:47.513950793 +0000 UTC m=+4806.214612611" watchObservedRunningTime="2025-11-21 13:10:47.519563504 +0000 UTC m=+4806.220225322" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.522827 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.140:9292/healthcheck\": read tcp 10.217.0.2:37752->10.217.1.140:9292: read: connection reset by peer" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.523278 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.140:9292/healthcheck\": read tcp 10.217.0.2:37768->10.217.1.140:9292: read: connection reset by peer" Nov 21 13:10:47 crc kubenswrapper[4769]: I1121 13:10:47.552885 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-79785467cb-pt6w4"] Nov 21 13:10:48 crc kubenswrapper[4769]: W1121 13:10:48.119410 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05a6e07f_22ef_4eeb_a7ce_a5da8ae0148e.slice/crio-0a3eeb77475f8b21b02d26d7cb1d3ff2091025ba3945060207231d75f93cbd34 WatchSource:0}: Error finding container 0a3eeb77475f8b21b02d26d7cb1d3ff2091025ba3945060207231d75f93cbd34: Status 404 returned error can't find the container with id 0a3eeb77475f8b21b02d26d7cb1d3ff2091025ba3945060207231d75f93cbd34 Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.127101 4769 scope.go:117] "RemoveContainer" containerID="bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.188724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8ddd5f84-24dd-43ff-957b-388116a08570" (UID: "8ddd5f84-24dd-43ff-957b-388116a08570"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.280489 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd5f84-24dd-43ff-957b-388116a08570-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.528982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a4b95613-8dcb-4a9f-86c1-825050bcc265","Type":"ContainerDied","Data":"85fa9e2f74b2c884cf055aedf2540238940c901539238d17979903006ccb25f2"} Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.529354 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85fa9e2f74b2c884cf055aedf2540238940c901539238d17979903006ccb25f2" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.546759 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.560171 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.572141 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerID="73ef3fc058d2a0a57ad2bac828877997113b978b36b4263da816db65eea21bec" exitCode=0 Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.572604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5e4e94a5-7681-4dba-9c88-23c4673511e6","Type":"ContainerDied","Data":"73ef3fc058d2a0a57ad2bac828877997113b978b36b4263da816db65eea21bec"} Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.580992 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.585199 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.587236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" event={"ID":"dbb0650d-c5a5-4749-b8ca-642300da8535","Type":"ContainerDied","Data":"96380511604c4120a96799d8617dea4fc729a21945815028b38cca98c8cd081f"} Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.588076 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.589344 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="sg-core" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.589390 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="sg-core" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.589425 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-log" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.589434 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-log" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.589941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="proxy-httpd" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.589995 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="proxy-httpd" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.590013 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dbb0650d-c5a5-4749-b8ca-642300da8535" containerName="keystone-api" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.590021 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb0650d-c5a5-4749-b8ca-642300da8535" containerName="keystone-api" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.590072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-central-agent" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.590082 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-central-agent" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.590094 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-notification-agent" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.590627 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-notification-agent" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.590662 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-metadata" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.590669 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-metadata" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592435 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-log" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592463 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="sg-core" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592497 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="proxy-httpd" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592513 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-central-agent" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592530 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dbb0650d-c5a5-4749-b8ca-642300da8535" containerName="keystone-api" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592544 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" containerName="ceilometer-notification-agent" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.592566 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" containerName="nova-metadata-metadata" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.596373 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.598253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.604741 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.604960 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.615748 4769 scope.go:117] "RemoveContainer" containerID="da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.616318 4769 generic.go:334] "Generic (PLEG): container finished" podID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerID="77638a49b42c7b2e1d004ebe4a18219687776b3d561e7fc5eeed45b1604c04ad" exitCode=137 Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.616408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerDied","Data":"77638a49b42c7b2e1d004ebe4a18219687776b3d561e7fc5eeed45b1604c04ad"} Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.621663 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1\": container with ID starting with da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1 not found: ID does not exist" containerID="da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.621741 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1"} err="failed to get container status \"da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1\": rpc error: code = NotFound desc = could not find container \"da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1\": container with ID starting with da88adaf8d25214d6d2f5d095907909a0ed6e8898d043a9082a75c3722b278a1 not found: ID does not exist" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.621770 4769 scope.go:117] "RemoveContainer" containerID="bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c" Nov 21 13:10:48 crc kubenswrapper[4769]: E1121 13:10:48.622167 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c\": container with ID starting with bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c not found: ID does not exist" containerID="bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.622244 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c"} err="failed to get container status \"bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c\": rpc error: code = NotFound desc = could not find container \"bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c\": container with ID starting with bd761fc5ca64e4b0e25f65cabb21b3c1ced579cab52165e126aaab5ba72a190c not found: ID does not exist" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.622271 4769 scope.go:117] "RemoveContainer" containerID="de60df9b83d974676643990b8f723b82df66a50899862f2d4142a3a12c8b8f89" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.684395 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerID="fe845a8be2450e88bdfcdeb4b8d70df954686fd7fec00ca6d73ccd648e0896d1" exitCode=0 Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.684440 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerID="412b9c4c27073c68931948cf97c00f7c604e86cd839c18427528ee2903c2c719" exitCode=143 Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.684619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" event={"ID":"0e428a8f-3f0d-428a-b327-cc3f2a15ca93","Type":"ContainerDied","Data":"fe845a8be2450e88bdfcdeb4b8d70df954686fd7fec00ca6d73ccd648e0896d1"} Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.684695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" event={"ID":"0e428a8f-3f0d-428a-b327-cc3f2a15ca93","Type":"ContainerDied","Data":"412b9c4c27073c68931948cf97c00f7c604e86cd839c18427528ee2903c2c719"} Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.689240 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-public-tls-certs\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.689320 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-log-httpd\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.689359 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-combined-ca-bundle\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.689392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-run-httpd\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.689975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-config-data\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-ceilometer-tls-certs\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-scripts\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-combined-ca-bundle\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtwpx\" (UniqueName: \"kubernetes.io/projected/dbb0650d-c5a5-4749-b8ca-642300da8535-kube-api-access-jtwpx\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-sg-core-conf-yaml\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wvlr\" (UniqueName: \"kubernetes.io/projected/a4b95613-8dcb-4a9f-86c1-825050bcc265-kube-api-access-5wvlr\") pod \"a4b95613-8dcb-4a9f-86c1-825050bcc265\" (UID: \"a4b95613-8dcb-4a9f-86c1-825050bcc265\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-credential-keys\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-internal-tls-certs\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-config-data\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-scripts\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.690618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-fernet-keys\") pod \"dbb0650d-c5a5-4749-b8ca-642300da8535\" (UID: \"dbb0650d-c5a5-4749-b8ca-642300da8535\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.691030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.692075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.692140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.692419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35639d56-6b05-4c44-b344-8c4834e12841-logs\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.692554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbdrx\" (UniqueName: \"kubernetes.io/projected/35639d56-6b05-4c44-b344-8c4834e12841-kube-api-access-pbdrx\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.692930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-config-data\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.693121 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.693805 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a4b95613-8dcb-4a9f-86c1-825050bcc265-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.695431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" event={"ID":"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e","Type":"ContainerStarted","Data":"0a3eeb77475f8b21b02d26d7cb1d3ff2091025ba3945060207231d75f93cbd34"} Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.701141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-scripts" (OuterVolumeSpecName: "scripts") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.701263 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-scripts" (OuterVolumeSpecName: "scripts") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.701705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.712661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb0650d-c5a5-4749-b8ca-642300da8535-kube-api-access-jtwpx" (OuterVolumeSpecName: "kube-api-access-jtwpx") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "kube-api-access-jtwpx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.714637 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.732626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b95613-8dcb-4a9f-86c1-825050bcc265-kube-api-access-5wvlr" (OuterVolumeSpecName: "kube-api-access-5wvlr") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "kube-api-access-5wvlr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.755973 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.128:9696/\": dial tcp 10.217.1.128:9696: connect: connection refused" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.783270 4769 scope.go:117] "RemoveContainer" containerID="51fd8e3831d48efa1564568c19a1e9850f88f95af140e12bda169fa31a6855d7" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.790079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-config-data" (OuterVolumeSpecName: "config-data") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.795347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35639d56-6b05-4c44-b344-8c4834e12841-logs\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.795451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pbdrx\" (UniqueName: \"kubernetes.io/projected/35639d56-6b05-4c44-b344-8c4834e12841-kube-api-access-pbdrx\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.795614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-config-data\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.795706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.795740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.795801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35639d56-6b05-4c44-b344-8c4834e12841-logs\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796050 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796623 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jtwpx\" (UniqueName: \"kubernetes.io/projected/dbb0650d-c5a5-4749-b8ca-642300da8535-kube-api-access-jtwpx\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796648 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5wvlr\" (UniqueName: \"kubernetes.io/projected/a4b95613-8dcb-4a9f-86c1-825050bcc265-kube-api-access-5wvlr\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796659 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796669 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796678 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.796687 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.800402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.803602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-config-data\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.809173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.811307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.813226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.817941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbdrx\" (UniqueName: \"kubernetes.io/projected/35639d56-6b05-4c44-b344-8c4834e12841-kube-api-access-pbdrx\") pod \"nova-metadata-0\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.829382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.836378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.848829 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.862116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.864177 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "dbb0650d-c5a5-4749-b8ca-642300da8535" (UID: "dbb0650d-c5a5-4749-b8ca-642300da8535"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.897851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-scripts\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.897903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-public-tls-certs\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.897933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcv2p\" (UniqueName: \"kubernetes.io/projected/5e4e94a5-7681-4dba-9c88-23c4673511e6-kube-api-access-fcv2p\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-logs\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-httpd-run\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898242 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-config-data\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-combined-ca-bundle\") pod \"5e4e94a5-7681-4dba-9c88-23c4673511e6\" (UID: \"5e4e94a5-7681-4dba-9c88-23c4673511e6\") " Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898697 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898710 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898718 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898726 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898734 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbb0650d-c5a5-4749-b8ca-642300da8535-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.898742 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.899773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-logs" (OuterVolumeSpecName: "logs") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.903046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.904962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4e94a5-7681-4dba-9c88-23c4673511e6-kube-api-access-fcv2p" (OuterVolumeSpecName: "kube-api-access-fcv2p") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "kube-api-access-fcv2p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.905967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-scripts" (OuterVolumeSpecName: "scripts") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.928587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.937702 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.941340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.959764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:48 crc kubenswrapper[4769]: I1121 13:10:48.966949 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:48.999791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data-custom\") pod \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:48.999855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-combined-ca-bundle\") pod \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:48.999989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-etc-machine-id\") pod \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.000103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data\") pod \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.001287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "dd791ad6-e40c-46b0-a644-9ac1a1b177c0" (UID: "dd791ad6-e40c-46b0-a644-9ac1a1b177c0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.008044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-config-data" (OuterVolumeSpecName: "config-data") pod "5e4e94a5-7681-4dba-9c88-23c4673511e6" (UID: "5e4e94a5-7681-4dba-9c88-23c4673511e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010664 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010701 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010717 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010731 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/5e4e94a5-7681-4dba-9c88-23c4673511e6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010746 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fcv2p\" (UniqueName: \"kubernetes.io/projected/5e4e94a5-7681-4dba-9c88-23c4673511e6-kube-api-access-fcv2p\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010756 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010767 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/5e4e94a5-7681-4dba-9c88-23c4673511e6-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010807 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.010824 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.011569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dd791ad6-e40c-46b0-a644-9ac1a1b177c0" (UID: "dd791ad6-e40c-46b0-a644-9ac1a1b177c0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.021959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-config-data" (OuterVolumeSpecName: "config-data") pod "a4b95613-8dcb-4a9f-86c1-825050bcc265" (UID: "a4b95613-8dcb-4a9f-86c1-825050bcc265"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.036821 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.111948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxhdx\" (UniqueName: \"kubernetes.io/projected/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-kube-api-access-rxhdx\") pod \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.112019 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-scripts\") pod \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\" (UID: \"dd791ad6-e40c-46b0-a644-9ac1a1b177c0\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.112660 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4b95613-8dcb-4a9f-86c1-825050bcc265-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.112693 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.112710 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.115896 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd791ad6-e40c-46b0-a644-9ac1a1b177c0" (UID: "dd791ad6-e40c-46b0-a644-9ac1a1b177c0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.124146 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-scripts" (OuterVolumeSpecName: "scripts") pod "dd791ad6-e40c-46b0-a644-9ac1a1b177c0" (UID: "dd791ad6-e40c-46b0-a644-9ac1a1b177c0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.132400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-kube-api-access-rxhdx" (OuterVolumeSpecName: "kube-api-access-rxhdx") pod "dd791ad6-e40c-46b0-a644-9ac1a1b177c0" (UID: "dd791ad6-e40c-46b0-a644-9ac1a1b177c0"). InnerVolumeSpecName "kube-api-access-rxhdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.217239 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rxhdx\" (UniqueName: \"kubernetes.io/projected/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-kube-api-access-rxhdx\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.217618 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.217628 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.333915 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ddd5f84-24dd-43ff-957b-388116a08570" path="/var/lib/kubelet/pods/8ddd5f84-24dd-43ff-957b-388116a08570/volumes" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.343340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data" (OuterVolumeSpecName: "config-data") pod "dd791ad6-e40c-46b0-a644-9ac1a1b177c0" (UID: "dd791ad6-e40c-46b0-a644-9ac1a1b177c0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.425142 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dd791ad6-e40c-46b0-a644-9ac1a1b177c0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.506108 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.540868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-config-data\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.540942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-scripts\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.540970 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-public-tls-certs\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.541077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp2kq\" (UniqueName: \"kubernetes.io/projected/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-kube-api-access-wp2kq\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.541139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-combined-ca-bundle\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.541221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-logs\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.541287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-internal-tls-certs\") pod \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\" (UID: \"0e428a8f-3f0d-428a-b327-cc3f2a15ca93\") " Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.549399 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-logs" (OuterVolumeSpecName: "logs") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.643649 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.735559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"dd791ad6-e40c-46b0-a644-9ac1a1b177c0","Type":"ContainerDied","Data":"f5aebbfca2aa4cd57950b710ed2af629f4844e352160a019a90c26ace7e5d883"} Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.735607 4769 scope.go:117] "RemoveContainer" containerID="77638a49b42c7b2e1d004ebe4a18219687776b3d561e7fc5eeed45b1604c04ad" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.735700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.760020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" event={"ID":"0e428a8f-3f0d-428a-b327-cc3f2a15ca93","Type":"ContainerDied","Data":"9819c00e1f145c3e9541561d3c9bc8248d448c7c70eb60d410eac385945c0bbb"} Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.760107 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65dcdc4bdb-k65m8" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.762010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" event={"ID":"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e","Type":"ContainerStarted","Data":"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc"} Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.773082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"5e4e94a5-7681-4dba-9c88-23c4673511e6","Type":"ContainerDied","Data":"b9cc0c56eacbe783cf310915caedb62f8fdaabbafd9063d53d770de97b81a1af"} Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.773182 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.776303 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.777112 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-846ccd89dd-j22ct" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.798455 4769 scope.go:117] "RemoveContainer" containerID="f06769b438aa181e2a18ea6fed91e271fefff21495eaf2a2fa79d35fa2fbe544" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.807983 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.830553 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.844478 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-846ccd89dd-j22ct"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.862995 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863471 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863493 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-log" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863500 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-log" Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863507 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="probe" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863513 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="probe" Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863525 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-log" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863531 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-log" Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863540 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-api" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-api" Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863567 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863573 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" Nov 21 13:10:49 crc kubenswrapper[4769]: E1121 13:10:49.863588 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-httpd" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863593 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-httpd" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863765 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-log" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863790 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863801 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-api" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863806 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="cinder-scheduler" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863818 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" containerName="placement-log" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863829 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" containerName="probe" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.863838 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" containerName="glance-httpd" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.864906 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.873396 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.879203 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-846ccd89dd-j22ct"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.879328 4769 scope.go:117] "RemoveContainer" containerID="fe845a8be2450e88bdfcdeb4b8d70df954686fd7fec00ca6d73ccd648e0896d1" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.903992 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.921086 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.932830 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.951272 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.953072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.953112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-scripts\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.953226 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.953337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.953391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9aeea80a-dfea-4111-a296-461ffc4bc583-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.953488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44g9s\" (UniqueName: \"kubernetes.io/projected/9aeea80a-dfea-4111-a296-461ffc4bc583-kube-api-access-44g9s\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.957143 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.961838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.973912 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.979261 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.979514 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.983315 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:10:49 crc kubenswrapper[4769]: I1121 13:10:49.989880 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.006793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.020879 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.023167 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.025872 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.026605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.032335 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g9n6\" (UniqueName: \"kubernetes.io/projected/983d3297-af3a-447c-ac21-4150a0626907-kube-api-access-7g9n6\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055509 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055537 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-scripts\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-config-data\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-scripts\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvg8d\" (UniqueName: \"kubernetes.io/projected/91b5d253-958f-421b-bff9-432fa0abea80-kube-api-access-pvg8d\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.055992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-scripts\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056039 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-config-data\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-run-httpd\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9aeea80a-dfea-4111-a296-461ffc4bc583-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056144 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-logs\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056228 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-log-httpd\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.056247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-44g9s\" (UniqueName: \"kubernetes.io/projected/9aeea80a-dfea-4111-a296-461ffc4bc583-kube-api-access-44g9s\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.057216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9aeea80a-dfea-4111-a296-461ffc4bc583-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.089034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-scripts" (OuterVolumeSpecName: "scripts") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.089774 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-kube-api-access-wp2kq" (OuterVolumeSpecName: "kube-api-access-wp2kq") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "kube-api-access-wp2kq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.091037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.091219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.092688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.093275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-44g9s\" (UniqueName: \"kubernetes.io/projected/9aeea80a-dfea-4111-a296-461ffc4bc583-kube-api-access-44g9s\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.093683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-scripts\") pod \"cinder-scheduler-0\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.136155 4769 scope.go:117] "RemoveContainer" containerID="412b9c4c27073c68931948cf97c00f7c604e86cd839c18427528ee2903c2c719" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-log-httpd\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158759 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7g9n6\" (UniqueName: \"kubernetes.io/projected/983d3297-af3a-447c-ac21-4150a0626907-kube-api-access-7g9n6\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-config-data\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-scripts\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pvg8d\" (UniqueName: \"kubernetes.io/projected/91b5d253-958f-421b-bff9-432fa0abea80-kube-api-access-pvg8d\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.158980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-scripts\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-config-data\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-run-httpd\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-logs\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159174 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159199 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wp2kq\" (UniqueName: \"kubernetes.io/projected/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-kube-api-access-wp2kq\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.159493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.160174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-log-httpd\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.160446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-run-httpd\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.160938 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.162503 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-logs\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.168365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.168881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-scripts\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.170651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-config-data\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.172793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.173009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.174645 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-scripts\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.175462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.176323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.179293 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-config-data\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.194787 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.199588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvg8d\" (UniqueName: \"kubernetes.io/projected/91b5d253-958f-421b-bff9-432fa0abea80-kube-api-access-pvg8d\") pod \"ceilometer-0\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.201761 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g9n6\" (UniqueName: \"kubernetes.io/projected/983d3297-af3a-447c-ac21-4150a0626907-kube-api-access-7g9n6\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.297321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.443003 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79785467cb-pt6w4"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.455983 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.127:8778/\": read tcp 10.217.0.2:59290->10.217.1.127:8778: read: connection reset by peer" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.456246 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.127:8778/\": read tcp 10.217.0.2:59278->10.217.1.127:8778: read: connection reset by peer" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.456571 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-746497cdbb-48258" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.127:8778/\": dial tcp 10.217.1.127:8778: connect: connection refused" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.492264 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-54468579b4-cgdw7"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.494507 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.516954 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-54468579b4-cgdw7"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.538121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.569959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6z45\" (UniqueName: \"kubernetes.io/projected/9e7628da-ebf2-4650-ab67-7636546fdf65-kube-api-access-h6z45\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7628da-ebf2-4650-ab67-7636546fdf65-logs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data-custom\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-combined-ca-bundle\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-internal-tls-certs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.585936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-public-tls-certs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.586040 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6z45\" (UniqueName: \"kubernetes.io/projected/9e7628da-ebf2-4650-ab67-7636546fdf65-kube-api-access-h6z45\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7628da-ebf2-4650-ab67-7636546fdf65-logs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data-custom\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-combined-ca-bundle\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-internal-tls-certs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.688627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-public-tls-certs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.689673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7628da-ebf2-4650-ab67-7636546fdf65-logs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.709730 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-public-tls-certs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.710566 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-combined-ca-bundle\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.712817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-internal-tls-certs\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.713332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.717543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data-custom\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.717784 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-config-data" (OuterVolumeSpecName: "config-data") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.721340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6z45\" (UniqueName: \"kubernetes.io/projected/9e7628da-ebf2-4650-ab67-7636546fdf65-kube-api-access-h6z45\") pod \"barbican-api-54468579b4-cgdw7\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.765115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.774962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0e428a8f-3f0d-428a-b327-cc3f2a15ca93" (UID: "0e428a8f-3f0d-428a-b327-cc3f2a15ca93"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.801181 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.801234 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.801247 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e428a8f-3f0d-428a-b327-cc3f2a15ca93-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.810599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87447b3d-8379-4b3f-8f75-91ea2fc591ea","Type":"ContainerStarted","Data":"5401fd97b2ef48dbfc2b5d69640565cfb88f8988e3d56328b99afea808b67beb"} Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.824736 4769 generic.go:334] "Generic (PLEG): container finished" podID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerID="ea2904c509111773753e8b4f3752ef32c2f9670f1a1f373bb2ccb33275a378cd" exitCode=0 Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.824795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"45f57e1d-5fbf-42c7-9f34-fa747091c0c2","Type":"ContainerDied","Data":"ea2904c509111773753e8b4f3752ef32c2f9670f1a1f373bb2ccb33275a378cd"} Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.824821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"45f57e1d-5fbf-42c7-9f34-fa747091c0c2","Type":"ContainerDied","Data":"bd152b236b1911bbb6bb725a0044c8857eb6c66fdcb07f291a40fdb79241e38a"} Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.824833 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd152b236b1911bbb6bb725a0044c8857eb6c66fdcb07f291a40fdb79241e38a" Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.826432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.830861 4769 generic.go:334] "Generic (PLEG): container finished" podID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerID="647be020514c515af3e277477946fbc1c5d789a27386a56e5af3700f76bd321d" exitCode=0 Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.830933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-746497cdbb-48258" event={"ID":"491eddfd-964e-4de3-940f-e22d3f0d2c29","Type":"ContainerDied","Data":"647be020514c515af3e277477946fbc1c5d789a27386a56e5af3700f76bd321d"} Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.838013 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerStarted","Data":"6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c"} Nov 21 13:10:50 crc kubenswrapper[4769]: I1121 13:10:50.843250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"35639d56-6b05-4c44-b344-8c4834e12841","Type":"ContainerStarted","Data":"929e521243bd913289e2fd611c8fef24138309126318a8bd727d6fcf2c1d2008"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.018129 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.122659 4769 scope.go:117] "RemoveContainer" containerID="73ef3fc058d2a0a57ad2bac828877997113b978b36b4263da816db65eea21bec" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.167862 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.180743 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65dcdc4bdb-k65m8"] Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.182505 4769 scope.go:117] "RemoveContainer" containerID="873b2156865008f4291604f305057144026f4ae1f066b89bc5c688084e077533" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.202704 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-65dcdc4bdb-k65m8"] Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.215377 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.326364 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e428a8f-3f0d-428a-b327-cc3f2a15ca93" path="/var/lib/kubelet/pods/0e428a8f-3f0d-428a-b327-cc3f2a15ca93/volumes" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.327884 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e4e94a5-7681-4dba-9c88-23c4673511e6" path="/var/lib/kubelet/pods/5e4e94a5-7681-4dba-9c88-23c4673511e6/volumes" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.329760 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b95613-8dcb-4a9f-86c1-825050bcc265" path="/var/lib/kubelet/pods/a4b95613-8dcb-4a9f-86c1-825050bcc265/volumes" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.331462 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb0650d-c5a5-4749-b8ca-642300da8535" path="/var/lib/kubelet/pods/dbb0650d-c5a5-4749-b8ca-642300da8535/volumes" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.332079 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd791ad6-e40c-46b0-a644-9ac1a1b177c0" path="/var/lib/kubelet/pods/dd791ad6-e40c-46b0-a644-9ac1a1b177c0/volumes" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.350723 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.423520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-combined-ca-bundle\") pod \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.423890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-config-data\") pod \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.423933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-internal-tls-certs\") pod \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.424036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-public-tls-certs\") pod \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.424113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-logs\") pod \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.424131 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pltcs\" (UniqueName: \"kubernetes.io/projected/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-kube-api-access-pltcs\") pod \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\" (UID: \"45f57e1d-5fbf-42c7-9f34-fa747091c0c2\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.427158 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-kube-api-access-pltcs" (OuterVolumeSpecName: "kube-api-access-pltcs") pod "45f57e1d-5fbf-42c7-9f34-fa747091c0c2" (UID: "45f57e1d-5fbf-42c7-9f34-fa747091c0c2"). InnerVolumeSpecName "kube-api-access-pltcs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.427893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-logs" (OuterVolumeSpecName: "logs") pod "45f57e1d-5fbf-42c7-9f34-fa747091c0c2" (UID: "45f57e1d-5fbf-42c7-9f34-fa747091c0c2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.469985 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45f57e1d-5fbf-42c7-9f34-fa747091c0c2" (UID: "45f57e1d-5fbf-42c7-9f34-fa747091c0c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.493526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-config-data" (OuterVolumeSpecName: "config-data") pod "45f57e1d-5fbf-42c7-9f34-fa747091c0c2" (UID: "45f57e1d-5fbf-42c7-9f34-fa747091c0c2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.505987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "45f57e1d-5fbf-42c7-9f34-fa747091c0c2" (UID: "45f57e1d-5fbf-42c7-9f34-fa747091c0c2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.534957 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.534990 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pltcs\" (UniqueName: \"kubernetes.io/projected/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-kube-api-access-pltcs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.535004 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.535012 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.535021 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.550318 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "45f57e1d-5fbf-42c7-9f34-fa747091c0c2" (UID: "45f57e1d-5fbf-42c7-9f34-fa747091c0c2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.642441 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/45f57e1d-5fbf-42c7-9f34-fa747091c0c2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.690132 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.743943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-config-data\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.744550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-scripts\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.744713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nlh4\" (UniqueName: \"kubernetes.io/projected/491eddfd-964e-4de3-940f-e22d3f0d2c29-kube-api-access-4nlh4\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.744986 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-public-tls-certs\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.745018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.745082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491eddfd-964e-4de3-940f-e22d3f0d2c29-logs\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.745113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-internal-tls-certs\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.750259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/491eddfd-964e-4de3-940f-e22d3f0d2c29-logs" (OuterVolumeSpecName: "logs") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.750717 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/491eddfd-964e-4de3-940f-e22d3f0d2c29-kube-api-access-4nlh4" (OuterVolumeSpecName: "kube-api-access-4nlh4") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "kube-api-access-4nlh4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.766469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-scripts" (OuterVolumeSpecName: "scripts") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.834857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-config-data" (OuterVolumeSpecName: "config-data") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.888129 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.888768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle\") pod \"491eddfd-964e-4de3-940f-e22d3f0d2c29\" (UID: \"491eddfd-964e-4de3-940f-e22d3f0d2c29\") " Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.889293 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4nlh4\" (UniqueName: \"kubernetes.io/projected/491eddfd-964e-4de3-940f-e22d3f0d2c29-kube-api-access-4nlh4\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.889413 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/491eddfd-964e-4de3-940f-e22d3f0d2c29-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.889740 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.889828 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: W1121 13:10:51.889795 4769 empty_dir.go:500] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/491eddfd-964e-4de3-940f-e22d3f0d2c29/volumes/kubernetes.io~secret/combined-ca-bundle Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.889982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.898605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerStarted","Data":"e1a4f589a2621dc377f146b4036cabd6c7fbe34d2623ca0d379abb0a530ae7ce"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.901675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"35639d56-6b05-4c44-b344-8c4834e12841","Type":"ContainerStarted","Data":"322181a90fba9fec78d937f0cf3b317b57434d3663e1ca80ff852cd244cc9693"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.901774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"35639d56-6b05-4c44-b344-8c4834e12841","Type":"ContainerStarted","Data":"52bf814fc8e211a8b34844fdf5223234505ecd39743ed8295ab6031c097ee316"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.905363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerStarted","Data":"d65ae5bac05bd39733ce9e2680cc3f77892aac80d79744b3289579b083370707"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.923621 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" event={"ID":"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e","Type":"ContainerStarted","Data":"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.923798 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api-log" containerID="cri-o://90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc" gracePeriod=30 Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.924170 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.924257 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.924817 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api" containerID="cri-o://2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d" gracePeriod=30 Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.929499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-746497cdbb-48258" event={"ID":"491eddfd-964e-4de3-940f-e22d3f0d2c29","Type":"ContainerDied","Data":"e15f8869eb179524b1508efc5c8950470a1d0eff41d416977c0a253277e4466d"} Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.929575 4769 scope.go:117] "RemoveContainer" containerID="647be020514c515af3e277477946fbc1c5d789a27386a56e5af3700f76bd321d" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.929756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.929832 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-746497cdbb-48258" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.930624 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.976738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.976855 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.97684106 podStartE2EDuration="3.97684106s" podCreationTimestamp="2025-11-21 13:10:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:51.95012588 +0000 UTC m=+4810.650787708" watchObservedRunningTime="2025-11-21 13:10:51.97684106 +0000 UTC m=+4810.677502878" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.988584 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.991740 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.991777 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.995505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "491eddfd-964e-4de3-940f-e22d3f0d2c29" (UID: "491eddfd-964e-4de3-940f-e22d3f0d2c29"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:51 crc kubenswrapper[4769]: I1121 13:10:51.996634 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-54468579b4-cgdw7"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.005795 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=8.005776469 podStartE2EDuration="8.005776469s" podCreationTimestamp="2025-11-21 13:10:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:51.979870551 +0000 UTC m=+4810.680532379" watchObservedRunningTime="2025-11-21 13:10:52.005776469 +0000 UTC m=+4810.706438287" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.014239 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" podStartSLOduration=6.014220547 podStartE2EDuration="6.014220547s" podCreationTimestamp="2025-11-21 13:10:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:52.003044276 +0000 UTC m=+4810.703706094" watchObservedRunningTime="2025-11-21 13:10:52.014220547 +0000 UTC m=+4810.714882365" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.054087 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=8.05405891 podStartE2EDuration="8.05405891s" podCreationTimestamp="2025-11-21 13:10:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:52.028766469 +0000 UTC m=+4810.729428287" watchObservedRunningTime="2025-11-21 13:10:52.05405891 +0000 UTC m=+4810.754720728" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.067044 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.075637 4769 scope.go:117] "RemoveContainer" containerID="dd9565562c127fc67102981469d2b4ced7a5404a7d3cae22bbc58af0f92e0a38" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.105357 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/491eddfd-964e-4de3-940f-e22d3f0d2c29-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.158712 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.172869 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:52 crc kubenswrapper[4769]: E1121 13:10:52.173368 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173387 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" Nov 21 13:10:52 crc kubenswrapper[4769]: E1121 13:10:52.173410 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-api" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173416 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-api" Nov 21 13:10:52 crc kubenswrapper[4769]: E1121 13:10:52.173434 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-log" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173440 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-log" Nov 21 13:10:52 crc kubenswrapper[4769]: E1121 13:10:52.173447 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-api" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173453 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-api" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173624 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-log" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173644 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-log" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173656 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" containerName="placement-api" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.173671 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" containerName="nova-api-api" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.174728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.179148 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.179272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.179671 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.198417 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.309040 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.309122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.309208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.309250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e185c2f1-e6b7-45df-8977-d343330f24e3-logs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.309328 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-config-data\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.309463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb649\" (UniqueName: \"kubernetes.io/projected/e185c2f1-e6b7-45df-8977-d343330f24e3-kube-api-access-jb649\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.422172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jb649\" (UniqueName: \"kubernetes.io/projected/e185c2f1-e6b7-45df-8977-d343330f24e3-kube-api-access-jb649\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.423174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.423509 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.423683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.423780 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e185c2f1-e6b7-45df-8977-d343330f24e3-logs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.423884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-config-data\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.427380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-746497cdbb-48258"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.427504 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e185c2f1-e6b7-45df-8977-d343330f24e3-logs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.435898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.437840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.443162 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-config-data\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.448810 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-746497cdbb-48258"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.449565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb649\" (UniqueName: \"kubernetes.io/projected/e185c2f1-e6b7-45df-8977-d343330f24e3-kube-api-access-jb649\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.450632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs\") pod \"nova-api-0\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.632873 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.726671 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.727430 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-internal-tls-certs\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.727668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5blm\" (UniqueName: \"kubernetes.io/projected/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-kube-api-access-d5blm\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.727700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-public-tls-certs\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.727722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data-custom\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.727781 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-combined-ca-bundle\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.728583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.728603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-logs\") pod \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\" (UID: \"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e\") " Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.729347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-logs" (OuterVolumeSpecName: "logs") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.746136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-kube-api-access-d5blm" (OuterVolumeSpecName: "kube-api-access-d5blm") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "kube-api-access-d5blm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.746141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.759456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.789951 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.829612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data" (OuterVolumeSpecName: "config-data") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.830726 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d5blm\" (UniqueName: \"kubernetes.io/projected/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-kube-api-access-d5blm\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.830746 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.830755 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.830764 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.830773 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.830784 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.860419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" (UID: "05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.919862 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.932872 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:52 crc kubenswrapper[4769]: I1121 13:10:52.992064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"983d3297-af3a-447c-ac21-4150a0626907","Type":"ContainerStarted","Data":"d2f2948cca4c4068696e7ac691ad4a49a4104f5be8335077266015665bbf40ea"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.022505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerStarted","Data":"132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.024780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerStarted","Data":"6241ad9fb10ef3484828bd5a36f910dae11a2cf14838958df346b595ad4f05b9"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027251 4769 generic.go:334] "Generic (PLEG): container finished" podID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerID="2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d" exitCode=0 Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027273 4769 generic.go:334] "Generic (PLEG): container finished" podID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerID="90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc" exitCode=143 Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" event={"ID":"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e","Type":"ContainerDied","Data":"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" event={"ID":"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e","Type":"ContainerDied","Data":"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" event={"ID":"05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e","Type":"ContainerDied","Data":"0a3eeb77475f8b21b02d26d7cb1d3ff2091025ba3945060207231d75f93cbd34"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027357 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-79785467cb-pt6w4" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.027365 4769 scope.go:117] "RemoveContainer" containerID="2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.033334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" event={"ID":"9e7628da-ebf2-4650-ab67-7636546fdf65","Type":"ContainerStarted","Data":"57298bda3155381200ae1e6bb49a3c4f0a2c270e76442b8ba3ecf230459a769f"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.033398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" event={"ID":"9e7628da-ebf2-4650-ab67-7636546fdf65","Type":"ContainerStarted","Data":"295ba92e4dd42fb0f0dc26e0842fc3ea44994b27fee003b3bfe99ca1ed550308"} Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.122312 4769 scope.go:117] "RemoveContainer" containerID="90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.141245 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-79785467cb-pt6w4"] Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.153627 4769 scope.go:117] "RemoveContainer" containerID="2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d" Nov 21 13:10:53 crc kubenswrapper[4769]: E1121 13:10:53.157705 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d\": container with ID starting with 2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d not found: ID does not exist" containerID="2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.157758 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d"} err="failed to get container status \"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d\": rpc error: code = NotFound desc = could not find container \"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d\": container with ID starting with 2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d not found: ID does not exist" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.157793 4769 scope.go:117] "RemoveContainer" containerID="90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.158627 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-79785467cb-pt6w4"] Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.160099 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="28b4c080-d344-4492-b6aa-909d533fec32" containerName="galera" containerID="cri-o://454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a" gracePeriod=30 Nov 21 13:10:53 crc kubenswrapper[4769]: E1121 13:10:53.161904 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc\": container with ID starting with 90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc not found: ID does not exist" containerID="90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.161933 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc"} err="failed to get container status \"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc\": rpc error: code = NotFound desc = could not find container \"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc\": container with ID starting with 90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc not found: ID does not exist" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.161958 4769 scope.go:117] "RemoveContainer" containerID="2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.165091 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d"} err="failed to get container status \"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d\": rpc error: code = NotFound desc = could not find container \"2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d\": container with ID starting with 2b198913f79f0049fe553fdfd9f905d534486f6fb5f8b9a7892f2bfddb80ee4d not found: ID does not exist" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.165135 4769 scope.go:117] "RemoveContainer" containerID="90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.165466 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc"} err="failed to get container status \"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc\": rpc error: code = NotFound desc = could not find container \"90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc\": container with ID starting with 90c5911189dd3156d1d686ee5b83dfb5e8db25530ce5f64e666485a3123183dc not found: ID does not exist" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.292935 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" path="/var/lib/kubelet/pods/05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e/volumes" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.293944 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f57e1d-5fbf-42c7-9f34-fa747091c0c2" path="/var/lib/kubelet/pods/45f57e1d-5fbf-42c7-9f34-fa747091c0c2/volumes" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.294577 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="491eddfd-964e-4de3-940f-e22d3f0d2c29" path="/var/lib/kubelet/pods/491eddfd-964e-4de3-940f-e22d3f0d2c29/volumes" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.388924 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:10:53 crc kubenswrapper[4769]: W1121 13:10:53.397842 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode185c2f1_e6b7_45df_8977_d343330f24e3.slice/crio-633c9fc54e4cbc1241712c281e790fc963303d9ad5efb1eb17ecb63c74be4ec6 WatchSource:0}: Error finding container 633c9fc54e4cbc1241712c281e790fc963303d9ad5efb1eb17ecb63c74be4ec6: Status 404 returned error can't find the container with id 633c9fc54e4cbc1241712c281e790fc963303d9ad5efb1eb17ecb63c74be4ec6 Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.937844 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:53 crc kubenswrapper[4769]: I1121 13:10:53.938161 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.044679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" event={"ID":"9e7628da-ebf2-4650-ab67-7636546fdf65","Type":"ContainerStarted","Data":"79ef4a73447843fd9a3b1a461f8b1ffd2d6c2a8248e4027f928854962875fb3f"} Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.046177 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.046312 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.050163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"983d3297-af3a-447c-ac21-4150a0626907","Type":"ContainerStarted","Data":"e092805bd57392bc944dea66cee8e98cc8cd1596cb22e01eae257ca8b1694a32"} Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.055039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerStarted","Data":"3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a"} Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.058225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e185c2f1-e6b7-45df-8977-d343330f24e3","Type":"ContainerStarted","Data":"8bfef00943a48dc5e1d8712c382f942d89bcf93b1d416023c5df7398aa0f5826"} Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.058264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e185c2f1-e6b7-45df-8977-d343330f24e3","Type":"ContainerStarted","Data":"633c9fc54e4cbc1241712c281e790fc963303d9ad5efb1eb17ecb63c74be4ec6"} Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.103524 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podStartSLOduration=4.10350674 podStartE2EDuration="4.10350674s" podCreationTimestamp="2025-11-21 13:10:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:54.078931188 +0000 UTC m=+4812.779593006" watchObservedRunningTime="2025-11-21 13:10:54.10350674 +0000 UTC m=+4812.804168558" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.534988 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.534972234 podStartE2EDuration="5.534972234s" podCreationTimestamp="2025-11-21 13:10:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:54.106117741 +0000 UTC m=+4812.806779559" watchObservedRunningTime="2025-11-21 13:10:54.534972234 +0000 UTC m=+4813.235634042" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.539132 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.755062 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerName="galera" containerID="cri-o://8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e" gracePeriod=30 Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.809446 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.809504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.849993 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.869916 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.876692 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:54 crc kubenswrapper[4769]: I1121 13:10:54.993996 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.045642 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.045880 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="60f31c55-36c3-4986-b9f8-432f4f055d75" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde" gracePeriod=30 Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.093323 4769 generic.go:334] "Generic (PLEG): container finished" podID="28b4c080-d344-4492-b6aa-909d533fec32" containerID="454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a" exitCode=0 Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.093412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"28b4c080-d344-4492-b6aa-909d533fec32","Type":"ContainerDied","Data":"454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a"} Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.093443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"28b4c080-d344-4492-b6aa-909d533fec32","Type":"ContainerDied","Data":"dbe028ecc6b10f34cd174f47cd09b9102c0dfe5310e21c5cc27007d7d4b09649"} Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.093463 4769 scope.go:117] "RemoveContainer" containerID="454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.093618 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.103523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerStarted","Data":"6c60b55664d50339922e5939476f8824a82d0e2abf601b99a2e92514bf86ec11"} Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.111223 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e185c2f1-e6b7-45df-8977-d343330f24e3","Type":"ContainerStarted","Data":"b9847f2b3d0083ef5ef68f7cec090f69da0c6ed2b4bc3f866a1e4ac3c5a41af8"} Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.124335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"983d3297-af3a-447c-ac21-4150a0626907","Type":"ContainerStarted","Data":"85e87dc518b24c4ec2884bd507e742126b310138eccd8a0f39d227ababb6622f"} Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.124899 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.125445 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.141086 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.141064002 podStartE2EDuration="3.141064002s" podCreationTimestamp="2025-11-21 13:10:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:55.137440924 +0000 UTC m=+4813.838102742" watchObservedRunningTime="2025-11-21 13:10:55.141064002 +0000 UTC m=+4813.841725820" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.160351 4769 scope.go:117] "RemoveContainer" containerID="08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.167170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-galera-tls-certs\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.167786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvphg\" (UniqueName: \"kubernetes.io/projected/28b4c080-d344-4492-b6aa-909d533fec32-kube-api-access-cvphg\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.168153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/28b4c080-d344-4492-b6aa-909d533fec32-config-data-generated\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.168585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-operator-scripts\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.168823 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.168964 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-config-data-default\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.169118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-kolla-config\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.169156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b4c080-d344-4492-b6aa-909d533fec32-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.169276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-combined-ca-bundle\") pod \"28b4c080-d344-4492-b6aa-909d533fec32\" (UID: \"28b4c080-d344-4492-b6aa-909d533fec32\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.170552 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/28b4c080-d344-4492-b6aa-909d533fec32-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.176397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.181692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.182415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.182861 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b4c080-d344-4492-b6aa-909d533fec32-kube-api-access-cvphg" (OuterVolumeSpecName: "kube-api-access-cvphg") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "kube-api-access-cvphg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.186520 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.186494955 podStartE2EDuration="6.186494955s" podCreationTimestamp="2025-11-21 13:10:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:55.158227364 +0000 UTC m=+4813.858889182" watchObservedRunningTime="2025-11-21 13:10:55.186494955 +0000 UTC m=+4813.887156773" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.196130 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.205148 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.249651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.272134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "28b4c080-d344-4492-b6aa-909d533fec32" (UID: "28b4c080-d344-4492-b6aa-909d533fec32"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.275746 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.276692 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cvphg\" (UniqueName: \"kubernetes.io/projected/28b4c080-d344-4492-b6aa-909d533fec32-kube-api-access-cvphg\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.277279 4769 scope.go:117] "RemoveContainer" containerID="05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.278650 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.278911 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.279612 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.279630 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/28b4c080-d344-4492-b6aa-909d533fec32-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.279640 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28b4c080-d344-4492-b6aa-909d533fec32-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.335001 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.369317 4769 scope.go:117] "RemoveContainer" containerID="454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a" Nov 21 13:10:55 crc kubenswrapper[4769]: E1121 13:10:55.370892 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a\": container with ID starting with 454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a not found: ID does not exist" containerID="454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.370997 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a"} err="failed to get container status \"454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a\": rpc error: code = NotFound desc = could not find container \"454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a\": container with ID starting with 454064bf360278dcaaeb6f68d9d95d1ca56db96dfc2021c694c18a14cc32289a not found: ID does not exist" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.371091 4769 scope.go:117] "RemoveContainer" containerID="08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e" Nov 21 13:10:55 crc kubenswrapper[4769]: E1121 13:10:55.371580 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e\": container with ID starting with 08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e not found: ID does not exist" containerID="08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.371639 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e"} err="failed to get container status \"08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e\": rpc error: code = NotFound desc = could not find container \"08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e\": container with ID starting with 08fe902743c237550c4bad2e50b5af423fafa37ab0d1c407b9c0e49c00a0315e not found: ID does not exist" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.382364 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.425638 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.446843 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.471472 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:55 crc kubenswrapper[4769]: E1121 13:10:55.471936 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api-log" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.471955 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api-log" Nov 21 13:10:55 crc kubenswrapper[4769]: E1121 13:10:55.471991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28b4c080-d344-4492-b6aa-909d533fec32" containerName="galera" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.472000 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b4c080-d344-4492-b6aa-909d533fec32" containerName="galera" Nov 21 13:10:55 crc kubenswrapper[4769]: E1121 13:10:55.472023 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.472031 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api" Nov 21 13:10:55 crc kubenswrapper[4769]: E1121 13:10:55.472041 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="28b4c080-d344-4492-b6aa-909d533fec32" containerName="mysql-bootstrap" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.472049 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b4c080-d344-4492-b6aa-909d533fec32" containerName="mysql-bootstrap" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.472291 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="28b4c080-d344-4492-b6aa-909d533fec32" containerName="galera" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.472318 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api-log" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.472358 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="05a6e07f-22ef-4eeb-a7ce-a5da8ae0148e" containerName="barbican-api" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.473678 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.475337 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-xl2bf" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.475934 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.476375 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.476587 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.489698 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.586045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqpc\" (UniqueName: \"kubernetes.io/projected/49dbf016-abc5-4e21-9912-cdac726ea545-kube-api-access-clqpc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.586358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.586699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.586849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.587016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.587261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.587403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.587564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689334 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-clqpc\" (UniqueName: \"kubernetes.io/projected/49dbf016-abc5-4e21-9912-cdac726ea545-kube-api-access-clqpc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.689636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.690456 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.690657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.690924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.691059 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.692814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.699773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.705506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.714048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqpc\" (UniqueName: \"kubernetes.io/projected/49dbf016-abc5-4e21-9912-cdac726ea545-kube-api-access-clqpc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.738043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.812839 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.838984 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6986bbf45b-vgn4n"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.839717 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" podUID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" containerName="keystone-api" containerID="cri-o://33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8" gracePeriod=30 Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.855291 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" podUID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.1.148:5000/v3\": read tcp 10.217.0.2:45212->10.217.1.148:5000: read: connection reset by peer" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.886519 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-85c5b68669-ljc9x"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.888102 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.897363 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.936612 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-85c5b68669-ljc9x"] Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.995076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-combined-ca-bundle\") pod \"60f31c55-36c3-4986-b9f8-432f4f055d75\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.995238 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-config-data\") pod \"60f31c55-36c3-4986-b9f8-432f4f055d75\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.995306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-vencrypt-tls-certs\") pod \"60f31c55-36c3-4986-b9f8-432f4f055d75\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.995395 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-nova-novncproxy-tls-certs\") pod \"60f31c55-36c3-4986-b9f8-432f4f055d75\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.995426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs578\" (UniqueName: \"kubernetes.io/projected/60f31c55-36c3-4986-b9f8-432f4f055d75-kube-api-access-fs578\") pod \"60f31c55-36c3-4986-b9f8-432f4f055d75\" (UID: \"60f31c55-36c3-4986-b9f8-432f4f055d75\") " Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.995934 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-config-data\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-combined-ca-bundle\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996060 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-credential-keys\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fpxd\" (UniqueName: \"kubernetes.io/projected/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-kube-api-access-6fpxd\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-public-tls-certs\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996213 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-fernet-keys\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-scripts\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:55 crc kubenswrapper[4769]: I1121 13:10:55.996515 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-internal-tls-certs\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.032075 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60f31c55-36c3-4986-b9f8-432f4f055d75-kube-api-access-fs578" (OuterVolumeSpecName: "kube-api-access-fs578") pod "60f31c55-36c3-4986-b9f8-432f4f055d75" (UID: "60f31c55-36c3-4986-b9f8-432f4f055d75"). InnerVolumeSpecName "kube-api-access-fs578". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.049057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "60f31c55-36c3-4986-b9f8-432f4f055d75" (UID: "60f31c55-36c3-4986-b9f8-432f4f055d75"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.066585 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.105363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-fernet-keys\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.105786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-scripts\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.105820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-internal-tls-certs\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.105868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-config-data\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.106010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-combined-ca-bundle\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.106095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-credential-keys\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.106123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpxd\" (UniqueName: \"kubernetes.io/projected/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-kube-api-access-6fpxd\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.106216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-public-tls-certs\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.106303 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fs578\" (UniqueName: \"kubernetes.io/projected/60f31c55-36c3-4986-b9f8-432f4f055d75-kube-api-access-fs578\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.106315 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.111283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-internal-tls-certs\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.111476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-config-data" (OuterVolumeSpecName: "config-data") pod "60f31c55-36c3-4986-b9f8-432f4f055d75" (UID: "60f31c55-36c3-4986-b9f8-432f4f055d75"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.117868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-combined-ca-bundle\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.118600 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-credential-keys\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.121702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "60f31c55-36c3-4986-b9f8-432f4f055d75" (UID: "60f31c55-36c3-4986-b9f8-432f4f055d75"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.124289 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-fernet-keys\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.126694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fpxd\" (UniqueName: \"kubernetes.io/projected/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-kube-api-access-6fpxd\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.127422 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-public-tls-certs\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.128056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-config-data\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.141765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-scripts\") pod \"keystone-85c5b68669-ljc9x\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.142100 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "60f31c55-36c3-4986-b9f8-432f4f055d75" (UID: "60f31c55-36c3-4986-b9f8-432f4f055d75"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.182732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerStarted","Data":"8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc"} Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.185160 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.195228 4769 generic.go:334] "Generic (PLEG): container finished" podID="60f31c55-36c3-4986-b9f8-432f4f055d75" containerID="c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde" exitCode=0 Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.195298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"60f31c55-36c3-4986-b9f8-432f4f055d75","Type":"ContainerDied","Data":"c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde"} Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.195326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"60f31c55-36c3-4986-b9f8-432f4f055d75","Type":"ContainerDied","Data":"597c7c8d3551426aebf31c6868e24e6f79a11ff8ac7235fa20811a08e36faa38"} Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.195343 4769 scope.go:117] "RemoveContainer" containerID="c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.195473 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.208123 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.210198 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.210347 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/60f31c55-36c3-4986-b9f8-432f4f055d75-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.243105 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.244307 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerStarted","Data":"d2d9913e73bc99914b02d81e8c2dee44e47569031422898b520f66bf2fe6034d"} Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.273870 4769 scope.go:117] "RemoveContainer" containerID="1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.296584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.336099 4769 scope.go:117] "RemoveContainer" containerID="c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde" Nov 21 13:10:56 crc kubenswrapper[4769]: E1121 13:10:56.337132 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde\": container with ID starting with c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde not found: ID does not exist" containerID="c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.337274 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde"} err="failed to get container status \"c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde\": rpc error: code = NotFound desc = could not find container \"c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde\": container with ID starting with c46bef5f349b8f3439cd6eae7944a47c537dda949f6e3868c8420de95f9b7cde not found: ID does not exist" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.380839 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.385097 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:56 crc kubenswrapper[4769]: E1121 13:10:56.387913 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="60f31c55-36c3-4986-b9f8-432f4f055d75" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.387946 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="60f31c55-36c3-4986-b9f8-432f4f055d75" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.388243 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="60f31c55-36c3-4986-b9f8-432f4f055d75" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.397474 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.397727 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.401614 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.401836 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.401973 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.476427 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.517578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghlrp\" (UniqueName: \"kubernetes.io/projected/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-kube-api-access-ghlrp\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.517666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.517721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.517739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.517773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.619407 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.619585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.619678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.619818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlrp\" (UniqueName: \"kubernetes.io/projected/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-kube-api-access-ghlrp\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.619906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.627698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.628937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.633267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.638778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.644125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghlrp\" (UniqueName: \"kubernetes.io/projected/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-kube-api-access-ghlrp\") pod \"nova-cell1-novncproxy-0\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.665166 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.720853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-internal-tls-certs\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.720913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g7hm\" (UniqueName: \"kubernetes.io/projected/9be129cd-9422-434a-b2aa-0d9c3d8423e0-kube-api-access-7g7hm\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.720961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-credential-keys\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.721017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-config-data\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.721072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-combined-ca-bundle\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.721094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-public-tls-certs\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.721154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-fernet-keys\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.721245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-scripts\") pod \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\" (UID: \"9be129cd-9422-434a-b2aa-0d9c3d8423e0\") " Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.727706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-scripts" (OuterVolumeSpecName: "scripts") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.731819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be129cd-9422-434a-b2aa-0d9c3d8423e0-kube-api-access-7g7hm" (OuterVolumeSpecName: "kube-api-access-7g7hm") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "kube-api-access-7g7hm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.734515 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.734591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.785570 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.825045 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.825077 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.825086 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.825096 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7g7hm\" (UniqueName: \"kubernetes.io/projected/9be129cd-9422-434a-b2aa-0d9c3d8423e0-kube-api-access-7g7hm\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.904063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.931093 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-85c5b68669-ljc9x"] Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.932756 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.935412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-config-data" (OuterVolumeSpecName: "config-data") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:56 crc kubenswrapper[4769]: I1121 13:10:56.946408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.008136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.046709 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.046732 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcrjq\" (UniqueName: \"kubernetes.io/projected/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kube-api-access-zcrjq\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-generated\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-operator-scripts\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-combined-ca-bundle\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-default\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.147988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-galera-tls-certs\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.148023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kolla-config\") pod \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\" (UID: \"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1\") " Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.148295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.148833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.149748 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.149833 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.149855 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.150118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.254512 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.254541 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.257704 4769 generic.go:334] "Generic (PLEG): container finished" podID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerID="8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e" exitCode=0 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.257759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1","Type":"ContainerDied","Data":"8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e"} Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.257764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.257923 4769 scope.go:117] "RemoveContainer" containerID="8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.257909 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1","Type":"ContainerDied","Data":"5e091aeb83f00dce501ba309a2093ad2c9eae1d4a805e8cd560e2d4e154f8f5c"} Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.269671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" event={"ID":"cecb25e5-59fd-4adf-b38b-c0f36e711c0f","Type":"ContainerStarted","Data":"87bb7b889a909fd03f984b8f172470eb45e54f221ab59b602c72ccd07a6406b4"} Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.271632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"49dbf016-abc5-4e21-9912-cdac726ea545","Type":"ContainerStarted","Data":"eae5f0d1d90a297afb50c50fde2ed865d7fe1ca832e1efc754bef6fc60f0a2a4"} Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.271671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"49dbf016-abc5-4e21-9912-cdac726ea545","Type":"ContainerStarted","Data":"eecfecf58ea3d4e053d447da44845a99b1483d45dd726892fd127ed68a8cacd4"} Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.273492 4769 generic.go:334] "Generic (PLEG): container finished" podID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" containerID="33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8" exitCode=0 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.273579 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.279791 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerID="132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de" exitCode=1 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.290369 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b4c080-d344-4492-b6aa-909d533fec32" path="/var/lib/kubelet/pods/28b4c080-d344-4492-b6aa-909d533fec32/volumes" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.290940 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60f31c55-36c3-4986-b9f8-432f4f055d75" path="/var/lib/kubelet/pods/60f31c55-36c3-4986-b9f8-432f4f055d75/volumes" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.293531 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-central-agent" containerID="cri-o://6241ad9fb10ef3484828bd5a36f910dae11a2cf14838958df346b595ad4f05b9" gracePeriod=30 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.293830 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.293843 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="sg-core" containerID="cri-o://d2d9913e73bc99914b02d81e8c2dee44e47569031422898b520f66bf2fe6034d" gracePeriod=30 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.293851 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.293885 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-notification-agent" containerID="cri-o://6c60b55664d50339922e5939476f8824a82d0e2abf601b99a2e92514bf86ec11" gracePeriod=30 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.293831 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="proxy-httpd" containerID="cri-o://ac28bec72a02aacf2a6341b52779262d55a4c20bb05da0ec8dd04d78f5bacd70" gracePeriod=30 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.340467 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.9768116989999998 podStartE2EDuration="8.340439811s" podCreationTimestamp="2025-11-21 13:10:49 +0000 UTC" firstStartedPulling="2025-11-21 13:10:51.09228195 +0000 UTC m=+4809.792943768" lastFinishedPulling="2025-11-21 13:10:56.455910062 +0000 UTC m=+4815.156571880" observedRunningTime="2025-11-21 13:10:57.328879479 +0000 UTC m=+4816.029541327" watchObservedRunningTime="2025-11-21 13:10:57.340439811 +0000 UTC m=+4816.041101629" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.787046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kube-api-access-zcrjq" (OuterVolumeSpecName: "kube-api-access-zcrjq") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "kube-api-access-zcrjq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: W1121 13:10:57.796902 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda22f9c37_8fc9_4add_944a_d4d1dcc1a6f6.slice/crio-9c0a592539bf600bea79ae7a7eebd5f07bf4f08cc04f41f5e431a197d60c2e30 WatchSource:0}: Error finding container 9c0a592539bf600bea79ae7a7eebd5f07bf4f08cc04f41f5e431a197d60c2e30: Status 404 returned error can't find the container with id 9c0a592539bf600bea79ae7a7eebd5f07bf4f08cc04f41f5e431a197d60c2e30 Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.802221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.835628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9be129cd-9422-434a-b2aa-0d9c3d8423e0" (UID: "9be129cd-9422-434a-b2aa-0d9c3d8423e0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.867344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.872773 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be129cd-9422-434a-b2aa-0d9c3d8423e0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.872800 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.872811 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zcrjq\" (UniqueName: \"kubernetes.io/projected/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-kube-api-access-zcrjq\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:57 crc kubenswrapper[4769]: I1121 13:10:57.872882 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.009288 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.048840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" (UID: "d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.076588 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.076633 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184476 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" event={"ID":"9be129cd-9422-434a-b2aa-0d9c3d8423e0","Type":"ContainerDied","Data":"33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6986bbf45b-vgn4n" event={"ID":"9be129cd-9422-434a-b2aa-0d9c3d8423e0","Type":"ContainerDied","Data":"071a2edf793e5b603f789af202c88539eda751c78d2e2b2f36c623e6b29daafc"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerStarted","Data":"df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184565 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184614 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerDied","Data":"132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184643 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184670 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.184680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerStarted","Data":"ac28bec72a02aacf2a6341b52779262d55a4c20bb05da0ec8dd04d78f5bacd70"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.185004 4769 scope.go:117] "RemoveContainer" containerID="132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.186491 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.221600 4769 scope.go:117] "RemoveContainer" containerID="74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.275323 4769 scope.go:117] "RemoveContainer" containerID="8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e" Nov 21 13:10:58 crc kubenswrapper[4769]: E1121 13:10:58.281097 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e\": container with ID starting with 8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e not found: ID does not exist" containerID="8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.281172 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e"} err="failed to get container status \"8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e\": rpc error: code = NotFound desc = could not find container \"8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e\": container with ID starting with 8ec20a643a3009b06fac7b0e1c7b6348cba51009a7660e5efc8f6495fca7f58e not found: ID does not exist" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.281210 4769 scope.go:117] "RemoveContainer" containerID="74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f" Nov 21 13:10:58 crc kubenswrapper[4769]: E1121 13:10:58.286355 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f\": container with ID starting with 74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f not found: ID does not exist" containerID="74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.286406 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f"} err="failed to get container status \"74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f\": rpc error: code = NotFound desc = could not find container \"74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f\": container with ID starting with 74f243aa238d74088ea6efa44185aedf2e0221280069cd60eeda9e325743b48f not found: ID does not exist" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.286433 4769 scope.go:117] "RemoveContainer" containerID="33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.346609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6","Type":"ContainerStarted","Data":"9c0a592539bf600bea79ae7a7eebd5f07bf4f08cc04f41f5e431a197d60c2e30"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.412313 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.424249 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.432471 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6986bbf45b-vgn4n"] Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.440296 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6986bbf45b-vgn4n"] Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.454236 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:58 crc kubenswrapper[4769]: E1121 13:10:58.454709 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerName="galera" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.454724 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerName="galera" Nov 21 13:10:58 crc kubenswrapper[4769]: E1121 13:10:58.454743 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerName="mysql-bootstrap" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.454749 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerName="mysql-bootstrap" Nov 21 13:10:58 crc kubenswrapper[4769]: E1121 13:10:58.454769 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" containerName="keystone-api" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.454776 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" containerName="keystone-api" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.454942 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" containerName="keystone-api" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.454971 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" containerName="galera" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.455973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.459312 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.464240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.470605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.470931 4769 generic.go:334] "Generic (PLEG): container finished" podID="91b5d253-958f-421b-bff9-432fa0abea80" containerID="d2d9913e73bc99914b02d81e8c2dee44e47569031422898b520f66bf2fe6034d" exitCode=2 Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.470955 4769 generic.go:334] "Generic (PLEG): container finished" podID="91b5d253-958f-421b-bff9-432fa0abea80" containerID="6c60b55664d50339922e5939476f8824a82d0e2abf601b99a2e92514bf86ec11" exitCode=0 Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.471014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerDied","Data":"d2d9913e73bc99914b02d81e8c2dee44e47569031422898b520f66bf2fe6034d"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.471037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerDied","Data":"6c60b55664d50339922e5939476f8824a82d0e2abf601b99a2e92514bf86ec11"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.471338 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.471383 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ktmdt" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.475265 4769 generic.go:334] "Generic (PLEG): container finished" podID="49dbf016-abc5-4e21-9912-cdac726ea545" containerID="eae5f0d1d90a297afb50c50fde2ed865d7fe1ca832e1efc754bef6fc60f0a2a4" exitCode=0 Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.476626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"49dbf016-abc5-4e21-9912-cdac726ea545","Type":"ContainerDied","Data":"eae5f0d1d90a297afb50c50fde2ed865d7fe1ca832e1efc754bef6fc60f0a2a4"} Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-kolla-config\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494222 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e7403ff5-3219-4017-9736-d92812125520-config-data-generated\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-config-data-default\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-operator-scripts\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.494510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qgjl\" (UniqueName: \"kubernetes.io/projected/e7403ff5-3219-4017-9736-d92812125520-kube-api-access-7qgjl\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-operator-scripts\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599136 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7qgjl\" (UniqueName: \"kubernetes.io/projected/e7403ff5-3219-4017-9736-d92812125520-kube-api-access-7qgjl\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-kolla-config\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599288 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e7403ff5-3219-4017-9736-d92812125520-config-data-generated\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.599308 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-config-data-default\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.600371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-config-data-default\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.600807 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-kolla-config\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.602126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-operator-scripts\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.602990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e7403ff5-3219-4017-9736-d92812125520-config-data-generated\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.603159 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.614988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.618417 4769 scope.go:117] "RemoveContainer" containerID="33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.623948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: E1121 13:10:58.627341 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8\": container with ID starting with 33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8 not found: ID does not exist" containerID="33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.627390 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8"} err="failed to get container status \"33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8\": rpc error: code = NotFound desc = could not find container \"33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8\": container with ID starting with 33bc251fa424821b5991b8930d7c0bf0a00f8100972fc1759536b934224c70a8 not found: ID does not exist" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.630846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qgjl\" (UniqueName: \"kubernetes.io/projected/e7403ff5-3219-4017-9736-d92812125520-kube-api-access-7qgjl\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.693637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.938158 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.938573 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:10:58 crc kubenswrapper[4769]: I1121 13:10:58.984671 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.195765 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.306357 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9be129cd-9422-434a-b2aa-0d9c3d8423e0" path="/var/lib/kubelet/pods/9be129cd-9422-434a-b2aa-0d9c3d8423e0/volumes" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.307305 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1" path="/var/lib/kubelet/pods/d55280e6-0ad9-4bb3-b7c0-f0aa1d9fc4f1/volumes" Nov 21 13:10:59 crc kubenswrapper[4769]: E1121 13:10:59.321358 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc is running failed: container process not found" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:59 crc kubenswrapper[4769]: E1121 13:10:59.328628 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc is running failed: container process not found" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:59 crc kubenswrapper[4769]: E1121 13:10:59.335599 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc is running failed: container process not found" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:10:59 crc kubenswrapper[4769]: E1121 13:10:59.335675 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc is running failed: container process not found" probeType="Liveness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.490621 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" exitCode=1 Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.490679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerDied","Data":"8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc"} Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.490712 4769 scope.go:117] "RemoveContainer" containerID="05b56f4fe7986ef5c17c97baa8db25f53f875ab5be50a7e7120bc407d1c7a7a4" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.491398 4769 scope.go:117] "RemoveContainer" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:10:59 crc kubenswrapper[4769]: E1121 13:10:59.491887 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(f5b6a13f-243f-4eb4-868d-039a2c527c0b)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.495294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"49dbf016-abc5-4e21-9912-cdac726ea545","Type":"ContainerStarted","Data":"ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb"} Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.498861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6","Type":"ContainerStarted","Data":"fbc8e22d3500b60d401be82ddb82650923ba7c1a02ac9f6b4280c500a79c6304"} Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.504701 4769 generic.go:334] "Generic (PLEG): container finished" podID="91b5d253-958f-421b-bff9-432fa0abea80" containerID="6241ad9fb10ef3484828bd5a36f910dae11a2cf14838958df346b595ad4f05b9" exitCode=0 Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.505021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerDied","Data":"6241ad9fb10ef3484828bd5a36f910dae11a2cf14838958df346b595ad4f05b9"} Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.530301 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.530365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" event={"ID":"cecb25e5-59fd-4adf-b38b-c0f36e711c0f","Type":"ContainerStarted","Data":"5304de44ce101b82147ad2b4ad0a44667ae2301091073c255c33cc1513cd7c04"} Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.551308 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=4.55128437 podStartE2EDuration="4.55128437s" podCreationTimestamp="2025-11-21 13:10:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:59.530069049 +0000 UTC m=+4818.230730877" watchObservedRunningTime="2025-11-21 13:10:59.55128437 +0000 UTC m=+4818.251946178" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.582295 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.582275615 podStartE2EDuration="3.582275615s" podCreationTimestamp="2025-11-21 13:10:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:59.550719495 +0000 UTC m=+4818.251381333" watchObservedRunningTime="2025-11-21 13:10:59.582275615 +0000 UTC m=+4818.282937423" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.591931 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" podStartSLOduration=4.591913525 podStartE2EDuration="4.591913525s" podCreationTimestamp="2025-11-21 13:10:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:10:59.573441227 +0000 UTC m=+4818.274103045" watchObservedRunningTime="2025-11-21 13:10:59.591913525 +0000 UTC m=+4818.292575343" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.702881 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.951373 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.155:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:10:59 crc kubenswrapper[4769]: I1121 13:10:59.951413 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.155:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.195869 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.545980 4769 generic.go:334] "Generic (PLEG): container finished" podID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerID="df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0" exitCode=1 Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.546046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerDied","Data":"df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0"} Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.546077 4769 scope.go:117] "RemoveContainer" containerID="1d8b35e87034609a55ca359d8ebb12207a2ad7afc1195c422a8e52cc6232c39b" Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.546718 4769 scope.go:117] "RemoveContainer" containerID="df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0" Nov 21 13:11:00 crc kubenswrapper[4769]: E1121 13:11:00.546943 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(4447c27b-0c4c-444a-981a-df468fe19b6e)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.567478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerStarted","Data":"0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f"} Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.569956 4769 generic.go:334] "Generic (PLEG): container finished" podID="e7403ff5-3219-4017-9736-d92812125520" containerID="474958df98f4855eb255c24fdce75db8a1252c75676d0498ed9efebdc001dcc7" exitCode=0 Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.570737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"e7403ff5-3219-4017-9736-d92812125520","Type":"ContainerDied","Data":"474958df98f4855eb255c24fdce75db8a1252c75676d0498ed9efebdc001dcc7"} Nov 21 13:11:00 crc kubenswrapper[4769]: I1121 13:11:00.570801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"e7403ff5-3219-4017-9736-d92812125520","Type":"ContainerStarted","Data":"44c9f8f0570237d34d4a22d2e480da46f918680b91115452d32dced0e0cdedcd"} Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.168770 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.168830 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.224095 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.230300 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.584127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"e7403ff5-3219-4017-9736-d92812125520","Type":"ContainerStarted","Data":"9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31"} Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.584935 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.584984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.606758 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=3.606742122 podStartE2EDuration="3.606742122s" podCreationTimestamp="2025-11-21 13:10:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:11:01.601554652 +0000 UTC m=+4820.302216470" watchObservedRunningTime="2025-11-21 13:11:01.606742122 +0000 UTC m=+4820.307403930" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.786721 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:11:01 crc kubenswrapper[4769]: I1121 13:11:01.814446 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.230488 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.231441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.232098 4769 scope.go:117] "RemoveContainer" containerID="df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0" Nov 21 13:11:02 crc kubenswrapper[4769]: E1121 13:11:02.232342 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(4447c27b-0c4c-444a-981a-df468fe19b6e)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.316682 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.317475 4769 scope.go:117] "RemoveContainer" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:11:02 crc kubenswrapper[4769]: E1121 13:11:02.317712 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(f5b6a13f-243f-4eb4-868d-039a2c527c0b)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.727957 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:02 crc kubenswrapper[4769]: I1121 13:11:02.728006 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:03 crc kubenswrapper[4769]: I1121 13:11:03.604526 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:03 crc kubenswrapper[4769]: I1121 13:11:03.604878 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:11:03 crc kubenswrapper[4769]: I1121 13:11:03.743392 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.165:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:03 crc kubenswrapper[4769]: I1121 13:11:03.743432 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.165:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:03 crc kubenswrapper[4769]: I1121 13:11:03.863552 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:11:04 crc kubenswrapper[4769]: I1121 13:11:04.813470 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:05 crc kubenswrapper[4769]: I1121 13:11:05.196170 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:11:05 crc kubenswrapper[4769]: I1121 13:11:05.221410 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:05 crc kubenswrapper[4769]: I1121 13:11:05.814256 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:11:05 crc kubenswrapper[4769]: I1121 13:11:05.814311 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:11:05 crc kubenswrapper[4769]: I1121 13:11:05.901854 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:11:06 crc kubenswrapper[4769]: I1121 13:11:06.225430 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:06 crc kubenswrapper[4769]: I1121 13:11:06.225430 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:06 crc kubenswrapper[4769]: I1121 13:11:06.717714 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:11:06 crc kubenswrapper[4769]: I1121 13:11:06.786769 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:11:06 crc kubenswrapper[4769]: I1121 13:11:06.819534 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:06 crc kubenswrapper[4769]: I1121 13:11:06.833587 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:11:07 crc kubenswrapper[4769]: I1121 13:11:07.235402 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:07 crc kubenswrapper[4769]: I1121 13:11:07.668822 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:11:08 crc kubenswrapper[4769]: I1121 13:11:08.985387 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:11:08 crc kubenswrapper[4769]: I1121 13:11:08.985759 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:11:09 crc kubenswrapper[4769]: I1121 13:11:09.069372 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:11:09 crc kubenswrapper[4769]: I1121 13:11:09.773997 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:11:09 crc kubenswrapper[4769]: I1121 13:11:09.819384 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:09 crc kubenswrapper[4769]: I1121 13:11:09.950376 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.155:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:09 crc kubenswrapper[4769]: I1121 13:11:09.950636 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.155:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.196935 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6f699bcfc4-4pddg_933cf65a-d662-413c-8b6f-fa4145f20373/neutron-api/0.log" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.197029 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.245349 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.156:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.245774 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.299645 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-ovndb-tls-certs\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-config\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-combined-ca-bundle\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-httpd-config\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-public-tls-certs\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blxh6\" (UniqueName: \"kubernetes.io/projected/933cf65a-d662-413c-8b6f-fa4145f20373-kube-api-access-blxh6\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.343890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-internal-tls-certs\") pod \"933cf65a-d662-413c-8b6f-fa4145f20373\" (UID: \"933cf65a-d662-413c-8b6f-fa4145f20373\") " Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.366141 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7cb6877b78-6gzcc"] Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.366393 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-api" containerID="cri-o://a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25" gracePeriod=30 Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.366464 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-httpd" containerID="cri-o://4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4" gracePeriod=30 Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.366863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.368242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933cf65a-d662-413c-8b6f-fa4145f20373-kube-api-access-blxh6" (OuterVolumeSpecName: "kube-api-access-blxh6") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "kube-api-access-blxh6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.445899 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.445925 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-blxh6\" (UniqueName: \"kubernetes.io/projected/933cf65a-d662-413c-8b6f-fa4145f20373-kube-api-access-blxh6\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.450382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-config" (OuterVolumeSpecName: "config") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.459260 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.465150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.470935 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.474596 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "933cf65a-d662-413c-8b6f-fa4145f20373" (UID: "933cf65a-d662-413c-8b6f-fa4145f20373"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.547547 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.547580 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.547591 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.547601 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.547610 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/933cf65a-d662-413c-8b6f-fa4145f20373-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.672834 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6f699bcfc4-4pddg_933cf65a-d662-413c-8b6f-fa4145f20373/neutron-api/0.log" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.672889 4769 generic.go:334] "Generic (PLEG): container finished" podID="933cf65a-d662-413c-8b6f-fa4145f20373" containerID="16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f" exitCode=137 Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.672945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" event={"ID":"933cf65a-d662-413c-8b6f-fa4145f20373","Type":"ContainerDied","Data":"16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f"} Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.672978 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" event={"ID":"933cf65a-d662-413c-8b6f-fa4145f20373","Type":"ContainerDied","Data":"bbad7d76b64104941c1bfe290f78e5a3986af803ae84bf9e8df68db6ebea0563"} Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.672998 4769 scope.go:117] "RemoveContainer" containerID="0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.673136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f699bcfc4-4pddg" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.696971 4769 generic.go:334] "Generic (PLEG): container finished" podID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerID="4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4" exitCode=0 Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.698067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" event={"ID":"66f33c4c-4a03-4c53-a741-6ad15373c8d8","Type":"ContainerDied","Data":"4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4"} Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.759762 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6f699bcfc4-4pddg"] Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.760606 4769 scope.go:117] "RemoveContainer" containerID="16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.772738 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6f699bcfc4-4pddg"] Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.781296 4769 scope.go:117] "RemoveContainer" containerID="0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71" Nov 21 13:11:10 crc kubenswrapper[4769]: E1121 13:11:10.781811 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71\": container with ID starting with 0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71 not found: ID does not exist" containerID="0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.781899 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71"} err="failed to get container status \"0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71\": rpc error: code = NotFound desc = could not find container \"0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71\": container with ID starting with 0c82f3b18a12d7e331bbc38fc2881f3ec4f98afe2b35b6e08fd2206c6ca69e71 not found: ID does not exist" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.781924 4769 scope.go:117] "RemoveContainer" containerID="16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f" Nov 21 13:11:10 crc kubenswrapper[4769]: E1121 13:11:10.782319 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f\": container with ID starting with 16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f not found: ID does not exist" containerID="16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f" Nov 21 13:11:10 crc kubenswrapper[4769]: I1121 13:11:10.782349 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f"} err="failed to get container status \"16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f\": rpc error: code = NotFound desc = could not find container \"16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f\": container with ID starting with 16a5ca4b4f9ef905d66f08adae5aa752408d1ba6e133682e07080de41ca9793f not found: ID does not exist" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.230351 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.235424 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.294756 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" path="/var/lib/kubelet/pods/933cf65a-d662-413c-8b6f-fa4145f20373/volumes" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.824380 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.824476 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.825302 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="cinder-api" containerStatusID={"Type":"cri-o","ID":"6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c"} pod="openstack-kuttl-tests/cinder-api-0" containerMessage="Container cinder-api failed liveness probe, will be restarted" Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.825347 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" containerID="cri-o://6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c" gracePeriod=30 Nov 21 13:11:11 crc kubenswrapper[4769]: I1121 13:11:11.831313 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": EOF" Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.163802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.164967 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.256921 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s"] Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.257178 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" containerID="cri-o://14cd5599654e80e3b56cbc85d4913754f76181a0d736b82cfebc34744d8c3b72" gracePeriod=30 Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.257608 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" containerID="cri-o://32ee2ea07569326f7865d37227adde1c3380cbbff935de16eb86abc4ea6eb67c" gracePeriod=30 Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.720819 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerID="14cd5599654e80e3b56cbc85d4913754f76181a0d736b82cfebc34744d8c3b72" exitCode=143 Nov 21 13:11:12 crc kubenswrapper[4769]: I1121 13:11:12.720908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" event={"ID":"2cae97f7-9440-4fc6-8c35-15fab8987634","Type":"ContainerDied","Data":"14cd5599654e80e3b56cbc85d4913754f76181a0d736b82cfebc34744d8c3b72"} Nov 21 13:11:13 crc kubenswrapper[4769]: I1121 13:11:13.736332 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.165:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:13 crc kubenswrapper[4769]: I1121 13:11:13.736378 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.165:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:13 crc kubenswrapper[4769]: I1121 13:11:13.922837 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.76:9696/\": dial tcp 10.217.1.76:9696: connect: connection refused" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.274782 4769 scope.go:117] "RemoveContainer" containerID="df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0" Nov 21 13:11:15 crc kubenswrapper[4769]: E1121 13:11:15.275554 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(4447c27b-0c4c-444a-981a-df468fe19b6e)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.275589 4769 scope.go:117] "RemoveContainer" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:11:15 crc kubenswrapper[4769]: E1121 13:11:15.275769 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(f5b6a13f-243f-4eb4-868d-039a2c527c0b)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.287440 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.1.156:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.404329 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": read tcp 10.217.0.2:51670->10.217.1.126:9311: read: connection reset by peer" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.404388 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.126:9311/healthcheck\": read tcp 10.217.0.2:51674->10.217.1.126:9311: read: connection reset by peer" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.434788 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.763616 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerID="32ee2ea07569326f7865d37227adde1c3380cbbff935de16eb86abc4ea6eb67c" exitCode=0 Nov 21 13:11:15 crc kubenswrapper[4769]: I1121 13:11:15.763658 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" event={"ID":"2cae97f7-9440-4fc6-8c35-15fab8987634","Type":"ContainerDied","Data":"32ee2ea07569326f7865d37227adde1c3380cbbff935de16eb86abc4ea6eb67c"} Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.167045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.268876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cae97f7-9440-4fc6-8c35-15fab8987634-logs\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.268981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data-custom\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.269043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98bvz\" (UniqueName: \"kubernetes.io/projected/2cae97f7-9440-4fc6-8c35-15fab8987634-kube-api-access-98bvz\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.269070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.269142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-combined-ca-bundle\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.269181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-public-tls-certs\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.269293 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-internal-tls-certs\") pod \"2cae97f7-9440-4fc6-8c35-15fab8987634\" (UID: \"2cae97f7-9440-4fc6-8c35-15fab8987634\") " Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.270338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cae97f7-9440-4fc6-8c35-15fab8987634-logs" (OuterVolumeSpecName: "logs") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.275588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.287381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cae97f7-9440-4fc6-8c35-15fab8987634-kube-api-access-98bvz" (OuterVolumeSpecName: "kube-api-access-98bvz") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "kube-api-access-98bvz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.313334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.337356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.348128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data" (OuterVolumeSpecName: "config-data") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.349329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2cae97f7-9440-4fc6-8c35-15fab8987634" (UID: "2cae97f7-9440-4fc6-8c35-15fab8987634"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371491 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371545 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2cae97f7-9440-4fc6-8c35-15fab8987634-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371560 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371574 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-98bvz\" (UniqueName: \"kubernetes.io/projected/2cae97f7-9440-4fc6-8c35-15fab8987634-kube-api-access-98bvz\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371590 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371602 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.371615 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cae97f7-9440-4fc6-8c35-15fab8987634-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.557101 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.599606 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.660337 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh"] Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.660587 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-log" containerID="cri-o://382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0" gracePeriod=30 Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.661019 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-api" containerID="cri-o://e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda" gracePeriod=30 Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.777227 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.778424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s" event={"ID":"2cae97f7-9440-4fc6-8c35-15fab8987634","Type":"ContainerDied","Data":"681d76daf64324a735824abdfeabeb5fa48e0f6b64e2551791c493a5c8163952"} Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.778488 4769 scope.go:117] "RemoveContainer" containerID="32ee2ea07569326f7865d37227adde1c3380cbbff935de16eb86abc4ea6eb67c" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.831968 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.858471 4769 scope.go:117] "RemoveContainer" containerID="14cd5599654e80e3b56cbc85d4913754f76181a0d736b82cfebc34744d8c3b72" Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.860387 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s"] Nov 21 13:11:16 crc kubenswrapper[4769]: I1121 13:11:16.872899 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-779bc9b6f8-swz8s"] Nov 21 13:11:17 crc kubenswrapper[4769]: I1121 13:11:17.287500 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" path="/var/lib/kubelet/pods/2cae97f7-9440-4fc6-8c35-15fab8987634/volumes" Nov 21 13:11:17 crc kubenswrapper[4769]: I1121 13:11:17.848925 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerID="382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0" exitCode=143 Nov 21 13:11:17 crc kubenswrapper[4769]: I1121 13:11:17.849364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" event={"ID":"6b07ece4-f42b-4b10-9c27-51b2f210ff9c","Type":"ContainerDied","Data":"382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0"} Nov 21 13:11:18 crc kubenswrapper[4769]: I1121 13:11:18.944039 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:11:18 crc kubenswrapper[4769]: I1121 13:11:18.948355 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:11:18 crc kubenswrapper[4769]: I1121 13:11:18.950008 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:11:19 crc kubenswrapper[4769]: I1121 13:11:19.885738 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.319757 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.549767 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-combined-ca-bundle\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668451 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-config-data\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-logs\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668831 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-scripts\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.668948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sp4q\" (UniqueName: \"kubernetes.io/projected/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-kube-api-access-4sp4q\") pod \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\" (UID: \"6b07ece4-f42b-4b10-9c27-51b2f210ff9c\") " Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.669435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-logs" (OuterVolumeSpecName: "logs") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.670466 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.688002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-kube-api-access-4sp4q" (OuterVolumeSpecName: "kube-api-access-4sp4q") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "kube-api-access-4sp4q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.688061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-scripts" (OuterVolumeSpecName: "scripts") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.734667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-config-data" (OuterVolumeSpecName: "config-data") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.754158 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.772029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.772830 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.773359 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4sp4q\" (UniqueName: \"kubernetes.io/projected/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-kube-api-access-4sp4q\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.773518 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.773598 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.773669 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.776703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6b07ece4-f42b-4b10-9c27-51b2f210ff9c" (UID: "6b07ece4-f42b-4b10-9c27-51b2f210ff9c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.875762 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b07ece4-f42b-4b10-9c27-51b2f210ff9c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.890569 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerID="e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda" exitCode=0 Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.890664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" event={"ID":"6b07ece4-f42b-4b10-9c27-51b2f210ff9c","Type":"ContainerDied","Data":"e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda"} Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.890723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" event={"ID":"6b07ece4-f42b-4b10-9c27-51b2f210ff9c","Type":"ContainerDied","Data":"0347245903a4e1cc155bec4ed51f5ad065850d9da57d5d7dfff0233069364c40"} Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.890747 4769 scope.go:117] "RemoveContainer" containerID="e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.890912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.928521 4769 scope.go:117] "RemoveContainer" containerID="382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.932365 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh"] Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.941778 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5cb98c4cd6-nfsfh"] Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.954898 4769 scope.go:117] "RemoveContainer" containerID="e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda" Nov 21 13:11:20 crc kubenswrapper[4769]: E1121 13:11:20.955396 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda\": container with ID starting with e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda not found: ID does not exist" containerID="e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.955438 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda"} err="failed to get container status \"e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda\": rpc error: code = NotFound desc = could not find container \"e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda\": container with ID starting with e3ac2d3ea340320c217b5ef3e75c1790073e735cd76792655e38877a6fff6fda not found: ID does not exist" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.955468 4769 scope.go:117] "RemoveContainer" containerID="382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0" Nov 21 13:11:20 crc kubenswrapper[4769]: E1121 13:11:20.955831 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0\": container with ID starting with 382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0 not found: ID does not exist" containerID="382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0" Nov 21 13:11:20 crc kubenswrapper[4769]: I1121 13:11:20.955863 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0"} err="failed to get container status \"382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0\": rpc error: code = NotFound desc = could not find container \"382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0\": container with ID starting with 382bd3c9cfc056fb966b75568d7f3fa01ac616a32a745aa387d5ff3ffe14d4f0 not found: ID does not exist" Nov 21 13:11:21 crc kubenswrapper[4769]: I1121 13:11:21.287644 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" path="/var/lib/kubelet/pods/6b07ece4-f42b-4b10-9c27-51b2f210ff9c/volumes" Nov 21 13:11:21 crc kubenswrapper[4769]: I1121 13:11:21.833062 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:22 crc kubenswrapper[4769]: I1121 13:11:22.727732 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:22 crc kubenswrapper[4769]: I1121 13:11:22.728668 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:22 crc kubenswrapper[4769]: I1121 13:11:22.742314 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:22 crc kubenswrapper[4769]: I1121 13:11:22.743579 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:22 crc kubenswrapper[4769]: I1121 13:11:22.938686 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:22 crc kubenswrapper[4769]: I1121 13:11:22.942968 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:11:23 crc kubenswrapper[4769]: I1121 13:11:23.253882 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": read tcp 10.217.0.2:45484->10.217.1.150:8776: read: connection reset by peer" Nov 21 13:11:23 crc kubenswrapper[4769]: I1121 13:11:23.945955 4769 generic.go:334] "Generic (PLEG): container finished" podID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerID="6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c" exitCode=0 Nov 21 13:11:23 crc kubenswrapper[4769]: I1121 13:11:23.946023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerDied","Data":"6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c"} Nov 21 13:11:24 crc kubenswrapper[4769]: I1121 13:11:24.982535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerStarted","Data":"45adc74c493f83053c338c16259911147510ac30d8eec3af654716733844c05d"} Nov 21 13:11:25 crc kubenswrapper[4769]: I1121 13:11:25.994007 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:11:26 crc kubenswrapper[4769]: I1121 13:11:26.719485 4769 status_manager.go:317] "Container readiness changed for unknown container" pod="openstack-kuttl-tests/cinder-api-0" containerID="cri-o://6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c" Nov 21 13:11:26 crc kubenswrapper[4769]: I1121 13:11:26.719520 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:11:26 crc kubenswrapper[4769]: I1121 13:11:26.719554 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:11:27 crc kubenswrapper[4769]: I1121 13:11:27.825377 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:11:27 crc kubenswrapper[4769]: I1121 13:11:27.931634 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5675c77c96-r99x8"] Nov 21 13:11:27 crc kubenswrapper[4769]: I1121 13:11:27.931850 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" podUID="619cbb7a-cb38-4111-a1c4-e681e36233ab" containerName="keystone-api" containerID="cri-o://5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5" gracePeriod=30 Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.021930 4769 generic.go:334] "Generic (PLEG): container finished" podID="91b5d253-958f-421b-bff9-432fa0abea80" containerID="ac28bec72a02aacf2a6341b52779262d55a4c20bb05da0ec8dd04d78f5bacd70" exitCode=137 Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.021973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerDied","Data":"ac28bec72a02aacf2a6341b52779262d55a4c20bb05da0ec8dd04d78f5bacd70"} Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.274141 4769 scope.go:117] "RemoveContainer" containerID="df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.432406 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.547622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-run-httpd\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.547946 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-ceilometer-tls-certs\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-sg-core-conf-yaml\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-combined-ca-bundle\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-config-data\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548278 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvg8d\" (UniqueName: \"kubernetes.io/projected/91b5d253-958f-421b-bff9-432fa0abea80-kube-api-access-pvg8d\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-scripts\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.548425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-log-httpd\") pod \"91b5d253-958f-421b-bff9-432fa0abea80\" (UID: \"91b5d253-958f-421b-bff9-432fa0abea80\") " Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.549039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.549763 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.549797 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/91b5d253-958f-421b-bff9-432fa0abea80-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.553828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b5d253-958f-421b-bff9-432fa0abea80-kube-api-access-pvg8d" (OuterVolumeSpecName: "kube-api-access-pvg8d") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "kube-api-access-pvg8d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.554962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-scripts" (OuterVolumeSpecName: "scripts") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.576918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.619083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.651546 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.652029 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.652136 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pvg8d\" (UniqueName: \"kubernetes.io/projected/91b5d253-958f-421b-bff9-432fa0abea80-kube-api-access-pvg8d\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.652235 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.652334 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.652413 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.653661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-config-data" (OuterVolumeSpecName: "config-data") pod "91b5d253-958f-421b-bff9-432fa0abea80" (UID: "91b5d253-958f-421b-bff9-432fa0abea80"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:28 crc kubenswrapper[4769]: I1121 13:11:28.753229 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/91b5d253-958f-421b-bff9-432fa0abea80-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.033517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerStarted","Data":"03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b"} Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.033788 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.037524 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"91b5d253-958f-421b-bff9-432fa0abea80","Type":"ContainerDied","Data":"d65ae5bac05bd39733ce9e2680cc3f77892aac80d79744b3289579b083370707"} Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.037580 4769 scope.go:117] "RemoveContainer" containerID="ac28bec72a02aacf2a6341b52779262d55a4c20bb05da0ec8dd04d78f5bacd70" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.037610 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.074439 4769 scope.go:117] "RemoveContainer" containerID="d2d9913e73bc99914b02d81e8c2dee44e47569031422898b520f66bf2fe6034d" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.100680 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.121063 4769 scope.go:117] "RemoveContainer" containerID="6c60b55664d50339922e5939476f8824a82d0e2abf601b99a2e92514bf86ec11" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.144383 4769 scope.go:117] "RemoveContainer" containerID="6241ad9fb10ef3484828bd5a36f910dae11a2cf14838958df346b595ad4f05b9" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.155692 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165134 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165812 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-central-agent" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165826 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-central-agent" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165839 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-httpd" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165847 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-httpd" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165861 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="proxy-httpd" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165866 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="proxy-httpd" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165874 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165881 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165896 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-notification-agent" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-notification-agent" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165920 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-api" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165927 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-api" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165946 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-log" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165952 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-log" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165969 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="sg-core" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.165975 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="sg-core" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.165995 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-api" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166001 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-api" Nov 21 13:11:29 crc kubenswrapper[4769]: E1121 13:11:29.166014 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166020 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-api" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166789 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="sg-core" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166812 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-central-agent" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166832 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b07ece4-f42b-4b10-9c27-51b2f210ff9c" containerName="placement-log" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166841 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-httpd" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166855 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="ceilometer-notification-agent" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166865 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api-log" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166874 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cae97f7-9440-4fc6-8c35-15fab8987634" containerName="barbican-api" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="933cf65a-d662-413c-8b6f-fa4145f20373" containerName="neutron-api" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.166895 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="91b5d253-958f-421b-bff9-432fa0abea80" containerName="proxy-httpd" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.168572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.171840 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.172162 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.173521 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.192827 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.260913 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-scripts\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-config-data\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261081 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-log-httpd\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-run-httpd\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.261373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwj6c\" (UniqueName: \"kubernetes.io/projected/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-kube-api-access-vwj6c\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.289228 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b5d253-958f-421b-bff9-432fa0abea80" path="/var/lib/kubelet/pods/91b5d253-958f-421b-bff9-432fa0abea80/volumes" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.363932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-run-httpd\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.364692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj6c\" (UniqueName: \"kubernetes.io/projected/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-kube-api-access-vwj6c\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.364843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-scripts\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.365800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-config-data\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.365909 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.366040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-log-httpd\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.366247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.366344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.364653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-run-httpd\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.368381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-log-httpd\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.680814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.681016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-config-data\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.681803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-scripts\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.683426 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.683890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.685475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwj6c\" (UniqueName: \"kubernetes.io/projected/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-kube-api-access-vwj6c\") pod \"ceilometer-0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:29 crc kubenswrapper[4769]: I1121 13:11:29.782722 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:30 crc kubenswrapper[4769]: I1121 13:11:30.273723 4769 scope.go:117] "RemoveContainer" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:11:30 crc kubenswrapper[4769]: I1121 13:11:30.313683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:30 crc kubenswrapper[4769]: I1121 13:11:30.348006 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.072340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerStarted","Data":"387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4"} Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.073074 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.074492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerStarted","Data":"199529f0bfc54af410a0d7de39f9a3b7949fbe2163cfe9ae7bc5f696951291b4"} Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.601428 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-fernet-keys\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-combined-ca-bundle\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-credential-keys\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-internal-tls-certs\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95zls\" (UniqueName: \"kubernetes.io/projected/619cbb7a-cb38-4111-a1c4-e681e36233ab-kube-api-access-95zls\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-public-tls-certs\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-config-data\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.732957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-scripts\") pod \"619cbb7a-cb38-4111-a1c4-e681e36233ab\" (UID: \"619cbb7a-cb38-4111-a1c4-e681e36233ab\") " Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.739606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.739643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-scripts" (OuterVolumeSpecName: "scripts") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.739958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.747632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619cbb7a-cb38-4111-a1c4-e681e36233ab-kube-api-access-95zls" (OuterVolumeSpecName: "kube-api-access-95zls") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "kube-api-access-95zls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.777336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-config-data" (OuterVolumeSpecName: "config-data") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.780363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.809581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.831451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "619cbb7a-cb38-4111-a1c4-e681e36233ab" (UID: "619cbb7a-cb38-4111-a1c4-e681e36233ab"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834843 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834882 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834896 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834909 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834923 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834935 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834947 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/619cbb7a-cb38-4111-a1c4-e681e36233ab-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.834962 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-95zls\" (UniqueName: \"kubernetes.io/projected/619cbb7a-cb38-4111-a1c4-e681e36233ab-kube-api-access-95zls\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:31 crc kubenswrapper[4769]: I1121 13:11:31.898779 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.085984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerStarted","Data":"cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96"} Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.087674 4769 generic.go:334] "Generic (PLEG): container finished" podID="619cbb7a-cb38-4111-a1c4-e681e36233ab" containerID="5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5" exitCode=0 Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.088685 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.102240 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" event={"ID":"619cbb7a-cb38-4111-a1c4-e681e36233ab","Type":"ContainerDied","Data":"5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5"} Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.102515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5675c77c96-r99x8" event={"ID":"619cbb7a-cb38-4111-a1c4-e681e36233ab","Type":"ContainerDied","Data":"6e2e98c4a5a536645e88ee7d61abebc32df36bbfb8cea3b533d583a61bc3af3d"} Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.102629 4769 scope.go:117] "RemoveContainer" containerID="5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.134850 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5675c77c96-r99x8"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.135990 4769 scope.go:117] "RemoveContainer" containerID="5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5" Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.136502 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5\": container with ID starting with 5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5 not found: ID does not exist" containerID="5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.136556 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5"} err="failed to get container status \"5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5\": rpc error: code = NotFound desc = could not find container \"5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5\": container with ID starting with 5f8e0e82fc49ba56f69f3ddb534d1d144d6e81cbb0c25a5c71f219ad385530a5 not found: ID does not exist" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.141501 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5675c77c96-r99x8"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.168125 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.169974 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="72c08d5f-4fce-4541-9649-1a24c14b9524" containerName="openstackclient" containerID="cri-o://b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6" gracePeriod=2 Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.179014 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.218533 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.218909 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="619cbb7a-cb38-4111-a1c4-e681e36233ab" containerName="keystone-api" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.218926 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="619cbb7a-cb38-4111-a1c4-e681e36233ab" containerName="keystone-api" Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.218955 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="72c08d5f-4fce-4541-9649-1a24c14b9524" containerName="openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.218961 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c08d5f-4fce-4541-9649-1a24c14b9524" containerName="openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.219135 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="619cbb7a-cb38-4111-a1c4-e681e36233ab" containerName="keystone-api" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.219165 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="72c08d5f-4fce-4541-9649-1a24c14b9524" containerName="openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.219949 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.224527 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="72c08d5f-4fce-4541-9649-1a24c14b9524" podUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.235232 4769 status_manager.go:875] "Failed to update status for pod" pod="openstack-kuttl-tests/openstackclient" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9e34bb5a-8078-4a78-be3a-edc9a70d0416\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T13:11:32Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T13:11:32Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T13:11:32Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2025-11-21T13:11:32Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/podified-antelope-centos9/openstack-openstackclient@sha256:fed8e34e2c12b6bae77e207c0620bf237aee86c22f0e5e8dc5a39d1920d422cb\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"openstackclient\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/clouds.yaml\\\",\\\"name\\\":\\\"openstack-config\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/secure.yaml\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/cloudrc\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem\\\",\\\"name\\\":\\\"combined-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-d55d7\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2025-11-21T13:11:32Z\\\"}}\" for pod \"openstack-kuttl-tests\"/\"openstackclient\": pods \"openstackclient\" not found" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.236098 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.246193 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.247194 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-d55d7 openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[combined-ca-bundle kube-api-access-d55d7 openstack-config openstack-config-secret]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.259217 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.267573 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.268959 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.272602 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.283334 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.346376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config-secret\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.346486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55d7\" (UniqueName: \"kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.346513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.346545 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config-secret\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqlg\" (UniqueName: \"kubernetes.io/projected/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-kube-api-access-hgqlg\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config-secret\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d55d7\" (UniqueName: \"kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-combined-ca-bundle\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.450819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.452409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.452879 4769 projected.go:194] Error preparing data for projected volume kube-api-access-d55d7 for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (9e34bb5a-8078-4a78-be3a-edc9a70d0416) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.453599 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7 podName:9e34bb5a-8078-4a78-be3a-edc9a70d0416 nodeName:}" failed. No retries permitted until 2025-11-21 13:11:32.953577714 +0000 UTC m=+4851.654239542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d55d7" (UniqueName: "kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7") pod "openstackclient" (UID: "9e34bb5a-8078-4a78-be3a-edc9a70d0416") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (9e34bb5a-8078-4a78-be3a-edc9a70d0416) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.454739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.457671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config-secret\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.552798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-combined-ca-bundle\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.552931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.553824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.553902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config-secret\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.553933 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqlg\" (UniqueName: \"kubernetes.io/projected/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-kube-api-access-hgqlg\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.558798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config-secret\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.559078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-combined-ca-bundle\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.569452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqlg\" (UniqueName: \"kubernetes.io/projected/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-kube-api-access-hgqlg\") pod \"openstackclient\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.589797 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: I1121 13:11:32.964505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d55d7\" (UniqueName: \"kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7\") pod \"openstackclient\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.966967 4769 projected.go:194] Error preparing data for projected volume kube-api-access-d55d7 for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (9e34bb5a-8078-4a78-be3a-edc9a70d0416) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:11:32 crc kubenswrapper[4769]: E1121 13:11:32.967033 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7 podName:9e34bb5a-8078-4a78-be3a-edc9a70d0416 nodeName:}" failed. No retries permitted until 2025-11-21 13:11:33.967014485 +0000 UTC m=+4852.667676353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d55d7" (UniqueName: "kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7") pod "openstackclient" (UID: "9e34bb5a-8078-4a78-be3a-edc9a70d0416") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (9e34bb5a-8078-4a78-be3a-edc9a70d0416) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.024926 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:11:33 crc kubenswrapper[4769]: W1121 13:11:33.038037 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fa73a6c_74d4_4713_bdcb_13a6ddda7232.slice/crio-b383ef871d1813b4e3a1f6f9a0bfbce9e181a7643b8f9ac0ce63a1500fd5b764 WatchSource:0}: Error finding container b383ef871d1813b4e3a1f6f9a0bfbce9e181a7643b8f9ac0ce63a1500fd5b764: Status 404 returned error can't find the container with id b383ef871d1813b4e3a1f6f9a0bfbce9e181a7643b8f9ac0ce63a1500fd5b764 Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.127353 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"8fa73a6c-74d4-4713-bdcb-13a6ddda7232","Type":"ContainerStarted","Data":"b383ef871d1813b4e3a1f6f9a0bfbce9e181a7643b8f9ac0ce63a1500fd5b764"} Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.140093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerStarted","Data":"bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a"} Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.140536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.146719 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.159632 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.167514 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.171333 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.277012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-combined-ca-bundle\") pod \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.277103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config-secret\") pod \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.277275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config\") pod \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\" (UID: \"9e34bb5a-8078-4a78-be3a-edc9a70d0416\") " Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.277802 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d55d7\" (UniqueName: \"kubernetes.io/projected/9e34bb5a-8078-4a78-be3a-edc9a70d0416-kube-api-access-d55d7\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.278339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "9e34bb5a-8078-4a78-be3a-edc9a70d0416" (UID: "9e34bb5a-8078-4a78-be3a-edc9a70d0416"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.281359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e34bb5a-8078-4a78-be3a-edc9a70d0416" (UID: "9e34bb5a-8078-4a78-be3a-edc9a70d0416"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.283885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "9e34bb5a-8078-4a78-be3a-edc9a70d0416" (UID: "9e34bb5a-8078-4a78-be3a-edc9a70d0416"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.290453 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619cbb7a-cb38-4111-a1c4-e681e36233ab" path="/var/lib/kubelet/pods/619cbb7a-cb38-4111-a1c4-e681e36233ab/volumes" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.295040 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" path="/var/lib/kubelet/pods/9e34bb5a-8078-4a78-be3a-edc9a70d0416/volumes" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.380475 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.380511 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:33 crc kubenswrapper[4769]: I1121 13:11:33.380523 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9e34bb5a-8078-4a78-be3a-edc9a70d0416-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.152615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"8fa73a6c-74d4-4713-bdcb-13a6ddda7232","Type":"ContainerStarted","Data":"8b0b2bef3262c86bca0f9052cf9d437111d150487a08e9f093775c05d3716716"} Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.157669 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.158381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerStarted","Data":"b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd"} Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.170906 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.170884587 podStartE2EDuration="2.170884587s" podCreationTimestamp="2025-11-21 13:11:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:11:34.170097926 +0000 UTC m=+4852.870759774" watchObservedRunningTime="2025-11-21 13:11:34.170884587 +0000 UTC m=+4852.871546405" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.173005 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="9e34bb5a-8078-4a78-be3a-edc9a70d0416" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.266421 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.604136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.609638 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="72c08d5f-4fce-4541-9649-1a24c14b9524" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.705803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config-secret\") pod \"72c08d5f-4fce-4541-9649-1a24c14b9524\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.706476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config\") pod \"72c08d5f-4fce-4541-9649-1a24c14b9524\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.706556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-combined-ca-bundle\") pod \"72c08d5f-4fce-4541-9649-1a24c14b9524\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.706620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzqm5\" (UniqueName: \"kubernetes.io/projected/72c08d5f-4fce-4541-9649-1a24c14b9524-kube-api-access-wzqm5\") pod \"72c08d5f-4fce-4541-9649-1a24c14b9524\" (UID: \"72c08d5f-4fce-4541-9649-1a24c14b9524\") " Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.717569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c08d5f-4fce-4541-9649-1a24c14b9524-kube-api-access-wzqm5" (OuterVolumeSpecName: "kube-api-access-wzqm5") pod "72c08d5f-4fce-4541-9649-1a24c14b9524" (UID: "72c08d5f-4fce-4541-9649-1a24c14b9524"). InnerVolumeSpecName "kube-api-access-wzqm5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.746908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "72c08d5f-4fce-4541-9649-1a24c14b9524" (UID: "72c08d5f-4fce-4541-9649-1a24c14b9524"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.756443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "72c08d5f-4fce-4541-9649-1a24c14b9524" (UID: "72c08d5f-4fce-4541-9649-1a24c14b9524"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.781567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "72c08d5f-4fce-4541-9649-1a24c14b9524" (UID: "72c08d5f-4fce-4541-9649-1a24c14b9524"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.809869 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wzqm5\" (UniqueName: \"kubernetes.io/projected/72c08d5f-4fce-4541-9649-1a24c14b9524-kube-api-access-wzqm5\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.809903 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.809913 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/72c08d5f-4fce-4541-9649-1a24c14b9524-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:34 crc kubenswrapper[4769]: I1121 13:11:34.809923 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/72c08d5f-4fce-4541-9649-1a24c14b9524-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.073310 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q"] Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.074884 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.096124 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q"] Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.169486 4769 generic.go:334] "Generic (PLEG): container finished" podID="72c08d5f-4fce-4541-9649-1a24c14b9524" containerID="b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6" exitCode=137 Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.169560 4769 scope.go:117] "RemoveContainer" containerID="b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.169681 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.174008 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="72c08d5f-4fce-4541-9649-1a24c14b9524" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.177045 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-central-agent" containerID="cri-o://cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96" gracePeriod=30 Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.177315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerStarted","Data":"6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8"} Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.177356 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.177591 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="proxy-httpd" containerID="cri-o://6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8" gracePeriod=30 Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.177641 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="sg-core" containerID="cri-o://b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd" gracePeriod=30 Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.177673 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-notification-agent" containerID="cri-o://bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a" gracePeriod=30 Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.200250 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="72c08d5f-4fce-4541-9649-1a24c14b9524" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.204819 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.927262416 podStartE2EDuration="6.20479956s" podCreationTimestamp="2025-11-21 13:11:29 +0000 UTC" firstStartedPulling="2025-11-21 13:11:30.347432236 +0000 UTC m=+4849.048094074" lastFinishedPulling="2025-11-21 13:11:34.62496939 +0000 UTC m=+4853.325631218" observedRunningTime="2025-11-21 13:11:35.196221209 +0000 UTC m=+4853.896883027" watchObservedRunningTime="2025-11-21 13:11:35.20479956 +0000 UTC m=+4853.905461378" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.208123 4769 scope.go:117] "RemoveContainer" containerID="b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6" Nov 21 13:11:35 crc kubenswrapper[4769]: E1121 13:11:35.211379 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6\": container with ID starting with b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6 not found: ID does not exist" containerID="b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.211416 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6"} err="failed to get container status \"b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6\": rpc error: code = NotFound desc = could not find container \"b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6\": container with ID starting with b5a2d794511ce23db68553363e8cdb45fc10a39b81b144084bf6b401fe8a6db6 not found: ID does not exist" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217417 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-log-httpd\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-config-data\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqcmk\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-kube-api-access-kqcmk\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-combined-ca-bundle\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-run-httpd\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-public-tls-certs\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-internal-tls-certs\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.217713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-etc-swift\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.287581 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c08d5f-4fce-4541-9649-1a24c14b9524" path="/var/lib/kubelet/pods/72c08d5f-4fce-4541-9649-1a24c14b9524/volumes" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-etc-swift\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-log-httpd\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-config-data\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kqcmk\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-kube-api-access-kqcmk\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-combined-ca-bundle\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-run-httpd\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319460 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-public-tls-certs\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-internal-tls-certs\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.319846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-log-httpd\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.321095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-run-httpd\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.329593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-etc-swift\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.330413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-internal-tls-certs\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.331834 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-combined-ca-bundle\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.334270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-public-tls-certs\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.335714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-config-data\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.342898 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqcmk\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-kube-api-access-kqcmk\") pod \"swift-proxy-d688c7f7d-8gr5q\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.395414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:35 crc kubenswrapper[4769]: W1121 13:11:35.855492 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bebf004_4bd2_427b_aeb6_0d1d4199caae.slice/crio-a30679d3f8e223584ac526340544319f2ffafb348128a5a6208292511fbd8dc5 WatchSource:0}: Error finding container a30679d3f8e223584ac526340544319f2ffafb348128a5a6208292511fbd8dc5: Status 404 returned error can't find the container with id a30679d3f8e223584ac526340544319f2ffafb348128a5a6208292511fbd8dc5 Nov 21 13:11:35 crc kubenswrapper[4769]: I1121 13:11:35.858822 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q"] Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.185992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" event={"ID":"8bebf004-4bd2-427b-aeb6-0d1d4199caae","Type":"ContainerStarted","Data":"9ea1222a4763b5e1922a4ecec40f631471cbe0ccb62a1f4746700fe65bbc4bb0"} Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.186389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" event={"ID":"8bebf004-4bd2-427b-aeb6-0d1d4199caae","Type":"ContainerStarted","Data":"a30679d3f8e223584ac526340544319f2ffafb348128a5a6208292511fbd8dc5"} Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.196174 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerID="6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8" exitCode=0 Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.196215 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerID="b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd" exitCode=2 Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.196223 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerID="bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a" exitCode=0 Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.196232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerDied","Data":"6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8"} Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.196276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerDied","Data":"b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd"} Nov 21 13:11:36 crc kubenswrapper[4769]: I1121 13:11:36.196289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerDied","Data":"bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a"} Nov 21 13:11:37 crc kubenswrapper[4769]: I1121 13:11:37.233539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" event={"ID":"8bebf004-4bd2-427b-aeb6-0d1d4199caae","Type":"ContainerStarted","Data":"a820fbd57cdb5145022fa3dcb67dbd197e305982f91310287aac8ebf4ac783cb"} Nov 21 13:11:37 crc kubenswrapper[4769]: I1121 13:11:37.235060 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:37 crc kubenswrapper[4769]: I1121 13:11:37.235130 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:37 crc kubenswrapper[4769]: I1121 13:11:37.258051 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" podStartSLOduration=2.258034733 podStartE2EDuration="2.258034733s" podCreationTimestamp="2025-11-21 13:11:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:11:37.257002885 +0000 UTC m=+4855.957664713" watchObservedRunningTime="2025-11-21 13:11:37.258034733 +0000 UTC m=+4855.958696561" Nov 21 13:11:39 crc kubenswrapper[4769]: I1121 13:11:39.345418 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.892801 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7cb6877b78-6gzcc_66f33c4c-4a03-4c53-a741-6ad15373c8d8/neutron-api/0.log" Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.893426 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.934995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-ovndb-tls-certs\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.935064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fspw2\" (UniqueName: \"kubernetes.io/projected/66f33c4c-4a03-4c53-a741-6ad15373c8d8-kube-api-access-fspw2\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.935094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-combined-ca-bundle\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.935150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-config\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.935214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-public-tls-certs\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.935275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-httpd-config\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.935350 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-internal-tls-certs\") pod \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\" (UID: \"66f33c4c-4a03-4c53-a741-6ad15373c8d8\") " Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.941925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f33c4c-4a03-4c53-a741-6ad15373c8d8-kube-api-access-fspw2" (OuterVolumeSpecName: "kube-api-access-fspw2") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "kube-api-access-fspw2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:40 crc kubenswrapper[4769]: I1121 13:11:40.943713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.004581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.028379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-config" (OuterVolumeSpecName: "config") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.034509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.043273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.047312 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.047342 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.047351 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.047362 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.047373 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fspw2\" (UniqueName: \"kubernetes.io/projected/66f33c4c-4a03-4c53-a741-6ad15373c8d8-kube-api-access-fspw2\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.047383 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.091015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "66f33c4c-4a03-4c53-a741-6ad15373c8d8" (UID: "66f33c4c-4a03-4c53-a741-6ad15373c8d8"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.114549 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.148968 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-run-httpd\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-ceilometer-tls-certs\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwj6c\" (UniqueName: \"kubernetes.io/projected/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-kube-api-access-vwj6c\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-combined-ca-bundle\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-log-httpd\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-sg-core-conf-yaml\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149501 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-scripts\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149530 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-config-data\") pod \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\" (UID: \"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0\") " Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.149976 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.150000 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/66f33c4c-4a03-4c53-a741-6ad15373c8d8-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.150312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.152803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-kube-api-access-vwj6c" (OuterVolumeSpecName: "kube-api-access-vwj6c") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "kube-api-access-vwj6c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.154149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-scripts" (OuterVolumeSpecName: "scripts") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.178804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.212751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.243159 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.251644 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.251774 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vwj6c\" (UniqueName: \"kubernetes.io/projected/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-kube-api-access-vwj6c\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.251836 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.251908 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.251999 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.252057 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.259397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-config-data" (OuterVolumeSpecName: "config-data") pod "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" (UID: "f3e62d6a-4c74-49a7-8a5f-fe694745f2b0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.312834 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerID="cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96" exitCode=0 Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.313253 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.312914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerDied","Data":"cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96"} Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.313430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f3e62d6a-4c74-49a7-8a5f-fe694745f2b0","Type":"ContainerDied","Data":"199529f0bfc54af410a0d7de39f9a3b7949fbe2163cfe9ae7bc5f696951291b4"} Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.313450 4769 scope.go:117] "RemoveContainer" containerID="6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.317052 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7cb6877b78-6gzcc_66f33c4c-4a03-4c53-a741-6ad15373c8d8/neutron-api/0.log" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.317087 4769 generic.go:334] "Generic (PLEG): container finished" podID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerID="a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25" exitCode=137 Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.317108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" event={"ID":"66f33c4c-4a03-4c53-a741-6ad15373c8d8","Type":"ContainerDied","Data":"a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25"} Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.317138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" event={"ID":"66f33c4c-4a03-4c53-a741-6ad15373c8d8","Type":"ContainerDied","Data":"c4e8a46b70b7b887f0b95cb02b0a38e38609eb81679d0a661870bd491c8fc7d6"} Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.317215 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7cb6877b78-6gzcc" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.350851 4769 scope.go:117] "RemoveContainer" containerID="b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.355974 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.357760 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7cb6877b78-6gzcc"] Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.368380 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7cb6877b78-6gzcc"] Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.383515 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.393290 4769 scope.go:117] "RemoveContainer" containerID="bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.398789 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.418537 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.418981 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-notification-agent" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.418999 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-notification-agent" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.419018 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-api" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419023 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-api" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.419048 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="proxy-httpd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419054 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="proxy-httpd" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.419069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-central-agent" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419075 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-central-agent" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.419088 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="sg-core" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="sg-core" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.419109 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-httpd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-httpd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419338 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-notification-agent" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419352 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="sg-core" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419370 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-api" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419381 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="ceilometer-central-agent" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419389 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" containerName="proxy-httpd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.419396 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" containerName="neutron-httpd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.420113 4769 scope.go:117] "RemoveContainer" containerID="cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.421489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.423957 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.424311 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.424542 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.427752 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457632 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-config-data\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9wq\" (UniqueName: \"kubernetes.io/projected/eac35646-4f9b-49dc-b8e1-313f0daf1e21-kube-api-access-vz9wq\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457728 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457831 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-log-httpd\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-run-httpd\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.457997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-scripts\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.458022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.459893 4769 scope.go:117] "RemoveContainer" containerID="6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.460446 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8\": container with ID starting with 6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8 not found: ID does not exist" containerID="6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.460482 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8"} err="failed to get container status \"6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8\": rpc error: code = NotFound desc = could not find container \"6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8\": container with ID starting with 6f00225110b9348c11e7d3fbad86e33b28e0ed8fefcd0b2f11efc729578928a8 not found: ID does not exist" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.460510 4769 scope.go:117] "RemoveContainer" containerID="b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.461338 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd\": container with ID starting with b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd not found: ID does not exist" containerID="b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.461363 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd"} err="failed to get container status \"b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd\": rpc error: code = NotFound desc = could not find container \"b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd\": container with ID starting with b586cc0d36898caade60828229019e7f2a551dcc05fa21999af7669391d4f0bd not found: ID does not exist" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.461380 4769 scope.go:117] "RemoveContainer" containerID="bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.461744 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a\": container with ID starting with bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a not found: ID does not exist" containerID="bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.461810 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a"} err="failed to get container status \"bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a\": rpc error: code = NotFound desc = could not find container \"bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a\": container with ID starting with bbf1c5302be5ae61c2565f4828bc326f5a324fd1cfff8646899e6a924c92df7a not found: ID does not exist" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.461838 4769 scope.go:117] "RemoveContainer" containerID="cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.462288 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96\": container with ID starting with cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96 not found: ID does not exist" containerID="cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.462318 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96"} err="failed to get container status \"cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96\": rpc error: code = NotFound desc = could not find container \"cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96\": container with ID starting with cb9ef40806742fa7e647966244deee1469a5299fd660eafda5d6953305ad2e96 not found: ID does not exist" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.462339 4769 scope.go:117] "RemoveContainer" containerID="4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.482414 4769 scope.go:117] "RemoveContainer" containerID="a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.502461 4769 scope.go:117] "RemoveContainer" containerID="4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.502900 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4\": container with ID starting with 4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4 not found: ID does not exist" containerID="4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.502936 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4"} err="failed to get container status \"4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4\": rpc error: code = NotFound desc = could not find container \"4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4\": container with ID starting with 4543493b14a8f2f7a795059caa70fe8b4064396143900d119200ae7dc82e57c4 not found: ID does not exist" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.502974 4769 scope.go:117] "RemoveContainer" containerID="a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25" Nov 21 13:11:41 crc kubenswrapper[4769]: E1121 13:11:41.503516 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25\": container with ID starting with a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25 not found: ID does not exist" containerID="a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.503542 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25"} err="failed to get container status \"a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25\": rpc error: code = NotFound desc = could not find container \"a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25\": container with ID starting with a0d91182521269666963e819e1e3ff7992d06ea37d6005c242477f43512daf25 not found: ID does not exist" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-config-data\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9wq\" (UniqueName: \"kubernetes.io/projected/eac35646-4f9b-49dc-b8e1-313f0daf1e21-kube-api-access-vz9wq\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558727 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-log-httpd\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-run-httpd\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.558951 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-scripts\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.559397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-log-httpd\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.559518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-run-httpd\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.559581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.564263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-scripts\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.564277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.564980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.565414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-config-data\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.566722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.576838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9wq\" (UniqueName: \"kubernetes.io/projected/eac35646-4f9b-49dc-b8e1-313f0daf1e21-kube-api-access-vz9wq\") pod \"ceilometer-0\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:41 crc kubenswrapper[4769]: I1121 13:11:41.756960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:42 crc kubenswrapper[4769]: I1121 13:11:42.228608 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:11:42 crc kubenswrapper[4769]: W1121 13:11:42.231179 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeac35646_4f9b_49dc_b8e1_313f0daf1e21.slice/crio-4ce95439f7570762f282b382105530a8779050472503786a1081fd8171fd51db WatchSource:0}: Error finding container 4ce95439f7570762f282b382105530a8779050472503786a1081fd8171fd51db: Status 404 returned error can't find the container with id 4ce95439f7570762f282b382105530a8779050472503786a1081fd8171fd51db Nov 21 13:11:42 crc kubenswrapper[4769]: I1121 13:11:42.329592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerStarted","Data":"4ce95439f7570762f282b382105530a8779050472503786a1081fd8171fd51db"} Nov 21 13:11:43 crc kubenswrapper[4769]: I1121 13:11:43.298347 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f33c4c-4a03-4c53-a741-6ad15373c8d8" path="/var/lib/kubelet/pods/66f33c4c-4a03-4c53-a741-6ad15373c8d8/volumes" Nov 21 13:11:43 crc kubenswrapper[4769]: I1121 13:11:43.299989 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e62d6a-4c74-49a7-8a5f-fe694745f2b0" path="/var/lib/kubelet/pods/f3e62d6a-4c74-49a7-8a5f-fe694745f2b0/volumes" Nov 21 13:11:44 crc kubenswrapper[4769]: I1121 13:11:44.387177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerStarted","Data":"06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8"} Nov 21 13:11:44 crc kubenswrapper[4769]: I1121 13:11:44.387873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerStarted","Data":"3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d"} Nov 21 13:11:45 crc kubenswrapper[4769]: I1121 13:11:45.400837 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:45 crc kubenswrapper[4769]: I1121 13:11:45.401847 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:11:45 crc kubenswrapper[4769]: I1121 13:11:45.504534 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4"] Nov 21 13:11:45 crc kubenswrapper[4769]: I1121 13:11:45.504805 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-httpd" containerID="cri-o://2cfc347d39ad0f86dd559e8d66234bcb38d810d8807c0228d01fc9f3d53831b5" gracePeriod=30 Nov 21 13:11:45 crc kubenswrapper[4769]: I1121 13:11:45.505252 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-server" containerID="cri-o://49853b2d4b4be27a262d79e0727dbb40515dd28bbab25415aefb0a1bc3c9abb0" gracePeriod=30 Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.419293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerStarted","Data":"0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5"} Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.424577 4769 generic.go:334] "Generic (PLEG): container finished" podID="96370f55-1a3c-4023-b59b-5702856f0192" containerID="49853b2d4b4be27a262d79e0727dbb40515dd28bbab25415aefb0a1bc3c9abb0" exitCode=0 Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.424613 4769 generic.go:334] "Generic (PLEG): container finished" podID="96370f55-1a3c-4023-b59b-5702856f0192" containerID="2cfc347d39ad0f86dd559e8d66234bcb38d810d8807c0228d01fc9f3d53831b5" exitCode=0 Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.425663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" event={"ID":"96370f55-1a3c-4023-b59b-5702856f0192","Type":"ContainerDied","Data":"49853b2d4b4be27a262d79e0727dbb40515dd28bbab25415aefb0a1bc3c9abb0"} Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.425699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" event={"ID":"96370f55-1a3c-4023-b59b-5702856f0192","Type":"ContainerDied","Data":"2cfc347d39ad0f86dd559e8d66234bcb38d810d8807c0228d01fc9f3d53831b5"} Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.425714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" event={"ID":"96370f55-1a3c-4023-b59b-5702856f0192","Type":"ContainerDied","Data":"60b7a5fb1ccac538202a02e0282cb66c92c483cc3676f6b6b63f4aa159a40226"} Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.425725 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60b7a5fb1ccac538202a02e0282cb66c92c483cc3676f6b6b63f4aa159a40226" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.469842 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600512 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-run-httpd\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-internal-tls-certs\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600688 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvtvv\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-kube-api-access-xvtvv\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-config-data\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-log-httpd\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-public-tls-certs\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-etc-swift\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-combined-ca-bundle\") pod \"96370f55-1a3c-4023-b59b-5702856f0192\" (UID: \"96370f55-1a3c-4023-b59b-5702856f0192\") " Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.600887 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.605289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-kube-api-access-xvtvv" (OuterVolumeSpecName: "kube-api-access-xvtvv") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "kube-api-access-xvtvv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.605680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.608309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.682435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.685814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-config-data" (OuterVolumeSpecName: "config-data") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.690310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.701307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96370f55-1a3c-4023-b59b-5702856f0192" (UID: "96370f55-1a3c-4023-b59b-5702856f0192"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704276 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704308 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704323 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704337 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704350 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704362 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/96370f55-1a3c-4023-b59b-5702856f0192-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704373 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/96370f55-1a3c-4023-b59b-5702856f0192-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:46 crc kubenswrapper[4769]: I1121 13:11:46.704384 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xvtvv\" (UniqueName: \"kubernetes.io/projected/96370f55-1a3c-4023-b59b-5702856f0192-kube-api-access-xvtvv\") on node \"crc\" DevicePath \"\"" Nov 21 13:11:47 crc kubenswrapper[4769]: I1121 13:11:47.434487 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" Nov 21 13:11:47 crc kubenswrapper[4769]: I1121 13:11:47.436042 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerStarted","Data":"bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721"} Nov 21 13:11:47 crc kubenswrapper[4769]: I1121 13:11:47.436077 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:11:47 crc kubenswrapper[4769]: I1121 13:11:47.473677 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.165560387 podStartE2EDuration="6.473658454s" podCreationTimestamp="2025-11-21 13:11:41 +0000 UTC" firstStartedPulling="2025-11-21 13:11:42.234534566 +0000 UTC m=+4860.935196394" lastFinishedPulling="2025-11-21 13:11:46.542632643 +0000 UTC m=+4865.243294461" observedRunningTime="2025-11-21 13:11:47.458464755 +0000 UTC m=+4866.159126573" watchObservedRunningTime="2025-11-21 13:11:47.473658454 +0000 UTC m=+4866.174320272" Nov 21 13:11:47 crc kubenswrapper[4769]: I1121 13:11:47.487696 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4"] Nov 21 13:11:47 crc kubenswrapper[4769]: I1121 13:11:47.496780 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4"] Nov 21 13:11:49 crc kubenswrapper[4769]: I1121 13:11:49.283921 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96370f55-1a3c-4023-b59b-5702856f0192" path="/var/lib/kubelet/pods/96370f55-1a3c-4023-b59b-5702856f0192/volumes" Nov 21 13:11:51 crc kubenswrapper[4769]: I1121 13:11:51.313377 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.77:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:11:51 crc kubenswrapper[4769]: I1121 13:11:51.313769 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-789d76b4f8-lgqr4" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.77:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:12:11 crc kubenswrapper[4769]: I1121 13:12:11.325042 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:12:11 crc kubenswrapper[4769]: I1121 13:12:11.325827 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:12:11 crc kubenswrapper[4769]: I1121 13:12:11.766207 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:16 crc kubenswrapper[4769]: I1121 13:12:16.667442 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:16 crc kubenswrapper[4769]: I1121 13:12:16.668699 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-central-agent" containerID="cri-o://06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8" gracePeriod=30 Nov 21 13:12:16 crc kubenswrapper[4769]: I1121 13:12:16.668918 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-notification-agent" containerID="cri-o://3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d" gracePeriod=30 Nov 21 13:12:16 crc kubenswrapper[4769]: I1121 13:12:16.668813 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="sg-core" containerID="cri-o://0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5" gracePeriod=30 Nov 21 13:12:16 crc kubenswrapper[4769]: I1121 13:12:16.669109 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="proxy-httpd" containerID="cri-o://bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721" gracePeriod=30 Nov 21 13:12:17 crc kubenswrapper[4769]: I1121 13:12:17.806214 4769 generic.go:334] "Generic (PLEG): container finished" podID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerID="bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721" exitCode=0 Nov 21 13:12:17 crc kubenswrapper[4769]: I1121 13:12:17.806652 4769 generic.go:334] "Generic (PLEG): container finished" podID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerID="0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5" exitCode=2 Nov 21 13:12:17 crc kubenswrapper[4769]: I1121 13:12:17.806665 4769 generic.go:334] "Generic (PLEG): container finished" podID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerID="06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8" exitCode=0 Nov 21 13:12:17 crc kubenswrapper[4769]: I1121 13:12:17.806280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerDied","Data":"bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721"} Nov 21 13:12:17 crc kubenswrapper[4769]: I1121 13:12:17.806708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerDied","Data":"0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5"} Nov 21 13:12:17 crc kubenswrapper[4769]: I1121 13:12:17.806725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerDied","Data":"06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8"} Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.324445 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-2229h"] Nov 21 13:12:18 crc kubenswrapper[4769]: E1121 13:12:18.324906 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-httpd" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.324931 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-httpd" Nov 21 13:12:18 crc kubenswrapper[4769]: E1121 13:12:18.324983 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-server" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.324991 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-server" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.325230 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-httpd" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.325260 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96370f55-1a3c-4023-b59b-5702856f0192" containerName="proxy-server" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.327327 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.334481 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-2229h"] Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.473999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q89k8\" (UniqueName: \"kubernetes.io/projected/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-kube-api-access-q89k8\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.474443 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-utilities\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.474612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-catalog-content\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.576876 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q89k8\" (UniqueName: \"kubernetes.io/projected/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-kube-api-access-q89k8\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.576941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-utilities\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.577010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-catalog-content\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.577502 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-utilities\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.577598 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-catalog-content\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.603392 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q89k8\" (UniqueName: \"kubernetes.io/projected/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-kube-api-access-q89k8\") pod \"certified-operators-2229h\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:18 crc kubenswrapper[4769]: I1121 13:12:18.685675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:19 crc kubenswrapper[4769]: I1121 13:12:19.193786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-2229h"] Nov 21 13:12:19 crc kubenswrapper[4769]: I1121 13:12:19.842933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerStarted","Data":"b57e820471895e9d4013feab7f3bac2e4578c914304282358b1f8dffecab1332"} Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.478600 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.642634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-ceilometer-tls-certs\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.642703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-sg-core-conf-yaml\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.642764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-combined-ca-bundle\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.642871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-log-httpd\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.642911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-run-httpd\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.643041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-scripts\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.643105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz9wq\" (UniqueName: \"kubernetes.io/projected/eac35646-4f9b-49dc-b8e1-313f0daf1e21-kube-api-access-vz9wq\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.643135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-config-data\") pod \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\" (UID: \"eac35646-4f9b-49dc-b8e1-313f0daf1e21\") " Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.643585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.643741 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.644073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.648257 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-scripts" (OuterVolumeSpecName: "scripts") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.648383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac35646-4f9b-49dc-b8e1-313f0daf1e21-kube-api-access-vz9wq" (OuterVolumeSpecName: "kube-api-access-vz9wq") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "kube-api-access-vz9wq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.685853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.697764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.733082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.735005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-config-data" (OuterVolumeSpecName: "config-data") pod "eac35646-4f9b-49dc-b8e1-313f0daf1e21" (UID: "eac35646-4f9b-49dc-b8e1-313f0daf1e21"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745179 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vz9wq\" (UniqueName: \"kubernetes.io/projected/eac35646-4f9b-49dc-b8e1-313f0daf1e21-kube-api-access-vz9wq\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745266 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745280 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745292 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745303 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745314 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eac35646-4f9b-49dc-b8e1-313f0daf1e21-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.745326 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eac35646-4f9b-49dc-b8e1-313f0daf1e21-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.857167 4769 generic.go:334] "Generic (PLEG): container finished" podID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerID="bce15b9ca4fbf26c69855bbc7de558bf8aeeed67ee45916e38d6d4bdbe6376b3" exitCode=0 Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.857259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerDied","Data":"bce15b9ca4fbf26c69855bbc7de558bf8aeeed67ee45916e38d6d4bdbe6376b3"} Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.861692 4769 generic.go:334] "Generic (PLEG): container finished" podID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerID="3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d" exitCode=0 Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.861755 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerDied","Data":"3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d"} Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.861791 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.861980 4769 scope.go:117] "RemoveContainer" containerID="bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.861862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eac35646-4f9b-49dc-b8e1-313f0daf1e21","Type":"ContainerDied","Data":"4ce95439f7570762f282b382105530a8779050472503786a1081fd8171fd51db"} Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.893171 4769 scope.go:117] "RemoveContainer" containerID="0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.909171 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.918461 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.926263 4769 scope.go:117] "RemoveContainer" containerID="3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.928864 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.929413 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-notification-agent" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929440 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-notification-agent" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.929495 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="sg-core" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929506 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="sg-core" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.929531 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="proxy-httpd" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929541 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="proxy-httpd" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.929558 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-central-agent" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929567 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-central-agent" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929820 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-central-agent" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929856 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="ceilometer-notification-agent" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929871 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="proxy-httpd" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.929890 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" containerName="sg-core" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.932294 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.935823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.936040 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.936876 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.938965 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.953667 4769 scope.go:117] "RemoveContainer" containerID="06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.979405 4769 scope.go:117] "RemoveContainer" containerID="bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.979818 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721\": container with ID starting with bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721 not found: ID does not exist" containerID="bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.979847 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721"} err="failed to get container status \"bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721\": rpc error: code = NotFound desc = could not find container \"bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721\": container with ID starting with bc1de93f76a40cf8952ec77312a40154e0a1191e599fa37709ef35a20571b721 not found: ID does not exist" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.979871 4769 scope.go:117] "RemoveContainer" containerID="0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.980048 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5\": container with ID starting with 0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5 not found: ID does not exist" containerID="0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.980096 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5"} err="failed to get container status \"0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5\": rpc error: code = NotFound desc = could not find container \"0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5\": container with ID starting with 0b68f07534ab8ec36feeadd3c4c3e0d8cc395921c8611ff224408407196d86e5 not found: ID does not exist" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.980110 4769 scope.go:117] "RemoveContainer" containerID="3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.980322 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d\": container with ID starting with 3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d not found: ID does not exist" containerID="3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.980347 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d"} err="failed to get container status \"3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d\": rpc error: code = NotFound desc = could not find container \"3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d\": container with ID starting with 3166098f7904e9c37cf0761b2cbbfe3cb3c7a187a0ecc2f0f08d2deb03c6b31d not found: ID does not exist" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.980361 4769 scope.go:117] "RemoveContainer" containerID="06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8" Nov 21 13:12:20 crc kubenswrapper[4769]: E1121 13:12:20.980608 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8\": container with ID starting with 06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8 not found: ID does not exist" containerID="06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8" Nov 21 13:12:20 crc kubenswrapper[4769]: I1121 13:12:20.980649 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8"} err="failed to get container status \"06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8\": rpc error: code = NotFound desc = could not find container \"06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8\": container with ID starting with 06213f3fc4c1f6e7093e452fc36fc9ee1052a787dc95776bcb27ef788bbae7f8 not found: ID does not exist" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.052987 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-config-data\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr4nt\" (UniqueName: \"kubernetes.io/projected/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-kube-api-access-hr4nt\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053061 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-run-httpd\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053200 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-scripts\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.053307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-log-httpd\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.155230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-run-httpd\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.155521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.155617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.155709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-scripts\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.155828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.155908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-log-httpd\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.156013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-run-httpd\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.156135 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-config-data\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.156223 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hr4nt\" (UniqueName: \"kubernetes.io/projected/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-kube-api-access-hr4nt\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.156581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-log-httpd\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.161219 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-scripts\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.161747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-config-data\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.162067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.173744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.175637 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr4nt\" (UniqueName: \"kubernetes.io/projected/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-kube-api-access-hr4nt\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.177436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.267388 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:21 crc kubenswrapper[4769]: I1121 13:12:21.312721 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac35646-4f9b-49dc-b8e1-313f0daf1e21" path="/var/lib/kubelet/pods/eac35646-4f9b-49dc-b8e1-313f0daf1e21/volumes" Nov 21 13:12:22 crc kubenswrapper[4769]: I1121 13:12:22.525324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:22 crc kubenswrapper[4769]: W1121 13:12:22.528536 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7502cfa7_e853_47c6_b98e_3d9d38c25cf1.slice/crio-234dde112f5100d71a80f803c5d889afd39fe109dd1f176c4085d8639b7b4bd4 WatchSource:0}: Error finding container 234dde112f5100d71a80f803c5d889afd39fe109dd1f176c4085d8639b7b4bd4: Status 404 returned error can't find the container with id 234dde112f5100d71a80f803c5d889afd39fe109dd1f176c4085d8639b7b4bd4 Nov 21 13:12:22 crc kubenswrapper[4769]: I1121 13:12:22.887391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerStarted","Data":"10f4f7d37690f4fda97734fc341495dc455f12f52cd7b874a999ac301d33583d"} Nov 21 13:12:22 crc kubenswrapper[4769]: I1121 13:12:22.888475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerStarted","Data":"234dde112f5100d71a80f803c5d889afd39fe109dd1f176c4085d8639b7b4bd4"} Nov 21 13:12:23 crc kubenswrapper[4769]: I1121 13:12:23.900716 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerStarted","Data":"c33a4fb05b67693cae37eafcf51039870dc219c0d587c95253161dc96847f64c"} Nov 21 13:12:23 crc kubenswrapper[4769]: I1121 13:12:23.901361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerStarted","Data":"1ac6a9cbf9c5bc7dedb94b98cb137524c5869954e18b4face10142a805202d4a"} Nov 21 13:12:24 crc kubenswrapper[4769]: I1121 13:12:24.911705 4769 generic.go:334] "Generic (PLEG): container finished" podID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerID="10f4f7d37690f4fda97734fc341495dc455f12f52cd7b874a999ac301d33583d" exitCode=0 Nov 21 13:12:24 crc kubenswrapper[4769]: I1121 13:12:24.911778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerDied","Data":"10f4f7d37690f4fda97734fc341495dc455f12f52cd7b874a999ac301d33583d"} Nov 21 13:12:25 crc kubenswrapper[4769]: I1121 13:12:25.925215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerStarted","Data":"f52b5564b71e505ef3546ff8491a84f27760b29ba01f07a605d03eba3aaa5b85"} Nov 21 13:12:25 crc kubenswrapper[4769]: I1121 13:12:25.929880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerStarted","Data":"d4dc361bd50cbe266d391c6230f55fa8659ee1b068a5be6a0c8fd280a970c3c2"} Nov 21 13:12:25 crc kubenswrapper[4769]: I1121 13:12:25.951391 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-2229h" podStartSLOduration=3.185445725 podStartE2EDuration="7.951370276s" podCreationTimestamp="2025-11-21 13:12:18 +0000 UTC" firstStartedPulling="2025-11-21 13:12:20.860311747 +0000 UTC m=+4899.560973565" lastFinishedPulling="2025-11-21 13:12:25.626236278 +0000 UTC m=+4904.326898116" observedRunningTime="2025-11-21 13:12:25.944146851 +0000 UTC m=+4904.644808679" watchObservedRunningTime="2025-11-21 13:12:25.951370276 +0000 UTC m=+4904.652032094" Nov 21 13:12:26 crc kubenswrapper[4769]: I1121 13:12:26.941413 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerStarted","Data":"9dc68326152be9bd2c48a2f30bf8f8a5af426c719d8801fcd2d52d97fe61fa30"} Nov 21 13:12:26 crc kubenswrapper[4769]: I1121 13:12:26.941806 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:26 crc kubenswrapper[4769]: I1121 13:12:26.970115 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.16783188 podStartE2EDuration="6.97009008s" podCreationTimestamp="2025-11-21 13:12:20 +0000 UTC" firstStartedPulling="2025-11-21 13:12:22.549011469 +0000 UTC m=+4901.249673297" lastFinishedPulling="2025-11-21 13:12:26.351269679 +0000 UTC m=+4905.051931497" observedRunningTime="2025-11-21 13:12:26.962146476 +0000 UTC m=+4905.662808294" watchObservedRunningTime="2025-11-21 13:12:26.97009008 +0000 UTC m=+4905.670751898" Nov 21 13:12:28 crc kubenswrapper[4769]: I1121 13:12:28.685915 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:28 crc kubenswrapper[4769]: I1121 13:12:28.686423 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:28 crc kubenswrapper[4769]: I1121 13:12:28.770473 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.082453 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.083345 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" containerName="openstackclient" containerID="cri-o://8b0b2bef3262c86bca0f9052cf9d437111d150487a08e9f093775c05d3716716" gracePeriod=2 Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.093849 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.245637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.424046 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.424108 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data podName:d9bcbff3-ef6f-466b-81ad-7aa2093adbed nodeName:}" failed. No retries permitted until 2025-11-21 13:12:32.924093187 +0000 UTC m=+4911.624755005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data") pod "rabbitmq-cell1-server-0" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.435328 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance2383-account-delete-q59sz"] Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.435870 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" containerName="openstackclient" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.435902 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" containerName="openstackclient" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.436170 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" containerName="openstackclient" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.436987 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.465293 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance2383-account-delete-q59sz"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.524997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts\") pod \"glance2383-account-delete-q59sz\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.525068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvnn\" (UniqueName: \"kubernetes.io/projected/158a329a-0904-43dd-b3da-b010701dcef0-kube-api-access-bsvnn\") pod \"glance2383-account-delete-q59sz\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.553400 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement1832-account-delete-5fdvd"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.554792 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.581653 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.599275 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement1832-account-delete-5fdvd"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.611054 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutronaaf3-account-delete-4srnv"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.612845 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.630654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvnn\" (UniqueName: \"kubernetes.io/projected/158a329a-0904-43dd-b3da-b010701dcef0-kube-api-access-bsvnn\") pod \"glance2383-account-delete-q59sz\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.631037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts\") pod \"placement1832-account-delete-5fdvd\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.631234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wh5v\" (UniqueName: \"kubernetes.io/projected/b61a670b-7dd5-4560-8b17-57044f1ea44b-kube-api-access-5wh5v\") pod \"placement1832-account-delete-5fdvd\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.631425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts\") pod \"glance2383-account-delete-q59sz\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.632577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts\") pod \"glance2383-account-delete-q59sz\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.656864 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.657099 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" containerID="cri-o://6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" gracePeriod=30 Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.657527 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="openstack-network-exporter" containerID="cri-o://a5aad00ff05c150b93f70bd16b1ceeef86ed5980b761b995801e435b824bf874" gracePeriod=30 Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.667951 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronaaf3-account-delete-4srnv"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.685415 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.686428 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="openstack-network-exporter" containerID="cri-o://d51c1c0606b4847e6a8a7725c715a026f637f8e548ff6f2d4587137bf4b3c14a" gracePeriod=300 Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.735139 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.736443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.738148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5wh5v\" (UniqueName: \"kubernetes.io/projected/b61a670b-7dd5-4560-8b17-57044f1ea44b-kube-api-access-5wh5v\") pod \"placement1832-account-delete-5fdvd\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.738351 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts\") pod \"neutronaaf3-account-delete-4srnv\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.738389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts\") pod \"placement1832-account-delete-5fdvd\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.738410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjj59\" (UniqueName: \"kubernetes.io/projected/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-kube-api-access-jjj59\") pod \"neutronaaf3-account-delete-4srnv\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.739119 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.739162 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data podName:67b175f2-3b5a-49a9-a0f5-aec7dafbde5a nodeName:}" failed. No retries permitted until 2025-11-21 13:12:33.239149864 +0000 UTC m=+4911.939811682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data") pod "rabbitmq-server-0" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a") : configmap "rabbitmq-config-data" not found Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.740677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts\") pod \"placement1832-account-delete-5fdvd\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.778118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75vgw"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.831881 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-75vgw"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.840298 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts\") pod \"neutronaaf3-account-delete-4srnv\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.840348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jjj59\" (UniqueName: \"kubernetes.io/projected/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-kube-api-access-jjj59\") pod \"neutronaaf3-account-delete-4srnv\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.840380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts\") pod \"barbicanb23d-account-delete-5p6qv\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.840506 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx5g9\" (UniqueName: \"kubernetes.io/projected/269e95b2-5877-4a8e-a661-4cf7270f215d-kube-api-access-rx5g9\") pod \"barbicanb23d-account-delete-5p6qv\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.845449 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts\") pod \"neutronaaf3-account-delete-4srnv\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.864681 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.890316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f9pm7"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.901786 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-f9pm7"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.909810 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinderff83-account-delete-n49j8"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.911398 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.915880 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinderff83-account-delete-n49j8"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.924322 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.924740 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="openstack-network-exporter" containerID="cri-o://09166ec9c62fa77d0613bc7dadc17139475d45c65088a2c6159406d713c6b7c6" gracePeriod=300 Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.942132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts\") pod \"barbicanb23d-account-delete-5p6qv\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.942266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rx5g9\" (UniqueName: \"kubernetes.io/projected/269e95b2-5877-4a8e-a661-4cf7270f215d-kube-api-access-rx5g9\") pod \"barbicanb23d-account-delete-5p6qv\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.942453 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:32 crc kubenswrapper[4769]: E1121 13:12:32.942504 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data podName:d9bcbff3-ef6f-466b-81ad-7aa2093adbed nodeName:}" failed. No retries permitted until 2025-11-21 13:12:33.942486371 +0000 UTC m=+4912.643148189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data") pod "rabbitmq-cell1-server-0" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:32 crc kubenswrapper[4769]: I1121 13:12:32.943166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts\") pod \"barbicanb23d-account-delete-5p6qv\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.043602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmqcx\" (UniqueName: \"kubernetes.io/projected/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-kube-api-access-bmqcx\") pod \"cinderff83-account-delete-n49j8\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.043864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts\") pod \"cinderff83-account-delete-n49j8\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.079692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvnn\" (UniqueName: \"kubernetes.io/projected/158a329a-0904-43dd-b3da-b010701dcef0-kube-api-access-bsvnn\") pod \"glance2383-account-delete-q59sz\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.083506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wh5v\" (UniqueName: \"kubernetes.io/projected/b61a670b-7dd5-4560-8b17-57044f1ea44b-kube-api-access-5wh5v\") pod \"placement1832-account-delete-5fdvd\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.083759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjj59\" (UniqueName: \"kubernetes.io/projected/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-kube-api-access-jjj59\") pod \"neutronaaf3-account-delete-4srnv\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.088287 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx5g9\" (UniqueName: \"kubernetes.io/projected/269e95b2-5877-4a8e-a661-4cf7270f215d-kube-api-access-rx5g9\") pod \"barbicanb23d-account-delete-5p6qv\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.088782 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.099306 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.127901 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell09288-account-delete-clqgk"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.131485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.146403 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bmqcx\" (UniqueName: \"kubernetes.io/projected/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-kube-api-access-bmqcx\") pod \"cinderff83-account-delete-n49j8\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.146528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts\") pod \"cinderff83-account-delete-n49j8\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.147420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts\") pod \"cinderff83-account-delete-n49j8\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.157525 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell09288-account-delete-clqgk"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.169610 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmqcx\" (UniqueName: \"kubernetes.io/projected/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-kube-api-access-bmqcx\") pod \"cinderff83-account-delete-n49j8\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.203313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.251021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfk4\" (UniqueName: \"kubernetes.io/projected/c9d55e43-3709-48bb-80d3-490d8418422e-kube-api-access-5pfk4\") pod \"novacell09288-account-delete-clqgk\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.251090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts\") pod \"novacell09288-account-delete-clqgk\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.251444 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.251497 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data podName:67b175f2-3b5a-49a9-a0f5-aec7dafbde5a nodeName:}" failed. No retries permitted until 2025-11-21 13:12:34.251479745 +0000 UTC m=+4912.952141573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data") pod "rabbitmq-server-0" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a") : configmap "rabbitmq-config-data" not found Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.265717 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-qr457"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.277103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.317469 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.318506 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="ovsdbserver-nb" containerID="cri-o://35c9b30387654c1f32651b1cf7f65ac9652dc6e47ad5eff620152c7c2d14fcce" gracePeriod=300 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.353756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfk4\" (UniqueName: \"kubernetes.io/projected/c9d55e43-3709-48bb-80d3-490d8418422e-kube-api-access-5pfk4\") pod \"novacell09288-account-delete-clqgk\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.353814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts\") pod \"novacell09288-account-delete-clqgk\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.355396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts\") pod \"novacell09288-account-delete-clqgk\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.410881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfk4\" (UniqueName: \"kubernetes.io/projected/c9d55e43-3709-48bb-80d3-490d8418422e-kube-api-access-5pfk4\") pod \"novacell09288-account-delete-clqgk\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.443219 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="ovsdbserver-sb" containerID="cri-o://721d6911a1b3ec564dc67fa869793d0b76441f9ba55852b8ac8fa47a47dbc90c" gracePeriod=300 Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.458780 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.458866 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:33.958847412 +0000 UTC m=+4912.659509230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "combined-ca-bundle" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.459153 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.459238 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:33.959214981 +0000 UTC m=+4912.659876879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-public-svc" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.460645 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.460707 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:33.960691161 +0000 UTC m=+4912.661352979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-internal-svc" not found Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.483453 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3906bc17-ab23-4a75-8272-0404c19616ec" path="/var/lib/kubelet/pods/3906bc17-ab23-4a75-8272-0404c19616ec/volumes" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.485560 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="871ef20e-db69-407c-bf2b-0adde206d6ef" path="/var/lib/kubelet/pods/871ef20e-db69-407c-bf2b-0adde206d6ef/volumes" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.486299 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-qr457"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.487009 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqkjd"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.487095 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqkjd"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.487174 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi558e-account-delete-grnrb"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.488487 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.516386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi558e-account-delete-grnrb"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.523836 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.534252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-z4n4m"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.550371 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-z4n4m"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.561139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvn5l\" (UniqueName: \"kubernetes.io/projected/bb8b5ad1-e875-465a-bdf2-5f990e090632-kube-api-access-fvn5l\") pod \"novaapi558e-account-delete-grnrb\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.561266 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts\") pod \"novaapi558e-account-delete-grnrb\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.568263 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-lkmwv"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.588118 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-lkmwv"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.621739 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5fb4445bb6-b7tmz"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.622004 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-log" containerID="cri-o://2ca8b06c3af120dd02e735b16a2ce782700c9797a0545898975dfe0e9fb7e4d2" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.622764 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-api" containerID="cri-o://a2935a55a0c5f438e8f50cb9b12402f1525361c791e6198d99d3c7813f69f9d1" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.666856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts\") pod \"novaapi558e-account-delete-grnrb\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.667306 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fvn5l\" (UniqueName: \"kubernetes.io/projected/bb8b5ad1-e875-465a-bdf2-5f990e090632-kube-api-access-fvn5l\") pod \"novaapi558e-account-delete-grnrb\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.668729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts\") pod \"novaapi558e-account-delete-grnrb\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.701744 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.701973 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-log" containerID="cri-o://e092805bd57392bc944dea66cee8e98cc8cd1596cb22e01eae257ca8b1694a32" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.702394 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-httpd" containerID="cri-o://85e87dc518b24c4ec2884bd507e742126b310138eccd8a0f39d227ababb6622f" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.703793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvn5l\" (UniqueName: \"kubernetes.io/projected/bb8b5ad1-e875-465a-bdf2-5f990e090632-kube-api-access-fvn5l\") pod \"novaapi558e-account-delete-grnrb\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.767268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.778935 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pwqlw"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.795666 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.806561 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-8jfdp"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.829429 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.831787 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-server" containerID="cri-o://0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832209 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="swift-recon-cron" containerID="cri-o://20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832252 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="rsync" containerID="cri-o://5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832286 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-expirer" containerID="cri-o://75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832452 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-updater" containerID="cri-o://1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832485 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-auditor" containerID="cri-o://f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832523 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-replicator" containerID="cri-o://826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832555 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-server" containerID="cri-o://c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832605 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-updater" containerID="cri-o://f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832733 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-auditor" containerID="cri-o://8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832773 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-replicator" containerID="cri-o://7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832835 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-server" containerID="cri-o://a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832877 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-reaper" containerID="cri-o://0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.832910 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-auditor" containerID="cri-o://222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.833030 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-replicator" containerID="cri-o://93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.851681 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.851944 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-log" containerID="cri-o://2a4609450f8a9194b63550d4f501e76842cb87df6e87a7722dc004333a5a469c" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.852448 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-httpd" containerID="cri-o://5401fd97b2ef48dbfc2b5d69640565cfb88f8988e3d56328b99afea808b67beb" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.887696 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8576757c54-nblzm"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.887978 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-api" containerID="cri-o://39ef7e4397f48731bce48b78715be96da4f74652e9ed100f8863f7a964cc1dcd" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.888102 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-httpd" containerID="cri-o://6edfc81cd3befd0a3b3f3414ada3d4fd0e7a79eacffd642f5a5c8b38558ae6b2" gracePeriod=30 Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.928487 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr"] Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.933711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:33 crc kubenswrapper[4769]: I1121 13:12:33.948511 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.976534 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.987025 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:34.98698867 +0000 UTC m=+4913.687650488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "combined-ca-bundle" not found Nov 21 13:12:33 crc kubenswrapper[4769]: E1121 13:12:33.977489 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.001869 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:35.00183692 +0000 UTC m=+4913.702498738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-internal-svc" not found Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:33.977524 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.002547 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:35.002534618 +0000 UTC m=+4913.703196436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-public-svc" not found Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:33.977562 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.002613 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr"] Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.002933 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data podName:d9bcbff3-ef6f-466b-81ad-7aa2093adbed nodeName:}" failed. No retries permitted until 2025-11-21 13:12:36.002918579 +0000 UTC m=+4914.703580397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data") pod "rabbitmq-cell1-server-0" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.029290 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.049974 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_a76ed59b-2b28-4f4b-bac2-8e4fbdca2607/ovsdbserver-sb/0.log" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.050037 4769 generic.go:334] "Generic (PLEG): container finished" podID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerID="09166ec9c62fa77d0613bc7dadc17139475d45c65088a2c6159406d713c6b7c6" exitCode=2 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.050052 4769 generic.go:334] "Generic (PLEG): container finished" podID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerID="721d6911a1b3ec564dc67fa869793d0b76441f9ba55852b8ac8fa47a47dbc90c" exitCode=143 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.050140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607","Type":"ContainerDied","Data":"09166ec9c62fa77d0613bc7dadc17139475d45c65088a2c6159406d713c6b7c6"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.050168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607","Type":"ContainerDied","Data":"721d6911a1b3ec564dc67fa869793d0b76441f9ba55852b8ac8fa47a47dbc90c"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.056073 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.056572 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="probe" containerID="cri-o://3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.056752 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" containerID="cri-o://0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.067520 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_852be43e-77fe-4edf-ba14-fe226cfce274/ovsdbserver-nb/0.log" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.067585 4769 generic.go:334] "Generic (PLEG): container finished" podID="852be43e-77fe-4edf-ba14-fe226cfce274" containerID="d51c1c0606b4847e6a8a7725c715a026f637f8e548ff6f2d4587137bf4b3c14a" exitCode=2 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.067606 4769 generic.go:334] "Generic (PLEG): container finished" podID="852be43e-77fe-4edf-ba14-fe226cfce274" containerID="35c9b30387654c1f32651b1cf7f65ac9652dc6e47ad5eff620152c7c2d14fcce" exitCode=143 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.067697 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"852be43e-77fe-4edf-ba14-fe226cfce274","Type":"ContainerDied","Data":"d51c1c0606b4847e6a8a7725c715a026f637f8e548ff6f2d4587137bf4b3c14a"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.067751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"852be43e-77fe-4edf-ba14-fe226cfce274","Type":"ContainerDied","Data":"35c9b30387654c1f32651b1cf7f65ac9652dc6e47ad5eff620152c7c2d14fcce"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.072608 4769 generic.go:334] "Generic (PLEG): container finished" podID="6e99fec8-485c-4729-bb82-623b8cd00824" containerID="a5aad00ff05c150b93f70bd16b1ceeef86ed5980b761b995801e435b824bf874" exitCode=2 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.072664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6e99fec8-485c-4729-bb82-623b8cd00824","Type":"ContainerDied","Data":"a5aad00ff05c150b93f70bd16b1ceeef86ed5980b761b995801e435b824bf874"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.078407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.078659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.078761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dml9l\" (UniqueName: \"kubernetes.io/projected/6919fe80-c60f-4450-9a82-e985d9f546e3-kube-api-access-dml9l\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.104647 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="rabbitmq" containerID="cri-o://5d26239474a3e16cffea4e7314aafddd0ff19c871879a7013a25f4969633a000" gracePeriod=604800 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111263 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10" exitCode=0 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111301 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6" exitCode=0 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111313 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e" exitCode=0 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111326 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75" exitCode=0 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111337 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb" exitCode=0 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111480 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111494 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.111505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.124844 4769 generic.go:334] "Generic (PLEG): container finished" podID="983d3297-af3a-447c-ac21-4150a0626907" containerID="e092805bd57392bc944dea66cee8e98cc8cd1596cb22e01eae257ca8b1694a32" exitCode=143 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.124933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"983d3297-af3a-447c-ac21-4150a0626907","Type":"ContainerDied","Data":"e092805bd57392bc944dea66cee8e98cc8cd1596cb22e01eae257ca8b1694a32"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.156860 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.157164 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api-log" containerID="cri-o://921af3a8df3310b4a813a396eeafa4a47e71d25f38d2695db22f35ded27941b5" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.157274 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" containerID="cri-o://45adc74c493f83053c338c16259911147510ac30d8eec3af654716733844c05d" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.180866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dml9l\" (UniqueName: \"kubernetes.io/projected/6919fe80-c60f-4450-9a82-e985d9f546e3-kube-api-access-dml9l\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.180920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.181057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.181180 4769 generic.go:334] "Generic (PLEG): container finished" podID="554020cb-5fc6-4185-940f-4210d7c58422" containerID="2ca8b06c3af120dd02e735b16a2ce782700c9797a0545898975dfe0e9fb7e4d2" exitCode=143 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.181250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" event={"ID":"554020cb-5fc6-4185-940f-4210d7c58422","Type":"ContainerDied","Data":"2ca8b06c3af120dd02e735b16a2ce782700c9797a0545898975dfe0e9fb7e4d2"} Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.181885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.182157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.193943 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.194327 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-httpd" containerID="cri-o://9ea1222a4763b5e1922a4ecec40f631471cbe0ccb62a1f4746700fe65bbc4bb0" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.194953 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-server" containerID="cri-o://a820fbd57cdb5145022fa3dcb67dbd197e305982f91310287aac8ebf4ac783cb" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.203621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dml9l\" (UniqueName: \"kubernetes.io/projected/6919fe80-c60f-4450-9a82-e985d9f546e3-kube-api-access-dml9l\") pod \"dnsmasq-dnsmasq-84b9f45d47-hhwjr\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.271381 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.271635 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-log" containerID="cri-o://8bfef00943a48dc5e1d8712c382f942d89bcf93b1d416023c5df7398aa0f5826" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.272157 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-api" containerID="cri-o://b9847f2b3d0083ef5ef68f7cec090f69da0c6ed2b4bc3f866a1e4ac3c5a41af8" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.285745 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.285821 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data podName:67b175f2-3b5a-49a9-a0f5-aec7dafbde5a nodeName:}" failed. No retries permitted until 2025-11-21 13:12:36.28580582 +0000 UTC m=+4914.986467638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data") pod "rabbitmq-server-0" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a") : configmap "rabbitmq-config-data" not found Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.294833 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.347870 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.348159 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" containerID="cri-o://52bf814fc8e211a8b34844fdf5223234505ecd39743ed8295ab6031c097ee316" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.348734 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" containerID="cri-o://322181a90fba9fec78d937f0cf3b317b57434d3663e1ca80ff852cd244cc9693" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.368098 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.376071 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.395289 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-k6r6q"] Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.432381 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.432881 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-k6r6q"] Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.473385 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.473453 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.508780 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.519079 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-8c08-account-create-znbwj"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.551775 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.552370 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener-log" containerID="cri-o://01fc349f22783f08743b711022c71ba577b7b162773d7722adb2fde2c56261c6" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.553690 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener" containerID="cri-o://e15abbadf3e48c577ca2118a1b46f14868fc0a17cf1a74a3b2c023b947133f5c" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.568576 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.619156 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-54468579b4-cgdw7"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.619506 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" containerID="cri-o://57298bda3155381200ae1e6bb49a3c4f0a2c270e76442b8ba3ecf230459a769f" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.619912 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" containerID="cri-o://79ef4a73447843fd9a3b1a461f8b1ffd2d6c2a8248e4027f928854962875fb3f" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.646566 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.655938 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker-log" containerID="cri-o://aafcb2fe94defa7138324db37ddfa0cc79921bf4dc7287a684357415cbc47472" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.656283 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker" containerID="cri-o://db66bc499117548016d3663ec3a8733b3464af3a068ea1055c43a9cd91cdc128" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.708473 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="rabbitmq" containerID="cri-o://f2e9d93c5241ce1a455f474ad9b632082ce2e117c0bcf9d7d95727dd36b98d63" gracePeriod=604800 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.733417 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.734080 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-central-agent" containerID="cri-o://1ac6a9cbf9c5bc7dedb94b98cb137524c5869954e18b4face10142a805202d4a" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.734541 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="proxy-httpd" containerID="cri-o://9dc68326152be9bd2c48a2f30bf8f8a5af426c719d8801fcd2d52d97fe61fa30" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.734634 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="sg-core" containerID="cri-o://d4dc361bd50cbe266d391c6230f55fa8659ee1b068a5be6a0c8fd280a970c3c2" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.734728 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-notification-agent" containerID="cri-o://c33a4fb05b67693cae37eafcf51039870dc219c0d587c95253161dc96847f64c" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.795271 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.795719 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://fbc8e22d3500b60d401be82ddb82650923ba7c1a02ac9f6b4280c500a79c6304" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.800523 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_852be43e-77fe-4edf-ba14-fe226cfce274/ovsdbserver-nb/0.log" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.800596 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.802500 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.809369 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.809585 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" containerID="cri-o://03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.815873 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_a76ed59b-2b28-4f4b-bac2-8e4fbdca2607/ovsdbserver-sb/0.log" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.815944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.819373 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-h8tjn"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.828252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.840527 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-ldjcc"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.869392 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.869610 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" containerID="cri-o://387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.889693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.889902 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="f073b942-59a2-4273-bd2c-fa4039a573bf" containerName="kube-state-metrics" containerID="cri-o://518ea2dd9cf4cfc354793ae836c42ce25b9409750594dec001c8a6f3eb456bf2" gracePeriod=30 Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.923822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-scripts\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.923911 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-combined-ca-bundle\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.923938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdb-rundir\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.923963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77jxt\" (UniqueName: \"kubernetes.io/projected/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-kube-api-access-77jxt\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.923995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdb-rundir\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-config\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-metrics-certs-tls-certs\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-combined-ca-bundle\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-scripts\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-config\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924281 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdbserver-sb-tls-certs\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-metrics-certs-tls-certs\") pod \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\" (UID: \"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdbserver-nb-tls-certs\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.924380 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qr8l\" (UniqueName: \"kubernetes.io/projected/852be43e-77fe-4edf-ba14-fe226cfce274-kube-api-access-9qr8l\") pod \"852be43e-77fe-4edf-ba14-fe226cfce274\" (UID: \"852be43e-77fe-4edf-ba14-fe226cfce274\") " Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.927837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-scripts" (OuterVolumeSpecName: "scripts") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.928149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-scripts" (OuterVolumeSpecName: "scripts") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.934364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.934456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-config" (OuterVolumeSpecName: "config") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.934578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.934881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-config" (OuterVolumeSpecName: "config") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.951328 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="f073b942-59a2-4273-bd2c-fa4039a573bf" containerName="kube-state-metrics" probeResult="failure" output="Get \"https://10.217.1.100:8081/readyz\": read tcp 10.217.0.2:49680->10.217.1.100:8081: read: connection reset by peer" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.983531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.983774 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852be43e-77fe-4edf-ba14-fe226cfce274-kube-api-access-9qr8l" (OuterVolumeSpecName: "kube-api-access-9qr8l") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "kube-api-access-9qr8l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.986020 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone1c88-account-delete-9z4jh"] Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.987132 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="openstack-network-exporter" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987149 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="openstack-network-exporter" Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.987170 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="openstack-network-exporter" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987177 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="openstack-network-exporter" Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.987205 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="ovsdbserver-sb" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987211 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="ovsdbserver-sb" Nov 21 13:12:34 crc kubenswrapper[4769]: E1121 13:12:34.987233 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="ovsdbserver-nb" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987239 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="ovsdbserver-nb" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987465 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="ovsdbserver-nb" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987483 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" containerName="openstack-network-exporter" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987494 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="openstack-network-exporter" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.987513 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" containerName="ovsdbserver-sb" Nov 21 13:12:34 crc kubenswrapper[4769]: I1121 13:12:34.988957 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.007901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.017345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-kube-api-access-77jxt" (OuterVolumeSpecName: "kube-api-access-77jxt") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "kube-api-access-77jxt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.026678 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.026727 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.026737 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.026766 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.026814 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.026794062 +0000 UTC m=+4915.727455880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "combined-ca-bundle" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.026859 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.026888 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.027159 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.027150311 +0000 UTC m=+4915.727812129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-public-svc" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.027202 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.027181322 +0000 UTC m=+4915.727843140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-internal-svc" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027218 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9qr8l\" (UniqueName: \"kubernetes.io/projected/852be43e-77fe-4edf-ba14-fe226cfce274-kube-api-access-9qr8l\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027232 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/852be43e-77fe-4edf-ba14-fe226cfce274-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027241 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027252 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-77jxt\" (UniqueName: \"kubernetes.io/projected/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-kube-api-access-77jxt\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027263 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027289 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.027303 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.035428 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="galera" containerID="cri-o://ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb" gracePeriod=30 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.043980 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone1c88-account-delete-9z4jh"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.082979 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckmvs"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.109231 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.117217 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h2w9n"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.131010 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-ckmvs"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.131070 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h2w9n"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.132991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.133077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwg4s\" (UniqueName: \"kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.133153 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.166423 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-85c5b68669-ljc9x"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.167465 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" podUID="cecb25e5-59fd-4adf-b38b-c0f36e711c0f" containerName="keystone-api" containerID="cri-o://5304de44ce101b82147ad2b4ad0a44667ae2301091073c255c33cc1513cd7c04" gracePeriod=30 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.184857 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.205354 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4v45s"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.215048 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_a76ed59b-2b28-4f4b-bac2-8e4fbdca2607/ovsdbserver-sb/0.log" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.215126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"a76ed59b-2b28-4f4b-bac2-8e4fbdca2607","Type":"ContainerDied","Data":"1b3ad52197bc10ecb54fad2d9e894942092776a84f76eec3f65ba10983b7f034"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.215169 4769 scope.go:117] "RemoveContainer" containerID="09166ec9c62fa77d0613bc7dadc17139475d45c65088a2c6159406d713c6b7c6" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.215267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.220306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.226960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.234641 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-1c88-account-create-2mqhl"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.238871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.238972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qwg4s\" (UniqueName: \"kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.239052 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.239072 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.239088 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.239105 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:35.739091461 +0000 UTC m=+4914.439753279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : configmap "openstack-scripts" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.242969 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4v45s"] Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.244970 4769 projected.go:194] Error preparing data for projected volume kube-api-access-qwg4s for pod openstack-kuttl-tests/keystone1c88-account-delete-9z4jh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.245055 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:35.745034061 +0000 UTC m=+4914.445695949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qwg4s" (UniqueName: "kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.246669 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerID="3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.246730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerDied","Data":"3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.255587 4769 generic.go:334] "Generic (PLEG): container finished" podID="35639d56-6b05-4c44-b344-8c4834e12841" containerID="52bf814fc8e211a8b34844fdf5223234505ecd39743ed8295ab6031c097ee316" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.255661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"35639d56-6b05-4c44-b344-8c4834e12841","Type":"ContainerDied","Data":"52bf814fc8e211a8b34844fdf5223234505ecd39743ed8295ab6031c097ee316"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.258810 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-1c88-account-create-2mqhl"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.260718 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerID="a820fbd57cdb5145022fa3dcb67dbd197e305982f91310287aac8ebf4ac783cb" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.260745 4769 generic.go:334] "Generic (PLEG): container finished" podID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerID="9ea1222a4763b5e1922a4ecec40f631471cbe0ccb62a1f4746700fe65bbc4bb0" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.260788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" event={"ID":"8bebf004-4bd2-427b-aeb6-0d1d4199caae","Type":"ContainerDied","Data":"a820fbd57cdb5145022fa3dcb67dbd197e305982f91310287aac8ebf4ac783cb"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.260816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" event={"ID":"8bebf004-4bd2-427b-aeb6-0d1d4199caae","Type":"ContainerDied","Data":"9ea1222a4763b5e1922a4ecec40f631471cbe0ccb62a1f4746700fe65bbc4bb0"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.263174 4769 generic.go:334] "Generic (PLEG): container finished" podID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerID="57298bda3155381200ae1e6bb49a3c4f0a2c270e76442b8ba3ecf230459a769f" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.263235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" event={"ID":"9e7628da-ebf2-4650-ab67-7636546fdf65","Type":"ContainerDied","Data":"57298bda3155381200ae1e6bb49a3c4f0a2c270e76442b8ba3ecf230459a769f"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.265607 4769 generic.go:334] "Generic (PLEG): container finished" podID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerID="aafcb2fe94defa7138324db37ddfa0cc79921bf4dc7287a684357415cbc47472" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.265647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" event={"ID":"347ea447-ef20-4550-8ad9-be274e65ad9e","Type":"ContainerDied","Data":"aafcb2fe94defa7138324db37ddfa0cc79921bf4dc7287a684357415cbc47472"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.269669 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone1c88-account-delete-9z4jh"] Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.270648 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qwg4s operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" podUID="4640235d-af3d-4c48-b378-efc21e7c4fe8" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.272328 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_852be43e-77fe-4edf-ba14-fe226cfce274/ovsdbserver-nb/0.log" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.272453 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.273005 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"852be43e-77fe-4edf-ba14-fe226cfce274","Type":"ContainerDied","Data":"6aaf4255cf71c9bb94ce80912bb8fec5a1fe5ddd1d36afc62f44c577c5ecd229"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.276056 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.281113 4769 generic.go:334] "Generic (PLEG): container finished" podID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerID="9dc68326152be9bd2c48a2f30bf8f8a5af426c719d8801fcd2d52d97fe61fa30" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.281138 4769 generic.go:334] "Generic (PLEG): container finished" podID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerID="d4dc361bd50cbe266d391c6230f55fa8659ee1b068a5be6a0c8fd280a970c3c2" exitCode=2 Nov 21 13:12:35 crc kubenswrapper[4769]: W1121 13:12:35.285608 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9d55e43_3709_48bb_80d3_490d8418422e.slice/crio-7a83981b9acc700569ccf3a36d06029bf63373017c3a483b75343a0acec238e2 WatchSource:0}: Error finding container 7a83981b9acc700569ccf3a36d06029bf63373017c3a483b75343a0acec238e2: Status 404 returned error can't find the container with id 7a83981b9acc700569ccf3a36d06029bf63373017c3a483b75343a0acec238e2 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.286315 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="174d4344-c28a-4ec2-bd00-9562557ed4bc" path="/var/lib/kubelet/pods/174d4344-c28a-4ec2-bd00-9562557ed4bc/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.286933 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="480cabd9-af74-4901-b68a-0c45bef090f5" path="/var/lib/kubelet/pods/480cabd9-af74-4901-b68a-0c45bef090f5/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.288050 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c942925-3923-4f5e-ac7e-a1cfaeaad438" path="/var/lib/kubelet/pods/4c942925-3923-4f5e-ac7e-a1cfaeaad438/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.288617 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d7b6f0e-c00f-41d0-a40c-b2778737bd01" path="/var/lib/kubelet/pods/4d7b6f0e-c00f-41d0-a40c-b2778737bd01/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.289784 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="612ef882-152a-4bb0-9abb-93354e9eecf6" path="/var/lib/kubelet/pods/612ef882-152a-4bb0-9abb-93354e9eecf6/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.290254 4769 generic.go:334] "Generic (PLEG): container finished" podID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerID="8bfef00943a48dc5e1d8712c382f942d89bcf93b1d416023c5df7398aa0f5826" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.290534 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79d74527-af39-47db-bf0c-cbc8279db923" path="/var/lib/kubelet/pods/79d74527-af39-47db-bf0c-cbc8279db923/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.291322 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5ee83a-68a6-403a-ba3b-9a0ec176f548" path="/var/lib/kubelet/pods/9f5ee83a-68a6-403a-ba3b-9a0ec176f548/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.292320 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a88ab4e8-0911-46cc-b88d-8c9b4870ed31" path="/var/lib/kubelet/pods/a88ab4e8-0911-46cc-b88d-8c9b4870ed31/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.292892 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9947afc-b1ba-486e-be88-83ba66751c37" path="/var/lib/kubelet/pods/a9947afc-b1ba-486e-be88-83ba66751c37/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.293452 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3bfa54a-e28e-4914-8cff-800df74c7a21" path="/var/lib/kubelet/pods/c3bfa54a-e28e-4914-8cff-800df74c7a21/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.294039 4769 generic.go:334] "Generic (PLEG): container finished" podID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerID="01fc349f22783f08743b711022c71ba577b7b162773d7722adb2fde2c56261c6" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.294903 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf189434-e3fa-4580-8375-2558a80d4110" path="/var/lib/kubelet/pods/cf189434-e3fa-4580-8375-2558a80d4110/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.295482 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b05393-7377-44ab-85d2-ac8a93060492" path="/var/lib/kubelet/pods/d6b05393-7377-44ab-85d2-ac8a93060492/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: W1121 13:12:35.296486 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb54832c_1b96_4cc7_adf2_1dc47bda6fdd.slice/crio-e252314009ac14d5c2fd9739f275f69029a47861b8158427045066ef3a420199 WatchSource:0}: Error finding container e252314009ac14d5c2fd9739f275f69029a47861b8158427045066ef3a420199: Status 404 returned error can't find the container with id e252314009ac14d5c2fd9739f275f69029a47861b8158427045066ef3a420199 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.299855 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81" path="/var/lib/kubelet/pods/d8eee5a6-1da4-49e7-8b34-8a3fbf00bc81/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.300518 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f012a00e-b09d-4c32-9308-b225a8d17807" path="/var/lib/kubelet/pods/f012a00e-b09d-4c32-9308-b225a8d17807/volumes" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.313162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.322680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335462 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335517 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335526 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335535 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335541 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335547 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335554 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335579 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.335588 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.341284 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.341299 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.341310 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.343124 4769 generic.go:334] "Generic (PLEG): container finished" podID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" containerID="8b0b2bef3262c86bca0f9052cf9d437111d150487a08e9f093775c05d3716716" exitCode=137 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.348114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" (UID: "a76ed59b-2b28-4f4b-bac2-8e4fbdca2607"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.361203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "852be43e-77fe-4edf-ba14-fe226cfce274" (UID: "852be43e-77fe-4edf-ba14-fe226cfce274"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.363275 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerID="6edfc81cd3befd0a3b3f3414ada3d4fd0e7a79eacffd642f5a5c8b38558ae6b2" exitCode=0 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.382821 4769 generic.go:334] "Generic (PLEG): container finished" podID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerID="2a4609450f8a9194b63550d4f501e76842cb87df6e87a7722dc004333a5a469c" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.391914 4769 generic.go:334] "Generic (PLEG): container finished" podID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerID="921af3a8df3310b4a813a396eeafa4a47e71d25f38d2695db22f35ded27941b5" exitCode=143 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.393728 4769 generic.go:334] "Generic (PLEG): container finished" podID="f073b942-59a2-4273-bd2c-fa4039a573bf" containerID="518ea2dd9cf4cfc354793ae836c42ce25b9409750594dec001c8a6f3eb456bf2" exitCode=2 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.396508 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.173:8080/healthcheck\": dial tcp 10.217.1.173:8080: connect: connection refused" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.396519 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.173:8080/healthcheck\": dial tcp 10.217.1.173:8080: connect: connection refused" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.443585 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.443649 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/852be43e-77fe-4edf-ba14-fe226cfce274-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.446448 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="galera" containerID="cri-o://9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31" gracePeriod=30 Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.532340 4769 scope.go:117] "RemoveContainer" containerID="721d6911a1b3ec564dc67fa869793d0b76441f9ba55852b8ac8fa47a47dbc90c" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.552263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerDied","Data":"9dc68326152be9bd2c48a2f30bf8f8a5af426c719d8801fcd2d52d97fe61fa30"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.554249 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.554591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerDied","Data":"d4dc361bd50cbe266d391c6230f55fa8659ee1b068a5be6a0c8fd280a970c3c2"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.554828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e185c2f1-e6b7-45df-8977-d343330f24e3","Type":"ContainerDied","Data":"8bfef00943a48dc5e1d8712c382f942d89bcf93b1d416023c5df7398aa0f5826"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.554995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" event={"ID":"bcbe4d3d-cecf-48f5-84c3-436b5442228b","Type":"ContainerDied","Data":"01fc349f22783f08743b711022c71ba577b7b162773d7722adb2fde2c56261c6"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronaaf3-account-delete-4srnv"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555583 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell09288-account-delete-clqgk"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555726 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555751 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance2383-account-delete-q59sz"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.555962 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-wl27m"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604147 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wl27m"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604233 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604282 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" event={"ID":"9d48ea37-164f-4a8b-955d-b3b7416672de","Type":"ContainerDied","Data":"6edfc81cd3befd0a3b3f3414ada3d4fd0e7a79eacffd642f5a5c8b38558ae6b2"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87447b3d-8379-4b3f-8f75-91ea2fc591ea","Type":"ContainerDied","Data":"2a4609450f8a9194b63550d4f501e76842cb87df6e87a7722dc004333a5a469c"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerDied","Data":"921af3a8df3310b4a813a396eeafa4a47e71d25f38d2695db22f35ded27941b5"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f073b942-59a2-4273-bd2c-fa4039a573bf","Type":"ContainerDied","Data":"518ea2dd9cf4cfc354793ae836c42ce25b9409750594dec001c8a6f3eb456bf2"} Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.604478 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.618932 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement1832-account-delete-5fdvd"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.621462 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.636317 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinderff83-account-delete-n49j8"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.686936 4769 scope.go:117] "RemoveContainer" containerID="d51c1c0606b4847e6a8a7725c715a026f637f8e548ff6f2d4587137bf4b3c14a" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.754384 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.758728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config\") pod \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.758807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgqlg\" (UniqueName: \"kubernetes.io/projected/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-kube-api-access-hgqlg\") pod \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.758918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config-secret\") pod \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.759062 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-combined-ca-bundle\") pod \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\" (UID: \"8fa73a6c-74d4-4713-bdcb-13a6ddda7232\") " Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.759491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.759580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qwg4s\" (UniqueName: \"kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.759609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-utilities\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.759635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-catalog-content\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.759722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzntw\" (UniqueName: \"kubernetes.io/projected/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-kube-api-access-mzntw\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.760514 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.760581 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:36.760555879 +0000 UTC m=+4915.461217697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : configmap "openstack-scripts" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.781642 4769 projected.go:194] Error preparing data for projected volume kube-api-access-qwg4s for pod openstack-kuttl-tests/keystone1c88-account-delete-9z4jh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.781732 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:36.781707839 +0000 UTC m=+4915.482369657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwg4s" (UniqueName: "kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.800349 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.818479 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb is running failed: container process not found" containerID="ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.821842 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.827827 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb is running failed: container process not found" containerID="ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.828464 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb is running failed: container process not found" containerID="ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:12:35 crc kubenswrapper[4769]: E1121 13:12:35.828533 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="galera" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.830748 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.838884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-kube-api-access-hgqlg" (OuterVolumeSpecName: "kube-api-access-hgqlg") pod "8fa73a6c-74d4-4713-bdcb-13a6ddda7232" (UID: "8fa73a6c-74d4-4713-bdcb-13a6ddda7232"). InnerVolumeSpecName "kube-api-access-hgqlg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.861105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mzntw\" (UniqueName: \"kubernetes.io/projected/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-kube-api-access-mzntw\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.862459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-utilities\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.862506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-catalog-content\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.862646 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hgqlg\" (UniqueName: \"kubernetes.io/projected/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-kube-api-access-hgqlg\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.862999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-utilities\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.863042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-catalog-content\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.891297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "8fa73a6c-74d4-4713-bdcb-13a6ddda7232" (UID: "8fa73a6c-74d4-4713-bdcb-13a6ddda7232"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.916776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzntw\" (UniqueName: \"kubernetes.io/projected/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-kube-api-access-mzntw\") pod \"redhat-marketplace-wl27m\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.936354 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi558e-account-delete-grnrb"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.941559 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr"] Nov 21 13:12:35 crc kubenswrapper[4769]: I1121 13:12:35.964739 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.022268 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.039434 4769 scope.go:117] "RemoveContainer" containerID="35c9b30387654c1f32651b1cf7f65ac9652dc6e47ad5eff620152c7c2d14fcce" Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.067459 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.067707 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data podName:d9bcbff3-ef6f-466b-81ad-7aa2093adbed nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.067686163 +0000 UTC m=+4918.768347981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data") pod "rabbitmq-cell1-server-0" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.076568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8fa73a6c-74d4-4713-bdcb-13a6ddda7232" (UID: "8fa73a6c-74d4-4713-bdcb-13a6ddda7232"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.162009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.169048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqxh6\" (UniqueName: \"kubernetes.io/projected/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-api-access-qqxh6\") pod \"f073b942-59a2-4273-bd2c-fa4039a573bf\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.169132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-config\") pod \"f073b942-59a2-4273-bd2c-fa4039a573bf\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.169266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-combined-ca-bundle\") pod \"f073b942-59a2-4273-bd2c-fa4039a573bf\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.169341 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-certs\") pod \"f073b942-59a2-4273-bd2c-fa4039a573bf\" (UID: \"f073b942-59a2-4273-bd2c-fa4039a573bf\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.172309 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.184816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-api-access-qqxh6" (OuterVolumeSpecName: "kube-api-access-qqxh6") pod "f073b942-59a2-4273-bd2c-fa4039a573bf" (UID: "f073b942-59a2-4273-bd2c-fa4039a573bf"). InnerVolumeSpecName "kube-api-access-qqxh6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.211340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "f073b942-59a2-4273-bd2c-fa4039a573bf" (UID: "f073b942-59a2-4273-bd2c-fa4039a573bf"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.216304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "8fa73a6c-74d4-4713-bdcb-13a6ddda7232" (UID: "8fa73a6c-74d4-4713-bdcb-13a6ddda7232"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.286582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "f073b942-59a2-4273-bd2c-fa4039a573bf" (UID: "f073b942-59a2-4273-bd2c-fa4039a573bf"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.292225 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.292255 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8fa73a6c-74d4-4713-bdcb-13a6ddda7232-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.292266 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qqxh6\" (UniqueName: \"kubernetes.io/projected/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-api-access-qqxh6\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.292275 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.292336 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.292384 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data podName:67b175f2-3b5a-49a9-a0f5-aec7dafbde5a nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.292370986 +0000 UTC m=+4918.993032804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data") pod "rabbitmq-server-0" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a") : configmap "rabbitmq-config-data" not found Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.315847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f073b942-59a2-4273-bd2c-fa4039a573bf" (UID: "f073b942-59a2-4273-bd2c-fa4039a573bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.412708 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f073b942-59a2-4273-bd2c-fa4039a573bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.436663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" event={"ID":"db54832c-1b96-4cc7-adf2-1dc47bda6fdd","Type":"ContainerStarted","Data":"565966ee53afc9d91096fa79bd3d1606f835596120fa629d84e4032248a6f54d"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.436717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" event={"ID":"db54832c-1b96-4cc7-adf2-1dc47bda6fdd","Type":"ContainerStarted","Data":"e252314009ac14d5c2fd9739f275f69029a47861b8158427045066ef3a420199"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.437402 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.440747 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"f073b942-59a2-4273-bd2c-fa4039a573bf","Type":"ContainerDied","Data":"163928c7a1b4b21bdec964a82866f83e001a0a14a162aa69a91629b9e6b722ca"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.440812 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.459908 4769 generic.go:334] "Generic (PLEG): container finished" podID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerID="c33a4fb05b67693cae37eafcf51039870dc219c0d587c95253161dc96847f64c" exitCode=0 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.459934 4769 generic.go:334] "Generic (PLEG): container finished" podID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerID="1ac6a9cbf9c5bc7dedb94b98cb137524c5869954e18b4face10142a805202d4a" exitCode=0 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.459948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerDied","Data":"c33a4fb05b67693cae37eafcf51039870dc219c0d587c95253161dc96847f64c"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.460008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerDied","Data":"1ac6a9cbf9c5bc7dedb94b98cb137524c5869954e18b4face10142a805202d4a"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.462110 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" podStartSLOduration=4.462086977 podStartE2EDuration="4.462086977s" podCreationTimestamp="2025-11-21 13:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:12:36.448669415 +0000 UTC m=+4915.149331233" watchObservedRunningTime="2025-11-21 13:12:36.462086977 +0000 UTC m=+4915.162748795" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.464138 4769 generic.go:334] "Generic (PLEG): container finished" podID="49dbf016-abc5-4e21-9912-cdac726ea545" containerID="ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb" exitCode=0 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.464213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"49dbf016-abc5-4e21-9912-cdac726ea545","Type":"ContainerDied","Data":"ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.466158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" event={"ID":"eaf5da75-9e8a-4b56-a7d5-5040f624fce0","Type":"ContainerStarted","Data":"836584f49dd8d9576f4dd962dbcb6a66f1ded4a323edb1eae206675e56094067"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.469557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" event={"ID":"8bebf004-4bd2-427b-aeb6-0d1d4199caae","Type":"ContainerDied","Data":"a30679d3f8e223584ac526340544319f2ffafb348128a5a6208292511fbd8dc5"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.469608 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a30679d3f8e223584ac526340544319f2ffafb348128a5a6208292511fbd8dc5" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.471297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" event={"ID":"6919fe80-c60f-4450-9a82-e985d9f546e3","Type":"ContainerStarted","Data":"a4a371c213edb7e297ea4fa5e6a143400e44260f561f4425f66372fb119a2c40"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.474121 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" event={"ID":"bb8b5ad1-e875-465a-bdf2-5f990e090632","Type":"ContainerStarted","Data":"3098a295db0a397399ed9283a2f26629e2e38cb2e2a33dc66074528502998aad"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.489766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" event={"ID":"158a329a-0904-43dd-b3da-b010701dcef0","Type":"ContainerStarted","Data":"f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.489815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" event={"ID":"158a329a-0904-43dd-b3da-b010701dcef0","Type":"ContainerStarted","Data":"30ae4d9367906c5b0a6b00da00bee1019cfa516777d9bf033b97c4ff43505a18"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.490736 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.490776 4769 scope.go:117] "RemoveContainer" containerID="f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.493905 4769 generic.go:334] "Generic (PLEG): container finished" podID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" containerID="fbc8e22d3500b60d401be82ddb82650923ba7c1a02ac9f6b4280c500a79c6304" exitCode=0 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.494035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6","Type":"ContainerDied","Data":"fbc8e22d3500b60d401be82ddb82650923ba7c1a02ac9f6b4280c500a79c6304"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.494063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6","Type":"ContainerDied","Data":"9c0a592539bf600bea79ae7a7eebd5f07bf4f08cc04f41f5e431a197d60c2e30"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.494074 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c0a592539bf600bea79ae7a7eebd5f07bf4f08cc04f41f5e431a197d60c2e30" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.499576 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.503666 4769 generic.go:334] "Generic (PLEG): container finished" podID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerID="f63fe298f700ed50962ee3c96c267c7bfb9e133c569147b8f69e659d7e970d62" exitCode=1 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.503827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" event={"ID":"269e95b2-5877-4a8e-a661-4cf7270f215d","Type":"ContainerDied","Data":"f63fe298f700ed50962ee3c96c267c7bfb9e133c569147b8f69e659d7e970d62"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.503860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" event={"ID":"269e95b2-5877-4a8e-a661-4cf7270f215d","Type":"ContainerStarted","Data":"c277e56da0ddc7d74c475a4b97ce675b09cba94bca40e22d7e25fcf127d122bb"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.504525 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.504580 4769 scope.go:117] "RemoveContainer" containerID="f63fe298f700ed50962ee3c96c267c7bfb9e133c569147b8f69e659d7e970d62" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.517398 4769 generic.go:334] "Generic (PLEG): container finished" podID="c9d55e43-3709-48bb-80d3-490d8418422e" containerID="66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca" exitCode=1 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.517740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" event={"ID":"c9d55e43-3709-48bb-80d3-490d8418422e","Type":"ContainerDied","Data":"66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.517873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" event={"ID":"c9d55e43-3709-48bb-80d3-490d8418422e","Type":"ContainerStarted","Data":"7a83981b9acc700569ccf3a36d06029bf63373017c3a483b75343a0acec238e2"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.518150 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.518211 4769 scope.go:117] "RemoveContainer" containerID="66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.533648 4769 generic.go:334] "Generic (PLEG): container finished" podID="e7403ff5-3219-4017-9736-d92812125520" containerID="9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31" exitCode=0 Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.533761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"e7403ff5-3219-4017-9736-d92812125520","Type":"ContainerDied","Data":"9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31"} Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.536328 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.536516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" event={"ID":"b61a670b-7dd5-4560-8b17-57044f1ea44b","Type":"ContainerStarted","Data":"bd84a27695bc560fae54b5c6622a7e713af0edb89fc2ca07dd1402e9e6429ca3"} Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.618978 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619016 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619055 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts podName:269e95b2-5877-4a8e-a661-4cf7270f215d nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.119035965 +0000 UTC m=+4915.819697783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts") pod "barbicanb23d-account-delete-5p6qv" (UID: "269e95b2-5877-4a8e-a661-4cf7270f215d") : configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619099 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts podName:158a329a-0904-43dd-b3da-b010701dcef0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.119078436 +0000 UTC m=+4915.819740254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts") pod "glance2383-account-delete-q59sz" (UID: "158a329a-0904-43dd-b3da-b010701dcef0") : configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619130 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619152 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts podName:c9d55e43-3709-48bb-80d3-490d8418422e nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.119145888 +0000 UTC m=+4915.819807696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts") pod "novacell09288-account-delete-clqgk" (UID: "c9d55e43-3709-48bb-80d3-490d8418422e") : configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619290 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.619350 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts podName:db54832c-1b96-4cc7-adf2-1dc47bda6fdd nodeName:}" failed. No retries permitted until 2025-11-21 13:12:37.119334083 +0000 UTC m=+4915.819995901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts") pod "neutronaaf3-account-delete-4srnv" (UID: "db54832c-1b96-4cc7-adf2-1dc47bda6fdd") : configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.700507 4769 scope.go:117] "RemoveContainer" containerID="518ea2dd9cf4cfc354793ae836c42ce25b9409750594dec001c8a6f3eb456bf2" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.822316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.822408 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qwg4s\" (UniqueName: \"kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.822936 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.822980 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.822967809 +0000 UTC m=+4917.523629627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : configmap "openstack-scripts" not found Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.824307 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.829145 4769 projected.go:194] Error preparing data for projected volume kube-api-access-qwg4s for pod openstack-kuttl-tests/keystone1c88-account-delete-9z4jh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:36 crc kubenswrapper[4769]: E1121 13:12:36.829411 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.829392472 +0000 UTC m=+4917.530054290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwg4s" (UniqueName: "kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.861687 4769 scope.go:117] "RemoveContainer" containerID="8b0b2bef3262c86bca0f9052cf9d437111d150487a08e9f093775c05d3716716" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.877504 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.888401 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.913321 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-combined-ca-bundle\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-config-data\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924131 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-public-tls-certs\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-run-httpd\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924252 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqcmk\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-kube-api-access-kqcmk\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924305 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-etc-swift\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-internal-tls-certs\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.924386 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-log-httpd\") pod \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\" (UID: \"8bebf004-4bd2-427b-aeb6-0d1d4199caae\") " Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.925032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.925554 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.930396 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.936556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.936687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-kube-api-access-kqcmk" (OuterVolumeSpecName: "kube-api-access-kqcmk") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "kube-api-access-kqcmk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:36 crc kubenswrapper[4769]: I1121 13:12:36.970590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-wl27m"] Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.012085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.012560 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.27:5671: connect: connection refused" Nov 21 13:12:37 crc kubenswrapper[4769]: W1121 13:12:37.016116 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3df8f87_5d5f_49b6_9b8f_e66ba3a39d38.slice/crio-2f29e2e5fc6208636af0af9b9c9baf018d83d1b801f3c93409fea5c7511e6cbc WatchSource:0}: Error finding container 2f29e2e5fc6208636af0af9b9c9baf018d83d1b801f3c93409fea5c7511e6cbc: Status 404 returned error can't find the container with id 2f29e2e5fc6208636af0af9b9c9baf018d83d1b801f3c93409fea5c7511e6cbc Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.020169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.022621 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-operator-scripts\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghlrp\" (UniqueName: \"kubernetes.io/projected/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-kube-api-access-ghlrp\") pod \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-combined-ca-bundle\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-nova-novncproxy-tls-certs\") pod \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027446 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-galera-tls-certs\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027526 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-generated\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-config-data\") pod \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-vencrypt-tls-certs\") pod \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-default\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.027684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-kolla-config\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.028364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.029604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.031825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-combined-ca-bundle\") pod \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\" (UID: \"a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.031902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clqpc\" (UniqueName: \"kubernetes.io/projected/49dbf016-abc5-4e21-9912-cdac726ea545-kube-api-access-clqpc\") pod \"49dbf016-abc5-4e21-9912-cdac726ea545\" (UID: \"49dbf016-abc5-4e21-9912-cdac726ea545\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.032337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.032832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.032940 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.032990 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:41.032974686 +0000 UTC m=+4919.733636504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-internal-svc" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.033087 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.033120 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.033135 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kqcmk\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-kube-api-access-kqcmk\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.033147 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/8bebf004-4bd2-427b-aeb6-0d1d4199caae-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.033161 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.033175 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.037729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-kube-api-access-ghlrp" (OuterVolumeSpecName: "kube-api-access-ghlrp") pod "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" (UID: "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6"). InnerVolumeSpecName "kube-api-access-ghlrp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.038335 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.038376 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.038427 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.038475 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:41.038456934 +0000 UTC m=+4919.739118842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "combined-ca-bundle" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.039443 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8bebf004-4bd2-427b-aeb6-0d1d4199caae-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.039518 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs podName:e185c2f1-e6b7-45df-8977-d343330f24e3 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:41.039508042 +0000 UTC m=+4919.740169970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs") pod "nova-api-0" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3") : secret "cert-nova-public-svc" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.042723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-config-data" (OuterVolumeSpecName: "config-data") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.042757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49dbf016-abc5-4e21-9912-cdac726ea545-kube-api-access-clqpc" (OuterVolumeSpecName: "kube-api-access-clqpc") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "kube-api-access-clqpc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.079183 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.095115 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144109 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-config-data\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-sg-core-conf-yaml\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-run-httpd\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144358 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-log-httpd\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-ceilometer-tls-certs\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr4nt\" (UniqueName: \"kubernetes.io/projected/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-kube-api-access-hr4nt\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144563 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-combined-ca-bundle\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-scripts\") pod \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\" (UID: \"7502cfa7-e853-47c6-b98e-3d9d38c25cf1\") " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144978 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/49dbf016-abc5-4e21-9912-cdac726ea545-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.144989 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ghlrp\" (UniqueName: \"kubernetes.io/projected/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-kube-api-access-ghlrp\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.145008 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.145018 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/49dbf016-abc5-4e21-9912-cdac726ea545-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.145027 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.145036 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-clqpc\" (UniqueName: \"kubernetes.io/projected/49dbf016-abc5-4e21-9912-cdac726ea545-kube-api-access-clqpc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.145924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.145978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146057 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146097 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts podName:db54832c-1b96-4cc7-adf2-1dc47bda6fdd nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.146083153 +0000 UTC m=+4916.846744971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts") pod "neutronaaf3-account-delete-4srnv" (UID: "db54832c-1b96-4cc7-adf2-1dc47bda6fdd") : configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146414 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146481 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146528 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146490 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts podName:158a329a-0904-43dd-b3da-b010701dcef0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.146472134 +0000 UTC m=+4916.847133952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts") pod "glance2383-account-delete-q59sz" (UID: "158a329a-0904-43dd-b3da-b010701dcef0") : configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146581 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts podName:c9d55e43-3709-48bb-80d3-490d8418422e nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.146563566 +0000 UTC m=+4916.847225384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts") pod "novacell09288-account-delete-clqgk" (UID: "c9d55e43-3709-48bb-80d3-490d8418422e") : configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.146596 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts podName:269e95b2-5877-4a8e-a661-4cf7270f215d nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.146589357 +0000 UTC m=+4916.847251175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts") pod "barbicanb23d-account-delete-5p6qv" (UID: "269e95b2-5877-4a8e-a661-4cf7270f215d") : configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.156462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" (UID: "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.163224 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-scripts" (OuterVolumeSpecName: "scripts") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.164032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-kube-api-access-hr4nt" (OuterVolumeSpecName: "kube-api-access-hr4nt") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "kube-api-access-hr4nt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.194327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8bebf004-4bd2-427b-aeb6-0d1d4199caae" (UID: "8bebf004-4bd2-427b-aeb6-0d1d4199caae"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.215644 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252238 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252325 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bebf004-4bd2-427b-aeb6-0d1d4199caae-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252424 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hr4nt\" (UniqueName: \"kubernetes.io/projected/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-kube-api-access-hr4nt\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252440 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252493 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252507 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.252518 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.290034 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="852be43e-77fe-4edf-ba14-fe226cfce274" path="/var/lib/kubelet/pods/852be43e-77fe-4edf-ba14-fe226cfce274/volumes" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.290862 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa73a6c-74d4-4713-bdcb-13a6ddda7232" path="/var/lib/kubelet/pods/8fa73a6c-74d4-4713-bdcb-13a6ddda7232/volumes" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.291791 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76ed59b-2b28-4f4b-bac2-8e4fbdca2607" path="/var/lib/kubelet/pods/a76ed59b-2b28-4f4b-bac2-8e4fbdca2607/volumes" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.293426 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f073b942-59a2-4273-bd2c-fa4039a573bf" path="/var/lib/kubelet/pods/f073b942-59a2-4273-bd2c-fa4039a573bf/volumes" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.471339 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.150:8776/healthcheck\": read tcp 10.217.0.2:36288->10.217.1.150:8776: read: connection reset by peer" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.483523 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.565365 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.28:5671: connect: connection refused" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.574695 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.590070 4769 generic.go:334] "Generic (PLEG): container finished" podID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerID="45adc74c493f83053c338c16259911147510ac30d8eec3af654716733844c05d" exitCode=0 Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.593836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.647390 4769 generic.go:334] "Generic (PLEG): container finished" podID="983d3297-af3a-447c-ac21-4150a0626907" containerID="85e87dc518b24c4ec2884bd507e742126b310138eccd8a0f39d227ababb6622f" exitCode=0 Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.657899 4769 generic.go:334] "Generic (PLEG): container finished" podID="158a329a-0904-43dd-b3da-b010701dcef0" containerID="f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66" exitCode=1 Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.658877 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.667617 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.682310 4769 generic.go:334] "Generic (PLEG): container finished" podID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerID="5401fd97b2ef48dbfc2b5d69640565cfb88f8988e3d56328b99afea808b67beb" exitCode=0 Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.687885 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.687937 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts podName:eaf5da75-9e8a-4b56-a7d5-5040f624fce0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.18792346 +0000 UTC m=+4916.888585278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts") pod "cinderff83-account-delete-n49j8" (UID: "eaf5da75-9e8a-4b56-a7d5-5040f624fce0") : configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.694173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" (UID: "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.694568 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" podStartSLOduration=5.694553469 podStartE2EDuration="5.694553469s" podCreationTimestamp="2025-11-21 13:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:12:37.675346221 +0000 UTC m=+4916.376008039" watchObservedRunningTime="2025-11-21 13:12:37.694553469 +0000 UTC m=+4916.395215287" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.721125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-config-data" (OuterVolumeSpecName: "config-data") pod "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" (UID: "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.723475 4769 generic.go:334] "Generic (PLEG): container finished" podID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerID="565966ee53afc9d91096fa79bd3d1606f835596120fa629d84e4032248a6f54d" exitCode=1 Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.723922 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.723951 4769 scope.go:117] "RemoveContainer" containerID="565966ee53afc9d91096fa79bd3d1606f835596120fa629d84e4032248a6f54d" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.740414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" (UID: "a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.743323 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" podStartSLOduration=5.743303772 podStartE2EDuration="5.743303772s" podCreationTimestamp="2025-11-21 13:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:12:37.691862216 +0000 UTC m=+4916.392524044" watchObservedRunningTime="2025-11-21 13:12:37.743303772 +0000 UTC m=+4916.443965650" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.750575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.786658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "49dbf016-abc5-4e21-9912-cdac726ea545" (UID: "49dbf016-abc5-4e21-9912-cdac726ea545"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.790392 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.790429 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.790443 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/49dbf016-abc5-4e21-9912-cdac726ea545-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.790452 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.790463 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.794114 4769 generic.go:334] "Generic (PLEG): container finished" podID="554020cb-5fc6-4185-940f-4210d7c58422" containerID="a2935a55a0c5f438e8f50cb9b12402f1525361c791e6198d99d3c7813f69f9d1" exitCode=0 Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.810081 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.810274 4769 scope.go:117] "RemoveContainer" containerID="93cb8ebf8b14dcfa4999d829b651de90764c395c2a73faadb3b04a008c495ee9" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.810649 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-delete\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-delete pod=novacell09288-account-delete-clqgk_openstack-kuttl-tests(c9d55e43-3709-48bb-80d3-490d8418422e)\"" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.822016 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.824559 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.845090 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.845628 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.846110 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.930830 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: E1121 13:12:37.931218 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts podName:bb8b5ad1-e875-465a-bdf2-5f990e090632 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:38.431202984 +0000 UTC m=+4917.131864792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts") pod "novaapi558e-account-delete-grnrb" (UID: "bb8b5ad1-e875-465a-bdf2-5f990e090632") : configmap "openstack-scripts" not found Nov 21 13:12:37 crc kubenswrapper[4769]: I1121 13:12:37.982466 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" podStartSLOduration=4.982441795 podStartE2EDuration="4.982441795s" podCreationTimestamp="2025-11-21 13:12:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:12:37.893598511 +0000 UTC m=+4916.594260329" watchObservedRunningTime="2025-11-21 13:12:37.982441795 +0000 UTC m=+4916.683103613" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.002445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-config-data" (OuterVolumeSpecName: "config-data") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.034073 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.035366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.138292 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.146020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7502cfa7-e853-47c6-b98e-3d9d38c25cf1" (UID: "7502cfa7-e853-47c6-b98e-3d9d38c25cf1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.158344 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": read tcp 10.217.0.2:43808->10.217.1.159:9311: read: connection reset by peer" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.158567 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.159:9311/healthcheck\": read tcp 10.217.0.2:43816->10.217.1.159:9311: read: connection reset by peer" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.245687 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7502cfa7-e853-47c6-b98e-3d9d38c25cf1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.245767 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.245816 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts podName:158a329a-0904-43dd-b3da-b010701dcef0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.245798489 +0000 UTC m=+4918.946460307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts") pod "glance2383-account-delete-q59sz" (UID: "158a329a-0904-43dd-b3da-b010701dcef0") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.246280 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.246378 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts podName:eaf5da75-9e8a-4b56-a7d5-5040f624fce0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:39.246355514 +0000 UTC m=+4917.947017382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts") pod "cinderff83-account-delete-n49j8" (UID: "eaf5da75-9e8a-4b56-a7d5-5040f624fce0") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.246425 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.246452 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts podName:c9d55e43-3709-48bb-80d3-490d8418422e nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.246441057 +0000 UTC m=+4918.947102965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts") pod "novacell09288-account-delete-clqgk" (UID: "c9d55e43-3709-48bb-80d3-490d8418422e") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.246496 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.246525 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts podName:db54832c-1b96-4cc7-adf2-1dc47bda6fdd nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.246517639 +0000 UTC m=+4918.947179557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts") pod "neutronaaf3-account-delete-4srnv" (UID: "db54832c-1b96-4cc7-adf2-1dc47bda6fdd") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.248603 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.248705 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts podName:269e95b2-5877-4a8e-a661-4cf7270f215d nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.248682447 +0000 UTC m=+4918.949344355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts") pod "barbicanb23d-account-delete-5p6qv" (UID: "269e95b2-5877-4a8e-a661-4cf7270f215d") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.458777 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.458846 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts podName:bb8b5ad1-e875-465a-bdf2-5f990e090632 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:39.458830848 +0000 UTC m=+4918.159492666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts") pod "novaapi558e-account-delete-grnrb" (UID: "bb8b5ad1-e875-465a-bdf2-5f990e090632") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.848690 4769 generic.go:334] "Generic (PLEG): container finished" podID="c9d55e43-3709-48bb-80d3-490d8418422e" containerID="93cb8ebf8b14dcfa4999d829b651de90764c395c2a73faadb3b04a008c495ee9" exitCode=1 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.851538 4769 generic.go:334] "Generic (PLEG): container finished" podID="eaf5da75-9e8a-4b56-a7d5-5040f624fce0" containerID="6f5ac43652e5aa7578e8c47de5147f7f997fd7c4101353e1c7121ea7b5a67e3d" exitCode=1 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.852944 4769 generic.go:334] "Generic (PLEG): container finished" podID="cecb25e5-59fd-4adf-b38b-c0f36e711c0f" containerID="5304de44ce101b82147ad2b4ad0a44667ae2301091073c255c33cc1513cd7c04" exitCode=0 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.856203 4769 generic.go:334] "Generic (PLEG): container finished" podID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerID="7577fbf72698fa6c8af8be1a767e1a6e40e38e8c42d5422f22d6212c98e2c87a" exitCode=1 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.856939 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.856986 4769 scope.go:117] "RemoveContainer" containerID="7577fbf72698fa6c8af8be1a767e1a6e40e38e8c42d5422f22d6212c98e2c87a" Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.857456 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-delete\" with CrashLoopBackOff: \"back-off 10s restarting failed container=mariadb-account-delete pod=barbicanb23d-account-delete-5p6qv_openstack-kuttl-tests(269e95b2-5877-4a8e-a661-4cf7270f215d)\"" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.861578 4769 generic.go:334] "Generic (PLEG): container finished" podID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerID="b9847f2b3d0083ef5ef68f7cec090f69da0c6ed2b4bc3f866a1e4ac3c5a41af8" exitCode=0 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.864284 4769 generic.go:334] "Generic (PLEG): container finished" podID="bb8b5ad1-e875-465a-bdf2-5f990e090632" containerID="d5c23eb34ca3b41182a525d7ee4ee9177c9ce28074583e0ae5df4d0ad0deb85b" exitCode=1 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.869248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.869392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qwg4s\" (UniqueName: \"kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s\") pod \"keystone1c88-account-delete-9z4jh\" (UID: \"4640235d-af3d-4c48-b378-efc21e7c4fe8\") " pod="openstack-kuttl-tests/keystone1c88-account-delete-9z4jh" Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.870832 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.870876 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:42.870863258 +0000 UTC m=+4921.571525076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.876915 4769 projected.go:194] Error preparing data for projected volume kube-api-access-qwg4s for pod openstack-kuttl-tests/keystone1c88-account-delete-9z4jh: failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.877002 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s podName:4640235d-af3d-4c48-b378-efc21e7c4fe8 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:42.876982043 +0000 UTC m=+4921.577643861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwg4s" (UniqueName: "kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s") pod "keystone1c88-account-delete-9z4jh" (UID: "4640235d-af3d-4c48-b378-efc21e7c4fe8") : failed to fetch token: serviceaccounts "galera-openstack" not found Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.881951 4769 generic.go:334] "Generic (PLEG): container finished" podID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerID="79ef4a73447843fd9a3b1a461f8b1ffd2d6c2a8248e4027f928854962875fb3f" exitCode=0 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.883603 4769 generic.go:334] "Generic (PLEG): container finished" podID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerID="db66bc499117548016d3663ec3a8733b3464af3a068ea1055c43a9cd91cdc128" exitCode=0 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.884803 4769 generic.go:334] "Generic (PLEG): container finished" podID="158a329a-0904-43dd-b3da-b010701dcef0" containerID="0bfc2ed943f742a18984f56c9d1e883ccf1ea60719a7155fd7ce66771efd4397" exitCode=1 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.888824 4769 generic.go:334] "Generic (PLEG): container finished" podID="35639d56-6b05-4c44-b344-8c4834e12841" containerID="322181a90fba9fec78d937f0cf3b317b57434d3663e1ca80ff852cd244cc9693" exitCode=0 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.890612 4769 generic.go:334] "Generic (PLEG): container finished" podID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerID="7a56f3e1f629cd5d33c5600857120f3ad831d7a794c96d067f9437504e993c28" exitCode=0 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.899070 4769 generic.go:334] "Generic (PLEG): container finished" podID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerID="bbb8c6b69af76dc1c0812931127a3e060edeb2007e6b20ff80c4053e0f2b5375" exitCode=1 Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.899657 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" secret="" err="secret \"galera-openstack-dockercfg-ktmdt\" not found" Nov 21 13:12:38 crc kubenswrapper[4769]: I1121 13:12:38.899694 4769 scope.go:117] "RemoveContainer" containerID="bbb8c6b69af76dc1c0812931127a3e060edeb2007e6b20ff80c4053e0f2b5375" Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.989254 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31 is running failed: container process not found" containerID="9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.989780 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.990108 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31 is running failed: container process not found" containerID="9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.990204 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts podName:b61a670b-7dd5-4560-8b17-57044f1ea44b nodeName:}" failed. No retries permitted until 2025-11-21 13:12:39.489825303 +0000 UTC m=+4918.190487121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts") pod "placement1832-account-delete-5fdvd" (UID: "b61a670b-7dd5-4560-8b17-57044f1ea44b") : configmap "openstack-scripts" not found Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.991092 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31 is running failed: container process not found" containerID="9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:12:38 crc kubenswrapper[4769]: E1121 13:12:38.991120 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="galera" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.229755 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.231889 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.233063 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.233105 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.262922 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.265355 4769 kubelet.go:2526] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.992s" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.265493 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.265536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerDied","Data":"45adc74c493f83053c338c16259911147510ac30d8eec3af654716733844c05d"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.265561 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2p5mj"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.265602 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-2p5mj"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.265620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"49dbf016-abc5-4e21-9912-cdac726ea545","Type":"ContainerDied","Data":"eecfecf58ea3d4e053d447da44845a99b1483d45dd726892fd127ed68a8cacd4"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" event={"ID":"6919fe80-c60f-4450-9a82-e985d9f546e3","Type":"ContainerStarted","Data":"7a56f3e1f629cd5d33c5600857120f3ad831d7a794c96d067f9437504e993c28"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266693 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-2383-account-create-sg7tw"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerStarted","Data":"2f29e2e5fc6208636af0af9b9c9baf018d83d1b801f3c93409fea5c7511e6cbc"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"983d3297-af3a-447c-ac21-4150a0626907","Type":"ContainerDied","Data":"85e87dc518b24c4ec2884bd507e742126b310138eccd8a0f39d227ababb6622f"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"983d3297-af3a-447c-ac21-4150a0626907","Type":"ContainerDied","Data":"d2f2948cca4c4068696e7ac691ad4a49a4104f5be8335077266015665bbf40ea"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266748 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2f2948cca4c4068696e7ac691ad4a49a4104f5be8335077266015665bbf40ea" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" event={"ID":"158a329a-0904-43dd-b3da-b010701dcef0","Type":"ContainerDied","Data":"f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" event={"ID":"158a329a-0904-43dd-b3da-b010701dcef0","Type":"ContainerStarted","Data":"0bfc2ed943f742a18984f56c9d1e883ccf1ea60719a7155fd7ce66771efd4397"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" event={"ID":"eaf5da75-9e8a-4b56-a7d5-5040f624fce0","Type":"ContainerStarted","Data":"6f5ac43652e5aa7578e8c47de5147f7f997fd7c4101353e1c7121ea7b5a67e3d"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87447b3d-8379-4b3f-8f75-91ea2fc591ea","Type":"ContainerDied","Data":"5401fd97b2ef48dbfc2b5d69640565cfb88f8988e3d56328b99afea808b67beb"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266818 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-2383-account-create-sg7tw"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266836 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance2383-account-delete-q59sz"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266852 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-9vbvz"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" event={"ID":"db54832c-1b96-4cc7-adf2-1dc47bda6fdd","Type":"ContainerDied","Data":"565966ee53afc9d91096fa79bd3d1606f835596120fa629d84e4032248a6f54d"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266883 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-9vbvz"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"e7403ff5-3219-4017-9736-d92812125520","Type":"ContainerDied","Data":"44c9f8f0570237d34d4a22d2e480da46f918680b91115452d32dced0e0cdedcd"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266907 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement1832-account-delete-5fdvd"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266921 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-1832-account-create-zf699"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" event={"ID":"554020cb-5fc6-4185-940f-4210d7c58422","Type":"ContainerDied","Data":"a2935a55a0c5f438e8f50cb9b12402f1525361c791e6198d99d3c7813f69f9d1"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" event={"ID":"c9d55e43-3709-48bb-80d3-490d8418422e","Type":"ContainerStarted","Data":"93cb8ebf8b14dcfa4999d829b651de90764c395c2a73faadb3b04a008c495ee9"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7502cfa7-e853-47c6-b98e-3d9d38c25cf1","Type":"ContainerDied","Data":"234dde112f5100d71a80f803c5d889afd39fe109dd1f176c4085d8639b7b4bd4"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" event={"ID":"bb8b5ad1-e875-465a-bdf2-5f990e090632","Type":"ContainerStarted","Data":"d5c23eb34ca3b41182a525d7ee4ee9177c9ce28074583e0ae5df4d0ad0deb85b"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.266992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" event={"ID":"c9d55e43-3709-48bb-80d3-490d8418422e","Type":"ContainerDied","Data":"93cb8ebf8b14dcfa4999d829b651de90764c395c2a73faadb3b04a008c495ee9"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267006 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-1832-account-create-zf699"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" event={"ID":"eaf5da75-9e8a-4b56-a7d5-5040f624fce0","Type":"ContainerDied","Data":"6f5ac43652e5aa7578e8c47de5147f7f997fd7c4101353e1c7121ea7b5a67e3d"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" event={"ID":"cecb25e5-59fd-4adf-b38b-c0f36e711c0f","Type":"ContainerDied","Data":"5304de44ce101b82147ad2b4ad0a44667ae2301091073c255c33cc1513cd7c04"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267056 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-lshv4"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267071 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-lshv4"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"52a8d5cd-1b4e-4654-a190-57fc62882968","Type":"ContainerDied","Data":"de86fb75e70c81c2c20a8ea4b8d36209fa7809ea9f1901494663e4b9b25ddc11"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267098 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de86fb75e70c81c2c20a8ea4b8d36209fa7809ea9f1901494663e4b9b25ddc11" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" event={"ID":"269e95b2-5877-4a8e-a661-4cf7270f215d","Type":"ContainerDied","Data":"7577fbf72698fa6c8af8be1a767e1a6e40e38e8c42d5422f22d6212c98e2c87a"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267129 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronaaf3-account-delete-4srnv"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267144 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e185c2f1-e6b7-45df-8977-d343330f24e3","Type":"ContainerDied","Data":"b9847f2b3d0083ef5ef68f7cec090f69da0c6ed2b4bc3f866a1e4ac3c5a41af8"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" event={"ID":"bb8b5ad1-e875-465a-bdf2-5f990e090632","Type":"ContainerDied","Data":"d5c23eb34ca3b41182a525d7ee4ee9177c9ce28074583e0ae5df4d0ad0deb85b"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267202 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-aaf3-account-create-mc2pj"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" event={"ID":"9e7628da-ebf2-4650-ab67-7636546fdf65","Type":"ContainerDied","Data":"79ef4a73447843fd9a3b1a461f8b1ffd2d6c2a8248e4027f928854962875fb3f"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267243 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7wtrh"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" event={"ID":"9e7628da-ebf2-4650-ab67-7636546fdf65","Type":"ContainerDied","Data":"295ba92e4dd42fb0f0dc26e0842fc3ea44994b27fee003b3bfe99ca1ed550308"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267264 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="295ba92e4dd42fb0f0dc26e0842fc3ea44994b27fee003b3bfe99ca1ed550308" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267277 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-7wtrh"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" event={"ID":"347ea447-ef20-4550-8ad9-be274e65ad9e","Type":"ContainerDied","Data":"db66bc499117548016d3663ec3a8733b3464af3a068ea1055c43a9cd91cdc128"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" event={"ID":"158a329a-0904-43dd-b3da-b010701dcef0","Type":"ContainerDied","Data":"0bfc2ed943f742a18984f56c9d1e883ccf1ea60719a7155fd7ce66771efd4397"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267311 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-b23d-account-create-f45zl"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"35639d56-6b05-4c44-b344-8c4834e12841","Type":"ContainerDied","Data":"322181a90fba9fec78d937f0cf3b317b57434d3663e1ca80ff852cd244cc9693"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267334 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" event={"ID":"6919fe80-c60f-4450-9a82-e985d9f546e3","Type":"ContainerDied","Data":"7a56f3e1f629cd5d33c5600857120f3ad831d7a794c96d067f9437504e993c28"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" event={"ID":"554020cb-5fc6-4185-940f-4210d7c58422","Type":"ContainerDied","Data":"086038a88ddad6217a3704615af13fdd802f0eb2f7bb02b3cd1849e1875cfdfc"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267363 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="086038a88ddad6217a3704615af13fdd802f0eb2f7bb02b3cd1849e1875cfdfc" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"87447b3d-8379-4b3f-8f75-91ea2fc591ea","Type":"ContainerDied","Data":"bdcbfd1ce94d484a05fe52bd5bbe10d1c46c1adf2eab4c7265162a1f2eab4201"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267379 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdcbfd1ce94d484a05fe52bd5bbe10d1c46c1adf2eab4c7265162a1f2eab4201" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" event={"ID":"b61a670b-7dd5-4560-8b17-57044f1ea44b","Type":"ContainerDied","Data":"bbb8c6b69af76dc1c0812931127a3e060edeb2007e6b20ff80c4053e0f2b5375"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267397 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-b23d-account-create-f45zl"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267414 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bbfjf"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267425 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bbfjf"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267436 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-ff83-account-create-pjrnr"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267446 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinderff83-account-delete-n49j8"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267456 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-ff83-account-create-pjrnr"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267466 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-59tqv"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267475 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-59tqv"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267486 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell09288-account-delete-clqgk"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267496 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267505 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9288-account-create-r9x9p"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267516 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-5kbfw"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267529 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-5kbfw"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267541 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi558e-account-delete-grnrb"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267553 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-558e-account-create-hmv5l"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.267563 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-558e-account-create-hmv5l"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.268341 4769 scope.go:117] "RemoveContainer" containerID="6d86dc478e5d5604704d3e263d012febf8e49f3de7ecbb911634831250e5755c" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e7403ff5-3219-4017-9736-d92812125520-config-data-generated\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-galera-tls-certs\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-combined-ca-bundle\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299530 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-config-data-default\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-kolla-config\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-operator-scripts\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qgjl\" (UniqueName: \"kubernetes.io/projected/e7403ff5-3219-4017-9736-d92812125520-kube-api-access-7qgjl\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"e7403ff5-3219-4017-9736-d92812125520\" (UID: \"e7403ff5-3219-4017-9736-d92812125520\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.299925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7403ff5-3219-4017-9736-d92812125520-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.300601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.300992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.301588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.303010 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.303073 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts podName:eaf5da75-9e8a-4b56-a7d5-5040f624fce0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:41.303053861 +0000 UTC m=+4920.003715669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts") pod "cinderff83-account-delete-n49j8" (UID: "eaf5da75-9e8a-4b56-a7d5-5040f624fce0") : configmap "openstack-scripts" not found Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.303847 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.303866 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.303876 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/e7403ff5-3219-4017-9736-d92812125520-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.303887 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/e7403ff5-3219-4017-9736-d92812125520-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.308463 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082d07f1-32ad-4b86-a0df-d03cadc19d40" path="/var/lib/kubelet/pods/082d07f1-32ad-4b86-a0df-d03cadc19d40/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.309242 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11ccf025-4f3b-46f4-9853-8a6db7008c07" path="/var/lib/kubelet/pods/11ccf025-4f3b-46f4-9853-8a6db7008c07/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.310233 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a2ebfe-495d-4429-b763-894dcfc7f6c9" path="/var/lib/kubelet/pods/19a2ebfe-495d-4429-b763-894dcfc7f6c9/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.310951 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c92747c-5699-4802-8c1d-afe79205840d" path="/var/lib/kubelet/pods/3c92747c-5699-4802-8c1d-afe79205840d/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.312461 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53d1c317-3210-468d-a3e9-35a00fb5ac2a" path="/var/lib/kubelet/pods/53d1c317-3210-468d-a3e9-35a00fb5ac2a/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.315114 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5690e3ba-c822-4d9a-bb27-6ec578fc3c20" path="/var/lib/kubelet/pods/5690e3ba-c822-4d9a-bb27-6ec578fc3c20/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.317657 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6026dc8b-c8b7-46ef-8af8-a3902f2db94b" path="/var/lib/kubelet/pods/6026dc8b-c8b7-46ef-8af8-a3902f2db94b/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.319505 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69cfd29a-66d8-4e85-a2a0-46b1d849bc54" path="/var/lib/kubelet/pods/69cfd29a-66d8-4e85-a2a0-46b1d849bc54/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.321626 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7a4145-54f2-4346-9f48-f678f702a24e" path="/var/lib/kubelet/pods/6d7a4145-54f2-4346-9f48-f678f702a24e/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.324483 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78023dc4-0be7-430f-af00-2a55d14d88b4" path="/var/lib/kubelet/pods/78023dc4-0be7-430f-af00-2a55d14d88b4/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.325615 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52c123b-e469-4987-836c-bd30d57e71bc" path="/var/lib/kubelet/pods/a52c123b-e469-4987-836c-bd30d57e71bc/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.326327 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6693c70-1cb4-40a9-96d3-1935284ae324" path="/var/lib/kubelet/pods/a6693c70-1cb4-40a9-96d3-1935284ae324/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.327064 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9dc3feb-5411-4bf4-be54-4ba3a549bf4c" path="/var/lib/kubelet/pods/d9dc3feb-5411-4bf4-be54-4ba3a549bf4c/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.328627 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb2fa88-6221-4ecf-84c3-e6778228e2fd" path="/var/lib/kubelet/pods/efb2fa88-6221-4ecf-84c3-e6778228e2fd/volumes" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.330743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7403ff5-3219-4017-9736-d92812125520-kube-api-access-7qgjl" (OuterVolumeSpecName: "kube-api-access-7qgjl") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "kube-api-access-7qgjl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.338665 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.340808 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.342328 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.342368 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.380773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.391295 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.395474 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.405695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.405973 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7qgjl\" (UniqueName: \"kubernetes.io/projected/e7403ff5-3219-4017-9736-d92812125520-kube-api-access-7qgjl\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.406008 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.406022 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.415937 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.416013 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.430135 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.439850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "e7403ff5-3219-4017-9736-d92812125520" (UID: "e7403ff5-3219-4017-9736-d92812125520"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.507571 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.507635 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts podName:b61a670b-7dd5-4560-8b17-57044f1ea44b nodeName:}" failed. No retries permitted until 2025-11-21 13:12:40.507620172 +0000 UTC m=+4919.208281990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts") pod "placement1832-account-delete-5fdvd" (UID: "b61a670b-7dd5-4560-8b17-57044f1ea44b") : configmap "openstack-scripts" not found Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.507658 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.507670 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:39 crc kubenswrapper[4769]: E1121 13:12:39.507720 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts podName:bb8b5ad1-e875-465a-bdf2-5f990e090632 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:41.507710805 +0000 UTC m=+4920.208372613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts") pod "novaapi558e-account-delete-grnrb" (UID: "bb8b5ad1-e875-465a-bdf2-5f990e090632") : configmap "openstack-scripts" not found Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.507672 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7403ff5-3219-4017-9736-d92812125520-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.556920 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-2229h"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.590762 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.605817 4769 scope.go:117] "RemoveContainer" containerID="ac48d9f9984b1cee79a41b5c7645d746a03e0bb84e83c1e9c351b2f4c24e0edb" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.609133 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-logs\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.609776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-logs" (OuterVolumeSpecName: "logs") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.609917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.610209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-scripts\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.610258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-public-tls-certs\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.610300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-httpd-run\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.610344 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-combined-ca-bundle\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.610428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g9n6\" (UniqueName: \"kubernetes.io/projected/983d3297-af3a-447c-ac21-4150a0626907-kube-api-access-7g9n6\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.610499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-config-data\") pod \"983d3297-af3a-447c-ac21-4150a0626907\" (UID: \"983d3297-af3a-447c-ac21-4150a0626907\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.611346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.616044 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.616076 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/983d3297-af3a-447c-ac21-4150a0626907-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.623879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-scripts" (OuterVolumeSpecName: "scripts") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.624440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.634623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983d3297-af3a-447c-ac21-4150a0626907-kube-api-access-7g9n6" (OuterVolumeSpecName: "kube-api-access-7g9n6") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "kube-api-access-7g9n6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.667392 4769 scope.go:117] "RemoveContainer" containerID="eae5f0d1d90a297afb50c50fde2ed865d7fe1ca832e1efc754bef6fc60f0a2a4" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.682180 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.686759 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.701050 4769 scope.go:117] "RemoveContainer" containerID="f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.717445 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.717464 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.717476 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7g9n6\" (UniqueName: \"kubernetes.io/projected/983d3297-af3a-447c-ac21-4150a0626907-kube-api-access-7g9n6\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.719372 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.808403 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone1c88-account-delete-9z4jh"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.814002 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone1c88-account-delete-9z4jh"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.816935 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.817998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-combined-ca-bundle\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/52a8d5cd-1b4e-4654-a190-57fc62882968-etc-machine-id\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-internal-tls-certs\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-internal-tls-certs\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818099 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlc8k\" (UniqueName: \"kubernetes.io/projected/554020cb-5fc6-4185-940f-4210d7c58422-kube-api-access-nlc8k\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data-custom\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xchb9\" (UniqueName: \"kubernetes.io/projected/52a8d5cd-1b4e-4654-a190-57fc62882968-kube-api-access-xchb9\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818167 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-config-data\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-config-data\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-public-tls-certs\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-public-tls-certs\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsxq4\" (UniqueName: \"kubernetes.io/projected/87447b3d-8379-4b3f-8f75-91ea2fc591ea-kube-api-access-nsxq4\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818372 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-combined-ca-bundle\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.818410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-scripts\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819324 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-scripts\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-internal-tls-certs\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-logs\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-httpd-run\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/52a8d5cd-1b4e-4654-a190-57fc62882968-logs\") pod \"52a8d5cd-1b4e-4654-a190-57fc62882968\" (UID: \"52a8d5cd-1b4e-4654-a190-57fc62882968\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/554020cb-5fc6-4185-940f-4210d7c58422-logs\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-scripts\") pod \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\" (UID: \"87447b3d-8379-4b3f-8f75-91ea2fc591ea\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.819548 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-combined-ca-bundle\") pod \"554020cb-5fc6-4185-940f-4210d7c58422\" (UID: \"554020cb-5fc6-4185-940f-4210d7c58422\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.823982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/52a8d5cd-1b4e-4654-a190-57fc62882968-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.828760 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.828763 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/554020cb-5fc6-4185-940f-4210d7c58422-logs" (OuterVolumeSpecName: "logs") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.829115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a8d5cd-1b4e-4654-a190-57fc62882968-logs" (OuterVolumeSpecName: "logs") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.829124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-logs" (OuterVolumeSpecName: "logs") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.835361 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.840106 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.841425 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.847544 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.854022 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.854892 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.857941 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.871483 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.891609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.891715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-scripts" (OuterVolumeSpecName: "scripts") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.895542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.896357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-scripts" (OuterVolumeSpecName: "scripts") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.898063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554020cb-5fc6-4185-940f-4210d7c58422-kube-api-access-nlc8k" (OuterVolumeSpecName: "kube-api-access-nlc8k") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "kube-api-access-nlc8k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.903960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-scripts" (OuterVolumeSpecName: "scripts") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.917490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.919460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87447b3d-8379-4b3f-8f75-91ea2fc591ea-kube-api-access-nsxq4" (OuterVolumeSpecName: "kube-api-access-nsxq4") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "kube-api-access-nsxq4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7628da-ebf2-4650-ab67-7636546fdf65-logs\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data-custom\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-public-tls-certs\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6z45\" (UniqueName: \"kubernetes.io/projected/9e7628da-ebf2-4650-ab67-7636546fdf65-kube-api-access-h6z45\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-combined-ca-bundle\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.921732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-internal-tls-certs\") pod \"9e7628da-ebf2-4650-ab67-7636546fdf65\" (UID: \"9e7628da-ebf2-4650-ab67-7636546fdf65\") " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922533 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nlc8k\" (UniqueName: \"kubernetes.io/projected/554020cb-5fc6-4185-940f-4210d7c58422-kube-api-access-nlc8k\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922549 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922569 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922600 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nsxq4\" (UniqueName: \"kubernetes.io/projected/87447b3d-8379-4b3f-8f75-91ea2fc591ea-kube-api-access-nsxq4\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922609 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qwg4s\" (UniqueName: \"kubernetes.io/projected/4640235d-af3d-4c48-b378-efc21e7c4fe8-kube-api-access-qwg4s\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922617 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922626 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922637 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4640235d-af3d-4c48-b378-efc21e7c4fe8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922646 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922674 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/87447b3d-8379-4b3f-8f75-91ea2fc591ea-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922683 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/52a8d5cd-1b4e-4654-a190-57fc62882968-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922690 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/554020cb-5fc6-4185-940f-4210d7c58422-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922698 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.922705 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/52a8d5cd-1b4e-4654-a190-57fc62882968-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.925079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7628da-ebf2-4650-ab67-7636546fdf65-logs" (OuterVolumeSpecName: "logs") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.944968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a8d5cd-1b4e-4654-a190-57fc62882968-kube-api-access-xchb9" (OuterVolumeSpecName: "kube-api-access-xchb9") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "kube-api-access-xchb9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.967779 4769 scope.go:117] "RemoveContainer" containerID="9e6f6f7df426930d13a341b33dce6f75b185d1a3932495a030d3fbc251b2ba31" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.969471 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7628da-ebf2-4650-ab67-7636546fdf65-kube-api-access-h6z45" (OuterVolumeSpecName: "kube-api-access-h6z45") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "kube-api-access-h6z45". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.970695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.972475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"e185c2f1-e6b7-45df-8977-d343330f24e3","Type":"ContainerDied","Data":"633c9fc54e4cbc1241712c281e790fc963303d9ad5efb1eb17ecb63c74be4ec6"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.972498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.975939 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.975947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85" event={"ID":"347ea447-ef20-4550-8ad9-be274e65ad9e","Type":"ContainerDied","Data":"303396ce35f05722bc6ae9fe1f722de686efc85e4b06d72b5725085878128a9a"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.978158 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerID="0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f" exitCode=0 Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.978262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerDied","Data":"0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.978282 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"9aeea80a-dfea-4111-a296-461ffc4bc583","Type":"ContainerDied","Data":"e1a4f589a2621dc377f146b4036cabd6c7fbe34d2623ca0d379abb0a530ae7ce"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.978340 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.989663 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.992390 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"35639d56-6b05-4c44-b344-8c4834e12841","Type":"ContainerDied","Data":"929e521243bd913289e2fd611c8fef24138309126318a8bd727d6fcf2c1d2008"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.992481 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.995320 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5fb4445bb6-b7tmz" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.995585 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.996024 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-2229h" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="registry-server" containerID="cri-o://f52b5564b71e505ef3546ff8491a84f27760b29ba01f07a605d03eba3aaa5b85" gracePeriod=2 Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.996312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-85c5b68669-ljc9x" event={"ID":"cecb25e5-59fd-4adf-b38b-c0f36e711c0f","Type":"ContainerDied","Data":"87bb7b889a909fd03f984b8f172470eb45e54f221ab59b602c72ccd07a6406b4"} Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.996380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.997207 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.998108 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-54468579b4-cgdw7" Nov 21 13:12:39 crc kubenswrapper[4769]: I1121 13:12:39.999222 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.021275 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026431 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-combined-ca-bundle\") pod \"35639d56-6b05-4c44-b344-8c4834e12841\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026511 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb649\" (UniqueName: \"kubernetes.io/projected/e185c2f1-e6b7-45df-8977-d343330f24e3-kube-api-access-jb649\") pod \"e185c2f1-e6b7-45df-8977-d343330f24e3\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e185c2f1-e6b7-45df-8977-d343330f24e3-logs\") pod \"e185c2f1-e6b7-45df-8977-d343330f24e3\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-fernet-keys\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fpxd\" (UniqueName: \"kubernetes.io/projected/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-kube-api-access-6fpxd\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026661 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-config-data\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-public-tls-certs\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026813 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs\") pod \"e185c2f1-e6b7-45df-8977-d343330f24e3\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data\") pod \"9aeea80a-dfea-4111-a296-461ffc4bc583\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle\") pod \"e185c2f1-e6b7-45df-8977-d343330f24e3\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-internal-tls-certs\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.026960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbdrx\" (UniqueName: \"kubernetes.io/projected/35639d56-6b05-4c44-b344-8c4834e12841-kube-api-access-pbdrx\") pod \"35639d56-6b05-4c44-b344-8c4834e12841\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-combined-ca-bundle\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/347ea447-ef20-4550-8ad9-be274e65ad9e-logs\") pod \"347ea447-ef20-4550-8ad9-be274e65ad9e\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-scripts\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027202 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35639d56-6b05-4c44-b344-8c4834e12841-logs\") pod \"35639d56-6b05-4c44-b344-8c4834e12841\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027236 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-config-data\") pod \"35639d56-6b05-4c44-b344-8c4834e12841\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027315 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-scripts\") pod \"9aeea80a-dfea-4111-a296-461ffc4bc583\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027356 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-combined-ca-bundle\") pod \"9aeea80a-dfea-4111-a296-461ffc4bc583\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data\") pod \"347ea447-ef20-4550-8ad9-be274e65ad9e\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-credential-keys\") pod \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\" (UID: \"cecb25e5-59fd-4adf-b38b-c0f36e711c0f\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7cml\" (UniqueName: \"kubernetes.io/projected/347ea447-ef20-4550-8ad9-be274e65ad9e-kube-api-access-k7cml\") pod \"347ea447-ef20-4550-8ad9-be274e65ad9e\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.027529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs\") pod \"e185c2f1-e6b7-45df-8977-d343330f24e3\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.028045 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-nova-metadata-tls-certs\") pod \"35639d56-6b05-4c44-b344-8c4834e12841\" (UID: \"35639d56-6b05-4c44-b344-8c4834e12841\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.028103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data-custom\") pod \"347ea447-ef20-4550-8ad9-be274e65ad9e\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.028155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9aeea80a-dfea-4111-a296-461ffc4bc583-etc-machine-id\") pod \"9aeea80a-dfea-4111-a296-461ffc4bc583\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.028223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-combined-ca-bundle\") pod \"347ea447-ef20-4550-8ad9-be274e65ad9e\" (UID: \"347ea447-ef20-4550-8ad9-be274e65ad9e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.028257 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data-custom\") pod \"9aeea80a-dfea-4111-a296-461ffc4bc583\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.029030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-config-data\") pod \"e185c2f1-e6b7-45df-8977-d343330f24e3\" (UID: \"e185c2f1-e6b7-45df-8977-d343330f24e3\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.029079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44g9s\" (UniqueName: \"kubernetes.io/projected/9aeea80a-dfea-4111-a296-461ffc4bc583-kube-api-access-44g9s\") pod \"9aeea80a-dfea-4111-a296-461ffc4bc583\" (UID: \"9aeea80a-dfea-4111-a296-461ffc4bc583\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.030795 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h6z45\" (UniqueName: \"kubernetes.io/projected/9e7628da-ebf2-4650-ab67-7636546fdf65-kube-api-access-h6z45\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.030824 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9e7628da-ebf2-4650-ab67-7636546fdf65-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.030839 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xchb9\" (UniqueName: \"kubernetes.io/projected/52a8d5cd-1b4e-4654-a190-57fc62882968-kube-api-access-xchb9\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.030889 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.031265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e185c2f1-e6b7-45df-8977-d343330f24e3-logs" (OuterVolumeSpecName: "logs") pod "e185c2f1-e6b7-45df-8977-d343330f24e3" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.045552 4769 scope.go:117] "RemoveContainer" containerID="474958df98f4855eb255c24fdce75db8a1252c75676d0498ed9efebdc001dcc7" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.046156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9aeea80a-dfea-4111-a296-461ffc4bc583-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "9aeea80a-dfea-4111-a296-461ffc4bc583" (UID: "9aeea80a-dfea-4111-a296-461ffc4bc583"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.047468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ea447-ef20-4550-8ad9-be274e65ad9e-logs" (OuterVolumeSpecName: "logs") pod "347ea447-ef20-4550-8ad9-be274e65ad9e" (UID: "347ea447-ef20-4550-8ad9-be274e65ad9e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.049349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35639d56-6b05-4c44-b344-8c4834e12841-logs" (OuterVolumeSpecName: "logs") pod "35639d56-6b05-4c44-b344-8c4834e12841" (UID: "35639d56-6b05-4c44-b344-8c4834e12841"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.049675 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.084383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aeea80a-dfea-4111-a296-461ffc4bc583-kube-api-access-44g9s" (OuterVolumeSpecName: "kube-api-access-44g9s") pod "9aeea80a-dfea-4111-a296-461ffc4bc583" (UID: "9aeea80a-dfea-4111-a296-461ffc4bc583"). InnerVolumeSpecName "kube-api-access-44g9s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.118523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.120530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e185c2f1-e6b7-45df-8977-d343330f24e3-kube-api-access-jb649" (OuterVolumeSpecName: "kube-api-access-jb649") pod "e185c2f1-e6b7-45df-8977-d343330f24e3" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3"). InnerVolumeSpecName "kube-api-access-jb649". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.121961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-kube-api-access-6fpxd" (OuterVolumeSpecName: "kube-api-access-6fpxd") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "kube-api-access-6fpxd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.133723 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvn5l\" (UniqueName: \"kubernetes.io/projected/bb8b5ad1-e875-465a-bdf2-5f990e090632-kube-api-access-fvn5l\") pod \"bb8b5ad1-e875-465a-bdf2-5f990e090632\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.134486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bb8b5ad1-e875-465a-bdf2-5f990e090632" (UID: "bb8b5ad1-e875-465a-bdf2-5f990e090632"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.134008 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts\") pod \"bb8b5ad1-e875-465a-bdf2-5f990e090632\" (UID: \"bb8b5ad1-e875-465a-bdf2-5f990e090632\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.134804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/347ea447-ef20-4550-8ad9-be274e65ad9e-kube-api-access-k7cml" (OuterVolumeSpecName: "kube-api-access-k7cml") pod "347ea447-ef20-4550-8ad9-be274e65ad9e" (UID: "347ea447-ef20-4550-8ad9-be274e65ad9e"). InnerVolumeSpecName "kube-api-access-k7cml". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.134961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "347ea447-ef20-4550-8ad9-be274e65ad9e" (UID: "347ea447-ef20-4550-8ad9-be274e65ad9e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-scripts" (OuterVolumeSpecName: "scripts") pod "9aeea80a-dfea-4111-a296-461ffc4bc583" (UID: "9aeea80a-dfea-4111-a296-461ffc4bc583"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135417 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-44g9s\" (UniqueName: \"kubernetes.io/projected/9aeea80a-dfea-4111-a296-461ffc4bc583-kube-api-access-44g9s\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135437 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jb649\" (UniqueName: \"kubernetes.io/projected/e185c2f1-e6b7-45df-8977-d343330f24e3-kube-api-access-jb649\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135447 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e185c2f1-e6b7-45df-8977-d343330f24e3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135460 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135471 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6fpxd\" (UniqueName: \"kubernetes.io/projected/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-kube-api-access-6fpxd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135479 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/347ea447-ef20-4550-8ad9-be274e65ad9e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135488 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/35639d56-6b05-4c44-b344-8c4834e12841-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135496 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135504 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k7cml\" (UniqueName: \"kubernetes.io/projected/347ea447-ef20-4550-8ad9-be274e65ad9e-kube-api-access-k7cml\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135536 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb8b5ad1-e875-465a-bdf2-5f990e090632-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135545 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135553 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/9aeea80a-dfea-4111-a296-461ffc4bc583-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.135557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9aeea80a-dfea-4111-a296-461ffc4bc583" (UID: "9aeea80a-dfea-4111-a296-461ffc4bc583"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.135567 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.135623 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data podName:d9bcbff3-ef6f-466b-81ad-7aa2093adbed nodeName:}" failed. No retries permitted until 2025-11-21 13:12:48.135603949 +0000 UTC m=+4926.836265767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data") pod "rabbitmq-cell1-server-0" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.142348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35639d56-6b05-4c44-b344-8c4834e12841-kube-api-access-pbdrx" (OuterVolumeSpecName: "kube-api-access-pbdrx") pod "35639d56-6b05-4c44-b344-8c4834e12841" (UID: "35639d56-6b05-4c44-b344-8c4834e12841"). InnerVolumeSpecName "kube-api-access-pbdrx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.155340 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.160757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb8b5ad1-e875-465a-bdf2-5f990e090632-kube-api-access-fvn5l" (OuterVolumeSpecName: "kube-api-access-fvn5l") pod "bb8b5ad1-e875-465a-bdf2-5f990e090632" (UID: "bb8b5ad1-e875-465a-bdf2-5f990e090632"). InnerVolumeSpecName "kube-api-access-fvn5l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.166084 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.167082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.171863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-scripts" (OuterVolumeSpecName: "scripts") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.183821 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.194349 4769 scope.go:117] "RemoveContainer" containerID="9dc68326152be9bd2c48a2f30bf8f8a5af426c719d8801fcd2d52d97fe61fa30" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.236283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts\") pod \"158a329a-0904-43dd-b3da-b010701dcef0\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.236566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsvnn\" (UniqueName: \"kubernetes.io/projected/158a329a-0904-43dd-b3da-b010701dcef0-kube-api-access-bsvnn\") pod \"158a329a-0904-43dd-b3da-b010701dcef0\" (UID: \"158a329a-0904-43dd-b3da-b010701dcef0\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.239235 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pbdrx\" (UniqueName: \"kubernetes.io/projected/35639d56-6b05-4c44-b344-8c4834e12841-kube-api-access-pbdrx\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.239257 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.239268 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fvn5l\" (UniqueName: \"kubernetes.io/projected/bb8b5ad1-e875-465a-bdf2-5f990e090632-kube-api-access-fvn5l\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.239277 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.239288 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.240078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "158a329a-0904-43dd-b3da-b010701dcef0" (UID: "158a329a-0904-43dd-b3da-b010701dcef0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.266925 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.285021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158a329a-0904-43dd-b3da-b010701dcef0-kube-api-access-bsvnn" (OuterVolumeSpecName: "kube-api-access-bsvnn") pod "158a329a-0904-43dd-b3da-b010701dcef0" (UID: "158a329a-0904-43dd-b3da-b010701dcef0"). InnerVolumeSpecName "kube-api-access-bsvnn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.290500 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.147:9696/\": dial tcp 10.217.1.147:9696: connect: connection refused" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.343001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts\") pod \"c9d55e43-3709-48bb-80d3-490d8418422e\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.343383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pfk4\" (UniqueName: \"kubernetes.io/projected/c9d55e43-3709-48bb-80d3-490d8418422e-kube-api-access-5pfk4\") pod \"c9d55e43-3709-48bb-80d3-490d8418422e\" (UID: \"c9d55e43-3709-48bb-80d3-490d8418422e\") " Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.343951 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bsvnn\" (UniqueName: \"kubernetes.io/projected/158a329a-0904-43dd-b3da-b010701dcef0-kube-api-access-bsvnn\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.343974 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.343986 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/158a329a-0904-43dd-b3da-b010701dcef0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.344170 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.344248 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts podName:db54832c-1b96-4cc7-adf2-1dc47bda6fdd nodeName:}" failed. No retries permitted until 2025-11-21 13:12:44.344230909 +0000 UTC m=+4923.044892727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts") pod "neutronaaf3-account-delete-4srnv" (UID: "db54832c-1b96-4cc7-adf2-1dc47bda6fdd") : configmap "openstack-scripts" not found Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.345391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c9d55e43-3709-48bb-80d3-490d8418422e" (UID: "c9d55e43-3709-48bb-80d3-490d8418422e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.346570 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.349504 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.349961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d55e43-3709-48bb-80d3-490d8418422e-kube-api-access-5pfk4" (OuterVolumeSpecName: "kube-api-access-5pfk4") pod "c9d55e43-3709-48bb-80d3-490d8418422e" (UID: "c9d55e43-3709-48bb-80d3-490d8418422e"). InnerVolumeSpecName "kube-api-access-5pfk4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.349754 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data podName:67b175f2-3b5a-49a9-a0f5-aec7dafbde5a nodeName:}" failed. No retries permitted until 2025-11-21 13:12:48.349654305 +0000 UTC m=+4927.050316123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data") pod "rabbitmq-server-0" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a") : configmap "rabbitmq-config-data" not found Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.350047 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts podName:269e95b2-5877-4a8e-a661-4cf7270f215d nodeName:}" failed. No retries permitted until 2025-11-21 13:12:44.350022965 +0000 UTC m=+4923.050684883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts") pod "barbicanb23d-account-delete-5p6qv" (UID: "269e95b2-5877-4a8e-a661-4cf7270f215d") : configmap "openstack-scripts" not found Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.381079 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3df8f87_5d5f_49b6_9b8f_e66ba3a39d38.slice/crio-conmon-21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3df8f87_5d5f_49b6_9b8f_e66ba3a39d38.slice/crio-21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.446109 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5pfk4\" (UniqueName: \"kubernetes.io/projected/c9d55e43-3709-48bb-80d3-490d8418422e-kube-api-access-5pfk4\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.446738 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9d55e43-3709-48bb-80d3-490d8418422e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.549017 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:40 crc kubenswrapper[4769]: E1121 13:12:40.549085 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts podName:b61a670b-7dd5-4560-8b17-57044f1ea44b nodeName:}" failed. No retries permitted until 2025-11-21 13:12:42.549070687 +0000 UTC m=+4921.249732505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts") pod "placement1832-account-delete-5fdvd" (UID: "b61a670b-7dd5-4560-8b17-57044f1ea44b") : configmap "openstack-scripts" not found Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.701431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.710905 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.758577 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.758626 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.821316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:40 crc kubenswrapper[4769]: I1121 13:12:40.860702 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.030970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" event={"ID":"c9d55e43-3709-48bb-80d3-490d8418422e","Type":"ContainerDied","Data":"7a83981b9acc700569ccf3a36d06029bf63373017c3a483b75343a0acec238e2"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.031180 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell09288-account-delete-clqgk" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.038464 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.039025 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance2383-account-delete-q59sz" event={"ID":"158a329a-0904-43dd-b3da-b010701dcef0","Type":"ContainerDied","Data":"30ae4d9367906c5b0a6b00da00bee1019cfa516777d9bf033b97c4ff43505a18"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.041277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" event={"ID":"eaf5da75-9e8a-4b56-a7d5-5040f624fce0","Type":"ContainerDied","Data":"836584f49dd8d9576f4dd962dbcb6a66f1ded4a323edb1eae206675e56094067"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.041387 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="836584f49dd8d9576f4dd962dbcb6a66f1ded4a323edb1eae206675e56094067" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.045425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" event={"ID":"bb8b5ad1-e875-465a-bdf2-5f990e090632","Type":"ContainerDied","Data":"3098a295db0a397399ed9283a2f26629e2e38cb2e2a33dc66074528502998aad"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.045579 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi558e-account-delete-grnrb" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.048878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.052871 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerID="21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff" exitCode=0 Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.052921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerDied","Data":"21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.068211 4769 generic.go:334] "Generic (PLEG): container finished" podID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerID="5d26239474a3e16cffea4e7314aafddd0ff19c871879a7013a25f4969633a000" exitCode=0 Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.068337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d9bcbff3-ef6f-466b-81ad-7aa2093adbed","Type":"ContainerDied","Data":"5d26239474a3e16cffea4e7314aafddd0ff19c871879a7013a25f4969633a000"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.080680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerDied","Data":"f52b5564b71e505ef3546ff8491a84f27760b29ba01f07a605d03eba3aaa5b85"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.080661 4769 generic.go:334] "Generic (PLEG): container finished" podID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerID="f52b5564b71e505ef3546ff8491a84f27760b29ba01f07a605d03eba3aaa5b85" exitCode=0 Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.081839 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2229h" event={"ID":"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5","Type":"ContainerDied","Data":"b57e820471895e9d4013feab7f3bac2e4578c914304282358b1f8dffecab1332"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.081962 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b57e820471895e9d4013feab7f3bac2e4578c914304282358b1f8dffecab1332" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.086582 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.087689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" event={"ID":"269e95b2-5877-4a8e-a661-4cf7270f215d","Type":"ContainerDied","Data":"c277e56da0ddc7d74c475a4b97ce675b09cba94bca40e22d7e25fcf127d122bb"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.087724 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c277e56da0ddc7d74c475a4b97ce675b09cba94bca40e22d7e25fcf127d122bb" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.090781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" event={"ID":"b61a670b-7dd5-4560-8b17-57044f1ea44b","Type":"ContainerStarted","Data":"795246d05660705213cd961db3d3ebb6e51d97fc569362d8be3410f401821fc0"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.090921 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" containerID="cri-o://795246d05660705213cd961db3d3ebb6e51d97fc569362d8be3410f401821fc0" gracePeriod=30 Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.099018 4769 generic.go:334] "Generic (PLEG): container finished" podID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerID="0754db392725e02affdf3ebff5c4bdaac236040ded1d213c472ef884b7c69b6e" exitCode=1 Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.099104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" event={"ID":"db54832c-1b96-4cc7-adf2-1dc47bda6fdd","Type":"ContainerDied","Data":"0754db392725e02affdf3ebff5c4bdaac236040ded1d213c472ef884b7c69b6e"} Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.115852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.115862 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" podStartSLOduration=9.115845146 podStartE2EDuration="9.115845146s" podCreationTimestamp="2025-11-21 13:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:12:41.112928347 +0000 UTC m=+4919.813590155" watchObservedRunningTime="2025-11-21 13:12:41.115845146 +0000 UTC m=+4919.816506964" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.187927 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.301901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-config-data" (OuterVolumeSpecName: "config-data") pod "35639d56-6b05-4c44-b344-8c4834e12841" (UID: "35639d56-6b05-4c44-b344-8c4834e12841"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.306989 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "347ea447-ef20-4550-8ad9-be274e65ad9e" (UID: "347ea447-ef20-4550-8ad9-be274e65ad9e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.307746 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.307814 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: E1121 13:12:41.307908 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:41 crc kubenswrapper[4769]: E1121 13:12:41.307980 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts podName:eaf5da75-9e8a-4b56-a7d5-5040f624fce0 nodeName:}" failed. No retries permitted until 2025-11-21 13:12:45.307958562 +0000 UTC m=+4924.008620380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts") pod "cinderff83-account-delete-n49j8" (UID: "eaf5da75-9e8a-4b56-a7d5-5040f624fce0") : configmap "openstack-scripts" not found Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.321552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.326760 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.326833 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.328425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.330406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-config-data" (OuterVolumeSpecName: "config-data") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.335409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.335462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-config-data" (OuterVolumeSpecName: "config-data") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.336528 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4640235d-af3d-4c48-b378-efc21e7c4fe8" path="/var/lib/kubelet/pods/4640235d-af3d-4c48-b378-efc21e7c4fe8/volumes" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.337062 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" path="/var/lib/kubelet/pods/49dbf016-abc5-4e21-9912-cdac726ea545/volumes" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.337812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-config-data" (OuterVolumeSpecName: "config-data") pod "e185c2f1-e6b7-45df-8977-d343330f24e3" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.338262 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" path="/var/lib/kubelet/pods/a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6/volumes" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.340135 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7403ff5-3219-4017-9736-d92812125520" path="/var/lib/kubelet/pods/e7403ff5-3219-4017-9736-d92812125520/volumes" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.346354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.358713 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.358837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.362541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e185c2f1-e6b7-45df-8977-d343330f24e3" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.375550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "35639d56-6b05-4c44-b344-8c4834e12841" (UID: "35639d56-6b05-4c44-b344-8c4834e12841"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410032 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410073 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410085 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410097 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410110 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410124 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410135 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410145 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410156 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410167 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.410178 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.484607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e185c2f1-e6b7-45df-8977-d343330f24e3" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.485100 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data" (OuterVolumeSpecName: "config-data") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.487965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9e7628da-ebf2-4650-ab67-7636546fdf65" (UID: "9e7628da-ebf2-4650-ab67-7636546fdf65"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.488436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data" (OuterVolumeSpecName: "config-data") pod "52a8d5cd-1b4e-4654-a190-57fc62882968" (UID: "52a8d5cd-1b4e-4654-a190-57fc62882968"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.490601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-config-data" (OuterVolumeSpecName: "config-data") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.494623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "35639d56-6b05-4c44-b344-8c4834e12841" (UID: "35639d56-6b05-4c44-b344-8c4834e12841"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.505296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e185c2f1-e6b7-45df-8977-d343330f24e3" (UID: "e185c2f1-e6b7-45df-8977-d343330f24e3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.507662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9aeea80a-dfea-4111-a296-461ffc4bc583" (UID: "9aeea80a-dfea-4111-a296-461ffc4bc583"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.509340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518786 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518833 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518845 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518867 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518883 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/35639d56-6b05-4c44-b344-8c4834e12841-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518895 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518906 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e7628da-ebf2-4650-ab67-7636546fdf65-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518920 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e185c2f1-e6b7-45df-8977-d343330f24e3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.518931 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52a8d5cd-1b4e-4654-a190-57fc62882968-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.522405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data" (OuterVolumeSpecName: "config-data") pod "347ea447-ef20-4550-8ad9-be274e65ad9e" (UID: "347ea447-ef20-4550-8ad9-be274e65ad9e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.532236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cecb25e5-59fd-4adf-b38b-c0f36e711c0f" (UID: "cecb25e5-59fd-4adf-b38b-c0f36e711c0f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.559323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-config-data" (OuterVolumeSpecName: "config-data") pod "87447b3d-8379-4b3f-8f75-91ea2fc591ea" (UID: "87447b3d-8379-4b3f-8f75-91ea2fc591ea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.559457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "983d3297-af3a-447c-ac21-4150a0626907" (UID: "983d3297-af3a-447c-ac21-4150a0626907"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.582517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.597021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "554020cb-5fc6-4185-940f-4210d7c58422" (UID: "554020cb-5fc6-4185-940f-4210d7c58422"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.620315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data" (OuterVolumeSpecName: "config-data") pod "9aeea80a-dfea-4111-a296-461ffc4bc583" (UID: "9aeea80a-dfea-4111-a296-461ffc4bc583"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621219 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621342 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/347ea447-ef20-4550-8ad9-be274e65ad9e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621426 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/87447b3d-8379-4b3f-8f75-91ea2fc591ea-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621501 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/554020cb-5fc6-4185-940f-4210d7c58422-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621639 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/983d3297-af3a-447c-ac21-4150a0626907-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621727 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cecb25e5-59fd-4adf-b38b-c0f36e711c0f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.621798 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9aeea80a-dfea-4111-a296-461ffc4bc583-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.789315 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.168:6080/vnc_lite.html\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.917308 4769 scope.go:117] "RemoveContainer" containerID="d4dc361bd50cbe266d391c6230f55fa8659ee1b068a5be6a0c8fd280a970c3c2" Nov 21 13:12:41 crc kubenswrapper[4769]: I1121 13:12:41.926809 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.006649 4769 scope.go:117] "RemoveContainer" containerID="c33a4fb05b67693cae37eafcf51039870dc219c0d587c95253161dc96847f64c" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.032719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmqcx\" (UniqueName: \"kubernetes.io/projected/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-kube-api-access-bmqcx\") pod \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.033738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts\") pod \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\" (UID: \"eaf5da75-9e8a-4b56-a7d5-5040f624fce0\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.035021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "eaf5da75-9e8a-4b56-a7d5-5040f624fce0" (UID: "eaf5da75-9e8a-4b56-a7d5-5040f624fce0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.042299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-kube-api-access-bmqcx" (OuterVolumeSpecName: "kube-api-access-bmqcx") pod "eaf5da75-9e8a-4b56-a7d5-5040f624fce0" (UID: "eaf5da75-9e8a-4b56-a7d5-5040f624fce0"). InnerVolumeSpecName "kube-api-access-bmqcx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.059409 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.074756 4769 scope.go:117] "RemoveContainer" containerID="1ac6a9cbf9c5bc7dedb94b98cb137524c5869954e18b4face10142a805202d4a" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.110987 4769 generic.go:334] "Generic (PLEG): container finished" podID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerID="e15abbadf3e48c577ca2118a1b46f14868fc0a17cf1a74a3b2c023b947133f5c" exitCode=0 Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.111054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" event={"ID":"bcbe4d3d-cecf-48f5-84c3-436b5442228b","Type":"ContainerDied","Data":"e15abbadf3e48c577ca2118a1b46f14868fc0a17cf1a74a3b2c023b947133f5c"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.112723 4769 generic.go:334] "Generic (PLEG): container finished" podID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerID="03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b" exitCode=0 Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.112773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerDied","Data":"03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.114311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" event={"ID":"db54832c-1b96-4cc7-adf2-1dc47bda6fdd","Type":"ContainerDied","Data":"e252314009ac14d5c2fd9739f275f69029a47861b8158427045066ef3a420199"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.114337 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e252314009ac14d5c2fd9739f275f69029a47861b8158427045066ef3a420199" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.118172 4769 generic.go:334] "Generic (PLEG): container finished" podID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerID="f2e9d93c5241ce1a455f474ad9b632082ce2e117c0bcf9d7d95727dd36b98d63" exitCode=0 Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.118253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a","Type":"ContainerDied","Data":"f2e9d93c5241ce1a455f474ad9b632082ce2e117c0bcf9d7d95727dd36b98d63"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.118286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a","Type":"ContainerDied","Data":"37719618a1b278ab1568e31f187fc214fd2694c7727105c5d81b0220b9fb5c0f"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.118307 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37719618a1b278ab1568e31f187fc214fd2694c7727105c5d81b0220b9fb5c0f" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.120727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" event={"ID":"6919fe80-c60f-4450-9a82-e985d9f546e3","Type":"ContainerStarted","Data":"54fc00a8bf30a0c326304765e15a4f1d196451a370b1d2f6ee676f022617e099"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.120839 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.122536 4769 generic.go:334] "Generic (PLEG): container finished" podID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerID="795246d05660705213cd961db3d3ebb6e51d97fc569362d8be3410f401821fc0" exitCode=1 Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.122578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" event={"ID":"b61a670b-7dd5-4560-8b17-57044f1ea44b","Type":"ContainerDied","Data":"795246d05660705213cd961db3d3ebb6e51d97fc569362d8be3410f401821fc0"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.122594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" event={"ID":"b61a670b-7dd5-4560-8b17-57044f1ea44b","Type":"ContainerDied","Data":"bd84a27695bc560fae54b5c6622a7e713af0edb89fc2ca07dd1402e9e6429ca3"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.122603 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd84a27695bc560fae54b5c6622a7e713af0edb89fc2ca07dd1402e9e6429ca3" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.124857 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"d9bcbff3-ef6f-466b-81ad-7aa2093adbed","Type":"ContainerDied","Data":"be26784bc0e1e80a68099f741d5ebf123609c93dc40811f63737cf6bafad91b5"} Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.124889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.124923 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be26784bc0e1e80a68099f741d5ebf123609c93dc40811f63737cf6bafad91b5" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.124889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinderff83-account-delete-n49j8" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.134741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts\") pod \"269e95b2-5877-4a8e-a661-4cf7270f215d\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.134844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx5g9\" (UniqueName: \"kubernetes.io/projected/269e95b2-5877-4a8e-a661-4cf7270f215d-kube-api-access-rx5g9\") pod \"269e95b2-5877-4a8e-a661-4cf7270f215d\" (UID: \"269e95b2-5877-4a8e-a661-4cf7270f215d\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.135250 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.135275 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bmqcx\" (UniqueName: \"kubernetes.io/projected/eaf5da75-9e8a-4b56-a7d5-5040f624fce0-kube-api-access-bmqcx\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.136141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "269e95b2-5877-4a8e-a661-4cf7270f215d" (UID: "269e95b2-5877-4a8e-a661-4cf7270f215d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.138689 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" podStartSLOduration=9.138672101 podStartE2EDuration="9.138672101s" podCreationTimestamp="2025-11-21 13:12:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:12:42.136589475 +0000 UTC m=+4920.837251313" watchObservedRunningTime="2025-11-21 13:12:42.138672101 +0000 UTC m=+4920.839333919" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.140342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/269e95b2-5877-4a8e-a661-4cf7270f215d-kube-api-access-rx5g9" (OuterVolumeSpecName: "kube-api-access-rx5g9") pod "269e95b2-5877-4a8e-a661-4cf7270f215d" (UID: "269e95b2-5877-4a8e-a661-4cf7270f215d"). InnerVolumeSpecName "kube-api-access-rx5g9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.190901 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.219691 4769 scope.go:117] "RemoveContainer" containerID="66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.245703 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rx5g9\" (UniqueName: \"kubernetes.io/projected/269e95b2-5877-4a8e-a661-4cf7270f215d-kube-api-access-rx5g9\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.245729 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/269e95b2-5877-4a8e-a661-4cf7270f215d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.253962 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.255230 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.265830 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.266669 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.278545 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi558e-account-delete-grnrb"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.284394 4769 scope.go:117] "RemoveContainer" containerID="f63fe298f700ed50962ee3c96c267c7bfb9e133c569147b8f69e659d7e970d62" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.288611 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi558e-account-delete-grnrb"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.296600 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.303808 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7c8db7c54f-9vf85"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.319714 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5fb4445bb6-b7tmz"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.329161 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5fb4445bb6-b7tmz"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.338903 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance2383-account-delete-q59sz"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.351285 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-catalog-content\") pod \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.352179 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-utilities\") pod \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.352422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q89k8\" (UniqueName: \"kubernetes.io/projected/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-kube-api-access-q89k8\") pod \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\" (UID: \"d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.353637 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-utilities" (OuterVolumeSpecName: "utilities") pod "d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" (UID: "d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.357666 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance2383-account-delete-q59sz"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.359504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-kube-api-access-q89k8" (OuterVolumeSpecName: "kube-api-access-q89k8") pod "d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" (UID: "d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5"). InnerVolumeSpecName "kube-api-access-q89k8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.366632 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-54468579b4-cgdw7"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.376840 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-54468579b4-cgdw7"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.383060 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell09288-account-delete-clqgk"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.393380 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell09288-account-delete-clqgk"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.399705 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.405935 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.413290 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.420612 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.435249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.439353 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.442766 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.449338 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.453921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-pod-info\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.453981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.454018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-confd\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.454424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-server-conf\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.454594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-plugins-conf\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.454645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.454893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-erlang-cookie-secret\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.455108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjj59\" (UniqueName: \"kubernetes.io/projected/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-kube-api-access-jjj59\") pod \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.455305 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-erlang-cookie\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.455362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-plugins\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.455392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts\") pod \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\" (UID: \"db54832c-1b96-4cc7-adf2-1dc47bda6fdd\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.455416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-tls\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.455448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kksd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-kube-api-access-2kksd\") pod \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\" (UID: \"d9bcbff3-ef6f-466b-81ad-7aa2093adbed\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.456020 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.456036 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q89k8\" (UniqueName: \"kubernetes.io/projected/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-kube-api-access-q89k8\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.459245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.459257 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.459819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.461635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "db54832c-1b96-4cc7-adf2-1dc47bda6fdd" (UID: "db54832c-1b96-4cc7-adf2-1dc47bda6fdd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.483830 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-kube-api-access-2kksd" (OuterVolumeSpecName: "kube-api-access-2kksd") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "kube-api-access-2kksd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.484129 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "persistence") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.484302 4769 scope.go:117] "RemoveContainer" containerID="f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.487559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.487671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-pod-info" (OuterVolumeSpecName: "pod-info") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.494775 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: E1121 13:12:42.496509 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66\": container with ID starting with f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66 not found: ID does not exist" containerID="f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.496545 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66"} err="failed to get container status \"f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66\": rpc error: code = NotFound desc = could not find container \"f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66\": container with ID starting with f65ef6112b1017999be5e3cd1d0097037b757487c80cf6ed4280b988edc4bb66 not found: ID does not exist" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.496571 4769 scope.go:117] "RemoveContainer" containerID="b9847f2b3d0083ef5ef68f7cec090f69da0c6ed2b4bc3f866a1e4ac3c5a41af8" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.497406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-kube-api-access-jjj59" (OuterVolumeSpecName: "kube-api-access-jjj59") pod "db54832c-1b96-4cc7-adf2-1dc47bda6fdd" (UID: "db54832c-1b96-4cc7-adf2-1dc47bda6fdd"). InnerVolumeSpecName "kube-api-access-jjj59". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.504464 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.514410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" (UID: "d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.518853 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.520991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data" (OuterVolumeSpecName: "config-data") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.540564 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558345 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558381 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558394 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558406 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2kksd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-kube-api-access-2kksd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558418 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558429 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558454 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558469 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558496 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558509 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558520 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jjj59\" (UniqueName: \"kubernetes.io/projected/db54832c-1b96-4cc7-adf2-1dc47bda6fdd-kube-api-access-jjj59\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.558532 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: E1121 13:12:42.558390 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:12:42 crc kubenswrapper[4769]: E1121 13:12:42.558615 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts podName:b61a670b-7dd5-4560-8b17-57044f1ea44b nodeName:}" failed. No retries permitted until 2025-11-21 13:12:46.558595373 +0000 UTC m=+4925.259257241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts") pod "placement1832-account-delete-5fdvd" (UID: "b61a670b-7dd5-4560-8b17-57044f1ea44b") : configmap "openstack-scripts" not found Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.561744 4769 scope.go:117] "RemoveContainer" containerID="8bfef00943a48dc5e1d8712c382f942d89bcf93b1d416023c5df7398aa0f5826" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.571964 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-85c5b68669-ljc9x"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.621779 4769 scope.go:117] "RemoveContainer" containerID="db66bc499117548016d3663ec3a8733b3464af3a068ea1055c43a9cd91cdc128" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.627100 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-85c5b68669-ljc9x"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.634837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.636731 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.637018 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.647592 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.660939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-erlang-cookie-secret\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.660989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-plugins-conf\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.661013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-server-conf\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.661051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2qmc\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-kube-api-access-d2qmc\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.661072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nbws\" (UniqueName: \"kubernetes.io/projected/bcbe4d3d-cecf-48f5-84c3-436b5442228b-kube-api-access-2nbws\") pod \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.661110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-confd\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.661183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data\") pod \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data-custom\") pod \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662324 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-tls\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts\") pod \"b61a670b-7dd5-4560-8b17-57044f1ea44b\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662427 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-combined-ca-bundle\") pod \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662449 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wh5v\" (UniqueName: \"kubernetes.io/projected/b61a670b-7dd5-4560-8b17-57044f1ea44b-kube-api-access-5wh5v\") pod \"b61a670b-7dd5-4560-8b17-57044f1ea44b\" (UID: \"b61a670b-7dd5-4560-8b17-57044f1ea44b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcbe4d3d-cecf-48f5-84c3-436b5442228b-logs\") pod \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\" (UID: \"bcbe4d3d-cecf-48f5-84c3-436b5442228b\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-erlang-cookie\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-plugins\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.662630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-pod-info\") pod \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\" (UID: \"67b175f2-3b5a-49a9-a0f5-aec7dafbde5a\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.663140 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.663314 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.663327 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.664432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.668606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61a670b-7dd5-4560-8b17-57044f1ea44b-kube-api-access-5wh5v" (OuterVolumeSpecName: "kube-api-access-5wh5v") pod "b61a670b-7dd5-4560-8b17-57044f1ea44b" (UID: "b61a670b-7dd5-4560-8b17-57044f1ea44b"). InnerVolumeSpecName "kube-api-access-5wh5v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.668765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b61a670b-7dd5-4560-8b17-57044f1ea44b" (UID: "b61a670b-7dd5-4560-8b17-57044f1ea44b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.669218 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcbe4d3d-cecf-48f5-84c3-436b5442228b-logs" (OuterVolumeSpecName: "logs") pod "bcbe4d3d-cecf-48f5-84c3-436b5442228b" (UID: "bcbe4d3d-cecf-48f5-84c3-436b5442228b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.669625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.670402 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinderff83-account-delete-n49j8"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.670940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "persistence") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.674360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bcbe4d3d-cecf-48f5-84c3-436b5442228b" (UID: "bcbe4d3d-cecf-48f5-84c3-436b5442228b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.675332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.680244 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-kube-api-access-d2qmc" (OuterVolumeSpecName: "kube-api-access-d2qmc") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "kube-api-access-d2qmc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.681439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.683005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-pod-info" (OuterVolumeSpecName: "pod-info") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.689491 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinderff83-account-delete-n49j8"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.690825 4769 scope.go:117] "RemoveContainer" containerID="aafcb2fe94defa7138324db37ddfa0cc79921bf4dc7287a684357415cbc47472" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.697006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcbe4d3d-cecf-48f5-84c3-436b5442228b-kube-api-access-2nbws" (OuterVolumeSpecName: "kube-api-access-2nbws") pod "bcbe4d3d-cecf-48f5-84c3-436b5442228b" (UID: "bcbe4d3d-cecf-48f5-84c3-436b5442228b"). InnerVolumeSpecName "kube-api-access-2nbws". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.699500 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.706040 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bcbe4d3d-cecf-48f5-84c3-436b5442228b" (UID: "bcbe4d3d-cecf-48f5-84c3-436b5442228b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.706331 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbicanb23d-account-delete-5p6qv"] Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.712645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data" (OuterVolumeSpecName: "config-data") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.722839 4769 scope.go:117] "RemoveContainer" containerID="0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.724482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-server-conf" (OuterVolumeSpecName: "server-conf") pod "d9bcbff3-ef6f-466b-81ad-7aa2093adbed" (UID: "d9bcbff3-ef6f-466b-81ad-7aa2093adbed"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.732224 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-server-conf" (OuterVolumeSpecName: "server-conf") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.733013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.772789 4769 scope.go:117] "RemoveContainer" containerID="3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.774898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-config-data\") pod \"4447c27b-0c4c-444a-981a-df468fe19b6e\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgk5v\" (UniqueName: \"kubernetes.io/projected/4447c27b-0c4c-444a-981a-df468fe19b6e-kube-api-access-hgk5v\") pod \"4447c27b-0c4c-444a-981a-df468fe19b6e\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775114 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-combined-ca-bundle\") pod \"4447c27b-0c4c-444a-981a-df468fe19b6e\" (UID: \"4447c27b-0c4c-444a-981a-df468fe19b6e\") " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775447 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775460 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775471 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b61a670b-7dd5-4560-8b17-57044f1ea44b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775480 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775490 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5wh5v\" (UniqueName: \"kubernetes.io/projected/b61a670b-7dd5-4560-8b17-57044f1ea44b-kube-api-access-5wh5v\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775501 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bcbe4d3d-cecf-48f5-84c3-436b5442228b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775513 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775522 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775532 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775554 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775564 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775574 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775583 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775592 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d2qmc\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-kube-api-access-d2qmc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775600 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2nbws\" (UniqueName: \"kubernetes.io/projected/bcbe4d3d-cecf-48f5-84c3-436b5442228b-kube-api-access-2nbws\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.775609 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/d9bcbff3-ef6f-466b-81ad-7aa2093adbed-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.796205 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4447c27b-0c4c-444a-981a-df468fe19b6e-kube-api-access-hgk5v" (OuterVolumeSpecName: "kube-api-access-hgk5v") pod "4447c27b-0c4c-444a-981a-df468fe19b6e" (UID: "4447c27b-0c4c-444a-981a-df468fe19b6e"). InnerVolumeSpecName "kube-api-access-hgk5v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.811738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4447c27b-0c4c-444a-981a-df468fe19b6e" (UID: "4447c27b-0c4c-444a-981a-df468fe19b6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.813478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-config-data" (OuterVolumeSpecName: "config-data") pod "4447c27b-0c4c-444a-981a-df468fe19b6e" (UID: "4447c27b-0c4c-444a-981a-df468fe19b6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:42 crc kubenswrapper[4769]: I1121 13:12:42.813986 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.835941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data" (OuterVolumeSpecName: "config-data") pod "bcbe4d3d-cecf-48f5-84c3-436b5442228b" (UID: "bcbe4d3d-cecf-48f5-84c3-436b5442228b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.849166 4769 scope.go:117] "RemoveContainer" containerID="132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.855166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" (UID: "67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.877237 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.877285 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.877300 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.877312 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4447c27b-0c4c-444a-981a-df468fe19b6e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.877328 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bcbe4d3d-cecf-48f5-84c3-436b5442228b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.877342 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hgk5v\" (UniqueName: \"kubernetes.io/projected/4447c27b-0c4c-444a-981a-df468fe19b6e-kube-api-access-hgk5v\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.920338 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.951904 4769 scope.go:117] "RemoveContainer" containerID="0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:42.952821 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f\": container with ID starting with 0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f not found: ID does not exist" containerID="0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.952844 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f"} err="failed to get container status \"0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f\": rpc error: code = NotFound desc = could not find container \"0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f\": container with ID starting with 0b0f47ba1f9db3b04e58ef1a37b8e36d54991eda2e4633c60dad65c57b0ef26f not found: ID does not exist" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.952865 4769 scope.go:117] "RemoveContainer" containerID="3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:42.953094 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a\": container with ID starting with 3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a not found: ID does not exist" containerID="3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.953113 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a"} err="failed to get container status \"3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a\": rpc error: code = NotFound desc = could not find container \"3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a\": container with ID starting with 3bab66dc2fb666017f5d14d4ad0c7c0e46ceb3a171b1813d26e624917a028b0a not found: ID does not exist" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.953127 4769 scope.go:117] "RemoveContainer" containerID="132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:42.953316 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de\": container with ID starting with 132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de not found: ID does not exist" containerID="132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.953331 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de"} err="failed to get container status \"132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de\": rpc error: code = NotFound desc = could not find container \"132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de\": container with ID starting with 132ab19d17352925e5acbb4062643962674656a0723b5707a1c904b9b66aa0de not found: ID does not exist" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.953342 4769 scope.go:117] "RemoveContainer" containerID="322181a90fba9fec78d937f0cf3b317b57434d3663e1ca80ff852cd244cc9693" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.978394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-combined-ca-bundle\") pod \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.978512 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whfpx\" (UniqueName: \"kubernetes.io/projected/f5b6a13f-243f-4eb4-868d-039a2c527c0b-kube-api-access-whfpx\") pod \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.978546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-config-data\") pod \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\" (UID: \"f5b6a13f-243f-4eb4-868d-039a2c527c0b\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.980241 4769 scope.go:117] "RemoveContainer" containerID="52bf814fc8e211a8b34844fdf5223234505ecd39743ed8295ab6031c097ee316" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.981403 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b6a13f-243f-4eb4-868d-039a2c527c0b-kube-api-access-whfpx" (OuterVolumeSpecName: "kube-api-access-whfpx") pod "f5b6a13f-243f-4eb4-868d-039a2c527c0b" (UID: "f5b6a13f-243f-4eb4-868d-039a2c527c0b"). InnerVolumeSpecName "kube-api-access-whfpx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.996685 4769 scope.go:117] "RemoveContainer" containerID="5304de44ce101b82147ad2b4ad0a44667ae2301091073c255c33cc1513cd7c04" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:42.999884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-config-data" (OuterVolumeSpecName: "config-data") pod "f5b6a13f-243f-4eb4-868d-039a2c527c0b" (UID: "f5b6a13f-243f-4eb4-868d-039a2c527c0b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.000418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5b6a13f-243f-4eb4-868d-039a2c527c0b" (UID: "f5b6a13f-243f-4eb4-868d-039a2c527c0b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.016301 4769 scope.go:117] "RemoveContainer" containerID="93cb8ebf8b14dcfa4999d829b651de90764c395c2a73faadb3b04a008c495ee9" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.033527 4769 scope.go:117] "RemoveContainer" containerID="66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:43.033916 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca\": container with ID starting with 66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca not found: ID does not exist" containerID="66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.033961 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca"} err="failed to get container status \"66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca\": rpc error: code = NotFound desc = could not find container \"66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca\": container with ID starting with 66251810c3b664ac5ee680f8e3820ce2c09fb0c3004955a979fba60bd8af5fca not found: ID does not exist" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.033988 4769 scope.go:117] "RemoveContainer" containerID="0bfc2ed943f742a18984f56c9d1e883ccf1ea60719a7155fd7ce66771efd4397" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.050759 4769 scope.go:117] "RemoveContainer" containerID="d5c23eb34ca3b41182a525d7ee4ee9177c9ce28074583e0ae5df4d0ad0deb85b" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.068009 4769 scope.go:117] "RemoveContainer" containerID="565966ee53afc9d91096fa79bd3d1606f835596120fa629d84e4032248a6f54d" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.080389 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.080429 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-whfpx\" (UniqueName: \"kubernetes.io/projected/f5b6a13f-243f-4eb4-868d-039a2c527c0b-kube-api-access-whfpx\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.080442 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b6a13f-243f-4eb4-868d-039a2c527c0b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.104908 4769 scope.go:117] "RemoveContainer" containerID="df00369cd314ab282a312e3337c4b565f36428563ed7872409d3915a5b23aaa0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.139463 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronaaf3-account-delete-4srnv" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.153104 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" exitCode=0 Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.153158 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerDied","Data":"387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4"} Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.153182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5b6a13f-243f-4eb4-868d-039a2c527c0b","Type":"ContainerDied","Data":"8098984b8040d2e9025fe01f36eee46aeab3991446b8878795477b09f13572c0"} Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.153249 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.160257 4769 scope.go:117] "RemoveContainer" containerID="bbb8c6b69af76dc1c0812931127a3e060edeb2007e6b20ff80c4053e0f2b5375" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.166674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerStarted","Data":"619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f"} Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.172976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" event={"ID":"bcbe4d3d-cecf-48f5-84c3-436b5442228b","Type":"ContainerDied","Data":"ce01450bdf6c6c44abd340e42784748f443114ae9dcc374ef4a870ecff3bfce1"} Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.173094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.195547 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6e99fec8-485c-4729-bb82-623b8cd00824/ovn-northd/0.log" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.195606 4769 generic.go:334] "Generic (PLEG): container finished" podID="6e99fec8-485c-4729-bb82-623b8cd00824" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" exitCode=139 Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.195677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6e99fec8-485c-4729-bb82-623b8cd00824","Type":"ContainerDied","Data":"6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd"} Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.197851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"4447c27b-0c4c-444a-981a-df468fe19b6e","Type":"ContainerDied","Data":"a69fb0a8a93f45e9210c9957d2b4731e233da7ede2d4e2fcc3857e2209ac0f4c"} Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.197947 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.202460 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronaaf3-account-delete-4srnv"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.219355 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.219502 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2229h" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.219700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement1832-account-delete-5fdvd" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.219780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.229361 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutronaaf3-account-delete-4srnv"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.234862 4769 scope.go:117] "RemoveContainer" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.258833 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.265969 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.268797 4769 scope.go:117] "RemoveContainer" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.296689 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158a329a-0904-43dd-b3da-b010701dcef0" path="/var/lib/kubelet/pods/158a329a-0904-43dd-b3da-b010701dcef0/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.297516 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" path="/var/lib/kubelet/pods/269e95b2-5877-4a8e-a661-4cf7270f215d/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.298148 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" path="/var/lib/kubelet/pods/347ea447-ef20-4550-8ad9-be274e65ad9e/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.301024 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35639d56-6b05-4c44-b344-8c4834e12841" path="/var/lib/kubelet/pods/35639d56-6b05-4c44-b344-8c4834e12841/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.301712 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" path="/var/lib/kubelet/pods/52a8d5cd-1b4e-4654-a190-57fc62882968/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.302772 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="554020cb-5fc6-4185-940f-4210d7c58422" path="/var/lib/kubelet/pods/554020cb-5fc6-4185-940f-4210d7c58422/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.303824 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" path="/var/lib/kubelet/pods/87447b3d-8379-4b3f-8f75-91ea2fc591ea/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.304869 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="983d3297-af3a-447c-ac21-4150a0626907" path="/var/lib/kubelet/pods/983d3297-af3a-447c-ac21-4150a0626907/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.305968 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" path="/var/lib/kubelet/pods/9aeea80a-dfea-4111-a296-461ffc4bc583/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.306747 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" path="/var/lib/kubelet/pods/9e7628da-ebf2-4650-ab67-7636546fdf65/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.307416 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb8b5ad1-e875-465a-bdf2-5f990e090632" path="/var/lib/kubelet/pods/bb8b5ad1-e875-465a-bdf2-5f990e090632/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.308321 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" path="/var/lib/kubelet/pods/c9d55e43-3709-48bb-80d3-490d8418422e/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.308933 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cecb25e5-59fd-4adf-b38b-c0f36e711c0f" path="/var/lib/kubelet/pods/cecb25e5-59fd-4adf-b38b-c0f36e711c0f/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.309387 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" path="/var/lib/kubelet/pods/db54832c-1b96-4cc7-adf2-1dc47bda6fdd/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.310360 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" path="/var/lib/kubelet/pods/e185c2f1-e6b7-45df-8977-d343330f24e3/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.311056 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf5da75-9e8a-4b56-a7d5-5040f624fce0" path="/var/lib/kubelet/pods/eaf5da75-9e8a-4b56-a7d5-5040f624fce0/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.311612 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" path="/var/lib/kubelet/pods/f5b6a13f-243f-4eb4-868d-039a2c527c0b/volumes" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.313020 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.313850 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7b5c95756d-r9vg8"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.319408 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.324344 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.328881 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.333375 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.338827 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement1832-account-delete-5fdvd"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.342945 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement1832-account-delete-5fdvd"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.347783 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-2229h"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.352509 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-2229h"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.411164 4769 scope.go:117] "RemoveContainer" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:43.411594 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4\": container with ID starting with 387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4 not found: ID does not exist" containerID="387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.411633 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4"} err="failed to get container status \"387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4\": rpc error: code = NotFound desc = could not find container \"387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4\": container with ID starting with 387a34b3dc0673bb17ecfa49819317641f0f3f2f3ef52d8ee94ca1cd53b9fbd4 not found: ID does not exist" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.411659 4769 scope.go:117] "RemoveContainer" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:43.411979 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc\": container with ID starting with 8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc not found: ID does not exist" containerID="8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.412025 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc"} err="failed to get container status \"8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc\": rpc error: code = NotFound desc = could not find container \"8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc\": container with ID starting with 8ee3f2fcd1e5f2009dc4d08b28b57848ffa265e2d1b5a2667b1a4b9a9703d4bc not found: ID does not exist" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.412060 4769 scope.go:117] "RemoveContainer" containerID="e15abbadf3e48c577ca2118a1b46f14868fc0a17cf1a74a3b2c023b947133f5c" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.436159 4769 scope.go:117] "RemoveContainer" containerID="01fc349f22783f08743b711022c71ba577b7b162773d7722adb2fde2c56261c6" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.467903 4769 scope.go:117] "RemoveContainer" containerID="03b71bcb0e55aab0b9b063a64b0ae25986261add1f31d409c4342adc9a40ed4b" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.796881 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.797126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="4fa29008-f566-42ca-b07b-24909ba55a2e" containerName="nova-scheduler-scheduler" containerID="cri-o://defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db" gracePeriod=30 Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.803331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.805086 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" containerName="memcached" containerID="cri-o://6a8fc84d76468c2bf634196510f850fd13bdabbf01bb76bd79b43c2051c09ae6" gracePeriod=30 Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.944512 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.155:8775/\": context deadline exceeded" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:43.944885 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.155:8775/\": context deadline exceeded" Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:44.364206 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd is running failed: container process not found" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:44.364621 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd is running failed: container process not found" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:44.365091 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd is running failed: container process not found" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:12:44 crc kubenswrapper[4769]: E1121 13:12:44.365156 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.556429 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6e99fec8-485c-4729-bb82-623b8cd00824/ovn-northd/0.log" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.556833 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d7h4\" (UniqueName: \"kubernetes.io/projected/6e99fec8-485c-4729-bb82-623b8cd00824-kube-api-access-5d7h4\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-config\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-metrics-certs-tls-certs\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610559 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-northd-tls-certs\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-rundir\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-scripts\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.610622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-combined-ca-bundle\") pod \"6e99fec8-485c-4729-bb82-623b8cd00824\" (UID: \"6e99fec8-485c-4729-bb82-623b8cd00824\") " Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.611362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.611876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-scripts" (OuterVolumeSpecName: "scripts") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.612702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-config" (OuterVolumeSpecName: "config") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.617122 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e99fec8-485c-4729-bb82-623b8cd00824-kube-api-access-5d7h4" (OuterVolumeSpecName: "kube-api-access-5d7h4") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "kube-api-access-5d7h4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.638983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.672716 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.677110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6e99fec8-485c-4729-bb82-623b8cd00824" (UID: "6e99fec8-485c-4729-bb82-623b8cd00824"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.712539 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.712700 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.712784 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.712852 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5d7h4\" (UniqueName: \"kubernetes.io/projected/6e99fec8-485c-4729-bb82-623b8cd00824-kube-api-access-5d7h4\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.712910 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e99fec8-485c-4729-bb82-623b8cd00824-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.712969 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.713035 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e99fec8-485c-4729-bb82-623b8cd00824-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:44 crc kubenswrapper[4769]: I1121 13:12:44.847679 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" containerName="memcached" probeResult="failure" output="dial tcp 10.217.1.152:11211: connect: connection refused" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.254713 4769 generic.go:334] "Generic (PLEG): container finished" podID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" containerID="6a8fc84d76468c2bf634196510f850fd13bdabbf01bb76bd79b43c2051c09ae6" exitCode=0 Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.254791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e30b9c3a-08b6-4d59-bf89-588e667ef25f","Type":"ContainerDied","Data":"6a8fc84d76468c2bf634196510f850fd13bdabbf01bb76bd79b43c2051c09ae6"} Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.258371 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_6e99fec8-485c-4729-bb82-623b8cd00824/ovn-northd/0.log" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.258581 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"6e99fec8-485c-4729-bb82-623b8cd00824","Type":"ContainerDied","Data":"e132cf9a7d7b7acd6efa2dbe0e767cd8287eaf1185f6fe30ab1cee501a4e4edc"} Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.258712 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.258731 4769 scope.go:117] "RemoveContainer" containerID="a5aad00ff05c150b93f70bd16b1ceeef86ed5980b761b995801e435b824bf874" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.288132 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" path="/var/lib/kubelet/pods/4447c27b-0c4c-444a-981a-df468fe19b6e/volumes" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.288792 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" path="/var/lib/kubelet/pods/b61a670b-7dd5-4560-8b17-57044f1ea44b/volumes" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.289384 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" path="/var/lib/kubelet/pods/bcbe4d3d-cecf-48f5-84c3-436b5442228b/volumes" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.289364 4769 scope.go:117] "RemoveContainer" containerID="6e7355f93b7697a63bbed61572d753208faec6fa9e6f9de3b59c76f08d73aacd" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.290630 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" path="/var/lib/kubelet/pods/d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5/volumes" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.291522 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" path="/var/lib/kubelet/pods/d9bcbff3-ef6f-466b-81ad-7aa2093adbed/volumes" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.295451 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.306398 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.897822 4769 scope.go:117] "RemoveContainer" containerID="ac83bc611844805895bb08ac671d85349e2b7aa3ab033f68699e3255af87f04c" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.932948 4769 scope.go:117] "RemoveContainer" containerID="c4bc0a9f2961e86bc7ef87ceccf472d3807e9aebc30013d37d525b5565b00a05" Nov 21 13:12:45 crc kubenswrapper[4769]: I1121 13:12:45.985866 4769 scope.go:117] "RemoveContainer" containerID="318205313ca28fc0e7fc191ab8be8bed44fd5a257ffddc0f272394dde627e1fd" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.024998 4769 scope.go:117] "RemoveContainer" containerID="9da075ecf9ee34fdc525494974b9adf17d7c63f8487aa860902fc100114a05af" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.043211 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.055171 4769 scope.go:117] "RemoveContainer" containerID="d8ba6d2a6dd8ed7dcc45678bd09db2a44e1a5aa13b6ad7304a1220f00bce0698" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.137374 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-combined-ca-bundle\") pod \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.137434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-config-data\") pod \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.137494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-memcached-tls-certs\") pod \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.137571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrq4q\" (UniqueName: \"kubernetes.io/projected/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kube-api-access-zrq4q\") pod \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.137591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kolla-config\") pod \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\" (UID: \"e30b9c3a-08b6-4d59-bf89-588e667ef25f\") " Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.138458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "e30b9c3a-08b6-4d59-bf89-588e667ef25f" (UID: "e30b9c3a-08b6-4d59-bf89-588e667ef25f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.138517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-config-data" (OuterVolumeSpecName: "config-data") pod "e30b9c3a-08b6-4d59-bf89-588e667ef25f" (UID: "e30b9c3a-08b6-4d59-bf89-588e667ef25f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.239439 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.239472 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.274787 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerID="619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f" exitCode=0 Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.274853 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerDied","Data":"619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f"} Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.282795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e30b9c3a-08b6-4d59-bf89-588e667ef25f","Type":"ContainerDied","Data":"8453f68d7b5c7687792641d44b165ca7509e3d3387d6b9f02a51428c47490367"} Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.282859 4769 scope.go:117] "RemoveContainer" containerID="6a8fc84d76468c2bf634196510f850fd13bdabbf01bb76bd79b43c2051c09ae6" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.282802 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.479643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kube-api-access-zrq4q" (OuterVolumeSpecName: "kube-api-access-zrq4q") pod "e30b9c3a-08b6-4d59-bf89-588e667ef25f" (UID: "e30b9c3a-08b6-4d59-bf89-588e667ef25f"). InnerVolumeSpecName "kube-api-access-zrq4q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.507495 4769 scope.go:117] "RemoveContainer" containerID="5057923bd9ee853e309f0550164e19b5bf5397f8de264bbf30b905b34e4d78e2" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.518259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e30b9c3a-08b6-4d59-bf89-588e667ef25f" (UID: "e30b9c3a-08b6-4d59-bf89-588e667ef25f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.543567 4769 scope.go:117] "RemoveContainer" containerID="d4d4b9d9b6b372178b453dedb9cc896b7d516d5d20376643b3cbc00f070c99ca" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.544988 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.545022 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zrq4q\" (UniqueName: \"kubernetes.io/projected/e30b9c3a-08b6-4d59-bf89-588e667ef25f-kube-api-access-zrq4q\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.550705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "e30b9c3a-08b6-4d59-bf89-588e667ef25f" (UID: "e30b9c3a-08b6-4d59-bf89-588e667ef25f"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.567472 4769 scope.go:117] "RemoveContainer" containerID="44b0acbda05b17f41fa84764abed75f90553281275fccdcc1dd2e73fd151b20b" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.590501 4769 scope.go:117] "RemoveContainer" containerID="5d26239474a3e16cffea4e7314aafddd0ff19c871879a7013a25f4969633a000" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.615959 4769 scope.go:117] "RemoveContainer" containerID="9d5e0152b42519827753f8cc93604b2128f655276348458c8ae4584439f28528" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.627490 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.634219 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.646233 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e30b9c3a-08b6-4d59-bf89-588e667ef25f-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.663763 4769 scope.go:117] "RemoveContainer" containerID="1d5bf3c89845d6b83aaf03360240aa273fade74369502bfe934ff30f9e1dbc9d" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.690104 4769 scope.go:117] "RemoveContainer" containerID="818bae63b54b75b9d153ca690e3037b23b533cf1c060f6ad7f600755e4c4b69d" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.710350 4769 scope.go:117] "RemoveContainer" containerID="267ade2d6a9db457b9d33049d1a504f14771153c3278657faede3de73a013513" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.763983 4769 scope.go:117] "RemoveContainer" containerID="0df3a4bcad79b259fd39b601b6fc1624c9ffb07be587d4fc43b262e4ea242181" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.794070 4769 scope.go:117] "RemoveContainer" containerID="87cf2ddf1a99e6efe63f7bb15f2d315f31cd9dbf512a45a8508cb8d90a0303d9" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.810547 4769 scope.go:117] "RemoveContainer" containerID="b2ad67c9d01720b0dad7ae6daae691076f860bbc3a696c34ac116a3ec21267e8" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.854203 4769 scope.go:117] "RemoveContainer" containerID="8ed0a33aba937f755915b2fc4c92fe0b0b6d471286df9b04d3cd29b5ae2019b2" Nov 21 13:12:46 crc kubenswrapper[4769]: I1121 13:12:46.906628 4769 scope.go:117] "RemoveContainer" containerID="f2e9d93c5241ce1a455f474ad9b632082ce2e117c0bcf9d7d95727dd36b98d63" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.001751 4769 scope.go:117] "RemoveContainer" containerID="5cb8bbce19ac0ceafe6b9ec7f4c5c1f19b411bb776829969ce2910ca25f6d8af" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.034892 4769 scope.go:117] "RemoveContainer" containerID="7ac1b0f9a0ea046fc1d0a8b25bc99c736d938e044e4a1495b65444706590afb8" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.082074 4769 scope.go:117] "RemoveContainer" containerID="9c09e34129e450d3235f71c7f47fa027430be6695e0ad775fde53c82a561d2f1" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.141602 4769 scope.go:117] "RemoveContainer" containerID="b78b8fd0295425f6ca1365ceb094c05bdf1f41c1a1412bcab48e93d6f50625b9" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.178029 4769 scope.go:117] "RemoveContainer" containerID="bd16965684eae98ffc96ff430f636f692e5238ffdcf429acca920276a0096550" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.221273 4769 scope.go:117] "RemoveContainer" containerID="01ee754882a2a7c2e21f86b803eb4b436bae6c6fcfce1259b0b4661de7ee1d94" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.239164 4769 scope.go:117] "RemoveContainer" containerID="7f5aa071bec205a5807a7c135c63cdb3bb788608a28ba64531eac1d1513154f2" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.272292 4769 scope.go:117] "RemoveContainer" containerID="93378f632b019d9c7e10bfcefe379529c75465a1167d0ebf281da8b3624044e4" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.282362 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" path="/var/lib/kubelet/pods/6e99fec8-485c-4729-bb82-623b8cd00824/volumes" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.283341 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" path="/var/lib/kubelet/pods/e30b9c3a-08b6-4d59-bf89-588e667ef25f/volumes" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.306078 4769 scope.go:117] "RemoveContainer" containerID="9599ec0ce31c3444a165662ff0efc585b182b0d77b1e0161507e607312e525c0" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.350588 4769 scope.go:117] "RemoveContainer" containerID="b891c565e76b9494353fcdcbe809fe3b252a046220e933a441169a11153e8285" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.398769 4769 scope.go:117] "RemoveContainer" containerID="1cd386014096eac0cdf21dbc34921d21612c850d03674a188bc2faaca9111307" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.418796 4769 scope.go:117] "RemoveContainer" containerID="a800be49870924b40b94fb5f9c6f7fcbfd92178e134a580cf172fe15bb3a5eeb" Nov 21 13:12:47 crc kubenswrapper[4769]: I1121 13:12:47.456363 4769 scope.go:117] "RemoveContainer" containerID="74c188d249634a04165a894b0b0c441b858767e33bd194d2baf231f0be89bd3a" Nov 21 13:12:47 crc kubenswrapper[4769]: E1121 13:12:47.784861 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:12:47 crc kubenswrapper[4769]: E1121 13:12:47.801434 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:12:47 crc kubenswrapper[4769]: E1121 13:12:47.803428 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:12:47 crc kubenswrapper[4769]: E1121 13:12:47.803518 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="4fa29008-f566-42ca-b07b-24909ba55a2e" containerName="nova-scheduler-scheduler" Nov 21 13:12:49 crc kubenswrapper[4769]: I1121 13:12:49.371426 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:12:49 crc kubenswrapper[4769]: I1121 13:12:49.440581 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5"] Nov 21 13:12:49 crc kubenswrapper[4769]: I1121 13:12:49.441261 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="dnsmasq-dns" containerID="cri-o://4611b8e31f314c4f66d31e042a0171cd4db8c5b5d20f84c9f6e9a794c7383ed9" gracePeriod=10 Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.352241 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.45:5353: connect: connection refused" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.387355 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerID="4611b8e31f314c4f66d31e042a0171cd4db8c5b5d20f84c9f6e9a794c7383ed9" exitCode=0 Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.387453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" event={"ID":"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce","Type":"ContainerDied","Data":"4611b8e31f314c4f66d31e042a0171cd4db8c5b5d20f84c9f6e9a794c7383ed9"} Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.390122 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerID="39ef7e4397f48731bce48b78715be96da4f74652e9ed100f8863f7a964cc1dcd" exitCode=0 Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.390232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" event={"ID":"9d48ea37-164f-4a8b-955d-b3b7416672de","Type":"ContainerDied","Data":"39ef7e4397f48731bce48b78715be96da4f74652e9ed100f8863f7a964cc1dcd"} Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.392870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerStarted","Data":"e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb"} Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.423982 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-wl27m" podStartSLOduration=7.44562749 podStartE2EDuration="15.423962721s" podCreationTimestamp="2025-11-21 13:12:35 +0000 UTC" firstStartedPulling="2025-11-21 13:12:41.055427468 +0000 UTC m=+4919.756089286" lastFinishedPulling="2025-11-21 13:12:49.033762659 +0000 UTC m=+4927.734424517" observedRunningTime="2025-11-21 13:12:50.421035212 +0000 UTC m=+4929.121697030" watchObservedRunningTime="2025-11-21 13:12:50.423962721 +0000 UTC m=+4929.124624539" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.797786 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.818556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dns-swift-storage-0\") pod \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.818905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjz2h\" (UniqueName: \"kubernetes.io/projected/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-kube-api-access-pjz2h\") pod \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.820665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-config\") pod \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.820830 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dnsmasq-svc\") pod \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\" (UID: \"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce\") " Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.827617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-kube-api-access-pjz2h" (OuterVolumeSpecName: "kube-api-access-pjz2h") pod "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" (UID: "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce"). InnerVolumeSpecName "kube-api-access-pjz2h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.873178 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" (UID: "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.889881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" (UID: "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.907103 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-config" (OuterVolumeSpecName: "config") pod "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" (UID: "6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.922602 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pjz2h\" (UniqueName: \"kubernetes.io/projected/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-kube-api-access-pjz2h\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.922629 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.922638 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.922648 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:50 crc kubenswrapper[4769]: I1121 13:12:50.977726 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.023857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-ovndb-tls-certs\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.023952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-public-tls-certs\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.024007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-config\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.024036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-internal-tls-certs\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.024056 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-httpd-config\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.024122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n289s\" (UniqueName: \"kubernetes.io/projected/9d48ea37-164f-4a8b-955d-b3b7416672de-kube-api-access-n289s\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.024156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-combined-ca-bundle\") pod \"9d48ea37-164f-4a8b-955d-b3b7416672de\" (UID: \"9d48ea37-164f-4a8b-955d-b3b7416672de\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.027165 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.027960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d48ea37-164f-4a8b-955d-b3b7416672de-kube-api-access-n289s" (OuterVolumeSpecName: "kube-api-access-n289s") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "kube-api-access-n289s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.062005 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.067911 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.084871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.087857 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-config" (OuterVolumeSpecName: "config") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.102446 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "9d48ea37-164f-4a8b-955d-b3b7416672de" (UID: "9d48ea37-164f-4a8b-955d-b3b7416672de"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125210 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125247 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125258 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125267 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125276 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125285 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n289s\" (UniqueName: \"kubernetes.io/projected/9d48ea37-164f-4a8b-955d-b3b7416672de-kube-api-access-n289s\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.125294 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d48ea37-164f-4a8b-955d-b3b7416672de-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.404777 4769 generic.go:334] "Generic (PLEG): container finished" podID="4fa29008-f566-42ca-b07b-24909ba55a2e" containerID="defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db" exitCode=0 Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.404847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4fa29008-f566-42ca-b07b-24909ba55a2e","Type":"ContainerDied","Data":"defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db"} Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.404902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"4fa29008-f566-42ca-b07b-24909ba55a2e","Type":"ContainerDied","Data":"59f8ed1fa9472cb8fb5d1a57cf8a287575362a7274916239704bcc5c1f35d35f"} Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.404914 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59f8ed1fa9472cb8fb5d1a57cf8a287575362a7274916239704bcc5c1f35d35f" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.408050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" event={"ID":"6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce","Type":"ContainerDied","Data":"b8094a0044d3fbbafe530f48515f9d119dd2bb0b815817ee1324b010e6d9e625"} Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.408087 4769 scope.go:117] "RemoveContainer" containerID="4611b8e31f314c4f66d31e042a0171cd4db8c5b5d20f84c9f6e9a794c7383ed9" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.408139 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.411232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.411220 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8576757c54-nblzm" event={"ID":"9d48ea37-164f-4a8b-955d-b3b7416672de","Type":"ContainerDied","Data":"ad316cd297d469811f90f20d5a9291e27e398bed853cbb51c068a42938236b32"} Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.427684 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.437865 4769 scope.go:117] "RemoveContainer" containerID="406e35566d065b822f0e62b3641e02958ff64fd9f7e30e125653368b62346762" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.441839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5"] Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.448435 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-74bb965b7c-f6fg5"] Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.460721 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8576757c54-nblzm"] Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.466647 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8576757c54-nblzm"] Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.471757 4769 scope.go:117] "RemoveContainer" containerID="6edfc81cd3befd0a3b3f3414ada3d4fd0e7a79eacffd642f5a5c8b38558ae6b2" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.513732 4769 scope.go:117] "RemoveContainer" containerID="39ef7e4397f48731bce48b78715be96da4f74652e9ed100f8863f7a964cc1dcd" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.534163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-combined-ca-bundle\") pod \"4fa29008-f566-42ca-b07b-24909ba55a2e\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.534379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkvmh\" (UniqueName: \"kubernetes.io/projected/4fa29008-f566-42ca-b07b-24909ba55a2e-kube-api-access-xkvmh\") pod \"4fa29008-f566-42ca-b07b-24909ba55a2e\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.534443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-config-data\") pod \"4fa29008-f566-42ca-b07b-24909ba55a2e\" (UID: \"4fa29008-f566-42ca-b07b-24909ba55a2e\") " Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.537914 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa29008-f566-42ca-b07b-24909ba55a2e-kube-api-access-xkvmh" (OuterVolumeSpecName: "kube-api-access-xkvmh") pod "4fa29008-f566-42ca-b07b-24909ba55a2e" (UID: "4fa29008-f566-42ca-b07b-24909ba55a2e"). InnerVolumeSpecName "kube-api-access-xkvmh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.560569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-config-data" (OuterVolumeSpecName: "config-data") pod "4fa29008-f566-42ca-b07b-24909ba55a2e" (UID: "4fa29008-f566-42ca-b07b-24909ba55a2e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.569523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4fa29008-f566-42ca-b07b-24909ba55a2e" (UID: "4fa29008-f566-42ca-b07b-24909ba55a2e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.636804 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.637174 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xkvmh\" (UniqueName: \"kubernetes.io/projected/4fa29008-f566-42ca-b07b-24909ba55a2e-kube-api-access-xkvmh\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:51 crc kubenswrapper[4769]: I1121 13:12:51.637299 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4fa29008-f566-42ca-b07b-24909ba55a2e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:52 crc kubenswrapper[4769]: I1121 13:12:52.440125 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:12:52 crc kubenswrapper[4769]: I1121 13:12:52.480874 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:12:52 crc kubenswrapper[4769]: I1121 13:12:52.486617 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:12:53 crc kubenswrapper[4769]: I1121 13:12:53.284805 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa29008-f566-42ca-b07b-24909ba55a2e" path="/var/lib/kubelet/pods/4fa29008-f566-42ca-b07b-24909ba55a2e/volumes" Nov 21 13:12:53 crc kubenswrapper[4769]: I1121 13:12:53.285712 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" path="/var/lib/kubelet/pods/6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce/volumes" Nov 21 13:12:53 crc kubenswrapper[4769]: I1121 13:12:53.286459 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" path="/var/lib/kubelet/pods/9d48ea37-164f-4a8b-955d-b3b7416672de/volumes" Nov 21 13:12:56 crc kubenswrapper[4769]: I1121 13:12:56.163165 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:56 crc kubenswrapper[4769]: I1121 13:12:56.163665 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:56 crc kubenswrapper[4769]: I1121 13:12:56.222323 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:56 crc kubenswrapper[4769]: I1121 13:12:56.737100 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:56 crc kubenswrapper[4769]: I1121 13:12:56.797434 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wl27m"] Nov 21 13:12:58 crc kubenswrapper[4769]: I1121 13:12:58.502446 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-wl27m" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="registry-server" containerID="cri-o://e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb" gracePeriod=2 Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.472203 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.518425 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerID="e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb" exitCode=0 Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.518467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerDied","Data":"e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb"} Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.518501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-wl27m" event={"ID":"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38","Type":"ContainerDied","Data":"2f29e2e5fc6208636af0af9b9c9baf018d83d1b801f3c93409fea5c7511e6cbc"} Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.518519 4769 scope.go:117] "RemoveContainer" containerID="e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.518541 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-wl27m" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.540074 4769 scope.go:117] "RemoveContainer" containerID="619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.561295 4769 scope.go:117] "RemoveContainer" containerID="21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.593321 4769 scope.go:117] "RemoveContainer" containerID="e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb" Nov 21 13:12:59 crc kubenswrapper[4769]: E1121 13:12:59.593898 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb\": container with ID starting with e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb not found: ID does not exist" containerID="e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.593953 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb"} err="failed to get container status \"e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb\": rpc error: code = NotFound desc = could not find container \"e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb\": container with ID starting with e08b3bf7dcf884aaa534a9c70b0bac2e38b23ad35a4cc085a068a03c7235dccb not found: ID does not exist" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.593985 4769 scope.go:117] "RemoveContainer" containerID="619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f" Nov 21 13:12:59 crc kubenswrapper[4769]: E1121 13:12:59.594481 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f\": container with ID starting with 619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f not found: ID does not exist" containerID="619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.594539 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f"} err="failed to get container status \"619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f\": rpc error: code = NotFound desc = could not find container \"619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f\": container with ID starting with 619a875cd0df122f305e4b49e95644eecdc4eed7ca34059a3688a0dd2632c83f not found: ID does not exist" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.594578 4769 scope.go:117] "RemoveContainer" containerID="21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff" Nov 21 13:12:59 crc kubenswrapper[4769]: E1121 13:12:59.596121 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff\": container with ID starting with 21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff not found: ID does not exist" containerID="21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.596168 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff"} err="failed to get container status \"21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff\": rpc error: code = NotFound desc = could not find container \"21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff\": container with ID starting with 21f76e2c07fe4925823d5beebc6fea3617b7ff393cc9d7912d7c6e4c13621dff not found: ID does not exist" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.658674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-catalog-content\") pod \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.658755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-utilities\") pod \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.658884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzntw\" (UniqueName: \"kubernetes.io/projected/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-kube-api-access-mzntw\") pod \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\" (UID: \"f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38\") " Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.659791 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-utilities" (OuterVolumeSpecName: "utilities") pod "f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" (UID: "f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.664702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-kube-api-access-mzntw" (OuterVolumeSpecName: "kube-api-access-mzntw") pod "f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" (UID: "f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38"). InnerVolumeSpecName "kube-api-access-mzntw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.684134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" (UID: "f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.761097 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mzntw\" (UniqueName: \"kubernetes.io/projected/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-kube-api-access-mzntw\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.761161 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.761181 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.859684 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-wl27m"] Nov 21 13:12:59 crc kubenswrapper[4769]: I1121 13:12:59.865946 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-wl27m"] Nov 21 13:13:01 crc kubenswrapper[4769]: I1121 13:13:01.290990 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" path="/var/lib/kubelet/pods/f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38/volumes" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.440135 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.544376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-857h2\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-kube-api-access-857h2\") pod \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.544433 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") pod \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.544534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.544561 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-lock\") pod \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.544600 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-cache\") pod \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\" (UID: \"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881\") " Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.545254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-lock" (OuterVolumeSpecName: "lock") pod "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.545417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-cache" (OuterVolumeSpecName: "cache") pod "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.550424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-kube-api-access-857h2" (OuterVolumeSpecName: "kube-api-access-857h2") pod "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881"). InnerVolumeSpecName "kube-api-access-857h2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.550501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "swift") pod "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.552362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" (UID: "7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.582692 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerID="20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45" exitCode=137 Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.582751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45"} Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.582801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881","Type":"ContainerDied","Data":"90aad20e65322c46bf1536bb3ea244951cbd0ac88923e4b1f836518fd4fb857e"} Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.582826 4769 scope.go:117] "RemoveContainer" containerID="20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.582995 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.625364 4769 scope.go:117] "RemoveContainer" containerID="5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.626761 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.634204 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.647285 4769 scope.go:117] "RemoveContainer" containerID="75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.647816 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-cache\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.647864 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-857h2\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-kube-api-access-857h2\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.647878 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.647912 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.647927 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881-lock\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.664852 4769 scope.go:117] "RemoveContainer" containerID="1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.666304 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.684462 4769 scope.go:117] "RemoveContainer" containerID="f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.701497 4769 scope.go:117] "RemoveContainer" containerID="826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.718393 4769 scope.go:117] "RemoveContainer" containerID="c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.734856 4769 scope.go:117] "RemoveContainer" containerID="f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.749001 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.754290 4769 scope.go:117] "RemoveContainer" containerID="8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.774735 4769 scope.go:117] "RemoveContainer" containerID="7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.793432 4769 scope.go:117] "RemoveContainer" containerID="a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.811838 4769 scope.go:117] "RemoveContainer" containerID="0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.852594 4769 scope.go:117] "RemoveContainer" containerID="222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.880391 4769 scope.go:117] "RemoveContainer" containerID="93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.911729 4769 scope.go:117] "RemoveContainer" containerID="0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.934564 4769 scope.go:117] "RemoveContainer" containerID="20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.934961 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45\": container with ID starting with 20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45 not found: ID does not exist" containerID="20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.934996 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45"} err="failed to get container status \"20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45\": rpc error: code = NotFound desc = could not find container \"20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45\": container with ID starting with 20f0aa4000f948a93047bcaf5db7d96b0b2107ca3203da6449e96004d457eb45 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.935023 4769 scope.go:117] "RemoveContainer" containerID="5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.935456 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461\": container with ID starting with 5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461 not found: ID does not exist" containerID="5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.935485 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461"} err="failed to get container status \"5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461\": rpc error: code = NotFound desc = could not find container \"5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461\": container with ID starting with 5cfd4d684b92aca8b15731bc75e38b620a015ec5ba0dade8caa0acf19a85c461 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.935507 4769 scope.go:117] "RemoveContainer" containerID="75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.935925 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10\": container with ID starting with 75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10 not found: ID does not exist" containerID="75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.935951 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10"} err="failed to get container status \"75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10\": rpc error: code = NotFound desc = could not find container \"75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10\": container with ID starting with 75442d3849ca93a8de5ef4e7878a356ac49184a0a03b77d032e734907746cc10 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.935969 4769 scope.go:117] "RemoveContainer" containerID="1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.936285 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81\": container with ID starting with 1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81 not found: ID does not exist" containerID="1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.936329 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81"} err="failed to get container status \"1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81\": rpc error: code = NotFound desc = could not find container \"1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81\": container with ID starting with 1a283ba366dc2141b24cccf1128dae40bf4abf021fea4717e58ed960d5990b81 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.936350 4769 scope.go:117] "RemoveContainer" containerID="f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.940745 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401\": container with ID starting with f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401 not found: ID does not exist" containerID="f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.940793 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401"} err="failed to get container status \"f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401\": rpc error: code = NotFound desc = could not find container \"f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401\": container with ID starting with f9122237dcdc7f484e7e06bf8652d4f78e7686c067df4d4bdb6181cc46564401 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.940825 4769 scope.go:117] "RemoveContainer" containerID="826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.941133 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6\": container with ID starting with 826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6 not found: ID does not exist" containerID="826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.941165 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6"} err="failed to get container status \"826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6\": rpc error: code = NotFound desc = could not find container \"826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6\": container with ID starting with 826b28ca5cdb06590ff2890159babc8ce5d54f8419d83a0744c3ce8468c664b6 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.941201 4769 scope.go:117] "RemoveContainer" containerID="c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.944645 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b\": container with ID starting with c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b not found: ID does not exist" containerID="c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.944682 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b"} err="failed to get container status \"c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b\": rpc error: code = NotFound desc = could not find container \"c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b\": container with ID starting with c9765ebd586195c81e9e226b3ad1feb06b0da6510b9293d465744967341bcd8b not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.944705 4769 scope.go:117] "RemoveContainer" containerID="f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.945029 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e\": container with ID starting with f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e not found: ID does not exist" containerID="f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.945060 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e"} err="failed to get container status \"f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e\": rpc error: code = NotFound desc = could not find container \"f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e\": container with ID starting with f06bf161e13fe9c51a09c85da90ebd37eb67733d7908c8a9b54e36d1a63f259e not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.945081 4769 scope.go:117] "RemoveContainer" containerID="8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.945413 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1\": container with ID starting with 8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1 not found: ID does not exist" containerID="8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.945437 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1"} err="failed to get container status \"8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1\": rpc error: code = NotFound desc = could not find container \"8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1\": container with ID starting with 8a4ef95d41964ade10e59fcb0b42606016d6b5fe2218b97b5d928da5de6450f1 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.945450 4769 scope.go:117] "RemoveContainer" containerID="7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.949619 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75\": container with ID starting with 7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75 not found: ID does not exist" containerID="7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.949673 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75"} err="failed to get container status \"7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75\": rpc error: code = NotFound desc = could not find container \"7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75\": container with ID starting with 7bef15ee430106e8ee0054baa9adffa219852322ce69fbc743c264e9f1efce75 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.949700 4769 scope.go:117] "RemoveContainer" containerID="a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.949936 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00\": container with ID starting with a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00 not found: ID does not exist" containerID="a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.949953 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00"} err="failed to get container status \"a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00\": rpc error: code = NotFound desc = could not find container \"a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00\": container with ID starting with a32ed8ae622ea1a561f1c79d3817d3efaaf12eb3e6b2ccbfa7a826e3226aff00 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.949967 4769 scope.go:117] "RemoveContainer" containerID="0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.950163 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5\": container with ID starting with 0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5 not found: ID does not exist" containerID="0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.950258 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5"} err="failed to get container status \"0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5\": rpc error: code = NotFound desc = could not find container \"0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5\": container with ID starting with 0571c1dc135411346bb49585cdb45d6d48cdedbbb4c93ac7389195857182a9d5 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.950273 4769 scope.go:117] "RemoveContainer" containerID="222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.950516 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5\": container with ID starting with 222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5 not found: ID does not exist" containerID="222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.950560 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5"} err="failed to get container status \"222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5\": rpc error: code = NotFound desc = could not find container \"222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5\": container with ID starting with 222640ad4ce20fea56fa65f54d2292228868f72c13818c4f4009f80c44cd42a5 not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.950586 4769 scope.go:117] "RemoveContainer" containerID="93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.950818 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb\": container with ID starting with 93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb not found: ID does not exist" containerID="93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.950845 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb"} err="failed to get container status \"93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb\": rpc error: code = NotFound desc = could not find container \"93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb\": container with ID starting with 93d8ddcd0723084f25bbc504dde29cf0f6841dda4c77ed0cf78cf82f05dcbefb not found: ID does not exist" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.950863 4769 scope.go:117] "RemoveContainer" containerID="0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0" Nov 21 13:13:04 crc kubenswrapper[4769]: E1121 13:13:04.951319 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0\": container with ID starting with 0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0 not found: ID does not exist" containerID="0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0" Nov 21 13:13:04 crc kubenswrapper[4769]: I1121 13:13:04.951338 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0"} err="failed to get container status \"0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0\": rpc error: code = NotFound desc = could not find container \"0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0\": container with ID starting with 0e8fc29c92b10802cc236e5de2f3755e2ba7e21ba0e2ad7fa6a238a879dd59c0 not found: ID does not exist" Nov 21 13:13:05 crc kubenswrapper[4769]: I1121 13:13:05.348595 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" path="/var/lib/kubelet/pods/7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881/volumes" Nov 21 13:13:09 crc kubenswrapper[4769]: I1121 13:13:09.268525 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod4640235d-af3d-4c48-b378-efc21e7c4fe8"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod4640235d-af3d-4c48-b378-efc21e7c4fe8] : Timed out while waiting for systemd to remove kubepods-besteffort-pod4640235d_af3d_4c48_b378_efc21e7c4fe8.slice" Nov 21 13:13:09 crc kubenswrapper[4769]: I1121 13:13:09.638802 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8bebf004-4bd2-427b-aeb6-0d1d4199caae"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8bebf004-4bd2-427b-aeb6-0d1d4199caae] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8bebf004_4bd2_427b_aeb6_0d1d4199caae.slice" Nov 21 13:13:09 crc kubenswrapper[4769]: E1121 13:13:09.638869 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod8bebf004-4bd2-427b-aeb6-0d1d4199caae] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod8bebf004-4bd2-427b-aeb6-0d1d4199caae] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8bebf004_4bd2_427b_aeb6_0d1d4199caae.slice" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" Nov 21 13:13:09 crc kubenswrapper[4769]: I1121 13:13:09.661935 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod7502cfa7-e853-47c6-b98e-3d9d38c25cf1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod7502cfa7-e853-47c6-b98e-3d9d38c25cf1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7502cfa7_e853_47c6_b98e_3d9d38c25cf1.slice" Nov 21 13:13:09 crc kubenswrapper[4769]: E1121 13:13:09.662017 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod7502cfa7-e853-47c6-b98e-3d9d38c25cf1] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod7502cfa7-e853-47c6-b98e-3d9d38c25cf1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7502cfa7_e853_47c6_b98e_3d9d38c25cf1.slice" pod="openstack-kuttl-tests/ceilometer-0" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" Nov 21 13:13:09 crc kubenswrapper[4769]: I1121 13:13:09.671854 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod49dbf016-abc5-4e21-9912-cdac726ea545"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod49dbf016-abc5-4e21-9912-cdac726ea545] : Timed out while waiting for systemd to remove kubepods-besteffort-pod49dbf016_abc5_4e21_9912_cdac726ea545.slice" Nov 21 13:13:09 crc kubenswrapper[4769]: I1121 13:13:09.672949 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod7502cfa7-e853-47c6-b98e-3d9d38c25cf1"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod7502cfa7-e853-47c6-b98e-3d9d38c25cf1] : Timed out while waiting for systemd to remove kubepods-besteffort-pod7502cfa7_e853_47c6_b98e_3d9d38c25cf1.slice" Nov 21 13:13:09 crc kubenswrapper[4769]: I1121 13:13:09.678088 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8bebf004-4bd2-427b-aeb6-0d1d4199caae"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8bebf004-4bd2-427b-aeb6-0d1d4199caae] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8bebf004_4bd2_427b_aeb6_0d1d4199caae.slice" Nov 21 13:13:10 crc kubenswrapper[4769]: I1121 13:13:10.636923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:13:10 crc kubenswrapper[4769]: I1121 13:13:10.638274 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q" Nov 21 13:13:10 crc kubenswrapper[4769]: I1121 13:13:10.681175 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:13:10 crc kubenswrapper[4769]: I1121 13:13:10.689889 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:13:10 crc kubenswrapper[4769]: I1121 13:13:10.714581 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q"] Nov 21 13:13:10 crc kubenswrapper[4769]: I1121 13:13:10.721740 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-d688c7f7d-8gr5q"] Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.283427 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" path="/var/lib/kubelet/pods/7502cfa7-e853-47c6-b98e-3d9d38c25cf1/volumes" Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.284535 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" path="/var/lib/kubelet/pods/8bebf004-4bd2-427b-aeb6-0d1d4199caae/volumes" Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.325397 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.325481 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.325549 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.326379 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"1b1f2c1e2837e5ce0cc2c156af60fed23afef95bb5d7d7c049b7a0edff9bcd61"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.326464 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://1b1f2c1e2837e5ce0cc2c156af60fed23afef95bb5d7d7c049b7a0edff9bcd61" gracePeriod=600 Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.646147 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="1b1f2c1e2837e5ce0cc2c156af60fed23afef95bb5d7d7c049b7a0edff9bcd61" exitCode=0 Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.646208 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"1b1f2c1e2837e5ce0cc2c156af60fed23afef95bb5d7d7c049b7a0edff9bcd61"} Nov 21 13:13:11 crc kubenswrapper[4769]: I1121 13:13:11.646270 4769 scope.go:117] "RemoveContainer" containerID="93841f45ceb706f8f369819a8fa7c193038fd9992fa2bbda692e176b9817d7e8" Nov 21 13:13:12 crc kubenswrapper[4769]: I1121 13:13:12.656677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826"} Nov 21 13:13:13 crc kubenswrapper[4769]: I1121 13:13:13.379648 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","pod67b175f2-3b5a-49a9-a0f5-aec7dafbde5a"] err="unable to destroy cgroup paths for cgroup [kubepods burstable pod67b175f2-3b5a-49a9-a0f5-aec7dafbde5a] : Timed out while waiting for systemd to remove kubepods-burstable-pod67b175f2_3b5a_49a9_a0f5_aec7dafbde5a.slice" Nov 21 13:13:13 crc kubenswrapper[4769]: E1121 13:13:13.380086 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods burstable pod67b175f2-3b5a-49a9-a0f5-aec7dafbde5a] : unable to destroy cgroup paths for cgroup [kubepods burstable pod67b175f2-3b5a-49a9-a0f5-aec7dafbde5a] : Timed out while waiting for systemd to remove kubepods-burstable-pod67b175f2_3b5a_49a9_a0f5_aec7dafbde5a.slice" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" Nov 21 13:13:13 crc kubenswrapper[4769]: I1121 13:13:13.664498 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:13 crc kubenswrapper[4769]: I1121 13:13:13.701440 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:13:13 crc kubenswrapper[4769]: I1121 13:13:13.707548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.011011 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.011613 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.011695 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.011769 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="158a329a-0904-43dd-b3da-b010701dcef0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.011837 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="158a329a-0904-43dd-b3da-b010701dcef0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.011901 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.011968 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012056 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012123 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012210 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012278 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012348 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eaf5da75-9e8a-4b56-a7d5-5040f624fce0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012423 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf5da75-9e8a-4b56-a7d5-5040f624fce0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012505 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-updater" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012569 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-updater" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012644 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012706 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012771 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012834 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-server" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.012905 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="probe" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.012966 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="probe" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013031 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013155 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013235 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013305 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f073b942-59a2-4273-bd2c-fa4039a573bf" containerName="kube-state-metrics" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013371 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f073b942-59a2-4273-bd2c-fa4039a573bf" containerName="kube-state-metrics" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013435 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013496 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013564 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013623 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013688 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013753 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013828 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cecb25e5-59fd-4adf-b38b-c0f36e711c0f" containerName="keystone-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.013914 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cecb25e5-59fd-4adf-b38b-c0f36e711c0f" containerName="keystone-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.013995 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-reaper" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014070 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-reaper" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014165 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014260 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014477 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="extract-utilities" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014535 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="extract-utilities" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014597 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="setup-container" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014656 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="setup-container" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014721 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-server" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014847 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.014906 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.014990 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015052 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015122 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015180 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015273 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015334 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015401 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015462 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015527 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="rabbitmq" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015585 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="rabbitmq" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015651 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015708 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015772 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="galera" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015835 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="galera" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.015900 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="extract-content" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.015962 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="extract-content" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016023 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016081 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016141 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016296 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="mysql-bootstrap" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016360 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="mysql-bootstrap" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016425 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="dnsmasq-dns" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016491 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="dnsmasq-dns" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016550 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="registry-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016611 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="registry-server" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016671 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="swift-recon-cron" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016730 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="swift-recon-cron" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016797 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="setup-container" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016859 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="setup-container" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.016925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.016980 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017041 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" containerName="memcached" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" containerName="memcached" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017161 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017248 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017312 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="registry-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017370 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="registry-server" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017425 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="extract-utilities" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="extract-utilities" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017546 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017608 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017673 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017732 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017792 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017849 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.017929 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.017989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018050 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="galera" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018110 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="galera" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018179 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="rsync" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018262 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="rsync" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018328 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="proxy-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018386 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="proxy-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018454 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018508 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018572 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-expirer" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018634 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-expirer" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018696 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018754 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018820 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.018879 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.018945 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019024 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019085 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019147 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019225 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019289 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019351 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019407 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019473 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-central-agent" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019536 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-central-agent" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019605 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bb8b5ad1-e875-465a-bdf2-5f990e090632" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019663 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb8b5ad1-e875-465a-bdf2-5f990e090632" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019727 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019785 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019847 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="rabbitmq" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.019905 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="rabbitmq" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.019959 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020019 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020083 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="sg-core" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="sg-core" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020208 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="extract-content" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020272 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="extract-content" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020335 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020393 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020458 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020519 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020582 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-updater" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020640 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-updater" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020706 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="init" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020766 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="init" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020825 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.020884 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.020947 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021007 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021154 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="mysql-bootstrap" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021226 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="mysql-bootstrap" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021297 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="openstack-network-exporter" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021357 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="openstack-network-exporter" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021504 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-server" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021564 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021626 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021696 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021824 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4fa29008-f566-42ca-b07b-24909ba55a2e" containerName="nova-scheduler-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.021884 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa29008-f566-42ca-b07b-24909ba55a2e" containerName="nova-scheduler-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.021947 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.022009 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.022072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.022136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.022275 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.022348 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-api" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.022405 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.022467 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-server" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.022529 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.022584 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-log" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.022649 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-notification-agent" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.022707 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-notification-agent" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023030 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" containerName="rabbitmq" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023114 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023182 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023267 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023332 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023390 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4fa29008-f566-42ca-b07b-24909ba55a2e" containerName="nova-scheduler-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023456 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-updater" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023521 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e7403ff5-3219-4017-9736-d92812125520" containerName="galera" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023589 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="49dbf016-abc5-4e21-9912-cdac726ea545" containerName="galera" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023646 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="swift-recon-cron" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023704 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023762 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023826 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="158a329a-0904-43dd-b3da-b010701dcef0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023884 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.023948 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="554020cb-5fc6-4185-940f-4210d7c58422" containerName="placement-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024018 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024077 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8bebf004-4bd2-427b-aeb6-0d1d4199caae" containerName="proxy-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024140 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024212 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024280 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="ovn-northd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024343 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024405 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024471 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024531 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-notification-agent" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024592 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="87447b3d-8379-4b3f-8f75-91ea2fc591ea" containerName="glance-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024656 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e30b9c3a-08b6-4d59-bf89-588e667ef25f" containerName="memcached" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024727 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bb8b5ad1-e875-465a-bdf2-5f990e090632" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024874 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.024943 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025015 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eaf5da75-9e8a-4b56-a7d5-5040f624fce0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025089 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="rsync" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025159 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d9bcbff3-ef6f-466b-81ad-7aa2093adbed" containerName="rabbitmq" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025260 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025339 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="cinder-scheduler" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025414 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="proxy-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025486 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025559 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-reaper" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025626 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d48ea37-164f-4a8b-955d-b3b7416672de" containerName="neutron-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025707 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bca6b8c-ee60-41c4-b6c6-95f4b811a8ce" containerName="dnsmasq-dns" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025787 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025861 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="269e95b2-5877-4a8e-a661-4cf7270f215d" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.025937 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026015 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-updater" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026089 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bcbe4d3d-cecf-48f5-84c3-436b5442228b" containerName="barbican-keystone-listener-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026166 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e99fec8-485c-4729-bb82-623b8cd00824" containerName="openstack-network-exporter" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026270 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="container-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026338 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="158a329a-0904-43dd-b3da-b010701dcef0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026398 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026454 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-metadata" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026517 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="ceilometer-central-agent" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026583 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026649 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026709 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-replicator" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026773 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="35639d56-6b05-4c44-b344-8c4834e12841" containerName="nova-metadata-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026841 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026904 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b61a670b-7dd5-4560-8b17-57044f1ea44b" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.026984 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027049 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-expirer" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027118 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7502cfa7-e853-47c6-b98e-3d9d38c25cf1" containerName="sg-core" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027184 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3df8f87-5d5f-49b6-9b8f-e66ba3a39d38" containerName="registry-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027407 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d3ecb356-8ae8-41ff-9bde-59a1fdcb35b5" containerName="registry-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027471 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cecb25e5-59fd-4adf-b38b-c0f36e711c0f" containerName="keystone-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027546 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027615 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e185c2f1-e6b7-45df-8977-d343330f24e3" containerName="nova-api-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027676 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9aeea80a-dfea-4111-a296-461ffc4bc583" containerName="probe" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027732 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="object-auditor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027796 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a22f9c37-8fc9-4add-944a-d4d1dcc1a6f6" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027859 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bcf5218-5e8a-4a7d-ab5c-bed7a55a8881" containerName="account-server" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027920 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="347ea447-ef20-4550-8ad9-be274e65ad9e" containerName="barbican-worker-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.027984 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028050 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028116 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e7628da-ebf2-4650-ab67-7636546fdf65" containerName="barbican-api-log" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028179 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="983d3297-af3a-447c-ac21-4150a0626907" containerName="glance-httpd" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028263 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028325 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f073b942-59a2-4273-bd2c-fa4039a573bf" containerName="kube-state-metrics" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.028690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028763 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db54832c-1b96-4cc7-adf2-1dc47bda6fdd" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.028829 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.028887 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d55e43-3709-48bb-80d3-490d8418422e" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.028970 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.029029 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: E1121 13:13:14.029111 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="158a329a-0904-43dd-b3da-b010701dcef0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.029173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="158a329a-0904-43dd-b3da-b010701dcef0" containerName="mariadb-account-delete" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.029415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="52a8d5cd-1b4e-4654-a190-57fc62882968" containerName="cinder-api" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.029486 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4447c27b-0c4c-444a-981a-df468fe19b6e" containerName="nova-cell1-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.029564 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5b6a13f-243f-4eb4-868d-039a2c527c0b" containerName="nova-cell0-conductor-conductor" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.030286 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.031349 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033325 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033535 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033636 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033783 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033833 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033984 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.033973 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-zpcck" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.184617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/cdd3fc9d-251c-47d2-aba8-53f309ea4494-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185332 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/cdd3fc9d-251c-47d2-aba8-53f309ea4494-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.185792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsvq\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-kube-api-access-2rsvq\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/cdd3fc9d-251c-47d2-aba8-53f309ea4494-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/cdd3fc9d-251c-47d2-aba8-53f309ea4494-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsvq\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-kube-api-access-2rsvq\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.288761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.289543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.289576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.289542 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.289612 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.289720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.292850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.295619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.298900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/cdd3fc9d-251c-47d2-aba8-53f309ea4494-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.300997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/cdd3fc9d-251c-47d2-aba8-53f309ea4494-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.302994 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.307586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsvq\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-kube-api-access-2rsvq\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.319602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.363515 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.436511 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.437736 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.443549 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.443571 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.444818 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.445279 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ngfw2" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.453348 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.468165 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.592895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/83b015b4-b107-44ce-8778-c85241297661-config-data-generated\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593430 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblgm\" (UniqueName: \"kubernetes.io/projected/83b015b4-b107-44ce-8778-c85241297661-kube-api-access-kblgm\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-config-data-default\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-kolla-config\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.593624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-operator-scripts\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.694806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-config-data-default\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.695851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-kolla-config\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.695943 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696056 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-config-data-default\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-operator-scripts\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/83b015b4-b107-44ce-8778-c85241297661-config-data-generated\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kblgm\" (UniqueName: \"kubernetes.io/projected/83b015b4-b107-44ce-8778-c85241297661-kube-api-access-kblgm\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-kolla-config\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.696908 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.697715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/83b015b4-b107-44ce-8778-c85241297661-config-data-generated\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.698113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-operator-scripts\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.704125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.706739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.714582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblgm\" (UniqueName: \"kubernetes.io/projected/83b015b4-b107-44ce-8778-c85241297661-kube-api-access-kblgm\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.731296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.783655 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:14 crc kubenswrapper[4769]: I1121 13:13:14.873037 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:13:14 crc kubenswrapper[4769]: W1121 13:13:14.884635 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd3fc9d_251c_47d2_aba8_53f309ea4494.slice/crio-aa87807cbef93d3a26e23820d95044e769cca9bbf31e69ce0ce20d45f6c32a01 WatchSource:0}: Error finding container aa87807cbef93d3a26e23820d95044e769cca9bbf31e69ce0ce20d45f6c32a01: Status 404 returned error can't find the container with id aa87807cbef93d3a26e23820d95044e769cca9bbf31e69ce0ce20d45f6c32a01 Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.203738 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.286704 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b175f2-3b5a-49a9-a0f5-aec7dafbde5a" path="/var/lib/kubelet/pods/67b175f2-3b5a-49a9-a0f5-aec7dafbde5a/volumes" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.661031 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.663181 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.665561 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.666585 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.670732 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.670870 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.670997 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.671752 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-zlfjj" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.672025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.691892 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.696387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"cdd3fc9d-251c-47d2-aba8-53f309ea4494","Type":"ContainerStarted","Data":"aa87807cbef93d3a26e23820d95044e769cca9bbf31e69ce0ce20d45f6c32a01"} Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.698106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"83b015b4-b107-44ce-8778-c85241297661","Type":"ContainerStarted","Data":"a996063c2b9c0e8be9e708f9b7aa4812380e8d3b42db0580183783cd740fe2ea"} Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.814999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866xx\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-kube-api-access-866xx\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/532433c6-42b6-4674-977f-8a7a23614deb-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815165 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815222 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815315 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/532433c6-42b6-4674-977f-8a7a23614deb-pod-info\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815351 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-server-conf\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.815372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.913109 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.914269 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-server-conf\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917136 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-866xx\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-kube-api-access-866xx\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/532433c6-42b6-4674-977f-8a7a23614deb-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917278 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.917292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/532433c6-42b6-4674-977f-8a7a23614deb-pod-info\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.918940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.918984 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919324 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919403 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-8x57j" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919431 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919433 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.919703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-server-conf\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.920854 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.924920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/532433c6-42b6-4674-977f-8a7a23614deb-pod-info\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.927820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.927865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.931481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/532433c6-42b6-4674-977f-8a7a23614deb-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.935963 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.945660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-866xx\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-kube-api-access-866xx\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.960389 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-server-0\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:15 crc kubenswrapper[4769]: I1121 13:13:15.983886 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018382 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph9n5\" (UniqueName: \"kubernetes.io/projected/3d6ae528-025a-4c40-be99-295e541bc058-kube-api-access-ph9n5\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.018491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3d6ae528-025a-4c40-be99-295e541bc058-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.119996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.120570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ph9n5\" (UniqueName: \"kubernetes.io/projected/3d6ae528-025a-4c40-be99-295e541bc058-kube-api-access-ph9n5\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.120596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3d6ae528-025a-4c40-be99-295e541bc058-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.120621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.120779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.120839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.120980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.121019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.121332 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.123419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.124080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3d6ae528-025a-4c40-be99-295e541bc058-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.125524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.132677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.133046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.133341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.145424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph9n5\" (UniqueName: \"kubernetes.io/projected/3d6ae528-025a-4c40-be99-295e541bc058-kube-api-access-ph9n5\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.167567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.304812 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.428026 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:13:16 crc kubenswrapper[4769]: W1121 13:13:16.447257 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532433c6_42b6_4674_977f_8a7a23614deb.slice/crio-501d14bbde170bbe0ddab107c607e47c5f5cd793a80b284ae680054a3135e663 WatchSource:0}: Error finding container 501d14bbde170bbe0ddab107c607e47c5f5cd793a80b284ae680054a3135e663: Status 404 returned error can't find the container with id 501d14bbde170bbe0ddab107c607e47c5f5cd793a80b284ae680054a3135e663 Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.707735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"83b015b4-b107-44ce-8778-c85241297661","Type":"ContainerStarted","Data":"631aa4b6557276b1abeae26b64b5406bfb6a6657d6772722d90336b583de1fd9"} Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.710169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"532433c6-42b6-4674-977f-8a7a23614deb","Type":"ContainerStarted","Data":"501d14bbde170bbe0ddab107c607e47c5f5cd793a80b284ae680054a3135e663"} Nov 21 13:13:16 crc kubenswrapper[4769]: I1121 13:13:16.783656 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.101217 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.102688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.104824 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.105003 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-tnvrp" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.109703 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.123271 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.240572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-memcached-tls-certs\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.240628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-config-data\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.240666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tbkk\" (UniqueName: \"kubernetes.io/projected/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kube-api-access-6tbkk\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.240707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kolla-config\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.240748 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-combined-ca-bundle\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.341906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kolla-config\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.342151 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-combined-ca-bundle\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.342404 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-memcached-tls-certs\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.342511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-config-data\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.342614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6tbkk\" (UniqueName: \"kubernetes.io/projected/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kube-api-access-6tbkk\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.342967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kolla-config\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.343705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-config-data\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.349278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-combined-ca-bundle\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.349938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-memcached-tls-certs\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.371116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tbkk\" (UniqueName: \"kubernetes.io/projected/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kube-api-access-6tbkk\") pod \"memcached-0\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.424651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.731757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"cdd3fc9d-251c-47d2-aba8-53f309ea4494","Type":"ContainerStarted","Data":"a50e9a2c71965c0e3d93aaf31a3e6a327478abb570b880a1080ec987676d30da"} Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.738783 4769 generic.go:334] "Generic (PLEG): container finished" podID="83b015b4-b107-44ce-8778-c85241297661" containerID="631aa4b6557276b1abeae26b64b5406bfb6a6657d6772722d90336b583de1fd9" exitCode=0 Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.738872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"83b015b4-b107-44ce-8778-c85241297661","Type":"ContainerDied","Data":"631aa4b6557276b1abeae26b64b5406bfb6a6657d6772722d90336b583de1fd9"} Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.742594 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d6ae528-025a-4c40-be99-295e541bc058" containerID="19a408de28f0d01d376dde732021ad9bfdfdbb558dd7a55704e8c3d02fef3da4" exitCode=0 Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.742651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3d6ae528-025a-4c40-be99-295e541bc058","Type":"ContainerDied","Data":"19a408de28f0d01d376dde732021ad9bfdfdbb558dd7a55704e8c3d02fef3da4"} Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.742682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3d6ae528-025a-4c40-be99-295e541bc058","Type":"ContainerStarted","Data":"a1029e176776a153868be42233574cc188fe3e53f5b0a4ce3ad159b76ad61b19"} Nov 21 13:13:17 crc kubenswrapper[4769]: I1121 13:13:17.901312 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.685687 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.687947 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.690908 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-bhtwm" Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.697119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.752567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"532433c6-42b6-4674-977f-8a7a23614deb","Type":"ContainerStarted","Data":"852d507c8ff43e9a30e35228cc317898ff5aab08f9ed7751045b05fdf80409fc"} Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.760077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"83b015b4-b107-44ce-8778-c85241297661","Type":"ContainerStarted","Data":"e359038b76ee6b67178f744ae7d73bbb1f08c8833fb8e7791663f2a46008db7a"} Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.764889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l927q\" (UniqueName: \"kubernetes.io/projected/7267e484-4b78-41c2-9483-b5ae5ec97a16-kube-api-access-l927q\") pod \"kube-state-metrics-0\" (UID: \"7267e484-4b78-41c2-9483-b5ae5ec97a16\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.769049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e763d05d-9c43-40a6-90a1-327f8fce3ca9","Type":"ContainerStarted","Data":"b68470f158ba2bee9a6e86c876a23815950ddfd2d545294b50afac21f6988e61"} Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.785826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3d6ae528-025a-4c40-be99-295e541bc058","Type":"ContainerStarted","Data":"6012866497a818b2eb3242b8ea796e5f2ab75d67f83647b6ec80a589a6a09c0e"} Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.805997 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=4.805981012 podStartE2EDuration="4.805981012s" podCreationTimestamp="2025-11-21 13:13:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:18.802350954 +0000 UTC m=+4957.503012782" watchObservedRunningTime="2025-11-21 13:13:18.805981012 +0000 UTC m=+4957.506642830" Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.867271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l927q\" (UniqueName: \"kubernetes.io/projected/7267e484-4b78-41c2-9483-b5ae5ec97a16-kube-api-access-l927q\") pod \"kube-state-metrics-0\" (UID: \"7267e484-4b78-41c2-9483-b5ae5ec97a16\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:18 crc kubenswrapper[4769]: I1121 13:13:18.885283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l927q\" (UniqueName: \"kubernetes.io/projected/7267e484-4b78-41c2-9483-b5ae5ec97a16-kube-api-access-l927q\") pod \"kube-state-metrics-0\" (UID: \"7267e484-4b78-41c2-9483-b5ae5ec97a16\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.041959 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.485597 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.797264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e763d05d-9c43-40a6-90a1-327f8fce3ca9","Type":"ContainerStarted","Data":"b9e0f9d1913bd3d590345d3ee7a8525a12723763fc8a3d5fe2146f70cdc50dff"} Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.797727 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.798723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7267e484-4b78-41c2-9483-b5ae5ec97a16","Type":"ContainerStarted","Data":"a84cf7d954aa66cd2af09e8fa0e004d0acc810bf9f6ab68bdf655a53d8825a00"} Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.828035 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.828016084 podStartE2EDuration="2.828016084s" podCreationTimestamp="2025-11-21 13:13:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:19.823361948 +0000 UTC m=+4958.524023766" watchObservedRunningTime="2025-11-21 13:13:19.828016084 +0000 UTC m=+4958.528677902" Nov 21 13:13:19 crc kubenswrapper[4769]: I1121 13:13:19.867804 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=4.867782035 podStartE2EDuration="4.867782035s" podCreationTimestamp="2025-11-21 13:13:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:19.851407064 +0000 UTC m=+4958.552068902" watchObservedRunningTime="2025-11-21 13:13:19.867782035 +0000 UTC m=+4958.568443853" Nov 21 13:13:20 crc kubenswrapper[4769]: E1121 13:13:20.750942 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:46988->38.102.83.227:40411: write tcp 38.102.83.227:46988->38.102.83.227:40411: write: broken pipe Nov 21 13:13:23 crc kubenswrapper[4769]: I1121 13:13:23.836556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7267e484-4b78-41c2-9483-b5ae5ec97a16","Type":"ContainerStarted","Data":"101c6f5202d1a7a43b823007df5b91d750a80c8bc33f7b4617e24eae79acf93f"} Nov 21 13:13:23 crc kubenswrapper[4769]: I1121 13:13:23.837124 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:23 crc kubenswrapper[4769]: I1121 13:13:23.858269 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.762399054 podStartE2EDuration="5.858243765s" podCreationTimestamp="2025-11-21 13:13:18 +0000 UTC" firstStartedPulling="2025-11-21 13:13:19.493451581 +0000 UTC m=+4958.194113399" lastFinishedPulling="2025-11-21 13:13:22.589296292 +0000 UTC m=+4961.289958110" observedRunningTime="2025-11-21 13:13:23.850396474 +0000 UTC m=+4962.551058292" watchObservedRunningTime="2025-11-21 13:13:23.858243765 +0000 UTC m=+4962.558905623" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.047260 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.050587 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.059557 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.059950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-nf9br" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.061213 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.062042 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.062734 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.082947 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.150811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.150892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.150922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8drnb\" (UniqueName: \"kubernetes.io/projected/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-kube-api-access-8drnb\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.150954 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.151032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.151055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-config\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.151175 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.151556 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.252704 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.252783 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.252852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.252905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.252945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8drnb\" (UniqueName: \"kubernetes.io/projected/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-kube-api-access-8drnb\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.252986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.253087 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.253122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-config\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.253169 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.253815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.256682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-config\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.257058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.259230 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.259647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.264867 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.273291 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8drnb\" (UniqueName: \"kubernetes.io/projected/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-kube-api-access-8drnb\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.287405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.423103 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.784237 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.784554 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:24 crc kubenswrapper[4769]: I1121 13:13:24.839435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.374416 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.376521 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.381933 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.381931 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.382130 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.383879 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-b5szn" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.385328 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32250b53-705a-499e-b2e8-f745a3819acf-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwsbw\" (UniqueName: \"kubernetes.io/projected/32250b53-705a-499e-b2e8-f745a3819acf-kube-api-access-wwsbw\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-config\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474694 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.474727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.576150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.576593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.576623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.576679 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.576728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.576762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32250b53-705a-499e-b2e8-f745a3819acf-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.577129 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.577694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wwsbw\" (UniqueName: \"kubernetes.io/projected/32250b53-705a-499e-b2e8-f745a3819acf-kube-api-access-wwsbw\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.577797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-config\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.577954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32250b53-705a-499e-b2e8-f745a3819acf-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.578004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.580284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.582102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-config\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.582310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.582333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.595859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwsbw\" (UniqueName: \"kubernetes.io/projected/32250b53-705a-499e-b2e8-f745a3819acf-kube-api-access-wwsbw\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.615034 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.638491 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.722334 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="galera" probeResult="failure" output=< Nov 21 13:13:25 crc kubenswrapper[4769]: wsrep_local_state_comment (Joined) differs from Synced Nov 21 13:13:25 crc kubenswrapper[4769]: > Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.735336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.866084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6","Type":"ContainerStarted","Data":"f0553c50f5eec7e176bccf6ac2753aabff874d027d03af13c52e385c1a0fbe27"} Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.866444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6","Type":"ContainerStarted","Data":"9d6d4e88f95dec7d35e7e30f8fbc9ebf77c7e965a737068c13d6e5967ab1a03d"} Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.866461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6","Type":"ContainerStarted","Data":"6a73dff3715516fde62c43de992c6bfbd38f46d816236af4e4f6f23b19a15b83"} Nov 21 13:13:25 crc kubenswrapper[4769]: I1121 13:13:25.896719 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.896698031 podStartE2EDuration="2.896698031s" podCreationTimestamp="2025-11-21 13:13:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:25.890919415 +0000 UTC m=+4964.591581233" watchObservedRunningTime="2025-11-21 13:13:25.896698031 +0000 UTC m=+4964.597359859" Nov 21 13:13:26 crc kubenswrapper[4769]: I1121 13:13:26.213413 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:13:26 crc kubenswrapper[4769]: W1121 13:13:26.217816 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32250b53_705a_499e_b2e8_f745a3819acf.slice/crio-2e78cb4772e56d47d118635b27e62605a4fb99ff5aad22ff2162f02859a89aeb WatchSource:0}: Error finding container 2e78cb4772e56d47d118635b27e62605a4fb99ff5aad22ff2162f02859a89aeb: Status 404 returned error can't find the container with id 2e78cb4772e56d47d118635b27e62605a4fb99ff5aad22ff2162f02859a89aeb Nov 21 13:13:26 crc kubenswrapper[4769]: I1121 13:13:26.305759 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:26 crc kubenswrapper[4769]: I1121 13:13:26.305834 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:26 crc kubenswrapper[4769]: I1121 13:13:26.428463 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:26 crc kubenswrapper[4769]: I1121 13:13:26.881019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"32250b53-705a-499e-b2e8-f745a3819acf","Type":"ContainerStarted","Data":"df8d1936f5e7274942337676c1b9c5c2d82487a181a6f28f8eba7af6efd88747"} Nov 21 13:13:26 crc kubenswrapper[4769]: I1121 13:13:26.881131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"32250b53-705a-499e-b2e8-f745a3819acf","Type":"ContainerStarted","Data":"2e78cb4772e56d47d118635b27e62605a4fb99ff5aad22ff2162f02859a89aeb"} Nov 21 13:13:27 crc kubenswrapper[4769]: I1121 13:13:27.001928 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:13:27 crc kubenswrapper[4769]: I1121 13:13:27.424615 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:27 crc kubenswrapper[4769]: I1121 13:13:27.425879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:13:27 crc kubenswrapper[4769]: I1121 13:13:27.892552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"32250b53-705a-499e-b2e8-f745a3819acf","Type":"ContainerStarted","Data":"33796b24c53ddaa1d99134f01001f34cb4ff061dc650bf57e1b5a0465a6e44d7"} Nov 21 13:13:27 crc kubenswrapper[4769]: I1121 13:13:27.914109 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=3.914081987 podStartE2EDuration="3.914081987s" podCreationTimestamp="2025-11-21 13:13:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:27.912061203 +0000 UTC m=+4966.612723051" watchObservedRunningTime="2025-11-21 13:13:27.914081987 +0000 UTC m=+4966.614743835" Nov 21 13:13:28 crc kubenswrapper[4769]: I1121 13:13:28.736312 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.051108 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.239531 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.250552 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.252971 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.253376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.253971 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-j85fb" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.254227 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.292643 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.315104 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-tlv5r"] Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.316459 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.319941 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.320163 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.320301 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.326095 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-tlv5r"] Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.353440 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.353544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-lock\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.353570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.353620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-cache\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.353661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96pj4\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-kube-api-access-96pj4\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.424756 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/120509e4-657e-40e6-be8c-cf569b931fa8-etc-swift\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-cache\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-96pj4\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-kube-api-access-96pj4\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455616 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-swiftconf\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455667 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-ring-data-devices\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzn52\" (UniqueName: \"kubernetes.io/projected/120509e4-657e-40e6-be8c-cf569b931fa8-kube-api-access-vzn52\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-dispersionconf\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-combined-ca-bundle\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-lock\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.455908 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-scripts\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.456458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-cache\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: E1121 13:13:29.456785 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:13:29 crc kubenswrapper[4769]: E1121 13:13:29.456802 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:13:29 crc kubenswrapper[4769]: E1121 13:13:29.456834 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift podName:66c82043-0b6b-4a5f-9c0c-826a19dc36d3 nodeName:}" failed. No retries permitted until 2025-11-21 13:13:29.956820738 +0000 UTC m=+4968.657482556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift") pod "swift-storage-0" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3") : configmap "swift-ring-files" not found Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.457225 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-lock\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.457531 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.557846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-ring-data-devices\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.557910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vzn52\" (UniqueName: \"kubernetes.io/projected/120509e4-657e-40e6-be8c-cf569b931fa8-kube-api-access-vzn52\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.557946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-dispersionconf\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.558008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-combined-ca-bundle\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.558782 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-ring-data-devices\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.558944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-scripts\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.559017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/120509e4-657e-40e6-be8c-cf569b931fa8-etc-swift\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.559563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-swiftconf\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.559638 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/120509e4-657e-40e6-be8c-cf569b931fa8-etc-swift\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.559771 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-scripts\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.581580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-96pj4\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-kube-api-access-96pj4\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.586718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-dispersionconf\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.588929 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzn52\" (UniqueName: \"kubernetes.io/projected/120509e4-657e-40e6-be8c-cf569b931fa8-kube-api-access-vzn52\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.590953 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-combined-ca-bundle\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.591510 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-swiftconf\") pod \"swift-ring-rebalance-tlv5r\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.612226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.640529 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:29 crc kubenswrapper[4769]: I1121 13:13:29.973874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:29 crc kubenswrapper[4769]: E1121 13:13:29.974055 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:13:29 crc kubenswrapper[4769]: E1121 13:13:29.974299 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:13:29 crc kubenswrapper[4769]: E1121 13:13:29.974363 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift podName:66c82043-0b6b-4a5f-9c0c-826a19dc36d3 nodeName:}" failed. No retries permitted until 2025-11-21 13:13:30.9743456 +0000 UTC m=+4969.675007428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift") pod "swift-storage-0" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3") : configmap "swift-ring-files" not found Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.059379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-tlv5r"] Nov 21 13:13:30 crc kubenswrapper[4769]: W1121 13:13:30.072094 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod120509e4_657e_40e6_be8c_cf569b931fa8.slice/crio-799a731e6be0d5735255fff5623d42341ca3b2ebfb520e738884bb4948bb972a WatchSource:0}: Error finding container 799a731e6be0d5735255fff5623d42341ca3b2ebfb520e738884bb4948bb972a: Status 404 returned error can't find the container with id 799a731e6be0d5735255fff5623d42341ca3b2ebfb520e738884bb4948bb972a Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.479220 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.548828 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.736760 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.938409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" event={"ID":"120509e4-657e-40e6-be8c-cf569b931fa8","Type":"ContainerStarted","Data":"f67d41496c8c1f43dcf14db061b50bfdac3bec1606a0213ae1bb4ba543bb1f81"} Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.938473 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" event={"ID":"120509e4-657e-40e6-be8c-cf569b931fa8","Type":"ContainerStarted","Data":"799a731e6be0d5735255fff5623d42341ca3b2ebfb520e738884bb4948bb972a"} Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.971272 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" podStartSLOduration=1.971252695 podStartE2EDuration="1.971252695s" podCreationTimestamp="2025-11-21 13:13:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:30.965834689 +0000 UTC m=+4969.666496517" watchObservedRunningTime="2025-11-21 13:13:30.971252695 +0000 UTC m=+4969.671914523" Nov 21 13:13:30 crc kubenswrapper[4769]: I1121 13:13:30.991658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:30 crc kubenswrapper[4769]: E1121 13:13:30.991945 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:13:30 crc kubenswrapper[4769]: E1121 13:13:30.991983 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:13:30 crc kubenswrapper[4769]: E1121 13:13:30.992058 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift podName:66c82043-0b6b-4a5f-9c0c-826a19dc36d3 nodeName:}" failed. No retries permitted until 2025-11-21 13:13:32.992032335 +0000 UTC m=+4971.692694153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift") pod "swift-storage-0" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3") : configmap "swift-ring-files" not found Nov 21 13:13:31 crc kubenswrapper[4769]: I1121 13:13:31.788663 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.025522 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.203229 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.204838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.206846 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.206846 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.208459 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-h5r64" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.208598 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.214714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316020 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-scripts\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-config\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8trk\" (UniqueName: \"kubernetes.io/projected/1ac90b6c-ad45-4800-992d-b89dc057f1e4-kube-api-access-f8trk\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316506 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.316601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-scripts\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-config\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f8trk\" (UniqueName: \"kubernetes.io/projected/1ac90b6c-ad45-4800-992d-b89dc057f1e4-kube-api-access-f8trk\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.418607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.419152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.419952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-scripts\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.420937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-config\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.427919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.429049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.439453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.453946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8trk\" (UniqueName: \"kubernetes.io/projected/1ac90b6c-ad45-4800-992d-b89dc057f1e4-kube-api-access-f8trk\") pod \"ovn-northd-0\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:32 crc kubenswrapper[4769]: I1121 13:13:32.541390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:33 crc kubenswrapper[4769]: I1121 13:13:33.028363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:33 crc kubenswrapper[4769]: E1121 13:13:33.028494 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:13:33 crc kubenswrapper[4769]: E1121 13:13:33.028814 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:13:33 crc kubenswrapper[4769]: E1121 13:13:33.028876 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift podName:66c82043-0b6b-4a5f-9c0c-826a19dc36d3 nodeName:}" failed. No retries permitted until 2025-11-21 13:13:37.028855936 +0000 UTC m=+4975.729517834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift") pod "swift-storage-0" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3") : configmap "swift-ring-files" not found Nov 21 13:13:33 crc kubenswrapper[4769]: I1121 13:13:33.031688 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:13:33 crc kubenswrapper[4769]: I1121 13:13:33.994594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1ac90b6c-ad45-4800-992d-b89dc057f1e4","Type":"ContainerStarted","Data":"e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb"} Nov 21 13:13:33 crc kubenswrapper[4769]: I1121 13:13:33.995027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1ac90b6c-ad45-4800-992d-b89dc057f1e4","Type":"ContainerStarted","Data":"2032dac41072527dfacde7f88ffd2811b15e71736e6a2ae55a0fa0a4d100fc7b"} Nov 21 13:13:34 crc kubenswrapper[4769]: I1121 13:13:34.886139 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:13:35 crc kubenswrapper[4769]: I1121 13:13:35.006933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1ac90b6c-ad45-4800-992d-b89dc057f1e4","Type":"ContainerStarted","Data":"8888f1576cd083e0c03bcf91d0135e5553e82f4a6bea4bc45184b3107c90ab67"} Nov 21 13:13:35 crc kubenswrapper[4769]: I1121 13:13:35.007201 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:35 crc kubenswrapper[4769]: I1121 13:13:35.027685 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.027671122 podStartE2EDuration="3.027671122s" podCreationTimestamp="2025-11-21 13:13:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:35.024137187 +0000 UTC m=+4973.724799005" watchObservedRunningTime="2025-11-21 13:13:35.027671122 +0000 UTC m=+4973.728332940" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.051978 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dk4kd"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.054142 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.076060 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dk4kd"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.112180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:37 crc kubenswrapper[4769]: E1121 13:13:37.112508 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:13:37 crc kubenswrapper[4769]: E1121 13:13:37.112529 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:13:37 crc kubenswrapper[4769]: E1121 13:13:37.112588 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift podName:66c82043-0b6b-4a5f-9c0c-826a19dc36d3 nodeName:}" failed. No retries permitted until 2025-11-21 13:13:45.112569798 +0000 UTC m=+4983.813231616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift") pod "swift-storage-0" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3") : configmap "swift-ring-files" not found Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.147824 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-1b74-account-create-mvhlv"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.150982 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.154761 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.168767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-1b74-account-create-mvhlv"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.214757 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a44a904-1fdb-4823-bb25-1e383dca3a29-operator-scripts\") pod \"keystone-db-create-dk4kd\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.214915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q76bq\" (UniqueName: \"kubernetes.io/projected/9a44a904-1fdb-4823-bb25-1e383dca3a29-kube-api-access-q76bq\") pod \"keystone-db-create-dk4kd\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.316700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25e3b1e9-f21b-4557-9e45-0549dd8929ff-operator-scripts\") pod \"keystone-1b74-account-create-mvhlv\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.316752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a44a904-1fdb-4823-bb25-1e383dca3a29-operator-scripts\") pod \"keystone-db-create-dk4kd\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.316808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqprm\" (UniqueName: \"kubernetes.io/projected/25e3b1e9-f21b-4557-9e45-0549dd8929ff-kube-api-access-hqprm\") pod \"keystone-1b74-account-create-mvhlv\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.316897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q76bq\" (UniqueName: \"kubernetes.io/projected/9a44a904-1fdb-4823-bb25-1e383dca3a29-kube-api-access-q76bq\") pod \"keystone-db-create-dk4kd\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.317671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a44a904-1fdb-4823-bb25-1e383dca3a29-operator-scripts\") pod \"keystone-db-create-dk4kd\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.353876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76bq\" (UniqueName: \"kubernetes.io/projected/9a44a904-1fdb-4823-bb25-1e383dca3a29-kube-api-access-q76bq\") pod \"keystone-db-create-dk4kd\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.355376 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-fgbqv"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.357506 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.366791 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fgbqv"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.389291 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.418390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hqprm\" (UniqueName: \"kubernetes.io/projected/25e3b1e9-f21b-4557-9e45-0549dd8929ff-kube-api-access-hqprm\") pod \"keystone-1b74-account-create-mvhlv\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.418627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25e3b1e9-f21b-4557-9e45-0549dd8929ff-operator-scripts\") pod \"keystone-1b74-account-create-mvhlv\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.419398 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25e3b1e9-f21b-4557-9e45-0549dd8929ff-operator-scripts\") pod \"keystone-1b74-account-create-mvhlv\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.446914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqprm\" (UniqueName: \"kubernetes.io/projected/25e3b1e9-f21b-4557-9e45-0549dd8929ff-kube-api-access-hqprm\") pod \"keystone-1b74-account-create-mvhlv\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.457532 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-87ee-account-create-mk6k4"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.458541 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.461340 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.467390 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-87ee-account-create-mk6k4"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.469870 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.521903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmxt\" (UniqueName: \"kubernetes.io/projected/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-kube-api-access-vqmxt\") pod \"placement-db-create-fgbqv\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.522444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-operator-scripts\") pod \"placement-db-create-fgbqv\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.585937 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-dkftj"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.587526 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.598179 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-dkftj"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.624472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmxt\" (UniqueName: \"kubernetes.io/projected/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-kube-api-access-vqmxt\") pod \"placement-db-create-fgbqv\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.624539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfb5z\" (UniqueName: \"kubernetes.io/projected/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-kube-api-access-lfb5z\") pod \"placement-87ee-account-create-mk6k4\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.624599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-operator-scripts\") pod \"placement-87ee-account-create-mk6k4\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.624749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-operator-scripts\") pod \"placement-db-create-fgbqv\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.625751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-operator-scripts\") pod \"placement-db-create-fgbqv\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.645565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmxt\" (UniqueName: \"kubernetes.io/projected/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-kube-api-access-vqmxt\") pod \"placement-db-create-fgbqv\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.701112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.726754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-operator-scripts\") pod \"glance-db-create-dkftj\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.726931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lfb5z\" (UniqueName: \"kubernetes.io/projected/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-kube-api-access-lfb5z\") pod \"placement-87ee-account-create-mk6k4\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.726978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p89mb\" (UniqueName: \"kubernetes.io/projected/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-kube-api-access-p89mb\") pod \"glance-db-create-dkftj\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.727017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-operator-scripts\") pod \"placement-87ee-account-create-mk6k4\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.727820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-operator-scripts\") pod \"placement-87ee-account-create-mk6k4\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.745011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfb5z\" (UniqueName: \"kubernetes.io/projected/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-kube-api-access-lfb5z\") pod \"placement-87ee-account-create-mk6k4\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.758331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-80a8-account-create-wdrsx"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.759675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.762925 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.770104 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-80a8-account-create-wdrsx"] Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.828523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-operator-scripts\") pod \"glance-db-create-dkftj\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.828646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p89mb\" (UniqueName: \"kubernetes.io/projected/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-kube-api-access-p89mb\") pod \"glance-db-create-dkftj\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.829363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-operator-scripts\") pod \"glance-db-create-dkftj\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.846238 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p89mb\" (UniqueName: \"kubernetes.io/projected/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-kube-api-access-p89mb\") pod \"glance-db-create-dkftj\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.861099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.872263 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dk4kd"] Nov 21 13:13:37 crc kubenswrapper[4769]: W1121 13:13:37.888749 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a44a904_1fdb_4823_bb25_1e383dca3a29.slice/crio-edc294e43141f9e5615a61fa7e2eaa1aa4c359f9851f003651fabe66e46ac8d1 WatchSource:0}: Error finding container edc294e43141f9e5615a61fa7e2eaa1aa4c359f9851f003651fabe66e46ac8d1: Status 404 returned error can't find the container with id edc294e43141f9e5615a61fa7e2eaa1aa4c359f9851f003651fabe66e46ac8d1 Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.908243 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.930594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/da23ab45-177b-4767-963b-56eb10bd7517-operator-scripts\") pod \"glance-80a8-account-create-wdrsx\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.930832 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgp9c\" (UniqueName: \"kubernetes.io/projected/da23ab45-177b-4767-963b-56eb10bd7517-kube-api-access-pgp9c\") pod \"glance-80a8-account-create-wdrsx\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:37 crc kubenswrapper[4769]: I1121 13:13:37.978773 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-1b74-account-create-mvhlv"] Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.032675 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/da23ab45-177b-4767-963b-56eb10bd7517-operator-scripts\") pod \"glance-80a8-account-create-wdrsx\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.032787 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pgp9c\" (UniqueName: \"kubernetes.io/projected/da23ab45-177b-4767-963b-56eb10bd7517-kube-api-access-pgp9c\") pod \"glance-80a8-account-create-wdrsx\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.033328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/da23ab45-177b-4767-963b-56eb10bd7517-operator-scripts\") pod \"glance-80a8-account-create-wdrsx\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.034026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" event={"ID":"9a44a904-1fdb-4823-bb25-1e383dca3a29","Type":"ContainerStarted","Data":"edc294e43141f9e5615a61fa7e2eaa1aa4c359f9851f003651fabe66e46ac8d1"} Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.039614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" event={"ID":"25e3b1e9-f21b-4557-9e45-0549dd8929ff","Type":"ContainerStarted","Data":"3b1e36544e9573e64a2f0d28d8cb86115eecbdfe45b4432faed4feb2b2062f54"} Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.049744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgp9c\" (UniqueName: \"kubernetes.io/projected/da23ab45-177b-4767-963b-56eb10bd7517-kube-api-access-pgp9c\") pod \"glance-80a8-account-create-wdrsx\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.082683 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.171443 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fgbqv"] Nov 21 13:13:38 crc kubenswrapper[4769]: W1121 13:13:38.172452 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1fedfb9_7d53_4e8d_8bf9_b5b7a3e69894.slice/crio-05c5c3c796cb420211c0a52ea7e65129634fc2a750f933e0de5b87427431c9d9 WatchSource:0}: Error finding container 05c5c3c796cb420211c0a52ea7e65129634fc2a750f933e0de5b87427431c9d9: Status 404 returned error can't find the container with id 05c5c3c796cb420211c0a52ea7e65129634fc2a750f933e0de5b87427431c9d9 Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.309862 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-87ee-account-create-mk6k4"] Nov 21 13:13:38 crc kubenswrapper[4769]: W1121 13:13:38.311270 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45cccfa6_c0ca_4ae1_a0a5_244d4dfedb98.slice/crio-e4bc0209121eed3a48c49221324f6b0ff43cf46f51a104c954a30eb4c0a750ec WatchSource:0}: Error finding container e4bc0209121eed3a48c49221324f6b0ff43cf46f51a104c954a30eb4c0a750ec: Status 404 returned error can't find the container with id e4bc0209121eed3a48c49221324f6b0ff43cf46f51a104c954a30eb4c0a750ec Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.387981 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-dkftj"] Nov 21 13:13:38 crc kubenswrapper[4769]: W1121 13:13:38.395473 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb213d15_7ca5_4e6e_ab56_f5a89ba7e33e.slice/crio-718827a2f62a0f1d478d0dec3dd4bbc04a705c59ee181a8a529710e3231e3212 WatchSource:0}: Error finding container 718827a2f62a0f1d478d0dec3dd4bbc04a705c59ee181a8a529710e3231e3212: Status 404 returned error can't find the container with id 718827a2f62a0f1d478d0dec3dd4bbc04a705c59ee181a8a529710e3231e3212 Nov 21 13:13:38 crc kubenswrapper[4769]: I1121 13:13:38.511098 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-80a8-account-create-wdrsx"] Nov 21 13:13:38 crc kubenswrapper[4769]: W1121 13:13:38.516602 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda23ab45_177b_4767_963b_56eb10bd7517.slice/crio-88e5bf0eede7fe6f798ded120473b63464123f1f381b218297cf5aecc9838d74 WatchSource:0}: Error finding container 88e5bf0eede7fe6f798ded120473b63464123f1f381b218297cf5aecc9838d74: Status 404 returned error can't find the container with id 88e5bf0eede7fe6f798ded120473b63464123f1f381b218297cf5aecc9838d74 Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.049439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" event={"ID":"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98","Type":"ContainerStarted","Data":"de9986a3c3152affa9b7c487a0dd95aa4fbf835e561e76cd7e6ec0c1b0af0ff4"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.049851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" event={"ID":"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98","Type":"ContainerStarted","Data":"e4bc0209121eed3a48c49221324f6b0ff43cf46f51a104c954a30eb4c0a750ec"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.051530 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fgbqv" event={"ID":"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894","Type":"ContainerStarted","Data":"95a0a0a2a1265e481d1d8de4eb87bb1af563c21a6ab68c11b0b04a2987bd3fe8"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.051561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fgbqv" event={"ID":"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894","Type":"ContainerStarted","Data":"05c5c3c796cb420211c0a52ea7e65129634fc2a750f933e0de5b87427431c9d9"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.053292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" event={"ID":"da23ab45-177b-4767-963b-56eb10bd7517","Type":"ContainerStarted","Data":"c8e97db73342e76610e33005e1f28cc2c2affce55abe35ee675912f8cf232fab"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.053320 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" event={"ID":"da23ab45-177b-4767-963b-56eb10bd7517","Type":"ContainerStarted","Data":"88e5bf0eede7fe6f798ded120473b63464123f1f381b218297cf5aecc9838d74"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.054641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" event={"ID":"25e3b1e9-f21b-4557-9e45-0549dd8929ff","Type":"ContainerStarted","Data":"f14c606d27d7b605ccd05b67d59beaab6421e29cb803c013a13d4a2879b1c2e2"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.055751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-dkftj" event={"ID":"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e","Type":"ContainerStarted","Data":"c1025be48415542cb22cc152c938853bd553d31da3b90c2018a820e45f256f34"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.055772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-dkftj" event={"ID":"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e","Type":"ContainerStarted","Data":"718827a2f62a0f1d478d0dec3dd4bbc04a705c59ee181a8a529710e3231e3212"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.056756 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" event={"ID":"9a44a904-1fdb-4823-bb25-1e383dca3a29","Type":"ContainerStarted","Data":"1e76fc7639de72039a1cb4d636b54e5e195b7213d97aeda7c97f3b1a23abc143"} Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.069651 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" podStartSLOduration=2.06963194 podStartE2EDuration="2.06963194s" podCreationTimestamp="2025-11-21 13:13:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:39.064780469 +0000 UTC m=+4977.765442337" watchObservedRunningTime="2025-11-21 13:13:39.06963194 +0000 UTC m=+4977.770293758" Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.090141 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" podStartSLOduration=2.090114322 podStartE2EDuration="2.090114322s" podCreationTimestamp="2025-11-21 13:13:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:39.083704499 +0000 UTC m=+4977.784366347" watchObservedRunningTime="2025-11-21 13:13:39.090114322 +0000 UTC m=+4977.790776180" Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.102134 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-dkftj" podStartSLOduration=2.102102574 podStartE2EDuration="2.102102574s" podCreationTimestamp="2025-11-21 13:13:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:39.099475194 +0000 UTC m=+4977.800137052" watchObservedRunningTime="2025-11-21 13:13:39.102102574 +0000 UTC m=+4977.802764432" Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.128008 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" podStartSLOduration=2.127981232 podStartE2EDuration="2.127981232s" podCreationTimestamp="2025-11-21 13:13:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:39.125717931 +0000 UTC m=+4977.826379759" watchObservedRunningTime="2025-11-21 13:13:39.127981232 +0000 UTC m=+4977.828643080" Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.149436 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" podStartSLOduration=2.149413439 podStartE2EDuration="2.149413439s" podCreationTimestamp="2025-11-21 13:13:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:39.138927796 +0000 UTC m=+4977.839589614" watchObservedRunningTime="2025-11-21 13:13:39.149413439 +0000 UTC m=+4977.850075267" Nov 21 13:13:39 crc kubenswrapper[4769]: I1121 13:13:39.158702 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-fgbqv" podStartSLOduration=2.158679819 podStartE2EDuration="2.158679819s" podCreationTimestamp="2025-11-21 13:13:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:39.154472705 +0000 UTC m=+4977.855134543" watchObservedRunningTime="2025-11-21 13:13:39.158679819 +0000 UTC m=+4977.859341637" Nov 21 13:13:40 crc kubenswrapper[4769]: I1121 13:13:40.076527 4769 generic.go:334] "Generic (PLEG): container finished" podID="9a44a904-1fdb-4823-bb25-1e383dca3a29" containerID="1e76fc7639de72039a1cb4d636b54e5e195b7213d97aeda7c97f3b1a23abc143" exitCode=0 Nov 21 13:13:40 crc kubenswrapper[4769]: I1121 13:13:40.078595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" event={"ID":"9a44a904-1fdb-4823-bb25-1e383dca3a29","Type":"ContainerDied","Data":"1e76fc7639de72039a1cb4d636b54e5e195b7213d97aeda7c97f3b1a23abc143"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.091937 4769 generic.go:334] "Generic (PLEG): container finished" podID="120509e4-657e-40e6-be8c-cf569b931fa8" containerID="f67d41496c8c1f43dcf14db061b50bfdac3bec1606a0213ae1bb4ba543bb1f81" exitCode=0 Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.092041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" event={"ID":"120509e4-657e-40e6-be8c-cf569b931fa8","Type":"ContainerDied","Data":"f67d41496c8c1f43dcf14db061b50bfdac3bec1606a0213ae1bb4ba543bb1f81"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.101545 4769 generic.go:334] "Generic (PLEG): container finished" podID="da23ab45-177b-4767-963b-56eb10bd7517" containerID="c8e97db73342e76610e33005e1f28cc2c2affce55abe35ee675912f8cf232fab" exitCode=0 Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.101598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" event={"ID":"da23ab45-177b-4767-963b-56eb10bd7517","Type":"ContainerDied","Data":"c8e97db73342e76610e33005e1f28cc2c2affce55abe35ee675912f8cf232fab"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.105005 4769 generic.go:334] "Generic (PLEG): container finished" podID="25e3b1e9-f21b-4557-9e45-0549dd8929ff" containerID="f14c606d27d7b605ccd05b67d59beaab6421e29cb803c013a13d4a2879b1c2e2" exitCode=0 Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.105064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" event={"ID":"25e3b1e9-f21b-4557-9e45-0549dd8929ff","Type":"ContainerDied","Data":"f14c606d27d7b605ccd05b67d59beaab6421e29cb803c013a13d4a2879b1c2e2"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.110177 4769 generic.go:334] "Generic (PLEG): container finished" podID="bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" containerID="c1025be48415542cb22cc152c938853bd553d31da3b90c2018a820e45f256f34" exitCode=0 Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.110281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-dkftj" event={"ID":"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e","Type":"ContainerDied","Data":"c1025be48415542cb22cc152c938853bd553d31da3b90c2018a820e45f256f34"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.114163 4769 generic.go:334] "Generic (PLEG): container finished" podID="45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" containerID="de9986a3c3152affa9b7c487a0dd95aa4fbf835e561e76cd7e6ec0c1b0af0ff4" exitCode=0 Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.114263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" event={"ID":"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98","Type":"ContainerDied","Data":"de9986a3c3152affa9b7c487a0dd95aa4fbf835e561e76cd7e6ec0c1b0af0ff4"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.123961 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" containerID="95a0a0a2a1265e481d1d8de4eb87bb1af563c21a6ab68c11b0b04a2987bd3fe8" exitCode=0 Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.124050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fgbqv" event={"ID":"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894","Type":"ContainerDied","Data":"95a0a0a2a1265e481d1d8de4eb87bb1af563c21a6ab68c11b0b04a2987bd3fe8"} Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.705291 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.799440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a44a904-1fdb-4823-bb25-1e383dca3a29-operator-scripts\") pod \"9a44a904-1fdb-4823-bb25-1e383dca3a29\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.799695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q76bq\" (UniqueName: \"kubernetes.io/projected/9a44a904-1fdb-4823-bb25-1e383dca3a29-kube-api-access-q76bq\") pod \"9a44a904-1fdb-4823-bb25-1e383dca3a29\" (UID: \"9a44a904-1fdb-4823-bb25-1e383dca3a29\") " Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.802777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a44a904-1fdb-4823-bb25-1e383dca3a29-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9a44a904-1fdb-4823-bb25-1e383dca3a29" (UID: "9a44a904-1fdb-4823-bb25-1e383dca3a29"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.809977 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a44a904-1fdb-4823-bb25-1e383dca3a29-kube-api-access-q76bq" (OuterVolumeSpecName: "kube-api-access-q76bq") pod "9a44a904-1fdb-4823-bb25-1e383dca3a29" (UID: "9a44a904-1fdb-4823-bb25-1e383dca3a29"). InnerVolumeSpecName "kube-api-access-q76bq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.901885 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a44a904-1fdb-4823-bb25-1e383dca3a29-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:41 crc kubenswrapper[4769]: I1121 13:13:41.901921 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q76bq\" (UniqueName: \"kubernetes.io/projected/9a44a904-1fdb-4823-bb25-1e383dca3a29-kube-api-access-q76bq\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.144810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.144892 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dk4kd" event={"ID":"9a44a904-1fdb-4823-bb25-1e383dca3a29","Type":"ContainerDied","Data":"edc294e43141f9e5615a61fa7e2eaa1aa4c359f9851f003651fabe66e46ac8d1"} Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.144947 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edc294e43141f9e5615a61fa7e2eaa1aa4c359f9851f003651fabe66e46ac8d1" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.631605 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-scripts\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzn52\" (UniqueName: \"kubernetes.io/projected/120509e4-657e-40e6-be8c-cf569b931fa8-kube-api-access-vzn52\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-swiftconf\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-combined-ca-bundle\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-dispersionconf\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-ring-data-devices\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.718748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/120509e4-657e-40e6-be8c-cf569b931fa8-etc-swift\") pod \"120509e4-657e-40e6-be8c-cf569b931fa8\" (UID: \"120509e4-657e-40e6-be8c-cf569b931fa8\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.720117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.722550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/120509e4-657e-40e6-be8c-cf569b931fa8-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.724510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120509e4-657e-40e6-be8c-cf569b931fa8-kube-api-access-vzn52" (OuterVolumeSpecName: "kube-api-access-vzn52") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "kube-api-access-vzn52". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.726498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.757010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-scripts" (OuterVolumeSpecName: "scripts") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.760030 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.767740 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "120509e4-657e-40e6-be8c-cf569b931fa8" (UID: "120509e4-657e-40e6-be8c-cf569b931fa8"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820673 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vzn52\" (UniqueName: \"kubernetes.io/projected/120509e4-657e-40e6-be8c-cf569b931fa8-kube-api-access-vzn52\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820708 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820718 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820726 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/120509e4-657e-40e6-be8c-cf569b931fa8-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820736 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820744 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/120509e4-657e-40e6-be8c-cf569b931fa8-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.820754 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/120509e4-657e-40e6-be8c-cf569b931fa8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.846515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.853531 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.868549 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.887354 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.894950 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.921454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgp9c\" (UniqueName: \"kubernetes.io/projected/da23ab45-177b-4767-963b-56eb10bd7517-kube-api-access-pgp9c\") pod \"da23ab45-177b-4767-963b-56eb10bd7517\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.921636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25e3b1e9-f21b-4557-9e45-0549dd8929ff-operator-scripts\") pod \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.921674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/da23ab45-177b-4767-963b-56eb10bd7517-operator-scripts\") pod \"da23ab45-177b-4767-963b-56eb10bd7517\" (UID: \"da23ab45-177b-4767-963b-56eb10bd7517\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.921714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqprm\" (UniqueName: \"kubernetes.io/projected/25e3b1e9-f21b-4557-9e45-0549dd8929ff-kube-api-access-hqprm\") pod \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\" (UID: \"25e3b1e9-f21b-4557-9e45-0549dd8929ff\") " Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.922357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25e3b1e9-f21b-4557-9e45-0549dd8929ff-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "25e3b1e9-f21b-4557-9e45-0549dd8929ff" (UID: "25e3b1e9-f21b-4557-9e45-0549dd8929ff"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.922708 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da23ab45-177b-4767-963b-56eb10bd7517-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "da23ab45-177b-4767-963b-56eb10bd7517" (UID: "da23ab45-177b-4767-963b-56eb10bd7517"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.927862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e3b1e9-f21b-4557-9e45-0549dd8929ff-kube-api-access-hqprm" (OuterVolumeSpecName: "kube-api-access-hqprm") pod "25e3b1e9-f21b-4557-9e45-0549dd8929ff" (UID: "25e3b1e9-f21b-4557-9e45-0549dd8929ff"). InnerVolumeSpecName "kube-api-access-hqprm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:42 crc kubenswrapper[4769]: I1121 13:13:42.929389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da23ab45-177b-4767-963b-56eb10bd7517-kube-api-access-pgp9c" (OuterVolumeSpecName: "kube-api-access-pgp9c") pod "da23ab45-177b-4767-963b-56eb10bd7517" (UID: "da23ab45-177b-4767-963b-56eb10bd7517"). InnerVolumeSpecName "kube-api-access-pgp9c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.023710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-operator-scripts\") pod \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.023771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-operator-scripts\") pod \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.023864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p89mb\" (UniqueName: \"kubernetes.io/projected/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-kube-api-access-p89mb\") pod \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\" (UID: \"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e\") " Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.023899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfb5z\" (UniqueName: \"kubernetes.io/projected/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-kube-api-access-lfb5z\") pod \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.023918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqmxt\" (UniqueName: \"kubernetes.io/projected/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-kube-api-access-vqmxt\") pod \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\" (UID: \"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894\") " Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.023967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-operator-scripts\") pod \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\" (UID: \"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98\") " Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.024370 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/25e3b1e9-f21b-4557-9e45-0549dd8929ff-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.024384 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/da23ab45-177b-4767-963b-56eb10bd7517-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.024393 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hqprm\" (UniqueName: \"kubernetes.io/projected/25e3b1e9-f21b-4557-9e45-0549dd8929ff-kube-api-access-hqprm\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.024425 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pgp9c\" (UniqueName: \"kubernetes.io/projected/da23ab45-177b-4767-963b-56eb10bd7517-kube-api-access-pgp9c\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.024845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" (UID: "bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.024926 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" (UID: "b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.025090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" (UID: "45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.027909 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-kube-api-access-p89mb" (OuterVolumeSpecName: "kube-api-access-p89mb") pod "bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" (UID: "bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e"). InnerVolumeSpecName "kube-api-access-p89mb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.027995 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-kube-api-access-lfb5z" (OuterVolumeSpecName: "kube-api-access-lfb5z") pod "45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" (UID: "45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98"). InnerVolumeSpecName "kube-api-access-lfb5z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.029215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-kube-api-access-vqmxt" (OuterVolumeSpecName: "kube-api-access-vqmxt") pod "b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" (UID: "b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894"). InnerVolumeSpecName "kube-api-access-vqmxt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.125871 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.126155 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.126371 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.126515 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p89mb\" (UniqueName: \"kubernetes.io/projected/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e-kube-api-access-p89mb\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.126646 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lfb5z\" (UniqueName: \"kubernetes.io/projected/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98-kube-api-access-lfb5z\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.126799 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vqmxt\" (UniqueName: \"kubernetes.io/projected/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894-kube-api-access-vqmxt\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.161688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" event={"ID":"45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98","Type":"ContainerDied","Data":"e4bc0209121eed3a48c49221324f6b0ff43cf46f51a104c954a30eb4c0a750ec"} Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.161731 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4bc0209121eed3a48c49221324f6b0ff43cf46f51a104c954a30eb4c0a750ec" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.161755 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-87ee-account-create-mk6k4" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.168409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-fgbqv" event={"ID":"b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894","Type":"ContainerDied","Data":"05c5c3c796cb420211c0a52ea7e65129634fc2a750f933e0de5b87427431c9d9"} Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.168508 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05c5c3c796cb420211c0a52ea7e65129634fc2a750f933e0de5b87427431c9d9" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.168604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-fgbqv" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.199073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" event={"ID":"120509e4-657e-40e6-be8c-cf569b931fa8","Type":"ContainerDied","Data":"799a731e6be0d5735255fff5623d42341ca3b2ebfb520e738884bb4948bb972a"} Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.199120 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="799a731e6be0d5735255fff5623d42341ca3b2ebfb520e738884bb4948bb972a" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.199269 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-tlv5r" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.210539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" event={"ID":"da23ab45-177b-4767-963b-56eb10bd7517","Type":"ContainerDied","Data":"88e5bf0eede7fe6f798ded120473b63464123f1f381b218297cf5aecc9838d74"} Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.210584 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88e5bf0eede7fe6f798ded120473b63464123f1f381b218297cf5aecc9838d74" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.210650 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-80a8-account-create-wdrsx" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.216842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" event={"ID":"25e3b1e9-f21b-4557-9e45-0549dd8929ff","Type":"ContainerDied","Data":"3b1e36544e9573e64a2f0d28d8cb86115eecbdfe45b4432faed4feb2b2062f54"} Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.216899 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b1e36544e9573e64a2f0d28d8cb86115eecbdfe45b4432faed4feb2b2062f54" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.217014 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-1b74-account-create-mvhlv" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.225538 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-dkftj" event={"ID":"bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e","Type":"ContainerDied","Data":"718827a2f62a0f1d478d0dec3dd4bbc04a705c59ee181a8a529710e3231e3212"} Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.225579 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="718827a2f62a0f1d478d0dec3dd4bbc04a705c59ee181a8a529710e3231e3212" Nov 21 13:13:43 crc kubenswrapper[4769]: I1121 13:13:43.225639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-dkftj" Nov 21 13:13:45 crc kubenswrapper[4769]: I1121 13:13:45.172527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:45 crc kubenswrapper[4769]: I1121 13:13:45.183446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"swift-storage-0\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:45 crc kubenswrapper[4769]: I1121 13:13:45.481491 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.633533 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.895562 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-smrhb"] Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896122 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896133 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896148 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="da23ab45-177b-4767-963b-56eb10bd7517" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896154 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="da23ab45-177b-4767-963b-56eb10bd7517" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896174 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9a44a904-1fdb-4823-bb25-1e383dca3a29" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896181 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a44a904-1fdb-4823-bb25-1e383dca3a29" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896210 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896215 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896225 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="120509e4-657e-40e6-be8c-cf569b931fa8" containerName="swift-ring-rebalance" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896230 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="120509e4-657e-40e6-be8c-cf569b931fa8" containerName="swift-ring-rebalance" Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896239 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896245 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: E1121 13:13:47.896256 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25e3b1e9-f21b-4557-9e45-0549dd8929ff" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896261 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3b1e9-f21b-4557-9e45-0549dd8929ff" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896406 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896420 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896429 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="da23ab45-177b-4767-963b-56eb10bd7517" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896444 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="120509e4-657e-40e6-be8c-cf569b931fa8" containerName="swift-ring-rebalance" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896452 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25e3b1e9-f21b-4557-9e45-0549dd8929ff" containerName="mariadb-account-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9a44a904-1fdb-4823-bb25-1e383dca3a29" containerName="mariadb-database-create" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.896956 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.901437 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.903262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-bklzq" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:47.904885 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-smrhb"] Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.029526 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmj8m\" (UniqueName: \"kubernetes.io/projected/95da8079-c38d-4d8a-b573-1251c28fdec0-kube-api-access-zmj8m\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.029585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-config-data\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.029604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-combined-ca-bundle\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.029764 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-db-sync-config-data\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.131270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zmj8m\" (UniqueName: \"kubernetes.io/projected/95da8079-c38d-4d8a-b573-1251c28fdec0-kube-api-access-zmj8m\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.131363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-config-data\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.131405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-combined-ca-bundle\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.131475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-db-sync-config-data\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.138827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-config-data\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.139846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-combined-ca-bundle\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.155106 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-db-sync-config-data\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.156989 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmj8m\" (UniqueName: \"kubernetes.io/projected/95da8079-c38d-4d8a-b573-1251c28fdec0-kube-api-access-zmj8m\") pod \"glance-db-sync-smrhb\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.213932 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.315152 4769 scope.go:117] "RemoveContainer" containerID="6b002a16fee0b7c04f60dcc573e09454ec74d7777fc4112eb630fb3aeac97e8f" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.365519 4769 scope.go:117] "RemoveContainer" containerID="98fa8fad19d35ab5261db85d75889bb666b8f577808831d2497851c06e4f6148" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.396401 4769 scope.go:117] "RemoveContainer" containerID="630b09fc44a905b1df9534dd63c47b371a6650e61c2ada95422d930e2a39e5d0" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.422698 4769 scope.go:117] "RemoveContainer" containerID="0ede93cfcedc5b730fc364279a516a0ac8430755b385354b583d7fecd4c4ed2b" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.442846 4769 scope.go:117] "RemoveContainer" containerID="bbdb4389df758ad4f1de57e0bf913d0e0a703f7bd23214fdc23f1781fd689ae1" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.462730 4769 scope.go:117] "RemoveContainer" containerID="2cfc347d39ad0f86dd559e8d66234bcb38d810d8807c0228d01fc9f3d53831b5" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.485608 4769 scope.go:117] "RemoveContainer" containerID="e5c850067e6dc734296c14a3a39e614a776748728e46009b22ee9adf1e1b288d" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.525504 4769 scope.go:117] "RemoveContainer" containerID="49853b2d4b4be27a262d79e0727dbb40515dd28bbab25415aefb0a1bc3c9abb0" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.554876 4769 scope.go:117] "RemoveContainer" containerID="63b25d61889f9733f6d860f4e4d227397127c75af2d786c4cf6a6e9ea63fe3fe" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:48.576580 4769 scope.go:117] "RemoveContainer" containerID="92fad9c5ab2b64db4adf9719700f72d5abb28d8704ea800d220e90c5c8ebde58" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:49.304706 4769 generic.go:334] "Generic (PLEG): container finished" podID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerID="a50e9a2c71965c0e3d93aaf31a3e6a327478abb570b880a1080ec987676d30da" exitCode=0 Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:49.304799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"cdd3fc9d-251c-47d2-aba8-53f309ea4494","Type":"ContainerDied","Data":"a50e9a2c71965c0e3d93aaf31a3e6a327478abb570b880a1080ec987676d30da"} Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:50.328547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"cdd3fc9d-251c-47d2-aba8-53f309ea4494","Type":"ContainerStarted","Data":"6b8b64d1841f7133ce1191474f0746d6f3e25dec326fdc438f460624b3a44758"} Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:50.329410 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:50.331098 4769 generic.go:334] "Generic (PLEG): container finished" podID="532433c6-42b6-4674-977f-8a7a23614deb" containerID="852d507c8ff43e9a30e35228cc317898ff5aab08f9ed7751045b05fdf80409fc" exitCode=0 Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:50.331137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"532433c6-42b6-4674-977f-8a7a23614deb","Type":"ContainerDied","Data":"852d507c8ff43e9a30e35228cc317898ff5aab08f9ed7751045b05fdf80409fc"} Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:50.372089 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=38.372066179 podStartE2EDuration="38.372066179s" podCreationTimestamp="2025-11-21 13:13:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:50.370321602 +0000 UTC m=+4989.070983440" watchObservedRunningTime="2025-11-21 13:13:50.372066179 +0000 UTC m=+4989.072728007" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:51.287908 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:51.339279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"b7563f827fc865ef1cd73859710a731d44c30a095f7eeff7a09db21856d98287"} Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:51.341939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"532433c6-42b6-4674-977f-8a7a23614deb","Type":"ContainerStarted","Data":"e5f71ffb25e3e61b208f6c7926eecbd32eaee9d7fa57daac62217c0abf303717"} Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:51.342232 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:51.367106 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.367086415 podStartE2EDuration="37.367086415s" podCreationTimestamp="2025-11-21 13:13:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:51.36652662 +0000 UTC m=+4990.067188448" watchObservedRunningTime="2025-11-21 13:13:51.367086415 +0000 UTC m=+4990.067748243" Nov 21 13:13:51 crc kubenswrapper[4769]: I1121 13:13:51.464277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-smrhb"] Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.354165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-smrhb" event={"ID":"95da8079-c38d-4d8a-b573-1251c28fdec0","Type":"ContainerStarted","Data":"b5866afb2228684413a3d45b29fadf6034e172c4940bcf2e1b9e6ab6a930e528"} Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.354731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-smrhb" event={"ID":"95da8079-c38d-4d8a-b573-1251c28fdec0","Type":"ContainerStarted","Data":"a08c04f0e5eb976d821b56f360d91896065934e98c306c144199d434a53e632e"} Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.356432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0"} Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.356469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111"} Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.356482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f"} Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.356492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d"} Nov 21 13:13:52 crc kubenswrapper[4769]: I1121 13:13:52.372286 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-smrhb" podStartSLOduration=5.372259373 podStartE2EDuration="5.372259373s" podCreationTimestamp="2025-11-21 13:13:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:52.370076174 +0000 UTC m=+4991.070737992" watchObservedRunningTime="2025-11-21 13:13:52.372259373 +0000 UTC m=+4991.072921191" Nov 21 13:13:53 crc kubenswrapper[4769]: I1121 13:13:53.373269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358"} Nov 21 13:13:53 crc kubenswrapper[4769]: I1121 13:13:53.373313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655"} Nov 21 13:13:54 crc kubenswrapper[4769]: I1121 13:13:54.389134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf"} Nov 21 13:13:54 crc kubenswrapper[4769]: I1121 13:13:54.389898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926"} Nov 21 13:13:54 crc kubenswrapper[4769]: I1121 13:13:54.389915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9"} Nov 21 13:13:54 crc kubenswrapper[4769]: I1121 13:13:54.389926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a"} Nov 21 13:13:55 crc kubenswrapper[4769]: I1121 13:13:55.408319 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587"} Nov 21 13:13:55 crc kubenswrapper[4769]: I1121 13:13:55.408991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954"} Nov 21 13:13:55 crc kubenswrapper[4769]: I1121 13:13:55.409014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a"} Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.417115 4769 generic.go:334] "Generic (PLEG): container finished" podID="95da8079-c38d-4d8a-b573-1251c28fdec0" containerID="b5866afb2228684413a3d45b29fadf6034e172c4940bcf2e1b9e6ab6a930e528" exitCode=0 Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.417228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-smrhb" event={"ID":"95da8079-c38d-4d8a-b573-1251c28fdec0","Type":"ContainerDied","Data":"b5866afb2228684413a3d45b29fadf6034e172c4940bcf2e1b9e6ab6a930e528"} Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.423293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20"} Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.423519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerStarted","Data":"e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df"} Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.480064 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=27.480042863 podStartE2EDuration="27.480042863s" podCreationTimestamp="2025-11-21 13:13:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:56.475052719 +0000 UTC m=+4995.175714537" watchObservedRunningTime="2025-11-21 13:13:56.480042863 +0000 UTC m=+4995.180704681" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.615047 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z"] Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.616449 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.622118 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.633264 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z"] Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.724348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2t74\" (UniqueName: \"kubernetes.io/projected/5aed6b53-02ed-4c72-a91a-2f8d750be346-kube-api-access-s2t74\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.724419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.724729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-config\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.725017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.827746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2t74\" (UniqueName: \"kubernetes.io/projected/5aed6b53-02ed-4c72-a91a-2f8d750be346-kube-api-access-s2t74\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.827807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.827898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-config\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.828726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.828734 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-config\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.828862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.829544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.849421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2t74\" (UniqueName: \"kubernetes.io/projected/5aed6b53-02ed-4c72-a91a-2f8d750be346-kube-api-access-s2t74\") pod \"dnsmasq-dnsmasq-75f856ddc7-znl2z\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:56 crc kubenswrapper[4769]: I1121 13:13:56.934403 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.402529 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z"] Nov 21 13:13:57 crc kubenswrapper[4769]: W1121 13:13:57.407905 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5aed6b53_02ed_4c72_a91a_2f8d750be346.slice/crio-bf539fbe751ce60df28547e6c63684f7afb6786ecaf397e1889dd80a0fcbb8b4 WatchSource:0}: Error finding container bf539fbe751ce60df28547e6c63684f7afb6786ecaf397e1889dd80a0fcbb8b4: Status 404 returned error can't find the container with id bf539fbe751ce60df28547e6c63684f7afb6786ecaf397e1889dd80a0fcbb8b4 Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.437414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" event={"ID":"5aed6b53-02ed-4c72-a91a-2f8d750be346","Type":"ContainerStarted","Data":"bf539fbe751ce60df28547e6c63684f7afb6786ecaf397e1889dd80a0fcbb8b4"} Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.677555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.848285 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmj8m\" (UniqueName: \"kubernetes.io/projected/95da8079-c38d-4d8a-b573-1251c28fdec0-kube-api-access-zmj8m\") pod \"95da8079-c38d-4d8a-b573-1251c28fdec0\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.848585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-db-sync-config-data\") pod \"95da8079-c38d-4d8a-b573-1251c28fdec0\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.848762 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-config-data\") pod \"95da8079-c38d-4d8a-b573-1251c28fdec0\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.849927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-combined-ca-bundle\") pod \"95da8079-c38d-4d8a-b573-1251c28fdec0\" (UID: \"95da8079-c38d-4d8a-b573-1251c28fdec0\") " Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.855672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "95da8079-c38d-4d8a-b573-1251c28fdec0" (UID: "95da8079-c38d-4d8a-b573-1251c28fdec0"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.856307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95da8079-c38d-4d8a-b573-1251c28fdec0-kube-api-access-zmj8m" (OuterVolumeSpecName: "kube-api-access-zmj8m") pod "95da8079-c38d-4d8a-b573-1251c28fdec0" (UID: "95da8079-c38d-4d8a-b573-1251c28fdec0"). InnerVolumeSpecName "kube-api-access-zmj8m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.913352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "95da8079-c38d-4d8a-b573-1251c28fdec0" (UID: "95da8079-c38d-4d8a-b573-1251c28fdec0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.919488 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-config-data" (OuterVolumeSpecName: "config-data") pod "95da8079-c38d-4d8a-b573-1251c28fdec0" (UID: "95da8079-c38d-4d8a-b573-1251c28fdec0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.953659 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zmj8m\" (UniqueName: \"kubernetes.io/projected/95da8079-c38d-4d8a-b573-1251c28fdec0-kube-api-access-zmj8m\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.953707 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.953722 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:57 crc kubenswrapper[4769]: I1121 13:13:57.953734 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95da8079-c38d-4d8a-b573-1251c28fdec0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:13:58 crc kubenswrapper[4769]: I1121 13:13:58.455544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-smrhb" event={"ID":"95da8079-c38d-4d8a-b573-1251c28fdec0","Type":"ContainerDied","Data":"a08c04f0e5eb976d821b56f360d91896065934e98c306c144199d434a53e632e"} Nov 21 13:13:58 crc kubenswrapper[4769]: I1121 13:13:58.456069 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a08c04f0e5eb976d821b56f360d91896065934e98c306c144199d434a53e632e" Nov 21 13:13:58 crc kubenswrapper[4769]: I1121 13:13:58.455580 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-smrhb" Nov 21 13:13:58 crc kubenswrapper[4769]: I1121 13:13:58.457466 4769 generic.go:334] "Generic (PLEG): container finished" podID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerID="aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff" exitCode=0 Nov 21 13:13:58 crc kubenswrapper[4769]: I1121 13:13:58.457531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" event={"ID":"5aed6b53-02ed-4c72-a91a-2f8d750be346","Type":"ContainerDied","Data":"aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff"} Nov 21 13:13:59 crc kubenswrapper[4769]: I1121 13:13:59.481710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" event={"ID":"5aed6b53-02ed-4c72-a91a-2f8d750be346","Type":"ContainerStarted","Data":"ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c"} Nov 21 13:13:59 crc kubenswrapper[4769]: I1121 13:13:59.482167 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:13:59 crc kubenswrapper[4769]: I1121 13:13:59.499461 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" podStartSLOduration=3.499444944 podStartE2EDuration="3.499444944s" podCreationTimestamp="2025-11-21 13:13:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:13:59.496641228 +0000 UTC m=+4998.197303066" watchObservedRunningTime="2025-11-21 13:13:59.499444944 +0000 UTC m=+4998.200106762" Nov 21 13:14:04 crc kubenswrapper[4769]: I1121 13:14:04.367137 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:14:05 crc kubenswrapper[4769]: I1121 13:14:05.987375 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.272027 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s5kcn"] Nov 21 13:14:06 crc kubenswrapper[4769]: E1121 13:14:06.272694 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95da8079-c38d-4d8a-b573-1251c28fdec0" containerName="glance-db-sync" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.272712 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95da8079-c38d-4d8a-b573-1251c28fdec0" containerName="glance-db-sync" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.272900 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95da8079-c38d-4d8a-b573-1251c28fdec0" containerName="glance-db-sync" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.273451 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.294852 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s5kcn"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.376833 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-8885-account-create-x7frl"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.377838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.381149 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.393854 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-8885-account-create-x7frl"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.408251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69486421-e690-4d51-b0e8-b3c319cd058b-operator-scripts\") pod \"barbican-db-create-s5kcn\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.408298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgg8\" (UniqueName: \"kubernetes.io/projected/69486421-e690-4d51-b0e8-b3c319cd058b-kube-api-access-vbgg8\") pod \"barbican-db-create-s5kcn\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.461223 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-8z25b"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.462369 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.477643 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-aa33-account-create-4gmsv"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.478733 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.482541 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-8z25b"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.488179 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.500976 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-aa33-account-create-4gmsv"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.509395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxt2\" (UniqueName: \"kubernetes.io/projected/fa487be8-a1c5-460b-991c-d171c4048851-kube-api-access-6lxt2\") pod \"cinder-8885-account-create-x7frl\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.509455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa487be8-a1c5-460b-991c-d171c4048851-operator-scripts\") pod \"cinder-8885-account-create-x7frl\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.509499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69486421-e690-4d51-b0e8-b3c319cd058b-operator-scripts\") pod \"barbican-db-create-s5kcn\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.509524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgg8\" (UniqueName: \"kubernetes.io/projected/69486421-e690-4d51-b0e8-b3c319cd058b-kube-api-access-vbgg8\") pod \"barbican-db-create-s5kcn\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.510539 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69486421-e690-4d51-b0e8-b3c319cd058b-operator-scripts\") pod \"barbican-db-create-s5kcn\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.549496 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgg8\" (UniqueName: \"kubernetes.io/projected/69486421-e690-4d51-b0e8-b3c319cd058b-kube-api-access-vbgg8\") pod \"barbican-db-create-s5kcn\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.571561 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cb8pt"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.572959 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.583855 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cb8pt"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.591978 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.611134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxt2\" (UniqueName: \"kubernetes.io/projected/fa487be8-a1c5-460b-991c-d171c4048851-kube-api-access-6lxt2\") pod \"cinder-8885-account-create-x7frl\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.611197 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa487be8-a1c5-460b-991c-d171c4048851-operator-scripts\") pod \"cinder-8885-account-create-x7frl\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.611228 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cd784d1-60a3-4d8f-94c9-7ed460143f00-operator-scripts\") pod \"cinder-db-create-8z25b\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.611259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3962bd7f-0adf-4443-9d35-6f726f976e5e-operator-scripts\") pod \"barbican-aa33-account-create-4gmsv\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.611292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ghz\" (UniqueName: \"kubernetes.io/projected/3962bd7f-0adf-4443-9d35-6f726f976e5e-kube-api-access-f2ghz\") pod \"barbican-aa33-account-create-4gmsv\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.611331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx4z5\" (UniqueName: \"kubernetes.io/projected/0cd784d1-60a3-4d8f-94c9-7ed460143f00-kube-api-access-mx4z5\") pod \"cinder-db-create-8z25b\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.612636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa487be8-a1c5-460b-991c-d171c4048851-operator-scripts\") pod \"cinder-8885-account-create-x7frl\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.627625 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-hhcgp"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.628632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.637146 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.637252 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.637486 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-rt6qk" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.637682 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.643441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-hhcgp"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.645164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxt2\" (UniqueName: \"kubernetes.io/projected/fa487be8-a1c5-460b-991c-d171c4048851-kube-api-access-6lxt2\") pod \"cinder-8885-account-create-x7frl\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.680734 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-985a-account-create-xv7tg"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.682369 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.685146 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.690891 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-985a-account-create-xv7tg"] Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.697367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.713631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mx4z5\" (UniqueName: \"kubernetes.io/projected/0cd784d1-60a3-4d8f-94c9-7ed460143f00-kube-api-access-mx4z5\") pod \"cinder-db-create-8z25b\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.713744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rwfj\" (UniqueName: \"kubernetes.io/projected/ac295c82-00b1-4c2a-930d-3abbe3157018-kube-api-access-7rwfj\") pod \"neutron-db-create-cb8pt\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.713787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac295c82-00b1-4c2a-930d-3abbe3157018-operator-scripts\") pod \"neutron-db-create-cb8pt\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.713849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cd784d1-60a3-4d8f-94c9-7ed460143f00-operator-scripts\") pod \"cinder-db-create-8z25b\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.713897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3962bd7f-0adf-4443-9d35-6f726f976e5e-operator-scripts\") pod \"barbican-aa33-account-create-4gmsv\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.713971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ghz\" (UniqueName: \"kubernetes.io/projected/3962bd7f-0adf-4443-9d35-6f726f976e5e-kube-api-access-f2ghz\") pod \"barbican-aa33-account-create-4gmsv\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.714817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3962bd7f-0adf-4443-9d35-6f726f976e5e-operator-scripts\") pod \"barbican-aa33-account-create-4gmsv\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7rwfj\" (UniqueName: \"kubernetes.io/projected/ac295c82-00b1-4c2a-930d-3abbe3157018-kube-api-access-7rwfj\") pod \"neutron-db-create-cb8pt\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816124 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b80cab6-1658-446e-9925-04195053566e-operator-scripts\") pod \"neutron-985a-account-create-xv7tg\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac295c82-00b1-4c2a-930d-3abbe3157018-operator-scripts\") pod \"neutron-db-create-cb8pt\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrtdh\" (UniqueName: \"kubernetes.io/projected/2b80cab6-1658-446e-9925-04195053566e-kube-api-access-rrtdh\") pod \"neutron-985a-account-create-xv7tg\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816202 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-combined-ca-bundle\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-config-data\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.816361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4jb\" (UniqueName: \"kubernetes.io/projected/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-kube-api-access-zv4jb\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.918013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-config-data\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.918108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4jb\" (UniqueName: \"kubernetes.io/projected/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-kube-api-access-zv4jb\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.918215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b80cab6-1658-446e-9925-04195053566e-operator-scripts\") pod \"neutron-985a-account-create-xv7tg\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.918273 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rrtdh\" (UniqueName: \"kubernetes.io/projected/2b80cab6-1658-446e-9925-04195053566e-kube-api-access-rrtdh\") pod \"neutron-985a-account-create-xv7tg\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.918498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-combined-ca-bundle\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.936548 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:14:06 crc kubenswrapper[4769]: I1121 13:14:06.990170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cd784d1-60a3-4d8f-94c9-7ed460143f00-operator-scripts\") pod \"cinder-db-create-8z25b\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.005792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b80cab6-1658-446e-9925-04195053566e-operator-scripts\") pod \"neutron-985a-account-create-xv7tg\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.006920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-config-data\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.007366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac295c82-00b1-4c2a-930d-3abbe3157018-operator-scripts\") pod \"neutron-db-create-cb8pt\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.011508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrtdh\" (UniqueName: \"kubernetes.io/projected/2b80cab6-1658-446e-9925-04195053566e-kube-api-access-rrtdh\") pod \"neutron-985a-account-create-xv7tg\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.012866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ghz\" (UniqueName: \"kubernetes.io/projected/3962bd7f-0adf-4443-9d35-6f726f976e5e-kube-api-access-f2ghz\") pod \"barbican-aa33-account-create-4gmsv\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.015167 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr"] Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.016761 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerName="dnsmasq-dns" containerID="cri-o://54fc00a8bf30a0c326304765e15a4f1d196451a370b1d2f6ee676f022617e099" gracePeriod=10 Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.016889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-combined-ca-bundle\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.017804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rwfj\" (UniqueName: \"kubernetes.io/projected/ac295c82-00b1-4c2a-930d-3abbe3157018-kube-api-access-7rwfj\") pod \"neutron-db-create-cb8pt\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.031659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx4z5\" (UniqueName: \"kubernetes.io/projected/0cd784d1-60a3-4d8f-94c9-7ed460143f00-kube-api-access-mx4z5\") pod \"cinder-db-create-8z25b\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.040700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4jb\" (UniqueName: \"kubernetes.io/projected/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-kube-api-access-zv4jb\") pod \"keystone-db-sync-hhcgp\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.078260 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.097728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.284321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.295171 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.303740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.569989 4769 generic.go:334] "Generic (PLEG): container finished" podID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerID="54fc00a8bf30a0c326304765e15a4f1d196451a370b1d2f6ee676f022617e099" exitCode=0 Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.570344 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" event={"ID":"6919fe80-c60f-4450-9a82-e985d9f546e3","Type":"ContainerDied","Data":"54fc00a8bf30a0c326304765e15a4f1d196451a370b1d2f6ee676f022617e099"} Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.571639 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s5kcn"] Nov 21 13:14:07 crc kubenswrapper[4769]: W1121 13:14:07.577353 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69486421_e690_4d51_b0e8_b3c319cd058b.slice/crio-c73236823848540ec28abb1cc2745a270ac95a086b4407ee3e2cddc58e0d55ee WatchSource:0}: Error finding container c73236823848540ec28abb1cc2745a270ac95a086b4407ee3e2cddc58e0d55ee: Status 404 returned error can't find the container with id c73236823848540ec28abb1cc2745a270ac95a086b4407ee3e2cddc58e0d55ee Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.662614 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-8z25b"] Nov 21 13:14:07 crc kubenswrapper[4769]: W1121 13:14:07.669408 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cd784d1_60a3_4d8f_94c9_7ed460143f00.slice/crio-804c5b39906666fec400ca1e8b4f00881f29e947fac1ede195d6af625ba2f25f WatchSource:0}: Error finding container 804c5b39906666fec400ca1e8b4f00881f29e947fac1ede195d6af625ba2f25f: Status 404 returned error can't find the container with id 804c5b39906666fec400ca1e8b4f00881f29e947fac1ede195d6af625ba2f25f Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.722235 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-8885-account-create-x7frl"] Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.732725 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-aa33-account-create-4gmsv"] Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.927879 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-hhcgp"] Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.943286 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cb8pt"] Nov 21 13:14:07 crc kubenswrapper[4769]: W1121 13:14:07.946338 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac295c82_00b1_4c2a_930d_3abbe3157018.slice/crio-a04540a38bcd50bf2929b28e6066e466baf910510decc44152a7592cfa9278ef WatchSource:0}: Error finding container a04540a38bcd50bf2929b28e6066e466baf910510decc44152a7592cfa9278ef: Status 404 returned error can't find the container with id a04540a38bcd50bf2929b28e6066e466baf910510decc44152a7592cfa9278ef Nov 21 13:14:07 crc kubenswrapper[4769]: I1121 13:14:07.951727 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-985a-account-create-xv7tg"] Nov 21 13:14:07 crc kubenswrapper[4769]: W1121 13:14:07.966387 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cf3f41a_698e_45cf_8660_4a2f1318ea4a.slice/crio-ae69b2bad657ecd64d2e424bb5e4847fab55645b13aba138453000c77c7a6e45 WatchSource:0}: Error finding container ae69b2bad657ecd64d2e424bb5e4847fab55645b13aba138453000c77c7a6e45: Status 404 returned error can't find the container with id ae69b2bad657ecd64d2e424bb5e4847fab55645b13aba138453000c77c7a6e45 Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.108003 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.244950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dml9l\" (UniqueName: \"kubernetes.io/projected/6919fe80-c60f-4450-9a82-e985d9f546e3-kube-api-access-dml9l\") pod \"6919fe80-c60f-4450-9a82-e985d9f546e3\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.245050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-config\") pod \"6919fe80-c60f-4450-9a82-e985d9f546e3\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.245171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-dnsmasq-svc\") pod \"6919fe80-c60f-4450-9a82-e985d9f546e3\" (UID: \"6919fe80-c60f-4450-9a82-e985d9f546e3\") " Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.249316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6919fe80-c60f-4450-9a82-e985d9f546e3-kube-api-access-dml9l" (OuterVolumeSpecName: "kube-api-access-dml9l") pod "6919fe80-c60f-4450-9a82-e985d9f546e3" (UID: "6919fe80-c60f-4450-9a82-e985d9f546e3"). InnerVolumeSpecName "kube-api-access-dml9l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.289489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6919fe80-c60f-4450-9a82-e985d9f546e3" (UID: "6919fe80-c60f-4450-9a82-e985d9f546e3"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.296217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-config" (OuterVolumeSpecName: "config") pod "6919fe80-c60f-4450-9a82-e985d9f546e3" (UID: "6919fe80-c60f-4450-9a82-e985d9f546e3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.347594 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dml9l\" (UniqueName: \"kubernetes.io/projected/6919fe80-c60f-4450-9a82-e985d9f546e3-kube-api-access-dml9l\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.348141 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.348154 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6919fe80-c60f-4450-9a82-e985d9f546e3-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.582280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" event={"ID":"2b80cab6-1658-446e-9925-04195053566e","Type":"ContainerStarted","Data":"97f2750132e9f7caaacb72fa44fe20c18905687023f1aa4e388e0ee2179b939f"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.582321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" event={"ID":"2b80cab6-1658-446e-9925-04195053566e","Type":"ContainerStarted","Data":"ca9170c4f95d25463bb7d2805f57bc1384493e7e3119af9b28c86a0fb8904170"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.585394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-8z25b" event={"ID":"0cd784d1-60a3-4d8f-94c9-7ed460143f00","Type":"ContainerStarted","Data":"623ccaec758e4ab39094e84c9bb46910eebf9f4e1155d8b0858a1087a5b003b2"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.585419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-8z25b" event={"ID":"0cd784d1-60a3-4d8f-94c9-7ed460143f00","Type":"ContainerStarted","Data":"804c5b39906666fec400ca1e8b4f00881f29e947fac1ede195d6af625ba2f25f"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.587481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" event={"ID":"69486421-e690-4d51-b0e8-b3c319cd058b","Type":"ContainerStarted","Data":"c8f2fff6a14b3215f0778bfc5b8b99e0cb0131450ee2427fd5c534a2eb58ed7e"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.587504 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" event={"ID":"69486421-e690-4d51-b0e8-b3c319cd058b","Type":"ContainerStarted","Data":"c73236823848540ec28abb1cc2745a270ac95a086b4407ee3e2cddc58e0d55ee"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.590493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" event={"ID":"6919fe80-c60f-4450-9a82-e985d9f546e3","Type":"ContainerDied","Data":"a4a371c213edb7e297ea4fa5e6a143400e44260f561f4425f66372fb119a2c40"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.590522 4769 scope.go:117] "RemoveContainer" containerID="54fc00a8bf30a0c326304765e15a4f1d196451a370b1d2f6ee676f022617e099" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.590621 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.602838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" event={"ID":"ac295c82-00b1-4c2a-930d-3abbe3157018","Type":"ContainerStarted","Data":"8a1793d8a587cf3fee59f9961bbb086ed83949770673a457a92e6694575bbfba"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.602895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" event={"ID":"ac295c82-00b1-4c2a-930d-3abbe3157018","Type":"ContainerStarted","Data":"a04540a38bcd50bf2929b28e6066e466baf910510decc44152a7592cfa9278ef"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.606724 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" podStartSLOduration=2.606694187 podStartE2EDuration="2.606694187s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.602011361 +0000 UTC m=+5007.302673179" watchObservedRunningTime="2025-11-21 13:14:08.606694187 +0000 UTC m=+5007.307356005" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.607939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" event={"ID":"3962bd7f-0adf-4443-9d35-6f726f976e5e","Type":"ContainerStarted","Data":"b8544fee26f33428b6d15938baa05558a0c4362225037c5b18cf86e141d9491c"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.608492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" event={"ID":"3962bd7f-0adf-4443-9d35-6f726f976e5e","Type":"ContainerStarted","Data":"a8686b1ed93939ff5631da087809853d33d074ce2a399196aeceb477ec98d2a0"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.610704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" event={"ID":"2cf3f41a-698e-45cf-8660-4a2f1318ea4a","Type":"ContainerStarted","Data":"60a80f6557d630aa193f55460d9c2638cddeefc491430a4f05863f7c38e3dfd8"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.610753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" event={"ID":"2cf3f41a-698e-45cf-8660-4a2f1318ea4a","Type":"ContainerStarted","Data":"ae69b2bad657ecd64d2e424bb5e4847fab55645b13aba138453000c77c7a6e45"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.614258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" event={"ID":"fa487be8-a1c5-460b-991c-d171c4048851","Type":"ContainerStarted","Data":"550a5254a71684f89a21383641e5c81589873856cd29cc354f66029c28da76b7"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.614474 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" event={"ID":"fa487be8-a1c5-460b-991c-d171c4048851","Type":"ContainerStarted","Data":"9d9eeba5666a8f521608b1190fb70ed7302687ba5d63bf4b5055a9389db03f2c"} Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.625244 4769 scope.go:117] "RemoveContainer" containerID="7a56f3e1f629cd5d33c5600857120f3ad831d7a794c96d067f9437504e993c28" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.627693 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" podStartSLOduration=2.627673322 podStartE2EDuration="2.627673322s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.618796273 +0000 UTC m=+5007.319458101" watchObservedRunningTime="2025-11-21 13:14:08.627673322 +0000 UTC m=+5007.328335140" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.656029 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-8z25b" podStartSLOduration=2.656000525 podStartE2EDuration="2.656000525s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.634496236 +0000 UTC m=+5007.335158064" watchObservedRunningTime="2025-11-21 13:14:08.656000525 +0000 UTC m=+5007.356662343" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.660743 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" podStartSLOduration=2.660728393 podStartE2EDuration="2.660728393s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.654079034 +0000 UTC m=+5007.354740852" watchObservedRunningTime="2025-11-21 13:14:08.660728393 +0000 UTC m=+5007.361390211" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.677210 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" podStartSLOduration=2.6771706159999997 podStartE2EDuration="2.677170616s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.671603826 +0000 UTC m=+5007.372265654" watchObservedRunningTime="2025-11-21 13:14:08.677170616 +0000 UTC m=+5007.377832434" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.698181 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" podStartSLOduration=2.698161991 podStartE2EDuration="2.698161991s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.693368722 +0000 UTC m=+5007.394030540" watchObservedRunningTime="2025-11-21 13:14:08.698161991 +0000 UTC m=+5007.398823809" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.729688 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" podStartSLOduration=2.7296635 podStartE2EDuration="2.7296635s" podCreationTimestamp="2025-11-21 13:14:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:08.713077913 +0000 UTC m=+5007.413739731" watchObservedRunningTime="2025-11-21 13:14:08.7296635 +0000 UTC m=+5007.430325318" Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.731615 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr"] Nov 21 13:14:08 crc kubenswrapper[4769]: I1121 13:14:08.738380 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-hhwjr"] Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.289097 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" path="/var/lib/kubelet/pods/6919fe80-c60f-4450-9a82-e985d9f546e3/volumes" Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.628435 4769 generic.go:334] "Generic (PLEG): container finished" podID="69486421-e690-4d51-b0e8-b3c319cd058b" containerID="c8f2fff6a14b3215f0778bfc5b8b99e0cb0131450ee2427fd5c534a2eb58ed7e" exitCode=0 Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.628474 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" event={"ID":"69486421-e690-4d51-b0e8-b3c319cd058b","Type":"ContainerDied","Data":"c8f2fff6a14b3215f0778bfc5b8b99e0cb0131450ee2427fd5c534a2eb58ed7e"} Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.634241 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac295c82-00b1-4c2a-930d-3abbe3157018" containerID="8a1793d8a587cf3fee59f9961bbb086ed83949770673a457a92e6694575bbfba" exitCode=0 Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.634313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" event={"ID":"ac295c82-00b1-4c2a-930d-3abbe3157018","Type":"ContainerDied","Data":"8a1793d8a587cf3fee59f9961bbb086ed83949770673a457a92e6694575bbfba"} Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.636310 4769 generic.go:334] "Generic (PLEG): container finished" podID="3962bd7f-0adf-4443-9d35-6f726f976e5e" containerID="b8544fee26f33428b6d15938baa05558a0c4362225037c5b18cf86e141d9491c" exitCode=0 Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.636416 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" event={"ID":"3962bd7f-0adf-4443-9d35-6f726f976e5e","Type":"ContainerDied","Data":"b8544fee26f33428b6d15938baa05558a0c4362225037c5b18cf86e141d9491c"} Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.638867 4769 generic.go:334] "Generic (PLEG): container finished" podID="fa487be8-a1c5-460b-991c-d171c4048851" containerID="550a5254a71684f89a21383641e5c81589873856cd29cc354f66029c28da76b7" exitCode=0 Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.638922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" event={"ID":"fa487be8-a1c5-460b-991c-d171c4048851","Type":"ContainerDied","Data":"550a5254a71684f89a21383641e5c81589873856cd29cc354f66029c28da76b7"} Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.644481 4769 generic.go:334] "Generic (PLEG): container finished" podID="2b80cab6-1658-446e-9925-04195053566e" containerID="97f2750132e9f7caaacb72fa44fe20c18905687023f1aa4e388e0ee2179b939f" exitCode=0 Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.644558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" event={"ID":"2b80cab6-1658-446e-9925-04195053566e","Type":"ContainerDied","Data":"97f2750132e9f7caaacb72fa44fe20c18905687023f1aa4e388e0ee2179b939f"} Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.647437 4769 generic.go:334] "Generic (PLEG): container finished" podID="0cd784d1-60a3-4d8f-94c9-7ed460143f00" containerID="623ccaec758e4ab39094e84c9bb46910eebf9f4e1155d8b0858a1087a5b003b2" exitCode=0 Nov 21 13:14:09 crc kubenswrapper[4769]: I1121 13:14:09.647587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-8z25b" event={"ID":"0cd784d1-60a3-4d8f-94c9-7ed460143f00","Type":"ContainerDied","Data":"623ccaec758e4ab39094e84c9bb46910eebf9f4e1155d8b0858a1087a5b003b2"} Nov 21 13:14:10 crc kubenswrapper[4769]: I1121 13:14:10.666427 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cf3f41a-698e-45cf-8660-4a2f1318ea4a" containerID="60a80f6557d630aa193f55460d9c2638cddeefc491430a4f05863f7c38e3dfd8" exitCode=0 Nov 21 13:14:10 crc kubenswrapper[4769]: I1121 13:14:10.666659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" event={"ID":"2cf3f41a-698e-45cf-8660-4a2f1318ea4a","Type":"ContainerDied","Data":"60a80f6557d630aa193f55460d9c2638cddeefc491430a4f05863f7c38e3dfd8"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.522266 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.528699 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.541692 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.557976 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.565065 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.578153 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.613075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbgg8\" (UniqueName: \"kubernetes.io/projected/69486421-e690-4d51-b0e8-b3c319cd058b-kube-api-access-vbgg8\") pod \"69486421-e690-4d51-b0e8-b3c319cd058b\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.613137 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2ghz\" (UniqueName: \"kubernetes.io/projected/3962bd7f-0adf-4443-9d35-6f726f976e5e-kube-api-access-f2ghz\") pod \"3962bd7f-0adf-4443-9d35-6f726f976e5e\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.613249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69486421-e690-4d51-b0e8-b3c319cd058b-operator-scripts\") pod \"69486421-e690-4d51-b0e8-b3c319cd058b\" (UID: \"69486421-e690-4d51-b0e8-b3c319cd058b\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.613275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3962bd7f-0adf-4443-9d35-6f726f976e5e-operator-scripts\") pod \"3962bd7f-0adf-4443-9d35-6f726f976e5e\" (UID: \"3962bd7f-0adf-4443-9d35-6f726f976e5e\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.615112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69486421-e690-4d51-b0e8-b3c319cd058b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "69486421-e690-4d51-b0e8-b3c319cd058b" (UID: "69486421-e690-4d51-b0e8-b3c319cd058b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.615217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3962bd7f-0adf-4443-9d35-6f726f976e5e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3962bd7f-0adf-4443-9d35-6f726f976e5e" (UID: "3962bd7f-0adf-4443-9d35-6f726f976e5e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.621414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3962bd7f-0adf-4443-9d35-6f726f976e5e-kube-api-access-f2ghz" (OuterVolumeSpecName: "kube-api-access-f2ghz") pod "3962bd7f-0adf-4443-9d35-6f726f976e5e" (UID: "3962bd7f-0adf-4443-9d35-6f726f976e5e"). InnerVolumeSpecName "kube-api-access-f2ghz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.622402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69486421-e690-4d51-b0e8-b3c319cd058b-kube-api-access-vbgg8" (OuterVolumeSpecName: "kube-api-access-vbgg8") pod "69486421-e690-4d51-b0e8-b3c319cd058b" (UID: "69486421-e690-4d51-b0e8-b3c319cd058b"). InnerVolumeSpecName "kube-api-access-vbgg8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.681281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" event={"ID":"3962bd7f-0adf-4443-9d35-6f726f976e5e","Type":"ContainerDied","Data":"a8686b1ed93939ff5631da087809853d33d074ce2a399196aeceb477ec98d2a0"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.681318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-aa33-account-create-4gmsv" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.681325 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8686b1ed93939ff5631da087809853d33d074ce2a399196aeceb477ec98d2a0" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.683492 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.683489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8885-account-create-x7frl" event={"ID":"fa487be8-a1c5-460b-991c-d171c4048851","Type":"ContainerDied","Data":"9d9eeba5666a8f521608b1190fb70ed7302687ba5d63bf4b5055a9389db03f2c"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.683618 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d9eeba5666a8f521608b1190fb70ed7302687ba5d63bf4b5055a9389db03f2c" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.684977 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.684969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-985a-account-create-xv7tg" event={"ID":"2b80cab6-1658-446e-9925-04195053566e","Type":"ContainerDied","Data":"ca9170c4f95d25463bb7d2805f57bc1384493e7e3119af9b28c86a0fb8904170"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.685121 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca9170c4f95d25463bb7d2805f57bc1384493e7e3119af9b28c86a0fb8904170" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.686724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-8z25b" event={"ID":"0cd784d1-60a3-4d8f-94c9-7ed460143f00","Type":"ContainerDied","Data":"804c5b39906666fec400ca1e8b4f00881f29e947fac1ede195d6af625ba2f25f"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.686757 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="804c5b39906666fec400ca1e8b4f00881f29e947fac1ede195d6af625ba2f25f" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.686736 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-8z25b" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.688553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" event={"ID":"69486421-e690-4d51-b0e8-b3c319cd058b","Type":"ContainerDied","Data":"c73236823848540ec28abb1cc2745a270ac95a086b4407ee3e2cddc58e0d55ee"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.688576 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c73236823848540ec28abb1cc2745a270ac95a086b4407ee3e2cddc58e0d55ee" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.688590 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-s5kcn" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.693289 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.693517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-cb8pt" event={"ID":"ac295c82-00b1-4c2a-930d-3abbe3157018","Type":"ContainerDied","Data":"a04540a38bcd50bf2929b28e6066e466baf910510decc44152a7592cfa9278ef"} Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.693540 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a04540a38bcd50bf2929b28e6066e466baf910510decc44152a7592cfa9278ef" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx4z5\" (UniqueName: \"kubernetes.io/projected/0cd784d1-60a3-4d8f-94c9-7ed460143f00-kube-api-access-mx4z5\") pod \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa487be8-a1c5-460b-991c-d171c4048851-operator-scripts\") pod \"fa487be8-a1c5-460b-991c-d171c4048851\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715821 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cd784d1-60a3-4d8f-94c9-7ed460143f00-operator-scripts\") pod \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\" (UID: \"0cd784d1-60a3-4d8f-94c9-7ed460143f00\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac295c82-00b1-4c2a-930d-3abbe3157018-operator-scripts\") pod \"ac295c82-00b1-4c2a-930d-3abbe3157018\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rwfj\" (UniqueName: \"kubernetes.io/projected/ac295c82-00b1-4c2a-930d-3abbe3157018-kube-api-access-7rwfj\") pod \"ac295c82-00b1-4c2a-930d-3abbe3157018\" (UID: \"ac295c82-00b1-4c2a-930d-3abbe3157018\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715968 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b80cab6-1658-446e-9925-04195053566e-operator-scripts\") pod \"2b80cab6-1658-446e-9925-04195053566e\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.715998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrtdh\" (UniqueName: \"kubernetes.io/projected/2b80cab6-1658-446e-9925-04195053566e-kube-api-access-rrtdh\") pod \"2b80cab6-1658-446e-9925-04195053566e\" (UID: \"2b80cab6-1658-446e-9925-04195053566e\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lxt2\" (UniqueName: \"kubernetes.io/projected/fa487be8-a1c5-460b-991c-d171c4048851-kube-api-access-6lxt2\") pod \"fa487be8-a1c5-460b-991c-d171c4048851\" (UID: \"fa487be8-a1c5-460b-991c-d171c4048851\") " Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716478 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/69486421-e690-4d51-b0e8-b3c319cd058b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716498 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3962bd7f-0adf-4443-9d35-6f726f976e5e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716509 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vbgg8\" (UniqueName: \"kubernetes.io/projected/69486421-e690-4d51-b0e8-b3c319cd058b-kube-api-access-vbgg8\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716518 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f2ghz\" (UniqueName: \"kubernetes.io/projected/3962bd7f-0adf-4443-9d35-6f726f976e5e-kube-api-access-f2ghz\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716488 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa487be8-a1c5-460b-991c-d171c4048851-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fa487be8-a1c5-460b-991c-d171c4048851" (UID: "fa487be8-a1c5-460b-991c-d171c4048851"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716889 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cd784d1-60a3-4d8f-94c9-7ed460143f00-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0cd784d1-60a3-4d8f-94c9-7ed460143f00" (UID: "0cd784d1-60a3-4d8f-94c9-7ed460143f00"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.716982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b80cab6-1658-446e-9925-04195053566e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2b80cab6-1658-446e-9925-04195053566e" (UID: "2b80cab6-1658-446e-9925-04195053566e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.717056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac295c82-00b1-4c2a-930d-3abbe3157018-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ac295c82-00b1-4c2a-930d-3abbe3157018" (UID: "ac295c82-00b1-4c2a-930d-3abbe3157018"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.718910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd784d1-60a3-4d8f-94c9-7ed460143f00-kube-api-access-mx4z5" (OuterVolumeSpecName: "kube-api-access-mx4z5") pod "0cd784d1-60a3-4d8f-94c9-7ed460143f00" (UID: "0cd784d1-60a3-4d8f-94c9-7ed460143f00"). InnerVolumeSpecName "kube-api-access-mx4z5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.720130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b80cab6-1658-446e-9925-04195053566e-kube-api-access-rrtdh" (OuterVolumeSpecName: "kube-api-access-rrtdh") pod "2b80cab6-1658-446e-9925-04195053566e" (UID: "2b80cab6-1658-446e-9925-04195053566e"). InnerVolumeSpecName "kube-api-access-rrtdh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.720670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa487be8-a1c5-460b-991c-d171c4048851-kube-api-access-6lxt2" (OuterVolumeSpecName: "kube-api-access-6lxt2") pod "fa487be8-a1c5-460b-991c-d171c4048851" (UID: "fa487be8-a1c5-460b-991c-d171c4048851"). InnerVolumeSpecName "kube-api-access-6lxt2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.722243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac295c82-00b1-4c2a-930d-3abbe3157018-kube-api-access-7rwfj" (OuterVolumeSpecName: "kube-api-access-7rwfj") pod "ac295c82-00b1-4c2a-930d-3abbe3157018" (UID: "ac295c82-00b1-4c2a-930d-3abbe3157018"). InnerVolumeSpecName "kube-api-access-7rwfj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817832 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0cd784d1-60a3-4d8f-94c9-7ed460143f00-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817868 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac295c82-00b1-4c2a-930d-3abbe3157018-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817878 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7rwfj\" (UniqueName: \"kubernetes.io/projected/ac295c82-00b1-4c2a-930d-3abbe3157018-kube-api-access-7rwfj\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817890 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2b80cab6-1658-446e-9925-04195053566e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817899 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rrtdh\" (UniqueName: \"kubernetes.io/projected/2b80cab6-1658-446e-9925-04195053566e-kube-api-access-rrtdh\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817909 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6lxt2\" (UniqueName: \"kubernetes.io/projected/fa487be8-a1c5-460b-991c-d171c4048851-kube-api-access-6lxt2\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817917 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mx4z5\" (UniqueName: \"kubernetes.io/projected/0cd784d1-60a3-4d8f-94c9-7ed460143f00-kube-api-access-mx4z5\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.817926 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fa487be8-a1c5-460b-991c-d171c4048851-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:11 crc kubenswrapper[4769]: I1121 13:14:11.997665 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.126852 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-config-data\") pod \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.126954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-combined-ca-bundle\") pod \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.127076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4jb\" (UniqueName: \"kubernetes.io/projected/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-kube-api-access-zv4jb\") pod \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\" (UID: \"2cf3f41a-698e-45cf-8660-4a2f1318ea4a\") " Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.133801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-kube-api-access-zv4jb" (OuterVolumeSpecName: "kube-api-access-zv4jb") pod "2cf3f41a-698e-45cf-8660-4a2f1318ea4a" (UID: "2cf3f41a-698e-45cf-8660-4a2f1318ea4a"). InnerVolumeSpecName "kube-api-access-zv4jb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.173289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cf3f41a-698e-45cf-8660-4a2f1318ea4a" (UID: "2cf3f41a-698e-45cf-8660-4a2f1318ea4a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.185521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-config-data" (OuterVolumeSpecName: "config-data") pod "2cf3f41a-698e-45cf-8660-4a2f1318ea4a" (UID: "2cf3f41a-698e-45cf-8660-4a2f1318ea4a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.228500 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zv4jb\" (UniqueName: \"kubernetes.io/projected/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-kube-api-access-zv4jb\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.228530 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.228540 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf3f41a-698e-45cf-8660-4a2f1318ea4a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.721481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" event={"ID":"2cf3f41a-698e-45cf-8660-4a2f1318ea4a","Type":"ContainerDied","Data":"ae69b2bad657ecd64d2e424bb5e4847fab55645b13aba138453000c77c7a6e45"} Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.721534 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae69b2bad657ecd64d2e424bb5e4847fab55645b13aba138453000c77c7a6e45" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.721620 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-hhcgp" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.892302 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4vtb5"] Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893027 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3962bd7f-0adf-4443-9d35-6f726f976e5e" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3962bd7f-0adf-4443-9d35-6f726f976e5e" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893065 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac295c82-00b1-4c2a-930d-3abbe3157018" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893071 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac295c82-00b1-4c2a-930d-3abbe3157018" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2b80cab6-1658-446e-9925-04195053566e" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893090 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b80cab6-1658-446e-9925-04195053566e" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893103 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0cd784d1-60a3-4d8f-94c9-7ed460143f00" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893109 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd784d1-60a3-4d8f-94c9-7ed460143f00" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893115 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerName="dnsmasq-dns" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893121 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerName="dnsmasq-dns" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893135 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cf3f41a-698e-45cf-8660-4a2f1318ea4a" containerName="keystone-db-sync" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893141 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf3f41a-698e-45cf-8660-4a2f1318ea4a" containerName="keystone-db-sync" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893150 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerName="init" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893156 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerName="init" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fa487be8-a1c5-460b-991c-d171c4048851" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa487be8-a1c5-460b-991c-d171c4048851" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: E1121 13:14:12.893206 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="69486421-e690-4d51-b0e8-b3c319cd058b" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.893214 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="69486421-e690-4d51-b0e8-b3c319cd058b" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900325 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac295c82-00b1-4c2a-930d-3abbe3157018" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900368 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3962bd7f-0adf-4443-9d35-6f726f976e5e" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900380 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0cd784d1-60a3-4d8f-94c9-7ed460143f00" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900390 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cf3f41a-698e-45cf-8660-4a2f1318ea4a" containerName="keystone-db-sync" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900399 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="69486421-e690-4d51-b0e8-b3c319cd058b" containerName="mariadb-database-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900412 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2b80cab6-1658-446e-9925-04195053566e" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900431 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6919fe80-c60f-4450-9a82-e985d9f546e3" containerName="dnsmasq-dns" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.900440 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fa487be8-a1c5-460b-991c-d171c4048851" containerName="mariadb-account-create" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.901022 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.905464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.905483 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.905970 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.913717 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.913745 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-rt6qk" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.917311 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4vtb5"] Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.966808 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.968350 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.972877 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.973840 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-bklzq" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.973948 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:14:12 crc kubenswrapper[4769]: I1121 13:14:12.974025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.003918 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.037592 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.039473 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.041412 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.041581 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045094 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-credential-keys\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045159 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045219 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfwb2\" (UniqueName: \"kubernetes.io/projected/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-kube-api-access-tfwb2\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rp85\" (UniqueName: \"kubernetes.io/projected/6d0d6b9c-a5cb-4589-a690-8a66914447a7-kube-api-access-9rp85\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045395 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-config-data\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-scripts\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045467 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-logs\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045521 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-fernet-keys\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-config-data\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-combined-ca-bundle\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.045648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-scripts\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.049243 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.051779 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.054926 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.057749 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.057804 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.066203 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.125606 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-6lxdx"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.126810 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.129206 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-kkw29" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.129443 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.131846 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4wp\" (UniqueName: \"kubernetes.io/projected/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-kube-api-access-wt4wp\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-credential-keys\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-scripts\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tfwb2\" (UniqueName: \"kubernetes.io/projected/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-kube-api-access-tfwb2\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rp85\" (UniqueName: \"kubernetes.io/projected/6d0d6b9c-a5cb-4589-a690-8a66914447a7-kube-api-access-9rp85\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-logs\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146786 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146817 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146833 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-config-data\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-config-data\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-scripts\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-logs\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkjc9\" (UniqueName: \"kubernetes.io/projected/5f0c75a4-09c0-41f3-b153-a723dd115353-kube-api-access-dkjc9\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-fernet-keys\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146965 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-run-httpd\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.146988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-config-data\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.147008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-combined-ca-bundle\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.147024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-log-httpd\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.147045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-scripts\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.147063 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.147083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.149926 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.149951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-logs\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.150481 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.172272 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-6lxdx"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/34368a98-a12d-4728-828e-5d3de52901b3-kube-api-access-dwxwx\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248489 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-config-data\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-config-data\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkjc9\" (UniqueName: \"kubernetes.io/projected/5f0c75a4-09c0-41f3-b153-a723dd115353-kube-api-access-dkjc9\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-run-httpd\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-log-httpd\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-scripts\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4wp\" (UniqueName: \"kubernetes.io/projected/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-kube-api-access-wt4wp\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-scripts\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248934 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.248957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-combined-ca-bundle\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.249012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34368a98-a12d-4728-828e-5d3de52901b3-logs\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.249041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.249062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.249084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-logs\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.249588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-logs\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.250459 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.250680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-run-httpd\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.253660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-log-httpd\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.254017 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.284554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-credential-keys\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-scripts\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300208 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-fernet-keys\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-combined-ca-bundle\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-config-data\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfwb2\" (UniqueName: \"kubernetes.io/projected/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-kube-api-access-tfwb2\") pod \"keystone-bootstrap-4vtb5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-scripts\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.300732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-config-data\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.301213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.301606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.302376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rp85\" (UniqueName: \"kubernetes.io/projected/6d0d6b9c-a5cb-4589-a690-8a66914447a7-kube-api-access-9rp85\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.303257 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.303447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-scripts\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.303730 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.304553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-config-data\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.305031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.305174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.305424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.305669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.307012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4wp\" (UniqueName: \"kubernetes.io/projected/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-kube-api-access-wt4wp\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.307227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkjc9\" (UniqueName: \"kubernetes.io/projected/5f0c75a4-09c0-41f3-b153-a723dd115353-kube-api-access-dkjc9\") pod \"ceilometer-0\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.331414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.350059 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-scripts\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.350113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-combined-ca-bundle\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.350157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34368a98-a12d-4728-828e-5d3de52901b3-logs\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.350212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/34368a98-a12d-4728-828e-5d3de52901b3-kube-api-access-dwxwx\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.350236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-config-data\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.351614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34368a98-a12d-4728-828e-5d3de52901b3-logs\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.353111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-scripts\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.354455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-config-data\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.358713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-combined-ca-bundle\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.367305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/34368a98-a12d-4728-828e-5d3de52901b3-kube-api-access-dwxwx\") pod \"placement-db-sync-6lxdx\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.376383 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.381666 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.410798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.449099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.543227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.598630 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.901741 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:13 crc kubenswrapper[4769]: I1121 13:14:13.909150 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.098294 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-6lxdx"] Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.106438 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4vtb5"] Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.112358 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:14 crc kubenswrapper[4769]: W1121 13:14:14.113816 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod845bcbdc_f7a3_48d5_8c4b_281a8a28e1c5.slice/crio-2bbe5e13c551b1be1f54c1ec043beae2b1a283e2955ff3dfcf3a928503993ce9 WatchSource:0}: Error finding container 2bbe5e13c551b1be1f54c1ec043beae2b1a283e2955ff3dfcf3a928503993ce9: Status 404 returned error can't find the container with id 2bbe5e13c551b1be1f54c1ec043beae2b1a283e2955ff3dfcf3a928503993ce9 Nov 21 13:14:14 crc kubenswrapper[4769]: W1121 13:14:14.119792 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34368a98_a12d_4728_828e_5d3de52901b3.slice/crio-d85e5c7fd259f1379316697767c7f251df1de1c2a508dff6e46110654bb633d9 WatchSource:0}: Error finding container d85e5c7fd259f1379316697767c7f251df1de1c2a508dff6e46110654bb633d9: Status 404 returned error can't find the container with id d85e5c7fd259f1379316697767c7f251df1de1c2a508dff6e46110654bb633d9 Nov 21 13:14:14 crc kubenswrapper[4769]: W1121 13:14:14.123344 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d0d6b9c_a5cb_4589_a690_8a66914447a7.slice/crio-3003aac0cdee867cf4650006f3387b50ec2289827a32c30751d13a44bc395256 WatchSource:0}: Error finding container 3003aac0cdee867cf4650006f3387b50ec2289827a32c30751d13a44bc395256: Status 404 returned error can't find the container with id 3003aac0cdee867cf4650006f3387b50ec2289827a32c30751d13a44bc395256 Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.745862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" event={"ID":"34368a98-a12d-4728-828e-5d3de52901b3","Type":"ContainerStarted","Data":"26c54edafc6a1a0ff762b4f1f64b3d243c6d5c913df92c04f335c261605df009"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.746623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" event={"ID":"34368a98-a12d-4728-828e-5d3de52901b3","Type":"ContainerStarted","Data":"d85e5c7fd259f1379316697767c7f251df1de1c2a508dff6e46110654bb633d9"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.747996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" event={"ID":"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5","Type":"ContainerStarted","Data":"28cf8754d4df43c03e06a772ba4589e855a8b7bb76011f499335e93bbc5c9e1d"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.748021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" event={"ID":"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5","Type":"ContainerStarted","Data":"2bbe5e13c551b1be1f54c1ec043beae2b1a283e2955ff3dfcf3a928503993ce9"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.749008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerStarted","Data":"846a2464b2bede124ae9636d244b9e24379a9eba706be6194080dbbdd210dc73"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.750552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d0d6b9c-a5cb-4589-a690-8a66914447a7","Type":"ContainerStarted","Data":"3003aac0cdee867cf4650006f3387b50ec2289827a32c30751d13a44bc395256"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.754558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c","Type":"ContainerStarted","Data":"2cc9c13fb6d5243726ee9a3f5dea03d84350e27687e9a8fb43ff87f6d767196a"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.754591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c","Type":"ContainerStarted","Data":"ffaeb96bc10a87a1c43eaa6bbb836f8be96014a6e89ddecd0ec08db49482f79e"} Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.770773 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" podStartSLOduration=1.770751982 podStartE2EDuration="1.770751982s" podCreationTimestamp="2025-11-21 13:14:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:14.762975823 +0000 UTC m=+5013.463637651" watchObservedRunningTime="2025-11-21 13:14:14.770751982 +0000 UTC m=+5013.471413800" Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.778753 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" podStartSLOduration=2.778737467 podStartE2EDuration="2.778737467s" podCreationTimestamp="2025-11-21 13:14:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:14.777533615 +0000 UTC m=+5013.478195453" watchObservedRunningTime="2025-11-21 13:14:14.778737467 +0000 UTC m=+5013.479399275" Nov 21 13:14:14 crc kubenswrapper[4769]: I1121 13:14:14.995512 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.042633 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.061792 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.788588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerStarted","Data":"c7b4d9e1d1fc18133bf4883df46c5d96424e304c4a3bdeae758ee47eabec399b"} Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.809775 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d0d6b9c-a5cb-4589-a690-8a66914447a7","Type":"ContainerStarted","Data":"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c"} Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.809838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d0d6b9c-a5cb-4589-a690-8a66914447a7","Type":"ContainerStarted","Data":"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959"} Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.827010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c","Type":"ContainerStarted","Data":"a7a8f7380d046c735a2cfd0718c52fe7eda85afa0d411e96da6a15fdfb5a24e7"} Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.827226 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-log" containerID="cri-o://2cc9c13fb6d5243726ee9a3f5dea03d84350e27687e9a8fb43ff87f6d767196a" gracePeriod=30 Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.827455 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-httpd" containerID="cri-o://a7a8f7380d046c735a2cfd0718c52fe7eda85afa0d411e96da6a15fdfb5a24e7" gracePeriod=30 Nov 21 13:14:15 crc kubenswrapper[4769]: I1121 13:14:15.860079 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=2.860055488 podStartE2EDuration="2.860055488s" podCreationTimestamp="2025-11-21 13:14:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:15.859537924 +0000 UTC m=+5014.560199742" watchObservedRunningTime="2025-11-21 13:14:15.860055488 +0000 UTC m=+5014.560717306" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.857503 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-shq9l"] Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.859159 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.867267 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-shq9l"] Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.868025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-dh9rd" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.868241 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.888870 4769 generic.go:334] "Generic (PLEG): container finished" podID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerID="a7a8f7380d046c735a2cfd0718c52fe7eda85afa0d411e96da6a15fdfb5a24e7" exitCode=0 Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.888899 4769 generic.go:334] "Generic (PLEG): container finished" podID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerID="2cc9c13fb6d5243726ee9a3f5dea03d84350e27687e9a8fb43ff87f6d767196a" exitCode=143 Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.888940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c","Type":"ContainerDied","Data":"a7a8f7380d046c735a2cfd0718c52fe7eda85afa0d411e96da6a15fdfb5a24e7"} Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.888966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c","Type":"ContainerDied","Data":"2cc9c13fb6d5243726ee9a3f5dea03d84350e27687e9a8fb43ff87f6d767196a"} Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.888975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c","Type":"ContainerDied","Data":"ffaeb96bc10a87a1c43eaa6bbb836f8be96014a6e89ddecd0ec08db49482f79e"} Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.888987 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffaeb96bc10a87a1c43eaa6bbb836f8be96014a6e89ddecd0ec08db49482f79e" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.889105 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.892723 4769 generic.go:334] "Generic (PLEG): container finished" podID="34368a98-a12d-4728-828e-5d3de52901b3" containerID="26c54edafc6a1a0ff762b4f1f64b3d243c6d5c913df92c04f335c261605df009" exitCode=0 Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.892799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" event={"ID":"34368a98-a12d-4728-828e-5d3de52901b3","Type":"ContainerDied","Data":"26c54edafc6a1a0ff762b4f1f64b3d243c6d5c913df92c04f335c261605df009"} Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.902088 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-log" containerID="cri-o://0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959" gracePeriod=30 Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.902398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerStarted","Data":"d351c97838585032e86bcae56f5aafaf4587e8b8e25683386d8f55ea193801cb"} Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.902475 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-httpd" containerID="cri-o://aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c" gracePeriod=30 Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.912298 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-7r4lg"] Nov 21 13:14:16 crc kubenswrapper[4769]: E1121 13:14:16.912733 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-httpd" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.912750 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-httpd" Nov 21 13:14:16 crc kubenswrapper[4769]: E1121 13:14:16.912779 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-log" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.912786 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-log" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.913145 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-httpd" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.913182 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" containerName="glance-log" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.913762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.916724 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-4jz5m" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.916900 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.917103 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.928144 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-7r4lg"] Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-scripts\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt4wp\" (UniqueName: \"kubernetes.io/projected/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-kube-api-access-wt4wp\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-combined-ca-bundle\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-httpd-run\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-logs\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-config-data\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959788 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-internal-tls-certs\") pod \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\" (UID: \"befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c\") " Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.959992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-db-sync-config-data\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-db-sync-config-data\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-config-data\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rg49\" (UniqueName: \"kubernetes.io/projected/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-kube-api-access-9rg49\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-scripts\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960136 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-combined-ca-bundle\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06dda6f1-250b-496b-8545-c85e8ac91921-etc-machine-id\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-combined-ca-bundle\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.960233 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5sgg\" (UniqueName: \"kubernetes.io/projected/06dda6f1-250b-496b-8545-c85e8ac91921-kube-api-access-z5sgg\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.961954 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.962973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-logs" (OuterVolumeSpecName: "logs") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.968109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.985976 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.985955258 podStartE2EDuration="4.985955258s" podCreationTimestamp="2025-11-21 13:14:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:16.964939542 +0000 UTC m=+5015.665601360" watchObservedRunningTime="2025-11-21 13:14:16.985955258 +0000 UTC m=+5015.686617096" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.990445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-scripts" (OuterVolumeSpecName: "scripts") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:16 crc kubenswrapper[4769]: I1121 13:14:16.994448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-kube-api-access-wt4wp" (OuterVolumeSpecName: "kube-api-access-wt4wp") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "kube-api-access-wt4wp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.016525 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mg55q"] Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.017596 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.017914 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.019999 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.020299 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.020513 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-kztxz" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.023439 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mg55q"] Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.048248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-combined-ca-bundle\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062308 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z5sgg\" (UniqueName: \"kubernetes.io/projected/06dda6f1-250b-496b-8545-c85e8ac91921-kube-api-access-z5sgg\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-db-sync-config-data\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-db-sync-config-data\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-combined-ca-bundle\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062587 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-config-data\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9rg49\" (UniqueName: \"kubernetes.io/projected/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-kube-api-access-9rg49\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-config\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-scripts\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25j6\" (UniqueName: \"kubernetes.io/projected/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-kube-api-access-g25j6\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06dda6f1-250b-496b-8545-c85e8ac91921-etc-machine-id\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-combined-ca-bundle\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062948 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062962 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062986 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.062998 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.063010 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.063021 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.063034 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wt4wp\" (UniqueName: \"kubernetes.io/projected/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-kube-api-access-wt4wp\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.064591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06dda6f1-250b-496b-8545-c85e8ac91921-etc-machine-id\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.068324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-scripts\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.070421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-combined-ca-bundle\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.070624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-config-data\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.071616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-db-sync-config-data\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.072527 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-combined-ca-bundle\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.075792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-config-data" (OuterVolumeSpecName: "config-data") pod "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" (UID: "befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.079266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-db-sync-config-data\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.086406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rg49\" (UniqueName: \"kubernetes.io/projected/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-kube-api-access-9rg49\") pod \"barbican-db-sync-shq9l\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.088039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5sgg\" (UniqueName: \"kubernetes.io/projected/06dda6f1-250b-496b-8545-c85e8ac91921-kube-api-access-z5sgg\") pod \"cinder-db-sync-7r4lg\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.091656 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.164198 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-combined-ca-bundle\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.164272 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-config\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.164298 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g25j6\" (UniqueName: \"kubernetes.io/projected/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-kube-api-access-g25j6\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.164404 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.164416 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.168567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-config\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.169982 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-combined-ca-bundle\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.182579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25j6\" (UniqueName: \"kubernetes.io/projected/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-kube-api-access-g25j6\") pod \"neutron-db-sync-mg55q\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.204603 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.235228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.370053 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.668371 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.775729 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-shq9l"] Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.782941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-scripts\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rp85\" (UniqueName: \"kubernetes.io/projected/6d0d6b9c-a5cb-4589-a690-8a66914447a7-kube-api-access-9rp85\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783131 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-httpd-run\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-public-tls-certs\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-logs\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-config-data\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.783324 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-combined-ca-bundle\") pod \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\" (UID: \"6d0d6b9c-a5cb-4589-a690-8a66914447a7\") " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.786849 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.787206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-logs" (OuterVolumeSpecName: "logs") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.792170 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0d6b9c-a5cb-4589-a690-8a66914447a7-kube-api-access-9rp85" (OuterVolumeSpecName: "kube-api-access-9rp85") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "kube-api-access-9rp85". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.794299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-scripts" (OuterVolumeSpecName: "scripts") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.797334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.810804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-7r4lg"] Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.838440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.856454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-config-data" (OuterVolumeSpecName: "config-data") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.870640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6d0d6b9c-a5cb-4589-a690-8a66914447a7" (UID: "6d0d6b9c-a5cb-4589-a690-8a66914447a7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.884873 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.884907 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9rp85\" (UniqueName: \"kubernetes.io/projected/6d0d6b9c-a5cb-4589-a690-8a66914447a7-kube-api-access-9rp85\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.884926 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.884968 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.884982 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.884996 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d0d6b9c-a5cb-4589-a690-8a66914447a7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.885007 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.885017 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d0d6b9c-a5cb-4589-a690-8a66914447a7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.906438 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:14:17 crc kubenswrapper[4769]: W1121 13:14:17.916984 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7745b13c_03b6_48ec_a3ca_fda54d77d5bb.slice/crio-5f1e65aa3bb8191c7f8b00096e0907563eb107481d6cbddc7dba71e34e579a68 WatchSource:0}: Error finding container 5f1e65aa3bb8191c7f8b00096e0907563eb107481d6cbddc7dba71e34e579a68: Status 404 returned error can't find the container with id 5f1e65aa3bb8191c7f8b00096e0907563eb107481d6cbddc7dba71e34e579a68 Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.917443 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mg55q"] Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.920229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" event={"ID":"06dda6f1-250b-496b-8545-c85e8ac91921","Type":"ContainerStarted","Data":"c2e203bbe5a673d75b88a470b0a4edb0e13688be5c868a4f05bd7e9af6efcd14"} Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922392 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerID="aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c" exitCode=0 Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922427 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerID="0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959" exitCode=143 Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d0d6b9c-a5cb-4589-a690-8a66914447a7","Type":"ContainerDied","Data":"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c"} Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d0d6b9c-a5cb-4589-a690-8a66914447a7","Type":"ContainerDied","Data":"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959"} Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d0d6b9c-a5cb-4589-a690-8a66914447a7","Type":"ContainerDied","Data":"3003aac0cdee867cf4650006f3387b50ec2289827a32c30751d13a44bc395256"} Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922576 4769 scope.go:117] "RemoveContainer" containerID="aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.922707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.928623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" event={"ID":"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d","Type":"ContainerStarted","Data":"04e561eb6bb1e8ad2d8357d11cebbfb502441cddd7ecbd49c66055103a4f3842"} Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.931066 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.931918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerStarted","Data":"8c9433b175442fdeaa43a5a44a8129ee227fb7c9e3efaaaaa6f3c673aebe8e40"} Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.986444 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.991111 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:17 crc kubenswrapper[4769]: I1121 13:14:17.998297 4769 scope.go:117] "RemoveContainer" containerID="0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.011081 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.026351 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.056238 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.056353 4769 scope.go:117] "RemoveContainer" containerID="aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c" Nov 21 13:14:18 crc kubenswrapper[4769]: E1121 13:14:18.056928 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c\": container with ID starting with aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c not found: ID does not exist" containerID="aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.056984 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c"} err="failed to get container status \"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c\": rpc error: code = NotFound desc = could not find container \"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c\": container with ID starting with aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c not found: ID does not exist" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.057012 4769 scope.go:117] "RemoveContainer" containerID="0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959" Nov 21 13:14:18 crc kubenswrapper[4769]: E1121 13:14:18.057440 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959\": container with ID starting with 0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959 not found: ID does not exist" containerID="0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.057481 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959"} err="failed to get container status \"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959\": rpc error: code = NotFound desc = could not find container \"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959\": container with ID starting with 0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959 not found: ID does not exist" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.057522 4769 scope.go:117] "RemoveContainer" containerID="aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.062426 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c"} err="failed to get container status \"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c\": rpc error: code = NotFound desc = could not find container \"aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c\": container with ID starting with aa7a6d87c1fcfaf06fa2430cb955eb94706833c5d01cab27f21f894bd60b2b3c not found: ID does not exist" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.062480 4769 scope.go:117] "RemoveContainer" containerID="0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.062890 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959"} err="failed to get container status \"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959\": rpc error: code = NotFound desc = could not find container \"0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959\": container with ID starting with 0f593d19dd6bdd1894e161c9c8623f5ccd1647d22081cef429eb8be07531f959 not found: ID does not exist" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.067371 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: E1121 13:14:18.068025 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-httpd" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.068043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-httpd" Nov 21 13:14:18 crc kubenswrapper[4769]: E1121 13:14:18.068069 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-log" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.068076 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-log" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.068257 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-httpd" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.068282 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" containerName="glance-log" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.069795 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.072464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-bklzq" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.072598 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.074485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.074778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.074830 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.074791 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.076411 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.076455 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.078230 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.086971 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.189842 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.189896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t9sc\" (UniqueName: \"kubernetes.io/projected/ced008cb-d09d-4d3f-bb38-8771e748e2d8-kube-api-access-7t9sc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.190520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-config-data\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.190596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.190644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.190671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-logs\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.190869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.190961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wsx9\" (UniqueName: \"kubernetes.io/projected/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-kube-api-access-4wsx9\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-logs\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-scripts\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191165 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.191205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.229302 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-config-data\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-logs\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4wsx9\" (UniqueName: \"kubernetes.io/projected/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-kube-api-access-4wsx9\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-logs\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292704 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-scripts\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292861 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.292920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7t9sc\" (UniqueName: \"kubernetes.io/projected/ced008cb-d09d-4d3f-bb38-8771e748e2d8-kube-api-access-7t9sc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.293920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.294064 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.294349 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.294789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-logs\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.295067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-logs\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.295073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.301907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.301932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.302621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-scripts\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.306530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-config-data\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.307570 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-scripts\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.308619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t9sc\" (UniqueName: \"kubernetes.io/projected/ced008cb-d09d-4d3f-bb38-8771e748e2d8-kube-api-access-7t9sc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.308788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-config-data\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.309857 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.310056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.318911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wsx9\" (UniqueName: \"kubernetes.io/projected/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-kube-api-access-4wsx9\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.328258 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.336972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.394413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34368a98-a12d-4728-828e-5d3de52901b3-logs\") pod \"34368a98-a12d-4728-828e-5d3de52901b3\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.394537 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-config-data\") pod \"34368a98-a12d-4728-828e-5d3de52901b3\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.394629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/34368a98-a12d-4728-828e-5d3de52901b3-kube-api-access-dwxwx\") pod \"34368a98-a12d-4728-828e-5d3de52901b3\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.394657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-combined-ca-bundle\") pod \"34368a98-a12d-4728-828e-5d3de52901b3\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.394711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-scripts\") pod \"34368a98-a12d-4728-828e-5d3de52901b3\" (UID: \"34368a98-a12d-4728-828e-5d3de52901b3\") " Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.394926 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34368a98-a12d-4728-828e-5d3de52901b3-logs" (OuterVolumeSpecName: "logs") pod "34368a98-a12d-4728-828e-5d3de52901b3" (UID: "34368a98-a12d-4728-828e-5d3de52901b3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.395170 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34368a98-a12d-4728-828e-5d3de52901b3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.400450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-scripts" (OuterVolumeSpecName: "scripts") pod "34368a98-a12d-4728-828e-5d3de52901b3" (UID: "34368a98-a12d-4728-828e-5d3de52901b3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.400542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34368a98-a12d-4728-828e-5d3de52901b3-kube-api-access-dwxwx" (OuterVolumeSpecName: "kube-api-access-dwxwx") pod "34368a98-a12d-4728-828e-5d3de52901b3" (UID: "34368a98-a12d-4728-828e-5d3de52901b3"). InnerVolumeSpecName "kube-api-access-dwxwx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.417881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34368a98-a12d-4728-828e-5d3de52901b3" (UID: "34368a98-a12d-4728-828e-5d3de52901b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.419079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-config-data" (OuterVolumeSpecName: "config-data") pod "34368a98-a12d-4728-828e-5d3de52901b3" (UID: "34368a98-a12d-4728-828e-5d3de52901b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.423807 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.441148 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.496405 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.496527 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/34368a98-a12d-4728-828e-5d3de52901b3-kube-api-access-dwxwx\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.496586 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.496637 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/34368a98-a12d-4728-828e-5d3de52901b3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.901638 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:14:18 crc kubenswrapper[4769]: W1121 13:14:18.908032 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod259f4d5c_cc0f_4221_aea2_1a40b6edcc4c.slice/crio-8961141fa2b92b1deec642a87cbf0be44a4c29b927e1ec684e70de57526ad426 WatchSource:0}: Error finding container 8961141fa2b92b1deec642a87cbf0be44a4c29b927e1ec684e70de57526ad426: Status 404 returned error can't find the container with id 8961141fa2b92b1deec642a87cbf0be44a4c29b927e1ec684e70de57526ad426 Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.941249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" event={"ID":"7745b13c-03b6-48ec-a3ca-fda54d77d5bb","Type":"ContainerStarted","Data":"1cc9ce240529d7cf767425ba46de20b5cd7f0399808010279416827c077cc542"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.941659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" event={"ID":"7745b13c-03b6-48ec-a3ca-fda54d77d5bb","Type":"ContainerStarted","Data":"5f1e65aa3bb8191c7f8b00096e0907563eb107481d6cbddc7dba71e34e579a68"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.943403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" event={"ID":"06dda6f1-250b-496b-8545-c85e8ac91921","Type":"ContainerStarted","Data":"90b5a48879d63f18b826dfcbb5b2ba070be7d88c1e27bc3c7b971223df9d3d96"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.945675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" event={"ID":"34368a98-a12d-4728-828e-5d3de52901b3","Type":"ContainerDied","Data":"d85e5c7fd259f1379316697767c7f251df1de1c2a508dff6e46110654bb633d9"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.945703 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d85e5c7fd259f1379316697767c7f251df1de1c2a508dff6e46110654bb633d9" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.945754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-6lxdx" Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.947059 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" event={"ID":"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d","Type":"ContainerStarted","Data":"5908e91360c92b28682a9148475c13ac5c72dd29f71b3b973dc894554a7d015e"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.948997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c","Type":"ContainerStarted","Data":"8961141fa2b92b1deec642a87cbf0be44a4c29b927e1ec684e70de57526ad426"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.950937 4769 generic.go:334] "Generic (PLEG): container finished" podID="845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" containerID="28cf8754d4df43c03e06a772ba4589e855a8b7bb76011f499335e93bbc5c9e1d" exitCode=0 Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.951038 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" event={"ID":"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5","Type":"ContainerDied","Data":"28cf8754d4df43c03e06a772ba4589e855a8b7bb76011f499335e93bbc5c9e1d"} Nov 21 13:14:18 crc kubenswrapper[4769]: I1121 13:14:18.970774 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" podStartSLOduration=2.970754877 podStartE2EDuration="2.970754877s" podCreationTimestamp="2025-11-21 13:14:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:18.964866419 +0000 UTC m=+5017.665528257" watchObservedRunningTime="2025-11-21 13:14:18.970754877 +0000 UTC m=+5017.671416695" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.028163 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" podStartSLOduration=3.028145503 podStartE2EDuration="3.028145503s" podCreationTimestamp="2025-11-21 13:14:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:19.018999987 +0000 UTC m=+5017.719661805" watchObservedRunningTime="2025-11-21 13:14:19.028145503 +0000 UTC m=+5017.728807321" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.046439 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.104490 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" podStartSLOduration=3.10446292 podStartE2EDuration="3.10446292s" podCreationTimestamp="2025-11-21 13:14:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:19.044258058 +0000 UTC m=+5017.744919886" watchObservedRunningTime="2025-11-21 13:14:19.10446292 +0000 UTC m=+5017.805124758" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.127450 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-8476ff6dc6-jfqrm"] Nov 21 13:14:19 crc kubenswrapper[4769]: E1121 13:14:19.128060 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34368a98-a12d-4728-828e-5d3de52901b3" containerName="placement-db-sync" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.128141 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34368a98-a12d-4728-828e-5d3de52901b3" containerName="placement-db-sync" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.128406 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34368a98-a12d-4728-828e-5d3de52901b3" containerName="placement-db-sync" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.129838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.138281 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-kkw29" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.138599 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8476ff6dc6-jfqrm"] Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.138775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.138844 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.151507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-combined-ca-bundle\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.151603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-config-data\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.151651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-scripts\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.151713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5bc57375-7cce-458b-a855-dc3658fbc26d-logs\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.151749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbdgm\" (UniqueName: \"kubernetes.io/projected/5bc57375-7cce-458b-a855-dc3658fbc26d-kube-api-access-wbdgm\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.253348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-config-data\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.253405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-scripts\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.253457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5bc57375-7cce-458b-a855-dc3658fbc26d-logs\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.253496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wbdgm\" (UniqueName: \"kubernetes.io/projected/5bc57375-7cce-458b-a855-dc3658fbc26d-kube-api-access-wbdgm\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.253549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-combined-ca-bundle\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.254651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5bc57375-7cce-458b-a855-dc3658fbc26d-logs\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.259883 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-scripts\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.259897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-config-data\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.260758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-combined-ca-bundle\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.273283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbdgm\" (UniqueName: \"kubernetes.io/projected/5bc57375-7cce-458b-a855-dc3658fbc26d-kube-api-access-wbdgm\") pod \"placement-8476ff6dc6-jfqrm\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.298347 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d0d6b9c-a5cb-4589-a690-8a66914447a7" path="/var/lib/kubelet/pods/6d0d6b9c-a5cb-4589-a690-8a66914447a7/volumes" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.299206 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c" path="/var/lib/kubelet/pods/befb3d28-b1a4-4f03-bb8f-ee22bfeb9c8c/volumes" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.305697 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5b5647db7d-6q5bl"] Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.307648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.310556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.318104 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.322976 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b5647db7d-6q5bl"] Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-internal-tls-certs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gqs9\" (UniqueName: \"kubernetes.io/projected/7658f401-2091-41a5-834d-eb052f71924b-kube-api-access-7gqs9\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457291 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-combined-ca-bundle\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457363 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7658f401-2091-41a5-834d-eb052f71924b-logs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-config-data\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-scripts\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.457436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-public-tls-certs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.476844 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.558787 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7658f401-2091-41a5-834d-eb052f71924b-logs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.559299 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7658f401-2091-41a5-834d-eb052f71924b-logs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.559327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-config-data\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.559352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-scripts\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.560170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-public-tls-certs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.560287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-internal-tls-certs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.560328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7gqs9\" (UniqueName: \"kubernetes.io/projected/7658f401-2091-41a5-834d-eb052f71924b-kube-api-access-7gqs9\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.560346 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-combined-ca-bundle\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.563469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-scripts\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.563916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-config-data\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.565377 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-public-tls-certs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.566457 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-combined-ca-bundle\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.576881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-internal-tls-certs\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.584329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gqs9\" (UniqueName: \"kubernetes.io/projected/7658f401-2091-41a5-834d-eb052f71924b-kube-api-access-7gqs9\") pod \"placement-5b5647db7d-6q5bl\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.629948 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.974318 4769 generic.go:334] "Generic (PLEG): container finished" podID="74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" containerID="5908e91360c92b28682a9148475c13ac5c72dd29f71b3b973dc894554a7d015e" exitCode=0 Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.974393 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" event={"ID":"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d","Type":"ContainerDied","Data":"5908e91360c92b28682a9148475c13ac5c72dd29f71b3b973dc894554a7d015e"} Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.978965 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ced008cb-d09d-4d3f-bb38-8771e748e2d8","Type":"ContainerStarted","Data":"346ba60a9139e2e57c6928862c592e245698a017cc5c7ce901f6a1564538b36c"} Nov 21 13:14:19 crc kubenswrapper[4769]: I1121 13:14:19.987367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c","Type":"ContainerStarted","Data":"ceb0abe99505ba71282f5f90e73dbbcb7b5041fec45bfddc26d1e32530a34fe2"} Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.132773 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8476ff6dc6-jfqrm"] Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.240866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5b5647db7d-6q5bl"] Nov 21 13:14:20 crc kubenswrapper[4769]: W1121 13:14:20.501177 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bc57375_7cce_458b_a855_dc3658fbc26d.slice/crio-058df33b0ed1e6197a32234eec2d8935203abad1349a3c58e548557c5811aa00 WatchSource:0}: Error finding container 058df33b0ed1e6197a32234eec2d8935203abad1349a3c58e548557c5811aa00: Status 404 returned error can't find the container with id 058df33b0ed1e6197a32234eec2d8935203abad1349a3c58e548557c5811aa00 Nov 21 13:14:20 crc kubenswrapper[4769]: W1121 13:14:20.501758 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7658f401_2091_41a5_834d_eb052f71924b.slice/crio-e1db582b041119533c1ae8233ccb474d9d6cb77a420befc0a45244ee1cde8d6b WatchSource:0}: Error finding container e1db582b041119533c1ae8233ccb474d9d6cb77a420befc0a45244ee1cde8d6b: Status 404 returned error can't find the container with id e1db582b041119533c1ae8233ccb474d9d6cb77a420befc0a45244ee1cde8d6b Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.517553 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.582791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-config-data\") pod \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.583245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-combined-ca-bundle\") pod \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.583290 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-fernet-keys\") pod \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.583379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfwb2\" (UniqueName: \"kubernetes.io/projected/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-kube-api-access-tfwb2\") pod \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.583463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-credential-keys\") pod \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.583502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-scripts\") pod \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\" (UID: \"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5\") " Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.591391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" (UID: "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.591851 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-kube-api-access-tfwb2" (OuterVolumeSpecName: "kube-api-access-tfwb2") pod "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" (UID: "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5"). InnerVolumeSpecName "kube-api-access-tfwb2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.593368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" (UID: "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.593465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-scripts" (OuterVolumeSpecName: "scripts") pod "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" (UID: "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.634073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" (UID: "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.655781 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-config-data" (OuterVolumeSpecName: "config-data") pod "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" (UID: "845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.685735 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tfwb2\" (UniqueName: \"kubernetes.io/projected/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-kube-api-access-tfwb2\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.685786 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.685800 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.685814 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.685829 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.685840 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.994956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" event={"ID":"845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5","Type":"ContainerDied","Data":"2bbe5e13c551b1be1f54c1ec043beae2b1a283e2955ff3dfcf3a928503993ce9"} Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.995392 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bbe5e13c551b1be1f54c1ec043beae2b1a283e2955ff3dfcf3a928503993ce9" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.995228 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-4vtb5" Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.997724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerStarted","Data":"b0ae74b89117397fe6430bd3ec8f92c1e1d13253c22f58ce5ae066e0e2f5f203"} Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.997859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerStarted","Data":"058df33b0ed1e6197a32234eec2d8935203abad1349a3c58e548557c5811aa00"} Nov 21 13:14:20 crc kubenswrapper[4769]: I1121 13:14:20.999889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerStarted","Data":"87161158451ff7c141f751920eb2d3f3394c01ddd9036ae70b879f4c033226cd"} Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.000100 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-central-agent" containerID="cri-o://c7b4d9e1d1fc18133bf4883df46c5d96424e304c4a3bdeae758ee47eabec399b" gracePeriod=30 Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.000462 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.000781 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="proxy-httpd" containerID="cri-o://87161158451ff7c141f751920eb2d3f3394c01ddd9036ae70b879f4c033226cd" gracePeriod=30 Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.000925 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="sg-core" containerID="cri-o://8c9433b175442fdeaa43a5a44a8129ee227fb7c9e3efaaaaa6f3c673aebe8e40" gracePeriod=30 Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.001056 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-notification-agent" containerID="cri-o://d351c97838585032e86bcae56f5aafaf4587e8b8e25683386d8f55ea193801cb" gracePeriod=30 Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.004076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" event={"ID":"7658f401-2091-41a5-834d-eb052f71924b","Type":"ContainerStarted","Data":"5b37a5f3d9412e7de70fb89cb6b4fcf423e309f767aa02eb0540c22ec835f952"} Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.004122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" event={"ID":"7658f401-2091-41a5-834d-eb052f71924b","Type":"ContainerStarted","Data":"e1db582b041119533c1ae8233ccb474d9d6cb77a420befc0a45244ee1cde8d6b"} Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.007462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ced008cb-d09d-4d3f-bb38-8771e748e2d8","Type":"ContainerStarted","Data":"c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3"} Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.009328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c","Type":"ContainerStarted","Data":"48c9f6737b202fee45ba6442d8aff96676c345945786237599c0c8013ac6eba0"} Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.020505 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.309428452 podStartE2EDuration="8.020485405s" podCreationTimestamp="2025-11-21 13:14:13 +0000 UTC" firstStartedPulling="2025-11-21 13:14:13.914358821 +0000 UTC m=+5012.615020639" lastFinishedPulling="2025-11-21 13:14:19.625415774 +0000 UTC m=+5018.326077592" observedRunningTime="2025-11-21 13:14:21.018624025 +0000 UTC m=+5019.719285853" watchObservedRunningTime="2025-11-21 13:14:21.020485405 +0000 UTC m=+5019.721147223" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.056901 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.056883326 podStartE2EDuration="4.056883326s" podCreationTimestamp="2025-11-21 13:14:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:21.046470675 +0000 UTC m=+5019.747132513" watchObservedRunningTime="2025-11-21 13:14:21.056883326 +0000 UTC m=+5019.757545144" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.081030 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4vtb5"] Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.087566 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-4vtb5"] Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.176599 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k8lx8"] Nov 21 13:14:21 crc kubenswrapper[4769]: E1121 13:14:21.176924 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" containerName="keystone-bootstrap" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.176934 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" containerName="keystone-bootstrap" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.178085 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" containerName="keystone-bootstrap" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.179950 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.182735 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.182955 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.183107 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.183241 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-rt6qk" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.183331 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.194812 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k8lx8"] Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.300279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9thp\" (UniqueName: \"kubernetes.io/projected/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-kube-api-access-w9thp\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.300660 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-config-data\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.300700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-scripts\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.300759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-credential-keys\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.300786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-fernet-keys\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.300852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-combined-ca-bundle\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.303660 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5" path="/var/lib/kubelet/pods/845bcbdc-f7a3-48d5-8c4b-281a8a28e1c5/volumes" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.403548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-combined-ca-bundle\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.403663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w9thp\" (UniqueName: \"kubernetes.io/projected/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-kube-api-access-w9thp\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.403712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-config-data\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.403746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-scripts\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.403810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-credential-keys\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.403852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-fernet-keys\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.410067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-credential-keys\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.410590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-scripts\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.411264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-fernet-keys\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.411450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-combined-ca-bundle\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.417057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-config-data\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.422037 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9thp\" (UniqueName: \"kubernetes.io/projected/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-kube-api-access-w9thp\") pod \"keystone-bootstrap-k8lx8\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.422604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.505280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rg49\" (UniqueName: \"kubernetes.io/projected/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-kube-api-access-9rg49\") pod \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.505456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-db-sync-config-data\") pod \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.505528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-combined-ca-bundle\") pod \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\" (UID: \"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d\") " Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.509808 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-kube-api-access-9rg49" (OuterVolumeSpecName: "kube-api-access-9rg49") pod "74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" (UID: "74d6a6f6-8260-449d-86a2-3a5d2d4bc18d"). InnerVolumeSpecName "kube-api-access-9rg49". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.509947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" (UID: "74d6a6f6-8260-449d-86a2-3a5d2d4bc18d"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.530901 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.538393 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" (UID: "74d6a6f6-8260-449d-86a2-3a5d2d4bc18d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.608164 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.608414 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9rg49\" (UniqueName: \"kubernetes.io/projected/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-kube-api-access-9rg49\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:21 crc kubenswrapper[4769]: I1121 13:14:21.608501 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.020793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ced008cb-d09d-4d3f-bb38-8771e748e2d8","Type":"ContainerStarted","Data":"4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.023951 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerID="9bfa01de77ccb997c1e8a2a5cae6cf0d27b4bd609feb64e4ce6379c2c9f174a5" exitCode=1 Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.024035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerDied","Data":"9bfa01de77ccb997c1e8a2a5cae6cf0d27b4bd609feb64e4ce6379c2c9f174a5"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.024746 4769 scope.go:117] "RemoveContainer" containerID="9bfa01de77ccb997c1e8a2a5cae6cf0d27b4bd609feb64e4ce6379c2c9f174a5" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.025162 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029147 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerID="87161158451ff7c141f751920eb2d3f3394c01ddd9036ae70b879f4c033226cd" exitCode=0 Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029177 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerID="8c9433b175442fdeaa43a5a44a8129ee227fb7c9e3efaaaaa6f3c673aebe8e40" exitCode=2 Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029232 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerID="d351c97838585032e86bcae56f5aafaf4587e8b8e25683386d8f55ea193801cb" exitCode=0 Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029248 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerID="c7b4d9e1d1fc18133bf4883df46c5d96424e304c4a3bdeae758ee47eabec399b" exitCode=0 Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerDied","Data":"87161158451ff7c141f751920eb2d3f3394c01ddd9036ae70b879f4c033226cd"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerDied","Data":"8c9433b175442fdeaa43a5a44a8129ee227fb7c9e3efaaaaa6f3c673aebe8e40"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerDied","Data":"d351c97838585032e86bcae56f5aafaf4587e8b8e25683386d8f55ea193801cb"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.029950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerDied","Data":"c7b4d9e1d1fc18133bf4883df46c5d96424e304c4a3bdeae758ee47eabec399b"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.032432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" event={"ID":"7658f401-2091-41a5-834d-eb052f71924b","Type":"ContainerStarted","Data":"847021ad5e806201b166db6b08e694348b3111943706a7e60c22a2492b92b982"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.032734 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.034341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" event={"ID":"74d6a6f6-8260-449d-86a2-3a5d2d4bc18d","Type":"ContainerDied","Data":"04e561eb6bb1e8ad2d8357d11cebbfb502441cddd7ecbd49c66055103a4f3842"} Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.034366 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04e561eb6bb1e8ad2d8357d11cebbfb502441cddd7ecbd49c66055103a4f3842" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.034515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-shq9l" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.059550 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.059522637 podStartE2EDuration="4.059522637s" podCreationTimestamp="2025-11-21 13:14:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:22.046912167 +0000 UTC m=+5020.747573995" watchObservedRunningTime="2025-11-21 13:14:22.059522637 +0000 UTC m=+5020.760184455" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.114474 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" podStartSLOduration=3.114451176 podStartE2EDuration="3.114451176s" podCreationTimestamp="2025-11-21 13:14:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:22.10235943 +0000 UTC m=+5020.803021248" watchObservedRunningTime="2025-11-21 13:14:22.114451176 +0000 UTC m=+5020.815112994" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.127014 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k8lx8"] Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.567087 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.626569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-log-httpd\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.627027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-combined-ca-bundle\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.627064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-scripts\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.627082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkjc9\" (UniqueName: \"kubernetes.io/projected/5f0c75a4-09c0-41f3-b153-a723dd115353-kube-api-access-dkjc9\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.627144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-run-httpd\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.627181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-config-data\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.627228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-sg-core-conf-yaml\") pod \"5f0c75a4-09c0-41f3-b153-a723dd115353\" (UID: \"5f0c75a4-09c0-41f3-b153-a723dd115353\") " Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.632882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.637572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-scripts" (OuterVolumeSpecName: "scripts") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.638157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.662600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0c75a4-09c0-41f3-b153-a723dd115353-kube-api-access-dkjc9" (OuterVolumeSpecName: "kube-api-access-dkjc9") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "kube-api-access-dkjc9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.688830 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88"] Nov 21 13:14:22 crc kubenswrapper[4769]: E1121 13:14:22.689381 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="sg-core" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689404 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="sg-core" Nov 21 13:14:22 crc kubenswrapper[4769]: E1121 13:14:22.689438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="proxy-httpd" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689449 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="proxy-httpd" Nov 21 13:14:22 crc kubenswrapper[4769]: E1121 13:14:22.689473 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-notification-agent" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689482 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-notification-agent" Nov 21 13:14:22 crc kubenswrapper[4769]: E1121 13:14:22.689511 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" containerName="barbican-db-sync" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689520 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" containerName="barbican-db-sync" Nov 21 13:14:22 crc kubenswrapper[4769]: E1121 13:14:22.689532 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-central-agent" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689540 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-central-agent" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689746 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="sg-core" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689783 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-notification-agent" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689798 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" containerName="barbican-db-sync" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689815 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="proxy-httpd" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.689832 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" containerName="ceilometer-central-agent" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.691295 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.700888 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-dh9rd" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.701086 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.701231 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.716875 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n"] Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.722010 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.727095 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88"] Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data-custom\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729056 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs86m\" (UniqueName: \"kubernetes.io/projected/64e92b59-ae64-4236-8fef-a857b35df619-kube-api-access-bs86m\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729165 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-combined-ca-bundle\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64e92b59-ae64-4236-8fef-a857b35df619-logs\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729326 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729336 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5f0c75a4-09c0-41f3-b153-a723dd115353-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729344 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729353 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dkjc9\" (UniqueName: \"kubernetes.io/projected/5f0c75a4-09c0-41f3-b153-a723dd115353-kube-api-access-dkjc9\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.729911 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.737632 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n"] Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.825298 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp"] Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.826884 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.829997 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-combined-ca-bundle\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64e92b59-ae64-4236-8fef-a857b35df619-logs\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data-custom\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4ddn\" (UniqueName: \"kubernetes.io/projected/f587d35f-67ee-497c-8d1b-00cd19e6a42a-kube-api-access-q4ddn\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-combined-ca-bundle\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data-custom\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bs86m\" (UniqueName: \"kubernetes.io/projected/64e92b59-ae64-4236-8fef-a857b35df619-kube-api-access-bs86m\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f587d35f-67ee-497c-8d1b-00cd19e6a42a-logs\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.832961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64e92b59-ae64-4236-8fef-a857b35df619-logs\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.843738 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.855341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-combined-ca-bundle\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.857571 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp"] Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.857970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data-custom\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.860358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs86m\" (UniqueName: \"kubernetes.io/projected/64e92b59-ae64-4236-8fef-a857b35df619-kube-api-access-bs86m\") pod \"barbican-keystone-listener-8cdb476cb-4vs88\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.886653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.933847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data-custom\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-combined-ca-bundle\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934230 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgswp\" (UniqueName: \"kubernetes.io/projected/be04736f-6752-4ab7-8399-22dccef1daee-kube-api-access-zgswp\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q4ddn\" (UniqueName: \"kubernetes.io/projected/f587d35f-67ee-497c-8d1b-00cd19e6a42a-kube-api-access-q4ddn\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-combined-ca-bundle\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f587d35f-67ee-497c-8d1b-00cd19e6a42a-logs\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data-custom\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be04736f-6752-4ab7-8399-22dccef1daee-logs\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.934440 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.939544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data-custom\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.940442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f587d35f-67ee-497c-8d1b-00cd19e6a42a-logs\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.941543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.949418 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-combined-ca-bundle\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.952655 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.953821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4ddn\" (UniqueName: \"kubernetes.io/projected/f587d35f-67ee-497c-8d1b-00cd19e6a42a-kube-api-access-q4ddn\") pod \"barbican-worker-6bf87cb49f-7s75n\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.957297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-config-data" (OuterVolumeSpecName: "config-data") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:22 crc kubenswrapper[4769]: I1121 13:14:22.969746 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.016364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5f0c75a4-09c0-41f3-b153-a723dd115353" (UID: "5f0c75a4-09c0-41f3-b153-a723dd115353"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.038709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data-custom\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.038770 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be04736f-6752-4ab7-8399-22dccef1daee-logs\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.038932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-combined-ca-bundle\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.038989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zgswp\" (UniqueName: \"kubernetes.io/projected/be04736f-6752-4ab7-8399-22dccef1daee-kube-api-access-zgswp\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.039040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.039229 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.039248 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f0c75a4-09c0-41f3-b153-a723dd115353-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.044696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be04736f-6752-4ab7-8399-22dccef1daee-logs\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.046075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-combined-ca-bundle\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.048537 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data-custom\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.048840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.049674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" event={"ID":"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee","Type":"ContainerStarted","Data":"efc51cfbb4a39361534ad3d6bd863f4388872a3d4440023d53f983859fe2fafc"} Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.049719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" event={"ID":"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee","Type":"ContainerStarted","Data":"1f7477fed1fbdf6be509dc090c67dcd719052799bac8385f187ac0f8fae99bae"} Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.057995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgswp\" (UniqueName: \"kubernetes.io/projected/be04736f-6752-4ab7-8399-22dccef1daee-kube-api-access-zgswp\") pod \"barbican-api-9fc6bd774-xk9lp\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.064134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerStarted","Data":"9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b"} Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.064426 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.083000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5f0c75a4-09c0-41f3-b153-a723dd115353","Type":"ContainerDied","Data":"846a2464b2bede124ae9636d244b9e24379a9eba706be6194080dbbdd210dc73"} Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.083052 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.083108 4769 scope.go:117] "RemoveContainer" containerID="87161158451ff7c141f751920eb2d3f3394c01ddd9036ae70b879f4c033226cd" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.088658 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" podStartSLOduration=2.08863804 podStartE2EDuration="2.08863804s" podCreationTimestamp="2025-11-21 13:14:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:23.080651385 +0000 UTC m=+5021.781313213" watchObservedRunningTime="2025-11-21 13:14:23.08863804 +0000 UTC m=+5021.789299858" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.088851 4769 generic.go:334] "Generic (PLEG): container finished" podID="7745b13c-03b6-48ec-a3ca-fda54d77d5bb" containerID="1cc9ce240529d7cf767425ba46de20b5cd7f0399808010279416827c077cc542" exitCode=0 Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.088916 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" event={"ID":"7745b13c-03b6-48ec-a3ca-fda54d77d5bb","Type":"ContainerDied","Data":"1cc9ce240529d7cf767425ba46de20b5cd7f0399808010279416827c077cc542"} Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.106231 4769 generic.go:334] "Generic (PLEG): container finished" podID="06dda6f1-250b-496b-8545-c85e8ac91921" containerID="90b5a48879d63f18b826dfcbb5b2ba070be7d88c1e27bc3c7b971223df9d3d96" exitCode=0 Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.107284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" event={"ID":"06dda6f1-250b-496b-8545-c85e8ac91921","Type":"ContainerDied","Data":"90b5a48879d63f18b826dfcbb5b2ba070be7d88c1e27bc3c7b971223df9d3d96"} Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.107950 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.109421 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podStartSLOduration=4.10940272 podStartE2EDuration="4.10940272s" podCreationTimestamp="2025-11-21 13:14:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:23.104745064 +0000 UTC m=+5021.805406892" watchObservedRunningTime="2025-11-21 13:14:23.10940272 +0000 UTC m=+5021.810064538" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.162438 4769 scope.go:117] "RemoveContainer" containerID="8c9433b175442fdeaa43a5a44a8129ee227fb7c9e3efaaaaa6f3c673aebe8e40" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.281766 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.282476 4769 scope.go:117] "RemoveContainer" containerID="d351c97838585032e86bcae56f5aafaf4587e8b8e25683386d8f55ea193801cb" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.330994 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.331054 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.355800 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.361929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.364646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.364822 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.373747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.392838 4769 scope.go:117] "RemoveContainer" containerID="c7b4d9e1d1fc18133bf4883df46c5d96424e304c4a3bdeae758ee47eabec399b" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-config-data\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-log-httpd\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-run-httpd\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-scripts\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6wzj\" (UniqueName: \"kubernetes.io/projected/996577d9-578c-40c1-8310-24db4469b23f-kube-api-access-n6wzj\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.460320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.561592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-config-data\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.561998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-log-httpd\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.562068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-run-httpd\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.562090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.562121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-scripts\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.562144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6wzj\" (UniqueName: \"kubernetes.io/projected/996577d9-578c-40c1-8310-24db4469b23f-kube-api-access-n6wzj\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.562179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.566630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-log-httpd\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.566896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-run-httpd\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.573696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-config-data\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.577462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.577659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.578031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-scripts\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.585216 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6wzj\" (UniqueName: \"kubernetes.io/projected/996577d9-578c-40c1-8310-24db4469b23f-kube-api-access-n6wzj\") pod \"ceilometer-0\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.676227 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88"] Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.681533 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n"] Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.716379 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:23 crc kubenswrapper[4769]: I1121 13:14:23.944660 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp"] Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.134121 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" event={"ID":"f587d35f-67ee-497c-8d1b-00cd19e6a42a","Type":"ContainerStarted","Data":"2c1d8c3924d0b3e5ae694196b9f4434b588d49481c19b66e89fed2280f6d6434"} Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.139016 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" event={"ID":"be04736f-6752-4ab7-8399-22dccef1daee","Type":"ContainerStarted","Data":"7572299f69330d37fd04d554ba59a23fba1998de940620bebfabeda5f64bcb91"} Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.140037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" event={"ID":"64e92b59-ae64-4236-8fef-a857b35df619","Type":"ContainerStarted","Data":"fe42c3bda4cb0e0d5423c3444fc0cc8f063c41690246b51d0327fe78623d9d03"} Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.151540 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerID="9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b" exitCode=1 Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.151974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerDied","Data":"9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b"} Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.152046 4769 scope.go:117] "RemoveContainer" containerID="9bfa01de77ccb997c1e8a2a5cae6cf0d27b4bd609feb64e4ce6379c2c9f174a5" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.153133 4769 scope.go:117] "RemoveContainer" containerID="9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b" Nov 21 13:14:24 crc kubenswrapper[4769]: E1121 13:14:24.153508 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=placement-api pod=placement-8476ff6dc6-jfqrm_openstack-kuttl-tests(5bc57375-7cce-458b-a855-dc3658fbc26d)\"" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.476021 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.637346 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.690142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-config\") pod \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.691050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g25j6\" (UniqueName: \"kubernetes.io/projected/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-kube-api-access-g25j6\") pod \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.691230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-combined-ca-bundle\") pod \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\" (UID: \"7745b13c-03b6-48ec-a3ca-fda54d77d5bb\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.712106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-kube-api-access-g25j6" (OuterVolumeSpecName: "kube-api-access-g25j6") pod "7745b13c-03b6-48ec-a3ca-fda54d77d5bb" (UID: "7745b13c-03b6-48ec-a3ca-fda54d77d5bb"). InnerVolumeSpecName "kube-api-access-g25j6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.732549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7745b13c-03b6-48ec-a3ca-fda54d77d5bb" (UID: "7745b13c-03b6-48ec-a3ca-fda54d77d5bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.737370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-config" (OuterVolumeSpecName: "config") pod "7745b13c-03b6-48ec-a3ca-fda54d77d5bb" (UID: "7745b13c-03b6-48ec-a3ca-fda54d77d5bb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.794834 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g25j6\" (UniqueName: \"kubernetes.io/projected/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-kube-api-access-g25j6\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.794882 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.794894 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7745b13c-03b6-48ec-a3ca-fda54d77d5bb-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.825003 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.896508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5sgg\" (UniqueName: \"kubernetes.io/projected/06dda6f1-250b-496b-8545-c85e8ac91921-kube-api-access-z5sgg\") pod \"06dda6f1-250b-496b-8545-c85e8ac91921\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.896565 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-scripts\") pod \"06dda6f1-250b-496b-8545-c85e8ac91921\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.896648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-combined-ca-bundle\") pod \"06dda6f1-250b-496b-8545-c85e8ac91921\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.896724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-config-data\") pod \"06dda6f1-250b-496b-8545-c85e8ac91921\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.896796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-db-sync-config-data\") pod \"06dda6f1-250b-496b-8545-c85e8ac91921\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.896942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06dda6f1-250b-496b-8545-c85e8ac91921-etc-machine-id\") pod \"06dda6f1-250b-496b-8545-c85e8ac91921\" (UID: \"06dda6f1-250b-496b-8545-c85e8ac91921\") " Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.897076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/06dda6f1-250b-496b-8545-c85e8ac91921-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "06dda6f1-250b-496b-8545-c85e8ac91921" (UID: "06dda6f1-250b-496b-8545-c85e8ac91921"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.897580 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/06dda6f1-250b-496b-8545-c85e8ac91921-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.906215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "06dda6f1-250b-496b-8545-c85e8ac91921" (UID: "06dda6f1-250b-496b-8545-c85e8ac91921"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.915386 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-scripts" (OuterVolumeSpecName: "scripts") pod "06dda6f1-250b-496b-8545-c85e8ac91921" (UID: "06dda6f1-250b-496b-8545-c85e8ac91921"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.921337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06dda6f1-250b-496b-8545-c85e8ac91921-kube-api-access-z5sgg" (OuterVolumeSpecName: "kube-api-access-z5sgg") pod "06dda6f1-250b-496b-8545-c85e8ac91921" (UID: "06dda6f1-250b-496b-8545-c85e8ac91921"). InnerVolumeSpecName "kube-api-access-z5sgg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.940666 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "06dda6f1-250b-496b-8545-c85e8ac91921" (UID: "06dda6f1-250b-496b-8545-c85e8ac91921"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:24 crc kubenswrapper[4769]: I1121 13:14:24.950826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-config-data" (OuterVolumeSpecName: "config-data") pod "06dda6f1-250b-496b-8545-c85e8ac91921" (UID: "06dda6f1-250b-496b-8545-c85e8ac91921"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.002538 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z5sgg\" (UniqueName: \"kubernetes.io/projected/06dda6f1-250b-496b-8545-c85e8ac91921-kube-api-access-z5sgg\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.002595 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.002609 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.002621 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.002644 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/06dda6f1-250b-496b-8545-c85e8ac91921-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.195874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.195879 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-7r4lg" event={"ID":"06dda6f1-250b-496b-8545-c85e8ac91921","Type":"ContainerDied","Data":"c2e203bbe5a673d75b88a470b0a4edb0e13688be5c868a4f05bd7e9af6efcd14"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.195945 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2e203bbe5a673d75b88a470b0a4edb0e13688be5c868a4f05bd7e9af6efcd14" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.198126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" event={"ID":"f587d35f-67ee-497c-8d1b-00cd19e6a42a","Type":"ContainerStarted","Data":"e083fdef73808cdcadc8a5eebaa41ece176f6935c9510d1818ee8189eca45284"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.198155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" event={"ID":"f587d35f-67ee-497c-8d1b-00cd19e6a42a","Type":"ContainerStarted","Data":"4f8f1f9db0e4143f84aee90e6923931e5b99b72770c4cdf54742aae36679e761"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.200119 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" event={"ID":"be04736f-6752-4ab7-8399-22dccef1daee","Type":"ContainerStarted","Data":"a1b294599aee5cec1fe56543232b99141788e5c80f58791c95b6ac600caa98d5"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.200142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" event={"ID":"be04736f-6752-4ab7-8399-22dccef1daee","Type":"ContainerStarted","Data":"14b42dbb74e27a4fc74095aa922cf52a1e9d9c9291837787f6ece42c2f4cdf9e"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.200438 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.202454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" event={"ID":"64e92b59-ae64-4236-8fef-a857b35df619","Type":"ContainerStarted","Data":"31c5364f0b49ac3f12d434c67d9370c9442a0c8c9c541dc56c1a8e59739610e0"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.202499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" event={"ID":"64e92b59-ae64-4236-8fef-a857b35df619","Type":"ContainerStarted","Data":"7100f7dfd87d9df473edc7e27cf9a8b56bd937ff687861cb12558e4b1fedb2d2"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.203753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerStarted","Data":"03aff210508b8ac33238de1a2c4939fe79c7ca603691c6483fc15070cf41255c"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.209573 4769 scope.go:117] "RemoveContainer" containerID="9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.211440 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.212417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" event={"ID":"7745b13c-03b6-48ec-a3ca-fda54d77d5bb","Type":"ContainerDied","Data":"5f1e65aa3bb8191c7f8b00096e0907563eb107481d6cbddc7dba71e34e579a68"} Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.212453 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f1e65aa3bb8191c7f8b00096e0907563eb107481d6cbddc7dba71e34e579a68" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.212499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mg55q" Nov 21 13:14:25 crc kubenswrapper[4769]: E1121 13:14:25.212533 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=placement-api pod=placement-8476ff6dc6-jfqrm_openstack-kuttl-tests(5bc57375-7cce-458b-a855-dc3658fbc26d)\"" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.220798 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" podStartSLOduration=3.220780598 podStartE2EDuration="3.220780598s" podCreationTimestamp="2025-11-21 13:14:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:25.218142407 +0000 UTC m=+5023.918804235" watchObservedRunningTime="2025-11-21 13:14:25.220780598 +0000 UTC m=+5023.921442416" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.289103 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0c75a4-09c0-41f3-b153-a723dd115353" path="/var/lib/kubelet/pods/5f0c75a4-09c0-41f3-b153-a723dd115353/volumes" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.313444 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" podStartSLOduration=3.313421414 podStartE2EDuration="3.313421414s" podCreationTimestamp="2025-11-21 13:14:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:25.304237157 +0000 UTC m=+5024.004898985" watchObservedRunningTime="2025-11-21 13:14:25.313421414 +0000 UTC m=+5024.014083232" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.314724 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" podStartSLOduration=3.314719239 podStartE2EDuration="3.314719239s" podCreationTimestamp="2025-11-21 13:14:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:25.270780945 +0000 UTC m=+5023.971442763" watchObservedRunningTime="2025-11-21 13:14:25.314719239 +0000 UTC m=+5024.015381057" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.447382 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:25 crc kubenswrapper[4769]: E1121 13:14:25.447763 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="06dda6f1-250b-496b-8545-c85e8ac91921" containerName="cinder-db-sync" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.447781 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="06dda6f1-250b-496b-8545-c85e8ac91921" containerName="cinder-db-sync" Nov 21 13:14:25 crc kubenswrapper[4769]: E1121 13:14:25.447793 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7745b13c-03b6-48ec-a3ca-fda54d77d5bb" containerName="neutron-db-sync" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.447800 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7745b13c-03b6-48ec-a3ca-fda54d77d5bb" containerName="neutron-db-sync" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.447988 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7745b13c-03b6-48ec-a3ca-fda54d77d5bb" containerName="neutron-db-sync" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.448015 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="06dda6f1-250b-496b-8545-c85e8ac91921" containerName="cinder-db-sync" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.453036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.460657 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-4jz5m" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.465284 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.465556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.465628 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.520520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.520617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpmmn\" (UniqueName: \"kubernetes.io/projected/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-kube-api-access-zpmmn\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.520883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.520960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.520992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-scripts\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.521068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.526714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.579292 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt"] Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.581137 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.587517 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt"] Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.592029 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.592269 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.592373 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.602641 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-kztxz" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.612757 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.621227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623503 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0144ecec-d1f8-4866-9bed-cde58a764e50-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-httpd-config\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-combined-ca-bundle\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zpmmn\" (UniqueName: \"kubernetes.io/projected/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-kube-api-access-zpmmn\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtnbf\" (UniqueName: \"kubernetes.io/projected/0144ecec-d1f8-4866-9bed-cde58a764e50-kube-api-access-xtnbf\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-scripts\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjkdk\" (UniqueName: \"kubernetes.io/projected/95358f61-e922-4897-b6d6-ef84c250fe36-kube-api-access-kjkdk\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0144ecec-d1f8-4866-9bed-cde58a764e50-logs\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623795 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-scripts\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-ovndb-tls-certs\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data-custom\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623916 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-config\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.623936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.627540 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.630585 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.633318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.634575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.640619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.641760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.642825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-scripts\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.649868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpmmn\" (UniqueName: \"kubernetes.io/projected/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-kube-api-access-zpmmn\") pod \"cinder-scheduler-0\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-config\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728339 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0144ecec-d1f8-4866-9bed-cde58a764e50-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-httpd-config\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-combined-ca-bundle\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xtnbf\" (UniqueName: \"kubernetes.io/projected/0144ecec-d1f8-4866-9bed-cde58a764e50-kube-api-access-xtnbf\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728459 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kjkdk\" (UniqueName: \"kubernetes.io/projected/95358f61-e922-4897-b6d6-ef84c250fe36-kube-api-access-kjkdk\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0144ecec-d1f8-4866-9bed-cde58a764e50-logs\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-scripts\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-ovndb-tls-certs\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.728565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data-custom\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.733515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0144ecec-d1f8-4866-9bed-cde58a764e50-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.738624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-config\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.739171 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0144ecec-d1f8-4866-9bed-cde58a764e50-logs\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.739860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data-custom\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.745875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-httpd-config\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.746110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.746840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.748116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-scripts\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.754842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-combined-ca-bundle\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.765974 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-ovndb-tls-certs\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.768096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtnbf\" (UniqueName: \"kubernetes.io/projected/0144ecec-d1f8-4866-9bed-cde58a764e50-kube-api-access-xtnbf\") pod \"cinder-api-0\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.768526 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.768716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjkdk\" (UniqueName: \"kubernetes.io/projected/95358f61-e922-4897-b6d6-ef84c250fe36-kube-api-access-kjkdk\") pod \"neutron-7b47f96c5f-ctbrt\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.905149 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:25 crc kubenswrapper[4769]: I1121 13:14:25.923154 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:26 crc kubenswrapper[4769]: I1121 13:14:26.224259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerStarted","Data":"a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5"} Nov 21 13:14:26 crc kubenswrapper[4769]: I1121 13:14:26.225492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:26 crc kubenswrapper[4769]: I1121 13:14:26.292330 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:26 crc kubenswrapper[4769]: I1121 13:14:26.547097 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt"] Nov 21 13:14:26 crc kubenswrapper[4769]: W1121 13:14:26.556504 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95358f61_e922_4897_b6d6_ef84c250fe36.slice/crio-4a62605433fa7e963d2d46d42b492651078c3e7ba036c158f8d1113d1d6b7751 WatchSource:0}: Error finding container 4a62605433fa7e963d2d46d42b492651078c3e7ba036c158f8d1113d1d6b7751: Status 404 returned error can't find the container with id 4a62605433fa7e963d2d46d42b492651078c3e7ba036c158f8d1113d1d6b7751 Nov 21 13:14:26 crc kubenswrapper[4769]: I1121 13:14:26.683227 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:27 crc kubenswrapper[4769]: I1121 13:14:27.261422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe","Type":"ContainerStarted","Data":"d4e56e6a12dca3ca61406345e8edaf872e36cbd619cc703ead3aaaf37ea77a4d"} Nov 21 13:14:27 crc kubenswrapper[4769]: I1121 13:14:27.261868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe","Type":"ContainerStarted","Data":"9363444fc0824f082f9221177c4d610f466b74eb5a05da8c79bb994e9a2c8098"} Nov 21 13:14:27 crc kubenswrapper[4769]: I1121 13:14:27.263604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" event={"ID":"95358f61-e922-4897-b6d6-ef84c250fe36","Type":"ContainerStarted","Data":"ff6e5208f6f875e2be955c084aa59528a726de6594aba59482549fc032b1da39"} Nov 21 13:14:27 crc kubenswrapper[4769]: I1121 13:14:27.263634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" event={"ID":"95358f61-e922-4897-b6d6-ef84c250fe36","Type":"ContainerStarted","Data":"4a62605433fa7e963d2d46d42b492651078c3e7ba036c158f8d1113d1d6b7751"} Nov 21 13:14:27 crc kubenswrapper[4769]: I1121 13:14:27.265731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0144ecec-d1f8-4866-9bed-cde58a764e50","Type":"ContainerStarted","Data":"f761784903f78707c45f4b0029d67b854ca9feb1b3642e0c526880087ca63631"} Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.282936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0144ecec-d1f8-4866-9bed-cde58a764e50","Type":"ContainerStarted","Data":"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45"} Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.284538 4769 generic.go:334] "Generic (PLEG): container finished" podID="d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" containerID="efc51cfbb4a39361534ad3d6bd863f4388872a3d4440023d53f983859fe2fafc" exitCode=0 Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.284594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" event={"ID":"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee","Type":"ContainerDied","Data":"efc51cfbb4a39361534ad3d6bd863f4388872a3d4440023d53f983859fe2fafc"} Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.286742 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerStarted","Data":"2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147"} Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.288541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe","Type":"ContainerStarted","Data":"4856777467e2082c284fb8358726b74fdd69e11dcd9f16191a8cfdbd7234cfe2"} Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.293382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" event={"ID":"95358f61-e922-4897-b6d6-ef84c250fe36","Type":"ContainerStarted","Data":"6745ccaae6613659b84e3701b16f37df336aa00a0fe58e18a18444a352c8574c"} Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.293834 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.322614 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" podStartSLOduration=3.322595469 podStartE2EDuration="3.322595469s" podCreationTimestamp="2025-11-21 13:14:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:28.317483871 +0000 UTC m=+5027.018145689" watchObservedRunningTime="2025-11-21 13:14:28.322595469 +0000 UTC m=+5027.023257287" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.355675 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.355652029 podStartE2EDuration="3.355652029s" podCreationTimestamp="2025-11-21 13:14:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:28.342797543 +0000 UTC m=+5027.043459361" watchObservedRunningTime="2025-11-21 13:14:28.355652029 +0000 UTC m=+5027.056313847" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.424600 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.424678 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.441636 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.441687 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.468341 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.481549 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.481742 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:28 crc kubenswrapper[4769]: I1121 13:14:28.493437 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.305593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0144ecec-d1f8-4866-9bed-cde58a764e50","Type":"ContainerStarted","Data":"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7"} Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.307315 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.309436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerStarted","Data":"8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da"} Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.310459 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.310731 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.311702 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.312344 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.332332 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.33231482 podStartE2EDuration="4.33231482s" podCreationTimestamp="2025-11-21 13:14:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:29.324759587 +0000 UTC m=+5028.025421405" watchObservedRunningTime="2025-11-21 13:14:29.33231482 +0000 UTC m=+5028.032976638" Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.455716 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:29 crc kubenswrapper[4769]: I1121 13:14:29.916067 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.026739 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-combined-ca-bundle\") pod \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.026816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-credential-keys\") pod \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.026886 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-fernet-keys\") pod \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.026916 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9thp\" (UniqueName: \"kubernetes.io/projected/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-kube-api-access-w9thp\") pod \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.026991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-scripts\") pod \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.027011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-config-data\") pod \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\" (UID: \"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee\") " Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.037395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-scripts" (OuterVolumeSpecName: "scripts") pod "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" (UID: "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.037496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-kube-api-access-w9thp" (OuterVolumeSpecName: "kube-api-access-w9thp") pod "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" (UID: "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee"). InnerVolumeSpecName "kube-api-access-w9thp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.037663 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" (UID: "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.038101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" (UID: "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.060337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" (UID: "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.065525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-config-data" (OuterVolumeSpecName: "config-data") pod "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" (UID: "d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.128629 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.128663 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.128673 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.128683 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.128691 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.128701 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w9thp\" (UniqueName: \"kubernetes.io/projected/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee-kube-api-access-w9thp\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.320674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" event={"ID":"d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee","Type":"ContainerDied","Data":"1f7477fed1fbdf6be509dc090c67dcd719052799bac8385f187ac0f8fae99bae"} Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.321057 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f7477fed1fbdf6be509dc090c67dcd719052799bac8385f187ac0f8fae99bae" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.320739 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-k8lx8" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.324772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerStarted","Data":"0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855"} Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.325751 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.365498 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.204569401 podStartE2EDuration="7.365481583s" podCreationTimestamp="2025-11-21 13:14:23 +0000 UTC" firstStartedPulling="2025-11-21 13:14:24.531783207 +0000 UTC m=+5023.232445025" lastFinishedPulling="2025-11-21 13:14:29.692695389 +0000 UTC m=+5028.393357207" observedRunningTime="2025-11-21 13:14:30.358589768 +0000 UTC m=+5029.059251586" watchObservedRunningTime="2025-11-21 13:14:30.365481583 +0000 UTC m=+5029.066143401" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.455813 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-75dc7ff446-mqw8n"] Nov 21 13:14:30 crc kubenswrapper[4769]: E1121 13:14:30.456200 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" containerName="keystone-bootstrap" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.456217 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" containerName="keystone-bootstrap" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.456428 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" containerName="keystone-bootstrap" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.457101 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.462761 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-rt6qk" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.462970 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.463006 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.463907 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.464619 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.470262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.485829 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-75dc7ff446-mqw8n"] Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-scripts\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-config-data\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-internal-tls-certs\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-fernet-keys\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhwqg\" (UniqueName: \"kubernetes.io/projected/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-kube-api-access-fhwqg\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-public-tls-certs\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547817 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-combined-ca-bundle\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.547846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-credential-keys\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.648986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-internal-tls-certs\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-fernet-keys\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fhwqg\" (UniqueName: \"kubernetes.io/projected/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-kube-api-access-fhwqg\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-public-tls-certs\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-combined-ca-bundle\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-credential-keys\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649163 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-scripts\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.649324 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-config-data\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.653772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-combined-ca-bundle\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.654040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-scripts\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.654464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-fernet-keys\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.654757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-config-data\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.656715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-public-tls-certs\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.656975 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-internal-tls-certs\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.660602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-credential-keys\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.683677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhwqg\" (UniqueName: \"kubernetes.io/projected/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-kube-api-access-fhwqg\") pod \"keystone-75dc7ff446-mqw8n\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.768898 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:30 crc kubenswrapper[4769]: I1121 13:14:30.781903 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:31 crc kubenswrapper[4769]: I1121 13:14:31.336604 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api-log" containerID="cri-o://65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45" gracePeriod=30 Nov 21 13:14:31 crc kubenswrapper[4769]: I1121 13:14:31.336637 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:14:31 crc kubenswrapper[4769]: I1121 13:14:31.337096 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:14:31 crc kubenswrapper[4769]: I1121 13:14:31.336716 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api" containerID="cri-o://a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7" gracePeriod=30 Nov 21 13:14:31 crc kubenswrapper[4769]: I1121 13:14:31.345681 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-75dc7ff446-mqw8n"] Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.263830 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352362 4769 generic.go:334] "Generic (PLEG): container finished" podID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerID="a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7" exitCode=0 Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352417 4769 generic.go:334] "Generic (PLEG): container finished" podID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerID="65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45" exitCode=143 Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0144ecec-d1f8-4866-9bed-cde58a764e50","Type":"ContainerDied","Data":"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7"} Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352491 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0144ecec-d1f8-4866-9bed-cde58a764e50","Type":"ContainerDied","Data":"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45"} Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0144ecec-d1f8-4866-9bed-cde58a764e50","Type":"ContainerDied","Data":"f761784903f78707c45f4b0029d67b854ca9feb1b3642e0c526880087ca63631"} Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352518 4769 scope.go:117] "RemoveContainer" containerID="a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.352661 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.364369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" event={"ID":"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a","Type":"ContainerStarted","Data":"bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409"} Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.364403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" event={"ID":"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a","Type":"ContainerStarted","Data":"18a80cd0de80c8e4fa19b23f29342503be80afedcb40e784c58ca0a5b560bf5a"} Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.389227 4769 scope.go:117] "RemoveContainer" containerID="65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.394822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0144ecec-d1f8-4866-9bed-cde58a764e50-etc-machine-id\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.394908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-combined-ca-bundle\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.394941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.395095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0144ecec-d1f8-4866-9bed-cde58a764e50-logs\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.395125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtnbf\" (UniqueName: \"kubernetes.io/projected/0144ecec-d1f8-4866-9bed-cde58a764e50-kube-api-access-xtnbf\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.395169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data-custom\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.395204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-scripts\") pod \"0144ecec-d1f8-4866-9bed-cde58a764e50\" (UID: \"0144ecec-d1f8-4866-9bed-cde58a764e50\") " Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.397270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0144ecec-d1f8-4866-9bed-cde58a764e50-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.397418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0144ecec-d1f8-4866-9bed-cde58a764e50-logs" (OuterVolumeSpecName: "logs") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.404858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.407347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-scripts" (OuterVolumeSpecName: "scripts") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.418430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0144ecec-d1f8-4866-9bed-cde58a764e50-kube-api-access-xtnbf" (OuterVolumeSpecName: "kube-api-access-xtnbf") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "kube-api-access-xtnbf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.484372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.499008 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0144ecec-d1f8-4866-9bed-cde58a764e50-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.499044 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xtnbf\" (UniqueName: \"kubernetes.io/projected/0144ecec-d1f8-4866-9bed-cde58a764e50-kube-api-access-xtnbf\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.499057 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.499069 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.499079 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0144ecec-d1f8-4866-9bed-cde58a764e50-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.499091 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.508303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data" (OuterVolumeSpecName: "config-data") pod "0144ecec-d1f8-4866-9bed-cde58a764e50" (UID: "0144ecec-d1f8-4866-9bed-cde58a764e50"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.510607 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.510698 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.511062 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.544402 4769 scope.go:117] "RemoveContainer" containerID="a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7" Nov 21 13:14:32 crc kubenswrapper[4769]: E1121 13:14:32.544928 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7\": container with ID starting with a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7 not found: ID does not exist" containerID="a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.544983 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7"} err="failed to get container status \"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7\": rpc error: code = NotFound desc = could not find container \"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7\": container with ID starting with a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7 not found: ID does not exist" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.545004 4769 scope.go:117] "RemoveContainer" containerID="65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45" Nov 21 13:14:32 crc kubenswrapper[4769]: E1121 13:14:32.545432 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45\": container with ID starting with 65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45 not found: ID does not exist" containerID="65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.545453 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45"} err="failed to get container status \"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45\": rpc error: code = NotFound desc = could not find container \"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45\": container with ID starting with 65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45 not found: ID does not exist" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.545489 4769 scope.go:117] "RemoveContainer" containerID="a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.546020 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7"} err="failed to get container status \"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7\": rpc error: code = NotFound desc = could not find container \"a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7\": container with ID starting with a5dd286d2c224abfc64c20433084a2dfc752cb11264ee794943a0160fa465df7 not found: ID does not exist" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.546045 4769 scope.go:117] "RemoveContainer" containerID="65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.546415 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45"} err="failed to get container status \"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45\": rpc error: code = NotFound desc = could not find container \"65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45\": container with ID starting with 65c5b19c7ae40a8e96bfe0ffa07dfd2616a1bde79f643bf1a8b3d1d966b05b45 not found: ID does not exist" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.600535 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0144ecec-d1f8-4866-9bed-cde58a764e50-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.647731 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.648179 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.703215 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.716245 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.728013 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:32 crc kubenswrapper[4769]: E1121 13:14:32.728451 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api-log" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.728466 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api-log" Nov 21 13:14:32 crc kubenswrapper[4769]: E1121 13:14:32.728499 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.728507 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.728710 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.728730 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" containerName="cinder-api-log" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.729742 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.734848 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.734992 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.735095 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.743072 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-public-tls-certs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcda061b-5dcd-43e6-ba38-4107650d2c68-logs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data-custom\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcda061b-5dcd-43e6-ba38-4107650d2c68-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-scripts\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckpk\" (UniqueName: \"kubernetes.io/projected/dcda061b-5dcd-43e6-ba38-4107650d2c68-kube-api-access-gckpk\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.805901 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.901232 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gckpk\" (UniqueName: \"kubernetes.io/projected/dcda061b-5dcd-43e6-ba38-4107650d2c68-kube-api-access-gckpk\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-public-tls-certs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcda061b-5dcd-43e6-ba38-4107650d2c68-logs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data-custom\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcda061b-5dcd-43e6-ba38-4107650d2c68-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.907953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-scripts\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.909355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcda061b-5dcd-43e6-ba38-4107650d2c68-logs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.910024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcda061b-5dcd-43e6-ba38-4107650d2c68-etc-machine-id\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.984320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.984717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-scripts\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.985272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data-custom\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.986176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.987640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.992205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckpk\" (UniqueName: \"kubernetes.io/projected/dcda061b-5dcd-43e6-ba38-4107650d2c68-kube-api-access-gckpk\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:32 crc kubenswrapper[4769]: I1121 13:14:32.992797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-public-tls-certs\") pod \"cinder-api-0\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.092621 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.310875 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0144ecec-d1f8-4866-9bed-cde58a764e50" path="/var/lib/kubelet/pods/0144ecec-d1f8-4866-9bed-cde58a764e50/volumes" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.421227 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.455246 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" podStartSLOduration=3.455223289 podStartE2EDuration="3.455223289s" podCreationTimestamp="2025-11-21 13:14:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:33.443553694 +0000 UTC m=+5032.144215512" watchObservedRunningTime="2025-11-21 13:14:33.455223289 +0000 UTC m=+5032.155885107" Nov 21 13:14:33 crc kubenswrapper[4769]: W1121 13:14:33.651466 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcda061b_5dcd_43e6_ba38_4107650d2c68.slice/crio-8bc2c1d7651576dd99ac2da60a156033057724f9e715fe9e064444c25bdd31a9 WatchSource:0}: Error finding container 8bc2c1d7651576dd99ac2da60a156033057724f9e715fe9e064444c25bdd31a9: Status 404 returned error can't find the container with id 8bc2c1d7651576dd99ac2da60a156033057724f9e715fe9e064444c25bdd31a9 Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.671301 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.842935 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-677956c48d-qmjsd"] Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.844722 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.847614 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.848485 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.860996 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-677956c48d-qmjsd"] Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-httpd-config\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-combined-ca-bundle\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937286 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-ovndb-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-config\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-public-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-internal-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:33 crc kubenswrapper[4769]: I1121 13:14:33.937394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgr28\" (UniqueName: \"kubernetes.io/projected/9974304e-9420-484d-83e8-996cd607775e-kube-api-access-qgr28\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.038573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-internal-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.038966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qgr28\" (UniqueName: \"kubernetes.io/projected/9974304e-9420-484d-83e8-996cd607775e-kube-api-access-qgr28\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.039359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-httpd-config\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.039390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-combined-ca-bundle\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.039812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-ovndb-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.039837 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-config\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.039853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-public-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.048149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-config\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.048873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-httpd-config\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.054784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-public-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.057504 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-combined-ca-bundle\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.065012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-ovndb-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.068713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgr28\" (UniqueName: \"kubernetes.io/projected/9974304e-9420-484d-83e8-996cd607775e-kube-api-access-qgr28\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.090180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-internal-tls-certs\") pod \"neutron-677956c48d-qmjsd\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.151060 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98"] Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.152557 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.157354 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.157470 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.171930 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.196308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98"] Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.243330 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56bq\" (UniqueName: \"kubernetes.io/projected/558083c4-e40d-4b2c-9906-97dbb347594f-kube-api-access-t56bq\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.243380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-internal-tls-certs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.243432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-public-tls-certs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.243581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data-custom\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.243715 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.243889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-combined-ca-bundle\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.244029 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/558083c4-e40d-4b2c-9906-97dbb347594f-logs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/558083c4-e40d-4b2c-9906-97dbb347594f-logs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349388 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t56bq\" (UniqueName: \"kubernetes.io/projected/558083c4-e40d-4b2c-9906-97dbb347594f-kube-api-access-t56bq\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-internal-tls-certs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-public-tls-certs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data-custom\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.349568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-combined-ca-bundle\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.350509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/558083c4-e40d-4b2c-9906-97dbb347594f-logs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.356717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.356880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-combined-ca-bundle\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.357009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-public-tls-certs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.358136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-internal-tls-certs\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.360893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data-custom\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.381746 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56bq\" (UniqueName: \"kubernetes.io/projected/558083c4-e40d-4b2c-9906-97dbb347594f-kube-api-access-t56bq\") pod \"barbican-api-cc55d97cd-rsl98\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.472761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.559559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcda061b-5dcd-43e6-ba38-4107650d2c68","Type":"ContainerStarted","Data":"8bc2c1d7651576dd99ac2da60a156033057724f9e715fe9e064444c25bdd31a9"} Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.807612 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-677956c48d-qmjsd"] Nov 21 13:14:34 crc kubenswrapper[4769]: I1121 13:14:34.925694 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98"] Nov 21 13:14:34 crc kubenswrapper[4769]: W1121 13:14:34.948812 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod558083c4_e40d_4b2c_9906_97dbb347594f.slice/crio-637987de3f5f4814ae60edb447bfdd394c06cd2bf2bb2d82d9b4aba6a9100986 WatchSource:0}: Error finding container 637987de3f5f4814ae60edb447bfdd394c06cd2bf2bb2d82d9b4aba6a9100986: Status 404 returned error can't find the container with id 637987de3f5f4814ae60edb447bfdd394c06cd2bf2bb2d82d9b4aba6a9100986 Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.579738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcda061b-5dcd-43e6-ba38-4107650d2c68","Type":"ContainerStarted","Data":"727c46869b60a9da5cf7db58b041b392b257ffa47fd5e4c83cb1fddd805f6a4f"} Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.594330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" event={"ID":"558083c4-e40d-4b2c-9906-97dbb347594f","Type":"ContainerStarted","Data":"0499d4a28070d43226b39b4ab467989c8946eb755a3a78fcc36f3e7aa8d50055"} Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.594375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" event={"ID":"558083c4-e40d-4b2c-9906-97dbb347594f","Type":"ContainerStarted","Data":"9cf697bda07d2b9c6e94f92949af58de39309d4b5c661190d34eddc8edcf37a5"} Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.594385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" event={"ID":"558083c4-e40d-4b2c-9906-97dbb347594f","Type":"ContainerStarted","Data":"637987de3f5f4814ae60edb447bfdd394c06cd2bf2bb2d82d9b4aba6a9100986"} Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.595448 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.595476 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.608296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" event={"ID":"9974304e-9420-484d-83e8-996cd607775e","Type":"ContainerStarted","Data":"88a3098d4de1963c4bb87da7f38369cee6007d6fac475005c87672c631e8c57a"} Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.608338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" event={"ID":"9974304e-9420-484d-83e8-996cd607775e","Type":"ContainerStarted","Data":"91a12b7861f49ee9349fd9f301965573b6fcae5c75d181bf605cdfb858bfe01d"} Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.633038 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" podStartSLOduration=1.6330193259999999 podStartE2EDuration="1.633019326s" podCreationTimestamp="2025-11-21 13:14:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:35.626520641 +0000 UTC m=+5034.327182459" watchObservedRunningTime="2025-11-21 13:14:35.633019326 +0000 UTC m=+5034.333681144" Nov 21 13:14:35 crc kubenswrapper[4769]: I1121 13:14:35.705730 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.080753 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.138354 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.522007 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.619399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" event={"ID":"9974304e-9420-484d-83e8-996cd607775e","Type":"ContainerStarted","Data":"f9476e9de41a7b3d04b8cc568338310fcadfcab6112de4eab5b2abf58c425d1d"} Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.620347 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.623917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcda061b-5dcd-43e6-ba38-4107650d2c68","Type":"ContainerStarted","Data":"6681d42e9aea19c227e4a1854ff99562bf648422d81c2564511296f50a6705ee"} Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.623994 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="cinder-scheduler" containerID="cri-o://d4e56e6a12dca3ca61406345e8edaf872e36cbd619cc703ead3aaaf37ea77a4d" gracePeriod=30 Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.624113 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="probe" containerID="cri-o://4856777467e2082c284fb8358726b74fdd69e11dcd9f16191a8cfdbd7234cfe2" gracePeriod=30 Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.624275 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.652170 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" podStartSLOduration=3.6521519209999997 podStartE2EDuration="3.652151921s" podCreationTimestamp="2025-11-21 13:14:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:36.645382699 +0000 UTC m=+5035.346044517" watchObservedRunningTime="2025-11-21 13:14:36.652151921 +0000 UTC m=+5035.352813729" Nov 21 13:14:36 crc kubenswrapper[4769]: I1121 13:14:36.688946 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.688923942 podStartE2EDuration="4.688923942s" podCreationTimestamp="2025-11-21 13:14:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:36.683970319 +0000 UTC m=+5035.384632137" watchObservedRunningTime="2025-11-21 13:14:36.688923942 +0000 UTC m=+5035.389585760" Nov 21 13:14:37 crc kubenswrapper[4769]: I1121 13:14:37.634308 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerID="4856777467e2082c284fb8358726b74fdd69e11dcd9f16191a8cfdbd7234cfe2" exitCode=0 Nov 21 13:14:37 crc kubenswrapper[4769]: I1121 13:14:37.634370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe","Type":"ContainerDied","Data":"4856777467e2082c284fb8358726b74fdd69e11dcd9f16191a8cfdbd7234cfe2"} Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.661913 4769 generic.go:334] "Generic (PLEG): container finished" podID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerID="d4e56e6a12dca3ca61406345e8edaf872e36cbd619cc703ead3aaaf37ea77a4d" exitCode=0 Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.661998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe","Type":"ContainerDied","Data":"d4e56e6a12dca3ca61406345e8edaf872e36cbd619cc703ead3aaaf37ea77a4d"} Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.662543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe","Type":"ContainerDied","Data":"9363444fc0824f082f9221177c4d610f466b74eb5a05da8c79bb994e9a2c8098"} Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.662557 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9363444fc0824f082f9221177c4d610f466b74eb5a05da8c79bb994e9a2c8098" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.713600 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.763656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-combined-ca-bundle\") pod \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.763784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data\") pod \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.764746 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpmmn\" (UniqueName: \"kubernetes.io/projected/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-kube-api-access-zpmmn\") pod \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.764795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data-custom\") pod \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.764896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-scripts\") pod \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.764927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-etc-machine-id\") pod \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\" (UID: \"c6b93e93-7c02-42c2-9f6f-37587ffd5cbe\") " Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.765572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" (UID: "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.785625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-kube-api-access-zpmmn" (OuterVolumeSpecName: "kube-api-access-zpmmn") pod "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" (UID: "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe"). InnerVolumeSpecName "kube-api-access-zpmmn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.786469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-scripts" (OuterVolumeSpecName: "scripts") pod "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" (UID: "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.789525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" (UID: "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.851116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" (UID: "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.867672 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zpmmn\" (UniqueName: \"kubernetes.io/projected/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-kube-api-access-zpmmn\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.867714 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.867726 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.867737 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.867748 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.873689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data" (OuterVolumeSpecName: "config-data") pod "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" (UID: "c6b93e93-7c02-42c2-9f6f-37587ffd5cbe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:39 crc kubenswrapper[4769]: I1121 13:14:39.969809 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.274524 4769 scope.go:117] "RemoveContainer" containerID="9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.277090 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.673499 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.715578 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.728373 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.755138 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:40 crc kubenswrapper[4769]: E1121 13:14:40.759454 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="probe" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.759497 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="probe" Nov 21 13:14:40 crc kubenswrapper[4769]: E1121 13:14:40.759543 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="cinder-scheduler" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.759553 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="cinder-scheduler" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.759786 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="cinder-scheduler" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.759806 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" containerName="probe" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.761003 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.764412 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.773221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.887084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.887159 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ce321fe1-25d5-48ee-85fd-46e4adb2494b-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.887209 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.887252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.887272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-scripts\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.887391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84b85\" (UniqueName: \"kubernetes.io/projected/ce321fe1-25d5-48ee-85fd-46e4adb2494b-kube-api-access-84b85\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ce321fe1-25d5-48ee-85fd-46e4adb2494b-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989410 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989433 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-scripts\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989534 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-84b85\" (UniqueName: \"kubernetes.io/projected/ce321fe1-25d5-48ee-85fd-46e4adb2494b-kube-api-access-84b85\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.989897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ce321fe1-25d5-48ee-85fd-46e4adb2494b-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:40 crc kubenswrapper[4769]: I1121 13:14:40.995177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.000855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.002116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.011960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-84b85\" (UniqueName: \"kubernetes.io/projected/ce321fe1-25d5-48ee-85fd-46e4adb2494b-kube-api-access-84b85\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.022931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-scripts\") pod \"cinder-scheduler-0\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.098594 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.307680 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b93e93-7c02-42c2-9f6f-37587ffd5cbe" path="/var/lib/kubelet/pods/c6b93e93-7c02-42c2-9f6f-37587ffd5cbe/volumes" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.594590 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.687752 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ce321fe1-25d5-48ee-85fd-46e4adb2494b","Type":"ContainerStarted","Data":"46438690470dfc0a0e110303a191117fe74676e874ea4383edc6a9ecdb5d28b7"} Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.694400 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerID="5d838d8c9a45428a9d8a657a3bad1f1fe8f7c9dd9425a690a0148b7eb69a1dc3" exitCode=1 Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.694450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerDied","Data":"5d838d8c9a45428a9d8a657a3bad1f1fe8f7c9dd9425a690a0148b7eb69a1dc3"} Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.694487 4769 scope.go:117] "RemoveContainer" containerID="9559da292f6c57e6108463db2ee1f02caa162a6f1fce4d9de3dbd07f23b11d7b" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.696892 4769 scope.go:117] "RemoveContainer" containerID="5d838d8c9a45428a9d8a657a3bad1f1fe8f7c9dd9425a690a0148b7eb69a1dc3" Nov 21 13:14:41 crc kubenswrapper[4769]: E1121 13:14:41.697181 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=placement-api pod=placement-8476ff6dc6-jfqrm_openstack-kuttl-tests(5bc57375-7cce-458b-a855-dc3658fbc26d)\"" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" Nov 21 13:14:41 crc kubenswrapper[4769]: I1121 13:14:41.698137 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:43 crc kubenswrapper[4769]: I1121 13:14:43.725162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ce321fe1-25d5-48ee-85fd-46e4adb2494b","Type":"ContainerStarted","Data":"d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6"} Nov 21 13:14:44 crc kubenswrapper[4769]: I1121 13:14:44.738178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ce321fe1-25d5-48ee-85fd-46e4adb2494b","Type":"ContainerStarted","Data":"d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc"} Nov 21 13:14:44 crc kubenswrapper[4769]: I1121 13:14:44.774209 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.774168673 podStartE2EDuration="4.774168673s" podCreationTimestamp="2025-11-21 13:14:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:14:44.755288065 +0000 UTC m=+5043.455949883" watchObservedRunningTime="2025-11-21 13:14:44.774168673 +0000 UTC m=+5043.474830491" Nov 21 13:14:45 crc kubenswrapper[4769]: I1121 13:14:45.312121 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:14:45 crc kubenswrapper[4769]: I1121 13:14:45.964888 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:45 crc kubenswrapper[4769]: I1121 13:14:45.970259 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:14:46 crc kubenswrapper[4769]: I1121 13:14:46.054736 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp"] Nov 21 13:14:46 crc kubenswrapper[4769]: I1121 13:14:46.055007 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api-log" containerID="cri-o://14b42dbb74e27a4fc74095aa922cf52a1e9d9c9291837787f6ece42c2f4cdf9e" gracePeriod=30 Nov 21 13:14:46 crc kubenswrapper[4769]: I1121 13:14:46.055532 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api" containerID="cri-o://a1b294599aee5cec1fe56543232b99141788e5c80f58791c95b6ac600caa98d5" gracePeriod=30 Nov 21 13:14:46 crc kubenswrapper[4769]: I1121 13:14:46.098762 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:46 crc kubenswrapper[4769]: I1121 13:14:46.764730 4769 generic.go:334] "Generic (PLEG): container finished" podID="be04736f-6752-4ab7-8399-22dccef1daee" containerID="14b42dbb74e27a4fc74095aa922cf52a1e9d9c9291837787f6ece42c2f4cdf9e" exitCode=143 Nov 21 13:14:46 crc kubenswrapper[4769]: I1121 13:14:46.765917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" event={"ID":"be04736f-6752-4ab7-8399-22dccef1daee","Type":"ContainerDied","Data":"14b42dbb74e27a4fc74095aa922cf52a1e9d9c9291837787f6ece42c2f4cdf9e"} Nov 21 13:14:48 crc kubenswrapper[4769]: I1121 13:14:48.843716 4769 scope.go:117] "RemoveContainer" containerID="47464cb4f9c29c0b7a22d462adacb55e61f37977af85f1484d17a548f3a6d76e" Nov 21 13:14:48 crc kubenswrapper[4769]: I1121 13:14:48.874457 4769 scope.go:117] "RemoveContainer" containerID="b1acd400de4f042bd8f6d4420cd2ff0208eea01c5a3248ff7d3e9502b75f56f8" Nov 21 13:14:48 crc kubenswrapper[4769]: I1121 13:14:48.921918 4769 scope.go:117] "RemoveContainer" containerID="28079413175ac0c62eb6bfc85d57b17ecb0e9f64ba592241bcf0e867a7026fc7" Nov 21 13:14:48 crc kubenswrapper[4769]: I1121 13:14:48.982674 4769 scope.go:117] "RemoveContainer" containerID="ecd3726cfa81aff917bd5bdc8db544db6efd4ab7aac38f9e297d3563609e64ee" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.043048 4769 scope.go:117] "RemoveContainer" containerID="727e48ea3638b91ec9afc41a762955cc8212cf71d6129e142c2cbd2d4fda78f0" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.477685 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.478676 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.478373 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.477927 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.479808 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.480378 4769 scope.go:117] "RemoveContainer" containerID="5d838d8c9a45428a9d8a657a3bad1f1fe8f7c9dd9425a690a0148b7eb69a1dc3" Nov 21 13:14:49 crc kubenswrapper[4769]: E1121 13:14:49.480971 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=placement-api pod=placement-8476ff6dc6-jfqrm_openstack-kuttl-tests(5bc57375-7cce-458b-a855-dc3658fbc26d)\"" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.610702 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.228:9311/healthcheck\": read tcp 10.217.0.2:46638->10.217.1.228:9311: read: connection reset by peer" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.610825 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.228:9311/healthcheck\": read tcp 10.217.0.2:46652->10.217.1.228:9311: read: connection reset by peer" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.799828 4769 generic.go:334] "Generic (PLEG): container finished" podID="be04736f-6752-4ab7-8399-22dccef1daee" containerID="a1b294599aee5cec1fe56543232b99141788e5c80f58791c95b6ac600caa98d5" exitCode=0 Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.800070 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" event={"ID":"be04736f-6752-4ab7-8399-22dccef1daee","Type":"ContainerDied","Data":"a1b294599aee5cec1fe56543232b99141788e5c80f58791c95b6ac600caa98d5"} Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.800624 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:49 crc kubenswrapper[4769]: I1121 13:14:49.801054 4769 scope.go:117] "RemoveContainer" containerID="5d838d8c9a45428a9d8a657a3bad1f1fe8f7c9dd9425a690a0148b7eb69a1dc3" Nov 21 13:14:49 crc kubenswrapper[4769]: E1121 13:14:49.801366 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"placement-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=placement-api pod=placement-8476ff6dc6-jfqrm_openstack-kuttl-tests(5bc57375-7cce-458b-a855-dc3658fbc26d)\"" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.678813 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.691391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data\") pod \"be04736f-6752-4ab7-8399-22dccef1daee\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.691523 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-combined-ca-bundle\") pod \"be04736f-6752-4ab7-8399-22dccef1daee\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.691683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data-custom\") pod \"be04736f-6752-4ab7-8399-22dccef1daee\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.691707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgswp\" (UniqueName: \"kubernetes.io/projected/be04736f-6752-4ab7-8399-22dccef1daee-kube-api-access-zgswp\") pod \"be04736f-6752-4ab7-8399-22dccef1daee\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.691776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be04736f-6752-4ab7-8399-22dccef1daee-logs\") pod \"be04736f-6752-4ab7-8399-22dccef1daee\" (UID: \"be04736f-6752-4ab7-8399-22dccef1daee\") " Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.692939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be04736f-6752-4ab7-8399-22dccef1daee-logs" (OuterVolumeSpecName: "logs") pod "be04736f-6752-4ab7-8399-22dccef1daee" (UID: "be04736f-6752-4ab7-8399-22dccef1daee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.698676 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "be04736f-6752-4ab7-8399-22dccef1daee" (UID: "be04736f-6752-4ab7-8399-22dccef1daee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.704538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be04736f-6752-4ab7-8399-22dccef1daee-kube-api-access-zgswp" (OuterVolumeSpecName: "kube-api-access-zgswp") pod "be04736f-6752-4ab7-8399-22dccef1daee" (UID: "be04736f-6752-4ab7-8399-22dccef1daee"). InnerVolumeSpecName "kube-api-access-zgswp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.754648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be04736f-6752-4ab7-8399-22dccef1daee" (UID: "be04736f-6752-4ab7-8399-22dccef1daee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.785367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data" (OuterVolumeSpecName: "config-data") pod "be04736f-6752-4ab7-8399-22dccef1daee" (UID: "be04736f-6752-4ab7-8399-22dccef1daee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.793130 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.793160 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zgswp\" (UniqueName: \"kubernetes.io/projected/be04736f-6752-4ab7-8399-22dccef1daee-kube-api-access-zgswp\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.793172 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/be04736f-6752-4ab7-8399-22dccef1daee-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.793180 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.793203 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be04736f-6752-4ab7-8399-22dccef1daee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.796478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.811091 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.811049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp" event={"ID":"be04736f-6752-4ab7-8399-22dccef1daee","Type":"ContainerDied","Data":"7572299f69330d37fd04d554ba59a23fba1998de940620bebfabeda5f64bcb91"} Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.811210 4769 scope.go:117] "RemoveContainer" containerID="a1b294599aee5cec1fe56543232b99141788e5c80f58791c95b6ac600caa98d5" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.841719 4769 scope.go:117] "RemoveContainer" containerID="14b42dbb74e27a4fc74095aa922cf52a1e9d9c9291837787f6ece42c2f4cdf9e" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.843608 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.847779 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp"] Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.860134 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-9fc6bd774-xk9lp"] Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.902362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8476ff6dc6-jfqrm"] Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.902666 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" containerID="cri-o://b0ae74b89117397fe6430bd3ec8f92c1e1d13253c22f58ce5ae066e0e2f5f203" gracePeriod=30 Nov 21 13:14:50 crc kubenswrapper[4769]: I1121 13:14:50.903309 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" probeResult="failure" output="Get \"http://10.217.1.223:8778/\": dial tcp 10.217.1.223:8778: connect: connection refused" Nov 21 13:14:51 crc kubenswrapper[4769]: I1121 13:14:51.287179 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be04736f-6752-4ab7-8399-22dccef1daee" path="/var/lib/kubelet/pods/be04736f-6752-4ab7-8399-22dccef1daee/volumes" Nov 21 13:14:51 crc kubenswrapper[4769]: I1121 13:14:51.300890 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:14:51 crc kubenswrapper[4769]: I1121 13:14:51.823023 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerID="b0ae74b89117397fe6430bd3ec8f92c1e1d13253c22f58ce5ae066e0e2f5f203" exitCode=143 Nov 21 13:14:51 crc kubenswrapper[4769]: I1121 13:14:51.823090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerDied","Data":"b0ae74b89117397fe6430bd3ec8f92c1e1d13253c22f58ce5ae066e0e2f5f203"} Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.113199 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.129963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5bc57375-7cce-458b-a855-dc3658fbc26d-logs\") pod \"5bc57375-7cce-458b-a855-dc3658fbc26d\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.130023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-config-data\") pod \"5bc57375-7cce-458b-a855-dc3658fbc26d\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.130210 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbdgm\" (UniqueName: \"kubernetes.io/projected/5bc57375-7cce-458b-a855-dc3658fbc26d-kube-api-access-wbdgm\") pod \"5bc57375-7cce-458b-a855-dc3658fbc26d\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.130295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-combined-ca-bundle\") pod \"5bc57375-7cce-458b-a855-dc3658fbc26d\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.130336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-scripts\") pod \"5bc57375-7cce-458b-a855-dc3658fbc26d\" (UID: \"5bc57375-7cce-458b-a855-dc3658fbc26d\") " Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.130345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc57375-7cce-458b-a855-dc3658fbc26d-logs" (OuterVolumeSpecName: "logs") pod "5bc57375-7cce-458b-a855-dc3658fbc26d" (UID: "5bc57375-7cce-458b-a855-dc3658fbc26d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.130751 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5bc57375-7cce-458b-a855-dc3658fbc26d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.183633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc57375-7cce-458b-a855-dc3658fbc26d-kube-api-access-wbdgm" (OuterVolumeSpecName: "kube-api-access-wbdgm") pod "5bc57375-7cce-458b-a855-dc3658fbc26d" (UID: "5bc57375-7cce-458b-a855-dc3658fbc26d"). InnerVolumeSpecName "kube-api-access-wbdgm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.184052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-scripts" (OuterVolumeSpecName: "scripts") pod "5bc57375-7cce-458b-a855-dc3658fbc26d" (UID: "5bc57375-7cce-458b-a855-dc3658fbc26d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.206128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5bc57375-7cce-458b-a855-dc3658fbc26d" (UID: "5bc57375-7cce-458b-a855-dc3658fbc26d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.210221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-config-data" (OuterVolumeSpecName: "config-data") pod "5bc57375-7cce-458b-a855-dc3658fbc26d" (UID: "5bc57375-7cce-458b-a855-dc3658fbc26d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.233227 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.233268 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.233308 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5bc57375-7cce-458b-a855-dc3658fbc26d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.233322 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wbdgm\" (UniqueName: \"kubernetes.io/projected/5bc57375-7cce-458b-a855-dc3658fbc26d-kube-api-access-wbdgm\") on node \"crc\" DevicePath \"\"" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.835630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" event={"ID":"5bc57375-7cce-458b-a855-dc3658fbc26d","Type":"ContainerDied","Data":"058df33b0ed1e6197a32234eec2d8935203abad1349a3c58e548557c5811aa00"} Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.835692 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8476ff6dc6-jfqrm" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.835700 4769 scope.go:117] "RemoveContainer" containerID="5d838d8c9a45428a9d8a657a3bad1f1fe8f7c9dd9425a690a0148b7eb69a1dc3" Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.868321 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8476ff6dc6-jfqrm"] Nov 21 13:14:52 crc kubenswrapper[4769]: I1121 13:14:52.879310 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-8476ff6dc6-jfqrm"] Nov 21 13:14:53 crc kubenswrapper[4769]: I1121 13:14:53.097292 4769 scope.go:117] "RemoveContainer" containerID="b0ae74b89117397fe6430bd3ec8f92c1e1d13253c22f58ce5ae066e0e2f5f203" Nov 21 13:14:53 crc kubenswrapper[4769]: I1121 13:14:53.284490 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" path="/var/lib/kubelet/pods/5bc57375-7cce-458b-a855-dc3658fbc26d/volumes" Nov 21 13:14:53 crc kubenswrapper[4769]: I1121 13:14:53.722479 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:14:55 crc kubenswrapper[4769]: I1121 13:14:55.933088 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.142294 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5"] Nov 21 13:15:00 crc kubenswrapper[4769]: E1121 13:15:00.146453 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api-log" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.146582 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api-log" Nov 21 13:15:00 crc kubenswrapper[4769]: E1121 13:15:00.146674 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.146756 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:00 crc kubenswrapper[4769]: E1121 13:15:00.146884 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.146971 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" Nov 21 13:15:00 crc kubenswrapper[4769]: E1121 13:15:00.147048 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147125 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:00 crc kubenswrapper[4769]: E1121 13:15:00.147211 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147281 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147558 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api-log" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147657 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-log" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147733 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147793 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be04736f-6752-4ab7-8399-22dccef1daee" containerName="barbican-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.147856 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.148705 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.151510 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.152172 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5"] Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.153690 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.275324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/ccb155bb-8ed3-4650-bc55-ad73c7733a51-secret-volume\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.275736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jr77\" (UniqueName: \"kubernetes.io/projected/ccb155bb-8ed3-4650-bc55-ad73c7733a51-kube-api-access-4jr77\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.275831 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb155bb-8ed3-4650-bc55-ad73c7733a51-config-volume\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.377912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb155bb-8ed3-4650-bc55-ad73c7733a51-config-volume\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.378024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/ccb155bb-8ed3-4650-bc55-ad73c7733a51-secret-volume\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.378080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4jr77\" (UniqueName: \"kubernetes.io/projected/ccb155bb-8ed3-4650-bc55-ad73c7733a51-kube-api-access-4jr77\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.379329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb155bb-8ed3-4650-bc55-ad73c7733a51-config-volume\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.389141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/ccb155bb-8ed3-4650-bc55-ad73c7733a51-secret-volume\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.398623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jr77\" (UniqueName: \"kubernetes.io/projected/ccb155bb-8ed3-4650-bc55-ad73c7733a51-kube-api-access-4jr77\") pod \"collect-profiles-29395515-886c5\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.485809 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:00 crc kubenswrapper[4769]: I1121 13:15:00.945785 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5"] Nov 21 13:15:01 crc kubenswrapper[4769]: I1121 13:15:01.924729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" event={"ID":"ccb155bb-8ed3-4650-bc55-ad73c7733a51","Type":"ContainerStarted","Data":"b01afb18e9dcd7e74a693a6cb6a65ad72d853dcd30baf5d9d4419888a34a01fa"} Nov 21 13:15:01 crc kubenswrapper[4769]: I1121 13:15:01.925210 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" event={"ID":"ccb155bb-8ed3-4650-bc55-ad73c7733a51","Type":"ContainerStarted","Data":"bd78ad0b1727f28f93731567aeeff00fb1f87af3220a7362fb9fc24a78bc1a86"} Nov 21 13:15:01 crc kubenswrapper[4769]: I1121 13:15:01.947623 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" podStartSLOduration=1.9476030130000002 podStartE2EDuration="1.947603013s" podCreationTimestamp="2025-11-21 13:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:01.945009123 +0000 UTC m=+5060.645670971" watchObservedRunningTime="2025-11-21 13:15:01.947603013 +0000 UTC m=+5060.648264831" Nov 21 13:15:02 crc kubenswrapper[4769]: I1121 13:15:02.648577 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:15:02 crc kubenswrapper[4769]: I1121 13:15:02.934581 4769 generic.go:334] "Generic (PLEG): container finished" podID="ccb155bb-8ed3-4650-bc55-ad73c7733a51" containerID="b01afb18e9dcd7e74a693a6cb6a65ad72d853dcd30baf5d9d4419888a34a01fa" exitCode=0 Nov 21 13:15:02 crc kubenswrapper[4769]: I1121 13:15:02.934619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" event={"ID":"ccb155bb-8ed3-4650-bc55-ad73c7733a51","Type":"ContainerDied","Data":"b01afb18e9dcd7e74a693a6cb6a65ad72d853dcd30baf5d9d4419888a34a01fa"} Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.548476 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:15:03 crc kubenswrapper[4769]: E1121 13:15:03.549316 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.549341 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.549538 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bc57375-7cce-458b-a855-dc3658fbc26d" containerName="placement-api" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.550165 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.553036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.554271 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-g5sxb" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.554445 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.563518 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.634482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4wzt\" (UniqueName: \"kubernetes.io/projected/e08edeba-c4cd-4f68-b02e-8c8f285582c6-kube-api-access-s4wzt\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.634704 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.634800 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.634846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config-secret\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.736421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.736847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.736988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config-secret\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.737131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wzt\" (UniqueName: \"kubernetes.io/projected/e08edeba-c4cd-4f68-b02e-8c8f285582c6-kube-api-access-s4wzt\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.737726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.751881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.752358 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config-secret\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.760954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wzt\" (UniqueName: \"kubernetes.io/projected/e08edeba-c4cd-4f68-b02e-8c8f285582c6-kube-api-access-s4wzt\") pod \"openstackclient\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:03 crc kubenswrapper[4769]: I1121 13:15:03.883935 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.191639 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.260570 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt"] Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.261743 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-api" containerID="cri-o://ff6e5208f6f875e2be955c084aa59528a726de6594aba59482549fc032b1da39" gracePeriod=30 Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.262173 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-httpd" containerID="cri-o://6745ccaae6613659b84e3701b16f37df336aa00a0fe58e18a18444a352c8574c" gracePeriod=30 Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.369709 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.451826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb155bb-8ed3-4650-bc55-ad73c7733a51-config-volume\") pod \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.451892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jr77\" (UniqueName: \"kubernetes.io/projected/ccb155bb-8ed3-4650-bc55-ad73c7733a51-kube-api-access-4jr77\") pod \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.452015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/ccb155bb-8ed3-4650-bc55-ad73c7733a51-secret-volume\") pod \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\" (UID: \"ccb155bb-8ed3-4650-bc55-ad73c7733a51\") " Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.452703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccb155bb-8ed3-4650-bc55-ad73c7733a51-config-volume" (OuterVolumeSpecName: "config-volume") pod "ccb155bb-8ed3-4650-bc55-ad73c7733a51" (UID: "ccb155bb-8ed3-4650-bc55-ad73c7733a51"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.457435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.554146 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccb155bb-8ed3-4650-bc55-ad73c7733a51-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.784137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccb155bb-8ed3-4650-bc55-ad73c7733a51-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "ccb155bb-8ed3-4650-bc55-ad73c7733a51" (UID: "ccb155bb-8ed3-4650-bc55-ad73c7733a51"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.784434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb155bb-8ed3-4650-bc55-ad73c7733a51-kube-api-access-4jr77" (OuterVolumeSpecName: "kube-api-access-4jr77") pod "ccb155bb-8ed3-4650-bc55-ad73c7733a51" (UID: "ccb155bb-8ed3-4650-bc55-ad73c7733a51"). InnerVolumeSpecName "kube-api-access-4jr77". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.858785 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4jr77\" (UniqueName: \"kubernetes.io/projected/ccb155bb-8ed3-4650-bc55-ad73c7733a51-kube-api-access-4jr77\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.859154 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/ccb155bb-8ed3-4650-bc55-ad73c7733a51-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.964373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" event={"ID":"ccb155bb-8ed3-4650-bc55-ad73c7733a51","Type":"ContainerDied","Data":"bd78ad0b1727f28f93731567aeeff00fb1f87af3220a7362fb9fc24a78bc1a86"} Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.964413 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd78ad0b1727f28f93731567aeeff00fb1f87af3220a7362fb9fc24a78bc1a86" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.964467 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5" Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.969099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" event={"ID":"95358f61-e922-4897-b6d6-ef84c250fe36","Type":"ContainerDied","Data":"6745ccaae6613659b84e3701b16f37df336aa00a0fe58e18a18444a352c8574c"} Nov 21 13:15:04 crc kubenswrapper[4769]: I1121 13:15:04.969046 4769 generic.go:334] "Generic (PLEG): container finished" podID="95358f61-e922-4897-b6d6-ef84c250fe36" containerID="6745ccaae6613659b84e3701b16f37df336aa00a0fe58e18a18444a352c8574c" exitCode=0 Nov 21 13:15:05 crc kubenswrapper[4769]: I1121 13:15:05.025868 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395470-744df"] Nov 21 13:15:05 crc kubenswrapper[4769]: I1121 13:15:05.039553 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395470-744df"] Nov 21 13:15:05 crc kubenswrapper[4769]: I1121 13:15:05.289744 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8858feeb-2dd0-4eb5-9417-7efb5d53aa3e" path="/var/lib/kubelet/pods/8858feeb-2dd0-4eb5-9417-7efb5d53aa3e/volumes" Nov 21 13:15:05 crc kubenswrapper[4769]: I1121 13:15:05.979412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"e08edeba-c4cd-4f68-b02e-8c8f285582c6","Type":"ContainerStarted","Data":"21c309de1ad11572d0b9256cd7e63386908a3402b3e803c9c8ac2651a7c62b56"} Nov 21 13:15:05 crc kubenswrapper[4769]: I1121 13:15:05.979749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"e08edeba-c4cd-4f68-b02e-8c8f285582c6","Type":"ContainerStarted","Data":"b7c1e45250ec0ab6d764ce1a0f842116942aeb504b186e1ada45f3f6f7333816"} Nov 21 13:15:05 crc kubenswrapper[4769]: I1121 13:15:05.993740 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.993718133 podStartE2EDuration="2.993718133s" podCreationTimestamp="2025-11-21 13:15:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:05.993029414 +0000 UTC m=+5064.693691232" watchObservedRunningTime="2025-11-21 13:15:05.993718133 +0000 UTC m=+5064.694379971" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.174378 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.175379 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-central-agent" containerID="cri-o://a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5" gracePeriod=30 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.175856 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="proxy-httpd" containerID="cri-o://0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855" gracePeriod=30 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.175903 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="sg-core" containerID="cri-o://8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da" gracePeriod=30 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.175937 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-notification-agent" containerID="cri-o://2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147" gracePeriod=30 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.492355 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj"] Nov 21 13:15:07 crc kubenswrapper[4769]: E1121 13:15:07.492746 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ccb155bb-8ed3-4650-bc55-ad73c7733a51" containerName="collect-profiles" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.492763 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb155bb-8ed3-4650-bc55-ad73c7733a51" containerName="collect-profiles" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.492920 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ccb155bb-8ed3-4650-bc55-ad73c7733a51" containerName="collect-profiles" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.494034 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.498031 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.498258 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.498401 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.511298 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj"] Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602030 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdbq\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-kube-api-access-mmdbq\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-config-data\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-etc-swift\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-log-httpd\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-combined-ca-bundle\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-run-httpd\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-internal-tls-certs\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.602857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-public-tls-certs\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.704744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-public-tls-certs\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.704800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-internal-tls-certs\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.704881 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdbq\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-kube-api-access-mmdbq\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.704913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-config-data\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.704949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-etc-swift\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.705053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-log-httpd\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.705103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-combined-ca-bundle\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.705128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-run-httpd\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.705718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-run-httpd\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.707283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-log-httpd\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.715033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-internal-tls-certs\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.715181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-combined-ca-bundle\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.715310 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-config-data\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.715846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-public-tls-certs\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.720089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-etc-swift\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.738830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdbq\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-kube-api-access-mmdbq\") pod \"swift-proxy-865c65649b-5vkhj\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.824501 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.999296 4769 generic.go:334] "Generic (PLEG): container finished" podID="996577d9-578c-40c1-8310-24db4469b23f" containerID="0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855" exitCode=0 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.999327 4769 generic.go:334] "Generic (PLEG): container finished" podID="996577d9-578c-40c1-8310-24db4469b23f" containerID="8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da" exitCode=2 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.999336 4769 generic.go:334] "Generic (PLEG): container finished" podID="996577d9-578c-40c1-8310-24db4469b23f" containerID="a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5" exitCode=0 Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.999367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerDied","Data":"0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855"} Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.999418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerDied","Data":"8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da"} Nov 21 13:15:07 crc kubenswrapper[4769]: I1121 13:15:07.999434 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerDied","Data":"a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5"} Nov 21 13:15:08 crc kubenswrapper[4769]: I1121 13:15:08.290163 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj"] Nov 21 13:15:09 crc kubenswrapper[4769]: I1121 13:15:09.010454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" event={"ID":"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99","Type":"ContainerStarted","Data":"58c55c056d067a0c7edaf3bcaecc30eada0c2378ed09c7b7f74f65a8d9ea64f2"} Nov 21 13:15:09 crc kubenswrapper[4769]: I1121 13:15:09.011211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" event={"ID":"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99","Type":"ContainerStarted","Data":"e7dcb48371f08e2c167ef53b8a5b4bd0a3f974876a17a45ae6db4e5462097e39"} Nov 21 13:15:09 crc kubenswrapper[4769]: I1121 13:15:09.011237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" event={"ID":"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99","Type":"ContainerStarted","Data":"cd63ecc135b7df0eedbab4eb3424ca1e38d24037a1c03fae9c69dc1008d92dce"} Nov 21 13:15:09 crc kubenswrapper[4769]: I1121 13:15:09.011444 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:09 crc kubenswrapper[4769]: I1121 13:15:09.031926 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" podStartSLOduration=2.031907519 podStartE2EDuration="2.031907519s" podCreationTimestamp="2025-11-21 13:15:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:09.029670959 +0000 UTC m=+5067.730332787" watchObservedRunningTime="2025-11-21 13:15:09.031907519 +0000 UTC m=+5067.732569337" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.023846 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.846611 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-zl7nx"] Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.874361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.881137 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-zl7nx"] Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.934928 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-q2h4q"] Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.936429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.941325 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-q2h4q"] Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.980127 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc0db106-c6fb-4bf7-bdae-434a1d40598a-operator-scripts\") pod \"nova-cell0-db-create-q2h4q\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.980238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p6gz\" (UniqueName: \"kubernetes.io/projected/cc0db106-c6fb-4bf7-bdae-434a1d40598a-kube-api-access-2p6gz\") pod \"nova-cell0-db-create-q2h4q\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.980299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8r2\" (UniqueName: \"kubernetes.io/projected/7b17861e-ad2b-400e-a402-b9e6a986e276-kube-api-access-dw8r2\") pod \"nova-api-db-create-zl7nx\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:10 crc kubenswrapper[4769]: I1121 13:15:10.980389 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b17861e-ad2b-400e-a402-b9e6a986e276-operator-scripts\") pod \"nova-api-db-create-zl7nx\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.020061 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-9af9-account-create-vj26g"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.022899 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.025640 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.041296 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9af9-account-create-vj26g"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.082496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-operator-scripts\") pod \"nova-api-9af9-account-create-vj26g\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.082555 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc0db106-c6fb-4bf7-bdae-434a1d40598a-operator-scripts\") pod \"nova-cell0-db-create-q2h4q\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.082594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2p6gz\" (UniqueName: \"kubernetes.io/projected/cc0db106-c6fb-4bf7-bdae-434a1d40598a-kube-api-access-2p6gz\") pod \"nova-cell0-db-create-q2h4q\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.082623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8r2\" (UniqueName: \"kubernetes.io/projected/7b17861e-ad2b-400e-a402-b9e6a986e276-kube-api-access-dw8r2\") pod \"nova-api-db-create-zl7nx\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.082689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b17861e-ad2b-400e-a402-b9e6a986e276-operator-scripts\") pod \"nova-api-db-create-zl7nx\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.082784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2qvv\" (UniqueName: \"kubernetes.io/projected/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-kube-api-access-l2qvv\") pod \"nova-api-9af9-account-create-vj26g\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.083474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc0db106-c6fb-4bf7-bdae-434a1d40598a-operator-scripts\") pod \"nova-cell0-db-create-q2h4q\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.083741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b17861e-ad2b-400e-a402-b9e6a986e276-operator-scripts\") pod \"nova-api-db-create-zl7nx\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.101894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p6gz\" (UniqueName: \"kubernetes.io/projected/cc0db106-c6fb-4bf7-bdae-434a1d40598a-kube-api-access-2p6gz\") pod \"nova-cell0-db-create-q2h4q\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.108823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8r2\" (UniqueName: \"kubernetes.io/projected/7b17861e-ad2b-400e-a402-b9e6a986e276-kube-api-access-dw8r2\") pod \"nova-api-db-create-zl7nx\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.138767 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-d7x8p"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.139956 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.180023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-d7x8p"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.193386 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnk52\" (UniqueName: \"kubernetes.io/projected/732a6a91-49bd-42d7-9007-af1835aa4024-kube-api-access-fnk52\") pod \"nova-cell1-db-create-d7x8p\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.193469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-operator-scripts\") pod \"nova-api-9af9-account-create-vj26g\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.193537 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/732a6a91-49bd-42d7-9007-af1835aa4024-operator-scripts\") pod \"nova-cell1-db-create-d7x8p\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.193562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l2qvv\" (UniqueName: \"kubernetes.io/projected/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-kube-api-access-l2qvv\") pod \"nova-api-9af9-account-create-vj26g\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.194522 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-operator-scripts\") pod \"nova-api-9af9-account-create-vj26g\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.219976 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.258768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.261356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2qvv\" (UniqueName: \"kubernetes.io/projected/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-kube-api-access-l2qvv\") pod \"nova-api-9af9-account-create-vj26g\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.298853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fnk52\" (UniqueName: \"kubernetes.io/projected/732a6a91-49bd-42d7-9007-af1835aa4024-kube-api-access-fnk52\") pod \"nova-cell1-db-create-d7x8p\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.299088 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/732a6a91-49bd-42d7-9007-af1835aa4024-operator-scripts\") pod \"nova-cell1-db-create-d7x8p\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.300016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/732a6a91-49bd-42d7-9007-af1835aa4024-operator-scripts\") pod \"nova-cell1-db-create-d7x8p\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.320756 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnk52\" (UniqueName: \"kubernetes.io/projected/732a6a91-49bd-42d7-9007-af1835aa4024-kube-api-access-fnk52\") pod \"nova-cell1-db-create-d7x8p\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.342751 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.364434 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.366000 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.366106 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.383223 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.407252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac22474c-69bf-4242-921d-8401864d88d4-operator-scripts\") pod \"nova-cell0-f24d-account-create-j782s\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.407379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnd28\" (UniqueName: \"kubernetes.io/projected/ac22474c-69bf-4242-921d-8401864d88d4-kube-api-access-mnd28\") pod \"nova-cell0-f24d-account-create-j782s\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.477291 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.478634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.505063 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.509477 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb"] Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.510538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac22474c-69bf-4242-921d-8401864d88d4-operator-scripts\") pod \"nova-cell0-f24d-account-create-j782s\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.510602 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mnd28\" (UniqueName: \"kubernetes.io/projected/ac22474c-69bf-4242-921d-8401864d88d4-kube-api-access-mnd28\") pod \"nova-cell0-f24d-account-create-j782s\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.510629 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqp8\" (UniqueName: \"kubernetes.io/projected/c9f6d7c8-4590-42c5-bace-ee43645040da-kube-api-access-grqp8\") pod \"nova-cell1-ec99-account-create-fh2jb\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.510671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9f6d7c8-4590-42c5-bace-ee43645040da-operator-scripts\") pod \"nova-cell1-ec99-account-create-fh2jb\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.511308 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac22474c-69bf-4242-921d-8401864d88d4-operator-scripts\") pod \"nova-cell0-f24d-account-create-j782s\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.511645 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.549119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnd28\" (UniqueName: \"kubernetes.io/projected/ac22474c-69bf-4242-921d-8401864d88d4-kube-api-access-mnd28\") pod \"nova-cell0-f24d-account-create-j782s\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.612018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-grqp8\" (UniqueName: \"kubernetes.io/projected/c9f6d7c8-4590-42c5-bace-ee43645040da-kube-api-access-grqp8\") pod \"nova-cell1-ec99-account-create-fh2jb\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.612126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9f6d7c8-4590-42c5-bace-ee43645040da-operator-scripts\") pod \"nova-cell1-ec99-account-create-fh2jb\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.613213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9f6d7c8-4590-42c5-bace-ee43645040da-operator-scripts\") pod \"nova-cell1-ec99-account-create-fh2jb\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.645058 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqp8\" (UniqueName: \"kubernetes.io/projected/c9f6d7c8-4590-42c5-bace-ee43645040da-kube-api-access-grqp8\") pod \"nova-cell1-ec99-account-create-fh2jb\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.743813 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.835710 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:11 crc kubenswrapper[4769]: I1121 13:15:11.922195 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-q2h4q"] Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.057733 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" event={"ID":"cc0db106-c6fb-4bf7-bdae-434a1d40598a","Type":"ContainerStarted","Data":"f8186c241bb92413cfca1e1800e225655a9e40826a0b59545ab9edb9886e1b28"} Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.088738 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9af9-account-create-vj26g"] Nov 21 13:15:12 crc kubenswrapper[4769]: W1121 13:15:12.100709 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b17861e_ad2b_400e_a402_b9e6a986e276.slice/crio-66d4abacb78c4e8ec3fcf8f4a5cc4abf5d101e6901065d47ecd8b4642813e0f4 WatchSource:0}: Error finding container 66d4abacb78c4e8ec3fcf8f4a5cc4abf5d101e6901065d47ecd8b4642813e0f4: Status 404 returned error can't find the container with id 66d4abacb78c4e8ec3fcf8f4a5cc4abf5d101e6901065d47ecd8b4642813e0f4 Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.102654 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-zl7nx"] Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.307584 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-d7x8p"] Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.402127 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s"] Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.453466 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb"] Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.749555 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:15:12 crc kubenswrapper[4769]: I1121 13:15:12.749785 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="7267e484-4b78-41c2-9483-b5ae5ec97a16" containerName="kube-state-metrics" containerID="cri-o://101c6f5202d1a7a43b823007df5b91d750a80c8bc33f7b4617e24eae79acf93f" gracePeriod=30 Nov 21 13:15:12 crc kubenswrapper[4769]: W1121 13:15:12.807132 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod732a6a91_49bd_42d7_9007_af1835aa4024.slice/crio-ef9e09217252017d23f9d82e2ef8213e1af9511d7865a1e90e735dabc41a2a99 WatchSource:0}: Error finding container ef9e09217252017d23f9d82e2ef8213e1af9511d7865a1e90e735dabc41a2a99: Status 404 returned error can't find the container with id ef9e09217252017d23f9d82e2ef8213e1af9511d7865a1e90e735dabc41a2a99 Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.074648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" event={"ID":"cc0db106-c6fb-4bf7-bdae-434a1d40598a","Type":"ContainerStarted","Data":"5ac880fd145211d0a1d8bc2f74f27223bfa832a7533090cb26d7944bec370d63"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.079666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" event={"ID":"c9f6d7c8-4590-42c5-bace-ee43645040da","Type":"ContainerStarted","Data":"c5e876ac77b04cf0ad8c98a7004efce933908dc0024ae10ba4ab59253b63349a"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.081795 4769 generic.go:334] "Generic (PLEG): container finished" podID="7267e484-4b78-41c2-9483-b5ae5ec97a16" containerID="101c6f5202d1a7a43b823007df5b91d750a80c8bc33f7b4617e24eae79acf93f" exitCode=2 Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.081862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7267e484-4b78-41c2-9483-b5ae5ec97a16","Type":"ContainerDied","Data":"101c6f5202d1a7a43b823007df5b91d750a80c8bc33f7b4617e24eae79acf93f"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.089422 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" event={"ID":"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f","Type":"ContainerStarted","Data":"090d1123c10ccfb176f8e1511d438b40ddc9369780d980a23ef669524659f346"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.092738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" event={"ID":"732a6a91-49bd-42d7-9007-af1835aa4024","Type":"ContainerStarted","Data":"ef9e09217252017d23f9d82e2ef8213e1af9511d7865a1e90e735dabc41a2a99"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.097024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" event={"ID":"ac22474c-69bf-4242-921d-8401864d88d4","Type":"ContainerStarted","Data":"714707acb3d3b68dc94a5dedf512adec039d01139a0d7147b89f48449b762ead"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.099147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" event={"ID":"7b17861e-ad2b-400e-a402-b9e6a986e276","Type":"ContainerStarted","Data":"c1624aa19000399e1b301fd9c8a1d857ffe396d70af0aea1520ee13047496654"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.099227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" event={"ID":"7b17861e-ad2b-400e-a402-b9e6a986e276","Type":"ContainerStarted","Data":"66d4abacb78c4e8ec3fcf8f4a5cc4abf5d101e6901065d47ecd8b4642813e0f4"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.100677 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" podStartSLOduration=3.100657548 podStartE2EDuration="3.100657548s" podCreationTimestamp="2025-11-21 13:15:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:13.093346682 +0000 UTC m=+5071.794008500" watchObservedRunningTime="2025-11-21 13:15:13.100657548 +0000 UTC m=+5071.801319366" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.103741 4769 generic.go:334] "Generic (PLEG): container finished" podID="95358f61-e922-4897-b6d6-ef84c250fe36" containerID="ff6e5208f6f875e2be955c084aa59528a726de6594aba59482549fc032b1da39" exitCode=0 Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.103776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" event={"ID":"95358f61-e922-4897-b6d6-ef84c250fe36","Type":"ContainerDied","Data":"ff6e5208f6f875e2be955c084aa59528a726de6594aba59482549fc032b1da39"} Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.133347 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" podStartSLOduration=3.133300598 podStartE2EDuration="3.133300598s" podCreationTimestamp="2025-11-21 13:15:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:13.115237201 +0000 UTC m=+5071.815899019" watchObservedRunningTime="2025-11-21 13:15:13.133300598 +0000 UTC m=+5071.833962416" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.456781 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.589389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l927q\" (UniqueName: \"kubernetes.io/projected/7267e484-4b78-41c2-9483-b5ae5ec97a16-kube-api-access-l927q\") pod \"7267e484-4b78-41c2-9483-b5ae5ec97a16\" (UID: \"7267e484-4b78-41c2-9483-b5ae5ec97a16\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.598391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7267e484-4b78-41c2-9483-b5ae5ec97a16-kube-api-access-l927q" (OuterVolumeSpecName: "kube-api-access-l927q") pod "7267e484-4b78-41c2-9483-b5ae5ec97a16" (UID: "7267e484-4b78-41c2-9483-b5ae5ec97a16"). InnerVolumeSpecName "kube-api-access-l927q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.669679 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.675830 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.691100 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l927q\" (UniqueName: \"kubernetes.io/projected/7267e484-4b78-41c2-9483-b5ae5ec97a16-kube-api-access-l927q\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.791989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-combined-ca-bundle\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.792738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-sg-core-conf-yaml\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.792890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-ovndb-tls-certs\") pod \"95358f61-e922-4897-b6d6-ef84c250fe36\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjkdk\" (UniqueName: \"kubernetes.io/projected/95358f61-e922-4897-b6d6-ef84c250fe36-kube-api-access-kjkdk\") pod \"95358f61-e922-4897-b6d6-ef84c250fe36\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-httpd-config\") pod \"95358f61-e922-4897-b6d6-ef84c250fe36\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793368 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-scripts\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-combined-ca-bundle\") pod \"95358f61-e922-4897-b6d6-ef84c250fe36\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-config\") pod \"95358f61-e922-4897-b6d6-ef84c250fe36\" (UID: \"95358f61-e922-4897-b6d6-ef84c250fe36\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6wzj\" (UniqueName: \"kubernetes.io/projected/996577d9-578c-40c1-8310-24db4469b23f-kube-api-access-n6wzj\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-run-httpd\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.793912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-log-httpd\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.794226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-config-data\") pod \"996577d9-578c-40c1-8310-24db4469b23f\" (UID: \"996577d9-578c-40c1-8310-24db4469b23f\") " Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.794551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.794802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.794878 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.796240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "95358f61-e922-4897-b6d6-ef84c250fe36" (UID: "95358f61-e922-4897-b6d6-ef84c250fe36"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.796701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-scripts" (OuterVolumeSpecName: "scripts") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.798545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/996577d9-578c-40c1-8310-24db4469b23f-kube-api-access-n6wzj" (OuterVolumeSpecName: "kube-api-access-n6wzj") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "kube-api-access-n6wzj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.802365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95358f61-e922-4897-b6d6-ef84c250fe36-kube-api-access-kjkdk" (OuterVolumeSpecName: "kube-api-access-kjkdk") pod "95358f61-e922-4897-b6d6-ef84c250fe36" (UID: "95358f61-e922-4897-b6d6-ef84c250fe36"). InnerVolumeSpecName "kube-api-access-kjkdk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.817957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.844903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "95358f61-e922-4897-b6d6-ef84c250fe36" (UID: "95358f61-e922-4897-b6d6-ef84c250fe36"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.852545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-config" (OuterVolumeSpecName: "config") pod "95358f61-e922-4897-b6d6-ef84c250fe36" (UID: "95358f61-e922-4897-b6d6-ef84c250fe36"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.879378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "95358f61-e922-4897-b6d6-ef84c250fe36" (UID: "95358f61-e922-4897-b6d6-ef84c250fe36"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.880208 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897009 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/996577d9-578c-40c1-8310-24db4469b23f-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897045 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897056 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897066 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897076 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kjkdk\" (UniqueName: \"kubernetes.io/projected/95358f61-e922-4897-b6d6-ef84c250fe36-kube-api-access-kjkdk\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897085 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897093 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897102 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897110 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/95358f61-e922-4897-b6d6-ef84c250fe36-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.897118 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n6wzj\" (UniqueName: \"kubernetes.io/projected/996577d9-578c-40c1-8310-24db4469b23f-kube-api-access-n6wzj\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.916174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-config-data" (OuterVolumeSpecName: "config-data") pod "996577d9-578c-40c1-8310-24db4469b23f" (UID: "996577d9-578c-40c1-8310-24db4469b23f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:13 crc kubenswrapper[4769]: I1121 13:15:13.998865 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/996577d9-578c-40c1-8310-24db4469b23f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.115752 4769 generic.go:334] "Generic (PLEG): container finished" podID="3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" containerID="935def2f22d12f2990c685ada52ab1305ce000cdc20a721fbeaf703fa8b0fe03" exitCode=0 Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.115844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" event={"ID":"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f","Type":"ContainerDied","Data":"935def2f22d12f2990c685ada52ab1305ce000cdc20a721fbeaf703fa8b0fe03"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.122018 4769 generic.go:334] "Generic (PLEG): container finished" podID="7b17861e-ad2b-400e-a402-b9e6a986e276" containerID="c1624aa19000399e1b301fd9c8a1d857ffe396d70af0aea1520ee13047496654" exitCode=0 Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.122205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" event={"ID":"7b17861e-ad2b-400e-a402-b9e6a986e276","Type":"ContainerDied","Data":"c1624aa19000399e1b301fd9c8a1d857ffe396d70af0aea1520ee13047496654"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.124707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" event={"ID":"95358f61-e922-4897-b6d6-ef84c250fe36","Type":"ContainerDied","Data":"4a62605433fa7e963d2d46d42b492651078c3e7ba036c158f8d1113d1d6b7751"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.124823 4769 scope.go:117] "RemoveContainer" containerID="6745ccaae6613659b84e3701b16f37df336aa00a0fe58e18a18444a352c8574c" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.125012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.130716 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc0db106-c6fb-4bf7-bdae-434a1d40598a" containerID="5ac880fd145211d0a1d8bc2f74f27223bfa832a7533090cb26d7944bec370d63" exitCode=0 Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.130795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" event={"ID":"cc0db106-c6fb-4bf7-bdae-434a1d40598a","Type":"ContainerDied","Data":"5ac880fd145211d0a1d8bc2f74f27223bfa832a7533090cb26d7944bec370d63"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.136045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.137352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"7267e484-4b78-41c2-9483-b5ae5ec97a16","Type":"ContainerDied","Data":"a84cf7d954aa66cd2af09e8fa0e004d0acc810bf9f6ab68bdf655a53d8825a00"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.149750 4769 generic.go:334] "Generic (PLEG): container finished" podID="996577d9-578c-40c1-8310-24db4469b23f" containerID="2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147" exitCode=0 Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.149808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerDied","Data":"2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.149835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"996577d9-578c-40c1-8310-24db4469b23f","Type":"ContainerDied","Data":"03aff210508b8ac33238de1a2c4939fe79c7ca603691c6483fc15070cf41255c"} Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.149988 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.233742 4769 scope.go:117] "RemoveContainer" containerID="ff6e5208f6f875e2be955c084aa59528a726de6594aba59482549fc032b1da39" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.236291 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.263809 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7b47f96c5f-ctbrt"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.281991 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.292289 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.300347 4769 scope.go:117] "RemoveContainer" containerID="101c6f5202d1a7a43b823007df5b91d750a80c8bc33f7b4617e24eae79acf93f" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308184 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308640 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="sg-core" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308657 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="sg-core" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308685 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-httpd" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308695 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-httpd" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308712 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7267e484-4b78-41c2-9483-b5ae5ec97a16" containerName="kube-state-metrics" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308718 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7267e484-4b78-41c2-9483-b5ae5ec97a16" containerName="kube-state-metrics" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308733 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="proxy-httpd" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308739 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="proxy-httpd" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308751 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-central-agent" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308758 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-central-agent" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308769 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-notification-agent" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308775 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-notification-agent" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.308784 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-api" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308790 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-api" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308967 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="sg-core" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308982 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7267e484-4b78-41c2-9483-b5ae5ec97a16" containerName="kube-state-metrics" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.308998 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-notification-agent" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.309007 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-api" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.309022 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="proxy-httpd" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.309037 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" containerName="neutron-httpd" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.309050 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="996577d9-578c-40c1-8310-24db4469b23f" containerName="ceilometer-central-agent" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.309669 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.312012 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-bhtwm" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.312165 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.314526 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.319668 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.334319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.347770 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.351705 4769 scope.go:117] "RemoveContainer" containerID="0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.355537 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95358f61_e922_4897_b6d6_ef84c250fe36.slice/crio-4a62605433fa7e963d2d46d42b492651078c3e7ba036c158f8d1113d1d6b7751\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7267e484_4b78_41c2_9483_b5ae5ec97a16.slice\": RecentStats: unable to find data in memory cache]" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.362748 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.369615 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.376622 4769 scope.go:117] "RemoveContainer" containerID="8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.376638 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.376705 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.391355 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.405523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.405590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8rp\" (UniqueName: \"kubernetes.io/projected/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-api-access-7g8rp\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.405686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.405713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.424970 4769 scope.go:117] "RemoveContainer" containerID="2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.445178 4769 scope.go:117] "RemoveContainer" containerID="a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.484754 4769 scope.go:117] "RemoveContainer" containerID="0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.485457 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855\": container with ID starting with 0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855 not found: ID does not exist" containerID="0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.485514 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855"} err="failed to get container status \"0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855\": rpc error: code = NotFound desc = could not find container \"0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855\": container with ID starting with 0a1c8c5765d61c0695b94d8e0824f8e992cb80033f981cef8224b204c198f855 not found: ID does not exist" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.485545 4769 scope.go:117] "RemoveContainer" containerID="8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.485913 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da\": container with ID starting with 8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da not found: ID does not exist" containerID="8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.485940 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da"} err="failed to get container status \"8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da\": rpc error: code = NotFound desc = could not find container \"8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da\": container with ID starting with 8811737d46ed83014833293fb071518719a8812a1b25e936f7dbfbea6e1cb9da not found: ID does not exist" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.485958 4769 scope.go:117] "RemoveContainer" containerID="2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.486442 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147\": container with ID starting with 2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147 not found: ID does not exist" containerID="2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.486471 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147"} err="failed to get container status \"2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147\": rpc error: code = NotFound desc = could not find container \"2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147\": container with ID starting with 2142b462c69c78f2a0d5b39cd44c7f6a878227932e13fe3206dcf50f0d7e9147 not found: ID does not exist" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.486489 4769 scope.go:117] "RemoveContainer" containerID="a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5" Nov 21 13:15:14 crc kubenswrapper[4769]: E1121 13:15:14.486771 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5\": container with ID starting with a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5 not found: ID does not exist" containerID="a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.486803 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5"} err="failed to get container status \"a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5\": rpc error: code = NotFound desc = could not find container \"a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5\": container with ID starting with a6ce9f6cc1f62f761bcec5f52e5251114c3d4567b07570f8df7cb1ac1e02aae5 not found: ID does not exist" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508509 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-run-httpd\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508581 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-config-data\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8rp\" (UniqueName: \"kubernetes.io/projected/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-api-access-7g8rp\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbpnz\" (UniqueName: \"kubernetes.io/projected/eef9f770-c76b-4205-98cc-65aa678eea61-kube-api-access-wbpnz\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.508970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-log-httpd\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.509004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.509046 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-scripts\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.610691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-run-httpd\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.611271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.611395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-run-httpd\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.611594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-config-data\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.611721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wbpnz\" (UniqueName: \"kubernetes.io/projected/eef9f770-c76b-4205-98cc-65aa678eea61-kube-api-access-wbpnz\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.611843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-log-httpd\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.611991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.612696 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-scripts\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.612507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-log-httpd\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.686309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.686566 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.686850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.687412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.687936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-config-data\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.688391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8rp\" (UniqueName: \"kubernetes.io/projected/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-api-access-7g8rp\") pod \"kube-state-metrics-0\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.692978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbpnz\" (UniqueName: \"kubernetes.io/projected/eef9f770-c76b-4205-98cc-65aa678eea61-kube-api-access-wbpnz\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.703474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-scripts\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.711325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.940469 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.972565 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:14 crc kubenswrapper[4769]: I1121 13:15:14.974094 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.166050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" event={"ID":"c9f6d7c8-4590-42c5-bace-ee43645040da","Type":"ContainerStarted","Data":"d85cce4ecec066027ff83499830ba52857c216053c38299de387f6fe68d5458f"} Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.183251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" event={"ID":"732a6a91-49bd-42d7-9007-af1835aa4024","Type":"ContainerStarted","Data":"743b78b4d2d710e689cab3e4a93cee94e755ceb048228a03934928f87969f76f"} Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.184708 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" podStartSLOduration=4.1846876 podStartE2EDuration="4.1846876s" podCreationTimestamp="2025-11-21 13:15:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:15.181471884 +0000 UTC m=+5073.882133712" watchObservedRunningTime="2025-11-21 13:15:15.1846876 +0000 UTC m=+5073.885349418" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.189847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" event={"ID":"ac22474c-69bf-4242-921d-8401864d88d4","Type":"ContainerStarted","Data":"f1ba6322e5b2fd8f9d61ebfb31895ae253c98dcaebc2ef016a403c03ee2953f6"} Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.231920 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" podStartSLOduration=4.231889012 podStartE2EDuration="4.231889012s" podCreationTimestamp="2025-11-21 13:15:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:15.208342098 +0000 UTC m=+5073.909003916" watchObservedRunningTime="2025-11-21 13:15:15.231889012 +0000 UTC m=+5073.932550830" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.236955 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.237268 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-log" containerID="cri-o://c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3" gracePeriod=30 Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.237821 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-httpd" containerID="cri-o://4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7" gracePeriod=30 Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.271946 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" podStartSLOduration=4.27192302 podStartE2EDuration="4.27192302s" podCreationTimestamp="2025-11-21 13:15:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:15.223295711 +0000 UTC m=+5073.923957529" watchObservedRunningTime="2025-11-21 13:15:15.27192302 +0000 UTC m=+5073.972584838" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.301700 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7267e484-4b78-41c2-9483-b5ae5ec97a16" path="/var/lib/kubelet/pods/7267e484-4b78-41c2-9483-b5ae5ec97a16/volumes" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.302670 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95358f61-e922-4897-b6d6-ef84c250fe36" path="/var/lib/kubelet/pods/95358f61-e922-4897-b6d6-ef84c250fe36/volumes" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.303526 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="996577d9-578c-40c1-8310-24db4469b23f" path="/var/lib/kubelet/pods/996577d9-578c-40c1-8310-24db4469b23f/volumes" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.363883 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.457851 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:15:15 crc kubenswrapper[4769]: W1121 13:15:15.472207 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26c27a21_dcc1_48a8_b4ea_fa384a28c315.slice/crio-277d508eef92012ec6e33205a2f530434709ede33f639e4d1419a982e8a58972 WatchSource:0}: Error finding container 277d508eef92012ec6e33205a2f530434709ede33f639e4d1419a982e8a58972: Status 404 returned error can't find the container with id 277d508eef92012ec6e33205a2f530434709ede33f639e4d1419a982e8a58972 Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.667900 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.671599 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.684752 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.740674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2qvv\" (UniqueName: \"kubernetes.io/projected/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-kube-api-access-l2qvv\") pod \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.740733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-operator-scripts\") pod \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\" (UID: \"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f\") " Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.740815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p6gz\" (UniqueName: \"kubernetes.io/projected/cc0db106-c6fb-4bf7-bdae-434a1d40598a-kube-api-access-2p6gz\") pod \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.740884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc0db106-c6fb-4bf7-bdae-434a1d40598a-operator-scripts\") pod \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\" (UID: \"cc0db106-c6fb-4bf7-bdae-434a1d40598a\") " Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.740940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw8r2\" (UniqueName: \"kubernetes.io/projected/7b17861e-ad2b-400e-a402-b9e6a986e276-kube-api-access-dw8r2\") pod \"7b17861e-ad2b-400e-a402-b9e6a986e276\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.740976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b17861e-ad2b-400e-a402-b9e6a986e276-operator-scripts\") pod \"7b17861e-ad2b-400e-a402-b9e6a986e276\" (UID: \"7b17861e-ad2b-400e-a402-b9e6a986e276\") " Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.741514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0db106-c6fb-4bf7-bdae-434a1d40598a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cc0db106-c6fb-4bf7-bdae-434a1d40598a" (UID: "cc0db106-c6fb-4bf7-bdae-434a1d40598a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.741577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" (UID: "3e9ba597-8cd2-4eed-b410-fcad0ef9f41f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.741689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b17861e-ad2b-400e-a402-b9e6a986e276-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7b17861e-ad2b-400e-a402-b9e6a986e276" (UID: "7b17861e-ad2b-400e-a402-b9e6a986e276"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.751407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b17861e-ad2b-400e-a402-b9e6a986e276-kube-api-access-dw8r2" (OuterVolumeSpecName: "kube-api-access-dw8r2") pod "7b17861e-ad2b-400e-a402-b9e6a986e276" (UID: "7b17861e-ad2b-400e-a402-b9e6a986e276"). InnerVolumeSpecName "kube-api-access-dw8r2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.751672 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-kube-api-access-l2qvv" (OuterVolumeSpecName: "kube-api-access-l2qvv") pod "3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" (UID: "3e9ba597-8cd2-4eed-b410-fcad0ef9f41f"). InnerVolumeSpecName "kube-api-access-l2qvv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.752668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0db106-c6fb-4bf7-bdae-434a1d40598a-kube-api-access-2p6gz" (OuterVolumeSpecName: "kube-api-access-2p6gz") pod "cc0db106-c6fb-4bf7-bdae-434a1d40598a" (UID: "cc0db106-c6fb-4bf7-bdae-434a1d40598a"). InnerVolumeSpecName "kube-api-access-2p6gz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.842495 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dw8r2\" (UniqueName: \"kubernetes.io/projected/7b17861e-ad2b-400e-a402-b9e6a986e276-kube-api-access-dw8r2\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.842526 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7b17861e-ad2b-400e-a402-b9e6a986e276-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.842536 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l2qvv\" (UniqueName: \"kubernetes.io/projected/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-kube-api-access-l2qvv\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.842545 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.842553 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2p6gz\" (UniqueName: \"kubernetes.io/projected/cc0db106-c6fb-4bf7-bdae-434a1d40598a-kube-api-access-2p6gz\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:15 crc kubenswrapper[4769]: I1121 13:15:15.842564 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc0db106-c6fb-4bf7-bdae-434a1d40598a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.200373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" event={"ID":"cc0db106-c6fb-4bf7-bdae-434a1d40598a","Type":"ContainerDied","Data":"f8186c241bb92413cfca1e1800e225655a9e40826a0b59545ab9edb9886e1b28"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.200423 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8186c241bb92413cfca1e1800e225655a9e40826a0b59545ab9edb9886e1b28" Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.200396 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-q2h4q" Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.202051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerStarted","Data":"9568d66f817a7459412b5bc1c9b3810033ad522c0ff5734b9df981a5b4485231"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.204376 4769 generic.go:334] "Generic (PLEG): container finished" podID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerID="c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3" exitCode=143 Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.204461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ced008cb-d09d-4d3f-bb38-8771e748e2d8","Type":"ContainerDied","Data":"c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.205721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"26c27a21-dcc1-48a8-b4ea-fa384a28c315","Type":"ContainerStarted","Data":"277d508eef92012ec6e33205a2f530434709ede33f639e4d1419a982e8a58972"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.207859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" event={"ID":"3e9ba597-8cd2-4eed-b410-fcad0ef9f41f","Type":"ContainerDied","Data":"090d1123c10ccfb176f8e1511d438b40ddc9369780d980a23ef669524659f346"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.207891 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="090d1123c10ccfb176f8e1511d438b40ddc9369780d980a23ef669524659f346" Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.207891 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af9-account-create-vj26g" Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.211816 4769 generic.go:334] "Generic (PLEG): container finished" podID="732a6a91-49bd-42d7-9007-af1835aa4024" containerID="743b78b4d2d710e689cab3e4a93cee94e755ceb048228a03934928f87969f76f" exitCode=0 Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.211905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" event={"ID":"732a6a91-49bd-42d7-9007-af1835aa4024","Type":"ContainerDied","Data":"743b78b4d2d710e689cab3e4a93cee94e755ceb048228a03934928f87969f76f"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.214935 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac22474c-69bf-4242-921d-8401864d88d4" containerID="f1ba6322e5b2fd8f9d61ebfb31895ae253c98dcaebc2ef016a403c03ee2953f6" exitCode=0 Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.215019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" event={"ID":"ac22474c-69bf-4242-921d-8401864d88d4","Type":"ContainerDied","Data":"f1ba6322e5b2fd8f9d61ebfb31895ae253c98dcaebc2ef016a403c03ee2953f6"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.217180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" event={"ID":"7b17861e-ad2b-400e-a402-b9e6a986e276","Type":"ContainerDied","Data":"66d4abacb78c4e8ec3fcf8f4a5cc4abf5d101e6901065d47ecd8b4642813e0f4"} Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.217277 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66d4abacb78c4e8ec3fcf8f4a5cc4abf5d101e6901065d47ecd8b4642813e0f4" Nov 21 13:15:16 crc kubenswrapper[4769]: I1121 13:15:16.217215 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-zl7nx" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.228734 4769 generic.go:334] "Generic (PLEG): container finished" podID="c9f6d7c8-4590-42c5-bace-ee43645040da" containerID="d85cce4ecec066027ff83499830ba52857c216053c38299de387f6fe68d5458f" exitCode=0 Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.228843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" event={"ID":"c9f6d7c8-4590-42c5-bace-ee43645040da","Type":"ContainerDied","Data":"d85cce4ecec066027ff83499830ba52857c216053c38299de387f6fe68d5458f"} Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.684419 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.753762 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.754110 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-log" containerID="cri-o://ceb0abe99505ba71282f5f90e73dbbcb7b5041fec45bfddc26d1e32530a34fe2" gracePeriod=30 Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.754268 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-httpd" containerID="cri-o://48c9f6737b202fee45ba6442d8aff96676c345945786237599c0c8013ac6eba0" gracePeriod=30 Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.774849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnd28\" (UniqueName: \"kubernetes.io/projected/ac22474c-69bf-4242-921d-8401864d88d4-kube-api-access-mnd28\") pod \"ac22474c-69bf-4242-921d-8401864d88d4\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.774922 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac22474c-69bf-4242-921d-8401864d88d4-operator-scripts\") pod \"ac22474c-69bf-4242-921d-8401864d88d4\" (UID: \"ac22474c-69bf-4242-921d-8401864d88d4\") " Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.775750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac22474c-69bf-4242-921d-8401864d88d4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ac22474c-69bf-4242-921d-8401864d88d4" (UID: "ac22474c-69bf-4242-921d-8401864d88d4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.780522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac22474c-69bf-4242-921d-8401864d88d4-kube-api-access-mnd28" (OuterVolumeSpecName: "kube-api-access-mnd28") pod "ac22474c-69bf-4242-921d-8401864d88d4" (UID: "ac22474c-69bf-4242-921d-8401864d88d4"). InnerVolumeSpecName "kube-api-access-mnd28". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.804015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.830700 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.842519 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.880790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/732a6a91-49bd-42d7-9007-af1835aa4024-operator-scripts\") pod \"732a6a91-49bd-42d7-9007-af1835aa4024\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.880883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnk52\" (UniqueName: \"kubernetes.io/projected/732a6a91-49bd-42d7-9007-af1835aa4024-kube-api-access-fnk52\") pod \"732a6a91-49bd-42d7-9007-af1835aa4024\" (UID: \"732a6a91-49bd-42d7-9007-af1835aa4024\") " Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.881361 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mnd28\" (UniqueName: \"kubernetes.io/projected/ac22474c-69bf-4242-921d-8401864d88d4-kube-api-access-mnd28\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.881379 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac22474c-69bf-4242-921d-8401864d88d4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.882490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/732a6a91-49bd-42d7-9007-af1835aa4024-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "732a6a91-49bd-42d7-9007-af1835aa4024" (UID: "732a6a91-49bd-42d7-9007-af1835aa4024"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.909473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/732a6a91-49bd-42d7-9007-af1835aa4024-kube-api-access-fnk52" (OuterVolumeSpecName: "kube-api-access-fnk52") pod "732a6a91-49bd-42d7-9007-af1835aa4024" (UID: "732a6a91-49bd-42d7-9007-af1835aa4024"). InnerVolumeSpecName "kube-api-access-fnk52". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.983296 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/732a6a91-49bd-42d7-9007-af1835aa4024-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:17 crc kubenswrapper[4769]: I1121 13:15:17.983334 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fnk52\" (UniqueName: \"kubernetes.io/projected/732a6a91-49bd-42d7-9007-af1835aa4024-kube-api-access-fnk52\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.239861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" event={"ID":"ac22474c-69bf-4242-921d-8401864d88d4","Type":"ContainerDied","Data":"714707acb3d3b68dc94a5dedf512adec039d01139a0d7147b89f48449b762ead"} Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.240775 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="714707acb3d3b68dc94a5dedf512adec039d01139a0d7147b89f48449b762ead" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.239925 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.241806 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerStarted","Data":"3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e"} Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.246783 4769 generic.go:334] "Generic (PLEG): container finished" podID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerID="ceb0abe99505ba71282f5f90e73dbbcb7b5041fec45bfddc26d1e32530a34fe2" exitCode=143 Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.246891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c","Type":"ContainerDied","Data":"ceb0abe99505ba71282f5f90e73dbbcb7b5041fec45bfddc26d1e32530a34fe2"} Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.249929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"26c27a21-dcc1-48a8-b4ea-fa384a28c315","Type":"ContainerStarted","Data":"8a8bcb12784225376247ec07d55ee253020968759273e0b4e1b31180083afd27"} Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.250016 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.253432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.253735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-d7x8p" event={"ID":"732a6a91-49bd-42d7-9007-af1835aa4024","Type":"ContainerDied","Data":"ef9e09217252017d23f9d82e2ef8213e1af9511d7865a1e90e735dabc41a2a99"} Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.253793 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef9e09217252017d23f9d82e2ef8213e1af9511d7865a1e90e735dabc41a2a99" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.281690 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.950641445 podStartE2EDuration="4.281667491s" podCreationTimestamp="2025-11-21 13:15:14 +0000 UTC" firstStartedPulling="2025-11-21 13:15:15.477505029 +0000 UTC m=+5074.178166847" lastFinishedPulling="2025-11-21 13:15:17.808531065 +0000 UTC m=+5076.509192893" observedRunningTime="2025-11-21 13:15:18.274662142 +0000 UTC m=+5076.975323970" watchObservedRunningTime="2025-11-21 13:15:18.281667491 +0000 UTC m=+5076.982329309" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.645477 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.684645 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.222:9292/healthcheck\": read tcp 10.217.0.2:35720->10.217.1.222:9292: read: connection reset by peer" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.684641 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.222:9292/healthcheck\": read tcp 10.217.0.2:35710->10.217.1.222:9292: read: connection reset by peer" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.694792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9f6d7c8-4590-42c5-bace-ee43645040da-operator-scripts\") pod \"c9f6d7c8-4590-42c5-bace-ee43645040da\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.694856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grqp8\" (UniqueName: \"kubernetes.io/projected/c9f6d7c8-4590-42c5-bace-ee43645040da-kube-api-access-grqp8\") pod \"c9f6d7c8-4590-42c5-bace-ee43645040da\" (UID: \"c9f6d7c8-4590-42c5-bace-ee43645040da\") " Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.695423 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f6d7c8-4590-42c5-bace-ee43645040da-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c9f6d7c8-4590-42c5-bace-ee43645040da" (UID: "c9f6d7c8-4590-42c5-bace-ee43645040da"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.702736 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f6d7c8-4590-42c5-bace-ee43645040da-kube-api-access-grqp8" (OuterVolumeSpecName: "kube-api-access-grqp8") pod "c9f6d7c8-4590-42c5-bace-ee43645040da" (UID: "c9f6d7c8-4590-42c5-bace-ee43645040da"). InnerVolumeSpecName "kube-api-access-grqp8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.797078 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c9f6d7c8-4590-42c5-bace-ee43645040da-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:18 crc kubenswrapper[4769]: I1121 13:15:18.797142 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-grqp8\" (UniqueName: \"kubernetes.io/projected/c9f6d7c8-4590-42c5-bace-ee43645040da-kube-api-access-grqp8\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.019144 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.100674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.100731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-combined-ca-bundle\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.100771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-config-data\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.100910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-public-tls-certs\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.100941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-httpd-run\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.100984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-logs\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.101017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t9sc\" (UniqueName: \"kubernetes.io/projected/ced008cb-d09d-4d3f-bb38-8771e748e2d8-kube-api-access-7t9sc\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.101072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-scripts\") pod \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\" (UID: \"ced008cb-d09d-4d3f-bb38-8771e748e2d8\") " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.101468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.101991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-logs" (OuterVolumeSpecName: "logs") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.113823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.120551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced008cb-d09d-4d3f-bb38-8771e748e2d8-kube-api-access-7t9sc" (OuterVolumeSpecName: "kube-api-access-7t9sc") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "kube-api-access-7t9sc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.125161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-scripts" (OuterVolumeSpecName: "scripts") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.153317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.162337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-config-data" (OuterVolumeSpecName: "config-data") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.190443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ced008cb-d09d-4d3f-bb38-8771e748e2d8" (UID: "ced008cb-d09d-4d3f-bb38-8771e748e2d8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202788 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202824 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202834 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ced008cb-d09d-4d3f-bb38-8771e748e2d8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202844 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7t9sc\" (UniqueName: \"kubernetes.io/projected/ced008cb-d09d-4d3f-bb38-8771e748e2d8-kube-api-access-7t9sc\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202856 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202889 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202900 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.202909 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ced008cb-d09d-4d3f-bb38-8771e748e2d8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.224787 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.267611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" event={"ID":"c9f6d7c8-4590-42c5-bace-ee43645040da","Type":"ContainerDied","Data":"c5e876ac77b04cf0ad8c98a7004efce933908dc0024ae10ba4ab59253b63349a"} Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.267660 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5e876ac77b04cf0ad8c98a7004efce933908dc0024ae10ba4ab59253b63349a" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.267730 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.284021 4769 generic.go:334] "Generic (PLEG): container finished" podID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerID="4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7" exitCode=0 Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.284262 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.304496 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.316398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerStarted","Data":"7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2"} Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.316435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ced008cb-d09d-4d3f-bb38-8771e748e2d8","Type":"ContainerDied","Data":"4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7"} Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.316450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ced008cb-d09d-4d3f-bb38-8771e748e2d8","Type":"ContainerDied","Data":"346ba60a9139e2e57c6928862c592e245698a017cc5c7ce901f6a1564538b36c"} Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.316468 4769 scope.go:117] "RemoveContainer" containerID="4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.339902 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.348680 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.384211 4769 scope.go:117] "RemoveContainer" containerID="c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.385324 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.385690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-log" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.385706 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-log" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.385717 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.385724 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.385735 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc0db106-c6fb-4bf7-bdae-434a1d40598a" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.385742 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0db106-c6fb-4bf7-bdae-434a1d40598a" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.385753 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="732a6a91-49bd-42d7-9007-af1835aa4024" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.385760 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="732a6a91-49bd-42d7-9007-af1835aa4024" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.385776 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c9f6d7c8-4590-42c5-bace-ee43645040da" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.385782 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f6d7c8-4590-42c5-bace-ee43645040da" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.391356 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-httpd" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391423 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-httpd" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.391457 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b17861e-ad2b-400e-a402-b9e6a986e276" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391465 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b17861e-ad2b-400e-a402-b9e6a986e276" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.391485 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac22474c-69bf-4242-921d-8401864d88d4" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391497 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac22474c-69bf-4242-921d-8401864d88d4" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391878 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-log" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391904 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="732a6a91-49bd-42d7-9007-af1835aa4024" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391918 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac22474c-69bf-4242-921d-8401864d88d4" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391933 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c9f6d7c8-4590-42c5-bace-ee43645040da" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391946 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" containerName="mariadb-account-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391963 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b17861e-ad2b-400e-a402-b9e6a986e276" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.391977 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc0db106-c6fb-4bf7-bdae-434a1d40598a" containerName="mariadb-database-create" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.392000 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" containerName="glance-httpd" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.393052 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.397606 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.397876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.410011 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-scripts\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510737 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-logs\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-config-data\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510817 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.510840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsskt\" (UniqueName: \"kubernetes.io/projected/303d0b55-36e2-4605-9c93-6dec4e83eac2-kube-api-access-tsskt\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.517416 4769 scope.go:117] "RemoveContainer" containerID="4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.518719 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7\": container with ID starting with 4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7 not found: ID does not exist" containerID="4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.518751 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7"} err="failed to get container status \"4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7\": rpc error: code = NotFound desc = could not find container \"4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7\": container with ID starting with 4ea1804608629ae3a75767b40087775c418da92f79e3eb35498da80481f6c8b7 not found: ID does not exist" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.518772 4769 scope.go:117] "RemoveContainer" containerID="c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3" Nov 21 13:15:19 crc kubenswrapper[4769]: E1121 13:15:19.522762 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3\": container with ID starting with c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3 not found: ID does not exist" containerID="c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.522935 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3"} err="failed to get container status \"c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3\": rpc error: code = NotFound desc = could not find container \"c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3\": container with ID starting with c066bab70fadb2d8ecb434cbc888f1805da383ebe3bfa325409bc42c4c5b83b3 not found: ID does not exist" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614110 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-config-data\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614222 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tsskt\" (UniqueName: \"kubernetes.io/projected/303d0b55-36e2-4605-9c93-6dec4e83eac2-kube-api-access-tsskt\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-scripts\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-logs\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.614872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-logs\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.616276 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.616654 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.626810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.629928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.631173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-scripts\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.637463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-config-data\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.660927 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsskt\" (UniqueName: \"kubernetes.io/projected/303d0b55-36e2-4605-9c93-6dec4e83eac2-kube-api-access-tsskt\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.699868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:19 crc kubenswrapper[4769]: I1121 13:15:19.812377 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:20 crc kubenswrapper[4769]: W1121 13:15:20.251728 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod303d0b55_36e2_4605_9c93_6dec4e83eac2.slice/crio-62021feb93db9a7b8e18b86b59878400a63d3e4df2a1f381519d90503262e9f0 WatchSource:0}: Error finding container 62021feb93db9a7b8e18b86b59878400a63d3e4df2a1f381519d90503262e9f0: Status 404 returned error can't find the container with id 62021feb93db9a7b8e18b86b59878400a63d3e4df2a1f381519d90503262e9f0 Nov 21 13:15:20 crc kubenswrapper[4769]: I1121 13:15:20.255798 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:15:20 crc kubenswrapper[4769]: I1121 13:15:20.295505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerStarted","Data":"c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06"} Nov 21 13:15:20 crc kubenswrapper[4769]: I1121 13:15:20.299766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"303d0b55-36e2-4605-9c93-6dec4e83eac2","Type":"ContainerStarted","Data":"62021feb93db9a7b8e18b86b59878400a63d3e4df2a1f381519d90503262e9f0"} Nov 21 13:15:20 crc kubenswrapper[4769]: I1121 13:15:20.895781 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.1.221:9292/healthcheck\": read tcp 10.217.0.2:35044->10.217.1.221:9292: read: connection reset by peer" Nov 21 13:15:20 crc kubenswrapper[4769]: I1121 13:15:20.895801 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.1.221:9292/healthcheck\": read tcp 10.217.0.2:35038->10.217.1.221:9292: read: connection reset by peer" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.294129 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced008cb-d09d-4d3f-bb38-8771e748e2d8" path="/var/lib/kubelet/pods/ced008cb-d09d-4d3f-bb38-8771e748e2d8/volumes" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.316659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"303d0b55-36e2-4605-9c93-6dec4e83eac2","Type":"ContainerStarted","Data":"6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b"} Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.318496 4769 generic.go:334] "Generic (PLEG): container finished" podID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerID="48c9f6737b202fee45ba6442d8aff96676c345945786237599c0c8013ac6eba0" exitCode=0 Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.318528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c","Type":"ContainerDied","Data":"48c9f6737b202fee45ba6442d8aff96676c345945786237599c0c8013ac6eba0"} Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.375961 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.455562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-internal-tls-certs\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.455670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-combined-ca-bundle\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.455933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-scripts\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.456008 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.456072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-httpd-run\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.456100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-config-data\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.456213 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wsx9\" (UniqueName: \"kubernetes.io/projected/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-kube-api-access-4wsx9\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.456418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-logs\") pod \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\" (UID: \"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c\") " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.457547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-logs" (OuterVolumeSpecName: "logs") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.457818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.461873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.465569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-kube-api-access-4wsx9" (OuterVolumeSpecName: "kube-api-access-4wsx9") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "kube-api-access-4wsx9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.469773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-scripts" (OuterVolumeSpecName: "scripts") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.543434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.558308 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.558343 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.558369 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.558382 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.558396 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4wsx9\" (UniqueName: \"kubernetes.io/projected/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-kube-api-access-4wsx9\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.558409 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.563576 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.588971 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r"] Nov 21 13:15:21 crc kubenswrapper[4769]: E1121 13:15:21.589393 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-log" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.589404 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-log" Nov 21 13:15:21 crc kubenswrapper[4769]: E1121 13:15:21.589438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-httpd" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.589444 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-httpd" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.589616 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-httpd" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.589637 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" containerName="glance-log" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.590368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.592972 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.593201 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.593223 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-7nn2b" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.611875 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r"] Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.618294 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.627427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-config-data" (OuterVolumeSpecName: "config-data") pod "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" (UID: "259f4d5c-cc0f-4221-aea2-1a40b6edcc4c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.659861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.660044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-scripts\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.660077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-config-data\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.660156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fzlg\" (UniqueName: \"kubernetes.io/projected/7c3f7a0e-20e7-4571-aa36-738a676580a3-kube-api-access-2fzlg\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.660267 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.660285 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.660295 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.762077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.762216 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-scripts\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.762239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-config-data\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.762279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2fzlg\" (UniqueName: \"kubernetes.io/projected/7c3f7a0e-20e7-4571-aa36-738a676580a3-kube-api-access-2fzlg\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.769635 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-scripts\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.769740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.769862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-config-data\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:21 crc kubenswrapper[4769]: I1121 13:15:21.781068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fzlg\" (UniqueName: \"kubernetes.io/projected/7c3f7a0e-20e7-4571-aa36-738a676580a3-kube-api-access-2fzlg\") pod \"nova-cell0-conductor-db-sync-k2k7r\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.023462 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.351344 4769 generic.go:334] "Generic (PLEG): container finished" podID="eef9f770-c76b-4205-98cc-65aa678eea61" containerID="d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4" exitCode=1 Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.351456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerDied","Data":"d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4"} Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.351497 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-central-agent" containerID="cri-o://3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e" gracePeriod=30 Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.351555 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-notification-agent" containerID="cri-o://7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2" gracePeriod=30 Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.351547 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="sg-core" containerID="cri-o://c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06" gracePeriod=30 Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.356212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"259f4d5c-cc0f-4221-aea2-1a40b6edcc4c","Type":"ContainerDied","Data":"8961141fa2b92b1deec642a87cbf0be44a4c29b927e1ec684e70de57526ad426"} Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.356259 4769 scope.go:117] "RemoveContainer" containerID="48c9f6737b202fee45ba6442d8aff96676c345945786237599c0c8013ac6eba0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.356386 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.361872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"303d0b55-36e2-4605-9c93-6dec4e83eac2","Type":"ContainerStarted","Data":"4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac"} Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.392307 4769 scope.go:117] "RemoveContainer" containerID="ceb0abe99505ba71282f5f90e73dbbcb7b5041fec45bfddc26d1e32530a34fe2" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.409248 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.409226044 podStartE2EDuration="3.409226044s" podCreationTimestamp="2025-11-21 13:15:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:22.407788226 +0000 UTC m=+5081.108450044" watchObservedRunningTime="2025-11-21 13:15:22.409226044 +0000 UTC m=+5081.109887872" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.431587 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.439298 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.461041 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.462823 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.465749 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.466089 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.506243 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580214 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-logs\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-642b7\" (UniqueName: \"kubernetes.io/projected/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-kube-api-access-642b7\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.580799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.683697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684199 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-logs\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-642b7\" (UniqueName: \"kubernetes.io/projected/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-kube-api-access-642b7\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.684542 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.685616 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.685642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.685770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-logs\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.692112 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.697092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-scripts\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.697271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-config-data\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.710307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-642b7\" (UniqueName: \"kubernetes.io/projected/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-kube-api-access-642b7\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.712076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.752092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:22 crc kubenswrapper[4769]: I1121 13:15:22.897549 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.002276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r"] Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.285418 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="259f4d5c-cc0f-4221-aea2-1a40b6edcc4c" path="/var/lib/kubelet/pods/259f4d5c-cc0f-4221-aea2-1a40b6edcc4c/volumes" Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.345009 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:15:23 crc kubenswrapper[4769]: W1121 13:15:23.354534 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83fa5ff4_d052_43d6_94da_a7b1bc2ba0f2.slice/crio-08bb4a090cc8a2ba649ba485ee40e187ad8b1273f250cfd55aedfb52e7e9a980 WatchSource:0}: Error finding container 08bb4a090cc8a2ba649ba485ee40e187ad8b1273f250cfd55aedfb52e7e9a980: Status 404 returned error can't find the container with id 08bb4a090cc8a2ba649ba485ee40e187ad8b1273f250cfd55aedfb52e7e9a980 Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.374294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2","Type":"ContainerStarted","Data":"08bb4a090cc8a2ba649ba485ee40e187ad8b1273f250cfd55aedfb52e7e9a980"} Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.378091 4769 generic.go:334] "Generic (PLEG): container finished" podID="eef9f770-c76b-4205-98cc-65aa678eea61" containerID="c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06" exitCode=2 Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.378117 4769 generic.go:334] "Generic (PLEG): container finished" podID="eef9f770-c76b-4205-98cc-65aa678eea61" containerID="7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2" exitCode=0 Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.378150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerDied","Data":"c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06"} Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.378166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerDied","Data":"7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2"} Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.384110 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" event={"ID":"7c3f7a0e-20e7-4571-aa36-738a676580a3","Type":"ContainerStarted","Data":"10703a120a7cf5f1b3ccbbc6a7054a0ba627c80c40e0808afb513db0ce9b544f"} Nov 21 13:15:23 crc kubenswrapper[4769]: I1121 13:15:23.384177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" event={"ID":"7c3f7a0e-20e7-4571-aa36-738a676580a3","Type":"ContainerStarted","Data":"527ed1f86d87c3fbf57421fd9b243acef3016a0171c6f1930617da5dfe0f0ea1"} Nov 21 13:15:24 crc kubenswrapper[4769]: I1121 13:15:24.413118 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" podStartSLOduration=3.413099148 podStartE2EDuration="3.413099148s" podCreationTimestamp="2025-11-21 13:15:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:24.410727824 +0000 UTC m=+5083.111389652" watchObservedRunningTime="2025-11-21 13:15:24.413099148 +0000 UTC m=+5083.113760966" Nov 21 13:15:24 crc kubenswrapper[4769]: I1121 13:15:24.952956 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:15:25 crc kubenswrapper[4769]: I1121 13:15:25.404252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2","Type":"ContainerStarted","Data":"dd8e2fd78d75b0189c16396e4fe6a06f53e819a2e859dc01962e87379855181a"} Nov 21 13:15:25 crc kubenswrapper[4769]: I1121 13:15:25.404643 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2","Type":"ContainerStarted","Data":"aed056b6874cbff320ebc9d162bfb88d60d2ee1a21407b0606cbbd937fe65d48"} Nov 21 13:15:25 crc kubenswrapper[4769]: I1121 13:15:25.427670 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.427641238 podStartE2EDuration="3.427641238s" podCreationTimestamp="2025-11-21 13:15:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:25.423124906 +0000 UTC m=+5084.123786764" watchObservedRunningTime="2025-11-21 13:15:25.427641238 +0000 UTC m=+5084.128303076" Nov 21 13:15:28 crc kubenswrapper[4769]: I1121 13:15:28.438842 4769 generic.go:334] "Generic (PLEG): container finished" podID="7c3f7a0e-20e7-4571-aa36-738a676580a3" containerID="10703a120a7cf5f1b3ccbbc6a7054a0ba627c80c40e0808afb513db0ce9b544f" exitCode=0 Nov 21 13:15:28 crc kubenswrapper[4769]: I1121 13:15:28.438922 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" event={"ID":"7c3f7a0e-20e7-4571-aa36-738a676580a3","Type":"ContainerDied","Data":"10703a120a7cf5f1b3ccbbc6a7054a0ba627c80c40e0808afb513db0ce9b544f"} Nov 21 13:15:28 crc kubenswrapper[4769]: I1121 13:15:28.908846 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-combined-ca-bundle\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbpnz\" (UniqueName: \"kubernetes.io/projected/eef9f770-c76b-4205-98cc-65aa678eea61-kube-api-access-wbpnz\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-scripts\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-sg-core-conf-yaml\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-config-data\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-run-httpd\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.002972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-log-httpd\") pod \"eef9f770-c76b-4205-98cc-65aa678eea61\" (UID: \"eef9f770-c76b-4205-98cc-65aa678eea61\") " Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.004010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.005618 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.009806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-scripts" (OuterVolumeSpecName: "scripts") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.013806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef9f770-c76b-4205-98cc-65aa678eea61-kube-api-access-wbpnz" (OuterVolumeSpecName: "kube-api-access-wbpnz") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "kube-api-access-wbpnz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.031287 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.073013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104017 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-config-data" (OuterVolumeSpecName: "config-data") pod "eef9f770-c76b-4205-98cc-65aa678eea61" (UID: "eef9f770-c76b-4205-98cc-65aa678eea61"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104866 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104895 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104904 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eef9f770-c76b-4205-98cc-65aa678eea61-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104913 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104928 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wbpnz\" (UniqueName: \"kubernetes.io/projected/eef9f770-c76b-4205-98cc-65aa678eea61-kube-api-access-wbpnz\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104936 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.104944 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eef9f770-c76b-4205-98cc-65aa678eea61-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.470890 4769 generic.go:334] "Generic (PLEG): container finished" podID="eef9f770-c76b-4205-98cc-65aa678eea61" containerID="3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e" exitCode=0 Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.470975 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.471043 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerDied","Data":"3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e"} Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.471068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eef9f770-c76b-4205-98cc-65aa678eea61","Type":"ContainerDied","Data":"9568d66f817a7459412b5bc1c9b3810033ad522c0ff5734b9df981a5b4485231"} Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.471084 4769 scope.go:117] "RemoveContainer" containerID="d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.496996 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.513989 4769 scope.go:117] "RemoveContainer" containerID="c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.516155 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.531705 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.532257 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-notification-agent" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532281 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-notification-agent" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.532304 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="proxy-httpd" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532313 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="proxy-httpd" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.532343 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="sg-core" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532351 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="sg-core" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.532370 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-central-agent" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-central-agent" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532622 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-central-agent" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532642 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="sg-core" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532654 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="proxy-httpd" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.532670 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" containerName="ceilometer-notification-agent" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.536055 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.537835 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.538065 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.538939 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.552916 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.590803 4769 scope.go:117] "RemoveContainer" containerID="7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.631101 4769 scope.go:117] "RemoveContainer" containerID="3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.657618 4769 scope.go:117] "RemoveContainer" containerID="d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.658076 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4\": container with ID starting with d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4 not found: ID does not exist" containerID="d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.658109 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4"} err="failed to get container status \"d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4\": rpc error: code = NotFound desc = could not find container \"d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4\": container with ID starting with d8d193ea202a3ea863618f4f237de4b86c6fe047e6c2f3340691f496e93abca4 not found: ID does not exist" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.658128 4769 scope.go:117] "RemoveContainer" containerID="c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.658447 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06\": container with ID starting with c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06 not found: ID does not exist" containerID="c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.658475 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06"} err="failed to get container status \"c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06\": rpc error: code = NotFound desc = could not find container \"c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06\": container with ID starting with c0e52f11af9183bf894af6d7a71f50d0cb4a47522965125814fcde8b46bbea06 not found: ID does not exist" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.658491 4769 scope.go:117] "RemoveContainer" containerID="7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.658743 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2\": container with ID starting with 7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2 not found: ID does not exist" containerID="7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.658769 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2"} err="failed to get container status \"7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2\": rpc error: code = NotFound desc = could not find container \"7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2\": container with ID starting with 7778db7eb83aedf60d11f442b9e6d0e4a904d09a3226ca5ee49feb5b494c27f2 not found: ID does not exist" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.658787 4769 scope.go:117] "RemoveContainer" containerID="3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e" Nov 21 13:15:29 crc kubenswrapper[4769]: E1121 13:15:29.659019 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e\": container with ID starting with 3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e not found: ID does not exist" containerID="3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.659043 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e"} err="failed to get container status \"3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e\": rpc error: code = NotFound desc = could not find container \"3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e\": container with ID starting with 3f76479feba2c4cd5eab44847037d78ca3a446722d121d459e498ff0e53c778e not found: ID does not exist" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717548 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-config-data\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717588 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-scripts\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-log-httpd\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717735 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-run-httpd\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgvsq\" (UniqueName: \"kubernetes.io/projected/de390327-3b86-45b5-ae75-d49d23210bfa-kube-api-access-dgvsq\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.717839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.813481 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.813537 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.819762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-scripts\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-log-httpd\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820110 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-run-httpd\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dgvsq\" (UniqueName: \"kubernetes.io/projected/de390327-3b86-45b5-ae75-d49d23210bfa-kube-api-access-dgvsq\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820258 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-config-data\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.820483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-log-httpd\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.822292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-run-httpd\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.823784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.824106 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.824290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-config-data\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.825135 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-scripts\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.836299 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.839258 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgvsq\" (UniqueName: \"kubernetes.io/projected/de390327-3b86-45b5-ae75-d49d23210bfa-kube-api-access-dgvsq\") pod \"ceilometer-0\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.860066 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.872210 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.906279 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:29 crc kubenswrapper[4769]: I1121 13:15:29.922959 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.023899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-scripts\") pod \"7c3f7a0e-20e7-4571-aa36-738a676580a3\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.023955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-config-data\") pod \"7c3f7a0e-20e7-4571-aa36-738a676580a3\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.024012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-combined-ca-bundle\") pod \"7c3f7a0e-20e7-4571-aa36-738a676580a3\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.024754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fzlg\" (UniqueName: \"kubernetes.io/projected/7c3f7a0e-20e7-4571-aa36-738a676580a3-kube-api-access-2fzlg\") pod \"7c3f7a0e-20e7-4571-aa36-738a676580a3\" (UID: \"7c3f7a0e-20e7-4571-aa36-738a676580a3\") " Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.039115 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3f7a0e-20e7-4571-aa36-738a676580a3-kube-api-access-2fzlg" (OuterVolumeSpecName: "kube-api-access-2fzlg") pod "7c3f7a0e-20e7-4571-aa36-738a676580a3" (UID: "7c3f7a0e-20e7-4571-aa36-738a676580a3"). InnerVolumeSpecName "kube-api-access-2fzlg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.039263 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-scripts" (OuterVolumeSpecName: "scripts") pod "7c3f7a0e-20e7-4571-aa36-738a676580a3" (UID: "7c3f7a0e-20e7-4571-aa36-738a676580a3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.052876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-config-data" (OuterVolumeSpecName: "config-data") pod "7c3f7a0e-20e7-4571-aa36-738a676580a3" (UID: "7c3f7a0e-20e7-4571-aa36-738a676580a3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.060048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7c3f7a0e-20e7-4571-aa36-738a676580a3" (UID: "7c3f7a0e-20e7-4571-aa36-738a676580a3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.126738 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.127220 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.127234 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c3f7a0e-20e7-4571-aa36-738a676580a3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.127248 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2fzlg\" (UniqueName: \"kubernetes.io/projected/7c3f7a0e-20e7-4571-aa36-738a676580a3-kube-api-access-2fzlg\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.356876 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.485130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" event={"ID":"7c3f7a0e-20e7-4571-aa36-738a676580a3","Type":"ContainerDied","Data":"527ed1f86d87c3fbf57421fd9b243acef3016a0171c6f1930617da5dfe0f0ea1"} Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.485182 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="527ed1f86d87c3fbf57421fd9b243acef3016a0171c6f1930617da5dfe0f0ea1" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.485286 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.488891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerStarted","Data":"d447e144c7f5fe7bedbad44cb63ac3f74a8611bf0d05e158ac8b878b4e8f60fb"} Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.493365 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.493401 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.527017 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:15:30 crc kubenswrapper[4769]: E1121 13:15:30.527756 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7c3f7a0e-20e7-4571-aa36-738a676580a3" containerName="nova-cell0-conductor-db-sync" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.527798 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3f7a0e-20e7-4571-aa36-738a676580a3" containerName="nova-cell0-conductor-db-sync" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.528009 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7c3f7a0e-20e7-4571-aa36-738a676580a3" containerName="nova-cell0-conductor-db-sync" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.528806 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.531374 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.531445 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-7nn2b" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.569206 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.637587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.637695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.637851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htncv\" (UniqueName: \"kubernetes.io/projected/62895325-8bb1-4c7a-b517-d7d2b60261b2-kube-api-access-htncv\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.739897 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-htncv\" (UniqueName: \"kubernetes.io/projected/62895325-8bb1-4c7a-b517-d7d2b60261b2-kube-api-access-htncv\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.740008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.740071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.747601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.761552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.767789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-htncv\" (UniqueName: \"kubernetes.io/projected/62895325-8bb1-4c7a-b517-d7d2b60261b2-kube-api-access-htncv\") pod \"nova-cell0-conductor-0\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:30 crc kubenswrapper[4769]: I1121 13:15:30.848964 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:31 crc kubenswrapper[4769]: I1121 13:15:31.319453 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef9f770-c76b-4205-98cc-65aa678eea61" path="/var/lib/kubelet/pods/eef9f770-c76b-4205-98cc-65aa678eea61/volumes" Nov 21 13:15:31 crc kubenswrapper[4769]: I1121 13:15:31.320606 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:15:31 crc kubenswrapper[4769]: I1121 13:15:31.320927 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:15:31 crc kubenswrapper[4769]: W1121 13:15:31.327828 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62895325_8bb1_4c7a_b517_d7d2b60261b2.slice/crio-d5112893054eb8aaf9f48a0be1f580fc39881593b2dbf9c7326b0e6af663f4be WatchSource:0}: Error finding container d5112893054eb8aaf9f48a0be1f580fc39881593b2dbf9c7326b0e6af663f4be: Status 404 returned error can't find the container with id d5112893054eb8aaf9f48a0be1f580fc39881593b2dbf9c7326b0e6af663f4be Nov 21 13:15:31 crc kubenswrapper[4769]: I1121 13:15:31.472276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:31 crc kubenswrapper[4769]: I1121 13:15:31.507873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"62895325-8bb1-4c7a-b517-d7d2b60261b2","Type":"ContainerStarted","Data":"d5112893054eb8aaf9f48a0be1f580fc39881593b2dbf9c7326b0e6af663f4be"} Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.437551 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.456258 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.518690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"62895325-8bb1-4c7a-b517-d7d2b60261b2","Type":"ContainerStarted","Data":"66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697"} Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.518884 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" containerID="cri-o://66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" gracePeriod=30 Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.521097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerStarted","Data":"d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477"} Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.546247 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.546227948 podStartE2EDuration="2.546227948s" podCreationTimestamp="2025-11-21 13:15:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:15:32.540879034 +0000 UTC m=+5091.241540852" watchObservedRunningTime="2025-11-21 13:15:32.546227948 +0000 UTC m=+5091.246889766" Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.898525 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.901099 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.944905 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:32 crc kubenswrapper[4769]: I1121 13:15:32.965757 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:33 crc kubenswrapper[4769]: I1121 13:15:33.534143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerStarted","Data":"8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e"} Nov 21 13:15:33 crc kubenswrapper[4769]: I1121 13:15:33.535287 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:33 crc kubenswrapper[4769]: I1121 13:15:33.535320 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:34 crc kubenswrapper[4769]: I1121 13:15:34.543970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerStarted","Data":"44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d"} Nov 21 13:15:35 crc kubenswrapper[4769]: I1121 13:15:35.555684 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:15:35 crc kubenswrapper[4769]: I1121 13:15:35.555916 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:15:35 crc kubenswrapper[4769]: I1121 13:15:35.730105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:35 crc kubenswrapper[4769]: I1121 13:15:35.813644 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:15:35 crc kubenswrapper[4769]: I1121 13:15:35.849906 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.605994 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerStarted","Data":"efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081"} Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.606578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.606458 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="proxy-httpd" containerID="cri-o://efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081" gracePeriod=30 Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.606498 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="sg-core" containerID="cri-o://44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d" gracePeriod=30 Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.606515 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-notification-agent" containerID="cri-o://8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e" gracePeriod=30 Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.606083 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-central-agent" containerID="cri-o://d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477" gracePeriod=30 Nov 21 13:15:39 crc kubenswrapper[4769]: I1121 13:15:39.628985 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.667069433 podStartE2EDuration="10.628957961s" podCreationTimestamp="2025-11-21 13:15:29 +0000 UTC" firstStartedPulling="2025-11-21 13:15:30.355384928 +0000 UTC m=+5089.056046746" lastFinishedPulling="2025-11-21 13:15:38.317273456 +0000 UTC m=+5097.017935274" observedRunningTime="2025-11-21 13:15:39.626765882 +0000 UTC m=+5098.327427700" watchObservedRunningTime="2025-11-21 13:15:39.628957961 +0000 UTC m=+5098.329619789" Nov 21 13:15:40 crc kubenswrapper[4769]: I1121 13:15:40.618540 4769 generic.go:334] "Generic (PLEG): container finished" podID="de390327-3b86-45b5-ae75-d49d23210bfa" containerID="efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081" exitCode=0 Nov 21 13:15:40 crc kubenswrapper[4769]: I1121 13:15:40.618805 4769 generic.go:334] "Generic (PLEG): container finished" podID="de390327-3b86-45b5-ae75-d49d23210bfa" containerID="44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d" exitCode=2 Nov 21 13:15:40 crc kubenswrapper[4769]: I1121 13:15:40.618819 4769 generic.go:334] "Generic (PLEG): container finished" podID="de390327-3b86-45b5-ae75-d49d23210bfa" containerID="8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e" exitCode=0 Nov 21 13:15:40 crc kubenswrapper[4769]: I1121 13:15:40.618730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerDied","Data":"efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081"} Nov 21 13:15:40 crc kubenswrapper[4769]: I1121 13:15:40.618858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerDied","Data":"44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d"} Nov 21 13:15:40 crc kubenswrapper[4769]: I1121 13:15:40.618874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerDied","Data":"8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e"} Nov 21 13:15:40 crc kubenswrapper[4769]: E1121 13:15:40.852760 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:40 crc kubenswrapper[4769]: E1121 13:15:40.855023 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:40 crc kubenswrapper[4769]: E1121 13:15:40.856946 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:40 crc kubenswrapper[4769]: E1121 13:15:40.857008 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.013621 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-scripts\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-ceilometer-tls-certs\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-config-data\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057722 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgvsq\" (UniqueName: \"kubernetes.io/projected/de390327-3b86-45b5-ae75-d49d23210bfa-kube-api-access-dgvsq\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-run-httpd\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057916 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-sg-core-conf-yaml\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.057981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-log-httpd\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.058047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-combined-ca-bundle\") pod \"de390327-3b86-45b5-ae75-d49d23210bfa\" (UID: \"de390327-3b86-45b5-ae75-d49d23210bfa\") " Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.058474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.058966 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.059296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.064709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de390327-3b86-45b5-ae75-d49d23210bfa-kube-api-access-dgvsq" (OuterVolumeSpecName: "kube-api-access-dgvsq") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "kube-api-access-dgvsq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.066258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-scripts" (OuterVolumeSpecName: "scripts") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.093892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.142644 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.161804 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.161851 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.161886 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dgvsq\" (UniqueName: \"kubernetes.io/projected/de390327-3b86-45b5-ae75-d49d23210bfa-kube-api-access-dgvsq\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.161899 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.161907 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de390327-3b86-45b5-ae75-d49d23210bfa-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.165460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-config-data" (OuterVolumeSpecName: "config-data") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.165559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "de390327-3b86-45b5-ae75-d49d23210bfa" (UID: "de390327-3b86-45b5-ae75-d49d23210bfa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.263906 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.263941 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de390327-3b86-45b5-ae75-d49d23210bfa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.325629 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.325677 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.634590 4769 generic.go:334] "Generic (PLEG): container finished" podID="de390327-3b86-45b5-ae75-d49d23210bfa" containerID="d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477" exitCode=0 Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.634642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerDied","Data":"d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477"} Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.634982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de390327-3b86-45b5-ae75-d49d23210bfa","Type":"ContainerDied","Data":"d447e144c7f5fe7bedbad44cb63ac3f74a8611bf0d05e158ac8b878b4e8f60fb"} Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.635008 4769 scope.go:117] "RemoveContainer" containerID="efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.634670 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.672921 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.677523 4769 scope.go:117] "RemoveContainer" containerID="44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.683671 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.695992 4769 scope.go:117] "RemoveContainer" containerID="8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.717533 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.718395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-central-agent" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718423 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-central-agent" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.718455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="sg-core" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718464 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="sg-core" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.718475 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="proxy-httpd" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718488 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="proxy-httpd" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.718515 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-notification-agent" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718524 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-notification-agent" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718791 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-notification-agent" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718835 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="ceilometer-central-agent" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718852 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="proxy-httpd" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.718864 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" containerName="sg-core" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.721068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.726880 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.726954 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.726880 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.727155 4769 scope.go:117] "RemoveContainer" containerID="d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.730061 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.757371 4769 scope.go:117] "RemoveContainer" containerID="efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.757824 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081\": container with ID starting with efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081 not found: ID does not exist" containerID="efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.757869 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081"} err="failed to get container status \"efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081\": rpc error: code = NotFound desc = could not find container \"efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081\": container with ID starting with efad4646365c00113598672cb42773987050e0a2d1d6753f2641ef10a7577081 not found: ID does not exist" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.757912 4769 scope.go:117] "RemoveContainer" containerID="44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.758356 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d\": container with ID starting with 44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d not found: ID does not exist" containerID="44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.758391 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d"} err="failed to get container status \"44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d\": rpc error: code = NotFound desc = could not find container \"44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d\": container with ID starting with 44113c790068cddfd82148f8ee56e0ee13a247878624b406d712257abe714f3d not found: ID does not exist" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.758421 4769 scope.go:117] "RemoveContainer" containerID="8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.758697 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e\": container with ID starting with 8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e not found: ID does not exist" containerID="8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.758726 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e"} err="failed to get container status \"8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e\": rpc error: code = NotFound desc = could not find container \"8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e\": container with ID starting with 8f28df27a9e1b3b790acec99eb40714002b0b20bdd530d2b97deaeac2726e34e not found: ID does not exist" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.758746 4769 scope.go:117] "RemoveContainer" containerID="d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477" Nov 21 13:15:41 crc kubenswrapper[4769]: E1121 13:15:41.759610 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477\": container with ID starting with d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477 not found: ID does not exist" containerID="d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.759643 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477"} err="failed to get container status \"d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477\": rpc error: code = NotFound desc = could not find container \"d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477\": container with ID starting with d43a5d90a30c143473e5c40fcbd5893f9181248847a3f8c07d3080e8d560e477 not found: ID does not exist" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-scripts\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774259 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-config-data\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-log-httpd\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-run-httpd\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774411 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvx4\" (UniqueName: \"kubernetes.io/projected/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-kube-api-access-rxvx4\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.774441 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-run-httpd\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvx4\" (UniqueName: \"kubernetes.io/projected/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-kube-api-access-rxvx4\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876345 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-scripts\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-config-data\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-log-httpd\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.876965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-log-httpd\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.877179 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-run-httpd\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.881277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.882173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.883623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.884979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-config-data\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.886658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-scripts\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:41 crc kubenswrapper[4769]: I1121 13:15:41.894607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvx4\" (UniqueName: \"kubernetes.io/projected/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-kube-api-access-rxvx4\") pod \"ceilometer-0\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:42 crc kubenswrapper[4769]: I1121 13:15:42.044593 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:42 crc kubenswrapper[4769]: I1121 13:15:42.588645 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:15:42 crc kubenswrapper[4769]: I1121 13:15:42.647407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerStarted","Data":"673c8aed5a959eb9da0ba81eb72e8b0feb8541a30c42286b93c4552850386008"} Nov 21 13:15:43 crc kubenswrapper[4769]: I1121 13:15:43.294247 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de390327-3b86-45b5-ae75-d49d23210bfa" path="/var/lib/kubelet/pods/de390327-3b86-45b5-ae75-d49d23210bfa/volumes" Nov 21 13:15:44 crc kubenswrapper[4769]: I1121 13:15:44.669283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerStarted","Data":"373fee426ce981d8b4d6c516588fe85c5c74ea526b5639bfd63dc1bbaf6b66d3"} Nov 21 13:15:45 crc kubenswrapper[4769]: I1121 13:15:45.693622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerStarted","Data":"8bcd8d8dbba6c26b0086dafb969189b7dc3de28adff923a2f3296cf47801b2e0"} Nov 21 13:15:45 crc kubenswrapper[4769]: E1121 13:15:45.851334 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:45 crc kubenswrapper[4769]: E1121 13:15:45.853059 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:45 crc kubenswrapper[4769]: E1121 13:15:45.854424 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:45 crc kubenswrapper[4769]: E1121 13:15:45.854466 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:15:47 crc kubenswrapper[4769]: I1121 13:15:47.721019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerStarted","Data":"f9ff48c90e20951d40a991958bb636411382fff14b52b8755c847afdfb79a175"} Nov 21 13:15:49 crc kubenswrapper[4769]: I1121 13:15:49.206992 4769 scope.go:117] "RemoveContainer" containerID="8beb2efdbf703007886b1e12a039aea01b3769c293d82fed64504282a9c72cc5" Nov 21 13:15:49 crc kubenswrapper[4769]: I1121 13:15:49.746665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerStarted","Data":"862833f94ed796396988195a731cbbc1aae6f881a153648ce848ccdedc713db1"} Nov 21 13:15:49 crc kubenswrapper[4769]: I1121 13:15:49.747497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:15:50 crc kubenswrapper[4769]: E1121 13:15:50.852172 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:50 crc kubenswrapper[4769]: E1121 13:15:50.854372 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:50 crc kubenswrapper[4769]: E1121 13:15:50.856095 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:50 crc kubenswrapper[4769]: E1121 13:15:50.856147 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:15:55 crc kubenswrapper[4769]: E1121 13:15:55.851166 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:55 crc kubenswrapper[4769]: E1121 13:15:55.853973 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:55 crc kubenswrapper[4769]: E1121 13:15:55.855754 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:15:55 crc kubenswrapper[4769]: E1121 13:15:55.855893 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:16:00 crc kubenswrapper[4769]: E1121 13:16:00.852786 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:16:00 crc kubenswrapper[4769]: E1121 13:16:00.855621 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:16:00 crc kubenswrapper[4769]: E1121 13:16:00.857107 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:16:00 crc kubenswrapper[4769]: E1121 13:16:00.857149 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:16:02 crc kubenswrapper[4769]: I1121 13:16:02.972829 4769 generic.go:334] "Generic (PLEG): container finished" podID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" exitCode=137 Nov 21 13:16:02 crc kubenswrapper[4769]: I1121 13:16:02.972919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"62895325-8bb1-4c7a-b517-d7d2b60261b2","Type":"ContainerDied","Data":"66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697"} Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.592640 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.615860 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=16.428003045 podStartE2EDuration="22.615834311s" podCreationTimestamp="2025-11-21 13:15:41 +0000 UTC" firstStartedPulling="2025-11-21 13:15:42.603337189 +0000 UTC m=+5101.303999007" lastFinishedPulling="2025-11-21 13:15:48.791168445 +0000 UTC m=+5107.491830273" observedRunningTime="2025-11-21 13:15:49.783305842 +0000 UTC m=+5108.483967680" watchObservedRunningTime="2025-11-21 13:16:03.615834311 +0000 UTC m=+5122.316496169" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.728155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htncv\" (UniqueName: \"kubernetes.io/projected/62895325-8bb1-4c7a-b517-d7d2b60261b2-kube-api-access-htncv\") pod \"62895325-8bb1-4c7a-b517-d7d2b60261b2\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.728324 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-config-data\") pod \"62895325-8bb1-4c7a-b517-d7d2b60261b2\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.728401 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-combined-ca-bundle\") pod \"62895325-8bb1-4c7a-b517-d7d2b60261b2\" (UID: \"62895325-8bb1-4c7a-b517-d7d2b60261b2\") " Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.736114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62895325-8bb1-4c7a-b517-d7d2b60261b2-kube-api-access-htncv" (OuterVolumeSpecName: "kube-api-access-htncv") pod "62895325-8bb1-4c7a-b517-d7d2b60261b2" (UID: "62895325-8bb1-4c7a-b517-d7d2b60261b2"). InnerVolumeSpecName "kube-api-access-htncv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.759934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-config-data" (OuterVolumeSpecName: "config-data") pod "62895325-8bb1-4c7a-b517-d7d2b60261b2" (UID: "62895325-8bb1-4c7a-b517-d7d2b60261b2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.761367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "62895325-8bb1-4c7a-b517-d7d2b60261b2" (UID: "62895325-8bb1-4c7a-b517-d7d2b60261b2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.830881 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.830928 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-htncv\" (UniqueName: \"kubernetes.io/projected/62895325-8bb1-4c7a-b517-d7d2b60261b2-kube-api-access-htncv\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.830943 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62895325-8bb1-4c7a-b517-d7d2b60261b2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.986381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"62895325-8bb1-4c7a-b517-d7d2b60261b2","Type":"ContainerDied","Data":"d5112893054eb8aaf9f48a0be1f580fc39881593b2dbf9c7326b0e6af663f4be"} Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.986448 4769 scope.go:117] "RemoveContainer" containerID="66ab2a4b5486b9a6b67fb3c82428f285c0382687f8ffc93cdb7bc8b3d5788697" Nov 21 13:16:03 crc kubenswrapper[4769]: I1121 13:16:03.986560 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.057678 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.076273 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.092276 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:16:04 crc kubenswrapper[4769]: E1121 13:16:04.093080 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.093248 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.093582 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" containerName="nova-cell0-conductor-conductor" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.094340 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.100456 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.100665 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-7nn2b" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.102477 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.241002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.242348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddtdn\" (UniqueName: \"kubernetes.io/projected/e1cda346-6c04-495f-991d-2e081618c5b3-kube-api-access-ddtdn\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.242494 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.344365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.344893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.344948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ddtdn\" (UniqueName: \"kubernetes.io/projected/e1cda346-6c04-495f-991d-2e081618c5b3-kube-api-access-ddtdn\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.355544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.355793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.376511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddtdn\" (UniqueName: \"kubernetes.io/projected/e1cda346-6c04-495f-991d-2e081618c5b3-kube-api-access-ddtdn\") pod \"nova-cell0-conductor-0\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.423932 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:04 crc kubenswrapper[4769]: I1121 13:16:04.923973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:16:04 crc kubenswrapper[4769]: W1121 13:16:04.925975 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1cda346_6c04_495f_991d_2e081618c5b3.slice/crio-8200570c477128db50ce7dd54dcc9b3ba8c8d7bd35353b294ae070d599e6b021 WatchSource:0}: Error finding container 8200570c477128db50ce7dd54dcc9b3ba8c8d7bd35353b294ae070d599e6b021: Status 404 returned error can't find the container with id 8200570c477128db50ce7dd54dcc9b3ba8c8d7bd35353b294ae070d599e6b021 Nov 21 13:16:05 crc kubenswrapper[4769]: I1121 13:16:04.999906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e1cda346-6c04-495f-991d-2e081618c5b3","Type":"ContainerStarted","Data":"8200570c477128db50ce7dd54dcc9b3ba8c8d7bd35353b294ae070d599e6b021"} Nov 21 13:16:05 crc kubenswrapper[4769]: I1121 13:16:05.291549 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62895325-8bb1-4c7a-b517-d7d2b60261b2" path="/var/lib/kubelet/pods/62895325-8bb1-4c7a-b517-d7d2b60261b2/volumes" Nov 21 13:16:06 crc kubenswrapper[4769]: I1121 13:16:06.016603 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e1cda346-6c04-495f-991d-2e081618c5b3","Type":"ContainerStarted","Data":"0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7"} Nov 21 13:16:06 crc kubenswrapper[4769]: I1121 13:16:06.016990 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:06 crc kubenswrapper[4769]: I1121 13:16:06.063632 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.063612792 podStartE2EDuration="2.063612792s" podCreationTimestamp="2025-11-21 13:16:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:06.055683679 +0000 UTC m=+5124.756345537" watchObservedRunningTime="2025-11-21 13:16:06.063612792 +0000 UTC m=+5124.764274630" Nov 21 13:16:11 crc kubenswrapper[4769]: I1121 13:16:11.324936 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:16:11 crc kubenswrapper[4769]: I1121 13:16:11.325618 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:16:12 crc kubenswrapper[4769]: I1121 13:16:12.056775 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.455160 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.872613 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64"] Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.875456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.879043 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.879800 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.882648 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64"] Nov 21 13:16:14 crc kubenswrapper[4769]: I1121 13:16:14.999516 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.008429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.011954 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.025221 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.026726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.030119 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.044739 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.049848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.049909 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-config-data\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.049931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-scripts\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.049958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkpq\" (UniqueName: \"kubernetes.io/projected/ad71458a-e543-4b79-9748-40c0cc2aca18-kube-api-access-mrkpq\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.093702 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.161065 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.173855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-config-data\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.173898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-scripts\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.174546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-config-data\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.174626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkpq\" (UniqueName: \"kubernetes.io/projected/ad71458a-e543-4b79-9748-40c0cc2aca18-kube-api-access-mrkpq\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4dcbeb88-eaad-4314-9e14-86bc51557689-logs\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175476 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2fms\" (UniqueName: \"kubernetes.io/projected/4dcbeb88-eaad-4314-9e14-86bc51557689-kube-api-access-q2fms\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.175791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skj2\" (UniqueName: \"kubernetes.io/projected/a4de1341-4848-48c5-aea7-94faf07b17e3-kube-api-access-8skj2\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.176071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.182652 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.188606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-scripts\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.194247 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.207166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkpq\" (UniqueName: \"kubernetes.io/projected/ad71458a-e543-4b79-9748-40c0cc2aca18-kube-api-access-mrkpq\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.212328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-config-data\") pod \"nova-cell0-cell-mapping-hdv64\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.232882 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.247145 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.248881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.251258 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.259773 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.279205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.279283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.279932 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nxx2\" (UniqueName: \"kubernetes.io/projected/0aef1000-7461-4483-9ea6-91f76d6f6f43-kube-api-access-6nxx2\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.279980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4dcbeb88-eaad-4314-9e14-86bc51557689-logs\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.280669 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.280721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.280805 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.280829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-config-data\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.280899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q2fms\" (UniqueName: \"kubernetes.io/projected/4dcbeb88-eaad-4314-9e14-86bc51557689-kube-api-access-q2fms\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.280980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4dcbeb88-eaad-4314-9e14-86bc51557689-logs\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.281016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8skj2\" (UniqueName: \"kubernetes.io/projected/a4de1341-4848-48c5-aea7-94faf07b17e3-kube-api-access-8skj2\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.281074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-config-data\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.281128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-config-data\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.281238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0aef1000-7461-4483-9ea6-91f76d6f6f43-logs\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.281263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh6gb\" (UniqueName: \"kubernetes.io/projected/5e3437f8-aef3-493b-a04f-8ff9c8242470-kube-api-access-gh6gb\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.285425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-config-data\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.287102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.290787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.296519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.301758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2fms\" (UniqueName: \"kubernetes.io/projected/4dcbeb88-eaad-4314-9e14-86bc51557689-kube-api-access-q2fms\") pod \"nova-api-0\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.305747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skj2\" (UniqueName: \"kubernetes.io/projected/a4de1341-4848-48c5-aea7-94faf07b17e3-kube-api-access-8skj2\") pod \"nova-cell1-novncproxy-0\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.340728 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.372325 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6nxx2\" (UniqueName: \"kubernetes.io/projected/0aef1000-7461-4483-9ea6-91f76d6f6f43-kube-api-access-6nxx2\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384448 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-config-data\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-config-data\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0aef1000-7461-4483-9ea6-91f76d6f6f43-logs\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gh6gb\" (UniqueName: \"kubernetes.io/projected/5e3437f8-aef3-493b-a04f-8ff9c8242470-kube-api-access-gh6gb\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.384663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.385533 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0aef1000-7461-4483-9ea6-91f76d6f6f43-logs\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.389029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-config-data\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.389237 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.398434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-config-data\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.400007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.403036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh6gb\" (UniqueName: \"kubernetes.io/projected/5e3437f8-aef3-493b-a04f-8ff9c8242470-kube-api-access-gh6gb\") pod \"nova-scheduler-0\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.404164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nxx2\" (UniqueName: \"kubernetes.io/projected/0aef1000-7461-4483-9ea6-91f76d6f6f43-kube-api-access-6nxx2\") pod \"nova-metadata-0\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.418277 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.429656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.501546 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:15 crc kubenswrapper[4769]: I1121 13:16:15.901594 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:16 crc kubenswrapper[4769]: W1121 13:16:16.018104 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4de1341_4848_48c5_aea7_94faf07b17e3.slice/crio-976f6eada937fe2c2f95c124e9d8f42234339db785d64a02c56d363bd6a9481f WatchSource:0}: Error finding container 976f6eada937fe2c2f95c124e9d8f42234339db785d64a02c56d363bd6a9481f: Status 404 returned error can't find the container with id 976f6eada937fe2c2f95c124e9d8f42234339db785d64a02c56d363bd6a9481f Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.024489 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.072527 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6"] Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.074278 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.078851 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.079035 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.092781 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6"] Nov 21 13:16:16 crc kubenswrapper[4769]: W1121 13:16:16.117422 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aef1000_7461_4483_9ea6_91f76d6f6f43.slice/crio-8c5f0f527434172e917ace6be83258c4a0f94028bb1e5a73553f2af9866a8747 WatchSource:0}: Error finding container 8c5f0f527434172e917ace6be83258c4a0f94028bb1e5a73553f2af9866a8747: Status 404 returned error can't find the container with id 8c5f0f527434172e917ace6be83258c4a0f94028bb1e5a73553f2af9866a8747 Nov 21 13:16:16 crc kubenswrapper[4769]: W1121 13:16:16.133236 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad71458a_e543_4b79_9748_40c0cc2aca18.slice/crio-db89a984f78bc7542678242a09fa852a2cb3dfee5d743d2f5239e4852b318419 WatchSource:0}: Error finding container db89a984f78bc7542678242a09fa852a2cb3dfee5d743d2f5239e4852b318419: Status 404 returned error can't find the container with id db89a984f78bc7542678242a09fa852a2cb3dfee5d743d2f5239e4852b318419 Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.135212 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.148127 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.155751 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64"] Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.199696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"0aef1000-7461-4483-9ea6-91f76d6f6f43","Type":"ContainerStarted","Data":"8c5f0f527434172e917ace6be83258c4a0f94028bb1e5a73553f2af9866a8747"} Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.201373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4dcbeb88-eaad-4314-9e14-86bc51557689","Type":"ContainerStarted","Data":"78bf7239cb0ecdacba33efaab863196741b88b2bfa0c8f29a7b6f068a2c54609"} Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.201400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4dcbeb88-eaad-4314-9e14-86bc51557689","Type":"ContainerStarted","Data":"2cdd1a94b4b15cf39dbc87e2be040a9a4603e1ebfe5d7173287907413094bbe5"} Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.203398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" event={"ID":"ad71458a-e543-4b79-9748-40c0cc2aca18","Type":"ContainerStarted","Data":"db89a984f78bc7542678242a09fa852a2cb3dfee5d743d2f5239e4852b318419"} Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.204856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a4de1341-4848-48c5-aea7-94faf07b17e3","Type":"ContainerStarted","Data":"976f6eada937fe2c2f95c124e9d8f42234339db785d64a02c56d363bd6a9481f"} Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.207341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-scripts\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.207429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.207499 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-config-data\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.207646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72v97\" (UniqueName: \"kubernetes.io/projected/63079ec2-d114-482b-944a-39b1cc0a9315-kube-api-access-72v97\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.207828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5e3437f8-aef3-493b-a04f-8ff9c8242470","Type":"ContainerStarted","Data":"4f350e8ef0868aa55dbbd5b8809f52db9859b76c01fdd25996d6856f85b57303"} Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.308854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-72v97\" (UniqueName: \"kubernetes.io/projected/63079ec2-d114-482b-944a-39b1cc0a9315-kube-api-access-72v97\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.309134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-scripts\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.309215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.309250 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-config-data\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.313305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-config-data\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.314712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-scripts\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.324384 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.326813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-72v97\" (UniqueName: \"kubernetes.io/projected/63079ec2-d114-482b-944a-39b1cc0a9315-kube-api-access-72v97\") pod \"nova-cell1-conductor-db-sync-vzgj6\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.409182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:16 crc kubenswrapper[4769]: W1121 13:16:16.926732 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63079ec2_d114_482b_944a_39b1cc0a9315.slice/crio-3a107a47c930aafeebba2e7e6dd40b2914e74470bdac458e59ee72e58ed4f49e WatchSource:0}: Error finding container 3a107a47c930aafeebba2e7e6dd40b2914e74470bdac458e59ee72e58ed4f49e: Status 404 returned error can't find the container with id 3a107a47c930aafeebba2e7e6dd40b2914e74470bdac458e59ee72e58ed4f49e Nov 21 13:16:16 crc kubenswrapper[4769]: I1121 13:16:16.932314 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6"] Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.219786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5e3437f8-aef3-493b-a04f-8ff9c8242470","Type":"ContainerStarted","Data":"d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.222594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" event={"ID":"63079ec2-d114-482b-944a-39b1cc0a9315","Type":"ContainerStarted","Data":"dee302c5a15e1d9b0d6f92858045b699f67ffd3afe54fc55ef37f0d66d8196d3"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.222634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" event={"ID":"63079ec2-d114-482b-944a-39b1cc0a9315","Type":"ContainerStarted","Data":"3a107a47c930aafeebba2e7e6dd40b2914e74470bdac458e59ee72e58ed4f49e"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.235739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"0aef1000-7461-4483-9ea6-91f76d6f6f43","Type":"ContainerStarted","Data":"1fa7aee4e3776feccc0b707990cb87c432731db08c37b4f075fa6b5afa8ad232"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.236521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"0aef1000-7461-4483-9ea6-91f76d6f6f43","Type":"ContainerStarted","Data":"4c0e54d17eb5d298d18c44aba1a84d5f8655663dc0593fa6a133ca791f91ecf6"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.244467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4dcbeb88-eaad-4314-9e14-86bc51557689","Type":"ContainerStarted","Data":"fa9bb110fcf19a16f46303963e1edd45f4a5f17dd6ceea774370c3314dc67335"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.247558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" event={"ID":"ad71458a-e543-4b79-9748-40c0cc2aca18","Type":"ContainerStarted","Data":"068275a2815c982d25c891b31f773852d583ba4f3d17fd64adb156cafde10846"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.264617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a4de1341-4848-48c5-aea7-94faf07b17e3","Type":"ContainerStarted","Data":"824b077c66d51373f46d3362e19d7f8f6d20c47ed0b4f9e5ec8b1cd580150d2c"} Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.266996 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.266979253 podStartE2EDuration="2.266979253s" podCreationTimestamp="2025-11-21 13:16:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:17.236955335 +0000 UTC m=+5135.937617153" watchObservedRunningTime="2025-11-21 13:16:17.266979253 +0000 UTC m=+5135.967641061" Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.298117 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.298095622 podStartE2EDuration="2.298095622s" podCreationTimestamp="2025-11-21 13:16:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:17.257746385 +0000 UTC m=+5135.958408203" watchObservedRunningTime="2025-11-21 13:16:17.298095622 +0000 UTC m=+5135.998757440" Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.305376 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" podStartSLOduration=1.3053576470000001 podStartE2EDuration="1.305357647s" podCreationTimestamp="2025-11-21 13:16:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:17.273723115 +0000 UTC m=+5135.974384943" watchObservedRunningTime="2025-11-21 13:16:17.305357647 +0000 UTC m=+5136.006019485" Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.340372 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" podStartSLOduration=3.34034883 podStartE2EDuration="3.34034883s" podCreationTimestamp="2025-11-21 13:16:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:17.288099312 +0000 UTC m=+5135.988761150" watchObservedRunningTime="2025-11-21 13:16:17.34034883 +0000 UTC m=+5136.041010648" Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.373674 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.373658037 podStartE2EDuration="3.373658037s" podCreationTimestamp="2025-11-21 13:16:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:17.329339403 +0000 UTC m=+5136.030001231" watchObservedRunningTime="2025-11-21 13:16:17.373658037 +0000 UTC m=+5136.074319855" Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.381233 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.381213561 podStartE2EDuration="3.381213561s" podCreationTimestamp="2025-11-21 13:16:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:17.351223883 +0000 UTC m=+5136.051885711" watchObservedRunningTime="2025-11-21 13:16:17.381213561 +0000 UTC m=+5136.081875379" Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.718371 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:17 crc kubenswrapper[4769]: I1121 13:16:17.743511 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:19 crc kubenswrapper[4769]: I1121 13:16:19.282819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="a4de1341-4848-48c5-aea7-94faf07b17e3" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://824b077c66d51373f46d3362e19d7f8f6d20c47ed0b4f9e5ec8b1cd580150d2c" gracePeriod=30 Nov 21 13:16:19 crc kubenswrapper[4769]: I1121 13:16:19.282898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-log" containerID="cri-o://4c0e54d17eb5d298d18c44aba1a84d5f8655663dc0593fa6a133ca791f91ecf6" gracePeriod=30 Nov 21 13:16:19 crc kubenswrapper[4769]: I1121 13:16:19.282945 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-metadata" containerID="cri-o://1fa7aee4e3776feccc0b707990cb87c432731db08c37b4f075fa6b5afa8ad232" gracePeriod=30 Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.318013 4769 generic.go:334] "Generic (PLEG): container finished" podID="63079ec2-d114-482b-944a-39b1cc0a9315" containerID="dee302c5a15e1d9b0d6f92858045b699f67ffd3afe54fc55ef37f0d66d8196d3" exitCode=0 Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.318386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" event={"ID":"63079ec2-d114-482b-944a-39b1cc0a9315","Type":"ContainerDied","Data":"dee302c5a15e1d9b0d6f92858045b699f67ffd3afe54fc55ef37f0d66d8196d3"} Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.322573 4769 generic.go:334] "Generic (PLEG): container finished" podID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerID="1fa7aee4e3776feccc0b707990cb87c432731db08c37b4f075fa6b5afa8ad232" exitCode=0 Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.322645 4769 generic.go:334] "Generic (PLEG): container finished" podID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerID="4c0e54d17eb5d298d18c44aba1a84d5f8655663dc0593fa6a133ca791f91ecf6" exitCode=143 Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.322710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"0aef1000-7461-4483-9ea6-91f76d6f6f43","Type":"ContainerDied","Data":"1fa7aee4e3776feccc0b707990cb87c432731db08c37b4f075fa6b5afa8ad232"} Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.322747 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"0aef1000-7461-4483-9ea6-91f76d6f6f43","Type":"ContainerDied","Data":"4c0e54d17eb5d298d18c44aba1a84d5f8655663dc0593fa6a133ca791f91ecf6"} Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.325166 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4de1341-4848-48c5-aea7-94faf07b17e3" containerID="824b077c66d51373f46d3362e19d7f8f6d20c47ed0b4f9e5ec8b1cd580150d2c" exitCode=0 Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.325228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a4de1341-4848-48c5-aea7-94faf07b17e3","Type":"ContainerDied","Data":"824b077c66d51373f46d3362e19d7f8f6d20c47ed0b4f9e5ec8b1cd580150d2c"} Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.373716 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.419603 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.431380 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.431423 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.683152 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.693018 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.817867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-combined-ca-bundle\") pod \"a4de1341-4848-48c5-aea7-94faf07b17e3\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.818213 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-config-data\") pod \"a4de1341-4848-48c5-aea7-94faf07b17e3\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.818334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0aef1000-7461-4483-9ea6-91f76d6f6f43-logs\") pod \"0aef1000-7461-4483-9ea6-91f76d6f6f43\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.818528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8skj2\" (UniqueName: \"kubernetes.io/projected/a4de1341-4848-48c5-aea7-94faf07b17e3-kube-api-access-8skj2\") pod \"a4de1341-4848-48c5-aea7-94faf07b17e3\" (UID: \"a4de1341-4848-48c5-aea7-94faf07b17e3\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.818725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nxx2\" (UniqueName: \"kubernetes.io/projected/0aef1000-7461-4483-9ea6-91f76d6f6f43-kube-api-access-6nxx2\") pod \"0aef1000-7461-4483-9ea6-91f76d6f6f43\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.818731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0aef1000-7461-4483-9ea6-91f76d6f6f43-logs" (OuterVolumeSpecName: "logs") pod "0aef1000-7461-4483-9ea6-91f76d6f6f43" (UID: "0aef1000-7461-4483-9ea6-91f76d6f6f43"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.818957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-combined-ca-bundle\") pod \"0aef1000-7461-4483-9ea6-91f76d6f6f43\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.819064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-config-data\") pod \"0aef1000-7461-4483-9ea6-91f76d6f6f43\" (UID: \"0aef1000-7461-4483-9ea6-91f76d6f6f43\") " Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.819640 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0aef1000-7461-4483-9ea6-91f76d6f6f43-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.835841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4de1341-4848-48c5-aea7-94faf07b17e3-kube-api-access-8skj2" (OuterVolumeSpecName: "kube-api-access-8skj2") pod "a4de1341-4848-48c5-aea7-94faf07b17e3" (UID: "a4de1341-4848-48c5-aea7-94faf07b17e3"). InnerVolumeSpecName "kube-api-access-8skj2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.835887 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aef1000-7461-4483-9ea6-91f76d6f6f43-kube-api-access-6nxx2" (OuterVolumeSpecName: "kube-api-access-6nxx2") pod "0aef1000-7461-4483-9ea6-91f76d6f6f43" (UID: "0aef1000-7461-4483-9ea6-91f76d6f6f43"). InnerVolumeSpecName "kube-api-access-6nxx2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.850739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-config-data" (OuterVolumeSpecName: "config-data") pod "0aef1000-7461-4483-9ea6-91f76d6f6f43" (UID: "0aef1000-7461-4483-9ea6-91f76d6f6f43"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.852683 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a4de1341-4848-48c5-aea7-94faf07b17e3" (UID: "a4de1341-4848-48c5-aea7-94faf07b17e3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.853350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-config-data" (OuterVolumeSpecName: "config-data") pod "a4de1341-4848-48c5-aea7-94faf07b17e3" (UID: "a4de1341-4848-48c5-aea7-94faf07b17e3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.860113 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0aef1000-7461-4483-9ea6-91f76d6f6f43" (UID: "0aef1000-7461-4483-9ea6-91f76d6f6f43"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.921527 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.921802 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a4de1341-4848-48c5-aea7-94faf07b17e3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.921812 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8skj2\" (UniqueName: \"kubernetes.io/projected/a4de1341-4848-48c5-aea7-94faf07b17e3-kube-api-access-8skj2\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.921824 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6nxx2\" (UniqueName: \"kubernetes.io/projected/0aef1000-7461-4483-9ea6-91f76d6f6f43-kube-api-access-6nxx2\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.921833 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:20 crc kubenswrapper[4769]: I1121 13:16:20.921843 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0aef1000-7461-4483-9ea6-91f76d6f6f43-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.343216 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.343213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"a4de1341-4848-48c5-aea7-94faf07b17e3","Type":"ContainerDied","Data":"976f6eada937fe2c2f95c124e9d8f42234339db785d64a02c56d363bd6a9481f"} Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.343395 4769 scope.go:117] "RemoveContainer" containerID="824b077c66d51373f46d3362e19d7f8f6d20c47ed0b4f9e5ec8b1cd580150d2c" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.353348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"0aef1000-7461-4483-9ea6-91f76d6f6f43","Type":"ContainerDied","Data":"8c5f0f527434172e917ace6be83258c4a0f94028bb1e5a73553f2af9866a8747"} Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.353414 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.389410 4769 scope.go:117] "RemoveContainer" containerID="1fa7aee4e3776feccc0b707990cb87c432731db08c37b4f075fa6b5afa8ad232" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.405258 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.447715 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.479396 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.479431 4769 scope.go:117] "RemoveContainer" containerID="4c0e54d17eb5d298d18c44aba1a84d5f8655663dc0593fa6a133ca791f91ecf6" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.500969 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.514839 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: E1121 13:16:21.515297 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-metadata" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.515313 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-metadata" Nov 21 13:16:21 crc kubenswrapper[4769]: E1121 13:16:21.515328 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4de1341-4848-48c5-aea7-94faf07b17e3" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.515334 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4de1341-4848-48c5-aea7-94faf07b17e3" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:16:21 crc kubenswrapper[4769]: E1121 13:16:21.515368 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-log" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.515375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-log" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.515582 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4de1341-4848-48c5-aea7-94faf07b17e3" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.515610 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-metadata" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.515618 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" containerName="nova-metadata-log" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.523994 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.526228 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.526425 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.526553 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.530915 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.542275 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.544127 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.547469 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.547519 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.551501 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f011aa-da5a-495d-8733-d24acbb608fe-logs\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640281 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6grr\" (UniqueName: \"kubernetes.io/projected/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-kube-api-access-m6grr\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640382 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640411 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-config-data\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640517 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrfj\" (UniqueName: \"kubernetes.io/projected/25f011aa-da5a-495d-8733-d24acbb608fe-kube-api-access-6hrfj\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.640556 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m6grr\" (UniqueName: \"kubernetes.io/projected/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-kube-api-access-m6grr\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-config-data\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrfj\" (UniqueName: \"kubernetes.io/projected/25f011aa-da5a-495d-8733-d24acbb608fe-kube-api-access-6hrfj\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.742863 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f011aa-da5a-495d-8733-d24acbb608fe-logs\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.743518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f011aa-da5a-495d-8733-d24acbb608fe-logs\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.748707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.749915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.750592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.750749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.750990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-config-data\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.753014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.754810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.759969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6grr\" (UniqueName: \"kubernetes.io/projected/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-kube-api-access-m6grr\") pod \"nova-cell1-novncproxy-0\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.761455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrfj\" (UniqueName: \"kubernetes.io/projected/25f011aa-da5a-495d-8733-d24acbb608fe-kube-api-access-6hrfj\") pod \"nova-metadata-0\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.833951 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.853539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.869538 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.945709 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72v97\" (UniqueName: \"kubernetes.io/projected/63079ec2-d114-482b-944a-39b1cc0a9315-kube-api-access-72v97\") pod \"63079ec2-d114-482b-944a-39b1cc0a9315\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.945920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-scripts\") pod \"63079ec2-d114-482b-944a-39b1cc0a9315\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.946002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-config-data\") pod \"63079ec2-d114-482b-944a-39b1cc0a9315\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.946053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-combined-ca-bundle\") pod \"63079ec2-d114-482b-944a-39b1cc0a9315\" (UID: \"63079ec2-d114-482b-944a-39b1cc0a9315\") " Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.949963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63079ec2-d114-482b-944a-39b1cc0a9315-kube-api-access-72v97" (OuterVolumeSpecName: "kube-api-access-72v97") pod "63079ec2-d114-482b-944a-39b1cc0a9315" (UID: "63079ec2-d114-482b-944a-39b1cc0a9315"). InnerVolumeSpecName "kube-api-access-72v97". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.955504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-scripts" (OuterVolumeSpecName: "scripts") pod "63079ec2-d114-482b-944a-39b1cc0a9315" (UID: "63079ec2-d114-482b-944a-39b1cc0a9315"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:21 crc kubenswrapper[4769]: I1121 13:16:21.982437 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "63079ec2-d114-482b-944a-39b1cc0a9315" (UID: "63079ec2-d114-482b-944a-39b1cc0a9315"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.005384 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-config-data" (OuterVolumeSpecName: "config-data") pod "63079ec2-d114-482b-944a-39b1cc0a9315" (UID: "63079ec2-d114-482b-944a-39b1cc0a9315"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.048366 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.048660 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.048678 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-72v97\" (UniqueName: \"kubernetes.io/projected/63079ec2-d114-482b-944a-39b1cc0a9315-kube-api-access-72v97\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.048686 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/63079ec2-d114-482b-944a-39b1cc0a9315-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.373079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" event={"ID":"63079ec2-d114-482b-944a-39b1cc0a9315","Type":"ContainerDied","Data":"3a107a47c930aafeebba2e7e6dd40b2914e74470bdac458e59ee72e58ed4f49e"} Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.373143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.373142 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a107a47c930aafeebba2e7e6dd40b2914e74470bdac458e59ee72e58ed4f49e" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.403737 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.415296 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.435979 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:16:22 crc kubenswrapper[4769]: E1121 13:16:22.436385 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="63079ec2-d114-482b-944a-39b1cc0a9315" containerName="nova-cell1-conductor-db-sync" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.436403 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="63079ec2-d114-482b-944a-39b1cc0a9315" containerName="nova-cell1-conductor-db-sync" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.436626 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="63079ec2-d114-482b-944a-39b1cc0a9315" containerName="nova-cell1-conductor-db-sync" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.437227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.443260 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.447673 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.544267 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-76ckk"] Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.546751 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.557304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-76ckk"] Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.558287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kb6f\" (UniqueName: \"kubernetes.io/projected/d830c7b1-a218-4975-9ad3-75515bb3aa1c-kube-api-access-4kb6f\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.558381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.558434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.660777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v4n4\" (UniqueName: \"kubernetes.io/projected/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-kube-api-access-6v4n4\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.660874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.660924 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-utilities\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.660944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.661019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-catalog-content\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.661061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4kb6f\" (UniqueName: \"kubernetes.io/projected/d830c7b1-a218-4975-9ad3-75515bb3aa1c-kube-api-access-4kb6f\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.664302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.665045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.675811 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kb6f\" (UniqueName: \"kubernetes.io/projected/d830c7b1-a218-4975-9ad3-75515bb3aa1c-kube-api-access-4kb6f\") pod \"nova-cell1-conductor-0\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.763353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6v4n4\" (UniqueName: \"kubernetes.io/projected/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-kube-api-access-6v4n4\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.763793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-utilities\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.763946 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-catalog-content\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.764893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-utilities\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.764910 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-catalog-content\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.783038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v4n4\" (UniqueName: \"kubernetes.io/projected/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-kube-api-access-6v4n4\") pod \"community-operators-76ckk\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.825375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:22 crc kubenswrapper[4769]: I1121 13:16:22.882877 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.290593 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aef1000-7461-4483-9ea6-91f76d6f6f43" path="/var/lib/kubelet/pods/0aef1000-7461-4483-9ea6-91f76d6f6f43/volumes" Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.298083 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4de1341-4848-48c5-aea7-94faf07b17e3" path="/var/lib/kubelet/pods/a4de1341-4848-48c5-aea7-94faf07b17e3/volumes" Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.364324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.392387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f011aa-da5a-495d-8733-d24acbb608fe","Type":"ContainerStarted","Data":"ee8df9a7cead496cabccf3d955a9dc6342c16605b82173a5ad40ac314a5967f8"} Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.392433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f011aa-da5a-495d-8733-d24acbb608fe","Type":"ContainerStarted","Data":"6cea1826cb2c0a70a920f847868f810dd0f16f441b04a1db9ef514a17da241f9"} Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.393546 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad71458a-e543-4b79-9748-40c0cc2aca18" containerID="068275a2815c982d25c891b31f773852d583ba4f3d17fd64adb156cafde10846" exitCode=0 Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.393604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" event={"ID":"ad71458a-e543-4b79-9748-40c0cc2aca18","Type":"ContainerDied","Data":"068275a2815c982d25c891b31f773852d583ba4f3d17fd64adb156cafde10846"} Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.395229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c","Type":"ContainerStarted","Data":"a24f4fb6172451971f4e6d321a2dd78cac444c6c9b9e607b80b89fe2829d4afc"} Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.395256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c","Type":"ContainerStarted","Data":"34bf3af8f4ffc7a4449abb12ec33861f026f6d58ab9299df41ed26fc76791997"} Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.499491 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.499471122 podStartE2EDuration="2.499471122s" podCreationTimestamp="2025-11-21 13:16:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:23.477014257 +0000 UTC m=+5142.177676075" watchObservedRunningTime="2025-11-21 13:16:23.499471122 +0000 UTC m=+5142.200132940" Nov 21 13:16:23 crc kubenswrapper[4769]: I1121 13:16:23.523762 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-76ckk"] Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.418624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d830c7b1-a218-4975-9ad3-75515bb3aa1c","Type":"ContainerStarted","Data":"ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49"} Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.419130 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.419153 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d830c7b1-a218-4975-9ad3-75515bb3aa1c","Type":"ContainerStarted","Data":"9fb871381a53864c5ab24b651186bdff14a2457388967b3d5ee0c6a5fd9919dd"} Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.420762 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerID="69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1" exitCode=0 Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.420876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerDied","Data":"69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1"} Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.420914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerStarted","Data":"eda10b5fd48b89c8d2e7099b5b93b0f1b70349cbd51397136ad0c343eb1daee6"} Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.423666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f011aa-da5a-495d-8733-d24acbb608fe","Type":"ContainerStarted","Data":"58ca3f8d4d029416078377fe2d90d66e62fc6ac0bb5c87e1c14df1d12db253fb"} Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.448757 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.448741235 podStartE2EDuration="2.448741235s" podCreationTimestamp="2025-11-21 13:16:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:24.437608645 +0000 UTC m=+5143.138270463" watchObservedRunningTime="2025-11-21 13:16:24.448741235 +0000 UTC m=+5143.149403053" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.491331 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.491310002 podStartE2EDuration="3.491310002s" podCreationTimestamp="2025-11-21 13:16:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:24.48977661 +0000 UTC m=+5143.190438448" watchObservedRunningTime="2025-11-21 13:16:24.491310002 +0000 UTC m=+5143.191971840" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.829675 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.933613 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrkpq\" (UniqueName: \"kubernetes.io/projected/ad71458a-e543-4b79-9748-40c0cc2aca18-kube-api-access-mrkpq\") pod \"ad71458a-e543-4b79-9748-40c0cc2aca18\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.933760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-combined-ca-bundle\") pod \"ad71458a-e543-4b79-9748-40c0cc2aca18\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.933817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-scripts\") pod \"ad71458a-e543-4b79-9748-40c0cc2aca18\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.934028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-config-data\") pod \"ad71458a-e543-4b79-9748-40c0cc2aca18\" (UID: \"ad71458a-e543-4b79-9748-40c0cc2aca18\") " Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.939590 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-scripts" (OuterVolumeSpecName: "scripts") pod "ad71458a-e543-4b79-9748-40c0cc2aca18" (UID: "ad71458a-e543-4b79-9748-40c0cc2aca18"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.940431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad71458a-e543-4b79-9748-40c0cc2aca18-kube-api-access-mrkpq" (OuterVolumeSpecName: "kube-api-access-mrkpq") pod "ad71458a-e543-4b79-9748-40c0cc2aca18" (UID: "ad71458a-e543-4b79-9748-40c0cc2aca18"). InnerVolumeSpecName "kube-api-access-mrkpq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.984345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad71458a-e543-4b79-9748-40c0cc2aca18" (UID: "ad71458a-e543-4b79-9748-40c0cc2aca18"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:24 crc kubenswrapper[4769]: I1121 13:16:24.986664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-config-data" (OuterVolumeSpecName: "config-data") pod "ad71458a-e543-4b79-9748-40c0cc2aca18" (UID: "ad71458a-e543-4b79-9748-40c0cc2aca18"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.036953 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.036999 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mrkpq\" (UniqueName: \"kubernetes.io/projected/ad71458a-e543-4b79-9748-40c0cc2aca18-kube-api-access-mrkpq\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.037016 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.037029 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad71458a-e543-4b79-9748-40c0cc2aca18-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.343143 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.343553 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.419532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.438844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" event={"ID":"ad71458a-e543-4b79-9748-40c0cc2aca18","Type":"ContainerDied","Data":"db89a984f78bc7542678242a09fa852a2cb3dfee5d743d2f5239e4852b318419"} Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.438898 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db89a984f78bc7542678242a09fa852a2cb3dfee5d743d2f5239e4852b318419" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.439505 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.479500 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.520956 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.627324 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:25 crc kubenswrapper[4769]: I1121 13:16:25.674831 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.085671 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.385359 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.28:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.427325 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.28:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.450103 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-log" containerID="cri-o://78bf7239cb0ecdacba33efaab863196741b88b2bfa0c8f29a7b6f068a2c54609" gracePeriod=30 Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.451995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerStarted","Data":"a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb"} Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.452879 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-log" containerID="cri-o://ee8df9a7cead496cabccf3d955a9dc6342c16605b82173a5ad40ac314a5967f8" gracePeriod=30 Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.454104 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-api" containerID="cri-o://fa9bb110fcf19a16f46303963e1edd45f4a5f17dd6ceea774370c3314dc67335" gracePeriod=30 Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.454345 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-metadata" containerID="cri-o://58ca3f8d4d029416078377fe2d90d66e62fc6ac0bb5c87e1c14df1d12db253fb" gracePeriod=30 Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.544130 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-4qgbh"] Nov 21 13:16:26 crc kubenswrapper[4769]: E1121 13:16:26.544532 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad71458a-e543-4b79-9748-40c0cc2aca18" containerName="nova-manage" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.544548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad71458a-e543-4b79-9748-40c0cc2aca18" containerName="nova-manage" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.544754 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad71458a-e543-4b79-9748-40c0cc2aca18" containerName="nova-manage" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.546206 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.558511 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-4qgbh"] Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.588155 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwpzf\" (UniqueName: \"kubernetes.io/projected/1791c01a-d642-432a-a96e-39436b4de482-kube-api-access-dwpzf\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.588303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-utilities\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.588326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-catalog-content\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.689535 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dwpzf\" (UniqueName: \"kubernetes.io/projected/1791c01a-d642-432a-a96e-39436b4de482-kube-api-access-dwpzf\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.689640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-utilities\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.689661 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-catalog-content\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.690133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-catalog-content\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.690419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-utilities\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.709919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwpzf\" (UniqueName: \"kubernetes.io/projected/1791c01a-d642-432a-a96e-39436b4de482-kube-api-access-dwpzf\") pod \"redhat-operators-4qgbh\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.855217 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.870801 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.870847 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:26 crc kubenswrapper[4769]: I1121 13:16:26.872242 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.368805 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-4qgbh"] Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.463755 4769 generic.go:334] "Generic (PLEG): container finished" podID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerID="78bf7239cb0ecdacba33efaab863196741b88b2bfa0c8f29a7b6f068a2c54609" exitCode=143 Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.463841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4dcbeb88-eaad-4314-9e14-86bc51557689","Type":"ContainerDied","Data":"78bf7239cb0ecdacba33efaab863196741b88b2bfa0c8f29a7b6f068a2c54609"} Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.465612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerStarted","Data":"6853af6e7d0d8fe8f42cf1e474a799349d46ff6943384a89afe70c5573f188e9"} Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.467841 4769 generic.go:334] "Generic (PLEG): container finished" podID="25f011aa-da5a-495d-8733-d24acbb608fe" containerID="58ca3f8d4d029416078377fe2d90d66e62fc6ac0bb5c87e1c14df1d12db253fb" exitCode=0 Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.467888 4769 generic.go:334] "Generic (PLEG): container finished" podID="25f011aa-da5a-495d-8733-d24acbb608fe" containerID="ee8df9a7cead496cabccf3d955a9dc6342c16605b82173a5ad40ac314a5967f8" exitCode=143 Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.467904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f011aa-da5a-495d-8733-d24acbb608fe","Type":"ContainerDied","Data":"58ca3f8d4d029416078377fe2d90d66e62fc6ac0bb5c87e1c14df1d12db253fb"} Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.467936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f011aa-da5a-495d-8733-d24acbb608fe","Type":"ContainerDied","Data":"ee8df9a7cead496cabccf3d955a9dc6342c16605b82173a5ad40ac314a5967f8"} Nov 21 13:16:27 crc kubenswrapper[4769]: I1121 13:16:27.468149 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="5e3437f8-aef3-493b-a04f-8ff9c8242470" containerName="nova-scheduler-scheduler" containerID="cri-o://d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1" gracePeriod=30 Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.489659 4769 generic.go:334] "Generic (PLEG): container finished" podID="1791c01a-d642-432a-a96e-39436b4de482" containerID="e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206" exitCode=0 Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.489981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerDied","Data":"e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206"} Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.572877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.631291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-combined-ca-bundle\") pod \"25f011aa-da5a-495d-8733-d24acbb608fe\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.631340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hrfj\" (UniqueName: \"kubernetes.io/projected/25f011aa-da5a-495d-8733-d24acbb608fe-kube-api-access-6hrfj\") pod \"25f011aa-da5a-495d-8733-d24acbb608fe\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.631435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f011aa-da5a-495d-8733-d24acbb608fe-logs\") pod \"25f011aa-da5a-495d-8733-d24acbb608fe\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.631451 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-config-data\") pod \"25f011aa-da5a-495d-8733-d24acbb608fe\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.631470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-nova-metadata-tls-certs\") pod \"25f011aa-da5a-495d-8733-d24acbb608fe\" (UID: \"25f011aa-da5a-495d-8733-d24acbb608fe\") " Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.632150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f011aa-da5a-495d-8733-d24acbb608fe-logs" (OuterVolumeSpecName: "logs") pod "25f011aa-da5a-495d-8733-d24acbb608fe" (UID: "25f011aa-da5a-495d-8733-d24acbb608fe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.636710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f011aa-da5a-495d-8733-d24acbb608fe-kube-api-access-6hrfj" (OuterVolumeSpecName: "kube-api-access-6hrfj") pod "25f011aa-da5a-495d-8733-d24acbb608fe" (UID: "25f011aa-da5a-495d-8733-d24acbb608fe"). InnerVolumeSpecName "kube-api-access-6hrfj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.675026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25f011aa-da5a-495d-8733-d24acbb608fe" (UID: "25f011aa-da5a-495d-8733-d24acbb608fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.682732 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-config-data" (OuterVolumeSpecName: "config-data") pod "25f011aa-da5a-495d-8733-d24acbb608fe" (UID: "25f011aa-da5a-495d-8733-d24acbb608fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.717042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "25f011aa-da5a-495d-8733-d24acbb608fe" (UID: "25f011aa-da5a-495d-8733-d24acbb608fe"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.733480 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.733523 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.733541 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f011aa-da5a-495d-8733-d24acbb608fe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.733554 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6hrfj\" (UniqueName: \"kubernetes.io/projected/25f011aa-da5a-495d-8733-d24acbb608fe-kube-api-access-6hrfj\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.733566 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25f011aa-da5a-495d-8733-d24acbb608fe-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:28 crc kubenswrapper[4769]: I1121 13:16:28.993392 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.138595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-combined-ca-bundle\") pod \"5e3437f8-aef3-493b-a04f-8ff9c8242470\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.138743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh6gb\" (UniqueName: \"kubernetes.io/projected/5e3437f8-aef3-493b-a04f-8ff9c8242470-kube-api-access-gh6gb\") pod \"5e3437f8-aef3-493b-a04f-8ff9c8242470\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.138775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-config-data\") pod \"5e3437f8-aef3-493b-a04f-8ff9c8242470\" (UID: \"5e3437f8-aef3-493b-a04f-8ff9c8242470\") " Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.177955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3437f8-aef3-493b-a04f-8ff9c8242470-kube-api-access-gh6gb" (OuterVolumeSpecName: "kube-api-access-gh6gb") pod "5e3437f8-aef3-493b-a04f-8ff9c8242470" (UID: "5e3437f8-aef3-493b-a04f-8ff9c8242470"). InnerVolumeSpecName "kube-api-access-gh6gb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.181331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-config-data" (OuterVolumeSpecName: "config-data") pod "5e3437f8-aef3-493b-a04f-8ff9c8242470" (UID: "5e3437f8-aef3-493b-a04f-8ff9c8242470"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.182940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e3437f8-aef3-493b-a04f-8ff9c8242470" (UID: "5e3437f8-aef3-493b-a04f-8ff9c8242470"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.242519 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gh6gb\" (UniqueName: \"kubernetes.io/projected/5e3437f8-aef3-493b-a04f-8ff9c8242470-kube-api-access-gh6gb\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.242587 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.242616 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3437f8-aef3-493b-a04f-8ff9c8242470-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.500404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"25f011aa-da5a-495d-8733-d24acbb608fe","Type":"ContainerDied","Data":"6cea1826cb2c0a70a920f847868f810dd0f16f441b04a1db9ef514a17da241f9"} Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.500749 4769 scope.go:117] "RemoveContainer" containerID="58ca3f8d4d029416078377fe2d90d66e62fc6ac0bb5c87e1c14df1d12db253fb" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.500614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.505466 4769 generic.go:334] "Generic (PLEG): container finished" podID="5e3437f8-aef3-493b-a04f-8ff9c8242470" containerID="d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1" exitCode=0 Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.505498 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5e3437f8-aef3-493b-a04f-8ff9c8242470","Type":"ContainerDied","Data":"d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1"} Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.505518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5e3437f8-aef3-493b-a04f-8ff9c8242470","Type":"ContainerDied","Data":"4f350e8ef0868aa55dbbd5b8809f52db9859b76c01fdd25996d6856f85b57303"} Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.505562 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.528733 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.530700 4769 scope.go:117] "RemoveContainer" containerID="ee8df9a7cead496cabccf3d955a9dc6342c16605b82173a5ad40ac314a5967f8" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.563351 4769 scope.go:117] "RemoveContainer" containerID="d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.566030 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.578332 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.589442 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598057 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: E1121 13:16:29.598622 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5e3437f8-aef3-493b-a04f-8ff9c8242470" containerName="nova-scheduler-scheduler" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598648 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3437f8-aef3-493b-a04f-8ff9c8242470" containerName="nova-scheduler-scheduler" Nov 21 13:16:29 crc kubenswrapper[4769]: E1121 13:16:29.598670 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-metadata" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598678 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-metadata" Nov 21 13:16:29 crc kubenswrapper[4769]: E1121 13:16:29.598701 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-log" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598707 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-log" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598911 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-metadata" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598947 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" containerName="nova-metadata-log" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.598956 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5e3437f8-aef3-493b-a04f-8ff9c8242470" containerName="nova-scheduler-scheduler" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.599981 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.604443 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.609249 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.609391 4769 scope.go:117] "RemoveContainer" containerID="d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.611165 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.616083 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: E1121 13:16:29.617633 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1\": container with ID starting with d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1 not found: ID does not exist" containerID="d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.617678 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1"} err="failed to get container status \"d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1\": rpc error: code = NotFound desc = could not find container \"d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1\": container with ID starting with d6b4e72296100bc81334d98b3826b08c5d8a7862d98fad61976fc1fc8c359ce1 not found: ID does not exist" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.618008 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.618312 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.626249 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.654637 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnnf\" (UniqueName: \"kubernetes.io/projected/712cf82b-f8e2-4391-89d6-557b4c0d403c-kube-api-access-dpnnf\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.654863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-config-data\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.654946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.655119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.656722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/712cf82b-f8e2-4391-89d6-557b4c0d403c-logs\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.758782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnnf\" (UniqueName: \"kubernetes.io/projected/712cf82b-f8e2-4391-89d6-557b4c0d403c-kube-api-access-dpnnf\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.758836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.758919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-config-data\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.758957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-config-data\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.758996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.759068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wq6\" (UniqueName: \"kubernetes.io/projected/d35bbf3e-3152-46bc-9515-333642ded235-kube-api-access-k6wq6\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.759106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.759141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/712cf82b-f8e2-4391-89d6-557b4c0d403c-logs\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.759700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/712cf82b-f8e2-4391-89d6-557b4c0d403c-logs\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.764622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-config-data\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.764697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.765297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.782977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnnf\" (UniqueName: \"kubernetes.io/projected/712cf82b-f8e2-4391-89d6-557b4c0d403c-kube-api-access-dpnnf\") pod \"nova-metadata-0\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.861588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.861701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-config-data\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.861817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wq6\" (UniqueName: \"kubernetes.io/projected/d35bbf3e-3152-46bc-9515-333642ded235-kube-api-access-k6wq6\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.867623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-config-data\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.867840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.877659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wq6\" (UniqueName: \"kubernetes.io/projected/d35bbf3e-3152-46bc-9515-333642ded235-kube-api-access-k6wq6\") pod \"nova-scheduler-0\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.956616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:29 crc kubenswrapper[4769]: I1121 13:16:29.973684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:30 crc kubenswrapper[4769]: I1121 13:16:30.473548 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:30 crc kubenswrapper[4769]: I1121 13:16:30.536514 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:30 crc kubenswrapper[4769]: W1121 13:16:30.789054 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod712cf82b_f8e2_4391_89d6_557b4c0d403c.slice/crio-af7a5b040e94b03b506f331e461536a1e5bf046e5c8700880abc7b39e939d72b WatchSource:0}: Error finding container af7a5b040e94b03b506f331e461536a1e5bf046e5c8700880abc7b39e939d72b: Status 404 returned error can't find the container with id af7a5b040e94b03b506f331e461536a1e5bf046e5c8700880abc7b39e939d72b Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.284856 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25f011aa-da5a-495d-8733-d24acbb608fe" path="/var/lib/kubelet/pods/25f011aa-da5a-495d-8733-d24acbb608fe/volumes" Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.286151 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3437f8-aef3-493b-a04f-8ff9c8242470" path="/var/lib/kubelet/pods/5e3437f8-aef3-493b-a04f-8ff9c8242470/volumes" Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.543808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"712cf82b-f8e2-4391-89d6-557b4c0d403c","Type":"ContainerStarted","Data":"af7a5b040e94b03b506f331e461536a1e5bf046e5c8700880abc7b39e939d72b"} Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.548513 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerID="a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb" exitCode=0 Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.548630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerDied","Data":"a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb"} Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.551429 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.553720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerStarted","Data":"09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23"} Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.556850 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d35bbf3e-3152-46bc-9515-333642ded235","Type":"ContainerStarted","Data":"1ddc22bcf518d3e61aa39f9424584941452f5045d6d3f35ac6634bc2c2f0676a"} Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.855358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:31 crc kubenswrapper[4769]: I1121 13:16:31.893855 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.579533 4769 generic.go:334] "Generic (PLEG): container finished" podID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerID="fa9bb110fcf19a16f46303963e1edd45f4a5f17dd6ceea774370c3314dc67335" exitCode=0 Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.579696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4dcbeb88-eaad-4314-9e14-86bc51557689","Type":"ContainerDied","Data":"fa9bb110fcf19a16f46303963e1edd45f4a5f17dd6ceea774370c3314dc67335"} Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.582815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d35bbf3e-3152-46bc-9515-333642ded235","Type":"ContainerStarted","Data":"5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43"} Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.585509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"712cf82b-f8e2-4391-89d6-557b4c0d403c","Type":"ContainerStarted","Data":"148d9bed3b746782654529ad0ff03d3ba4280f9332b3c39a9997a92e028fc4be"} Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.604803 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.604786113 podStartE2EDuration="3.604786113s" podCreationTimestamp="2025-11-21 13:16:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:32.596362906 +0000 UTC m=+5151.297024734" watchObservedRunningTime="2025-11-21 13:16:32.604786113 +0000 UTC m=+5151.305447921" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.629148 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.877127 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.915766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.927531 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-combined-ca-bundle\") pod \"4dcbeb88-eaad-4314-9e14-86bc51557689\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.927677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-config-data\") pod \"4dcbeb88-eaad-4314-9e14-86bc51557689\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.927717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2fms\" (UniqueName: \"kubernetes.io/projected/4dcbeb88-eaad-4314-9e14-86bc51557689-kube-api-access-q2fms\") pod \"4dcbeb88-eaad-4314-9e14-86bc51557689\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.927775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4dcbeb88-eaad-4314-9e14-86bc51557689-logs\") pod \"4dcbeb88-eaad-4314-9e14-86bc51557689\" (UID: \"4dcbeb88-eaad-4314-9e14-86bc51557689\") " Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.929362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcbeb88-eaad-4314-9e14-86bc51557689-logs" (OuterVolumeSpecName: "logs") pod "4dcbeb88-eaad-4314-9e14-86bc51557689" (UID: "4dcbeb88-eaad-4314-9e14-86bc51557689"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.934577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcbeb88-eaad-4314-9e14-86bc51557689-kube-api-access-q2fms" (OuterVolumeSpecName: "kube-api-access-q2fms") pod "4dcbeb88-eaad-4314-9e14-86bc51557689" (UID: "4dcbeb88-eaad-4314-9e14-86bc51557689"). InnerVolumeSpecName "kube-api-access-q2fms". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.965582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-config-data" (OuterVolumeSpecName: "config-data") pod "4dcbeb88-eaad-4314-9e14-86bc51557689" (UID: "4dcbeb88-eaad-4314-9e14-86bc51557689"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:32 crc kubenswrapper[4769]: I1121 13:16:32.965744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4dcbeb88-eaad-4314-9e14-86bc51557689" (UID: "4dcbeb88-eaad-4314-9e14-86bc51557689"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.030633 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.030835 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q2fms\" (UniqueName: \"kubernetes.io/projected/4dcbeb88-eaad-4314-9e14-86bc51557689-kube-api-access-q2fms\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.030845 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4dcbeb88-eaad-4314-9e14-86bc51557689-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.030854 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4dcbeb88-eaad-4314-9e14-86bc51557689-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.401827 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2"] Nov 21 13:16:33 crc kubenswrapper[4769]: E1121 13:16:33.402377 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-api" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.402395 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-api" Nov 21 13:16:33 crc kubenswrapper[4769]: E1121 13:16:33.402443 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-log" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.402450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-log" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.402636 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-api" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.402661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" containerName="nova-api-log" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.403391 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.408274 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.408466 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.412733 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2"] Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.541312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-scripts\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.541433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.541555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfl8m\" (UniqueName: \"kubernetes.io/projected/1accd34e-cf48-4807-a34f-68d4f0f8f250-kube-api-access-tfl8m\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.541589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-config-data\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.601904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerStarted","Data":"e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3"} Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.605861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"712cf82b-f8e2-4391-89d6-557b4c0d403c","Type":"ContainerStarted","Data":"b451580139b180dc67dde57ded1f161a00a2a4f7c3ee0524d81e2508467fd662"} Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.610471 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.610785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4dcbeb88-eaad-4314-9e14-86bc51557689","Type":"ContainerDied","Data":"2cdd1a94b4b15cf39dbc87e2be040a9a4603e1ebfe5d7173287907413094bbe5"} Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.610872 4769 scope.go:117] "RemoveContainer" containerID="fa9bb110fcf19a16f46303963e1edd45f4a5f17dd6ceea774370c3314dc67335" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.626151 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-76ckk" podStartSLOduration=3.277680706 podStartE2EDuration="11.626131217s" podCreationTimestamp="2025-11-21 13:16:22 +0000 UTC" firstStartedPulling="2025-11-21 13:16:24.422701423 +0000 UTC m=+5143.123363261" lastFinishedPulling="2025-11-21 13:16:32.771151964 +0000 UTC m=+5151.471813772" observedRunningTime="2025-11-21 13:16:33.623397013 +0000 UTC m=+5152.324058841" watchObservedRunningTime="2025-11-21 13:16:33.626131217 +0000 UTC m=+5152.326793045" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.646858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-scripts\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.647072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.647142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tfl8m\" (UniqueName: \"kubernetes.io/projected/1accd34e-cf48-4807-a34f-68d4f0f8f250-kube-api-access-tfl8m\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.647170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-config-data\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.648512 4769 scope.go:117] "RemoveContainer" containerID="78bf7239cb0ecdacba33efaab863196741b88b2bfa0c8f29a7b6f068a2c54609" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.654303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.655959 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.65593386 podStartE2EDuration="4.65593386s" podCreationTimestamp="2025-11-21 13:16:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:33.646085284 +0000 UTC m=+5152.346747122" watchObservedRunningTime="2025-11-21 13:16:33.65593386 +0000 UTC m=+5152.356595678" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.663624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-config-data\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.667332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-scripts\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.671443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfl8m\" (UniqueName: \"kubernetes.io/projected/1accd34e-cf48-4807-a34f-68d4f0f8f250-kube-api-access-tfl8m\") pod \"nova-cell1-cell-mapping-h24d2\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.680460 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.692116 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.705028 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.706859 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.713390 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.713535 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.724090 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.857464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/206b5962-83a2-4342-8a86-de0bfb354918-logs\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.858842 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6hxz\" (UniqueName: \"kubernetes.io/projected/206b5962-83a2-4342-8a86-de0bfb354918-kube-api-access-h6hxz\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.858922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.859051 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-config-data\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.960253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h6hxz\" (UniqueName: \"kubernetes.io/projected/206b5962-83a2-4342-8a86-de0bfb354918-kube-api-access-h6hxz\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.960333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.960402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-config-data\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.960469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/206b5962-83a2-4342-8a86-de0bfb354918-logs\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.961038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/206b5962-83a2-4342-8a86-de0bfb354918-logs\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.965454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.971052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-config-data\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:33 crc kubenswrapper[4769]: I1121 13:16:33.977773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6hxz\" (UniqueName: \"kubernetes.io/projected/206b5962-83a2-4342-8a86-de0bfb354918-kube-api-access-h6hxz\") pod \"nova-api-0\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.126029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.235023 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2"] Nov 21 13:16:34 crc kubenswrapper[4769]: W1121 13:16:34.263514 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1accd34e_cf48_4807_a34f_68d4f0f8f250.slice/crio-85488172b6faa9b822b852790309d5f76a4bd8877d4730cc907538b0dcf2b43b WatchSource:0}: Error finding container 85488172b6faa9b822b852790309d5f76a4bd8877d4730cc907538b0dcf2b43b: Status 404 returned error can't find the container with id 85488172b6faa9b822b852790309d5f76a4bd8877d4730cc907538b0dcf2b43b Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.625022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" event={"ID":"1accd34e-cf48-4807-a34f-68d4f0f8f250","Type":"ContainerStarted","Data":"85488172b6faa9b822b852790309d5f76a4bd8877d4730cc907538b0dcf2b43b"} Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.627955 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:34 crc kubenswrapper[4769]: W1121 13:16:34.632524 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b WatchSource:0}: Error finding container 445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b: Status 404 returned error can't find the container with id 445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.957595 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.974733 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:34 crc kubenswrapper[4769]: I1121 13:16:34.974778 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.286849 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcbeb88-eaad-4314-9e14-86bc51557689" path="/var/lib/kubelet/pods/4dcbeb88-eaad-4314-9e14-86bc51557689/volumes" Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.639329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"206b5962-83a2-4342-8a86-de0bfb354918","Type":"ContainerStarted","Data":"eac855a2b1d04a590da77ea977d01fbba1d13c3a76d784a18e7fe49761e3cc53"} Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.639410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"206b5962-83a2-4342-8a86-de0bfb354918","Type":"ContainerStarted","Data":"e00376becf5523e679c9925e5141b6abef57a014168bab76c33304aed149770d"} Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.639430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"206b5962-83a2-4342-8a86-de0bfb354918","Type":"ContainerStarted","Data":"445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b"} Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.641766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" event={"ID":"1accd34e-cf48-4807-a34f-68d4f0f8f250","Type":"ContainerStarted","Data":"7501d9e1cd7dadd083e519f6cf5d5424e0f554eb19cb5e99e514981bc72f610e"} Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.662550 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.662524956 podStartE2EDuration="2.662524956s" podCreationTimestamp="2025-11-21 13:16:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:35.657883631 +0000 UTC m=+5154.358545469" watchObservedRunningTime="2025-11-21 13:16:35.662524956 +0000 UTC m=+5154.363186794" Nov 21 13:16:35 crc kubenswrapper[4769]: I1121 13:16:35.686852 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" podStartSLOduration=2.6868309310000003 podStartE2EDuration="2.686830931s" podCreationTimestamp="2025-11-21 13:16:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:35.673906733 +0000 UTC m=+5154.374568571" watchObservedRunningTime="2025-11-21 13:16:35.686830931 +0000 UTC m=+5154.387492759" Nov 21 13:16:39 crc kubenswrapper[4769]: I1121 13:16:39.687236 4769 generic.go:334] "Generic (PLEG): container finished" podID="1accd34e-cf48-4807-a34f-68d4f0f8f250" containerID="7501d9e1cd7dadd083e519f6cf5d5424e0f554eb19cb5e99e514981bc72f610e" exitCode=0 Nov 21 13:16:39 crc kubenswrapper[4769]: I1121 13:16:39.687284 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" event={"ID":"1accd34e-cf48-4807-a34f-68d4f0f8f250","Type":"ContainerDied","Data":"7501d9e1cd7dadd083e519f6cf5d5424e0f554eb19cb5e99e514981bc72f610e"} Nov 21 13:16:39 crc kubenswrapper[4769]: I1121 13:16:39.957909 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:39 crc kubenswrapper[4769]: I1121 13:16:39.973892 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:39 crc kubenswrapper[4769]: I1121 13:16:39.974153 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:40 crc kubenswrapper[4769]: I1121 13:16:40.200523 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:40 crc kubenswrapper[4769]: I1121 13:16:40.747137 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.116389 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.210392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-combined-ca-bundle\") pod \"1accd34e-cf48-4807-a34f-68d4f0f8f250\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.210535 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-scripts\") pod \"1accd34e-cf48-4807-a34f-68d4f0f8f250\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.210642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfl8m\" (UniqueName: \"kubernetes.io/projected/1accd34e-cf48-4807-a34f-68d4f0f8f250-kube-api-access-tfl8m\") pod \"1accd34e-cf48-4807-a34f-68d4f0f8f250\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.210679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-config-data\") pod \"1accd34e-cf48-4807-a34f-68d4f0f8f250\" (UID: \"1accd34e-cf48-4807-a34f-68d4f0f8f250\") " Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.217334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-scripts" (OuterVolumeSpecName: "scripts") pod "1accd34e-cf48-4807-a34f-68d4f0f8f250" (UID: "1accd34e-cf48-4807-a34f-68d4f0f8f250"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.230427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1accd34e-cf48-4807-a34f-68d4f0f8f250-kube-api-access-tfl8m" (OuterVolumeSpecName: "kube-api-access-tfl8m") pod "1accd34e-cf48-4807-a34f-68d4f0f8f250" (UID: "1accd34e-cf48-4807-a34f-68d4f0f8f250"). InnerVolumeSpecName "kube-api-access-tfl8m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.256394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-config-data" (OuterVolumeSpecName: "config-data") pod "1accd34e-cf48-4807-a34f-68d4f0f8f250" (UID: "1accd34e-cf48-4807-a34f-68d4f0f8f250"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.262726 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1accd34e-cf48-4807-a34f-68d4f0f8f250" (UID: "1accd34e-cf48-4807-a34f-68d4f0f8f250"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.313605 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tfl8m\" (UniqueName: \"kubernetes.io/projected/1accd34e-cf48-4807-a34f-68d4f0f8f250-kube-api-access-tfl8m\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.313641 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.313655 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.313666 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1accd34e-cf48-4807-a34f-68d4f0f8f250-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.470468 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.99:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.470871 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.470546 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.99:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.470918 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.471050 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.471864 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.471957 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" gracePeriod=600 Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.713760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" event={"ID":"1accd34e-cf48-4807-a34f-68d4f0f8f250","Type":"ContainerDied","Data":"85488172b6faa9b822b852790309d5f76a4bd8877d4730cc907538b0dcf2b43b"} Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.713803 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85488172b6faa9b822b852790309d5f76a4bd8877d4730cc907538b0dcf2b43b" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.713832 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2" Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.837476 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.845268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.845510 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-log" containerID="cri-o://148d9bed3b746782654529ad0ff03d3ba4280f9332b3c39a9997a92e028fc4be" gracePeriod=30 Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.845598 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-metadata" containerID="cri-o://b451580139b180dc67dde57ded1f161a00a2a4f7c3ee0524d81e2508467fd662" gracePeriod=30 Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.856699 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.856904 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-log" containerID="cri-o://e00376becf5523e679c9925e5141b6abef57a014168bab76c33304aed149770d" gracePeriod=30 Nov 21 13:16:41 crc kubenswrapper[4769]: I1121 13:16:41.856918 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-api" containerID="cri-o://eac855a2b1d04a590da77ea977d01fbba1d13c3a76d784a18e7fe49761e3cc53" gracePeriod=30 Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.727360 4769 generic.go:334] "Generic (PLEG): container finished" podID="206b5962-83a2-4342-8a86-de0bfb354918" containerID="eac855a2b1d04a590da77ea977d01fbba1d13c3a76d784a18e7fe49761e3cc53" exitCode=0 Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.727716 4769 generic.go:334] "Generic (PLEG): container finished" podID="206b5962-83a2-4342-8a86-de0bfb354918" containerID="e00376becf5523e679c9925e5141b6abef57a014168bab76c33304aed149770d" exitCode=143 Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.727442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"206b5962-83a2-4342-8a86-de0bfb354918","Type":"ContainerDied","Data":"eac855a2b1d04a590da77ea977d01fbba1d13c3a76d784a18e7fe49761e3cc53"} Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.727804 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"206b5962-83a2-4342-8a86-de0bfb354918","Type":"ContainerDied","Data":"e00376becf5523e679c9925e5141b6abef57a014168bab76c33304aed149770d"} Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.731075 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" exitCode=0 Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.731163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826"} Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.731234 4769 scope.go:117] "RemoveContainer" containerID="1b1f2c1e2837e5ce0cc2c156af60fed23afef95bb5d7d7c049b7a0edff9bcd61" Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.735789 4769 generic.go:334] "Generic (PLEG): container finished" podID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerID="148d9bed3b746782654529ad0ff03d3ba4280f9332b3c39a9997a92e028fc4be" exitCode=143 Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.735866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"712cf82b-f8e2-4391-89d6-557b4c0d403c","Type":"ContainerDied","Data":"148d9bed3b746782654529ad0ff03d3ba4280f9332b3c39a9997a92e028fc4be"} Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.735985 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d35bbf3e-3152-46bc-9515-333642ded235" containerName="nova-scheduler-scheduler" containerID="cri-o://5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43" gracePeriod=30 Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.883474 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.884540 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:42 crc kubenswrapper[4769]: I1121 13:16:42.945171 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:43 crc kubenswrapper[4769]: E1121 13:16:43.095319 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.616109 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.749277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"206b5962-83a2-4342-8a86-de0bfb354918","Type":"ContainerDied","Data":"445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b"} Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.749326 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.749347 4769 scope.go:117] "RemoveContainer" containerID="eac855a2b1d04a590da77ea977d01fbba1d13c3a76d784a18e7fe49761e3cc53" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.753566 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:16:43 crc kubenswrapper[4769]: E1121 13:16:43.753862 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.784284 4769 scope.go:117] "RemoveContainer" containerID="e00376becf5523e679c9925e5141b6abef57a014168bab76c33304aed149770d" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.784917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-combined-ca-bundle\") pod \"206b5962-83a2-4342-8a86-de0bfb354918\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.785015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-config-data\") pod \"206b5962-83a2-4342-8a86-de0bfb354918\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.785245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/206b5962-83a2-4342-8a86-de0bfb354918-logs\") pod \"206b5962-83a2-4342-8a86-de0bfb354918\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.785365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6hxz\" (UniqueName: \"kubernetes.io/projected/206b5962-83a2-4342-8a86-de0bfb354918-kube-api-access-h6hxz\") pod \"206b5962-83a2-4342-8a86-de0bfb354918\" (UID: \"206b5962-83a2-4342-8a86-de0bfb354918\") " Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.787025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206b5962-83a2-4342-8a86-de0bfb354918-logs" (OuterVolumeSpecName: "logs") pod "206b5962-83a2-4342-8a86-de0bfb354918" (UID: "206b5962-83a2-4342-8a86-de0bfb354918"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.795634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206b5962-83a2-4342-8a86-de0bfb354918-kube-api-access-h6hxz" (OuterVolumeSpecName: "kube-api-access-h6hxz") pod "206b5962-83a2-4342-8a86-de0bfb354918" (UID: "206b5962-83a2-4342-8a86-de0bfb354918"). InnerVolumeSpecName "kube-api-access-h6hxz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.833780 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.841695 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-config-data" (OuterVolumeSpecName: "config-data") pod "206b5962-83a2-4342-8a86-de0bfb354918" (UID: "206b5962-83a2-4342-8a86-de0bfb354918"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.859755 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "206b5962-83a2-4342-8a86-de0bfb354918" (UID: "206b5962-83a2-4342-8a86-de0bfb354918"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.887545 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-76ckk"] Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.888561 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h6hxz\" (UniqueName: \"kubernetes.io/projected/206b5962-83a2-4342-8a86-de0bfb354918-kube-api-access-h6hxz\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.888587 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.888596 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/206b5962-83a2-4342-8a86-de0bfb354918-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:43 crc kubenswrapper[4769]: I1121 13:16:43.888606 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/206b5962-83a2-4342-8a86-de0bfb354918-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.084588 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.095629 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106100 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.106549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-log" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106570 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-log" Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.106587 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1accd34e-cf48-4807-a34f-68d4f0f8f250" containerName="nova-manage" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106593 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1accd34e-cf48-4807-a34f-68d4f0f8f250" containerName="nova-manage" Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.106621 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-api" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106626 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-api" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106819 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-log" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106833 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="206b5962-83a2-4342-8a86-de0bfb354918" containerName="nova-api-api" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.106842 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1accd34e-cf48-4807-a34f-68d4f0f8f250" containerName="nova-manage" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.108006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.111657 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.121575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.193508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.193816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152a6270-6b75-4745-b45e-8deb50bdb7a2-logs\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.193907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbdf7\" (UniqueName: \"kubernetes.io/projected/152a6270-6b75-4745-b45e-8deb50bdb7a2-kube-api-access-xbdf7\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.193996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-config-data\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.295406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.295742 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152a6270-6b75-4745-b45e-8deb50bdb7a2-logs\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.295865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xbdf7\" (UniqueName: \"kubernetes.io/projected/152a6270-6b75-4745-b45e-8deb50bdb7a2-kube-api-access-xbdf7\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.295977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-config-data\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.296490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152a6270-6b75-4745-b45e-8deb50bdb7a2-logs\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.299706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.300342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-config-data\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.313469 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbdf7\" (UniqueName: \"kubernetes.io/projected/152a6270-6b75-4745-b45e-8deb50bdb7a2-kube-api-access-xbdf7\") pod \"nova-api-0\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.436735 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.764145 4769 generic.go:334] "Generic (PLEG): container finished" podID="d35bbf3e-3152-46bc-9515-333642ded235" containerID="5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43" exitCode=0 Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.764221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d35bbf3e-3152-46bc-9515-333642ded235","Type":"ContainerDied","Data":"5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43"} Nov 21 13:16:44 crc kubenswrapper[4769]: I1121 13:16:44.923783 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.957435 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43 is running failed: container process not found" containerID="5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.961538 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43 is running failed: container process not found" containerID="5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.962107 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43 is running failed: container process not found" containerID="5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:16:44 crc kubenswrapper[4769]: E1121 13:16:44.962168 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d35bbf3e-3152-46bc-9515-333642ded235" containerName="nova-scheduler-scheduler" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.076223 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.212617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-combined-ca-bundle\") pod \"d35bbf3e-3152-46bc-9515-333642ded235\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.212776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-config-data\") pod \"d35bbf3e-3152-46bc-9515-333642ded235\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.212874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6wq6\" (UniqueName: \"kubernetes.io/projected/d35bbf3e-3152-46bc-9515-333642ded235-kube-api-access-k6wq6\") pod \"d35bbf3e-3152-46bc-9515-333642ded235\" (UID: \"d35bbf3e-3152-46bc-9515-333642ded235\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.219043 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35bbf3e-3152-46bc-9515-333642ded235-kube-api-access-k6wq6" (OuterVolumeSpecName: "kube-api-access-k6wq6") pod "d35bbf3e-3152-46bc-9515-333642ded235" (UID: "d35bbf3e-3152-46bc-9515-333642ded235"). InnerVolumeSpecName "kube-api-access-k6wq6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.243427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d35bbf3e-3152-46bc-9515-333642ded235" (UID: "d35bbf3e-3152-46bc-9515-333642ded235"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.246987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-config-data" (OuterVolumeSpecName: "config-data") pod "d35bbf3e-3152-46bc-9515-333642ded235" (UID: "d35bbf3e-3152-46bc-9515-333642ded235"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.283905 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="206b5962-83a2-4342-8a86-de0bfb354918" path="/var/lib/kubelet/pods/206b5962-83a2-4342-8a86-de0bfb354918/volumes" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.314486 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.314516 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6wq6\" (UniqueName: \"kubernetes.io/projected/d35bbf3e-3152-46bc-9515-333642ded235-kube-api-access-k6wq6\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.314531 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d35bbf3e-3152-46bc-9515-333642ded235-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:45 crc kubenswrapper[4769]: E1121 13:16:45.574486 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b\": RecentStats: unable to find data in memory cache]" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.783706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d35bbf3e-3152-46bc-9515-333642ded235","Type":"ContainerDied","Data":"1ddc22bcf518d3e61aa39f9424584941452f5045d6d3f35ac6634bc2c2f0676a"} Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.784031 4769 scope.go:117] "RemoveContainer" containerID="5e9d1e7ee589ac42616a5bc280ad3e3398c3936f993057a4f4cd702ebbe4cc43" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.783747 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.789645 4769 generic.go:334] "Generic (PLEG): container finished" podID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerID="b451580139b180dc67dde57ded1f161a00a2a4f7c3ee0524d81e2508467fd662" exitCode=0 Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.789720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"712cf82b-f8e2-4391-89d6-557b4c0d403c","Type":"ContainerDied","Data":"b451580139b180dc67dde57ded1f161a00a2a4f7c3ee0524d81e2508467fd662"} Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.789786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"712cf82b-f8e2-4391-89d6-557b4c0d403c","Type":"ContainerDied","Data":"af7a5b040e94b03b506f331e461536a1e5bf046e5c8700880abc7b39e939d72b"} Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.789797 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af7a5b040e94b03b506f331e461536a1e5bf046e5c8700880abc7b39e939d72b" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.798340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"152a6270-6b75-4745-b45e-8deb50bdb7a2","Type":"ContainerStarted","Data":"ecfb898577853b44a17da1917a03064e1074bb78704a133af4bd8d1ba0c2c56a"} Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.798397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"152a6270-6b75-4745-b45e-8deb50bdb7a2","Type":"ContainerStarted","Data":"bd3ff6786b7e00f1bb4bf8187eaa31890654b2a7204b858fae67be12aa48a626"} Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.798414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"152a6270-6b75-4745-b45e-8deb50bdb7a2","Type":"ContainerStarted","Data":"c0fab53183eaf2b1e7a04f1ab3ae9058fc21188f24bf926beba3895e95ce9612"} Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.798553 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-76ckk" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="registry-server" containerID="cri-o://e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3" gracePeriod=2 Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.808250 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.820334 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.82031747 podStartE2EDuration="1.82031747s" podCreationTimestamp="2025-11-21 13:16:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:45.815344646 +0000 UTC m=+5164.516006474" watchObservedRunningTime="2025-11-21 13:16:45.82031747 +0000 UTC m=+5164.520979288" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.847863 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.860179 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.899097 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:45 crc kubenswrapper[4769]: E1121 13:16:45.899674 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-metadata" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.899697 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-metadata" Nov 21 13:16:45 crc kubenswrapper[4769]: E1121 13:16:45.899741 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d35bbf3e-3152-46bc-9515-333642ded235" containerName="nova-scheduler-scheduler" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.899750 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35bbf3e-3152-46bc-9515-333642ded235" containerName="nova-scheduler-scheduler" Nov 21 13:16:45 crc kubenswrapper[4769]: E1121 13:16:45.899789 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-log" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.899797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-log" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.900037 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-metadata" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.900070 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d35bbf3e-3152-46bc-9515-333642ded235" containerName="nova-scheduler-scheduler" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.900087 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" containerName="nova-metadata-log" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.900943 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.908687 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.910282 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.930817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-combined-ca-bundle\") pod \"712cf82b-f8e2-4391-89d6-557b4c0d403c\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.931057 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-config-data\") pod \"712cf82b-f8e2-4391-89d6-557b4c0d403c\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.931125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-nova-metadata-tls-certs\") pod \"712cf82b-f8e2-4391-89d6-557b4c0d403c\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.931172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpnnf\" (UniqueName: \"kubernetes.io/projected/712cf82b-f8e2-4391-89d6-557b4c0d403c-kube-api-access-dpnnf\") pod \"712cf82b-f8e2-4391-89d6-557b4c0d403c\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.931227 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/712cf82b-f8e2-4391-89d6-557b4c0d403c-logs\") pod \"712cf82b-f8e2-4391-89d6-557b4c0d403c\" (UID: \"712cf82b-f8e2-4391-89d6-557b4c0d403c\") " Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.940401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/712cf82b-f8e2-4391-89d6-557b4c0d403c-kube-api-access-dpnnf" (OuterVolumeSpecName: "kube-api-access-dpnnf") pod "712cf82b-f8e2-4391-89d6-557b4c0d403c" (UID: "712cf82b-f8e2-4391-89d6-557b4c0d403c"). InnerVolumeSpecName "kube-api-access-dpnnf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.941707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712cf82b-f8e2-4391-89d6-557b4c0d403c-logs" (OuterVolumeSpecName: "logs") pod "712cf82b-f8e2-4391-89d6-557b4c0d403c" (UID: "712cf82b-f8e2-4391-89d6-557b4c0d403c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.966440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "712cf82b-f8e2-4391-89d6-557b4c0d403c" (UID: "712cf82b-f8e2-4391-89d6-557b4c0d403c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.972381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-config-data" (OuterVolumeSpecName: "config-data") pod "712cf82b-f8e2-4391-89d6-557b4c0d403c" (UID: "712cf82b-f8e2-4391-89d6-557b4c0d403c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:45 crc kubenswrapper[4769]: I1121 13:16:45.992958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "712cf82b-f8e2-4391-89d6-557b4c0d403c" (UID: "712cf82b-f8e2-4391-89d6-557b4c0d403c"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034466 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-config-data\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034534 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rstkr\" (UniqueName: \"kubernetes.io/projected/5c11994a-1f6a-442c-8479-180dab834496-kube-api-access-rstkr\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034885 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034918 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034933 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dpnnf\" (UniqueName: \"kubernetes.io/projected/712cf82b-f8e2-4391-89d6-557b4c0d403c-kube-api-access-dpnnf\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034945 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/712cf82b-f8e2-4391-89d6-557b4c0d403c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.034957 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/712cf82b-f8e2-4391-89d6-557b4c0d403c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.136072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-config-data\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.136138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.136168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rstkr\" (UniqueName: \"kubernetes.io/projected/5c11994a-1f6a-442c-8479-180dab834496-kube-api-access-rstkr\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.139874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-config-data\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.140305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.151757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rstkr\" (UniqueName: \"kubernetes.io/projected/5c11994a-1f6a-442c-8479-180dab834496-kube-api-access-rstkr\") pod \"nova-scheduler-0\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.349432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.358520 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.442422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v4n4\" (UniqueName: \"kubernetes.io/projected/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-kube-api-access-6v4n4\") pod \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.443301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-catalog-content\") pod \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.443406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-utilities\") pod \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\" (UID: \"f3347c92-7e37-4db2-a9d0-ecc10035dcd7\") " Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.445464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-utilities" (OuterVolumeSpecName: "utilities") pod "f3347c92-7e37-4db2-a9d0-ecc10035dcd7" (UID: "f3347c92-7e37-4db2-a9d0-ecc10035dcd7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.446730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-kube-api-access-6v4n4" (OuterVolumeSpecName: "kube-api-access-6v4n4") pod "f3347c92-7e37-4db2-a9d0-ecc10035dcd7" (UID: "f3347c92-7e37-4db2-a9d0-ecc10035dcd7"). InnerVolumeSpecName "kube-api-access-6v4n4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.502586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f3347c92-7e37-4db2-a9d0-ecc10035dcd7" (UID: "f3347c92-7e37-4db2-a9d0-ecc10035dcd7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.546549 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.546608 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.546627 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6v4n4\" (UniqueName: \"kubernetes.io/projected/f3347c92-7e37-4db2-a9d0-ecc10035dcd7-kube-api-access-6v4n4\") on node \"crc\" DevicePath \"\"" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.811696 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerID="e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3" exitCode=0 Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.811809 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-76ckk" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.811816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerDied","Data":"e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3"} Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.811931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-76ckk" event={"ID":"f3347c92-7e37-4db2-a9d0-ecc10035dcd7","Type":"ContainerDied","Data":"eda10b5fd48b89c8d2e7099b5b93b0f1b70349cbd51397136ad0c343eb1daee6"} Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.811980 4769 scope.go:117] "RemoveContainer" containerID="e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.813846 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.833451 4769 scope.go:117] "RemoveContainer" containerID="a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.866753 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.880416 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.901176 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.906427 4769 scope.go:117] "RemoveContainer" containerID="69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1" Nov 21 13:16:46 crc kubenswrapper[4769]: W1121 13:16:46.910850 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c11994a_1f6a_442c_8479_180dab834496.slice/crio-90a5b9ef51eb343d2b9722ba5713456f44c2e72fdcba884a5a416e1a225709e8 WatchSource:0}: Error finding container 90a5b9ef51eb343d2b9722ba5713456f44c2e72fdcba884a5a416e1a225709e8: Status 404 returned error can't find the container with id 90a5b9ef51eb343d2b9722ba5713456f44c2e72fdcba884a5a416e1a225709e8 Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.915546 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-76ckk"] Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.927884 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-76ckk"] Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.940590 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:46 crc kubenswrapper[4769]: E1121 13:16:46.940957 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="extract-utilities" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.940971 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="extract-utilities" Nov 21 13:16:46 crc kubenswrapper[4769]: E1121 13:16:46.941015 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="registry-server" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.941022 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="registry-server" Nov 21 13:16:46 crc kubenswrapper[4769]: E1121 13:16:46.941038 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="extract-content" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.941044 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="extract-content" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.941254 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" containerName="registry-server" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.942214 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.944761 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.945207 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:16:46 crc kubenswrapper[4769]: I1121 13:16:46.950221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.046012 4769 scope.go:117] "RemoveContainer" containerID="e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3" Nov 21 13:16:47 crc kubenswrapper[4769]: E1121 13:16:47.046597 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3\": container with ID starting with e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3 not found: ID does not exist" containerID="e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.046642 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3"} err="failed to get container status \"e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3\": rpc error: code = NotFound desc = could not find container \"e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3\": container with ID starting with e41a78483397c7d8d171eb3b7cf8ae5745698bc8eb5c501f863567e0dd1e7dd3 not found: ID does not exist" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.046669 4769 scope.go:117] "RemoveContainer" containerID="a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb" Nov 21 13:16:47 crc kubenswrapper[4769]: E1121 13:16:47.047055 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb\": container with ID starting with a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb not found: ID does not exist" containerID="a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.047085 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb"} err="failed to get container status \"a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb\": rpc error: code = NotFound desc = could not find container \"a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb\": container with ID starting with a1f5dc8c1a00983f193abd42b8856445784e805c552753c12b8b4b9973419feb not found: ID does not exist" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.047101 4769 scope.go:117] "RemoveContainer" containerID="69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1" Nov 21 13:16:47 crc kubenswrapper[4769]: E1121 13:16:47.047317 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1\": container with ID starting with 69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1 not found: ID does not exist" containerID="69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.047349 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1"} err="failed to get container status \"69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1\": rpc error: code = NotFound desc = could not find container \"69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1\": container with ID starting with 69778e09a6bb2334f091eaf5efeb43cfa8ce981e0c9688cce7c93b7794d68be1 not found: ID does not exist" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.055469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-config-data\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.055528 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.055591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgh49\" (UniqueName: \"kubernetes.io/projected/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-kube-api-access-mgh49\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.055692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-logs\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.055744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.157664 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.157771 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-config-data\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.157807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.157846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mgh49\" (UniqueName: \"kubernetes.io/projected/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-kube-api-access-mgh49\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.157901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-logs\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.158365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-logs\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.163660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-config-data\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.167491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.169434 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.173591 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgh49\" (UniqueName: \"kubernetes.io/projected/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-kube-api-access-mgh49\") pod \"nova-metadata-0\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.287501 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="712cf82b-f8e2-4391-89d6-557b4c0d403c" path="/var/lib/kubelet/pods/712cf82b-f8e2-4391-89d6-557b4c0d403c/volumes" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.288477 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35bbf3e-3152-46bc-9515-333642ded235" path="/var/lib/kubelet/pods/d35bbf3e-3152-46bc-9515-333642ded235/volumes" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.289041 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3347c92-7e37-4db2-a9d0-ecc10035dcd7" path="/var/lib/kubelet/pods/f3347c92-7e37-4db2-a9d0-ecc10035dcd7/volumes" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.366207 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.829549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5c11994a-1f6a-442c-8479-180dab834496","Type":"ContainerStarted","Data":"e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372"} Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.829943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5c11994a-1f6a-442c-8479-180dab834496","Type":"ContainerStarted","Data":"90a5b9ef51eb343d2b9722ba5713456f44c2e72fdcba884a5a416e1a225709e8"} Nov 21 13:16:47 crc kubenswrapper[4769]: I1121 13:16:47.842386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:16:48 crc kubenswrapper[4769]: I1121 13:16:48.852088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5","Type":"ContainerStarted","Data":"4b77409f62864dd07617e7ba35b9a9c81076d5613f7b3a78ecbf73d25736a279"} Nov 21 13:16:48 crc kubenswrapper[4769]: I1121 13:16:48.852580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5","Type":"ContainerStarted","Data":"1f5eaf4e5330d0535285af4fb4df276bfed64f6128ffb9f07fb46eaaf00aa597"} Nov 21 13:16:48 crc kubenswrapper[4769]: I1121 13:16:48.852604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5","Type":"ContainerStarted","Data":"efad955a4fbe01df9f6a32ead3cbada075cbb06e0e64bb1d1d8f11099d2c7328"} Nov 21 13:16:48 crc kubenswrapper[4769]: I1121 13:16:48.883798 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.883779487 podStartE2EDuration="3.883779487s" podCreationTimestamp="2025-11-21 13:16:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:48.877071136 +0000 UTC m=+5167.577732974" watchObservedRunningTime="2025-11-21 13:16:48.883779487 +0000 UTC m=+5167.584441315" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.459129 4769 scope.go:117] "RemoveContainer" containerID="ea2904c509111773753e8b4f3752ef32c2f9670f1a1f373bb2ccb33275a378cd" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.491850 4769 scope.go:117] "RemoveContainer" containerID="1d623dc794ddb57c8c416420ccb01eb9b4d33c16c471a747a95e74fb8ff1f279" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.514265 4769 scope.go:117] "RemoveContainer" containerID="9a4778b350a270984c137eb79a4d2db49d7069ed5606fd6f17bc387e9d8944ef" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.543806 4769 scope.go:117] "RemoveContainer" containerID="5401fd97b2ef48dbfc2b5d69640565cfb88f8988e3d56328b99afea808b67beb" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.567020 4769 scope.go:117] "RemoveContainer" containerID="2a4609450f8a9194b63550d4f501e76842cb87df6e87a7722dc004333a5a469c" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.589101 4769 scope.go:117] "RemoveContainer" containerID="921af3a8df3310b4a813a396eeafa4a47e71d25f38d2695db22f35ded27941b5" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.612656 4769 scope.go:117] "RemoveContainer" containerID="9532177a2d3500212bf7e1d50b199515e03d4007343481106eea2e03ae665675" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.648123 4769 scope.go:117] "RemoveContainer" containerID="2ca8b06c3af120dd02e735b16a2ce782700c9797a0545898975dfe0e9fb7e4d2" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.667490 4769 scope.go:117] "RemoveContainer" containerID="23f8a542b5d7c1f93785908528c3c12d30a32293a4d0181ea48c7161f77868c7" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.687603 4769 scope.go:117] "RemoveContainer" containerID="defd5c7e8af5dfd1990c7af9fb9c5c260950d0d1876eb319abb56fc8903395db" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.712634 4769 scope.go:117] "RemoveContainer" containerID="a2935a55a0c5f438e8f50cb9b12402f1525361c791e6198d99d3c7813f69f9d1" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.740142 4769 scope.go:117] "RemoveContainer" containerID="25ba5b27062f1568ba7b9b7588cdef03b351d97989e70bfc22e3b666ece3192a" Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.865937 4769 generic.go:334] "Generic (PLEG): container finished" podID="1791c01a-d642-432a-a96e-39436b4de482" containerID="09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23" exitCode=0 Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.866026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerDied","Data":"09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23"} Nov 21 13:16:49 crc kubenswrapper[4769]: I1121 13:16:49.932702 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.932683284 podStartE2EDuration="3.932683284s" podCreationTimestamp="2025-11-21 13:16:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:16:49.922592412 +0000 UTC m=+5168.623254240" watchObservedRunningTime="2025-11-21 13:16:49.932683284 +0000 UTC m=+5168.633345112" Nov 21 13:16:51 crc kubenswrapper[4769]: I1121 13:16:51.359047 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:51 crc kubenswrapper[4769]: I1121 13:16:51.925751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerStarted","Data":"733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57"} Nov 21 13:16:51 crc kubenswrapper[4769]: I1121 13:16:51.955699 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-4qgbh" podStartSLOduration=3.5679740239999997 podStartE2EDuration="25.955672112s" podCreationTimestamp="2025-11-21 13:16:26 +0000 UTC" firstStartedPulling="2025-11-21 13:16:28.491920635 +0000 UTC m=+5147.192582463" lastFinishedPulling="2025-11-21 13:16:50.879618733 +0000 UTC m=+5169.580280551" observedRunningTime="2025-11-21 13:16:51.948753535 +0000 UTC m=+5170.649415353" watchObservedRunningTime="2025-11-21 13:16:51.955672112 +0000 UTC m=+5170.656333940" Nov 21 13:16:52 crc kubenswrapper[4769]: I1121 13:16:52.367252 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:52 crc kubenswrapper[4769]: I1121 13:16:52.367301 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:54 crc kubenswrapper[4769]: I1121 13:16:54.437399 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:54 crc kubenswrapper[4769]: I1121 13:16:54.437740 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:16:55 crc kubenswrapper[4769]: I1121 13:16:55.273537 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:16:55 crc kubenswrapper[4769]: E1121 13:16:55.274237 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:16:55 crc kubenswrapper[4769]: I1121 13:16:55.519401 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.102:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:55 crc kubenswrapper[4769]: I1121 13:16:55.519875 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.102:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:55 crc kubenswrapper[4769]: E1121 13:16:55.857686 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b\": RecentStats: unable to find data in memory cache]" Nov 21 13:16:56 crc kubenswrapper[4769]: I1121 13:16:56.359309 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:56 crc kubenswrapper[4769]: I1121 13:16:56.400594 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:56 crc kubenswrapper[4769]: I1121 13:16:56.873136 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:56 crc kubenswrapper[4769]: I1121 13:16:56.873199 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:16:57 crc kubenswrapper[4769]: I1121 13:16:57.003795 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:16:57 crc kubenswrapper[4769]: I1121 13:16:57.366965 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:57 crc kubenswrapper[4769]: I1121 13:16:57.367424 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:16:57 crc kubenswrapper[4769]: I1121 13:16:57.922416 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-4qgbh" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="registry-server" probeResult="failure" output=< Nov 21 13:16:57 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 13:16:57 crc kubenswrapper[4769]: > Nov 21 13:16:58 crc kubenswrapper[4769]: I1121 13:16:58.384458 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.104:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:16:58 crc kubenswrapper[4769]: I1121 13:16:58.384539 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.104:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:17:04 crc kubenswrapper[4769]: I1121 13:17:04.441920 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:04 crc kubenswrapper[4769]: I1121 13:17:04.442555 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:04 crc kubenswrapper[4769]: I1121 13:17:04.443053 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:04 crc kubenswrapper[4769]: I1121 13:17:04.443105 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:04 crc kubenswrapper[4769]: I1121 13:17:04.449793 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:04 crc kubenswrapper[4769]: I1121 13:17:04.454498 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:06 crc kubenswrapper[4769]: E1121 13:17:06.144835 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b\": RecentStats: unable to find data in memory cache]" Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.478552 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.479284 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-central-agent" containerID="cri-o://373fee426ce981d8b4d6c516588fe85c5c74ea526b5639bfd63dc1bbaf6b66d3" gracePeriod=30 Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.479348 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="proxy-httpd" containerID="cri-o://862833f94ed796396988195a731cbbc1aae6f881a153648ce848ccdedc713db1" gracePeriod=30 Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.479398 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-notification-agent" containerID="cri-o://8bcd8d8dbba6c26b0086dafb969189b7dc3de28adff923a2f3296cf47801b2e0" gracePeriod=30 Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.479398 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="sg-core" containerID="cri-o://f9ff48c90e20951d40a991958bb636411382fff14b52b8755c847afdfb79a175" gracePeriod=30 Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.933394 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:17:06 crc kubenswrapper[4769]: I1121 13:17:06.977841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.050347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098201 4769 generic.go:334] "Generic (PLEG): container finished" podID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerID="862833f94ed796396988195a731cbbc1aae6f881a153648ce848ccdedc713db1" exitCode=0 Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerDied","Data":"862833f94ed796396988195a731cbbc1aae6f881a153648ce848ccdedc713db1"} Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerDied","Data":"f9ff48c90e20951d40a991958bb636411382fff14b52b8755c847afdfb79a175"} Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098238 4769 generic.go:334] "Generic (PLEG): container finished" podID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerID="f9ff48c90e20951d40a991958bb636411382fff14b52b8755c847afdfb79a175" exitCode=2 Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098290 4769 generic.go:334] "Generic (PLEG): container finished" podID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerID="373fee426ce981d8b4d6c516588fe85c5c74ea526b5639bfd63dc1bbaf6b66d3" exitCode=0 Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098581 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerDied","Data":"373fee426ce981d8b4d6c516588fe85c5c74ea526b5639bfd63dc1bbaf6b66d3"} Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098940 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-log" containerID="cri-o://bd3ff6786b7e00f1bb4bf8187eaa31890654b2a7204b858fae67be12aa48a626" gracePeriod=30 Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.098962 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-api" containerID="cri-o://ecfb898577853b44a17da1917a03064e1074bb78704a133af4bd8d1ba0c2c56a" gracePeriod=30 Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.168974 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-4qgbh"] Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.372528 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.373606 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:17:07 crc kubenswrapper[4769]: I1121 13:17:07.376531 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.110760 4769 generic.go:334] "Generic (PLEG): container finished" podID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerID="8bcd8d8dbba6c26b0086dafb969189b7dc3de28adff923a2f3296cf47801b2e0" exitCode=0 Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.111037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerDied","Data":"8bcd8d8dbba6c26b0086dafb969189b7dc3de28adff923a2f3296cf47801b2e0"} Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.113995 4769 generic.go:334] "Generic (PLEG): container finished" podID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerID="bd3ff6786b7e00f1bb4bf8187eaa31890654b2a7204b858fae67be12aa48a626" exitCode=143 Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.114067 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"152a6270-6b75-4745-b45e-8deb50bdb7a2","Type":"ContainerDied","Data":"bd3ff6786b7e00f1bb4bf8187eaa31890654b2a7204b858fae67be12aa48a626"} Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.114340 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-4qgbh" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="registry-server" containerID="cri-o://733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57" gracePeriod=2 Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.126563 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.437021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.518749 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-scripts\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-config-data\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-log-httpd\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxvx4\" (UniqueName: \"kubernetes.io/projected/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-kube-api-access-rxvx4\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519277 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-ceilometer-tls-certs\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-combined-ca-bundle\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-sg-core-conf-yaml\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-run-httpd\") pod \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\" (UID: \"b37fd8f6-7247-42b8-b806-9a3c8285ceb3\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.519728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.520106 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.520467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.533435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-scripts" (OuterVolumeSpecName: "scripts") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.533467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-kube-api-access-rxvx4" (OuterVolumeSpecName: "kube-api-access-rxvx4") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "kube-api-access-rxvx4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.573093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.612802 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.621756 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.621799 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.621813 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.621833 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rxvx4\" (UniqueName: \"kubernetes.io/projected/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-kube-api-access-rxvx4\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.627048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.685418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.723571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-catalog-content\") pod \"1791c01a-d642-432a-a96e-39436b4de482\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.723641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwpzf\" (UniqueName: \"kubernetes.io/projected/1791c01a-d642-432a-a96e-39436b4de482-kube-api-access-dwpzf\") pod \"1791c01a-d642-432a-a96e-39436b4de482\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.723719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-utilities\") pod \"1791c01a-d642-432a-a96e-39436b4de482\" (UID: \"1791c01a-d642-432a-a96e-39436b4de482\") " Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.724175 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.724217 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.724988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-utilities" (OuterVolumeSpecName: "utilities") pod "1791c01a-d642-432a-a96e-39436b4de482" (UID: "1791c01a-d642-432a-a96e-39436b4de482"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.730661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1791c01a-d642-432a-a96e-39436b4de482-kube-api-access-dwpzf" (OuterVolumeSpecName: "kube-api-access-dwpzf") pod "1791c01a-d642-432a-a96e-39436b4de482" (UID: "1791c01a-d642-432a-a96e-39436b4de482"). InnerVolumeSpecName "kube-api-access-dwpzf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.731547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-config-data" (OuterVolumeSpecName: "config-data") pod "b37fd8f6-7247-42b8-b806-9a3c8285ceb3" (UID: "b37fd8f6-7247-42b8-b806-9a3c8285ceb3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.822673 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1791c01a-d642-432a-a96e-39436b4de482" (UID: "1791c01a-d642-432a-a96e-39436b4de482"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.826368 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b37fd8f6-7247-42b8-b806-9a3c8285ceb3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.826410 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.826432 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dwpzf\" (UniqueName: \"kubernetes.io/projected/1791c01a-d642-432a-a96e-39436b4de482-kube-api-access-dwpzf\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:08 crc kubenswrapper[4769]: I1121 13:17:08.826445 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1791c01a-d642-432a-a96e-39436b4de482-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.137525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b37fd8f6-7247-42b8-b806-9a3c8285ceb3","Type":"ContainerDied","Data":"673c8aed5a959eb9da0ba81eb72e8b0feb8541a30c42286b93c4552850386008"} Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.137564 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.137586 4769 scope.go:117] "RemoveContainer" containerID="862833f94ed796396988195a731cbbc1aae6f881a153648ce848ccdedc713db1" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.145629 4769 generic.go:334] "Generic (PLEG): container finished" podID="1791c01a-d642-432a-a96e-39436b4de482" containerID="733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57" exitCode=0 Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.145671 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4qgbh" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.145720 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerDied","Data":"733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57"} Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.145776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4qgbh" event={"ID":"1791c01a-d642-432a-a96e-39436b4de482","Type":"ContainerDied","Data":"6853af6e7d0d8fe8f42cf1e474a799349d46ff6943384a89afe70c5573f188e9"} Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.171955 4769 scope.go:117] "RemoveContainer" containerID="f9ff48c90e20951d40a991958bb636411382fff14b52b8755c847afdfb79a175" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.201167 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.216270 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.223934 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224315 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="extract-content" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224331 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="extract-content" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224353 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="sg-core" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224361 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="sg-core" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224374 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="registry-server" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="registry-server" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224436 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-notification-agent" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224442 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-notification-agent" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224454 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-central-agent" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224460 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-central-agent" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="proxy-httpd" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224480 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="proxy-httpd" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.224494 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="extract-utilities" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224500 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="extract-utilities" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224662 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-notification-agent" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="proxy-httpd" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224697 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="ceilometer-central-agent" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224711 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" containerName="sg-core" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.224721 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1791c01a-d642-432a-a96e-39436b4de482" containerName="registry-server" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.226343 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.229155 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.229468 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.232524 4769 scope.go:117] "RemoveContainer" containerID="8bcd8d8dbba6c26b0086dafb969189b7dc3de28adff923a2f3296cf47801b2e0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.232670 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.237674 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-4qgbh"] Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.247276 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-4qgbh"] Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.257330 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.277200 4769 scope.go:117] "RemoveContainer" containerID="373fee426ce981d8b4d6c516588fe85c5c74ea526b5639bfd63dc1bbaf6b66d3" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.285526 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1791c01a-d642-432a-a96e-39436b4de482" path="/var/lib/kubelet/pods/1791c01a-d642-432a-a96e-39436b4de482/volumes" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.286259 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b37fd8f6-7247-42b8-b806-9a3c8285ceb3" path="/var/lib/kubelet/pods/b37fd8f6-7247-42b8-b806-9a3c8285ceb3/volumes" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.298436 4769 scope.go:117] "RemoveContainer" containerID="733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.319493 4769 scope.go:117] "RemoveContainer" containerID="09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334748 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-config-data\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcb4b\" (UniqueName: \"kubernetes.io/projected/46644543-c2f6-4875-819c-399f5116e678-kube-api-access-hcb4b\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-run-httpd\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-scripts\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.334958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-log-httpd\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.335050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.348273 4769 scope.go:117] "RemoveContainer" containerID="e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.404787 4769 scope.go:117] "RemoveContainer" containerID="733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.405292 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57\": container with ID starting with 733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57 not found: ID does not exist" containerID="733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.405330 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57"} err="failed to get container status \"733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57\": rpc error: code = NotFound desc = could not find container \"733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57\": container with ID starting with 733d043e9e3f2dbfee69f1cef3e9c8a7f5d77d8d3ca52cbf490fd580ba3e0d57 not found: ID does not exist" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.405350 4769 scope.go:117] "RemoveContainer" containerID="09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.405588 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23\": container with ID starting with 09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23 not found: ID does not exist" containerID="09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.405621 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23"} err="failed to get container status \"09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23\": rpc error: code = NotFound desc = could not find container \"09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23\": container with ID starting with 09d943038375bcd252a12410ed0a1594618d138e652598658f488a93a0e4dd23 not found: ID does not exist" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.405641 4769 scope.go:117] "RemoveContainer" containerID="e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206" Nov 21 13:17:09 crc kubenswrapper[4769]: E1121 13:17:09.405846 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206\": container with ID starting with e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206 not found: ID does not exist" containerID="e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.405867 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206"} err="failed to get container status \"e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206\": rpc error: code = NotFound desc = could not find container \"e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206\": container with ID starting with e8041a3b4ad973f5f3eead533ce313daaaf609a6be5712800c0e3b9a0e1c2206 not found: ID does not exist" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.436917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.436992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-config-data\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.437052 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hcb4b\" (UniqueName: \"kubernetes.io/projected/46644543-c2f6-4875-819c-399f5116e678-kube-api-access-hcb4b\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.437099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.437123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-run-httpd\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.437140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-scripts\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.437158 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.437262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-log-httpd\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.438013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-log-httpd\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.438113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-run-httpd\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.442018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.442306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.443397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-config-data\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.444836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-scripts\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.456031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.458766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcb4b\" (UniqueName: \"kubernetes.io/projected/46644543-c2f6-4875-819c-399f5116e678-kube-api-access-hcb4b\") pod \"ceilometer-0\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.556343 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:09 crc kubenswrapper[4769]: I1121 13:17:09.849785 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:17:09 crc kubenswrapper[4769]: W1121 13:17:09.851917 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46644543_c2f6_4875_819c_399f5116e678.slice/crio-ceed50cc6601d81c53f6a1ee332b373a81a5d805cc1919db15e468f3c0b956ca WatchSource:0}: Error finding container ceed50cc6601d81c53f6a1ee332b373a81a5d805cc1919db15e468f3c0b956ca: Status 404 returned error can't find the container with id ceed50cc6601d81c53f6a1ee332b373a81a5d805cc1919db15e468f3c0b956ca Nov 21 13:17:10 crc kubenswrapper[4769]: I1121 13:17:10.161991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerStarted","Data":"ceed50cc6601d81c53f6a1ee332b373a81a5d805cc1919db15e468f3c0b956ca"} Nov 21 13:17:10 crc kubenswrapper[4769]: I1121 13:17:10.275002 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:17:10 crc kubenswrapper[4769]: E1121 13:17:10.275440 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.182538 4769 generic.go:334] "Generic (PLEG): container finished" podID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerID="ecfb898577853b44a17da1917a03064e1074bb78704a133af4bd8d1ba0c2c56a" exitCode=0 Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.182630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"152a6270-6b75-4745-b45e-8deb50bdb7a2","Type":"ContainerDied","Data":"ecfb898577853b44a17da1917a03064e1074bb78704a133af4bd8d1ba0c2c56a"} Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.525220 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.573287 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-config-data\") pod \"152a6270-6b75-4745-b45e-8deb50bdb7a2\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.573413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbdf7\" (UniqueName: \"kubernetes.io/projected/152a6270-6b75-4745-b45e-8deb50bdb7a2-kube-api-access-xbdf7\") pod \"152a6270-6b75-4745-b45e-8deb50bdb7a2\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.573499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152a6270-6b75-4745-b45e-8deb50bdb7a2-logs\") pod \"152a6270-6b75-4745-b45e-8deb50bdb7a2\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.573608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-combined-ca-bundle\") pod \"152a6270-6b75-4745-b45e-8deb50bdb7a2\" (UID: \"152a6270-6b75-4745-b45e-8deb50bdb7a2\") " Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.573965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/152a6270-6b75-4745-b45e-8deb50bdb7a2-logs" (OuterVolumeSpecName: "logs") pod "152a6270-6b75-4745-b45e-8deb50bdb7a2" (UID: "152a6270-6b75-4745-b45e-8deb50bdb7a2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.584762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/152a6270-6b75-4745-b45e-8deb50bdb7a2-kube-api-access-xbdf7" (OuterVolumeSpecName: "kube-api-access-xbdf7") pod "152a6270-6b75-4745-b45e-8deb50bdb7a2" (UID: "152a6270-6b75-4745-b45e-8deb50bdb7a2"). InnerVolumeSpecName "kube-api-access-xbdf7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.605643 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-config-data" (OuterVolumeSpecName: "config-data") pod "152a6270-6b75-4745-b45e-8deb50bdb7a2" (UID: "152a6270-6b75-4745-b45e-8deb50bdb7a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.622105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "152a6270-6b75-4745-b45e-8deb50bdb7a2" (UID: "152a6270-6b75-4745-b45e-8deb50bdb7a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.676165 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.676233 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xbdf7\" (UniqueName: \"kubernetes.io/projected/152a6270-6b75-4745-b45e-8deb50bdb7a2-kube-api-access-xbdf7\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.676249 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/152a6270-6b75-4745-b45e-8deb50bdb7a2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:11 crc kubenswrapper[4769]: I1121 13:17:11.676278 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/152a6270-6b75-4745-b45e-8deb50bdb7a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.197474 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"152a6270-6b75-4745-b45e-8deb50bdb7a2","Type":"ContainerDied","Data":"c0fab53183eaf2b1e7a04f1ab3ae9058fc21188f24bf926beba3895e95ce9612"} Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.197559 4769 scope.go:117] "RemoveContainer" containerID="ecfb898577853b44a17da1917a03064e1074bb78704a133af4bd8d1ba0c2c56a" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.197681 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.217334 4769 scope.go:117] "RemoveContainer" containerID="bd3ff6786b7e00f1bb4bf8187eaa31890654b2a7204b858fae67be12aa48a626" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.249452 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.265056 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.278552 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:17:12 crc kubenswrapper[4769]: E1121 13:17:12.279084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-api" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.279106 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-api" Nov 21 13:17:12 crc kubenswrapper[4769]: E1121 13:17:12.279129 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-log" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.279140 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-log" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.279403 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-log" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.279429 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" containerName="nova-api-api" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.281382 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.283876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.284153 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.284287 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.310933 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.392399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.392469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-config-data\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.392500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-public-tls-certs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.392516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ba837d-aafd-488c-bdff-96820a5daf6a-logs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.392576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2w9p\" (UniqueName: \"kubernetes.io/projected/47ba837d-aafd-488c-bdff-96820a5daf6a-kube-api-access-t2w9p\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.392647 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.494375 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.494428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.494464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-config-data\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.494484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-public-tls-certs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.494505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ba837d-aafd-488c-bdff-96820a5daf6a-logs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.494591 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t2w9p\" (UniqueName: \"kubernetes.io/projected/47ba837d-aafd-488c-bdff-96820a5daf6a-kube-api-access-t2w9p\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.495288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ba837d-aafd-488c-bdff-96820a5daf6a-logs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.498819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-public-tls-certs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.499029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.499581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-config-data\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.499912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.521328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2w9p\" (UniqueName: \"kubernetes.io/projected/47ba837d-aafd-488c-bdff-96820a5daf6a-kube-api-access-t2w9p\") pod \"nova-api-0\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:12 crc kubenswrapper[4769]: I1121 13:17:12.653355 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:13 crc kubenswrapper[4769]: I1121 13:17:13.142797 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:17:13 crc kubenswrapper[4769]: I1121 13:17:13.210945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerStarted","Data":"b47320a3d2fe731e7e3a4239e036ff20c1bfe115228ccdf50f0ee2042feda822"} Nov 21 13:17:13 crc kubenswrapper[4769]: I1121 13:17:13.289098 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="152a6270-6b75-4745-b45e-8deb50bdb7a2" path="/var/lib/kubelet/pods/152a6270-6b75-4745-b45e-8deb50bdb7a2/volumes" Nov 21 13:17:14 crc kubenswrapper[4769]: I1121 13:17:14.227646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"47ba837d-aafd-488c-bdff-96820a5daf6a","Type":"ContainerStarted","Data":"e9c60f877d28eb62ce1f56e55dda4115d1caad95bc3e3dba6120e911db42024a"} Nov 21 13:17:14 crc kubenswrapper[4769]: I1121 13:17:14.227887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"47ba837d-aafd-488c-bdff-96820a5daf6a","Type":"ContainerStarted","Data":"012e5492ce297f056adc793986cf2188ef1472191af4e8006d38c0eee9a51279"} Nov 21 13:17:14 crc kubenswrapper[4769]: I1121 13:17:14.231042 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerStarted","Data":"e472c1d0d8ce8ba67d21174fe003d08046d717f089a3a99b1a75948893ed69e7"} Nov 21 13:17:15 crc kubenswrapper[4769]: I1121 13:17:15.246951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"47ba837d-aafd-488c-bdff-96820a5daf6a","Type":"ContainerStarted","Data":"fe1465c6142546badbf6c7f45bf28ea5fc922646e293bd020ab58682d2407ff2"} Nov 21 13:17:15 crc kubenswrapper[4769]: I1121 13:17:15.276863 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.276840578 podStartE2EDuration="3.276840578s" podCreationTimestamp="2025-11-21 13:17:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:17:15.268602806 +0000 UTC m=+5193.969264674" watchObservedRunningTime="2025-11-21 13:17:15.276840578 +0000 UTC m=+5193.977502406" Nov 21 13:17:16 crc kubenswrapper[4769]: E1121 13:17:16.406785 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b\": RecentStats: unable to find data in memory cache]" Nov 21 13:17:17 crc kubenswrapper[4769]: I1121 13:17:17.268676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerStarted","Data":"42c646ed11e5b027a9b0341ac74e22d71d5e666945a4ba345099e83afd1ea6a9"} Nov 21 13:17:19 crc kubenswrapper[4769]: I1121 13:17:19.321987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerStarted","Data":"d6c4f8fa57cd210c43227ca6900108060f909f666becc7ea0599edb0750c0683"} Nov 21 13:17:20 crc kubenswrapper[4769]: I1121 13:17:20.330784 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:20 crc kubenswrapper[4769]: I1121 13:17:20.361038 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.198647533 podStartE2EDuration="11.361018781s" podCreationTimestamp="2025-11-21 13:17:09 +0000 UTC" firstStartedPulling="2025-11-21 13:17:09.854927165 +0000 UTC m=+5188.555588983" lastFinishedPulling="2025-11-21 13:17:19.017298393 +0000 UTC m=+5197.717960231" observedRunningTime="2025-11-21 13:17:20.354772213 +0000 UTC m=+5199.055434031" watchObservedRunningTime="2025-11-21 13:17:20.361018781 +0000 UTC m=+5199.061680599" Nov 21 13:17:22 crc kubenswrapper[4769]: I1121 13:17:22.654434 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:22 crc kubenswrapper[4769]: I1121 13:17:22.655389 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:23 crc kubenswrapper[4769]: I1121 13:17:23.670510 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.106:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:17:23 crc kubenswrapper[4769]: I1121 13:17:23.670597 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.106:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:17:24 crc kubenswrapper[4769]: I1121 13:17:24.274983 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:17:24 crc kubenswrapper[4769]: E1121 13:17:24.275542 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:17:26 crc kubenswrapper[4769]: E1121 13:17:26.728978 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b\": RecentStats: unable to find data in memory cache]" Nov 21 13:17:32 crc kubenswrapper[4769]: I1121 13:17:32.668419 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:32 crc kubenswrapper[4769]: I1121 13:17:32.671152 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:32 crc kubenswrapper[4769]: I1121 13:17:32.683972 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:32 crc kubenswrapper[4769]: I1121 13:17:32.704223 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:33 crc kubenswrapper[4769]: I1121 13:17:33.497832 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:33 crc kubenswrapper[4769]: I1121 13:17:33.505513 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:17:35 crc kubenswrapper[4769]: I1121 13:17:35.274960 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:17:35 crc kubenswrapper[4769]: E1121 13:17:35.275505 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:17:36 crc kubenswrapper[4769]: E1121 13:17:36.982351 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206b5962_83a2_4342_8a86_de0bfb354918.slice/crio-445686bcdc16036dd6f12147a5e9c22ebd45932890804e4baef82be73e801d1b\": RecentStats: unable to find data in memory cache]" Nov 21 13:17:39 crc kubenswrapper[4769]: I1121 13:17:39.570994 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.060075 4769 scope.go:117] "RemoveContainer" containerID="e092805bd57392bc944dea66cee8e98cc8cd1596cb22e01eae257ca8b1694a32" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.103697 4769 scope.go:117] "RemoveContainer" containerID="fbc8e22d3500b60d401be82ddb82650923ba7c1a02ac9f6b4280c500a79c6304" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.138874 4769 scope.go:117] "RemoveContainer" containerID="a820fbd57cdb5145022fa3dcb67dbd197e305982f91310287aac8ebf4ac783cb" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.171257 4769 scope.go:117] "RemoveContainer" containerID="85e87dc518b24c4ec2884bd507e742126b310138eccd8a0f39d227ababb6622f" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.210102 4769 scope.go:117] "RemoveContainer" containerID="45adc74c493f83053c338c16259911147510ac30d8eec3af654716733844c05d" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.246015 4769 scope.go:117] "RemoveContainer" containerID="57298bda3155381200ae1e6bb49a3c4f0a2c270e76442b8ba3ecf230459a769f" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.274925 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:17:50 crc kubenswrapper[4769]: E1121 13:17:50.275353 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.275396 4769 scope.go:117] "RemoveContainer" containerID="79ef4a73447843fd9a3b1a461f8b1ffd2d6c2a8248e4027f928854962875fb3f" Nov 21 13:17:50 crc kubenswrapper[4769]: I1121 13:17:50.318566 4769 scope.go:117] "RemoveContainer" containerID="9ea1222a4763b5e1922a4ecec40f631471cbe0ccb62a1f4746700fe65bbc4bb0" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.492391 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.493266 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" containerName="memcached" containerID="cri-o://b9e0f9d1913bd3d590345d3ee7a8525a12723763fc8a3d5fe2146f70cdc50dff" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.501938 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.502169 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-log" containerID="cri-o://1f5eaf4e5330d0535285af4fb4df276bfed64f6128ffb9f07fb46eaaf00aa597" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.502285 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-metadata" containerID="cri-o://4b77409f62864dd07617e7ba35b9a9c81076d5613f7b3a78ecbf73d25736a279" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.524812 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.525391 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="openstack-network-exporter" containerID="cri-o://f0553c50f5eec7e176bccf6ac2753aabff874d027d03af13c52e385c1a0fbe27" gracePeriod=300 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.539545 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.541221 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.549891 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.562656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.569107 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.579947 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.591269 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.591627 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="cinder-scheduler" containerID="cri-o://d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.591763 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="probe" containerID="cri-o://d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.604129 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.604386 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="e08edeba-c4cd-4f68-b02e-8c8f285582c6" containerName="openstackclient" containerID="cri-o://21c309de1ad11572d0b9256cd7e63386908a3402b3e803c9c8ac2651a7c62b56" gracePeriod=2 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.622661 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.623640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9c2f\" (UniqueName: \"kubernetes.io/projected/113d6870-bffb-4ac9-8f23-3d4463d37245-kube-api-access-t9c2f\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.623693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-combined-ca-bundle\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.623721 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.623787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data-custom\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.623811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/113d6870-bffb-4ac9-8f23-3d4463d37245-logs\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.645289 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.645554 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-log" containerID="cri-o://6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.645809 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-httpd" containerID="cri-o://4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.658591 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.658843 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="ovn-northd" containerID="cri-o://e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.658967 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="openstack-network-exporter" containerID="cri-o://8888f1576cd083e0c03bcf91d0135e5553e82f4a6bea4bc45184b3107c90ab67" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.743839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-combined-ca-bundle\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.743923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-logs\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.743988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data-custom\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744036 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/113d6870-bffb-4ac9-8f23-3d4463d37245-logs\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data-custom\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvb9\" (UniqueName: \"kubernetes.io/projected/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-kube-api-access-xmvb9\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t9c2f\" (UniqueName: \"kubernetes.io/projected/113d6870-bffb-4ac9-8f23-3d4463d37245-kube-api-access-t9c2f\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-combined-ca-bundle\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.744798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.755431 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/113d6870-bffb-4ac9-8f23-3d4463d37245-logs\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.801239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-combined-ca-bundle\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.801911 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.802216 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="5c11994a-1f6a-442c-8479-180dab834496" containerName="nova-scheduler-scheduler" containerID="cri-o://e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.910117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data-custom\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.911590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9c2f\" (UniqueName: \"kubernetes.io/projected/113d6870-bffb-4ac9-8f23-3d4463d37245-kube-api-access-t9c2f\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.932399 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data\") pod \"barbican-worker-74b4dd6b4c-mrrd6\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.942757 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.943069 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://a24f4fb6172451971f4e6d321a2dd78cac444c6c9b9e607b80b89fe2829d4afc" gracePeriod=30 Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.959207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.959310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-combined-ca-bundle\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.959386 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-logs\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.959469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data-custom\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.959554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvb9\" (UniqueName: \"kubernetes.io/projected/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-kube-api-access-xmvb9\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.960340 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-logs\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.981960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data-custom\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.982234 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c"] Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.983789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.983803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-combined-ca-bundle\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:00 crc kubenswrapper[4769]: E1121 13:18:00.984619 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e08edeba-c4cd-4f68-b02e-8c8f285582c6" containerName="openstackclient" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.984646 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08edeba-c4cd-4f68-b02e-8c8f285582c6" containerName="openstackclient" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.984937 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e08edeba-c4cd-4f68-b02e-8c8f285582c6" containerName="openstackclient" Nov 21 13:18:00 crc kubenswrapper[4769]: I1121 13:18:00.986314 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.023073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvb9\" (UniqueName: \"kubernetes.io/projected/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-kube-api-access-xmvb9\") pod \"barbican-keystone-listener-86b99bc85b-b6bvw\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.026406 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.044825 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.045042 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e1cda346-6c04-495f-991d-2e081618c5b3" containerName="nova-cell0-conductor-conductor" containerID="cri-o://0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.047374 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.062888 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/74ad1f39-faa9-412c-97e7-ad0edd13c885-logs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.062952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszzf\" (UniqueName: \"kubernetes.io/projected/74ad1f39-faa9-412c-97e7-ad0edd13c885-kube-api-access-fszzf\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.062973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.062994 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.063014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-combined-ca-bundle\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.063031 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data-custom\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.063065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.069715 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="ovsdbserver-nb" containerID="cri-o://9d6d4e88f95dec7d35e7e30f8fbc9ebf77c7e965a737068c13d6e5967ab1a03d" gracePeriod=300 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.098840 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.107519 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="openstack-network-exporter" containerID="cri-o://33796b24c53ddaa1d99134f01001f34cb4ff061dc650bf57e1b5a0465a6e44d7" gracePeriod=300 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.133707 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-5f9ff86c46-xdt6p"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.139403 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fszzf\" (UniqueName: \"kubernetes.io/projected/74ad1f39-faa9-412c-97e7-ad0edd13c885-kube-api-access-fszzf\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-combined-ca-bundle\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data-custom\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.169730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/74ad1f39-faa9-412c-97e7-ad0edd13c885-logs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.170108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/74ad1f39-faa9-412c-97e7-ad0edd13c885-logs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.170190 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.172286 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.172339 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:01.672323889 +0000 UTC m=+5240.372985707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.172503 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.172577 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:01.672568466 +0000 UTC m=+5240.373230284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.180897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-combined-ca-bundle\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.197672 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.198742 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.200298 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.200528 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" containerName="nova-cell1-conductor-conductor" containerID="cri-o://ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.204765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data-custom\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.221707 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-5f9ff86c46-xdt6p"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.232372 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="ovsdbserver-sb" containerID="cri-o://df8d1936f5e7274942337676c1b9c5c2d82487a181a6f28f8eba7af6efd88747" gracePeriod=300 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.245714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszzf\" (UniqueName: \"kubernetes.io/projected/74ad1f39-faa9-412c-97e7-ad0edd13c885-kube-api-access-fszzf\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.260009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.265801 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.266041 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api-log" containerID="cri-o://727c46869b60a9da5cf7db58b041b392b257ffa47fd5e4c83cb1fddd805f6a4f" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.266164 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api" containerID="cri-o://6681d42e9aea19c227e4a1854ff99562bf648422d81c2564511296f50a6705ee" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.271750 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-config-data\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.271822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-scripts\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.271854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-combined-ca-bundle\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.271873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.271911 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-logs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.271985 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzc4s\" (UniqueName: \"kubernetes.io/projected/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-kube-api-access-rzc4s\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.272006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-config-data\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-scripts\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377523 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-combined-ca-bundle\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-logs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.377708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rzc4s\" (UniqueName: \"kubernetes.io/projected/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-kube-api-access-rzc4s\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.379330 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.379395 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:01.879378887 +0000 UTC m=+5240.580040705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.380748 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-logs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.380875 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.380930 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:01.880912909 +0000 UTC m=+5240.581574727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.392164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-config-data\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.397770 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzc4s\" (UniqueName: \"kubernetes.io/projected/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-kube-api-access-rzc4s\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.406598 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.409164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-scripts\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.419852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-combined-ca-bundle\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.462069 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.467592 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.467639 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6f6994f598-xm7l5"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.469347 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6f6994f598-xm7l5"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.469366 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5868866f7b-tknss"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.470172 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5868866f7b-tknss"] Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.470361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.470980 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-log" containerID="cri-o://aed056b6874cbff320ebc9d162bfb88d60d2ee1a21407b0606cbbd937fe65d48" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.471248 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-httpd" containerID="cri-o://dd8e2fd78d75b0189c16396e4fe6a06f53e819a2e859dc01962e87379855181a" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.471330 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.471183 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-log" containerID="cri-o://e9c60f877d28eb62ce1f56e55dda4115d1caad95bc3e3dba6120e911db42024a" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.471682 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-api" containerID="cri-o://fe1465c6142546badbf6c7f45bf28ea5fc922646e293bd020ab58682d2407ff2" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.481328 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.543356 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.543434 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="5c11994a-1f6a-442c-8479-180dab834496" containerName="nova-scheduler-scheduler" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.591883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-combined-ca-bundle\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.591935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-fernet-keys\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.591972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.591990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-config\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-config-data\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592126 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-combined-ca-bundle\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-credential-keys\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzlt\" (UniqueName: \"kubernetes.io/projected/32a2a58b-94ff-4246-9a32-914964266c1a-kube-api-access-gwzlt\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcq9f\" (UniqueName: \"kubernetes.io/projected/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-kube-api-access-rcq9f\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592376 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-httpd-config\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592420 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-scripts\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.592439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-httpd-config\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-scripts\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-combined-ca-bundle\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-fernet-keys\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-config\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-config-data\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697913 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-combined-ca-bundle\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.697980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.698015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-credential-keys\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.698032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzlt\" (UniqueName: \"kubernetes.io/projected/32a2a58b-94ff-4246-9a32-914964266c1a-kube-api-access-gwzlt\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.698055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rcq9f\" (UniqueName: \"kubernetes.io/projected/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-kube-api-access-rcq9f\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.698487 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-internal-svc: secret "cert-keystone-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.698530 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.198516715 +0000 UTC m=+5240.899178533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699358 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699444 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.699422679 +0000 UTC m=+5241.400084497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699504 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-public-svc: secret "cert-keystone-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699580 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.199561623 +0000 UTC m=+5240.900223441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699624 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699646 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.699639335 +0000 UTC m=+5241.400301153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699684 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.699702 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.199696596 +0000 UTC m=+5240.900358414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.710364 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.710446 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.210427035 +0000 UTC m=+5240.911088853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.713115 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.713177 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.213161219 +0000 UTC m=+5240.913823037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-ovndbs" not found Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.713173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-credential-keys\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.715651 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-fernet-keys\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.725938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-httpd-config\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.733142 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-combined-ca-bundle\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.736342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-config\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.736796 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcq9f\" (UniqueName: \"kubernetes.io/projected/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-kube-api-access-rcq9f\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.740016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-scripts\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.740039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-config-data\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.746919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzlt\" (UniqueName: \"kubernetes.io/projected/32a2a58b-94ff-4246-9a32-914964266c1a-kube-api-access-gwzlt\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.765435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-combined-ca-bundle\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.848145 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="3d6ae528-025a-4c40-be99-295e541bc058" containerName="galera" containerID="cri-o://6012866497a818b2eb3242b8ea796e5f2ab75d67f83647b6ec80a589a6a09c0e" gracePeriod=30 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.867138 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.53:6080/vnc_lite.html\": dial tcp 10.217.0.53:6080: connect: connection refused" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.903685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.903820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.903979 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.904020 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.90400765 +0000 UTC m=+5241.604669468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.904451 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: E1121 13:18:01.904520 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:02.904502164 +0000 UTC m=+5241.605163982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.966948 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_32250b53-705a-499e-b2e8-f745a3819acf/ovsdbserver-sb/0.log" Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.966997 4769 generic.go:334] "Generic (PLEG): container finished" podID="32250b53-705a-499e-b2e8-f745a3819acf" containerID="33796b24c53ddaa1d99134f01001f34cb4ff061dc650bf57e1b5a0465a6e44d7" exitCode=2 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.967011 4769 generic.go:334] "Generic (PLEG): container finished" podID="32250b53-705a-499e-b2e8-f745a3819acf" containerID="df8d1936f5e7274942337676c1b9c5c2d82487a181a6f28f8eba7af6efd88747" exitCode=143 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.967051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"32250b53-705a-499e-b2e8-f745a3819acf","Type":"ContainerDied","Data":"33796b24c53ddaa1d99134f01001f34cb4ff061dc650bf57e1b5a0465a6e44d7"} Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.967076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"32250b53-705a-499e-b2e8-f745a3819acf","Type":"ContainerDied","Data":"df8d1936f5e7274942337676c1b9c5c2d82487a181a6f28f8eba7af6efd88747"} Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.970629 4769 generic.go:334] "Generic (PLEG): container finished" podID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerID="aed056b6874cbff320ebc9d162bfb88d60d2ee1a21407b0606cbbd937fe65d48" exitCode=143 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.970692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2","Type":"ContainerDied","Data":"aed056b6874cbff320ebc9d162bfb88d60d2ee1a21407b0606cbbd937fe65d48"} Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.982719 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerID="d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc" exitCode=0 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.982762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ce321fe1-25d5-48ee-85fd-46e4adb2494b","Type":"ContainerDied","Data":"d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc"} Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.992053 4769 generic.go:334] "Generic (PLEG): container finished" podID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerID="6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b" exitCode=143 Nov 21 13:18:01 crc kubenswrapper[4769]: I1121 13:18:01.992294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"303d0b55-36e2-4605-9c93-6dec4e83eac2","Type":"ContainerDied","Data":"6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.007628 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="galera" containerID="cri-o://e359038b76ee6b67178f744ae7d73bbb1f08c8833fb8e7791663f2a46008db7a" gracePeriod=30 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.018452 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6/ovsdbserver-nb/0.log" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.018499 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerID="f0553c50f5eec7e176bccf6ac2753aabff874d027d03af13c52e385c1a0fbe27" exitCode=2 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.018514 4769 generic.go:334] "Generic (PLEG): container finished" podID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerID="9d6d4e88f95dec7d35e7e30f8fbc9ebf77c7e965a737068c13d6e5967ab1a03d" exitCode=143 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.018589 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6","Type":"ContainerDied","Data":"f0553c50f5eec7e176bccf6ac2753aabff874d027d03af13c52e385c1a0fbe27"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.018624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6","Type":"ContainerDied","Data":"9d6d4e88f95dec7d35e7e30f8fbc9ebf77c7e965a737068c13d6e5967ab1a03d"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.036542 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerID="8888f1576cd083e0c03bcf91d0135e5553e82f4a6bea4bc45184b3107c90ab67" exitCode=2 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.036618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1ac90b6c-ad45-4800-992d-b89dc057f1e4","Type":"ContainerDied","Data":"8888f1576cd083e0c03bcf91d0135e5553e82f4a6bea4bc45184b3107c90ab67"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.054635 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerID="1f5eaf4e5330d0535285af4fb4df276bfed64f6128ffb9f07fb46eaaf00aa597" exitCode=143 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.054718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5","Type":"ContainerDied","Data":"1f5eaf4e5330d0535285af4fb4df276bfed64f6128ffb9f07fb46eaaf00aa597"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.067672 4769 generic.go:334] "Generic (PLEG): container finished" podID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" containerID="b9e0f9d1913bd3d590345d3ee7a8525a12723763fc8a3d5fe2146f70cdc50dff" exitCode=0 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.067738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e763d05d-9c43-40a6-90a1-327f8fce3ca9","Type":"ContainerDied","Data":"b9e0f9d1913bd3d590345d3ee7a8525a12723763fc8a3d5fe2146f70cdc50dff"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.074145 4769 generic.go:334] "Generic (PLEG): container finished" podID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerID="e9c60f877d28eb62ce1f56e55dda4115d1caad95bc3e3dba6120e911db42024a" exitCode=143 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.074215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"47ba837d-aafd-488c-bdff-96820a5daf6a","Type":"ContainerDied","Data":"e9c60f877d28eb62ce1f56e55dda4115d1caad95bc3e3dba6120e911db42024a"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.076133 4769 generic.go:334] "Generic (PLEG): container finished" podID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerID="727c46869b60a9da5cf7db58b041b392b257ffa47fd5e4c83cb1fddd805f6a4f" exitCode=143 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.076163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcda061b-5dcd-43e6-ba38-4107650d2c68","Type":"ContainerDied","Data":"727c46869b60a9da5cf7db58b041b392b257ffa47fd5e4c83cb1fddd805f6a4f"} Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.167538 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_32250b53-705a-499e-b2e8-f745a3819acf/ovsdbserver-sb/0.log" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.167900 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.214431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.214525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.214633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.214673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.214763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.214955 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215011 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:03.214994087 +0000 UTC m=+5241.915655905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-ovndbs" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215376 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215401 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:03.215393808 +0000 UTC m=+5241.916055626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215395 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-internal-svc: secret "cert-keystone-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215423 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:03.215418489 +0000 UTC m=+5241.916080307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215445 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215514 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:03.215496051 +0000 UTC m=+5241.916157869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215642 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-public-svc: secret "cert-keystone-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.215667 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:03.215660715 +0000 UTC m=+5241.916322523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwsbw\" (UniqueName: \"kubernetes.io/projected/32250b53-705a-499e-b2e8-f745a3819acf-kube-api-access-wwsbw\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-metrics-certs-tls-certs\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-scripts\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32250b53-705a-499e-b2e8-f745a3819acf-ovsdb-rundir\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-combined-ca-bundle\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-config\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.316438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-ovsdbserver-sb-tls-certs\") pod \"32250b53-705a-499e-b2e8-f745a3819acf\" (UID: \"32250b53-705a-499e-b2e8-f745a3819acf\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.317504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32250b53-705a-499e-b2e8-f745a3819acf-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.317569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-config" (OuterVolumeSpecName: "config") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.317966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-scripts" (OuterVolumeSpecName: "scripts") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.322834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32250b53-705a-499e-b2e8-f745a3819acf-kube-api-access-wwsbw" (OuterVolumeSpecName: "kube-api-access-wwsbw") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "kube-api-access-wwsbw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.338091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.418542 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wwsbw\" (UniqueName: \"kubernetes.io/projected/32250b53-705a-499e-b2e8-f745a3819acf-kube-api-access-wwsbw\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.418571 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.418580 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/32250b53-705a-499e-b2e8-f745a3819acf-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.418588 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32250b53-705a-499e-b2e8-f745a3819acf-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.418606 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.494252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.494788 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-central-agent" containerID="cri-o://b47320a3d2fe731e7e3a4239e036ff20c1bfe115228ccdf50f0ee2042feda822" gracePeriod=30 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.495334 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="proxy-httpd" containerID="cri-o://d6c4f8fa57cd210c43227ca6900108060f909f666becc7ea0599edb0750c0683" gracePeriod=30 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.495409 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="sg-core" containerID="cri-o://42c646ed11e5b027a9b0341ac74e22d71d5e666945a4ba345099e83afd1ea6a9" gracePeriod=30 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.495471 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-notification-agent" containerID="cri-o://e472c1d0d8ce8ba67d21174fe003d08046d717f089a3a99b1a75948893ed69e7" gracePeriod=30 Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.527921 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6"] Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.537637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw"] Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.541094 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6/ovsdbserver-nb/0.log" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.541185 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.544786 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.549756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.552764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.554079 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.624710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-memcached-tls-certs\") pod \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-combined-ca-bundle\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdb-rundir\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-metrics-certs-tls-certs\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tbkk\" (UniqueName: \"kubernetes.io/projected/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kube-api-access-6tbkk\") pod \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625254 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-config\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8drnb\" (UniqueName: \"kubernetes.io/projected/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-kube-api-access-8drnb\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625329 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kolla-config\") pod \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-combined-ca-bundle\") pod \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdbserver-nb-tls-certs\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625500 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-scripts\") pod \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\" (UID: \"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.625556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-config-data\") pod \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\" (UID: \"e763d05d-9c43-40a6-90a1-327f8fce3ca9\") " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.626874 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.626905 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.628357 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.637279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.638255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-config" (OuterVolumeSpecName: "config") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.638861 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.642430 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.642515 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="ovn-northd" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.642553 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-config-data" (OuterVolumeSpecName: "config-data") pod "e763d05d-9c43-40a6-90a1-327f8fce3ca9" (UID: "e763d05d-9c43-40a6-90a1-327f8fce3ca9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.643477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "e763d05d-9c43-40a6-90a1-327f8fce3ca9" (UID: "e763d05d-9c43-40a6-90a1-327f8fce3ca9"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.643577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-scripts" (OuterVolumeSpecName: "scripts") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.645803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "32250b53-705a-499e-b2e8-f745a3819acf" (UID: "32250b53-705a-499e-b2e8-f745a3819acf"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.654733 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-kube-api-access-8drnb" (OuterVolumeSpecName: "kube-api-access-8drnb") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "kube-api-access-8drnb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.657944 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.705583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kube-api-access-6tbkk" (OuterVolumeSpecName: "kube-api-access-6tbkk") pod "e763d05d-9c43-40a6-90a1-327f8fce3ca9" (UID: "e763d05d-9c43-40a6-90a1-327f8fce3ca9"). InnerVolumeSpecName "kube-api-access-6tbkk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.728597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.728754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.728623 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729091 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729125 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729138 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729149 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729159 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729167 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/32250b53-705a-499e-b2e8-f745a3819acf-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729175 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6tbkk\" (UniqueName: \"kubernetes.io/projected/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kube-api-access-6tbkk\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729183 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.728980 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.729411 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.729391005 +0000 UTC m=+5243.430052883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.729430 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.729422896 +0000 UTC m=+5243.430084804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729451 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8drnb\" (UniqueName: \"kubernetes.io/projected/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-kube-api-access-8drnb\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.729467 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/e763d05d-9c43-40a6-90a1-327f8fce3ca9-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.737701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.785852 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.802461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e763d05d-9c43-40a6-90a1-327f8fce3ca9" (UID: "e763d05d-9c43-40a6-90a1-327f8fce3ca9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.818921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "e763d05d-9c43-40a6-90a1-327f8fce3ca9" (UID: "e763d05d-9c43-40a6-90a1-327f8fce3ca9"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.828864 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49 is running failed: container process not found" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.832171 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49 is running failed: container process not found" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.833152 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49 is running failed: container process not found" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.833217 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" containerName="nova-cell1-conductor-conductor" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.836243 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.836275 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.836618 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/e763d05d-9c43-40a6-90a1-327f8fce3ca9-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.836641 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.882804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.908900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" (UID: "9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.938797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.938931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.939276 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: I1121 13:18:02.939291 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.939063 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.939362 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.939348801 +0000 UTC m=+5243.640010619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.939102 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:02 crc kubenswrapper[4769]: E1121 13:18:02.939542 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.939511095 +0000 UTC m=+5243.640172913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.085221 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" event={"ID":"113d6870-bffb-4ac9-8f23-3d4463d37245","Type":"ContainerStarted","Data":"901914345a67a13f7695774b55558fe7caa90d9b1ad63eb849d20c2636170566"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.090487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"e763d05d-9c43-40a6-90a1-327f8fce3ca9","Type":"ContainerDied","Data":"b68470f158ba2bee9a6e86c876a23815950ddfd2d545294b50afac21f6988e61"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.090537 4769 scope.go:117] "RemoveContainer" containerID="b9e0f9d1913bd3d590345d3ee7a8525a12723763fc8a3d5fe2146f70cdc50dff" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.090646 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.108489 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6/ovsdbserver-nb/0.log" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.108625 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.108777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6","Type":"ContainerDied","Data":"6a73dff3715516fde62c43de992c6bfbd38f46d816236af4e4f6f23b19a15b83"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.112569 4769 generic.go:334] "Generic (PLEG): container finished" podID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" containerID="a24f4fb6172451971f4e6d321a2dd78cac444c6c9b9e607b80b89fe2829d4afc" exitCode=0 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.112628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c","Type":"ContainerDied","Data":"a24f4fb6172451971f4e6d321a2dd78cac444c6c9b9e607b80b89fe2829d4afc"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.114373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" event={"ID":"7bd38baf-c2f2-4755-826d-27eeca7b2c1c","Type":"ContainerStarted","Data":"95cc006d680b401833c4b646ca4264c3b32a960355b9edff9b7a0fe96b695022"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.117755 4769 generic.go:334] "Generic (PLEG): container finished" podID="46644543-c2f6-4875-819c-399f5116e678" containerID="d6c4f8fa57cd210c43227ca6900108060f909f666becc7ea0599edb0750c0683" exitCode=0 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.117776 4769 generic.go:334] "Generic (PLEG): container finished" podID="46644543-c2f6-4875-819c-399f5116e678" containerID="42c646ed11e5b027a9b0341ac74e22d71d5e666945a4ba345099e83afd1ea6a9" exitCode=2 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.117782 4769 generic.go:334] "Generic (PLEG): container finished" podID="46644543-c2f6-4875-819c-399f5116e678" containerID="b47320a3d2fe731e7e3a4239e036ff20c1bfe115228ccdf50f0ee2042feda822" exitCode=0 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.117791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerDied","Data":"d6c4f8fa57cd210c43227ca6900108060f909f666becc7ea0599edb0750c0683"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.117832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerDied","Data":"42c646ed11e5b027a9b0341ac74e22d71d5e666945a4ba345099e83afd1ea6a9"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.117842 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerDied","Data":"b47320a3d2fe731e7e3a4239e036ff20c1bfe115228ccdf50f0ee2042feda822"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.131780 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_32250b53-705a-499e-b2e8-f745a3819acf/ovsdbserver-sb/0.log" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.131897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"32250b53-705a-499e-b2e8-f745a3819acf","Type":"ContainerDied","Data":"2e78cb4772e56d47d118635b27e62605a4fb99ff5aad22ff2162f02859a89aeb"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.132013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.142858 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.168623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.169905 4769 generic.go:334] "Generic (PLEG): container finished" podID="e08edeba-c4cd-4f68-b02e-8c8f285582c6" containerID="21c309de1ad11572d0b9256cd7e63386908a3402b3e803c9c8ac2651a7c62b56" exitCode=137 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.169991 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7c1e45250ec0ab6d764ce1a0f842116942aeb504b186e1ada45f3f6f7333816" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.172481 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.182468 4769 scope.go:117] "RemoveContainer" containerID="f0553c50f5eec7e176bccf6ac2753aabff874d027d03af13c52e385c1a0fbe27" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.185475 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d6ae528-025a-4c40-be99-295e541bc058" containerID="6012866497a818b2eb3242b8ea796e5f2ab75d67f83647b6ec80a589a6a09c0e" exitCode=0 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.185545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3d6ae528-025a-4c40-be99-295e541bc058","Type":"ContainerDied","Data":"6012866497a818b2eb3242b8ea796e5f2ab75d67f83647b6ec80a589a6a09c0e"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.197810 4769 generic.go:334] "Generic (PLEG): container finished" podID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" exitCode=0 Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.197870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d830c7b1-a218-4975-9ad3-75515bb3aa1c","Type":"ContainerDied","Data":"ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.197902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"d830c7b1-a218-4975-9ad3-75515bb3aa1c","Type":"ContainerDied","Data":"9fb871381a53864c5ab24b651186bdff14a2457388967b3d5ee0c6a5fd9919dd"} Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.197971 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.200764 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.214397 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.214762 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="openstack-network-exporter" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.214779 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="openstack-network-exporter" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.214795 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="ovsdbserver-sb" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.214801 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="ovsdbserver-sb" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.214811 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="openstack-network-exporter" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.214818 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="openstack-network-exporter" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.214836 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="ovsdbserver-nb" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.214895 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="ovsdbserver-nb" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.214986 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" containerName="nova-cell1-conductor-conductor" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.214994 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" containerName="nova-cell1-conductor-conductor" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.215011 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" containerName="memcached" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215046 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" containerName="memcached" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215258 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" containerName="memcached" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215292 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" containerName="nova-cell1-conductor-conductor" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215301 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="ovsdbserver-sb" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215314 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="32250b53-705a-499e-b2e8-f745a3819acf" containerName="openstack-network-exporter" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215330 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="openstack-network-exporter" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.215345 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" containerName="ovsdbserver-nb" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.216036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.221279 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.221370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-tnvrp" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.221289 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.235372 4769 scope.go:117] "RemoveContainer" containerID="9d6d4e88f95dec7d35e7e30f8fbc9ebf77c7e965a737068c13d6e5967ab1a03d" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259101 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kb6f\" (UniqueName: \"kubernetes.io/projected/d830c7b1-a218-4975-9ad3-75515bb3aa1c-kube-api-access-4kb6f\") pod \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4wzt\" (UniqueName: \"kubernetes.io/projected/e08edeba-c4cd-4f68-b02e-8c8f285582c6-kube-api-access-s4wzt\") pod \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259475 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-config-data\") pod \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-combined-ca-bundle\") pod \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\" (UID: \"d830c7b1-a218-4975-9ad3-75515bb3aa1c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259590 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config\") pod \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259671 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-combined-ca-bundle\") pod \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.259785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config-secret\") pod \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\" (UID: \"e08edeba-c4cd-4f68-b02e-8c8f285582c6\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.260145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.263282 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.263472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.263529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.263665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.263996 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.264158 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.26411476 +0000 UTC m=+5243.964776578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-ovndbs" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265303 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-public-svc: secret "cert-keystone-public-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265377 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.265359684 +0000 UTC m=+5243.966021502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-public-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265483 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265527 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.265513718 +0000 UTC m=+5243.966175576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-public-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265575 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-internal-svc: secret "cert-keystone-internal-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265602 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.26559314 +0000 UTC m=+5243.966255088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-internal-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265644 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.265677 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.265666842 +0000 UTC m=+5243.966328660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-internal-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.271503 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.273018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d830c7b1-a218-4975-9ad3-75515bb3aa1c-kube-api-access-4kb6f" (OuterVolumeSpecName: "kube-api-access-4kb6f") pod "d830c7b1-a218-4975-9ad3-75515bb3aa1c" (UID: "d830c7b1-a218-4975-9ad3-75515bb3aa1c"). InnerVolumeSpecName "kube-api-access-4kb6f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.295308 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" path="/var/lib/kubelet/pods/e763d05d-9c43-40a6-90a1-327f8fce3ca9/volumes" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.306968 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08edeba-c4cd-4f68-b02e-8c8f285582c6-kube-api-access-s4wzt" (OuterVolumeSpecName: "kube-api-access-s4wzt") pod "e08edeba-c4cd-4f68-b02e-8c8f285582c6" (UID: "e08edeba-c4cd-4f68-b02e-8c8f285582c6"). InnerVolumeSpecName "kube-api-access-s4wzt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.308017 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.325849 4769 scope.go:117] "RemoveContainer" containerID="33796b24c53ddaa1d99134f01001f34cb4ff061dc650bf57e1b5a0465a6e44d7" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.326792 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.340722 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.348863 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.357566 4769 scope.go:117] "RemoveContainer" containerID="df8d1936f5e7274942337676c1b9c5c2d82487a181a6f28f8eba7af6efd88747" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.363008 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.365633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrq5q\" (UniqueName: \"kubernetes.io/projected/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kube-api-access-jrq5q\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.365705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.365755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-config-data\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.365923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.365956 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kolla-config\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.365971 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.366017 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s4wzt\" (UniqueName: \"kubernetes.io/projected/e08edeba-c4cd-4f68-b02e-8c8f285582c6-kube-api-access-s4wzt\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.366030 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4kb6f\" (UniqueName: \"kubernetes.io/projected/d830c7b1-a218-4975-9ad3-75515bb3aa1c-kube-api-access-4kb6f\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.368281 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-nf9br" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.368644 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.369676 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.369780 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.371241 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.398356 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.409050 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.411287 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.411736 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.412168 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-b5szn" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.415406 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.416683 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.437943 4769 scope.go:117] "RemoveContainer" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468409 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kolla-config\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.468666 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jrq5q\" (UniqueName: \"kubernetes.io/projected/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kube-api-access-jrq5q\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.468787 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs podName:ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:03.968756223 +0000 UTC m=+5242.669418131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs") pod "memcached-0" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237") : secret "cert-memcached-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.468921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-config\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.469222 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-config-data\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.469295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpwbs\" (UniqueName: \"kubernetes.io/projected/cdf2d017-23db-4785-bd86-878843cd47b4-kube-api-access-rpwbs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.469457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.469481 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kolla-config\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.469733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.469759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.470135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.471129 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-config-data\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.481698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-combined-ca-bundle\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.497773 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.498681 4769 scope.go:117] "RemoveContainer" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.499141 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49\": container with ID starting with ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49 not found: ID does not exist" containerID="ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.499174 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49"} err="failed to get container status \"ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49\": rpc error: code = NotFound desc = could not find container \"ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49\": container with ID starting with ab4b159ee6db323d02be9315e0b2303744bc1f1e017a3b15a2e97c2c080f8f49 not found: ID does not exist" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.572222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-combined-ca-bundle\") pod \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.572822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-nova-novncproxy-tls-certs\") pod \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.572869 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-config-data\") pod \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-vencrypt-tls-certs\") pod \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6grr\" (UniqueName: \"kubernetes.io/projected/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-kube-api-access-m6grr\") pod \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\" (UID: \"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c\") " Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/01898107-d50e-405c-a122-83e5d3e1720e-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cp45\" (UniqueName: \"kubernetes.io/projected/01898107-d50e-405c-a122-83e5d3e1720e-kube-api-access-7cp45\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573726 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573898 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-config\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573916 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.573923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-config\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.575835 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.575948 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.576014 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.075993802 +0000 UTC m=+5242.776655620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.576478 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.576525 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.076514826 +0000 UTC m=+5242.777176744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovn-metrics" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.576875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rpwbs\" (UniqueName: \"kubernetes.io/projected/cdf2d017-23db-4785-bd86-878843cd47b4-kube-api-access-rpwbs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.577004 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.577250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-config\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.577956 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679277 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.679311 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-config\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.679585 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.179563682 +0000 UTC m=+5242.880225500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovn-metrics" not found Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.679655 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/01898107-d50e-405c-a122-83e5d3e1720e-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.679743 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.179722026 +0000 UTC m=+5242.880383954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7cp45\" (UniqueName: \"kubernetes.io/projected/01898107-d50e-405c-a122-83e5d3e1720e-kube-api-access-7cp45\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.679839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.680580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/01898107-d50e-405c-a122-83e5d3e1720e-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.681690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.683477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-config\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.684241 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.981006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrq5q\" (UniqueName: \"kubernetes.io/projected/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kube-api-access-jrq5q\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.982662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.982885 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.983377 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cp45\" (UniqueName: \"kubernetes.io/projected/01898107-d50e-405c-a122-83e5d3e1720e-kube-api-access-7cp45\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.983927 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "e08edeba-c4cd-4f68-b02e-8c8f285582c6" (UID: "e08edeba-c4cd-4f68-b02e-8c8f285582c6"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.986354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.986539 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.986581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpwbs\" (UniqueName: \"kubernetes.io/projected/cdf2d017-23db-4785-bd86-878843cd47b4-kube-api-access-rpwbs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:03 crc kubenswrapper[4769]: E1121 13:18:03.986637 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs podName:ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.986614874 +0000 UTC m=+5243.687276702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs") pod "memcached-0" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237") : secret "cert-memcached-svc" not found Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.986672 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:03 crc kubenswrapper[4769]: I1121 13:18:03.996865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-kube-api-access-m6grr" (OuterVolumeSpecName: "kube-api-access-m6grr") pod "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" (UID: "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c"). InnerVolumeSpecName "kube-api-access-m6grr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.058435 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d830c7b1-a218-4975-9ad3-75515bb3aa1c" (UID: "d830c7b1-a218-4975-9ad3-75515bb3aa1c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.080385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e08edeba-c4cd-4f68-b02e-8c8f285582c6" (UID: "e08edeba-c4cd-4f68-b02e-8c8f285582c6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.088466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.088513 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.088681 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.088705 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.088719 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m6grr\" (UniqueName: \"kubernetes.io/projected/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-kube-api-access-m6grr\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.088680 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.088759 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.088790 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.088772946 +0000 UTC m=+5243.789434774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.088808 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.088800297 +0000 UTC m=+5243.789462135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovn-metrics" not found Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.092741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" (UID: "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.097007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.100613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-config-data" (OuterVolumeSpecName: "config-data") pod "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" (UID: "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.114076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" (UID: "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.120003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "e08edeba-c4cd-4f68-b02e-8c8f285582c6" (UID: "e08edeba-c4cd-4f68-b02e-8c8f285582c6"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.151364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-config-data" (OuterVolumeSpecName: "config-data") pod "d830c7b1-a218-4975-9ad3-75515bb3aa1c" (UID: "d830c7b1-a218-4975-9ad3-75515bb3aa1c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.172080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" (UID: "2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205641 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205654 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205663 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e08edeba-c4cd-4f68-b02e-8c8f285582c6-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205675 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d830c7b1-a218-4975-9ad3-75515bb3aa1c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205684 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.205692 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.205815 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.205862 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.20584508 +0000 UTC m=+5243.906506908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovn-metrics" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.206016 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.206086 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.206067176 +0000 UTC m=+5243.906728994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.206660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.223510 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.230368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c","Type":"ContainerDied","Data":"34bf3af8f4ffc7a4449abb12ec33861f026f6d58ab9299df41ed26fc76791997"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.230501 4769 scope.go:117] "RemoveContainer" containerID="a24f4fb6172451971f4e6d321a2dd78cac444c6c9b9e607b80b89fe2829d4afc" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.234341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" event={"ID":"7bd38baf-c2f2-4755-826d-27eeca7b2c1c","Type":"ContainerStarted","Data":"01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.235604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" event={"ID":"113d6870-bffb-4ac9-8f23-3d4463d37245","Type":"ContainerStarted","Data":"8261509e5db67b1ce557d83ed76661488c4a905b3b1f4250e78780eb60cab733"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.237290 4769 generic.go:334] "Generic (PLEG): container finished" podID="83b015b4-b107-44ce-8778-c85241297661" containerID="e359038b76ee6b67178f744ae7d73bbb1f08c8833fb8e7791663f2a46008db7a" exitCode=0 Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.237336 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"83b015b4-b107-44ce-8778-c85241297661","Type":"ContainerDied","Data":"e359038b76ee6b67178f744ae7d73bbb1f08c8833fb8e7791663f2a46008db7a"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.237355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"83b015b4-b107-44ce-8778-c85241297661","Type":"ContainerDied","Data":"a996063c2b9c0e8be9e708f9b7aa4812380e8d3b42db0580183783cd740fe2ea"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.237367 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a996063c2b9c0e8be9e708f9b7aa4812380e8d3b42db0580183783cd740fe2ea" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.238584 4769 generic.go:334] "Generic (PLEG): container finished" podID="e1cda346-6c04-495f-991d-2e081618c5b3" containerID="0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7" exitCode=0 Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.238628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e1cda346-6c04-495f-991d-2e081618c5b3","Type":"ContainerDied","Data":"0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.245435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"3d6ae528-025a-4c40-be99-295e541bc058","Type":"ContainerDied","Data":"a1029e176776a153868be42233574cc188fe3e53f5b0a4ce3ad159b76ad61b19"} Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.245476 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1029e176776a153868be42233574cc188fe3e53f5b0a4ce3ad159b76ad61b19" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.252241 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.275670 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.275923 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.410147 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.410664 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:04.910648997 +0000 UTC m=+5243.611310805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.412545 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.425574 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7 is running failed: container process not found" containerID="0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.426114 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7 is running failed: container process not found" containerID="0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.426640 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7 is running failed: container process not found" containerID="0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.426704 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e1cda346-6c04-495f-991d-2e081618c5b3" containerName="nova-cell0-conductor-conductor" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.510810 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/83b015b4-b107-44ce-8778-c85241297661-config-data-generated\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.510998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-combined-ca-bundle\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.511087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-operator-scripts\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.512009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.512399 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-config-data-default\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.512583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-kolla-config\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.512740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kblgm\" (UniqueName: \"kubernetes.io/projected/83b015b4-b107-44ce-8778-c85241297661-kube-api-access-kblgm\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.513741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-galera-tls-certs\") pod \"83b015b4-b107-44ce-8778-c85241297661\" (UID: \"83b015b4-b107-44ce-8778-c85241297661\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.511297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83b015b4-b107-44ce-8778-c85241297661-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.513894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.511912 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.513865 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.514556 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/83b015b4-b107-44ce-8778-c85241297661-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.514641 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.515056 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.515295 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/83b015b4-b107-44ce-8778-c85241297661-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.576701 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.578874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b015b4-b107-44ce-8778-c85241297661-kube-api-access-kblgm" (OuterVolumeSpecName: "kube-api-access-kblgm") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "kube-api-access-kblgm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.588674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.588982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.595573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.595641 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.614486 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.619134 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kblgm\" (UniqueName: \"kubernetes.io/projected/83b015b4-b107-44ce-8778-c85241297661-kube-api-access-kblgm\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.619207 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.619229 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.634376 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.635073 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.635137 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e1cda346-6c04-495f-991d-2e081618c5b3" containerName="nova-cell0-conductor-conductor" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635148 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cda346-6c04-495f-991d-2e081618c5b3" containerName="nova-cell0-conductor-conductor" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.635171 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="galera" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635179 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="galera" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.635227 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d6ae528-025a-4c40-be99-295e541bc058" containerName="mysql-bootstrap" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635236 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6ae528-025a-4c40-be99-295e541bc058" containerName="mysql-bootstrap" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.635290 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="mysql-bootstrap" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635298 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="mysql-bootstrap" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.635308 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d6ae528-025a-4c40-be99-295e541bc058" containerName="galera" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635316 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6ae528-025a-4c40-be99-295e541bc058" containerName="galera" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635637 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e1cda346-6c04-495f-991d-2e081618c5b3" containerName="nova-cell0-conductor-conductor" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635664 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83b015b4-b107-44ce-8778-c85241297661" containerName="galera" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.635725 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d6ae528-025a-4c40-be99-295e541bc058" containerName="galera" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.636761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.642776 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.642840 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.642935 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.659722 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.675710 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.685109 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.695969 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.697338 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.699834 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.706732 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-config-data\") pod \"e1cda346-6c04-495f-991d-2e081618c5b3\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721493 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-kolla-config\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721561 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-combined-ca-bundle\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-config-data-default\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721717 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-combined-ca-bundle\") pod \"e1cda346-6c04-495f-991d-2e081618c5b3\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-galera-tls-certs\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-operator-scripts\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph9n5\" (UniqueName: \"kubernetes.io/projected/3d6ae528-025a-4c40-be99-295e541bc058-kube-api-access-ph9n5\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3d6ae528-025a-4c40-be99-295e541bc058-config-data-generated\") pod \"3d6ae528-025a-4c40-be99-295e541bc058\" (UID: \"3d6ae528-025a-4c40-be99-295e541bc058\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721926 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.721943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddtdn\" (UniqueName: \"kubernetes.io/projected/e1cda346-6c04-495f-991d-2e081618c5b3-kube-api-access-ddtdn\") pod \"e1cda346-6c04-495f-991d-2e081618c5b3\" (UID: \"e1cda346-6c04-495f-991d-2e081618c5b3\") " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.722298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.722574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwk7g\" (UniqueName: \"kubernetes.io/projected/03ac8777-8f62-4bc5-b214-281f4a01352c-kube-api-access-nwk7g\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.722687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.722694 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6ae528-025a-4c40-be99-295e541bc058-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723277 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723464 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/3d6ae528-025a-4c40-be99-295e541bc058-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723485 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.723498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.729735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6ae528-025a-4c40-be99-295e541bc058-kube-api-access-ph9n5" (OuterVolumeSpecName: "kube-api-access-ph9n5") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "kube-api-access-ph9n5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.734468 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.741105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cda346-6c04-495f-991d-2e081618c5b3-kube-api-access-ddtdn" (OuterVolumeSpecName: "kube-api-access-ddtdn") pod "e1cda346-6c04-495f-991d-2e081618c5b3" (UID: "e1cda346-6c04-495f-991d-2e081618c5b3"). InnerVolumeSpecName "kube-api-access-ddtdn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.748172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.808461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "83b015b4-b107-44ce-8778-c85241297661" (UID: "83b015b4-b107-44ce-8778-c85241297661"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.820133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e1cda346-6c04-495f-991d-2e081618c5b3" (UID: "e1cda346-6c04-495f-991d-2e081618c5b3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825241 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr6lc\" (UniqueName: \"kubernetes.io/projected/0ef4ab46-7a06-41be-ae29-ebc45d686505-kube-api-access-rr6lc\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nwk7g\" (UniqueName: \"kubernetes.io/projected/03ac8777-8f62-4bc5-b214-281f4a01352c-kube-api-access-nwk7g\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825628 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825711 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/83b015b4-b107-44ce-8778-c85241297661-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825723 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825743 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825753 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3d6ae528-025a-4c40-be99-295e541bc058-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825762 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ph9n5\" (UniqueName: \"kubernetes.io/projected/3d6ae528-025a-4c40-be99-295e541bc058-kube-api-access-ph9n5\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825772 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ddtdn\" (UniqueName: \"kubernetes.io/projected/e1cda346-6c04-495f-991d-2e081618c5b3-kube-api-access-ddtdn\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.825782 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.826391 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.826523 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.32650335 +0000 UTC m=+5244.027165168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.826833 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.826975 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.326965883 +0000 UTC m=+5244.027627701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.827099 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.827177 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.827167128 +0000 UTC m=+5247.527828946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-public-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.828474 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-internal-svc: secret "cert-barbican-internal-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.828512 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.828501844 +0000 UTC m=+5247.529163662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-internal-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.831827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-config-data" (OuterVolumeSpecName: "config-data") pod "e1cda346-6c04-495f-991d-2e081618c5b3" (UID: "e1cda346-6c04-495f-991d-2e081618c5b3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.833688 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.836682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.848819 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.850040 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwk7g\" (UniqueName: \"kubernetes.io/projected/03ac8777-8f62-4bc5-b214-281f4a01352c-kube-api-access-nwk7g\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.866753 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.234:8776/healthcheck\": read tcp 10.217.0.2:35988->10.217.1.234:8776: read: connection reset by peer" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.901973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.914854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3d6ae528-025a-4c40-be99-295e541bc058" (UID: "3d6ae528-025a-4c40-be99-295e541bc058"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.928730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.928874 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: E1121 13:18:04.928950 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:05.92892943 +0000 UTC m=+5244.629591248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.929928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.930026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rr6lc\" (UniqueName: \"kubernetes.io/projected/0ef4ab46-7a06-41be-ae29-ebc45d686505-kube-api-access-rr6lc\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.930288 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.930310 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d6ae528-025a-4c40-be99-295e541bc058-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.930323 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.930340 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1cda346-6c04-495f-991d-2e081618c5b3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.933141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.943666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:04 crc kubenswrapper[4769]: I1121 13:18:04.948930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr6lc\" (UniqueName: \"kubernetes.io/projected/0ef4ab46-7a06-41be-ae29-ebc45d686505-kube-api-access-rr6lc\") pod \"nova-cell1-conductor-0\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.026782 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.032458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.032672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.032768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.033073 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.033139 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.033121166 +0000 UTC m=+5247.733782984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.033332 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.033404 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs podName:ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.033385494 +0000 UTC m=+5245.734047332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs") pod "memcached-0" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237") : secret "cert-memcached-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.033472 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.033513 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.033499567 +0000 UTC m=+5247.734161405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.132353 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.104:8775/\": read tcp 10.217.0.2:38010->10.217.0.104:8775: read: connection reset by peer" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.132699 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.104:8775/\": read tcp 10.217.0.2:38020->10.217.0.104:8775: read: connection reset by peer" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.134857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.134906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.135151 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.135208 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.135181716 +0000 UTC m=+5245.835843534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovn-metrics" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.135246 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.135265 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.135258898 +0000 UTC m=+5245.835920716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.236559 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.236945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.237074 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.237120 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.237105712 +0000 UTC m=+5245.937767530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.237460 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.237484 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.237476722 +0000 UTC m=+5245.938138540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovn-metrics" not found Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.312015 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" podStartSLOduration=5.311987179 podStartE2EDuration="5.311987179s" podCreationTimestamp="2025-11-21 13:18:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:05.298780603 +0000 UTC m=+5243.999442441" watchObservedRunningTime="2025-11-21 13:18:05.311987179 +0000 UTC m=+5244.012648997" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.314343 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerID="4b77409f62864dd07617e7ba35b9a9c81076d5613f7b3a78ecbf73d25736a279" exitCode=0 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.320395 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c" path="/var/lib/kubelet/pods/2c0f9c8d-1ecc-4c91-a4a1-1792fa6ec73c/volumes" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.321022 4769 generic.go:334] "Generic (PLEG): container finished" podID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerID="fe1465c6142546badbf6c7f45bf28ea5fc922646e293bd020ab58682d2407ff2" exitCode=0 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.322800 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32250b53-705a-499e-b2e8-f745a3819acf" path="/var/lib/kubelet/pods/32250b53-705a-499e-b2e8-f745a3819acf/volumes" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.329467 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6" path="/var/lib/kubelet/pods/9f3cc368-b9a6-4d03-915e-39e5c9a1ecd6/volumes" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.330053 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d830c7b1-a218-4975-9ad3-75515bb3aa1c" path="/var/lib/kubelet/pods/d830c7b1-a218-4975-9ad3-75515bb3aa1c/volumes" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338415 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08edeba-c4cd-4f68-b02e-8c8f285582c6" path="/var/lib/kubelet/pods/e08edeba-c4cd-4f68-b02e-8c8f285582c6/volumes" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338731 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.338798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.338956 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339006 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.338991246 +0000 UTC m=+5248.039653064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-ovndbs" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339364 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339390 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.339381517 +0000 UTC m=+5248.040043335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-internal-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339425 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-public-svc: secret "cert-keystone-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339442 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.339436778 +0000 UTC m=+5248.040098596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339471 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-internal-svc: secret "cert-keystone-internal-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339489 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.33948254 +0000 UTC m=+5248.040144348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-internal-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339520 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339536 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:06.339530701 +0000 UTC m=+5245.040192519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339565 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339579 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.339574272 +0000 UTC m=+5248.040236090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339607 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.339623 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:06.339618533 +0000 UTC m=+5245.040280351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.343932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" event={"ID":"113d6870-bffb-4ac9-8f23-3d4463d37245","Type":"ContainerStarted","Data":"3a41d8e27027f69228803146853ccc8f5dad3ec8ba14125f317fc0a8d9eaa800"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.343984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5","Type":"ContainerDied","Data":"4b77409f62864dd07617e7ba35b9a9c81076d5613f7b3a78ecbf73d25736a279"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.344036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"47ba837d-aafd-488c-bdff-96820a5daf6a","Type":"ContainerDied","Data":"fe1465c6142546badbf6c7f45bf28ea5fc922646e293bd020ab58682d2407ff2"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.345109 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.345364 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker-log" containerID="cri-o://4f8f1f9db0e4143f84aee90e6923931e5b99b72770c4cdf54742aae36679e761" gracePeriod=30 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.345908 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker" containerID="cri-o://e083fdef73808cdcadc8a5eebaa41ece176f6935c9510d1818ee8189eca45284" gracePeriod=30 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.367794 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.368420 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.368518 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e1cda346-6c04-495f-991d-2e081618c5b3","Type":"ContainerDied","Data":"8200570c477128db50ce7dd54dcc9b3ba8c8d7bd35353b294ae070d599e6b021"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.368552 4769 scope.go:117] "RemoveContainer" containerID="0ee4d85a61545a4b32a5793cb8c1e451be1a8b45221ff85583ba72e1a07414a7" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.403870 4769 generic.go:334] "Generic (PLEG): container finished" podID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerID="6681d42e9aea19c227e4a1854ff99562bf648422d81c2564511296f50a6705ee" exitCode=0 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.403960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcda061b-5dcd-43e6-ba38-4107650d2c68","Type":"ContainerDied","Data":"6681d42e9aea19c227e4a1854ff99562bf648422d81c2564511296f50a6705ee"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.454660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" event={"ID":"7bd38baf-c2f2-4755-826d-27eeca7b2c1c","Type":"ContainerStarted","Data":"63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.497328 4769 generic.go:334] "Generic (PLEG): container finished" podID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerID="dd8e2fd78d75b0189c16396e4fe6a06f53e819a2e859dc01962e87379855181a" exitCode=0 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.497417 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.506601 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" podStartSLOduration=5.506578441 podStartE2EDuration="5.506578441s" podCreationTimestamp="2025-11-21 13:18:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:05.484982959 +0000 UTC m=+5244.185644777" watchObservedRunningTime="2025-11-21 13:18:05.506578441 +0000 UTC m=+5244.207240259" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.510313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2","Type":"ContainerDied","Data":"dd8e2fd78d75b0189c16396e4fe6a06f53e819a2e859dc01962e87379855181a"} Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.510453 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.510959 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.529996 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.530239 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener-log" containerID="cri-o://7100f7dfd87d9df473edc7e27cf9a8b56bd937ff687861cb12558e4b1fedb2d2" gracePeriod=30 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.530822 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener" containerID="cri-o://31c5364f0b49ac3f12d434c67d9370c9442a0c8c9c541dc56c1a8e59739610e0" gracePeriod=30 Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-642b7\" (UniqueName: \"kubernetes.io/projected/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-kube-api-access-642b7\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-scripts\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546501 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-config-data\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546523 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-combined-ca-bundle\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-logs\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-httpd-run\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.546741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-internal-tls-certs\") pod \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\" (UID: \"83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2\") " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.559682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.561520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-logs" (OuterVolumeSpecName: "logs") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.566316 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.566817 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.771894 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.800250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-kube-api-access-642b7" (OuterVolumeSpecName: "kube-api-access-642b7") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "kube-api-access-642b7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.801443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.803381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-scripts" (OuterVolumeSpecName: "scripts") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.808009 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.820962 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.821497 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-log" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.821602 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-log" Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.821690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-httpd" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.821746 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-httpd" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.821987 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-httpd" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.822152 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" containerName="glance-log" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.823153 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.823509 4769 scope.go:117] "RemoveContainer" containerID="dd8e2fd78d75b0189c16396e4fe6a06f53e819a2e859dc01962e87379855181a" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.827084 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.827395 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.827590 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-8x57j" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.827996 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.836271 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.859096 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.874393 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.881254 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.881287 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-642b7\" (UniqueName: \"kubernetes.io/projected/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-kube-api-access-642b7\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.881298 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.888666 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.891112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.893520 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.894177 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.894399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ngfw2" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.894545 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.899658 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.907791 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.922006 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.948261 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.950617 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.959995 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.960737 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.982814 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-kolla-config\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.982939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-generated\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6r4v\" (UniqueName: \"kubernetes.io/projected/db108581-e980-4f5b-a0b8-56e3477ff0c2-kube-api-access-k6r4v\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-default\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983490 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck4mz\" (UniqueName: \"kubernetes.io/projected/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kube-api-access-ck4mz\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983723 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.983804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-operator-scripts\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.984041 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: E1121 13:18:05.984117 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.984100904 +0000 UTC m=+5246.684762722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:05 crc kubenswrapper[4769]: I1121 13:18:05.992335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-config-data" (OuterVolumeSpecName: "config-data") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.010714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:18:06 crc kubenswrapper[4769]: W1121 13:18:06.040213 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ef4ab46_7a06_41be_ae29_ebc45d686505.slice/crio-e45ffdb9c9ff13fbd5275f7e1cade26ac32de7e86fa9e51827304beaa3b030f9 WatchSource:0}: Error finding container e45ffdb9c9ff13fbd5275f7e1cade26ac32de7e86fa9e51827304beaa3b030f9: Status 404 returned error can't find the container with id e45ffdb9c9ff13fbd5275f7e1cade26ac32de7e86fa9e51827304beaa3b030f9 Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.087080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.087695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrmjg\" (UniqueName: \"kubernetes.io/projected/d17f3666-e78c-4e03-8509-14d6cdea4083-kube-api-access-rrmjg\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.087802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6r4v\" (UniqueName: \"kubernetes.io/projected/db108581-e980-4f5b-a0b8-56e3477ff0c2-kube-api-access-k6r4v\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.087928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088256 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-default\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ck4mz\" (UniqueName: \"kubernetes.io/projected/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kube-api-access-ck4mz\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.088998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-operator-scripts\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089363 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-kolla-config\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-generated\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.089930 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.090337 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.091473 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: E1121 13:18:06.092818 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Nov 21 13:18:06 crc kubenswrapper[4769]: E1121 13:18:06.092890 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs podName:db108581-e980-4f5b-a0b8-56e3477ff0c2 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:06.592870235 +0000 UTC m=+5245.293532053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs") pod "openstack-galera-0" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2") : secret "cert-galera-openstack-svc" not found Nov 21 13:18:06 crc kubenswrapper[4769]: E1121 13:18:06.093067 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Nov 21 13:18:06 crc kubenswrapper[4769]: E1121 13:18:06.093098 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs podName:dd5c9de7-9929-4ae7-8c6b-45b980c15e9f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:06.59309009 +0000 UTC m=+5245.293751908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f") : secret "cert-galera-openstack-cell1-svc" not found Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.094815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.095554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.096744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-operator-scripts\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.097150 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-kolla-config\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.097442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-generated\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.097830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.099053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.111702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck4mz\" (UniqueName: \"kubernetes.io/projected/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kube-api-access-ck4mz\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.112174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-default\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.113328 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.119120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.124949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6r4v\" (UniqueName: \"kubernetes.io/projected/db108581-e980-4f5b-a0b8-56e3477ff0c2-kube-api-access-k6r4v\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.134301 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.148567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.171218 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" (UID: "83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:06 crc kubenswrapper[4769]: I1121 13:18:06.176463 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.192905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.201014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.201567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.201615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rrmjg\" (UniqueName: \"kubernetes.io/projected/d17f3666-e78c-4e03-8509-14d6cdea4083-kube-api-access-rrmjg\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.201744 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.201758 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.201771 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.208659 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.210654 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.227944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrmjg\" (UniqueName: \"kubernetes.io/projected/d17f3666-e78c-4e03-8509-14d6cdea4083-kube-api-access-rrmjg\") pod \"nova-cell0-conductor-0\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.359705 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372 is running failed: container process not found" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.360015 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372 is running failed: container process not found" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.360364 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372 is running failed: container process not found" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.360390 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="5c11994a-1f6a-442c-8479-180dab834496" containerName="nova-scheduler-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.404869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.404926 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.406140 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.406200 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.406170995 +0000 UTC m=+5247.106832813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.406331 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.406474 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.406444812 +0000 UTC m=+5247.107106630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.423063 4769 scope.go:117] "RemoveContainer" containerID="aed056b6874cbff320ebc9d162bfb88d60d2ee1a21407b0606cbbd937fe65d48" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.423997 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.428945 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.477107 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506042 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-config-data\") pod \"47ba837d-aafd-488c-bdff-96820a5daf6a\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-public-tls-certs\") pod \"47ba837d-aafd-488c-bdff-96820a5daf6a\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506232 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-combined-ca-bundle\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506262 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-combined-ca-bundle\") pod \"47ba837d-aafd-488c-bdff-96820a5daf6a\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-internal-tls-certs\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gckpk\" (UniqueName: \"kubernetes.io/projected/dcda061b-5dcd-43e6-ba38-4107650d2c68-kube-api-access-gckpk\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-public-tls-certs\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506487 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcda061b-5dcd-43e6-ba38-4107650d2c68-etc-machine-id\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506523 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-scripts\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcda061b-5dcd-43e6-ba38-4107650d2c68-logs\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2w9p\" (UniqueName: \"kubernetes.io/projected/47ba837d-aafd-488c-bdff-96820a5daf6a-kube-api-access-t2w9p\") pod \"47ba837d-aafd-488c-bdff-96820a5daf6a\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506686 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data-custom\") pod \"dcda061b-5dcd-43e6-ba38-4107650d2c68\" (UID: \"dcda061b-5dcd-43e6-ba38-4107650d2c68\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-internal-tls-certs\") pod \"47ba837d-aafd-488c-bdff-96820a5daf6a\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.506804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ba837d-aafd-488c-bdff-96820a5daf6a-logs\") pod \"47ba837d-aafd-488c-bdff-96820a5daf6a\" (UID: \"47ba837d-aafd-488c-bdff-96820a5daf6a\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.508883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ba837d-aafd-488c-bdff-96820a5daf6a-logs" (OuterVolumeSpecName: "logs") pod "47ba837d-aafd-488c-bdff-96820a5daf6a" (UID: "47ba837d-aafd-488c-bdff-96820a5daf6a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.509542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/dcda061b-5dcd-43e6-ba38-4107650d2c68-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.518460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ba837d-aafd-488c-bdff-96820a5daf6a-kube-api-access-t2w9p" (OuterVolumeSpecName: "kube-api-access-t2w9p") pod "47ba837d-aafd-488c-bdff-96820a5daf6a" (UID: "47ba837d-aafd-488c-bdff-96820a5daf6a"). InnerVolumeSpecName "kube-api-access-t2w9p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.518886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcda061b-5dcd-43e6-ba38-4107650d2c68-logs" (OuterVolumeSpecName: "logs") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.538172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-scripts" (OuterVolumeSpecName: "scripts") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.548276 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.581538 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.585449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcda061b-5dcd-43e6-ba38-4107650d2c68-kube-api-access-gckpk" (OuterVolumeSpecName: "kube-api-access-gckpk") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "kube-api-access-gckpk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.585632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.588559 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c11994a-1f6a-442c-8479-180dab834496" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" exitCode=0 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.588648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5c11994a-1f6a-442c-8479-180dab834496","Type":"ContainerDied","Data":"e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.588677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"5c11994a-1f6a-442c-8479-180dab834496","Type":"ContainerDied","Data":"90a5b9ef51eb343d2b9722ba5713456f44c2e72fdcba884a5a416e1a225709e8"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.588687 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a5b9ef51eb343d2b9722ba5713456f44c2e72fdcba884a5a416e1a225709e8" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.592510 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.593680 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.595669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"47ba837d-aafd-488c-bdff-96820a5daf6a","Type":"ContainerDied","Data":"012e5492ce297f056adc793986cf2188ef1472191af4e8006d38c0eee9a51279"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.595713 4769 scope.go:117] "RemoveContainer" containerID="fe1465c6142546badbf6c7f45bf28ea5fc922646e293bd020ab58682d2407ff2" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.595837 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603075 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603569 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603587 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api-log" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603607 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603614 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603645 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603653 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-log" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603664 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-api" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603670 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-api" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603681 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603690 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-log" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603705 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603712 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-log" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603731 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-metadata" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603738 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-metadata" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.603746 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-httpd" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603752 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-httpd" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603952 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-api" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603975 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.603989 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-httpd" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.604005 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" containerName="cinder-api" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.604017 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerName="glance-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.604030 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-metadata" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.604043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" containerName="nova-metadata-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.604057 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" containerName="nova-api-log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.605677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613203 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-logs\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-config-data\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613415 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-public-tls-certs\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613440 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-combined-ca-bundle\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-httpd-run\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613521 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-config-data\") pod \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613541 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-scripts\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613585 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsskt\" (UniqueName: \"kubernetes.io/projected/303d0b55-36e2-4605-9c93-6dec4e83eac2-kube-api-access-tsskt\") pod \"303d0b55-36e2-4605-9c93-6dec4e83eac2\" (UID: \"303d0b55-36e2-4605-9c93-6dec4e83eac2\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-nova-metadata-tls-certs\") pod \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgh49\" (UniqueName: \"kubernetes.io/projected/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-kube-api-access-mgh49\") pod \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-logs\") pod \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.613738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-combined-ca-bundle\") pod \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\" (UID: \"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.615920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-logs" (OuterVolumeSpecName: "logs") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.618422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-logs" (OuterVolumeSpecName: "logs") pod "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" (UID: "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.627376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.627424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628011 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47ba837d-aafd-488c-bdff-96820a5daf6a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628024 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628034 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628045 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gckpk\" (UniqueName: \"kubernetes.io/projected/dcda061b-5dcd-43e6-ba38-4107650d2c68-kube-api-access-gckpk\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628056 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/dcda061b-5dcd-43e6-ba38-4107650d2c68-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628064 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628072 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dcda061b-5dcd-43e6-ba38-4107650d2c68-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628081 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t2w9p\" (UniqueName: \"kubernetes.io/projected/47ba837d-aafd-488c-bdff-96820a5daf6a-kube-api-access-t2w9p\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628091 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628569 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.628741 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.629928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.631246 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.631312 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs podName:db108581-e980-4f5b-a0b8-56e3477ff0c2 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.63129365 +0000 UTC m=+5246.331955468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs") pod "openstack-galera-0" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2") : secret "cert-galera-openstack-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.631743 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.631774 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs podName:dd5c9de7-9929-4ae7-8c6b-45b980c15e9f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.631764222 +0000 UTC m=+5246.332426040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f") : secret "cert-galera-openstack-cell1-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.632009 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.636490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-scripts" (OuterVolumeSpecName: "scripts") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.637703 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.638647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"dcda061b-5dcd-43e6-ba38-4107650d2c68","Type":"ContainerDied","Data":"8bc2c1d7651576dd99ac2da60a156033057724f9e715fe9e064444c25bdd31a9"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.641397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.650067 4769 scope.go:117] "RemoveContainer" containerID="e9c60f877d28eb62ce1f56e55dda4115d1caad95bc3e3dba6120e911db42024a" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.652539 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-kube-api-access-mgh49" (OuterVolumeSpecName: "kube-api-access-mgh49") pod "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" (UID: "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5"). InnerVolumeSpecName "kube-api-access-mgh49". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.659153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/303d0b55-36e2-4605-9c93-6dec4e83eac2-kube-api-access-tsskt" (OuterVolumeSpecName: "kube-api-access-tsskt") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "kube-api-access-tsskt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.663462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.687732 4769 generic.go:334] "Generic (PLEG): container finished" podID="64e92b59-ae64-4236-8fef-a857b35df619" containerID="7100f7dfd87d9df473edc7e27cf9a8b56bd937ff687861cb12558e4b1fedb2d2" exitCode=143 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.687831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" event={"ID":"64e92b59-ae64-4236-8fef-a857b35df619","Type":"ContainerDied","Data":"7100f7dfd87d9df473edc7e27cf9a8b56bd937ff687861cb12558e4b1fedb2d2"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.688454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47ba837d-aafd-488c-bdff-96820a5daf6a" (UID: "47ba837d-aafd-488c-bdff-96820a5daf6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.690353 4769 generic.go:334] "Generic (PLEG): container finished" podID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerID="4f8f1f9db0e4143f84aee90e6923931e5b99b72770c4cdf54742aae36679e761" exitCode=143 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.690426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" event={"ID":"f587d35f-67ee-497c-8d1b-00cd19e6a42a","Type":"ContainerDied","Data":"4f8f1f9db0e4143f84aee90e6923931e5b99b72770c4cdf54742aae36679e761"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.702104 4769 scope.go:117] "RemoveContainer" containerID="6681d42e9aea19c227e4a1854ff99562bf648422d81c2564511296f50a6705ee" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.715671 4769 generic.go:334] "Generic (PLEG): container finished" podID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerID="d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6" exitCode=0 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.715765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ce321fe1-25d5-48ee-85fd-46e4adb2494b","Type":"ContainerDied","Data":"d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.715793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"ce321fe1-25d5-48ee-85fd-46e4adb2494b","Type":"ContainerDied","Data":"46438690470dfc0a0e110303a191117fe74676e874ea4383edc6a9ecdb5d28b7"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.715848 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.722302 4769 generic.go:334] "Generic (PLEG): container finished" podID="303d0b55-36e2-4605-9c93-6dec4e83eac2" containerID="4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac" exitCode=0 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.722426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"303d0b55-36e2-4605-9c93-6dec4e83eac2","Type":"ContainerDied","Data":"4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.722453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"303d0b55-36e2-4605-9c93-6dec4e83eac2","Type":"ContainerDied","Data":"62021feb93db9a7b8e18b86b59878400a63d3e4df2a1f381519d90503262e9f0"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.722532 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-combined-ca-bundle\") pod \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731482 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data\") pod \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data-custom\") pod \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-combined-ca-bundle\") pod \"5c11994a-1f6a-442c-8479-180dab834496\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rstkr\" (UniqueName: \"kubernetes.io/projected/5c11994a-1f6a-442c-8479-180dab834496-kube-api-access-rstkr\") pod \"5c11994a-1f6a-442c-8479-180dab834496\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-scripts\") pod \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.731998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84b85\" (UniqueName: \"kubernetes.io/projected/ce321fe1-25d5-48ee-85fd-46e4adb2494b-kube-api-access-84b85\") pod \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ce321fe1-25d5-48ee-85fd-46e4adb2494b-etc-machine-id\") pod \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\" (UID: \"ce321fe1-25d5-48ee-85fd-46e4adb2494b\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-config-data\") pod \"5c11994a-1f6a-442c-8479-180dab834496\" (UID: \"5c11994a-1f6a-442c-8479-180dab834496\") " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732841 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nwlz\" (UniqueName: \"kubernetes.io/projected/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-kube-api-access-5nwlz\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732870 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.732969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-logs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733169 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mgh49\" (UniqueName: \"kubernetes.io/projected/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-kube-api-access-mgh49\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733203 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733230 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733243 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/303d0b55-36e2-4605-9c93-6dec4e83eac2-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733256 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.733269 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tsskt\" (UniqueName: \"kubernetes.io/projected/303d0b55-36e2-4605-9c93-6dec4e83eac2-kube-api-access-tsskt\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.737677 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerStarted","Data":"e45ffdb9c9ff13fbd5275f7e1cade26ac32de7e86fa9e51827304beaa3b030f9"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.738640 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.739013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-config-data" (OuterVolumeSpecName: "config-data") pod "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" (UID: "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.739807 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ce321fe1-25d5-48ee-85fd-46e4adb2494b-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ce321fe1-25d5-48ee-85fd-46e4adb2494b" (UID: "ce321fe1-25d5-48ee-85fd-46e4adb2494b"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.755310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data" (OuterVolumeSpecName: "config-data") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.776338 4769 scope.go:117] "RemoveContainer" containerID="727c46869b60a9da5cf7db58b041b392b257ffa47fd5e4c83cb1fddd805f6a4f" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.776380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c11994a-1f6a-442c-8479-180dab834496-kube-api-access-rstkr" (OuterVolumeSpecName: "kube-api-access-rstkr") pod "5c11994a-1f6a-442c-8479-180dab834496" (UID: "5c11994a-1f6a-442c-8479-180dab834496"). InnerVolumeSpecName "kube-api-access-rstkr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.776405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ce321fe1-25d5-48ee-85fd-46e4adb2494b" (UID: "ce321fe1-25d5-48ee-85fd-46e4adb2494b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.776447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-scripts" (OuterVolumeSpecName: "scripts") pod "ce321fe1-25d5-48ee-85fd-46e4adb2494b" (UID: "ce321fe1-25d5-48ee-85fd-46e4adb2494b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.791396 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.793435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5","Type":"ContainerDied","Data":"efad955a4fbe01df9f6a32ead3cbada075cbb06e0e64bb1d1d8f11099d2c7328"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.799450 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.799417019 podStartE2EDuration="2.799417019s" podCreationTimestamp="2025-11-21 13:18:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:06.796649214 +0000 UTC m=+5245.497311032" watchObservedRunningTime="2025-11-21 13:18:06.799417019 +0000 UTC m=+5245.500078847" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.809658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce321fe1-25d5-48ee-85fd-46e4adb2494b-kube-api-access-84b85" (OuterVolumeSpecName: "kube-api-access-84b85") pod "ce321fe1-25d5-48ee-85fd-46e4adb2494b" (UID: "ce321fe1-25d5-48ee-85fd-46e4adb2494b"). InnerVolumeSpecName "kube-api-access-84b85". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.844014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.844446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.844754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.844916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.844955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.844980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5nwlz\" (UniqueName: \"kubernetes.io/projected/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-kube-api-access-5nwlz\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.845102 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-internal-svc: secret "cert-glance-default-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:06.845157 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs podName:1cb6ac7f-13cf-4627-986b-bff3ff6be5a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:07.34514174 +0000 UTC m=+5246.045803558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs") pod "glance-default-internal-api-0" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4") : secret "cert-glance-default-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845204 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845228 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-logs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845404 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845418 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845430 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rstkr\" (UniqueName: \"kubernetes.io/projected/5c11994a-1f6a-442c-8479-180dab834496-kube-api-access-rstkr\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845445 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845457 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845467 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-84b85\" (UniqueName: \"kubernetes.io/projected/ce321fe1-25d5-48ee-85fd-46e4adb2494b-kube-api-access-84b85\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.845479 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ce321fe1-25d5-48ee-85fd-46e4adb2494b-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.847314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-logs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.848108 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.849363 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.851900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.865614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.865999 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.870941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.873201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c11994a-1f6a-442c-8479-180dab834496" (UID: "5c11994a-1f6a-442c-8479-180dab834496"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.884339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nwlz\" (UniqueName: \"kubernetes.io/projected/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-kube-api-access-5nwlz\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.884405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-config-data" (OuterVolumeSpecName: "config-data") pod "47ba837d-aafd-488c-bdff-96820a5daf6a" (UID: "47ba837d-aafd-488c-bdff-96820a5daf6a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.903579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" (UID: "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.907981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.911301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "47ba837d-aafd-488c-bdff-96820a5daf6a" (UID: "47ba837d-aafd-488c-bdff-96820a5daf6a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.927109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-config-data" (OuterVolumeSpecName: "config-data") pod "5c11994a-1f6a-442c-8479-180dab834496" (UID: "5c11994a-1f6a-442c-8479-180dab834496"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.931933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.944730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ce321fe1-25d5-48ee-85fd-46e4adb2494b" (UID: "ce321fe1-25d5-48ee-85fd-46e4adb2494b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947664 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947687 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947700 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5c11994a-1f6a-442c-8479-180dab834496-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947709 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947717 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947729 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947737 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947745 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.947753 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.951185 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "47ba837d-aafd-488c-bdff-96820a5daf6a" (UID: "47ba837d-aafd-488c-bdff-96820a5daf6a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.951585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-config-data" (OuterVolumeSpecName: "config-data") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.958292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.975675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" (UID: "ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.977997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "303d0b55-36e2-4605-9c93-6dec4e83eac2" (UID: "303d0b55-36e2-4605-9c93-6dec4e83eac2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.988768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "dcda061b-5dcd-43e6-ba38-4107650d2c68" (UID: "dcda061b-5dcd-43e6-ba38-4107650d2c68"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:06.996098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data" (OuterVolumeSpecName: "config-data") pod "ce321fe1-25d5-48ee-85fd-46e4adb2494b" (UID: "ce321fe1-25d5-48ee-85fd-46e4adb2494b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049766 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47ba837d-aafd-488c-bdff-96820a5daf6a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049779 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049792 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dcda061b-5dcd-43e6-ba38-4107650d2c68-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049800 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ce321fe1-25d5-48ee-85fd-46e4adb2494b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049809 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049819 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.049828 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/303d0b55-36e2-4605-9c93-6dec4e83eac2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.049878 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.049981 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs podName:ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.049962628 +0000 UTC m=+5249.750624446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs") pod "memcached-0" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237") : secret "cert-memcached-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.153563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.153658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.153720 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.153905 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.153885138 +0000 UTC m=+5249.854546956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.154037 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.154359 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.15434119 +0000 UTC m=+5249.855003038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovn-metrics" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.255279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.255384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.255445 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.255505 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.255488255 +0000 UTC m=+5249.956150073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovn-metrics" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.255548 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.255614 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.255594528 +0000 UTC m=+5249.956256466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.291871 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6ae528-025a-4c40-be99-295e541bc058" path="/var/lib/kubelet/pods/3d6ae528-025a-4c40-be99-295e541bc058/volumes" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.292595 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b015b4-b107-44ce-8778-c85241297661" path="/var/lib/kubelet/pods/83b015b4-b107-44ce-8778-c85241297661/volumes" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.293708 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2" path="/var/lib/kubelet/pods/83fa5ff4-d052-43d6-94da-a7b1bc2ba0f2/volumes" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.294580 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cda346-6c04-495f-991d-2e081618c5b3" path="/var/lib/kubelet/pods/e1cda346-6c04-495f-991d-2e081618c5b3/volumes" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.355311 4769 scope.go:117] "RemoveContainer" containerID="d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.358293 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.359251 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-internal-svc: secret "cert-glance-default-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.359292 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs podName:1cb6ac7f-13cf-4627-986b-bff3ff6be5a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.359278631 +0000 UTC m=+5247.059940449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs") pod "glance-default-internal-api-0" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4") : secret "cert-glance-default-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.426482 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="e763d05d-9c43-40a6-90a1-327f8fce3ca9" containerName="memcached" probeResult="failure" output="dial tcp 10.217.1.191:11211: i/o timeout" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.432626 4769 scope.go:117] "RemoveContainer" containerID="d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.445656 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.474767 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.491250 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.519245 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.519749 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="probe" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.519762 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="probe" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.519780 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c11994a-1f6a-442c-8479-180dab834496" containerName="nova-scheduler-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.519787 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c11994a-1f6a-442c-8479-180dab834496" containerName="nova-scheduler-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.519823 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="cinder-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.519830 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="cinder-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.520004 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c11994a-1f6a-442c-8479-180dab834496" containerName="nova-scheduler-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.520016 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="probe" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.520035 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" containerName="cinder-scheduler" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.521036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.531923 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.532139 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.532267 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.536547 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.544320 4769 scope.go:117] "RemoveContainer" containerID="d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.551768 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc\": container with ID starting with d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc not found: ID does not exist" containerID="d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.551814 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc"} err="failed to get container status \"d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc\": rpc error: code = NotFound desc = could not find container \"d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc\": container with ID starting with d4167f8ca228398df90ed7c3b124a225c5087a53392e98cc21c53622be150cbc not found: ID does not exist" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.551845 4769 scope.go:117] "RemoveContainer" containerID="d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.552865 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.552992 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6\": container with ID starting with d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6 not found: ID does not exist" containerID="d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.553015 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6"} err="failed to get container status \"d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6\": rpc error: code = NotFound desc = could not find container \"d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6\": container with ID starting with d02aa947728eb519ea28f37bbd4d86657ff3b94a3c3ed38d6bacf461e7524eb6 not found: ID does not exist" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.553032 4769 scope.go:117] "RemoveContainer" containerID="4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.554761 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.556210 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.556258 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="ovn-northd" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.559369 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.573569 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.577034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tc7\" (UniqueName: \"kubernetes.io/projected/04b8df03-70c8-45b7-b80d-93ee00880c63-kube-api-access-w6tc7\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.577217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-config-data\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.577249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.577284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.577327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04b8df03-70c8-45b7-b80d-93ee00880c63-logs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.578630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.587902 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.598310 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.600694 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.603138 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.603312 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.606560 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.628368 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.630052 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.634163 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.634535 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.638474 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.644431 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.652326 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.661438 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.669296 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.671344 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.674796 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.675496 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.675630 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-4jz5m" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.676616 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.677150 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680337 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-config-data\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680391 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-scripts\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680484 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04b8df03-70c8-45b7-b80d-93ee00880c63-logs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7nxl\" (UniqueName: \"kubernetes.io/projected/ad35f3f3-be0b-46f9-b5de-f72839180563-kube-api-access-r7nxl\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e195233f-2809-4a2d-b82d-39e587d4cc45-logs\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-config-data\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.680732 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.680780 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.180764602 +0000 UTC m=+5246.881426420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680809 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680834 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.680999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-logs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.681046 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tc7\" (UniqueName: \"kubernetes.io/projected/04b8df03-70c8-45b7-b80d-93ee00880c63-kube-api-access-w6tc7\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.681123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf4hk\" (UniqueName: \"kubernetes.io/projected/e195233f-2809-4a2d-b82d-39e587d4cc45-kube-api-access-pf4hk\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.681181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-config-data\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.681215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.681571 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.681595 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs podName:db108581-e980-4f5b-a0b8-56e3477ff0c2 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.681588174 +0000 UTC m=+5248.382249982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs") pod "openstack-galera-0" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2") : secret "cert-galera-openstack-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.681627 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.681644 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.181638825 +0000 UTC m=+5246.882300643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.681683 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-cell1-svc: secret "cert-galera-openstack-cell1-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.681703 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs podName:dd5c9de7-9929-4ae7-8c6b-45b980c15e9f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.681694787 +0000 UTC m=+5248.382356605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs") pod "openstack-cell1-galera-0" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f") : secret "cert-galera-openstack-cell1-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.699583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04b8df03-70c8-45b7-b80d-93ee00880c63-logs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.700166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.706788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tc7\" (UniqueName: \"kubernetes.io/projected/04b8df03-70c8-45b7-b80d-93ee00880c63-kube-api-access-w6tc7\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.698781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-config-data\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.725381 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.729030 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.729199 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.733618 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.733862 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.733982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.744329 4769 scope.go:117] "RemoveContainer" containerID="6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.765675 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.775483 4769 scope.go:117] "RemoveContainer" containerID="4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.790076 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac\": container with ID starting with 4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac not found: ID does not exist" containerID="4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.790129 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac"} err="failed to get container status \"4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac\": rpc error: code = NotFound desc = could not find container \"4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac\": container with ID starting with 4c4f6ec80208c6d9c518d17e5ee671221798d1f922ca77501b388e3d938d36ac not found: ID does not exist" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.790159 4769 scope.go:117] "RemoveContainer" containerID="6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.792490 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b\": container with ID starting with 6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b not found: ID does not exist" containerID="6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.792541 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b"} err="failed to get container status \"6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b\": rpc error: code = NotFound desc = could not find container \"6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b\": container with ID starting with 6bbc5519e8b84e0cfa6048fce78e3fd6d2e04b7f8104913ef51c55dd84bdfb5b not found: ID does not exist" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.792576 4769 scope.go:117] "RemoveContainer" containerID="4b77409f62864dd07617e7ba35b9a9c81076d5613f7b3a78ecbf73d25736a279" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-logs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48eb070a-aa77-468b-a3c2-74300e75594d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pf4hk\" (UniqueName: \"kubernetes.io/projected/e195233f-2809-4a2d-b82d-39e587d4cc45-kube-api-access-pf4hk\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-config-data\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.793981 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jx8\" (UniqueName: \"kubernetes.io/projected/48eb070a-aa77-468b-a3c2-74300e75594d-kube-api-access-r2jx8\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-scripts\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz759\" (UniqueName: \"kubernetes.io/projected/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-kube-api-access-bz759\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794166 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data-custom\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794320 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r7nxl\" (UniqueName: \"kubernetes.io/projected/ad35f3f3-be0b-46f9-b5de-f72839180563-kube-api-access-r7nxl\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e195233f-2809-4a2d-b82d-39e587d4cc45-logs\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-scripts\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794529 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48eb070a-aa77-468b-a3c2-74300e75594d-logs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-config-data\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794639 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-scripts\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.794884 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.795213 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e195233f-2809-4a2d-b82d-39e587d4cc45-logs\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.799983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.803911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.804099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.804238 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.804288 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs podName:ad35f3f3-be0b-46f9-b5de-f72839180563 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.304271689 +0000 UTC m=+5247.004933747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs") pod "glance-default-external-api-0" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563") : secret "cert-glance-default-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.807894 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-logs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.809723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.810142 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-config-data\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.812859 4769 generic.go:334] "Generic (PLEG): container finished" podID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerID="e083fdef73808cdcadc8a5eebaa41ece176f6935c9510d1818ee8189eca45284" exitCode=0 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.812903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" event={"ID":"f587d35f-67ee-497c-8d1b-00cd19e6a42a","Type":"ContainerDied","Data":"e083fdef73808cdcadc8a5eebaa41ece176f6935c9510d1818ee8189eca45284"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.836421 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-scripts\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.841028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-config-data\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.854767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf4hk\" (UniqueName: \"kubernetes.io/projected/e195233f-2809-4a2d-b82d-39e587d4cc45-kube-api-access-pf4hk\") pod \"nova-metadata-0\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.859418 4769 generic.go:334] "Generic (PLEG): container finished" podID="64e92b59-ae64-4236-8fef-a857b35df619" containerID="31c5364f0b49ac3f12d434c67d9370c9442a0c8c9c541dc56c1a8e59739610e0" exitCode=0 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.859519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" event={"ID":"64e92b59-ae64-4236-8fef-a857b35df619","Type":"ContainerDied","Data":"31c5364f0b49ac3f12d434c67d9370c9442a0c8c9c541dc56c1a8e59739610e0"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.868283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7nxl\" (UniqueName: \"kubernetes.io/projected/ad35f3f3-be0b-46f9-b5de-f72839180563-kube-api-access-r7nxl\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.872782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerStarted","Data":"db367d771acd9f593150099db1fa88f1ff5782cbe1e572ce655e572ea9886d19"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.876263 4769 generic.go:334] "Generic (PLEG): container finished" podID="46644543-c2f6-4875-819c-399f5116e678" containerID="e472c1d0d8ce8ba67d21174fe003d08046d717f089a3a99b1a75948893ed69e7" exitCode=0 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.876374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerDied","Data":"e472c1d0d8ce8ba67d21174fe003d08046d717f089a3a99b1a75948893ed69e7"} Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.876392 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.877000 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-scripts\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48eb070a-aa77-468b-a3c2-74300e75594d-logs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896861 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896890 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-scripts\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.896919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.897004 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.897377 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.897451 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.397433699 +0000 UTC m=+5247.098095517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48eb070a-aa77-468b-a3c2-74300e75594d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898254 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jx8\" (UniqueName: \"kubernetes.io/projected/48eb070a-aa77-468b-a3c2-74300e75594d-kube-api-access-r2jx8\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898343 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48eb070a-aa77-468b-a3c2-74300e75594d-etc-machine-id\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898374 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bz759\" (UniqueName: \"kubernetes.io/projected/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-kube-api-access-bz759\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data-custom\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.898605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.898792 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:07.898818 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:08.398810266 +0000 UTC m=+5247.099472084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.955622 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.976538 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.979735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-scripts\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.979751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.981005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-scripts\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.992896 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:07.997451 4769 scope.go:117] "RemoveContainer" containerID="1f5eaf4e5330d0535285af4fb4df276bfed64f6128ffb9f07fb46eaaf00aa597" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.000784 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.000850 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:12.000831384 +0000 UTC m=+5250.701493212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.003349 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.005131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.005243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.006658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz759\" (UniqueName: \"kubernetes.io/projected/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-kube-api-access-bz759\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.008762 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.011685 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.015352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.019322 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48eb070a-aa77-468b-a3c2-74300e75594d-logs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.021406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.021543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jx8\" (UniqueName: \"kubernetes.io/projected/48eb070a-aa77-468b-a3c2-74300e75594d-kube-api-access-r2jx8\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.021863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.022971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data-custom\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.104766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-config-data\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.104925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwb4j\" (UniqueName: \"kubernetes.io/projected/2614f647-50de-416e-afe3-7b658b34092e-kube-api-access-zwb4j\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.104963 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.207037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-config-data\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.207154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zwb4j\" (UniqueName: \"kubernetes.io/projected/2614f647-50de-416e-afe3-7b658b34092e-kube-api-access-zwb4j\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.207199 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.207303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.207551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.207706 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.207757 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.207741568 +0000 UTC m=+5247.908403376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.209433 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.209469 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.209459265 +0000 UTC m=+5247.910121083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.217286 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.219661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-config-data\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.232212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwb4j\" (UniqueName: \"kubernetes.io/projected/2614f647-50de-416e-afe3-7b658b34092e-kube-api-access-zwb4j\") pod \"nova-scheduler-0\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.309058 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.309572 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.309646 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs podName:ad35f3f3-be0b-46f9-b5de-f72839180563 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.309625243 +0000 UTC m=+5248.010287071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs") pod "glance-default-external-api-0" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563") : secret "cert-glance-default-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.317206 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.355786 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.427471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.427607 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-internal-svc: secret "cert-glance-default-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.427768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.427822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.427850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428063 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428113 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs podName:1cb6ac7f-13cf-4627-986b-bff3ff6be5a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:10.427967891 +0000 UTC m=+5249.128629699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs") pod "glance-default-internal-api-0" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4") : secret "cert-glance-default-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428163 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:12.428152916 +0000 UTC m=+5251.128814734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428165 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428256 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.428237578 +0000 UTC m=+5248.128899396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428183 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428315 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:12.42830678 +0000 UTC m=+5251.128968848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.428529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428678 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.428702 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:09.428694681 +0000 UTC m=+5248.129356499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-internal-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.840023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.840426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.840203 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: E1121 13:18:08.840527 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:16.840507625 +0000 UTC m=+5255.541169443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-public-svc" not found Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.845004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.891556 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_1ac90b6c-ad45-4800-992d-b89dc057f1e4/ovn-northd/0.log" Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.891594 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" exitCode=139 Nov 21 13:18:08 crc kubenswrapper[4769]: I1121 13:18:08.892306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1ac90b6c-ad45-4800-992d-b89dc057f1e4","Type":"ContainerDied","Data":"e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.035227 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_1ac90b6c-ad45-4800-992d-b89dc057f1e4/ovn-northd/0.log" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.035295 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.044399 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.044525 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.044595 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.044576982 +0000 UTC m=+5255.745238800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.044634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.044777 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.044825 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.044813959 +0000 UTC m=+5255.745475777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.046410 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.058764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.070131 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145592 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data\") pod \"64e92b59-ae64-4236-8fef-a857b35df619\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145639 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-run-httpd\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data\") pod \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data-custom\") pod \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-combined-ca-bundle\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-northd-tls-certs\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145792 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-ceilometer-tls-certs\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4ddn\" (UniqueName: \"kubernetes.io/projected/f587d35f-67ee-497c-8d1b-00cd19e6a42a-kube-api-access-q4ddn\") pod \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64e92b59-ae64-4236-8fef-a857b35df619-logs\") pod \"64e92b59-ae64-4236-8fef-a857b35df619\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f587d35f-67ee-497c-8d1b-00cd19e6a42a-logs\") pod \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145879 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-combined-ca-bundle\") pod \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\" (UID: \"f587d35f-67ee-497c-8d1b-00cd19e6a42a\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcb4b\" (UniqueName: \"kubernetes.io/projected/46644543-c2f6-4875-819c-399f5116e678-kube-api-access-hcb4b\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-log-httpd\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.145977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-combined-ca-bundle\") pod \"64e92b59-ae64-4236-8fef-a857b35df619\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146010 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs86m\" (UniqueName: \"kubernetes.io/projected/64e92b59-ae64-4236-8fef-a857b35df619-kube-api-access-bs86m\") pod \"64e92b59-ae64-4236-8fef-a857b35df619\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-combined-ca-bundle\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8trk\" (UniqueName: \"kubernetes.io/projected/1ac90b6c-ad45-4800-992d-b89dc057f1e4-kube-api-access-f8trk\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-sg-core-conf-yaml\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-scripts\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146146 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data-custom\") pod \"64e92b59-ae64-4236-8fef-a857b35df619\" (UID: \"64e92b59-ae64-4236-8fef-a857b35df619\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-scripts\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146232 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-metrics-certs-tls-certs\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-config\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-config-data\") pod \"46644543-c2f6-4875-819c-399f5116e678\" (UID: \"46644543-c2f6-4875-819c-399f5116e678\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.146330 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-rundir\") pod \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\" (UID: \"1ac90b6c-ad45-4800-992d-b89dc057f1e4\") " Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.147920 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-scripts" (OuterVolumeSpecName: "scripts") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.149645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.149832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.150024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e92b59-ae64-4236-8fef-a857b35df619-logs" (OuterVolumeSpecName: "logs") pod "64e92b59-ae64-4236-8fef-a857b35df619" (UID: "64e92b59-ae64-4236-8fef-a857b35df619"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.153702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-config" (OuterVolumeSpecName: "config") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.155087 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.158532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46644543-c2f6-4875-819c-399f5116e678-kube-api-access-hcb4b" (OuterVolumeSpecName: "kube-api-access-hcb4b") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "kube-api-access-hcb4b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.158565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f587d35f-67ee-497c-8d1b-00cd19e6a42a-logs" (OuterVolumeSpecName: "logs") pod "f587d35f-67ee-497c-8d1b-00cd19e6a42a" (UID: "f587d35f-67ee-497c-8d1b-00cd19e6a42a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.161142 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-scripts" (OuterVolumeSpecName: "scripts") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.163283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac90b6c-ad45-4800-992d-b89dc057f1e4-kube-api-access-f8trk" (OuterVolumeSpecName: "kube-api-access-f8trk") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "kube-api-access-f8trk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.173654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f587d35f-67ee-497c-8d1b-00cd19e6a42a-kube-api-access-q4ddn" (OuterVolumeSpecName: "kube-api-access-q4ddn") pod "f587d35f-67ee-497c-8d1b-00cd19e6a42a" (UID: "f587d35f-67ee-497c-8d1b-00cd19e6a42a"). InnerVolumeSpecName "kube-api-access-q4ddn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.173758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "64e92b59-ae64-4236-8fef-a857b35df619" (UID: "64e92b59-ae64-4236-8fef-a857b35df619"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.179430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e92b59-ae64-4236-8fef-a857b35df619-kube-api-access-bs86m" (OuterVolumeSpecName: "kube-api-access-bs86m") pod "64e92b59-ae64-4236-8fef-a857b35df619" (UID: "64e92b59-ae64-4236-8fef-a857b35df619"). InnerVolumeSpecName "kube-api-access-bs86m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.190485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f587d35f-67ee-497c-8d1b-00cd19e6a42a" (UID: "f587d35f-67ee-497c-8d1b-00cd19e6a42a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.208492 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.209240 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[galera-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.223900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f587d35f-67ee-497c-8d1b-00cd19e6a42a" (UID: "f587d35f-67ee-497c-8d1b-00cd19e6a42a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.227803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "64e92b59-ae64-4236-8fef-a857b35df619" (UID: "64e92b59-ae64-4236-8fef-a857b35df619"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.247252 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data" (OuterVolumeSpecName: "config-data") pod "f587d35f-67ee-497c-8d1b-00cd19e6a42a" (UID: "f587d35f-67ee-497c-8d1b-00cd19e6a42a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.249516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.249764 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.249868 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.249842192 +0000 UTC m=+5249.950504010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.249768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.249883 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.249951 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.249933624 +0000 UTC m=+5249.950595642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255672 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255721 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255737 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bs86m\" (UniqueName: \"kubernetes.io/projected/64e92b59-ae64-4236-8fef-a857b35df619-kube-api-access-bs86m\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255750 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f8trk\" (UniqueName: \"kubernetes.io/projected/1ac90b6c-ad45-4800-992d-b89dc057f1e4-kube-api-access-f8trk\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255761 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255774 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255785 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255797 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ac90b6c-ad45-4800-992d-b89dc057f1e4-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255808 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255819 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/46644543-c2f6-4875-819c-399f5116e678-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255830 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255842 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255853 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q4ddn\" (UniqueName: \"kubernetes.io/projected/f587d35f-67ee-497c-8d1b-00cd19e6a42a-kube-api-access-q4ddn\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255867 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64e92b59-ae64-4236-8fef-a857b35df619-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255877 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f587d35f-67ee-497c-8d1b-00cd19e6a42a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255886 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f587d35f-67ee-497c-8d1b-00cd19e6a42a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.255896 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hcb4b\" (UniqueName: \"kubernetes.io/projected/46644543-c2f6-4875-819c-399f5116e678-kube-api-access-hcb4b\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.297026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.301912 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.310811 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.331202 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="303d0b55-36e2-4605-9c93-6dec4e83eac2" path="/var/lib/kubelet/pods/303d0b55-36e2-4605-9c93-6dec4e83eac2/volumes" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.332583 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ba837d-aafd-488c-bdff-96820a5daf6a" path="/var/lib/kubelet/pods/47ba837d-aafd-488c-bdff-96820a5daf6a/volumes" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.333497 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c11994a-1f6a-442c-8479-180dab834496" path="/var/lib/kubelet/pods/5c11994a-1f6a-442c-8479-180dab834496/volumes" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.334673 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce321fe1-25d5-48ee-85fd-46e4adb2494b" path="/var/lib/kubelet/pods/ce321fe1-25d5-48ee-85fd-46e4adb2494b/volumes" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.335512 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcda061b-5dcd-43e6-ba38-4107650d2c68" path="/var/lib/kubelet/pods/dcda061b-5dcd-43e6-ba38-4107650d2c68/volumes" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.336339 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5" path="/var/lib/kubelet/pods/ed52b0ef-6f64-4a2c-af8e-e01c996d5bb5/volumes" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.345209 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.352734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data" (OuterVolumeSpecName: "config-data") pod "64e92b59-ae64-4236-8fef-a857b35df619" (UID: "64e92b59-ae64-4236-8fef-a857b35df619"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.353569 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.355020 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.359062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.359308 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.359373 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.359354481 +0000 UTC m=+5256.060016299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-ovndbs" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.359496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.359586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.359655 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.359683 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.359760 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.359764 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs podName:ad35f3f3-be0b-46f9-b5de-f72839180563 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.359702161 +0000 UTC m=+5250.060363979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs") pod "glance-default-external-api-0" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563") : secret "cert-glance-default-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.359976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.360245 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.360209884 +0000 UTC m=+5256.060871702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.360340 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-public-svc: secret "cert-keystone-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.360384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.360399 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.360383959 +0000 UTC m=+5256.061045967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.360464 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-keystone-internal-svc: secret "cert-keystone-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.360499 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs podName:3d9eede1-62b7-48a8-86a4-ccde7312f0e4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.360489702 +0000 UTC m=+5256.061151750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs") pod "keystone-5868866f7b-tknss" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4") : secret "cert-keystone-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.360528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.360919 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.362525 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.362487096 +0000 UTC m=+5256.063148904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.362832 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.362855 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.362889 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64e92b59-ae64-4236-8fef-a857b35df619-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.362900 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.362912 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.369381 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.407164 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-config-data" (OuterVolumeSpecName: "config-data") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.414360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "1ac90b6c-ad45-4800-992d-b89dc057f1e4" (UID: "1ac90b6c-ad45-4800-992d-b89dc057f1e4"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.435038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46644543-c2f6-4875-819c-399f5116e678" (UID: "46644543-c2f6-4875-819c-399f5116e678"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.465593 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.465990 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.466140 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.466104147 +0000 UTC m=+5250.166766165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-public-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.466885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.467243 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac90b6c-ad45-4800-992d-b89dc057f1e4-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.467280 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.467305 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/46644543-c2f6-4875-819c-399f5116e678-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.467505 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.467756 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.467733041 +0000 UTC m=+5250.168395069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-internal-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.774501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.774554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.774691 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-galera-openstack-svc: secret "cert-galera-openstack-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: E1121 13:18:09.774775 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs podName:db108581-e980-4f5b-a0b8-56e3477ff0c2 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:13.774755172 +0000 UTC m=+5252.475416990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "galera-tls-certs" (UniqueName: "kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs") pod "openstack-galera-0" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2") : secret "cert-galera-openstack-svc" not found Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.779126 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.905311 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerID="db367d771acd9f593150099db1fa88f1ff5782cbe1e572ce655e572ea9886d19" exitCode=1 Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.905536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerDied","Data":"db367d771acd9f593150099db1fa88f1ff5782cbe1e572ce655e572ea9886d19"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.906796 4769 scope.go:117] "RemoveContainer" containerID="db367d771acd9f593150099db1fa88f1ff5782cbe1e572ce655e572ea9886d19" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.912315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerStarted","Data":"4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.912355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerStarted","Data":"9369ee2485c7da4df7efe0229bc40411671fff8ad5f3b6e784ce477e227df216"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.913904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e195233f-2809-4a2d-b82d-39e587d4cc45","Type":"ContainerStarted","Data":"137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.913928 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e195233f-2809-4a2d-b82d-39e587d4cc45","Type":"ContainerStarted","Data":"84f8afe6c05d127bbd6f928f0003e368dfbb9aad335b3de14f17d6e37010b670"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.916604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" event={"ID":"f587d35f-67ee-497c-8d1b-00cd19e6a42a","Type":"ContainerDied","Data":"2c1d8c3924d0b3e5ae694196b9f4434b588d49481c19b66e89fed2280f6d6434"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.916637 4769 scope.go:117] "RemoveContainer" containerID="e083fdef73808cdcadc8a5eebaa41ece176f6935c9510d1818ee8189eca45284" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.916756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.921232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerStarted","Data":"5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.921531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerStarted","Data":"a362d0e063048c194631afa26ae0dcc9c71aa46f98bbbd2b770e538021f8a77f"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.923337 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.926952 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_1ac90b6c-ad45-4800-992d-b89dc057f1e4/ovn-northd/0.log" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.927009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1ac90b6c-ad45-4800-992d-b89dc057f1e4","Type":"ContainerDied","Data":"2032dac41072527dfacde7f88ffd2811b15e71736e6a2ae55a0fa0a4d100fc7b"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.927095 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.936579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"46644543-c2f6-4875-819c-399f5116e678","Type":"ContainerDied","Data":"ceed50cc6601d81c53f6a1ee332b373a81a5d805cc1919db15e468f3c0b956ca"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.936676 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.939311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"546bcae7-9cd0-4153-9ebc-5f408d2b4eba","Type":"ContainerStarted","Data":"ac07c5b33d7c99132cc7a0bc294aec336daf819ef1fbabaa4fd600317dc23d3b"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.944766 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.945050 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.945343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88" event={"ID":"64e92b59-ae64-4236-8fef-a857b35df619","Type":"ContainerDied","Data":"fe42c3bda4cb0e0d5423c3444fc0cc8f063c41690246b51d0327fe78623d9d03"} Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.964043 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.964025141 podStartE2EDuration="2.964025141s" podCreationTimestamp="2025-11-21 13:18:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:09.952916141 +0000 UTC m=+5248.653577959" watchObservedRunningTime="2025-11-21 13:18:09.964025141 +0000 UTC m=+5248.664686959" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.977119 4769 scope.go:117] "RemoveContainer" containerID="4f8f1f9db0e4143f84aee90e6923931e5b99b72770c4cdf54742aae36679e761" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.984405 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=4.984382609 podStartE2EDuration="4.984382609s" podCreationTimestamp="2025-11-21 13:18:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:09.976054115 +0000 UTC m=+5248.676715933" watchObservedRunningTime="2025-11-21 13:18:09.984382609 +0000 UTC m=+5248.685044427" Nov 21 13:18:09 crc kubenswrapper[4769]: I1121 13:18:09.986696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.014019 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.026114 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.042540 4769 scope.go:117] "RemoveContainer" containerID="8888f1576cd083e0c03bcf91d0135e5553e82f4a6bea4bc45184b3107c90ab67" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.046267 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.054349 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.054884 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="sg-core" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.054908 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="sg-core" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.054931 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-notification-agent" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.054941 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-notification-agent" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.054961 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker-log" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.054969 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker-log" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.054990 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="proxy-httpd" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.054998 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="proxy-httpd" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.055011 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="openstack-network-exporter" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055019 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="openstack-network-exporter" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.055037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="ovn-northd" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055048 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="ovn-northd" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.055062 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-central-agent" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055070 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-central-agent" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.055085 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener-log" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055092 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener-log" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.055108 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.055130 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055138 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055396 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="ovn-northd" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker-log" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055430 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" containerName="openstack-network-exporter" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055455 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="sg-core" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055465 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-notification-agent" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055481 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener-log" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055496 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="proxy-httpd" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055505 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64e92b59-ae64-4236-8fef-a857b35df619" containerName="barbican-keystone-listener" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055516 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="46644543-c2f6-4875-819c-399f5116e678" containerName="ceilometer-central-agent" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.055533 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" containerName="barbican-worker" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.056833 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.060695 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-h5r64" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.061084 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.061389 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.061985 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-6bf87cb49f-7s75n"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.062454 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.072124 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.079747 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck4mz\" (UniqueName: \"kubernetes.io/projected/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kube-api-access-ck4mz\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080532 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kolla-config\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080635 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-generated\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-operator-scripts\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080718 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-default\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-combined-ca-bundle\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.080820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") pod \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\" (UID: \"dd5c9de7-9929-4ae7-8c6b-45b980c15e9f\") " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.082041 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.082487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.082685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.082854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.085726 4769 scope.go:117] "RemoveContainer" containerID="e4b6029ff5293aa3a08b44c80ca55522dc686ac9e29bb6111779ae1a284579fb" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.096076 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-8cdb476cb-4vs88"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.109298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.115384 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.115434 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.115447 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.115458 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.115470 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.117045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kube-api-access-ck4mz" (OuterVolumeSpecName: "kube-api-access-ck4mz") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "kube-api-access-ck4mz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.117453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.126452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" (UID: "dd5c9de7-9929-4ae7-8c6b-45b980c15e9f"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.138379 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.161259 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.171456 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.173659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.177755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.178071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.178305 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.197936 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.208538 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.209213 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[galera-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstack-galera-0" podUID="db108581-e980-4f5b-a0b8-56e3477ff0c2" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-scripts\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217086 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-config\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217329 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxg5l\" (UniqueName: \"kubernetes.io/projected/653286ca-0dcc-4209-99e7-ca16dfde4dfb-kube-api-access-hxg5l\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217813 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ck4mz\" (UniqueName: \"kubernetes.io/projected/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-kube-api-access-ck4mz\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217840 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.217919 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.239594 4769 scope.go:117] "RemoveContainer" containerID="d6c4f8fa57cd210c43227ca6900108060f909f666becc7ea0599edb0750c0683" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.247378 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.269240 4769 scope.go:117] "RemoveContainer" containerID="42c646ed11e5b027a9b0341ac74e22d71d5e666945a4ba345099e83afd1ea6a9" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.286626 4769 scope.go:117] "RemoveContainer" containerID="e472c1d0d8ce8ba67d21174fe003d08046d717f089a3a99b1a75948893ed69e7" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.304133 4769 scope.go:117] "RemoveContainer" containerID="b47320a3d2fe731e7e3a4239e036ff20c1bfe115228ccdf50f0ee2042feda822" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-scripts\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-config\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320280 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320331 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-scripts\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320486 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-config-data\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320694 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hxg5l\" (UniqueName: \"kubernetes.io/projected/653286ca-0dcc-4209-99e7-ca16dfde4dfb-kube-api-access-hxg5l\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-log-httpd\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v4vv\" (UniqueName: \"kubernetes.io/projected/2e26e138-4a68-4436-84a6-9713ee58c8ee-kube-api-access-9v4vv\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-run-httpd\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.320999 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.321898 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.321992 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.322033 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:10.821994414 +0000 UTC m=+5249.522656232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.322159 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:10.822117028 +0000 UTC m=+5249.522778846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovn-metrics" not found Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.322627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.323278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-config\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.324061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-scripts\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.325778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.328954 4769 scope.go:117] "RemoveContainer" containerID="31c5364f0b49ac3f12d434c67d9370c9442a0c8c9c541dc56c1a8e59739610e0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.343648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxg5l\" (UniqueName: \"kubernetes.io/projected/653286ca-0dcc-4209-99e7-ca16dfde4dfb-kube-api-access-hxg5l\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.375233 4769 scope.go:117] "RemoveContainer" containerID="7100f7dfd87d9df473edc7e27cf9a8b56bd937ff687861cb12558e4b1fedb2d2" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.422456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.422536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-scripts\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.422806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.422874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-config-data\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.422970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.423028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-log-httpd\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.423109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9v4vv\" (UniqueName: \"kubernetes.io/projected/2e26e138-4a68-4436-84a6-9713ee58c8ee-kube-api-access-9v4vv\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.423208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-run-httpd\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.423804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-run-httpd\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.423929 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.424000 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs podName:2e26e138-4a68-4436-84a6-9713ee58c8ee nodeName:}" failed. No retries permitted until 2025-11-21 13:18:10.923979792 +0000 UTC m=+5249.624641630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee") : secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.425309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-log-httpd\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.432869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.433067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-scripts\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.433090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.434314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-config-data\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.443432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v4vv\" (UniqueName: \"kubernetes.io/projected/2e26e138-4a68-4436-84a6-9713ee58c8ee-kube-api-access-9v4vv\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.524740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.524906 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-internal-svc: secret "cert-glance-default-internal-svc" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.524983 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs podName:1cb6ac7f-13cf-4627-986b-bff3ff6be5a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:14.524965672 +0000 UTC m=+5253.225627490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs") pod "glance-default-internal-api-0" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4") : secret "cert-glance-default-internal-svc" not found Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.833527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.833710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.833748 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.833834 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.833813733 +0000 UTC m=+5250.534475561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.833866 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.833914 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.833900125 +0000 UTC m=+5250.534561943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovn-metrics" not found Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.935326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.935610 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:10 crc kubenswrapper[4769]: E1121 13:18:10.935725 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs podName:2e26e138-4a68-4436-84a6-9713ee58c8ee nodeName:}" failed. No retries permitted until 2025-11-21 13:18:11.935699497 +0000 UTC m=+5250.636361385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee") : secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.974622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"546bcae7-9cd0-4153-9ebc-5f408d2b4eba","Type":"ContainerStarted","Data":"fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2"} Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.986182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerStarted","Data":"3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e"} Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.986667 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.993687 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.994989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e195233f-2809-4a2d-b82d-39e587d4cc45","Type":"ContainerStarted","Data":"428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14"} Nov 21 13:18:10 crc kubenswrapper[4769]: I1121 13:18:10.995341 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.015080 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.041926 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.041901838 podStartE2EDuration="4.041901838s" podCreationTimestamp="2025-11-21 13:18:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:11.024828078 +0000 UTC m=+5249.725489896" watchObservedRunningTime="2025-11-21 13:18:11.041901838 +0000 UTC m=+5249.742563656" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.074521 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.087033 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.094260 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.097607 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.106603 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.138223 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.139504 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-8x57j" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6r4v\" (UniqueName: \"kubernetes.io/projected/db108581-e980-4f5b-a0b8-56e3477ff0c2-kube-api-access-k6r4v\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-combined-ca-bundle\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-generated\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-kolla-config\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-operator-scripts\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140399 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-default\") pod \"db108581-e980-4f5b-a0b8-56e3477ff0c2\" (UID: \"db108581-e980-4f5b-a0b8-56e3477ff0c2\") " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140685 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.140936 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.141364 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.141928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.142370 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.143971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.144118 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-memcached-svc: secret "cert-memcached-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.144185 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs podName:ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:19.144166823 +0000 UTC m=+5257.844828641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "memcached-tls-certs" (UniqueName: "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs") pod "memcached-0" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237") : secret "cert-memcached-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.144246 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.154055 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db108581-e980-4f5b-a0b8-56e3477ff0c2-kube-api-access-k6r4v" (OuterVolumeSpecName: "kube-api-access-k6r4v") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "kube-api-access-k6r4v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.164315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.169344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "db108581-e980-4f5b-a0b8-56e3477ff0c2" (UID: "db108581-e980-4f5b-a0b8-56e3477ff0c2"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.252403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.252520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.252543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.252578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253250 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253382 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253414 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:15.253393006 +0000 UTC m=+5253.954054814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-internal-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253573 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpqxs\" (UniqueName: \"kubernetes.io/projected/550f37a2-49a9-43e6-8bc5-d4787232f49a-kube-api-access-kpqxs\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253618 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:19.253611422 +0000 UTC m=+5257.954273240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovn-metrics" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253819 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.253861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253928 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:19.25390909 +0000 UTC m=+5257.954570908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.253863 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.254085 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:15.254076324 +0000 UTC m=+5253.954738142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-public-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254396 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254468 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254535 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254595 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254650 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/db108581-e980-4f5b-a0b8-56e3477ff0c2-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254703 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6r4v\" (UniqueName: \"kubernetes.io/projected/db108581-e980-4f5b-a0b8-56e3477ff0c2-kube-api-access-k6r4v\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.254754 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.280487 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.285944 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac90b6c-ad45-4800-992d-b89dc057f1e4" path="/var/lib/kubelet/pods/1ac90b6c-ad45-4800-992d-b89dc057f1e4/volumes" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.286949 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46644543-c2f6-4875-819c-399f5116e678" path="/var/lib/kubelet/pods/46644543-c2f6-4875-819c-399f5116e678/volumes" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.292176 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e92b59-ae64-4236-8fef-a857b35df619" path="/var/lib/kubelet/pods/64e92b59-ae64-4236-8fef-a857b35df619/volumes" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.293169 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd5c9de7-9929-4ae7-8c6b-45b980c15e9f" path="/var/lib/kubelet/pods/dd5c9de7-9929-4ae7-8c6b-45b980c15e9f/volumes" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.293689 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f587d35f-67ee-497c-8d1b-00cd19e6a42a" path="/var/lib/kubelet/pods/f587d35f-67ee-497c-8d1b-00cd19e6a42a/volumes" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.358648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.358707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.358851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359332 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359266 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") device mount path \"/mnt/openstack/pv17\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359644 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kpqxs\" (UniqueName: \"kubernetes.io/projected/550f37a2-49a9-43e6-8bc5-d4787232f49a-kube-api-access-kpqxs\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.359989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.360119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.360357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.360561 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.359468 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.361085 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:19.361064807 +0000 UTC m=+5258.061726645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovn-metrics" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.360467 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.361275 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:19.361262442 +0000 UTC m=+5258.061924260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.360507 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.361307 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs podName:ad35f3f3-be0b-46f9-b5de-f72839180563 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:15.361299823 +0000 UTC m=+5254.061961641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs") pod "glance-default-external-api-0" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563") : secret "cert-glance-default-public-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.361521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.361714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.362550 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.365634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.379265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.384700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpqxs\" (UniqueName: \"kubernetes.io/projected/550f37a2-49a9-43e6-8bc5-d4787232f49a-kube-api-access-kpqxs\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.400330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"openstack-cell1-galera-0\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.544854 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.573077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.573479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.574119 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-internal-svc: secret "cert-cinder-internal-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.574285 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:15.57424794 +0000 UTC m=+5254.274909768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-internal-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.574394 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.574533 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:15.574511707 +0000 UTC m=+5254.275173525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-public-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.881016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.881917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.881668 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.882360 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:13.882340589 +0000 UTC m=+5252.583002417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.882056 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.886916 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:13.886873481 +0000 UTC m=+5252.587535299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovn-metrics" not found Nov 21 13:18:11 crc kubenswrapper[4769]: I1121 13:18:11.984677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.984894 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:11 crc kubenswrapper[4769]: E1121 13:18:11.984993 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs podName:2e26e138-4a68-4436-84a6-9713ee58c8ee nodeName:}" failed. No retries permitted until 2025-11-21 13:18:13.984973194 +0000 UTC m=+5252.685635012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee") : secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.010524 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.010728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"546bcae7-9cd0-4153-9ebc-5f408d2b4eba","Type":"ContainerStarted","Data":"3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f"} Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.045624 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=5.045600388 podStartE2EDuration="5.045600388s" podCreationTimestamp="2025-11-21 13:18:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:12.045019972 +0000 UTC m=+5250.745681800" watchObservedRunningTime="2025-11-21 13:18:12.045600388 +0000 UTC m=+5250.746262206" Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.103738 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.103814 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:20.103795525 +0000 UTC m=+5258.804457333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.132676 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.143241 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.153490 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.164530 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.167399 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.171203 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.171473 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-ngfw2" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.171745 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.171861 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.178571 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.296379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-operator-scripts\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstp6\" (UniqueName: \"kubernetes.io/projected/cf393762-ecdb-4462-8198-0f85d54912e7-kube-api-access-hstp6\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297297 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297508 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-kolla-config\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-default\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297569 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-generated\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.297643 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/db108581-e980-4f5b-a0b8-56e3477ff0c2-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.399743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.399948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.399987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-kolla-config\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.400018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-default\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.400037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-generated\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.400066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-operator-scripts\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.400092 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hstp6\" (UniqueName: \"kubernetes.io/projected/cf393762-ecdb-4462-8198-0f85d54912e7-kube-api-access-hstp6\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.400169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.401279 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-kolla-config\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.401314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-default\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.401409 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.401963 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-operator-scripts\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.404636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.404772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.413297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-generated\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.433804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstp6\" (UniqueName: \"kubernetes.io/projected/cf393762-ecdb-4462-8198-0f85d54912e7-kube-api-access-hstp6\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.443048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"openstack-galera-0\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.502295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.502390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.502506 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.502616 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.502624 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:20.502590489 +0000 UTC m=+5259.203252347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.502809 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:20.502785434 +0000 UTC m=+5259.203447262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.551154 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5 is running failed: container process not found" containerID="5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.551850 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5 is running failed: container process not found" containerID="5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.552360 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5 is running failed: container process not found" containerID="5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:18:12 crc kubenswrapper[4769]: E1121 13:18:12.552425 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5 is running failed: container process not found" probeType="Liveness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.615852 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.958587 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:12 crc kubenswrapper[4769]: I1121 13:18:12.959167 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.022564 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerID="3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e" exitCode=1 Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.022652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerDied","Data":"3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e"} Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.022691 4769 scope.go:117] "RemoveContainer" containerID="db367d771acd9f593150099db1fa88f1ff5782cbe1e572ce655e572ea9886d19" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.023451 4769 scope.go:117] "RemoveContainer" containerID="3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e" Nov 21 13:18:13 crc kubenswrapper[4769]: E1121 13:18:13.024008 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.027486 4769 generic.go:334] "Generic (PLEG): container finished" podID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerID="5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5" exitCode=1 Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.027559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerDied","Data":"5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5"} Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.028181 4769 scope.go:117] "RemoveContainer" containerID="5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.047144 4769 generic.go:334] "Generic (PLEG): container finished" podID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerID="e5e9da381997ba1cc439add77d4946e84fc2cb4b35ffa59d4229e2dfd3b29d58" exitCode=0 Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.048045 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"550f37a2-49a9-43e6-8bc5-d4787232f49a","Type":"ContainerDied","Data":"e5e9da381997ba1cc439add77d4946e84fc2cb4b35ffa59d4229e2dfd3b29d58"} Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.048094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"550f37a2-49a9-43e6-8bc5-d4787232f49a","Type":"ContainerStarted","Data":"983221e14dce7a3272bd9235c0ca8b59a76e338c3f27703b7f5cd36a851614e9"} Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.167575 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:18:13 crc kubenswrapper[4769]: W1121 13:18:13.215719 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf393762_ecdb_4462_8198_0f85d54912e7.slice/crio-3ab1b31d67ee0aad8290e83545d69cdad9eb53222243b73f54e30489b0af9120 WatchSource:0}: Error finding container 3ab1b31d67ee0aad8290e83545d69cdad9eb53222243b73f54e30489b0af9120: Status 404 returned error can't find the container with id 3ab1b31d67ee0aad8290e83545d69cdad9eb53222243b73f54e30489b0af9120 Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.291090 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db108581-e980-4f5b-a0b8-56e3477ff0c2" path="/var/lib/kubelet/pods/db108581-e980-4f5b-a0b8-56e3477ff0c2/volumes" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.317661 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.356636 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.951983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:13 crc kubenswrapper[4769]: E1121 13:18:13.952437 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:13 crc kubenswrapper[4769]: I1121 13:18:13.952566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:13 crc kubenswrapper[4769]: E1121 13:18:13.952662 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.952626641 +0000 UTC m=+5256.653288489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovn-metrics" not found Nov 21 13:18:13 crc kubenswrapper[4769]: E1121 13:18:13.952737 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:13 crc kubenswrapper[4769]: E1121 13:18:13.952831 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:17.952806156 +0000 UTC m=+5256.653468064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.028156 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.057775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:14 crc kubenswrapper[4769]: E1121 13:18:14.057962 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:14 crc kubenswrapper[4769]: E1121 13:18:14.058034 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs podName:2e26e138-4a68-4436-84a6-9713ee58c8ee nodeName:}" failed. No retries permitted until 2025-11-21 13:18:18.05801357 +0000 UTC m=+5256.758675408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee") : secret "cert-ceilometer-internal-svc" not found Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.069682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerStarted","Data":"911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2"} Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.069990 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.072292 4769 generic.go:334] "Generic (PLEG): container finished" podID="cf393762-ecdb-4462-8198-0f85d54912e7" containerID="ed17bcc6e65e52f713872afa81bf11a08c32fe18dd1b2b4f031f5f3b71ac5ede" exitCode=0 Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.072911 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"cf393762-ecdb-4462-8198-0f85d54912e7","Type":"ContainerDied","Data":"ed17bcc6e65e52f713872afa81bf11a08c32fe18dd1b2b4f031f5f3b71ac5ede"} Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.072946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"cf393762-ecdb-4462-8198-0f85d54912e7","Type":"ContainerStarted","Data":"3ab1b31d67ee0aad8290e83545d69cdad9eb53222243b73f54e30489b0af9120"} Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.075732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"550f37a2-49a9-43e6-8bc5-d4787232f49a","Type":"ContainerStarted","Data":"8a6c581f1425e299fee1e4e6e1be11770c4a38740293ef00fad83aae0f71f499"} Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.082250 4769 scope.go:117] "RemoveContainer" containerID="3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e" Nov 21 13:18:14 crc kubenswrapper[4769]: E1121 13:18:14.082801 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.125989 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=3.125964251 podStartE2EDuration="3.125964251s" podCreationTimestamp="2025-11-21 13:18:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:14.120812702 +0000 UTC m=+5252.821474540" watchObservedRunningTime="2025-11-21 13:18:14.125964251 +0000 UTC m=+5252.826626069" Nov 21 13:18:14 crc kubenswrapper[4769]: I1121 13:18:14.573627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:14 crc kubenswrapper[4769]: E1121 13:18:14.573929 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-internal-svc: secret "cert-glance-default-internal-svc" not found Nov 21 13:18:14 crc kubenswrapper[4769]: E1121 13:18:14.574064 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs podName:1cb6ac7f-13cf-4627-986b-bff3ff6be5a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:22.574033701 +0000 UTC m=+5261.274695559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs") pod "glance-default-internal-api-0" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4") : secret "cert-glance-default-internal-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.290251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.290431 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.290872 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:23.290825021 +0000 UTC m=+5261.991486929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-internal-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.291007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.291501 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.291538 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:23.29152747 +0000 UTC m=+5261.992189368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-public-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.393851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.394033 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-glance-default-public-svc: secret "cert-glance-default-public-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.394097 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs podName:ad35f3f3-be0b-46f9-b5de-f72839180563 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:23.394078183 +0000 UTC m=+5262.094740001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs") pod "glance-default-external-api-0" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563") : secret "cert-glance-default-public-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.409133 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.410207 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ceilometer-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="2e26e138-4a68-4436-84a6-9713ee58c8ee" Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.597551 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.597672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.597851 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-cinder-public-svc: secret "cert-cinder-public-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: E1121 13:18:15.597958 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs podName:48eb070a-aa77-468b-a3c2-74300e75594d nodeName:}" failed. No retries permitted until 2025-11-21 13:18:23.597934645 +0000 UTC m=+5262.298596483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs") pod "cinder-api-0" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d") : secret "cert-cinder-public-svc" not found Nov 21 13:18:15 crc kubenswrapper[4769]: I1121 13:18:15.607036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.121853 4769 generic.go:334] "Generic (PLEG): container finished" podID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerID="911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2" exitCode=1 Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.121980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerDied","Data":"911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2"} Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.122089 4769 scope.go:117] "RemoveContainer" containerID="5c7d496c5c89e023883b8b5fc599723e3c3f5b9c7014b171776f37f05ef5d5e5" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.123371 4769 scope.go:117] "RemoveContainer" containerID="911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2" Nov 21 13:18:16 crc kubenswrapper[4769]: E1121 13:18:16.124106 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.133365 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.137896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"cf393762-ecdb-4462-8198-0f85d54912e7","Type":"ContainerStarted","Data":"2f4f3e90046e483bb711b36f5823b5f9ae214a329eba2cafa8e19c1887b99826"} Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.217116 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=4.217095675 podStartE2EDuration="4.217095675s" podCreationTimestamp="2025-11-21 13:18:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:16.183417588 +0000 UTC m=+5254.884079416" watchObservedRunningTime="2025-11-21 13:18:16.217095675 +0000 UTC m=+5254.917757493" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.220302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-combined-ca-bundle\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-log-httpd\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-sg-core-conf-yaml\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-run-httpd\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-scripts\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-config-data\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v4vv\" (UniqueName: \"kubernetes.io/projected/2e26e138-4a68-4436-84a6-9713ee58c8ee-kube-api-access-9v4vv\") pod \"2e26e138-4a68-4436-84a6-9713ee58c8ee\" (UID: \"2e26e138-4a68-4436-84a6-9713ee58c8ee\") " Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.317906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.318101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.318683 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.318706 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2e26e138-4a68-4436-84a6-9713ee58c8ee-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.322073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-config-data" (OuterVolumeSpecName: "config-data") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.322487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-scripts" (OuterVolumeSpecName: "scripts") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.322687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.324418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e26e138-4a68-4436-84a6-9713ee58c8ee-kube-api-access-9v4vv" (OuterVolumeSpecName: "kube-api-access-9v4vv") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "kube-api-access-9v4vv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.346432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e26e138-4a68-4436-84a6-9713ee58c8ee" (UID: "2e26e138-4a68-4436-84a6-9713ee58c8ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.355650 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:16 crc kubenswrapper[4769]: E1121 13:18:16.356661 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/cinder-api-0" podUID="48eb070a-aa77-468b-a3c2-74300e75594d" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.421800 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.421853 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.421867 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.421887 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9v4vv\" (UniqueName: \"kubernetes.io/projected/2e26e138-4a68-4436-84a6-9713ee58c8ee-kube-api-access-9v4vv\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.421908 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:16 crc kubenswrapper[4769]: I1121 13:18:16.933326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") pod \"barbican-api-d89fbdf48-gck5c\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:16 crc kubenswrapper[4769]: E1121 13:18:16.933507 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-barbican-public-svc: secret "cert-barbican-public-svc" not found Nov 21 13:18:16 crc kubenswrapper[4769]: E1121 13:18:16.933920 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs podName:74ad1f39-faa9-412c-97e7-ad0edd13c885 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:32.933902724 +0000 UTC m=+5271.634564542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs") pod "barbican-api-d89fbdf48-gck5c" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885") : secret "cert-barbican-public-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.137954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.138096 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.138172 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:33.138154507 +0000 UTC m=+5271.838816325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.138409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.138724 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.138799 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:18:33.138780764 +0000 UTC m=+5271.839442602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.147577 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.147612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.163367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.217009 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.235689 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jx8\" (UniqueName: \"kubernetes.io/projected/48eb070a-aa77-468b-a3c2-74300e75594d-kube-api-access-r2jx8\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239559 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48eb070a-aa77-468b-a3c2-74300e75594d-logs\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-combined-ca-bundle\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239623 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48eb070a-aa77-468b-a3c2-74300e75594d-etc-machine-id\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239806 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data-custom\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.239846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-scripts\") pod \"48eb070a-aa77-468b-a3c2-74300e75594d\" (UID: \"48eb070a-aa77-468b-a3c2-74300e75594d\") " Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.240044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48eb070a-aa77-468b-a3c2-74300e75594d-logs" (OuterVolumeSpecName: "logs") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.240451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/48eb070a-aa77-468b-a3c2-74300e75594d-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.241574 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/48eb070a-aa77-468b-a3c2-74300e75594d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.254846 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.263409 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.266099 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.266397 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.266540 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.272001 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.273757 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.274103 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.289450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.289495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.289556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data" (OuterVolumeSpecName: "config-data") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.289573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.295241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48eb070a-aa77-468b-a3c2-74300e75594d-kube-api-access-r2jx8" (OuterVolumeSpecName: "kube-api-access-r2jx8") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "kube-api-access-r2jx8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.297959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-scripts" (OuterVolumeSpecName: "scripts") pod "48eb070a-aa77-468b-a3c2-74300e75594d" (UID: "48eb070a-aa77-468b-a3c2-74300e75594d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.299759 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e26e138-4a68-4436-84a6-9713ee58c8ee" path="/var/lib/kubelet/pods/2e26e138-4a68-4436-84a6-9713ee58c8ee/volumes" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.344055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-log-httpd\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.344109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.344638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-config-data\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.344714 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.344838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5tb\" (UniqueName: \"kubernetes.io/projected/f1009742-1d7e-44b0-b3ed-690da05e8e41-kube-api-access-gj5tb\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-scripts\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-run-httpd\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346810 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346839 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346853 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346868 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/48eb070a-aa77-468b-a3c2-74300e75594d-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346886 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e26e138-4a68-4436-84a6-9713ee58c8ee-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346900 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346913 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.346931 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r2jx8\" (UniqueName: \"kubernetes.io/projected/48eb070a-aa77-468b-a3c2-74300e75594d-kube-api-access-r2jx8\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.448766 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-config-data\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.449625 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.449701 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:33.449682279 +0000 UTC m=+5272.150344097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-public-svc" not found Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449708 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5tb\" (UniqueName: \"kubernetes.io/projected/f1009742-1d7e-44b0-b3ed-690da05e8e41-kube-api-access-gj5tb\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.449838 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-scripts\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-run-httpd\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-log-httpd\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450499 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-run-httpd\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.450779 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.450894 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs podName:32a2a58b-94ff-4246-9a32-914964266c1a nodeName:}" failed. No retries permitted until 2025-11-21 13:18:33.450875681 +0000 UTC m=+5272.151537599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs") pod "neutron-6f6994f598-xm7l5" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a") : secret "cert-neutron-ovndbs" not found Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.450805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-log-httpd\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.452223 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.455385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-config-data\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.455628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.461875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"neutron-6f6994f598-xm7l5\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.462161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.462206 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-scripts\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.462450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.463076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"keystone-5868866f7b-tknss\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.471076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5tb\" (UniqueName: \"kubernetes.io/projected/f1009742-1d7e-44b0-b3ed-690da05e8e41-kube-api-access-gj5tb\") pod \"ceilometer-0\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.551297 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.595963 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.956614 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.957586 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.966633 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:17 crc kubenswrapper[4769]: I1121 13:18:17.966902 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.967145 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.967230 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:25.967213251 +0000 UTC m=+5264.667875089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.967643 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:17 crc kubenswrapper[4769]: E1121 13:18:17.967703 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:25.967692394 +0000 UTC m=+5264.668354232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovn-metrics" not found Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.024901 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5868866f7b-tknss"] Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.137993 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.159454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" event={"ID":"3d9eede1-62b7-48a8-86a4-ccde7312f0e4","Type":"ContainerStarted","Data":"a07e9174e34265c17d02772c3e51eab4eaf208c28248f8898404eb5ebb763e58"} Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.161152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerStarted","Data":"9932763396c7c0ebdce2613ee4c4810f0ae0e89e939bef144a6302daa07afea6"} Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.161169 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.240027 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.258313 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.268332 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.270743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.274675 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.275062 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.275156 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277642 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277762 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhtnb\" (UniqueName: \"kubernetes.io/projected/ee629876-0334-4adf-af35-f82beface453-kube-api-access-mhtnb\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277842 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data-custom\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.277979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-scripts\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.278119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee629876-0334-4adf-af35-f82beface453-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.278210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee629876-0334-4adf-af35-f82beface453-logs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.278351 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/48eb070a-aa77-468b-a3c2-74300e75594d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.278827 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.357231 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-scripts\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee629876-0334-4adf-af35-f82beface453-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380133 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee629876-0334-4adf-af35-f82beface453-logs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mhtnb\" (UniqueName: \"kubernetes.io/projected/ee629876-0334-4adf-af35-f82beface453-kube-api-access-mhtnb\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380364 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data-custom\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee629876-0334-4adf-af35-f82beface453-etc-machine-id\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.380852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee629876-0334-4adf-af35-f82beface453-logs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.385635 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-scripts\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.385840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data-custom\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.386693 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.387134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.389022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.390749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-public-tls-certs\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.391796 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.396543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhtnb\" (UniqueName: \"kubernetes.io/projected/ee629876-0334-4adf-af35-f82beface453-kube-api-access-mhtnb\") pod \"cinder-api-0\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.550084 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.550822 4769 scope.go:117] "RemoveContainer" containerID="911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2" Nov 21 13:18:18 crc kubenswrapper[4769]: E1121 13:18:18.551389 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.648233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.968451 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.124:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:18 crc kubenswrapper[4769]: I1121 13:18:18.980519 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.124:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.185592 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:19 crc kubenswrapper[4769]: W1121 13:18:19.189073 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee629876_0334_4adf_af35_f82beface453.slice/crio-c7e5d352f7e7c3c94bfd2d320a92948fc06a9e31d3f4b54cf7ccd2c6d8f2d1c8 WatchSource:0}: Error finding container c7e5d352f7e7c3c94bfd2d320a92948fc06a9e31d3f4b54cf7ccd2c6d8f2d1c8: Status 404 returned error can't find the container with id c7e5d352f7e7c3c94bfd2d320a92948fc06a9e31d3f4b54cf7ccd2c6d8f2d1c8 Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.195089 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" event={"ID":"3d9eede1-62b7-48a8-86a4-ccde7312f0e4","Type":"ContainerStarted","Data":"8adab6c34885496a2c52b5ff0c76f15baed8c4850c15ded559cac04cc3c7e6b9"} Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.195152 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.205294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.214444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"memcached-0\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.241297 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" podStartSLOduration=18.241272744 podStartE2EDuration="18.241272744s" podCreationTimestamp="2025-11-21 13:18:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:19.229364543 +0000 UTC m=+5257.930026371" watchObservedRunningTime="2025-11-21 13:18:19.241272744 +0000 UTC m=+5257.941934562" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.251630 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.291947 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48eb070a-aa77-468b-a3c2-74300e75594d" path="/var/lib/kubelet/pods/48eb070a-aa77-468b-a3c2-74300e75594d/volumes" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.307668 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.307713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.308364 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-nb-ovndbs: secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.308409 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:35.308396072 +0000 UTC m=+5274.009057890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "ovsdbserver-nb-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovndbcluster-nb-ovndbs" not found Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.309092 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.309128 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs podName:cdf2d017-23db-4785-bd86-878843cd47b4 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:35.309120192 +0000 UTC m=+5274.009782010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs") pod "ovsdbserver-nb-0" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4") : secret "cert-ovn-metrics" not found Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.410693 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.410810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.410862 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.410937 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovndbcluster-sb-ovndbs: secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.410944 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:35.410923174 +0000 UTC m=+5274.111584992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovn-metrics" not found Nov 21 13:18:19 crc kubenswrapper[4769]: E1121 13:18:19.410972 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs podName:01898107-d50e-405c-a122-83e5d3e1720e nodeName:}" failed. No retries permitted until 2025-11-21 13:18:35.410963085 +0000 UTC m=+5274.111624903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "ovsdbserver-sb-tls-certs" (UniqueName: "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs") pod "ovsdbserver-sb-0" (UID: "01898107-d50e-405c-a122-83e5d3e1720e") : secret "cert-ovndbcluster-sb-ovndbs" not found Nov 21 13:18:19 crc kubenswrapper[4769]: I1121 13:18:19.449033 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:20 crc kubenswrapper[4769]: I1121 13:18:20.028808 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:20 crc kubenswrapper[4769]: W1121 13:18:20.045652 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebaa8c46_edc4_42ef_b0b7_c2b46d9c5237.slice/crio-8d4654b3e55935c9825adedf95049866eb6c795357f9c9cff85ae1932328aea2 WatchSource:0}: Error finding container 8d4654b3e55935c9825adedf95049866eb6c795357f9c9cff85ae1932328aea2: Status 404 returned error can't find the container with id 8d4654b3e55935c9825adedf95049866eb6c795357f9c9cff85ae1932328aea2 Nov 21 13:18:20 crc kubenswrapper[4769]: I1121 13:18:20.213063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ee629876-0334-4adf-af35-f82beface453","Type":"ContainerStarted","Data":"411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88"} Nov 21 13:18:20 crc kubenswrapper[4769]: I1121 13:18:20.213119 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ee629876-0334-4adf-af35-f82beface453","Type":"ContainerStarted","Data":"c7e5d352f7e7c3c94bfd2d320a92948fc06a9e31d3f4b54cf7ccd2c6d8f2d1c8"} Nov 21 13:18:20 crc kubenswrapper[4769]: I1121 13:18:20.221346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237","Type":"ContainerStarted","Data":"8d4654b3e55935c9825adedf95049866eb6c795357f9c9cff85ae1932328aea2"} Nov 21 13:18:20 crc kubenswrapper[4769]: I1121 13:18:20.558577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:20 crc kubenswrapper[4769]: I1121 13:18:20.558639 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:20 crc kubenswrapper[4769]: E1121 13:18:20.558802 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:20 crc kubenswrapper[4769]: E1121 13:18:20.558857 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:20 crc kubenswrapper[4769]: E1121 13:18:20.558882 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:36.558862518 +0000 UTC m=+5275.259524336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:18:20 crc kubenswrapper[4769]: E1121 13:18:20.558910 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs podName:03ac8777-8f62-4bc5-b214-281f4a01352c nodeName:}" failed. No retries permitted until 2025-11-21 13:18:36.558896799 +0000 UTC m=+5275.259558627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.217733 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c"] Nov 21 13:18:21 crc kubenswrapper[4769]: E1121 13:18:21.218722 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" podUID="74ad1f39-faa9-412c-97e7-ad0edd13c885" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.231389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237","Type":"ContainerStarted","Data":"a61826de7083b516071a8645961c499af6c71573459a9702acf35f8fa9d0bb1f"} Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.231819 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.237085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.237229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ee629876-0334-4adf-af35-f82beface453","Type":"ContainerStarted","Data":"9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c"} Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.237336 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.254035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.257001 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5"] Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.258631 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.277875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") pod \"74ad1f39-faa9-412c-97e7-ad0edd13c885\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.277956 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fszzf\" (UniqueName: \"kubernetes.io/projected/74ad1f39-faa9-412c-97e7-ad0edd13c885-kube-api-access-fszzf\") pod \"74ad1f39-faa9-412c-97e7-ad0edd13c885\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/74ad1f39-faa9-412c-97e7-ad0edd13c885-logs\") pod \"74ad1f39-faa9-412c-97e7-ad0edd13c885\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data-custom\") pod \"74ad1f39-faa9-412c-97e7-ad0edd13c885\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278065 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data\") pod \"74ad1f39-faa9-412c-97e7-ad0edd13c885\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-combined-ca-bundle\") pod \"74ad1f39-faa9-412c-97e7-ad0edd13c885\" (UID: \"74ad1f39-faa9-412c-97e7-ad0edd13c885\") " Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/797d3cd9-6063-4c91-8d90-5628845039e8-logs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-internal-tls-certs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-public-tls-certs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-combined-ca-bundle\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kgr5\" (UniqueName: \"kubernetes.io/projected/797d3cd9-6063-4c91-8d90-5628845039e8-kube-api-access-6kgr5\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.278690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data-custom\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.297991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74ad1f39-faa9-412c-97e7-ad0edd13c885-logs" (OuterVolumeSpecName: "logs") pod "74ad1f39-faa9-412c-97e7-ad0edd13c885" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.308100 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=18.308080402 podStartE2EDuration="18.308080402s" podCreationTimestamp="2025-11-21 13:18:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:21.256395919 +0000 UTC m=+5259.957057737" watchObservedRunningTime="2025-11-21 13:18:21.308080402 +0000 UTC m=+5260.008742220" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.311498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ad1f39-faa9-412c-97e7-ad0edd13c885-kube-api-access-fszzf" (OuterVolumeSpecName: "kube-api-access-fszzf") pod "74ad1f39-faa9-412c-97e7-ad0edd13c885" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885"). InnerVolumeSpecName "kube-api-access-fszzf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.311603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "74ad1f39-faa9-412c-97e7-ad0edd13c885" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.311688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "74ad1f39-faa9-412c-97e7-ad0edd13c885" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.312275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "74ad1f39-faa9-412c-97e7-ad0edd13c885" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.319483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data" (OuterVolumeSpecName: "config-data") pod "74ad1f39-faa9-412c-97e7-ad0edd13c885" (UID: "74ad1f39-faa9-412c-97e7-ad0edd13c885"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.346085 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5"] Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.356249 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.356219369 podStartE2EDuration="3.356219369s" podCreationTimestamp="2025-11-21 13:18:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:21.31172973 +0000 UTC m=+5260.012391548" watchObservedRunningTime="2025-11-21 13:18:21.356219369 +0000 UTC m=+5260.056881187" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380205 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6kgr5\" (UniqueName: \"kubernetes.io/projected/797d3cd9-6063-4c91-8d90-5628845039e8-kube-api-access-6kgr5\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data-custom\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380455 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/797d3cd9-6063-4c91-8d90-5628845039e8-logs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-internal-tls-certs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380492 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-public-tls-certs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380532 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-combined-ca-bundle\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380663 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380677 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fszzf\" (UniqueName: \"kubernetes.io/projected/74ad1f39-faa9-412c-97e7-ad0edd13c885-kube-api-access-fszzf\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380688 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/74ad1f39-faa9-412c-97e7-ad0edd13c885-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380698 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380709 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.380718 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.381413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/797d3cd9-6063-4c91-8d90-5628845039e8-logs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.384363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-combined-ca-bundle\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.385009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-public-tls-certs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.385577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data-custom\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.386012 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-internal-tls-certs\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.388602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.395183 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kgr5\" (UniqueName: \"kubernetes.io/projected/797d3cd9-6063-4c91-8d90-5628845039e8-kube-api-access-6kgr5\") pod \"barbican-api-748fd86b66-5pcr5\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.546504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.546893 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.656570 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:21 crc kubenswrapper[4769]: I1121 13:18:21.686602 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.195962 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5"] Nov 21 13:18:22 crc kubenswrapper[4769]: W1121 13:18:22.208259 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod797d3cd9_6063_4c91_8d90_5628845039e8.slice/crio-658871fcd716c1dec5630370863f1534bb45bd158463099bb42f4da8cc832c77 WatchSource:0}: Error finding container 658871fcd716c1dec5630370863f1534bb45bd158463099bb42f4da8cc832c77: Status 404 returned error can't find the container with id 658871fcd716c1dec5630370863f1534bb45bd158463099bb42f4da8cc832c77 Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.247644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" event={"ID":"797d3cd9-6063-4c91-8d90-5628845039e8","Type":"ContainerStarted","Data":"658871fcd716c1dec5630370863f1534bb45bd158463099bb42f4da8cc832c77"} Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.247822 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.306213 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c"] Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.337510 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-d89fbdf48-gck5c"] Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.367103 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.505398 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/74ad1f39-faa9-412c-97e7-ad0edd13c885-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.606986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.611788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.616358 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.616584 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.748691 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:22 crc kubenswrapper[4769]: I1121 13:18:22.842586 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.258889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" event={"ID":"797d3cd9-6063-4c91-8d90-5628845039e8","Type":"ContainerStarted","Data":"0d05fe9f89fd92a1ae7e80c040c3ad662e3fcc554593635eedb1fee44c542ca1"} Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.259306 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.259318 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.259326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" event={"ID":"797d3cd9-6063-4c91-8d90-5628845039e8","Type":"ContainerStarted","Data":"23ccda9b087fd680e768137e483901727a68450f675d8f2ef6157d28893f6801"} Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.288102 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ad1f39-faa9-412c-97e7-ad0edd13c885" path="/var/lib/kubelet/pods/74ad1f39-faa9-412c-97e7-ad0edd13c885/volumes" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.327837 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" podStartSLOduration=2.327821143 podStartE2EDuration="2.327821143s" podCreationTimestamp="2025-11-21 13:18:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:23.295387649 +0000 UTC m=+5261.996049467" watchObservedRunningTime="2025-11-21 13:18:23.327821143 +0000 UTC m=+5262.028482961" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.330528 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.331681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.331845 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") pod \"nova-api-0\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:23 crc kubenswrapper[4769]: E1121 13:18:23.331872 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Nov 21 13:18:23 crc kubenswrapper[4769]: E1121 13:18:23.332068 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:39.332051497 +0000 UTC m=+5278.032713315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-internal-svc" not found Nov 21 13:18:23 crc kubenswrapper[4769]: E1121 13:18:23.332139 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Nov 21 13:18:23 crc kubenswrapper[4769]: E1121 13:18:23.332349 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs podName:04b8df03-70c8-45b7-b80d-93ee00880c63 nodeName:}" failed. No retries permitted until 2025-11-21 13:18:39.332267572 +0000 UTC m=+5278.032929400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs") pod "nova-api-0" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63") : secret "cert-nova-public-svc" not found Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.364461 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.125:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.401885 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.433422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.471011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:23 crc kubenswrapper[4769]: I1121 13:18:23.531234 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:24 crc kubenswrapper[4769]: W1121 13:18:24.002345 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad35f3f3_be0b_46f9_b5de_f72839180563.slice/crio-a569f54f7416014f66d38914ba47cd1db7e3f82dfb753727789287d43432d4f6 WatchSource:0}: Error finding container a569f54f7416014f66d38914ba47cd1db7e3f82dfb753727789287d43432d4f6: Status 404 returned error can't find the container with id a569f54f7416014f66d38914ba47cd1db7e3f82dfb753727789287d43432d4f6 Nov 21 13:18:24 crc kubenswrapper[4769]: I1121 13:18:24.009874 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:24 crc kubenswrapper[4769]: I1121 13:18:24.287444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4","Type":"ContainerStarted","Data":"f9b9e21765ad3e2656859b19e6345325ae1c7364a30ef377c6607d5ae9b30bfb"} Nov 21 13:18:24 crc kubenswrapper[4769]: I1121 13:18:24.287783 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4","Type":"ContainerStarted","Data":"dee50b38a9f97cf4a81a327698c8812dd6404cabbc286e1a47ab70608c2fc540"} Nov 21 13:18:24 crc kubenswrapper[4769]: I1121 13:18:24.295387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad35f3f3-be0b-46f9-b5de-f72839180563","Type":"ContainerStarted","Data":"a569f54f7416014f66d38914ba47cd1db7e3f82dfb753727789287d43432d4f6"} Nov 21 13:18:25 crc kubenswrapper[4769]: I1121 13:18:25.277355 4769 scope.go:117] "RemoveContainer" containerID="3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e" Nov 21 13:18:25 crc kubenswrapper[4769]: I1121 13:18:25.310153 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad35f3f3-be0b-46f9-b5de-f72839180563","Type":"ContainerStarted","Data":"add323a4aed2e05d0e4461f4da7d305f49c4daec7120a6638f73aaed7fa70e36"} Nov 21 13:18:25 crc kubenswrapper[4769]: I1121 13:18:25.313210 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4","Type":"ContainerStarted","Data":"42f999d52e4767e1e3e4606dd9df21020b0a3d45222066576d73ca2c7964d905"} Nov 21 13:18:25 crc kubenswrapper[4769]: I1121 13:18:25.343014 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=19.342991709 podStartE2EDuration="19.342991709s" podCreationTimestamp="2025-11-21 13:18:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:25.328012336 +0000 UTC m=+5264.028674164" watchObservedRunningTime="2025-11-21 13:18:25.342991709 +0000 UTC m=+5264.043653537" Nov 21 13:18:26 crc kubenswrapper[4769]: I1121 13:18:26.000360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:26 crc kubenswrapper[4769]: E1121 13:18:26.000558 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovnnorthd-ovndbs: secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:26 crc kubenswrapper[4769]: I1121 13:18:26.000584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:26 crc kubenswrapper[4769]: E1121 13:18:26.000771 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-ovn-metrics: secret "cert-ovn-metrics" not found Nov 21 13:18:26 crc kubenswrapper[4769]: E1121 13:18:26.001022 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:42.000979245 +0000 UTC m=+5280.701641083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovn-metrics" not found Nov 21 13:18:26 crc kubenswrapper[4769]: E1121 13:18:26.001060 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs podName:653286ca-0dcc-4209-99e7-ca16dfde4dfb nodeName:}" failed. No retries permitted until 2025-11-21 13:18:42.001039327 +0000 UTC m=+5280.701701145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "ovn-northd-tls-certs" (UniqueName: "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs") pod "ovn-northd-0" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb") : secret "cert-ovnnorthd-ovndbs" not found Nov 21 13:18:26 crc kubenswrapper[4769]: I1121 13:18:26.334522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerStarted","Data":"7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774"} Nov 21 13:18:26 crc kubenswrapper[4769]: I1121 13:18:26.335113 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:26 crc kubenswrapper[4769]: I1121 13:18:26.337914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad35f3f3-be0b-46f9-b5de-f72839180563","Type":"ContainerStarted","Data":"a4d2d64e30e1db27f8ac6c2690b992c10c11b30460d63d92aa15c3ed96bc0b8b"} Nov 21 13:18:26 crc kubenswrapper[4769]: I1121 13:18:26.377748 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=19.377724145 podStartE2EDuration="19.377724145s" podCreationTimestamp="2025-11-21 13:18:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:26.373000688 +0000 UTC m=+5265.073662526" watchObservedRunningTime="2025-11-21 13:18:26.377724145 +0000 UTC m=+5265.078385963" Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.378552 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerID="7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774" exitCode=1 Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.378626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerDied","Data":"7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774"} Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.379726 4769 scope.go:117] "RemoveContainer" containerID="3c92c98a99a6d8bc4ca812a3f92d9a27011a83782abc68f0ee1bcf8a6a83a01e" Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.380513 4769 scope.go:117] "RemoveContainer" containerID="7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774" Nov 21 13:18:28 crc kubenswrapper[4769]: E1121 13:18:28.380826 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.408912 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="cinder-scheduler" probeResult="failure" output="Get \"http://10.217.0.125:8080/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:28 crc kubenswrapper[4769]: E1121 13:18:28.464264 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out" image="quay.io/podified-antelope-centos9/openstack-ceilometer-central@sha256:7b50597c6dbca671784fa98d7317a18980f1a1ac729254460e6d769d70dfefc5" Nov 21 13:18:28 crc kubenswrapper[4769]: E1121 13:18:28.464992 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:ceilometer-central-agent,Image:quay.io/podified-antelope-centos9/openstack-ceilometer-central@sha256:7b50597c6dbca671784fa98d7317a18980f1a1ac729254460e6d769d70dfefc5,Command:[/bin/bash],Args:[-c /usr/local/bin/kolla_start],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:nc8h4h66h649h7h59ch579h5f4hf9h57fh59chb5h85h5cdh6fh5dbh54dh5b7h59ch5d7h557h645h668h5fbh5bch65dh9fhbfh689h698h568h5c9q,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:scripts,ReadOnly:true,MountPath:/var/lib/openstack/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/openstack/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data,ReadOnly:true,MountPath:/var/lib/kolla/config_files/config.json,SubPath:ceilometer-central-config.json,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:combined-ca-bundle,ReadOnly:true,MountPath:/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem,SubPath:tls-ca-bundle.pem,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-gj5tb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/python3 /var/lib/openstack/bin/centralhealth.py],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:300,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ceilometer-0_openstack-kuttl-tests(f1009742-1d7e-44b0-b3ed-690da05e8e41): ErrImagePull: parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out" logger="UnhandledError" Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.713636 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.966327 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.124:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:28 crc kubenswrapper[4769]: I1121 13:18:28.966325 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.124:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.027822 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.393877 4769 scope.go:117] "RemoveContainer" containerID="7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774" Nov 21 13:18:29 crc kubenswrapper[4769]: E1121 13:18:29.394422 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.450461 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.516736 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.672159 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.672490 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-log" containerID="cri-o://add323a4aed2e05d0e4461f4da7d305f49c4daec7120a6638f73aaed7fa70e36" gracePeriod=30 Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.672977 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-httpd" containerID="cri-o://a4d2d64e30e1db27f8ac6c2690b992c10c11b30460d63d92aa15c3ed96bc0b8b" gracePeriod=30 Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.692235 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:29 crc kubenswrapper[4769]: E1121 13:18:29.693515 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[nova-novncproxy-tls-certs vencrypt-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="03ac8777-8f62-4bc5-b214-281f4a01352c" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.750577 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.751074 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-httpd" containerID="cri-o://42f999d52e4767e1e3e4606dd9df21020b0a3d45222066576d73ca2c7964d905" gracePeriod=30 Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.750915 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-log" containerID="cri-o://f9b9e21765ad3e2656859b19e6345325ae1c7364a30ef377c6607d5ae9b30bfb" gracePeriod=30 Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.782770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6f6994f598-xm7l5"] Nov 21 13:18:29 crc kubenswrapper[4769]: E1121 13:18:29.783678 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ovndb-tls-certs public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" podUID="32a2a58b-94ff-4246-9a32-914964266c1a" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.814354 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5868866f7b-tknss"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.814560 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" podUID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" containerName="keystone-api" containerID="cri-o://8adab6c34885496a2c52b5ff0c76f15baed8c4850c15ded559cac04cc3c7e6b9" gracePeriod=30 Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.834053 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.835744 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.868337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.903805 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5bd9978c6b-sccsr"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.905611 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.911292 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5bd9978c6b-sccsr"] Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.965561 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" podUID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.112:5000/v3\": EOF" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990543 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9w94\" (UniqueName: \"kubernetes.io/projected/4aca7a55-cf5a-4979-856b-4252ae54ba5f-kube-api-access-b9w94\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-combined-ca-bundle\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-ovndb-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-internal-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-config\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-httpd-config\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:29 crc kubenswrapper[4769]: I1121 13:18:29.990969 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-public-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-combined-ca-bundle\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-scripts\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-internal-tls-certs\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-fernet-keys\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-config-data\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-public-tls-certs\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-ovndb-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-credential-keys\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-internal-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092545 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-config\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-combined-ca-bundle\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092611 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-httpd-config\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-public-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697c2\" (UniqueName: \"kubernetes.io/projected/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-kube-api-access-697c2\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.092713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b9w94\" (UniqueName: \"kubernetes.io/projected/4aca7a55-cf5a-4979-856b-4252ae54ba5f-kube-api-access-b9w94\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.101164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-httpd-config\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.102861 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-config\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.103454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-internal-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.114944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-public-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.115262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-ovndb-tls-certs\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.117697 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9w94\" (UniqueName: \"kubernetes.io/projected/4aca7a55-cf5a-4979-856b-4252ae54ba5f-kube-api-access-b9w94\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.135620 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-combined-ca-bundle\") pod \"neutron-7dff9d7dc4-j69vs\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.194728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-combined-ca-bundle\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-697c2\" (UniqueName: \"kubernetes.io/projected/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-kube-api-access-697c2\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-scripts\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-internal-tls-certs\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-fernet-keys\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-config-data\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195294 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-public-tls-certs\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.195336 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-credential-keys\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.201564 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-combined-ca-bundle\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.202916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-scripts\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.206719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-config-data\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.207702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-credential-keys\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.208730 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-internal-tls-certs\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.211647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-public-tls-certs\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.212495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-fernet-keys\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.219679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-697c2\" (UniqueName: \"kubernetes.io/projected/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-kube-api-access-697c2\") pod \"keystone-5bd9978c6b-sccsr\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.221320 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.250321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.453385 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerID="a4d2d64e30e1db27f8ac6c2690b992c10c11b30460d63d92aa15c3ed96bc0b8b" exitCode=0 Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.453419 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerID="add323a4aed2e05d0e4461f4da7d305f49c4daec7120a6638f73aaed7fa70e36" exitCode=143 Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.453471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad35f3f3-be0b-46f9-b5de-f72839180563","Type":"ContainerDied","Data":"a4d2d64e30e1db27f8ac6c2690b992c10c11b30460d63d92aa15c3ed96bc0b8b"} Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.453502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad35f3f3-be0b-46f9-b5de-f72839180563","Type":"ContainerDied","Data":"add323a4aed2e05d0e4461f4da7d305f49c4daec7120a6638f73aaed7fa70e36"} Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.469482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerStarted","Data":"c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594"} Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.494555 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:30 crc kubenswrapper[4769]: E1121 13:18:30.505457 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[internal-tls-certs public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-api-0" podUID="04b8df03-70c8-45b7-b80d-93ee00880c63" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.524127 4769 generic.go:334] "Generic (PLEG): container finished" podID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerID="42f999d52e4767e1e3e4606dd9df21020b0a3d45222066576d73ca2c7964d905" exitCode=0 Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.524166 4769 generic.go:334] "Generic (PLEG): container finished" podID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerID="f9b9e21765ad3e2656859b19e6345325ae1c7364a30ef377c6607d5ae9b30bfb" exitCode=143 Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.524274 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.524682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4","Type":"ContainerDied","Data":"42f999d52e4767e1e3e4606dd9df21020b0a3d45222066576d73ca2c7964d905"} Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.524725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4","Type":"ContainerDied","Data":"f9b9e21765ad3e2656859b19e6345325ae1c7364a30ef377c6607d5ae9b30bfb"} Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.524894 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" containerName="memcached" containerID="cri-o://a61826de7083b516071a8645961c499af6c71573459a9702acf35f8fa9d0bb1f" gracePeriod=30 Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.525106 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.586398 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.618369 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") pod \"32a2a58b-94ff-4246-9a32-914964266c1a\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwzlt\" (UniqueName: \"kubernetes.io/projected/32a2a58b-94ff-4246-9a32-914964266c1a-kube-api-access-gwzlt\") pod \"32a2a58b-94ff-4246-9a32-914964266c1a\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwk7g\" (UniqueName: \"kubernetes.io/projected/03ac8777-8f62-4bc5-b214-281f4a01352c-kube-api-access-nwk7g\") pod \"03ac8777-8f62-4bc5-b214-281f4a01352c\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727676 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-config\") pod \"32a2a58b-94ff-4246-9a32-914964266c1a\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-combined-ca-bundle\") pod \"03ac8777-8f62-4bc5-b214-281f4a01352c\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-httpd-config\") pod \"32a2a58b-94ff-4246-9a32-914964266c1a\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-combined-ca-bundle\") pod \"32a2a58b-94ff-4246-9a32-914964266c1a\" (UID: \"32a2a58b-94ff-4246-9a32-914964266c1a\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.727972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-config-data\") pod \"03ac8777-8f62-4bc5-b214-281f4a01352c\" (UID: \"03ac8777-8f62-4bc5-b214-281f4a01352c\") " Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.734853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-config-data" (OuterVolumeSpecName: "config-data") pod "03ac8777-8f62-4bc5-b214-281f4a01352c" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.735297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "32a2a58b-94ff-4246-9a32-914964266c1a" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.755355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "32a2a58b-94ff-4246-9a32-914964266c1a" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.755430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ac8777-8f62-4bc5-b214-281f4a01352c-kube-api-access-nwk7g" (OuterVolumeSpecName: "kube-api-access-nwk7g") pod "03ac8777-8f62-4bc5-b214-281f4a01352c" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c"). InnerVolumeSpecName "kube-api-access-nwk7g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.756469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-config" (OuterVolumeSpecName: "config") pod "32a2a58b-94ff-4246-9a32-914964266c1a" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.756522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03ac8777-8f62-4bc5-b214-281f4a01352c" (UID: "03ac8777-8f62-4bc5-b214-281f4a01352c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.756557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32a2a58b-94ff-4246-9a32-914964266c1a" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.760377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a2a58b-94ff-4246-9a32-914964266c1a-kube-api-access-gwzlt" (OuterVolumeSpecName: "kube-api-access-gwzlt") pod "32a2a58b-94ff-4246-9a32-914964266c1a" (UID: "32a2a58b-94ff-4246-9a32-914964266c1a"). InnerVolumeSpecName "kube-api-access-gwzlt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830705 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830741 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830752 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830761 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gwzlt\" (UniqueName: \"kubernetes.io/projected/32a2a58b-94ff-4246-9a32-914964266c1a-kube-api-access-gwzlt\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830773 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nwk7g\" (UniqueName: \"kubernetes.io/projected/03ac8777-8f62-4bc5-b214-281f4a01352c-kube-api-access-nwk7g\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830781 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830789 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.830797 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:30 crc kubenswrapper[4769]: I1121 13:18:30.895660 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.017708 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.040894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.040991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-scripts\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.041030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-logs\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.041052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nwlz\" (UniqueName: \"kubernetes.io/projected/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-kube-api-access-5nwlz\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.041119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-combined-ca-bundle\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.041207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.041245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-httpd-run\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.041267 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-config-data\") pod \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\" (UID: \"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.047316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.051890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-logs" (OuterVolumeSpecName: "logs") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.057621 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-kube-api-access-5nwlz" (OuterVolumeSpecName: "kube-api-access-5nwlz") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "kube-api-access-5nwlz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.086137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.086239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-scripts" (OuterVolumeSpecName: "scripts") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.115279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.122155 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5bd9978c6b-sccsr"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.143293 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.143316 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.143338 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.143349 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.143358 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.143368 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5nwlz\" (UniqueName: \"kubernetes.io/projected/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-kube-api-access-5nwlz\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.222547 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.225211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.246565 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.246601 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.252236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-config-data" (OuterVolumeSpecName: "config-data") pod "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" (UID: "1cb6ac7f-13cf-4627-986b-bff3ff6be5a4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.275379 4769 scope.go:117] "RemoveContainer" containerID="911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.276289 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:18:31 crc kubenswrapper[4769]: E1121 13:18:31.276545 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.316784 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.350214 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451469 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-logs\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-scripts\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-combined-ca-bundle\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451759 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-httpd-run\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7nxl\" (UniqueName: \"kubernetes.io/projected/ad35f3f3-be0b-46f9-b5de-f72839180563-kube-api-access-r7nxl\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.451887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-config-data\") pod \"ad35f3f3-be0b-46f9-b5de-f72839180563\" (UID: \"ad35f3f3-be0b-46f9-b5de-f72839180563\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.453978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.454461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-logs" (OuterVolumeSpecName: "logs") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.459128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad35f3f3-be0b-46f9-b5de-f72839180563-kube-api-access-r7nxl" (OuterVolumeSpecName: "kube-api-access-r7nxl") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "kube-api-access-r7nxl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.463352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-scripts" (OuterVolumeSpecName: "scripts") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.465258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.485326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.525387 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-config-data" (OuterVolumeSpecName: "config-data") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.529402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ad35f3f3-be0b-46f9-b5de-f72839180563" (UID: "ad35f3f3-be0b-46f9-b5de-f72839180563"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.542954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ad35f3f3-be0b-46f9-b5de-f72839180563","Type":"ContainerDied","Data":"a569f54f7416014f66d38914ba47cd1db7e3f82dfb753727789287d43432d4f6"} Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.542987 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.543003 4769 scope.go:117] "RemoveContainer" containerID="a4d2d64e30e1db27f8ac6c2690b992c10c11b30460d63d92aa15c3ed96bc0b8b" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.551441 4769 generic.go:334] "Generic (PLEG): container finished" podID="ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" containerID="a61826de7083b516071a8645961c499af6c71573459a9702acf35f8fa9d0bb1f" exitCode=0 Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.551515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237","Type":"ContainerDied","Data":"a61826de7083b516071a8645961c499af6c71573459a9702acf35f8fa9d0bb1f"} Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.553996 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r7nxl\" (UniqueName: \"kubernetes.io/projected/ad35f3f3-be0b-46f9-b5de-f72839180563-kube-api-access-r7nxl\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554018 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554027 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554035 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554043 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554064 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554073 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad35f3f3-be0b-46f9-b5de-f72839180563-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.554082 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ad35f3f3-be0b-46f9-b5de-f72839180563-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.556354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerStarted","Data":"b718218e62347f8b26f4ebac6ecc8510f7c1a835b66d1135a950a27699309fbd"} Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.566964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1cb6ac7f-13cf-4627-986b-bff3ff6be5a4","Type":"ContainerDied","Data":"dee50b38a9f97cf4a81a327698c8812dd6404cabbc286e1a47ab70608c2fc540"} Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.567062 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.576463 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6f6994f598-xm7l5" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.577968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" event={"ID":"c1b56e2b-87d8-453b-a5cf-7c07d00b58de","Type":"ContainerStarted","Data":"75966c2199dd9e42136a8e1db289d3f6f34401bc64659cb427ddfd6c08f050fc"} Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.578035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.578563 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.586369 4769 scope.go:117] "RemoveContainer" containerID="add323a4aed2e05d0e4461f4da7d305f49c4daec7120a6638f73aaed7fa70e36" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.586947 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.593737 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.619364 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.650436 4769 scope.go:117] "RemoveContainer" containerID="42f999d52e4767e1e3e4606dd9df21020b0a3d45222066576d73ca2c7964d905" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.688932 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: E1121 13:18:31.689389 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-httpd" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689409 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-httpd" Nov 21 13:18:31 crc kubenswrapper[4769]: E1121 13:18:31.689419 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-httpd" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689426 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-httpd" Nov 21 13:18:31 crc kubenswrapper[4769]: E1121 13:18:31.689439 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-log" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689446 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-log" Nov 21 13:18:31 crc kubenswrapper[4769]: E1121 13:18:31.689481 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-log" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689488 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-log" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-log" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689674 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" containerName="glance-httpd" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689693 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-log" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.689705 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" containerName="glance-httpd" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.690799 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.700728 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-bklzq" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.700912 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.700973 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.701034 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.706037 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.706102 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.743183 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.750383 4769 scope.go:117] "RemoveContainer" containerID="f9b9e21765ad3e2656859b19e6345325ae1c7364a30ef377c6607d5ae9b30bfb" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.757127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04b8df03-70c8-45b7-b80d-93ee00880c63-logs\") pod \"04b8df03-70c8-45b7-b80d-93ee00880c63\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.757365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-combined-ca-bundle\") pod \"04b8df03-70c8-45b7-b80d-93ee00880c63\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.758023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-config-data\") pod \"04b8df03-70c8-45b7-b80d-93ee00880c63\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.758120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6tc7\" (UniqueName: \"kubernetes.io/projected/04b8df03-70c8-45b7-b80d-93ee00880c63-kube-api-access-w6tc7\") pod \"04b8df03-70c8-45b7-b80d-93ee00880c63\" (UID: \"04b8df03-70c8-45b7-b80d-93ee00880c63\") " Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.757487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04b8df03-70c8-45b7-b80d-93ee00880c63-logs" (OuterVolumeSpecName: "logs") pod "04b8df03-70c8-45b7-b80d-93ee00880c63" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.758836 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/04b8df03-70c8-45b7-b80d-93ee00880c63-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.758908 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.764308 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.764806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-config-data" (OuterVolumeSpecName: "config-data") pod "04b8df03-70c8-45b7-b80d-93ee00880c63" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.769696 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "04b8df03-70c8-45b7-b80d-93ee00880c63" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.772157 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b8df03-70c8-45b7-b80d-93ee00880c63-kube-api-access-w6tc7" (OuterVolumeSpecName: "kube-api-access-w6tc7") pod "04b8df03-70c8-45b7-b80d-93ee00880c63" (UID: "04b8df03-70c8-45b7-b80d-93ee00880c63"). InnerVolumeSpecName "kube-api-access-w6tc7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.773842 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.781262 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.785472 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.785717 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.785830 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.821248 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6f6994f598-xm7l5"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.835218 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6f6994f598-xm7l5"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.847266 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.855808 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-scripts\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-logs\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866586 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg95t\" (UniqueName: \"kubernetes.io/projected/d00a1c01-316a-4298-a685-949250f157fe-kube-api-access-fg95t\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866827 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwk6\" (UniqueName: \"kubernetes.io/projected/4b2083be-823d-422d-af53-af0074ba54cd-kube-api-access-wpwk6\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-config-data\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.866988 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.867000 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.867010 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.867019 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w6tc7\" (UniqueName: \"kubernetes.io/projected/04b8df03-70c8-45b7-b80d-93ee00880c63-kube-api-access-w6tc7\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.867030 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/03ac8777-8f62-4bc5-b214-281f4a01352c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.887888 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.898417 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.900131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.902771 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.902874 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.928277 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.956013 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:31 crc kubenswrapper[4769]: E1121 13:18:31.956797 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs-tls-certs ovsdbserver-nb-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="cdf2d017-23db-4785-bd86-878843cd47b4" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-scripts\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-logs\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.968995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fg95t\" (UniqueName: \"kubernetes.io/projected/d00a1c01-316a-4298-a685-949250f157fe-kube-api-access-fg95t\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-logs\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969557 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.969741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.970540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwk6\" (UniqueName: \"kubernetes.io/projected/4b2083be-823d-422d-af53-af0074ba54cd-kube-api-access-wpwk6\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.970647 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.970763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prtk\" (UniqueName: \"kubernetes.io/projected/6eda467f-6052-47e5-9913-12698d31aee1-kube-api-access-8prtk\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.970910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-config-data\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.970992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.971092 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.971149 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/32a2a58b-94ff-4246-9a32-914964266c1a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.971963 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.973003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.973543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-logs\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.975627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.976030 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.978874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.980489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.984967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-config-data\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.986723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-scripts\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.990744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwk6\" (UniqueName: \"kubernetes.io/projected/4b2083be-823d-422d-af53-af0074ba54cd-kube-api-access-wpwk6\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.991159 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.994525 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:31 crc kubenswrapper[4769]: I1121 13:18:31.994803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg95t\" (UniqueName: \"kubernetes.io/projected/d00a1c01-316a-4298-a685-949250f157fe-kube-api-access-fg95t\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.045786 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-logs\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073495 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8prtk\" (UniqueName: \"kubernetes.io/projected/6eda467f-6052-47e5-9913-12698d31aee1-kube-api-access-8prtk\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073749 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.073832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.074289 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-logs\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.074319 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.074781 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.080243 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-scripts\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.089046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-config-data\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.090905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.091969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.093445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prtk\" (UniqueName: \"kubernetes.io/projected/6eda467f-6052-47e5-9913-12698d31aee1-kube-api-access-8prtk\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.108643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.188713 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.226390 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.342125 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.479625 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.630480 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerStarted","Data":"17127d8fae66c1070ce2b9cbe311a112e8390090f1e93b4e52b36c1aaced1ef0"} Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.632844 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.633341 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.674452 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.809293 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.822613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.851818 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.869279 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.872382 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.886036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.886141 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.886483 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.916593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdb-rundir\") pod \"cdf2d017-23db-4785-bd86-878843cd47b4\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.916643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpwbs\" (UniqueName: \"kubernetes.io/projected/cdf2d017-23db-4785-bd86-878843cd47b4-kube-api-access-rpwbs\") pod \"cdf2d017-23db-4785-bd86-878843cd47b4\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.916685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-config\") pod \"cdf2d017-23db-4785-bd86-878843cd47b4\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.916740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-scripts\") pod \"cdf2d017-23db-4785-bd86-878843cd47b4\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.916764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"cdf2d017-23db-4785-bd86-878843cd47b4\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.916793 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-combined-ca-bundle\") pod \"cdf2d017-23db-4785-bd86-878843cd47b4\" (UID: \"cdf2d017-23db-4785-bd86-878843cd47b4\") " Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.917502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-config" (OuterVolumeSpecName: "config") pod "cdf2d017-23db-4785-bd86-878843cd47b4" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.918627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "cdf2d017-23db-4785-bd86-878843cd47b4" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.918714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.921249 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf2d017-23db-4785-bd86-878843cd47b4-kube-api-access-rpwbs" (OuterVolumeSpecName: "kube-api-access-rpwbs") pod "cdf2d017-23db-4785-bd86-878843cd47b4" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4"). InnerVolumeSpecName "kube-api-access-rpwbs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.922671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-scripts" (OuterVolumeSpecName: "scripts") pod "cdf2d017-23db-4785-bd86-878843cd47b4" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.928481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "cdf2d017-23db-4785-bd86-878843cd47b4" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.932931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cdf2d017-23db-4785-bd86-878843cd47b4" (UID: "cdf2d017-23db-4785-bd86-878843cd47b4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:32 crc kubenswrapper[4769]: I1121 13:18:32.955875 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.018722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-config-data\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.018802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.018903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.018930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx82t\" (UniqueName: \"kubernetes.io/projected/6a1be668-7c60-4d82-b2e9-a78e11562b6a-kube-api-access-kx82t\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.018957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-public-tls-certs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.018988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a1be668-7c60-4d82-b2e9-a78e11562b6a-logs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019071 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019082 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019092 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cdf2d017-23db-4785-bd86-878843cd47b4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019111 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019120 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019132 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04b8df03-70c8-45b7-b80d-93ee00880c63-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019141 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.019149 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rpwbs\" (UniqueName: \"kubernetes.io/projected/cdf2d017-23db-4785-bd86-878843cd47b4-kube-api-access-rpwbs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.065569 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.066773 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs-tls-certs ovsdbserver-sb-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="01898107-d50e-405c-a122-83e5d3e1720e" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.068333 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.120521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.120565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kx82t\" (UniqueName: \"kubernetes.io/projected/6a1be668-7c60-4d82-b2e9-a78e11562b6a-kube-api-access-kx82t\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.120598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-public-tls-certs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.120634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a1be668-7c60-4d82-b2e9-a78e11562b6a-logs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.120725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-config-data\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.121927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.122017 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.123582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a1be668-7c60-4d82-b2e9-a78e11562b6a-logs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.128650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.129118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-config-data\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.134662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-public-tls-certs\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.151866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.170565 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx82t\" (UniqueName: \"kubernetes.io/projected/6a1be668-7c60-4d82-b2e9-a78e11562b6a-kube-api-access-kx82t\") pod \"nova-api-0\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.216269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.223712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.223849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") pod \"placement-5f9ff86c46-xdt6p\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.224065 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.224173 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:19:05.224118952 +0000 UTC m=+5303.924780770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-public-svc" not found Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.224586 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.224614 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs podName:0f0bb7e0-c308-4869-bfe8-53d4a526f24f nodeName:}" failed. No retries permitted until 2025-11-21 13:19:05.224606325 +0000 UTC m=+5303.925268233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs") pod "placement-5f9ff86c46-xdt6p" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f") : secret "cert-placement-internal-svc" not found Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.254299 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.324548 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kolla-config\") pod \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.324898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-combined-ca-bundle\") pod \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.324927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") pod \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.325005 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-config-data\") pod \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.325041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrq5q\" (UniqueName: \"kubernetes.io/projected/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kube-api-access-jrq5q\") pod \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\" (UID: \"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.330086 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ac8777-8f62-4bc5-b214-281f4a01352c" path="/var/lib/kubelet/pods/03ac8777-8f62-4bc5-b214-281f4a01352c/volumes" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.330532 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04b8df03-70c8-45b7-b80d-93ee00880c63" path="/var/lib/kubelet/pods/04b8df03-70c8-45b7-b80d-93ee00880c63/volumes" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.330965 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb6ac7f-13cf-4627-986b-bff3ff6be5a4" path="/var/lib/kubelet/pods/1cb6ac7f-13cf-4627-986b-bff3ff6be5a4/volumes" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.332751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.341705 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a2a58b-94ff-4246-9a32-914964266c1a" path="/var/lib/kubelet/pods/32a2a58b-94ff-4246-9a32-914964266c1a/volumes" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.342171 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad35f3f3-be0b-46f9-b5de-f72839180563" path="/var/lib/kubelet/pods/ad35f3f3-be0b-46f9-b5de-f72839180563/volumes" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.343361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-config-data" (OuterVolumeSpecName: "config-data") pod "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.376406 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f is running failed: container process not found" containerID="4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.384482 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.385646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kube-api-access-jrq5q" (OuterVolumeSpecName: "kube-api-access-jrq5q") pod "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237"). InnerVolumeSpecName "kube-api-access-jrq5q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.396352 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f is running failed: container process not found" containerID="4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.399786 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f is running failed: container process not found" containerID="4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.399857 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.432851 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.432879 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.432889 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jrq5q\" (UniqueName: \"kubernetes.io/projected/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-kube-api-access-jrq5q\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.476533 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.541894 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.547545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" (UID: "ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.553127 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.553882 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs-tls-certs ovn-northd-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ovn-northd-0" podUID="653286ca-0dcc-4209-99e7-ca16dfde4dfb" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.644522 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.644961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d00a1c01-316a-4298-a685-949250f157fe","Type":"ContainerStarted","Data":"cea2bc7e28c06f00f936083f023b39391000a1df439a678d3ea982726e0e6d58"} Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.646160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6eda467f-6052-47e5-9913-12698d31aee1","Type":"ContainerStarted","Data":"e9da29f6a5299a4db7082148223328a504f96173028daa8f59a7944b27222a51"} Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.647474 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.647945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237","Type":"ContainerDied","Data":"8d4654b3e55935c9825adedf95049866eb6c795357f9c9cff85ae1932328aea2"} Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.647992 4769 scope.go:117] "RemoveContainer" containerID="a61826de7083b516071a8645961c499af6c71573459a9702acf35f8fa9d0bb1f" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.681328 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4b2083be-823d-422d-af53-af0074ba54cd","Type":"ContainerStarted","Data":"d419b20b589bcddc9428a1fbd4df25b659f2a09418d3be8d4c462bcf318b2202"} Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.682649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" event={"ID":"c1b56e2b-87d8-453b-a5cf-7c07d00b58de","Type":"ContainerStarted","Data":"d457bea966d589e2d76a7b9a0370d36eae12e2bd70d331e7fc3600901558bbb6"} Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.684643 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.685410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerStarted","Data":"de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2"} Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.685756 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.685798 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.702423 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.719404 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.726999 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.744161 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.758205 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: E1121 13:18:33.761301 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" containerName="memcached" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.761322 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" containerName="memcached" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.761539 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" containerName="memcached" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.762754 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.766126 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.766324 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-tnvrp" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.766775 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.770379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.779545 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.873349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/01898107-d50e-405c-a122-83e5d3e1720e-ovsdb-rundir\") pod \"01898107-d50e-405c-a122-83e5d3e1720e\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.873398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-scripts\") pod \"01898107-d50e-405c-a122-83e5d3e1720e\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.873434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"01898107-d50e-405c-a122-83e5d3e1720e\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.873460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cp45\" (UniqueName: \"kubernetes.io/projected/01898107-d50e-405c-a122-83e5d3e1720e-kube-api-access-7cp45\") pod \"01898107-d50e-405c-a122-83e5d3e1720e\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.873489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-rundir\") pod \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.873539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-config\") pod \"01898107-d50e-405c-a122-83e5d3e1720e\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.874364 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxg5l\" (UniqueName: \"kubernetes.io/projected/653286ca-0dcc-4209-99e7-ca16dfde4dfb-kube-api-access-hxg5l\") pod \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.874422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-config\") pod \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.874468 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-combined-ca-bundle\") pod \"01898107-d50e-405c-a122-83e5d3e1720e\" (UID: \"01898107-d50e-405c-a122-83e5d3e1720e\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.874513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-combined-ca-bundle\") pod \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.874533 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-scripts\") pod \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\" (UID: \"653286ca-0dcc-4209-99e7-ca16dfde4dfb\") " Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.875075 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-memcached-tls-certs\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.875110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-kolla-config\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.875138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-config-data\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.875344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-combined-ca-bundle\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.875489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlfq7\" (UniqueName: \"kubernetes.io/projected/76a1ee99-6132-416f-8a48-9a7a8073e929-kube-api-access-zlfq7\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.876478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "653286ca-0dcc-4209-99e7-ca16dfde4dfb" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.876813 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.876871 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-config" (OuterVolumeSpecName: "config") pod "01898107-d50e-405c-a122-83e5d3e1720e" (UID: "01898107-d50e-405c-a122-83e5d3e1720e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.877542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01898107-d50e-405c-a122-83e5d3e1720e-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "01898107-d50e-405c-a122-83e5d3e1720e" (UID: "01898107-d50e-405c-a122-83e5d3e1720e"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.877839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-config" (OuterVolumeSpecName: "config") pod "653286ca-0dcc-4209-99e7-ca16dfde4dfb" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.879413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-scripts" (OuterVolumeSpecName: "scripts") pod "653286ca-0dcc-4209-99e7-ca16dfde4dfb" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.888682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-scripts" (OuterVolumeSpecName: "scripts") pod "01898107-d50e-405c-a122-83e5d3e1720e" (UID: "01898107-d50e-405c-a122-83e5d3e1720e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.893898 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.894425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01898107-d50e-405c-a122-83e5d3e1720e" (UID: "01898107-d50e-405c-a122-83e5d3e1720e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.902456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653286ca-0dcc-4209-99e7-ca16dfde4dfb-kube-api-access-hxg5l" (OuterVolumeSpecName: "kube-api-access-hxg5l") pod "653286ca-0dcc-4209-99e7-ca16dfde4dfb" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb"). InnerVolumeSpecName "kube-api-access-hxg5l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.904465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "01898107-d50e-405c-a122-83e5d3e1720e" (UID: "01898107-d50e-405c-a122-83e5d3e1720e"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.904649 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01898107-d50e-405c-a122-83e5d3e1720e-kube-api-access-7cp45" (OuterVolumeSpecName: "kube-api-access-7cp45") pod "01898107-d50e-405c-a122-83e5d3e1720e" (UID: "01898107-d50e-405c-a122-83e5d3e1720e"). InnerVolumeSpecName "kube-api-access-7cp45". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.932339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "653286ca-0dcc-4209-99e7-ca16dfde4dfb" (UID: "653286ca-0dcc-4209-99e7-ca16dfde4dfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.951286 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.952991 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.957496 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.982876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-nf9br" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.993872 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.994955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-combined-ca-bundle\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.998640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zlfq7\" (UniqueName: \"kubernetes.io/projected/76a1ee99-6132-416f-8a48-9a7a8073e929-kube-api-access-zlfq7\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:33 crc kubenswrapper[4769]: I1121 13:18:33.999563 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-memcached-tls-certs\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.000939 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-kolla-config\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.040338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-config-data\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.040859 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.040936 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/01898107-d50e-405c-a122-83e5d3e1720e-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041002 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041055 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7cp45\" (UniqueName: \"kubernetes.io/projected/01898107-d50e-405c-a122-83e5d3e1720e-kube-api-access-7cp45\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041114 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041165 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01898107-d50e-405c-a122-83e5d3e1720e-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041232 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hxg5l\" (UniqueName: \"kubernetes.io/projected/653286ca-0dcc-4209-99e7-ca16dfde4dfb-kube-api-access-hxg5l\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041295 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041348 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041400 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041458 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf2d017-23db-4785-bd86-878843cd47b4-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041509 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.041559 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/653286ca-0dcc-4209-99e7-ca16dfde4dfb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.012250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-kolla-config\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:33.984347 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:33.993985 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.034334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-combined-ca-bundle\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.039330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-memcached-tls-certs\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.054696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-config-data\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.071237 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlfq7\" (UniqueName: \"kubernetes.io/projected/76a1ee99-6132-416f-8a48-9a7a8073e929-kube-api-access-zlfq7\") pod \"memcached-0\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.110251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.127260 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.168223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bww\" (UniqueName: \"kubernetes.io/projected/0a30004c-7036-4604-8fea-33ffd692a39a-kube-api-access-k9bww\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.169967 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170047 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-config\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.170782 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.199062 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bww\" (UniqueName: \"kubernetes.io/projected/0a30004c-7036-4604-8fea-33ffd692a39a-kube-api-access-k9bww\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274844 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.274962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-config\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.275841 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-config\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.275943 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.288351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.289644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.299511 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.299875 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.322903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.349647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bww\" (UniqueName: \"kubernetes.io/projected/0a30004c-7036-4604-8fea-33ffd692a39a-kube-api-access-k9bww\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.422291 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"ovsdbserver-nb-0\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.524842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.724239 4769 generic.go:334] "Generic (PLEG): container finished" podID="2614f647-50de-416e-afe3-7b658b34092e" containerID="4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f" exitCode=1 Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.724567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerDied","Data":"4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f"} Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.725156 4769 scope.go:117] "RemoveContainer" containerID="4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.741329 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.741713 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.742046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6a1be668-7c60-4d82-b2e9-a78e11562b6a","Type":"ContainerStarted","Data":"78697dad51704f13d4db1eb2e5c04ee203ece2e85d377d2c12b1d975c20034ca"} Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.742078 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.867690 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" podStartSLOduration=5.867669697 podStartE2EDuration="5.867669697s" podCreationTimestamp="2025-11-21 13:18:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:34.803713624 +0000 UTC m=+5273.504375442" watchObservedRunningTime="2025-11-21 13:18:34.867669697 +0000 UTC m=+5273.568331515" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.877233 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.887624 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.900292 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.912523 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.912702 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.919815 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.920000 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.924784 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.924957 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-h5r64" Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.955135 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:34 crc kubenswrapper[4769]: I1121 13:18:34.982462 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.006035 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.007962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.010507 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbw9b\" (UniqueName: \"kubernetes.io/projected/f74f9009-9b6c-453a-aa99-a6036758983d-kube-api-access-kbw9b\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011839 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-scripts\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.011992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-config\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.012035 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.012045 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/653286ca-0dcc-4209-99e7-ca16dfde4dfb-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.013816 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-b5szn" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.014001 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.040265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.064036 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.072315 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5f9ff86c46-xdt6p"] Nov 21 13:18:35 crc kubenswrapper[4769]: E1121 13:18:35.073911 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[internal-tls-certs public-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" podUID="0f0bb7e0-c308-4869-bfe8-53d4a526f24f" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.096573 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.116824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk899\" (UniqueName: \"kubernetes.io/projected/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-kube-api-access-rk899\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.116868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.116918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.116964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-config\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.116998 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-config\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kbw9b\" (UniqueName: \"kubernetes.io/projected/f74f9009-9b6c-453a-aa99-a6036758983d-kube-api-access-kbw9b\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117107 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117136 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-scripts\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117291 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.117302 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/01898107-d50e-405c-a122-83e5d3e1720e-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.121043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-config\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.123698 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-647c459466-wxh25"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.129181 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-647c459466-wxh25"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.129655 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-scripts\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.126644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.130109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.134294 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.139869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.150341 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.176016 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbw9b\" (UniqueName: \"kubernetes.io/projected/f74f9009-9b6c-453a-aa99-a6036758983d-kube-api-access-kbw9b\") pod \"ovn-northd-0\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.176634 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.219634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-config-data\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.220118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-scripts\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.230239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rk899\" (UniqueName: \"kubernetes.io/projected/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-kube-api-access-rk899\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.230302 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.230336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5r7\" (UniqueName: \"kubernetes.io/projected/0654eaa4-795d-4d1f-887a-979dcc9739f7-kube-api-access-pr5r7\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.230380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-combined-ca-bundle\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.230614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-internal-tls-certs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.230865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.231692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-config\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.231737 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.238827 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-public-tls-certs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.238870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.239381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0654eaa4-795d-4d1f-887a-979dcc9739f7-logs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.239421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.239454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.240278 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.250852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.255062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.264031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-config\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.267941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.269082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.272085 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.275907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.288934 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk899\" (UniqueName: \"kubernetes.io/projected/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-kube-api-access-rk899\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.342927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-public-tls-certs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.343000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0654eaa4-795d-4d1f-887a-979dcc9739f7-logs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.343061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-config-data\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.343114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-scripts\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.343149 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5r7\" (UniqueName: \"kubernetes.io/projected/0654eaa4-795d-4d1f-887a-979dcc9739f7-kube-api-access-pr5r7\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.343165 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-combined-ca-bundle\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.343254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-internal-tls-certs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.350776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-scripts\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.351441 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0654eaa4-795d-4d1f-887a-979dcc9739f7-logs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.356094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-combined-ca-bundle\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.356913 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-public-tls-certs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.359176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-internal-tls-certs\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.362468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-config-data\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.377575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5r7\" (UniqueName: \"kubernetes.io/projected/0654eaa4-795d-4d1f-887a-979dcc9739f7-kube-api-access-pr5r7\") pod \"placement-647c459466-wxh25\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.378582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"ovsdbserver-sb-0\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.381018 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.397570 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.401637 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01898107-d50e-405c-a122-83e5d3e1720e" path="/var/lib/kubelet/pods/01898107-d50e-405c-a122-83e5d3e1720e/volumes" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.402296 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="653286ca-0dcc-4209-99e7-ca16dfde4dfb" path="/var/lib/kubelet/pods/653286ca-0dcc-4209-99e7-ca16dfde4dfb/volumes" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.402845 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf2d017-23db-4785-bd86-878843cd47b4" path="/var/lib/kubelet/pods/cdf2d017-23db-4785-bd86-878843cd47b4/volumes" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.403452 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237" path="/var/lib/kubelet/pods/ebaa8c46-edc4-42ef-b0b7-c2b46d9c5237/volumes" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.423108 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.769473 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"76a1ee99-6132-416f-8a48-9a7a8073e929","Type":"ContainerStarted","Data":"ab3480bde1f8cdbd4c2b8ee058cc75184bd6e5739652888d8b504040acb5cb02"} Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.775527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"0a30004c-7036-4604-8fea-33ffd692a39a","Type":"ContainerStarted","Data":"3d97e817507793cf37ba793db59206cb15fb0dd37e61b2868e69430bdff20fd3"} Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.786062 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.786931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerStarted","Data":"008809cb82983c2800b6a5362130127361432ba59b760ba1a5988d0ee508141c"} Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.804989 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.866140 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.964978 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-scripts\") pod \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.965784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzc4s\" (UniqueName: \"kubernetes.io/projected/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-kube-api-access-rzc4s\") pod \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.965825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-config-data\") pod \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.965961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-logs\") pod \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.966152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-combined-ca-bundle\") pod \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\" (UID: \"0f0bb7e0-c308-4869-bfe8-53d4a526f24f\") " Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.967377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-logs" (OuterVolumeSpecName: "logs") pod "0f0bb7e0-c308-4869-bfe8-53d4a526f24f" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:35 crc kubenswrapper[4769]: I1121 13:18:35.967546 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.011227 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98"] Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.011548 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api-log" containerID="cri-o://9cf697bda07d2b9c6e94f92949af58de39309d4b5c661190d34eddc8edcf37a5" gracePeriod=30 Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.011935 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api" containerID="cri-o://0499d4a28070d43226b39b4ab467989c8946eb755a3a78fcc36f3e7aa8d50055" gracePeriod=30 Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.049324 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.059361 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-647c459466-wxh25"] Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.111374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-kube-api-access-rzc4s" (OuterVolumeSpecName: "kube-api-access-rzc4s") pod "0f0bb7e0-c308-4869-bfe8-53d4a526f24f" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f"). InnerVolumeSpecName "kube-api-access-rzc4s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.113332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0f0bb7e0-c308-4869-bfe8-53d4a526f24f" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.117356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-config-data" (OuterVolumeSpecName: "config-data") pod "0f0bb7e0-c308-4869-bfe8-53d4a526f24f" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.121530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-scripts" (OuterVolumeSpecName: "scripts") pod "0f0bb7e0-c308-4869-bfe8-53d4a526f24f" (UID: "0f0bb7e0-c308-4869-bfe8-53d4a526f24f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.141365 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.178517 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rzc4s\" (UniqueName: \"kubernetes.io/projected/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-kube-api-access-rzc4s\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.178561 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.178575 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.178586 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.799883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4b2083be-823d-422d-af53-af0074ba54cd","Type":"ContainerStarted","Data":"0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.803399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f74f9009-9b6c-453a-aa99-a6036758983d","Type":"ContainerStarted","Data":"85651dca65e7ec5760eb8f88f2454f16703d3a495aff06b3992d1c85f3bd67f4"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.804655 4769 generic.go:334] "Generic (PLEG): container finished" podID="558083c4-e40d-4b2c-9906-97dbb347594f" containerID="9cf697bda07d2b9c6e94f92949af58de39309d4b5c661190d34eddc8edcf37a5" exitCode=143 Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.804730 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" event={"ID":"558083c4-e40d-4b2c-9906-97dbb347594f","Type":"ContainerDied","Data":"9cf697bda07d2b9c6e94f92949af58de39309d4b5c661190d34eddc8edcf37a5"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.814820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d00a1c01-316a-4298-a685-949250f157fe","Type":"ContainerStarted","Data":"8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.817731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6eda467f-6052-47e5-9913-12698d31aee1","Type":"ContainerStarted","Data":"f010c4324e60a7d2224f1258a2d30b9134679dbb808c2bed8965a639debc9483"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.821054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-647c459466-wxh25" event={"ID":"0654eaa4-795d-4d1f-887a-979dcc9739f7","Type":"ContainerStarted","Data":"50b45af447747826312e47a0bf61fac90aa32dc584cb0a8eac5f697c8cf188b4"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.823647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb","Type":"ContainerStarted","Data":"9299c7c6c71303b82ba40195209d172d99a9eefe2355bf1cfa33ca64c0f8db05"} Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.823718 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5f9ff86c46-xdt6p" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.829144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.829222 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=5.82919899 podStartE2EDuration="5.82919899s" podCreationTimestamp="2025-11-21 13:18:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:36.819478318 +0000 UTC m=+5275.520140136" watchObservedRunningTime="2025-11-21 13:18:36.82919899 +0000 UTC m=+5275.529860808" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.846088 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" podStartSLOduration=7.846068594 podStartE2EDuration="7.846068594s" podCreationTimestamp="2025-11-21 13:18:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:36.841637555 +0000 UTC m=+5275.542299373" watchObservedRunningTime="2025-11-21 13:18:36.846068594 +0000 UTC m=+5275.546730412" Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.971598 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5f9ff86c46-xdt6p"] Nov 21 13:18:36 crc kubenswrapper[4769]: I1121 13:18:36.978859 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5f9ff86c46-xdt6p"] Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.103405 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.103448 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0bb7e0-c308-4869-bfe8-53d4a526f24f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.188901 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.286114 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f0bb7e0-c308-4869-bfe8-53d4a526f24f" path="/var/lib/kubelet/pods/0f0bb7e0-c308-4869-bfe8-53d4a526f24f/volumes" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.846122 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb","Type":"ContainerStarted","Data":"e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.858571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6eda467f-6052-47e5-9913-12698d31aee1","Type":"ContainerStarted","Data":"1eb2ad17e3c7244081cd5e98094c9c4aeb0c961cb4e7e06a9c7edd1137d70cbb"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.866506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-647c459466-wxh25" event={"ID":"0654eaa4-795d-4d1f-887a-979dcc9739f7","Type":"ContainerStarted","Data":"37adfe26aa60ce1642983d36150cf6e4f0cf2564b059ee835c25aef1cbce7f8d"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.867825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerStarted","Data":"cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.888117 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" containerID="8adab6c34885496a2c52b5ff0c76f15baed8c4850c15ded559cac04cc3c7e6b9" exitCode=0 Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.888211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" event={"ID":"3d9eede1-62b7-48a8-86a4-ccde7312f0e4","Type":"ContainerDied","Data":"8adab6c34885496a2c52b5ff0c76f15baed8c4850c15ded559cac04cc3c7e6b9"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.907687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f74f9009-9b6c-453a-aa99-a6036758983d","Type":"ContainerStarted","Data":"06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.942464 4769 generic.go:334] "Generic (PLEG): container finished" podID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerID="de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2" exitCode=1 Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.942556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerDied","Data":"de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.942590 4769 scope.go:117] "RemoveContainer" containerID="911892d48733dedb6def1f4f41539608c653e86a3047c9006c024fa99c94e0c2" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.944496 4769 scope.go:117] "RemoveContainer" containerID="de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2" Nov 21 13:18:37 crc kubenswrapper[4769]: E1121 13:18:37.944734 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.958360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6a1be668-7c60-4d82-b2e9-a78e11562b6a","Type":"ContainerStarted","Data":"ef9df5f3dca5e28b4cfe05fd216ad4656124c58a4b392caa85abc04351e6692f"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.967844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"0a30004c-7036-4604-8fea-33ffd692a39a","Type":"ContainerStarted","Data":"72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.986682 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.988910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"76a1ee99-6132-416f-8a48-9a7a8073e929","Type":"ContainerStarted","Data":"418cae4cbab2263e5231f263abb5327311931af72a389f0fcd0e83592d4ebefb"} Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.988939 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:37 crc kubenswrapper[4769]: I1121 13:18:37.989445 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.012571 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.050263 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=5.050242773 podStartE2EDuration="5.050242773s" podCreationTimestamp="2025-11-21 13:18:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:38.037337576 +0000 UTC m=+5276.737999394" watchObservedRunningTime="2025-11-21 13:18:38.050242773 +0000 UTC m=+5276.750904581" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.356487 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.356879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.417595 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.633586 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.769856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-config-data\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-fernet-keys\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-combined-ca-bundle\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770399 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770464 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcq9f\" (UniqueName: \"kubernetes.io/projected/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-kube-api-access-rcq9f\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-scripts\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770635 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:38 crc kubenswrapper[4769]: I1121 13:18:38.770750 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-credential-keys\") pod \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\" (UID: \"3d9eede1-62b7-48a8-86a4-ccde7312f0e4\") " Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.015501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6a1be668-7c60-4d82-b2e9-a78e11562b6a","Type":"ContainerStarted","Data":"2407a13186de66c36c261320a343fbf12f50954d5b879da509e8df92d5fe3db3"} Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.023381 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d00a1c01-316a-4298-a685-949250f157fe","Type":"ContainerStarted","Data":"d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8"} Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.028361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" event={"ID":"3d9eede1-62b7-48a8-86a4-ccde7312f0e4","Type":"ContainerDied","Data":"a07e9174e34265c17d02772c3e51eab4eaf208c28248f8898404eb5ebb763e58"} Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.028379 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5868866f7b-tknss" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.028411 4769 scope.go:117] "RemoveContainer" containerID="8adab6c34885496a2c52b5ff0c76f15baed8c4850c15ded559cac04cc3c7e6b9" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.035508 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.058267 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=8.058245659 podStartE2EDuration="8.058245659s" podCreationTimestamp="2025-11-21 13:18:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:39.045078444 +0000 UTC m=+5277.745740262" watchObservedRunningTime="2025-11-21 13:18:39.058245659 +0000 UTC m=+5277.758907467" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.289537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-scripts" (OuterVolumeSpecName: "scripts") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.303008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.306960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-kube-api-access-rcq9f" (OuterVolumeSpecName: "kube-api-access-rcq9f") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "kube-api-access-rcq9f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.307220 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.377585 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-config-data" (OuterVolumeSpecName: "config-data") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.386106 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.386138 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rcq9f\" (UniqueName: \"kubernetes.io/projected/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-kube-api-access-rcq9f\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.386153 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.386165 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.386177 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.401350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.473999 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.236:9311/healthcheck\": dial tcp 10.217.1.236:9311: connect: connection refused" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.474031 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.236:9311/healthcheck\": dial tcp 10.217.1.236:9311: connect: connection refused" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.490370 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.519517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.523687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3d9eede1-62b7-48a8-86a4-ccde7312f0e4" (UID: "3d9eede1-62b7-48a8-86a4-ccde7312f0e4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.592520 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.592559 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3d9eede1-62b7-48a8-86a4-ccde7312f0e4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.642685 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.642743 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.643438 4769 scope.go:117] "RemoveContainer" containerID="de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2" Nov 21 13:18:39 crc kubenswrapper[4769]: E1121 13:18:39.643729 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.717852 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5868866f7b-tknss"] Nov 21 13:18:39 crc kubenswrapper[4769]: I1121 13:18:39.727654 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5868866f7b-tknss"] Nov 21 13:18:39 crc kubenswrapper[4769]: E1121 13:18:39.831445 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out" image="quay.io/openstack-k8s-operators/sg-core@sha256:09b5017c95d7697e66b9c64846bc48ef5826a009cba89b956ec54561e5f4a2d1" Nov 21 13:18:39 crc kubenswrapper[4769]: E1121 13:18:39.831712 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:sg-core,Image:quay.io/openstack-k8s-operators/sg-core@sha256:09b5017c95d7697e66b9c64846bc48ef5826a009cba89b956ec54561e5f4a2d1,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:sg-core-conf-yaml,ReadOnly:false,MountPath:/etc/sg-core.conf.yaml,SubPath:sg-core.conf.yaml,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-gj5tb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ceilometer-0_openstack-kuttl-tests(f1009742-1d7e-44b0-b3ed-690da05e8e41): ErrImagePull: parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out" logger="UnhandledError" Nov 21 13:18:40 crc kubenswrapper[4769]: I1121 13:18:40.040692 4769 generic.go:334] "Generic (PLEG): container finished" podID="558083c4-e40d-4b2c-9906-97dbb347594f" containerID="0499d4a28070d43226b39b4ab467989c8946eb755a3a78fcc36f3e7aa8d50055" exitCode=0 Nov 21 13:18:40 crc kubenswrapper[4769]: I1121 13:18:40.040734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" event={"ID":"558083c4-e40d-4b2c-9906-97dbb347594f","Type":"ContainerDied","Data":"0499d4a28070d43226b39b4ab467989c8946eb755a3a78fcc36f3e7aa8d50055"} Nov 21 13:18:40 crc kubenswrapper[4769]: I1121 13:18:40.043395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb","Type":"ContainerStarted","Data":"88eb6797b61d829add320d5ea7df7e1f33f647ef6846c80e60633477279e763f"} Nov 21 13:18:40 crc kubenswrapper[4769]: I1121 13:18:40.064389 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=9.064369843 podStartE2EDuration="9.064369843s" podCreationTimestamp="2025-11-21 13:18:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:40.062921024 +0000 UTC m=+5278.763582862" watchObservedRunningTime="2025-11-21 13:18:40.064369843 +0000 UTC m=+5278.765031661" Nov 21 13:18:40 crc kubenswrapper[4769]: I1121 13:18:40.089677 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=8.089656904 podStartE2EDuration="8.089656904s" podCreationTimestamp="2025-11-21 13:18:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:40.082582494 +0000 UTC m=+5278.783244322" watchObservedRunningTime="2025-11-21 13:18:40.089656904 +0000 UTC m=+5278.790318722" Nov 21 13:18:40 crc kubenswrapper[4769]: I1121 13:18:40.991612 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.059707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" event={"ID":"558083c4-e40d-4b2c-9906-97dbb347594f","Type":"ContainerDied","Data":"637987de3f5f4814ae60edb447bfdd394c06cd2bf2bb2d82d9b4aba6a9100986"} Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.059791 4769 scope.go:117] "RemoveContainer" containerID="0499d4a28070d43226b39b4ab467989c8946eb755a3a78fcc36f3e7aa8d50055" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.059734 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.065784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"0a30004c-7036-4604-8fea-33ffd692a39a","Type":"ContainerStarted","Data":"7f9377333fa47ffea5425ae287e8ffba676c5d8221d4572416218df149e39ca6"} Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.077050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-647c459466-wxh25" event={"ID":"0654eaa4-795d-4d1f-887a-979dcc9739f7","Type":"ContainerStarted","Data":"33b0518140145e9ac4bebce2c1b42c497a67c98a088cc195d0a48aed34b2ac6a"} Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.078020 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.078085 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.087066 4769 scope.go:117] "RemoveContainer" containerID="9cf697bda07d2b9c6e94f92949af58de39309d4b5c661190d34eddc8edcf37a5" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.092643 4769 generic.go:334] "Generic (PLEG): container finished" podID="2614f647-50de-416e-afe3-7b658b34092e" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" exitCode=1 Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.092799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerDied","Data":"cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784"} Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.093637 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.095135 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=8.09509973 podStartE2EDuration="8.09509973s" podCreationTimestamp="2025-11-21 13:18:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:41.092687125 +0000 UTC m=+5279.793348953" watchObservedRunningTime="2025-11-21 13:18:41.09509973 +0000 UTC m=+5279.795761558" Nov 21 13:18:41 crc kubenswrapper[4769]: E1121 13:18:41.098092 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.119941 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7dff9d7dc4-j69vs_4aca7a55-cf5a-4979-856b-4252ae54ba5f/neutron-api/0.log" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.120133 4769 generic.go:334] "Generic (PLEG): container finished" podID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerID="17127d8fae66c1070ce2b9cbe311a112e8390090f1e93b4e52b36c1aaced1ef0" exitCode=1 Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.120268 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerDied","Data":"17127d8fae66c1070ce2b9cbe311a112e8390090f1e93b4e52b36c1aaced1ef0"} Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.121300 4769 scope.go:117] "RemoveContainer" containerID="17127d8fae66c1070ce2b9cbe311a112e8390090f1e93b4e52b36c1aaced1ef0" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.130617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-internal-tls-certs\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.131013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-public-tls-certs\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.131335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t56bq\" (UniqueName: \"kubernetes.io/projected/558083c4-e40d-4b2c-9906-97dbb347594f-kube-api-access-t56bq\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.131479 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-combined-ca-bundle\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.131621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data-custom\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.131766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.131889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/558083c4-e40d-4b2c-9906-97dbb347594f-logs\") pod \"558083c4-e40d-4b2c-9906-97dbb347594f\" (UID: \"558083c4-e40d-4b2c-9906-97dbb347594f\") " Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.145706 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.149313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f74f9009-9b6c-453a-aa99-a6036758983d","Type":"ContainerStarted","Data":"fe1fcf32b913741fbb85d265f70f54f729b43e9983930764a838ce5da2686049"} Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.149513 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.149112 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/558083c4-e40d-4b2c-9906-97dbb347594f-logs" (OuterVolumeSpecName: "logs") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.152082 4769 scope.go:117] "RemoveContainer" containerID="4b92327cba6bc0066b37d0cafa5e39371b897d5ee7dd4eb597b824cc8854618f" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.159536 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/558083c4-e40d-4b2c-9906-97dbb347594f-kube-api-access-t56bq" (OuterVolumeSpecName: "kube-api-access-t56bq") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "kube-api-access-t56bq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.171325 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-647c459466-wxh25" podStartSLOduration=6.171305343 podStartE2EDuration="6.171305343s" podCreationTimestamp="2025-11-21 13:18:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:41.146053603 +0000 UTC m=+5279.846715421" watchObservedRunningTime="2025-11-21 13:18:41.171305343 +0000 UTC m=+5279.871967161" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.178680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.208890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data" (OuterVolumeSpecName: "config-data") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.210425 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=7.210389676 podStartE2EDuration="7.210389676s" podCreationTimestamp="2025-11-21 13:18:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:41.198012743 +0000 UTC m=+5279.898674561" watchObservedRunningTime="2025-11-21 13:18:41.210389676 +0000 UTC m=+5279.911051494" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.223822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.224452 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=7.224434475 podStartE2EDuration="7.224434475s" podCreationTimestamp="2025-11-21 13:18:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:41.221266479 +0000 UTC m=+5279.921928297" watchObservedRunningTime="2025-11-21 13:18:41.224434475 +0000 UTC m=+5279.925096293" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.238763 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t56bq\" (UniqueName: \"kubernetes.io/projected/558083c4-e40d-4b2c-9906-97dbb347594f-kube-api-access-t56bq\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.238836 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.238851 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.238866 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.238880 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/558083c4-e40d-4b2c-9906-97dbb347594f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.243721 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.246416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "558083c4-e40d-4b2c-9906-97dbb347594f" (UID: "558083c4-e40d-4b2c-9906-97dbb347594f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.287376 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" path="/var/lib/kubelet/pods/3d9eede1-62b7-48a8-86a4-ccde7312f0e4/volumes" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.342606 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.343298 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/558083c4-e40d-4b2c-9906-97dbb347594f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.393738 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98"] Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.398226 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.405639 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-cc55d97cd-rsl98"] Nov 21 13:18:41 crc kubenswrapper[4769]: I1121 13:18:41.452914 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.166463 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:18:42 crc kubenswrapper[4769]: E1121 13:18:42.167641 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.171553 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7dff9d7dc4-j69vs_4aca7a55-cf5a-4979-856b-4252ae54ba5f/neutron-api/0.log" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.171828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerStarted","Data":"d16e182001f62a31006d6869c168bd753526228755c8a652e1995805f68bb07e"} Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.172575 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.190233 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.223677 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.227108 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.227147 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.251674 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.277419 4769 scope.go:117] "RemoveContainer" containerID="7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774" Nov 21 13:18:42 crc kubenswrapper[4769]: E1121 13:18:42.277634 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.284019 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.286437 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.347280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.347345 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.382872 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.392548 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.580505 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-647c459466-wxh25"] Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.605053 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-67959f9746-jwjb9"] Nov 21 13:18:42 crc kubenswrapper[4769]: E1121 13:18:42.605769 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api-log" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.605791 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api-log" Nov 21 13:18:42 crc kubenswrapper[4769]: E1121 13:18:42.605826 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" containerName="keystone-api" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.605834 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" containerName="keystone-api" Nov 21 13:18:42 crc kubenswrapper[4769]: E1121 13:18:42.605852 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.605858 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.606062 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d9eede1-62b7-48a8-86a4-ccde7312f0e4" containerName="keystone-api" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.606102 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api-log" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.606120 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" containerName="barbican-api" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.607129 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.618360 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-67959f9746-jwjb9"] Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.771989 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.772093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.772132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b257324-3e15-4f82-87a7-b6510652951a-logs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.772151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.772271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbm4\" (UniqueName: \"kubernetes.io/projected/6b257324-3e15-4f82-87a7-b6510652951a-kube-api-access-gmbm4\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.772372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.772463 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.874712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.874819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b257324-3e15-4f82-87a7-b6510652951a-logs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.874861 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.874923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbm4\" (UniqueName: \"kubernetes.io/projected/6b257324-3e15-4f82-87a7-b6510652951a-kube-api-access-gmbm4\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.874993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.875039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.875154 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.875387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b257324-3e15-4f82-87a7-b6510652951a-logs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.885615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.887224 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.888478 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.888652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.890548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.895967 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbm4\" (UniqueName: \"kubernetes.io/projected/6b257324-3e15-4f82-87a7-b6510652951a-kube-api-access-gmbm4\") pod \"placement-67959f9746-jwjb9\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:42 crc kubenswrapper[4769]: I1121 13:18:42.936433 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.241882 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-647c459466-wxh25" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-log" containerID="cri-o://37adfe26aa60ce1642983d36150cf6e4f0cf2564b059ee835c25aef1cbce7f8d" gracePeriod=30 Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.242821 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-647c459466-wxh25" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-api" containerID="cri-o://33b0518140145e9ac4bebce2c1b42c497a67c98a088cc195d0a48aed34b2ac6a" gracePeriod=30 Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.246983 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.247014 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.247024 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.247721 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.317581 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.404725 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="558083c4-e40d-4b2c-9906-97dbb347594f" path="/var/lib/kubelet/pods/558083c4-e40d-4b2c-9906-97dbb347594f/volumes" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.405471 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.405461 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-647c459466-wxh25" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.145:8778/\": EOF" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.405490 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.406824 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:18:43 crc kubenswrapper[4769]: E1121 13:18:43.407113 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.445161 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.445827 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.538128 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.613441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-67959f9746-jwjb9"] Nov 21 13:18:43 crc kubenswrapper[4769]: I1121 13:18:43.702217 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:43 crc kubenswrapper[4769]: E1121 13:18:43.770180 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ceilometer-central-agent\" with ErrImagePull: \"parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out\", failed to \"StartContainer\" for \"sg-core\" with ErrImagePull: \"parsing image configuration: fetching blob: received unexpected HTTP status: 504 Gateway Time-out\"]" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.201374 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.276173 4769 generic.go:334] "Generic (PLEG): container finished" podID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerID="37adfe26aa60ce1642983d36150cf6e4f0cf2564b059ee835c25aef1cbce7f8d" exitCode=143 Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.276265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-647c459466-wxh25" event={"ID":"0654eaa4-795d-4d1f-887a-979dcc9739f7","Type":"ContainerDied","Data":"37adfe26aa60ce1642983d36150cf6e4f0cf2564b059ee835c25aef1cbce7f8d"} Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.293794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerStarted","Data":"23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc"} Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.294168 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.307205 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" event={"ID":"6b257324-3e15-4f82-87a7-b6510652951a","Type":"ContainerStarted","Data":"15360538021fc052bef33c9c34ebae1d05603dc5a31bbd84daba9f7e3da6d60a"} Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.307456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" event={"ID":"6b257324-3e15-4f82-87a7-b6510652951a","Type":"ContainerStarted","Data":"f87415f5f950da51f4ee628abd8f82711e074a0b668dd74fcd6a34f73f922d0a"} Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.308641 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.380256 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.517398 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.140:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:44 crc kubenswrapper[4769]: I1121 13:18:44.517409 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.140:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.322851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" event={"ID":"6b257324-3e15-4f82-87a7-b6510652951a","Type":"ContainerStarted","Data":"4f8d47da9752b3301435660772a5b9a18c405c8ded394b8412e868df9f4472f8"} Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.322883 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.323201 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.323402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.323771 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.322909 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.323885 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.345894 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" podStartSLOduration=3.345873952 podStartE2EDuration="3.345873952s" podCreationTimestamp="2025-11-21 13:18:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:45.34354804 +0000 UTC m=+5284.044209858" watchObservedRunningTime="2025-11-21 13:18:45.345873952 +0000 UTC m=+5284.046535770" Nov 21 13:18:45 crc kubenswrapper[4769]: E1121 13:18:45.785737 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sg-core\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/sg-core@sha256:09b5017c95d7697e66b9c64846bc48ef5826a009cba89b956ec54561e5f4a2d1\\\"\"" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" Nov 21 13:18:45 crc kubenswrapper[4769]: I1121 13:18:45.904129 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:46 crc kubenswrapper[4769]: I1121 13:18:46.099046 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:18:46 crc kubenswrapper[4769]: I1121 13:18:46.158947 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:46 crc kubenswrapper[4769]: I1121 13:18:46.161955 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:18:46 crc kubenswrapper[4769]: I1121 13:18:46.274956 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:18:46 crc kubenswrapper[4769]: E1121 13:18:46.275145 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:18:46 crc kubenswrapper[4769]: I1121 13:18:46.332364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerStarted","Data":"d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b"} Nov 21 13:18:46 crc kubenswrapper[4769]: E1121 13:18:46.334046 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sg-core\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/sg-core@sha256:09b5017c95d7697e66b9c64846bc48ef5826a009cba89b956ec54561e5f4a2d1\\\"\"" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" Nov 21 13:18:47 crc kubenswrapper[4769]: E1121 13:18:47.350317 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sg-core\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/sg-core@sha256:09b5017c95d7697e66b9c64846bc48ef5826a009cba89b956ec54561e5f4a2d1\\\"\"" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" Nov 21 13:18:47 crc kubenswrapper[4769]: I1121 13:18:47.821208 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-647c459466-wxh25" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.145:8778/\": read tcp 10.217.0.2:51632->10.217.0.145:8778: read: connection reset by peer" Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.148662 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.149161 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-log" containerID="cri-o://ef9df5f3dca5e28b4cfe05fd216ad4656124c58a4b392caa85abc04351e6692f" gracePeriod=30 Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.149299 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-api" containerID="cri-o://2407a13186de66c36c261320a343fbf12f50954d5b879da509e8df92d5fe3db3" gracePeriod=30 Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.356925 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.358032 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.358368 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:18:48 crc kubenswrapper[4769]: E1121 13:18:48.358530 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.362569 4769 generic.go:334] "Generic (PLEG): container finished" podID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerID="33b0518140145e9ac4bebce2c1b42c497a67c98a088cc195d0a48aed34b2ac6a" exitCode=0 Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.362691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-647c459466-wxh25" event={"ID":"0654eaa4-795d-4d1f-887a-979dcc9739f7","Type":"ContainerDied","Data":"33b0518140145e9ac4bebce2c1b42c497a67c98a088cc195d0a48aed34b2ac6a"} Nov 21 13:18:48 crc kubenswrapper[4769]: I1121 13:18:48.938094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.002890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-public-tls-certs\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.003020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0654eaa4-795d-4d1f-887a-979dcc9739f7-logs\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.003054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-config-data\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.003129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-combined-ca-bundle\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.003178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr5r7\" (UniqueName: \"kubernetes.io/projected/0654eaa4-795d-4d1f-887a-979dcc9739f7-kube-api-access-pr5r7\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.003263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-internal-tls-certs\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.003367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-scripts\") pod \"0654eaa4-795d-4d1f-887a-979dcc9739f7\" (UID: \"0654eaa4-795d-4d1f-887a-979dcc9739f7\") " Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.005689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0654eaa4-795d-4d1f-887a-979dcc9739f7-logs" (OuterVolumeSpecName: "logs") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.020594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-scripts" (OuterVolumeSpecName: "scripts") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.029508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0654eaa4-795d-4d1f-887a-979dcc9739f7-kube-api-access-pr5r7" (OuterVolumeSpecName: "kube-api-access-pr5r7") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "kube-api-access-pr5r7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.105907 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0654eaa4-795d-4d1f-887a-979dcc9739f7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.106252 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pr5r7\" (UniqueName: \"kubernetes.io/projected/0654eaa4-795d-4d1f-887a-979dcc9739f7-kube-api-access-pr5r7\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.106264 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.118348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-config-data" (OuterVolumeSpecName: "config-data") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.142928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.174304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.193589 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0654eaa4-795d-4d1f-887a-979dcc9739f7" (UID: "0654eaa4-795d-4d1f-887a-979dcc9739f7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.207818 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.207861 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.207874 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.207885 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0654eaa4-795d-4d1f-887a-979dcc9739f7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.383537 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerID="ef9df5f3dca5e28b4cfe05fd216ad4656124c58a4b392caa85abc04351e6692f" exitCode=143 Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.383846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6a1be668-7c60-4d82-b2e9-a78e11562b6a","Type":"ContainerDied","Data":"ef9df5f3dca5e28b4cfe05fd216ad4656124c58a4b392caa85abc04351e6692f"} Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.387325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-647c459466-wxh25" event={"ID":"0654eaa4-795d-4d1f-887a-979dcc9739f7","Type":"ContainerDied","Data":"50b45af447747826312e47a0bf61fac90aa32dc584cb0a8eac5f697c8cf188b4"} Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.387397 4769 scope.go:117] "RemoveContainer" containerID="33b0518140145e9ac4bebce2c1b42c497a67c98a088cc195d0a48aed34b2ac6a" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.387348 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-647c459466-wxh25" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.388091 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:18:49 crc kubenswrapper[4769]: E1121 13:18:49.388505 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.414476 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-647c459466-wxh25"] Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.418736 4769 scope.go:117] "RemoveContainer" containerID="37adfe26aa60ce1642983d36150cf6e4f0cf2564b059ee835c25aef1cbce7f8d" Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.425204 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-647c459466-wxh25"] Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.999395 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5bd9978c6b-sccsr"] Nov 21 13:18:49 crc kubenswrapper[4769]: I1121 13:18:49.999880 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" podUID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" containerName="keystone-api" containerID="cri-o://d457bea966d589e2d76a7b9a0370d36eae12e2bd70d331e7fc3600901558bbb6" gracePeriod=30 Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.011810 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" podUID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.136:5000/v3\": read tcp 10.217.0.2:60810->10.217.0.136:5000: read: connection reset by peer" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.027378 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-6bb546f66c-25blf"] Nov 21 13:18:50 crc kubenswrapper[4769]: E1121 13:18:50.027887 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-api" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.027915 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-api" Nov 21 13:18:50 crc kubenswrapper[4769]: E1121 13:18:50.027937 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-log" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.027946 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-log" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.028322 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-api" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.028352 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" containerName="placement-log" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.029168 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.037054 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6bb546f66c-25blf"] Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.125792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-internal-tls-certs\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.125840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-public-tls-certs\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.125929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgjz\" (UniqueName: \"kubernetes.io/projected/ab913d48-455c-472c-8942-180b14a301d8-kube-api-access-lmgjz\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.125977 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-combined-ca-bundle\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.126003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-fernet-keys\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.126021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-credential-keys\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.126053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-config-data\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.126161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-scripts\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-public-tls-certs\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgjz\" (UniqueName: \"kubernetes.io/projected/ab913d48-455c-472c-8942-180b14a301d8-kube-api-access-lmgjz\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-combined-ca-bundle\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-fernet-keys\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-credential-keys\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-config-data\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.227975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-scripts\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.228024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-internal-tls-certs\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.232784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-combined-ca-bundle\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.233170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-internal-tls-certs\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.233284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-config-data\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.233521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-credential-keys\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.233666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-scripts\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.246702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-fernet-keys\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.250677 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-public-tls-certs\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.250741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgjz\" (UniqueName: \"kubernetes.io/projected/ab913d48-455c-472c-8942-180b14a301d8-kube-api-access-lmgjz\") pod \"keystone-6bb546f66c-25blf\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.346973 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.347424 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.506502 4769 scope.go:117] "RemoveContainer" containerID="6f5ac43652e5aa7578e8c47de5147f7f997fd7c4101353e1c7121ea7b5a67e3d" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.548105 4769 scope.go:117] "RemoveContainer" containerID="f52b5564b71e505ef3546ff8491a84f27760b29ba01f07a605d03eba3aaa5b85" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.615019 4769 scope.go:117] "RemoveContainer" containerID="10f4f7d37690f4fda97734fc341495dc455f12f52cd7b874a999ac301d33583d" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.655551 4769 scope.go:117] "RemoveContainer" containerID="0754db392725e02affdf3ebff5c4bdaac236040ded1d213c472ef884b7c69b6e" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.675914 4769 scope.go:117] "RemoveContainer" containerID="7577fbf72698fa6c8af8be1a767e1a6e40e38e8c42d5422f22d6212c98e2c87a" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.695911 4769 scope.go:117] "RemoveContainer" containerID="bce15b9ca4fbf26c69855bbc7de558bf8aeeed67ee45916e38d6d4bdbe6376b3" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.731647 4769 scope.go:117] "RemoveContainer" containerID="795246d05660705213cd961db3d3ebb6e51d97fc569362d8be3410f401821fc0" Nov 21 13:18:50 crc kubenswrapper[4769]: I1121 13:18:50.828066 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-6bb546f66c-25blf"] Nov 21 13:18:50 crc kubenswrapper[4769]: W1121 13:18:50.836513 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab913d48_455c_472c_8942_180b14a301d8.slice/crio-cc1916e8e234dc669948cdd4b792d9d9165c04168e5a0f3b55c3994b7d6d034a WatchSource:0}: Error finding container cc1916e8e234dc669948cdd4b792d9d9165c04168e5a0f3b55c3994b7d6d034a: Status 404 returned error can't find the container with id cc1916e8e234dc669948cdd4b792d9d9165c04168e5a0f3b55c3994b7d6d034a Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.288752 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0654eaa4-795d-4d1f-887a-979dcc9739f7" path="/var/lib/kubelet/pods/0654eaa4-795d-4d1f-887a-979dcc9739f7/volumes" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.512625 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerID="2407a13186de66c36c261320a343fbf12f50954d5b879da509e8df92d5fe3db3" exitCode=0 Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.512729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6a1be668-7c60-4d82-b2e9-a78e11562b6a","Type":"ContainerDied","Data":"2407a13186de66c36c261320a343fbf12f50954d5b879da509e8df92d5fe3db3"} Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.529472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" event={"ID":"ab913d48-455c-472c-8942-180b14a301d8","Type":"ContainerStarted","Data":"765665de4dd1cfdfa579b855b613c34bf02bc2a7c6b5434c90e14bfe9b78d4a1"} Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.529519 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" event={"ID":"ab913d48-455c-472c-8942-180b14a301d8","Type":"ContainerStarted","Data":"cc1916e8e234dc669948cdd4b792d9d9165c04168e5a0f3b55c3994b7d6d034a"} Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.530659 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.541849 4769 generic.go:334] "Generic (PLEG): container finished" podID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" containerID="d457bea966d589e2d76a7b9a0370d36eae12e2bd70d331e7fc3600901558bbb6" exitCode=0 Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.541894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" event={"ID":"c1b56e2b-87d8-453b-a5cf-7c07d00b58de","Type":"ContainerDied","Data":"d457bea966d589e2d76a7b9a0370d36eae12e2bd70d331e7fc3600901558bbb6"} Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.553521 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" podStartSLOduration=1.553500862 podStartE2EDuration="1.553500862s" podCreationTimestamp="2025-11-21 13:18:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:51.543922204 +0000 UTC m=+5290.244584022" watchObservedRunningTime="2025-11-21 13:18:51.553500862 +0000 UTC m=+5290.254162680" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.880765 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.971894 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.974939 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-697c2\" (UniqueName: \"kubernetes.io/projected/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-kube-api-access-697c2\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.975845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-public-tls-certs\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.975890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-internal-tls-certs\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.976017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-combined-ca-bundle\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.976120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-scripts\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.976235 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-fernet-keys\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.976254 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-config-data\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.976332 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-credential-keys\") pod \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\" (UID: \"c1b56e2b-87d8-453b-a5cf-7c07d00b58de\") " Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.984637 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.996890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-kube-api-access-697c2" (OuterVolumeSpecName: "kube-api-access-697c2") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "kube-api-access-697c2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:51 crc kubenswrapper[4769]: I1121 13:18:51.997524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-scripts" (OuterVolumeSpecName: "scripts") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.008489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.030816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.037397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-config-data" (OuterVolumeSpecName: "config-data") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.061107 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.065305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c1b56e2b-87d8-453b-a5cf-7c07d00b58de" (UID: "c1b56e2b-87d8-453b-a5cf-7c07d00b58de"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.082907 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-combined-ca-bundle\") pod \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-internal-tls-certs\") pod \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a1be668-7c60-4d82-b2e9-a78e11562b6a-logs\") pod \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx82t\" (UniqueName: \"kubernetes.io/projected/6a1be668-7c60-4d82-b2e9-a78e11562b6a-kube-api-access-kx82t\") pod \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083185 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-config-data\") pod \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-public-tls-certs\") pod \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\" (UID: \"6a1be668-7c60-4d82-b2e9-a78e11562b6a\") " Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a1be668-7c60-4d82-b2e9-a78e11562b6a-logs" (OuterVolumeSpecName: "logs") pod "6a1be668-7c60-4d82-b2e9-a78e11562b6a" (UID: "6a1be668-7c60-4d82-b2e9-a78e11562b6a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083874 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083898 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083907 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083915 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083925 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-697c2\" (UniqueName: \"kubernetes.io/projected/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-kube-api-access-697c2\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083934 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a1be668-7c60-4d82-b2e9-a78e11562b6a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083943 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083952 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.083964 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1b56e2b-87d8-453b-a5cf-7c07d00b58de-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.092445 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a1be668-7c60-4d82-b2e9-a78e11562b6a-kube-api-access-kx82t" (OuterVolumeSpecName: "kube-api-access-kx82t") pod "6a1be668-7c60-4d82-b2e9-a78e11562b6a" (UID: "6a1be668-7c60-4d82-b2e9-a78e11562b6a"). InnerVolumeSpecName "kube-api-access-kx82t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.127540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-config-data" (OuterVolumeSpecName: "config-data") pod "6a1be668-7c60-4d82-b2e9-a78e11562b6a" (UID: "6a1be668-7c60-4d82-b2e9-a78e11562b6a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.141966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6a1be668-7c60-4d82-b2e9-a78e11562b6a" (UID: "6a1be668-7c60-4d82-b2e9-a78e11562b6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.166577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6a1be668-7c60-4d82-b2e9-a78e11562b6a" (UID: "6a1be668-7c60-4d82-b2e9-a78e11562b6a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.177815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6a1be668-7c60-4d82-b2e9-a78e11562b6a" (UID: "6a1be668-7c60-4d82-b2e9-a78e11562b6a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.185449 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.185482 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.185494 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kx82t\" (UniqueName: \"kubernetes.io/projected/6a1be668-7c60-4d82-b2e9-a78e11562b6a-kube-api-access-kx82t\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.185510 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.185524 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a1be668-7c60-4d82-b2e9-a78e11562b6a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.274231 4769 scope.go:117] "RemoveContainer" containerID="de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2" Nov 21 13:18:52 crc kubenswrapper[4769]: E1121 13:18:52.274524 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.552960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" event={"ID":"c1b56e2b-87d8-453b-a5cf-7c07d00b58de","Type":"ContainerDied","Data":"75966c2199dd9e42136a8e1db289d3f6f34401bc64659cb427ddfd6c08f050fc"} Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.553029 4769 scope.go:117] "RemoveContainer" containerID="d457bea966d589e2d76a7b9a0370d36eae12e2bd70d331e7fc3600901558bbb6" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.553847 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5bd9978c6b-sccsr" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.556246 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.557957 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6a1be668-7c60-4d82-b2e9-a78e11562b6a","Type":"ContainerDied","Data":"78697dad51704f13d4db1eb2e5c04ee203ece2e85d377d2c12b1d975c20034ca"} Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.577366 4769 scope.go:117] "RemoveContainer" containerID="2407a13186de66c36c261320a343fbf12f50954d5b879da509e8df92d5fe3db3" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.588972 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.597817 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.609087 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5bd9978c6b-sccsr"] Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.609647 4769 scope.go:117] "RemoveContainer" containerID="ef9df5f3dca5e28b4cfe05fd216ad4656124c58a4b392caa85abc04351e6692f" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.620761 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5bd9978c6b-sccsr"] Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677031 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:52 crc kubenswrapper[4769]: E1121 13:18:52.677538 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-api" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-api" Nov 21 13:18:52 crc kubenswrapper[4769]: E1121 13:18:52.677573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-log" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677581 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-log" Nov 21 13:18:52 crc kubenswrapper[4769]: E1121 13:18:52.677595 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" containerName="keystone-api" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677603 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" containerName="keystone-api" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677815 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-log" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677848 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" containerName="nova-api-api" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.677868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" containerName="keystone-api" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.678882 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.680880 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.685116 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.685868 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.693271 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.798879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.799050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.799430 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-config-data\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.799479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzcsh\" (UniqueName: \"kubernetes.io/projected/6b9c7230-b4d7-4461-a212-03ec2b2f14af-kube-api-access-vzcsh\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.799497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b9c7230-b4d7-4461-a212-03ec2b2f14af-logs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.799516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-public-tls-certs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.901409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-config-data\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.901776 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vzcsh\" (UniqueName: \"kubernetes.io/projected/6b9c7230-b4d7-4461-a212-03ec2b2f14af-kube-api-access-vzcsh\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.901797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b9c7230-b4d7-4461-a212-03ec2b2f14af-logs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.901820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-public-tls-certs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.901885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.901929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.902397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b9c7230-b4d7-4461-a212-03ec2b2f14af-logs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.906461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-config-data\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.906825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-public-tls-certs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.907825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-internal-tls-certs\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.908661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:52 crc kubenswrapper[4769]: I1121 13:18:52.919776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzcsh\" (UniqueName: \"kubernetes.io/projected/6b9c7230-b4d7-4461-a212-03ec2b2f14af-kube-api-access-vzcsh\") pod \"nova-api-0\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:53 crc kubenswrapper[4769]: I1121 13:18:53.007852 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:18:53 crc kubenswrapper[4769]: I1121 13:18:53.286150 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a1be668-7c60-4d82-b2e9-a78e11562b6a" path="/var/lib/kubelet/pods/6a1be668-7c60-4d82-b2e9-a78e11562b6a/volumes" Nov 21 13:18:53 crc kubenswrapper[4769]: I1121 13:18:53.287119 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1b56e2b-87d8-453b-a5cf-7c07d00b58de" path="/var/lib/kubelet/pods/c1b56e2b-87d8-453b-a5cf-7c07d00b58de/volumes" Nov 21 13:18:53 crc kubenswrapper[4769]: I1121 13:18:53.469962 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:18:53 crc kubenswrapper[4769]: I1121 13:18:53.572249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6b9c7230-b4d7-4461-a212-03ec2b2f14af","Type":"ContainerStarted","Data":"172b925bd84721bd3109a2b6eea7718bcc7b91c24d74b9c0114381697f33583b"} Nov 21 13:18:54 crc kubenswrapper[4769]: I1121 13:18:54.584560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6b9c7230-b4d7-4461-a212-03ec2b2f14af","Type":"ContainerStarted","Data":"0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9"} Nov 21 13:18:54 crc kubenswrapper[4769]: I1121 13:18:54.585206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6b9c7230-b4d7-4461-a212-03ec2b2f14af","Type":"ContainerStarted","Data":"c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7"} Nov 21 13:18:54 crc kubenswrapper[4769]: I1121 13:18:54.608579 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.608553193 podStartE2EDuration="2.608553193s" podCreationTimestamp="2025-11-21 13:18:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:54.603137967 +0000 UTC m=+5293.303799785" watchObservedRunningTime="2025-11-21 13:18:54.608553193 +0000 UTC m=+5293.309215011" Nov 21 13:18:55 crc kubenswrapper[4769]: I1121 13:18:55.274601 4769 scope.go:117] "RemoveContainer" containerID="7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774" Nov 21 13:18:55 crc kubenswrapper[4769]: I1121 13:18:55.457026 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:18:55 crc kubenswrapper[4769]: I1121 13:18:55.457749 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api-log" containerID="cri-o://411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88" gracePeriod=30 Nov 21 13:18:55 crc kubenswrapper[4769]: I1121 13:18:55.458022 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api" containerID="cri-o://9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c" gracePeriod=30 Nov 21 13:18:56 crc kubenswrapper[4769]: I1121 13:18:56.623027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerStarted","Data":"8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82"} Nov 21 13:18:56 crc kubenswrapper[4769]: I1121 13:18:56.623633 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:56 crc kubenswrapper[4769]: I1121 13:18:56.627103 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee629876-0334-4adf-af35-f82beface453" containerID="411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88" exitCode=143 Nov 21 13:18:56 crc kubenswrapper[4769]: I1121 13:18:56.627215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ee629876-0334-4adf-af35-f82beface453","Type":"ContainerDied","Data":"411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88"} Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.321035 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.321696 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-log" containerID="cri-o://8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8" gracePeriod=30 Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.321965 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-httpd" containerID="cri-o://d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8" gracePeriod=30 Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.377606 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.377888 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-log" containerID="cri-o://f010c4324e60a7d2224f1258a2d30b9134679dbb808c2bed8965a639debc9483" gracePeriod=30 Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.378015 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-httpd" containerID="cri-o://1eb2ad17e3c7244081cd5e98094c9c4aeb0c961cb4e7e06a9c7edd1137d70cbb" gracePeriod=30 Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.467571 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6"] Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.470051 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.482536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6"] Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-combined-ca-bundle\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-internal-tls-certs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvvs\" (UniqueName: \"kubernetes.io/projected/4db51a88-4aed-4420-8340-40dea3c7dcd4-kube-api-access-4pvvs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-public-tls-certs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4db51a88-4aed-4420-8340-40dea3c7dcd4-logs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data-custom\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.515887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.617317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4db51a88-4aed-4420-8340-40dea3c7dcd4-logs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.617995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data-custom\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.618099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.618158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4db51a88-4aed-4420-8340-40dea3c7dcd4-logs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.618316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-combined-ca-bundle\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.618446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-internal-tls-certs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.618549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvvs\" (UniqueName: \"kubernetes.io/projected/4db51a88-4aed-4420-8340-40dea3c7dcd4-kube-api-access-4pvvs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.618782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-public-tls-certs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.626211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-internal-tls-certs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.626269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-combined-ca-bundle\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.635576 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data-custom\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.638464 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.639455 4769 generic.go:334] "Generic (PLEG): container finished" podID="d00a1c01-316a-4298-a685-949250f157fe" containerID="8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8" exitCode=143 Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.639617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d00a1c01-316a-4298-a685-949250f157fe","Type":"ContainerDied","Data":"8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8"} Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.642918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvvs\" (UniqueName: \"kubernetes.io/projected/4db51a88-4aed-4420-8340-40dea3c7dcd4-kube-api-access-4pvvs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.643056 4769 generic.go:334] "Generic (PLEG): container finished" podID="6eda467f-6052-47e5-9913-12698d31aee1" containerID="f010c4324e60a7d2224f1258a2d30b9134679dbb808c2bed8965a639debc9483" exitCode=143 Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.643113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6eda467f-6052-47e5-9913-12698d31aee1","Type":"ContainerDied","Data":"f010c4324e60a7d2224f1258a2d30b9134679dbb808c2bed8965a639debc9483"} Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.646735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-public-tls-certs\") pod \"barbican-api-579b5f64d-k9xr6\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:57 crc kubenswrapper[4769]: I1121 13:18:57.851160 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.310824 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6"] Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.656518 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" exitCode=1 Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.656565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerDied","Data":"8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82"} Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.656602 4769 scope.go:117] "RemoveContainer" containerID="7b296dad8996422c6d9a0f90947626cb037e6b867131208e16aca3c8144b7774" Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.657538 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:18:58 crc kubenswrapper[4769]: E1121 13:18:58.658137 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:58 crc kubenswrapper[4769]: W1121 13:18:58.784651 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4db51a88_4aed_4420_8340_40dea3c7dcd4.slice/crio-c6c77e1cf018a29bf2104d8907b31856a1309444823b0d3518007429c713f09c WatchSource:0}: Error finding container c6c77e1cf018a29bf2104d8907b31856a1309444823b0d3518007429c713f09c: Status 404 returned error can't find the container with id c6c77e1cf018a29bf2104d8907b31856a1309444823b0d3518007429c713f09c Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.940491 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.940750 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-log" containerID="cri-o://137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50" gracePeriod=30 Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.940861 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-metadata" containerID="cri-o://428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14" gracePeriod=30 Nov 21 13:18:58 crc kubenswrapper[4769]: I1121 13:18:58.998143 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.133:8776/healthcheck\": read tcp 10.217.0.2:55638->10.217.0.133:8776: read: connection reset by peer" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.028507 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.274619 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:18:59 crc kubenswrapper[4769]: E1121 13:18:59.276841 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.534158 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562338 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-scripts\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhtnb\" (UniqueName: \"kubernetes.io/projected/ee629876-0334-4adf-af35-f82beface453-kube-api-access-mhtnb\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee629876-0334-4adf-af35-f82beface453-etc-machine-id\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-internal-tls-certs\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-combined-ca-bundle\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data-custom\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562804 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee629876-0334-4adf-af35-f82beface453-logs\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.562853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-public-tls-certs\") pod \"ee629876-0334-4adf-af35-f82beface453\" (UID: \"ee629876-0334-4adf-af35-f82beface453\") " Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.566439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ee629876-0334-4adf-af35-f82beface453-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.569853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee629876-0334-4adf-af35-f82beface453-logs" (OuterVolumeSpecName: "logs") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.586264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-scripts" (OuterVolumeSpecName: "scripts") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.587816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee629876-0334-4adf-af35-f82beface453-kube-api-access-mhtnb" (OuterVolumeSpecName: "kube-api-access-mhtnb") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "kube-api-access-mhtnb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.600943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.668041 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/ee629876-0334-4adf-af35-f82beface453-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.668087 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.668101 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ee629876-0334-4adf-af35-f82beface453-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.668113 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.668127 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mhtnb\" (UniqueName: \"kubernetes.io/projected/ee629876-0334-4adf-af35-f82beface453-kube-api-access-mhtnb\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.696230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.696437 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee629876-0334-4adf-af35-f82beface453" containerID="9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c" exitCode=0 Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.696517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ee629876-0334-4adf-af35-f82beface453","Type":"ContainerDied","Data":"9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c"} Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.696543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"ee629876-0334-4adf-af35-f82beface453","Type":"ContainerDied","Data":"c7e5d352f7e7c3c94bfd2d320a92948fc06a9e31d3f4b54cf7ccd2c6d8f2d1c8"} Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.696561 4769 scope.go:117] "RemoveContainer" containerID="9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.696671 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.718307 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:18:59 crc kubenswrapper[4769]: E1121 13:18:59.718576 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.720663 4769 generic.go:334] "Generic (PLEG): container finished" podID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerID="137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50" exitCode=143 Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.720728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e195233f-2809-4a2d-b82d-39e587d4cc45","Type":"ContainerDied","Data":"137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50"} Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.723117 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" event={"ID":"4db51a88-4aed-4420-8340-40dea3c7dcd4","Type":"ContainerStarted","Data":"ed4b7617bef0589b4db5c95663140acf6cc60c136c50f582ed3a0feaa90544eb"} Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.723169 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" event={"ID":"4db51a88-4aed-4420-8340-40dea3c7dcd4","Type":"ContainerStarted","Data":"c462c45586bbc9a08ab9ab8bcf50b0e3c88e350d03f7f30b8e74ddff22014633"} Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.723182 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" event={"ID":"4db51a88-4aed-4420-8340-40dea3c7dcd4","Type":"ContainerStarted","Data":"c6c77e1cf018a29bf2104d8907b31856a1309444823b0d3518007429c713f09c"} Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.723226 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.723328 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.728342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data" (OuterVolumeSpecName: "config-data") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.774177 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.782411 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.782452 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.782466 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.792419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee629876-0334-4adf-af35-f82beface453" (UID: "ee629876-0334-4adf-af35-f82beface453"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.807638 4769 scope.go:117] "RemoveContainer" containerID="411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.851793 4769 scope.go:117] "RemoveContainer" containerID="9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.860482 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" podStartSLOduration=2.860462385 podStartE2EDuration="2.860462385s" podCreationTimestamp="2025-11-21 13:18:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:18:59.804270021 +0000 UTC m=+5298.504931849" watchObservedRunningTime="2025-11-21 13:18:59.860462385 +0000 UTC m=+5298.561124203" Nov 21 13:18:59 crc kubenswrapper[4769]: E1121 13:18:59.871476 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c\": container with ID starting with 9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c not found: ID does not exist" containerID="9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.871569 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c"} err="failed to get container status \"9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c\": rpc error: code = NotFound desc = could not find container \"9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c\": container with ID starting with 9ea5cf98db7876fe0a42f032ec02c015508f391d154889e898cf8372c7be0d6c not found: ID does not exist" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.871602 4769 scope.go:117] "RemoveContainer" containerID="411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88" Nov 21 13:18:59 crc kubenswrapper[4769]: E1121 13:18:59.878442 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88\": container with ID starting with 411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88 not found: ID does not exist" containerID="411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.878517 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88"} err="failed to get container status \"411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88\": rpc error: code = NotFound desc = could not find container \"411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88\": container with ID starting with 411cafe21e2665c5be21b8f14d3b265409a18530c1ff4b65f105dc1f747b4d88 not found: ID does not exist" Nov 21 13:18:59 crc kubenswrapper[4769]: I1121 13:18:59.911260 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee629876-0334-4adf-af35-f82beface453-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.050654 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.061638 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.072030 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.072276 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-log" containerID="cri-o://c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7" gracePeriod=30 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.072384 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-api" containerID="cri-o://0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9" gracePeriod=30 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.110737 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:00 crc kubenswrapper[4769]: E1121 13:19:00.111167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api-log" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.111182 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api-log" Nov 21 13:19:00 crc kubenswrapper[4769]: E1121 13:19:00.111213 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.111220 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.111405 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api-log" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.111435 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee629876-0334-4adf-af35-f82beface453" containerName="cinder-api" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.112474 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.115448 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.116372 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.120888 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.134493 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.214699 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-scripts\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.214747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data-custom\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxkm\" (UniqueName: \"kubernetes.io/projected/6a095e0f-f9e7-476e-a960-70f3365c77aa-kube-api-access-7wxkm\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215236 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215268 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a095e0f-f9e7-476e-a960-70f3365c77aa-logs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215318 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-public-tls-certs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6a095e0f-f9e7-476e-a960-70f3365c77aa-etc-machine-id\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.215504 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.228375 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.228594 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="4b2083be-823d-422d-af53-af0074ba54cd" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14" gracePeriod=30 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.243719 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.276047 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.315444 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-677956c48d-qmjsd"] Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.315705 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-api" containerID="cri-o://88a3098d4de1963c4bb87da7f38369cee6007d6fac475005c87672c631e8c57a" gracePeriod=30 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.316038 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-httpd" containerID="cri-o://f9476e9de41a7b3d04b8cc568338310fcadfcab6112de4eab5b2abf58c425d1d" gracePeriod=30 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.317174 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxkm\" (UniqueName: \"kubernetes.io/projected/6a095e0f-f9e7-476e-a960-70f3365c77aa-kube-api-access-7wxkm\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.317385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.317493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a095e0f-f9e7-476e-a960-70f3365c77aa-logs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.317613 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-public-tls-certs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.317835 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6a095e0f-f9e7-476e-a960-70f3365c77aa-etc-machine-id\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.317953 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.318151 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-scripts\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.318350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.318496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data-custom\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.318884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a095e0f-f9e7-476e-a960-70f3365c77aa-logs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.321965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6a095e0f-f9e7-476e-a960-70f3365c77aa-etc-machine-id\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.680646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.681089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-scripts\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.681268 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.681291 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-public-tls-certs\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.682022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data-custom\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.682538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxkm\" (UniqueName: \"kubernetes.io/projected/6a095e0f-f9e7-476e-a960-70f3365c77aa-kube-api-access-7wxkm\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.682952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data\") pod \"cinder-api-0\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.732638 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.740362 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerID="c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7" exitCode=143 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.740410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6b9c7230-b4d7-4461-a212-03ec2b2f14af","Type":"ContainerDied","Data":"c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7"} Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.746943 4769 generic.go:334] "Generic (PLEG): container finished" podID="6eda467f-6052-47e5-9913-12698d31aee1" containerID="1eb2ad17e3c7244081cd5e98094c9c4aeb0c961cb4e7e06a9c7edd1137d70cbb" exitCode=0 Nov 21 13:19:00 crc kubenswrapper[4769]: I1121 13:19:00.747020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6eda467f-6052-47e5-9913-12698d31aee1","Type":"ContainerDied","Data":"1eb2ad17e3c7244081cd5e98094c9c4aeb0c961cb4e7e06a9c7edd1137d70cbb"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.203761 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.294363 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.301027 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee629876-0334-4adf-af35-f82beface453" path="/var/lib/kubelet/pods/ee629876-0334-4adf-af35-f82beface453/volumes" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-scripts\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8prtk\" (UniqueName: \"kubernetes.io/projected/6eda467f-6052-47e5-9913-12698d31aee1-kube-api-access-8prtk\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-combined-ca-bundle\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338784 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-logs\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338813 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-config-data\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338835 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.338899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-httpd-run\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.344894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-logs" (OuterVolumeSpecName: "logs") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.344947 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.349955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.359255 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-scripts" (OuterVolumeSpecName: "scripts") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.363092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eda467f-6052-47e5-9913-12698d31aee1-kube-api-access-8prtk" (OuterVolumeSpecName: "kube-api-access-8prtk") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "kube-api-access-8prtk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.374639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.390352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.414213 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs podName:6eda467f-6052-47e5-9913-12698d31aee1 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:01.914160871 +0000 UTC m=+5300.614822699 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1") : error deleting /var/lib/kubelet/pods/6eda467f-6052-47e5-9913-12698d31aee1/volume-subpaths: remove /var/lib/kubelet/pods/6eda467f-6052-47e5-9913-12698d31aee1/volume-subpaths: no such file or directory Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.422660 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.423494 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.426306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-config-data" (OuterVolumeSpecName: "config-data") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.449548 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-config-data\") pod \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.449627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-combined-ca-bundle\") pod \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.449763 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b9c7230-b4d7-4461-a212-03ec2b2f14af-logs\") pod \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.449820 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-public-tls-certs\") pod \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.449838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-internal-tls-certs\") pod \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.449875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzcsh\" (UniqueName: \"kubernetes.io/projected/6b9c7230-b4d7-4461-a212-03ec2b2f14af-kube-api-access-vzcsh\") pod \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\" (UID: \"6b9c7230-b4d7-4461-a212-03ec2b2f14af\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450253 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450271 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450280 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450290 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6eda467f-6052-47e5-9913-12698d31aee1-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450298 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450307 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8prtk\" (UniqueName: \"kubernetes.io/projected/6eda467f-6052-47e5-9913-12698d31aee1-kube-api-access-8prtk\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.450325 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.451628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b9c7230-b4d7-4461-a212-03ec2b2f14af-logs" (OuterVolumeSpecName: "logs") pod "6b9c7230-b4d7-4461-a212-03ec2b2f14af" (UID: "6b9c7230-b4d7-4461-a212-03ec2b2f14af"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.464434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9c7230-b4d7-4461-a212-03ec2b2f14af-kube-api-access-vzcsh" (OuterVolumeSpecName: "kube-api-access-vzcsh") pod "6b9c7230-b4d7-4461-a212-03ec2b2f14af" (UID: "6b9c7230-b4d7-4461-a212-03ec2b2f14af"). InnerVolumeSpecName "kube-api-access-vzcsh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.503830 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-httpd-run\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551500 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-scripts\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg95t\" (UniqueName: \"kubernetes.io/projected/d00a1c01-316a-4298-a685-949250f157fe-kube-api-access-fg95t\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-combined-ca-bundle\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-logs\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551704 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-combined-ca-bundle\") pod \"4b2083be-823d-422d-af53-af0074ba54cd\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-vencrypt-tls-certs\") pod \"4b2083be-823d-422d-af53-af0074ba54cd\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpwk6\" (UniqueName: \"kubernetes.io/projected/4b2083be-823d-422d-af53-af0074ba54cd-kube-api-access-wpwk6\") pod \"4b2083be-823d-422d-af53-af0074ba54cd\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-public-tls-certs\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551914 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-nova-novncproxy-tls-certs\") pod \"4b2083be-823d-422d-af53-af0074ba54cd\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-config-data\") pod \"4b2083be-823d-422d-af53-af0074ba54cd\" (UID: \"4b2083be-823d-422d-af53-af0074ba54cd\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.551987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-config-data\") pod \"d00a1c01-316a-4298-a685-949250f157fe\" (UID: \"d00a1c01-316a-4298-a685-949250f157fe\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.552428 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b9c7230-b4d7-4461-a212-03ec2b2f14af-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.552442 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.552451 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vzcsh\" (UniqueName: \"kubernetes.io/projected/6b9c7230-b4d7-4461-a212-03ec2b2f14af-kube-api-access-vzcsh\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.553327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-logs" (OuterVolumeSpecName: "logs") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.553599 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.563340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-config-data" (OuterVolumeSpecName: "config-data") pod "6b9c7230-b4d7-4461-a212-03ec2b2f14af" (UID: "6b9c7230-b4d7-4461-a212-03ec2b2f14af"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.566854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-scripts" (OuterVolumeSpecName: "scripts") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.575491 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.582141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2083be-823d-422d-af53-af0074ba54cd-kube-api-access-wpwk6" (OuterVolumeSpecName: "kube-api-access-wpwk6") pod "4b2083be-823d-422d-af53-af0074ba54cd" (UID: "4b2083be-823d-422d-af53-af0074ba54cd"). InnerVolumeSpecName "kube-api-access-wpwk6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.582982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.583448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d00a1c01-316a-4298-a685-949250f157fe-kube-api-access-fg95t" (OuterVolumeSpecName: "kube-api-access-fg95t") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "kube-api-access-fg95t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.610694 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6b9c7230-b4d7-4461-a212-03ec2b2f14af" (UID: "6b9c7230-b4d7-4461-a212-03ec2b2f14af"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.650911 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b9c7230-b4d7-4461-a212-03ec2b2f14af" (UID: "6b9c7230-b4d7-4461-a212-03ec2b2f14af"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.660540 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fg95t\" (UniqueName: \"kubernetes.io/projected/d00a1c01-316a-4298-a685-949250f157fe-kube-api-access-fg95t\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.660725 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.660843 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.660905 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.661402 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.661475 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.661546 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wpwk6\" (UniqueName: \"kubernetes.io/projected/4b2083be-823d-422d-af53-af0074ba54cd-kube-api-access-wpwk6\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.661604 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d00a1c01-316a-4298-a685-949250f157fe-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.661664 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.686593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b2083be-823d-422d-af53-af0074ba54cd" (UID: "4b2083be-823d-422d-af53-af0074ba54cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.695407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6b9c7230-b4d7-4461-a212-03ec2b2f14af" (UID: "6b9c7230-b4d7-4461-a212-03ec2b2f14af"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.710466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.711389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-config-data" (OuterVolumeSpecName: "config-data") pod "4b2083be-823d-422d-af53-af0074ba54cd" (UID: "4b2083be-823d-422d-af53-af0074ba54cd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.711819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "4b2083be-823d-422d-af53-af0074ba54cd" (UID: "4b2083be-823d-422d-af53-af0074ba54cd"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.738603 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "4b2083be-823d-422d-af53-af0074ba54cd" (UID: "4b2083be-823d-422d-af53-af0074ba54cd"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.750841 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.757549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764567 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764598 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b9c7230-b4d7-4461-a212-03ec2b2f14af-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764610 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764622 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764632 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764639 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764648 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.764657 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b2083be-823d-422d-af53-af0074ba54cd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.765154 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6a095e0f-f9e7-476e-a960-70f3365c77aa","Type":"ContainerStarted","Data":"7374827832e1d49cc336d781fc29ce788e0a436eb0d09390143103ce09940680"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.770582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-config-data" (OuterVolumeSpecName: "config-data") pod "d00a1c01-316a-4298-a685-949250f157fe" (UID: "d00a1c01-316a-4298-a685-949250f157fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.788420 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerID="0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9" exitCode=0 Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.788498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.788525 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6b9c7230-b4d7-4461-a212-03ec2b2f14af","Type":"ContainerDied","Data":"0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.788554 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"6b9c7230-b4d7-4461-a212-03ec2b2f14af","Type":"ContainerDied","Data":"172b925bd84721bd3109a2b6eea7718bcc7b91c24d74b9c0114381697f33583b"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.788572 4769 scope.go:117] "RemoveContainer" containerID="0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.793030 4769 generic.go:334] "Generic (PLEG): container finished" podID="d00a1c01-316a-4298-a685-949250f157fe" containerID="d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8" exitCode=0 Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.793049 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.793098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d00a1c01-316a-4298-a685-949250f157fe","Type":"ContainerDied","Data":"d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.793132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d00a1c01-316a-4298-a685-949250f157fe","Type":"ContainerDied","Data":"cea2bc7e28c06f00f936083f023b39391000a1df439a678d3ea982726e0e6d58"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.795649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"6eda467f-6052-47e5-9913-12698d31aee1","Type":"ContainerDied","Data":"e9da29f6a5299a4db7082148223328a504f96173028daa8f59a7944b27222a51"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.795685 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.798522 4769 generic.go:334] "Generic (PLEG): container finished" podID="9974304e-9420-484d-83e8-996cd607775e" containerID="f9476e9de41a7b3d04b8cc568338310fcadfcab6112de4eab5b2abf58c425d1d" exitCode=0 Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.798580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" event={"ID":"9974304e-9420-484d-83e8-996cd607775e","Type":"ContainerDied","Data":"f9476e9de41a7b3d04b8cc568338310fcadfcab6112de4eab5b2abf58c425d1d"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.801168 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerStarted","Data":"86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.803740 4769 generic.go:334] "Generic (PLEG): container finished" podID="4b2083be-823d-422d-af53-af0074ba54cd" containerID="0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14" exitCode=0 Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.803793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4b2083be-823d-422d-af53-af0074ba54cd","Type":"ContainerDied","Data":"0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.804290 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"4b2083be-823d-422d-af53-af0074ba54cd","Type":"ContainerDied","Data":"d419b20b589bcddc9428a1fbd4df25b659f2a09418d3be8d4c462bcf318b2202"} Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.804364 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.831698 4769 scope.go:117] "RemoveContainer" containerID="c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.865522 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.866235 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d00a1c01-316a-4298-a685-949250f157fe-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.899073 4769 scope.go:117] "RemoveContainer" containerID="0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.901029 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9\": container with ID starting with 0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9 not found: ID does not exist" containerID="0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.901114 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9"} err="failed to get container status \"0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9\": rpc error: code = NotFound desc = could not find container \"0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9\": container with ID starting with 0c4adf1f7fb0a6a8ddfc7f7a33a09dfc65224ca6ec2de30745c6fcc53b2be6f9 not found: ID does not exist" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.901154 4769 scope.go:117] "RemoveContainer" containerID="c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.902518 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7\": container with ID starting with c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7 not found: ID does not exist" containerID="c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.902590 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7"} err="failed to get container status \"c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7\": rpc error: code = NotFound desc = could not find container \"c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7\": container with ID starting with c8b09841ef10008405bd1845b42db6d9b9334f7e12f0dd6ec17b9a237dd0b9b7 not found: ID does not exist" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.902618 4769 scope.go:117] "RemoveContainer" containerID="d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.919980 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.967883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs\") pod \"6eda467f-6052-47e5-9913-12698d31aee1\" (UID: \"6eda467f-6052-47e5-9913-12698d31aee1\") " Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.972924 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.973491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-httpd" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.973559 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-httpd" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.973650 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4b2083be-823d-422d-af53-af0074ba54cd" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.973701 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b2083be-823d-422d-af53-af0074ba54cd" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.973760 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-httpd" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.973809 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-httpd" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.973875 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-log" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.973999 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-log" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.974071 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-log" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974133 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-log" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.974201 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-log" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974255 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-log" Nov 21 13:19:01 crc kubenswrapper[4769]: E1121 13:19:01.974311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-api" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974369 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-api" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974583 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-api" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974666 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4b2083be-823d-422d-af53-af0074ba54cd" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-log" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974777 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6eda467f-6052-47e5-9913-12698d31aee1" containerName="glance-httpd" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974854 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-log" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.974910 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" containerName="nova-api-log" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.975011 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d00a1c01-316a-4298-a685-949250f157fe" containerName="glance-httpd" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.976045 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.973960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6eda467f-6052-47e5-9913-12698d31aee1" (UID: "6eda467f-6052-47e5-9913-12698d31aee1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.983683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.990625 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.990815 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.991029 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:19:01 crc kubenswrapper[4769]: I1121 13:19:01.994278 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.015144 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.024413 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.036471 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.043252 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.045768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.050687 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.051129 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.058034 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.059367 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.064223 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.064533 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.064753 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.069821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5a91599-04eb-42eb-a583-666c0552a16f-logs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.069937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-public-tls-certs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.070002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.070022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.070139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzfg\" (UniqueName: \"kubernetes.io/projected/f5a91599-04eb-42eb-a583-666c0552a16f-kube-api-access-8pzfg\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.070183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-config-data\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.070284 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6eda467f-6052-47e5-9913-12698d31aee1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.075820 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.088079 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.093361 4769 scope.go:117] "RemoveContainer" containerID="8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.139858 4769 scope.go:117] "RemoveContainer" containerID="d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8" Nov 21 13:19:02 crc kubenswrapper[4769]: E1121 13:19:02.140322 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8\": container with ID starting with d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8 not found: ID does not exist" containerID="d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.140351 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8"} err="failed to get container status \"d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8\": rpc error: code = NotFound desc = could not find container \"d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8\": container with ID starting with d65a189692d28115d1e5b9a965b926202f4a3ba9a2e5cf3fefbf9c8c88ccdfe8 not found: ID does not exist" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.140373 4769 scope.go:117] "RemoveContainer" containerID="8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8" Nov 21 13:19:02 crc kubenswrapper[4769]: E1121 13:19:02.145327 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8\": container with ID starting with 8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8 not found: ID does not exist" containerID="8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.145371 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8"} err="failed to get container status \"8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8\": rpc error: code = NotFound desc = could not find container \"8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8\": container with ID starting with 8bee912d4a84561db9f50ad32db53c812437b612546098602ed962bc8ec3d2f8 not found: ID does not exist" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.145399 4769 scope.go:117] "RemoveContainer" containerID="1eb2ad17e3c7244081cd5e98094c9c4aeb0c961cb4e7e06a9c7edd1137d70cbb" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.148010 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172196 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7wcg\" (UniqueName: \"kubernetes.io/projected/b08d0a94-0636-40de-b613-a6ffecc06c12-kube-api-access-q7wcg\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172243 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-logs\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzfg\" (UniqueName: \"kubernetes.io/projected/f5a91599-04eb-42eb-a583-666c0552a16f-kube-api-access-8pzfg\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172425 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-config-data\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172487 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-scripts\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172580 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5a91599-04eb-42eb-a583-666c0552a16f-logs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172690 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtkj5\" (UniqueName: \"kubernetes.io/projected/e73113de-3961-438d-acd9-886c2db72385-kube-api-access-rtkj5\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-public-tls-certs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5a91599-04eb-42eb-a583-666c0552a16f-logs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.172992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-config-data\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.176859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-config-data\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.176981 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.178239 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.183524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.189707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-public-tls-certs\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.193632 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzfg\" (UniqueName: \"kubernetes.io/projected/f5a91599-04eb-42eb-a583-666c0552a16f-kube-api-access-8pzfg\") pod \"nova-api-0\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.208277 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.209933 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.218092 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.219837 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.220128 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.247390 4769 scope.go:117] "RemoveContainer" containerID="f010c4324e60a7d2224f1258a2d30b9134679dbb808c2bed8965a639debc9483" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rtkj5\" (UniqueName: \"kubernetes.io/projected/e73113de-3961-438d-acd9-886c2db72385-kube-api-access-rtkj5\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274870 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274894 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274911 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-logs\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-config-data\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.274978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q7wcg\" (UniqueName: \"kubernetes.io/projected/b08d0a94-0636-40de-b613-a6ffecc06c12-kube-api-access-q7wcg\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275039 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwxh\" (UniqueName: \"kubernetes.io/projected/1ac95b70-d511-44d0-b6f0-2f66169bbad4-kube-api-access-mvwxh\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-logs\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275173 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-scripts\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.275242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.276205 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.279958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.280685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-logs\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.282727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.282914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-config-data\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.287630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.289396 4769 scope.go:117] "RemoveContainer" containerID="0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.291911 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.292444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.309536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.323985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.324076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.324754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtkj5\" (UniqueName: \"kubernetes.io/projected/e73113de-3961-438d-acd9-886c2db72385-kube-api-access-rtkj5\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.325314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-scripts\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.340656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7wcg\" (UniqueName: \"kubernetes.io/projected/b08d0a94-0636-40de-b613-a6ffecc06c12-kube-api-access-q7wcg\") pod \"nova-cell1-novncproxy-0\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.340874 4769 scope.go:117] "RemoveContainer" containerID="0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14" Nov 21 13:19:02 crc kubenswrapper[4769]: E1121 13:19:02.341434 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14\": container with ID starting with 0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14 not found: ID does not exist" containerID="0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.341475 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14"} err="failed to get container status \"0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14\": rpc error: code = NotFound desc = could not find container \"0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14\": container with ID starting with 0bcfa2c1bf951c13946c5c5d861f078056dc6e764cefe1659ccc08888c7cab14 not found: ID does not exist" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.346063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"glance-default-external-api-0\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.371240 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.376914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.376988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.377027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-logs\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.377096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.377121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.377164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.377491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwxh\" (UniqueName: \"kubernetes.io/projected/1ac95b70-d511-44d0-b6f0-2f66169bbad4-kube-api-access-mvwxh\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.377605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.379027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.379123 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") device mount path \"/mnt/openstack/pv10\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.379719 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-logs\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.383687 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.384242 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.384625 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.384913 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.387070 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.415257 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwxh\" (UniqueName: \"kubernetes.io/projected/1ac95b70-d511-44d0-b6f0-2f66169bbad4-kube-api-access-mvwxh\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.429722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"glance-default-internal-api-0\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.551929 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.864901 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.880299 4769 generic.go:334] "Generic (PLEG): container finished" podID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerID="428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14" exitCode=0 Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.880387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e195233f-2809-4a2d-b82d-39e587d4cc45","Type":"ContainerDied","Data":"428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14"} Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.880420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e195233f-2809-4a2d-b82d-39e587d4cc45","Type":"ContainerDied","Data":"84f8afe6c05d127bbd6f928f0003e368dfbb9aad335b3de14f17d6e37010b670"} Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.880442 4769 scope.go:117] "RemoveContainer" containerID="428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.880583 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.895633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerStarted","Data":"9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580"} Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.896576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e195233f-2809-4a2d-b82d-39e587d4cc45-logs\") pod \"e195233f-2809-4a2d-b82d-39e587d4cc45\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.896674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-nova-metadata-tls-certs\") pod \"e195233f-2809-4a2d-b82d-39e587d4cc45\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.896714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-combined-ca-bundle\") pod \"e195233f-2809-4a2d-b82d-39e587d4cc45\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.896754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf4hk\" (UniqueName: \"kubernetes.io/projected/e195233f-2809-4a2d-b82d-39e587d4cc45-kube-api-access-pf4hk\") pod \"e195233f-2809-4a2d-b82d-39e587d4cc45\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.896799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-config-data\") pod \"e195233f-2809-4a2d-b82d-39e587d4cc45\" (UID: \"e195233f-2809-4a2d-b82d-39e587d4cc45\") " Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.898460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e195233f-2809-4a2d-b82d-39e587d4cc45-logs" (OuterVolumeSpecName: "logs") pod "e195233f-2809-4a2d-b82d-39e587d4cc45" (UID: "e195233f-2809-4a2d-b82d-39e587d4cc45"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.916581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e195233f-2809-4a2d-b82d-39e587d4cc45-kube-api-access-pf4hk" (OuterVolumeSpecName: "kube-api-access-pf4hk") pod "e195233f-2809-4a2d-b82d-39e587d4cc45" (UID: "e195233f-2809-4a2d-b82d-39e587d4cc45"). InnerVolumeSpecName "kube-api-access-pf4hk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.927931 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.967765 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.00874629 podStartE2EDuration="45.967743554s" podCreationTimestamp="2025-11-21 13:18:17 +0000 UTC" firstStartedPulling="2025-11-21 13:18:18.133412219 +0000 UTC m=+5256.834074037" lastFinishedPulling="2025-11-21 13:19:02.092409483 +0000 UTC m=+5300.793071301" observedRunningTime="2025-11-21 13:19:02.93789117 +0000 UTC m=+5301.638552998" watchObservedRunningTime="2025-11-21 13:19:02.967743554 +0000 UTC m=+5301.668405372" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.977910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e195233f-2809-4a2d-b82d-39e587d4cc45" (UID: "e195233f-2809-4a2d-b82d-39e587d4cc45"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.988366 4769 scope.go:117] "RemoveContainer" containerID="137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.998892 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e195233f-2809-4a2d-b82d-39e587d4cc45-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.998924 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:02 crc kubenswrapper[4769]: I1121 13:19:02.998938 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pf4hk\" (UniqueName: \"kubernetes.io/projected/e195233f-2809-4a2d-b82d-39e587d4cc45-kube-api-access-pf4hk\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.016132 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.037363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-config-data" (OuterVolumeSpecName: "config-data") pod "e195233f-2809-4a2d-b82d-39e587d4cc45" (UID: "e195233f-2809-4a2d-b82d-39e587d4cc45"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.064356 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.074418 4769 scope.go:117] "RemoveContainer" containerID="428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14" Nov 21 13:19:03 crc kubenswrapper[4769]: E1121 13:19:03.075319 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14\": container with ID starting with 428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14 not found: ID does not exist" containerID="428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.075344 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14"} err="failed to get container status \"428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14\": rpc error: code = NotFound desc = could not find container \"428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14\": container with ID starting with 428d0871f49ace45dea5779aaa1d5d66f8aa0e35f148f7676a9a7a55339cde14 not found: ID does not exist" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.075364 4769 scope.go:117] "RemoveContainer" containerID="137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50" Nov 21 13:19:03 crc kubenswrapper[4769]: E1121 13:19:03.075703 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50\": container with ID starting with 137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50 not found: ID does not exist" containerID="137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.075758 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50"} err="failed to get container status \"137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50\": rpc error: code = NotFound desc = could not find container \"137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50\": container with ID starting with 137baf288c43708bdbe6bf11e992ab39eb9f9e9be90253d5b69805306e607e50 not found: ID does not exist" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.079376 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-66f88c5fc4-4c656"] Nov 21 13:19:03 crc kubenswrapper[4769]: E1121 13:19:03.079795 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-metadata" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.079806 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-metadata" Nov 21 13:19:03 crc kubenswrapper[4769]: E1121 13:19:03.079826 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-log" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.079832 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-log" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.080006 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-log" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.080038 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" containerName="nova-metadata-metadata" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.080947 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.088397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e195233f-2809-4a2d-b82d-39e587d4cc45" (UID: "e195233f-2809-4a2d-b82d-39e587d4cc45"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.091928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-66f88c5fc4-4c656"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.104760 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.105016 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e195233f-2809-4a2d-b82d-39e587d4cc45-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.173742 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: W1121 13:19:03.182143 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode73113de_3961_438d_acd9_886c2db72385.slice/crio-c2fc3ee9278497939e5e0529d38c2317aa9e00aea4fc9178b4190ab302025d56 WatchSource:0}: Error finding container c2fc3ee9278497939e5e0529d38c2317aa9e00aea4fc9178b4190ab302025d56: Status 404 returned error can't find the container with id c2fc3ee9278497939e5e0529d38c2317aa9e00aea4fc9178b4190ab302025d56 Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.202827 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.206847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-config\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.206899 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-public-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.206922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-combined-ca-bundle\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.206941 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97gjv\" (UniqueName: \"kubernetes.io/projected/db4e8e03-925e-49f1-bc4f-a3818374af73-kube-api-access-97gjv\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.206966 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-internal-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.207048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-httpd-config\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.207079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-ovndb-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.228773 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.237456 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.271446 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.278992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-logs\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-httpd-config\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308354 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-ovndb-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj8vx\" (UniqueName: \"kubernetes.io/projected/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-kube-api-access-cj8vx\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308396 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-config\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-public-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308519 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-combined-ca-bundle\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308534 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-97gjv\" (UniqueName: \"kubernetes.io/projected/db4e8e03-925e-49f1-bc4f-a3818374af73-kube-api-access-97gjv\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-internal-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.308573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-config-data\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.321952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-httpd-config\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.322049 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.322170 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.326737 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-public-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.328317 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-ovndb-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.335665 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-combined-ca-bundle\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.339584 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-config\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.342260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-internal-tls-certs\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.342644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-97gjv\" (UniqueName: \"kubernetes.io/projected/db4e8e03-925e-49f1-bc4f-a3818374af73-kube-api-access-97gjv\") pod \"neutron-66f88c5fc4-4c656\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.343571 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2083be-823d-422d-af53-af0074ba54cd" path="/var/lib/kubelet/pods/4b2083be-823d-422d-af53-af0074ba54cd/volumes" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.344305 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9c7230-b4d7-4461-a212-03ec2b2f14af" path="/var/lib/kubelet/pods/6b9c7230-b4d7-4461-a212-03ec2b2f14af/volumes" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.345074 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eda467f-6052-47e5-9913-12698d31aee1" path="/var/lib/kubelet/pods/6eda467f-6052-47e5-9913-12698d31aee1/volumes" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.346457 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d00a1c01-316a-4298-a685-949250f157fe" path="/var/lib/kubelet/pods/d00a1c01-316a-4298-a685-949250f157fe/volumes" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.347451 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e195233f-2809-4a2d-b82d-39e587d4cc45" path="/var/lib/kubelet/pods/e195233f-2809-4a2d-b82d-39e587d4cc45/volumes" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.348648 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.348700 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.358594 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.410617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-logs\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.410957 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-logs\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.411114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cj8vx\" (UniqueName: \"kubernetes.io/projected/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-kube-api-access-cj8vx\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.411142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.414432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.415394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-config-data\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.423133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.425743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.433729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-config-data\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.434275 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj8vx\" (UniqueName: \"kubernetes.io/projected/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-kube-api-access-cj8vx\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.434656 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.659737 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.797475 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-66f88c5fc4-4c656"] Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.957332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1ac95b70-d511-44d0-b6f0-2f66169bbad4","Type":"ContainerStarted","Data":"fa76569e1037a6f963d10fd16a886f2dd159462224c1c3a5cf59ff4ecd0fde62"} Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.959402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e73113de-3961-438d-acd9-886c2db72385","Type":"ContainerStarted","Data":"c2fc3ee9278497939e5e0529d38c2317aa9e00aea4fc9178b4190ab302025d56"} Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.960726 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f5a91599-04eb-42eb-a583-666c0552a16f","Type":"ContainerStarted","Data":"8f46547bd724f15a906dff1f908869f1b610836a8a2d4ddf20148f9a22b4d334"} Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.960748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f5a91599-04eb-42eb-a583-666c0552a16f","Type":"ContainerStarted","Data":"8b6f1b2bc483909b07725fc5687bcc89008def1a9dfd447f2a4f473bd82223f2"} Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.966763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6a095e0f-f9e7-476e-a960-70f3365c77aa","Type":"ContainerStarted","Data":"70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3"} Nov 21 13:19:03 crc kubenswrapper[4769]: I1121 13:19:03.994528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b08d0a94-0636-40de-b613-a6ffecc06c12","Type":"ContainerStarted","Data":"434b617ee1c93a1806b06fe300d3790693880b5cbfe2648b09841dad55e123a3"} Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.007654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" event={"ID":"db4e8e03-925e-49f1-bc4f-a3818374af73","Type":"ContainerStarted","Data":"51ca1ca3f9d079185769d5afd5c38a90c7344306ae182820973c37a185aa4171"} Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.175268 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.235:9696/\": dial tcp 10.217.1.235:9696: connect: connection refused" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.373615 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.663046 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-66f88c5fc4-4c656"] Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.697858 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7979fc499d-l7wjs"] Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.699750 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.721918 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7979fc499d-l7wjs"] Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-public-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-combined-ca-bundle\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-ovndb-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765495 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqjsr\" (UniqueName: \"kubernetes.io/projected/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-kube-api-access-fqjsr\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-httpd-config\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-config\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.765595 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-internal-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.867580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-public-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.867885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-combined-ca-bundle\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.867917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-ovndb-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.867945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fqjsr\" (UniqueName: \"kubernetes.io/projected/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-kube-api-access-fqjsr\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.867961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-httpd-config\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.868004 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-config\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.868050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-internal-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.873732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-internal-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.879019 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-config\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.879214 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-httpd-config\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.879377 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-combined-ca-bundle\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.887607 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-ovndb-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.891108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-public-tls-certs\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:04 crc kubenswrapper[4769]: I1121 13:19:04.896094 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqjsr\" (UniqueName: \"kubernetes.io/projected/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-kube-api-access-fqjsr\") pod \"neutron-7979fc499d-l7wjs\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.017751 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.029213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f9e7d8a7-0ab6-433c-a590-8a908ae70d01","Type":"ContainerStarted","Data":"13ab8dbe2fb8c59dec0d2b012d946b0138a9693621b85b6286f8a7638b11c3a5"} Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.030848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b08d0a94-0636-40de-b613-a6ffecc06c12","Type":"ContainerStarted","Data":"39ac0c9ca848af57a4488ae7a4733f481488f46f542a7d5335e3a062c8d52cb1"} Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.034163 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" event={"ID":"db4e8e03-925e-49f1-bc4f-a3818374af73","Type":"ContainerStarted","Data":"68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572"} Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.036693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f5a91599-04eb-42eb-a583-666c0552a16f","Type":"ContainerStarted","Data":"664df784d54f1953a61905f5ac3a0ed70e6c9cc9a1d804f4ad065ce31820c3cb"} Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.054709 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=4.054693455 podStartE2EDuration="4.054693455s" podCreationTimestamp="2025-11-21 13:19:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:05.051896199 +0000 UTC m=+5303.752558017" watchObservedRunningTime="2025-11-21 13:19:05.054693455 +0000 UTC m=+5303.755355273" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.073914 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.073883872 podStartE2EDuration="4.073883872s" podCreationTimestamp="2025-11-21 13:19:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:05.07087468 +0000 UTC m=+5303.771536528" watchObservedRunningTime="2025-11-21 13:19:05.073883872 +0000 UTC m=+5303.774545690" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.289891 4769 scope.go:117] "RemoveContainer" containerID="de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.406544 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6"] Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.407157 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api-log" containerID="cri-o://c462c45586bbc9a08ab9ab8bcf50b0e3c88e350d03f7f30b8e74ddff22014633" gracePeriod=30 Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.407304 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api" containerID="cri-o://ed4b7617bef0589b4db5c95663140acf6cc60c136c50f582ed3a0feaa90544eb" gracePeriod=30 Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.432559 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.149:9311/healthcheck\": EOF" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.432787 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.149:9311/healthcheck\": EOF" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.443183 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-56c85cb96-q6889"] Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.447575 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.479087 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-56c85cb96-q6889"] Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data-custom\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-combined-ca-bundle\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b728bee3-96ff-4142-9282-de05409ad732-logs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-internal-tls-certs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-public-tls-certs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.514945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2xq\" (UniqueName: \"kubernetes.io/projected/b728bee3-96ff-4142-9282-de05409ad732-kube-api-access-jc2xq\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.568289 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7979fc499d-l7wjs"] Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b728bee3-96ff-4142-9282-de05409ad732-logs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618727 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-internal-tls-certs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-public-tls-certs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2xq\" (UniqueName: \"kubernetes.io/projected/b728bee3-96ff-4142-9282-de05409ad732-kube-api-access-jc2xq\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data-custom\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.618908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-combined-ca-bundle\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.631733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-combined-ca-bundle\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.631980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data-custom\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.633543 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b728bee3-96ff-4142-9282-de05409ad732-logs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.633679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-internal-tls-certs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.635079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-public-tls-certs\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.638391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.670712 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2xq\" (UniqueName: \"kubernetes.io/projected/b728bee3-96ff-4142-9282-de05409ad732-kube-api-access-jc2xq\") pod \"barbican-api-56c85cb96-q6889\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:05 crc kubenswrapper[4769]: I1121 13:19:05.753787 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.101295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f9e7d8a7-0ab6-433c-a590-8a908ae70d01","Type":"ContainerStarted","Data":"14e60c29fdf5f6a03d66db49ee3c700b970c8ee0827320db8caa98a96d972cbc"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.101553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f9e7d8a7-0ab6-433c-a590-8a908ae70d01","Type":"ContainerStarted","Data":"ceec5e9ae4db59a6c071fcac05945b9798302c0e45510e38eb06fb0c28b6a2ca"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.104387 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-api" containerID="cri-o://68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572" gracePeriod=30 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.104496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" event={"ID":"db4e8e03-925e-49f1-bc4f-a3818374af73","Type":"ContainerStarted","Data":"417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.104680 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-httpd" containerID="cri-o://417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc" gracePeriod=30 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.105484 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.107897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1ac95b70-d511-44d0-b6f0-2f66169bbad4","Type":"ContainerStarted","Data":"15888949b29d204ac86a4426582988850fb8b58bb4b10c0b63169560d49becb8"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.114330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e73113de-3961-438d-acd9-886c2db72385","Type":"ContainerStarted","Data":"12f02a05f413e8857f425ce4bbd37f702949440faf33c3309c7e81954e222613"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.129528 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" podStartSLOduration=4.12951099 podStartE2EDuration="4.12951099s" podCreationTimestamp="2025-11-21 13:19:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:06.12321442 +0000 UTC m=+5304.823876238" watchObservedRunningTime="2025-11-21 13:19:06.12951099 +0000 UTC m=+5304.830172798" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.141138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6a095e0f-f9e7-476e-a960-70f3365c77aa","Type":"ContainerStarted","Data":"e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.141306 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api-log" containerID="cri-o://70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3" gracePeriod=30 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.141542 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.141801 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api" containerID="cri-o://e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49" gracePeriod=30 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.159454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" event={"ID":"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc","Type":"ContainerStarted","Data":"15205680f75d7bafea71eff445dfd97507653414b5dfb2268041b4b2d1c2b110"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.159515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" event={"ID":"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc","Type":"ContainerStarted","Data":"b4f260634f0bd6fdf7fdfc15836fe3c1d507e806014b5587f05a30b638887f06"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.165757 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=6.165736256 podStartE2EDuration="6.165736256s" podCreationTimestamp="2025-11-21 13:19:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:06.15662367 +0000 UTC m=+5304.857285488" watchObservedRunningTime="2025-11-21 13:19:06.165736256 +0000 UTC m=+5304.866398074" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.185099 4769 generic.go:334] "Generic (PLEG): container finished" podID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerID="ed4b7617bef0589b4db5c95663140acf6cc60c136c50f582ed3a0feaa90544eb" exitCode=0 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.185133 4769 generic.go:334] "Generic (PLEG): container finished" podID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerID="c462c45586bbc9a08ab9ab8bcf50b0e3c88e350d03f7f30b8e74ddff22014633" exitCode=143 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.185246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" event={"ID":"4db51a88-4aed-4420-8340-40dea3c7dcd4","Type":"ContainerDied","Data":"ed4b7617bef0589b4db5c95663140acf6cc60c136c50f582ed3a0feaa90544eb"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.185278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" event={"ID":"4db51a88-4aed-4420-8340-40dea3c7dcd4","Type":"ContainerDied","Data":"c462c45586bbc9a08ab9ab8bcf50b0e3c88e350d03f7f30b8e74ddff22014633"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.205499 4769 generic.go:334] "Generic (PLEG): container finished" podID="2614f647-50de-416e-afe3-7b658b34092e" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" exitCode=1 Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.206464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerDied","Data":"86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6"} Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.206532 4769 scope.go:117] "RemoveContainer" containerID="cad813d3a3861ea67ed5ba01fd32394462ea951cc6678a76019a0d58e732d784" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.207494 4769 scope.go:117] "RemoveContainer" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:19:06 crc kubenswrapper[4769]: E1121 13:19:06.207818 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.318512 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-56c85cb96-q6889"] Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.394525 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-public-tls-certs\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445417 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-internal-tls-certs\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4db51a88-4aed-4420-8340-40dea3c7dcd4-logs\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445532 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data-custom\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pvvs\" (UniqueName: \"kubernetes.io/projected/4db51a88-4aed-4420-8340-40dea3c7dcd4-kube-api-access-4pvvs\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.445633 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-combined-ca-bundle\") pod \"4db51a88-4aed-4420-8340-40dea3c7dcd4\" (UID: \"4db51a88-4aed-4420-8340-40dea3c7dcd4\") " Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.446316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4db51a88-4aed-4420-8340-40dea3c7dcd4-logs" (OuterVolumeSpecName: "logs") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.454361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.477156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db51a88-4aed-4420-8340-40dea3c7dcd4-kube-api-access-4pvvs" (OuterVolumeSpecName: "kube-api-access-4pvvs") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "kube-api-access-4pvvs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.538306 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.545512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.548439 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4pvvs\" (UniqueName: \"kubernetes.io/projected/4db51a88-4aed-4420-8340-40dea3c7dcd4-kube-api-access-4pvvs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.548466 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.548475 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.548486 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4db51a88-4aed-4420-8340-40dea3c7dcd4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.548495 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.555662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.613051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data" (OuterVolumeSpecName: "config-data") pod "4db51a88-4aed-4420-8340-40dea3c7dcd4" (UID: "4db51a88-4aed-4420-8340-40dea3c7dcd4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.649952 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:06 crc kubenswrapper[4769]: I1121 13:19:06.649990 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4db51a88-4aed-4420-8340-40dea3c7dcd4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.228310 4769 generic.go:334] "Generic (PLEG): container finished" podID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerID="417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc" exitCode=0 Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.228827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" event={"ID":"db4e8e03-925e-49f1-bc4f-a3818374af73","Type":"ContainerDied","Data":"417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.239855 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" event={"ID":"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc","Type":"ContainerStarted","Data":"8474f3bee160abdbfe40a398cfc6fd3dc69c47042bd45d32463964a7bfb491e6"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.241341 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.253479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" event={"ID":"4db51a88-4aed-4420-8340-40dea3c7dcd4","Type":"ContainerDied","Data":"c6c77e1cf018a29bf2104d8907b31856a1309444823b0d3518007429c713f09c"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.253528 4769 scope.go:117] "RemoveContainer" containerID="ed4b7617bef0589b4db5c95663140acf6cc60c136c50f582ed3a0feaa90544eb" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.253655 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.271787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerStarted","Data":"33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.272630 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.289900 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" podStartSLOduration=3.289883639 podStartE2EDuration="3.289883639s" podCreationTimestamp="2025-11-21 13:19:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:07.258245866 +0000 UTC m=+5305.958907694" watchObservedRunningTime="2025-11-21 13:19:07.289883639 +0000 UTC m=+5305.990545457" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.307378 4769 scope.go:117] "RemoveContainer" containerID="c462c45586bbc9a08ab9ab8bcf50b0e3c88e350d03f7f30b8e74ddff22014633" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.310324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1ac95b70-d511-44d0-b6f0-2f66169bbad4","Type":"ContainerStarted","Data":"6096e8bc4422d60d2481bc64037379546fc4f0ec6245e5f0c984b66eb753fdfd"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.316604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.320570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e73113de-3961-438d-acd9-886c2db72385","Type":"ContainerStarted","Data":"fb93df30b6001a9be0414bd1042aa0d363e8be222763a54a21ccbda58e264729"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.324679 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.324658435 podStartE2EDuration="5.324658435s" podCreationTimestamp="2025-11-21 13:19:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:07.32186337 +0000 UTC m=+5306.022525188" watchObservedRunningTime="2025-11-21 13:19:07.324658435 +0000 UTC m=+5306.025320253" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.349863 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerID="e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49" exitCode=0 Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.349907 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerID="70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3" exitCode=143 Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.349946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6a095e0f-f9e7-476e-a960-70f3365c77aa","Type":"ContainerDied","Data":"e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.349970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6a095e0f-f9e7-476e-a960-70f3365c77aa","Type":"ContainerDied","Data":"70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.350023 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.366335 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6"] Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.385922 4769 scope.go:117] "RemoveContainer" containerID="e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.388162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" event={"ID":"b728bee3-96ff-4142-9282-de05409ad732","Type":"ContainerStarted","Data":"5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.388239 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" event={"ID":"b728bee3-96ff-4142-9282-de05409ad732","Type":"ContainerStarted","Data":"de1bdc8ca6a0024e361e0fbe8edfcc538d188b4624b329fdc6e9a9ac52bee659"} Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.388290 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.388307 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.388420 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.389098 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-579b5f64d-k9xr6"] Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.392389 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.392368519 podStartE2EDuration="6.392368519s" podCreationTimestamp="2025-11-21 13:19:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:07.361183249 +0000 UTC m=+5306.061845057" watchObservedRunningTime="2025-11-21 13:19:07.392368519 +0000 UTC m=+5306.093030337" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.467628 4769 scope.go:117] "RemoveContainer" containerID="70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.473732 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" podStartSLOduration=2.473708951 podStartE2EDuration="2.473708951s" podCreationTimestamp="2025-11-21 13:19:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:07.428574155 +0000 UTC m=+5306.129235973" watchObservedRunningTime="2025-11-21 13:19:07.473708951 +0000 UTC m=+5306.174370769" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.484584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a095e0f-f9e7-476e-a960-70f3365c77aa-logs\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.484713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-scripts\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.484766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-combined-ca-bundle\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.484844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wxkm\" (UniqueName: \"kubernetes.io/projected/6a095e0f-f9e7-476e-a960-70f3365c77aa-kube-api-access-7wxkm\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.484917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6a095e0f-f9e7-476e-a960-70f3365c77aa-etc-machine-id\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.484959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-public-tls-certs\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.485000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-internal-tls-certs\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.485098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data-custom\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.485214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data\") pod \"6a095e0f-f9e7-476e-a960-70f3365c77aa\" (UID: \"6a095e0f-f9e7-476e-a960-70f3365c77aa\") " Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.486659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a095e0f-f9e7-476e-a960-70f3365c77aa-logs" (OuterVolumeSpecName: "logs") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.487006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6a095e0f-f9e7-476e-a960-70f3365c77aa-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.489101 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6a095e0f-f9e7-476e-a960-70f3365c77aa-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.489158 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6a095e0f-f9e7-476e-a960-70f3365c77aa-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.501063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a095e0f-f9e7-476e-a960-70f3365c77aa-kube-api-access-7wxkm" (OuterVolumeSpecName: "kube-api-access-7wxkm") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "kube-api-access-7wxkm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.505369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-scripts" (OuterVolumeSpecName: "scripts") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.515626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.529529 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.529502204 podStartE2EDuration="4.529502204s" podCreationTimestamp="2025-11-21 13:19:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:07.461255885 +0000 UTC m=+5306.161917703" watchObservedRunningTime="2025-11-21 13:19:07.529502204 +0000 UTC m=+5306.230164042" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.554522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data" (OuterVolumeSpecName: "config-data") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.560140 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.590132 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.590159 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.590167 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.590177 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.590202 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7wxkm\" (UniqueName: \"kubernetes.io/projected/6a095e0f-f9e7-476e-a960-70f3365c77aa-kube-api-access-7wxkm\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.627460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.636207 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6a095e0f-f9e7-476e-a960-70f3365c77aa" (UID: "6a095e0f-f9e7-476e-a960-70f3365c77aa"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.691122 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.691168 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a095e0f-f9e7-476e-a960-70f3365c77aa-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.736359 4769 scope.go:117] "RemoveContainer" containerID="e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49" Nov 21 13:19:07 crc kubenswrapper[4769]: E1121 13:19:07.740292 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49\": container with ID starting with e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49 not found: ID does not exist" containerID="e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.740331 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49"} err="failed to get container status \"e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49\": rpc error: code = NotFound desc = could not find container \"e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49\": container with ID starting with e4c777e719fee3dc419a701283bfc66565d8684ea1ff7907bad4f44a8fc91c49 not found: ID does not exist" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.740355 4769 scope.go:117] "RemoveContainer" containerID="70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.740415 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:07 crc kubenswrapper[4769]: E1121 13:19:07.742345 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3\": container with ID starting with 70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3 not found: ID does not exist" containerID="70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.742372 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3"} err="failed to get container status \"70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3\": rpc error: code = NotFound desc = could not find container \"70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3\": container with ID starting with 70e5767da9593ed09ad1d2e2ec4bdbe5376dc8d546a55cf10aab80536ed4aef3 not found: ID does not exist" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.753240 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.760910 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:07 crc kubenswrapper[4769]: E1121 13:19:07.761354 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761369 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api" Nov 21 13:19:07 crc kubenswrapper[4769]: E1121 13:19:07.761397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api-log" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761405 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api-log" Nov 21 13:19:07 crc kubenswrapper[4769]: E1121 13:19:07.761420 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api-log" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761426 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api-log" Nov 21 13:19:07 crc kubenswrapper[4769]: E1121 13:19:07.761435 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761442 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761622 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api-log" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761642 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761661 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" containerName="cinder-api" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.761670 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" containerName="barbican-api-log" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.766073 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.768168 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.768544 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.772049 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.778091 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.894907 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrnfr\" (UniqueName: \"kubernetes.io/projected/2914ed85-6d74-4ebc-ae7c-11417e874ab1-kube-api-access-wrnfr\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2914ed85-6d74-4ebc-ae7c-11417e874ab1-logs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data-custom\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895625 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-scripts\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.895866 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2914ed85-6d74-4ebc-ae7c-11417e874ab1-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2914ed85-6d74-4ebc-ae7c-11417e874ab1-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wrnfr\" (UniqueName: \"kubernetes.io/projected/2914ed85-6d74-4ebc-ae7c-11417e874ab1-kube-api-access-wrnfr\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997782 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2914ed85-6d74-4ebc-ae7c-11417e874ab1-etc-machine-id\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997792 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997874 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2914ed85-6d74-4ebc-ae7c-11417e874ab1-logs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data-custom\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.997955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.998019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-scripts\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:07 crc kubenswrapper[4769]: I1121 13:19:07.998348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2914ed85-6d74-4ebc-ae7c-11417e874ab1-logs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.357089 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.357145 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.357154 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.357880 4769 scope.go:117] "RemoveContainer" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:19:08 crc kubenswrapper[4769]: E1121 13:19:08.358104 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.426717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" event={"ID":"b728bee3-96ff-4142-9282-de05409ad732","Type":"ContainerStarted","Data":"3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198"} Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.484920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.485687 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-scripts\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.485940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data-custom\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.486951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.487033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.487167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-public-tls-certs\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.488250 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrnfr\" (UniqueName: \"kubernetes.io/projected/2914ed85-6d74-4ebc-ae7c-11417e874ab1-kube-api-access-wrnfr\") pod \"cinder-api-0\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.661180 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.661326 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:08 crc kubenswrapper[4769]: I1121 13:19:08.691599 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.176901 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.291947 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db51a88-4aed-4420-8340-40dea3c7dcd4" path="/var/lib/kubelet/pods/4db51a88-4aed-4420-8340-40dea3c7dcd4/volumes" Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.292767 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a095e0f-f9e7-476e-a960-70f3365c77aa" path="/var/lib/kubelet/pods/6a095e0f-f9e7-476e-a960-70f3365c77aa/volumes" Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.493230 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2914ed85-6d74-4ebc-ae7c-11417e874ab1","Type":"ContainerStarted","Data":"4fd19754b7fb6879de97b13491fd0d060177a0097e4af29b7809e36c31db0dc6"} Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.501031 4769 generic.go:334] "Generic (PLEG): container finished" podID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" exitCode=1 Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.501077 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerDied","Data":"33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee"} Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.501908 4769 scope.go:117] "RemoveContainer" containerID="de91d42f7919adbe8e6994df752928615ecfb8b5f01ddd78bb75793c39df09a2" Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.502752 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:19:09 crc kubenswrapper[4769]: E1121 13:19:09.503007 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:19:09 crc kubenswrapper[4769]: I1121 13:19:09.549984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:19:10 crc kubenswrapper[4769]: I1121 13:19:10.513574 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2914ed85-6d74-4ebc-ae7c-11417e874ab1","Type":"ContainerStarted","Data":"43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de"} Nov 21 13:19:10 crc kubenswrapper[4769]: I1121 13:19:10.517955 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:19:10 crc kubenswrapper[4769]: E1121 13:19:10.518448 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:19:11 crc kubenswrapper[4769]: I1121 13:19:11.275728 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:19:11 crc kubenswrapper[4769]: E1121 13:19:11.276372 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:19:11 crc kubenswrapper[4769]: I1121 13:19:11.549781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2914ed85-6d74-4ebc-ae7c-11417e874ab1","Type":"ContainerStarted","Data":"48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6"} Nov 21 13:19:11 crc kubenswrapper[4769]: I1121 13:19:11.549919 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:11 crc kubenswrapper[4769]: I1121 13:19:11.577595 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.577572236 podStartE2EDuration="4.577572236s" podCreationTimestamp="2025-11-21 13:19:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:11.570096952 +0000 UTC m=+5310.270758770" watchObservedRunningTime="2025-11-21 13:19:11.577572236 +0000 UTC m=+5310.278234054" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.310821 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.310884 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.372416 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.372492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.388707 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.417084 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.421617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.462316 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.552991 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.553041 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.562127 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.562175 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.579165 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.628954 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:12 crc kubenswrapper[4769]: I1121 13:19:12.638647 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.293402 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.293667 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-notification-agent" containerID="cri-o://c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594" gracePeriod=30 Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.293717 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-central-agent" containerID="cri-o://d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b" gracePeriod=30 Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.293761 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="sg-core" containerID="cri-o://9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580" gracePeriod=30 Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.293799 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="proxy-httpd" containerID="cri-o://23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc" gracePeriod=30 Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.323389 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.151:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.323400 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.151:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.616535 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerID="9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580" exitCode=2 Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.616662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerDied","Data":"9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580"} Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.618080 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.618125 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.661296 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:13 crc kubenswrapper[4769]: I1121 13:19:13.661354 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.162263 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.273949 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:19:14 crc kubenswrapper[4769]: E1121 13:19:14.274440 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.629083 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerID="d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b" exitCode=0 Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.629113 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerID="23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc" exitCode=0 Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.629125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerDied","Data":"d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b"} Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.629213 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.629222 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.629310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerDied","Data":"23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc"} Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.673462 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.156:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.673762 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.156:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.814554 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.886607 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b5647db7d-6q5bl"] Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.886836 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-log" containerID="cri-o://5b37a5f3d9412e7de70fb89cb6b4fcf423e309f767aa02eb0540c22ec835f952" gracePeriod=30 Nov 21 13:19:14 crc kubenswrapper[4769]: I1121 13:19:14.887234 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-api" containerID="cri-o://847021ad5e806201b166db6b08e694348b3111943706a7e60c22a2492b92b982" gracePeriod=30 Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.639432 4769 generic.go:334] "Generic (PLEG): container finished" podID="7658f401-2091-41a5-834d-eb052f71924b" containerID="5b37a5f3d9412e7de70fb89cb6b4fcf423e309f767aa02eb0540c22ec835f952" exitCode=143 Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.639781 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.639790 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.639611 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" event={"ID":"7658f401-2091-41a5-834d-eb052f71924b","Type":"ContainerDied","Data":"5b37a5f3d9412e7de70fb89cb6b4fcf423e309f767aa02eb0540c22ec835f952"} Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.659728 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.659842 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:19:15 crc kubenswrapper[4769]: I1121 13:19:15.662522 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.040370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.041678 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.419363 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494288 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-run-httpd\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494403 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-log-httpd\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-scripts\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-combined-ca-bundle\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-sg-core-conf-yaml\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494725 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-ceilometer-tls-certs\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-config-data\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.494825 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj5tb\" (UniqueName: \"kubernetes.io/projected/f1009742-1d7e-44b0-b3ed-690da05e8e41-kube-api-access-gj5tb\") pod \"f1009742-1d7e-44b0-b3ed-690da05e8e41\" (UID: \"f1009742-1d7e-44b0-b3ed-690da05e8e41\") " Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.495045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.495773 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.495792 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f1009742-1d7e-44b0-b3ed-690da05e8e41-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.501473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1009742-1d7e-44b0-b3ed-690da05e8e41-kube-api-access-gj5tb" (OuterVolumeSpecName: "kube-api-access-gj5tb") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "kube-api-access-gj5tb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.505314 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-scripts" (OuterVolumeSpecName: "scripts") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.585290 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.602402 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gj5tb\" (UniqueName: \"kubernetes.io/projected/f1009742-1d7e-44b0-b3ed-690da05e8e41-kube-api-access-gj5tb\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.602438 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.602447 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.618368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.664225 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerID="c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594" exitCode=0 Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.665242 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.665471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerDied","Data":"c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594"} Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.665513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f1009742-1d7e-44b0-b3ed-690da05e8e41","Type":"ContainerDied","Data":"9932763396c7c0ebdce2613ee4c4810f0ae0e89e939bef144a6302daa07afea6"} Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.665535 4769 scope.go:117] "RemoveContainer" containerID="9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.686407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-config-data" (OuterVolumeSpecName: "config-data") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.704209 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.704243 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.705471 4769 scope.go:117] "RemoveContainer" containerID="d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.737602 4769 scope.go:117] "RemoveContainer" containerID="23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.744374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1009742-1d7e-44b0-b3ed-690da05e8e41" (UID: "f1009742-1d7e-44b0-b3ed-690da05e8e41"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.769221 4769 scope.go:117] "RemoveContainer" containerID="c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.798129 4769 scope.go:117] "RemoveContainer" containerID="9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580" Nov 21 13:19:16 crc kubenswrapper[4769]: E1121 13:19:16.800553 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580\": container with ID starting with 9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580 not found: ID does not exist" containerID="9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.800600 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580"} err="failed to get container status \"9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580\": rpc error: code = NotFound desc = could not find container \"9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580\": container with ID starting with 9df94b76965e7b01b44c5a19c1f8b061ef3267348f6bbf6ddf9bd267224a0580 not found: ID does not exist" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.800628 4769 scope.go:117] "RemoveContainer" containerID="d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b" Nov 21 13:19:16 crc kubenswrapper[4769]: E1121 13:19:16.801013 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b\": container with ID starting with d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b not found: ID does not exist" containerID="d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.801041 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b"} err="failed to get container status \"d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b\": rpc error: code = NotFound desc = could not find container \"d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b\": container with ID starting with d78d67bf6c25364efa6d2782cdd93572538d6431eb8d84ab39cc325e2b00df9b not found: ID does not exist" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.801055 4769 scope.go:117] "RemoveContainer" containerID="23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc" Nov 21 13:19:16 crc kubenswrapper[4769]: E1121 13:19:16.801314 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc\": container with ID starting with 23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc not found: ID does not exist" containerID="23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.801339 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc"} err="failed to get container status \"23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc\": rpc error: code = NotFound desc = could not find container \"23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc\": container with ID starting with 23276e492bde4b34184ba2c67391d1c2230479d57b60dd4ec7c79ebe3fbe01bc not found: ID does not exist" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.801353 4769 scope.go:117] "RemoveContainer" containerID="c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594" Nov 21 13:19:16 crc kubenswrapper[4769]: E1121 13:19:16.801569 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594\": container with ID starting with c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594 not found: ID does not exist" containerID="c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.801593 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594"} err="failed to get container status \"c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594\": rpc error: code = NotFound desc = could not find container \"c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594\": container with ID starting with c2a6e0167a78c0bfcc41ceb78dc48e94d4d1936c52db0f10cb2b1effe519a594 not found: ID does not exist" Nov 21 13:19:16 crc kubenswrapper[4769]: I1121 13:19:16.805559 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1009742-1d7e-44b0-b3ed-690da05e8e41-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.001677 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.017850 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.029787 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:17 crc kubenswrapper[4769]: E1121 13:19:17.030175 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="sg-core" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030219 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="sg-core" Nov 21 13:19:17 crc kubenswrapper[4769]: E1121 13:19:17.030240 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-notification-agent" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030246 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-notification-agent" Nov 21 13:19:17 crc kubenswrapper[4769]: E1121 13:19:17.030280 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="proxy-httpd" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030287 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="proxy-httpd" Nov 21 13:19:17 crc kubenswrapper[4769]: E1121 13:19:17.030301 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-central-agent" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030307 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-central-agent" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030481 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="sg-core" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030509 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="proxy-httpd" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030523 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-central-agent" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.030534 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" containerName="ceilometer-notification-agent" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.032172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.034627 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.035357 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.066522 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.103265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.212758 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.212859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-scripts\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.213720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnqdw\" (UniqueName: \"kubernetes.io/projected/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-kube-api-access-cnqdw\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.213795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.213869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-config-data\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.213936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-log-httpd\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.214014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-run-httpd\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.214042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.286489 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1009742-1d7e-44b0-b3ed-690da05e8e41" path="/var/lib/kubelet/pods/f1009742-1d7e-44b0-b3ed-690da05e8e41/volumes" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315233 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-config-data\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315290 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-log-httpd\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-run-httpd\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315921 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-run-httpd\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-log-httpd\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.315954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-scripts\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.316643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cnqdw\" (UniqueName: \"kubernetes.io/projected/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-kube-api-access-cnqdw\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.316693 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.323798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-config-data\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.326084 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.327173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-scripts\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.328691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.341713 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.351907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnqdw\" (UniqueName: \"kubernetes.io/projected/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-kube-api-access-cnqdw\") pod \"ceilometer-0\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.359743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.763813 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:17 crc kubenswrapper[4769]: I1121 13:19:17.896364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.180321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.235118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5"] Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.235423 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api-log" containerID="cri-o://23ccda9b087fd680e768137e483901727a68450f675d8f2ef6157d28893f6801" gracePeriod=30 Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.235585 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api" containerID="cri-o://0d05fe9f89fd92a1ae7e80c040c3ad662e3fcc554593635eedb1fee44c542ca1" gracePeriod=30 Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.729487 4769 generic.go:334] "Generic (PLEG): container finished" podID="7658f401-2091-41a5-834d-eb052f71924b" containerID="847021ad5e806201b166db6b08e694348b3111943706a7e60c22a2492b92b982" exitCode=0 Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.729935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" event={"ID":"7658f401-2091-41a5-834d-eb052f71924b","Type":"ContainerDied","Data":"847021ad5e806201b166db6b08e694348b3111943706a7e60c22a2492b92b982"} Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.735120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerStarted","Data":"88616ca1766430307e56559e01dae2bc6b2ed07a403d7b7bf524d01fb56a1847"} Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.738595 4769 generic.go:334] "Generic (PLEG): container finished" podID="797d3cd9-6063-4c91-8d90-5628845039e8" containerID="23ccda9b087fd680e768137e483901727a68450f675d8f2ef6157d28893f6801" exitCode=143 Nov 21 13:19:18 crc kubenswrapper[4769]: I1121 13:19:18.739552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" event={"ID":"797d3cd9-6063-4c91-8d90-5628845039e8","Type":"ContainerDied","Data":"23ccda9b087fd680e768137e483901727a68450f675d8f2ef6157d28893f6801"} Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.237455 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-internal-tls-certs\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367501 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-combined-ca-bundle\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-config-data\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-public-tls-certs\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367626 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7658f401-2091-41a5-834d-eb052f71924b-logs\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gqs9\" (UniqueName: \"kubernetes.io/projected/7658f401-2091-41a5-834d-eb052f71924b-kube-api-access-7gqs9\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.367766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-scripts\") pod \"7658f401-2091-41a5-834d-eb052f71924b\" (UID: \"7658f401-2091-41a5-834d-eb052f71924b\") " Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.369836 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7658f401-2091-41a5-834d-eb052f71924b-logs" (OuterVolumeSpecName: "logs") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.374414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-scripts" (OuterVolumeSpecName: "scripts") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.375863 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7658f401-2091-41a5-834d-eb052f71924b-kube-api-access-7gqs9" (OuterVolumeSpecName: "kube-api-access-7gqs9") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "kube-api-access-7gqs9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.444304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.446348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-config-data" (OuterVolumeSpecName: "config-data") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.471273 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7658f401-2091-41a5-834d-eb052f71924b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.471314 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7gqs9\" (UniqueName: \"kubernetes.io/projected/7658f401-2091-41a5-834d-eb052f71924b-kube-api-access-7gqs9\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.471329 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.471343 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.471354 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.489921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.493410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7658f401-2091-41a5-834d-eb052f71924b" (UID: "7658f401-2091-41a5-834d-eb052f71924b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.572967 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.573292 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7658f401-2091-41a5-834d-eb052f71924b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.749564 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.749601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-5b5647db7d-6q5bl" event={"ID":"7658f401-2091-41a5-834d-eb052f71924b","Type":"ContainerDied","Data":"e1db582b041119533c1ae8233ccb474d9d6cb77a420befc0a45244ee1cde8d6b"} Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.749668 4769 scope.go:117] "RemoveContainer" containerID="847021ad5e806201b166db6b08e694348b3111943706a7e60c22a2492b92b982" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.751993 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerStarted","Data":"8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423"} Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.780249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-5b5647db7d-6q5bl"] Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.787425 4769 scope.go:117] "RemoveContainer" containerID="5b37a5f3d9412e7de70fb89cb6b4fcf423e309f767aa02eb0540c22ec835f952" Nov 21 13:19:19 crc kubenswrapper[4769]: I1121 13:19:19.792996 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-5b5647db7d-6q5bl"] Nov 21 13:19:20 crc kubenswrapper[4769]: I1121 13:19:20.763743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerStarted","Data":"b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f"} Nov 21 13:19:20 crc kubenswrapper[4769]: I1121 13:19:20.851943 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.285022 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7658f401-2091-41a5-834d-eb052f71924b" path="/var/lib/kubelet/pods/7658f401-2091-41a5-834d-eb052f71924b/volumes" Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.687468 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.134:9311/healthcheck\": dial tcp 10.217.0.134:9311: connect: connection refused" Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.691277 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.134:9311/healthcheck\": dial tcp 10.217.0.134:9311: connect: connection refused" Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.784131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerStarted","Data":"39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb"} Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.788886 4769 generic.go:334] "Generic (PLEG): container finished" podID="797d3cd9-6063-4c91-8d90-5628845039e8" containerID="0d05fe9f89fd92a1ae7e80c040c3ad662e3fcc554593635eedb1fee44c542ca1" exitCode=0 Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.788924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" event={"ID":"797d3cd9-6063-4c91-8d90-5628845039e8","Type":"ContainerDied","Data":"0d05fe9f89fd92a1ae7e80c040c3ad662e3fcc554593635eedb1fee44c542ca1"} Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.905894 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.984319 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-75dc7ff446-mqw8n"] Nov 21 13:19:21 crc kubenswrapper[4769]: I1121 13:19:21.984931 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" podUID="23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" containerName="keystone-api" containerID="cri-o://bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409" gracePeriod=30 Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.028041 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.121701 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data-custom\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.121805 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-combined-ca-bundle\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.121874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-internal-tls-certs\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.121904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kgr5\" (UniqueName: \"kubernetes.io/projected/797d3cd9-6063-4c91-8d90-5628845039e8-kube-api-access-6kgr5\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.121925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/797d3cd9-6063-4c91-8d90-5628845039e8-logs\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.121956 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.122104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-public-tls-certs\") pod \"797d3cd9-6063-4c91-8d90-5628845039e8\" (UID: \"797d3cd9-6063-4c91-8d90-5628845039e8\") " Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.125098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/797d3cd9-6063-4c91-8d90-5628845039e8-logs" (OuterVolumeSpecName: "logs") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.131364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/797d3cd9-6063-4c91-8d90-5628845039e8-kube-api-access-6kgr5" (OuterVolumeSpecName: "kube-api-access-6kgr5") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "kube-api-access-6kgr5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.132275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.157312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.177279 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.180276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.205454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data" (OuterVolumeSpecName: "config-data") pod "797d3cd9-6063-4c91-8d90-5628845039e8" (UID: "797d3cd9-6063-4c91-8d90-5628845039e8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225357 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225394 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6kgr5\" (UniqueName: \"kubernetes.io/projected/797d3cd9-6063-4c91-8d90-5628845039e8-kube-api-access-6kgr5\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225405 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/797d3cd9-6063-4c91-8d90-5628845039e8-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225414 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225427 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225436 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.225444 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/797d3cd9-6063-4c91-8d90-5628845039e8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.274660 4769 scope.go:117] "RemoveContainer" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.274758 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:19:22 crc kubenswrapper[4769]: E1121 13:19:22.274935 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-scheduler-scheduler\" with CrashLoopBackOff: \"back-off 20s restarting failed container=nova-scheduler-scheduler pod=nova-scheduler-0_openstack-kuttl-tests(2614f647-50de-416e-afe3-7b658b34092e)\"" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" Nov 21 13:19:22 crc kubenswrapper[4769]: E1121 13:19:22.275020 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.322160 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.322284 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.322613 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.322666 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.328523 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.328656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.809605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerStarted","Data":"5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1"} Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.809810 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.812097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" event={"ID":"797d3cd9-6063-4c91-8d90-5628845039e8","Type":"ContainerDied","Data":"658871fcd716c1dec5630370863f1534bb45bd158463099bb42f4da8cc832c77"} Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.812143 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.812274 4769 scope.go:117] "RemoveContainer" containerID="0d05fe9f89fd92a1ae7e80c040c3ad662e3fcc554593635eedb1fee44c542ca1" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.840161 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.211954204 podStartE2EDuration="5.840148065s" podCreationTimestamp="2025-11-21 13:19:17 +0000 UTC" firstStartedPulling="2025-11-21 13:19:17.915578795 +0000 UTC m=+5316.616240613" lastFinishedPulling="2025-11-21 13:19:22.543772656 +0000 UTC m=+5321.244434474" observedRunningTime="2025-11-21 13:19:22.836849719 +0000 UTC m=+5321.537511527" watchObservedRunningTime="2025-11-21 13:19:22.840148065 +0000 UTC m=+5321.540809883" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.868247 4769 scope.go:117] "RemoveContainer" containerID="23ccda9b087fd680e768137e483901727a68450f675d8f2ef6157d28893f6801" Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.871391 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5"] Nov 21 13:19:22 crc kubenswrapper[4769]: I1121 13:19:22.886116 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-748fd86b66-5pcr5"] Nov 21 13:19:23 crc kubenswrapper[4769]: I1121 13:19:23.314357 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" path="/var/lib/kubelet/pods/797d3cd9-6063-4c91-8d90-5628845039e8/volumes" Nov 21 13:19:23 crc kubenswrapper[4769]: I1121 13:19:23.666257 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:23 crc kubenswrapper[4769]: I1121 13:19:23.667553 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:23 crc kubenswrapper[4769]: I1121 13:19:23.673047 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:23 crc kubenswrapper[4769]: I1121 13:19:23.831224 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.273912 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.274690 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell1-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell1-conductor-conductor pod=nova-cell1-conductor-0_openstack-kuttl-tests(0ef4ab46-7a06-41be-ae29-ebc45d686505)\"" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.593373 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.715808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-config-data\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.715966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-combined-ca-bundle\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.715991 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-public-tls-certs\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.716016 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhwqg\" (UniqueName: \"kubernetes.io/projected/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-kube-api-access-fhwqg\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.716054 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-fernet-keys\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.716093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-scripts\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.716153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-internal-tls-certs\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.716225 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-credential-keys\") pod \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\" (UID: \"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a\") " Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.725476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.738114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.738262 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-kube-api-access-fhwqg" (OuterVolumeSpecName: "kube-api-access-fhwqg") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "kube-api-access-fhwqg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.753470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-scripts" (OuterVolumeSpecName: "scripts") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.783115 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.786593 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" containerName="keystone-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.786634 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" containerName="keystone-api" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.786660 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.786680 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.786710 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-log" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.786719 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-log" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.786742 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api-log" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.786749 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api-log" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.786779 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.786787 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.787041 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.787078 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-log" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.787091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="797d3cd9-6063-4c91-8d90-5628845039e8" containerName="barbican-api-log" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.787112 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7658f401-2091-41a5-834d-eb052f71924b" containerName="placement-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.787143 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" containerName="keystone-api" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.787548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-config-data" (OuterVolumeSpecName: "config-data") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.789505 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:25 crc kubenswrapper[4769]: W1121 13:19:25.793568 4769 reflector.go:561] object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-g5sxb": failed to list *v1.Secret: secrets "openstackclient-openstackclient-dockercfg-g5sxb" is forbidden: User "system:node:crc" cannot list resource "secrets" in API group "" in the namespace "openstack-kuttl-tests": no relationship found between node 'crc' and this object Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.793620 4769 reflector.go:158] "Unhandled Error" err="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-g5sxb\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"openstackclient-openstackclient-dockercfg-g5sxb\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 13:19:25 crc kubenswrapper[4769]: W1121 13:19:25.793731 4769 reflector.go:561] object-"openstack-kuttl-tests"/"openstack-config-secret": failed to list *v1.Secret: secrets "openstack-config-secret" is forbidden: User "system:node:crc" cannot list resource "secrets" in API group "" in the namespace "openstack-kuttl-tests": no relationship found between node 'crc' and this object Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.793750 4769 reflector.go:158] "Unhandled Error" err="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"openstack-config-secret\" is forbidden: User \"system:node:crc\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 13:19:25 crc kubenswrapper[4769]: W1121 13:19:25.794507 4769 reflector.go:561] object-"openstack-kuttl-tests"/"openstack-config": failed to list *v1.ConfigMap: configmaps "openstack-config" is forbidden: User "system:node:crc" cannot list resource "configmaps" in API group "" in the namespace "openstack-kuttl-tests": no relationship found between node 'crc' and this object Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.794538 4769 reflector.go:158] "Unhandled Error" err="object-\"openstack-kuttl-tests\"/\"openstack-config\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"openstack-config\" is forbidden: User \"system:node:crc\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" logger="UnhandledError" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.819119 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.819159 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.819178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fhwqg\" (UniqueName: \"kubernetes.io/projected/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-kube-api-access-fhwqg\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.819243 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.819256 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.819249 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.822494 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.828325 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.829901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.846182 4769 generic.go:334] "Generic (PLEG): container finished" podID="23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" containerID="bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409" exitCode=0 Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.846422 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.846463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" event={"ID":"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a","Type":"ContainerDied","Data":"bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409"} Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.846520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-75dc7ff446-mqw8n" event={"ID":"23a3a7a5-04b7-49ce-bca1-3af43e17cc5a","Type":"ContainerDied","Data":"18a80cd0de80c8e4fa19b23f29342503be80afedcb40e784c58ca0a5b560bf5a"} Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.846537 4769 scope.go:117] "RemoveContainer" containerID="bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.852333 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e661d232-9d61-4d34-981e-8ed97c577dc3" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.852785 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-xf6j8 openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="e661d232-9d61-4d34-981e-8ed97c577dc3" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.853916 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.872966 4769 scope.go:117] "RemoveContainer" containerID="bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409" Nov 21 13:19:25 crc kubenswrapper[4769]: E1121 13:19:25.873581 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409\": container with ID starting with bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409 not found: ID does not exist" containerID="bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.873707 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409"} err="failed to get container status \"bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409\": rpc error: code = NotFound desc = could not find container \"bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409\": container with ID starting with bcb2e6d6b33d421f1ad5bd40c8dbab81b63b66a46372fb7a67c85116e7d00409 not found: ID does not exist" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.874530 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.874561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" (UID: "23a3a7a5-04b7-49ce-bca1-3af43e17cc5a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.875964 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.883470 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.920781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config-secret\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.920834 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.920863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6j8\" (UniqueName: \"kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.921003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.921167 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.921181 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:25 crc kubenswrapper[4769]: I1121 13:19:25.921238 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.023359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xplv2\" (UniqueName: \"kubernetes.io/projected/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-kube-api-access-xplv2\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.023654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.023841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config-secret\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.023968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.024083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6j8\" (UniqueName: \"kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.024210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.024332 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.024468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: E1121 13:19:26.026826 4769 projected.go:194] Error preparing data for projected volume kube-api-access-xf6j8 for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (e661d232-9d61-4d34-981e-8ed97c577dc3) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:19:26 crc kubenswrapper[4769]: E1121 13:19:26.026894 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8 podName:e661d232-9d61-4d34-981e-8ed97c577dc3 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:26.526873969 +0000 UTC m=+5325.227535887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xf6j8" (UniqueName: "kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8") pod "openstackclient" (UID: "e661d232-9d61-4d34-981e-8ed97c577dc3") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (e661d232-9d61-4d34-981e-8ed97c577dc3) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.029417 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.127024 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xplv2\" (UniqueName: \"kubernetes.io/projected/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-kube-api-access-xplv2\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.127103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.127182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.127247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.131420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-combined-ca-bundle\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.150519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xplv2\" (UniqueName: \"kubernetes.io/projected/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-kube-api-access-xplv2\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.190087 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-75dc7ff446-mqw8n"] Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.198931 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-75dc7ff446-mqw8n"] Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.536489 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6j8\" (UniqueName: \"kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8\") pod \"openstackclient\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: E1121 13:19:26.538315 4769 projected.go:194] Error preparing data for projected volume kube-api-access-xf6j8 for pod openstack-kuttl-tests/openstackclient: failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (e661d232-9d61-4d34-981e-8ed97c577dc3) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:19:26 crc kubenswrapper[4769]: E1121 13:19:26.538378 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8 podName:e661d232-9d61-4d34-981e-8ed97c577dc3 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:27.538359781 +0000 UTC m=+5326.239021599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xf6j8" (UniqueName: "kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8") pod "openstackclient" (UID: "e661d232-9d61-4d34-981e-8ed97c577dc3") : failed to fetch token: serviceaccounts "openstackclient-openstackclient" is forbidden: the UID in the bound object reference (e661d232-9d61-4d34-981e-8ed97c577dc3) does not match the UID in record. The object might have been deleted and then recreated Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.794736 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-g5sxb" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.860891 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.867328 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e661d232-9d61-4d34-981e-8ed97c577dc3" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.870596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:26 crc kubenswrapper[4769]: I1121 13:19:26.873855 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e661d232-9d61-4d34-981e-8ed97c577dc3" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.024370 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/openstack-config-secret: failed to sync secret cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.024459 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config-secret podName:e661d232-9d61-4d34-981e-8ed97c577dc3 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:27.524438414 +0000 UTC m=+5326.225100252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openstack-config-secret" (UniqueName: "kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config-secret") pod "openstackclient" (UID: "e661d232-9d61-4d34-981e-8ed97c577dc3") : failed to sync secret cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.025856 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-config: failed to sync configmap cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.025908 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config podName:e661d232-9d61-4d34-981e-8ed97c577dc3 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:27.525892932 +0000 UTC m=+5326.226554760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openstack-config" (UniqueName: "kubernetes.io/configmap/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config") pod "openstackclient" (UID: "e661d232-9d61-4d34-981e-8ed97c577dc3") : failed to sync configmap cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.046844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-combined-ca-bundle\") pod \"e661d232-9d61-4d34-981e-8ed97c577dc3\" (UID: \"e661d232-9d61-4d34-981e-8ed97c577dc3\") " Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.047574 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.047599 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xf6j8\" (UniqueName: \"kubernetes.io/projected/e661d232-9d61-4d34-981e-8ed97c577dc3-kube-api-access-xf6j8\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.047614 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.058758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e661d232-9d61-4d34-981e-8ed97c577dc3" (UID: "e661d232-9d61-4d34-981e-8ed97c577dc3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.128074 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/openstack-config-secret: failed to sync secret cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.128136 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-config: failed to sync configmap cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.128166 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret podName:e8bcf3a2-8158-4c12-85da-4ea99b70bfc1 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:27.628146841 +0000 UTC m=+5326.328808659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openstack-config-secret" (UniqueName: "kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret") pod "openstackclient" (UID: "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1") : failed to sync secret cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: E1121 13:19:27.128237 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config podName:e8bcf3a2-8158-4c12-85da-4ea99b70bfc1 nodeName:}" failed. No retries permitted until 2025-11-21 13:19:27.628215663 +0000 UTC m=+5326.328877491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openstack-config" (UniqueName: "kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config") pod "openstackclient" (UID: "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1") : failed to sync configmap cache: timed out waiting for the condition Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.150486 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e661d232-9d61-4d34-981e-8ed97c577dc3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.298406 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a3a7a5-04b7-49ce-bca1-3af43e17cc5a" path="/var/lib/kubelet/pods/23a3a7a5-04b7-49ce-bca1-3af43e17cc5a/volumes" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.299271 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e661d232-9d61-4d34-981e-8ed97c577dc3" path="/var/lib/kubelet/pods/e661d232-9d61-4d34-981e-8ed97c577dc3/volumes" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.365676 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.379612 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.672817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.673168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.674090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.677706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret\") pod \"openstackclient\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.698276 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.873572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.878260 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e661d232-9d61-4d34-981e-8ed97c577dc3" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" Nov 21 13:19:27 crc kubenswrapper[4769]: I1121 13:19:27.884527 4769 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e661d232-9d61-4d34-981e-8ed97c577dc3" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" Nov 21 13:19:28 crc kubenswrapper[4769]: I1121 13:19:28.011166 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:19:28 crc kubenswrapper[4769]: W1121 13:19:28.014815 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8bcf3a2_8158_4c12_85da_4ea99b70bfc1.slice/crio-fc7c4d19a6b38dc1c2aea5b7ad71504e25c141f35793aa63550030043b576b82 WatchSource:0}: Error finding container fc7c4d19a6b38dc1c2aea5b7ad71504e25c141f35793aa63550030043b576b82: Status 404 returned error can't find the container with id fc7c4d19a6b38dc1c2aea5b7ad71504e25c141f35793aa63550030043b576b82 Nov 21 13:19:28 crc kubenswrapper[4769]: I1121 13:19:28.887697 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1","Type":"ContainerStarted","Data":"430453e445cddd84bb821265e71641462e43cb6e3ead94e9f3f1b29b37f4882f"} Nov 21 13:19:28 crc kubenswrapper[4769]: I1121 13:19:28.888446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1","Type":"ContainerStarted","Data":"fc7c4d19a6b38dc1c2aea5b7ad71504e25c141f35793aa63550030043b576b82"} Nov 21 13:19:28 crc kubenswrapper[4769]: I1121 13:19:28.906214 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=3.906182158 podStartE2EDuration="3.906182158s" podCreationTimestamp="2025-11-21 13:19:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:28.904281689 +0000 UTC m=+5327.604943507" watchObservedRunningTime="2025-11-21 13:19:28.906182158 +0000 UTC m=+5327.606843976" Nov 21 13:19:29 crc kubenswrapper[4769]: I1121 13:19:29.280020 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:19:29 crc kubenswrapper[4769]: E1121 13:19:29.280398 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:19:30 crc kubenswrapper[4769]: E1121 13:19:30.817492 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9974304e_9420_484d_83e8_996cd607775e.slice/crio-88a3098d4de1963c4bb87da7f38369cee6007d6fac475005c87672c631e8c57a.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:19:30 crc kubenswrapper[4769]: I1121 13:19:30.914781 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-677956c48d-qmjsd_9974304e-9420-484d-83e8-996cd607775e/neutron-api/0.log" Nov 21 13:19:30 crc kubenswrapper[4769]: I1121 13:19:30.914836 4769 generic.go:334] "Generic (PLEG): container finished" podID="9974304e-9420-484d-83e8-996cd607775e" containerID="88a3098d4de1963c4bb87da7f38369cee6007d6fac475005c87672c631e8c57a" exitCode=137 Nov 21 13:19:30 crc kubenswrapper[4769]: I1121 13:19:30.914869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" event={"ID":"9974304e-9420-484d-83e8-996cd607775e","Type":"ContainerDied","Data":"88a3098d4de1963c4bb87da7f38369cee6007d6fac475005c87672c631e8c57a"} Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.286011 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-677956c48d-qmjsd_9974304e-9420-484d-83e8-996cd607775e/neutron-api/0.log" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.286076 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357580 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-config\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357709 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-ovndb-tls-certs\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-public-tls-certs\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgr28\" (UniqueName: \"kubernetes.io/projected/9974304e-9420-484d-83e8-996cd607775e-kube-api-access-qgr28\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-internal-tls-certs\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-combined-ca-bundle\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.357990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-httpd-config\") pod \"9974304e-9420-484d-83e8-996cd607775e\" (UID: \"9974304e-9420-484d-83e8-996cd607775e\") " Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.363327 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.386531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9974304e-9420-484d-83e8-996cd607775e-kube-api-access-qgr28" (OuterVolumeSpecName: "kube-api-access-qgr28") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "kube-api-access-qgr28". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.426622 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.432246 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.436856 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.448896 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-config" (OuterVolumeSpecName: "config") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.460309 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.460349 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.460365 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qgr28\" (UniqueName: \"kubernetes.io/projected/9974304e-9420-484d-83e8-996cd607775e-kube-api-access-qgr28\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.460391 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.460400 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.460409 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.479237 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "9974304e-9420-484d-83e8-996cd607775e" (UID: "9974304e-9420-484d-83e8-996cd607775e"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.561809 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9974304e-9420-484d-83e8-996cd607775e-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.606142 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4"] Nov 21 13:19:31 crc kubenswrapper[4769]: E1121 13:19:31.606549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-httpd" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.606564 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-httpd" Nov 21 13:19:31 crc kubenswrapper[4769]: E1121 13:19:31.606602 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-api" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.606608 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-api" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.606814 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-httpd" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.606852 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9974304e-9420-484d-83e8-996cd607775e" containerName="neutron-api" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.607916 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.624869 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4"] Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.663861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zqh\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-kube-api-access-r8zqh\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.663910 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-log-httpd\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.663943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-internal-tls-certs\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.663961 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-combined-ca-bundle\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.664003 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-etc-swift\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.664028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-run-httpd\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.664070 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-config-data\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.664095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-public-tls-certs\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.765817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zqh\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-kube-api-access-r8zqh\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.765886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-log-httpd\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.765927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-internal-tls-certs\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.765947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-combined-ca-bundle\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.765993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-etc-swift\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.766026 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-run-httpd\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.766071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-config-data\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.766091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-public-tls-certs\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.767267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-run-httpd\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.767383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-log-httpd\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.770234 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-internal-tls-certs\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.770696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-combined-ca-bundle\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.773076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-etc-swift\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.773727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-config-data\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.774354 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-public-tls-certs\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.791773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zqh\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-kube-api-access-r8zqh\") pod \"swift-proxy-85df7b9854-wwmc4\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.926711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.942116 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-677956c48d-qmjsd_9974304e-9420-484d-83e8-996cd607775e/neutron-api/0.log" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.942365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" event={"ID":"9974304e-9420-484d-83e8-996cd607775e","Type":"ContainerDied","Data":"91a12b7861f49ee9349fd9f301965573b6fcae5c75d181bf605cdfb858bfe01d"} Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.942418 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-677956c48d-qmjsd" Nov 21 13:19:31 crc kubenswrapper[4769]: I1121 13:19:31.942526 4769 scope.go:117] "RemoveContainer" containerID="f9476e9de41a7b3d04b8cc568338310fcadfcab6112de4eab5b2abf58c425d1d" Nov 21 13:19:32 crc kubenswrapper[4769]: I1121 13:19:32.054276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-677956c48d-qmjsd"] Nov 21 13:19:32 crc kubenswrapper[4769]: I1121 13:19:32.055322 4769 scope.go:117] "RemoveContainer" containerID="88a3098d4de1963c4bb87da7f38369cee6007d6fac475005c87672c631e8c57a" Nov 21 13:19:32 crc kubenswrapper[4769]: I1121 13:19:32.060919 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-677956c48d-qmjsd"] Nov 21 13:19:32 crc kubenswrapper[4769]: I1121 13:19:32.404890 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4"] Nov 21 13:19:32 crc kubenswrapper[4769]: W1121 13:19:32.986283 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod766fca12_6311_4b42_beeb_bd6dfbc3dce3.slice/crio-1c9cfc78a5ad7f6950ed6ce8bd83f8579149f880add6751d6d6d3bdc29cfb407 WatchSource:0}: Error finding container 1c9cfc78a5ad7f6950ed6ce8bd83f8579149f880add6751d6d6d3bdc29cfb407: Status 404 returned error can't find the container with id 1c9cfc78a5ad7f6950ed6ce8bd83f8579149f880add6751d6d6d3bdc29cfb407 Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.284319 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9974304e-9420-484d-83e8-996cd607775e" path="/var/lib/kubelet/pods/9974304e-9420-484d-83e8-996cd607775e/volumes" Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.427216 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.155:9696/\": dial tcp 10.217.0.155:9696: connect: connection refused" Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.970727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" event={"ID":"766fca12-6311-4b42-beeb-bd6dfbc3dce3","Type":"ContainerStarted","Data":"ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328"} Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.971548 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" event={"ID":"766fca12-6311-4b42-beeb-bd6dfbc3dce3","Type":"ContainerStarted","Data":"869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9"} Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.971697 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" event={"ID":"766fca12-6311-4b42-beeb-bd6dfbc3dce3","Type":"ContainerStarted","Data":"1c9cfc78a5ad7f6950ed6ce8bd83f8579149f880add6751d6d6d3bdc29cfb407"} Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.971837 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:33 crc kubenswrapper[4769]: I1121 13:19:33.971979 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:34 crc kubenswrapper[4769]: I1121 13:19:34.020694 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" podStartSLOduration=3.020673569 podStartE2EDuration="3.020673569s" podCreationTimestamp="2025-11-21 13:19:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:19:34.012726233 +0000 UTC m=+5332.713388051" watchObservedRunningTime="2025-11-21 13:19:34.020673569 +0000 UTC m=+5332.721335387" Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.039243 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.119507 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs"] Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.119833 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-httpd" containerID="cri-o://008809cb82983c2800b6a5362130127361432ba59b760ba1a5988d0ee508141c" gracePeriod=30 Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.120286 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" containerID="cri-o://d16e182001f62a31006d6869c168bd753526228755c8a652e1995805f68bb07e" gracePeriod=30 Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.274329 4769 scope.go:117] "RemoveContainer" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.275387 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:19:35 crc kubenswrapper[4769]: E1121 13:19:35.275637 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:19:35 crc kubenswrapper[4769]: I1121 13:19:35.995966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerStarted","Data":"26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8"} Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.003202 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7dff9d7dc4-j69vs_4aca7a55-cf5a-4979-856b-4252ae54ba5f/neutron-api/0.log" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.003275 4769 generic.go:334] "Generic (PLEG): container finished" podID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerID="008809cb82983c2800b6a5362130127361432ba59b760ba1a5988d0ee508141c" exitCode=0 Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.003313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerDied","Data":"008809cb82983c2800b6a5362130127361432ba59b760ba1a5988d0ee508141c"} Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.542232 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-66f88c5fc4-4c656_db4e8e03-925e-49f1-bc4f-a3818374af73/neutron-api/0.log" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.542602 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.568984 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-httpd-config\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.569025 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-public-tls-certs\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.569053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97gjv\" (UniqueName: \"kubernetes.io/projected/db4e8e03-925e-49f1-bc4f-a3818374af73-kube-api-access-97gjv\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.569093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-internal-tls-certs\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.569115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-combined-ca-bundle\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.569223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-config\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.569278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-ovndb-tls-certs\") pod \"db4e8e03-925e-49f1-bc4f-a3818374af73\" (UID: \"db4e8e03-925e-49f1-bc4f-a3818374af73\") " Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.603701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.603728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db4e8e03-925e-49f1-bc4f-a3818374af73-kube-api-access-97gjv" (OuterVolumeSpecName: "kube-api-access-97gjv") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "kube-api-access-97gjv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.653142 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.656639 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-config" (OuterVolumeSpecName: "config") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.663238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.670595 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.670635 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.670654 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-97gjv\" (UniqueName: \"kubernetes.io/projected/db4e8e03-925e-49f1-bc4f-a3818374af73-kube-api-access-97gjv\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.670669 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.670682 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.672461 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.699961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "db4e8e03-925e-49f1-bc4f-a3818374af73" (UID: "db4e8e03-925e-49f1-bc4f-a3818374af73"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.772382 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:36 crc kubenswrapper[4769]: I1121 13:19:36.772421 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/db4e8e03-925e-49f1-bc4f-a3818374af73-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.014170 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-66f88c5fc4-4c656_db4e8e03-925e-49f1-bc4f-a3818374af73/neutron-api/0.log" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.014253 4769 generic.go:334] "Generic (PLEG): container finished" podID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerID="68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572" exitCode=137 Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.014286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" event={"ID":"db4e8e03-925e-49f1-bc4f-a3818374af73","Type":"ContainerDied","Data":"68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572"} Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.014324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" event={"ID":"db4e8e03-925e-49f1-bc4f-a3818374af73","Type":"ContainerDied","Data":"51ca1ca3f9d079185769d5afd5c38a90c7344306ae182820973c37a185aa4171"} Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.014371 4769 scope.go:117] "RemoveContainer" containerID="417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.014434 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-66f88c5fc4-4c656" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.041626 4769 scope.go:117] "RemoveContainer" containerID="68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.067942 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-66f88c5fc4-4c656"] Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.072368 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-66f88c5fc4-4c656"] Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.082280 4769 scope.go:117] "RemoveContainer" containerID="417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc" Nov 21 13:19:37 crc kubenswrapper[4769]: E1121 13:19:37.082950 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc\": container with ID starting with 417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc not found: ID does not exist" containerID="417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.082991 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc"} err="failed to get container status \"417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc\": rpc error: code = NotFound desc = could not find container \"417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc\": container with ID starting with 417367601e2414f7d69a74066afc89570ab9528d2206760b265088317c1704fc not found: ID does not exist" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.083012 4769 scope.go:117] "RemoveContainer" containerID="68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572" Nov 21 13:19:37 crc kubenswrapper[4769]: E1121 13:19:37.083275 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572\": container with ID starting with 68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572 not found: ID does not exist" containerID="68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.083295 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572"} err="failed to get container status \"68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572\": rpc error: code = NotFound desc = could not find container \"68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572\": container with ID starting with 68e40429aa1fe8b18be29d8cbc24c2ca30bf04803e477522eba1c214ceadb572 not found: ID does not exist" Nov 21 13:19:37 crc kubenswrapper[4769]: I1121 13:19:37.283672 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" path="/var/lib/kubelet/pods/db4e8e03-925e-49f1-bc4f-a3818374af73/volumes" Nov 21 13:19:38 crc kubenswrapper[4769]: I1121 13:19:38.357340 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:38 crc kubenswrapper[4769]: I1121 13:19:38.357860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:38 crc kubenswrapper[4769]: I1121 13:19:38.393328 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:39 crc kubenswrapper[4769]: I1121 13:19:39.078577 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:19:39 crc kubenswrapper[4769]: I1121 13:19:39.274441 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.053272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerStarted","Data":"2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd"} Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.059363 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-7dff9d7dc4-j69vs_4aca7a55-cf5a-4979-856b-4252ae54ba5f/neutron-api/0.log" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.059752 4769 generic.go:334] "Generic (PLEG): container finished" podID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerID="d16e182001f62a31006d6869c168bd753526228755c8a652e1995805f68bb07e" exitCode=0 Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.059791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerDied","Data":"d16e182001f62a31006d6869c168bd753526228755c8a652e1995805f68bb07e"} Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.059824 4769 scope.go:117] "RemoveContainer" containerID="17127d8fae66c1070ce2b9cbe311a112e8390090f1e93b4e52b36c1aaced1ef0" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.060601 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.430754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.552858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-config\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.553221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-httpd-config\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.553353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9w94\" (UniqueName: \"kubernetes.io/projected/4aca7a55-cf5a-4979-856b-4252ae54ba5f-kube-api-access-b9w94\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.553482 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-public-tls-certs\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.553608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-combined-ca-bundle\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.553735 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-ovndb-tls-certs\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.553936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-internal-tls-certs\") pod \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\" (UID: \"4aca7a55-cf5a-4979-856b-4252ae54ba5f\") " Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.558702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aca7a55-cf5a-4979-856b-4252ae54ba5f-kube-api-access-b9w94" (OuterVolumeSpecName: "kube-api-access-b9w94") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "kube-api-access-b9w94". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.559906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.604044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.612520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-config" (OuterVolumeSpecName: "config") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.618692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.619879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.627728 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "4aca7a55-cf5a-4979-856b-4252ae54ba5f" (UID: "4aca7a55-cf5a-4979-856b-4252ae54ba5f"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656177 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656606 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656624 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656638 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656653 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656666 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4aca7a55-cf5a-4979-856b-4252ae54ba5f-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:40 crc kubenswrapper[4769]: I1121 13:19:40.656681 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b9w94\" (UniqueName: \"kubernetes.io/projected/4aca7a55-cf5a-4979-856b-4252ae54ba5f-kube-api-access-b9w94\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.074983 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.075673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs" event={"ID":"4aca7a55-cf5a-4979-856b-4252ae54ba5f","Type":"ContainerDied","Data":"b718218e62347f8b26f4ebac6ecc8510f7c1a835b66d1135a950a27699309fbd"} Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.075715 4769 scope.go:117] "RemoveContainer" containerID="d16e182001f62a31006d6869c168bd753526228755c8a652e1995805f68bb07e" Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.098880 4769 scope.go:117] "RemoveContainer" containerID="008809cb82983c2800b6a5362130127361432ba59b760ba1a5988d0ee508141c" Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.117683 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs"] Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.125660 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7dff9d7dc4-j69vs"] Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.289311 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" path="/var/lib/kubelet/pods/4aca7a55-cf5a-4979-856b-4252ae54ba5f/volumes" Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.932286 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:41 crc kubenswrapper[4769]: I1121 13:19:41.933767 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:19:42 crc kubenswrapper[4769]: I1121 13:19:42.046786 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj"] Nov 21 13:19:42 crc kubenswrapper[4769]: I1121 13:19:42.049102 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-httpd" containerID="cri-o://e7dcb48371f08e2c167ef53b8a5b4bd0a3f974876a17a45ae6db4e5462097e39" gracePeriod=30 Nov 21 13:19:42 crc kubenswrapper[4769]: I1121 13:19:42.049366 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-server" containerID="cri-o://58c55c056d067a0c7edaf3bcaecc30eada0c2378ed09c7b7f74f65a8d9ea64f2" gracePeriod=30 Nov 21 13:19:42 crc kubenswrapper[4769]: I1121 13:19:42.274067 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:19:42 crc kubenswrapper[4769]: E1121 13:19:42.274322 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:19:42 crc kubenswrapper[4769]: I1121 13:19:42.825613 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.240:8080/healthcheck\": dial tcp 10.217.1.240:8080: connect: connection refused" Nov 21 13:19:42 crc kubenswrapper[4769]: I1121 13:19:42.825964 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.240:8080/healthcheck\": dial tcp 10.217.1.240:8080: connect: connection refused" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.105923 4769 generic.go:334] "Generic (PLEG): container finished" podID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerID="58c55c056d067a0c7edaf3bcaecc30eada0c2378ed09c7b7f74f65a8d9ea64f2" exitCode=0 Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.106251 4769 generic.go:334] "Generic (PLEG): container finished" podID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerID="e7dcb48371f08e2c167ef53b8a5b4bd0a3f974876a17a45ae6db4e5462097e39" exitCode=0 Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.106039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" event={"ID":"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99","Type":"ContainerDied","Data":"58c55c056d067a0c7edaf3bcaecc30eada0c2378ed09c7b7f74f65a8d9ea64f2"} Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.106295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" event={"ID":"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99","Type":"ContainerDied","Data":"e7dcb48371f08e2c167ef53b8a5b4bd0a3f974876a17a45ae6db4e5462097e39"} Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.106313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" event={"ID":"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99","Type":"ContainerDied","Data":"cd63ecc135b7df0eedbab4eb3424ca1e38d24037a1c03fae9c69dc1008d92dce"} Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.106328 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd63ecc135b7df0eedbab4eb3424ca1e38d24037a1c03fae9c69dc1008d92dce" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.166894 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-config-data\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-internal-tls-certs\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-log-httpd\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-combined-ca-bundle\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-etc-swift\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmdbq\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-kube-api-access-mmdbq\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-run-httpd\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.313952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-public-tls-certs\") pod \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\" (UID: \"dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99\") " Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.314732 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.314744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.314889 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.314902 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.979478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-kube-api-access-mmdbq" (OuterVolumeSpecName: "kube-api-access-mmdbq") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "kube-api-access-mmdbq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:43 crc kubenswrapper[4769]: I1121 13:19:43.985429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.030166 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mmdbq\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-kube-api-access-mmdbq\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.030240 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.127223 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-config-data" (OuterVolumeSpecName: "config-data") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.131894 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.133227 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.148787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.152543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.174555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" (UID: "dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.233478 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.233512 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.233526 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.465541 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj"] Nov 21 13:19:44 crc kubenswrapper[4769]: I1121 13:19:44.474020 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-865c65649b-5vkhj"] Nov 21 13:19:45 crc kubenswrapper[4769]: I1121 13:19:45.075446 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:19:45 crc kubenswrapper[4769]: I1121 13:19:45.302840 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" path="/var/lib/kubelet/pods/dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99/volumes" Nov 21 13:19:46 crc kubenswrapper[4769]: I1121 13:19:46.274833 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:19:46 crc kubenswrapper[4769]: E1121 13:19:46.275648 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 40s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(d17f3666-e78c-4e03-8509-14d6cdea4083)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" Nov 21 13:19:47 crc kubenswrapper[4769]: I1121 13:19:47.367418 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:49 crc kubenswrapper[4769]: I1121 13:19:49.267781 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:49 crc kubenswrapper[4769]: I1121 13:19:49.268429 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-central-agent" containerID="cri-o://8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423" gracePeriod=30 Nov 21 13:19:49 crc kubenswrapper[4769]: I1121 13:19:49.268524 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="sg-core" containerID="cri-o://39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb" gracePeriod=30 Nov 21 13:19:49 crc kubenswrapper[4769]: I1121 13:19:49.268533 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="proxy-httpd" containerID="cri-o://5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1" gracePeriod=30 Nov 21 13:19:49 crc kubenswrapper[4769]: I1121 13:19:49.268626 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-notification-agent" containerID="cri-o://b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f" gracePeriod=30 Nov 21 13:19:50 crc kubenswrapper[4769]: I1121 13:19:50.227744 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerID="5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1" exitCode=0 Nov 21 13:19:50 crc kubenswrapper[4769]: I1121 13:19:50.228303 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerID="39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb" exitCode=2 Nov 21 13:19:50 crc kubenswrapper[4769]: I1121 13:19:50.228314 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerID="8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423" exitCode=0 Nov 21 13:19:50 crc kubenswrapper[4769]: I1121 13:19:50.227865 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerDied","Data":"5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1"} Nov 21 13:19:50 crc kubenswrapper[4769]: I1121 13:19:50.228377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerDied","Data":"39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb"} Nov 21 13:19:50 crc kubenswrapper[4769]: I1121 13:19:50.228397 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerDied","Data":"8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423"} Nov 21 13:19:51 crc kubenswrapper[4769]: E1121 13:19:51.390848 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0e39f4c_ee4e_418a_bb4c_449c7a045b5f.slice/crio-b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0e39f4c_ee4e_418a_bb4c_449c7a045b5f.slice/crio-conmon-b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:19:51 crc kubenswrapper[4769]: I1121 13:19:51.549801 4769 scope.go:117] "RemoveContainer" containerID="6012866497a818b2eb3242b8ea796e5f2ab75d67f83647b6ec80a589a6a09c0e" Nov 21 13:19:51 crc kubenswrapper[4769]: I1121 13:19:51.599101 4769 scope.go:117] "RemoveContainer" containerID="631aa4b6557276b1abeae26b64b5406bfb6a6657d6772722d90336b583de1fd9" Nov 21 13:19:51 crc kubenswrapper[4769]: I1121 13:19:51.637705 4769 scope.go:117] "RemoveContainer" containerID="e359038b76ee6b67178f744ae7d73bbb1f08c8833fb8e7791663f2a46008db7a" Nov 21 13:19:51 crc kubenswrapper[4769]: I1121 13:19:51.731829 4769 scope.go:117] "RemoveContainer" containerID="19a408de28f0d01d376dde732021ad9bfdfdbb558dd7a55704e8c3d02fef3da4" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.189045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-sg-core-conf-yaml\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-log-httpd\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnqdw\" (UniqueName: \"kubernetes.io/projected/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-kube-api-access-cnqdw\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-combined-ca-bundle\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-ceilometer-tls-certs\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-scripts\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-config-data\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.255767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-run-httpd\") pod \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\" (UID: \"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f\") " Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.257670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.257801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.268172 4769 generic.go:334] "Generic (PLEG): container finished" podID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerID="b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f" exitCode=0 Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.268295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerDied","Data":"b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f"} Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.268314 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.268364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f0e39f4c-ee4e-418a-bb4c-449c7a045b5f","Type":"ContainerDied","Data":"88616ca1766430307e56559e01dae2bc6b2ed07a403d7b7bf524d01fb56a1847"} Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.268403 4769 scope.go:117] "RemoveContainer" containerID="5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.268933 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-kube-api-access-cnqdw" (OuterVolumeSpecName: "kube-api-access-cnqdw") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "kube-api-access-cnqdw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.270110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-scripts" (OuterVolumeSpecName: "scripts") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.304449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.355379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.360158 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.360210 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.360222 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cnqdw\" (UniqueName: \"kubernetes.io/projected/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-kube-api-access-cnqdw\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.360235 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.360245 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.360255 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.368943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.402172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-config-data" (OuterVolumeSpecName: "config-data") pod "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" (UID: "f0e39f4c-ee4e-418a-bb4c-449c7a045b5f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.462053 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.462092 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.479539 4769 scope.go:117] "RemoveContainer" containerID="39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.502738 4769 scope.go:117] "RemoveContainer" containerID="b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.525015 4769 scope.go:117] "RemoveContainer" containerID="8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.555939 4769 scope.go:117] "RemoveContainer" containerID="5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.556457 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1\": container with ID starting with 5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1 not found: ID does not exist" containerID="5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.556484 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1"} err="failed to get container status \"5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1\": rpc error: code = NotFound desc = could not find container \"5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1\": container with ID starting with 5904652f171a37d59c6e11d32c184729e17cc12dda7f16cbc0a958e8b15c5ab1 not found: ID does not exist" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.556505 4769 scope.go:117] "RemoveContainer" containerID="39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.557829 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb\": container with ID starting with 39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb not found: ID does not exist" containerID="39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.557854 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb"} err="failed to get container status \"39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb\": rpc error: code = NotFound desc = could not find container \"39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb\": container with ID starting with 39671b8f98f7e68c7c1b78f1ea6d75a5186c45b230554cad9000f2e258cc15bb not found: ID does not exist" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.557869 4769 scope.go:117] "RemoveContainer" containerID="b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.558113 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f\": container with ID starting with b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f not found: ID does not exist" containerID="b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.558138 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f"} err="failed to get container status \"b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f\": rpc error: code = NotFound desc = could not find container \"b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f\": container with ID starting with b5ba9eab17ec6eef1428b8acdd3fcdd2442483280592818de59c338c03f0a85f not found: ID does not exist" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.558150 4769 scope.go:117] "RemoveContainer" containerID="8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.558386 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423\": container with ID starting with 8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423 not found: ID does not exist" containerID="8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.558403 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423"} err="failed to get container status \"8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423\": rpc error: code = NotFound desc = could not find container \"8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423\": container with ID starting with 8659d726012ae6d8fd27f7c5927b09f47647a0dcd68875ad5ca5b69393a39423 not found: ID does not exist" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.614201 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.624041 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.640912 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641333 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-central-agent" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641347 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-central-agent" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641364 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="sg-core" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641372 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="sg-core" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641386 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-server" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641393 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-server" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641406 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641411 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641428 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641436 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641448 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641456 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641496 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641502 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641516 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641522 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641533 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="proxy-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641539 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="proxy-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: E1121 13:19:52.641548 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-notification-agent" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-notification-agent" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641736 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="proxy-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641751 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641765 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641776 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-httpd" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641791 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dac0eaf7-4413-4c4e-80d3-5c7fcbc77d99" containerName="proxy-server" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641801 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641810 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-central-agent" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641817 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="ceilometer-notification-agent" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641824 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4aca7a55-cf5a-4979-856b-4252ae54ba5f" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641843 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="db4e8e03-925e-49f1-bc4f-a3818374af73" containerName="neutron-api" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.641853 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" containerName="sg-core" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.643815 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.647557 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.647678 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.647752 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.656236 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-log-httpd\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665445 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-scripts\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-config-data\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-run-httpd\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrk7d\" (UniqueName: \"kubernetes.io/projected/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-kube-api-access-jrk7d\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.665664 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-scripts\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-config-data\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-run-httpd\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jrk7d\" (UniqueName: \"kubernetes.io/projected/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-kube-api-access-jrk7d\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-log-httpd\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767959 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.767995 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.768385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-run-httpd\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.768430 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-log-httpd\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.772066 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.772283 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.773111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-config-data\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.773683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.774617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-scripts\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.789131 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrk7d\" (UniqueName: \"kubernetes.io/projected/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-kube-api-access-jrk7d\") pod \"ceilometer-0\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:52 crc kubenswrapper[4769]: I1121 13:19:52.974931 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:19:53 crc kubenswrapper[4769]: I1121 13:19:53.286321 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e39f4c-ee4e-418a-bb4c-449c7a045b5f" path="/var/lib/kubelet/pods/f0e39f4c-ee4e-418a-bb4c-449c7a045b5f/volumes" Nov 21 13:19:53 crc kubenswrapper[4769]: I1121 13:19:53.371786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:19:54 crc kubenswrapper[4769]: I1121 13:19:54.298369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerStarted","Data":"70090640a895c331d26e9a81ab22c0b907bad22089def7f0d9ec71d858affe7a"} Nov 21 13:19:55 crc kubenswrapper[4769]: I1121 13:19:55.325088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerStarted","Data":"36b1bf769252086e38877bb15f5ce07c690500262ecd2aefe2205876a7ab2812"} Nov 21 13:19:56 crc kubenswrapper[4769]: I1121 13:19:56.273856 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:19:56 crc kubenswrapper[4769]: E1121 13:19:56.274448 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:19:57 crc kubenswrapper[4769]: I1121 13:19:57.274485 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:19:57 crc kubenswrapper[4769]: I1121 13:19:57.365007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerStarted","Data":"240fbceb280f0466787fb0af67fb6f961f5bff07573b4aa015615e3e197d9640"} Nov 21 13:19:58 crc kubenswrapper[4769]: I1121 13:19:58.381814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerStarted","Data":"2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d"} Nov 21 13:19:58 crc kubenswrapper[4769]: I1121 13:19:58.383640 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:19:59 crc kubenswrapper[4769]: I1121 13:19:59.400527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerStarted","Data":"0bc7915362f1cc96b0d86321e9be9c9e72e608fa6ffde495e470378c70a37dd9"} Nov 21 13:20:02 crc kubenswrapper[4769]: I1121 13:20:02.449278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerStarted","Data":"f728688765c11a8b9276f1b9090000fe2246b4eb2e98a7a9f4f1df8baeef17b5"} Nov 21 13:20:02 crc kubenswrapper[4769]: I1121 13:20:02.450100 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:20:02 crc kubenswrapper[4769]: I1121 13:20:02.495086 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.572603971 podStartE2EDuration="10.495066253s" podCreationTimestamp="2025-11-21 13:19:52 +0000 UTC" firstStartedPulling="2025-11-21 13:19:53.395102164 +0000 UTC m=+5352.095764002" lastFinishedPulling="2025-11-21 13:20:01.317564466 +0000 UTC m=+5360.018226284" observedRunningTime="2025-11-21 13:20:02.480531517 +0000 UTC m=+5361.181193355" watchObservedRunningTime="2025-11-21 13:20:02.495066253 +0000 UTC m=+5361.195728071" Nov 21 13:20:06 crc kubenswrapper[4769]: I1121 13:20:06.607099 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:20:08 crc kubenswrapper[4769]: I1121 13:20:08.274292 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:20:08 crc kubenswrapper[4769]: E1121 13:20:08.275353 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:20:22 crc kubenswrapper[4769]: I1121 13:20:22.983409 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:20:23 crc kubenswrapper[4769]: I1121 13:20:23.286680 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:20:23 crc kubenswrapper[4769]: E1121 13:20:23.287152 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:20:31 crc kubenswrapper[4769]: E1121 13:20:31.178719 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:51288->38.102.83.227:40411: write tcp 38.102.83.227:51288->38.102.83.227:40411: write: broken pipe Nov 21 13:20:35 crc kubenswrapper[4769]: I1121 13:20:35.275313 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:20:35 crc kubenswrapper[4769]: E1121 13:20:35.276065 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.671102 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.700899 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.701144 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" containerName="openstackclient" containerID="cri-o://430453e445cddd84bb821265e71641462e43cb6e3ead94e9f3f1b29b37f4882f" gracePeriod=2 Nov 21 13:20:42 crc kubenswrapper[4769]: E1121 13:20:42.711401 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:42 crc kubenswrapper[4769]: E1121 13:20:42.711483 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data podName:cdd3fc9d-251c-47d2-aba8-53f309ea4494 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:43.211456618 +0000 UTC m=+5401.912118436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data") pod "rabbitmq-cell1-server-0" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.733033 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.946559 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.972492 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:20:42 crc kubenswrapper[4769]: I1121 13:20:42.973229 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="openstack-network-exporter" containerID="cri-o://88eb6797b61d829add320d5ea7df7e1f33f647ef6846c80e60633477279e763f" gracePeriod=300 Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.023922 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.030752 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="openstack-network-exporter" containerID="cri-o://fe1fcf32b913741fbb85d265f70f54f729b43e9983930764a838ce5da2686049" gracePeriod=30 Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.024169 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="ovn-northd" containerID="cri-o://06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" gracePeriod=30 Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.057753 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement87ee-account-delete-s6pdt"] Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.058933 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" containerName="openstackclient" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.058958 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" containerName="openstackclient" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.059209 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" containerName="openstackclient" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.060179 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.122918 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.122981 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data podName:532433c6-42b6-4674-977f-8a7a23614deb nodeName:}" failed. No retries permitted until 2025-11-21 13:20:43.62296734 +0000 UTC m=+5402.323629148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data") pod "rabbitmq-server-0" (UID: "532433c6-42b6-4674-977f-8a7a23614deb") : configmap "rabbitmq-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.130919 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement87ee-account-delete-s6pdt"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.220253 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="ovsdbserver-sb" containerID="cri-o://e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198" gracePeriod=300 Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.224773 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts\") pod \"placement87ee-account-delete-s6pdt\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.224939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64gfr\" (UniqueName: \"kubernetes.io/projected/011db835-c98c-4f22-8167-d07b161ac7f2-kube-api-access-64gfr\") pod \"placement87ee-account-delete-s6pdt\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.225054 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.225093 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data podName:cdd3fc9d-251c-47d2-aba8-53f309ea4494 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.225080424 +0000 UTC m=+5402.925742242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data") pod "rabbitmq-cell1-server-0" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.233123 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron985a-account-delete-cr2xl"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.242162 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.350550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-64gfr\" (UniqueName: \"kubernetes.io/projected/011db835-c98c-4f22-8167-d07b161ac7f2-kube-api-access-64gfr\") pod \"placement87ee-account-delete-s6pdt\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.351222 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts\") pod \"placement87ee-account-delete-s6pdt\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.463876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts\") pod \"placement87ee-account-delete-s6pdt\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.537289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl6wl\" (UniqueName: \"kubernetes.io/projected/9c7aa71e-490d-4282-9b1f-26de919af8a4-kube-api-access-bl6wl\") pod \"neutron985a-account-delete-cr2xl\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.537366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts\") pod \"neutron985a-account-delete-cr2xl\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.538391 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.538435 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.038421363 +0000 UTC m=+5402.739083181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-scripts" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.539942 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.540013 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.039996834 +0000 UTC m=+5402.740658652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-internal-svc" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.540904 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.540936 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.040928198 +0000 UTC m=+5402.741590016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.540972 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.540993 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.040986239 +0000 UTC m=+5402.741648057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "combined-ca-bundle" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.541571 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.541626 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.041611295 +0000 UTC m=+5402.742273193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-public-svc" not found Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.548693 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron985a-account-delete-cr2xl"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.579899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-64gfr\" (UniqueName: \"kubernetes.io/projected/011db835-c98c-4f22-8167-d07b161ac7f2-kube-api-access-64gfr\") pod \"placement87ee-account-delete-s6pdt\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.603571 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.604601 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="openstack-network-exporter" containerID="cri-o://7f9377333fa47ffea5425ae287e8ffba676c5d8221d4572416218df149e39ca6" gracePeriod=300 Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.638784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bl6wl\" (UniqueName: \"kubernetes.io/projected/9c7aa71e-490d-4282-9b1f-26de919af8a4-kube-api-access-bl6wl\") pod \"neutron985a-account-delete-cr2xl\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.638843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts\") pod \"neutron985a-account-delete-cr2xl\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.639551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts\") pod \"neutron985a-account-delete-cr2xl\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.640081 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: E1121 13:20:43.640134 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data podName:532433c6-42b6-4674-977f-8a7a23614deb nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.640118928 +0000 UTC m=+5403.340780746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data") pod "rabbitmq-server-0" (UID: "532433c6-42b6-4674-977f-8a7a23614deb") : configmap "rabbitmq-config-data" not found Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.645766 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-6lxdx"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.670444 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-6lxdx"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.680211 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl6wl\" (UniqueName: \"kubernetes.io/projected/9c7aa71e-490d-4282-9b1f-26de919af8a4-kube-api-access-bl6wl\") pod \"neutron985a-account-delete-cr2xl\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.713670 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.773816 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.790374 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.839975 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="ovsdbserver-nb" containerID="cri-o://72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b" gracePeriod=300 Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.862042 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.898680 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.915705 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mg55q"] Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.958991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jsv\" (UniqueName: \"kubernetes.io/projected/6dc0a443-6a8e-43fd-8612-01cfe8196876-kube-api-access-q9jsv\") pod \"barbicanaa33-account-delete-7zjf5\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.959052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts\") pod \"barbicanaa33-account-delete-7zjf5\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:43 crc kubenswrapper[4769]: I1121 13:20:43.969760 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mg55q"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.013008 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder8885-account-delete-7cg2c"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.045576 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder8885-account-delete-7cg2c"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.045759 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.060630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts\") pod \"barbicanaa33-account-delete-7zjf5\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.060680 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance80a8-account-delete-65lmn"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.060924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jsv\" (UniqueName: \"kubernetes.io/projected/6dc0a443-6a8e-43fd-8612-01cfe8196876-kube-api-access-q9jsv\") pod \"barbicanaa33-account-delete-7zjf5\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061428 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061473 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.061459304 +0000 UTC m=+5403.762121122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-scripts" not found Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.061465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts\") pod \"barbicanaa33-account-delete-7zjf5\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061527 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061546 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.061540296 +0000 UTC m=+5403.762202114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-internal-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061573 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061590 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.061584847 +0000 UTC m=+5403.762246665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-config-data" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061651 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061706 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.06169164 +0000 UTC m=+5403.762353498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-public-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061757 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.061786 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.061777252 +0000 UTC m=+5403.762439130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.065998 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.091570 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9dc26468-7e8c-4434-8bed-2a6ed91fa1eb/ovsdbserver-sb/0.log" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.091620 4769 generic.go:334] "Generic (PLEG): container finished" podID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerID="88eb6797b61d829add320d5ea7df7e1f33f647ef6846c80e60633477279e763f" exitCode=2 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.091637 4769 generic.go:334] "Generic (PLEG): container finished" podID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerID="e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198" exitCode=143 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.091737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb","Type":"ContainerDied","Data":"88eb6797b61d829add320d5ea7df7e1f33f647ef6846c80e60633477279e763f"} Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.091769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb","Type":"ContainerDied","Data":"e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198"} Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.114204 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance80a8-account-delete-65lmn"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.132086 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jsv\" (UniqueName: \"kubernetes.io/projected/6dc0a443-6a8e-43fd-8612-01cfe8196876-kube-api-access-q9jsv\") pod \"barbicanaa33-account-delete-7zjf5\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.134340 4769 generic.go:334] "Generic (PLEG): container finished" podID="f74f9009-9b6c-453a-aa99-a6036758983d" containerID="fe1fcf32b913741fbb85d265f70f54f729b43e9983930764a838ce5da2686049" exitCode=2 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.134388 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f74f9009-9b6c-453a-aa99-a6036758983d","Type":"ContainerDied","Data":"fe1fcf32b913741fbb85d265f70f54f729b43e9983930764a838ce5da2686049"} Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.161201 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.162278 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts\") pod \"cinder8885-account-delete-7cg2c\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.162364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f59k9\" (UniqueName: \"kubernetes.io/projected/1015deb7-ba46-4b81-8a0d-3767e6b5829d-kube-api-access-f59k9\") pod \"cinder8885-account-delete-7cg2c\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.162384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts\") pod \"glance80a8-account-delete-65lmn\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.188844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h59g\" (UniqueName: \"kubernetes.io/projected/86068992-fbf9-40e2-88a1-456bb9d59cbe-kube-api-access-7h59g\") pod \"glance80a8-account-delete-65lmn\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.185839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-shq9l"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.268169 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-shq9l"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.291073 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f59k9\" (UniqueName: \"kubernetes.io/projected/1015deb7-ba46-4b81-8a0d-3767e6b5829d-kube-api-access-f59k9\") pod \"cinder8885-account-delete-7cg2c\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.306385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts\") pod \"glance80a8-account-delete-65lmn\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.306618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7h59g\" (UniqueName: \"kubernetes.io/projected/86068992-fbf9-40e2-88a1-456bb9d59cbe-kube-api-access-7h59g\") pod \"glance80a8-account-delete-65lmn\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.306815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts\") pod \"cinder8885-account-delete-7cg2c\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.307568 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts\") pod \"cinder8885-account-delete-7cg2c\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.308091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts\") pod \"glance80a8-account-delete-65lmn\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.308131 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.308168 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data podName:cdd3fc9d-251c-47d2-aba8-53f309ea4494 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:46.308157216 +0000 UTC m=+5405.008819034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data") pod "rabbitmq-cell1-server-0" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.359733 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-tlv5r"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.367152 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" secret="" err="secret \"nova-nova-dockercfg-7nn2b\" not found" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.383540 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-tlv5r"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.399509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f59k9\" (UniqueName: \"kubernetes.io/projected/1015deb7-ba46-4b81-8a0d-3767e6b5829d-kube-api-access-f59k9\") pod \"cinder8885-account-delete-7cg2c\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.408402 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.408478 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.908463965 +0000 UTC m=+5403.609125783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.408828 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.408851 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.908844795 +0000 UTC m=+5403.609506603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.409429 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.409514 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.909494111 +0000 UTC m=+5403.610155929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.409557 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.409578 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.909572493 +0000 UTC m=+5403.610234311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.410058 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.410082 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:44.910075316 +0000 UTC m=+5403.610737134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.414718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h59g\" (UniqueName: \"kubernetes.io/projected/86068992-fbf9-40e2-88a1-456bb9d59cbe-kube-api-access-7h59g\") pod \"glance80a8-account-delete-65lmn\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.433250 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.433661 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-smrhb"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.444260 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-7r4lg"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.492386 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-7r4lg"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.520324 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-smrhb"] Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.528328 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b is running failed: container process not found" containerID="72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.530958 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b is running failed: container process not found" containerID="72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.546116 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b is running failed: container process not found" containerID="72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.546175 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="ovsdbserver-nb" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.577352 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.587437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell0f24d-account-delete-98zw4"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.588776 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.614801 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0f24d-account-delete-98zw4"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.633929 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7979fc499d-l7wjs"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.634421 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-api" containerID="cri-o://15205680f75d7bafea71eff445dfd97507653414b5dfb2268041b4b2d1c2b110" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.634826 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-httpd" containerID="cri-o://8474f3bee160abdbfe40a398cfc6fd3dc69c47042bd45d32463964a7bfb491e6" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.643004 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.643907 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-server" containerID="cri-o://cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646696 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-updater" containerID="cri-o://1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646797 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-reaper" containerID="cri-o://6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646853 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="swift-recon-cron" containerID="cri-o://fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646879 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-auditor" containerID="cri-o://cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646889 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="rsync" containerID="cri-o://e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646929 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-replicator" containerID="cri-o://9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646941 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-expirer" containerID="cri-o://35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646976 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-server" containerID="cri-o://98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.646987 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-updater" containerID="cri-o://21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.647019 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-auditor" containerID="cri-o://44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.647044 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-replicator" containerID="cri-o://cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.647055 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-server" containerID="cri-o://46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.647085 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-replicator" containerID="cri-o://bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.647096 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-auditor" containerID="cri-o://46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.662020 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-67959f9746-jwjb9"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.662339 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-log" containerID="cri-o://15360538021fc052bef33c9c34ebae1d05603dc5a31bbd84daba9f7e3da6d60a" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.662472 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-api" containerID="cri-o://4f8d47da9752b3301435660772a5b9a18c405c8ded394b8412e868df9f4472f8" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.691274 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.714247 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.748789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zmrw\" (UniqueName: \"kubernetes.io/projected/d83cd1db-8da7-4977-889a-579eb4e3367a-kube-api-access-4zmrw\") pod \"novacell0f24d-account-delete-98zw4\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.748918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts\") pod \"novacell0f24d-account-delete-98zw4\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.749631 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.749691 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data podName:532433c6-42b6-4674-977f-8a7a23614deb nodeName:}" failed. No retries permitted until 2025-11-21 13:20:46.749671015 +0000 UTC m=+5405.450332823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data") pod "rabbitmq-server-0" (UID: "532433c6-42b6-4674-977f-8a7a23614deb") : configmap "rabbitmq-config-data" not found Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.750924 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.773507 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-hdv64"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.798518 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h24d2"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.848700 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerName="rabbitmq" containerID="cri-o://6b8b64d1841f7133ce1191474f0746d6f3e25dec326fdc438f460624b3a44758" gracePeriod=604800 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.851081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4zmrw\" (UniqueName: \"kubernetes.io/projected/d83cd1db-8da7-4977-889a-579eb4e3367a-kube-api-access-4zmrw\") pod \"novacell0f24d-account-delete-98zw4\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.851132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts\") pod \"novacell0f24d-account-delete-98zw4\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.853734 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts\") pod \"novacell0f24d-account-delete-98zw4\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.876037 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.877461 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.877534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zmrw\" (UniqueName: \"kubernetes.io/projected/d83cd1db-8da7-4977-889a-579eb4e3367a-kube-api-access-4zmrw\") pod \"novacell0f24d-account-delete-98zw4\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.916274 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.927625 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.942487 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.944342 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.949282 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb"] Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.953558 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.955041 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.955022755 +0000 UTC m=+5404.655684573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.954467 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.955300 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.955291612 +0000 UTC m=+5404.655953430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.954506 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.955730 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.955721594 +0000 UTC m=+5404.656383412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.954550 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.955862 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.955855377 +0000 UTC m=+5404.656517195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "combined-ca-bundle" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.954592 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: E1121 13:20:44.956054 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:45.956034392 +0000 UTC m=+5404.656696210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.963597 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.967605 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="cinder-scheduler" containerID="cri-o://fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.968060 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="probe" containerID="cri-o://3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.988092 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.988484 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api-log" containerID="cri-o://43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de" gracePeriod=30 Nov 21 13:20:44 crc kubenswrapper[4769]: I1121 13:20:44.989560 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api" containerID="cri-o://48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.007901 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.008363 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-log" containerID="cri-o://12f02a05f413e8857f425ce4bbd37f702949440faf33c3309c7e81954e222613" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.008539 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-httpd" containerID="cri-o://fb93df30b6001a9be0414bd1042aa0d363e8be222763a54a21ccbda58e264729" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.016522 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.016781 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-log" containerID="cri-o://15888949b29d204ac86a4426582988850fb8b58bb4b10c0b63169560d49becb8" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.017803 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-httpd" containerID="cri-o://6096e8bc4422d60d2481bc64037379546fc4f0ec6245e5f0c984b66eb753fdfd" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.027275 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.027526 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener-log" containerID="cri-o://01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.027636 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener" containerID="cri-o://63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.044570 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.044927 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker-log" containerID="cri-o://8261509e5db67b1ce557d83ed76661488c4a905b3b1f4250e78780eb60cab733" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.045063 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker" containerID="cri-o://3a41d8e27027f69228803146853ccc8f5dad3ec8ba14125f317fc0a8d9eaa800" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.054846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.054884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts\") pod \"novaapi9af9-account-delete-4hfb2\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.054949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxzw8\" (UniqueName: \"kubernetes.io/projected/a1e6bd23-a129-40d9-812b-998d49dbb376-kube-api-access-pxzw8\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.055000 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr4hj\" (UniqueName: \"kubernetes.io/projected/bf19d867-b143-4d9e-a5c7-99f6ece00271-kube-api-access-wr4hj\") pod \"novaapi9af9-account-delete-4hfb2\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.055041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.058518 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.058703 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-log" containerID="cri-o://ceec5e9ae4db59a6c071fcac05945b9798302c0e45510e38eb06fb0c28b6a2ca" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.058812 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-metadata" containerID="cri-o://14e60c29fdf5f6a03d66db49ee3c700b970c8ee0827320db8caa98a96d972cbc" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.080380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.096336 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.096526 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-log" containerID="cri-o://8f46547bd724f15a906dff1f908869f1b610836a8a2d4ddf20148f9a22b4d334" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.096657 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-api" containerID="cri-o://664df784d54f1953a61905f5ac3a0ed70e6c9cc9a1d804f4ad065ce31820c3cb" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.109664 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-56c85cb96-q6889"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.109966 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api-log" containerID="cri-o://5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.110126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api" containerID="cri-o://3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.123145 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.157075 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.157287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.157312 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts\") pod \"novaapi9af9-account-delete-4hfb2\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.157375 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pxzw8\" (UniqueName: \"kubernetes.io/projected/a1e6bd23-a129-40d9-812b-998d49dbb376-kube-api-access-pxzw8\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.157435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wr4hj\" (UniqueName: \"kubernetes.io/projected/bf19d867-b143-4d9e-a5c7-99f6ece00271-kube-api-access-wr4hj\") pod \"novaapi9af9-account-delete-4hfb2\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.158283 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.158441 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:47.158423145 +0000 UTC m=+5405.859084963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "combined-ca-bundle" not found Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.158370 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.158669 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.158798 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:47.158785315 +0000 UTC m=+5405.859447213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-public-svc" not found Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.158895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.158958 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.158984 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:47.15897481 +0000 UTC m=+5405.859636628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-config-data" not found Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.159001 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-d7x8p"] Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.159047 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.159069 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:47.159060712 +0000 UTC m=+5405.859722530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-scripts" not found Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.159306 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.159410 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:47.159400011 +0000 UTC m=+5405.860061829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-internal-svc" not found Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.160743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts\") pod \"novaapi9af9-account-delete-4hfb2\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.180093 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-d7x8p"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.183915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr4hj\" (UniqueName: \"kubernetes.io/projected/bf19d867-b143-4d9e-a5c7-99f6ece00271-kube-api-access-wr4hj\") pod \"novaapi9af9-account-delete-4hfb2\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.193028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxzw8\" (UniqueName: \"kubernetes.io/projected/a1e6bd23-a129-40d9-812b-998d49dbb376-kube-api-access-pxzw8\") pod \"dnsmasq-dnsmasq-84b9f45d47-7fmbb\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.193219 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="rabbitmq" containerID="cri-o://e5f71ffb25e3e61b208f6c7926eecbd32eaee9d7fa57daac62217c0abf303717" gracePeriod=604800 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.198948 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.210249 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ec99-account-create-fh2jb"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.221659 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_0a30004c-7036-4604-8fea-33ffd692a39a/ovsdbserver-nb/0.log" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.221708 4769 generic.go:334] "Generic (PLEG): container finished" podID="0a30004c-7036-4604-8fea-33ffd692a39a" containerID="7f9377333fa47ffea5425ae287e8ffba676c5d8221d4572416218df149e39ca6" exitCode=2 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.221724 4769 generic.go:334] "Generic (PLEG): container finished" podID="0a30004c-7036-4604-8fea-33ffd692a39a" containerID="72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b" exitCode=143 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.221782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"0a30004c-7036-4604-8fea-33ffd692a39a","Type":"ContainerDied","Data":"7f9377333fa47ffea5425ae287e8ffba676c5d8221d4572416218df149e39ca6"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.221808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"0a30004c-7036-4604-8fea-33ffd692a39a","Type":"ContainerDied","Data":"72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.245283 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.259551 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9dc26468-7e8c-4434-8bed-2a6ed91fa1eb/ovsdbserver-sb/0.log" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.259638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb","Type":"ContainerDied","Data":"9299c7c6c71303b82ba40195209d172d99a9eefe2355bf1cfa33ca64c0f8db05"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.259664 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9299c7c6c71303b82ba40195209d172d99a9eefe2355bf1cfa33ca64c0f8db05" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.268854 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.269653 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.285087 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.291640 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305303 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305339 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305347 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305354 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305362 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305368 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305376 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305383 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305389 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.305397 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.306339 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.306376 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="ovn-northd" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.327593 4769 generic.go:334] "Generic (PLEG): container finished" podID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" containerID="430453e445cddd84bb821265e71641462e43cb6e3ead94e9f3f1b29b37f4882f" exitCode=137 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.341153 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b257324-3e15-4f82-87a7-b6510652951a" containerID="15360538021fc052bef33c9c34ebae1d05603dc5a31bbd84daba9f7e3da6d60a" exitCode=143 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.351510 4769 generic.go:334] "Generic (PLEG): container finished" podID="e73113de-3961-438d-acd9-886c2db72385" containerID="12f02a05f413e8857f425ce4bbd37f702949440faf33c3309c7e81954e222613" exitCode=143 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.376111 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerID="8474f3bee160abdbfe40a398cfc6fd3dc69c47042bd45d32463964a7bfb491e6" exitCode=0 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.387646 4769 generic.go:334] "Generic (PLEG): container finished" podID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerID="43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de" exitCode=143 Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.404499 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198 is running failed: container process not found" containerID="e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.408359 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198 is running failed: container process not found" containerID="e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.415574 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198 is running failed: container process not found" containerID="e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:20:45 crc kubenswrapper[4769]: E1121 13:20:45.415631 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="ovsdbserver-sb" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.471421 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerName="galera" containerID="cri-o://8a6c581f1425e299fee1e4e6e1be11770c4a38740293ef00fad83aae0f71f499" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.575809 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06dda6f1-250b-496b-8545-c85e8ac91921" path="/var/lib/kubelet/pods/06dda6f1-250b-496b-8545-c85e8ac91921/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.576991 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120509e4-657e-40e6-be8c-cf569b931fa8" path="/var/lib/kubelet/pods/120509e4-657e-40e6-be8c-cf569b931fa8/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.579130 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1accd34e-cf48-4807-a34f-68d4f0f8f250" path="/var/lib/kubelet/pods/1accd34e-cf48-4807-a34f-68d4f0f8f250/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.579870 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34368a98-a12d-4728-828e-5d3de52901b3" path="/var/lib/kubelet/pods/34368a98-a12d-4728-828e-5d3de52901b3/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.580454 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="732a6a91-49bd-42d7-9007-af1835aa4024" path="/var/lib/kubelet/pods/732a6a91-49bd-42d7-9007-af1835aa4024/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.581660 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74d6a6f6-8260-449d-86a2-3a5d2d4bc18d" path="/var/lib/kubelet/pods/74d6a6f6-8260-449d-86a2-3a5d2d4bc18d/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.582158 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7745b13c-03b6-48ec-a3ca-fda54d77d5bb" path="/var/lib/kubelet/pods/7745b13c-03b6-48ec-a3ca-fda54d77d5bb/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.582657 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95da8079-c38d-4d8a-b573-1251c28fdec0" path="/var/lib/kubelet/pods/95da8079-c38d-4d8a-b573-1251c28fdec0/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.583235 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad71458a-e543-4b79-9748-40c0cc2aca18" path="/var/lib/kubelet/pods/ad71458a-e543-4b79-9748-40c0cc2aca18/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.586668 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9f6d7c8-4590-42c5-bace-ee43645040da" path="/var/lib/kubelet/pods/c9f6d7c8-4590-42c5-bace-ee43645040da/volumes" Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587628 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vzgj6"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587653 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587700 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587710 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587733 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587742 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587753 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587768 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-k2k7r"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587788 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587807 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" event={"ID":"6b257324-3e15-4f82-87a7-b6510652951a","Type":"ContainerDied","Data":"15360538021fc052bef33c9c34ebae1d05603dc5a31bbd84daba9f7e3da6d60a"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587817 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587829 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587850 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e73113de-3961-438d-acd9-886c2db72385","Type":"ContainerDied","Data":"12f02a05f413e8857f425ce4bbd37f702949440faf33c3309c7e81954e222613"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587862 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" event={"ID":"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc","Type":"ContainerDied","Data":"8474f3bee160abdbfe40a398cfc6fd3dc69c47042bd45d32463964a7bfb491e6"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587885 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2914ed85-6d74-4ebc-ae7c-11417e874ab1","Type":"ContainerDied","Data":"43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de"} Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587911 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement87ee-account-delete-s6pdt"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587925 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron985a-account-delete-cr2xl"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587936 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder8885-account-delete-7cg2c"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587945 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.587955 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance80a8-account-delete-65lmn"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.588136 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="26c27a21-dcc1-48a8-b4ea-fa384a28c315" containerName="kube-state-metrics" containerID="cri-o://8a8bcb12784225376247ec07d55ee253020968759273e0b4e1b31180083afd27" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.588622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" containerID="cri-o://2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.588799 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" containerID="cri-o://26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.588947 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" containerID="cri-o://2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.589035 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="b08d0a94-0636-40de-b613-a6ffecc06c12" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://39ac0c9ca848af57a4488ae7a4733f481488f46f542a7d5335e3a062c8d52cb1" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.589155 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-central-agent" containerID="cri-o://36b1bf769252086e38877bb15f5ce07c690500262ecd2aefe2205876a7ab2812" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.589233 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="proxy-httpd" containerID="cri-o://f728688765c11a8b9276f1b9090000fe2246b4eb2e98a7a9f4f1df8baeef17b5" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.589267 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="sg-core" containerID="cri-o://0bc7915362f1cc96b0d86321e9be9c9e72e608fa6ffde495e470378c70a37dd9" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.589296 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-notification-agent" containerID="cri-o://240fbceb280f0466787fb0af67fb6f961f5bff07573b4aa015615e3e197d9640" gracePeriod=30 Nov 21 13:20:45 crc kubenswrapper[4769]: W1121 13:20:45.590663 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c7aa71e_490d_4282_9b1f_26de919af8a4.slice/crio-4fd2353d6a658a95ff2cf7818d6373688c9a7e999cf2a4d13281e2c159c6da05 WatchSource:0}: Error finding container 4fd2353d6a658a95ff2cf7818d6373688c9a7e999cf2a4d13281e2c159c6da05: Status 404 returned error can't find the container with id 4fd2353d6a658a95ff2cf7818d6373688c9a7e999cf2a4d13281e2c159c6da05 Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.934812 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0f24d-account-delete-98zw4"] Nov 21 13:20:45 crc kubenswrapper[4769]: I1121 13:20:45.985592 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.189:5671: connect: connection refused" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.031857 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.032074 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-httpd" containerID="cri-o://869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9" gracePeriod=30 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.032419 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-server" containerID="cri-o://ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328" gracePeriod=30 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.042725 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_9dc26468-7e8c-4434-8bed-2a6ed91fa1eb/ovsdbserver-sb/0.log" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.042791 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051320 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdb-rundir\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-scripts\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdbserver-sb-tls-certs\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-config\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051521 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-metrics-certs-tls-certs\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk899\" (UniqueName: \"kubernetes.io/projected/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-kube-api-access-rk899\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-combined-ca-bundle\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.051733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\" (UID: \"9dc26468-7e8c-4434-8bed-2a6ed91fa1eb\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.052236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-scripts" (OuterVolumeSpecName: "scripts") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.052337 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052409 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052447 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.052433849 +0000 UTC m=+5406.753095667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "cert-nova-novncproxy-cell1-public-svc" not found Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.052594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052716 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052739 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.052732697 +0000 UTC m=+5406.753394515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "combined-ca-bundle" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052772 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052790 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.052784748 +0000 UTC m=+5406.753446566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "cert-kube-state-metrics-svc" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052817 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052832 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle podName:26c27a21-dcc1-48a8-b4ea-fa384a28c315 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.052827889 +0000 UTC m=+5406.753489707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315") : secret "combined-ca-bundle" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052859 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.052877 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs podName:b08d0a94-0636-40de-b613-a6ffecc06c12 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.05287212 +0000 UTC m=+5406.753533938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.061506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.067604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-config" (OuterVolumeSpecName: "config") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.080345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-kube-api-access-rk899" (OuterVolumeSpecName: "kube-api-access-rk899") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "kube-api-access-rk899". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.121033 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.128670 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="76a1ee99-6132-416f-8a48-9a7a8073e929" containerName="memcached" containerID="cri-o://418cae4cbab2263e5231f263abb5327311931af72a389f0fcd0e83592d4ebefb" gracePeriod=30 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.164571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.189735 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.189990 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.190003 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rk899\" (UniqueName: \"kubernetes.io/projected/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-kube-api-access-rk899\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.190019 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.190042 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.223269 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.234278 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k8lx8"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.260024 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-hhcgp"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.270427 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-k8lx8"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.274376 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.279881 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-hhcgp"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.285331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6bb546f66c-25blf"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.285574 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" podUID="ab913d48-455c-472c-8942-180b14a301d8" containerName="keystone-api" containerID="cri-o://765665de4dd1cfdfa579b855b613c34bf02bc2a7c6b5434c90e14bfe9b78d4a1" gracePeriod=30 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.292405 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret\") pod \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.292692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config\") pod \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.292727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xplv2\" (UniqueName: \"kubernetes.io/projected/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-kube-api-access-xplv2\") pod \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.292788 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-combined-ca-bundle\") pod \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\" (UID: \"e8bcf3a2-8158-4c12-85da-4ea99b70bfc1\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.293345 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.310840 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.320111 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.326502 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dk4kd"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.326960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-kube-api-access-xplv2" (OuterVolumeSpecName: "kube-api-access-xplv2") pod "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" (UID: "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1"). InnerVolumeSpecName "kube-api-access-xplv2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.331604 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dk4kd"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.333155 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" (UID: "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.338906 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-1b74-account-create-mvhlv"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.345830 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-1b74-account-create-mvhlv"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.364338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.395612 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.395642 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.395689 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xplv2\" (UniqueName: \"kubernetes.io/projected/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-kube-api-access-xplv2\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.395789 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.395833 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data podName:cdd3fc9d-251c-47d2-aba8-53f309ea4494 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:50.395820576 +0000 UTC m=+5409.096482384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data") pod "rabbitmq-cell1-server-0" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.404769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" (UID: "9dc26468-7e8c-4434-8bed-2a6ed91fa1eb"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.416560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" event={"ID":"d83cd1db-8da7-4977-889a-579eb4e3367a","Type":"ContainerStarted","Data":"266a151150c76d988a3fe5d9be866f39079df8644e2ab4ca5a8ff9968d914303"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.431320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" (UID: "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.444027 4769 generic.go:334] "Generic (PLEG): container finished" podID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerID="3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.444209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"546bcae7-9cd0-4153-9ebc-5f408d2b4eba","Type":"ContainerDied","Data":"3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.453031 4769 generic.go:334] "Generic (PLEG): container finished" podID="b08d0a94-0636-40de-b613-a6ffecc06c12" containerID="39ac0c9ca848af57a4488ae7a4733f481488f46f542a7d5335e3a062c8d52cb1" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.453091 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b08d0a94-0636-40de-b613-a6ffecc06c12","Type":"ContainerDied","Data":"39ac0c9ca848af57a4488ae7a4733f481488f46f542a7d5335e3a062c8d52cb1"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.463336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" (UID: "e8bcf3a2-8158-4c12-85da-4ea99b70bfc1"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.487373 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_0a30004c-7036-4604-8fea-33ffd692a39a/ovsdbserver-nb/0.log" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.487445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"0a30004c-7036-4604-8fea-33ffd692a39a","Type":"ContainerDied","Data":"3d97e817507793cf37ba793db59206cb15fb0dd37e61b2868e69430bdff20fd3"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.487469 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d97e817507793cf37ba793db59206cb15fb0dd37e61b2868e69430bdff20fd3" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.490689 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.492031 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_0a30004c-7036-4604-8fea-33ffd692a39a/ovsdbserver-nb/0.log" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.492094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.493316 4769 generic.go:334] "Generic (PLEG): container finished" podID="b728bee3-96ff-4142-9282-de05409ad732" containerID="5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400" exitCode=143 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.493389 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" event={"ID":"b728bee3-96ff-4142-9282-de05409ad732","Type":"ContainerDied","Data":"5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.497283 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.497306 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.497315 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.499990 4769 generic.go:334] "Generic (PLEG): container finished" podID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerID="ceec5e9ae4db59a6c071fcac05945b9798302c0e45510e38eb06fb0c28b6a2ca" exitCode=143 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.500058 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f9e7d8a7-0ab6-433c-a590-8a908ae70d01","Type":"ContainerDied","Data":"ceec5e9ae4db59a6c071fcac05945b9798302c0e45510e38eb06fb0c28b6a2ca"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.510034 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerID="01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664" exitCode=143 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.510103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" event={"ID":"7bd38baf-c2f2-4755-826d-27eeca7b2c1c","Type":"ContainerDied","Data":"01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.511783 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" event={"ID":"bf19d867-b143-4d9e-a5c7-99f6ece00271","Type":"ContainerStarted","Data":"2a6252200e43b8e7f6a28236e8ed2667ca9d99c8654109d13e68db86cc996375"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.512957 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" event={"ID":"011db835-c98c-4f22-8167-d07b161ac7f2","Type":"ContainerStarted","Data":"9bc0ec4a0d6ba8bc501e188899bae316c34afaa91e3ab25f6616d2775f402be9"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.515779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" event={"ID":"1015deb7-ba46-4b81-8a0d-3767e6b5829d","Type":"ContainerStarted","Data":"deaa916c0906b568d97248035fabe0fde0420718cdc80fa00a0eb731c5082ee2"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.519827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" event={"ID":"86068992-fbf9-40e2-88a1-456bb9d59cbe","Type":"ContainerStarted","Data":"57ec44ed8ccc6662b1869365f2c531c9f9024f16d9e49225fdc91144468a372f"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.521639 4769 generic.go:334] "Generic (PLEG): container finished" podID="26c27a21-dcc1-48a8-b4ea-fa384a28c315" containerID="8a8bcb12784225376247ec07d55ee253020968759273e0b4e1b31180083afd27" exitCode=2 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.521682 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"26c27a21-dcc1-48a8-b4ea-fa384a28c315","Type":"ContainerDied","Data":"8a8bcb12784225376247ec07d55ee253020968759273e0b4e1b31180083afd27"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544218 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544246 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544253 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544259 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.544365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.548689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" event={"ID":"6dc0a443-6a8e-43fd-8612-01cfe8196876","Type":"ContainerStarted","Data":"3539080b1f47168a3235d51496094b8a25ee357eb564d74ed6dca74e77c4ae48"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.550706 4769 scope.go:117] "RemoveContainer" containerID="430453e445cddd84bb821265e71641462e43cb6e3ead94e9f3f1b29b37f4882f" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.550744 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.552397 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.552665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" event={"ID":"9c7aa71e-490d-4282-9b1f-26de919af8a4","Type":"ContainerStarted","Data":"4fd2353d6a658a95ff2cf7818d6373688c9a7e999cf2a4d13281e2c159c6da05"} Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.554015 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.563319 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.563360 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.564175 4769 generic.go:334] "Generic (PLEG): container finished" podID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerID="8261509e5db67b1ce557d83ed76661488c4a905b3b1f4250e78780eb60cab733" exitCode=143 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.564241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" event={"ID":"113d6870-bffb-4ac9-8f23-3d4463d37245","Type":"ContainerDied","Data":"8261509e5db67b1ce557d83ed76661488c4a905b3b1f4250e78780eb60cab733"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.571632 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerID="15888949b29d204ac86a4426582988850fb8b58bb4b10c0b63169560d49becb8" exitCode=143 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.571773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1ac95b70-d511-44d0-b6f0-2f66169bbad4","Type":"ContainerDied","Data":"15888949b29d204ac86a4426582988850fb8b58bb4b10c0b63169560d49becb8"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.573881 4769 generic.go:334] "Generic (PLEG): container finished" podID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerID="869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.573926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" event={"ID":"766fca12-6311-4b42-beeb-bd6dfbc3dce3","Type":"ContainerDied","Data":"869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602536 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-metrics-certs-tls-certs\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9bww\" (UniqueName: \"kubernetes.io/projected/0a30004c-7036-4604-8fea-33ffd692a39a-kube-api-access-k9bww\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-config\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdb-rundir\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-combined-ca-bundle\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602800 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-scripts\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.602955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdbserver-nb-tls-certs\") pod \"0a30004c-7036-4604-8fea-33ffd692a39a\" (UID: \"0a30004c-7036-4604-8fea-33ffd692a39a\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.604291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.604450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-config" (OuterVolumeSpecName: "config") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.605488 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5a91599-04eb-42eb-a583-666c0552a16f" containerID="8f46547bd724f15a906dff1f908869f1b610836a8a2d4ddf20148f9a22b4d334" exitCode=143 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.605572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f5a91599-04eb-42eb-a583-666c0552a16f","Type":"ContainerDied","Data":"8f46547bd724f15a906dff1f908869f1b610836a8a2d4ddf20148f9a22b4d334"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.608658 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerID="f728688765c11a8b9276f1b9090000fe2246b4eb2e98a7a9f4f1df8baeef17b5" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.608672 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerID="0bc7915362f1cc96b0d86321e9be9c9e72e608fa6ffde495e470378c70a37dd9" exitCode=2 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.608680 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerID="36b1bf769252086e38877bb15f5ce07c690500262ecd2aefe2205876a7ab2812" exitCode=0 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.608733 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.614296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerDied","Data":"f728688765c11a8b9276f1b9090000fe2246b4eb2e98a7a9f4f1df8baeef17b5"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.614322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerDied","Data":"0bc7915362f1cc96b0d86321e9be9c9e72e608fa6ffde495e470378c70a37dd9"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.614332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerDied","Data":"36b1bf769252086e38877bb15f5ce07c690500262ecd2aefe2205876a7ab2812"} Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.604489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-scripts" (OuterVolumeSpecName: "scripts") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.633625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a30004c-7036-4604-8fea-33ffd692a39a-kube-api-access-k9bww" (OuterVolumeSpecName: "kube-api-access-k9bww") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "kube-api-access-k9bww". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.633827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.660304 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.678289 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.695307 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.704908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-config\") pod \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.705032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle\") pod \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.705629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs\") pod \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.705728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g8rp\" (UniqueName: \"kubernetes.io/projected/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-api-access-7g8rp\") pod \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\" (UID: \"26c27a21-dcc1-48a8-b4ea-fa384a28c315\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.706273 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k9bww\" (UniqueName: \"kubernetes.io/projected/0a30004c-7036-4604-8fea-33ffd692a39a-kube-api-access-k9bww\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.706340 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.706350 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.706371 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.706384 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0a30004c-7036-4604-8fea-33ffd692a39a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.718085 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-api-access-7g8rp" (OuterVolumeSpecName: "kube-api-access-7g8rp") pod "26c27a21-dcc1-48a8-b4ea-fa384a28c315" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315"). InnerVolumeSpecName "kube-api-access-7g8rp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.773393 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" containerName="galera" containerID="cri-o://2f4f3e90046e483bb711b36f5823b5f9ae214a329eba2cafa8e19c1887b99826" gracePeriod=30 Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.812736 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7g8rp\" (UniqueName: \"kubernetes.io/projected/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-api-access-7g8rp\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.813039 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:20:46 crc kubenswrapper[4769]: E1121 13:20:46.813215 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data podName:532433c6-42b6-4674-977f-8a7a23614deb nodeName:}" failed. No retries permitted until 2025-11-21 13:20:50.813173338 +0000 UTC m=+5409.513835156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data") pod "rabbitmq-server-0" (UID: "532433c6-42b6-4674-977f-8a7a23614deb") : configmap "rabbitmq-config-data" not found Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.835073 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.914620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs\") pod \"b08d0a94-0636-40de-b613-a6ffecc06c12\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.914978 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-config-data\") pod \"b08d0a94-0636-40de-b613-a6ffecc06c12\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.915143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs\") pod \"b08d0a94-0636-40de-b613-a6ffecc06c12\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.915254 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle\") pod \"b08d0a94-0636-40de-b613-a6ffecc06c12\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.915856 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7wcg\" (UniqueName: \"kubernetes.io/projected/b08d0a94-0636-40de-b613-a6ffecc06c12-kube-api-access-q7wcg\") pod \"b08d0a94-0636-40de-b613-a6ffecc06c12\" (UID: \"b08d0a94-0636-40de-b613-a6ffecc06c12\") " Nov 21 13:20:46 crc kubenswrapper[4769]: I1121 13:20:46.956873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08d0a94-0636-40de-b613-a6ffecc06c12-kube-api-access-q7wcg" (OuterVolumeSpecName: "kube-api-access-q7wcg") pod "b08d0a94-0636-40de-b613-a6ffecc06c12" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12"). InnerVolumeSpecName "kube-api-access-q7wcg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.019214 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q7wcg\" (UniqueName: \"kubernetes.io/projected/b08d0a94-0636-40de-b613-a6ffecc06c12-kube-api-access-q7wcg\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.048649 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.071780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.115879 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.121330 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.121359 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.168322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26c27a21-dcc1-48a8-b4ea-fa384a28c315" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.190885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-config-data" (OuterVolumeSpecName: "config-data") pod "b08d0a94-0636-40de-b613-a6ffecc06c12" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.192838 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "26c27a21-dcc1-48a8-b4ea-fa384a28c315" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.222901 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8zqh\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-kube-api-access-r8zqh\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.222943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-public-tls-certs\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.222966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-internal-tls-certs\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.222997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-etc-swift\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-run-httpd\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223259 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-log-httpd\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-combined-ca-bundle\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-config-data\") pod \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\" (UID: \"766fca12-6311-4b42-beeb-bd6dfbc3dce3\") " Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223768 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223785 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.223796 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.223872 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.223918 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.22390429 +0000 UTC m=+5409.924566108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "combined-ca-bundle" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224635 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-scripts: secret "placement-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224667 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.22465932 +0000 UTC m=+5409.925321138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224672 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-public-svc: secret "cert-placement-public-svc" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224699 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/cert-placement-internal-svc: secret "cert-placement-internal-svc" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224719 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.224713341 +0000 UTC m=+5409.925375159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-internal-svc" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224732 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.224726301 +0000 UTC m=+5409.925388119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "cert-placement-public-svc" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224761 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/placement-config-data: secret "placement-config-data" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.224780 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data podName:6b257324-3e15-4f82-87a7-b6510652951a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.224775663 +0000 UTC m=+5409.925437471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data") pod "placement-67959f9746-jwjb9" (UID: "6b257324-3e15-4f82-87a7-b6510652951a") : secret "placement-config-data" not found Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.225378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.225488 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.226617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b08d0a94-0636-40de-b613-a6ffecc06c12" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.228895 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-kube-api-access-r8zqh" (OuterVolumeSpecName: "kube-api-access-r8zqh") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "kube-api-access-r8zqh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.240976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.271111 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "26c27a21-dcc1-48a8-b4ea-fa384a28c315" (UID: "26c27a21-dcc1-48a8-b4ea-fa384a28c315"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.280559 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.280989 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.314452 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e3b1e9-f21b-4557-9e45-0549dd8929ff" path="/var/lib/kubelet/pods/25e3b1e9-f21b-4557-9e45-0549dd8929ff/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.315100 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf3f41a-698e-45cf-8660-4a2f1318ea4a" path="/var/lib/kubelet/pods/2cf3f41a-698e-45cf-8660-4a2f1318ea4a/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.315741 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63079ec2-d114-482b-944a-39b1cc0a9315" path="/var/lib/kubelet/pods/63079ec2-d114-482b-944a-39b1cc0a9315/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.316390 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3f7a0e-20e7-4571-aa36-738a676580a3" path="/var/lib/kubelet/pods/7c3f7a0e-20e7-4571-aa36-738a676580a3/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.317581 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a44a904-1fdb-4823-bb25-1e383dca3a29" path="/var/lib/kubelet/pods/9a44a904-1fdb-4823-bb25-1e383dca3a29/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.318333 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" path="/var/lib/kubelet/pods/9dc26468-7e8c-4434-8bed-2a6ed91fa1eb/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.319788 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee" path="/var/lib/kubelet/pods/d60d8bcf-c7bb-4fe6-8a00-70dcfc23d1ee/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.320476 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8bcf3a2-8158-4c12-85da-4ea99b70bfc1" path="/var/lib/kubelet/pods/e8bcf3a2-8158-4c12-85da-4ea99b70bfc1/volumes" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.333465 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/26c27a21-dcc1-48a8-b4ea-fa384a28c315-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.333510 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.333529 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r8zqh\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-kube-api-access-r8zqh\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.333541 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/766fca12-6311-4b42-beeb-bd6dfbc3dce3-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.333550 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/766fca12-6311-4b42-beeb-bd6dfbc3dce3-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.333563 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.380565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "b08d0a94-0636-40de-b613-a6ffecc06c12" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.391745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "b08d0a94-0636-40de-b613-a6ffecc06c12" (UID: "b08d0a94-0636-40de-b613-a6ffecc06c12"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.404270 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.435912 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.435944 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/b08d0a94-0636-40de-b613-a6ffecc06c12-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.435954 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.436160 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.450443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.453240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "0a30004c-7036-4604-8fea-33ffd692a39a" (UID: "0a30004c-7036-4604-8fea-33ffd692a39a"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.474488 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.491834 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-config-data" (OuterVolumeSpecName: "config-data") pod "766fca12-6311-4b42-beeb-bd6dfbc3dce3" (UID: "766fca12-6311-4b42-beeb-bd6dfbc3dce3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.537999 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.538237 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.538249 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.538259 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/766fca12-6311-4b42-beeb-bd6dfbc3dce3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.538269 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a30004c-7036-4604-8fea-33ffd692a39a-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.623056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" event={"ID":"1015deb7-ba46-4b81-8a0d-3767e6b5829d","Type":"ContainerStarted","Data":"99fc62aaca7cc7aaa38d5170f6a9aef6a7a0a5b5c487d3558f5771e25662577d"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.623593 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.630084 4769 generic.go:334] "Generic (PLEG): container finished" podID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerID="ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328" exitCode=0 Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.630147 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" event={"ID":"766fca12-6311-4b42-beeb-bd6dfbc3dce3","Type":"ContainerDied","Data":"ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.630173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" event={"ID":"766fca12-6311-4b42-beeb-bd6dfbc3dce3","Type":"ContainerDied","Data":"1c9cfc78a5ad7f6950ed6ce8bd83f8579149f880add6751d6d6d3bdc29cfb407"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.630227 4769 scope.go:117] "RemoveContainer" containerID="ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.630365 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.636300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" event={"ID":"86068992-fbf9-40e2-88a1-456bb9d59cbe","Type":"ContainerStarted","Data":"aaf0ce07622f50a461eae71918281ebf37af3872cf521ffd6ed3cb669e1072fb"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.636751 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.643133 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" podStartSLOduration=4.643116572 podStartE2EDuration="4.643116572s" podCreationTimestamp="2025-11-21 13:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.6387958 +0000 UTC m=+5406.339457618" watchObservedRunningTime="2025-11-21 13:20:47.643116572 +0000 UTC m=+5406.343778380" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.645784 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.645782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"26c27a21-dcc1-48a8-b4ea-fa384a28c315","Type":"ContainerDied","Data":"277d508eef92012ec6e33205a2f530434709ede33f639e4d1419a982e8a58972"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.651601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"b08d0a94-0636-40de-b613-a6ffecc06c12","Type":"ContainerDied","Data":"434b617ee1c93a1806b06fe300d3790693880b5cbfe2648b09841dad55e123a3"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.651697 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.662836 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" podStartSLOduration=4.662819142 podStartE2EDuration="4.662819142s" podCreationTimestamp="2025-11-21 13:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.661025936 +0000 UTC m=+5406.361687754" watchObservedRunningTime="2025-11-21 13:20:47.662819142 +0000 UTC m=+5406.363480960" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.664813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" event={"ID":"011db835-c98c-4f22-8167-d07b161ac7f2","Type":"ContainerStarted","Data":"5be2094edc8d34604e6e2f832b5eef3088010b1f5deac7dbb19aa06a35b74be7"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.665631 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.669762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" event={"ID":"d83cd1db-8da7-4977-889a-579eb4e3367a","Type":"ContainerStarted","Data":"6d97557c542c2a164a87f4bfc1f697513d12972250e2b849766c32f1cc959314"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.670292 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.673089 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" event={"ID":"6dc0a443-6a8e-43fd-8612-01cfe8196876","Type":"ContainerStarted","Data":"d506840060e7eabda62be3f50c47f7e4a80d0514ec2e158b2e5f22eea6dc3efd"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.674314 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.675471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" event={"ID":"9c7aa71e-490d-4282-9b1f-26de919af8a4","Type":"ContainerStarted","Data":"e296c3c463c4056af81480df26b9bc522f01bd50202481d3a57c0bc953b2742d"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.676308 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.686930 4769 generic.go:334] "Generic (PLEG): container finished" podID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerID="8a6c581f1425e299fee1e4e6e1be11770c4a38740293ef00fad83aae0f71f499" exitCode=0 Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.687056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"550f37a2-49a9-43e6-8bc5-d4787232f49a","Type":"ContainerDied","Data":"8a6c581f1425e299fee1e4e6e1be11770c4a38740293ef00fad83aae0f71f499"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.688294 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" podStartSLOduration=5.688270211 podStartE2EDuration="5.688270211s" podCreationTimestamp="2025-11-21 13:20:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.677047691 +0000 UTC m=+5406.377709509" watchObservedRunningTime="2025-11-21 13:20:47.688270211 +0000 UTC m=+5406.388932019" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.690001 4769 generic.go:334] "Generic (PLEG): container finished" podID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerID="73d718eb673c6658d0573f2d0fd781e8b3871353cc4f2b06e3fd317fc74fb8e5" exitCode=0 Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.690078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" event={"ID":"a1e6bd23-a129-40d9-812b-998d49dbb376","Type":"ContainerDied","Data":"73d718eb673c6658d0573f2d0fd781e8b3871353cc4f2b06e3fd317fc74fb8e5"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.690108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" event={"ID":"a1e6bd23-a129-40d9-812b-998d49dbb376","Type":"ContainerStarted","Data":"466ad876bf5f6fedea9cf84ead40f355ca83e7b07973fc6df683eed349f78e1a"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.700329 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" podStartSLOduration=4.700314914 podStartE2EDuration="4.700314914s" podCreationTimestamp="2025-11-21 13:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.696529646 +0000 UTC m=+5406.397191464" watchObservedRunningTime="2025-11-21 13:20:47.700314914 +0000 UTC m=+5406.400976732" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.705902 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.706924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" event={"ID":"bf19d867-b143-4d9e-a5c7-99f6ece00271","Type":"ContainerStarted","Data":"119181dfcc69e1dc873ee36fc1a176d2bfcc8241100c839c0d10f051e03b2111"} Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.711779 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.717024 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" podStartSLOduration=4.716991396 podStartE2EDuration="4.716991396s" podCreationTimestamp="2025-11-21 13:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.708133326 +0000 UTC m=+5406.408795144" watchObservedRunningTime="2025-11-21 13:20:47.716991396 +0000 UTC m=+5406.417653214" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.736665 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" podStartSLOduration=4.736645095 podStartE2EDuration="4.736645095s" podCreationTimestamp="2025-11-21 13:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.724401718 +0000 UTC m=+5406.425063556" watchObservedRunningTime="2025-11-21 13:20:47.736645095 +0000 UTC m=+5406.437306913" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.738804 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" podStartSLOduration=3.7387935 podStartE2EDuration="3.7387935s" podCreationTimestamp="2025-11-21 13:20:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:47.735035233 +0000 UTC m=+5406.435697061" watchObservedRunningTime="2025-11-21 13:20:47.7387935 +0000 UTC m=+5406.439455328" Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.743907 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.743966 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.243950384 +0000 UTC m=+5406.944612202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744424 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744457 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.244449887 +0000 UTC m=+5406.945111705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744689 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744714 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.244708204 +0000 UTC m=+5406.945370012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744741 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744751 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744779 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744760 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.244754295 +0000 UTC m=+5406.945416113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744828 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.244813526 +0000 UTC m=+5406.945475434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.744843 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.244835687 +0000 UTC m=+5406.945497505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.745117 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.745148 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:20:48.245141775 +0000 UTC m=+5406.945803593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.764914 4769 scope.go:117] "RemoveContainer" containerID="869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.802806 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.808443 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.819700 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.827325 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.840671 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.850218 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.855391 4769 scope.go:117] "RemoveContainer" containerID="ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328" Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.858686 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328\": container with ID starting with ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328 not found: ID does not exist" containerID="ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.858717 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328"} err="failed to get container status \"ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328\": rpc error: code = NotFound desc = could not find container \"ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328\": container with ID starting with ae40937f006b845844a8aeef4a7441303c422ed1d7349f77c02e6873ff683328 not found: ID does not exist" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.858737 4769 scope.go:117] "RemoveContainer" containerID="869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9" Nov 21 13:20:47 crc kubenswrapper[4769]: E1121 13:20:47.858906 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9\": container with ID starting with 869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9 not found: ID does not exist" containerID="869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.858928 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9"} err="failed to get container status \"869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9\": rpc error: code = NotFound desc = could not find container \"869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9\": container with ID starting with 869a9f920d4cde51993aeb8b4335688a4b937e5e64dddfbaecf71c9ef2126bd9 not found: ID does not exist" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.858939 4769 scope.go:117] "RemoveContainer" containerID="8a8bcb12784225376247ec07d55ee253020968759273e0b4e1b31180083afd27" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.863539 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.868745 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.879854 4769 scope.go:117] "RemoveContainer" containerID="39ac0c9ca848af57a4488ae7a4733f481488f46f542a7d5335e3a062c8d52cb1" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.933175 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:20:47 crc kubenswrapper[4769]: I1121 13:20:47.998341 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fgbqv"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.007735 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-fgbqv"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.025224 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement87ee-account-delete-s6pdt"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.032960 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-87ee-account-create-mk6k4"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.038804 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-87ee-account-create-mk6k4"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049178 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpqxs\" (UniqueName: \"kubernetes.io/projected/550f37a2-49a9-43e6-8bc5-d4787232f49a-kube-api-access-kpqxs\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-default\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049380 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-kolla-config\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-operator-scripts\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049556 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-combined-ca-bundle\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-galera-tls-certs\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.049658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-generated\") pod \"550f37a2-49a9-43e6-8bc5-d4787232f49a\" (UID: \"550f37a2-49a9-43e6-8bc5-d4787232f49a\") " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.051108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.052358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.052508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.053465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.056896 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550f37a2-49a9-43e6-8bc5-d4787232f49a-kube-api-access-kpqxs" (OuterVolumeSpecName: "kube-api-access-kpqxs") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "kube-api-access-kpqxs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.061256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage17-crc" (OuterVolumeSpecName: "mysql-db") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "local-storage17-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.078554 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.126304 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cb8pt"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.149907 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-cb8pt"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152413 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152444 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kpqxs\" (UniqueName: \"kubernetes.io/projected/550f37a2-49a9-43e6-8bc5-d4787232f49a-kube-api-access-kpqxs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152453 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152464 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152492 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" " Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152505 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/550f37a2-49a9-43e6-8bc5-d4787232f49a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.152517 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.158596 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron985a-account-delete-cr2xl"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.162236 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "550f37a2-49a9-43e6-8bc5-d4787232f49a" (UID: "550f37a2-49a9-43e6-8bc5-d4787232f49a"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.167949 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-985a-account-create-xv7tg"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.173220 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-985a-account-create-xv7tg"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.176019 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage17-crc" (UniqueName: "kubernetes.io/local-volume/local-storage17-crc") on node "crc" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.254852 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage17-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage17-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.254888 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/550f37a2-49a9-43e6-8bc5-d4787232f49a-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.254960 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255017 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.255001055 +0000 UTC m=+5407.955662883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255411 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255444 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.255433896 +0000 UTC m=+5407.956095734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255474 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255499 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.255492048 +0000 UTC m=+5407.956153876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255526 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255548 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.255541699 +0000 UTC m=+5407.956203527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255576 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255597 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.25559067 +0000 UTC m=+5407.956252508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255625 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255648 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.255641772 +0000 UTC m=+5407.956303600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255674 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.255696 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:49.255689653 +0000 UTC m=+5407.956351481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.324252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s5kcn"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.333011 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-s5kcn"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.351508 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-aa33-account-create-4gmsv"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.361841 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5"] Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.362814 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.364289 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.365532 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:20:48 crc kubenswrapper[4769]: E1121 13:20:48.365592 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.367544 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-aa33-account-create-4gmsv"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.477207 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-8z25b"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.493266 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-8z25b"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.502627 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-8885-account-create-x7frl"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.554126 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-8885-account-create-x7frl"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.567798 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder8885-account-delete-7cg2c"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.571463 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-dkftj"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.580684 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-dkftj"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.595831 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.158:9311/healthcheck\": read tcp 10.217.0.2:45220->10.217.0.158:9311: read: connection reset by peer" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.596151 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.158:9311/healthcheck\": read tcp 10.217.0.2:45218->10.217.0.158:9311: read: connection reset by peer" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.597277 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-80a8-account-create-wdrsx"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.605568 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance80a8-account-delete-65lmn"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.612102 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-80a8-account-create-wdrsx"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.664001 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.156:8775/\": dial tcp 10.217.0.156:8775: connect: connection refused" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.664008 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.156:8775/\": dial tcp 10.217.0.156:8775: connect: connection refused" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.695307 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.159:8776/healthcheck\": dial tcp 10.217.0.159:8776: connect: connection refused" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.718341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" event={"ID":"a1e6bd23-a129-40d9-812b-998d49dbb376","Type":"ContainerStarted","Data":"d470e322fb9c2ecc9deb2938524dc2595360048920acee94605912dfd548ba7c"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.718518 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.720628 4769 generic.go:334] "Generic (PLEG): container finished" podID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerID="3a41d8e27027f69228803146853ccc8f5dad3ec8ba14125f317fc0a8d9eaa800" exitCode=0 Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.720662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" event={"ID":"113d6870-bffb-4ac9-8f23-3d4463d37245","Type":"ContainerDied","Data":"3a41d8e27027f69228803146853ccc8f5dad3ec8ba14125f317fc0a8d9eaa800"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.722516 4769 generic.go:334] "Generic (PLEG): container finished" podID="e73113de-3961-438d-acd9-886c2db72385" containerID="fb93df30b6001a9be0414bd1042aa0d363e8be222763a54a21ccbda58e264729" exitCode=0 Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.722572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e73113de-3961-438d-acd9-886c2db72385","Type":"ContainerDied","Data":"fb93df30b6001a9be0414bd1042aa0d363e8be222763a54a21ccbda58e264729"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.724312 4769 generic.go:334] "Generic (PLEG): container finished" podID="76a1ee99-6132-416f-8a48-9a7a8073e929" containerID="418cae4cbab2263e5231f263abb5327311931af72a389f0fcd0e83592d4ebefb" exitCode=0 Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.724368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"76a1ee99-6132-416f-8a48-9a7a8073e929","Type":"ContainerDied","Data":"418cae4cbab2263e5231f263abb5327311931af72a389f0fcd0e83592d4ebefb"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.724440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"76a1ee99-6132-416f-8a48-9a7a8073e929","Type":"ContainerDied","Data":"ab3480bde1f8cdbd4c2b8ee058cc75184bd6e5739652888d8b504040acb5cb02"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.724454 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab3480bde1f8cdbd4c2b8ee058cc75184bd6e5739652888d8b504040acb5cb02" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.740992 4769 generic.go:334] "Generic (PLEG): container finished" podID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerID="14e60c29fdf5f6a03d66db49ee3c700b970c8ee0827320db8caa98a96d972cbc" exitCode=0 Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.741053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f9e7d8a7-0ab6-433c-a590-8a908ae70d01","Type":"ContainerDied","Data":"14e60c29fdf5f6a03d66db49ee3c700b970c8ee0827320db8caa98a96d972cbc"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.745987 4769 generic.go:334] "Generic (PLEG): container finished" podID="cf393762-ecdb-4462-8198-0f85d54912e7" containerID="2f4f3e90046e483bb711b36f5823b5f9ae214a329eba2cafa8e19c1887b99826" exitCode=0 Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.746055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"cf393762-ecdb-4462-8198-0f85d54912e7","Type":"ContainerDied","Data":"2f4f3e90046e483bb711b36f5823b5f9ae214a329eba2cafa8e19c1887b99826"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.747537 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" podStartSLOduration=4.747522586 podStartE2EDuration="4.747522586s" podCreationTimestamp="2025-11-21 13:20:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:20:48.741054138 +0000 UTC m=+5407.441715976" watchObservedRunningTime="2025-11-21 13:20:48.747522586 +0000 UTC m=+5407.448184414" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.749790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"550f37a2-49a9-43e6-8bc5-d4787232f49a","Type":"ContainerDied","Data":"983221e14dce7a3272bd9235c0ca8b59a76e338c3f27703b7f5cd36a851614e9"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.749837 4769 scope.go:117] "RemoveContainer" containerID="8a6c581f1425e299fee1e4e6e1be11770c4a38740293ef00fad83aae0f71f499" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.749969 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.758530 4769 generic.go:334] "Generic (PLEG): container finished" podID="6b257324-3e15-4f82-87a7-b6510652951a" containerID="4f8d47da9752b3301435660772a5b9a18c405c8ded394b8412e868df9f4472f8" exitCode=0 Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.758828 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" event={"ID":"6b257324-3e15-4f82-87a7-b6510652951a","Type":"ContainerDied","Data":"4f8d47da9752b3301435660772a5b9a18c405c8ded394b8412e868df9f4472f8"} Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.759529 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.766860 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.767408 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.767709 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.767970 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.768267 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.768629 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" secret="" err="secret \"galera-openstack-dockercfg-ngfw2\" not found" Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.944805 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-q2h4q"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.950329 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-q2h4q"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.974256 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.979929 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f24d-account-create-j782s"] Nov 21 13:20:48 crc kubenswrapper[4769]: I1121 13:20:48.987933 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0f24d-account-delete-98zw4"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.164700 4769 scope.go:117] "RemoveContainer" containerID="e5e9da381997ba1cc439add77d4946e84fc2cb4b35ffa59d4229e2dfd3b29d58" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.184891 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.189689 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.191104 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.191697 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.241375 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.247904 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.261273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-zl7nx"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.292753 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" path="/var/lib/kubelet/pods/0a30004c-7036-4604-8fea-33ffd692a39a/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.293641 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd784d1-60a3-4d8f-94c9-7ed460143f00" path="/var/lib/kubelet/pods/0cd784d1-60a3-4d8f-94c9-7ed460143f00/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.295085 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c27a21-dcc1-48a8-b4ea-fa384a28c315" path="/var/lib/kubelet/pods/26c27a21-dcc1-48a8-b4ea-fa384a28c315/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.296542 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b80cab6-1658-446e-9925-04195053566e" path="/var/lib/kubelet/pods/2b80cab6-1658-446e-9925-04195053566e/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.297122 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3962bd7f-0adf-4443-9d35-6f726f976e5e" path="/var/lib/kubelet/pods/3962bd7f-0adf-4443-9d35-6f726f976e5e/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.297779 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98" path="/var/lib/kubelet/pods/45cccfa6-c0ca-4ae1-a0a5-244d4dfedb98/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.299592 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" path="/var/lib/kubelet/pods/550f37a2-49a9-43e6-8bc5-d4787232f49a/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.300161 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69486421-e690-4d51-b0e8-b3c319cd058b" path="/var/lib/kubelet/pods/69486421-e690-4d51-b0e8-b3c319cd058b/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.300818 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" path="/var/lib/kubelet/pods/766fca12-6311-4b42-beeb-bd6dfbc3dce3/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.302346 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac22474c-69bf-4242-921d-8401864d88d4" path="/var/lib/kubelet/pods/ac22474c-69bf-4242-921d-8401864d88d4/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.302952 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac295c82-00b1-4c2a-930d-3abbe3157018" path="/var/lib/kubelet/pods/ac295c82-00b1-4c2a-930d-3abbe3157018/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.303524 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08d0a94-0636-40de-b613-a6ffecc06c12" path="/var/lib/kubelet/pods/b08d0a94-0636-40de-b613-a6ffecc06c12/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.304639 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894" path="/var/lib/kubelet/pods/b1fedfb9-7d53-4e8d-8bf9-b5b7a3e69894/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.305159 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e" path="/var/lib/kubelet/pods/bb213d15-7ca5-4e6e-ab56-f5a89ba7e33e/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.305645 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0db106-c6fb-4bf7-bdae-434a1d40598a" path="/var/lib/kubelet/pods/cc0db106-c6fb-4bf7-bdae-434a1d40598a/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.306173 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da23ab45-177b-4767-963b-56eb10bd7517" path="/var/lib/kubelet/pods/da23ab45-177b-4767-963b-56eb10bd7517/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307669 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-public-tls-certs\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-config-data\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307777 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj8vx\" (UniqueName: \"kubernetes.io/projected/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-kube-api-access-cj8vx\") pod \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmbm4\" (UniqueName: \"kubernetes.io/projected/6b257324-3e15-4f82-87a7-b6510652951a-kube-api-access-gmbm4\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307850 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-combined-ca-bundle\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-combined-ca-bundle\") pod \"76a1ee99-6132-416f-8a48-9a7a8073e929\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307930 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-httpd-run\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b257324-3e15-4f82-87a7-b6510652951a-logs\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.307968 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-memcached-tls-certs\") pod \"76a1ee99-6132-416f-8a48-9a7a8073e929\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-combined-ca-bundle\") pod \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308029 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-scripts\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-kolla-config\") pod \"76a1ee99-6132-416f-8a48-9a7a8073e929\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308075 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-logs\") pod \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308111 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-config-data\") pod \"76a1ee99-6132-416f-8a48-9a7a8073e929\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlfq7\" (UniqueName: \"kubernetes.io/projected/76a1ee99-6132-416f-8a48-9a7a8073e929-kube-api-access-zlfq7\") pod \"76a1ee99-6132-416f-8a48-9a7a8073e929\" (UID: \"76a1ee99-6132-416f-8a48-9a7a8073e929\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtkj5\" (UniqueName: \"kubernetes.io/projected/e73113de-3961-438d-acd9-886c2db72385-kube-api-access-rtkj5\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-nova-metadata-tls-certs\") pod \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308338 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-config-data\") pod \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\" (UID: \"f9e7d8a7-0ab6-433c-a590-8a908ae70d01\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308370 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-logs\") pod \"e73113de-3961-438d-acd9-886c2db72385\" (UID: \"e73113de-3961-438d-acd9-886c2db72385\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.308408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs\") pod \"6b257324-3e15-4f82-87a7-b6510652951a\" (UID: \"6b257324-3e15-4f82-87a7-b6510652951a\") " Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.308930 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.308988 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.308970772 +0000 UTC m=+5410.009632590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.311132 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-config-data" (OuterVolumeSpecName: "config-data") pod "76a1ee99-6132-416f-8a48-9a7a8073e929" (UID: "76a1ee99-6132-416f-8a48-9a7a8073e929"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311735 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311786 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.311770805 +0000 UTC m=+5410.012432623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311820 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311844 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.311837117 +0000 UTC m=+5410.012498945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311870 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311889 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.311882548 +0000 UTC m=+5410.012544366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311918 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.311940 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.311933289 +0000 UTC m=+5410.012595107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.312399 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa487be8-a1c5-460b-991c-d171c4048851" path="/var/lib/kubelet/pods/fa487be8-a1c5-460b-991c-d171c4048851/volumes" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.313940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.314248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b257324-3e15-4f82-87a7-b6510652951a-logs" (OuterVolumeSpecName: "logs") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.314684 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-logs" (OuterVolumeSpecName: "logs") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.317066 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73113de-3961-438d-acd9-886c2db72385-kube-api-access-rtkj5" (OuterVolumeSpecName: "kube-api-access-rtkj5") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "kube-api-access-rtkj5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.317595 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.317750 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.317701678 +0000 UTC m=+5410.018363496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.317839 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: E1121 13:20:49.317872 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:20:51.317864693 +0000 UTC m=+5410.018526511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.318554 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "76a1ee99-6132-416f-8a48-9a7a8073e929" (UID: "76a1ee99-6132-416f-8a48-9a7a8073e929"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.321796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-logs" (OuterVolumeSpecName: "logs") pod "f9e7d8a7-0ab6-433c-a590-8a908ae70d01" (UID: "f9e7d8a7-0ab6-433c-a590-8a908ae70d01"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.326567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts" (OuterVolumeSpecName: "scripts") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.327024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a1ee99-6132-416f-8a48-9a7a8073e929-kube-api-access-zlfq7" (OuterVolumeSpecName: "kube-api-access-zlfq7") pod "76a1ee99-6132-416f-8a48-9a7a8073e929" (UID: "76a1ee99-6132-416f-8a48-9a7a8073e929"). InnerVolumeSpecName "kube-api-access-zlfq7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.338130 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-kube-api-access-cj8vx" (OuterVolumeSpecName: "kube-api-access-cj8vx") pod "f9e7d8a7-0ab6-433c-a590-8a908ae70d01" (UID: "f9e7d8a7-0ab6-433c-a590-8a908ae70d01"). InnerVolumeSpecName "kube-api-access-cj8vx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.343061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-scripts" (OuterVolumeSpecName: "scripts") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.345338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "glance") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.367342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "76a1ee99-6132-416f-8a48-9a7a8073e929" (UID: "76a1ee99-6132-416f-8a48-9a7a8073e929"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.385394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b257324-3e15-4f82-87a7-b6510652951a-kube-api-access-gmbm4" (OuterVolumeSpecName: "kube-api-access-gmbm4") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "kube-api-access-gmbm4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.406323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413272 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413300 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413312 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413410 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6b257324-3e15-4f82-87a7-b6510652951a-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413421 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413430 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413438 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413448 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/76a1ee99-6132-416f-8a48-9a7a8073e929-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413457 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zlfq7\" (UniqueName: \"kubernetes.io/projected/76a1ee99-6132-416f-8a48-9a7a8073e929-kube-api-access-zlfq7\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.413488 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rtkj5\" (UniqueName: \"kubernetes.io/projected/e73113de-3961-438d-acd9-886c2db72385-kube-api-access-rtkj5\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.414699 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.414712 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e73113de-3961-438d-acd9-886c2db72385-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.414746 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.414756 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cj8vx\" (UniqueName: \"kubernetes.io/projected/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-kube-api-access-cj8vx\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.414765 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gmbm4\" (UniqueName: \"kubernetes.io/projected/6b257324-3e15-4f82-87a7-b6510652951a-kube-api-access-gmbm4\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.464692 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-zl7nx"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.464730 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.464746 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-9af9-account-create-vj26g"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.464756 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-9af9-account-create-vj26g"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.474699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f9e7d8a7-0ab6-433c-a590-8a908ae70d01" (UID: "f9e7d8a7-0ab6-433c-a590-8a908ae70d01"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.478232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.502275 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data" (OuterVolumeSpecName: "config-data") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.515567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data\") pod \"113d6870-bffb-4ac9-8f23-3d4463d37245\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.515662 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/113d6870-bffb-4ac9-8f23-3d4463d37245-logs\") pod \"113d6870-bffb-4ac9-8f23-3d4463d37245\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.515716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-combined-ca-bundle\") pod \"113d6870-bffb-4ac9-8f23-3d4463d37245\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.516302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9c2f\" (UniqueName: \"kubernetes.io/projected/113d6870-bffb-4ac9-8f23-3d4463d37245-kube-api-access-t9c2f\") pod \"113d6870-bffb-4ac9-8f23-3d4463d37245\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.516452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data-custom\") pod \"113d6870-bffb-4ac9-8f23-3d4463d37245\" (UID: \"113d6870-bffb-4ac9-8f23-3d4463d37245\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.516624 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-config-data" (OuterVolumeSpecName: "config-data") pod "f9e7d8a7-0ab6-433c-a590-8a908ae70d01" (UID: "f9e7d8a7-0ab6-433c-a590-8a908ae70d01"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.517020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113d6870-bffb-4ac9-8f23-3d4463d37245-logs" (OuterVolumeSpecName: "logs") pod "113d6870-bffb-4ac9-8f23-3d4463d37245" (UID: "113d6870-bffb-4ac9-8f23-3d4463d37245"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.517651 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.517677 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/113d6870-bffb-4ac9-8f23-3d4463d37245-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.517693 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.517707 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.528146 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113d6870-bffb-4ac9-8f23-3d4463d37245-kube-api-access-t9c2f" (OuterVolumeSpecName: "kube-api-access-t9c2f") pod "113d6870-bffb-4ac9-8f23-3d4463d37245" (UID: "113d6870-bffb-4ac9-8f23-3d4463d37245"). InnerVolumeSpecName "kube-api-access-t9c2f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.537535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "113d6870-bffb-4ac9-8f23-3d4463d37245" (UID: "113d6870-bffb-4ac9-8f23-3d4463d37245"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.559432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.596944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-galera-tls-certs\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-operator-scripts\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-kolla-config\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-combined-ca-bundle\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-generated\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hstp6\" (UniqueName: \"kubernetes.io/projected/cf393762-ecdb-4462-8198-0f85d54912e7-kube-api-access-hstp6\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-default\") pod \"cf393762-ecdb-4462-8198-0f85d54912e7\" (UID: \"cf393762-ecdb-4462-8198-0f85d54912e7\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619943 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t9c2f\" (UniqueName: \"kubernetes.io/projected/113d6870-bffb-4ac9-8f23-3d4463d37245-kube-api-access-t9c2f\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.619957 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.620884 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.621298 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.621447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.621465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.621734 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.690062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf393762-ecdb-4462-8198-0f85d54912e7-kube-api-access-hstp6" (OuterVolumeSpecName: "kube-api-access-hstp6") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "kube-api-access-hstp6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.696910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.707611 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "mysql-db") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.709301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.710998 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.713563 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-config-data" (OuterVolumeSpecName: "config-data") pod "e73113de-3961-438d-acd9-886c2db72385" (UID: "e73113de-3961-438d-acd9-886c2db72385"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.718353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "f9e7d8a7-0ab6-433c-a590-8a908ae70d01" (UID: "f9e7d8a7-0ab6-433c-a590-8a908ae70d01"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.720923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-logs\") pod \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.720992 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc2xq\" (UniqueName: \"kubernetes.io/projected/b728bee3-96ff-4142-9282-de05409ad732-kube-api-access-jc2xq\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-public-tls-certs\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b728bee3-96ff-4142-9282-de05409ad732-logs\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-internal-tls-certs\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data-custom\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-combined-ca-bundle\") pod \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721331 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmvb9\" (UniqueName: \"kubernetes.io/projected/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-kube-api-access-xmvb9\") pod \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721377 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-combined-ca-bundle\") pod \"b728bee3-96ff-4142-9282-de05409ad732\" (UID: \"b728bee3-96ff-4142-9282-de05409ad732\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721396 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data\") pod \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721441 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data-custom\") pod \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\" (UID: \"7bd38baf-c2f2-4755-826d-27eeca7b2c1c\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721817 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9e7d8a7-0ab6-433c-a590-8a908ae70d01-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721834 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721853 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721863 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721874 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721882 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e73113de-3961-438d-acd9-886c2db72385-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721891 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721900 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hstp6\" (UniqueName: \"kubernetes.io/projected/cf393762-ecdb-4462-8198-0f85d54912e7-kube-api-access-hstp6\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721908 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.721917 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cf393762-ecdb-4462-8198-0f85d54912e7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.732443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-logs" (OuterVolumeSpecName: "logs") pod "7bd38baf-c2f2-4755-826d-27eeca7b2c1c" (UID: "7bd38baf-c2f2-4755-826d-27eeca7b2c1c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.733114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b728bee3-96ff-4142-9282-de05409ad732-logs" (OuterVolumeSpecName: "logs") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.742913 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "113d6870-bffb-4ac9-8f23-3d4463d37245" (UID: "113d6870-bffb-4ac9-8f23-3d4463d37245"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.743086 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.745069 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b728bee3-96ff-4142-9282-de05409ad732-kube-api-access-jc2xq" (OuterVolumeSpecName: "kube-api-access-jc2xq") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "kube-api-access-jc2xq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.745121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-kube-api-access-xmvb9" (OuterVolumeSpecName: "kube-api-access-xmvb9") pod "7bd38baf-c2f2-4755-826d-27eeca7b2c1c" (UID: "7bd38baf-c2f2-4755-826d-27eeca7b2c1c"). InnerVolumeSpecName "kube-api-access-xmvb9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.753816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.753832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7bd38baf-c2f2-4755-826d-27eeca7b2c1c" (UID: "7bd38baf-c2f2-4755-826d-27eeca7b2c1c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.781024 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerID="6096e8bc4422d60d2481bc64037379546fc4f0ec6245e5f0c984b66eb753fdfd" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.781672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1ac95b70-d511-44d0-b6f0-2f66169bbad4","Type":"ContainerDied","Data":"6096e8bc4422d60d2481bc64037379546fc4f0ec6245e5f0c984b66eb753fdfd"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.782358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.785008 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5a91599-04eb-42eb-a583-666c0552a16f" containerID="664df784d54f1953a61905f5ac3a0ed70e6c9cc9a1d804f4ad065ce31820c3cb" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.785130 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f5a91599-04eb-42eb-a583-666c0552a16f","Type":"ContainerDied","Data":"664df784d54f1953a61905f5ac3a0ed70e6c9cc9a1d804f4ad065ce31820c3cb"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.791640 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab913d48-455c-472c-8942-180b14a301d8" containerID="765665de4dd1cfdfa579b855b613c34bf02bc2a7c6b5434c90e14bfe9b78d4a1" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.791715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" event={"ID":"ab913d48-455c-472c-8942-180b14a301d8","Type":"ContainerDied","Data":"765665de4dd1cfdfa579b855b613c34bf02bc2a7c6b5434c90e14bfe9b78d4a1"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.796148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"cf393762-ecdb-4462-8198-0f85d54912e7","Type":"ContainerDied","Data":"3ab1b31d67ee0aad8290e83545d69cdad9eb53222243b73f54e30489b0af9120"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.796239 4769 scope.go:117] "RemoveContainer" containerID="2f4f3e90046e483bb711b36f5823b5f9ae214a329eba2cafa8e19c1887b99826" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.796441 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.819093 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerID="63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.819314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" event={"ID":"7bd38baf-c2f2-4755-826d-27eeca7b2c1c","Type":"ContainerDied","Data":"63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.819386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" event={"ID":"7bd38baf-c2f2-4755-826d-27eeca7b2c1c","Type":"ContainerDied","Data":"95cc006d680b401833c4b646ca4264c3b32a960355b9edff9b7a0fe96b695022"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.819338 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.819735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.838596 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" event={"ID":"113d6870-bffb-4ac9-8f23-3d4463d37245","Type":"ContainerDied","Data":"901914345a67a13f7695774b55558fe7caa90d9b1ad63eb849d20c2636170566"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.838709 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.844542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" event={"ID":"6b257324-3e15-4f82-87a7-b6510652951a","Type":"ContainerDied","Data":"f87415f5f950da51f4ee628abd8f82711e074a0b668dd74fcd6a34f73f922d0a"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.844604 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-67959f9746-jwjb9" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.857728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e73113de-3961-438d-acd9-886c2db72385","Type":"ContainerDied","Data":"c2fc3ee9278497939e5e0529d38c2317aa9e00aea4fc9178b4190ab302025d56"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.857858 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.859758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2914ed85-6d74-4ebc-ae7c-11417e874ab1-etc-machine-id\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.860242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/2914ed85-6d74-4ebc-ae7c-11417e874ab1-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.860448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-combined-ca-bundle\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.861019 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data-custom\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.861158 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.861348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-internal-tls-certs\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.863465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-public-tls-certs\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.863608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrnfr\" (UniqueName: \"kubernetes.io/projected/2914ed85-6d74-4ebc-ae7c-11417e874ab1-kube-api-access-wrnfr\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.863737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-scripts\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.863860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2914ed85-6d74-4ebc-ae7c-11417e874ab1-logs\") pod \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\" (UID: \"2914ed85-6d74-4ebc-ae7c-11417e874ab1\") " Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.865687 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xmvb9\" (UniqueName: \"kubernetes.io/projected/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-kube-api-access-xmvb9\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.877207 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880305 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880336 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/2914ed85-6d74-4ebc-ae7c-11417e874ab1-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880367 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880380 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880399 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jc2xq\" (UniqueName: \"kubernetes.io/projected/b728bee3-96ff-4142-9282-de05409ad732-kube-api-access-jc2xq\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880417 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b728bee3-96ff-4142-9282-de05409ad732-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880428 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880440 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880453 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.873804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.879646 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2914ed85-6d74-4ebc-ae7c-11417e874ab1-logs" (OuterVolumeSpecName: "logs") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.873946 4769 generic.go:334] "Generic (PLEG): container finished" podID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerID="48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.873969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2914ed85-6d74-4ebc-ae7c-11417e874ab1","Type":"ContainerDied","Data":"48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.880659 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"2914ed85-6d74-4ebc-ae7c-11417e874ab1","Type":"ContainerDied","Data":"4fd19754b7fb6879de97b13491fd0d060177a0097e4af29b7809e36c31db0dc6"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.874070 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.892584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2914ed85-6d74-4ebc-ae7c-11417e874ab1-kube-api-access-wrnfr" (OuterVolumeSpecName: "kube-api-access-wrnfr") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "kube-api-access-wrnfr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.896977 4769 scope.go:117] "RemoveContainer" containerID="ed17bcc6e65e52f713872afa81bf11a08c32fe18dd1b2b4f031f5f3b71ac5ede" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.906214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"f9e7d8a7-0ab6-433c-a590-8a908ae70d01","Type":"ContainerDied","Data":"13ab8dbe2fb8c59dec0d2b012d946b0138a9693621b85b6286f8a7638b11c3a5"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.906488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.912491 4769 generic.go:334] "Generic (PLEG): container finished" podID="b728bee3-96ff-4142-9282-de05409ad732" containerID="3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.912635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" event={"ID":"b728bee3-96ff-4142-9282-de05409ad732","Type":"ContainerDied","Data":"3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.912670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" event={"ID":"b728bee3-96ff-4142-9282-de05409ad732","Type":"ContainerDied","Data":"de1bdc8ca6a0024e361e0fbe8edfcc538d188b4624b329fdc6e9a9ac52bee659"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.912844 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-56c85cb96-q6889" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.918888 4769 generic.go:334] "Generic (PLEG): container finished" podID="2614f647-50de-416e-afe3-7b658b34092e" containerID="26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8" exitCode=0 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.919513 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" podUID="9c7aa71e-490d-4282-9b1f-26de919af8a4" containerName="mariadb-account-delete" containerID="cri-o://e296c3c463c4056af81480df26b9bc522f01bd50202481d3a57c0bc953b2742d" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.919792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerDied","Data":"26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8"} Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.920259 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" podUID="86068992-fbf9-40e2-88a1-456bb9d59cbe" containerName="mariadb-account-delete" containerID="cri-o://aaf0ce07622f50a461eae71918281ebf37af3872cf521ffd6ed3cb669e1072fb" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.920281 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.921887 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" podUID="d83cd1db-8da7-4977-889a-579eb4e3367a" containerName="mariadb-account-delete" containerID="cri-o://6d97557c542c2a164a87f4bfc1f697513d12972250e2b849766c32f1cc959314" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.922078 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" podUID="bf19d867-b143-4d9e-a5c7-99f6ece00271" containerName="mariadb-account-delete" containerID="cri-o://119181dfcc69e1dc873ee36fc1a176d2bfcc8241100c839c0d10f051e03b2111" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.923882 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" podUID="1015deb7-ba46-4b81-8a0d-3767e6b5829d" containerName="mariadb-account-delete" containerID="cri-o://99fc62aaca7cc7aaa38d5170f6a9aef6a7a0a5b5c487d3558f5771e25662577d" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.924143 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" podUID="6dc0a443-6a8e-43fd-8612-01cfe8196876" containerName="mariadb-account-delete" containerID="cri-o://d506840060e7eabda62be3f50c47f7e4a80d0514ec2e158b2e5f22eea6dc3efd" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.924972 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" podUID="011db835-c98c-4f22-8167-d07b161ac7f2" containerName="mariadb-account-delete" containerID="cri-o://5be2094edc8d34604e6e2f832b5eef3088010b1f5deac7dbb19aa06a35b74be7" gracePeriod=30 Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.953887 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.959582 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:20:49 crc kubenswrapper[4769]: I1121 13:20:49.994658 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.001132 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.002554 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2914ed85-6d74-4ebc-ae7c-11417e874ab1-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.002577 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.002588 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wrnfr\" (UniqueName: \"kubernetes.io/projected/2914ed85-6d74-4ebc-ae7c-11417e874ab1-kube-api-access-wrnfr\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.033250 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.034154 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.035228 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.035277 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.276900 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.280482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data" (OuterVolumeSpecName: "config-data") pod "113d6870-bffb-4ac9-8f23-3d4463d37245" (UID: "113d6870-bffb-4ac9-8f23-3d4463d37245"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.284945 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.285470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-scripts" (OuterVolumeSpecName: "scripts") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.286997 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.287065 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="ovn-northd" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.308469 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/113d6870-bffb-4ac9-8f23-3d4463d37245-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.308507 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.317398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "76a1ee99-6132-416f-8a48-9a7a8073e929" (UID: "76a1ee99-6132-416f-8a48-9a7a8073e929"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.324140 4769 scope.go:117] "RemoveContainer" containerID="63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.325238 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7bd38baf-c2f2-4755-826d-27eeca7b2c1c" (UID: "7bd38baf-c2f2-4755-826d-27eeca7b2c1c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.326722 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.340339 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "cf393762-ecdb-4462-8198-0f85d54912e7" (UID: "cf393762-ecdb-4462-8198-0f85d54912e7"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.365137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data" (OuterVolumeSpecName: "config-data") pod "7bd38baf-c2f2-4755-826d-27eeca7b2c1c" (UID: "7bd38baf-c2f2-4755-826d-27eeca7b2c1c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.375524 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.397957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410417 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/76a1ee99-6132-416f-8a48-9a7a8073e929-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410448 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410459 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410468 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf393762-ecdb-4462-8198-0f85d54912e7-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410478 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410486 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.410495 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bd38baf-c2f2-4755-826d-27eeca7b2c1c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.410784 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.410868 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data podName:cdd3fc9d-251c-47d2-aba8-53f309ea4494 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:58.41085386 +0000 UTC m=+5417.111515678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data") pod "rabbitmq-cell1-server-0" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.492462 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.493375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6b257324-3e15-4f82-87a7-b6510652951a" (UID: "6b257324-3e15-4f82-87a7-b6510652951a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.501908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.503790 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.503850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data" (OuterVolumeSpecName: "config-data") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.508580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2914ed85-6d74-4ebc-ae7c-11417e874ab1" (UID: "2914ed85-6d74-4ebc-ae7c-11417e874ab1"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.511645 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.511677 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.511687 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.511699 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6b257324-3e15-4f82-87a7-b6510652951a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.511710 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.511718 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2914ed85-6d74-4ebc-ae7c-11417e874ab1-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.536745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data" (OuterVolumeSpecName: "config-data") pod "b728bee3-96ff-4142-9282-de05409ad732" (UID: "b728bee3-96ff-4142-9282-de05409ad732"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.613778 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b728bee3-96ff-4142-9282-de05409ad732-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.630754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.637291 4769 scope.go:117] "RemoveContainer" containerID="01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.640895 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.716057 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.725355 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-86b99bc85b-b6bvw"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.726563 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.727868 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.736609 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.737843 4769 scope.go:117] "RemoveContainer" containerID="63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.738850 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a\": container with ID starting with 63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a not found: ID does not exist" containerID="63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.738914 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a"} err="failed to get container status \"63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a\": rpc error: code = NotFound desc = could not find container \"63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a\": container with ID starting with 63e380cf076f64eaf9a8f0e52808fff184d08f06a1faf9be7775dffee509134a not found: ID does not exist" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.738942 4769 scope.go:117] "RemoveContainer" containerID="01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664" Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.739337 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664\": container with ID starting with 01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664 not found: ID does not exist" containerID="01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.739359 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664"} err="failed to get container status \"01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664\": rpc error: code = NotFound desc = could not find container \"01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664\": container with ID starting with 01d443ded2123f08a9c50159af01d955b787b44b429a53b4fef28ba1cbaf9664 not found: ID does not exist" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.739372 4769 scope.go:117] "RemoveContainer" containerID="3a41d8e27027f69228803146853ccc8f5dad3ec8ba14125f317fc0a8d9eaa800" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.740399 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.751468 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.758511 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.764827 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.767842 4769 scope.go:117] "RemoveContainer" containerID="8261509e5db67b1ce557d83ed76661488c4a905b3b1f4250e78780eb60cab733" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.771215 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-74b4dd6b4c-mrrd6"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.794276 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-67959f9746-jwjb9"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.799797 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-67959f9746-jwjb9"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.800381 4769 scope.go:117] "RemoveContainer" containerID="4f8d47da9752b3301435660772a5b9a18c405c8ded394b8412e868df9f4472f8" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818453 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pzfg\" (UniqueName: \"kubernetes.io/projected/f5a91599-04eb-42eb-a583-666c0552a16f-kube-api-access-8pzfg\") pod \"f5a91599-04eb-42eb-a583-666c0552a16f\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-config-data\") pod \"f5a91599-04eb-42eb-a583-666c0552a16f\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwb4j\" (UniqueName: \"kubernetes.io/projected/2614f647-50de-416e-afe3-7b658b34092e-kube-api-access-zwb4j\") pod \"2614f647-50de-416e-afe3-7b658b34092e\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-combined-ca-bundle\") pod \"f5a91599-04eb-42eb-a583-666c0552a16f\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-internal-tls-certs\") pod \"f5a91599-04eb-42eb-a583-666c0552a16f\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-public-tls-certs\") pod \"f5a91599-04eb-42eb-a583-666c0552a16f\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818753 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5a91599-04eb-42eb-a583-666c0552a16f-logs\") pod \"f5a91599-04eb-42eb-a583-666c0552a16f\" (UID: \"f5a91599-04eb-42eb-a583-666c0552a16f\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-config-data\") pod \"2614f647-50de-416e-afe3-7b658b34092e\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.818818 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-combined-ca-bundle\") pod \"2614f647-50de-416e-afe3-7b658b34092e\" (UID: \"2614f647-50de-416e-afe3-7b658b34092e\") " Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.819371 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:20:50 crc kubenswrapper[4769]: E1121 13:20:50.819447 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data podName:532433c6-42b6-4674-977f-8a7a23614deb nodeName:}" failed. No retries permitted until 2025-11-21 13:20:58.819429866 +0000 UTC m=+5417.520091684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data") pod "rabbitmq-server-0" (UID: "532433c6-42b6-4674-977f-8a7a23614deb") : configmap "rabbitmq-config-data" not found Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.823581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a91599-04eb-42eb-a583-666c0552a16f-logs" (OuterVolumeSpecName: "logs") pod "f5a91599-04eb-42eb-a583-666c0552a16f" (UID: "f5a91599-04eb-42eb-a583-666c0552a16f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.831667 4769 scope.go:117] "RemoveContainer" containerID="15360538021fc052bef33c9c34ebae1d05603dc5a31bbd84daba9f7e3da6d60a" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.833934 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a91599-04eb-42eb-a583-666c0552a16f-kube-api-access-8pzfg" (OuterVolumeSpecName: "kube-api-access-8pzfg") pod "f5a91599-04eb-42eb-a583-666c0552a16f" (UID: "f5a91599-04eb-42eb-a583-666c0552a16f"). InnerVolumeSpecName "kube-api-access-8pzfg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.840358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2614f647-50de-416e-afe3-7b658b34092e-kube-api-access-zwb4j" (OuterVolumeSpecName: "kube-api-access-zwb4j") pod "2614f647-50de-416e-afe3-7b658b34092e" (UID: "2614f647-50de-416e-afe3-7b658b34092e"). InnerVolumeSpecName "kube-api-access-zwb4j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.846632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2614f647-50de-416e-afe3-7b658b34092e" (UID: "2614f647-50de-416e-afe3-7b658b34092e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.868398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5a91599-04eb-42eb-a583-666c0552a16f" (UID: "f5a91599-04eb-42eb-a583-666c0552a16f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.874395 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-config-data" (OuterVolumeSpecName: "config-data") pod "2614f647-50de-416e-afe3-7b658b34092e" (UID: "2614f647-50de-416e-afe3-7b658b34092e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.877206 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.884231 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.887353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-config-data" (OuterVolumeSpecName: "config-data") pod "f5a91599-04eb-42eb-a583-666c0552a16f" (UID: "f5a91599-04eb-42eb-a583-666c0552a16f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.900230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f5a91599-04eb-42eb-a583-666c0552a16f" (UID: "f5a91599-04eb-42eb-a583-666c0552a16f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.919875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-logs\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.919954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-internal-tls-certs\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.919985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmgjz\" (UniqueName: \"kubernetes.io/projected/ab913d48-455c-472c-8942-180b14a301d8-kube-api-access-lmgjz\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.920451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-logs" (OuterVolumeSpecName: "logs") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-config-data\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-public-tls-certs\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-combined-ca-bundle\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvwxh\" (UniqueName: \"kubernetes.io/projected/1ac95b70-d511-44d0-b6f0-2f66169bbad4-kube-api-access-mvwxh\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-fernet-keys\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-internal-tls-certs\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935535 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-credential-keys\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-combined-ca-bundle\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-scripts\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-config-data\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935709 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-scripts\") pod \"ab913d48-455c-472c-8942-180b14a301d8\" (UID: \"ab913d48-455c-472c-8942-180b14a301d8\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.935735 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-httpd-run\") pod \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\" (UID: \"1ac95b70-d511-44d0-b6f0-2f66169bbad4\") " Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936298 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8pzfg\" (UniqueName: \"kubernetes.io/projected/f5a91599-04eb-42eb-a583-666c0552a16f-kube-api-access-8pzfg\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936324 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936338 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zwb4j\" (UniqueName: \"kubernetes.io/projected/2614f647-50de-416e-afe3-7b658b34092e-kube-api-access-zwb4j\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936350 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936363 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936375 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f5a91599-04eb-42eb-a583-666c0552a16f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936388 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936399 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2614f647-50de-416e-afe3-7b658b34092e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.936410 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.941237 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-scripts" (OuterVolumeSpecName: "scripts") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.941918 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "glance") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.942124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f5a91599-04eb-42eb-a583-666c0552a16f" (UID: "f5a91599-04eb-42eb-a583-666c0552a16f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.944018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-scripts" (OuterVolumeSpecName: "scripts") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.945522 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-56c85cb96-q6889"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.945881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab913d48-455c-472c-8942-180b14a301d8-kube-api-access-lmgjz" (OuterVolumeSpecName: "kube-api-access-lmgjz") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "kube-api-access-lmgjz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.946860 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.947094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.952874 4769 scope.go:117] "RemoveContainer" containerID="fb93df30b6001a9be0414bd1042aa0d363e8be222763a54a21ccbda58e264729" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.954693 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-56c85cb96-q6889"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.956098 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.957429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac95b70-d511-44d0-b6f0-2f66169bbad4-kube-api-access-mvwxh" (OuterVolumeSpecName: "kube-api-access-mvwxh") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "kube-api-access-mvwxh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.959896 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1ac95b70-d511-44d0-b6f0-2f66169bbad4","Type":"ContainerDied","Data":"fa76569e1037a6f963d10fd16a886f2dd159462224c1c3a5cf59ff4ecd0fde62"} Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.959987 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.964345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f5a91599-04eb-42eb-a583-666c0552a16f","Type":"ContainerDied","Data":"8b6f1b2bc483909b07725fc5687bcc89008def1a9dfd447f2a4f473bd82223f2"} Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.964424 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.967001 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.967001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" event={"ID":"ab913d48-455c-472c-8942-180b14a301d8","Type":"ContainerDied","Data":"cc1916e8e234dc669948cdd4b792d9d9165c04168e5a0f3b55c3994b7d6d034a"} Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.970909 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.971536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"2614f647-50de-416e-afe3-7b658b34092e","Type":"ContainerDied","Data":"9369ee2485c7da4df7efe0229bc40411671fff8ad5f3b6e784ce477e227df216"} Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.986724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-config-data" (OuterVolumeSpecName: "config-data") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.993878 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:20:50 crc kubenswrapper[4769]: I1121 13:20:50.995898 4769 scope.go:117] "RemoveContainer" containerID="12f02a05f413e8857f425ce4bbd37f702949440faf33c3309c7e81954e222613" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.000215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.003077 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.004909 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.016515 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.020116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-config-data" (OuterVolumeSpecName: "config-data") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.021218 4769 scope.go:117] "RemoveContainer" containerID="48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.022836 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.022876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1ac95b70-d511-44d0-b6f0-2f66169bbad4" (UID: "1ac95b70-d511-44d0-b6f0-2f66169bbad4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.025742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.032762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ab913d48-455c-472c-8942-180b14a301d8" (UID: "ab913d48-455c-472c-8942-180b14a301d8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.037748 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.037888 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f5a91599-04eb-42eb-a583-666c0552a16f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.037950 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038006 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038088 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038168 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038350 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038415 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038478 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1ac95b70-d511-44d0-b6f0-2f66169bbad4-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038540 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038640 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lmgjz\" (UniqueName: \"kubernetes.io/projected/ab913d48-455c-472c-8942-180b14a301d8-kube-api-access-lmgjz\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038702 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038764 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038822 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ac95b70-d511-44d0-b6f0-2f66169bbad4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038877 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mvwxh\" (UniqueName: \"kubernetes.io/projected/1ac95b70-d511-44d0-b6f0-2f66169bbad4-kube-api-access-mvwxh\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.038934 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ab913d48-455c-472c-8942-180b14a301d8-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.039373 4769 scope.go:117] "RemoveContainer" containerID="43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.056850 4769 scope.go:117] "RemoveContainer" containerID="48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.057210 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6\": container with ID starting with 48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6 not found: ID does not exist" containerID="48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.057249 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6"} err="failed to get container status \"48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6\": rpc error: code = NotFound desc = could not find container \"48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6\": container with ID starting with 48d658e1b7fec8cb2ee8da3d33d799aa9ac40745354c13d937a061526fee76d6 not found: ID does not exist" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.057267 4769 scope.go:117] "RemoveContainer" containerID="43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.057488 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de\": container with ID starting with 43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de not found: ID does not exist" containerID="43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.057508 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de"} err="failed to get container status \"43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de\": rpc error: code = NotFound desc = could not find container \"43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de\": container with ID starting with 43fc406bea081b9e7e3de704bfbd9761262fbaf6d66f179257a93893cab264de not found: ID does not exist" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.057521 4769 scope.go:117] "RemoveContainer" containerID="14e60c29fdf5f6a03d66db49ee3c700b970c8ee0827320db8caa98a96d972cbc" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.057649 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.075091 4769 scope.go:117] "RemoveContainer" containerID="ceec5e9ae4db59a6c071fcac05945b9798302c0e45510e38eb06fb0c28b6a2ca" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.092919 4769 scope.go:117] "RemoveContainer" containerID="3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.115633 4769 scope.go:117] "RemoveContainer" containerID="5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.133799 4769 scope.go:117] "RemoveContainer" containerID="3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.134295 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198\": container with ID starting with 3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198 not found: ID does not exist" containerID="3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.134332 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198"} err="failed to get container status \"3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198\": rpc error: code = NotFound desc = could not find container \"3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198\": container with ID starting with 3753bc656205a867184c404cb5722f90693172cae711e7a5e74d8191569b3198 not found: ID does not exist" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.134380 4769 scope.go:117] "RemoveContainer" containerID="5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.134793 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400\": container with ID starting with 5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400 not found: ID does not exist" containerID="5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.134817 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400"} err="failed to get container status \"5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400\": rpc error: code = NotFound desc = could not find container \"5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400\": container with ID starting with 5885dd3579bbbbbba93cbc8e13dccc79235fefa868c3c9937c7ce636aa47e400 not found: ID does not exist" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.134832 4769 scope.go:117] "RemoveContainer" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.139630 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.172468 4769 scope.go:117] "RemoveContainer" containerID="6096e8bc4422d60d2481bc64037379546fc4f0ec6245e5f0c984b66eb753fdfd" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.267349 4769 scope.go:117] "RemoveContainer" containerID="15888949b29d204ac86a4426582988850fb8b58bb4b10c0b63169560d49becb8" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.285820 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" path="/var/lib/kubelet/pods/113d6870-bffb-4ac9-8f23-3d4463d37245/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.286373 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2614f647-50de-416e-afe3-7b658b34092e" path="/var/lib/kubelet/pods/2614f647-50de-416e-afe3-7b658b34092e/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.286893 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" path="/var/lib/kubelet/pods/2914ed85-6d74-4ebc-ae7c-11417e874ab1/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.287823 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e9ba597-8cd2-4eed-b410-fcad0ef9f41f" path="/var/lib/kubelet/pods/3e9ba597-8cd2-4eed-b410-fcad0ef9f41f/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.288420 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b257324-3e15-4f82-87a7-b6510652951a" path="/var/lib/kubelet/pods/6b257324-3e15-4f82-87a7-b6510652951a/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.288952 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a1ee99-6132-416f-8a48-9a7a8073e929" path="/var/lib/kubelet/pods/76a1ee99-6132-416f-8a48-9a7a8073e929/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.289965 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b17861e-ad2b-400e-a402-b9e6a986e276" path="/var/lib/kubelet/pods/7b17861e-ad2b-400e-a402-b9e6a986e276/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.290590 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" path="/var/lib/kubelet/pods/7bd38baf-c2f2-4755-826d-27eeca7b2c1c/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.291289 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b728bee3-96ff-4142-9282-de05409ad732" path="/var/lib/kubelet/pods/b728bee3-96ff-4142-9282-de05409ad732/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.292641 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" path="/var/lib/kubelet/pods/cf393762-ecdb-4462-8198-0f85d54912e7/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.295409 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73113de-3961-438d-acd9-886c2db72385" path="/var/lib/kubelet/pods/e73113de-3961-438d-acd9-886c2db72385/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.296494 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" path="/var/lib/kubelet/pods/f5a91599-04eb-42eb-a583-666c0552a16f/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.298923 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" path="/var/lib/kubelet/pods/f9e7d8a7-0ab6-433c-a590-8a908ae70d01/volumes" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.313799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.319010 4769 scope.go:117] "RemoveContainer" containerID="664df784d54f1953a61905f5ac3a0ed70e6c9cc9a1d804f4ad065ce31820c3cb" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.322478 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.343728 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.347017 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.346993284 +0000 UTC m=+5414.047655102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.345686 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.345717 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.345747 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.346874 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.346905 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.346941 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.345778 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-6bb546f66c-25blf"] Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.351054 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.351042919 +0000 UTC m=+5414.051704737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.351254 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.351242834 +0000 UTC m=+5414.051904662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.351357 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.351345917 +0000 UTC m=+5414.052007735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.351409 4769 scope.go:117] "RemoveContainer" containerID="8f46547bd724f15a906dff1f908869f1b610836a8a2d4ddf20148f9a22b4d334" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.351511 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.351502221 +0000 UTC m=+5414.052164039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.351605 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.351597893 +0000 UTC m=+5414.052259711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.351684 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:20:55.351669845 +0000 UTC m=+5414.052331663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.364364 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-6bb546f66c-25blf"] Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.378310 4769 scope.go:117] "RemoveContainer" containerID="765665de4dd1cfdfa579b855b613c34bf02bc2a7c6b5434c90e14bfe9b78d4a1" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.552169 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.553898 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.555232 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.555261 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.697072 4769 scope.go:117] "RemoveContainer" containerID="26db52357fe268f2f5cc37ffc5cc36db59679975489341d433253516f6121fa8" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.760048 4769 scope.go:117] "RemoveContainer" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:20:51 crc kubenswrapper[4769]: E1121 13:20:51.761140 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6\": container with ID starting with 86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6 not found: ID does not exist" containerID="86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.761242 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6"} err="failed to get container status \"86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6\": rpc error: code = NotFound desc = could not find container \"86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6\": container with ID starting with 86e113537807222b7f82613d6b68ce40b8125171e311b6dc33c16d4d0972eef6 not found: ID does not exist" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.931245 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.163:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:20:51 crc kubenswrapper[4769]: I1121 13:20:51.931672 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-85df7b9854-wwmc4" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.163:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.251163 4769 scope.go:117] "RemoveContainer" containerID="550a5254a71684f89a21383641e5c81589873856cd29cc354f66029c28da76b7" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.280575 4769 scope.go:117] "RemoveContainer" containerID="b5866afb2228684413a3d45b29fadf6034e172c4940bcf2e1b9e6ab6a930e528" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.359719 4769 scope.go:117] "RemoveContainer" containerID="c8e97db73342e76610e33005e1f28cc2c2affce55abe35ee675912f8cf232fab" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.387007 4769 scope.go:117] "RemoveContainer" containerID="c8f2fff6a14b3215f0778bfc5b8b99e0cb0131450ee2427fd5c534a2eb58ed7e" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.416513 4769 scope.go:117] "RemoveContainer" containerID="623ccaec758e4ab39094e84c9bb46910eebf9f4e1155d8b0858a1087a5b003b2" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.464320 4769 scope.go:117] "RemoveContainer" containerID="efc51cfbb4a39361534ad3d6bd863f4388872a3d4440023d53f983859fe2fafc" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.513303 4769 scope.go:117] "RemoveContainer" containerID="90b5a48879d63f18b826dfcbb5b2ba070be7d88c1e27bc3c7b971223df9d3d96" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.580844 4769 scope.go:117] "RemoveContainer" containerID="26c54edafc6a1a0ff762b4f1f64b3d243c6d5c913df92c04f335c261605df009" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.621939 4769 scope.go:117] "RemoveContainer" containerID="60a80f6557d630aa193f55460d9c2638cddeefc491430a4f05863f7c38e3dfd8" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.695923 4769 scope.go:117] "RemoveContainer" containerID="de9986a3c3152affa9b7c487a0dd95aa4fbf835e561e76cd7e6ec0c1b0af0ff4" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.751117 4769 scope.go:117] "RemoveContainer" containerID="95a0a0a2a1265e481d1d8de4eb87bb1af563c21a6ab68c11b0b04a2987bd3fe8" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.796727 4769 scope.go:117] "RemoveContainer" containerID="f14c606d27d7b605ccd05b67d59beaab6421e29cb803c013a13d4a2879b1c2e2" Nov 21 13:20:52 crc kubenswrapper[4769]: I1121 13:20:52.928624 4769 scope.go:117] "RemoveContainer" containerID="d4e56e6a12dca3ca61406345e8edaf872e36cbd619cc703ead3aaaf37ea77a4d" Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.045889 4769 generic.go:334] "Generic (PLEG): container finished" podID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerID="240fbceb280f0466787fb0af67fb6f961f5bff07573b4aa015615e3e197d9640" exitCode=0 Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.046008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerDied","Data":"240fbceb280f0466787fb0af67fb6f961f5bff07573b4aa015615e3e197d9640"} Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.047738 4769 generic.go:334] "Generic (PLEG): container finished" podID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerID="6b8b64d1841f7133ce1191474f0746d6f3e25dec326fdc438f460624b3a44758" exitCode=0 Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.047869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"cdd3fc9d-251c-47d2-aba8-53f309ea4494","Type":"ContainerDied","Data":"6b8b64d1841f7133ce1191474f0746d6f3e25dec326fdc438f460624b3a44758"} Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.053650 4769 generic.go:334] "Generic (PLEG): container finished" podID="532433c6-42b6-4674-977f-8a7a23614deb" containerID="e5f71ffb25e3e61b208f6c7926eecbd32eaee9d7fa57daac62217c0abf303717" exitCode=0 Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.053733 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"532433c6-42b6-4674-977f-8a7a23614deb","Type":"ContainerDied","Data":"e5f71ffb25e3e61b208f6c7926eecbd32eaee9d7fa57daac62217c0abf303717"} Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.057405 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_f74f9009-9b6c-453a-aa99-a6036758983d/ovn-northd/0.log" Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.057456 4769 generic.go:334] "Generic (PLEG): container finished" podID="f74f9009-9b6c-453a-aa99-a6036758983d" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" exitCode=139 Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.057479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f74f9009-9b6c-453a-aa99-a6036758983d","Type":"ContainerDied","Data":"06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50"} Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.059380 4769 generic.go:334] "Generic (PLEG): container finished" podID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" exitCode=0 Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.059438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerDied","Data":"2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d"} Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.059478 4769 scope.go:117] "RemoveContainer" containerID="33ea84c8011afe4796c19c070449b76d7dbbe73d5569ef8adc264e53afaae9ee" Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.285783 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" path="/var/lib/kubelet/pods/1ac95b70-d511-44d0-b6f0-2f66169bbad4/volumes" Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.286667 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab913d48-455c-472c-8942-180b14a301d8" path="/var/lib/kubelet/pods/ab913d48-455c-472c-8942-180b14a301d8/volumes" Nov 21 13:20:53 crc kubenswrapper[4769]: I1121 13:20:53.946732 4769 scope.go:117] "RemoveContainer" containerID="1cc9ce240529d7cf767425ba46de20b5cd7f0399808010279416827c077cc542" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.093685 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerID="15205680f75d7bafea71eff445dfd97507653414b5dfb2268041b4b2d1c2b110" exitCode=0 Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.093773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" event={"ID":"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc","Type":"ContainerDied","Data":"15205680f75d7bafea71eff445dfd97507653414b5dfb2268041b4b2d1c2b110"} Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.096992 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_f74f9009-9b6c-453a-aa99-a6036758983d/ovn-northd/0.log" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.097125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"f74f9009-9b6c-453a-aa99-a6036758983d","Type":"ContainerDied","Data":"85651dca65e7ec5760eb8f88f2454f16703d3a495aff06b3992d1c85f3bd67f4"} Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.097156 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85651dca65e7ec5760eb8f88f2454f16703d3a495aff06b3992d1c85f3bd67f4" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.099719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7","Type":"ContainerDied","Data":"70090640a895c331d26e9a81ab22c0b907bad22089def7f0d9ec71d858affe7a"} Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.099742 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70090640a895c331d26e9a81ab22c0b907bad22089def7f0d9ec71d858affe7a" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.103036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"cdd3fc9d-251c-47d2-aba8-53f309ea4494","Type":"ContainerDied","Data":"aa87807cbef93d3a26e23820d95044e769cca9bbf31e69ce0ce20d45f6c32a01"} Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.103058 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa87807cbef93d3a26e23820d95044e769cca9bbf31e69ce0ce20d45f6c32a01" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.205720 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.206710 4769 scope.go:117] "RemoveContainer" containerID="5908e91360c92b28682a9148475c13ac5c72dd29f71b3b973dc894554a7d015e" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.212093 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_f74f9009-9b6c-453a-aa99-a6036758983d/ovn-northd/0.log" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.212150 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.228968 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.250844 4769 scope.go:117] "RemoveContainer" containerID="a7a8f7380d046c735a2cfd0718c52fe7eda85afa0d411e96da6a15fdfb5a24e7" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.302487 4769 scope.go:117] "RemoveContainer" containerID="2cc9c13fb6d5243726ee9a3f5dea03d84350e27687e9a8fb43ff87f6d767196a" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/cdd3fc9d-251c-47d2-aba8-53f309ea4494-pod-info\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-plugins-conf\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325459 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/cdd3fc9d-251c-47d2-aba8-53f309ea4494-erlang-cookie-secret\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-confd\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rsvq\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-kube-api-access-2rsvq\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325766 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-plugins\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-tls\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325903 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-erlang-cookie\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.325952 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-server-conf\") pod \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\" (UID: \"cdd3fc9d-251c-47d2-aba8-53f309ea4494\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.326104 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.326893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.327412 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.328670 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.328706 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.328726 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.332410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.332558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdd3fc9d-251c-47d2-aba8-53f309ea4494-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.335527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cdd3fc9d-251c-47d2-aba8-53f309ea4494-pod-info" (OuterVolumeSpecName: "pod-info") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.338460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.346912 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-kube-api-access-2rsvq" (OuterVolumeSpecName: "kube-api-access-2rsvq") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "kube-api-access-2rsvq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.371209 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data" (OuterVolumeSpecName: "config-data") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.373650 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-server-conf" (OuterVolumeSpecName: "server-conf") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.409179 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "cdd3fc9d-251c-47d2-aba8-53f309ea4494" (UID: "cdd3fc9d-251c-47d2-aba8-53f309ea4494"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.428880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrk7d\" (UniqueName: \"kubernetes.io/projected/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-kube-api-access-jrk7d\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-config-data\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429171 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-metrics-certs-tls-certs\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429219 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-scripts\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-northd-tls-certs\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-run-httpd\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-config\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-log-httpd\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429351 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbw9b\" (UniqueName: \"kubernetes.io/projected/f74f9009-9b6c-453a-aa99-a6036758983d-kube-api-access-kbw9b\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-rundir\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-sg-core-conf-yaml\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429453 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-combined-ca-bundle\") pod \"f74f9009-9b6c-453a-aa99-a6036758983d\" (UID: \"f74f9009-9b6c-453a-aa99-a6036758983d\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429496 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-ceilometer-tls-certs\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-scripts\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-combined-ca-bundle\") pod \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\" (UID: \"e6c5a53a-ebfa-4652-bfec-3df5ca4895b7\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429902 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/cdd3fc9d-251c-47d2-aba8-53f309ea4494-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429932 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429957 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.429971 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.432280 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2rsvq\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-kube-api-access-2rsvq\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.432298 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/cdd3fc9d-251c-47d2-aba8-53f309ea4494-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.432309 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/cdd3fc9d-251c-47d2-aba8-53f309ea4494-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.432317 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/cdd3fc9d-251c-47d2-aba8-53f309ea4494-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.430931 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-scripts" (OuterVolumeSpecName: "scripts") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.431632 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.431899 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-config" (OuterVolumeSpecName: "config") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.432224 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.436483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.436507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-kube-api-access-jrk7d" (OuterVolumeSpecName: "kube-api-access-jrk7d") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "kube-api-access-jrk7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.437070 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74f9009-9b6c-453a-aa99-a6036758983d-kube-api-access-kbw9b" (OuterVolumeSpecName: "kube-api-access-kbw9b") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "kube-api-access-kbw9b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.437150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-scripts" (OuterVolumeSpecName: "scripts") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.449943 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.454543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.455630 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.476521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.481815 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.490051 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.491265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.496398 4769 scope.go:117] "RemoveContainer" containerID="97f2750132e9f7caaacb72fa44fe20c18905687023f1aa4e388e0ee2179b939f" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.498459 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.503638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.510134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "f74f9009-9b6c-453a-aa99-a6036758983d" (UID: "f74f9009-9b6c-453a-aa99-a6036758983d"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.527408 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-config-data" (OuterVolumeSpecName: "config-data") pod "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" (UID: "e6c5a53a-ebfa-4652-bfec-3df5ca4895b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-httpd-config\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533444 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-plugins\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-confd\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533530 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-config\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533557 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-config-data\") pod \"d17f3666-e78c-4e03-8509-14d6cdea4083\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-combined-ca-bundle\") pod \"d17f3666-e78c-4e03-8509-14d6cdea4083\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-internal-tls-certs\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-combined-ca-bundle\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/532433c6-42b6-4674-977f-8a7a23614deb-pod-info\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-866xx\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-kube-api-access-866xx\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-ovndb-tls-certs\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533802 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-public-tls-certs\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqjsr\" (UniqueName: \"kubernetes.io/projected/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-kube-api-access-fqjsr\") pod \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\" (UID: \"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/532433c6-42b6-4674-977f-8a7a23614deb-erlang-cookie-secret\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-tls\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrmjg\" (UniqueName: \"kubernetes.io/projected/d17f3666-e78c-4e03-8509-14d6cdea4083-kube-api-access-rrmjg\") pod \"d17f3666-e78c-4e03-8509-14d6cdea4083\" (UID: \"d17f3666-e78c-4e03-8509-14d6cdea4083\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.533981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-erlang-cookie\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-server-conf\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-plugins-conf\") pod \"532433c6-42b6-4674-977f-8a7a23614deb\" (UID: \"532433c6-42b6-4674-977f-8a7a23614deb\") " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534594 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534619 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534635 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jrk7d\" (UniqueName: \"kubernetes.io/projected/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-kube-api-access-jrk7d\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534647 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534661 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534675 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534689 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534705 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534718 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534731 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f74f9009-9b6c-453a-aa99-a6036758983d-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534742 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534755 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kbw9b\" (UniqueName: \"kubernetes.io/projected/f74f9009-9b6c-453a-aa99-a6036758983d-kube-api-access-kbw9b\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534766 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f74f9009-9b6c-453a-aa99-a6036758983d-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534779 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534791 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f74f9009-9b6c-453a-aa99-a6036758983d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.534803 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.535342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.538128 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.538470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-kube-api-access-866xx" (OuterVolumeSpecName: "kube-api-access-866xx") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "kube-api-access-866xx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.540735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.542291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17f3666-e78c-4e03-8509-14d6cdea4083-kube-api-access-rrmjg" (OuterVolumeSpecName: "kube-api-access-rrmjg") pod "d17f3666-e78c-4e03-8509-14d6cdea4083" (UID: "d17f3666-e78c-4e03-8509-14d6cdea4083"). InnerVolumeSpecName "kube-api-access-rrmjg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.543967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.544917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "persistence") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.545496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-kube-api-access-fqjsr" (OuterVolumeSpecName: "kube-api-access-fqjsr") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "kube-api-access-fqjsr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.548494 4769 scope.go:117] "RemoveContainer" containerID="b8544fee26f33428b6d15938baa05558a0c4362225037c5b18cf86e141d9491c" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.552320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.558110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532433c6-42b6-4674-977f-8a7a23614deb-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.565119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/532433c6-42b6-4674-977f-8a7a23614deb-pod-info" (OuterVolumeSpecName: "pod-info") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.567803 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data" (OuterVolumeSpecName: "config-data") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.572636 4769 scope.go:117] "RemoveContainer" containerID="1e76fc7639de72039a1cb4d636b54e5e195b7213d97aeda7c97f3b1a23abc143" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.587258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-config-data" (OuterVolumeSpecName: "config-data") pod "d17f3666-e78c-4e03-8509-14d6cdea4083" (UID: "d17f3666-e78c-4e03-8509-14d6cdea4083"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.605551 4769 scope.go:117] "RemoveContainer" containerID="f67d41496c8c1f43dcf14db061b50bfdac3bec1606a0213ae1bb4ba543bb1f81" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.606680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-server-conf" (OuterVolumeSpecName: "server-conf") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.608510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.620139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d17f3666-e78c-4e03-8509-14d6cdea4083" (UID: "d17f3666-e78c-4e03-8509-14d6cdea4083"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.621409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.626418 4769 scope.go:117] "RemoveContainer" containerID="28cf8754d4df43c03e06a772ba4589e855a8b7bb76011f499335e93bbc5c9e1d" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.629298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-config" (OuterVolumeSpecName: "config") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.631534 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.632754 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" (UID: "1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635864 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635895 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635914 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635950 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635967 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/532433c6-42b6-4674-977f-8a7a23614deb-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635980 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.635992 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636005 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636016 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636028 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d17f3666-e78c-4e03-8509-14d6cdea4083-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636043 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636055 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636067 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/532433c6-42b6-4674-977f-8a7a23614deb-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636083 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-866xx\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-kube-api-access-866xx\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636095 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636107 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636120 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fqjsr\" (UniqueName: \"kubernetes.io/projected/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc-kube-api-access-fqjsr\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636134 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/532433c6-42b6-4674-977f-8a7a23614deb-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636145 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.636159 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rrmjg\" (UniqueName: \"kubernetes.io/projected/d17f3666-e78c-4e03-8509-14d6cdea4083-kube-api-access-rrmjg\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.651391 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "532433c6-42b6-4674-977f-8a7a23614deb" (UID: "532433c6-42b6-4674-977f-8a7a23614deb"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.656684 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.669354 4769 scope.go:117] "RemoveContainer" containerID="8a1793d8a587cf3fee59f9961bbb086ed83949770673a457a92e6694575bbfba" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.688304 4769 scope.go:117] "RemoveContainer" containerID="c1025be48415542cb22cc152c938853bd553d31da3b90c2018a820e45f256f34" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.705822 4769 scope.go:117] "RemoveContainer" containerID="852d507c8ff43e9a30e35228cc317898ff5aab08f9ed7751045b05fdf80409fc" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.727154 4769 scope.go:117] "RemoveContainer" containerID="a50e9a2c71965c0e3d93aaf31a3e6a327478abb570b880a1080ec987676d30da" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.737079 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/532433c6-42b6-4674-977f-8a7a23614deb-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.737118 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:54 crc kubenswrapper[4769]: I1121 13:20:54.743699 4769 scope.go:117] "RemoveContainer" containerID="4856777467e2082c284fb8358726b74fdd69e11dcd9f16191a8cfdbd7234cfe2" Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.028812 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.030141 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.031447 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.031477 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.117767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d17f3666-e78c-4e03-8509-14d6cdea4083","Type":"ContainerDied","Data":"a362d0e063048c194631afa26ae0dcc9c71aa46f98bbbd2b770e538021f8a77f"} Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.117882 4769 scope.go:117] "RemoveContainer" containerID="2b809c2e9f6641103819affc7b50b9824b4a797af492afc578aa680a3c7c7d0d" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.117810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.120121 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.128298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" event={"ID":"1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc","Type":"ContainerDied","Data":"b4f260634f0bd6fdf7fdfc15836fe3c1d507e806014b5587f05a30b638887f06"} Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.128394 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7979fc499d-l7wjs" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.161338 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.161361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"532433c6-42b6-4674-977f-8a7a23614deb","Type":"ContainerDied","Data":"501d14bbde170bbe0ddab107c607e47c5f5cd793a80b284ae680054a3135e663"} Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.162075 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.162367 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.162564 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.170781 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.179075 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.185421 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.202030 4769 scope.go:117] "RemoveContainer" containerID="8474f3bee160abdbfe40a398cfc6fd3dc69c47042bd45d32463964a7bfb491e6" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.202510 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7979fc499d-l7wjs"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.209010 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7979fc499d-l7wjs"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.216473 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.222847 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.229688 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.237471 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.238244 4769 scope.go:117] "RemoveContainer" containerID="15205680f75d7bafea71eff445dfd97507653414b5dfb2268041b4b2d1c2b110" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.242314 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.246723 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.266176 4769 scope.go:117] "RemoveContainer" containerID="e5f71ffb25e3e61b208f6c7926eecbd32eaee9d7fa57daac62217c0abf303717" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.271366 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.294418 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" path="/var/lib/kubelet/pods/1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc/volumes" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.295387 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532433c6-42b6-4674-977f-8a7a23614deb" path="/var/lib/kubelet/pods/532433c6-42b6-4674-977f-8a7a23614deb/volumes" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.296703 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" path="/var/lib/kubelet/pods/cdd3fc9d-251c-47d2-aba8-53f309ea4494/volumes" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.297400 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" path="/var/lib/kubelet/pods/d17f3666-e78c-4e03-8509-14d6cdea4083/volumes" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.298126 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" path="/var/lib/kubelet/pods/e6c5a53a-ebfa-4652-bfec-3df5ca4895b7/volumes" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.299661 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" path="/var/lib/kubelet/pods/f74f9009-9b6c-453a-aa99-a6036758983d/volumes" Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.321015 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z"] Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.321302 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerName="dnsmasq-dns" containerID="cri-o://ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c" gracePeriod=10 Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447048 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447110 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447095463 +0000 UTC m=+5422.147757281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447446 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447485 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447473972 +0000 UTC m=+5422.148135800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447490 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447519 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447532 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447520504 +0000 UTC m=+5422.148182322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447549 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447542154 +0000 UTC m=+5422.148203972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447562 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447582 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447585 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447577405 +0000 UTC m=+5422.148239223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447616 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447608236 +0000 UTC m=+5422.148270054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447647 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: E1121 13:20:55.447673 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:21:03.447664937 +0000 UTC m=+5422.148326755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:20:55 crc kubenswrapper[4769]: I1121 13:20:55.876771 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.055921 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2t74\" (UniqueName: \"kubernetes.io/projected/5aed6b53-02ed-4c72-a91a-2f8d750be346-kube-api-access-s2t74\") pod \"5aed6b53-02ed-4c72-a91a-2f8d750be346\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.055998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dnsmasq-svc\") pod \"5aed6b53-02ed-4c72-a91a-2f8d750be346\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.056051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-config\") pod \"5aed6b53-02ed-4c72-a91a-2f8d750be346\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.056079 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dns-swift-storage-0\") pod \"5aed6b53-02ed-4c72-a91a-2f8d750be346\" (UID: \"5aed6b53-02ed-4c72-a91a-2f8d750be346\") " Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.060667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aed6b53-02ed-4c72-a91a-2f8d750be346-kube-api-access-s2t74" (OuterVolumeSpecName: "kube-api-access-s2t74") pod "5aed6b53-02ed-4c72-a91a-2f8d750be346" (UID: "5aed6b53-02ed-4c72-a91a-2f8d750be346"). InnerVolumeSpecName "kube-api-access-s2t74". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.104738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5aed6b53-02ed-4c72-a91a-2f8d750be346" (UID: "5aed6b53-02ed-4c72-a91a-2f8d750be346"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.111081 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-config" (OuterVolumeSpecName: "config") pod "5aed6b53-02ed-4c72-a91a-2f8d750be346" (UID: "5aed6b53-02ed-4c72-a91a-2f8d750be346"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.111794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "5aed6b53-02ed-4c72-a91a-2f8d750be346" (UID: "5aed6b53-02ed-4c72-a91a-2f8d750be346"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.158033 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s2t74\" (UniqueName: \"kubernetes.io/projected/5aed6b53-02ed-4c72-a91a-2f8d750be346-kube-api-access-s2t74\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.158296 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.158363 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.158421 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/5aed6b53-02ed-4c72-a91a-2f8d750be346-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.187276 4769 generic.go:334] "Generic (PLEG): container finished" podID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerID="ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c" exitCode=0 Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.187368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" event={"ID":"5aed6b53-02ed-4c72-a91a-2f8d750be346","Type":"ContainerDied","Data":"ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c"} Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.187396 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" event={"ID":"5aed6b53-02ed-4c72-a91a-2f8d750be346","Type":"ContainerDied","Data":"bf539fbe751ce60df28547e6c63684f7afb6786ecaf397e1889dd80a0fcbb8b4"} Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.187406 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.187416 4769 scope.go:117] "RemoveContainer" containerID="ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.230945 4769 scope.go:117] "RemoveContainer" containerID="aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.235240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z"] Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.242881 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-75f856ddc7-znl2z"] Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.256037 4769 scope.go:117] "RemoveContainer" containerID="ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c" Nov 21 13:20:56 crc kubenswrapper[4769]: E1121 13:20:56.256436 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c\": container with ID starting with ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c not found: ID does not exist" containerID="ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.256467 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c"} err="failed to get container status \"ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c\": rpc error: code = NotFound desc = could not find container \"ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c\": container with ID starting with ec6cf7626e26758ed7d56b2675d9ba4181d6fbe62bb7db5bcc1773fda624808c not found: ID does not exist" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.256491 4769 scope.go:117] "RemoveContainer" containerID="aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff" Nov 21 13:20:56 crc kubenswrapper[4769]: E1121 13:20:56.256829 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff\": container with ID starting with aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff not found: ID does not exist" containerID="aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff" Nov 21 13:20:56 crc kubenswrapper[4769]: I1121 13:20:56.256893 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff"} err="failed to get container status \"aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff\": rpc error: code = NotFound desc = could not find container \"aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff\": container with ID starting with aa66ad3554f06cf70ec354e2766c7296f9d2d625ddcde4ecdbe7145dfc24d8ff not found: ID does not exist" Nov 21 13:20:57 crc kubenswrapper[4769]: I1121 13:20:57.286901 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" path="/var/lib/kubelet/pods/5aed6b53-02ed-4c72-a91a-2f8d750be346/volumes" Nov 21 13:20:59 crc kubenswrapper[4769]: I1121 13:20:59.273944 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:20:59 crc kubenswrapper[4769]: E1121 13:20:59.274921 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:21:00 crc kubenswrapper[4769]: E1121 13:21:00.029742 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:00 crc kubenswrapper[4769]: E1121 13:21:00.032018 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:00 crc kubenswrapper[4769]: E1121 13:21:00.034215 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:00 crc kubenswrapper[4769]: E1121 13:21:00.034426 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537151 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.539416 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.539385424 +0000 UTC m=+5438.240047272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537229 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537271 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537293 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537299 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537320 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.537374 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.540244 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.540176745 +0000 UTC m=+5438.240838593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.540643 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.540615996 +0000 UTC m=+5438.241277844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.540840 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.540822181 +0000 UTC m=+5438.241484029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.540993 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.540975745 +0000 UTC m=+5438.241637603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.541316 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.541299984 +0000 UTC m=+5438.241961832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:21:03 crc kubenswrapper[4769]: E1121 13:21:03.541470 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:21:19.541454708 +0000 UTC m=+5438.242116566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:21:05 crc kubenswrapper[4769]: E1121 13:21:05.030134 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:05 crc kubenswrapper[4769]: E1121 13:21:05.032855 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:05 crc kubenswrapper[4769]: E1121 13:21:05.035132 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:05 crc kubenswrapper[4769]: E1121 13:21:05.035228 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:10 crc kubenswrapper[4769]: E1121 13:21:10.030290 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:10 crc kubenswrapper[4769]: E1121 13:21:10.032298 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:10 crc kubenswrapper[4769]: E1121 13:21:10.034846 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:10 crc kubenswrapper[4769]: E1121 13:21:10.034913 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:10 crc kubenswrapper[4769]: I1121 13:21:10.274327 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:21:10 crc kubenswrapper[4769]: E1121 13:21:10.274578 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.030337 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.032248 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.034183 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.034231 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.141129 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.224290 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") pod \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.224428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-cache\") pod \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.224458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-lock\") pod \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.224538 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.224586 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96pj4\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-kube-api-access-96pj4\") pod \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\" (UID: \"66c82043-0b6b-4a5f-9c0c-826a19dc36d3\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.225101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-lock" (OuterVolumeSpecName: "lock") pod "66c82043-0b6b-4a5f-9c0c-826a19dc36d3" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.225340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-cache" (OuterVolumeSpecName: "cache") pod "66c82043-0b6b-4a5f-9c0c-826a19dc36d3" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.230072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-kube-api-access-96pj4" (OuterVolumeSpecName: "kube-api-access-96pj4") pod "66c82043-0b6b-4a5f-9c0c-826a19dc36d3" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3"). InnerVolumeSpecName "kube-api-access-96pj4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.250070 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "swift") pod "66c82043-0b6b-4a5f-9c0c-826a19dc36d3" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.250118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "66c82043-0b6b-4a5f-9c0c-826a19dc36d3" (UID: "66c82043-0b6b-4a5f-9c0c-826a19dc36d3"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.299323 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.325765 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz759\" (UniqueName: \"kubernetes.io/projected/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-kube-api-access-bz759\") pod \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.325835 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data-custom\") pod \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.325860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-combined-ca-bundle\") pod \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.325950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-scripts\") pod \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.325989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data\") pod \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-etc-machine-id\") pod \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\" (UID: \"546bcae7-9cd0-4153-9ebc-5f408d2b4eba\") " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "546bcae7-9cd0-4153-9ebc-5f408d2b4eba" (UID: "546bcae7-9cd0-4153-9ebc-5f408d2b4eba"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326644 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-cache\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326670 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-lock\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326697 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326712 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-96pj4\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-kube-api-access-96pj4\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326729 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.326741 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/66c82043-0b6b-4a5f-9c0c-826a19dc36d3-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.329559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "546bcae7-9cd0-4153-9ebc-5f408d2b4eba" (UID: "546bcae7-9cd0-4153-9ebc-5f408d2b4eba"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.329584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-scripts" (OuterVolumeSpecName: "scripts") pod "546bcae7-9cd0-4153-9ebc-5f408d2b4eba" (UID: "546bcae7-9cd0-4153-9ebc-5f408d2b4eba"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.332312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-kube-api-access-bz759" (OuterVolumeSpecName: "kube-api-access-bz759") pod "546bcae7-9cd0-4153-9ebc-5f408d2b4eba" (UID: "546bcae7-9cd0-4153-9ebc-5f408d2b4eba"). InnerVolumeSpecName "kube-api-access-bz759". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.342896 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.362839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "546bcae7-9cd0-4153-9ebc-5f408d2b4eba" (UID: "546bcae7-9cd0-4153-9ebc-5f408d2b4eba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.394573 4769 generic.go:334] "Generic (PLEG): container finished" podID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerID="fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2" exitCode=137 Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.394636 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.394638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"546bcae7-9cd0-4153-9ebc-5f408d2b4eba","Type":"ContainerDied","Data":"fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2"} Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.394791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"546bcae7-9cd0-4153-9ebc-5f408d2b4eba","Type":"ContainerDied","Data":"ac07c5b33d7c99132cc7a0bc294aec336daf819ef1fbabaa4fd600317dc23d3b"} Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.394818 4769 scope.go:117] "RemoveContainer" containerID="3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.397543 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data" (OuterVolumeSpecName: "config-data") pod "546bcae7-9cd0-4153-9ebc-5f408d2b4eba" (UID: "546bcae7-9cd0-4153-9ebc-5f408d2b4eba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.400808 4769 generic.go:334] "Generic (PLEG): container finished" podID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerID="fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20" exitCode=137 Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.400847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20"} Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.400874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"66c82043-0b6b-4a5f-9c0c-826a19dc36d3","Type":"ContainerDied","Data":"b7563f827fc865ef1cd73859710a731d44c30a095f7eeff7a09db21856d98287"} Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.400900 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.412715 4769 scope.go:117] "RemoveContainer" containerID="fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.427699 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bz759\" (UniqueName: \"kubernetes.io/projected/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-kube-api-access-bz759\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.427744 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.427754 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.427764 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.427773 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/546bcae7-9cd0-4153-9ebc-5f408d2b4eba-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.427783 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.439381 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.442025 4769 scope.go:117] "RemoveContainer" containerID="3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.442498 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f\": container with ID starting with 3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f not found: ID does not exist" containerID="3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.442567 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f"} err="failed to get container status \"3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f\": rpc error: code = NotFound desc = could not find container \"3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f\": container with ID starting with 3c1e26132340a09eba4959283a8bacb405faf5e9f6bd4e0600bb7b5ef4740d3f not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.442599 4769 scope.go:117] "RemoveContainer" containerID="fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.442889 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2\": container with ID starting with fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2 not found: ID does not exist" containerID="fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.442922 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2"} err="failed to get container status \"fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2\": rpc error: code = NotFound desc = could not find container \"fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2\": container with ID starting with fce0bf7f1913f5c62f83f22800035039afe8bb44961cb2b2f2bb7684de1aefd2 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.442944 4769 scope.go:117] "RemoveContainer" containerID="fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.445666 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.458536 4769 scope.go:117] "RemoveContainer" containerID="e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.472170 4769 scope.go:117] "RemoveContainer" containerID="35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.485507 4769 scope.go:117] "RemoveContainer" containerID="21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.504360 4769 scope.go:117] "RemoveContainer" containerID="44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.526404 4769 scope.go:117] "RemoveContainer" containerID="cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.547890 4769 scope.go:117] "RemoveContainer" containerID="46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.571265 4769 scope.go:117] "RemoveContainer" containerID="1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.591528 4769 scope.go:117] "RemoveContainer" containerID="cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.608403 4769 scope.go:117] "RemoveContainer" containerID="9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.625029 4769 scope.go:117] "RemoveContainer" containerID="98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.694076 4769 scope.go:117] "RemoveContainer" containerID="6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.715538 4769 scope.go:117] "RemoveContainer" containerID="46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.723058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.729394 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.746263 4769 scope.go:117] "RemoveContainer" containerID="bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.807369 4769 scope.go:117] "RemoveContainer" containerID="cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.833100 4769 scope.go:117] "RemoveContainer" containerID="fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.833565 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20\": container with ID starting with fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20 not found: ID does not exist" containerID="fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.833592 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20"} err="failed to get container status \"fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20\": rpc error: code = NotFound desc = could not find container \"fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20\": container with ID starting with fa3e5a772a0a596379d95490006282ff53861cbc0daeecc728f564b9f9286b20 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.833613 4769 scope.go:117] "RemoveContainer" containerID="e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.833906 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df\": container with ID starting with e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df not found: ID does not exist" containerID="e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.833928 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df"} err="failed to get container status \"e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df\": rpc error: code = NotFound desc = could not find container \"e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df\": container with ID starting with e4ff275ca5b3e455a48640d87eefd36194054b68210d95d3178f96a1dd9ec9df not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.833963 4769 scope.go:117] "RemoveContainer" containerID="35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.834337 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587\": container with ID starting with 35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587 not found: ID does not exist" containerID="35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.834390 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587"} err="failed to get container status \"35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587\": rpc error: code = NotFound desc = could not find container \"35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587\": container with ID starting with 35287fabe6bf71c387e2b5ceda08f5e7931b316cec6a06be11483cb82491b587 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.834404 4769 scope.go:117] "RemoveContainer" containerID="21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.834707 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954\": container with ID starting with 21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954 not found: ID does not exist" containerID="21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.834735 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954"} err="failed to get container status \"21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954\": rpc error: code = NotFound desc = could not find container \"21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954\": container with ID starting with 21c215161b4e5bbae79dd6343ce1e69ea89134d13f4d796ee8ead6202f81a954 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.834752 4769 scope.go:117] "RemoveContainer" containerID="44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.834974 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a\": container with ID starting with 44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a not found: ID does not exist" containerID="44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835001 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a"} err="failed to get container status \"44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a\": rpc error: code = NotFound desc = could not find container \"44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a\": container with ID starting with 44157f2b7aa05431ca053b48bf47508ba18e9b6397558ef91ebc611877ee354a not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835019 4769 scope.go:117] "RemoveContainer" containerID="cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.835271 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf\": container with ID starting with cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf not found: ID does not exist" containerID="cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835291 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf"} err="failed to get container status \"cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf\": rpc error: code = NotFound desc = could not find container \"cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf\": container with ID starting with cddff68b11821374b61166c15949d405327b58df2b53bbb3c30b6e55256a7fdf not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835303 4769 scope.go:117] "RemoveContainer" containerID="46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.835562 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926\": container with ID starting with 46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926 not found: ID does not exist" containerID="46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835583 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926"} err="failed to get container status \"46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926\": rpc error: code = NotFound desc = could not find container \"46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926\": container with ID starting with 46fb0e2ea1cd54a0625e6234e0e2c3675f43040ca46fd2edc20e05fbc0a32926 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835594 4769 scope.go:117] "RemoveContainer" containerID="1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.835819 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9\": container with ID starting with 1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9 not found: ID does not exist" containerID="1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835835 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9"} err="failed to get container status \"1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9\": rpc error: code = NotFound desc = could not find container \"1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9\": container with ID starting with 1f7c42162237de0cf658a29edd9f477c80595bc168a36d6fe2d6919b297e5af9 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.835847 4769 scope.go:117] "RemoveContainer" containerID="cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.836074 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a\": container with ID starting with cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a not found: ID does not exist" containerID="cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.836090 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a"} err="failed to get container status \"cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a\": rpc error: code = NotFound desc = could not find container \"cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a\": container with ID starting with cec2a79de61d7603146b33672d8b19d02e810f28cc7b76f12f79b95c1ed2145a not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.836102 4769 scope.go:117] "RemoveContainer" containerID="9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.836363 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358\": container with ID starting with 9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358 not found: ID does not exist" containerID="9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.836385 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358"} err="failed to get container status \"9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358\": rpc error: code = NotFound desc = could not find container \"9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358\": container with ID starting with 9b9c1cc85b8c75ddc4ec7df0544653ad0dfae9adbaba193e692d500708cb8358 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.836400 4769 scope.go:117] "RemoveContainer" containerID="98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.836575 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655\": container with ID starting with 98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655 not found: ID does not exist" containerID="98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.836593 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655"} err="failed to get container status \"98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655\": rpc error: code = NotFound desc = could not find container \"98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655\": container with ID starting with 98e626a6548fcb858c20c51ce95890ccbd2ecf7de0681e2477a76d713d850655 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.836605 4769 scope.go:117] "RemoveContainer" containerID="6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.838325 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0\": container with ID starting with 6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0 not found: ID does not exist" containerID="6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.838382 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0"} err="failed to get container status \"6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0\": rpc error: code = NotFound desc = could not find container \"6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0\": container with ID starting with 6e7ee8ca44d57a97fdbd94e0b4ce1bfb9342bce16267f05f40dfd938e2a54dc0 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.838420 4769 scope.go:117] "RemoveContainer" containerID="46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.838750 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111\": container with ID starting with 46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111 not found: ID does not exist" containerID="46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.838774 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111"} err="failed to get container status \"46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111\": rpc error: code = NotFound desc = could not find container \"46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111\": container with ID starting with 46bb4e7af924fa95c62e616e506ded1ccf706b73cda2ec5f801c00239293a111 not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.838789 4769 scope.go:117] "RemoveContainer" containerID="bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.839046 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f\": container with ID starting with bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f not found: ID does not exist" containerID="bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.839068 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f"} err="failed to get container status \"bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f\": rpc error: code = NotFound desc = could not find container \"bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f\": container with ID starting with bf70e7bb5b43a32a603fa06cbc0c6a63d09345a170c73a9fa24d85837ba67f6f not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.839079 4769 scope.go:117] "RemoveContainer" containerID="cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d" Nov 21 13:21:15 crc kubenswrapper[4769]: E1121 13:21:15.839322 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d\": container with ID starting with cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d not found: ID does not exist" containerID="cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.839341 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d"} err="failed to get container status \"cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d\": rpc error: code = NotFound desc = could not find container \"cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d\": container with ID starting with cb88312c2e5452d53944bb42b508b7d5729d85586abb75b862c545b7ea953c5d not found: ID does not exist" Nov 21 13:21:15 crc kubenswrapper[4769]: I1121 13:21:15.933208 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.037348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-config-data\") pod \"0ef4ab46-7a06-41be-ae29-ebc45d686505\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.037604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr6lc\" (UniqueName: \"kubernetes.io/projected/0ef4ab46-7a06-41be-ae29-ebc45d686505-kube-api-access-rr6lc\") pod \"0ef4ab46-7a06-41be-ae29-ebc45d686505\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.037657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-combined-ca-bundle\") pod \"0ef4ab46-7a06-41be-ae29-ebc45d686505\" (UID: \"0ef4ab46-7a06-41be-ae29-ebc45d686505\") " Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.041593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef4ab46-7a06-41be-ae29-ebc45d686505-kube-api-access-rr6lc" (OuterVolumeSpecName: "kube-api-access-rr6lc") pod "0ef4ab46-7a06-41be-ae29-ebc45d686505" (UID: "0ef4ab46-7a06-41be-ae29-ebc45d686505"). InnerVolumeSpecName "kube-api-access-rr6lc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.058527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-config-data" (OuterVolumeSpecName: "config-data") pod "0ef4ab46-7a06-41be-ae29-ebc45d686505" (UID: "0ef4ab46-7a06-41be-ae29-ebc45d686505"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.059485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0ef4ab46-7a06-41be-ae29-ebc45d686505" (UID: "0ef4ab46-7a06-41be-ae29-ebc45d686505"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.140075 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rr6lc\" (UniqueName: \"kubernetes.io/projected/0ef4ab46-7a06-41be-ae29-ebc45d686505-kube-api-access-rr6lc\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.140113 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.140125 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ef4ab46-7a06-41be-ae29-ebc45d686505-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.413693 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" exitCode=137 Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.413754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerDied","Data":"2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd"} Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.413761 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.413784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"0ef4ab46-7a06-41be-ae29-ebc45d686505","Type":"ContainerDied","Data":"e45ffdb9c9ff13fbd5275f7e1cade26ac32de7e86fa9e51827304beaa3b030f9"} Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.413806 4769 scope.go:117] "RemoveContainer" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.431696 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.443712 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.450567 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.483148 4769 scope.go:117] "RemoveContainer" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" Nov 21 13:21:16 crc kubenswrapper[4769]: E1121 13:21:16.483690 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd\": container with ID starting with 2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd not found: ID does not exist" containerID="2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.483822 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd"} err="failed to get container status \"2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd\": rpc error: code = NotFound desc = could not find container \"2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd\": container with ID starting with 2754a38df8ae72eaca8a0b98ae52cfaf02201d27a3996d513fa2c5853f4c13fd not found: ID does not exist" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.483869 4769 scope.go:117] "RemoveContainer" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:21:16 crc kubenswrapper[4769]: E1121 13:21:16.484829 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82\": container with ID starting with 8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82 not found: ID does not exist" containerID="8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82" Nov 21 13:21:16 crc kubenswrapper[4769]: I1121 13:21:16.484865 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82"} err="failed to get container status \"8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82\": rpc error: code = NotFound desc = could not find container \"8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82\": container with ID starting with 8b0c90c2a3668dbab128d010454cf66532e07ca8c5a8b7ee5171cec9f1d5cc82 not found: ID does not exist" Nov 21 13:21:17 crc kubenswrapper[4769]: I1121 13:21:17.284960 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" path="/var/lib/kubelet/pods/0ef4ab46-7a06-41be-ae29-ebc45d686505/volumes" Nov 21 13:21:17 crc kubenswrapper[4769]: I1121 13:21:17.286049 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" path="/var/lib/kubelet/pods/546bcae7-9cd0-4153-9ebc-5f408d2b4eba/volumes" Nov 21 13:21:17 crc kubenswrapper[4769]: I1121 13:21:17.287172 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" path="/var/lib/kubelet/pods/66c82043-0b6b-4a5f-9c0c-826a19dc36d3/volumes" Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.589862 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.589880 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.589883 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.589871 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.589921 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.589921 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590044 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590258 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts podName:011db835-c98c-4f22-8167-d07b161ac7f2 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.59023681 +0000 UTC m=+5470.290898688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts") pod "placement87ee-account-delete-s6pdt" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2") : configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590435 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts podName:bf19d867-b143-4d9e-a5c7-99f6ece00271 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.590418035 +0000 UTC m=+5470.291079923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts") pod "novaapi9af9-account-delete-4hfb2" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271") : configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590453 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts podName:9c7aa71e-490d-4282-9b1f-26de919af8a4 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.590442526 +0000 UTC m=+5470.291104454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts") pod "neutron985a-account-delete-cr2xl" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4") : configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590472 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts podName:1015deb7-ba46-4b81-8a0d-3767e6b5829d nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.590465406 +0000 UTC m=+5470.291127334 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts") pod "cinder8885-account-delete-7cg2c" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d") : configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590488 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts podName:d83cd1db-8da7-4977-889a-579eb4e3367a nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.590481997 +0000 UTC m=+5470.291143915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts") pod "novacell0f24d-account-delete-98zw4" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a") : configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590538 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts podName:86068992-fbf9-40e2-88a1-456bb9d59cbe nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.590529208 +0000 UTC m=+5470.291191096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts") pod "glance80a8-account-delete-65lmn" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe") : configmap "openstack-scripts" not found Nov 21 13:21:19 crc kubenswrapper[4769]: E1121 13:21:19.590560 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts podName:6dc0a443-6a8e-43fd-8612-01cfe8196876 nodeName:}" failed. No retries permitted until 2025-11-21 13:21:51.590550528 +0000 UTC m=+5470.291212436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts") pod "barbicanaa33-account-delete-7zjf5" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876") : configmap "openstack-scripts" not found Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.349087 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-6bb546f66c-25blf" podUID="ab913d48-455c-472c-8942-180b14a301d8" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.147:5000/v3\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.451915 4769 generic.go:334] "Generic (PLEG): container finished" podID="011db835-c98c-4f22-8167-d07b161ac7f2" containerID="5be2094edc8d34604e6e2f832b5eef3088010b1f5deac7dbb19aa06a35b74be7" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.451989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" event={"ID":"011db835-c98c-4f22-8167-d07b161ac7f2","Type":"ContainerDied","Data":"5be2094edc8d34604e6e2f832b5eef3088010b1f5deac7dbb19aa06a35b74be7"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.452022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" event={"ID":"011db835-c98c-4f22-8167-d07b161ac7f2","Type":"ContainerDied","Data":"9bc0ec4a0d6ba8bc501e188899bae316c34afaa91e3ab25f6616d2775f402be9"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.452034 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bc0ec4a0d6ba8bc501e188899bae316c34afaa91e3ab25f6616d2775f402be9" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.453848 4769 generic.go:334] "Generic (PLEG): container finished" podID="d83cd1db-8da7-4977-889a-579eb4e3367a" containerID="6d97557c542c2a164a87f4bfc1f697513d12972250e2b849766c32f1cc959314" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.453906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" event={"ID":"d83cd1db-8da7-4977-889a-579eb4e3367a","Type":"ContainerDied","Data":"6d97557c542c2a164a87f4bfc1f697513d12972250e2b849766c32f1cc959314"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.455339 4769 generic.go:334] "Generic (PLEG): container finished" podID="6dc0a443-6a8e-43fd-8612-01cfe8196876" containerID="d506840060e7eabda62be3f50c47f7e4a80d0514ec2e158b2e5f22eea6dc3efd" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.455366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" event={"ID":"6dc0a443-6a8e-43fd-8612-01cfe8196876","Type":"ContainerDied","Data":"d506840060e7eabda62be3f50c47f7e4a80d0514ec2e158b2e5f22eea6dc3efd"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.457862 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c7aa71e-490d-4282-9b1f-26de919af8a4" containerID="e296c3c463c4056af81480df26b9bc522f01bd50202481d3a57c0bc953b2742d" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.457907 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" event={"ID":"9c7aa71e-490d-4282-9b1f-26de919af8a4","Type":"ContainerDied","Data":"e296c3c463c4056af81480df26b9bc522f01bd50202481d3a57c0bc953b2742d"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.459723 4769 generic.go:334] "Generic (PLEG): container finished" podID="1015deb7-ba46-4b81-8a0d-3767e6b5829d" containerID="99fc62aaca7cc7aaa38d5170f6a9aef6a7a0a5b5c487d3558f5771e25662577d" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.459781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" event={"ID":"1015deb7-ba46-4b81-8a0d-3767e6b5829d","Type":"ContainerDied","Data":"99fc62aaca7cc7aaa38d5170f6a9aef6a7a0a5b5c487d3558f5771e25662577d"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.460983 4769 generic.go:334] "Generic (PLEG): container finished" podID="86068992-fbf9-40e2-88a1-456bb9d59cbe" containerID="aaf0ce07622f50a461eae71918281ebf37af3872cf521ffd6ed3cb669e1072fb" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.461039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" event={"ID":"86068992-fbf9-40e2-88a1-456bb9d59cbe","Type":"ContainerDied","Data":"aaf0ce07622f50a461eae71918281ebf37af3872cf521ffd6ed3cb669e1072fb"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.462056 4769 generic.go:334] "Generic (PLEG): container finished" podID="bf19d867-b143-4d9e-a5c7-99f6ece00271" containerID="119181dfcc69e1dc873ee36fc1a176d2bfcc8241100c839c0d10f051e03b2111" exitCode=137 Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.462083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" event={"ID":"bf19d867-b143-4d9e-a5c7-99f6ece00271","Type":"ContainerDied","Data":"119181dfcc69e1dc873ee36fc1a176d2bfcc8241100c839c0d10f051e03b2111"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.462101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" event={"ID":"bf19d867-b143-4d9e-a5c7-99f6ece00271","Type":"ContainerDied","Data":"2a6252200e43b8e7f6a28236e8ed2667ca9d99c8654109d13e68db86cc996375"} Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.462114 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a6252200e43b8e7f6a28236e8ed2667ca9d99c8654109d13e68db86cc996375" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.506422 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.529213 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.605485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts\") pod \"011db835-c98c-4f22-8167-d07b161ac7f2\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.605827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr4hj\" (UniqueName: \"kubernetes.io/projected/bf19d867-b143-4d9e-a5c7-99f6ece00271-kube-api-access-wr4hj\") pod \"bf19d867-b143-4d9e-a5c7-99f6ece00271\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.605906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64gfr\" (UniqueName: \"kubernetes.io/projected/011db835-c98c-4f22-8167-d07b161ac7f2-kube-api-access-64gfr\") pod \"011db835-c98c-4f22-8167-d07b161ac7f2\" (UID: \"011db835-c98c-4f22-8167-d07b161ac7f2\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.606037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts\") pod \"bf19d867-b143-4d9e-a5c7-99f6ece00271\" (UID: \"bf19d867-b143-4d9e-a5c7-99f6ece00271\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.606675 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bf19d867-b143-4d9e-a5c7-99f6ece00271" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.607093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "011db835-c98c-4f22-8167-d07b161ac7f2" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.611875 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf19d867-b143-4d9e-a5c7-99f6ece00271-kube-api-access-wr4hj" (OuterVolumeSpecName: "kube-api-access-wr4hj") pod "bf19d867-b143-4d9e-a5c7-99f6ece00271" (UID: "bf19d867-b143-4d9e-a5c7-99f6ece00271"). InnerVolumeSpecName "kube-api-access-wr4hj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.612840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011db835-c98c-4f22-8167-d07b161ac7f2-kube-api-access-64gfr" (OuterVolumeSpecName: "kube-api-access-64gfr") pod "011db835-c98c-4f22-8167-d07b161ac7f2" (UID: "011db835-c98c-4f22-8167-d07b161ac7f2"). InnerVolumeSpecName "kube-api-access-64gfr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.708704 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-64gfr\" (UniqueName: \"kubernetes.io/projected/011db835-c98c-4f22-8167-d07b161ac7f2-kube-api-access-64gfr\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.708741 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bf19d867-b143-4d9e-a5c7-99f6ece00271-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.708755 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/011db835-c98c-4f22-8167-d07b161ac7f2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.708767 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wr4hj\" (UniqueName: \"kubernetes.io/projected/bf19d867-b143-4d9e-a5c7-99f6ece00271-kube-api-access-wr4hj\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.774023 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.809878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts\") pod \"86068992-fbf9-40e2-88a1-456bb9d59cbe\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.809982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h59g\" (UniqueName: \"kubernetes.io/projected/86068992-fbf9-40e2-88a1-456bb9d59cbe-kube-api-access-7h59g\") pod \"86068992-fbf9-40e2-88a1-456bb9d59cbe\" (UID: \"86068992-fbf9-40e2-88a1-456bb9d59cbe\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.810787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "86068992-fbf9-40e2-88a1-456bb9d59cbe" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.814584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86068992-fbf9-40e2-88a1-456bb9d59cbe-kube-api-access-7h59g" (OuterVolumeSpecName: "kube-api-access-7h59g") pod "86068992-fbf9-40e2-88a1-456bb9d59cbe" (UID: "86068992-fbf9-40e2-88a1-456bb9d59cbe"). InnerVolumeSpecName "kube-api-access-7h59g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.851653 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.868062 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.878595 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.904650 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts\") pod \"6dc0a443-6a8e-43fd-8612-01cfe8196876\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911240 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f59k9\" (UniqueName: \"kubernetes.io/projected/1015deb7-ba46-4b81-8a0d-3767e6b5829d-kube-api-access-f59k9\") pod \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9jsv\" (UniqueName: \"kubernetes.io/projected/6dc0a443-6a8e-43fd-8612-01cfe8196876-kube-api-access-q9jsv\") pod \"6dc0a443-6a8e-43fd-8612-01cfe8196876\" (UID: \"6dc0a443-6a8e-43fd-8612-01cfe8196876\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts\") pod \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\" (UID: \"1015deb7-ba46-4b81-8a0d-3767e6b5829d\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911381 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts\") pod \"d83cd1db-8da7-4977-889a-579eb4e3367a\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zmrw\" (UniqueName: \"kubernetes.io/projected/d83cd1db-8da7-4977-889a-579eb4e3367a-kube-api-access-4zmrw\") pod \"d83cd1db-8da7-4977-889a-579eb4e3367a\" (UID: \"d83cd1db-8da7-4977-889a-579eb4e3367a\") " Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6dc0a443-6a8e-43fd-8612-01cfe8196876" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911729 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86068992-fbf9-40e2-88a1-456bb9d59cbe-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.911814 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7h59g\" (UniqueName: \"kubernetes.io/projected/86068992-fbf9-40e2-88a1-456bb9d59cbe-kube-api-access-7h59g\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.912006 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d83cd1db-8da7-4977-889a-579eb4e3367a" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.912155 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1015deb7-ba46-4b81-8a0d-3767e6b5829d" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.914280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc0a443-6a8e-43fd-8612-01cfe8196876-kube-api-access-q9jsv" (OuterVolumeSpecName: "kube-api-access-q9jsv") pod "6dc0a443-6a8e-43fd-8612-01cfe8196876" (UID: "6dc0a443-6a8e-43fd-8612-01cfe8196876"). InnerVolumeSpecName "kube-api-access-q9jsv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.915400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83cd1db-8da7-4977-889a-579eb4e3367a-kube-api-access-4zmrw" (OuterVolumeSpecName: "kube-api-access-4zmrw") pod "d83cd1db-8da7-4977-889a-579eb4e3367a" (UID: "d83cd1db-8da7-4977-889a-579eb4e3367a"). InnerVolumeSpecName "kube-api-access-4zmrw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:20 crc kubenswrapper[4769]: I1121 13:21:20.921108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1015deb7-ba46-4b81-8a0d-3767e6b5829d-kube-api-access-f59k9" (OuterVolumeSpecName: "kube-api-access-f59k9") pod "1015deb7-ba46-4b81-8a0d-3767e6b5829d" (UID: "1015deb7-ba46-4b81-8a0d-3767e6b5829d"). InnerVolumeSpecName "kube-api-access-f59k9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.013471 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts\") pod \"9c7aa71e-490d-4282-9b1f-26de919af8a4\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.013772 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl6wl\" (UniqueName: \"kubernetes.io/projected/9c7aa71e-490d-4282-9b1f-26de919af8a4-kube-api-access-bl6wl\") pod \"9c7aa71e-490d-4282-9b1f-26de919af8a4\" (UID: \"9c7aa71e-490d-4282-9b1f-26de919af8a4\") " Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014120 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9c7aa71e-490d-4282-9b1f-26de919af8a4" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014159 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1015deb7-ba46-4b81-8a0d-3767e6b5829d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014181 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d83cd1db-8da7-4977-889a-579eb4e3367a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014223 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4zmrw\" (UniqueName: \"kubernetes.io/projected/d83cd1db-8da7-4977-889a-579eb4e3367a-kube-api-access-4zmrw\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014242 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6dc0a443-6a8e-43fd-8612-01cfe8196876-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014255 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f59k9\" (UniqueName: \"kubernetes.io/projected/1015deb7-ba46-4b81-8a0d-3767e6b5829d-kube-api-access-f59k9\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.014268 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q9jsv\" (UniqueName: \"kubernetes.io/projected/6dc0a443-6a8e-43fd-8612-01cfe8196876-kube-api-access-q9jsv\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.016266 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7aa71e-490d-4282-9b1f-26de919af8a4-kube-api-access-bl6wl" (OuterVolumeSpecName: "kube-api-access-bl6wl") pod "9c7aa71e-490d-4282-9b1f-26de919af8a4" (UID: "9c7aa71e-490d-4282-9b1f-26de919af8a4"). InnerVolumeSpecName "kube-api-access-bl6wl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.115350 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bl6wl\" (UniqueName: \"kubernetes.io/projected/9c7aa71e-490d-4282-9b1f-26de919af8a4-kube-api-access-bl6wl\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.115385 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9c7aa71e-490d-4282-9b1f-26de919af8a4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.471995 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" event={"ID":"1015deb7-ba46-4b81-8a0d-3767e6b5829d","Type":"ContainerDied","Data":"deaa916c0906b568d97248035fabe0fde0420718cdc80fa00a0eb731c5082ee2"} Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.472015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8885-account-delete-7cg2c" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.472060 4769 scope.go:117] "RemoveContainer" containerID="99fc62aaca7cc7aaa38d5170f6a9aef6a7a0a5b5c487d3558f5771e25662577d" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.474965 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.474954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance80a8-account-delete-65lmn" event={"ID":"86068992-fbf9-40e2-88a1-456bb9d59cbe","Type":"ContainerDied","Data":"57ec44ed8ccc6662b1869365f2c531c9f9024f16d9e49225fdc91144468a372f"} Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.478977 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.478980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0f24d-account-delete-98zw4" event={"ID":"d83cd1db-8da7-4977-889a-579eb4e3367a","Type":"ContainerDied","Data":"266a151150c76d988a3fe5d9be866f39079df8644e2ab4ca5a8ff9968d914303"} Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.481587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" event={"ID":"6dc0a443-6a8e-43fd-8612-01cfe8196876","Type":"ContainerDied","Data":"3539080b1f47168a3235d51496094b8a25ee357eb564d74ed6dca74e77c4ae48"} Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.481595 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.484243 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.484307 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement87ee-account-delete-s6pdt" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.484543 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" event={"ID":"9c7aa71e-490d-4282-9b1f-26de919af8a4","Type":"ContainerDied","Data":"4fd2353d6a658a95ff2cf7818d6373688c9a7e999cf2a4d13281e2c159c6da05"} Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.484596 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron985a-account-delete-cr2xl" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.507624 4769 scope.go:117] "RemoveContainer" containerID="aaf0ce07622f50a461eae71918281ebf37af3872cf521ffd6ed3cb669e1072fb" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.511084 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder8885-account-delete-7cg2c"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.524295 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder8885-account-delete-7cg2c"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.540068 4769 scope.go:117] "RemoveContainer" containerID="6d97557c542c2a164a87f4bfc1f697513d12972250e2b849766c32f1cc959314" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.540970 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.551497 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi9af9-account-delete-4hfb2"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.562564 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance80a8-account-delete-65lmn"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.565230 4769 scope.go:117] "RemoveContainer" containerID="d506840060e7eabda62be3f50c47f7e4a80d0514ec2e158b2e5f22eea6dc3efd" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.570252 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance80a8-account-delete-65lmn"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.576623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement87ee-account-delete-s6pdt"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.581885 4769 scope.go:117] "RemoveContainer" containerID="e296c3c463c4056af81480df26b9bc522f01bd50202481d3a57c0bc953b2742d" Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.585338 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement87ee-account-delete-s6pdt"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.591963 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron985a-account-delete-cr2xl"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.596865 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron985a-account-delete-cr2xl"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.601749 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.608082 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbicanaa33-account-delete-7zjf5"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.623602 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0f24d-account-delete-98zw4"] Nov 21 13:21:21 crc kubenswrapper[4769]: I1121 13:21:21.634924 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell0f24d-account-delete-98zw4"] Nov 21 13:21:22 crc kubenswrapper[4769]: I1121 13:21:22.274489 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:21:22 crc kubenswrapper[4769]: E1121 13:21:22.274836 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:21:22 crc kubenswrapper[4769]: I1121 13:21:22.977245 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.164:3000/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.282140 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011db835-c98c-4f22-8167-d07b161ac7f2" path="/var/lib/kubelet/pods/011db835-c98c-4f22-8167-d07b161ac7f2/volumes" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.282871 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1015deb7-ba46-4b81-8a0d-3767e6b5829d" path="/var/lib/kubelet/pods/1015deb7-ba46-4b81-8a0d-3767e6b5829d/volumes" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.283407 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc0a443-6a8e-43fd-8612-01cfe8196876" path="/var/lib/kubelet/pods/6dc0a443-6a8e-43fd-8612-01cfe8196876/volumes" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.283938 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86068992-fbf9-40e2-88a1-456bb9d59cbe" path="/var/lib/kubelet/pods/86068992-fbf9-40e2-88a1-456bb9d59cbe/volumes" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.284957 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7aa71e-490d-4282-9b1f-26de919af8a4" path="/var/lib/kubelet/pods/9c7aa71e-490d-4282-9b1f-26de919af8a4/volumes" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.285484 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf19d867-b143-4d9e-a5c7-99f6ece00271" path="/var/lib/kubelet/pods/bf19d867-b143-4d9e-a5c7-99f6ece00271/volumes" Nov 21 13:21:23 crc kubenswrapper[4769]: I1121 13:21:23.286040 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83cd1db-8da7-4977-889a-579eb4e3367a" path="/var/lib/kubelet/pods/d83cd1db-8da7-4977-889a-579eb4e3367a/volumes" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.707183 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-5gjsp"] Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.712289 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-5gjsp"] Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.836944 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-hdmtk"] Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837302 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-central-agent" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837321 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-central-agent" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837336 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837345 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-api" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837370 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837390 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837398 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837411 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" containerName="mysql-bootstrap" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837418 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" containerName="mysql-bootstrap" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837435 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="ovsdbserver-nb" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837442 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="ovsdbserver-nb" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837461 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837473 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-updater" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837500 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-updater" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837512 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="rsync" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837520 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="rsync" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837531 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837540 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-server" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837565 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="86068992-fbf9-40e2-88a1-456bb9d59cbe" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837573 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="86068992-fbf9-40e2-88a1-456bb9d59cbe" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837588 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837596 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837612 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-metadata" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837620 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-metadata" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837637 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837645 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837663 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837671 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerName="init" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837698 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerName="init" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837708 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="probe" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837715 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="probe" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837733 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837741 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837752 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837761 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837772 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerName="setup-container" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837780 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerName="setup-container" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837795 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837804 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837816 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837825 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837836 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837844 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837860 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" containerName="galera" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837868 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" containerName="galera" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837882 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837891 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-updater" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837912 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-updater" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837920 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="swift-recon-cron" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837928 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="swift-recon-cron" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837964 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="sg-core" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837972 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="sg-core" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.837982 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-expirer" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.837990 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-expirer" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838001 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerName="dnsmasq-dns" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838009 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerName="dnsmasq-dns" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838023 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838031 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838041 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838050 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-api" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838063 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="76a1ee99-6132-416f-8a48-9a7a8073e929" containerName="memcached" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838071 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a1ee99-6132-416f-8a48-9a7a8073e929" containerName="memcached" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838087 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bf19d867-b143-4d9e-a5c7-99f6ece00271" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf19d867-b143-4d9e-a5c7-99f6ece00271" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838113 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-notification-agent" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838121 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-notification-agent" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838132 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838140 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838155 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838163 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838173 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838182 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838238 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838247 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-server" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838261 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838269 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838285 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838293 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838307 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838314 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838329 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab913d48-455c-472c-8942-180b14a301d8" containerName="keystone-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838337 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab913d48-455c-472c-8942-180b14a301d8" containerName="keystone-api" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838352 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838360 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-server" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838375 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerName="mysql-bootstrap" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838383 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerName="mysql-bootstrap" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838398 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838405 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838419 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="setup-container" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838427 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="setup-container" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838440 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="proxy-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838448 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="proxy-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838458 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="26c27a21-dcc1-48a8-b4ea-fa384a28c315" containerName="kube-state-metrics" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838467 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c27a21-dcc1-48a8-b4ea-fa384a28c315" containerName="kube-state-metrics" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838478 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="ovn-northd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838486 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="ovn-northd" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838500 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838508 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838520 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838528 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838541 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838549 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838558 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-reaper" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838565 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-reaper" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838576 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838585 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838601 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c7aa71e-490d-4282-9b1f-26de919af8a4" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838609 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7aa71e-490d-4282-9b1f-26de919af8a4" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838621 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6dc0a443-6a8e-43fd-8612-01cfe8196876" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838629 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc0a443-6a8e-43fd-8612-01cfe8196876" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838643 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d83cd1db-8da7-4977-889a-579eb4e3367a" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838651 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83cd1db-8da7-4977-889a-579eb4e3367a" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838667 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="rabbitmq" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838677 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="rabbitmq" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838696 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838705 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-api" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838726 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838738 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838757 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838767 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838785 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838794 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838810 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838820 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838835 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerName="galera" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838844 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerName="galera" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838858 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838868 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-server" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838882 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838892 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838902 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838910 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838920 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="ovsdbserver-sb" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838928 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="ovsdbserver-sb" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-log" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838959 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838967 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.838983 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b08d0a94-0636-40de-b613-a6ffecc06c12" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.838991 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08d0a94-0636-40de-b613-a6ffecc06c12" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.839006 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839014 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.839025 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1015deb7-ba46-4b81-8a0d-3767e6b5829d" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839033 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1015deb7-ba46-4b81-8a0d-3767e6b5829d" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.839044 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="cinder-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839052 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="cinder-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.839064 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerName="rabbitmq" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839072 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerName="rabbitmq" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.839083 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="011db835-c98c-4f22-8167-d07b161ac7f2" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="011db835-c98c-4f22-8167-d07b161ac7f2" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: E1121 13:21:25.839103 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839111 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839354 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839362 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839373 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839388 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839398 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="26c27a21-dcc1-48a8-b4ea-fa384a28c315" containerName="kube-state-metrics" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839416 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="550f37a2-49a9-43e6-8bc5-d4787232f49a" containerName="galera" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839428 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-updater" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839438 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839447 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839457 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1015deb7-ba46-4b81-8a0d-3767e6b5829d" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839473 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="532433c6-42b6-4674-977f-8a7a23614deb" containerName="rabbitmq" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839485 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839493 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839503 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839512 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="ovsdbserver-sb" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839523 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-central-agent" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839537 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cf393762-ecdb-4462-8198-0f85d54912e7" containerName="galera" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839551 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="76a1ee99-6132-416f-8a48-9a7a8073e929" containerName="memcached" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839561 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="cinder-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839570 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="ceilometer-notification-agent" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839580 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839589 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839598 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-updater" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839611 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2914ed85-6d74-4ebc-ae7c-11417e874ab1" containerName="cinder-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839619 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839629 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839642 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0a30004c-7036-4604-8fea-33ffd692a39a" containerName="ovsdbserver-nb" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839657 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839668 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b08d0a94-0636-40de-b613-a6ffecc06c12" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839682 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5aed6b53-02ed-4c72-a91a-2f8d750be346" containerName="dnsmasq-dns" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839738 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839775 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="swift-recon-cron" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839794 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cdd3fc9d-251c-47d2-aba8-53f309ea4494" containerName="rabbitmq" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839809 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839822 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="113d6870-bffb-4ac9-8f23-3d4463d37245" containerName="barbican-worker" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839840 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="sg-core" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839850 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839865 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839873 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f74f9009-9b6c-453a-aa99-a6036758983d" containerName="ovn-northd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839888 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d83cd1db-8da7-4977-889a-579eb4e3367a" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839903 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839912 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab913d48-455c-472c-8942-180b14a301d8" containerName="keystone-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839923 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839934 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-server" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839943 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839957 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839968 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="766fca12-6311-4b42-beeb-bd6dfbc3dce3" containerName="proxy-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839980 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="rsync" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.839992 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840009 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840019 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6b257324-3e15-4f82-87a7-b6510652951a" containerName="placement-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840035 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-auditor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840049 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e73113de-3961-438d-acd9-886c2db72385" containerName="glance-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840057 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="86068992-fbf9-40e2-88a1-456bb9d59cbe" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840067 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5a91599-04eb-42eb-a583-666c0552a16f" containerName="nova-api-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840093 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ac95b70-d511-44d0-b6f0-2f66169bbad4" containerName="glance-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840105 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="011db835-c98c-4f22-8167-d07b161ac7f2" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840121 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="account-reaper" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840129 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e6c5a53a-ebfa-4652-bfec-3df5ca4895b7" containerName="proxy-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840144 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="546bcae7-9cd0-4153-9ebc-5f408d2b4eba" containerName="probe" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840157 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="object-expirer" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840169 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840182 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c7aa71e-490d-4282-9b1f-26de919af8a4" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840225 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840238 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b728bee3-96ff-4142-9282-de05409ad732" containerName="barbican-api" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840251 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840263 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ca72de5-8bbe-4688-a068-4ecc4a4f3cfc" containerName="neutron-httpd" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840276 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f9e7d8a7-0ab6-433c-a590-8a908ae70d01" containerName="nova-metadata-metadata" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840287 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66c82043-0b6b-4a5f-9c0c-826a19dc36d3" containerName="container-replicator" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840298 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6dc0a443-6a8e-43fd-8612-01cfe8196876" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840309 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bd38baf-c2f2-4755-826d-27eeca7b2c1c" containerName="barbican-keystone-listener-log" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840321 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bf19d867-b143-4d9e-a5c7-99f6ece00271" containerName="mariadb-account-delete" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840333 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9dc26468-7e8c-4434-8bed-2a6ed91fa1eb" containerName="openstack-network-exporter" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.840937 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.845014 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.845253 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.845594 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.848713 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hdmtk"] Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.850752 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.886872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fe5cf447-98b7-425c-b10b-2d1b66e45258-crc-storage\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.886953 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swvxz\" (UniqueName: \"kubernetes.io/projected/fe5cf447-98b7-425c-b10b-2d1b66e45258-kube-api-access-swvxz\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.887011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fe5cf447-98b7-425c-b10b-2d1b66e45258-node-mnt\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.988137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fe5cf447-98b7-425c-b10b-2d1b66e45258-crc-storage\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.988247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-swvxz\" (UniqueName: \"kubernetes.io/projected/fe5cf447-98b7-425c-b10b-2d1b66e45258-kube-api-access-swvxz\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.988297 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fe5cf447-98b7-425c-b10b-2d1b66e45258-node-mnt\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.988636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fe5cf447-98b7-425c-b10b-2d1b66e45258-node-mnt\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:25 crc kubenswrapper[4769]: I1121 13:21:25.989061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fe5cf447-98b7-425c-b10b-2d1b66e45258-crc-storage\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:26 crc kubenswrapper[4769]: I1121 13:21:26.007162 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-swvxz\" (UniqueName: \"kubernetes.io/projected/fe5cf447-98b7-425c-b10b-2d1b66e45258-kube-api-access-swvxz\") pod \"crc-storage-crc-hdmtk\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:26 crc kubenswrapper[4769]: I1121 13:21:26.165303 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:26 crc kubenswrapper[4769]: I1121 13:21:26.624062 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hdmtk"] Nov 21 13:21:27 crc kubenswrapper[4769]: I1121 13:21:27.285220 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546f1ee0-ab53-4793-b5df-792ddcdc8bc7" path="/var/lib/kubelet/pods/546f1ee0-ab53-4793-b5df-792ddcdc8bc7/volumes" Nov 21 13:21:27 crc kubenswrapper[4769]: I1121 13:21:27.546540 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hdmtk" event={"ID":"fe5cf447-98b7-425c-b10b-2d1b66e45258","Type":"ContainerStarted","Data":"760f0b87ffe3b632377c014d228ecd82afec230ec9aca96578b75d7db3d8990b"} Nov 21 13:21:28 crc kubenswrapper[4769]: I1121 13:21:28.555753 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe5cf447-98b7-425c-b10b-2d1b66e45258" containerID="2ef027f91ee44e18b5f40fcd0a6e3775ad68549c3902ed8998451eed515855cc" exitCode=0 Nov 21 13:21:28 crc kubenswrapper[4769]: I1121 13:21:28.555803 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hdmtk" event={"ID":"fe5cf447-98b7-425c-b10b-2d1b66e45258","Type":"ContainerDied","Data":"2ef027f91ee44e18b5f40fcd0a6e3775ad68549c3902ed8998451eed515855cc"} Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.900605 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.944807 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fe5cf447-98b7-425c-b10b-2d1b66e45258-node-mnt\") pod \"fe5cf447-98b7-425c-b10b-2d1b66e45258\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.944959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fe5cf447-98b7-425c-b10b-2d1b66e45258-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "fe5cf447-98b7-425c-b10b-2d1b66e45258" (UID: "fe5cf447-98b7-425c-b10b-2d1b66e45258"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.944987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fe5cf447-98b7-425c-b10b-2d1b66e45258-crc-storage\") pod \"fe5cf447-98b7-425c-b10b-2d1b66e45258\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.945097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swvxz\" (UniqueName: \"kubernetes.io/projected/fe5cf447-98b7-425c-b10b-2d1b66e45258-kube-api-access-swvxz\") pod \"fe5cf447-98b7-425c-b10b-2d1b66e45258\" (UID: \"fe5cf447-98b7-425c-b10b-2d1b66e45258\") " Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.945508 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fe5cf447-98b7-425c-b10b-2d1b66e45258-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.953478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe5cf447-98b7-425c-b10b-2d1b66e45258-kube-api-access-swvxz" (OuterVolumeSpecName: "kube-api-access-swvxz") pod "fe5cf447-98b7-425c-b10b-2d1b66e45258" (UID: "fe5cf447-98b7-425c-b10b-2d1b66e45258"). InnerVolumeSpecName "kube-api-access-swvxz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:29 crc kubenswrapper[4769]: I1121 13:21:29.980417 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe5cf447-98b7-425c-b10b-2d1b66e45258-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "fe5cf447-98b7-425c-b10b-2d1b66e45258" (UID: "fe5cf447-98b7-425c-b10b-2d1b66e45258"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:30 crc kubenswrapper[4769]: I1121 13:21:30.046327 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fe5cf447-98b7-425c-b10b-2d1b66e45258-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:30 crc kubenswrapper[4769]: I1121 13:21:30.046359 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-swvxz\" (UniqueName: \"kubernetes.io/projected/fe5cf447-98b7-425c-b10b-2d1b66e45258-kube-api-access-swvxz\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:30 crc kubenswrapper[4769]: I1121 13:21:30.577862 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hdmtk" event={"ID":"fe5cf447-98b7-425c-b10b-2d1b66e45258","Type":"ContainerDied","Data":"760f0b87ffe3b632377c014d228ecd82afec230ec9aca96578b75d7db3d8990b"} Nov 21 13:21:30 crc kubenswrapper[4769]: I1121 13:21:30.577908 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="760f0b87ffe3b632377c014d228ecd82afec230ec9aca96578b75d7db3d8990b" Nov 21 13:21:30 crc kubenswrapper[4769]: I1121 13:21:30.577967 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hdmtk" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.298380 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-hdmtk"] Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.303353 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-hdmtk"] Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.449467 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-z6cbg"] Nov 21 13:21:33 crc kubenswrapper[4769]: E1121 13:21:33.449802 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.449819 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: E1121 13:21:33.449831 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.449837 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:33 crc kubenswrapper[4769]: E1121 13:21:33.449850 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.449858 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: E1121 13:21:33.449869 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe5cf447-98b7-425c-b10b-2d1b66e45258" containerName="storage" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.449875 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe5cf447-98b7-425c-b10b-2d1b66e45258" containerName="storage" Nov 21 13:21:33 crc kubenswrapper[4769]: E1121 13:21:33.449888 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.449895 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17f3666-e78c-4e03-8509-14d6cdea4083" containerName="nova-cell0-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.450041 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2614f647-50de-416e-afe3-7b658b34092e" containerName="nova-scheduler-scheduler" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.450091 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ef4ab46-7a06-41be-ae29-ebc45d686505" containerName="nova-cell1-conductor-conductor" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.450105 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe5cf447-98b7-425c-b10b-2d1b66e45258" containerName="storage" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.450719 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.452599 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.452740 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.452779 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.453034 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.470799 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-z6cbg"] Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.491573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8szv7\" (UniqueName: \"kubernetes.io/projected/d4b6d57d-d109-4e91-ae95-18105181c349-kube-api-access-8szv7\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.491650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d4b6d57d-d109-4e91-ae95-18105181c349-crc-storage\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.491679 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d4b6d57d-d109-4e91-ae95-18105181c349-node-mnt\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.592556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8szv7\" (UniqueName: \"kubernetes.io/projected/d4b6d57d-d109-4e91-ae95-18105181c349-kube-api-access-8szv7\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.592629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d4b6d57d-d109-4e91-ae95-18105181c349-crc-storage\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.592656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d4b6d57d-d109-4e91-ae95-18105181c349-node-mnt\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.592924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d4b6d57d-d109-4e91-ae95-18105181c349-node-mnt\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.593480 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d4b6d57d-d109-4e91-ae95-18105181c349-crc-storage\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.611650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8szv7\" (UniqueName: \"kubernetes.io/projected/d4b6d57d-d109-4e91-ae95-18105181c349-kube-api-access-8szv7\") pod \"crc-storage-crc-z6cbg\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:33 crc kubenswrapper[4769]: I1121 13:21:33.771157 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:34 crc kubenswrapper[4769]: I1121 13:21:34.194654 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-z6cbg"] Nov 21 13:21:34 crc kubenswrapper[4769]: I1121 13:21:34.203130 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:21:34 crc kubenswrapper[4769]: I1121 13:21:34.611150 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-z6cbg" event={"ID":"d4b6d57d-d109-4e91-ae95-18105181c349","Type":"ContainerStarted","Data":"fd3bf34bdcfbdfdbca95387a6afd5faceb395e920503f7474b19248eb852c5c9"} Nov 21 13:21:35 crc kubenswrapper[4769]: I1121 13:21:35.284101 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe5cf447-98b7-425c-b10b-2d1b66e45258" path="/var/lib/kubelet/pods/fe5cf447-98b7-425c-b10b-2d1b66e45258/volumes" Nov 21 13:21:36 crc kubenswrapper[4769]: I1121 13:21:36.274359 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:21:36 crc kubenswrapper[4769]: E1121 13:21:36.275441 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:21:36 crc kubenswrapper[4769]: I1121 13:21:36.641592 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4b6d57d-d109-4e91-ae95-18105181c349" containerID="5550cf7a7b55f6f5368733cda6671532aaaf75ab10001b98af344a90ad658e25" exitCode=0 Nov 21 13:21:36 crc kubenswrapper[4769]: I1121 13:21:36.641694 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-z6cbg" event={"ID":"d4b6d57d-d109-4e91-ae95-18105181c349","Type":"ContainerDied","Data":"5550cf7a7b55f6f5368733cda6671532aaaf75ab10001b98af344a90ad658e25"} Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.964329 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.968616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d4b6d57d-d109-4e91-ae95-18105181c349-crc-storage\") pod \"d4b6d57d-d109-4e91-ae95-18105181c349\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.968667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d4b6d57d-d109-4e91-ae95-18105181c349-node-mnt\") pod \"d4b6d57d-d109-4e91-ae95-18105181c349\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.968783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8szv7\" (UniqueName: \"kubernetes.io/projected/d4b6d57d-d109-4e91-ae95-18105181c349-kube-api-access-8szv7\") pod \"d4b6d57d-d109-4e91-ae95-18105181c349\" (UID: \"d4b6d57d-d109-4e91-ae95-18105181c349\") " Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.969566 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d4b6d57d-d109-4e91-ae95-18105181c349-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "d4b6d57d-d109-4e91-ae95-18105181c349" (UID: "d4b6d57d-d109-4e91-ae95-18105181c349"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.973065 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b6d57d-d109-4e91-ae95-18105181c349-kube-api-access-8szv7" (OuterVolumeSpecName: "kube-api-access-8szv7") pod "d4b6d57d-d109-4e91-ae95-18105181c349" (UID: "d4b6d57d-d109-4e91-ae95-18105181c349"). InnerVolumeSpecName "kube-api-access-8szv7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:21:37 crc kubenswrapper[4769]: I1121 13:21:37.991419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b6d57d-d109-4e91-ae95-18105181c349-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "d4b6d57d-d109-4e91-ae95-18105181c349" (UID: "d4b6d57d-d109-4e91-ae95-18105181c349"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:21:38 crc kubenswrapper[4769]: I1121 13:21:38.070404 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8szv7\" (UniqueName: \"kubernetes.io/projected/d4b6d57d-d109-4e91-ae95-18105181c349-kube-api-access-8szv7\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:38 crc kubenswrapper[4769]: I1121 13:21:38.070442 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d4b6d57d-d109-4e91-ae95-18105181c349-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:38 crc kubenswrapper[4769]: I1121 13:21:38.070457 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d4b6d57d-d109-4e91-ae95-18105181c349-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:21:38 crc kubenswrapper[4769]: I1121 13:21:38.660823 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-z6cbg" event={"ID":"d4b6d57d-d109-4e91-ae95-18105181c349","Type":"ContainerDied","Data":"fd3bf34bdcfbdfdbca95387a6afd5faceb395e920503f7474b19248eb852c5c9"} Nov 21 13:21:38 crc kubenswrapper[4769]: I1121 13:21:38.660878 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd3bf34bdcfbdfdbca95387a6afd5faceb395e920503f7474b19248eb852c5c9" Nov 21 13:21:38 crc kubenswrapper[4769]: I1121 13:21:38.660953 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z6cbg" Nov 21 13:21:48 crc kubenswrapper[4769]: I1121 13:21:48.274473 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:21:48 crc kubenswrapper[4769]: I1121 13:21:48.742794 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"7ff5c9c12aa9f3f80f599745cb886ae54831b6420ebf341781639b968520a396"} Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.870923 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:21:49 crc kubenswrapper[4769]: E1121 13:21:49.871265 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4b6d57d-d109-4e91-ae95-18105181c349" containerName="storage" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.871277 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b6d57d-d109-4e91-ae95-18105181c349" containerName="storage" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.871407 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4b6d57d-d109-4e91-ae95-18105181c349" containerName="storage" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.872216 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.877507 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.877658 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-config-data" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.877893 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-default-user" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.877970 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-server-dockercfg-f9kzf" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.878499 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.878757 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-svc" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.878965 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-server-conf" Nov 21 13:21:49 crc kubenswrapper[4769]: I1121 13:21:49.904157 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.042732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b51a88b8-9feb-448a-89c2-93800a854081-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.042809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b51a88b8-9feb-448a-89c2-93800a854081-pod-info\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.042847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-server-conf\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.042903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.042970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztbw\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-kube-api-access-bztbw\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.043018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.043092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.043229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.043326 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.043390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.043439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b51a88b8-9feb-448a-89c2-93800a854081-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-server-conf\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b51a88b8-9feb-448a-89c2-93800a854081-pod-info\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bztbw\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-kube-api-access-bztbw\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.144961 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.145323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.145361 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.145456 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.145765 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.145781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.146429 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.146855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.146865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.148137 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-server-conf\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.150794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b51a88b8-9feb-448a-89c2-93800a854081-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.157482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.157980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.160624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b51a88b8-9feb-448a-89c2-93800a854081-pod-info\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.163069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztbw\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-kube-api-access-bztbw\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.171847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.193330 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.685461 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.766829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b51a88b8-9feb-448a-89c2-93800a854081","Type":"ContainerStarted","Data":"941c7aa364bfbf72755fe6a20c2493832f8063c6ccd7be9e47faa23ae5a395e6"} Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.854389 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.856268 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.858660 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-erlang-cookie" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.858861 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-config-data" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.859025 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-plugins-conf" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.859253 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-rabbitmq-cell1-svc" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.859427 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-dockercfg-nkvbl" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.859611 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"rabbitmq-cell1-server-conf" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.859731 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"rabbitmq-cell1-default-user" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.872871 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962606 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f76c87ba-5d40-4b61-a44a-7b8c895507d8-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962677 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f76c87ba-5d40-4b61-a44a-7b8c895507d8-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962727 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962749 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962817 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7hh\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-kube-api-access-wj7hh\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.962902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.963013 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.963233 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:50 crc kubenswrapper[4769]: I1121 13:21:50.963277 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065372 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065699 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7hh\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-kube-api-access-wj7hh\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f76c87ba-5d40-4b61-a44a-7b8c895507d8-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065940 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f76c87ba-5d40-4b61-a44a-7b8c895507d8-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.065955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.066817 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.066985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.067158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.067491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.067785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.067915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.071896 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f76c87ba-5d40-4b61-a44a-7b8c895507d8-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.071928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f76c87ba-5d40-4b61-a44a-7b8c895507d8-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.072491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.073026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.091863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7hh\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-kube-api-access-wj7hh\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.108171 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.178353 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.690729 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:21:51 crc kubenswrapper[4769]: W1121 13:21:51.692781 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76c87ba_5d40_4b61_a44a_7b8c895507d8.slice/crio-23a86f946b081732b2394e643ed35e00dd95e314d4d137845fd304b1cfe2b181 WatchSource:0}: Error finding container 23a86f946b081732b2394e643ed35e00dd95e314d4d137845fd304b1cfe2b181: Status 404 returned error can't find the container with id 23a86f946b081732b2394e643ed35e00dd95e314d4d137845fd304b1cfe2b181 Nov 21 13:21:51 crc kubenswrapper[4769]: I1121 13:21:51.774874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"f76c87ba-5d40-4b61-a44a-7b8c895507d8","Type":"ContainerStarted","Data":"23a86f946b081732b2394e643ed35e00dd95e314d4d137845fd304b1cfe2b181"} Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.311766 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.313378 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.317047 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-scripts" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.317403 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-svc" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.317707 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-dockercfg-6bjcj" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.317864 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config-data" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.330647 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.332995 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.505036 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.505640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1243748f-cba6-409e-8765-467b40e04ba7-config-data-generated\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.505693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-operator-scripts\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.505810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr242\" (UniqueName: \"kubernetes.io/projected/1243748f-cba6-409e-8765-467b40e04ba7-kube-api-access-mr242\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.505860 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.505959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.506009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-config-data-default\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.506083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-kolla-config\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.607252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mr242\" (UniqueName: \"kubernetes.io/projected/1243748f-cba6-409e-8765-467b40e04ba7-kube-api-access-mr242\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.607605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.607746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.607855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-config-data-default\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.607977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-kolla-config\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1243748f-cba6-409e-8765-467b40e04ba7-config-data-generated\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608377 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-operator-scripts\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-kolla-config\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608733 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1243748f-cba6-409e-8765-467b40e04ba7-config-data-generated\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608826 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-config-data-default\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.608854 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.609810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-operator-scripts\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.623314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.623634 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.626166 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr242\" (UniqueName: \"kubernetes.io/projected/1243748f-cba6-409e-8765-467b40e04ba7-kube-api-access-mr242\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.641646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-0\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.783948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b51a88b8-9feb-448a-89c2-93800a854081","Type":"ContainerStarted","Data":"bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a"} Nov 21 13:21:52 crc kubenswrapper[4769]: I1121 13:21:52.931227 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.200668 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.750331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.752948 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.757066 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-galera-openstack-cell1-svc" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.757167 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"galera-openstack-cell1-dockercfg-vnhbz" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.757521 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-config-data" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.757669 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-cell1-scripts" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.768731 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.795811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"1243748f-cba6-409e-8765-467b40e04ba7","Type":"ContainerStarted","Data":"e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21"} Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.795863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"1243748f-cba6-409e-8765-467b40e04ba7","Type":"ContainerStarted","Data":"fcd373bcdbdfefa4723265d65941e37f9bd1b9c2c2ff79a151d2664a3ede9ba5"} Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.803913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"f76c87ba-5d40-4b61-a44a-7b8c895507d8","Type":"ContainerStarted","Data":"12749eec873cc9c283cbbf6933412d3ccab913e1b10a3630ef36798a37d4b69c"} Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.930029 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.930262 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2z2\" (UniqueName: \"kubernetes.io/projected/ed1d317a-289c-469d-98ae-789dd3230e4a-kube-api-access-pj2z2\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.930500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.930599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.931747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.931795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.931898 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:53 crc kubenswrapper[4769]: I1121 13:21:53.931945 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034016 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034137 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2z2\" (UniqueName: \"kubernetes.io/projected/ed1d317a-289c-469d-98ae-789dd3230e4a-kube-api-access-pj2z2\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034315 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.034517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.035042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.035212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.035373 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.035793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.035844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.041985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.045062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.075158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2z2\" (UniqueName: \"kubernetes.io/projected/ed1d317a-289c-469d-98ae-789dd3230e4a-kube-api-access-pj2z2\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.102297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.238957 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.242158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.244841 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-memcached-svc" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.245087 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"memcached-config-data" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.246216 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"memcached-memcached-dockercfg-f56bl" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.253127 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.338055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gc78\" (UniqueName: \"kubernetes.io/projected/00d977e8-e6a0-4274-be9a-24c45d5b1496-kube-api-access-2gc78\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.338442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-combined-ca-bundle\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.338492 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-config-data\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.338591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-kolla-config\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.338658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-memcached-tls-certs\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.377664 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.439540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-kolla-config\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.439614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-memcached-tls-certs\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.439757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2gc78\" (UniqueName: \"kubernetes.io/projected/00d977e8-e6a0-4274-be9a-24c45d5b1496-kube-api-access-2gc78\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.440071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-combined-ca-bundle\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.440123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-config-data\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.440696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-kolla-config\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.441577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-config-data\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.445486 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-combined-ca-bundle\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.449723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-memcached-tls-certs\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.459996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gc78\" (UniqueName: \"kubernetes.io/projected/00d977e8-e6a0-4274-be9a-24c45d5b1496-kube-api-access-2gc78\") pod \"memcached-0\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.601722 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:54 crc kubenswrapper[4769]: I1121 13:21:54.840182 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:21:54 crc kubenswrapper[4769]: W1121 13:21:54.845960 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded1d317a_289c_469d_98ae_789dd3230e4a.slice/crio-5cecface125ba1a29ce2d9c798ba8e2e5af6e0756846903aff523c971e91ed4a WatchSource:0}: Error finding container 5cecface125ba1a29ce2d9c798ba8e2e5af6e0756846903aff523c971e91ed4a: Status 404 returned error can't find the container with id 5cecface125ba1a29ce2d9c798ba8e2e5af6e0756846903aff523c971e91ed4a Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.032753 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:21:55 crc kubenswrapper[4769]: W1121 13:21:55.037317 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00d977e8_e6a0_4274_be9a_24c45d5b1496.slice/crio-ae92a08bb050757dc7ac3a709ccab2a113f5668f6e918808382474be49209344 WatchSource:0}: Error finding container ae92a08bb050757dc7ac3a709ccab2a113f5668f6e918808382474be49209344: Status 404 returned error can't find the container with id ae92a08bb050757dc7ac3a709ccab2a113f5668f6e918808382474be49209344 Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.506990 4769 scope.go:117] "RemoveContainer" containerID="5ac880fd145211d0a1d8bc2f74f27223bfa832a7533090cb26d7944bec370d63" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.542391 4769 scope.go:117] "RemoveContainer" containerID="c1624aa19000399e1b301fd9c8a1d857ffe396d70af0aea1520ee13047496654" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.587524 4769 scope.go:117] "RemoveContainer" containerID="d85cce4ecec066027ff83499830ba52857c216053c38299de387f6fe68d5458f" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.613105 4769 scope.go:117] "RemoveContainer" containerID="58c55c056d067a0c7edaf3bcaecc30eada0c2378ed09c7b7f74f65a8d9ea64f2" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.645215 4769 scope.go:117] "RemoveContainer" containerID="6b8b64d1841f7133ce1191474f0746d6f3e25dec326fdc438f460624b3a44758" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.686820 4769 scope.go:117] "RemoveContainer" containerID="935def2f22d12f2990c685ada52ab1305ce000cdc20a721fbeaf703fa8b0fe03" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.708567 4769 scope.go:117] "RemoveContainer" containerID="a3494c786bde02a64a6245c32ced4dadcc14b680d66453e245dcebb53a862c8f" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.748571 4769 scope.go:117] "RemoveContainer" containerID="10703a120a7cf5f1b3ccbbc6a7054a0ba627c80c40e0808afb513db0ce9b544f" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.798806 4769 scope.go:117] "RemoveContainer" containerID="743b78b4d2d710e689cab3e4a93cee94e755ceb048228a03934928f87969f76f" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.819265 4769 scope.go:117] "RemoveContainer" containerID="e7dcb48371f08e2c167ef53b8a5b4bd0a3f974876a17a45ae6db4e5462097e39" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.839585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"ed1d317a-289c-469d-98ae-789dd3230e4a","Type":"ContainerStarted","Data":"35780fbd002f6471a055378cb579e4acd2cd09045a9d6681b7d277bd001c293b"} Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.839657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"ed1d317a-289c-469d-98ae-789dd3230e4a","Type":"ContainerStarted","Data":"5cecface125ba1a29ce2d9c798ba8e2e5af6e0756846903aff523c971e91ed4a"} Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.848993 4769 scope.go:117] "RemoveContainer" containerID="f1ba6322e5b2fd8f9d61ebfb31895ae253c98dcaebc2ef016a403c03ee2953f6" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.875113 4769 scope.go:117] "RemoveContainer" containerID="21c309de1ad11572d0b9256cd7e63386908a3402b3e803c9c8ac2651a7c62b56" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.880237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"00d977e8-e6a0-4274-be9a-24c45d5b1496","Type":"ContainerStarted","Data":"81b8a741f8c82e2efe32db9b2fb6bd4b16c9bcc4e5d212b94284640d453687d2"} Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.880279 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"00d977e8-e6a0-4274-be9a-24c45d5b1496","Type":"ContainerStarted","Data":"ae92a08bb050757dc7ac3a709ccab2a113f5668f6e918808382474be49209344"} Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.880560 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:21:55 crc kubenswrapper[4769]: I1121 13:21:55.905015 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.904992015 podStartE2EDuration="1.904992015s" podCreationTimestamp="2025-11-21 13:21:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:21:55.898079116 +0000 UTC m=+5474.598740944" watchObservedRunningTime="2025-11-21 13:21:55.904992015 +0000 UTC m=+5474.605653833" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.103492 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.119398 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.119761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.125669 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"telemetry-ceilometer-dockercfg-7525l" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.269570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbbc\" (UniqueName: \"kubernetes.io/projected/2ae49068-2bd3-4e26-9f64-aacec87152cd-kube-api-access-hdbbc\") pod \"kube-state-metrics-0\" (UID: \"2ae49068-2bd3-4e26-9f64-aacec87152cd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.371145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbbc\" (UniqueName: \"kubernetes.io/projected/2ae49068-2bd3-4e26-9f64-aacec87152cd-kube-api-access-hdbbc\") pod \"kube-state-metrics-0\" (UID: \"2ae49068-2bd3-4e26-9f64-aacec87152cd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.389908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbbc\" (UniqueName: \"kubernetes.io/projected/2ae49068-2bd3-4e26-9f64-aacec87152cd-kube-api-access-hdbbc\") pod \"kube-state-metrics-0\" (UID: \"2ae49068-2bd3-4e26-9f64-aacec87152cd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.447053 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:21:56 crc kubenswrapper[4769]: I1121 13:21:56.878892 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:21:57 crc kubenswrapper[4769]: I1121 13:21:57.895238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2ae49068-2bd3-4e26-9f64-aacec87152cd","Type":"ContainerStarted","Data":"d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f"} Nov 21 13:21:57 crc kubenswrapper[4769]: I1121 13:21:57.895590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2ae49068-2bd3-4e26-9f64-aacec87152cd","Type":"ContainerStarted","Data":"874a1bcbe19f370f692b77f5c5de63357c9b3f5e46dba5720c20a4cdcd118b5f"} Nov 21 13:21:57 crc kubenswrapper[4769]: I1121 13:21:57.895612 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:21:57 crc kubenswrapper[4769]: I1121 13:21:57.908527 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.485771511 podStartE2EDuration="1.908508744s" podCreationTimestamp="2025-11-21 13:21:56 +0000 UTC" firstStartedPulling="2025-11-21 13:21:56.889065371 +0000 UTC m=+5475.589727189" lastFinishedPulling="2025-11-21 13:21:57.311802604 +0000 UTC m=+5476.012464422" observedRunningTime="2025-11-21 13:21:57.906563824 +0000 UTC m=+5476.607225652" watchObservedRunningTime="2025-11-21 13:21:57.908508744 +0000 UTC m=+5476.609170562" Nov 21 13:21:58 crc kubenswrapper[4769]: I1121 13:21:58.902338 4769 generic.go:334] "Generic (PLEG): container finished" podID="1243748f-cba6-409e-8765-467b40e04ba7" containerID="e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21" exitCode=0 Nov 21 13:21:58 crc kubenswrapper[4769]: I1121 13:21:58.904033 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"1243748f-cba6-409e-8765-467b40e04ba7","Type":"ContainerDied","Data":"e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21"} Nov 21 13:21:59 crc kubenswrapper[4769]: I1121 13:21:59.911559 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"1243748f-cba6-409e-8765-467b40e04ba7","Type":"ContainerStarted","Data":"d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0"} Nov 21 13:21:59 crc kubenswrapper[4769]: I1121 13:21:59.914629 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerID="35780fbd002f6471a055378cb579e4acd2cd09045a9d6681b7d277bd001c293b" exitCode=0 Nov 21 13:21:59 crc kubenswrapper[4769]: I1121 13:21:59.914702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"ed1d317a-289c-469d-98ae-789dd3230e4a","Type":"ContainerDied","Data":"35780fbd002f6471a055378cb579e4acd2cd09045a9d6681b7d277bd001c293b"} Nov 21 13:21:59 crc kubenswrapper[4769]: I1121 13:21:59.934840 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.934824313 podStartE2EDuration="8.934824313s" podCreationTimestamp="2025-11-21 13:21:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:21:59.931852516 +0000 UTC m=+5478.632514334" watchObservedRunningTime="2025-11-21 13:21:59.934824313 +0000 UTC m=+5478.635486131" Nov 21 13:22:00 crc kubenswrapper[4769]: I1121 13:22:00.924232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"ed1d317a-289c-469d-98ae-789dd3230e4a","Type":"ContainerStarted","Data":"1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e"} Nov 21 13:22:00 crc kubenswrapper[4769]: I1121 13:22:00.947829 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=8.947811828 podStartE2EDuration="8.947811828s" podCreationTimestamp="2025-11-21 13:21:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:00.941574367 +0000 UTC m=+5479.642236205" watchObservedRunningTime="2025-11-21 13:22:00.947811828 +0000 UTC m=+5479.648473646" Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.985884 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.987248 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.990094 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovn-metrics" Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.990268 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-nb-ovndbs" Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.990339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-nb-dockercfg-scscz" Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.990653 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-scripts" Nov 21 13:22:01 crc kubenswrapper[4769]: I1121 13:22:01.990925 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-nb-config" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.000656 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.169342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.169684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-config\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.169809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.170181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.170356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.170485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.170627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4l2f\" (UniqueName: \"kubernetes.io/projected/2d6fd3d6-d129-40ae-8db7-be0e04466950-kube-api-access-g4l2f\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.170779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.271779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.271833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.271861 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-config\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.271886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.273038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.273113 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.273249 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.273384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.273452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.273502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g4l2f\" (UniqueName: \"kubernetes.io/projected/2d6fd3d6-d129-40ae-8db7-be0e04466950-kube-api-access-g4l2f\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.275239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.275170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-config\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.279814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.281005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.285342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.292261 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4l2f\" (UniqueName: \"kubernetes.io/projected/2d6fd3d6-d129-40ae-8db7-be0e04466950-kube-api-access-g4l2f\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.330562 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.333049 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.336144 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovndbcluster-sb-ovndbs" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.336428 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-config" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.336588 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovndbcluster-sb-scripts" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.338022 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovncluster-ovndbcluster-sb-dockercfg-cx2h8" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.342522 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.344551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.371091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477659 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-config\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477751 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.477830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fplnv\" (UniqueName: \"kubernetes.io/projected/024d7eeb-986d-4113-9ed3-956c3ca2f600-kube-api-access-fplnv\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-config\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579558 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579627 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fplnv\" (UniqueName: \"kubernetes.io/projected/024d7eeb-986d-4113-9ed3-956c3ca2f600-kube-api-access-fplnv\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.579743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.580016 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.580908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.581091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-config\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.589528 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.591038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.591122 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.593835 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.599669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fplnv\" (UniqueName: \"kubernetes.io/projected/024d7eeb-986d-4113-9ed3-956c3ca2f600-kube-api-access-fplnv\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.604172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.773005 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.842428 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.932121 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.932939 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:22:02 crc kubenswrapper[4769]: I1121 13:22:02.942880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"2d6fd3d6-d129-40ae-8db7-be0e04466950","Type":"ContainerStarted","Data":"44006b672b92d7851a5c352b6f254cde2469389ef1d654f899296716dfee0f1e"} Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.245140 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:22:03 crc kubenswrapper[4769]: W1121 13:22:03.253029 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod024d7eeb_986d_4113_9ed3_956c3ca2f600.slice/crio-85650a7bd7894a05ba70fd66385f5c961ebe532ce057ca0cbc0e04da2ca0c0eb WatchSource:0}: Error finding container 85650a7bd7894a05ba70fd66385f5c961ebe532ce057ca0cbc0e04da2ca0c0eb: Status 404 returned error can't find the container with id 85650a7bd7894a05ba70fd66385f5c961ebe532ce057ca0cbc0e04da2ca0c0eb Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.954112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"024d7eeb-986d-4113-9ed3-956c3ca2f600","Type":"ContainerStarted","Data":"db49913b70d2be34d6c625affcffd31fd7e3bae0a9aa1c37a1ac503be82937da"} Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.954449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"024d7eeb-986d-4113-9ed3-956c3ca2f600","Type":"ContainerStarted","Data":"569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472"} Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.954463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"024d7eeb-986d-4113-9ed3-956c3ca2f600","Type":"ContainerStarted","Data":"85650a7bd7894a05ba70fd66385f5c961ebe532ce057ca0cbc0e04da2ca0c0eb"} Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.955893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"2d6fd3d6-d129-40ae-8db7-be0e04466950","Type":"ContainerStarted","Data":"be9c19419f89a89082ee0b343109bab8e7792cc6fea3839c7fdeddca9f685c62"} Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.956026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"2d6fd3d6-d129-40ae-8db7-be0e04466950","Type":"ContainerStarted","Data":"cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514"} Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.975647 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.975625345 podStartE2EDuration="2.975625345s" podCreationTimestamp="2025-11-21 13:22:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:03.972047122 +0000 UTC m=+5482.672708940" watchObservedRunningTime="2025-11-21 13:22:03.975625345 +0000 UTC m=+5482.676287163" Nov 21 13:22:03 crc kubenswrapper[4769]: I1121 13:22:03.992012 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.991992269 podStartE2EDuration="3.991992269s" podCreationTimestamp="2025-11-21 13:22:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:03.989475373 +0000 UTC m=+5482.690137191" watchObservedRunningTime="2025-11-21 13:22:03.991992269 +0000 UTC m=+5482.692654087" Nov 21 13:22:04 crc kubenswrapper[4769]: I1121 13:22:04.379398 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:22:04 crc kubenswrapper[4769]: I1121 13:22:04.379762 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:22:04 crc kubenswrapper[4769]: I1121 13:22:04.603816 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:22:05 crc kubenswrapper[4769]: I1121 13:22:05.083088 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:22:05 crc kubenswrapper[4769]: I1121 13:22:05.154232 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:22:05 crc kubenswrapper[4769]: I1121 13:22:05.161548 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:22:05 crc kubenswrapper[4769]: I1121 13:22:05.254818 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:22:05 crc kubenswrapper[4769]: I1121 13:22:05.371620 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:05 crc kubenswrapper[4769]: I1121 13:22:05.773425 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:06 crc kubenswrapper[4769]: I1121 13:22:06.454381 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.372041 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.537549 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.543751 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.545330 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-conf" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.545714 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-swift-dockercfg-dkhsk" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.545783 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-files" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.545834 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-storage-config-data" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.557623 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.661274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-cache\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.662172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.662507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt988\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-kube-api-access-lt988\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.662731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-lock\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.662835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.763916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-cache\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.763974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.764014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lt988\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-kube-api-access-lt988\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.764088 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-lock\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.764112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: E1121 13:22:07.764344 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:22:07 crc kubenswrapper[4769]: E1121 13:22:07.764362 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:22:07 crc kubenswrapper[4769]: E1121 13:22:07.764414 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift podName:de29f094-3b0a-4c67-a75e-8d50a59945a9 nodeName:}" failed. No retries permitted until 2025-11-21 13:22:08.264394068 +0000 UTC m=+5486.965055886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift") pod "swift-storage-0" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9") : configmap "swift-ring-files" not found Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.764878 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.765014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-cache\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.765160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-lock\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.787411 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.800098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt988\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-kube-api-access-lt988\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:07 crc kubenswrapper[4769]: I1121 13:22:07.800944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:08 crc kubenswrapper[4769]: I1121 13:22:08.271473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:08 crc kubenswrapper[4769]: E1121 13:22:08.271604 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:22:08 crc kubenswrapper[4769]: E1121 13:22:08.271869 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:22:08 crc kubenswrapper[4769]: E1121 13:22:08.271912 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift podName:de29f094-3b0a-4c67-a75e-8d50a59945a9 nodeName:}" failed. No retries permitted until 2025-11-21 13:22:09.271899657 +0000 UTC m=+5487.972561475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift") pod "swift-storage-0" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9") : configmap "swift-ring-files" not found Nov 21 13:22:08 crc kubenswrapper[4769]: I1121 13:22:08.419055 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:08 crc kubenswrapper[4769]: I1121 13:22:08.466127 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:22:08 crc kubenswrapper[4769]: I1121 13:22:08.810084 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:08 crc kubenswrapper[4769]: I1121 13:22:08.855830 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.021564 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.023235 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.025954 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ovnnorthd-ovnnorthd-dockercfg-97lw2" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.026182 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-scripts" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.026508 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ovnnorthd-ovndbs" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.026662 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovnnorthd-config" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.037630 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-scripts\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-config\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088789 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4pmc\" (UniqueName: \"kubernetes.io/projected/604926b7-fdf2-4dc6-9a15-2160c9feff0c-kube-api-access-x4pmc\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088853 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.088903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.190915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.191072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.191124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-scripts\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.191162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-config\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.191207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.191237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x4pmc\" (UniqueName: \"kubernetes.io/projected/604926b7-fdf2-4dc6-9a15-2160c9feff0c-kube-api-access-x4pmc\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.191299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.192890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-scripts\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.193119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-config\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.193118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.199487 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.199663 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.205708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.210928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4pmc\" (UniqueName: \"kubernetes.io/projected/604926b7-fdf2-4dc6-9a15-2160c9feff0c-kube-api-access-x4pmc\") pod \"ovn-northd-0\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.292955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:09 crc kubenswrapper[4769]: E1121 13:22:09.293220 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:22:09 crc kubenswrapper[4769]: E1121 13:22:09.293234 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:22:09 crc kubenswrapper[4769]: E1121 13:22:09.293275 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift podName:de29f094-3b0a-4c67-a75e-8d50a59945a9 nodeName:}" failed. No retries permitted until 2025-11-21 13:22:11.293260289 +0000 UTC m=+5489.993922107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift") pod "swift-storage-0" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9") : configmap "swift-ring-files" not found Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.358383 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:09 crc kubenswrapper[4769]: I1121 13:22:09.969121 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:22:09 crc kubenswrapper[4769]: W1121 13:22:09.973762 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod604926b7_fdf2_4dc6_9a15_2160c9feff0c.slice/crio-c6f0c5575de76731f992ac5e1e2905f90292de9df114b70dc7feed02a679a6ff WatchSource:0}: Error finding container c6f0c5575de76731f992ac5e1e2905f90292de9df114b70dc7feed02a679a6ff: Status 404 returned error can't find the container with id c6f0c5575de76731f992ac5e1e2905f90292de9df114b70dc7feed02a679a6ff Nov 21 13:22:10 crc kubenswrapper[4769]: I1121 13:22:10.009294 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"604926b7-fdf2-4dc6-9a15-2160c9feff0c","Type":"ContainerStarted","Data":"c6f0c5575de76731f992ac5e1e2905f90292de9df114b70dc7feed02a679a6ff"} Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.021044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"604926b7-fdf2-4dc6-9a15-2160c9feff0c","Type":"ContainerStarted","Data":"ef863c661a90d61b54675e320d9df78dcaf9bf458ea01ea85f44d8e12a6dd1f5"} Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.021403 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"604926b7-fdf2-4dc6-9a15-2160c9feff0c","Type":"ContainerStarted","Data":"b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf"} Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.021427 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.040469 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=3.040453237 podStartE2EDuration="3.040453237s" podCreationTimestamp="2025-11-21 13:22:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:11.037328816 +0000 UTC m=+5489.737990644" watchObservedRunningTime="2025-11-21 13:22:11.040453237 +0000 UTC m=+5489.741115055" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.329469 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:11 crc kubenswrapper[4769]: E1121 13:22:11.329643 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:22:11 crc kubenswrapper[4769]: E1121 13:22:11.329680 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:22:11 crc kubenswrapper[4769]: E1121 13:22:11.329749 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift podName:de29f094-3b0a-4c67-a75e-8d50a59945a9 nodeName:}" failed. No retries permitted until 2025-11-21 13:22:15.329727702 +0000 UTC m=+5494.030389530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift") pod "swift-storage-0" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9") : configmap "swift-ring-files" not found Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.447450 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ff6qq"] Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.451893 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.465957 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.466114 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-config-data" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.495231 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"swift-ring-scripts" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534048 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-swiftconf\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534139 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-etc-swift\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534168 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-dispersionconf\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-ring-data-devices\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-scripts\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zgf2\" (UniqueName: \"kubernetes.io/projected/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-kube-api-access-7zgf2\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-combined-ca-bundle\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.534300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ff6qq"] Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-dispersionconf\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635566 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-ring-data-devices\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-scripts\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7zgf2\" (UniqueName: \"kubernetes.io/projected/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-kube-api-access-7zgf2\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-combined-ca-bundle\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-swiftconf\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.635798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-etc-swift\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.636294 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-etc-swift\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.636960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-scripts\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.637108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-ring-data-devices\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.640546 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-swiftconf\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.640751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-combined-ca-bundle\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.640947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-dispersionconf\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.655269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zgf2\" (UniqueName: \"kubernetes.io/projected/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-kube-api-access-7zgf2\") pod \"swift-ring-rebalance-ff6qq\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:11 crc kubenswrapper[4769]: I1121 13:22:11.800126 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:12 crc kubenswrapper[4769]: I1121 13:22:12.057158 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ff6qq"] Nov 21 13:22:13 crc kubenswrapper[4769]: I1121 13:22:13.039098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" event={"ID":"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4","Type":"ContainerStarted","Data":"de6e86a204e3313f8c68feba8496fdf691fb8e53cfa08e9d1f313903e424530a"} Nov 21 13:22:13 crc kubenswrapper[4769]: I1121 13:22:13.039385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" event={"ID":"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4","Type":"ContainerStarted","Data":"aacc3bb65fc3dc2a8afa293e7b70814bb20f408e335ed5ce47278c4643c9ab4d"} Nov 21 13:22:13 crc kubenswrapper[4769]: I1121 13:22:13.060454 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" podStartSLOduration=2.060434421 podStartE2EDuration="2.060434421s" podCreationTimestamp="2025-11-21 13:22:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:13.054829546 +0000 UTC m=+5491.755491354" watchObservedRunningTime="2025-11-21 13:22:13.060434421 +0000 UTC m=+5491.761096239" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.191509 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4gk9w"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.193214 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.225319 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4gk9w"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.280310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjf5s\" (UniqueName: \"kubernetes.io/projected/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-kube-api-access-bjf5s\") pod \"keystone-db-create-4gk9w\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.280413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-operator-scripts\") pod \"keystone-db-create-4gk9w\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.282835 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.283954 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.286017 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-db-secret" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.294367 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.384506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bjf5s\" (UniqueName: \"kubernetes.io/projected/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-kube-api-access-bjf5s\") pod \"keystone-db-create-4gk9w\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.384572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28bs2\" (UniqueName: \"kubernetes.io/projected/63ed2f4f-4e7c-4539-8d06-557aa785ac52-kube-api-access-28bs2\") pod \"keystone-e6a4-account-create-4zwkx\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.384619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-operator-scripts\") pod \"keystone-db-create-4gk9w\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.384646 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63ed2f4f-4e7c-4539-8d06-557aa785ac52-operator-scripts\") pod \"keystone-e6a4-account-create-4zwkx\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.385925 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-operator-scripts\") pod \"keystone-db-create-4gk9w\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.409987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjf5s\" (UniqueName: \"kubernetes.io/projected/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-kube-api-access-bjf5s\") pod \"keystone-db-create-4gk9w\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.486641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-28bs2\" (UniqueName: \"kubernetes.io/projected/63ed2f4f-4e7c-4539-8d06-557aa785ac52-kube-api-access-28bs2\") pod \"keystone-e6a4-account-create-4zwkx\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.486723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63ed2f4f-4e7c-4539-8d06-557aa785ac52-operator-scripts\") pod \"keystone-e6a4-account-create-4zwkx\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.487873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63ed2f4f-4e7c-4539-8d06-557aa785ac52-operator-scripts\") pod \"keystone-e6a4-account-create-4zwkx\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.502355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-28bs2\" (UniqueName: \"kubernetes.io/projected/63ed2f4f-4e7c-4539-8d06-557aa785ac52-kube-api-access-28bs2\") pod \"keystone-e6a4-account-create-4zwkx\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.529266 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.565338 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-gz5jt"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.566764 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.575770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-gz5jt"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.608587 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.694201 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-3637-account-create-nfwpk"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.695841 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.696305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x4rg\" (UniqueName: \"kubernetes.io/projected/2a0c9095-8e64-4754-936e-d92dca1fcb6c-kube-api-access-6x4rg\") pod \"placement-db-create-gz5jt\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.696488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a0c9095-8e64-4754-936e-d92dca1fcb6c-operator-scripts\") pod \"placement-db-create-gz5jt\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.697515 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-db-secret" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.699781 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3637-account-create-nfwpk"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.798716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd3f3895-cd1e-465e-9516-7744f08911cb-operator-scripts\") pod \"placement-3637-account-create-nfwpk\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.798802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4rg\" (UniqueName: \"kubernetes.io/projected/2a0c9095-8e64-4754-936e-d92dca1fcb6c-kube-api-access-6x4rg\") pod \"placement-db-create-gz5jt\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.798859 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a0c9095-8e64-4754-936e-d92dca1fcb6c-operator-scripts\") pod \"placement-db-create-gz5jt\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.798934 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7s5t\" (UniqueName: \"kubernetes.io/projected/bd3f3895-cd1e-465e-9516-7744f08911cb-kube-api-access-v7s5t\") pod \"placement-3637-account-create-nfwpk\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.799467 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-mx78h"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.800046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a0c9095-8e64-4754-936e-d92dca1fcb6c-operator-scripts\") pod \"placement-db-create-gz5jt\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.801668 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.816219 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mx78h"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.819253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x4rg\" (UniqueName: \"kubernetes.io/projected/2a0c9095-8e64-4754-936e-d92dca1fcb6c-kube-api-access-6x4rg\") pod \"placement-db-create-gz5jt\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.888313 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-f3b9-account-create-65z5z"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.889511 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.892786 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-db-secret" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.898229 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-f3b9-account-create-65z5z"] Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.900502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v7s5t\" (UniqueName: \"kubernetes.io/projected/bd3f3895-cd1e-465e-9516-7744f08911cb-kube-api-access-v7s5t\") pod \"placement-3637-account-create-nfwpk\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.900962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd3f3895-cd1e-465e-9516-7744f08911cb-operator-scripts\") pod \"placement-3637-account-create-nfwpk\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.901045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqsm\" (UniqueName: \"kubernetes.io/projected/16eacb62-36b7-461f-88f0-47f604b06741-kube-api-access-swqsm\") pod \"glance-db-create-mx78h\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.901086 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16eacb62-36b7-461f-88f0-47f604b06741-operator-scripts\") pod \"glance-db-create-mx78h\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.903069 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd3f3895-cd1e-465e-9516-7744f08911cb-operator-scripts\") pod \"placement-3637-account-create-nfwpk\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:14 crc kubenswrapper[4769]: I1121 13:22:14.917803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7s5t\" (UniqueName: \"kubernetes.io/projected/bd3f3895-cd1e-465e-9516-7744f08911cb-kube-api-access-v7s5t\") pod \"placement-3637-account-create-nfwpk\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.002018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-swqsm\" (UniqueName: \"kubernetes.io/projected/16eacb62-36b7-461f-88f0-47f604b06741-kube-api-access-swqsm\") pod \"glance-db-create-mx78h\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.002077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16eacb62-36b7-461f-88f0-47f604b06741-operator-scripts\") pod \"glance-db-create-mx78h\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.002126 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3642a623-680d-488e-97bd-5a9a11f56b4d-operator-scripts\") pod \"glance-f3b9-account-create-65z5z\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.002160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcg8r\" (UniqueName: \"kubernetes.io/projected/3642a623-680d-488e-97bd-5a9a11f56b4d-kube-api-access-gcg8r\") pod \"glance-f3b9-account-create-65z5z\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.002884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16eacb62-36b7-461f-88f0-47f604b06741-operator-scripts\") pod \"glance-db-create-mx78h\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.007612 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.022968 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.023836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqsm\" (UniqueName: \"kubernetes.io/projected/16eacb62-36b7-461f-88f0-47f604b06741-kube-api-access-swqsm\") pod \"glance-db-create-mx78h\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.065585 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4gk9w"] Nov 21 13:22:15 crc kubenswrapper[4769]: W1121 13:22:15.066486 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode91ff0bf_0214_45a3_8436_0ae635c5d3e9.slice/crio-21e11abc1c95dd03d2bbdce5f7fe75f24cff7e5574e034f4fd1000ba6ef39129 WatchSource:0}: Error finding container 21e11abc1c95dd03d2bbdce5f7fe75f24cff7e5574e034f4fd1000ba6ef39129: Status 404 returned error can't find the container with id 21e11abc1c95dd03d2bbdce5f7fe75f24cff7e5574e034f4fd1000ba6ef39129 Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.106219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3642a623-680d-488e-97bd-5a9a11f56b4d-operator-scripts\") pod \"glance-f3b9-account-create-65z5z\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.106263 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gcg8r\" (UniqueName: \"kubernetes.io/projected/3642a623-680d-488e-97bd-5a9a11f56b4d-kube-api-access-gcg8r\") pod \"glance-f3b9-account-create-65z5z\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.107174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3642a623-680d-488e-97bd-5a9a11f56b4d-operator-scripts\") pod \"glance-f3b9-account-create-65z5z\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.120675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.127321 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcg8r\" (UniqueName: \"kubernetes.io/projected/3642a623-680d-488e-97bd-5a9a11f56b4d-kube-api-access-gcg8r\") pod \"glance-f3b9-account-create-65z5z\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.190675 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx"] Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.214295 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.410493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:15 crc kubenswrapper[4769]: E1121 13:22:15.411764 4769 projected.go:288] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Nov 21 13:22:15 crc kubenswrapper[4769]: E1121 13:22:15.411788 4769 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Nov 21 13:22:15 crc kubenswrapper[4769]: E1121 13:22:15.411835 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift podName:de29f094-3b0a-4c67-a75e-8d50a59945a9 nodeName:}" failed. No retries permitted until 2025-11-21 13:22:23.411818583 +0000 UTC m=+5502.112480401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift") pod "swift-storage-0" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9") : configmap "swift-ring-files" not found Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.458364 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-gz5jt"] Nov 21 13:22:15 crc kubenswrapper[4769]: W1121 13:22:15.471528 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a0c9095_8e64_4754_936e_d92dca1fcb6c.slice/crio-731d08bbd012b3a583d1352e1650769b59e6314cedd149d8c62de55474459694 WatchSource:0}: Error finding container 731d08bbd012b3a583d1352e1650769b59e6314cedd149d8c62de55474459694: Status 404 returned error can't find the container with id 731d08bbd012b3a583d1352e1650769b59e6314cedd149d8c62de55474459694 Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.538419 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3637-account-create-nfwpk"] Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.651690 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mx78h"] Nov 21 13:22:15 crc kubenswrapper[4769]: W1121 13:22:15.657336 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16eacb62_36b7_461f_88f0_47f604b06741.slice/crio-7ca9275983bcb8ee0b30e3f716808e184818fae1302dc3b0b10610c442e73333 WatchSource:0}: Error finding container 7ca9275983bcb8ee0b30e3f716808e184818fae1302dc3b0b10610c442e73333: Status 404 returned error can't find the container with id 7ca9275983bcb8ee0b30e3f716808e184818fae1302dc3b0b10610c442e73333 Nov 21 13:22:15 crc kubenswrapper[4769]: I1121 13:22:15.785287 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-f3b9-account-create-65z5z"] Nov 21 13:22:15 crc kubenswrapper[4769]: W1121 13:22:15.802468 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3642a623_680d_488e_97bd_5a9a11f56b4d.slice/crio-4ae414eb96953621fede588aa5847d876410bf1db838cb7cf25d20211bd8e149 WatchSource:0}: Error finding container 4ae414eb96953621fede588aa5847d876410bf1db838cb7cf25d20211bd8e149: Status 404 returned error can't find the container with id 4ae414eb96953621fede588aa5847d876410bf1db838cb7cf25d20211bd8e149 Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.071978 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mx78h" event={"ID":"16eacb62-36b7-461f-88f0-47f604b06741","Type":"ContainerStarted","Data":"c86bd2c25f45181ac6696189fa8f94da60ccb3ca924946935844330b805f7be6"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.072053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mx78h" event={"ID":"16eacb62-36b7-461f-88f0-47f604b06741","Type":"ContainerStarted","Data":"7ca9275983bcb8ee0b30e3f716808e184818fae1302dc3b0b10610c442e73333"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.075252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" event={"ID":"bd3f3895-cd1e-465e-9516-7744f08911cb","Type":"ContainerStarted","Data":"ddbe6f6bbb3dbc33f83c9c105fda39a62ecdfd48e50608fb83c7ea728448ca80"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.075329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" event={"ID":"bd3f3895-cd1e-465e-9516-7744f08911cb","Type":"ContainerStarted","Data":"3800c10c055cd1960de83d688e996b3b0319229132673d11baf9ca0205899fbe"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.082991 4769 generic.go:334] "Generic (PLEG): container finished" podID="e91ff0bf-0214-45a3-8436-0ae635c5d3e9" containerID="01cee13087c2bdab18b5bd5d986cd8431354843f6a4ee90746f8aa23820127d3" exitCode=0 Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.083072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" event={"ID":"e91ff0bf-0214-45a3-8436-0ae635c5d3e9","Type":"ContainerDied","Data":"01cee13087c2bdab18b5bd5d986cd8431354843f6a4ee90746f8aa23820127d3"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.083100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" event={"ID":"e91ff0bf-0214-45a3-8436-0ae635c5d3e9","Type":"ContainerStarted","Data":"21e11abc1c95dd03d2bbdce5f7fe75f24cff7e5574e034f4fd1000ba6ef39129"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.085318 4769 generic.go:334] "Generic (PLEG): container finished" podID="63ed2f4f-4e7c-4539-8d06-557aa785ac52" containerID="201f11a80c28d2e389fc6403d05e4a63c823852d372df0b738102621e5b80179" exitCode=0 Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.085400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" event={"ID":"63ed2f4f-4e7c-4539-8d06-557aa785ac52","Type":"ContainerDied","Data":"201f11a80c28d2e389fc6403d05e4a63c823852d372df0b738102621e5b80179"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.085438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" event={"ID":"63ed2f4f-4e7c-4539-8d06-557aa785ac52","Type":"ContainerStarted","Data":"dca81096086c62d515876f9198649bee1f0ec8905f4d97a8fcf4748fd0c28734"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.088767 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-create-mx78h" podStartSLOduration=2.088750582 podStartE2EDuration="2.088750582s" podCreationTimestamp="2025-11-21 13:22:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:16.087437658 +0000 UTC m=+5494.788099476" watchObservedRunningTime="2025-11-21 13:22:16.088750582 +0000 UTC m=+5494.789412410" Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.089567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" event={"ID":"3642a623-680d-488e-97bd-5a9a11f56b4d","Type":"ContainerStarted","Data":"d3a595ac7572f6ee343796bd1cfe8ff50a9360543b62e14fd98a04a7128aa945"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.089609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" event={"ID":"3642a623-680d-488e-97bd-5a9a11f56b4d","Type":"ContainerStarted","Data":"4ae414eb96953621fede588aa5847d876410bf1db838cb7cf25d20211bd8e149"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.096908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-gz5jt" event={"ID":"2a0c9095-8e64-4754-936e-d92dca1fcb6c","Type":"ContainerStarted","Data":"9873ddc0c1065b28be395293760dc95aef10666fd643c5460c2bdb92415a6cb8"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.096960 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-gz5jt" event={"ID":"2a0c9095-8e64-4754-936e-d92dca1fcb6c","Type":"ContainerStarted","Data":"731d08bbd012b3a583d1352e1650769b59e6314cedd149d8c62de55474459694"} Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.136923 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" podStartSLOduration=2.136898459 podStartE2EDuration="2.136898459s" podCreationTimestamp="2025-11-21 13:22:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:16.132900816 +0000 UTC m=+5494.833562644" watchObservedRunningTime="2025-11-21 13:22:16.136898459 +0000 UTC m=+5494.837560277" Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.155750 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" podStartSLOduration=2.155728707 podStartE2EDuration="2.155728707s" podCreationTimestamp="2025-11-21 13:22:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:16.147558116 +0000 UTC m=+5494.848219934" watchObservedRunningTime="2025-11-21 13:22:16.155728707 +0000 UTC m=+5494.856390535" Nov 21 13:22:16 crc kubenswrapper[4769]: I1121 13:22:16.167229 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-create-gz5jt" podStartSLOduration=2.167185074 podStartE2EDuration="2.167185074s" podCreationTimestamp="2025-11-21 13:22:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:16.161760774 +0000 UTC m=+5494.862422622" watchObservedRunningTime="2025-11-21 13:22:16.167185074 +0000 UTC m=+5494.867846912" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.106971 4769 generic.go:334] "Generic (PLEG): container finished" podID="2a0c9095-8e64-4754-936e-d92dca1fcb6c" containerID="9873ddc0c1065b28be395293760dc95aef10666fd643c5460c2bdb92415a6cb8" exitCode=0 Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.107031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-gz5jt" event={"ID":"2a0c9095-8e64-4754-936e-d92dca1fcb6c","Type":"ContainerDied","Data":"9873ddc0c1065b28be395293760dc95aef10666fd643c5460c2bdb92415a6cb8"} Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.604103 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.612608 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.650609 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjf5s\" (UniqueName: \"kubernetes.io/projected/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-kube-api-access-bjf5s\") pod \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.650780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28bs2\" (UniqueName: \"kubernetes.io/projected/63ed2f4f-4e7c-4539-8d06-557aa785ac52-kube-api-access-28bs2\") pod \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.650824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63ed2f4f-4e7c-4539-8d06-557aa785ac52-operator-scripts\") pod \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\" (UID: \"63ed2f4f-4e7c-4539-8d06-557aa785ac52\") " Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.650890 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-operator-scripts\") pod \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\" (UID: \"e91ff0bf-0214-45a3-8436-0ae635c5d3e9\") " Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.652149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e91ff0bf-0214-45a3-8436-0ae635c5d3e9" (UID: "e91ff0bf-0214-45a3-8436-0ae635c5d3e9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.652483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ed2f4f-4e7c-4539-8d06-557aa785ac52-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "63ed2f4f-4e7c-4539-8d06-557aa785ac52" (UID: "63ed2f4f-4e7c-4539-8d06-557aa785ac52"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.658102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-kube-api-access-bjf5s" (OuterVolumeSpecName: "kube-api-access-bjf5s") pod "e91ff0bf-0214-45a3-8436-0ae635c5d3e9" (UID: "e91ff0bf-0214-45a3-8436-0ae635c5d3e9"). InnerVolumeSpecName "kube-api-access-bjf5s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.659061 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ed2f4f-4e7c-4539-8d06-557aa785ac52-kube-api-access-28bs2" (OuterVolumeSpecName: "kube-api-access-28bs2") pod "63ed2f4f-4e7c-4539-8d06-557aa785ac52" (UID: "63ed2f4f-4e7c-4539-8d06-557aa785ac52"). InnerVolumeSpecName "kube-api-access-28bs2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.752817 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.753321 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bjf5s\" (UniqueName: \"kubernetes.io/projected/e91ff0bf-0214-45a3-8436-0ae635c5d3e9-kube-api-access-bjf5s\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.753402 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-28bs2\" (UniqueName: \"kubernetes.io/projected/63ed2f4f-4e7c-4539-8d06-557aa785ac52-kube-api-access-28bs2\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:17 crc kubenswrapper[4769]: I1121 13:22:17.753474 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/63ed2f4f-4e7c-4539-8d06-557aa785ac52-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.120522 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.120527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx" event={"ID":"63ed2f4f-4e7c-4539-8d06-557aa785ac52","Type":"ContainerDied","Data":"dca81096086c62d515876f9198649bee1f0ec8905f4d97a8fcf4748fd0c28734"} Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.120647 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dca81096086c62d515876f9198649bee1f0ec8905f4d97a8fcf4748fd0c28734" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.122639 4769 generic.go:334] "Generic (PLEG): container finished" podID="3642a623-680d-488e-97bd-5a9a11f56b4d" containerID="d3a595ac7572f6ee343796bd1cfe8ff50a9360543b62e14fd98a04a7128aa945" exitCode=0 Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.122778 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" event={"ID":"3642a623-680d-488e-97bd-5a9a11f56b4d","Type":"ContainerDied","Data":"d3a595ac7572f6ee343796bd1cfe8ff50a9360543b62e14fd98a04a7128aa945"} Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.124805 4769 generic.go:334] "Generic (PLEG): container finished" podID="16eacb62-36b7-461f-88f0-47f604b06741" containerID="c86bd2c25f45181ac6696189fa8f94da60ccb3ca924946935844330b805f7be6" exitCode=0 Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.125003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mx78h" event={"ID":"16eacb62-36b7-461f-88f0-47f604b06741","Type":"ContainerDied","Data":"c86bd2c25f45181ac6696189fa8f94da60ccb3ca924946935844330b805f7be6"} Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.129264 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd3f3895-cd1e-465e-9516-7744f08911cb" containerID="ddbe6f6bbb3dbc33f83c9c105fda39a62ecdfd48e50608fb83c7ea728448ca80" exitCode=0 Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.129994 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" event={"ID":"bd3f3895-cd1e-465e-9516-7744f08911cb","Type":"ContainerDied","Data":"ddbe6f6bbb3dbc33f83c9c105fda39a62ecdfd48e50608fb83c7ea728448ca80"} Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.133112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" event={"ID":"e91ff0bf-0214-45a3-8436-0ae635c5d3e9","Type":"ContainerDied","Data":"21e11abc1c95dd03d2bbdce5f7fe75f24cff7e5574e034f4fd1000ba6ef39129"} Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.133327 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21e11abc1c95dd03d2bbdce5f7fe75f24cff7e5574e034f4fd1000ba6ef39129" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.133133 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-4gk9w" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.571118 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.671623 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x4rg\" (UniqueName: \"kubernetes.io/projected/2a0c9095-8e64-4754-936e-d92dca1fcb6c-kube-api-access-6x4rg\") pod \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.672041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a0c9095-8e64-4754-936e-d92dca1fcb6c-operator-scripts\") pod \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\" (UID: \"2a0c9095-8e64-4754-936e-d92dca1fcb6c\") " Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.673058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0c9095-8e64-4754-936e-d92dca1fcb6c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2a0c9095-8e64-4754-936e-d92dca1fcb6c" (UID: "2a0c9095-8e64-4754-936e-d92dca1fcb6c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.676110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0c9095-8e64-4754-936e-d92dca1fcb6c-kube-api-access-6x4rg" (OuterVolumeSpecName: "kube-api-access-6x4rg") pod "2a0c9095-8e64-4754-936e-d92dca1fcb6c" (UID: "2a0c9095-8e64-4754-936e-d92dca1fcb6c"). InnerVolumeSpecName "kube-api-access-6x4rg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.774866 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2a0c9095-8e64-4754-936e-d92dca1fcb6c-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:18 crc kubenswrapper[4769]: I1121 13:22:18.774905 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6x4rg\" (UniqueName: \"kubernetes.io/projected/2a0c9095-8e64-4754-936e-d92dca1fcb6c-kube-api-access-6x4rg\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.146500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-gz5jt" event={"ID":"2a0c9095-8e64-4754-936e-d92dca1fcb6c","Type":"ContainerDied","Data":"731d08bbd012b3a583d1352e1650769b59e6314cedd149d8c62de55474459694"} Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.146871 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="731d08bbd012b3a583d1352e1650769b59e6314cedd149d8c62de55474459694" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.146710 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-gz5jt" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.634766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.639639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.645255 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.792883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7s5t\" (UniqueName: \"kubernetes.io/projected/bd3f3895-cd1e-465e-9516-7744f08911cb-kube-api-access-v7s5t\") pod \"bd3f3895-cd1e-465e-9516-7744f08911cb\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.792975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16eacb62-36b7-461f-88f0-47f604b06741-operator-scripts\") pod \"16eacb62-36b7-461f-88f0-47f604b06741\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.793068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swqsm\" (UniqueName: \"kubernetes.io/projected/16eacb62-36b7-461f-88f0-47f604b06741-kube-api-access-swqsm\") pod \"16eacb62-36b7-461f-88f0-47f604b06741\" (UID: \"16eacb62-36b7-461f-88f0-47f604b06741\") " Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.793101 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcg8r\" (UniqueName: \"kubernetes.io/projected/3642a623-680d-488e-97bd-5a9a11f56b4d-kube-api-access-gcg8r\") pod \"3642a623-680d-488e-97bd-5a9a11f56b4d\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.793134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3642a623-680d-488e-97bd-5a9a11f56b4d-operator-scripts\") pod \"3642a623-680d-488e-97bd-5a9a11f56b4d\" (UID: \"3642a623-680d-488e-97bd-5a9a11f56b4d\") " Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.793215 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd3f3895-cd1e-465e-9516-7744f08911cb-operator-scripts\") pod \"bd3f3895-cd1e-465e-9516-7744f08911cb\" (UID: \"bd3f3895-cd1e-465e-9516-7744f08911cb\") " Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.793838 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd3f3895-cd1e-465e-9516-7744f08911cb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bd3f3895-cd1e-465e-9516-7744f08911cb" (UID: "bd3f3895-cd1e-465e-9516-7744f08911cb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.794123 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3642a623-680d-488e-97bd-5a9a11f56b4d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3642a623-680d-488e-97bd-5a9a11f56b4d" (UID: "3642a623-680d-488e-97bd-5a9a11f56b4d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.794698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16eacb62-36b7-461f-88f0-47f604b06741-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "16eacb62-36b7-461f-88f0-47f604b06741" (UID: "16eacb62-36b7-461f-88f0-47f604b06741"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.797932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3642a623-680d-488e-97bd-5a9a11f56b4d-kube-api-access-gcg8r" (OuterVolumeSpecName: "kube-api-access-gcg8r") pod "3642a623-680d-488e-97bd-5a9a11f56b4d" (UID: "3642a623-680d-488e-97bd-5a9a11f56b4d"). InnerVolumeSpecName "kube-api-access-gcg8r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.798025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16eacb62-36b7-461f-88f0-47f604b06741-kube-api-access-swqsm" (OuterVolumeSpecName: "kube-api-access-swqsm") pod "16eacb62-36b7-461f-88f0-47f604b06741" (UID: "16eacb62-36b7-461f-88f0-47f604b06741"). InnerVolumeSpecName "kube-api-access-swqsm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.800034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3f3895-cd1e-465e-9516-7744f08911cb-kube-api-access-v7s5t" (OuterVolumeSpecName: "kube-api-access-v7s5t") pod "bd3f3895-cd1e-465e-9516-7744f08911cb" (UID: "bd3f3895-cd1e-465e-9516-7744f08911cb"). InnerVolumeSpecName "kube-api-access-v7s5t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.895161 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-swqsm\" (UniqueName: \"kubernetes.io/projected/16eacb62-36b7-461f-88f0-47f604b06741-kube-api-access-swqsm\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.895241 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gcg8r\" (UniqueName: \"kubernetes.io/projected/3642a623-680d-488e-97bd-5a9a11f56b4d-kube-api-access-gcg8r\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.895263 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3642a623-680d-488e-97bd-5a9a11f56b4d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.895280 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd3f3895-cd1e-465e-9516-7744f08911cb-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.895297 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v7s5t\" (UniqueName: \"kubernetes.io/projected/bd3f3895-cd1e-465e-9516-7744f08911cb-kube-api-access-v7s5t\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:19 crc kubenswrapper[4769]: I1121 13:22:19.895316 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/16eacb62-36b7-461f-88f0-47f604b06741-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.155894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mx78h" event={"ID":"16eacb62-36b7-461f-88f0-47f604b06741","Type":"ContainerDied","Data":"7ca9275983bcb8ee0b30e3f716808e184818fae1302dc3b0b10610c442e73333"} Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.155932 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ca9275983bcb8ee0b30e3f716808e184818fae1302dc3b0b10610c442e73333" Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.155944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mx78h" Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.157947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" event={"ID":"bd3f3895-cd1e-465e-9516-7744f08911cb","Type":"ContainerDied","Data":"3800c10c055cd1960de83d688e996b3b0319229132673d11baf9ca0205899fbe"} Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.157965 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3800c10c055cd1960de83d688e996b3b0319229132673d11baf9ca0205899fbe" Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.158012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3637-account-create-nfwpk" Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.162041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" event={"ID":"3642a623-680d-488e-97bd-5a9a11f56b4d","Type":"ContainerDied","Data":"4ae414eb96953621fede588aa5847d876410bf1db838cb7cf25d20211bd8e149"} Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.162083 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ae414eb96953621fede588aa5847d876410bf1db838cb7cf25d20211bd8e149" Nov 21 13:22:20 crc kubenswrapper[4769]: I1121 13:22:20.162136 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-f3b9-account-create-65z5z" Nov 21 13:22:21 crc kubenswrapper[4769]: I1121 13:22:21.177135 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" containerID="de6e86a204e3313f8c68feba8496fdf691fb8e53cfa08e9d1f313903e424530a" exitCode=0 Nov 21 13:22:21 crc kubenswrapper[4769]: I1121 13:22:21.177255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" event={"ID":"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4","Type":"ContainerDied","Data":"de6e86a204e3313f8c68feba8496fdf691fb8e53cfa08e9d1f313903e424530a"} Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.537208 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.649859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-ring-data-devices\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.649934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-scripts\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.650055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-combined-ca-bundle\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.650094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-swiftconf\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.650313 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zgf2\" (UniqueName: \"kubernetes.io/projected/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-kube-api-access-7zgf2\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.650373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-dispersionconf\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.650587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-etc-swift\") pod \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\" (UID: \"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4\") " Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.650662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.651426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.651441 4769 reconciler_common.go:293] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-ring-data-devices\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.659029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-kube-api-access-7zgf2" (OuterVolumeSpecName: "kube-api-access-7zgf2") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "kube-api-access-7zgf2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.659686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.672346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.675689 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-scripts" (OuterVolumeSpecName: "scripts") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.677358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" (UID: "2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.752147 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7zgf2\" (UniqueName: \"kubernetes.io/projected/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-kube-api-access-7zgf2\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.752178 4769 reconciler_common.go:293] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-dispersionconf\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.752207 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.752217 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.752226 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:22 crc kubenswrapper[4769]: I1121 13:22:22.752235 4769 reconciler_common.go:293] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4-swiftconf\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:23 crc kubenswrapper[4769]: I1121 13:22:23.206888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" event={"ID":"2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4","Type":"ContainerDied","Data":"aacc3bb65fc3dc2a8afa293e7b70814bb20f408e335ed5ce47278c4643c9ab4d"} Nov 21 13:22:23 crc kubenswrapper[4769]: I1121 13:22:23.207366 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aacc3bb65fc3dc2a8afa293e7b70814bb20f408e335ed5ce47278c4643c9ab4d" Nov 21 13:22:23 crc kubenswrapper[4769]: I1121 13:22:23.206978 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-ff6qq" Nov 21 13:22:23 crc kubenswrapper[4769]: I1121 13:22:23.464324 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:23 crc kubenswrapper[4769]: I1121 13:22:23.473281 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"swift-storage-0\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:23 crc kubenswrapper[4769]: I1121 13:22:23.767539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:22:24 crc kubenswrapper[4769]: I1121 13:22:24.413633 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.117443 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wf6w5"] Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118086 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16eacb62-36b7-461f-88f0-47f604b06741" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118104 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="16eacb62-36b7-461f-88f0-47f604b06741" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118123 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3642a623-680d-488e-97bd-5a9a11f56b4d" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118131 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3642a623-680d-488e-97bd-5a9a11f56b4d" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118140 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd3f3895-cd1e-465e-9516-7744f08911cb" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118146 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd3f3895-cd1e-465e-9516-7744f08911cb" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118156 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2a0c9095-8e64-4754-936e-d92dca1fcb6c" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118163 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a0c9095-8e64-4754-936e-d92dca1fcb6c" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118171 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" containerName="swift-ring-rebalance" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118177 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" containerName="swift-ring-rebalance" Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118230 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e91ff0bf-0214-45a3-8436-0ae635c5d3e9" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118239 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91ff0bf-0214-45a3-8436-0ae635c5d3e9" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.118264 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="63ed2f4f-4e7c-4539-8d06-557aa785ac52" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ed2f4f-4e7c-4539-8d06-557aa785ac52" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118430 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" containerName="swift-ring-rebalance" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118447 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bd3f3895-cd1e-465e-9516-7744f08911cb" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118457 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="63ed2f4f-4e7c-4539-8d06-557aa785ac52" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118473 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2a0c9095-8e64-4754-936e-d92dca1fcb6c" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118482 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3642a623-680d-488e-97bd-5a9a11f56b4d" containerName="mariadb-account-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118492 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="16eacb62-36b7-461f-88f0-47f604b06741" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.118503 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e91ff0bf-0214-45a3-8436-0ae635c5d3e9" containerName="mariadb-database-create" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.119098 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.121695 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-28s9x" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.121991 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-config-data" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.130167 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wf6w5"] Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.139704 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.226048 4769 generic.go:334] "Generic (PLEG): container finished" podID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerID="12749eec873cc9c283cbbf6933412d3ccab913e1b10a3630ef36798a37d4b69c" exitCode=0 Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.226111 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"f76c87ba-5d40-4b61-a44a-7b8c895507d8","Type":"ContainerDied","Data":"12749eec873cc9c283cbbf6933412d3ccab913e1b10a3630ef36798a37d4b69c"} Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.228741 4769 generic.go:334] "Generic (PLEG): container finished" podID="b51a88b8-9feb-448a-89c2-93800a854081" containerID="bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a" exitCode=0 Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.228779 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b51a88b8-9feb-448a-89c2-93800a854081","Type":"ContainerDied","Data":"bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a"} Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.230556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"237fd32bdd853ec0a909668d632679a3e2acfecbdd894e1ba979c33b8748e92e"} Nov 21 13:22:25 crc kubenswrapper[4769]: E1121 13:22:25.270345 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76c87ba_5d40_4b61_a44a_7b8c895507d8.slice/crio-12749eec873cc9c283cbbf6933412d3ccab913e1b10a3630ef36798a37d4b69c.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.313351 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-db-sync-config-data\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.313596 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-combined-ca-bundle\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.313631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87l6c\" (UniqueName: \"kubernetes.io/projected/52f5329b-af4d-40fd-9d96-228fc4ab9b27-kube-api-access-87l6c\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.313662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-config-data\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.414896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-config-data\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.415230 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-db-sync-config-data\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.415562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-combined-ca-bundle\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.415707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-87l6c\" (UniqueName: \"kubernetes.io/projected/52f5329b-af4d-40fd-9d96-228fc4ab9b27-kube-api-access-87l6c\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.420022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-db-sync-config-data\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.420878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-config-data\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.421541 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-combined-ca-bundle\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.433391 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-87l6c\" (UniqueName: \"kubernetes.io/projected/52f5329b-af4d-40fd-9d96-228fc4ab9b27-kube-api-access-87l6c\") pod \"glance-db-sync-wf6w5\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.439330 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:25 crc kubenswrapper[4769]: I1121 13:22:25.737880 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wf6w5"] Nov 21 13:22:25 crc kubenswrapper[4769]: W1121 13:22:25.750385 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52f5329b_af4d_40fd_9d96_228fc4ab9b27.slice/crio-0a2328691527090bfce601133f725ef6858638483471444a8fe0f05b4495c28e WatchSource:0}: Error finding container 0a2328691527090bfce601133f725ef6858638483471444a8fe0f05b4495c28e: Status 404 returned error can't find the container with id 0a2328691527090bfce601133f725ef6858638483471444a8fe0f05b4495c28e Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.245109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"f76c87ba-5d40-4b61-a44a-7b8c895507d8","Type":"ContainerStarted","Data":"3d2e40b1a98b0dda394e3f33fc6d50da970f3d836fbbf318f680db1c338ae781"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.245903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.249639 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b51a88b8-9feb-448a-89c2-93800a854081","Type":"ContainerStarted","Data":"bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.249869 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.258106 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" event={"ID":"52f5329b-af4d-40fd-9d96-228fc4ab9b27","Type":"ContainerStarted","Data":"0a2328691527090bfce601133f725ef6858638483471444a8fe0f05b4495c28e"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.264609 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.264749 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.264834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.264847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9"} Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.276479 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.275405896 podStartE2EDuration="37.275405896s" podCreationTimestamp="2025-11-21 13:21:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:26.270666883 +0000 UTC m=+5504.971328711" watchObservedRunningTime="2025-11-21 13:22:26.275405896 +0000 UTC m=+5504.976067714" Nov 21 13:22:26 crc kubenswrapper[4769]: I1121 13:22:26.300996 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=38.300969838 podStartE2EDuration="38.300969838s" podCreationTimestamp="2025-11-21 13:21:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:26.294164302 +0000 UTC m=+5504.994826130" watchObservedRunningTime="2025-11-21 13:22:26.300969838 +0000 UTC m=+5505.001631656" Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.311913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.312256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.312273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.312285 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.312295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.312305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.312316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748"} Nov 21 13:22:27 crc kubenswrapper[4769]: I1121 13:22:27.318277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" event={"ID":"52f5329b-af4d-40fd-9d96-228fc4ab9b27","Type":"ContainerStarted","Data":"3746623be8e16fc057b91cbcd838cfb45af50b0099ea09751999b9d7b9bef04d"} Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.333975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c"} Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.335278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2"} Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.335447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6"} Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.335573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerStarted","Data":"4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b"} Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.367182 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" podStartSLOduration=3.367148499 podStartE2EDuration="3.367148499s" podCreationTimestamp="2025-11-21 13:22:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:27.357242434 +0000 UTC m=+5506.057904242" watchObservedRunningTime="2025-11-21 13:22:28.367148499 +0000 UTC m=+5507.067810367" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.372693 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=22.372674843 podStartE2EDuration="22.372674843s" podCreationTimestamp="2025-11-21 13:22:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:28.361731089 +0000 UTC m=+5507.062392907" watchObservedRunningTime="2025-11-21 13:22:28.372674843 +0000 UTC m=+5507.073336701" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.528065 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd"] Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.529822 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.533532 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"dns-swift-storage-0" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.554684 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd"] Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.700153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-config\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.700303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.700343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.700361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmc4\" (UniqueName: \"kubernetes.io/projected/36fbd548-442c-4365-bda7-12f523a7c3e5-kube-api-access-sjmc4\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.801915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-config\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.802034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.802073 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.802090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmc4\" (UniqueName: \"kubernetes.io/projected/36fbd548-442c-4365-bda7-12f523a7c3e5-kube-api-access-sjmc4\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.802855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-config\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.803029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.803107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.824965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmc4\" (UniqueName: \"kubernetes.io/projected/36fbd548-442c-4365-bda7-12f523a7c3e5-kube-api-access-sjmc4\") pod \"dnsmasq-dnsmasq-698877975-4fdqd\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:28 crc kubenswrapper[4769]: I1121 13:22:28.849371 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:29 crc kubenswrapper[4769]: I1121 13:22:29.363952 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd"] Nov 21 13:22:29 crc kubenswrapper[4769]: W1121 13:22:29.386313 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36fbd548_442c_4365_bda7_12f523a7c3e5.slice/crio-e4ebe150cb5f6a318ef4b4842795f7db97132f34fc3e49065b8efc58952881f7 WatchSource:0}: Error finding container e4ebe150cb5f6a318ef4b4842795f7db97132f34fc3e49065b8efc58952881f7: Status 404 returned error can't find the container with id e4ebe150cb5f6a318ef4b4842795f7db97132f34fc3e49065b8efc58952881f7 Nov 21 13:22:30 crc kubenswrapper[4769]: I1121 13:22:30.352775 4769 generic.go:334] "Generic (PLEG): container finished" podID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerID="2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009" exitCode=0 Nov 21 13:22:30 crc kubenswrapper[4769]: I1121 13:22:30.352880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" event={"ID":"36fbd548-442c-4365-bda7-12f523a7c3e5","Type":"ContainerDied","Data":"2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009"} Nov 21 13:22:30 crc kubenswrapper[4769]: I1121 13:22:30.353265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" event={"ID":"36fbd548-442c-4365-bda7-12f523a7c3e5","Type":"ContainerStarted","Data":"e4ebe150cb5f6a318ef4b4842795f7db97132f34fc3e49065b8efc58952881f7"} Nov 21 13:22:31 crc kubenswrapper[4769]: I1121 13:22:31.363575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" event={"ID":"36fbd548-442c-4365-bda7-12f523a7c3e5","Type":"ContainerStarted","Data":"e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3"} Nov 21 13:22:31 crc kubenswrapper[4769]: I1121 13:22:31.364072 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:31 crc kubenswrapper[4769]: I1121 13:22:31.396532 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" podStartSLOduration=3.396511036 podStartE2EDuration="3.396511036s" podCreationTimestamp="2025-11-21 13:22:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:31.387113723 +0000 UTC m=+5510.087775551" watchObservedRunningTime="2025-11-21 13:22:31.396511036 +0000 UTC m=+5510.097172854" Nov 21 13:22:34 crc kubenswrapper[4769]: I1121 13:22:34.398919 4769 generic.go:334] "Generic (PLEG): container finished" podID="52f5329b-af4d-40fd-9d96-228fc4ab9b27" containerID="3746623be8e16fc057b91cbcd838cfb45af50b0099ea09751999b9d7b9bef04d" exitCode=0 Nov 21 13:22:34 crc kubenswrapper[4769]: I1121 13:22:34.399171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" event={"ID":"52f5329b-af4d-40fd-9d96-228fc4ab9b27","Type":"ContainerDied","Data":"3746623be8e16fc057b91cbcd838cfb45af50b0099ea09751999b9d7b9bef04d"} Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.774707 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.928379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-combined-ca-bundle\") pod \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.928442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-db-sync-config-data\") pod \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.928503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-config-data\") pod \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.928662 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87l6c\" (UniqueName: \"kubernetes.io/projected/52f5329b-af4d-40fd-9d96-228fc4ab9b27-kube-api-access-87l6c\") pod \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\" (UID: \"52f5329b-af4d-40fd-9d96-228fc4ab9b27\") " Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.935307 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "52f5329b-af4d-40fd-9d96-228fc4ab9b27" (UID: "52f5329b-af4d-40fd-9d96-228fc4ab9b27"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.935993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f5329b-af4d-40fd-9d96-228fc4ab9b27-kube-api-access-87l6c" (OuterVolumeSpecName: "kube-api-access-87l6c") pod "52f5329b-af4d-40fd-9d96-228fc4ab9b27" (UID: "52f5329b-af4d-40fd-9d96-228fc4ab9b27"). InnerVolumeSpecName "kube-api-access-87l6c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:35 crc kubenswrapper[4769]: I1121 13:22:35.971893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "52f5329b-af4d-40fd-9d96-228fc4ab9b27" (UID: "52f5329b-af4d-40fd-9d96-228fc4ab9b27"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.010570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-config-data" (OuterVolumeSpecName: "config-data") pod "52f5329b-af4d-40fd-9d96-228fc4ab9b27" (UID: "52f5329b-af4d-40fd-9d96-228fc4ab9b27"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.031048 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-87l6c\" (UniqueName: \"kubernetes.io/projected/52f5329b-af4d-40fd-9d96-228fc4ab9b27-kube-api-access-87l6c\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.031360 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.031480 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.031584 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/52f5329b-af4d-40fd-9d96-228fc4ab9b27-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.421334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" event={"ID":"52f5329b-af4d-40fd-9d96-228fc4ab9b27","Type":"ContainerDied","Data":"0a2328691527090bfce601133f725ef6858638483471444a8fe0f05b4495c28e"} Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.421638 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a2328691527090bfce601133f725ef6858638483471444a8fe0f05b4495c28e" Nov 21 13:22:36 crc kubenswrapper[4769]: I1121 13:22:36.421470 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-wf6w5" Nov 21 13:22:38 crc kubenswrapper[4769]: I1121 13:22:38.851455 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:22:38 crc kubenswrapper[4769]: I1121 13:22:38.908615 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb"] Nov 21 13:22:38 crc kubenswrapper[4769]: I1121 13:22:38.908898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="dnsmasq-dns" containerID="cri-o://d470e322fb9c2ecc9deb2938524dc2595360048920acee94605912dfd548ba7c" gracePeriod=10 Nov 21 13:22:39 crc kubenswrapper[4769]: I1121 13:22:39.450380 4769 generic.go:334] "Generic (PLEG): container finished" podID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerID="d470e322fb9c2ecc9deb2938524dc2595360048920acee94605912dfd548ba7c" exitCode=0 Nov 21 13:22:39 crc kubenswrapper[4769]: I1121 13:22:39.450435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" event={"ID":"a1e6bd23-a129-40d9-812b-998d49dbb376","Type":"ContainerDied","Data":"d470e322fb9c2ecc9deb2938524dc2595360048920acee94605912dfd548ba7c"} Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.196554 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.270571 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.0.172:5353: connect: connection refused" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.553852 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-8e53-account-create-h6dl4"] Nov 21 13:22:40 crc kubenswrapper[4769]: E1121 13:22:40.554177 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="52f5329b-af4d-40fd-9d96-228fc4ab9b27" containerName="glance-db-sync" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.554206 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f5329b-af4d-40fd-9d96-228fc4ab9b27" containerName="glance-db-sync" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.554371 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="52f5329b-af4d-40fd-9d96-228fc4ab9b27" containerName="glance-db-sync" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.554890 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.558853 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-db-secret" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.559209 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-kp4d7"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.560036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.567788 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-8e53-account-create-h6dl4"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.582732 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-kp4d7"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.613774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb49b879-3d42-4ab6-82f4-6f2acfa72760-operator-scripts\") pod \"cinder-8e53-account-create-h6dl4\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.613912 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9phl\" (UniqueName: \"kubernetes.io/projected/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-kube-api-access-v9phl\") pod \"barbican-db-create-kp4d7\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.613943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tr8n\" (UniqueName: \"kubernetes.io/projected/eb49b879-3d42-4ab6-82f4-6f2acfa72760-kube-api-access-6tr8n\") pod \"cinder-8e53-account-create-h6dl4\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.613960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-operator-scripts\") pod \"barbican-db-create-kp4d7\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.667669 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-b7x6s"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.669051 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.688103 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-b7x6s"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.716025 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb49b879-3d42-4ab6-82f4-6f2acfa72760-operator-scripts\") pod \"cinder-8e53-account-create-h6dl4\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.716079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbm4n\" (UniqueName: \"kubernetes.io/projected/b6840543-d283-4ac5-87aa-7ea4af38dc7e-kube-api-access-mbm4n\") pod \"cinder-db-create-b7x6s\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.716141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6840543-d283-4ac5-87aa-7ea4af38dc7e-operator-scripts\") pod \"cinder-db-create-b7x6s\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.716208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v9phl\" (UniqueName: \"kubernetes.io/projected/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-kube-api-access-v9phl\") pod \"barbican-db-create-kp4d7\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.716236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6tr8n\" (UniqueName: \"kubernetes.io/projected/eb49b879-3d42-4ab6-82f4-6f2acfa72760-kube-api-access-6tr8n\") pod \"cinder-8e53-account-create-h6dl4\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.716253 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-operator-scripts\") pod \"barbican-db-create-kp4d7\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.759538 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-grspb"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.761163 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.812460 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-8259-account-create-dm6vc"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.815070 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.819500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6840543-d283-4ac5-87aa-7ea4af38dc7e-operator-scripts\") pod \"cinder-db-create-b7x6s\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.819600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0a85c2f-0820-4771-8303-5d3b849ab7c7-operator-scripts\") pod \"neutron-db-create-grspb\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.819668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8gq\" (UniqueName: \"kubernetes.io/projected/a0a85c2f-0820-4771-8303-5d3b849ab7c7-kube-api-access-4x8gq\") pod \"neutron-db-create-grspb\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.819735 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-db-secret" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.842936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mbm4n\" (UniqueName: \"kubernetes.io/projected/b6840543-d283-4ac5-87aa-7ea4af38dc7e-kube-api-access-mbm4n\") pod \"cinder-db-create-b7x6s\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.864224 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-grspb"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.884033 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8259-account-create-dm6vc"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.904408 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-6c8kk"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.906055 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.913119 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.913406 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m6k4f" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.913529 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.913750 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.919384 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-6c8kk"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.932435 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-bfc0-account-create-674zs"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.934585 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.937073 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-db-secret" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.950366 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-bfc0-account-create-674zs"] Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.953616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0a85c2f-0820-4771-8303-5d3b849ab7c7-operator-scripts\") pod \"neutron-db-create-grspb\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.953685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8gq\" (UniqueName: \"kubernetes.io/projected/a0a85c2f-0820-4771-8303-5d3b849ab7c7-kube-api-access-4x8gq\") pod \"neutron-db-create-grspb\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.953782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p757t\" (UniqueName: \"kubernetes.io/projected/406bfa32-af31-408c-bb6e-cc77eb721124-kube-api-access-p757t\") pod \"barbican-8259-account-create-dm6vc\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:40 crc kubenswrapper[4769]: I1121 13:22:40.953811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/406bfa32-af31-408c-bb6e-cc77eb721124-operator-scripts\") pod \"barbican-8259-account-create-dm6vc\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.011627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6840543-d283-4ac5-87aa-7ea4af38dc7e-operator-scripts\") pod \"cinder-db-create-b7x6s\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.011627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb49b879-3d42-4ab6-82f4-6f2acfa72760-operator-scripts\") pod \"cinder-8e53-account-create-h6dl4\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.013255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0a85c2f-0820-4771-8303-5d3b849ab7c7-operator-scripts\") pod \"neutron-db-create-grspb\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.014648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-operator-scripts\") pod \"barbican-db-create-kp4d7\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.017123 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9phl\" (UniqueName: \"kubernetes.io/projected/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-kube-api-access-v9phl\") pod \"barbican-db-create-kp4d7\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.017840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbm4n\" (UniqueName: \"kubernetes.io/projected/b6840543-d283-4ac5-87aa-7ea4af38dc7e-kube-api-access-mbm4n\") pod \"cinder-db-create-b7x6s\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.020660 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tr8n\" (UniqueName: \"kubernetes.io/projected/eb49b879-3d42-4ab6-82f4-6f2acfa72760-kube-api-access-6tr8n\") pod \"cinder-8e53-account-create-h6dl4\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.033890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8gq\" (UniqueName: \"kubernetes.io/projected/a0a85c2f-0820-4771-8303-5d3b849ab7c7-kube-api-access-4x8gq\") pod \"neutron-db-create-grspb\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-combined-ca-bundle\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-p757t\" (UniqueName: \"kubernetes.io/projected/406bfa32-af31-408c-bb6e-cc77eb721124-kube-api-access-p757t\") pod \"barbican-8259-account-create-dm6vc\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/406bfa32-af31-408c-bb6e-cc77eb721124-operator-scripts\") pod \"barbican-8259-account-create-dm6vc\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056457 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hr62\" (UniqueName: \"kubernetes.io/projected/14321b29-565a-4472-ae96-461ab7c03f25-kube-api-access-5hr62\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056580 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-config-data\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64a354eb-09c7-467d-bb1c-a40253cc5a4b-operator-scripts\") pod \"neutron-bfc0-account-create-674zs\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.056654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wh5\" (UniqueName: \"kubernetes.io/projected/64a354eb-09c7-467d-bb1c-a40253cc5a4b-kube-api-access-d6wh5\") pod \"neutron-bfc0-account-create-674zs\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.057176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/406bfa32-af31-408c-bb6e-cc77eb721124-operator-scripts\") pod \"barbican-8259-account-create-dm6vc\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.075227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-p757t\" (UniqueName: \"kubernetes.io/projected/406bfa32-af31-408c-bb6e-cc77eb721124-kube-api-access-p757t\") pod \"barbican-8259-account-create-dm6vc\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.157872 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-config-data\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.157964 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64a354eb-09c7-467d-bb1c-a40253cc5a4b-operator-scripts\") pod \"neutron-bfc0-account-create-674zs\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.157999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wh5\" (UniqueName: \"kubernetes.io/projected/64a354eb-09c7-467d-bb1c-a40253cc5a4b-kube-api-access-d6wh5\") pod \"neutron-bfc0-account-create-674zs\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.158068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-combined-ca-bundle\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.158219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hr62\" (UniqueName: \"kubernetes.io/projected/14321b29-565a-4472-ae96-461ab7c03f25-kube-api-access-5hr62\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.158718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64a354eb-09c7-467d-bb1c-a40253cc5a4b-operator-scripts\") pod \"neutron-bfc0-account-create-674zs\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.163083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-config-data\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.177832 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hr62\" (UniqueName: \"kubernetes.io/projected/14321b29-565a-4472-ae96-461ab7c03f25-kube-api-access-5hr62\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.178406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-combined-ca-bundle\") pod \"keystone-db-sync-6c8kk\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.184007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wh5\" (UniqueName: \"kubernetes.io/projected/64a354eb-09c7-467d-bb1c-a40253cc5a4b-kube-api-access-d6wh5\") pod \"neutron-bfc0-account-create-674zs\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.184891 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.311341 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.311362 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.311642 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.311842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.312595 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.312709 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.313271 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.739722 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.869575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxzw8\" (UniqueName: \"kubernetes.io/projected/a1e6bd23-a129-40d9-812b-998d49dbb376-kube-api-access-pxzw8\") pod \"a1e6bd23-a129-40d9-812b-998d49dbb376\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.869636 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-config\") pod \"a1e6bd23-a129-40d9-812b-998d49dbb376\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.869752 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-dnsmasq-svc\") pod \"a1e6bd23-a129-40d9-812b-998d49dbb376\" (UID: \"a1e6bd23-a129-40d9-812b-998d49dbb376\") " Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.888616 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e6bd23-a129-40d9-812b-998d49dbb376-kube-api-access-pxzw8" (OuterVolumeSpecName: "kube-api-access-pxzw8") pod "a1e6bd23-a129-40d9-812b-998d49dbb376" (UID: "a1e6bd23-a129-40d9-812b-998d49dbb376"). InnerVolumeSpecName "kube-api-access-pxzw8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.912738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-config" (OuterVolumeSpecName: "config") pod "a1e6bd23-a129-40d9-812b-998d49dbb376" (UID: "a1e6bd23-a129-40d9-812b-998d49dbb376"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.913867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "a1e6bd23-a129-40d9-812b-998d49dbb376" (UID: "a1e6bd23-a129-40d9-812b-998d49dbb376"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.971062 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.971095 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pxzw8\" (UniqueName: \"kubernetes.io/projected/a1e6bd23-a129-40d9-812b-998d49dbb376-kube-api-access-pxzw8\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:41 crc kubenswrapper[4769]: I1121 13:22:41.971109 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1e6bd23-a129-40d9-812b-998d49dbb376-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.152028 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-grspb"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.191718 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-8e53-account-create-h6dl4"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.200878 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-8259-account-create-dm6vc"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.215620 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-kp4d7"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.233751 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-b7x6s"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.239473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-6c8kk"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.245431 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-bfc0-account-create-674zs"] Nov 21 13:22:42 crc kubenswrapper[4769]: W1121 13:22:42.262852 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14321b29_565a_4472_ae96_461ab7c03f25.slice/crio-8a65265c430546582d898768b63ad77ed56ad139146f581f6f8d02c24bba79f8 WatchSource:0}: Error finding container 8a65265c430546582d898768b63ad77ed56ad139146f581f6f8d02c24bba79f8: Status 404 returned error can't find the container with id 8a65265c430546582d898768b63ad77ed56ad139146f581f6f8d02c24bba79f8 Nov 21 13:22:42 crc kubenswrapper[4769]: W1121 13:22:42.275613 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64a354eb_09c7_467d_bb1c_a40253cc5a4b.slice/crio-5954ff449cbd5a00d519ad2716673ba1180c076083c708ca74630a0350d5d9fc WatchSource:0}: Error finding container 5954ff449cbd5a00d519ad2716673ba1180c076083c708ca74630a0350d5d9fc: Status 404 returned error can't find the container with id 5954ff449cbd5a00d519ad2716673ba1180c076083c708ca74630a0350d5d9fc Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.479138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" event={"ID":"406bfa32-af31-408c-bb6e-cc77eb721124","Type":"ContainerStarted","Data":"30769c69e891a3cf3b4b2aa22bca0d17c9bda8230661a97af8c1247f6b66cc51"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.484295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" event={"ID":"61b2ee8b-8633-4e4f-8b24-22446a0a66a2","Type":"ContainerStarted","Data":"5099a74ef5cdf9350cf39609eed2a1bb4ba5d8761e49162a1f7cc5d12bb2bb94"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.487790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" event={"ID":"a1e6bd23-a129-40d9-812b-998d49dbb376","Type":"ContainerDied","Data":"466ad876bf5f6fedea9cf84ead40f355ca83e7b07973fc6df683eed349f78e1a"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.487848 4769 scope.go:117] "RemoveContainer" containerID="d470e322fb9c2ecc9deb2938524dc2595360048920acee94605912dfd548ba7c" Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.487933 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb" Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.488888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" event={"ID":"eb49b879-3d42-4ab6-82f4-6f2acfa72760","Type":"ContainerStarted","Data":"ace33f77db5f5ac3373a00b6f9e6f0d6ab6cb477577e6e451353a7bf5a4c0363"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.490385 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-grspb" event={"ID":"a0a85c2f-0820-4771-8303-5d3b849ab7c7","Type":"ContainerStarted","Data":"28322a7e085bb253c1ebc89cef1a8a3234095ea70cf770daf940c6728abbd8b1"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.492769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" event={"ID":"b6840543-d283-4ac5-87aa-7ea4af38dc7e","Type":"ContainerStarted","Data":"60128ff00b39d6eb909850637fcf9e3d9ce9765f2cc4db60ef1f2c7fe1ba1a8e"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.495053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" event={"ID":"14321b29-565a-4472-ae96-461ab7c03f25","Type":"ContainerStarted","Data":"8a65265c430546582d898768b63ad77ed56ad139146f581f6f8d02c24bba79f8"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.495841 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" event={"ID":"64a354eb-09c7-467d-bb1c-a40253cc5a4b","Type":"ContainerStarted","Data":"5954ff449cbd5a00d519ad2716673ba1180c076083c708ca74630a0350d5d9fc"} Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.513617 4769 scope.go:117] "RemoveContainer" containerID="73d718eb673c6658d0573f2d0fd781e8b3871353cc4f2b06e3fd317fc74fb8e5" Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.521243 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb"] Nov 21 13:22:42 crc kubenswrapper[4769]: I1121 13:22:42.532570 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7fmbb"] Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.332281 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" path="/var/lib/kubelet/pods/a1e6bd23-a129-40d9-812b-998d49dbb376/volumes" Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.506550 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" event={"ID":"61b2ee8b-8633-4e4f-8b24-22446a0a66a2","Type":"ContainerStarted","Data":"80efed2bad3b32e75ae5ef3a3eb810db72129dc7bddf6b3b05516ddc0b7055da"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.511384 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" event={"ID":"eb49b879-3d42-4ab6-82f4-6f2acfa72760","Type":"ContainerStarted","Data":"97a7aa4760173fd99013dbd8c78b3bacbaed3939cdc3b0b5f06da6d044b6ee33"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.517298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-grspb" event={"ID":"a0a85c2f-0820-4771-8303-5d3b849ab7c7","Type":"ContainerStarted","Data":"95a9f1fdb7dc9dfd378e8207e1c350aa299b339ede92db72e93b16a59a013c57"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.527437 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" event={"ID":"b6840543-d283-4ac5-87aa-7ea4af38dc7e","Type":"ContainerStarted","Data":"29156d73b0d44e2d7ce85a740663c12800e3dac66939d5ca403259ab9b4ea6fb"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.532174 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" podStartSLOduration=3.5321548849999997 podStartE2EDuration="3.532154885s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.523585473 +0000 UTC m=+5522.224247291" watchObservedRunningTime="2025-11-21 13:22:43.532154885 +0000 UTC m=+5522.232816703" Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.533367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" event={"ID":"14321b29-565a-4472-ae96-461ab7c03f25","Type":"ContainerStarted","Data":"5cc8a4070a809b59e45492a1bd78706ed7d94654d144842dc35582033546ab59"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.536012 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" event={"ID":"64a354eb-09c7-467d-bb1c-a40253cc5a4b","Type":"ContainerStarted","Data":"3b29e5ba4a8f38f80c99b0d98ef6329e58eaf5f7edb0d8f0f6ffe3389918679e"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.537592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" event={"ID":"406bfa32-af31-408c-bb6e-cc77eb721124","Type":"ContainerStarted","Data":"5588efb755e1ca2a21a6847e224c4da27a93e6a5576be3dce9c35cd464a20d7c"} Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.557630 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-create-grspb" podStartSLOduration=3.557613434 podStartE2EDuration="3.557613434s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.551039764 +0000 UTC m=+5522.251701592" watchObservedRunningTime="2025-11-21 13:22:43.557613434 +0000 UTC m=+5522.258275252" Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.574123 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" podStartSLOduration=3.574102302 podStartE2EDuration="3.574102302s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.566497325 +0000 UTC m=+5522.267159153" watchObservedRunningTime="2025-11-21 13:22:43.574102302 +0000 UTC m=+5522.274764120" Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.595377 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" podStartSLOduration=3.595356162 podStartE2EDuration="3.595356162s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.582103959 +0000 UTC m=+5522.282765777" watchObservedRunningTime="2025-11-21 13:22:43.595356162 +0000 UTC m=+5522.296017980" Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.601394 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" podStartSLOduration=3.601384298 podStartE2EDuration="3.601384298s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.595328221 +0000 UTC m=+5522.295990039" watchObservedRunningTime="2025-11-21 13:22:43.601384298 +0000 UTC m=+5522.302046116" Nov 21 13:22:43 crc kubenswrapper[4769]: I1121 13:22:43.613093 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" podStartSLOduration=3.613083512 podStartE2EDuration="3.613083512s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.608737729 +0000 UTC m=+5522.309399547" watchObservedRunningTime="2025-11-21 13:22:43.613083512 +0000 UTC m=+5522.313745330" Nov 21 13:22:44 crc kubenswrapper[4769]: I1121 13:22:44.553174 4769 generic.go:334] "Generic (PLEG): container finished" podID="b6840543-d283-4ac5-87aa-7ea4af38dc7e" containerID="29156d73b0d44e2d7ce85a740663c12800e3dac66939d5ca403259ab9b4ea6fb" exitCode=0 Nov 21 13:22:44 crc kubenswrapper[4769]: I1121 13:22:44.553323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" event={"ID":"b6840543-d283-4ac5-87aa-7ea4af38dc7e","Type":"ContainerDied","Data":"29156d73b0d44e2d7ce85a740663c12800e3dac66939d5ca403259ab9b4ea6fb"} Nov 21 13:22:44 crc kubenswrapper[4769]: I1121 13:22:44.566417 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" podStartSLOduration=4.5663892409999995 podStartE2EDuration="4.566389241s" podCreationTimestamp="2025-11-21 13:22:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:22:43.627251019 +0000 UTC m=+5522.327912837" watchObservedRunningTime="2025-11-21 13:22:44.566389241 +0000 UTC m=+5523.267051059" Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.568601 4769 generic.go:334] "Generic (PLEG): container finished" podID="eb49b879-3d42-4ab6-82f4-6f2acfa72760" containerID="97a7aa4760173fd99013dbd8c78b3bacbaed3939cdc3b0b5f06da6d044b6ee33" exitCode=0 Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.568675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" event={"ID":"eb49b879-3d42-4ab6-82f4-6f2acfa72760","Type":"ContainerDied","Data":"97a7aa4760173fd99013dbd8c78b3bacbaed3939cdc3b0b5f06da6d044b6ee33"} Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.572142 4769 generic.go:334] "Generic (PLEG): container finished" podID="64a354eb-09c7-467d-bb1c-a40253cc5a4b" containerID="3b29e5ba4a8f38f80c99b0d98ef6329e58eaf5f7edb0d8f0f6ffe3389918679e" exitCode=0 Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.572339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" event={"ID":"64a354eb-09c7-467d-bb1c-a40253cc5a4b","Type":"ContainerDied","Data":"3b29e5ba4a8f38f80c99b0d98ef6329e58eaf5f7edb0d8f0f6ffe3389918679e"} Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.574526 4769 generic.go:334] "Generic (PLEG): container finished" podID="406bfa32-af31-408c-bb6e-cc77eb721124" containerID="5588efb755e1ca2a21a6847e224c4da27a93e6a5576be3dce9c35cd464a20d7c" exitCode=0 Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.574577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" event={"ID":"406bfa32-af31-408c-bb6e-cc77eb721124","Type":"ContainerDied","Data":"5588efb755e1ca2a21a6847e224c4da27a93e6a5576be3dce9c35cd464a20d7c"} Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.579343 4769 generic.go:334] "Generic (PLEG): container finished" podID="61b2ee8b-8633-4e4f-8b24-22446a0a66a2" containerID="80efed2bad3b32e75ae5ef3a3eb810db72129dc7bddf6b3b05516ddc0b7055da" exitCode=0 Nov 21 13:22:45 crc kubenswrapper[4769]: I1121 13:22:45.579470 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" event={"ID":"61b2ee8b-8633-4e4f-8b24-22446a0a66a2","Type":"ContainerDied","Data":"80efed2bad3b32e75ae5ef3a3eb810db72129dc7bddf6b3b05516ddc0b7055da"} Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.070958 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.156286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6840543-d283-4ac5-87aa-7ea4af38dc7e-operator-scripts\") pod \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.156470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbm4n\" (UniqueName: \"kubernetes.io/projected/b6840543-d283-4ac5-87aa-7ea4af38dc7e-kube-api-access-mbm4n\") pod \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\" (UID: \"b6840543-d283-4ac5-87aa-7ea4af38dc7e\") " Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.157405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6840543-d283-4ac5-87aa-7ea4af38dc7e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b6840543-d283-4ac5-87aa-7ea4af38dc7e" (UID: "b6840543-d283-4ac5-87aa-7ea4af38dc7e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.164429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6840543-d283-4ac5-87aa-7ea4af38dc7e-kube-api-access-mbm4n" (OuterVolumeSpecName: "kube-api-access-mbm4n") pod "b6840543-d283-4ac5-87aa-7ea4af38dc7e" (UID: "b6840543-d283-4ac5-87aa-7ea4af38dc7e"). InnerVolumeSpecName "kube-api-access-mbm4n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.259294 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mbm4n\" (UniqueName: \"kubernetes.io/projected/b6840543-d283-4ac5-87aa-7ea4af38dc7e-kube-api-access-mbm4n\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.259361 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b6840543-d283-4ac5-87aa-7ea4af38dc7e-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.592348 4769 generic.go:334] "Generic (PLEG): container finished" podID="a0a85c2f-0820-4771-8303-5d3b849ab7c7" containerID="95a9f1fdb7dc9dfd378e8207e1c350aa299b339ede92db72e93b16a59a013c57" exitCode=0 Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.592415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-grspb" event={"ID":"a0a85c2f-0820-4771-8303-5d3b849ab7c7","Type":"ContainerDied","Data":"95a9f1fdb7dc9dfd378e8207e1c350aa299b339ede92db72e93b16a59a013c57"} Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.594539 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.594580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-b7x6s" event={"ID":"b6840543-d283-4ac5-87aa-7ea4af38dc7e","Type":"ContainerDied","Data":"60128ff00b39d6eb909850637fcf9e3d9ce9765f2cc4db60ef1f2c7fe1ba1a8e"} Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.595068 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60128ff00b39d6eb909850637fcf9e3d9ce9765f2cc4db60ef1f2c7fe1ba1a8e" Nov 21 13:22:46 crc kubenswrapper[4769]: I1121 13:22:46.970364 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.072414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64a354eb-09c7-467d-bb1c-a40253cc5a4b-operator-scripts\") pod \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.072618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6wh5\" (UniqueName: \"kubernetes.io/projected/64a354eb-09c7-467d-bb1c-a40253cc5a4b-kube-api-access-d6wh5\") pod \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\" (UID: \"64a354eb-09c7-467d-bb1c-a40253cc5a4b\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.073560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a354eb-09c7-467d-bb1c-a40253cc5a4b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "64a354eb-09c7-467d-bb1c-a40253cc5a4b" (UID: "64a354eb-09c7-467d-bb1c-a40253cc5a4b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.079389 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a354eb-09c7-467d-bb1c-a40253cc5a4b-kube-api-access-d6wh5" (OuterVolumeSpecName: "kube-api-access-d6wh5") pod "64a354eb-09c7-467d-bb1c-a40253cc5a4b" (UID: "64a354eb-09c7-467d-bb1c-a40253cc5a4b"). InnerVolumeSpecName "kube-api-access-d6wh5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.124420 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.133886 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.141891 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.174425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/406bfa32-af31-408c-bb6e-cc77eb721124-operator-scripts\") pod \"406bfa32-af31-408c-bb6e-cc77eb721124\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.174514 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-operator-scripts\") pod \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.174602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p757t\" (UniqueName: \"kubernetes.io/projected/406bfa32-af31-408c-bb6e-cc77eb721124-kube-api-access-p757t\") pod \"406bfa32-af31-408c-bb6e-cc77eb721124\" (UID: \"406bfa32-af31-408c-bb6e-cc77eb721124\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.174672 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9phl\" (UniqueName: \"kubernetes.io/projected/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-kube-api-access-v9phl\") pod \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\" (UID: \"61b2ee8b-8633-4e4f-8b24-22446a0a66a2\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.175025 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64a354eb-09c7-467d-bb1c-a40253cc5a4b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.175039 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d6wh5\" (UniqueName: \"kubernetes.io/projected/64a354eb-09c7-467d-bb1c-a40253cc5a4b-kube-api-access-d6wh5\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.175159 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/406bfa32-af31-408c-bb6e-cc77eb721124-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "406bfa32-af31-408c-bb6e-cc77eb721124" (UID: "406bfa32-af31-408c-bb6e-cc77eb721124"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.175627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "61b2ee8b-8633-4e4f-8b24-22446a0a66a2" (UID: "61b2ee8b-8633-4e4f-8b24-22446a0a66a2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.182620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/406bfa32-af31-408c-bb6e-cc77eb721124-kube-api-access-p757t" (OuterVolumeSpecName: "kube-api-access-p757t") pod "406bfa32-af31-408c-bb6e-cc77eb721124" (UID: "406bfa32-af31-408c-bb6e-cc77eb721124"). InnerVolumeSpecName "kube-api-access-p757t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.186589 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-kube-api-access-v9phl" (OuterVolumeSpecName: "kube-api-access-v9phl") pod "61b2ee8b-8633-4e4f-8b24-22446a0a66a2" (UID: "61b2ee8b-8633-4e4f-8b24-22446a0a66a2"). InnerVolumeSpecName "kube-api-access-v9phl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.276424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb49b879-3d42-4ab6-82f4-6f2acfa72760-operator-scripts\") pod \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.276476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tr8n\" (UniqueName: \"kubernetes.io/projected/eb49b879-3d42-4ab6-82f4-6f2acfa72760-kube-api-access-6tr8n\") pod \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\" (UID: \"eb49b879-3d42-4ab6-82f4-6f2acfa72760\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.276911 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v9phl\" (UniqueName: \"kubernetes.io/projected/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-kube-api-access-v9phl\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.276929 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/406bfa32-af31-408c-bb6e-cc77eb721124-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.276939 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/61b2ee8b-8633-4e4f-8b24-22446a0a66a2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.276950 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-p757t\" (UniqueName: \"kubernetes.io/projected/406bfa32-af31-408c-bb6e-cc77eb721124-kube-api-access-p757t\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.278720 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb49b879-3d42-4ab6-82f4-6f2acfa72760-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "eb49b879-3d42-4ab6-82f4-6f2acfa72760" (UID: "eb49b879-3d42-4ab6-82f4-6f2acfa72760"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.280045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb49b879-3d42-4ab6-82f4-6f2acfa72760-kube-api-access-6tr8n" (OuterVolumeSpecName: "kube-api-access-6tr8n") pod "eb49b879-3d42-4ab6-82f4-6f2acfa72760" (UID: "eb49b879-3d42-4ab6-82f4-6f2acfa72760"). InnerVolumeSpecName "kube-api-access-6tr8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.378271 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eb49b879-3d42-4ab6-82f4-6f2acfa72760-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.378312 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6tr8n\" (UniqueName: \"kubernetes.io/projected/eb49b879-3d42-4ab6-82f4-6f2acfa72760-kube-api-access-6tr8n\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.609923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" event={"ID":"406bfa32-af31-408c-bb6e-cc77eb721124","Type":"ContainerDied","Data":"30769c69e891a3cf3b4b2aa22bca0d17c9bda8230661a97af8c1247f6b66cc51"} Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.610301 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30769c69e891a3cf3b4b2aa22bca0d17c9bda8230661a97af8c1247f6b66cc51" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.610377 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-8259-account-create-dm6vc" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.618267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.618320 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-kp4d7" event={"ID":"61b2ee8b-8633-4e4f-8b24-22446a0a66a2","Type":"ContainerDied","Data":"5099a74ef5cdf9350cf39609eed2a1bb4ba5d8761e49162a1f7cc5d12bb2bb94"} Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.618387 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5099a74ef5cdf9350cf39609eed2a1bb4ba5d8761e49162a1f7cc5d12bb2bb94" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.621462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" event={"ID":"eb49b879-3d42-4ab6-82f4-6f2acfa72760","Type":"ContainerDied","Data":"ace33f77db5f5ac3373a00b6f9e6f0d6ab6cb477577e6e451353a7bf5a4c0363"} Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.621504 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ace33f77db5f5ac3373a00b6f9e6f0d6ab6cb477577e6e451353a7bf5a4c0363" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.621544 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-8e53-account-create-h6dl4" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.625997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" event={"ID":"64a354eb-09c7-467d-bb1c-a40253cc5a4b","Type":"ContainerDied","Data":"5954ff449cbd5a00d519ad2716673ba1180c076083c708ca74630a0350d5d9fc"} Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.626079 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-bfc0-account-create-674zs" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.626097 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5954ff449cbd5a00d519ad2716673ba1180c076083c708ca74630a0350d5d9fc" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.879575 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.987571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0a85c2f-0820-4771-8303-5d3b849ab7c7-operator-scripts\") pod \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.987828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x8gq\" (UniqueName: \"kubernetes.io/projected/a0a85c2f-0820-4771-8303-5d3b849ab7c7-kube-api-access-4x8gq\") pod \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\" (UID: \"a0a85c2f-0820-4771-8303-5d3b849ab7c7\") " Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.988050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a85c2f-0820-4771-8303-5d3b849ab7c7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a0a85c2f-0820-4771-8303-5d3b849ab7c7" (UID: "a0a85c2f-0820-4771-8303-5d3b849ab7c7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.988438 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a0a85c2f-0820-4771-8303-5d3b849ab7c7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:47 crc kubenswrapper[4769]: I1121 13:22:47.994351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a85c2f-0820-4771-8303-5d3b849ab7c7-kube-api-access-4x8gq" (OuterVolumeSpecName: "kube-api-access-4x8gq") pod "a0a85c2f-0820-4771-8303-5d3b849ab7c7" (UID: "a0a85c2f-0820-4771-8303-5d3b849ab7c7"). InnerVolumeSpecName "kube-api-access-4x8gq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:22:48 crc kubenswrapper[4769]: I1121 13:22:48.094092 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4x8gq\" (UniqueName: \"kubernetes.io/projected/a0a85c2f-0820-4771-8303-5d3b849ab7c7-kube-api-access-4x8gq\") on node \"crc\" DevicePath \"\"" Nov 21 13:22:48 crc kubenswrapper[4769]: I1121 13:22:48.641224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-grspb" event={"ID":"a0a85c2f-0820-4771-8303-5d3b849ab7c7","Type":"ContainerDied","Data":"28322a7e085bb253c1ebc89cef1a8a3234095ea70cf770daf940c6728abbd8b1"} Nov 21 13:22:48 crc kubenswrapper[4769]: I1121 13:22:48.641286 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28322a7e085bb253c1ebc89cef1a8a3234095ea70cf770daf940c6728abbd8b1" Nov 21 13:22:48 crc kubenswrapper[4769]: I1121 13:22:48.641364 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-grspb" Nov 21 13:22:56 crc kubenswrapper[4769]: I1121 13:22:56.292122 4769 scope.go:117] "RemoveContainer" containerID="dee302c5a15e1d9b0d6f92858045b699f67ffd3afe54fc55ef37f0d66d8196d3" Nov 21 13:22:56 crc kubenswrapper[4769]: I1121 13:22:56.341643 4769 scope.go:117] "RemoveContainer" containerID="7501d9e1cd7dadd083e519f6cf5d5424e0f554eb19cb5e99e514981bc72f610e" Nov 21 13:22:56 crc kubenswrapper[4769]: I1121 13:22:56.388143 4769 scope.go:117] "RemoveContainer" containerID="e1c4f43569d8d427e971469f8ea49dd3bf3a58133a468ff2571f2d8854dd6372" Nov 21 13:22:56 crc kubenswrapper[4769]: I1121 13:22:56.421752 4769 scope.go:117] "RemoveContainer" containerID="068275a2815c982d25c891b31f773852d583ba4f3d17fd64adb156cafde10846" Nov 21 13:22:56 crc kubenswrapper[4769]: I1121 13:22:56.467467 4769 scope.go:117] "RemoveContainer" containerID="b451580139b180dc67dde57ded1f161a00a2a4f7c3ee0524d81e2508467fd662" Nov 21 13:22:56 crc kubenswrapper[4769]: I1121 13:22:56.487242 4769 scope.go:117] "RemoveContainer" containerID="148d9bed3b746782654529ad0ff03d3ba4280f9332b3c39a9997a92e028fc4be" Nov 21 13:23:00 crc kubenswrapper[4769]: I1121 13:23:00.747236 4769 generic.go:334] "Generic (PLEG): container finished" podID="14321b29-565a-4472-ae96-461ab7c03f25" containerID="5cc8a4070a809b59e45492a1bd78706ed7d94654d144842dc35582033546ab59" exitCode=0 Nov 21 13:23:00 crc kubenswrapper[4769]: I1121 13:23:00.747319 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" event={"ID":"14321b29-565a-4472-ae96-461ab7c03f25","Type":"ContainerDied","Data":"5cc8a4070a809b59e45492a1bd78706ed7d94654d144842dc35582033546ab59"} Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.080380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.167283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hr62\" (UniqueName: \"kubernetes.io/projected/14321b29-565a-4472-ae96-461ab7c03f25-kube-api-access-5hr62\") pod \"14321b29-565a-4472-ae96-461ab7c03f25\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.167367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-combined-ca-bundle\") pod \"14321b29-565a-4472-ae96-461ab7c03f25\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.167392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-config-data\") pod \"14321b29-565a-4472-ae96-461ab7c03f25\" (UID: \"14321b29-565a-4472-ae96-461ab7c03f25\") " Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.173180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14321b29-565a-4472-ae96-461ab7c03f25-kube-api-access-5hr62" (OuterVolumeSpecName: "kube-api-access-5hr62") pod "14321b29-565a-4472-ae96-461ab7c03f25" (UID: "14321b29-565a-4472-ae96-461ab7c03f25"). InnerVolumeSpecName "kube-api-access-5hr62". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.195521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "14321b29-565a-4472-ae96-461ab7c03f25" (UID: "14321b29-565a-4472-ae96-461ab7c03f25"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.209315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-config-data" (OuterVolumeSpecName: "config-data") pod "14321b29-565a-4472-ae96-461ab7c03f25" (UID: "14321b29-565a-4472-ae96-461ab7c03f25"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.269477 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5hr62\" (UniqueName: \"kubernetes.io/projected/14321b29-565a-4472-ae96-461ab7c03f25-kube-api-access-5hr62\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.269509 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.269535 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/14321b29-565a-4472-ae96-461ab7c03f25-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.766950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" event={"ID":"14321b29-565a-4472-ae96-461ab7c03f25","Type":"ContainerDied","Data":"8a65265c430546582d898768b63ad77ed56ad139146f581f6f8d02c24bba79f8"} Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.767347 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a65265c430546582d898768b63ad77ed56ad139146f581f6f8d02c24bba79f8" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.767377 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-6c8kk" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.980743 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cq5l2"] Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981163 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="406bfa32-af31-408c-bb6e-cc77eb721124" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981181 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="406bfa32-af31-408c-bb6e-cc77eb721124" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981216 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a0a85c2f-0820-4771-8303-5d3b849ab7c7" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981223 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a85c2f-0820-4771-8303-5d3b849ab7c7" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981231 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="14321b29-565a-4472-ae96-461ab7c03f25" containerName="keystone-db-sync" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981238 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="14321b29-565a-4472-ae96-461ab7c03f25" containerName="keystone-db-sync" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981247 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eb49b879-3d42-4ab6-82f4-6f2acfa72760" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981253 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb49b879-3d42-4ab6-82f4-6f2acfa72760" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981262 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="init" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981267 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="init" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981286 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6840543-d283-4ac5-87aa-7ea4af38dc7e" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981292 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6840543-d283-4ac5-87aa-7ea4af38dc7e" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981301 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64a354eb-09c7-467d-bb1c-a40253cc5a4b" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981309 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a354eb-09c7-467d-bb1c-a40253cc5a4b" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981330 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="61b2ee8b-8633-4e4f-8b24-22446a0a66a2" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981337 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b2ee8b-8633-4e4f-8b24-22446a0a66a2" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: E1121 13:23:02.981349 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="dnsmasq-dns" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981355 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="dnsmasq-dns" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981506 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a1e6bd23-a129-40d9-812b-998d49dbb376" containerName="dnsmasq-dns" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981515 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6840543-d283-4ac5-87aa-7ea4af38dc7e" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981522 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="406bfa32-af31-408c-bb6e-cc77eb721124" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981529 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="14321b29-565a-4472-ae96-461ab7c03f25" containerName="keystone-db-sync" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981540 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a0a85c2f-0820-4771-8303-5d3b849ab7c7" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981547 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64a354eb-09c7-467d-bb1c-a40253cc5a4b" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981563 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="61b2ee8b-8633-4e4f-8b24-22446a0a66a2" containerName="mariadb-database-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.981572 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eb49b879-3d42-4ab6-82f4-6f2acfa72760" containerName="mariadb-account-create" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.982143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.989107 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.989321 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.989491 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m6k4f" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.989640 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 13:23:02 crc kubenswrapper[4769]: I1121 13:23:02.992063 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.015428 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cq5l2"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.082923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-combined-ca-bundle\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.082978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-fernet-keys\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.083053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-credential-keys\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.083085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xzj\" (UniqueName: \"kubernetes.io/projected/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-kube-api-access-k2xzj\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.083128 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-scripts\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.083150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-config-data\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.187118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-combined-ca-bundle\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.187171 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-fernet-keys\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.187264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-credential-keys\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.187286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xzj\" (UniqueName: \"kubernetes.io/projected/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-kube-api-access-k2xzj\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.187328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-scripts\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.187353 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-config-data\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.196362 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.199437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-scripts\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.205027 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.207577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-fernet-keys\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.209083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-credential-keys\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.209199 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-combined-ca-bundle\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.222425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-config-data\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.222818 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.222981 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.223638 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hrmds"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.224654 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.230491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xzj\" (UniqueName: \"kubernetes.io/projected/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-kube-api-access-k2xzj\") pod \"keystone-bootstrap-cq5l2\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.231462 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.231641 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-9656w" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.231741 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.238163 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bscxr"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.252067 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.259088 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.259329 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.259777 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.262695 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-b97dv" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.277076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hrmds"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-log-httpd\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307657 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-config-data\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307677 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbqvg\" (UniqueName: \"kubernetes.io/projected/62791949-c414-4fab-8cdf-8f7d4ac51246-kube-api-access-dbqvg\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307702 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-config-data\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-run-httpd\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307753 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-scripts\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307785 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-combined-ca-bundle\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqlx\" (UniqueName: \"kubernetes.io/projected/141368eb-f9c2-4f68-839d-0e1f4795ecbb-kube-api-access-cpqlx\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307843 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-db-sync-config-data\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-scripts\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.307917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/141368eb-f9c2-4f68-839d-0e1f4795ecbb-etc-machine-id\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.329913 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.345305 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bscxr"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-combined-ca-bundle\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqlx\" (UniqueName: \"kubernetes.io/projected/141368eb-f9c2-4f68-839d-0e1f4795ecbb-kube-api-access-cpqlx\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qrz\" (UniqueName: \"kubernetes.io/projected/6fbb8388-7720-4ddf-b608-f6cd45ebe188-kube-api-access-k8qrz\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-db-sync-config-data\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412448 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-scripts\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-combined-ca-bundle\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412497 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/141368eb-f9c2-4f68-839d-0e1f4795ecbb-etc-machine-id\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412528 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412561 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-scripts\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-log-httpd\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412634 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-config-data\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dbqvg\" (UniqueName: \"kubernetes.io/projected/62791949-c414-4fab-8cdf-8f7d4ac51246-kube-api-access-dbqvg\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-config-data\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-run-httpd\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412776 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fbb8388-7720-4ddf-b608-f6cd45ebe188-logs\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-scripts\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.412835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-config-data\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.414616 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/141368eb-f9c2-4f68-839d-0e1f4795ecbb-etc-machine-id\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.417864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-combined-ca-bundle\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.418518 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-log-httpd\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.418560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-run-httpd\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.419396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-config-data\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.421788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-db-sync-config-data\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.422056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-scripts\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.422880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.424147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-config-data\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.427455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-scripts\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.427671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.436081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqlx\" (UniqueName: \"kubernetes.io/projected/141368eb-f9c2-4f68-839d-0e1f4795ecbb-kube-api-access-cpqlx\") pod \"cinder-db-sync-hrmds\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.439053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbqvg\" (UniqueName: \"kubernetes.io/projected/62791949-c414-4fab-8cdf-8f7d4ac51246-kube-api-access-dbqvg\") pod \"ceilometer-0\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.447675 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5qdzl"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.449177 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.452220 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-5k9wz" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.452406 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.456637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5qdzl"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.474117 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-6vqlq"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.475321 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.485076 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.485292 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.485777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-5gq5c" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.486757 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-6vqlq"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.490815 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.506911 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.516457 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-combined-ca-bundle\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.516580 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-scripts\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.516695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fbb8388-7720-4ddf-b608-f6cd45ebe188-logs\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.516758 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-config-data\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.516840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qrz\" (UniqueName: \"kubernetes.io/projected/6fbb8388-7720-4ddf-b608-f6cd45ebe188-kube-api-access-k8qrz\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.519019 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fbb8388-7720-4ddf-b608-f6cd45ebe188-logs\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.522100 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-scripts\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.523051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-combined-ca-bundle\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.527754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-config-data\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.540608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qrz\" (UniqueName: \"kubernetes.io/projected/6fbb8388-7720-4ddf-b608-f6cd45ebe188-kube-api-access-k8qrz\") pod \"placement-db-sync-bscxr\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.618161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-combined-ca-bundle\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.618247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-db-sync-config-data\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.618345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gcn\" (UniqueName: \"kubernetes.io/projected/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-kube-api-access-q2gcn\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.618401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-config\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.618575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/44b531a5-573a-4457-880e-6156cfae85da-kube-api-access-7g5k5\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.618635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-combined-ca-bundle\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.720111 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-combined-ca-bundle\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.720207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-combined-ca-bundle\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.720247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-db-sync-config-data\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.720281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gcn\" (UniqueName: \"kubernetes.io/projected/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-kube-api-access-q2gcn\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.720311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-config\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.720341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/44b531a5-573a-4457-880e-6156cfae85da-kube-api-access-7g5k5\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.725577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-db-sync-config-data\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.725882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-config\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.726819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-combined-ca-bundle\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.728300 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-combined-ca-bundle\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.737963 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/44b531a5-573a-4457-880e-6156cfae85da-kube-api-access-7g5k5\") pod \"barbican-db-sync-5qdzl\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.742618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gcn\" (UniqueName: \"kubernetes.io/projected/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-kube-api-access-q2gcn\") pod \"neutron-db-sync-6vqlq\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.819009 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.839429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.852925 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.873303 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cq5l2"] Nov 21 13:23:03 crc kubenswrapper[4769]: I1121 13:23:03.990844 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hrmds"] Nov 21 13:23:04 crc kubenswrapper[4769]: W1121 13:23:04.002287 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141368eb_f9c2_4f68_839d_0e1f4795ecbb.slice/crio-ba152dec94242293a21fd065ab78158955e6a0ea35abf7dbce6b731ace88b784 WatchSource:0}: Error finding container ba152dec94242293a21fd065ab78158955e6a0ea35abf7dbce6b731ace88b784: Status 404 returned error can't find the container with id ba152dec94242293a21fd065ab78158955e6a0ea35abf7dbce6b731ace88b784 Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.137403 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.176598 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.178421 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.201370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:23:04 crc kubenswrapper[4769]: W1121 13:23:04.201626 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62791949_c414_4fab_8cdf_8f7d4ac51246.slice/crio-91142d651f4f043dc40e54f54ed2c0849e7d9c581e3eacdcd3211895f6b7a80f WatchSource:0}: Error finding container 91142d651f4f043dc40e54f54ed2c0849e7d9c581e3eacdcd3211895f6b7a80f: Status 404 returned error can't find the container with id 91142d651f4f043dc40e54f54ed2c0849e7d9c581e3eacdcd3211895f6b7a80f Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.201668 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.201843 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.202024 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-28s9x" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.204555 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.210859 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.212571 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.218717 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.218897 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.222360 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.342228 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.342992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-config-data\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-config-data\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343135 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4hlq\" (UniqueName: \"kubernetes.io/projected/e983989c-d859-4dd0-ac5c-5fb70f4644ea-kube-api-access-d4hlq\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-logs\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-logs\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrp9x\" (UniqueName: \"kubernetes.io/projected/2bd5b4e4-20fb-45ac-94b1-de361f055e14-kube-api-access-qrp9x\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343951 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.343996 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.344015 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-scripts\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.344038 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-scripts\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.445339 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446411 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-config-data\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-config-data\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446601 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d4hlq\" (UniqueName: \"kubernetes.io/projected/e983989c-d859-4dd0-ac5c-5fb70f4644ea-kube-api-access-d4hlq\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446640 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-logs\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-logs\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446825 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qrp9x\" (UniqueName: \"kubernetes.io/projected/2bd5b4e4-20fb-45ac-94b1-de361f055e14-kube-api-access-qrp9x\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-scripts\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.446987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-scripts\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.447696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.447869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-logs\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.447966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.448176 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.448206 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.448491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-logs\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.453816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-scripts\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.454438 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.459783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.464306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-scripts\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.466940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.469119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-config-data\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.471669 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4hlq\" (UniqueName: \"kubernetes.io/projected/e983989c-d859-4dd0-ac5c-5fb70f4644ea-kube-api-access-d4hlq\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.471957 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.472932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrp9x\" (UniqueName: \"kubernetes.io/projected/2bd5b4e4-20fb-45ac-94b1-de361f055e14-kube-api-access-qrp9x\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.483446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-config-data\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.495525 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.531454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.604835 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-6vqlq"] Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.607895 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.625919 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.664679 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bscxr"] Nov 21 13:23:04 crc kubenswrapper[4769]: W1121 13:23:04.674017 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fbb8388_7720_4ddf_b608_f6cd45ebe188.slice/crio-4732fded87dc32450ea05fbf50984502fe2a2fd209a752b5969e3c4070b4f5c6 WatchSource:0}: Error finding container 4732fded87dc32450ea05fbf50984502fe2a2fd209a752b5969e3c4070b4f5c6: Status 404 returned error can't find the container with id 4732fded87dc32450ea05fbf50984502fe2a2fd209a752b5969e3c4070b4f5c6 Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.678573 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5qdzl"] Nov 21 13:23:04 crc kubenswrapper[4769]: W1121 13:23:04.695721 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b531a5_573a_4457_880e_6156cfae85da.slice/crio-5e168963c43c29faec7e308643c99ccb3523ebf6fc4703cfa28dd34b25014339 WatchSource:0}: Error finding container 5e168963c43c29faec7e308643c99ccb3523ebf6fc4703cfa28dd34b25014339: Status 404 returned error can't find the container with id 5e168963c43c29faec7e308643c99ccb3523ebf6fc4703cfa28dd34b25014339 Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.838411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" event={"ID":"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf","Type":"ContainerStarted","Data":"d5265044b4f82c9e0605e6dd6b5625379245027edf57110c6f743f5482a2c43d"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.839790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" event={"ID":"44b531a5-573a-4457-880e-6156cfae85da","Type":"ContainerStarted","Data":"5e168963c43c29faec7e308643c99ccb3523ebf6fc4703cfa28dd34b25014339"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.840949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" event={"ID":"141368eb-f9c2-4f68-839d-0e1f4795ecbb","Type":"ContainerStarted","Data":"ba152dec94242293a21fd065ab78158955e6a0ea35abf7dbce6b731ace88b784"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.844904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerStarted","Data":"91142d651f4f043dc40e54f54ed2c0849e7d9c581e3eacdcd3211895f6b7a80f"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.874652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" event={"ID":"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4","Type":"ContainerStarted","Data":"1e8d609f3478e330fa2af2d42a4790e25b430fee1075df86f4fcfe6c7147be58"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.874689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" event={"ID":"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4","Type":"ContainerStarted","Data":"82d15d72af60e542b30afa33808c859cc34cf15caad0bb63e99f721f23e15f0a"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.878502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bscxr" event={"ID":"6fbb8388-7720-4ddf-b608-f6cd45ebe188","Type":"ContainerStarted","Data":"4732fded87dc32450ea05fbf50984502fe2a2fd209a752b5969e3c4070b4f5c6"} Nov 21 13:23:04 crc kubenswrapper[4769]: I1121 13:23:04.903836 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" podStartSLOduration=2.903813538 podStartE2EDuration="2.903813538s" podCreationTimestamp="2025-11-21 13:23:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:04.896089658 +0000 UTC m=+5543.596751476" watchObservedRunningTime="2025-11-21 13:23:04.903813538 +0000 UTC m=+5543.604475356" Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.065276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.195618 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:05 crc kubenswrapper[4769]: W1121 13:23:05.204907 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode983989c_d859_4dd0_ac5c_5fb70f4644ea.slice/crio-ae8da12bf17b388740c5847ada5003be5c8db7d3f41c390912abe0032be5eab8 WatchSource:0}: Error finding container ae8da12bf17b388740c5847ada5003be5c8db7d3f41c390912abe0032be5eab8: Status 404 returned error can't find the container with id ae8da12bf17b388740c5847ada5003be5c8db7d3f41c390912abe0032be5eab8 Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.766129 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.862795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.920104 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2bd5b4e4-20fb-45ac-94b1-de361f055e14","Type":"ContainerStarted","Data":"ed9d311c9a83746742c70c82e281095d6efd389e570a1ecb5a73cc69c13c2a39"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.920146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2bd5b4e4-20fb-45ac-94b1-de361f055e14","Type":"ContainerStarted","Data":"09bc1901ea4f00590bf40ce18befb2a9ac3667f81a9b3fac2302942ec6f50429"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.923063 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.932229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" event={"ID":"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf","Type":"ContainerStarted","Data":"51fa27bf5185af42d96749f1c1646e10b496d74f5e164127ba90189d401e2542"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.940073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e983989c-d859-4dd0-ac5c-5fb70f4644ea","Type":"ContainerStarted","Data":"ae8da12bf17b388740c5847ada5003be5c8db7d3f41c390912abe0032be5eab8"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.943986 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bscxr" event={"ID":"6fbb8388-7720-4ddf-b608-f6cd45ebe188","Type":"ContainerStarted","Data":"2ed99484568493e535ea4e8cc2f2dc6ce9258eeaf828bdd2e04830029be8d004"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.950832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" event={"ID":"44b531a5-573a-4457-880e-6156cfae85da","Type":"ContainerStarted","Data":"082eaeb455b6e1ceeac08a63cbd1e880fada5c9f6876b7f9ffb31bd34dd44d10"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.953352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" event={"ID":"141368eb-f9c2-4f68-839d-0e1f4795ecbb","Type":"ContainerStarted","Data":"417fa1bd93e0a00bed8d1bb4d7264141d52f2d44f4c500c18a7c4af683f89767"} Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.956807 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" podStartSLOduration=2.956785019 podStartE2EDuration="2.956785019s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:05.954029888 +0000 UTC m=+5544.654691706" watchObservedRunningTime="2025-11-21 13:23:05.956785019 +0000 UTC m=+5544.657446827" Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.969404 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" podStartSLOduration=2.969388936 podStartE2EDuration="2.969388936s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:05.96875252 +0000 UTC m=+5544.669414338" watchObservedRunningTime="2025-11-21 13:23:05.969388936 +0000 UTC m=+5544.670050754" Nov 21 13:23:05 crc kubenswrapper[4769]: I1121 13:23:05.997887 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-bscxr" podStartSLOduration=2.997861894 podStartE2EDuration="2.997861894s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:05.986830428 +0000 UTC m=+5544.687492246" watchObservedRunningTime="2025-11-21 13:23:05.997861894 +0000 UTC m=+5544.698523712" Nov 21 13:23:06 crc kubenswrapper[4769]: I1121 13:23:06.010206 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" podStartSLOduration=3.010176833 podStartE2EDuration="3.010176833s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:06.005859221 +0000 UTC m=+5544.706521039" watchObservedRunningTime="2025-11-21 13:23:06.010176833 +0000 UTC m=+5544.710838651" Nov 21 13:23:07 crc kubenswrapper[4769]: I1121 13:23:07.019369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e983989c-d859-4dd0-ac5c-5fb70f4644ea","Type":"ContainerStarted","Data":"96a4fabba89056d1c7cacc1b2c1a819c35c7e7a910d189116c8e6477b213104a"} Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.043472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e983989c-d859-4dd0-ac5c-5fb70f4644ea","Type":"ContainerStarted","Data":"5bbe2fee2809c590b37ee16f61c232cd21d010c3e6db8e2d6b4598ea3e2c33d6"} Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.043926 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-log" containerID="cri-o://96a4fabba89056d1c7cacc1b2c1a819c35c7e7a910d189116c8e6477b213104a" gracePeriod=30 Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.044396 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-httpd" containerID="cri-o://5bbe2fee2809c590b37ee16f61c232cd21d010c3e6db8e2d6b4598ea3e2c33d6" gracePeriod=30 Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.082732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2bd5b4e4-20fb-45ac-94b1-de361f055e14","Type":"ContainerStarted","Data":"3bb4a26c7b2f362b5348deac5d992307d8b90a354aa4d1cb3b003f2c54801e56"} Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.082896 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-log" containerID="cri-o://ed9d311c9a83746742c70c82e281095d6efd389e570a1ecb5a73cc69c13c2a39" gracePeriod=30 Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.083355 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-httpd" containerID="cri-o://3bb4a26c7b2f362b5348deac5d992307d8b90a354aa4d1cb3b003f2c54801e56" gracePeriod=30 Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.091129 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.091103957 podStartE2EDuration="5.091103957s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:08.079471435 +0000 UTC m=+5546.780133253" watchObservedRunningTime="2025-11-21 13:23:08.091103957 +0000 UTC m=+5546.791765775" Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.095607 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerStarted","Data":"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc"} Nov 21 13:23:08 crc kubenswrapper[4769]: I1121 13:23:08.118345 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.118322892 podStartE2EDuration="5.118322892s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:08.110265993 +0000 UTC m=+5546.810927801" watchObservedRunningTime="2025-11-21 13:23:08.118322892 +0000 UTC m=+5546.818984710" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.108881 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerID="3bb4a26c7b2f362b5348deac5d992307d8b90a354aa4d1cb3b003f2c54801e56" exitCode=0 Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.109089 4769 generic.go:334] "Generic (PLEG): container finished" podID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerID="ed9d311c9a83746742c70c82e281095d6efd389e570a1ecb5a73cc69c13c2a39" exitCode=143 Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.108931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2bd5b4e4-20fb-45ac-94b1-de361f055e14","Type":"ContainerDied","Data":"3bb4a26c7b2f362b5348deac5d992307d8b90a354aa4d1cb3b003f2c54801e56"} Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.109148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2bd5b4e4-20fb-45ac-94b1-de361f055e14","Type":"ContainerDied","Data":"ed9d311c9a83746742c70c82e281095d6efd389e570a1ecb5a73cc69c13c2a39"} Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.111254 4769 generic.go:334] "Generic (PLEG): container finished" podID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerID="5bbe2fee2809c590b37ee16f61c232cd21d010c3e6db8e2d6b4598ea3e2c33d6" exitCode=0 Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.111273 4769 generic.go:334] "Generic (PLEG): container finished" podID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerID="96a4fabba89056d1c7cacc1b2c1a819c35c7e7a910d189116c8e6477b213104a" exitCode=143 Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.111287 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e983989c-d859-4dd0-ac5c-5fb70f4644ea","Type":"ContainerDied","Data":"5bbe2fee2809c590b37ee16f61c232cd21d010c3e6db8e2d6b4598ea3e2c33d6"} Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.111301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e983989c-d859-4dd0-ac5c-5fb70f4644ea","Type":"ContainerDied","Data":"96a4fabba89056d1c7cacc1b2c1a819c35c7e7a910d189116c8e6477b213104a"} Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.318411 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.324502 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-public-tls-certs\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457649 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-httpd-run\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-scripts\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-scripts\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457738 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-config-data\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457758 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4hlq\" (UniqueName: \"kubernetes.io/projected/e983989c-d859-4dd0-ac5c-5fb70f4644ea-kube-api-access-d4hlq\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-logs\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-combined-ca-bundle\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrp9x\" (UniqueName: \"kubernetes.io/projected/2bd5b4e4-20fb-45ac-94b1-de361f055e14-kube-api-access-qrp9x\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-config-data\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457932 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-httpd-run\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457954 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-internal-tls-certs\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-logs\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.457998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-combined-ca-bundle\") pod \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\" (UID: \"2bd5b4e4-20fb-45ac-94b1-de361f055e14\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.458022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\" (UID: \"e983989c-d859-4dd0-ac5c-5fb70f4644ea\") " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.458949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-logs" (OuterVolumeSpecName: "logs") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.458993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.459690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-logs" (OuterVolumeSpecName: "logs") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.461527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "glance") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.461623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.462910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd5b4e4-20fb-45ac-94b1-de361f055e14-kube-api-access-qrp9x" (OuterVolumeSpecName: "kube-api-access-qrp9x") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "kube-api-access-qrp9x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.464438 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.464909 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e983989c-d859-4dd0-ac5c-5fb70f4644ea-kube-api-access-d4hlq" (OuterVolumeSpecName: "kube-api-access-d4hlq") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "kube-api-access-d4hlq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.466334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-scripts" (OuterVolumeSpecName: "scripts") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.469156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-scripts" (OuterVolumeSpecName: "scripts") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.490921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.502874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.511352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.523530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-config-data" (OuterVolumeSpecName: "config-data") pod "2bd5b4e4-20fb-45ac-94b1-de361f055e14" (UID: "2bd5b4e4-20fb-45ac-94b1-de361f055e14"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.524828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.544124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-config-data" (OuterVolumeSpecName: "config-data") pod "e983989c-d859-4dd0-ac5c-5fb70f4644ea" (UID: "e983989c-d859-4dd0-ac5c-5fb70f4644ea"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561119 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561156 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561169 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561182 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561212 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d4hlq\" (UniqueName: \"kubernetes.io/projected/e983989c-d859-4dd0-ac5c-5fb70f4644ea-kube-api-access-d4hlq\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561228 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561240 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561253 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qrp9x\" (UniqueName: \"kubernetes.io/projected/2bd5b4e4-20fb-45ac-94b1-de361f055e14-kube-api-access-qrp9x\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561265 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561275 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e983989c-d859-4dd0-ac5c-5fb70f4644ea-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561287 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561298 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2bd5b4e4-20fb-45ac-94b1-de361f055e14-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561310 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2bd5b4e4-20fb-45ac-94b1-de361f055e14-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561348 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561367 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.561381 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e983989c-d859-4dd0-ac5c-5fb70f4644ea-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.594935 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.602637 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.663236 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:09 crc kubenswrapper[4769]: I1121 13:23:09.663596 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.127786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"2bd5b4e4-20fb-45ac-94b1-de361f055e14","Type":"ContainerDied","Data":"09bc1901ea4f00590bf40ce18befb2a9ac3667f81a9b3fac2302942ec6f50429"} Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.127841 4769 scope.go:117] "RemoveContainer" containerID="3bb4a26c7b2f362b5348deac5d992307d8b90a354aa4d1cb3b003f2c54801e56" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.127862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.130728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerStarted","Data":"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d"} Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.135451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"e983989c-d859-4dd0-ac5c-5fb70f4644ea","Type":"ContainerDied","Data":"ae8da12bf17b388740c5847ada5003be5c8db7d3f41c390912abe0032be5eab8"} Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.135537 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.194238 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.217777 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.233997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.241982 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.253250 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: E1121 13:23:10.253963 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-log" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.254107 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-log" Nov 21 13:23:10 crc kubenswrapper[4769]: E1121 13:23:10.254259 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-httpd" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.254375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-httpd" Nov 21 13:23:10 crc kubenswrapper[4769]: E1121 13:23:10.254496 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-log" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.254591 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-log" Nov 21 13:23:10 crc kubenswrapper[4769]: E1121 13:23:10.254703 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-httpd" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.254806 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-httpd" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.255264 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-log" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.255399 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-log" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.255522 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" containerName="glance-httpd" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.255646 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" containerName="glance-httpd" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.257276 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.260650 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-glance-dockercfg-28s9x" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.260874 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-scripts" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.261946 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.263732 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.266061 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.269882 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.270164 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.275262 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.286225 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.286968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnqpl\" (UniqueName: \"kubernetes.io/projected/8067105d-fdc5-496a-9687-ea7fba144743-kube-api-access-qnqpl\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379414 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-scripts\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379472 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wjz\" (UniqueName: \"kubernetes.io/projected/e3ac9004-704a-4634-916d-9ec129c2eea3-kube-api-access-v5wjz\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379572 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-config-data\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-logs\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379722 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-logs\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.379745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.481650 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-scripts\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wjz\" (UniqueName: \"kubernetes.io/projected/e3ac9004-704a-4634-916d-9ec129c2eea3-kube-api-access-v5wjz\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482159 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-config-data\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-logs\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-logs\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qnqpl\" (UniqueName: \"kubernetes.io/projected/8067105d-fdc5-496a-9687-ea7fba144743-kube-api-access-qnqpl\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.482952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.483061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-logs\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.483356 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.483560 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.483722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.484899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-logs\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.489557 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.489675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-scripts\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.490422 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.491022 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.493678 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-scripts\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.494018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-config-data\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.496232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-config-data\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.502098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.503847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnqpl\" (UniqueName: \"kubernetes.io/projected/8067105d-fdc5-496a-9687-ea7fba144743-kube-api-access-qnqpl\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.524589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.529402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.539876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wjz\" (UniqueName: \"kubernetes.io/projected/e3ac9004-704a-4634-916d-9ec129c2eea3-kube-api-access-v5wjz\") pod \"glance-default-internal-api-0\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.634293 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:10 crc kubenswrapper[4769]: I1121 13:23:10.640639 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.162913 4769 scope.go:117] "RemoveContainer" containerID="ed9d311c9a83746742c70c82e281095d6efd389e570a1ecb5a73cc69c13c2a39" Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.234093 4769 scope.go:117] "RemoveContainer" containerID="5bbe2fee2809c590b37ee16f61c232cd21d010c3e6db8e2d6b4598ea3e2c33d6" Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.324076 4769 scope.go:117] "RemoveContainer" containerID="96a4fabba89056d1c7cacc1b2c1a819c35c7e7a910d189116c8e6477b213104a" Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.330475 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd5b4e4-20fb-45ac-94b1-de361f055e14" path="/var/lib/kubelet/pods/2bd5b4e4-20fb-45ac-94b1-de361f055e14/volumes" Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.331785 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e983989c-d859-4dd0-ac5c-5fb70f4644ea" path="/var/lib/kubelet/pods/e983989c-d859-4dd0-ac5c-5fb70f4644ea/volumes" Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.644468 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:23:11 crc kubenswrapper[4769]: W1121 13:23:11.655593 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3ac9004_704a_4634_916d_9ec129c2eea3.slice/crio-be815dc372fd1e0ad460ee4e2982a5029a86aef9855270e78f37c4a220ea2f4a WatchSource:0}: Error finding container be815dc372fd1e0ad460ee4e2982a5029a86aef9855270e78f37c4a220ea2f4a: Status 404 returned error can't find the container with id be815dc372fd1e0ad460ee4e2982a5029a86aef9855270e78f37c4a220ea2f4a Nov 21 13:23:11 crc kubenswrapper[4769]: I1121 13:23:11.719177 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:23:12 crc kubenswrapper[4769]: I1121 13:23:12.165914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"8067105d-fdc5-496a-9687-ea7fba144743","Type":"ContainerStarted","Data":"2903e869e01264df211c14dd85495b39c1b526f6a8ee4b61515d23d18d288ef0"} Nov 21 13:23:12 crc kubenswrapper[4769]: I1121 13:23:12.169408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e3ac9004-704a-4634-916d-9ec129c2eea3","Type":"ContainerStarted","Data":"be815dc372fd1e0ad460ee4e2982a5029a86aef9855270e78f37c4a220ea2f4a"} Nov 21 13:23:13 crc kubenswrapper[4769]: I1121 13:23:13.183023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"8067105d-fdc5-496a-9687-ea7fba144743","Type":"ContainerStarted","Data":"a0d8a82c7051a5f9776967b5994f3d787ddcaed1cb184a30dad2fb917d8e737f"} Nov 21 13:23:13 crc kubenswrapper[4769]: I1121 13:23:13.185937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e3ac9004-704a-4634-916d-9ec129c2eea3","Type":"ContainerStarted","Data":"3c169290cfcc7523a06e3f4b57928f8e228b6c58975946280505f93af4d539a5"} Nov 21 13:23:13 crc kubenswrapper[4769]: I1121 13:23:13.185983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e3ac9004-704a-4634-916d-9ec129c2eea3","Type":"ContainerStarted","Data":"8382848fbfe153f4d42cf2f5b79786927fc3410074b27bb4775d8e829bec5e07"} Nov 21 13:23:13 crc kubenswrapper[4769]: I1121 13:23:13.188222 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerStarted","Data":"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709"} Nov 21 13:23:14 crc kubenswrapper[4769]: I1121 13:23:14.200710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"8067105d-fdc5-496a-9687-ea7fba144743","Type":"ContainerStarted","Data":"2667be75f935aef6130ccadf531dd892125c2c9ad950da48c6606293c6bedd4d"} Nov 21 13:23:14 crc kubenswrapper[4769]: I1121 13:23:14.231821 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.231804904 podStartE2EDuration="4.231804904s" podCreationTimestamp="2025-11-21 13:23:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:14.226294851 +0000 UTC m=+5552.926956669" watchObservedRunningTime="2025-11-21 13:23:14.231804904 +0000 UTC m=+5552.932466722" Nov 21 13:23:14 crc kubenswrapper[4769]: I1121 13:23:14.288313 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.288288687 podStartE2EDuration="4.288288687s" podCreationTimestamp="2025-11-21 13:23:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:14.266292977 +0000 UTC m=+5552.966954805" watchObservedRunningTime="2025-11-21 13:23:14.288288687 +0000 UTC m=+5552.988950525" Nov 21 13:23:15 crc kubenswrapper[4769]: I1121 13:23:15.215880 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerStarted","Data":"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd"} Nov 21 13:23:15 crc kubenswrapper[4769]: I1121 13:23:15.216345 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="sg-core" containerID="cri-o://cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" gracePeriod=30 Nov 21 13:23:15 crc kubenswrapper[4769]: I1121 13:23:15.216338 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-central-agent" containerID="cri-o://5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" gracePeriod=30 Nov 21 13:23:15 crc kubenswrapper[4769]: I1121 13:23:15.216401 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-notification-agent" containerID="cri-o://3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" gracePeriod=30 Nov 21 13:23:15 crc kubenswrapper[4769]: I1121 13:23:15.216440 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="proxy-httpd" containerID="cri-o://a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" gracePeriod=30 Nov 21 13:23:15 crc kubenswrapper[4769]: I1121 13:23:15.261094 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.991777527 podStartE2EDuration="12.261073531s" podCreationTimestamp="2025-11-21 13:23:03 +0000 UTC" firstStartedPulling="2025-11-21 13:23:04.211377108 +0000 UTC m=+5542.912038926" lastFinishedPulling="2025-11-21 13:23:14.480673112 +0000 UTC m=+5553.181334930" observedRunningTime="2025-11-21 13:23:15.255782584 +0000 UTC m=+5553.956444412" watchObservedRunningTime="2025-11-21 13:23:15.261073531 +0000 UTC m=+5553.961735349" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.000382 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088466 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-scripts\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-config-data\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-sg-core-conf-yaml\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-combined-ca-bundle\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbqvg\" (UniqueName: \"kubernetes.io/projected/62791949-c414-4fab-8cdf-8f7d4ac51246-kube-api-access-dbqvg\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-log-httpd\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.088782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-run-httpd\") pod \"62791949-c414-4fab-8cdf-8f7d4ac51246\" (UID: \"62791949-c414-4fab-8cdf-8f7d4ac51246\") " Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.089778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.089737 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.094894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62791949-c414-4fab-8cdf-8f7d4ac51246-kube-api-access-dbqvg" (OuterVolumeSpecName: "kube-api-access-dbqvg") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "kube-api-access-dbqvg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.098449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-scripts" (OuterVolumeSpecName: "scripts") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.117245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.157638 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.176776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-config-data" (OuterVolumeSpecName: "config-data") pod "62791949-c414-4fab-8cdf-8f7d4ac51246" (UID: "62791949-c414-4fab-8cdf-8f7d4ac51246"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191307 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191346 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/62791949-c414-4fab-8cdf-8f7d4ac51246-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191358 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191368 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191378 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191391 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62791949-c414-4fab-8cdf-8f7d4ac51246-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.191405 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dbqvg\" (UniqueName: \"kubernetes.io/projected/62791949-c414-4fab-8cdf-8f7d4ac51246-kube-api-access-dbqvg\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.227931 4769 generic.go:334] "Generic (PLEG): container finished" podID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" exitCode=0 Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.227962 4769 generic.go:334] "Generic (PLEG): container finished" podID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" exitCode=2 Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.227970 4769 generic.go:334] "Generic (PLEG): container finished" podID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" exitCode=0 Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.227964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerDied","Data":"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd"} Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.227978 4769 generic.go:334] "Generic (PLEG): container finished" podID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" exitCode=0 Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.227998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerDied","Data":"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709"} Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.228011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerDied","Data":"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d"} Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.228022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerDied","Data":"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc"} Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.228031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"62791949-c414-4fab-8cdf-8f7d4ac51246","Type":"ContainerDied","Data":"91142d651f4f043dc40e54f54ed2c0849e7d9c581e3eacdcd3211895f6b7a80f"} Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.228047 4769 scope.go:117] "RemoveContainer" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.229067 4769 generic.go:334] "Generic (PLEG): container finished" podID="c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" containerID="1e8d609f3478e330fa2af2d42a4790e25b430fee1075df86f4fcfe6c7147be58" exitCode=0 Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.229083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" event={"ID":"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4","Type":"ContainerDied","Data":"1e8d609f3478e330fa2af2d42a4790e25b430fee1075df86f4fcfe6c7147be58"} Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.229353 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.261804 4769 scope.go:117] "RemoveContainer" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.275413 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.283426 4769 scope.go:117] "RemoveContainer" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.284772 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.300682 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.303810 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-central-agent" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.303840 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-central-agent" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.303868 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-notification-agent" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.303875 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-notification-agent" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.303899 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="proxy-httpd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.303906 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="proxy-httpd" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.303915 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="sg-core" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.303922 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="sg-core" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.304161 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-notification-agent" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.304175 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="proxy-httpd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.304211 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="sg-core" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.304229 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" containerName="ceilometer-central-agent" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.306356 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.308596 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.308797 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.312171 4769 scope.go:117] "RemoveContainer" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.316269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.350636 4769 scope.go:117] "RemoveContainer" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.351435 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": container with ID starting with a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd not found: ID does not exist" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.351477 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd"} err="failed to get container status \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": rpc error: code = NotFound desc = could not find container \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": container with ID starting with a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.351556 4769 scope.go:117] "RemoveContainer" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.351846 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": container with ID starting with cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709 not found: ID does not exist" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.351886 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709"} err="failed to get container status \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": rpc error: code = NotFound desc = could not find container \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": container with ID starting with cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709 not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.351917 4769 scope.go:117] "RemoveContainer" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.352597 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": container with ID starting with 3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d not found: ID does not exist" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.352631 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d"} err="failed to get container status \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": rpc error: code = NotFound desc = could not find container \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": container with ID starting with 3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.352651 4769 scope.go:117] "RemoveContainer" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" Nov 21 13:23:16 crc kubenswrapper[4769]: E1121 13:23:16.352934 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": container with ID starting with 5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc not found: ID does not exist" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.352956 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc"} err="failed to get container status \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": rpc error: code = NotFound desc = could not find container \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": container with ID starting with 5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.352971 4769 scope.go:117] "RemoveContainer" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.353196 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd"} err="failed to get container status \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": rpc error: code = NotFound desc = could not find container \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": container with ID starting with a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.353256 4769 scope.go:117] "RemoveContainer" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.353604 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709"} err="failed to get container status \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": rpc error: code = NotFound desc = could not find container \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": container with ID starting with cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709 not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.353628 4769 scope.go:117] "RemoveContainer" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.353874 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d"} err="failed to get container status \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": rpc error: code = NotFound desc = could not find container \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": container with ID starting with 3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.353904 4769 scope.go:117] "RemoveContainer" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354103 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc"} err="failed to get container status \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": rpc error: code = NotFound desc = could not find container \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": container with ID starting with 5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354130 4769 scope.go:117] "RemoveContainer" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354393 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd"} err="failed to get container status \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": rpc error: code = NotFound desc = could not find container \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": container with ID starting with a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354412 4769 scope.go:117] "RemoveContainer" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354629 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709"} err="failed to get container status \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": rpc error: code = NotFound desc = could not find container \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": container with ID starting with cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709 not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354656 4769 scope.go:117] "RemoveContainer" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354867 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d"} err="failed to get container status \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": rpc error: code = NotFound desc = could not find container \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": container with ID starting with 3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.354885 4769 scope.go:117] "RemoveContainer" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.355093 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc"} err="failed to get container status \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": rpc error: code = NotFound desc = could not find container \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": container with ID starting with 5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.355112 4769 scope.go:117] "RemoveContainer" containerID="a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.355333 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd"} err="failed to get container status \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": rpc error: code = NotFound desc = could not find container \"a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd\": container with ID starting with a7080c37283afedd5c86f6dfad396364c765befe91f5df47e3f40ad15fc655bd not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.355393 4769 scope.go:117] "RemoveContainer" containerID="cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.356903 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709"} err="failed to get container status \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": rpc error: code = NotFound desc = could not find container \"cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709\": container with ID starting with cc7c45c037021c15d6536c8c37620d83d9c561fd00f98292ac4b5a76ccd05709 not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.356931 4769 scope.go:117] "RemoveContainer" containerID="3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.357249 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d"} err="failed to get container status \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": rpc error: code = NotFound desc = could not find container \"3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d\": container with ID starting with 3235d6e2def55be56f42ed00e649ec207ee6dae47db29952196e86c250e8eb5d not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.357280 4769 scope.go:117] "RemoveContainer" containerID="5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.357534 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc"} err="failed to get container status \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": rpc error: code = NotFound desc = could not find container \"5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc\": container with ID starting with 5d398572c3eb2b84ae04e62bef6792af69b31daf139d90fa05ce25b16df1f8dc not found: ID does not exist" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.394633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-log-httpd\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.394685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.395017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-run-httpd\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.395151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-scripts\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.395224 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.395308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-config-data\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.395361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pt78\" (UniqueName: \"kubernetes.io/projected/e980ebee-a906-4b0d-9c10-89f163d7d0da-kube-api-access-8pt78\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498321 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-run-httpd\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-scripts\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-config-data\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8pt78\" (UniqueName: \"kubernetes.io/projected/e980ebee-a906-4b0d-9c10-89f163d7d0da-kube-api-access-8pt78\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.498915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-log-httpd\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.499493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-log-httpd\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.501949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-run-httpd\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.502244 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.502519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-scripts\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.503258 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.504960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-config-data\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.515490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pt78\" (UniqueName: \"kubernetes.io/projected/e980ebee-a906-4b0d-9c10-89f163d7d0da-kube-api-access-8pt78\") pod \"ceilometer-0\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:16 crc kubenswrapper[4769]: I1121 13:23:16.629687 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.117806 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:23:17 crc kubenswrapper[4769]: W1121 13:23:17.121864 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode980ebee_a906_4b0d_9c10_89f163d7d0da.slice/crio-6aa0412e5355ae511efff2c89270a038a779fa0d6c78dd9e97e5c6b91fc137af WatchSource:0}: Error finding container 6aa0412e5355ae511efff2c89270a038a779fa0d6c78dd9e97e5c6b91fc137af: Status 404 returned error can't find the container with id 6aa0412e5355ae511efff2c89270a038a779fa0d6c78dd9e97e5c6b91fc137af Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.240211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerStarted","Data":"6aa0412e5355ae511efff2c89270a038a779fa0d6c78dd9e97e5c6b91fc137af"} Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.292156 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62791949-c414-4fab-8cdf-8f7d4ac51246" path="/var/lib/kubelet/pods/62791949-c414-4fab-8cdf-8f7d4ac51246/volumes" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.839423 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.925339 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-credential-keys\") pod \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.925652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-fernet-keys\") pod \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.927442 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-config-data\") pod \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.927574 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-scripts\") pod \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.927619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-combined-ca-bundle\") pod \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.927686 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2xzj\" (UniqueName: \"kubernetes.io/projected/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-kube-api-access-k2xzj\") pod \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\" (UID: \"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4\") " Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.931138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" (UID: "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.933595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-kube-api-access-k2xzj" (OuterVolumeSpecName: "kube-api-access-k2xzj") pod "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" (UID: "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4"). InnerVolumeSpecName "kube-api-access-k2xzj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.941406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-scripts" (OuterVolumeSpecName: "scripts") pod "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" (UID: "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.943102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" (UID: "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.958921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-config-data" (OuterVolumeSpecName: "config-data") pod "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" (UID: "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:17 crc kubenswrapper[4769]: I1121 13:23:17.967652 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" (UID: "c67c2798-6d8e-4dcf-b63e-b7a1386d3db4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.030051 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.030092 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.030110 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k2xzj\" (UniqueName: \"kubernetes.io/projected/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-kube-api-access-k2xzj\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.030125 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.030138 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.030149 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.255654 4769 generic.go:334] "Generic (PLEG): container finished" podID="6fbb8388-7720-4ddf-b608-f6cd45ebe188" containerID="2ed99484568493e535ea4e8cc2f2dc6ce9258eeaf828bdd2e04830029be8d004" exitCode=0 Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.256068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bscxr" event={"ID":"6fbb8388-7720-4ddf-b608-f6cd45ebe188","Type":"ContainerDied","Data":"2ed99484568493e535ea4e8cc2f2dc6ce9258eeaf828bdd2e04830029be8d004"} Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.260091 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerStarted","Data":"6cbfa81ba28502803eae6ae681dd9006ee2b9c28ac33c099fd119ef49f56af0c"} Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.265151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" event={"ID":"c67c2798-6d8e-4dcf-b63e-b7a1386d3db4","Type":"ContainerDied","Data":"82d15d72af60e542b30afa33808c859cc34cf15caad0bb63e99f721f23e15f0a"} Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.265235 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82d15d72af60e542b30afa33808c859cc34cf15caad0bb63e99f721f23e15f0a" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.265307 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-cq5l2" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.454397 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cq5l2"] Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.489939 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-cq5l2"] Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.547063 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g7v9w"] Nov 21 13:23:18 crc kubenswrapper[4769]: E1121 13:23:18.547456 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" containerName="keystone-bootstrap" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.547472 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" containerName="keystone-bootstrap" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.547624 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" containerName="keystone-bootstrap" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.548183 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.551771 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"osp-secret" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.551771 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.551888 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m6k4f" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.552215 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.552216 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.566221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g7v9w"] Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.643416 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-combined-ca-bundle\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.643462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-config-data\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.643496 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-scripts\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.643527 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lv6v\" (UniqueName: \"kubernetes.io/projected/9044488d-6b19-4fbe-b4b2-8276fc8c644d-kube-api-access-9lv6v\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.643557 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-credential-keys\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.643578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-fernet-keys\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.744796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-combined-ca-bundle\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.744857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-config-data\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.744899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-scripts\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.744941 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9lv6v\" (UniqueName: \"kubernetes.io/projected/9044488d-6b19-4fbe-b4b2-8276fc8c644d-kube-api-access-9lv6v\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.744983 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-credential-keys\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.745017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-fernet-keys\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.747722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-scripts\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.747864 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-combined-ca-bundle\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.748311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-credential-keys\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.748443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-fernet-keys\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.749579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-config-data\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.772409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lv6v\" (UniqueName: \"kubernetes.io/projected/9044488d-6b19-4fbe-b4b2-8276fc8c644d-kube-api-access-9lv6v\") pod \"keystone-bootstrap-g7v9w\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:18 crc kubenswrapper[4769]: I1121 13:23:18.916389 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.287070 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c67c2798-6d8e-4dcf-b63e-b7a1386d3db4" path="/var/lib/kubelet/pods/c67c2798-6d8e-4dcf-b63e-b7a1386d3db4/volumes" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.294966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerStarted","Data":"914110a10d13b5e5b382f8c7aefeab074f41fe7249ba7d5e34ebdc0607e94632"} Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.456922 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g7v9w"] Nov 21 13:23:19 crc kubenswrapper[4769]: W1121 13:23:19.468659 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9044488d_6b19_4fbe_b4b2_8276fc8c644d.slice/crio-3bed45589737f82a18d1550d3a44a77f5a2bd21d52391f072cd88c933c40a5c0 WatchSource:0}: Error finding container 3bed45589737f82a18d1550d3a44a77f5a2bd21d52391f072cd88c933c40a5c0: Status 404 returned error can't find the container with id 3bed45589737f82a18d1550d3a44a77f5a2bd21d52391f072cd88c933c40a5c0 Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.611405 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.661168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-combined-ca-bundle\") pod \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.661286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fbb8388-7720-4ddf-b608-f6cd45ebe188-logs\") pod \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.661318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8qrz\" (UniqueName: \"kubernetes.io/projected/6fbb8388-7720-4ddf-b608-f6cd45ebe188-kube-api-access-k8qrz\") pod \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.661343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-scripts\") pod \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.661375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-config-data\") pod \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\" (UID: \"6fbb8388-7720-4ddf-b608-f6cd45ebe188\") " Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.662818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbb8388-7720-4ddf-b608-f6cd45ebe188-logs" (OuterVolumeSpecName: "logs") pod "6fbb8388-7720-4ddf-b608-f6cd45ebe188" (UID: "6fbb8388-7720-4ddf-b608-f6cd45ebe188"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.666433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbb8388-7720-4ddf-b608-f6cd45ebe188-kube-api-access-k8qrz" (OuterVolumeSpecName: "kube-api-access-k8qrz") pod "6fbb8388-7720-4ddf-b608-f6cd45ebe188" (UID: "6fbb8388-7720-4ddf-b608-f6cd45ebe188"). InnerVolumeSpecName "kube-api-access-k8qrz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.678866 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-scripts" (OuterVolumeSpecName: "scripts") pod "6fbb8388-7720-4ddf-b608-f6cd45ebe188" (UID: "6fbb8388-7720-4ddf-b608-f6cd45ebe188"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.695831 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-config-data" (OuterVolumeSpecName: "config-data") pod "6fbb8388-7720-4ddf-b608-f6cd45ebe188" (UID: "6fbb8388-7720-4ddf-b608-f6cd45ebe188"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.710994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6fbb8388-7720-4ddf-b608-f6cd45ebe188" (UID: "6fbb8388-7720-4ddf-b608-f6cd45ebe188"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.763825 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.763883 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6fbb8388-7720-4ddf-b608-f6cd45ebe188-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.763899 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k8qrz\" (UniqueName: \"kubernetes.io/projected/6fbb8388-7720-4ddf-b608-f6cd45ebe188-kube-api-access-k8qrz\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.763912 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:19 crc kubenswrapper[4769]: I1121 13:23:19.763924 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6fbb8388-7720-4ddf-b608-f6cd45ebe188-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.308036 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-bscxr" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.308056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-bscxr" event={"ID":"6fbb8388-7720-4ddf-b608-f6cd45ebe188","Type":"ContainerDied","Data":"4732fded87dc32450ea05fbf50984502fe2a2fd209a752b5969e3c4070b4f5c6"} Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.308114 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4732fded87dc32450ea05fbf50984502fe2a2fd209a752b5969e3c4070b4f5c6" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.311274 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" event={"ID":"9044488d-6b19-4fbe-b4b2-8276fc8c644d","Type":"ContainerStarted","Data":"3f787a2b66dd0895ca1896e220fa1d6ebe3229d45c182d7b4edcb501219aa2fe"} Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.311315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" event={"ID":"9044488d-6b19-4fbe-b4b2-8276fc8c644d","Type":"ContainerStarted","Data":"3bed45589737f82a18d1550d3a44a77f5a2bd21d52391f072cd88c933c40a5c0"} Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.316949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerStarted","Data":"6990482a8b26fde6aa719c7386df6b8248fe96fe7922d2e3dd6bc5923515ea13"} Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.341931 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" podStartSLOduration=2.341911918 podStartE2EDuration="2.341911918s" podCreationTimestamp="2025-11-21 13:23:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:20.336985611 +0000 UTC m=+5559.037647439" watchObservedRunningTime="2025-11-21 13:23:20.341911918 +0000 UTC m=+5559.042573746" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.398446 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6989955c5d-x4d64"] Nov 21 13:23:20 crc kubenswrapper[4769]: E1121 13:23:20.398908 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6fbb8388-7720-4ddf-b608-f6cd45ebe188" containerName="placement-db-sync" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.398931 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbb8388-7720-4ddf-b608-f6cd45ebe188" containerName="placement-db-sync" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.399144 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6fbb8388-7720-4ddf-b608-f6cd45ebe188" containerName="placement-db-sync" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.400595 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.406860 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-scripts" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.407103 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-config-data" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.407280 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"placement-placement-dockercfg-b97dv" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.407546 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-internal-svc" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.407774 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-placement-public-svc" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.426380 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6989955c5d-x4d64"] Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.479707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtj5\" (UniqueName: \"kubernetes.io/projected/cc15cbd1-7c64-4f95-b7ed-2090167ce968-kube-api-access-rxtj5\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.479972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-scripts\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.480060 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-combined-ca-bundle\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.480141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-public-tls-certs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.480229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-internal-tls-certs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.480293 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-config-data\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.480368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc15cbd1-7c64-4f95-b7ed-2090167ce968-logs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.582514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-scripts\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.582578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-combined-ca-bundle\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.582609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-public-tls-certs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.582636 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-internal-tls-certs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.582654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-config-data\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.582676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc15cbd1-7c64-4f95-b7ed-2090167ce968-logs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.583386 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc15cbd1-7c64-4f95-b7ed-2090167ce968-logs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.583996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtj5\" (UniqueName: \"kubernetes.io/projected/cc15cbd1-7c64-4f95-b7ed-2090167ce968-kube-api-access-rxtj5\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.587751 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-scripts\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.588120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-combined-ca-bundle\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.588587 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-config-data\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.588703 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-public-tls-certs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.591564 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-internal-tls-certs\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.618021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtj5\" (UniqueName: \"kubernetes.io/projected/cc15cbd1-7c64-4f95-b7ed-2090167ce968-kube-api-access-rxtj5\") pod \"placement-6989955c5d-x4d64\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.634518 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.634578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.642015 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.642321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.670569 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.685857 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.691576 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.705241 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:20 crc kubenswrapper[4769]: I1121 13:23:20.733921 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:21 crc kubenswrapper[4769]: I1121 13:23:21.330485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerStarted","Data":"5a93cda2bfd3f52cf324bf45bfef559e34319f0f34996395f70d850b91f766b1"} Nov 21 13:23:21 crc kubenswrapper[4769]: I1121 13:23:21.332141 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:21 crc kubenswrapper[4769]: I1121 13:23:21.332687 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:21 crc kubenswrapper[4769]: I1121 13:23:21.332750 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:21 crc kubenswrapper[4769]: I1121 13:23:21.332762 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:21 crc kubenswrapper[4769]: I1121 13:23:21.481536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6989955c5d-x4d64"] Nov 21 13:23:21 crc kubenswrapper[4769]: W1121 13:23:21.482055 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc15cbd1_7c64_4f95_b7ed_2090167ce968.slice/crio-13157ac206ba172098ca31948483bb64f87d7b1215b48a520ef50a7b884548e5 WatchSource:0}: Error finding container 13157ac206ba172098ca31948483bb64f87d7b1215b48a520ef50a7b884548e5: Status 404 returned error can't find the container with id 13157ac206ba172098ca31948483bb64f87d7b1215b48a520ef50a7b884548e5 Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.343586 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" event={"ID":"cc15cbd1-7c64-4f95-b7ed-2090167ce968","Type":"ContainerStarted","Data":"0164617c683f651c195f2757ec57bffae8ad263ad2047e33a3fcd9f12edeb133"} Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.343643 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.343657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" event={"ID":"cc15cbd1-7c64-4f95-b7ed-2090167ce968","Type":"ContainerStarted","Data":"2625031a0b0c2bbf67b35c39fd280fdbab221bfd025c71f05cfb0b8e055e826b"} Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.343670 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" event={"ID":"cc15cbd1-7c64-4f95-b7ed-2090167ce968","Type":"ContainerStarted","Data":"13157ac206ba172098ca31948483bb64f87d7b1215b48a520ef50a7b884548e5"} Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.344823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.344853 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.396764 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" podStartSLOduration=2.396747496 podStartE2EDuration="2.396747496s" podCreationTimestamp="2025-11-21 13:23:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:22.393936263 +0000 UTC m=+5561.094598081" watchObservedRunningTime="2025-11-21 13:23:22.396747496 +0000 UTC m=+5561.097409314" Nov 21 13:23:22 crc kubenswrapper[4769]: I1121 13:23:22.399240 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.47116636 podStartE2EDuration="6.39923082s" podCreationTimestamp="2025-11-21 13:23:16 +0000 UTC" firstStartedPulling="2025-11-21 13:23:17.124320635 +0000 UTC m=+5555.824982443" lastFinishedPulling="2025-11-21 13:23:21.052385055 +0000 UTC m=+5559.753046903" observedRunningTime="2025-11-21 13:23:22.371520532 +0000 UTC m=+5561.072182340" watchObservedRunningTime="2025-11-21 13:23:22.39923082 +0000 UTC m=+5561.099892638" Nov 21 13:23:23 crc kubenswrapper[4769]: I1121 13:23:23.289651 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:23 crc kubenswrapper[4769]: I1121 13:23:23.299783 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:23:23 crc kubenswrapper[4769]: I1121 13:23:23.310142 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:23 crc kubenswrapper[4769]: I1121 13:23:23.356224 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:23:23 crc kubenswrapper[4769]: I1121 13:23:23.402210 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:23:24 crc kubenswrapper[4769]: I1121 13:23:24.366767 4769 generic.go:334] "Generic (PLEG): container finished" podID="9044488d-6b19-4fbe-b4b2-8276fc8c644d" containerID="3f787a2b66dd0895ca1896e220fa1d6ebe3229d45c182d7b4edcb501219aa2fe" exitCode=0 Nov 21 13:23:24 crc kubenswrapper[4769]: I1121 13:23:24.366860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" event={"ID":"9044488d-6b19-4fbe-b4b2-8276fc8c644d","Type":"ContainerDied","Data":"3f787a2b66dd0895ca1896e220fa1d6ebe3229d45c182d7b4edcb501219aa2fe"} Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.721455 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.790775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lv6v\" (UniqueName: \"kubernetes.io/projected/9044488d-6b19-4fbe-b4b2-8276fc8c644d-kube-api-access-9lv6v\") pod \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.790827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-combined-ca-bundle\") pod \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.790859 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-credential-keys\") pod \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.790950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-scripts\") pod \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.791074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-config-data\") pod \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.791127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-fernet-keys\") pod \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\" (UID: \"9044488d-6b19-4fbe-b4b2-8276fc8c644d\") " Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.798133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "9044488d-6b19-4fbe-b4b2-8276fc8c644d" (UID: "9044488d-6b19-4fbe-b4b2-8276fc8c644d"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.798979 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-scripts" (OuterVolumeSpecName: "scripts") pod "9044488d-6b19-4fbe-b4b2-8276fc8c644d" (UID: "9044488d-6b19-4fbe-b4b2-8276fc8c644d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.810078 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "9044488d-6b19-4fbe-b4b2-8276fc8c644d" (UID: "9044488d-6b19-4fbe-b4b2-8276fc8c644d"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.812289 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9044488d-6b19-4fbe-b4b2-8276fc8c644d-kube-api-access-9lv6v" (OuterVolumeSpecName: "kube-api-access-9lv6v") pod "9044488d-6b19-4fbe-b4b2-8276fc8c644d" (UID: "9044488d-6b19-4fbe-b4b2-8276fc8c644d"). InnerVolumeSpecName "kube-api-access-9lv6v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.816764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9044488d-6b19-4fbe-b4b2-8276fc8c644d" (UID: "9044488d-6b19-4fbe-b4b2-8276fc8c644d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.829711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-config-data" (OuterVolumeSpecName: "config-data") pod "9044488d-6b19-4fbe-b4b2-8276fc8c644d" (UID: "9044488d-6b19-4fbe-b4b2-8276fc8c644d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.893101 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.893148 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.893169 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9lv6v\" (UniqueName: \"kubernetes.io/projected/9044488d-6b19-4fbe-b4b2-8276fc8c644d-kube-api-access-9lv6v\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.893204 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.893219 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:25 crc kubenswrapper[4769]: I1121 13:23:25.893232 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9044488d-6b19-4fbe-b4b2-8276fc8c644d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.391763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" event={"ID":"9044488d-6b19-4fbe-b4b2-8276fc8c644d","Type":"ContainerDied","Data":"3bed45589737f82a18d1550d3a44a77f5a2bd21d52391f072cd88c933c40a5c0"} Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.391811 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bed45589737f82a18d1550d3a44a77f5a2bd21d52391f072cd88c933c40a5c0" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.391854 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-g7v9w" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.493026 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7f8594c87b-2g9gp"] Nov 21 13:23:26 crc kubenswrapper[4769]: E1121 13:23:26.494064 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9044488d-6b19-4fbe-b4b2-8276fc8c644d" containerName="keystone-bootstrap" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.494100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9044488d-6b19-4fbe-b4b2-8276fc8c644d" containerName="keystone-bootstrap" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.494458 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9044488d-6b19-4fbe-b4b2-8276fc8c644d" containerName="keystone-bootstrap" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.495483 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.498686 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-scripts" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.499445 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-public-svc" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.499445 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-keystone-dockercfg-m6k4f" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.499635 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone-config-data" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.499744 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.499842 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"keystone" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.504680 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7f8594c87b-2g9gp"] Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.605635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-config-data\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.605770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-scripts\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.605811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-internal-tls-certs\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.605904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-combined-ca-bundle\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.606034 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-public-tls-certs\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.606134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-fernet-keys\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.606254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-credential-keys\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.606410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8wg\" (UniqueName: \"kubernetes.io/projected/6c0d96de-e234-4e3c-9db1-882b35918e73-kube-api-access-zv8wg\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.708598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8wg\" (UniqueName: \"kubernetes.io/projected/6c0d96de-e234-4e3c-9db1-882b35918e73-kube-api-access-zv8wg\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.708748 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-config-data\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.708891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-scripts\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.708950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-internal-tls-certs\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.710409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-combined-ca-bundle\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.710479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-public-tls-certs\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.710518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-fernet-keys\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.710641 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-credential-keys\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.714821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-credential-keys\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.715173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-combined-ca-bundle\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.715473 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-public-tls-certs\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.717227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-config-data\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.726297 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-internal-tls-certs\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.726443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-fernet-keys\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.726567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-scripts\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.729946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8wg\" (UniqueName: \"kubernetes.io/projected/6c0d96de-e234-4e3c-9db1-882b35918e73-kube-api-access-zv8wg\") pod \"keystone-7f8594c87b-2g9gp\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:26 crc kubenswrapper[4769]: I1121 13:23:26.820909 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:27 crc kubenswrapper[4769]: I1121 13:23:27.263422 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7f8594c87b-2g9gp"] Nov 21 13:23:27 crc kubenswrapper[4769]: I1121 13:23:27.405795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" event={"ID":"6c0d96de-e234-4e3c-9db1-882b35918e73","Type":"ContainerStarted","Data":"84c8f8779a0cc74b3f5dbb3a48974c63389bb86fead51f9b241e718ae6b1f33f"} Nov 21 13:23:28 crc kubenswrapper[4769]: I1121 13:23:28.431178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" event={"ID":"6c0d96de-e234-4e3c-9db1-882b35918e73","Type":"ContainerStarted","Data":"c8c8acbaa3d7dac4a90d7287898b59d5fe457dc4f4647765a6926a222fb25e6c"} Nov 21 13:23:28 crc kubenswrapper[4769]: I1121 13:23:28.431425 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:28 crc kubenswrapper[4769]: I1121 13:23:28.456158 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" podStartSLOduration=2.456140127 podStartE2EDuration="2.456140127s" podCreationTimestamp="2025-11-21 13:23:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:28.455957392 +0000 UTC m=+5567.156619290" watchObservedRunningTime="2025-11-21 13:23:28.456140127 +0000 UTC m=+5567.156801955" Nov 21 13:23:30 crc kubenswrapper[4769]: I1121 13:23:30.462556 4769 generic.go:334] "Generic (PLEG): container finished" podID="44b531a5-573a-4457-880e-6156cfae85da" containerID="082eaeb455b6e1ceeac08a63cbd1e880fada5c9f6876b7f9ffb31bd34dd44d10" exitCode=0 Nov 21 13:23:30 crc kubenswrapper[4769]: I1121 13:23:30.462698 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" event={"ID":"44b531a5-573a-4457-880e-6156cfae85da","Type":"ContainerDied","Data":"082eaeb455b6e1ceeac08a63cbd1e880fada5c9f6876b7f9ffb31bd34dd44d10"} Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.884507 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.918278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-combined-ca-bundle\") pod \"44b531a5-573a-4457-880e-6156cfae85da\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.918385 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/44b531a5-573a-4457-880e-6156cfae85da-kube-api-access-7g5k5\") pod \"44b531a5-573a-4457-880e-6156cfae85da\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.918447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-db-sync-config-data\") pod \"44b531a5-573a-4457-880e-6156cfae85da\" (UID: \"44b531a5-573a-4457-880e-6156cfae85da\") " Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.930698 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b531a5-573a-4457-880e-6156cfae85da-kube-api-access-7g5k5" (OuterVolumeSpecName: "kube-api-access-7g5k5") pod "44b531a5-573a-4457-880e-6156cfae85da" (UID: "44b531a5-573a-4457-880e-6156cfae85da"). InnerVolumeSpecName "kube-api-access-7g5k5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.930750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "44b531a5-573a-4457-880e-6156cfae85da" (UID: "44b531a5-573a-4457-880e-6156cfae85da"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:31 crc kubenswrapper[4769]: I1121 13:23:31.965202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "44b531a5-573a-4457-880e-6156cfae85da" (UID: "44b531a5-573a-4457-880e-6156cfae85da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.019698 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.019745 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7g5k5\" (UniqueName: \"kubernetes.io/projected/44b531a5-573a-4457-880e-6156cfae85da-kube-api-access-7g5k5\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.019758 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/44b531a5-573a-4457-880e-6156cfae85da-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.337784 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-cgwqv"] Nov 21 13:23:32 crc kubenswrapper[4769]: E1121 13:23:32.338827 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="44b531a5-573a-4457-880e-6156cfae85da" containerName="barbican-db-sync" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.338854 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b531a5-573a-4457-880e-6156cfae85da" containerName="barbican-db-sync" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.339104 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="44b531a5-573a-4457-880e-6156cfae85da" containerName="barbican-db-sync" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.340882 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.346408 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-cgwqv"] Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.425399 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-utilities\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.425479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-258mp\" (UniqueName: \"kubernetes.io/projected/ca5d99b9-e410-4d25-8ac9-346e375b2368-kube-api-access-258mp\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.425635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-catalog-content\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.485497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" event={"ID":"44b531a5-573a-4457-880e-6156cfae85da","Type":"ContainerDied","Data":"5e168963c43c29faec7e308643c99ccb3523ebf6fc4703cfa28dd34b25014339"} Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.485541 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e168963c43c29faec7e308643c99ccb3523ebf6fc4703cfa28dd34b25014339" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.485567 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-5qdzl" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.527351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-utilities\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.527415 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-258mp\" (UniqueName: \"kubernetes.io/projected/ca5d99b9-e410-4d25-8ac9-346e375b2368-kube-api-access-258mp\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.527498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-catalog-content\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.527839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-utilities\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.527908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-catalog-content\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.554303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-258mp\" (UniqueName: \"kubernetes.io/projected/ca5d99b9-e410-4d25-8ac9-346e375b2368-kube-api-access-258mp\") pod \"redhat-marketplace-cgwqv\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.659941 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.725796 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd"] Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.727153 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.741830 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-barbican-dockercfg-5k9wz" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.742072 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-worker-config-data" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.742239 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-config-data" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.752453 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5"] Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.753954 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.760853 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.780856 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd"] Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.805759 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5"] Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data-custom\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939162 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96422\" (UniqueName: \"kubernetes.io/projected/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-kube-api-access-96422\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64ba6619-1b2b-4a3e-8605-cdc296f28855-logs\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-combined-ca-bundle\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data-custom\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939384 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgbg5\" (UniqueName: \"kubernetes.io/projected/64ba6619-1b2b-4a3e-8605-cdc296f28855-kube-api-access-rgbg5\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-combined-ca-bundle\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.939442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-logs\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.950002 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5"] Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.951814 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.957949 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"barbican-api-config-data" Nov 21 13:23:32 crc kubenswrapper[4769]: I1121 13:23:32.967834 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5"] Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.040820 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data-custom\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.040886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.040979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-96422\" (UniqueName: \"kubernetes.io/projected/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-kube-api-access-96422\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64ba6619-1b2b-4a3e-8605-cdc296f28855-logs\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041046 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-combined-ca-bundle\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data-custom\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rgbg5\" (UniqueName: \"kubernetes.io/projected/64ba6619-1b2b-4a3e-8605-cdc296f28855-kube-api-access-rgbg5\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041162 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-combined-ca-bundle\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041440 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-logs\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.041874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-logs\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.043093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64ba6619-1b2b-4a3e-8605-cdc296f28855-logs\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.052104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data-custom\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.052567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.052905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data-custom\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.053248 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.055472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-combined-ca-bundle\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.056856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-combined-ca-bundle\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.062578 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-96422\" (UniqueName: \"kubernetes.io/projected/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-kube-api-access-96422\") pod \"barbican-worker-86d59c8959-pbrhd\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.063439 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgbg5\" (UniqueName: \"kubernetes.io/projected/64ba6619-1b2b-4a3e-8605-cdc296f28855-kube-api-access-rgbg5\") pod \"barbican-keystone-listener-6d769cf55b-64vn5\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.080953 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.143129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-logs\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.143511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data-custom\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.143574 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tvc\" (UniqueName: \"kubernetes.io/projected/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-kube-api-access-k6tvc\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.143612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-combined-ca-bundle\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.143634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.146604 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.246094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-logs\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.246182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data-custom\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.246301 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tvc\" (UniqueName: \"kubernetes.io/projected/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-kube-api-access-k6tvc\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.246417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-combined-ca-bundle\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.246446 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.247614 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-logs\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.254691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-combined-ca-bundle\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.257009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data-custom\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.257933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.266107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tvc\" (UniqueName: \"kubernetes.io/projected/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-kube-api-access-k6tvc\") pod \"barbican-api-5fbc9c6444-tblt5\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.270120 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.316766 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-cgwqv"] Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.337918 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd"] Nov 21 13:23:33 crc kubenswrapper[4769]: W1121 13:23:33.367765 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod083c8f14_c35e_4d60_91ef_9881dc7ad8c3.slice/crio-0b02016ced1b4129118030c849609397c8603f15df746c2157bfa8d56b1b3ba6 WatchSource:0}: Error finding container 0b02016ced1b4129118030c849609397c8603f15df746c2157bfa8d56b1b3ba6: Status 404 returned error can't find the container with id 0b02016ced1b4129118030c849609397c8603f15df746c2157bfa8d56b1b3ba6 Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.494124 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerStarted","Data":"7f0175474e0116cc4a22dff662511b2303d3b91c18146eb7a07291b7b60971a5"} Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.495344 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" event={"ID":"083c8f14-c35e-4d60-91ef-9881dc7ad8c3","Type":"ContainerStarted","Data":"0b02016ced1b4129118030c849609397c8603f15df746c2157bfa8d56b1b3ba6"} Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.693815 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5"] Nov 21 13:23:33 crc kubenswrapper[4769]: W1121 13:23:33.697600 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64ba6619_1b2b_4a3e_8605_cdc296f28855.slice/crio-38ff679e84e4e9da751ef79a9978b06b7bb7b8948e354e49e8a35764d0d781b5 WatchSource:0}: Error finding container 38ff679e84e4e9da751ef79a9978b06b7bb7b8948e354e49e8a35764d0d781b5: Status 404 returned error can't find the container with id 38ff679e84e4e9da751ef79a9978b06b7bb7b8948e354e49e8a35764d0d781b5 Nov 21 13:23:33 crc kubenswrapper[4769]: I1121 13:23:33.806472 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5"] Nov 21 13:23:33 crc kubenswrapper[4769]: W1121 13:23:33.817017 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ec4cb1b_bd5e_4dc1_8ecf_5e16e3079f8c.slice/crio-3a2346d569b0dc361085c43e3f72e1f0c5e407abe571d9864339bc409c551572 WatchSource:0}: Error finding container 3a2346d569b0dc361085c43e3f72e1f0c5e407abe571d9864339bc409c551572: Status 404 returned error can't find the container with id 3a2346d569b0dc361085c43e3f72e1f0c5e407abe571d9864339bc409c551572 Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.507549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" event={"ID":"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c","Type":"ContainerStarted","Data":"8a2fb3edf6aa081a544a3fca69743f7bc2dd4f8d866a7cf37f6c711d7f806244"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.507900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" event={"ID":"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c","Type":"ContainerStarted","Data":"3a2346d569b0dc361085c43e3f72e1f0c5e407abe571d9864339bc409c551572"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.509316 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" event={"ID":"64ba6619-1b2b-4a3e-8605-cdc296f28855","Type":"ContainerStarted","Data":"3b24cc09ab22264d746ae4f5f0857ced13d35ea66ae2f1da22e626a7d540861b"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.509339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" event={"ID":"64ba6619-1b2b-4a3e-8605-cdc296f28855","Type":"ContainerStarted","Data":"38ff679e84e4e9da751ef79a9978b06b7bb7b8948e354e49e8a35764d0d781b5"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.510969 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerID="366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a" exitCode=0 Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.511010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerDied","Data":"366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.516674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" event={"ID":"083c8f14-c35e-4d60-91ef-9881dc7ad8c3","Type":"ContainerStarted","Data":"042b1d0b935aa62be0f611d8c6dc9f0f79c51fdf863fdcaad51c73d08a3c2379"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.516703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" event={"ID":"083c8f14-c35e-4d60-91ef-9881dc7ad8c3","Type":"ContainerStarted","Data":"51c82d1abe313c608e8cfb5b329634aa1bb7af7491c585fda31de62cdc267828"} Nov 21 13:23:34 crc kubenswrapper[4769]: I1121 13:23:34.566095 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" podStartSLOduration=2.5660728390000003 podStartE2EDuration="2.566072839s" podCreationTimestamp="2025-11-21 13:23:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:34.556806499 +0000 UTC m=+5573.257468327" watchObservedRunningTime="2025-11-21 13:23:34.566072839 +0000 UTC m=+5573.266734657" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.304416 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-68d8656558-w62fh"] Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.306331 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.308031 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.310156 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-barbican-public-svc" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.327552 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-68d8656558-w62fh"] Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.488412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-internal-tls-certs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.488787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwtn\" (UniqueName: \"kubernetes.io/projected/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-kube-api-access-sxwtn\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.488859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.488936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-combined-ca-bundle\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.489041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data-custom\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.489084 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-logs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.489130 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-public-tls-certs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.528157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" event={"ID":"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c","Type":"ContainerStarted","Data":"9025e3061963d633d29939a871feb6590de7c929ae2945e0ad26fd4ab0cff353"} Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.531025 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.531247 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.536374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" event={"ID":"64ba6619-1b2b-4a3e-8605-cdc296f28855","Type":"ContainerStarted","Data":"0a8bb992cb4724c1bb88eeebb5bc3e3b06b4814e629415b220aa44dff8458fca"} Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.561575 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" podStartSLOduration=3.561546549 podStartE2EDuration="3.561546549s" podCreationTimestamp="2025-11-21 13:23:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:35.54882998 +0000 UTC m=+5574.249491838" watchObservedRunningTime="2025-11-21 13:23:35.561546549 +0000 UTC m=+5574.262208397" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.578225 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" podStartSLOduration=3.57816356 podStartE2EDuration="3.57816356s" podCreationTimestamp="2025-11-21 13:23:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:35.573741855 +0000 UTC m=+5574.274403713" watchObservedRunningTime="2025-11-21 13:23:35.57816356 +0000 UTC m=+5574.278825418" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590520 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-internal-tls-certs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwtn\" (UniqueName: \"kubernetes.io/projected/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-kube-api-access-sxwtn\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590622 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-combined-ca-bundle\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data-custom\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590695 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-logs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.590718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-public-tls-certs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.596361 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-public-tls-certs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.600143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-logs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.600892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-combined-ca-bundle\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.601170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-internal-tls-certs\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.603302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data-custom\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.617427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.620561 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwtn\" (UniqueName: \"kubernetes.io/projected/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-kube-api-access-sxwtn\") pod \"barbican-api-68d8656558-w62fh\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:35 crc kubenswrapper[4769]: I1121 13:23:35.648946 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:36 crc kubenswrapper[4769]: I1121 13:23:36.352858 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-68d8656558-w62fh"] Nov 21 13:23:36 crc kubenswrapper[4769]: W1121 13:23:36.353953 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d949ccd_2ecb_4d79_b7a5_200c5aeaefee.slice/crio-81024220af94caaa1538f67b9d77afd781d15c25bbb12c5683ac54a7fcfbe3f3 WatchSource:0}: Error finding container 81024220af94caaa1538f67b9d77afd781d15c25bbb12c5683ac54a7fcfbe3f3: Status 404 returned error can't find the container with id 81024220af94caaa1538f67b9d77afd781d15c25bbb12c5683ac54a7fcfbe3f3 Nov 21 13:23:36 crc kubenswrapper[4769]: I1121 13:23:36.550821 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" event={"ID":"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee","Type":"ContainerStarted","Data":"81024220af94caaa1538f67b9d77afd781d15c25bbb12c5683ac54a7fcfbe3f3"} Nov 21 13:23:36 crc kubenswrapper[4769]: I1121 13:23:36.553071 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerStarted","Data":"dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316"} Nov 21 13:23:37 crc kubenswrapper[4769]: I1121 13:23:37.562912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" event={"ID":"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee","Type":"ContainerStarted","Data":"d075a66075a632d2de68d442c1cc583ed5c59a569c329ed713b7cb4da2b7f525"} Nov 21 13:23:37 crc kubenswrapper[4769]: I1121 13:23:37.563764 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:37 crc kubenswrapper[4769]: I1121 13:23:37.563829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" event={"ID":"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee","Type":"ContainerStarted","Data":"d47834be36b3b8424947e2ec37cd955af4c78a9889f24e5ec2d3bc3c33b442ad"} Nov 21 13:23:37 crc kubenswrapper[4769]: I1121 13:23:37.566169 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerID="dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316" exitCode=0 Nov 21 13:23:37 crc kubenswrapper[4769]: I1121 13:23:37.566272 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerDied","Data":"dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316"} Nov 21 13:23:37 crc kubenswrapper[4769]: I1121 13:23:37.608162 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" podStartSLOduration=2.6081438649999997 podStartE2EDuration="2.608143865s" podCreationTimestamp="2025-11-21 13:23:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:37.585698883 +0000 UTC m=+5576.286360711" watchObservedRunningTime="2025-11-21 13:23:37.608143865 +0000 UTC m=+5576.308805683" Nov 21 13:23:38 crc kubenswrapper[4769]: I1121 13:23:38.580940 4769 generic.go:334] "Generic (PLEG): container finished" podID="141368eb-f9c2-4f68-839d-0e1f4795ecbb" containerID="417fa1bd93e0a00bed8d1bb4d7264141d52f2d44f4c500c18a7c4af683f89767" exitCode=0 Nov 21 13:23:38 crc kubenswrapper[4769]: I1121 13:23:38.581026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" event={"ID":"141368eb-f9c2-4f68-839d-0e1f4795ecbb","Type":"ContainerDied","Data":"417fa1bd93e0a00bed8d1bb4d7264141d52f2d44f4c500c18a7c4af683f89767"} Nov 21 13:23:38 crc kubenswrapper[4769]: I1121 13:23:38.584560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerStarted","Data":"cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc"} Nov 21 13:23:38 crc kubenswrapper[4769]: I1121 13:23:38.584854 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:38 crc kubenswrapper[4769]: I1121 13:23:38.627434 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-cgwqv" podStartSLOduration=3.119416334 podStartE2EDuration="6.627412112s" podCreationTimestamp="2025-11-21 13:23:32 +0000 UTC" firstStartedPulling="2025-11-21 13:23:34.512777188 +0000 UTC m=+5573.213439006" lastFinishedPulling="2025-11-21 13:23:38.020772936 +0000 UTC m=+5576.721434784" observedRunningTime="2025-11-21 13:23:38.619448036 +0000 UTC m=+5577.320109894" watchObservedRunningTime="2025-11-21 13:23:38.627412112 +0000 UTC m=+5577.328073930" Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.908490 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.979143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-scripts\") pod \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.979334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/141368eb-f9c2-4f68-839d-0e1f4795ecbb-etc-machine-id\") pod \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.979406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpqlx\" (UniqueName: \"kubernetes.io/projected/141368eb-f9c2-4f68-839d-0e1f4795ecbb-kube-api-access-cpqlx\") pod \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.979455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-db-sync-config-data\") pod \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.979566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-combined-ca-bundle\") pod \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.979614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-config-data\") pod \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\" (UID: \"141368eb-f9c2-4f68-839d-0e1f4795ecbb\") " Nov 21 13:23:39 crc kubenswrapper[4769]: I1121 13:23:39.980568 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/141368eb-f9c2-4f68-839d-0e1f4795ecbb-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "141368eb-f9c2-4f68-839d-0e1f4795ecbb" (UID: "141368eb-f9c2-4f68-839d-0e1f4795ecbb"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.076557 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141368eb-f9c2-4f68-839d-0e1f4795ecbb-kube-api-access-cpqlx" (OuterVolumeSpecName: "kube-api-access-cpqlx") pod "141368eb-f9c2-4f68-839d-0e1f4795ecbb" (UID: "141368eb-f9c2-4f68-839d-0e1f4795ecbb"). InnerVolumeSpecName "kube-api-access-cpqlx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.077847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "141368eb-f9c2-4f68-839d-0e1f4795ecbb" (UID: "141368eb-f9c2-4f68-839d-0e1f4795ecbb"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.082035 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/141368eb-f9c2-4f68-839d-0e1f4795ecbb-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.082067 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cpqlx\" (UniqueName: \"kubernetes.io/projected/141368eb-f9c2-4f68-839d-0e1f4795ecbb-kube-api-access-cpqlx\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.082083 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.082913 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-scripts" (OuterVolumeSpecName: "scripts") pod "141368eb-f9c2-4f68-839d-0e1f4795ecbb" (UID: "141368eb-f9c2-4f68-839d-0e1f4795ecbb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.097365 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "141368eb-f9c2-4f68-839d-0e1f4795ecbb" (UID: "141368eb-f9c2-4f68-839d-0e1f4795ecbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.122469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-config-data" (OuterVolumeSpecName: "config-data") pod "141368eb-f9c2-4f68-839d-0e1f4795ecbb" (UID: "141368eb-f9c2-4f68-839d-0e1f4795ecbb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.184240 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.184271 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.184281 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/141368eb-f9c2-4f68-839d-0e1f4795ecbb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.621646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" event={"ID":"141368eb-f9c2-4f68-839d-0e1f4795ecbb","Type":"ContainerDied","Data":"ba152dec94242293a21fd065ab78158955e6a0ea35abf7dbce6b731ace88b784"} Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.621813 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba152dec94242293a21fd065ab78158955e6a0ea35abf7dbce6b731ace88b784" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.621889 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-hrmds" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.861882 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:40 crc kubenswrapper[4769]: E1121 13:23:40.862819 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="141368eb-f9c2-4f68-839d-0e1f4795ecbb" containerName="cinder-db-sync" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.862838 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="141368eb-f9c2-4f68-839d-0e1f4795ecbb" containerName="cinder-db-sync" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.863020 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="141368eb-f9c2-4f68-839d-0e1f4795ecbb" containerName="cinder-db-sync" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.865904 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.874325 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.874426 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-config-data" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.874473 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-cinder-dockercfg-9656w" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.874631 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scripts" Nov 21 13:23:40 crc kubenswrapper[4769]: I1121 13:23:40.893419 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.001252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.001302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68gvv\" (UniqueName: \"kubernetes.io/projected/1c7f9b09-7900-4538-a8ea-e2c079ca4272-kube-api-access-68gvv\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.001379 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.001401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.001433 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.001482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c7f9b09-7900-4538-a8ea-e2c079ca4272-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.050652 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.052362 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.053799 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.062867 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.102812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/aff25ca1-897f-4a5a-ad64-c65770ff1162-etc-machine-id\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.102869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.102899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-scripts\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103146 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/aff25ca1-897f-4a5a-ad64-c65770ff1162-logs\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103182 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data-custom\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ms89\" (UniqueName: \"kubernetes.io/projected/aff25ca1-897f-4a5a-ad64-c65770ff1162-kube-api-access-5ms89\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103337 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c7f9b09-7900-4538-a8ea-e2c079ca4272-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c7f9b09-7900-4538-a8ea-e2c079ca4272-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103421 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103573 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68gvv\" (UniqueName: \"kubernetes.io/projected/1c7f9b09-7900-4538-a8ea-e2c079ca4272-kube-api-access-68gvv\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.103610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.107393 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.108654 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.110759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.122717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-scripts\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.127664 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68gvv\" (UniqueName: \"kubernetes.io/projected/1c7f9b09-7900-4538-a8ea-e2c079ca4272-kube-api-access-68gvv\") pod \"cinder-scheduler-0\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.185233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205423 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/aff25ca1-897f-4a5a-ad64-c65770ff1162-etc-machine-id\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205494 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-scripts\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/aff25ca1-897f-4a5a-ad64-c65770ff1162-logs\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/aff25ca1-897f-4a5a-ad64-c65770ff1162-etc-machine-id\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data-custom\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5ms89\" (UniqueName: \"kubernetes.io/projected/aff25ca1-897f-4a5a-ad64-c65770ff1162-kube-api-access-5ms89\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.205876 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/aff25ca1-897f-4a5a-ad64-c65770ff1162-logs\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.212590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data-custom\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.212809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.214134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.220444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-scripts\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.232019 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ms89\" (UniqueName: \"kubernetes.io/projected/aff25ca1-897f-4a5a-ad64-c65770ff1162-kube-api-access-5ms89\") pod \"cinder-api-0\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.372221 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.711468 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:41 crc kubenswrapper[4769]: I1121 13:23:41.877424 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.644913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"aff25ca1-897f-4a5a-ad64-c65770ff1162","Type":"ContainerStarted","Data":"0b4d6b1b7d81f166adf2fab745750bacc52260bb09ecdce977356897bc5ce869"} Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.645371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"aff25ca1-897f-4a5a-ad64-c65770ff1162","Type":"ContainerStarted","Data":"709d2f97ae9b2a35d1ca27795ca357fbb226fcd5086dba291cf28e863e8ef8cc"} Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.650357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c7f9b09-7900-4538-a8ea-e2c079ca4272","Type":"ContainerStarted","Data":"1051419b90ee506aa1de64ab87a0f1c888c2ef0a395d8cef0fdf686b6f2a7a6c"} Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.650380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c7f9b09-7900-4538-a8ea-e2c079ca4272","Type":"ContainerStarted","Data":"8a1ac9c957414318726a113c2c721361134e2791f809b2b3d2cd304e938dc5ba"} Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.660626 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.662096 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:42 crc kubenswrapper[4769]: I1121 13:23:42.761538 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.172542 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.660736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c7f9b09-7900-4538-a8ea-e2c079ca4272","Type":"ContainerStarted","Data":"d857dadadc9278112c5ae0a4cc681e8bff15900f45d353d9bb513bab2b808f14"} Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.664765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"aff25ca1-897f-4a5a-ad64-c65770ff1162","Type":"ContainerStarted","Data":"ab967e4784d9bbb86001c2dc3755f84a2b0579e75d0ff2971d922f865118d822"} Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.665072 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api-log" containerID="cri-o://0b4d6b1b7d81f166adf2fab745750bacc52260bb09ecdce977356897bc5ce869" gracePeriod=30 Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.665096 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api" containerID="cri-o://ab967e4784d9bbb86001c2dc3755f84a2b0579e75d0ff2971d922f865118d822" gracePeriod=30 Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.681834 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.681811796 podStartE2EDuration="3.681811796s" podCreationTimestamp="2025-11-21 13:23:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:43.67929534 +0000 UTC m=+5582.379957158" watchObservedRunningTime="2025-11-21 13:23:43.681811796 +0000 UTC m=+5582.382473614" Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.705454 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=2.705435538 podStartE2EDuration="2.705435538s" podCreationTimestamp="2025-11-21 13:23:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:43.704689298 +0000 UTC m=+5582.405351116" watchObservedRunningTime="2025-11-21 13:23:43.705435538 +0000 UTC m=+5582.406097346" Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.739802 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:43 crc kubenswrapper[4769]: I1121 13:23:43.798281 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-cgwqv"] Nov 21 13:23:44 crc kubenswrapper[4769]: I1121 13:23:44.690880 4769 generic.go:334] "Generic (PLEG): container finished" podID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerID="0b4d6b1b7d81f166adf2fab745750bacc52260bb09ecdce977356897bc5ce869" exitCode=143 Nov 21 13:23:44 crc kubenswrapper[4769]: I1121 13:23:44.690999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"aff25ca1-897f-4a5a-ad64-c65770ff1162","Type":"ContainerDied","Data":"0b4d6b1b7d81f166adf2fab745750bacc52260bb09ecdce977356897bc5ce869"} Nov 21 13:23:44 crc kubenswrapper[4769]: I1121 13:23:44.870648 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:44 crc kubenswrapper[4769]: I1121 13:23:44.897789 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:45 crc kubenswrapper[4769]: I1121 13:23:45.702682 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-cgwqv" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="registry-server" containerID="cri-o://cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc" gracePeriod=2 Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.186365 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.234359 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.372443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.410678 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-catalog-content\") pod \"ca5d99b9-e410-4d25-8ac9-346e375b2368\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.411064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-258mp\" (UniqueName: \"kubernetes.io/projected/ca5d99b9-e410-4d25-8ac9-346e375b2368-kube-api-access-258mp\") pod \"ca5d99b9-e410-4d25-8ac9-346e375b2368\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.411246 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-utilities\") pod \"ca5d99b9-e410-4d25-8ac9-346e375b2368\" (UID: \"ca5d99b9-e410-4d25-8ac9-346e375b2368\") " Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.412581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-utilities" (OuterVolumeSpecName: "utilities") pod "ca5d99b9-e410-4d25-8ac9-346e375b2368" (UID: "ca5d99b9-e410-4d25-8ac9-346e375b2368"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.412739 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.419975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca5d99b9-e410-4d25-8ac9-346e375b2368-kube-api-access-258mp" (OuterVolumeSpecName: "kube-api-access-258mp") pod "ca5d99b9-e410-4d25-8ac9-346e375b2368" (UID: "ca5d99b9-e410-4d25-8ac9-346e375b2368"). InnerVolumeSpecName "kube-api-access-258mp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.446712 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "ca5d99b9-e410-4d25-8ac9-346e375b2368" (UID: "ca5d99b9-e410-4d25-8ac9-346e375b2368"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.514245 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/ca5d99b9-e410-4d25-8ac9-346e375b2368-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.514302 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-258mp\" (UniqueName: \"kubernetes.io/projected/ca5d99b9-e410-4d25-8ac9-346e375b2368-kube-api-access-258mp\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.635966 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.718921 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerID="cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc" exitCode=0 Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.718994 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-cgwqv" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.718998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerDied","Data":"cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc"} Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.720391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-cgwqv" event={"ID":"ca5d99b9-e410-4d25-8ac9-346e375b2368","Type":"ContainerDied","Data":"7f0175474e0116cc4a22dff662511b2303d3b91c18146eb7a07291b7b60971a5"} Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.720484 4769 scope.go:117] "RemoveContainer" containerID="cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.770373 4769 scope.go:117] "RemoveContainer" containerID="dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.775632 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-cgwqv"] Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.782921 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-cgwqv"] Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.807039 4769 scope.go:117] "RemoveContainer" containerID="366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.831933 4769 scope.go:117] "RemoveContainer" containerID="cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc" Nov 21 13:23:46 crc kubenswrapper[4769]: E1121 13:23:46.832368 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc\": container with ID starting with cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc not found: ID does not exist" containerID="cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.832410 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc"} err="failed to get container status \"cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc\": rpc error: code = NotFound desc = could not find container \"cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc\": container with ID starting with cecc7958669b689c5a8ce03b753a97f8c7345a6ad3229a7a375201ab5c05b5dc not found: ID does not exist" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.832438 4769 scope.go:117] "RemoveContainer" containerID="dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316" Nov 21 13:23:46 crc kubenswrapper[4769]: E1121 13:23:46.832740 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316\": container with ID starting with dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316 not found: ID does not exist" containerID="dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.832773 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316"} err="failed to get container status \"dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316\": rpc error: code = NotFound desc = could not find container \"dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316\": container with ID starting with dafb64dbe7bd9b2d34228ca7e87059061d3c49f7319500f88012669203854316 not found: ID does not exist" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.832796 4769 scope.go:117] "RemoveContainer" containerID="366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a" Nov 21 13:23:46 crc kubenswrapper[4769]: E1121 13:23:46.833443 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a\": container with ID starting with 366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a not found: ID does not exist" containerID="366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a" Nov 21 13:23:46 crc kubenswrapper[4769]: I1121 13:23:46.833468 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a"} err="failed to get container status \"366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a\": rpc error: code = NotFound desc = could not find container \"366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a\": container with ID starting with 366607293c99e3d631526db104b478a8fe83349b3c41c23714de615ef4ac645a not found: ID does not exist" Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.211495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.268620 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.285439 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" path="/var/lib/kubelet/pods/ca5d99b9-e410-4d25-8ac9-346e375b2368/volumes" Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.334870 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5"] Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.335247 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api-log" containerID="cri-o://8a2fb3edf6aa081a544a3fca69743f7bc2dd4f8d866a7cf37f6c711d7f806244" gracePeriod=30 Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.335292 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api" containerID="cri-o://9025e3061963d633d29939a871feb6590de7c929ae2945e0ad26fd4ab0cff353" gracePeriod=30 Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.736244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" event={"ID":"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c","Type":"ContainerDied","Data":"8a2fb3edf6aa081a544a3fca69743f7bc2dd4f8d866a7cf37f6c711d7f806244"} Nov 21 13:23:47 crc kubenswrapper[4769]: I1121 13:23:47.736255 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerID="8a2fb3edf6aa081a544a3fca69743f7bc2dd4f8d866a7cf37f6c711d7f806244" exitCode=143 Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.505433 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-tthkp"] Nov 21 13:23:48 crc kubenswrapper[4769]: E1121 13:23:48.505996 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="registry-server" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.506026 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="registry-server" Nov 21 13:23:48 crc kubenswrapper[4769]: E1121 13:23:48.506062 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="extract-content" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.506076 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="extract-content" Nov 21 13:23:48 crc kubenswrapper[4769]: E1121 13:23:48.506100 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="extract-utilities" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.506113 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="extract-utilities" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.506512 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ca5d99b9-e410-4d25-8ac9-346e375b2368" containerName="registry-server" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.509938 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.538036 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-tthkp"] Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.601788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-utilities\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.601872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-catalog-content\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.602071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f558b\" (UniqueName: \"kubernetes.io/projected/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-kube-api-access-f558b\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.703744 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-catalog-content\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.703919 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f558b\" (UniqueName: \"kubernetes.io/projected/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-kube-api-access-f558b\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.703985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-utilities\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.704521 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-utilities\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.704797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-catalog-content\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.739388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f558b\" (UniqueName: \"kubernetes.io/projected/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-kube-api-access-f558b\") pod \"certified-operators-tthkp\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:48 crc kubenswrapper[4769]: I1121 13:23:48.854470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:23:49 crc kubenswrapper[4769]: I1121 13:23:49.393824 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-tthkp"] Nov 21 13:23:49 crc kubenswrapper[4769]: W1121 13:23:49.405454 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd30e73_6c05_4d55_bc7e_21dee790c4f3.slice/crio-f28a557eadf7a9fe21d7ba7640605431d570a28da651a4a76c802beb9af1680f WatchSource:0}: Error finding container f28a557eadf7a9fe21d7ba7640605431d570a28da651a4a76c802beb9af1680f: Status 404 returned error can't find the container with id f28a557eadf7a9fe21d7ba7640605431d570a28da651a4a76c802beb9af1680f Nov 21 13:23:49 crc kubenswrapper[4769]: I1121 13:23:49.763330 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerID="1eac9550f18c3efe8d7e7bc76722444c617ef5a0fc783cd7a40394bdb53a03aa" exitCode=0 Nov 21 13:23:49 crc kubenswrapper[4769]: I1121 13:23:49.763374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerDied","Data":"1eac9550f18c3efe8d7e7bc76722444c617ef5a0fc783cd7a40394bdb53a03aa"} Nov 21 13:23:49 crc kubenswrapper[4769]: I1121 13:23:49.763399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerStarted","Data":"f28a557eadf7a9fe21d7ba7640605431d570a28da651a4a76c802beb9af1680f"} Nov 21 13:23:50 crc kubenswrapper[4769]: I1121 13:23:50.504918 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.218:9311/healthcheck\": read tcp 10.217.0.2:47250->10.217.0.218:9311: read: connection reset by peer" Nov 21 13:23:50 crc kubenswrapper[4769]: I1121 13:23:50.504951 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.218:9311/healthcheck\": read tcp 10.217.0.2:47248->10.217.0.218:9311: read: connection reset by peer" Nov 21 13:23:50 crc kubenswrapper[4769]: I1121 13:23:50.784895 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerID="9025e3061963d633d29939a871feb6590de7c929ae2945e0ad26fd4ab0cff353" exitCode=0 Nov 21 13:23:50 crc kubenswrapper[4769]: I1121 13:23:50.784938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" event={"ID":"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c","Type":"ContainerDied","Data":"9025e3061963d633d29939a871feb6590de7c929ae2945e0ad26fd4ab0cff353"} Nov 21 13:23:50 crc kubenswrapper[4769]: I1121 13:23:50.968260 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.057836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6tvc\" (UniqueName: \"kubernetes.io/projected/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-kube-api-access-k6tvc\") pod \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.057937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data-custom\") pod \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.058046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data\") pod \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.058077 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-logs\") pod \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.058252 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-combined-ca-bundle\") pod \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\" (UID: \"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c\") " Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.059659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-logs" (OuterVolumeSpecName: "logs") pod "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" (UID: "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.064214 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" (UID: "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.073058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-kube-api-access-k6tvc" (OuterVolumeSpecName: "kube-api-access-k6tvc") pod "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" (UID: "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c"). InnerVolumeSpecName "kube-api-access-k6tvc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.108400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" (UID: "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.117948 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data" (OuterVolumeSpecName: "config-data") pod "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" (UID: "3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.161241 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.161287 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6tvc\" (UniqueName: \"kubernetes.io/projected/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-kube-api-access-k6tvc\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.161303 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.161316 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.161329 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.459514 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.511223 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.801605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerStarted","Data":"6d16a6f77f4fcbb1c51a564730ca8f4c94717543d34560db7af961b221396aae"} Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.807985 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" event={"ID":"3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c","Type":"ContainerDied","Data":"3a2346d569b0dc361085c43e3f72e1f0c5e407abe571d9864339bc409c551572"} Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.808070 4769 scope.go:117] "RemoveContainer" containerID="9025e3061963d633d29939a871feb6590de7c929ae2945e0ad26fd4ab0cff353" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.808096 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.808139 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="cinder-scheduler" containerID="cri-o://1051419b90ee506aa1de64ab87a0f1c888c2ef0a395d8cef0fdf686b6f2a7a6c" gracePeriod=30 Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.808276 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="probe" containerID="cri-o://d857dadadc9278112c5ae0a4cc681e8bff15900f45d353d9bb513bab2b808f14" gracePeriod=30 Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.846166 4769 scope.go:117] "RemoveContainer" containerID="8a2fb3edf6aa081a544a3fca69743f7bc2dd4f8d866a7cf37f6c711d7f806244" Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.846882 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5"] Nov 21 13:23:51 crc kubenswrapper[4769]: I1121 13:23:51.853630 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-5fbc9c6444-tblt5"] Nov 21 13:23:52 crc kubenswrapper[4769]: I1121 13:23:52.309357 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:52 crc kubenswrapper[4769]: I1121 13:23:52.827559 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerID="d857dadadc9278112c5ae0a4cc681e8bff15900f45d353d9bb513bab2b808f14" exitCode=0 Nov 21 13:23:52 crc kubenswrapper[4769]: I1121 13:23:52.827664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c7f9b09-7900-4538-a8ea-e2c079ca4272","Type":"ContainerDied","Data":"d857dadadc9278112c5ae0a4cc681e8bff15900f45d353d9bb513bab2b808f14"} Nov 21 13:23:52 crc kubenswrapper[4769]: I1121 13:23:52.867093 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:23:53 crc kubenswrapper[4769]: I1121 13:23:53.293143 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" path="/var/lib/kubelet/pods/3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c/volumes" Nov 21 13:23:53 crc kubenswrapper[4769]: I1121 13:23:53.678849 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:23:53 crc kubenswrapper[4769]: I1121 13:23:53.849525 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerID="1051419b90ee506aa1de64ab87a0f1c888c2ef0a395d8cef0fdf686b6f2a7a6c" exitCode=0 Nov 21 13:23:53 crc kubenswrapper[4769]: I1121 13:23:53.849567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c7f9b09-7900-4538-a8ea-e2c079ca4272","Type":"ContainerDied","Data":"1051419b90ee506aa1de64ab87a0f1c888c2ef0a395d8cef0fdf686b6f2a7a6c"} Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.286722 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.461937 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68gvv\" (UniqueName: \"kubernetes.io/projected/1c7f9b09-7900-4538-a8ea-e2c079ca4272-kube-api-access-68gvv\") pod \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.462390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data\") pod \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.462423 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data-custom\") pod \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.463249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c7f9b09-7900-4538-a8ea-e2c079ca4272-etc-machine-id\") pod \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.463299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-scripts\") pod \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.463346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-combined-ca-bundle\") pod \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\" (UID: \"1c7f9b09-7900-4538-a8ea-e2c079ca4272\") " Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.463458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1c7f9b09-7900-4538-a8ea-e2c079ca4272-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1c7f9b09-7900-4538-a8ea-e2c079ca4272" (UID: "1c7f9b09-7900-4538-a8ea-e2c079ca4272"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.463817 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1c7f9b09-7900-4538-a8ea-e2c079ca4272-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.470657 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1c7f9b09-7900-4538-a8ea-e2c079ca4272" (UID: "1c7f9b09-7900-4538-a8ea-e2c079ca4272"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.470786 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7f9b09-7900-4538-a8ea-e2c079ca4272-kube-api-access-68gvv" (OuterVolumeSpecName: "kube-api-access-68gvv") pod "1c7f9b09-7900-4538-a8ea-e2c079ca4272" (UID: "1c7f9b09-7900-4538-a8ea-e2c079ca4272"). InnerVolumeSpecName "kube-api-access-68gvv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.470778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-scripts" (OuterVolumeSpecName: "scripts") pod "1c7f9b09-7900-4538-a8ea-e2c079ca4272" (UID: "1c7f9b09-7900-4538-a8ea-e2c079ca4272"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.522908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c7f9b09-7900-4538-a8ea-e2c079ca4272" (UID: "1c7f9b09-7900-4538-a8ea-e2c079ca4272"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.565330 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68gvv\" (UniqueName: \"kubernetes.io/projected/1c7f9b09-7900-4538-a8ea-e2c079ca4272-kube-api-access-68gvv\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.565385 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.565403 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.565421 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.571507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data" (OuterVolumeSpecName: "config-data") pod "1c7f9b09-7900-4538-a8ea-e2c079ca4272" (UID: "1c7f9b09-7900-4538-a8ea-e2c079ca4272"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.667426 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c7f9b09-7900-4538-a8ea-e2c079ca4272-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.863568 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.863516 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1c7f9b09-7900-4538-a8ea-e2c079ca4272","Type":"ContainerDied","Data":"8a1ac9c957414318726a113c2c721361134e2791f809b2b3d2cd304e938dc5ba"} Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.864645 4769 scope.go:117] "RemoveContainer" containerID="d857dadadc9278112c5ae0a4cc681e8bff15900f45d353d9bb513bab2b808f14" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.902300 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.911655 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.914939 4769 scope.go:117] "RemoveContainer" containerID="1051419b90ee506aa1de64ab87a0f1c888c2ef0a395d8cef0fdf686b6f2a7a6c" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.928944 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:54 crc kubenswrapper[4769]: E1121 13:23:54.929357 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="probe" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="probe" Nov 21 13:23:54 crc kubenswrapper[4769]: E1121 13:23:54.929401 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="cinder-scheduler" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929408 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="cinder-scheduler" Nov 21 13:23:54 crc kubenswrapper[4769]: E1121 13:23:54.929423 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api-log" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929429 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api-log" Nov 21 13:23:54 crc kubenswrapper[4769]: E1121 13:23:54.929452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929459 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929629 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="cinder-scheduler" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929644 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" containerName="probe" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929662 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.929681 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ec4cb1b-bd5e-4dc1-8ecf-5e16e3079f8c" containerName="barbican-api-log" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.933740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.941668 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:54 crc kubenswrapper[4769]: I1121 13:23:54.951954 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-scheduler-config-data" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.074889 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/00ca8158-c10b-4e37-b666-6610ba3113f2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.075054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.075106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.075263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-scripts\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.075448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4g9\" (UniqueName: \"kubernetes.io/projected/00ca8158-c10b-4e37-b666-6610ba3113f2-kube-api-access-wc4g9\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.075604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.177815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.177915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/00ca8158-c10b-4e37-b666-6610ba3113f2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.177948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.177982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.178050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/00ca8158-c10b-4e37-b666-6610ba3113f2-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.178061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-scripts\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.178213 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4g9\" (UniqueName: \"kubernetes.io/projected/00ca8158-c10b-4e37-b666-6610ba3113f2-kube-api-access-wc4g9\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.181985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.182141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.182388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-scripts\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.187004 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.199715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4g9\" (UniqueName: \"kubernetes.io/projected/00ca8158-c10b-4e37-b666-6610ba3113f2-kube-api-access-wc4g9\") pod \"cinder-scheduler-0\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.268890 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.295358 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7f9b09-7900-4538-a8ea-e2c079ca4272" path="/var/lib/kubelet/pods/1c7f9b09-7900-4538-a8ea-e2c079ca4272/volumes" Nov 21 13:23:55 crc kubenswrapper[4769]: W1121 13:23:55.787162 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00ca8158_c10b_4e37_b666_6610ba3113f2.slice/crio-02970a4cd74f47f789bd917c7d77dc67892f3c132473a6a7b06a29a9dd3c170d WatchSource:0}: Error finding container 02970a4cd74f47f789bd917c7d77dc67892f3c132473a6a7b06a29a9dd3c170d: Status 404 returned error can't find the container with id 02970a4cd74f47f789bd917c7d77dc67892f3c132473a6a7b06a29a9dd3c170d Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.794867 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:23:55 crc kubenswrapper[4769]: I1121 13:23:55.884011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"00ca8158-c10b-4e37-b666-6610ba3113f2","Type":"ContainerStarted","Data":"02970a4cd74f47f789bd917c7d77dc67892f3c132473a6a7b06a29a9dd3c170d"} Nov 21 13:23:56 crc kubenswrapper[4769]: I1121 13:23:56.898411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"00ca8158-c10b-4e37-b666-6610ba3113f2","Type":"ContainerStarted","Data":"c6d239fc1939be310f5bcd366fc6fdf9ec2dbd5126149f75ac259820c40d6b2f"} Nov 21 13:23:56 crc kubenswrapper[4769]: I1121 13:23:56.901103 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerID="6d16a6f77f4fcbb1c51a564730ca8f4c94717543d34560db7af961b221396aae" exitCode=0 Nov 21 13:23:56 crc kubenswrapper[4769]: I1121 13:23:56.901143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerDied","Data":"6d16a6f77f4fcbb1c51a564730ca8f4c94717543d34560db7af961b221396aae"} Nov 21 13:23:57 crc kubenswrapper[4769]: I1121 13:23:57.914756 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"00ca8158-c10b-4e37-b666-6610ba3113f2","Type":"ContainerStarted","Data":"f64d2bc57c57a71190be05e671bb1c457619526945c17ab314e1f5b71413d4a2"} Nov 21 13:23:57 crc kubenswrapper[4769]: I1121 13:23:57.935351 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.935328566 podStartE2EDuration="3.935328566s" podCreationTimestamp="2025-11-21 13:23:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:23:57.929988767 +0000 UTC m=+5596.630650585" watchObservedRunningTime="2025-11-21 13:23:57.935328566 +0000 UTC m=+5596.635990384" Nov 21 13:23:58 crc kubenswrapper[4769]: I1121 13:23:58.341863 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:23:58 crc kubenswrapper[4769]: I1121 13:23:58.926762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerStarted","Data":"7816ad0b851748876e61122f15cebac749c1e28046b9ee9b798fb2e74a691bdd"} Nov 21 13:23:58 crc kubenswrapper[4769]: I1121 13:23:58.946259 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-tthkp" podStartSLOduration=2.993457543 podStartE2EDuration="10.946239729s" podCreationTimestamp="2025-11-21 13:23:48 +0000 UTC" firstStartedPulling="2025-11-21 13:23:49.766078951 +0000 UTC m=+5588.466740799" lastFinishedPulling="2025-11-21 13:23:57.718861167 +0000 UTC m=+5596.419522985" observedRunningTime="2025-11-21 13:23:58.943911808 +0000 UTC m=+5597.644573626" watchObservedRunningTime="2025-11-21 13:23:58.946239729 +0000 UTC m=+5597.646901557" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.269482 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.657463 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.659120 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.661909 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-config-secret" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.662239 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-config" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.662266 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstackclient-openstackclient-dockercfg-n2qvl" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.671036 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.799982 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config-secret\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.800093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhvs\" (UniqueName: \"kubernetes.io/projected/9377cea3-e509-437e-b857-e60fb24f9570-kube-api-access-rbhvs\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.800525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.800687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.902202 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config-secret\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.902254 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhvs\" (UniqueName: \"kubernetes.io/projected/9377cea3-e509-437e-b857-e60fb24f9570-kube-api-access-rbhvs\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.902299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.902370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.903938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.912671 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-combined-ca-bundle\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.917252 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config-secret\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.919028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhvs\" (UniqueName: \"kubernetes.io/projected/9377cea3-e509-437e-b857-e60fb24f9570-kube-api-access-rbhvs\") pod \"openstackclient\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:00 crc kubenswrapper[4769]: I1121 13:24:00.992294 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:24:01 crc kubenswrapper[4769]: I1121 13:24:01.468781 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:24:01 crc kubenswrapper[4769]: W1121 13:24:01.472168 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9377cea3_e509_437e_b857_e60fb24f9570.slice/crio-37eedcb9aac504deb9c786acfaaf25bca71d638c47a39c62675bb92b63be3936 WatchSource:0}: Error finding container 37eedcb9aac504deb9c786acfaaf25bca71d638c47a39c62675bb92b63be3936: Status 404 returned error can't find the container with id 37eedcb9aac504deb9c786acfaaf25bca71d638c47a39c62675bb92b63be3936 Nov 21 13:24:01 crc kubenswrapper[4769]: I1121 13:24:01.984971 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"9377cea3-e509-437e-b857-e60fb24f9570","Type":"ContainerStarted","Data":"a7a9e9c182706899fd81f119e340a8b9ac071b17d6858f5b6b34121651f3f41f"} Nov 21 13:24:01 crc kubenswrapper[4769]: I1121 13:24:01.985363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"9377cea3-e509-437e-b857-e60fb24f9570","Type":"ContainerStarted","Data":"37eedcb9aac504deb9c786acfaaf25bca71d638c47a39c62675bb92b63be3936"} Nov 21 13:24:03 crc kubenswrapper[4769]: I1121 13:24:03.043540 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=3.043523435 podStartE2EDuration="3.043523435s" podCreationTimestamp="2025-11-21 13:24:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:03.043036292 +0000 UTC m=+5601.743698120" watchObservedRunningTime="2025-11-21 13:24:03.043523435 +0000 UTC m=+5601.744185253" Nov 21 13:24:05 crc kubenswrapper[4769]: I1121 13:24:05.497885 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.245854 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt"] Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.247314 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.252048 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-internal-svc" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.252338 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-swift-public-svc" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.253296 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"swift-proxy-config-data" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.280671 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt"] Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.426257 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-public-tls-certs\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.426740 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-config-data\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.426894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-log-httpd\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.427095 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-internal-tls-certs\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.427253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-etc-swift\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.427400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-combined-ca-bundle\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.427599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-run-httpd\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.427643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxfn\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-kube-api-access-hwxfn\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530292 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-internal-tls-certs\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-etc-swift\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530485 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-combined-ca-bundle\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530544 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-run-httpd\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530624 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxfn\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-kube-api-access-hwxfn\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-public-tls-certs\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.530993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-config-data\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.531049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-log-httpd\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.532007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-log-httpd\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.533759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-run-httpd\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.538964 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-config-data\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.540165 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-public-tls-certs\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.540555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-etc-swift\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.549491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-internal-tls-certs\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.550661 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-combined-ca-bundle\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.571087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxfn\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-kube-api-access-hwxfn\") pod \"swift-proxy-79fd8485b-brhmt\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:06 crc kubenswrapper[4769]: I1121 13:24:06.575994 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:07 crc kubenswrapper[4769]: I1121 13:24:07.087717 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt"] Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.046464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" event={"ID":"2aa088d3-53a0-4016-87ac-59358c5b2d35","Type":"ContainerStarted","Data":"801a5a2e0ae9c34058bc621dfe0405dfcb878e7285d4e358124dc8a802c16f4f"} Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.047134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" event={"ID":"2aa088d3-53a0-4016-87ac-59358c5b2d35","Type":"ContainerStarted","Data":"5adac2918490b2e7c46769264c7951b0c8e6a236d35988472255847e24f782a3"} Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.047390 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.047417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" event={"ID":"2aa088d3-53a0-4016-87ac-59358c5b2d35","Type":"ContainerStarted","Data":"902522ab3cb768e4093c49215431e8362c9d5f7ba2a50b64eff5bb5b7196d883"} Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.047443 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.084349 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" podStartSLOduration=2.0843292350000002 podStartE2EDuration="2.084329235s" podCreationTimestamp="2025-11-21 13:24:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:08.067781957 +0000 UTC m=+5606.768443815" watchObservedRunningTime="2025-11-21 13:24:08.084329235 +0000 UTC m=+5606.784991063" Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.855426 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.855482 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:24:08 crc kubenswrapper[4769]: I1121 13:24:08.914622 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.138805 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.236695 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-tthkp"] Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.369580 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.370347 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-central-agent" containerID="cri-o://6cbfa81ba28502803eae6ae681dd9006ee2b9c28ac33c099fd119ef49f56af0c" gracePeriod=30 Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.370384 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="proxy-httpd" containerID="cri-o://5a93cda2bfd3f52cf324bf45bfef559e34319f0f34996395f70d850b91f766b1" gracePeriod=30 Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.370457 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-notification-agent" containerID="cri-o://914110a10d13b5e5b382f8c7aefeab074f41fe7249ba7d5e34ebdc0607e94632" gracePeriod=30 Nov 21 13:24:09 crc kubenswrapper[4769]: I1121 13:24:09.370384 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="sg-core" containerID="cri-o://6990482a8b26fde6aa719c7386df6b8248fe96fe7922d2e3dd6bc5923515ea13" gracePeriod=30 Nov 21 13:24:10 crc kubenswrapper[4769]: I1121 13:24:10.069311 4769 generic.go:334] "Generic (PLEG): container finished" podID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerID="5a93cda2bfd3f52cf324bf45bfef559e34319f0f34996395f70d850b91f766b1" exitCode=0 Nov 21 13:24:10 crc kubenswrapper[4769]: I1121 13:24:10.069348 4769 generic.go:334] "Generic (PLEG): container finished" podID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerID="6990482a8b26fde6aa719c7386df6b8248fe96fe7922d2e3dd6bc5923515ea13" exitCode=2 Nov 21 13:24:10 crc kubenswrapper[4769]: I1121 13:24:10.069360 4769 generic.go:334] "Generic (PLEG): container finished" podID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerID="6cbfa81ba28502803eae6ae681dd9006ee2b9c28ac33c099fd119ef49f56af0c" exitCode=0 Nov 21 13:24:10 crc kubenswrapper[4769]: I1121 13:24:10.069763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerDied","Data":"5a93cda2bfd3f52cf324bf45bfef559e34319f0f34996395f70d850b91f766b1"} Nov 21 13:24:10 crc kubenswrapper[4769]: I1121 13:24:10.069933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerDied","Data":"6990482a8b26fde6aa719c7386df6b8248fe96fe7922d2e3dd6bc5923515ea13"} Nov 21 13:24:10 crc kubenswrapper[4769]: I1121 13:24:10.070074 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerDied","Data":"6cbfa81ba28502803eae6ae681dd9006ee2b9c28ac33c099fd119ef49f56af0c"} Nov 21 13:24:11 crc kubenswrapper[4769]: I1121 13:24:11.080695 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-tthkp" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="registry-server" containerID="cri-o://7816ad0b851748876e61122f15cebac749c1e28046b9ee9b798fb2e74a691bdd" gracePeriod=2 Nov 21 13:24:11 crc kubenswrapper[4769]: I1121 13:24:11.325407 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:24:11 crc kubenswrapper[4769]: I1121 13:24:11.325570 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.106088 4769 generic.go:334] "Generic (PLEG): container finished" podID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerID="914110a10d13b5e5b382f8c7aefeab074f41fe7249ba7d5e34ebdc0607e94632" exitCode=0 Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.106142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerDied","Data":"914110a10d13b5e5b382f8c7aefeab074f41fe7249ba7d5e34ebdc0607e94632"} Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.827805 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.957795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-sg-core-conf-yaml\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.958230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-config-data\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.958279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-scripts\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.958309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-log-httpd\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.958338 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-run-httpd\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.958525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-combined-ca-bundle\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.958560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pt78\" (UniqueName: \"kubernetes.io/projected/e980ebee-a906-4b0d-9c10-89f163d7d0da-kube-api-access-8pt78\") pod \"e980ebee-a906-4b0d-9c10-89f163d7d0da\" (UID: \"e980ebee-a906-4b0d-9c10-89f163d7d0da\") " Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.959072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.959522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.964056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-scripts" (OuterVolumeSpecName: "scripts") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.977559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e980ebee-a906-4b0d-9c10-89f163d7d0da-kube-api-access-8pt78" (OuterVolumeSpecName: "kube-api-access-8pt78") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "kube-api-access-8pt78". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:12 crc kubenswrapper[4769]: I1121 13:24:12.993558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.031332 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.051397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-config-data" (OuterVolumeSpecName: "config-data") pod "e980ebee-a906-4b0d-9c10-89f163d7d0da" (UID: "e980ebee-a906-4b0d-9c10-89f163d7d0da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060632 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060675 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060689 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060708 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e980ebee-a906-4b0d-9c10-89f163d7d0da-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060721 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060738 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8pt78\" (UniqueName: \"kubernetes.io/projected/e980ebee-a906-4b0d-9c10-89f163d7d0da-kube-api-access-8pt78\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.060750 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e980ebee-a906-4b0d-9c10-89f163d7d0da-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.118341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e980ebee-a906-4b0d-9c10-89f163d7d0da","Type":"ContainerDied","Data":"6aa0412e5355ae511efff2c89270a038a779fa0d6c78dd9e97e5c6b91fc137af"} Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.118406 4769 scope.go:117] "RemoveContainer" containerID="5a93cda2bfd3f52cf324bf45bfef559e34319f0f34996395f70d850b91f766b1" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.118636 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.135851 4769 generic.go:334] "Generic (PLEG): container finished" podID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerID="7816ad0b851748876e61122f15cebac749c1e28046b9ee9b798fb2e74a691bdd" exitCode=0 Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.135939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerDied","Data":"7816ad0b851748876e61122f15cebac749c1e28046b9ee9b798fb2e74a691bdd"} Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.184221 4769 scope.go:117] "RemoveContainer" containerID="6990482a8b26fde6aa719c7386df6b8248fe96fe7922d2e3dd6bc5923515ea13" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.198390 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.214469 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.217366 4769 scope.go:117] "RemoveContainer" containerID="914110a10d13b5e5b382f8c7aefeab074f41fe7249ba7d5e34ebdc0607e94632" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.223665 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:13 crc kubenswrapper[4769]: E1121 13:24:13.224153 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="proxy-httpd" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224170 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="proxy-httpd" Nov 21 13:24:13 crc kubenswrapper[4769]: E1121 13:24:13.224204 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-notification-agent" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224213 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-notification-agent" Nov 21 13:24:13 crc kubenswrapper[4769]: E1121 13:24:13.224235 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-central-agent" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224243 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-central-agent" Nov 21 13:24:13 crc kubenswrapper[4769]: E1121 13:24:13.224263 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="sg-core" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="sg-core" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224487 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="sg-core" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224508 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-notification-agent" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224527 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="proxy-httpd" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.224541 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" containerName="ceilometer-central-agent" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.234092 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.234401 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.236605 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.236777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.240869 4769 scope.go:117] "RemoveContainer" containerID="6cbfa81ba28502803eae6ae681dd9006ee2b9c28ac33c099fd119ef49f56af0c" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.294666 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e980ebee-a906-4b0d-9c10-89f163d7d0da" path="/var/lib/kubelet/pods/e980ebee-a906-4b0d-9c10-89f163d7d0da/volumes" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-scripts\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-run-httpd\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366571 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vjt4\" (UniqueName: \"kubernetes.io/projected/8d13be1c-beab-41aa-bb2d-1c51808eeaca-kube-api-access-7vjt4\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-config-data\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.366743 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-log-httpd\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.436320 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.468791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-scripts\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.468843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-run-httpd\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.468901 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.468938 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7vjt4\" (UniqueName: \"kubernetes.io/projected/8d13be1c-beab-41aa-bb2d-1c51808eeaca-kube-api-access-7vjt4\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.469097 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-config-data\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.469497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-run-httpd\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.469553 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.469662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-log-httpd\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.470164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-log-httpd\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.476705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.477183 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-scripts\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.484092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.488262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-config-data\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.489838 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vjt4\" (UniqueName: \"kubernetes.io/projected/8d13be1c-beab-41aa-bb2d-1c51808eeaca-kube-api-access-7vjt4\") pod \"ceilometer-0\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.557134 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.570888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-utilities\") pod \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.571069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f558b\" (UniqueName: \"kubernetes.io/projected/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-kube-api-access-f558b\") pod \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.571107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-catalog-content\") pod \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\" (UID: \"5bd30e73-6c05-4d55-bc7e-21dee790c4f3\") " Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.571952 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-utilities" (OuterVolumeSpecName: "utilities") pod "5bd30e73-6c05-4d55-bc7e-21dee790c4f3" (UID: "5bd30e73-6c05-4d55-bc7e-21dee790c4f3"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.574256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-kube-api-access-f558b" (OuterVolumeSpecName: "kube-api-access-f558b") pod "5bd30e73-6c05-4d55-bc7e-21dee790c4f3" (UID: "5bd30e73-6c05-4d55-bc7e-21dee790c4f3"). InnerVolumeSpecName "kube-api-access-f558b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.619110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "5bd30e73-6c05-4d55-bc7e-21dee790c4f3" (UID: "5bd30e73-6c05-4d55-bc7e-21dee790c4f3"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.674004 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f558b\" (UniqueName: \"kubernetes.io/projected/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-kube-api-access-f558b\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.674037 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:13 crc kubenswrapper[4769]: I1121 13:24:13.674048 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5bd30e73-6c05-4d55-bc7e-21dee790c4f3-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.027060 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:14 crc kubenswrapper[4769]: W1121 13:24:14.032940 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d13be1c_beab_41aa_bb2d_1c51808eeaca.slice/crio-052fd9d72f499bbdbc201713befd9b824ec03e2900650d95753c7bc4f577424d WatchSource:0}: Error finding container 052fd9d72f499bbdbc201713befd9b824ec03e2900650d95753c7bc4f577424d: Status 404 returned error can't find the container with id 052fd9d72f499bbdbc201713befd9b824ec03e2900650d95753c7bc4f577424d Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.165693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-tthkp" event={"ID":"5bd30e73-6c05-4d55-bc7e-21dee790c4f3","Type":"ContainerDied","Data":"f28a557eadf7a9fe21d7ba7640605431d570a28da651a4a76c802beb9af1680f"} Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.165757 4769 scope.go:117] "RemoveContainer" containerID="7816ad0b851748876e61122f15cebac749c1e28046b9ee9b798fb2e74a691bdd" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.165967 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-tthkp" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.195492 4769 generic.go:334] "Generic (PLEG): container finished" podID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerID="ab967e4784d9bbb86001c2dc3755f84a2b0579e75d0ff2971d922f865118d822" exitCode=137 Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.195582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"aff25ca1-897f-4a5a-ad64-c65770ff1162","Type":"ContainerDied","Data":"ab967e4784d9bbb86001c2dc3755f84a2b0579e75d0ff2971d922f865118d822"} Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.198458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerStarted","Data":"052fd9d72f499bbdbc201713befd9b824ec03e2900650d95753c7bc4f577424d"} Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.233031 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-tthkp"] Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.238091 4769 scope.go:117] "RemoveContainer" containerID="6d16a6f77f4fcbb1c51a564730ca8f4c94717543d34560db7af961b221396aae" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.243789 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-tthkp"] Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.280987 4769 scope.go:117] "RemoveContainer" containerID="1eac9550f18c3efe8d7e7bc76722444c617ef5a0fc783cd7a40394bdb53a03aa" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.374323 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509211 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/aff25ca1-897f-4a5a-ad64-c65770ff1162-logs\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ms89\" (UniqueName: \"kubernetes.io/projected/aff25ca1-897f-4a5a-ad64-c65770ff1162-kube-api-access-5ms89\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data-custom\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/aff25ca1-897f-4a5a-ad64-c65770ff1162-etc-machine-id\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-scripts\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509536 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/aff25ca1-897f-4a5a-ad64-c65770ff1162-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-combined-ca-bundle\") pod \"aff25ca1-897f-4a5a-ad64-c65770ff1162\" (UID: \"aff25ca1-897f-4a5a-ad64-c65770ff1162\") " Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.509725 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff25ca1-897f-4a5a-ad64-c65770ff1162-logs" (OuterVolumeSpecName: "logs") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.510037 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/aff25ca1-897f-4a5a-ad64-c65770ff1162-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.510064 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/aff25ca1-897f-4a5a-ad64-c65770ff1162-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.515984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff25ca1-897f-4a5a-ad64-c65770ff1162-kube-api-access-5ms89" (OuterVolumeSpecName: "kube-api-access-5ms89") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "kube-api-access-5ms89". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.519304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.519331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-scripts" (OuterVolumeSpecName: "scripts") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.543141 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.564497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data" (OuterVolumeSpecName: "config-data") pod "aff25ca1-897f-4a5a-ad64-c65770ff1162" (UID: "aff25ca1-897f-4a5a-ad64-c65770ff1162"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.611388 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.611430 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.611442 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5ms89\" (UniqueName: \"kubernetes.io/projected/aff25ca1-897f-4a5a-ad64-c65770ff1162-kube-api-access-5ms89\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.611455 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:14 crc kubenswrapper[4769]: I1121 13:24:14.611467 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/aff25ca1-897f-4a5a-ad64-c65770ff1162-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.108414 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-6jmtc"] Nov 21 13:24:15 crc kubenswrapper[4769]: E1121 13:24:15.109326 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="extract-content" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109348 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="extract-content" Nov 21 13:24:15 crc kubenswrapper[4769]: E1121 13:24:15.109365 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="extract-utilities" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109373 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="extract-utilities" Nov 21 13:24:15 crc kubenswrapper[4769]: E1121 13:24:15.109391 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="registry-server" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109398 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="registry-server" Nov 21 13:24:15 crc kubenswrapper[4769]: E1121 13:24:15.109438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api-log" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109446 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api-log" Nov 21 13:24:15 crc kubenswrapper[4769]: E1121 13:24:15.109460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109467 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109668 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" containerName="registry-server" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109690 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.109722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" containerName="cinder-api-log" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.114139 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.125540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-6jmtc"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.210457 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"aff25ca1-897f-4a5a-ad64-c65770ff1162","Type":"ContainerDied","Data":"709d2f97ae9b2a35d1ca27795ca357fbb226fcd5086dba291cf28e863e8ef8cc"} Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.210498 4769 scope.go:117] "RemoveContainer" containerID="ab967e4784d9bbb86001c2dc3755f84a2b0579e75d0ff2971d922f865118d822" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.210621 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.222584 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9df536c6-9ff2-4b84-b5df-cb59a9d18215-operator-scripts\") pod \"nova-api-db-create-6jmtc\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.222627 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6ht6\" (UniqueName: \"kubernetes.io/projected/9df536c6-9ff2-4b84-b5df-cb59a9d18215-kube-api-access-d6ht6\") pod \"nova-api-db-create-6jmtc\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.324313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9df536c6-9ff2-4b84-b5df-cb59a9d18215-operator-scripts\") pod \"nova-api-db-create-6jmtc\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.324357 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d6ht6\" (UniqueName: \"kubernetes.io/projected/9df536c6-9ff2-4b84-b5df-cb59a9d18215-kube-api-access-d6ht6\") pod \"nova-api-db-create-6jmtc\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.325301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9df536c6-9ff2-4b84-b5df-cb59a9d18215-operator-scripts\") pod \"nova-api-db-create-6jmtc\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.348608 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd30e73-6c05-4d55-bc7e-21dee790c4f3" path="/var/lib/kubelet/pods/5bd30e73-6c05-4d55-bc7e-21dee790c4f3/volumes" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.357962 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6ht6\" (UniqueName: \"kubernetes.io/projected/9df536c6-9ff2-4b84-b5df-cb59a9d18215-kube-api-access-d6ht6\") pod \"nova-api-db-create-6jmtc\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.358717 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-10ec-account-create-5544k"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.360030 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.367623 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-db-secret" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.383167 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-10ec-account-create-5544k"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.398785 4769 scope.go:117] "RemoveContainer" containerID="0b4d6b1b7d81f166adf2fab745750bacc52260bb09ecdce977356897bc5ce869" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.424362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.448302 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.469325 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.476372 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.478345 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-internal-svc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.490876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cinder-api-config-data" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.491045 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-cinder-public-svc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.502093 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-t94wk"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.503365 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.525605 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.527635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qrtb\" (UniqueName: \"kubernetes.io/projected/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-kube-api-access-8qrtb\") pod \"nova-api-10ec-account-create-5544k\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.527711 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-operator-scripts\") pod \"nova-api-10ec-account-create-5544k\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.532381 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-t94wk"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.539780 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mmrgq"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.541293 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.547865 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.549018 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.550839 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-db-secret" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.562529 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mmrgq"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.581570 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.587546 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.628890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.628933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.628969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8qrtb\" (UniqueName: \"kubernetes.io/projected/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-kube-api-access-8qrtb\") pod \"nova-api-10ec-account-create-5544k\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.628990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data-custom\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629050 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qfs5\" (UniqueName: \"kubernetes.io/projected/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-kube-api-access-2qfs5\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpll7\" (UniqueName: \"kubernetes.io/projected/b46d04b9-5ec1-493b-a455-fc811117ee73-kube-api-access-gpll7\") pod \"nova-cell0-726e-account-create-x7j6g\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629099 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46d04b9-5ec1-493b-a455-fc811117ee73-operator-scripts\") pod \"nova-cell0-726e-account-create-x7j6g\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629124 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af43989f-54b8-4793-873f-466b61eadf51-operator-scripts\") pod \"nova-cell1-db-create-mmrgq\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629144 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-operator-scripts\") pod \"nova-api-10ec-account-create-5544k\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629203 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-logs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vbr\" (UniqueName: \"kubernetes.io/projected/af43989f-54b8-4793-873f-466b61eadf51-kube-api-access-r4vbr\") pod \"nova-cell1-db-create-mmrgq\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dxvx\" (UniqueName: \"kubernetes.io/projected/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-kube-api-access-5dxvx\") pod \"nova-cell0-db-create-t94wk\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-scripts\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629322 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.629345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-operator-scripts\") pod \"nova-cell0-db-create-t94wk\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.631099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-operator-scripts\") pod \"nova-api-10ec-account-create-5544k\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.649151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qrtb\" (UniqueName: \"kubernetes.io/projected/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-kube-api-access-8qrtb\") pod \"nova-api-10ec-account-create-5544k\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.712231 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.714230 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.716763 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-db-secret" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.722240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24"] Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731073 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data-custom\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2qfs5\" (UniqueName: \"kubernetes.io/projected/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-kube-api-access-2qfs5\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gpll7\" (UniqueName: \"kubernetes.io/projected/b46d04b9-5ec1-493b-a455-fc811117ee73-kube-api-access-gpll7\") pod \"nova-cell0-726e-account-create-x7j6g\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46d04b9-5ec1-493b-a455-fc811117ee73-operator-scripts\") pod \"nova-cell0-726e-account-create-x7j6g\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af43989f-54b8-4793-873f-466b61eadf51-operator-scripts\") pod \"nova-cell1-db-create-mmrgq\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731237 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-logs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vbr\" (UniqueName: \"kubernetes.io/projected/af43989f-54b8-4793-873f-466b61eadf51-kube-api-access-r4vbr\") pod \"nova-cell1-db-create-mmrgq\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5dxvx\" (UniqueName: \"kubernetes.io/projected/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-kube-api-access-5dxvx\") pod \"nova-cell0-db-create-t94wk\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-scripts\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.731385 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-operator-scripts\") pod \"nova-cell0-db-create-t94wk\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.732020 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-operator-scripts\") pod \"nova-cell0-db-create-t94wk\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.732071 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.732316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-logs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.732633 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af43989f-54b8-4793-873f-466b61eadf51-operator-scripts\") pod \"nova-cell1-db-create-mmrgq\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.733833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46d04b9-5ec1-493b-a455-fc811117ee73-operator-scripts\") pod \"nova-cell0-726e-account-create-x7j6g\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.735082 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-scripts\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.736884 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.740378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.753280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.753284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpll7\" (UniqueName: \"kubernetes.io/projected/b46d04b9-5ec1-493b-a455-fc811117ee73-kube-api-access-gpll7\") pod \"nova-cell0-726e-account-create-x7j6g\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.754030 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.756304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dxvx\" (UniqueName: \"kubernetes.io/projected/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-kube-api-access-5dxvx\") pod \"nova-cell0-db-create-t94wk\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.759839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vbr\" (UniqueName: \"kubernetes.io/projected/af43989f-54b8-4793-873f-466b61eadf51-kube-api-access-r4vbr\") pod \"nova-cell1-db-create-mmrgq\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.760472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qfs5\" (UniqueName: \"kubernetes.io/projected/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-kube-api-access-2qfs5\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.764655 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data-custom\") pod \"cinder-api-0\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.815559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.828332 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.832518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqxt\" (UniqueName: \"kubernetes.io/projected/80e1c737-c744-40d7-9514-9883a3fecad1-kube-api-access-btqxt\") pod \"nova-cell1-d462-account-create-m8s24\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.832613 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80e1c737-c744-40d7-9514-9883a3fecad1-operator-scripts\") pod \"nova-cell1-d462-account-create-m8s24\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.892579 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.926651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.932868 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.934371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-btqxt\" (UniqueName: \"kubernetes.io/projected/80e1c737-c744-40d7-9514-9883a3fecad1-kube-api-access-btqxt\") pod \"nova-cell1-d462-account-create-m8s24\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.934781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80e1c737-c744-40d7-9514-9883a3fecad1-operator-scripts\") pod \"nova-cell1-d462-account-create-m8s24\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.935622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80e1c737-c744-40d7-9514-9883a3fecad1-operator-scripts\") pod \"nova-cell1-d462-account-create-m8s24\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:15 crc kubenswrapper[4769]: I1121 13:24:15.959745 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqxt\" (UniqueName: \"kubernetes.io/projected/80e1c737-c744-40d7-9514-9883a3fecad1-kube-api-access-btqxt\") pod \"nova-cell1-d462-account-create-m8s24\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.035256 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.042655 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-6jmtc"] Nov 21 13:24:16 crc kubenswrapper[4769]: W1121 13:24:16.105065 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df536c6_9ff2_4b84_b5df_cb59a9d18215.slice/crio-05c0f514e101c574dc4bda2a0c63c638bc57fb80c0bc1735218bb5526d09dee7 WatchSource:0}: Error finding container 05c0f514e101c574dc4bda2a0c63c638bc57fb80c0bc1735218bb5526d09dee7: Status 404 returned error can't find the container with id 05c0f514e101c574dc4bda2a0c63c638bc57fb80c0bc1735218bb5526d09dee7 Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.128053 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.128297 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-log" containerID="cri-o://a0d8a82c7051a5f9776967b5994f3d787ddcaed1cb184a30dad2fb917d8e737f" gracePeriod=30 Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.128391 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-httpd" containerID="cri-o://2667be75f935aef6130ccadf531dd892125c2c9ad950da48c6606293c6bedd4d" gracePeriod=30 Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.241744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" event={"ID":"9df536c6-9ff2-4b84-b5df-cb59a9d18215","Type":"ContainerStarted","Data":"05c0f514e101c574dc4bda2a0c63c638bc57fb80c0bc1735218bb5526d09dee7"} Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.249114 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerStarted","Data":"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25"} Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.314366 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-10ec-account-create-5544k"] Nov 21 13:24:16 crc kubenswrapper[4769]: W1121 13:24:16.340029 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc43a72a1_6d90_4f99_a7d1_41cf8e343bb3.slice/crio-aa9649e27b036dc67432ec8c20ab5bc785adb411245dfdeb04c7673abceeadb6 WatchSource:0}: Error finding container aa9649e27b036dc67432ec8c20ab5bc785adb411245dfdeb04c7673abceeadb6: Status 404 returned error can't find the container with id aa9649e27b036dc67432ec8c20ab5bc785adb411245dfdeb04c7673abceeadb6 Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.357010 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:24:16 crc kubenswrapper[4769]: W1121 13:24:16.391082 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ce1f400_1f9f_4ab6_8ac9_ea5d0615fd7f.slice/crio-6a79c1e7cc01323dffe1064f9bdc25915ac4591df97676fde186f1edbcaf1e74 WatchSource:0}: Error finding container 6a79c1e7cc01323dffe1064f9bdc25915ac4591df97676fde186f1edbcaf1e74: Status 404 returned error can't find the container with id 6a79c1e7cc01323dffe1064f9bdc25915ac4591df97676fde186f1edbcaf1e74 Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.581740 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.583232 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.614509 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mmrgq"] Nov 21 13:24:16 crc kubenswrapper[4769]: W1121 13:24:16.627210 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf43989f_54b8_4793_873f_466b61eadf51.slice/crio-8476c09810565db4701d8093c8964cc53a6795b81496847c49269e7ca3f9be7d WatchSource:0}: Error finding container 8476c09810565db4701d8093c8964cc53a6795b81496847c49269e7ca3f9be7d: Status 404 returned error can't find the container with id 8476c09810565db4701d8093c8964cc53a6795b81496847c49269e7ca3f9be7d Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.701056 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-t94wk"] Nov 21 13:24:16 crc kubenswrapper[4769]: W1121 13:24:16.719182 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e0bc4f7_dff2_4d22_ab55_3232f6fdb259.slice/crio-af608694d639c2f12f5b2c0b49e25132035c7214a0f40e0eb2e705ed5cf61ed2 WatchSource:0}: Error finding container af608694d639c2f12f5b2c0b49e25132035c7214a0f40e0eb2e705ed5cf61ed2: Status 404 returned error can't find the container with id af608694d639c2f12f5b2c0b49e25132035c7214a0f40e0eb2e705ed5cf61ed2 Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.723743 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g"] Nov 21 13:24:16 crc kubenswrapper[4769]: I1121 13:24:16.739926 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24"] Nov 21 13:24:16 crc kubenswrapper[4769]: W1121 13:24:16.801291 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80e1c737_c744_40d7_9514_9883a3fecad1.slice/crio-670c0ba25f3633cbbe4b3133d1f381f58b1a77ec7fa607dbd20b4eae3946077f WatchSource:0}: Error finding container 670c0ba25f3633cbbe4b3133d1f381f58b1a77ec7fa607dbd20b4eae3946077f: Status 404 returned error can't find the container with id 670c0ba25f3633cbbe4b3133d1f381f58b1a77ec7fa607dbd20b4eae3946077f Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.283379 4769 generic.go:334] "Generic (PLEG): container finished" podID="8067105d-fdc5-496a-9687-ea7fba144743" containerID="a0d8a82c7051a5f9776967b5994f3d787ddcaed1cb184a30dad2fb917d8e737f" exitCode=143 Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.299351 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff25ca1-897f-4a5a-ad64-c65770ff1162" path="/var/lib/kubelet/pods/aff25ca1-897f-4a5a-ad64-c65770ff1162/volumes" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.305590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"8067105d-fdc5-496a-9687-ea7fba144743","Type":"ContainerDied","Data":"a0d8a82c7051a5f9776967b5994f3d787ddcaed1cb184a30dad2fb917d8e737f"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.307952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" event={"ID":"80e1c737-c744-40d7-9514-9883a3fecad1","Type":"ContainerStarted","Data":"0b078a6a9935ea3ebb49c2656e7fa2f96c992333f51efedf1ab87fe48d7f65d4"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.308157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" event={"ID":"80e1c737-c744-40d7-9514-9883a3fecad1","Type":"ContainerStarted","Data":"670c0ba25f3633cbbe4b3133d1f381f58b1a77ec7fa607dbd20b4eae3946077f"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.309354 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f","Type":"ContainerStarted","Data":"53038e30829e3e1c73043a67ac6c92fecd76e095a9ac67e5c78d14d1a099763c"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.309433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f","Type":"ContainerStarted","Data":"6a79c1e7cc01323dffe1064f9bdc25915ac4591df97676fde186f1edbcaf1e74"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.311201 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" event={"ID":"9df536c6-9ff2-4b84-b5df-cb59a9d18215","Type":"ContainerStarted","Data":"9a3f3fc6300e1fb4b3801f7035c005d1a20e4dfffda72c535482a8a93be7b2e7"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.313894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" event={"ID":"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259","Type":"ContainerStarted","Data":"047bda7c2b045be3dbf51477ebf4c2a99d35ee73c160d621262b1cd7eb842910"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.313921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" event={"ID":"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259","Type":"ContainerStarted","Data":"af608694d639c2f12f5b2c0b49e25132035c7214a0f40e0eb2e705ed5cf61ed2"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.323943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" event={"ID":"af43989f-54b8-4793-873f-466b61eadf51","Type":"ContainerStarted","Data":"510cbdebfb1ff5a0015362db6a913954199bb4089aaa4dee916fa8dd02b07d5d"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.323988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" event={"ID":"af43989f-54b8-4793-873f-466b61eadf51","Type":"ContainerStarted","Data":"8476c09810565db4701d8093c8964cc53a6795b81496847c49269e7ca3f9be7d"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.331853 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" event={"ID":"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3","Type":"ContainerStarted","Data":"93f7d4a7522445d06442ec143288d32c058ae426d7d46111b1b7372c33dfa86f"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.331899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" event={"ID":"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3","Type":"ContainerStarted","Data":"aa9649e27b036dc67432ec8c20ab5bc785adb411245dfdeb04c7673abceeadb6"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.333587 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" podStartSLOduration=2.333563262 podStartE2EDuration="2.333563262s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:17.323986583 +0000 UTC m=+5616.024648401" watchObservedRunningTime="2025-11-21 13:24:17.333563262 +0000 UTC m=+5616.034225080" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.340773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" event={"ID":"b46d04b9-5ec1-493b-a455-fc811117ee73","Type":"ContainerStarted","Data":"987cafdb073ad0e42a9431c56b3a70ebe0c5b03175714202b811c1620dbb3877"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.340927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" event={"ID":"b46d04b9-5ec1-493b-a455-fc811117ee73","Type":"ContainerStarted","Data":"d321f149ed022a4b42d3175a78c94bfd69cda8cb549390539b599ee34eb62403"} Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.344527 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" podStartSLOduration=2.344508585 podStartE2EDuration="2.344508585s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:17.334800804 +0000 UTC m=+5616.035462622" watchObservedRunningTime="2025-11-21 13:24:17.344508585 +0000 UTC m=+5616.045170403" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.361045 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" podStartSLOduration=2.3610278129999998 podStartE2EDuration="2.361027813s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:17.351870776 +0000 UTC m=+5616.052532604" watchObservedRunningTime="2025-11-21 13:24:17.361027813 +0000 UTC m=+5616.061689631" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.376208 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" podStartSLOduration=2.376178606 podStartE2EDuration="2.376178606s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:17.364169665 +0000 UTC m=+5616.064831483" watchObservedRunningTime="2025-11-21 13:24:17.376178606 +0000 UTC m=+5616.076840434" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.396591 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" podStartSLOduration=2.396567454 podStartE2EDuration="2.396567454s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:17.390669531 +0000 UTC m=+5616.091331409" watchObservedRunningTime="2025-11-21 13:24:17.396567454 +0000 UTC m=+5616.097229282" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.418921 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" podStartSLOduration=2.418898113 podStartE2EDuration="2.418898113s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:17.406588244 +0000 UTC m=+5616.107250062" watchObservedRunningTime="2025-11-21 13:24:17.418898113 +0000 UTC m=+5616.119559941" Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.775993 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.776313 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-log" containerID="cri-o://8382848fbfe153f4d42cf2f5b79786927fc3410074b27bb4775d8e829bec5e07" gracePeriod=30 Nov 21 13:24:17 crc kubenswrapper[4769]: I1121 13:24:17.776376 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-httpd" containerID="cri-o://3c169290cfcc7523a06e3f4b57928f8e228b6c58975946280505f93af4d539a5" gracePeriod=30 Nov 21 13:24:18 crc kubenswrapper[4769]: E1121 13:24:18.121867 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e0bc4f7_dff2_4d22_ab55_3232f6fdb259.slice/crio-conmon-047bda7c2b045be3dbf51477ebf4c2a99d35ee73c160d621262b1cd7eb842910.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e0bc4f7_dff2_4d22_ab55_3232f6fdb259.slice/crio-047bda7c2b045be3dbf51477ebf4c2a99d35ee73c160d621262b1cd7eb842910.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.351593 4769 generic.go:334] "Generic (PLEG): container finished" podID="b46d04b9-5ec1-493b-a455-fc811117ee73" containerID="987cafdb073ad0e42a9431c56b3a70ebe0c5b03175714202b811c1620dbb3877" exitCode=0 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.351695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" event={"ID":"b46d04b9-5ec1-493b-a455-fc811117ee73","Type":"ContainerDied","Data":"987cafdb073ad0e42a9431c56b3a70ebe0c5b03175714202b811c1620dbb3877"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.353460 4769 generic.go:334] "Generic (PLEG): container finished" podID="80e1c737-c744-40d7-9514-9883a3fecad1" containerID="0b078a6a9935ea3ebb49c2656e7fa2f96c992333f51efedf1ab87fe48d7f65d4" exitCode=0 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.353523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" event={"ID":"80e1c737-c744-40d7-9514-9883a3fecad1","Type":"ContainerDied","Data":"0b078a6a9935ea3ebb49c2656e7fa2f96c992333f51efedf1ab87fe48d7f65d4"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.356257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f","Type":"ContainerStarted","Data":"a5ac62d77120b0c9972bb763b1099bfe3f2232cca9e8ce39e1255eaa67c20acf"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.356408 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.358227 4769 generic.go:334] "Generic (PLEG): container finished" podID="3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" containerID="047bda7c2b045be3dbf51477ebf4c2a99d35ee73c160d621262b1cd7eb842910" exitCode=0 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.358296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" event={"ID":"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259","Type":"ContainerDied","Data":"047bda7c2b045be3dbf51477ebf4c2a99d35ee73c160d621262b1cd7eb842910"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.359923 4769 generic.go:334] "Generic (PLEG): container finished" podID="c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" containerID="93f7d4a7522445d06442ec143288d32c058ae426d7d46111b1b7372c33dfa86f" exitCode=0 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.359989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" event={"ID":"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3","Type":"ContainerDied","Data":"93f7d4a7522445d06442ec143288d32c058ae426d7d46111b1b7372c33dfa86f"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.361902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerStarted","Data":"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.363406 4769 generic.go:334] "Generic (PLEG): container finished" podID="9df536c6-9ff2-4b84-b5df-cb59a9d18215" containerID="9a3f3fc6300e1fb4b3801f7035c005d1a20e4dfffda72c535482a8a93be7b2e7" exitCode=0 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.363460 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" event={"ID":"9df536c6-9ff2-4b84-b5df-cb59a9d18215","Type":"ContainerDied","Data":"9a3f3fc6300e1fb4b3801f7035c005d1a20e4dfffda72c535482a8a93be7b2e7"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.365415 4769 generic.go:334] "Generic (PLEG): container finished" podID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerID="8382848fbfe153f4d42cf2f5b79786927fc3410074b27bb4775d8e829bec5e07" exitCode=143 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.365478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e3ac9004-704a-4634-916d-9ec129c2eea3","Type":"ContainerDied","Data":"8382848fbfe153f4d42cf2f5b79786927fc3410074b27bb4775d8e829bec5e07"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.366883 4769 generic.go:334] "Generic (PLEG): container finished" podID="af43989f-54b8-4793-873f-466b61eadf51" containerID="510cbdebfb1ff5a0015362db6a913954199bb4089aaa4dee916fa8dd02b07d5d" exitCode=0 Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.366924 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" event={"ID":"af43989f-54b8-4793-873f-466b61eadf51","Type":"ContainerDied","Data":"510cbdebfb1ff5a0015362db6a913954199bb4089aaa4dee916fa8dd02b07d5d"} Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.404041 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.404022175 podStartE2EDuration="3.404022175s" podCreationTimestamp="2025-11-21 13:24:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:18.3945815 +0000 UTC m=+5617.095243318" watchObservedRunningTime="2025-11-21 13:24:18.404022175 +0000 UTC m=+5617.104683993" Nov 21 13:24:18 crc kubenswrapper[4769]: I1121 13:24:18.566170 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.382244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerStarted","Data":"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2"} Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.384338 4769 generic.go:334] "Generic (PLEG): container finished" podID="8067105d-fdc5-496a-9687-ea7fba144743" containerID="2667be75f935aef6130ccadf531dd892125c2c9ad950da48c6606293c6bedd4d" exitCode=0 Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.384431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"8067105d-fdc5-496a-9687-ea7fba144743","Type":"ContainerDied","Data":"2667be75f935aef6130ccadf531dd892125c2c9ad950da48c6606293c6bedd4d"} Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.704029 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.812424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btqxt\" (UniqueName: \"kubernetes.io/projected/80e1c737-c744-40d7-9514-9883a3fecad1-kube-api-access-btqxt\") pod \"80e1c737-c744-40d7-9514-9883a3fecad1\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.812727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80e1c737-c744-40d7-9514-9883a3fecad1-operator-scripts\") pod \"80e1c737-c744-40d7-9514-9883a3fecad1\" (UID: \"80e1c737-c744-40d7-9514-9883a3fecad1\") " Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.813879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e1c737-c744-40d7-9514-9883a3fecad1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "80e1c737-c744-40d7-9514-9883a3fecad1" (UID: "80e1c737-c744-40d7-9514-9883a3fecad1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.818852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e1c737-c744-40d7-9514-9883a3fecad1-kube-api-access-btqxt" (OuterVolumeSpecName: "kube-api-access-btqxt") pod "80e1c737-c744-40d7-9514-9883a3fecad1" (UID: "80e1c737-c744-40d7-9514-9883a3fecad1"). InnerVolumeSpecName "kube-api-access-btqxt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.888439 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.918862 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80e1c737-c744-40d7-9514-9883a3fecad1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:19 crc kubenswrapper[4769]: I1121 13:24:19.918898 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-btqxt\" (UniqueName: \"kubernetes.io/projected/80e1c737-c744-40d7-9514-9883a3fecad1-kube-api-access-btqxt\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.010719 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.020591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-operator-scripts\") pod \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.020705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dxvx\" (UniqueName: \"kubernetes.io/projected/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-kube-api-access-5dxvx\") pod \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\" (UID: \"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.021382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" (UID: "3e0bc4f7-dff2-4d22-ab55-3232f6fdb259"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.021798 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.025530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-kube-api-access-5dxvx" (OuterVolumeSpecName: "kube-api-access-5dxvx") pod "3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" (UID: "3e0bc4f7-dff2-4d22-ab55-3232f6fdb259"). InnerVolumeSpecName "kube-api-access-5dxvx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.034776 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.044131 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.105525 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.121988 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.122431 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-operator-scripts\") pod \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.122622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpll7\" (UniqueName: \"kubernetes.io/projected/b46d04b9-5ec1-493b-a455-fc811117ee73-kube-api-access-gpll7\") pod \"b46d04b9-5ec1-493b-a455-fc811117ee73\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.122684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46d04b9-5ec1-493b-a455-fc811117ee73-operator-scripts\") pod \"b46d04b9-5ec1-493b-a455-fc811117ee73\" (UID: \"b46d04b9-5ec1-493b-a455-fc811117ee73\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.122755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qrtb\" (UniqueName: \"kubernetes.io/projected/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-kube-api-access-8qrtb\") pod \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\" (UID: \"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.122771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af43989f-54b8-4793-873f-466b61eadf51-operator-scripts\") pod \"af43989f-54b8-4793-873f-466b61eadf51\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.122791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4vbr\" (UniqueName: \"kubernetes.io/projected/af43989f-54b8-4793-873f-466b61eadf51-kube-api-access-r4vbr\") pod \"af43989f-54b8-4793-873f-466b61eadf51\" (UID: \"af43989f-54b8-4793-873f-466b61eadf51\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.123121 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5dxvx\" (UniqueName: \"kubernetes.io/projected/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259-kube-api-access-5dxvx\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.123240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46d04b9-5ec1-493b-a455-fc811117ee73-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b46d04b9-5ec1-493b-a455-fc811117ee73" (UID: "b46d04b9-5ec1-493b-a455-fc811117ee73"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.123561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af43989f-54b8-4793-873f-466b61eadf51-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "af43989f-54b8-4793-873f-466b61eadf51" (UID: "af43989f-54b8-4793-873f-466b61eadf51"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.123550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" (UID: "c43a72a1-6d90-4f99-a7d1-41cf8e343bb3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.127500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46d04b9-5ec1-493b-a455-fc811117ee73-kube-api-access-gpll7" (OuterVolumeSpecName: "kube-api-access-gpll7") pod "b46d04b9-5ec1-493b-a455-fc811117ee73" (UID: "b46d04b9-5ec1-493b-a455-fc811117ee73"). InnerVolumeSpecName "kube-api-access-gpll7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.127653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af43989f-54b8-4793-873f-466b61eadf51-kube-api-access-r4vbr" (OuterVolumeSpecName: "kube-api-access-r4vbr") pod "af43989f-54b8-4793-873f-466b61eadf51" (UID: "af43989f-54b8-4793-873f-466b61eadf51"). InnerVolumeSpecName "kube-api-access-r4vbr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.130406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-kube-api-access-8qrtb" (OuterVolumeSpecName: "kube-api-access-8qrtb") pod "c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" (UID: "c43a72a1-6d90-4f99-a7d1-41cf8e343bb3"). InnerVolumeSpecName "kube-api-access-8qrtb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.223716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9df536c6-9ff2-4b84-b5df-cb59a9d18215-operator-scripts\") pod \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224405 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df536c6-9ff2-4b84-b5df-cb59a9d18215-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9df536c6-9ff2-4b84-b5df-cb59a9d18215" (UID: "9df536c6-9ff2-4b84-b5df-cb59a9d18215"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-config-data\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224819 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-public-tls-certs\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6ht6\" (UniqueName: \"kubernetes.io/projected/9df536c6-9ff2-4b84-b5df-cb59a9d18215-kube-api-access-d6ht6\") pod \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\" (UID: \"9df536c6-9ff2-4b84-b5df-cb59a9d18215\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224907 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-scripts\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.224982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-combined-ca-bundle\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.225108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-logs\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.225126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnqpl\" (UniqueName: \"kubernetes.io/projected/8067105d-fdc5-496a-9687-ea7fba144743-kube-api-access-qnqpl\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.225148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-httpd-run\") pod \"8067105d-fdc5-496a-9687-ea7fba144743\" (UID: \"8067105d-fdc5-496a-9687-ea7fba144743\") " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226266 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9df536c6-9ff2-4b84-b5df-cb59a9d18215-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226338 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gpll7\" (UniqueName: \"kubernetes.io/projected/b46d04b9-5ec1-493b-a455-fc811117ee73-kube-api-access-gpll7\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226407 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46d04b9-5ec1-493b-a455-fc811117ee73-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226467 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8qrtb\" (UniqueName: \"kubernetes.io/projected/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-kube-api-access-8qrtb\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226528 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/af43989f-54b8-4793-873f-466b61eadf51-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226587 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r4vbr\" (UniqueName: \"kubernetes.io/projected/af43989f-54b8-4793-873f-466b61eadf51-kube-api-access-r4vbr\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226649 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-logs" (OuterVolumeSpecName: "logs") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.226890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.233827 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df536c6-9ff2-4b84-b5df-cb59a9d18215-kube-api-access-d6ht6" (OuterVolumeSpecName: "kube-api-access-d6ht6") pod "9df536c6-9ff2-4b84-b5df-cb59a9d18215" (UID: "9df536c6-9ff2-4b84-b5df-cb59a9d18215"). InnerVolumeSpecName "kube-api-access-d6ht6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.236013 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-scripts" (OuterVolumeSpecName: "scripts") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.236558 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8067105d-fdc5-496a-9687-ea7fba144743-kube-api-access-qnqpl" (OuterVolumeSpecName: "kube-api-access-qnqpl") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "kube-api-access-qnqpl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.237919 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "glance") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.276323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.282094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-config-data" (OuterVolumeSpecName: "config-data") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.293285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8067105d-fdc5-496a-9687-ea7fba144743" (UID: "8067105d-fdc5-496a-9687-ea7fba144743"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.327954 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.327989 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328012 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328022 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d6ht6\" (UniqueName: \"kubernetes.io/projected/9df536c6-9ff2-4b84-b5df-cb59a9d18215-kube-api-access-d6ht6\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328031 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328040 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8067105d-fdc5-496a-9687-ea7fba144743-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328048 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328056 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qnqpl\" (UniqueName: \"kubernetes.io/projected/8067105d-fdc5-496a-9687-ea7fba144743-kube-api-access-qnqpl\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.328065 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/8067105d-fdc5-496a-9687-ea7fba144743-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.371924 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.411434 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.412015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-6jmtc" event={"ID":"9df536c6-9ff2-4b84-b5df-cb59a9d18215","Type":"ContainerDied","Data":"05c0f514e101c574dc4bda2a0c63c638bc57fb80c0bc1735218bb5526d09dee7"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.412047 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05c0f514e101c574dc4bda2a0c63c638bc57fb80c0bc1735218bb5526d09dee7" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.421446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" event={"ID":"3e0bc4f7-dff2-4d22-ab55-3232f6fdb259","Type":"ContainerDied","Data":"af608694d639c2f12f5b2c0b49e25132035c7214a0f40e0eb2e705ed5cf61ed2"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.421499 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af608694d639c2f12f5b2c0b49e25132035c7214a0f40e0eb2e705ed5cf61ed2" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.421589 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-t94wk" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.429959 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.438108 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" event={"ID":"af43989f-54b8-4793-873f-466b61eadf51","Type":"ContainerDied","Data":"8476c09810565db4701d8093c8964cc53a6795b81496847c49269e7ca3f9be7d"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.438144 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8476c09810565db4701d8093c8964cc53a6795b81496847c49269e7ca3f9be7d" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.438310 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-mmrgq" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.441688 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" event={"ID":"c43a72a1-6d90-4f99-a7d1-41cf8e343bb3","Type":"ContainerDied","Data":"aa9649e27b036dc67432ec8c20ab5bc785adb411245dfdeb04c7673abceeadb6"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.441729 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa9649e27b036dc67432ec8c20ab5bc785adb411245dfdeb04c7673abceeadb6" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.441836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-10ec-account-create-5544k" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.453575 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerStarted","Data":"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.453750 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-central-agent" containerID="cri-o://8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" gracePeriod=30 Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.453820 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.454078 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="proxy-httpd" containerID="cri-o://cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" gracePeriod=30 Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.454175 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="sg-core" containerID="cri-o://6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" gracePeriod=30 Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.454211 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-notification-agent" containerID="cri-o://e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" gracePeriod=30 Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.459125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" event={"ID":"b46d04b9-5ec1-493b-a455-fc811117ee73","Type":"ContainerDied","Data":"d321f149ed022a4b42d3175a78c94bfd69cda8cb549390539b599ee34eb62403"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.459453 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d321f149ed022a4b42d3175a78c94bfd69cda8cb549390539b599ee34eb62403" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.459518 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.467964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"8067105d-fdc5-496a-9687-ea7fba144743","Type":"ContainerDied","Data":"2903e869e01264df211c14dd85495b39c1b526f6a8ee4b61515d23d18d288ef0"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.468095 4769 scope.go:117] "RemoveContainer" containerID="2667be75f935aef6130ccadf531dd892125c2c9ad950da48c6606293c6bedd4d" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.468012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.477634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" event={"ID":"80e1c737-c744-40d7-9514-9883a3fecad1","Type":"ContainerDied","Data":"670c0ba25f3633cbbe4b3133d1f381f58b1a77ec7fa607dbd20b4eae3946077f"} Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.477680 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="670c0ba25f3633cbbe4b3133d1f381f58b1a77ec7fa607dbd20b4eae3946077f" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.477899 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.505889 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.5371218500000001 podStartE2EDuration="7.505867522s" podCreationTimestamp="2025-11-21 13:24:13 +0000 UTC" firstStartedPulling="2025-11-21 13:24:14.035825732 +0000 UTC m=+5612.736487550" lastFinishedPulling="2025-11-21 13:24:20.004571404 +0000 UTC m=+5618.705233222" observedRunningTime="2025-11-21 13:24:20.486036488 +0000 UTC m=+5619.186698306" watchObservedRunningTime="2025-11-21 13:24:20.505867522 +0000 UTC m=+5619.206529340" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.534023 4769 scope.go:117] "RemoveContainer" containerID="a0d8a82c7051a5f9776967b5994f3d787ddcaed1cb184a30dad2fb917d8e737f" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.566227 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.587810 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.603758 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604276 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b46d04b9-5ec1-493b-a455-fc811117ee73" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604296 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46d04b9-5ec1-493b-a455-fc811117ee73" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604322 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9df536c6-9ff2-4b84-b5df-cb59a9d18215" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604330 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df536c6-9ff2-4b84-b5df-cb59a9d18215" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604352 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af43989f-54b8-4793-873f-466b61eadf51" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604359 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af43989f-54b8-4793-873f-466b61eadf51" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604372 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604379 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604409 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604418 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604436 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-log" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604445 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-log" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604459 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-httpd" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604468 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-httpd" Nov 21 13:24:20 crc kubenswrapper[4769]: E1121 13:24:20.604483 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="80e1c737-c744-40d7-9514-9883a3fecad1" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e1c737-c744-40d7-9514-9883a3fecad1" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604702 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-log" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604718 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604732 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="80e1c737-c744-40d7-9514-9883a3fecad1" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604748 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604761 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9df536c6-9ff2-4b84-b5df-cb59a9d18215" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604769 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af43989f-54b8-4793-873f-466b61eadf51" containerName="mariadb-database-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604780 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8067105d-fdc5-496a-9687-ea7fba144743" containerName="glance-httpd" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.604792 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b46d04b9-5ec1-493b-a455-fc811117ee73" containerName="mariadb-account-create" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.606057 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.612631 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-public-svc" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.623536 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-external-config-data" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.647368 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648590 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-scripts\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648729 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-logs\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-config-data\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn8jl\" (UniqueName: \"kubernetes.io/projected/f75bf156-e338-42b1-959d-83c46d7a4a6e-kube-api-access-kn8jl\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.648891 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.750743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kn8jl\" (UniqueName: \"kubernetes.io/projected/f75bf156-e338-42b1-959d-83c46d7a4a6e-kube-api-access-kn8jl\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.750875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.750924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.750975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.751002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-scripts\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.751039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.751110 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-logs\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.751147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-config-data\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.752090 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.757843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.758068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-logs\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.761757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-scripts\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.761879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.761920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.768890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn8jl\" (UniqueName: \"kubernetes.io/projected/f75bf156-e338-42b1-959d-83c46d7a4a6e-kube-api-access-kn8jl\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.775400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-config-data\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.801618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"glance-default-external-api-0\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:20 crc kubenswrapper[4769]: I1121 13:24:20.972884 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.250506 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.298612 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8067105d-fdc5-496a-9687-ea7fba144743" path="/var/lib/kubelet/pods/8067105d-fdc5-496a-9687-ea7fba144743/volumes" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.363575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-combined-ca-bundle\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.363622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-run-httpd\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.363698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vjt4\" (UniqueName: \"kubernetes.io/projected/8d13be1c-beab-41aa-bb2d-1c51808eeaca-kube-api-access-7vjt4\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.363851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-log-httpd\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.363898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-sg-core-conf-yaml\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.363981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-config-data\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.364041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-scripts\") pod \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\" (UID: \"8d13be1c-beab-41aa-bb2d-1c51808eeaca\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.364648 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.367710 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.372317 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d13be1c-beab-41aa-bb2d-1c51808eeaca-kube-api-access-7vjt4" (OuterVolumeSpecName: "kube-api-access-7vjt4") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "kube-api-access-7vjt4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.373015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-scripts" (OuterVolumeSpecName: "scripts") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.397348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.455794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.466356 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.466388 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.466400 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.466409 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.466420 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8d13be1c-beab-41aa-bb2d-1c51808eeaca-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.466429 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7vjt4\" (UniqueName: \"kubernetes.io/projected/8d13be1c-beab-41aa-bb2d-1c51808eeaca-kube-api-access-7vjt4\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.493146 4769 generic.go:334] "Generic (PLEG): container finished" podID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerID="3c169290cfcc7523a06e3f4b57928f8e228b6c58975946280505f93af4d539a5" exitCode=0 Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.493247 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e3ac9004-704a-4634-916d-9ec129c2eea3","Type":"ContainerDied","Data":"3c169290cfcc7523a06e3f4b57928f8e228b6c58975946280505f93af4d539a5"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.493298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"e3ac9004-704a-4634-916d-9ec129c2eea3","Type":"ContainerDied","Data":"be815dc372fd1e0ad460ee4e2982a5029a86aef9855270e78f37c4a220ea2f4a"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.493311 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be815dc372fd1e0ad460ee4e2982a5029a86aef9855270e78f37c4a220ea2f4a" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.494211 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-config-data" (OuterVolumeSpecName: "config-data") pod "8d13be1c-beab-41aa-bb2d-1c51808eeaca" (UID: "8d13be1c-beab-41aa-bb2d-1c51808eeaca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.496544 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" exitCode=0 Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.496729 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" exitCode=2 Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.496797 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" exitCode=0 Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.496872 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" exitCode=0 Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.496712 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.496696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerDied","Data":"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.497161 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerDied","Data":"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.497177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerDied","Data":"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.497265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerDied","Data":"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.497276 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8d13be1c-beab-41aa-bb2d-1c51808eeaca","Type":"ContainerDied","Data":"052fd9d72f499bbdbc201713befd9b824ec03e2900650d95753c7bc4f577424d"} Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.497245 4769 scope.go:117] "RemoveContainer" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.565009 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.568461 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d13be1c-beab-41aa-bb2d-1c51808eeaca-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.568871 4769 scope.go:117] "RemoveContainer" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.588521 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.606295 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.608584 4769 scope.go:117] "RemoveContainer" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627136 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.627669 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="proxy-httpd" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627688 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="proxy-httpd" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.627721 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-notification-agent" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627729 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-notification-agent" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.627745 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-httpd" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627752 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-httpd" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.627787 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-log" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627797 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-log" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.627811 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="sg-core" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627818 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="sg-core" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.627834 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-central-agent" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.627841 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-central-agent" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.628043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-central-agent" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.628061 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="sg-core" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.628073 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-httpd" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.628085 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" containerName="glance-log" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.628097 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="ceilometer-notification-agent" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.628111 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" containerName="proxy-httpd" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.630254 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.635480 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.638734 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.651437 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.661476 4769 scope.go:117] "RemoveContainer" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.670644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-logs\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.670699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-scripts\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.670803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5wjz\" (UniqueName: \"kubernetes.io/projected/e3ac9004-704a-4634-916d-9ec129c2eea3-kube-api-access-v5wjz\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.670845 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-internal-tls-certs\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.670889 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-combined-ca-bundle\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.670929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-config-data\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-httpd-run\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"e3ac9004-704a-4634-916d-9ec129c2eea3\" (UID: \"e3ac9004-704a-4634-916d-9ec129c2eea3\") " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-logs" (OuterVolumeSpecName: "logs") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-run-httpd\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpd6b\" (UniqueName: \"kubernetes.io/projected/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-kube-api-access-rpd6b\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671500 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-config-data\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671601 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-scripts\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-log-httpd\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.671801 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.672587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.676540 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.676691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.678623 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-scripts" (OuterVolumeSpecName: "scripts") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.699604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ac9004-704a-4634-916d-9ec129c2eea3-kube-api-access-v5wjz" (OuterVolumeSpecName: "kube-api-access-v5wjz") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "kube-api-access-v5wjz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.719787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.730921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.731643 4769 scope.go:117] "RemoveContainer" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.732031 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": container with ID starting with cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c not found: ID does not exist" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.732081 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c"} err="failed to get container status \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": rpc error: code = NotFound desc = could not find container \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": container with ID starting with cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.732114 4769 scope.go:117] "RemoveContainer" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.732546 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": container with ID starting with 6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2 not found: ID does not exist" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.732574 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2"} err="failed to get container status \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": rpc error: code = NotFound desc = could not find container \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": container with ID starting with 6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.732589 4769 scope.go:117] "RemoveContainer" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.733019 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": container with ID starting with e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0 not found: ID does not exist" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733049 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0"} err="failed to get container status \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": rpc error: code = NotFound desc = could not find container \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": container with ID starting with e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733072 4769 scope.go:117] "RemoveContainer" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" Nov 21 13:24:21 crc kubenswrapper[4769]: E1121 13:24:21.733336 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": container with ID starting with 8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25 not found: ID does not exist" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733355 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25"} err="failed to get container status \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": rpc error: code = NotFound desc = could not find container \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": container with ID starting with 8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733367 4769 scope.go:117] "RemoveContainer" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733680 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c"} err="failed to get container status \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": rpc error: code = NotFound desc = could not find container \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": container with ID starting with cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733702 4769 scope.go:117] "RemoveContainer" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733892 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2"} err="failed to get container status \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": rpc error: code = NotFound desc = could not find container \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": container with ID starting with 6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.733908 4769 scope.go:117] "RemoveContainer" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.734261 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0"} err="failed to get container status \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": rpc error: code = NotFound desc = could not find container \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": container with ID starting with e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.734311 4769 scope.go:117] "RemoveContainer" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.734883 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25"} err="failed to get container status \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": rpc error: code = NotFound desc = could not find container \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": container with ID starting with 8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.734939 4769 scope.go:117] "RemoveContainer" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.735858 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c"} err="failed to get container status \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": rpc error: code = NotFound desc = could not find container \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": container with ID starting with cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.735879 4769 scope.go:117] "RemoveContainer" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.736137 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2"} err="failed to get container status \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": rpc error: code = NotFound desc = could not find container \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": container with ID starting with 6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.736161 4769 scope.go:117] "RemoveContainer" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.737983 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0"} err="failed to get container status \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": rpc error: code = NotFound desc = could not find container \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": container with ID starting with e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.738005 4769 scope.go:117] "RemoveContainer" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.741159 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25"} err="failed to get container status \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": rpc error: code = NotFound desc = could not find container \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": container with ID starting with 8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.741181 4769 scope.go:117] "RemoveContainer" containerID="cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.741793 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c"} err="failed to get container status \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": rpc error: code = NotFound desc = could not find container \"cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c\": container with ID starting with cbfe0c17c5c4f32a93c8586f73cbde19eff2232bd4bf2216ae388f081b2c159c not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.741827 4769 scope.go:117] "RemoveContainer" containerID="6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.742217 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2"} err="failed to get container status \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": rpc error: code = NotFound desc = could not find container \"6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2\": container with ID starting with 6ab90f9ead92544e7477b2714275a12bb09b0ae043d6f0632c98e2bf30114af2 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.742237 4769 scope.go:117] "RemoveContainer" containerID="e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.742412 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0"} err="failed to get container status \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": rpc error: code = NotFound desc = could not find container \"e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0\": container with ID starting with e428e5b9feeae4f23585df62ff996cfb3c55badee8c3e27d23023fb6853ba7e0 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.742430 4769 scope.go:117] "RemoveContainer" containerID="8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.742659 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25"} err="failed to get container status \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": rpc error: code = NotFound desc = could not find container \"8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25\": container with ID starting with 8a076e7b675fad41f2d0d1fc4078eb7c8ef216f55122cb3b05d81bd1bfa7ff25 not found: ID does not exist" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.757499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-config-data" (OuterVolumeSpecName: "config-data") pod "e3ac9004-704a-4634-916d-9ec129c2eea3" (UID: "e3ac9004-704a-4634-916d-9ec129c2eea3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.773076 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.773477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-scripts\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.773646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-log-httpd\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.773865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-run-httpd\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rpd6b\" (UniqueName: \"kubernetes.io/projected/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-kube-api-access-rpd6b\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-config-data\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774221 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-log-httpd\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774253 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774274 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v5wjz\" (UniqueName: \"kubernetes.io/projected/e3ac9004-704a-4634-916d-9ec129c2eea3-kube-api-access-v5wjz\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774288 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774303 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774316 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e3ac9004-704a-4634-916d-9ec129c2eea3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774328 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e3ac9004-704a-4634-916d-9ec129c2eea3-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-run-httpd\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.774354 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.777818 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-scripts\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.778168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.783134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.783159 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-config-data\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.796984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpd6b\" (UniqueName: \"kubernetes.io/projected/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-kube-api-access-rpd6b\") pod \"ceilometer-0\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.802756 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.876489 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:21 crc kubenswrapper[4769]: I1121 13:24:21.956595 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.451969 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:22 crc kubenswrapper[4769]: W1121 13:24:22.456984 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fa41c8b_84f3_4d5a_984e_ce640a5f05ae.slice/crio-cf8704d08267eafcdf836f12d9e4e15f9fd600a5daa4691653fc829205fb4473 WatchSource:0}: Error finding container cf8704d08267eafcdf836f12d9e4e15f9fd600a5daa4691653fc829205fb4473: Status 404 returned error can't find the container with id cf8704d08267eafcdf836f12d9e4e15f9fd600a5daa4691653fc829205fb4473 Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.512034 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f75bf156-e338-42b1-959d-83c46d7a4a6e","Type":"ContainerStarted","Data":"657264f8ebb53a43fa5c089677968f587795d955a77f426c19143c4a6ef1df07"} Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.512092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f75bf156-e338-42b1-959d-83c46d7a4a6e","Type":"ContainerStarted","Data":"c45a4ef67cd9a55a8944bd94cf9c4b9103e70e0da358f617073a82b873d1fced"} Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.513549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerStarted","Data":"cf8704d08267eafcdf836f12d9e4e15f9fd600a5daa4691653fc829205fb4473"} Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.514793 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.545904 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.554878 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.575144 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.576993 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.582018 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"glance-default-internal-config-data" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.582280 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-glance-default-internal-svc" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.592481 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9q5z\" (UniqueName: \"kubernetes.io/projected/93f0d766-9895-4c18-9a55-b670336879a5-kube-api-access-k9q5z\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-scripts\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708616 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-config-data\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708662 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-logs\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708815 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.708847 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.810673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-logs\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811339 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9q5z\" (UniqueName: \"kubernetes.io/projected/93f0d766-9895-4c18-9a55-b670336879a5-kube-api-access-k9q5z\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-scripts\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-config-data\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-logs\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811675 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.811867 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.812792 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.815670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-scripts\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.816508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-config-data\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.817821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.820247 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.825809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9q5z\" (UniqueName: \"kubernetes.io/projected/93f0d766-9895-4c18-9a55-b670336879a5-kube-api-access-k9q5z\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.841482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"glance-default-internal-api-0\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:22 crc kubenswrapper[4769]: I1121 13:24:22.906687 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.289408 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d13be1c-beab-41aa-bb2d-1c51808eeaca" path="/var/lib/kubelet/pods/8d13be1c-beab-41aa-bb2d-1c51808eeaca/volumes" Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.290724 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ac9004-704a-4634-916d-9ec129c2eea3" path="/var/lib/kubelet/pods/e3ac9004-704a-4634-916d-9ec129c2eea3/volumes" Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.375776 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:24:23 crc kubenswrapper[4769]: W1121 13:24:23.381936 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93f0d766_9895_4c18_9a55_b670336879a5.slice/crio-cf93466f6e17844dd11db7c47f444bf3b5ea4acf24d8bdea24a131f71d6ccd0a WatchSource:0}: Error finding container cf93466f6e17844dd11db7c47f444bf3b5ea4acf24d8bdea24a131f71d6ccd0a: Status 404 returned error can't find the container with id cf93466f6e17844dd11db7c47f444bf3b5ea4acf24d8bdea24a131f71d6ccd0a Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.531383 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerStarted","Data":"c2b897536e16b74534722fe3866f1c98e48ea324bb2a6c7925fc29c40d18fd3f"} Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.532693 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93f0d766-9895-4c18-9a55-b670336879a5","Type":"ContainerStarted","Data":"cf93466f6e17844dd11db7c47f444bf3b5ea4acf24d8bdea24a131f71d6ccd0a"} Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.535468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f75bf156-e338-42b1-959d-83c46d7a4a6e","Type":"ContainerStarted","Data":"3fef85e8a624512666e3827fea3c0e9bc4b33c17eddbc5371403291aad3c527a"} Nov 21 13:24:23 crc kubenswrapper[4769]: I1121 13:24:23.571656 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.571639072 podStartE2EDuration="3.571639072s" podCreationTimestamp="2025-11-21 13:24:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:23.56461356 +0000 UTC m=+5622.265275378" watchObservedRunningTime="2025-11-21 13:24:23.571639072 +0000 UTC m=+5622.272300890" Nov 21 13:24:24 crc kubenswrapper[4769]: I1121 13:24:24.549846 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerStarted","Data":"76956e133473139126f7299214442291e2d5e3d019c0a31198fe4a5a4c20e34f"} Nov 21 13:24:24 crc kubenswrapper[4769]: I1121 13:24:24.560374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93f0d766-9895-4c18-9a55-b670336879a5","Type":"ContainerStarted","Data":"28fa00088106bd2af81ea2a135e9d01f80cdf4c35440b619adb0f417ec784fc9"} Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.573369 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerStarted","Data":"a1a30a2d59b581b75a8813d18c16ca50c00e5f05537bac3200b34d7a6e7943e0"} Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.577567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93f0d766-9895-4c18-9a55-b670336879a5","Type":"ContainerStarted","Data":"de581e699c555ad13a35e2d0fc1e302531144b8f66ce87c8d54ac8cb48bc8982"} Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.838147 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.8381197929999997 podStartE2EDuration="3.838119793s" podCreationTimestamp="2025-11-21 13:24:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:25.609942061 +0000 UTC m=+5624.310603879" watchObservedRunningTime="2025-11-21 13:24:25.838119793 +0000 UTC m=+5624.538781601" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.844169 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9"] Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.845386 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.848748 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-scripts" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.848772 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.863790 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-cl9ts" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.872893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.873462 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-scripts\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.873525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-config-data\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.873658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxr4\" (UniqueName: \"kubernetes.io/projected/f37c6c6f-0074-4c84-b898-3b4bff18cb26-kube-api-access-klxr4\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.877683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9"] Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.976071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.976161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-scripts\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.976192 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-config-data\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.976241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-klxr4\" (UniqueName: \"kubernetes.io/projected/f37c6c6f-0074-4c84-b898-3b4bff18cb26-kube-api-access-klxr4\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.981642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-config-data\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.983445 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-scripts\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.984690 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:25 crc kubenswrapper[4769]: I1121 13:24:25.993581 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxr4\" (UniqueName: \"kubernetes.io/projected/f37c6c6f-0074-4c84-b898-3b4bff18cb26-kube-api-access-klxr4\") pod \"nova-cell0-conductor-db-sync-sfvl9\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:26 crc kubenswrapper[4769]: I1121 13:24:26.173379 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:24:26 crc kubenswrapper[4769]: I1121 13:24:26.504494 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9"] Nov 21 13:24:26 crc kubenswrapper[4769]: I1121 13:24:26.598404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" event={"ID":"f37c6c6f-0074-4c84-b898-3b4bff18cb26","Type":"ContainerStarted","Data":"370958a4345c440b255ee538bee690caeafe35f99c581ece1da85425213d1ff7"} Nov 21 13:24:27 crc kubenswrapper[4769]: I1121 13:24:27.607583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" event={"ID":"f37c6c6f-0074-4c84-b898-3b4bff18cb26","Type":"ContainerStarted","Data":"fbae5a68db3b14c8d0ae0a4906efdf2061d2132564fd2335c419d8b71d43b02e"} Nov 21 13:24:27 crc kubenswrapper[4769]: I1121 13:24:27.626581 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" podStartSLOduration=2.6265568889999997 podStartE2EDuration="2.626556889s" podCreationTimestamp="2025-11-21 13:24:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:27.623047318 +0000 UTC m=+5626.323709136" watchObservedRunningTime="2025-11-21 13:24:27.626556889 +0000 UTC m=+5626.327218717" Nov 21 13:24:29 crc kubenswrapper[4769]: I1121 13:24:29.471803 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:24:29 crc kubenswrapper[4769]: I1121 13:24:29.635651 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerStarted","Data":"0b89a566aeb617f8a13055ea00accddf2de5816fc2b71b773cbf1ffac6950a8d"} Nov 21 13:24:29 crc kubenswrapper[4769]: I1121 13:24:29.636170 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:29 crc kubenswrapper[4769]: I1121 13:24:29.655006 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.665472052 podStartE2EDuration="8.654978903s" podCreationTimestamp="2025-11-21 13:24:21 +0000 UTC" firstStartedPulling="2025-11-21 13:24:22.461201311 +0000 UTC m=+5621.161863139" lastFinishedPulling="2025-11-21 13:24:28.450708152 +0000 UTC m=+5627.151369990" observedRunningTime="2025-11-21 13:24:29.654814258 +0000 UTC m=+5628.355476086" watchObservedRunningTime="2025-11-21 13:24:29.654978903 +0000 UTC m=+5628.355640721" Nov 21 13:24:30 crc kubenswrapper[4769]: I1121 13:24:30.973454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:30 crc kubenswrapper[4769]: I1121 13:24:30.974478 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:31 crc kubenswrapper[4769]: I1121 13:24:31.007524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:31 crc kubenswrapper[4769]: I1121 13:24:31.024294 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:31 crc kubenswrapper[4769]: I1121 13:24:31.657718 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:31 crc kubenswrapper[4769]: I1121 13:24:31.658049 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:32 crc kubenswrapper[4769]: I1121 13:24:32.907343 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:32 crc kubenswrapper[4769]: I1121 13:24:32.907424 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.026441 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.070353 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.523647 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.673802 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.674706 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.675245 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.830372 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.830676 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-central-agent" containerID="cri-o://c2b897536e16b74534722fe3866f1c98e48ea324bb2a6c7925fc29c40d18fd3f" gracePeriod=30 Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.830741 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="proxy-httpd" containerID="cri-o://0b89a566aeb617f8a13055ea00accddf2de5816fc2b71b773cbf1ffac6950a8d" gracePeriod=30 Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.830716 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="sg-core" containerID="cri-o://a1a30a2d59b581b75a8813d18c16ca50c00e5f05537bac3200b34d7a6e7943e0" gracePeriod=30 Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.830760 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-notification-agent" containerID="cri-o://76956e133473139126f7299214442291e2d5e3d019c0a31198fe4a5a4c20e34f" gracePeriod=30 Nov 21 13:24:33 crc kubenswrapper[4769]: I1121 13:24:33.884561 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:24:34 crc kubenswrapper[4769]: I1121 13:24:34.683078 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerID="0b89a566aeb617f8a13055ea00accddf2de5816fc2b71b773cbf1ffac6950a8d" exitCode=0 Nov 21 13:24:34 crc kubenswrapper[4769]: I1121 13:24:34.683106 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerID="a1a30a2d59b581b75a8813d18c16ca50c00e5f05537bac3200b34d7a6e7943e0" exitCode=2 Nov 21 13:24:34 crc kubenswrapper[4769]: I1121 13:24:34.683113 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerID="c2b897536e16b74534722fe3866f1c98e48ea324bb2a6c7925fc29c40d18fd3f" exitCode=0 Nov 21 13:24:34 crc kubenswrapper[4769]: I1121 13:24:34.683151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerDied","Data":"0b89a566aeb617f8a13055ea00accddf2de5816fc2b71b773cbf1ffac6950a8d"} Nov 21 13:24:34 crc kubenswrapper[4769]: I1121 13:24:34.683220 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerDied","Data":"a1a30a2d59b581b75a8813d18c16ca50c00e5f05537bac3200b34d7a6e7943e0"} Nov 21 13:24:34 crc kubenswrapper[4769]: I1121 13:24:34.683233 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerDied","Data":"c2b897536e16b74534722fe3866f1c98e48ea324bb2a6c7925fc29c40d18fd3f"} Nov 21 13:24:35 crc kubenswrapper[4769]: I1121 13:24:35.692451 4769 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Nov 21 13:24:35 crc kubenswrapper[4769]: I1121 13:24:35.692925 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:35 crc kubenswrapper[4769]: I1121 13:24:35.703231 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.705756 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerID="76956e133473139126f7299214442291e2d5e3d019c0a31198fe4a5a4c20e34f" exitCode=0 Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.705838 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerDied","Data":"76956e133473139126f7299214442291e2d5e3d019c0a31198fe4a5a4c20e34f"} Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.706227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae","Type":"ContainerDied","Data":"cf8704d08267eafcdf836f12d9e4e15f9fd600a5daa4691653fc829205fb4473"} Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.706240 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf8704d08267eafcdf836f12d9e4e15f9fd600a5daa4691653fc829205fb4473" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.740380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-config-data\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788566 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-run-httpd\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-combined-ca-bundle\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788681 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-scripts\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788739 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpd6b\" (UniqueName: \"kubernetes.io/projected/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-kube-api-access-rpd6b\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-log-httpd\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.788888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-sg-core-conf-yaml\") pod \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\" (UID: \"1fa41c8b-84f3-4d5a-984e-ce640a5f05ae\") " Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.801959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.802118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.806954 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-kube-api-access-rpd6b" (OuterVolumeSpecName: "kube-api-access-rpd6b") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "kube-api-access-rpd6b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.807223 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-scripts" (OuterVolumeSpecName: "scripts") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.847337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.892020 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.892058 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rpd6b\" (UniqueName: \"kubernetes.io/projected/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-kube-api-access-rpd6b\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.892072 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.892087 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.892099 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.898982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.917796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-config-data" (OuterVolumeSpecName: "config-data") pod "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" (UID: "1fa41c8b-84f3-4d5a-984e-ce640a5f05ae"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.994234 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:36 crc kubenswrapper[4769]: I1121 13:24:36.994272 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.716790 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.751722 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.762658 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.779503 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:37 crc kubenswrapper[4769]: E1121 13:24:37.780065 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-notification-agent" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780094 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-notification-agent" Nov 21 13:24:37 crc kubenswrapper[4769]: E1121 13:24:37.780120 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="sg-core" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780128 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="sg-core" Nov 21 13:24:37 crc kubenswrapper[4769]: E1121 13:24:37.780145 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-central-agent" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780153 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-central-agent" Nov 21 13:24:37 crc kubenswrapper[4769]: E1121 13:24:37.780180 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="proxy-httpd" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780207 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="proxy-httpd" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780498 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="sg-core" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780535 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-central-agent" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780555 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="proxy-httpd" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.780573 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" containerName="ceilometer-notification-agent" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.782835 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.789047 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.789425 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.810849 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.910915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-run-httpd\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.910976 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.910995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.911017 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-scripts\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.911112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh82z\" (UniqueName: \"kubernetes.io/projected/68d15023-6ab0-4a79-9db8-a57775097fdb-kube-api-access-hh82z\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.911272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-config-data\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:37 crc kubenswrapper[4769]: I1121 13:24:37.911317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-log-httpd\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-config-data\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013257 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-log-httpd\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-run-httpd\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013414 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-scripts\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.013467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hh82z\" (UniqueName: \"kubernetes.io/projected/68d15023-6ab0-4a79-9db8-a57775097fdb-kube-api-access-hh82z\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.014904 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-log-httpd\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.015369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-run-httpd\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.020683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-scripts\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.027823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-config-data\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.028101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.030132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.032067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh82z\" (UniqueName: \"kubernetes.io/projected/68d15023-6ab0-4a79-9db8-a57775097fdb-kube-api-access-hh82z\") pod \"ceilometer-0\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.118352 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.621916 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:38 crc kubenswrapper[4769]: I1121 13:24:38.726494 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerStarted","Data":"d7084dd3943e9a20f98584f5207e7fca594d0aeedf4b68e3e9059dcb0f6e22d4"} Nov 21 13:24:39 crc kubenswrapper[4769]: I1121 13:24:39.295431 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa41c8b-84f3-4d5a-984e-ce640a5f05ae" path="/var/lib/kubelet/pods/1fa41c8b-84f3-4d5a-984e-ce640a5f05ae/volumes" Nov 21 13:24:39 crc kubenswrapper[4769]: I1121 13:24:39.736792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerStarted","Data":"4a5072229fba932454d186e23371505a8056af20a6dbf5c0ef4bcb780cdbd72a"} Nov 21 13:24:40 crc kubenswrapper[4769]: I1121 13:24:40.746679 4769 generic.go:334] "Generic (PLEG): container finished" podID="abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" containerID="51fa27bf5185af42d96749f1c1646e10b496d74f5e164127ba90189d401e2542" exitCode=0 Nov 21 13:24:40 crc kubenswrapper[4769]: I1121 13:24:40.746764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" event={"ID":"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf","Type":"ContainerDied","Data":"51fa27bf5185af42d96749f1c1646e10b496d74f5e164127ba90189d401e2542"} Nov 21 13:24:40 crc kubenswrapper[4769]: I1121 13:24:40.749156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerStarted","Data":"c97e0a982bb48eca70114251b79a6db12bb32528339b05314d74b618af878c46"} Nov 21 13:24:41 crc kubenswrapper[4769]: I1121 13:24:41.325811 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:24:41 crc kubenswrapper[4769]: I1121 13:24:41.325873 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:24:41 crc kubenswrapper[4769]: I1121 13:24:41.762349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerStarted","Data":"6dbaa3e84a4ef4291b8e973432abb02dfcbfd5e4ded4f0cbfb4d10c9c46ada9c"} Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.130688 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.249714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2gcn\" (UniqueName: \"kubernetes.io/projected/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-kube-api-access-q2gcn\") pod \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.250207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-combined-ca-bundle\") pod \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.250323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-config\") pod \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\" (UID: \"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf\") " Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.263447 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-kube-api-access-q2gcn" (OuterVolumeSpecName: "kube-api-access-q2gcn") pod "abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" (UID: "abb0643a-6cf9-4f43-b2ff-a872f3ee0faf"). InnerVolumeSpecName "kube-api-access-q2gcn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.289499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" (UID: "abb0643a-6cf9-4f43-b2ff-a872f3ee0faf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.292426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-config" (OuterVolumeSpecName: "config") pod "abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" (UID: "abb0643a-6cf9-4f43-b2ff-a872f3ee0faf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.352363 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q2gcn\" (UniqueName: \"kubernetes.io/projected/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-kube-api-access-q2gcn\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.352917 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.352954 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.776440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerStarted","Data":"b0b832287d268eb24269b447ee0e70c1284dbc57c144195dbcd9521e83988cc8"} Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.776617 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.780534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" event={"ID":"abb0643a-6cf9-4f43-b2ff-a872f3ee0faf","Type":"ContainerDied","Data":"d5265044b4f82c9e0605e6dd6b5625379245027edf57110c6f743f5482a2c43d"} Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.780830 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5265044b4f82c9e0605e6dd6b5625379245027edf57110c6f743f5482a2c43d" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.780838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-6vqlq" Nov 21 13:24:42 crc kubenswrapper[4769]: I1121 13:24:42.832045 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9315430980000001 podStartE2EDuration="5.832023384s" podCreationTimestamp="2025-11-21 13:24:37 +0000 UTC" firstStartedPulling="2025-11-21 13:24:38.628296821 +0000 UTC m=+5637.328958639" lastFinishedPulling="2025-11-21 13:24:42.528777107 +0000 UTC m=+5641.229438925" observedRunningTime="2025-11-21 13:24:42.80987527 +0000 UTC m=+5641.510537098" watchObservedRunningTime="2025-11-21 13:24:42.832023384 +0000 UTC m=+5641.532685192" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.162362 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-54975c7c59-fn9lz"] Nov 21 13:24:43 crc kubenswrapper[4769]: E1121 13:24:43.162824 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" containerName="neutron-db-sync" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.162842 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" containerName="neutron-db-sync" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.163059 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" containerName="neutron-db-sync" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.164048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.168707 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-config" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.169029 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-httpd-config" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.169267 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-ovndbs" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.172570 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-5gq5c" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.173826 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-54975c7c59-fn9lz"] Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.271446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-combined-ca-bundle\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.271523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjl4\" (UniqueName: \"kubernetes.io/projected/457ff79d-90fb-4665-bba7-4ef9bb4368cd-kube-api-access-qrjl4\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.271555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-ovndb-tls-certs\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.271597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-config\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.271640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-httpd-config\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.373170 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-combined-ca-bundle\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.373335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjl4\" (UniqueName: \"kubernetes.io/projected/457ff79d-90fb-4665-bba7-4ef9bb4368cd-kube-api-access-qrjl4\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.373371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-ovndb-tls-certs\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.373417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-config\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.373441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-httpd-config\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.381924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-combined-ca-bundle\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.383062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-config\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.383573 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-ovndb-tls-certs\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.389447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-httpd-config\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.407444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjl4\" (UniqueName: \"kubernetes.io/projected/457ff79d-90fb-4665-bba7-4ef9bb4368cd-kube-api-access-qrjl4\") pod \"neutron-54975c7c59-fn9lz\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.501344 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-neutron-dockercfg-5gq5c" Nov 21 13:24:43 crc kubenswrapper[4769]: I1121 13:24:43.509711 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:44 crc kubenswrapper[4769]: I1121 13:24:44.029042 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-54975c7c59-fn9lz"] Nov 21 13:24:44 crc kubenswrapper[4769]: I1121 13:24:44.813874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" event={"ID":"457ff79d-90fb-4665-bba7-4ef9bb4368cd","Type":"ContainerStarted","Data":"8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf"} Nov 21 13:24:44 crc kubenswrapper[4769]: I1121 13:24:44.814264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" event={"ID":"457ff79d-90fb-4665-bba7-4ef9bb4368cd","Type":"ContainerStarted","Data":"0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc"} Nov 21 13:24:44 crc kubenswrapper[4769]: I1121 13:24:44.814278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" event={"ID":"457ff79d-90fb-4665-bba7-4ef9bb4368cd","Type":"ContainerStarted","Data":"4546abf635f69579d7aef6fc946fd04dea0763f416ff8763cfaf54fafca66c79"} Nov 21 13:24:44 crc kubenswrapper[4769]: I1121 13:24:44.814316 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:24:44 crc kubenswrapper[4769]: I1121 13:24:44.844568 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" podStartSLOduration=1.844546805 podStartE2EDuration="1.844546805s" podCreationTimestamp="2025-11-21 13:24:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:44.83932935 +0000 UTC m=+5643.539991168" watchObservedRunningTime="2025-11-21 13:24:44.844546805 +0000 UTC m=+5643.545208623" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.385421 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-b4896794-72gsv"] Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.387217 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.398305 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-internal-svc" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.398467 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-neutron-public-svc" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.416803 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-b4896794-72gsv"] Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.515090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-internal-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.515439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-ovndb-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.515563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn4zk\" (UniqueName: \"kubernetes.io/projected/222390bc-4c6c-4f69-b753-5f190e15bb6d-kube-api-access-mn4zk\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.515746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-config\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.515804 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-combined-ca-bundle\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.515871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-httpd-config\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.516013 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-public-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.617868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-ovndb-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.617920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4zk\" (UniqueName: \"kubernetes.io/projected/222390bc-4c6c-4f69-b753-5f190e15bb6d-kube-api-access-mn4zk\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.617954 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-config\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.617970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-combined-ca-bundle\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.617991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-httpd-config\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.618070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-public-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.618107 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-internal-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.624706 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-config\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.637763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-ovndb-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.637815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-internal-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.638111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-httpd-config\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.638388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-public-tls-certs\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.643051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn4zk\" (UniqueName: \"kubernetes.io/projected/222390bc-4c6c-4f69-b753-5f190e15bb6d-kube-api-access-mn4zk\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.646108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-combined-ca-bundle\") pod \"neutron-b4896794-72gsv\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:45 crc kubenswrapper[4769]: I1121 13:24:45.709648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.266558 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-b4896794-72gsv"] Nov 21 13:24:46 crc kubenswrapper[4769]: W1121 13:24:46.271862 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod222390bc_4c6c_4f69_b753_5f190e15bb6d.slice/crio-50dcda6da4738b958815f13225f8d1222e11ca6cc642f4dd350f496ed302687d WatchSource:0}: Error finding container 50dcda6da4738b958815f13225f8d1222e11ca6cc642f4dd350f496ed302687d: Status 404 returned error can't find the container with id 50dcda6da4738b958815f13225f8d1222e11ca6cc642f4dd350f496ed302687d Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.758925 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.759557 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-central-agent" containerID="cri-o://4a5072229fba932454d186e23371505a8056af20a6dbf5c0ef4bcb780cdbd72a" gracePeriod=30 Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.759594 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="sg-core" containerID="cri-o://6dbaa3e84a4ef4291b8e973432abb02dfcbfd5e4ded4f0cbfb4d10c9c46ada9c" gracePeriod=30 Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.759670 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-notification-agent" containerID="cri-o://c97e0a982bb48eca70114251b79a6db12bb32528339b05314d74b618af878c46" gracePeriod=30 Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.759696 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="proxy-httpd" containerID="cri-o://b0b832287d268eb24269b447ee0e70c1284dbc57c144195dbcd9521e83988cc8" gracePeriod=30 Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.834283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" event={"ID":"222390bc-4c6c-4f69-b753-5f190e15bb6d","Type":"ContainerStarted","Data":"92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84"} Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.834330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" event={"ID":"222390bc-4c6c-4f69-b753-5f190e15bb6d","Type":"ContainerStarted","Data":"5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb"} Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.834340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" event={"ID":"222390bc-4c6c-4f69-b753-5f190e15bb6d","Type":"ContainerStarted","Data":"50dcda6da4738b958815f13225f8d1222e11ca6cc642f4dd350f496ed302687d"} Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.834769 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:24:46 crc kubenswrapper[4769]: I1121 13:24:46.864077 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" podStartSLOduration=1.864059278 podStartE2EDuration="1.864059278s" podCreationTimestamp="2025-11-21 13:24:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:24:46.861150233 +0000 UTC m=+5645.561812051" watchObservedRunningTime="2025-11-21 13:24:46.864059278 +0000 UTC m=+5645.564721096" Nov 21 13:24:47 crc kubenswrapper[4769]: I1121 13:24:47.845812 4769 generic.go:334] "Generic (PLEG): container finished" podID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerID="b0b832287d268eb24269b447ee0e70c1284dbc57c144195dbcd9521e83988cc8" exitCode=0 Nov 21 13:24:47 crc kubenswrapper[4769]: I1121 13:24:47.846076 4769 generic.go:334] "Generic (PLEG): container finished" podID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerID="6dbaa3e84a4ef4291b8e973432abb02dfcbfd5e4ded4f0cbfb4d10c9c46ada9c" exitCode=2 Nov 21 13:24:47 crc kubenswrapper[4769]: I1121 13:24:47.846084 4769 generic.go:334] "Generic (PLEG): container finished" podID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerID="c97e0a982bb48eca70114251b79a6db12bb32528339b05314d74b618af878c46" exitCode=0 Nov 21 13:24:47 crc kubenswrapper[4769]: I1121 13:24:47.845936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerDied","Data":"b0b832287d268eb24269b447ee0e70c1284dbc57c144195dbcd9521e83988cc8"} Nov 21 13:24:47 crc kubenswrapper[4769]: I1121 13:24:47.846349 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerDied","Data":"6dbaa3e84a4ef4291b8e973432abb02dfcbfd5e4ded4f0cbfb4d10c9c46ada9c"} Nov 21 13:24:47 crc kubenswrapper[4769]: I1121 13:24:47.846363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerDied","Data":"c97e0a982bb48eca70114251b79a6db12bb32528339b05314d74b618af878c46"} Nov 21 13:24:52 crc kubenswrapper[4769]: I1121 13:24:52.906737 4769 generic.go:334] "Generic (PLEG): container finished" podID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerID="4a5072229fba932454d186e23371505a8056af20a6dbf5c0ef4bcb780cdbd72a" exitCode=0 Nov 21 13:24:52 crc kubenswrapper[4769]: I1121 13:24:52.906947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerDied","Data":"4a5072229fba932454d186e23371505a8056af20a6dbf5c0ef4bcb780cdbd72a"} Nov 21 13:24:52 crc kubenswrapper[4769]: I1121 13:24:52.990943 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049222 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-scripts\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh82z\" (UniqueName: \"kubernetes.io/projected/68d15023-6ab0-4a79-9db8-a57775097fdb-kube-api-access-hh82z\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-config-data\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-log-httpd\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-sg-core-conf-yaml\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-run-httpd\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.049616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-combined-ca-bundle\") pod \"68d15023-6ab0-4a79-9db8-a57775097fdb\" (UID: \"68d15023-6ab0-4a79-9db8-a57775097fdb\") " Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.050460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.050475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.061508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d15023-6ab0-4a79-9db8-a57775097fdb-kube-api-access-hh82z" (OuterVolumeSpecName: "kube-api-access-hh82z") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "kube-api-access-hh82z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.094364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-scripts" (OuterVolumeSpecName: "scripts") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.106330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.134747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.151557 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.151588 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.151600 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.151610 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hh82z\" (UniqueName: \"kubernetes.io/projected/68d15023-6ab0-4a79-9db8-a57775097fdb-kube-api-access-hh82z\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.151619 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/68d15023-6ab0-4a79-9db8-a57775097fdb-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.151627 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.184054 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-config-data" (OuterVolumeSpecName: "config-data") pod "68d15023-6ab0-4a79-9db8-a57775097fdb" (UID: "68d15023-6ab0-4a79-9db8-a57775097fdb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.253680 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/68d15023-6ab0-4a79-9db8-a57775097fdb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.919090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"68d15023-6ab0-4a79-9db8-a57775097fdb","Type":"ContainerDied","Data":"d7084dd3943e9a20f98584f5207e7fca594d0aeedf4b68e3e9059dcb0f6e22d4"} Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.919155 4769 scope.go:117] "RemoveContainer" containerID="b0b832287d268eb24269b447ee0e70c1284dbc57c144195dbcd9521e83988cc8" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.920789 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.947675 4769 scope.go:117] "RemoveContainer" containerID="6dbaa3e84a4ef4291b8e973432abb02dfcbfd5e4ded4f0cbfb4d10c9c46ada9c" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.958646 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.971622 4769 scope.go:117] "RemoveContainer" containerID="c97e0a982bb48eca70114251b79a6db12bb32528339b05314d74b618af878c46" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.972373 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.982444 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:53 crc kubenswrapper[4769]: E1121 13:24:53.983282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="proxy-httpd" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983302 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="proxy-httpd" Nov 21 13:24:53 crc kubenswrapper[4769]: E1121 13:24:53.983311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-central-agent" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983319 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-central-agent" Nov 21 13:24:53 crc kubenswrapper[4769]: E1121 13:24:53.983332 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="sg-core" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983339 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="sg-core" Nov 21 13:24:53 crc kubenswrapper[4769]: E1121 13:24:53.983375 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-notification-agent" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983382 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-notification-agent" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983548 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="proxy-httpd" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983568 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="sg-core" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983608 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-central-agent" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.983621 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" containerName="ceilometer-notification-agent" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.986062 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.989032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.989636 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:24:53 crc kubenswrapper[4769]: I1121 13:24:53.999555 4769 scope.go:117] "RemoveContainer" containerID="4a5072229fba932454d186e23371505a8056af20a6dbf5c0ef4bcb780cdbd72a" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.004134 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-log-httpd\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-run-httpd\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44c55\" (UniqueName: \"kubernetes.io/projected/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-kube-api-access-44c55\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-config-data\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-scripts\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.067551 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.169793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-log-httpd\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.169870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-run-httpd\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.169906 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-44c55\" (UniqueName: \"kubernetes.io/projected/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-kube-api-access-44c55\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.169931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.169967 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-config-data\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.170007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-scripts\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.170077 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.171606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-log-httpd\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.171931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-run-httpd\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.174809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.175760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-config-data\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.176442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.178452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-scripts\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.190266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-44c55\" (UniqueName: \"kubernetes.io/projected/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-kube-api-access-44c55\") pod \"ceilometer-0\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.310471 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.793565 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:24:54 crc kubenswrapper[4769]: I1121 13:24:54.931752 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerStarted","Data":"401022e430f4465e36f825a383f7f5a247ce762872dd40fe0b35965f37c3c681"} Nov 21 13:24:55 crc kubenswrapper[4769]: I1121 13:24:55.288744 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d15023-6ab0-4a79-9db8-a57775097fdb" path="/var/lib/kubelet/pods/68d15023-6ab0-4a79-9db8-a57775097fdb/volumes" Nov 21 13:24:55 crc kubenswrapper[4769]: I1121 13:24:55.942571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerStarted","Data":"39f3f8e9c7b7b9116e29d6342f20bff7ff20bb2f128c6576652cfdc422203f11"} Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.798556 4769 scope.go:117] "RemoveContainer" containerID="7f9377333fa47ffea5425ae287e8ffba676c5d8221d4572416218df149e39ca6" Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.893484 4769 scope.go:117] "RemoveContainer" containerID="fe1fcf32b913741fbb85d265f70f54f729b43e9983930764a838ce5da2686049" Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.917521 4769 scope.go:117] "RemoveContainer" containerID="88eb6797b61d829add320d5ea7df7e1f33f647ef6846c80e60633477279e763f" Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.951473 4769 scope.go:117] "RemoveContainer" containerID="e991cfdde50e0d34344ef1d28dce5d785fb1c206390149bdc35472789d300198" Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.967680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerStarted","Data":"dba55d2ec714ff33f5b07b001c518e75bfaa08844a2010350ababa139584f98a"} Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.978854 4769 scope.go:117] "RemoveContainer" containerID="72792839254bf7731df15dd19d9d305d2eff2a9cee51cc5b5a26951ea992142b" Nov 21 13:24:56 crc kubenswrapper[4769]: I1121 13:24:56.997364 4769 scope.go:117] "RemoveContainer" containerID="06a75e0677f1dcc1fbf428a860eb06bb61a926c253a642c284ae5006fe5ada50" Nov 21 13:24:57 crc kubenswrapper[4769]: I1121 13:24:57.031849 4769 scope.go:117] "RemoveContainer" containerID="418cae4cbab2263e5231f263abb5327311931af72a389f0fcd0e83592d4ebefb" Nov 21 13:24:57 crc kubenswrapper[4769]: I1121 13:24:57.978501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerStarted","Data":"2543ef18051849a319ab105af8fc9cc7d437b57c3b7c633a3a1b0e67577ef044"} Nov 21 13:24:58 crc kubenswrapper[4769]: I1121 13:24:58.992552 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerStarted","Data":"c6181391c23abdc93692d37a07446b1cdaeaef1cd08780388715759fce24ea52"} Nov 21 13:24:58 crc kubenswrapper[4769]: I1121 13:24:58.993287 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:24:59 crc kubenswrapper[4769]: I1121 13:24:59.016054 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.487339776 podStartE2EDuration="6.01603291s" podCreationTimestamp="2025-11-21 13:24:53 +0000 UTC" firstStartedPulling="2025-11-21 13:24:54.798693654 +0000 UTC m=+5653.499355482" lastFinishedPulling="2025-11-21 13:24:58.327386798 +0000 UTC m=+5657.028048616" observedRunningTime="2025-11-21 13:24:59.009116121 +0000 UTC m=+5657.709777949" watchObservedRunningTime="2025-11-21 13:24:59.01603291 +0000 UTC m=+5657.716694718" Nov 21 13:24:59 crc kubenswrapper[4769]: I1121 13:24:59.224228 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:01 crc kubenswrapper[4769]: I1121 13:25:01.018877 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-central-agent" containerID="cri-o://39f3f8e9c7b7b9116e29d6342f20bff7ff20bb2f128c6576652cfdc422203f11" gracePeriod=30 Nov 21 13:25:01 crc kubenswrapper[4769]: I1121 13:25:01.018913 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="proxy-httpd" containerID="cri-o://c6181391c23abdc93692d37a07446b1cdaeaef1cd08780388715759fce24ea52" gracePeriod=30 Nov 21 13:25:01 crc kubenswrapper[4769]: I1121 13:25:01.018922 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="sg-core" containerID="cri-o://2543ef18051849a319ab105af8fc9cc7d437b57c3b7c633a3a1b0e67577ef044" gracePeriod=30 Nov 21 13:25:01 crc kubenswrapper[4769]: I1121 13:25:01.018958 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-notification-agent" containerID="cri-o://dba55d2ec714ff33f5b07b001c518e75bfaa08844a2010350ababa139584f98a" gracePeriod=30 Nov 21 13:25:02 crc kubenswrapper[4769]: I1121 13:25:02.041106 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerID="c6181391c23abdc93692d37a07446b1cdaeaef1cd08780388715759fce24ea52" exitCode=0 Nov 21 13:25:02 crc kubenswrapper[4769]: I1121 13:25:02.041249 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerDied","Data":"c6181391c23abdc93692d37a07446b1cdaeaef1cd08780388715759fce24ea52"} Nov 21 13:25:03 crc kubenswrapper[4769]: I1121 13:25:03.055420 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerID="2543ef18051849a319ab105af8fc9cc7d437b57c3b7c633a3a1b0e67577ef044" exitCode=2 Nov 21 13:25:03 crc kubenswrapper[4769]: I1121 13:25:03.055728 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerID="dba55d2ec714ff33f5b07b001c518e75bfaa08844a2010350ababa139584f98a" exitCode=0 Nov 21 13:25:03 crc kubenswrapper[4769]: I1121 13:25:03.055632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerDied","Data":"2543ef18051849a319ab105af8fc9cc7d437b57c3b7c633a3a1b0e67577ef044"} Nov 21 13:25:03 crc kubenswrapper[4769]: I1121 13:25:03.055762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerDied","Data":"dba55d2ec714ff33f5b07b001c518e75bfaa08844a2010350ababa139584f98a"} Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.106841 4769 generic.go:334] "Generic (PLEG): container finished" podID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerID="39f3f8e9c7b7b9116e29d6342f20bff7ff20bb2f128c6576652cfdc422203f11" exitCode=0 Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.106897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerDied","Data":"39f3f8e9c7b7b9116e29d6342f20bff7ff20bb2f128c6576652cfdc422203f11"} Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.627385 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-scripts\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-combined-ca-bundle\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823424 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44c55\" (UniqueName: \"kubernetes.io/projected/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-kube-api-access-44c55\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-config-data\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-run-httpd\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-log-httpd\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.823700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-sg-core-conf-yaml\") pod \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\" (UID: \"1c5eecd5-8cec-4d72-8913-9f9b76e848ff\") " Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.824025 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.824323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.829504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-scripts" (OuterVolumeSpecName: "scripts") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.830645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-kube-api-access-44c55" (OuterVolumeSpecName: "kube-api-access-44c55") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "kube-api-access-44c55". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.851464 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.926071 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.926106 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.926117 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-44c55\" (UniqueName: \"kubernetes.io/projected/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-kube-api-access-44c55\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.926128 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.926136 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.936665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-config-data" (OuterVolumeSpecName: "config-data") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:06 crc kubenswrapper[4769]: I1121 13:25:06.967669 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1c5eecd5-8cec-4d72-8913-9f9b76e848ff" (UID: "1c5eecd5-8cec-4d72-8913-9f9b76e848ff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.027522 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.027557 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1c5eecd5-8cec-4d72-8913-9f9b76e848ff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.120443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1c5eecd5-8cec-4d72-8913-9f9b76e848ff","Type":"ContainerDied","Data":"401022e430f4465e36f825a383f7f5a247ce762872dd40fe0b35965f37c3c681"} Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.120522 4769 scope.go:117] "RemoveContainer" containerID="c6181391c23abdc93692d37a07446b1cdaeaef1cd08780388715759fce24ea52" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.120530 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.149001 4769 scope.go:117] "RemoveContainer" containerID="2543ef18051849a319ab105af8fc9cc7d437b57c3b7c633a3a1b0e67577ef044" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.176587 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.176718 4769 scope.go:117] "RemoveContainer" containerID="dba55d2ec714ff33f5b07b001c518e75bfaa08844a2010350ababa139584f98a" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.185444 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.198396 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:07 crc kubenswrapper[4769]: E1121 13:25:07.198855 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-notification-agent" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.198874 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-notification-agent" Nov 21 13:25:07 crc kubenswrapper[4769]: E1121 13:25:07.198888 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-central-agent" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.198895 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-central-agent" Nov 21 13:25:07 crc kubenswrapper[4769]: E1121 13:25:07.198926 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="proxy-httpd" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.198934 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="proxy-httpd" Nov 21 13:25:07 crc kubenswrapper[4769]: E1121 13:25:07.198942 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="sg-core" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.198949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="sg-core" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.199176 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-central-agent" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.199217 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="ceilometer-notification-agent" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.199230 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="sg-core" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.199248 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" containerName="proxy-httpd" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.201285 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.203876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.204137 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.207077 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.207937 4769 scope.go:117] "RemoveContainer" containerID="39f3f8e9c7b7b9116e29d6342f20bff7ff20bb2f128c6576652cfdc422203f11" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkjv4\" (UniqueName: \"kubernetes.io/projected/66767ea3-4f4a-4680-87e9-17651cd5a3ac-kube-api-access-jkjv4\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-scripts\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-log-httpd\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-config-data\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-run-httpd\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.232450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.285121 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5eecd5-8cec-4d72-8913-9f9b76e848ff" path="/var/lib/kubelet/pods/1c5eecd5-8cec-4d72-8913-9f9b76e848ff/volumes" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-config-data\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333441 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-run-httpd\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jkjv4\" (UniqueName: \"kubernetes.io/projected/66767ea3-4f4a-4680-87e9-17651cd5a3ac-kube-api-access-jkjv4\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333594 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-scripts\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.333623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-log-httpd\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.334042 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-log-httpd\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.334172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-run-httpd\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.338779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-scripts\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.339515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-config-data\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.340778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.341498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.355234 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkjv4\" (UniqueName: \"kubernetes.io/projected/66767ea3-4f4a-4680-87e9-17651cd5a3ac-kube-api-access-jkjv4\") pod \"ceilometer-0\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:07 crc kubenswrapper[4769]: I1121 13:25:07.519110 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:08 crc kubenswrapper[4769]: I1121 13:25:08.035419 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:08 crc kubenswrapper[4769]: W1121 13:25:08.040570 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66767ea3_4f4a_4680_87e9_17651cd5a3ac.slice/crio-e30b4acef97ec19fb06e9d671a7746f7a1c98d909e88cd3d44f015aaa5a7b651 WatchSource:0}: Error finding container e30b4acef97ec19fb06e9d671a7746f7a1c98d909e88cd3d44f015aaa5a7b651: Status 404 returned error can't find the container with id e30b4acef97ec19fb06e9d671a7746f7a1c98d909e88cd3d44f015aaa5a7b651 Nov 21 13:25:08 crc kubenswrapper[4769]: I1121 13:25:08.132571 4769 generic.go:334] "Generic (PLEG): container finished" podID="f37c6c6f-0074-4c84-b898-3b4bff18cb26" containerID="fbae5a68db3b14c8d0ae0a4906efdf2061d2132564fd2335c419d8b71d43b02e" exitCode=0 Nov 21 13:25:08 crc kubenswrapper[4769]: I1121 13:25:08.132641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" event={"ID":"f37c6c6f-0074-4c84-b898-3b4bff18cb26","Type":"ContainerDied","Data":"fbae5a68db3b14c8d0ae0a4906efdf2061d2132564fd2335c419d8b71d43b02e"} Nov 21 13:25:08 crc kubenswrapper[4769]: I1121 13:25:08.134751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerStarted","Data":"e30b4acef97ec19fb06e9d671a7746f7a1c98d909e88cd3d44f015aaa5a7b651"} Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.594808 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.687266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-scripts\") pod \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.687321 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-config-data\") pod \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.687406 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-combined-ca-bundle\") pod \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.687552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klxr4\" (UniqueName: \"kubernetes.io/projected/f37c6c6f-0074-4c84-b898-3b4bff18cb26-kube-api-access-klxr4\") pod \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\" (UID: \"f37c6c6f-0074-4c84-b898-3b4bff18cb26\") " Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.692967 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-scripts" (OuterVolumeSpecName: "scripts") pod "f37c6c6f-0074-4c84-b898-3b4bff18cb26" (UID: "f37c6c6f-0074-4c84-b898-3b4bff18cb26"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.694368 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37c6c6f-0074-4c84-b898-3b4bff18cb26-kube-api-access-klxr4" (OuterVolumeSpecName: "kube-api-access-klxr4") pod "f37c6c6f-0074-4c84-b898-3b4bff18cb26" (UID: "f37c6c6f-0074-4c84-b898-3b4bff18cb26"). InnerVolumeSpecName "kube-api-access-klxr4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.715443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f37c6c6f-0074-4c84-b898-3b4bff18cb26" (UID: "f37c6c6f-0074-4c84-b898-3b4bff18cb26"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.717874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-config-data" (OuterVolumeSpecName: "config-data") pod "f37c6c6f-0074-4c84-b898-3b4bff18cb26" (UID: "f37c6c6f-0074-4c84-b898-3b4bff18cb26"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.789537 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.789574 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-klxr4\" (UniqueName: \"kubernetes.io/projected/f37c6c6f-0074-4c84-b898-3b4bff18cb26-kube-api-access-klxr4\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.789591 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:09 crc kubenswrapper[4769]: I1121 13:25:09.789603 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37c6c6f-0074-4c84-b898-3b4bff18cb26-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.157566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" event={"ID":"f37c6c6f-0074-4c84-b898-3b4bff18cb26","Type":"ContainerDied","Data":"370958a4345c440b255ee538bee690caeafe35f99c581ece1da85425213d1ff7"} Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.157603 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="370958a4345c440b255ee538bee690caeafe35f99c581ece1da85425213d1ff7" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.157719 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.159399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerStarted","Data":"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360"} Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.246875 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:10 crc kubenswrapper[4769]: E1121 13:25:10.247709 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f37c6c6f-0074-4c84-b898-3b4bff18cb26" containerName="nova-cell0-conductor-db-sync" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.247740 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37c6c6f-0074-4c84-b898-3b4bff18cb26" containerName="nova-cell0-conductor-db-sync" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.248030 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f37c6c6f-0074-4c84-b898-3b4bff18cb26" containerName="nova-cell0-conductor-db-sync" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.248762 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.253451 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-cl9ts" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.253451 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.262050 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.298260 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.298469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnp5\" (UniqueName: \"kubernetes.io/projected/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-kube-api-access-bpnp5\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.298780 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.400514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.400578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnp5\" (UniqueName: \"kubernetes.io/projected/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-kube-api-access-bpnp5\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.400686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.404117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.404508 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.435227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnp5\" (UniqueName: \"kubernetes.io/projected/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-kube-api-access-bpnp5\") pod \"nova-cell0-conductor-0\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:10 crc kubenswrapper[4769]: I1121 13:25:10.601528 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.180769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerStarted","Data":"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5"} Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.324906 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.324975 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.325021 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.325966 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"7ff5c9c12aa9f3f80f599745cb886ae54831b6420ebf341781639b968520a396"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.326026 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://7ff5c9c12aa9f3f80f599745cb886ae54831b6420ebf341781639b968520a396" gracePeriod=600 Nov 21 13:25:11 crc kubenswrapper[4769]: I1121 13:25:11.503569 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:11 crc kubenswrapper[4769]: W1121 13:25:11.509782 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd89eb95d_5db7_452a_8e7f_80c1cd2b9fce.slice/crio-7ecc79882da9c492ea949f0c4da667f80f0af2553113a81e8f54196cac69d9ab WatchSource:0}: Error finding container 7ecc79882da9c492ea949f0c4da667f80f0af2553113a81e8f54196cac69d9ab: Status 404 returned error can't find the container with id 7ecc79882da9c492ea949f0c4da667f80f0af2553113a81e8f54196cac69d9ab Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.190758 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce","Type":"ContainerStarted","Data":"2e701e029ede5354aca8ea6f948daf6c6625c89248fdbd0bd18213fa417b375d"} Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.191441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce","Type":"ContainerStarted","Data":"7ecc79882da9c492ea949f0c4da667f80f0af2553113a81e8f54196cac69d9ab"} Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.191470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.192830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerStarted","Data":"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f"} Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.196502 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="7ff5c9c12aa9f3f80f599745cb886ae54831b6420ebf341781639b968520a396" exitCode=0 Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.196563 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"7ff5c9c12aa9f3f80f599745cb886ae54831b6420ebf341781639b968520a396"} Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.196589 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6"} Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.196606 4769 scope.go:117] "RemoveContainer" containerID="baf2743331c597ebfadc0e8d10d2dd0cfef2a47c37fdb9331489d933a675f826" Nov 21 13:25:12 crc kubenswrapper[4769]: I1121 13:25:12.212010 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.21199125 podStartE2EDuration="2.21199125s" podCreationTimestamp="2025-11-21 13:25:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:12.206366134 +0000 UTC m=+5670.907027952" watchObservedRunningTime="2025-11-21 13:25:12.21199125 +0000 UTC m=+5670.912653068" Nov 21 13:25:13 crc kubenswrapper[4769]: I1121 13:25:13.519334 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:25:14 crc kubenswrapper[4769]: I1121 13:25:14.230610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerStarted","Data":"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73"} Nov 21 13:25:14 crc kubenswrapper[4769]: I1121 13:25:14.230999 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:14 crc kubenswrapper[4769]: I1121 13:25:14.265984 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.031331745 podStartE2EDuration="7.265966867s" podCreationTimestamp="2025-11-21 13:25:07 +0000 UTC" firstStartedPulling="2025-11-21 13:25:08.056888568 +0000 UTC m=+5666.757550386" lastFinishedPulling="2025-11-21 13:25:13.29152369 +0000 UTC m=+5671.992185508" observedRunningTime="2025-11-21 13:25:14.259790837 +0000 UTC m=+5672.960452655" watchObservedRunningTime="2025-11-21 13:25:14.265966867 +0000 UTC m=+5672.966628685" Nov 21 13:25:15 crc kubenswrapper[4769]: I1121 13:25:15.616867 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:15 crc kubenswrapper[4769]: I1121 13:25:15.617367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" containerName="nova-cell0-conductor-conductor" containerID="cri-o://2e701e029ede5354aca8ea6f948daf6c6625c89248fdbd0bd18213fa417b375d" gracePeriod=30 Nov 21 13:25:15 crc kubenswrapper[4769]: I1121 13:25:15.727215 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:25:15 crc kubenswrapper[4769]: I1121 13:25:15.795812 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-54975c7c59-fn9lz"] Nov 21 13:25:15 crc kubenswrapper[4769]: I1121 13:25:15.796417 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-api" containerID="cri-o://0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc" gracePeriod=30 Nov 21 13:25:15 crc kubenswrapper[4769]: I1121 13:25:15.796563 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-httpd" containerID="cri-o://8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf" gracePeriod=30 Nov 21 13:25:16 crc kubenswrapper[4769]: I1121 13:25:16.250552 4769 generic.go:334] "Generic (PLEG): container finished" podID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerID="8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf" exitCode=0 Nov 21 13:25:16 crc kubenswrapper[4769]: I1121 13:25:16.250623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" event={"ID":"457ff79d-90fb-4665-bba7-4ef9bb4368cd","Type":"ContainerDied","Data":"8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf"} Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.261029 4769 generic.go:334] "Generic (PLEG): container finished" podID="d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" containerID="2e701e029ede5354aca8ea6f948daf6c6625c89248fdbd0bd18213fa417b375d" exitCode=0 Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.261264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce","Type":"ContainerDied","Data":"2e701e029ede5354aca8ea6f948daf6c6625c89248fdbd0bd18213fa417b375d"} Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.366536 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.367128 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="proxy-httpd" containerID="cri-o://a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" gracePeriod=30 Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.368029 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-central-agent" containerID="cri-o://db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" gracePeriod=30 Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.368159 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="sg-core" containerID="cri-o://5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" gracePeriod=30 Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.368250 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-notification-agent" containerID="cri-o://2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" gracePeriod=30 Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.446810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.538948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-combined-ca-bundle\") pod \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.539046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-config-data\") pod \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.539084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpnp5\" (UniqueName: \"kubernetes.io/projected/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-kube-api-access-bpnp5\") pod \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\" (UID: \"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.546347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-kube-api-access-bpnp5" (OuterVolumeSpecName: "kube-api-access-bpnp5") pod "d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" (UID: "d89eb95d-5db7-452a-8e7f-80c1cd2b9fce"). InnerVolumeSpecName "kube-api-access-bpnp5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.574230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" (UID: "d89eb95d-5db7-452a-8e7f-80c1cd2b9fce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.578546 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-config-data" (OuterVolumeSpecName: "config-data") pod "d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" (UID: "d89eb95d-5db7-452a-8e7f-80c1cd2b9fce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.641922 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.641972 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bpnp5\" (UniqueName: \"kubernetes.io/projected/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-kube-api-access-bpnp5\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.641989 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.664272 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.845139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrjl4\" (UniqueName: \"kubernetes.io/projected/457ff79d-90fb-4665-bba7-4ef9bb4368cd-kube-api-access-qrjl4\") pod \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.845220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-combined-ca-bundle\") pod \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.845312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-config\") pod \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.845334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-ovndb-tls-certs\") pod \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.845375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-httpd-config\") pod \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\" (UID: \"457ff79d-90fb-4665-bba7-4ef9bb4368cd\") " Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.850047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "457ff79d-90fb-4665-bba7-4ef9bb4368cd" (UID: "457ff79d-90fb-4665-bba7-4ef9bb4368cd"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.850123 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457ff79d-90fb-4665-bba7-4ef9bb4368cd-kube-api-access-qrjl4" (OuterVolumeSpecName: "kube-api-access-qrjl4") pod "457ff79d-90fb-4665-bba7-4ef9bb4368cd" (UID: "457ff79d-90fb-4665-bba7-4ef9bb4368cd"). InnerVolumeSpecName "kube-api-access-qrjl4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.906971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-config" (OuterVolumeSpecName: "config") pod "457ff79d-90fb-4665-bba7-4ef9bb4368cd" (UID: "457ff79d-90fb-4665-bba7-4ef9bb4368cd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.908966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "457ff79d-90fb-4665-bba7-4ef9bb4368cd" (UID: "457ff79d-90fb-4665-bba7-4ef9bb4368cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.935254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "457ff79d-90fb-4665-bba7-4ef9bb4368cd" (UID: "457ff79d-90fb-4665-bba7-4ef9bb4368cd"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.948282 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qrjl4\" (UniqueName: \"kubernetes.io/projected/457ff79d-90fb-4665-bba7-4ef9bb4368cd-kube-api-access-qrjl4\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.948316 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.948329 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.948348 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:17 crc kubenswrapper[4769]: I1121 13:25:17.948362 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/457ff79d-90fb-4665-bba7-4ef9bb4368cd-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.050797 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155505 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-combined-ca-bundle\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155553 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-run-httpd\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-config-data\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-scripts\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-log-httpd\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkjv4\" (UniqueName: \"kubernetes.io/projected/66767ea3-4f4a-4680-87e9-17651cd5a3ac-kube-api-access-jkjv4\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.155867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-sg-core-conf-yaml\") pod \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\" (UID: \"66767ea3-4f4a-4680-87e9-17651cd5a3ac\") " Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.156905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.157016 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.159641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-scripts" (OuterVolumeSpecName: "scripts") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.159764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66767ea3-4f4a-4680-87e9-17651cd5a3ac-kube-api-access-jkjv4" (OuterVolumeSpecName: "kube-api-access-jkjv4") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "kube-api-access-jkjv4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.185738 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.240959 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.258611 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.258897 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.258987 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.259073 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66767ea3-4f4a-4680-87e9-17651cd5a3ac-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.259160 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jkjv4\" (UniqueName: \"kubernetes.io/projected/66767ea3-4f4a-4680-87e9-17651cd5a3ac-kube-api-access-jkjv4\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.259289 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.273377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d89eb95d-5db7-452a-8e7f-80c1cd2b9fce","Type":"ContainerDied","Data":"7ecc79882da9c492ea949f0c4da667f80f0af2553113a81e8f54196cac69d9ab"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.273419 4769 scope.go:117] "RemoveContainer" containerID="2e701e029ede5354aca8ea6f948daf6c6625c89248fdbd0bd18213fa417b375d" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.273418 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.277773 4769 generic.go:334] "Generic (PLEG): container finished" podID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerID="0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc" exitCode=0 Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.277905 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.277970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" event={"ID":"457ff79d-90fb-4665-bba7-4ef9bb4368cd","Type":"ContainerDied","Data":"0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.278062 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-54975c7c59-fn9lz" event={"ID":"457ff79d-90fb-4665-bba7-4ef9bb4368cd","Type":"ContainerDied","Data":"4546abf635f69579d7aef6fc946fd04dea0763f416ff8763cfaf54fafca66c79"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281214 4769 generic.go:334] "Generic (PLEG): container finished" podID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" exitCode=0 Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281252 4769 generic.go:334] "Generic (PLEG): container finished" podID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" exitCode=2 Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281263 4769 generic.go:334] "Generic (PLEG): container finished" podID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" exitCode=0 Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281273 4769 generic.go:334] "Generic (PLEG): container finished" podID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" exitCode=0 Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerDied","Data":"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerDied","Data":"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerDied","Data":"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerDied","Data":"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66767ea3-4f4a-4680-87e9-17651cd5a3ac","Type":"ContainerDied","Data":"e30b4acef97ec19fb06e9d671a7746f7a1c98d909e88cd3d44f015aaa5a7b651"} Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.281799 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.292586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-config-data" (OuterVolumeSpecName: "config-data") pod "66767ea3-4f4a-4680-87e9-17651cd5a3ac" (UID: "66767ea3-4f4a-4680-87e9-17651cd5a3ac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.333388 4769 scope.go:117] "RemoveContainer" containerID="8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.355420 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.361471 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66767ea3-4f4a-4680-87e9-17651cd5a3ac-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.367312 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.367479 4769 scope.go:117] "RemoveContainer" containerID="0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.382129 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-54975c7c59-fn9lz"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.392073 4769 scope.go:117] "RemoveContainer" containerID="8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.392671 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf\": container with ID starting with 8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf not found: ID does not exist" containerID="8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.392790 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf"} err="failed to get container status \"8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf\": rpc error: code = NotFound desc = could not find container \"8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf\": container with ID starting with 8158f7a85da1d35cc0d99a4b2683761aac842f66bda1dc78aef1ef3024be4fdf not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.392912 4769 scope.go:117] "RemoveContainer" containerID="0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.393442 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc\": container with ID starting with 0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc not found: ID does not exist" containerID="0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.393500 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc"} err="failed to get container status \"0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc\": rpc error: code = NotFound desc = could not find container \"0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc\": container with ID starting with 0a601444a0e720162e17231ef3fa78a88273bb7b5b7a54cc0054a54d632f79bc not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.393554 4769 scope.go:117] "RemoveContainer" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.397269 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-54975c7c59-fn9lz"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.408512 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.408970 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" containerName="nova-cell0-conductor-conductor" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.408989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" containerName="nova-cell0-conductor-conductor" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.409005 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-httpd" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409017 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-httpd" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.409034 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-central-agent" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409040 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-central-agent" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.409053 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-api" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409058 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-api" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.409072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="sg-core" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409078 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="sg-core" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.409096 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-notification-agent" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409103 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-notification-agent" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.409113 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="proxy-httpd" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409119 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="proxy-httpd" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409290 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-notification-agent" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409312 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" containerName="nova-cell0-conductor-conductor" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409324 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-httpd" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409334 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="sg-core" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409344 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="ceilometer-central-agent" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409360 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" containerName="proxy-httpd" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.409367 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" containerName="neutron-api" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.410023 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.417026 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-nova-dockercfg-cl9ts" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.417147 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-conductor-config-data" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.422182 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.427582 4769 scope.go:117] "RemoveContainer" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.446436 4769 scope.go:117] "RemoveContainer" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.466759 4769 scope.go:117] "RemoveContainer" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.485632 4769 scope.go:117] "RemoveContainer" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.486252 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": container with ID starting with a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73 not found: ID does not exist" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.486299 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73"} err="failed to get container status \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": rpc error: code = NotFound desc = could not find container \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": container with ID starting with a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.486319 4769 scope.go:117] "RemoveContainer" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.486629 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": container with ID starting with 5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f not found: ID does not exist" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.486686 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f"} err="failed to get container status \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": rpc error: code = NotFound desc = could not find container \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": container with ID starting with 5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.486723 4769 scope.go:117] "RemoveContainer" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.487047 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": container with ID starting with 2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5 not found: ID does not exist" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.487071 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5"} err="failed to get container status \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": rpc error: code = NotFound desc = could not find container \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": container with ID starting with 2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.487110 4769 scope.go:117] "RemoveContainer" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" Nov 21 13:25:18 crc kubenswrapper[4769]: E1121 13:25:18.487445 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": container with ID starting with db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360 not found: ID does not exist" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.487618 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360"} err="failed to get container status \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": rpc error: code = NotFound desc = could not find container \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": container with ID starting with db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.487674 4769 scope.go:117] "RemoveContainer" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488006 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73"} err="failed to get container status \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": rpc error: code = NotFound desc = could not find container \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": container with ID starting with a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488046 4769 scope.go:117] "RemoveContainer" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488364 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f"} err="failed to get container status \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": rpc error: code = NotFound desc = could not find container \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": container with ID starting with 5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488389 4769 scope.go:117] "RemoveContainer" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488674 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5"} err="failed to get container status \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": rpc error: code = NotFound desc = could not find container \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": container with ID starting with 2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488726 4769 scope.go:117] "RemoveContainer" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.488968 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360"} err="failed to get container status \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": rpc error: code = NotFound desc = could not find container \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": container with ID starting with db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.489033 4769 scope.go:117] "RemoveContainer" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.489392 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73"} err="failed to get container status \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": rpc error: code = NotFound desc = could not find container \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": container with ID starting with a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.489414 4769 scope.go:117] "RemoveContainer" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.489646 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f"} err="failed to get container status \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": rpc error: code = NotFound desc = could not find container \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": container with ID starting with 5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.489671 4769 scope.go:117] "RemoveContainer" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.489977 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5"} err="failed to get container status \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": rpc error: code = NotFound desc = could not find container \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": container with ID starting with 2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490001 4769 scope.go:117] "RemoveContainer" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490333 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360"} err="failed to get container status \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": rpc error: code = NotFound desc = could not find container \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": container with ID starting with db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490354 4769 scope.go:117] "RemoveContainer" containerID="a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490622 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73"} err="failed to get container status \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": rpc error: code = NotFound desc = could not find container \"a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73\": container with ID starting with a96f5747b465f2688463020de264b624de67884a4450d416199ce36fd740de73 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490641 4769 scope.go:117] "RemoveContainer" containerID="5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490858 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f"} err="failed to get container status \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": rpc error: code = NotFound desc = could not find container \"5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f\": container with ID starting with 5c744a81799c79c68d7f51b279d41c4ca227aceb38f6aad04d2e49ea6e5d751f not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.490882 4769 scope.go:117] "RemoveContainer" containerID="2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.491113 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5"} err="failed to get container status \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": rpc error: code = NotFound desc = could not find container \"2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5\": container with ID starting with 2ed2205ae0cc18e81948bf6061635de804a598a57fecf6066ac2aa68c991bea5 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.491131 4769 scope.go:117] "RemoveContainer" containerID="db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.491543 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360"} err="failed to get container status \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": rpc error: code = NotFound desc = could not find container \"db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360\": container with ID starting with db7eb80291bfe0973cd7f9a74842162cb7cbbfb8419c02611bc873e994be3360 not found: ID does not exist" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.564923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.564972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.565011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvsfk\" (UniqueName: \"kubernetes.io/projected/76618b5e-2d20-420a-a18c-5c6c1da97b94-kube-api-access-rvsfk\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.614818 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.624223 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.637717 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.643315 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.646349 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.646867 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.647740 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.666725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rvsfk\" (UniqueName: \"kubernetes.io/projected/76618b5e-2d20-420a-a18c-5c6c1da97b94-kube-api-access-rvsfk\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.666945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.666984 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.671091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.676429 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.699984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvsfk\" (UniqueName: \"kubernetes.io/projected/76618b5e-2d20-420a-a18c-5c6c1da97b94-kube-api-access-rvsfk\") pod \"nova-cell0-conductor-0\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.734156 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769225 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-scripts\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769305 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-log-httpd\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-run-httpd\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769431 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-config-data\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769466 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86gcn\" (UniqueName: \"kubernetes.io/projected/1609faa6-20fa-4ce9-b000-37a193840188-kube-api-access-86gcn\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.769505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.871502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.871793 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-scripts\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.871810 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-log-httpd\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.871846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-run-httpd\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.872497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-log-httpd\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.872552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-config-data\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.872623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-86gcn\" (UniqueName: \"kubernetes.io/projected/1609faa6-20fa-4ce9-b000-37a193840188-kube-api-access-86gcn\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.872678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.873172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-run-httpd\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.880242 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.881454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-config-data\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.881647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-scripts\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.884945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.894444 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-86gcn\" (UniqueName: \"kubernetes.io/projected/1609faa6-20fa-4ce9-b000-37a193840188-kube-api-access-86gcn\") pod \"ceilometer-0\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:18 crc kubenswrapper[4769]: I1121 13:25:18.987336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:19 crc kubenswrapper[4769]: I1121 13:25:19.176333 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:25:19 crc kubenswrapper[4769]: I1121 13:25:19.286270 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457ff79d-90fb-4665-bba7-4ef9bb4368cd" path="/var/lib/kubelet/pods/457ff79d-90fb-4665-bba7-4ef9bb4368cd/volumes" Nov 21 13:25:19 crc kubenswrapper[4769]: I1121 13:25:19.287410 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66767ea3-4f4a-4680-87e9-17651cd5a3ac" path="/var/lib/kubelet/pods/66767ea3-4f4a-4680-87e9-17651cd5a3ac/volumes" Nov 21 13:25:19 crc kubenswrapper[4769]: I1121 13:25:19.288064 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d89eb95d-5db7-452a-8e7f-80c1cd2b9fce" path="/var/lib/kubelet/pods/d89eb95d-5db7-452a-8e7f-80c1cd2b9fce/volumes" Nov 21 13:25:19 crc kubenswrapper[4769]: I1121 13:25:19.293788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"76618b5e-2d20-420a-a18c-5c6c1da97b94","Type":"ContainerStarted","Data":"30e5b5c9bb30f43622c62d7e195195506a8299164d0e68ee48e549f56936345f"} Nov 21 13:25:19 crc kubenswrapper[4769]: I1121 13:25:19.431580 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:19 crc kubenswrapper[4769]: W1121 13:25:19.437780 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1609faa6_20fa_4ce9_b000_37a193840188.slice/crio-c9a885441cf10868fe9d2464f676f472479c824c8f994a382e3e389a4ed0f661 WatchSource:0}: Error finding container c9a885441cf10868fe9d2464f676f472479c824c8f994a382e3e389a4ed0f661: Status 404 returned error can't find the container with id c9a885441cf10868fe9d2464f676f472479c824c8f994a382e3e389a4ed0f661 Nov 21 13:25:20 crc kubenswrapper[4769]: I1121 13:25:20.307118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerStarted","Data":"c9a885441cf10868fe9d2464f676f472479c824c8f994a382e3e389a4ed0f661"} Nov 21 13:25:20 crc kubenswrapper[4769]: I1121 13:25:20.308861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"76618b5e-2d20-420a-a18c-5c6c1da97b94","Type":"ContainerStarted","Data":"990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19"} Nov 21 13:25:20 crc kubenswrapper[4769]: I1121 13:25:20.309079 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:21 crc kubenswrapper[4769]: I1121 13:25:21.321945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerStarted","Data":"73faa59c25bed7d4ffac8615bd62a21bc2b6d20d2b06a24c60a4b81702613089"} Nov 21 13:25:22 crc kubenswrapper[4769]: I1121 13:25:22.333984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerStarted","Data":"a1ca1e2ecbc3f5d4c1548eb1104849b2e264fa9f88869507f0096fd5dc8fb820"} Nov 21 13:25:23 crc kubenswrapper[4769]: I1121 13:25:23.319396 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=5.319369329 podStartE2EDuration="5.319369329s" podCreationTimestamp="2025-11-21 13:25:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:20.337574485 +0000 UTC m=+5679.038236333" watchObservedRunningTime="2025-11-21 13:25:23.319369329 +0000 UTC m=+5682.020031187" Nov 21 13:25:24 crc kubenswrapper[4769]: I1121 13:25:24.359877 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerStarted","Data":"c024ea2a802fdb3564e5621481769b1ba7b87092c6c96e72b8b08f9c4ff54ae6"} Nov 21 13:25:26 crc kubenswrapper[4769]: I1121 13:25:26.383300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerStarted","Data":"082a19cab89f227c74cf55101c013c8ca8dbdf990d6b326793e61d60674d329a"} Nov 21 13:25:26 crc kubenswrapper[4769]: I1121 13:25:26.385342 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:26 crc kubenswrapper[4769]: I1121 13:25:26.410111 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.106935688 podStartE2EDuration="8.410093236s" podCreationTimestamp="2025-11-21 13:25:18 +0000 UTC" firstStartedPulling="2025-11-21 13:25:19.439760763 +0000 UTC m=+5678.140422581" lastFinishedPulling="2025-11-21 13:25:25.742918311 +0000 UTC m=+5684.443580129" observedRunningTime="2025-11-21 13:25:26.40870097 +0000 UTC m=+5685.109362798" watchObservedRunningTime="2025-11-21 13:25:26.410093236 +0000 UTC m=+5685.110755054" Nov 21 13:25:28 crc kubenswrapper[4769]: I1121 13:25:28.762435 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.243386 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.244585 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.246677 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-config-data" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.259078 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell0-manage-scripts" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.262917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.278370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.278434 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-scripts\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.278555 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-config-data\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.278597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg4xw\" (UniqueName: \"kubernetes.io/projected/6f1c0c06-720c-4e58-b32f-8731a28a0a81-kube-api-access-tg4xw\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.379916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.381958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-scripts\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.382252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-config-data\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.382396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tg4xw\" (UniqueName: \"kubernetes.io/projected/6f1c0c06-720c-4e58-b32f-8731a28a0a81-kube-api-access-tg4xw\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.388633 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.388658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-scripts\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.392874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-config-data\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.423432 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.425111 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.429926 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.430574 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg4xw\" (UniqueName: \"kubernetes.io/projected/6f1c0c06-720c-4e58-b32f-8731a28a0a81-kube-api-access-tg4xw\") pod \"nova-cell0-cell-mapping-s9rfm\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.448851 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.472234 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.477513 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.483558 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.506587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp522\" (UniqueName: \"kubernetes.io/projected/afd550b5-1b89-4200-b630-e6ea4ec683dc-kube-api-access-bp522\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.506771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-logs\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.506880 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4v4r\" (UniqueName: \"kubernetes.io/projected/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-kube-api-access-h4v4r\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.506959 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.507229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.507317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-config-data\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.507417 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.507610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-config-data\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.580158 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.581221 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.614118 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.616772 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-config-data\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-config-data\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bp522\" (UniqueName: \"kubernetes.io/projected/afd550b5-1b89-4200-b630-e6ea4ec683dc-kube-api-access-bp522\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623868 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-logs\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.623886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h4v4r\" (UniqueName: \"kubernetes.io/projected/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-kube-api-access-h4v4r\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.626734 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-logs\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.640404 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-config-data\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.648520 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.649325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-config-data\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.661980 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.674856 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.676666 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.676931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.681102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4v4r\" (UniqueName: \"kubernetes.io/projected/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-kube-api-access-h4v4r\") pod \"nova-api-0\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.682269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.685330 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.695855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp522\" (UniqueName: \"kubernetes.io/projected/afd550b5-1b89-4200-b630-e6ea4ec683dc-kube-api-access-bp522\") pod \"nova-scheduler-0\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.726344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.726407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20326750-7b98-4f33-94ca-97b5a0267390-logs\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.726451 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnqq\" (UniqueName: \"kubernetes.io/projected/20326750-7b98-4f33-94ca-97b5a0267390-kube-api-access-wtnqq\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.726498 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-config-data\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.819923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.829623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-config-data\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.830466 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.830608 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.830697 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.830768 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20326750-7b98-4f33-94ca-97b5a0267390-logs\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.830850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnqq\" (UniqueName: \"kubernetes.io/projected/20326750-7b98-4f33-94ca-97b5a0267390-kube-api-access-wtnqq\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.830929 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66md\" (UniqueName: \"kubernetes.io/projected/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-kube-api-access-v66md\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.831400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20326750-7b98-4f33-94ca-97b5a0267390-logs\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.835207 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.835264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-config-data\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.835649 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.847691 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnqq\" (UniqueName: \"kubernetes.io/projected/20326750-7b98-4f33-94ca-97b5a0267390-kube-api-access-wtnqq\") pod \"nova-metadata-0\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.932337 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.932751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v66md\" (UniqueName: \"kubernetes.io/projected/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-kube-api-access-v66md\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.932899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.938222 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.940285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:29 crc kubenswrapper[4769]: I1121 13:25:29.969074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66md\" (UniqueName: \"kubernetes.io/projected/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-kube-api-access-v66md\") pod \"nova-cell1-novncproxy-0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.069600 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.079020 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.196074 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm"] Nov 21 13:25:30 crc kubenswrapper[4769]: W1121 13:25:30.237670 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f1c0c06_720c_4e58_b32f_8731a28a0a81.slice/crio-a1f8c126f15852fc4fa38c0ffeb482a135e2b25f2cd6be57e0e69f69984ad65e WatchSource:0}: Error finding container a1f8c126f15852fc4fa38c0ffeb482a135e2b25f2cd6be57e0e69f69984ad65e: Status 404 returned error can't find the container with id a1f8c126f15852fc4fa38c0ffeb482a135e2b25f2cd6be57e0e69f69984ad65e Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.345128 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:30 crc kubenswrapper[4769]: W1121 13:25:30.345821 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafd550b5_1b89_4200_b630_e6ea4ec683dc.slice/crio-1008b7ae92aee21e0a12e05c750e2c75f1222a0589b3f7e0eeba4fa3b81260c9 WatchSource:0}: Error finding container 1008b7ae92aee21e0a12e05c750e2c75f1222a0589b3f7e0eeba4fa3b81260c9: Status 404 returned error can't find the container with id 1008b7ae92aee21e0a12e05c750e2c75f1222a0589b3f7e0eeba4fa3b81260c9 Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.365329 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.374675 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m"] Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.376870 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.380481 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.380682 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-scripts" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.386303 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m"] Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.459904 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw5fq\" (UniqueName: \"kubernetes.io/projected/6d77dade-4b4d-433c-8fba-b99098b19fa8-kube-api-access-sw5fq\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.460079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-config-data\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.460319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-scripts\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.460481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.491772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"afd550b5-1b89-4200-b630-e6ea4ec683dc","Type":"ContainerStarted","Data":"1008b7ae92aee21e0a12e05c750e2c75f1222a0589b3f7e0eeba4fa3b81260c9"} Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.495020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" event={"ID":"6f1c0c06-720c-4e58-b32f-8731a28a0a81","Type":"ContainerStarted","Data":"a1f8c126f15852fc4fa38c0ffeb482a135e2b25f2cd6be57e0e69f69984ad65e"} Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.497429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b","Type":"ContainerStarted","Data":"f1c9eda479923ed94ac348710ff6a4ff5526cdb684e1bbdf95d5df717f97026e"} Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.562464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.562550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sw5fq\" (UniqueName: \"kubernetes.io/projected/6d77dade-4b4d-433c-8fba-b99098b19fa8-kube-api-access-sw5fq\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.562592 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-config-data\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.562658 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-scripts\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.567877 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.569073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-scripts\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.574484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-config-data\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.579101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw5fq\" (UniqueName: \"kubernetes.io/projected/6d77dade-4b4d-433c-8fba-b99098b19fa8-kube-api-access-sw5fq\") pod \"nova-cell1-conductor-db-sync-jht9m\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: W1121 13:25:30.613689 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2347c8f_2f9c_4ae7_9819_4f18f0e8a3d0.slice/crio-de5a88c56855aa78c27a610e1d5bf8fab8cfbfc567a259c0a4af1b6fbf7b890d WatchSource:0}: Error finding container de5a88c56855aa78c27a610e1d5bf8fab8cfbfc567a259c0a4af1b6fbf7b890d: Status 404 returned error can't find the container with id de5a88c56855aa78c27a610e1d5bf8fab8cfbfc567a259c0a4af1b6fbf7b890d Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.616633 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.665664 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:25:30 crc kubenswrapper[4769]: I1121 13:25:30.716601 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.177014 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m"] Nov 21 13:25:31 crc kubenswrapper[4769]: W1121 13:25:31.185605 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d77dade_4b4d_433c_8fba_b99098b19fa8.slice/crio-220a89261ce96d82e55c96399f295174a92077bff06d8c01d2598d685f05f460 WatchSource:0}: Error finding container 220a89261ce96d82e55c96399f295174a92077bff06d8c01d2598d685f05f460: Status 404 returned error can't find the container with id 220a89261ce96d82e55c96399f295174a92077bff06d8c01d2598d685f05f460 Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.512342 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" event={"ID":"6d77dade-4b4d-433c-8fba-b99098b19fa8","Type":"ContainerStarted","Data":"91b7d2f78e02c9a15743e06682ccf76288024c1e88cfc65e567a567345670ac8"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.512703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" event={"ID":"6d77dade-4b4d-433c-8fba-b99098b19fa8","Type":"ContainerStarted","Data":"220a89261ce96d82e55c96399f295174a92077bff06d8c01d2598d685f05f460"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.516861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" event={"ID":"6f1c0c06-720c-4e58-b32f-8731a28a0a81","Type":"ContainerStarted","Data":"a93f684bae5b0ac67e6909c3d551ebfe826dfdc9589994e405863f69bdbfcf6d"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.519442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b","Type":"ContainerStarted","Data":"1490c4b49bf1652e231a7451f3d5ef9c8f7eb7815feecf8a79db6a1d5cc35c9b"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.519477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b","Type":"ContainerStarted","Data":"b5238dc0a8fc58c4f021e3ef4bda3259b0735deb5ada008f6177ffedb87a27ec"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.522578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"20326750-7b98-4f33-94ca-97b5a0267390","Type":"ContainerStarted","Data":"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.522612 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"20326750-7b98-4f33-94ca-97b5a0267390","Type":"ContainerStarted","Data":"861916a75ed9b80a2da2b5e69421e18535930917c74b230a2de81fdddd69babe"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.527833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"afd550b5-1b89-4200-b630-e6ea4ec683dc","Type":"ContainerStarted","Data":"cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.553895 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" podStartSLOduration=1.553870595 podStartE2EDuration="1.553870595s" podCreationTimestamp="2025-11-21 13:25:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:31.526907476 +0000 UTC m=+5690.227569294" watchObservedRunningTime="2025-11-21 13:25:31.553870595 +0000 UTC m=+5690.254532413" Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.555061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0","Type":"ContainerStarted","Data":"7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.555211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0","Type":"ContainerStarted","Data":"de5a88c56855aa78c27a610e1d5bf8fab8cfbfc567a259c0a4af1b6fbf7b890d"} Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.595464 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.5954447419999997 podStartE2EDuration="2.595444742s" podCreationTimestamp="2025-11-21 13:25:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:31.56178407 +0000 UTC m=+5690.262445888" watchObservedRunningTime="2025-11-21 13:25:31.595444742 +0000 UTC m=+5690.296106560" Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.606327 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.606303763 podStartE2EDuration="2.606303763s" podCreationTimestamp="2025-11-21 13:25:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:31.595086693 +0000 UTC m=+5690.295748511" watchObservedRunningTime="2025-11-21 13:25:31.606303763 +0000 UTC m=+5690.306965591" Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.624444 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" podStartSLOduration=2.624421543 podStartE2EDuration="2.624421543s" podCreationTimestamp="2025-11-21 13:25:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:31.618720165 +0000 UTC m=+5690.319381983" watchObservedRunningTime="2025-11-21 13:25:31.624421543 +0000 UTC m=+5690.325083361" Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.641571 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.641554146 podStartE2EDuration="2.641554146s" podCreationTimestamp="2025-11-21 13:25:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:31.635618073 +0000 UTC m=+5690.336279891" watchObservedRunningTime="2025-11-21 13:25:31.641554146 +0000 UTC m=+5690.342215964" Nov 21 13:25:31 crc kubenswrapper[4769]: I1121 13:25:31.668612 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.668590387 podStartE2EDuration="2.668590387s" podCreationTimestamp="2025-11-21 13:25:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:31.651093954 +0000 UTC m=+5690.351755772" watchObservedRunningTime="2025-11-21 13:25:31.668590387 +0000 UTC m=+5690.369252205" Nov 21 13:25:32 crc kubenswrapper[4769]: I1121 13:25:32.568938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"20326750-7b98-4f33-94ca-97b5a0267390","Type":"ContainerStarted","Data":"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db"} Nov 21 13:25:33 crc kubenswrapper[4769]: I1121 13:25:33.097543 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:33 crc kubenswrapper[4769]: I1121 13:25:33.106243 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:33 crc kubenswrapper[4769]: I1121 13:25:33.578822 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc" gracePeriod=30 Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.446571 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.551513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v66md\" (UniqueName: \"kubernetes.io/projected/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-kube-api-access-v66md\") pod \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.551689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-combined-ca-bundle\") pod \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.551823 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-config-data\") pod \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\" (UID: \"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0\") " Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.558023 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-kube-api-access-v66md" (OuterVolumeSpecName: "kube-api-access-v66md") pod "e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" (UID: "e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0"). InnerVolumeSpecName "kube-api-access-v66md". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.587974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-config-data" (OuterVolumeSpecName: "config-data") pod "e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" (UID: "e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.595805 4769 generic.go:334] "Generic (PLEG): container finished" podID="e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" containerID="7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc" exitCode=0 Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.596031 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-log" containerID="cri-o://a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb" gracePeriod=30 Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.596645 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.597056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0","Type":"ContainerDied","Data":"7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc"} Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.597085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0","Type":"ContainerDied","Data":"de5a88c56855aa78c27a610e1d5bf8fab8cfbfc567a259c0a4af1b6fbf7b890d"} Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.597101 4769 scope.go:117] "RemoveContainer" containerID="7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.597437 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-metadata" containerID="cri-o://582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db" gracePeriod=30 Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.612802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" (UID: "e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.654518 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.654562 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v66md\" (UniqueName: \"kubernetes.io/projected/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-kube-api-access-v66md\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.654577 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.682579 4769 scope.go:117] "RemoveContainer" containerID="7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc" Nov 21 13:25:34 crc kubenswrapper[4769]: E1121 13:25:34.683338 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc\": container with ID starting with 7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc not found: ID does not exist" containerID="7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.683403 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc"} err="failed to get container status \"7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc\": rpc error: code = NotFound desc = could not find container \"7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc\": container with ID starting with 7f302e304503b6b477107a04b547df32ae9735d2a52bf0eebd723e517ea6ebcc not found: ID does not exist" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.836658 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.940118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.955476 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.986553 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:34 crc kubenswrapper[4769]: E1121 13:25:34.986976 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.986987 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.987182 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.987845 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.990233 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-novncproxy-config-data" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.990849 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-public-svc" Nov 21 13:25:34 crc kubenswrapper[4769]: I1121 13:25:34.991116 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-novncproxy-cell1-vencrypt" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.022147 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.070924 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.070983 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.162851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.163037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.163131 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.163367 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gs7g\" (UniqueName: \"kubernetes.io/projected/baec736c-d0fb-4b1a-9c7f-14e3a275807c-kube-api-access-9gs7g\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.163523 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.264890 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.265313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.265349 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.265429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9gs7g\" (UniqueName: \"kubernetes.io/projected/baec736c-d0fb-4b1a-9c7f-14e3a275807c-kube-api-access-9gs7g\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.265487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.269747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.270101 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.270588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.271349 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.282450 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gs7g\" (UniqueName: \"kubernetes.io/projected/baec736c-d0fb-4b1a-9c7f-14e3a275807c-kube-api-access-9gs7g\") pod \"nova-cell1-novncproxy-0\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.295100 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0" path="/var/lib/kubelet/pods/e2347c8f-2f9c-4ae7-9819-4f18f0e8a3d0/volumes" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.318934 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.335012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.468298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-config-data\") pod \"20326750-7b98-4f33-94ca-97b5a0267390\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.468534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtnqq\" (UniqueName: \"kubernetes.io/projected/20326750-7b98-4f33-94ca-97b5a0267390-kube-api-access-wtnqq\") pod \"20326750-7b98-4f33-94ca-97b5a0267390\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.468771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-combined-ca-bundle\") pod \"20326750-7b98-4f33-94ca-97b5a0267390\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.468814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20326750-7b98-4f33-94ca-97b5a0267390-logs\") pod \"20326750-7b98-4f33-94ca-97b5a0267390\" (UID: \"20326750-7b98-4f33-94ca-97b5a0267390\") " Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.469595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20326750-7b98-4f33-94ca-97b5a0267390-logs" (OuterVolumeSpecName: "logs") pod "20326750-7b98-4f33-94ca-97b5a0267390" (UID: "20326750-7b98-4f33-94ca-97b5a0267390"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.475567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20326750-7b98-4f33-94ca-97b5a0267390-kube-api-access-wtnqq" (OuterVolumeSpecName: "kube-api-access-wtnqq") pod "20326750-7b98-4f33-94ca-97b5a0267390" (UID: "20326750-7b98-4f33-94ca-97b5a0267390"). InnerVolumeSpecName "kube-api-access-wtnqq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.501799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20326750-7b98-4f33-94ca-97b5a0267390" (UID: "20326750-7b98-4f33-94ca-97b5a0267390"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.511170 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-config-data" (OuterVolumeSpecName: "config-data") pod "20326750-7b98-4f33-94ca-97b5a0267390" (UID: "20326750-7b98-4f33-94ca-97b5a0267390"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.572853 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wtnqq\" (UniqueName: \"kubernetes.io/projected/20326750-7b98-4f33-94ca-97b5a0267390-kube-api-access-wtnqq\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.572931 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.572947 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/20326750-7b98-4f33-94ca-97b5a0267390-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.572962 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20326750-7b98-4f33-94ca-97b5a0267390-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612045 4769 generic.go:334] "Generic (PLEG): container finished" podID="20326750-7b98-4f33-94ca-97b5a0267390" containerID="582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db" exitCode=0 Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612136 4769 generic.go:334] "Generic (PLEG): container finished" podID="20326750-7b98-4f33-94ca-97b5a0267390" containerID="a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb" exitCode=143 Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612175 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"20326750-7b98-4f33-94ca-97b5a0267390","Type":"ContainerDied","Data":"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db"} Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612260 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"20326750-7b98-4f33-94ca-97b5a0267390","Type":"ContainerDied","Data":"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb"} Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"20326750-7b98-4f33-94ca-97b5a0267390","Type":"ContainerDied","Data":"861916a75ed9b80a2da2b5e69421e18535930917c74b230a2de81fdddd69babe"} Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612351 4769 scope.go:117] "RemoveContainer" containerID="582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.612697 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.653384 4769 scope.go:117] "RemoveContainer" containerID="a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.668679 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.684532 4769 scope.go:117] "RemoveContainer" containerID="582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db" Nov 21 13:25:35 crc kubenswrapper[4769]: E1121 13:25:35.685155 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db\": container with ID starting with 582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db not found: ID does not exist" containerID="582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.685279 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db"} err="failed to get container status \"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db\": rpc error: code = NotFound desc = could not find container \"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db\": container with ID starting with 582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db not found: ID does not exist" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.685310 4769 scope.go:117] "RemoveContainer" containerID="a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb" Nov 21 13:25:35 crc kubenswrapper[4769]: E1121 13:25:35.686997 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb\": container with ID starting with a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb not found: ID does not exist" containerID="a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.687084 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb"} err="failed to get container status \"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb\": rpc error: code = NotFound desc = could not find container \"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb\": container with ID starting with a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb not found: ID does not exist" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.687208 4769 scope.go:117] "RemoveContainer" containerID="582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.687791 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db"} err="failed to get container status \"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db\": rpc error: code = NotFound desc = could not find container \"582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db\": container with ID starting with 582081fc6a7d9810aa95f6c022dfe6f06f5b6472eaac2aef7c6b842c497068db not found: ID does not exist" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.687869 4769 scope.go:117] "RemoveContainer" containerID="a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.688233 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb"} err="failed to get container status \"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb\": rpc error: code = NotFound desc = could not find container \"a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb\": container with ID starting with a2671bcce033c5ff8921e3a208339d7ca6cde6df96c2609a4de8c917635d6efb not found: ID does not exist" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.689339 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.699598 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:35 crc kubenswrapper[4769]: E1121 13:25:35.700095 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-metadata" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.700120 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-metadata" Nov 21 13:25:35 crc kubenswrapper[4769]: E1121 13:25:35.700209 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-log" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.700222 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-log" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.700467 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-metadata" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.700500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20326750-7b98-4f33-94ca-97b5a0267390" containerName="nova-metadata-log" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.701910 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.704412 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.708454 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.710376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:25:35 crc kubenswrapper[4769]: W1121 13:25:35.774926 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaec736c_d0fb_4b1a_9c7f_14e3a275807c.slice/crio-33bfbb50221b5bb40b2ea41c8cfab1420ea326b45a99c2e17027cff91982de94 WatchSource:0}: Error finding container 33bfbb50221b5bb40b2ea41c8cfab1420ea326b45a99c2e17027cff91982de94: Status 404 returned error can't find the container with id 33bfbb50221b5bb40b2ea41c8cfab1420ea326b45a99c2e17027cff91982de94 Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.776134 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.882412 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-logs\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.882536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.882634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.883214 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghnz\" (UniqueName: \"kubernetes.io/projected/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-kube-api-access-cghnz\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.883323 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-config-data\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.985143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-logs\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.985700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.985819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.985579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-logs\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.986008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cghnz\" (UniqueName: \"kubernetes.io/projected/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-kube-api-access-cghnz\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.986217 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-config-data\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.992051 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.995414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-config-data\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:35 crc kubenswrapper[4769]: I1121 13:25:35.996802 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.018365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghnz\" (UniqueName: \"kubernetes.io/projected/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-kube-api-access-cghnz\") pod \"nova-metadata-0\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.020466 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.390039 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.623572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b6ec9f10-6cc4-44fa-87cd-0b952b18013f","Type":"ContainerStarted","Data":"a3654b08b41127d99484e6403192f38d23df2fd7287ae2bea4d864a50cf565d9"} Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.625444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baec736c-d0fb-4b1a-9c7f-14e3a275807c","Type":"ContainerStarted","Data":"d4b92ecfef7c6e9ac2708c8d2e3892522247b4ab3c5d5d8cfd4298451b09ca86"} Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.625471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baec736c-d0fb-4b1a-9c7f-14e3a275807c","Type":"ContainerStarted","Data":"33bfbb50221b5bb40b2ea41c8cfab1420ea326b45a99c2e17027cff91982de94"} Nov 21 13:25:36 crc kubenswrapper[4769]: I1121 13:25:36.650230 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.650208155 podStartE2EDuration="2.650208155s" podCreationTimestamp="2025-11-21 13:25:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:36.642526746 +0000 UTC m=+5695.343188564" watchObservedRunningTime="2025-11-21 13:25:36.650208155 +0000 UTC m=+5695.350869973" Nov 21 13:25:37 crc kubenswrapper[4769]: I1121 13:25:37.292879 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20326750-7b98-4f33-94ca-97b5a0267390" path="/var/lib/kubelet/pods/20326750-7b98-4f33-94ca-97b5a0267390/volumes" Nov 21 13:25:37 crc kubenswrapper[4769]: I1121 13:25:37.637860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b6ec9f10-6cc4-44fa-87cd-0b952b18013f","Type":"ContainerStarted","Data":"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502"} Nov 21 13:25:37 crc kubenswrapper[4769]: I1121 13:25:37.637919 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b6ec9f10-6cc4-44fa-87cd-0b952b18013f","Type":"ContainerStarted","Data":"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4"} Nov 21 13:25:37 crc kubenswrapper[4769]: I1121 13:25:37.671966 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.6719482660000002 podStartE2EDuration="2.671948266s" podCreationTimestamp="2025-11-21 13:25:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:37.665724925 +0000 UTC m=+5696.366386763" watchObservedRunningTime="2025-11-21 13:25:37.671948266 +0000 UTC m=+5696.372610084" Nov 21 13:25:38 crc kubenswrapper[4769]: I1121 13:25:38.650540 4769 generic.go:334] "Generic (PLEG): container finished" podID="6f1c0c06-720c-4e58-b32f-8731a28a0a81" containerID="a93f684bae5b0ac67e6909c3d551ebfe826dfdc9589994e405863f69bdbfcf6d" exitCode=0 Nov 21 13:25:38 crc kubenswrapper[4769]: I1121 13:25:38.650619 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" event={"ID":"6f1c0c06-720c-4e58-b32f-8731a28a0a81","Type":"ContainerDied","Data":"a93f684bae5b0ac67e6909c3d551ebfe826dfdc9589994e405863f69bdbfcf6d"} Nov 21 13:25:39 crc kubenswrapper[4769]: I1121 13:25:39.821235 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:39 crc kubenswrapper[4769]: I1121 13:25:39.821699 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:39 crc kubenswrapper[4769]: I1121 13:25:39.835912 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:39 crc kubenswrapper[4769]: I1121 13:25:39.883826 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.055553 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.178638 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-config-data\") pod \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.178700 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-combined-ca-bundle\") pod \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.178812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-scripts\") pod \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.179141 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg4xw\" (UniqueName: \"kubernetes.io/projected/6f1c0c06-720c-4e58-b32f-8731a28a0a81-kube-api-access-tg4xw\") pod \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\" (UID: \"6f1c0c06-720c-4e58-b32f-8731a28a0a81\") " Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.184123 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-scripts" (OuterVolumeSpecName: "scripts") pod "6f1c0c06-720c-4e58-b32f-8731a28a0a81" (UID: "6f1c0c06-720c-4e58-b32f-8731a28a0a81"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.186619 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1c0c06-720c-4e58-b32f-8731a28a0a81-kube-api-access-tg4xw" (OuterVolumeSpecName: "kube-api-access-tg4xw") pod "6f1c0c06-720c-4e58-b32f-8731a28a0a81" (UID: "6f1c0c06-720c-4e58-b32f-8731a28a0a81"). InnerVolumeSpecName "kube-api-access-tg4xw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.211385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-config-data" (OuterVolumeSpecName: "config-data") pod "6f1c0c06-720c-4e58-b32f-8731a28a0a81" (UID: "6f1c0c06-720c-4e58-b32f-8731a28a0a81"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.211735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f1c0c06-720c-4e58-b32f-8731a28a0a81" (UID: "6f1c0c06-720c-4e58-b32f-8731a28a0a81"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.281695 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tg4xw\" (UniqueName: \"kubernetes.io/projected/6f1c0c06-720c-4e58-b32f-8731a28a0a81-kube-api-access-tg4xw\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.281725 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.281737 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.281746 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f1c0c06-720c-4e58-b32f-8731a28a0a81-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.320461 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.673149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" event={"ID":"6f1c0c06-720c-4e58-b32f-8731a28a0a81","Type":"ContainerDied","Data":"a1f8c126f15852fc4fa38c0ffeb482a135e2b25f2cd6be57e0e69f69984ad65e"} Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.673209 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1f8c126f15852fc4fa38c0ffeb482a135e2b25f2cd6be57e0e69f69984ad65e" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.673182 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.712161 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.861032 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.861391 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-log" containerID="cri-o://b5238dc0a8fc58c4f021e3ef4bda3259b0735deb5ada008f6177ffedb87a27ec" gracePeriod=30 Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.861579 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-api" containerID="cri-o://1490c4b49bf1652e231a7451f3d5ef9c8f7eb7815feecf8a79db6a1d5cc35c9b" gracePeriod=30 Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.873941 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.247:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.873956 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.247:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.881620 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.881914 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-log" containerID="cri-o://a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4" gracePeriod=30 Nov 21 13:25:40 crc kubenswrapper[4769]: I1121 13:25:40.881981 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-metadata" containerID="cri-o://d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502" gracePeriod=30 Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.021305 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.021823 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.187108 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.487535 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.620675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cghnz\" (UniqueName: \"kubernetes.io/projected/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-kube-api-access-cghnz\") pod \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.620840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-logs\") pod \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.621050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-combined-ca-bundle\") pod \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.621116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-nova-metadata-tls-certs\") pod \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.621160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-config-data\") pod \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\" (UID: \"b6ec9f10-6cc4-44fa-87cd-0b952b18013f\") " Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.621474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-logs" (OuterVolumeSpecName: "logs") pod "b6ec9f10-6cc4-44fa-87cd-0b952b18013f" (UID: "b6ec9f10-6cc4-44fa-87cd-0b952b18013f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.622224 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.626035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-kube-api-access-cghnz" (OuterVolumeSpecName: "kube-api-access-cghnz") pod "b6ec9f10-6cc4-44fa-87cd-0b952b18013f" (UID: "b6ec9f10-6cc4-44fa-87cd-0b952b18013f"). InnerVolumeSpecName "kube-api-access-cghnz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.651743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b6ec9f10-6cc4-44fa-87cd-0b952b18013f" (UID: "b6ec9f10-6cc4-44fa-87cd-0b952b18013f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.653629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-config-data" (OuterVolumeSpecName: "config-data") pod "b6ec9f10-6cc4-44fa-87cd-0b952b18013f" (UID: "b6ec9f10-6cc4-44fa-87cd-0b952b18013f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b6ec9f10-6cc4-44fa-87cd-0b952b18013f" (UID: "b6ec9f10-6cc4-44fa-87cd-0b952b18013f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685477 4769 generic.go:334] "Generic (PLEG): container finished" podID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerID="d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502" exitCode=0 Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685505 4769 generic.go:334] "Generic (PLEG): container finished" podID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerID="a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4" exitCode=143 Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b6ec9f10-6cc4-44fa-87cd-0b952b18013f","Type":"ContainerDied","Data":"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502"} Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b6ec9f10-6cc4-44fa-87cd-0b952b18013f","Type":"ContainerDied","Data":"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4"} Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685640 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685660 4769 scope.go:117] "RemoveContainer" containerID="d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.685646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b6ec9f10-6cc4-44fa-87cd-0b952b18013f","Type":"ContainerDied","Data":"a3654b08b41127d99484e6403192f38d23df2fd7287ae2bea4d864a50cf565d9"} Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.687739 4769 generic.go:334] "Generic (PLEG): container finished" podID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerID="b5238dc0a8fc58c4f021e3ef4bda3259b0735deb5ada008f6177ffedb87a27ec" exitCode=143 Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.688534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b","Type":"ContainerDied","Data":"b5238dc0a8fc58c4f021e3ef4bda3259b0735deb5ada008f6177ffedb87a27ec"} Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.718165 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.724538 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.724575 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.724588 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.724602 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cghnz\" (UniqueName: \"kubernetes.io/projected/b6ec9f10-6cc4-44fa-87cd-0b952b18013f-kube-api-access-cghnz\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.725727 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.737961 4769 scope.go:117] "RemoveContainer" containerID="a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746007 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:41 crc kubenswrapper[4769]: E1121 13:25:41.746429 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-metadata" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746447 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-metadata" Nov 21 13:25:41 crc kubenswrapper[4769]: E1121 13:25:41.746478 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f1c0c06-720c-4e58-b32f-8731a28a0a81" containerName="nova-manage" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746484 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1c0c06-720c-4e58-b32f-8731a28a0a81" containerName="nova-manage" Nov 21 13:25:41 crc kubenswrapper[4769]: E1121 13:25:41.746498 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-log" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746503 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-log" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746681 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f1c0c06-720c-4e58-b32f-8731a28a0a81" containerName="nova-manage" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-metadata" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.746720 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" containerName="nova-metadata-log" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.747891 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.753617 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.758737 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.759251 4769 scope.go:117] "RemoveContainer" containerID="d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502" Nov 21 13:25:41 crc kubenswrapper[4769]: E1121 13:25:41.760238 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502\": container with ID starting with d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502 not found: ID does not exist" containerID="d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.760275 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502"} err="failed to get container status \"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502\": rpc error: code = NotFound desc = could not find container \"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502\": container with ID starting with d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502 not found: ID does not exist" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.760302 4769 scope.go:117] "RemoveContainer" containerID="a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4" Nov 21 13:25:41 crc kubenswrapper[4769]: E1121 13:25:41.760663 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4\": container with ID starting with a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4 not found: ID does not exist" containerID="a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.760686 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4"} err="failed to get container status \"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4\": rpc error: code = NotFound desc = could not find container \"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4\": container with ID starting with a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4 not found: ID does not exist" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.760699 4769 scope.go:117] "RemoveContainer" containerID="d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.761040 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502"} err="failed to get container status \"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502\": rpc error: code = NotFound desc = could not find container \"d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502\": container with ID starting with d7b7322401244de03726cb41691e3a876cc6c17c6b37888f441c94658d441502 not found: ID does not exist" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.761059 4769 scope.go:117] "RemoveContainer" containerID="a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.761443 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4"} err="failed to get container status \"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4\": rpc error: code = NotFound desc = could not find container \"a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4\": container with ID starting with a6099f43e7dc9f0f21e9320566e9d5ad01e396f5b86d2a7673649f2f6422e6f4 not found: ID does not exist" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.761992 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.928247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-config-data\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.930567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.930668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-logs\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.930782 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:41 crc kubenswrapper[4769]: I1121 13:25:41.930903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnjpl\" (UniqueName: \"kubernetes.io/projected/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-kube-api-access-jnjpl\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.034431 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-config-data\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.035086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.035321 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-logs\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.035500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.035706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jnjpl\" (UniqueName: \"kubernetes.io/projected/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-kube-api-access-jnjpl\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.035863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-logs\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.040111 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.040118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.040821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-config-data\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.057119 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnjpl\" (UniqueName: \"kubernetes.io/projected/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-kube-api-access-jnjpl\") pod \"nova-metadata-0\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.075670 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.579449 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:25:42 crc kubenswrapper[4769]: W1121 13:25:42.581979 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3926aac_4463_4bba_9d2f_58c1b0e84a0b.slice/crio-e4c7c7bbe82cf14103161a13d590d089d970ec8b2dab0796f2f7f426422af359 WatchSource:0}: Error finding container e4c7c7bbe82cf14103161a13d590d089d970ec8b2dab0796f2f7f426422af359: Status 404 returned error can't find the container with id e4c7c7bbe82cf14103161a13d590d089d970ec8b2dab0796f2f7f426422af359 Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.701786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b3926aac-4463-4bba-9d2f-58c1b0e84a0b","Type":"ContainerStarted","Data":"e4c7c7bbe82cf14103161a13d590d089d970ec8b2dab0796f2f7f426422af359"} Nov 21 13:25:42 crc kubenswrapper[4769]: I1121 13:25:42.704329 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="afd550b5-1b89-4200-b630-e6ea4ec683dc" containerName="nova-scheduler-scheduler" containerID="cri-o://cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" gracePeriod=30 Nov 21 13:25:43 crc kubenswrapper[4769]: I1121 13:25:43.289865 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ec9f10-6cc4-44fa-87cd-0b952b18013f" path="/var/lib/kubelet/pods/b6ec9f10-6cc4-44fa-87cd-0b952b18013f/volumes" Nov 21 13:25:43 crc kubenswrapper[4769]: I1121 13:25:43.717981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b3926aac-4463-4bba-9d2f-58c1b0e84a0b","Type":"ContainerStarted","Data":"40483e213bbb8fb730f5881d5ce6648bdb67668c550c3c3946b3c47e4e682801"} Nov 21 13:25:43 crc kubenswrapper[4769]: I1121 13:25:43.718407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b3926aac-4463-4bba-9d2f-58c1b0e84a0b","Type":"ContainerStarted","Data":"81c4fc57a60049743c433e4b858d298d43b52ccc9ae8e6fbc402f6c8bc50ddb1"} Nov 21 13:25:43 crc kubenswrapper[4769]: I1121 13:25:43.756731 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.75671063 podStartE2EDuration="2.75671063s" podCreationTimestamp="2025-11-21 13:25:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:43.749711712 +0000 UTC m=+5702.450373530" watchObservedRunningTime="2025-11-21 13:25:43.75671063 +0000 UTC m=+5702.457372448" Nov 21 13:25:44 crc kubenswrapper[4769]: E1121 13:25:44.839101 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:25:44 crc kubenswrapper[4769]: E1121 13:25:44.842807 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:25:44 crc kubenswrapper[4769]: E1121 13:25:44.844759 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:25:44 crc kubenswrapper[4769]: E1121 13:25:44.844868 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="afd550b5-1b89-4200-b630-e6ea4ec683dc" containerName="nova-scheduler-scheduler" Nov 21 13:25:45 crc kubenswrapper[4769]: I1121 13:25:45.320736 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:45 crc kubenswrapper[4769]: I1121 13:25:45.339446 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:45 crc kubenswrapper[4769]: I1121 13:25:45.763845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.748414 4769 generic.go:334] "Generic (PLEG): container finished" podID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerID="1490c4b49bf1652e231a7451f3d5ef9c8f7eb7815feecf8a79db6a1d5cc35c9b" exitCode=0 Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.748501 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b","Type":"ContainerDied","Data":"1490c4b49bf1652e231a7451f3d5ef9c8f7eb7815feecf8a79db6a1d5cc35c9b"} Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.748695 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b","Type":"ContainerDied","Data":"f1c9eda479923ed94ac348710ff6a4ff5526cdb684e1bbdf95d5df717f97026e"} Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.748707 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1c9eda479923ed94ac348710ff6a4ff5526cdb684e1bbdf95d5df717f97026e" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.774137 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.927801 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-config-data\") pod \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.928289 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-logs\") pod \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.928391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4v4r\" (UniqueName: \"kubernetes.io/projected/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-kube-api-access-h4v4r\") pod \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.928421 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-combined-ca-bundle\") pod \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\" (UID: \"50851f2b-461e-4e6a-8189-ba6c7ccd3d5b\") " Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.928913 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-logs" (OuterVolumeSpecName: "logs") pod "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" (UID: "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.930294 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.934420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-kube-api-access-h4v4r" (OuterVolumeSpecName: "kube-api-access-h4v4r") pod "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" (UID: "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b"). InnerVolumeSpecName "kube-api-access-h4v4r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.956382 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-config-data" (OuterVolumeSpecName: "config-data") pod "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" (UID: "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:46 crc kubenswrapper[4769]: I1121 13:25:46.959212 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" (UID: "50851f2b-461e-4e6a-8189-ba6c7ccd3d5b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.031988 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h4v4r\" (UniqueName: \"kubernetes.io/projected/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-kube-api-access-h4v4r\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.032021 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.032034 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.076656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.076725 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.756747 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.800627 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.830819 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.840514 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:47 crc kubenswrapper[4769]: E1121 13:25:47.840969 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-log" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.840986 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-log" Nov 21 13:25:47 crc kubenswrapper[4769]: E1121 13:25:47.841006 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-api" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.841011 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-api" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.841200 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-api" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.841217 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" containerName="nova-api-log" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.842234 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.850252 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.865884 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.969612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-config-data\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.969981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.970005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4530dcef-df4a-4e18-9e83-810d74a8b6cc-logs\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:47 crc kubenswrapper[4769]: I1121 13:25:47.970161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkhq\" (UniqueName: \"kubernetes.io/projected/4530dcef-df4a-4e18-9e83-810d74a8b6cc-kube-api-access-gmkhq\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.072401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkhq\" (UniqueName: \"kubernetes.io/projected/4530dcef-df4a-4e18-9e83-810d74a8b6cc-kube-api-access-gmkhq\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.072515 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-config-data\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.072559 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.072582 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4530dcef-df4a-4e18-9e83-810d74a8b6cc-logs\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.072991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4530dcef-df4a-4e18-9e83-810d74a8b6cc-logs\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.078264 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.078845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-config-data\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.093935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkhq\" (UniqueName: \"kubernetes.io/projected/4530dcef-df4a-4e18-9e83-810d74a8b6cc-kube-api-access-gmkhq\") pod \"nova-api-0\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.244768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.583845 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.689524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-config-data\") pod \"afd550b5-1b89-4200-b630-e6ea4ec683dc\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.689577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-combined-ca-bundle\") pod \"afd550b5-1b89-4200-b630-e6ea4ec683dc\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.689632 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp522\" (UniqueName: \"kubernetes.io/projected/afd550b5-1b89-4200-b630-e6ea4ec683dc-kube-api-access-bp522\") pod \"afd550b5-1b89-4200-b630-e6ea4ec683dc\" (UID: \"afd550b5-1b89-4200-b630-e6ea4ec683dc\") " Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.700416 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd550b5-1b89-4200-b630-e6ea4ec683dc-kube-api-access-bp522" (OuterVolumeSpecName: "kube-api-access-bp522") pod "afd550b5-1b89-4200-b630-e6ea4ec683dc" (UID: "afd550b5-1b89-4200-b630-e6ea4ec683dc"). InnerVolumeSpecName "kube-api-access-bp522". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.732388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "afd550b5-1b89-4200-b630-e6ea4ec683dc" (UID: "afd550b5-1b89-4200-b630-e6ea4ec683dc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.735518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-config-data" (OuterVolumeSpecName: "config-data") pod "afd550b5-1b89-4200-b630-e6ea4ec683dc" (UID: "afd550b5-1b89-4200-b630-e6ea4ec683dc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.776223 4769 generic.go:334] "Generic (PLEG): container finished" podID="afd550b5-1b89-4200-b630-e6ea4ec683dc" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" exitCode=0 Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.776263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"afd550b5-1b89-4200-b630-e6ea4ec683dc","Type":"ContainerDied","Data":"cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34"} Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.776288 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"afd550b5-1b89-4200-b630-e6ea4ec683dc","Type":"ContainerDied","Data":"1008b7ae92aee21e0a12e05c750e2c75f1222a0589b3f7e0eeba4fa3b81260c9"} Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.776305 4769 scope.go:117] "RemoveContainer" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.776505 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.791673 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.791703 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/afd550b5-1b89-4200-b630-e6ea4ec683dc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.791715 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bp522\" (UniqueName: \"kubernetes.io/projected/afd550b5-1b89-4200-b630-e6ea4ec683dc-kube-api-access-bp522\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.810665 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.862534 4769 scope.go:117] "RemoveContainer" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" Nov 21 13:25:48 crc kubenswrapper[4769]: E1121 13:25:48.864601 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34\": container with ID starting with cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34 not found: ID does not exist" containerID="cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.864648 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34"} err="failed to get container status \"cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34\": rpc error: code = NotFound desc = could not find container \"cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34\": container with ID starting with cefb9952361f49a9ca3dd4f70d310e827b669ffa2fb1b48c5452d0ae207b5c34 not found: ID does not exist" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.885118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.899783 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.913833 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:48 crc kubenswrapper[4769]: E1121 13:25:48.914395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="afd550b5-1b89-4200-b630-e6ea4ec683dc" containerName="nova-scheduler-scheduler" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.914490 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="afd550b5-1b89-4200-b630-e6ea4ec683dc" containerName="nova-scheduler-scheduler" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.914718 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="afd550b5-1b89-4200-b630-e6ea4ec683dc" containerName="nova-scheduler-scheduler" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.915304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.915442 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.935466 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.994744 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.997147 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-792hs\" (UniqueName: \"kubernetes.io/projected/0ceb97ce-6cbf-4730-929d-d449a402ac5f-kube-api-access-792hs\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.997283 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-config-data\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:48 crc kubenswrapper[4769]: I1121 13:25:48.997362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.099878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-config-data\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.100168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.100275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-792hs\" (UniqueName: \"kubernetes.io/projected/0ceb97ce-6cbf-4730-929d-d449a402ac5f-kube-api-access-792hs\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.105743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-config-data\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.106288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.121788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-792hs\" (UniqueName: \"kubernetes.io/projected/0ceb97ce-6cbf-4730-929d-d449a402ac5f-kube-api-access-792hs\") pod \"nova-scheduler-0\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.262930 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.290321 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50851f2b-461e-4e6a-8189-ba6c7ccd3d5b" path="/var/lib/kubelet/pods/50851f2b-461e-4e6a-8189-ba6c7ccd3d5b/volumes" Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.291005 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afd550b5-1b89-4200-b630-e6ea4ec683dc" path="/var/lib/kubelet/pods/afd550b5-1b89-4200-b630-e6ea4ec683dc/volumes" Nov 21 13:25:49 crc kubenswrapper[4769]: W1121 13:25:49.779267 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ceb97ce_6cbf_4730_929d_d449a402ac5f.slice/crio-f6b321ffbe5dc48b1ad8a6677e3c77480c3b63cb807cbcb474ffb512f5c4d058 WatchSource:0}: Error finding container f6b321ffbe5dc48b1ad8a6677e3c77480c3b63cb807cbcb474ffb512f5c4d058: Status 404 returned error can't find the container with id f6b321ffbe5dc48b1ad8a6677e3c77480c3b63cb807cbcb474ffb512f5c4d058 Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.787085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4530dcef-df4a-4e18-9e83-810d74a8b6cc","Type":"ContainerStarted","Data":"8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74"} Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.787131 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4530dcef-df4a-4e18-9e83-810d74a8b6cc","Type":"ContainerStarted","Data":"5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf"} Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.787144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4530dcef-df4a-4e18-9e83-810d74a8b6cc","Type":"ContainerStarted","Data":"271d8d059d9e8b4c9cc982565239b188e804c00eae93fd32a093f731123b0fb6"} Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.790234 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:25:49 crc kubenswrapper[4769]: I1121 13:25:49.809931 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.809910352 podStartE2EDuration="2.809910352s" podCreationTimestamp="2025-11-21 13:25:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:49.809262535 +0000 UTC m=+5708.509924363" watchObservedRunningTime="2025-11-21 13:25:49.809910352 +0000 UTC m=+5708.510572170" Nov 21 13:25:50 crc kubenswrapper[4769]: I1121 13:25:50.807308 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0ceb97ce-6cbf-4730-929d-d449a402ac5f","Type":"ContainerStarted","Data":"2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192"} Nov 21 13:25:50 crc kubenswrapper[4769]: I1121 13:25:50.807738 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0ceb97ce-6cbf-4730-929d-d449a402ac5f","Type":"ContainerStarted","Data":"f6b321ffbe5dc48b1ad8a6677e3c77480c3b63cb807cbcb474ffb512f5c4d058"} Nov 21 13:25:50 crc kubenswrapper[4769]: I1121 13:25:50.836551 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.836525141 podStartE2EDuration="2.836525141s" podCreationTimestamp="2025-11-21 13:25:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:25:50.823559122 +0000 UTC m=+5709.524220930" watchObservedRunningTime="2025-11-21 13:25:50.836525141 +0000 UTC m=+5709.537186979" Nov 21 13:25:52 crc kubenswrapper[4769]: I1121 13:25:52.076131 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:52 crc kubenswrapper[4769]: I1121 13:25:52.076209 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:25:52 crc kubenswrapper[4769]: I1121 13:25:52.833079 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:52.834056 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="2ae49068-2bd3-4e26-9f64-aacec87152cd" containerName="kube-state-metrics" containerID="cri-o://d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f" gracePeriod=30 Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.088339 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.254:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.135423 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.254:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.546059 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.608697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdbbc\" (UniqueName: \"kubernetes.io/projected/2ae49068-2bd3-4e26-9f64-aacec87152cd-kube-api-access-hdbbc\") pod \"2ae49068-2bd3-4e26-9f64-aacec87152cd\" (UID: \"2ae49068-2bd3-4e26-9f64-aacec87152cd\") " Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.616690 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ae49068-2bd3-4e26-9f64-aacec87152cd-kube-api-access-hdbbc" (OuterVolumeSpecName: "kube-api-access-hdbbc") pod "2ae49068-2bd3-4e26-9f64-aacec87152cd" (UID: "2ae49068-2bd3-4e26-9f64-aacec87152cd"). InnerVolumeSpecName "kube-api-access-hdbbc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.710490 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hdbbc\" (UniqueName: \"kubernetes.io/projected/2ae49068-2bd3-4e26-9f64-aacec87152cd-kube-api-access-hdbbc\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.832765 4769 generic.go:334] "Generic (PLEG): container finished" podID="2ae49068-2bd3-4e26-9f64-aacec87152cd" containerID="d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f" exitCode=2 Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.832813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2ae49068-2bd3-4e26-9f64-aacec87152cd","Type":"ContainerDied","Data":"d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f"} Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.832840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"2ae49068-2bd3-4e26-9f64-aacec87152cd","Type":"ContainerDied","Data":"874a1bcbe19f370f692b77f5c5de63357c9b3f5e46dba5720c20a4cdcd118b5f"} Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.832860 4769 scope.go:117] "RemoveContainer" containerID="d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.833237 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.856878 4769 scope.go:117] "RemoveContainer" containerID="d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f" Nov 21 13:25:53 crc kubenswrapper[4769]: E1121 13:25:53.857425 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f\": container with ID starting with d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f not found: ID does not exist" containerID="d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.857524 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f"} err="failed to get container status \"d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f\": rpc error: code = NotFound desc = could not find container \"d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f\": container with ID starting with d4af4a00182a3e78dcf8c52d68e746ae8ded427dff9f8b5bab64ee188b854e6f not found: ID does not exist" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.868746 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.877171 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.892926 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:25:53 crc kubenswrapper[4769]: E1121 13:25:53.893634 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2ae49068-2bd3-4e26-9f64-aacec87152cd" containerName="kube-state-metrics" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.893748 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ae49068-2bd3-4e26-9f64-aacec87152cd" containerName="kube-state-metrics" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.894083 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2ae49068-2bd3-4e26-9f64-aacec87152cd" containerName="kube-state-metrics" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.895097 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.897364 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-kube-state-metrics-svc" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.897366 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"kube-state-metrics-tls-config" Nov 21 13:25:53 crc kubenswrapper[4769]: I1121 13:25:53.909001 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.028082 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.028325 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.028411 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74sc\" (UniqueName: \"kubernetes.io/projected/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-api-access-z74sc\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.028454 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.129860 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.129955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.130042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.130436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z74sc\" (UniqueName: \"kubernetes.io/projected/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-api-access-z74sc\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.138420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.138627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.141092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.149919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74sc\" (UniqueName: \"kubernetes.io/projected/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-api-access-z74sc\") pod \"kube-state-metrics-0\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.210632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:54 crc kubenswrapper[4769]: I1121 13:25:54.728062 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.156123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.190671 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.192426 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-central-agent" containerID="cri-o://73faa59c25bed7d4ffac8615bd62a21bc2b6d20d2b06a24c60a4b81702613089" gracePeriod=30 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.192912 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="proxy-httpd" containerID="cri-o://082a19cab89f227c74cf55101c013c8ca8dbdf990d6b326793e61d60674d329a" gracePeriod=30 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.193045 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="sg-core" containerID="cri-o://c024ea2a802fdb3564e5621481769b1ba7b87092c6c96e72b8b08f9c4ff54ae6" gracePeriod=30 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.193115 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-notification-agent" containerID="cri-o://a1ca1e2ecbc3f5d4c1548eb1104849b2e264fa9f88869507f0096fd5dc8fb820" gracePeriod=30 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.286653 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ae49068-2bd3-4e26-9f64-aacec87152cd" path="/var/lib/kubelet/pods/2ae49068-2bd3-4e26-9f64-aacec87152cd/volumes" Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.864298 4769 generic.go:334] "Generic (PLEG): container finished" podID="1609faa6-20fa-4ce9-b000-37a193840188" containerID="082a19cab89f227c74cf55101c013c8ca8dbdf990d6b326793e61d60674d329a" exitCode=0 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.864329 4769 generic.go:334] "Generic (PLEG): container finished" podID="1609faa6-20fa-4ce9-b000-37a193840188" containerID="c024ea2a802fdb3564e5621481769b1ba7b87092c6c96e72b8b08f9c4ff54ae6" exitCode=2 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.864355 4769 generic.go:334] "Generic (PLEG): container finished" podID="1609faa6-20fa-4ce9-b000-37a193840188" containerID="73faa59c25bed7d4ffac8615bd62a21bc2b6d20d2b06a24c60a4b81702613089" exitCode=0 Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.864395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerDied","Data":"082a19cab89f227c74cf55101c013c8ca8dbdf990d6b326793e61d60674d329a"} Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.864433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerDied","Data":"c024ea2a802fdb3564e5621481769b1ba7b87092c6c96e72b8b08f9c4ff54ae6"} Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.864442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerDied","Data":"73faa59c25bed7d4ffac8615bd62a21bc2b6d20d2b06a24c60a4b81702613089"} Nov 21 13:25:55 crc kubenswrapper[4769]: I1121 13:25:55.865981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9","Type":"ContainerStarted","Data":"edc114cb006adf81af7ff52b81dd6e9bcfa86331584a3a343eb6eb3e1462dcd7"} Nov 21 13:25:56 crc kubenswrapper[4769]: I1121 13:25:56.876356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9","Type":"ContainerStarted","Data":"a363390d2addd7f62f663622f1c5f901c98980c4dcfe65b7aec2e4a68946b7f8"} Nov 21 13:25:56 crc kubenswrapper[4769]: I1121 13:25:56.876665 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:25:56 crc kubenswrapper[4769]: I1121 13:25:56.899316 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.8571784239999998 podStartE2EDuration="3.899295379s" podCreationTimestamp="2025-11-21 13:25:53 +0000 UTC" firstStartedPulling="2025-11-21 13:25:55.148872252 +0000 UTC m=+5713.849534070" lastFinishedPulling="2025-11-21 13:25:56.190989207 +0000 UTC m=+5714.891651025" observedRunningTime="2025-11-21 13:25:56.894913421 +0000 UTC m=+5715.595575239" watchObservedRunningTime="2025-11-21 13:25:56.899295379 +0000 UTC m=+5715.599957197" Nov 21 13:25:57 crc kubenswrapper[4769]: I1121 13:25:57.287903 4769 scope.go:117] "RemoveContainer" containerID="240fbceb280f0466787fb0af67fb6f961f5bff07573b4aa015615e3e197d9640" Nov 21 13:25:57 crc kubenswrapper[4769]: I1121 13:25:57.321702 4769 scope.go:117] "RemoveContainer" containerID="36b1bf769252086e38877bb15f5ce07c690500262ecd2aefe2205876a7ab2812" Nov 21 13:25:57 crc kubenswrapper[4769]: I1121 13:25:57.888384 4769 generic.go:334] "Generic (PLEG): container finished" podID="1609faa6-20fa-4ce9-b000-37a193840188" containerID="a1ca1e2ecbc3f5d4c1548eb1104849b2e264fa9f88869507f0096fd5dc8fb820" exitCode=0 Nov 21 13:25:57 crc kubenswrapper[4769]: I1121 13:25:57.888450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerDied","Data":"a1ca1e2ecbc3f5d4c1548eb1104849b2e264fa9f88869507f0096fd5dc8fb820"} Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.245660 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.245730 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.631239 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.755948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-scripts\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-config-data\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-log-httpd\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86gcn\" (UniqueName: \"kubernetes.io/projected/1609faa6-20fa-4ce9-b000-37a193840188-kube-api-access-86gcn\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-combined-ca-bundle\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-sg-core-conf-yaml\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756434 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-run-httpd\") pod \"1609faa6-20fa-4ce9-b000-37a193840188\" (UID: \"1609faa6-20fa-4ce9-b000-37a193840188\") " Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.756692 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.757045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.757211 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.757238 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1609faa6-20fa-4ce9-b000-37a193840188-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.764352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-scripts" (OuterVolumeSpecName: "scripts") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.788087 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.790531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1609faa6-20fa-4ce9-b000-37a193840188-kube-api-access-86gcn" (OuterVolumeSpecName: "kube-api-access-86gcn") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "kube-api-access-86gcn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.852971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.859230 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.859270 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.859287 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-86gcn\" (UniqueName: \"kubernetes.io/projected/1609faa6-20fa-4ce9-b000-37a193840188-kube-api-access-86gcn\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.859300 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.872118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-config-data" (OuterVolumeSpecName: "config-data") pod "1609faa6-20fa-4ce9-b000-37a193840188" (UID: "1609faa6-20fa-4ce9-b000-37a193840188"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.901408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1609faa6-20fa-4ce9-b000-37a193840188","Type":"ContainerDied","Data":"c9a885441cf10868fe9d2464f676f472479c824c8f994a382e3e389a4ed0f661"} Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.901462 4769 scope.go:117] "RemoveContainer" containerID="082a19cab89f227c74cf55101c013c8ca8dbdf990d6b326793e61d60674d329a" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.901491 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.951513 4769 scope.go:117] "RemoveContainer" containerID="c024ea2a802fdb3564e5621481769b1ba7b87092c6c96e72b8b08f9c4ff54ae6" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.960796 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1609faa6-20fa-4ce9-b000-37a193840188-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.977091 4769 scope.go:117] "RemoveContainer" containerID="a1ca1e2ecbc3f5d4c1548eb1104849b2e264fa9f88869507f0096fd5dc8fb820" Nov 21 13:25:58 crc kubenswrapper[4769]: I1121 13:25:58.979409 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.005791 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.011364 4769 scope.go:117] "RemoveContainer" containerID="73faa59c25bed7d4ffac8615bd62a21bc2b6d20d2b06a24c60a4b81702613089" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.013974 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:59 crc kubenswrapper[4769]: E1121 13:25:59.014413 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-notification-agent" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014429 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-notification-agent" Nov 21 13:25:59 crc kubenswrapper[4769]: E1121 13:25:59.014452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-central-agent" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014460 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-central-agent" Nov 21 13:25:59 crc kubenswrapper[4769]: E1121 13:25:59.014473 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="sg-core" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014479 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="sg-core" Nov 21 13:25:59 crc kubenswrapper[4769]: E1121 13:25:59.014490 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="proxy-httpd" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014495 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="proxy-httpd" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014670 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="proxy-httpd" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="sg-core" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014702 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-notification-agent" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.014719 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1609faa6-20fa-4ce9-b000-37a193840188" containerName="ceilometer-central-agent" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.016358 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.026748 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.027467 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.027617 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.091355 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-scripts\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnrt\" (UniqueName: \"kubernetes.io/projected/7188b2b8-147b-473c-8bc0-edc88a4a3a23-kube-api-access-qtnrt\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-run-httpd\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-log-httpd\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181717 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-config-data\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181750 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.181807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.266507 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283274 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283346 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-scripts\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnrt\" (UniqueName: \"kubernetes.io/projected/7188b2b8-147b-473c-8bc0-edc88a4a3a23-kube-api-access-qtnrt\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-run-httpd\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-log-httpd\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-config-data\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.283537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.286125 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1609faa6-20fa-4ce9-b000-37a193840188" path="/var/lib/kubelet/pods/1609faa6-20fa-4ce9-b000-37a193840188/volumes" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.286732 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-run-httpd\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.286817 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-log-httpd\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.287373 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.255:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.287406 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.255:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.290879 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.291295 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-scripts\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.291734 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-config-data\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.300736 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.312843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnrt\" (UniqueName: \"kubernetes.io/projected/7188b2b8-147b-473c-8bc0-edc88a4a3a23-kube-api-access-qtnrt\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.316972 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.331872 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.385253 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.859089 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.911767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerStarted","Data":"f50bc92ca65bc55c91d751810914f7328c8e39588f01bbc274a5b93f621af0a9"} Nov 21 13:25:59 crc kubenswrapper[4769]: I1121 13:25:59.944521 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:01 crc kubenswrapper[4769]: I1121 13:26:01.931847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerStarted","Data":"cc22436b4f70fd95ac3f0c3211c09ca516d1c238a5691b34c6c803ca8e9b5882"} Nov 21 13:26:02 crc kubenswrapper[4769]: I1121 13:26:02.084836 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:02 crc kubenswrapper[4769]: I1121 13:26:02.088414 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:02 crc kubenswrapper[4769]: I1121 13:26:02.093144 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:02 crc kubenswrapper[4769]: I1121 13:26:02.958237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerStarted","Data":"e1bce2527d4029ad5e45ad9a03cd8cf91d169ddba70f9973ec09ad4f54014a53"} Nov 21 13:26:02 crc kubenswrapper[4769]: I1121 13:26:02.964080 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:03 crc kubenswrapper[4769]: I1121 13:26:03.965211 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerStarted","Data":"79a84896c7bb29f8401ef3908e4ac49ab8086268c54a4182a80a7ce6f39b8ac5"} Nov 21 13:26:04 crc kubenswrapper[4769]: I1121 13:26:04.221514 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:26:05 crc kubenswrapper[4769]: I1121 13:26:05.984922 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d77dade-4b4d-433c-8fba-b99098b19fa8" containerID="91b7d2f78e02c9a15743e06682ccf76288024c1e88cfc65e567a567345670ac8" exitCode=0 Nov 21 13:26:05 crc kubenswrapper[4769]: I1121 13:26:05.985037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" event={"ID":"6d77dade-4b4d-433c-8fba-b99098b19fa8","Type":"ContainerDied","Data":"91b7d2f78e02c9a15743e06682ccf76288024c1e88cfc65e567a567345670ac8"} Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.002685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerStarted","Data":"106f6a415024a974570a6d0f69daf9d0fff7181fc9b5cba0e57399398c832e7e"} Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.002945 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.045500 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.431133477 podStartE2EDuration="9.045482041s" podCreationTimestamp="2025-11-21 13:25:58 +0000 UTC" firstStartedPulling="2025-11-21 13:25:59.85900336 +0000 UTC m=+5718.559665178" lastFinishedPulling="2025-11-21 13:26:06.473351914 +0000 UTC m=+5725.174013742" observedRunningTime="2025-11-21 13:26:07.027454656 +0000 UTC m=+5725.728116484" watchObservedRunningTime="2025-11-21 13:26:07.045482041 +0000 UTC m=+5725.746143869" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.464747 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.556913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-config-data\") pod \"6d77dade-4b4d-433c-8fba-b99098b19fa8\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.556981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-scripts\") pod \"6d77dade-4b4d-433c-8fba-b99098b19fa8\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.557132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-combined-ca-bundle\") pod \"6d77dade-4b4d-433c-8fba-b99098b19fa8\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.557855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw5fq\" (UniqueName: \"kubernetes.io/projected/6d77dade-4b4d-433c-8fba-b99098b19fa8-kube-api-access-sw5fq\") pod \"6d77dade-4b4d-433c-8fba-b99098b19fa8\" (UID: \"6d77dade-4b4d-433c-8fba-b99098b19fa8\") " Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.563149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-scripts" (OuterVolumeSpecName: "scripts") pod "6d77dade-4b4d-433c-8fba-b99098b19fa8" (UID: "6d77dade-4b4d-433c-8fba-b99098b19fa8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.563671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d77dade-4b4d-433c-8fba-b99098b19fa8-kube-api-access-sw5fq" (OuterVolumeSpecName: "kube-api-access-sw5fq") pod "6d77dade-4b4d-433c-8fba-b99098b19fa8" (UID: "6d77dade-4b4d-433c-8fba-b99098b19fa8"). InnerVolumeSpecName "kube-api-access-sw5fq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.588315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d77dade-4b4d-433c-8fba-b99098b19fa8" (UID: "6d77dade-4b4d-433c-8fba-b99098b19fa8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.612216 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-config-data" (OuterVolumeSpecName: "config-data") pod "6d77dade-4b4d-433c-8fba-b99098b19fa8" (UID: "6d77dade-4b4d-433c-8fba-b99098b19fa8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.662159 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.662258 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.662278 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sw5fq\" (UniqueName: \"kubernetes.io/projected/6d77dade-4b4d-433c-8fba-b99098b19fa8-kube-api-access-sw5fq\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:07 crc kubenswrapper[4769]: I1121 13:26:07.662328 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d77dade-4b4d-433c-8fba-b99098b19fa8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.012509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" event={"ID":"6d77dade-4b4d-433c-8fba-b99098b19fa8","Type":"ContainerDied","Data":"220a89261ce96d82e55c96399f295174a92077bff06d8c01d2598d685f05f460"} Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.012571 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="220a89261ce96d82e55c96399f295174a92077bff06d8c01d2598d685f05f460" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.012726 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.104802 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:26:08 crc kubenswrapper[4769]: E1121 13:26:08.105177 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d77dade-4b4d-433c-8fba-b99098b19fa8" containerName="nova-cell1-conductor-db-sync" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.105211 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d77dade-4b4d-433c-8fba-b99098b19fa8" containerName="nova-cell1-conductor-db-sync" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.105429 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d77dade-4b4d-433c-8fba-b99098b19fa8" containerName="nova-cell1-conductor-db-sync" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.106068 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.107973 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-conductor-config-data" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.120677 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.171113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.171234 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kc6q\" (UniqueName: \"kubernetes.io/projected/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-kube-api-access-6kc6q\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.171584 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.249806 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.250392 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.250449 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.253244 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.272999 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.273118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.273207 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6kc6q\" (UniqueName: \"kubernetes.io/projected/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-kube-api-access-6kc6q\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.276932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.276969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.299947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kc6q\" (UniqueName: \"kubernetes.io/projected/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-kube-api-access-6kc6q\") pod \"nova-cell1-conductor-0\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.435154 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:08 crc kubenswrapper[4769]: I1121 13:26:08.946672 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:26:09 crc kubenswrapper[4769]: I1121 13:26:09.024555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd","Type":"ContainerStarted","Data":"43e33afe3cbea2be313a956d551724f59427a46d1ed3adb1139f1cf80c5e3d70"} Nov 21 13:26:09 crc kubenswrapper[4769]: I1121 13:26:09.025015 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:09 crc kubenswrapper[4769]: I1121 13:26:09.030990 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:10 crc kubenswrapper[4769]: I1121 13:26:10.036243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd","Type":"ContainerStarted","Data":"3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501"} Nov 21 13:26:10 crc kubenswrapper[4769]: I1121 13:26:10.068465 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.068447895 podStartE2EDuration="2.068447895s" podCreationTimestamp="2025-11-21 13:26:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:26:10.067000936 +0000 UTC m=+5728.767662754" watchObservedRunningTime="2025-11-21 13:26:10.068447895 +0000 UTC m=+5728.769109713" Nov 21 13:26:11 crc kubenswrapper[4769]: I1121 13:26:11.049715 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:11 crc kubenswrapper[4769]: I1121 13:26:11.524655 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:11 crc kubenswrapper[4769]: I1121 13:26:11.525225 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-central-agent" containerID="cri-o://cc22436b4f70fd95ac3f0c3211c09ca516d1c238a5691b34c6c803ca8e9b5882" gracePeriod=30 Nov 21 13:26:11 crc kubenswrapper[4769]: I1121 13:26:11.525279 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="proxy-httpd" containerID="cri-o://106f6a415024a974570a6d0f69daf9d0fff7181fc9b5cba0e57399398c832e7e" gracePeriod=30 Nov 21 13:26:11 crc kubenswrapper[4769]: I1121 13:26:11.525336 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="sg-core" containerID="cri-o://79a84896c7bb29f8401ef3908e4ac49ab8086268c54a4182a80a7ce6f39b8ac5" gracePeriod=30 Nov 21 13:26:11 crc kubenswrapper[4769]: I1121 13:26:11.525304 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-notification-agent" containerID="cri-o://e1bce2527d4029ad5e45ad9a03cd8cf91d169ddba70f9973ec09ad4f54014a53" gracePeriod=30 Nov 21 13:26:12 crc kubenswrapper[4769]: I1121 13:26:12.318815 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:12 crc kubenswrapper[4769]: I1121 13:26:12.319390 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-log" containerID="cri-o://5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf" gracePeriod=30 Nov 21 13:26:12 crc kubenswrapper[4769]: I1121 13:26:12.319473 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-api" containerID="cri-o://8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74" gracePeriod=30 Nov 21 13:26:13 crc kubenswrapper[4769]: I1121 13:26:13.069564 4769 generic.go:334] "Generic (PLEG): container finished" podID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerID="106f6a415024a974570a6d0f69daf9d0fff7181fc9b5cba0e57399398c832e7e" exitCode=0 Nov 21 13:26:13 crc kubenswrapper[4769]: I1121 13:26:13.069604 4769 generic.go:334] "Generic (PLEG): container finished" podID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerID="79a84896c7bb29f8401ef3908e4ac49ab8086268c54a4182a80a7ce6f39b8ac5" exitCode=2 Nov 21 13:26:13 crc kubenswrapper[4769]: I1121 13:26:13.069628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerDied","Data":"106f6a415024a974570a6d0f69daf9d0fff7181fc9b5cba0e57399398c832e7e"} Nov 21 13:26:13 crc kubenswrapper[4769]: I1121 13:26:13.069656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerDied","Data":"79a84896c7bb29f8401ef3908e4ac49ab8086268c54a4182a80a7ce6f39b8ac5"} Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.105354 4769 generic.go:334] "Generic (PLEG): container finished" podID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerID="5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf" exitCode=143 Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.105624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4530dcef-df4a-4e18-9e83-810d74a8b6cc","Type":"ContainerDied","Data":"5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf"} Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.107547 4769 generic.go:334] "Generic (PLEG): container finished" podID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerID="e1bce2527d4029ad5e45ad9a03cd8cf91d169ddba70f9973ec09ad4f54014a53" exitCode=0 Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.107565 4769 generic.go:334] "Generic (PLEG): container finished" podID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerID="cc22436b4f70fd95ac3f0c3211c09ca516d1c238a5691b34c6c803ca8e9b5882" exitCode=0 Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.107579 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerDied","Data":"e1bce2527d4029ad5e45ad9a03cd8cf91d169ddba70f9973ec09ad4f54014a53"} Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.107594 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerDied","Data":"cc22436b4f70fd95ac3f0c3211c09ca516d1c238a5691b34c6c803ca8e9b5882"} Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.418182 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-combined-ca-bundle\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-log-httpd\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtnrt\" (UniqueName: \"kubernetes.io/projected/7188b2b8-147b-473c-8bc0-edc88a4a3a23-kube-api-access-qtnrt\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527397 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-ceilometer-tls-certs\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-scripts\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-sg-core-conf-yaml\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527543 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-config-data\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-run-httpd\") pod \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\" (UID: \"7188b2b8-147b-473c-8bc0-edc88a4a3a23\") " Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.527930 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.528169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.533079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7188b2b8-147b-473c-8bc0-edc88a4a3a23-kube-api-access-qtnrt" (OuterVolumeSpecName: "kube-api-access-qtnrt") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "kube-api-access-qtnrt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.536847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-scripts" (OuterVolumeSpecName: "scripts") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.572832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.596504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.623665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.630673 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7188b2b8-147b-473c-8bc0-edc88a4a3a23-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.630753 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.630783 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qtnrt\" (UniqueName: \"kubernetes.io/projected/7188b2b8-147b-473c-8bc0-edc88a4a3a23-kube-api-access-qtnrt\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.630802 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.630819 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.630838 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.634450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-config-data" (OuterVolumeSpecName: "config-data") pod "7188b2b8-147b-473c-8bc0-edc88a4a3a23" (UID: "7188b2b8-147b-473c-8bc0-edc88a4a3a23"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:14 crc kubenswrapper[4769]: I1121 13:26:14.732776 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7188b2b8-147b-473c-8bc0-edc88a4a3a23-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.135531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7188b2b8-147b-473c-8bc0-edc88a4a3a23","Type":"ContainerDied","Data":"f50bc92ca65bc55c91d751810914f7328c8e39588f01bbc274a5b93f621af0a9"} Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.135997 4769 scope.go:117] "RemoveContainer" containerID="106f6a415024a974570a6d0f69daf9d0fff7181fc9b5cba0e57399398c832e7e" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.135641 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.168368 4769 scope.go:117] "RemoveContainer" containerID="79a84896c7bb29f8401ef3908e4ac49ab8086268c54a4182a80a7ce6f39b8ac5" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.209634 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.211748 4769 scope.go:117] "RemoveContainer" containerID="e1bce2527d4029ad5e45ad9a03cd8cf91d169ddba70f9973ec09ad4f54014a53" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.219587 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.227471 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:15 crc kubenswrapper[4769]: E1121 13:26:15.228876 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="proxy-httpd" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.228907 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="proxy-httpd" Nov 21 13:26:15 crc kubenswrapper[4769]: E1121 13:26:15.228933 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-notification-agent" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.228942 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-notification-agent" Nov 21 13:26:15 crc kubenswrapper[4769]: E1121 13:26:15.228963 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-central-agent" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.228975 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-central-agent" Nov 21 13:26:15 crc kubenswrapper[4769]: E1121 13:26:15.228991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="sg-core" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.228999 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="sg-core" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.229283 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-notification-agent" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.229305 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="proxy-httpd" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.229334 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="sg-core" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.229350 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" containerName="ceilometer-central-agent" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.231654 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.234084 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.234327 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.234464 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.237252 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.269459 4769 scope.go:117] "RemoveContainer" containerID="cc22436b4f70fd95ac3f0c3211c09ca516d1c238a5691b34c6c803ca8e9b5882" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.284663 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7188b2b8-147b-473c-8bc0-edc88a4a3a23" path="/var/lib/kubelet/pods/7188b2b8-147b-473c-8bc0-edc88a4a3a23/volumes" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-scripts\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-log-httpd\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355226 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-run-httpd\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355254 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv567\" (UniqueName: \"kubernetes.io/projected/a730999c-47e5-4dbe-aaf0-74ac82e83564-kube-api-access-xv567\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355282 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.355359 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-config-data\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.456782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-run-httpd\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.456857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xv567\" (UniqueName: \"kubernetes.io/projected/a730999c-47e5-4dbe-aaf0-74ac82e83564-kube-api-access-xv567\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.456908 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.456950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.457054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-config-data\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.457105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-scripts\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.457131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.457152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-log-httpd\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.458480 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-run-httpd\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.460269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-log-httpd\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.462972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.463263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.464480 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-scripts\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.465906 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.470505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-config-data\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.492919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv567\" (UniqueName: \"kubernetes.io/projected/a730999c-47e5-4dbe-aaf0-74ac82e83564-kube-api-access-xv567\") pod \"ceilometer-0\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.572433 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.629729 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:15 crc kubenswrapper[4769]: I1121 13:26:15.970883 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.073893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmkhq\" (UniqueName: \"kubernetes.io/projected/4530dcef-df4a-4e18-9e83-810d74a8b6cc-kube-api-access-gmkhq\") pod \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.073972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-config-data\") pod \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.074078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4530dcef-df4a-4e18-9e83-810d74a8b6cc-logs\") pod \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.074116 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-combined-ca-bundle\") pod \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\" (UID: \"4530dcef-df4a-4e18-9e83-810d74a8b6cc\") " Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.077338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4530dcef-df4a-4e18-9e83-810d74a8b6cc-logs" (OuterVolumeSpecName: "logs") pod "4530dcef-df4a-4e18-9e83-810d74a8b6cc" (UID: "4530dcef-df4a-4e18-9e83-810d74a8b6cc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.087653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4530dcef-df4a-4e18-9e83-810d74a8b6cc-kube-api-access-gmkhq" (OuterVolumeSpecName: "kube-api-access-gmkhq") pod "4530dcef-df4a-4e18-9e83-810d74a8b6cc" (UID: "4530dcef-df4a-4e18-9e83-810d74a8b6cc"). InnerVolumeSpecName "kube-api-access-gmkhq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.104722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4530dcef-df4a-4e18-9e83-810d74a8b6cc" (UID: "4530dcef-df4a-4e18-9e83-810d74a8b6cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.105230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-config-data" (OuterVolumeSpecName: "config-data") pod "4530dcef-df4a-4e18-9e83-810d74a8b6cc" (UID: "4530dcef-df4a-4e18-9e83-810d74a8b6cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.148988 4769 generic.go:334] "Generic (PLEG): container finished" podID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerID="8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74" exitCode=0 Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.149031 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4530dcef-df4a-4e18-9e83-810d74a8b6cc","Type":"ContainerDied","Data":"8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74"} Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.149057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4530dcef-df4a-4e18-9e83-810d74a8b6cc","Type":"ContainerDied","Data":"271d8d059d9e8b4c9cc982565239b188e804c00eae93fd32a093f731123b0fb6"} Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.149078 4769 scope.go:117] "RemoveContainer" containerID="8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.149262 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.173047 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.177447 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gmkhq\" (UniqueName: \"kubernetes.io/projected/4530dcef-df4a-4e18-9e83-810d74a8b6cc-kube-api-access-gmkhq\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.177480 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.177496 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4530dcef-df4a-4e18-9e83-810d74a8b6cc-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.177510 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4530dcef-df4a-4e18-9e83-810d74a8b6cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.181723 4769 scope.go:117] "RemoveContainer" containerID="5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf" Nov 21 13:26:16 crc kubenswrapper[4769]: W1121 13:26:16.194093 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda730999c_47e5_4dbe_aaf0_74ac82e83564.slice/crio-60d361651bb3ebafd7ad97ef3f2e61bba9411ddf8d87c36c6240d129ac5b95cf WatchSource:0}: Error finding container 60d361651bb3ebafd7ad97ef3f2e61bba9411ddf8d87c36c6240d129ac5b95cf: Status 404 returned error can't find the container with id 60d361651bb3ebafd7ad97ef3f2e61bba9411ddf8d87c36c6240d129ac5b95cf Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.208078 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.217760 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.219816 4769 scope.go:117] "RemoveContainer" containerID="8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74" Nov 21 13:26:16 crc kubenswrapper[4769]: E1121 13:26:16.220501 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74\": container with ID starting with 8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74 not found: ID does not exist" containerID="8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.220549 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74"} err="failed to get container status \"8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74\": rpc error: code = NotFound desc = could not find container \"8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74\": container with ID starting with 8c5017901ad9aaf3037a25171617420fdf20dd391ddb0f0ad64090c64438eb74 not found: ID does not exist" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.220581 4769 scope.go:117] "RemoveContainer" containerID="5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf" Nov 21 13:26:16 crc kubenswrapper[4769]: E1121 13:26:16.220963 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf\": container with ID starting with 5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf not found: ID does not exist" containerID="5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.220984 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf"} err="failed to get container status \"5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf\": rpc error: code = NotFound desc = could not find container \"5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf\": container with ID starting with 5f6955fc93a940612fa79c76e5c2bbc8a5b2a72819b0ecfbcbea0010a7f36ecf not found: ID does not exist" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.227062 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:16 crc kubenswrapper[4769]: E1121 13:26:16.228994 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-log" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.229015 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-log" Nov 21 13:26:16 crc kubenswrapper[4769]: E1121 13:26:16.229051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-api" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.229059 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-api" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.229242 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-api" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.229258 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" containerName="nova-api-log" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.230230 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.232326 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.232574 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.232653 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.242114 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.381002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-public-tls-certs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.381536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-logs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.381591 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-config-data\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.381630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.381658 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wkvc\" (UniqueName: \"kubernetes.io/projected/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-kube-api-access-8wkvc\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.381709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.483824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.484010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-public-tls-certs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.484063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-logs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.484115 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-config-data\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.484156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.484210 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8wkvc\" (UniqueName: \"kubernetes.io/projected/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-kube-api-access-8wkvc\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.485729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-logs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.488143 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.489356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-public-tls-certs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.489910 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.492089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-config-data\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.518517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wkvc\" (UniqueName: \"kubernetes.io/projected/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-kube-api-access-8wkvc\") pod \"nova-api-0\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:16 crc kubenswrapper[4769]: I1121 13:26:16.551966 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:17 crc kubenswrapper[4769]: I1121 13:26:17.045761 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:17 crc kubenswrapper[4769]: W1121 13:26:17.055309 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4d5fc85_f6b5_4f56_aa07_fc0ee696f6fa.slice/crio-86cc4f59d66b12e8b227d3d9faadfc16fab4c2c04fc60ba790ecf50dfc87559c WatchSource:0}: Error finding container 86cc4f59d66b12e8b227d3d9faadfc16fab4c2c04fc60ba790ecf50dfc87559c: Status 404 returned error can't find the container with id 86cc4f59d66b12e8b227d3d9faadfc16fab4c2c04fc60ba790ecf50dfc87559c Nov 21 13:26:17 crc kubenswrapper[4769]: I1121 13:26:17.162400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa","Type":"ContainerStarted","Data":"86cc4f59d66b12e8b227d3d9faadfc16fab4c2c04fc60ba790ecf50dfc87559c"} Nov 21 13:26:17 crc kubenswrapper[4769]: I1121 13:26:17.164035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerStarted","Data":"60d361651bb3ebafd7ad97ef3f2e61bba9411ddf8d87c36c6240d129ac5b95cf"} Nov 21 13:26:17 crc kubenswrapper[4769]: I1121 13:26:17.285670 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4530dcef-df4a-4e18-9e83-810d74a8b6cc" path="/var/lib/kubelet/pods/4530dcef-df4a-4e18-9e83-810d74a8b6cc/volumes" Nov 21 13:26:18 crc kubenswrapper[4769]: I1121 13:26:18.180132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa","Type":"ContainerStarted","Data":"f299a0bf68542ef5dc1da626f0a89a14b9adc331dfb56a47bbd635bc451e02cd"} Nov 21 13:26:18 crc kubenswrapper[4769]: I1121 13:26:18.522819 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.189812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa","Type":"ContainerStarted","Data":"73c6854305d761f93a516805fb4efbe611700186cb86398b1a1016e7a5a4d631"} Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.212287 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.212265742 podStartE2EDuration="3.212265742s" podCreationTimestamp="2025-11-21 13:26:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:26:19.211201823 +0000 UTC m=+5737.911863641" watchObservedRunningTime="2025-11-21 13:26:19.212265742 +0000 UTC m=+5737.912927560" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.233570 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk"] Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.234740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.236344 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-config-data" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.236529 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-manage-scripts" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.278254 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk"] Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.337797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5twp\" (UniqueName: \"kubernetes.io/projected/f04a110e-5f5a-43e2-8e67-6266212050a1-kube-api-access-b5twp\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.337845 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-scripts\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.338429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-config-data\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.338609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.440688 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-config-data\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.440775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.440882 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b5twp\" (UniqueName: \"kubernetes.io/projected/f04a110e-5f5a-43e2-8e67-6266212050a1-kube-api-access-b5twp\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.441619 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-scripts\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.445726 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-scripts\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.445829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-config-data\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.445936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.460653 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5twp\" (UniqueName: \"kubernetes.io/projected/f04a110e-5f5a-43e2-8e67-6266212050a1-kube-api-access-b5twp\") pod \"nova-cell1-cell-mapping-5dhrk\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:19 crc kubenswrapper[4769]: I1121 13:26:19.550656 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:20 crc kubenswrapper[4769]: I1121 13:26:20.002608 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk"] Nov 21 13:26:20 crc kubenswrapper[4769]: W1121 13:26:20.009878 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf04a110e_5f5a_43e2_8e67_6266212050a1.slice/crio-86d2ca0c153706781bd536f77f946b526dd447d5dc032ae04a998b06c4b16e26 WatchSource:0}: Error finding container 86d2ca0c153706781bd536f77f946b526dd447d5dc032ae04a998b06c4b16e26: Status 404 returned error can't find the container with id 86d2ca0c153706781bd536f77f946b526dd447d5dc032ae04a998b06c4b16e26 Nov 21 13:26:20 crc kubenswrapper[4769]: I1121 13:26:20.203210 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" event={"ID":"f04a110e-5f5a-43e2-8e67-6266212050a1","Type":"ContainerStarted","Data":"86d2ca0c153706781bd536f77f946b526dd447d5dc032ae04a998b06c4b16e26"} Nov 21 13:26:20 crc kubenswrapper[4769]: I1121 13:26:20.205231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerStarted","Data":"ea85f7c3b13df7e7472dd284239bc3d6a19a9ef34eed38c03e0ccac7ba99a948"} Nov 21 13:26:21 crc kubenswrapper[4769]: I1121 13:26:21.218126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" event={"ID":"f04a110e-5f5a-43e2-8e67-6266212050a1","Type":"ContainerStarted","Data":"7252c32c33ccf9d780e1002a6de97e266979582821c1eac37d469db1f16252ad"} Nov 21 13:26:21 crc kubenswrapper[4769]: I1121 13:26:21.248307 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" podStartSLOduration=2.248285354 podStartE2EDuration="2.248285354s" podCreationTimestamp="2025-11-21 13:26:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:26:21.239419316 +0000 UTC m=+5739.940081164" watchObservedRunningTime="2025-11-21 13:26:21.248285354 +0000 UTC m=+5739.948947182" Nov 21 13:26:23 crc kubenswrapper[4769]: I1121 13:26:23.238314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerStarted","Data":"57fd2c7e474b3882a7edc6c18ed3ed6463e98f36c779583674361c2748a347d2"} Nov 21 13:26:25 crc kubenswrapper[4769]: I1121 13:26:25.268047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerStarted","Data":"c46f3faad81ed60c667c4c4e62f6e41a3db354b330f34bcfc6c1c66adb2bdc74"} Nov 21 13:26:25 crc kubenswrapper[4769]: I1121 13:26:25.272383 4769 generic.go:334] "Generic (PLEG): container finished" podID="f04a110e-5f5a-43e2-8e67-6266212050a1" containerID="7252c32c33ccf9d780e1002a6de97e266979582821c1eac37d469db1f16252ad" exitCode=0 Nov 21 13:26:25 crc kubenswrapper[4769]: I1121 13:26:25.272430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" event={"ID":"f04a110e-5f5a-43e2-8e67-6266212050a1","Type":"ContainerDied","Data":"7252c32c33ccf9d780e1002a6de97e266979582821c1eac37d469db1f16252ad"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:26.554481 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:26.555677 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:26.845519 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.004853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-combined-ca-bundle\") pod \"f04a110e-5f5a-43e2-8e67-6266212050a1\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.004961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-scripts\") pod \"f04a110e-5f5a-43e2-8e67-6266212050a1\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.005028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-config-data\") pod \"f04a110e-5f5a-43e2-8e67-6266212050a1\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.005223 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5twp\" (UniqueName: \"kubernetes.io/projected/f04a110e-5f5a-43e2-8e67-6266212050a1-kube-api-access-b5twp\") pod \"f04a110e-5f5a-43e2-8e67-6266212050a1\" (UID: \"f04a110e-5f5a-43e2-8e67-6266212050a1\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.013250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-scripts" (OuterVolumeSpecName: "scripts") pod "f04a110e-5f5a-43e2-8e67-6266212050a1" (UID: "f04a110e-5f5a-43e2-8e67-6266212050a1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.013324 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04a110e-5f5a-43e2-8e67-6266212050a1-kube-api-access-b5twp" (OuterVolumeSpecName: "kube-api-access-b5twp") pod "f04a110e-5f5a-43e2-8e67-6266212050a1" (UID: "f04a110e-5f5a-43e2-8e67-6266212050a1"). InnerVolumeSpecName "kube-api-access-b5twp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.048505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-config-data" (OuterVolumeSpecName: "config-data") pod "f04a110e-5f5a-43e2-8e67-6266212050a1" (UID: "f04a110e-5f5a-43e2-8e67-6266212050a1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.069837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f04a110e-5f5a-43e2-8e67-6266212050a1" (UID: "f04a110e-5f5a-43e2-8e67-6266212050a1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.107666 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.107695 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.107709 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04a110e-5f5a-43e2-8e67-6266212050a1-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.107722 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b5twp\" (UniqueName: \"kubernetes.io/projected/f04a110e-5f5a-43e2-8e67-6266212050a1-kube-api-access-b5twp\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.300910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerStarted","Data":"0e8b4426501dc9a12337832dad107326297acb1d7b5124b2044e8f14f2e69b82"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.301099 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-central-agent" containerID="cri-o://ea85f7c3b13df7e7472dd284239bc3d6a19a9ef34eed38c03e0ccac7ba99a948" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.301691 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="proxy-httpd" containerID="cri-o://0e8b4426501dc9a12337832dad107326297acb1d7b5124b2044e8f14f2e69b82" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.301764 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.301767 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-notification-agent" containerID="cri-o://57fd2c7e474b3882a7edc6c18ed3ed6463e98f36c779583674361c2748a347d2" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.301799 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="sg-core" containerID="cri-o://c46f3faad81ed60c667c4c4e62f6e41a3db354b330f34bcfc6c1c66adb2bdc74" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.306398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" event={"ID":"f04a110e-5f5a-43e2-8e67-6266212050a1","Type":"ContainerDied","Data":"86d2ca0c153706781bd536f77f946b526dd447d5dc032ae04a998b06c4b16e26"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.306436 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86d2ca0c153706781bd536f77f946b526dd447d5dc032ae04a998b06c4b16e26" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.306435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.342821 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.911249706 podStartE2EDuration="12.342773428s" podCreationTimestamp="2025-11-21 13:26:15 +0000 UTC" firstStartedPulling="2025-11-21 13:26:16.1994153 +0000 UTC m=+5734.900077128" lastFinishedPulling="2025-11-21 13:26:26.630939012 +0000 UTC m=+5745.331600850" observedRunningTime="2025-11-21 13:26:27.327702632 +0000 UTC m=+5746.028364460" watchObservedRunningTime="2025-11-21 13:26:27.342773428 +0000 UTC m=+5746.043435256" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.429839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.445391 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.445634 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" containerName="nova-scheduler-scheduler" containerID="cri-o://2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.530696 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.530991 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-log" containerID="cri-o://81c4fc57a60049743c433e4b858d298d43b52ccc9ae8e6fbc402f6c8bc50ddb1" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.531102 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-metadata" containerID="cri-o://40483e213bbb8fb730f5881d5ce6648bdb67668c550c3c3946b3c47e4e682801" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.585526 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.5:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:27.585537 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.5:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323280 4769 generic.go:334] "Generic (PLEG): container finished" podID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerID="0e8b4426501dc9a12337832dad107326297acb1d7b5124b2044e8f14f2e69b82" exitCode=0 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323313 4769 generic.go:334] "Generic (PLEG): container finished" podID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerID="c46f3faad81ed60c667c4c4e62f6e41a3db354b330f34bcfc6c1c66adb2bdc74" exitCode=2 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323322 4769 generic.go:334] "Generic (PLEG): container finished" podID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerID="57fd2c7e474b3882a7edc6c18ed3ed6463e98f36c779583674361c2748a347d2" exitCode=0 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323332 4769 generic.go:334] "Generic (PLEG): container finished" podID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerID="ea85f7c3b13df7e7472dd284239bc3d6a19a9ef34eed38c03e0ccac7ba99a948" exitCode=0 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerDied","Data":"0e8b4426501dc9a12337832dad107326297acb1d7b5124b2044e8f14f2e69b82"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerDied","Data":"c46f3faad81ed60c667c4c4e62f6e41a3db354b330f34bcfc6c1c66adb2bdc74"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323471 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerDied","Data":"57fd2c7e474b3882a7edc6c18ed3ed6463e98f36c779583674361c2748a347d2"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.323485 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerDied","Data":"ea85f7c3b13df7e7472dd284239bc3d6a19a9ef34eed38c03e0ccac7ba99a948"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.325320 4769 generic.go:334] "Generic (PLEG): container finished" podID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerID="81c4fc57a60049743c433e4b858d298d43b52ccc9ae8e6fbc402f6c8bc50ddb1" exitCode=143 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.325498 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-log" containerID="cri-o://f299a0bf68542ef5dc1da626f0a89a14b9adc331dfb56a47bbd635bc451e02cd" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.325731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b3926aac-4463-4bba-9d2f-58c1b0e84a0b","Type":"ContainerDied","Data":"81c4fc57a60049743c433e4b858d298d43b52ccc9ae8e6fbc402f6c8bc50ddb1"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:28.326023 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-api" containerID="cri-o://73c6854305d761f93a516805fb4efbe611700186cb86398b1a1016e7a5a4d631" gracePeriod=30 Nov 21 13:26:29 crc kubenswrapper[4769]: E1121 13:26:29.265665 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192 is running failed: container process not found" containerID="2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:26:29 crc kubenswrapper[4769]: E1121 13:26:29.266388 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192 is running failed: container process not found" containerID="2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:26:29 crc kubenswrapper[4769]: E1121 13:26:29.267227 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192 is running failed: container process not found" containerID="2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:26:29 crc kubenswrapper[4769]: E1121 13:26:29.267314 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" containerName="nova-scheduler-scheduler" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.342567 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerID="f299a0bf68542ef5dc1da626f0a89a14b9adc331dfb56a47bbd635bc451e02cd" exitCode=143 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.342641 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa","Type":"ContainerDied","Data":"f299a0bf68542ef5dc1da626f0a89a14b9adc331dfb56a47bbd635bc451e02cd"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.345399 4769 generic.go:334] "Generic (PLEG): container finished" podID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" containerID="2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192" exitCode=0 Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.345450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0ceb97ce-6cbf-4730-929d-d449a402ac5f","Type":"ContainerDied","Data":"2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192"} Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.457909 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.462969 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.558828 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-config-data\") pod \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.558908 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-log-httpd\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.558948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-ceilometer-tls-certs\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.558975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-scripts\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559008 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-run-httpd\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-combined-ca-bundle\") pod \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-combined-ca-bundle\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559127 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv567\" (UniqueName: \"kubernetes.io/projected/a730999c-47e5-4dbe-aaf0-74ac82e83564-kube-api-access-xv567\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-config-data\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-sg-core-conf-yaml\") pod \"a730999c-47e5-4dbe-aaf0-74ac82e83564\" (UID: \"a730999c-47e5-4dbe-aaf0-74ac82e83564\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.559296 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-792hs\" (UniqueName: \"kubernetes.io/projected/0ceb97ce-6cbf-4730-929d-d449a402ac5f-kube-api-access-792hs\") pod \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\" (UID: \"0ceb97ce-6cbf-4730-929d-d449a402ac5f\") " Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.560829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.561038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.569342 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ceb97ce-6cbf-4730-929d-d449a402ac5f-kube-api-access-792hs" (OuterVolumeSpecName: "kube-api-access-792hs") pod "0ceb97ce-6cbf-4730-929d-d449a402ac5f" (UID: "0ceb97ce-6cbf-4730-929d-d449a402ac5f"). InnerVolumeSpecName "kube-api-access-792hs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.573681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-scripts" (OuterVolumeSpecName: "scripts") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.577530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a730999c-47e5-4dbe-aaf0-74ac82e83564-kube-api-access-xv567" (OuterVolumeSpecName: "kube-api-access-xv567") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "kube-api-access-xv567". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.615121 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-config-data" (OuterVolumeSpecName: "config-data") pod "0ceb97ce-6cbf-4730-929d-d449a402ac5f" (UID: "0ceb97ce-6cbf-4730-929d-d449a402ac5f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.623097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0ceb97ce-6cbf-4730-929d-d449a402ac5f" (UID: "0ceb97ce-6cbf-4730-929d-d449a402ac5f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.628917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.639448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661550 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661594 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-792hs\" (UniqueName: \"kubernetes.io/projected/0ceb97ce-6cbf-4730-929d-d449a402ac5f-kube-api-access-792hs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661611 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661624 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661637 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661649 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661660 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a730999c-47e5-4dbe-aaf0-74ac82e83564-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661672 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0ceb97ce-6cbf-4730-929d-d449a402ac5f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.661684 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xv567\" (UniqueName: \"kubernetes.io/projected/a730999c-47e5-4dbe-aaf0-74ac82e83564-kube-api-access-xv567\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.673812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.686839 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-config-data" (OuterVolumeSpecName: "config-data") pod "a730999c-47e5-4dbe-aaf0-74ac82e83564" (UID: "a730999c-47e5-4dbe-aaf0-74ac82e83564"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.763251 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:29 crc kubenswrapper[4769]: I1121 13:26:29.763282 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a730999c-47e5-4dbe-aaf0-74ac82e83564-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.369712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a730999c-47e5-4dbe-aaf0-74ac82e83564","Type":"ContainerDied","Data":"60d361651bb3ebafd7ad97ef3f2e61bba9411ddf8d87c36c6240d129ac5b95cf"} Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.369739 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.369782 4769 scope.go:117] "RemoveContainer" containerID="0e8b4426501dc9a12337832dad107326297acb1d7b5124b2044e8f14f2e69b82" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.373515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"0ceb97ce-6cbf-4730-929d-d449a402ac5f","Type":"ContainerDied","Data":"f6b321ffbe5dc48b1ad8a6677e3c77480c3b63cb807cbcb474ffb512f5c4d058"} Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.373586 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.413534 4769 scope.go:117] "RemoveContainer" containerID="c46f3faad81ed60c667c4c4e62f6e41a3db354b330f34bcfc6c1c66adb2bdc74" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.442342 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.469677 4769 scope.go:117] "RemoveContainer" containerID="57fd2c7e474b3882a7edc6c18ed3ed6463e98f36c779583674361c2748a347d2" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.474086 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.500374 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.505738 4769 scope.go:117] "RemoveContainer" containerID="ea85f7c3b13df7e7472dd284239bc3d6a19a9ef34eed38c03e0ccac7ba99a948" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.512078 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.518871 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: E1121 13:26:30.519458 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-notification-agent" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519485 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-notification-agent" Nov 21 13:26:30 crc kubenswrapper[4769]: E1121 13:26:30.519511 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f04a110e-5f5a-43e2-8e67-6266212050a1" containerName="nova-manage" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519523 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04a110e-5f5a-43e2-8e67-6266212050a1" containerName="nova-manage" Nov 21 13:26:30 crc kubenswrapper[4769]: E1121 13:26:30.519542 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-central-agent" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519550 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-central-agent" Nov 21 13:26:30 crc kubenswrapper[4769]: E1121 13:26:30.519581 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" containerName="nova-scheduler-scheduler" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519596 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" containerName="nova-scheduler-scheduler" Nov 21 13:26:30 crc kubenswrapper[4769]: E1121 13:26:30.519610 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="proxy-httpd" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519618 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="proxy-httpd" Nov 21 13:26:30 crc kubenswrapper[4769]: E1121 13:26:30.519644 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="sg-core" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519653 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="sg-core" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519896 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-notification-agent" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519930 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="sg-core" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519950 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="proxy-httpd" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519965 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" containerName="nova-scheduler-scheduler" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.519999 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f04a110e-5f5a-43e2-8e67-6266212050a1" containerName="nova-manage" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.520011 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" containerName="ceilometer-central-agent" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.522423 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.525212 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-ceilometer-internal-svc" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.525435 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-scripts" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.525570 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"ceilometer-config-data" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.525669 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.527182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.530821 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-scheduler-config-data" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.533035 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.539078 4769 scope.go:117] "RemoveContainer" containerID="2060f2c09c3c6fdc88445f4e9f89e90bd4ad2f4bc91c4ef2b2f614320ffee192" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.540992 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.582054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.583026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-config-data\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.684742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-config-data\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.684865 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.684897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.684934 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-log-httpd\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.684972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx4tx\" (UniqueName: \"kubernetes.io/projected/fdf41518-0738-4701-9482-fe17d9be8abf-kube-api-access-rx4tx\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.685019 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-scripts\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.685042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.685069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-config-data\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.685087 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-run-httpd\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.685111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tqjv\" (UniqueName: \"kubernetes.io/projected/8389f7ff-450d-41b9-88eb-c7c2929deccc-kube-api-access-9tqjv\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.685167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.691132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.698922 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-config-data\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.785896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786348 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-run-httpd\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9tqjv\" (UniqueName: \"kubernetes.io/projected/8389f7ff-450d-41b9-88eb-c7c2929deccc-kube-api-access-9tqjv\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-config-data\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786455 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786522 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-log-httpd\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786556 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rx4tx\" (UniqueName: \"kubernetes.io/projected/fdf41518-0738-4701-9482-fe17d9be8abf-kube-api-access-rx4tx\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.786605 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-scripts\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.787005 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-log-httpd\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.787324 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-run-httpd\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.790606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-scripts\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.792323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.793048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.794382 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-config-data\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.794765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.805813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx4tx\" (UniqueName: \"kubernetes.io/projected/fdf41518-0738-4701-9482-fe17d9be8abf-kube-api-access-rx4tx\") pod \"nova-scheduler-0\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.807907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tqjv\" (UniqueName: \"kubernetes.io/projected/8389f7ff-450d-41b9-88eb-c7c2929deccc-kube-api-access-9tqjv\") pod \"ceilometer-0\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.849479 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:30 crc kubenswrapper[4769]: I1121 13:26:30.862989 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.288815 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ceb97ce-6cbf-4730-929d-d449a402ac5f" path="/var/lib/kubelet/pods/0ceb97ce-6cbf-4730-929d-d449a402ac5f/volumes" Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.289923 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a730999c-47e5-4dbe-aaf0-74ac82e83564" path="/var/lib/kubelet/pods/a730999c-47e5-4dbe-aaf0-74ac82e83564/volumes" Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.331342 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.383586 4769 generic.go:334] "Generic (PLEG): container finished" podID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerID="40483e213bbb8fb730f5881d5ce6648bdb67668c550c3c3946b3c47e4e682801" exitCode=0 Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.383672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b3926aac-4463-4bba-9d2f-58c1b0e84a0b","Type":"ContainerDied","Data":"40483e213bbb8fb730f5881d5ce6648bdb67668c550c3c3946b3c47e4e682801"} Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.386977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerStarted","Data":"128e7ab5c057f3814a7303c41abfdc7f505c368b6a08efc0851ebb9d5042553d"} Nov 21 13:26:31 crc kubenswrapper[4769]: I1121 13:26:31.401554 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:26:31 crc kubenswrapper[4769]: W1121 13:26:31.405272 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdf41518_0738_4701_9482_fe17d9be8abf.slice/crio-8af694a44537fe0413c7fdc8dc48466a968a076fbb4d86c3c6b0e69d9fe9184c WatchSource:0}: Error finding container 8af694a44537fe0413c7fdc8dc48466a968a076fbb4d86c3c6b0e69d9fe9184c: Status 404 returned error can't find the container with id 8af694a44537fe0413c7fdc8dc48466a968a076fbb4d86c3c6b0e69d9fe9184c Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.144694 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.312450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-combined-ca-bundle\") pod \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.312581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnjpl\" (UniqueName: \"kubernetes.io/projected/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-kube-api-access-jnjpl\") pod \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.312630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-config-data\") pod \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.312666 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-logs\") pod \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.312690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-nova-metadata-tls-certs\") pod \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\" (UID: \"b3926aac-4463-4bba-9d2f-58c1b0e84a0b\") " Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.314091 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-logs" (OuterVolumeSpecName: "logs") pod "b3926aac-4463-4bba-9d2f-58c1b0e84a0b" (UID: "b3926aac-4463-4bba-9d2f-58c1b0e84a0b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.325418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-kube-api-access-jnjpl" (OuterVolumeSpecName: "kube-api-access-jnjpl") pod "b3926aac-4463-4bba-9d2f-58c1b0e84a0b" (UID: "b3926aac-4463-4bba-9d2f-58c1b0e84a0b"). InnerVolumeSpecName "kube-api-access-jnjpl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.344961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-config-data" (OuterVolumeSpecName: "config-data") pod "b3926aac-4463-4bba-9d2f-58c1b0e84a0b" (UID: "b3926aac-4463-4bba-9d2f-58c1b0e84a0b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.355659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3926aac-4463-4bba-9d2f-58c1b0e84a0b" (UID: "b3926aac-4463-4bba-9d2f-58c1b0e84a0b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.379843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b3926aac-4463-4bba-9d2f-58c1b0e84a0b" (UID: "b3926aac-4463-4bba-9d2f-58c1b0e84a0b"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.406769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b3926aac-4463-4bba-9d2f-58c1b0e84a0b","Type":"ContainerDied","Data":"e4c7c7bbe82cf14103161a13d590d089d970ec8b2dab0796f2f7f426422af359"} Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.406819 4769 scope.go:117] "RemoveContainer" containerID="40483e213bbb8fb730f5881d5ce6648bdb67668c550c3c3946b3c47e4e682801" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.406906 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.415800 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.415853 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.415876 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.415895 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jnjpl\" (UniqueName: \"kubernetes.io/projected/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-kube-api-access-jnjpl\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.415912 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3926aac-4463-4bba-9d2f-58c1b0e84a0b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.416257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fdf41518-0738-4701-9482-fe17d9be8abf","Type":"ContainerStarted","Data":"173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701"} Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.416307 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fdf41518-0738-4701-9482-fe17d9be8abf","Type":"ContainerStarted","Data":"8af694a44537fe0413c7fdc8dc48466a968a076fbb4d86c3c6b0e69d9fe9184c"} Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.457254 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.457229317 podStartE2EDuration="2.457229317s" podCreationTimestamp="2025-11-21 13:26:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:26:32.433403326 +0000 UTC m=+5751.134065154" watchObservedRunningTime="2025-11-21 13:26:32.457229317 +0000 UTC m=+5751.157891135" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.458497 4769 scope.go:117] "RemoveContainer" containerID="81c4fc57a60049743c433e4b858d298d43b52ccc9ae8e6fbc402f6c8bc50ddb1" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.482996 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.495505 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.503453 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:26:32 crc kubenswrapper[4769]: E1121 13:26:32.503881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-log" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.503924 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-log" Nov 21 13:26:32 crc kubenswrapper[4769]: E1121 13:26:32.503950 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-metadata" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.503957 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-metadata" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.504143 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-log" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.504170 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-metadata" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.505482 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.507658 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-metadata-internal-svc" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.507827 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-config-data" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.520520 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.649512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d4eed1d-bce3-4f26-a240-956b705062da-logs\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.649630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.649666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-config-data\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.649689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g4sr\" (UniqueName: \"kubernetes.io/projected/1d4eed1d-bce3-4f26-a240-956b705062da-kube-api-access-2g4sr\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.649923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.751723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.751777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-config-data\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.751840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2g4sr\" (UniqueName: \"kubernetes.io/projected/1d4eed1d-bce3-4f26-a240-956b705062da-kube-api-access-2g4sr\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.752579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.752649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d4eed1d-bce3-4f26-a240-956b705062da-logs\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.753263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d4eed1d-bce3-4f26-a240-956b705062da-logs\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.760629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-config-data\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.760679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.764372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.773265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g4sr\" (UniqueName: \"kubernetes.io/projected/1d4eed1d-bce3-4f26-a240-956b705062da-kube-api-access-2g4sr\") pod \"nova-metadata-0\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:32 crc kubenswrapper[4769]: I1121 13:26:32.841407 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.296620 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" path="/var/lib/kubelet/pods/b3926aac-4463-4bba-9d2f-58c1b0e84a0b/volumes" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.468470 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerID="73c6854305d761f93a516805fb4efbe611700186cb86398b1a1016e7a5a4d631" exitCode=0 Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.468555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa","Type":"ContainerDied","Data":"73c6854305d761f93a516805fb4efbe611700186cb86398b1a1016e7a5a4d631"} Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.669951 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.780043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-combined-ca-bundle\") pod \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.780085 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-config-data\") pod \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.780150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-public-tls-certs\") pod \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.780186 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wkvc\" (UniqueName: \"kubernetes.io/projected/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-kube-api-access-8wkvc\") pod \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.780263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-logs\") pod \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.780345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-internal-tls-certs\") pod \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\" (UID: \"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa\") " Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.781640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-logs" (OuterVolumeSpecName: "logs") pod "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" (UID: "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.803110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-kube-api-access-8wkvc" (OuterVolumeSpecName: "kube-api-access-8wkvc") pod "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" (UID: "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa"). InnerVolumeSpecName "kube-api-access-8wkvc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.812049 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-config-data" (OuterVolumeSpecName: "config-data") pod "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" (UID: "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.826726 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" (UID: "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.847730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" (UID: "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.854015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" (UID: "d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.882854 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.882902 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.882917 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.882932 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.882945 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:33 crc kubenswrapper[4769]: I1121 13:26:33.882960 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8wkvc\" (UniqueName: \"kubernetes.io/projected/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa-kube-api-access-8wkvc\") on node \"crc\" DevicePath \"\"" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.027114 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:26:34 crc kubenswrapper[4769]: W1121 13:26:34.029105 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4eed1d_bce3_4f26_a240_956b705062da.slice/crio-96d41257c2a4674ace8d3c4838036c0c95e3fcd34c29a76c62ae68146f6e7923 WatchSource:0}: Error finding container 96d41257c2a4674ace8d3c4838036c0c95e3fcd34c29a76c62ae68146f6e7923: Status 404 returned error can't find the container with id 96d41257c2a4674ace8d3c4838036c0c95e3fcd34c29a76c62ae68146f6e7923 Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.489650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d4eed1d-bce3-4f26-a240-956b705062da","Type":"ContainerStarted","Data":"060e837d9f9e93205f3db10b0c7600a479b7ff79dd34a70673a559c089e2deb4"} Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.489976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d4eed1d-bce3-4f26-a240-956b705062da","Type":"ContainerStarted","Data":"96d41257c2a4674ace8d3c4838036c0c95e3fcd34c29a76c62ae68146f6e7923"} Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.491399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerStarted","Data":"4ce5b8eac8d6f245179bff460d5545dca76594d996bbf2de33253d57d860fec0"} Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.492945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa","Type":"ContainerDied","Data":"86cc4f59d66b12e8b227d3d9faadfc16fab4c2c04fc60ba790ecf50dfc87559c"} Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.492978 4769 scope.go:117] "RemoveContainer" containerID="73c6854305d761f93a516805fb4efbe611700186cb86398b1a1016e7a5a4d631" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.493110 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.528559 4769 scope.go:117] "RemoveContainer" containerID="f299a0bf68542ef5dc1da626f0a89a14b9adc331dfb56a47bbd635bc451e02cd" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.533930 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.549955 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.559996 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:34 crc kubenswrapper[4769]: E1121 13:26:34.560422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-api" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.560438 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-api" Nov 21 13:26:34 crc kubenswrapper[4769]: E1121 13:26:34.560463 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-log" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.560469 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-log" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.560653 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-api" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.560678 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" containerName="nova-api-log" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.561661 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.569547 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-internal-svc" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.569568 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-api-config-data" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.570040 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"cert-nova-public-svc" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.586528 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.711257 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.711336 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ece80665-fef3-4d5e-a84e-e853f5725be7-logs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.711525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-config-data\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.711579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.711799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-public-tls-certs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.711871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkcv\" (UniqueName: \"kubernetes.io/projected/ece80665-fef3-4d5e-a84e-e853f5725be7-kube-api-access-lwkcv\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-public-tls-certs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkcv\" (UniqueName: \"kubernetes.io/projected/ece80665-fef3-4d5e-a84e-e853f5725be7-kube-api-access-lwkcv\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814197 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814229 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ece80665-fef3-4d5e-a84e-e853f5725be7-logs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814323 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-config-data\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814365 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.814881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ece80665-fef3-4d5e-a84e-e853f5725be7-logs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.820815 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.821177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.832942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-config-data\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.833061 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-public-tls-certs\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.846160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkcv\" (UniqueName: \"kubernetes.io/projected/ece80665-fef3-4d5e-a84e-e853f5725be7-kube-api-access-lwkcv\") pod \"nova-api-0\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:34 crc kubenswrapper[4769]: I1121 13:26:34.898428 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:35 crc kubenswrapper[4769]: I1121 13:26:35.288215 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa" path="/var/lib/kubelet/pods/d4d5fc85-f6b5-4f56-aa07-fc0ee696f6fa/volumes" Nov 21 13:26:35 crc kubenswrapper[4769]: W1121 13:26:35.355011 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podece80665_fef3_4d5e_a84e_e853f5725be7.slice/crio-03af8994aadecc1a927227600ad9b29ff06153bd5c7107caea2ed37ec0dea295 WatchSource:0}: Error finding container 03af8994aadecc1a927227600ad9b29ff06153bd5c7107caea2ed37ec0dea295: Status 404 returned error can't find the container with id 03af8994aadecc1a927227600ad9b29ff06153bd5c7107caea2ed37ec0dea295 Nov 21 13:26:35 crc kubenswrapper[4769]: I1121 13:26:35.358181 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:26:35 crc kubenswrapper[4769]: I1121 13:26:35.515444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ece80665-fef3-4d5e-a84e-e853f5725be7","Type":"ContainerStarted","Data":"03af8994aadecc1a927227600ad9b29ff06153bd5c7107caea2ed37ec0dea295"} Nov 21 13:26:35 crc kubenswrapper[4769]: I1121 13:26:35.519424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d4eed1d-bce3-4f26-a240-956b705062da","Type":"ContainerStarted","Data":"7c8f41d0967c011e600c9453e4a9ab5232eb669f5feab3e40413582abdb49f5c"} Nov 21 13:26:35 crc kubenswrapper[4769]: I1121 13:26:35.547381 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.5473566979999998 podStartE2EDuration="3.547356698s" podCreationTimestamp="2025-11-21 13:26:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:26:35.543783522 +0000 UTC m=+5754.244445360" watchObservedRunningTime="2025-11-21 13:26:35.547356698 +0000 UTC m=+5754.248018536" Nov 21 13:26:35 crc kubenswrapper[4769]: I1121 13:26:35.863450 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:36 crc kubenswrapper[4769]: I1121 13:26:36.337002 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:26:36 crc kubenswrapper[4769]: I1121 13:26:36.530259 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ece80665-fef3-4d5e-a84e-e853f5725be7","Type":"ContainerStarted","Data":"acd63c2764ed3cc516620b6e3f07fdaff888a485389174ec59e7caed4a8ac47d"} Nov 21 13:26:36 crc kubenswrapper[4769]: I1121 13:26:36.532386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerStarted","Data":"4c766b60a2104885e7d5d1baed345a70fe7750f2658927a7539752ddf8457bfc"} Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.077077 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.254:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.077249 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b3926aac-4463-4bba-9d2f-58c1b0e84a0b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.254:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.555974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ece80665-fef3-4d5e-a84e-e853f5725be7","Type":"ContainerStarted","Data":"9d69ab3f61c7fed3934f0597dc69b74c925dadc71f7e99117e34fe6b975dab16"} Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.596870 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.596843223 podStartE2EDuration="3.596843223s" podCreationTimestamp="2025-11-21 13:26:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:26:37.587890062 +0000 UTC m=+5756.288551930" watchObservedRunningTime="2025-11-21 13:26:37.596843223 +0000 UTC m=+5756.297505051" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.842903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.843267 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.944045 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-wqclj"] Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.946736 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.957952 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wqclj"] Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.991509 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-utilities\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.991745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjx2z\" (UniqueName: \"kubernetes.io/projected/d88463cb-c3de-4442-a43d-aad262fee2bb-kube-api-access-tjx2z\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:37 crc kubenswrapper[4769]: I1121 13:26:37.991811 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-catalog-content\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.093756 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tjx2z\" (UniqueName: \"kubernetes.io/projected/d88463cb-c3de-4442-a43d-aad262fee2bb-kube-api-access-tjx2z\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.093856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-catalog-content\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.093936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-utilities\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.094628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-catalog-content\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.094686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-utilities\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.115499 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjx2z\" (UniqueName: \"kubernetes.io/projected/d88463cb-c3de-4442-a43d-aad262fee2bb-kube-api-access-tjx2z\") pod \"redhat-operators-wqclj\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.294358 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.566242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerStarted","Data":"31034454d54b70210b9ccb8f54f225b4b1478991df6416d684e66ecf7584c5e4"} Nov 21 13:26:38 crc kubenswrapper[4769]: W1121 13:26:38.784764 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88463cb_c3de_4442_a43d_aad262fee2bb.slice/crio-d8f01d2b755d87ffb3db07c401d26ebfd79d4085bad6cc13c78ad726ebdd1bf6 WatchSource:0}: Error finding container d8f01d2b755d87ffb3db07c401d26ebfd79d4085bad6cc13c78ad726ebdd1bf6: Status 404 returned error can't find the container with id d8f01d2b755d87ffb3db07c401d26ebfd79d4085bad6cc13c78ad726ebdd1bf6 Nov 21 13:26:38 crc kubenswrapper[4769]: I1121 13:26:38.787214 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-wqclj"] Nov 21 13:26:39 crc kubenswrapper[4769]: I1121 13:26:39.583042 4769 generic.go:334] "Generic (PLEG): container finished" podID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerID="7f122d280347b8b94fa6ccffcfae9c20359f542fc9dec9a63b6dbe756515bf13" exitCode=0 Nov 21 13:26:39 crc kubenswrapper[4769]: I1121 13:26:39.583105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerDied","Data":"7f122d280347b8b94fa6ccffcfae9c20359f542fc9dec9a63b6dbe756515bf13"} Nov 21 13:26:39 crc kubenswrapper[4769]: I1121 13:26:39.583335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerStarted","Data":"d8f01d2b755d87ffb3db07c401d26ebfd79d4085bad6cc13c78ad726ebdd1bf6"} Nov 21 13:26:40 crc kubenswrapper[4769]: I1121 13:26:40.599146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerStarted","Data":"96f270b1b77c8f30e2785f79744a67c37aac48442377c3f5df0dc14b6495ef4b"} Nov 21 13:26:40 crc kubenswrapper[4769]: I1121 13:26:40.599570 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:26:40 crc kubenswrapper[4769]: I1121 13:26:40.630628 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.26965083 podStartE2EDuration="10.630609838s" podCreationTimestamp="2025-11-21 13:26:30 +0000 UTC" firstStartedPulling="2025-11-21 13:26:31.340423732 +0000 UTC m=+5750.041085550" lastFinishedPulling="2025-11-21 13:26:39.70138272 +0000 UTC m=+5758.402044558" observedRunningTime="2025-11-21 13:26:40.628902912 +0000 UTC m=+5759.329564750" watchObservedRunningTime="2025-11-21 13:26:40.630609838 +0000 UTC m=+5759.331271676" Nov 21 13:26:40 crc kubenswrapper[4769]: I1121 13:26:40.863831 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:40 crc kubenswrapper[4769]: I1121 13:26:40.901039 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:41 crc kubenswrapper[4769]: I1121 13:26:41.610055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerStarted","Data":"ca1ab360757afd3f771465cc9e9de9105289a136b973f1aadbac2b1d525ada2f"} Nov 21 13:26:41 crc kubenswrapper[4769]: I1121 13:26:41.645984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:26:42 crc kubenswrapper[4769]: I1121 13:26:42.842291 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:42 crc kubenswrapper[4769]: I1121 13:26:42.843085 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:43 crc kubenswrapper[4769]: I1121 13:26:43.853355 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.9:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:43 crc kubenswrapper[4769]: I1121 13:26:43.853351 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.9:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:44 crc kubenswrapper[4769]: I1121 13:26:44.899652 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:44 crc kubenswrapper[4769]: I1121 13:26:44.900114 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:45 crc kubenswrapper[4769]: I1121 13:26:45.914521 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.10:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:45 crc kubenswrapper[4769]: I1121 13:26:45.914535 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.10:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 21 13:26:46 crc kubenswrapper[4769]: I1121 13:26:46.671128 4769 generic.go:334] "Generic (PLEG): container finished" podID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerID="ca1ab360757afd3f771465cc9e9de9105289a136b973f1aadbac2b1d525ada2f" exitCode=0 Nov 21 13:26:46 crc kubenswrapper[4769]: I1121 13:26:46.671667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerDied","Data":"ca1ab360757afd3f771465cc9e9de9105289a136b973f1aadbac2b1d525ada2f"} Nov 21 13:26:48 crc kubenswrapper[4769]: I1121 13:26:48.701426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerStarted","Data":"3b2eabbc9dd32b3ae1209b7db86ffa541928b5494289ca731428c92876869f5f"} Nov 21 13:26:48 crc kubenswrapper[4769]: I1121 13:26:48.721335 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-wqclj" podStartSLOduration=3.762474616 podStartE2EDuration="11.721317983s" podCreationTimestamp="2025-11-21 13:26:37 +0000 UTC" firstStartedPulling="2025-11-21 13:26:39.652778252 +0000 UTC m=+5758.353440070" lastFinishedPulling="2025-11-21 13:26:47.611621599 +0000 UTC m=+5766.312283437" observedRunningTime="2025-11-21 13:26:48.71640179 +0000 UTC m=+5767.417063618" watchObservedRunningTime="2025-11-21 13:26:48.721317983 +0000 UTC m=+5767.421979801" Nov 21 13:26:52 crc kubenswrapper[4769]: I1121 13:26:52.847655 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:52 crc kubenswrapper[4769]: I1121 13:26:52.851318 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:52 crc kubenswrapper[4769]: I1121 13:26:52.853233 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:53 crc kubenswrapper[4769]: I1121 13:26:53.749948 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:26:54 crc kubenswrapper[4769]: I1121 13:26:54.915624 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:54 crc kubenswrapper[4769]: I1121 13:26:54.916393 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:54 crc kubenswrapper[4769]: I1121 13:26:54.918847 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:54 crc kubenswrapper[4769]: I1121 13:26:54.922612 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:55 crc kubenswrapper[4769]: I1121 13:26:55.764266 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:55 crc kubenswrapper[4769]: I1121 13:26:55.770732 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:26:57 crc kubenswrapper[4769]: I1121 13:26:57.543145 4769 scope.go:117] "RemoveContainer" containerID="119181dfcc69e1dc873ee36fc1a176d2bfcc8241100c839c0d10f051e03b2111" Nov 21 13:26:57 crc kubenswrapper[4769]: I1121 13:26:57.582824 4769 scope.go:117] "RemoveContainer" containerID="5be2094edc8d34604e6e2f832b5eef3088010b1f5deac7dbb19aa06a35b74be7" Nov 21 13:26:57 crc kubenswrapper[4769]: I1121 13:26:57.616956 4769 scope.go:117] "RemoveContainer" containerID="f728688765c11a8b9276f1b9090000fe2246b4eb2e98a7a9f4f1df8baeef17b5" Nov 21 13:26:57 crc kubenswrapper[4769]: I1121 13:26:57.651038 4769 scope.go:117] "RemoveContainer" containerID="0bc7915362f1cc96b0d86321e9be9c9e72e608fa6ffde495e470378c70a37dd9" Nov 21 13:26:58 crc kubenswrapper[4769]: I1121 13:26:58.295117 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:58 crc kubenswrapper[4769]: I1121 13:26:58.295169 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:58 crc kubenswrapper[4769]: I1121 13:26:58.369302 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:58 crc kubenswrapper[4769]: I1121 13:26:58.843233 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:26:58 crc kubenswrapper[4769]: I1121 13:26:58.892892 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wqclj"] Nov 21 13:27:00 crc kubenswrapper[4769]: I1121 13:27:00.818690 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-wqclj" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="registry-server" containerID="cri-o://3b2eabbc9dd32b3ae1209b7db86ffa541928b5494289ca731428c92876869f5f" gracePeriod=2 Nov 21 13:27:00 crc kubenswrapper[4769]: I1121 13:27:00.866172 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.034882 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-cw69r"] Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.037494 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.054395 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-cw69r"] Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.171820 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f99n7\" (UniqueName: \"kubernetes.io/projected/90a092e1-717f-4c7a-9740-89b57b690e43-kube-api-access-f99n7\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.171943 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-catalog-content\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.172016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-utilities\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.273377 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f99n7\" (UniqueName: \"kubernetes.io/projected/90a092e1-717f-4c7a-9740-89b57b690e43-kube-api-access-f99n7\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.273500 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-catalog-content\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.273608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-utilities\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.274062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-catalog-content\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.274138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-utilities\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.297151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f99n7\" (UniqueName: \"kubernetes.io/projected/90a092e1-717f-4c7a-9740-89b57b690e43-kube-api-access-f99n7\") pod \"community-operators-cw69r\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.379127 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.830901 4769 generic.go:334] "Generic (PLEG): container finished" podID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerID="3b2eabbc9dd32b3ae1209b7db86ffa541928b5494289ca731428c92876869f5f" exitCode=0 Nov 21 13:27:01 crc kubenswrapper[4769]: I1121 13:27:01.830982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerDied","Data":"3b2eabbc9dd32b3ae1209b7db86ffa541928b5494289ca731428c92876869f5f"} Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.139594 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-cw69r"] Nov 21 13:27:02 crc kubenswrapper[4769]: W1121 13:27:02.147717 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a092e1_717f_4c7a_9740_89b57b690e43.slice/crio-773bfd2f31bb321c78c717f8bdede867315f73b6e37ec694bf5a1e022ccee6f4 WatchSource:0}: Error finding container 773bfd2f31bb321c78c717f8bdede867315f73b6e37ec694bf5a1e022ccee6f4: Status 404 returned error can't find the container with id 773bfd2f31bb321c78c717f8bdede867315f73b6e37ec694bf5a1e022ccee6f4 Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.284386 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.295947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjx2z\" (UniqueName: \"kubernetes.io/projected/d88463cb-c3de-4442-a43d-aad262fee2bb-kube-api-access-tjx2z\") pod \"d88463cb-c3de-4442-a43d-aad262fee2bb\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.296048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-utilities\") pod \"d88463cb-c3de-4442-a43d-aad262fee2bb\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.296117 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-catalog-content\") pod \"d88463cb-c3de-4442-a43d-aad262fee2bb\" (UID: \"d88463cb-c3de-4442-a43d-aad262fee2bb\") " Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.297020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-utilities" (OuterVolumeSpecName: "utilities") pod "d88463cb-c3de-4442-a43d-aad262fee2bb" (UID: "d88463cb-c3de-4442-a43d-aad262fee2bb"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.303235 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88463cb-c3de-4442-a43d-aad262fee2bb-kube-api-access-tjx2z" (OuterVolumeSpecName: "kube-api-access-tjx2z") pod "d88463cb-c3de-4442-a43d-aad262fee2bb" (UID: "d88463cb-c3de-4442-a43d-aad262fee2bb"). InnerVolumeSpecName "kube-api-access-tjx2z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.398900 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tjx2z\" (UniqueName: \"kubernetes.io/projected/d88463cb-c3de-4442-a43d-aad262fee2bb-kube-api-access-tjx2z\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.399237 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.841093 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerStarted","Data":"773bfd2f31bb321c78c717f8bdede867315f73b6e37ec694bf5a1e022ccee6f4"} Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.844757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-wqclj" event={"ID":"d88463cb-c3de-4442-a43d-aad262fee2bb","Type":"ContainerDied","Data":"d8f01d2b755d87ffb3db07c401d26ebfd79d4085bad6cc13c78ad726ebdd1bf6"} Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.844826 4769 scope.go:117] "RemoveContainer" containerID="3b2eabbc9dd32b3ae1209b7db86ffa541928b5494289ca731428c92876869f5f" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.844837 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-wqclj" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.867367 4769 scope.go:117] "RemoveContainer" containerID="ca1ab360757afd3f771465cc9e9de9105289a136b973f1aadbac2b1d525ada2f" Nov 21 13:27:02 crc kubenswrapper[4769]: I1121 13:27:02.889491 4769 scope.go:117] "RemoveContainer" containerID="7f122d280347b8b94fa6ccffcfae9c20359f542fc9dec9a63b6dbe756515bf13" Nov 21 13:27:03 crc kubenswrapper[4769]: I1121 13:27:03.610656 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d88463cb-c3de-4442-a43d-aad262fee2bb" (UID: "d88463cb-c3de-4442-a43d-aad262fee2bb"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:03 crc kubenswrapper[4769]: I1121 13:27:03.619167 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d88463cb-c3de-4442-a43d-aad262fee2bb-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:03 crc kubenswrapper[4769]: I1121 13:27:03.783530 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-wqclj"] Nov 21 13:27:03 crc kubenswrapper[4769]: I1121 13:27:03.791613 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-wqclj"] Nov 21 13:27:03 crc kubenswrapper[4769]: I1121 13:27:03.855358 4769 generic.go:334] "Generic (PLEG): container finished" podID="90a092e1-717f-4c7a-9740-89b57b690e43" containerID="a7400aff22e5cdfb01cf61117c215695098d258d843f79b41373661055530c0d" exitCode=0 Nov 21 13:27:03 crc kubenswrapper[4769]: I1121 13:27:03.855488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerDied","Data":"a7400aff22e5cdfb01cf61117c215695098d258d843f79b41373661055530c0d"} Nov 21 13:27:05 crc kubenswrapper[4769]: I1121 13:27:05.284402 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" path="/var/lib/kubelet/pods/d88463cb-c3de-4442-a43d-aad262fee2bb/volumes" Nov 21 13:27:05 crc kubenswrapper[4769]: I1121 13:27:05.911484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerStarted","Data":"803757e54916f8e20659de800e1cd9e6ed6a2b4b7d4d3b0b479dfbb02da229be"} Nov 21 13:27:09 crc kubenswrapper[4769]: I1121 13:27:09.946946 4769 generic.go:334] "Generic (PLEG): container finished" podID="90a092e1-717f-4c7a-9740-89b57b690e43" containerID="803757e54916f8e20659de800e1cd9e6ed6a2b4b7d4d3b0b479dfbb02da229be" exitCode=0 Nov 21 13:27:09 crc kubenswrapper[4769]: I1121 13:27:09.947039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerDied","Data":"803757e54916f8e20659de800e1cd9e6ed6a2b4b7d4d3b0b479dfbb02da229be"} Nov 21 13:27:11 crc kubenswrapper[4769]: I1121 13:27:11.324878 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:27:11 crc kubenswrapper[4769]: I1121 13:27:11.325375 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:27:13 crc kubenswrapper[4769]: I1121 13:27:13.990165 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerStarted","Data":"fa98d3985eb6a30d06eddaf9ed39767135f67b0acb4b2b8428762a935fc41375"} Nov 21 13:27:14 crc kubenswrapper[4769]: I1121 13:27:14.019314 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-cw69r" podStartSLOduration=5.789033616 podStartE2EDuration="14.019286886s" podCreationTimestamp="2025-11-21 13:27:00 +0000 UTC" firstStartedPulling="2025-11-21 13:27:03.857560397 +0000 UTC m=+5782.558222215" lastFinishedPulling="2025-11-21 13:27:12.087813667 +0000 UTC m=+5790.788475485" observedRunningTime="2025-11-21 13:27:14.007523339 +0000 UTC m=+5792.708185167" watchObservedRunningTime="2025-11-21 13:27:14.019286886 +0000 UTC m=+5792.719948694" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.272820 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.273714 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="9377cea3-e509-437e-b857-e60fb24f9570" containerName="openstackclient" containerID="cri-o://a7a9e9c182706899fd81f119e340a8b9ac071b17d6858f5b6b34121651f3f41f" gracePeriod=2 Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.288320 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.369795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.372233 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="openstack-network-exporter" containerID="cri-o://be9c19419f89a89082ee0b343109bab8e7792cc6fea3839c7fdeddca9f685c62" gracePeriod=300 Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.397479 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.425495 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement3637-account-delete-m2bjk"] Nov 21 13:27:20 crc kubenswrapper[4769]: E1121 13:27:20.426024 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="extract-content" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.426046 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="extract-content" Nov 21 13:27:20 crc kubenswrapper[4769]: E1121 13:27:20.426077 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="extract-utilities" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.426086 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="extract-utilities" Nov 21 13:27:20 crc kubenswrapper[4769]: E1121 13:27:20.426101 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9377cea3-e509-437e-b857-e60fb24f9570" containerName="openstackclient" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.426109 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9377cea3-e509-437e-b857-e60fb24f9570" containerName="openstackclient" Nov 21 13:27:20 crc kubenswrapper[4769]: E1121 13:27:20.426129 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="registry-server" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.426137 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="registry-server" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.426415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9377cea3-e509-437e-b857-e60fb24f9570" containerName="openstackclient" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.426456 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d88463cb-c3de-4442-a43d-aad262fee2bb" containerName="registry-server" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.427418 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.436210 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement3637-account-delete-m2bjk"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.556727 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican8259-account-delete-r2c4s"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.559840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts\") pod \"placement3637-account-delete-m2bjk\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.559948 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g7k7\" (UniqueName: \"kubernetes.io/projected/b46b5eff-f711-418b-b9de-54a5a91821af-kube-api-access-8g7k7\") pod \"placement3637-account-delete-m2bjk\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: E1121 13:27:20.561052 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:20 crc kubenswrapper[4769]: E1121 13:27:20.561112 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data podName:f76c87ba-5d40-4b61-a44a-7b8c895507d8 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:21.061088147 +0000 UTC m=+5799.761749965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data") pod "rabbitmq-cell1-server-0" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.572164 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.589574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican8259-account-delete-r2c4s"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.620549 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="ovsdbserver-nb" containerID="cri-o://cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514" gracePeriod=300 Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.663808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8g7k7\" (UniqueName: \"kubernetes.io/projected/b46b5eff-f711-418b-b9de-54a5a91821af-kube-api-access-8g7k7\") pod \"placement3637-account-delete-m2bjk\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.663982 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9w2\" (UniqueName: \"kubernetes.io/projected/5d95dea2-4e74-42eb-b7a0-cf3093c486da-kube-api-access-7p9w2\") pod \"barbican8259-account-delete-r2c4s\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.664039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts\") pod \"placement3637-account-delete-m2bjk\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.664067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts\") pod \"barbican8259-account-delete-r2c4s\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.665024 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts\") pod \"placement3637-account-delete-m2bjk\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.696393 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.697287 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g7k7\" (UniqueName: \"kubernetes.io/projected/b46b5eff-f711-418b-b9de-54a5a91821af-kube-api-access-8g7k7\") pod \"placement3637-account-delete-m2bjk\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.698601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.742249 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.765279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9w2\" (UniqueName: \"kubernetes.io/projected/5d95dea2-4e74-42eb-b7a0-cf3093c486da-kube-api-access-7p9w2\") pod \"barbican8259-account-delete-r2c4s\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.765341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89r75\" (UniqueName: \"kubernetes.io/projected/0380fc82-b08b-4e96-a26d-d06c67417449-kube-api-access-89r75\") pod \"neutronbfc0-account-delete-bvhpq\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.765373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts\") pod \"barbican8259-account-delete-r2c4s\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.765447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts\") pod \"neutronbfc0-account-delete-bvhpq\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.765980 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.766283 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="ovn-northd" containerID="cri-o://b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" gracePeriod=30 Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.766353 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts\") pod \"barbican8259-account-delete-r2c4s\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.766421 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="openstack-network-exporter" containerID="cri-o://ef863c661a90d61b54675e320d9df78dcaf9bf458ea01ea85f44d8e12a6dd1f5" gracePeriod=30 Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.779575 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.788793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9w2\" (UniqueName: \"kubernetes.io/projected/5d95dea2-4e74-42eb-b7a0-cf3093c486da-kube-api-access-7p9w2\") pod \"barbican8259-account-delete-r2c4s\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.803121 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.804285 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="openstack-network-exporter" containerID="cri-o://db49913b70d2be34d6c625affcffd31fd7e3bae0a9aa1c37a1ac503be82937da" gracePeriod=300 Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.822505 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glancef3b9-account-delete-4b67q"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.823827 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.857104 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glancef3b9-account-delete-4b67q"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.871394 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwvd\" (UniqueName: \"kubernetes.io/projected/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-kube-api-access-mmwvd\") pod \"glancef3b9-account-delete-4b67q\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.871524 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts\") pod \"neutronbfc0-account-delete-bvhpq\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.871691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts\") pod \"glancef3b9-account-delete-4b67q\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.871788 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-89r75\" (UniqueName: \"kubernetes.io/projected/0380fc82-b08b-4e96-a26d-d06c67417449-kube-api-access-89r75\") pod \"neutronbfc0-account-delete-bvhpq\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.873567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts\") pod \"neutronbfc0-account-delete-bvhpq\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.900351 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bscxr"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.911332 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.924267 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-89r75\" (UniqueName: \"kubernetes.io/projected/0380fc82-b08b-4e96-a26d-d06c67417449-kube-api-access-89r75\") pod \"neutronbfc0-account-delete-bvhpq\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.929638 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-bscxr"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.961386 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5qdzl"] Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.986800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwvd\" (UniqueName: \"kubernetes.io/projected/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-kube-api-access-mmwvd\") pod \"glancef3b9-account-delete-4b67q\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.986896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts\") pod \"glancef3b9-account-delete-4b67q\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.987717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts\") pod \"glancef3b9-account-delete-4b67q\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:20 crc kubenswrapper[4769]: I1121 13:27:20.993242 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-5qdzl"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.017977 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder8e53-account-delete-zvrnf"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.019308 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.041322 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder8e53-account-delete-zvrnf"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.051846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="ovsdbserver-sb" containerID="cri-o://569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472" gracePeriod=300 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.080572 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.094537 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts\") pod \"cinder8e53-account-delete-zvrnf\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.094638 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsltx\" (UniqueName: \"kubernetes.io/projected/ac1d3aa2-0067-423a-ad55-820d9dde22f4-kube-api-access-fsltx\") pod \"cinder8e53-account-delete-zvrnf\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: E1121 13:27:21.094786 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:21 crc kubenswrapper[4769]: E1121 13:27:21.094827 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data podName:f76c87ba-5d40-4b61-a44a-7b8c895507d8 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:22.094813711 +0000 UTC m=+5800.795475529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data") pod "rabbitmq-cell1-server-0" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.183762 4769 generic.go:334] "Generic (PLEG): container finished" podID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerID="db49913b70d2be34d6c625affcffd31fd7e3bae0a9aa1c37a1ac503be82937da" exitCode=2 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.183851 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"024d7eeb-986d-4113-9ed3-956c3ca2f600","Type":"ContainerDied","Data":"db49913b70d2be34d6c625affcffd31fd7e3bae0a9aa1c37a1ac503be82937da"} Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.184846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwvd\" (UniqueName: \"kubernetes.io/projected/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-kube-api-access-mmwvd\") pod \"glancef3b9-account-delete-4b67q\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.199458 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novacell0726e-account-delete-tt4rj"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.200655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts\") pod \"cinder8e53-account-delete-zvrnf\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.200770 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fsltx\" (UniqueName: \"kubernetes.io/projected/ac1d3aa2-0067-423a-ad55-820d9dde22f4-kube-api-access-fsltx\") pod \"cinder8e53-account-delete-zvrnf\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.202163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts\") pod \"cinder8e53-account-delete-zvrnf\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.210801 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.250236 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0726e-account-delete-tt4rj"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.293569 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_2d6fd3d6-d129-40ae-8db7-be0e04466950/ovsdbserver-nb/0.log" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.294537 4769 generic.go:334] "Generic (PLEG): container finished" podID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerID="be9c19419f89a89082ee0b343109bab8e7792cc6fea3839c7fdeddca9f685c62" exitCode=2 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.294620 4769 generic.go:334] "Generic (PLEG): container finished" podID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerID="cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514" exitCode=143 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.295339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsltx\" (UniqueName: \"kubernetes.io/projected/ac1d3aa2-0067-423a-ad55-820d9dde22f4-kube-api-access-fsltx\") pod \"cinder8e53-account-delete-zvrnf\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.366888 4769 generic.go:334] "Generic (PLEG): container finished" podID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerID="ef863c661a90d61b54675e320d9df78dcaf9bf458ea01ea85f44d8e12a6dd1f5" exitCode=2 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.542745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts\") pod \"novacell0726e-account-delete-tt4rj\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.553539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf78d\" (UniqueName: \"kubernetes.io/projected/ee855a9c-b038-4a02-bca3-32d7fc3f321f-kube-api-access-sf78d\") pod \"novacell0726e-account-delete-tt4rj\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.550490 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.550361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.568428 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b531a5-573a-4457-880e-6156cfae85da" path="/var/lib/kubelet/pods/44b531a5-573a-4457-880e-6156cfae85da/volumes" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.569537 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbb8388-7720-4ddf-b608-f6cd45ebe188" path="/var/lib/kubelet/pods/6fbb8388-7720-4ddf-b608-f6cd45ebe188/volumes" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"2d6fd3d6-d129-40ae-8db7-be0e04466950","Type":"ContainerDied","Data":"be9c19419f89a89082ee0b343109bab8e7792cc6fea3839c7fdeddca9f685c62"} Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570142 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wf6w5"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"2d6fd3d6-d129-40ae-8db7-be0e04466950","Type":"ContainerDied","Data":"cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514"} Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570178 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570207 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570218 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-wf6w5"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570233 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"604926b7-fdf2-4dc6-9a15-2160c9feff0c","Type":"ContainerDied","Data":"ef863c661a90d61b54675e320d9df78dcaf9bf458ea01ea85f44d8e12a6dd1f5"} Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.570244 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-6vqlq"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.574666 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.626712 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-6vqlq"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.656051 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sf78d\" (UniqueName: \"kubernetes.io/projected/ee855a9c-b038-4a02-bca3-32d7fc3f321f-kube-api-access-sf78d\") pod \"novacell0726e-account-delete-tt4rj\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.656301 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts\") pod \"novacell0726e-account-delete-tt4rj\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.657356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts\") pod \"novacell0726e-account-delete-tt4rj\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.672260 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hrmds"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.695395 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-hrmds"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.725232 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf78d\" (UniqueName: \"kubernetes.io/projected/ee855a9c-b038-4a02-bca3-32d7fc3f321f-kube-api-access-sf78d\") pod \"novacell0726e-account-delete-tt4rj\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.737565 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.746799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ff6qq"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.845660 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-ff6qq"] Nov 21 13:27:21 crc kubenswrapper[4769]: E1121 13:27:21.863360 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:27:21 crc kubenswrapper[4769]: E1121 13:27:21.863430 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data podName:b51a88b8-9feb-448a-89c2-93800a854081 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:22.363408716 +0000 UTC m=+5801.064070534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data") pod "rabbitmq-server-0" (UID: "b51a88b8-9feb-448a-89c2-93800a854081") : configmap "rabbitmq-config-data" not found Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.867136 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/novaapi10ec-account-delete-cktts"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.869322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.897182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.927556 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6989955c5d-x4d64"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.927812 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-log" containerID="cri-o://2625031a0b0c2bbf67b35c39fd280fdbab221bfd025c71f05cfb0b8e055e826b" gracePeriod=30 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.929676 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-api" containerID="cri-o://0164617c683f651c195f2757ec57bffae8ad263ad2047e33a3fcd9f12edeb133" gracePeriod=30 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.968959 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts\") pod \"novaapi10ec-account-delete-cktts\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.969085 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zssqq\" (UniqueName: \"kubernetes.io/projected/a55ce728-ef0d-492c-9c68-31f2139f4734-kube-api-access-zssqq\") pod \"novaapi10ec-account-delete-cktts\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.972499 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b4896794-72gsv"] Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.972708 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-api" containerID="cri-o://5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb" gracePeriod=30 Nov 21 13:27:21 crc kubenswrapper[4769]: I1121 13:27:21.974129 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-httpd" containerID="cri-o://92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.030663 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-server" containerID="cri-o://1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031741 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="swift-recon-cron" containerID="cri-o://a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031785 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="rsync" containerID="cri-o://9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031831 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-expirer" containerID="cri-o://11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031864 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-updater" containerID="cri-o://4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031906 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-auditor" containerID="cri-o://316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031953 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-replicator" containerID="cri-o://84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.031993 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-server" containerID="cri-o://92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.032038 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-updater" containerID="cri-o://9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.032087 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-auditor" containerID="cri-o://935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.032122 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-replicator" containerID="cri-o://40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.032152 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-server" containerID="cri-o://13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.032179 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-reaper" containerID="cri-o://f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.033519 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-replicator" containerID="cri-o://93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.033546 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-auditor" containerID="cri-o://a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.060393 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi10ec-account-delete-cktts"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.078543 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.078773 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-log" containerID="cri-o://657264f8ebb53a43fa5c089677968f587795d955a77f426c19143c4a6ef1df07" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.079178 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-httpd" containerID="cri-o://3fef85e8a624512666e3827fea3c0e9bc4b33c17eddbc5371403291aad3c527a" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.095045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zssqq\" (UniqueName: \"kubernetes.io/projected/a55ce728-ef0d-492c-9c68-31f2139f4734-kube-api-access-zssqq\") pod \"novaapi10ec-account-delete-cktts\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.096933 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts\") pod \"novaapi10ec-account-delete-cktts\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.097025 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.097074 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data podName:f76c87ba-5d40-4b61-a44a-7b8c895507d8 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:24.097059914 +0000 UTC m=+5802.797721722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data") pod "rabbitmq-cell1-server-0" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.097729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts\") pod \"novaapi10ec-account-delete-cktts\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.117246 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.122935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zssqq\" (UniqueName: \"kubernetes.io/projected/a55ce728-ef0d-492c-9c68-31f2139f4734-kube-api-access-zssqq\") pod \"novaapi10ec-account-delete-cktts\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.148622 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.185342 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-s9rfm"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.242282 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-5dhrk"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.243010 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.272643 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.272879 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="cinder-scheduler" containerID="cri-o://c6d239fc1939be310f5bcd366fc6fdf9ec2dbd5126149f75ac259820c40d6b2f" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.273383 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="probe" containerID="cri-o://f64d2bc57c57a71190be05e671bb1c457619526945c17ab314e1f5b71413d4a2" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.292962 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.293271 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api-log" containerID="cri-o://53038e30829e3e1c73043a67ac6c92fecd76e095a9ac67e5c78d14d1a099763c" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.293383 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api" containerID="cri-o://a5ac62d77120b0c9972bb763b1099bfe3f2232cca9e8ce39e1255eaa67c20acf" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.341258 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.341830 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-log" containerID="cri-o://28fa00088106bd2af81ea2a135e9d01f80cdf4c35440b619adb0f417ec784fc9" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.342133 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-httpd" containerID="cri-o://de581e699c555ad13a35e2d0fc1e302531144b8f66ce87c8d54ac8cb48bc8982" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.371049 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.371286 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="fdf41518-0738-4701-9482-fe17d9be8abf" containerName="nova-scheduler-scheduler" containerID="cri-o://173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.391448 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514 is running failed: container process not found" containerID="cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.405048 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.405368 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker-log" containerID="cri-o://51c82d1abe313c608e8cfb5b329634aa1bb7af7491c585fda31de62cdc267828" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.406424 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514 is running failed: container process not found" containerID="cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.406471 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker" containerID="cri-o://042b1d0b935aa62be0f611d8c6dc9f0f79c51fdf863fdcaad51c73d08a3c2379" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.413334 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514 is running failed: container process not found" containerID="cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.413410 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="ovsdbserver-nb" Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.419787 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.419839 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data podName:b51a88b8-9feb-448a-89c2-93800a854081 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:23.41982253 +0000 UTC m=+5802.120484348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data") pod "rabbitmq-server-0" (UID: "b51a88b8-9feb-448a-89c2-93800a854081") : configmap "rabbitmq-config-data" not found Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.420345 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.420612 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-httpd" containerID="cri-o://5adac2918490b2e7c46769264c7951b0c8e6a236d35988472255847e24f782a3" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.420741 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-server" containerID="cri-o://801a5a2e0ae9c34058bc621dfe0405dfcb878e7285d4e358124dc8a802c16f4f" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.439269 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.442478 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.452282 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.452611 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener-log" containerID="cri-o://3b24cc09ab22264d746ae4f5f0857ced13d35ea66ae2f1da22e626a7d540861b" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.452722 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener" containerID="cri-o://0a8bb992cb4724c1bb88eeebb5bc3e3b06b4814e629415b220aa44dff8458fca" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.462302 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.463039 4769 generic.go:334] "Generic (PLEG): container finished" podID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerID="657264f8ebb53a43fa5c089677968f587795d955a77f426c19143c4a6ef1df07" exitCode=143 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.463132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f75bf156-e338-42b1-959d-83c46d7a4a6e","Type":"ContainerDied","Data":"657264f8ebb53a43fa5c089677968f587795d955a77f426c19143c4a6ef1df07"} Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.476147 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-68d8656558-w62fh"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.476483 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api-log" containerID="cri-o://d47834be36b3b8424947e2ec37cd955af4c78a9889f24e5ec2d3bc3c33b442ad" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.476617 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api" containerID="cri-o://d075a66075a632d2de68d442c1cc583ed5c59a569c329ed713b7cb4da2b7f525" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.495516 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_024d7eeb-986d-4113-9ed3-956c3ca2f600/ovsdbserver-sb/0.log" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.495597 4769 generic.go:334] "Generic (PLEG): container finished" podID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerID="569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472" exitCode=143 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.496450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"024d7eeb-986d-4113-9ed3-956c3ca2f600","Type":"ContainerDied","Data":"569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472"} Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.499469 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.524290 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.524383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.524460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfx5\" (UniqueName: \"kubernetes.io/projected/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-kube-api-access-lrfx5\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.535052 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.558739 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.559016 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" containerID="cri-o://060e837d9f9e93205f3db10b0c7600a479b7ff79dd34a70673a559c089e2deb4" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.559207 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" containerID="cri-o://7c8f41d0967c011e600c9453e4a9ab5232eb669f5feab3e40413582abdb49f5c" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.581252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mmrgq"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.593595 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-mmrgq"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.606450 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.606708 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-log" containerID="cri-o://acd63c2764ed3cc516620b6e3f07fdaff888a485389174ec59e7caed4a8ac47d" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.607139 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-api" containerID="cri-o://9d69ab3f61c7fed3934f0597dc69b74c925dadc71f7e99117e34fe6b975dab16" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.635749 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="rabbitmq" containerID="cri-o://3d2e40b1a98b0dda394e3f33fc6d50da970f3d836fbbf318f680db1c338ae781" gracePeriod=604800 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.664827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfx5\" (UniqueName: \"kubernetes.io/projected/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-kube-api-access-lrfx5\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.669794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.669988 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.673323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.681776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.684743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfx5\" (UniqueName: \"kubernetes.io/projected/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-kube-api-access-lrfx5\") pod \"dnsmasq-dnsmasq-84b9f45d47-v4dxk\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.693974 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_2d6fd3d6-d129-40ae-8db7-be0e04466950/ovsdbserver-nb/0.log" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.694058 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.738839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.784706 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.786964 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472 is running failed: container process not found" containerID="569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.788811 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-d462-account-create-m8s24"] Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.791571 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472 is running failed: container process not found" containerID="569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.791899 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472 is running failed: container process not found" containerID="569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472" cmd=["/usr/bin/pidof","ovsdb-server"] Nov 21 13:27:22 crc kubenswrapper[4769]: E1121 13:27:22.791954 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="ovsdbserver-sb" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.821747 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.822264 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://d4b92ecfef7c6e9ac2708c8d2e3892522247b4ab3c5d5d8cfd4298451b09ca86" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.836388 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: W1121 13:27:22.843550 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddffd7c05_86ef_4d65_8ace_49a5cbc0cd9d.slice/crio-c153a94b2fc510699c2a58bd340c7e97bc701ecf096c90f88abb3fa7d49a9017 WatchSource:0}: Error finding container c153a94b2fc510699c2a58bd340c7e97bc701ecf096c90f88abb3fa7d49a9017: Status 404 returned error can't find the container with id c153a94b2fc510699c2a58bd340c7e97bc701ecf096c90f88abb3fa7d49a9017 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.861548 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdbserver-nb-tls-certs\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-config\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874394 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4l2f\" (UniqueName: \"kubernetes.io/projected/2d6fd3d6-d129-40ae-8db7-be0e04466950-kube-api-access-g4l2f\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874518 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-combined-ca-bundle\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdb-rundir\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-scripts\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.874644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-metrics-certs-tls-certs\") pod \"2d6fd3d6-d129-40ae-8db7-be0e04466950\" (UID: \"2d6fd3d6-d129-40ae-8db7-be0e04466950\") " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.879724 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.881273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-config" (OuterVolumeSpecName: "config") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.881381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-scripts" (OuterVolumeSpecName: "scripts") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.894081 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6fd3d6-d129-40ae-8db7-be0e04466950-kube-api-access-g4l2f" (OuterVolumeSpecName: "kube-api-access-g4l2f") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "kube-api-access-g4l2f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.910390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.921299 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.921567 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" containerName="nova-cell1-conductor-conductor" containerID="cri-o://3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501" gracePeriod=30 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.961152 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="rabbitmq" containerID="cri-o://bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7" gracePeriod=604800 Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.970265 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.970910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.978255 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.978290 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d6fd3d6-d129-40ae-8db7-be0e04466950-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.978315 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.978328 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g4l2f\" (UniqueName: \"kubernetes.io/projected/2d6fd3d6-d129-40ae-8db7-be0e04466950-kube-api-access-g4l2f\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.978345 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.978357 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:22 crc kubenswrapper[4769]: I1121 13:27:22.979158 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-jht9m"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.089520 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="galera" containerID="cri-o://1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.115675 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.126252 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.126452 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerName="nova-cell0-conductor-conductor" containerID="cri-o://990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.160606 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.167991 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-sfvl9"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.180797 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican8259-account-delete-r2c4s"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.186425 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement3637-account-delete-m2bjk"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.200008 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.255306 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.287790 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_024d7eeb-986d-4113-9ed3-956c3ca2f600/ovsdbserver-sb/0.log" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.288248 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.291449 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141368eb-f9c2-4f68-839d-0e1f4795ecbb" path="/var/lib/kubelet/pods/141368eb-f9c2-4f68-839d-0e1f4795ecbb/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.294101 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4" path="/var/lib/kubelet/pods/2bdf5b95-7ef0-4aba-a95f-134fd1e47dc4/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.294810 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f5329b-af4d-40fd-9d96-228fc4ab9b27" path="/var/lib/kubelet/pods/52f5329b-af4d-40fd-9d96-228fc4ab9b27/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.297147 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d77dade-4b4d-433c-8fba-b99098b19fa8" path="/var/lib/kubelet/pods/6d77dade-4b4d-433c-8fba-b99098b19fa8/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.297854 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1c0c06-720c-4e58-b32f-8731a28a0a81" path="/var/lib/kubelet/pods/6f1c0c06-720c-4e58-b32f-8731a28a0a81/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.298622 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e1c737-c744-40d7-9514-9883a3fecad1" path="/var/lib/kubelet/pods/80e1c737-c744-40d7-9514-9883a3fecad1/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.299890 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb0643a-6cf9-4f43-b2ff-a872f3ee0faf" path="/var/lib/kubelet/pods/abb0643a-6cf9-4f43-b2ff-a872f3ee0faf/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.300658 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af43989f-54b8-4793-873f-466b61eadf51" path="/var/lib/kubelet/pods/af43989f-54b8-4793-873f-466b61eadf51/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.301326 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04a110e-5f5a-43e2-8e67-6266212050a1" path="/var/lib/kubelet/pods/f04a110e-5f5a-43e2-8e67-6266212050a1/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.310183 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37c6c6f-0074-4c84-b898-3b4bff18cb26" path="/var/lib/kubelet/pods/f37c6c6f-0074-4c84-b898-3b4bff18cb26/volumes" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.314098 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glancef3b9-account-delete-4b67q"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.323839 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.324159 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-central-agent" containerID="cri-o://4ce5b8eac8d6f245179bff460d5545dca76594d996bbf2de33253d57d860fec0" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.324343 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="proxy-httpd" containerID="cri-o://96f270b1b77c8f30e2785f79744a67c37aac48442377c3f5df0dc14b6495ef4b" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.324403 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="sg-core" containerID="cri-o://31034454d54b70210b9ccb8f54f225b4b1478991df6416d684e66ecf7584c5e4" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.324454 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-notification-agent" containerID="cri-o://4c766b60a2104885e7d5d1baed345a70fe7750f2658927a7539752ddf8457bfc" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.342524 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-cw69r"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.359268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.359614 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" containerName="kube-state-metrics" containerID="cri-o://a363390d2addd7f62f663622f1c5f901c98980c4dcfe65b7aec2e4a68946b7f8" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.394682 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.395125 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" containerName="memcached" containerID="cri-o://81b8a741f8c82e2efe32db9b2fb6bd4b16c9bcc4e5d212b94284640d453687d2" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-metrics-certs-tls-certs\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410156 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-scripts\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410214 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdbserver-sb-tls-certs\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410299 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fplnv\" (UniqueName: \"kubernetes.io/projected/024d7eeb-986d-4113-9ed3-956c3ca2f600-kube-api-access-fplnv\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-combined-ca-bundle\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdb-rundir\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.410439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-config\") pod \"024d7eeb-986d-4113-9ed3-956c3ca2f600\" (UID: \"024d7eeb-986d-4113-9ed3-956c3ca2f600\") " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.416083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-scripts" (OuterVolumeSpecName: "scripts") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.417354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.417812 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-config" (OuterVolumeSpecName: "config") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.425523 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-6c8kk"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.432699 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g7v9w"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.437352 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.438739 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.443917 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.443986 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" containerName="nova-cell1-conductor-conductor" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.450076 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-6c8kk"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.469635 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-g7v9w"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.474174 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7f8594c87b-2g9gp"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.474430 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" containerName="keystone-api" containerID="cri-o://c8c8acbaa3d7dac4a90d7287898b59d5fe457dc4f4647765a6926a222fb25e6c" gracePeriod=30 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.483102 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.485489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.485849 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/024d7eeb-986d-4113-9ed3-956c3ca2f600-kube-api-access-fplnv" (OuterVolumeSpecName: "kube-api-access-fplnv") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "kube-api-access-fplnv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.490492 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4gk9w"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.507377 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-4gk9w"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.515347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.540604 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.540726 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fplnv\" (UniqueName: \"kubernetes.io/projected/024d7eeb-986d-4113-9ed3-956c3ca2f600-kube-api-access-fplnv\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.540785 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.540858 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.540913 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/024d7eeb-986d-4113-9ed3-956c3ca2f600-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.544484 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.544633 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data podName:b51a88b8-9feb-448a-89c2-93800a854081 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:25.5446153 +0000 UTC m=+5804.245277118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data") pod "rabbitmq-server-0" (UID: "b51a88b8-9feb-448a-89c2-93800a854081") : configmap "rabbitmq-config-data" not found Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.558936 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-e6a4-account-create-4zwkx"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.570024 4769 generic.go:334] "Generic (PLEG): container finished" podID="9377cea3-e509-437e-b857-e60fb24f9570" containerID="a7a9e9c182706899fd81f119e340a8b9ac071b17d6858f5b6b34121651f3f41f" exitCode=137 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.585225 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder8e53-account-delete-zvrnf"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.586261 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novacell0726e-account-delete-tt4rj"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.611236 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4eed1d_bce3_4f26_a240_956b705062da.slice/crio-conmon-060e837d9f9e93205f3db10b0c7600a479b7ff79dd34a70673a559c089e2deb4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde29f094_3b0a_4c67_a75e_8d50a59945a9.slice/crio-conmon-316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8389f7ff_450d_41b9_88eb_c7c2929deccc.slice/crio-31034454d54b70210b9ccb8f54f225b4b1478991df6416d684e66ecf7584c5e4.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaec736c_d0fb_4b1a_9c7f_14e3a275807c.slice/crio-d4b92ecfef7c6e9ac2708c8d2e3892522247b4ab3c5d5d8cfd4298451b09ca86.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podece80665_fef3_4d5e_a84e_e853f5725be7.slice/crio-conmon-acd63c2764ed3cc516620b6e3f07fdaff888a485389174ec59e7caed4a8ac47d.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.624031 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/novaapi10ec-account-delete-cktts"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.628245 4769 generic.go:334] "Generic (PLEG): container finished" podID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerID="3b24cc09ab22264d746ae4f5f0857ced13d35ea66ae2f1da22e626a7d540861b" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.628477 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" event={"ID":"64ba6619-1b2b-4a3e-8605-cdc296f28855","Type":"ContainerDied","Data":"3b24cc09ab22264d746ae4f5f0857ced13d35ea66ae2f1da22e626a7d540861b"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.634886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" event={"ID":"5d95dea2-4e74-42eb-b7a0-cf3093c486da","Type":"ContainerStarted","Data":"c213268c670c3ca753c66e0ee9e32d9ed56cfeb54f6c050f9860853910ef1747"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.647451 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_024d7eeb-986d-4113-9ed3-956c3ca2f600/ovsdbserver-sb/0.log" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.647555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"024d7eeb-986d-4113-9ed3-956c3ca2f600","Type":"ContainerDied","Data":"85650a7bd7894a05ba70fd66385f5c961ebe532ce057ca0cbc0e04da2ca0c0eb"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.647592 4769 scope.go:117] "RemoveContainer" containerID="db49913b70d2be34d6c625affcffd31fd7e3bae0a9aa1c37a1ac503be82937da" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.647625 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.658148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" event={"ID":"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d","Type":"ContainerStarted","Data":"c153a94b2fc510699c2a58bd340c7e97bc701ecf096c90f88abb3fa7d49a9017"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.664726 4769 generic.go:334] "Generic (PLEG): container finished" podID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerID="53038e30829e3e1c73043a67ac6c92fecd76e095a9ac67e5c78d14d1a099763c" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.664780 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f","Type":"ContainerDied","Data":"53038e30829e3e1c73043a67ac6c92fecd76e095a9ac67e5c78d14d1a099763c"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.671272 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_2d6fd3d6-d129-40ae-8db7-be0e04466950/ovsdbserver-nb/0.log" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.671326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"2d6fd3d6-d129-40ae-8db7-be0e04466950","Type":"ContainerDied","Data":"44006b672b92d7851a5c352b6f254cde2469389ef1d654f899296716dfee0f1e"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.671400 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.681043 4769 generic.go:334] "Generic (PLEG): container finished" podID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerID="acd63c2764ed3cc516620b6e3f07fdaff888a485389174ec59e7caed4a8ac47d" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.681238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ece80665-fef3-4d5e-a84e-e853f5725be7","Type":"ContainerDied","Data":"acd63c2764ed3cc516620b6e3f07fdaff888a485389174ec59e7caed4a8ac47d"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.684764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" event={"ID":"0380fc82-b08b-4e96-a26d-d06c67417449","Type":"ContainerStarted","Data":"9a1e9d9a0c638d5eea368727c9ef553e247acce103fbe21888f23c5dd7751591"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.699169 4769 generic.go:334] "Generic (PLEG): container finished" podID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerID="51c82d1abe313c608e8cfb5b329634aa1bb7af7491c585fda31de62cdc267828" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.699257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" event={"ID":"083c8f14-c35e-4d60-91ef-9881dc7ad8c3","Type":"ContainerDied","Data":"51c82d1abe313c608e8cfb5b329634aa1bb7af7491c585fda31de62cdc267828"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.703300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" event={"ID":"b46b5eff-f711-418b-b9de-54a5a91821af","Type":"ContainerStarted","Data":"00ae7b411f23726c32518a8b05d9916481e126a38d493e4614f8070d6a45ff38"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.731766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.739259 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.742354 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b" exitCode=0 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.742393 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c" exitCode=0 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.742427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.742481 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.745349 4769 generic.go:334] "Generic (PLEG): container finished" podID="93f0d766-9895-4c18-9a55-b670336879a5" containerID="28fa00088106bd2af81ea2a135e9d01f80cdf4c35440b619adb0f417ec784fc9" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.745432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93f0d766-9895-4c18-9a55-b670336879a5","Type":"ContainerDied","Data":"28fa00088106bd2af81ea2a135e9d01f80cdf4c35440b619adb0f417ec784fc9"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.745676 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.745707 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.748954 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.751430 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.757007 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:23 crc kubenswrapper[4769]: E1121 13:27:23.757086 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerName="nova-cell0-conductor-conductor" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.757489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" event={"ID":"ac1d3aa2-0067-423a-ad55-820d9dde22f4","Type":"ContainerStarted","Data":"a910ba1812a14680d65ff12d2f18092f82e78c242ba142b7bc657e64340bf9bf"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.768599 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" event={"ID":"ee855a9c-b038-4a02-bca3-32d7fc3f321f","Type":"ContainerStarted","Data":"df0dd1e7c28d7199d76acc3ff27cb63626b456dd40b49f62856652c2daa7698e"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.779225 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerID="d47834be36b3b8424947e2ec37cd955af4c78a9889f24e5ec2d3bc3c33b442ad" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.779513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" event={"ID":"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee","Type":"ContainerDied","Data":"d47834be36b3b8424947e2ec37cd955af4c78a9889f24e5ec2d3bc3c33b442ad"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.790844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.793269 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerID="2625031a0b0c2bbf67b35c39fd280fdbab221bfd025c71f05cfb0b8e055e826b" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.793347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" event={"ID":"cc15cbd1-7c64-4f95-b7ed-2090167ce968","Type":"ContainerDied","Data":"2625031a0b0c2bbf67b35c39fd280fdbab221bfd025c71f05cfb0b8e055e826b"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.800851 4769 generic.go:334] "Generic (PLEG): container finished" podID="1d4eed1d-bce3-4f26-a240-956b705062da" containerID="060e837d9f9e93205f3db10b0c7600a479b7ff79dd34a70673a559c089e2deb4" exitCode=143 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.800902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d4eed1d-bce3-4f26-a240-956b705062da","Type":"ContainerDied","Data":"060e837d9f9e93205f3db10b0c7600a479b7ff79dd34a70673a559c089e2deb4"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.803734 4769 generic.go:334] "Generic (PLEG): container finished" podID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerID="31034454d54b70210b9ccb8f54f225b4b1478991df6416d684e66ecf7584c5e4" exitCode=2 Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.804092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerDied","Data":"31034454d54b70210b9ccb8f54f225b4b1478991df6416d684e66ecf7584c5e4"} Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.848311 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.908262 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "2d6fd3d6-d129-40ae-8db7-be0e04466950" (UID: "2d6fd3d6-d129-40ae-8db7-be0e04466950"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.914219 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk"] Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.954410 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d6fd3d6-d129-40ae-8db7-be0e04466950-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.983036 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:23 crc kubenswrapper[4769]: I1121 13:27:23.993531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "024d7eeb-986d-4113-9ed3-956c3ca2f600" (UID: "024d7eeb-986d-4113-9ed3-956c3ca2f600"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:24 crc kubenswrapper[4769]: W1121 13:27:24.012844 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5ae4ec3_5987_4a40_a7af_5f243c1eef60.slice/crio-2683e845f5b2c7801bc52d9d36d188373e8daf73ed98f715c76c06cd91a25f4b WatchSource:0}: Error finding container 2683e845f5b2c7801bc52d9d36d188373e8daf73ed98f715c76c06cd91a25f4b: Status 404 returned error can't find the container with id 2683e845f5b2c7801bc52d9d36d188373e8daf73ed98f715c76c06cd91a25f4b Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.056647 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.056683 4769 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/024d7eeb-986d-4113-9ed3-956c3ca2f600-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.119658 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="1243748f-cba6-409e-8765-467b40e04ba7" containerName="galera" containerID="cri-o://d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0" gracePeriod=30 Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.158370 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.158445 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data podName:f76c87ba-5d40-4b61-a44a-7b8c895507d8 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:28.158426128 +0000 UTC m=+5806.859087946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data") pod "rabbitmq-cell1-server-0" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.211787 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" containerName="kube-state-metrics" probeResult="failure" output="Get \"https://10.217.1.1:8081/readyz\": dial tcp 10.217.1.1:8081: connect: connection refused" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.243739 4769 scope.go:117] "RemoveContainer" containerID="569633c255b611e691a417f13f6e5f373e706dfaedb32d706204769fc6800472" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.269285 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.322439 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.340922 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.342440 4769 scope.go:117] "RemoveContainer" containerID="be9c19419f89a89082ee0b343109bab8e7792cc6fea3839c7fdeddca9f685c62" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.366602 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.375397 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.384067 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.388969 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.390289 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.397057 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.397114 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="galera" Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.397381 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:27:24 crc kubenswrapper[4769]: E1121 13:27:24.397407 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="ovn-northd" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.465121 4769 scope.go:117] "RemoveContainer" containerID="cdaa1d8f7d3d6f55cd5295bb6c352e9a0c980a4cdbc1400a1c6948b54e244514" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.611440 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/memcached-0" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" containerName="memcached" probeResult="failure" output="dial tcp 10.217.0.179:11211: connect: connection refused" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.827990 4769 generic.go:334] "Generic (PLEG): container finished" podID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" containerID="a363390d2addd7f62f663622f1c5f901c98980c4dcfe65b7aec2e4a68946b7f8" exitCode=2 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.828555 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9","Type":"ContainerDied","Data":"a363390d2addd7f62f663622f1c5f901c98980c4dcfe65b7aec2e4a68946b7f8"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.833601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" event={"ID":"5d95dea2-4e74-42eb-b7a0-cf3093c486da","Type":"ContainerStarted","Data":"da35b0f4ffb1f1ef38cbec717c5fb6e0e7e25e9d6f1d56e125ec21b01cddc2f7"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.835376 4769 generic.go:334] "Generic (PLEG): container finished" podID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" containerID="d4b92ecfef7c6e9ac2708c8d2e3892522247b4ab3c5d5d8cfd4298451b09ca86" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.835449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baec736c-d0fb-4b1a-9c7f-14e3a275807c","Type":"ContainerDied","Data":"d4b92ecfef7c6e9ac2708c8d2e3892522247b4ab3c5d5d8cfd4298451b09ca86"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.836652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" event={"ID":"a55ce728-ef0d-492c-9c68-31f2139f4734","Type":"ContainerStarted","Data":"ea051d63715f183dd0535b886dbe8f092cc20b31e7d94445dfc4c346195b3780"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.846544 4769 generic.go:334] "Generic (PLEG): container finished" podID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerID="f64d2bc57c57a71190be05e671bb1c457619526945c17ab314e1f5b71413d4a2" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.846622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"00ca8158-c10b-4e37-b666-6610ba3113f2","Type":"ContainerDied","Data":"f64d2bc57c57a71190be05e671bb1c457619526945c17ab314e1f5b71413d4a2"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.848216 4769 generic.go:334] "Generic (PLEG): container finished" podID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerID="92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.848212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" event={"ID":"222390bc-4c6c-4f69-b753-5f190e15bb6d","Type":"ContainerDied","Data":"92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.851028 4769 generic.go:334] "Generic (PLEG): container finished" podID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerID="801a5a2e0ae9c34058bc621dfe0405dfcb878e7285d4e358124dc8a802c16f4f" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.851046 4769 generic.go:334] "Generic (PLEG): container finished" podID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerID="5adac2918490b2e7c46769264c7951b0c8e6a236d35988472255847e24f782a3" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.851088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" event={"ID":"2aa088d3-53a0-4016-87ac-59358c5b2d35","Type":"ContainerDied","Data":"801a5a2e0ae9c34058bc621dfe0405dfcb878e7285d4e358124dc8a802c16f4f"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.851105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" event={"ID":"2aa088d3-53a0-4016-87ac-59358c5b2d35","Type":"ContainerDied","Data":"5adac2918490b2e7c46769264c7951b0c8e6a236d35988472255847e24f782a3"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.852326 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" event={"ID":"0380fc82-b08b-4e96-a26d-d06c67417449","Type":"ContainerStarted","Data":"618570b0583bee68d8251d9be19ff801ddbd37d2aa2bac59decdbaabe8c86c7b"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.855799 4769 generic.go:334] "Generic (PLEG): container finished" podID="00d977e8-e6a0-4274-be9a-24c45d5b1496" containerID="81b8a741f8c82e2efe32db9b2fb6bd4b16c9bcc4e5d212b94284640d453687d2" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.855868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"00d977e8-e6a0-4274-be9a-24c45d5b1496","Type":"ContainerDied","Data":"81b8a741f8c82e2efe32db9b2fb6bd4b16c9bcc4e5d212b94284640d453687d2"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.857679 4769 generic.go:334] "Generic (PLEG): container finished" podID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" containerID="3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.857748 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd","Type":"ContainerDied","Data":"3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870375 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870407 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870415 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870424 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870432 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870439 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870446 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870495 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870508 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870452 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870587 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870600 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870612 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870620 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.870815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.871160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.873052 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37eedcb9aac504deb9c786acfaaf25bca71d638c47a39c62675bb92b63be3936" Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.875339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" event={"ID":"b5ae4ec3-5987-4a40-a7af-5f243c1eef60","Type":"ContainerStarted","Data":"2683e845f5b2c7801bc52d9d36d188373e8daf73ed98f715c76c06cd91a25f4b"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.880547 4769 generic.go:334] "Generic (PLEG): container finished" podID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerID="96f270b1b77c8f30e2785f79744a67c37aac48442377c3f5df0dc14b6495ef4b" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.880578 4769 generic.go:334] "Generic (PLEG): container finished" podID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerID="4c766b60a2104885e7d5d1baed345a70fe7750f2658927a7539752ddf8457bfc" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.880585 4769 generic.go:334] "Generic (PLEG): container finished" podID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerID="4ce5b8eac8d6f245179bff460d5545dca76594d996bbf2de33253d57d860fec0" exitCode=0 Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.880630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerDied","Data":"96f270b1b77c8f30e2785f79744a67c37aac48442377c3f5df0dc14b6495ef4b"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.880684 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerDied","Data":"4c766b60a2104885e7d5d1baed345a70fe7750f2658927a7539752ddf8457bfc"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.880702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerDied","Data":"4ce5b8eac8d6f245179bff460d5545dca76594d996bbf2de33253d57d860fec0"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.882760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" event={"ID":"b46b5eff-f711-418b-b9de-54a5a91821af","Type":"ContainerStarted","Data":"53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441"} Nov 21 13:27:24 crc kubenswrapper[4769]: I1121 13:27:24.882936 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-cw69r" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="registry-server" containerID="cri-o://fa98d3985eb6a30d06eddaf9ed39767135f67b0acb4b2b8428762a935fc41375" gracePeriod=2 Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.053332 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.110933 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config-secret\") pod \"9377cea3-e509-437e-b857-e60fb24f9570\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.110985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-combined-ca-bundle\") pod \"9377cea3-e509-437e-b857-e60fb24f9570\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.111086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config\") pod \"9377cea3-e509-437e-b857-e60fb24f9570\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.111135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbhvs\" (UniqueName: \"kubernetes.io/projected/9377cea3-e509-437e-b857-e60fb24f9570-kube-api-access-rbhvs\") pod \"9377cea3-e509-437e-b857-e60fb24f9570\" (UID: \"9377cea3-e509-437e-b857-e60fb24f9570\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.133429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9377cea3-e509-437e-b857-e60fb24f9570-kube-api-access-rbhvs" (OuterVolumeSpecName: "kube-api-access-rbhvs") pod "9377cea3-e509-437e-b857-e60fb24f9570" (UID: "9377cea3-e509-437e-b857-e60fb24f9570"). InnerVolumeSpecName "kube-api-access-rbhvs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.137010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "9377cea3-e509-437e-b857-e60fb24f9570" (UID: "9377cea3-e509-437e-b857-e60fb24f9570"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.158310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9377cea3-e509-437e-b857-e60fb24f9570" (UID: "9377cea3-e509-437e-b857-e60fb24f9570"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.206983 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "9377cea3-e509-437e-b857-e60fb24f9570" (UID: "9377cea3-e509-437e-b857-e60fb24f9570"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.216674 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.216709 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9377cea3-e509-437e-b857-e60fb24f9570-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.216720 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/9377cea3-e509-437e-b857-e60fb24f9570-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.216730 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rbhvs\" (UniqueName: \"kubernetes.io/projected/9377cea3-e509-437e-b857-e60fb24f9570-kube-api-access-rbhvs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.310801 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" path="/var/lib/kubelet/pods/024d7eeb-986d-4113-9ed3-956c3ca2f600/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.313316 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14321b29-565a-4472-ae96-461ab7c03f25" path="/var/lib/kubelet/pods/14321b29-565a-4472-ae96-461ab7c03f25/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.316286 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" path="/var/lib/kubelet/pods/2d6fd3d6-d129-40ae-8db7-be0e04466950/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.317024 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ed2f4f-4e7c-4539-8d06-557aa785ac52" path="/var/lib/kubelet/pods/63ed2f4f-4e7c-4539-8d06-557aa785ac52/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.317729 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9044488d-6b19-4fbe-b4b2-8276fc8c644d" path="/var/lib/kubelet/pods/9044488d-6b19-4fbe-b4b2-8276fc8c644d/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.321075 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.0.252:6080/vnc_lite.html\": dial tcp 10.217.0.252:6080: connect: connection refused" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.322743 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9377cea3-e509-437e-b857-e60fb24f9570" path="/var/lib/kubelet/pods/9377cea3-e509-437e-b857-e60fb24f9570/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.323612 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91ff0bf-0214-45a3-8436-0ae635c5d3e9" path="/var/lib/kubelet/pods/e91ff0bf-0214-45a3-8436-0ae635c5d3e9/volumes" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.436749 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-gz5jt"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.450670 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.451922 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-gz5jt"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.462678 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-3637-account-create-nfwpk"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.463897 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.481979 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-3637-account-create-nfwpk"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.492095 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement3637-account-delete-m2bjk"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.528500 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z74sc\" (UniqueName: \"kubernetes.io/projected/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-api-access-z74sc\") pod \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.528598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-config\") pod \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.528623 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gc78\" (UniqueName: \"kubernetes.io/projected/00d977e8-e6a0-4274-be9a-24c45d5b1496-kube-api-access-2gc78\") pod \"00d977e8-e6a0-4274-be9a-24c45d5b1496\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.529149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-combined-ca-bundle\") pod \"00d977e8-e6a0-4274-be9a-24c45d5b1496\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.529286 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-memcached-tls-certs\") pod \"00d977e8-e6a0-4274-be9a-24c45d5b1496\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.529360 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-certs\") pod \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.529404 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-config-data\") pod \"00d977e8-e6a0-4274-be9a-24c45d5b1496\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.529456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-kolla-config\") pod \"00d977e8-e6a0-4274-be9a-24c45d5b1496\" (UID: \"00d977e8-e6a0-4274-be9a-24c45d5b1496\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.529502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-combined-ca-bundle\") pod \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\" (UID: \"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9\") " Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.531134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-config-data" (OuterVolumeSpecName: "config-data") pod "00d977e8-e6a0-4274-be9a-24c45d5b1496" (UID: "00d977e8-e6a0-4274-be9a-24c45d5b1496"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.531172 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "00d977e8-e6a0-4274-be9a-24c45d5b1496" (UID: "00d977e8-e6a0-4274-be9a-24c45d5b1496"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.536768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-api-access-z74sc" (OuterVolumeSpecName: "kube-api-access-z74sc") pod "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" (UID: "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9"). InnerVolumeSpecName "kube-api-access-z74sc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.546490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d977e8-e6a0-4274-be9a-24c45d5b1496-kube-api-access-2gc78" (OuterVolumeSpecName: "kube-api-access-2gc78") pod "00d977e8-e6a0-4274-be9a-24c45d5b1496" (UID: "00d977e8-e6a0-4274-be9a-24c45d5b1496"). InnerVolumeSpecName "kube-api-access-2gc78". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.601031 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-kp4d7"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.616626 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-kp4d7"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.620879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "00d977e8-e6a0-4274-be9a-24c45d5b1496" (UID: "00d977e8-e6a0-4274-be9a-24c45d5b1496"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.636891 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-8259-account-create-dm6vc"] Nov 21 13:27:25 crc kubenswrapper[4769]: E1121 13:27:25.637397 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:27:25 crc kubenswrapper[4769]: E1121 13:27:25.637457 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data podName:b51a88b8-9feb-448a-89c2-93800a854081 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:29.637437561 +0000 UTC m=+5808.338099489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data") pod "rabbitmq-server-0" (UID: "b51a88b8-9feb-448a-89c2-93800a854081") : configmap "rabbitmq-config-data" not found Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.638336 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.638368 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/00d977e8-e6a0-4274-be9a-24c45d5b1496-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.638380 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z74sc\" (UniqueName: \"kubernetes.io/projected/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-api-access-z74sc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.638392 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2gc78\" (UniqueName: \"kubernetes.io/projected/00d977e8-e6a0-4274-be9a-24c45d5b1496-kube-api-access-2gc78\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.638402 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.692908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" (UID: "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.747727 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.219:9311/healthcheck\": read tcp 10.217.0.2:45230->10.217.0.219:9311: read: connection reset by peer" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.748205 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.219:9311/healthcheck\": read tcp 10.217.0.2:45224->10.217.0.219:9311: read: connection reset by peer" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.763968 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-8259-account-create-dm6vc"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.800606 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican8259-account-delete-r2c4s"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.807538 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.902945 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" (UID: "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.909959 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:25 crc kubenswrapper[4769]: E1121 13:27:25.927670 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.927806 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-grspb"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.927881 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" (UID: "e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.932583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "00d977e8-e6a0-4274-be9a-24c45d5b1496" (UID: "00d977e8-e6a0-4274-be9a-24c45d5b1496"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:25 crc kubenswrapper[4769]: E1121 13:27:25.958496 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.986706 4769 generic.go:334] "Generic (PLEG): container finished" podID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerID="7b39d818ba5d4f34c390d02af9f96c36bbeffebe7dc55c52009a58149db36791" exitCode=1 Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.986816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" event={"ID":"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d","Type":"ContainerDied","Data":"7b39d818ba5d4f34c390d02af9f96c36bbeffebe7dc55c52009a58149db36791"} Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.987413 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:25 crc kubenswrapper[4769]: I1121 13:27:25.987446 4769 scope.go:117] "RemoveContainer" containerID="7b39d818ba5d4f34c390d02af9f96c36bbeffebe7dc55c52009a58149db36791" Nov 21 13:27:25 crc kubenswrapper[4769]: E1121 13:27:25.990938 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Nov 21 13:27:25 crc kubenswrapper[4769]: E1121 13:27:25.990987 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="fdf41518-0738-4701-9482-fe17d9be8abf" containerName="nova-scheduler-scheduler" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.013614 4769 reconciler_common.go:293] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/00d977e8-e6a0-4274-be9a-24c45d5b1496-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.013642 4769 reconciler_common.go:293] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.020424 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-grspb"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.039626 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerID="0164617c683f651c195f2757ec57bffae8ad263ad2047e33a3fcd9f12edeb133" exitCode=0 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.039795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" event={"ID":"cc15cbd1-7c64-4f95-b7ed-2090167ce968","Type":"ContainerDied","Data":"0164617c683f651c195f2757ec57bffae8ad263ad2047e33a3fcd9f12edeb133"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.067249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-bfc0-account-create-674zs"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.079562 4769 generic.go:334] "Generic (PLEG): container finished" podID="b46b5eff-f711-418b-b9de-54a5a91821af" containerID="53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441" exitCode=1 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.079618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" event={"ID":"b46b5eff-f711-418b-b9de-54a5a91821af","Type":"ContainerDied","Data":"53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.080070 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.080106 4769 scope.go:117] "RemoveContainer" containerID="53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.090809 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-bfc0-account-create-674zs"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.125941 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.236:9292/healthcheck\": read tcp 10.217.0.2:51436->10.217.0.236:9292: read: connection reset by peer" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.127983 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.236:9292/healthcheck\": read tcp 10.217.0.2:51430->10.217.0.236:9292: read: connection reset by peer" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.130323 4769 generic.go:334] "Generic (PLEG): container finished" podID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerID="ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e" exitCode=0 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.132712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" event={"ID":"b5ae4ec3-5987-4a40-a7af-5f243c1eef60","Type":"ContainerDied","Data":"ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e"} Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.138780 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.138838 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts podName:dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d nodeName:}" failed. No retries permitted until 2025-11-21 13:27:26.638822505 +0000 UTC m=+5805.339484323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts") pod "glancef3b9-account-delete-4b67q" (UID: "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.152865 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.159823 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.229:8776/healthcheck\": read tcp 10.217.0.2:56744->10.217.0.229:8776: read: connection reset by peer" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.169483 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mx78h"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.184225 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerID="be0519166390db68391d0049b7d5f8c7b63656a920b7ef46312a91ab03906afe" exitCode=1 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.184305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" event={"ID":"ac1d3aa2-0067-423a-ad55-820d9dde22f4","Type":"ContainerDied","Data":"be0519166390db68391d0049b7d5f8c7b63656a920b7ef46312a91ab03906afe"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.200496 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mx78h"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.205822 4769 generic.go:334] "Generic (PLEG): container finished" podID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerID="c6d239fc1939be310f5bcd366fc6fdf9ec2dbd5126149f75ac259820c40d6b2f" exitCode=0 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.205885 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"00ca8158-c10b-4e37-b666-6610ba3113f2","Type":"ContainerDied","Data":"c6d239fc1939be310f5bcd366fc6fdf9ec2dbd5126149f75ac259820c40d6b2f"} Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.242950 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.243005 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts podName:b46b5eff-f711-418b-b9de-54a5a91821af nodeName:}" failed. No retries permitted until 2025-11-21 13:27:26.742990978 +0000 UTC m=+5805.443652786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts") pod "placement3637-account-delete-m2bjk" (UID: "b46b5eff-f711-418b-b9de-54a5a91821af") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.244307 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-f3b9-account-create-65z5z"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.255607 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerID="5bfe147eba2c65afc48c2e107851d247ccff63b815c4bb7f56759cc5841700fb" exitCode=1 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.255705 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" event={"ID":"ee855a9c-b038-4a02-bca3-32d7fc3f321f","Type":"ContainerDied","Data":"5bfe147eba2c65afc48c2e107851d247ccff63b815c4bb7f56759cc5841700fb"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.258674 4769 generic.go:334] "Generic (PLEG): container finished" podID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerID="da35b0f4ffb1f1ef38cbec717c5fb6e0e7e25e9d6f1d56e125ec21b01cddc2f7" exitCode=1 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.258735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" event={"ID":"5d95dea2-4e74-42eb-b7a0-cf3093c486da","Type":"ContainerDied","Data":"da35b0f4ffb1f1ef38cbec717c5fb6e0e7e25e9d6f1d56e125ec21b01cddc2f7"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.258739 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.258802 4769 scope.go:117] "RemoveContainer" containerID="be0519166390db68391d0049b7d5f8c7b63656a920b7ef46312a91ab03906afe" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.259453 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.259492 4769 scope.go:117] "RemoveContainer" containerID="da35b0f4ffb1f1ef38cbec717c5fb6e0e7e25e9d6f1d56e125ec21b01cddc2f7" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.292477 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.9:8775/\": read tcp 10.217.0.2:51188->10.217.1.9:8775: read: connection reset by peer" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.292012 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.9:8775/\": read tcp 10.217.0.2:51200->10.217.1.9:8775: read: connection reset by peer" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.295289 4769 generic.go:334] "Generic (PLEG): container finished" podID="0380fc82-b08b-4e96-a26d-d06c67417449" containerID="618570b0583bee68d8251d9be19ff801ddbd37d2aa2bac59decdbaabe8c86c7b" exitCode=1 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.295647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" event={"ID":"0380fc82-b08b-4e96-a26d-d06c67417449","Type":"ContainerDied","Data":"618570b0583bee68d8251d9be19ff801ddbd37d2aa2bac59decdbaabe8c86c7b"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.295850 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.295883 4769 scope.go:117] "RemoveContainer" containerID="618570b0583bee68d8251d9be19ff801ddbd37d2aa2bac59decdbaabe8c86c7b" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.302256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9","Type":"ContainerDied","Data":"edc114cb006adf81af7ff52b81dd6e9bcfa86331584a3a343eb6eb3e1462dcd7"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.302305 4769 scope.go:117] "RemoveContainer" containerID="a363390d2addd7f62f663622f1c5f901c98980c4dcfe65b7aec2e4a68946b7f8" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.302390 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.303733 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glancef3b9-account-delete-4b67q"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.307054 4769 generic.go:334] "Generic (PLEG): container finished" podID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerID="caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd" exitCode=1 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.307144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" event={"ID":"a55ce728-ef0d-492c-9c68-31f2139f4734","Type":"ContainerDied","Data":"caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.322276 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-f3b9-account-create-65z5z"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.325130 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-b7x6s"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.350015 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-b7x6s"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.385953 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.385996 4769 scope.go:117] "RemoveContainer" containerID="5bfe147eba2c65afc48c2e107851d247ccff63b815c4bb7f56759cc5841700fb" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.388001 4769 generic.go:334] "Generic (PLEG): container finished" podID="90a092e1-717f-4c7a-9740-89b57b690e43" containerID="fa98d3985eb6a30d06eddaf9ed39767135f67b0acb4b2b8428762a935fc41375" exitCode=0 Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.389380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerDied","Data":"fa98d3985eb6a30d06eddaf9ed39767135f67b0acb4b2b8428762a935fc41375"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.405068 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-8e53-account-create-h6dl4"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.417530 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.424176 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.425231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"00d977e8-e6a0-4274-be9a-24c45d5b1496","Type":"ContainerDied","Data":"ae92a08bb050757dc7ac3a709ccab2a113f5668f6e918808382474be49209344"} Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.445293 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-8e53-account-create-h6dl4"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.477220 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" secret="" err="secret \"galera-openstack-dockercfg-6bjcj\" not found" Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.477270 4769 scope.go:117] "RemoveContainer" containerID="caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd" Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.478831 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.478871 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts podName:ac1d3aa2-0067-423a-ad55-820d9dde22f4 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:26.978859286 +0000 UTC m=+5805.679521104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts") pod "cinder8e53-account-delete-zvrnf" (UID: "ac1d3aa2-0067-423a-ad55-820d9dde22f4") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.480923 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.480974 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts podName:5d95dea2-4e74-42eb-b7a0-cf3093c486da nodeName:}" failed. No retries permitted until 2025-11-21 13:27:26.980958842 +0000 UTC m=+5805.681620660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts") pod "barbican8259-account-delete-r2c4s" (UID: "5d95dea2-4e74-42eb-b7a0-cf3093c486da") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.481347 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.481464 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts podName:0380fc82-b08b-4e96-a26d-d06c67417449 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:26.981453506 +0000 UTC m=+5805.682115394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts") pod "neutronbfc0-account-delete-bvhpq" (UID: "0380fc82-b08b-4e96-a26d-d06c67417449") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.539358 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder8e53-account-delete-zvrnf"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.566855 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-t94wk"] Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.596963 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.597035 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts podName:a55ce728-ef0d-492c-9c68-31f2139f4734 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:27.097016326 +0000 UTC m=+5805.797678144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts") pod "novaapi10ec-account-delete-cktts" (UID: "a55ce728-ef0d-492c-9c68-31f2139f4734") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.597924 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.597990 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts podName:ee855a9c-b038-4a02-bca3-32d7fc3f321f nodeName:}" failed. No retries permitted until 2025-11-21 13:27:27.097972731 +0000 UTC m=+5805.798634539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts") pod "novacell0726e-account-delete-tt4rj" (UID: "ee855a9c-b038-4a02-bca3-32d7fc3f321f") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.647759 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-t94wk"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.659667 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.685817 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-726e-account-create-x7j6g"] Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.699287 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.699362 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts podName:dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d nodeName:}" failed. No retries permitted until 2025-11-21 13:27:27.69934527 +0000 UTC m=+5806.400007088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts") pod "glancef3b9-account-delete-4b67q" (UID: "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.700469 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0726e-account-delete-tt4rj"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.727329 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-6jmtc"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.737850 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-6jmtc"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.760901 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-10ec-account-create-5544k"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.771850 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi10ec-account-delete-cktts"] Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.787486 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-10ec-account-create-5544k"] Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.801547 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: E1121 13:27:26.801618 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts podName:b46b5eff-f711-418b-b9de-54a5a91821af nodeName:}" failed. No retries permitted until 2025-11-21 13:27:27.801601692 +0000 UTC m=+5806.502263510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts") pod "placement3637-account-delete-m2bjk" (UID: "b46b5eff-f711-418b-b9de-54a5a91821af") : configmap "openstack-scripts" not found Nov 21 13:27:26 crc kubenswrapper[4769]: I1121 13:27:26.830786 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" containerName="keystone-api" probeResult="failure" output="Get \"https://10.217.0.214:5000/v3\": dial tcp 10.217.0.214:5000: connect: connection refused" Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.006627 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.006686 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts podName:ac1d3aa2-0067-423a-ad55-820d9dde22f4 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:28.00667328 +0000 UTC m=+5806.707335098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts") pod "cinder8e53-account-delete-zvrnf" (UID: "ac1d3aa2-0067-423a-ad55-820d9dde22f4") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.006720 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.006739 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts podName:5d95dea2-4e74-42eb-b7a0-cf3093c486da nodeName:}" failed. No retries permitted until 2025-11-21 13:27:28.006733632 +0000 UTC m=+5806.707395450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts") pod "barbican8259-account-delete-r2c4s" (UID: "5d95dea2-4e74-42eb-b7a0-cf3093c486da") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.006759 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.006775 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts podName:0380fc82-b08b-4e96-a26d-d06c67417449 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:28.006770553 +0000 UTC m=+5806.707432371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts") pod "neutronbfc0-account-delete-bvhpq" (UID: "0380fc82-b08b-4e96-a26d-d06c67417449") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.108582 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.108652 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts podName:a55ce728-ef0d-492c-9c68-31f2139f4734 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:28.108635574 +0000 UTC m=+5806.809297392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts") pod "novaapi10ec-account-delete-cktts" (UID: "a55ce728-ef0d-492c-9c68-31f2139f4734") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.109009 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.109055 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts podName:ee855a9c-b038-4a02-bca3-32d7fc3f321f nodeName:}" failed. No retries permitted until 2025-11-21 13:27:28.109045125 +0000 UTC m=+5806.809706943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts") pod "novacell0726e-account-delete-tt4rj" (UID: "ee855a9c-b038-4a02-bca3-32d7fc3f321f") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.296296 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16eacb62-36b7-461f-88f0-47f604b06741" path="/var/lib/kubelet/pods/16eacb62-36b7-461f-88f0-47f604b06741/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.297223 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a0c9095-8e64-4754-936e-d92dca1fcb6c" path="/var/lib/kubelet/pods/2a0c9095-8e64-4754-936e-d92dca1fcb6c/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.297776 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3642a623-680d-488e-97bd-5a9a11f56b4d" path="/var/lib/kubelet/pods/3642a623-680d-488e-97bd-5a9a11f56b4d/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.298522 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e0bc4f7-dff2-4d22-ab55-3232f6fdb259" path="/var/lib/kubelet/pods/3e0bc4f7-dff2-4d22-ab55-3232f6fdb259/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.299609 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="406bfa32-af31-408c-bb6e-cc77eb721124" path="/var/lib/kubelet/pods/406bfa32-af31-408c-bb6e-cc77eb721124/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.300487 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b2ee8b-8633-4e4f-8b24-22446a0a66a2" path="/var/lib/kubelet/pods/61b2ee8b-8633-4e4f-8b24-22446a0a66a2/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.301263 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a354eb-09c7-467d-bb1c-a40253cc5a4b" path="/var/lib/kubelet/pods/64a354eb-09c7-467d-bb1c-a40253cc5a4b/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.301792 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df536c6-9ff2-4b84-b5df-cb59a9d18215" path="/var/lib/kubelet/pods/9df536c6-9ff2-4b84-b5df-cb59a9d18215/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.302418 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a85c2f-0820-4771-8303-5d3b849ab7c7" path="/var/lib/kubelet/pods/a0a85c2f-0820-4771-8303-5d3b849ab7c7/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.304164 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46d04b9-5ec1-493b-a455-fc811117ee73" path="/var/lib/kubelet/pods/b46d04b9-5ec1-493b-a455-fc811117ee73/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.305066 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6840543-d283-4ac5-87aa-7ea4af38dc7e" path="/var/lib/kubelet/pods/b6840543-d283-4ac5-87aa-7ea4af38dc7e/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.305898 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd3f3895-cd1e-465e-9516-7744f08911cb" path="/var/lib/kubelet/pods/bd3f3895-cd1e-465e-9516-7744f08911cb/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.319181 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c43a72a1-6d90-4f99-a7d1-41cf8e343bb3" path="/var/lib/kubelet/pods/c43a72a1-6d90-4f99-a7d1-41cf8e343bb3/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.319815 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb49b879-3d42-4ab6-82f4-6f2acfa72760" path="/var/lib/kubelet/pods/eb49b879-3d42-4ab6-82f4-6f2acfa72760/volumes" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.437512 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"00ca8158-c10b-4e37-b666-6610ba3113f2","Type":"ContainerDied","Data":"02970a4cd74f47f789bd917c7d77dc67892f3c132473a6a7b06a29a9dd3c170d"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.437563 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02970a4cd74f47f789bd917c7d77dc67892f3c132473a6a7b06a29a9dd3c170d" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.440585 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c0d96de-e234-4e3c-9db1-882b35918e73" containerID="c8c8acbaa3d7dac4a90d7287898b59d5fe457dc4f4647765a6926a222fb25e6c" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.440654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" event={"ID":"6c0d96de-e234-4e3c-9db1-882b35918e73","Type":"ContainerDied","Data":"c8c8acbaa3d7dac4a90d7287898b59d5fe457dc4f4647765a6926a222fb25e6c"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.440680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" event={"ID":"6c0d96de-e234-4e3c-9db1-882b35918e73","Type":"ContainerDied","Data":"84c8f8779a0cc74b3f5dbb3a48974c63389bb86fead51f9b241e718ae6b1f33f"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.440690 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84c8f8779a0cc74b3f5dbb3a48974c63389bb86fead51f9b241e718ae6b1f33f" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.443356 4769 generic.go:334] "Generic (PLEG): container finished" podID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerID="9d69ab3f61c7fed3934f0597dc69b74c925dadc71f7e99117e34fe6b975dab16" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.443478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ece80665-fef3-4d5e-a84e-e853f5725be7","Type":"ContainerDied","Data":"9d69ab3f61c7fed3934f0597dc69b74c925dadc71f7e99117e34fe6b975dab16"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.448251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8389f7ff-450d-41b9-88eb-c7c2929deccc","Type":"ContainerDied","Data":"128e7ab5c057f3814a7303c41abfdc7f505c368b6a08efc0851ebb9d5042553d"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.448315 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="128e7ab5c057f3814a7303c41abfdc7f505c368b6a08efc0851ebb9d5042553d" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.451010 4769 generic.go:334] "Generic (PLEG): container finished" podID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerID="a5ac62d77120b0c9972bb763b1099bfe3f2232cca9e8ce39e1255eaa67c20acf" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.451103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f","Type":"ContainerDied","Data":"a5ac62d77120b0c9972bb763b1099bfe3f2232cca9e8ce39e1255eaa67c20acf"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.451123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f","Type":"ContainerDied","Data":"6a79c1e7cc01323dffe1064f9bdc25915ac4591df97676fde186f1edbcaf1e74"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.451219 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a79c1e7cc01323dffe1064f9bdc25915ac4591df97676fde186f1edbcaf1e74" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.454089 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerID="d075a66075a632d2de68d442c1cc583ed5c59a569c329ed713b7cb4da2b7f525" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.454151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" event={"ID":"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee","Type":"ContainerDied","Data":"d075a66075a632d2de68d442c1cc583ed5c59a569c329ed713b7cb4da2b7f525"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.454177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" event={"ID":"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee","Type":"ContainerDied","Data":"81024220af94caaa1538f67b9d77afd781d15c25bbb12c5683ac54a7fcfbe3f3"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.454213 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81024220af94caaa1538f67b9d77afd781d15c25bbb12c5683ac54a7fcfbe3f3" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.456583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd","Type":"ContainerDied","Data":"43e33afe3cbea2be313a956d551724f59427a46d1ed3adb1139f1cf80c5e3d70"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.456632 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43e33afe3cbea2be313a956d551724f59427a46d1ed3adb1139f1cf80c5e3d70" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.459426 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerID="1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.459492 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"ed1d317a-289c-469d-98ae-789dd3230e4a","Type":"ContainerDied","Data":"1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.461452 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" event={"ID":"cc15cbd1-7c64-4f95-b7ed-2090167ce968","Type":"ContainerDied","Data":"13157ac206ba172098ca31948483bb64f87d7b1215b48a520ef50a7b884548e5"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.461491 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13157ac206ba172098ca31948483bb64f87d7b1215b48a520ef50a7b884548e5" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.464082 4769 generic.go:334] "Generic (PLEG): container finished" podID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerID="3fef85e8a624512666e3827fea3c0e9bc4b33c17eddbc5371403291aad3c527a" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.464132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f75bf156-e338-42b1-959d-83c46d7a4a6e","Type":"ContainerDied","Data":"3fef85e8a624512666e3827fea3c0e9bc4b33c17eddbc5371403291aad3c527a"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.464156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f75bf156-e338-42b1-959d-83c46d7a4a6e","Type":"ContainerDied","Data":"c45a4ef67cd9a55a8944bd94cf9c4b9103e70e0da358f617073a82b873d1fced"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.464167 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c45a4ef67cd9a55a8944bd94cf9c4b9103e70e0da358f617073a82b873d1fced" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.465876 4769 generic.go:334] "Generic (PLEG): container finished" podID="fdf41518-0738-4701-9482-fe17d9be8abf" containerID="173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.465941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fdf41518-0738-4701-9482-fe17d9be8abf","Type":"ContainerDied","Data":"173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.465991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"fdf41518-0738-4701-9482-fe17d9be8abf","Type":"ContainerDied","Data":"8af694a44537fe0413c7fdc8dc48466a968a076fbb4d86c3c6b0e69d9fe9184c"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.466008 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8af694a44537fe0413c7fdc8dc48466a968a076fbb4d86c3c6b0e69d9fe9184c" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.467923 4769 generic.go:334] "Generic (PLEG): container finished" podID="1d4eed1d-bce3-4f26-a240-956b705062da" containerID="7c8f41d0967c011e600c9453e4a9ab5232eb669f5feab3e40413582abdb49f5c" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.467982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d4eed1d-bce3-4f26-a240-956b705062da","Type":"ContainerDied","Data":"7c8f41d0967c011e600c9453e4a9ab5232eb669f5feab3e40413582abdb49f5c"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.468008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"1d4eed1d-bce3-4f26-a240-956b705062da","Type":"ContainerDied","Data":"96d41257c2a4674ace8d3c4838036c0c95e3fcd34c29a76c62ae68146f6e7923"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.468019 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96d41257c2a4674ace8d3c4838036c0c95e3fcd34c29a76c62ae68146f6e7923" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.471645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-cw69r" event={"ID":"90a092e1-717f-4c7a-9740-89b57b690e43","Type":"ContainerDied","Data":"773bfd2f31bb321c78c717f8bdede867315f73b6e37ec694bf5a1e022ccee6f4"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.471677 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="773bfd2f31bb321c78c717f8bdede867315f73b6e37ec694bf5a1e022ccee6f4" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.473517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"baec736c-d0fb-4b1a-9c7f-14e3a275807c","Type":"ContainerDied","Data":"33bfbb50221b5bb40b2ea41c8cfab1420ea326b45a99c2e17027cff91982de94"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.473582 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33bfbb50221b5bb40b2ea41c8cfab1420ea326b45a99c2e17027cff91982de94" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.476113 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" event={"ID":"2aa088d3-53a0-4016-87ac-59358c5b2d35","Type":"ContainerDied","Data":"902522ab3cb768e4093c49215431e8362c9d5f7ba2a50b64eff5bb5b7196d883"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.476147 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="902522ab3cb768e4093c49215431e8362c9d5f7ba2a50b64eff5bb5b7196d883" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.477960 4769 generic.go:334] "Generic (PLEG): container finished" podID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerID="042b1d0b935aa62be0f611d8c6dc9f0f79c51fdf863fdcaad51c73d08a3c2379" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.478010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" event={"ID":"083c8f14-c35e-4d60-91ef-9881dc7ad8c3","Type":"ContainerDied","Data":"042b1d0b935aa62be0f611d8c6dc9f0f79c51fdf863fdcaad51c73d08a3c2379"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.478027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" event={"ID":"083c8f14-c35e-4d60-91ef-9881dc7ad8c3","Type":"ContainerDied","Data":"0b02016ced1b4129118030c849609397c8603f15df746c2157bfa8d56b1b3ba6"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.478037 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b02016ced1b4129118030c849609397c8603f15df746c2157bfa8d56b1b3ba6" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.490087 4769 generic.go:334] "Generic (PLEG): container finished" podID="93f0d766-9895-4c18-9a55-b670336879a5" containerID="de581e699c555ad13a35e2d0fc1e302531144b8f66ce87c8d54ac8cb48bc8982" exitCode=0 Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.490127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93f0d766-9895-4c18-9a55-b670336879a5","Type":"ContainerDied","Data":"de581e699c555ad13a35e2d0fc1e302531144b8f66ce87c8d54ac8cb48bc8982"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.490152 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"93f0d766-9895-4c18-9a55-b670336879a5","Type":"ContainerDied","Data":"cf93466f6e17844dd11db7c47f444bf3b5ea4acf24d8bdea24a131f71d6ccd0a"} Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.490163 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf93466f6e17844dd11db7c47f444bf3b5ea4acf24d8bdea24a131f71d6ccd0a" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.572685 4769 scope.go:117] "RemoveContainer" containerID="81b8a741f8c82e2efe32db9b2fb6bd4b16c9bcc4e5d212b94284640d453687d2" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.573033 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.620824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gs7g\" (UniqueName: \"kubernetes.io/projected/baec736c-d0fb-4b1a-9c7f-14e3a275807c-kube-api-access-9gs7g\") pod \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.620914 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-config-data\") pod \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.621074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-vencrypt-tls-certs\") pod \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.621199 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-nova-novncproxy-tls-certs\") pod \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.621311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-combined-ca-bundle\") pod \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\" (UID: \"baec736c-d0fb-4b1a-9c7f-14e3a275807c\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.653870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baec736c-d0fb-4b1a-9c7f-14e3a275807c-kube-api-access-9gs7g" (OuterVolumeSpecName: "kube-api-access-9gs7g") pod "baec736c-d0fb-4b1a-9c7f-14e3a275807c" (UID: "baec736c-d0fb-4b1a-9c7f-14e3a275807c"). InnerVolumeSpecName "kube-api-access-9gs7g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.657231 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "baec736c-d0fb-4b1a-9c7f-14e3a275807c" (UID: "baec736c-d0fb-4b1a-9c7f-14e3a275807c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.666955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-config-data" (OuterVolumeSpecName: "config-data") pod "baec736c-d0fb-4b1a-9c7f-14e3a275807c" (UID: "baec736c-d0fb-4b1a-9c7f-14e3a275807c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.690758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "baec736c-d0fb-4b1a-9c7f-14e3a275807c" (UID: "baec736c-d0fb-4b1a-9c7f-14e3a275807c"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.691992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "baec736c-d0fb-4b1a-9c7f-14e3a275807c" (UID: "baec736c-d0fb-4b1a-9c7f-14e3a275807c"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.724530 4769 reconciler_common.go:293] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.724563 4769 reconciler_common.go:293] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.724609 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.724573 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.724749 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts podName:dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d nodeName:}" failed. No retries permitted until 2025-11-21 13:27:29.724705153 +0000 UTC m=+5808.425367001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts") pod "glancef3b9-account-delete-4b67q" (UID: "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.724788 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9gs7g\" (UniqueName: \"kubernetes.io/projected/baec736c-d0fb-4b1a-9c7f-14e3a275807c-kube-api-access-9gs7g\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.724808 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/baec736c-d0fb-4b1a-9c7f-14e3a275807c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.754701 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.819896 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-combined-ca-bundle\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-run-httpd\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-public-tls-certs\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-log-httpd\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829205 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-etc-swift\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829244 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwxfn\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-kube-api-access-hwxfn\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829333 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-combined-ca-bundle\") pod \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-config-data\") pod \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kc6q\" (UniqueName: \"kubernetes.io/projected/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-kube-api-access-6kc6q\") pod \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\" (UID: \"a7782b46-8d2b-49c2-ba34-423e6eb6e6cd\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829513 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-internal-tls-certs\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.829552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-config-data\") pod \"2aa088d3-53a0-4016-87ac-59358c5b2d35\" (UID: \"2aa088d3-53a0-4016-87ac-59358c5b2d35\") " Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.830077 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: E1121 13:27:27.830126 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts podName:b46b5eff-f711-418b-b9de-54a5a91821af nodeName:}" failed. No retries permitted until 2025-11-21 13:27:29.83011191 +0000 UTC m=+5808.530773728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts") pod "placement3637-account-delete-m2bjk" (UID: "b46b5eff-f711-418b-b9de-54a5a91821af") : configmap "openstack-scripts" not found Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.832148 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.832544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.857641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-kube-api-access-hwxfn" (OuterVolumeSpecName: "kube-api-access-hwxfn") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "kube-api-access-hwxfn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.862971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.884741 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-kube-api-access-6kc6q" (OuterVolumeSpecName: "kube-api-access-6kc6q") pod "a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" (UID: "a7782b46-8d2b-49c2-ba34-423e6eb6e6cd"). InnerVolumeSpecName "kube-api-access-6kc6q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.917804 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" (UID: "a7782b46-8d2b-49c2-ba34-423e6eb6e6cd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.931847 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.932083 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2aa088d3-53a0-4016-87ac-59358c5b2d35-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.932184 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.932301 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hwxfn\" (UniqueName: \"kubernetes.io/projected/2aa088d3-53a0-4016-87ac-59358c5b2d35-kube-api-access-hwxfn\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.932394 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.932482 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6kc6q\" (UniqueName: \"kubernetes.io/projected/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-kube-api-access-6kc6q\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.935326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-config-data" (OuterVolumeSpecName: "config-data") pod "a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" (UID: "a7782b46-8d2b-49c2-ba34-423e6eb6e6cd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.953233 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-config-data" (OuterVolumeSpecName: "config-data") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.960313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.964293 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:27 crc kubenswrapper[4769]: I1121 13:27:27.995358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2aa088d3-53a0-4016-87ac-59358c5b2d35" (UID: "2aa088d3-53a0-4016-87ac-59358c5b2d35"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.034405 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.034615 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.034626 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.034635 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2aa088d3-53a0-4016-87ac-59358c5b2d35-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.034644 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.034699 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.034742 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts podName:5d95dea2-4e74-42eb-b7a0-cf3093c486da nodeName:}" failed. No retries permitted until 2025-11-21 13:27:30.034728137 +0000 UTC m=+5808.735389955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts") pod "barbican8259-account-delete-r2c4s" (UID: "5d95dea2-4e74-42eb-b7a0-cf3093c486da") : configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.034993 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.035023 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts podName:0380fc82-b08b-4e96-a26d-d06c67417449 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:30.035016674 +0000 UTC m=+5808.735678482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts") pod "neutronbfc0-account-delete-bvhpq" (UID: "0380fc82-b08b-4e96-a26d-d06c67417449") : configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.035048 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.035067 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts podName:ac1d3aa2-0067-423a-ad55-820d9dde22f4 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:30.035062306 +0000 UTC m=+5808.735724124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts") pod "cinder8e53-account-delete-zvrnf" (UID: "ac1d3aa2-0067-423a-ad55-820d9dde22f4") : configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.057513 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.062124 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.070131 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.080144 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.094968 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.126476 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135469 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc15cbd1-7c64-4f95-b7ed-2090167ce968-logs\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-internal-tls-certs\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-logs\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-config-data\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-run-httpd\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135679 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-catalog-content\") pod \"90a092e1-717f-4c7a-9740-89b57b690e43\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-scripts\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135752 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-config-data\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-combined-ca-bundle\") pod \"00ca8158-c10b-4e37-b666-6610ba3113f2\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-combined-ca-bundle\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-ceilometer-tls-certs\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135893 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-combined-ca-bundle\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc4g9\" (UniqueName: \"kubernetes.io/projected/00ca8158-c10b-4e37-b666-6610ba3113f2-kube-api-access-wc4g9\") pod \"00ca8158-c10b-4e37-b666-6610ba3113f2\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-public-tls-certs\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.135987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-log-httpd\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136018 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data-custom\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/00ca8158-c10b-4e37-b666-6610ba3113f2-etc-machine-id\") pod \"00ca8158-c10b-4e37-b666-6610ba3113f2\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136085 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data-custom\") pod \"00ca8158-c10b-4e37-b666-6610ba3113f2\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136112 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data\") pod \"00ca8158-c10b-4e37-b666-6610ba3113f2\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxtj5\" (UniqueName: \"kubernetes.io/projected/cc15cbd1-7c64-4f95-b7ed-2090167ce968-kube-api-access-rxtj5\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136228 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f99n7\" (UniqueName: \"kubernetes.io/projected/90a092e1-717f-4c7a-9740-89b57b690e43-kube-api-access-f99n7\") pod \"90a092e1-717f-4c7a-9740-89b57b690e43\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136254 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-sg-core-conf-yaml\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136284 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-combined-ca-bundle\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136327 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-scripts\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136371 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxwtn\" (UniqueName: \"kubernetes.io/projected/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-kube-api-access-sxwtn\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136411 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-public-tls-certs\") pod \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\" (UID: \"6d949ccd-2ecb-4d79-b7a5-200c5aeaefee\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-internal-tls-certs\") pod \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\" (UID: \"cc15cbd1-7c64-4f95-b7ed-2090167ce968\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-scripts\") pod \"00ca8158-c10b-4e37-b666-6610ba3113f2\" (UID: \"00ca8158-c10b-4e37-b666-6610ba3113f2\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136498 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tqjv\" (UniqueName: \"kubernetes.io/projected/8389f7ff-450d-41b9-88eb-c7c2929deccc-kube-api-access-9tqjv\") pod \"8389f7ff-450d-41b9-88eb-c7c2929deccc\" (UID: \"8389f7ff-450d-41b9-88eb-c7c2929deccc\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.136521 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-utilities\") pod \"90a092e1-717f-4c7a-9740-89b57b690e43\" (UID: \"90a092e1-717f-4c7a-9740-89b57b690e43\") " Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.137224 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.137287 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts podName:a55ce728-ef0d-492c-9c68-31f2139f4734 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:30.137267826 +0000 UTC m=+5808.837929644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts") pod "novaapi10ec-account-delete-cktts" (UID: "a55ce728-ef0d-492c-9c68-31f2139f4734") : configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.138794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.139681 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.142261 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/00ca8158-c10b-4e37-b666-6610ba3113f2-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "00ca8158-c10b-4e37-b666-6610ba3113f2" (UID: "00ca8158-c10b-4e37-b666-6610ba3113f2"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.145531 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.145608 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts podName:ee855a9c-b038-4a02-bca3-32d7fc3f321f nodeName:}" failed. No retries permitted until 2025-11-21 13:27:30.14558578 +0000 UTC m=+5808.846247668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts") pod "novacell0726e-account-delete-tt4rj" (UID: "ee855a9c-b038-4a02-bca3-32d7fc3f321f") : configmap "openstack-scripts" not found Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.148273 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8389f7ff-450d-41b9-88eb-c7c2929deccc-kube-api-access-9tqjv" (OuterVolumeSpecName: "kube-api-access-9tqjv") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "kube-api-access-9tqjv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.149621 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-utilities" (OuterVolumeSpecName: "utilities") pod "90a092e1-717f-4c7a-9740-89b57b690e43" (UID: "90a092e1-717f-4c7a-9740-89b57b690e43"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.150146 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.150988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-kube-api-access-sxwtn" (OuterVolumeSpecName: "kube-api-access-sxwtn") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "kube-api-access-sxwtn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.153862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-logs" (OuterVolumeSpecName: "logs") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.155523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc15cbd1-7c64-4f95-b7ed-2090167ce968-logs" (OuterVolumeSpecName: "logs") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.155902 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ca8158-c10b-4e37-b666-6610ba3113f2-kube-api-access-wc4g9" (OuterVolumeSpecName: "kube-api-access-wc4g9") pod "00ca8158-c10b-4e37-b666-6610ba3113f2" (UID: "00ca8158-c10b-4e37-b666-6610ba3113f2"). InnerVolumeSpecName "kube-api-access-wc4g9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.157027 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.162334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.173019 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.174887 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.180458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.183929 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.194267 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-scripts" (OuterVolumeSpecName: "scripts") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.203415 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.207169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-scripts" (OuterVolumeSpecName: "scripts") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.208480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "00ca8158-c10b-4e37-b666-6610ba3113f2" (UID: "00ca8158-c10b-4e37-b666-6610ba3113f2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.208725 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a092e1-717f-4c7a-9740-89b57b690e43-kube-api-access-f99n7" (OuterVolumeSpecName: "kube-api-access-f99n7") pod "90a092e1-717f-4c7a-9740-89b57b690e43" (UID: "90a092e1-717f-4c7a-9740-89b57b690e43"). InnerVolumeSpecName "kube-api-access-f99n7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.209312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-scripts" (OuterVolumeSpecName: "scripts") pod "00ca8158-c10b-4e37-b666-6610ba3113f2" (UID: "00ca8158-c10b-4e37-b666-6610ba3113f2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.218751 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.227385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc15cbd1-7c64-4f95-b7ed-2090167ce968-kube-api-access-rxtj5" (OuterVolumeSpecName: "kube-api-access-rxtj5") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "kube-api-access-rxtj5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-scripts\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-public-tls-certs\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-galera-tls-certs\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-config-data\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238940 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx4tx\" (UniqueName: \"kubernetes.io/projected/fdf41518-0738-4701-9482-fe17d9be8abf-kube-api-access-rx4tx\") pod \"fdf41518-0738-4701-9482-fe17d9be8abf\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qfs5\" (UniqueName: \"kubernetes.io/projected/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-kube-api-access-2qfs5\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.238997 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-combined-ca-bundle\") pod \"ece80665-fef3-4d5e-a84e-e853f5725be7\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-logs\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-operator-scripts\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-logs\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-internal-tls-certs\") pod \"ece80665-fef3-4d5e-a84e-e853f5725be7\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9q5z\" (UniqueName: \"kubernetes.io/projected/93f0d766-9895-4c18-9a55-b670336879a5-kube-api-access-k9q5z\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwkcv\" (UniqueName: \"kubernetes.io/projected/ece80665-fef3-4d5e-a84e-e853f5725be7-kube-api-access-lwkcv\") pod \"ece80665-fef3-4d5e-a84e-e853f5725be7\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-public-tls-certs\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-httpd-run\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239285 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-nova-metadata-tls-certs\") pod \"1d4eed1d-bce3-4f26-a240-956b705062da\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239303 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-default\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-fernet-keys\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239358 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-scripts\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239405 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-internal-tls-certs\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239444 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn8jl\" (UniqueName: \"kubernetes.io/projected/f75bf156-e338-42b1-959d-83c46d7a4a6e-kube-api-access-kn8jl\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-config-data\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-logs\") pod \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239544 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-etc-machine-id\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239596 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-internal-tls-certs\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239617 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-public-tls-certs\") pod \"ece80665-fef3-4d5e-a84e-e853f5725be7\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239642 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-credential-keys\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-config-data\") pod \"ece80665-fef3-4d5e-a84e-e853f5725be7\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-combined-ca-bundle\") pod \"fdf41518-0738-4701-9482-fe17d9be8abf\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-logs\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-combined-ca-bundle\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239775 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-combined-ca-bundle\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239798 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g4sr\" (UniqueName: \"kubernetes.io/projected/1d4eed1d-bce3-4f26-a240-956b705062da-kube-api-access-2g4sr\") pod \"1d4eed1d-bce3-4f26-a240-956b705062da\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239832 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-combined-ca-bundle\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-scripts\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239882 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-scripts\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-combined-ca-bundle\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.239926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d4eed1d-bce3-4f26-a240-956b705062da-logs\") pod \"1d4eed1d-bce3-4f26-a240-956b705062da\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-generated\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240048 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-config-data\") pod \"fdf41518-0738-4701-9482-fe17d9be8abf\" (UID: \"fdf41518-0738-4701-9482-fe17d9be8abf\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-kolla-config\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-combined-ca-bundle\") pod \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data-custom\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240250 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data-custom\") pod \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ece80665-fef3-4d5e-a84e-e853f5725be7-logs\") pod \"ece80665-fef3-4d5e-a84e-e853f5725be7\" (UID: \"ece80665-fef3-4d5e-a84e-e853f5725be7\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240305 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-logs" (OuterVolumeSpecName: "logs") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240320 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj2z2\" (UniqueName: \"kubernetes.io/projected/ed1d317a-289c-469d-98ae-789dd3230e4a-kube-api-access-pj2z2\") pod \"ed1d317a-289c-469d-98ae-789dd3230e4a\" (UID: \"ed1d317a-289c-469d-98ae-789dd3230e4a\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96422\" (UniqueName: \"kubernetes.io/projected/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-kube-api-access-96422\") pod \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240448 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-internal-tls-certs\") pod \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\" (UID: \"7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240474 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-config-data\") pod \"1d4eed1d-bce3-4f26-a240-956b705062da\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data\") pod \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\" (UID: \"083c8f14-c35e-4d60-91ef-9881dc7ad8c3\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-public-tls-certs\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240625 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv8wg\" (UniqueName: \"kubernetes.io/projected/6c0d96de-e234-4e3c-9db1-882b35918e73-kube-api-access-zv8wg\") pod \"6c0d96de-e234-4e3c-9db1-882b35918e73\" (UID: \"6c0d96de-e234-4e3c-9db1-882b35918e73\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-httpd-run\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240682 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-config-data\") pod \"93f0d766-9895-4c18-9a55-b670336879a5\" (UID: \"93f0d766-9895-4c18-9a55-b670336879a5\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-combined-ca-bundle\") pod \"f75bf156-e338-42b1-959d-83c46d7a4a6e\" (UID: \"f75bf156-e338-42b1-959d-83c46d7a4a6e\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.240745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-combined-ca-bundle\") pod \"1d4eed1d-bce3-4f26-a240-956b705062da\" (UID: \"1d4eed1d-bce3-4f26-a240-956b705062da\") " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.241578 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.241605 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wc4g9\" (UniqueName: \"kubernetes.io/projected/00ca8158-c10b-4e37-b666-6610ba3113f2-kube-api-access-wc4g9\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.241618 4769 reconciler_common.go:293] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-log-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.241631 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.241642 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/00ca8158-c10b-4e37-b666-6610ba3113f2-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.241654 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.243645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.242071 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rxtj5\" (UniqueName: \"kubernetes.io/projected/cc15cbd1-7c64-4f95-b7ed-2090167ce968-kube-api-access-rxtj5\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244443 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f99n7\" (UniqueName: \"kubernetes.io/projected/90a092e1-717f-4c7a-9740-89b57b690e43-kube-api-access-f99n7\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244460 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244536 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sxwtn\" (UniqueName: \"kubernetes.io/projected/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-kube-api-access-sxwtn\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244548 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244559 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9tqjv\" (UniqueName: \"kubernetes.io/projected/8389f7ff-450d-41b9-88eb-c7c2929deccc-kube-api-access-9tqjv\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244573 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244604 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc15cbd1-7c64-4f95-b7ed-2090167ce968-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244615 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244626 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.244639 4769 reconciler_common.go:293] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8389f7ff-450d-41b9-88eb-c7c2929deccc-run-httpd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.244731 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.245179 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data podName:f76c87ba-5d40-4b61-a44a-7b8c895507d8 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:36.244843931 +0000 UTC m=+5814.945505819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data") pod "rabbitmq-cell1-server-0" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8") : configmap "rabbitmq-cell1-config-data" not found Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.248116 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.250372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-logs" (OuterVolumeSpecName: "logs") pod "083c8f14-c35e-4d60-91ef-9881dc7ad8c3" (UID: "083c8f14-c35e-4d60-91ef-9881dc7ad8c3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.250493 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-logs" (OuterVolumeSpecName: "logs") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.251978 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ece80665-fef3-4d5e-a84e-e853f5725be7-logs" (OuterVolumeSpecName: "logs") pod "ece80665-fef3-4d5e-a84e-e853f5725be7" (UID: "ece80665-fef3-4d5e-a84e-e853f5725be7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.251988 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.256966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.257056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.259813 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4eed1d-bce3-4f26-a240-956b705062da-logs" (OuterVolumeSpecName: "logs") pod "1d4eed1d-bce3-4f26-a240-956b705062da" (UID: "1d4eed1d-bce3-4f26-a240-956b705062da"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.260997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.261323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-logs" (OuterVolumeSpecName: "logs") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.270136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-kube-api-access-96422" (OuterVolumeSpecName: "kube-api-access-96422") pod "083c8f14-c35e-4d60-91ef-9881dc7ad8c3" (UID: "083c8f14-c35e-4d60-91ef-9881dc7ad8c3"). InnerVolumeSpecName "kube-api-access-96422". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.274595 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ece80665-fef3-4d5e-a84e-e853f5725be7-kube-api-access-lwkcv" (OuterVolumeSpecName: "kube-api-access-lwkcv") pod "ece80665-fef3-4d5e-a84e-e853f5725be7" (UID: "ece80665-fef3-4d5e-a84e-e853f5725be7"). InnerVolumeSpecName "kube-api-access-lwkcv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.278589 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "083c8f14-c35e-4d60-91ef-9881dc7ad8c3" (UID: "083c8f14-c35e-4d60-91ef-9881dc7ad8c3"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.279377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "90a092e1-717f-4c7a-9740-89b57b690e43" (UID: "90a092e1-717f-4c7a-9740-89b57b690e43"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.279406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf41518-0738-4701-9482-fe17d9be8abf-kube-api-access-rx4tx" (OuterVolumeSpecName: "kube-api-access-rx4tx") pod "fdf41518-0738-4701-9482-fe17d9be8abf" (UID: "fdf41518-0738-4701-9482-fe17d9be8abf"). InnerVolumeSpecName "kube-api-access-rx4tx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.281660 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "glance") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.286072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "glance") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.308841 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4eed1d-bce3-4f26-a240-956b705062da-kube-api-access-2g4sr" (OuterVolumeSpecName: "kube-api-access-2g4sr") pod "1d4eed1d-bce3-4f26-a240-956b705062da" (UID: "1d4eed1d-bce3-4f26-a240-956b705062da"). InnerVolumeSpecName "kube-api-access-2g4sr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.310727 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f0d766-9895-4c18-9a55-b670336879a5-kube-api-access-k9q5z" (OuterVolumeSpecName: "kube-api-access-k9q5z") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "kube-api-access-k9q5z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.310814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-kube-api-access-2qfs5" (OuterVolumeSpecName: "kube-api-access-2qfs5") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "kube-api-access-2qfs5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.310937 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1d317a-289c-469d-98ae-789dd3230e4a-kube-api-access-pj2z2" (OuterVolumeSpecName: "kube-api-access-pj2z2") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "kube-api-access-pj2z2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.311456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-scripts" (OuterVolumeSpecName: "scripts") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.311581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.311668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-scripts" (OuterVolumeSpecName: "scripts") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.320137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f75bf156-e338-42b1-959d-83c46d7a4a6e-kube-api-access-kn8jl" (OuterVolumeSpecName: "kube-api-access-kn8jl") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "kube-api-access-kn8jl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.330326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-scripts" (OuterVolumeSpecName: "scripts") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.331470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0d96de-e234-4e3c-9db1-882b35918e73-kube-api-access-zv8wg" (OuterVolumeSpecName: "kube-api-access-zv8wg") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "kube-api-access-zv8wg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.335504 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.335531 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.340333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-scripts" (OuterVolumeSpecName: "scripts") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347536 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-96422\" (UniqueName: \"kubernetes.io/projected/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-kube-api-access-96422\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347566 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pj2z2\" (UniqueName: \"kubernetes.io/projected/ed1d317a-289c-469d-98ae-789dd3230e4a-kube-api-access-pj2z2\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347576 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zv8wg\" (UniqueName: \"kubernetes.io/projected/6c0d96de-e234-4e3c-9db1-882b35918e73-kube-api-access-zv8wg\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347585 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347594 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347607 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rx4tx\" (UniqueName: \"kubernetes.io/projected/fdf41518-0738-4701-9482-fe17d9be8abf-kube-api-access-rx4tx\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347617 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2qfs5\" (UniqueName: \"kubernetes.io/projected/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-kube-api-access-2qfs5\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347628 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347636 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347645 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lwkcv\" (UniqueName: \"kubernetes.io/projected/ece80665-fef3-4d5e-a84e-e853f5725be7-kube-api-access-lwkcv\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347654 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/90a092e1-717f-4c7a-9740-89b57b690e43-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347663 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k9q5z\" (UniqueName: \"kubernetes.io/projected/93f0d766-9895-4c18-9a55-b670336879a5-kube-api-access-k9q5z\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347671 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93f0d766-9895-4c18-9a55-b670336879a5-httpd-run\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347681 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347690 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347698 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347707 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kn8jl\" (UniqueName: \"kubernetes.io/projected/f75bf156-e338-42b1-959d-83c46d7a4a6e-kube-api-access-kn8jl\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347717 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347736 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347746 4769 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347755 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347763 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f75bf156-e338-42b1-959d-83c46d7a4a6e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347772 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2g4sr\" (UniqueName: \"kubernetes.io/projected/1d4eed1d-bce3-4f26-a240-956b705062da-kube-api-access-2g4sr\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347782 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347791 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347799 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1d4eed1d-bce3-4f26-a240-956b705062da-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347808 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ed1d317a-289c-469d-98ae-789dd3230e4a-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347823 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347832 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ed1d317a-289c-469d-98ae-789dd3230e4a-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347842 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347851 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.347860 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ece80665-fef3-4d5e-a84e-e853f5725be7-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.419944 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.454030 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.505503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" event={"ID":"ee855a9c-b038-4a02-bca3-32d7fc3f321f","Type":"ContainerStarted","Data":"d0f8f64c6678a8ec1fbbd8f88594cc84cd97edee251ef045e8a09a9a9e423e9d"} Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.505543 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" containerID="cri-o://d0f8f64c6678a8ec1fbbd8f88594cc84cd97edee251ef045e8a09a9a9e423e9d" gracePeriod=30 Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.514988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ece80665-fef3-4d5e-a84e-e853f5725be7","Type":"ContainerDied","Data":"03af8994aadecc1a927227600ad9b29ff06153bd5c7107caea2ed37ec0dea295"} Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.515054 4769 scope.go:117] "RemoveContainer" containerID="9d69ab3f61c7fed3934f0597dc69b74c925dadc71f7e99117e34fe6b975dab16" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.515185 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.523123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.523129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"ed1d317a-289c-469d-98ae-789dd3230e4a","Type":"ContainerDied","Data":"5cecface125ba1a29ce2d9c798ba8e2e5af6e0756846903aff523c971e91ed4a"} Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.532727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" event={"ID":"0380fc82-b08b-4e96-a26d-d06c67417449","Type":"ContainerStarted","Data":"06d9cd7c1bb46d263a945ed4fd0d3ba41c433b6b3c5f4e4cfd6c517126475b42"} Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.532905 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" containerID="cri-o://06d9cd7c1bb46d263a945ed4fd0d3ba41c433b6b3c5f4e4cfd6c517126475b42" gracePeriod=30 Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.536411 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" podStartSLOduration=7.536369757 podStartE2EDuration="7.536369757s" podCreationTimestamp="2025-11-21 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:27:28.524050025 +0000 UTC m=+5807.224711843" watchObservedRunningTime="2025-11-21 13:27:28.536369757 +0000 UTC m=+5807.237031595" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.538634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" event={"ID":"b46b5eff-f711-418b-b9de-54a5a91821af","Type":"ContainerStarted","Data":"7b0def21090337055b41a1f840dc3e26d99648661a05d3782ad3426a4088a728"} Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.538773 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" containerID="cri-o://7b0def21090337055b41a1f840dc3e26d99648661a05d3782ad3426a4088a728" gracePeriod=30 Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.546401 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.546851 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" containerID="cri-o://bd503f3ff5ccb5cabc4c7a75a9a9cc41a0f5c86e1a37b89538ee79fb6c2ba2af" gracePeriod=30 Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.547092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" event={"ID":"ac1d3aa2-0067-423a-ad55-820d9dde22f4","Type":"ContainerStarted","Data":"bd503f3ff5ccb5cabc4c7a75a9a9cc41a0f5c86e1a37b89538ee79fb6c2ba2af"} Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.547148 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.547408 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68d8656558-w62fh" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.547597 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.549689 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.550267 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.550933 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.550976 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.550983 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.551009 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.551015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.551004 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.551037 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-cw69r" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.551041 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.551060 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6989955c5d-x4d64" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.566911 4769 scope.go:117] "RemoveContainer" containerID="acd63c2764ed3cc516620b6e3f07fdaff888a485389174ec59e7caed4a8ac47d" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.569780 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" podStartSLOduration=8.569735155 podStartE2EDuration="8.569735155s" podCreationTimestamp="2025-11-21 13:27:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:27:28.559219732 +0000 UTC m=+5807.259881550" watchObservedRunningTime="2025-11-21 13:27:28.569735155 +0000 UTC m=+5807.270396973" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.612318 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" podStartSLOduration=8.61229746 podStartE2EDuration="8.61229746s" podCreationTimestamp="2025-11-21 13:27:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:27:28.610151692 +0000 UTC m=+5807.310813530" watchObservedRunningTime="2025-11-21 13:27:28.61229746 +0000 UTC m=+5807.312959278" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.658869 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" podStartSLOduration=8.658844983 podStartE2EDuration="8.658844983s" podCreationTimestamp="2025-11-21 13:27:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:27:28.655077041 +0000 UTC m=+5807.355738869" watchObservedRunningTime="2025-11-21 13:27:28.658844983 +0000 UTC m=+5807.359506801" Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.738474 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.742153 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.744664 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Nov 21 13:27:28 crc kubenswrapper[4769]: E1121 13:27:28.744721 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerName="nova-cell0-conductor-conductor" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.793866 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.835795 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.864472 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.867314 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.867337 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.867349 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.930685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.936836 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-config-data" (OuterVolumeSpecName: "config-data") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.945309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.971969 4769 reconciler_common.go:293] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.972143 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.972226 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:28 crc kubenswrapper[4769]: I1121 13:27:28.987941 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.019239 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.057009 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.075131 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.078516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ece80665-fef3-4d5e-a84e-e853f5725be7" (UID: "ece80665-fef3-4d5e-a84e-e853f5725be7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.085139 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.085825 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.099808 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-config-data" (OuterVolumeSpecName: "config-data") pod "fdf41518-0738-4701-9482-fe17d9be8abf" (UID: "fdf41518-0738-4701-9482-fe17d9be8abf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.145145 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.189648 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.189686 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.189698 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.214853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fdf41518-0738-4701-9482-fe17d9be8abf" (UID: "fdf41518-0738-4701-9482-fe17d9be8abf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.250497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.292465 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.292491 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fdf41518-0738-4701-9482-fe17d9be8abf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.308989 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.318206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-config-data" (OuterVolumeSpecName: "config-data") pod "ece80665-fef3-4d5e-a84e-e853f5725be7" (UID: "ece80665-fef3-4d5e-a84e-e853f5725be7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.357956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.360506 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.361646 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.363851 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.363941 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="ovn-northd" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.377847 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-config-data" (OuterVolumeSpecName: "config-data") pod "1d4eed1d-bce3-4f26-a240-956b705062da" (UID: "1d4eed1d-bce3-4f26-a240-956b705062da"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.383106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.386949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.395277 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.395381 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.395441 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.395674 4769 reconciler_common.go:293] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.395741 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.395800 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.448207 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "ed1d317a-289c-469d-98ae-789dd3230e4a" (UID: "ed1d317a-289c-469d-98ae-789dd3230e4a"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.453769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ece80665-fef3-4d5e-a84e-e853f5725be7" (UID: "ece80665-fef3-4d5e-a84e-e853f5725be7"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.462936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1d4eed1d-bce3-4f26-a240-956b705062da" (UID: "1d4eed1d-bce3-4f26-a240-956b705062da"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.497753 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data" (OuterVolumeSpecName: "config-data") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.498144 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.498165 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed1d317a-289c-469d-98ae-789dd3230e4a-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.498174 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.498209 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.498299 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "083c8f14-c35e-4d60-91ef-9881dc7ad8c3" (UID: "083c8f14-c35e-4d60-91ef-9881dc7ad8c3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.501842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data" (OuterVolumeSpecName: "config-data") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.513282 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.513843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.530363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" (UID: "6d949ccd-2ecb-4d79-b7a5-200c5aeaefee"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.530394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.536337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "1d4eed1d-bce3-4f26-a240-956b705062da" (UID: "1d4eed1d-bce3-4f26-a240-956b705062da"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.536367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ece80665-fef3-4d5e-a84e-e853f5725be7" (UID: "ece80665-fef3-4d5e-a84e-e853f5725be7"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.544537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" (UID: "7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.567778 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.569823 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerID="d0f8f64c6678a8ec1fbbd8f88594cc84cd97edee251ef045e8a09a9a9e423e9d" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.572559 4769 generic.go:334] "Generic (PLEG): container finished" podID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerID="bd56958d10b48bffa465fb6c4509d088147aac5ac8a7742a182dda72a2c4a1aa" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.575881 4769 generic.go:334] "Generic (PLEG): container finished" podID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerID="c50e5c1d420c19b8c655bf0da67a5c416de58f2e833e07ba32f8de3591e64434" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.584131 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerID="bd503f3ff5ccb5cabc4c7a75a9a9cc41a0f5c86e1a37b89538ee79fb6c2ba2af" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599519 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ece80665-fef3-4d5e-a84e-e853f5725be7-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599551 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4eed1d-bce3-4f26-a240-956b705062da-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599561 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599572 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599580 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599589 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599597 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599606 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599616 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.599624 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.601960 4769 generic.go:334] "Generic (PLEG): container finished" podID="0380fc82-b08b-4e96-a26d-d06c67417449" containerID="06d9cd7c1bb46d263a945ed4fd0d3ba41c433b6b3c5f4e4cfd6c517126475b42" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.602820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.604323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-config-data" (OuterVolumeSpecName: "config-data") pod "f75bf156-e338-42b1-959d-83c46d7a4a6e" (UID: "f75bf156-e338-42b1-959d-83c46d7a4a6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.608249 4769 generic.go:334] "Generic (PLEG): container finished" podID="b46b5eff-f711-418b-b9de-54a5a91821af" containerID="7b0def21090337055b41a1f840dc3e26d99648661a05d3782ad3426a4088a728" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.616008 4769 generic.go:334] "Generic (PLEG): container finished" podID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerID="8b921dada6827bd512fcb738282355b80189744df2307273266e1af72074eab9" exitCode=1 Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.621228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data" (OuterVolumeSpecName: "config-data") pod "083c8f14-c35e-4d60-91ef-9881dc7ad8c3" (UID: "083c8f14-c35e-4d60-91ef-9881dc7ad8c3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.635110 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" podStartSLOduration=8.623292548 podStartE2EDuration="8.623292548s" podCreationTimestamp="2025-11-21 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:27:29.611663155 +0000 UTC m=+5808.312324973" watchObservedRunningTime="2025-11-21 13:27:29.623292548 +0000 UTC m=+5808.323954366" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.637373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data" (OuterVolumeSpecName: "config-data") pod "00ca8158-c10b-4e37-b666-6610ba3113f2" (UID: "00ca8158-c10b-4e37-b666-6610ba3113f2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.676779 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.680383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "00ca8158-c10b-4e37-b666-6610ba3113f2" (UID: "00ca8158-c10b-4e37-b666-6610ba3113f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.692291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-config-data" (OuterVolumeSpecName: "config-data") pod "cc15cbd1-7c64-4f95-b7ed-2090167ce968" (UID: "cc15cbd1-7c64-4f95-b7ed-2090167ce968"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701478 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701514 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/083c8f14-c35e-4d60-91ef-9881dc7ad8c3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701524 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f75bf156-e338-42b1-959d-83c46d7a4a6e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701534 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701543 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701551 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc15cbd1-7c64-4f95-b7ed-2090167ce968-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.701559 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/00ca8158-c10b-4e37-b666-6610ba3113f2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.701491 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.701620 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data podName:b51a88b8-9feb-448a-89c2-93800a854081 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:37.701603226 +0000 UTC m=+5816.402265044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data") pod "rabbitmq-server-0" (UID: "b51a88b8-9feb-448a-89c2-93800a854081") : configmap "rabbitmq-config-data" not found Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.707419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-config-data" (OuterVolumeSpecName: "config-data") pod "8389f7ff-450d-41b9-88eb-c7c2929deccc" (UID: "8389f7ff-450d-41b9-88eb-c7c2929deccc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.719118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6c0d96de-e234-4e3c-9db1-882b35918e73" (UID: "6c0d96de-e234-4e3c-9db1-882b35918e73"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.721181 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-config-data" (OuterVolumeSpecName: "config-data") pod "93f0d766-9895-4c18-9a55-b670336879a5" (UID: "93f0d766-9895-4c18-9a55-b670336879a5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.802918 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93f0d766-9895-4c18-9a55-b670336879a5-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.802992 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c0d96de-e234-4e3c-9db1-882b35918e73-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: I1121 13:27:29.803004 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8389f7ff-450d-41b9-88eb-c7c2929deccc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.803117 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.803174 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts podName:dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d nodeName:}" failed. No retries permitted until 2025-11-21 13:27:33.803157259 +0000 UTC m=+5812.503819077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts") pod "glancef3b9-account-delete-4b67q" (UID: "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d") : configmap "openstack-scripts" not found Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.906717 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:29 crc kubenswrapper[4769]: E1121 13:27:29.907085 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts podName:b46b5eff-f711-418b-b9de-54a5a91821af nodeName:}" failed. No retries permitted until 2025-11-21 13:27:33.907066785 +0000 UTC m=+5812.607728603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts") pod "placement3637-account-delete-m2bjk" (UID: "b46b5eff-f711-418b-b9de-54a5a91821af") : configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.109289 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.109369 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts podName:5d95dea2-4e74-42eb-b7a0-cf3093c486da nodeName:}" failed. No retries permitted until 2025-11-21 13:27:34.109350599 +0000 UTC m=+5812.810012417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts") pod "barbican8259-account-delete-r2c4s" (UID: "5d95dea2-4e74-42eb-b7a0-cf3093c486da") : configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.109414 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.109465 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts podName:0380fc82-b08b-4e96-a26d-d06c67417449 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:34.109452852 +0000 UTC m=+5812.810114670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts") pod "neutronbfc0-account-delete-bvhpq" (UID: "0380fc82-b08b-4e96-a26d-d06c67417449") : configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.109415 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.109499 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts podName:ac1d3aa2-0067-423a-ad55-820d9dde22f4 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:34.109491783 +0000 UTC m=+5812.810153601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts") pod "cinder8e53-account-delete-zvrnf" (UID: "ac1d3aa2-0067-423a-ad55-820d9dde22f4") : configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.194246 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.175:5671: connect: connection refused" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.229444 4769 scope.go:117] "RemoveContainer" containerID="1e2cee2857f36adcd8b77c929ea7610b7502812a0a5f3a555e2ae92f67d6d84e" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" event={"ID":"ee855a9c-b038-4a02-bca3-32d7fc3f321f","Type":"ContainerDied","Data":"d0f8f64c6678a8ec1fbbd8f88594cc84cd97edee251ef045e8a09a9a9e423e9d"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230526 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230538 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" event={"ID":"ee855a9c-b038-4a02-bca3-32d7fc3f321f","Type":"ContainerDied","Data":"df0dd1e7c28d7199d76acc3ff27cb63626b456dd40b49f62856652c2daa7698e"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230547 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df0dd1e7c28d7199d76acc3ff27cb63626b456dd40b49f62856652c2daa7698e" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" event={"ID":"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d","Type":"ContainerDied","Data":"bd56958d10b48bffa465fb6c4509d088147aac5ac8a7742a182dda72a2c4a1aa"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" event={"ID":"5d95dea2-4e74-42eb-b7a0-cf3093c486da","Type":"ContainerDied","Data":"c50e5c1d420c19b8c655bf0da67a5c416de58f2e833e07ba32f8de3591e64434"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" event={"ID":"b5ae4ec3-5987-4a40-a7af-5f243c1eef60","Type":"ContainerStarted","Data":"bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" event={"ID":"ac1d3aa2-0067-423a-ad55-820d9dde22f4","Type":"ContainerDied","Data":"bd503f3ff5ccb5cabc4c7a75a9a9cc41a0f5c86e1a37b89538ee79fb6c2ba2af"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" event={"ID":"ac1d3aa2-0067-423a-ad55-820d9dde22f4","Type":"ContainerDied","Data":"a910ba1812a14680d65ff12d2f18092f82e78c242ba142b7bc657e64340bf9bf"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230625 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a910ba1812a14680d65ff12d2f18092f82e78c242ba142b7bc657e64340bf9bf" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230634 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" event={"ID":"0380fc82-b08b-4e96-a26d-d06c67417449","Type":"ContainerDied","Data":"06d9cd7c1bb46d263a945ed4fd0d3ba41c433b6b3c5f4e4cfd6c517126475b42"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230644 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" event={"ID":"0380fc82-b08b-4e96-a26d-d06c67417449","Type":"ContainerDied","Data":"9a1e9d9a0c638d5eea368727c9ef553e247acce103fbe21888f23c5dd7751591"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230653 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a1e9d9a0c638d5eea368727c9ef553e247acce103fbe21888f23c5dd7751591" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" event={"ID":"b46b5eff-f711-418b-b9de-54a5a91821af","Type":"ContainerDied","Data":"7b0def21090337055b41a1f840dc3e26d99648661a05d3782ad3426a4088a728"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.230673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" event={"ID":"a55ce728-ef0d-492c-9c68-31f2139f4734","Type":"ContainerDied","Data":"8b921dada6827bd512fcb738282355b80189744df2307273266e1af72074eab9"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.234668 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.234805 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.234856 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts podName:ee855a9c-b038-4a02-bca3-32d7fc3f321f nodeName:}" failed. No retries permitted until 2025-11-21 13:27:34.234840976 +0000 UTC m=+5812.935502794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts") pod "novacell0726e-account-delete-tt4rj" (UID: "ee855a9c-b038-4a02-bca3-32d7fc3f321f") : configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.234902 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.234994 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts podName:a55ce728-ef0d-492c-9c68-31f2139f4734 nodeName:}" failed. No retries permitted until 2025-11-21 13:27:34.23497004 +0000 UTC m=+5812.935631948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts") pod "novaapi10ec-account-delete-cktts" (UID: "a55ce728-ef0d-492c-9c68-31f2139f4734") : configmap "openstack-scripts" not found Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.236464 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.242040 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.318636 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.328322 4769 scope.go:117] "RemoveContainer" containerID="35780fbd002f6471a055378cb579e4acd2cd09045a9d6681b7d277bd001c293b" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.333908 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.336272 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts\") pod \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.336352 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsltx\" (UniqueName: \"kubernetes.io/projected/ac1d3aa2-0067-423a-ad55-820d9dde22f4-kube-api-access-fsltx\") pod \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\" (UID: \"ac1d3aa2-0067-423a-ad55-820d9dde22f4\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.337358 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ac1d3aa2-0067-423a-ad55-820d9dde22f4" (UID: "ac1d3aa2-0067-423a-ad55-820d9dde22f4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.338037 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac1d3aa2-0067-423a-ad55-820d9dde22f4-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.341079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1d3aa2-0067-423a-ad55-820d9dde22f4-kube-api-access-fsltx" (OuterVolumeSpecName: "kube-api-access-fsltx") pod "ac1d3aa2-0067-423a-ad55-820d9dde22f4" (UID: "ac1d3aa2-0067-423a-ad55-820d9dde22f4"). InnerVolumeSpecName "kube-api-access-fsltx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.358659 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.362530 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.370575 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.383013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.405229 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.419038 4769 scope.go:117] "RemoveContainer" containerID="5bfe147eba2c65afc48c2e107851d247ccff63b815c4bb7f56759cc5841700fb" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.424658 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.436137 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts\") pod \"a55ce728-ef0d-492c-9c68-31f2139f4734\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439655 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmwvd\" (UniqueName: \"kubernetes.io/projected/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-kube-api-access-mmwvd\") pod \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts\") pod \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\" (UID: \"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zssqq\" (UniqueName: \"kubernetes.io/projected/a55ce728-ef0d-492c-9c68-31f2139f4734-kube-api-access-zssqq\") pod \"a55ce728-ef0d-492c-9c68-31f2139f4734\" (UID: \"a55ce728-ef0d-492c-9c68-31f2139f4734\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89r75\" (UniqueName: \"kubernetes.io/projected/0380fc82-b08b-4e96-a26d-d06c67417449-kube-api-access-89r75\") pod \"0380fc82-b08b-4e96-a26d-d06c67417449\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439958 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts\") pod \"b46b5eff-f711-418b-b9de-54a5a91821af\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.439987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts\") pod \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.440030 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts\") pod \"0380fc82-b08b-4e96-a26d-d06c67417449\" (UID: \"0380fc82-b08b-4e96-a26d-d06c67417449\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.440055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf78d\" (UniqueName: \"kubernetes.io/projected/ee855a9c-b038-4a02-bca3-32d7fc3f321f-kube-api-access-sf78d\") pod \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\" (UID: \"ee855a9c-b038-4a02-bca3-32d7fc3f321f\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.440088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g7k7\" (UniqueName: \"kubernetes.io/projected/b46b5eff-f711-418b-b9de-54a5a91821af-kube-api-access-8g7k7\") pod \"b46b5eff-f711-418b-b9de-54a5a91821af\" (UID: \"b46b5eff-f711-418b-b9de-54a5a91821af\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.440671 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fsltx\" (UniqueName: \"kubernetes.io/projected/ac1d3aa2-0067-423a-ad55-820d9dde22f4-kube-api-access-fsltx\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.441650 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" (UID: "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.441758 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee855a9c-b038-4a02-bca3-32d7fc3f321f" (UID: "ee855a9c-b038-4a02-bca3-32d7fc3f321f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.442048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a55ce728-ef0d-492c-9c68-31f2139f4734" (UID: "a55ce728-ef0d-492c-9c68-31f2139f4734"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.442397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b46b5eff-f711-418b-b9de-54a5a91821af" (UID: "b46b5eff-f711-418b-b9de-54a5a91821af"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.444014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0380fc82-b08b-4e96-a26d-d06c67417449" (UID: "0380fc82-b08b-4e96-a26d-d06c67417449"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.447215 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0380fc82-b08b-4e96-a26d-d06c67417449-kube-api-access-89r75" (OuterVolumeSpecName: "kube-api-access-89r75") pod "0380fc82-b08b-4e96-a26d-d06c67417449" (UID: "0380fc82-b08b-4e96-a26d-d06c67417449"). InnerVolumeSpecName "kube-api-access-89r75". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.447254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46b5eff-f711-418b-b9de-54a5a91821af-kube-api-access-8g7k7" (OuterVolumeSpecName: "kube-api-access-8g7k7") pod "b46b5eff-f711-418b-b9de-54a5a91821af" (UID: "b46b5eff-f711-418b-b9de-54a5a91821af"). InnerVolumeSpecName "kube-api-access-8g7k7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.455668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee855a9c-b038-4a02-bca3-32d7fc3f321f-kube-api-access-sf78d" (OuterVolumeSpecName: "kube-api-access-sf78d") pod "ee855a9c-b038-4a02-bca3-32d7fc3f321f" (UID: "ee855a9c-b038-4a02-bca3-32d7fc3f321f"). InnerVolumeSpecName "kube-api-access-sf78d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.472080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-kube-api-access-mmwvd" (OuterVolumeSpecName: "kube-api-access-mmwvd") pod "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" (UID: "dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d"). InnerVolumeSpecName "kube-api-access-mmwvd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.480436 4769 scope.go:117] "RemoveContainer" containerID="7b39d818ba5d4f34c390d02af9f96c36bbeffebe7dc55c52009a58149db36791" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.484143 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.488688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a55ce728-ef0d-492c-9c68-31f2139f4734-kube-api-access-zssqq" (OuterVolumeSpecName: "kube-api-access-zssqq") pod "a55ce728-ef0d-492c-9c68-31f2139f4734" (UID: "a55ce728-ef0d-492c-9c68-31f2139f4734"). InnerVolumeSpecName "kube-api-access-zssqq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.505235 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-cw69r"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.511182 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-cw69r"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.519025 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.526770 4769 scope.go:117] "RemoveContainer" containerID="da35b0f4ffb1f1ef38cbec717c5fb6e0e7e25e9d6f1d56e125ec21b01cddc2f7" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.526897 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.543650 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544312 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p9w2\" (UniqueName: \"kubernetes.io/projected/5d95dea2-4e74-42eb-b7a0-cf3093c486da-kube-api-access-7p9w2\") pod \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts\") pod \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\" (UID: \"5d95dea2-4e74-42eb-b7a0-cf3093c486da\") " Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544778 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a55ce728-ef0d-492c-9c68-31f2139f4734-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544792 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mmwvd\" (UniqueName: \"kubernetes.io/projected/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-kube-api-access-mmwvd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544804 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544813 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zssqq\" (UniqueName: \"kubernetes.io/projected/a55ce728-ef0d-492c-9c68-31f2139f4734-kube-api-access-zssqq\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544822 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-89r75\" (UniqueName: \"kubernetes.io/projected/0380fc82-b08b-4e96-a26d-d06c67417449-kube-api-access-89r75\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544832 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b46b5eff-f711-418b-b9de-54a5a91821af-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544842 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee855a9c-b038-4a02-bca3-32d7fc3f321f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544852 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0380fc82-b08b-4e96-a26d-d06c67417449-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544862 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sf78d\" (UniqueName: \"kubernetes.io/projected/ee855a9c-b038-4a02-bca3-32d7fc3f321f-kube-api-access-sf78d\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.544871 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8g7k7\" (UniqueName: \"kubernetes.io/projected/b46b5eff-f711-418b-b9de-54a5a91821af-kube-api-access-8g7k7\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.545313 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5d95dea2-4e74-42eb-b7a0-cf3093c486da" (UID: "5d95dea2-4e74-42eb-b7a0-cf3093c486da"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.548920 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.558465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d95dea2-4e74-42eb-b7a0-cf3093c486da-kube-api-access-7p9w2" (OuterVolumeSpecName: "kube-api-access-7p9w2") pod "5d95dea2-4e74-42eb-b7a0-cf3093c486da" (UID: "5d95dea2-4e74-42eb-b7a0-cf3093c486da"). InnerVolumeSpecName "kube-api-access-7p9w2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.559597 4769 scope.go:117] "RemoveContainer" containerID="be0519166390db68391d0049b7d5f8c7b63656a920b7ef46312a91ab03906afe" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.568089 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.576082 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.585241 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-68d8656558-w62fh"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.592506 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-68d8656558-w62fh"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.597365 4769 scope.go:117] "RemoveContainer" containerID="618570b0583bee68d8251d9be19ff801ddbd37d2aa2bac59decdbaabe8c86c7b" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.597968 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.604585 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.614671 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6989955c5d-x4d64"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.628507 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6989955c5d-x4d64"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.637633 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.645998 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" event={"ID":"b46b5eff-f711-418b-b9de-54a5a91821af","Type":"ContainerDied","Data":"00ae7b411f23726c32518a8b05d9916481e126a38d493e4614f8070d6a45ff38"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.646097 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement3637-account-delete-m2bjk" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.646220 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d95dea2-4e74-42eb-b7a0-cf3093c486da-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.646241 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7p9w2\" (UniqueName: \"kubernetes.io/projected/5d95dea2-4e74-42eb-b7a0-cf3093c486da-kube-api-access-7p9w2\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.647991 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder8e53-account-delete-zvrnf" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.649291 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.650538 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" event={"ID":"dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d","Type":"ContainerDied","Data":"c153a94b2fc510699c2a58bd340c7e97bc701ecf096c90f88abb3fa7d49a9017"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.650655 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glancef3b9-account-delete-4b67q" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.655263 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.656577 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_604926b7-fdf2-4dc6-9a15-2160c9feff0c/ovn-northd/0.log" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.656628 4769 generic.go:334] "Generic (PLEG): container finished" podID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" exitCode=139 Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.656725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"604926b7-fdf2-4dc6-9a15-2160c9feff0c","Type":"ContainerDied","Data":"b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.660479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" event={"ID":"a55ce728-ef0d-492c-9c68-31f2139f4734","Type":"ContainerDied","Data":"ea051d63715f183dd0535b886dbe8f092cc20b31e7d94445dfc4c346195b3780"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.660568 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novaapi10ec-account-delete-cktts" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.662167 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-86d59c8959-pbrhd"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.663658 4769 generic.go:334] "Generic (PLEG): container finished" podID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerID="0a8bb992cb4724c1bb88eeebb5bc3e3b06b4814e629415b220aa44dff8458fca" exitCode=0 Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.663728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" event={"ID":"64ba6619-1b2b-4a3e-8605-cdc296f28855","Type":"ContainerDied","Data":"0a8bb992cb4724c1bb88eeebb5bc3e3b06b4814e629415b220aa44dff8458fca"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.665435 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/novacell0726e-account-delete-tt4rj" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.668394 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.670624 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.670704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican8259-account-delete-r2c4s" event={"ID":"5d95dea2-4e74-42eb-b7a0-cf3093c486da","Type":"ContainerDied","Data":"c213268c670c3ca753c66e0ee9e32d9ed56cfeb54f6c050f9860853910ef1747"} Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.683705 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.698800 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.712941 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.722697 4769 scope.go:117] "RemoveContainer" containerID="53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.728610 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.744097 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.752478 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.833915 4769 scope.go:117] "RemoveContainer" containerID="caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.847408 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement3637-account-delete-m2bjk"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.859272 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement3637-account-delete-m2bjk"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.889208 4769 scope.go:117] "RemoveContainer" containerID="7b0def21090337055b41a1f840dc3e26d99648661a05d3782ad3426a4088a728" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.920012 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.928505 4769 scope.go:117] "RemoveContainer" containerID="53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441" Nov 21 13:27:30 crc kubenswrapper[4769]: E1121 13:27:30.929559 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441\": container with ID starting with 53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441 not found: ID does not exist" containerID="53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.929609 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441"} err="failed to get container status \"53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441\": rpc error: code = NotFound desc = could not find container \"53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441\": container with ID starting with 53ed5e072608fc2616237f9488401c6901d715096ef73983d6c298fe4138d441 not found: ID does not exist" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.929642 4769 scope.go:117] "RemoveContainer" containerID="bd56958d10b48bffa465fb6c4509d088147aac5ac8a7742a182dda72a2c4a1aa" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.940665 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutronbfc0-account-delete-bvhpq"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.952286 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novacell0726e-account-delete-tt4rj"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.959941 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novacell0726e-account-delete-tt4rj"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.960850 4769 scope.go:117] "RemoveContainer" containerID="8b921dada6827bd512fcb738282355b80189744df2307273266e1af72074eab9" Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.970950 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder8e53-account-delete-zvrnf"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.981657 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder8e53-account-delete-zvrnf"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.987554 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glancef3b9-account-delete-4b67q"] Nov 21 13:27:30 crc kubenswrapper[4769]: I1121 13:27:30.998817 4769 scope.go:117] "RemoveContainer" containerID="caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd" Nov 21 13:27:31 crc kubenswrapper[4769]: E1121 13:27:31.002157 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd\": container with ID starting with caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd not found: ID does not exist" containerID="caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.002213 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd"} err="failed to get container status \"caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd\": rpc error: code = NotFound desc = could not find container \"caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd\": container with ID starting with caec840b08f512977c97f804434623f42630290aeeac1a6c4a110680021b37cd not found: ID does not exist" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.002242 4769 scope.go:117] "RemoveContainer" containerID="c50e5c1d420c19b8c655bf0da67a5c416de58f2e833e07ba32f8de3591e64434" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.004977 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glancef3b9-account-delete-4b67q"] Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.016564 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/novaapi10ec-account-delete-cktts"] Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.020479 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_604926b7-fdf2-4dc6-9a15-2160c9feff0c/ovn-northd/0.log" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.020592 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.023941 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/novaapi10ec-account-delete-cktts"] Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.028801 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican8259-account-delete-r2c4s"] Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.032940 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican8259-account-delete-r2c4s"] Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.155968 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-config\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-scripts\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4pmc\" (UniqueName: \"kubernetes.io/projected/604926b7-fdf2-4dc6-9a15-2160c9feff0c-kube-api-access-x4pmc\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156533 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-metrics-certs-tls-certs\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-northd-tls-certs\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156695 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-combined-ca-bundle\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156699 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-scripts" (OuterVolumeSpecName: "scripts") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.156743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-rundir\") pod \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\" (UID: \"604926b7-fdf2-4dc6-9a15-2160c9feff0c\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.157119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.157244 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-config" (OuterVolumeSpecName: "config") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.157586 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-rundir\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.157603 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.157614 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/604926b7-fdf2-4dc6-9a15-2160c9feff0c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.164424 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604926b7-fdf2-4dc6-9a15-2160c9feff0c-kube-api-access-x4pmc" (OuterVolumeSpecName: "kube-api-access-x4pmc") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "kube-api-access-x4pmc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.179139 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.176:5671: connect: connection refused" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.183969 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.222542 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.224530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "604926b7-fdf2-4dc6-9a15-2160c9feff0c" (UID: "604926b7-fdf2-4dc6-9a15-2160c9feff0c"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.227553 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.269950 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.269994 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x4pmc\" (UniqueName: \"kubernetes.io/projected/604926b7-fdf2-4dc6-9a15-2160c9feff0c-kube-api-access-x4pmc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.270005 4769 reconciler_common.go:293] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.270015 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/604926b7-fdf2-4dc6-9a15-2160c9feff0c-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.288892 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" path="/var/lib/kubelet/pods/00ca8158-c10b-4e37-b666-6610ba3113f2/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.289765 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" path="/var/lib/kubelet/pods/0380fc82-b08b-4e96-a26d-d06c67417449/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.290294 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" path="/var/lib/kubelet/pods/083c8f14-c35e-4d60-91ef-9881dc7ad8c3/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.291486 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" path="/var/lib/kubelet/pods/1d4eed1d-bce3-4f26-a240-956b705062da/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.292059 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" path="/var/lib/kubelet/pods/2aa088d3-53a0-4016-87ac-59358c5b2d35/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.292627 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" path="/var/lib/kubelet/pods/5d95dea2-4e74-42eb-b7a0-cf3093c486da/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.293583 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" path="/var/lib/kubelet/pods/6d949ccd-2ecb-4d79-b7a5-200c5aeaefee/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.294126 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" path="/var/lib/kubelet/pods/7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.295264 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" path="/var/lib/kubelet/pods/90a092e1-717f-4c7a-9740-89b57b690e43/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.296052 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f0d766-9895-4c18-9a55-b670336879a5" path="/var/lib/kubelet/pods/93f0d766-9895-4c18-9a55-b670336879a5/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.296742 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" path="/var/lib/kubelet/pods/a55ce728-ef0d-492c-9c68-31f2139f4734/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.297781 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" path="/var/lib/kubelet/pods/a7782b46-8d2b-49c2-ba34-423e6eb6e6cd/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.298576 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" path="/var/lib/kubelet/pods/ac1d3aa2-0067-423a-ad55-820d9dde22f4/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.299130 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" path="/var/lib/kubelet/pods/b46b5eff-f711-418b-b9de-54a5a91821af/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.300510 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" path="/var/lib/kubelet/pods/baec736c-d0fb-4b1a-9c7f-14e3a275807c/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.301218 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" path="/var/lib/kubelet/pods/cc15cbd1-7c64-4f95-b7ed-2090167ce968/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.301880 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" path="/var/lib/kubelet/pods/dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.302955 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" path="/var/lib/kubelet/pods/ece80665-fef3-4d5e-a84e-e853f5725be7/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.303885 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" path="/var/lib/kubelet/pods/ed1d317a-289c-469d-98ae-789dd3230e4a/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.304925 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" path="/var/lib/kubelet/pods/ee855a9c-b038-4a02-bca3-32d7fc3f321f/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.306008 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" path="/var/lib/kubelet/pods/f75bf156-e338-42b1-959d-83c46d7a4a6e/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.306761 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf41518-0738-4701-9482-fe17d9be8abf" path="/var/lib/kubelet/pods/fdf41518-0738-4701-9482-fe17d9be8abf/volumes" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.370737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64ba6619-1b2b-4a3e-8605-cdc296f28855-logs\") pod \"64ba6619-1b2b-4a3e-8605-cdc296f28855\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.370783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgbg5\" (UniqueName: \"kubernetes.io/projected/64ba6619-1b2b-4a3e-8605-cdc296f28855-kube-api-access-rgbg5\") pod \"64ba6619-1b2b-4a3e-8605-cdc296f28855\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.370861 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data-custom\") pod \"64ba6619-1b2b-4a3e-8605-cdc296f28855\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.370977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-combined-ca-bundle\") pod \"64ba6619-1b2b-4a3e-8605-cdc296f28855\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.371113 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data\") pod \"64ba6619-1b2b-4a3e-8605-cdc296f28855\" (UID: \"64ba6619-1b2b-4a3e-8605-cdc296f28855\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.373265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ba6619-1b2b-4a3e-8605-cdc296f28855-logs" (OuterVolumeSpecName: "logs") pod "64ba6619-1b2b-4a3e-8605-cdc296f28855" (UID: "64ba6619-1b2b-4a3e-8605-cdc296f28855"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.376027 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "64ba6619-1b2b-4a3e-8605-cdc296f28855" (UID: "64ba6619-1b2b-4a3e-8605-cdc296f28855"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.377355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64ba6619-1b2b-4a3e-8605-cdc296f28855-kube-api-access-rgbg5" (OuterVolumeSpecName: "kube-api-access-rgbg5") pod "64ba6619-1b2b-4a3e-8605-cdc296f28855" (UID: "64ba6619-1b2b-4a3e-8605-cdc296f28855"). InnerVolumeSpecName "kube-api-access-rgbg5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.393828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "64ba6619-1b2b-4a3e-8605-cdc296f28855" (UID: "64ba6619-1b2b-4a3e-8605-cdc296f28855"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.411440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data" (OuterVolumeSpecName: "config-data") pod "64ba6619-1b2b-4a3e-8605-cdc296f28855" (UID: "64ba6619-1b2b-4a3e-8605-cdc296f28855"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.422922 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.473726 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.473763 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/64ba6619-1b2b-4a3e-8605-cdc296f28855-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.473774 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rgbg5\" (UniqueName: \"kubernetes.io/projected/64ba6619-1b2b-4a3e-8605-cdc296f28855-kube-api-access-rgbg5\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.473785 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.473794 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64ba6619-1b2b-4a3e-8605-cdc296f28855-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.574362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-config-data\") pod \"76618b5e-2d20-420a-a18c-5c6c1da97b94\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.574472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-combined-ca-bundle\") pod \"76618b5e-2d20-420a-a18c-5c6c1da97b94\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.574509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvsfk\" (UniqueName: \"kubernetes.io/projected/76618b5e-2d20-420a-a18c-5c6c1da97b94-kube-api-access-rvsfk\") pod \"76618b5e-2d20-420a-a18c-5c6c1da97b94\" (UID: \"76618b5e-2d20-420a-a18c-5c6c1da97b94\") " Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.577819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76618b5e-2d20-420a-a18c-5c6c1da97b94-kube-api-access-rvsfk" (OuterVolumeSpecName: "kube-api-access-rvsfk") pod "76618b5e-2d20-420a-a18c-5c6c1da97b94" (UID: "76618b5e-2d20-420a-a18c-5c6c1da97b94"). InnerVolumeSpecName "kube-api-access-rvsfk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.577901 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.225:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.577893 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-79fd8485b-brhmt" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.225:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.598578 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "76618b5e-2d20-420a-a18c-5c6c1da97b94" (UID: "76618b5e-2d20-420a-a18c-5c6c1da97b94"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.608420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-config-data" (OuterVolumeSpecName: "config-data") pod "76618b5e-2d20-420a-a18c-5c6c1da97b94" (UID: "76618b5e-2d20-420a-a18c-5c6c1da97b94"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.676138 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.676167 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/76618b5e-2d20-420a-a18c-5c6c1da97b94-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.676178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rvsfk\" (UniqueName: \"kubernetes.io/projected/76618b5e-2d20-420a-a18c-5c6c1da97b94-kube-api-access-rvsfk\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.695816 4769 generic.go:334] "Generic (PLEG): container finished" podID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" exitCode=0 Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.695878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"76618b5e-2d20-420a-a18c-5c6c1da97b94","Type":"ContainerDied","Data":"990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19"} Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.695902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"76618b5e-2d20-420a-a18c-5c6c1da97b94","Type":"ContainerDied","Data":"30e5b5c9bb30f43622c62d7e195195506a8299164d0e68ee48e549f56936345f"} Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.695919 4769 scope.go:117] "RemoveContainer" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.696303 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.708691 4769 generic.go:334] "Generic (PLEG): container finished" podID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerID="3d2e40b1a98b0dda394e3f33fc6d50da970f3d836fbbf318f680db1c338ae781" exitCode=0 Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.708757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"f76c87ba-5d40-4b61-a44a-7b8c895507d8","Type":"ContainerDied","Data":"3d2e40b1a98b0dda394e3f33fc6d50da970f3d836fbbf318f680db1c338ae781"} Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.710430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" event={"ID":"64ba6619-1b2b-4a3e-8605-cdc296f28855","Type":"ContainerDied","Data":"38ff679e84e4e9da751ef79a9978b06b7bb7b8948e354e49e8a35764d0d781b5"} Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.710470 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.711993 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_604926b7-fdf2-4dc6-9a15-2160c9feff0c/ovn-northd/0.log" Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.712024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"604926b7-fdf2-4dc6-9a15-2160c9feff0c","Type":"ContainerDied","Data":"c6f0c5575de76731f992ac5e1e2905f90292de9df114b70dc7feed02a679a6ff"} Nov 21 13:27:31 crc kubenswrapper[4769]: I1121 13:27:31.712076 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.002558 4769 scope.go:117] "RemoveContainer" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" Nov 21 13:27:32 crc kubenswrapper[4769]: E1121 13:27:32.003747 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19\": container with ID starting with 990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19 not found: ID does not exist" containerID="990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.003790 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19"} err="failed to get container status \"990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19\": rpc error: code = NotFound desc = could not find container \"990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19\": container with ID starting with 990480424fb2f8ebe49ec8d280c4fdf40863ad559b97d6f30ad10076e2fb5a19 not found: ID does not exist" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.003817 4769 scope.go:117] "RemoveContainer" containerID="0a8bb992cb4724c1bb88eeebb5bc3e3b06b4814e629415b220aa44dff8458fca" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.043604 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.049295 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.058376 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.065593 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.070275 4769 scope.go:117] "RemoveContainer" containerID="3b24cc09ab22264d746ae4f5f0857ced13d35ea66ae2f1da22e626a7d540861b" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.074013 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.084149 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6d769cf55b-64vn5"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.086973 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.111780 4769 scope.go:117] "RemoveContainer" containerID="ef863c661a90d61b54675e320d9df78dcaf9bf458ea01ea85f44d8e12a6dd1f5" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.139431 4769 scope.go:117] "RemoveContainer" containerID="b495dec12eccba0e748cef7a7ca6308c6d6a4ece67afc81b339417af09baf0bf" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.185842 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-plugins-conf\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-tls\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186677 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-erlang-cookie\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f76c87ba-5d40-4b61-a44a-7b8c895507d8-pod-info\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-confd\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186822 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f76c87ba-5d40-4b61-a44a-7b8c895507d8-erlang-cookie-secret\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186864 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186904 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-plugins\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj7hh\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-kube-api-access-wj7hh\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.186971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-server-conf\") pod \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\" (UID: \"f76c87ba-5d40-4b61-a44a-7b8c895507d8\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.187323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.187768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.188285 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.194552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f76c87ba-5d40-4b61-a44a-7b8c895507d8-pod-info" (OuterVolumeSpecName: "pod-info") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.194556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f76c87ba-5d40-4b61-a44a-7b8c895507d8-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.194664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-kube-api-access-wj7hh" (OuterVolumeSpecName: "kube-api-access-wj7hh") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "kube-api-access-wj7hh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.194843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "persistence") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.195003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.219083 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data" (OuterVolumeSpecName: "config-data") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.225879 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.241826 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-server-conf" (OuterVolumeSpecName: "server-conf") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-tls\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-confd\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-server-conf\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-plugins-conf\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288363 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-plugins\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bztbw\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-kube-api-access-bztbw\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288416 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-erlang-cookie\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288544 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b51a88b8-9feb-448a-89c2-93800a854081-pod-info\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b51a88b8-9feb-448a-89c2-93800a854081-erlang-cookie-secret\") pod \"b51a88b8-9feb-448a-89c2-93800a854081\" (UID: \"b51a88b8-9feb-448a-89c2-93800a854081\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288872 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/f76c87ba-5d40-4b61-a44a-7b8c895507d8-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288920 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288930 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288942 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wj7hh\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-kube-api-access-wj7hh\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288968 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288980 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.288989 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/f76c87ba-5d40-4b61-a44a-7b8c895507d8-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.289000 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.289011 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.289022 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/f76c87ba-5d40-4b61-a44a-7b8c895507d8-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.290256 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.292545 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.293167 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.294556 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-kube-api-access-bztbw" (OuterVolumeSpecName: "kube-api-access-bztbw") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "kube-api-access-bztbw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.295051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b51a88b8-9feb-448a-89c2-93800a854081-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.297007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "persistence") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.297021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b51a88b8-9feb-448a-89c2-93800a854081-pod-info" (OuterVolumeSpecName: "pod-info") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.297262 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "f76c87ba-5d40-4b61-a44a-7b8c895507d8" (UID: "f76c87ba-5d40-4b61-a44a-7b8c895507d8"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.297600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.309083 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.310660 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data" (OuterVolumeSpecName: "config-data") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.331404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-server-conf" (OuterVolumeSpecName: "server-conf") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.373059 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "b51a88b8-9feb-448a-89c2-93800a854081" (UID: "b51a88b8-9feb-448a-89c2-93800a854081"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-config-data-default\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1243748f-cba6-409e-8765-467b40e04ba7-config-data-generated\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-kolla-config\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-operator-scripts\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389836 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389860 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr242\" (UniqueName: \"kubernetes.io/projected/1243748f-cba6-409e-8765-467b40e04ba7-kube-api-access-mr242\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389888 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-combined-ca-bundle\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.389957 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-galera-tls-certs\") pod \"1243748f-cba6-409e-8765-467b40e04ba7\" (UID: \"1243748f-cba6-409e-8765-467b40e04ba7\") " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390329 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/f76c87ba-5d40-4b61-a44a-7b8c895507d8-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390354 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390367 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390378 4769 reconciler_common.go:293] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-server-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390390 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390415 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390428 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390441 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bztbw\" (UniqueName: \"kubernetes.io/projected/b51a88b8-9feb-448a-89c2-93800a854081-kube-api-access-bztbw\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390455 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390465 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/b51a88b8-9feb-448a-89c2-93800a854081-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390478 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/b51a88b8-9feb-448a-89c2-93800a854081-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390489 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/b51a88b8-9feb-448a-89c2-93800a854081-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390500 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/b51a88b8-9feb-448a-89c2-93800a854081-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.390594 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1243748f-cba6-409e-8765-467b40e04ba7-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.391326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.391605 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.391777 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.393394 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1243748f-cba6-409e-8765-467b40e04ba7-kube-api-access-mr242" (OuterVolumeSpecName: "kube-api-access-mr242") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "kube-api-access-mr242". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.400203 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.406447 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.410426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.436180 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "1243748f-cba6-409e-8765-467b40e04ba7" (UID: "1243748f-cba6-409e-8765-467b40e04ba7"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491636 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491687 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/1243748f-cba6-409e-8765-467b40e04ba7-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491700 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491710 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491719 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1243748f-cba6-409e-8765-467b40e04ba7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491783 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491797 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mr242\" (UniqueName: \"kubernetes.io/projected/1243748f-cba6-409e-8765-467b40e04ba7-kube-api-access-mr242\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491807 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.491816 4769 reconciler_common.go:293] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/1243748f-cba6-409e-8765-467b40e04ba7-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.505833 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.599484 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.725672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"f76c87ba-5d40-4b61-a44a-7b8c895507d8","Type":"ContainerDied","Data":"23a86f946b081732b2394e643ed35e00dd95e314d4d137845fd304b1cfe2b181"} Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.725754 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.725790 4769 scope.go:117] "RemoveContainer" containerID="3d2e40b1a98b0dda394e3f33fc6d50da970f3d836fbbf318f680db1c338ae781" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.728796 4769 generic.go:334] "Generic (PLEG): container finished" podID="b51a88b8-9feb-448a-89c2-93800a854081" containerID="bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7" exitCode=0 Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.728849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b51a88b8-9feb-448a-89c2-93800a854081","Type":"ContainerDied","Data":"bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7"} Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.728875 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.728906 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"b51a88b8-9feb-448a-89c2-93800a854081","Type":"ContainerDied","Data":"941c7aa364bfbf72755fe6a20c2493832f8063c6ccd7be9e47faa23ae5a395e6"} Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.735740 4769 generic.go:334] "Generic (PLEG): container finished" podID="1243748f-cba6-409e-8765-467b40e04ba7" containerID="d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0" exitCode=0 Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.735797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"1243748f-cba6-409e-8765-467b40e04ba7","Type":"ContainerDied","Data":"d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0"} Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.735940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"1243748f-cba6-409e-8765-467b40e04ba7","Type":"ContainerDied","Data":"fcd373bcdbdfefa4723265d65941e37f9bd1b9c2c2ff79a151d2664a3ede9ba5"} Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.735850 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.765908 4769 scope.go:117] "RemoveContainer" containerID="12749eec873cc9c283cbbf6933412d3ccab913e1b10a3630ef36798a37d4b69c" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.780908 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.787483 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.801505 4769 scope.go:117] "RemoveContainer" containerID="bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.817688 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.824785 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.832352 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.833824 4769 scope.go:117] "RemoveContainer" containerID="bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.837832 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.843710 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.9:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.845854 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.9:8775/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.855235 4769 scope.go:117] "RemoveContainer" containerID="bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7" Nov 21 13:27:32 crc kubenswrapper[4769]: E1121 13:27:32.855676 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7\": container with ID starting with bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7 not found: ID does not exist" containerID="bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.855727 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7"} err="failed to get container status \"bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7\": rpc error: code = NotFound desc = could not find container \"bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7\": container with ID starting with bd2a00f0342383bb685ee88afd44cde21d55b5badbdf65f6ed32a62fd29d18f7 not found: ID does not exist" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.856124 4769 scope.go:117] "RemoveContainer" containerID="bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a" Nov 21 13:27:32 crc kubenswrapper[4769]: E1121 13:27:32.856799 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a\": container with ID starting with bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a not found: ID does not exist" containerID="bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.856825 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a"} err="failed to get container status \"bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a\": rpc error: code = NotFound desc = could not find container \"bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a\": container with ID starting with bee262d89dcd67fb40abacab0f776783978fcc9a579ab7bb08c4ca3972b9431a not found: ID does not exist" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.856856 4769 scope.go:117] "RemoveContainer" containerID="d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.884858 4769 scope.go:117] "RemoveContainer" containerID="e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.904212 4769 scope.go:117] "RemoveContainer" containerID="d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0" Nov 21 13:27:32 crc kubenswrapper[4769]: E1121 13:27:32.904730 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0\": container with ID starting with d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0 not found: ID does not exist" containerID="d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.904771 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0"} err="failed to get container status \"d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0\": rpc error: code = NotFound desc = could not find container \"d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0\": container with ID starting with d9ae5cb3dd0299f9b763f7f9bbf43f6780490d586e29b4d6594baa94d76242d0 not found: ID does not exist" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.904801 4769 scope.go:117] "RemoveContainer" containerID="e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21" Nov 21 13:27:32 crc kubenswrapper[4769]: E1121 13:27:32.905084 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21\": container with ID starting with e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21 not found: ID does not exist" containerID="e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21" Nov 21 13:27:32 crc kubenswrapper[4769]: I1121 13:27:32.905112 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21"} err="failed to get container status \"e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21\": rpc error: code = NotFound desc = could not find container \"e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21\": container with ID starting with e8f2babb236adf7c020286fd4ac9539f673b42e4a9927e8f0b883de7c954fe21 not found: ID does not exist" Nov 21 13:27:33 crc kubenswrapper[4769]: I1121 13:27:33.290465 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1243748f-cba6-409e-8765-467b40e04ba7" path="/var/lib/kubelet/pods/1243748f-cba6-409e-8765-467b40e04ba7/volumes" Nov 21 13:27:33 crc kubenswrapper[4769]: I1121 13:27:33.292500 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" path="/var/lib/kubelet/pods/604926b7-fdf2-4dc6-9a15-2160c9feff0c/volumes" Nov 21 13:27:33 crc kubenswrapper[4769]: I1121 13:27:33.293804 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" path="/var/lib/kubelet/pods/64ba6619-1b2b-4a3e-8605-cdc296f28855/volumes" Nov 21 13:27:33 crc kubenswrapper[4769]: I1121 13:27:33.296335 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" path="/var/lib/kubelet/pods/76618b5e-2d20-420a-a18c-5c6c1da97b94/volumes" Nov 21 13:27:33 crc kubenswrapper[4769]: I1121 13:27:33.297731 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51a88b8-9feb-448a-89c2-93800a854081" path="/var/lib/kubelet/pods/b51a88b8-9feb-448a-89c2-93800a854081/volumes" Nov 21 13:27:33 crc kubenswrapper[4769]: I1121 13:27:33.300456 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" path="/var/lib/kubelet/pods/f76c87ba-5d40-4b61-a44a-7b8c895507d8/volumes" Nov 21 13:27:37 crc kubenswrapper[4769]: I1121 13:27:37.973352 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.068363 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd"] Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.068618 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerName="dnsmasq-dns" containerID="cri-o://e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3" gracePeriod=10 Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.469687 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.605103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dnsmasq-svc\") pod \"36fbd548-442c-4365-bda7-12f523a7c3e5\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.605161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-config\") pod \"36fbd548-442c-4365-bda7-12f523a7c3e5\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.605275 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjmc4\" (UniqueName: \"kubernetes.io/projected/36fbd548-442c-4365-bda7-12f523a7c3e5-kube-api-access-sjmc4\") pod \"36fbd548-442c-4365-bda7-12f523a7c3e5\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.605530 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dns-swift-storage-0\") pod \"36fbd548-442c-4365-bda7-12f523a7c3e5\" (UID: \"36fbd548-442c-4365-bda7-12f523a7c3e5\") " Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.626702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fbd548-442c-4365-bda7-12f523a7c3e5-kube-api-access-sjmc4" (OuterVolumeSpecName: "kube-api-access-sjmc4") pod "36fbd548-442c-4365-bda7-12f523a7c3e5" (UID: "36fbd548-442c-4365-bda7-12f523a7c3e5"). InnerVolumeSpecName "kube-api-access-sjmc4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.645900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-config" (OuterVolumeSpecName: "config") pod "36fbd548-442c-4365-bda7-12f523a7c3e5" (UID: "36fbd548-442c-4365-bda7-12f523a7c3e5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.650022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "36fbd548-442c-4365-bda7-12f523a7c3e5" (UID: "36fbd548-442c-4365-bda7-12f523a7c3e5"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.659849 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "36fbd548-442c-4365-bda7-12f523a7c3e5" (UID: "36fbd548-442c-4365-bda7-12f523a7c3e5"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.707850 4769 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.707883 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.707892 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fbd548-442c-4365-bda7-12f523a7c3e5-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.707904 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sjmc4\" (UniqueName: \"kubernetes.io/projected/36fbd548-442c-4365-bda7-12f523a7c3e5-kube-api-access-sjmc4\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.826272 4769 generic.go:334] "Generic (PLEG): container finished" podID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerID="e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3" exitCode=0 Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.826309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" event={"ID":"36fbd548-442c-4365-bda7-12f523a7c3e5","Type":"ContainerDied","Data":"e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3"} Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.826332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" event={"ID":"36fbd548-442c-4365-bda7-12f523a7c3e5","Type":"ContainerDied","Data":"e4ebe150cb5f6a318ef4b4842795f7db97132f34fc3e49065b8efc58952881f7"} Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.826478 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.826535 4769 scope.go:117] "RemoveContainer" containerID="e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.861776 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd"] Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.863903 4769 scope.go:117] "RemoveContainer" containerID="2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.867086 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-698877975-4fdqd"] Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.886629 4769 scope.go:117] "RemoveContainer" containerID="e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3" Nov 21 13:27:38 crc kubenswrapper[4769]: E1121 13:27:38.887163 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3\": container with ID starting with e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3 not found: ID does not exist" containerID="e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.887222 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3"} err="failed to get container status \"e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3\": rpc error: code = NotFound desc = could not find container \"e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3\": container with ID starting with e8fae8f34563e557bfec58dad97a92d9a5de5437f68db95c4735348b7ff98ad3 not found: ID does not exist" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.887250 4769 scope.go:117] "RemoveContainer" containerID="2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009" Nov 21 13:27:38 crc kubenswrapper[4769]: E1121 13:27:38.887621 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009\": container with ID starting with 2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009 not found: ID does not exist" containerID="2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009" Nov 21 13:27:38 crc kubenswrapper[4769]: I1121 13:27:38.887647 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009"} err="failed to get container status \"2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009\": rpc error: code = NotFound desc = could not find container \"2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009\": container with ID starting with 2e26e29632733e19f4a71c766ee9226d24e23439b5b1be9502778ac394e14009 not found: ID does not exist" Nov 21 13:27:39 crc kubenswrapper[4769]: I1121 13:27:39.290369 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" path="/var/lib/kubelet/pods/36fbd548-442c-4365-bda7-12f523a7c3e5/volumes" Nov 21 13:27:41 crc kubenswrapper[4769]: I1121 13:27:41.325097 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:27:41 crc kubenswrapper[4769]: I1121 13:27:41.325455 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:27:45 crc kubenswrapper[4769]: I1121 13:27:45.712419 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.240:9696/\": dial tcp 10.217.0.240:9696: connect: connection refused" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.488570 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.629294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-cache\") pod \"de29f094-3b0a-4c67-a75e-8d50a59945a9\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.629712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") pod \"de29f094-3b0a-4c67-a75e-8d50a59945a9\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.629853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"de29f094-3b0a-4c67-a75e-8d50a59945a9\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.629884 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt988\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-kube-api-access-lt988\") pod \"de29f094-3b0a-4c67-a75e-8d50a59945a9\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.629951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-lock\") pod \"de29f094-3b0a-4c67-a75e-8d50a59945a9\" (UID: \"de29f094-3b0a-4c67-a75e-8d50a59945a9\") " Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.630659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-lock" (OuterVolumeSpecName: "lock") pod "de29f094-3b0a-4c67-a75e-8d50a59945a9" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.630651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-cache" (OuterVolumeSpecName: "cache") pod "de29f094-3b0a-4c67-a75e-8d50a59945a9" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.634835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "swift") pod "de29f094-3b0a-4c67-a75e-8d50a59945a9" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.634986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-kube-api-access-lt988" (OuterVolumeSpecName: "kube-api-access-lt988") pod "de29f094-3b0a-4c67-a75e-8d50a59945a9" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9"). InnerVolumeSpecName "kube-api-access-lt988". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.635296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "de29f094-3b0a-4c67-a75e-8d50a59945a9" (UID: "de29f094-3b0a-4c67-a75e-8d50a59945a9"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.731962 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.732003 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lt988\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-kube-api-access-lt988\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.732015 4769 reconciler_common.go:293] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-lock\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.732024 4769 reconciler_common.go:293] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/de29f094-3b0a-4c67-a75e-8d50a59945a9-cache\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.732032 4769 reconciler_common.go:293] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/de29f094-3b0a-4c67-a75e-8d50a59945a9-etc-swift\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.748717 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.833744 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.902485 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-b4896794-72gsv_222390bc-4c6c-4f69-b753-5f190e15bb6d/neutron-api/0.log" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.902566 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.948485 4769 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-b4896794-72gsv_222390bc-4c6c-4f69-b753-5f190e15bb6d/neutron-api/0.log" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.948543 4769 generic.go:334] "Generic (PLEG): container finished" podID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerID="5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb" exitCode=137 Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.948612 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.948616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" event={"ID":"222390bc-4c6c-4f69-b753-5f190e15bb6d","Type":"ContainerDied","Data":"5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb"} Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.948733 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-b4896794-72gsv" event={"ID":"222390bc-4c6c-4f69-b753-5f190e15bb6d","Type":"ContainerDied","Data":"50dcda6da4738b958815f13225f8d1222e11ca6cc642f4dd350f496ed302687d"} Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.948770 4769 scope.go:117] "RemoveContainer" containerID="92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.957290 4769 generic.go:334] "Generic (PLEG): container finished" podID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerID="a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c" exitCode=137 Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.957315 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c"} Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.957368 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"de29f094-3b0a-4c67-a75e-8d50a59945a9","Type":"ContainerDied","Data":"237fd32bdd853ec0a909668d632679a3e2acfecbdd894e1ba979c33b8748e92e"} Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.957370 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.992416 4769 scope.go:117] "RemoveContainer" containerID="5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb" Nov 21 13:27:52 crc kubenswrapper[4769]: I1121 13:27:52.999798 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.007372 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.013908 4769 scope.go:117] "RemoveContainer" containerID="92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.014285 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84\": container with ID starting with 92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84 not found: ID does not exist" containerID="92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.014315 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84"} err="failed to get container status \"92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84\": rpc error: code = NotFound desc = could not find container \"92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84\": container with ID starting with 92bc6e2a26ae49eced7af0dd8ed2ebf320c07e6323d7239f70b7678f5b872c84 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.014337 4769 scope.go:117] "RemoveContainer" containerID="5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.014641 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb\": container with ID starting with 5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb not found: ID does not exist" containerID="5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.014692 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb"} err="failed to get container status \"5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb\": rpc error: code = NotFound desc = could not find container \"5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb\": container with ID starting with 5857ae1d8f5fea561861477e411d69e00dfed12bd4571c6a24fe4527fd2d16fb not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.014733 4769 scope.go:117] "RemoveContainer" containerID="a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.033952 4769 scope.go:117] "RemoveContainer" containerID="9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-httpd-config\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-combined-ca-bundle\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-config\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-internal-tls-certs\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035373 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn4zk\" (UniqueName: \"kubernetes.io/projected/222390bc-4c6c-4f69-b753-5f190e15bb6d-kube-api-access-mn4zk\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-ovndb-tls-certs\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.035422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-public-tls-certs\") pod \"222390bc-4c6c-4f69-b753-5f190e15bb6d\" (UID: \"222390bc-4c6c-4f69-b753-5f190e15bb6d\") " Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.038974 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/222390bc-4c6c-4f69-b753-5f190e15bb6d-kube-api-access-mn4zk" (OuterVolumeSpecName: "kube-api-access-mn4zk") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "kube-api-access-mn4zk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.039501 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.055682 4769 scope.go:117] "RemoveContainer" containerID="11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.070580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.073581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-config" (OuterVolumeSpecName: "config") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.075749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.077953 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.106641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "222390bc-4c6c-4f69-b753-5f190e15bb6d" (UID: "222390bc-4c6c-4f69-b753-5f190e15bb6d"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137340 4769 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-httpd-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137386 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137403 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137414 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137427 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mn4zk\" (UniqueName: \"kubernetes.io/projected/222390bc-4c6c-4f69-b753-5f190e15bb6d-kube-api-access-mn4zk\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137442 4769 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.137453 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/222390bc-4c6c-4f69-b753-5f190e15bb6d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.156347 4769 scope.go:117] "RemoveContainer" containerID="4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.183571 4769 scope.go:117] "RemoveContainer" containerID="316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.204177 4769 scope.go:117] "RemoveContainer" containerID="84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.220329 4769 scope.go:117] "RemoveContainer" containerID="92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.240472 4769 scope.go:117] "RemoveContainer" containerID="9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.260454 4769 scope.go:117] "RemoveContainer" containerID="935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.287430 4769 scope.go:117] "RemoveContainer" containerID="40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.297953 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" path="/var/lib/kubelet/pods/de29f094-3b0a-4c67-a75e-8d50a59945a9/volumes" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.299728 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-b4896794-72gsv"] Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.299755 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-b4896794-72gsv"] Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.314069 4769 scope.go:117] "RemoveContainer" containerID="13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.338338 4769 scope.go:117] "RemoveContainer" containerID="f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.371562 4769 scope.go:117] "RemoveContainer" containerID="a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.396920 4769 scope.go:117] "RemoveContainer" containerID="93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.417289 4769 scope.go:117] "RemoveContainer" containerID="1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.436976 4769 scope.go:117] "RemoveContainer" containerID="a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.437735 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c\": container with ID starting with a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c not found: ID does not exist" containerID="a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.437765 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c"} err="failed to get container status \"a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c\": rpc error: code = NotFound desc = could not find container \"a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c\": container with ID starting with a4558d7713f4328aa140d5e6e423bdfebb1cd7b07ebc3af5d66683a88d5de78c not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.437785 4769 scope.go:117] "RemoveContainer" containerID="9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.438138 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2\": container with ID starting with 9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2 not found: ID does not exist" containerID="9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.438167 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2"} err="failed to get container status \"9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2\": rpc error: code = NotFound desc = could not find container \"9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2\": container with ID starting with 9af3e76f0273be455925f6579dfaca29294c5bc6c7dd6db8e26a9c79f4ee0ad2 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.438182 4769 scope.go:117] "RemoveContainer" containerID="11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.438436 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6\": container with ID starting with 11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6 not found: ID does not exist" containerID="11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.438463 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6"} err="failed to get container status \"11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6\": rpc error: code = NotFound desc = could not find container \"11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6\": container with ID starting with 11e1c87108f8889f472d634946ce448166f439e752d38265b9de94b42e9133a6 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.438477 4769 scope.go:117] "RemoveContainer" containerID="4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.438761 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b\": container with ID starting with 4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b not found: ID does not exist" containerID="4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.438789 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b"} err="failed to get container status \"4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b\": rpc error: code = NotFound desc = could not find container \"4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b\": container with ID starting with 4c3cd4dfe518ec3d5d8a732bf87916cb89efe3c03f7589c75e6842de64dd2c5b not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.438803 4769 scope.go:117] "RemoveContainer" containerID="316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.439216 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c\": container with ID starting with 316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c not found: ID does not exist" containerID="316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.439255 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c"} err="failed to get container status \"316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c\": rpc error: code = NotFound desc = could not find container \"316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c\": container with ID starting with 316f07d30113ad39fad55b9c97ea7e769bed12fed878e919e821dc0e73e9ac8c not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.439282 4769 scope.go:117] "RemoveContainer" containerID="84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.439596 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340\": container with ID starting with 84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340 not found: ID does not exist" containerID="84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.439623 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340"} err="failed to get container status \"84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340\": rpc error: code = NotFound desc = could not find container \"84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340\": container with ID starting with 84b874c8ba955e51a2951f4828ae8cbb80a8addbc6ef7f95ec2937f16c641340 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.439655 4769 scope.go:117] "RemoveContainer" containerID="92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.439972 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53\": container with ID starting with 92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53 not found: ID does not exist" containerID="92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.439998 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53"} err="failed to get container status \"92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53\": rpc error: code = NotFound desc = could not find container \"92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53\": container with ID starting with 92c33988afd40d346be8da9c5a451ab179bcd8d243bf0ce4ca6744801757af53 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440015 4769 scope.go:117] "RemoveContainer" containerID="9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.440356 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018\": container with ID starting with 9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018 not found: ID does not exist" containerID="9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440382 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018"} err="failed to get container status \"9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018\": rpc error: code = NotFound desc = could not find container \"9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018\": container with ID starting with 9d663f969a57c9070fa6cc68b4a5f2b0d25eb386fa8c48a31510ee68db980018 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440398 4769 scope.go:117] "RemoveContainer" containerID="935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.440654 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c\": container with ID starting with 935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c not found: ID does not exist" containerID="935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440678 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c"} err="failed to get container status \"935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c\": rpc error: code = NotFound desc = could not find container \"935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c\": container with ID starting with 935f227075c20e6afe2610fd2b760ea5b85a0ac906387214afb64f039b957c1c not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440694 4769 scope.go:117] "RemoveContainer" containerID="40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.440939 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6\": container with ID starting with 40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6 not found: ID does not exist" containerID="40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440965 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6"} err="failed to get container status \"40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6\": rpc error: code = NotFound desc = could not find container \"40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6\": container with ID starting with 40895716a6e6f214262987b3ecdbe636c330cff44c53f98523bc5759656928b6 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.440982 4769 scope.go:117] "RemoveContainer" containerID="13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.441241 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748\": container with ID starting with 13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748 not found: ID does not exist" containerID="13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.441263 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748"} err="failed to get container status \"13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748\": rpc error: code = NotFound desc = could not find container \"13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748\": container with ID starting with 13562bcf4831858127919c99488b99dec155b185276647e6c1d452c49c34c748 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.441283 4769 scope.go:117] "RemoveContainer" containerID="f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.441515 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81\": container with ID starting with f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81 not found: ID does not exist" containerID="f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.441536 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81"} err="failed to get container status \"f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81\": rpc error: code = NotFound desc = could not find container \"f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81\": container with ID starting with f05a1b8d5ec7abd4e3e2e34a2d4e205fa96a9456990acdd3dbd1d60c04cbdc81 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.441553 4769 scope.go:117] "RemoveContainer" containerID="a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.441803 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88\": container with ID starting with a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88 not found: ID does not exist" containerID="a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.441826 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88"} err="failed to get container status \"a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88\": rpc error: code = NotFound desc = could not find container \"a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88\": container with ID starting with a28246847dd17f21e6d653aa27dac17ecff089faeabf3127a42487cc6b663d88 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.441843 4769 scope.go:117] "RemoveContainer" containerID="93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.442155 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55\": container with ID starting with 93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55 not found: ID does not exist" containerID="93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.442178 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55"} err="failed to get container status \"93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55\": rpc error: code = NotFound desc = could not find container \"93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55\": container with ID starting with 93e3ae339ff11d543d5d8a2063e5bf3720f418eabd150d61ada44b052e861f55 not found: ID does not exist" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.442209 4769 scope.go:117] "RemoveContainer" containerID="1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9" Nov 21 13:27:53 crc kubenswrapper[4769]: E1121 13:27:53.442453 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9\": container with ID starting with 1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9 not found: ID does not exist" containerID="1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9" Nov 21 13:27:53 crc kubenswrapper[4769]: I1121 13:27:53.442477 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9"} err="failed to get container status \"1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9\": rpc error: code = NotFound desc = could not find container \"1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9\": container with ID starting with 1d0914cc02359202c697aa0852fc817fc191510720b4778a1e8bb3aa40164ca9 not found: ID does not exist" Nov 21 13:27:55 crc kubenswrapper[4769]: I1121 13:27:55.289306 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" path="/var/lib/kubelet/pods/222390bc-4c6c-4f69-b753-5f190e15bb6d/volumes" Nov 21 13:27:57 crc kubenswrapper[4769]: I1121 13:27:57.560515 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod00d977e8-e6a0-4274-be9a-24c45d5b1496"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod00d977e8-e6a0-4274-be9a-24c45d5b1496] : Timed out while waiting for systemd to remove kubepods-besteffort-pod00d977e8_e6a0_4274_be9a_24c45d5b1496.slice" Nov 21 13:27:57 crc kubenswrapper[4769]: E1121 13:27:57.560591 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod00d977e8-e6a0-4274-be9a-24c45d5b1496] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod00d977e8-e6a0-4274-be9a-24c45d5b1496] : Timed out while waiting for systemd to remove kubepods-besteffort-pod00d977e8_e6a0_4274_be9a_24c45d5b1496.slice" pod="openstack-kuttl-tests/memcached-0" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" Nov 21 13:27:57 crc kubenswrapper[4769]: I1121 13:27:57.564647 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pode8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pode8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9] : Timed out while waiting for systemd to remove kubepods-besteffort-pode8fe2dd1_6fb5_4120_9258_a0e3f4dfdaa9.slice" Nov 21 13:27:57 crc kubenswrapper[4769]: E1121 13:27:57.564696 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pode8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9] : unable to destroy cgroup paths for cgroup [kubepods besteffort pode8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9] : Timed out while waiting for systemd to remove kubepods-besteffort-pode8fe2dd1_6fb5_4120_9258_a0e3f4dfdaa9.slice" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" Nov 21 13:27:57 crc kubenswrapper[4769]: I1121 13:27:57.864596 4769 scope.go:117] "RemoveContainer" containerID="2ef027f91ee44e18b5f40fcd0a6e3775ad68549c3902ed8998451eed515855cc" Nov 21 13:27:58 crc kubenswrapper[4769]: I1121 13:27:58.009169 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Nov 21 13:27:58 crc kubenswrapper[4769]: I1121 13:27:58.009257 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Nov 21 13:27:58 crc kubenswrapper[4769]: I1121 13:27:58.045377 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:27:58 crc kubenswrapper[4769]: I1121 13:27:58.052712 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Nov 21 13:27:58 crc kubenswrapper[4769]: I1121 13:27:58.061004 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:27:58 crc kubenswrapper[4769]: I1121 13:27:58.067463 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Nov 21 13:27:59 crc kubenswrapper[4769]: I1121 13:27:59.286043 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" path="/var/lib/kubelet/pods/00d977e8-e6a0-4274-be9a-24c45d5b1496/volumes" Nov 21 13:27:59 crc kubenswrapper[4769]: I1121 13:27:59.286949 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" path="/var/lib/kubelet/pods/e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9/volumes" Nov 21 13:28:00 crc kubenswrapper[4769]: I1121 13:28:00.348016 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod8389f7ff-450d-41b9-88eb-c7c2929deccc"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod8389f7ff-450d-41b9-88eb-c7c2929deccc] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8389f7ff_450d_41b9_88eb_c7c2929deccc.slice" Nov 21 13:28:00 crc kubenswrapper[4769]: E1121 13:28:00.348461 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod8389f7ff-450d-41b9-88eb-c7c2929deccc] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod8389f7ff-450d-41b9-88eb-c7c2929deccc] : Timed out while waiting for systemd to remove kubepods-besteffort-pod8389f7ff_450d_41b9_88eb_c7c2929deccc.slice" pod="openstack-kuttl-tests/ceilometer-0" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" Nov 21 13:28:00 crc kubenswrapper[4769]: I1121 13:28:00.359874 4769 pod_container_manager_linux.go:210] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod6c0d96de-e234-4e3c-9db1-882b35918e73"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod6c0d96de-e234-4e3c-9db1-882b35918e73] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6c0d96de_e234_4e3c_9db1_882b35918e73.slice" Nov 21 13:28:00 crc kubenswrapper[4769]: E1121 13:28:00.359933 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod6c0d96de-e234-4e3c-9db1-882b35918e73] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod6c0d96de-e234-4e3c-9db1-882b35918e73] : Timed out while waiting for systemd to remove kubepods-besteffort-pod6c0d96de_e234_4e3c_9db1_882b35918e73.slice" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.038226 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.038649 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7f8594c87b-2g9gp" Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.062498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7f8594c87b-2g9gp"] Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.076847 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7f8594c87b-2g9gp"] Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.083318 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.089444 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.286996 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" path="/var/lib/kubelet/pods/6c0d96de-e234-4e3c-9db1-882b35918e73/volumes" Nov 21 13:28:01 crc kubenswrapper[4769]: I1121 13:28:01.287998 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" path="/var/lib/kubelet/pods/8389f7ff-450d-41b9-88eb-c7c2929deccc/volumes" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.334448 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-z6cbg"] Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.341665 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-z6cbg"] Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.483563 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-pz9rx"] Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.483974 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="rabbitmq" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.483992 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="rabbitmq" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484011 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484021 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484046 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484056 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484073 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484083 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484096 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484107 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484121 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-reaper" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484132 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-reaper" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484149 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="setup-container" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484158 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="setup-container" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484169 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484178 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484229 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484240 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484256 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-updater" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484267 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-updater" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484282 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-notification-agent" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484293 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-notification-agent" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484313 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="sg-core" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484324 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="sg-core" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484369 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484380 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484395 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="ovsdbserver-sb" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484404 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="ovsdbserver-sb" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484417 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="rabbitmq" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484426 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="rabbitmq" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484441 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="rsync" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484452 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="rsync" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="galera" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484476 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="galera" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484485 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484494 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-server" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484512 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" containerName="kube-state-metrics" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484524 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" containerName="kube-state-metrics" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484542 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484552 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-api" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484565 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484587 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-updater" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484596 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-updater" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484608 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484619 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484629 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484639 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484657 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484666 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484911 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484926 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-server" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484957 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484969 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.484987 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.484997 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485016 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="ovsdbserver-nb" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485048 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="ovsdbserver-nb" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485071 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-server" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485081 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485090 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485108 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485119 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485130 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485138 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485149 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1243748f-cba6-409e-8765-467b40e04ba7" containerName="mysql-bootstrap" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1243748f-cba6-409e-8765-467b40e04ba7" containerName="mysql-bootstrap" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485175 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485205 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485216 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-api" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485226 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485234 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485248 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="setup-container" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485256 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="setup-container" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485267 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="mysql-bootstrap" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485276 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="mysql-bootstrap" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485291 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1243748f-cba6-409e-8765-467b40e04ba7" containerName="galera" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485300 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1243748f-cba6-409e-8765-467b40e04ba7" containerName="galera" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485319 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485336 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" containerName="memcached" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485344 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" containerName="memcached" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485360 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485368 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485379 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="swift-recon-cron" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485387 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="swift-recon-cron" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485396 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="probe" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485404 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="probe" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485417 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="ovn-northd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485426 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="ovn-northd" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485438 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="proxy-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485456 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="proxy-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485474 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485485 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485501 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485509 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485522 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485531 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485547 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485569 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485589 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485596 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485614 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485622 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485633 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fdf41518-0738-4701-9482-fe17d9be8abf" containerName="nova-scheduler-scheduler" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485641 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf41518-0738-4701-9482-fe17d9be8abf" containerName="nova-scheduler-scheduler" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485652 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="registry-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485660 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="registry-server" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485677 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485684 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485698 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="extract-content" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485707 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="extract-content" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485718 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="cinder-scheduler" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485727 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="cinder-scheduler" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485738 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerName="dnsmasq-dns" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485746 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerName="dnsmasq-dns" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485760 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-expirer" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485768 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-expirer" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485781 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="extract-utilities" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485789 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="extract-utilities" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485799 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485807 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485840 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" containerName="nova-cell1-conductor-conductor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485849 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" containerName="nova-cell1-conductor-conductor" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485860 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485868 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485878 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485887 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-api" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485901 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485908 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-server" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485921 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485929 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485941 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485958 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485966 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.485979 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" containerName="keystone-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.485988 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" containerName="keystone-api" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486002 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486010 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486023 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486031 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486041 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-central-agent" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486048 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-central-agent" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486081 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486100 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486108 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486123 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerName="init" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486132 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerName="init" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486146 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486156 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486165 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerName="nova-cell0-conductor-conductor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486174 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerName="nova-cell0-conductor-conductor" Nov 21 13:28:03 crc kubenswrapper[4769]: E1121 13:28:03.486211 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486219 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486398 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="00d977e8-e6a0-4274-be9a-24c45d5b1496" containerName="memcached" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486418 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486440 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-updater" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486460 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486470 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="sg-core" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486486 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486504 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486521 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-central-agent" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486531 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486542 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f76c87ba-5d40-4b61-a44a-7b8c895507d8" containerName="rabbitmq" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486558 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486586 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486605 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="proxy-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486618 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc15cbd1-7c64-4f95-b7ed-2090167ce968" containerName="placement-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486629 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fdf41518-0738-4701-9482-fe17d9be8abf" containerName="nova-scheduler-scheduler" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486642 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486656 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486669 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486681 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="083c8f14-c35e-4d60-91ef-9881dc7ad8c3" containerName="barbican-worker-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486692 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486700 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486710 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486719 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-metadata" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486734 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486750 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486773 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486789 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0380fc82-b08b-4e96-a26d-d06c67417449" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486804 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="rsync" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486813 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="cinder-scheduler" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486826 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486835 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486847 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7ce1f400-1f9f-4ab6-8ac9-ea5d0615fd7f" containerName="cinder-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486857 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486865 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64ba6619-1b2b-4a3e-8605-cdc296f28855" containerName="barbican-keystone-listener-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486879 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee855a9c-b038-4a02-bca3-32d7fc3f321f" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486888 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="ovsdbserver-nb" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486897 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-updater" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486905 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="76618b5e-2d20-420a-a18c-5c6c1da97b94" containerName="nova-cell0-conductor-conductor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486920 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486930 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486946 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="90a092e1-717f-4c7a-9740-89b57b690e43" containerName="registry-server" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486957 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486967 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93f0d766-9895-4c18-9a55-b670336879a5" containerName="glance-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486974 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="36fbd548-442c-4365-bda7-12f523a7c3e5" containerName="dnsmasq-dns" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.486989 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e8fe2dd1-6fb5-4120-9258-a0e3f4dfdaa9" containerName="kube-state-metrics" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487004 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487015 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="00ca8158-c10b-4e37-b666-6610ba3113f2" containerName="probe" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487029 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c0d96de-e234-4e3c-9db1-882b35918e73" containerName="keystone-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487043 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487057 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7782b46-8d2b-49c2-ba34-423e6eb6e6cd" containerName="nova-cell1-conductor-conductor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487066 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487075 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1d4eed1d-bce3-4f26-a240-956b705062da" containerName="nova-metadata-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487086 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2d6fd3d6-d129-40ae-8db7-be0e04466950" containerName="openstack-network-exporter" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487099 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-auditor" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487111 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b51a88b8-9feb-448a-89c2-93800a854081" containerName="rabbitmq" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487121 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1243748f-cba6-409e-8765-467b40e04ba7" containerName="galera" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487131 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed1d317a-289c-469d-98ae-789dd3230e4a" containerName="galera" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487141 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="account-reaper" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487156 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="swift-recon-cron" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487168 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d949ccd-2ecb-4d79-b7a5-200c5aeaefee" containerName="barbican-api-log" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487177 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487186 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="604926b7-fdf2-4dc6-9a15-2160c9feff0c" containerName="ovn-northd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487279 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b46b5eff-f711-418b-b9de-54a5a91821af" containerName="mariadb-account-delete" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487293 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2aa088d3-53a0-4016-87ac-59358c5b2d35" containerName="proxy-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487307 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8389f7ff-450d-41b9-88eb-c7c2929deccc" containerName="ceilometer-notification-agent" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487323 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f75bf156-e338-42b1-959d-83c46d7a4a6e" containerName="glance-httpd" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487332 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="container-replicator" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487348 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="222390bc-4c6c-4f69-b753-5f190e15bb6d" containerName="neutron-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487360 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ece80665-fef3-4d5e-a84e-e853f5725be7" containerName="nova-api-api" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487369 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="024d7eeb-986d-4113-9ed3-956c3ca2f600" containerName="ovsdbserver-sb" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487377 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="de29f094-3b0a-4c67-a75e-8d50a59945a9" containerName="object-expirer" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.487386 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="baec736c-d0fb-4b1a-9c7f-14e3a275807c" containerName="nova-cell1-novncproxy-novncproxy" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.488005 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.490698 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.490865 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.491080 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.491093 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.494558 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-pz9rx"] Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.588570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gs7\" (UniqueName: \"kubernetes.io/projected/47264153-2b35-4e40-8655-0ec94b5b786d-kube-api-access-85gs7\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.588675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/47264153-2b35-4e40-8655-0ec94b5b786d-node-mnt\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.588767 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/47264153-2b35-4e40-8655-0ec94b5b786d-crc-storage\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.690324 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-85gs7\" (UniqueName: \"kubernetes.io/projected/47264153-2b35-4e40-8655-0ec94b5b786d-kube-api-access-85gs7\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.690402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/47264153-2b35-4e40-8655-0ec94b5b786d-node-mnt\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.690468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/47264153-2b35-4e40-8655-0ec94b5b786d-crc-storage\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.690862 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/47264153-2b35-4e40-8655-0ec94b5b786d-node-mnt\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.691647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/47264153-2b35-4e40-8655-0ec94b5b786d-crc-storage\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.708558 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gs7\" (UniqueName: \"kubernetes.io/projected/47264153-2b35-4e40-8655-0ec94b5b786d-kube-api-access-85gs7\") pod \"crc-storage-crc-pz9rx\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:03 crc kubenswrapper[4769]: I1121 13:28:03.811472 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:04 crc kubenswrapper[4769]: I1121 13:28:04.225708 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-pz9rx"] Nov 21 13:28:05 crc kubenswrapper[4769]: I1121 13:28:05.091606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-pz9rx" event={"ID":"47264153-2b35-4e40-8655-0ec94b5b786d","Type":"ContainerStarted","Data":"fd10adfec2ecfa45c66d45273d5da8ae1edd423bd10adf87ad2325189fa7e73c"} Nov 21 13:28:05 crc kubenswrapper[4769]: I1121 13:28:05.291640 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b6d57d-d109-4e91-ae95-18105181c349" path="/var/lib/kubelet/pods/d4b6d57d-d109-4e91-ae95-18105181c349/volumes" Nov 21 13:28:07 crc kubenswrapper[4769]: I1121 13:28:07.114612 4769 generic.go:334] "Generic (PLEG): container finished" podID="47264153-2b35-4e40-8655-0ec94b5b786d" containerID="eb41c6cdf5a0472a7319895ab05cd6f0504174447df1eebe5547b6d76cb2ed33" exitCode=0 Nov 21 13:28:07 crc kubenswrapper[4769]: I1121 13:28:07.114691 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-pz9rx" event={"ID":"47264153-2b35-4e40-8655-0ec94b5b786d","Type":"ContainerDied","Data":"eb41c6cdf5a0472a7319895ab05cd6f0504174447df1eebe5547b6d76cb2ed33"} Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.422980 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.565520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/47264153-2b35-4e40-8655-0ec94b5b786d-crc-storage\") pod \"47264153-2b35-4e40-8655-0ec94b5b786d\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.565602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85gs7\" (UniqueName: \"kubernetes.io/projected/47264153-2b35-4e40-8655-0ec94b5b786d-kube-api-access-85gs7\") pod \"47264153-2b35-4e40-8655-0ec94b5b786d\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.565704 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/47264153-2b35-4e40-8655-0ec94b5b786d-node-mnt\") pod \"47264153-2b35-4e40-8655-0ec94b5b786d\" (UID: \"47264153-2b35-4e40-8655-0ec94b5b786d\") " Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.565845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/47264153-2b35-4e40-8655-0ec94b5b786d-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "47264153-2b35-4e40-8655-0ec94b5b786d" (UID: "47264153-2b35-4e40-8655-0ec94b5b786d"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.565997 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/47264153-2b35-4e40-8655-0ec94b5b786d-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.570429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47264153-2b35-4e40-8655-0ec94b5b786d-kube-api-access-85gs7" (OuterVolumeSpecName: "kube-api-access-85gs7") pod "47264153-2b35-4e40-8655-0ec94b5b786d" (UID: "47264153-2b35-4e40-8655-0ec94b5b786d"). InnerVolumeSpecName "kube-api-access-85gs7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.584404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47264153-2b35-4e40-8655-0ec94b5b786d-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "47264153-2b35-4e40-8655-0ec94b5b786d" (UID: "47264153-2b35-4e40-8655-0ec94b5b786d"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.668233 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/47264153-2b35-4e40-8655-0ec94b5b786d-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:08 crc kubenswrapper[4769]: I1121 13:28:08.668292 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-85gs7\" (UniqueName: \"kubernetes.io/projected/47264153-2b35-4e40-8655-0ec94b5b786d-kube-api-access-85gs7\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:09 crc kubenswrapper[4769]: I1121 13:28:09.138282 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-pz9rx" event={"ID":"47264153-2b35-4e40-8655-0ec94b5b786d","Type":"ContainerDied","Data":"fd10adfec2ecfa45c66d45273d5da8ae1edd423bd10adf87ad2325189fa7e73c"} Nov 21 13:28:09 crc kubenswrapper[4769]: I1121 13:28:09.138627 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd10adfec2ecfa45c66d45273d5da8ae1edd423bd10adf87ad2325189fa7e73c" Nov 21 13:28:09 crc kubenswrapper[4769]: I1121 13:28:09.138324 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-pz9rx" Nov 21 13:28:11 crc kubenswrapper[4769]: I1121 13:28:11.325534 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:28:11 crc kubenswrapper[4769]: I1121 13:28:11.325609 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:28:11 crc kubenswrapper[4769]: I1121 13:28:11.325669 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:28:11 crc kubenswrapper[4769]: I1121 13:28:11.326372 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:28:11 crc kubenswrapper[4769]: I1121 13:28:11.326466 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" gracePeriod=600 Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.179552 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" exitCode=0 Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.179684 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6"} Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.180110 4769 scope.go:117] "RemoveContainer" containerID="7ff5c9c12aa9f3f80f599745cb886ae54831b6420ebf341781639b968520a396" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.325405 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-pz9rx"] Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.337041 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-pz9rx"] Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.468777 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-mbfzl"] Nov 21 13:28:12 crc kubenswrapper[4769]: E1121 13:28:12.469113 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerName="mariadb-account-delete" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469126 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerName="mariadb-account-delete" Nov 21 13:28:12 crc kubenswrapper[4769]: E1121 13:28:12.469141 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="47264153-2b35-4e40-8655-0ec94b5b786d" containerName="storage" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469147 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="47264153-2b35-4e40-8655-0ec94b5b786d" containerName="storage" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469296 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5d95dea2-4e74-42eb-b7a0-cf3093c486da" containerName="mariadb-account-delete" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469310 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dffd7c05-86ef-4d65-8ace-49a5cbc0cd9d" containerName="mariadb-account-delete" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469321 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a55ce728-ef0d-492c-9c68-31f2139f4734" containerName="mariadb-account-delete" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469334 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac1d3aa2-0067-423a-ad55-820d9dde22f4" containerName="mariadb-account-delete" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469348 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="47264153-2b35-4e40-8655-0ec94b5b786d" containerName="storage" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.469814 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.476824 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.476977 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.477007 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.476988 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.483240 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-mbfzl"] Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.530844 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7679e358-002a-407d-9c1f-1b732394d9db-crc-storage\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.530962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxw2k\" (UniqueName: \"kubernetes.io/projected/7679e358-002a-407d-9c1f-1b732394d9db-kube-api-access-dxw2k\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.531035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7679e358-002a-407d-9c1f-1b732394d9db-node-mnt\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.632287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7679e358-002a-407d-9c1f-1b732394d9db-crc-storage\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.632404 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dxw2k\" (UniqueName: \"kubernetes.io/projected/7679e358-002a-407d-9c1f-1b732394d9db-kube-api-access-dxw2k\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.632476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7679e358-002a-407d-9c1f-1b732394d9db-node-mnt\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.632777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7679e358-002a-407d-9c1f-1b732394d9db-node-mnt\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.633874 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7679e358-002a-407d-9c1f-1b732394d9db-crc-storage\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.661970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxw2k\" (UniqueName: \"kubernetes.io/projected/7679e358-002a-407d-9c1f-1b732394d9db-kube-api-access-dxw2k\") pod \"crc-storage-crc-mbfzl\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:12 crc kubenswrapper[4769]: E1121 13:28:12.759761 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:28:12 crc kubenswrapper[4769]: I1121 13:28:12.789458 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:13 crc kubenswrapper[4769]: I1121 13:28:13.191462 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:28:13 crc kubenswrapper[4769]: E1121 13:28:13.192084 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:28:13 crc kubenswrapper[4769]: I1121 13:28:13.218414 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-mbfzl"] Nov 21 13:28:13 crc kubenswrapper[4769]: I1121 13:28:13.285790 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47264153-2b35-4e40-8655-0ec94b5b786d" path="/var/lib/kubelet/pods/47264153-2b35-4e40-8655-0ec94b5b786d/volumes" Nov 21 13:28:14 crc kubenswrapper[4769]: I1121 13:28:14.201500 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mbfzl" event={"ID":"7679e358-002a-407d-9c1f-1b732394d9db","Type":"ContainerStarted","Data":"f46fdacc4cc515f63929e926c9643db4f0e56233212449af6a305d175b622c6c"} Nov 21 13:28:14 crc kubenswrapper[4769]: E1121 13:28:14.737609 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7679e358_002a_407d_9c1f_1b732394d9db.slice/crio-conmon-332caff11cee0039f7000ddb6823664f18e0c32e29e1a58f50ac5b42e7b6fcc6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7679e358_002a_407d_9c1f_1b732394d9db.slice/crio-332caff11cee0039f7000ddb6823664f18e0c32e29e1a58f50ac5b42e7b6fcc6.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:28:15 crc kubenswrapper[4769]: I1121 13:28:15.224995 4769 generic.go:334] "Generic (PLEG): container finished" podID="7679e358-002a-407d-9c1f-1b732394d9db" containerID="332caff11cee0039f7000ddb6823664f18e0c32e29e1a58f50ac5b42e7b6fcc6" exitCode=0 Nov 21 13:28:15 crc kubenswrapper[4769]: I1121 13:28:15.225101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mbfzl" event={"ID":"7679e358-002a-407d-9c1f-1b732394d9db","Type":"ContainerDied","Data":"332caff11cee0039f7000ddb6823664f18e0c32e29e1a58f50ac5b42e7b6fcc6"} Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.511765 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.595769 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7679e358-002a-407d-9c1f-1b732394d9db-node-mnt\") pod \"7679e358-002a-407d-9c1f-1b732394d9db\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.595865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7679e358-002a-407d-9c1f-1b732394d9db-crc-storage\") pod \"7679e358-002a-407d-9c1f-1b732394d9db\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.595948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxw2k\" (UniqueName: \"kubernetes.io/projected/7679e358-002a-407d-9c1f-1b732394d9db-kube-api-access-dxw2k\") pod \"7679e358-002a-407d-9c1f-1b732394d9db\" (UID: \"7679e358-002a-407d-9c1f-1b732394d9db\") " Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.595997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7679e358-002a-407d-9c1f-1b732394d9db-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "7679e358-002a-407d-9c1f-1b732394d9db" (UID: "7679e358-002a-407d-9c1f-1b732394d9db"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.597141 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/7679e358-002a-407d-9c1f-1b732394d9db-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.601400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7679e358-002a-407d-9c1f-1b732394d9db-kube-api-access-dxw2k" (OuterVolumeSpecName: "kube-api-access-dxw2k") pod "7679e358-002a-407d-9c1f-1b732394d9db" (UID: "7679e358-002a-407d-9c1f-1b732394d9db"). InnerVolumeSpecName "kube-api-access-dxw2k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.615082 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7679e358-002a-407d-9c1f-1b732394d9db-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "7679e358-002a-407d-9c1f-1b732394d9db" (UID: "7679e358-002a-407d-9c1f-1b732394d9db"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.699583 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/7679e358-002a-407d-9c1f-1b732394d9db-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:16 crc kubenswrapper[4769]: I1121 13:28:16.699659 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dxw2k\" (UniqueName: \"kubernetes.io/projected/7679e358-002a-407d-9c1f-1b732394d9db-kube-api-access-dxw2k\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:17 crc kubenswrapper[4769]: I1121 13:28:17.244144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mbfzl" event={"ID":"7679e358-002a-407d-9c1f-1b732394d9db","Type":"ContainerDied","Data":"f46fdacc4cc515f63929e926c9643db4f0e56233212449af6a305d175b622c6c"} Nov 21 13:28:17 crc kubenswrapper[4769]: I1121 13:28:17.244241 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f46fdacc4cc515f63929e926c9643db4f0e56233212449af6a305d175b622c6c" Nov 21 13:28:17 crc kubenswrapper[4769]: I1121 13:28:17.244243 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mbfzl" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.175488 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw"] Nov 21 13:28:21 crc kubenswrapper[4769]: E1121 13:28:21.176208 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7679e358-002a-407d-9c1f-1b732394d9db" containerName="storage" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.176227 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7679e358-002a-407d-9c1f-1b732394d9db" containerName="storage" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.176424 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7679e358-002a-407d-9c1f-1b732394d9db" containerName="storage" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.177590 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.179735 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-edpm-ipam" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.188155 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw"] Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.264535 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwl4l\" (UniqueName: \"kubernetes.io/projected/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-kube-api-access-mwl4l\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.264609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.264760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.264848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-config\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.283440 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw"] Nov 21 13:28:21 crc kubenswrapper[4769]: E1121 13:28:21.283920 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc kube-api-access-mwl4l openstack-edpm-ipam], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" podUID="dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.311862 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf"] Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.313706 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.322229 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf"] Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-config\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-config\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4l42\" (UniqueName: \"kubernetes.io/projected/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-kube-api-access-c4l42\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mwl4l\" (UniqueName: \"kubernetes.io/projected/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-kube-api-access-mwl4l\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.366917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.367783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.367805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.367939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-config\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.383686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwl4l\" (UniqueName: \"kubernetes.io/projected/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-kube-api-access-mwl4l\") pod \"dnsmasq-dnsmasq-5b68c79f89-vggkw\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.468704 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.469045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-config\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.469248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.469372 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c4l42\" (UniqueName: \"kubernetes.io/projected/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-kube-api-access-c4l42\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.470172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-openstack-edpm-ipam\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.470662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.471419 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-config\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.485436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4l42\" (UniqueName: \"kubernetes.io/projected/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-kube-api-access-c4l42\") pod \"dnsmasq-dnsmasq-79667f9c49-kzgjf\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:21 crc kubenswrapper[4769]: I1121 13:28:21.627677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.061510 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf"] Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.297429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.297468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" event={"ID":"ba6c9f12-a25e-4e3c-8f61-e28ba352195b","Type":"ContainerStarted","Data":"70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a"} Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.297940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" event={"ID":"ba6c9f12-a25e-4e3c-8f61-e28ba352195b","Type":"ContainerStarted","Data":"7921e700d6ecd092d80537fa7e420439a273e56fe45b1fd595caad2a46d2b37f"} Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.358457 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.485595 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwl4l\" (UniqueName: \"kubernetes.io/projected/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-kube-api-access-mwl4l\") pod \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.485687 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-config\") pod \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.485770 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-openstack-edpm-ipam\") pod \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.485816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-dnsmasq-svc\") pod \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\" (UID: \"dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c\") " Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.486475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-config" (OuterVolumeSpecName: "config") pod "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c" (UID: "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.486640 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-openstack-edpm-ipam" (OuterVolumeSpecName: "openstack-edpm-ipam") pod "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c" (UID: "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c"). InnerVolumeSpecName "openstack-edpm-ipam". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.486731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c" (UID: "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.489058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-kube-api-access-mwl4l" (OuterVolumeSpecName: "kube-api-access-mwl4l") pod "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c" (UID: "dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c"). InnerVolumeSpecName "kube-api-access-mwl4l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.588034 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.588095 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mwl4l\" (UniqueName: \"kubernetes.io/projected/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-kube-api-access-mwl4l\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.588114 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:22 crc kubenswrapper[4769]: I1121 13:28:22.588126 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c-openstack-edpm-ipam\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.312163 4769 generic.go:334] "Generic (PLEG): container finished" podID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerID="70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a" exitCode=0 Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.312630 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw" Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.312335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" event={"ID":"ba6c9f12-a25e-4e3c-8f61-e28ba352195b","Type":"ContainerDied","Data":"70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a"} Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.314984 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.315029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" event={"ID":"ba6c9f12-a25e-4e3c-8f61-e28ba352195b","Type":"ContainerStarted","Data":"7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82"} Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.351485 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" podStartSLOduration=2.351464216 podStartE2EDuration="2.351464216s" podCreationTimestamp="2025-11-21 13:28:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:28:23.341601788 +0000 UTC m=+5862.042263626" watchObservedRunningTime="2025-11-21 13:28:23.351464216 +0000 UTC m=+5862.052126054" Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.391093 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw"] Nov 21 13:28:23 crc kubenswrapper[4769]: I1121 13:28:23.402294 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5b68c79f89-vggkw"] Nov 21 13:28:25 crc kubenswrapper[4769]: I1121 13:28:25.274895 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:28:25 crc kubenswrapper[4769]: E1121 13:28:25.275882 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:28:25 crc kubenswrapper[4769]: I1121 13:28:25.286545 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c" path="/var/lib/kubelet/pods/dad2f683-b8dd-45e6-9ce2-8cc1dd7aa35c/volumes" Nov 21 13:28:31 crc kubenswrapper[4769]: I1121 13:28:31.629523 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:31 crc kubenswrapper[4769]: I1121 13:28:31.678894 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk"] Nov 21 13:28:31 crc kubenswrapper[4769]: I1121 13:28:31.679172 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerName="dnsmasq-dns" containerID="cri-o://bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6" gracePeriod=10 Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.085808 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.139414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-dnsmasq-svc\") pod \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.139486 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrfx5\" (UniqueName: \"kubernetes.io/projected/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-kube-api-access-lrfx5\") pod \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.139959 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-config\") pod \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\" (UID: \"b5ae4ec3-5987-4a40-a7af-5f243c1eef60\") " Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.145463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-kube-api-access-lrfx5" (OuterVolumeSpecName: "kube-api-access-lrfx5") pod "b5ae4ec3-5987-4a40-a7af-5f243c1eef60" (UID: "b5ae4ec3-5987-4a40-a7af-5f243c1eef60"). InnerVolumeSpecName "kube-api-access-lrfx5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.178170 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "b5ae4ec3-5987-4a40-a7af-5f243c1eef60" (UID: "b5ae4ec3-5987-4a40-a7af-5f243c1eef60"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.185400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-config" (OuterVolumeSpecName: "config") pod "b5ae4ec3-5987-4a40-a7af-5f243c1eef60" (UID: "b5ae4ec3-5987-4a40-a7af-5f243c1eef60"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.241755 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.241795 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.241807 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lrfx5\" (UniqueName: \"kubernetes.io/projected/b5ae4ec3-5987-4a40-a7af-5f243c1eef60-kube-api-access-lrfx5\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.422721 4769 generic.go:334] "Generic (PLEG): container finished" podID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerID="bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6" exitCode=0 Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.422773 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" event={"ID":"b5ae4ec3-5987-4a40-a7af-5f243c1eef60","Type":"ContainerDied","Data":"bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6"} Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.422802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" event={"ID":"b5ae4ec3-5987-4a40-a7af-5f243c1eef60","Type":"ContainerDied","Data":"2683e845f5b2c7801bc52d9d36d188373e8daf73ed98f715c76c06cd91a25f4b"} Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.422812 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.422825 4769 scope.go:117] "RemoveContainer" containerID="bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.448009 4769 scope.go:117] "RemoveContainer" containerID="ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.474702 4769 scope.go:117] "RemoveContainer" containerID="bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.474887 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk"] Nov 21 13:28:32 crc kubenswrapper[4769]: E1121 13:28:32.475119 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6\": container with ID starting with bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6 not found: ID does not exist" containerID="bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.475151 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6"} err="failed to get container status \"bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6\": rpc error: code = NotFound desc = could not find container \"bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6\": container with ID starting with bbfa58cbcc30923caf99af55b2cdacc1a86119937edf32466c285b600aaf7ca6 not found: ID does not exist" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.475171 4769 scope.go:117] "RemoveContainer" containerID="ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e" Nov 21 13:28:32 crc kubenswrapper[4769]: E1121 13:28:32.475690 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e\": container with ID starting with ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e not found: ID does not exist" containerID="ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.475752 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e"} err="failed to get container status \"ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e\": rpc error: code = NotFound desc = could not find container \"ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e\": container with ID starting with ba80f28a19510d2625edd2520d31ab6f67ec5ab127439edcec83cbb22228739e not found: ID does not exist" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.484872 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-v4dxk"] Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.571899 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm"] Nov 21 13:28:32 crc kubenswrapper[4769]: E1121 13:28:32.572290 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerName="init" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.572311 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerName="init" Nov 21 13:28:32 crc kubenswrapper[4769]: E1121 13:28:32.572345 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerName="dnsmasq-dns" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.572354 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerName="dnsmasq-dns" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.572523 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" containerName="dnsmasq-dns" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.573464 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.586267 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm"] Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.647422 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.647792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp992\" (UniqueName: \"kubernetes.io/projected/1fe76423-c70c-457f-99c0-b21afb9525cf-kube-api-access-xp992\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.647875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.749667 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.749724 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xp992\" (UniqueName: \"kubernetes.io/projected/1fe76423-c70c-457f-99c0-b21afb9525cf-kube-api-access-xp992\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.749782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.750759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.750791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.765718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp992\" (UniqueName: \"kubernetes.io/projected/1fe76423-c70c-457f-99c0-b21afb9525cf-kube-api-access-xp992\") pod \"dnsmasq-dnsmasq-84b9f45d47-84hdm\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:32 crc kubenswrapper[4769]: I1121 13:28:32.923706 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:33 crc kubenswrapper[4769]: I1121 13:28:33.285923 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ae4ec3-5987-4a40-a7af-5f243c1eef60" path="/var/lib/kubelet/pods/b5ae4ec3-5987-4a40-a7af-5f243c1eef60/volumes" Nov 21 13:28:33 crc kubenswrapper[4769]: I1121 13:28:33.368791 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm"] Nov 21 13:28:33 crc kubenswrapper[4769]: W1121 13:28:33.398287 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fe76423_c70c_457f_99c0_b21afb9525cf.slice/crio-88082339bac7536e770f7a3f84c14f377aeb10db1407aa35492b8d6c05be73e4 WatchSource:0}: Error finding container 88082339bac7536e770f7a3f84c14f377aeb10db1407aa35492b8d6c05be73e4: Status 404 returned error can't find the container with id 88082339bac7536e770f7a3f84c14f377aeb10db1407aa35492b8d6c05be73e4 Nov 21 13:28:33 crc kubenswrapper[4769]: I1121 13:28:33.434076 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" event={"ID":"1fe76423-c70c-457f-99c0-b21afb9525cf","Type":"ContainerStarted","Data":"88082339bac7536e770f7a3f84c14f377aeb10db1407aa35492b8d6c05be73e4"} Nov 21 13:28:34 crc kubenswrapper[4769]: I1121 13:28:34.455695 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerID="43678ca198425aa36f4d407834707ea601942ae3e565a4d3932ef15192b65755" exitCode=0 Nov 21 13:28:34 crc kubenswrapper[4769]: I1121 13:28:34.456125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" event={"ID":"1fe76423-c70c-457f-99c0-b21afb9525cf","Type":"ContainerDied","Data":"43678ca198425aa36f4d407834707ea601942ae3e565a4d3932ef15192b65755"} Nov 21 13:28:35 crc kubenswrapper[4769]: I1121 13:28:35.475094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" event={"ID":"1fe76423-c70c-457f-99c0-b21afb9525cf","Type":"ContainerStarted","Data":"3b563188780ca69d88faab0547f9cd15c760c329fc43154fe4f8611ff69aed8c"} Nov 21 13:28:35 crc kubenswrapper[4769]: I1121 13:28:35.475656 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:35 crc kubenswrapper[4769]: I1121 13:28:35.503489 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" podStartSLOduration=3.503461126 podStartE2EDuration="3.503461126s" podCreationTimestamp="2025-11-21 13:28:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:28:35.500106618 +0000 UTC m=+5874.200768466" watchObservedRunningTime="2025-11-21 13:28:35.503461126 +0000 UTC m=+5874.204122974" Nov 21 13:28:40 crc kubenswrapper[4769]: I1121 13:28:40.275087 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:28:40 crc kubenswrapper[4769]: E1121 13:28:40.276294 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.150921 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-mbfzl"] Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.161719 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-mbfzl"] Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.283119 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7679e358-002a-407d-9c1f-1b732394d9db" path="/var/lib/kubelet/pods/7679e358-002a-407d-9c1f-1b732394d9db/volumes" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.290681 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-v8lmv"] Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.291918 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.295481 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.295554 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.295583 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.296042 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.305591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-v8lmv"] Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.406510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/053ad8fe-b078-4163-93c8-304012f87cca-crc-storage\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.407340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/053ad8fe-b078-4163-93c8-304012f87cca-node-mnt\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.407734 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zwlp\" (UniqueName: \"kubernetes.io/projected/053ad8fe-b078-4163-93c8-304012f87cca-kube-api-access-5zwlp\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.509281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5zwlp\" (UniqueName: \"kubernetes.io/projected/053ad8fe-b078-4163-93c8-304012f87cca-kube-api-access-5zwlp\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.509352 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/053ad8fe-b078-4163-93c8-304012f87cca-crc-storage\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.509379 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/053ad8fe-b078-4163-93c8-304012f87cca-node-mnt\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.509774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/053ad8fe-b078-4163-93c8-304012f87cca-node-mnt\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.510397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/053ad8fe-b078-4163-93c8-304012f87cca-crc-storage\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.527636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zwlp\" (UniqueName: \"kubernetes.io/projected/053ad8fe-b078-4163-93c8-304012f87cca-kube-api-access-5zwlp\") pod \"crc-storage-crc-v8lmv\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.621150 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:41 crc kubenswrapper[4769]: I1121 13:28:41.867470 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-v8lmv"] Nov 21 13:28:42 crc kubenswrapper[4769]: I1121 13:28:42.549629 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-v8lmv" event={"ID":"053ad8fe-b078-4163-93c8-304012f87cca","Type":"ContainerStarted","Data":"1e98dd5e86de87799cee27010f76eba1ba19abf0379ceff908bc471876908276"} Nov 21 13:28:42 crc kubenswrapper[4769]: I1121 13:28:42.926522 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.027879 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf"] Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.028732 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerName="dnsmasq-dns" containerID="cri-o://7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82" gracePeriod=10 Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.562563 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.565895 4769 generic.go:334] "Generic (PLEG): container finished" podID="053ad8fe-b078-4163-93c8-304012f87cca" containerID="13e51de4ffd038089fdfc7207028ed9bcb7f3f7071e60c382ca4448b04e6d86c" exitCode=0 Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.566011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-v8lmv" event={"ID":"053ad8fe-b078-4163-93c8-304012f87cca","Type":"ContainerDied","Data":"13e51de4ffd038089fdfc7207028ed9bcb7f3f7071e60c382ca4448b04e6d86c"} Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.569328 4769 generic.go:334] "Generic (PLEG): container finished" podID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerID="7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82" exitCode=0 Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.569363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" event={"ID":"ba6c9f12-a25e-4e3c-8f61-e28ba352195b","Type":"ContainerDied","Data":"7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82"} Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.569386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" event={"ID":"ba6c9f12-a25e-4e3c-8f61-e28ba352195b","Type":"ContainerDied","Data":"7921e700d6ecd092d80537fa7e420439a273e56fe45b1fd595caad2a46d2b37f"} Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.569404 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.569407 4769 scope.go:117] "RemoveContainer" containerID="7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.618871 4769 scope.go:117] "RemoveContainer" containerID="70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.655468 4769 scope.go:117] "RemoveContainer" containerID="7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82" Nov 21 13:28:43 crc kubenswrapper[4769]: E1121 13:28:43.656022 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82\": container with ID starting with 7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82 not found: ID does not exist" containerID="7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.656160 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82"} err="failed to get container status \"7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82\": rpc error: code = NotFound desc = could not find container \"7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82\": container with ID starting with 7215f16e8a811a14d3a6324ec76dcfe1171271197f2daac7754afaaf46babd82 not found: ID does not exist" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.656318 4769 scope.go:117] "RemoveContainer" containerID="70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a" Nov 21 13:28:43 crc kubenswrapper[4769]: E1121 13:28:43.656696 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a\": container with ID starting with 70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a not found: ID does not exist" containerID="70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.656727 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a"} err="failed to get container status \"70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a\": rpc error: code = NotFound desc = could not find container \"70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a\": container with ID starting with 70c19b9b065624f117773e905b7b65c92c2d604736db50bf2e43a289c913503a not found: ID does not exist" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.658397 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-openstack-edpm-ipam\") pod \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.658491 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-dnsmasq-svc\") pod \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.658547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-config\") pod \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.658576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4l42\" (UniqueName: \"kubernetes.io/projected/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-kube-api-access-c4l42\") pod \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\" (UID: \"ba6c9f12-a25e-4e3c-8f61-e28ba352195b\") " Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.667972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-kube-api-access-c4l42" (OuterVolumeSpecName: "kube-api-access-c4l42") pod "ba6c9f12-a25e-4e3c-8f61-e28ba352195b" (UID: "ba6c9f12-a25e-4e3c-8f61-e28ba352195b"). InnerVolumeSpecName "kube-api-access-c4l42". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.700658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-config" (OuterVolumeSpecName: "config") pod "ba6c9f12-a25e-4e3c-8f61-e28ba352195b" (UID: "ba6c9f12-a25e-4e3c-8f61-e28ba352195b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.701105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "ba6c9f12-a25e-4e3c-8f61-e28ba352195b" (UID: "ba6c9f12-a25e-4e3c-8f61-e28ba352195b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.716707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-openstack-edpm-ipam" (OuterVolumeSpecName: "openstack-edpm-ipam") pod "ba6c9f12-a25e-4e3c-8f61-e28ba352195b" (UID: "ba6c9f12-a25e-4e3c-8f61-e28ba352195b"). InnerVolumeSpecName "openstack-edpm-ipam". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.760494 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-ipam\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-openstack-edpm-ipam\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.760543 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.760555 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.760571 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c4l42\" (UniqueName: \"kubernetes.io/projected/ba6c9f12-a25e-4e3c-8f61-e28ba352195b-kube-api-access-c4l42\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.910793 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf"] Nov 21 13:28:43 crc kubenswrapper[4769]: I1121 13:28:43.923265 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79667f9c49-kzgjf"] Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.915986 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.988336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zwlp\" (UniqueName: \"kubernetes.io/projected/053ad8fe-b078-4163-93c8-304012f87cca-kube-api-access-5zwlp\") pod \"053ad8fe-b078-4163-93c8-304012f87cca\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.988568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/053ad8fe-b078-4163-93c8-304012f87cca-node-mnt\") pod \"053ad8fe-b078-4163-93c8-304012f87cca\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.988607 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/053ad8fe-b078-4163-93c8-304012f87cca-crc-storage\") pod \"053ad8fe-b078-4163-93c8-304012f87cca\" (UID: \"053ad8fe-b078-4163-93c8-304012f87cca\") " Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.988723 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/053ad8fe-b078-4163-93c8-304012f87cca-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "053ad8fe-b078-4163-93c8-304012f87cca" (UID: "053ad8fe-b078-4163-93c8-304012f87cca"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.989082 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/053ad8fe-b078-4163-93c8-304012f87cca-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:44 crc kubenswrapper[4769]: I1121 13:28:44.994487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053ad8fe-b078-4163-93c8-304012f87cca-kube-api-access-5zwlp" (OuterVolumeSpecName: "kube-api-access-5zwlp") pod "053ad8fe-b078-4163-93c8-304012f87cca" (UID: "053ad8fe-b078-4163-93c8-304012f87cca"). InnerVolumeSpecName "kube-api-access-5zwlp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.008222 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/053ad8fe-b078-4163-93c8-304012f87cca-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "053ad8fe-b078-4163-93c8-304012f87cca" (UID: "053ad8fe-b078-4163-93c8-304012f87cca"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.090665 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/053ad8fe-b078-4163-93c8-304012f87cca-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.090715 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5zwlp\" (UniqueName: \"kubernetes.io/projected/053ad8fe-b078-4163-93c8-304012f87cca-kube-api-access-5zwlp\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.293810 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" path="/var/lib/kubelet/pods/ba6c9f12-a25e-4e3c-8f61-e28ba352195b/volumes" Nov 21 13:28:45 crc kubenswrapper[4769]: E1121 13:28:45.351926 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053ad8fe_b078_4163_93c8_304012f87cca.slice\": RecentStats: unable to find data in memory cache]" Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.594015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-v8lmv" event={"ID":"053ad8fe-b078-4163-93c8-304012f87cca","Type":"ContainerDied","Data":"1e98dd5e86de87799cee27010f76eba1ba19abf0379ceff908bc471876908276"} Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.594068 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e98dd5e86de87799cee27010f76eba1ba19abf0379ceff908bc471876908276" Nov 21 13:28:45 crc kubenswrapper[4769]: I1121 13:28:45.594109 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v8lmv" Nov 21 13:28:48 crc kubenswrapper[4769]: I1121 13:28:48.835628 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-v8lmv"] Nov 21 13:28:48 crc kubenswrapper[4769]: I1121 13:28:48.839856 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-v8lmv"] Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.028437 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-6p2ml"] Nov 21 13:28:49 crc kubenswrapper[4769]: E1121 13:28:49.028806 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerName="init" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.028828 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerName="init" Nov 21 13:28:49 crc kubenswrapper[4769]: E1121 13:28:49.028860 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="053ad8fe-b078-4163-93c8-304012f87cca" containerName="storage" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.028869 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="053ad8fe-b078-4163-93c8-304012f87cca" containerName="storage" Nov 21 13:28:49 crc kubenswrapper[4769]: E1121 13:28:49.028885 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerName="dnsmasq-dns" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.028893 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerName="dnsmasq-dns" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.029107 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ba6c9f12-a25e-4e3c-8f61-e28ba352195b" containerName="dnsmasq-dns" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.029133 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="053ad8fe-b078-4163-93c8-304012f87cca" containerName="storage" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.029942 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.032490 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.032764 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.032959 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.032987 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.038459 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-6p2ml"] Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.147697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/29fb48a8-beb5-4a04-b405-327876476700-node-mnt\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.147738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/29fb48a8-beb5-4a04-b405-327876476700-crc-storage\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.147779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrbx\" (UniqueName: \"kubernetes.io/projected/29fb48a8-beb5-4a04-b405-327876476700-kube-api-access-pkrbx\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.249678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/29fb48a8-beb5-4a04-b405-327876476700-node-mnt\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.249757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/29fb48a8-beb5-4a04-b405-327876476700-crc-storage\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.249841 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrbx\" (UniqueName: \"kubernetes.io/projected/29fb48a8-beb5-4a04-b405-327876476700-kube-api-access-pkrbx\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.250031 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/29fb48a8-beb5-4a04-b405-327876476700-node-mnt\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.251132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/29fb48a8-beb5-4a04-b405-327876476700-crc-storage\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.278870 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrbx\" (UniqueName: \"kubernetes.io/projected/29fb48a8-beb5-4a04-b405-327876476700-kube-api-access-pkrbx\") pod \"crc-storage-crc-6p2ml\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.294510 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053ad8fe-b078-4163-93c8-304012f87cca" path="/var/lib/kubelet/pods/053ad8fe-b078-4163-93c8-304012f87cca/volumes" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.350924 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:49 crc kubenswrapper[4769]: I1121 13:28:49.826638 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-6p2ml"] Nov 21 13:28:49 crc kubenswrapper[4769]: W1121 13:28:49.836177 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29fb48a8_beb5_4a04_b405_327876476700.slice/crio-e63466b6b803e1b8237618c4ed935fea94040f0bbbf95fe5417ca05f9af5b017 WatchSource:0}: Error finding container e63466b6b803e1b8237618c4ed935fea94040f0bbbf95fe5417ca05f9af5b017: Status 404 returned error can't find the container with id e63466b6b803e1b8237618c4ed935fea94040f0bbbf95fe5417ca05f9af5b017 Nov 21 13:28:50 crc kubenswrapper[4769]: I1121 13:28:50.645863 4769 generic.go:334] "Generic (PLEG): container finished" podID="29fb48a8-beb5-4a04-b405-327876476700" containerID="1e8f7931bdb97b2d9a0cff88a43149952d632581847e8f1f0067d714d9e6b454" exitCode=0 Nov 21 13:28:50 crc kubenswrapper[4769]: I1121 13:28:50.645921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-6p2ml" event={"ID":"29fb48a8-beb5-4a04-b405-327876476700","Type":"ContainerDied","Data":"1e8f7931bdb97b2d9a0cff88a43149952d632581847e8f1f0067d714d9e6b454"} Nov 21 13:28:50 crc kubenswrapper[4769]: I1121 13:28:50.646225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-6p2ml" event={"ID":"29fb48a8-beb5-4a04-b405-327876476700","Type":"ContainerStarted","Data":"e63466b6b803e1b8237618c4ed935fea94040f0bbbf95fe5417ca05f9af5b017"} Nov 21 13:28:51 crc kubenswrapper[4769]: I1121 13:28:51.274948 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:28:51 crc kubenswrapper[4769]: E1121 13:28:51.275279 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.001283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.092747 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkrbx\" (UniqueName: \"kubernetes.io/projected/29fb48a8-beb5-4a04-b405-327876476700-kube-api-access-pkrbx\") pod \"29fb48a8-beb5-4a04-b405-327876476700\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.092803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/29fb48a8-beb5-4a04-b405-327876476700-node-mnt\") pod \"29fb48a8-beb5-4a04-b405-327876476700\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.092917 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/29fb48a8-beb5-4a04-b405-327876476700-crc-storage\") pod \"29fb48a8-beb5-4a04-b405-327876476700\" (UID: \"29fb48a8-beb5-4a04-b405-327876476700\") " Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.092958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/29fb48a8-beb5-4a04-b405-327876476700-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "29fb48a8-beb5-4a04-b405-327876476700" (UID: "29fb48a8-beb5-4a04-b405-327876476700"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.093233 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/29fb48a8-beb5-4a04-b405-327876476700-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.097963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29fb48a8-beb5-4a04-b405-327876476700-kube-api-access-pkrbx" (OuterVolumeSpecName: "kube-api-access-pkrbx") pod "29fb48a8-beb5-4a04-b405-327876476700" (UID: "29fb48a8-beb5-4a04-b405-327876476700"). InnerVolumeSpecName "kube-api-access-pkrbx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.112137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29fb48a8-beb5-4a04-b405-327876476700-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "29fb48a8-beb5-4a04-b405-327876476700" (UID: "29fb48a8-beb5-4a04-b405-327876476700"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.195138 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/29fb48a8-beb5-4a04-b405-327876476700-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.195178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pkrbx\" (UniqueName: \"kubernetes.io/projected/29fb48a8-beb5-4a04-b405-327876476700-kube-api-access-pkrbx\") on node \"crc\" DevicePath \"\"" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.669928 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-6p2ml" event={"ID":"29fb48a8-beb5-4a04-b405-327876476700","Type":"ContainerDied","Data":"e63466b6b803e1b8237618c4ed935fea94040f0bbbf95fe5417ca05f9af5b017"} Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.669978 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e63466b6b803e1b8237618c4ed935fea94040f0bbbf95fe5417ca05f9af5b017" Nov 21 13:28:52 crc kubenswrapper[4769]: I1121 13:28:52.670005 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-6p2ml" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.826733 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q"] Nov 21 13:28:55 crc kubenswrapper[4769]: E1121 13:28:55.827461 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29fb48a8-beb5-4a04-b405-327876476700" containerName="storage" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.827479 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fb48a8-beb5-4a04-b405-327876476700" containerName="storage" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.827679 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="29fb48a8-beb5-4a04-b405-327876476700" containerName="storage" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.828627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.830950 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-compute-global" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.839034 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q"] Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.844920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdcjf\" (UniqueName: \"kubernetes.io/projected/ef52e904-6d2e-4ec5-8757-92dc09083594-kube-api-access-cdcjf\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.844980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.845006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-edpm-compute-global\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.845330 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-config\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.946985 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cdcjf\" (UniqueName: \"kubernetes.io/projected/ef52e904-6d2e-4ec5-8757-92dc09083594-kube-api-access-cdcjf\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.947079 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.947108 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-edpm-compute-global\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.947184 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-config\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.947977 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.948021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-edpm-compute-global\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.948833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-config\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:55 crc kubenswrapper[4769]: I1121 13:28:55.964829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdcjf\" (UniqueName: \"kubernetes.io/projected/ef52e904-6d2e-4ec5-8757-92dc09083594-kube-api-access-cdcjf\") pod \"dnsmasq-dnsmasq-7d78464677-ck59q\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:56 crc kubenswrapper[4769]: I1121 13:28:56.148996 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:56 crc kubenswrapper[4769]: I1121 13:28:56.477804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q"] Nov 21 13:28:56 crc kubenswrapper[4769]: I1121 13:28:56.770306 4769 generic.go:334] "Generic (PLEG): container finished" podID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerID="e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1" exitCode=0 Nov 21 13:28:56 crc kubenswrapper[4769]: I1121 13:28:56.770377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" event={"ID":"ef52e904-6d2e-4ec5-8757-92dc09083594","Type":"ContainerDied","Data":"e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1"} Nov 21 13:28:56 crc kubenswrapper[4769]: I1121 13:28:56.770412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" event={"ID":"ef52e904-6d2e-4ec5-8757-92dc09083594","Type":"ContainerStarted","Data":"d28d52ef4eb86cb9c7049838c13d8a4be06f1eda49db6cc02b5c9fddc5ab9b81"} Nov 21 13:28:57 crc kubenswrapper[4769]: I1121 13:28:57.780704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" event={"ID":"ef52e904-6d2e-4ec5-8757-92dc09083594","Type":"ContainerStarted","Data":"70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c"} Nov 21 13:28:57 crc kubenswrapper[4769]: I1121 13:28:57.781113 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:28:57 crc kubenswrapper[4769]: I1121 13:28:57.795967 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" podStartSLOduration=2.795950321 podStartE2EDuration="2.795950321s" podCreationTimestamp="2025-11-21 13:28:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:28:57.79552596 +0000 UTC m=+5896.496187778" watchObservedRunningTime="2025-11-21 13:28:57.795950321 +0000 UTC m=+5896.496612139" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.218611 4769 scope.go:117] "RemoveContainer" containerID="de6e86a204e3313f8c68feba8496fdf691fb8e53cfa08e9d1f313903e424530a" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.240993 4769 scope.go:117] "RemoveContainer" containerID="3b29e5ba4a8f38f80c99b0d98ef6329e58eaf5f7edb0d8f0f6ffe3389918679e" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.271105 4769 scope.go:117] "RemoveContainer" containerID="ddbe6f6bbb3dbc33f83c9c105fda39a62ecdfd48e50608fb83c7ea728448ca80" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.309292 4769 scope.go:117] "RemoveContainer" containerID="5588efb755e1ca2a21a6847e224c4da27a93e6a5576be3dce9c35cd464a20d7c" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.351114 4769 scope.go:117] "RemoveContainer" containerID="c86bd2c25f45181ac6696189fa8f94da60ccb3ca924946935844330b805f7be6" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.370409 4769 scope.go:117] "RemoveContainer" containerID="5cc8a4070a809b59e45492a1bd78706ed7d94654d144842dc35582033546ab59" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.405779 4769 scope.go:117] "RemoveContainer" containerID="80efed2bad3b32e75ae5ef3a3eb810db72129dc7bddf6b3b05516ddc0b7055da" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.440436 4769 scope.go:117] "RemoveContainer" containerID="201f11a80c28d2e389fc6403d05e4a63c823852d372df0b738102621e5b80179" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.460384 4769 scope.go:117] "RemoveContainer" containerID="3746623be8e16fc057b91cbcd838cfb45af50b0099ea09751999b9d7b9bef04d" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.506668 4769 scope.go:117] "RemoveContainer" containerID="97a7aa4760173fd99013dbd8c78b3bacbaed3939cdc3b0b5f06da6d044b6ee33" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.531211 4769 scope.go:117] "RemoveContainer" containerID="9873ddc0c1065b28be395293760dc95aef10666fd643c5460c2bdb92415a6cb8" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.547897 4769 scope.go:117] "RemoveContainer" containerID="01cee13087c2bdab18b5bd5d986cd8431354843f6a4ee90746f8aa23820127d3" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.566129 4769 scope.go:117] "RemoveContainer" containerID="95a9f1fdb7dc9dfd378e8207e1c350aa299b339ede92db72e93b16a59a013c57" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.585560 4769 scope.go:117] "RemoveContainer" containerID="29156d73b0d44e2d7ce85a740663c12800e3dac66939d5ca403259ab9b4ea6fb" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.610152 4769 scope.go:117] "RemoveContainer" containerID="5550cf7a7b55f6f5368733cda6671532aaaf75ab10001b98af344a90ad658e25" Nov 21 13:28:58 crc kubenswrapper[4769]: I1121 13:28:58.634913 4769 scope.go:117] "RemoveContainer" containerID="d3a595ac7572f6ee343796bd1cfe8ff50a9360543b62e14fd98a04a7128aa945" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.150422 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.236716 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm"] Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.237130 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerName="dnsmasq-dns" containerID="cri-o://3b563188780ca69d88faab0547f9cd15c760c329fc43154fe4f8611ff69aed8c" gracePeriod=10 Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.771249 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw"] Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.772501 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.774845 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.774876 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.778540 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.778564 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.785292 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw"] Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.833436 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerID="3b563188780ca69d88faab0547f9cd15c760c329fc43154fe4f8611ff69aed8c" exitCode=0 Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.833493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" event={"ID":"1fe76423-c70c-457f-99c0-b21afb9525cf","Type":"ContainerDied","Data":"3b563188780ca69d88faab0547f9cd15c760c329fc43154fe4f8611ff69aed8c"} Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.880172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-inventory\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.880593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-ssh-key\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.880713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76n4\" (UniqueName: \"kubernetes.io/projected/fb61f8f1-1c1b-438e-8586-75a7efd24b82-kube-api-access-j76n4\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.982681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-ssh-key\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.982763 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j76n4\" (UniqueName: \"kubernetes.io/projected/fb61f8f1-1c1b-438e-8586-75a7efd24b82-kube-api-access-j76n4\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.982878 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-inventory\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.991138 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-ssh-key\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:01 crc kubenswrapper[4769]: I1121 13:29:01.999813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76n4\" (UniqueName: \"kubernetes.io/projected/fb61f8f1-1c1b-438e-8586-75a7efd24b82-kube-api-access-j76n4\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.000800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-inventory\") pod \"download-cache-edpm-compute-global-edpm-compute-global-9hrtw\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.091489 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.178079 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.286620 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-dnsmasq-svc\") pod \"1fe76423-c70c-457f-99c0-b21afb9525cf\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.286707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp992\" (UniqueName: \"kubernetes.io/projected/1fe76423-c70c-457f-99c0-b21afb9525cf-kube-api-access-xp992\") pod \"1fe76423-c70c-457f-99c0-b21afb9525cf\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.286771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-config\") pod \"1fe76423-c70c-457f-99c0-b21afb9525cf\" (UID: \"1fe76423-c70c-457f-99c0-b21afb9525cf\") " Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.291866 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe76423-c70c-457f-99c0-b21afb9525cf-kube-api-access-xp992" (OuterVolumeSpecName: "kube-api-access-xp992") pod "1fe76423-c70c-457f-99c0-b21afb9525cf" (UID: "1fe76423-c70c-457f-99c0-b21afb9525cf"). InnerVolumeSpecName "kube-api-access-xp992". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.319915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-config" (OuterVolumeSpecName: "config") pod "1fe76423-c70c-457f-99c0-b21afb9525cf" (UID: "1fe76423-c70c-457f-99c0-b21afb9525cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.321950 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "1fe76423-c70c-457f-99c0-b21afb9525cf" (UID: "1fe76423-c70c-457f-99c0-b21afb9525cf"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.388706 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.388743 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xp992\" (UniqueName: \"kubernetes.io/projected/1fe76423-c70c-457f-99c0-b21afb9525cf-kube-api-access-xp992\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.388754 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fe76423-c70c-457f-99c0-b21afb9525cf-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.571889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw"] Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.844007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" event={"ID":"fb61f8f1-1c1b-438e-8586-75a7efd24b82","Type":"ContainerStarted","Data":"f6c17074e184421574c41892d3205f812d0dca7e7633bd920c2d09ac0beae46e"} Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.846614 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" event={"ID":"1fe76423-c70c-457f-99c0-b21afb9525cf","Type":"ContainerDied","Data":"88082339bac7536e770f7a3f84c14f377aeb10db1407aa35492b8d6c05be73e4"} Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.846688 4769 scope.go:117] "RemoveContainer" containerID="3b563188780ca69d88faab0547f9cd15c760c329fc43154fe4f8611ff69aed8c" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.846717 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.869303 4769 scope.go:117] "RemoveContainer" containerID="43678ca198425aa36f4d407834707ea601942ae3e565a4d3932ef15192b65755" Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.889235 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm"] Nov 21 13:29:02 crc kubenswrapper[4769]: I1121 13:29:02.897437 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-84hdm"] Nov 21 13:29:03 crc kubenswrapper[4769]: I1121 13:29:03.280999 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:29:03 crc kubenswrapper[4769]: E1121 13:29:03.281332 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:29:03 crc kubenswrapper[4769]: I1121 13:29:03.287535 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" path="/var/lib/kubelet/pods/1fe76423-c70c-457f-99c0-b21afb9525cf/volumes" Nov 21 13:29:11 crc kubenswrapper[4769]: I1121 13:29:11.931744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" event={"ID":"fb61f8f1-1c1b-438e-8586-75a7efd24b82","Type":"ContainerStarted","Data":"06e0de70e14dd998324f362fbd9e6a0ac4ba458aaecc365bfc75007a828440cb"} Nov 21 13:29:11 crc kubenswrapper[4769]: I1121 13:29:11.946712 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" podStartSLOduration=2.638646353 podStartE2EDuration="10.946696428s" podCreationTimestamp="2025-11-21 13:29:01 +0000 UTC" firstStartedPulling="2025-11-21 13:29:02.58309884 +0000 UTC m=+5901.283760658" lastFinishedPulling="2025-11-21 13:29:10.891148905 +0000 UTC m=+5909.591810733" observedRunningTime="2025-11-21 13:29:11.945730322 +0000 UTC m=+5910.646392140" watchObservedRunningTime="2025-11-21 13:29:11.946696428 +0000 UTC m=+5910.647358246" Nov 21 13:29:12 crc kubenswrapper[4769]: I1121 13:29:12.946331 4769 generic.go:334] "Generic (PLEG): container finished" podID="fb61f8f1-1c1b-438e-8586-75a7efd24b82" containerID="06e0de70e14dd998324f362fbd9e6a0ac4ba458aaecc365bfc75007a828440cb" exitCode=0 Nov 21 13:29:12 crc kubenswrapper[4769]: I1121 13:29:12.946392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" event={"ID":"fb61f8f1-1c1b-438e-8586-75a7efd24b82","Type":"ContainerDied","Data":"06e0de70e14dd998324f362fbd9e6a0ac4ba458aaecc365bfc75007a828440cb"} Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.338984 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.339943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-ssh-key\") pod \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.339981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-inventory\") pod \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.340035 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j76n4\" (UniqueName: \"kubernetes.io/projected/fb61f8f1-1c1b-438e-8586-75a7efd24b82-kube-api-access-j76n4\") pod \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\" (UID: \"fb61f8f1-1c1b-438e-8586-75a7efd24b82\") " Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.347031 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb61f8f1-1c1b-438e-8586-75a7efd24b82-kube-api-access-j76n4" (OuterVolumeSpecName: "kube-api-access-j76n4") pod "fb61f8f1-1c1b-438e-8586-75a7efd24b82" (UID: "fb61f8f1-1c1b-438e-8586-75a7efd24b82"). InnerVolumeSpecName "kube-api-access-j76n4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.366062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "fb61f8f1-1c1b-438e-8586-75a7efd24b82" (UID: "fb61f8f1-1c1b-438e-8586-75a7efd24b82"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.374641 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-inventory" (OuterVolumeSpecName: "inventory") pod "fb61f8f1-1c1b-438e-8586-75a7efd24b82" (UID: "fb61f8f1-1c1b-438e-8586-75a7efd24b82"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.441792 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.442241 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fb61f8f1-1c1b-438e-8586-75a7efd24b82-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.442264 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j76n4\" (UniqueName: \"kubernetes.io/projected/fb61f8f1-1c1b-438e-8586-75a7efd24b82-kube-api-access-j76n4\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.979298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" event={"ID":"fb61f8f1-1c1b-438e-8586-75a7efd24b82","Type":"ContainerDied","Data":"f6c17074e184421574c41892d3205f812d0dca7e7633bd920c2d09ac0beae46e"} Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.979359 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6c17074e184421574c41892d3205f812d0dca7e7633bd920c2d09ac0beae46e" Nov 21 13:29:14 crc kubenswrapper[4769]: I1121 13:29:14.979452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.044555 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq"] Nov 21 13:29:15 crc kubenswrapper[4769]: E1121 13:29:15.044960 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerName="dnsmasq-dns" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.044980 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerName="dnsmasq-dns" Nov 21 13:29:15 crc kubenswrapper[4769]: E1121 13:29:15.045021 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fb61f8f1-1c1b-438e-8586-75a7efd24b82" containerName="download-cache-edpm-compute-global-edpm-compute-global" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.045034 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb61f8f1-1c1b-438e-8586-75a7efd24b82" containerName="download-cache-edpm-compute-global-edpm-compute-global" Nov 21 13:29:15 crc kubenswrapper[4769]: E1121 13:29:15.045063 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerName="init" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.045074 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerName="init" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.045416 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fb61f8f1-1c1b-438e-8586-75a7efd24b82" containerName="download-cache-edpm-compute-global-edpm-compute-global" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.045452 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1fe76423-c70c-457f-99c0-b21afb9525cf" containerName="dnsmasq-dns" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.046183 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.050003 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.050241 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.050399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.051048 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.052424 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.052920 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8pdl\" (UniqueName: \"kubernetes.io/projected/37905d2c-e505-4675-91da-311a66b6d413-kube-api-access-m8pdl\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.052991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.053011 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq"] Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.053024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-ssh-key\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.053321 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-inventory\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.154968 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-inventory\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.155122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m8pdl\" (UniqueName: \"kubernetes.io/projected/37905d2c-e505-4675-91da-311a66b6d413-kube-api-access-m8pdl\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.155227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.155266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-ssh-key\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.159758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-inventory\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.170979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.171161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-ssh-key\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.189068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8pdl\" (UniqueName: \"kubernetes.io/projected/37905d2c-e505-4675-91da-311a66b6d413-kube-api-access-m8pdl\") pod \"bootstrap-edpm-compute-global-edpm-compute-global-7hjdq\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.373990 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.859831 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq"] Nov 21 13:29:15 crc kubenswrapper[4769]: W1121 13:29:15.862696 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37905d2c_e505_4675_91da_311a66b6d413.slice/crio-ec641bd1dc7ea4d27222d8b12ac2468910787b28dc76d26ea90df8f11a016ffb WatchSource:0}: Error finding container ec641bd1dc7ea4d27222d8b12ac2468910787b28dc76d26ea90df8f11a016ffb: Status 404 returned error can't find the container with id ec641bd1dc7ea4d27222d8b12ac2468910787b28dc76d26ea90df8f11a016ffb Nov 21 13:29:15 crc kubenswrapper[4769]: I1121 13:29:15.989837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" event={"ID":"37905d2c-e505-4675-91da-311a66b6d413","Type":"ContainerStarted","Data":"ec641bd1dc7ea4d27222d8b12ac2468910787b28dc76d26ea90df8f11a016ffb"} Nov 21 13:29:17 crc kubenswrapper[4769]: I1121 13:29:17.004410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" event={"ID":"37905d2c-e505-4675-91da-311a66b6d413","Type":"ContainerStarted","Data":"de19dcc71ecbe9de1b9feeffcd956a33632e73795b51391faf7eace808a724ec"} Nov 21 13:29:17 crc kubenswrapper[4769]: I1121 13:29:17.040969 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" podStartSLOduration=1.614483095 podStartE2EDuration="2.040941947s" podCreationTimestamp="2025-11-21 13:29:15 +0000 UTC" firstStartedPulling="2025-11-21 13:29:15.867285075 +0000 UTC m=+5914.567946893" lastFinishedPulling="2025-11-21 13:29:16.293743927 +0000 UTC m=+5914.994405745" observedRunningTime="2025-11-21 13:29:17.029000635 +0000 UTC m=+5915.729662503" watchObservedRunningTime="2025-11-21 13:29:17.040941947 +0000 UTC m=+5915.741603795" Nov 21 13:29:17 crc kubenswrapper[4769]: I1121 13:29:17.274230 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:29:17 crc kubenswrapper[4769]: E1121 13:29:17.274419 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:29:18 crc kubenswrapper[4769]: I1121 13:29:18.018592 4769 generic.go:334] "Generic (PLEG): container finished" podID="37905d2c-e505-4675-91da-311a66b6d413" containerID="de19dcc71ecbe9de1b9feeffcd956a33632e73795b51391faf7eace808a724ec" exitCode=0 Nov 21 13:29:18 crc kubenswrapper[4769]: I1121 13:29:18.018652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" event={"ID":"37905d2c-e505-4675-91da-311a66b6d413","Type":"ContainerDied","Data":"de19dcc71ecbe9de1b9feeffcd956a33632e73795b51391faf7eace808a724ec"} Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.355449 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.555684 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-ssh-key\") pod \"37905d2c-e505-4675-91da-311a66b6d413\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.555837 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-bootstrap-combined-ca-bundle\") pod \"37905d2c-e505-4675-91da-311a66b6d413\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.555967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8pdl\" (UniqueName: \"kubernetes.io/projected/37905d2c-e505-4675-91da-311a66b6d413-kube-api-access-m8pdl\") pod \"37905d2c-e505-4675-91da-311a66b6d413\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.556017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-inventory\") pod \"37905d2c-e505-4675-91da-311a66b6d413\" (UID: \"37905d2c-e505-4675-91da-311a66b6d413\") " Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.561513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "37905d2c-e505-4675-91da-311a66b6d413" (UID: "37905d2c-e505-4675-91da-311a66b6d413"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.570559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37905d2c-e505-4675-91da-311a66b6d413-kube-api-access-m8pdl" (OuterVolumeSpecName: "kube-api-access-m8pdl") pod "37905d2c-e505-4675-91da-311a66b6d413" (UID: "37905d2c-e505-4675-91da-311a66b6d413"). InnerVolumeSpecName "kube-api-access-m8pdl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.577343 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "37905d2c-e505-4675-91da-311a66b6d413" (UID: "37905d2c-e505-4675-91da-311a66b6d413"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.595123 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-inventory" (OuterVolumeSpecName: "inventory") pod "37905d2c-e505-4675-91da-311a66b6d413" (UID: "37905d2c-e505-4675-91da-311a66b6d413"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.657463 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.657500 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.657513 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m8pdl\" (UniqueName: \"kubernetes.io/projected/37905d2c-e505-4675-91da-311a66b6d413-kube-api-access-m8pdl\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:19 crc kubenswrapper[4769]: I1121 13:29:19.657525 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/37905d2c-e505-4675-91da-311a66b6d413-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.041171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" event={"ID":"37905d2c-e505-4675-91da-311a66b6d413","Type":"ContainerDied","Data":"ec641bd1dc7ea4d27222d8b12ac2468910787b28dc76d26ea90df8f11a016ffb"} Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.041658 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec641bd1dc7ea4d27222d8b12ac2468910787b28dc76d26ea90df8f11a016ffb" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.041812 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.123571 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6"] Nov 21 13:29:20 crc kubenswrapper[4769]: E1121 13:29:20.123962 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="37905d2c-e505-4675-91da-311a66b6d413" containerName="bootstrap-edpm-compute-global-edpm-compute-global" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.123984 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="37905d2c-e505-4675-91da-311a66b6d413" containerName="bootstrap-edpm-compute-global-edpm-compute-global" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.124166 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="37905d2c-e505-4675-91da-311a66b6d413" containerName="bootstrap-edpm-compute-global-edpm-compute-global" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.124783 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.127409 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.127557 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.129916 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.130072 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.136153 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6"] Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.267746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-ssh-key\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.267861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-inventory\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.268110 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7th76\" (UniqueName: \"kubernetes.io/projected/127d314b-c938-4dff-ad98-a4323c8ebace-kube-api-access-7th76\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.370517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7th76\" (UniqueName: \"kubernetes.io/projected/127d314b-c938-4dff-ad98-a4323c8ebace-kube-api-access-7th76\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.370767 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-ssh-key\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.370855 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-inventory\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.378333 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-inventory\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.378392 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-ssh-key\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.393931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7th76\" (UniqueName: \"kubernetes.io/projected/127d314b-c938-4dff-ad98-a4323c8ebace-kube-api-access-7th76\") pod \"configure-network-edpm-compute-global-edpm-compute-global-f4tw6\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.443635 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:20 crc kubenswrapper[4769]: I1121 13:29:20.683303 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6"] Nov 21 13:29:21 crc kubenswrapper[4769]: I1121 13:29:21.055715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" event={"ID":"127d314b-c938-4dff-ad98-a4323c8ebace","Type":"ContainerStarted","Data":"d618a4dfa4507dbb5d6e11b4deefbbc24f02a5941b60b7071adbf9680b978eed"} Nov 21 13:29:22 crc kubenswrapper[4769]: I1121 13:29:22.068063 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" event={"ID":"127d314b-c938-4dff-ad98-a4323c8ebace","Type":"ContainerStarted","Data":"eada4ef31899d79c64caffe170e23ee10691cfc95a5d3e067bcea851333bce4a"} Nov 21 13:29:22 crc kubenswrapper[4769]: I1121 13:29:22.109236 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" podStartSLOduration=1.409229062 podStartE2EDuration="2.109214527s" podCreationTimestamp="2025-11-21 13:29:20 +0000 UTC" firstStartedPulling="2025-11-21 13:29:20.699962814 +0000 UTC m=+5919.400624642" lastFinishedPulling="2025-11-21 13:29:21.399948259 +0000 UTC m=+5920.100610107" observedRunningTime="2025-11-21 13:29:22.098012944 +0000 UTC m=+5920.798674792" watchObservedRunningTime="2025-11-21 13:29:22.109214527 +0000 UTC m=+5920.809876345" Nov 21 13:29:23 crc kubenswrapper[4769]: I1121 13:29:23.080029 4769 generic.go:334] "Generic (PLEG): container finished" podID="127d314b-c938-4dff-ad98-a4323c8ebace" containerID="eada4ef31899d79c64caffe170e23ee10691cfc95a5d3e067bcea851333bce4a" exitCode=0 Nov 21 13:29:23 crc kubenswrapper[4769]: I1121 13:29:23.080100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" event={"ID":"127d314b-c938-4dff-ad98-a4323c8ebace","Type":"ContainerDied","Data":"eada4ef31899d79c64caffe170e23ee10691cfc95a5d3e067bcea851333bce4a"} Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.454132 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.646977 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-inventory\") pod \"127d314b-c938-4dff-ad98-a4323c8ebace\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.648643 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7th76\" (UniqueName: \"kubernetes.io/projected/127d314b-c938-4dff-ad98-a4323c8ebace-kube-api-access-7th76\") pod \"127d314b-c938-4dff-ad98-a4323c8ebace\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.648768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-ssh-key\") pod \"127d314b-c938-4dff-ad98-a4323c8ebace\" (UID: \"127d314b-c938-4dff-ad98-a4323c8ebace\") " Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.655400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127d314b-c938-4dff-ad98-a4323c8ebace-kube-api-access-7th76" (OuterVolumeSpecName: "kube-api-access-7th76") pod "127d314b-c938-4dff-ad98-a4323c8ebace" (UID: "127d314b-c938-4dff-ad98-a4323c8ebace"). InnerVolumeSpecName "kube-api-access-7th76". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.673819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-inventory" (OuterVolumeSpecName: "inventory") pod "127d314b-c938-4dff-ad98-a4323c8ebace" (UID: "127d314b-c938-4dff-ad98-a4323c8ebace"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.690802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "127d314b-c938-4dff-ad98-a4323c8ebace" (UID: "127d314b-c938-4dff-ad98-a4323c8ebace"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.750993 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.751045 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/127d314b-c938-4dff-ad98-a4323c8ebace-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:24 crc kubenswrapper[4769]: I1121 13:29:24.751069 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7th76\" (UniqueName: \"kubernetes.io/projected/127d314b-c938-4dff-ad98-a4323c8ebace-kube-api-access-7th76\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.138482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" event={"ID":"127d314b-c938-4dff-ad98-a4323c8ebace","Type":"ContainerDied","Data":"d618a4dfa4507dbb5d6e11b4deefbbc24f02a5941b60b7071adbf9680b978eed"} Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.138545 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d618a4dfa4507dbb5d6e11b4deefbbc24f02a5941b60b7071adbf9680b978eed" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.138584 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.211024 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8"] Nov 21 13:29:25 crc kubenswrapper[4769]: E1121 13:29:25.211829 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="127d314b-c938-4dff-ad98-a4323c8ebace" containerName="configure-network-edpm-compute-global-edpm-compute-global" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.212016 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="127d314b-c938-4dff-ad98-a4323c8ebace" containerName="configure-network-edpm-compute-global-edpm-compute-global" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.212471 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="127d314b-c938-4dff-ad98-a4323c8ebace" containerName="configure-network-edpm-compute-global-edpm-compute-global" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.213469 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.216792 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.216825 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.217700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.217831 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.225536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8"] Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.260109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-inventory\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.260217 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znk2b\" (UniqueName: \"kubernetes.io/projected/00200e3a-50f1-41d1-b946-12996d697270-kube-api-access-znk2b\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.260432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-ssh-key\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.362614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-znk2b\" (UniqueName: \"kubernetes.io/projected/00200e3a-50f1-41d1-b946-12996d697270-kube-api-access-znk2b\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.362813 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-ssh-key\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.362923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-inventory\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.370405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-inventory\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.371705 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-ssh-key\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.385893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-znk2b\" (UniqueName: \"kubernetes.io/projected/00200e3a-50f1-41d1-b946-12996d697270-kube-api-access-znk2b\") pod \"validate-network-edpm-compute-global-edpm-compute-global-vx4w8\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.573440 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:25 crc kubenswrapper[4769]: I1121 13:29:25.905786 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8"] Nov 21 13:29:25 crc kubenswrapper[4769]: W1121 13:29:25.914114 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00200e3a_50f1_41d1_b946_12996d697270.slice/crio-02f66ccd4c795b310cf8c0596b9599c500ccf05bb3cfcf8bda4cb17acdc47ac3 WatchSource:0}: Error finding container 02f66ccd4c795b310cf8c0596b9599c500ccf05bb3cfcf8bda4cb17acdc47ac3: Status 404 returned error can't find the container with id 02f66ccd4c795b310cf8c0596b9599c500ccf05bb3cfcf8bda4cb17acdc47ac3 Nov 21 13:29:26 crc kubenswrapper[4769]: I1121 13:29:26.155040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" event={"ID":"00200e3a-50f1-41d1-b946-12996d697270","Type":"ContainerStarted","Data":"02f66ccd4c795b310cf8c0596b9599c500ccf05bb3cfcf8bda4cb17acdc47ac3"} Nov 21 13:29:27 crc kubenswrapper[4769]: I1121 13:29:27.170123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" event={"ID":"00200e3a-50f1-41d1-b946-12996d697270","Type":"ContainerStarted","Data":"1ea9dca10e93917b4895b381414d6352a41cd3553ee8ee146f6022b1e42d5d76"} Nov 21 13:29:27 crc kubenswrapper[4769]: I1121 13:29:27.200904 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" podStartSLOduration=1.7312104160000001 podStartE2EDuration="2.200883428s" podCreationTimestamp="2025-11-21 13:29:25 +0000 UTC" firstStartedPulling="2025-11-21 13:29:25.920385092 +0000 UTC m=+5924.621046960" lastFinishedPulling="2025-11-21 13:29:26.390058124 +0000 UTC m=+5925.090719972" observedRunningTime="2025-11-21 13:29:27.190440045 +0000 UTC m=+5925.891101903" watchObservedRunningTime="2025-11-21 13:29:27.200883428 +0000 UTC m=+5925.901545266" Nov 21 13:29:28 crc kubenswrapper[4769]: I1121 13:29:28.187460 4769 generic.go:334] "Generic (PLEG): container finished" podID="00200e3a-50f1-41d1-b946-12996d697270" containerID="1ea9dca10e93917b4895b381414d6352a41cd3553ee8ee146f6022b1e42d5d76" exitCode=0 Nov 21 13:29:28 crc kubenswrapper[4769]: I1121 13:29:28.187546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" event={"ID":"00200e3a-50f1-41d1-b946-12996d697270","Type":"ContainerDied","Data":"1ea9dca10e93917b4895b381414d6352a41cd3553ee8ee146f6022b1e42d5d76"} Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.529479 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.628104 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znk2b\" (UniqueName: \"kubernetes.io/projected/00200e3a-50f1-41d1-b946-12996d697270-kube-api-access-znk2b\") pod \"00200e3a-50f1-41d1-b946-12996d697270\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.628304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-ssh-key\") pod \"00200e3a-50f1-41d1-b946-12996d697270\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.628349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-inventory\") pod \"00200e3a-50f1-41d1-b946-12996d697270\" (UID: \"00200e3a-50f1-41d1-b946-12996d697270\") " Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.633476 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00200e3a-50f1-41d1-b946-12996d697270-kube-api-access-znk2b" (OuterVolumeSpecName: "kube-api-access-znk2b") pod "00200e3a-50f1-41d1-b946-12996d697270" (UID: "00200e3a-50f1-41d1-b946-12996d697270"). InnerVolumeSpecName "kube-api-access-znk2b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.648162 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "00200e3a-50f1-41d1-b946-12996d697270" (UID: "00200e3a-50f1-41d1-b946-12996d697270"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.655955 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-inventory" (OuterVolumeSpecName: "inventory") pod "00200e3a-50f1-41d1-b946-12996d697270" (UID: "00200e3a-50f1-41d1-b946-12996d697270"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.730988 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.731040 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/00200e3a-50f1-41d1-b946-12996d697270-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:29 crc kubenswrapper[4769]: I1121 13:29:29.731065 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-znk2b\" (UniqueName: \"kubernetes.io/projected/00200e3a-50f1-41d1-b946-12996d697270-kube-api-access-znk2b\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.213419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" event={"ID":"00200e3a-50f1-41d1-b946-12996d697270","Type":"ContainerDied","Data":"02f66ccd4c795b310cf8c0596b9599c500ccf05bb3cfcf8bda4cb17acdc47ac3"} Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.214083 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02f66ccd4c795b310cf8c0596b9599c500ccf05bb3cfcf8bda4cb17acdc47ac3" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.213487 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.274214 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:29:30 crc kubenswrapper[4769]: E1121 13:29:30.274684 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.288664 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf"] Nov 21 13:29:30 crc kubenswrapper[4769]: E1121 13:29:30.289218 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="00200e3a-50f1-41d1-b946-12996d697270" containerName="validate-network-edpm-compute-global-edpm-compute-global" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.289247 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="00200e3a-50f1-41d1-b946-12996d697270" containerName="validate-network-edpm-compute-global-edpm-compute-global" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.289464 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="00200e3a-50f1-41d1-b946-12996d697270" containerName="validate-network-edpm-compute-global-edpm-compute-global" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.290095 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.292088 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.292810 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.293068 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.300304 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf"] Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.343038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.444012 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-inventory\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.444140 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv67z\" (UniqueName: \"kubernetes.io/projected/ab01a70a-84dd-4618-ae18-6b9b36ec5326-kube-api-access-wv67z\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.444205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-ssh-key\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.546101 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wv67z\" (UniqueName: \"kubernetes.io/projected/ab01a70a-84dd-4618-ae18-6b9b36ec5326-kube-api-access-wv67z\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.546178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-ssh-key\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.546289 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-inventory\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.553985 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-ssh-key\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.553991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-inventory\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.564899 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv67z\" (UniqueName: \"kubernetes.io/projected/ab01a70a-84dd-4618-ae18-6b9b36ec5326-kube-api-access-wv67z\") pod \"install-os-edpm-compute-global-edpm-compute-global-jvkgf\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:30 crc kubenswrapper[4769]: I1121 13:29:30.657393 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:31 crc kubenswrapper[4769]: I1121 13:29:31.095493 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf"] Nov 21 13:29:31 crc kubenswrapper[4769]: W1121 13:29:31.100960 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab01a70a_84dd_4618_ae18_6b9b36ec5326.slice/crio-6f1217621d6f1858958e07c196fb24e7dbf1c8d33a5de23ae2383a0461e924c9 WatchSource:0}: Error finding container 6f1217621d6f1858958e07c196fb24e7dbf1c8d33a5de23ae2383a0461e924c9: Status 404 returned error can't find the container with id 6f1217621d6f1858958e07c196fb24e7dbf1c8d33a5de23ae2383a0461e924c9 Nov 21 13:29:31 crc kubenswrapper[4769]: I1121 13:29:31.221861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" event={"ID":"ab01a70a-84dd-4618-ae18-6b9b36ec5326","Type":"ContainerStarted","Data":"6f1217621d6f1858958e07c196fb24e7dbf1c8d33a5de23ae2383a0461e924c9"} Nov 21 13:29:32 crc kubenswrapper[4769]: I1121 13:29:32.237549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" event={"ID":"ab01a70a-84dd-4618-ae18-6b9b36ec5326","Type":"ContainerStarted","Data":"accf550c908bc7f63d304d2d40cd0d8dfc44bacfceabb85d776563f25b18cbc5"} Nov 21 13:29:32 crc kubenswrapper[4769]: I1121 13:29:32.273454 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" podStartSLOduration=1.815101083 podStartE2EDuration="2.273424189s" podCreationTimestamp="2025-11-21 13:29:30 +0000 UTC" firstStartedPulling="2025-11-21 13:29:31.1041 +0000 UTC m=+5929.804761818" lastFinishedPulling="2025-11-21 13:29:31.562423106 +0000 UTC m=+5930.263084924" observedRunningTime="2025-11-21 13:29:32.261269731 +0000 UTC m=+5930.961931629" watchObservedRunningTime="2025-11-21 13:29:32.273424189 +0000 UTC m=+5930.974086037" Nov 21 13:29:34 crc kubenswrapper[4769]: I1121 13:29:34.262967 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab01a70a-84dd-4618-ae18-6b9b36ec5326" containerID="accf550c908bc7f63d304d2d40cd0d8dfc44bacfceabb85d776563f25b18cbc5" exitCode=0 Nov 21 13:29:34 crc kubenswrapper[4769]: I1121 13:29:34.263073 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" event={"ID":"ab01a70a-84dd-4618-ae18-6b9b36ec5326","Type":"ContainerDied","Data":"accf550c908bc7f63d304d2d40cd0d8dfc44bacfceabb85d776563f25b18cbc5"} Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.743635 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.833716 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv67z\" (UniqueName: \"kubernetes.io/projected/ab01a70a-84dd-4618-ae18-6b9b36ec5326-kube-api-access-wv67z\") pod \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.833857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-ssh-key\") pod \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.833927 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-inventory\") pod \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\" (UID: \"ab01a70a-84dd-4618-ae18-6b9b36ec5326\") " Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.839693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab01a70a-84dd-4618-ae18-6b9b36ec5326-kube-api-access-wv67z" (OuterVolumeSpecName: "kube-api-access-wv67z") pod "ab01a70a-84dd-4618-ae18-6b9b36ec5326" (UID: "ab01a70a-84dd-4618-ae18-6b9b36ec5326"). InnerVolumeSpecName "kube-api-access-wv67z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.864026 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-inventory" (OuterVolumeSpecName: "inventory") pod "ab01a70a-84dd-4618-ae18-6b9b36ec5326" (UID: "ab01a70a-84dd-4618-ae18-6b9b36ec5326"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.871837 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "ab01a70a-84dd-4618-ae18-6b9b36ec5326" (UID: "ab01a70a-84dd-4618-ae18-6b9b36ec5326"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.936030 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.936089 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ab01a70a-84dd-4618-ae18-6b9b36ec5326-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:35 crc kubenswrapper[4769]: I1121 13:29:35.936105 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wv67z\" (UniqueName: \"kubernetes.io/projected/ab01a70a-84dd-4618-ae18-6b9b36ec5326-kube-api-access-wv67z\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.286727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" event={"ID":"ab01a70a-84dd-4618-ae18-6b9b36ec5326","Type":"ContainerDied","Data":"6f1217621d6f1858958e07c196fb24e7dbf1c8d33a5de23ae2383a0461e924c9"} Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.286764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.286772 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f1217621d6f1858958e07c196fb24e7dbf1c8d33a5de23ae2383a0461e924c9" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.391862 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7"] Nov 21 13:29:36 crc kubenswrapper[4769]: E1121 13:29:36.392491 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab01a70a-84dd-4618-ae18-6b9b36ec5326" containerName="install-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.392524 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab01a70a-84dd-4618-ae18-6b9b36ec5326" containerName="install-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.392825 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab01a70a-84dd-4618-ae18-6b9b36ec5326" containerName="install-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.393768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.395946 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.395952 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.396674 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.396958 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.421424 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7"] Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.556474 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94b6\" (UniqueName: \"kubernetes.io/projected/8cebcd43-50f6-4169-8d6a-875b0aa8b305-kube-api-access-c94b6\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.556537 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-ssh-key\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.556578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-inventory\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.658372 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-ssh-key\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.658504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-inventory\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.658665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c94b6\" (UniqueName: \"kubernetes.io/projected/8cebcd43-50f6-4169-8d6a-875b0aa8b305-kube-api-access-c94b6\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.669344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-ssh-key\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.670803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-inventory\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.673278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94b6\" (UniqueName: \"kubernetes.io/projected/8cebcd43-50f6-4169-8d6a-875b0aa8b305-kube-api-access-c94b6\") pod \"configure-os-edpm-compute-global-edpm-compute-global-nhzw7\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.723801 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:36 crc kubenswrapper[4769]: I1121 13:29:36.958125 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7"] Nov 21 13:29:37 crc kubenswrapper[4769]: I1121 13:29:37.301083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" event={"ID":"8cebcd43-50f6-4169-8d6a-875b0aa8b305","Type":"ContainerStarted","Data":"fcdb30491fcd36c68220f8143f33aaff964d36c71bd0a9ef849e276db7be3d19"} Nov 21 13:29:38 crc kubenswrapper[4769]: I1121 13:29:38.312293 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" event={"ID":"8cebcd43-50f6-4169-8d6a-875b0aa8b305","Type":"ContainerStarted","Data":"26eec958f63189a63d97e63208963dd86c750b714c6f520337d7118db78e8ec4"} Nov 21 13:29:38 crc kubenswrapper[4769]: I1121 13:29:38.339098 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" podStartSLOduration=1.6910541829999999 podStartE2EDuration="2.33906881s" podCreationTimestamp="2025-11-21 13:29:36 +0000 UTC" firstStartedPulling="2025-11-21 13:29:36.961492105 +0000 UTC m=+5935.662153943" lastFinishedPulling="2025-11-21 13:29:37.609506742 +0000 UTC m=+5936.310168570" observedRunningTime="2025-11-21 13:29:38.334309466 +0000 UTC m=+5937.034971344" watchObservedRunningTime="2025-11-21 13:29:38.33906881 +0000 UTC m=+5937.039730658" Nov 21 13:29:40 crc kubenswrapper[4769]: I1121 13:29:40.340610 4769 generic.go:334] "Generic (PLEG): container finished" podID="8cebcd43-50f6-4169-8d6a-875b0aa8b305" containerID="26eec958f63189a63d97e63208963dd86c750b714c6f520337d7118db78e8ec4" exitCode=0 Nov 21 13:29:40 crc kubenswrapper[4769]: I1121 13:29:40.340655 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" event={"ID":"8cebcd43-50f6-4169-8d6a-875b0aa8b305","Type":"ContainerDied","Data":"26eec958f63189a63d97e63208963dd86c750b714c6f520337d7118db78e8ec4"} Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.761007 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.786849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c94b6\" (UniqueName: \"kubernetes.io/projected/8cebcd43-50f6-4169-8d6a-875b0aa8b305-kube-api-access-c94b6\") pod \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.787280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-inventory\") pod \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.787447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-ssh-key\") pod \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\" (UID: \"8cebcd43-50f6-4169-8d6a-875b0aa8b305\") " Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.826385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cebcd43-50f6-4169-8d6a-875b0aa8b305-kube-api-access-c94b6" (OuterVolumeSpecName: "kube-api-access-c94b6") pod "8cebcd43-50f6-4169-8d6a-875b0aa8b305" (UID: "8cebcd43-50f6-4169-8d6a-875b0aa8b305"). InnerVolumeSpecName "kube-api-access-c94b6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.848460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-inventory" (OuterVolumeSpecName: "inventory") pod "8cebcd43-50f6-4169-8d6a-875b0aa8b305" (UID: "8cebcd43-50f6-4169-8d6a-875b0aa8b305"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.856124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "8cebcd43-50f6-4169-8d6a-875b0aa8b305" (UID: "8cebcd43-50f6-4169-8d6a-875b0aa8b305"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.889942 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.889976 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8cebcd43-50f6-4169-8d6a-875b0aa8b305-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:41 crc kubenswrapper[4769]: I1121 13:29:41.889989 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c94b6\" (UniqueName: \"kubernetes.io/projected/8cebcd43-50f6-4169-8d6a-875b0aa8b305-kube-api-access-c94b6\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.273943 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:29:42 crc kubenswrapper[4769]: E1121 13:29:42.274444 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.368395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" event={"ID":"8cebcd43-50f6-4169-8d6a-875b0aa8b305","Type":"ContainerDied","Data":"fcdb30491fcd36c68220f8143f33aaff964d36c71bd0a9ef849e276db7be3d19"} Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.368452 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcdb30491fcd36c68220f8143f33aaff964d36c71bd0a9ef849e276db7be3d19" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.368863 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.447785 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb"] Nov 21 13:29:42 crc kubenswrapper[4769]: E1121 13:29:42.448440 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8cebcd43-50f6-4169-8d6a-875b0aa8b305" containerName="configure-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.448559 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cebcd43-50f6-4169-8d6a-875b0aa8b305" containerName="configure-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.448848 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8cebcd43-50f6-4169-8d6a-875b0aa8b305" containerName="configure-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.449568 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.453798 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.454068 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.454098 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.454648 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.467979 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb"] Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.499754 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmkc\" (UniqueName: \"kubernetes.io/projected/635be697-3ad3-4888-88d2-10bd8769310b-kube-api-access-hsmkc\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.499851 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-ssh-key\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.499878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-inventory\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.600937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-ssh-key\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.600982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-inventory\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.601047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmkc\" (UniqueName: \"kubernetes.io/projected/635be697-3ad3-4888-88d2-10bd8769310b-kube-api-access-hsmkc\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.605798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-inventory\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.605944 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-ssh-key\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.621577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmkc\" (UniqueName: \"kubernetes.io/projected/635be697-3ad3-4888-88d2-10bd8769310b-kube-api-access-hsmkc\") pod \"run-os-edpm-compute-global-edpm-compute-global-nt8hb\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:42 crc kubenswrapper[4769]: I1121 13:29:42.782141 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:43 crc kubenswrapper[4769]: I1121 13:29:43.297701 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb"] Nov 21 13:29:43 crc kubenswrapper[4769]: W1121 13:29:43.310743 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod635be697_3ad3_4888_88d2_10bd8769310b.slice/crio-17883bffb5081a996a47a22f2c0475221fc243140fd53263a3e5e0020e3acd78 WatchSource:0}: Error finding container 17883bffb5081a996a47a22f2c0475221fc243140fd53263a3e5e0020e3acd78: Status 404 returned error can't find the container with id 17883bffb5081a996a47a22f2c0475221fc243140fd53263a3e5e0020e3acd78 Nov 21 13:29:43 crc kubenswrapper[4769]: I1121 13:29:43.382472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" event={"ID":"635be697-3ad3-4888-88d2-10bd8769310b","Type":"ContainerStarted","Data":"17883bffb5081a996a47a22f2c0475221fc243140fd53263a3e5e0020e3acd78"} Nov 21 13:29:44 crc kubenswrapper[4769]: I1121 13:29:44.848785 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:45 crc kubenswrapper[4769]: I1121 13:29:45.404666 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" event={"ID":"635be697-3ad3-4888-88d2-10bd8769310b","Type":"ContainerStarted","Data":"864c427e16dec49886dd845254c509cbc98696e9d8136f955275960c42e259c6"} Nov 21 13:29:45 crc kubenswrapper[4769]: I1121 13:29:45.419223 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" podStartSLOduration=1.887782154 podStartE2EDuration="3.41916007s" podCreationTimestamp="2025-11-21 13:29:42 +0000 UTC" firstStartedPulling="2025-11-21 13:29:43.315302823 +0000 UTC m=+5942.015964671" lastFinishedPulling="2025-11-21 13:29:44.846680769 +0000 UTC m=+5943.547342587" observedRunningTime="2025-11-21 13:29:45.415383671 +0000 UTC m=+5944.116045569" watchObservedRunningTime="2025-11-21 13:29:45.41916007 +0000 UTC m=+5944.119821928" Nov 21 13:29:46 crc kubenswrapper[4769]: I1121 13:29:46.419005 4769 generic.go:334] "Generic (PLEG): container finished" podID="635be697-3ad3-4888-88d2-10bd8769310b" containerID="864c427e16dec49886dd845254c509cbc98696e9d8136f955275960c42e259c6" exitCode=0 Nov 21 13:29:46 crc kubenswrapper[4769]: I1121 13:29:46.419056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" event={"ID":"635be697-3ad3-4888-88d2-10bd8769310b","Type":"ContainerDied","Data":"864c427e16dec49886dd845254c509cbc98696e9d8136f955275960c42e259c6"} Nov 21 13:29:47 crc kubenswrapper[4769]: I1121 13:29:47.803496 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:47 crc kubenswrapper[4769]: I1121 13:29:47.986999 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-ssh-key\") pod \"635be697-3ad3-4888-88d2-10bd8769310b\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " Nov 21 13:29:47 crc kubenswrapper[4769]: I1121 13:29:47.987082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-inventory\") pod \"635be697-3ad3-4888-88d2-10bd8769310b\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " Nov 21 13:29:47 crc kubenswrapper[4769]: I1121 13:29:47.987306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmkc\" (UniqueName: \"kubernetes.io/projected/635be697-3ad3-4888-88d2-10bd8769310b-kube-api-access-hsmkc\") pod \"635be697-3ad3-4888-88d2-10bd8769310b\" (UID: \"635be697-3ad3-4888-88d2-10bd8769310b\") " Nov 21 13:29:47 crc kubenswrapper[4769]: I1121 13:29:47.995859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635be697-3ad3-4888-88d2-10bd8769310b-kube-api-access-hsmkc" (OuterVolumeSpecName: "kube-api-access-hsmkc") pod "635be697-3ad3-4888-88d2-10bd8769310b" (UID: "635be697-3ad3-4888-88d2-10bd8769310b"). InnerVolumeSpecName "kube-api-access-hsmkc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.023032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-inventory" (OuterVolumeSpecName: "inventory") pod "635be697-3ad3-4888-88d2-10bd8769310b" (UID: "635be697-3ad3-4888-88d2-10bd8769310b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.023518 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "635be697-3ad3-4888-88d2-10bd8769310b" (UID: "635be697-3ad3-4888-88d2-10bd8769310b"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.089669 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hsmkc\" (UniqueName: \"kubernetes.io/projected/635be697-3ad3-4888-88d2-10bd8769310b-kube-api-access-hsmkc\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.089746 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.089760 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/635be697-3ad3-4888-88d2-10bd8769310b-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.477823 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" event={"ID":"635be697-3ad3-4888-88d2-10bd8769310b","Type":"ContainerDied","Data":"17883bffb5081a996a47a22f2c0475221fc243140fd53263a3e5e0020e3acd78"} Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.478315 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17883bffb5081a996a47a22f2c0475221fc243140fd53263a3e5e0020e3acd78" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.477919 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.512670 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd"] Nov 21 13:29:48 crc kubenswrapper[4769]: E1121 13:29:48.513042 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="635be697-3ad3-4888-88d2-10bd8769310b" containerName="run-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.513063 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="635be697-3ad3-4888-88d2-10bd8769310b" containerName="run-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.513273 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="635be697-3ad3-4888-88d2-10bd8769310b" containerName="run-os-edpm-compute-global-edpm-compute-global" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.515128 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.519470 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.519523 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.519950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.520775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.526932 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.538907 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd"] Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ssh-key\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698183 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-inventory\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9n99\" (UniqueName: \"kubernetes.io/projected/f997fd8b-3986-4e20-b4e8-2465344ba505-kube-api-access-c9n99\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.698973 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.699059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.801723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.802743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ssh-key\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.802877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.802979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-inventory\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803171 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-c9n99\" (UniqueName: \"kubernetes.io/projected/f997fd8b-3986-4e20-b4e8-2465344ba505-kube-api-access-c9n99\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803396 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803434 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.803537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.807903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.808152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.809443 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.809720 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ssh-key\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.811095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.813776 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.815263 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.815915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.815955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.816991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.817356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-inventory\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.833291 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9n99\" (UniqueName: \"kubernetes.io/projected/f997fd8b-3986-4e20-b4e8-2465344ba505-kube-api-access-c9n99\") pod \"install-certs-edpm-compute-global-edpm-compute-global-ngpmd\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:48 crc kubenswrapper[4769]: I1121 13:29:48.835635 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:49 crc kubenswrapper[4769]: I1121 13:29:49.193662 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd"] Nov 21 13:29:49 crc kubenswrapper[4769]: W1121 13:29:49.208024 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf997fd8b_3986_4e20_b4e8_2465344ba505.slice/crio-b831175be89e4e809c8e93cad214f1d676dc0d2269a483ddc3c54908636b2f8b WatchSource:0}: Error finding container b831175be89e4e809c8e93cad214f1d676dc0d2269a483ddc3c54908636b2f8b: Status 404 returned error can't find the container with id b831175be89e4e809c8e93cad214f1d676dc0d2269a483ddc3c54908636b2f8b Nov 21 13:29:49 crc kubenswrapper[4769]: I1121 13:29:49.491615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" event={"ID":"f997fd8b-3986-4e20-b4e8-2465344ba505","Type":"ContainerStarted","Data":"b831175be89e4e809c8e93cad214f1d676dc0d2269a483ddc3c54908636b2f8b"} Nov 21 13:29:51 crc kubenswrapper[4769]: I1121 13:29:51.525717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" event={"ID":"f997fd8b-3986-4e20-b4e8-2465344ba505","Type":"ContainerStarted","Data":"8a03c7f8d131834c8f170128c76a66663dfa0f1e866b221ebb3976555178a4a8"} Nov 21 13:29:51 crc kubenswrapper[4769]: I1121 13:29:51.559875 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" podStartSLOduration=2.564238118 podStartE2EDuration="3.559848304s" podCreationTimestamp="2025-11-21 13:29:48 +0000 UTC" firstStartedPulling="2025-11-21 13:29:49.212788617 +0000 UTC m=+5947.913450435" lastFinishedPulling="2025-11-21 13:29:50.208398793 +0000 UTC m=+5948.909060621" observedRunningTime="2025-11-21 13:29:51.557938624 +0000 UTC m=+5950.258600532" watchObservedRunningTime="2025-11-21 13:29:51.559848304 +0000 UTC m=+5950.260510162" Nov 21 13:29:52 crc kubenswrapper[4769]: I1121 13:29:52.542775 4769 generic.go:334] "Generic (PLEG): container finished" podID="f997fd8b-3986-4e20-b4e8-2465344ba505" containerID="8a03c7f8d131834c8f170128c76a66663dfa0f1e866b221ebb3976555178a4a8" exitCode=0 Nov 21 13:29:52 crc kubenswrapper[4769]: I1121 13:29:52.542949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" event={"ID":"f997fd8b-3986-4e20-b4e8-2465344ba505","Type":"ContainerDied","Data":"8a03c7f8d131834c8f170128c76a66663dfa0f1e866b221ebb3976555178a4a8"} Nov 21 13:29:53 crc kubenswrapper[4769]: I1121 13:29:53.970315 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.114969 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ovn-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115076 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-sriov-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9n99\" (UniqueName: \"kubernetes.io/projected/f997fd8b-3986-4e20-b4e8-2465344ba505-kube-api-access-c9n99\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115353 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-nova-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-libvirt-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115574 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-metadata-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-inventory\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115708 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ssh-key\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-dhcp-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.115814 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-custom-global-service-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.116015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-ovn-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.116103 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-bootstrap-combined-ca-bundle\") pod \"f997fd8b-3986-4e20-b4e8-2465344ba505\" (UID: \"f997fd8b-3986-4e20-b4e8-2465344ba505\") " Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.121718 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.122060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.122433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.123843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.123960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f997fd8b-3986-4e20-b4e8-2465344ba505-kube-api-access-c9n99" (OuterVolumeSpecName: "kube-api-access-c9n99") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "kube-api-access-c9n99". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.124854 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.125500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.128146 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.128914 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.129114 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.152842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.164597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-inventory" (OuterVolumeSpecName: "inventory") pod "f997fd8b-3986-4e20-b4e8-2465344ba505" (UID: "f997fd8b-3986-4e20-b4e8-2465344ba505"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220725 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-c9n99\" (UniqueName: \"kubernetes.io/projected/f997fd8b-3986-4e20-b4e8-2465344ba505-kube-api-access-c9n99\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220767 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220777 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220787 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220799 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220808 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220817 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220827 4769 reconciler_common.go:293] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220836 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220846 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220858 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.220867 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f997fd8b-3986-4e20-b4e8-2465344ba505-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.572511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" event={"ID":"f997fd8b-3986-4e20-b4e8-2465344ba505","Type":"ContainerDied","Data":"b831175be89e4e809c8e93cad214f1d676dc0d2269a483ddc3c54908636b2f8b"} Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.572561 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b831175be89e4e809c8e93cad214f1d676dc0d2269a483ddc3c54908636b2f8b" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.572566 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.663044 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7"] Nov 21 13:29:54 crc kubenswrapper[4769]: E1121 13:29:54.663668 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f997fd8b-3986-4e20-b4e8-2465344ba505" containerName="install-certs-edpm-compute-global-edpm-compute-global" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.663715 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f997fd8b-3986-4e20-b4e8-2465344ba505" containerName="install-certs-edpm-compute-global-edpm-compute-global" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.664051 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f997fd8b-3986-4e20-b4e8-2465344ba505" containerName="install-certs-edpm-compute-global-edpm-compute-global" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.664768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.667987 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.668241 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.669713 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.669745 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-config" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.670314 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.678595 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.697337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7"] Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.729066 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ssh-key\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.729173 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.729248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/95ef9154-1cbb-4b8d-af15-623088396f36-ovncontroller-config-0\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.729292 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbvk\" (UniqueName: \"kubernetes.io/projected/95ef9154-1cbb-4b8d-af15-623088396f36-kube-api-access-2sbvk\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.729317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-inventory\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.830896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ssh-key\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.831464 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.831533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/95ef9154-1cbb-4b8d-af15-623088396f36-ovncontroller-config-0\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.833133 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/95ef9154-1cbb-4b8d-af15-623088396f36-ovncontroller-config-0\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.833287 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbvk\" (UniqueName: \"kubernetes.io/projected/95ef9154-1cbb-4b8d-af15-623088396f36-kube-api-access-2sbvk\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.833341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-inventory\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.837301 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.839033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ssh-key\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.840057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-inventory\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.860765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbvk\" (UniqueName: \"kubernetes.io/projected/95ef9154-1cbb-4b8d-af15-623088396f36-kube-api-access-2sbvk\") pod \"ovn-edpm-compute-global-edpm-compute-global-fshq7\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:54 crc kubenswrapper[4769]: I1121 13:29:54.983476 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:55 crc kubenswrapper[4769]: I1121 13:29:55.274695 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:29:55 crc kubenswrapper[4769]: E1121 13:29:55.275049 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:29:55 crc kubenswrapper[4769]: I1121 13:29:55.316650 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7"] Nov 21 13:29:55 crc kubenswrapper[4769]: W1121 13:29:55.323858 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95ef9154_1cbb_4b8d_af15_623088396f36.slice/crio-f9888d16249751a0422a575002b9637f1c44a217c279fc3d91023fcff76519a4 WatchSource:0}: Error finding container f9888d16249751a0422a575002b9637f1c44a217c279fc3d91023fcff76519a4: Status 404 returned error can't find the container with id f9888d16249751a0422a575002b9637f1c44a217c279fc3d91023fcff76519a4 Nov 21 13:29:55 crc kubenswrapper[4769]: I1121 13:29:55.600429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" event={"ID":"95ef9154-1cbb-4b8d-af15-623088396f36","Type":"ContainerStarted","Data":"f9888d16249751a0422a575002b9637f1c44a217c279fc3d91023fcff76519a4"} Nov 21 13:29:56 crc kubenswrapper[4769]: I1121 13:29:56.615819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" event={"ID":"95ef9154-1cbb-4b8d-af15-623088396f36","Type":"ContainerStarted","Data":"6a2aa7ed3ef17d7509bac47a9cb9209d424e89e1083707dc5e95ee525e3703fd"} Nov 21 13:29:56 crc kubenswrapper[4769]: I1121 13:29:56.640294 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" podStartSLOduration=2.051523775 podStartE2EDuration="2.640263762s" podCreationTimestamp="2025-11-21 13:29:54 +0000 UTC" firstStartedPulling="2025-11-21 13:29:55.327379418 +0000 UTC m=+5954.028041246" lastFinishedPulling="2025-11-21 13:29:55.916119405 +0000 UTC m=+5954.616781233" observedRunningTime="2025-11-21 13:29:56.638610078 +0000 UTC m=+5955.339271976" watchObservedRunningTime="2025-11-21 13:29:56.640263762 +0000 UTC m=+5955.340925640" Nov 21 13:29:57 crc kubenswrapper[4769]: I1121 13:29:57.631165 4769 generic.go:334] "Generic (PLEG): container finished" podID="95ef9154-1cbb-4b8d-af15-623088396f36" containerID="6a2aa7ed3ef17d7509bac47a9cb9209d424e89e1083707dc5e95ee525e3703fd" exitCode=0 Nov 21 13:29:57 crc kubenswrapper[4769]: I1121 13:29:57.631363 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" event={"ID":"95ef9154-1cbb-4b8d-af15-623088396f36","Type":"ContainerDied","Data":"6a2aa7ed3ef17d7509bac47a9cb9209d424e89e1083707dc5e95ee525e3703fd"} Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.005616 4769 scope.go:117] "RemoveContainer" containerID="d075a66075a632d2de68d442c1cc583ed5c59a569c329ed713b7cb4da2b7f525" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.053825 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.082347 4769 scope.go:117] "RemoveContainer" containerID="f64d2bc57c57a71190be05e671bb1c457619526945c17ab314e1f5b71413d4a2" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.109293 4769 scope.go:117] "RemoveContainer" containerID="042b1d0b935aa62be0f611d8c6dc9f0f79c51fdf863fdcaad51c73d08a3c2379" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.119748 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ovn-combined-ca-bundle\") pod \"95ef9154-1cbb-4b8d-af15-623088396f36\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.119797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/95ef9154-1cbb-4b8d-af15-623088396f36-ovncontroller-config-0\") pod \"95ef9154-1cbb-4b8d-af15-623088396f36\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.119881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sbvk\" (UniqueName: \"kubernetes.io/projected/95ef9154-1cbb-4b8d-af15-623088396f36-kube-api-access-2sbvk\") pod \"95ef9154-1cbb-4b8d-af15-623088396f36\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.119945 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-inventory\") pod \"95ef9154-1cbb-4b8d-af15-623088396f36\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.119982 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ssh-key\") pod \"95ef9154-1cbb-4b8d-af15-623088396f36\" (UID: \"95ef9154-1cbb-4b8d-af15-623088396f36\") " Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.127347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "95ef9154-1cbb-4b8d-af15-623088396f36" (UID: "95ef9154-1cbb-4b8d-af15-623088396f36"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.128105 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ef9154-1cbb-4b8d-af15-623088396f36-kube-api-access-2sbvk" (OuterVolumeSpecName: "kube-api-access-2sbvk") pod "95ef9154-1cbb-4b8d-af15-623088396f36" (UID: "95ef9154-1cbb-4b8d-af15-623088396f36"). InnerVolumeSpecName "kube-api-access-2sbvk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.150714 4769 scope.go:117] "RemoveContainer" containerID="3f787a2b66dd0895ca1896e220fa1d6ebe3229d45c182d7b4edcb501219aa2fe" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.156559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-inventory" (OuterVolumeSpecName: "inventory") pod "95ef9154-1cbb-4b8d-af15-623088396f36" (UID: "95ef9154-1cbb-4b8d-af15-623088396f36"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.161004 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "95ef9154-1cbb-4b8d-af15-623088396f36" (UID: "95ef9154-1cbb-4b8d-af15-623088396f36"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.161402 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ef9154-1cbb-4b8d-af15-623088396f36-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "95ef9154-1cbb-4b8d-af15-623088396f36" (UID: "95ef9154-1cbb-4b8d-af15-623088396f36"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.221660 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.221858 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.221922 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95ef9154-1cbb-4b8d-af15-623088396f36-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.221990 4769 reconciler_common.go:293] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/95ef9154-1cbb-4b8d-af15-623088396f36-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.222053 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2sbvk\" (UniqueName: \"kubernetes.io/projected/95ef9154-1cbb-4b8d-af15-623088396f36-kube-api-access-2sbvk\") on node \"crc\" DevicePath \"\"" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.241881 4769 scope.go:117] "RemoveContainer" containerID="51c82d1abe313c608e8cfb5b329634aa1bb7af7491c585fda31de62cdc267828" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.274903 4769 scope.go:117] "RemoveContainer" containerID="2ed99484568493e535ea4e8cc2f2dc6ce9258eeaf828bdd2e04830029be8d004" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.319550 4769 scope.go:117] "RemoveContainer" containerID="d47834be36b3b8424947e2ec37cd955af4c78a9889f24e5ec2d3bc3c33b442ad" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.356707 4769 scope.go:117] "RemoveContainer" containerID="1e8d609f3478e330fa2af2d42a4790e25b430fee1075df86f4fcfe6c7147be58" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.395704 4769 scope.go:117] "RemoveContainer" containerID="c6d239fc1939be310f5bcd366fc6fdf9ec2dbd5126149f75ac259820c40d6b2f" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.419783 4769 scope.go:117] "RemoveContainer" containerID="c8c8acbaa3d7dac4a90d7287898b59d5fe457dc4f4647765a6926a222fb25e6c" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.443775 4769 scope.go:117] "RemoveContainer" containerID="0164617c683f651c195f2757ec57bffae8ad263ad2047e33a3fcd9f12edeb133" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.463675 4769 scope.go:117] "RemoveContainer" containerID="2625031a0b0c2bbf67b35c39fd280fdbab221bfd025c71f05cfb0b8e055e826b" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.485487 4769 scope.go:117] "RemoveContainer" containerID="082eaeb455b6e1ceeac08a63cbd1e880fada5c9f6876b7f9ffb31bd34dd44d10" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.533995 4769 scope.go:117] "RemoveContainer" containerID="51fa27bf5185af42d96749f1c1646e10b496d74f5e164127ba90189d401e2542" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.601124 4769 scope.go:117] "RemoveContainer" containerID="3c169290cfcc7523a06e3f4b57928f8e228b6c58975946280505f93af4d539a5" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.639543 4769 scope.go:117] "RemoveContainer" containerID="8382848fbfe153f4d42cf2f5b79786927fc3410074b27bb4775d8e829bec5e07" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.663835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" event={"ID":"95ef9154-1cbb-4b8d-af15-623088396f36","Type":"ContainerDied","Data":"f9888d16249751a0422a575002b9637f1c44a217c279fc3d91023fcff76519a4"} Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.663882 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9888d16249751a0422a575002b9637f1c44a217c279fc3d91023fcff76519a4" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.663938 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.667216 4769 scope.go:117] "RemoveContainer" containerID="417fa1bd93e0a00bed8d1bb4d7264141d52f2d44f4c500c18a7c4af683f89767" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.714753 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq"] Nov 21 13:29:59 crc kubenswrapper[4769]: E1121 13:29:59.715218 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95ef9154-1cbb-4b8d-af15-623088396f36" containerName="ovn-edpm-compute-global-edpm-compute-global" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.715238 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ef9154-1cbb-4b8d-af15-623088396f36" containerName="ovn-edpm-compute-global-edpm-compute-global" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.715408 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95ef9154-1cbb-4b8d-af15-623088396f36" containerName="ovn-edpm-compute-global-edpm-compute-global" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.715995 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.720319 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-neutron-config" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.720687 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.720911 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.721116 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.721150 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-metadata-agent-neutron-config" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.721175 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.721341 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.728064 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq"] Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.838713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.838777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-ssh-key\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.838846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.838908 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.838970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdkp\" (UniqueName: \"kubernetes.io/projected/5b884669-a403-48e5-9741-5e89dcaec5d3-kube-api-access-nkdkp\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.839005 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.839072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-inventory\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.839202 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdkp\" (UniqueName: \"kubernetes.io/projected/5b884669-a403-48e5-9741-5e89dcaec5d3-kube-api-access-nkdkp\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940623 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-inventory\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-ssh-key\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.940798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.945485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.945721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.946824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-ssh-key\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.947033 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.947389 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.947959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.955316 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-inventory\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:29:59 crc kubenswrapper[4769]: I1121 13:29:59.970272 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdkp\" (UniqueName: \"kubernetes.io/projected/5b884669-a403-48e5-9741-5e89dcaec5d3-kube-api-access-nkdkp\") pod \"neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.041699 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.148002 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r"] Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.149648 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.167217 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.167273 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.195283 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r"] Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.247074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45zt\" (UniqueName: \"kubernetes.io/projected/86515347-cf8b-47ee-b0b5-8f3cef8812bc-kube-api-access-j45zt\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.247142 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/86515347-cf8b-47ee-b0b5-8f3cef8812bc-secret-volume\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.247205 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86515347-cf8b-47ee-b0b5-8f3cef8812bc-config-volume\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.349604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j45zt\" (UniqueName: \"kubernetes.io/projected/86515347-cf8b-47ee-b0b5-8f3cef8812bc-kube-api-access-j45zt\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.349672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/86515347-cf8b-47ee-b0b5-8f3cef8812bc-secret-volume\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.349711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86515347-cf8b-47ee-b0b5-8f3cef8812bc-config-volume\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.350789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86515347-cf8b-47ee-b0b5-8f3cef8812bc-config-volume\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.356008 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/86515347-cf8b-47ee-b0b5-8f3cef8812bc-secret-volume\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.371170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45zt\" (UniqueName: \"kubernetes.io/projected/86515347-cf8b-47ee-b0b5-8f3cef8812bc-kube-api-access-j45zt\") pod \"collect-profiles-29395530-kr89r\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.500084 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.544000 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq"] Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.685431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" event={"ID":"5b884669-a403-48e5-9741-5e89dcaec5d3","Type":"ContainerStarted","Data":"e302b943539c3560ee233ba8077bda523b7a7507cffce4744f8b99d9e0315b6a"} Nov 21 13:30:00 crc kubenswrapper[4769]: I1121 13:30:00.795632 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r"] Nov 21 13:30:00 crc kubenswrapper[4769]: W1121 13:30:00.798826 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86515347_cf8b_47ee_b0b5_8f3cef8812bc.slice/crio-a678cd18e27e7945b40c8eebeca06a8de8f7c9013f33c23b24284085776828c4 WatchSource:0}: Error finding container a678cd18e27e7945b40c8eebeca06a8de8f7c9013f33c23b24284085776828c4: Status 404 returned error can't find the container with id a678cd18e27e7945b40c8eebeca06a8de8f7c9013f33c23b24284085776828c4 Nov 21 13:30:01 crc kubenswrapper[4769]: I1121 13:30:01.698546 4769 generic.go:334] "Generic (PLEG): container finished" podID="86515347-cf8b-47ee-b0b5-8f3cef8812bc" containerID="f9d8ba5644cf0e2defe684b71260a5d1616605197bf6b0502c4724644a35e263" exitCode=0 Nov 21 13:30:01 crc kubenswrapper[4769]: I1121 13:30:01.698623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" event={"ID":"86515347-cf8b-47ee-b0b5-8f3cef8812bc","Type":"ContainerDied","Data":"f9d8ba5644cf0e2defe684b71260a5d1616605197bf6b0502c4724644a35e263"} Nov 21 13:30:01 crc kubenswrapper[4769]: I1121 13:30:01.698918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" event={"ID":"86515347-cf8b-47ee-b0b5-8f3cef8812bc","Type":"ContainerStarted","Data":"a678cd18e27e7945b40c8eebeca06a8de8f7c9013f33c23b24284085776828c4"} Nov 21 13:30:01 crc kubenswrapper[4769]: I1121 13:30:01.701226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" event={"ID":"5b884669-a403-48e5-9741-5e89dcaec5d3","Type":"ContainerStarted","Data":"8c9ef2f09ec9eee0ddf3739ec713973eeff97ba22d4fdd45c0693a3772e26058"} Nov 21 13:30:01 crc kubenswrapper[4769]: I1121 13:30:01.741111 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" podStartSLOduration=2.234579336 podStartE2EDuration="2.741087882s" podCreationTimestamp="2025-11-21 13:29:59 +0000 UTC" firstStartedPulling="2025-11-21 13:30:00.556535205 +0000 UTC m=+5959.257197063" lastFinishedPulling="2025-11-21 13:30:01.063043771 +0000 UTC m=+5959.763705609" observedRunningTime="2025-11-21 13:30:01.733680278 +0000 UTC m=+5960.434342126" watchObservedRunningTime="2025-11-21 13:30:01.741087882 +0000 UTC m=+5960.441749740" Nov 21 13:30:02 crc kubenswrapper[4769]: I1121 13:30:02.723472 4769 generic.go:334] "Generic (PLEG): container finished" podID="5b884669-a403-48e5-9741-5e89dcaec5d3" containerID="8c9ef2f09ec9eee0ddf3739ec713973eeff97ba22d4fdd45c0693a3772e26058" exitCode=0 Nov 21 13:30:02 crc kubenswrapper[4769]: I1121 13:30:02.723722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" event={"ID":"5b884669-a403-48e5-9741-5e89dcaec5d3","Type":"ContainerDied","Data":"8c9ef2f09ec9eee0ddf3739ec713973eeff97ba22d4fdd45c0693a3772e26058"} Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.122167 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.196439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86515347-cf8b-47ee-b0b5-8f3cef8812bc-config-volume\") pod \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.196571 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/86515347-cf8b-47ee-b0b5-8f3cef8812bc-secret-volume\") pod \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.196667 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j45zt\" (UniqueName: \"kubernetes.io/projected/86515347-cf8b-47ee-b0b5-8f3cef8812bc-kube-api-access-j45zt\") pod \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\" (UID: \"86515347-cf8b-47ee-b0b5-8f3cef8812bc\") " Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.197650 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86515347-cf8b-47ee-b0b5-8f3cef8812bc-config-volume" (OuterVolumeSpecName: "config-volume") pod "86515347-cf8b-47ee-b0b5-8f3cef8812bc" (UID: "86515347-cf8b-47ee-b0b5-8f3cef8812bc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.198180 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/86515347-cf8b-47ee-b0b5-8f3cef8812bc-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.207068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86515347-cf8b-47ee-b0b5-8f3cef8812bc-kube-api-access-j45zt" (OuterVolumeSpecName: "kube-api-access-j45zt") pod "86515347-cf8b-47ee-b0b5-8f3cef8812bc" (UID: "86515347-cf8b-47ee-b0b5-8f3cef8812bc"). InnerVolumeSpecName "kube-api-access-j45zt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.211369 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86515347-cf8b-47ee-b0b5-8f3cef8812bc-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "86515347-cf8b-47ee-b0b5-8f3cef8812bc" (UID: "86515347-cf8b-47ee-b0b5-8f3cef8812bc"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.299225 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/86515347-cf8b-47ee-b0b5-8f3cef8812bc-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.299503 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j45zt\" (UniqueName: \"kubernetes.io/projected/86515347-cf8b-47ee-b0b5-8f3cef8812bc-kube-api-access-j45zt\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.738080 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" event={"ID":"86515347-cf8b-47ee-b0b5-8f3cef8812bc","Type":"ContainerDied","Data":"a678cd18e27e7945b40c8eebeca06a8de8f7c9013f33c23b24284085776828c4"} Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.738436 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a678cd18e27e7945b40c8eebeca06a8de8f7c9013f33c23b24284085776828c4" Nov 21 13:30:03 crc kubenswrapper[4769]: I1121 13:30:03.738153 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.047438 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.113598 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-ovn-metadata-agent-neutron-config-0\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.113776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-2\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.113838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-ssh-key\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.113878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-0\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.113918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-metadata-combined-ca-bundle\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.113961 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkdkp\" (UniqueName: \"kubernetes.io/projected/5b884669-a403-48e5-9741-5e89dcaec5d3-kube-api-access-nkdkp\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.114155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-1\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.114241 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-inventory\") pod \"5b884669-a403-48e5-9741-5e89dcaec5d3\" (UID: \"5b884669-a403-48e5-9741-5e89dcaec5d3\") " Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.118680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b884669-a403-48e5-9741-5e89dcaec5d3-kube-api-access-nkdkp" (OuterVolumeSpecName: "kube-api-access-nkdkp") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "kube-api-access-nkdkp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.119344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.138381 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.147029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.148374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.148852 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.163991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.167320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-inventory" (OuterVolumeSpecName: "inventory") pod "5b884669-a403-48e5-9741-5e89dcaec5d3" (UID: "5b884669-a403-48e5-9741-5e89dcaec5d3"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.204945 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm"] Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.212622 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395485-vf4pm"] Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215863 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215895 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215909 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215927 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nkdkp\" (UniqueName: \"kubernetes.io/projected/5b884669-a403-48e5-9741-5e89dcaec5d3-kube-api-access-nkdkp\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215941 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215955 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215970 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.215984 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/5b884669-a403-48e5-9741-5e89dcaec5d3-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.752479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" event={"ID":"5b884669-a403-48e5-9741-5e89dcaec5d3","Type":"ContainerDied","Data":"e302b943539c3560ee233ba8077bda523b7a7507cffce4744f8b99d9e0315b6a"} Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.753844 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e302b943539c3560ee233ba8077bda523b7a7507cffce4744f8b99d9e0315b6a" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.752619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.869703 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7"] Nov 21 13:30:04 crc kubenswrapper[4769]: E1121 13:30:04.870272 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5b884669-a403-48e5-9741-5e89dcaec5d3" containerName="neutron-metadata-edpm-compute-global-edpm-compute-global" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.870305 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b884669-a403-48e5-9741-5e89dcaec5d3" containerName="neutron-metadata-edpm-compute-global-edpm-compute-global" Nov 21 13:30:04 crc kubenswrapper[4769]: E1121 13:30:04.870324 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="86515347-cf8b-47ee-b0b5-8f3cef8812bc" containerName="collect-profiles" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.870336 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="86515347-cf8b-47ee-b0b5-8f3cef8812bc" containerName="collect-profiles" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.870597 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5b884669-a403-48e5-9741-5e89dcaec5d3" containerName="neutron-metadata-edpm-compute-global-edpm-compute-global" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.870626 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="86515347-cf8b-47ee-b0b5-8f3cef8812bc" containerName="collect-profiles" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.871450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.875987 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-agent-neutron-config" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.876646 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.876926 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.877232 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.879737 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.880518 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.894372 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7"] Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.926410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-ssh-key\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.926458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-inventory\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.926521 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.926587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqf46\" (UniqueName: \"kubernetes.io/projected/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-kube-api-access-gqf46\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:04 crc kubenswrapper[4769]: I1121 13:30:04.926696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.028280 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gqf46\" (UniqueName: \"kubernetes.io/projected/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-kube-api-access-gqf46\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.028401 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.028487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-ssh-key\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.028525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-inventory\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.028617 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.037303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-inventory\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.037491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.041930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-ssh-key\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.043364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.056355 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqf46\" (UniqueName: \"kubernetes.io/projected/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-kube-api-access-gqf46\") pod \"neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.195866 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.295836 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4474e22a-06ba-4064-beae-c2a9748add3d" path="/var/lib/kubelet/pods/4474e22a-06ba-4064-beae-c2a9748add3d/volumes" Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.665168 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7"] Nov 21 13:30:05 crc kubenswrapper[4769]: I1121 13:30:05.768311 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" event={"ID":"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c","Type":"ContainerStarted","Data":"0e07601fdc159ca232198b96fefbfb37c940d3a3e8082aba106090e180b893b5"} Nov 21 13:30:06 crc kubenswrapper[4769]: I1121 13:30:06.783402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" event={"ID":"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c","Type":"ContainerStarted","Data":"26dd8c9e6b3cc8ad4cc9136d281480066d5dea4e95b2460d38ea0c967de2200f"} Nov 21 13:30:06 crc kubenswrapper[4769]: I1121 13:30:06.809222 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" podStartSLOduration=2.391492104 podStartE2EDuration="2.809165627s" podCreationTimestamp="2025-11-21 13:30:04 +0000 UTC" firstStartedPulling="2025-11-21 13:30:05.679632008 +0000 UTC m=+5964.380293836" lastFinishedPulling="2025-11-21 13:30:06.097305501 +0000 UTC m=+5964.797967359" observedRunningTime="2025-11-21 13:30:06.808069828 +0000 UTC m=+5965.508731646" watchObservedRunningTime="2025-11-21 13:30:06.809165627 +0000 UTC m=+5965.509827445" Nov 21 13:30:07 crc kubenswrapper[4769]: I1121 13:30:07.798144 4769 generic.go:334] "Generic (PLEG): container finished" podID="193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" containerID="26dd8c9e6b3cc8ad4cc9136d281480066d5dea4e95b2460d38ea0c967de2200f" exitCode=0 Nov 21 13:30:07 crc kubenswrapper[4769]: I1121 13:30:07.798245 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" event={"ID":"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c","Type":"ContainerDied","Data":"26dd8c9e6b3cc8ad4cc9136d281480066d5dea4e95b2460d38ea0c967de2200f"} Nov 21 13:30:08 crc kubenswrapper[4769]: I1121 13:30:08.273916 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:30:08 crc kubenswrapper[4769]: E1121 13:30:08.274478 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.170016 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.200295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-inventory\") pod \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.200389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-agent-neutron-config-0\") pod \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.200445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-ssh-key\") pod \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.200527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-combined-ca-bundle\") pod \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.200593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqf46\" (UniqueName: \"kubernetes.io/projected/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-kube-api-access-gqf46\") pod \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\" (UID: \"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c\") " Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.213376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-kube-api-access-gqf46" (OuterVolumeSpecName: "kube-api-access-gqf46") pod "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" (UID: "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c"). InnerVolumeSpecName "kube-api-access-gqf46". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.215127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" (UID: "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.220241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" (UID: "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.221502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-inventory" (OuterVolumeSpecName: "inventory") pod "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" (UID: "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.227136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" (UID: "193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.302213 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.302248 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.302264 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gqf46\" (UniqueName: \"kubernetes.io/projected/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-kube-api-access-gqf46\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.302274 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.302284 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.824218 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" event={"ID":"193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c","Type":"ContainerDied","Data":"0e07601fdc159ca232198b96fefbfb37c940d3a3e8082aba106090e180b893b5"} Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.824292 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e07601fdc159ca232198b96fefbfb37c940d3a3e8082aba106090e180b893b5" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.824614 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.895892 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp"] Nov 21 13:30:09 crc kubenswrapper[4769]: E1121 13:30:09.896755 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" containerName="neutron-ovn-edpm-compute-global-edpm-compute-global" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.896786 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" containerName="neutron-ovn-edpm-compute-global-edpm-compute-global" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.897079 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" containerName="neutron-ovn-edpm-compute-global-edpm-compute-global" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.897887 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.909642 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp"] Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.909897 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.910225 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-sriov-agent-neutron-config" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.910671 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.911145 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.911270 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.911185 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.912483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.912541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.912594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-inventory\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.912635 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq74n\" (UniqueName: \"kubernetes.io/projected/b0ffa900-d127-4312-8125-4fcba0d0ef72-kube-api-access-dq74n\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:09 crc kubenswrapper[4769]: I1121 13:30:09.912705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-ssh-key\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.014335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-inventory\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.014405 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dq74n\" (UniqueName: \"kubernetes.io/projected/b0ffa900-d127-4312-8125-4fcba0d0ef72-kube-api-access-dq74n\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.014472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-ssh-key\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.014574 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.014603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.018205 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-inventory\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.018282 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.018427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-ssh-key\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.026821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.034032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq74n\" (UniqueName: \"kubernetes.io/projected/b0ffa900-d127-4312-8125-4fcba0d0ef72-kube-api-access-dq74n\") pod \"neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.223334 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.698592 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp"] Nov 21 13:30:10 crc kubenswrapper[4769]: I1121 13:30:10.841956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" event={"ID":"b0ffa900-d127-4312-8125-4fcba0d0ef72","Type":"ContainerStarted","Data":"acef21e9d4c758543806faf7f400f3440fe2874f67df09028987f02d2400ba6c"} Nov 21 13:30:11 crc kubenswrapper[4769]: I1121 13:30:11.860623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" event={"ID":"b0ffa900-d127-4312-8125-4fcba0d0ef72","Type":"ContainerStarted","Data":"6f8882b9c0d9aa615595934a75f6b25cf9ed6e615ceb3523a760989c1eec614c"} Nov 21 13:30:11 crc kubenswrapper[4769]: I1121 13:30:11.885645 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" podStartSLOduration=2.22368812 podStartE2EDuration="2.885618611s" podCreationTimestamp="2025-11-21 13:30:09 +0000 UTC" firstStartedPulling="2025-11-21 13:30:10.708486857 +0000 UTC m=+5969.409148715" lastFinishedPulling="2025-11-21 13:30:11.370417358 +0000 UTC m=+5970.071079206" observedRunningTime="2025-11-21 13:30:11.883817694 +0000 UTC m=+5970.584479572" watchObservedRunningTime="2025-11-21 13:30:11.885618611 +0000 UTC m=+5970.586280459" Nov 21 13:30:12 crc kubenswrapper[4769]: I1121 13:30:12.879322 4769 generic.go:334] "Generic (PLEG): container finished" podID="b0ffa900-d127-4312-8125-4fcba0d0ef72" containerID="6f8882b9c0d9aa615595934a75f6b25cf9ed6e615ceb3523a760989c1eec614c" exitCode=0 Nov 21 13:30:12 crc kubenswrapper[4769]: I1121 13:30:12.879394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" event={"ID":"b0ffa900-d127-4312-8125-4fcba0d0ef72","Type":"ContainerDied","Data":"6f8882b9c0d9aa615595934a75f6b25cf9ed6e615ceb3523a760989c1eec614c"} Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.272094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.397641 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-combined-ca-bundle\") pod \"b0ffa900-d127-4312-8125-4fcba0d0ef72\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.398032 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-inventory\") pod \"b0ffa900-d127-4312-8125-4fcba0d0ef72\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.398144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-ssh-key\") pod \"b0ffa900-d127-4312-8125-4fcba0d0ef72\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.398375 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-agent-neutron-config-0\") pod \"b0ffa900-d127-4312-8125-4fcba0d0ef72\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.398456 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq74n\" (UniqueName: \"kubernetes.io/projected/b0ffa900-d127-4312-8125-4fcba0d0ef72-kube-api-access-dq74n\") pod \"b0ffa900-d127-4312-8125-4fcba0d0ef72\" (UID: \"b0ffa900-d127-4312-8125-4fcba0d0ef72\") " Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.407592 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "b0ffa900-d127-4312-8125-4fcba0d0ef72" (UID: "b0ffa900-d127-4312-8125-4fcba0d0ef72"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.407894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ffa900-d127-4312-8125-4fcba0d0ef72-kube-api-access-dq74n" (OuterVolumeSpecName: "kube-api-access-dq74n") pod "b0ffa900-d127-4312-8125-4fcba0d0ef72" (UID: "b0ffa900-d127-4312-8125-4fcba0d0ef72"). InnerVolumeSpecName "kube-api-access-dq74n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.431628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "b0ffa900-d127-4312-8125-4fcba0d0ef72" (UID: "b0ffa900-d127-4312-8125-4fcba0d0ef72"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.451792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "b0ffa900-d127-4312-8125-4fcba0d0ef72" (UID: "b0ffa900-d127-4312-8125-4fcba0d0ef72"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.453626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-inventory" (OuterVolumeSpecName: "inventory") pod "b0ffa900-d127-4312-8125-4fcba0d0ef72" (UID: "b0ffa900-d127-4312-8125-4fcba0d0ef72"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.500007 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.500047 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dq74n\" (UniqueName: \"kubernetes.io/projected/b0ffa900-d127-4312-8125-4fcba0d0ef72-kube-api-access-dq74n\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.500065 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.500083 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.500096 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b0ffa900-d127-4312-8125-4fcba0d0ef72-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.902487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" event={"ID":"b0ffa900-d127-4312-8125-4fcba0d0ef72","Type":"ContainerDied","Data":"acef21e9d4c758543806faf7f400f3440fe2874f67df09028987f02d2400ba6c"} Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.902854 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acef21e9d4c758543806faf7f400f3440fe2874f67df09028987f02d2400ba6c" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.902594 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.985766 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m"] Nov 21 13:30:14 crc kubenswrapper[4769]: E1121 13:30:14.986164 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b0ffa900-d127-4312-8125-4fcba0d0ef72" containerName="neutron-sriov-edpm-compute-global-edpm-compute-global" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.986182 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ffa900-d127-4312-8125-4fcba0d0ef72" containerName="neutron-sriov-edpm-compute-global-edpm-compute-global" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.986425 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b0ffa900-d127-4312-8125-4fcba0d0ef72" containerName="neutron-sriov-edpm-compute-global-edpm-compute-global" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.987252 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.992088 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.992788 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.992822 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.993065 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-dhcp-agent-neutron-config" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.993133 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:14 crc kubenswrapper[4769]: I1121 13:30:14.993274 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.002336 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m"] Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.107620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn48n\" (UniqueName: \"kubernetes.io/projected/66dc4420-6960-483d-9950-e3770b108183-kube-api-access-mn48n\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.107668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-inventory\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.107697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.107779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.107818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-ssh-key\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.209358 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.209420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-ssh-key\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.209449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mn48n\" (UniqueName: \"kubernetes.io/projected/66dc4420-6960-483d-9950-e3770b108183-kube-api-access-mn48n\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.209472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-inventory\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.209502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.215006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.215174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-ssh-key\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.217574 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-inventory\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.218995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.241180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn48n\" (UniqueName: \"kubernetes.io/projected/66dc4420-6960-483d-9950-e3770b108183-kube-api-access-mn48n\") pod \"neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.311685 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.830804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m"] Nov 21 13:30:15 crc kubenswrapper[4769]: W1121 13:30:15.832946 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66dc4420_6960_483d_9950_e3770b108183.slice/crio-119b4e9c3e3862edfb5ce8e3e4987575d7ed03517028f369c02d75d0953ca13f WatchSource:0}: Error finding container 119b4e9c3e3862edfb5ce8e3e4987575d7ed03517028f369c02d75d0953ca13f: Status 404 returned error can't find the container with id 119b4e9c3e3862edfb5ce8e3e4987575d7ed03517028f369c02d75d0953ca13f Nov 21 13:30:15 crc kubenswrapper[4769]: I1121 13:30:15.921290 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" event={"ID":"66dc4420-6960-483d-9950-e3770b108183","Type":"ContainerStarted","Data":"119b4e9c3e3862edfb5ce8e3e4987575d7ed03517028f369c02d75d0953ca13f"} Nov 21 13:30:16 crc kubenswrapper[4769]: I1121 13:30:16.934055 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" event={"ID":"66dc4420-6960-483d-9950-e3770b108183","Type":"ContainerStarted","Data":"f5e9f80e4a56f8b2f47cdcec128544bbf316191d7341e57bee5ac75b2fd6693a"} Nov 21 13:30:16 crc kubenswrapper[4769]: I1121 13:30:16.961636 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" podStartSLOduration=2.492072974 podStartE2EDuration="2.961608772s" podCreationTimestamp="2025-11-21 13:30:14 +0000 UTC" firstStartedPulling="2025-11-21 13:30:15.8380438 +0000 UTC m=+5974.538705668" lastFinishedPulling="2025-11-21 13:30:16.307579608 +0000 UTC m=+5975.008241466" observedRunningTime="2025-11-21 13:30:16.95464333 +0000 UTC m=+5975.655305208" watchObservedRunningTime="2025-11-21 13:30:16.961608772 +0000 UTC m=+5975.662270620" Nov 21 13:30:17 crc kubenswrapper[4769]: I1121 13:30:17.948712 4769 generic.go:334] "Generic (PLEG): container finished" podID="66dc4420-6960-483d-9950-e3770b108183" containerID="f5e9f80e4a56f8b2f47cdcec128544bbf316191d7341e57bee5ac75b2fd6693a" exitCode=0 Nov 21 13:30:17 crc kubenswrapper[4769]: I1121 13:30:17.948809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" event={"ID":"66dc4420-6960-483d-9950-e3770b108183","Type":"ContainerDied","Data":"f5e9f80e4a56f8b2f47cdcec128544bbf316191d7341e57bee5ac75b2fd6693a"} Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.414457 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.591823 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-agent-neutron-config-0\") pod \"66dc4420-6960-483d-9950-e3770b108183\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.592001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-ssh-key\") pod \"66dc4420-6960-483d-9950-e3770b108183\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.592115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-inventory\") pod \"66dc4420-6960-483d-9950-e3770b108183\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.592285 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn48n\" (UniqueName: \"kubernetes.io/projected/66dc4420-6960-483d-9950-e3770b108183-kube-api-access-mn48n\") pod \"66dc4420-6960-483d-9950-e3770b108183\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.592369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-combined-ca-bundle\") pod \"66dc4420-6960-483d-9950-e3770b108183\" (UID: \"66dc4420-6960-483d-9950-e3770b108183\") " Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.599897 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66dc4420-6960-483d-9950-e3770b108183-kube-api-access-mn48n" (OuterVolumeSpecName: "kube-api-access-mn48n") pod "66dc4420-6960-483d-9950-e3770b108183" (UID: "66dc4420-6960-483d-9950-e3770b108183"). InnerVolumeSpecName "kube-api-access-mn48n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.602421 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "66dc4420-6960-483d-9950-e3770b108183" (UID: "66dc4420-6960-483d-9950-e3770b108183"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.632681 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-inventory" (OuterVolumeSpecName: "inventory") pod "66dc4420-6960-483d-9950-e3770b108183" (UID: "66dc4420-6960-483d-9950-e3770b108183"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.637240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "66dc4420-6960-483d-9950-e3770b108183" (UID: "66dc4420-6960-483d-9950-e3770b108183"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.638655 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "66dc4420-6960-483d-9950-e3770b108183" (UID: "66dc4420-6960-483d-9950-e3770b108183"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.694691 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mn48n\" (UniqueName: \"kubernetes.io/projected/66dc4420-6960-483d-9950-e3770b108183-kube-api-access-mn48n\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.694750 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.694779 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.694800 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.694823 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/66dc4420-6960-483d-9950-e3770b108183-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.982083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" event={"ID":"66dc4420-6960-483d-9950-e3770b108183","Type":"ContainerDied","Data":"119b4e9c3e3862edfb5ce8e3e4987575d7ed03517028f369c02d75d0953ca13f"} Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.982133 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="119b4e9c3e3862edfb5ce8e3e4987575d7ed03517028f369c02d75d0953ca13f" Nov 21 13:30:19 crc kubenswrapper[4769]: I1121 13:30:19.982372 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.084444 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh"] Nov 21 13:30:20 crc kubenswrapper[4769]: E1121 13:30:20.084842 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66dc4420-6960-483d-9950-e3770b108183" containerName="neutron-dhcp-edpm-compute-global-edpm-compute-global" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.084867 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66dc4420-6960-483d-9950-e3770b108183" containerName="neutron-dhcp-edpm-compute-global-edpm-compute-global" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.085058 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66dc4420-6960-483d-9950-e3770b108183" containerName="neutron-dhcp-edpm-compute-global-edpm-compute-global" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.085644 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.088243 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.088588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.088766 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"libvirt-secret" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.089138 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.089340 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.089817 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.102270 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh"] Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.203078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-inventory\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.203172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.203366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-secret-0\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.203556 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74qgz\" (UniqueName: \"kubernetes.io/projected/ccf0b63d-e38f-48dc-987c-0546137ddb95-kube-api-access-74qgz\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.203604 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-ssh-key\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.273768 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:30:20 crc kubenswrapper[4769]: E1121 13:30:20.274108 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.305474 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-inventory\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.305569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.305657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-secret-0\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.305751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-74qgz\" (UniqueName: \"kubernetes.io/projected/ccf0b63d-e38f-48dc-987c-0546137ddb95-kube-api-access-74qgz\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.305797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-ssh-key\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.310070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.310686 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-inventory\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.310743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-ssh-key\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.316768 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-secret-0\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.333474 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-74qgz\" (UniqueName: \"kubernetes.io/projected/ccf0b63d-e38f-48dc-987c-0546137ddb95-kube-api-access-74qgz\") pod \"libvirt-edpm-compute-global-edpm-compute-global-wp9nh\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.403899 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:20 crc kubenswrapper[4769]: I1121 13:30:20.663910 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh"] Nov 21 13:30:20 crc kubenswrapper[4769]: W1121 13:30:20.666227 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccf0b63d_e38f_48dc_987c_0546137ddb95.slice/crio-ff714be647ff879d5af7dfe5e1ea5bcf55c73a5cb95924da15c6a912fe10a119 WatchSource:0}: Error finding container ff714be647ff879d5af7dfe5e1ea5bcf55c73a5cb95924da15c6a912fe10a119: Status 404 returned error can't find the container with id ff714be647ff879d5af7dfe5e1ea5bcf55c73a5cb95924da15c6a912fe10a119 Nov 21 13:30:21 crc kubenswrapper[4769]: I1121 13:30:21.000442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" event={"ID":"ccf0b63d-e38f-48dc-987c-0546137ddb95","Type":"ContainerStarted","Data":"ff714be647ff879d5af7dfe5e1ea5bcf55c73a5cb95924da15c6a912fe10a119"} Nov 21 13:30:22 crc kubenswrapper[4769]: I1121 13:30:22.015910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" event={"ID":"ccf0b63d-e38f-48dc-987c-0546137ddb95","Type":"ContainerStarted","Data":"ef59659272e55d987fcd1b7eb02dc35823ed22551a14ece03bc801fa2e9cf8d0"} Nov 21 13:30:22 crc kubenswrapper[4769]: I1121 13:30:22.050125 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" podStartSLOduration=1.640186013 podStartE2EDuration="2.050095403s" podCreationTimestamp="2025-11-21 13:30:20 +0000 UTC" firstStartedPulling="2025-11-21 13:30:20.667906947 +0000 UTC m=+5979.368568785" lastFinishedPulling="2025-11-21 13:30:21.077816357 +0000 UTC m=+5979.778478175" observedRunningTime="2025-11-21 13:30:22.042115914 +0000 UTC m=+5980.742777772" watchObservedRunningTime="2025-11-21 13:30:22.050095403 +0000 UTC m=+5980.750757261" Nov 21 13:30:23 crc kubenswrapper[4769]: I1121 13:30:23.033061 4769 generic.go:334] "Generic (PLEG): container finished" podID="ccf0b63d-e38f-48dc-987c-0546137ddb95" containerID="ef59659272e55d987fcd1b7eb02dc35823ed22551a14ece03bc801fa2e9cf8d0" exitCode=0 Nov 21 13:30:23 crc kubenswrapper[4769]: I1121 13:30:23.033457 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" event={"ID":"ccf0b63d-e38f-48dc-987c-0546137ddb95","Type":"ContainerDied","Data":"ef59659272e55d987fcd1b7eb02dc35823ed22551a14ece03bc801fa2e9cf8d0"} Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.394829 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.487304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-secret-0\") pod \"ccf0b63d-e38f-48dc-987c-0546137ddb95\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.488282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74qgz\" (UniqueName: \"kubernetes.io/projected/ccf0b63d-e38f-48dc-987c-0546137ddb95-kube-api-access-74qgz\") pod \"ccf0b63d-e38f-48dc-987c-0546137ddb95\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.488413 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-ssh-key\") pod \"ccf0b63d-e38f-48dc-987c-0546137ddb95\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.488780 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-inventory\") pod \"ccf0b63d-e38f-48dc-987c-0546137ddb95\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.488830 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-combined-ca-bundle\") pod \"ccf0b63d-e38f-48dc-987c-0546137ddb95\" (UID: \"ccf0b63d-e38f-48dc-987c-0546137ddb95\") " Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.494321 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "ccf0b63d-e38f-48dc-987c-0546137ddb95" (UID: "ccf0b63d-e38f-48dc-987c-0546137ddb95"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.504110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf0b63d-e38f-48dc-987c-0546137ddb95-kube-api-access-74qgz" (OuterVolumeSpecName: "kube-api-access-74qgz") pod "ccf0b63d-e38f-48dc-987c-0546137ddb95" (UID: "ccf0b63d-e38f-48dc-987c-0546137ddb95"). InnerVolumeSpecName "kube-api-access-74qgz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.510043 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "ccf0b63d-e38f-48dc-987c-0546137ddb95" (UID: "ccf0b63d-e38f-48dc-987c-0546137ddb95"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.513048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "ccf0b63d-e38f-48dc-987c-0546137ddb95" (UID: "ccf0b63d-e38f-48dc-987c-0546137ddb95"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.526349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-inventory" (OuterVolumeSpecName: "inventory") pod "ccf0b63d-e38f-48dc-987c-0546137ddb95" (UID: "ccf0b63d-e38f-48dc-987c-0546137ddb95"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.591024 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-74qgz\" (UniqueName: \"kubernetes.io/projected/ccf0b63d-e38f-48dc-987c-0546137ddb95-kube-api-access-74qgz\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.591089 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.591102 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.591115 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:24 crc kubenswrapper[4769]: I1121 13:30:24.591130 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/ccf0b63d-e38f-48dc-987c-0546137ddb95-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.056421 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" event={"ID":"ccf0b63d-e38f-48dc-987c-0546137ddb95","Type":"ContainerDied","Data":"ff714be647ff879d5af7dfe5e1ea5bcf55c73a5cb95924da15c6a912fe10a119"} Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.056680 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff714be647ff879d5af7dfe5e1ea5bcf55c73a5cb95924da15c6a912fe10a119" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.056471 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.113979 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb"] Nov 21 13:30:25 crc kubenswrapper[4769]: E1121 13:30:25.114560 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ccf0b63d-e38f-48dc-987c-0546137ddb95" containerName="libvirt-edpm-compute-global-edpm-compute-global" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.114630 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf0b63d-e38f-48dc-987c-0546137ddb95" containerName="libvirt-edpm-compute-global-edpm-compute-global" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.114847 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ccf0b63d-e38f-48dc-987c-0546137ddb95" containerName="libvirt-edpm-compute-global-edpm-compute-global" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.115375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.117370 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.119683 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-compute-config" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.119844 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.119981 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.120600 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-migration-ssh-key" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.121459 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.121601 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.129983 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb"] Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.198988 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199077 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfx8b\" (UniqueName: \"kubernetes.io/projected/4673ea55-5aa2-436a-a666-08f0978a9626-kube-api-access-jfx8b\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199125 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199149 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-combined-ca-bundle\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199208 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-ssh-key\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.199252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-inventory\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.299851 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.299905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-combined-ca-bundle\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.299929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.299958 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-ssh-key\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.299981 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-inventory\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.300037 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.300069 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.300091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx8b\" (UniqueName: \"kubernetes.io/projected/4673ea55-5aa2-436a-a666-08f0978a9626-kube-api-access-jfx8b\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.304787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.304813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.304794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-combined-ca-bundle\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.305113 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-ssh-key\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.305577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-inventory\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.306089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.315805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.316597 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfx8b\" (UniqueName: \"kubernetes.io/projected/4673ea55-5aa2-436a-a666-08f0978a9626-kube-api-access-jfx8b\") pod \"nova-edpm-compute-global-edpm-compute-global-t6qvb\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.431219 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:25 crc kubenswrapper[4769]: I1121 13:30:25.894621 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb"] Nov 21 13:30:25 crc kubenswrapper[4769]: W1121 13:30:25.900178 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4673ea55_5aa2_436a_a666_08f0978a9626.slice/crio-9f1dc2b5a6acf07ed92f5b03818c6f5272f6adfaa00f533bed958b7df4863a71 WatchSource:0}: Error finding container 9f1dc2b5a6acf07ed92f5b03818c6f5272f6adfaa00f533bed958b7df4863a71: Status 404 returned error can't find the container with id 9f1dc2b5a6acf07ed92f5b03818c6f5272f6adfaa00f533bed958b7df4863a71 Nov 21 13:30:26 crc kubenswrapper[4769]: I1121 13:30:26.065856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" event={"ID":"4673ea55-5aa2-436a-a666-08f0978a9626","Type":"ContainerStarted","Data":"9f1dc2b5a6acf07ed92f5b03818c6f5272f6adfaa00f533bed958b7df4863a71"} Nov 21 13:30:27 crc kubenswrapper[4769]: I1121 13:30:27.078739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" event={"ID":"4673ea55-5aa2-436a-a666-08f0978a9626","Type":"ContainerStarted","Data":"0b47fd97f42e7d7418c949d671a776e512c1828be96f588b395011d8ec32c245"} Nov 21 13:30:27 crc kubenswrapper[4769]: I1121 13:30:27.099815 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" podStartSLOduration=1.595490709 podStartE2EDuration="2.099789976s" podCreationTimestamp="2025-11-21 13:30:25 +0000 UTC" firstStartedPulling="2025-11-21 13:30:25.903427931 +0000 UTC m=+5984.604089759" lastFinishedPulling="2025-11-21 13:30:26.407727168 +0000 UTC m=+5985.108389026" observedRunningTime="2025-11-21 13:30:27.097225259 +0000 UTC m=+5985.797887107" watchObservedRunningTime="2025-11-21 13:30:27.099789976 +0000 UTC m=+5985.800451794" Nov 21 13:30:28 crc kubenswrapper[4769]: I1121 13:30:28.094984 4769 generic.go:334] "Generic (PLEG): container finished" podID="4673ea55-5aa2-436a-a666-08f0978a9626" containerID="0b47fd97f42e7d7418c949d671a776e512c1828be96f588b395011d8ec32c245" exitCode=0 Nov 21 13:30:28 crc kubenswrapper[4769]: I1121 13:30:28.095149 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" event={"ID":"4673ea55-5aa2-436a-a666-08f0978a9626","Type":"ContainerDied","Data":"0b47fd97f42e7d7418c949d671a776e512c1828be96f588b395011d8ec32c245"} Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.397327 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.570960 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-1\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571019 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-ssh-key\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-inventory\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571096 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfx8b\" (UniqueName: \"kubernetes.io/projected/4673ea55-5aa2-436a-a666-08f0978a9626-kube-api-access-jfx8b\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-combined-ca-bundle\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571216 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-1\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571239 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-0\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.571271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-0\") pod \"4673ea55-5aa2-436a-a666-08f0978a9626\" (UID: \"4673ea55-5aa2-436a-a666-08f0978a9626\") " Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.582063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4673ea55-5aa2-436a-a666-08f0978a9626-kube-api-access-jfx8b" (OuterVolumeSpecName: "kube-api-access-jfx8b") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "kube-api-access-jfx8b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.583960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.594458 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.594962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.595373 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.598781 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.606879 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.619815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-inventory" (OuterVolumeSpecName: "inventory") pod "4673ea55-5aa2-436a-a666-08f0978a9626" (UID: "4673ea55-5aa2-436a-a666-08f0978a9626"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673409 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673447 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673460 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673470 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jfx8b\" (UniqueName: \"kubernetes.io/projected/4673ea55-5aa2-436a-a666-08f0978a9626-kube-api-access-jfx8b\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673487 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673495 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673504 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:29 crc kubenswrapper[4769]: I1121 13:30:29.673513 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/4673ea55-5aa2-436a-a666-08f0978a9626-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.115273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" event={"ID":"4673ea55-5aa2-436a-a666-08f0978a9626","Type":"ContainerDied","Data":"9f1dc2b5a6acf07ed92f5b03818c6f5272f6adfaa00f533bed958b7df4863a71"} Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.115323 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f1dc2b5a6acf07ed92f5b03818c6f5272f6adfaa00f533bed958b7df4863a71" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.115382 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.202357 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq"] Nov 21 13:30:30 crc kubenswrapper[4769]: E1121 13:30:30.203021 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4673ea55-5aa2-436a-a666-08f0978a9626" containerName="nova-edpm-compute-global-edpm-compute-global" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.203163 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4673ea55-5aa2-436a-a666-08f0978a9626" containerName="nova-edpm-compute-global-edpm-compute-global" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.203483 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4673ea55-5aa2-436a-a666-08f0978a9626" containerName="nova-edpm-compute-global-edpm-compute-global" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.204218 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.209386 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.209660 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.209700 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.209848 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.210286 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.211609 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq"] Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.383464 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kl8x\" (UniqueName: \"kubernetes.io/projected/9b39b369-12bc-47aa-a198-cfd7153a873f-kube-api-access-2kl8x\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.383687 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.383927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.384091 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-inventory-0\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.484885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.484949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-inventory-0\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.485015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2kl8x\" (UniqueName: \"kubernetes.io/projected/9b39b369-12bc-47aa-a198-cfd7153a873f-kube-api-access-2kl8x\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.485054 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.491830 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.499666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.499996 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-inventory-0\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.519627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kl8x\" (UniqueName: \"kubernetes.io/projected/9b39b369-12bc-47aa-a198-cfd7153a873f-kube-api-access-2kl8x\") pod \"custom-global-service-edpm-compute-global-9l5mq\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.524143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:30 crc kubenswrapper[4769]: I1121 13:30:30.850276 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq"] Nov 21 13:30:31 crc kubenswrapper[4769]: I1121 13:30:31.131887 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" event={"ID":"9b39b369-12bc-47aa-a198-cfd7153a873f","Type":"ContainerStarted","Data":"59a6f480bee09ce5ae67963a19d5c6dffdb7135921328117cb3f13bd32f6ba51"} Nov 21 13:30:32 crc kubenswrapper[4769]: I1121 13:30:32.163943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" event={"ID":"9b39b369-12bc-47aa-a198-cfd7153a873f","Type":"ContainerStarted","Data":"707274123a06609799fb4c6e275902f87ccd36312dd3b8c34c865b6cd39cbb3b"} Nov 21 13:30:32 crc kubenswrapper[4769]: I1121 13:30:32.216998 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" podStartSLOduration=1.634042919 podStartE2EDuration="2.216972664s" podCreationTimestamp="2025-11-21 13:30:30 +0000 UTC" firstStartedPulling="2025-11-21 13:30:30.861660421 +0000 UTC m=+5989.562322239" lastFinishedPulling="2025-11-21 13:30:31.444590146 +0000 UTC m=+5990.145251984" observedRunningTime="2025-11-21 13:30:32.214836858 +0000 UTC m=+5990.915498716" watchObservedRunningTime="2025-11-21 13:30:32.216972664 +0000 UTC m=+5990.917634492" Nov 21 13:30:32 crc kubenswrapper[4769]: I1121 13:30:32.277564 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:30:32 crc kubenswrapper[4769]: E1121 13:30:32.278124 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:30:35 crc kubenswrapper[4769]: I1121 13:30:35.195650 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b39b369-12bc-47aa-a198-cfd7153a873f" containerID="707274123a06609799fb4c6e275902f87ccd36312dd3b8c34c865b6cd39cbb3b" exitCode=0 Nov 21 13:30:35 crc kubenswrapper[4769]: I1121 13:30:35.195765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" event={"ID":"9b39b369-12bc-47aa-a198-cfd7153a873f","Type":"ContainerDied","Data":"707274123a06609799fb4c6e275902f87ccd36312dd3b8c34c865b6cd39cbb3b"} Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.591703 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.786022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-custom-global-service-combined-ca-bundle\") pod \"9b39b369-12bc-47aa-a198-cfd7153a873f\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.786087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-inventory-0\") pod \"9b39b369-12bc-47aa-a198-cfd7153a873f\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.786168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-ssh-key-edpm-compute-global\") pod \"9b39b369-12bc-47aa-a198-cfd7153a873f\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.786331 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kl8x\" (UniqueName: \"kubernetes.io/projected/9b39b369-12bc-47aa-a198-cfd7153a873f-kube-api-access-2kl8x\") pod \"9b39b369-12bc-47aa-a198-cfd7153a873f\" (UID: \"9b39b369-12bc-47aa-a198-cfd7153a873f\") " Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.792034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b39b369-12bc-47aa-a198-cfd7153a873f-kube-api-access-2kl8x" (OuterVolumeSpecName: "kube-api-access-2kl8x") pod "9b39b369-12bc-47aa-a198-cfd7153a873f" (UID: "9b39b369-12bc-47aa-a198-cfd7153a873f"). InnerVolumeSpecName "kube-api-access-2kl8x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.793597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "9b39b369-12bc-47aa-a198-cfd7153a873f" (UID: "9b39b369-12bc-47aa-a198-cfd7153a873f"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.822075 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "9b39b369-12bc-47aa-a198-cfd7153a873f" (UID: "9b39b369-12bc-47aa-a198-cfd7153a873f"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.828202 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-inventory-0" (OuterVolumeSpecName: "inventory-0") pod "9b39b369-12bc-47aa-a198-cfd7153a873f" (UID: "9b39b369-12bc-47aa-a198-cfd7153a873f"). InnerVolumeSpecName "inventory-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.887430 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.887458 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2kl8x\" (UniqueName: \"kubernetes.io/projected/9b39b369-12bc-47aa-a198-cfd7153a873f-kube-api-access-2kl8x\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.887467 4769 reconciler_common.go:293] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:36 crc kubenswrapper[4769]: I1121 13:30:36.887479 4769 reconciler_common.go:293] "Volume detached for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/9b39b369-12bc-47aa-a198-cfd7153a873f-inventory-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.217819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" event={"ID":"9b39b369-12bc-47aa-a198-cfd7153a873f","Type":"ContainerDied","Data":"59a6f480bee09ce5ae67963a19d5c6dffdb7135921328117cb3f13bd32f6ba51"} Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.217857 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59a6f480bee09ce5ae67963a19d5c6dffdb7135921328117cb3f13bd32f6ba51" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.218221 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.810815 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct"] Nov 21 13:30:37 crc kubenswrapper[4769]: E1121 13:30:37.811244 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b39b369-12bc-47aa-a198-cfd7153a873f" containerName="custom-global-service-edpm-compute-global" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.811262 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b39b369-12bc-47aa-a198-cfd7153a873f" containerName="custom-global-service-edpm-compute-global" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.811459 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b39b369-12bc-47aa-a198-cfd7153a873f" containerName="custom-global-service-edpm-compute-global" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.812540 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.814591 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-compute-beta-nodeset" Nov 21 13:30:37 crc kubenswrapper[4769]: I1121 13:30:37.833585 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct"] Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.005345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvv9g\" (UniqueName: \"kubernetes.io/projected/7409b957-839b-4068-9689-233a2751eb20-kube-api-access-xvv9g\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.006025 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-global\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.006092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.006113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-config\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.006134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.107320 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.107366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-config\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.107389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.107445 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xvv9g\" (UniqueName: \"kubernetes.io/projected/7409b957-839b-4068-9689-233a2751eb20-kube-api-access-xvv9g\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.107505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-global\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.108289 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-global\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.108344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.108829 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-config\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.109009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.124649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvv9g\" (UniqueName: \"kubernetes.io/projected/7409b957-839b-4068-9689-233a2751eb20-kube-api-access-xvv9g\") pod \"dnsmasq-dnsmasq-6668544499-jf7ct\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.135749 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:38 crc kubenswrapper[4769]: I1121 13:30:38.394551 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct"] Nov 21 13:30:39 crc kubenswrapper[4769]: I1121 13:30:39.250938 4769 generic.go:334] "Generic (PLEG): container finished" podID="7409b957-839b-4068-9689-233a2751eb20" containerID="b17c7013a8aa0b475d4a7f1a8073dbe60a2d46a198197e92d1b951b1822bb247" exitCode=0 Nov 21 13:30:39 crc kubenswrapper[4769]: I1121 13:30:39.251036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" event={"ID":"7409b957-839b-4068-9689-233a2751eb20","Type":"ContainerDied","Data":"b17c7013a8aa0b475d4a7f1a8073dbe60a2d46a198197e92d1b951b1822bb247"} Nov 21 13:30:39 crc kubenswrapper[4769]: I1121 13:30:39.251213 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" event={"ID":"7409b957-839b-4068-9689-233a2751eb20","Type":"ContainerStarted","Data":"1203fea22265ed9ce3ba09b06aea2adccde6f225e4b96b9b9da8da94757e3f9d"} Nov 21 13:30:40 crc kubenswrapper[4769]: I1121 13:30:40.261829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" event={"ID":"7409b957-839b-4068-9689-233a2751eb20","Type":"ContainerStarted","Data":"7b479499b16ab273b2d962978b3f2d96934d66d517952636900f06d0103ed201"} Nov 21 13:30:40 crc kubenswrapper[4769]: I1121 13:30:40.262332 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:40 crc kubenswrapper[4769]: I1121 13:30:40.286296 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" podStartSLOduration=3.286275334 podStartE2EDuration="3.286275334s" podCreationTimestamp="2025-11-21 13:30:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:30:40.277854704 +0000 UTC m=+5998.978516522" watchObservedRunningTime="2025-11-21 13:30:40.286275334 +0000 UTC m=+5998.986937152" Nov 21 13:30:47 crc kubenswrapper[4769]: I1121 13:30:47.274208 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:30:47 crc kubenswrapper[4769]: E1121 13:30:47.275003 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:30:48 crc kubenswrapper[4769]: I1121 13:30:48.137351 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:30:48 crc kubenswrapper[4769]: I1121 13:30:48.251711 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q"] Nov 21 13:30:48 crc kubenswrapper[4769]: I1121 13:30:48.251974 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerName="dnsmasq-dns" containerID="cri-o://70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c" gracePeriod=10 Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.158620 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.282735 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdcjf\" (UniqueName: \"kubernetes.io/projected/ef52e904-6d2e-4ec5-8757-92dc09083594-kube-api-access-cdcjf\") pod \"ef52e904-6d2e-4ec5-8757-92dc09083594\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.282871 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-config\") pod \"ef52e904-6d2e-4ec5-8757-92dc09083594\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.282920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-edpm-compute-global\") pod \"ef52e904-6d2e-4ec5-8757-92dc09083594\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.283003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-dnsmasq-svc\") pod \"ef52e904-6d2e-4ec5-8757-92dc09083594\" (UID: \"ef52e904-6d2e-4ec5-8757-92dc09083594\") " Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.288385 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef52e904-6d2e-4ec5-8757-92dc09083594-kube-api-access-cdcjf" (OuterVolumeSpecName: "kube-api-access-cdcjf") pod "ef52e904-6d2e-4ec5-8757-92dc09083594" (UID: "ef52e904-6d2e-4ec5-8757-92dc09083594"). InnerVolumeSpecName "kube-api-access-cdcjf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.324957 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "ef52e904-6d2e-4ec5-8757-92dc09083594" (UID: "ef52e904-6d2e-4ec5-8757-92dc09083594"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.335351 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-edpm-compute-global" (OuterVolumeSpecName: "edpm-compute-global") pod "ef52e904-6d2e-4ec5-8757-92dc09083594" (UID: "ef52e904-6d2e-4ec5-8757-92dc09083594"). InnerVolumeSpecName "edpm-compute-global". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.336043 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-config" (OuterVolumeSpecName: "config") pod "ef52e904-6d2e-4ec5-8757-92dc09083594" (UID: "ef52e904-6d2e-4ec5-8757-92dc09083594"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.355292 4769 generic.go:334] "Generic (PLEG): container finished" podID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerID="70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c" exitCode=0 Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.355335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" event={"ID":"ef52e904-6d2e-4ec5-8757-92dc09083594","Type":"ContainerDied","Data":"70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c"} Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.355367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" event={"ID":"ef52e904-6d2e-4ec5-8757-92dc09083594","Type":"ContainerDied","Data":"d28d52ef4eb86cb9c7049838c13d8a4be06f1eda49db6cc02b5c9fddc5ab9b81"} Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.355389 4769 scope.go:117] "RemoveContainer" containerID="70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.355858 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.384858 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.384905 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cdcjf\" (UniqueName: \"kubernetes.io/projected/ef52e904-6d2e-4ec5-8757-92dc09083594-kube-api-access-cdcjf\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.384926 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.384946 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/ef52e904-6d2e-4ec5-8757-92dc09083594-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.409532 4769 scope.go:117] "RemoveContainer" containerID="e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.413489 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q"] Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.420725 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-7d78464677-ck59q"] Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.438853 4769 scope.go:117] "RemoveContainer" containerID="70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c" Nov 21 13:30:49 crc kubenswrapper[4769]: E1121 13:30:49.442369 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c\": container with ID starting with 70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c not found: ID does not exist" containerID="70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.442417 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c"} err="failed to get container status \"70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c\": rpc error: code = NotFound desc = could not find container \"70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c\": container with ID starting with 70e23592e5f6983fe1ee1c8379f64574e77254fc7c0670adf7df3bee9fb5409c not found: ID does not exist" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.442444 4769 scope.go:117] "RemoveContainer" containerID="e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1" Nov 21 13:30:49 crc kubenswrapper[4769]: E1121 13:30:49.443308 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1\": container with ID starting with e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1 not found: ID does not exist" containerID="e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1" Nov 21 13:30:49 crc kubenswrapper[4769]: I1121 13:30:49.443360 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1"} err="failed to get container status \"e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1\": rpc error: code = NotFound desc = could not find container \"e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1\": container with ID starting with e58b9f9b5e462f4c8165bd9f74254e15b72a9f757458da9e27cb2bcb0d693bc1 not found: ID does not exist" Nov 21 13:30:51 crc kubenswrapper[4769]: I1121 13:30:51.287100 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" path="/var/lib/kubelet/pods/ef52e904-6d2e-4ec5-8757-92dc09083594/volumes" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.771714 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8"] Nov 21 13:30:52 crc kubenswrapper[4769]: E1121 13:30:52.772072 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerName="init" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.772085 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerName="init" Nov 21 13:30:52 crc kubenswrapper[4769]: E1121 13:30:52.772112 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerName="dnsmasq-dns" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.772118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerName="dnsmasq-dns" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.772280 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ef52e904-6d2e-4ec5-8757-92dc09083594" containerName="dnsmasq-dns" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.772842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.775296 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.775435 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.775934 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.779285 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.781689 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7"] Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.783020 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.789513 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-beta-nodeset" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.789902 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7"] Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.790019 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-beta-nodeset-dockercfg-s6z4f" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.798554 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8"] Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.946028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.946100 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.946122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.946153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.946200 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9pzr\" (UniqueName: \"kubernetes.io/projected/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-kube-api-access-k9pzr\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:52 crc kubenswrapper[4769]: I1121 13:30:52.946224 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nng5p\" (UniqueName: \"kubernetes.io/projected/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-kube-api-access-nng5p\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.047891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9pzr\" (UniqueName: \"kubernetes.io/projected/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-kube-api-access-k9pzr\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.047947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nng5p\" (UniqueName: \"kubernetes.io/projected/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-kube-api-access-nng5p\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.048003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.048060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.048093 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.048141 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.053127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.053242 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.053582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.055930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.069220 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9pzr\" (UniqueName: \"kubernetes.io/projected/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-kube-api-access-k9pzr\") pod \"download-cache-edpm-multinodeset-edpm-compute-global-75sd8\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.072344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nng5p\" (UniqueName: \"kubernetes.io/projected/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-kube-api-access-nng5p\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.102610 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.111010 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.405378 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8"] Nov 21 13:30:53 crc kubenswrapper[4769]: I1121 13:30:53.651982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7"] Nov 21 13:30:54 crc kubenswrapper[4769]: I1121 13:30:54.426941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" event={"ID":"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b","Type":"ContainerStarted","Data":"56cd16e1798198996fba648152dc48a7d339c341fb23c34bb1cc6ba66bf16274"} Nov 21 13:30:54 crc kubenswrapper[4769]: I1121 13:30:54.429889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" event={"ID":"8d3ae695-2bb8-4b20-ac49-d4e741f1103e","Type":"ContainerStarted","Data":"6abb513d9151c4d60d4bf7577184c68e3f1450d12a0f9be34ca6a9e1c3ceea14"} Nov 21 13:30:55 crc kubenswrapper[4769]: I1121 13:30:55.439781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" event={"ID":"8d3ae695-2bb8-4b20-ac49-d4e741f1103e","Type":"ContainerStarted","Data":"dfaa04fb80695ae0acbae0c9f0190413f7f3dade68a54cf4dc9440c04b4a5d7f"} Nov 21 13:30:55 crc kubenswrapper[4769]: I1121 13:30:55.441383 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" event={"ID":"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b","Type":"ContainerStarted","Data":"0c7d8f0d4a291e93c586e7e3a5cf97abc44001f7dffd50961e74236b19edf340"} Nov 21 13:30:55 crc kubenswrapper[4769]: I1121 13:30:55.465766 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" podStartSLOduration=2.782623964 podStartE2EDuration="3.465747158s" podCreationTimestamp="2025-11-21 13:30:52 +0000 UTC" firstStartedPulling="2025-11-21 13:30:53.65972632 +0000 UTC m=+6012.360388148" lastFinishedPulling="2025-11-21 13:30:54.342849514 +0000 UTC m=+6013.043511342" observedRunningTime="2025-11-21 13:30:55.463935091 +0000 UTC m=+6014.164596979" watchObservedRunningTime="2025-11-21 13:30:55.465747158 +0000 UTC m=+6014.166408996" Nov 21 13:30:55 crc kubenswrapper[4769]: I1121 13:30:55.505837 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" podStartSLOduration=2.664464904 podStartE2EDuration="3.505809966s" podCreationTimestamp="2025-11-21 13:30:52 +0000 UTC" firstStartedPulling="2025-11-21 13:30:53.414948809 +0000 UTC m=+6012.115610627" lastFinishedPulling="2025-11-21 13:30:54.256293871 +0000 UTC m=+6012.956955689" observedRunningTime="2025-11-21 13:30:55.491598104 +0000 UTC m=+6014.192259932" watchObservedRunningTime="2025-11-21 13:30:55.505809966 +0000 UTC m=+6014.206471814" Nov 21 13:30:56 crc kubenswrapper[4769]: I1121 13:30:56.452562 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d3ae695-2bb8-4b20-ac49-d4e741f1103e" containerID="dfaa04fb80695ae0acbae0c9f0190413f7f3dade68a54cf4dc9440c04b4a5d7f" exitCode=0 Nov 21 13:30:56 crc kubenswrapper[4769]: I1121 13:30:56.453029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" event={"ID":"8d3ae695-2bb8-4b20-ac49-d4e741f1103e","Type":"ContainerDied","Data":"dfaa04fb80695ae0acbae0c9f0190413f7f3dade68a54cf4dc9440c04b4a5d7f"} Nov 21 13:30:56 crc kubenswrapper[4769]: I1121 13:30:56.455148 4769 generic.go:334] "Generic (PLEG): container finished" podID="57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" containerID="0c7d8f0d4a291e93c586e7e3a5cf97abc44001f7dffd50961e74236b19edf340" exitCode=0 Nov 21 13:30:56 crc kubenswrapper[4769]: I1121 13:30:56.455209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" event={"ID":"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b","Type":"ContainerDied","Data":"0c7d8f0d4a291e93c586e7e3a5cf97abc44001f7dffd50961e74236b19edf340"} Nov 21 13:30:57 crc kubenswrapper[4769]: I1121 13:30:57.830745 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:57 crc kubenswrapper[4769]: I1121 13:30:57.839138 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.032071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9pzr\" (UniqueName: \"kubernetes.io/projected/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-kube-api-access-k9pzr\") pod \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.032138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-ssh-key\") pod \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.032176 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-ssh-key\") pod \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.032219 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-inventory\") pod \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\" (UID: \"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b\") " Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.032264 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nng5p\" (UniqueName: \"kubernetes.io/projected/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-kube-api-access-nng5p\") pod \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.033102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-inventory\") pod \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\" (UID: \"8d3ae695-2bb8-4b20-ac49-d4e741f1103e\") " Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.037502 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-kube-api-access-nng5p" (OuterVolumeSpecName: "kube-api-access-nng5p") pod "8d3ae695-2bb8-4b20-ac49-d4e741f1103e" (UID: "8d3ae695-2bb8-4b20-ac49-d4e741f1103e"). InnerVolumeSpecName "kube-api-access-nng5p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.041429 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-kube-api-access-k9pzr" (OuterVolumeSpecName: "kube-api-access-k9pzr") pod "57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" (UID: "57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b"). InnerVolumeSpecName "kube-api-access-k9pzr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.052428 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-inventory" (OuterVolumeSpecName: "inventory") pod "57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" (UID: "57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.061899 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" (UID: "57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.062942 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "8d3ae695-2bb8-4b20-ac49-d4e741f1103e" (UID: "8d3ae695-2bb8-4b20-ac49-d4e741f1103e"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.070139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-inventory" (OuterVolumeSpecName: "inventory") pod "8d3ae695-2bb8-4b20-ac49-d4e741f1103e" (UID: "8d3ae695-2bb8-4b20-ac49-d4e741f1103e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.134942 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.134969 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.134979 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.134991 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nng5p\" (UniqueName: \"kubernetes.io/projected/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-kube-api-access-nng5p\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.135000 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8d3ae695-2bb8-4b20-ac49-d4e741f1103e-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.135009 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k9pzr\" (UniqueName: \"kubernetes.io/projected/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b-kube-api-access-k9pzr\") on node \"crc\" DevicePath \"\"" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.483849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" event={"ID":"8d3ae695-2bb8-4b20-ac49-d4e741f1103e","Type":"ContainerDied","Data":"6abb513d9151c4d60d4bf7577184c68e3f1450d12a0f9be34ca6a9e1c3ceea14"} Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.484248 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6abb513d9151c4d60d4bf7577184c68e3f1450d12a0f9be34ca6a9e1c3ceea14" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.483906 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.486358 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" event={"ID":"57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b","Type":"ContainerDied","Data":"56cd16e1798198996fba648152dc48a7d339c341fb23c34bb1cc6ba66bf16274"} Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.486397 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56cd16e1798198996fba648152dc48a7d339c341fb23c34bb1cc6ba66bf16274" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.486455 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.546533 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c"] Nov 21 13:30:58 crc kubenswrapper[4769]: E1121 13:30:58.546877 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d3ae695-2bb8-4b20-ac49-d4e741f1103e" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.546895 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3ae695-2bb8-4b20-ac49-d4e741f1103e" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:30:58 crc kubenswrapper[4769]: E1121 13:30:58.546914 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" containerName="download-cache-edpm-multinodeset-edpm-compute-global" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.546922 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" containerName="download-cache-edpm-multinodeset-edpm-compute-global" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.547080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d3ae695-2bb8-4b20-ac49-d4e741f1103e" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.547092 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" containerName="download-cache-edpm-multinodeset-edpm-compute-global" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.548004 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.549996 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.550667 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-beta-nodeset" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.551556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-beta-nodeset-dockercfg-s6z4f" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.552005 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.552258 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.567718 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c"] Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.574981 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.575064 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mltr4\" (UniqueName: \"kubernetes.io/projected/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-kube-api-access-mltr4\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.575106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.575153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.587941 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm"] Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.588892 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.592858 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.593072 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.613651 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm"] Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.676161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mltr4\" (UniqueName: \"kubernetes.io/projected/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-kube-api-access-mltr4\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.676238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.676305 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.676342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.680764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.681217 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.681314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.695110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mltr4\" (UniqueName: \"kubernetes.io/projected/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-kube-api-access-mltr4\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.777222 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.777290 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.777378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.777446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw5rc\" (UniqueName: \"kubernetes.io/projected/6a38a6af-edaf-4b9e-b616-a43508999994-kube-api-access-cw5rc\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.863429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.878451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.878514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.878568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.878631 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cw5rc\" (UniqueName: \"kubernetes.io/projected/6a38a6af-edaf-4b9e-b616-a43508999994-kube-api-access-cw5rc\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.886847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.887321 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.887692 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.896371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw5rc\" (UniqueName: \"kubernetes.io/projected/6a38a6af-edaf-4b9e-b616-a43508999994-kube-api-access-cw5rc\") pod \"bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:58 crc kubenswrapper[4769]: I1121 13:30:58.903015 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.152996 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm"] Nov 21 13:30:59 crc kubenswrapper[4769]: W1121 13:30:59.154384 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a38a6af_edaf_4b9e_b616_a43508999994.slice/crio-a7bf87fb7c34be6ae8799f2c6938f8d0b44b896dde67416edd6c4feb53924041 WatchSource:0}: Error finding container a7bf87fb7c34be6ae8799f2c6938f8d0b44b896dde67416edd6c4feb53924041: Status 404 returned error can't find the container with id a7bf87fb7c34be6ae8799f2c6938f8d0b44b896dde67416edd6c4feb53924041 Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.319480 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c"] Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.496440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" event={"ID":"6a38a6af-edaf-4b9e-b616-a43508999994","Type":"ContainerStarted","Data":"a7bf87fb7c34be6ae8799f2c6938f8d0b44b896dde67416edd6c4feb53924041"} Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.498558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" event={"ID":"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66","Type":"ContainerStarted","Data":"13cdb2e08b5cd65ed9fd504829c2cfbb6661279231c30a47368a471e753d866f"} Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.902747 4769 scope.go:117] "RemoveContainer" containerID="28fa00088106bd2af81ea2a135e9d01f80cdf4c35440b619adb0f417ec784fc9" Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.929658 4769 scope.go:117] "RemoveContainer" containerID="de581e699c555ad13a35e2d0fc1e302531144b8f66ce87c8d54ac8cb48bc8982" Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.960004 4769 scope.go:117] "RemoveContainer" containerID="c2b897536e16b74534722fe3866f1c98e48ea324bb2a6c7925fc29c40d18fd3f" Nov 21 13:30:59 crc kubenswrapper[4769]: I1121 13:30:59.980171 4769 scope.go:117] "RemoveContainer" containerID="9a3f3fc6300e1fb4b3801f7035c005d1a20e4dfffda72c535482a8a93be7b2e7" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.007119 4769 scope.go:117] "RemoveContainer" containerID="0b89a566aeb617f8a13055ea00accddf2de5816fc2b71b773cbf1ffac6950a8d" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.031653 4769 scope.go:117] "RemoveContainer" containerID="801a5a2e0ae9c34058bc621dfe0405dfcb878e7285d4e358124dc8a802c16f4f" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.046154 4769 scope.go:117] "RemoveContainer" containerID="93f7d4a7522445d06442ec143288d32c058ae426d7d46111b1b7372c33dfa86f" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.063525 4769 scope.go:117] "RemoveContainer" containerID="fbae5a68db3b14c8d0ae0a4906efdf2061d2132564fd2335c419d8b71d43b02e" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.110031 4769 scope.go:117] "RemoveContainer" containerID="657264f8ebb53a43fa5c089677968f587795d955a77f426c19143c4a6ef1df07" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.134776 4769 scope.go:117] "RemoveContainer" containerID="53038e30829e3e1c73043a67ac6c92fecd76e095a9ac67e5c78d14d1a099763c" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.166855 4769 scope.go:117] "RemoveContainer" containerID="8ae65709e63cf2452b103949a5ba8f2dfa3cfcb98302deb471cb811cb6985a5d" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.201839 4769 scope.go:117] "RemoveContainer" containerID="3fef85e8a624512666e3827fea3c0e9bc4b33c17eddbc5371403291aad3c527a" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.224492 4769 scope.go:117] "RemoveContainer" containerID="510cbdebfb1ff5a0015362db6a913954199bb4089aaa4dee916fa8dd02b07d5d" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.245710 4769 scope.go:117] "RemoveContainer" containerID="0b078a6a9935ea3ebb49c2656e7fa2f96c992333f51efedf1ab87fe48d7f65d4" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.264820 4769 scope.go:117] "RemoveContainer" containerID="5adac2918490b2e7c46769264c7951b0c8e6a236d35988472255847e24f782a3" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.299390 4769 scope.go:117] "RemoveContainer" containerID="a7a9e9c182706899fd81f119e340a8b9ac071b17d6858f5b6b34121651f3f41f" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.323849 4769 scope.go:117] "RemoveContainer" containerID="047bda7c2b045be3dbf51477ebf4c2a99d35ee73c160d621262b1cd7eb842910" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.349923 4769 scope.go:117] "RemoveContainer" containerID="987cafdb073ad0e42a9431c56b3a70ebe0c5b03175714202b811c1620dbb3877" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.386696 4769 scope.go:117] "RemoveContainer" containerID="a1a30a2d59b581b75a8813d18c16ca50c00e5f05537bac3200b34d7a6e7943e0" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.407263 4769 scope.go:117] "RemoveContainer" containerID="76956e133473139126f7299214442291e2d5e3d019c0a31198fe4a5a4c20e34f" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.445599 4769 scope.go:117] "RemoveContainer" containerID="a5ac62d77120b0c9972bb763b1099bfe3f2232cca9e8ce39e1255eaa67c20acf" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.509769 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" event={"ID":"6a38a6af-edaf-4b9e-b616-a43508999994","Type":"ContainerStarted","Data":"c0f99b9925bf2589e224c1e4e21884c55431cf77769a709bfd7cd0c27bf218e5"} Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.512934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" event={"ID":"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66","Type":"ContainerStarted","Data":"6dc58fe6b3bc94bec17c325ce571dee6eec0f3e2bd79cba50ff4466c3bef9ea7"} Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.538243 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" podStartSLOduration=2.061326479 podStartE2EDuration="2.53822086s" podCreationTimestamp="2025-11-21 13:30:58 +0000 UTC" firstStartedPulling="2025-11-21 13:30:59.156787754 +0000 UTC m=+6017.857449572" lastFinishedPulling="2025-11-21 13:30:59.633682135 +0000 UTC m=+6018.334343953" observedRunningTime="2025-11-21 13:31:00.531165185 +0000 UTC m=+6019.231827023" watchObservedRunningTime="2025-11-21 13:31:00.53822086 +0000 UTC m=+6019.238882688" Nov 21 13:31:00 crc kubenswrapper[4769]: I1121 13:31:00.558962 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" podStartSLOduration=2.138374113 podStartE2EDuration="2.558944722s" podCreationTimestamp="2025-11-21 13:30:58 +0000 UTC" firstStartedPulling="2025-11-21 13:30:59.320969927 +0000 UTC m=+6018.021631745" lastFinishedPulling="2025-11-21 13:30:59.741540516 +0000 UTC m=+6018.442202354" observedRunningTime="2025-11-21 13:31:00.547677237 +0000 UTC m=+6019.248339075" watchObservedRunningTime="2025-11-21 13:31:00.558944722 +0000 UTC m=+6019.259606540" Nov 21 13:31:01 crc kubenswrapper[4769]: I1121 13:31:01.275047 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:31:01 crc kubenswrapper[4769]: E1121 13:31:01.275569 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:31:01 crc kubenswrapper[4769]: I1121 13:31:01.547984 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a38a6af-edaf-4b9e-b616-a43508999994" containerID="c0f99b9925bf2589e224c1e4e21884c55431cf77769a709bfd7cd0c27bf218e5" exitCode=0 Nov 21 13:31:01 crc kubenswrapper[4769]: I1121 13:31:01.548048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" event={"ID":"6a38a6af-edaf-4b9e-b616-a43508999994","Type":"ContainerDied","Data":"c0f99b9925bf2589e224c1e4e21884c55431cf77769a709bfd7cd0c27bf218e5"} Nov 21 13:31:01 crc kubenswrapper[4769]: I1121 13:31:01.549284 4769 generic.go:334] "Generic (PLEG): container finished" podID="88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" containerID="6dc58fe6b3bc94bec17c325ce571dee6eec0f3e2bd79cba50ff4466c3bef9ea7" exitCode=0 Nov 21 13:31:01 crc kubenswrapper[4769]: I1121 13:31:01.549348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" event={"ID":"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66","Type":"ContainerDied","Data":"6dc58fe6b3bc94bec17c325ce571dee6eec0f3e2bd79cba50ff4466c3bef9ea7"} Nov 21 13:31:02 crc kubenswrapper[4769]: I1121 13:31:02.911256 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:31:02 crc kubenswrapper[4769]: I1121 13:31:02.915774 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049229 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-bootstrap-combined-ca-bundle\") pod \"6a38a6af-edaf-4b9e-b616-a43508999994\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw5rc\" (UniqueName: \"kubernetes.io/projected/6a38a6af-edaf-4b9e-b616-a43508999994-kube-api-access-cw5rc\") pod \"6a38a6af-edaf-4b9e-b616-a43508999994\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049308 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-bootstrap-combined-ca-bundle\") pod \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-inventory\") pod \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-inventory\") pod \"6a38a6af-edaf-4b9e-b616-a43508999994\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mltr4\" (UniqueName: \"kubernetes.io/projected/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-kube-api-access-mltr4\") pod \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-ssh-key\") pod \"6a38a6af-edaf-4b9e-b616-a43508999994\" (UID: \"6a38a6af-edaf-4b9e-b616-a43508999994\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.049573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-ssh-key\") pod \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\" (UID: \"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66\") " Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.056506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "6a38a6af-edaf-4b9e-b616-a43508999994" (UID: "6a38a6af-edaf-4b9e-b616-a43508999994"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.056555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a38a6af-edaf-4b9e-b616-a43508999994-kube-api-access-cw5rc" (OuterVolumeSpecName: "kube-api-access-cw5rc") pod "6a38a6af-edaf-4b9e-b616-a43508999994" (UID: "6a38a6af-edaf-4b9e-b616-a43508999994"). InnerVolumeSpecName "kube-api-access-cw5rc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.056622 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" (UID: "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.057008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-kube-api-access-mltr4" (OuterVolumeSpecName: "kube-api-access-mltr4") pod "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" (UID: "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66"). InnerVolumeSpecName "kube-api-access-mltr4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.076419 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-inventory" (OuterVolumeSpecName: "inventory") pod "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" (UID: "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.115463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" (UID: "88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.117443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "6a38a6af-edaf-4b9e-b616-a43508999994" (UID: "6a38a6af-edaf-4b9e-b616-a43508999994"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.130670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-inventory" (OuterVolumeSpecName: "inventory") pod "6a38a6af-edaf-4b9e-b616-a43508999994" (UID: "6a38a6af-edaf-4b9e-b616-a43508999994"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160064 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160111 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mltr4\" (UniqueName: \"kubernetes.io/projected/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-kube-api-access-mltr4\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160128 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160140 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160153 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6a38a6af-edaf-4b9e-b616-a43508999994-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160166 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cw5rc\" (UniqueName: \"kubernetes.io/projected/6a38a6af-edaf-4b9e-b616-a43508999994-kube-api-access-cw5rc\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160180 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.160210 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.577813 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" event={"ID":"88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66","Type":"ContainerDied","Data":"13cdb2e08b5cd65ed9fd504829c2cfbb6661279231c30a47368a471e753d866f"} Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.578088 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13cdb2e08b5cd65ed9fd504829c2cfbb6661279231c30a47368a471e753d866f" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.578025 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.579702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" event={"ID":"6a38a6af-edaf-4b9e-b616-a43508999994","Type":"ContainerDied","Data":"a7bf87fb7c34be6ae8799f2c6938f8d0b44b896dde67416edd6c4feb53924041"} Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.579808 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7bf87fb7c34be6ae8799f2c6938f8d0b44b896dde67416edd6c4feb53924041" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.579928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.625346 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54"] Nov 21 13:31:03 crc kubenswrapper[4769]: E1121 13:31:03.625713 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a38a6af-edaf-4b9e-b616-a43508999994" containerName="bootstrap-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.625736 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a38a6af-edaf-4b9e-b616-a43508999994" containerName="bootstrap-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:03 crc kubenswrapper[4769]: E1121 13:31:03.625761 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.625770 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.625954 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.625992 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a38a6af-edaf-4b9e-b616-a43508999994" containerName="bootstrap-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.626653 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.629086 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.629117 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.629519 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.630491 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.647278 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54"] Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.769347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppfm\" (UniqueName: \"kubernetes.io/projected/07a81bb5-4c50-4011-937d-f4e211159ba5-kube-api-access-sppfm\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.770425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-ssh-key\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.770624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.872562 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-ssh-key\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.873598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.873733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sppfm\" (UniqueName: \"kubernetes.io/projected/07a81bb5-4c50-4011-937d-f4e211159ba5-kube-api-access-sppfm\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.880339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.881662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-ssh-key\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.895425 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppfm\" (UniqueName: \"kubernetes.io/projected/07a81bb5-4c50-4011-937d-f4e211159ba5-kube-api-access-sppfm\") pod \"configure-network-edpm-multinodeset-edpm-compute-global-8bd54\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:03 crc kubenswrapper[4769]: I1121 13:31:03.947410 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:04 crc kubenswrapper[4769]: I1121 13:31:04.452096 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54"] Nov 21 13:31:04 crc kubenswrapper[4769]: W1121 13:31:04.455508 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07a81bb5_4c50_4011_937d_f4e211159ba5.slice/crio-cd6bda741b6f3d57e1cc9d2fe9345d41497f37da93f2a6bec0ce0546c1dae31c WatchSource:0}: Error finding container cd6bda741b6f3d57e1cc9d2fe9345d41497f37da93f2a6bec0ce0546c1dae31c: Status 404 returned error can't find the container with id cd6bda741b6f3d57e1cc9d2fe9345d41497f37da93f2a6bec0ce0546c1dae31c Nov 21 13:31:04 crc kubenswrapper[4769]: I1121 13:31:04.592343 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" event={"ID":"07a81bb5-4c50-4011-937d-f4e211159ba5","Type":"ContainerStarted","Data":"cd6bda741b6f3d57e1cc9d2fe9345d41497f37da93f2a6bec0ce0546c1dae31c"} Nov 21 13:31:05 crc kubenswrapper[4769]: I1121 13:31:05.599832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" event={"ID":"07a81bb5-4c50-4011-937d-f4e211159ba5","Type":"ContainerStarted","Data":"28a3d2ca0e0e10678f6b08fc13f3029e4291888e10de58f3380c36000f9f2afc"} Nov 21 13:31:05 crc kubenswrapper[4769]: I1121 13:31:05.626796 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" podStartSLOduration=2.13154773 podStartE2EDuration="2.62677178s" podCreationTimestamp="2025-11-21 13:31:03 +0000 UTC" firstStartedPulling="2025-11-21 13:31:04.458316404 +0000 UTC m=+6023.158978252" lastFinishedPulling="2025-11-21 13:31:04.953540484 +0000 UTC m=+6023.654202302" observedRunningTime="2025-11-21 13:31:05.620590588 +0000 UTC m=+6024.321252446" watchObservedRunningTime="2025-11-21 13:31:05.62677178 +0000 UTC m=+6024.327433628" Nov 21 13:31:06 crc kubenswrapper[4769]: I1121 13:31:06.612335 4769 generic.go:334] "Generic (PLEG): container finished" podID="07a81bb5-4c50-4011-937d-f4e211159ba5" containerID="28a3d2ca0e0e10678f6b08fc13f3029e4291888e10de58f3380c36000f9f2afc" exitCode=0 Nov 21 13:31:06 crc kubenswrapper[4769]: I1121 13:31:06.612400 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" event={"ID":"07a81bb5-4c50-4011-937d-f4e211159ba5","Type":"ContainerDied","Data":"28a3d2ca0e0e10678f6b08fc13f3029e4291888e10de58f3380c36000f9f2afc"} Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.031705 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.141803 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sppfm\" (UniqueName: \"kubernetes.io/projected/07a81bb5-4c50-4011-937d-f4e211159ba5-kube-api-access-sppfm\") pod \"07a81bb5-4c50-4011-937d-f4e211159ba5\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.141873 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-ssh-key\") pod \"07a81bb5-4c50-4011-937d-f4e211159ba5\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.141910 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-inventory\") pod \"07a81bb5-4c50-4011-937d-f4e211159ba5\" (UID: \"07a81bb5-4c50-4011-937d-f4e211159ba5\") " Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.156348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a81bb5-4c50-4011-937d-f4e211159ba5-kube-api-access-sppfm" (OuterVolumeSpecName: "kube-api-access-sppfm") pod "07a81bb5-4c50-4011-937d-f4e211159ba5" (UID: "07a81bb5-4c50-4011-937d-f4e211159ba5"). InnerVolumeSpecName "kube-api-access-sppfm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.167869 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "07a81bb5-4c50-4011-937d-f4e211159ba5" (UID: "07a81bb5-4c50-4011-937d-f4e211159ba5"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.181677 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-inventory" (OuterVolumeSpecName: "inventory") pod "07a81bb5-4c50-4011-937d-f4e211159ba5" (UID: "07a81bb5-4c50-4011-937d-f4e211159ba5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.243616 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sppfm\" (UniqueName: \"kubernetes.io/projected/07a81bb5-4c50-4011-937d-f4e211159ba5-kube-api-access-sppfm\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.243654 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.243664 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/07a81bb5-4c50-4011-937d-f4e211159ba5-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.637588 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" event={"ID":"07a81bb5-4c50-4011-937d-f4e211159ba5","Type":"ContainerDied","Data":"cd6bda741b6f3d57e1cc9d2fe9345d41497f37da93f2a6bec0ce0546c1dae31c"} Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.637956 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd6bda741b6f3d57e1cc9d2fe9345d41497f37da93f2a6bec0ce0546c1dae31c" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.637639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.710740 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr"] Nov 21 13:31:08 crc kubenswrapper[4769]: E1121 13:31:08.711173 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="07a81bb5-4c50-4011-937d-f4e211159ba5" containerName="configure-network-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.711224 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a81bb5-4c50-4011-937d-f4e211159ba5" containerName="configure-network-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.711441 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="07a81bb5-4c50-4011-937d-f4e211159ba5" containerName="configure-network-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.712055 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.714670 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.714836 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.715131 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.715313 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.717332 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr"] Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.754371 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-ssh-key\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.754510 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwldb\" (UniqueName: \"kubernetes.io/projected/409efb81-0c51-4cf4-a525-577d64be2834-kube-api-access-jwldb\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.754577 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.855777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-ssh-key\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.855877 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jwldb\" (UniqueName: \"kubernetes.io/projected/409efb81-0c51-4cf4-a525-577d64be2834-kube-api-access-jwldb\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.855929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.862654 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.862675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-ssh-key\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:08 crc kubenswrapper[4769]: I1121 13:31:08.880096 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwldb\" (UniqueName: \"kubernetes.io/projected/409efb81-0c51-4cf4-a525-577d64be2834-kube-api-access-jwldb\") pod \"validate-network-edpm-multinodeset-edpm-compute-global-z9mbr\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:09 crc kubenswrapper[4769]: I1121 13:31:09.037171 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:09 crc kubenswrapper[4769]: I1121 13:31:09.338018 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr"] Nov 21 13:31:09 crc kubenswrapper[4769]: I1121 13:31:09.646212 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" event={"ID":"409efb81-0c51-4cf4-a525-577d64be2834","Type":"ContainerStarted","Data":"81254ea885110b64f5d1c1e1d3c5e89ab85865649a76a5f8d817d0b94f2f4f73"} Nov 21 13:31:10 crc kubenswrapper[4769]: I1121 13:31:10.658551 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" event={"ID":"409efb81-0c51-4cf4-a525-577d64be2834","Type":"ContainerStarted","Data":"aa7f88aef3e2d4c459f932ae13c6b9a8ccf95e7feb50977a69d29ab6ea3f0f93"} Nov 21 13:31:10 crc kubenswrapper[4769]: I1121 13:31:10.697965 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" podStartSLOduration=2.28705857 podStartE2EDuration="2.697917384s" podCreationTimestamp="2025-11-21 13:31:08 +0000 UTC" firstStartedPulling="2025-11-21 13:31:09.348534007 +0000 UTC m=+6028.049195825" lastFinishedPulling="2025-11-21 13:31:09.759392811 +0000 UTC m=+6028.460054639" observedRunningTime="2025-11-21 13:31:10.687164913 +0000 UTC m=+6029.387826741" watchObservedRunningTime="2025-11-21 13:31:10.697917384 +0000 UTC m=+6029.398579212" Nov 21 13:31:11 crc kubenswrapper[4769]: I1121 13:31:11.672456 4769 generic.go:334] "Generic (PLEG): container finished" podID="409efb81-0c51-4cf4-a525-577d64be2834" containerID="aa7f88aef3e2d4c459f932ae13c6b9a8ccf95e7feb50977a69d29ab6ea3f0f93" exitCode=0 Nov 21 13:31:11 crc kubenswrapper[4769]: I1121 13:31:11.672556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" event={"ID":"409efb81-0c51-4cf4-a525-577d64be2834","Type":"ContainerDied","Data":"aa7f88aef3e2d4c459f932ae13c6b9a8ccf95e7feb50977a69d29ab6ea3f0f93"} Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.005097 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.053698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-ssh-key\") pod \"409efb81-0c51-4cf4-a525-577d64be2834\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.053754 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-inventory\") pod \"409efb81-0c51-4cf4-a525-577d64be2834\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.053812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwldb\" (UniqueName: \"kubernetes.io/projected/409efb81-0c51-4cf4-a525-577d64be2834-kube-api-access-jwldb\") pod \"409efb81-0c51-4cf4-a525-577d64be2834\" (UID: \"409efb81-0c51-4cf4-a525-577d64be2834\") " Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.072525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409efb81-0c51-4cf4-a525-577d64be2834-kube-api-access-jwldb" (OuterVolumeSpecName: "kube-api-access-jwldb") pod "409efb81-0c51-4cf4-a525-577d64be2834" (UID: "409efb81-0c51-4cf4-a525-577d64be2834"). InnerVolumeSpecName "kube-api-access-jwldb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.135341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-inventory" (OuterVolumeSpecName: "inventory") pod "409efb81-0c51-4cf4-a525-577d64be2834" (UID: "409efb81-0c51-4cf4-a525-577d64be2834"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.145341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "409efb81-0c51-4cf4-a525-577d64be2834" (UID: "409efb81-0c51-4cf4-a525-577d64be2834"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.154555 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jwldb\" (UniqueName: \"kubernetes.io/projected/409efb81-0c51-4cf4-a525-577d64be2834-kube-api-access-jwldb\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.154589 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.154602 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/409efb81-0c51-4cf4-a525-577d64be2834-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.278782 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:31:13 crc kubenswrapper[4769]: E1121 13:31:13.279266 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.696776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" event={"ID":"409efb81-0c51-4cf4-a525-577d64be2834","Type":"ContainerDied","Data":"81254ea885110b64f5d1c1e1d3c5e89ab85865649a76a5f8d817d0b94f2f4f73"} Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.696828 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81254ea885110b64f5d1c1e1d3c5e89ab85865649a76a5f8d817d0b94f2f4f73" Nov 21 13:31:13 crc kubenswrapper[4769]: I1121 13:31:13.697386 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.128453 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s"] Nov 21 13:31:14 crc kubenswrapper[4769]: E1121 13:31:14.130295 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="409efb81-0c51-4cf4-a525-577d64be2834" containerName="validate-network-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.130481 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="409efb81-0c51-4cf4-a525-577d64be2834" containerName="validate-network-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.130921 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="409efb81-0c51-4cf4-a525-577d64be2834" containerName="validate-network-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.131901 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.136573 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.136895 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.137376 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s"] Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.139010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.142959 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.271531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-ssh-key\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.271939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.272018 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwv5v\" (UniqueName: \"kubernetes.io/projected/d03859d6-f6cf-453d-8ab1-0cac11c59697-kube-api-access-rwv5v\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.376575 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-ssh-key\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.376701 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.377295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rwv5v\" (UniqueName: \"kubernetes.io/projected/d03859d6-f6cf-453d-8ab1-0cac11c59697-kube-api-access-rwv5v\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.382424 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.383848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-ssh-key\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.409535 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwv5v\" (UniqueName: \"kubernetes.io/projected/d03859d6-f6cf-453d-8ab1-0cac11c59697-kube-api-access-rwv5v\") pod \"install-os-edpm-multinodeset-edpm-compute-global-sgf2s\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.462680 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:14 crc kubenswrapper[4769]: I1121 13:31:14.973968 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s"] Nov 21 13:31:14 crc kubenswrapper[4769]: W1121 13:31:14.982122 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd03859d6_f6cf_453d_8ab1_0cac11c59697.slice/crio-71ff5b6b426091de9227a989fa66f68ae840c998b106ee61e6fc4c9a8aeadb0b WatchSource:0}: Error finding container 71ff5b6b426091de9227a989fa66f68ae840c998b106ee61e6fc4c9a8aeadb0b: Status 404 returned error can't find the container with id 71ff5b6b426091de9227a989fa66f68ae840c998b106ee61e6fc4c9a8aeadb0b Nov 21 13:31:15 crc kubenswrapper[4769]: I1121 13:31:15.723020 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" event={"ID":"d03859d6-f6cf-453d-8ab1-0cac11c59697","Type":"ContainerStarted","Data":"71ff5b6b426091de9227a989fa66f68ae840c998b106ee61e6fc4c9a8aeadb0b"} Nov 21 13:31:16 crc kubenswrapper[4769]: I1121 13:31:16.736967 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" event={"ID":"d03859d6-f6cf-453d-8ab1-0cac11c59697","Type":"ContainerStarted","Data":"03ff6d1db3b81b70342432461b273dc0a96e0ab36f6bbbf155c544ddadf50bf3"} Nov 21 13:31:16 crc kubenswrapper[4769]: I1121 13:31:16.761133 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" podStartSLOduration=2.1813678 podStartE2EDuration="2.761109681s" podCreationTimestamp="2025-11-21 13:31:14 +0000 UTC" firstStartedPulling="2025-11-21 13:31:14.984160193 +0000 UTC m=+6033.684822031" lastFinishedPulling="2025-11-21 13:31:15.563902094 +0000 UTC m=+6034.264563912" observedRunningTime="2025-11-21 13:31:16.755431193 +0000 UTC m=+6035.456093081" watchObservedRunningTime="2025-11-21 13:31:16.761109681 +0000 UTC m=+6035.461771499" Nov 21 13:31:17 crc kubenswrapper[4769]: I1121 13:31:17.747910 4769 generic.go:334] "Generic (PLEG): container finished" podID="d03859d6-f6cf-453d-8ab1-0cac11c59697" containerID="03ff6d1db3b81b70342432461b273dc0a96e0ab36f6bbbf155c544ddadf50bf3" exitCode=0 Nov 21 13:31:17 crc kubenswrapper[4769]: I1121 13:31:17.747964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" event={"ID":"d03859d6-f6cf-453d-8ab1-0cac11c59697","Type":"ContainerDied","Data":"03ff6d1db3b81b70342432461b273dc0a96e0ab36f6bbbf155c544ddadf50bf3"} Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.097017 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.239629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-ssh-key\") pod \"d03859d6-f6cf-453d-8ab1-0cac11c59697\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.239824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwv5v\" (UniqueName: \"kubernetes.io/projected/d03859d6-f6cf-453d-8ab1-0cac11c59697-kube-api-access-rwv5v\") pod \"d03859d6-f6cf-453d-8ab1-0cac11c59697\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.239901 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-inventory\") pod \"d03859d6-f6cf-453d-8ab1-0cac11c59697\" (UID: \"d03859d6-f6cf-453d-8ab1-0cac11c59697\") " Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.244679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03859d6-f6cf-453d-8ab1-0cac11c59697-kube-api-access-rwv5v" (OuterVolumeSpecName: "kube-api-access-rwv5v") pod "d03859d6-f6cf-453d-8ab1-0cac11c59697" (UID: "d03859d6-f6cf-453d-8ab1-0cac11c59697"). InnerVolumeSpecName "kube-api-access-rwv5v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.268726 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-inventory" (OuterVolumeSpecName: "inventory") pod "d03859d6-f6cf-453d-8ab1-0cac11c59697" (UID: "d03859d6-f6cf-453d-8ab1-0cac11c59697"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.269768 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "d03859d6-f6cf-453d-8ab1-0cac11c59697" (UID: "d03859d6-f6cf-453d-8ab1-0cac11c59697"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.342219 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.342288 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rwv5v\" (UniqueName: \"kubernetes.io/projected/d03859d6-f6cf-453d-8ab1-0cac11c59697-kube-api-access-rwv5v\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.342320 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/d03859d6-f6cf-453d-8ab1-0cac11c59697-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.782523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" event={"ID":"d03859d6-f6cf-453d-8ab1-0cac11c59697","Type":"ContainerDied","Data":"71ff5b6b426091de9227a989fa66f68ae840c998b106ee61e6fc4c9a8aeadb0b"} Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.782890 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71ff5b6b426091de9227a989fa66f68ae840c998b106ee61e6fc4c9a8aeadb0b" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.782622 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.861727 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847"] Nov 21 13:31:19 crc kubenswrapper[4769]: E1121 13:31:19.862275 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d03859d6-f6cf-453d-8ab1-0cac11c59697" containerName="install-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.862306 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03859d6-f6cf-453d-8ab1-0cac11c59697" containerName="install-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.862611 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d03859d6-f6cf-453d-8ab1-0cac11c59697" containerName="install-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.863503 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.867483 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.868317 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.869252 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.870320 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:19 crc kubenswrapper[4769]: I1121 13:31:19.896865 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847"] Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.051763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.051877 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz5bd\" (UniqueName: \"kubernetes.io/projected/4901aa5e-3211-407d-85be-b6f62dc3f4d1-kube-api-access-sz5bd\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.051952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-ssh-key\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.152936 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.153015 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sz5bd\" (UniqueName: \"kubernetes.io/projected/4901aa5e-3211-407d-85be-b6f62dc3f4d1-kube-api-access-sz5bd\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.153070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-ssh-key\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.157515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.160427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-ssh-key\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.175075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz5bd\" (UniqueName: \"kubernetes.io/projected/4901aa5e-3211-407d-85be-b6f62dc3f4d1-kube-api-access-sz5bd\") pod \"configure-os-edpm-multinodeset-edpm-compute-global-kv847\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.189168 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.650298 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847"] Nov 21 13:31:20 crc kubenswrapper[4769]: I1121 13:31:20.794011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" event={"ID":"4901aa5e-3211-407d-85be-b6f62dc3f4d1","Type":"ContainerStarted","Data":"5bec0081d91b0035fa7e05a0fe9bc3a9d01cc00ef7a63f3a63ca067272a8c9af"} Nov 21 13:31:21 crc kubenswrapper[4769]: I1121 13:31:21.806359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" event={"ID":"4901aa5e-3211-407d-85be-b6f62dc3f4d1","Type":"ContainerStarted","Data":"848f990243303a21b173571b68291c4ddeb10ebdbb22089d93e1bcbd187253fb"} Nov 21 13:31:21 crc kubenswrapper[4769]: I1121 13:31:21.839593 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" podStartSLOduration=2.408865284 podStartE2EDuration="2.839555397s" podCreationTimestamp="2025-11-21 13:31:19 +0000 UTC" firstStartedPulling="2025-11-21 13:31:20.655602845 +0000 UTC m=+6039.356264663" lastFinishedPulling="2025-11-21 13:31:21.086292958 +0000 UTC m=+6039.786954776" observedRunningTime="2025-11-21 13:31:21.835240594 +0000 UTC m=+6040.535902452" watchObservedRunningTime="2025-11-21 13:31:21.839555397 +0000 UTC m=+6040.540217225" Nov 21 13:31:22 crc kubenswrapper[4769]: I1121 13:31:22.825565 4769 generic.go:334] "Generic (PLEG): container finished" podID="4901aa5e-3211-407d-85be-b6f62dc3f4d1" containerID="848f990243303a21b173571b68291c4ddeb10ebdbb22089d93e1bcbd187253fb" exitCode=0 Nov 21 13:31:22 crc kubenswrapper[4769]: I1121 13:31:22.825784 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" event={"ID":"4901aa5e-3211-407d-85be-b6f62dc3f4d1","Type":"ContainerDied","Data":"848f990243303a21b173571b68291c4ddeb10ebdbb22089d93e1bcbd187253fb"} Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.187690 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.274745 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:31:24 crc kubenswrapper[4769]: E1121 13:31:24.275308 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.329110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-ssh-key\") pod \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.329163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-inventory\") pod \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.329292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz5bd\" (UniqueName: \"kubernetes.io/projected/4901aa5e-3211-407d-85be-b6f62dc3f4d1-kube-api-access-sz5bd\") pod \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\" (UID: \"4901aa5e-3211-407d-85be-b6f62dc3f4d1\") " Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.342551 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4901aa5e-3211-407d-85be-b6f62dc3f4d1-kube-api-access-sz5bd" (OuterVolumeSpecName: "kube-api-access-sz5bd") pod "4901aa5e-3211-407d-85be-b6f62dc3f4d1" (UID: "4901aa5e-3211-407d-85be-b6f62dc3f4d1"). InnerVolumeSpecName "kube-api-access-sz5bd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.365626 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "4901aa5e-3211-407d-85be-b6f62dc3f4d1" (UID: "4901aa5e-3211-407d-85be-b6f62dc3f4d1"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.376799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-inventory" (OuterVolumeSpecName: "inventory") pod "4901aa5e-3211-407d-85be-b6f62dc3f4d1" (UID: "4901aa5e-3211-407d-85be-b6f62dc3f4d1"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.432225 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sz5bd\" (UniqueName: \"kubernetes.io/projected/4901aa5e-3211-407d-85be-b6f62dc3f4d1-kube-api-access-sz5bd\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.432284 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.432295 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4901aa5e-3211-407d-85be-b6f62dc3f4d1-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.847934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" event={"ID":"4901aa5e-3211-407d-85be-b6f62dc3f4d1","Type":"ContainerDied","Data":"5bec0081d91b0035fa7e05a0fe9bc3a9d01cc00ef7a63f3a63ca067272a8c9af"} Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.847986 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bec0081d91b0035fa7e05a0fe9bc3a9d01cc00ef7a63f3a63ca067272a8c9af" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.848027 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.925604 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt"] Nov 21 13:31:24 crc kubenswrapper[4769]: E1121 13:31:24.925999 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4901aa5e-3211-407d-85be-b6f62dc3f4d1" containerName="configure-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.926021 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4901aa5e-3211-407d-85be-b6f62dc3f4d1" containerName="configure-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.926221 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4901aa5e-3211-407d-85be-b6f62dc3f4d1" containerName="configure-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.926826 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.930255 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.930649 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.934881 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.935473 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:24 crc kubenswrapper[4769]: I1121 13:31:24.940764 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt"] Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.042747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.042810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrwq\" (UniqueName: \"kubernetes.io/projected/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-kube-api-access-hqrwq\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.042909 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-ssh-key\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.144406 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-ssh-key\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.144487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.144537 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrwq\" (UniqueName: \"kubernetes.io/projected/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-kube-api-access-hqrwq\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.154292 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.161730 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-ssh-key\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.167729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrwq\" (UniqueName: \"kubernetes.io/projected/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-kube-api-access-hqrwq\") pod \"run-os-edpm-multinodeset-edpm-compute-global-4c5wt\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.252164 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.782034 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt"] Nov 21 13:31:25 crc kubenswrapper[4769]: W1121 13:31:25.782662 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11b2f4fb_13cd_4524_b9a6_5ae7b1798de7.slice/crio-ed7d015a3cbac6cc1a329c358687d8a5ded1fa9fc80600308408bef116622950 WatchSource:0}: Error finding container ed7d015a3cbac6cc1a329c358687d8a5ded1fa9fc80600308408bef116622950: Status 404 returned error can't find the container with id ed7d015a3cbac6cc1a329c358687d8a5ded1fa9fc80600308408bef116622950 Nov 21 13:31:25 crc kubenswrapper[4769]: I1121 13:31:25.858948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" event={"ID":"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7","Type":"ContainerStarted","Data":"ed7d015a3cbac6cc1a329c358687d8a5ded1fa9fc80600308408bef116622950"} Nov 21 13:31:26 crc kubenswrapper[4769]: I1121 13:31:26.871111 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" event={"ID":"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7","Type":"ContainerStarted","Data":"809d521f289b72bb91cc8ea43a2c8a4b320111911f78438aa09ce683782c41e9"} Nov 21 13:31:26 crc kubenswrapper[4769]: I1121 13:31:26.903531 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" podStartSLOduration=2.48846701 podStartE2EDuration="2.903390881s" podCreationTimestamp="2025-11-21 13:31:24 +0000 UTC" firstStartedPulling="2025-11-21 13:31:25.785339342 +0000 UTC m=+6044.486001200" lastFinishedPulling="2025-11-21 13:31:26.200263253 +0000 UTC m=+6044.900925071" observedRunningTime="2025-11-21 13:31:26.896336556 +0000 UTC m=+6045.596998464" watchObservedRunningTime="2025-11-21 13:31:26.903390881 +0000 UTC m=+6045.604052729" Nov 21 13:31:27 crc kubenswrapper[4769]: I1121 13:31:27.885504 4769 generic.go:334] "Generic (PLEG): container finished" podID="11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" containerID="809d521f289b72bb91cc8ea43a2c8a4b320111911f78438aa09ce683782c41e9" exitCode=0 Nov 21 13:31:27 crc kubenswrapper[4769]: I1121 13:31:27.885638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" event={"ID":"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7","Type":"ContainerDied","Data":"809d521f289b72bb91cc8ea43a2c8a4b320111911f78438aa09ce683782c41e9"} Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.230010 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.326857 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-inventory\") pod \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.326963 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-ssh-key\") pod \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.327051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqrwq\" (UniqueName: \"kubernetes.io/projected/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-kube-api-access-hqrwq\") pod \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\" (UID: \"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7\") " Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.366540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-kube-api-access-hqrwq" (OuterVolumeSpecName: "kube-api-access-hqrwq") pod "11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" (UID: "11b2f4fb-13cd-4524-b9a6-5ae7b1798de7"). InnerVolumeSpecName "kube-api-access-hqrwq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.378564 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-inventory" (OuterVolumeSpecName: "inventory") pod "11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" (UID: "11b2f4fb-13cd-4524-b9a6-5ae7b1798de7"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.397434 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" (UID: "11b2f4fb-13cd-4524-b9a6-5ae7b1798de7"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.429491 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.429536 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.429549 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hqrwq\" (UniqueName: \"kubernetes.io/projected/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7-kube-api-access-hqrwq\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.908137 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" event={"ID":"11b2f4fb-13cd-4524-b9a6-5ae7b1798de7","Type":"ContainerDied","Data":"ed7d015a3cbac6cc1a329c358687d8a5ded1fa9fc80600308408bef116622950"} Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.908180 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed7d015a3cbac6cc1a329c358687d8a5ded1fa9fc80600308408bef116622950" Nov 21 13:31:29 crc kubenswrapper[4769]: I1121 13:31:29.908305 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.008382 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv"] Nov 21 13:31:30 crc kubenswrapper[4769]: E1121 13:31:30.008758 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" containerName="run-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.008781 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" containerName="run-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.008983 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" containerName="run-os-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.009650 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.014174 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.015413 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.015775 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.015912 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.016071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.031636 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv"] Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.142953 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.143169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.143298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.143708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.143792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ssh-key\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.143936 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.144041 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.144103 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.144129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.144276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.144301 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl6tb\" (UniqueName: \"kubernetes.io/projected/68192d92-ce46-4320-a01b-81bf285230f8-kube-api-access-bl6tb\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.144340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245359 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245462 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245487 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bl6tb\" (UniqueName: \"kubernetes.io/projected/68192d92-ce46-4320-a01b-81bf285230f8-kube-api-access-bl6tb\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245564 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ssh-key\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.245730 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.250983 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.251050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-custom-global-service-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.251741 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.251957 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.252269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.253041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.253393 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.255787 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.255845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ssh-key\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.256619 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.260512 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.273479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl6tb\" (UniqueName: \"kubernetes.io/projected/68192d92-ce46-4320-a01b-81bf285230f8-kube-api-access-bl6tb\") pod \"install-certs-edpm-multinodeset-edpm-compute-global-4w7mv\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.328201 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.780200 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv"] Nov 21 13:31:30 crc kubenswrapper[4769]: W1121 13:31:30.786312 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68192d92_ce46_4320_a01b_81bf285230f8.slice/crio-6bb6ab00a8a800aafcc978683f13cfab7c46517d0a6ccede80397e376c37dce0 WatchSource:0}: Error finding container 6bb6ab00a8a800aafcc978683f13cfab7c46517d0a6ccede80397e376c37dce0: Status 404 returned error can't find the container with id 6bb6ab00a8a800aafcc978683f13cfab7c46517d0a6ccede80397e376c37dce0 Nov 21 13:31:30 crc kubenswrapper[4769]: I1121 13:31:30.918487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" event={"ID":"68192d92-ce46-4320-a01b-81bf285230f8","Type":"ContainerStarted","Data":"6bb6ab00a8a800aafcc978683f13cfab7c46517d0a6ccede80397e376c37dce0"} Nov 21 13:31:31 crc kubenswrapper[4769]: I1121 13:31:31.929534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" event={"ID":"68192d92-ce46-4320-a01b-81bf285230f8","Type":"ContainerStarted","Data":"ba402ed9142db1b8afef7cd0895f80d5c41ad2b10cd70acfc898512484f8ed5f"} Nov 21 13:31:32 crc kubenswrapper[4769]: I1121 13:31:32.939899 4769 generic.go:334] "Generic (PLEG): container finished" podID="68192d92-ce46-4320-a01b-81bf285230f8" containerID="ba402ed9142db1b8afef7cd0895f80d5c41ad2b10cd70acfc898512484f8ed5f" exitCode=0 Nov 21 13:31:32 crc kubenswrapper[4769]: I1121 13:31:32.939947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" event={"ID":"68192d92-ce46-4320-a01b-81bf285230f8","Type":"ContainerDied","Data":"ba402ed9142db1b8afef7cd0895f80d5c41ad2b10cd70acfc898512484f8ed5f"} Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.320682 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.470520 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-custom-global-service-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.470589 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ssh-key\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.470648 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-libvirt-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.470676 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-dhcp-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.470713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ovn-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl6tb\" (UniqueName: \"kubernetes.io/projected/68192d92-ce46-4320-a01b-81bf285230f8-kube-api-access-bl6tb\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471692 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-metadata-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-sriov-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471790 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-nova-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-bootstrap-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-inventory\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.471950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-ovn-combined-ca-bundle\") pod \"68192d92-ce46-4320-a01b-81bf285230f8\" (UID: \"68192d92-ce46-4320-a01b-81bf285230f8\") " Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.477867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.478300 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.478539 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68192d92-ce46-4320-a01b-81bf285230f8-kube-api-access-bl6tb" (OuterVolumeSpecName: "kube-api-access-bl6tb") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "kube-api-access-bl6tb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.479870 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.480234 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.489497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.489474 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.490281 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.491308 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.493316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.501003 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.503087 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-inventory" (OuterVolumeSpecName: "inventory") pod "68192d92-ce46-4320-a01b-81bf285230f8" (UID: "68192d92-ce46-4320-a01b-81bf285230f8"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573843 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573905 4769 reconciler_common.go:293] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573924 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573938 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573952 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573965 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573982 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bl6tb\" (UniqueName: \"kubernetes.io/projected/68192d92-ce46-4320-a01b-81bf285230f8-kube-api-access-bl6tb\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.573997 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.574010 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.574025 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.574042 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.574056 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/68192d92-ce46-4320-a01b-81bf285230f8-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.969083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" event={"ID":"68192d92-ce46-4320-a01b-81bf285230f8","Type":"ContainerDied","Data":"6bb6ab00a8a800aafcc978683f13cfab7c46517d0a6ccede80397e376c37dce0"} Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.969133 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bb6ab00a8a800aafcc978683f13cfab7c46517d0a6ccede80397e376c37dce0" Nov 21 13:31:34 crc kubenswrapper[4769]: I1121 13:31:34.969147 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.064876 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf"] Nov 21 13:31:35 crc kubenswrapper[4769]: E1121 13:31:35.065242 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="68192d92-ce46-4320-a01b-81bf285230f8" containerName="install-certs-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.065265 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="68192d92-ce46-4320-a01b-81bf285230f8" containerName="install-certs-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.065466 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="68192d92-ce46-4320-a01b-81bf285230f8" containerName="install-certs-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.066059 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.068152 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.068366 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.069091 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-config" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.069153 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.069975 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.071494 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.082441 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/9b729b96-0236-4148-bdb4-33046b028fcf-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.082697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfhd2\" (UniqueName: \"kubernetes.io/projected/9b729b96-0236-4148-bdb4-33046b028fcf-kube-api-access-hfhd2\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.082849 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ssh-key\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.082948 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.083027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.088464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf"] Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.184781 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hfhd2\" (UniqueName: \"kubernetes.io/projected/9b729b96-0236-4148-bdb4-33046b028fcf-kube-api-access-hfhd2\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.184888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ssh-key\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.184937 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.184969 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.185057 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/9b729b96-0236-4148-bdb4-33046b028fcf-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.186311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/9b729b96-0236-4148-bdb4-33046b028fcf-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.188682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ssh-key\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.189758 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.194125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.206775 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfhd2\" (UniqueName: \"kubernetes.io/projected/9b729b96-0236-4148-bdb4-33046b028fcf-kube-api-access-hfhd2\") pod \"ovn-edpm-multinodeset-edpm-compute-global-bm2jf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.394166 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.819421 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf"] Nov 21 13:31:35 crc kubenswrapper[4769]: I1121 13:31:35.978937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" event={"ID":"9b729b96-0236-4148-bdb4-33046b028fcf","Type":"ContainerStarted","Data":"bd1213d4bacccff1b09bbb25d92529efed1e4032f435122c1bafb41e79fa59d3"} Nov 21 13:31:36 crc kubenswrapper[4769]: I1121 13:31:36.992373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" event={"ID":"9b729b96-0236-4148-bdb4-33046b028fcf","Type":"ContainerStarted","Data":"495e3f4828d84b7801f6c34a64a915696d1f493baf411f23ece77eb8190dcdb3"} Nov 21 13:31:37 crc kubenswrapper[4769]: I1121 13:31:37.013256 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" podStartSLOduration=1.344660637 podStartE2EDuration="2.013229821s" podCreationTimestamp="2025-11-21 13:31:35 +0000 UTC" firstStartedPulling="2025-11-21 13:31:35.831335193 +0000 UTC m=+6054.531997011" lastFinishedPulling="2025-11-21 13:31:36.499904367 +0000 UTC m=+6055.200566195" observedRunningTime="2025-11-21 13:31:37.010619623 +0000 UTC m=+6055.711281451" watchObservedRunningTime="2025-11-21 13:31:37.013229821 +0000 UTC m=+6055.713891649" Nov 21 13:31:38 crc kubenswrapper[4769]: I1121 13:31:38.274516 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:31:38 crc kubenswrapper[4769]: E1121 13:31:38.275048 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:31:39 crc kubenswrapper[4769]: I1121 13:31:39.016223 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b729b96-0236-4148-bdb4-33046b028fcf" containerID="495e3f4828d84b7801f6c34a64a915696d1f493baf411f23ece77eb8190dcdb3" exitCode=0 Nov 21 13:31:39 crc kubenswrapper[4769]: I1121 13:31:39.016277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" event={"ID":"9b729b96-0236-4148-bdb4-33046b028fcf","Type":"ContainerDied","Data":"495e3f4828d84b7801f6c34a64a915696d1f493baf411f23ece77eb8190dcdb3"} Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.320274 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.466420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/9b729b96-0236-4148-bdb4-33046b028fcf-ovncontroller-config-0\") pod \"9b729b96-0236-4148-bdb4-33046b028fcf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.466637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ssh-key\") pod \"9b729b96-0236-4148-bdb4-33046b028fcf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.466674 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ovn-combined-ca-bundle\") pod \"9b729b96-0236-4148-bdb4-33046b028fcf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.466736 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory\") pod \"9b729b96-0236-4148-bdb4-33046b028fcf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.466847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfhd2\" (UniqueName: \"kubernetes.io/projected/9b729b96-0236-4148-bdb4-33046b028fcf-kube-api-access-hfhd2\") pod \"9b729b96-0236-4148-bdb4-33046b028fcf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.472361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b729b96-0236-4148-bdb4-33046b028fcf-kube-api-access-hfhd2" (OuterVolumeSpecName: "kube-api-access-hfhd2") pod "9b729b96-0236-4148-bdb4-33046b028fcf" (UID: "9b729b96-0236-4148-bdb4-33046b028fcf"). InnerVolumeSpecName "kube-api-access-hfhd2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.472742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "9b729b96-0236-4148-bdb4-33046b028fcf" (UID: "9b729b96-0236-4148-bdb4-33046b028fcf"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.488432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b729b96-0236-4148-bdb4-33046b028fcf-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "9b729b96-0236-4148-bdb4-33046b028fcf" (UID: "9b729b96-0236-4148-bdb4-33046b028fcf"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:31:40 crc kubenswrapper[4769]: E1121 13:31:40.492685 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory podName:9b729b96-0236-4148-bdb4-33046b028fcf nodeName:}" failed. No retries permitted until 2025-11-21 13:31:40.992653511 +0000 UTC m=+6059.693315339 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "inventory" (UniqueName: "kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory") pod "9b729b96-0236-4148-bdb4-33046b028fcf" (UID: "9b729b96-0236-4148-bdb4-33046b028fcf") : error deleting /var/lib/kubelet/pods/9b729b96-0236-4148-bdb4-33046b028fcf/volume-subpaths: remove /var/lib/kubelet/pods/9b729b96-0236-4148-bdb4-33046b028fcf/volume-subpaths: no such file or directory Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.495361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "9b729b96-0236-4148-bdb4-33046b028fcf" (UID: "9b729b96-0236-4148-bdb4-33046b028fcf"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.568626 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hfhd2\" (UniqueName: \"kubernetes.io/projected/9b729b96-0236-4148-bdb4-33046b028fcf-kube-api-access-hfhd2\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.568674 4769 reconciler_common.go:293] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/9b729b96-0236-4148-bdb4-33046b028fcf-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.568687 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:40 crc kubenswrapper[4769]: I1121 13:31:40.568700 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.034813 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.035097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf" event={"ID":"9b729b96-0236-4148-bdb4-33046b028fcf","Type":"ContainerDied","Data":"bd1213d4bacccff1b09bbb25d92529efed1e4032f435122c1bafb41e79fa59d3"} Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.035245 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd1213d4bacccff1b09bbb25d92529efed1e4032f435122c1bafb41e79fa59d3" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.076703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory\") pod \"9b729b96-0236-4148-bdb4-33046b028fcf\" (UID: \"9b729b96-0236-4148-bdb4-33046b028fcf\") " Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.080485 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory" (OuterVolumeSpecName: "inventory") pod "9b729b96-0236-4148-bdb4-33046b028fcf" (UID: "9b729b96-0236-4148-bdb4-33046b028fcf"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.117352 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb"] Nov 21 13:31:41 crc kubenswrapper[4769]: E1121 13:31:41.117725 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b729b96-0236-4148-bdb4-33046b028fcf" containerName="ovn-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.117749 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b729b96-0236-4148-bdb4-33046b028fcf" containerName="ovn-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.117975 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b729b96-0236-4148-bdb4-33046b028fcf" containerName="ovn-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.118627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.120367 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-metadata-agent-neutron-config" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.120682 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-neutron-config" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.134876 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb"] Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.178513 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b729b96-0236-4148-bdb4-33046b028fcf-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.279372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-ssh-key\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.279706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.279968 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.280094 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.280154 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.280303 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.280343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzptk\" (UniqueName: \"kubernetes.io/projected/74faa949-c3b0-4f12-9312-610dd39ecc71-kube-api-access-jzptk\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.280373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381417 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381517 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381806 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jzptk\" (UniqueName: \"kubernetes.io/projected/74faa949-c3b0-4f12-9312-610dd39ecc71-kube-api-access-jzptk\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381893 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.381974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-ssh-key\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.382086 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.387097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.387418 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.388049 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.392077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-ssh-key\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.392846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.396288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.403167 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.411259 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzptk\" (UniqueName: \"kubernetes.io/projected/74faa949-c3b0-4f12-9312-610dd39ecc71-kube-api-access-jzptk\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:41 crc kubenswrapper[4769]: I1121 13:31:41.481504 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:45 crc kubenswrapper[4769]: I1121 13:31:45.942221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb"] Nov 21 13:31:45 crc kubenswrapper[4769]: I1121 13:31:45.957558 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:31:46 crc kubenswrapper[4769]: I1121 13:31:46.082536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" event={"ID":"74faa949-c3b0-4f12-9312-610dd39ecc71","Type":"ContainerStarted","Data":"31ebb43481f326014840476c529c911352980b4f8bb7b31ac3958cf4c30edfe0"} Nov 21 13:31:47 crc kubenswrapper[4769]: I1121 13:31:47.093126 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" event={"ID":"74faa949-c3b0-4f12-9312-610dd39ecc71","Type":"ContainerStarted","Data":"1a8ac146a81f7e0b637d7943584b3dfaec10fa0ae0a290e248c1a44cc6f4dd20"} Nov 21 13:31:47 crc kubenswrapper[4769]: I1121 13:31:47.107833 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" podStartSLOduration=5.450516393 podStartE2EDuration="6.107811292s" podCreationTimestamp="2025-11-21 13:31:41 +0000 UTC" firstStartedPulling="2025-11-21 13:31:45.957270605 +0000 UTC m=+6064.657932433" lastFinishedPulling="2025-11-21 13:31:46.614565494 +0000 UTC m=+6065.315227332" observedRunningTime="2025-11-21 13:31:47.106372275 +0000 UTC m=+6065.807034093" watchObservedRunningTime="2025-11-21 13:31:47.107811292 +0000 UTC m=+6065.808473110" Nov 21 13:31:49 crc kubenswrapper[4769]: I1121 13:31:49.110971 4769 generic.go:334] "Generic (PLEG): container finished" podID="74faa949-c3b0-4f12-9312-610dd39ecc71" containerID="1a8ac146a81f7e0b637d7943584b3dfaec10fa0ae0a290e248c1a44cc6f4dd20" exitCode=0 Nov 21 13:31:49 crc kubenswrapper[4769]: I1121 13:31:49.111300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" event={"ID":"74faa949-c3b0-4f12-9312-610dd39ecc71","Type":"ContainerDied","Data":"1a8ac146a81f7e0b637d7943584b3dfaec10fa0ae0a290e248c1a44cc6f4dd20"} Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.402764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.479966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-metadata-combined-ca-bundle\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480017 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-0\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzptk\" (UniqueName: \"kubernetes.io/projected/74faa949-c3b0-4f12-9312-610dd39ecc71-kube-api-access-jzptk\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-2\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480098 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-ssh-key\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-ovn-metadata-agent-neutron-config-0\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480233 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-1\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.480276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-inventory\") pod \"74faa949-c3b0-4f12-9312-610dd39ecc71\" (UID: \"74faa949-c3b0-4f12-9312-610dd39ecc71\") " Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.485110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74faa949-c3b0-4f12-9312-610dd39ecc71-kube-api-access-jzptk" (OuterVolumeSpecName: "kube-api-access-jzptk") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "kube-api-access-jzptk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.485509 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.502487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.505325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.507184 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.508443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.508512 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-inventory" (OuterVolumeSpecName: "inventory") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.508762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "74faa949-c3b0-4f12-9312-610dd39ecc71" (UID: "74faa949-c3b0-4f12-9312-610dd39ecc71"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581619 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581656 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581671 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581680 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581690 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581702 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jzptk\" (UniqueName: \"kubernetes.io/projected/74faa949-c3b0-4f12-9312-610dd39ecc71-kube-api-access-jzptk\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581711 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:50 crc kubenswrapper[4769]: I1121 13:31:50.581720 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/74faa949-c3b0-4f12-9312-610dd39ecc71-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.134776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" event={"ID":"74faa949-c3b0-4f12-9312-610dd39ecc71","Type":"ContainerDied","Data":"31ebb43481f326014840476c529c911352980b4f8bb7b31ac3958cf4c30edfe0"} Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.134819 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31ebb43481f326014840476c529c911352980b4f8bb7b31ac3958cf4c30edfe0" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.134869 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.208240 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks"] Nov 21 13:31:51 crc kubenswrapper[4769]: E1121 13:31:51.208913 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="74faa949-c3b0-4f12-9312-610dd39ecc71" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.208943 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="74faa949-c3b0-4f12-9312-610dd39ecc71" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.209324 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="74faa949-c3b0-4f12-9312-610dd39ecc71" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.210396 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.212517 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-agent-neutron-config" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.215339 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.216074 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.216441 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.216486 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.216486 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.221961 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks"] Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.274772 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:31:51 crc kubenswrapper[4769]: E1121 13:31:51.275130 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.392468 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff9q7\" (UniqueName: \"kubernetes.io/projected/82ca09be-8886-4bab-bcf3-fe61ed980683-kube-api-access-ff9q7\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.392628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.392665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.393353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.393483 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-ssh-key\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.494930 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-ssh-key\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.495091 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ff9q7\" (UniqueName: \"kubernetes.io/projected/82ca09be-8886-4bab-bcf3-fe61ed980683-kube-api-access-ff9q7\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.495250 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.495329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.495438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.500701 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.501432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.501965 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.511552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-ssh-key\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.529089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff9q7\" (UniqueName: \"kubernetes.io/projected/82ca09be-8886-4bab-bcf3-fe61ed980683-kube-api-access-ff9q7\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:51 crc kubenswrapper[4769]: I1121 13:31:51.532088 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:52 crc kubenswrapper[4769]: I1121 13:31:52.004461 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks"] Nov 21 13:31:52 crc kubenswrapper[4769]: I1121 13:31:52.150673 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" event={"ID":"82ca09be-8886-4bab-bcf3-fe61ed980683","Type":"ContainerStarted","Data":"8263bb1b97ddd7c142b06120dbd4e5bcb96eaf3b647c7e2665994079f0c4d745"} Nov 21 13:31:53 crc kubenswrapper[4769]: I1121 13:31:53.163801 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" event={"ID":"82ca09be-8886-4bab-bcf3-fe61ed980683","Type":"ContainerStarted","Data":"9adafb00afe2961660380b1dbd4f5423ee9c1ad95b9bc4e7de9d22ade012b287"} Nov 21 13:31:53 crc kubenswrapper[4769]: I1121 13:31:53.192973 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" podStartSLOduration=1.512997023 podStartE2EDuration="2.192953823s" podCreationTimestamp="2025-11-21 13:31:51 +0000 UTC" firstStartedPulling="2025-11-21 13:31:52.007963576 +0000 UTC m=+6070.708625414" lastFinishedPulling="2025-11-21 13:31:52.687920386 +0000 UTC m=+6071.388582214" observedRunningTime="2025-11-21 13:31:53.187158242 +0000 UTC m=+6071.887820060" watchObservedRunningTime="2025-11-21 13:31:53.192953823 +0000 UTC m=+6071.893615631" Nov 21 13:31:54 crc kubenswrapper[4769]: I1121 13:31:54.177313 4769 generic.go:334] "Generic (PLEG): container finished" podID="82ca09be-8886-4bab-bcf3-fe61ed980683" containerID="9adafb00afe2961660380b1dbd4f5423ee9c1ad95b9bc4e7de9d22ade012b287" exitCode=0 Nov 21 13:31:54 crc kubenswrapper[4769]: I1121 13:31:54.177440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" event={"ID":"82ca09be-8886-4bab-bcf3-fe61ed980683","Type":"ContainerDied","Data":"9adafb00afe2961660380b1dbd4f5423ee9c1ad95b9bc4e7de9d22ade012b287"} Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.508777 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.675484 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff9q7\" (UniqueName: \"kubernetes.io/projected/82ca09be-8886-4bab-bcf3-fe61ed980683-kube-api-access-ff9q7\") pod \"82ca09be-8886-4bab-bcf3-fe61ed980683\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.675554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-agent-neutron-config-0\") pod \"82ca09be-8886-4bab-bcf3-fe61ed980683\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.675622 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-combined-ca-bundle\") pod \"82ca09be-8886-4bab-bcf3-fe61ed980683\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.675645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-inventory\") pod \"82ca09be-8886-4bab-bcf3-fe61ed980683\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.675726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-ssh-key\") pod \"82ca09be-8886-4bab-bcf3-fe61ed980683\" (UID: \"82ca09be-8886-4bab-bcf3-fe61ed980683\") " Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.681322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "82ca09be-8886-4bab-bcf3-fe61ed980683" (UID: "82ca09be-8886-4bab-bcf3-fe61ed980683"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.681454 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ca09be-8886-4bab-bcf3-fe61ed980683-kube-api-access-ff9q7" (OuterVolumeSpecName: "kube-api-access-ff9q7") pod "82ca09be-8886-4bab-bcf3-fe61ed980683" (UID: "82ca09be-8886-4bab-bcf3-fe61ed980683"). InnerVolumeSpecName "kube-api-access-ff9q7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.699007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-inventory" (OuterVolumeSpecName: "inventory") pod "82ca09be-8886-4bab-bcf3-fe61ed980683" (UID: "82ca09be-8886-4bab-bcf3-fe61ed980683"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.699956 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "82ca09be-8886-4bab-bcf3-fe61ed980683" (UID: "82ca09be-8886-4bab-bcf3-fe61ed980683"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.706961 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "82ca09be-8886-4bab-bcf3-fe61ed980683" (UID: "82ca09be-8886-4bab-bcf3-fe61ed980683"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.777178 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ff9q7\" (UniqueName: \"kubernetes.io/projected/82ca09be-8886-4bab-bcf3-fe61ed980683-kube-api-access-ff9q7\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.777457 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.777471 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.777481 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:55 crc kubenswrapper[4769]: I1121 13:31:55.777491 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/82ca09be-8886-4bab-bcf3-fe61ed980683-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.199731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" event={"ID":"82ca09be-8886-4bab-bcf3-fe61ed980683","Type":"ContainerDied","Data":"8263bb1b97ddd7c142b06120dbd4e5bcb96eaf3b647c7e2665994079f0c4d745"} Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.199804 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8263bb1b97ddd7c142b06120dbd4e5bcb96eaf3b647c7e2665994079f0c4d745" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.199939 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.313377 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb"] Nov 21 13:31:56 crc kubenswrapper[4769]: E1121 13:31:56.313858 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82ca09be-8886-4bab-bcf3-fe61ed980683" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.313890 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ca09be-8886-4bab-bcf3-fe61ed980683" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.314136 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="82ca09be-8886-4bab-bcf3-fe61ed980683" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-global" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.315071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.318058 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.318094 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.318178 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-sriov-agent-neutron-config" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.318339 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.318239 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.318525 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.335569 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb"] Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.487251 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.487380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-ssh-key\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.487512 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzgvd\" (UniqueName: \"kubernetes.io/projected/9b60874a-f01a-427e-a977-a8a2fe0158c5-kube-api-access-zzgvd\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.487600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.487665 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.588703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.588773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.588828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.588885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-ssh-key\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.588996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zzgvd\" (UniqueName: \"kubernetes.io/projected/9b60874a-f01a-427e-a977-a8a2fe0158c5-kube-api-access-zzgvd\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.594842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.596526 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.596855 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.599085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-ssh-key\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.618057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzgvd\" (UniqueName: \"kubernetes.io/projected/9b60874a-f01a-427e-a977-a8a2fe0158c5-kube-api-access-zzgvd\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:56 crc kubenswrapper[4769]: I1121 13:31:56.644960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:31:57 crc kubenswrapper[4769]: I1121 13:31:57.182671 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb"] Nov 21 13:31:57 crc kubenswrapper[4769]: W1121 13:31:57.190094 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b60874a_f01a_427e_a977_a8a2fe0158c5.slice/crio-3abd88c52aec3e7c18433f659e87c7e5d9f0c77c1457202c5c5df03b67eb266b WatchSource:0}: Error finding container 3abd88c52aec3e7c18433f659e87c7e5d9f0c77c1457202c5c5df03b67eb266b: Status 404 returned error can't find the container with id 3abd88c52aec3e7c18433f659e87c7e5d9f0c77c1457202c5c5df03b67eb266b Nov 21 13:31:57 crc kubenswrapper[4769]: I1121 13:31:57.217876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" event={"ID":"9b60874a-f01a-427e-a977-a8a2fe0158c5","Type":"ContainerStarted","Data":"3abd88c52aec3e7c18433f659e87c7e5d9f0c77c1457202c5c5df03b67eb266b"} Nov 21 13:31:58 crc kubenswrapper[4769]: I1121 13:31:58.234243 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" event={"ID":"9b60874a-f01a-427e-a977-a8a2fe0158c5","Type":"ContainerStarted","Data":"4458d7a3062baecb353b60c0a34be762e0ee11bbb1e66311961989c3436ae20d"} Nov 21 13:31:58 crc kubenswrapper[4769]: I1121 13:31:58.268482 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" podStartSLOduration=1.876197595 podStartE2EDuration="2.268439822s" podCreationTimestamp="2025-11-21 13:31:56 +0000 UTC" firstStartedPulling="2025-11-21 13:31:57.193502131 +0000 UTC m=+6075.894163969" lastFinishedPulling="2025-11-21 13:31:57.585744348 +0000 UTC m=+6076.286406196" observedRunningTime="2025-11-21 13:31:58.253736887 +0000 UTC m=+6076.954398735" watchObservedRunningTime="2025-11-21 13:31:58.268439822 +0000 UTC m=+6076.969101670" Nov 21 13:31:59 crc kubenswrapper[4769]: I1121 13:31:59.248835 4769 generic.go:334] "Generic (PLEG): container finished" podID="9b60874a-f01a-427e-a977-a8a2fe0158c5" containerID="4458d7a3062baecb353b60c0a34be762e0ee11bbb1e66311961989c3436ae20d" exitCode=0 Nov 21 13:31:59 crc kubenswrapper[4769]: I1121 13:31:59.248902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" event={"ID":"9b60874a-f01a-427e-a977-a8a2fe0158c5","Type":"ContainerDied","Data":"4458d7a3062baecb353b60c0a34be762e0ee11bbb1e66311961989c3436ae20d"} Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.609019 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.763381 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-combined-ca-bundle\") pod \"9b60874a-f01a-427e-a977-a8a2fe0158c5\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.763506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-ssh-key\") pod \"9b60874a-f01a-427e-a977-a8a2fe0158c5\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.763610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzgvd\" (UniqueName: \"kubernetes.io/projected/9b60874a-f01a-427e-a977-a8a2fe0158c5-kube-api-access-zzgvd\") pod \"9b60874a-f01a-427e-a977-a8a2fe0158c5\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.763867 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-agent-neutron-config-0\") pod \"9b60874a-f01a-427e-a977-a8a2fe0158c5\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.763966 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-inventory\") pod \"9b60874a-f01a-427e-a977-a8a2fe0158c5\" (UID: \"9b60874a-f01a-427e-a977-a8a2fe0158c5\") " Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.771525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b60874a-f01a-427e-a977-a8a2fe0158c5-kube-api-access-zzgvd" (OuterVolumeSpecName: "kube-api-access-zzgvd") pod "9b60874a-f01a-427e-a977-a8a2fe0158c5" (UID: "9b60874a-f01a-427e-a977-a8a2fe0158c5"). InnerVolumeSpecName "kube-api-access-zzgvd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.772582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "9b60874a-f01a-427e-a977-a8a2fe0158c5" (UID: "9b60874a-f01a-427e-a977-a8a2fe0158c5"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.773056 4769 scope.go:117] "RemoveContainer" containerID="91b7d2f78e02c9a15743e06682ccf76288024c1e88cfc65e567a567345670ac8" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.788921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "9b60874a-f01a-427e-a977-a8a2fe0158c5" (UID: "9b60874a-f01a-427e-a977-a8a2fe0158c5"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.793443 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-inventory" (OuterVolumeSpecName: "inventory") pod "9b60874a-f01a-427e-a977-a8a2fe0158c5" (UID: "9b60874a-f01a-427e-a977-a8a2fe0158c5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.811106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "9b60874a-f01a-427e-a977-a8a2fe0158c5" (UID: "9b60874a-f01a-427e-a977-a8a2fe0158c5"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.865493 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.865528 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.865540 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zzgvd\" (UniqueName: \"kubernetes.io/projected/9b60874a-f01a-427e-a977-a8a2fe0158c5-kube-api-access-zzgvd\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.865552 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.865563 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9b60874a-f01a-427e-a977-a8a2fe0158c5-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.908484 4769 scope.go:117] "RemoveContainer" containerID="d4b92ecfef7c6e9ac2708c8d2e3892522247b4ab3c5d5d8cfd4298451b09ca86" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.939953 4769 scope.go:117] "RemoveContainer" containerID="1490c4b49bf1652e231a7451f3d5ef9c8f7eb7815feecf8a79db6a1d5cc35c9b" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.962475 4769 scope.go:117] "RemoveContainer" containerID="a93f684bae5b0ac67e6909c3d551ebfe826dfdc9589994e405863f69bdbfcf6d" Nov 21 13:32:00 crc kubenswrapper[4769]: I1121 13:32:00.998240 4769 scope.go:117] "RemoveContainer" containerID="b5238dc0a8fc58c4f021e3ef4bda3259b0735deb5ada008f6177ffedb87a27ec" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.273539 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.293051 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb" event={"ID":"9b60874a-f01a-427e-a977-a8a2fe0158c5","Type":"ContainerDied","Data":"3abd88c52aec3e7c18433f659e87c7e5d9f0c77c1457202c5c5df03b67eb266b"} Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.293118 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3abd88c52aec3e7c18433f659e87c7e5d9f0c77c1457202c5c5df03b67eb266b" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.401249 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn"] Nov 21 13:32:01 crc kubenswrapper[4769]: E1121 13:32:01.402318 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9b60874a-f01a-427e-a977-a8a2fe0158c5" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.402341 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b60874a-f01a-427e-a977-a8a2fe0158c5" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.402550 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9b60874a-f01a-427e-a977-a8a2fe0158c5" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.403265 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.407297 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.407379 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-dhcp-agent-neutron-config" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.408571 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.408832 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.409064 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.409123 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn"] Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.409930 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.475141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.475306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.475355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-ssh-key\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.475400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.475466 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj7bx\" (UniqueName: \"kubernetes.io/projected/8860ffe7-2f55-449b-bef4-f4127374f5fb-kube-api-access-vj7bx\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.576476 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vj7bx\" (UniqueName: \"kubernetes.io/projected/8860ffe7-2f55-449b-bef4-f4127374f5fb-kube-api-access-vj7bx\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.576616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.576690 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.576734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-ssh-key\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.576770 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.581151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.581840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-ssh-key\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.582021 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.584127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.594968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj7bx\" (UniqueName: \"kubernetes.io/projected/8860ffe7-2f55-449b-bef4-f4127374f5fb-kube-api-access-vj7bx\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:01 crc kubenswrapper[4769]: I1121 13:32:01.721962 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:02 crc kubenswrapper[4769]: I1121 13:32:02.181044 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn"] Nov 21 13:32:02 crc kubenswrapper[4769]: W1121 13:32:02.181976 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8860ffe7_2f55_449b_bef4_f4127374f5fb.slice/crio-f4647bdd9db8bbfae12a819932e116db99bfe19bbca35adaff410d866a8fb90b WatchSource:0}: Error finding container f4647bdd9db8bbfae12a819932e116db99bfe19bbca35adaff410d866a8fb90b: Status 404 returned error can't find the container with id f4647bdd9db8bbfae12a819932e116db99bfe19bbca35adaff410d866a8fb90b Nov 21 13:32:02 crc kubenswrapper[4769]: I1121 13:32:02.288774 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" event={"ID":"8860ffe7-2f55-449b-bef4-f4127374f5fb","Type":"ContainerStarted","Data":"f4647bdd9db8bbfae12a819932e116db99bfe19bbca35adaff410d866a8fb90b"} Nov 21 13:32:04 crc kubenswrapper[4769]: I1121 13:32:04.332372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" event={"ID":"8860ffe7-2f55-449b-bef4-f4127374f5fb","Type":"ContainerStarted","Data":"7c81520ef289c4c39f2d971f9bad236385df8809490cffa01cc7f3362191a091"} Nov 21 13:32:04 crc kubenswrapper[4769]: I1121 13:32:04.360712 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" podStartSLOduration=2.453373971 podStartE2EDuration="3.360685428s" podCreationTimestamp="2025-11-21 13:32:01 +0000 UTC" firstStartedPulling="2025-11-21 13:32:02.184964022 +0000 UTC m=+6080.885625840" lastFinishedPulling="2025-11-21 13:32:03.092275439 +0000 UTC m=+6081.792937297" observedRunningTime="2025-11-21 13:32:04.353928192 +0000 UTC m=+6083.054590030" watchObservedRunningTime="2025-11-21 13:32:04.360685428 +0000 UTC m=+6083.061347246" Nov 21 13:32:05 crc kubenswrapper[4769]: I1121 13:32:05.273976 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:32:05 crc kubenswrapper[4769]: E1121 13:32:05.274412 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:32:05 crc kubenswrapper[4769]: I1121 13:32:05.346830 4769 generic.go:334] "Generic (PLEG): container finished" podID="8860ffe7-2f55-449b-bef4-f4127374f5fb" containerID="7c81520ef289c4c39f2d971f9bad236385df8809490cffa01cc7f3362191a091" exitCode=0 Nov 21 13:32:05 crc kubenswrapper[4769]: I1121 13:32:05.346903 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" event={"ID":"8860ffe7-2f55-449b-bef4-f4127374f5fb","Type":"ContainerDied","Data":"7c81520ef289c4c39f2d971f9bad236385df8809490cffa01cc7f3362191a091"} Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.737006 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.863943 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-ssh-key\") pod \"8860ffe7-2f55-449b-bef4-f4127374f5fb\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.864253 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-combined-ca-bundle\") pod \"8860ffe7-2f55-449b-bef4-f4127374f5fb\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.864504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-agent-neutron-config-0\") pod \"8860ffe7-2f55-449b-bef4-f4127374f5fb\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.865013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj7bx\" (UniqueName: \"kubernetes.io/projected/8860ffe7-2f55-449b-bef4-f4127374f5fb-kube-api-access-vj7bx\") pod \"8860ffe7-2f55-449b-bef4-f4127374f5fb\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.865159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-inventory\") pod \"8860ffe7-2f55-449b-bef4-f4127374f5fb\" (UID: \"8860ffe7-2f55-449b-bef4-f4127374f5fb\") " Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.878249 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "8860ffe7-2f55-449b-bef4-f4127374f5fb" (UID: "8860ffe7-2f55-449b-bef4-f4127374f5fb"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.878407 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8860ffe7-2f55-449b-bef4-f4127374f5fb-kube-api-access-vj7bx" (OuterVolumeSpecName: "kube-api-access-vj7bx") pod "8860ffe7-2f55-449b-bef4-f4127374f5fb" (UID: "8860ffe7-2f55-449b-bef4-f4127374f5fb"). InnerVolumeSpecName "kube-api-access-vj7bx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.885620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "8860ffe7-2f55-449b-bef4-f4127374f5fb" (UID: "8860ffe7-2f55-449b-bef4-f4127374f5fb"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.905828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "8860ffe7-2f55-449b-bef4-f4127374f5fb" (UID: "8860ffe7-2f55-449b-bef4-f4127374f5fb"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.906943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-inventory" (OuterVolumeSpecName: "inventory") pod "8860ffe7-2f55-449b-bef4-f4127374f5fb" (UID: "8860ffe7-2f55-449b-bef4-f4127374f5fb"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.966215 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vj7bx\" (UniqueName: \"kubernetes.io/projected/8860ffe7-2f55-449b-bef4-f4127374f5fb-kube-api-access-vj7bx\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.966396 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.966451 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.966539 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:06 crc kubenswrapper[4769]: I1121 13:32:06.966622 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/8860ffe7-2f55-449b-bef4-f4127374f5fb-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.373109 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" event={"ID":"8860ffe7-2f55-449b-bef4-f4127374f5fb","Type":"ContainerDied","Data":"f4647bdd9db8bbfae12a819932e116db99bfe19bbca35adaff410d866a8fb90b"} Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.373161 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4647bdd9db8bbfae12a819932e116db99bfe19bbca35adaff410d866a8fb90b" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.373413 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.441161 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429"] Nov 21 13:32:07 crc kubenswrapper[4769]: E1121 13:32:07.441558 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8860ffe7-2f55-449b-bef4-f4127374f5fb" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.441575 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8860ffe7-2f55-449b-bef4-f4127374f5fb" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.441729 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8860ffe7-2f55-449b-bef4-f4127374f5fb" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.442185 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.444982 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.445048 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.445087 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"libvirt-secret" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.445122 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.445137 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.445310 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.456814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429"] Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.474014 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzl4\" (UniqueName: \"kubernetes.io/projected/77a33562-7d81-4964-8e28-23703797c98c-kube-api-access-pdzl4\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.474113 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-ssh-key\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.474153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.474289 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.474444 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.575481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzl4\" (UniqueName: \"kubernetes.io/projected/77a33562-7d81-4964-8e28-23703797c98c-kube-api-access-pdzl4\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.575540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-ssh-key\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.575570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.575595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.575665 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.581504 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.581648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.581821 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-ssh-key\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.582107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.600127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzl4\" (UniqueName: \"kubernetes.io/projected/77a33562-7d81-4964-8e28-23703797c98c-kube-api-access-pdzl4\") pod \"libvirt-edpm-multinodeset-edpm-compute-global-kq429\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:07 crc kubenswrapper[4769]: I1121 13:32:07.756287 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:08 crc kubenswrapper[4769]: I1121 13:32:08.027478 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429"] Nov 21 13:32:08 crc kubenswrapper[4769]: W1121 13:32:08.029052 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77a33562_7d81_4964_8e28_23703797c98c.slice/crio-fc3a2783e39cab94ed13f301c03edfe83ed4e5407be1a175bbc3e7cc6d1b8916 WatchSource:0}: Error finding container fc3a2783e39cab94ed13f301c03edfe83ed4e5407be1a175bbc3e7cc6d1b8916: Status 404 returned error can't find the container with id fc3a2783e39cab94ed13f301c03edfe83ed4e5407be1a175bbc3e7cc6d1b8916 Nov 21 13:32:08 crc kubenswrapper[4769]: I1121 13:32:08.388300 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" event={"ID":"77a33562-7d81-4964-8e28-23703797c98c","Type":"ContainerStarted","Data":"fc3a2783e39cab94ed13f301c03edfe83ed4e5407be1a175bbc3e7cc6d1b8916"} Nov 21 13:32:09 crc kubenswrapper[4769]: I1121 13:32:09.400881 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" event={"ID":"77a33562-7d81-4964-8e28-23703797c98c","Type":"ContainerStarted","Data":"97d8ca2aa36c02ef2ec34ae3820617f45d3ae8a89764fc41cdc88e74280c3347"} Nov 21 13:32:09 crc kubenswrapper[4769]: I1121 13:32:09.437915 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" podStartSLOduration=1.9678805110000002 podStartE2EDuration="2.437872972s" podCreationTimestamp="2025-11-21 13:32:07 +0000 UTC" firstStartedPulling="2025-11-21 13:32:08.032031888 +0000 UTC m=+6086.732693706" lastFinishedPulling="2025-11-21 13:32:08.502024349 +0000 UTC m=+6087.202686167" observedRunningTime="2025-11-21 13:32:09.425587381 +0000 UTC m=+6088.126249279" watchObservedRunningTime="2025-11-21 13:32:09.437872972 +0000 UTC m=+6088.138534830" Nov 21 13:32:09 crc kubenswrapper[4769]: E1121 13:32:09.958365 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77a33562_7d81_4964_8e28_23703797c98c.slice/crio-conmon-97d8ca2aa36c02ef2ec34ae3820617f45d3ae8a89764fc41cdc88e74280c3347.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77a33562_7d81_4964_8e28_23703797c98c.slice/crio-97d8ca2aa36c02ef2ec34ae3820617f45d3ae8a89764fc41cdc88e74280c3347.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:32:10 crc kubenswrapper[4769]: I1121 13:32:10.415518 4769 generic.go:334] "Generic (PLEG): container finished" podID="77a33562-7d81-4964-8e28-23703797c98c" containerID="97d8ca2aa36c02ef2ec34ae3820617f45d3ae8a89764fc41cdc88e74280c3347" exitCode=0 Nov 21 13:32:10 crc kubenswrapper[4769]: I1121 13:32:10.415657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" event={"ID":"77a33562-7d81-4964-8e28-23703797c98c","Type":"ContainerDied","Data":"97d8ca2aa36c02ef2ec34ae3820617f45d3ae8a89764fc41cdc88e74280c3347"} Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.805532 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.953555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-secret-0\") pod \"77a33562-7d81-4964-8e28-23703797c98c\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.953647 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-inventory\") pod \"77a33562-7d81-4964-8e28-23703797c98c\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.953724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-combined-ca-bundle\") pod \"77a33562-7d81-4964-8e28-23703797c98c\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.953811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdzl4\" (UniqueName: \"kubernetes.io/projected/77a33562-7d81-4964-8e28-23703797c98c-kube-api-access-pdzl4\") pod \"77a33562-7d81-4964-8e28-23703797c98c\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.953851 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-ssh-key\") pod \"77a33562-7d81-4964-8e28-23703797c98c\" (UID: \"77a33562-7d81-4964-8e28-23703797c98c\") " Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.961544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a33562-7d81-4964-8e28-23703797c98c-kube-api-access-pdzl4" (OuterVolumeSpecName: "kube-api-access-pdzl4") pod "77a33562-7d81-4964-8e28-23703797c98c" (UID: "77a33562-7d81-4964-8e28-23703797c98c"). InnerVolumeSpecName "kube-api-access-pdzl4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.962039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "77a33562-7d81-4964-8e28-23703797c98c" (UID: "77a33562-7d81-4964-8e28-23703797c98c"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.993251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "77a33562-7d81-4964-8e28-23703797c98c" (UID: "77a33562-7d81-4964-8e28-23703797c98c"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.995295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-inventory" (OuterVolumeSpecName: "inventory") pod "77a33562-7d81-4964-8e28-23703797c98c" (UID: "77a33562-7d81-4964-8e28-23703797c98c"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:11 crc kubenswrapper[4769]: I1121 13:32:11.995982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "77a33562-7d81-4964-8e28-23703797c98c" (UID: "77a33562-7d81-4964-8e28-23703797c98c"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.056137 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.056221 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.056245 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pdzl4\" (UniqueName: \"kubernetes.io/projected/77a33562-7d81-4964-8e28-23703797c98c-kube-api-access-pdzl4\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.056262 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.056284 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/77a33562-7d81-4964-8e28-23703797c98c-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.444894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" event={"ID":"77a33562-7d81-4964-8e28-23703797c98c","Type":"ContainerDied","Data":"fc3a2783e39cab94ed13f301c03edfe83ed4e5407be1a175bbc3e7cc6d1b8916"} Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.444952 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc3a2783e39cab94ed13f301c03edfe83ed4e5407be1a175bbc3e7cc6d1b8916" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.444982 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.538053 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl"] Nov 21 13:32:12 crc kubenswrapper[4769]: E1121 13:32:12.538803 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="77a33562-7d81-4964-8e28-23703797c98c" containerName="libvirt-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.538896 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a33562-7d81-4964-8e28-23703797c98c" containerName="libvirt-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.539175 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="77a33562-7d81-4964-8e28-23703797c98c" containerName="libvirt-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.539990 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.547984 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl"] Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.576358 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-migration-ssh-key" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.576591 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.576897 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.577129 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-compute-config" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.577497 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.577173 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.577946 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.680447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhpcw\" (UniqueName: \"kubernetes.io/projected/ad571476-420e-4381-918e-3a11834e3f1f-kube-api-access-bhpcw\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.680770 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.680885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.681022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.681144 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.681294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.681423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-ssh-key\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.681585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-ssh-key\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783699 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bhpcw\" (UniqueName: \"kubernetes.io/projected/ad571476-420e-4381-918e-3a11834e3f1f-kube-api-access-bhpcw\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783816 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.783935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.789718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-ssh-key\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.790039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.790125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.791916 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.792498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.793043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.793583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.812173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhpcw\" (UniqueName: \"kubernetes.io/projected/ad571476-420e-4381-918e-3a11834e3f1f-kube-api-access-bhpcw\") pod \"nova-edpm-multinodeset-edpm-compute-global-slrkl\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:12 crc kubenswrapper[4769]: I1121 13:32:12.894982 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:13 crc kubenswrapper[4769]: I1121 13:32:13.163611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl"] Nov 21 13:32:13 crc kubenswrapper[4769]: I1121 13:32:13.453942 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" event={"ID":"ad571476-420e-4381-918e-3a11834e3f1f","Type":"ContainerStarted","Data":"569597df606d60ad9aca3ddc7a8f9a3be288ea45f860b8423cdc7f4488ed29a3"} Nov 21 13:32:14 crc kubenswrapper[4769]: I1121 13:32:14.473172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" event={"ID":"ad571476-420e-4381-918e-3a11834e3f1f","Type":"ContainerStarted","Data":"9e5cd229e09e08687983145ebd4abcabc33746072ae3b94360c579b52d035d57"} Nov 21 13:32:14 crc kubenswrapper[4769]: I1121 13:32:14.514578 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" podStartSLOduration=2.125433227 podStartE2EDuration="2.514547602s" podCreationTimestamp="2025-11-21 13:32:12 +0000 UTC" firstStartedPulling="2025-11-21 13:32:13.206762384 +0000 UTC m=+6091.907424192" lastFinishedPulling="2025-11-21 13:32:13.595876719 +0000 UTC m=+6092.296538567" observedRunningTime="2025-11-21 13:32:14.507886388 +0000 UTC m=+6093.208548256" watchObservedRunningTime="2025-11-21 13:32:14.514547602 +0000 UTC m=+6093.215209460" Nov 21 13:32:15 crc kubenswrapper[4769]: I1121 13:32:15.487739 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad571476-420e-4381-918e-3a11834e3f1f" containerID="9e5cd229e09e08687983145ebd4abcabc33746072ae3b94360c579b52d035d57" exitCode=0 Nov 21 13:32:15 crc kubenswrapper[4769]: I1121 13:32:15.487826 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" event={"ID":"ad571476-420e-4381-918e-3a11834e3f1f","Type":"ContainerDied","Data":"9e5cd229e09e08687983145ebd4abcabc33746072ae3b94360c579b52d035d57"} Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.872012 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.959811 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-0\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.960108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-1\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.960217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhpcw\" (UniqueName: \"kubernetes.io/projected/ad571476-420e-4381-918e-3a11834e3f1f-kube-api-access-bhpcw\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.960298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-combined-ca-bundle\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.960366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-ssh-key\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.960481 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-1\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.961388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-0\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.961516 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-inventory\") pod \"ad571476-420e-4381-918e-3a11834e3f1f\" (UID: \"ad571476-420e-4381-918e-3a11834e3f1f\") " Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.967137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad571476-420e-4381-918e-3a11834e3f1f-kube-api-access-bhpcw" (OuterVolumeSpecName: "kube-api-access-bhpcw") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "kube-api-access-bhpcw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.970038 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.990749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.992731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.993084 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.997606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.998715 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-inventory" (OuterVolumeSpecName: "inventory") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:16 crc kubenswrapper[4769]: I1121 13:32:16.999137 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "ad571476-420e-4381-918e-3a11834e3f1f" (UID: "ad571476-420e-4381-918e-3a11834e3f1f"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063822 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063879 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063902 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063928 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063946 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063964 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bhpcw\" (UniqueName: \"kubernetes.io/projected/ad571476-420e-4381-918e-3a11834e3f1f-kube-api-access-bhpcw\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.063982 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.064001 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ad571476-420e-4381-918e-3a11834e3f1f-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.516941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" event={"ID":"ad571476-420e-4381-918e-3a11834e3f1f","Type":"ContainerDied","Data":"569597df606d60ad9aca3ddc7a8f9a3be288ea45f860b8423cdc7f4488ed29a3"} Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.517040 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="569597df606d60ad9aca3ddc7a8f9a3be288ea45f860b8423cdc7f4488ed29a3" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.516983 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.606769 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p"] Nov 21 13:32:17 crc kubenswrapper[4769]: E1121 13:32:17.607929 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad571476-420e-4381-918e-3a11834e3f1f" containerName="nova-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.607976 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad571476-420e-4381-918e-3a11834e3f1f" containerName="nova-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.608449 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad571476-420e-4381-918e-3a11834e3f1f" containerName="nova-edpm-multinodeset-edpm-compute-global" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.609578 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.612359 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-beta-nodeset" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.612690 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-global" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.612913 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.613214 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.613391 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-global-dockercfg-htjln" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.613974 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.616471 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p"] Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.775705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-beta-nodeset\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.775747 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-1\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.775771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqzdd\" (UniqueName: \"kubernetes.io/projected/150ee535-159d-47f6-9b98-3e9fc74f1e63-kube-api-access-zqzdd\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.775872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-0\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.775952 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.775997 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.877454 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-beta-nodeset\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.877504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-1\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.877530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zqzdd\" (UniqueName: \"kubernetes.io/projected/150ee535-159d-47f6-9b98-3e9fc74f1e63-kube-api-access-zqzdd\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.877550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-0\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.877577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.877607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.883089 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-global\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.883538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-custom-global-service-combined-ca-bundle\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.884364 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-beta-nodeset\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.889368 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-1\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.897931 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-0\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.899749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqzdd\" (UniqueName: \"kubernetes.io/projected/150ee535-159d-47f6-9b98-3e9fc74f1e63-kube-api-access-zqzdd\") pod \"custom-global-service-edpm-multinodeset-l842p\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:17 crc kubenswrapper[4769]: I1121 13:32:17.958051 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:18 crc kubenswrapper[4769]: I1121 13:32:18.416683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p"] Nov 21 13:32:18 crc kubenswrapper[4769]: I1121 13:32:18.545380 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" event={"ID":"150ee535-159d-47f6-9b98-3e9fc74f1e63","Type":"ContainerStarted","Data":"54b6f5f1cd4b74ca3ce1f00e20a735bb85fb5dcc905994da6c3adad379e92682"} Nov 21 13:32:19 crc kubenswrapper[4769]: I1121 13:32:19.557605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" event={"ID":"150ee535-159d-47f6-9b98-3e9fc74f1e63","Type":"ContainerStarted","Data":"02ce821a4b552b8e276c0566076bf0ca416e435f948260b60fe9e4e832e33d2b"} Nov 21 13:32:19 crc kubenswrapper[4769]: I1121 13:32:19.576613 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" podStartSLOduration=2.062824615 podStartE2EDuration="2.576596071s" podCreationTimestamp="2025-11-21 13:32:17 +0000 UTC" firstStartedPulling="2025-11-21 13:32:18.417001286 +0000 UTC m=+6097.117663144" lastFinishedPulling="2025-11-21 13:32:18.930772732 +0000 UTC m=+6097.631434600" observedRunningTime="2025-11-21 13:32:19.576023226 +0000 UTC m=+6098.276685054" watchObservedRunningTime="2025-11-21 13:32:19.576596071 +0000 UTC m=+6098.277257909" Nov 21 13:32:20 crc kubenswrapper[4769]: I1121 13:32:20.273736 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:32:20 crc kubenswrapper[4769]: E1121 13:32:20.274194 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:32:22 crc kubenswrapper[4769]: I1121 13:32:22.600267 4769 generic.go:334] "Generic (PLEG): container finished" podID="150ee535-159d-47f6-9b98-3e9fc74f1e63" containerID="02ce821a4b552b8e276c0566076bf0ca416e435f948260b60fe9e4e832e33d2b" exitCode=0 Nov 21 13:32:22 crc kubenswrapper[4769]: I1121 13:32:22.600331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" event={"ID":"150ee535-159d-47f6-9b98-3e9fc74f1e63","Type":"ContainerDied","Data":"02ce821a4b552b8e276c0566076bf0ca416e435f948260b60fe9e4e832e33d2b"} Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.022035 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.116733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-0\") pod \"150ee535-159d-47f6-9b98-3e9fc74f1e63\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.116815 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-beta-nodeset\") pod \"150ee535-159d-47f6-9b98-3e9fc74f1e63\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.116846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-custom-global-service-combined-ca-bundle\") pod \"150ee535-159d-47f6-9b98-3e9fc74f1e63\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.116872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqzdd\" (UniqueName: \"kubernetes.io/projected/150ee535-159d-47f6-9b98-3e9fc74f1e63-kube-api-access-zqzdd\") pod \"150ee535-159d-47f6-9b98-3e9fc74f1e63\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.116906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-global\") pod \"150ee535-159d-47f6-9b98-3e9fc74f1e63\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.117920 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-1\") pod \"150ee535-159d-47f6-9b98-3e9fc74f1e63\" (UID: \"150ee535-159d-47f6-9b98-3e9fc74f1e63\") " Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.129688 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150ee535-159d-47f6-9b98-3e9fc74f1e63-kube-api-access-zqzdd" (OuterVolumeSpecName: "kube-api-access-zqzdd") pod "150ee535-159d-47f6-9b98-3e9fc74f1e63" (UID: "150ee535-159d-47f6-9b98-3e9fc74f1e63"). InnerVolumeSpecName "kube-api-access-zqzdd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.129927 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-custom-global-service-combined-ca-bundle" (OuterVolumeSpecName: "custom-global-service-combined-ca-bundle") pod "150ee535-159d-47f6-9b98-3e9fc74f1e63" (UID: "150ee535-159d-47f6-9b98-3e9fc74f1e63"). InnerVolumeSpecName "custom-global-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.146422 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "ssh-key-edpm-compute-beta-nodeset") pod "150ee535-159d-47f6-9b98-3e9fc74f1e63" (UID: "150ee535-159d-47f6-9b98-3e9fc74f1e63"). InnerVolumeSpecName "ssh-key-edpm-compute-beta-nodeset". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.146838 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-global" (OuterVolumeSpecName: "ssh-key-edpm-compute-global") pod "150ee535-159d-47f6-9b98-3e9fc74f1e63" (UID: "150ee535-159d-47f6-9b98-3e9fc74f1e63"). InnerVolumeSpecName "ssh-key-edpm-compute-global". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.160460 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-0" (OuterVolumeSpecName: "inventory-0") pod "150ee535-159d-47f6-9b98-3e9fc74f1e63" (UID: "150ee535-159d-47f6-9b98-3e9fc74f1e63"). InnerVolumeSpecName "inventory-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.169045 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-1" (OuterVolumeSpecName: "inventory-1") pod "150ee535-159d-47f6-9b98-3e9fc74f1e63" (UID: "150ee535-159d-47f6-9b98-3e9fc74f1e63"). InnerVolumeSpecName "inventory-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.220338 4769 reconciler_common.go:293] "Volume detached for volume \"inventory-0\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.220405 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key-edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.220428 4769 reconciler_common.go:293] "Volume detached for volume \"custom-global-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-custom-global-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.220454 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zqzdd\" (UniqueName: \"kubernetes.io/projected/150ee535-159d-47f6-9b98-3e9fc74f1e63-kube-api-access-zqzdd\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.220480 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key-edpm-compute-global\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-ssh-key-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.220498 4769 reconciler_common.go:293] "Volume detached for volume \"inventory-1\" (UniqueName: \"kubernetes.io/secret/150ee535-159d-47f6-9b98-3e9fc74f1e63-inventory-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.641521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" event={"ID":"150ee535-159d-47f6-9b98-3e9fc74f1e63","Type":"ContainerDied","Data":"54b6f5f1cd4b74ca3ce1f00e20a735bb85fb5dcc905994da6c3adad379e92682"} Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.641936 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54b6f5f1cd4b74ca3ce1f00e20a735bb85fb5dcc905994da6c3adad379e92682" Nov 21 13:32:24 crc kubenswrapper[4769]: I1121 13:32:24.641639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.135632 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.143650 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-global-kq429"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.151083 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.162347 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.169115 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.176005 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-global-z9mbr"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.184905 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.191548 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-global-sgf2s"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.198145 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-global-4c5wt"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.205069 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.211701 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.218713 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-global-8bd54"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.224769 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-global-75sd8"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.231356 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-global-56qvb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.237626 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.244292 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.287534 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a81bb5-4c50-4011-937d-f4e211159ba5" path="/var/lib/kubelet/pods/07a81bb5-4c50-4011-937d-f4e211159ba5/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.288121 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b2f4fb-13cd-4524-b9a6-5ae7b1798de7" path="/var/lib/kubelet/pods/11b2f4fb-13cd-4524-b9a6-5ae7b1798de7/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.288663 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409efb81-0c51-4cf4-a525-577d64be2834" path="/var/lib/kubelet/pods/409efb81-0c51-4cf4-a525-577d64be2834/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.289199 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b" path="/var/lib/kubelet/pods/57ef1ad7-c315-45c2-8dc3-ea9432a0ff3b/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.290708 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a33562-7d81-4964-8e28-23703797c98c" path="/var/lib/kubelet/pods/77a33562-7d81-4964-8e28-23703797c98c/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.291222 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b60874a-f01a-427e-a977-a8a2fe0158c5" path="/var/lib/kubelet/pods/9b60874a-f01a-427e-a977-a8a2fe0158c5/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.291691 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d03859d6-f6cf-453d-8ab1-0cac11c59697" path="/var/lib/kubelet/pods/d03859d6-f6cf-453d-8ab1-0cac11c59697/volumes" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.292871 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.293946 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.303269 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.313114 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.319571 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.324697 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.330357 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-global-4w7mv"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.336100 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-multinodeset-l842p"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.342145 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-global-slrkl"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.348161 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-global-9cfkb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.353294 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-ft76c"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.361329 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-global-vsmks"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.370611 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-global-z2rpm"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.381339 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-global-bm2jf"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.397249 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.419319 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.425994 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.432099 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.439138 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.444161 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.449495 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.471041 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.478600 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.484610 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.490707 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetgdvv7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.496400 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-global-edpm-compute-global-9hrtw"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.501716 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-global-edpm-compute-global-f4tw6"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.506470 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-global-kv847"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.512806 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-global-service-edpm-compute-global-9l5mq"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.518513 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.523446 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-global-edpm-compute-global-7hjdq"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.528055 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-global-wzczn"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.532881 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-global-edpm-compute-global-jvkgf"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.538903 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-global-edpm-compute-global-t6qvb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.545014 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-global-edpm-compute-global-hcp2m"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.551165 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-global-edpm-compute-global-wp9nh"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.557305 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.562267 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.566734 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.573243 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.576985 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-global-edpm-compute-global-84nwp"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.581778 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.588520 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.594181 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-global-edpm-compute-global-vx4w8"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.598414 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-global-edpm-compute-global-ngpmd"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.603011 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.607372 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.613415 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-global-edpm-compute-global-nhzw7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.617614 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-global-edpm-compute-global-5tsqq"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.623112 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-global-edpm-compute-global-nt8hb"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.627374 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-global-edpm-compute-global-j82r7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.631836 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-global-edpm-compute-global-fshq7"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.636537 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z"] Nov 21 13:32:25 crc kubenswrapper[4769]: E1121 13:32:25.637057 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="150ee535-159d-47f6-9b98-3e9fc74f1e63" containerName="custom-global-service-edpm-multinodeset" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.637083 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="150ee535-159d-47f6-9b98-3e9fc74f1e63" containerName="custom-global-service-edpm-multinodeset" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.637378 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="150ee535-159d-47f6-9b98-3e9fc74f1e63" containerName="custom-global-service-edpm-multinodeset" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.638933 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.643686 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z"] Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.744456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.744893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqnf4\" (UniqueName: \"kubernetes.io/projected/3d2bc79f-c0d7-4625-8187-0885095662d3-kube-api-access-jqnf4\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.745062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.846550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnf4\" (UniqueName: \"kubernetes.io/projected/3d2bc79f-c0d7-4625-8187-0885095662d3-kube-api-access-jqnf4\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.846648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.846789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.847630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.847844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.877969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqnf4\" (UniqueName: \"kubernetes.io/projected/3d2bc79f-c0d7-4625-8187-0885095662d3-kube-api-access-jqnf4\") pod \"dnsmasq-dnsmasq-84b9f45d47-kv98z\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:25 crc kubenswrapper[4769]: I1121 13:32:25.968363 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:26 crc kubenswrapper[4769]: I1121 13:32:26.548289 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z"] Nov 21 13:32:26 crc kubenswrapper[4769]: I1121 13:32:26.671608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" event={"ID":"3d2bc79f-c0d7-4625-8187-0885095662d3","Type":"ContainerStarted","Data":"e47cc9f344db38a3d7436758fee88c8c6730dc2b56ab4fd20edcddcb9531d7ff"} Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.286145 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00200e3a-50f1-41d1-b946-12996d697270" path="/var/lib/kubelet/pods/00200e3a-50f1-41d1-b946-12996d697270/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.287569 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127d314b-c938-4dff-ad98-a4323c8ebace" path="/var/lib/kubelet/pods/127d314b-c938-4dff-ad98-a4323c8ebace/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.288606 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150ee535-159d-47f6-9b98-3e9fc74f1e63" path="/var/lib/kubelet/pods/150ee535-159d-47f6-9b98-3e9fc74f1e63/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.289633 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c" path="/var/lib/kubelet/pods/193cfdb7-8b03-49c4-bf01-7ed1ad2bb60c/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.291559 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37905d2c-e505-4675-91da-311a66b6d413" path="/var/lib/kubelet/pods/37905d2c-e505-4675-91da-311a66b6d413/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.292656 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4673ea55-5aa2-436a-a666-08f0978a9626" path="/var/lib/kubelet/pods/4673ea55-5aa2-436a-a666-08f0978a9626/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.293659 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4901aa5e-3211-407d-85be-b6f62dc3f4d1" path="/var/lib/kubelet/pods/4901aa5e-3211-407d-85be-b6f62dc3f4d1/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.295602 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b884669-a403-48e5-9741-5e89dcaec5d3" path="/var/lib/kubelet/pods/5b884669-a403-48e5-9741-5e89dcaec5d3/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.296590 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="635be697-3ad3-4888-88d2-10bd8769310b" path="/var/lib/kubelet/pods/635be697-3ad3-4888-88d2-10bd8769310b/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.297532 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66dc4420-6960-483d-9950-e3770b108183" path="/var/lib/kubelet/pods/66dc4420-6960-483d-9950-e3770b108183/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.299478 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68192d92-ce46-4320-a01b-81bf285230f8" path="/var/lib/kubelet/pods/68192d92-ce46-4320-a01b-81bf285230f8/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.300513 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a38a6af-edaf-4b9e-b616-a43508999994" path="/var/lib/kubelet/pods/6a38a6af-edaf-4b9e-b616-a43508999994/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.301553 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74faa949-c3b0-4f12-9312-610dd39ecc71" path="/var/lib/kubelet/pods/74faa949-c3b0-4f12-9312-610dd39ecc71/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.302745 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ca09be-8886-4bab-bcf3-fe61ed980683" path="/var/lib/kubelet/pods/82ca09be-8886-4bab-bcf3-fe61ed980683/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.304466 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8860ffe7-2f55-449b-bef4-f4127374f5fb" path="/var/lib/kubelet/pods/8860ffe7-2f55-449b-bef4-f4127374f5fb/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.305532 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66" path="/var/lib/kubelet/pods/88d4b0be-f5c8-4cf4-a5cf-7c448a92eb66/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.306824 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cebcd43-50f6-4169-8d6a-875b0aa8b305" path="/var/lib/kubelet/pods/8cebcd43-50f6-4169-8d6a-875b0aa8b305/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.308825 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d3ae695-2bb8-4b20-ac49-d4e741f1103e" path="/var/lib/kubelet/pods/8d3ae695-2bb8-4b20-ac49-d4e741f1103e/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.310007 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ef9154-1cbb-4b8d-af15-623088396f36" path="/var/lib/kubelet/pods/95ef9154-1cbb-4b8d-af15-623088396f36/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.311108 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b39b369-12bc-47aa-a198-cfd7153a873f" path="/var/lib/kubelet/pods/9b39b369-12bc-47aa-a198-cfd7153a873f/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.311813 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b729b96-0236-4148-bdb4-33046b028fcf" path="/var/lib/kubelet/pods/9b729b96-0236-4148-bdb4-33046b028fcf/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.312487 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab01a70a-84dd-4618-ae18-6b9b36ec5326" path="/var/lib/kubelet/pods/ab01a70a-84dd-4618-ae18-6b9b36ec5326/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.313420 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad571476-420e-4381-918e-3a11834e3f1f" path="/var/lib/kubelet/pods/ad571476-420e-4381-918e-3a11834e3f1f/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.313926 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ffa900-d127-4312-8125-4fcba0d0ef72" path="/var/lib/kubelet/pods/b0ffa900-d127-4312-8125-4fcba0d0ef72/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.314462 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf0b63d-e38f-48dc-987c-0546137ddb95" path="/var/lib/kubelet/pods/ccf0b63d-e38f-48dc-987c-0546137ddb95/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.315021 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f997fd8b-3986-4e20-b4e8-2465344ba505" path="/var/lib/kubelet/pods/f997fd8b-3986-4e20-b4e8-2465344ba505/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.315971 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb61f8f1-1c1b-438e-8586-75a7efd24b82" path="/var/lib/kubelet/pods/fb61f8f1-1c1b-438e-8586-75a7efd24b82/volumes" Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.684077 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerID="7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3" exitCode=0 Nov 21 13:32:27 crc kubenswrapper[4769]: I1121 13:32:27.684128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" event={"ID":"3d2bc79f-c0d7-4625-8187-0885095662d3","Type":"ContainerDied","Data":"7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3"} Nov 21 13:32:28 crc kubenswrapper[4769]: I1121 13:32:28.697398 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" event={"ID":"3d2bc79f-c0d7-4625-8187-0885095662d3","Type":"ContainerStarted","Data":"125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540"} Nov 21 13:32:28 crc kubenswrapper[4769]: I1121 13:32:28.697586 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:28 crc kubenswrapper[4769]: I1121 13:32:28.729162 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" podStartSLOduration=3.729136097 podStartE2EDuration="3.729136097s" podCreationTimestamp="2025-11-21 13:32:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:32:28.728345686 +0000 UTC m=+6107.429007504" watchObservedRunningTime="2025-11-21 13:32:28.729136097 +0000 UTC m=+6107.429797925" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.275107 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:32:34 crc kubenswrapper[4769]: E1121 13:32:34.276474 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.705424 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-6p2ml"] Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.711717 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-6p2ml"] Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.885366 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-x766j"] Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.886415 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.892055 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.892146 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.892272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.892313 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:32:34 crc kubenswrapper[4769]: I1121 13:32:34.909015 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-x766j"] Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.004648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-node-mnt\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.004709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68x8p\" (UniqueName: \"kubernetes.io/projected/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-kube-api-access-68x8p\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.004775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-crc-storage\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.106019 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-node-mnt\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.106096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68x8p\" (UniqueName: \"kubernetes.io/projected/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-kube-api-access-68x8p\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.106166 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-crc-storage\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.106442 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-node-mnt\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.106903 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-crc-storage\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.137978 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68x8p\" (UniqueName: \"kubernetes.io/projected/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-kube-api-access-68x8p\") pod \"crc-storage-crc-x766j\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.206871 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.288061 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29fb48a8-beb5-4a04-b405-327876476700" path="/var/lib/kubelet/pods/29fb48a8-beb5-4a04-b405-327876476700/volumes" Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.710889 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-x766j"] Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.784056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-x766j" event={"ID":"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f","Type":"ContainerStarted","Data":"4d3d8789d6c6e9d77265b5e092a7a7d0a10171181ca946aebf6a8a484b6c97cb"} Nov 21 13:32:35 crc kubenswrapper[4769]: I1121 13:32:35.971005 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:32:36 crc kubenswrapper[4769]: I1121 13:32:36.028226 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct"] Nov 21 13:32:36 crc kubenswrapper[4769]: I1121 13:32:36.028578 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" podUID="7409b957-839b-4068-9689-233a2751eb20" containerName="dnsmasq-dns" containerID="cri-o://7b479499b16ab273b2d962978b3f2d96934d66d517952636900f06d0103ed201" gracePeriod=10 Nov 21 13:32:36 crc kubenswrapper[4769]: I1121 13:32:36.798136 4769 generic.go:334] "Generic (PLEG): container finished" podID="7409b957-839b-4068-9689-233a2751eb20" containerID="7b479499b16ab273b2d962978b3f2d96934d66d517952636900f06d0103ed201" exitCode=0 Nov 21 13:32:36 crc kubenswrapper[4769]: I1121 13:32:36.798258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" event={"ID":"7409b957-839b-4068-9689-233a2751eb20","Type":"ContainerDied","Data":"7b479499b16ab273b2d962978b3f2d96934d66d517952636900f06d0103ed201"} Nov 21 13:32:36 crc kubenswrapper[4769]: I1121 13:32:36.978545 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.037569 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvv9g\" (UniqueName: \"kubernetes.io/projected/7409b957-839b-4068-9689-233a2751eb20-kube-api-access-xvv9g\") pod \"7409b957-839b-4068-9689-233a2751eb20\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.037633 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-dnsmasq-svc\") pod \"7409b957-839b-4068-9689-233a2751eb20\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.037683 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-config\") pod \"7409b957-839b-4068-9689-233a2751eb20\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.037721 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-beta-nodeset\") pod \"7409b957-839b-4068-9689-233a2751eb20\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.037765 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-global\") pod \"7409b957-839b-4068-9689-233a2751eb20\" (UID: \"7409b957-839b-4068-9689-233a2751eb20\") " Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.043241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7409b957-839b-4068-9689-233a2751eb20-kube-api-access-xvv9g" (OuterVolumeSpecName: "kube-api-access-xvv9g") pod "7409b957-839b-4068-9689-233a2751eb20" (UID: "7409b957-839b-4068-9689-233a2751eb20"). InnerVolumeSpecName "kube-api-access-xvv9g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.073056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-global" (OuterVolumeSpecName: "edpm-compute-global") pod "7409b957-839b-4068-9689-233a2751eb20" (UID: "7409b957-839b-4068-9689-233a2751eb20"). InnerVolumeSpecName "edpm-compute-global". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.076516 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-config" (OuterVolumeSpecName: "config") pod "7409b957-839b-4068-9689-233a2751eb20" (UID: "7409b957-839b-4068-9689-233a2751eb20"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.076859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "edpm-compute-beta-nodeset") pod "7409b957-839b-4068-9689-233a2751eb20" (UID: "7409b957-839b-4068-9689-233a2751eb20"). InnerVolumeSpecName "edpm-compute-beta-nodeset". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.078484 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "7409b957-839b-4068-9689-233a2751eb20" (UID: "7409b957-839b-4068-9689-233a2751eb20"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.139376 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.139416 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.139430 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.139446 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-global\" (UniqueName: \"kubernetes.io/configmap/7409b957-839b-4068-9689-233a2751eb20-edpm-compute-global\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.139460 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xvv9g\" (UniqueName: \"kubernetes.io/projected/7409b957-839b-4068-9689-233a2751eb20-kube-api-access-xvv9g\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.812410 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" event={"ID":"7409b957-839b-4068-9689-233a2751eb20","Type":"ContainerDied","Data":"1203fea22265ed9ce3ba09b06aea2adccde6f225e4b96b9b9da8da94757e3f9d"} Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.812491 4769 scope.go:117] "RemoveContainer" containerID="7b479499b16ab273b2d962978b3f2d96934d66d517952636900f06d0103ed201" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.812431 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.815933 4769 generic.go:334] "Generic (PLEG): container finished" podID="aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" containerID="3c0fcfaf14220aa5dd7cfe8a56d1be9d65d8246658b428d6564e3b22c91539e9" exitCode=0 Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.816000 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-x766j" event={"ID":"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f","Type":"ContainerDied","Data":"3c0fcfaf14220aa5dd7cfe8a56d1be9d65d8246658b428d6564e3b22c91539e9"} Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.848258 4769 scope.go:117] "RemoveContainer" containerID="b17c7013a8aa0b475d4a7f1a8073dbe60a2d46a198197e92d1b951b1822bb247" Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.882640 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct"] Nov 21 13:32:37 crc kubenswrapper[4769]: I1121 13:32:37.890329 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6668544499-jf7ct"] Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.208096 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.278875 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-node-mnt\") pod \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.278938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68x8p\" (UniqueName: \"kubernetes.io/projected/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-kube-api-access-68x8p\") pod \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.279037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-crc-storage\") pod \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\" (UID: \"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f\") " Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.279058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" (UID: "aa47f8d0-9485-4a9f-a46a-1afd6ad9911f"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.279251 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.287451 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7409b957-839b-4068-9689-233a2751eb20" path="/var/lib/kubelet/pods/7409b957-839b-4068-9689-233a2751eb20/volumes" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.290520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-kube-api-access-68x8p" (OuterVolumeSpecName: "kube-api-access-68x8p") pod "aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" (UID: "aa47f8d0-9485-4a9f-a46a-1afd6ad9911f"). InnerVolumeSpecName "kube-api-access-68x8p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.307320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" (UID: "aa47f8d0-9485-4a9f-a46a-1afd6ad9911f"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.380061 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68x8p\" (UniqueName: \"kubernetes.io/projected/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-kube-api-access-68x8p\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.380118 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.841430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-x766j" event={"ID":"aa47f8d0-9485-4a9f-a46a-1afd6ad9911f","Type":"ContainerDied","Data":"4d3d8789d6c6e9d77265b5e092a7a7d0a10171181ca946aebf6a8a484b6c97cb"} Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.841483 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d3d8789d6c6e9d77265b5e092a7a7d0a10171181ca946aebf6a8a484b6c97cb" Nov 21 13:32:39 crc kubenswrapper[4769]: I1121 13:32:39.841582 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-x766j" Nov 21 13:32:42 crc kubenswrapper[4769]: I1121 13:32:42.991838 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-x766j"] Nov 21 13:32:42 crc kubenswrapper[4769]: I1121 13:32:42.998812 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-x766j"] Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.163694 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-fvjgq"] Nov 21 13:32:43 crc kubenswrapper[4769]: E1121 13:32:43.164082 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7409b957-839b-4068-9689-233a2751eb20" containerName="init" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.164097 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7409b957-839b-4068-9689-233a2751eb20" containerName="init" Nov 21 13:32:43 crc kubenswrapper[4769]: E1121 13:32:43.164112 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" containerName="storage" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.164118 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" containerName="storage" Nov 21 13:32:43 crc kubenswrapper[4769]: E1121 13:32:43.164145 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7409b957-839b-4068-9689-233a2751eb20" containerName="dnsmasq-dns" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.164151 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7409b957-839b-4068-9689-233a2751eb20" containerName="dnsmasq-dns" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.164317 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" containerName="storage" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.164326 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7409b957-839b-4068-9689-233a2751eb20" containerName="dnsmasq-dns" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.164871 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.167637 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.167859 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.167978 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.168080 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.172004 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-fvjgq"] Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.208801 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jplpf\" (UniqueName: \"kubernetes.io/projected/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-kube-api-access-jplpf\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.209117 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-node-mnt\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.209176 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-crc-storage\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.289240 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa47f8d0-9485-4a9f-a46a-1afd6ad9911f" path="/var/lib/kubelet/pods/aa47f8d0-9485-4a9f-a46a-1afd6ad9911f/volumes" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.310899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jplpf\" (UniqueName: \"kubernetes.io/projected/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-kube-api-access-jplpf\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.310950 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-node-mnt\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.311038 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-crc-storage\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.312075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-crc-storage\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.312585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-node-mnt\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.340848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jplpf\" (UniqueName: \"kubernetes.io/projected/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-kube-api-access-jplpf\") pod \"crc-storage-crc-fvjgq\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.494127 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.501643 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:43 crc kubenswrapper[4769]: I1121 13:32:43.956388 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-fvjgq"] Nov 21 13:32:44 crc kubenswrapper[4769]: I1121 13:32:44.908739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fvjgq" event={"ID":"0d1a4309-328c-49a2-ab09-b0a3e49d59e7","Type":"ContainerStarted","Data":"2c001b05069b3ca08088799ade227b417a9771c1df019dcaff17166d62d85a19"} Nov 21 13:32:46 crc kubenswrapper[4769]: I1121 13:32:46.936714 4769 generic.go:334] "Generic (PLEG): container finished" podID="0d1a4309-328c-49a2-ab09-b0a3e49d59e7" containerID="2de4529029d546979d6192ce05932fbd91cd9c9896cc413b82f64717fe6ea133" exitCode=0 Nov 21 13:32:46 crc kubenswrapper[4769]: I1121 13:32:46.936831 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fvjgq" event={"ID":"0d1a4309-328c-49a2-ab09-b0a3e49d59e7","Type":"ContainerDied","Data":"2de4529029d546979d6192ce05932fbd91cd9c9896cc413b82f64717fe6ea133"} Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.275134 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:32:48 crc kubenswrapper[4769]: E1121 13:32:48.277122 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.337283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.502337 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-node-mnt\") pod \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.502535 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "0d1a4309-328c-49a2-ab09-b0a3e49d59e7" (UID: "0d1a4309-328c-49a2-ab09-b0a3e49d59e7"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.502568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jplpf\" (UniqueName: \"kubernetes.io/projected/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-kube-api-access-jplpf\") pod \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.502741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-crc-storage\") pod \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\" (UID: \"0d1a4309-328c-49a2-ab09-b0a3e49d59e7\") " Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.503353 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.507719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-kube-api-access-jplpf" (OuterVolumeSpecName: "kube-api-access-jplpf") pod "0d1a4309-328c-49a2-ab09-b0a3e49d59e7" (UID: "0d1a4309-328c-49a2-ab09-b0a3e49d59e7"). InnerVolumeSpecName "kube-api-access-jplpf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.528580 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "0d1a4309-328c-49a2-ab09-b0a3e49d59e7" (UID: "0d1a4309-328c-49a2-ab09-b0a3e49d59e7"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.604343 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:48 crc kubenswrapper[4769]: I1121 13:32:48.604386 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jplpf\" (UniqueName: \"kubernetes.io/projected/0d1a4309-328c-49a2-ab09-b0a3e49d59e7-kube-api-access-jplpf\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:49 crc kubenswrapper[4769]: I1121 13:32:49.016450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-fvjgq" event={"ID":"0d1a4309-328c-49a2-ab09-b0a3e49d59e7","Type":"ContainerDied","Data":"2c001b05069b3ca08088799ade227b417a9771c1df019dcaff17166d62d85a19"} Nov 21 13:32:49 crc kubenswrapper[4769]: I1121 13:32:49.016761 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c001b05069b3ca08088799ade227b417a9771c1df019dcaff17166d62d85a19" Nov 21 13:32:49 crc kubenswrapper[4769]: I1121 13:32:49.016617 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-fvjgq" Nov 21 13:32:51 crc kubenswrapper[4769]: I1121 13:32:51.995497 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl"] Nov 21 13:32:51 crc kubenswrapper[4769]: E1121 13:32:51.997488 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0d1a4309-328c-49a2-ab09-b0a3e49d59e7" containerName="storage" Nov 21 13:32:51 crc kubenswrapper[4769]: I1121 13:32:51.997615 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d1a4309-328c-49a2-ab09-b0a3e49d59e7" containerName="storage" Nov 21 13:32:51 crc kubenswrapper[4769]: I1121 13:32:51.997878 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0d1a4309-328c-49a2-ab09-b0a3e49d59e7" containerName="storage" Nov 21 13:32:51 crc kubenswrapper[4769]: I1121 13:32:51.998951 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.001634 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-edpm-tls" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.014387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl"] Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.109344 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl"] Nov 21 13:32:52 crc kubenswrapper[4769]: E1121 13:32:52.110206 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc kube-api-access-nzczq openstack-edpm-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" podUID="22ba7b4c-837b-472e-bb3e-c60e33fca314" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.132617 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r"] Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.133975 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.146088 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r"] Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-config\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174390 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4zpm\" (UniqueName: \"kubernetes.io/projected/c7b5dd1e-6cbf-4bd2-8264-947988862234-kube-api-access-l4zpm\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174488 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-config\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174538 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174622 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzczq\" (UniqueName: \"kubernetes.io/projected/22ba7b4c-837b-472e-bb3e-c60e33fca314-kube-api-access-nzczq\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.174705 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.237552 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r"] Nov 21 13:32:52 crc kubenswrapper[4769]: E1121 13:32:52.238008 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc kube-api-access-l4zpm openstack-edpm-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" podUID="c7b5dd1e-6cbf-4bd2-8264-947988862234" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.257582 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6"] Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.259031 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.270728 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6"] Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276147 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-config\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276192 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-config\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276256 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l4zpm\" (UniqueName: \"kubernetes.io/projected/c7b5dd1e-6cbf-4bd2-8264-947988862234-kube-api-access-l4zpm\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276299 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2f6\" (UniqueName: \"kubernetes.io/projected/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-kube-api-access-xd2f6\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-config\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276606 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nzczq\" (UniqueName: \"kubernetes.io/projected/22ba7b4c-837b-472e-bb3e-c60e33fca314-kube-api-access-nzczq\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.276799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.277280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-config\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.277318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-config\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.277818 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.278177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.278192 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.291553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.301080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzczq\" (UniqueName: \"kubernetes.io/projected/22ba7b4c-837b-472e-bb3e-c60e33fca314-kube-api-access-nzczq\") pod \"dnsmasq-dnsmasq-78c7b787f5-c7psl\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.317462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4zpm\" (UniqueName: \"kubernetes.io/projected/c7b5dd1e-6cbf-4bd2-8264-947988862234-kube-api-access-l4zpm\") pod \"dnsmasq-dnsmasq-78956bcdfc-kp76r\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.378409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.378514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.378567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-config\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.378620 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2f6\" (UniqueName: \"kubernetes.io/projected/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-kube-api-access-xd2f6\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.379696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.379865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-config\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.380170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.394949 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2f6\" (UniqueName: \"kubernetes.io/projected/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-kube-api-access-xd2f6\") pod \"dnsmasq-dnsmasq-76b7c4d945-vfbk6\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:52 crc kubenswrapper[4769]: I1121 13:32:52.583946 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.047761 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6"] Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.055167 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.055258 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.068418 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.074112 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.092971 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-config\") pod \"22ba7b4c-837b-472e-bb3e-c60e33fca314\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-openstack-edpm-tls\") pod \"c7b5dd1e-6cbf-4bd2-8264-947988862234\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093121 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzczq\" (UniqueName: \"kubernetes.io/projected/22ba7b4c-837b-472e-bb3e-c60e33fca314-kube-api-access-nzczq\") pod \"22ba7b4c-837b-472e-bb3e-c60e33fca314\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093145 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-openstack-edpm-tls\") pod \"22ba7b4c-837b-472e-bb3e-c60e33fca314\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-config\") pod \"c7b5dd1e-6cbf-4bd2-8264-947988862234\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093255 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-dnsmasq-svc\") pod \"c7b5dd1e-6cbf-4bd2-8264-947988862234\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093318 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-dnsmasq-svc\") pod \"22ba7b4c-837b-472e-bb3e-c60e33fca314\" (UID: \"22ba7b4c-837b-472e-bb3e-c60e33fca314\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093367 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4zpm\" (UniqueName: \"kubernetes.io/projected/c7b5dd1e-6cbf-4bd2-8264-947988862234-kube-api-access-l4zpm\") pod \"c7b5dd1e-6cbf-4bd2-8264-947988862234\" (UID: \"c7b5dd1e-6cbf-4bd2-8264-947988862234\") " Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093584 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-config" (OuterVolumeSpecName: "config") pod "22ba7b4c-837b-472e-bb3e-c60e33fca314" (UID: "22ba7b4c-837b-472e-bb3e-c60e33fca314"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.093753 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.094068 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "c7b5dd1e-6cbf-4bd2-8264-947988862234" (UID: "c7b5dd1e-6cbf-4bd2-8264-947988862234"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.094101 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "22ba7b4c-837b-472e-bb3e-c60e33fca314" (UID: "22ba7b4c-837b-472e-bb3e-c60e33fca314"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.094303 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-config" (OuterVolumeSpecName: "config") pod "c7b5dd1e-6cbf-4bd2-8264-947988862234" (UID: "c7b5dd1e-6cbf-4bd2-8264-947988862234"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.094353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "22ba7b4c-837b-472e-bb3e-c60e33fca314" (UID: "22ba7b4c-837b-472e-bb3e-c60e33fca314"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.094552 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "c7b5dd1e-6cbf-4bd2-8264-947988862234" (UID: "c7b5dd1e-6cbf-4bd2-8264-947988862234"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.097658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b5dd1e-6cbf-4bd2-8264-947988862234-kube-api-access-l4zpm" (OuterVolumeSpecName: "kube-api-access-l4zpm") pod "c7b5dd1e-6cbf-4bd2-8264-947988862234" (UID: "c7b5dd1e-6cbf-4bd2-8264-947988862234"). InnerVolumeSpecName "kube-api-access-l4zpm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.098575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ba7b4c-837b-472e-bb3e-c60e33fca314-kube-api-access-nzczq" (OuterVolumeSpecName: "kube-api-access-nzczq") pod "22ba7b4c-837b-472e-bb3e-c60e33fca314" (UID: "22ba7b4c-837b-472e-bb3e-c60e33fca314"). InnerVolumeSpecName "kube-api-access-nzczq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195723 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195763 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195779 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-l4zpm\" (UniqueName: \"kubernetes.io/projected/c7b5dd1e-6cbf-4bd2-8264-947988862234-kube-api-access-l4zpm\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195792 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195807 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nzczq\" (UniqueName: \"kubernetes.io/projected/22ba7b4c-837b-472e-bb3e-c60e33fca314-kube-api-access-nzczq\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195819 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/22ba7b4c-837b-472e-bb3e-c60e33fca314-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:53 crc kubenswrapper[4769]: I1121 13:32:53.195829 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7b5dd1e-6cbf-4bd2-8264-947988862234-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.065075 4769 generic.go:334] "Generic (PLEG): container finished" podID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerID="f33b1b91390747a0ec43878958790acc6658a79baab6d105b0977c06af083b06" exitCode=0 Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.065136 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" event={"ID":"25ed8043-9d6b-4cde-862d-a9edd7f34ae9","Type":"ContainerDied","Data":"f33b1b91390747a0ec43878958790acc6658a79baab6d105b0977c06af083b06"} Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.065181 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl" Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.065215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" event={"ID":"25ed8043-9d6b-4cde-862d-a9edd7f34ae9","Type":"ContainerStarted","Data":"a1c095693a042ce50728265ca6f0acda5ddb4c668f18266ba2cc1e3e328acd10"} Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.065232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r" Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.139523 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r"] Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.147671 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78956bcdfc-kp76r"] Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.203076 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl"] Nov 21 13:32:54 crc kubenswrapper[4769]: I1121 13:32:54.220129 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-c7psl"] Nov 21 13:32:55 crc kubenswrapper[4769]: I1121 13:32:55.081686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" event={"ID":"25ed8043-9d6b-4cde-862d-a9edd7f34ae9","Type":"ContainerStarted","Data":"d8f004f70798aa95aa8317639472ed599e97677d4f58e17fddae7e43a3255a1b"} Nov 21 13:32:55 crc kubenswrapper[4769]: I1121 13:32:55.081934 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:32:55 crc kubenswrapper[4769]: I1121 13:32:55.122467 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" podStartSLOduration=3.122436423 podStartE2EDuration="3.122436423s" podCreationTimestamp="2025-11-21 13:32:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:32:55.111759654 +0000 UTC m=+6133.812421502" watchObservedRunningTime="2025-11-21 13:32:55.122436423 +0000 UTC m=+6133.823098281" Nov 21 13:32:55 crc kubenswrapper[4769]: I1121 13:32:55.294515 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ba7b4c-837b-472e-bb3e-c60e33fca314" path="/var/lib/kubelet/pods/22ba7b4c-837b-472e-bb3e-c60e33fca314/volumes" Nov 21 13:32:55 crc kubenswrapper[4769]: I1121 13:32:55.295582 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b5dd1e-6cbf-4bd2-8264-947988862234" path="/var/lib/kubelet/pods/c7b5dd1e-6cbf-4bd2-8264-947988862234/volumes" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.128403 4769 scope.go:117] "RemoveContainer" containerID="7252c32c33ccf9d780e1002a6de97e266979582821c1eac37d469db1f16252ad" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.184541 4769 scope.go:117] "RemoveContainer" containerID="31034454d54b70210b9ccb8f54f225b4b1478991df6416d684e66ecf7584c5e4" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.213487 4769 scope.go:117] "RemoveContainer" containerID="4c766b60a2104885e7d5d1baed345a70fe7750f2658927a7539752ddf8457bfc" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.239552 4769 scope.go:117] "RemoveContainer" containerID="4ce5b8eac8d6f245179bff460d5545dca76594d996bbf2de33253d57d860fec0" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.265707 4769 scope.go:117] "RemoveContainer" containerID="060e837d9f9e93205f3db10b0c7600a479b7ff79dd34a70673a559c089e2deb4" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.288026 4769 scope.go:117] "RemoveContainer" containerID="3d0ed390e7da493eaafaab771faa355bc3be26ea216b97ebbc6fb0c0f7cc2501" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.312769 4769 scope.go:117] "RemoveContainer" containerID="96f270b1b77c8f30e2785f79744a67c37aac48442377c3f5df0dc14b6495ef4b" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.333377 4769 scope.go:117] "RemoveContainer" containerID="7c8f41d0967c011e600c9453e4a9ab5232eb669f5feab3e40413582abdb49f5c" Nov 21 13:33:01 crc kubenswrapper[4769]: I1121 13:33:01.359563 4769 scope.go:117] "RemoveContainer" containerID="173c2b7433d356ac6bc21f83ccae1a25057466f74270b187cadbc8f6852c1701" Nov 21 13:33:02 crc kubenswrapper[4769]: I1121 13:33:02.274502 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:33:02 crc kubenswrapper[4769]: E1121 13:33:02.274941 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:33:02 crc kubenswrapper[4769]: I1121 13:33:02.585581 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:33:02 crc kubenswrapper[4769]: I1121 13:33:02.658287 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z"] Nov 21 13:33:02 crc kubenswrapper[4769]: I1121 13:33:02.658609 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerName="dnsmasq-dns" containerID="cri-o://125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540" gracePeriod=10 Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.116608 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.188397 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerID="125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540" exitCode=0 Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.188498 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.188562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" event={"ID":"3d2bc79f-c0d7-4625-8187-0885095662d3","Type":"ContainerDied","Data":"125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540"} Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.188669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z" event={"ID":"3d2bc79f-c0d7-4625-8187-0885095662d3","Type":"ContainerDied","Data":"e47cc9f344db38a3d7436758fee88c8c6730dc2b56ab4fd20edcddcb9531d7ff"} Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.188719 4769 scope.go:117] "RemoveContainer" containerID="125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.222855 4769 scope.go:117] "RemoveContainer" containerID="7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.253639 4769 scope.go:117] "RemoveContainer" containerID="125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540" Nov 21 13:33:03 crc kubenswrapper[4769]: E1121 13:33:03.254746 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540\": container with ID starting with 125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540 not found: ID does not exist" containerID="125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.254817 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540"} err="failed to get container status \"125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540\": rpc error: code = NotFound desc = could not find container \"125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540\": container with ID starting with 125a97981a96b9f99c7eb5dbc34f17369e567c6c80b9b85294900261826e8540 not found: ID does not exist" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.254859 4769 scope.go:117] "RemoveContainer" containerID="7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3" Nov 21 13:33:03 crc kubenswrapper[4769]: E1121 13:33:03.255693 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3\": container with ID starting with 7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3 not found: ID does not exist" containerID="7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.255732 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3"} err="failed to get container status \"7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3\": rpc error: code = NotFound desc = could not find container \"7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3\": container with ID starting with 7a66c1a2091e1a330465d679ba7fd9e7c7ef058ee3539a81bfc7c5605ccf61b3 not found: ID does not exist" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.269297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqnf4\" (UniqueName: \"kubernetes.io/projected/3d2bc79f-c0d7-4625-8187-0885095662d3-kube-api-access-jqnf4\") pod \"3d2bc79f-c0d7-4625-8187-0885095662d3\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.269420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-dnsmasq-svc\") pod \"3d2bc79f-c0d7-4625-8187-0885095662d3\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.269473 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-config\") pod \"3d2bc79f-c0d7-4625-8187-0885095662d3\" (UID: \"3d2bc79f-c0d7-4625-8187-0885095662d3\") " Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.278807 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d2bc79f-c0d7-4625-8187-0885095662d3-kube-api-access-jqnf4" (OuterVolumeSpecName: "kube-api-access-jqnf4") pod "3d2bc79f-c0d7-4625-8187-0885095662d3" (UID: "3d2bc79f-c0d7-4625-8187-0885095662d3"). InnerVolumeSpecName "kube-api-access-jqnf4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.314546 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "3d2bc79f-c0d7-4625-8187-0885095662d3" (UID: "3d2bc79f-c0d7-4625-8187-0885095662d3"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.322487 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-config" (OuterVolumeSpecName: "config") pod "3d2bc79f-c0d7-4625-8187-0885095662d3" (UID: "3d2bc79f-c0d7-4625-8187-0885095662d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.370872 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jqnf4\" (UniqueName: \"kubernetes.io/projected/3d2bc79f-c0d7-4625-8187-0885095662d3-kube-api-access-jqnf4\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.370910 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.370925 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d2bc79f-c0d7-4625-8187-0885095662d3-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.530118 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z"] Nov 21 13:33:03 crc kubenswrapper[4769]: I1121 13:33:03.538995 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-kv98z"] Nov 21 13:33:05 crc kubenswrapper[4769]: I1121 13:33:05.293546 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" path="/var/lib/kubelet/pods/3d2bc79f-c0d7-4625-8187-0885095662d3/volumes" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.925768 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9"] Nov 21 13:33:11 crc kubenswrapper[4769]: E1121 13:33:11.926901 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerName="init" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.926927 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerName="init" Nov 21 13:33:11 crc kubenswrapper[4769]: E1121 13:33:11.926972 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerName="dnsmasq-dns" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.926985 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerName="dnsmasq-dns" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.927297 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d2bc79f-c0d7-4625-8187-0885095662d3" containerName="dnsmasq-dns" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.928151 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.932173 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.932389 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-6wj4m" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.932643 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-generic-service1-default-certs-1" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.932690 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-generic-service1-default-certs-2" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.932820 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.932970 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-generic-service1-default-certs-0" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.933298 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.933868 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:33:11 crc kubenswrapper[4769]: I1121 13:33:11.970671 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9"] Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.009533 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-generic-service1-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.009603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.009651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-ssh-key\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.009685 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-inventory\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.009855 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfk94\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-kube-api-access-kfk94\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.010038 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-install-certs-ovr-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.111418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kfk94\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-kube-api-access-kfk94\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.111490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-install-certs-ovr-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.111543 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-generic-service1-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.111568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.111598 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-ssh-key\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.111621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-inventory\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.118378 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-inventory\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.118414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-generic-service1-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.118891 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-ssh-key\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.120105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.120555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-install-certs-ovr-combined-ca-bundle\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.129157 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfk94\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-kube-api-access-kfk94\") pod \"install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.259355 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:12 crc kubenswrapper[4769]: I1121 13:33:12.713306 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9"] Nov 21 13:33:12 crc kubenswrapper[4769]: W1121 13:33:12.727130 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5e1c32e_90e1_4508_915c_0d42c7b75f7d.slice/crio-2c60c4aa39f4ed41cd9af7b50ae2810ab5fc66c07d1ccb4632761b1a724dc2a2 WatchSource:0}: Error finding container 2c60c4aa39f4ed41cd9af7b50ae2810ab5fc66c07d1ccb4632761b1a724dc2a2: Status 404 returned error can't find the container with id 2c60c4aa39f4ed41cd9af7b50ae2810ab5fc66c07d1ccb4632761b1a724dc2a2 Nov 21 13:33:13 crc kubenswrapper[4769]: I1121 13:33:13.291798 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" event={"ID":"f5e1c32e-90e1-4508-915c-0d42c7b75f7d","Type":"ContainerStarted","Data":"2c60c4aa39f4ed41cd9af7b50ae2810ab5fc66c07d1ccb4632761b1a724dc2a2"} Nov 21 13:33:14 crc kubenswrapper[4769]: I1121 13:33:14.300017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" event={"ID":"f5e1c32e-90e1-4508-915c-0d42c7b75f7d","Type":"ContainerStarted","Data":"ab8efec406d76fe782906768e1d752bd8bea514465f03d9349a7cc5a404d5d2d"} Nov 21 13:33:14 crc kubenswrapper[4769]: I1121 13:33:14.319885 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" podStartSLOduration=2.719314529 podStartE2EDuration="3.319856804s" podCreationTimestamp="2025-11-21 13:33:11 +0000 UTC" firstStartedPulling="2025-11-21 13:33:12.729637068 +0000 UTC m=+6151.430298896" lastFinishedPulling="2025-11-21 13:33:13.330179333 +0000 UTC m=+6152.030841171" observedRunningTime="2025-11-21 13:33:14.31703959 +0000 UTC m=+6153.017701428" watchObservedRunningTime="2025-11-21 13:33:14.319856804 +0000 UTC m=+6153.020518632" Nov 21 13:33:16 crc kubenswrapper[4769]: I1121 13:33:16.320137 4769 generic.go:334] "Generic (PLEG): container finished" podID="f5e1c32e-90e1-4508-915c-0d42c7b75f7d" containerID="ab8efec406d76fe782906768e1d752bd8bea514465f03d9349a7cc5a404d5d2d" exitCode=0 Nov 21 13:33:16 crc kubenswrapper[4769]: I1121 13:33:16.320234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" event={"ID":"f5e1c32e-90e1-4508-915c-0d42c7b75f7d","Type":"ContainerDied","Data":"ab8efec406d76fe782906768e1d752bd8bea514465f03d9349a7cc5a404d5d2d"} Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.274959 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.685871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.736039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-openstack-edpm-tls-generic-service1-default-certs-0\") pod \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.736096 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-install-certs-ovr-combined-ca-bundle\") pod \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.736118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-ssh-key\") pod \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.736162 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-generic-service1-combined-ca-bundle\") pod \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.736181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfk94\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-kube-api-access-kfk94\") pod \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.736230 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-inventory\") pod \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\" (UID: \"f5e1c32e-90e1-4508-915c-0d42c7b75f7d\") " Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.741915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-install-certs-ovr-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovr-combined-ca-bundle") pod "f5e1c32e-90e1-4508-915c-0d42c7b75f7d" (UID: "f5e1c32e-90e1-4508-915c-0d42c7b75f7d"). InnerVolumeSpecName "install-certs-ovr-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.742280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-generic-service1-combined-ca-bundle" (OuterVolumeSpecName: "generic-service1-combined-ca-bundle") pod "f5e1c32e-90e1-4508-915c-0d42c7b75f7d" (UID: "f5e1c32e-90e1-4508-915c-0d42c7b75f7d"). InnerVolumeSpecName "generic-service1-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.755264 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-kube-api-access-kfk94" (OuterVolumeSpecName: "kube-api-access-kfk94") pod "f5e1c32e-90e1-4508-915c-0d42c7b75f7d" (UID: "f5e1c32e-90e1-4508-915c-0d42c7b75f7d"). InnerVolumeSpecName "kube-api-access-kfk94". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.759477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-openstack-edpm-tls-generic-service1-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-generic-service1-default-certs-0") pod "f5e1c32e-90e1-4508-915c-0d42c7b75f7d" (UID: "f5e1c32e-90e1-4508-915c-0d42c7b75f7d"). InnerVolumeSpecName "openstack-edpm-tls-generic-service1-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.768630 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "f5e1c32e-90e1-4508-915c-0d42c7b75f7d" (UID: "f5e1c32e-90e1-4508-915c-0d42c7b75f7d"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.771136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-inventory" (OuterVolumeSpecName: "inventory") pod "f5e1c32e-90e1-4508-915c-0d42c7b75f7d" (UID: "f5e1c32e-90e1-4508-915c-0d42c7b75f7d"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.837516 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-generic-service1-default-certs-0\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-openstack-edpm-tls-generic-service1-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.837737 4769 reconciler_common.go:293] "Volume detached for volume \"install-certs-ovr-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-install-certs-ovr-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.837827 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.837936 4769 reconciler_common.go:293] "Volume detached for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-generic-service1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.838018 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kfk94\" (UniqueName: \"kubernetes.io/projected/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-kube-api-access-kfk94\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:17 crc kubenswrapper[4769]: I1121 13:33:17.838104 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f5e1c32e-90e1-4508-915c-0d42c7b75f7d-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.348177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"3203ba8b908976be79eb54d6b4e43f9921c02402288782dcf7a45861fd5e1ffc"} Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.351427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" event={"ID":"f5e1c32e-90e1-4508-915c-0d42c7b75f7d","Type":"ContainerDied","Data":"2c60c4aa39f4ed41cd9af7b50ae2810ab5fc66c07d1ccb4632761b1a724dc2a2"} Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.351470 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c60c4aa39f4ed41cd9af7b50ae2810ab5fc66c07d1ccb4632761b1a724dc2a2" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.351525 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.442280 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8"] Nov 21 13:33:18 crc kubenswrapper[4769]: E1121 13:33:18.442691 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f5e1c32e-90e1-4508-915c-0d42c7b75f7d" containerName="install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.442716 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e1c32e-90e1-4508-915c-0d42c7b75f7d" containerName="install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.442902 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f5e1c32e-90e1-4508-915c-0d42c7b75f7d" containerName="install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.443611 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.449522 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-6wj4m" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.449798 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.449929 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.450015 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.450034 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.453183 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8"] Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.548021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-inventory\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.548074 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzbzx\" (UniqueName: \"kubernetes.io/projected/4eb05546-ab19-48d8-8b7d-ee69833b919f-kube-api-access-fzbzx\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.548097 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-generic-service1-combined-ca-bundle\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.548150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-ssh-key\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.650152 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-inventory\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.650236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fzbzx\" (UniqueName: \"kubernetes.io/projected/4eb05546-ab19-48d8-8b7d-ee69833b919f-kube-api-access-fzbzx\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.650268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-generic-service1-combined-ca-bundle\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.650329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-ssh-key\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.655805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-ssh-key\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.655959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-generic-service1-combined-ca-bundle\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.668845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-inventory\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.673379 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzbzx\" (UniqueName: \"kubernetes.io/projected/4eb05546-ab19-48d8-8b7d-ee69833b919f-kube-api-access-fzbzx\") pod \"generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:18 crc kubenswrapper[4769]: I1121 13:33:18.768910 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:19 crc kubenswrapper[4769]: I1121 13:33:19.317582 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8"] Nov 21 13:33:19 crc kubenswrapper[4769]: W1121 13:33:19.326741 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eb05546_ab19_48d8_8b7d_ee69833b919f.slice/crio-24d000ac2bc3dbccdc68fe2eb8a2cea5cc615cae7cf0a71da7288bbbb96b2358 WatchSource:0}: Error finding container 24d000ac2bc3dbccdc68fe2eb8a2cea5cc615cae7cf0a71da7288bbbb96b2358: Status 404 returned error can't find the container with id 24d000ac2bc3dbccdc68fe2eb8a2cea5cc615cae7cf0a71da7288bbbb96b2358 Nov 21 13:33:19 crc kubenswrapper[4769]: I1121 13:33:19.385022 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" event={"ID":"4eb05546-ab19-48d8-8b7d-ee69833b919f","Type":"ContainerStarted","Data":"24d000ac2bc3dbccdc68fe2eb8a2cea5cc615cae7cf0a71da7288bbbb96b2358"} Nov 21 13:33:20 crc kubenswrapper[4769]: I1121 13:33:20.399814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" event={"ID":"4eb05546-ab19-48d8-8b7d-ee69833b919f","Type":"ContainerStarted","Data":"38ff58efcf125f224c90d8f44871674c2dc5e5ca142131e640f8902975babbf2"} Nov 21 13:33:23 crc kubenswrapper[4769]: I1121 13:33:23.439113 4769 generic.go:334] "Generic (PLEG): container finished" podID="4eb05546-ab19-48d8-8b7d-ee69833b919f" containerID="38ff58efcf125f224c90d8f44871674c2dc5e5ca142131e640f8902975babbf2" exitCode=0 Nov 21 13:33:23 crc kubenswrapper[4769]: I1121 13:33:23.439172 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" event={"ID":"4eb05546-ab19-48d8-8b7d-ee69833b919f","Type":"ContainerDied","Data":"38ff58efcf125f224c90d8f44871674c2dc5e5ca142131e640f8902975babbf2"} Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.862047 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.955866 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-generic-service1-combined-ca-bundle\") pod \"4eb05546-ab19-48d8-8b7d-ee69833b919f\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.955965 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-inventory\") pod \"4eb05546-ab19-48d8-8b7d-ee69833b919f\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.956905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-ssh-key\") pod \"4eb05546-ab19-48d8-8b7d-ee69833b919f\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.957045 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzbzx\" (UniqueName: \"kubernetes.io/projected/4eb05546-ab19-48d8-8b7d-ee69833b919f-kube-api-access-fzbzx\") pod \"4eb05546-ab19-48d8-8b7d-ee69833b919f\" (UID: \"4eb05546-ab19-48d8-8b7d-ee69833b919f\") " Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.962109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-generic-service1-combined-ca-bundle" (OuterVolumeSpecName: "generic-service1-combined-ca-bundle") pod "4eb05546-ab19-48d8-8b7d-ee69833b919f" (UID: "4eb05546-ab19-48d8-8b7d-ee69833b919f"). InnerVolumeSpecName "generic-service1-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.965994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb05546-ab19-48d8-8b7d-ee69833b919f-kube-api-access-fzbzx" (OuterVolumeSpecName: "kube-api-access-fzbzx") pod "4eb05546-ab19-48d8-8b7d-ee69833b919f" (UID: "4eb05546-ab19-48d8-8b7d-ee69833b919f"). InnerVolumeSpecName "kube-api-access-fzbzx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.992684 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-inventory" (OuterVolumeSpecName: "inventory") pod "4eb05546-ab19-48d8-8b7d-ee69833b919f" (UID: "4eb05546-ab19-48d8-8b7d-ee69833b919f"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:24 crc kubenswrapper[4769]: I1121 13:33:24.995173 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "4eb05546-ab19-48d8-8b7d-ee69833b919f" (UID: "4eb05546-ab19-48d8-8b7d-ee69833b919f"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.059093 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fzbzx\" (UniqueName: \"kubernetes.io/projected/4eb05546-ab19-48d8-8b7d-ee69833b919f-kube-api-access-fzbzx\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.059159 4769 reconciler_common.go:293] "Volume detached for volume \"generic-service1-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-generic-service1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.059183 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.059238 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4eb05546-ab19-48d8-8b7d-ee69833b919f-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.488049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" event={"ID":"4eb05546-ab19-48d8-8b7d-ee69833b919f","Type":"ContainerDied","Data":"24d000ac2bc3dbccdc68fe2eb8a2cea5cc615cae7cf0a71da7288bbbb96b2358"} Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.488225 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24d000ac2bc3dbccdc68fe2eb8a2cea5cc615cae7cf0a71da7288bbbb96b2358" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.488305 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.822595 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8"] Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.838297 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9"] Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.844155 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/generic-service1-openstack-edpm-tls-openstack-edpm-tls-jqpc8"] Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.850533 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovr-openstack-edpm-tls-openstack-edpm-tls-nwxz9"] Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.901641 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz"] Nov 21 13:33:25 crc kubenswrapper[4769]: E1121 13:33:25.902027 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4eb05546-ab19-48d8-8b7d-ee69833b919f" containerName="generic-service1-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.902050 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb05546-ab19-48d8-8b7d-ee69833b919f" containerName="generic-service1-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.902308 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4eb05546-ab19-48d8-8b7d-ee69833b919f" containerName="generic-service1-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.903359 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.913539 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz"] Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.971703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.971765 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtfb\" (UniqueName: \"kubernetes.io/projected/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-kube-api-access-vmtfb\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:25 crc kubenswrapper[4769]: I1121 13:33:25.972046 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.073752 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.073991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.074126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtfb\" (UniqueName: \"kubernetes.io/projected/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-kube-api-access-vmtfb\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.075124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.075304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.094172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtfb\" (UniqueName: \"kubernetes.io/projected/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-kube-api-access-vmtfb\") pod \"dnsmasq-dnsmasq-84b9f45d47-pg8rz\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.217726 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:26 crc kubenswrapper[4769]: I1121 13:33:26.690870 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz"] Nov 21 13:33:26 crc kubenswrapper[4769]: W1121 13:33:26.702451 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f76a3d8_3e68_4ff5_bc0f_8c398d8a6bac.slice/crio-38149d3049339f116e46f23f4d1480d97f9296262eae48b29b522db3d47263d5 WatchSource:0}: Error finding container 38149d3049339f116e46f23f4d1480d97f9296262eae48b29b522db3d47263d5: Status 404 returned error can't find the container with id 38149d3049339f116e46f23f4d1480d97f9296262eae48b29b522db3d47263d5 Nov 21 13:33:27 crc kubenswrapper[4769]: I1121 13:33:27.294033 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb05546-ab19-48d8-8b7d-ee69833b919f" path="/var/lib/kubelet/pods/4eb05546-ab19-48d8-8b7d-ee69833b919f/volumes" Nov 21 13:33:27 crc kubenswrapper[4769]: I1121 13:33:27.295902 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e1c32e-90e1-4508-915c-0d42c7b75f7d" path="/var/lib/kubelet/pods/f5e1c32e-90e1-4508-915c-0d42c7b75f7d/volumes" Nov 21 13:33:27 crc kubenswrapper[4769]: I1121 13:33:27.515289 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerID="1e5ec3e6389c593c17dafa9202d374fb241950ee02d48707b174fd9129fdbd0d" exitCode=0 Nov 21 13:33:27 crc kubenswrapper[4769]: I1121 13:33:27.515452 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" event={"ID":"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac","Type":"ContainerDied","Data":"1e5ec3e6389c593c17dafa9202d374fb241950ee02d48707b174fd9129fdbd0d"} Nov 21 13:33:27 crc kubenswrapper[4769]: I1121 13:33:27.515505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" event={"ID":"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac","Type":"ContainerStarted","Data":"38149d3049339f116e46f23f4d1480d97f9296262eae48b29b522db3d47263d5"} Nov 21 13:33:28 crc kubenswrapper[4769]: I1121 13:33:28.539874 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" event={"ID":"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac","Type":"ContainerStarted","Data":"bd64955156fa5e1479ce6db5f569be8c204153ae6f8e779bb7ede5f4ecdcb39e"} Nov 21 13:33:28 crc kubenswrapper[4769]: I1121 13:33:28.540534 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:28 crc kubenswrapper[4769]: I1121 13:33:28.575445 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" podStartSLOduration=3.5754075690000002 podStartE2EDuration="3.575407569s" podCreationTimestamp="2025-11-21 13:33:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:33:28.566944657 +0000 UTC m=+6167.267606505" watchObservedRunningTime="2025-11-21 13:33:28.575407569 +0000 UTC m=+6167.276069427" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.383972 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-fvjgq"] Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.390798 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-fvjgq"] Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.524810 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-hjrtf"] Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.525860 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.528463 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.528496 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.528652 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.529073 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.533788 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hjrtf"] Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.719058 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9aef9450-c9a0-481a-98ff-248d8286e19e-crc-storage\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.719161 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmt7\" (UniqueName: \"kubernetes.io/projected/9aef9450-c9a0-481a-98ff-248d8286e19e-kube-api-access-mmmt7\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.719258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9aef9450-c9a0-481a-98ff-248d8286e19e-node-mnt\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.820094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9aef9450-c9a0-481a-98ff-248d8286e19e-crc-storage\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.820215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmt7\" (UniqueName: \"kubernetes.io/projected/9aef9450-c9a0-481a-98ff-248d8286e19e-kube-api-access-mmmt7\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.820264 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9aef9450-c9a0-481a-98ff-248d8286e19e-node-mnt\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.820562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9aef9450-c9a0-481a-98ff-248d8286e19e-node-mnt\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.821525 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9aef9450-c9a0-481a-98ff-248d8286e19e-crc-storage\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.841080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmt7\" (UniqueName: \"kubernetes.io/projected/9aef9450-c9a0-481a-98ff-248d8286e19e-kube-api-access-mmmt7\") pod \"crc-storage-crc-hjrtf\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:34 crc kubenswrapper[4769]: I1121 13:33:34.847855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:35 crc kubenswrapper[4769]: I1121 13:33:35.285381 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d1a4309-328c-49a2-ab09-b0a3e49d59e7" path="/var/lib/kubelet/pods/0d1a4309-328c-49a2-ab09-b0a3e49d59e7/volumes" Nov 21 13:33:35 crc kubenswrapper[4769]: I1121 13:33:35.334208 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hjrtf"] Nov 21 13:33:35 crc kubenswrapper[4769]: W1121 13:33:35.349467 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aef9450_c9a0_481a_98ff_248d8286e19e.slice/crio-5178c2d64ded6b17a6d08672ce1bb13539b07f6a9ae4b072147773f028f1120b WatchSource:0}: Error finding container 5178c2d64ded6b17a6d08672ce1bb13539b07f6a9ae4b072147773f028f1120b: Status 404 returned error can't find the container with id 5178c2d64ded6b17a6d08672ce1bb13539b07f6a9ae4b072147773f028f1120b Nov 21 13:33:35 crc kubenswrapper[4769]: I1121 13:33:35.622127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hjrtf" event={"ID":"9aef9450-c9a0-481a-98ff-248d8286e19e","Type":"ContainerStarted","Data":"5178c2d64ded6b17a6d08672ce1bb13539b07f6a9ae4b072147773f028f1120b"} Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.220532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.296943 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6"] Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.297475 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerName="dnsmasq-dns" containerID="cri-o://d8f004f70798aa95aa8317639472ed599e97677d4f58e17fddae7e43a3255a1b" gracePeriod=10 Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.641514 4769 generic.go:334] "Generic (PLEG): container finished" podID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerID="d8f004f70798aa95aa8317639472ed599e97677d4f58e17fddae7e43a3255a1b" exitCode=0 Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.641740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" event={"ID":"25ed8043-9d6b-4cde-862d-a9edd7f34ae9","Type":"ContainerDied","Data":"d8f004f70798aa95aa8317639472ed599e97677d4f58e17fddae7e43a3255a1b"} Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.648845 4769 generic.go:334] "Generic (PLEG): container finished" podID="9aef9450-c9a0-481a-98ff-248d8286e19e" containerID="11afbd33797d6fcc773ef14555122390708e5cd6d71c07a97b6f1be70fdf712e" exitCode=0 Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.648889 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hjrtf" event={"ID":"9aef9450-c9a0-481a-98ff-248d8286e19e","Type":"ContainerDied","Data":"11afbd33797d6fcc773ef14555122390708e5cd6d71c07a97b6f1be70fdf712e"} Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.766092 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.958554 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-openstack-edpm-tls\") pod \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.959001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd2f6\" (UniqueName: \"kubernetes.io/projected/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-kube-api-access-xd2f6\") pod \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.959052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-config\") pod \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.959083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-dnsmasq-svc\") pod \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\" (UID: \"25ed8043-9d6b-4cde-862d-a9edd7f34ae9\") " Nov 21 13:33:36 crc kubenswrapper[4769]: I1121 13:33:36.967735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-kube-api-access-xd2f6" (OuterVolumeSpecName: "kube-api-access-xd2f6") pod "25ed8043-9d6b-4cde-862d-a9edd7f34ae9" (UID: "25ed8043-9d6b-4cde-862d-a9edd7f34ae9"). InnerVolumeSpecName "kube-api-access-xd2f6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.016893 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "25ed8043-9d6b-4cde-862d-a9edd7f34ae9" (UID: "25ed8043-9d6b-4cde-862d-a9edd7f34ae9"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.018169 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-config" (OuterVolumeSpecName: "config") pod "25ed8043-9d6b-4cde-862d-a9edd7f34ae9" (UID: "25ed8043-9d6b-4cde-862d-a9edd7f34ae9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.023525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "25ed8043-9d6b-4cde-862d-a9edd7f34ae9" (UID: "25ed8043-9d6b-4cde-862d-a9edd7f34ae9"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.060297 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xd2f6\" (UniqueName: \"kubernetes.io/projected/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-kube-api-access-xd2f6\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.060335 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.060348 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.060362 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/25ed8043-9d6b-4cde-862d-a9edd7f34ae9-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.665180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" event={"ID":"25ed8043-9d6b-4cde-862d-a9edd7f34ae9","Type":"ContainerDied","Data":"a1c095693a042ce50728265ca6f0acda5ddb4c668f18266ba2cc1e3e328acd10"} Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.665239 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.665303 4769 scope.go:117] "RemoveContainer" containerID="d8f004f70798aa95aa8317639472ed599e97677d4f58e17fddae7e43a3255a1b" Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.718448 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6"] Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.733368 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76b7c4d945-vfbk6"] Nov 21 13:33:37 crc kubenswrapper[4769]: I1121 13:33:37.741723 4769 scope.go:117] "RemoveContainer" containerID="f33b1b91390747a0ec43878958790acc6658a79baab6d105b0977c06af083b06" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.065742 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.176905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9aef9450-c9a0-481a-98ff-248d8286e19e-node-mnt\") pod \"9aef9450-c9a0-481a-98ff-248d8286e19e\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.177004 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9aef9450-c9a0-481a-98ff-248d8286e19e-crc-storage\") pod \"9aef9450-c9a0-481a-98ff-248d8286e19e\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.177064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmmt7\" (UniqueName: \"kubernetes.io/projected/9aef9450-c9a0-481a-98ff-248d8286e19e-kube-api-access-mmmt7\") pod \"9aef9450-c9a0-481a-98ff-248d8286e19e\" (UID: \"9aef9450-c9a0-481a-98ff-248d8286e19e\") " Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.177058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9aef9450-c9a0-481a-98ff-248d8286e19e-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "9aef9450-c9a0-481a-98ff-248d8286e19e" (UID: "9aef9450-c9a0-481a-98ff-248d8286e19e"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.177368 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/9aef9450-c9a0-481a-98ff-248d8286e19e-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.189500 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aef9450-c9a0-481a-98ff-248d8286e19e-kube-api-access-mmmt7" (OuterVolumeSpecName: "kube-api-access-mmmt7") pod "9aef9450-c9a0-481a-98ff-248d8286e19e" (UID: "9aef9450-c9a0-481a-98ff-248d8286e19e"). InnerVolumeSpecName "kube-api-access-mmmt7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.209400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aef9450-c9a0-481a-98ff-248d8286e19e-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "9aef9450-c9a0-481a-98ff-248d8286e19e" (UID: "9aef9450-c9a0-481a-98ff-248d8286e19e"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.278989 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/9aef9450-c9a0-481a-98ff-248d8286e19e-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.279038 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mmmt7\" (UniqueName: \"kubernetes.io/projected/9aef9450-c9a0-481a-98ff-248d8286e19e-kube-api-access-mmmt7\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.680040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hjrtf" event={"ID":"9aef9450-c9a0-481a-98ff-248d8286e19e","Type":"ContainerDied","Data":"5178c2d64ded6b17a6d08672ce1bb13539b07f6a9ae4b072147773f028f1120b"} Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.680083 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5178c2d64ded6b17a6d08672ce1bb13539b07f6a9ae4b072147773f028f1120b" Nov 21 13:33:38 crc kubenswrapper[4769]: I1121 13:33:38.680144 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hjrtf" Nov 21 13:33:39 crc kubenswrapper[4769]: I1121 13:33:39.286960 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" path="/var/lib/kubelet/pods/25ed8043-9d6b-4cde-862d-a9edd7f34ae9/volumes" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.000549 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-hjrtf"] Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.005090 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-hjrtf"] Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.135527 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-m75wl"] Nov 21 13:33:42 crc kubenswrapper[4769]: E1121 13:33:42.136183 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerName="init" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.136213 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerName="init" Nov 21 13:33:42 crc kubenswrapper[4769]: E1121 13:33:42.136229 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9aef9450-c9a0-481a-98ff-248d8286e19e" containerName="storage" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.136235 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aef9450-c9a0-481a-98ff-248d8286e19e" containerName="storage" Nov 21 13:33:42 crc kubenswrapper[4769]: E1121 13:33:42.136252 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerName="dnsmasq-dns" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.136258 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerName="dnsmasq-dns" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.136434 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25ed8043-9d6b-4cde-862d-a9edd7f34ae9" containerName="dnsmasq-dns" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.136449 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9aef9450-c9a0-481a-98ff-248d8286e19e" containerName="storage" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.137006 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.140099 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.140148 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.140099 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.140371 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.144161 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-m75wl"] Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.238179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsfpn\" (UniqueName: \"kubernetes.io/projected/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-kube-api-access-vsfpn\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.238314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-node-mnt\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.238397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-crc-storage\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.340226 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-node-mnt\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.340540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-crc-storage\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.340593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-node-mnt\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.340683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vsfpn\" (UniqueName: \"kubernetes.io/projected/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-kube-api-access-vsfpn\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.341994 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-crc-storage\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.360698 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsfpn\" (UniqueName: \"kubernetes.io/projected/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-kube-api-access-vsfpn\") pod \"crc-storage-crc-m75wl\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.463044 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:42 crc kubenswrapper[4769]: I1121 13:33:42.861990 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-m75wl"] Nov 21 13:33:43 crc kubenswrapper[4769]: I1121 13:33:43.289491 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aef9450-c9a0-481a-98ff-248d8286e19e" path="/var/lib/kubelet/pods/9aef9450-c9a0-481a-98ff-248d8286e19e/volumes" Nov 21 13:33:43 crc kubenswrapper[4769]: I1121 13:33:43.727786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-m75wl" event={"ID":"a53eddd2-f250-4f66-92da-56ea0e1aa0c2","Type":"ContainerStarted","Data":"2eb58979ddfa3c99745ebf60b723fd4ae9d69812db5e92df04b27b29eb45bd50"} Nov 21 13:33:44 crc kubenswrapper[4769]: I1121 13:33:44.741580 4769 generic.go:334] "Generic (PLEG): container finished" podID="a53eddd2-f250-4f66-92da-56ea0e1aa0c2" containerID="ce0000866949871db3013198d05a8dc20e39c0bfb35c8bb36cd63bd38e58fd4e" exitCode=0 Nov 21 13:33:44 crc kubenswrapper[4769]: I1121 13:33:44.741687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-m75wl" event={"ID":"a53eddd2-f250-4f66-92da-56ea0e1aa0c2","Type":"ContainerDied","Data":"ce0000866949871db3013198d05a8dc20e39c0bfb35c8bb36cd63bd38e58fd4e"} Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.091108 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.208153 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsfpn\" (UniqueName: \"kubernetes.io/projected/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-kube-api-access-vsfpn\") pod \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.208295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-node-mnt\") pod \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.208418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-crc-storage\") pod \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\" (UID: \"a53eddd2-f250-4f66-92da-56ea0e1aa0c2\") " Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.208506 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "a53eddd2-f250-4f66-92da-56ea0e1aa0c2" (UID: "a53eddd2-f250-4f66-92da-56ea0e1aa0c2"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.208730 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.214814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-kube-api-access-vsfpn" (OuterVolumeSpecName: "kube-api-access-vsfpn") pod "a53eddd2-f250-4f66-92da-56ea0e1aa0c2" (UID: "a53eddd2-f250-4f66-92da-56ea0e1aa0c2"). InnerVolumeSpecName "kube-api-access-vsfpn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.229971 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "a53eddd2-f250-4f66-92da-56ea0e1aa0c2" (UID: "a53eddd2-f250-4f66-92da-56ea0e1aa0c2"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.310146 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.310210 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vsfpn\" (UniqueName: \"kubernetes.io/projected/a53eddd2-f250-4f66-92da-56ea0e1aa0c2-kube-api-access-vsfpn\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.783668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-m75wl" event={"ID":"a53eddd2-f250-4f66-92da-56ea0e1aa0c2","Type":"ContainerDied","Data":"2eb58979ddfa3c99745ebf60b723fd4ae9d69812db5e92df04b27b29eb45bd50"} Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.783739 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2eb58979ddfa3c99745ebf60b723fd4ae9d69812db5e92df04b27b29eb45bd50" Nov 21 13:33:46 crc kubenswrapper[4769]: I1121 13:33:46.783756 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-m75wl" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.833254 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp"] Nov 21 13:33:49 crc kubenswrapper[4769]: E1121 13:33:49.833818 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a53eddd2-f250-4f66-92da-56ea0e1aa0c2" containerName="storage" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.833830 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53eddd2-f250-4f66-92da-56ea0e1aa0c2" containerName="storage" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.833991 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a53eddd2-f250-4f66-92da-56ea0e1aa0c2" containerName="storage" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.834928 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.840257 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.851522 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp"] Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.971167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.971380 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h2np\" (UniqueName: \"kubernetes.io/projected/6ff30df8-11ed-48c7-ba8d-47ac0894c561-kube-api-access-4h2np\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.971493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-config\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:49 crc kubenswrapper[4769]: I1121 13:33:49.971751 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.073429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.073502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4h2np\" (UniqueName: \"kubernetes.io/projected/6ff30df8-11ed-48c7-ba8d-47ac0894c561-kube-api-access-4h2np\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.073567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-config\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.073607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.074406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.074446 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.075621 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-config\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.096176 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h2np\" (UniqueName: \"kubernetes.io/projected/6ff30df8-11ed-48c7-ba8d-47ac0894c561-kube-api-access-4h2np\") pod \"dnsmasq-dnsmasq-64864b6d57-jpscp\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.180802 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.427293 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp"] Nov 21 13:33:50 crc kubenswrapper[4769]: W1121 13:33:50.431224 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ff30df8_11ed_48c7_ba8d_47ac0894c561.slice/crio-49f6956bb37780c005587629f5b20e9a1327c82e2ddf64fa60560c6ab6bf6abb WatchSource:0}: Error finding container 49f6956bb37780c005587629f5b20e9a1327c82e2ddf64fa60560c6ab6bf6abb: Status 404 returned error can't find the container with id 49f6956bb37780c005587629f5b20e9a1327c82e2ddf64fa60560c6ab6bf6abb Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.796776 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j"] Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.799871 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.805214 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j"] Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.807109 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.809082 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.809350 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.823464 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.825163 4769 generic.go:334] "Generic (PLEG): container finished" podID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerID="45c0fdf29410f9df98f599ddc10cc76e4eed978ee8c00d11ae48f9585bc52122" exitCode=0 Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.825256 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" event={"ID":"6ff30df8-11ed-48c7-ba8d-47ac0894c561","Type":"ContainerDied","Data":"45c0fdf29410f9df98f599ddc10cc76e4eed978ee8c00d11ae48f9585bc52122"} Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.825301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" event={"ID":"6ff30df8-11ed-48c7-ba8d-47ac0894c561","Type":"ContainerStarted","Data":"49f6956bb37780c005587629f5b20e9a1327c82e2ddf64fa60560c6ab6bf6abb"} Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.890419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-ssh-key\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.891453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-inventory\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.891617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg6qn\" (UniqueName: \"kubernetes.io/projected/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-kube-api-access-bg6qn\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.995784 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bg6qn\" (UniqueName: \"kubernetes.io/projected/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-kube-api-access-bg6qn\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.995949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-ssh-key\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:50 crc kubenswrapper[4769]: I1121 13:33:50.995986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-inventory\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.001409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-inventory\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.001465 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-ssh-key\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.012290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg6qn\" (UniqueName: \"kubernetes.io/projected/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-kube-api-access-bg6qn\") pod \"download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.145810 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.412135 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j"] Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.858401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" event={"ID":"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5","Type":"ContainerStarted","Data":"8f9f04a379a1b72acfe049fe3e7e48d38d61d9338335ba83dbbfa310d85f7d78"} Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.861635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" event={"ID":"6ff30df8-11ed-48c7-ba8d-47ac0894c561","Type":"ContainerStarted","Data":"56ed714049df023ecffe2a70ab50c0cc36bdd7ad5313dbdf09c24d960407982f"} Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.862050 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:33:51 crc kubenswrapper[4769]: I1121 13:33:51.891826 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" podStartSLOduration=2.891805535 podStartE2EDuration="2.891805535s" podCreationTimestamp="2025-11-21 13:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:33:51.885553722 +0000 UTC m=+6190.586215550" watchObservedRunningTime="2025-11-21 13:33:51.891805535 +0000 UTC m=+6190.592467363" Nov 21 13:33:52 crc kubenswrapper[4769]: I1121 13:33:52.876296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" event={"ID":"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5","Type":"ContainerStarted","Data":"8b889212c71fe78b4caecd7aec4ac41aa8a39d09575c8b877707e0f383558d98"} Nov 21 13:33:52 crc kubenswrapper[4769]: I1121 13:33:52.915135 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" podStartSLOduration=2.362589436 podStartE2EDuration="2.915104045s" podCreationTimestamp="2025-11-21 13:33:50 +0000 UTC" firstStartedPulling="2025-11-21 13:33:51.42546737 +0000 UTC m=+6190.126129188" lastFinishedPulling="2025-11-21 13:33:51.977981959 +0000 UTC m=+6190.678643797" observedRunningTime="2025-11-21 13:33:52.904909679 +0000 UTC m=+6191.605571567" watchObservedRunningTime="2025-11-21 13:33:52.915104045 +0000 UTC m=+6191.615765903" Nov 21 13:33:53 crc kubenswrapper[4769]: I1121 13:33:53.892049 4769 generic.go:334] "Generic (PLEG): container finished" podID="62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" containerID="8b889212c71fe78b4caecd7aec4ac41aa8a39d09575c8b877707e0f383558d98" exitCode=0 Nov 21 13:33:53 crc kubenswrapper[4769]: I1121 13:33:53.892094 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" event={"ID":"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5","Type":"ContainerDied","Data":"8b889212c71fe78b4caecd7aec4ac41aa8a39d09575c8b877707e0f383558d98"} Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.250224 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.405951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-inventory\") pod \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.406059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg6qn\" (UniqueName: \"kubernetes.io/projected/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-kube-api-access-bg6qn\") pod \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.406328 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-ssh-key\") pod \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\" (UID: \"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5\") " Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.420549 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-kube-api-access-bg6qn" (OuterVolumeSpecName: "kube-api-access-bg6qn") pod "62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" (UID: "62bcfeb0-8a8e-453e-a698-4cf57bbb82b5"). InnerVolumeSpecName "kube-api-access-bg6qn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.455885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" (UID: "62bcfeb0-8a8e-453e-a698-4cf57bbb82b5"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.459796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-inventory" (OuterVolumeSpecName: "inventory") pod "62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" (UID: "62bcfeb0-8a8e-453e-a698-4cf57bbb82b5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.508930 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.509636 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bg6qn\" (UniqueName: \"kubernetes.io/projected/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-kube-api-access-bg6qn\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.509785 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.916132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" event={"ID":"62bcfeb0-8a8e-453e-a698-4cf57bbb82b5","Type":"ContainerDied","Data":"8f9f04a379a1b72acfe049fe3e7e48d38d61d9338335ba83dbbfa310d85f7d78"} Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.916183 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f9f04a379a1b72acfe049fe3e7e48d38d61d9338335ba83dbbfa310d85f7d78" Nov 21 13:33:55 crc kubenswrapper[4769]: I1121 13:33:55.916215 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j" Nov 21 13:34:00 crc kubenswrapper[4769]: I1121 13:34:00.183152 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:34:00 crc kubenswrapper[4769]: I1121 13:34:00.254446 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz"] Nov 21 13:34:00 crc kubenswrapper[4769]: I1121 13:34:00.254742 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerName="dnsmasq-dns" containerID="cri-o://bd64955156fa5e1479ce6db5f569be8c204153ae6f8e779bb7ede5f4ecdcb39e" gracePeriod=10 Nov 21 13:34:00 crc kubenswrapper[4769]: I1121 13:34:00.968885 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerID="bd64955156fa5e1479ce6db5f569be8c204153ae6f8e779bb7ede5f4ecdcb39e" exitCode=0 Nov 21 13:34:00 crc kubenswrapper[4769]: I1121 13:34:00.968932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" event={"ID":"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac","Type":"ContainerDied","Data":"bd64955156fa5e1479ce6db5f569be8c204153ae6f8e779bb7ede5f4ecdcb39e"} Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.203427 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.216125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-config\") pod \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.216177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-dnsmasq-svc\") pod \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.216247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmtfb\" (UniqueName: \"kubernetes.io/projected/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-kube-api-access-vmtfb\") pod \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\" (UID: \"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac\") " Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.227129 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-kube-api-access-vmtfb" (OuterVolumeSpecName: "kube-api-access-vmtfb") pod "5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" (UID: "5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac"). InnerVolumeSpecName "kube-api-access-vmtfb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.263937 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-config" (OuterVolumeSpecName: "config") pod "5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" (UID: "5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.270537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" (UID: "5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.320552 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.320771 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.320841 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vmtfb\" (UniqueName: \"kubernetes.io/projected/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac-kube-api-access-vmtfb\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.561976 4769 scope.go:117] "RemoveContainer" containerID="bd503f3ff5ccb5cabc4c7a75a9a9cc41a0f5c86e1a37b89538ee79fb6c2ba2af" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.586143 4769 scope.go:117] "RemoveContainer" containerID="06d9cd7c1bb46d263a945ed4fd0d3ba41c433b6b3c5f4e4cfd6c517126475b42" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.615525 4769 scope.go:117] "RemoveContainer" containerID="803757e54916f8e20659de800e1cd9e6ed6a2b4b7d4d3b0b479dfbb02da229be" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.640360 4769 scope.go:117] "RemoveContainer" containerID="fa98d3985eb6a30d06eddaf9ed39767135f67b0acb4b2b8428762a935fc41375" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.668078 4769 scope.go:117] "RemoveContainer" containerID="d0f8f64c6678a8ec1fbbd8f88594cc84cd97edee251ef045e8a09a9a9e423e9d" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.685798 4769 scope.go:117] "RemoveContainer" containerID="a7400aff22e5cdfb01cf61117c215695098d258d843f79b41373661055530c0d" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.980683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" event={"ID":"5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac","Type":"ContainerDied","Data":"38149d3049339f116e46f23f4d1480d97f9296262eae48b29b522db3d47263d5"} Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.980736 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz" Nov 21 13:34:01 crc kubenswrapper[4769]: I1121 13:34:01.980752 4769 scope.go:117] "RemoveContainer" containerID="bd64955156fa5e1479ce6db5f569be8c204153ae6f8e779bb7ede5f4ecdcb39e" Nov 21 13:34:02 crc kubenswrapper[4769]: I1121 13:34:02.007886 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz"] Nov 21 13:34:02 crc kubenswrapper[4769]: I1121 13:34:02.007962 4769 scope.go:117] "RemoveContainer" containerID="1e5ec3e6389c593c17dafa9202d374fb241950ee02d48707b174fd9129fdbd0d" Nov 21 13:34:02 crc kubenswrapper[4769]: I1121 13:34:02.012215 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-pg8rz"] Nov 21 13:34:03 crc kubenswrapper[4769]: I1121 13:34:03.299958 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" path="/var/lib/kubelet/pods/5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac/volumes" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.867159 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr"] Nov 21 13:34:05 crc kubenswrapper[4769]: E1121 13:34:05.868305 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerName="dnsmasq-dns" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.868340 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerName="dnsmasq-dns" Nov 21 13:34:05 crc kubenswrapper[4769]: E1121 13:34:05.868403 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" containerName="download-cache-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.868425 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" containerName="download-cache-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:05 crc kubenswrapper[4769]: E1121 13:34:05.868457 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerName="init" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.868476 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerName="init" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.868819 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f76a3d8-3e68-4ff5-bc0f-8c398d8a6bac" containerName="dnsmasq-dns" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.868882 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" containerName="download-cache-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.870079 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.872937 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.873340 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.873914 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.874327 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.875708 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.884484 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr"] Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.896355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-ssh-key\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.896459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-inventory\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.896567 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.896713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnh95\" (UniqueName: \"kubernetes.io/projected/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-kube-api-access-gnh95\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.998468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-ssh-key\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.998514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-inventory\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.998552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:05 crc kubenswrapper[4769]: I1121 13:34:05.998603 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gnh95\" (UniqueName: \"kubernetes.io/projected/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-kube-api-access-gnh95\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:06 crc kubenswrapper[4769]: I1121 13:34:06.004076 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:06 crc kubenswrapper[4769]: I1121 13:34:06.004093 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-inventory\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:06 crc kubenswrapper[4769]: I1121 13:34:06.004892 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-ssh-key\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:06 crc kubenswrapper[4769]: I1121 13:34:06.014178 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnh95\" (UniqueName: \"kubernetes.io/projected/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-kube-api-access-gnh95\") pod \"bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:06 crc kubenswrapper[4769]: I1121 13:34:06.225461 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:06 crc kubenswrapper[4769]: I1121 13:34:06.631735 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr"] Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.034322 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" event={"ID":"ee60d19d-fa1f-41d6-9f06-529ac5da30c5","Type":"ContainerStarted","Data":"4b13984abdbb489be508c4f8504317bd5ffd040e57b1177866db224b4c1d32d1"} Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.085089 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-k2m8f"] Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.093696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.105063 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-k2m8f"] Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.113671 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-utilities\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.113812 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-catalog-content\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.113874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq7q6\" (UniqueName: \"kubernetes.io/projected/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-kube-api-access-xq7q6\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.215857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-catalog-content\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.215977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xq7q6\" (UniqueName: \"kubernetes.io/projected/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-kube-api-access-xq7q6\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.216079 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-utilities\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.216479 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-catalog-content\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.216494 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-utilities\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.243436 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq7q6\" (UniqueName: \"kubernetes.io/projected/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-kube-api-access-xq7q6\") pod \"certified-operators-k2m8f\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.427015 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:07 crc kubenswrapper[4769]: I1121 13:34:07.897640 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-k2m8f"] Nov 21 13:34:07 crc kubenswrapper[4769]: W1121 13:34:07.906860 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3611fe_bffd_43ba_a2e1_2ddb728c3eb5.slice/crio-849d20941ed12e3467ed1d7e8dad942271ec1be0a215a3947c4168d95bee9f07 WatchSource:0}: Error finding container 849d20941ed12e3467ed1d7e8dad942271ec1be0a215a3947c4168d95bee9f07: Status 404 returned error can't find the container with id 849d20941ed12e3467ed1d7e8dad942271ec1be0a215a3947c4168d95bee9f07 Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.044997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerStarted","Data":"849d20941ed12e3467ed1d7e8dad942271ec1be0a215a3947c4168d95bee9f07"} Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.047393 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" event={"ID":"ee60d19d-fa1f-41d6-9f06-529ac5da30c5","Type":"ContainerStarted","Data":"86652136509a869d6b6f2e29135024c7a981e3b117f713e8029e2737eb36a9ea"} Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.081180 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" podStartSLOduration=2.589332033 podStartE2EDuration="3.081152024s" podCreationTimestamp="2025-11-21 13:34:05 +0000 UTC" firstStartedPulling="2025-11-21 13:34:06.647826289 +0000 UTC m=+6205.348488117" lastFinishedPulling="2025-11-21 13:34:07.13964628 +0000 UTC m=+6205.840308108" observedRunningTime="2025-11-21 13:34:08.067712462 +0000 UTC m=+6206.768374300" watchObservedRunningTime="2025-11-21 13:34:08.081152024 +0000 UTC m=+6206.781813882" Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.886615 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-8cl2k"] Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.888444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.900238 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-8cl2k"] Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.940633 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-utilities\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.940696 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-catalog-content\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:08 crc kubenswrapper[4769]: I1121 13:34:08.940771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl7fh\" (UniqueName: \"kubernetes.io/projected/97a26375-24ef-4aac-b8de-8a62c5994e01-kube-api-access-bl7fh\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.041480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-utilities\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.042383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-utilities\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.042463 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-catalog-content\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.042707 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bl7fh\" (UniqueName: \"kubernetes.io/projected/97a26375-24ef-4aac-b8de-8a62c5994e01-kube-api-access-bl7fh\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.042979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-catalog-content\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.059831 4769 generic.go:334] "Generic (PLEG): container finished" podID="ee60d19d-fa1f-41d6-9f06-529ac5da30c5" containerID="86652136509a869d6b6f2e29135024c7a981e3b117f713e8029e2737eb36a9ea" exitCode=0 Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.060264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" event={"ID":"ee60d19d-fa1f-41d6-9f06-529ac5da30c5","Type":"ContainerDied","Data":"86652136509a869d6b6f2e29135024c7a981e3b117f713e8029e2737eb36a9ea"} Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.062623 4769 generic.go:334] "Generic (PLEG): container finished" podID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerID="5467aafccf7975e72d76502e4e9d2aac5cb0001cb77464ca6516f421ec8e3e9f" exitCode=0 Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.062667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerDied","Data":"5467aafccf7975e72d76502e4e9d2aac5cb0001cb77464ca6516f421ec8e3e9f"} Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.068847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl7fh\" (UniqueName: \"kubernetes.io/projected/97a26375-24ef-4aac-b8de-8a62c5994e01-kube-api-access-bl7fh\") pod \"redhat-marketplace-8cl2k\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.220722 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:09 crc kubenswrapper[4769]: I1121 13:34:09.502086 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-8cl2k"] Nov 21 13:34:09 crc kubenswrapper[4769]: W1121 13:34:09.503005 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a26375_24ef_4aac_b8de_8a62c5994e01.slice/crio-fd0fb102bc668e6ee953a9d4cb8b1893eab497b8f68d12104f13c9f1e410ae9b WatchSource:0}: Error finding container fd0fb102bc668e6ee953a9d4cb8b1893eab497b8f68d12104f13c9f1e410ae9b: Status 404 returned error can't find the container with id fd0fb102bc668e6ee953a9d4cb8b1893eab497b8f68d12104f13c9f1e410ae9b Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.074590 4769 generic.go:334] "Generic (PLEG): container finished" podID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerID="8f11cf50d939ba789e8b61e3198e53831c49d8963486205efce58096982b1f5b" exitCode=0 Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.074763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8cl2k" event={"ID":"97a26375-24ef-4aac-b8de-8a62c5994e01","Type":"ContainerDied","Data":"8f11cf50d939ba789e8b61e3198e53831c49d8963486205efce58096982b1f5b"} Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.077155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8cl2k" event={"ID":"97a26375-24ef-4aac-b8de-8a62c5994e01","Type":"ContainerStarted","Data":"fd0fb102bc668e6ee953a9d4cb8b1893eab497b8f68d12104f13c9f1e410ae9b"} Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.413928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.560778 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-bootstrap-combined-ca-bundle\") pod \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.560872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-inventory\") pod \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.560899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-ssh-key\") pod \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.560981 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnh95\" (UniqueName: \"kubernetes.io/projected/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-kube-api-access-gnh95\") pod \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\" (UID: \"ee60d19d-fa1f-41d6-9f06-529ac5da30c5\") " Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.566709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "ee60d19d-fa1f-41d6-9f06-529ac5da30c5" (UID: "ee60d19d-fa1f-41d6-9f06-529ac5da30c5"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.566703 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-kube-api-access-gnh95" (OuterVolumeSpecName: "kube-api-access-gnh95") pod "ee60d19d-fa1f-41d6-9f06-529ac5da30c5" (UID: "ee60d19d-fa1f-41d6-9f06-529ac5da30c5"). InnerVolumeSpecName "kube-api-access-gnh95". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.584664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-inventory" (OuterVolumeSpecName: "inventory") pod "ee60d19d-fa1f-41d6-9f06-529ac5da30c5" (UID: "ee60d19d-fa1f-41d6-9f06-529ac5da30c5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.593702 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "ee60d19d-fa1f-41d6-9f06-529ac5da30c5" (UID: "ee60d19d-fa1f-41d6-9f06-529ac5da30c5"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.663084 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.663125 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.663140 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gnh95\" (UniqueName: \"kubernetes.io/projected/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-kube-api-access-gnh95\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:10 crc kubenswrapper[4769]: I1121 13:34:10.663154 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee60d19d-fa1f-41d6-9f06-529ac5da30c5-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.091046 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" event={"ID":"ee60d19d-fa1f-41d6-9f06-529ac5da30c5","Type":"ContainerDied","Data":"4b13984abdbb489be508c4f8504317bd5ffd040e57b1177866db224b4c1d32d1"} Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.091276 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.091322 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b13984abdbb489be508c4f8504317bd5ffd040e57b1177866db224b4c1d32d1" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.099997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerStarted","Data":"76faf304c5dc76aa7ebb952d57ba25f3c04d256f279d51976fe50745a6f9eb5f"} Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.164326 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf"] Nov 21 13:34:11 crc kubenswrapper[4769]: E1121 13:34:11.164756 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ee60d19d-fa1f-41d6-9f06-529ac5da30c5" containerName="bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.164778 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee60d19d-fa1f-41d6-9f06-529ac5da30c5" containerName="bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.164991 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ee60d19d-fa1f-41d6-9f06-529ac5da30c5" containerName="bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.165669 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.168380 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.171547 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.172795 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.172958 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.179044 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf"] Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.271332 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjl7\" (UniqueName: \"kubernetes.io/projected/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-kube-api-access-vvjl7\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.271624 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-inventory\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.271663 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-ssh-key\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.373329 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjl7\" (UniqueName: \"kubernetes.io/projected/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-kube-api-access-vvjl7\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.373493 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-inventory\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.373579 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-ssh-key\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.379235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-ssh-key\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.381991 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-inventory\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.392453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjl7\" (UniqueName: \"kubernetes.io/projected/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-kube-api-access-vvjl7\") pod \"configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:11 crc kubenswrapper[4769]: I1121 13:34:11.498558 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:12 crc kubenswrapper[4769]: I1121 13:34:12.000929 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf"] Nov 21 13:34:12 crc kubenswrapper[4769]: W1121 13:34:12.005361 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b93f5cc_a6bd_441a_9bd9_3c024eb15283.slice/crio-aee1162fd0f2be57cb7cf391b71c646d2bb56a7de246b2d7eb149b361f4f9d3c WatchSource:0}: Error finding container aee1162fd0f2be57cb7cf391b71c646d2bb56a7de246b2d7eb149b361f4f9d3c: Status 404 returned error can't find the container with id aee1162fd0f2be57cb7cf391b71c646d2bb56a7de246b2d7eb149b361f4f9d3c Nov 21 13:34:12 crc kubenswrapper[4769]: I1121 13:34:12.114125 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" event={"ID":"3b93f5cc-a6bd-441a-9bd9-3c024eb15283","Type":"ContainerStarted","Data":"aee1162fd0f2be57cb7cf391b71c646d2bb56a7de246b2d7eb149b361f4f9d3c"} Nov 21 13:34:12 crc kubenswrapper[4769]: I1121 13:34:12.117983 4769 generic.go:334] "Generic (PLEG): container finished" podID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerID="a08a53f75bb394ba5c24ea45856311071e6c1b59e21743c5cbe404854f83bf9f" exitCode=0 Nov 21 13:34:12 crc kubenswrapper[4769]: I1121 13:34:12.118050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8cl2k" event={"ID":"97a26375-24ef-4aac-b8de-8a62c5994e01","Type":"ContainerDied","Data":"a08a53f75bb394ba5c24ea45856311071e6c1b59e21743c5cbe404854f83bf9f"} Nov 21 13:34:13 crc kubenswrapper[4769]: I1121 13:34:13.129128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" event={"ID":"3b93f5cc-a6bd-441a-9bd9-3c024eb15283","Type":"ContainerStarted","Data":"59a70e4e2acc88a961ce3845e3e0a87dff0bf5ada0007fafb62debe1c2cee436"} Nov 21 13:34:13 crc kubenswrapper[4769]: I1121 13:34:13.131779 4769 generic.go:334] "Generic (PLEG): container finished" podID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerID="76faf304c5dc76aa7ebb952d57ba25f3c04d256f279d51976fe50745a6f9eb5f" exitCode=0 Nov 21 13:34:13 crc kubenswrapper[4769]: I1121 13:34:13.131812 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerDied","Data":"76faf304c5dc76aa7ebb952d57ba25f3c04d256f279d51976fe50745a6f9eb5f"} Nov 21 13:34:14 crc kubenswrapper[4769]: I1121 13:34:14.157929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8cl2k" event={"ID":"97a26375-24ef-4aac-b8de-8a62c5994e01","Type":"ContainerStarted","Data":"6b3fb8f26fcfbdffeef4e66d4eb5075e37b6d2202b8568a1bec4035ec346be3d"} Nov 21 13:34:14 crc kubenswrapper[4769]: I1121 13:34:14.171476 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" podStartSLOduration=2.27738204 podStartE2EDuration="3.171248825s" podCreationTimestamp="2025-11-21 13:34:11 +0000 UTC" firstStartedPulling="2025-11-21 13:34:12.008685512 +0000 UTC m=+6210.709347330" lastFinishedPulling="2025-11-21 13:34:12.902552297 +0000 UTC m=+6211.603214115" observedRunningTime="2025-11-21 13:34:14.169833388 +0000 UTC m=+6212.870495206" watchObservedRunningTime="2025-11-21 13:34:14.171248825 +0000 UTC m=+6212.871910643" Nov 21 13:34:14 crc kubenswrapper[4769]: I1121 13:34:14.192725 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-8cl2k" podStartSLOduration=3.057743154 podStartE2EDuration="6.192703566s" podCreationTimestamp="2025-11-21 13:34:08 +0000 UTC" firstStartedPulling="2025-11-21 13:34:10.098891659 +0000 UTC m=+6208.799553517" lastFinishedPulling="2025-11-21 13:34:13.233852101 +0000 UTC m=+6211.934513929" observedRunningTime="2025-11-21 13:34:14.185802725 +0000 UTC m=+6212.886464543" watchObservedRunningTime="2025-11-21 13:34:14.192703566 +0000 UTC m=+6212.893365384" Nov 21 13:34:15 crc kubenswrapper[4769]: I1121 13:34:15.169099 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b93f5cc-a6bd-441a-9bd9-3c024eb15283" containerID="59a70e4e2acc88a961ce3845e3e0a87dff0bf5ada0007fafb62debe1c2cee436" exitCode=0 Nov 21 13:34:15 crc kubenswrapper[4769]: I1121 13:34:15.169227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" event={"ID":"3b93f5cc-a6bd-441a-9bd9-3c024eb15283","Type":"ContainerDied","Data":"59a70e4e2acc88a961ce3845e3e0a87dff0bf5ada0007fafb62debe1c2cee436"} Nov 21 13:34:15 crc kubenswrapper[4769]: I1121 13:34:15.172870 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerStarted","Data":"f039ca07be2954030c4a0f9d7d77387e19bbbb4c707d7c38f9237d535eff7689"} Nov 21 13:34:15 crc kubenswrapper[4769]: I1121 13:34:15.205400 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-k2m8f" podStartSLOduration=3.015464947 podStartE2EDuration="8.205178923s" podCreationTimestamp="2025-11-21 13:34:07 +0000 UTC" firstStartedPulling="2025-11-21 13:34:09.064607641 +0000 UTC m=+6207.765269469" lastFinishedPulling="2025-11-21 13:34:14.254321627 +0000 UTC m=+6212.954983445" observedRunningTime="2025-11-21 13:34:15.203706655 +0000 UTC m=+6213.904368473" watchObservedRunningTime="2025-11-21 13:34:15.205178923 +0000 UTC m=+6213.905840741" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.504591 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.646726 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvjl7\" (UniqueName: \"kubernetes.io/projected/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-kube-api-access-vvjl7\") pod \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.646896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-ssh-key\") pod \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.646980 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-inventory\") pod \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\" (UID: \"3b93f5cc-a6bd-441a-9bd9-3c024eb15283\") " Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.654581 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-kube-api-access-vvjl7" (OuterVolumeSpecName: "kube-api-access-vvjl7") pod "3b93f5cc-a6bd-441a-9bd9-3c024eb15283" (UID: "3b93f5cc-a6bd-441a-9bd9-3c024eb15283"). InnerVolumeSpecName "kube-api-access-vvjl7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.675747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "3b93f5cc-a6bd-441a-9bd9-3c024eb15283" (UID: "3b93f5cc-a6bd-441a-9bd9-3c024eb15283"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.682497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-inventory" (OuterVolumeSpecName: "inventory") pod "3b93f5cc-a6bd-441a-9bd9-3c024eb15283" (UID: "3b93f5cc-a6bd-441a-9bd9-3c024eb15283"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.748906 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vvjl7\" (UniqueName: \"kubernetes.io/projected/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-kube-api-access-vvjl7\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.748959 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:16 crc kubenswrapper[4769]: I1121 13:34:16.748980 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3b93f5cc-a6bd-441a-9bd9-3c024eb15283-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.189467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" event={"ID":"3b93f5cc-a6bd-441a-9bd9-3c024eb15283","Type":"ContainerDied","Data":"aee1162fd0f2be57cb7cf391b71c646d2bb56a7de246b2d7eb149b361f4f9d3c"} Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.189513 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aee1162fd0f2be57cb7cf391b71c646d2bb56a7de246b2d7eb149b361f4f9d3c" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.189573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.432463 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.433255 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.507394 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.595338 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6"] Nov 21 13:34:17 crc kubenswrapper[4769]: E1121 13:34:17.595656 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b93f5cc-a6bd-441a-9bd9-3c024eb15283" containerName="configure-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.595669 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b93f5cc-a6bd-441a-9bd9-3c024eb15283" containerName="configure-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.595824 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b93f5cc-a6bd-441a-9bd9-3c024eb15283" containerName="configure-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.596303 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.599064 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.599103 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.599603 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.600283 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.645178 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6"] Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.768726 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-inventory\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.768788 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-ssh-key\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.768856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzpq\" (UniqueName: \"kubernetes.io/projected/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-kube-api-access-kpzpq\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.869923 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-inventory\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.869965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-ssh-key\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.870005 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzpq\" (UniqueName: \"kubernetes.io/projected/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-kube-api-access-kpzpq\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.883431 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-ssh-key\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.893131 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-inventory\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.894524 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzpq\" (UniqueName: \"kubernetes.io/projected/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-kube-api-access-kpzpq\") pod \"validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:17 crc kubenswrapper[4769]: I1121 13:34:17.917431 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:18 crc kubenswrapper[4769]: I1121 13:34:18.327548 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6"] Nov 21 13:34:18 crc kubenswrapper[4769]: W1121 13:34:18.335149 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bbf7125_cc8b_400e_8d15_f5f512be2d1b.slice/crio-ab1ad0ee2d624f79c6d93f7403e691192240aec2249c85175c15e680c8dcb168 WatchSource:0}: Error finding container ab1ad0ee2d624f79c6d93f7403e691192240aec2249c85175c15e680c8dcb168: Status 404 returned error can't find the container with id ab1ad0ee2d624f79c6d93f7403e691192240aec2249c85175c15e680c8dcb168 Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.211834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" event={"ID":"7bbf7125-cc8b-400e-8d15-f5f512be2d1b","Type":"ContainerStarted","Data":"a8926732e15a3c090c6635c020263978d3e295bd95cbaaee471ccf5ae9df0605"} Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.212869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" event={"ID":"7bbf7125-cc8b-400e-8d15-f5f512be2d1b","Type":"ContainerStarted","Data":"ab1ad0ee2d624f79c6d93f7403e691192240aec2249c85175c15e680c8dcb168"} Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.220953 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.221035 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.262115 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.288975 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" podStartSLOduration=1.7100706479999999 podStartE2EDuration="2.288944576s" podCreationTimestamp="2025-11-21 13:34:17 +0000 UTC" firstStartedPulling="2025-11-21 13:34:18.337853735 +0000 UTC m=+6217.038515553" lastFinishedPulling="2025-11-21 13:34:18.916727643 +0000 UTC m=+6217.617389481" observedRunningTime="2025-11-21 13:34:19.233527488 +0000 UTC m=+6217.934189316" watchObservedRunningTime="2025-11-21 13:34:19.288944576 +0000 UTC m=+6217.989606394" Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.295665 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:19 crc kubenswrapper[4769]: I1121 13:34:19.866704 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-k2m8f"] Nov 21 13:34:20 crc kubenswrapper[4769]: I1121 13:34:20.223398 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bbf7125-cc8b-400e-8d15-f5f512be2d1b" containerID="a8926732e15a3c090c6635c020263978d3e295bd95cbaaee471ccf5ae9df0605" exitCode=0 Nov 21 13:34:20 crc kubenswrapper[4769]: I1121 13:34:20.223462 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" event={"ID":"7bbf7125-cc8b-400e-8d15-f5f512be2d1b","Type":"ContainerDied","Data":"a8926732e15a3c090c6635c020263978d3e295bd95cbaaee471ccf5ae9df0605"} Nov 21 13:34:20 crc kubenswrapper[4769]: I1121 13:34:20.278634 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.238097 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-k2m8f" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="registry-server" containerID="cri-o://f039ca07be2954030c4a0f9d7d77387e19bbbb4c707d7c38f9237d535eff7689" gracePeriod=2 Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.623305 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.637445 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-inventory\") pod \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.637548 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpzpq\" (UniqueName: \"kubernetes.io/projected/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-kube-api-access-kpzpq\") pod \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.637612 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-ssh-key\") pod \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\" (UID: \"7bbf7125-cc8b-400e-8d15-f5f512be2d1b\") " Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.655990 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-kube-api-access-kpzpq" (OuterVolumeSpecName: "kube-api-access-kpzpq") pod "7bbf7125-cc8b-400e-8d15-f5f512be2d1b" (UID: "7bbf7125-cc8b-400e-8d15-f5f512be2d1b"). InnerVolumeSpecName "kube-api-access-kpzpq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.681656 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-8cl2k"] Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.692606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-inventory" (OuterVolumeSpecName: "inventory") pod "7bbf7125-cc8b-400e-8d15-f5f512be2d1b" (UID: "7bbf7125-cc8b-400e-8d15-f5f512be2d1b"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.693488 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "7bbf7125-cc8b-400e-8d15-f5f512be2d1b" (UID: "7bbf7125-cc8b-400e-8d15-f5f512be2d1b"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.739427 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kpzpq\" (UniqueName: \"kubernetes.io/projected/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-kube-api-access-kpzpq\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.739476 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:21 crc kubenswrapper[4769]: I1121 13:34:21.739494 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/7bbf7125-cc8b-400e-8d15-f5f512be2d1b-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.265143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" event={"ID":"7bbf7125-cc8b-400e-8d15-f5f512be2d1b","Type":"ContainerDied","Data":"ab1ad0ee2d624f79c6d93f7403e691192240aec2249c85175c15e680c8dcb168"} Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.265255 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab1ad0ee2d624f79c6d93f7403e691192240aec2249c85175c15e680c8dcb168" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.265421 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-8cl2k" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="registry-server" containerID="cri-o://6b3fb8f26fcfbdffeef4e66d4eb5075e37b6d2202b8568a1bec4035ec346be3d" gracePeriod=2 Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.270545 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.314637 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7"] Nov 21 13:34:22 crc kubenswrapper[4769]: E1121 13:34:22.315067 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7bbf7125-cc8b-400e-8d15-f5f512be2d1b" containerName="validate-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.315095 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbf7125-cc8b-400e-8d15-f5f512be2d1b" containerName="validate-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.315300 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7bbf7125-cc8b-400e-8d15-f5f512be2d1b" containerName="validate-network-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.315965 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.320579 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.320920 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.321075 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.327114 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.327120 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7"] Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.355033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjpnt\" (UniqueName: \"kubernetes.io/projected/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-kube-api-access-pjpnt\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.355150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-ssh-key\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.355238 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-inventory\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.456397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pjpnt\" (UniqueName: \"kubernetes.io/projected/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-kube-api-access-pjpnt\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.456931 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-ssh-key\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.457129 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-inventory\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.462374 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-ssh-key\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.463014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-inventory\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.477993 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjpnt\" (UniqueName: \"kubernetes.io/projected/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-kube-api-access-pjpnt\") pod \"install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: I1121 13:34:22.641682 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:22 crc kubenswrapper[4769]: E1121 13:34:22.957136 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3611fe_bffd_43ba_a2e1_2ddb728c3eb5.slice/crio-f039ca07be2954030c4a0f9d7d77387e19bbbb4c707d7c38f9237d535eff7689.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a26375_24ef_4aac_b8de_8a62c5994e01.slice/crio-6b3fb8f26fcfbdffeef4e66d4eb5075e37b6d2202b8568a1bec4035ec346be3d.scope\": RecentStats: unable to find data in memory cache]" Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.107126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7"] Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.281649 4769 generic.go:334] "Generic (PLEG): container finished" podID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerID="6b3fb8f26fcfbdffeef4e66d4eb5075e37b6d2202b8568a1bec4035ec346be3d" exitCode=0 Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.286351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8cl2k" event={"ID":"97a26375-24ef-4aac-b8de-8a62c5994e01","Type":"ContainerDied","Data":"6b3fb8f26fcfbdffeef4e66d4eb5075e37b6d2202b8568a1bec4035ec346be3d"} Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.286406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" event={"ID":"42063f6e-62ad-4351-a4dc-a0ee1d1d0276","Type":"ContainerStarted","Data":"8f3dd833145ecf0502cb297ba8298db34712be867fa4645378e196d9c63a1b6b"} Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.286762 4769 generic.go:334] "Generic (PLEG): container finished" podID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerID="f039ca07be2954030c4a0f9d7d77387e19bbbb4c707d7c38f9237d535eff7689" exitCode=0 Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.286800 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerDied","Data":"f039ca07be2954030c4a0f9d7d77387e19bbbb4c707d7c38f9237d535eff7689"} Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.896209 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.998245 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl7fh\" (UniqueName: \"kubernetes.io/projected/97a26375-24ef-4aac-b8de-8a62c5994e01-kube-api-access-bl7fh\") pod \"97a26375-24ef-4aac-b8de-8a62c5994e01\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.998355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-catalog-content\") pod \"97a26375-24ef-4aac-b8de-8a62c5994e01\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " Nov 21 13:34:23 crc kubenswrapper[4769]: I1121 13:34:23.998460 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-utilities\") pod \"97a26375-24ef-4aac-b8de-8a62c5994e01\" (UID: \"97a26375-24ef-4aac-b8de-8a62c5994e01\") " Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.000142 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-utilities" (OuterVolumeSpecName: "utilities") pod "97a26375-24ef-4aac-b8de-8a62c5994e01" (UID: "97a26375-24ef-4aac-b8de-8a62c5994e01"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.001467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a26375-24ef-4aac-b8de-8a62c5994e01-kube-api-access-bl7fh" (OuterVolumeSpecName: "kube-api-access-bl7fh") pod "97a26375-24ef-4aac-b8de-8a62c5994e01" (UID: "97a26375-24ef-4aac-b8de-8a62c5994e01"). InnerVolumeSpecName "kube-api-access-bl7fh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.021123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.025635 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "97a26375-24ef-4aac-b8de-8a62c5994e01" (UID: "97a26375-24ef-4aac-b8de-8a62c5994e01"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.100989 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.101043 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bl7fh\" (UniqueName: \"kubernetes.io/projected/97a26375-24ef-4aac-b8de-8a62c5994e01-kube-api-access-bl7fh\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.101062 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/97a26375-24ef-4aac-b8de-8a62c5994e01-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.202325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq7q6\" (UniqueName: \"kubernetes.io/projected/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-kube-api-access-xq7q6\") pod \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.202611 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-utilities\") pod \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.202724 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-catalog-content\") pod \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\" (UID: \"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5\") " Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.204171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-utilities" (OuterVolumeSpecName: "utilities") pod "1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" (UID: "1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.207790 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-kube-api-access-xq7q6" (OuterVolumeSpecName: "kube-api-access-xq7q6") pod "1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" (UID: "1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5"). InnerVolumeSpecName "kube-api-access-xq7q6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.254654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" (UID: "1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.302704 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-8cl2k" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.302638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-8cl2k" event={"ID":"97a26375-24ef-4aac-b8de-8a62c5994e01","Type":"ContainerDied","Data":"fd0fb102bc668e6ee953a9d4cb8b1893eab497b8f68d12104f13c9f1e410ae9b"} Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.302943 4769 scope.go:117] "RemoveContainer" containerID="6b3fb8f26fcfbdffeef4e66d4eb5075e37b6d2202b8568a1bec4035ec346be3d" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.304422 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.304446 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.304458 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xq7q6\" (UniqueName: \"kubernetes.io/projected/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5-kube-api-access-xq7q6\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.304602 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" event={"ID":"42063f6e-62ad-4351-a4dc-a0ee1d1d0276","Type":"ContainerStarted","Data":"0295487d3afcd68444864dcc1aaf067869f6b62028cac0e3b8387cc794f97c82"} Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.310528 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-k2m8f" event={"ID":"1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5","Type":"ContainerDied","Data":"849d20941ed12e3467ed1d7e8dad942271ec1be0a215a3947c4168d95bee9f07"} Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.310842 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-k2m8f" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.339604 4769 scope.go:117] "RemoveContainer" containerID="a08a53f75bb394ba5c24ea45856311071e6c1b59e21743c5cbe404854f83bf9f" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.346925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" podStartSLOduration=1.576112949 podStartE2EDuration="2.346905406s" podCreationTimestamp="2025-11-21 13:34:22 +0000 UTC" firstStartedPulling="2025-11-21 13:34:23.115379361 +0000 UTC m=+6221.816041189" lastFinishedPulling="2025-11-21 13:34:23.886171828 +0000 UTC m=+6222.586833646" observedRunningTime="2025-11-21 13:34:24.339957495 +0000 UTC m=+6223.040619313" watchObservedRunningTime="2025-11-21 13:34:24.346905406 +0000 UTC m=+6223.047567234" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.364110 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-k2m8f"] Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.370991 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-k2m8f"] Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.389128 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-8cl2k"] Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.400210 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-8cl2k"] Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.410484 4769 scope.go:117] "RemoveContainer" containerID="8f11cf50d939ba789e8b61e3198e53831c49d8963486205efce58096982b1f5b" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.436149 4769 scope.go:117] "RemoveContainer" containerID="f039ca07be2954030c4a0f9d7d77387e19bbbb4c707d7c38f9237d535eff7689" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.463412 4769 scope.go:117] "RemoveContainer" containerID="76faf304c5dc76aa7ebb952d57ba25f3c04d256f279d51976fe50745a6f9eb5f" Nov 21 13:34:24 crc kubenswrapper[4769]: I1121 13:34:24.484020 4769 scope.go:117] "RemoveContainer" containerID="5467aafccf7975e72d76502e4e9d2aac5cb0001cb77464ca6516f421ec8e3e9f" Nov 21 13:34:25 crc kubenswrapper[4769]: I1121 13:34:25.293748 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" path="/var/lib/kubelet/pods/1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5/volumes" Nov 21 13:34:25 crc kubenswrapper[4769]: I1121 13:34:25.295720 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" path="/var/lib/kubelet/pods/97a26375-24ef-4aac-b8de-8a62c5994e01/volumes" Nov 21 13:34:26 crc kubenswrapper[4769]: I1121 13:34:26.357090 4769 generic.go:334] "Generic (PLEG): container finished" podID="42063f6e-62ad-4351-a4dc-a0ee1d1d0276" containerID="0295487d3afcd68444864dcc1aaf067869f6b62028cac0e3b8387cc794f97c82" exitCode=0 Nov 21 13:34:26 crc kubenswrapper[4769]: I1121 13:34:26.357246 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" event={"ID":"42063f6e-62ad-4351-a4dc-a0ee1d1d0276","Type":"ContainerDied","Data":"0295487d3afcd68444864dcc1aaf067869f6b62028cac0e3b8387cc794f97c82"} Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.734794 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.881251 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjpnt\" (UniqueName: \"kubernetes.io/projected/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-kube-api-access-pjpnt\") pod \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.881346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-ssh-key\") pod \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.881439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-inventory\") pod \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\" (UID: \"42063f6e-62ad-4351-a4dc-a0ee1d1d0276\") " Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.890398 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-kube-api-access-pjpnt" (OuterVolumeSpecName: "kube-api-access-pjpnt") pod "42063f6e-62ad-4351-a4dc-a0ee1d1d0276" (UID: "42063f6e-62ad-4351-a4dc-a0ee1d1d0276"). InnerVolumeSpecName "kube-api-access-pjpnt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.905334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-inventory" (OuterVolumeSpecName: "inventory") pod "42063f6e-62ad-4351-a4dc-a0ee1d1d0276" (UID: "42063f6e-62ad-4351-a4dc-a0ee1d1d0276"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.913039 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "42063f6e-62ad-4351-a4dc-a0ee1d1d0276" (UID: "42063f6e-62ad-4351-a4dc-a0ee1d1d0276"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.983030 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pjpnt\" (UniqueName: \"kubernetes.io/projected/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-kube-api-access-pjpnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.983066 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:27 crc kubenswrapper[4769]: I1121 13:34:27.983079 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/42063f6e-62ad-4351-a4dc-a0ee1d1d0276-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.384785 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" event={"ID":"42063f6e-62ad-4351-a4dc-a0ee1d1d0276","Type":"ContainerDied","Data":"8f3dd833145ecf0502cb297ba8298db34712be867fa4645378e196d9c63a1b6b"} Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.384828 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.384850 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f3dd833145ecf0502cb297ba8298db34712be867fa4645378e196d9c63a1b6b" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.454323 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6"] Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.455075 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="registry-server" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.455344 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="registry-server" Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.455452 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="extract-utilities" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.455525 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="extract-utilities" Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.455598 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="extract-utilities" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.455664 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="extract-utilities" Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.455752 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="extract-content" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.455821 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="extract-content" Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.455916 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="extract-content" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.455983 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="extract-content" Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.456060 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="registry-server" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.456147 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="registry-server" Nov 21 13:34:28 crc kubenswrapper[4769]: E1121 13:34:28.456278 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42063f6e-62ad-4351-a4dc-a0ee1d1d0276" containerName="install-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.456364 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42063f6e-62ad-4351-a4dc-a0ee1d1d0276" containerName="install-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.456603 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42063f6e-62ad-4351-a4dc-a0ee1d1d0276" containerName="install-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.456718 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1a3611fe-bffd-43ba-a2e1-2ddb728c3eb5" containerName="registry-server" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.456812 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="97a26375-24ef-4aac-b8de-8a62c5994e01" containerName="registry-server" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.457502 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.462729 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.463108 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.463632 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.463676 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.472593 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6"] Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.595502 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-ssh-key\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.595684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-inventory\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.595778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbrs\" (UniqueName: \"kubernetes.io/projected/e73d17aa-0777-4de8-8b1c-7a75fad85b38-kube-api-access-zgbrs\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.696823 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbrs\" (UniqueName: \"kubernetes.io/projected/e73d17aa-0777-4de8-8b1c-7a75fad85b38-kube-api-access-zgbrs\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.696888 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-ssh-key\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.696949 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-inventory\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.701837 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-inventory\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.706052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-ssh-key\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.727011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbrs\" (UniqueName: \"kubernetes.io/projected/e73d17aa-0777-4de8-8b1c-7a75fad85b38-kube-api-access-zgbrs\") pod \"configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:28 crc kubenswrapper[4769]: I1121 13:34:28.778717 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:29 crc kubenswrapper[4769]: I1121 13:34:29.259176 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6"] Nov 21 13:34:29 crc kubenswrapper[4769]: W1121 13:34:29.273805 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode73d17aa_0777_4de8_8b1c_7a75fad85b38.slice/crio-a5bced913301831a8dd519c50cacbd44ff842c2dcef5eb2d81b3d93deb55dd21 WatchSource:0}: Error finding container a5bced913301831a8dd519c50cacbd44ff842c2dcef5eb2d81b3d93deb55dd21: Status 404 returned error can't find the container with id a5bced913301831a8dd519c50cacbd44ff842c2dcef5eb2d81b3d93deb55dd21 Nov 21 13:34:29 crc kubenswrapper[4769]: I1121 13:34:29.399484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" event={"ID":"e73d17aa-0777-4de8-8b1c-7a75fad85b38","Type":"ContainerStarted","Data":"a5bced913301831a8dd519c50cacbd44ff842c2dcef5eb2d81b3d93deb55dd21"} Nov 21 13:34:31 crc kubenswrapper[4769]: I1121 13:34:31.419250 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" event={"ID":"e73d17aa-0777-4de8-8b1c-7a75fad85b38","Type":"ContainerStarted","Data":"cdd41564930861c6ee7d88ca5a32c4bf6f6b01e88c0f1da07f8c8213a5035095"} Nov 21 13:34:31 crc kubenswrapper[4769]: I1121 13:34:31.448023 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" podStartSLOduration=1.72081282 podStartE2EDuration="3.447998886s" podCreationTimestamp="2025-11-21 13:34:28 +0000 UTC" firstStartedPulling="2025-11-21 13:34:29.276984043 +0000 UTC m=+6227.977645861" lastFinishedPulling="2025-11-21 13:34:31.004170089 +0000 UTC m=+6229.704831927" observedRunningTime="2025-11-21 13:34:31.438442186 +0000 UTC m=+6230.139104014" watchObservedRunningTime="2025-11-21 13:34:31.447998886 +0000 UTC m=+6230.148660704" Nov 21 13:34:33 crc kubenswrapper[4769]: I1121 13:34:33.443805 4769 generic.go:334] "Generic (PLEG): container finished" podID="e73d17aa-0777-4de8-8b1c-7a75fad85b38" containerID="cdd41564930861c6ee7d88ca5a32c4bf6f6b01e88c0f1da07f8c8213a5035095" exitCode=0 Nov 21 13:34:33 crc kubenswrapper[4769]: I1121 13:34:33.443863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" event={"ID":"e73d17aa-0777-4de8-8b1c-7a75fad85b38","Type":"ContainerDied","Data":"cdd41564930861c6ee7d88ca5a32c4bf6f6b01e88c0f1da07f8c8213a5035095"} Nov 21 13:34:34 crc kubenswrapper[4769]: I1121 13:34:34.856567 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.009425 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgbrs\" (UniqueName: \"kubernetes.io/projected/e73d17aa-0777-4de8-8b1c-7a75fad85b38-kube-api-access-zgbrs\") pod \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.009675 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-ssh-key\") pod \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.009752 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-inventory\") pod \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\" (UID: \"e73d17aa-0777-4de8-8b1c-7a75fad85b38\") " Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.017799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73d17aa-0777-4de8-8b1c-7a75fad85b38-kube-api-access-zgbrs" (OuterVolumeSpecName: "kube-api-access-zgbrs") pod "e73d17aa-0777-4de8-8b1c-7a75fad85b38" (UID: "e73d17aa-0777-4de8-8b1c-7a75fad85b38"). InnerVolumeSpecName "kube-api-access-zgbrs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.048588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "e73d17aa-0777-4de8-8b1c-7a75fad85b38" (UID: "e73d17aa-0777-4de8-8b1c-7a75fad85b38"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.054222 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-inventory" (OuterVolumeSpecName: "inventory") pod "e73d17aa-0777-4de8-8b1c-7a75fad85b38" (UID: "e73d17aa-0777-4de8-8b1c-7a75fad85b38"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.111744 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.111792 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e73d17aa-0777-4de8-8b1c-7a75fad85b38-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.111815 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zgbrs\" (UniqueName: \"kubernetes.io/projected/e73d17aa-0777-4de8-8b1c-7a75fad85b38-kube-api-access-zgbrs\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.469990 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" event={"ID":"e73d17aa-0777-4de8-8b1c-7a75fad85b38","Type":"ContainerDied","Data":"a5bced913301831a8dd519c50cacbd44ff842c2dcef5eb2d81b3d93deb55dd21"} Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.470069 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5bced913301831a8dd519c50cacbd44ff842c2dcef5eb2d81b3d93deb55dd21" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.470090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.565340 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g"] Nov 21 13:34:35 crc kubenswrapper[4769]: E1121 13:34:35.566141 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e73d17aa-0777-4de8-8b1c-7a75fad85b38" containerName="configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.566198 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73d17aa-0777-4de8-8b1c-7a75fad85b38" containerName="configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.566610 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e73d17aa-0777-4de8-8b1c-7a75fad85b38" containerName="configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.567312 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.567823 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g"] Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.569490 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.569733 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.569771 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.569920 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.719355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.719413 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-inventory\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.719442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/27f9243c-2953-47d9-90af-d021bd580c62-kube-api-access-j5pg6\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.821565 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.821657 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-inventory\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.821689 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/27f9243c-2953-47d9-90af-d021bd580c62-kube-api-access-j5pg6\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.827178 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-inventory\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.828160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.841462 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/27f9243c-2953-47d9-90af-d021bd580c62-kube-api-access-j5pg6\") pod \"run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:35 crc kubenswrapper[4769]: I1121 13:34:35.896361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:36 crc kubenswrapper[4769]: I1121 13:34:36.362980 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g"] Nov 21 13:34:36 crc kubenswrapper[4769]: I1121 13:34:36.482374 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" event={"ID":"27f9243c-2953-47d9-90af-d021bd580c62","Type":"ContainerStarted","Data":"30aa58a03c2abbe211708399d62b93790cf1bb49cab416b77786fb21ac31d7fa"} Nov 21 13:34:37 crc kubenswrapper[4769]: I1121 13:34:37.493166 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" event={"ID":"27f9243c-2953-47d9-90af-d021bd580c62","Type":"ContainerStarted","Data":"80b03031f1307e6aa38e5307e8ba386fdb084f5b9a8f6b642dbe0979b47c8a3b"} Nov 21 13:34:37 crc kubenswrapper[4769]: I1121 13:34:37.508226 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" podStartSLOduration=2.086862126 podStartE2EDuration="2.508162964s" podCreationTimestamp="2025-11-21 13:34:35 +0000 UTC" firstStartedPulling="2025-11-21 13:34:36.365735949 +0000 UTC m=+6235.066397807" lastFinishedPulling="2025-11-21 13:34:36.787036797 +0000 UTC m=+6235.487698645" observedRunningTime="2025-11-21 13:34:37.504433056 +0000 UTC m=+6236.205094904" watchObservedRunningTime="2025-11-21 13:34:37.508162964 +0000 UTC m=+6236.208824792" Nov 21 13:34:38 crc kubenswrapper[4769]: I1121 13:34:38.503836 4769 generic.go:334] "Generic (PLEG): container finished" podID="27f9243c-2953-47d9-90af-d021bd580c62" containerID="80b03031f1307e6aa38e5307e8ba386fdb084f5b9a8f6b642dbe0979b47c8a3b" exitCode=0 Nov 21 13:34:38 crc kubenswrapper[4769]: I1121 13:34:38.503992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" event={"ID":"27f9243c-2953-47d9-90af-d021bd580c62","Type":"ContainerDied","Data":"80b03031f1307e6aa38e5307e8ba386fdb084f5b9a8f6b642dbe0979b47c8a3b"} Nov 21 13:34:39 crc kubenswrapper[4769]: I1121 13:34:39.795977 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:39 crc kubenswrapper[4769]: I1121 13:34:39.997105 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-inventory\") pod \"27f9243c-2953-47d9-90af-d021bd580c62\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " Nov 21 13:34:39 crc kubenswrapper[4769]: I1121 13:34:39.997430 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key\") pod \"27f9243c-2953-47d9-90af-d021bd580c62\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " Nov 21 13:34:39 crc kubenswrapper[4769]: I1121 13:34:39.997473 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/27f9243c-2953-47d9-90af-d021bd580c62-kube-api-access-j5pg6\") pod \"27f9243c-2953-47d9-90af-d021bd580c62\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.002292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f9243c-2953-47d9-90af-d021bd580c62-kube-api-access-j5pg6" (OuterVolumeSpecName: "kube-api-access-j5pg6") pod "27f9243c-2953-47d9-90af-d021bd580c62" (UID: "27f9243c-2953-47d9-90af-d021bd580c62"). InnerVolumeSpecName "kube-api-access-j5pg6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:40 crc kubenswrapper[4769]: E1121 13:34:40.015167 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key podName:27f9243c-2953-47d9-90af-d021bd580c62 nodeName:}" failed. No retries permitted until 2025-11-21 13:34:40.515138684 +0000 UTC m=+6239.215800512 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "ssh-key" (UniqueName: "kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key") pod "27f9243c-2953-47d9-90af-d021bd580c62" (UID: "27f9243c-2953-47d9-90af-d021bd580c62") : error deleting /var/lib/kubelet/pods/27f9243c-2953-47d9-90af-d021bd580c62/volume-subpaths: remove /var/lib/kubelet/pods/27f9243c-2953-47d9-90af-d021bd580c62/volume-subpaths: no such file or directory Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.017751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-inventory" (OuterVolumeSpecName: "inventory") pod "27f9243c-2953-47d9-90af-d021bd580c62" (UID: "27f9243c-2953-47d9-90af-d021bd580c62"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.099052 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.099097 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j5pg6\" (UniqueName: \"kubernetes.io/projected/27f9243c-2953-47d9-90af-d021bd580c62-kube-api-access-j5pg6\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.539143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" event={"ID":"27f9243c-2953-47d9-90af-d021bd580c62","Type":"ContainerDied","Data":"30aa58a03c2abbe211708399d62b93790cf1bb49cab416b77786fb21ac31d7fa"} Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.539280 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30aa58a03c2abbe211708399d62b93790cf1bb49cab416b77786fb21ac31d7fa" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.539532 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.595686 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl"] Nov 21 13:34:40 crc kubenswrapper[4769]: E1121 13:34:40.596037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="27f9243c-2953-47d9-90af-d021bd580c62" containerName="run-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.596059 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f9243c-2953-47d9-90af-d021bd580c62" containerName="run-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.596287 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="27f9243c-2953-47d9-90af-d021bd580c62" containerName="run-os-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.596863 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.599075 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key\") pod \"27f9243c-2953-47d9-90af-d021bd580c62\" (UID: \"27f9243c-2953-47d9-90af-d021bd580c62\") " Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608708 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-inventory\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608899 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.608984 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.609033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.609052 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ssh-key\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.609076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clx6d\" (UniqueName: \"kubernetes.io/projected/b548e734-e01e-4342-abef-731c6b4ebb0e-kube-api-access-clx6d\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.609445 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl"] Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.647514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "27f9243c-2953-47d9-90af-d021bd580c62" (UID: "27f9243c-2953-47d9-90af-d021bd580c62"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710395 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710422 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710473 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710491 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710511 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710655 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710750 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710773 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ssh-key\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710849 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-clx6d\" (UniqueName: \"kubernetes.io/projected/b548e734-e01e-4342-abef-731c6b4ebb0e-kube-api-access-clx6d\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.710884 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-inventory\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.711100 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/27f9243c-2953-47d9-90af-d021bd580c62-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.715694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-nova-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.715715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.716116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.716708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-inventory\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.716859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.717984 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ssh-key\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.718014 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.720405 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.720624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.720783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.730631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-clx6d\" (UniqueName: \"kubernetes.io/projected/b548e734-e01e-4342-abef-731c6b4ebb0e-kube-api-access-clx6d\") pod \"install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:40 crc kubenswrapper[4769]: I1121 13:34:40.985605 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:41 crc kubenswrapper[4769]: I1121 13:34:41.461884 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl"] Nov 21 13:34:41 crc kubenswrapper[4769]: W1121 13:34:41.469536 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb548e734_e01e_4342_abef_731c6b4ebb0e.slice/crio-157e57724f6fcb283147537b0943ea422e77eaca0f688524d1ba22c850e34c71 WatchSource:0}: Error finding container 157e57724f6fcb283147537b0943ea422e77eaca0f688524d1ba22c850e34c71: Status 404 returned error can't find the container with id 157e57724f6fcb283147537b0943ea422e77eaca0f688524d1ba22c850e34c71 Nov 21 13:34:41 crc kubenswrapper[4769]: I1121 13:34:41.553521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" event={"ID":"b548e734-e01e-4342-abef-731c6b4ebb0e","Type":"ContainerStarted","Data":"157e57724f6fcb283147537b0943ea422e77eaca0f688524d1ba22c850e34c71"} Nov 21 13:34:43 crc kubenswrapper[4769]: I1121 13:34:43.576536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" event={"ID":"b548e734-e01e-4342-abef-731c6b4ebb0e","Type":"ContainerStarted","Data":"74f36a2dd3cc93a09f85b10c9c6eb8d43497df9458c099ec1f5ed7266d3ac61a"} Nov 21 13:34:43 crc kubenswrapper[4769]: I1121 13:34:43.596828 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" podStartSLOduration=2.710799088 podStartE2EDuration="3.596800338s" podCreationTimestamp="2025-11-21 13:34:40 +0000 UTC" firstStartedPulling="2025-11-21 13:34:41.473279825 +0000 UTC m=+6240.173941683" lastFinishedPulling="2025-11-21 13:34:42.359281105 +0000 UTC m=+6241.059942933" observedRunningTime="2025-11-21 13:34:43.596347686 +0000 UTC m=+6242.297009504" watchObservedRunningTime="2025-11-21 13:34:43.596800338 +0000 UTC m=+6242.297462166" Nov 21 13:34:44 crc kubenswrapper[4769]: I1121 13:34:44.586161 4769 generic.go:334] "Generic (PLEG): container finished" podID="b548e734-e01e-4342-abef-731c6b4ebb0e" containerID="74f36a2dd3cc93a09f85b10c9c6eb8d43497df9458c099ec1f5ed7266d3ac61a" exitCode=0 Nov 21 13:34:44 crc kubenswrapper[4769]: I1121 13:34:44.586238 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" event={"ID":"b548e734-e01e-4342-abef-731c6b4ebb0e","Type":"ContainerDied","Data":"74f36a2dd3cc93a09f85b10c9c6eb8d43497df9458c099ec1f5ed7266d3ac61a"} Nov 21 13:34:45 crc kubenswrapper[4769]: I1121 13:34:45.861736 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001088 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-ovn-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001269 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-bootstrap-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001355 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-metadata-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clx6d\" (UniqueName: \"kubernetes.io/projected/b548e734-e01e-4342-abef-731c6b4ebb0e-kube-api-access-clx6d\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-nova-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ssh-key\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001546 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-dhcp-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001582 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-sriov-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001618 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-libvirt-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001707 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-inventory\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.001755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ovn-combined-ca-bundle\") pod \"b548e734-e01e-4342-abef-731c6b4ebb0e\" (UID: \"b548e734-e01e-4342-abef-731c6b4ebb0e\") " Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.008739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.008789 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b548e734-e01e-4342-abef-731c6b4ebb0e-kube-api-access-clx6d" (OuterVolumeSpecName: "kube-api-access-clx6d") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "kube-api-access-clx6d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.009291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.010348 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.010859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.010922 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.010943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.014024 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.016548 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.033537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.037514 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-inventory" (OuterVolumeSpecName: "inventory") pod "b548e734-e01e-4342-abef-731c6b4ebb0e" (UID: "b548e734-e01e-4342-abef-731c6b4ebb0e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103429 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103465 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103485 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103497 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103512 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103529 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-clx6d\" (UniqueName: \"kubernetes.io/projected/b548e734-e01e-4342-abef-731c6b4ebb0e-kube-api-access-clx6d\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103543 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103554 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103564 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103577 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.103596 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b548e734-e01e-4342-abef-731c6b4ebb0e-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.383929 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc"] Nov 21 13:34:46 crc kubenswrapper[4769]: E1121 13:34:46.384256 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b548e734-e01e-4342-abef-731c6b4ebb0e" containerName="install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.384270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b548e734-e01e-4342-abef-731c6b4ebb0e" containerName="install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.384413 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b548e734-e01e-4342-abef-731c6b4ebb0e" containerName="install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.384872 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.388363 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-config" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.399374 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc"] Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.508944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.509397 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ssh-key\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.509453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ssn9\" (UniqueName: \"kubernetes.io/projected/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-kube-api-access-8ssn9\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.509479 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-inventory\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.509529 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.605232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" event={"ID":"b548e734-e01e-4342-abef-731c6b4ebb0e","Type":"ContainerDied","Data":"157e57724f6fcb283147537b0943ea422e77eaca0f688524d1ba22c850e34c71"} Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.605276 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.605303 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="157e57724f6fcb283147537b0943ea422e77eaca0f688524d1ba22c850e34c71" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.611846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.611895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ssh-key\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.611944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8ssn9\" (UniqueName: \"kubernetes.io/projected/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-kube-api-access-8ssn9\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.611977 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-inventory\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.612027 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.613348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.616142 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-inventory\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.617151 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ssh-key\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.630714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.635072 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ssn9\" (UniqueName: \"kubernetes.io/projected/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-kube-api-access-8ssn9\") pod \"ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:46 crc kubenswrapper[4769]: I1121 13:34:46.699960 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:47 crc kubenswrapper[4769]: I1121 13:34:47.211400 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc"] Nov 21 13:34:47 crc kubenswrapper[4769]: I1121 13:34:47.618160 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" event={"ID":"594e01a6-ef67-4f73-b6a3-bb7946c6d33e","Type":"ContainerStarted","Data":"d6aa974f69a16408b3af5918582babda8181670f478e666306ee0f2f85eac5a4"} Nov 21 13:34:49 crc kubenswrapper[4769]: I1121 13:34:49.642024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" event={"ID":"594e01a6-ef67-4f73-b6a3-bb7946c6d33e","Type":"ContainerStarted","Data":"db2085a5e7312569502469e1e7fed8685bc98c0a740ea3932c17fa053bcdfa97"} Nov 21 13:34:49 crc kubenswrapper[4769]: I1121 13:34:49.672185 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" podStartSLOduration=2.582599956 podStartE2EDuration="3.672155822s" podCreationTimestamp="2025-11-21 13:34:46 +0000 UTC" firstStartedPulling="2025-11-21 13:34:47.222520421 +0000 UTC m=+6245.923182279" lastFinishedPulling="2025-11-21 13:34:48.312076297 +0000 UTC m=+6247.012738145" observedRunningTime="2025-11-21 13:34:49.66388342 +0000 UTC m=+6248.364545308" watchObservedRunningTime="2025-11-21 13:34:49.672155822 +0000 UTC m=+6248.372817680" Nov 21 13:34:50 crc kubenswrapper[4769]: I1121 13:34:50.659098 4769 generic.go:334] "Generic (PLEG): container finished" podID="594e01a6-ef67-4f73-b6a3-bb7946c6d33e" containerID="db2085a5e7312569502469e1e7fed8685bc98c0a740ea3932c17fa053bcdfa97" exitCode=0 Nov 21 13:34:50 crc kubenswrapper[4769]: I1121 13:34:50.659266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" event={"ID":"594e01a6-ef67-4f73-b6a3-bb7946c6d33e","Type":"ContainerDied","Data":"db2085a5e7312569502469e1e7fed8685bc98c0a740ea3932c17fa053bcdfa97"} Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.006100 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.120791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ssh-key\") pod \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.120883 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovncontroller-config-0\") pod \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.120934 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ssn9\" (UniqueName: \"kubernetes.io/projected/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-kube-api-access-8ssn9\") pod \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.120985 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-inventory\") pod \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.121053 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovn-combined-ca-bundle\") pod \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\" (UID: \"594e01a6-ef67-4f73-b6a3-bb7946c6d33e\") " Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.127489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "594e01a6-ef67-4f73-b6a3-bb7946c6d33e" (UID: "594e01a6-ef67-4f73-b6a3-bb7946c6d33e"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.127878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-kube-api-access-8ssn9" (OuterVolumeSpecName: "kube-api-access-8ssn9") pod "594e01a6-ef67-4f73-b6a3-bb7946c6d33e" (UID: "594e01a6-ef67-4f73-b6a3-bb7946c6d33e"). InnerVolumeSpecName "kube-api-access-8ssn9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.151148 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-inventory" (OuterVolumeSpecName: "inventory") pod "594e01a6-ef67-4f73-b6a3-bb7946c6d33e" (UID: "594e01a6-ef67-4f73-b6a3-bb7946c6d33e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.153366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "594e01a6-ef67-4f73-b6a3-bb7946c6d33e" (UID: "594e01a6-ef67-4f73-b6a3-bb7946c6d33e"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.169153 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "594e01a6-ef67-4f73-b6a3-bb7946c6d33e" (UID: "594e01a6-ef67-4f73-b6a3-bb7946c6d33e"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.223076 4769 reconciler_common.go:293] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.223140 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8ssn9\" (UniqueName: \"kubernetes.io/projected/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-kube-api-access-8ssn9\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.223156 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.223169 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.223182 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/594e01a6-ef67-4f73-b6a3-bb7946c6d33e-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.700357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" event={"ID":"594e01a6-ef67-4f73-b6a3-bb7946c6d33e","Type":"ContainerDied","Data":"d6aa974f69a16408b3af5918582babda8181670f478e666306ee0f2f85eac5a4"} Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.700423 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6aa974f69a16408b3af5918582babda8181670f478e666306ee0f2f85eac5a4" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.700461 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.768453 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2"] Nov 21 13:34:52 crc kubenswrapper[4769]: E1121 13:34:52.768896 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="594e01a6-ef67-4f73-b6a3-bb7946c6d33e" containerName="ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.768929 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="594e01a6-ef67-4f73-b6a3-bb7946c6d33e" containerName="ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.769299 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="594e01a6-ef67-4f73-b6a3-bb7946c6d33e" containerName="ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.770075 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.772666 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-metadata-agent-neutron-config" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.773117 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.773816 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-neutron-config" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.774116 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.774424 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.774512 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.777893 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.814320 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2"] Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.935803 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.935881 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.936171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfr5x\" (UniqueName: \"kubernetes.io/projected/e36be714-7f95-44a9-843a-6eb0344667c4-kube-api-access-jfr5x\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.936471 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-ssh-key\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.936597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.936731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-inventory\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.936895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:52 crc kubenswrapper[4769]: I1121 13:34:52.936983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-ssh-key\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038096 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-inventory\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038125 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038150 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038183 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038233 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.038270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jfr5x\" (UniqueName: \"kubernetes.io/projected/e36be714-7f95-44a9-843a-6eb0344667c4-kube-api-access-jfr5x\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.042164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.042235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.044714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.044820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.045262 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-ssh-key\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.045627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.047067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-inventory\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.057269 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfr5x\" (UniqueName: \"kubernetes.io/projected/e36be714-7f95-44a9-843a-6eb0344667c4-kube-api-access-jfr5x\") pod \"neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.100221 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.465919 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2"] Nov 21 13:34:53 crc kubenswrapper[4769]: W1121 13:34:53.479907 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode36be714_7f95_44a9_843a_6eb0344667c4.slice/crio-20fb1d9e225844c9733464427ec53949491cec7dbacf996bfda8852162df0ab2 WatchSource:0}: Error finding container 20fb1d9e225844c9733464427ec53949491cec7dbacf996bfda8852162df0ab2: Status 404 returned error can't find the container with id 20fb1d9e225844c9733464427ec53949491cec7dbacf996bfda8852162df0ab2 Nov 21 13:34:53 crc kubenswrapper[4769]: I1121 13:34:53.714997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" event={"ID":"e36be714-7f95-44a9-843a-6eb0344667c4","Type":"ContainerStarted","Data":"20fb1d9e225844c9733464427ec53949491cec7dbacf996bfda8852162df0ab2"} Nov 21 13:34:54 crc kubenswrapper[4769]: I1121 13:34:54.728676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" event={"ID":"e36be714-7f95-44a9-843a-6eb0344667c4","Type":"ContainerStarted","Data":"cf431704a11fe3b46df30895da35980007d277d674e8045ed6790c9b70205235"} Nov 21 13:34:54 crc kubenswrapper[4769]: I1121 13:34:54.755963 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" podStartSLOduration=2.342965595 podStartE2EDuration="2.755937378s" podCreationTimestamp="2025-11-21 13:34:52 +0000 UTC" firstStartedPulling="2025-11-21 13:34:53.483037939 +0000 UTC m=+6252.183699767" lastFinishedPulling="2025-11-21 13:34:53.896009692 +0000 UTC m=+6252.596671550" observedRunningTime="2025-11-21 13:34:54.753752829 +0000 UTC m=+6253.454414697" watchObservedRunningTime="2025-11-21 13:34:54.755937378 +0000 UTC m=+6253.456599226" Nov 21 13:34:55 crc kubenswrapper[4769]: I1121 13:34:55.955847 4769 generic.go:334] "Generic (PLEG): container finished" podID="e36be714-7f95-44a9-843a-6eb0344667c4" containerID="cf431704a11fe3b46df30895da35980007d277d674e8045ed6790c9b70205235" exitCode=0 Nov 21 13:34:55 crc kubenswrapper[4769]: I1121 13:34:55.956372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" event={"ID":"e36be714-7f95-44a9-843a-6eb0344667c4","Type":"ContainerDied","Data":"cf431704a11fe3b46df30895da35980007d277d674e8045ed6790c9b70205235"} Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.274130 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.455710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-metadata-combined-ca-bundle\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-0\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456044 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-ssh-key\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-1\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfr5x\" (UniqueName: \"kubernetes.io/projected/e36be714-7f95-44a9-843a-6eb0344667c4-kube-api-access-jfr5x\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456160 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-inventory\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-2\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.456213 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-ovn-metadata-agent-neutron-config-0\") pod \"e36be714-7f95-44a9-843a-6eb0344667c4\" (UID: \"e36be714-7f95-44a9-843a-6eb0344667c4\") " Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.462550 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.463280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36be714-7f95-44a9-843a-6eb0344667c4-kube-api-access-jfr5x" (OuterVolumeSpecName: "kube-api-access-jfr5x") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "kube-api-access-jfr5x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.480243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.484076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.485465 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.495527 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-inventory" (OuterVolumeSpecName: "inventory") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.500032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.500788 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "e36be714-7f95-44a9-843a-6eb0344667c4" (UID: "e36be714-7f95-44a9-843a-6eb0344667c4"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557520 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557550 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jfr5x\" (UniqueName: \"kubernetes.io/projected/e36be714-7f95-44a9-843a-6eb0344667c4-kube-api-access-jfr5x\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557564 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557574 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557585 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557594 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557603 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.557612 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/e36be714-7f95-44a9-843a-6eb0344667c4-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.992663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" event={"ID":"e36be714-7f95-44a9-843a-6eb0344667c4","Type":"ContainerDied","Data":"20fb1d9e225844c9733464427ec53949491cec7dbacf996bfda8852162df0ab2"} Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.992728 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20fb1d9e225844c9733464427ec53949491cec7dbacf996bfda8852162df0ab2" Nov 21 13:34:57 crc kubenswrapper[4769]: I1121 13:34:57.992791 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.024517 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk"] Nov 21 13:34:58 crc kubenswrapper[4769]: E1121 13:34:58.024839 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e36be714-7f95-44a9-843a-6eb0344667c4" containerName="neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.024857 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36be714-7f95-44a9-843a-6eb0344667c4" containerName="neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.025001 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e36be714-7f95-44a9-843a-6eb0344667c4" containerName="neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.025543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.027321 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.028586 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.028626 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.028596 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.028788 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.028925 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-agent-neutron-config" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.045869 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk"] Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.164271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-ssh-key\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.164746 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-inventory\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.164864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.164978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.165092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvngk\" (UniqueName: \"kubernetes.io/projected/1fcfa8fa-70d5-4ef3-9327-29e08b175999-kube-api-access-jvngk\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.267074 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-ssh-key\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.267221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-inventory\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.267279 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.267376 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.267444 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jvngk\" (UniqueName: \"kubernetes.io/projected/1fcfa8fa-70d5-4ef3-9327-29e08b175999-kube-api-access-jvngk\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.271794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-ssh-key\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.273325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.276928 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-inventory\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.278314 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.286158 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvngk\" (UniqueName: \"kubernetes.io/projected/1fcfa8fa-70d5-4ef3-9327-29e08b175999-kube-api-access-jvngk\") pod \"neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.349964 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:34:58 crc kubenswrapper[4769]: I1121 13:34:58.641740 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk"] Nov 21 13:34:58 crc kubenswrapper[4769]: W1121 13:34:58.652600 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fcfa8fa_70d5_4ef3_9327_29e08b175999.slice/crio-041a42446edefcb880e591cbc5552870dd5c69461d6e6b04051059a76af03f12 WatchSource:0}: Error finding container 041a42446edefcb880e591cbc5552870dd5c69461d6e6b04051059a76af03f12: Status 404 returned error can't find the container with id 041a42446edefcb880e591cbc5552870dd5c69461d6e6b04051059a76af03f12 Nov 21 13:34:59 crc kubenswrapper[4769]: I1121 13:34:59.003026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" event={"ID":"1fcfa8fa-70d5-4ef3-9327-29e08b175999","Type":"ContainerStarted","Data":"041a42446edefcb880e591cbc5552870dd5c69461d6e6b04051059a76af03f12"} Nov 21 13:35:00 crc kubenswrapper[4769]: I1121 13:35:00.043904 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" event={"ID":"1fcfa8fa-70d5-4ef3-9327-29e08b175999","Type":"ContainerStarted","Data":"c66a0e99103e11864edfe9c67cdc915ecd473e4785cd8323c17033ce63764e8b"} Nov 21 13:35:00 crc kubenswrapper[4769]: I1121 13:35:00.075102 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" podStartSLOduration=2.453657801 podStartE2EDuration="3.075066978s" podCreationTimestamp="2025-11-21 13:34:57 +0000 UTC" firstStartedPulling="2025-11-21 13:34:58.654553684 +0000 UTC m=+6257.355215512" lastFinishedPulling="2025-11-21 13:34:59.275962841 +0000 UTC m=+6257.976624689" observedRunningTime="2025-11-21 13:35:00.072220492 +0000 UTC m=+6258.772882360" watchObservedRunningTime="2025-11-21 13:35:00.075066978 +0000 UTC m=+6258.775728846" Nov 21 13:35:01 crc kubenswrapper[4769]: I1121 13:35:01.056975 4769 generic.go:334] "Generic (PLEG): container finished" podID="1fcfa8fa-70d5-4ef3-9327-29e08b175999" containerID="c66a0e99103e11864edfe9c67cdc915ecd473e4785cd8323c17033ce63764e8b" exitCode=0 Nov 21 13:35:01 crc kubenswrapper[4769]: I1121 13:35:01.057040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" event={"ID":"1fcfa8fa-70d5-4ef3-9327-29e08b175999","Type":"ContainerDied","Data":"c66a0e99103e11864edfe9c67cdc915ecd473e4785cd8323c17033ce63764e8b"} Nov 21 13:35:01 crc kubenswrapper[4769]: I1121 13:35:01.800872 4769 scope.go:117] "RemoveContainer" containerID="13e51de4ffd038089fdfc7207028ed9bcb7f3f7071e60c382ca4448b04e6d86c" Nov 21 13:35:01 crc kubenswrapper[4769]: I1121 13:35:01.834668 4769 scope.go:117] "RemoveContainer" containerID="eb41c6cdf5a0472a7319895ab05cd6f0504174447df1eebe5547b6d76cb2ed33" Nov 21 13:35:01 crc kubenswrapper[4769]: I1121 13:35:01.882697 4769 scope.go:117] "RemoveContainer" containerID="332caff11cee0039f7000ddb6823664f18e0c32e29e1a58f50ac5b42e7b6fcc6" Nov 21 13:35:01 crc kubenswrapper[4769]: I1121 13:35:01.911408 4769 scope.go:117] "RemoveContainer" containerID="1e8f7931bdb97b2d9a0cff88a43149952d632581847e8f1f0067d714d9e6b454" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.364137 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.472508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-combined-ca-bundle\") pod \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.472676 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvngk\" (UniqueName: \"kubernetes.io/projected/1fcfa8fa-70d5-4ef3-9327-29e08b175999-kube-api-access-jvngk\") pod \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.472728 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-ssh-key\") pod \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.472751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-inventory\") pod \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.472805 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-agent-neutron-config-0\") pod \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\" (UID: \"1fcfa8fa-70d5-4ef3-9327-29e08b175999\") " Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.477814 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fcfa8fa-70d5-4ef3-9327-29e08b175999-kube-api-access-jvngk" (OuterVolumeSpecName: "kube-api-access-jvngk") pod "1fcfa8fa-70d5-4ef3-9327-29e08b175999" (UID: "1fcfa8fa-70d5-4ef3-9327-29e08b175999"). InnerVolumeSpecName "kube-api-access-jvngk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.478380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "1fcfa8fa-70d5-4ef3-9327-29e08b175999" (UID: "1fcfa8fa-70d5-4ef3-9327-29e08b175999"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.498252 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "1fcfa8fa-70d5-4ef3-9327-29e08b175999" (UID: "1fcfa8fa-70d5-4ef3-9327-29e08b175999"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.507792 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "1fcfa8fa-70d5-4ef3-9327-29e08b175999" (UID: "1fcfa8fa-70d5-4ef3-9327-29e08b175999"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.509705 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-inventory" (OuterVolumeSpecName: "inventory") pod "1fcfa8fa-70d5-4ef3-9327-29e08b175999" (UID: "1fcfa8fa-70d5-4ef3-9327-29e08b175999"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.574396 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jvngk\" (UniqueName: \"kubernetes.io/projected/1fcfa8fa-70d5-4ef3-9327-29e08b175999-kube-api-access-jvngk\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.574431 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.574442 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.574451 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:02 crc kubenswrapper[4769]: I1121 13:35:02.574461 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fcfa8fa-70d5-4ef3-9327-29e08b175999-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.078941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" event={"ID":"1fcfa8fa-70d5-4ef3-9327-29e08b175999","Type":"ContainerDied","Data":"041a42446edefcb880e591cbc5552870dd5c69461d6e6b04051059a76af03f12"} Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.078977 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="041a42446edefcb880e591cbc5552870dd5c69461d6e6b04051059a76af03f12" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.079045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.161607 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm"] Nov 21 13:35:03 crc kubenswrapper[4769]: E1121 13:35:03.162927 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1fcfa8fa-70d5-4ef3-9327-29e08b175999" containerName="neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.162965 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fcfa8fa-70d5-4ef3-9327-29e08b175999" containerName="neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.163474 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1fcfa8fa-70d5-4ef3-9327-29e08b175999" containerName="neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.164138 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.167120 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.167353 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.167503 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.167728 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.167907 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.168010 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-sriov-agent-neutron-config" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.170956 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm"] Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.286636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-inventory\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.287007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkg2c\" (UniqueName: \"kubernetes.io/projected/729de42c-9efd-4c8e-a003-f48955e9cde2-kube-api-access-zkg2c\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.287253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.287357 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-ssh-key\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.287402 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.388765 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-inventory\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.388817 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zkg2c\" (UniqueName: \"kubernetes.io/projected/729de42c-9efd-4c8e-a003-f48955e9cde2-kube-api-access-zkg2c\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.388891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.388945 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-ssh-key\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.388978 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.392744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.393183 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-inventory\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.395789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-ssh-key\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.397458 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.415901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkg2c\" (UniqueName: \"kubernetes.io/projected/729de42c-9efd-4c8e-a003-f48955e9cde2-kube-api-access-zkg2c\") pod \"neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.494406 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:03 crc kubenswrapper[4769]: I1121 13:35:03.938868 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm"] Nov 21 13:35:04 crc kubenswrapper[4769]: I1121 13:35:04.091467 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" event={"ID":"729de42c-9efd-4c8e-a003-f48955e9cde2","Type":"ContainerStarted","Data":"cda388ffc0014ae9fa5944aab470156a6bb5106100a96f2314df0bab38907cd7"} Nov 21 13:35:06 crc kubenswrapper[4769]: I1121 13:35:06.111580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" event={"ID":"729de42c-9efd-4c8e-a003-f48955e9cde2","Type":"ContainerStarted","Data":"d9b7c634f825a9173e5b672fa528b0ece84b27f7dd7cc2305e2dbcfdc42cb11c"} Nov 21 13:35:06 crc kubenswrapper[4769]: I1121 13:35:06.130191 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" podStartSLOduration=2.279811993 podStartE2EDuration="3.130166093s" podCreationTimestamp="2025-11-21 13:35:03 +0000 UTC" firstStartedPulling="2025-11-21 13:35:03.940426364 +0000 UTC m=+6262.641088192" lastFinishedPulling="2025-11-21 13:35:04.790780474 +0000 UTC m=+6263.491442292" observedRunningTime="2025-11-21 13:35:06.126121855 +0000 UTC m=+6264.826783673" watchObservedRunningTime="2025-11-21 13:35:06.130166093 +0000 UTC m=+6264.830827911" Nov 21 13:35:07 crc kubenswrapper[4769]: I1121 13:35:07.124482 4769 generic.go:334] "Generic (PLEG): container finished" podID="729de42c-9efd-4c8e-a003-f48955e9cde2" containerID="d9b7c634f825a9173e5b672fa528b0ece84b27f7dd7cc2305e2dbcfdc42cb11c" exitCode=0 Nov 21 13:35:07 crc kubenswrapper[4769]: I1121 13:35:07.124531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" event={"ID":"729de42c-9efd-4c8e-a003-f48955e9cde2","Type":"ContainerDied","Data":"d9b7c634f825a9173e5b672fa528b0ece84b27f7dd7cc2305e2dbcfdc42cb11c"} Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.482699 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.579402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-inventory\") pod \"729de42c-9efd-4c8e-a003-f48955e9cde2\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.579452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-ssh-key\") pod \"729de42c-9efd-4c8e-a003-f48955e9cde2\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.579480 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkg2c\" (UniqueName: \"kubernetes.io/projected/729de42c-9efd-4c8e-a003-f48955e9cde2-kube-api-access-zkg2c\") pod \"729de42c-9efd-4c8e-a003-f48955e9cde2\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.579506 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-combined-ca-bundle\") pod \"729de42c-9efd-4c8e-a003-f48955e9cde2\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.579564 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-agent-neutron-config-0\") pod \"729de42c-9efd-4c8e-a003-f48955e9cde2\" (UID: \"729de42c-9efd-4c8e-a003-f48955e9cde2\") " Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.585356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "729de42c-9efd-4c8e-a003-f48955e9cde2" (UID: "729de42c-9efd-4c8e-a003-f48955e9cde2"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.586538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/729de42c-9efd-4c8e-a003-f48955e9cde2-kube-api-access-zkg2c" (OuterVolumeSpecName: "kube-api-access-zkg2c") pod "729de42c-9efd-4c8e-a003-f48955e9cde2" (UID: "729de42c-9efd-4c8e-a003-f48955e9cde2"). InnerVolumeSpecName "kube-api-access-zkg2c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.603108 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-inventory" (OuterVolumeSpecName: "inventory") pod "729de42c-9efd-4c8e-a003-f48955e9cde2" (UID: "729de42c-9efd-4c8e-a003-f48955e9cde2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.604647 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "729de42c-9efd-4c8e-a003-f48955e9cde2" (UID: "729de42c-9efd-4c8e-a003-f48955e9cde2"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.607378 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "729de42c-9efd-4c8e-a003-f48955e9cde2" (UID: "729de42c-9efd-4c8e-a003-f48955e9cde2"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.681171 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.681266 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.681284 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zkg2c\" (UniqueName: \"kubernetes.io/projected/729de42c-9efd-4c8e-a003-f48955e9cde2-kube-api-access-zkg2c\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.681300 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:08 crc kubenswrapper[4769]: I1121 13:35:08.681322 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/729de42c-9efd-4c8e-a003-f48955e9cde2-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.146984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" event={"ID":"729de42c-9efd-4c8e-a003-f48955e9cde2","Type":"ContainerDied","Data":"cda388ffc0014ae9fa5944aab470156a6bb5106100a96f2314df0bab38907cd7"} Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.147032 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cda388ffc0014ae9fa5944aab470156a6bb5106100a96f2314df0bab38907cd7" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.147082 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.210848 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg"] Nov 21 13:35:09 crc kubenswrapper[4769]: E1121 13:35:09.211192 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="729de42c-9efd-4c8e-a003-f48955e9cde2" containerName="neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.211227 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="729de42c-9efd-4c8e-a003-f48955e9cde2" containerName="neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.211371 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="729de42c-9efd-4c8e-a003-f48955e9cde2" containerName="neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.211876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.214032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.214092 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.214481 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.214706 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-dhcp-agent-neutron-config" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.215029 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.216991 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.224280 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg"] Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.290761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.290856 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q79c8\" (UniqueName: \"kubernetes.io/projected/91f47bb0-ae29-420b-96c6-7af7643cd983-kube-api-access-q79c8\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.290938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.290992 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-inventory\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.291104 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-ssh-key\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.392652 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-ssh-key\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.393356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.393581 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q79c8\" (UniqueName: \"kubernetes.io/projected/91f47bb0-ae29-420b-96c6-7af7643cd983-kube-api-access-q79c8\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.393755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.393917 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-inventory\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.399412 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.399809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-ssh-key\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.399890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.401018 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-inventory\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.414601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q79c8\" (UniqueName: \"kubernetes.io/projected/91f47bb0-ae29-420b-96c6-7af7643cd983-kube-api-access-q79c8\") pod \"neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:09 crc kubenswrapper[4769]: I1121 13:35:09.528302 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:10 crc kubenswrapper[4769]: I1121 13:35:10.033673 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg"] Nov 21 13:35:10 crc kubenswrapper[4769]: I1121 13:35:10.160658 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" event={"ID":"91f47bb0-ae29-420b-96c6-7af7643cd983","Type":"ContainerStarted","Data":"d75136662e86bd936bbe8771c65eb60842c6e1dcc993e17bddd6b3eb7ce498ed"} Nov 21 13:35:12 crc kubenswrapper[4769]: I1121 13:35:12.180214 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" event={"ID":"91f47bb0-ae29-420b-96c6-7af7643cd983","Type":"ContainerStarted","Data":"8fd8f308bd10fc0cb2b508d1dbe9250d9fc85c342591e534336a96d5e8e84b64"} Nov 21 13:35:12 crc kubenswrapper[4769]: I1121 13:35:12.200938 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" podStartSLOduration=2.288399194 podStartE2EDuration="3.200915039s" podCreationTimestamp="2025-11-21 13:35:09 +0000 UTC" firstStartedPulling="2025-11-21 13:35:10.046582008 +0000 UTC m=+6268.747243856" lastFinishedPulling="2025-11-21 13:35:10.959097873 +0000 UTC m=+6269.659759701" observedRunningTime="2025-11-21 13:35:12.198617928 +0000 UTC m=+6270.899279756" watchObservedRunningTime="2025-11-21 13:35:12.200915039 +0000 UTC m=+6270.901576857" Nov 21 13:35:13 crc kubenswrapper[4769]: I1121 13:35:13.192662 4769 generic.go:334] "Generic (PLEG): container finished" podID="91f47bb0-ae29-420b-96c6-7af7643cd983" containerID="8fd8f308bd10fc0cb2b508d1dbe9250d9fc85c342591e534336a96d5e8e84b64" exitCode=0 Nov 21 13:35:13 crc kubenswrapper[4769]: I1121 13:35:13.192997 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" event={"ID":"91f47bb0-ae29-420b-96c6-7af7643cd983","Type":"ContainerDied","Data":"8fd8f308bd10fc0cb2b508d1dbe9250d9fc85c342591e534336a96d5e8e84b64"} Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.548455 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.673108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-agent-neutron-config-0\") pod \"91f47bb0-ae29-420b-96c6-7af7643cd983\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.673901 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-ssh-key\") pod \"91f47bb0-ae29-420b-96c6-7af7643cd983\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.674107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q79c8\" (UniqueName: \"kubernetes.io/projected/91f47bb0-ae29-420b-96c6-7af7643cd983-kube-api-access-q79c8\") pod \"91f47bb0-ae29-420b-96c6-7af7643cd983\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.674323 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-combined-ca-bundle\") pod \"91f47bb0-ae29-420b-96c6-7af7643cd983\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.674449 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-inventory\") pod \"91f47bb0-ae29-420b-96c6-7af7643cd983\" (UID: \"91f47bb0-ae29-420b-96c6-7af7643cd983\") " Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.679097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "91f47bb0-ae29-420b-96c6-7af7643cd983" (UID: "91f47bb0-ae29-420b-96c6-7af7643cd983"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.679665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f47bb0-ae29-420b-96c6-7af7643cd983-kube-api-access-q79c8" (OuterVolumeSpecName: "kube-api-access-q79c8") pod "91f47bb0-ae29-420b-96c6-7af7643cd983" (UID: "91f47bb0-ae29-420b-96c6-7af7643cd983"). InnerVolumeSpecName "kube-api-access-q79c8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.702364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-inventory" (OuterVolumeSpecName: "inventory") pod "91f47bb0-ae29-420b-96c6-7af7643cd983" (UID: "91f47bb0-ae29-420b-96c6-7af7643cd983"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.702528 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "91f47bb0-ae29-420b-96c6-7af7643cd983" (UID: "91f47bb0-ae29-420b-96c6-7af7643cd983"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.719472 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "91f47bb0-ae29-420b-96c6-7af7643cd983" (UID: "91f47bb0-ae29-420b-96c6-7af7643cd983"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.775320 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.775353 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.775365 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.775375 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91f47bb0-ae29-420b-96c6-7af7643cd983-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:14 crc kubenswrapper[4769]: I1121 13:35:14.775387 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q79c8\" (UniqueName: \"kubernetes.io/projected/91f47bb0-ae29-420b-96c6-7af7643cd983-kube-api-access-q79c8\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.230142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" event={"ID":"91f47bb0-ae29-420b-96c6-7af7643cd983","Type":"ContainerDied","Data":"d75136662e86bd936bbe8771c65eb60842c6e1dcc993e17bddd6b3eb7ce498ed"} Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.230268 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.230276 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d75136662e86bd936bbe8771c65eb60842c6e1dcc993e17bddd6b3eb7ce498ed" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.980997 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2"] Nov 21 13:35:15 crc kubenswrapper[4769]: E1121 13:35:15.982303 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91f47bb0-ae29-420b-96c6-7af7643cd983" containerName="neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.982450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f47bb0-ae29-420b-96c6-7af7643cd983" containerName="neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.982737 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="91f47bb0-ae29-420b-96c6-7af7643cd983" containerName="neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.983432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2"] Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.983651 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.987596 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.987631 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.987685 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.988071 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.988407 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"libvirt-secret" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.990264 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.995650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-secret-0\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.995698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.995760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-ssh-key\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.995824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpg5s\" (UniqueName: \"kubernetes.io/projected/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-kube-api-access-mpg5s\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:15 crc kubenswrapper[4769]: I1121 13:35:15.995852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-inventory\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.097185 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-ssh-key\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.097539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mpg5s\" (UniqueName: \"kubernetes.io/projected/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-kube-api-access-mpg5s\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.097659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-inventory\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.097812 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-secret-0\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.097887 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.102498 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-ssh-key\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.102523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-secret-0\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.106873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.110148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-inventory\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.126673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpg5s\" (UniqueName: \"kubernetes.io/projected/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-kube-api-access-mpg5s\") pod \"libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.311659 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:16 crc kubenswrapper[4769]: I1121 13:35:16.759129 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2"] Nov 21 13:35:17 crc kubenswrapper[4769]: I1121 13:35:17.251900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" event={"ID":"9fbe3d38-1f00-4de5-8d18-8e1c569458f7","Type":"ContainerStarted","Data":"3b6fec6d481a6e318134b523528fda55e5505d78dc669d46d6a5f1e221992542"} Nov 21 13:35:19 crc kubenswrapper[4769]: I1121 13:35:19.287084 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" event={"ID":"9fbe3d38-1f00-4de5-8d18-8e1c569458f7","Type":"ContainerStarted","Data":"c7d36916f705a9f453b007a7947d43ec0a1964e0a1ed20469af73e6de1f05509"} Nov 21 13:35:19 crc kubenswrapper[4769]: I1121 13:35:19.310657 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" podStartSLOduration=3.116230791 podStartE2EDuration="4.310632307s" podCreationTimestamp="2025-11-21 13:35:15 +0000 UTC" firstStartedPulling="2025-11-21 13:35:16.772497774 +0000 UTC m=+6275.473159592" lastFinishedPulling="2025-11-21 13:35:17.96689929 +0000 UTC m=+6276.667561108" observedRunningTime="2025-11-21 13:35:19.303380392 +0000 UTC m=+6278.004042230" watchObservedRunningTime="2025-11-21 13:35:19.310632307 +0000 UTC m=+6278.011294125" Nov 21 13:35:20 crc kubenswrapper[4769]: I1121 13:35:20.293160 4769 generic.go:334] "Generic (PLEG): container finished" podID="9fbe3d38-1f00-4de5-8d18-8e1c569458f7" containerID="c7d36916f705a9f453b007a7947d43ec0a1964e0a1ed20469af73e6de1f05509" exitCode=0 Nov 21 13:35:20 crc kubenswrapper[4769]: I1121 13:35:20.293309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" event={"ID":"9fbe3d38-1f00-4de5-8d18-8e1c569458f7","Type":"ContainerDied","Data":"c7d36916f705a9f453b007a7947d43ec0a1964e0a1ed20469af73e6de1f05509"} Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.674275 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.825298 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-ssh-key\") pod \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.825419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-combined-ca-bundle\") pod \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.825477 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpg5s\" (UniqueName: \"kubernetes.io/projected/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-kube-api-access-mpg5s\") pod \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.825539 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-secret-0\") pod \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.826422 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-inventory\") pod \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\" (UID: \"9fbe3d38-1f00-4de5-8d18-8e1c569458f7\") " Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.833047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-kube-api-access-mpg5s" (OuterVolumeSpecName: "kube-api-access-mpg5s") pod "9fbe3d38-1f00-4de5-8d18-8e1c569458f7" (UID: "9fbe3d38-1f00-4de5-8d18-8e1c569458f7"). InnerVolumeSpecName "kube-api-access-mpg5s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.841448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "9fbe3d38-1f00-4de5-8d18-8e1c569458f7" (UID: "9fbe3d38-1f00-4de5-8d18-8e1c569458f7"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.860586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "9fbe3d38-1f00-4de5-8d18-8e1c569458f7" (UID: "9fbe3d38-1f00-4de5-8d18-8e1c569458f7"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.867258 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-inventory" (OuterVolumeSpecName: "inventory") pod "9fbe3d38-1f00-4de5-8d18-8e1c569458f7" (UID: "9fbe3d38-1f00-4de5-8d18-8e1c569458f7"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.872711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "9fbe3d38-1f00-4de5-8d18-8e1c569458f7" (UID: "9fbe3d38-1f00-4de5-8d18-8e1c569458f7"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.929345 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.929428 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mpg5s\" (UniqueName: \"kubernetes.io/projected/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-kube-api-access-mpg5s\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.929444 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.929458 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:21 crc kubenswrapper[4769]: I1121 13:35:21.929474 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/9fbe3d38-1f00-4de5-8d18-8e1c569458f7-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.317646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" event={"ID":"9fbe3d38-1f00-4de5-8d18-8e1c569458f7","Type":"ContainerDied","Data":"3b6fec6d481a6e318134b523528fda55e5505d78dc669d46d6a5f1e221992542"} Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.317698 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b6fec6d481a6e318134b523528fda55e5505d78dc669d46d6a5f1e221992542" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.317717 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.401857 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd"] Nov 21 13:35:22 crc kubenswrapper[4769]: E1121 13:35:22.402134 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9fbe3d38-1f00-4de5-8d18-8e1c569458f7" containerName="libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.402152 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbe3d38-1f00-4de5-8d18-8e1c569458f7" containerName="libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.402345 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9fbe3d38-1f00-4de5-8d18-8e1c569458f7" containerName="libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.402812 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.405571 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-compute-config" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.406612 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.406779 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.407035 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.407054 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.408226 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.409516 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-migration-ssh-key" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.424076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd"] Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.540883 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.540933 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.540957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-ssh-key\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.541044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-inventory\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.541065 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-combined-ca-bundle\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.541118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.541138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw82x\" (UniqueName: \"kubernetes.io/projected/62b03230-5fc4-472e-851a-6b2f13e814cd-kube-api-access-kw82x\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.541164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642597 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642662 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-ssh-key\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-inventory\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642743 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-combined-ca-bundle\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kw82x\" (UniqueName: \"kubernetes.io/projected/62b03230-5fc4-472e-851a-6b2f13e814cd-kube-api-access-kw82x\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.642829 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.648420 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-inventory\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.649173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.649781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-combined-ca-bundle\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.650039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-1\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.654472 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-ssh-key\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.656369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.658453 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-0\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.664332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw82x\" (UniqueName: \"kubernetes.io/projected/62b03230-5fc4-472e-851a-6b2f13e814cd-kube-api-access-kw82x\") pod \"nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:22 crc kubenswrapper[4769]: I1121 13:35:22.725033 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:23 crc kubenswrapper[4769]: I1121 13:35:23.008420 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd"] Nov 21 13:35:23 crc kubenswrapper[4769]: W1121 13:35:23.017695 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62b03230_5fc4_472e_851a_6b2f13e814cd.slice/crio-1d81dde97fe2bcc7bd87d3ce405059d0578b1d31b2f83fab4e53ad4b2a93ac51 WatchSource:0}: Error finding container 1d81dde97fe2bcc7bd87d3ce405059d0578b1d31b2f83fab4e53ad4b2a93ac51: Status 404 returned error can't find the container with id 1d81dde97fe2bcc7bd87d3ce405059d0578b1d31b2f83fab4e53ad4b2a93ac51 Nov 21 13:35:23 crc kubenswrapper[4769]: I1121 13:35:23.333232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" event={"ID":"62b03230-5fc4-472e-851a-6b2f13e814cd","Type":"ContainerStarted","Data":"1d81dde97fe2bcc7bd87d3ce405059d0578b1d31b2f83fab4e53ad4b2a93ac51"} Nov 21 13:35:24 crc kubenswrapper[4769]: I1121 13:35:24.356715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" event={"ID":"62b03230-5fc4-472e-851a-6b2f13e814cd","Type":"ContainerStarted","Data":"a5e29c39081acaf37d35a4714e3ce7cc9745d54e162862f791bd0e86428fce15"} Nov 21 13:35:25 crc kubenswrapper[4769]: I1121 13:35:25.410093 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" podStartSLOduration=2.472039923 podStartE2EDuration="3.41006519s" podCreationTimestamp="2025-11-21 13:35:22 +0000 UTC" firstStartedPulling="2025-11-21 13:35:23.019698536 +0000 UTC m=+6281.720360354" lastFinishedPulling="2025-11-21 13:35:23.957723793 +0000 UTC m=+6282.658385621" observedRunningTime="2025-11-21 13:35:25.395942351 +0000 UTC m=+6284.096604199" watchObservedRunningTime="2025-11-21 13:35:25.41006519 +0000 UTC m=+6284.110727048" Nov 21 13:35:26 crc kubenswrapper[4769]: I1121 13:35:26.385286 4769 generic.go:334] "Generic (PLEG): container finished" podID="62b03230-5fc4-472e-851a-6b2f13e814cd" containerID="a5e29c39081acaf37d35a4714e3ce7cc9745d54e162862f791bd0e86428fce15" exitCode=0 Nov 21 13:35:26 crc kubenswrapper[4769]: I1121 13:35:26.385356 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" event={"ID":"62b03230-5fc4-472e-851a-6b2f13e814cd","Type":"ContainerDied","Data":"a5e29c39081acaf37d35a4714e3ce7cc9745d54e162862f791bd0e86428fce15"} Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.809207 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.943891 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-combined-ca-bundle\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw82x\" (UniqueName: \"kubernetes.io/projected/62b03230-5fc4-472e-851a-6b2f13e814cd-kube-api-access-kw82x\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944232 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-1\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944294 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-ssh-key\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-0\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944455 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-1\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944524 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-inventory\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.944581 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-0\") pod \"62b03230-5fc4-472e-851a-6b2f13e814cd\" (UID: \"62b03230-5fc4-472e-851a-6b2f13e814cd\") " Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.956674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.966131 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62b03230-5fc4-472e-851a-6b2f13e814cd-kube-api-access-kw82x" (OuterVolumeSpecName: "kube-api-access-kw82x") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "kube-api-access-kw82x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.967376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.967714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.969356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.970818 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.986693 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:27 crc kubenswrapper[4769]: I1121 13:35:27.994147 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-inventory" (OuterVolumeSpecName: "inventory") pod "62b03230-5fc4-472e-851a-6b2f13e814cd" (UID: "62b03230-5fc4-472e-851a-6b2f13e814cd"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046084 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046118 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046130 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046151 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046161 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046169 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046177 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kw82x\" (UniqueName: \"kubernetes.io/projected/62b03230-5fc4-472e-851a-6b2f13e814cd-kube-api-access-kw82x\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.046203 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/62b03230-5fc4-472e-851a-6b2f13e814cd-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.413791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" event={"ID":"62b03230-5fc4-472e-851a-6b2f13e814cd","Type":"ContainerDied","Data":"1d81dde97fe2bcc7bd87d3ce405059d0578b1d31b2f83fab4e53ad4b2a93ac51"} Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.413844 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d81dde97fe2bcc7bd87d3ce405059d0578b1d31b2f83fab4e53ad4b2a93ac51" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.413911 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.984422 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv"] Nov 21 13:35:28 crc kubenswrapper[4769]: E1121 13:35:28.985137 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62b03230-5fc4-472e-851a-6b2f13e814cd" containerName="nova-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.985157 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b03230-5fc4-472e-851a-6b2f13e814cd" containerName="nova-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.990121 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62b03230-5fc4-472e-851a-6b2f13e814cd" containerName="nova-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:35:28 crc kubenswrapper[4769]: I1121 13:35:28.991116 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.017359 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.017755 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.017870 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.018023 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.021923 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv"] Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.022272 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.165011 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92p5\" (UniqueName: \"kubernetes.io/projected/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-kube-api-access-d92p5\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.165169 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-inventory\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.165493 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-ssh-key\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.165563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-custom-svc-combined-ca-bundle\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.266629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-ssh-key\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.267428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-custom-svc-combined-ca-bundle\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.267506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d92p5\" (UniqueName: \"kubernetes.io/projected/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-kube-api-access-d92p5\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.267549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-inventory\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.277260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-custom-svc-combined-ca-bundle\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.277517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-ssh-key\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.277941 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-inventory\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.288398 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92p5\" (UniqueName: \"kubernetes.io/projected/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-kube-api-access-d92p5\") pod \"custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.319598 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:29 crc kubenswrapper[4769]: I1121 13:35:29.820339 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv"] Nov 21 13:35:30 crc kubenswrapper[4769]: I1121 13:35:30.469934 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" event={"ID":"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e","Type":"ContainerStarted","Data":"bf0595fdae228d15c50ac0b56d75d8b9494576ecbf795aa789680eb4758ab679"} Nov 21 13:35:31 crc kubenswrapper[4769]: I1121 13:35:31.480044 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" event={"ID":"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e","Type":"ContainerStarted","Data":"940bca3f00f99eec266cc5c16e62e4aa576be7f8dfc06b69b51cc0d18df620a4"} Nov 21 13:35:31 crc kubenswrapper[4769]: I1121 13:35:31.501504 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" podStartSLOduration=3.026010061 podStartE2EDuration="3.501480748s" podCreationTimestamp="2025-11-21 13:35:28 +0000 UTC" firstStartedPulling="2025-11-21 13:35:29.831174313 +0000 UTC m=+6288.531836131" lastFinishedPulling="2025-11-21 13:35:30.30664495 +0000 UTC m=+6289.007306818" observedRunningTime="2025-11-21 13:35:31.495139538 +0000 UTC m=+6290.195801376" watchObservedRunningTime="2025-11-21 13:35:31.501480748 +0000 UTC m=+6290.202142576" Nov 21 13:35:33 crc kubenswrapper[4769]: I1121 13:35:33.504106 4769 generic.go:334] "Generic (PLEG): container finished" podID="c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" containerID="940bca3f00f99eec266cc5c16e62e4aa576be7f8dfc06b69b51cc0d18df620a4" exitCode=0 Nov 21 13:35:33 crc kubenswrapper[4769]: I1121 13:35:33.504151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" event={"ID":"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e","Type":"ContainerDied","Data":"940bca3f00f99eec266cc5c16e62e4aa576be7f8dfc06b69b51cc0d18df620a4"} Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.828629 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.949880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-custom-svc-combined-ca-bundle\") pod \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.949976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-ssh-key\") pod \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.950041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-inventory\") pod \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.950151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d92p5\" (UniqueName: \"kubernetes.io/projected/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-kube-api-access-d92p5\") pod \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\" (UID: \"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e\") " Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.955570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-custom-svc-combined-ca-bundle" (OuterVolumeSpecName: "custom-svc-combined-ca-bundle") pod "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" (UID: "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e"). InnerVolumeSpecName "custom-svc-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.956071 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-kube-api-access-d92p5" (OuterVolumeSpecName: "kube-api-access-d92p5") pod "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" (UID: "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e"). InnerVolumeSpecName "kube-api-access-d92p5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.976103 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-inventory" (OuterVolumeSpecName: "inventory") pod "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" (UID: "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:34 crc kubenswrapper[4769]: I1121 13:35:34.984031 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" (UID: "c4fe6d1d-921d-4ac5-86dd-f13462f5e61e"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.051208 4769 reconciler_common.go:293] "Volume detached for volume \"custom-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-custom-svc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.051242 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.051252 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.051265 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d92p5\" (UniqueName: \"kubernetes.io/projected/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e-kube-api-access-d92p5\") on node \"crc\" DevicePath \"\"" Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.527100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" event={"ID":"c4fe6d1d-921d-4ac5-86dd-f13462f5e61e","Type":"ContainerDied","Data":"bf0595fdae228d15c50ac0b56d75d8b9494576ecbf795aa789680eb4758ab679"} Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.527434 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf0595fdae228d15c50ac0b56d75d8b9494576ecbf795aa789680eb4758ab679" Nov 21 13:35:35 crc kubenswrapper[4769]: I1121 13:35:35.527216 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv" Nov 21 13:35:41 crc kubenswrapper[4769]: I1121 13:35:41.325018 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:35:41 crc kubenswrapper[4769]: I1121 13:35:41.325599 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.076360 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm"] Nov 21 13:35:59 crc kubenswrapper[4769]: E1121 13:35:59.077453 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" containerName="custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodes" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.077473 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" containerName="custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodes" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.077660 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" containerName="custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodes" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.078285 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.086405 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.086450 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-config" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.086805 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.086831 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.087253 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.088800 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.107173 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm"] Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.163798 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4x5\" (UniqueName: \"kubernetes.io/projected/34e777b9-a6be-42c0-a782-f92f7d99de4e-kube-api-access-jp4x5\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.163868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-inventory\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.163905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ssh-key\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.164021 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.164165 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.265927 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-inventory\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.266007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ssh-key\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.266071 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.266122 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.266268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4x5\" (UniqueName: \"kubernetes.io/projected/34e777b9-a6be-42c0-a782-f92f7d99de4e-kube-api-access-jp4x5\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.268679 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovncontroller-config-0\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.278087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ssh-key\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.278932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-inventory\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.288856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovn-combined-ca-bundle\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.298813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4x5\" (UniqueName: \"kubernetes.io/projected/34e777b9-a6be-42c0-a782-f92f7d99de4e-kube-api-access-jp4x5\") pod \"ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.401369 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.686977 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm"] Nov 21 13:35:59 crc kubenswrapper[4769]: I1121 13:35:59.812456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" event={"ID":"34e777b9-a6be-42c0-a782-f92f7d99de4e","Type":"ContainerStarted","Data":"c38469defed392f065a3a7b292c630a13cb7689fbd826f9e3276a2d50cfa8a60"} Nov 21 13:36:01 crc kubenswrapper[4769]: I1121 13:36:01.839980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" event={"ID":"34e777b9-a6be-42c0-a782-f92f7d99de4e","Type":"ContainerStarted","Data":"8f4f7262d51011aa1b9e5352781403d34dee67426639c067039611353d9a4468"} Nov 21 13:36:01 crc kubenswrapper[4769]: I1121 13:36:01.901523 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" podStartSLOduration=1.8919626379999999 podStartE2EDuration="2.901495351s" podCreationTimestamp="2025-11-21 13:35:59 +0000 UTC" firstStartedPulling="2025-11-21 13:35:59.696935306 +0000 UTC m=+6318.397597124" lastFinishedPulling="2025-11-21 13:36:00.706468009 +0000 UTC m=+6319.407129837" observedRunningTime="2025-11-21 13:36:01.894204126 +0000 UTC m=+6320.594865954" watchObservedRunningTime="2025-11-21 13:36:01.901495351 +0000 UTC m=+6320.602157169" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.107216 4769 scope.go:117] "RemoveContainer" containerID="6a2aa7ed3ef17d7509bac47a9cb9209d424e89e1083707dc5e95ee525e3703fd" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.130720 4769 scope.go:117] "RemoveContainer" containerID="eada4ef31899d79c64caffe170e23ee10691cfc95a5d3e067bcea851333bce4a" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.161289 4769 scope.go:117] "RemoveContainer" containerID="8c9ef2f09ec9eee0ddf3739ec713973eeff97ba22d4fdd45c0693a3772e26058" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.187852 4769 scope.go:117] "RemoveContainer" containerID="accf550c908bc7f63d304d2d40cd0d8dfc44bacfceabb85d776563f25b18cbc5" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.213080 4769 scope.go:117] "RemoveContainer" containerID="8a03c7f8d131834c8f170128c76a66663dfa0f1e866b221ebb3976555178a4a8" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.240317 4769 scope.go:117] "RemoveContainer" containerID="26eec958f63189a63d97e63208963dd86c750b714c6f520337d7118db78e8ec4" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.268427 4769 scope.go:117] "RemoveContainer" containerID="864c427e16dec49886dd845254c509cbc98696e9d8136f955275960c42e259c6" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.338350 4769 scope.go:117] "RemoveContainer" containerID="1ea9dca10e93917b4895b381414d6352a41cd3553ee8ee146f6022b1e42d5d76" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.368124 4769 scope.go:117] "RemoveContainer" containerID="de19dcc71ecbe9de1b9feeffcd956a33632e73795b51391faf7eace808a724ec" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.397456 4769 scope.go:117] "RemoveContainer" containerID="06e0de70e14dd998324f362fbd9e6a0ac4ba458aaecc365bfc75007a828440cb" Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.863360 4769 generic.go:334] "Generic (PLEG): container finished" podID="34e777b9-a6be-42c0-a782-f92f7d99de4e" containerID="8f4f7262d51011aa1b9e5352781403d34dee67426639c067039611353d9a4468" exitCode=0 Nov 21 13:36:02 crc kubenswrapper[4769]: I1121 13:36:02.863431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" event={"ID":"34e777b9-a6be-42c0-a782-f92f7d99de4e","Type":"ContainerDied","Data":"8f4f7262d51011aa1b9e5352781403d34dee67426639c067039611353d9a4468"} Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.224447 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.355808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp4x5\" (UniqueName: \"kubernetes.io/projected/34e777b9-a6be-42c0-a782-f92f7d99de4e-kube-api-access-jp4x5\") pod \"34e777b9-a6be-42c0-a782-f92f7d99de4e\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.356084 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-inventory\") pod \"34e777b9-a6be-42c0-a782-f92f7d99de4e\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.356126 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ssh-key\") pod \"34e777b9-a6be-42c0-a782-f92f7d99de4e\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.356753 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovn-combined-ca-bundle\") pod \"34e777b9-a6be-42c0-a782-f92f7d99de4e\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.356829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovncontroller-config-0\") pod \"34e777b9-a6be-42c0-a782-f92f7d99de4e\" (UID: \"34e777b9-a6be-42c0-a782-f92f7d99de4e\") " Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.363924 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "34e777b9-a6be-42c0-a782-f92f7d99de4e" (UID: "34e777b9-a6be-42c0-a782-f92f7d99de4e"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.364062 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e777b9-a6be-42c0-a782-f92f7d99de4e-kube-api-access-jp4x5" (OuterVolumeSpecName: "kube-api-access-jp4x5") pod "34e777b9-a6be-42c0-a782-f92f7d99de4e" (UID: "34e777b9-a6be-42c0-a782-f92f7d99de4e"). InnerVolumeSpecName "kube-api-access-jp4x5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.380625 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "34e777b9-a6be-42c0-a782-f92f7d99de4e" (UID: "34e777b9-a6be-42c0-a782-f92f7d99de4e"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.380984 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "34e777b9-a6be-42c0-a782-f92f7d99de4e" (UID: "34e777b9-a6be-42c0-a782-f92f7d99de4e"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.383887 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-inventory" (OuterVolumeSpecName: "inventory") pod "34e777b9-a6be-42c0-a782-f92f7d99de4e" (UID: "34e777b9-a6be-42c0-a782-f92f7d99de4e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.458940 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jp4x5\" (UniqueName: \"kubernetes.io/projected/34e777b9-a6be-42c0-a782-f92f7d99de4e-kube-api-access-jp4x5\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.458988 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.459004 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.459019 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.459033 4769 reconciler_common.go:293] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/34e777b9-a6be-42c0-a782-f92f7d99de4e-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.889459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" event={"ID":"34e777b9-a6be-42c0-a782-f92f7d99de4e","Type":"ContainerDied","Data":"c38469defed392f065a3a7b292c630a13cb7689fbd826f9e3276a2d50cfa8a60"} Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.889502 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c38469defed392f065a3a7b292c630a13cb7689fbd826f9e3276a2d50cfa8a60" Nov 21 13:36:04 crc kubenswrapper[4769]: I1121 13:36:04.889545 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.370906 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8"] Nov 21 13:36:07 crc kubenswrapper[4769]: E1121 13:36:07.371629 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34e777b9-a6be-42c0-a782-f92f7d99de4e" containerName="ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nodes" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.371643 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e777b9-a6be-42c0-a782-f92f7d99de4e" containerName="ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nodes" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.371811 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34e777b9-a6be-42c0-a782-f92f7d99de4e" containerName="ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-nodes" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.372634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.375382 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-compute-beta-nodeset" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.393102 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8"] Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.504461 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.504519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-config\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.504587 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.504615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.504876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48bjr\" (UniqueName: \"kubernetes.io/projected/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-kube-api-access-48bjr\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.606109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-48bjr\" (UniqueName: \"kubernetes.io/projected/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-kube-api-access-48bjr\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.606539 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.606673 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-config\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.606822 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.606914 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.607588 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-beta-nodeset\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.607843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.607846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.607850 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-config\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.628210 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-48bjr\" (UniqueName: \"kubernetes.io/projected/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-kube-api-access-48bjr\") pod \"dnsmasq-dnsmasq-67886899f9-8lpb8\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.692464 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.882730 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8"] Nov 21 13:36:07 crc kubenswrapper[4769]: I1121 13:36:07.922252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" event={"ID":"b847dd8c-0bec-45e2-b7f9-654f6f1486ad","Type":"ContainerStarted","Data":"1e029f1e90df41e5634778610ffbf232f935b8c8323b8e5706f336be3c22b7e5"} Nov 21 13:36:08 crc kubenswrapper[4769]: I1121 13:36:08.942087 4769 generic.go:334] "Generic (PLEG): container finished" podID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerID="779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a" exitCode=0 Nov 21 13:36:08 crc kubenswrapper[4769]: I1121 13:36:08.942361 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" event={"ID":"b847dd8c-0bec-45e2-b7f9-654f6f1486ad","Type":"ContainerDied","Data":"779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a"} Nov 21 13:36:09 crc kubenswrapper[4769]: I1121 13:36:09.978128 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" event={"ID":"b847dd8c-0bec-45e2-b7f9-654f6f1486ad","Type":"ContainerStarted","Data":"66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1"} Nov 21 13:36:09 crc kubenswrapper[4769]: I1121 13:36:09.978374 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:10 crc kubenswrapper[4769]: I1121 13:36:10.007046 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" podStartSLOduration=3.007020144 podStartE2EDuration="3.007020144s" podCreationTimestamp="2025-11-21 13:36:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:36:10.001989299 +0000 UTC m=+6328.702651117" watchObservedRunningTime="2025-11-21 13:36:10.007020144 +0000 UTC m=+6328.707681982" Nov 21 13:36:11 crc kubenswrapper[4769]: I1121 13:36:11.325328 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:36:11 crc kubenswrapper[4769]: I1121 13:36:11.325431 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:36:17 crc kubenswrapper[4769]: I1121 13:36:17.694063 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:36:17 crc kubenswrapper[4769]: I1121 13:36:17.755382 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp"] Nov 21 13:36:17 crc kubenswrapper[4769]: I1121 13:36:17.755862 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerName="dnsmasq-dns" containerID="cri-o://56ed714049df023ecffe2a70ab50c0cc36bdd7ad5313dbdf09c24d960407982f" gracePeriod=10 Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.077708 4769 generic.go:334] "Generic (PLEG): container finished" podID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerID="56ed714049df023ecffe2a70ab50c0cc36bdd7ad5313dbdf09c24d960407982f" exitCode=0 Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.077771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" event={"ID":"6ff30df8-11ed-48c7-ba8d-47ac0894c561","Type":"ContainerDied","Data":"56ed714049df023ecffe2a70ab50c0cc36bdd7ad5313dbdf09c24d960407982f"} Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.165375 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.290949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-edpm-compute-no-nodes\") pod \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.291006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-config\") pod \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.291061 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h2np\" (UniqueName: \"kubernetes.io/projected/6ff30df8-11ed-48c7-ba8d-47ac0894c561-kube-api-access-4h2np\") pod \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.291095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-dnsmasq-svc\") pod \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\" (UID: \"6ff30df8-11ed-48c7-ba8d-47ac0894c561\") " Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.297171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff30df8-11ed-48c7-ba8d-47ac0894c561-kube-api-access-4h2np" (OuterVolumeSpecName: "kube-api-access-4h2np") pod "6ff30df8-11ed-48c7-ba8d-47ac0894c561" (UID: "6ff30df8-11ed-48c7-ba8d-47ac0894c561"). InnerVolumeSpecName "kube-api-access-4h2np". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.332966 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6ff30df8-11ed-48c7-ba8d-47ac0894c561" (UID: "6ff30df8-11ed-48c7-ba8d-47ac0894c561"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.333697 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-config" (OuterVolumeSpecName: "config") pod "6ff30df8-11ed-48c7-ba8d-47ac0894c561" (UID: "6ff30df8-11ed-48c7-ba8d-47ac0894c561"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.340107 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "6ff30df8-11ed-48c7-ba8d-47ac0894c561" (UID: "6ff30df8-11ed-48c7-ba8d-47ac0894c561"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.394789 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.394832 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.394844 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4h2np\" (UniqueName: \"kubernetes.io/projected/6ff30df8-11ed-48c7-ba8d-47ac0894c561-kube-api-access-4h2np\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:18 crc kubenswrapper[4769]: I1121 13:36:18.394854 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6ff30df8-11ed-48c7-ba8d-47ac0894c561-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.089815 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" event={"ID":"6ff30df8-11ed-48c7-ba8d-47ac0894c561","Type":"ContainerDied","Data":"49f6956bb37780c005587629f5b20e9a1327c82e2ddf64fa60560c6ab6bf6abb"} Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.090183 4769 scope.go:117] "RemoveContainer" containerID="56ed714049df023ecffe2a70ab50c0cc36bdd7ad5313dbdf09c24d960407982f" Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.089938 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp" Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.135008 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp"] Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.142382 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-jpscp"] Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.144841 4769 scope.go:117] "RemoveContainer" containerID="45c0fdf29410f9df98f599ddc10cc76e4eed978ee8c00d11ae48f9585bc52122" Nov 21 13:36:19 crc kubenswrapper[4769]: I1121 13:36:19.291715 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" path="/var/lib/kubelet/pods/6ff30df8-11ed-48c7-ba8d-47ac0894c561/volumes" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.316433 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb"] Nov 21 13:36:22 crc kubenswrapper[4769]: E1121 13:36:22.317061 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerName="init" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.317081 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerName="init" Nov 21 13:36:22 crc kubenswrapper[4769]: E1121 13:36:22.317127 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerName="dnsmasq-dns" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.317136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerName="dnsmasq-dns" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.317368 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6ff30df8-11ed-48c7-ba8d-47ac0894c561" containerName="dnsmasq-dns" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.317995 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.322917 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.323012 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.323247 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.323651 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.328928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb"] Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.339412 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m"] Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.340626 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.350102 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m"] Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.354059 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-beta-nodeset" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.355271 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f577r\" (UniqueName: \"kubernetes.io/projected/1b2f48ab-1377-443b-9c78-0744c051fbf1-kube-api-access-f577r\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.355437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.355606 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.362784 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-beta-nodeset-dockercfg-qfrhl" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.456875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.456926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.456987 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f577r\" (UniqueName: \"kubernetes.io/projected/1b2f48ab-1377-443b-9c78-0744c051fbf1-kube-api-access-f577r\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.457010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.457041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.457068 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h77r\" (UniqueName: \"kubernetes.io/projected/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-kube-api-access-2h77r\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.463804 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.463932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.478507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f577r\" (UniqueName: \"kubernetes.io/projected/1b2f48ab-1377-443b-9c78-0744c051fbf1-kube-api-access-f577r\") pod \"download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.558239 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.558552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2h77r\" (UniqueName: \"kubernetes.io/projected/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-kube-api-access-2h77r\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.558678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.563693 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-inventory\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.573047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-ssh-key\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.577077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h77r\" (UniqueName: \"kubernetes.io/projected/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-kube-api-access-2h77r\") pod \"download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.633732 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.657143 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:22 crc kubenswrapper[4769]: I1121 13:36:22.975679 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb"] Nov 21 13:36:23 crc kubenswrapper[4769]: I1121 13:36:23.149660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" event={"ID":"1b2f48ab-1377-443b-9c78-0744c051fbf1","Type":"ContainerStarted","Data":"0ecff1e4c8fc4b8d39f991b1d25eb784defbba18acb8799be34e774f9ce2eab3"} Nov 21 13:36:23 crc kubenswrapper[4769]: I1121 13:36:23.195545 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m"] Nov 21 13:36:23 crc kubenswrapper[4769]: W1121 13:36:23.203726 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod837a28ed_208e_491a_9cc1_fc2f8bf2b1f2.slice/crio-426a60ead2b0333555dfedb1142dd16546782aaa8055012760962490acf52ff5 WatchSource:0}: Error finding container 426a60ead2b0333555dfedb1142dd16546782aaa8055012760962490acf52ff5: Status 404 returned error can't find the container with id 426a60ead2b0333555dfedb1142dd16546782aaa8055012760962490acf52ff5 Nov 21 13:36:24 crc kubenswrapper[4769]: I1121 13:36:24.164604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" event={"ID":"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2","Type":"ContainerStarted","Data":"426a60ead2b0333555dfedb1142dd16546782aaa8055012760962490acf52ff5"} Nov 21 13:36:25 crc kubenswrapper[4769]: I1121 13:36:25.184112 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" event={"ID":"1b2f48ab-1377-443b-9c78-0744c051fbf1","Type":"ContainerStarted","Data":"bf08f1034bd2aa05f7a7de510903669b70357ff7534a34d0fa3a07853962219f"} Nov 21 13:36:25 crc kubenswrapper[4769]: I1121 13:36:25.216629 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" podStartSLOduration=1.790638515 podStartE2EDuration="3.216602989s" podCreationTimestamp="2025-11-21 13:36:22 +0000 UTC" firstStartedPulling="2025-11-21 13:36:22.978858757 +0000 UTC m=+6341.679520575" lastFinishedPulling="2025-11-21 13:36:24.404823221 +0000 UTC m=+6343.105485049" observedRunningTime="2025-11-21 13:36:25.208294889 +0000 UTC m=+6343.908956727" watchObservedRunningTime="2025-11-21 13:36:25.216602989 +0000 UTC m=+6343.917264807" Nov 21 13:36:26 crc kubenswrapper[4769]: I1121 13:36:26.199281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" event={"ID":"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2","Type":"ContainerStarted","Data":"355ead91f69296ebf454dc85032bcacac400d016638b9252daa73c9ec3b8a326"} Nov 21 13:36:26 crc kubenswrapper[4769]: I1121 13:36:26.225665 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" podStartSLOduration=2.402218051 podStartE2EDuration="4.225637305s" podCreationTimestamp="2025-11-21 13:36:22 +0000 UTC" firstStartedPulling="2025-11-21 13:36:23.206826247 +0000 UTC m=+6341.907488065" lastFinishedPulling="2025-11-21 13:36:25.030245461 +0000 UTC m=+6343.730907319" observedRunningTime="2025-11-21 13:36:26.218057045 +0000 UTC m=+6344.918718903" watchObservedRunningTime="2025-11-21 13:36:26.225637305 +0000 UTC m=+6344.926299153" Nov 21 13:36:27 crc kubenswrapper[4769]: I1121 13:36:27.214950 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b2f48ab-1377-443b-9c78-0744c051fbf1" containerID="bf08f1034bd2aa05f7a7de510903669b70357ff7534a34d0fa3a07853962219f" exitCode=0 Nov 21 13:36:27 crc kubenswrapper[4769]: I1121 13:36:27.215079 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" event={"ID":"1b2f48ab-1377-443b-9c78-0744c051fbf1","Type":"ContainerDied","Data":"bf08f1034bd2aa05f7a7de510903669b70357ff7534a34d0fa3a07853962219f"} Nov 21 13:36:27 crc kubenswrapper[4769]: I1121 13:36:27.217899 4769 generic.go:334] "Generic (PLEG): container finished" podID="837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" containerID="355ead91f69296ebf454dc85032bcacac400d016638b9252daa73c9ec3b8a326" exitCode=0 Nov 21 13:36:27 crc kubenswrapper[4769]: I1121 13:36:27.217980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" event={"ID":"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2","Type":"ContainerDied","Data":"355ead91f69296ebf454dc85032bcacac400d016638b9252daa73c9ec3b8a326"} Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.548514 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.562053 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.566155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-inventory\") pod \"1b2f48ab-1377-443b-9c78-0744c051fbf1\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.566282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h77r\" (UniqueName: \"kubernetes.io/projected/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-kube-api-access-2h77r\") pod \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.566332 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f577r\" (UniqueName: \"kubernetes.io/projected/1b2f48ab-1377-443b-9c78-0744c051fbf1-kube-api-access-f577r\") pod \"1b2f48ab-1377-443b-9c78-0744c051fbf1\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.566354 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-inventory\") pod \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.566392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-ssh-key\") pod \"1b2f48ab-1377-443b-9c78-0744c051fbf1\" (UID: \"1b2f48ab-1377-443b-9c78-0744c051fbf1\") " Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.566420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-ssh-key\") pod \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\" (UID: \"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2\") " Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.572892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-kube-api-access-2h77r" (OuterVolumeSpecName: "kube-api-access-2h77r") pod "837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" (UID: "837a28ed-208e-491a-9cc1-fc2f8bf2b1f2"). InnerVolumeSpecName "kube-api-access-2h77r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.573397 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2f48ab-1377-443b-9c78-0744c051fbf1-kube-api-access-f577r" (OuterVolumeSpecName: "kube-api-access-f577r") pod "1b2f48ab-1377-443b-9c78-0744c051fbf1" (UID: "1b2f48ab-1377-443b-9c78-0744c051fbf1"). InnerVolumeSpecName "kube-api-access-f577r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.597680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-inventory" (OuterVolumeSpecName: "inventory") pod "1b2f48ab-1377-443b-9c78-0744c051fbf1" (UID: "1b2f48ab-1377-443b-9c78-0744c051fbf1"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.600359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" (UID: "837a28ed-208e-491a-9cc1-fc2f8bf2b1f2"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.601367 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "1b2f48ab-1377-443b-9c78-0744c051fbf1" (UID: "1b2f48ab-1377-443b-9c78-0744c051fbf1"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.612140 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-inventory" (OuterVolumeSpecName: "inventory") pod "837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" (UID: "837a28ed-208e-491a-9cc1-fc2f8bf2b1f2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.668362 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.668399 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2h77r\" (UniqueName: \"kubernetes.io/projected/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-kube-api-access-2h77r\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.668411 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f577r\" (UniqueName: \"kubernetes.io/projected/1b2f48ab-1377-443b-9c78-0744c051fbf1-kube-api-access-f577r\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.668420 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.668428 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1b2f48ab-1377-443b-9c78-0744c051fbf1-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:28 crc kubenswrapper[4769]: I1121 13:36:28.668437 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.235372 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" event={"ID":"1b2f48ab-1377-443b-9c78-0744c051fbf1","Type":"ContainerDied","Data":"0ecff1e4c8fc4b8d39f991b1d25eb784defbba18acb8799be34e774f9ce2eab3"} Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.235715 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ecff1e4c8fc4b8d39f991b1d25eb784defbba18acb8799be34e774f9ce2eab3" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.235412 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.236929 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" event={"ID":"837a28ed-208e-491a-9cc1-fc2f8bf2b1f2","Type":"ContainerDied","Data":"426a60ead2b0333555dfedb1142dd16546782aaa8055012760962490acf52ff5"} Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.237042 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="426a60ead2b0333555dfedb1142dd16546782aaa8055012760962490acf52ff5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.236992 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.353349 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq"] Nov 21 13:36:29 crc kubenswrapper[4769]: E1121 13:36:29.353897 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.353967 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:36:29 crc kubenswrapper[4769]: E1121 13:36:29.354037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b2f48ab-1377-443b-9c78-0744c051fbf1" containerName="download-cache-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.354115 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2f48ab-1377-443b-9c78-0744c051fbf1" containerName="download-cache-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.354354 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" containerName="download-cache-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.354442 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b2f48ab-1377-443b-9c78-0744c051fbf1" containerName="download-cache-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.355213 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq"] Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.355361 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.358262 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.358283 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.358521 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-beta-nodeset-dockercfg-qfrhl" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.359545 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.365955 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-beta-nodeset" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.375565 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5"] Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.376663 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378279 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378333 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mdf\" (UniqueName: \"kubernetes.io/projected/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-kube-api-access-82mdf\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378358 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378378 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq5h2\" (UniqueName: \"kubernetes.io/projected/77e4e31b-a26b-4212-bcf9-c2c81269eed2-kube-api-access-mq5h2\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378410 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378517 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378566 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.378651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.380126 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.380756 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.387910 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5"] Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.479672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.479722 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-82mdf\" (UniqueName: \"kubernetes.io/projected/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-kube-api-access-82mdf\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.479754 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.479772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mq5h2\" (UniqueName: \"kubernetes.io/projected/77e4e31b-a26b-4212-bcf9-c2c81269eed2-kube-api-access-mq5h2\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.479804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.479832 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.480066 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.480115 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.484373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.484763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.489735 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-inventory\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.492702 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.493551 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-bootstrap-combined-ca-bundle\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.493592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-ssh-key\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.495507 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq5h2\" (UniqueName: \"kubernetes.io/projected/77e4e31b-a26b-4212-bcf9-c2c81269eed2-kube-api-access-mq5h2\") pod \"bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.499003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mdf\" (UniqueName: \"kubernetes.io/projected/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-kube-api-access-82mdf\") pod \"bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.676240 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:29 crc kubenswrapper[4769]: I1121 13:36:29.699969 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:30 crc kubenswrapper[4769]: I1121 13:36:30.023739 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq"] Nov 21 13:36:30 crc kubenswrapper[4769]: I1121 13:36:30.178155 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5"] Nov 21 13:36:30 crc kubenswrapper[4769]: W1121 13:36:30.184209 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77e4e31b_a26b_4212_bcf9_c2c81269eed2.slice/crio-6ea42d73423d9354a4589c2278a60dfe40b6e5d36d163793177079f74ced2983 WatchSource:0}: Error finding container 6ea42d73423d9354a4589c2278a60dfe40b6e5d36d163793177079f74ced2983: Status 404 returned error can't find the container with id 6ea42d73423d9354a4589c2278a60dfe40b6e5d36d163793177079f74ced2983 Nov 21 13:36:30 crc kubenswrapper[4769]: I1121 13:36:30.250314 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" event={"ID":"77e4e31b-a26b-4212-bcf9-c2c81269eed2","Type":"ContainerStarted","Data":"6ea42d73423d9354a4589c2278a60dfe40b6e5d36d163793177079f74ced2983"} Nov 21 13:36:30 crc kubenswrapper[4769]: I1121 13:36:30.252974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" event={"ID":"c312ad84-cb49-4324-a9b4-45e23c8bb1fd","Type":"ContainerStarted","Data":"6e9f2baf9d5e7b09553e574ad6f96e8548f24081985faf527c0e38898ca9e70d"} Nov 21 13:36:31 crc kubenswrapper[4769]: I1121 13:36:31.267280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" event={"ID":"c312ad84-cb49-4324-a9b4-45e23c8bb1fd","Type":"ContainerStarted","Data":"463a3ba72a0d27157562cde93b2ef1d550d7c84187fe4338f3e9dd24043ff315"} Nov 21 13:36:32 crc kubenswrapper[4769]: I1121 13:36:32.282935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" event={"ID":"77e4e31b-a26b-4212-bcf9-c2c81269eed2","Type":"ContainerStarted","Data":"f52eae95215afac8c924b936d4f35872dfc6f34f3b814ccf1aa1c5402726253d"} Nov 21 13:36:32 crc kubenswrapper[4769]: I1121 13:36:32.312778 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" podStartSLOduration=2.209921242 podStartE2EDuration="3.312747103s" podCreationTimestamp="2025-11-21 13:36:29 +0000 UTC" firstStartedPulling="2025-11-21 13:36:30.188156099 +0000 UTC m=+6348.888817917" lastFinishedPulling="2025-11-21 13:36:31.29098195 +0000 UTC m=+6349.991643778" observedRunningTime="2025-11-21 13:36:32.309566569 +0000 UTC m=+6351.010228427" watchObservedRunningTime="2025-11-21 13:36:32.312747103 +0000 UTC m=+6351.013408961" Nov 21 13:36:32 crc kubenswrapper[4769]: I1121 13:36:32.341348 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" podStartSLOduration=2.418025185 podStartE2EDuration="3.341329s" podCreationTimestamp="2025-11-21 13:36:29 +0000 UTC" firstStartedPulling="2025-11-21 13:36:30.031531789 +0000 UTC m=+6348.732193597" lastFinishedPulling="2025-11-21 13:36:30.954835554 +0000 UTC m=+6349.655497412" observedRunningTime="2025-11-21 13:36:32.333939895 +0000 UTC m=+6351.034601713" watchObservedRunningTime="2025-11-21 13:36:32.341329 +0000 UTC m=+6351.041990818" Nov 21 13:36:33 crc kubenswrapper[4769]: I1121 13:36:33.293620 4769 generic.go:334] "Generic (PLEG): container finished" podID="77e4e31b-a26b-4212-bcf9-c2c81269eed2" containerID="f52eae95215afac8c924b936d4f35872dfc6f34f3b814ccf1aa1c5402726253d" exitCode=0 Nov 21 13:36:33 crc kubenswrapper[4769]: I1121 13:36:33.293708 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" event={"ID":"77e4e31b-a26b-4212-bcf9-c2c81269eed2","Type":"ContainerDied","Data":"f52eae95215afac8c924b936d4f35872dfc6f34f3b814ccf1aa1c5402726253d"} Nov 21 13:36:33 crc kubenswrapper[4769]: I1121 13:36:33.295927 4769 generic.go:334] "Generic (PLEG): container finished" podID="c312ad84-cb49-4324-a9b4-45e23c8bb1fd" containerID="463a3ba72a0d27157562cde93b2ef1d550d7c84187fe4338f3e9dd24043ff315" exitCode=0 Nov 21 13:36:33 crc kubenswrapper[4769]: I1121 13:36:33.295964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" event={"ID":"c312ad84-cb49-4324-a9b4-45e23c8bb1fd","Type":"ContainerDied","Data":"463a3ba72a0d27157562cde93b2ef1d550d7c84187fe4338f3e9dd24043ff315"} Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.554807 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.619261 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.664304 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq5h2\" (UniqueName: \"kubernetes.io/projected/77e4e31b-a26b-4212-bcf9-c2c81269eed2-kube-api-access-mq5h2\") pod \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.664378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-ssh-key\") pod \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.664402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-inventory\") pod \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.664476 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-bootstrap-combined-ca-bundle\") pod \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\" (UID: \"77e4e31b-a26b-4212-bcf9-c2c81269eed2\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.669629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e4e31b-a26b-4212-bcf9-c2c81269eed2-kube-api-access-mq5h2" (OuterVolumeSpecName: "kube-api-access-mq5h2") pod "77e4e31b-a26b-4212-bcf9-c2c81269eed2" (UID: "77e4e31b-a26b-4212-bcf9-c2c81269eed2"). InnerVolumeSpecName "kube-api-access-mq5h2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.670334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "77e4e31b-a26b-4212-bcf9-c2c81269eed2" (UID: "77e4e31b-a26b-4212-bcf9-c2c81269eed2"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.686254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "77e4e31b-a26b-4212-bcf9-c2c81269eed2" (UID: "77e4e31b-a26b-4212-bcf9-c2c81269eed2"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.686432 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-inventory" (OuterVolumeSpecName: "inventory") pod "77e4e31b-a26b-4212-bcf9-c2c81269eed2" (UID: "77e4e31b-a26b-4212-bcf9-c2c81269eed2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.766069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-inventory\") pod \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.766177 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82mdf\" (UniqueName: \"kubernetes.io/projected/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-kube-api-access-82mdf\") pod \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.766451 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-ssh-key\") pod \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.766703 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-bootstrap-combined-ca-bundle\") pod \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\" (UID: \"c312ad84-cb49-4324-a9b4-45e23c8bb1fd\") " Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.767086 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.767122 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mq5h2\" (UniqueName: \"kubernetes.io/projected/77e4e31b-a26b-4212-bcf9-c2c81269eed2-kube-api-access-mq5h2\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.767146 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.767169 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/77e4e31b-a26b-4212-bcf9-c2c81269eed2-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.769748 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-kube-api-access-82mdf" (OuterVolumeSpecName: "kube-api-access-82mdf") pod "c312ad84-cb49-4324-a9b4-45e23c8bb1fd" (UID: "c312ad84-cb49-4324-a9b4-45e23c8bb1fd"). InnerVolumeSpecName "kube-api-access-82mdf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.771228 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "c312ad84-cb49-4324-a9b4-45e23c8bb1fd" (UID: "c312ad84-cb49-4324-a9b4-45e23c8bb1fd"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.785722 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-inventory" (OuterVolumeSpecName: "inventory") pod "c312ad84-cb49-4324-a9b4-45e23c8bb1fd" (UID: "c312ad84-cb49-4324-a9b4-45e23c8bb1fd"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.787028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "c312ad84-cb49-4324-a9b4-45e23c8bb1fd" (UID: "c312ad84-cb49-4324-a9b4-45e23c8bb1fd"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.869534 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.869685 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.869713 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-82mdf\" (UniqueName: \"kubernetes.io/projected/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-kube-api-access-82mdf\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:34 crc kubenswrapper[4769]: I1121 13:36:34.869732 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c312ad84-cb49-4324-a9b4-45e23c8bb1fd-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.315410 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.315486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5" event={"ID":"77e4e31b-a26b-4212-bcf9-c2c81269eed2","Type":"ContainerDied","Data":"6ea42d73423d9354a4589c2278a60dfe40b6e5d36d163793177079f74ced2983"} Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.315555 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ea42d73423d9354a4589c2278a60dfe40b6e5d36d163793177079f74ced2983" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.317618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" event={"ID":"c312ad84-cb49-4324-a9b4-45e23c8bb1fd","Type":"ContainerDied","Data":"6e9f2baf9d5e7b09553e574ad6f96e8548f24081985faf527c0e38898ca9e70d"} Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.317649 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e9f2baf9d5e7b09553e574ad6f96e8548f24081985faf527c0e38898ca9e70d" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.317695 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.630719 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4"] Nov 21 13:36:35 crc kubenswrapper[4769]: E1121 13:36:35.631540 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c312ad84-cb49-4324-a9b4-45e23c8bb1fd" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.631556 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c312ad84-cb49-4324-a9b4-45e23c8bb1fd" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:36:35 crc kubenswrapper[4769]: E1121 13:36:35.631575 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="77e4e31b-a26b-4212-bcf9-c2c81269eed2" containerName="bootstrap-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.631583 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e4e31b-a26b-4212-bcf9-c2c81269eed2" containerName="bootstrap-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.631734 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c312ad84-cb49-4324-a9b4-45e23c8bb1fd" containerName="bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.631761 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="77e4e31b-a26b-4212-bcf9-c2c81269eed2" containerName="bootstrap-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.632299 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.637912 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.638009 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.638331 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.638759 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.658063 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4"] Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.786539 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-ssh-key\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.786672 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjxzw\" (UniqueName: \"kubernetes.io/projected/1ed344a6-aa34-406b-9a62-7c66a2025646-kube-api-access-qjxzw\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.786858 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.888341 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.888442 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-ssh-key\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.888477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qjxzw\" (UniqueName: \"kubernetes.io/projected/1ed344a6-aa34-406b-9a62-7c66a2025646-kube-api-access-qjxzw\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.892981 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-ssh-key\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.895605 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-inventory\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.904731 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjxzw\" (UniqueName: \"kubernetes.io/projected/1ed344a6-aa34-406b-9a62-7c66a2025646-kube-api-access-qjxzw\") pod \"configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:35 crc kubenswrapper[4769]: I1121 13:36:35.953593 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:36 crc kubenswrapper[4769]: I1121 13:36:36.392326 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4"] Nov 21 13:36:36 crc kubenswrapper[4769]: W1121 13:36:36.397119 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ed344a6_aa34_406b_9a62_7c66a2025646.slice/crio-62568a7851cc9e873de495c0e961373a73129a3cfd479e94f3ea78efa8f79844 WatchSource:0}: Error finding container 62568a7851cc9e873de495c0e961373a73129a3cfd479e94f3ea78efa8f79844: Status 404 returned error can't find the container with id 62568a7851cc9e873de495c0e961373a73129a3cfd479e94f3ea78efa8f79844 Nov 21 13:36:37 crc kubenswrapper[4769]: I1121 13:36:37.339844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" event={"ID":"1ed344a6-aa34-406b-9a62-7c66a2025646","Type":"ContainerStarted","Data":"62568a7851cc9e873de495c0e961373a73129a3cfd479e94f3ea78efa8f79844"} Nov 21 13:36:38 crc kubenswrapper[4769]: I1121 13:36:38.356626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" event={"ID":"1ed344a6-aa34-406b-9a62-7c66a2025646","Type":"ContainerStarted","Data":"c90d7dcef36bec28f82adbb4b3b0ae90b278ec9c12030e7fd8f1c23c276a85b1"} Nov 21 13:36:39 crc kubenswrapper[4769]: I1121 13:36:39.371998 4769 generic.go:334] "Generic (PLEG): container finished" podID="1ed344a6-aa34-406b-9a62-7c66a2025646" containerID="c90d7dcef36bec28f82adbb4b3b0ae90b278ec9c12030e7fd8f1c23c276a85b1" exitCode=0 Nov 21 13:36:39 crc kubenswrapper[4769]: I1121 13:36:39.372090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" event={"ID":"1ed344a6-aa34-406b-9a62-7c66a2025646","Type":"ContainerDied","Data":"c90d7dcef36bec28f82adbb4b3b0ae90b278ec9c12030e7fd8f1c23c276a85b1"} Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.711159 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.863570 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-inventory\") pod \"1ed344a6-aa34-406b-9a62-7c66a2025646\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.863663 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjxzw\" (UniqueName: \"kubernetes.io/projected/1ed344a6-aa34-406b-9a62-7c66a2025646-kube-api-access-qjxzw\") pod \"1ed344a6-aa34-406b-9a62-7c66a2025646\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.863826 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-ssh-key\") pod \"1ed344a6-aa34-406b-9a62-7c66a2025646\" (UID: \"1ed344a6-aa34-406b-9a62-7c66a2025646\") " Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.873529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed344a6-aa34-406b-9a62-7c66a2025646-kube-api-access-qjxzw" (OuterVolumeSpecName: "kube-api-access-qjxzw") pod "1ed344a6-aa34-406b-9a62-7c66a2025646" (UID: "1ed344a6-aa34-406b-9a62-7c66a2025646"). InnerVolumeSpecName "kube-api-access-qjxzw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.894182 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "1ed344a6-aa34-406b-9a62-7c66a2025646" (UID: "1ed344a6-aa34-406b-9a62-7c66a2025646"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.897456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-inventory" (OuterVolumeSpecName: "inventory") pod "1ed344a6-aa34-406b-9a62-7c66a2025646" (UID: "1ed344a6-aa34-406b-9a62-7c66a2025646"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.966118 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.966158 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qjxzw\" (UniqueName: \"kubernetes.io/projected/1ed344a6-aa34-406b-9a62-7c66a2025646-kube-api-access-qjxzw\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:40 crc kubenswrapper[4769]: I1121 13:36:40.966171 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/1ed344a6-aa34-406b-9a62-7c66a2025646-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.325113 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.325231 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.325315 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.326172 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"3203ba8b908976be79eb54d6b4e43f9921c02402288782dcf7a45861fd5e1ffc"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.326318 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://3203ba8b908976be79eb54d6b4e43f9921c02402288782dcf7a45861fd5e1ffc" gracePeriod=600 Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.397098 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" event={"ID":"1ed344a6-aa34-406b-9a62-7c66a2025646","Type":"ContainerDied","Data":"62568a7851cc9e873de495c0e961373a73129a3cfd479e94f3ea78efa8f79844"} Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.397176 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62568a7851cc9e873de495c0e961373a73129a3cfd479e94f3ea78efa8f79844" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.397311 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.461313 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg"] Nov 21 13:36:41 crc kubenswrapper[4769]: E1121 13:36:41.461690 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1ed344a6-aa34-406b-9a62-7c66a2025646" containerName="configure-network-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.461713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed344a6-aa34-406b-9a62-7c66a2025646" containerName="configure-network-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.461912 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1ed344a6-aa34-406b-9a62-7c66a2025646" containerName="configure-network-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.462435 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.465037 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.465184 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.465332 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.465052 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.476665 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg"] Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.576286 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-ssh-key\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.576340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhnkx\" (UniqueName: \"kubernetes.io/projected/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-kube-api-access-fhnkx\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.576403 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.680757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-ssh-key\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.680866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fhnkx\" (UniqueName: \"kubernetes.io/projected/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-kube-api-access-fhnkx\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.681103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.684302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-ssh-key\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.684467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-inventory\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.696153 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhnkx\" (UniqueName: \"kubernetes.io/projected/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-kube-api-access-fhnkx\") pod \"validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:41 crc kubenswrapper[4769]: I1121 13:36:41.808601 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:42 crc kubenswrapper[4769]: I1121 13:36:42.254092 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg"] Nov 21 13:36:42 crc kubenswrapper[4769]: W1121 13:36:42.264740 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdc4a9d8_8577_4f0b_86a9_7688d4b05cc0.slice/crio-0e9b94eb41a27d7a438c14953fcb1a7ca2f7d9d61ad9b3a036730d105f7ee898 WatchSource:0}: Error finding container 0e9b94eb41a27d7a438c14953fcb1a7ca2f7d9d61ad9b3a036730d105f7ee898: Status 404 returned error can't find the container with id 0e9b94eb41a27d7a438c14953fcb1a7ca2f7d9d61ad9b3a036730d105f7ee898 Nov 21 13:36:42 crc kubenswrapper[4769]: I1121 13:36:42.427559 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="3203ba8b908976be79eb54d6b4e43f9921c02402288782dcf7a45861fd5e1ffc" exitCode=0 Nov 21 13:36:42 crc kubenswrapper[4769]: I1121 13:36:42.427628 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"3203ba8b908976be79eb54d6b4e43f9921c02402288782dcf7a45861fd5e1ffc"} Nov 21 13:36:42 crc kubenswrapper[4769]: I1121 13:36:42.428043 4769 scope.go:117] "RemoveContainer" containerID="fbdc19bf76fafe9dcb5c1ed3941672296d8171aeca1e44cb6c4d054fe99fafb6" Nov 21 13:36:42 crc kubenswrapper[4769]: I1121 13:36:42.430512 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" event={"ID":"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0","Type":"ContainerStarted","Data":"0e9b94eb41a27d7a438c14953fcb1a7ca2f7d9d61ad9b3a036730d105f7ee898"} Nov 21 13:36:43 crc kubenswrapper[4769]: I1121 13:36:43.439156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0"} Nov 21 13:36:43 crc kubenswrapper[4769]: I1121 13:36:43.440572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" event={"ID":"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0","Type":"ContainerStarted","Data":"c103bbe9530001a0f7cb3f97e701e5841203a64ccfd3e7337732ea0aa489453b"} Nov 21 13:36:43 crc kubenswrapper[4769]: I1121 13:36:43.470610 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" podStartSLOduration=1.893909039 podStartE2EDuration="2.470592359s" podCreationTimestamp="2025-11-21 13:36:41 +0000 UTC" firstStartedPulling="2025-11-21 13:36:42.266748431 +0000 UTC m=+6360.967410249" lastFinishedPulling="2025-11-21 13:36:42.843431731 +0000 UTC m=+6361.544093569" observedRunningTime="2025-11-21 13:36:43.469265183 +0000 UTC m=+6362.169927001" watchObservedRunningTime="2025-11-21 13:36:43.470592359 +0000 UTC m=+6362.171254177" Nov 21 13:36:44 crc kubenswrapper[4769]: I1121 13:36:44.449042 4769 generic.go:334] "Generic (PLEG): container finished" podID="fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" containerID="c103bbe9530001a0f7cb3f97e701e5841203a64ccfd3e7337732ea0aa489453b" exitCode=0 Nov 21 13:36:44 crc kubenswrapper[4769]: I1121 13:36:44.449116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" event={"ID":"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0","Type":"ContainerDied","Data":"c103bbe9530001a0f7cb3f97e701e5841203a64ccfd3e7337732ea0aa489453b"} Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.758567 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.842782 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-ssh-key\") pod \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.842941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhnkx\" (UniqueName: \"kubernetes.io/projected/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-kube-api-access-fhnkx\") pod \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.842988 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-inventory\") pod \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\" (UID: \"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0\") " Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.851446 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-kube-api-access-fhnkx" (OuterVolumeSpecName: "kube-api-access-fhnkx") pod "fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" (UID: "fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0"). InnerVolumeSpecName "kube-api-access-fhnkx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.867707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-inventory" (OuterVolumeSpecName: "inventory") pod "fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" (UID: "fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.872304 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" (UID: "fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.944086 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.944114 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fhnkx\" (UniqueName: \"kubernetes.io/projected/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-kube-api-access-fhnkx\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:45 crc kubenswrapper[4769]: I1121 13:36:45.944129 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.374738 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8"] Nov 21 13:36:46 crc kubenswrapper[4769]: E1121 13:36:46.375447 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" containerName="validate-network-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.375492 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" containerName="validate-network-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.375871 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" containerName="validate-network-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.376895 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.390762 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8"] Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.451565 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-ssh-key\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.451634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjt2b\" (UniqueName: \"kubernetes.io/projected/251027e1-3980-4953-bc55-14ae01478d65-kube-api-access-tjt2b\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.451674 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.466810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" event={"ID":"fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0","Type":"ContainerDied","Data":"0e9b94eb41a27d7a438c14953fcb1a7ca2f7d9d61ad9b3a036730d105f7ee898"} Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.466852 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e9b94eb41a27d7a438c14953fcb1a7ca2f7d9d61ad9b3a036730d105f7ee898" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.466874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.553740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-ssh-key\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.553827 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tjt2b\" (UniqueName: \"kubernetes.io/projected/251027e1-3980-4953-bc55-14ae01478d65-kube-api-access-tjt2b\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.553873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.558085 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-ssh-key\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.558519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-inventory\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.580946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjt2b\" (UniqueName: \"kubernetes.io/projected/251027e1-3980-4953-bc55-14ae01478d65-kube-api-access-tjt2b\") pod \"install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:46 crc kubenswrapper[4769]: I1121 13:36:46.769234 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:47 crc kubenswrapper[4769]: I1121 13:36:47.180739 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8"] Nov 21 13:36:47 crc kubenswrapper[4769]: I1121 13:36:47.191871 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:36:47 crc kubenswrapper[4769]: I1121 13:36:47.475707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" event={"ID":"251027e1-3980-4953-bc55-14ae01478d65","Type":"ContainerStarted","Data":"a14f006c6c6190e6e70c1be0b09d14e5c46f577419218cfcd737f9d6e5009ab8"} Nov 21 13:36:49 crc kubenswrapper[4769]: I1121 13:36:49.499595 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" event={"ID":"251027e1-3980-4953-bc55-14ae01478d65","Type":"ContainerStarted","Data":"a1f2184e25b8e75aaf7e60ce883950cdf40aca0ae3339e962ad5218f38ad6bd6"} Nov 21 13:36:49 crc kubenswrapper[4769]: I1121 13:36:49.522531 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" podStartSLOduration=2.365372614 podStartE2EDuration="3.522508295s" podCreationTimestamp="2025-11-21 13:36:46 +0000 UTC" firstStartedPulling="2025-11-21 13:36:47.191629653 +0000 UTC m=+6365.892291471" lastFinishedPulling="2025-11-21 13:36:48.348765334 +0000 UTC m=+6367.049427152" observedRunningTime="2025-11-21 13:36:49.513527107 +0000 UTC m=+6368.214188985" watchObservedRunningTime="2025-11-21 13:36:49.522508295 +0000 UTC m=+6368.223170133" Nov 21 13:36:50 crc kubenswrapper[4769]: I1121 13:36:50.508628 4769 generic.go:334] "Generic (PLEG): container finished" podID="251027e1-3980-4953-bc55-14ae01478d65" containerID="a1f2184e25b8e75aaf7e60ce883950cdf40aca0ae3339e962ad5218f38ad6bd6" exitCode=0 Nov 21 13:36:50 crc kubenswrapper[4769]: I1121 13:36:50.508676 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" event={"ID":"251027e1-3980-4953-bc55-14ae01478d65","Type":"ContainerDied","Data":"a1f2184e25b8e75aaf7e60ce883950cdf40aca0ae3339e962ad5218f38ad6bd6"} Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.794091 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.947064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-inventory\") pod \"251027e1-3980-4953-bc55-14ae01478d65\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.947237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-ssh-key\") pod \"251027e1-3980-4953-bc55-14ae01478d65\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.947349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjt2b\" (UniqueName: \"kubernetes.io/projected/251027e1-3980-4953-bc55-14ae01478d65-kube-api-access-tjt2b\") pod \"251027e1-3980-4953-bc55-14ae01478d65\" (UID: \"251027e1-3980-4953-bc55-14ae01478d65\") " Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.953127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251027e1-3980-4953-bc55-14ae01478d65-kube-api-access-tjt2b" (OuterVolumeSpecName: "kube-api-access-tjt2b") pod "251027e1-3980-4953-bc55-14ae01478d65" (UID: "251027e1-3980-4953-bc55-14ae01478d65"). InnerVolumeSpecName "kube-api-access-tjt2b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.970219 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "251027e1-3980-4953-bc55-14ae01478d65" (UID: "251027e1-3980-4953-bc55-14ae01478d65"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:51 crc kubenswrapper[4769]: I1121 13:36:51.972573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-inventory" (OuterVolumeSpecName: "inventory") pod "251027e1-3980-4953-bc55-14ae01478d65" (UID: "251027e1-3980-4953-bc55-14ae01478d65"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.048592 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.048636 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tjt2b\" (UniqueName: \"kubernetes.io/projected/251027e1-3980-4953-bc55-14ae01478d65-kube-api-access-tjt2b\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.048653 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/251027e1-3980-4953-bc55-14ae01478d65-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.529215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" event={"ID":"251027e1-3980-4953-bc55-14ae01478d65","Type":"ContainerDied","Data":"a14f006c6c6190e6e70c1be0b09d14e5c46f577419218cfcd737f9d6e5009ab8"} Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.529260 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a14f006c6c6190e6e70c1be0b09d14e5c46f577419218cfcd737f9d6e5009ab8" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.529265 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.589944 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq"] Nov 21 13:36:52 crc kubenswrapper[4769]: E1121 13:36:52.590339 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="251027e1-3980-4953-bc55-14ae01478d65" containerName="install-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.590357 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="251027e1-3980-4953-bc55-14ae01478d65" containerName="install-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.590524 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="251027e1-3980-4953-bc55-14ae01478d65" containerName="install-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.591035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.594235 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.594379 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.594453 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.599265 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.602367 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq"] Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.759531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.759585 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmnq\" (UniqueName: \"kubernetes.io/projected/affb59a7-889e-4028-bb8e-fea75bb70fd1-kube-api-access-6mmnq\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.759652 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-ssh-key\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.860596 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmnq\" (UniqueName: \"kubernetes.io/projected/affb59a7-889e-4028-bb8e-fea75bb70fd1-kube-api-access-6mmnq\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.860674 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-ssh-key\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.860742 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.864743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-ssh-key\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.864738 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-inventory\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.877740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmnq\" (UniqueName: \"kubernetes.io/projected/affb59a7-889e-4028-bb8e-fea75bb70fd1-kube-api-access-6mmnq\") pod \"configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:52 crc kubenswrapper[4769]: I1121 13:36:52.911745 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:53 crc kubenswrapper[4769]: I1121 13:36:53.343442 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq"] Nov 21 13:36:53 crc kubenswrapper[4769]: I1121 13:36:53.539167 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" event={"ID":"affb59a7-889e-4028-bb8e-fea75bb70fd1","Type":"ContainerStarted","Data":"3323c76d4b2e273054412953bd5fc3762718e99f68f88ba3a1d4abb40c9f9a7c"} Nov 21 13:36:54 crc kubenswrapper[4769]: I1121 13:36:54.550954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" event={"ID":"affb59a7-889e-4028-bb8e-fea75bb70fd1","Type":"ContainerStarted","Data":"0589689ccd2b99331a2bfc62d1da1d32f2979b972eaf8e7ab3ee4a1a9a6e9533"} Nov 21 13:36:54 crc kubenswrapper[4769]: I1121 13:36:54.572878 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" podStartSLOduration=2.107321236 podStartE2EDuration="2.572852161s" podCreationTimestamp="2025-11-21 13:36:52 +0000 UTC" firstStartedPulling="2025-11-21 13:36:53.349177238 +0000 UTC m=+6372.049839056" lastFinishedPulling="2025-11-21 13:36:53.814708143 +0000 UTC m=+6372.515369981" observedRunningTime="2025-11-21 13:36:54.57053826 +0000 UTC m=+6373.271200078" watchObservedRunningTime="2025-11-21 13:36:54.572852161 +0000 UTC m=+6373.273513989" Nov 21 13:36:55 crc kubenswrapper[4769]: I1121 13:36:55.563975 4769 generic.go:334] "Generic (PLEG): container finished" podID="affb59a7-889e-4028-bb8e-fea75bb70fd1" containerID="0589689ccd2b99331a2bfc62d1da1d32f2979b972eaf8e7ab3ee4a1a9a6e9533" exitCode=0 Nov 21 13:36:55 crc kubenswrapper[4769]: I1121 13:36:55.564105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" event={"ID":"affb59a7-889e-4028-bb8e-fea75bb70fd1","Type":"ContainerDied","Data":"0589689ccd2b99331a2bfc62d1da1d32f2979b972eaf8e7ab3ee4a1a9a6e9533"} Nov 21 13:36:56 crc kubenswrapper[4769]: I1121 13:36:56.951647 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.122517 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-inventory\") pod \"affb59a7-889e-4028-bb8e-fea75bb70fd1\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.122614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mmnq\" (UniqueName: \"kubernetes.io/projected/affb59a7-889e-4028-bb8e-fea75bb70fd1-kube-api-access-6mmnq\") pod \"affb59a7-889e-4028-bb8e-fea75bb70fd1\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.122699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-ssh-key\") pod \"affb59a7-889e-4028-bb8e-fea75bb70fd1\" (UID: \"affb59a7-889e-4028-bb8e-fea75bb70fd1\") " Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.132269 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/affb59a7-889e-4028-bb8e-fea75bb70fd1-kube-api-access-6mmnq" (OuterVolumeSpecName: "kube-api-access-6mmnq") pod "affb59a7-889e-4028-bb8e-fea75bb70fd1" (UID: "affb59a7-889e-4028-bb8e-fea75bb70fd1"). InnerVolumeSpecName "kube-api-access-6mmnq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.163290 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "affb59a7-889e-4028-bb8e-fea75bb70fd1" (UID: "affb59a7-889e-4028-bb8e-fea75bb70fd1"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.167420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-inventory" (OuterVolumeSpecName: "inventory") pod "affb59a7-889e-4028-bb8e-fea75bb70fd1" (UID: "affb59a7-889e-4028-bb8e-fea75bb70fd1"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.225055 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6mmnq\" (UniqueName: \"kubernetes.io/projected/affb59a7-889e-4028-bb8e-fea75bb70fd1-kube-api-access-6mmnq\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.225107 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.225120 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/affb59a7-889e-4028-bb8e-fea75bb70fd1-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.813162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" event={"ID":"affb59a7-889e-4028-bb8e-fea75bb70fd1","Type":"ContainerDied","Data":"3323c76d4b2e273054412953bd5fc3762718e99f68f88ba3a1d4abb40c9f9a7c"} Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.813286 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3323c76d4b2e273054412953bd5fc3762718e99f68f88ba3a1d4abb40c9f9a7c" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.813384 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.858772 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt"] Nov 21 13:36:57 crc kubenswrapper[4769]: E1121 13:36:57.859215 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="affb59a7-889e-4028-bb8e-fea75bb70fd1" containerName="configure-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.859242 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="affb59a7-889e-4028-bb8e-fea75bb70fd1" containerName="configure-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.859479 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="affb59a7-889e-4028-bb8e-fea75bb70fd1" containerName="configure-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.860165 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.862337 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.863711 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.864778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.869509 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.874878 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4r7r\" (UniqueName: \"kubernetes.io/projected/3e766d9c-2541-4ff7-a6a0-630e28e9d181-kube-api-access-z4r7r\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.874990 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-ssh-key\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.875220 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.877372 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt"] Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.975811 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.975871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z4r7r\" (UniqueName: \"kubernetes.io/projected/3e766d9c-2541-4ff7-a6a0-630e28e9d181-kube-api-access-z4r7r\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.975918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-ssh-key\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.981080 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-inventory\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.981136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-ssh-key\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:57 crc kubenswrapper[4769]: I1121 13:36:57.999078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4r7r\" (UniqueName: \"kubernetes.io/projected/3e766d9c-2541-4ff7-a6a0-630e28e9d181-kube-api-access-z4r7r\") pod \"run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:58 crc kubenswrapper[4769]: I1121 13:36:58.187216 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:36:58 crc kubenswrapper[4769]: I1121 13:36:58.716615 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt"] Nov 21 13:36:58 crc kubenswrapper[4769]: I1121 13:36:58.824549 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" event={"ID":"3e766d9c-2541-4ff7-a6a0-630e28e9d181","Type":"ContainerStarted","Data":"36823e54266d49456b4805f8101d88cdfcef90df57747d3a9a20cfbddb2e574a"} Nov 21 13:37:00 crc kubenswrapper[4769]: I1121 13:37:00.848487 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" event={"ID":"3e766d9c-2541-4ff7-a6a0-630e28e9d181","Type":"ContainerStarted","Data":"217e68a0f7b098d5ee8095964a93b50ae6c4af974ba23ecd3e36ac3bcb44a7bb"} Nov 21 13:37:00 crc kubenswrapper[4769]: I1121 13:37:00.868128 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" podStartSLOduration=2.955982856 podStartE2EDuration="3.868092684s" podCreationTimestamp="2025-11-21 13:36:57 +0000 UTC" firstStartedPulling="2025-11-21 13:36:58.722441802 +0000 UTC m=+6377.423103650" lastFinishedPulling="2025-11-21 13:36:59.63455164 +0000 UTC m=+6378.335213478" observedRunningTime="2025-11-21 13:37:00.867340214 +0000 UTC m=+6379.568002072" watchObservedRunningTime="2025-11-21 13:37:00.868092684 +0000 UTC m=+6379.568754522" Nov 21 13:37:01 crc kubenswrapper[4769]: I1121 13:37:01.863933 4769 generic.go:334] "Generic (PLEG): container finished" podID="3e766d9c-2541-4ff7-a6a0-630e28e9d181" containerID="217e68a0f7b098d5ee8095964a93b50ae6c4af974ba23ecd3e36ac3bcb44a7bb" exitCode=0 Nov 21 13:37:01 crc kubenswrapper[4769]: I1121 13:37:01.864019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" event={"ID":"3e766d9c-2541-4ff7-a6a0-630e28e9d181","Type":"ContainerDied","Data":"217e68a0f7b098d5ee8095964a93b50ae6c4af974ba23ecd3e36ac3bcb44a7bb"} Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.605120 4769 scope.go:117] "RemoveContainer" containerID="6dc58fe6b3bc94bec17c325ce571dee6eec0f3e2bd79cba50ff4466c3bef9ea7" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.654148 4769 scope.go:117] "RemoveContainer" containerID="0b47fd97f42e7d7418c949d671a776e512c1828be96f588b395011d8ec32c245" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.684591 4769 scope.go:117] "RemoveContainer" containerID="707274123a06609799fb4c6e275902f87ccd36312dd3b8c34c865b6cd39cbb3b" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.726235 4769 scope.go:117] "RemoveContainer" containerID="f5e9f80e4a56f8b2f47cdcec128544bbf316191d7341e57bee5ac75b2fd6693a" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.759929 4769 scope.go:117] "RemoveContainer" containerID="0c7d8f0d4a291e93c586e7e3a5cf97abc44001f7dffd50961e74236b19edf340" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.799776 4769 scope.go:117] "RemoveContainer" containerID="26dd8c9e6b3cc8ad4cc9136d281480066d5dea4e95b2460d38ea0c967de2200f" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.831049 4769 scope.go:117] "RemoveContainer" containerID="6f8882b9c0d9aa615595934a75f6b25cf9ed6e615ceb3523a760989c1eec614c" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.860439 4769 scope.go:117] "RemoveContainer" containerID="dfaa04fb80695ae0acbae0c9f0190413f7f3dade68a54cf4dc9440c04b4a5d7f" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.911419 4769 scope.go:117] "RemoveContainer" containerID="c0f99b9925bf2589e224c1e4e21884c55431cf77769a709bfd7cd0c27bf218e5" Nov 21 13:37:02 crc kubenswrapper[4769]: I1121 13:37:02.940934 4769 scope.go:117] "RemoveContainer" containerID="ef59659272e55d987fcd1b7eb02dc35823ed22551a14ece03bc801fa2e9cf8d0" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.178142 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.371392 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-ssh-key\") pod \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.371447 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-inventory\") pod \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.371562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4r7r\" (UniqueName: \"kubernetes.io/projected/3e766d9c-2541-4ff7-a6a0-630e28e9d181-kube-api-access-z4r7r\") pod \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\" (UID: \"3e766d9c-2541-4ff7-a6a0-630e28e9d181\") " Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.376908 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e766d9c-2541-4ff7-a6a0-630e28e9d181-kube-api-access-z4r7r" (OuterVolumeSpecName: "kube-api-access-z4r7r") pod "3e766d9c-2541-4ff7-a6a0-630e28e9d181" (UID: "3e766d9c-2541-4ff7-a6a0-630e28e9d181"). InnerVolumeSpecName "kube-api-access-z4r7r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.393547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-inventory" (OuterVolumeSpecName: "inventory") pod "3e766d9c-2541-4ff7-a6a0-630e28e9d181" (UID: "3e766d9c-2541-4ff7-a6a0-630e28e9d181"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.398816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "3e766d9c-2541-4ff7-a6a0-630e28e9d181" (UID: "3e766d9c-2541-4ff7-a6a0-630e28e9d181"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.473093 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.473122 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/3e766d9c-2541-4ff7-a6a0-630e28e9d181-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.473135 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z4r7r\" (UniqueName: \"kubernetes.io/projected/3e766d9c-2541-4ff7-a6a0-630e28e9d181-kube-api-access-z4r7r\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.903417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" event={"ID":"3e766d9c-2541-4ff7-a6a0-630e28e9d181","Type":"ContainerDied","Data":"36823e54266d49456b4805f8101d88cdfcef90df57747d3a9a20cfbddb2e574a"} Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.903492 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36823e54266d49456b4805f8101d88cdfcef90df57747d3a9a20cfbddb2e574a" Nov 21 13:37:03 crc kubenswrapper[4769]: I1121 13:37:03.903546 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.005246 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6"] Nov 21 13:37:04 crc kubenswrapper[4769]: E1121 13:37:04.005593 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3e766d9c-2541-4ff7-a6a0-630e28e9d181" containerName="run-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.005609 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e766d9c-2541-4ff7-a6a0-630e28e9d181" containerName="run-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.005792 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3e766d9c-2541-4ff7-a6a0-630e28e9d181" containerName="run-os-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.006278 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.009146 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.009515 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.009985 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.010211 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6"] Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.011769 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.011832 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185070 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185177 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185250 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8k8h\" (UniqueName: \"kubernetes.io/projected/4143001e-4d11-4c31-9fef-1a137e8b73fc-kube-api-access-z8k8h\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ssh-key\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185446 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185609 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.185648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.287536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.287924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.287965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.287986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288049 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288157 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288200 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z8k8h\" (UniqueName: \"kubernetes.io/projected/4143001e-4d11-4c31-9fef-1a137e8b73fc-kube-api-access-z8k8h\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ssh-key\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.288267 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.294484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-metadata-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.295057 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-nova-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.295689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-sriov-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.299483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ssh-key\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.303092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.303468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ovn-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.310513 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-libvirt-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.311760 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-dhcp-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.313803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-inventory\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.317641 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-bootstrap-combined-ca-bundle\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.322553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8k8h\" (UniqueName: \"kubernetes.io/projected/4143001e-4d11-4c31-9fef-1a137e8b73fc-kube-api-access-z8k8h\") pod \"install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.327523 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.737918 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6"] Nov 21 13:37:04 crc kubenswrapper[4769]: I1121 13:37:04.914248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" event={"ID":"4143001e-4d11-4c31-9fef-1a137e8b73fc","Type":"ContainerStarted","Data":"17d39b6c8968253e2d2a478d959046c03170f4fe9ff3a76a2c18f320b87d6e2f"} Nov 21 13:37:06 crc kubenswrapper[4769]: I1121 13:37:06.946517 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" event={"ID":"4143001e-4d11-4c31-9fef-1a137e8b73fc","Type":"ContainerStarted","Data":"3fb75fc1f78f0526a6c21a6a96193500e4b2feb3e2c978319f87736a4c70be7b"} Nov 21 13:37:06 crc kubenswrapper[4769]: I1121 13:37:06.969280 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" podStartSLOduration=3.187677395 podStartE2EDuration="3.969257745s" podCreationTimestamp="2025-11-21 13:37:03 +0000 UTC" firstStartedPulling="2025-11-21 13:37:04.755691592 +0000 UTC m=+6383.456353420" lastFinishedPulling="2025-11-21 13:37:05.537271932 +0000 UTC m=+6384.237933770" observedRunningTime="2025-11-21 13:37:06.963865012 +0000 UTC m=+6385.664526880" watchObservedRunningTime="2025-11-21 13:37:06.969257745 +0000 UTC m=+6385.669919563" Nov 21 13:37:07 crc kubenswrapper[4769]: I1121 13:37:07.961118 4769 generic.go:334] "Generic (PLEG): container finished" podID="4143001e-4d11-4c31-9fef-1a137e8b73fc" containerID="3fb75fc1f78f0526a6c21a6a96193500e4b2feb3e2c978319f87736a4c70be7b" exitCode=0 Nov 21 13:37:07 crc kubenswrapper[4769]: I1121 13:37:07.961159 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" event={"ID":"4143001e-4d11-4c31-9fef-1a137e8b73fc","Type":"ContainerDied","Data":"3fb75fc1f78f0526a6c21a6a96193500e4b2feb3e2c978319f87736a4c70be7b"} Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.330350 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.484876 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-bootstrap-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.484996 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8k8h\" (UniqueName: \"kubernetes.io/projected/4143001e-4d11-4c31-9fef-1a137e8b73fc-kube-api-access-z8k8h\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485043 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-metadata-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485072 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-sriov-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485094 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-libvirt-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-inventory\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485183 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ssh-key\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-dhcp-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485279 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-ovn-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-nova-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.485345 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ovn-combined-ca-bundle\") pod \"4143001e-4d11-4c31-9fef-1a137e8b73fc\" (UID: \"4143001e-4d11-4c31-9fef-1a137e8b73fc\") " Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.491606 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.492125 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-bootstrap-combined-ca-bundle" (OuterVolumeSpecName: "bootstrap-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "bootstrap-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.492152 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.492286 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.492325 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.492341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.492600 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.493144 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4143001e-4d11-4c31-9fef-1a137e8b73fc-kube-api-access-z8k8h" (OuterVolumeSpecName: "kube-api-access-z8k8h") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "kube-api-access-z8k8h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.493915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.510965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.519134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-inventory" (OuterVolumeSpecName: "inventory") pod "4143001e-4d11-4c31-9fef-1a137e8b73fc" (UID: "4143001e-4d11-4c31-9fef-1a137e8b73fc"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.586957 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z8k8h\" (UniqueName: \"kubernetes.io/projected/4143001e-4d11-4c31-9fef-1a137e8b73fc-kube-api-access-z8k8h\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.586992 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587007 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587016 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587025 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587034 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587044 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587056 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587066 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587075 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.587083 4769 reconciler_common.go:293] "Volume detached for volume \"bootstrap-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4143001e-4d11-4c31-9fef-1a137e8b73fc-bootstrap-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.709206 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-jmdg6"] Nov 21 13:37:09 crc kubenswrapper[4769]: E1121 13:37:09.709610 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4143001e-4d11-4c31-9fef-1a137e8b73fc" containerName="install-certs-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.709634 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4143001e-4d11-4c31-9fef-1a137e8b73fc" containerName="install-certs-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.709837 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4143001e-4d11-4c31-9fef-1a137e8b73fc" containerName="install-certs-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.710964 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.726661 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-jmdg6"] Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.790281 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-utilities\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.790361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-catalog-content\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.790423 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqhfw\" (UniqueName: \"kubernetes.io/projected/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-kube-api-access-sqhfw\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.891856 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-catalog-content\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.891918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sqhfw\" (UniqueName: \"kubernetes.io/projected/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-kube-api-access-sqhfw\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.891991 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-utilities\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.892401 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-catalog-content\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.892411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-utilities\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.910452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqhfw\" (UniqueName: \"kubernetes.io/projected/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-kube-api-access-sqhfw\") pod \"community-operators-jmdg6\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.980719 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" event={"ID":"4143001e-4d11-4c31-9fef-1a137e8b73fc","Type":"ContainerDied","Data":"17d39b6c8968253e2d2a478d959046c03170f4fe9ff3a76a2c18f320b87d6e2f"} Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.980767 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17d39b6c8968253e2d2a478d959046c03170f4fe9ff3a76a2c18f320b87d6e2f" Nov 21 13:37:09 crc kubenswrapper[4769]: I1121 13:37:09.980767 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.033111 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.054015 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq"] Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.055596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.062771 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.062839 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.062855 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.063083 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"ovncontroller-config" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.063152 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.063228 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.065073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq"] Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.094556 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.094644 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.094695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwr5f\" (UniqueName: \"kubernetes.io/projected/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-kube-api-access-fwr5f\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.094755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.094818 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ssh-key\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.196132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fwr5f\" (UniqueName: \"kubernetes.io/projected/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-kube-api-access-fwr5f\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.196251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.196318 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ssh-key\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.196344 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.196394 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.210257 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovn-combined-ca-bundle\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.211053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovncontroller-config-0\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.211915 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ssh-key\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.214848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-inventory\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.228402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwr5f\" (UniqueName: \"kubernetes.io/projected/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-kube-api-access-fwr5f\") pod \"ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.381286 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.520479 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-jmdg6"] Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.592316 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq"] Nov 21 13:37:10 crc kubenswrapper[4769]: W1121 13:37:10.602555 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94da9eb8_296d_47a1_8f3f_3096c7d6b6f2.slice/crio-738be6d5356b0099664218be8f9f2f8c61612b177d1348bf6f916a62c2ecd287 WatchSource:0}: Error finding container 738be6d5356b0099664218be8f9f2f8c61612b177d1348bf6f916a62c2ecd287: Status 404 returned error can't find the container with id 738be6d5356b0099664218be8f9f2f8c61612b177d1348bf6f916a62c2ecd287 Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.991238 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerID="df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51" exitCode=0 Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.991337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jmdg6" event={"ID":"6d5fd101-97f0-47df-9aa6-1370ea3f86ff","Type":"ContainerDied","Data":"df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51"} Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.991571 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jmdg6" event={"ID":"6d5fd101-97f0-47df-9aa6-1370ea3f86ff","Type":"ContainerStarted","Data":"b2904ded64e0d34b94ce78b76d37168dcd09ee1fb62d7b5e26011bec4b89a4ac"} Nov 21 13:37:10 crc kubenswrapper[4769]: I1121 13:37:10.992964 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" event={"ID":"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2","Type":"ContainerStarted","Data":"738be6d5356b0099664218be8f9f2f8c61612b177d1348bf6f916a62c2ecd287"} Nov 21 13:37:12 crc kubenswrapper[4769]: I1121 13:37:12.014672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" event={"ID":"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2","Type":"ContainerStarted","Data":"d0ae507e5e916298dacf6a76a209318ba9abfdf3903f9a5d36519c64f84d4627"} Nov 21 13:37:12 crc kubenswrapper[4769]: I1121 13:37:12.040579 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" podStartSLOduration=1.420251702 podStartE2EDuration="2.040556337s" podCreationTimestamp="2025-11-21 13:37:10 +0000 UTC" firstStartedPulling="2025-11-21 13:37:10.604877977 +0000 UTC m=+6389.305539795" lastFinishedPulling="2025-11-21 13:37:11.225182612 +0000 UTC m=+6389.925844430" observedRunningTime="2025-11-21 13:37:12.033903921 +0000 UTC m=+6390.734565739" watchObservedRunningTime="2025-11-21 13:37:12.040556337 +0000 UTC m=+6390.741218155" Nov 21 13:37:13 crc kubenswrapper[4769]: I1121 13:37:13.025259 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerID="8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05" exitCode=0 Nov 21 13:37:13 crc kubenswrapper[4769]: I1121 13:37:13.025309 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jmdg6" event={"ID":"6d5fd101-97f0-47df-9aa6-1370ea3f86ff","Type":"ContainerDied","Data":"8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05"} Nov 21 13:37:13 crc kubenswrapper[4769]: I1121 13:37:13.027066 4769 generic.go:334] "Generic (PLEG): container finished" podID="94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" containerID="d0ae507e5e916298dacf6a76a209318ba9abfdf3903f9a5d36519c64f84d4627" exitCode=0 Nov 21 13:37:13 crc kubenswrapper[4769]: I1121 13:37:13.027100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" event={"ID":"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2","Type":"ContainerDied","Data":"d0ae507e5e916298dacf6a76a209318ba9abfdf3903f9a5d36519c64f84d4627"} Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.039649 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jmdg6" event={"ID":"6d5fd101-97f0-47df-9aa6-1370ea3f86ff","Type":"ContainerStarted","Data":"ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0"} Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.061110 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-jmdg6" podStartSLOduration=2.298460455 podStartE2EDuration="5.061092365s" podCreationTimestamp="2025-11-21 13:37:09 +0000 UTC" firstStartedPulling="2025-11-21 13:37:10.993003951 +0000 UTC m=+6389.693665769" lastFinishedPulling="2025-11-21 13:37:13.755635861 +0000 UTC m=+6392.456297679" observedRunningTime="2025-11-21 13:37:14.059926964 +0000 UTC m=+6392.760588782" watchObservedRunningTime="2025-11-21 13:37:14.061092365 +0000 UTC m=+6392.761754183" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.373443 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.465384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovncontroller-config-0\") pod \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.465547 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovn-combined-ca-bundle\") pod \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.465588 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwr5f\" (UniqueName: \"kubernetes.io/projected/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-kube-api-access-fwr5f\") pod \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.465608 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ssh-key\") pod \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.465651 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-inventory\") pod \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\" (UID: \"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2\") " Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.472825 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-kube-api-access-fwr5f" (OuterVolumeSpecName: "kube-api-access-fwr5f") pod "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" (UID: "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2"). InnerVolumeSpecName "kube-api-access-fwr5f". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.474555 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovn-combined-ca-bundle" (OuterVolumeSpecName: "ovn-combined-ca-bundle") pod "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" (UID: "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2"). InnerVolumeSpecName "ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.494359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" (UID: "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.497670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-inventory" (OuterVolumeSpecName: "inventory") pod "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" (UID: "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.497780 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovncontroller-config-0" (OuterVolumeSpecName: "ovncontroller-config-0") pod "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" (UID: "94da9eb8-296d-47a1-8f3f-3096c7d6b6f2"). InnerVolumeSpecName "ovncontroller-config-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.567527 4769 reconciler_common.go:293] "Volume detached for volume \"ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.567760 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fwr5f\" (UniqueName: \"kubernetes.io/projected/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-kube-api-access-fwr5f\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.567822 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.567908 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:14 crc kubenswrapper[4769]: I1121 13:37:14.567965 4769 reconciler_common.go:293] "Volume detached for volume \"ovncontroller-config-0\" (UniqueName: \"kubernetes.io/configmap/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2-ovncontroller-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.054569 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" event={"ID":"94da9eb8-296d-47a1-8f3f-3096c7d6b6f2","Type":"ContainerDied","Data":"738be6d5356b0099664218be8f9f2f8c61612b177d1348bf6f916a62c2ecd287"} Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.054873 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="738be6d5356b0099664218be8f9f2f8c61612b177d1348bf6f916a62c2ecd287" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.054633 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.120948 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9"] Nov 21 13:37:15 crc kubenswrapper[4769]: E1121 13:37:15.121676 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" containerName="ovn-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.121807 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" containerName="ovn-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.122163 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" containerName="ovn-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.122918 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.125435 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-metadata-agent-neutron-config" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.126078 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.126112 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-metadata-neutron-config" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.126577 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.128020 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.128806 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.128916 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9"] Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.130316 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277473 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctlk7\" (UniqueName: \"kubernetes.io/projected/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-kube-api-access-ctlk7\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-ssh-key\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.277816 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379483 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379651 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ctlk7\" (UniqueName: \"kubernetes.io/projected/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-kube-api-access-ctlk7\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-ssh-key\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.379854 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.384303 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-inventory\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.384523 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-ssh-key\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.384590 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-metadata-combined-ca-bundle\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.384789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.385448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-1\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.385682 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-ovn-metadata-agent-neutron-config-0\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.387936 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-2\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.411054 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctlk7\" (UniqueName: \"kubernetes.io/projected/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-kube-api-access-ctlk7\") pod \"neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.464690 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:15 crc kubenswrapper[4769]: I1121 13:37:15.921984 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9"] Nov 21 13:37:16 crc kubenswrapper[4769]: I1121 13:37:16.069445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" event={"ID":"cc16c515-cf5a-4dd8-802a-081c12e6aaaa","Type":"ContainerStarted","Data":"56ea0d02f58907c169562e534402f49374adf056569c6434d1bb93eb44b833ab"} Nov 21 13:37:18 crc kubenswrapper[4769]: I1121 13:37:18.094582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" event={"ID":"cc16c515-cf5a-4dd8-802a-081c12e6aaaa","Type":"ContainerStarted","Data":"5525d3582dbc9b718373aa662c77481f1236e2c4fb965cda073214b007f8f800"} Nov 21 13:37:19 crc kubenswrapper[4769]: I1121 13:37:19.104938 4769 generic.go:334] "Generic (PLEG): container finished" podID="cc16c515-cf5a-4dd8-802a-081c12e6aaaa" containerID="5525d3582dbc9b718373aa662c77481f1236e2c4fb965cda073214b007f8f800" exitCode=0 Nov 21 13:37:19 crc kubenswrapper[4769]: I1121 13:37:19.105036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" event={"ID":"cc16c515-cf5a-4dd8-802a-081c12e6aaaa","Type":"ContainerDied","Data":"5525d3582dbc9b718373aa662c77481f1236e2c4fb965cda073214b007f8f800"} Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.034066 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.034141 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.094157 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.181465 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.336024 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-jmdg6"] Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.472677 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573074 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-1\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573173 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-0\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573270 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-ssh-key\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573311 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctlk7\" (UniqueName: \"kubernetes.io/projected/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-kube-api-access-ctlk7\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573342 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-metadata-combined-ca-bundle\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-ovn-metadata-agent-neutron-config-0\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573452 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-2\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.573485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-inventory\") pod \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\" (UID: \"cc16c515-cf5a-4dd8-802a-081c12e6aaaa\") " Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.580333 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-metadata-combined-ca-bundle" (OuterVolumeSpecName: "neutron-metadata-combined-ca-bundle") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "neutron-metadata-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.581748 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-kube-api-access-ctlk7" (OuterVolumeSpecName: "kube-api-access-ctlk7") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "kube-api-access-ctlk7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.600992 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-0" (OuterVolumeSpecName: "nova-metadata-neutron-config-0") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "nova-metadata-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.601729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-ovn-metadata-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-metadata-agent-neutron-config-0") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "neutron-ovn-metadata-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.603248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.604492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-2" (OuterVolumeSpecName: "nova-metadata-neutron-config-2") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "nova-metadata-neutron-config-2". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.604683 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-inventory" (OuterVolumeSpecName: "inventory") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.613668 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-1" (OuterVolumeSpecName: "nova-metadata-neutron-config-1") pod "cc16c515-cf5a-4dd8-802a-081c12e6aaaa" (UID: "cc16c515-cf5a-4dd8-802a-081c12e6aaaa"). InnerVolumeSpecName "nova-metadata-neutron-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.674973 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-1\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675015 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675024 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675035 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ctlk7\" (UniqueName: \"kubernetes.io/projected/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-kube-api-access-ctlk7\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675048 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-metadata-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-metadata-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675060 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-metadata-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-neutron-ovn-metadata-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675072 4769 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-neutron-config-2\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-nova-metadata-neutron-config-2\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:20 crc kubenswrapper[4769]: I1121 13:37:20.675082 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/cc16c515-cf5a-4dd8-802a-081c12e6aaaa-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.127874 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.127867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9" event={"ID":"cc16c515-cf5a-4dd8-802a-081c12e6aaaa","Type":"ContainerDied","Data":"56ea0d02f58907c169562e534402f49374adf056569c6434d1bb93eb44b833ab"} Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.127930 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56ea0d02f58907c169562e534402f49374adf056569c6434d1bb93eb44b833ab" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.562748 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm"] Nov 21 13:37:21 crc kubenswrapper[4769]: E1121 13:37:21.564074 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cc16c515-cf5a-4dd8-802a-081c12e6aaaa" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.564173 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc16c515-cf5a-4dd8-802a-081c12e6aaaa" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.564488 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cc16c515-cf5a-4dd8-802a-081c12e6aaaa" containerName="neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.565091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.567370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.569109 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-ovn-agent-neutron-config" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.569365 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.569528 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.569710 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.569935 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.574878 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm"] Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.691978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.692134 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.692164 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.692341 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zk2l\" (UniqueName: \"kubernetes.io/projected/6f265b52-af41-4974-a47e-fc6d63c98cb3-kube-api-access-4zk2l\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.692428 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-ssh-key\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.793680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.793772 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.793801 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.793846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4zk2l\" (UniqueName: \"kubernetes.io/projected/6f265b52-af41-4974-a47e-fc6d63c98cb3-kube-api-access-4zk2l\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.793896 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-ssh-key\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.798704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-ssh-key\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.799181 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-agent-neutron-config-0\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.799647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-combined-ca-bundle\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.799937 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-inventory\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.816569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zk2l\" (UniqueName: \"kubernetes.io/projected/6f265b52-af41-4974-a47e-fc6d63c98cb3-kube-api-access-4zk2l\") pod \"neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:21 crc kubenswrapper[4769]: I1121 13:37:21.925496 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:22 crc kubenswrapper[4769]: I1121 13:37:22.142026 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-jmdg6" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="registry-server" containerID="cri-o://ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0" gracePeriod=2 Nov 21 13:37:22 crc kubenswrapper[4769]: I1121 13:37:22.235439 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm"] Nov 21 13:37:22 crc kubenswrapper[4769]: W1121 13:37:22.240423 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f265b52_af41_4974_a47e_fc6d63c98cb3.slice/crio-9c57518c1571ac680e784c6899da5bfa1441b4e1a9f0145ce9cfa40a0f713f1c WatchSource:0}: Error finding container 9c57518c1571ac680e784c6899da5bfa1441b4e1a9f0145ce9cfa40a0f713f1c: Status 404 returned error can't find the container with id 9c57518c1571ac680e784c6899da5bfa1441b4e1a9f0145ce9cfa40a0f713f1c Nov 21 13:37:22 crc kubenswrapper[4769]: I1121 13:37:22.840358 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.014426 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-utilities\") pod \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.014550 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqhfw\" (UniqueName: \"kubernetes.io/projected/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-kube-api-access-sqhfw\") pod \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.014615 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-catalog-content\") pod \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\" (UID: \"6d5fd101-97f0-47df-9aa6-1370ea3f86ff\") " Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.015816 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-utilities" (OuterVolumeSpecName: "utilities") pod "6d5fd101-97f0-47df-9aa6-1370ea3f86ff" (UID: "6d5fd101-97f0-47df-9aa6-1370ea3f86ff"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.026659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-kube-api-access-sqhfw" (OuterVolumeSpecName: "kube-api-access-sqhfw") pod "6d5fd101-97f0-47df-9aa6-1370ea3f86ff" (UID: "6d5fd101-97f0-47df-9aa6-1370ea3f86ff"). InnerVolumeSpecName "kube-api-access-sqhfw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.101338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "6d5fd101-97f0-47df-9aa6-1370ea3f86ff" (UID: "6d5fd101-97f0-47df-9aa6-1370ea3f86ff"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.116818 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.116893 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sqhfw\" (UniqueName: \"kubernetes.io/projected/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-kube-api-access-sqhfw\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.116913 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6d5fd101-97f0-47df-9aa6-1370ea3f86ff-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.161954 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerID="ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0" exitCode=0 Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.162036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jmdg6" event={"ID":"6d5fd101-97f0-47df-9aa6-1370ea3f86ff","Type":"ContainerDied","Data":"ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0"} Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.162068 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jmdg6" event={"ID":"6d5fd101-97f0-47df-9aa6-1370ea3f86ff","Type":"ContainerDied","Data":"b2904ded64e0d34b94ce78b76d37168dcd09ee1fb62d7b5e26011bec4b89a4ac"} Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.162091 4769 scope.go:117] "RemoveContainer" containerID="ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.162257 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jmdg6" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.168961 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" event={"ID":"6f265b52-af41-4974-a47e-fc6d63c98cb3","Type":"ContainerStarted","Data":"9c57518c1571ac680e784c6899da5bfa1441b4e1a9f0145ce9cfa40a0f713f1c"} Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.201836 4769 scope.go:117] "RemoveContainer" containerID="8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.232237 4769 scope.go:117] "RemoveContainer" containerID="df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.232359 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-jmdg6"] Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.244112 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-jmdg6"] Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.272381 4769 scope.go:117] "RemoveContainer" containerID="ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0" Nov 21 13:37:23 crc kubenswrapper[4769]: E1121 13:37:23.273030 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0\": container with ID starting with ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0 not found: ID does not exist" containerID="ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.273143 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0"} err="failed to get container status \"ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0\": rpc error: code = NotFound desc = could not find container \"ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0\": container with ID starting with ff2127b3fa6b3b2a537639240fc8d73cb562f973b245ed80903876003f0a9cd0 not found: ID does not exist" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.273247 4769 scope.go:117] "RemoveContainer" containerID="8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05" Nov 21 13:37:23 crc kubenswrapper[4769]: E1121 13:37:23.273782 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05\": container with ID starting with 8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05 not found: ID does not exist" containerID="8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.273873 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05"} err="failed to get container status \"8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05\": rpc error: code = NotFound desc = could not find container \"8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05\": container with ID starting with 8f62ca2f3e97633e3d3e43f92c973cf7e4fb8f62a33b55fad5c40e90b15e0b05 not found: ID does not exist" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.273928 4769 scope.go:117] "RemoveContainer" containerID="df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51" Nov 21 13:37:23 crc kubenswrapper[4769]: E1121 13:37:23.274691 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51\": container with ID starting with df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51 not found: ID does not exist" containerID="df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.274746 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51"} err="failed to get container status \"df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51\": rpc error: code = NotFound desc = could not find container \"df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51\": container with ID starting with df2e497b31ecbff492079d99daebbdbd62ed376d51c2800905de56ed1b4c2f51 not found: ID does not exist" Nov 21 13:37:23 crc kubenswrapper[4769]: I1121 13:37:23.292405 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" path="/var/lib/kubelet/pods/6d5fd101-97f0-47df-9aa6-1370ea3f86ff/volumes" Nov 21 13:37:24 crc kubenswrapper[4769]: I1121 13:37:24.180264 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" event={"ID":"6f265b52-af41-4974-a47e-fc6d63c98cb3","Type":"ContainerStarted","Data":"d4a167d91833cfef1cc4d0830248fda7aba17a9e9fd44a25cf14c82d5f240b47"} Nov 21 13:37:24 crc kubenswrapper[4769]: I1121 13:37:24.200237 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" podStartSLOduration=1.8804649709999999 podStartE2EDuration="3.200184849s" podCreationTimestamp="2025-11-21 13:37:21 +0000 UTC" firstStartedPulling="2025-11-21 13:37:22.242658291 +0000 UTC m=+6400.943320109" lastFinishedPulling="2025-11-21 13:37:23.562378129 +0000 UTC m=+6402.263039987" observedRunningTime="2025-11-21 13:37:24.198641828 +0000 UTC m=+6402.899303646" watchObservedRunningTime="2025-11-21 13:37:24.200184849 +0000 UTC m=+6402.900846677" Nov 21 13:37:25 crc kubenswrapper[4769]: I1121 13:37:25.199359 4769 generic.go:334] "Generic (PLEG): container finished" podID="6f265b52-af41-4974-a47e-fc6d63c98cb3" containerID="d4a167d91833cfef1cc4d0830248fda7aba17a9e9fd44a25cf14c82d5f240b47" exitCode=0 Nov 21 13:37:25 crc kubenswrapper[4769]: I1121 13:37:25.199429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" event={"ID":"6f265b52-af41-4974-a47e-fc6d63c98cb3","Type":"ContainerDied","Data":"d4a167d91833cfef1cc4d0830248fda7aba17a9e9fd44a25cf14c82d5f240b47"} Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.603392 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.799414 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-inventory\") pod \"6f265b52-af41-4974-a47e-fc6d63c98cb3\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.799763 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-agent-neutron-config-0\") pod \"6f265b52-af41-4974-a47e-fc6d63c98cb3\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.800508 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-ssh-key\") pod \"6f265b52-af41-4974-a47e-fc6d63c98cb3\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.801027 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-combined-ca-bundle\") pod \"6f265b52-af41-4974-a47e-fc6d63c98cb3\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.801269 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zk2l\" (UniqueName: \"kubernetes.io/projected/6f265b52-af41-4974-a47e-fc6d63c98cb3-kube-api-access-4zk2l\") pod \"6f265b52-af41-4974-a47e-fc6d63c98cb3\" (UID: \"6f265b52-af41-4974-a47e-fc6d63c98cb3\") " Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.806743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f265b52-af41-4974-a47e-fc6d63c98cb3-kube-api-access-4zk2l" (OuterVolumeSpecName: "kube-api-access-4zk2l") pod "6f265b52-af41-4974-a47e-fc6d63c98cb3" (UID: "6f265b52-af41-4974-a47e-fc6d63c98cb3"). InnerVolumeSpecName "kube-api-access-4zk2l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.807469 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-combined-ca-bundle" (OuterVolumeSpecName: "neutron-ovn-combined-ca-bundle") pod "6f265b52-af41-4974-a47e-fc6d63c98cb3" (UID: "6f265b52-af41-4974-a47e-fc6d63c98cb3"). InnerVolumeSpecName "neutron-ovn-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.827900 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "6f265b52-af41-4974-a47e-fc6d63c98cb3" (UID: "6f265b52-af41-4974-a47e-fc6d63c98cb3"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.837280 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-inventory" (OuterVolumeSpecName: "inventory") pod "6f265b52-af41-4974-a47e-fc6d63c98cb3" (UID: "6f265b52-af41-4974-a47e-fc6d63c98cb3"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.842478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-ovn-agent-neutron-config-0") pod "6f265b52-af41-4974-a47e-fc6d63c98cb3" (UID: "6f265b52-af41-4974-a47e-fc6d63c98cb3"). InnerVolumeSpecName "neutron-ovn-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.903324 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.903376 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4zk2l\" (UniqueName: \"kubernetes.io/projected/6f265b52-af41-4974-a47e-fc6d63c98cb3-kube-api-access-4zk2l\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.903396 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.903413 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-ovn-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-neutron-ovn-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:26 crc kubenswrapper[4769]: I1121 13:37:26.903432 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6f265b52-af41-4974-a47e-fc6d63c98cb3-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.227737 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" event={"ID":"6f265b52-af41-4974-a47e-fc6d63c98cb3","Type":"ContainerDied","Data":"9c57518c1571ac680e784c6899da5bfa1441b4e1a9f0145ce9cfa40a0f713f1c"} Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.228354 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c57518c1571ac680e784c6899da5bfa1441b4e1a9f0145ce9cfa40a0f713f1c" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.227821 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.707968 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt"] Nov 21 13:37:27 crc kubenswrapper[4769]: E1121 13:37:27.708373 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="extract-utilities" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.708393 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="extract-utilities" Nov 21 13:37:27 crc kubenswrapper[4769]: E1121 13:37:27.708417 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="extract-content" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.708425 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="extract-content" Nov 21 13:37:27 crc kubenswrapper[4769]: E1121 13:37:27.708437 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f265b52-af41-4974-a47e-fc6d63c98cb3" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.708448 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f265b52-af41-4974-a47e-fc6d63c98cb3" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:27 crc kubenswrapper[4769]: E1121 13:37:27.708464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="registry-server" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.708472 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="registry-server" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.708678 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d5fd101-97f0-47df-9aa6-1370ea3f86ff" containerName="registry-server" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.708691 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f265b52-af41-4974-a47e-fc6d63c98cb3" containerName="neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.709282 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.713025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-sriov-agent-neutron-config" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.713025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.713873 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.714056 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.714265 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.714509 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.722341 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt"] Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.817514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.817561 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.817602 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.817621 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-ssh-key\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.817641 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njh85\" (UniqueName: \"kubernetes.io/projected/22d4644b-f33f-4a94-a34a-c50891049c95-kube-api-access-njh85\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.918922 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.918989 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.919041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.919070 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-ssh-key\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.919098 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-njh85\" (UniqueName: \"kubernetes.io/projected/22d4644b-f33f-4a94-a34a-c50891049c95-kube-api-access-njh85\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.925296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-ssh-key\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.925859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-combined-ca-bundle\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.927088 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-agent-neutron-config-0\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.931763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-inventory\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:27 crc kubenswrapper[4769]: I1121 13:37:27.940757 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-njh85\" (UniqueName: \"kubernetes.io/projected/22d4644b-f33f-4a94-a34a-c50891049c95-kube-api-access-njh85\") pod \"neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:28 crc kubenswrapper[4769]: I1121 13:37:28.074176 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:29 crc kubenswrapper[4769]: I1121 13:37:28.367284 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt"] Nov 21 13:37:29 crc kubenswrapper[4769]: I1121 13:37:29.252917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" event={"ID":"22d4644b-f33f-4a94-a34a-c50891049c95","Type":"ContainerStarted","Data":"d67e57261dde56f7faf6b89ad48ee4ebd12fc02a513115899c51ae6de52b5fdb"} Nov 21 13:37:29 crc kubenswrapper[4769]: I1121 13:37:29.253303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" event={"ID":"22d4644b-f33f-4a94-a34a-c50891049c95","Type":"ContainerStarted","Data":"85c5ba7e16c34834c74df3d65ece941cfe0ac295d82ec321ef9576bbb0e2e841"} Nov 21 13:37:29 crc kubenswrapper[4769]: I1121 13:37:29.277566 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" podStartSLOduration=1.6762873900000002 podStartE2EDuration="2.277546832s" podCreationTimestamp="2025-11-21 13:37:27 +0000 UTC" firstStartedPulling="2025-11-21 13:37:28.371137956 +0000 UTC m=+6407.071799774" lastFinishedPulling="2025-11-21 13:37:28.972397378 +0000 UTC m=+6407.673059216" observedRunningTime="2025-11-21 13:37:29.271742858 +0000 UTC m=+6407.972404706" watchObservedRunningTime="2025-11-21 13:37:29.277546832 +0000 UTC m=+6407.978208650" Nov 21 13:37:31 crc kubenswrapper[4769]: I1121 13:37:31.275082 4769 generic.go:334] "Generic (PLEG): container finished" podID="22d4644b-f33f-4a94-a34a-c50891049c95" containerID="d67e57261dde56f7faf6b89ad48ee4ebd12fc02a513115899c51ae6de52b5fdb" exitCode=0 Nov 21 13:37:31 crc kubenswrapper[4769]: I1121 13:37:31.286303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" event={"ID":"22d4644b-f33f-4a94-a34a-c50891049c95","Type":"ContainerDied","Data":"d67e57261dde56f7faf6b89ad48ee4ebd12fc02a513115899c51ae6de52b5fdb"} Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.679489 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.812951 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-agent-neutron-config-0\") pod \"22d4644b-f33f-4a94-a34a-c50891049c95\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.813009 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njh85\" (UniqueName: \"kubernetes.io/projected/22d4644b-f33f-4a94-a34a-c50891049c95-kube-api-access-njh85\") pod \"22d4644b-f33f-4a94-a34a-c50891049c95\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.813055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-inventory\") pod \"22d4644b-f33f-4a94-a34a-c50891049c95\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.813092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-combined-ca-bundle\") pod \"22d4644b-f33f-4a94-a34a-c50891049c95\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.813118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-ssh-key\") pod \"22d4644b-f33f-4a94-a34a-c50891049c95\" (UID: \"22d4644b-f33f-4a94-a34a-c50891049c95\") " Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.820388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-combined-ca-bundle" (OuterVolumeSpecName: "neutron-sriov-combined-ca-bundle") pod "22d4644b-f33f-4a94-a34a-c50891049c95" (UID: "22d4644b-f33f-4a94-a34a-c50891049c95"). InnerVolumeSpecName "neutron-sriov-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.822591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d4644b-f33f-4a94-a34a-c50891049c95-kube-api-access-njh85" (OuterVolumeSpecName: "kube-api-access-njh85") pod "22d4644b-f33f-4a94-a34a-c50891049c95" (UID: "22d4644b-f33f-4a94-a34a-c50891049c95"). InnerVolumeSpecName "kube-api-access-njh85". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.838846 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-sriov-agent-neutron-config-0") pod "22d4644b-f33f-4a94-a34a-c50891049c95" (UID: "22d4644b-f33f-4a94-a34a-c50891049c95"). InnerVolumeSpecName "neutron-sriov-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.850414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "22d4644b-f33f-4a94-a34a-c50891049c95" (UID: "22d4644b-f33f-4a94-a34a-c50891049c95"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.856004 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-inventory" (OuterVolumeSpecName: "inventory") pod "22d4644b-f33f-4a94-a34a-c50891049c95" (UID: "22d4644b-f33f-4a94-a34a-c50891049c95"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.914294 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.914474 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-njh85\" (UniqueName: \"kubernetes.io/projected/22d4644b-f33f-4a94-a34a-c50891049c95-kube-api-access-njh85\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.914527 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.914575 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-sriov-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-neutron-sriov-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:32 crc kubenswrapper[4769]: I1121 13:37:32.914655 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/22d4644b-f33f-4a94-a34a-c50891049c95-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.309860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" event={"ID":"22d4644b-f33f-4a94-a34a-c50891049c95","Type":"ContainerDied","Data":"85c5ba7e16c34834c74df3d65ece941cfe0ac295d82ec321ef9576bbb0e2e841"} Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.310307 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85c5ba7e16c34834c74df3d65ece941cfe0ac295d82ec321ef9576bbb0e2e841" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.310492 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.397688 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8"] Nov 21 13:37:33 crc kubenswrapper[4769]: E1121 13:37:33.398297 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="22d4644b-f33f-4a94-a34a-c50891049c95" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.398322 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d4644b-f33f-4a94-a34a-c50891049c95" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.398834 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="22d4644b-f33f-4a94-a34a-c50891049c95" containerName="neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.399510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.403776 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.403778 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.404381 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.404455 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.404632 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"neutron-dhcp-agent-neutron-config" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.404878 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.409074 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8"] Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.523360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blvvt\" (UniqueName: \"kubernetes.io/projected/6c14277f-3597-4ac4-862f-4e733142b2a1-kube-api-access-blvvt\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.523437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.523489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.523810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.523915 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-ssh-key\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.625672 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-blvvt\" (UniqueName: \"kubernetes.io/projected/6c14277f-3597-4ac4-862f-4e733142b2a1-kube-api-access-blvvt\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.625741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.625794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.625815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.625833 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-ssh-key\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.630801 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-ssh-key\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.631265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-inventory\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.631350 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-agent-neutron-config-0\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.641948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-combined-ca-bundle\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.643990 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-blvvt\" (UniqueName: \"kubernetes.io/projected/6c14277f-3597-4ac4-862f-4e733142b2a1-kube-api-access-blvvt\") pod \"neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:33 crc kubenswrapper[4769]: I1121 13:37:33.719456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:34 crc kubenswrapper[4769]: I1121 13:37:34.219940 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8"] Nov 21 13:37:34 crc kubenswrapper[4769]: I1121 13:37:34.317928 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" event={"ID":"6c14277f-3597-4ac4-862f-4e733142b2a1","Type":"ContainerStarted","Data":"068f4735d9871efdb2e59d776b30a35b171f9953c26c900210cf3cc2a55a7df4"} Nov 21 13:37:36 crc kubenswrapper[4769]: I1121 13:37:36.346053 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" event={"ID":"6c14277f-3597-4ac4-862f-4e733142b2a1","Type":"ContainerStarted","Data":"d79c1e6ca4905c18eb424e1c27d7973186b5dc004670e512c380b96b73ef2010"} Nov 21 13:37:36 crc kubenswrapper[4769]: I1121 13:37:36.378566 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" podStartSLOduration=2.22048079 podStartE2EDuration="3.378530775s" podCreationTimestamp="2025-11-21 13:37:33 +0000 UTC" firstStartedPulling="2025-11-21 13:37:34.232797281 +0000 UTC m=+6412.933459109" lastFinishedPulling="2025-11-21 13:37:35.390847246 +0000 UTC m=+6414.091509094" observedRunningTime="2025-11-21 13:37:36.36628398 +0000 UTC m=+6415.066945818" watchObservedRunningTime="2025-11-21 13:37:36.378530775 +0000 UTC m=+6415.079192633" Nov 21 13:37:38 crc kubenswrapper[4769]: I1121 13:37:38.369955 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c14277f-3597-4ac4-862f-4e733142b2a1" containerID="d79c1e6ca4905c18eb424e1c27d7973186b5dc004670e512c380b96b73ef2010" exitCode=0 Nov 21 13:37:38 crc kubenswrapper[4769]: I1121 13:37:38.370110 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" event={"ID":"6c14277f-3597-4ac4-862f-4e733142b2a1","Type":"ContainerDied","Data":"d79c1e6ca4905c18eb424e1c27d7973186b5dc004670e512c380b96b73ef2010"} Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.760515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.933420 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-combined-ca-bundle\") pod \"6c14277f-3597-4ac4-862f-4e733142b2a1\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.933491 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-ssh-key\") pod \"6c14277f-3597-4ac4-862f-4e733142b2a1\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.933533 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-agent-neutron-config-0\") pod \"6c14277f-3597-4ac4-862f-4e733142b2a1\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.933602 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-inventory\") pod \"6c14277f-3597-4ac4-862f-4e733142b2a1\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.933645 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blvvt\" (UniqueName: \"kubernetes.io/projected/6c14277f-3597-4ac4-862f-4e733142b2a1-kube-api-access-blvvt\") pod \"6c14277f-3597-4ac4-862f-4e733142b2a1\" (UID: \"6c14277f-3597-4ac4-862f-4e733142b2a1\") " Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.939717 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-combined-ca-bundle" (OuterVolumeSpecName: "neutron-dhcp-combined-ca-bundle") pod "6c14277f-3597-4ac4-862f-4e733142b2a1" (UID: "6c14277f-3597-4ac4-862f-4e733142b2a1"). InnerVolumeSpecName "neutron-dhcp-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.939972 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c14277f-3597-4ac4-862f-4e733142b2a1-kube-api-access-blvvt" (OuterVolumeSpecName: "kube-api-access-blvvt") pod "6c14277f-3597-4ac4-862f-4e733142b2a1" (UID: "6c14277f-3597-4ac4-862f-4e733142b2a1"). InnerVolumeSpecName "kube-api-access-blvvt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.961901 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-inventory" (OuterVolumeSpecName: "inventory") pod "6c14277f-3597-4ac4-862f-4e733142b2a1" (UID: "6c14277f-3597-4ac4-862f-4e733142b2a1"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.970486 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "6c14277f-3597-4ac4-862f-4e733142b2a1" (UID: "6c14277f-3597-4ac4-862f-4e733142b2a1"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:39 crc kubenswrapper[4769]: I1121 13:37:39.972139 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-agent-neutron-config-0" (OuterVolumeSpecName: "neutron-dhcp-agent-neutron-config-0") pod "6c14277f-3597-4ac4-862f-4e733142b2a1" (UID: "6c14277f-3597-4ac4-862f-4e733142b2a1"). InnerVolumeSpecName "neutron-dhcp-agent-neutron-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.035326 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.035376 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-agent-neutron-config-0\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-agent-neutron-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.035391 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.035407 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-blvvt\" (UniqueName: \"kubernetes.io/projected/6c14277f-3597-4ac4-862f-4e733142b2a1-kube-api-access-blvvt\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.035420 4769 reconciler_common.go:293] "Volume detached for volume \"neutron-dhcp-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c14277f-3597-4ac4-862f-4e733142b2a1-neutron-dhcp-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.394039 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" event={"ID":"6c14277f-3597-4ac4-862f-4e733142b2a1","Type":"ContainerDied","Data":"068f4735d9871efdb2e59d776b30a35b171f9953c26c900210cf3cc2a55a7df4"} Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.394082 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="068f4735d9871efdb2e59d776b30a35b171f9953c26c900210cf3cc2a55a7df4" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.394114 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.484056 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp"] Nov 21 13:37:40 crc kubenswrapper[4769]: E1121 13:37:40.484701 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c14277f-3597-4ac4-862f-4e733142b2a1" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.485038 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c14277f-3597-4ac4-862f-4e733142b2a1" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.485389 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c14277f-3597-4ac4-862f-4e733142b2a1" containerName="neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.486148 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.489650 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"libvirt-secret" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.489675 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.489725 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-b867p" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.491970 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.492360 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.492372 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.503094 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp"] Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.644913 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-ssh-key\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.645001 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.645079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s76hn\" (UniqueName: \"kubernetes.io/projected/403d7c27-ae69-4bc7-8219-8d83dcf33530-kube-api-access-s76hn\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.645121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.645294 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.747044 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s76hn\" (UniqueName: \"kubernetes.io/projected/403d7c27-ae69-4bc7-8219-8d83dcf33530-kube-api-access-s76hn\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.747143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.747218 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.747313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-ssh-key\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.747398 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.752383 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-ssh-key\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.752409 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-inventory\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.753026 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-combined-ca-bundle\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.753572 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-secret-0\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.773342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s76hn\" (UniqueName: \"kubernetes.io/projected/403d7c27-ae69-4bc7-8219-8d83dcf33530-kube-api-access-s76hn\") pod \"libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:40 crc kubenswrapper[4769]: I1121 13:37:40.813564 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:41 crc kubenswrapper[4769]: I1121 13:37:41.403903 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp"] Nov 21 13:37:41 crc kubenswrapper[4769]: I1121 13:37:41.412553 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" event={"ID":"403d7c27-ae69-4bc7-8219-8d83dcf33530","Type":"ContainerStarted","Data":"471441743e0f105347bf86e3bc177879d356bf552eb37879ac023f59e86dff85"} Nov 21 13:37:43 crc kubenswrapper[4769]: I1121 13:37:43.439565 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" event={"ID":"403d7c27-ae69-4bc7-8219-8d83dcf33530","Type":"ContainerStarted","Data":"b415f984067eb5bc90e83154a99d4c7b283e283aad5ed322b262055654334e98"} Nov 21 13:37:43 crc kubenswrapper[4769]: I1121 13:37:43.458959 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" podStartSLOduration=2.418188226 podStartE2EDuration="3.458936732s" podCreationTimestamp="2025-11-21 13:37:40 +0000 UTC" firstStartedPulling="2025-11-21 13:37:41.389070978 +0000 UTC m=+6420.089732836" lastFinishedPulling="2025-11-21 13:37:42.429819484 +0000 UTC m=+6421.130481342" observedRunningTime="2025-11-21 13:37:43.457529044 +0000 UTC m=+6422.158190872" watchObservedRunningTime="2025-11-21 13:37:43.458936732 +0000 UTC m=+6422.159598560" Nov 21 13:37:44 crc kubenswrapper[4769]: I1121 13:37:44.455067 4769 generic.go:334] "Generic (PLEG): container finished" podID="403d7c27-ae69-4bc7-8219-8d83dcf33530" containerID="b415f984067eb5bc90e83154a99d4c7b283e283aad5ed322b262055654334e98" exitCode=0 Nov 21 13:37:44 crc kubenswrapper[4769]: I1121 13:37:44.455252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" event={"ID":"403d7c27-ae69-4bc7-8219-8d83dcf33530","Type":"ContainerDied","Data":"b415f984067eb5bc90e83154a99d4c7b283e283aad5ed322b262055654334e98"} Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.838651 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.974789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-ssh-key\") pod \"403d7c27-ae69-4bc7-8219-8d83dcf33530\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.974892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-inventory\") pod \"403d7c27-ae69-4bc7-8219-8d83dcf33530\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.974989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-secret-0\") pod \"403d7c27-ae69-4bc7-8219-8d83dcf33530\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.975022 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-combined-ca-bundle\") pod \"403d7c27-ae69-4bc7-8219-8d83dcf33530\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.975064 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s76hn\" (UniqueName: \"kubernetes.io/projected/403d7c27-ae69-4bc7-8219-8d83dcf33530-kube-api-access-s76hn\") pod \"403d7c27-ae69-4bc7-8219-8d83dcf33530\" (UID: \"403d7c27-ae69-4bc7-8219-8d83dcf33530\") " Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.982436 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403d7c27-ae69-4bc7-8219-8d83dcf33530-kube-api-access-s76hn" (OuterVolumeSpecName: "kube-api-access-s76hn") pod "403d7c27-ae69-4bc7-8219-8d83dcf33530" (UID: "403d7c27-ae69-4bc7-8219-8d83dcf33530"). InnerVolumeSpecName "kube-api-access-s76hn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:45 crc kubenswrapper[4769]: I1121 13:37:45.982480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-combined-ca-bundle" (OuterVolumeSpecName: "libvirt-combined-ca-bundle") pod "403d7c27-ae69-4bc7-8219-8d83dcf33530" (UID: "403d7c27-ae69-4bc7-8219-8d83dcf33530"). InnerVolumeSpecName "libvirt-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.002986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "403d7c27-ae69-4bc7-8219-8d83dcf33530" (UID: "403d7c27-ae69-4bc7-8219-8d83dcf33530"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.005109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-inventory" (OuterVolumeSpecName: "inventory") pod "403d7c27-ae69-4bc7-8219-8d83dcf33530" (UID: "403d7c27-ae69-4bc7-8219-8d83dcf33530"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.013559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-secret-0" (OuterVolumeSpecName: "libvirt-secret-0") pod "403d7c27-ae69-4bc7-8219-8d83dcf33530" (UID: "403d7c27-ae69-4bc7-8219-8d83dcf33530"). InnerVolumeSpecName "libvirt-secret-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.077362 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s76hn\" (UniqueName: \"kubernetes.io/projected/403d7c27-ae69-4bc7-8219-8d83dcf33530-kube-api-access-s76hn\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.077423 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.077444 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.077468 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-secret-0\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-secret-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.077489 4769 reconciler_common.go:293] "Volume detached for volume \"libvirt-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/403d7c27-ae69-4bc7-8219-8d83dcf33530-libvirt-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.409106 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b"] Nov 21 13:37:46 crc kubenswrapper[4769]: E1121 13:37:46.409526 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="403d7c27-ae69-4bc7-8219-8d83dcf33530" containerName="libvirt-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.409549 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="403d7c27-ae69-4bc7-8219-8d83dcf33530" containerName="libvirt-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.409766 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="403d7c27-ae69-4bc7-8219-8d83dcf33530" containerName="libvirt-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.410733 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.413968 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-cell1-compute-config" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.414925 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"nova-migration-ssh-key" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.426970 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b"] Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.480845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" event={"ID":"403d7c27-ae69-4bc7-8219-8d83dcf33530","Type":"ContainerDied","Data":"471441743e0f105347bf86e3bc177879d356bf552eb37879ac023f59e86dff85"} Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.480896 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="471441743e0f105347bf86e3bc177879d356bf552eb37879ac023f59e86dff85" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.480928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.587873 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.587939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-ssh-key\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.588033 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.588156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.588405 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.588489 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsw5z\" (UniqueName: \"kubernetes.io/projected/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-kube-api-access-dsw5z\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.588648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.588724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.690716 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.690797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dsw5z\" (UniqueName: \"kubernetes.io/projected/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-kube-api-access-dsw5z\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.690899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.690948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.691007 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.691068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-ssh-key\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.691113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.691260 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.695380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.695380 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-inventory\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.695397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-ssh-key\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.697048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.697699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-combined-ca-bundle\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.698476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-1\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.700218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-0\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.725749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsw5z\" (UniqueName: \"kubernetes.io/projected/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-kube-api-access-dsw5z\") pod \"nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:46 crc kubenswrapper[4769]: I1121 13:37:46.855958 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:47 crc kubenswrapper[4769]: I1121 13:37:47.326557 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b"] Nov 21 13:37:47 crc kubenswrapper[4769]: W1121 13:37:47.331085 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95bd4afe_0fce_4a88_b172_d41a9b3cd8ad.slice/crio-09374372e70f2eb72d9d7cc19bf955fb92309df4e72164d7e690c098f7494674 WatchSource:0}: Error finding container 09374372e70f2eb72d9d7cc19bf955fb92309df4e72164d7e690c098f7494674: Status 404 returned error can't find the container with id 09374372e70f2eb72d9d7cc19bf955fb92309df4e72164d7e690c098f7494674 Nov 21 13:37:47 crc kubenswrapper[4769]: I1121 13:37:47.497366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" event={"ID":"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad","Type":"ContainerStarted","Data":"09374372e70f2eb72d9d7cc19bf955fb92309df4e72164d7e690c098f7494674"} Nov 21 13:37:49 crc kubenswrapper[4769]: I1121 13:37:49.530711 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" event={"ID":"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad","Type":"ContainerStarted","Data":"5bf12f7db0e89cb7c2d80986e9fde57d8eeeab2217a4c2f05cc9cea5eca60f13"} Nov 21 13:37:49 crc kubenswrapper[4769]: I1121 13:37:49.561922 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" podStartSLOduration=2.351669963 podStartE2EDuration="3.56189476s" podCreationTimestamp="2025-11-21 13:37:46 +0000 UTC" firstStartedPulling="2025-11-21 13:37:47.333132195 +0000 UTC m=+6426.033794013" lastFinishedPulling="2025-11-21 13:37:48.543356952 +0000 UTC m=+6427.244018810" observedRunningTime="2025-11-21 13:37:49.554251828 +0000 UTC m=+6428.254913736" watchObservedRunningTime="2025-11-21 13:37:49.56189476 +0000 UTC m=+6428.262556618" Nov 21 13:37:50 crc kubenswrapper[4769]: I1121 13:37:50.548727 4769 generic.go:334] "Generic (PLEG): container finished" podID="95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" containerID="5bf12f7db0e89cb7c2d80986e9fde57d8eeeab2217a4c2f05cc9cea5eca60f13" exitCode=0 Nov 21 13:37:50 crc kubenswrapper[4769]: I1121 13:37:50.548810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" event={"ID":"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad","Type":"ContainerDied","Data":"5bf12f7db0e89cb7c2d80986e9fde57d8eeeab2217a4c2f05cc9cea5eca60f13"} Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.878442 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-inventory\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996613 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-ssh-key\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996671 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-1\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-1\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996740 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-0\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-combined-ca-bundle\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996791 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-0\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:51 crc kubenswrapper[4769]: I1121 13:37:51.996880 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsw5z\" (UniqueName: \"kubernetes.io/projected/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-kube-api-access-dsw5z\") pod \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\" (UID: \"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad\") " Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.002667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-kube-api-access-dsw5z" (OuterVolumeSpecName: "kube-api-access-dsw5z") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "kube-api-access-dsw5z". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.010633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-combined-ca-bundle" (OuterVolumeSpecName: "nova-combined-ca-bundle") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "nova-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.019894 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-1" (OuterVolumeSpecName: "nova-cell1-compute-config-1") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "nova-cell1-compute-config-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.022431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-0" (OuterVolumeSpecName: "nova-cell1-compute-config-0") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "nova-cell1-compute-config-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.027659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-inventory" (OuterVolumeSpecName: "inventory") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.031073 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-0" (OuterVolumeSpecName: "nova-migration-ssh-key-0") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "nova-migration-ssh-key-0". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.031537 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-1" (OuterVolumeSpecName: "nova-migration-ssh-key-1") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "nova-migration-ssh-key-1". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.037993 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" (UID: "95bd4afe-0fce-4a88-b172-d41a9b3cd8ad"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099424 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dsw5z\" (UniqueName: \"kubernetes.io/projected/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-kube-api-access-dsw5z\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099469 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099483 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099496 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099509 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-1\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099522 4769 reconciler_common.go:293] "Volume detached for volume \"nova-migration-ssh-key-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-migration-ssh-key-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099534 4769 reconciler_common.go:293] "Volume detached for volume \"nova-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.099546 4769 reconciler_common.go:293] "Volume detached for volume \"nova-cell1-compute-config-0\" (UniqueName: \"kubernetes.io/secret/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad-nova-cell1-compute-config-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.580267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" event={"ID":"95bd4afe-0fce-4a88-b172-d41a9b3cd8ad","Type":"ContainerDied","Data":"09374372e70f2eb72d9d7cc19bf955fb92309df4e72164d7e690c098f7494674"} Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.580527 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09374372e70f2eb72d9d7cc19bf955fb92309df4e72164d7e690c098f7494674" Nov 21 13:37:52 crc kubenswrapper[4769]: I1121 13:37:52.580656 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b" Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.758150 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.770114 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-multinodeset-edpm-compute-no-nodes-jp5m4"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.780043 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.787657 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.797221 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.803950 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-no-nodes-wmcz5"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.873314 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-multinodeset-edpm-compute-no-nodes-h5pfq"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.888330 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-multinodeset-edpm-compute-no-nodes-7x4jq"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.900127 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.915359 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.925393 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-multinodeset-edpm-compute-no-nodes-nv8qp"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.932316 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.941887 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.953462 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-multinodeset-edpm-compute-no-nodes-8nsrg"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.961557 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.967701 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-no-nodes-sjrrb"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.983443 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-multinodeset-edpm-compute-no-nodes-ngxf6"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.983518 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.985745 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.992065 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq"] Nov 21 13:37:54 crc kubenswrapper[4769]: I1121 13:37:54.998014 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.003949 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-multinodeset-edpm-compute-beta-nodeset-7lxqq"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.010555 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.015671 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-multinodeset-edpm-compute-no-nodes-sd4jt"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.021270 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-multinodeset-edpm-compute-beta-nodesetl5l9m"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.027617 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.033444 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-multinodeset-edpm-compute-no-nodes-fngl8"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.039001 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-multinodeset-edpm-compute-no-nodes-x8qgt"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.046839 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-multinodeset-edpm-compute-no-nodes-wwmr9"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.055027 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-multinodeset-edpm-compute-no-nodes-t8bt8"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.061826 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.066805 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-multinodeset-edpm-compute-no-nodes-g6b9b"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.072621 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.078255 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-multinodeset-edpm-compute-no-nodes-qfnhm"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.083694 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.089058 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.095397 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.100572 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.105365 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.110496 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-os-edpm-compute-no-nodes-edpm-compute-no-nodes-vqms6"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.116220 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-svc-edpm-compute-no-nodes-ovrd-edpm-compute-no-nodenvdjv"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.121496 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/download-cache-edpm-compute-no-nodes-edpm-compute-no-nodeswt59j"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.126614 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-updated-ovn-cm-edpm-compute-no-ntc2vm"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.131327 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-dhcp-edpm-compute-no-nodes-edpm-compute-no-nodes-8d9sg"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.136595 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.141375 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.146480 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.154645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.165590 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.173540 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.180401 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.187152 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.194145 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.201082 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.206916 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.213872 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.222366 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-544zc"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.228665 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-edpm-compute-no-nodes-edpm-compute-no-nodes-mw5gl"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.235073 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-os-edpm-compute-no-nodes-edpm-compute-no-nodes-wdqg7"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.243993 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-edpm-compute-no-nodes-edpm-compute-no-nodes-mkdgd"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.250906 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/validate-network-edpm-compute-no-nodes-edpm-compute-no-nodzttq6"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.260812 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-ovn-edpm-compute-no-nodes-edpm-compute-no-nodes-tl9vk"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.272297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/run-os-edpm-compute-no-nodes-edpm-compute-no-nodes-hj29g"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.286968 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2f48ab-1377-443b-9c78-0744c051fbf1" path="/var/lib/kubelet/pods/1b2f48ab-1377-443b-9c78-0744c051fbf1/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.287534 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed344a6-aa34-406b-9a62-7c66a2025646" path="/var/lib/kubelet/pods/1ed344a6-aa34-406b-9a62-7c66a2025646/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.288022 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fcfa8fa-70d5-4ef3-9327-29e08b175999" path="/var/lib/kubelet/pods/1fcfa8fa-70d5-4ef3-9327-29e08b175999/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.288574 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d4644b-f33f-4a94-a34a-c50891049c95" path="/var/lib/kubelet/pods/22d4644b-f33f-4a94-a34a-c50891049c95/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.289761 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="251027e1-3980-4953-bc55-14ae01478d65" path="/var/lib/kubelet/pods/251027e1-3980-4953-bc55-14ae01478d65/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.290292 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f9243c-2953-47d9-90af-d021bd580c62" path="/var/lib/kubelet/pods/27f9243c-2953-47d9-90af-d021bd580c62/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.290806 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e777b9-a6be-42c0-a782-f92f7d99de4e" path="/var/lib/kubelet/pods/34e777b9-a6be-42c0-a782-f92f7d99de4e/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.291934 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e766d9c-2541-4ff7-a6a0-630e28e9d181" path="/var/lib/kubelet/pods/3e766d9c-2541-4ff7-a6a0-630e28e9d181/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.292573 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403d7c27-ae69-4bc7-8219-8d83dcf33530" path="/var/lib/kubelet/pods/403d7c27-ae69-4bc7-8219-8d83dcf33530/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.293148 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4143001e-4d11-4c31-9fef-1a137e8b73fc" path="/var/lib/kubelet/pods/4143001e-4d11-4c31-9fef-1a137e8b73fc/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.294365 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42063f6e-62ad-4351-a4dc-a0ee1d1d0276" path="/var/lib/kubelet/pods/42063f6e-62ad-4351-a4dc-a0ee1d1d0276/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.294914 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594e01a6-ef67-4f73-b6a3-bb7946c6d33e" path="/var/lib/kubelet/pods/594e01a6-ef67-4f73-b6a3-bb7946c6d33e/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.295425 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62b03230-5fc4-472e-851a-6b2f13e814cd" path="/var/lib/kubelet/pods/62b03230-5fc4-472e-851a-6b2f13e814cd/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.295912 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62bcfeb0-8a8e-453e-a698-4cf57bbb82b5" path="/var/lib/kubelet/pods/62bcfeb0-8a8e-453e-a698-4cf57bbb82b5/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.296781 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c14277f-3597-4ac4-862f-4e733142b2a1" path="/var/lib/kubelet/pods/6c14277f-3597-4ac4-862f-4e733142b2a1/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.297241 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f265b52-af41-4974-a47e-fc6d63c98cb3" path="/var/lib/kubelet/pods/6f265b52-af41-4974-a47e-fc6d63c98cb3/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.297715 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e4e31b-a26b-4212-bcf9-c2c81269eed2" path="/var/lib/kubelet/pods/77e4e31b-a26b-4212-bcf9-c2c81269eed2/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.298614 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bbf7125-cc8b-400e-8d15-f5f512be2d1b" path="/var/lib/kubelet/pods/7bbf7125-cc8b-400e-8d15-f5f512be2d1b/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.299088 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="837a28ed-208e-491a-9cc1-fc2f8bf2b1f2" path="/var/lib/kubelet/pods/837a28ed-208e-491a-9cc1-fc2f8bf2b1f2/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.299626 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f47bb0-ae29-420b-96c6-7af7643cd983" path="/var/lib/kubelet/pods/91f47bb0-ae29-420b-96c6-7af7643cd983/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.300541 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94da9eb8-296d-47a1-8f3f-3096c7d6b6f2" path="/var/lib/kubelet/pods/94da9eb8-296d-47a1-8f3f-3096c7d6b6f2/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.300989 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" path="/var/lib/kubelet/pods/95bd4afe-0fce-4a88-b172-d41a9b3cd8ad/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.301470 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="affb59a7-889e-4028-bb8e-fea75bb70fd1" path="/var/lib/kubelet/pods/affb59a7-889e-4028-bb8e-fea75bb70fd1/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.301939 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b548e734-e01e-4342-abef-731c6b4ebb0e" path="/var/lib/kubelet/pods/b548e734-e01e-4342-abef-731c6b4ebb0e/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.302796 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c312ad84-cb49-4324-a9b4-45e23c8bb1fd" path="/var/lib/kubelet/pods/c312ad84-cb49-4324-a9b4-45e23c8bb1fd/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.303316 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4fe6d1d-921d-4ac5-86dd-f13462f5e61e" path="/var/lib/kubelet/pods/c4fe6d1d-921d-4ac5-86dd-f13462f5e61e/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.304039 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc16c515-cf5a-4dd8-802a-081c12e6aaaa" path="/var/lib/kubelet/pods/cc16c515-cf5a-4dd8-802a-081c12e6aaaa/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.305142 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73d17aa-0777-4de8-8b1c-7a75fad85b38" path="/var/lib/kubelet/pods/e73d17aa-0777-4de8-8b1c-7a75fad85b38/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.305769 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0" path="/var/lib/kubelet/pods/fdc4a9d8-8577-4f0b-86a9-7688d4b05cc0/volumes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.306243 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/libvirt-edpm-compute-no-nodes-edpm-compute-no-nodes-zcgz2"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.306272 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/configure-network-edpm-compute-no-nodes-edpm-compute-no-non82sf"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.306284 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/bootstrap-edpm-compute-no-nodes-edpm-compute-no-nodes-f6lhr"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.306295 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-sriov-edpm-compute-no-nodes-edpm-compute-no-nodes-99qjm"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.306306 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-metadata-edpm-compute-no-nodes-edpm-compute-no-nodz9kf2"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.307799 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4"] Nov 21 13:37:55 crc kubenswrapper[4769]: E1121 13:37:55.308066 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" containerName="nova-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.308078 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" containerName="nova-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.308243 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="95bd4afe-0fce-4a88-b172-d41a9b3cd8ad" containerName="nova-edpm-multinodeset-edpm-compute-no-nodes" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.309054 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.313382 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.318706 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.324242 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.326768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.330211 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl"] Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.356688 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsvcs\" (UniqueName: \"kubernetes.io/projected/99da0dac-1c51-4461-9a70-f5400b94ddb9-kube-api-access-zsvcs\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.356760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.356837 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4rw\" (UniqueName: \"kubernetes.io/projected/599316cf-358f-4e7d-a0da-8fef241c3659-kube-api-access-md4rw\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.356879 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.356925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.357078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.357143 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-config\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: E1121 13:37:55.377499 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc edpm-compute-no-nodes kube-api-access-zsvcs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" podUID="99da0dac-1c51-4461-9a70-f5400b94ddb9" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.459971 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.460241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-config\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.460328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zsvcs\" (UniqueName: \"kubernetes.io/projected/99da0dac-1c51-4461-9a70-f5400b94ddb9-kube-api-access-zsvcs\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.460389 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.460432 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-md4rw\" (UniqueName: \"kubernetes.io/projected/599316cf-358f-4e7d-a0da-8fef241c3659-kube-api-access-md4rw\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.460478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.460531 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.461108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-config\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: E1121 13:37:55.461332 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-no-nodes: configmap "edpm-compute-no-nodes" not found Nov 21 13:37:55 crc kubenswrapper[4769]: E1121 13:37:55.461388 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes podName:99da0dac-1c51-4461-9a70-f5400b94ddb9 nodeName:}" failed. No retries permitted until 2025-11-21 13:37:55.961373898 +0000 UTC m=+6434.662035716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "edpm-compute-no-nodes" (UniqueName: "kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes") pod "dnsmasq-dnsmasq-64864b6d57-9cgc4" (UID: "99da0dac-1c51-4461-9a70-f5400b94ddb9") : configmap "edpm-compute-no-nodes" not found Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.461505 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.461935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.462410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.479110 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsvcs\" (UniqueName: \"kubernetes.io/projected/99da0dac-1c51-4461-9a70-f5400b94ddb9-kube-api-access-zsvcs\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.486785 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4rw\" (UniqueName: \"kubernetes.io/projected/599316cf-358f-4e7d-a0da-8fef241c3659-kube-api-access-md4rw\") pod \"dnsmasq-dnsmasq-84b9f45d47-mhqkl\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.613044 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.625060 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.662923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsvcs\" (UniqueName: \"kubernetes.io/projected/99da0dac-1c51-4461-9a70-f5400b94ddb9-kube-api-access-zsvcs\") pod \"99da0dac-1c51-4461-9a70-f5400b94ddb9\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.663120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-dnsmasq-svc\") pod \"99da0dac-1c51-4461-9a70-f5400b94ddb9\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.663154 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-config\") pod \"99da0dac-1c51-4461-9a70-f5400b94ddb9\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.663729 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "99da0dac-1c51-4461-9a70-f5400b94ddb9" (UID: "99da0dac-1c51-4461-9a70-f5400b94ddb9"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.663725 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-config" (OuterVolumeSpecName: "config") pod "99da0dac-1c51-4461-9a70-f5400b94ddb9" (UID: "99da0dac-1c51-4461-9a70-f5400b94ddb9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.666574 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99da0dac-1c51-4461-9a70-f5400b94ddb9-kube-api-access-zsvcs" (OuterVolumeSpecName: "kube-api-access-zsvcs") pod "99da0dac-1c51-4461-9a70-f5400b94ddb9" (UID: "99da0dac-1c51-4461-9a70-f5400b94ddb9"). InnerVolumeSpecName "kube-api-access-zsvcs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.689224 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.765063 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.765123 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.765141 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zsvcs\" (UniqueName: \"kubernetes.io/projected/99da0dac-1c51-4461-9a70-f5400b94ddb9-kube-api-access-zsvcs\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:55 crc kubenswrapper[4769]: I1121 13:37:55.967779 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-9cgc4\" (UID: \"99da0dac-1c51-4461-9a70-f5400b94ddb9\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:55 crc kubenswrapper[4769]: E1121 13:37:55.967960 4769 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/edpm-compute-no-nodes: configmap "edpm-compute-no-nodes" not found Nov 21 13:37:55 crc kubenswrapper[4769]: E1121 13:37:55.968173 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes podName:99da0dac-1c51-4461-9a70-f5400b94ddb9 nodeName:}" failed. No retries permitted until 2025-11-21 13:37:56.968155666 +0000 UTC m=+6435.668817484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "edpm-compute-no-nodes" (UniqueName: "kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes") pod "dnsmasq-dnsmasq-64864b6d57-9cgc4" (UID: "99da0dac-1c51-4461-9a70-f5400b94ddb9") : configmap "edpm-compute-no-nodes" not found Nov 21 13:37:56 crc kubenswrapper[4769]: I1121 13:37:56.178536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl"] Nov 21 13:37:56 crc kubenswrapper[4769]: W1121 13:37:56.183609 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod599316cf_358f_4e7d_a0da_8fef241c3659.slice/crio-edd0e74681ecc1c6bb4e030f0e1495e57966ca9ebbfb128aa9290f9654af9a74 WatchSource:0}: Error finding container edd0e74681ecc1c6bb4e030f0e1495e57966ca9ebbfb128aa9290f9654af9a74: Status 404 returned error can't find the container with id edd0e74681ecc1c6bb4e030f0e1495e57966ca9ebbfb128aa9290f9654af9a74 Nov 21 13:37:56 crc kubenswrapper[4769]: I1121 13:37:56.630713 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" event={"ID":"599316cf-358f-4e7d-a0da-8fef241c3659","Type":"ContainerStarted","Data":"edd0e74681ecc1c6bb4e030f0e1495e57966ca9ebbfb128aa9290f9654af9a74"} Nov 21 13:37:56 crc kubenswrapper[4769]: I1121 13:37:56.630750 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4" Nov 21 13:37:56 crc kubenswrapper[4769]: I1121 13:37:56.702051 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4"] Nov 21 13:37:56 crc kubenswrapper[4769]: I1121 13:37:56.716749 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9cgc4"] Nov 21 13:37:56 crc kubenswrapper[4769]: I1121 13:37:56.781630 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/99da0dac-1c51-4461-9a70-f5400b94ddb9-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.294122 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b93f5cc-a6bd-441a-9bd9-3c024eb15283" path="/var/lib/kubelet/pods/3b93f5cc-a6bd-441a-9bd9-3c024eb15283/volumes" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.295764 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="729de42c-9efd-4c8e-a003-f48955e9cde2" path="/var/lib/kubelet/pods/729de42c-9efd-4c8e-a003-f48955e9cde2/volumes" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.296876 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99da0dac-1c51-4461-9a70-f5400b94ddb9" path="/var/lib/kubelet/pods/99da0dac-1c51-4461-9a70-f5400b94ddb9/volumes" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.297609 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fbe3d38-1f00-4de5-8d18-8e1c569458f7" path="/var/lib/kubelet/pods/9fbe3d38-1f00-4de5-8d18-8e1c569458f7/volumes" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.299288 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36be714-7f95-44a9-843a-6eb0344667c4" path="/var/lib/kubelet/pods/e36be714-7f95-44a9-843a-6eb0344667c4/volumes" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.300428 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee60d19d-fa1f-41d6-9f06-529ac5da30c5" path="/var/lib/kubelet/pods/ee60d19d-fa1f-41d6-9f06-529ac5da30c5/volumes" Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.646677 4769 generic.go:334] "Generic (PLEG): container finished" podID="599316cf-358f-4e7d-a0da-8fef241c3659" containerID="116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876" exitCode=0 Nov 21 13:37:57 crc kubenswrapper[4769]: I1121 13:37:57.646762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" event={"ID":"599316cf-358f-4e7d-a0da-8fef241c3659","Type":"ContainerDied","Data":"116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876"} Nov 21 13:37:58 crc kubenswrapper[4769]: I1121 13:37:58.666840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" event={"ID":"599316cf-358f-4e7d-a0da-8fef241c3659","Type":"ContainerStarted","Data":"92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2"} Nov 21 13:37:58 crc kubenswrapper[4769]: I1121 13:37:58.668468 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:37:58 crc kubenswrapper[4769]: I1121 13:37:58.709637 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" podStartSLOduration=3.709599505 podStartE2EDuration="3.709599505s" podCreationTimestamp="2025-11-21 13:37:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:37:58.707064478 +0000 UTC m=+6437.407726366" watchObservedRunningTime="2025-11-21 13:37:58.709599505 +0000 UTC m=+6437.410261363" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.158717 4769 scope.go:117] "RemoveContainer" containerID="495e3f4828d84b7801f6c34a64a915696d1f493baf411f23ece77eb8190dcdb3" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.217427 4769 scope.go:117] "RemoveContainer" containerID="4458d7a3062baecb353b60c0a34be762e0ee11bbb1e66311961989c3436ae20d" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.273125 4769 scope.go:117] "RemoveContainer" containerID="aa7f88aef3e2d4c459f932ae13c6b9a8ccf95e7feb50977a69d29ab6ea3f0f93" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.339699 4769 scope.go:117] "RemoveContainer" containerID="ba402ed9142db1b8afef7cd0895f80d5c41ad2b10cd70acfc898512484f8ed5f" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.382011 4769 scope.go:117] "RemoveContainer" containerID="848f990243303a21b173571b68291c4ddeb10ebdbb22089d93e1bcbd187253fb" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.418263 4769 scope.go:117] "RemoveContainer" containerID="28a3d2ca0e0e10678f6b08fc13f3029e4291888e10de58f3380c36000f9f2afc" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.463511 4769 scope.go:117] "RemoveContainer" containerID="03ff6d1db3b81b70342432461b273dc0a96e0ab36f6bbbf155c544ddadf50bf3" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.500578 4769 scope.go:117] "RemoveContainer" containerID="809d521f289b72bb91cc8ea43a2c8a4b320111911f78438aa09ce683782c41e9" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.543918 4769 scope.go:117] "RemoveContainer" containerID="1a8ac146a81f7e0b637d7943584b3dfaec10fa0ae0a290e248c1a44cc6f4dd20" Nov 21 13:38:03 crc kubenswrapper[4769]: I1121 13:38:03.585012 4769 scope.go:117] "RemoveContainer" containerID="9adafb00afe2961660380b1dbd4f5423ee9c1ad95b9bc4e7de9d22ade012b287" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.058613 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-m75wl"] Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.071344 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-m75wl"] Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.228587 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-p4m4z"] Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.231029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.234467 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.234516 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.239944 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.240072 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.242883 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-p4m4z"] Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.324925 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8040cfbc-eb6d-4764-b168-4645830b255d-crc-storage\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.324991 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8040cfbc-eb6d-4764-b168-4645830b255d-node-mnt\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.325035 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j892v\" (UniqueName: \"kubernetes.io/projected/8040cfbc-eb6d-4764-b168-4645830b255d-kube-api-access-j892v\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.426802 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8040cfbc-eb6d-4764-b168-4645830b255d-crc-storage\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.426907 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8040cfbc-eb6d-4764-b168-4645830b255d-node-mnt\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.426974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j892v\" (UniqueName: \"kubernetes.io/projected/8040cfbc-eb6d-4764-b168-4645830b255d-kube-api-access-j892v\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.427258 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8040cfbc-eb6d-4764-b168-4645830b255d-node-mnt\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.427942 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8040cfbc-eb6d-4764-b168-4645830b255d-crc-storage\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.453152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j892v\" (UniqueName: \"kubernetes.io/projected/8040cfbc-eb6d-4764-b168-4645830b255d-kube-api-access-j892v\") pod \"crc-storage-crc-p4m4z\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.567037 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:04 crc kubenswrapper[4769]: I1121 13:38:04.852563 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-p4m4z"] Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.294934 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53eddd2-f250-4f66-92da-56ea0e1aa0c2" path="/var/lib/kubelet/pods/a53eddd2-f250-4f66-92da-56ea0e1aa0c2/volumes" Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.690420 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.757370 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8"] Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.757882 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerName="dnsmasq-dns" containerID="cri-o://66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1" gracePeriod=10 Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.799445 4769 generic.go:334] "Generic (PLEG): container finished" podID="8040cfbc-eb6d-4764-b168-4645830b255d" containerID="7ffea6ae749e01612d8c58545a7b80d3f69d58bae2918929c46d9131bb10d2fb" exitCode=0 Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.799523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-p4m4z" event={"ID":"8040cfbc-eb6d-4764-b168-4645830b255d","Type":"ContainerDied","Data":"7ffea6ae749e01612d8c58545a7b80d3f69d58bae2918929c46d9131bb10d2fb"} Nov 21 13:38:05 crc kubenswrapper[4769]: I1121 13:38:05.799585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-p4m4z" event={"ID":"8040cfbc-eb6d-4764-b168-4645830b255d","Type":"ContainerStarted","Data":"380f99d54a6c9c36be217be90d8f2b6e4b1abd083d4fd4a85b2febd2369d7edc"} Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.195151 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.363013 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48bjr\" (UniqueName: \"kubernetes.io/projected/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-kube-api-access-48bjr\") pod \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.363654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-dnsmasq-svc\") pod \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.363719 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-config\") pod \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.363913 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-no-nodes\") pod \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.364049 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-beta-nodeset\") pod \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\" (UID: \"b847dd8c-0bec-45e2-b7f9-654f6f1486ad\") " Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.369000 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-kube-api-access-48bjr" (OuterVolumeSpecName: "kube-api-access-48bjr") pod "b847dd8c-0bec-45e2-b7f9-654f6f1486ad" (UID: "b847dd8c-0bec-45e2-b7f9-654f6f1486ad"). InnerVolumeSpecName "kube-api-access-48bjr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.398630 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-config" (OuterVolumeSpecName: "config") pod "b847dd8c-0bec-45e2-b7f9-654f6f1486ad" (UID: "b847dd8c-0bec-45e2-b7f9-654f6f1486ad"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.413418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-beta-nodeset" (OuterVolumeSpecName: "edpm-compute-beta-nodeset") pod "b847dd8c-0bec-45e2-b7f9-654f6f1486ad" (UID: "b847dd8c-0bec-45e2-b7f9-654f6f1486ad"). InnerVolumeSpecName "edpm-compute-beta-nodeset". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.418420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "b847dd8c-0bec-45e2-b7f9-654f6f1486ad" (UID: "b847dd8c-0bec-45e2-b7f9-654f6f1486ad"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.420071 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "b847dd8c-0bec-45e2-b7f9-654f6f1486ad" (UID: "b847dd8c-0bec-45e2-b7f9-654f6f1486ad"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.466369 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.466433 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-beta-nodeset\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-edpm-compute-beta-nodeset\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.466457 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-48bjr\" (UniqueName: \"kubernetes.io/projected/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-kube-api-access-48bjr\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.466475 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.466497 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b847dd8c-0bec-45e2-b7f9-654f6f1486ad-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.816086 4769 generic.go:334] "Generic (PLEG): container finished" podID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerID="66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1" exitCode=0 Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.816265 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.816266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" event={"ID":"b847dd8c-0bec-45e2-b7f9-654f6f1486ad","Type":"ContainerDied","Data":"66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1"} Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.816468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8" event={"ID":"b847dd8c-0bec-45e2-b7f9-654f6f1486ad","Type":"ContainerDied","Data":"1e029f1e90df41e5634778610ffbf232f935b8c8323b8e5706f336be3c22b7e5"} Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.816509 4769 scope.go:117] "RemoveContainer" containerID="66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.861083 4769 scope.go:117] "RemoveContainer" containerID="779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.877293 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8"] Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.895787 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-67886899f9-8lpb8"] Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.896620 4769 scope.go:117] "RemoveContainer" containerID="66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1" Nov 21 13:38:06 crc kubenswrapper[4769]: E1121 13:38:06.897651 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1\": container with ID starting with 66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1 not found: ID does not exist" containerID="66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.897694 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1"} err="failed to get container status \"66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1\": rpc error: code = NotFound desc = could not find container \"66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1\": container with ID starting with 66045ca66e6941595b45f6f2b9e5c3b96f7e88ca14d3d998fda423b7d37164a1 not found: ID does not exist" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.897725 4769 scope.go:117] "RemoveContainer" containerID="779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a" Nov 21 13:38:06 crc kubenswrapper[4769]: E1121 13:38:06.898504 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a\": container with ID starting with 779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a not found: ID does not exist" containerID="779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a" Nov 21 13:38:06 crc kubenswrapper[4769]: I1121 13:38:06.898565 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a"} err="failed to get container status \"779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a\": rpc error: code = NotFound desc = could not find container \"779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a\": container with ID starting with 779e237a739cf5e538e9f920560b5e8cb146d5464750f096078d862fbd4c665a not found: ID does not exist" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.100045 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.179423 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8040cfbc-eb6d-4764-b168-4645830b255d-crc-storage\") pod \"8040cfbc-eb6d-4764-b168-4645830b255d\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.179545 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8040cfbc-eb6d-4764-b168-4645830b255d-node-mnt\") pod \"8040cfbc-eb6d-4764-b168-4645830b255d\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.179631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j892v\" (UniqueName: \"kubernetes.io/projected/8040cfbc-eb6d-4764-b168-4645830b255d-kube-api-access-j892v\") pod \"8040cfbc-eb6d-4764-b168-4645830b255d\" (UID: \"8040cfbc-eb6d-4764-b168-4645830b255d\") " Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.180079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8040cfbc-eb6d-4764-b168-4645830b255d-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "8040cfbc-eb6d-4764-b168-4645830b255d" (UID: "8040cfbc-eb6d-4764-b168-4645830b255d"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.184133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8040cfbc-eb6d-4764-b168-4645830b255d-kube-api-access-j892v" (OuterVolumeSpecName: "kube-api-access-j892v") pod "8040cfbc-eb6d-4764-b168-4645830b255d" (UID: "8040cfbc-eb6d-4764-b168-4645830b255d"). InnerVolumeSpecName "kube-api-access-j892v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.211806 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8040cfbc-eb6d-4764-b168-4645830b255d-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "8040cfbc-eb6d-4764-b168-4645830b255d" (UID: "8040cfbc-eb6d-4764-b168-4645830b255d"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.280851 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/8040cfbc-eb6d-4764-b168-4645830b255d-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.280883 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/8040cfbc-eb6d-4764-b168-4645830b255d-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.280895 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j892v\" (UniqueName: \"kubernetes.io/projected/8040cfbc-eb6d-4764-b168-4645830b255d-kube-api-access-j892v\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.287633 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" path="/var/lib/kubelet/pods/b847dd8c-0bec-45e2-b7f9-654f6f1486ad/volumes" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.834757 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-p4m4z" Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.834755 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-p4m4z" event={"ID":"8040cfbc-eb6d-4764-b168-4645830b255d","Type":"ContainerDied","Data":"380f99d54a6c9c36be217be90d8f2b6e4b1abd083d4fd4a85b2febd2369d7edc"} Nov 21 13:38:07 crc kubenswrapper[4769]: I1121 13:38:07.834960 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="380f99d54a6c9c36be217be90d8f2b6e4b1abd083d4fd4a85b2febd2369d7edc" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.085382 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-p4m4z"] Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.105996 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-p4m4z"] Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.218990 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-zbbk2"] Nov 21 13:38:11 crc kubenswrapper[4769]: E1121 13:38:11.219360 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8040cfbc-eb6d-4764-b168-4645830b255d" containerName="storage" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.219375 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8040cfbc-eb6d-4764-b168-4645830b255d" containerName="storage" Nov 21 13:38:11 crc kubenswrapper[4769]: E1121 13:38:11.219400 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerName="init" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.219408 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerName="init" Nov 21 13:38:11 crc kubenswrapper[4769]: E1121 13:38:11.219425 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerName="dnsmasq-dns" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.219433 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerName="dnsmasq-dns" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.219602 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8040cfbc-eb6d-4764-b168-4645830b255d" containerName="storage" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.219638 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b847dd8c-0bec-45e2-b7f9-654f6f1486ad" containerName="dnsmasq-dns" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.220299 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.224534 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.227310 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.233418 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.234142 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-zbbk2"] Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.237604 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.286395 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8040cfbc-eb6d-4764-b168-4645830b255d" path="/var/lib/kubelet/pods/8040cfbc-eb6d-4764-b168-4645830b255d/volumes" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.348979 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-node-mnt\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.349167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2md6d\" (UniqueName: \"kubernetes.io/projected/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-kube-api-access-2md6d\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.349424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-crc-storage\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.450472 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-crc-storage\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.450547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-node-mnt\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.450625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2md6d\" (UniqueName: \"kubernetes.io/projected/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-kube-api-access-2md6d\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.451325 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-node-mnt\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.451680 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-crc-storage\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.470010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2md6d\" (UniqueName: \"kubernetes.io/projected/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-kube-api-access-2md6d\") pod \"crc-storage-crc-zbbk2\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:11 crc kubenswrapper[4769]: I1121 13:38:11.555791 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:12 crc kubenswrapper[4769]: I1121 13:38:12.115475 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-zbbk2"] Nov 21 13:38:12 crc kubenswrapper[4769]: I1121 13:38:12.908500 4769 generic.go:334] "Generic (PLEG): container finished" podID="57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" containerID="7c264901691ad608bf773e6f0d036657ee414bda3fec1475c9c3a1383ee03ff9" exitCode=0 Nov 21 13:38:12 crc kubenswrapper[4769]: I1121 13:38:12.908591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zbbk2" event={"ID":"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d","Type":"ContainerDied","Data":"7c264901691ad608bf773e6f0d036657ee414bda3fec1475c9c3a1383ee03ff9"} Nov 21 13:38:12 crc kubenswrapper[4769]: I1121 13:38:12.909100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zbbk2" event={"ID":"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d","Type":"ContainerStarted","Data":"4c4ddd7ea2161f98e29087e53f194a61cb084fe2e66bae72ecf251f4852bfced"} Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.365106 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.504549 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-node-mnt\") pod \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.504652 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-crc-storage\") pod \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.504709 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" (UID: "57e68cbf-48a9-4bc3-b4b5-ccf57937f89d"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.504783 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2md6d\" (UniqueName: \"kubernetes.io/projected/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-kube-api-access-2md6d\") pod \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\" (UID: \"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d\") " Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.505303 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.512617 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-kube-api-access-2md6d" (OuterVolumeSpecName: "kube-api-access-2md6d") pod "57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" (UID: "57e68cbf-48a9-4bc3-b4b5-ccf57937f89d"). InnerVolumeSpecName "kube-api-access-2md6d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.527583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" (UID: "57e68cbf-48a9-4bc3-b4b5-ccf57937f89d"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.606512 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.606561 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2md6d\" (UniqueName: \"kubernetes.io/projected/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d-kube-api-access-2md6d\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.939359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zbbk2" event={"ID":"57e68cbf-48a9-4bc3-b4b5-ccf57937f89d","Type":"ContainerDied","Data":"4c4ddd7ea2161f98e29087e53f194a61cb084fe2e66bae72ecf251f4852bfced"} Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.939430 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c4ddd7ea2161f98e29087e53f194a61cb084fe2e66bae72ecf251f4852bfced" Nov 21 13:38:14 crc kubenswrapper[4769]: I1121 13:38:14.939487 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zbbk2" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.021076 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn"] Nov 21 13:38:18 crc kubenswrapper[4769]: E1121 13:38:18.021725 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" containerName="storage" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.021738 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" containerName="storage" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.021880 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" containerName="storage" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.022644 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.025067 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-edpm-tls" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.051119 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn"] Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.072860 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn"] Nov 21 13:38:18 crc kubenswrapper[4769]: E1121 13:38:18.074235 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[config dnsmasq-svc kube-api-access-5blmx openstack-edpm-tls], unattached volumes=[], failed to process volumes=[config dnsmasq-svc kube-api-access-5blmx openstack-edpm-tls]: context canceled" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" podUID="5908fc49-a48d-409a-91c5-3fa5ae78115a" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.110877 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c"] Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.112638 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.127997 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c"] Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.169825 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b8dm\" (UniqueName: \"kubernetes.io/projected/23a9d37c-372a-4b80-92dd-64dcf4518783-kube-api-access-5b8dm\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.169872 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.170007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5blmx\" (UniqueName: \"kubernetes.io/projected/5908fc49-a48d-409a-91c5-3fa5ae78115a-kube-api-access-5blmx\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.170079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.170181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-config\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.170232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.170302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-config\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.170345 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272433 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272538 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-config\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5b8dm\" (UniqueName: \"kubernetes.io/projected/23a9d37c-372a-4b80-92dd-64dcf4518783-kube-api-access-5b8dm\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272666 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272693 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5blmx\" (UniqueName: \"kubernetes.io/projected/5908fc49-a48d-409a-91c5-3fa5ae78115a-kube-api-access-5blmx\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.272782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-config\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.274006 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.274045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.274173 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-config\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.274348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-config\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.274580 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-openstack-edpm-tls\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.274814 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.294594 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b8dm\" (UniqueName: \"kubernetes.io/projected/23a9d37c-372a-4b80-92dd-64dcf4518783-kube-api-access-5b8dm\") pod \"dnsmasq-dnsmasq-79cc674687-blf2c\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.297724 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5blmx\" (UniqueName: \"kubernetes.io/projected/5908fc49-a48d-409a-91c5-3fa5ae78115a-kube-api-access-5blmx\") pod \"dnsmasq-dnsmasq-78c7b787f5-kzmzn\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.437220 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.743582 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c"] Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.988931 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.988917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" event={"ID":"23a9d37c-372a-4b80-92dd-64dcf4518783","Type":"ContainerStarted","Data":"5bbde17f8401a8868711782affa75affdf2371f4a30503d4d286bac257e4d0bd"} Nov 21 13:38:18 crc kubenswrapper[4769]: I1121 13:38:18.989521 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" event={"ID":"23a9d37c-372a-4b80-92dd-64dcf4518783","Type":"ContainerStarted","Data":"094395134edb54fba0ab0281771bd0fb571da36a8afbfaeb1cc06c9863e6bd60"} Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.055898 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.188858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5blmx\" (UniqueName: \"kubernetes.io/projected/5908fc49-a48d-409a-91c5-3fa5ae78115a-kube-api-access-5blmx\") pod \"5908fc49-a48d-409a-91c5-3fa5ae78115a\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.188942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-config\") pod \"5908fc49-a48d-409a-91c5-3fa5ae78115a\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.188978 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-dnsmasq-svc\") pod \"5908fc49-a48d-409a-91c5-3fa5ae78115a\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.189031 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-openstack-edpm-tls\") pod \"5908fc49-a48d-409a-91c5-3fa5ae78115a\" (UID: \"5908fc49-a48d-409a-91c5-3fa5ae78115a\") " Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.189766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "5908fc49-a48d-409a-91c5-3fa5ae78115a" (UID: "5908fc49-a48d-409a-91c5-3fa5ae78115a"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.189796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5908fc49-a48d-409a-91c5-3fa5ae78115a" (UID: "5908fc49-a48d-409a-91c5-3fa5ae78115a"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.189861 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-config" (OuterVolumeSpecName: "config") pod "5908fc49-a48d-409a-91c5-3fa5ae78115a" (UID: "5908fc49-a48d-409a-91c5-3fa5ae78115a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.192739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5908fc49-a48d-409a-91c5-3fa5ae78115a-kube-api-access-5blmx" (OuterVolumeSpecName: "kube-api-access-5blmx") pod "5908fc49-a48d-409a-91c5-3fa5ae78115a" (UID: "5908fc49-a48d-409a-91c5-3fa5ae78115a"). InnerVolumeSpecName "kube-api-access-5blmx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.290401 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.290438 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5blmx\" (UniqueName: \"kubernetes.io/projected/5908fc49-a48d-409a-91c5-3fa5ae78115a-kube-api-access-5blmx\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.290450 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:19 crc kubenswrapper[4769]: I1121 13:38:19.290460 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5908fc49-a48d-409a-91c5-3fa5ae78115a-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.008776 4769 generic.go:334] "Generic (PLEG): container finished" podID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerID="5bbde17f8401a8868711782affa75affdf2371f4a30503d4d286bac257e4d0bd" exitCode=0 Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.008939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" event={"ID":"23a9d37c-372a-4b80-92dd-64dcf4518783","Type":"ContainerDied","Data":"5bbde17f8401a8868711782affa75affdf2371f4a30503d4d286bac257e4d0bd"} Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.009106 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn" Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.009127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" event={"ID":"23a9d37c-372a-4b80-92dd-64dcf4518783","Type":"ContainerStarted","Data":"fdb2f1ff2642196894273f8c0c9be90a614400278a3f332700951a2593c96173"} Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.009578 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.035496 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" podStartSLOduration=2.035464912 podStartE2EDuration="2.035464912s" podCreationTimestamp="2025-11-21 13:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:38:20.028678522 +0000 UTC m=+6458.729340380" watchObservedRunningTime="2025-11-21 13:38:20.035464912 +0000 UTC m=+6458.736126770" Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.083215 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn"] Nov 21 13:38:20 crc kubenswrapper[4769]: I1121 13:38:20.088853 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-78c7b787f5-kzmzn"] Nov 21 13:38:21 crc kubenswrapper[4769]: I1121 13:38:21.282849 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5908fc49-a48d-409a-91c5-3fa5ae78115a" path="/var/lib/kubelet/pods/5908fc49-a48d-409a-91c5-3fa5ae78115a/volumes" Nov 21 13:38:28 crc kubenswrapper[4769]: I1121 13:38:28.439492 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:38:28 crc kubenswrapper[4769]: I1121 13:38:28.518635 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl"] Nov 21 13:38:28 crc kubenswrapper[4769]: I1121 13:38:28.518919 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" containerName="dnsmasq-dns" containerID="cri-o://92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2" gracePeriod=10 Nov 21 13:38:28 crc kubenswrapper[4769]: I1121 13:38:28.940688 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.042731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md4rw\" (UniqueName: \"kubernetes.io/projected/599316cf-358f-4e7d-a0da-8fef241c3659-kube-api-access-md4rw\") pod \"599316cf-358f-4e7d-a0da-8fef241c3659\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.042785 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-config\") pod \"599316cf-358f-4e7d-a0da-8fef241c3659\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.042829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-dnsmasq-svc\") pod \"599316cf-358f-4e7d-a0da-8fef241c3659\" (UID: \"599316cf-358f-4e7d-a0da-8fef241c3659\") " Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.049223 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/599316cf-358f-4e7d-a0da-8fef241c3659-kube-api-access-md4rw" (OuterVolumeSpecName: "kube-api-access-md4rw") pod "599316cf-358f-4e7d-a0da-8fef241c3659" (UID: "599316cf-358f-4e7d-a0da-8fef241c3659"). InnerVolumeSpecName "kube-api-access-md4rw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.087883 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "599316cf-358f-4e7d-a0da-8fef241c3659" (UID: "599316cf-358f-4e7d-a0da-8fef241c3659"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.089604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-config" (OuterVolumeSpecName: "config") pod "599316cf-358f-4e7d-a0da-8fef241c3659" (UID: "599316cf-358f-4e7d-a0da-8fef241c3659"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.114169 4769 generic.go:334] "Generic (PLEG): container finished" podID="599316cf-358f-4e7d-a0da-8fef241c3659" containerID="92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2" exitCode=0 Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.114278 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" event={"ID":"599316cf-358f-4e7d-a0da-8fef241c3659","Type":"ContainerDied","Data":"92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2"} Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.114310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" event={"ID":"599316cf-358f-4e7d-a0da-8fef241c3659","Type":"ContainerDied","Data":"edd0e74681ecc1c6bb4e030f0e1495e57966ca9ebbfb128aa9290f9654af9a74"} Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.114327 4769 scope.go:117] "RemoveContainer" containerID="92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.114730 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.137568 4769 scope.go:117] "RemoveContainer" containerID="116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.147559 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-md4rw\" (UniqueName: \"kubernetes.io/projected/599316cf-358f-4e7d-a0da-8fef241c3659-kube-api-access-md4rw\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.147609 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.147621 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/599316cf-358f-4e7d-a0da-8fef241c3659-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.152600 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl"] Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.157298 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-mhqkl"] Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.167469 4769 scope.go:117] "RemoveContainer" containerID="92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2" Nov 21 13:38:29 crc kubenswrapper[4769]: E1121 13:38:29.167866 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2\": container with ID starting with 92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2 not found: ID does not exist" containerID="92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.167907 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2"} err="failed to get container status \"92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2\": rpc error: code = NotFound desc = could not find container \"92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2\": container with ID starting with 92061092bf6ea8db46a4ef44cb54f9752e7c01180cd5f9b381ff338554a2afc2 not found: ID does not exist" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.167938 4769 scope.go:117] "RemoveContainer" containerID="116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876" Nov 21 13:38:29 crc kubenswrapper[4769]: E1121 13:38:29.168303 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876\": container with ID starting with 116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876 not found: ID does not exist" containerID="116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.168424 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876"} err="failed to get container status \"116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876\": rpc error: code = NotFound desc = could not find container \"116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876\": container with ID starting with 116e31ab2a19cc920ef95870a9b1b5044e9f26ef58748080fd1f9a5276298876 not found: ID does not exist" Nov 21 13:38:29 crc kubenswrapper[4769]: I1121 13:38:29.282759 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" path="/var/lib/kubelet/pods/599316cf-358f-4e7d-a0da-8fef241c3659/volumes" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.711309 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb"] Nov 21 13:38:41 crc kubenswrapper[4769]: E1121 13:38:41.712264 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" containerName="dnsmasq-dns" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.712282 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" containerName="dnsmasq-dns" Nov 21 13:38:41 crc kubenswrapper[4769]: E1121 13:38:41.712314 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" containerName="init" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.712323 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" containerName="init" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.712545 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="599316cf-358f-4e7d-a0da-8fef241c3659" containerName="dnsmasq-dns" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.715228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.717028 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.717416 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-tls-dnsnames-second-certs-0" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.717655 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.717893 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb"] Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.718067 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.718096 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-crfww" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.718211 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.718812 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-tls-dnsnames-default-certs-0" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.777536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-ssh-key\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.777599 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6djk\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-kube-api-access-k6djk\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.777648 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.777683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.777911 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.778053 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.778116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-tls-dnsnames-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880000 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-ssh-key\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k6djk\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-kube-api-access-k6djk\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880180 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880261 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880413 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.880496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-tls-dnsnames-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.887028 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-ssh-key\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.887253 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.887320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.889448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.889780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.893917 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-tls-dnsnames-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:41 crc kubenswrapper[4769]: I1121 13:38:41.900718 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6djk\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-kube-api-access-k6djk\") pod \"install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:42 crc kubenswrapper[4769]: I1121 13:38:42.069560 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:42 crc kubenswrapper[4769]: I1121 13:38:42.371011 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb"] Nov 21 13:38:42 crc kubenswrapper[4769]: W1121 13:38:42.376043 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c910a7a_ca17_4254_af04_08c3927cc6be.slice/crio-b429af988a807269dc8c130755e8658a0648dbad33462483b710dd7202ef21c4 WatchSource:0}: Error finding container b429af988a807269dc8c130755e8658a0648dbad33462483b710dd7202ef21c4: Status 404 returned error can't find the container with id b429af988a807269dc8c130755e8658a0648dbad33462483b710dd7202ef21c4 Nov 21 13:38:43 crc kubenswrapper[4769]: I1121 13:38:43.294869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" event={"ID":"6c910a7a-ca17-4254-af04-08c3927cc6be","Type":"ContainerStarted","Data":"cf3a0cc5e3479a8c51b359435800f2fab8635623c4d6fe6815c5b6f1cb13637a"} Nov 21 13:38:43 crc kubenswrapper[4769]: I1121 13:38:43.296503 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" event={"ID":"6c910a7a-ca17-4254-af04-08c3927cc6be","Type":"ContainerStarted","Data":"b429af988a807269dc8c130755e8658a0648dbad33462483b710dd7202ef21c4"} Nov 21 13:38:43 crc kubenswrapper[4769]: I1121 13:38:43.315795 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" podStartSLOduration=1.620030543 podStartE2EDuration="2.315774088s" podCreationTimestamp="2025-11-21 13:38:41 +0000 UTC" firstStartedPulling="2025-11-21 13:38:42.378555525 +0000 UTC m=+6481.079217343" lastFinishedPulling="2025-11-21 13:38:43.07429903 +0000 UTC m=+6481.774960888" observedRunningTime="2025-11-21 13:38:43.313916329 +0000 UTC m=+6482.014578197" watchObservedRunningTime="2025-11-21 13:38:43.315774088 +0000 UTC m=+6482.016435906" Nov 21 13:38:47 crc kubenswrapper[4769]: I1121 13:38:47.337271 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c910a7a-ca17-4254-af04-08c3927cc6be" containerID="cf3a0cc5e3479a8c51b359435800f2fab8635623c4d6fe6815c5b6f1cb13637a" exitCode=0 Nov 21 13:38:47 crc kubenswrapper[4769]: I1121 13:38:47.337351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" event={"ID":"6c910a7a-ca17-4254-af04-08c3927cc6be","Type":"ContainerDied","Data":"cf3a0cc5e3479a8c51b359435800f2fab8635623c4d6fe6815c5b6f1cb13637a"} Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.693018 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-second-certs-0\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804120 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-inventory\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-tls-dnsnames-combined-ca-bundle\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804246 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-install-certs-ovrd-combined-ca-bundle\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-ssh-key\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804366 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6djk\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-kube-api-access-k6djk\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.804407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-default-certs-0\") pod \"6c910a7a-ca17-4254-af04-08c3927cc6be\" (UID: \"6c910a7a-ca17-4254-af04-08c3927cc6be\") " Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.811237 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dnsnames-default-certs-0") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "openstack-edpm-tls-tls-dnsnames-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.812097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-kube-api-access-k6djk" (OuterVolumeSpecName: "kube-api-access-k6djk") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "kube-api-access-k6djk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.812614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-tls-dnsnames-combined-ca-bundle" (OuterVolumeSpecName: "tls-dnsnames-combined-ca-bundle") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "tls-dnsnames-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.812833 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.815375 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-second-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dnsnames-second-certs-0") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "openstack-edpm-tls-tls-dnsnames-second-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.835666 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.846592 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-inventory" (OuterVolumeSpecName: "inventory") pod "6c910a7a-ca17-4254-af04-08c3927cc6be" (UID: "6c910a7a-ca17-4254-af04-08c3927cc6be"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906548 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906595 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-k6djk\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-kube-api-access-k6djk\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906614 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-tls-dnsnames-default-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906626 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-tls-dnsnames-second-certs-0\" (UniqueName: \"kubernetes.io/projected/6c910a7a-ca17-4254-af04-08c3927cc6be-openstack-edpm-tls-tls-dnsnames-second-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906638 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906650 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-tls-dnsnames-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:48 crc kubenswrapper[4769]: I1121 13:38:48.906662 4769 reconciler_common.go:293] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c910a7a-ca17-4254-af04-08c3927cc6be-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.370171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" event={"ID":"6c910a7a-ca17-4254-af04-08c3927cc6be","Type":"ContainerDied","Data":"b429af988a807269dc8c130755e8658a0648dbad33462483b710dd7202ef21c4"} Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.370579 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b429af988a807269dc8c130755e8658a0648dbad33462483b710dd7202ef21c4" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.370237 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.451454 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj"] Nov 21 13:38:49 crc kubenswrapper[4769]: E1121 13:38:49.451854 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c910a7a-ca17-4254-af04-08c3927cc6be" containerName="install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.451880 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c910a7a-ca17-4254-af04-08c3927cc6be" containerName="install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.452119 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c910a7a-ca17-4254-af04-08c3927cc6be" containerName="install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.452800 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.456756 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.456880 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-crfww" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.456961 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.457226 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.457236 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.459760 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj"] Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.515261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-tls-dnsnames-combined-ca-bundle\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.515302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-ssh-key\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.515346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-inventory\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.515524 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmzg\" (UniqueName: \"kubernetes.io/projected/c2665085-ab82-4edd-9eae-08d09d0b74d2-kube-api-access-ljmzg\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.617072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-tls-dnsnames-combined-ca-bundle\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.617138 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-ssh-key\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.617227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-inventory\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.617296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmzg\" (UniqueName: \"kubernetes.io/projected/c2665085-ab82-4edd-9eae-08d09d0b74d2-kube-api-access-ljmzg\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.620808 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-tls-dnsnames-combined-ca-bundle\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.628560 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-inventory\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.632946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-ssh-key\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.636318 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmzg\" (UniqueName: \"kubernetes.io/projected/c2665085-ab82-4edd-9eae-08d09d0b74d2-kube-api-access-ljmzg\") pod \"tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:49 crc kubenswrapper[4769]: I1121 13:38:49.778404 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:50 crc kubenswrapper[4769]: I1121 13:38:50.271070 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj"] Nov 21 13:38:50 crc kubenswrapper[4769]: W1121 13:38:50.282472 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2665085_ab82_4edd_9eae_08d09d0b74d2.slice/crio-ec142e76ab14e8eb4c1b30018adf9800d6195125af5c3f564fe952ec9e4df4b8 WatchSource:0}: Error finding container ec142e76ab14e8eb4c1b30018adf9800d6195125af5c3f564fe952ec9e4df4b8: Status 404 returned error can't find the container with id ec142e76ab14e8eb4c1b30018adf9800d6195125af5c3f564fe952ec9e4df4b8 Nov 21 13:38:50 crc kubenswrapper[4769]: I1121 13:38:50.379486 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" event={"ID":"c2665085-ab82-4edd-9eae-08d09d0b74d2","Type":"ContainerStarted","Data":"ec142e76ab14e8eb4c1b30018adf9800d6195125af5c3f564fe952ec9e4df4b8"} Nov 21 13:38:51 crc kubenswrapper[4769]: I1121 13:38:51.391441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" event={"ID":"c2665085-ab82-4edd-9eae-08d09d0b74d2","Type":"ContainerStarted","Data":"1a0dee2695bac7e108629e7fb47320354321d948143c2f5e4fbbcd7e75f0a859"} Nov 21 13:38:51 crc kubenswrapper[4769]: I1121 13:38:51.415340 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" podStartSLOduration=1.895038604 podStartE2EDuration="2.415314179s" podCreationTimestamp="2025-11-21 13:38:49 +0000 UTC" firstStartedPulling="2025-11-21 13:38:50.28836353 +0000 UTC m=+6488.989025358" lastFinishedPulling="2025-11-21 13:38:50.808639115 +0000 UTC m=+6489.509300933" observedRunningTime="2025-11-21 13:38:51.408521449 +0000 UTC m=+6490.109183317" watchObservedRunningTime="2025-11-21 13:38:51.415314179 +0000 UTC m=+6490.115976027" Nov 21 13:38:54 crc kubenswrapper[4769]: I1121 13:38:54.427995 4769 generic.go:334] "Generic (PLEG): container finished" podID="c2665085-ab82-4edd-9eae-08d09d0b74d2" containerID="1a0dee2695bac7e108629e7fb47320354321d948143c2f5e4fbbcd7e75f0a859" exitCode=0 Nov 21 13:38:54 crc kubenswrapper[4769]: I1121 13:38:54.428107 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" event={"ID":"c2665085-ab82-4edd-9eae-08d09d0b74d2","Type":"ContainerDied","Data":"1a0dee2695bac7e108629e7fb47320354321d948143c2f5e4fbbcd7e75f0a859"} Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.759705 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.838756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljmzg\" (UniqueName: \"kubernetes.io/projected/c2665085-ab82-4edd-9eae-08d09d0b74d2-kube-api-access-ljmzg\") pod \"c2665085-ab82-4edd-9eae-08d09d0b74d2\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.838962 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-ssh-key\") pod \"c2665085-ab82-4edd-9eae-08d09d0b74d2\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.839050 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-tls-dnsnames-combined-ca-bundle\") pod \"c2665085-ab82-4edd-9eae-08d09d0b74d2\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.839123 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-inventory\") pod \"c2665085-ab82-4edd-9eae-08d09d0b74d2\" (UID: \"c2665085-ab82-4edd-9eae-08d09d0b74d2\") " Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.844712 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-tls-dnsnames-combined-ca-bundle" (OuterVolumeSpecName: "tls-dnsnames-combined-ca-bundle") pod "c2665085-ab82-4edd-9eae-08d09d0b74d2" (UID: "c2665085-ab82-4edd-9eae-08d09d0b74d2"). InnerVolumeSpecName "tls-dnsnames-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.845060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2665085-ab82-4edd-9eae-08d09d0b74d2-kube-api-access-ljmzg" (OuterVolumeSpecName: "kube-api-access-ljmzg") pod "c2665085-ab82-4edd-9eae-08d09d0b74d2" (UID: "c2665085-ab82-4edd-9eae-08d09d0b74d2"). InnerVolumeSpecName "kube-api-access-ljmzg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.864704 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-inventory" (OuterVolumeSpecName: "inventory") pod "c2665085-ab82-4edd-9eae-08d09d0b74d2" (UID: "c2665085-ab82-4edd-9eae-08d09d0b74d2"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.883010 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "c2665085-ab82-4edd-9eae-08d09d0b74d2" (UID: "c2665085-ab82-4edd-9eae-08d09d0b74d2"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.941174 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ljmzg\" (UniqueName: \"kubernetes.io/projected/c2665085-ab82-4edd-9eae-08d09d0b74d2-kube-api-access-ljmzg\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.941264 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.941297 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dnsnames-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-tls-dnsnames-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:55 crc kubenswrapper[4769]: I1121 13:38:55.941879 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/c2665085-ab82-4edd-9eae-08d09d0b74d2-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:38:56 crc kubenswrapper[4769]: I1121 13:38:56.455927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" event={"ID":"c2665085-ab82-4edd-9eae-08d09d0b74d2","Type":"ContainerDied","Data":"ec142e76ab14e8eb4c1b30018adf9800d6195125af5c3f564fe952ec9e4df4b8"} Nov 21 13:38:56 crc kubenswrapper[4769]: I1121 13:38:56.455993 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec142e76ab14e8eb4c1b30018adf9800d6195125af5c3f564fe952ec9e4df4b8" Nov 21 13:38:56 crc kubenswrapper[4769]: I1121 13:38:56.456031 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.751147 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48"] Nov 21 13:38:58 crc kubenswrapper[4769]: E1121 13:38:58.752208 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c2665085-ab82-4edd-9eae-08d09d0b74d2" containerName="tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.752225 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2665085-ab82-4edd-9eae-08d09d0b74d2" containerName="tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.752458 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c2665085-ab82-4edd-9eae-08d09d0b74d2" containerName="tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.753130 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.755383 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.755873 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.756039 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-tls-dns-ips-default-certs-0" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.756042 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-crfww" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.756231 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.756912 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-custom-tls-dns-default-certs-0" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.758036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.766735 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48"] Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.907838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25t9d\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-kube-api-access-25t9d\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908247 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908366 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908482 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908678 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908779 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:58 crc kubenswrapper[4769]: I1121 13:38:58.908869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-ssh-key\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011014 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-ssh-key\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011114 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-25t9d\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-kube-api-access-25t9d\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011143 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.011322 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.018778 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.019068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.019646 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-ssh-key\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.020002 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.025489 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.026154 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.034007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-inventory\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.044168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-25t9d\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-kube-api-access-25t9d\") pod \"install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.075414 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:38:59 crc kubenswrapper[4769]: I1121 13:38:59.636908 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48"] Nov 21 13:39:00 crc kubenswrapper[4769]: I1121 13:39:00.510435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" event={"ID":"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5","Type":"ContainerStarted","Data":"035c246eb788010bc0c2dbff23dca1e380840d9d0e90c0930b4afb2251dad9b1"} Nov 21 13:39:01 crc kubenswrapper[4769]: I1121 13:39:01.526024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" event={"ID":"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5","Type":"ContainerStarted","Data":"b7999b46cb6b9fea6218c23e90b39928cf68bced4540b10e455987293017b967"} Nov 21 13:39:01 crc kubenswrapper[4769]: I1121 13:39:01.557999 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" podStartSLOduration=2.444102243 podStartE2EDuration="3.557971767s" podCreationTimestamp="2025-11-21 13:38:58 +0000 UTC" firstStartedPulling="2025-11-21 13:38:59.642881723 +0000 UTC m=+6498.343543541" lastFinishedPulling="2025-11-21 13:39:00.756751217 +0000 UTC m=+6499.457413065" observedRunningTime="2025-11-21 13:39:01.552167673 +0000 UTC m=+6500.252829491" watchObservedRunningTime="2025-11-21 13:39:01.557971767 +0000 UTC m=+6500.258633585" Nov 21 13:39:03 crc kubenswrapper[4769]: I1121 13:39:03.908864 4769 scope.go:117] "RemoveContainer" containerID="3c0fcfaf14220aa5dd7cfe8a56d1be9d65d8246658b428d6564e3b22c91539e9" Nov 21 13:39:03 crc kubenswrapper[4769]: I1121 13:39:03.963731 4769 scope.go:117] "RemoveContainer" containerID="02ce821a4b552b8e276c0566076bf0ca416e435f948260b60fe9e4e832e33d2b" Nov 21 13:39:04 crc kubenswrapper[4769]: I1121 13:39:04.016233 4769 scope.go:117] "RemoveContainer" containerID="7c81520ef289c4c39f2d971f9bad236385df8809490cffa01cc7f3362191a091" Nov 21 13:39:04 crc kubenswrapper[4769]: I1121 13:39:04.058249 4769 scope.go:117] "RemoveContainer" containerID="9e5cd229e09e08687983145ebd4abcabc33746072ae3b94360c579b52d035d57" Nov 21 13:39:04 crc kubenswrapper[4769]: I1121 13:39:04.094307 4769 scope.go:117] "RemoveContainer" containerID="97d8ca2aa36c02ef2ec34ae3820617f45d3ae8a89764fc41cdc88e74280c3347" Nov 21 13:39:04 crc kubenswrapper[4769]: I1121 13:39:04.146559 4769 scope.go:117] "RemoveContainer" containerID="2de4529029d546979d6192ce05932fbd91cd9c9896cc413b82f64717fe6ea133" Nov 21 13:39:04 crc kubenswrapper[4769]: I1121 13:39:04.561995 4769 generic.go:334] "Generic (PLEG): container finished" podID="8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" containerID="b7999b46cb6b9fea6218c23e90b39928cf68bced4540b10e455987293017b967" exitCode=0 Nov 21 13:39:04 crc kubenswrapper[4769]: I1121 13:39:04.562133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" event={"ID":"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5","Type":"ContainerDied","Data":"b7999b46cb6b9fea6218c23e90b39928cf68bced4540b10e455987293017b967"} Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.895141 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.914697 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.914833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-tls-dns-ips-combined-ca-bundle\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.916015 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.916059 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-ssh-key\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.916125 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25t9d\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-kube-api-access-25t9d\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.916646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-install-certs-ovrd-combined-ca-bundle\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.916751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-inventory\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.916797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-custom-tls-dns-combined-ca-bundle\") pod \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\" (UID: \"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5\") " Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.921411 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.921478 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.927846 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.928001 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-kube-api-access-25t9d" (OuterVolumeSpecName: "kube-api-access-25t9d") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "kube-api-access-25t9d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.928319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.928819 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.949691 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:05 crc kubenswrapper[4769]: I1121 13:39:05.959240 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-inventory" (OuterVolumeSpecName: "inventory") pod "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" (UID: "8e4748b8-378f-4c76-aa07-5e3d99eb8cb5"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019158 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019224 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019244 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019265 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-25t9d\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-kube-api-access-25t9d\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019283 4769 reconciler_common.go:293] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019295 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019310 4769 reconciler_common.go:293] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.019323 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.598830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" event={"ID":"8e4748b8-378f-4c76-aa07-5e3d99eb8cb5","Type":"ContainerDied","Data":"035c246eb788010bc0c2dbff23dca1e380840d9d0e90c0930b4afb2251dad9b1"} Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.598902 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="035c246eb788010bc0c2dbff23dca1e380840d9d0e90c0930b4afb2251dad9b1" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.598980 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.710704 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8"] Nov 21 13:39:06 crc kubenswrapper[4769]: E1121 13:39:06.711530 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" containerName="install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.711674 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" containerName="install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.712086 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" containerName="install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.713232 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.719781 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.719985 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.719785 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.720391 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.721004 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-crfww" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.722668 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8"] Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.737285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.737343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-ssh-key\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.737404 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-inventory\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.737442 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmb86\" (UniqueName: \"kubernetes.io/projected/f460d023-b58d-441b-96da-409067ab36b7-kube-api-access-xmb86\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.838741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.838808 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-ssh-key\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.838869 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-inventory\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.838899 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xmb86\" (UniqueName: \"kubernetes.io/projected/f460d023-b58d-441b-96da-409067ab36b7-kube-api-access-xmb86\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.844366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-ssh-key\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.844514 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.844583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-inventory\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:06 crc kubenswrapper[4769]: I1121 13:39:06.869010 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmb86\" (UniqueName: \"kubernetes.io/projected/f460d023-b58d-441b-96da-409067ab36b7-kube-api-access-xmb86\") pod \"tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:07 crc kubenswrapper[4769]: I1121 13:39:07.043352 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:07 crc kubenswrapper[4769]: I1121 13:39:07.330855 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8"] Nov 21 13:39:07 crc kubenswrapper[4769]: I1121 13:39:07.618829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" event={"ID":"f460d023-b58d-441b-96da-409067ab36b7","Type":"ContainerStarted","Data":"dcab670b69446450dcf0234fd6eb9e239dfe780fb221a26092c62f3ce7b74d6e"} Nov 21 13:39:09 crc kubenswrapper[4769]: I1121 13:39:09.643830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" event={"ID":"f460d023-b58d-441b-96da-409067ab36b7","Type":"ContainerStarted","Data":"f2dbcb14c12b7accf91b48561ca8d566c4da820850500a6f32c49f10164df00f"} Nov 21 13:39:11 crc kubenswrapper[4769]: I1121 13:39:11.325022 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:39:11 crc kubenswrapper[4769]: I1121 13:39:11.325580 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:39:11 crc kubenswrapper[4769]: I1121 13:39:11.667722 4769 generic.go:334] "Generic (PLEG): container finished" podID="f460d023-b58d-441b-96da-409067ab36b7" containerID="f2dbcb14c12b7accf91b48561ca8d566c4da820850500a6f32c49f10164df00f" exitCode=0 Nov 21 13:39:11 crc kubenswrapper[4769]: I1121 13:39:11.667792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" event={"ID":"f460d023-b58d-441b-96da-409067ab36b7","Type":"ContainerDied","Data":"f2dbcb14c12b7accf91b48561ca8d566c4da820850500a6f32c49f10164df00f"} Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.025828 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.139630 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmb86\" (UniqueName: \"kubernetes.io/projected/f460d023-b58d-441b-96da-409067ab36b7-kube-api-access-xmb86\") pod \"f460d023-b58d-441b-96da-409067ab36b7\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.139733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-ssh-key\") pod \"f460d023-b58d-441b-96da-409067ab36b7\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.139817 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-tls-dns-ips-combined-ca-bundle\") pod \"f460d023-b58d-441b-96da-409067ab36b7\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.139942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-inventory\") pod \"f460d023-b58d-441b-96da-409067ab36b7\" (UID: \"f460d023-b58d-441b-96da-409067ab36b7\") " Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.145944 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "f460d023-b58d-441b-96da-409067ab36b7" (UID: "f460d023-b58d-441b-96da-409067ab36b7"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.146586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f460d023-b58d-441b-96da-409067ab36b7-kube-api-access-xmb86" (OuterVolumeSpecName: "kube-api-access-xmb86") pod "f460d023-b58d-441b-96da-409067ab36b7" (UID: "f460d023-b58d-441b-96da-409067ab36b7"). InnerVolumeSpecName "kube-api-access-xmb86". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.172413 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "f460d023-b58d-441b-96da-409067ab36b7" (UID: "f460d023-b58d-441b-96da-409067ab36b7"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.173572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-inventory" (OuterVolumeSpecName: "inventory") pod "f460d023-b58d-441b-96da-409067ab36b7" (UID: "f460d023-b58d-441b-96da-409067ab36b7"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.242625 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.242686 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.242716 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xmb86\" (UniqueName: \"kubernetes.io/projected/f460d023-b58d-441b-96da-409067ab36b7-kube-api-access-xmb86\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.242736 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/f460d023-b58d-441b-96da-409067ab36b7-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.688829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" event={"ID":"f460d023-b58d-441b-96da-409067ab36b7","Type":"ContainerDied","Data":"dcab670b69446450dcf0234fd6eb9e239dfe780fb221a26092c62f3ce7b74d6e"} Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.689224 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcab670b69446450dcf0234fd6eb9e239dfe780fb221a26092c62f3ce7b74d6e" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.688902 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.762806 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z"] Nov 21 13:39:13 crc kubenswrapper[4769]: E1121 13:39:13.763288 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f460d023-b58d-441b-96da-409067ab36b7" containerName="tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.763310 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f460d023-b58d-441b-96da-409067ab36b7" containerName="tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.763474 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f460d023-b58d-441b-96da-409067ab36b7" containerName="tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.764146 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.768286 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.768492 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.768548 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-crfww" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.768809 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.768827 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.784851 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z"] Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.852693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-inventory\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.852771 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.852862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdcmz\" (UniqueName: \"kubernetes.io/projected/b9cae517-31db-427d-b627-98de827a1949-kube-api-access-wdcmz\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.852927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-ssh-key\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.954680 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-ssh-key\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.954746 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-inventory\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.954775 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.954828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wdcmz\" (UniqueName: \"kubernetes.io/projected/b9cae517-31db-427d-b627-98de827a1949-kube-api-access-wdcmz\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.959652 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-ssh-key\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.959800 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-inventory\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.960372 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:13 crc kubenswrapper[4769]: I1121 13:39:13.974839 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdcmz\" (UniqueName: \"kubernetes.io/projected/b9cae517-31db-427d-b627-98de827a1949-kube-api-access-wdcmz\") pod \"custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:14 crc kubenswrapper[4769]: I1121 13:39:14.082740 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:14 crc kubenswrapper[4769]: I1121 13:39:14.353853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z"] Nov 21 13:39:14 crc kubenswrapper[4769]: I1121 13:39:14.700845 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" event={"ID":"b9cae517-31db-427d-b627-98de827a1949","Type":"ContainerStarted","Data":"f72a330f9da89d4086fe8c0b1c0d0a4667da609bf43d94eabfd3db851e0903d8"} Nov 21 13:39:16 crc kubenswrapper[4769]: I1121 13:39:16.729095 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" event={"ID":"b9cae517-31db-427d-b627-98de827a1949","Type":"ContainerStarted","Data":"4b114220ba0545356eaa9a13c0edb71659c8e15882b54908dc0352ea4310508e"} Nov 21 13:39:16 crc kubenswrapper[4769]: I1121 13:39:16.747765 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" podStartSLOduration=2.442980874 podStartE2EDuration="3.747727846s" podCreationTimestamp="2025-11-21 13:39:13 +0000 UTC" firstStartedPulling="2025-11-21 13:39:14.376978169 +0000 UTC m=+6513.077639987" lastFinishedPulling="2025-11-21 13:39:15.681725121 +0000 UTC m=+6514.382386959" observedRunningTime="2025-11-21 13:39:16.746119653 +0000 UTC m=+6515.446781481" watchObservedRunningTime="2025-11-21 13:39:16.747727846 +0000 UTC m=+6515.448389684" Nov 21 13:39:19 crc kubenswrapper[4769]: I1121 13:39:19.761834 4769 generic.go:334] "Generic (PLEG): container finished" podID="b9cae517-31db-427d-b627-98de827a1949" containerID="4b114220ba0545356eaa9a13c0edb71659c8e15882b54908dc0352ea4310508e" exitCode=0 Nov 21 13:39:19 crc kubenswrapper[4769]: I1121 13:39:19.762153 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" event={"ID":"b9cae517-31db-427d-b627-98de827a1949","Type":"ContainerDied","Data":"4b114220ba0545356eaa9a13c0edb71659c8e15882b54908dc0352ea4310508e"} Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.094217 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.190800 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-custom-tls-dns-combined-ca-bundle\") pod \"b9cae517-31db-427d-b627-98de827a1949\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.190967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-inventory\") pod \"b9cae517-31db-427d-b627-98de827a1949\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.191055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-ssh-key\") pod \"b9cae517-31db-427d-b627-98de827a1949\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.191161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdcmz\" (UniqueName: \"kubernetes.io/projected/b9cae517-31db-427d-b627-98de827a1949-kube-api-access-wdcmz\") pod \"b9cae517-31db-427d-b627-98de827a1949\" (UID: \"b9cae517-31db-427d-b627-98de827a1949\") " Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.198716 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9cae517-31db-427d-b627-98de827a1949-kube-api-access-wdcmz" (OuterVolumeSpecName: "kube-api-access-wdcmz") pod "b9cae517-31db-427d-b627-98de827a1949" (UID: "b9cae517-31db-427d-b627-98de827a1949"). InnerVolumeSpecName "kube-api-access-wdcmz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.198829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "b9cae517-31db-427d-b627-98de827a1949" (UID: "b9cae517-31db-427d-b627-98de827a1949"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.218109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "b9cae517-31db-427d-b627-98de827a1949" (UID: "b9cae517-31db-427d-b627-98de827a1949"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.218490 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-inventory" (OuterVolumeSpecName: "inventory") pod "b9cae517-31db-427d-b627-98de827a1949" (UID: "b9cae517-31db-427d-b627-98de827a1949"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.299845 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wdcmz\" (UniqueName: \"kubernetes.io/projected/b9cae517-31db-427d-b627-98de827a1949-kube-api-access-wdcmz\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.299883 4769 reconciler_common.go:293] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.299895 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.299906 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b9cae517-31db-427d-b627-98de827a1949-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.790179 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" event={"ID":"b9cae517-31db-427d-b627-98de827a1949","Type":"ContainerDied","Data":"f72a330f9da89d4086fe8c0b1c0d0a4667da609bf43d94eabfd3db851e0903d8"} Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.790298 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f72a330f9da89d4086fe8c0b1c0d0a4667da609bf43d94eabfd3db851e0903d8" Nov 21 13:39:21 crc kubenswrapper[4769]: I1121 13:39:21.790335 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.403731 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb"] Nov 21 13:39:23 crc kubenswrapper[4769]: E1121 13:39:23.404517 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b9cae517-31db-427d-b627-98de827a1949" containerName="custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.404536 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9cae517-31db-427d-b627-98de827a1949" containerName="custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.404779 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b9cae517-31db-427d-b627-98de827a1949" containerName="custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.405456 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.407865 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-custom-tls-dns-default-certs-0" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.408036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-openstack-edpm-tls" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.408471 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-dockercfg-crfww" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.410210 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.410230 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.411900 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.416177 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"openstack-edpm-tls-tls-dns-ips-default-certs-0" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.416380 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb"] Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.538388 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.538650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.538781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.538894 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.539002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.539093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.539172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.539307 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.640910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641338 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641444 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641691 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.641753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.645939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.646048 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.646973 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.647277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.647352 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.648274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.649844 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.659038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.735697 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:23 crc kubenswrapper[4769]: I1121 13:39:23.977401 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb"] Nov 21 13:39:24 crc kubenswrapper[4769]: I1121 13:39:24.822547 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" event={"ID":"bc033195-350d-4a96-8f83-7bfc98da609f","Type":"ContainerStarted","Data":"5e3b1ad50c946eaf6e2e614b1cab3a1b398def9135127bd3e666d79934f27442"} Nov 21 13:39:25 crc kubenswrapper[4769]: I1121 13:39:25.831392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" event={"ID":"bc033195-350d-4a96-8f83-7bfc98da609f","Type":"ContainerStarted","Data":"3353f3ca5067e66ae8c7e135b13d35d7063b3d87d8570f1c6013a02ef0de7774"} Nov 21 13:39:28 crc kubenswrapper[4769]: I1121 13:39:28.861915 4769 generic.go:334] "Generic (PLEG): container finished" podID="bc033195-350d-4a96-8f83-7bfc98da609f" containerID="3353f3ca5067e66ae8c7e135b13d35d7063b3d87d8570f1c6013a02ef0de7774" exitCode=0 Nov 21 13:39:28 crc kubenswrapper[4769]: I1121 13:39:28.861993 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" event={"ID":"bc033195-350d-4a96-8f83-7bfc98da609f","Type":"ContainerDied","Data":"3353f3ca5067e66ae8c7e135b13d35d7063b3d87d8570f1c6013a02ef0de7774"} Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.182849 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.268348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.268764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-ssh-key\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.268808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.268912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-custom-tls-dns-combined-ca-bundle\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.268975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-inventory\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.269033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-install-certs-ovrd-combined-ca-bundle\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.269058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-tls-dns-ips-combined-ca-bundle\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.269501 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-kube-api-access-jtb44\") pod \"bc033195-350d-4a96-8f83-7bfc98da609f\" (UID: \"bc033195-350d-4a96-8f83-7bfc98da609f\") " Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.274561 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.274873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.275032 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-kube-api-access-jtb44" (OuterVolumeSpecName: "kube-api-access-jtb44") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "kube-api-access-jtb44". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.275054 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.275136 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.279341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.299776 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.302058 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-inventory" (OuterVolumeSpecName: "inventory") pod "bc033195-350d-4a96-8f83-7bfc98da609f" (UID: "bc033195-350d-4a96-8f83-7bfc98da609f"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.370979 4769 reconciler_common.go:293] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371016 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371072 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371086 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-kube-api-access-jtb44\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371098 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371109 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371118 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bc033195-350d-4a96-8f83-7bfc98da609f-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.371129 4769 reconciler_common.go:293] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc033195-350d-4a96-8f83-7bfc98da609f-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.573159 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h"] Nov 21 13:39:30 crc kubenswrapper[4769]: E1121 13:39:30.576735 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bc033195-350d-4a96-8f83-7bfc98da609f" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.576783 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc033195-350d-4a96-8f83-7bfc98da609f" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.577230 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bc033195-350d-4a96-8f83-7bfc98da609f" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.579924 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.636853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h"] Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676485 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676546 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.676579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781165 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781245 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781281 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781319 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781347 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.781380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.786090 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.786255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.788043 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.790788 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.791039 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.791118 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.793754 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.797675 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.887241 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" event={"ID":"bc033195-350d-4a96-8f83-7bfc98da609f","Type":"ContainerDied","Data":"5e3b1ad50c946eaf6e2e614b1cab3a1b398def9135127bd3e666d79934f27442"} Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.887302 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e3b1ad50c946eaf6e2e614b1cab3a1b398def9135127bd3e666d79934f27442" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.887386 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.898462 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:30 crc kubenswrapper[4769]: E1121 13:39:30.898669 4769 kubelet_pods.go:538] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.964861 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl"] Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.966504 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:30 crc kubenswrapper[4769]: I1121 13:39:30.977395 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl"] Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.086643 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-ssh-key\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.087055 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c96j\" (UniqueName: \"kubernetes.io/projected/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-kube-api-access-7c96j\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.087092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-inventory\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.087138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.192948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-ssh-key\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.193035 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7c96j\" (UniqueName: \"kubernetes.io/projected/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-kube-api-access-7c96j\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.193060 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-inventory\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.193084 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.223116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-tls-dns-ips-combined-ca-bundle\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.243723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-inventory\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.243823 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-ssh-key\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.275914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c96j\" (UniqueName: \"kubernetes.io/projected/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-kube-api-access-7c96j\") pod \"tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.286027 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.463204 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h"] Nov 21 13:39:31 crc kubenswrapper[4769]: E1121 13:39:31.475093 4769 kubelet_pods.go:538] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug" Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.831818 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl"] Nov 21 13:39:31 crc kubenswrapper[4769]: W1121 13:39:31.844955 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb473a6e5_5f1e_4b0a_82d6_ac4b0e34ff5e.slice/crio-53bd3dbb03313cd48157166d4ea328e7e4d324c85039a653be2ba20bca65d62b WatchSource:0}: Error finding container 53bd3dbb03313cd48157166d4ea328e7e4d324c85039a653be2ba20bca65d62b: Status 404 returned error can't find the container with id 53bd3dbb03313cd48157166d4ea328e7e4d324c85039a653be2ba20bca65d62b Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.903171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" event={"ID":"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e","Type":"ContainerStarted","Data":"53bd3dbb03313cd48157166d4ea328e7e4d324c85039a653be2ba20bca65d62b"} Nov 21 13:39:31 crc kubenswrapper[4769]: I1121 13:39:31.905429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" event={"ID":"054277df-295c-48a1-b338-af0dfa444165","Type":"ContainerStarted","Data":"094370f41299ab51ee33e922acff2d1ca837309519fcd45a22405cf0a442e09f"} Nov 21 13:39:32 crc kubenswrapper[4769]: E1121 13:39:32.328064 4769 kubelet_pods.go:538] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug" Nov 21 13:39:32 crc kubenswrapper[4769]: I1121 13:39:32.919329 4769 generic.go:334] "Generic (PLEG): container finished" podID="054277df-295c-48a1-b338-af0dfa444165" containerID="2315e6922dabc8673c1a0f05a3a944d7ac10c7977d7d353987c785c5b612e91a" exitCode=0 Nov 21 13:39:32 crc kubenswrapper[4769]: I1121 13:39:32.919392 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" event={"ID":"054277df-295c-48a1-b338-af0dfa444165","Type":"ContainerDied","Data":"2315e6922dabc8673c1a0f05a3a944d7ac10c7977d7d353987c785c5b612e91a"} Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.009305 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h"] Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.014120 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h"] Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.364798 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889"] Nov 21 13:39:33 crc kubenswrapper[4769]: E1121 13:39:33.366427 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="054277df-295c-48a1-b338-af0dfa444165" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.366458 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="054277df-295c-48a1-b338-af0dfa444165" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.367176 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="054277df-295c-48a1-b338-af0dfa444165" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.368307 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.378655 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889"] Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.445518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.445612 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.445683 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.445796 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.445876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.445923 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.446032 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.446145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.547700 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.548035 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.548160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.548351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.548480 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.549017 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.549387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.549512 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.554074 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.554987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-custom-tls-dns-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.557246 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-ssh-key\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.562600 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-tls-dns-ips-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.563121 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-inventory\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.563360 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-install-certs-ovrd-combined-ca-bundle\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.565098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.571482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-kube-api-access-jtb44\") pod \"install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.699470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:33 crc kubenswrapper[4769]: E1121 13:39:33.699862 4769 kubelet_pods.go:538] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug" Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.936370 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" event={"ID":"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e","Type":"ContainerStarted","Data":"06b5f8feb10ca3bf8bd2a181969175eaf41d91f92af43d2fc479258a8cfc1e4e"} Nov 21 13:39:33 crc kubenswrapper[4769]: I1121 13:39:33.957261 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" podStartSLOduration=2.9657102379999998 podStartE2EDuration="3.957234521s" podCreationTimestamp="2025-11-21 13:39:30 +0000 UTC" firstStartedPulling="2025-11-21 13:39:31.848726722 +0000 UTC m=+6530.549388580" lastFinishedPulling="2025-11-21 13:39:32.840251045 +0000 UTC m=+6531.540912863" observedRunningTime="2025-11-21 13:39:33.954410246 +0000 UTC m=+6532.655072074" watchObservedRunningTime="2025-11-21 13:39:33.957234521 +0000 UTC m=+6532.657896349" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.188166 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889"] Nov 21 13:39:34 crc kubenswrapper[4769]: W1121 13:39:34.204733 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbda40258_02ad_471e_96a8_544ba4a42598.slice/crio-e9ae095e8594e9f566445e0d0c4bbd1b95ce73176edb82a7a9538e3602f02196 WatchSource:0}: Error finding container e9ae095e8594e9f566445e0d0c4bbd1b95ce73176edb82a7a9538e3602f02196: Status 404 returned error can't find the container with id e9ae095e8594e9f566445e0d0c4bbd1b95ce73176edb82a7a9538e3602f02196 Nov 21 13:39:34 crc kubenswrapper[4769]: E1121 13:39:34.205568 4769 kubelet_pods.go:538] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.263830 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363308 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363376 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-custom-tls-dns-combined-ca-bundle\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-kube-api-access-jtb44\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363573 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-tls-dns-ips-combined-ca-bundle\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-inventory\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-ssh-key\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.363730 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-install-certs-ovrd-combined-ca-bundle\") pod \"054277df-295c-48a1-b338-af0dfa444165\" (UID: \"054277df-295c-48a1-b338-af0dfa444165\") " Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.370963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.371209 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-kube-api-access-jtb44" (OuterVolumeSpecName: "kube-api-access-jtb44") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "kube-api-access-jtb44". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.371540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.371886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.372525 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.373166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.399915 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-inventory" (OuterVolumeSpecName: "inventory") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.403346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "054277df-295c-48a1-b338-af0dfa444165" (UID: "054277df-295c-48a1-b338-af0dfa444165"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.466714 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.466798 4769 reconciler_common.go:293] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.466836 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-kube-api-access-jtb44\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.466867 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.466898 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.466928 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/054277df-295c-48a1-b338-af0dfa444165-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.467021 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.467055 4769 reconciler_common.go:293] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/054277df-295c-48a1-b338-af0dfa444165-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.948741 4769 scope.go:117] "RemoveContainer" containerID="2315e6922dabc8673c1a0f05a3a944d7ac10c7977d7d353987c785c5b612e91a" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.948840 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-8dt4h" Nov 21 13:39:34 crc kubenswrapper[4769]: I1121 13:39:34.950772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" event={"ID":"bda40258-02ad-471e-96a8-544ba4a42598","Type":"ContainerStarted","Data":"e9ae095e8594e9f566445e0d0c4bbd1b95ce73176edb82a7a9538e3602f02196"} Nov 21 13:39:35 crc kubenswrapper[4769]: I1121 13:39:35.293145 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054277df-295c-48a1-b338-af0dfa444165" path="/var/lib/kubelet/pods/054277df-295c-48a1-b338-af0dfa444165/volumes" Nov 21 13:39:35 crc kubenswrapper[4769]: E1121 13:39:35.923732 4769 kubelet_pods.go:538] "Hostname for pod was too long, truncated it" podName="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" hostnameMaxLen=63 truncatedHostname="install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug" Nov 21 13:39:35 crc kubenswrapper[4769]: I1121 13:39:35.977684 4769 generic.go:334] "Generic (PLEG): container finished" podID="b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" containerID="06b5f8feb10ca3bf8bd2a181969175eaf41d91f92af43d2fc479258a8cfc1e4e" exitCode=0 Nov 21 13:39:35 crc kubenswrapper[4769]: I1121 13:39:35.977836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" event={"ID":"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e","Type":"ContainerDied","Data":"06b5f8feb10ca3bf8bd2a181969175eaf41d91f92af43d2fc479258a8cfc1e4e"} Nov 21 13:39:36 crc kubenswrapper[4769]: I1121 13:39:36.995582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" event={"ID":"bda40258-02ad-471e-96a8-544ba4a42598","Type":"ContainerStarted","Data":"a8e687809e24b11d6b6b6bf296ef8941293c4ebbd7bf81895d3c3151de8a991e"} Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.471163 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.517998 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-tls-dns-ips-combined-ca-bundle\") pod \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.518089 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-ssh-key\") pod \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.518176 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-inventory\") pod \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.518220 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c96j\" (UniqueName: \"kubernetes.io/projected/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-kube-api-access-7c96j\") pod \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\" (UID: \"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e\") " Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.525361 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" (UID: "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.525380 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-kube-api-access-7c96j" (OuterVolumeSpecName: "kube-api-access-7c96j") pod "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" (UID: "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e"). InnerVolumeSpecName "kube-api-access-7c96j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.554148 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-inventory" (OuterVolumeSpecName: "inventory") pod "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" (UID: "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.564415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" (UID: "b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.629267 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.629315 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7c96j\" (UniqueName: \"kubernetes.io/projected/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-kube-api-access-7c96j\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.629331 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:37 crc kubenswrapper[4769]: I1121 13:39:37.629346 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.006569 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.006560 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl" event={"ID":"b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e","Type":"ContainerDied","Data":"53bd3dbb03313cd48157166d4ea328e7e4d324c85039a653be2ba20bca65d62b"} Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.006975 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53bd3dbb03313cd48157166d4ea328e7e4d324c85039a653be2ba20bca65d62b" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.007893 4769 generic.go:334] "Generic (PLEG): container finished" podID="bda40258-02ad-471e-96a8-544ba4a42598" containerID="a8e687809e24b11d6b6b6bf296ef8941293c4ebbd7bf81895d3c3151de8a991e" exitCode=0 Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.007920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" event={"ID":"bda40258-02ad-471e-96a8-544ba4a42598","Type":"ContainerDied","Data":"a8e687809e24b11d6b6b6bf296ef8941293c4ebbd7bf81895d3c3151de8a991e"} Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.080520 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.118896 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.195962 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd"] Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.196668 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" containerName="tls-dns-ips-certs-refresh-openstack-edpm-tls" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.196714 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" containerName="tls-dns-ips-certs-refresh-openstack-edpm-tls" Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.196737 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bda40258-02ad-471e-96a8-544ba4a42598" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.196746 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda40258-02ad-471e-96a8-544ba4a42598" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.197074 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" containerName="tls-dns-ips-certs-refresh-openstack-edpm-tls" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.197105 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bda40258-02ad-471e-96a8-544ba4a42598" containerName="install-certs-ovrd-certs-refresh-openstack-edpm-tls" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.211805 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.224280 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.249359 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.255989 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.261668 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.272022 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.277240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.283645 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.291807 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.303307 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-certs-refresh-openstack-edpm-tls-frszl"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.308833 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/tls-dns-ips-openstack-edpm-tls-ovrd-openstack-edpm-tls-nn9z8"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.314104 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/tls-dnsnames-openstack-edpm-tls-openstack-edpm-tls-bt5rj"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.318982 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-openstack-edpm-tls-ovrd-openstack-edpm-tls-l6d8z"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.323811 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-ovrd-openstack-edpm-fkn48"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.328641 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.334636 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/install-certs-ovrd-openstack-edpm-tls-openstack-edpm-tls-48rmb"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.340236 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd"] Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.340677 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[custom-tls-dns-combined-ca-bundle inventory kube-api-access-mtql2 ssh-key], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" podUID="802b1d2b-fdc3-40e6-b55b-124a54949027" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.345966 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.346026 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.346062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtql2\" (UniqueName: \"kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.346120 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-ssh-key\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.346786 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.348165 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.358897 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4"] Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447275 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdlx\" (UniqueName: \"kubernetes.io/projected/d21d9150-6ba0-42ae-b205-a5bab275fb3a-kube-api-access-7zdlx\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447334 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447370 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mtql2\" (UniqueName: \"kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447421 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-ssh-key\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.447524 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.448451 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-openstack-edpm-tls: secret "dataplanenodeset-openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.448542 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory podName:802b1d2b-fdc3-40e6-b55b-124a54949027 nodeName:}" failed. No retries permitted until 2025-11-21 13:39:38.948520284 +0000 UTC m=+6537.649182102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory") pod "custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027") : secret "dataplanenodeset-openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.453124 4769 projected.go:194] Error preparing data for projected volume kube-api-access-mtql2 for pod openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd: failed to fetch token: serviceaccounts "openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.453172 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2 podName:802b1d2b-fdc3-40e6-b55b-124a54949027 nodeName:}" failed. No retries permitted until 2025-11-21 13:39:38.953163037 +0000 UTC m=+6537.653824855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mtql2" (UniqueName: "kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2") pod "custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027") : failed to fetch token: serviceaccounts "openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.464240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-ssh-key\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.465330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-custom-tls-dns-combined-ca-bundle\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.549043 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.549248 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.549316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdlx\" (UniqueName: \"kubernetes.io/projected/d21d9150-6ba0-42ae-b205-a5bab275fb3a-kube-api-access-7zdlx\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.550305 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.550497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.576493 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdlx\" (UniqueName: \"kubernetes.io/projected/d21d9150-6ba0-42ae-b205-a5bab275fb3a-kube-api-access-7zdlx\") pod \"dnsmasq-dnsmasq-84b9f45d47-9hbl4\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.663647 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.959050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: I1121 13:39:38.959557 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mtql2\" (UniqueName: \"kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.960078 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-openstack-edpm-tls: secret "dataplanenodeset-openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.960139 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory podName:802b1d2b-fdc3-40e6-b55b-124a54949027 nodeName:}" failed. No retries permitted until 2025-11-21 13:39:39.96011996 +0000 UTC m=+6538.660781788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory") pod "custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027") : secret "dataplanenodeset-openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.962523 4769 projected.go:194] Error preparing data for projected volume kube-api-access-mtql2 for pod openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd: failed to fetch token: serviceaccounts "openstack-edpm-tls" not found Nov 21 13:39:38 crc kubenswrapper[4769]: E1121 13:39:38.962611 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2 podName:802b1d2b-fdc3-40e6-b55b-124a54949027 nodeName:}" failed. No retries permitted until 2025-11-21 13:39:39.962587696 +0000 UTC m=+6538.663249534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtql2" (UniqueName: "kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2") pod "custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027") : failed to fetch token: serviceaccounts "openstack-edpm-tls" not found Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.019887 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.032322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.128767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4"] Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.161892 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-ssh-key\") pod \"802b1d2b-fdc3-40e6-b55b-124a54949027\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.162155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-custom-tls-dns-combined-ca-bundle\") pod \"802b1d2b-fdc3-40e6-b55b-124a54949027\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.165621 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "802b1d2b-fdc3-40e6-b55b-124a54949027" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.165671 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "802b1d2b-fdc3-40e6-b55b-124a54949027" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.264234 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.264557 4769 reconciler_common.go:293] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.277123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.286857 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c910a7a-ca17-4254-af04-08c3927cc6be" path="/var/lib/kubelet/pods/6c910a7a-ca17-4254-af04-08c3927cc6be/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.288045 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4748b8-378f-4c76-aa07-5e3d99eb8cb5" path="/var/lib/kubelet/pods/8e4748b8-378f-4c76-aa07-5e3d99eb8cb5/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.288591 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e" path="/var/lib/kubelet/pods/b473a6e5-5f1e-4b0a-82d6-ac4b0e34ff5e/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.289053 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9cae517-31db-427d-b627-98de827a1949" path="/var/lib/kubelet/pods/b9cae517-31db-427d-b627-98de827a1949/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.289981 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc033195-350d-4a96-8f83-7bfc98da609f" path="/var/lib/kubelet/pods/bc033195-350d-4a96-8f83-7bfc98da609f/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.290525 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2665085-ab82-4edd-9eae-08d09d0b74d2" path="/var/lib/kubelet/pods/c2665085-ab82-4edd-9eae-08d09d0b74d2/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.290980 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f460d023-b58d-441b-96da-409067ab36b7" path="/var/lib/kubelet/pods/f460d023-b58d-441b-96da-409067ab36b7/volumes" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-custom-tls-dns-default-certs-0\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365107 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-ssh-key\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365148 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-inventory\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-tls-dns-ips-default-certs-0\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365217 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-install-certs-ovrd-combined-ca-bundle\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365235 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-custom-tls-dns-combined-ca-bundle\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365264 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-tls-dns-ips-combined-ca-bundle\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.365292 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-kube-api-access-jtb44\") pod \"bda40258-02ad-471e-96a8-544ba4a42598\" (UID: \"bda40258-02ad-471e-96a8-544ba4a42598\") " Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.370328 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-install-certs-ovrd-combined-ca-bundle" (OuterVolumeSpecName: "install-certs-ovrd-combined-ca-bundle") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "install-certs-ovrd-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.371183 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-kube-api-access-jtb44" (OuterVolumeSpecName: "kube-api-access-jtb44") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "kube-api-access-jtb44". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.371873 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-tls-dns-ips-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-tls-dns-ips-default-certs-0") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "openstack-edpm-tls-tls-dns-ips-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.372092 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-custom-tls-dns-default-certs-0" (OuterVolumeSpecName: "openstack-edpm-tls-custom-tls-dns-default-certs-0") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "openstack-edpm-tls-custom-tls-dns-default-certs-0". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.372570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-tls-dns-ips-combined-ca-bundle" (OuterVolumeSpecName: "tls-dns-ips-combined-ca-bundle") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "tls-dns-ips-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.380297 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-custom-tls-dns-combined-ca-bundle" (OuterVolumeSpecName: "custom-tls-dns-combined-ca-bundle") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "custom-tls-dns-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.393035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-inventory" (OuterVolumeSpecName: "inventory") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.422591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "bda40258-02ad-471e-96a8-544ba4a42598" (UID: "bda40258-02ad-471e-96a8-544ba4a42598"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468475 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468524 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-tls-dns-ips-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-tls-dns-ips-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468540 4769 reconciler_common.go:293] "Volume detached for volume \"install-certs-ovrd-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-install-certs-ovrd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468557 4769 reconciler_common.go:293] "Volume detached for volume \"custom-tls-dns-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-custom-tls-dns-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468571 4769 reconciler_common.go:293] "Volume detached for volume \"tls-dns-ips-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-tls-dns-ips-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468585 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jtb44\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-kube-api-access-jtb44\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468601 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls-custom-tls-dns-default-certs-0\" (UniqueName: \"kubernetes.io/projected/bda40258-02ad-471e-96a8-544ba4a42598-openstack-edpm-tls-custom-tls-dns-default-certs-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.468614 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/bda40258-02ad-471e-96a8-544ba4a42598-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.976080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:39 crc kubenswrapper[4769]: I1121 13:39:39.976219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mtql2\" (UniqueName: \"kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2\") pod \"custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd\" (UID: \"802b1d2b-fdc3-40e6-b55b-124a54949027\") " pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:39 crc kubenswrapper[4769]: E1121 13:39:39.976436 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-openstack-edpm-tls: secret "dataplanenodeset-openstack-edpm-tls" not found Nov 21 13:39:39 crc kubenswrapper[4769]: E1121 13:39:39.976627 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory podName:802b1d2b-fdc3-40e6-b55b-124a54949027 nodeName:}" failed. No retries permitted until 2025-11-21 13:39:41.976582213 +0000 UTC m=+6540.677244071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory") pod "custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027") : secret "dataplanenodeset-openstack-edpm-tls" not found Nov 21 13:39:39 crc kubenswrapper[4769]: E1121 13:39:39.979798 4769 projected.go:194] Error preparing data for projected volume kube-api-access-mtql2 for pod openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd: failed to fetch token: serviceaccounts "openstack-edpm-tls" not found Nov 21 13:39:39 crc kubenswrapper[4769]: E1121 13:39:39.979911 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2 podName:802b1d2b-fdc3-40e6-b55b-124a54949027 nodeName:}" failed. No retries permitted until 2025-11-21 13:39:41.979884551 +0000 UTC m=+6540.680546409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtql2" (UniqueName: "kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2") pod "custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" (UID: "802b1d2b-fdc3-40e6-b55b-124a54949027") : failed to fetch token: serviceaccounts "openstack-edpm-tls" not found Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.036533 4769 scope.go:117] "RemoveContainer" containerID="a8e687809e24b11d6b6b6bf296ef8941293c4ebbd7bf81895d3c3151de8a991e" Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.036541 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/install-certs-ovrd-certs-refresh-openstack-edpm-tls-nj5pb-debug-5j889" Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.038498 4769 generic.go:334] "Generic (PLEG): container finished" podID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerID="7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8" exitCode=0 Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.038885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd" Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.038568 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" event={"ID":"d21d9150-6ba0-42ae-b205-a5bab275fb3a","Type":"ContainerDied","Data":"7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8"} Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.038981 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" event={"ID":"d21d9150-6ba0-42ae-b205-a5bab275fb3a","Type":"ContainerStarted","Data":"9f6a6b6243e17f9fa527eb9c10fde8155c47bb61d2ecb3a25b1555bfc32dbd37"} Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.098745 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd"] Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.108066 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-tls-dns-certs-refresh-openstack-edpm-tls-nwxkd"] Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.186902 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mtql2\" (UniqueName: \"kubernetes.io/projected/802b1d2b-fdc3-40e6-b55b-124a54949027-kube-api-access-mtql2\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:40 crc kubenswrapper[4769]: I1121 13:39:40.186939 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/802b1d2b-fdc3-40e6-b55b-124a54949027-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:41 crc kubenswrapper[4769]: I1121 13:39:41.054178 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" event={"ID":"d21d9150-6ba0-42ae-b205-a5bab275fb3a","Type":"ContainerStarted","Data":"7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe"} Nov 21 13:39:41 crc kubenswrapper[4769]: I1121 13:39:41.054830 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:41 crc kubenswrapper[4769]: I1121 13:39:41.286812 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="802b1d2b-fdc3-40e6-b55b-124a54949027" path="/var/lib/kubelet/pods/802b1d2b-fdc3-40e6-b55b-124a54949027/volumes" Nov 21 13:39:41 crc kubenswrapper[4769]: I1121 13:39:41.287563 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda40258-02ad-471e-96a8-544ba4a42598" path="/var/lib/kubelet/pods/bda40258-02ad-471e-96a8-544ba4a42598/volumes" Nov 21 13:39:41 crc kubenswrapper[4769]: I1121 13:39:41.325337 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:39:41 crc kubenswrapper[4769]: I1121 13:39:41.325433 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.069975 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" podStartSLOduration=9.069956594 podStartE2EDuration="9.069956594s" podCreationTimestamp="2025-11-21 13:39:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:39:41.081028468 +0000 UTC m=+6539.781690316" watchObservedRunningTime="2025-11-21 13:39:47.069956594 +0000 UTC m=+6545.770618412" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.072969 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-zbbk2"] Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.077763 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-zbbk2"] Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.210968 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-z5qqq"] Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.212478 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.214471 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.214557 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.214692 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.215266 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.226013 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-z5qqq"] Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.311346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/749ab886-7a96-4951-8946-d5f36eccdf61-crc-storage\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.311426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/749ab886-7a96-4951-8946-d5f36eccdf61-node-mnt\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.311458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll8wn\" (UniqueName: \"kubernetes.io/projected/749ab886-7a96-4951-8946-d5f36eccdf61-kube-api-access-ll8wn\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.375991 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e68cbf-48a9-4bc3-b4b5-ccf57937f89d" path="/var/lib/kubelet/pods/57e68cbf-48a9-4bc3-b4b5-ccf57937f89d/volumes" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.413340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/749ab886-7a96-4951-8946-d5f36eccdf61-crc-storage\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.413530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/749ab886-7a96-4951-8946-d5f36eccdf61-node-mnt\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.413601 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ll8wn\" (UniqueName: \"kubernetes.io/projected/749ab886-7a96-4951-8946-d5f36eccdf61-kube-api-access-ll8wn\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.414013 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/749ab886-7a96-4951-8946-d5f36eccdf61-node-mnt\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.427381 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/749ab886-7a96-4951-8946-d5f36eccdf61-crc-storage\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.435366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll8wn\" (UniqueName: \"kubernetes.io/projected/749ab886-7a96-4951-8946-d5f36eccdf61-kube-api-access-ll8wn\") pod \"crc-storage-crc-z5qqq\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.536882 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:47 crc kubenswrapper[4769]: I1121 13:39:47.985817 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-z5qqq"] Nov 21 13:39:48 crc kubenswrapper[4769]: I1121 13:39:48.142366 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-z5qqq" event={"ID":"749ab886-7a96-4951-8946-d5f36eccdf61","Type":"ContainerStarted","Data":"9b07b3b77dcd41b16498cb27365c5bf06692f4dc223cad910f5cbf412e78eb48"} Nov 21 13:39:48 crc kubenswrapper[4769]: I1121 13:39:48.666145 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:39:48 crc kubenswrapper[4769]: I1121 13:39:48.708313 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c"] Nov 21 13:39:48 crc kubenswrapper[4769]: I1121 13:39:48.708572 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerName="dnsmasq-dns" containerID="cri-o://fdb2f1ff2642196894273f8c0c9be90a614400278a3f332700951a2593c96173" gracePeriod=10 Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.157093 4769 generic.go:334] "Generic (PLEG): container finished" podID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerID="fdb2f1ff2642196894273f8c0c9be90a614400278a3f332700951a2593c96173" exitCode=0 Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.157206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" event={"ID":"23a9d37c-372a-4b80-92dd-64dcf4518783","Type":"ContainerDied","Data":"fdb2f1ff2642196894273f8c0c9be90a614400278a3f332700951a2593c96173"} Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.157522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" event={"ID":"23a9d37c-372a-4b80-92dd-64dcf4518783","Type":"ContainerDied","Data":"094395134edb54fba0ab0281771bd0fb571da36a8afbfaeb1cc06c9863e6bd60"} Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.157539 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="094395134edb54fba0ab0281771bd0fb571da36a8afbfaeb1cc06c9863e6bd60" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.236796 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.345204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-config\") pod \"23a9d37c-372a-4b80-92dd-64dcf4518783\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.345266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b8dm\" (UniqueName: \"kubernetes.io/projected/23a9d37c-372a-4b80-92dd-64dcf4518783-kube-api-access-5b8dm\") pod \"23a9d37c-372a-4b80-92dd-64dcf4518783\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.345377 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-dnsmasq-svc\") pod \"23a9d37c-372a-4b80-92dd-64dcf4518783\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.345428 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-openstack-edpm-tls\") pod \"23a9d37c-372a-4b80-92dd-64dcf4518783\" (UID: \"23a9d37c-372a-4b80-92dd-64dcf4518783\") " Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.350742 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a9d37c-372a-4b80-92dd-64dcf4518783-kube-api-access-5b8dm" (OuterVolumeSpecName: "kube-api-access-5b8dm") pod "23a9d37c-372a-4b80-92dd-64dcf4518783" (UID: "23a9d37c-372a-4b80-92dd-64dcf4518783"). InnerVolumeSpecName "kube-api-access-5b8dm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.383795 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-config" (OuterVolumeSpecName: "config") pod "23a9d37c-372a-4b80-92dd-64dcf4518783" (UID: "23a9d37c-372a-4b80-92dd-64dcf4518783"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.385583 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "23a9d37c-372a-4b80-92dd-64dcf4518783" (UID: "23a9d37c-372a-4b80-92dd-64dcf4518783"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.407356 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-openstack-edpm-tls" (OuterVolumeSpecName: "openstack-edpm-tls") pod "23a9d37c-372a-4b80-92dd-64dcf4518783" (UID: "23a9d37c-372a-4b80-92dd-64dcf4518783"). InnerVolumeSpecName "openstack-edpm-tls". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.447621 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.447672 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5b8dm\" (UniqueName: \"kubernetes.io/projected/23a9d37c-372a-4b80-92dd-64dcf4518783-kube-api-access-5b8dm\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.447691 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:49 crc kubenswrapper[4769]: I1121 13:39:49.447705 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-tls\" (UniqueName: \"kubernetes.io/configmap/23a9d37c-372a-4b80-92dd-64dcf4518783-openstack-edpm-tls\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:50 crc kubenswrapper[4769]: I1121 13:39:50.169741 4769 generic.go:334] "Generic (PLEG): container finished" podID="749ab886-7a96-4951-8946-d5f36eccdf61" containerID="2d21a86b29e5a5840ad6672cdfbe3372a8f44459294614805ddb7933616b8c0b" exitCode=0 Nov 21 13:39:50 crc kubenswrapper[4769]: I1121 13:39:50.169837 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-z5qqq" event={"ID":"749ab886-7a96-4951-8946-d5f36eccdf61","Type":"ContainerDied","Data":"2d21a86b29e5a5840ad6672cdfbe3372a8f44459294614805ddb7933616b8c0b"} Nov 21 13:39:50 crc kubenswrapper[4769]: I1121 13:39:50.169882 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c" Nov 21 13:39:50 crc kubenswrapper[4769]: I1121 13:39:50.234782 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c"] Nov 21 13:39:50 crc kubenswrapper[4769]: I1121 13:39:50.240576 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79cc674687-blf2c"] Nov 21 13:39:50 crc kubenswrapper[4769]: E1121 13:39:50.347751 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a9d37c_372a_4b80_92dd_64dcf4518783.slice/crio-094395134edb54fba0ab0281771bd0fb571da36a8afbfaeb1cc06c9863e6bd60\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a9d37c_372a_4b80_92dd_64dcf4518783.slice\": RecentStats: unable to find data in memory cache]" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.286648 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" path="/var/lib/kubelet/pods/23a9d37c-372a-4b80-92dd-64dcf4518783/volumes" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.484608 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.602021 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll8wn\" (UniqueName: \"kubernetes.io/projected/749ab886-7a96-4951-8946-d5f36eccdf61-kube-api-access-ll8wn\") pod \"749ab886-7a96-4951-8946-d5f36eccdf61\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.602082 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/749ab886-7a96-4951-8946-d5f36eccdf61-node-mnt\") pod \"749ab886-7a96-4951-8946-d5f36eccdf61\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.602150 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/749ab886-7a96-4951-8946-d5f36eccdf61-crc-storage\") pod \"749ab886-7a96-4951-8946-d5f36eccdf61\" (UID: \"749ab886-7a96-4951-8946-d5f36eccdf61\") " Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.602251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/749ab886-7a96-4951-8946-d5f36eccdf61-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "749ab886-7a96-4951-8946-d5f36eccdf61" (UID: "749ab886-7a96-4951-8946-d5f36eccdf61"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.602465 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/749ab886-7a96-4951-8946-d5f36eccdf61-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.608420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749ab886-7a96-4951-8946-d5f36eccdf61-kube-api-access-ll8wn" (OuterVolumeSpecName: "kube-api-access-ll8wn") pod "749ab886-7a96-4951-8946-d5f36eccdf61" (UID: "749ab886-7a96-4951-8946-d5f36eccdf61"). InnerVolumeSpecName "kube-api-access-ll8wn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.621751 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/749ab886-7a96-4951-8946-d5f36eccdf61-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "749ab886-7a96-4951-8946-d5f36eccdf61" (UID: "749ab886-7a96-4951-8946-d5f36eccdf61"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.703441 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ll8wn\" (UniqueName: \"kubernetes.io/projected/749ab886-7a96-4951-8946-d5f36eccdf61-kube-api-access-ll8wn\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:51 crc kubenswrapper[4769]: I1121 13:39:51.703476 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/749ab886-7a96-4951-8946-d5f36eccdf61-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:52 crc kubenswrapper[4769]: I1121 13:39:52.187913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-z5qqq" event={"ID":"749ab886-7a96-4951-8946-d5f36eccdf61","Type":"ContainerDied","Data":"9b07b3b77dcd41b16498cb27365c5bf06692f4dc223cad910f5cbf412e78eb48"} Nov 21 13:39:52 crc kubenswrapper[4769]: I1121 13:39:52.187950 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b07b3b77dcd41b16498cb27365c5bf06692f4dc223cad910f5cbf412e78eb48" Nov 21 13:39:52 crc kubenswrapper[4769]: I1121 13:39:52.187965 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-z5qqq" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.112834 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-z5qqq"] Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.126616 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-z5qqq"] Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.252069 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-hgs8l"] Nov 21 13:39:55 crc kubenswrapper[4769]: E1121 13:39:55.253043 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerName="dnsmasq-dns" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.253083 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerName="dnsmasq-dns" Nov 21 13:39:55 crc kubenswrapper[4769]: E1121 13:39:55.253122 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="749ab886-7a96-4951-8946-d5f36eccdf61" containerName="storage" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.253135 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="749ab886-7a96-4951-8946-d5f36eccdf61" containerName="storage" Nov 21 13:39:55 crc kubenswrapper[4769]: E1121 13:39:55.253153 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerName="init" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.253167 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerName="init" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.255969 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="749ab886-7a96-4951-8946-d5f36eccdf61" containerName="storage" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.256019 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="23a9d37c-372a-4b80-92dd-64dcf4518783" containerName="dnsmasq-dns" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.256881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.257500 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hgs8l"] Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.260647 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.260646 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.261096 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.263415 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.298695 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="749ab886-7a96-4951-8946-d5f36eccdf61" path="/var/lib/kubelet/pods/749ab886-7a96-4951-8946-d5f36eccdf61/volumes" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.380070 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42817888-020e-41a2-9de0-7c71ddd9cb8e-node-mnt\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.380458 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v49n2\" (UniqueName: \"kubernetes.io/projected/42817888-020e-41a2-9de0-7c71ddd9cb8e-kube-api-access-v49n2\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.381324 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42817888-020e-41a2-9de0-7c71ddd9cb8e-crc-storage\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.483682 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42817888-020e-41a2-9de0-7c71ddd9cb8e-crc-storage\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.483925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42817888-020e-41a2-9de0-7c71ddd9cb8e-node-mnt\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.484242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v49n2\" (UniqueName: \"kubernetes.io/projected/42817888-020e-41a2-9de0-7c71ddd9cb8e-kube-api-access-v49n2\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.484342 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42817888-020e-41a2-9de0-7c71ddd9cb8e-node-mnt\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.485003 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42817888-020e-41a2-9de0-7c71ddd9cb8e-crc-storage\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.506907 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v49n2\" (UniqueName: \"kubernetes.io/projected/42817888-020e-41a2-9de0-7c71ddd9cb8e-kube-api-access-v49n2\") pod \"crc-storage-crc-hgs8l\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:55 crc kubenswrapper[4769]: I1121 13:39:55.593249 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:56 crc kubenswrapper[4769]: I1121 13:39:56.436663 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hgs8l"] Nov 21 13:39:56 crc kubenswrapper[4769]: W1121 13:39:56.450484 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42817888_020e_41a2_9de0_7c71ddd9cb8e.slice/crio-17670ac31013e237540bb2c4ac7df18800746436044b21fb86ee6dbf532961f6 WatchSource:0}: Error finding container 17670ac31013e237540bb2c4ac7df18800746436044b21fb86ee6dbf532961f6: Status 404 returned error can't find the container with id 17670ac31013e237540bb2c4ac7df18800746436044b21fb86ee6dbf532961f6 Nov 21 13:39:57 crc kubenswrapper[4769]: I1121 13:39:57.417662 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hgs8l" event={"ID":"42817888-020e-41a2-9de0-7c71ddd9cb8e","Type":"ContainerStarted","Data":"17670ac31013e237540bb2c4ac7df18800746436044b21fb86ee6dbf532961f6"} Nov 21 13:39:58 crc kubenswrapper[4769]: I1121 13:39:58.439108 4769 generic.go:334] "Generic (PLEG): container finished" podID="42817888-020e-41a2-9de0-7c71ddd9cb8e" containerID="ab258edd23bf216a2fc7fcc8078a71a0af84e7f1c6cffb58c44b4f1bcc8cdbaf" exitCode=0 Nov 21 13:39:58 crc kubenswrapper[4769]: I1121 13:39:58.439296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hgs8l" event={"ID":"42817888-020e-41a2-9de0-7c71ddd9cb8e","Type":"ContainerDied","Data":"ab258edd23bf216a2fc7fcc8078a71a0af84e7f1c6cffb58c44b4f1bcc8cdbaf"} Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.734841 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.873323 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/42817888-020e-41a2-9de0-7c71ddd9cb8e-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "42817888-020e-41a2-9de0-7c71ddd9cb8e" (UID: "42817888-020e-41a2-9de0-7c71ddd9cb8e"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.873372 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42817888-020e-41a2-9de0-7c71ddd9cb8e-node-mnt\") pod \"42817888-020e-41a2-9de0-7c71ddd9cb8e\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.873466 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v49n2\" (UniqueName: \"kubernetes.io/projected/42817888-020e-41a2-9de0-7c71ddd9cb8e-kube-api-access-v49n2\") pod \"42817888-020e-41a2-9de0-7c71ddd9cb8e\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.873575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42817888-020e-41a2-9de0-7c71ddd9cb8e-crc-storage\") pod \"42817888-020e-41a2-9de0-7c71ddd9cb8e\" (UID: \"42817888-020e-41a2-9de0-7c71ddd9cb8e\") " Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.875135 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/42817888-020e-41a2-9de0-7c71ddd9cb8e-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.894503 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42817888-020e-41a2-9de0-7c71ddd9cb8e-kube-api-access-v49n2" (OuterVolumeSpecName: "kube-api-access-v49n2") pod "42817888-020e-41a2-9de0-7c71ddd9cb8e" (UID: "42817888-020e-41a2-9de0-7c71ddd9cb8e"). InnerVolumeSpecName "kube-api-access-v49n2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.918060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42817888-020e-41a2-9de0-7c71ddd9cb8e-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "42817888-020e-41a2-9de0-7c71ddd9cb8e" (UID: "42817888-020e-41a2-9de0-7c71ddd9cb8e"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.977005 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v49n2\" (UniqueName: \"kubernetes.io/projected/42817888-020e-41a2-9de0-7c71ddd9cb8e-kube-api-access-v49n2\") on node \"crc\" DevicePath \"\"" Nov 21 13:39:59 crc kubenswrapper[4769]: I1121 13:39:59.977045 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/42817888-020e-41a2-9de0-7c71ddd9cb8e-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:00 crc kubenswrapper[4769]: I1121 13:40:00.469479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hgs8l" event={"ID":"42817888-020e-41a2-9de0-7c71ddd9cb8e","Type":"ContainerDied","Data":"17670ac31013e237540bb2c4ac7df18800746436044b21fb86ee6dbf532961f6"} Nov 21 13:40:00 crc kubenswrapper[4769]: I1121 13:40:00.469825 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17670ac31013e237540bb2c4ac7df18800746436044b21fb86ee6dbf532961f6" Nov 21 13:40:00 crc kubenswrapper[4769]: I1121 13:40:00.469537 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hgs8l" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.504041 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt"] Nov 21 13:40:03 crc kubenswrapper[4769]: E1121 13:40:03.504683 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42817888-020e-41a2-9de0-7c71ddd9cb8e" containerName="storage" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.504697 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42817888-020e-41a2-9de0-7c71ddd9cb8e" containerName="storage" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.504862 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42817888-020e-41a2-9de0-7c71ddd9cb8e" containerName="storage" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.505634 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.508493 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-extramounts" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.520465 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt"] Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.528636 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.528698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-edpm-extramounts\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.528738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-config\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.528790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb42n\" (UniqueName: \"kubernetes.io/projected/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-kube-api-access-vb42n\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.630003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vb42n\" (UniqueName: \"kubernetes.io/projected/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-kube-api-access-vb42n\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.630136 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.630167 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-edpm-extramounts\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.630226 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-config\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.631060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.631079 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-config\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.631315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-edpm-extramounts\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.650240 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb42n\" (UniqueName: \"kubernetes.io/projected/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-kube-api-access-vb42n\") pod \"dnsmasq-dnsmasq-76cd9645f5-mw8dt\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:03 crc kubenswrapper[4769]: I1121 13:40:03.823751 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.281853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt"] Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.392167 4769 scope.go:117] "RemoveContainer" containerID="8b889212c71fe78b4caecd7aec4ac41aa8a39d09575c8b877707e0f383558d98" Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.438906 4769 scope.go:117] "RemoveContainer" containerID="11afbd33797d6fcc773ef14555122390708e5cd6d71c07a97b6f1be70fdf712e" Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.511849 4769 scope.go:117] "RemoveContainer" containerID="ab8efec406d76fe782906768e1d752bd8bea514465f03d9349a7cc5a404d5d2d" Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.515918 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" event={"ID":"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b","Type":"ContainerStarted","Data":"9e1e5dfdfb68b13f8f76b02bb3ad707bd341d2fe01e8e43330e067a3b5176a54"} Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.551029 4769 scope.go:117] "RemoveContainer" containerID="38ff58efcf125f224c90d8f44871674c2dc5e5ca142131e640f8902975babbf2" Nov 21 13:40:04 crc kubenswrapper[4769]: I1121 13:40:04.577835 4769 scope.go:117] "RemoveContainer" containerID="ce0000866949871db3013198d05a8dc20e39c0bfb35c8bb36cd63bd38e58fd4e" Nov 21 13:40:05 crc kubenswrapper[4769]: I1121 13:40:05.532258 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerID="c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491" exitCode=0 Nov 21 13:40:05 crc kubenswrapper[4769]: I1121 13:40:05.532333 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" event={"ID":"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b","Type":"ContainerDied","Data":"c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491"} Nov 21 13:40:06 crc kubenswrapper[4769]: I1121 13:40:06.548777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" event={"ID":"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b","Type":"ContainerStarted","Data":"a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb"} Nov 21 13:40:07 crc kubenswrapper[4769]: I1121 13:40:07.560870 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:07 crc kubenswrapper[4769]: I1121 13:40:07.594435 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" podStartSLOduration=4.594404675 podStartE2EDuration="4.594404675s" podCreationTimestamp="2025-11-21 13:40:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:40:07.588016135 +0000 UTC m=+6566.288678033" watchObservedRunningTime="2025-11-21 13:40:07.594404675 +0000 UTC m=+6566.295066523" Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.325849 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.327051 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.327125 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.327842 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.327907 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" gracePeriod=600 Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.607276 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" exitCode=0 Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.607340 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0"} Nov 21 13:40:11 crc kubenswrapper[4769]: I1121 13:40:11.607379 4769 scope.go:117] "RemoveContainer" containerID="3203ba8b908976be79eb54d6b4e43f9921c02402288782dcf7a45861fd5e1ffc" Nov 21 13:40:11 crc kubenswrapper[4769]: E1121 13:40:11.969990 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:40:12 crc kubenswrapper[4769]: I1121 13:40:12.624146 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:40:12 crc kubenswrapper[4769]: E1121 13:40:12.625923 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:40:13 crc kubenswrapper[4769]: I1121 13:40:13.825388 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:13 crc kubenswrapper[4769]: I1121 13:40:13.898254 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4"] Nov 21 13:40:13 crc kubenswrapper[4769]: I1121 13:40:13.898756 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerName="dnsmasq-dns" containerID="cri-o://7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe" gracePeriod=10 Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.300917 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.405972 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zdlx\" (UniqueName: \"kubernetes.io/projected/d21d9150-6ba0-42ae-b205-a5bab275fb3a-kube-api-access-7zdlx\") pod \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.406095 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-dnsmasq-svc\") pod \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.406248 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-config\") pod \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\" (UID: \"d21d9150-6ba0-42ae-b205-a5bab275fb3a\") " Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.419840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21d9150-6ba0-42ae-b205-a5bab275fb3a-kube-api-access-7zdlx" (OuterVolumeSpecName: "kube-api-access-7zdlx") pod "d21d9150-6ba0-42ae-b205-a5bab275fb3a" (UID: "d21d9150-6ba0-42ae-b205-a5bab275fb3a"). InnerVolumeSpecName "kube-api-access-7zdlx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.455936 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-config" (OuterVolumeSpecName: "config") pod "d21d9150-6ba0-42ae-b205-a5bab275fb3a" (UID: "d21d9150-6ba0-42ae-b205-a5bab275fb3a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.462507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "d21d9150-6ba0-42ae-b205-a5bab275fb3a" (UID: "d21d9150-6ba0-42ae-b205-a5bab275fb3a"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.508663 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7zdlx\" (UniqueName: \"kubernetes.io/projected/d21d9150-6ba0-42ae-b205-a5bab275fb3a-kube-api-access-7zdlx\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.508726 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.508748 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d21d9150-6ba0-42ae-b205-a5bab275fb3a-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.647906 4769 generic.go:334] "Generic (PLEG): container finished" podID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerID="7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe" exitCode=0 Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.647973 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.648002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" event={"ID":"d21d9150-6ba0-42ae-b205-a5bab275fb3a","Type":"ContainerDied","Data":"7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe"} Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.648103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4" event={"ID":"d21d9150-6ba0-42ae-b205-a5bab275fb3a","Type":"ContainerDied","Data":"9f6a6b6243e17f9fa527eb9c10fde8155c47bb61d2ecb3a25b1555bfc32dbd37"} Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.648136 4769 scope.go:117] "RemoveContainer" containerID="7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.722240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4"] Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.723014 4769 scope.go:117] "RemoveContainer" containerID="7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.728212 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-9hbl4"] Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.745491 4769 scope.go:117] "RemoveContainer" containerID="7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe" Nov 21 13:40:14 crc kubenswrapper[4769]: E1121 13:40:14.746000 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe\": container with ID starting with 7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe not found: ID does not exist" containerID="7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.746074 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe"} err="failed to get container status \"7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe\": rpc error: code = NotFound desc = could not find container \"7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe\": container with ID starting with 7b5d16868fa04abd10644662a6a3686e951a9e17277eeb61fc5e61d9add72ebe not found: ID does not exist" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.746140 4769 scope.go:117] "RemoveContainer" containerID="7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8" Nov 21 13:40:14 crc kubenswrapper[4769]: E1121 13:40:14.746483 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8\": container with ID starting with 7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8 not found: ID does not exist" containerID="7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8" Nov 21 13:40:14 crc kubenswrapper[4769]: I1121 13:40:14.746521 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8"} err="failed to get container status \"7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8\": rpc error: code = NotFound desc = could not find container \"7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8\": container with ID starting with 7102fad428c6cb381ea6ce9046b828e9506adfed0dd6eb1b40a903c50b0413e8 not found: ID does not exist" Nov 21 13:40:15 crc kubenswrapper[4769]: I1121 13:40:15.287671 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" path="/var/lib/kubelet/pods/d21d9150-6ba0-42ae-b205-a5bab275fb3a/volumes" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.541317 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c"] Nov 21 13:40:18 crc kubenswrapper[4769]: E1121 13:40:18.541982 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerName="dnsmasq-dns" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.541997 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerName="dnsmasq-dns" Nov 21 13:40:18 crc kubenswrapper[4769]: E1121 13:40:18.542027 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerName="init" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.542035 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerName="init" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.542264 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d21d9150-6ba0-42ae-b205-a5bab275fb3a" containerName="dnsmasq-dns" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.543156 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.556302 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c"] Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.690344 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z755m\" (UniqueName: \"kubernetes.io/projected/5ee86ff3-9632-4d35-815f-335b918b912e-kube-api-access-z755m\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.690448 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.690666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.792235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.792380 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.792507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z755m\" (UniqueName: \"kubernetes.io/projected/5ee86ff3-9632-4d35-815f-335b918b912e-kube-api-access-z755m\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.793083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.793083 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.814914 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z755m\" (UniqueName: \"kubernetes.io/projected/5ee86ff3-9632-4d35-815f-335b918b912e-kube-api-access-z755m\") pod \"dnsmasq-dnsmasq-84b9f45d47-cmb2c\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:18 crc kubenswrapper[4769]: I1121 13:40:18.862892 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:19 crc kubenswrapper[4769]: W1121 13:40:19.323131 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ee86ff3_9632_4d35_815f_335b918b912e.slice/crio-15527af5051341aee50f47fc2c40029a94e945b2b464eeeea1d23ccdb2ade139 WatchSource:0}: Error finding container 15527af5051341aee50f47fc2c40029a94e945b2b464eeeea1d23ccdb2ade139: Status 404 returned error can't find the container with id 15527af5051341aee50f47fc2c40029a94e945b2b464eeeea1d23ccdb2ade139 Nov 21 13:40:19 crc kubenswrapper[4769]: I1121 13:40:19.318288 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c"] Nov 21 13:40:19 crc kubenswrapper[4769]: I1121 13:40:19.720331 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ee86ff3-9632-4d35-815f-335b918b912e" containerID="30e77f236b1c5a4938dfbac9fe2d6bc70c9e6fab35c358735865473859c160a7" exitCode=0 Nov 21 13:40:19 crc kubenswrapper[4769]: I1121 13:40:19.722642 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" event={"ID":"5ee86ff3-9632-4d35-815f-335b918b912e","Type":"ContainerDied","Data":"30e77f236b1c5a4938dfbac9fe2d6bc70c9e6fab35c358735865473859c160a7"} Nov 21 13:40:19 crc kubenswrapper[4769]: I1121 13:40:19.722724 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" event={"ID":"5ee86ff3-9632-4d35-815f-335b918b912e","Type":"ContainerStarted","Data":"15527af5051341aee50f47fc2c40029a94e945b2b464eeeea1d23ccdb2ade139"} Nov 21 13:40:20 crc kubenswrapper[4769]: I1121 13:40:20.738085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" event={"ID":"5ee86ff3-9632-4d35-815f-335b918b912e","Type":"ContainerStarted","Data":"81306d77eba144687e656e46df800f5b9f57cecf7fa22e1a7cbe55a4f159c8be"} Nov 21 13:40:20 crc kubenswrapper[4769]: I1121 13:40:20.738616 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:20 crc kubenswrapper[4769]: I1121 13:40:20.768320 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" podStartSLOduration=2.768285569 podStartE2EDuration="2.768285569s" podCreationTimestamp="2025-11-21 13:40:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:40:20.762503876 +0000 UTC m=+6579.463165714" watchObservedRunningTime="2025-11-21 13:40:20.768285569 +0000 UTC m=+6579.468947417" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.274234 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:40:27 crc kubenswrapper[4769]: E1121 13:40:27.275296 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.292655 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-hgs8l"] Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.300957 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-hgs8l"] Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.419702 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-7pqgv"] Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.420731 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.423598 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.425051 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.426301 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.429231 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.434253 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-7pqgv"] Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.441547 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/93626539-de61-44e1-b677-8a3002c034b6-node-mnt\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.441763 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8hh\" (UniqueName: \"kubernetes.io/projected/93626539-de61-44e1-b677-8a3002c034b6-kube-api-access-lh8hh\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.441906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/93626539-de61-44e1-b677-8a3002c034b6-crc-storage\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.543124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/93626539-de61-44e1-b677-8a3002c034b6-node-mnt\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.543240 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8hh\" (UniqueName: \"kubernetes.io/projected/93626539-de61-44e1-b677-8a3002c034b6-kube-api-access-lh8hh\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.543271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/93626539-de61-44e1-b677-8a3002c034b6-crc-storage\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.543583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/93626539-de61-44e1-b677-8a3002c034b6-node-mnt\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.544298 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/93626539-de61-44e1-b677-8a3002c034b6-crc-storage\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.570134 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8hh\" (UniqueName: \"kubernetes.io/projected/93626539-de61-44e1-b677-8a3002c034b6-kube-api-access-lh8hh\") pod \"crc-storage-crc-7pqgv\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:27 crc kubenswrapper[4769]: I1121 13:40:27.747392 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:28 crc kubenswrapper[4769]: I1121 13:40:28.251793 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-7pqgv"] Nov 21 13:40:28 crc kubenswrapper[4769]: W1121 13:40:28.272123 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93626539_de61_44e1_b677_8a3002c034b6.slice/crio-e4bb3bf2cec167b3fb4aeb73d8e78142fe0110837cf7fb383523b66d590ae129 WatchSource:0}: Error finding container e4bb3bf2cec167b3fb4aeb73d8e78142fe0110837cf7fb383523b66d590ae129: Status 404 returned error can't find the container with id e4bb3bf2cec167b3fb4aeb73d8e78142fe0110837cf7fb383523b66d590ae129 Nov 21 13:40:28 crc kubenswrapper[4769]: I1121 13:40:28.839475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7pqgv" event={"ID":"93626539-de61-44e1-b677-8a3002c034b6","Type":"ContainerStarted","Data":"e4bb3bf2cec167b3fb4aeb73d8e78142fe0110837cf7fb383523b66d590ae129"} Nov 21 13:40:28 crc kubenswrapper[4769]: I1121 13:40:28.865053 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:28 crc kubenswrapper[4769]: I1121 13:40:28.931363 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt"] Nov 21 13:40:28 crc kubenswrapper[4769]: I1121 13:40:28.931657 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerName="dnsmasq-dns" containerID="cri-o://a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb" gracePeriod=10 Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.285413 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42817888-020e-41a2-9de0-7c71ddd9cb8e" path="/var/lib/kubelet/pods/42817888-020e-41a2-9de0-7c71ddd9cb8e/volumes" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.286212 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.379343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-edpm-extramounts\") pod \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.379437 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-dnsmasq-svc\") pod \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.379462 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-config\") pod \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.379507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb42n\" (UniqueName: \"kubernetes.io/projected/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-kube-api-access-vb42n\") pod \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\" (UID: \"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b\") " Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.384613 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-kube-api-access-vb42n" (OuterVolumeSpecName: "kube-api-access-vb42n") pod "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" (UID: "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b"). InnerVolumeSpecName "kube-api-access-vb42n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.418579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" (UID: "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.423338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-config" (OuterVolumeSpecName: "config") pod "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" (UID: "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.424731 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-edpm-extramounts" (OuterVolumeSpecName: "edpm-extramounts") pod "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" (UID: "6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b"). InnerVolumeSpecName "edpm-extramounts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.480822 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-extramounts\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-edpm-extramounts\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.480864 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.480876 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.480888 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vb42n\" (UniqueName: \"kubernetes.io/projected/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b-kube-api-access-vb42n\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.852353 4769 generic.go:334] "Generic (PLEG): container finished" podID="93626539-de61-44e1-b677-8a3002c034b6" containerID="a6f75551f03a2f3dc133679e52d60943aa90aacaceed5f9d0bf97e932fc398b7" exitCode=0 Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.852446 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7pqgv" event={"ID":"93626539-de61-44e1-b677-8a3002c034b6","Type":"ContainerDied","Data":"a6f75551f03a2f3dc133679e52d60943aa90aacaceed5f9d0bf97e932fc398b7"} Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.856157 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerID="a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb" exitCode=0 Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.856210 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" event={"ID":"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b","Type":"ContainerDied","Data":"a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb"} Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.856305 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" event={"ID":"6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b","Type":"ContainerDied","Data":"9e1e5dfdfb68b13f8f76b02bb3ad707bd341d2fe01e8e43330e067a3b5176a54"} Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.856340 4769 scope.go:117] "RemoveContainer" containerID="a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.856399 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.898234 4769 scope.go:117] "RemoveContainer" containerID="c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.904001 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt"] Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.935015 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76cd9645f5-mw8dt"] Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.940775 4769 scope.go:117] "RemoveContainer" containerID="a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb" Nov 21 13:40:29 crc kubenswrapper[4769]: E1121 13:40:29.942103 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb\": container with ID starting with a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb not found: ID does not exist" containerID="a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.942161 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb"} err="failed to get container status \"a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb\": rpc error: code = NotFound desc = could not find container \"a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb\": container with ID starting with a8813d01c22ce9e8c02a0b3f1478221c265338f41838160be999ee62a301f9bb not found: ID does not exist" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.942261 4769 scope.go:117] "RemoveContainer" containerID="c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491" Nov 21 13:40:29 crc kubenswrapper[4769]: E1121 13:40:29.943038 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491\": container with ID starting with c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491 not found: ID does not exist" containerID="c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491" Nov 21 13:40:29 crc kubenswrapper[4769]: I1121 13:40:29.943086 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491"} err="failed to get container status \"c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491\": rpc error: code = NotFound desc = could not find container \"c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491\": container with ID starting with c89cfb109e140e1814aa4784b76ae046a47adca6bd8486959f0e18c70ed15491 not found: ID does not exist" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.224445 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.285086 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" path="/var/lib/kubelet/pods/6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b/volumes" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.309713 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh8hh\" (UniqueName: \"kubernetes.io/projected/93626539-de61-44e1-b677-8a3002c034b6-kube-api-access-lh8hh\") pod \"93626539-de61-44e1-b677-8a3002c034b6\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.309841 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/93626539-de61-44e1-b677-8a3002c034b6-node-mnt\") pod \"93626539-de61-44e1-b677-8a3002c034b6\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.309898 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/93626539-de61-44e1-b677-8a3002c034b6-crc-storage\") pod \"93626539-de61-44e1-b677-8a3002c034b6\" (UID: \"93626539-de61-44e1-b677-8a3002c034b6\") " Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.309999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/93626539-de61-44e1-b677-8a3002c034b6-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "93626539-de61-44e1-b677-8a3002c034b6" (UID: "93626539-de61-44e1-b677-8a3002c034b6"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.310319 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/93626539-de61-44e1-b677-8a3002c034b6-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.316495 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93626539-de61-44e1-b677-8a3002c034b6-kube-api-access-lh8hh" (OuterVolumeSpecName: "kube-api-access-lh8hh") pod "93626539-de61-44e1-b677-8a3002c034b6" (UID: "93626539-de61-44e1-b677-8a3002c034b6"). InnerVolumeSpecName "kube-api-access-lh8hh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.332014 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93626539-de61-44e1-b677-8a3002c034b6-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "93626539-de61-44e1-b677-8a3002c034b6" (UID: "93626539-de61-44e1-b677-8a3002c034b6"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.411565 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/93626539-de61-44e1-b677-8a3002c034b6-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.411603 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lh8hh\" (UniqueName: \"kubernetes.io/projected/93626539-de61-44e1-b677-8a3002c034b6-kube-api-access-lh8hh\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.883258 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-7pqgv" event={"ID":"93626539-de61-44e1-b677-8a3002c034b6","Type":"ContainerDied","Data":"e4bb3bf2cec167b3fb4aeb73d8e78142fe0110837cf7fb383523b66d590ae129"} Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.883330 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4bb3bf2cec167b3fb4aeb73d8e78142fe0110837cf7fb383523b66d590ae129" Nov 21 13:40:31 crc kubenswrapper[4769]: I1121 13:40:31.883558 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-7pqgv" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.157564 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-7pqgv"] Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.163694 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-7pqgv"] Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.294716 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93626539-de61-44e1-b677-8a3002c034b6" path="/var/lib/kubelet/pods/93626539-de61-44e1-b677-8a3002c034b6/volumes" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.331395 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-zdchl"] Nov 21 13:40:35 crc kubenswrapper[4769]: E1121 13:40:35.332053 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93626539-de61-44e1-b677-8a3002c034b6" containerName="storage" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.332099 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="93626539-de61-44e1-b677-8a3002c034b6" containerName="storage" Nov 21 13:40:35 crc kubenswrapper[4769]: E1121 13:40:35.332138 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerName="init" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.332158 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerName="init" Nov 21 13:40:35 crc kubenswrapper[4769]: E1121 13:40:35.332234 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerName="dnsmasq-dns" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.332249 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerName="dnsmasq-dns" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.332447 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="93626539-de61-44e1-b677-8a3002c034b6" containerName="storage" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.332478 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d8bb11d-cd2c-4c1f-bbf1-ffeade12941b" containerName="dnsmasq-dns" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.333137 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.335129 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.335330 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.335517 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.335602 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.344279 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-zdchl"] Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.378736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/20c8677d-a0ac-4739-8602-cf57080fcb52-node-mnt\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.378791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/20c8677d-a0ac-4739-8602-cf57080fcb52-crc-storage\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.378885 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbjp\" (UniqueName: \"kubernetes.io/projected/20c8677d-a0ac-4739-8602-cf57080fcb52-kube-api-access-jsbjp\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.481299 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbjp\" (UniqueName: \"kubernetes.io/projected/20c8677d-a0ac-4739-8602-cf57080fcb52-kube-api-access-jsbjp\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.481460 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/20c8677d-a0ac-4739-8602-cf57080fcb52-node-mnt\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.481501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/20c8677d-a0ac-4739-8602-cf57080fcb52-crc-storage\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.481869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/20c8677d-a0ac-4739-8602-cf57080fcb52-node-mnt\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.482631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/20c8677d-a0ac-4739-8602-cf57080fcb52-crc-storage\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.514302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbjp\" (UniqueName: \"kubernetes.io/projected/20c8677d-a0ac-4739-8602-cf57080fcb52-kube-api-access-jsbjp\") pod \"crc-storage-crc-zdchl\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:35 crc kubenswrapper[4769]: I1121 13:40:35.660522 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:36 crc kubenswrapper[4769]: I1121 13:40:36.106158 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-zdchl"] Nov 21 13:40:36 crc kubenswrapper[4769]: W1121 13:40:36.108553 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20c8677d_a0ac_4739_8602_cf57080fcb52.slice/crio-edac20b1584a82918b3008bd54226e1e65344ab5966967e70f2d139d5828bd03 WatchSource:0}: Error finding container edac20b1584a82918b3008bd54226e1e65344ab5966967e70f2d139d5828bd03: Status 404 returned error can't find the container with id edac20b1584a82918b3008bd54226e1e65344ab5966967e70f2d139d5828bd03 Nov 21 13:40:36 crc kubenswrapper[4769]: I1121 13:40:36.937110 4769 generic.go:334] "Generic (PLEG): container finished" podID="20c8677d-a0ac-4739-8602-cf57080fcb52" containerID="a9e7081a46f9def16167fe9602facf26e208570c8f054429e4582862dbc7ed04" exitCode=0 Nov 21 13:40:36 crc kubenswrapper[4769]: I1121 13:40:36.937162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zdchl" event={"ID":"20c8677d-a0ac-4739-8602-cf57080fcb52","Type":"ContainerDied","Data":"a9e7081a46f9def16167fe9602facf26e208570c8f054429e4582862dbc7ed04"} Nov 21 13:40:36 crc kubenswrapper[4769]: I1121 13:40:36.937235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zdchl" event={"ID":"20c8677d-a0ac-4739-8602-cf57080fcb52","Type":"ContainerStarted","Data":"edac20b1584a82918b3008bd54226e1e65344ab5966967e70f2d139d5828bd03"} Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.257222 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.330646 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsbjp\" (UniqueName: \"kubernetes.io/projected/20c8677d-a0ac-4739-8602-cf57080fcb52-kube-api-access-jsbjp\") pod \"20c8677d-a0ac-4739-8602-cf57080fcb52\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.330753 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/20c8677d-a0ac-4739-8602-cf57080fcb52-crc-storage\") pod \"20c8677d-a0ac-4739-8602-cf57080fcb52\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.330796 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/20c8677d-a0ac-4739-8602-cf57080fcb52-node-mnt\") pod \"20c8677d-a0ac-4739-8602-cf57080fcb52\" (UID: \"20c8677d-a0ac-4739-8602-cf57080fcb52\") " Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.331015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/20c8677d-a0ac-4739-8602-cf57080fcb52-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "20c8677d-a0ac-4739-8602-cf57080fcb52" (UID: "20c8677d-a0ac-4739-8602-cf57080fcb52"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.331505 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/20c8677d-a0ac-4739-8602-cf57080fcb52-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.337815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c8677d-a0ac-4739-8602-cf57080fcb52-kube-api-access-jsbjp" (OuterVolumeSpecName: "kube-api-access-jsbjp") pod "20c8677d-a0ac-4739-8602-cf57080fcb52" (UID: "20c8677d-a0ac-4739-8602-cf57080fcb52"). InnerVolumeSpecName "kube-api-access-jsbjp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.359376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20c8677d-a0ac-4739-8602-cf57080fcb52-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "20c8677d-a0ac-4739-8602-cf57080fcb52" (UID: "20c8677d-a0ac-4739-8602-cf57080fcb52"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.433032 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jsbjp\" (UniqueName: \"kubernetes.io/projected/20c8677d-a0ac-4739-8602-cf57080fcb52-kube-api-access-jsbjp\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.433091 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/20c8677d-a0ac-4739-8602-cf57080fcb52-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.977977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-zdchl" event={"ID":"20c8677d-a0ac-4739-8602-cf57080fcb52","Type":"ContainerDied","Data":"edac20b1584a82918b3008bd54226e1e65344ab5966967e70f2d139d5828bd03"} Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.978062 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-zdchl" Nov 21 13:40:38 crc kubenswrapper[4769]: I1121 13:40:38.978068 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edac20b1584a82918b3008bd54226e1e65344ab5966967e70f2d139d5828bd03" Nov 21 13:40:40 crc kubenswrapper[4769]: I1121 13:40:40.275022 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:40:40 crc kubenswrapper[4769]: E1121 13:40:40.275964 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.746777 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq"] Nov 21 13:40:41 crc kubenswrapper[4769]: E1121 13:40:41.747280 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="20c8677d-a0ac-4739-8602-cf57080fcb52" containerName="storage" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.747301 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c8677d-a0ac-4739-8602-cf57080fcb52" containerName="storage" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.747564 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="20c8677d-a0ac-4739-8602-cf57080fcb52" containerName="storage" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.749061 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.752463 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-edpm-multinode" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.761607 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq"] Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.915309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.915361 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95t6\" (UniqueName: \"kubernetes.io/projected/25c0ed54-ec9e-4be1-9239-db589480857b-kube-api-access-j95t6\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.915668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:41 crc kubenswrapper[4769]: I1121 13:40:41.915731 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-config\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.017147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.017283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j95t6\" (UniqueName: \"kubernetes.io/projected/25c0ed54-ec9e-4be1-9239-db589480857b-kube-api-access-j95t6\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.017317 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.017337 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-config\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.018070 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.018168 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-config\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.018969 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.042363 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95t6\" (UniqueName: \"kubernetes.io/projected/25c0ed54-ec9e-4be1-9239-db589480857b-kube-api-access-j95t6\") pod \"dnsmasq-dnsmasq-58854494b5-znzbq\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.127843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:42 crc kubenswrapper[4769]: I1121 13:40:42.418175 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq"] Nov 21 13:40:43 crc kubenswrapper[4769]: I1121 13:40:43.023150 4769 generic.go:334] "Generic (PLEG): container finished" podID="25c0ed54-ec9e-4be1-9239-db589480857b" containerID="8bb22f8c632862d2af1163838677ffa98784c10d63e9b130cd0fa9d2cbd7840c" exitCode=0 Nov 21 13:40:43 crc kubenswrapper[4769]: I1121 13:40:43.023271 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" event={"ID":"25c0ed54-ec9e-4be1-9239-db589480857b","Type":"ContainerDied","Data":"8bb22f8c632862d2af1163838677ffa98784c10d63e9b130cd0fa9d2cbd7840c"} Nov 21 13:40:43 crc kubenswrapper[4769]: I1121 13:40:43.023352 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" event={"ID":"25c0ed54-ec9e-4be1-9239-db589480857b","Type":"ContainerStarted","Data":"2d6176b925d227315efe2d9d0d64fd4d2d3e7a3d26b1af4d1465b4099cb083ba"} Nov 21 13:40:44 crc kubenswrapper[4769]: I1121 13:40:44.047393 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" event={"ID":"25c0ed54-ec9e-4be1-9239-db589480857b","Type":"ContainerStarted","Data":"0b2b67df3c82499d953e28f9f7ca502deb512c5f95764e9dca0c86d2f8d4dc51"} Nov 21 13:40:44 crc kubenswrapper[4769]: I1121 13:40:44.048389 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:44 crc kubenswrapper[4769]: I1121 13:40:44.114477 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" podStartSLOduration=3.114440338 podStartE2EDuration="3.114440338s" podCreationTimestamp="2025-11-21 13:40:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:40:44.10543452 +0000 UTC m=+6602.806096368" watchObservedRunningTime="2025-11-21 13:40:44.114440338 +0000 UTC m=+6602.815102186" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.130450 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.192165 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c"] Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.192639 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" containerName="dnsmasq-dns" containerID="cri-o://81306d77eba144687e656e46df800f5b9f57cecf7fa22e1a7cbe55a4f159c8be" gracePeriod=10 Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.327286 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk"] Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.329868 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.342107 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk"] Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.355921 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.356039 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkl9j\" (UniqueName: \"kubernetes.io/projected/2e5477b9-e655-4f80-983b-e82a6080b345-kube-api-access-dkl9j\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.356080 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-config\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.356209 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.457567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.458124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.458214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkl9j\" (UniqueName: \"kubernetes.io/projected/2e5477b9-e655-4f80-983b-e82a6080b345-kube-api-access-dkl9j\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.458272 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-config\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.458857 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.459075 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.459747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-config\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.481586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkl9j\" (UniqueName: \"kubernetes.io/projected/2e5477b9-e655-4f80-983b-e82a6080b345-kube-api-access-dkl9j\") pod \"dnsmasq-dnsmasq-59887957c5-4jxjk\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.672957 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:52 crc kubenswrapper[4769]: I1121 13:40:52.979833 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk"] Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.179710 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" event={"ID":"2e5477b9-e655-4f80-983b-e82a6080b345","Type":"ContainerStarted","Data":"68a412b5b5f81d1fe38791a88bd2f73861d4aee0b54cf393a354f073c35c3ddb"} Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.187326 4769 generic.go:334] "Generic (PLEG): container finished" podID="5ee86ff3-9632-4d35-815f-335b918b912e" containerID="81306d77eba144687e656e46df800f5b9f57cecf7fa22e1a7cbe55a4f159c8be" exitCode=0 Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.187419 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" event={"ID":"5ee86ff3-9632-4d35-815f-335b918b912e","Type":"ContainerDied","Data":"81306d77eba144687e656e46df800f5b9f57cecf7fa22e1a7cbe55a4f159c8be"} Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.664581 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.794117 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z755m\" (UniqueName: \"kubernetes.io/projected/5ee86ff3-9632-4d35-815f-335b918b912e-kube-api-access-z755m\") pod \"5ee86ff3-9632-4d35-815f-335b918b912e\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.794232 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-config\") pod \"5ee86ff3-9632-4d35-815f-335b918b912e\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.794265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-dnsmasq-svc\") pod \"5ee86ff3-9632-4d35-815f-335b918b912e\" (UID: \"5ee86ff3-9632-4d35-815f-335b918b912e\") " Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.799164 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee86ff3-9632-4d35-815f-335b918b912e-kube-api-access-z755m" (OuterVolumeSpecName: "kube-api-access-z755m") pod "5ee86ff3-9632-4d35-815f-335b918b912e" (UID: "5ee86ff3-9632-4d35-815f-335b918b912e"). InnerVolumeSpecName "kube-api-access-z755m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.834874 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-config" (OuterVolumeSpecName: "config") pod "5ee86ff3-9632-4d35-815f-335b918b912e" (UID: "5ee86ff3-9632-4d35-815f-335b918b912e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.851117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5ee86ff3-9632-4d35-815f-335b918b912e" (UID: "5ee86ff3-9632-4d35-815f-335b918b912e"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.896547 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z755m\" (UniqueName: \"kubernetes.io/projected/5ee86ff3-9632-4d35-815f-335b918b912e-kube-api-access-z755m\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.896616 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:53 crc kubenswrapper[4769]: I1121 13:40:53.896638 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5ee86ff3-9632-4d35-815f-335b918b912e-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.209742 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.209790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c" event={"ID":"5ee86ff3-9632-4d35-815f-335b918b912e","Type":"ContainerDied","Data":"15527af5051341aee50f47fc2c40029a94e945b2b464eeeea1d23ccdb2ade139"} Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.210645 4769 scope.go:117] "RemoveContainer" containerID="81306d77eba144687e656e46df800f5b9f57cecf7fa22e1a7cbe55a4f159c8be" Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.213759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" event={"ID":"2e5477b9-e655-4f80-983b-e82a6080b345","Type":"ContainerDied","Data":"9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9"} Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.213515 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e5477b9-e655-4f80-983b-e82a6080b345" containerID="9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9" exitCode=0 Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.273513 4769 scope.go:117] "RemoveContainer" containerID="30e77f236b1c5a4938dfbac9fe2d6bc70c9e6fab35c358735865473859c160a7" Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.286499 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c"] Nov 21 13:40:54 crc kubenswrapper[4769]: I1121 13:40:54.301883 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-cmb2c"] Nov 21 13:40:55 crc kubenswrapper[4769]: I1121 13:40:55.234733 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" event={"ID":"2e5477b9-e655-4f80-983b-e82a6080b345","Type":"ContainerStarted","Data":"f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded"} Nov 21 13:40:55 crc kubenswrapper[4769]: I1121 13:40:55.236147 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:40:55 crc kubenswrapper[4769]: I1121 13:40:55.275901 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" podStartSLOduration=3.27586779 podStartE2EDuration="3.27586779s" podCreationTimestamp="2025-11-21 13:40:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:40:55.269242675 +0000 UTC m=+6613.969904533" watchObservedRunningTime="2025-11-21 13:40:55.27586779 +0000 UTC m=+6613.976529638" Nov 21 13:40:55 crc kubenswrapper[4769]: I1121 13:40:55.278181 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:40:55 crc kubenswrapper[4769]: E1121 13:40:55.278899 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:40:55 crc kubenswrapper[4769]: I1121 13:40:55.296020 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" path="/var/lib/kubelet/pods/5ee86ff3-9632-4d35-815f-335b918b912e/volumes" Nov 21 13:41:02 crc kubenswrapper[4769]: I1121 13:41:02.674532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:41:02 crc kubenswrapper[4769]: I1121 13:41:02.755946 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq"] Nov 21 13:41:02 crc kubenswrapper[4769]: I1121 13:41:02.758387 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" containerName="dnsmasq-dns" containerID="cri-o://0b2b67df3c82499d953e28f9f7ca502deb512c5f95764e9dca0c86d2f8d4dc51" gracePeriod=10 Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.349508 4769 generic.go:334] "Generic (PLEG): container finished" podID="25c0ed54-ec9e-4be1-9239-db589480857b" containerID="0b2b67df3c82499d953e28f9f7ca502deb512c5f95764e9dca0c86d2f8d4dc51" exitCode=0 Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.349566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" event={"ID":"25c0ed54-ec9e-4be1-9239-db589480857b","Type":"ContainerDied","Data":"0b2b67df3c82499d953e28f9f7ca502deb512c5f95764e9dca0c86d2f8d4dc51"} Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.397664 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248"] Nov 21 13:41:03 crc kubenswrapper[4769]: E1121 13:41:03.398460 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" containerName="dnsmasq-dns" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.398594 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" containerName="dnsmasq-dns" Nov 21 13:41:03 crc kubenswrapper[4769]: E1121 13:41:03.398705 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" containerName="init" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.398785 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" containerName="init" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.399088 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5ee86ff3-9632-4d35-815f-335b918b912e" containerName="dnsmasq-dns" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.400565 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.408047 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248"] Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.465484 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.466227 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-config\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.466258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.466311 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjzvr\" (UniqueName: \"kubernetes.io/projected/3ad8e978-e707-47ba-a19f-ad65970ecc00-kube-api-access-cjzvr\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.567706 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cjzvr\" (UniqueName: \"kubernetes.io/projected/3ad8e978-e707-47ba-a19f-ad65970ecc00-kube-api-access-cjzvr\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.568134 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.568404 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-config\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.568514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.569102 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.569320 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.570047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-config\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.590313 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjzvr\" (UniqueName: \"kubernetes.io/projected/3ad8e978-e707-47ba-a19f-ad65970ecc00-kube-api-access-cjzvr\") pod \"dnsmasq-dnsmasq-5d55f47b6c-zm248\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.703942 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.760368 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.770923 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-dnsmasq-svc\") pod \"25c0ed54-ec9e-4be1-9239-db589480857b\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.777779 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j95t6\" (UniqueName: \"kubernetes.io/projected/25c0ed54-ec9e-4be1-9239-db589480857b-kube-api-access-j95t6\") pod \"25c0ed54-ec9e-4be1-9239-db589480857b\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.777862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-config\") pod \"25c0ed54-ec9e-4be1-9239-db589480857b\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.777931 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-openstack-edpm-multinode\") pod \"25c0ed54-ec9e-4be1-9239-db589480857b\" (UID: \"25c0ed54-ec9e-4be1-9239-db589480857b\") " Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.782994 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25c0ed54-ec9e-4be1-9239-db589480857b-kube-api-access-j95t6" (OuterVolumeSpecName: "kube-api-access-j95t6") pod "25c0ed54-ec9e-4be1-9239-db589480857b" (UID: "25c0ed54-ec9e-4be1-9239-db589480857b"). InnerVolumeSpecName "kube-api-access-j95t6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.830350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-config" (OuterVolumeSpecName: "config") pod "25c0ed54-ec9e-4be1-9239-db589480857b" (UID: "25c0ed54-ec9e-4be1-9239-db589480857b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.830815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "25c0ed54-ec9e-4be1-9239-db589480857b" (UID: "25c0ed54-ec9e-4be1-9239-db589480857b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.837735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "25c0ed54-ec9e-4be1-9239-db589480857b" (UID: "25c0ed54-ec9e-4be1-9239-db589480857b"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.881658 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j95t6\" (UniqueName: \"kubernetes.io/projected/25c0ed54-ec9e-4be1-9239-db589480857b-kube-api-access-j95t6\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.881704 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.881725 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:03 crc kubenswrapper[4769]: I1121 13:41:03.881747 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/25c0ed54-ec9e-4be1-9239-db589480857b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.228369 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248"] Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.364391 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" event={"ID":"3ad8e978-e707-47ba-a19f-ad65970ecc00","Type":"ContainerStarted","Data":"49e66137b2a9197fea15ad9f92c2cb79454f2ce51c8c3e874b2637aefae505d2"} Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.368180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" event={"ID":"25c0ed54-ec9e-4be1-9239-db589480857b","Type":"ContainerDied","Data":"2d6176b925d227315efe2d9d0d64fd4d2d3e7a3d26b1af4d1465b4099cb083ba"} Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.368275 4769 scope.go:117] "RemoveContainer" containerID="0b2b67df3c82499d953e28f9f7ca502deb512c5f95764e9dca0c86d2f8d4dc51" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.368290 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.410270 4769 scope.go:117] "RemoveContainer" containerID="8bb22f8c632862d2af1163838677ffa98784c10d63e9b130cd0fa9d2cbd7840c" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.439315 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq"] Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.444729 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58854494b5-znzbq"] Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.785629 4769 scope.go:117] "RemoveContainer" containerID="80b03031f1307e6aa38e5307e8ba386fdb084f5b9a8f6b642dbe0979b47c8a3b" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.825952 4769 scope.go:117] "RemoveContainer" containerID="c66a0e99103e11864edfe9c67cdc915ecd473e4785cd8323c17033ce63764e8b" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.861956 4769 scope.go:117] "RemoveContainer" containerID="cf431704a11fe3b46df30895da35980007d277d674e8045ed6790c9b70205235" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.926064 4769 scope.go:117] "RemoveContainer" containerID="74f36a2dd3cc93a09f85b10c9c6eb8d43497df9458c099ec1f5ed7266d3ac61a" Nov 21 13:41:04 crc kubenswrapper[4769]: I1121 13:41:04.981891 4769 scope.go:117] "RemoveContainer" containerID="59a70e4e2acc88a961ce3845e3e0a87dff0bf5ada0007fafb62debe1c2cee436" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.036134 4769 scope.go:117] "RemoveContainer" containerID="0295487d3afcd68444864dcc1aaf067869f6b62028cac0e3b8387cc794f97c82" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.082315 4769 scope.go:117] "RemoveContainer" containerID="a8926732e15a3c090c6635c020263978d3e295bd95cbaaee471ccf5ae9df0605" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.113405 4769 scope.go:117] "RemoveContainer" containerID="cdd41564930861c6ee7d88ca5a32c4bf6f6b01e88c0f1da07f8c8213a5035095" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.140277 4769 scope.go:117] "RemoveContainer" containerID="db2085a5e7312569502469e1e7fed8685bc98c0a740ea3932c17fa053bcdfa97" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.181894 4769 scope.go:117] "RemoveContainer" containerID="86652136509a869d6b6f2e29135024c7a981e3b117f713e8029e2737eb36a9ea" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.292047 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" path="/var/lib/kubelet/pods/25c0ed54-ec9e-4be1-9239-db589480857b/volumes" Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.382514 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerID="9d1926f0a845eb9635fd4eb74e8e61670f18efa13904db33dc1a94d42c63899d" exitCode=0 Nov 21 13:41:05 crc kubenswrapper[4769]: I1121 13:41:05.382657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" event={"ID":"3ad8e978-e707-47ba-a19f-ad65970ecc00","Type":"ContainerDied","Data":"9d1926f0a845eb9635fd4eb74e8e61670f18efa13904db33dc1a94d42c63899d"} Nov 21 13:41:06 crc kubenswrapper[4769]: I1121 13:41:06.408176 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" event={"ID":"3ad8e978-e707-47ba-a19f-ad65970ecc00","Type":"ContainerStarted","Data":"40933ceab1c45970e8341f7fefaa218f609a404363ff5cd6c824a79ea1e7fd7d"} Nov 21 13:41:06 crc kubenswrapper[4769]: I1121 13:41:06.408416 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:06 crc kubenswrapper[4769]: I1121 13:41:06.436513 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" podStartSLOduration=3.436477731 podStartE2EDuration="3.436477731s" podCreationTimestamp="2025-11-21 13:41:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:41:06.431937451 +0000 UTC m=+6625.132599289" watchObservedRunningTime="2025-11-21 13:41:06.436477731 +0000 UTC m=+6625.137139549" Nov 21 13:41:08 crc kubenswrapper[4769]: I1121 13:41:08.273998 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:41:08 crc kubenswrapper[4769]: E1121 13:41:08.274550 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:41:13 crc kubenswrapper[4769]: I1121 13:41:13.762385 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:13 crc kubenswrapper[4769]: I1121 13:41:13.877734 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk"] Nov 21 13:41:13 crc kubenswrapper[4769]: I1121 13:41:13.878123 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" containerName="dnsmasq-dns" containerID="cri-o://f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded" gracePeriod=10 Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.045788 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5"] Nov 21 13:41:14 crc kubenswrapper[4769]: E1121 13:41:14.046266 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" containerName="dnsmasq-dns" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.046283 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" containerName="dnsmasq-dns" Nov 21 13:41:14 crc kubenswrapper[4769]: E1121 13:41:14.046309 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" containerName="init" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.046319 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" containerName="init" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.046503 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="25c0ed54-ec9e-4be1-9239-db589480857b" containerName="dnsmasq-dns" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.047704 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.054459 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5"] Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.175165 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spqvj\" (UniqueName: \"kubernetes.io/projected/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-kube-api-access-spqvj\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.175792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.175886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-config\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.175957 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.277266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-config\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.277350 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.277397 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-spqvj\" (UniqueName: \"kubernetes.io/projected/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-kube-api-access-spqvj\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.277437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.278345 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-openstack-edpm-multinode\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.278970 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-config\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.279951 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.296015 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.301794 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-spqvj\" (UniqueName: \"kubernetes.io/projected/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-kube-api-access-spqvj\") pod \"dnsmasq-dnsmasq-964c896d7-x6ws5\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.380857 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.482741 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkl9j\" (UniqueName: \"kubernetes.io/projected/2e5477b9-e655-4f80-983b-e82a6080b345-kube-api-access-dkl9j\") pod \"2e5477b9-e655-4f80-983b-e82a6080b345\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.483711 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-dnsmasq-svc\") pod \"2e5477b9-e655-4f80-983b-e82a6080b345\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.483840 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-openstack-edpm-multinode\") pod \"2e5477b9-e655-4f80-983b-e82a6080b345\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.483906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-config\") pod \"2e5477b9-e655-4f80-983b-e82a6080b345\" (UID: \"2e5477b9-e655-4f80-983b-e82a6080b345\") " Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.487106 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5477b9-e655-4f80-983b-e82a6080b345-kube-api-access-dkl9j" (OuterVolumeSpecName: "kube-api-access-dkl9j") pod "2e5477b9-e655-4f80-983b-e82a6080b345" (UID: "2e5477b9-e655-4f80-983b-e82a6080b345"). InnerVolumeSpecName "kube-api-access-dkl9j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.510492 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e5477b9-e655-4f80-983b-e82a6080b345" containerID="f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded" exitCode=0 Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.510582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" event={"ID":"2e5477b9-e655-4f80-983b-e82a6080b345","Type":"ContainerDied","Data":"f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded"} Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.510635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" event={"ID":"2e5477b9-e655-4f80-983b-e82a6080b345","Type":"ContainerDied","Data":"68a412b5b5f81d1fe38791a88bd2f73861d4aee0b54cf393a354f073c35c3ddb"} Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.510671 4769 scope.go:117] "RemoveContainer" containerID="f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.511078 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.527396 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "2e5477b9-e655-4f80-983b-e82a6080b345" (UID: "2e5477b9-e655-4f80-983b-e82a6080b345"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.529415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-config" (OuterVolumeSpecName: "config") pod "2e5477b9-e655-4f80-983b-e82a6080b345" (UID: "2e5477b9-e655-4f80-983b-e82a6080b345"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.543958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "2e5477b9-e655-4f80-983b-e82a6080b345" (UID: "2e5477b9-e655-4f80-983b-e82a6080b345"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.551294 4769 scope.go:117] "RemoveContainer" containerID="9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.585879 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.585920 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.585937 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e5477b9-e655-4f80-983b-e82a6080b345-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.585952 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dkl9j\" (UniqueName: \"kubernetes.io/projected/2e5477b9-e655-4f80-983b-e82a6080b345-kube-api-access-dkl9j\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.601876 4769 scope.go:117] "RemoveContainer" containerID="f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded" Nov 21 13:41:14 crc kubenswrapper[4769]: E1121 13:41:14.602715 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded\": container with ID starting with f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded not found: ID does not exist" containerID="f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.602753 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded"} err="failed to get container status \"f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded\": rpc error: code = NotFound desc = could not find container \"f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded\": container with ID starting with f6db7177086afad2566a2a5bce350f61dec0b58ea20de0b4982ebe9e98fc7ded not found: ID does not exist" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.602784 4769 scope.go:117] "RemoveContainer" containerID="9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9" Nov 21 13:41:14 crc kubenswrapper[4769]: E1121 13:41:14.605509 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9\": container with ID starting with 9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9 not found: ID does not exist" containerID="9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.605557 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9"} err="failed to get container status \"9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9\": rpc error: code = NotFound desc = could not find container \"9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9\": container with ID starting with 9c19904676c11756078a400c2ed9f26319fa9de38f70de9f25008223203866c9 not found: ID does not exist" Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.876143 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5"] Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.887155 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk"] Nov 21 13:41:14 crc kubenswrapper[4769]: I1121 13:41:14.896297 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-59887957c5-4jxjk"] Nov 21 13:41:15 crc kubenswrapper[4769]: I1121 13:41:15.294934 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" path="/var/lib/kubelet/pods/2e5477b9-e655-4f80-983b-e82a6080b345/volumes" Nov 21 13:41:15 crc kubenswrapper[4769]: I1121 13:41:15.530413 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerID="583e3eadc15880ec6f2bdc8d6dbb899d5c3c7ab2f256d2de25e376a88c4cdd6a" exitCode=0 Nov 21 13:41:15 crc kubenswrapper[4769]: I1121 13:41:15.530557 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" event={"ID":"b1e862ab-eefe-4e32-9f62-a520a5fa3af0","Type":"ContainerDied","Data":"583e3eadc15880ec6f2bdc8d6dbb899d5c3c7ab2f256d2de25e376a88c4cdd6a"} Nov 21 13:41:15 crc kubenswrapper[4769]: I1121 13:41:15.530663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" event={"ID":"b1e862ab-eefe-4e32-9f62-a520a5fa3af0","Type":"ContainerStarted","Data":"157bfc84ac8b72c07650f3a5ac52d75e21e483171fc86a15374ef95953ec7dd7"} Nov 21 13:41:16 crc kubenswrapper[4769]: I1121 13:41:16.555375 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" event={"ID":"b1e862ab-eefe-4e32-9f62-a520a5fa3af0","Type":"ContainerStarted","Data":"c7d2a7022eabe6e61f7ed28d8714dd3f1af65d585f1214667d58a7928f09f91c"} Nov 21 13:41:16 crc kubenswrapper[4769]: I1121 13:41:16.555749 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:16 crc kubenswrapper[4769]: I1121 13:41:16.588720 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" podStartSLOduration=2.588681883 podStartE2EDuration="2.588681883s" podCreationTimestamp="2025-11-21 13:41:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:41:16.584081241 +0000 UTC m=+6635.284743089" watchObservedRunningTime="2025-11-21 13:41:16.588681883 +0000 UTC m=+6635.289343741" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.072217 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-k9grb"] Nov 21 13:41:21 crc kubenswrapper[4769]: E1121 13:41:21.072782 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" containerName="dnsmasq-dns" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.072801 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" containerName="dnsmasq-dns" Nov 21 13:41:21 crc kubenswrapper[4769]: E1121 13:41:21.072833 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" containerName="init" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.072842 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" containerName="init" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.073095 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e5477b9-e655-4f80-983b-e82a6080b345" containerName="dnsmasq-dns" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.079761 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.083531 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-k9grb"] Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.131871 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktskf\" (UniqueName: \"kubernetes.io/projected/82ed2214-e749-4f5e-8b78-5bda715f67f7-kube-api-access-ktskf\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.131937 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-catalog-content\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.132313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-utilities\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.234886 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ktskf\" (UniqueName: \"kubernetes.io/projected/82ed2214-e749-4f5e-8b78-5bda715f67f7-kube-api-access-ktskf\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.234975 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-catalog-content\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.235041 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-utilities\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.235747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-utilities\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.235773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-catalog-content\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.259477 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktskf\" (UniqueName: \"kubernetes.io/projected/82ed2214-e749-4f5e-8b78-5bda715f67f7-kube-api-access-ktskf\") pod \"redhat-operators-k9grb\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.275492 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:41:21 crc kubenswrapper[4769]: E1121 13:41:21.275976 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.438734 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:21 crc kubenswrapper[4769]: I1121 13:41:21.925475 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-k9grb"] Nov 21 13:41:21 crc kubenswrapper[4769]: W1121 13:41:21.935387 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ed2214_e749_4f5e_8b78_5bda715f67f7.slice/crio-ae8afc45a2bdc25ab1b524f0f4c94b3dc94008a3f386175bbf09e6f61a3d49dd WatchSource:0}: Error finding container ae8afc45a2bdc25ab1b524f0f4c94b3dc94008a3f386175bbf09e6f61a3d49dd: Status 404 returned error can't find the container with id ae8afc45a2bdc25ab1b524f0f4c94b3dc94008a3f386175bbf09e6f61a3d49dd Nov 21 13:41:22 crc kubenswrapper[4769]: I1121 13:41:22.638482 4769 generic.go:334] "Generic (PLEG): container finished" podID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerID="8f652e4aa0687339d52bddcfc249a42a617110299b14e8f8c6b920f97a2c950b" exitCode=0 Nov 21 13:41:22 crc kubenswrapper[4769]: I1121 13:41:22.638758 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerDied","Data":"8f652e4aa0687339d52bddcfc249a42a617110299b14e8f8c6b920f97a2c950b"} Nov 21 13:41:22 crc kubenswrapper[4769]: I1121 13:41:22.639013 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerStarted","Data":"ae8afc45a2bdc25ab1b524f0f4c94b3dc94008a3f386175bbf09e6f61a3d49dd"} Nov 21 13:41:24 crc kubenswrapper[4769]: I1121 13:41:24.383968 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:24 crc kubenswrapper[4769]: I1121 13:41:24.475434 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248"] Nov 21 13:41:24 crc kubenswrapper[4769]: I1121 13:41:24.475754 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerName="dnsmasq-dns" containerID="cri-o://40933ceab1c45970e8341f7fefaa218f609a404363ff5cd6c824a79ea1e7fd7d" gracePeriod=10 Nov 21 13:41:24 crc kubenswrapper[4769]: I1121 13:41:24.680988 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerStarted","Data":"4a64a64da35483ba0be589c95d93e79693c9132acea0a81c5ffe76e799ef8b8d"} Nov 21 13:41:24 crc kubenswrapper[4769]: I1121 13:41:24.685229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" event={"ID":"3ad8e978-e707-47ba-a19f-ad65970ecc00","Type":"ContainerDied","Data":"40933ceab1c45970e8341f7fefaa218f609a404363ff5cd6c824a79ea1e7fd7d"} Nov 21 13:41:24 crc kubenswrapper[4769]: I1121 13:41:24.685152 4769 generic.go:334] "Generic (PLEG): container finished" podID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerID="40933ceab1c45970e8341f7fefaa218f609a404363ff5cd6c824a79ea1e7fd7d" exitCode=0 Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.244704 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf"] Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.247364 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.260656 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf"] Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.349511 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.349628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.349701 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6p78\" (UniqueName: \"kubernetes.io/projected/d86f677f-03ec-4512-8794-78b9650c8e39-kube-api-access-x6p78\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.451148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.451307 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.451381 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x6p78\" (UniqueName: \"kubernetes.io/projected/d86f677f-03ec-4512-8794-78b9650c8e39-kube-api-access-x6p78\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.452411 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.454127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.454795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.478865 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6p78\" (UniqueName: \"kubernetes.io/projected/d86f677f-03ec-4512-8794-78b9650c8e39-kube-api-access-x6p78\") pod \"dnsmasq-dnsmasq-84b9f45d47-jfjlf\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.569760 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.657685 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-dnsmasq-svc\") pod \"3ad8e978-e707-47ba-a19f-ad65970ecc00\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.658465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-openstack-edpm-multinode\") pod \"3ad8e978-e707-47ba-a19f-ad65970ecc00\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.658525 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjzvr\" (UniqueName: \"kubernetes.io/projected/3ad8e978-e707-47ba-a19f-ad65970ecc00-kube-api-access-cjzvr\") pod \"3ad8e978-e707-47ba-a19f-ad65970ecc00\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.658558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-config\") pod \"3ad8e978-e707-47ba-a19f-ad65970ecc00\" (UID: \"3ad8e978-e707-47ba-a19f-ad65970ecc00\") " Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.671796 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad8e978-e707-47ba-a19f-ad65970ecc00-kube-api-access-cjzvr" (OuterVolumeSpecName: "kube-api-access-cjzvr") pod "3ad8e978-e707-47ba-a19f-ad65970ecc00" (UID: "3ad8e978-e707-47ba-a19f-ad65970ecc00"). InnerVolumeSpecName "kube-api-access-cjzvr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.717672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" event={"ID":"3ad8e978-e707-47ba-a19f-ad65970ecc00","Type":"ContainerDied","Data":"49e66137b2a9197fea15ad9f92c2cb79454f2ce51c8c3e874b2637aefae505d2"} Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.717760 4769 scope.go:117] "RemoveContainer" containerID="40933ceab1c45970e8341f7fefaa218f609a404363ff5cd6c824a79ea1e7fd7d" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.717699 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.731789 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "3ad8e978-e707-47ba-a19f-ad65970ecc00" (UID: "3ad8e978-e707-47ba-a19f-ad65970ecc00"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.733205 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-config" (OuterVolumeSpecName: "config") pod "3ad8e978-e707-47ba-a19f-ad65970ecc00" (UID: "3ad8e978-e707-47ba-a19f-ad65970ecc00"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.749532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "3ad8e978-e707-47ba-a19f-ad65970ecc00" (UID: "3ad8e978-e707-47ba-a19f-ad65970ecc00"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.760316 4769 scope.go:117] "RemoveContainer" containerID="9d1926f0a845eb9635fd4eb74e8e61670f18efa13904db33dc1a94d42c63899d" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.760503 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.760536 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.760561 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cjzvr\" (UniqueName: \"kubernetes.io/projected/3ad8e978-e707-47ba-a19f-ad65970ecc00-kube-api-access-cjzvr\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.760573 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ad8e978-e707-47ba-a19f-ad65970ecc00-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:25 crc kubenswrapper[4769]: I1121 13:41:25.890046 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf"] Nov 21 13:41:25 crc kubenswrapper[4769]: W1121 13:41:25.890931 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd86f677f_03ec_4512_8794_78b9650c8e39.slice/crio-2fa5258ddb8770d9384575b924976482c21369c2b604bf78d87949d84fc74dad WatchSource:0}: Error finding container 2fa5258ddb8770d9384575b924976482c21369c2b604bf78d87949d84fc74dad: Status 404 returned error can't find the container with id 2fa5258ddb8770d9384575b924976482c21369c2b604bf78d87949d84fc74dad Nov 21 13:41:26 crc kubenswrapper[4769]: I1121 13:41:26.064766 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248"] Nov 21 13:41:26 crc kubenswrapper[4769]: I1121 13:41:26.073967 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5d55f47b6c-zm248"] Nov 21 13:41:26 crc kubenswrapper[4769]: I1121 13:41:26.738225 4769 generic.go:334] "Generic (PLEG): container finished" podID="d86f677f-03ec-4512-8794-78b9650c8e39" containerID="9a172689f0d30fe77bbe64c0a8b5750cfea8913a4895e5704ea476447d96010d" exitCode=0 Nov 21 13:41:26 crc kubenswrapper[4769]: I1121 13:41:26.738321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" event={"ID":"d86f677f-03ec-4512-8794-78b9650c8e39","Type":"ContainerDied","Data":"9a172689f0d30fe77bbe64c0a8b5750cfea8913a4895e5704ea476447d96010d"} Nov 21 13:41:26 crc kubenswrapper[4769]: I1121 13:41:26.738378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" event={"ID":"d86f677f-03ec-4512-8794-78b9650c8e39","Type":"ContainerStarted","Data":"2fa5258ddb8770d9384575b924976482c21369c2b604bf78d87949d84fc74dad"} Nov 21 13:41:27 crc kubenswrapper[4769]: I1121 13:41:27.285034 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" path="/var/lib/kubelet/pods/3ad8e978-e707-47ba-a19f-ad65970ecc00/volumes" Nov 21 13:41:27 crc kubenswrapper[4769]: I1121 13:41:27.756244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" event={"ID":"d86f677f-03ec-4512-8794-78b9650c8e39","Type":"ContainerStarted","Data":"32d8f755aea1789002556a1cf246507a9845d5bcfff885f77fff77fe109899d2"} Nov 21 13:41:27 crc kubenswrapper[4769]: I1121 13:41:27.756509 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:27 crc kubenswrapper[4769]: I1121 13:41:27.796386 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" podStartSLOduration=2.7963524189999998 podStartE2EDuration="2.796352419s" podCreationTimestamp="2025-11-21 13:41:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:41:27.784781312 +0000 UTC m=+6646.485443140" watchObservedRunningTime="2025-11-21 13:41:27.796352419 +0000 UTC m=+6646.497014277" Nov 21 13:41:28 crc kubenswrapper[4769]: I1121 13:41:28.772854 4769 generic.go:334] "Generic (PLEG): container finished" podID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerID="4a64a64da35483ba0be589c95d93e79693c9132acea0a81c5ffe76e799ef8b8d" exitCode=0 Nov 21 13:41:28 crc kubenswrapper[4769]: I1121 13:41:28.773736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerDied","Data":"4a64a64da35483ba0be589c95d93e79693c9132acea0a81c5ffe76e799ef8b8d"} Nov 21 13:41:29 crc kubenswrapper[4769]: I1121 13:41:29.797387 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerStarted","Data":"8d9be6efc9e180f379e7c0777fa34b44432fbe1b07302d99de6623ddf0d1e2c8"} Nov 21 13:41:29 crc kubenswrapper[4769]: I1121 13:41:29.837544 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-k9grb" podStartSLOduration=2.293179799 podStartE2EDuration="8.837513942s" podCreationTimestamp="2025-11-21 13:41:21 +0000 UTC" firstStartedPulling="2025-11-21 13:41:22.642260932 +0000 UTC m=+6641.342922740" lastFinishedPulling="2025-11-21 13:41:29.186595065 +0000 UTC m=+6647.887256883" observedRunningTime="2025-11-21 13:41:29.82458551 +0000 UTC m=+6648.525247348" watchObservedRunningTime="2025-11-21 13:41:29.837513942 +0000 UTC m=+6648.538175800" Nov 21 13:41:31 crc kubenswrapper[4769]: I1121 13:41:31.440097 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:31 crc kubenswrapper[4769]: I1121 13:41:31.440495 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:32 crc kubenswrapper[4769]: I1121 13:41:32.531540 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-k9grb" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="registry-server" probeResult="failure" output=< Nov 21 13:41:32 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 13:41:32 crc kubenswrapper[4769]: > Nov 21 13:41:33 crc kubenswrapper[4769]: I1121 13:41:33.911752 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-zdchl"] Nov 21 13:41:33 crc kubenswrapper[4769]: I1121 13:41:33.916589 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-zdchl"] Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.057541 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-s5p9k"] Nov 21 13:41:34 crc kubenswrapper[4769]: E1121 13:41:34.057864 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerName="init" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.057882 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerName="init" Nov 21 13:41:34 crc kubenswrapper[4769]: E1121 13:41:34.057904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerName="dnsmasq-dns" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.057911 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerName="dnsmasq-dns" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.058116 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3ad8e978-e707-47ba-a19f-ad65970ecc00" containerName="dnsmasq-dns" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.058693 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.062759 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.062860 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.064548 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.066159 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.075117 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-s5p9k"] Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.213550 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z942c\" (UniqueName: \"kubernetes.io/projected/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-kube-api-access-z942c\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.213617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-crc-storage\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.213651 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-node-mnt\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.314745 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z942c\" (UniqueName: \"kubernetes.io/projected/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-kube-api-access-z942c\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.314887 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-crc-storage\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.314955 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-node-mnt\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.315413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-node-mnt\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.315595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-crc-storage\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.332467 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z942c\" (UniqueName: \"kubernetes.io/projected/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-kube-api-access-z942c\") pod \"crc-storage-crc-s5p9k\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.389335 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.621710 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-s5p9k"] Nov 21 13:41:34 crc kubenswrapper[4769]: I1121 13:41:34.849522 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s5p9k" event={"ID":"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02","Type":"ContainerStarted","Data":"1bcbe6e9f8f83b174f795784a0672d2ac2d7e25d43c0d3b8040266e552280c66"} Nov 21 13:41:35 crc kubenswrapper[4769]: I1121 13:41:35.275117 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:41:35 crc kubenswrapper[4769]: E1121 13:41:35.275614 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:41:35 crc kubenswrapper[4769]: I1121 13:41:35.283477 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20c8677d-a0ac-4739-8602-cf57080fcb52" path="/var/lib/kubelet/pods/20c8677d-a0ac-4739-8602-cf57080fcb52/volumes" Nov 21 13:41:35 crc kubenswrapper[4769]: I1121 13:41:35.572381 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:41:35 crc kubenswrapper[4769]: I1121 13:41:35.642207 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5"] Nov 21 13:41:35 crc kubenswrapper[4769]: I1121 13:41:35.642480 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerName="dnsmasq-dns" containerID="cri-o://c7d2a7022eabe6e61f7ed28d8714dd3f1af65d585f1214667d58a7928f09f91c" gracePeriod=10 Nov 21 13:41:36 crc kubenswrapper[4769]: I1121 13:41:36.885177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s5p9k" event={"ID":"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02","Type":"ContainerStarted","Data":"cf1ecfcf99abdc9673f90a91e5bc569fd27e23770860c284184ee52df49ff1ac"} Nov 21 13:41:36 crc kubenswrapper[4769]: I1121 13:41:36.890710 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerID="c7d2a7022eabe6e61f7ed28d8714dd3f1af65d585f1214667d58a7928f09f91c" exitCode=0 Nov 21 13:41:36 crc kubenswrapper[4769]: I1121 13:41:36.890752 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" event={"ID":"b1e862ab-eefe-4e32-9f62-a520a5fa3af0","Type":"ContainerDied","Data":"c7d2a7022eabe6e61f7ed28d8714dd3f1af65d585f1214667d58a7928f09f91c"} Nov 21 13:41:37 crc kubenswrapper[4769]: I1121 13:41:37.920298 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="crc-storage/crc-storage-crc-s5p9k" podStartSLOduration=3.091793326 podStartE2EDuration="3.920277769s" podCreationTimestamp="2025-11-21 13:41:34 +0000 UTC" firstStartedPulling="2025-11-21 13:41:34.63047958 +0000 UTC m=+6653.331141398" lastFinishedPulling="2025-11-21 13:41:35.458964023 +0000 UTC m=+6654.159625841" observedRunningTime="2025-11-21 13:41:37.917447184 +0000 UTC m=+6656.618109022" watchObservedRunningTime="2025-11-21 13:41:37.920277769 +0000 UTC m=+6656.620939587" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.179333 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.290699 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-config\") pod \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.290818 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-openstack-edpm-multinode\") pod \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.290854 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spqvj\" (UniqueName: \"kubernetes.io/projected/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-kube-api-access-spqvj\") pod \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.291028 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-dnsmasq-svc\") pod \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\" (UID: \"b1e862ab-eefe-4e32-9f62-a520a5fa3af0\") " Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.297830 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-kube-api-access-spqvj" (OuterVolumeSpecName: "kube-api-access-spqvj") pod "b1e862ab-eefe-4e32-9f62-a520a5fa3af0" (UID: "b1e862ab-eefe-4e32-9f62-a520a5fa3af0"). InnerVolumeSpecName "kube-api-access-spqvj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.334965 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-config" (OuterVolumeSpecName: "config") pod "b1e862ab-eefe-4e32-9f62-a520a5fa3af0" (UID: "b1e862ab-eefe-4e32-9f62-a520a5fa3af0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.343449 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-openstack-edpm-multinode" (OuterVolumeSpecName: "openstack-edpm-multinode") pod "b1e862ab-eefe-4e32-9f62-a520a5fa3af0" (UID: "b1e862ab-eefe-4e32-9f62-a520a5fa3af0"). InnerVolumeSpecName "openstack-edpm-multinode". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.347335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "b1e862ab-eefe-4e32-9f62-a520a5fa3af0" (UID: "b1e862ab-eefe-4e32-9f62-a520a5fa3af0"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.392095 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.392144 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.392168 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-edpm-multinode\" (UniqueName: \"kubernetes.io/configmap/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-openstack-edpm-multinode\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.392210 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-spqvj\" (UniqueName: \"kubernetes.io/projected/b1e862ab-eefe-4e32-9f62-a520a5fa3af0-kube-api-access-spqvj\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.909157 4769 generic.go:334] "Generic (PLEG): container finished" podID="4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" containerID="cf1ecfcf99abdc9673f90a91e5bc569fd27e23770860c284184ee52df49ff1ac" exitCode=0 Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.909235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s5p9k" event={"ID":"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02","Type":"ContainerDied","Data":"cf1ecfcf99abdc9673f90a91e5bc569fd27e23770860c284184ee52df49ff1ac"} Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.911789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" event={"ID":"b1e862ab-eefe-4e32-9f62-a520a5fa3af0","Type":"ContainerDied","Data":"157bfc84ac8b72c07650f3a5ac52d75e21e483171fc86a15374ef95953ec7dd7"} Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.911836 4769 scope.go:117] "RemoveContainer" containerID="c7d2a7022eabe6e61f7ed28d8714dd3f1af65d585f1214667d58a7928f09f91c" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.911896 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.940015 4769 scope.go:117] "RemoveContainer" containerID="583e3eadc15880ec6f2bdc8d6dbb899d5c3c7ab2f256d2de25e376a88c4cdd6a" Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.968387 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5"] Nov 21 13:41:38 crc kubenswrapper[4769]: I1121 13:41:38.979170 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-964c896d7-x6ws5"] Nov 21 13:41:39 crc kubenswrapper[4769]: I1121 13:41:39.290533 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" path="/var/lib/kubelet/pods/b1e862ab-eefe-4e32-9f62-a520a5fa3af0/volumes" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.261389 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.335350 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-crc-storage\") pod \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.335463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z942c\" (UniqueName: \"kubernetes.io/projected/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-kube-api-access-z942c\") pod \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.335491 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-node-mnt\") pod \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\" (UID: \"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02\") " Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.335678 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" (UID: "4f0b92aa-1c52-463f-a6f8-7d1770aa4d02"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.346414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-kube-api-access-z942c" (OuterVolumeSpecName: "kube-api-access-z942c") pod "4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" (UID: "4f0b92aa-1c52-463f-a6f8-7d1770aa4d02"). InnerVolumeSpecName "kube-api-access-z942c". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.376706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" (UID: "4f0b92aa-1c52-463f-a6f8-7d1770aa4d02"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.439700 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z942c\" (UniqueName: \"kubernetes.io/projected/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-kube-api-access-z942c\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.439739 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.439752 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.936420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-s5p9k" event={"ID":"4f0b92aa-1c52-463f-a6f8-7d1770aa4d02","Type":"ContainerDied","Data":"1bcbe6e9f8f83b174f795784a0672d2ac2d7e25d43c0d3b8040266e552280c66"} Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.936476 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-s5p9k" Nov 21 13:41:40 crc kubenswrapper[4769]: I1121 13:41:40.936487 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bcbe6e9f8f83b174f795784a0672d2ac2d7e25d43c0d3b8040266e552280c66" Nov 21 13:41:41 crc kubenswrapper[4769]: I1121 13:41:41.499964 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:41 crc kubenswrapper[4769]: I1121 13:41:41.559658 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:41 crc kubenswrapper[4769]: I1121 13:41:41.734962 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-k9grb"] Nov 21 13:41:42 crc kubenswrapper[4769]: I1121 13:41:42.954884 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-k9grb" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="registry-server" containerID="cri-o://8d9be6efc9e180f379e7c0777fa34b44432fbe1b07302d99de6623ddf0d1e2c8" gracePeriod=2 Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.629530 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-s5p9k"] Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.634069 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-s5p9k"] Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.785574 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-jcrv7"] Nov 21 13:41:43 crc kubenswrapper[4769]: E1121 13:41:43.785950 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerName="dnsmasq-dns" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.785973 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerName="dnsmasq-dns" Nov 21 13:41:43 crc kubenswrapper[4769]: E1121 13:41:43.785991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerName="init" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.786000 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerName="init" Nov 21 13:41:43 crc kubenswrapper[4769]: E1121 13:41:43.786036 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" containerName="storage" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.786047 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" containerName="storage" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.786258 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" containerName="storage" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.786291 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1e862ab-eefe-4e32-9f62-a520a5fa3af0" containerName="dnsmasq-dns" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.786938 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.791436 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.791691 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.791887 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.800781 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.804313 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1814b41c-0eac-425e-8ee7-f05cee957eb3-crc-storage\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.804426 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1814b41c-0eac-425e-8ee7-f05cee957eb3-node-mnt\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.804542 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9xd8\" (UniqueName: \"kubernetes.io/projected/1814b41c-0eac-425e-8ee7-f05cee957eb3-kube-api-access-z9xd8\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.819768 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-jcrv7"] Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.905790 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z9xd8\" (UniqueName: \"kubernetes.io/projected/1814b41c-0eac-425e-8ee7-f05cee957eb3-kube-api-access-z9xd8\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.905831 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1814b41c-0eac-425e-8ee7-f05cee957eb3-crc-storage\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.905880 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1814b41c-0eac-425e-8ee7-f05cee957eb3-node-mnt\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.906067 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1814b41c-0eac-425e-8ee7-f05cee957eb3-node-mnt\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.906670 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1814b41c-0eac-425e-8ee7-f05cee957eb3-crc-storage\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.931265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9xd8\" (UniqueName: \"kubernetes.io/projected/1814b41c-0eac-425e-8ee7-f05cee957eb3-kube-api-access-z9xd8\") pod \"crc-storage-crc-jcrv7\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.968881 4769 generic.go:334] "Generic (PLEG): container finished" podID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerID="8d9be6efc9e180f379e7c0777fa34b44432fbe1b07302d99de6623ddf0d1e2c8" exitCode=0 Nov 21 13:41:43 crc kubenswrapper[4769]: I1121 13:41:43.968931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerDied","Data":"8d9be6efc9e180f379e7c0777fa34b44432fbe1b07302d99de6623ddf0d1e2c8"} Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.111681 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.116824 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.209070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-utilities\") pod \"82ed2214-e749-4f5e-8b78-5bda715f67f7\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.209231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-catalog-content\") pod \"82ed2214-e749-4f5e-8b78-5bda715f67f7\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.209309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktskf\" (UniqueName: \"kubernetes.io/projected/82ed2214-e749-4f5e-8b78-5bda715f67f7-kube-api-access-ktskf\") pod \"82ed2214-e749-4f5e-8b78-5bda715f67f7\" (UID: \"82ed2214-e749-4f5e-8b78-5bda715f67f7\") " Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.209910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-utilities" (OuterVolumeSpecName: "utilities") pod "82ed2214-e749-4f5e-8b78-5bda715f67f7" (UID: "82ed2214-e749-4f5e-8b78-5bda715f67f7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.213981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ed2214-e749-4f5e-8b78-5bda715f67f7-kube-api-access-ktskf" (OuterVolumeSpecName: "kube-api-access-ktskf") pod "82ed2214-e749-4f5e-8b78-5bda715f67f7" (UID: "82ed2214-e749-4f5e-8b78-5bda715f67f7"). InnerVolumeSpecName "kube-api-access-ktskf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.311892 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.312167 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ktskf\" (UniqueName: \"kubernetes.io/projected/82ed2214-e749-4f5e-8b78-5bda715f67f7-kube-api-access-ktskf\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.314781 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "82ed2214-e749-4f5e-8b78-5bda715f67f7" (UID: "82ed2214-e749-4f5e-8b78-5bda715f67f7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.416270 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/82ed2214-e749-4f5e-8b78-5bda715f67f7-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:44 crc kubenswrapper[4769]: I1121 13:41:44.547179 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-jcrv7"] Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:44.998273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-k9grb" event={"ID":"82ed2214-e749-4f5e-8b78-5bda715f67f7","Type":"ContainerDied","Data":"ae8afc45a2bdc25ab1b524f0f4c94b3dc94008a3f386175bbf09e6f61a3d49dd"} Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:44.998353 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-k9grb" Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:44.998697 4769 scope.go:117] "RemoveContainer" containerID="8d9be6efc9e180f379e7c0777fa34b44432fbe1b07302d99de6623ddf0d1e2c8" Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.000542 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jcrv7" event={"ID":"1814b41c-0eac-425e-8ee7-f05cee957eb3","Type":"ContainerStarted","Data":"6be08ee2f1a2b057092573a12e54d8db79823e8a355097d2adfebebe1a90d482"} Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.042042 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-k9grb"] Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.044292 4769 scope.go:117] "RemoveContainer" containerID="4a64a64da35483ba0be589c95d93e79693c9132acea0a81c5ffe76e799ef8b8d" Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.054703 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-k9grb"] Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.076806 4769 scope.go:117] "RemoveContainer" containerID="8f652e4aa0687339d52bddcfc249a42a617110299b14e8f8c6b920f97a2c950b" Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.290333 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0b92aa-1c52-463f-a6f8-7d1770aa4d02" path="/var/lib/kubelet/pods/4f0b92aa-1c52-463f-a6f8-7d1770aa4d02/volumes" Nov 21 13:41:45 crc kubenswrapper[4769]: I1121 13:41:45.291673 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" path="/var/lib/kubelet/pods/82ed2214-e749-4f5e-8b78-5bda715f67f7/volumes" Nov 21 13:41:46 crc kubenswrapper[4769]: I1121 13:41:46.275028 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:41:46 crc kubenswrapper[4769]: E1121 13:41:46.275510 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:41:49 crc kubenswrapper[4769]: I1121 13:41:49.048830 4769 generic.go:334] "Generic (PLEG): container finished" podID="1814b41c-0eac-425e-8ee7-f05cee957eb3" containerID="e3ace4e7912a6b9aa0755c57e9357239fd76b1f83287cabdcd0878e6a79ea0f8" exitCode=0 Nov 21 13:41:49 crc kubenswrapper[4769]: I1121 13:41:49.048948 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jcrv7" event={"ID":"1814b41c-0eac-425e-8ee7-f05cee957eb3","Type":"ContainerDied","Data":"e3ace4e7912a6b9aa0755c57e9357239fd76b1f83287cabdcd0878e6a79ea0f8"} Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.469491 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.637011 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1814b41c-0eac-425e-8ee7-f05cee957eb3-node-mnt\") pod \"1814b41c-0eac-425e-8ee7-f05cee957eb3\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.637080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9xd8\" (UniqueName: \"kubernetes.io/projected/1814b41c-0eac-425e-8ee7-f05cee957eb3-kube-api-access-z9xd8\") pod \"1814b41c-0eac-425e-8ee7-f05cee957eb3\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.637216 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1814b41c-0eac-425e-8ee7-f05cee957eb3-crc-storage\") pod \"1814b41c-0eac-425e-8ee7-f05cee957eb3\" (UID: \"1814b41c-0eac-425e-8ee7-f05cee957eb3\") " Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.637357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1814b41c-0eac-425e-8ee7-f05cee957eb3-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "1814b41c-0eac-425e-8ee7-f05cee957eb3" (UID: "1814b41c-0eac-425e-8ee7-f05cee957eb3"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.637808 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/1814b41c-0eac-425e-8ee7-f05cee957eb3-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.646508 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1814b41c-0eac-425e-8ee7-f05cee957eb3-kube-api-access-z9xd8" (OuterVolumeSpecName: "kube-api-access-z9xd8") pod "1814b41c-0eac-425e-8ee7-f05cee957eb3" (UID: "1814b41c-0eac-425e-8ee7-f05cee957eb3"). InnerVolumeSpecName "kube-api-access-z9xd8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.658404 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1814b41c-0eac-425e-8ee7-f05cee957eb3-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "1814b41c-0eac-425e-8ee7-f05cee957eb3" (UID: "1814b41c-0eac-425e-8ee7-f05cee957eb3"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.744770 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z9xd8\" (UniqueName: \"kubernetes.io/projected/1814b41c-0eac-425e-8ee7-f05cee957eb3-kube-api-access-z9xd8\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:50 crc kubenswrapper[4769]: I1121 13:41:50.745236 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/1814b41c-0eac-425e-8ee7-f05cee957eb3-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:41:51 crc kubenswrapper[4769]: I1121 13:41:51.078996 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jcrv7" event={"ID":"1814b41c-0eac-425e-8ee7-f05cee957eb3","Type":"ContainerDied","Data":"6be08ee2f1a2b057092573a12e54d8db79823e8a355097d2adfebebe1a90d482"} Nov 21 13:41:51 crc kubenswrapper[4769]: I1121 13:41:51.079052 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6be08ee2f1a2b057092573a12e54d8db79823e8a355097d2adfebebe1a90d482" Nov 21 13:41:51 crc kubenswrapper[4769]: I1121 13:41:51.079796 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jcrv7" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.191165 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9"] Nov 21 13:41:54 crc kubenswrapper[4769]: E1121 13:41:54.191837 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="extract-content" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.191855 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="extract-content" Nov 21 13:41:54 crc kubenswrapper[4769]: E1121 13:41:54.191872 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="registry-server" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.191881 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="registry-server" Nov 21 13:41:54 crc kubenswrapper[4769]: E1121 13:41:54.191893 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="extract-utilities" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.191903 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="extract-utilities" Nov 21 13:41:54 crc kubenswrapper[4769]: E1121 13:41:54.191928 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1814b41c-0eac-425e-8ee7-f05cee957eb3" containerName="storage" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.191936 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1814b41c-0eac-425e-8ee7-f05cee957eb3" containerName="storage" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.192217 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1814b41c-0eac-425e-8ee7-f05cee957eb3" containerName="storage" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.192250 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="82ed2214-e749-4f5e-8b78-5bda715f67f7" containerName="registry-server" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.193209 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.202606 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.204558 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9"] Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.311092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.311167 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-config\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.311232 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.311302 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdbs\" (UniqueName: \"kubernetes.io/projected/ff7dd916-3971-4ae5-915d-18248347bdf6-kube-api-access-7hdbs\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.412590 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdbs\" (UniqueName: \"kubernetes.io/projected/ff7dd916-3971-4ae5-915d-18248347bdf6-kube-api-access-7hdbs\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.412836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.412905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-config\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.412957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.413950 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.414369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.414699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-config\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.449019 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdbs\" (UniqueName: \"kubernetes.io/projected/ff7dd916-3971-4ae5-915d-18248347bdf6-kube-api-access-7hdbs\") pod \"dnsmasq-dnsmasq-64864b6d57-9bcx9\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:54 crc kubenswrapper[4769]: I1121 13:41:54.516351 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:55 crc kubenswrapper[4769]: I1121 13:41:55.059057 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9"] Nov 21 13:41:55 crc kubenswrapper[4769]: I1121 13:41:55.133772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" event={"ID":"ff7dd916-3971-4ae5-915d-18248347bdf6","Type":"ContainerStarted","Data":"1fe226f2ec65fb6b11066d503569b6904e669de9a6f347d8d399f1c95ac87773"} Nov 21 13:41:56 crc kubenswrapper[4769]: I1121 13:41:56.152285 4769 generic.go:334] "Generic (PLEG): container finished" podID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerID="74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2" exitCode=0 Nov 21 13:41:56 crc kubenswrapper[4769]: I1121 13:41:56.152388 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" event={"ID":"ff7dd916-3971-4ae5-915d-18248347bdf6","Type":"ContainerDied","Data":"74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2"} Nov 21 13:41:57 crc kubenswrapper[4769]: I1121 13:41:57.174133 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" event={"ID":"ff7dd916-3971-4ae5-915d-18248347bdf6","Type":"ContainerStarted","Data":"6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904"} Nov 21 13:41:57 crc kubenswrapper[4769]: I1121 13:41:57.175070 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:41:57 crc kubenswrapper[4769]: I1121 13:41:57.209539 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" podStartSLOduration=3.209505262 podStartE2EDuration="3.209505262s" podCreationTimestamp="2025-11-21 13:41:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:41:57.202955229 +0000 UTC m=+6675.903617077" watchObservedRunningTime="2025-11-21 13:41:57.209505262 +0000 UTC m=+6675.910167120" Nov 21 13:41:59 crc kubenswrapper[4769]: I1121 13:41:59.276460 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:41:59 crc kubenswrapper[4769]: E1121 13:41:59.277319 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:42:04 crc kubenswrapper[4769]: I1121 13:42:04.519586 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:42:04 crc kubenswrapper[4769]: I1121 13:42:04.595089 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf"] Nov 21 13:42:04 crc kubenswrapper[4769]: I1121 13:42:04.595440 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="dnsmasq-dns" containerID="cri-o://32d8f755aea1789002556a1cf246507a9845d5bcfff885f77fff77fe109899d2" gracePeriod=10 Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.281441 4769 generic.go:334] "Generic (PLEG): container finished" podID="d86f677f-03ec-4512-8794-78b9650c8e39" containerID="32d8f755aea1789002556a1cf246507a9845d5bcfff885f77fff77fe109899d2" exitCode=0 Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.282581 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" event={"ID":"d86f677f-03ec-4512-8794-78b9650c8e39","Type":"ContainerDied","Data":"32d8f755aea1789002556a1cf246507a9845d5bcfff885f77fff77fe109899d2"} Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.564004 4769 scope.go:117] "RemoveContainer" containerID="8f4f7262d51011aa1b9e5352781403d34dee67426639c067039611353d9a4468" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.571843 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.144:5353: connect: connection refused" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.603011 4769 scope.go:117] "RemoveContainer" containerID="8fd8f308bd10fc0cb2b508d1dbe9250d9fc85c342591e534336a96d5e8e84b64" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.638469 4769 scope.go:117] "RemoveContainer" containerID="940bca3f00f99eec266cc5c16e62e4aa576be7f8dfc06b69b51cc0d18df620a4" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.673024 4769 scope.go:117] "RemoveContainer" containerID="c7d36916f705a9f453b007a7947d43ec0a1964e0a1ed20469af73e6de1f05509" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.716635 4769 scope.go:117] "RemoveContainer" containerID="a5e29c39081acaf37d35a4714e3ce7cc9745d54e162862f791bd0e86428fce15" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.781758 4769 scope.go:117] "RemoveContainer" containerID="d9b7c634f825a9173e5b672fa528b0ece84b27f7dd7cc2305e2dbcfdc42cb11c" Nov 21 13:42:05 crc kubenswrapper[4769]: I1121 13:42:05.956509 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.042604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-config\") pod \"d86f677f-03ec-4512-8794-78b9650c8e39\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.042818 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6p78\" (UniqueName: \"kubernetes.io/projected/d86f677f-03ec-4512-8794-78b9650c8e39-kube-api-access-x6p78\") pod \"d86f677f-03ec-4512-8794-78b9650c8e39\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.042949 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-dnsmasq-svc\") pod \"d86f677f-03ec-4512-8794-78b9650c8e39\" (UID: \"d86f677f-03ec-4512-8794-78b9650c8e39\") " Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.055301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d86f677f-03ec-4512-8794-78b9650c8e39-kube-api-access-x6p78" (OuterVolumeSpecName: "kube-api-access-x6p78") pod "d86f677f-03ec-4512-8794-78b9650c8e39" (UID: "d86f677f-03ec-4512-8794-78b9650c8e39"). InnerVolumeSpecName "kube-api-access-x6p78". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.087872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-config" (OuterVolumeSpecName: "config") pod "d86f677f-03ec-4512-8794-78b9650c8e39" (UID: "d86f677f-03ec-4512-8794-78b9650c8e39"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.099885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "d86f677f-03ec-4512-8794-78b9650c8e39" (UID: "d86f677f-03ec-4512-8794-78b9650c8e39"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.145116 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x6p78\" (UniqueName: \"kubernetes.io/projected/d86f677f-03ec-4512-8794-78b9650c8e39-kube-api-access-x6p78\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.145157 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.145169 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d86f677f-03ec-4512-8794-78b9650c8e39-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.294334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" event={"ID":"d86f677f-03ec-4512-8794-78b9650c8e39","Type":"ContainerDied","Data":"2fa5258ddb8770d9384575b924976482c21369c2b604bf78d87949d84fc74dad"} Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.294429 4769 scope.go:117] "RemoveContainer" containerID="32d8f755aea1789002556a1cf246507a9845d5bcfff885f77fff77fe109899d2" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.294635 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.329924 4769 scope.go:117] "RemoveContainer" containerID="9a172689f0d30fe77bbe64c0a8b5750cfea8913a4895e5704ea476447d96010d" Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.345074 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf"] Nov 21 13:42:06 crc kubenswrapper[4769]: I1121 13:42:06.358729 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-jfjlf"] Nov 21 13:42:07 crc kubenswrapper[4769]: I1121 13:42:07.285986 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" path="/var/lib/kubelet/pods/d86f677f-03ec-4512-8794-78b9650c8e39/volumes" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.095003 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t"] Nov 21 13:42:09 crc kubenswrapper[4769]: E1121 13:42:09.095822 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="init" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.095845 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="init" Nov 21 13:42:09 crc kubenswrapper[4769]: E1121 13:42:09.095885 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="dnsmasq-dns" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.095897 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="dnsmasq-dns" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.096176 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d86f677f-03ec-4512-8794-78b9650c8e39" containerName="dnsmasq-dns" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.097017 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.099139 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.099567 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"kuttl-service-cm-1" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.099140 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-82rwp" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.099142 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"kuttl-service-cm-2" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.100328 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"kuttl-service-cm-0" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.100415 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.100495 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.100638 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.117704 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t"] Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203141 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203309 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203348 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8mn2\" (UniqueName: \"kubernetes.io/projected/32d85016-d3f2-4c72-be87-8260a5a1e446-kube-api-access-d8mn2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-ssh-key\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203576 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-combined-ca-bundle\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203649 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203692 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-inventory\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.203787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-2-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305723 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-inventory\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305804 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-2-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305857 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305892 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305925 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d8mn2\" (UniqueName: \"kubernetes.io/projected/32d85016-d3f2-4c72-be87-8260a5a1e446-kube-api-access-d8mn2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.305993 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-ssh-key\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.306039 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-combined-ca-bundle\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.306072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.306095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.306130 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.307454 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-2-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.307577 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.307836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.308592 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.308704 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-0\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.310606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-1\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.311032 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.314583 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-ssh-key\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.315595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-combined-ca-bundle\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.318783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-inventory\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.325822 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8mn2\" (UniqueName: \"kubernetes.io/projected/32d85016-d3f2-4c72-be87-8260a5a1e446-kube-api-access-d8mn2\") pod \"kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.427286 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.669127 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t"] Nov 21 13:42:09 crc kubenswrapper[4769]: I1121 13:42:09.679338 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:42:10 crc kubenswrapper[4769]: I1121 13:42:10.362008 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" event={"ID":"32d85016-d3f2-4c72-be87-8260a5a1e446","Type":"ContainerStarted","Data":"9f851d93515b1c476e40537257b038ecb6e43f29a5338d349ea1e48135a60cef"} Nov 21 13:42:11 crc kubenswrapper[4769]: I1121 13:42:11.275534 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:42:11 crc kubenswrapper[4769]: E1121 13:42:11.275786 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:42:14 crc kubenswrapper[4769]: I1121 13:42:14.427975 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" event={"ID":"32d85016-d3f2-4c72-be87-8260a5a1e446","Type":"ContainerStarted","Data":"31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6"} Nov 21 13:42:14 crc kubenswrapper[4769]: I1121 13:42:14.461279 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" podStartSLOduration=1.6704837540000002 podStartE2EDuration="5.461255567s" podCreationTimestamp="2025-11-21 13:42:09 +0000 UTC" firstStartedPulling="2025-11-21 13:42:09.679075664 +0000 UTC m=+6688.379737482" lastFinishedPulling="2025-11-21 13:42:13.469847467 +0000 UTC m=+6692.170509295" observedRunningTime="2025-11-21 13:42:14.451393815 +0000 UTC m=+6693.152055653" watchObservedRunningTime="2025-11-21 13:42:14.461255567 +0000 UTC m=+6693.161917395" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.262496 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t"] Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.353160 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc"] Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.354696 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.383715 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc"] Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.436360 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.436432 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.436540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjzh\" (UniqueName: \"kubernetes.io/projected/5044ff03-8d1e-4703-98ba-2eb9909f3c59-kube-api-access-zfjzh\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.444518 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" podUID="32d85016-d3f2-4c72-be87-8260a5a1e446" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" containerID="cri-o://31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6" gracePeriod=30 Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.538265 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.538368 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.538427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjzh\" (UniqueName: \"kubernetes.io/projected/5044ff03-8d1e-4703-98ba-2eb9909f3c59-kube-api-access-zfjzh\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.540011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.540435 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.558273 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjzh\" (UniqueName: \"kubernetes.io/projected/5044ff03-8d1e-4703-98ba-2eb9909f3c59-kube-api-access-zfjzh\") pod \"dnsmasq-dnsmasq-84b9f45d47-7psdc\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:16 crc kubenswrapper[4769]: I1121 13:42:16.704542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:17 crc kubenswrapper[4769]: I1121 13:42:17.266448 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc"] Nov 21 13:42:17 crc kubenswrapper[4769]: I1121 13:42:17.458142 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" event={"ID":"5044ff03-8d1e-4703-98ba-2eb9909f3c59","Type":"ContainerStarted","Data":"7bbd11dc4e737c0675c5b2bd6d36be7e7642fbb73fde2c23192e592a0dd42536"} Nov 21 13:42:18 crc kubenswrapper[4769]: I1121 13:42:18.471796 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" event={"ID":"5044ff03-8d1e-4703-98ba-2eb9909f3c59","Type":"ContainerStarted","Data":"b2702b770126885714b9170f1312b78fe57696edc6e988a02e922b7f2e8604a9"} Nov 21 13:42:20 crc kubenswrapper[4769]: I1121 13:42:20.504637 4769 generic.go:334] "Generic (PLEG): container finished" podID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerID="b2702b770126885714b9170f1312b78fe57696edc6e988a02e922b7f2e8604a9" exitCode=0 Nov 21 13:42:20 crc kubenswrapper[4769]: I1121 13:42:20.504952 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" event={"ID":"5044ff03-8d1e-4703-98ba-2eb9909f3c59","Type":"ContainerDied","Data":"b2702b770126885714b9170f1312b78fe57696edc6e988a02e922b7f2e8604a9"} Nov 21 13:42:22 crc kubenswrapper[4769]: I1121 13:42:22.522143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" event={"ID":"5044ff03-8d1e-4703-98ba-2eb9909f3c59","Type":"ContainerStarted","Data":"02ce507a58f8b1d972d36154062c45657499254c216eb1eb9c5afc76d20965de"} Nov 21 13:42:23 crc kubenswrapper[4769]: I1121 13:42:23.531457 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:23 crc kubenswrapper[4769]: I1121 13:42:23.556042 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" podStartSLOduration=7.556016549 podStartE2EDuration="7.556016549s" podCreationTimestamp="2025-11-21 13:42:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:42:23.550486852 +0000 UTC m=+6702.251148720" watchObservedRunningTime="2025-11-21 13:42:23.556016549 +0000 UTC m=+6702.256678377" Nov 21 13:42:24 crc kubenswrapper[4769]: I1121 13:42:24.919730 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-jcrv7"] Nov 21 13:42:24 crc kubenswrapper[4769]: I1121 13:42:24.928344 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-jcrv7"] Nov 21 13:42:24 crc kubenswrapper[4769]: I1121 13:42:24.935552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.091925 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-jbtcz"] Nov 21 13:42:25 crc kubenswrapper[4769]: E1121 13:42:25.092421 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="32d85016-d3f2-4c72-be87-8260a5a1e446" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.092450 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d85016-d3f2-4c72-be87-8260a5a1e446" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.092666 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="32d85016-d3f2-4c72-be87-8260a5a1e446" containerName="kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.093657 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.093894 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-0\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.093976 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-combined-ca-bundle\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094026 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-inventory\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094069 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-2-0\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094117 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-2\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094155 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-2\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094182 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-1\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094307 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-0\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094382 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-ssh-key\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8mn2\" (UniqueName: \"kubernetes.io/projected/32d85016-d3f2-4c72-be87-8260a5a1e446-kube-api-access-d8mn2\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.094528 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-1\") pod \"32d85016-d3f2-4c72-be87-8260a5a1e446\" (UID: \"32d85016-d3f2-4c72-be87-8260a5a1e446\") " Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.097935 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.099960 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.100701 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.102420 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.102540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d85016-d3f2-4c72-be87-8260a5a1e446-kube-api-access-d8mn2" (OuterVolumeSpecName: "kube-api-access-d8mn2") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kube-api-access-d8mn2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.106997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-combined-ca-bundle" (OuterVolumeSpecName: "kuttl-service-combined-ca-bundle") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.111526 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-jbtcz"] Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.114976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-0" (OuterVolumeSpecName: "kuttl-service-cm-1-0") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-1-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.140334 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-1" (OuterVolumeSpecName: "kuttl-service-cm-0-1") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-0-1". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.140505 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-2" (OuterVolumeSpecName: "kuttl-service-cm-0-2") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-0-2". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.143886 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-0" (OuterVolumeSpecName: "kuttl-service-cm-0-0") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-0-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.144340 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-2" (OuterVolumeSpecName: "kuttl-service-cm-1-2") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-1-2". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.144553 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-1" (OuterVolumeSpecName: "kuttl-service-cm-1-1") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-1-1". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.145085 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-inventory" (OuterVolumeSpecName: "inventory") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.156611 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.157109 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-2-0" (OuterVolumeSpecName: "kuttl-service-cm-2-0") pod "32d85016-d3f2-4c72-be87-8260a5a1e446" (UID: "32d85016-d3f2-4c72-be87-8260a5a1e446"). InnerVolumeSpecName "kuttl-service-cm-2-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.195456 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fa66b8c7-571b-4b2b-bf60-17b8641c827c-node-mnt\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.195719 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn276\" (UniqueName: \"kubernetes.io/projected/fa66b8c7-571b-4b2b-bf60-17b8641c827c-kube-api-access-rn276\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.195887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fa66b8c7-571b-4b2b-bf60-17b8641c827c-crc-storage\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196326 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-1-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196553 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-1-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196602 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196634 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196657 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-2-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-2-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196681 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-1-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-1-2\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196701 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-0-2\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-2\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196722 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-0-1\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-1\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196742 4769 reconciler_common.go:293] "Volume detached for volume \"kuttl-service-cm-0-0\" (UniqueName: \"kubernetes.io/configmap/32d85016-d3f2-4c72-be87-8260a5a1e446-kuttl-service-cm-0-0\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196852 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/32d85016-d3f2-4c72-be87-8260a5a1e446-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.196875 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d8mn2\" (UniqueName: \"kubernetes.io/projected/32d85016-d3f2-4c72-be87-8260a5a1e446-kube-api-access-d8mn2\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.274107 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:42:25 crc kubenswrapper[4769]: E1121 13:42:25.274378 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.284628 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1814b41c-0eac-425e-8ee7-f05cee957eb3" path="/var/lib/kubelet/pods/1814b41c-0eac-425e-8ee7-f05cee957eb3/volumes" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.298436 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fa66b8c7-571b-4b2b-bf60-17b8641c827c-node-mnt\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.298607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rn276\" (UniqueName: \"kubernetes.io/projected/fa66b8c7-571b-4b2b-bf60-17b8641c827c-kube-api-access-rn276\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.298785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fa66b8c7-571b-4b2b-bf60-17b8641c827c-crc-storage\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.298795 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fa66b8c7-571b-4b2b-bf60-17b8641c827c-node-mnt\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.300485 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fa66b8c7-571b-4b2b-bf60-17b8641c827c-crc-storage\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.316063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn276\" (UniqueName: \"kubernetes.io/projected/fa66b8c7-571b-4b2b-bf60-17b8641c827c-kube-api-access-rn276\") pod \"crc-storage-crc-jbtcz\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.495763 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.557185 4769 generic.go:334] "Generic (PLEG): container finished" podID="32d85016-d3f2-4c72-be87-8260a5a1e446" containerID="31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6" exitCode=254 Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.557618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" event={"ID":"32d85016-d3f2-4c72-be87-8260a5a1e446","Type":"ContainerDied","Data":"31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6"} Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.557807 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" event={"ID":"32d85016-d3f2-4c72-be87-8260a5a1e446","Type":"ContainerDied","Data":"9f851d93515b1c476e40537257b038ecb6e43f29a5338d349ea1e48135a60cef"} Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.557967 4769 scope.go:117] "RemoveContainer" containerID="31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.558320 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.591587 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t"] Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.595459 4769 scope.go:117] "RemoveContainer" containerID="31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6" Nov 21 13:42:25 crc kubenswrapper[4769]: E1121 13:42:25.596067 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6\": container with ID starting with 31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6 not found: ID does not exist" containerID="31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.596110 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6"} err="failed to get container status \"31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6\": rpc error: code = NotFound desc = could not find container \"31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6\": container with ID starting with 31993efefa180a7cece3b2f4f5a09afebd10a6e7fffe5cbba11b539166c3e9b6 not found: ID does not exist" Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.600615 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kuttl-service-edpm-compute-no-nodes-edpm-compute-no-nodes-kkw2t"] Nov 21 13:42:25 crc kubenswrapper[4769]: I1121 13:42:25.954224 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-jbtcz"] Nov 21 13:42:25 crc kubenswrapper[4769]: W1121 13:42:25.964547 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa66b8c7_571b_4b2b_bf60_17b8641c827c.slice/crio-21fcfa5775a1a9be8112631766caadd839a0347c57d894bb13e1fe96f8ff6f86 WatchSource:0}: Error finding container 21fcfa5775a1a9be8112631766caadd839a0347c57d894bb13e1fe96f8ff6f86: Status 404 returned error can't find the container with id 21fcfa5775a1a9be8112631766caadd839a0347c57d894bb13e1fe96f8ff6f86 Nov 21 13:42:26 crc kubenswrapper[4769]: I1121 13:42:26.575902 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jbtcz" event={"ID":"fa66b8c7-571b-4b2b-bf60-17b8641c827c","Type":"ContainerStarted","Data":"21fcfa5775a1a9be8112631766caadd839a0347c57d894bb13e1fe96f8ff6f86"} Nov 21 13:42:27 crc kubenswrapper[4769]: I1121 13:42:27.290464 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d85016-d3f2-4c72-be87-8260a5a1e446" path="/var/lib/kubelet/pods/32d85016-d3f2-4c72-be87-8260a5a1e446/volumes" Nov 21 13:42:28 crc kubenswrapper[4769]: I1121 13:42:28.603470 4769 generic.go:334] "Generic (PLEG): container finished" podID="fa66b8c7-571b-4b2b-bf60-17b8641c827c" containerID="f1ff236f82e9d8478c37b9c48ad8e27de6d8c54c5ad9ca7eacb4ea1d70d1bcae" exitCode=0 Nov 21 13:42:28 crc kubenswrapper[4769]: I1121 13:42:28.603645 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jbtcz" event={"ID":"fa66b8c7-571b-4b2b-bf60-17b8641c827c","Type":"ContainerDied","Data":"f1ff236f82e9d8478c37b9c48ad8e27de6d8c54c5ad9ca7eacb4ea1d70d1bcae"} Nov 21 13:42:29 crc kubenswrapper[4769]: I1121 13:42:29.938505 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.086427 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn276\" (UniqueName: \"kubernetes.io/projected/fa66b8c7-571b-4b2b-bf60-17b8641c827c-kube-api-access-rn276\") pod \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.086488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fa66b8c7-571b-4b2b-bf60-17b8641c827c-crc-storage\") pod \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.086603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fa66b8c7-571b-4b2b-bf60-17b8641c827c-node-mnt\") pod \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\" (UID: \"fa66b8c7-571b-4b2b-bf60-17b8641c827c\") " Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.086946 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/fa66b8c7-571b-4b2b-bf60-17b8641c827c-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "fa66b8c7-571b-4b2b-bf60-17b8641c827c" (UID: "fa66b8c7-571b-4b2b-bf60-17b8641c827c"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.092597 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa66b8c7-571b-4b2b-bf60-17b8641c827c-kube-api-access-rn276" (OuterVolumeSpecName: "kube-api-access-rn276") pod "fa66b8c7-571b-4b2b-bf60-17b8641c827c" (UID: "fa66b8c7-571b-4b2b-bf60-17b8641c827c"). InnerVolumeSpecName "kube-api-access-rn276". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.110628 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa66b8c7-571b-4b2b-bf60-17b8641c827c-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "fa66b8c7-571b-4b2b-bf60-17b8641c827c" (UID: "fa66b8c7-571b-4b2b-bf60-17b8641c827c"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.188858 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rn276\" (UniqueName: \"kubernetes.io/projected/fa66b8c7-571b-4b2b-bf60-17b8641c827c-kube-api-access-rn276\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.188911 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/fa66b8c7-571b-4b2b-bf60-17b8641c827c-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.188935 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/fa66b8c7-571b-4b2b-bf60-17b8641c827c-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.627732 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-jbtcz" event={"ID":"fa66b8c7-571b-4b2b-bf60-17b8641c827c","Type":"ContainerDied","Data":"21fcfa5775a1a9be8112631766caadd839a0347c57d894bb13e1fe96f8ff6f86"} Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.627775 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21fcfa5775a1a9be8112631766caadd839a0347c57d894bb13e1fe96f8ff6f86" Nov 21 13:42:30 crc kubenswrapper[4769]: I1121 13:42:30.627833 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-jbtcz" Nov 21 13:42:31 crc kubenswrapper[4769]: I1121 13:42:31.707367 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:31 crc kubenswrapper[4769]: I1121 13:42:31.753362 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9"] Nov 21 13:42:31 crc kubenswrapper[4769]: I1121 13:42:31.753662 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerName="dnsmasq-dns" containerID="cri-o://6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904" gracePeriod=10 Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.176025 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.322207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-edpm-compute-no-nodes\") pod \"ff7dd916-3971-4ae5-915d-18248347bdf6\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.322265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hdbs\" (UniqueName: \"kubernetes.io/projected/ff7dd916-3971-4ae5-915d-18248347bdf6-kube-api-access-7hdbs\") pod \"ff7dd916-3971-4ae5-915d-18248347bdf6\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.322293 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-config\") pod \"ff7dd916-3971-4ae5-915d-18248347bdf6\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.322534 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-dnsmasq-svc\") pod \"ff7dd916-3971-4ae5-915d-18248347bdf6\" (UID: \"ff7dd916-3971-4ae5-915d-18248347bdf6\") " Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.338198 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7dd916-3971-4ae5-915d-18248347bdf6-kube-api-access-7hdbs" (OuterVolumeSpecName: "kube-api-access-7hdbs") pod "ff7dd916-3971-4ae5-915d-18248347bdf6" (UID: "ff7dd916-3971-4ae5-915d-18248347bdf6"). InnerVolumeSpecName "kube-api-access-7hdbs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.358843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "ff7dd916-3971-4ae5-915d-18248347bdf6" (UID: "ff7dd916-3971-4ae5-915d-18248347bdf6"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.366480 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-config" (OuterVolumeSpecName: "config") pod "ff7dd916-3971-4ae5-915d-18248347bdf6" (UID: "ff7dd916-3971-4ae5-915d-18248347bdf6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.370565 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "ff7dd916-3971-4ae5-915d-18248347bdf6" (UID: "ff7dd916-3971-4ae5-915d-18248347bdf6"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.424707 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.424767 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.424791 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7hdbs\" (UniqueName: \"kubernetes.io/projected/ff7dd916-3971-4ae5-915d-18248347bdf6-kube-api-access-7hdbs\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.424961 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff7dd916-3971-4ae5-915d-18248347bdf6-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.654756 4769 generic.go:334] "Generic (PLEG): container finished" podID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerID="6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904" exitCode=0 Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.654822 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" event={"ID":"ff7dd916-3971-4ae5-915d-18248347bdf6","Type":"ContainerDied","Data":"6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904"} Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.654873 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" event={"ID":"ff7dd916-3971-4ae5-915d-18248347bdf6","Type":"ContainerDied","Data":"1fe226f2ec65fb6b11066d503569b6904e669de9a6f347d8d399f1c95ac87773"} Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.654892 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.654903 4769 scope.go:117] "RemoveContainer" containerID="6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.678648 4769 scope.go:117] "RemoveContainer" containerID="74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.704697 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9"] Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.712769 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-9bcx9"] Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.732025 4769 scope.go:117] "RemoveContainer" containerID="6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904" Nov 21 13:42:32 crc kubenswrapper[4769]: E1121 13:42:32.732463 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904\": container with ID starting with 6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904 not found: ID does not exist" containerID="6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.732526 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904"} err="failed to get container status \"6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904\": rpc error: code = NotFound desc = could not find container \"6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904\": container with ID starting with 6619edfd7dc96afa751e4e886087fd2154a726ec871fce23ac8d0907c17e4904 not found: ID does not exist" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.732563 4769 scope.go:117] "RemoveContainer" containerID="74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2" Nov 21 13:42:32 crc kubenswrapper[4769]: E1121 13:42:32.733047 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2\": container with ID starting with 74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2 not found: ID does not exist" containerID="74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2" Nov 21 13:42:32 crc kubenswrapper[4769]: I1121 13:42:32.733078 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2"} err="failed to get container status \"74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2\": rpc error: code = NotFound desc = could not find container \"74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2\": container with ID starting with 74b24e359e7a7b58459b2f577aeb9f35f72f0bada42e3568b8984dcb2e8d79b2 not found: ID does not exist" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.287996 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" path="/var/lib/kubelet/pods/ff7dd916-3971-4ae5-915d-18248347bdf6/volumes" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.458265 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-jbtcz"] Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.466381 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-jbtcz"] Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.635834 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-sj68r"] Nov 21 13:42:33 crc kubenswrapper[4769]: E1121 13:42:33.636172 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerName="dnsmasq-dns" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.636190 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerName="dnsmasq-dns" Nov 21 13:42:33 crc kubenswrapper[4769]: E1121 13:42:33.636216 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerName="init" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.636224 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerName="init" Nov 21 13:42:33 crc kubenswrapper[4769]: E1121 13:42:33.636261 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fa66b8c7-571b-4b2b-bf60-17b8641c827c" containerName="storage" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.636271 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa66b8c7-571b-4b2b-bf60-17b8641c827c" containerName="storage" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.636451 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fa66b8c7-571b-4b2b-bf60-17b8641c827c" containerName="storage" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.636476 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ff7dd916-3971-4ae5-915d-18248347bdf6" containerName="dnsmasq-dns" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.637104 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.640457 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.640665 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.640824 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.641021 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.647481 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-sj68r"] Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.741541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c569b110-2497-43c9-ae17-86855c804915-crc-storage\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.741597 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qhkc\" (UniqueName: \"kubernetes.io/projected/c569b110-2497-43c9-ae17-86855c804915-kube-api-access-4qhkc\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.741626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c569b110-2497-43c9-ae17-86855c804915-node-mnt\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.843296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c569b110-2497-43c9-ae17-86855c804915-crc-storage\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.843373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4qhkc\" (UniqueName: \"kubernetes.io/projected/c569b110-2497-43c9-ae17-86855c804915-kube-api-access-4qhkc\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.843428 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c569b110-2497-43c9-ae17-86855c804915-node-mnt\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.843833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c569b110-2497-43c9-ae17-86855c804915-node-mnt\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.844866 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c569b110-2497-43c9-ae17-86855c804915-crc-storage\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.860997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qhkc\" (UniqueName: \"kubernetes.io/projected/c569b110-2497-43c9-ae17-86855c804915-kube-api-access-4qhkc\") pod \"crc-storage-crc-sj68r\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:33 crc kubenswrapper[4769]: I1121 13:42:33.954503 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:34 crc kubenswrapper[4769]: I1121 13:42:34.413495 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-sj68r"] Nov 21 13:42:34 crc kubenswrapper[4769]: I1121 13:42:34.690304 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-sj68r" event={"ID":"c569b110-2497-43c9-ae17-86855c804915","Type":"ContainerStarted","Data":"a7b608ce04e88761f5e2bd29067b07c9b11c706a9152c7ed583c2c44e4e22b4f"} Nov 21 13:42:35 crc kubenswrapper[4769]: I1121 13:42:35.287017 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa66b8c7-571b-4b2b-bf60-17b8641c827c" path="/var/lib/kubelet/pods/fa66b8c7-571b-4b2b-bf60-17b8641c827c/volumes" Nov 21 13:42:35 crc kubenswrapper[4769]: I1121 13:42:35.700766 4769 generic.go:334] "Generic (PLEG): container finished" podID="c569b110-2497-43c9-ae17-86855c804915" containerID="b47fee9ff00af9729d546649347a0b65420d04c5d14e4a0fc48a7268444caf77" exitCode=0 Nov 21 13:42:35 crc kubenswrapper[4769]: I1121 13:42:35.700843 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-sj68r" event={"ID":"c569b110-2497-43c9-ae17-86855c804915","Type":"ContainerDied","Data":"b47fee9ff00af9729d546649347a0b65420d04c5d14e4a0fc48a7268444caf77"} Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.015178 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.107319 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c569b110-2497-43c9-ae17-86855c804915-node-mnt\") pod \"c569b110-2497-43c9-ae17-86855c804915\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.107409 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c569b110-2497-43c9-ae17-86855c804915-crc-storage\") pod \"c569b110-2497-43c9-ae17-86855c804915\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.107465 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qhkc\" (UniqueName: \"kubernetes.io/projected/c569b110-2497-43c9-ae17-86855c804915-kube-api-access-4qhkc\") pod \"c569b110-2497-43c9-ae17-86855c804915\" (UID: \"c569b110-2497-43c9-ae17-86855c804915\") " Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.107498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c569b110-2497-43c9-ae17-86855c804915-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "c569b110-2497-43c9-ae17-86855c804915" (UID: "c569b110-2497-43c9-ae17-86855c804915"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.107849 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c569b110-2497-43c9-ae17-86855c804915-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.114425 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c569b110-2497-43c9-ae17-86855c804915-kube-api-access-4qhkc" (OuterVolumeSpecName: "kube-api-access-4qhkc") pod "c569b110-2497-43c9-ae17-86855c804915" (UID: "c569b110-2497-43c9-ae17-86855c804915"). InnerVolumeSpecName "kube-api-access-4qhkc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.128591 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c569b110-2497-43c9-ae17-86855c804915-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "c569b110-2497-43c9-ae17-86855c804915" (UID: "c569b110-2497-43c9-ae17-86855c804915"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.209608 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c569b110-2497-43c9-ae17-86855c804915-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.209658 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4qhkc\" (UniqueName: \"kubernetes.io/projected/c569b110-2497-43c9-ae17-86855c804915-kube-api-access-4qhkc\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.727489 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-sj68r" event={"ID":"c569b110-2497-43c9-ae17-86855c804915","Type":"ContainerDied","Data":"a7b608ce04e88761f5e2bd29067b07c9b11c706a9152c7ed583c2c44e4e22b4f"} Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.727965 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7b608ce04e88761f5e2bd29067b07c9b11c706a9152c7ed583c2c44e4e22b4f" Nov 21 13:42:37 crc kubenswrapper[4769]: I1121 13:42:37.727619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-sj68r" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.274773 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:42:40 crc kubenswrapper[4769]: E1121 13:42:40.275471 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.294193 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq"] Nov 21 13:42:40 crc kubenswrapper[4769]: E1121 13:42:40.294533 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c569b110-2497-43c9-ae17-86855c804915" containerName="storage" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.294548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c569b110-2497-43c9-ae17-86855c804915" containerName="storage" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.294710 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c569b110-2497-43c9-ae17-86855c804915" containerName="storage" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.295487 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.299064 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-no-nodes-custom-svc" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.309269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq"] Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.353273 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-config\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.353356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-edpm-no-nodes-custom-svc\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.353465 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z45g\" (UniqueName: \"kubernetes.io/projected/8359f21a-5014-4ece-8225-b8b92aebf817-kube-api-access-4z45g\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.353519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.454894 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-config\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.454992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-edpm-no-nodes-custom-svc\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.455068 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4z45g\" (UniqueName: \"kubernetes.io/projected/8359f21a-5014-4ece-8225-b8b92aebf817-kube-api-access-4z45g\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.455116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.455847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-edpm-no-nodes-custom-svc\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.455979 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-config\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.456270 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.474120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z45g\" (UniqueName: \"kubernetes.io/projected/8359f21a-5014-4ece-8225-b8b92aebf817-kube-api-access-4z45g\") pod \"dnsmasq-dnsmasq-6fdb84cf7c-zk9lq\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:40 crc kubenswrapper[4769]: I1121 13:42:40.662907 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:41 crc kubenswrapper[4769]: I1121 13:42:41.107805 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq"] Nov 21 13:42:41 crc kubenswrapper[4769]: I1121 13:42:41.786278 4769 generic.go:334] "Generic (PLEG): container finished" podID="8359f21a-5014-4ece-8225-b8b92aebf817" containerID="d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d" exitCode=0 Nov 21 13:42:41 crc kubenswrapper[4769]: I1121 13:42:41.786574 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" event={"ID":"8359f21a-5014-4ece-8225-b8b92aebf817","Type":"ContainerDied","Data":"d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d"} Nov 21 13:42:41 crc kubenswrapper[4769]: I1121 13:42:41.786606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" event={"ID":"8359f21a-5014-4ece-8225-b8b92aebf817","Type":"ContainerStarted","Data":"e884c2fa630ddee071c1a24de729d1f408ee8b1d6106efb3863c23e9dfe354fc"} Nov 21 13:42:42 crc kubenswrapper[4769]: I1121 13:42:42.799764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" event={"ID":"8359f21a-5014-4ece-8225-b8b92aebf817","Type":"ContainerStarted","Data":"979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3"} Nov 21 13:42:42 crc kubenswrapper[4769]: I1121 13:42:42.800010 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:50 crc kubenswrapper[4769]: I1121 13:42:50.665490 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:42:50 crc kubenswrapper[4769]: I1121 13:42:50.697884 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" podStartSLOduration=10.697861768 podStartE2EDuration="10.697861768s" podCreationTimestamp="2025-11-21 13:42:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:42:42.819713973 +0000 UTC m=+6721.520375831" watchObservedRunningTime="2025-11-21 13:42:50.697861768 +0000 UTC m=+6729.398523586" Nov 21 13:42:50 crc kubenswrapper[4769]: I1121 13:42:50.735373 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc"] Nov 21 13:42:50 crc kubenswrapper[4769]: I1121 13:42:50.735663 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerName="dnsmasq-dns" containerID="cri-o://02ce507a58f8b1d972d36154062c45657499254c216eb1eb9c5afc76d20965de" gracePeriod=10 Nov 21 13:42:50 crc kubenswrapper[4769]: I1121 13:42:50.888906 4769 generic.go:334] "Generic (PLEG): container finished" podID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerID="02ce507a58f8b1d972d36154062c45657499254c216eb1eb9c5afc76d20965de" exitCode=0 Nov 21 13:42:50 crc kubenswrapper[4769]: I1121 13:42:50.888999 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" event={"ID":"5044ff03-8d1e-4703-98ba-2eb9909f3c59","Type":"ContainerDied","Data":"02ce507a58f8b1d972d36154062c45657499254c216eb1eb9c5afc76d20965de"} Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.211449 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.331051 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfjzh\" (UniqueName: \"kubernetes.io/projected/5044ff03-8d1e-4703-98ba-2eb9909f3c59-kube-api-access-zfjzh\") pod \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.331151 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-dnsmasq-svc\") pod \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.331212 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-config\") pod \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\" (UID: \"5044ff03-8d1e-4703-98ba-2eb9909f3c59\") " Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.336647 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5044ff03-8d1e-4703-98ba-2eb9909f3c59-kube-api-access-zfjzh" (OuterVolumeSpecName: "kube-api-access-zfjzh") pod "5044ff03-8d1e-4703-98ba-2eb9909f3c59" (UID: "5044ff03-8d1e-4703-98ba-2eb9909f3c59"). InnerVolumeSpecName "kube-api-access-zfjzh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.364739 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5044ff03-8d1e-4703-98ba-2eb9909f3c59" (UID: "5044ff03-8d1e-4703-98ba-2eb9909f3c59"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.373925 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-config" (OuterVolumeSpecName: "config") pod "5044ff03-8d1e-4703-98ba-2eb9909f3c59" (UID: "5044ff03-8d1e-4703-98ba-2eb9909f3c59"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.435544 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zfjzh\" (UniqueName: \"kubernetes.io/projected/5044ff03-8d1e-4703-98ba-2eb9909f3c59-kube-api-access-zfjzh\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.435625 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.435648 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5044ff03-8d1e-4703-98ba-2eb9909f3c59-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.899510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" event={"ID":"5044ff03-8d1e-4703-98ba-2eb9909f3c59","Type":"ContainerDied","Data":"7bbd11dc4e737c0675c5b2bd6d36be7e7642fbb73fde2c23192e592a0dd42536"} Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.899577 4769 scope.go:117] "RemoveContainer" containerID="02ce507a58f8b1d972d36154062c45657499254c216eb1eb9c5afc76d20965de" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.899642 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc" Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.939713 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc"] Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.944650 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-7psdc"] Nov 21 13:42:51 crc kubenswrapper[4769]: I1121 13:42:51.946319 4769 scope.go:117] "RemoveContainer" containerID="b2702b770126885714b9170f1312b78fe57696edc6e988a02e922b7f2e8604a9" Nov 21 13:42:53 crc kubenswrapper[4769]: I1121 13:42:53.288500 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" path="/var/lib/kubelet/pods/5044ff03-8d1e-4703-98ba-2eb9909f3c59/volumes" Nov 21 13:42:54 crc kubenswrapper[4769]: I1121 13:42:54.273510 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:42:54 crc kubenswrapper[4769]: E1121 13:42:54.273775 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.252356 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf"] Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.252955 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerName="init" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.252968 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerName="init" Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.252978 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerName="dnsmasq-dns" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.252984 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerName="dnsmasq-dns" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.253137 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5044ff03-8d1e-4703-98ba-2eb9909f3c59" containerName="dnsmasq-dns" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.253607 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.261444 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.261566 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-no-nodes-custom-svc" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.261779 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.261993 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-no-nodes-custom-svc-dockercfg-krgkq" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.262740 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.268887 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf"] Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.396864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.396960 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9vb\" (UniqueName: \"kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.397076 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-ssh-key\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.397121 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-custom-img-svc-combined-ca-bundle\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.428330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf"] Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.429006 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[custom-img-svc-combined-ca-bundle inventory kube-api-access-bt9vb ssh-key], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" podUID="12642509-eba8-47f3-9f95-c99df1779262" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.498885 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.498974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9vb\" (UniqueName: \"kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.499028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-ssh-key\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.499051 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-edpm-no-nodes-custom-svc: secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.499136 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory podName:12642509-eba8-47f3-9f95-c99df1779262 nodeName:}" failed. No retries permitted until 2025-11-21 13:42:55.999116074 +0000 UTC m=+6734.699777892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" (UID: "12642509-eba8-47f3-9f95-c99df1779262") : secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.499064 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-custom-img-svc-combined-ca-bundle\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.504952 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-custom-img-svc-combined-ca-bundle\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.505374 4769 projected.go:194] Error preparing data for projected volume kube-api-access-bt9vb for pod openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf: failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Nov 21 13:42:55 crc kubenswrapper[4769]: E1121 13:42:55.505445 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb podName:12642509-eba8-47f3-9f95-c99df1779262 nodeName:}" failed. No retries permitted until 2025-11-21 13:42:56.005423361 +0000 UTC m=+6734.706085179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bt9vb" (UniqueName: "kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" (UID: "12642509-eba8-47f3-9f95-c99df1779262") : failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.505780 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-ssh-key\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.515991 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn"] Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.519300 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.547206 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn"] Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.702310 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghtkr\" (UniqueName: \"kubernetes.io/projected/abdf9add-ebf6-43f7-9b1d-a111bb80eede-kube-api-access-ghtkr\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.702682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.702857 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.804646 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.804719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.804807 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtkr\" (UniqueName: \"kubernetes.io/projected/abdf9add-ebf6-43f7-9b1d-a111bb80eede-kube-api-access-ghtkr\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.805750 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.806266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.821895 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghtkr\" (UniqueName: \"kubernetes.io/projected/abdf9add-ebf6-43f7-9b1d-a111bb80eede-kube-api-access-ghtkr\") pod \"dnsmasq-dnsmasq-84b9f45d47-gstvn\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.877150 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.934947 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:55 crc kubenswrapper[4769]: I1121 13:42:55.958639 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.008103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9vb\" (UniqueName: \"kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.008235 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:56 crc kubenswrapper[4769]: E1121 13:42:56.008381 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-edpm-no-nodes-custom-svc: secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Nov 21 13:42:56 crc kubenswrapper[4769]: E1121 13:42:56.008456 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory podName:12642509-eba8-47f3-9f95-c99df1779262 nodeName:}" failed. No retries permitted until 2025-11-21 13:42:57.00843863 +0000 UTC m=+6735.709100448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" (UID: "12642509-eba8-47f3-9f95-c99df1779262") : secret "dataplanenodeset-edpm-no-nodes-custom-svc" not found Nov 21 13:42:56 crc kubenswrapper[4769]: E1121 13:42:56.011228 4769 projected.go:194] Error preparing data for projected volume kube-api-access-bt9vb for pod openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf: failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Nov 21 13:42:56 crc kubenswrapper[4769]: E1121 13:42:56.011294 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb podName:12642509-eba8-47f3-9f95-c99df1779262 nodeName:}" failed. No retries permitted until 2025-11-21 13:42:57.011273695 +0000 UTC m=+6735.711935513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt9vb" (UniqueName: "kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" (UID: "12642509-eba8-47f3-9f95-c99df1779262") : failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.107814 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn"] Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.108768 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-ssh-key\") pod \"12642509-eba8-47f3-9f95-c99df1779262\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.108874 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-custom-img-svc-combined-ca-bundle\") pod \"12642509-eba8-47f3-9f95-c99df1779262\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.111714 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "12642509-eba8-47f3-9f95-c99df1779262" (UID: "12642509-eba8-47f3-9f95-c99df1779262"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:42:56 crc kubenswrapper[4769]: W1121 13:42:56.113620 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabdf9add_ebf6_43f7_9b1d_a111bb80eede.slice/crio-503e3da994973e55bd81e11788530ab53f4f6a6d71689f7a3109cf3c2e5ad92a WatchSource:0}: Error finding container 503e3da994973e55bd81e11788530ab53f4f6a6d71689f7a3109cf3c2e5ad92a: Status 404 returned error can't find the container with id 503e3da994973e55bd81e11788530ab53f4f6a6d71689f7a3109cf3c2e5ad92a Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.114687 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-custom-img-svc-combined-ca-bundle" (OuterVolumeSpecName: "custom-img-svc-combined-ca-bundle") pod "12642509-eba8-47f3-9f95-c99df1779262" (UID: "12642509-eba8-47f3-9f95-c99df1779262"). InnerVolumeSpecName "custom-img-svc-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.210662 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.210694 4769 reconciler_common.go:293] "Volume detached for volume \"custom-img-svc-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-custom-img-svc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.947091 4769 generic.go:334] "Generic (PLEG): container finished" podID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerID="dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b" exitCode=0 Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.947172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.947440 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" event={"ID":"abdf9add-ebf6-43f7-9b1d-a111bb80eede","Type":"ContainerDied","Data":"dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b"} Nov 21 13:42:56 crc kubenswrapper[4769]: I1121 13:42:56.947502 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" event={"ID":"abdf9add-ebf6-43f7-9b1d-a111bb80eede","Type":"ContainerStarted","Data":"503e3da994973e55bd81e11788530ab53f4f6a6d71689f7a3109cf3c2e5ad92a"} Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.022029 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9vb\" (UniqueName: \"kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.022369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory\") pod \"custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf\" (UID: \"12642509-eba8-47f3-9f95-c99df1779262\") " pod="openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" Nov 21 13:42:57 crc kubenswrapper[4769]: E1121 13:42:57.022494 4769 secret.go:188] Couldn't get secret openstack-kuttl-tests/dataplanenodeset-edpm-no-nodes-custom-svc: object "openstack-kuttl-tests"/"dataplanenodeset-edpm-no-nodes-custom-svc" not registered Nov 21 13:42:57 crc kubenswrapper[4769]: E1121 13:42:57.022544 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory podName:12642509-eba8-47f3-9f95-c99df1779262 nodeName:}" failed. No retries permitted until 2025-11-21 13:42:59.022526811 +0000 UTC m=+6737.723188629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "inventory" (UniqueName: "kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" (UID: "12642509-eba8-47f3-9f95-c99df1779262") : object "openstack-kuttl-tests"/"dataplanenodeset-edpm-no-nodes-custom-svc" not registered Nov 21 13:42:57 crc kubenswrapper[4769]: E1121 13:42:57.025646 4769 projected.go:194] Error preparing data for projected volume kube-api-access-bt9vb for pod openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf: failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Nov 21 13:42:57 crc kubenswrapper[4769]: E1121 13:42:57.025756 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb podName:12642509-eba8-47f3-9f95-c99df1779262 nodeName:}" failed. No retries permitted until 2025-11-21 13:42:59.025736746 +0000 UTC m=+6737.726398564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bt9vb" (UniqueName: "kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb") pod "custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf" (UID: "12642509-eba8-47f3-9f95-c99df1779262") : failed to fetch token: serviceaccounts "edpm-no-nodes-custom-svc" not found Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.100330 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf"] Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.103471 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/custom-img-svc-edpm-compute-no-nodes-edpm-no-nodes-custom-ccjnf"] Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.225930 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/12642509-eba8-47f3-9f95-c99df1779262-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.225979 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bt9vb\" (UniqueName: \"kubernetes.io/projected/12642509-eba8-47f3-9f95-c99df1779262-kube-api-access-bt9vb\") on node \"crc\" DevicePath \"\"" Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.283550 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12642509-eba8-47f3-9f95-c99df1779262" path="/var/lib/kubelet/pods/12642509-eba8-47f3-9f95-c99df1779262/volumes" Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.967574 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:42:57 crc kubenswrapper[4769]: I1121 13:42:57.968399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" event={"ID":"abdf9add-ebf6-43f7-9b1d-a111bb80eede","Type":"ContainerStarted","Data":"9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a"} Nov 21 13:42:58 crc kubenswrapper[4769]: I1121 13:42:58.004792 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" podStartSLOduration=3.004762388 podStartE2EDuration="3.004762388s" podCreationTimestamp="2025-11-21 13:42:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:42:57.99693788 +0000 UTC m=+6736.697599728" watchObservedRunningTime="2025-11-21 13:42:58.004762388 +0000 UTC m=+6736.705424246" Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.836170 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-sj68r"] Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.841387 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-sj68r"] Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.991550 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-cvksh"] Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.992780 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.996914 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.997746 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.997801 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:43:03 crc kubenswrapper[4769]: I1121 13:43:03.998079 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.019933 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-cvksh"] Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.044739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4af6897-8685-4936-919d-fad707ee855b-crc-storage\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.044972 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdnjn\" (UniqueName: \"kubernetes.io/projected/b4af6897-8685-4936-919d-fad707ee855b-kube-api-access-qdnjn\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.045060 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4af6897-8685-4936-919d-fad707ee855b-node-mnt\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.146501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4af6897-8685-4936-919d-fad707ee855b-crc-storage\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.146621 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qdnjn\" (UniqueName: \"kubernetes.io/projected/b4af6897-8685-4936-919d-fad707ee855b-kube-api-access-qdnjn\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.146659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4af6897-8685-4936-919d-fad707ee855b-node-mnt\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.147052 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4af6897-8685-4936-919d-fad707ee855b-node-mnt\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.147910 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4af6897-8685-4936-919d-fad707ee855b-crc-storage\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.187339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdnjn\" (UniqueName: \"kubernetes.io/projected/b4af6897-8685-4936-919d-fad707ee855b-kube-api-access-qdnjn\") pod \"crc-storage-crc-cvksh\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.321922 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:04 crc kubenswrapper[4769]: I1121 13:43:04.754473 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-cvksh"] Nov 21 13:43:04 crc kubenswrapper[4769]: W1121 13:43:04.757816 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4af6897_8685_4936_919d_fad707ee855b.slice/crio-682eec45ac68113fada8d5908338ccce1a6e28a67e499ad6ee11869ad6b5df59 WatchSource:0}: Error finding container 682eec45ac68113fada8d5908338ccce1a6e28a67e499ad6ee11869ad6b5df59: Status 404 returned error can't find the container with id 682eec45ac68113fada8d5908338ccce1a6e28a67e499ad6ee11869ad6b5df59 Nov 21 13:43:05 crc kubenswrapper[4769]: I1121 13:43:05.055808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-cvksh" event={"ID":"b4af6897-8685-4936-919d-fad707ee855b","Type":"ContainerStarted","Data":"682eec45ac68113fada8d5908338ccce1a6e28a67e499ad6ee11869ad6b5df59"} Nov 21 13:43:05 crc kubenswrapper[4769]: I1121 13:43:05.290087 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c569b110-2497-43c9-ae17-86855c804915" path="/var/lib/kubelet/pods/c569b110-2497-43c9-ae17-86855c804915/volumes" Nov 21 13:43:05 crc kubenswrapper[4769]: I1121 13:43:05.878442 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:43:05 crc kubenswrapper[4769]: I1121 13:43:05.946754 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq"] Nov 21 13:43:05 crc kubenswrapper[4769]: I1121 13:43:05.947041 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" containerName="dnsmasq-dns" containerID="cri-o://979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3" gracePeriod=10 Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.009218 4769 scope.go:117] "RemoveContainer" containerID="c90d7dcef36bec28f82adbb4b3b0ae90b278ec9c12030e7fd8f1c23c276a85b1" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.130858 4769 scope.go:117] "RemoveContainer" containerID="3fb75fc1f78f0526a6c21a6a96193500e4b2feb3e2c978319f87736a4c70be7b" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.167573 4769 scope.go:117] "RemoveContainer" containerID="217e68a0f7b098d5ee8095964a93b50ae6c4af974ba23ecd3e36ac3bcb44a7bb" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.195520 4769 scope.go:117] "RemoveContainer" containerID="a1f2184e25b8e75aaf7e60ce883950cdf40aca0ae3339e962ad5218f38ad6bd6" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.226586 4769 scope.go:117] "RemoveContainer" containerID="463a3ba72a0d27157562cde93b2ef1d550d7c84187fe4338f3e9dd24043ff315" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.269795 4769 scope.go:117] "RemoveContainer" containerID="bf08f1034bd2aa05f7a7de510903669b70357ff7534a34d0fa3a07853962219f" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.300330 4769 scope.go:117] "RemoveContainer" containerID="0589689ccd2b99331a2bfc62d1da1d32f2979b972eaf8e7ab3ee4a1a9a6e9533" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.335006 4769 scope.go:117] "RemoveContainer" containerID="c103bbe9530001a0f7cb3f97e701e5841203a64ccfd3e7337732ea0aa489453b" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.351462 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.369491 4769 scope.go:117] "RemoveContainer" containerID="f52eae95215afac8c924b936d4f35872dfc6f34f3b814ccf1aa1c5402726253d" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.389400 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z45g\" (UniqueName: \"kubernetes.io/projected/8359f21a-5014-4ece-8225-b8b92aebf817-kube-api-access-4z45g\") pod \"8359f21a-5014-4ece-8225-b8b92aebf817\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.389502 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-edpm-no-nodes-custom-svc\") pod \"8359f21a-5014-4ece-8225-b8b92aebf817\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.389644 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-config\") pod \"8359f21a-5014-4ece-8225-b8b92aebf817\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.389670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-dnsmasq-svc\") pod \"8359f21a-5014-4ece-8225-b8b92aebf817\" (UID: \"8359f21a-5014-4ece-8225-b8b92aebf817\") " Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.408658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8359f21a-5014-4ece-8225-b8b92aebf817-kube-api-access-4z45g" (OuterVolumeSpecName: "kube-api-access-4z45g") pod "8359f21a-5014-4ece-8225-b8b92aebf817" (UID: "8359f21a-5014-4ece-8225-b8b92aebf817"). InnerVolumeSpecName "kube-api-access-4z45g". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.459765 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "8359f21a-5014-4ece-8225-b8b92aebf817" (UID: "8359f21a-5014-4ece-8225-b8b92aebf817"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.462056 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-edpm-no-nodes-custom-svc" (OuterVolumeSpecName: "edpm-no-nodes-custom-svc") pod "8359f21a-5014-4ece-8225-b8b92aebf817" (UID: "8359f21a-5014-4ece-8225-b8b92aebf817"). InnerVolumeSpecName "edpm-no-nodes-custom-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.464523 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-config" (OuterVolumeSpecName: "config") pod "8359f21a-5014-4ece-8225-b8b92aebf817" (UID: "8359f21a-5014-4ece-8225-b8b92aebf817"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.490055 4769 scope.go:117] "RemoveContainer" containerID="355ead91f69296ebf454dc85032bcacac400d016638b9252daa73c9ec3b8a326" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.490978 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.491008 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.491024 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4z45g\" (UniqueName: \"kubernetes.io/projected/8359f21a-5014-4ece-8225-b8b92aebf817-kube-api-access-4z45g\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:06 crc kubenswrapper[4769]: I1121 13:43:06.491038 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-no-nodes-custom-svc\" (UniqueName: \"kubernetes.io/configmap/8359f21a-5014-4ece-8225-b8b92aebf817-edpm-no-nodes-custom-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.083288 4769 generic.go:334] "Generic (PLEG): container finished" podID="b4af6897-8685-4936-919d-fad707ee855b" containerID="509e20be4681508f6eaa30ae04a716764534423a793c0f09c20fa98d2eb8797f" exitCode=0 Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.083453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-cvksh" event={"ID":"b4af6897-8685-4936-919d-fad707ee855b","Type":"ContainerDied","Data":"509e20be4681508f6eaa30ae04a716764534423a793c0f09c20fa98d2eb8797f"} Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.086370 4769 generic.go:334] "Generic (PLEG): container finished" podID="8359f21a-5014-4ece-8225-b8b92aebf817" containerID="979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3" exitCode=0 Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.086418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" event={"ID":"8359f21a-5014-4ece-8225-b8b92aebf817","Type":"ContainerDied","Data":"979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3"} Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.086441 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" event={"ID":"8359f21a-5014-4ece-8225-b8b92aebf817","Type":"ContainerDied","Data":"e884c2fa630ddee071c1a24de729d1f408ee8b1d6106efb3863c23e9dfe354fc"} Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.086477 4769 scope.go:117] "RemoveContainer" containerID="979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.086924 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.130844 4769 scope.go:117] "RemoveContainer" containerID="d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.140656 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq"] Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.146121 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6fdb84cf7c-zk9lq"] Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.162797 4769 scope.go:117] "RemoveContainer" containerID="979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3" Nov 21 13:43:07 crc kubenswrapper[4769]: E1121 13:43:07.163655 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3\": container with ID starting with 979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3 not found: ID does not exist" containerID="979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.163706 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3"} err="failed to get container status \"979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3\": rpc error: code = NotFound desc = could not find container \"979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3\": container with ID starting with 979aa5b825c390bdc0035aa24a766cb3821382c0dd53d29998d5483e758705d3 not found: ID does not exist" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.163740 4769 scope.go:117] "RemoveContainer" containerID="d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d" Nov 21 13:43:07 crc kubenswrapper[4769]: E1121 13:43:07.164398 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d\": container with ID starting with d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d not found: ID does not exist" containerID="d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.164428 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d"} err="failed to get container status \"d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d\": rpc error: code = NotFound desc = could not find container \"d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d\": container with ID starting with d0b0525b93469c887dba5fa5bb448a06070e89469925f2331b1ff07778bd617d not found: ID does not exist" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.275069 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:43:07 crc kubenswrapper[4769]: E1121 13:43:07.276048 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:43:07 crc kubenswrapper[4769]: I1121 13:43:07.298625 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" path="/var/lib/kubelet/pods/8359f21a-5014-4ece-8225-b8b92aebf817/volumes" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.430859 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.529797 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4af6897-8685-4936-919d-fad707ee855b-node-mnt\") pod \"b4af6897-8685-4936-919d-fad707ee855b\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.529929 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b4af6897-8685-4936-919d-fad707ee855b-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "b4af6897-8685-4936-919d-fad707ee855b" (UID: "b4af6897-8685-4936-919d-fad707ee855b"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.529938 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4af6897-8685-4936-919d-fad707ee855b-crc-storage\") pod \"b4af6897-8685-4936-919d-fad707ee855b\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.530130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdnjn\" (UniqueName: \"kubernetes.io/projected/b4af6897-8685-4936-919d-fad707ee855b-kube-api-access-qdnjn\") pod \"b4af6897-8685-4936-919d-fad707ee855b\" (UID: \"b4af6897-8685-4936-919d-fad707ee855b\") " Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.530624 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/b4af6897-8685-4936-919d-fad707ee855b-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.537892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4af6897-8685-4936-919d-fad707ee855b-kube-api-access-qdnjn" (OuterVolumeSpecName: "kube-api-access-qdnjn") pod "b4af6897-8685-4936-919d-fad707ee855b" (UID: "b4af6897-8685-4936-919d-fad707ee855b"). InnerVolumeSpecName "kube-api-access-qdnjn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.553034 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4af6897-8685-4936-919d-fad707ee855b-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "b4af6897-8685-4936-919d-fad707ee855b" (UID: "b4af6897-8685-4936-919d-fad707ee855b"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.632533 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/b4af6897-8685-4936-919d-fad707ee855b-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:08 crc kubenswrapper[4769]: I1121 13:43:08.632940 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qdnjn\" (UniqueName: \"kubernetes.io/projected/b4af6897-8685-4936-919d-fad707ee855b-kube-api-access-qdnjn\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:09 crc kubenswrapper[4769]: I1121 13:43:09.121699 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-cvksh" event={"ID":"b4af6897-8685-4936-919d-fad707ee855b","Type":"ContainerDied","Data":"682eec45ac68113fada8d5908338ccce1a6e28a67e499ad6ee11869ad6b5df59"} Nov 21 13:43:09 crc kubenswrapper[4769]: I1121 13:43:09.121769 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="682eec45ac68113fada8d5908338ccce1a6e28a67e499ad6ee11869ad6b5df59" Nov 21 13:43:09 crc kubenswrapper[4769]: I1121 13:43:09.122155 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-cvksh" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.272305 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-cvksh"] Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.281750 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-cvksh"] Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.443939 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-qhgw7"] Nov 21 13:43:12 crc kubenswrapper[4769]: E1121 13:43:12.444467 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" containerName="dnsmasq-dns" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.444496 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" containerName="dnsmasq-dns" Nov 21 13:43:12 crc kubenswrapper[4769]: E1121 13:43:12.444562 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" containerName="init" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.444577 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" containerName="init" Nov 21 13:43:12 crc kubenswrapper[4769]: E1121 13:43:12.444606 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b4af6897-8685-4936-919d-fad707ee855b" containerName="storage" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.444617 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4af6897-8685-4936-919d-fad707ee855b" containerName="storage" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.444875 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b4af6897-8685-4936-919d-fad707ee855b" containerName="storage" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.444915 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8359f21a-5014-4ece-8225-b8b92aebf817" containerName="dnsmasq-dns" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.445713 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.448552 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"crc-storage" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.448727 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"kube-root-ca.crt" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.448866 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"crc-storage"/"openshift-service-ca.crt" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.448939 4769 reflector.go:368] Caches populated for *v1.Secret from object-"crc-storage"/"crc-storage-dockercfg-kk8kq" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.464840 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-qhgw7"] Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.498335 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ed53ba37-7e0a-48d3-88fa-5cf42a438592-node-mnt\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.498631 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckf7p\" (UniqueName: \"kubernetes.io/projected/ed53ba37-7e0a-48d3-88fa-5cf42a438592-kube-api-access-ckf7p\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.498846 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ed53ba37-7e0a-48d3-88fa-5cf42a438592-crc-storage\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.600782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ed53ba37-7e0a-48d3-88fa-5cf42a438592-crc-storage\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.601050 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ed53ba37-7e0a-48d3-88fa-5cf42a438592-node-mnt\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.601177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ckf7p\" (UniqueName: \"kubernetes.io/projected/ed53ba37-7e0a-48d3-88fa-5cf42a438592-kube-api-access-ckf7p\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.601475 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ed53ba37-7e0a-48d3-88fa-5cf42a438592-node-mnt\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.601784 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ed53ba37-7e0a-48d3-88fa-5cf42a438592-crc-storage\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.626571 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckf7p\" (UniqueName: \"kubernetes.io/projected/ed53ba37-7e0a-48d3-88fa-5cf42a438592-kube-api-access-ckf7p\") pod \"crc-storage-crc-qhgw7\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:12 crc kubenswrapper[4769]: I1121 13:43:12.769342 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:13 crc kubenswrapper[4769]: I1121 13:43:13.247505 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-qhgw7"] Nov 21 13:43:13 crc kubenswrapper[4769]: I1121 13:43:13.293942 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4af6897-8685-4936-919d-fad707ee855b" path="/var/lib/kubelet/pods/b4af6897-8685-4936-919d-fad707ee855b/volumes" Nov 21 13:43:14 crc kubenswrapper[4769]: I1121 13:43:14.172317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qhgw7" event={"ID":"ed53ba37-7e0a-48d3-88fa-5cf42a438592","Type":"ContainerStarted","Data":"64b17ca0713b5685646e2b28590696745b38311889935faa556ad781753acd0f"} Nov 21 13:43:15 crc kubenswrapper[4769]: I1121 13:43:15.185125 4769 generic.go:334] "Generic (PLEG): container finished" podID="ed53ba37-7e0a-48d3-88fa-5cf42a438592" containerID="baea9bcc65c9f5ac4c207fa147cc73acdfac9440f00645acc276a0a49ca0e1bf" exitCode=0 Nov 21 13:43:15 crc kubenswrapper[4769]: I1121 13:43:15.185523 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qhgw7" event={"ID":"ed53ba37-7e0a-48d3-88fa-5cf42a438592","Type":"ContainerDied","Data":"baea9bcc65c9f5ac4c207fa147cc73acdfac9440f00645acc276a0a49ca0e1bf"} Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.547089 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.574118 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ed53ba37-7e0a-48d3-88fa-5cf42a438592-node-mnt\") pod \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.574240 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ed53ba37-7e0a-48d3-88fa-5cf42a438592-crc-storage\") pod \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.574341 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ed53ba37-7e0a-48d3-88fa-5cf42a438592-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "ed53ba37-7e0a-48d3-88fa-5cf42a438592" (UID: "ed53ba37-7e0a-48d3-88fa-5cf42a438592"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGidValue "" Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.574450 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckf7p\" (UniqueName: \"kubernetes.io/projected/ed53ba37-7e0a-48d3-88fa-5cf42a438592-kube-api-access-ckf7p\") pod \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\" (UID: \"ed53ba37-7e0a-48d3-88fa-5cf42a438592\") " Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.574875 4769 reconciler_common.go:293] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/ed53ba37-7e0a-48d3-88fa-5cf42a438592-node-mnt\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.582762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed53ba37-7e0a-48d3-88fa-5cf42a438592-kube-api-access-ckf7p" (OuterVolumeSpecName: "kube-api-access-ckf7p") pod "ed53ba37-7e0a-48d3-88fa-5cf42a438592" (UID: "ed53ba37-7e0a-48d3-88fa-5cf42a438592"). InnerVolumeSpecName "kube-api-access-ckf7p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.598353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed53ba37-7e0a-48d3-88fa-5cf42a438592-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "ed53ba37-7e0a-48d3-88fa-5cf42a438592" (UID: "ed53ba37-7e0a-48d3-88fa-5cf42a438592"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.680055 4769 reconciler_common.go:293] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/ed53ba37-7e0a-48d3-88fa-5cf42a438592-crc-storage\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:16 crc kubenswrapper[4769]: I1121 13:43:16.680103 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ckf7p\" (UniqueName: \"kubernetes.io/projected/ed53ba37-7e0a-48d3-88fa-5cf42a438592-kube-api-access-ckf7p\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:17 crc kubenswrapper[4769]: I1121 13:43:17.210931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qhgw7" event={"ID":"ed53ba37-7e0a-48d3-88fa-5cf42a438592","Type":"ContainerDied","Data":"64b17ca0713b5685646e2b28590696745b38311889935faa556ad781753acd0f"} Nov 21 13:43:17 crc kubenswrapper[4769]: I1121 13:43:17.210998 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64b17ca0713b5685646e2b28590696745b38311889935faa556ad781753acd0f" Nov 21 13:43:17 crc kubenswrapper[4769]: I1121 13:43:17.211007 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qhgw7" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.892883 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv"] Nov 21 13:43:19 crc kubenswrapper[4769]: E1121 13:43:19.893578 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ed53ba37-7e0a-48d3-88fa-5cf42a438592" containerName="storage" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.893625 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed53ba37-7e0a-48d3-88fa-5cf42a438592" containerName="storage" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.893837 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ed53ba37-7e0a-48d3-88fa-5cf42a438592" containerName="storage" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.894838 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.896903 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.908610 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv"] Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.933603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-config\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.933703 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.933913 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kbrv\" (UniqueName: \"kubernetes.io/projected/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-kube-api-access-6kbrv\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:19 crc kubenswrapper[4769]: I1121 13:43:19.933978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.036013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.036148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6kbrv\" (UniqueName: \"kubernetes.io/projected/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-kube-api-access-6kbrv\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.036214 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.036340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-config\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.046483 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-edpm-compute-no-nodes\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.046569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-config\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.047649 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.059351 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kbrv\" (UniqueName: \"kubernetes.io/projected/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-kube-api-access-6kbrv\") pod \"dnsmasq-dnsmasq-64864b6d57-wtswv\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.274966 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:43:20 crc kubenswrapper[4769]: E1121 13:43:20.276135 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.346094 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:20 crc kubenswrapper[4769]: I1121 13:43:20.832564 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv"] Nov 21 13:43:21 crc kubenswrapper[4769]: I1121 13:43:21.243917 4769 generic.go:334] "Generic (PLEG): container finished" podID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerID="432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214" exitCode=0 Nov 21 13:43:21 crc kubenswrapper[4769]: I1121 13:43:21.244049 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" event={"ID":"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc","Type":"ContainerDied","Data":"432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214"} Nov 21 13:43:21 crc kubenswrapper[4769]: I1121 13:43:21.244430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" event={"ID":"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc","Type":"ContainerStarted","Data":"64aa420d5bbcc1fffd9464223fe0e3458955d50a316d790ab1f5f08ec99fcab1"} Nov 21 13:43:22 crc kubenswrapper[4769]: I1121 13:43:22.255334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" event={"ID":"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc","Type":"ContainerStarted","Data":"7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad"} Nov 21 13:43:22 crc kubenswrapper[4769]: I1121 13:43:22.255630 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.347482 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.383559 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" podStartSLOduration=11.383531451 podStartE2EDuration="11.383531451s" podCreationTimestamp="2025-11-21 13:43:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:43:22.281075743 +0000 UTC m=+6760.981737561" watchObservedRunningTime="2025-11-21 13:43:30.383531451 +0000 UTC m=+6769.084193279" Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.421611 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn"] Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.422126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerName="dnsmasq-dns" containerID="cri-o://9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a" gracePeriod=10 Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.811452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.908149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-dnsmasq-svc\") pod \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.908308 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-config\") pod \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.908349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghtkr\" (UniqueName: \"kubernetes.io/projected/abdf9add-ebf6-43f7-9b1d-a111bb80eede-kube-api-access-ghtkr\") pod \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\" (UID: \"abdf9add-ebf6-43f7-9b1d-a111bb80eede\") " Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.915400 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abdf9add-ebf6-43f7-9b1d-a111bb80eede-kube-api-access-ghtkr" (OuterVolumeSpecName: "kube-api-access-ghtkr") pod "abdf9add-ebf6-43f7-9b1d-a111bb80eede" (UID: "abdf9add-ebf6-43f7-9b1d-a111bb80eede"). InnerVolumeSpecName "kube-api-access-ghtkr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.943499 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "abdf9add-ebf6-43f7-9b1d-a111bb80eede" (UID: "abdf9add-ebf6-43f7-9b1d-a111bb80eede"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:30 crc kubenswrapper[4769]: I1121 13:43:30.949858 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-config" (OuterVolumeSpecName: "config") pod "abdf9add-ebf6-43f7-9b1d-a111bb80eede" (UID: "abdf9add-ebf6-43f7-9b1d-a111bb80eede"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.009644 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.009684 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ghtkr\" (UniqueName: \"kubernetes.io/projected/abdf9add-ebf6-43f7-9b1d-a111bb80eede-kube-api-access-ghtkr\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.009698 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/abdf9add-ebf6-43f7-9b1d-a111bb80eede-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.350383 4769 generic.go:334] "Generic (PLEG): container finished" podID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerID="9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a" exitCode=0 Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.350436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" event={"ID":"abdf9add-ebf6-43f7-9b1d-a111bb80eede","Type":"ContainerDied","Data":"9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a"} Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.350466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" event={"ID":"abdf9add-ebf6-43f7-9b1d-a111bb80eede","Type":"ContainerDied","Data":"503e3da994973e55bd81e11788530ab53f4f6a6d71689f7a3109cf3c2e5ad92a"} Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.350486 4769 scope.go:117] "RemoveContainer" containerID="9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.351670 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.390877 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn"] Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.397067 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-gstvn"] Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.404787 4769 scope.go:117] "RemoveContainer" containerID="dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.437598 4769 scope.go:117] "RemoveContainer" containerID="9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a" Nov 21 13:43:31 crc kubenswrapper[4769]: E1121 13:43:31.439613 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a\": container with ID starting with 9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a not found: ID does not exist" containerID="9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.439681 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a"} err="failed to get container status \"9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a\": rpc error: code = NotFound desc = could not find container \"9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a\": container with ID starting with 9f0add4473f38e6d8ce7e70c5bad16840c0c80b6a5d4e6b13edb16abb945000a not found: ID does not exist" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.439721 4769 scope.go:117] "RemoveContainer" containerID="dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b" Nov 21 13:43:31 crc kubenswrapper[4769]: E1121 13:43:31.440609 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b\": container with ID starting with dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b not found: ID does not exist" containerID="dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b" Nov 21 13:43:31 crc kubenswrapper[4769]: I1121 13:43:31.440654 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b"} err="failed to get container status \"dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b\": rpc error: code = NotFound desc = could not find container \"dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b\": container with ID starting with dfab87384e518e0c8b0f66f8723f18dea7954d016e8cd1b84c18649fc08d878b not found: ID does not exist" Nov 21 13:43:33 crc kubenswrapper[4769]: I1121 13:43:33.289232 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" path="/var/lib/kubelet/pods/abdf9add-ebf6-43f7-9b1d-a111bb80eede/volumes" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.274681 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:43:34 crc kubenswrapper[4769]: E1121 13:43:34.275645 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.826175 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns"] Nov 21 13:43:34 crc kubenswrapper[4769]: E1121 13:43:34.827841 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerName="init" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.827937 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerName="init" Nov 21 13:43:34 crc kubenswrapper[4769]: E1121 13:43:34.828104 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerName="dnsmasq-dns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.828368 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerName="dnsmasq-dns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.828742 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="abdf9add-ebf6-43f7-9b1d-a111bb80eede" containerName="dnsmasq-dns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.829454 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.831282 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.832016 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.832798 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-gq2df" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.833420 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.834252 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.849658 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns"] Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.876109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.876171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c5mm\" (UniqueName: \"kubernetes.io/projected/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-kube-api-access-2c5mm\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.876224 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.876252 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.977127 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.977219 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2c5mm\" (UniqueName: \"kubernetes.io/projected/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-kube-api-access-2c5mm\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.977242 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.977259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.982740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.982918 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.985585 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:34 crc kubenswrapper[4769]: I1121 13:43:34.993461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c5mm\" (UniqueName: \"kubernetes.io/projected/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-kube-api-access-2c5mm\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:35 crc kubenswrapper[4769]: I1121 13:43:35.161067 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:35 crc kubenswrapper[4769]: I1121 13:43:35.443430 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns"] Nov 21 13:43:35 crc kubenswrapper[4769]: W1121 13:43:35.452387 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod702c5b1e_cce5_42f0_abba_f4b80d7c5bd4.slice/crio-4c2a99898f1a2555853ba639ab090e8bdc917fa35d9761d69ecd6837e7aabbf3 WatchSource:0}: Error finding container 4c2a99898f1a2555853ba639ab090e8bdc917fa35d9761d69ecd6837e7aabbf3: Status 404 returned error can't find the container with id 4c2a99898f1a2555853ba639ab090e8bdc917fa35d9761d69ecd6837e7aabbf3 Nov 21 13:43:36 crc kubenswrapper[4769]: I1121 13:43:36.396035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" event={"ID":"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4","Type":"ContainerStarted","Data":"dc68ee95d1d98dda34a64be72afa825eb0e0d7097c5a810dc10c460630c47b23"} Nov 21 13:43:36 crc kubenswrapper[4769]: I1121 13:43:36.396722 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" event={"ID":"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4","Type":"ContainerStarted","Data":"4c2a99898f1a2555853ba639ab090e8bdc917fa35d9761d69ecd6837e7aabbf3"} Nov 21 13:43:36 crc kubenswrapper[4769]: I1121 13:43:36.419942 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" podStartSLOduration=1.892001338 podStartE2EDuration="2.419920256s" podCreationTimestamp="2025-11-21 13:43:34 +0000 UTC" firstStartedPulling="2025-11-21 13:43:35.455219924 +0000 UTC m=+6774.155881742" lastFinishedPulling="2025-11-21 13:43:35.983138802 +0000 UTC m=+6774.683800660" observedRunningTime="2025-11-21 13:43:36.419350381 +0000 UTC m=+6775.120012209" watchObservedRunningTime="2025-11-21 13:43:36.419920256 +0000 UTC m=+6775.120582074" Nov 21 13:43:38 crc kubenswrapper[4769]: I1121 13:43:38.414642 4769 generic.go:334] "Generic (PLEG): container finished" podID="702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" containerID="dc68ee95d1d98dda34a64be72afa825eb0e0d7097c5a810dc10c460630c47b23" exitCode=2 Nov 21 13:43:38 crc kubenswrapper[4769]: I1121 13:43:38.414712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" event={"ID":"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4","Type":"ContainerDied","Data":"dc68ee95d1d98dda34a64be72afa825eb0e0d7097c5a810dc10c460630c47b23"} Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.742418 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.755066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c5mm\" (UniqueName: \"kubernetes.io/projected/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-kube-api-access-2c5mm\") pod \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.755149 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-inventory\") pod \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.755180 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-failed-service-combined-ca-bundle\") pod \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.756325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-ssh-key\") pod \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\" (UID: \"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4\") " Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.766029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" (UID: "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.776711 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-kube-api-access-2c5mm" (OuterVolumeSpecName: "kube-api-access-2c5mm") pod "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" (UID: "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4"). InnerVolumeSpecName "kube-api-access-2c5mm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.790205 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-inventory" (OuterVolumeSpecName: "inventory") pod "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" (UID: "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.795250 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" (UID: "702c5b1e-cce5-42f0-abba-f4b80d7c5bd4"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.859525 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.859574 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2c5mm\" (UniqueName: \"kubernetes.io/projected/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-kube-api-access-2c5mm\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.859590 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:39 crc kubenswrapper[4769]: I1121 13:43:39.859604 4769 reconciler_common.go:293] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:40 crc kubenswrapper[4769]: I1121 13:43:40.450082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" event={"ID":"702c5b1e-cce5-42f0-abba-f4b80d7c5bd4","Type":"ContainerDied","Data":"4c2a99898f1a2555853ba639ab090e8bdc917fa35d9761d69ecd6837e7aabbf3"} Nov 21 13:43:40 crc kubenswrapper[4769]: I1121 13:43:40.450144 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c2a99898f1a2555853ba639ab090e8bdc917fa35d9761d69ecd6837e7aabbf3" Nov 21 13:43:40 crc kubenswrapper[4769]: I1121 13:43:40.450239 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.024702 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98"] Nov 21 13:43:47 crc kubenswrapper[4769]: E1121 13:43:47.025950 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.025973 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.026323 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.027268 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.030697 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.030873 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.030978 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.030984 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.031108 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-gq2df" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.031795 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98"] Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.164828 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.164884 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.164922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q74mg\" (UniqueName: \"kubernetes.io/projected/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-kube-api-access-q74mg\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.165089 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.266928 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.267047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.267085 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.267124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q74mg\" (UniqueName: \"kubernetes.io/projected/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-kube-api-access-q74mg\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.272938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.272988 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.277995 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.286554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q74mg\" (UniqueName: \"kubernetes.io/projected/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-kube-api-access-q74mg\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.361548 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:47 crc kubenswrapper[4769]: I1121 13:43:47.876337 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98"] Nov 21 13:43:47 crc kubenswrapper[4769]: W1121 13:43:47.880701 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff229284_2d94_4fe4_9dc7_dbab8b8e8472.slice/crio-9a983ce8d109617b600e740bd9ffdec1bee05446259ed473e4375edaf015b001 WatchSource:0}: Error finding container 9a983ce8d109617b600e740bd9ffdec1bee05446259ed473e4375edaf015b001: Status 404 returned error can't find the container with id 9a983ce8d109617b600e740bd9ffdec1bee05446259ed473e4375edaf015b001 Nov 21 13:43:48 crc kubenswrapper[4769]: I1121 13:43:48.274828 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:43:48 crc kubenswrapper[4769]: E1121 13:43:48.275600 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:43:48 crc kubenswrapper[4769]: I1121 13:43:48.515809 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" event={"ID":"ff229284-2d94-4fe4-9dc7-dbab8b8e8472","Type":"ContainerStarted","Data":"9a983ce8d109617b600e740bd9ffdec1bee05446259ed473e4375edaf015b001"} Nov 21 13:43:49 crc kubenswrapper[4769]: I1121 13:43:49.527262 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" event={"ID":"ff229284-2d94-4fe4-9dc7-dbab8b8e8472","Type":"ContainerStarted","Data":"0f6623dfefece359106fbf641769abc2d8289ed56c5120c53d35944560bd2c13"} Nov 21 13:43:49 crc kubenswrapper[4769]: I1121 13:43:49.564675 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" podStartSLOduration=1.938064067 podStartE2EDuration="2.564653048s" podCreationTimestamp="2025-11-21 13:43:47 +0000 UTC" firstStartedPulling="2025-11-21 13:43:47.883089653 +0000 UTC m=+6786.583751471" lastFinishedPulling="2025-11-21 13:43:48.509678644 +0000 UTC m=+6787.210340452" observedRunningTime="2025-11-21 13:43:49.559301596 +0000 UTC m=+6788.259963424" watchObservedRunningTime="2025-11-21 13:43:49.564653048 +0000 UTC m=+6788.265314866" Nov 21 13:43:51 crc kubenswrapper[4769]: I1121 13:43:51.546458 4769 generic.go:334] "Generic (PLEG): container finished" podID="ff229284-2d94-4fe4-9dc7-dbab8b8e8472" containerID="0f6623dfefece359106fbf641769abc2d8289ed56c5120c53d35944560bd2c13" exitCode=2 Nov 21 13:43:51 crc kubenswrapper[4769]: I1121 13:43:51.546515 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" event={"ID":"ff229284-2d94-4fe4-9dc7-dbab8b8e8472","Type":"ContainerDied","Data":"0f6623dfefece359106fbf641769abc2d8289ed56c5120c53d35944560bd2c13"} Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.007271 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.187627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-failed-service-combined-ca-bundle\") pod \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.188142 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-inventory\") pod \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.188271 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q74mg\" (UniqueName: \"kubernetes.io/projected/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-kube-api-access-q74mg\") pod \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.188316 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-ssh-key\") pod \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\" (UID: \"ff229284-2d94-4fe4-9dc7-dbab8b8e8472\") " Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.194735 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "ff229284-2d94-4fe4-9dc7-dbab8b8e8472" (UID: "ff229284-2d94-4fe4-9dc7-dbab8b8e8472"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.195379 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-kube-api-access-q74mg" (OuterVolumeSpecName: "kube-api-access-q74mg") pod "ff229284-2d94-4fe4-9dc7-dbab8b8e8472" (UID: "ff229284-2d94-4fe4-9dc7-dbab8b8e8472"). InnerVolumeSpecName "kube-api-access-q74mg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.216878 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "ff229284-2d94-4fe4-9dc7-dbab8b8e8472" (UID: "ff229284-2d94-4fe4-9dc7-dbab8b8e8472"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.229364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-inventory" (OuterVolumeSpecName: "inventory") pod "ff229284-2d94-4fe4-9dc7-dbab8b8e8472" (UID: "ff229284-2d94-4fe4-9dc7-dbab8b8e8472"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.289069 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.289128 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-q74mg\" (UniqueName: \"kubernetes.io/projected/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-kube-api-access-q74mg\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.289143 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.289152 4769 reconciler_common.go:293] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff229284-2d94-4fe4-9dc7-dbab8b8e8472-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.569116 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" event={"ID":"ff229284-2d94-4fe4-9dc7-dbab8b8e8472","Type":"ContainerDied","Data":"9a983ce8d109617b600e740bd9ffdec1bee05446259ed473e4375edaf015b001"} Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.569172 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a983ce8d109617b600e740bd9ffdec1bee05446259ed473e4375edaf015b001" Nov 21 13:43:53 crc kubenswrapper[4769]: I1121 13:43:53.569174 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98" Nov 21 13:43:59 crc kubenswrapper[4769]: I1121 13:43:59.274322 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:43:59 crc kubenswrapper[4769]: E1121 13:43:59.275318 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.750347 4769 scope.go:117] "RemoveContainer" containerID="7ffea6ae749e01612d8c58545a7b80d3f69d58bae2918929c46d9131bb10d2fb" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.793304 4769 scope.go:117] "RemoveContainer" containerID="b415f984067eb5bc90e83154a99d4c7b283e283aad5ed322b262055654334e98" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.844434 4769 scope.go:117] "RemoveContainer" containerID="d0ae507e5e916298dacf6a76a209318ba9abfdf3903f9a5d36519c64f84d4627" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.876454 4769 scope.go:117] "RemoveContainer" containerID="d67e57261dde56f7faf6b89ad48ee4ebd12fc02a513115899c51ae6de52b5fdb" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.921292 4769 scope.go:117] "RemoveContainer" containerID="5525d3582dbc9b718373aa662c77481f1236e2c4fb965cda073214b007f8f800" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.946630 4769 scope.go:117] "RemoveContainer" containerID="5bf12f7db0e89cb7c2d80986e9fde57d8eeeab2217a4c2f05cc9cea5eca60f13" Nov 21 13:44:06 crc kubenswrapper[4769]: I1121 13:44:06.981345 4769 scope.go:117] "RemoveContainer" containerID="d4a167d91833cfef1cc4d0830248fda7aba17a9e9fd44a25cf14c82d5f240b47" Nov 21 13:44:07 crc kubenswrapper[4769]: I1121 13:44:07.011614 4769 scope.go:117] "RemoveContainer" containerID="d79c1e6ca4905c18eb424e1c27d7973186b5dc004670e512c380b96b73ef2010" Nov 21 13:44:10 crc kubenswrapper[4769]: I1121 13:44:10.274627 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:44:10 crc kubenswrapper[4769]: E1121 13:44:10.275423 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.032677 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj"] Nov 21 13:44:11 crc kubenswrapper[4769]: E1121 13:44:11.033185 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ff229284-2d94-4fe4-9dc7-dbab8b8e8472" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.033247 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff229284-2d94-4fe4-9dc7-dbab8b8e8472" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.033527 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ff229284-2d94-4fe4-9dc7-dbab8b8e8472" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.034413 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.037433 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.037588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.038918 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.038942 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.039426 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-gq2df" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.053076 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj"] Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.206689 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.206777 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf5cs\" (UniqueName: \"kubernetes.io/projected/91dd310f-9f24-43ce-918f-d483b3d9953f-kube-api-access-pf5cs\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.206821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.206931 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.308747 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.308839 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pf5cs\" (UniqueName: \"kubernetes.io/projected/91dd310f-9f24-43ce-918f-d483b3d9953f-kube-api-access-pf5cs\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.308883 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.308986 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.316092 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.316806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.316840 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.332121 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf5cs\" (UniqueName: \"kubernetes.io/projected/91dd310f-9f24-43ce-918f-d483b3d9953f-kube-api-access-pf5cs\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:11 crc kubenswrapper[4769]: I1121 13:44:11.359064 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:12 crc kubenswrapper[4769]: I1121 13:44:11.999380 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj"] Nov 21 13:44:12 crc kubenswrapper[4769]: I1121 13:44:12.767490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" event={"ID":"91dd310f-9f24-43ce-918f-d483b3d9953f","Type":"ContainerStarted","Data":"87b1c7273ce5ed4c52cf31dcd0a7640bf754893ebfb474eab7f783d06f8db096"} Nov 21 13:44:13 crc kubenswrapper[4769]: I1121 13:44:13.779587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" event={"ID":"91dd310f-9f24-43ce-918f-d483b3d9953f","Type":"ContainerStarted","Data":"8c0919c60fe418dd0f70504b11b570af0c3b161e7e987b99cef44f0b2a89fc3e"} Nov 21 13:44:13 crc kubenswrapper[4769]: I1121 13:44:13.804690 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" podStartSLOduration=2.090184038 podStartE2EDuration="2.80466951s" podCreationTimestamp="2025-11-21 13:44:11 +0000 UTC" firstStartedPulling="2025-11-21 13:44:12.007947673 +0000 UTC m=+6810.708609491" lastFinishedPulling="2025-11-21 13:44:12.722433155 +0000 UTC m=+6811.423094963" observedRunningTime="2025-11-21 13:44:13.796067292 +0000 UTC m=+6812.496729150" watchObservedRunningTime="2025-11-21 13:44:13.80466951 +0000 UTC m=+6812.505331328" Nov 21 13:44:15 crc kubenswrapper[4769]: I1121 13:44:15.798544 4769 generic.go:334] "Generic (PLEG): container finished" podID="91dd310f-9f24-43ce-918f-d483b3d9953f" containerID="8c0919c60fe418dd0f70504b11b570af0c3b161e7e987b99cef44f0b2a89fc3e" exitCode=2 Nov 21 13:44:15 crc kubenswrapper[4769]: I1121 13:44:15.798623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" event={"ID":"91dd310f-9f24-43ce-918f-d483b3d9953f","Type":"ContainerDied","Data":"8c0919c60fe418dd0f70504b11b570af0c3b161e7e987b99cef44f0b2a89fc3e"} Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.104682 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.211078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-ssh-key\") pod \"91dd310f-9f24-43ce-918f-d483b3d9953f\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.211144 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-inventory\") pod \"91dd310f-9f24-43ce-918f-d483b3d9953f\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.211168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf5cs\" (UniqueName: \"kubernetes.io/projected/91dd310f-9f24-43ce-918f-d483b3d9953f-kube-api-access-pf5cs\") pod \"91dd310f-9f24-43ce-918f-d483b3d9953f\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.211258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-failed-service-combined-ca-bundle\") pod \"91dd310f-9f24-43ce-918f-d483b3d9953f\" (UID: \"91dd310f-9f24-43ce-918f-d483b3d9953f\") " Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.216679 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "91dd310f-9f24-43ce-918f-d483b3d9953f" (UID: "91dd310f-9f24-43ce-918f-d483b3d9953f"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.216921 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91dd310f-9f24-43ce-918f-d483b3d9953f-kube-api-access-pf5cs" (OuterVolumeSpecName: "kube-api-access-pf5cs") pod "91dd310f-9f24-43ce-918f-d483b3d9953f" (UID: "91dd310f-9f24-43ce-918f-d483b3d9953f"). InnerVolumeSpecName "kube-api-access-pf5cs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.235489 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "91dd310f-9f24-43ce-918f-d483b3d9953f" (UID: "91dd310f-9f24-43ce-918f-d483b3d9953f"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.240430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-inventory" (OuterVolumeSpecName: "inventory") pod "91dd310f-9f24-43ce-918f-d483b3d9953f" (UID: "91dd310f-9f24-43ce-918f-d483b3d9953f"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.313331 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.313363 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pf5cs\" (UniqueName: \"kubernetes.io/projected/91dd310f-9f24-43ce-918f-d483b3d9953f-kube-api-access-pf5cs\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.313377 4769 reconciler_common.go:293] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.313387 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/91dd310f-9f24-43ce-918f-d483b3d9953f-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.819080 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" event={"ID":"91dd310f-9f24-43ce-918f-d483b3d9953f","Type":"ContainerDied","Data":"87b1c7273ce5ed4c52cf31dcd0a7640bf754893ebfb474eab7f783d06f8db096"} Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.819621 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87b1c7273ce5ed4c52cf31dcd0a7640bf754893ebfb474eab7f783d06f8db096" Nov 21 13:44:17 crc kubenswrapper[4769]: I1121 13:44:17.819224 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj" Nov 21 13:44:24 crc kubenswrapper[4769]: I1121 13:44:24.273940 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:44:24 crc kubenswrapper[4769]: E1121 13:44:24.276116 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.865588 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-grthc"] Nov 21 13:44:33 crc kubenswrapper[4769]: E1121 13:44:33.866956 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="91dd310f-9f24-43ce-918f-d483b3d9953f" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.866978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="91dd310f-9f24-43ce-918f-d483b3d9953f" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.867478 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="91dd310f-9f24-43ce-918f-d483b3d9953f" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.869148 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.872507 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-grthc"] Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.906258 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-utilities\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.906314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-catalog-content\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:33 crc kubenswrapper[4769]: I1121 13:44:33.906475 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjn9h\" (UniqueName: \"kubernetes.io/projected/df112f00-8429-4a60-9a9b-737261bed3af-kube-api-access-wjn9h\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.008147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-utilities\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.008252 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-catalog-content\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.008295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjn9h\" (UniqueName: \"kubernetes.io/projected/df112f00-8429-4a60-9a9b-737261bed3af-kube-api-access-wjn9h\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.008723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-utilities\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.008753 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-catalog-content\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.033046 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjn9h\" (UniqueName: \"kubernetes.io/projected/df112f00-8429-4a60-9a9b-737261bed3af-kube-api-access-wjn9h\") pod \"certified-operators-grthc\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.191681 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.441868 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-grthc"] Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.985869 4769 generic.go:334] "Generic (PLEG): container finished" podID="df112f00-8429-4a60-9a9b-737261bed3af" containerID="0d9ffeffb87bf7115b26aaeb1f51b0ceb96e60e8d02923cf5e378d357cc1142a" exitCode=0 Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.985927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerDied","Data":"0d9ffeffb87bf7115b26aaeb1f51b0ceb96e60e8d02923cf5e378d357cc1142a"} Nov 21 13:44:34 crc kubenswrapper[4769]: I1121 13:44:34.986173 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerStarted","Data":"16b51e0ffa1c5964572961aef4fad12bcb9385e0fd7e48aa7831b91d5bcbe688"} Nov 21 13:44:35 crc kubenswrapper[4769]: I1121 13:44:35.997412 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerStarted","Data":"267e7bc5ca1b46316d68463e7f72f3c1a53db9e7c4f8f107c5fa950242d8cdea"} Nov 21 13:44:37 crc kubenswrapper[4769]: I1121 13:44:37.013399 4769 generic.go:334] "Generic (PLEG): container finished" podID="df112f00-8429-4a60-9a9b-737261bed3af" containerID="267e7bc5ca1b46316d68463e7f72f3c1a53db9e7c4f8f107c5fa950242d8cdea" exitCode=0 Nov 21 13:44:37 crc kubenswrapper[4769]: I1121 13:44:37.014625 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerDied","Data":"267e7bc5ca1b46316d68463e7f72f3c1a53db9e7c4f8f107c5fa950242d8cdea"} Nov 21 13:44:37 crc kubenswrapper[4769]: I1121 13:44:37.877442 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-mc4fz"] Nov 21 13:44:37 crc kubenswrapper[4769]: I1121 13:44:37.882592 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:37 crc kubenswrapper[4769]: I1121 13:44:37.884443 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-mc4fz"] Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.024504 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerStarted","Data":"fd13bc5b85dabadccc665e0af34c08d2b7199990f75de862e9804abd07f5dae0"} Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.048515 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-grthc" podStartSLOduration=2.241556201 podStartE2EDuration="5.048493186s" podCreationTimestamp="2025-11-21 13:44:33 +0000 UTC" firstStartedPulling="2025-11-21 13:44:34.988334321 +0000 UTC m=+6833.688996149" lastFinishedPulling="2025-11-21 13:44:37.795271316 +0000 UTC m=+6836.495933134" observedRunningTime="2025-11-21 13:44:38.045958529 +0000 UTC m=+6836.746620367" watchObservedRunningTime="2025-11-21 13:44:38.048493186 +0000 UTC m=+6836.749155004" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.071391 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8lvz\" (UniqueName: \"kubernetes.io/projected/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-kube-api-access-v8lvz\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.071600 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-utilities\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.071668 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-catalog-content\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.173335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v8lvz\" (UniqueName: \"kubernetes.io/projected/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-kube-api-access-v8lvz\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.173429 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-utilities\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.173475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-catalog-content\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.173924 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-catalog-content\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.174036 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-utilities\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.202455 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8lvz\" (UniqueName: \"kubernetes.io/projected/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-kube-api-access-v8lvz\") pod \"redhat-marketplace-mc4fz\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.229166 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:38 crc kubenswrapper[4769]: I1121 13:44:38.715467 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-mc4fz"] Nov 21 13:44:38 crc kubenswrapper[4769]: W1121 13:44:38.730382 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449c7c1b_003a_458f_8cff_b99f8ff8fcbb.slice/crio-cbfcca9cc163291d1349e627f9627edb4d1c5f0a89a591e4bf6b9ce7459b9ac9 WatchSource:0}: Error finding container cbfcca9cc163291d1349e627f9627edb4d1c5f0a89a591e4bf6b9ce7459b9ac9: Status 404 returned error can't find the container with id cbfcca9cc163291d1349e627f9627edb4d1c5f0a89a591e4bf6b9ce7459b9ac9 Nov 21 13:44:39 crc kubenswrapper[4769]: I1121 13:44:39.035231 4769 generic.go:334] "Generic (PLEG): container finished" podID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerID="27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c" exitCode=0 Nov 21 13:44:39 crc kubenswrapper[4769]: I1121 13:44:39.035455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mc4fz" event={"ID":"449c7c1b-003a-458f-8cff-b99f8ff8fcbb","Type":"ContainerDied","Data":"27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c"} Nov 21 13:44:39 crc kubenswrapper[4769]: I1121 13:44:39.036345 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mc4fz" event={"ID":"449c7c1b-003a-458f-8cff-b99f8ff8fcbb","Type":"ContainerStarted","Data":"cbfcca9cc163291d1349e627f9627edb4d1c5f0a89a591e4bf6b9ce7459b9ac9"} Nov 21 13:44:39 crc kubenswrapper[4769]: I1121 13:44:39.274566 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:44:39 crc kubenswrapper[4769]: E1121 13:44:39.274857 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:44:41 crc kubenswrapper[4769]: I1121 13:44:41.056431 4769 generic.go:334] "Generic (PLEG): container finished" podID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerID="ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14" exitCode=0 Nov 21 13:44:41 crc kubenswrapper[4769]: I1121 13:44:41.056583 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mc4fz" event={"ID":"449c7c1b-003a-458f-8cff-b99f8ff8fcbb","Type":"ContainerDied","Data":"ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14"} Nov 21 13:44:42 crc kubenswrapper[4769]: I1121 13:44:42.068747 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mc4fz" event={"ID":"449c7c1b-003a-458f-8cff-b99f8ff8fcbb","Type":"ContainerStarted","Data":"74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37"} Nov 21 13:44:42 crc kubenswrapper[4769]: I1121 13:44:42.091948 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-mc4fz" podStartSLOduration=3.5362201410000003 podStartE2EDuration="5.091928562s" podCreationTimestamp="2025-11-21 13:44:37 +0000 UTC" firstStartedPulling="2025-11-21 13:44:40.046020183 +0000 UTC m=+6838.746682021" lastFinishedPulling="2025-11-21 13:44:41.601728634 +0000 UTC m=+6840.302390442" observedRunningTime="2025-11-21 13:44:42.089136758 +0000 UTC m=+6840.789798586" watchObservedRunningTime="2025-11-21 13:44:42.091928562 +0000 UTC m=+6840.792590380" Nov 21 13:44:44 crc kubenswrapper[4769]: I1121 13:44:44.192758 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:44 crc kubenswrapper[4769]: I1121 13:44:44.192831 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:44 crc kubenswrapper[4769]: I1121 13:44:44.244820 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:45 crc kubenswrapper[4769]: I1121 13:44:45.163867 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:48 crc kubenswrapper[4769]: I1121 13:44:48.229719 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:48 crc kubenswrapper[4769]: I1121 13:44:48.230244 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:48 crc kubenswrapper[4769]: I1121 13:44:48.293157 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:48 crc kubenswrapper[4769]: I1121 13:44:48.456757 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-grthc"] Nov 21 13:44:48 crc kubenswrapper[4769]: I1121 13:44:48.457161 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-grthc" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="registry-server" containerID="cri-o://fd13bc5b85dabadccc665e0af34c08d2b7199990f75de862e9804abd07f5dae0" gracePeriod=2 Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.139547 4769 generic.go:334] "Generic (PLEG): container finished" podID="df112f00-8429-4a60-9a9b-737261bed3af" containerID="fd13bc5b85dabadccc665e0af34c08d2b7199990f75de862e9804abd07f5dae0" exitCode=0 Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.139630 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerDied","Data":"fd13bc5b85dabadccc665e0af34c08d2b7199990f75de862e9804abd07f5dae0"} Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.231482 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.428283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.561593 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-catalog-content\") pod \"df112f00-8429-4a60-9a9b-737261bed3af\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.563350 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-utilities\") pod \"df112f00-8429-4a60-9a9b-737261bed3af\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.563601 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjn9h\" (UniqueName: \"kubernetes.io/projected/df112f00-8429-4a60-9a9b-737261bed3af-kube-api-access-wjn9h\") pod \"df112f00-8429-4a60-9a9b-737261bed3af\" (UID: \"df112f00-8429-4a60-9a9b-737261bed3af\") " Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.564401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-utilities" (OuterVolumeSpecName: "utilities") pod "df112f00-8429-4a60-9a9b-737261bed3af" (UID: "df112f00-8429-4a60-9a9b-737261bed3af"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.568704 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df112f00-8429-4a60-9a9b-737261bed3af-kube-api-access-wjn9h" (OuterVolumeSpecName: "kube-api-access-wjn9h") pod "df112f00-8429-4a60-9a9b-737261bed3af" (UID: "df112f00-8429-4a60-9a9b-737261bed3af"). InnerVolumeSpecName "kube-api-access-wjn9h". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.608331 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "df112f00-8429-4a60-9a9b-737261bed3af" (UID: "df112f00-8429-4a60-9a9b-737261bed3af"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.665086 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjn9h\" (UniqueName: \"kubernetes.io/projected/df112f00-8429-4a60-9a9b-737261bed3af-kube-api-access-wjn9h\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.665134 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:49 crc kubenswrapper[4769]: I1121 13:44:49.665150 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/df112f00-8429-4a60-9a9b-737261bed3af-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.158432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-grthc" event={"ID":"df112f00-8429-4a60-9a9b-737261bed3af","Type":"ContainerDied","Data":"16b51e0ffa1c5964572961aef4fad12bcb9385e0fd7e48aa7831b91d5bcbe688"} Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.158554 4769 scope.go:117] "RemoveContainer" containerID="fd13bc5b85dabadccc665e0af34c08d2b7199990f75de862e9804abd07f5dae0" Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.158928 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-grthc" Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.191320 4769 scope.go:117] "RemoveContainer" containerID="267e7bc5ca1b46316d68463e7f72f3c1a53db9e7c4f8f107c5fa950242d8cdea" Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.214510 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-grthc"] Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.221336 4769 scope.go:117] "RemoveContainer" containerID="0d9ffeffb87bf7115b26aaeb1f51b0ceb96e60e8d02923cf5e378d357cc1142a" Nov 21 13:44:50 crc kubenswrapper[4769]: I1121 13:44:50.229985 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-grthc"] Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.274318 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:44:51 crc kubenswrapper[4769]: E1121 13:44:51.274929 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.285265 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df112f00-8429-4a60-9a9b-737261bed3af" path="/var/lib/kubelet/pods/df112f00-8429-4a60-9a9b-737261bed3af/volumes" Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.450623 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-mc4fz"] Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.450860 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-mc4fz" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="registry-server" containerID="cri-o://74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37" gracePeriod=2 Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.850632 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.900047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-catalog-content\") pod \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.900285 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-utilities\") pod \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.900369 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8lvz\" (UniqueName: \"kubernetes.io/projected/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-kube-api-access-v8lvz\") pod \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\" (UID: \"449c7c1b-003a-458f-8cff-b99f8ff8fcbb\") " Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.901295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-utilities" (OuterVolumeSpecName: "utilities") pod "449c7c1b-003a-458f-8cff-b99f8ff8fcbb" (UID: "449c7c1b-003a-458f-8cff-b99f8ff8fcbb"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.904538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-kube-api-access-v8lvz" (OuterVolumeSpecName: "kube-api-access-v8lvz") pod "449c7c1b-003a-458f-8cff-b99f8ff8fcbb" (UID: "449c7c1b-003a-458f-8cff-b99f8ff8fcbb"). InnerVolumeSpecName "kube-api-access-v8lvz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:44:51 crc kubenswrapper[4769]: I1121 13:44:51.923291 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "449c7c1b-003a-458f-8cff-b99f8ff8fcbb" (UID: "449c7c1b-003a-458f-8cff-b99f8ff8fcbb"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.002475 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.002509 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v8lvz\" (UniqueName: \"kubernetes.io/projected/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-kube-api-access-v8lvz\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.002522 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/449c7c1b-003a-458f-8cff-b99f8ff8fcbb-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.178550 4769 generic.go:334] "Generic (PLEG): container finished" podID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerID="74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37" exitCode=0 Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.178591 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mc4fz" event={"ID":"449c7c1b-003a-458f-8cff-b99f8ff8fcbb","Type":"ContainerDied","Data":"74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37"} Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.178617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-mc4fz" event={"ID":"449c7c1b-003a-458f-8cff-b99f8ff8fcbb","Type":"ContainerDied","Data":"cbfcca9cc163291d1349e627f9627edb4d1c5f0a89a591e4bf6b9ce7459b9ac9"} Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.178636 4769 scope.go:117] "RemoveContainer" containerID="74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.178764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-mc4fz" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.214194 4769 scope.go:117] "RemoveContainer" containerID="ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.222346 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-mc4fz"] Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.228627 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-mc4fz"] Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.241457 4769 scope.go:117] "RemoveContainer" containerID="27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.272132 4769 scope.go:117] "RemoveContainer" containerID="74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37" Nov 21 13:44:52 crc kubenswrapper[4769]: E1121 13:44:52.272590 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37\": container with ID starting with 74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37 not found: ID does not exist" containerID="74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.272642 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37"} err="failed to get container status \"74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37\": rpc error: code = NotFound desc = could not find container \"74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37\": container with ID starting with 74122bd9e6a344352a777f5d53f16fddcf38a2a7c3aedc7e45d2fe266fe72b37 not found: ID does not exist" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.272668 4769 scope.go:117] "RemoveContainer" containerID="ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14" Nov 21 13:44:52 crc kubenswrapper[4769]: E1121 13:44:52.273787 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14\": container with ID starting with ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14 not found: ID does not exist" containerID="ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.273810 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14"} err="failed to get container status \"ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14\": rpc error: code = NotFound desc = could not find container \"ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14\": container with ID starting with ec4360b0274a30244ba8388dc9b47bf98d05752be21754be04b62ad6a6633b14 not found: ID does not exist" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.273823 4769 scope.go:117] "RemoveContainer" containerID="27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c" Nov 21 13:44:52 crc kubenswrapper[4769]: E1121 13:44:52.274043 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c\": container with ID starting with 27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c not found: ID does not exist" containerID="27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c" Nov 21 13:44:52 crc kubenswrapper[4769]: I1121 13:44:52.274069 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c"} err="failed to get container status \"27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c\": rpc error: code = NotFound desc = could not find container \"27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c\": container with ID starting with 27414dbcbccaf463339882234219b772272e555a0904fc539c7955deb903db8c not found: ID does not exist" Nov 21 13:44:53 crc kubenswrapper[4769]: I1121 13:44:53.287054 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" path="/var/lib/kubelet/pods/449c7c1b-003a-458f-8cff-b99f8ff8fcbb/volumes" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027163 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm"] Nov 21 13:44:54 crc kubenswrapper[4769]: E1121 13:44:54.027681 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="extract-content" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027698 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="extract-content" Nov 21 13:44:54 crc kubenswrapper[4769]: E1121 13:44:54.027735 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="extract-utilities" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027744 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="extract-utilities" Nov 21 13:44:54 crc kubenswrapper[4769]: E1121 13:44:54.027755 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="registry-server" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027765 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="registry-server" Nov 21 13:44:54 crc kubenswrapper[4769]: E1121 13:44:54.027789 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="registry-server" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027799 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="registry-server" Nov 21 13:44:54 crc kubenswrapper[4769]: E1121 13:44:54.027816 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="extract-utilities" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027825 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="extract-utilities" Nov 21 13:44:54 crc kubenswrapper[4769]: E1121 13:44:54.027847 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="extract-content" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.027855 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="extract-content" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.028025 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="449c7c1b-003a-458f-8cff-b99f8ff8fcbb" containerName="registry-server" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.028055 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="df112f00-8429-4a60-9a9b-737261bed3af" containerName="registry-server" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.028754 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.030751 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplanenodeset-edpm-compute-no-nodes" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.031618 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"edpm-compute-no-nodes-dockercfg-gq2df" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.032250 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-kuttl-tests"/"openstack-aee-default-env" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.032522 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"combined-ca-bundle" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.033025 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-kuttl-tests"/"dataplane-ansible-ssh-private-key-secret" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.040148 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm"] Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.040516 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.040592 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csz9k\" (UniqueName: \"kubernetes.io/projected/fc431661-cc7f-47bc-bdaf-5a420f0819ea-kube-api-access-csz9k\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.040795 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.040930 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.143051 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.143131 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-csz9k\" (UniqueName: \"kubernetes.io/projected/fc431661-cc7f-47bc-bdaf-5a420f0819ea-kube-api-access-csz9k\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.143179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.143234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.148249 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-failed-service-combined-ca-bundle\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.148306 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-ssh-key\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.148545 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-inventory\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.165064 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-csz9k\" (UniqueName: \"kubernetes.io/projected/fc431661-cc7f-47bc-bdaf-5a420f0819ea-kube-api-access-csz9k\") pod \"failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.357385 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:44:54 crc kubenswrapper[4769]: I1121 13:44:54.845409 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm"] Nov 21 13:44:55 crc kubenswrapper[4769]: I1121 13:44:55.212935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" event={"ID":"fc431661-cc7f-47bc-bdaf-5a420f0819ea","Type":"ContainerStarted","Data":"64a49fd068b7095ad8b87794e582144458b5cea514aab336de3508de039c8ad0"} Nov 21 13:44:59 crc kubenswrapper[4769]: I1121 13:44:59.258937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" event={"ID":"fc431661-cc7f-47bc-bdaf-5a420f0819ea","Type":"ContainerStarted","Data":"db13f3833c0b12f3b36698e1a8d6c047ac34e9c11d679d143a923e151168e00a"} Nov 21 13:44:59 crc kubenswrapper[4769]: I1121 13:44:59.304947 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" podStartSLOduration=2.118527356 podStartE2EDuration="5.304920635s" podCreationTimestamp="2025-11-21 13:44:54 +0000 UTC" firstStartedPulling="2025-11-21 13:44:54.863399548 +0000 UTC m=+6853.564061376" lastFinishedPulling="2025-11-21 13:44:58.049792797 +0000 UTC m=+6856.750454655" observedRunningTime="2025-11-21 13:44:59.297027296 +0000 UTC m=+6857.997689124" watchObservedRunningTime="2025-11-21 13:44:59.304920635 +0000 UTC m=+6858.005582463" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.163215 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r"] Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.164314 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.166390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.166484 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.182432 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r"] Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.325517 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/09f85478-79a6-4dbf-a7a4-53546d67d0b2-secret-volume\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.325655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09f85478-79a6-4dbf-a7a4-53546d67d0b2-config-volume\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.325821 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxrm\" (UniqueName: \"kubernetes.io/projected/09f85478-79a6-4dbf-a7a4-53546d67d0b2-kube-api-access-mjxrm\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.427369 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxrm\" (UniqueName: \"kubernetes.io/projected/09f85478-79a6-4dbf-a7a4-53546d67d0b2-kube-api-access-mjxrm\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.427478 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/09f85478-79a6-4dbf-a7a4-53546d67d0b2-secret-volume\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.427585 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09f85478-79a6-4dbf-a7a4-53546d67d0b2-config-volume\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.429163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09f85478-79a6-4dbf-a7a4-53546d67d0b2-config-volume\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.433803 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/09f85478-79a6-4dbf-a7a4-53546d67d0b2-secret-volume\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.446141 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxrm\" (UniqueName: \"kubernetes.io/projected/09f85478-79a6-4dbf-a7a4-53546d67d0b2-kube-api-access-mjxrm\") pod \"collect-profiles-29395545-zwt8r\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.486743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:00 crc kubenswrapper[4769]: I1121 13:45:00.703137 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r"] Nov 21 13:45:01 crc kubenswrapper[4769]: I1121 13:45:01.275827 4769 generic.go:334] "Generic (PLEG): container finished" podID="fc431661-cc7f-47bc-bdaf-5a420f0819ea" containerID="db13f3833c0b12f3b36698e1a8d6c047ac34e9c11d679d143a923e151168e00a" exitCode=2 Nov 21 13:45:01 crc kubenswrapper[4769]: I1121 13:45:01.277480 4769 generic.go:334] "Generic (PLEG): container finished" podID="09f85478-79a6-4dbf-a7a4-53546d67d0b2" containerID="60be6fab7402ed969e8061ef7410fe7e17bd3f2fc8d00fd949039e547164b075" exitCode=0 Nov 21 13:45:01 crc kubenswrapper[4769]: I1121 13:45:01.284085 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" event={"ID":"fc431661-cc7f-47bc-bdaf-5a420f0819ea","Type":"ContainerDied","Data":"db13f3833c0b12f3b36698e1a8d6c047ac34e9c11d679d143a923e151168e00a"} Nov 21 13:45:01 crc kubenswrapper[4769]: I1121 13:45:01.284377 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" event={"ID":"09f85478-79a6-4dbf-a7a4-53546d67d0b2","Type":"ContainerDied","Data":"60be6fab7402ed969e8061ef7410fe7e17bd3f2fc8d00fd949039e547164b075"} Nov 21 13:45:01 crc kubenswrapper[4769]: I1121 13:45:01.284483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" event={"ID":"09f85478-79a6-4dbf-a7a4-53546d67d0b2","Type":"ContainerStarted","Data":"3033630a54fcb71b66be0e43eda5626e91ca0816b3255dd0bf7d6c5d59cec76b"} Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.611975 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.618302 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.759278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/09f85478-79a6-4dbf-a7a4-53546d67d0b2-secret-volume\") pod \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.759335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csz9k\" (UniqueName: \"kubernetes.io/projected/fc431661-cc7f-47bc-bdaf-5a420f0819ea-kube-api-access-csz9k\") pod \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.759379 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjxrm\" (UniqueName: \"kubernetes.io/projected/09f85478-79a6-4dbf-a7a4-53546d67d0b2-kube-api-access-mjxrm\") pod \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.760348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-ssh-key\") pod \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.760529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-failed-service-combined-ca-bundle\") pod \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.760578 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09f85478-79a6-4dbf-a7a4-53546d67d0b2-config-volume\") pod \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\" (UID: \"09f85478-79a6-4dbf-a7a4-53546d67d0b2\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.760627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-inventory\") pod \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\" (UID: \"fc431661-cc7f-47bc-bdaf-5a420f0819ea\") " Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.761823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f85478-79a6-4dbf-a7a4-53546d67d0b2-config-volume" (OuterVolumeSpecName: "config-volume") pod "09f85478-79a6-4dbf-a7a4-53546d67d0b2" (UID: "09f85478-79a6-4dbf-a7a4-53546d67d0b2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.766011 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09f85478-79a6-4dbf-a7a4-53546d67d0b2-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "09f85478-79a6-4dbf-a7a4-53546d67d0b2" (UID: "09f85478-79a6-4dbf-a7a4-53546d67d0b2"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.766276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-failed-service-combined-ca-bundle" (OuterVolumeSpecName: "failed-service-combined-ca-bundle") pod "fc431661-cc7f-47bc-bdaf-5a420f0819ea" (UID: "fc431661-cc7f-47bc-bdaf-5a420f0819ea"). InnerVolumeSpecName "failed-service-combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.768174 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f85478-79a6-4dbf-a7a4-53546d67d0b2-kube-api-access-mjxrm" (OuterVolumeSpecName: "kube-api-access-mjxrm") pod "09f85478-79a6-4dbf-a7a4-53546d67d0b2" (UID: "09f85478-79a6-4dbf-a7a4-53546d67d0b2"). InnerVolumeSpecName "kube-api-access-mjxrm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.768520 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc431661-cc7f-47bc-bdaf-5a420f0819ea-kube-api-access-csz9k" (OuterVolumeSpecName: "kube-api-access-csz9k") pod "fc431661-cc7f-47bc-bdaf-5a420f0819ea" (UID: "fc431661-cc7f-47bc-bdaf-5a420f0819ea"). InnerVolumeSpecName "kube-api-access-csz9k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.783409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-inventory" (OuterVolumeSpecName: "inventory") pod "fc431661-cc7f-47bc-bdaf-5a420f0819ea" (UID: "fc431661-cc7f-47bc-bdaf-5a420f0819ea"). InnerVolumeSpecName "inventory". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.784680 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-ssh-key" (OuterVolumeSpecName: "ssh-key") pod "fc431661-cc7f-47bc-bdaf-5a420f0819ea" (UID: "fc431661-cc7f-47bc-bdaf-5a420f0819ea"). InnerVolumeSpecName "ssh-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862641 4769 reconciler_common.go:293] "Volume detached for volume \"ssh-key\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-ssh-key\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862684 4769 reconciler_common.go:293] "Volume detached for volume \"failed-service-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-failed-service-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862700 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/09f85478-79a6-4dbf-a7a4-53546d67d0b2-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862711 4769 reconciler_common.go:293] "Volume detached for volume \"inventory\" (UniqueName: \"kubernetes.io/secret/fc431661-cc7f-47bc-bdaf-5a420f0819ea-inventory\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862751 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/09f85478-79a6-4dbf-a7a4-53546d67d0b2-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862765 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-csz9k\" (UniqueName: \"kubernetes.io/projected/fc431661-cc7f-47bc-bdaf-5a420f0819ea-kube-api-access-csz9k\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:02 crc kubenswrapper[4769]: I1121 13:45:02.862775 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mjxrm\" (UniqueName: \"kubernetes.io/projected/09f85478-79a6-4dbf-a7a4-53546d67d0b2-kube-api-access-mjxrm\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.296442 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.296679 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395545-zwt8r" event={"ID":"09f85478-79a6-4dbf-a7a4-53546d67d0b2","Type":"ContainerDied","Data":"3033630a54fcb71b66be0e43eda5626e91ca0816b3255dd0bf7d6c5d59cec76b"} Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.297239 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3033630a54fcb71b66be0e43eda5626e91ca0816b3255dd0bf7d6c5d59cec76b" Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.300438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" event={"ID":"fc431661-cc7f-47bc-bdaf-5a420f0819ea","Type":"ContainerDied","Data":"64a49fd068b7095ad8b87794e582144458b5cea514aab336de3508de039c8ad0"} Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.300476 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64a49fd068b7095ad8b87794e582144458b5cea514aab336de3508de039c8ad0" Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.300529 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm" Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.682073 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697"] Nov 21 13:45:03 crc kubenswrapper[4769]: I1121 13:45:03.687968 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395500-hp697"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.405122 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.415618 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.422331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.427085 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.431519 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodest4mnm"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.435937 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesspl98"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.441451 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesldfns"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.448141 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/failed-service-edpm-compute-no-nodes-edpm-compute-no-nodesl7rwj"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.488248 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff"] Nov 21 13:45:04 crc kubenswrapper[4769]: E1121 13:45:04.488564 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="09f85478-79a6-4dbf-a7a4-53546d67d0b2" containerName="collect-profiles" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.488581 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f85478-79a6-4dbf-a7a4-53546d67d0b2" containerName="collect-profiles" Nov 21 13:45:04 crc kubenswrapper[4769]: E1121 13:45:04.488611 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc431661-cc7f-47bc-bdaf-5a420f0819ea" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.488619 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc431661-cc7f-47bc-bdaf-5a420f0819ea" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.488888 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="09f85478-79a6-4dbf-a7a4-53546d67d0b2" containerName="collect-profiles" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.488935 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc431661-cc7f-47bc-bdaf-5a420f0819ea" containerName="failed-service-edpm-compute-no-nodes-edpm-compute-no-nodes" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.489743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.510689 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff"] Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.588661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/149c21d2-e244-43e9-a98a-e92de1d18f28-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.588774 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/149c21d2-e244-43e9-a98a-e92de1d18f28-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.588905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svbcp\" (UniqueName: \"kubernetes.io/projected/149c21d2-e244-43e9-a98a-e92de1d18f28-kube-api-access-svbcp\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.691481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/149c21d2-e244-43e9-a98a-e92de1d18f28-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.691608 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-svbcp\" (UniqueName: \"kubernetes.io/projected/149c21d2-e244-43e9-a98a-e92de1d18f28-kube-api-access-svbcp\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.691799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/149c21d2-e244-43e9-a98a-e92de1d18f28-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.692515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/149c21d2-e244-43e9-a98a-e92de1d18f28-config\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.692727 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/149c21d2-e244-43e9-a98a-e92de1d18f28-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.721845 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-svbcp\" (UniqueName: \"kubernetes.io/projected/149c21d2-e244-43e9-a98a-e92de1d18f28-kube-api-access-svbcp\") pod \"dnsmasq-dnsmasq-84b9f45d47-2dnff\" (UID: \"149c21d2-e244-43e9-a98a-e92de1d18f28\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:04 crc kubenswrapper[4769]: I1121 13:45:04.809552 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.241573 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff"] Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.284764 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2674ce4f-ef2f-45b7-8b99-3d16811f726e" path="/var/lib/kubelet/pods/2674ce4f-ef2f-45b7-8b99-3d16811f726e/volumes" Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.286253 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="702c5b1e-cce5-42f0-abba-f4b80d7c5bd4" path="/var/lib/kubelet/pods/702c5b1e-cce5-42f0-abba-f4b80d7c5bd4/volumes" Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.286807 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91dd310f-9f24-43ce-918f-d483b3d9953f" path="/var/lib/kubelet/pods/91dd310f-9f24-43ce-918f-d483b3d9953f/volumes" Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.287744 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc431661-cc7f-47bc-bdaf-5a420f0819ea" path="/var/lib/kubelet/pods/fc431661-cc7f-47bc-bdaf-5a420f0819ea/volumes" Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.288227 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff229284-2d94-4fe4-9dc7-dbab8b8e8472" path="/var/lib/kubelet/pods/ff229284-2d94-4fe4-9dc7-dbab8b8e8472/volumes" Nov 21 13:45:05 crc kubenswrapper[4769]: I1121 13:45:05.318069 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" event={"ID":"149c21d2-e244-43e9-a98a-e92de1d18f28","Type":"ContainerStarted","Data":"56494159b88c7ced893ae81e03faf975fa838f8a045f2b7bbfd422ab7aef4cd5"} Nov 21 13:45:06 crc kubenswrapper[4769]: I1121 13:45:06.274477 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:45:06 crc kubenswrapper[4769]: E1121 13:45:06.274841 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:45:06 crc kubenswrapper[4769]: I1121 13:45:06.344697 4769 generic.go:334] "Generic (PLEG): container finished" podID="149c21d2-e244-43e9-a98a-e92de1d18f28" containerID="672973c241bcddcc96cf87273785b8c2077f8fce9d8fff5628e428b1d807a312" exitCode=0 Nov 21 13:45:06 crc kubenswrapper[4769]: I1121 13:45:06.345048 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" event={"ID":"149c21d2-e244-43e9-a98a-e92de1d18f28","Type":"ContainerDied","Data":"672973c241bcddcc96cf87273785b8c2077f8fce9d8fff5628e428b1d807a312"} Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.187102 4769 scope.go:117] "RemoveContainer" containerID="5bbde17f8401a8868711782affa75affdf2371f4a30503d4d286bac257e4d0bd" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.212009 4769 scope.go:117] "RemoveContainer" containerID="cf3a0cc5e3479a8c51b359435800f2fab8635623c4d6fe6815c5b6f1cb13637a" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.254709 4769 scope.go:117] "RemoveContainer" containerID="b9292bb49fd9a196c9162d9187172c396d9b9bc2e5501ed3a34901f217f5ca84" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.281840 4769 scope.go:117] "RemoveContainer" containerID="7c264901691ad608bf773e6f0d036657ee414bda3fec1475c9c3a1383ee03ff9" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.309810 4769 scope.go:117] "RemoveContainer" containerID="b7999b46cb6b9fea6218c23e90b39928cf68bced4540b10e455987293017b967" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.364748 4769 scope.go:117] "RemoveContainer" containerID="1a0dee2695bac7e108629e7fb47320354321d948143c2f5e4fbbcd7e75f0a859" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.389045 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" event={"ID":"149c21d2-e244-43e9-a98a-e92de1d18f28","Type":"ContainerStarted","Data":"5fd486ed92192e5eed8dc6e8bac2614078c9da9c03680da25d487ea71365b355"} Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.389649 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.391707 4769 scope.go:117] "RemoveContainer" containerID="fdb2f1ff2642196894273f8c0c9be90a614400278a3f332700951a2593c96173" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.409073 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" podStartSLOduration=3.409053948 podStartE2EDuration="3.409053948s" podCreationTimestamp="2025-11-21 13:45:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:45:07.402909395 +0000 UTC m=+6866.103571213" watchObservedRunningTime="2025-11-21 13:45:07.409053948 +0000 UTC m=+6866.109715766" Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.789575 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.789857 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="kube-rbac-proxy" containerID="cri-o://8d868e6a04fc23686196f3767dd9ad9ef9a278e8d8f934e18f5d16b1d5cc06f3" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.789929 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="manager" containerID="cri-o://bf5a6c30d09e75eb03f2720daf0cbda1be4c561977c7b3cdfe4809428a9b34de" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.799240 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.799518 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="manager" containerID="cri-o://478fb18fc3332ba4f29b0d6b5fcd459e36b484739473c376efd5a28b520e4044" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.799938 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="kube-rbac-proxy" containerID="cri-o://7ab81a190f7145ab19be918722a255c3e182600639baf55f41cb667365a8162a" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.815803 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.816055 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="kube-rbac-proxy" containerID="cri-o://7fbc88a3b3c1936b9597119e2724b5f6bc70cc4472a304dfb9f35650fd3611df" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.816126 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="manager" containerID="cri-o://bd46dd8c9731a36be3f0e9694dbe037636ce2ea5c0d064b7f4c047b06f2d416c" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.825595 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.825814 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="manager" containerID="cri-o://149bcf102175b79f59006c0a114f30b2078eeba9534f17f7826903ff09f663e3" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.825875 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="kube-rbac-proxy" containerID="cri-o://ee6015ca258ee6b5ce1301776f76cd081fabad0d139968bc670160748d442344" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.834574 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.834819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="kube-rbac-proxy" containerID="cri-o://5c8347a693dfa211efed9bbe4b780160870ba4380606caa9ce739f6bb65e1b03" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.835026 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="manager" containerID="cri-o://ecac01db0828cac6541f262c83e55c1e7a591f42926cc3ec8ebef9b8b227faa5" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.857677 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.858053 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="kube-rbac-proxy" containerID="cri-o://db28119909fa7b28c44812d7184901321e739f42d3230070a418722047a5bdf3" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.858584 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="manager" containerID="cri-o://c3dccda292760178da96b95423da3f0986bed4c9b7cc165579e3b87ea035c99c" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.863762 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.863998 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="manager" containerID="cri-o://495665c86c27acc6143afe39073e804f682726439e71e688495d915ce8911500" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.864616 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="kube-rbac-proxy" containerID="cri-o://bc53fca0eca528cea270c1e119736ca93e18ca8fd4227514f717fd0de44d1f58" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.870805 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.871061 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="manager" containerID="cri-o://cba58951ed8f97777242e8f4f3065a904368ca8ff449e950a599427bc8738eb9" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.871207 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="kube-rbac-proxy" containerID="cri-o://4eac292042724ce058ecf3b3134ad96463fdebf3203317509bf46fcd779646a3" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.879108 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.879438 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="manager" containerID="cri-o://d4f8428dd5414db367dbc67de16d8be669be1224a6cac81927bb2bca0fffddf4" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.879844 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="kube-rbac-proxy" containerID="cri-o://1316aab7df7fc6324fcd638c3657cb8a3cec872ebf05bdccec83727bb411875d" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.889034 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.889361 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="manager" containerID="cri-o://bf29ee92d59dd39d5692b2f21c812db3f86b966c2fcb5b007de6ea3da2fbb791" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.889855 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="kube-rbac-proxy" containerID="cri-o://f3b9261a14c0c306233cca1c21257862ceabd1789ed170ed4f8d708155596af6" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.896604 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.896978 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="manager" containerID="cri-o://0e06f8a29ffe2d8596643312ae610a1cf815694f75382219618ad21413838164" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.897159 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="kube-rbac-proxy" containerID="cri-o://21da28b118326d5395e720618736da04fed81b4879e718b60cfe4709588e759f" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.903169 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.903563 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="kube-rbac-proxy" containerID="cri-o://a61b429862ef2a8daa1141a25b2ea4b51ff4c0daf48fdc7fa3fc2c8c4da6810c" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.903846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="manager" containerID="cri-o://42f881e43dc736f6bf238d9cfa131e449db41847556c165bb59a9f0e9a1e875e" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.910926 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/test-operator-controller-manager-8464cf66df-rlz94"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.911387 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="manager" containerID="cri-o://8aafeae1041add0e486c419c7fd17c32af98840183d02cc9979704f665626ead" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.911560 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="kube-rbac-proxy" containerID="cri-o://c26f7c9aa2914a8f6801fd98ac42edb8bbc0471d7738942c92027ebbb3ff6c98" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.921322 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.921657 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="manager" containerID="cri-o://e346bbc29cbe0559ebb51dd5a671c10b450ece5a9b11c62a20934e8159facf50" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.921835 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="kube-rbac-proxy" containerID="cri-o://8073ebd1c6b07e27a697d597db234cfc37862d83735a37077713855ed3811e0a" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.925883 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.926563 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="kube-rbac-proxy" containerID="cri-o://4302ed47c9a6350e7222fbd12311f7b707b9713cd07f2dc2f854b1fb08478cc9" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.926778 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="manager" containerID="cri-o://b6aff44fb28d02f6fc1817970a17b9ded2f2579fbd8c4fca71b7fb1357cc4255" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.932210 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.932477 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="manager" containerID="cri-o://9c3cc17a5c6e3a2e9193f2093c15f4de540b0b1cd9ea2087e6c8eb886ba175c3" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.932624 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="kube-rbac-proxy" containerID="cri-o://77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.943475 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.943805 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="manager" containerID="cri-o://3620ff9f616e0a12fef6dc00e7e0cc4df886f9ed2c4fff0f46cb8954dc0feb81" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.946541 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="kube-rbac-proxy" containerID="cri-o://9b538ada4b5e7656a174202cd35d4e50b7aad3730cbd8213daffe1d65d635877" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.958288 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.958534 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="kube-rbac-proxy" containerID="cri-o://1217b335749f9401e86fb4f1c162afd849feaa1f8e55cb7cab3479bab48fe16d" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.958640 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="manager" containerID="cri-o://9754745f9a00287fa86e89b74e0e2566fa28c15d4fbe9ffbb4ff59569b381ed7" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.964157 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.965233 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="kube-rbac-proxy" containerID="cri-o://c3bd0e428c0efbb264a317c62d1f2b9b26e235d1f3658b2cd045af505d8561a5" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.965531 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="manager" containerID="cri-o://664f44399e6c5308e54048bd384ad3d2f66fb021e2fe3a72d410af31bdc50a4e" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.969196 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.969403 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" containerName="operator" containerID="cri-o://bbe0e4466cfd8b3bdd075f4f164368b6a29c6dda6a76ee68499d29adcc3d7a27" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.977735 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.978454 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="manager" containerID="cri-o://7bbd995fe48422294a34544184d6dff7dcb9cb328b3addf52269afa18a42a330" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.978883 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="kube-rbac-proxy" containerID="cri-o://05e828f53e4434f6884067d1fc85e9d9f85822183babf29cc9f029da2e568e8c" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.983988 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.984871 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="manager" containerID="cri-o://9c02c139770ec2d26051b4aa5f27e890cd157c667ac3935ab804dd292a5deae9" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.985050 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="kube-rbac-proxy" containerID="cri-o://5facb6143fa98ce5583569e3b26176ecbbfe8467c6dee1738d0b29b8dd1b7b32" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.989851 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8"] Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.990034 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="kube-rbac-proxy" containerID="cri-o://465af80035a015eb6e543fbd5be14d8295a5281dc24073b5fd78db8705568160" gracePeriod=10 Nov 21 13:45:07 crc kubenswrapper[4769]: I1121 13:45:07.990140 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="manager" containerID="cri-o://a521933d00da2ecf0a7d7df2dbf6c8982eb4d2672a060bd2efc800d8bedd39c2" gracePeriod=10 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.481277 4769 generic.go:334] "Generic (PLEG): container finished" podID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerID="a521933d00da2ecf0a7d7df2dbf6c8982eb4d2672a060bd2efc800d8bedd39c2" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.481592 4769 generic.go:334] "Generic (PLEG): container finished" podID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerID="465af80035a015eb6e543fbd5be14d8295a5281dc24073b5fd78db8705568160" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.481640 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" event={"ID":"ebaca59c-611f-4c55-85df-3a788dab93d2","Type":"ContainerDied","Data":"a521933d00da2ecf0a7d7df2dbf6c8982eb4d2672a060bd2efc800d8bedd39c2"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.481668 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" event={"ID":"ebaca59c-611f-4c55-85df-3a788dab93d2","Type":"ContainerDied","Data":"465af80035a015eb6e543fbd5be14d8295a5281dc24073b5fd78db8705568160"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.491737 4769 generic.go:334] "Generic (PLEG): container finished" podID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerID="f3b9261a14c0c306233cca1c21257862ceabd1789ed170ed4f8d708155596af6" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.491765 4769 generic.go:334] "Generic (PLEG): container finished" podID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerID="bf29ee92d59dd39d5692b2f21c812db3f86b966c2fcb5b007de6ea3da2fbb791" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.491806 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" event={"ID":"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd","Type":"ContainerDied","Data":"f3b9261a14c0c306233cca1c21257862ceabd1789ed170ed4f8d708155596af6"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.491832 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" event={"ID":"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd","Type":"ContainerDied","Data":"bf29ee92d59dd39d5692b2f21c812db3f86b966c2fcb5b007de6ea3da2fbb791"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.516892 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb"] Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.517101 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="operator" containerID="cri-o://d9fd678815071ac1384473e06fe9926758e3f035627a5575e93a09b4890a131e" gracePeriod=10 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.517522 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="kube-rbac-proxy" containerID="cri-o://e0e9cea61b7b998373f3b4bb0e0d47e3eb867d8e2daeca55ef6edf1eeff4a124" gracePeriod=10 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.537351 4769 generic.go:334] "Generic (PLEG): container finished" podID="300d1793-527a-4e93-8753-460f9390a9f0" containerID="5facb6143fa98ce5583569e3b26176ecbbfe8467c6dee1738d0b29b8dd1b7b32" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.537382 4769 generic.go:334] "Generic (PLEG): container finished" podID="300d1793-527a-4e93-8753-460f9390a9f0" containerID="9c02c139770ec2d26051b4aa5f27e890cd157c667ac3935ab804dd292a5deae9" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.537434 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" event={"ID":"300d1793-527a-4e93-8753-460f9390a9f0","Type":"ContainerDied","Data":"5facb6143fa98ce5583569e3b26176ecbbfe8467c6dee1738d0b29b8dd1b7b32"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.537459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" event={"ID":"300d1793-527a-4e93-8753-460f9390a9f0","Type":"ContainerDied","Data":"9c02c139770ec2d26051b4aa5f27e890cd157c667ac3935ab804dd292a5deae9"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.583158 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-ttf49"] Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.583367 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-index-ttf49" podUID="848e8062-b068-4fc7-9b2b-092937683caa" containerName="registry-server" containerID="cri-o://2cf033c69500dfbcfb5b9cbab0acb3e0f4718409f87cf757654b7991228fcc62" gracePeriod=30 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.588349 4769 generic.go:334] "Generic (PLEG): container finished" podID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerID="bc53fca0eca528cea270c1e119736ca93e18ca8fd4227514f717fd0de44d1f58" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.588380 4769 generic.go:334] "Generic (PLEG): container finished" podID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerID="495665c86c27acc6143afe39073e804f682726439e71e688495d915ce8911500" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.588418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" event={"ID":"7da40971-cf3f-40a1-b8ca-cccc0b21c801","Type":"ContainerDied","Data":"bc53fca0eca528cea270c1e119736ca93e18ca8fd4227514f717fd0de44d1f58"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.588444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" event={"ID":"7da40971-cf3f-40a1-b8ca-cccc0b21c801","Type":"ContainerDied","Data":"495665c86c27acc6143afe39073e804f682726439e71e688495d915ce8911500"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.594433 4769 generic.go:334] "Generic (PLEG): container finished" podID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerID="ecac01db0828cac6541f262c83e55c1e7a591f42926cc3ec8ebef9b8b227faa5" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.594459 4769 generic.go:334] "Generic (PLEG): container finished" podID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerID="5c8347a693dfa211efed9bbe4b780160870ba4380606caa9ce739f6bb65e1b03" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.594493 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" event={"ID":"0bc3144e-ffee-4056-960b-c0144d0f0a14","Type":"ContainerDied","Data":"ecac01db0828cac6541f262c83e55c1e7a591f42926cc3ec8ebef9b8b227faa5"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.594514 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" event={"ID":"0bc3144e-ffee-4056-960b-c0144d0f0a14","Type":"ContainerDied","Data":"5c8347a693dfa211efed9bbe4b780160870ba4380606caa9ce739f6bb65e1b03"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.598153 4769 generic.go:334] "Generic (PLEG): container finished" podID="c947192b-fa60-475c-8485-d5b89b68db04" containerID="21da28b118326d5395e720618736da04fed81b4879e718b60cfe4709588e759f" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.598183 4769 generic.go:334] "Generic (PLEG): container finished" podID="c947192b-fa60-475c-8485-d5b89b68db04" containerID="0e06f8a29ffe2d8596643312ae610a1cf815694f75382219618ad21413838164" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.598231 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" event={"ID":"c947192b-fa60-475c-8485-d5b89b68db04","Type":"ContainerDied","Data":"21da28b118326d5395e720618736da04fed81b4879e718b60cfe4709588e759f"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.598255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" event={"ID":"c947192b-fa60-475c-8485-d5b89b68db04","Type":"ContainerDied","Data":"0e06f8a29ffe2d8596643312ae610a1cf815694f75382219618ad21413838164"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.600653 4769 generic.go:334] "Generic (PLEG): container finished" podID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerID="05e828f53e4434f6884067d1fc85e9d9f85822183babf29cc9f029da2e568e8c" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.600676 4769 generic.go:334] "Generic (PLEG): container finished" podID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerID="7bbd995fe48422294a34544184d6dff7dcb9cb328b3addf52269afa18a42a330" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.600707 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" event={"ID":"e4ba6f52-4d8e-4337-bff6-83de22056bf2","Type":"ContainerDied","Data":"05e828f53e4434f6884067d1fc85e9d9f85822183babf29cc9f029da2e568e8c"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.600725 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" event={"ID":"e4ba6f52-4d8e-4337-bff6-83de22056bf2","Type":"ContainerDied","Data":"7bbd995fe48422294a34544184d6dff7dcb9cb328b3addf52269afa18a42a330"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.624459 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c4b5619-0a5f-4363-985d-99182730024d" containerID="7ab81a190f7145ab19be918722a255c3e182600639baf55f41cb667365a8162a" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.624505 4769 generic.go:334] "Generic (PLEG): container finished" podID="5c4b5619-0a5f-4363-985d-99182730024d" containerID="478fb18fc3332ba4f29b0d6b5fcd459e36b484739473c376efd5a28b520e4044" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.624551 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" event={"ID":"5c4b5619-0a5f-4363-985d-99182730024d","Type":"ContainerDied","Data":"7ab81a190f7145ab19be918722a255c3e182600639baf55f41cb667365a8162a"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.624580 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" event={"ID":"5c4b5619-0a5f-4363-985d-99182730024d","Type":"ContainerDied","Data":"478fb18fc3332ba4f29b0d6b5fcd459e36b484739473c376efd5a28b520e4044"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.639537 4769 generic.go:334] "Generic (PLEG): container finished" podID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerID="77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.639565 4769 generic.go:334] "Generic (PLEG): container finished" podID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerID="9c3cc17a5c6e3a2e9193f2093c15f4de540b0b1cd9ea2087e6c8eb886ba175c3" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.639610 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd"] Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.639632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" event={"ID":"884af2cd-b59a-4583-818e-f6ff7b8b4fc7","Type":"ContainerDied","Data":"77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.639650 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" event={"ID":"884af2cd-b59a-4583-818e-f6ff7b8b4fc7","Type":"ContainerDied","Data":"9c3cc17a5c6e3a2e9193f2093c15f4de540b0b1cd9ea2087e6c8eb886ba175c3"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.661220 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/2f600d40645c3b5d5826f2c9954a3807468e61602beafe19f4b735f42ddrvmd"] Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.689462 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1424001-64e8-4892-b403-4284096261ba" containerID="c26f7c9aa2914a8f6801fd98ac42edb8bbc0471d7738942c92027ebbb3ff6c98" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.689495 4769 generic.go:334] "Generic (PLEG): container finished" podID="b1424001-64e8-4892-b403-4284096261ba" containerID="8aafeae1041add0e486c419c7fd17c32af98840183d02cc9979704f665626ead" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.689558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" event={"ID":"b1424001-64e8-4892-b403-4284096261ba","Type":"ContainerDied","Data":"c26f7c9aa2914a8f6801fd98ac42edb8bbc0471d7738942c92027ebbb3ff6c98"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.689585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" event={"ID":"b1424001-64e8-4892-b403-4284096261ba","Type":"ContainerDied","Data":"8aafeae1041add0e486c419c7fd17c32af98840183d02cc9979704f665626ead"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.702594 4769 generic.go:334] "Generic (PLEG): container finished" podID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerID="9b538ada4b5e7656a174202cd35d4e50b7aad3730cbd8213daffe1d65d635877" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.702632 4769 generic.go:334] "Generic (PLEG): container finished" podID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerID="3620ff9f616e0a12fef6dc00e7e0cc4df886f9ed2c4fff0f46cb8954dc0feb81" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.702667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" event={"ID":"73a1d48f-8d98-4b78-bac7-00e1ffa04b82","Type":"ContainerDied","Data":"9b538ada4b5e7656a174202cd35d4e50b7aad3730cbd8213daffe1d65d635877"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.702692 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" event={"ID":"73a1d48f-8d98-4b78-bac7-00e1ffa04b82","Type":"ContainerDied","Data":"3620ff9f616e0a12fef6dc00e7e0cc4df886f9ed2c4fff0f46cb8954dc0feb81"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.705770 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerID="4302ed47c9a6350e7222fbd12311f7b707b9713cd07f2dc2f854b1fb08478cc9" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.705814 4769 generic.go:334] "Generic (PLEG): container finished" podID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerID="b6aff44fb28d02f6fc1817970a17b9ded2f2579fbd8c4fca71b7fb1357cc4255" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.705860 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" event={"ID":"3c4f2848-d13a-4646-bd9c-cf691f1c1099","Type":"ContainerDied","Data":"4302ed47c9a6350e7222fbd12311f7b707b9713cd07f2dc2f854b1fb08478cc9"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.705882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" event={"ID":"3c4f2848-d13a-4646-bd9c-cf691f1c1099","Type":"ContainerDied","Data":"b6aff44fb28d02f6fc1817970a17b9ded2f2579fbd8c4fca71b7fb1357cc4255"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.710367 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerID="9754745f9a00287fa86e89b74e0e2566fa28c15d4fbe9ffbb4ff59569b381ed7" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.710398 4769 generic.go:334] "Generic (PLEG): container finished" podID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerID="1217b335749f9401e86fb4f1c162afd849feaa1f8e55cb7cab3479bab48fe16d" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.710433 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" event={"ID":"3d74755b-a923-42e2-b1cb-f68b956325f8","Type":"ContainerDied","Data":"9754745f9a00287fa86e89b74e0e2566fa28c15d4fbe9ffbb4ff59569b381ed7"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.710460 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" event={"ID":"3d74755b-a923-42e2-b1cb-f68b956325f8","Type":"ContainerDied","Data":"1217b335749f9401e86fb4f1c162afd849feaa1f8e55cb7cab3479bab48fe16d"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.713971 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerID="c3dccda292760178da96b95423da3f0986bed4c9b7cc165579e3b87ea035c99c" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.713999 4769 generic.go:334] "Generic (PLEG): container finished" podID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerID="db28119909fa7b28c44812d7184901321e739f42d3230070a418722047a5bdf3" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.714034 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" event={"ID":"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f","Type":"ContainerDied","Data":"c3dccda292760178da96b95423da3f0986bed4c9b7cc165579e3b87ea035c99c"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.714059 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" event={"ID":"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f","Type":"ContainerDied","Data":"db28119909fa7b28c44812d7184901321e739f42d3230070a418722047a5bdf3"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.715351 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerID="bf5a6c30d09e75eb03f2720daf0cbda1be4c561977c7b3cdfe4809428a9b34de" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.715364 4769 generic.go:334] "Generic (PLEG): container finished" podID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerID="8d868e6a04fc23686196f3767dd9ad9ef9a278e8d8f934e18f5d16b1d5cc06f3" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.715393 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" event={"ID":"6bbca42b-c781-4106-851f-ab9bb4fac793","Type":"ContainerDied","Data":"bf5a6c30d09e75eb03f2720daf0cbda1be4c561977c7b3cdfe4809428a9b34de"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.715407 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" event={"ID":"6bbca42b-c781-4106-851f-ab9bb4fac793","Type":"ContainerDied","Data":"8d868e6a04fc23686196f3767dd9ad9ef9a278e8d8f934e18f5d16b1d5cc06f3"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.717754 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerID="bd46dd8c9731a36be3f0e9694dbe037636ce2ea5c0d064b7f4c047b06f2d416c" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.717780 4769 generic.go:334] "Generic (PLEG): container finished" podID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerID="7fbc88a3b3c1936b9597119e2724b5f6bc70cc4472a304dfb9f35650fd3611df" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.717811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" event={"ID":"ca12a419-f80c-4f1c-8f23-1f72e4e07121","Type":"ContainerDied","Data":"bd46dd8c9731a36be3f0e9694dbe037636ce2ea5c0d064b7f4c047b06f2d416c"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.717830 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" event={"ID":"ca12a419-f80c-4f1c-8f23-1f72e4e07121","Type":"ContainerDied","Data":"7fbc88a3b3c1936b9597119e2724b5f6bc70cc4472a304dfb9f35650fd3611df"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.726762 4769 generic.go:334] "Generic (PLEG): container finished" podID="5244ed83-c201-493d-9c35-20102cd07696" containerID="8073ebd1c6b07e27a697d597db234cfc37862d83735a37077713855ed3811e0a" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.726794 4769 generic.go:334] "Generic (PLEG): container finished" podID="5244ed83-c201-493d-9c35-20102cd07696" containerID="e346bbc29cbe0559ebb51dd5a671c10b450ece5a9b11c62a20934e8159facf50" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.726833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" event={"ID":"5244ed83-c201-493d-9c35-20102cd07696","Type":"ContainerDied","Data":"8073ebd1c6b07e27a697d597db234cfc37862d83735a37077713855ed3811e0a"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.726859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" event={"ID":"5244ed83-c201-493d-9c35-20102cd07696","Type":"ContainerDied","Data":"e346bbc29cbe0559ebb51dd5a671c10b450ece5a9b11c62a20934e8159facf50"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.730835 4769 generic.go:334] "Generic (PLEG): container finished" podID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerID="c3bd0e428c0efbb264a317c62d1f2b9b26e235d1f3658b2cd045af505d8561a5" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.730870 4769 generic.go:334] "Generic (PLEG): container finished" podID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerID="664f44399e6c5308e54048bd384ad3d2f66fb021e2fe3a72d410af31bdc50a4e" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.730908 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" event={"ID":"bcf991ab-cf17-4dfe-89ca-364c2361278d","Type":"ContainerDied","Data":"c3bd0e428c0efbb264a317c62d1f2b9b26e235d1f3658b2cd045af505d8561a5"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.730931 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" event={"ID":"bcf991ab-cf17-4dfe-89ca-364c2361278d","Type":"ContainerDied","Data":"664f44399e6c5308e54048bd384ad3d2f66fb021e2fe3a72d410af31bdc50a4e"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.735847 4769 generic.go:334] "Generic (PLEG): container finished" podID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerID="4eac292042724ce058ecf3b3134ad96463fdebf3203317509bf46fcd779646a3" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.735877 4769 generic.go:334] "Generic (PLEG): container finished" podID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerID="cba58951ed8f97777242e8f4f3065a904368ca8ff449e950a599427bc8738eb9" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.735913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" event={"ID":"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58","Type":"ContainerDied","Data":"4eac292042724ce058ecf3b3134ad96463fdebf3203317509bf46fcd779646a3"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.735939 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" event={"ID":"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58","Type":"ContainerDied","Data":"cba58951ed8f97777242e8f4f3065a904368ca8ff449e950a599427bc8738eb9"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.740743 4769 generic.go:334] "Generic (PLEG): container finished" podID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" containerID="bbe0e4466cfd8b3bdd075f4f164368b6a29c6dda6a76ee68499d29adcc3d7a27" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.740810 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" event={"ID":"5f0da7e0-0d50-4ec6-8320-a1994e79e38c","Type":"ContainerDied","Data":"bbe0e4466cfd8b3bdd075f4f164368b6a29c6dda6a76ee68499d29adcc3d7a27"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.757551 4769 generic.go:334] "Generic (PLEG): container finished" podID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerID="42f881e43dc736f6bf238d9cfa131e449db41847556c165bb59a9f0e9a1e875e" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.757577 4769 generic.go:334] "Generic (PLEG): container finished" podID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerID="a61b429862ef2a8daa1141a25b2ea4b51ff4c0daf48fdc7fa3fc2c8c4da6810c" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.757623 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" event={"ID":"48bcc67d-6c8c-49c5-8b60-1ed8a583c885","Type":"ContainerDied","Data":"42f881e43dc736f6bf238d9cfa131e449db41847556c165bb59a9f0e9a1e875e"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.757646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" event={"ID":"48bcc67d-6c8c-49c5-8b60-1ed8a583c885","Type":"ContainerDied","Data":"a61b429862ef2a8daa1141a25b2ea4b51ff4c0daf48fdc7fa3fc2c8c4da6810c"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.761668 4769 generic.go:334] "Generic (PLEG): container finished" podID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerID="1316aab7df7fc6324fcd638c3657cb8a3cec872ebf05bdccec83727bb411875d" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.761704 4769 generic.go:334] "Generic (PLEG): container finished" podID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerID="d4f8428dd5414db367dbc67de16d8be669be1224a6cac81927bb2bca0fffddf4" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.761757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" event={"ID":"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3","Type":"ContainerDied","Data":"1316aab7df7fc6324fcd638c3657cb8a3cec872ebf05bdccec83727bb411875d"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.761787 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" event={"ID":"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3","Type":"ContainerDied","Data":"d4f8428dd5414db367dbc67de16d8be669be1224a6cac81927bb2bca0fffddf4"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.765636 4769 generic.go:334] "Generic (PLEG): container finished" podID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerID="ee6015ca258ee6b5ce1301776f76cd081fabad0d139968bc670160748d442344" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.765659 4769 generic.go:334] "Generic (PLEG): container finished" podID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerID="149bcf102175b79f59006c0a114f30b2078eeba9534f17f7826903ff09f663e3" exitCode=0 Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.766461 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" event={"ID":"f769fe9e-e5a5-4954-9d27-6786c130674d","Type":"ContainerDied","Data":"ee6015ca258ee6b5ce1301776f76cd081fabad0d139968bc670160748d442344"} Nov 21 13:45:08 crc kubenswrapper[4769]: I1121 13:45:08.766484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" event={"ID":"f769fe9e-e5a5-4954-9d27-6786c130674d","Type":"ContainerDied","Data":"149bcf102175b79f59006c0a114f30b2078eeba9534f17f7826903ff09f663e3"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.301920 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966766ef-ada6-45ba-b284-0b92bf3ee41a" path="/var/lib/kubelet/pods/966766ef-ada6-45ba-b284-0b92bf3ee41a/volumes" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.773656 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" event={"ID":"f769fe9e-e5a5-4954-9d27-6786c130674d","Type":"ContainerDied","Data":"e9552a0e4ef5e64a69da57cd6a769a7f675326c29224ac57f4db6e49fe21e94d"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.773703 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9552a0e4ef5e64a69da57cd6a769a7f675326c29224ac57f4db6e49fe21e94d" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.774977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" event={"ID":"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58","Type":"ContainerDied","Data":"3b888839a1462b890fc784ec6fa2770736b6c3e735792b61a1c4d41aed83ba47"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.775025 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b888839a1462b890fc784ec6fa2770736b6c3e735792b61a1c4d41aed83ba47" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.776390 4769 generic.go:334] "Generic (PLEG): container finished" podID="cad6c628-2097-4624-838e-1ebc9683235e" containerID="e0e9cea61b7b998373f3b4bb0e0d47e3eb867d8e2daeca55ef6edf1eeff4a124" exitCode=0 Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.776409 4769 generic.go:334] "Generic (PLEG): container finished" podID="cad6c628-2097-4624-838e-1ebc9683235e" containerID="d9fd678815071ac1384473e06fe9926758e3f035627a5575e93a09b4890a131e" exitCode=0 Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.776448 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" event={"ID":"cad6c628-2097-4624-838e-1ebc9683235e","Type":"ContainerDied","Data":"e0e9cea61b7b998373f3b4bb0e0d47e3eb867d8e2daeca55ef6edf1eeff4a124"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.776472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" event={"ID":"cad6c628-2097-4624-838e-1ebc9683235e","Type":"ContainerDied","Data":"d9fd678815071ac1384473e06fe9926758e3f035627a5575e93a09b4890a131e"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.776482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" event={"ID":"cad6c628-2097-4624-838e-1ebc9683235e","Type":"ContainerDied","Data":"82182d682aab90b0ba2e2f7d55caa591186dbae57beb8ea88f6fa2ad0882686d"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.776491 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82182d682aab90b0ba2e2f7d55caa591186dbae57beb8ea88f6fa2ad0882686d" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.777844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" event={"ID":"73a1d48f-8d98-4b78-bac7-00e1ffa04b82","Type":"ContainerDied","Data":"6a96a338911c595b04b7bd6ff384471b198388bfcfd1028a05b04956e0ecc39e"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.777882 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a96a338911c595b04b7bd6ff384471b198388bfcfd1028a05b04956e0ecc39e" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.779816 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" event={"ID":"ca12a419-f80c-4f1c-8f23-1f72e4e07121","Type":"ContainerDied","Data":"95e66c9e456247ef90f53adbb5e068b8b65670d67541c7b05f3f455587130ccc"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.779848 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95e66c9e456247ef90f53adbb5e068b8b65670d67541c7b05f3f455587130ccc" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.781364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" event={"ID":"0bc3144e-ffee-4056-960b-c0144d0f0a14","Type":"ContainerDied","Data":"6e339a2d762f69a8bb4d30a69615431904f2f9f51e1cfa61ba848ab732e2feba"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.781398 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e339a2d762f69a8bb4d30a69615431904f2f9f51e1cfa61ba848ab732e2feba" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.786709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" event={"ID":"e4ba6f52-4d8e-4337-bff6-83de22056bf2","Type":"ContainerDied","Data":"b13e0736069bb766813154f7ce8d8d6bf051feb7bc8e2206b6e2a99e9f20c771"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.786756 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b13e0736069bb766813154f7ce8d8d6bf051feb7bc8e2206b6e2a99e9f20c771" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.789134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" event={"ID":"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f","Type":"ContainerDied","Data":"e2402847b0ca8adcd2fb7b7e5cda0034428c562b0bc967f89e086a96607d0d8a"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.789160 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2402847b0ca8adcd2fb7b7e5cda0034428c562b0bc967f89e086a96607d0d8a" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.790893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" event={"ID":"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3","Type":"ContainerDied","Data":"d190098b8fc7ece72c7c76c80c6fe9eafdb831110056b10a1aff49f2db198cfb"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.790921 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d190098b8fc7ece72c7c76c80c6fe9eafdb831110056b10a1aff49f2db198cfb" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.792360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" event={"ID":"ebaca59c-611f-4c55-85df-3a788dab93d2","Type":"ContainerDied","Data":"2add25ed4529f10f701e44cf5aaa5312870718e052f75bfb159a46f81f38d743"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.792379 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2add25ed4529f10f701e44cf5aaa5312870718e052f75bfb159a46f81f38d743" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.794267 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" event={"ID":"6bbca42b-c781-4106-851f-ab9bb4fac793","Type":"ContainerDied","Data":"2123761f3a313d5890b2bacb33da3c7b0b0d9a5d48c9fe8e6b61c1e90b291261"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.794294 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2123761f3a313d5890b2bacb33da3c7b0b0d9a5d48c9fe8e6b61c1e90b291261" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.796660 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" event={"ID":"300d1793-527a-4e93-8753-460f9390a9f0","Type":"ContainerDied","Data":"96113baa6e8ad68cf8b367c4088feff397d9e446eeb936a3f882360ca35dddc9"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.796733 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96113baa6e8ad68cf8b367c4088feff397d9e446eeb936a3f882360ca35dddc9" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.799225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" event={"ID":"c947192b-fa60-475c-8485-d5b89b68db04","Type":"ContainerDied","Data":"b94d54ca5e6667b5c68473b24ae71d64ff2453c3976d55ad0b0e8fc8e9c99a10"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.799255 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b94d54ca5e6667b5c68473b24ae71d64ff2453c3976d55ad0b0e8fc8e9c99a10" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.802533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" event={"ID":"5c4b5619-0a5f-4363-985d-99182730024d","Type":"ContainerDied","Data":"8603dd0aabd68ac237e32ad20d82800289629528fbbb6e8df61c0d5857fd54a0"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.802565 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8603dd0aabd68ac237e32ad20d82800289629528fbbb6e8df61c0d5857fd54a0" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.804501 4769 generic.go:334] "Generic (PLEG): container finished" podID="848e8062-b068-4fc7-9b2b-092937683caa" containerID="2cf033c69500dfbcfb5b9cbab0acb3e0f4718409f87cf757654b7991228fcc62" exitCode=0 Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.804561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ttf49" event={"ID":"848e8062-b068-4fc7-9b2b-092937683caa","Type":"ContainerDied","Data":"2cf033c69500dfbcfb5b9cbab0acb3e0f4718409f87cf757654b7991228fcc62"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.804585 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ttf49" event={"ID":"848e8062-b068-4fc7-9b2b-092937683caa","Type":"ContainerDied","Data":"0bfaae16f16e5301628b78d891d37234aaef14a91c117e8b84d652fb01f97c6d"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.804595 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bfaae16f16e5301628b78d891d37234aaef14a91c117e8b84d652fb01f97c6d" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.806527 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" event={"ID":"7da40971-cf3f-40a1-b8ca-cccc0b21c801","Type":"ContainerDied","Data":"a600a30b94a103520335d88d570978002880f655d9e55b6b06912fac217d9814"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.806558 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a600a30b94a103520335d88d570978002880f655d9e55b6b06912fac217d9814" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.808480 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" event={"ID":"bcf991ab-cf17-4dfe-89ca-364c2361278d","Type":"ContainerDied","Data":"e74014ea487ee86673e8b5135ad0babe1807becd0239b14258d9d33678b51ea4"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.808510 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e74014ea487ee86673e8b5135ad0babe1807becd0239b14258d9d33678b51ea4" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.810177 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" event={"ID":"3c4f2848-d13a-4646-bd9c-cf691f1c1099","Type":"ContainerDied","Data":"81e7e0a297656e5647f40a075d937c40fb15aa2e18ea7c6247252d858ae9fe55"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.810229 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e7e0a297656e5647f40a075d937c40fb15aa2e18ea7c6247252d858ae9fe55" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.811605 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" event={"ID":"3d74755b-a923-42e2-b1cb-f68b956325f8","Type":"ContainerDied","Data":"6f8fc26313373b9ec84c5c9f891ae65b11b9fdea3179bff701519bbc82030b5f"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.811626 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f8fc26313373b9ec84c5c9f891ae65b11b9fdea3179bff701519bbc82030b5f" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.813061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" event={"ID":"884af2cd-b59a-4583-818e-f6ff7b8b4fc7","Type":"ContainerDied","Data":"5f8c3ca69948491aab4e8941188a80eef0c469e9e6e13194d5982543b83c9533"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.813094 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f8c3ca69948491aab4e8941188a80eef0c469e9e6e13194d5982543b83c9533" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.814359 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" event={"ID":"5f0da7e0-0d50-4ec6-8320-a1994e79e38c","Type":"ContainerDied","Data":"f4e59008b3c2d22df1d1fbdc43bc2c55c64d875623f1d1fe5e425752f5278eb1"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.814385 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4e59008b3c2d22df1d1fbdc43bc2c55c64d875623f1d1fe5e425752f5278eb1" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.816332 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" event={"ID":"48bcc67d-6c8c-49c5-8b60-1ed8a583c885","Type":"ContainerDied","Data":"156b3d183f6f293bc526a565b6d8298e57a8bbc458e9a93ec5aa2c127fdff83f"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.816375 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="156b3d183f6f293bc526a565b6d8298e57a8bbc458e9a93ec5aa2c127fdff83f" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.819365 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" event={"ID":"b1424001-64e8-4892-b403-4284096261ba","Type":"ContainerDied","Data":"9cc7c6a214f57c6e9ac68ddd9b93c327aef383bb1a40b0328bf7aa2310a35707"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.819411 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cc7c6a214f57c6e9ac68ddd9b93c327aef383bb1a40b0328bf7aa2310a35707" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.822703 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" event={"ID":"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd","Type":"ContainerDied","Data":"b32d5986523c3c37e75df8cf80f170da6d7dbbc3d5ee70fb338680142c832500"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.822733 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b32d5986523c3c37e75df8cf80f170da6d7dbbc3d5ee70fb338680142c832500" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.825727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" event={"ID":"5244ed83-c201-493d-9c35-20102cd07696","Type":"ContainerDied","Data":"791e51714a4f4d6368d7fe980e51607dbbc94a40076fd9802b5d8f2279df384d"} Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.825761 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="791e51714a4f4d6368d7fe980e51607dbbc94a40076fd9802b5d8f2279df384d" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.856085 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.867094 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.877723 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.897794 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.907926 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.916219 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.920686 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert\") pod \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.920744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdmhr\" (UniqueName: \"kubernetes.io/projected/ca12a419-f80c-4f1c-8f23-1f72e4e07121-kube-api-access-xdmhr\") pod \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\" (UID: \"ca12a419-f80c-4f1c-8f23-1f72e4e07121\") " Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.920776 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") pod \"5c4b5619-0a5f-4363-985d-99182730024d\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.920941 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mqm4\" (UniqueName: \"kubernetes.io/projected/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58-kube-api-access-7mqm4\") pod \"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58\" (UID: \"62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58\") " Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.921068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-247bs\" (UniqueName: \"kubernetes.io/projected/5c4b5619-0a5f-4363-985d-99182730024d-kube-api-access-247bs\") pod \"5c4b5619-0a5f-4363-985d-99182730024d\" (UID: \"5c4b5619-0a5f-4363-985d-99182730024d\") " Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.933479 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58-kube-api-access-7mqm4" (OuterVolumeSpecName: "kube-api-access-7mqm4") pod "62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" (UID: "62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58"). InnerVolumeSpecName "kube-api-access-7mqm4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.933560 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4b5619-0a5f-4363-985d-99182730024d-kube-api-access-247bs" (OuterVolumeSpecName: "kube-api-access-247bs") pod "5c4b5619-0a5f-4363-985d-99182730024d" (UID: "5c4b5619-0a5f-4363-985d-99182730024d"). InnerVolumeSpecName "kube-api-access-247bs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.934346 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca12a419-f80c-4f1c-8f23-1f72e4e07121-kube-api-access-xdmhr" (OuterVolumeSpecName: "kube-api-access-xdmhr") pod "ca12a419-f80c-4f1c-8f23-1f72e4e07121" (UID: "ca12a419-f80c-4f1c-8f23-1f72e4e07121"). InnerVolumeSpecName "kube-api-access-xdmhr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.936122 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert" (OuterVolumeSpecName: "cert") pod "5c4b5619-0a5f-4363-985d-99182730024d" (UID: "5c4b5619-0a5f-4363-985d-99182730024d"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.937117 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.938866 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert" (OuterVolumeSpecName: "cert") pod "ca12a419-f80c-4f1c-8f23-1f72e4e07121" (UID: "ca12a419-f80c-4f1c-8f23-1f72e4e07121"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.946685 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.947120 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.960110 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.969912 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.978170 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 13:45:09 crc kubenswrapper[4769]: I1121 13:45:09.995641 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.003966 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.011209 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.020708 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.025756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49hk4\" (UniqueName: \"kubernetes.io/projected/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd-kube-api-access-49hk4\") pod \"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd\" (UID: \"fec807b0-ab6b-4c9d-9c06-efb27c7c75dd\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.025808 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xknhk\" (UniqueName: \"kubernetes.io/projected/f769fe9e-e5a5-4954-9d27-6786c130674d-kube-api-access-xknhk\") pod \"f769fe9e-e5a5-4954-9d27-6786c130674d\" (UID: \"f769fe9e-e5a5-4954-9d27-6786c130674d\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.025838 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbpjr\" (UniqueName: \"kubernetes.io/projected/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3-kube-api-access-tbpjr\") pod \"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3\" (UID: \"b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.026334 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnk85\" (UniqueName: \"kubernetes.io/projected/73a1d48f-8d98-4b78-bac7-00e1ffa04b82-kube-api-access-qnk85\") pod \"73a1d48f-8d98-4b78-bac7-00e1ffa04b82\" (UID: \"73a1d48f-8d98-4b78-bac7-00e1ffa04b82\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.027629 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk8dt\" (UniqueName: \"kubernetes.io/projected/48bcc67d-6c8c-49c5-8b60-1ed8a583c885-kube-api-access-gk8dt\") pod \"48bcc67d-6c8c-49c5-8b60-1ed8a583c885\" (UID: \"48bcc67d-6c8c-49c5-8b60-1ed8a583c885\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.027660 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx9lm\" (UniqueName: \"kubernetes.io/projected/c947192b-fa60-475c-8485-d5b89b68db04-kube-api-access-cx9lm\") pod \"c947192b-fa60-475c-8485-d5b89b68db04\" (UID: \"c947192b-fa60-475c-8485-d5b89b68db04\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.027705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzvkl\" (UniqueName: \"kubernetes.io/projected/6bbca42b-c781-4106-851f-ab9bb4fac793-kube-api-access-qzvkl\") pod \"6bbca42b-c781-4106-851f-ab9bb4fac793\" (UID: \"6bbca42b-c781-4106-851f-ab9bb4fac793\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.027732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fk8m\" (UniqueName: \"kubernetes.io/projected/0bc3144e-ffee-4056-960b-c0144d0f0a14-kube-api-access-9fk8m\") pod \"0bc3144e-ffee-4056-960b-c0144d0f0a14\" (UID: \"0bc3144e-ffee-4056-960b-c0144d0f0a14\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.027757 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhlrk\" (UniqueName: \"kubernetes.io/projected/7da40971-cf3f-40a1-b8ca-cccc0b21c801-kube-api-access-xhlrk\") pod \"7da40971-cf3f-40a1-b8ca-cccc0b21c801\" (UID: \"7da40971-cf3f-40a1-b8ca-cccc0b21c801\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.028102 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7mqm4\" (UniqueName: \"kubernetes.io/projected/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58-kube-api-access-7mqm4\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.028127 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-247bs\" (UniqueName: \"kubernetes.io/projected/5c4b5619-0a5f-4363-985d-99182730024d-kube-api-access-247bs\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.028140 4769 reconciler_common.go:293] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca12a419-f80c-4f1c-8f23-1f72e4e07121-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.028155 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xdmhr\" (UniqueName: \"kubernetes.io/projected/ca12a419-f80c-4f1c-8f23-1f72e4e07121-kube-api-access-xdmhr\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.028166 4769 reconciler_common.go:293] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4b5619-0a5f-4363-985d-99182730024d-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.031247 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3-kube-api-access-tbpjr" (OuterVolumeSpecName: "kube-api-access-tbpjr") pod "b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" (UID: "b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3"). InnerVolumeSpecName "kube-api-access-tbpjr". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.031349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd-kube-api-access-49hk4" (OuterVolumeSpecName: "kube-api-access-49hk4") pod "fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" (UID: "fec807b0-ab6b-4c9d-9c06-efb27c7c75dd"). InnerVolumeSpecName "kube-api-access-49hk4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.032182 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48bcc67d-6c8c-49c5-8b60-1ed8a583c885-kube-api-access-gk8dt" (OuterVolumeSpecName: "kube-api-access-gk8dt") pod "48bcc67d-6c8c-49c5-8b60-1ed8a583c885" (UID: "48bcc67d-6c8c-49c5-8b60-1ed8a583c885"). InnerVolumeSpecName "kube-api-access-gk8dt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.034156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a1d48f-8d98-4b78-bac7-00e1ffa04b82-kube-api-access-qnk85" (OuterVolumeSpecName: "kube-api-access-qnk85") pod "73a1d48f-8d98-4b78-bac7-00e1ffa04b82" (UID: "73a1d48f-8d98-4b78-bac7-00e1ffa04b82"). InnerVolumeSpecName "kube-api-access-qnk85". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.035308 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bbca42b-c781-4106-851f-ab9bb4fac793-kube-api-access-qzvkl" (OuterVolumeSpecName: "kube-api-access-qzvkl") pod "6bbca42b-c781-4106-851f-ab9bb4fac793" (UID: "6bbca42b-c781-4106-851f-ab9bb4fac793"). InnerVolumeSpecName "kube-api-access-qzvkl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.035858 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.036666 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f769fe9e-e5a5-4954-9d27-6786c130674d-kube-api-access-xknhk" (OuterVolumeSpecName: "kube-api-access-xknhk") pod "f769fe9e-e5a5-4954-9d27-6786c130674d" (UID: "f769fe9e-e5a5-4954-9d27-6786c130674d"). InnerVolumeSpecName "kube-api-access-xknhk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.041147 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da40971-cf3f-40a1-b8ca-cccc0b21c801-kube-api-access-xhlrk" (OuterVolumeSpecName: "kube-api-access-xhlrk") pod "7da40971-cf3f-40a1-b8ca-cccc0b21c801" (UID: "7da40971-cf3f-40a1-b8ca-cccc0b21c801"). InnerVolumeSpecName "kube-api-access-xhlrk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.063372 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c947192b-fa60-475c-8485-d5b89b68db04-kube-api-access-cx9lm" (OuterVolumeSpecName: "kube-api-access-cx9lm") pod "c947192b-fa60-475c-8485-d5b89b68db04" (UID: "c947192b-fa60-475c-8485-d5b89b68db04"). InnerVolumeSpecName "kube-api-access-cx9lm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.074475 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc3144e-ffee-4056-960b-c0144d0f0a14-kube-api-access-9fk8m" (OuterVolumeSpecName: "kube-api-access-9fk8m") pod "0bc3144e-ffee-4056-960b-c0144d0f0a14" (UID: "0bc3144e-ffee-4056-960b-c0144d0f0a14"). InnerVolumeSpecName "kube-api-access-9fk8m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.098689 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.118467 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.128918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv48n\" (UniqueName: \"kubernetes.io/projected/3c4f2848-d13a-4646-bd9c-cf691f1c1099-kube-api-access-wv48n\") pod \"3c4f2848-d13a-4646-bd9c-cf691f1c1099\" (UID: \"3c4f2848-d13a-4646-bd9c-cf691f1c1099\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129002 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh7hz\" (UniqueName: \"kubernetes.io/projected/bcf991ab-cf17-4dfe-89ca-364c2361278d-kube-api-access-mh7hz\") pod \"bcf991ab-cf17-4dfe-89ca-364c2361278d\" (UID: \"bcf991ab-cf17-4dfe-89ca-364c2361278d\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xf6k\" (UniqueName: \"kubernetes.io/projected/5244ed83-c201-493d-9c35-20102cd07696-kube-api-access-7xf6k\") pod \"5244ed83-c201-493d-9c35-20102cd07696\" (UID: \"5244ed83-c201-493d-9c35-20102cd07696\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvlmj\" (UniqueName: \"kubernetes.io/projected/e4ba6f52-4d8e-4337-bff6-83de22056bf2-kube-api-access-xvlmj\") pod \"e4ba6f52-4d8e-4337-bff6-83de22056bf2\" (UID: \"e4ba6f52-4d8e-4337-bff6-83de22056bf2\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129168 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nv49\" (UniqueName: \"kubernetes.io/projected/884af2cd-b59a-4583-818e-f6ff7b8b4fc7-kube-api-access-7nv49\") pod \"884af2cd-b59a-4583-818e-f6ff7b8b4fc7\" (UID: \"884af2cd-b59a-4583-818e-f6ff7b8b4fc7\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129680 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gk8dt\" (UniqueName: \"kubernetes.io/projected/48bcc67d-6c8c-49c5-8b60-1ed8a583c885-kube-api-access-gk8dt\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129699 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cx9lm\" (UniqueName: \"kubernetes.io/projected/c947192b-fa60-475c-8485-d5b89b68db04-kube-api-access-cx9lm\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129713 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qzvkl\" (UniqueName: \"kubernetes.io/projected/6bbca42b-c781-4106-851f-ab9bb4fac793-kube-api-access-qzvkl\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129727 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9fk8m\" (UniqueName: \"kubernetes.io/projected/0bc3144e-ffee-4056-960b-c0144d0f0a14-kube-api-access-9fk8m\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129744 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xhlrk\" (UniqueName: \"kubernetes.io/projected/7da40971-cf3f-40a1-b8ca-cccc0b21c801-kube-api-access-xhlrk\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129756 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-49hk4\" (UniqueName: \"kubernetes.io/projected/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd-kube-api-access-49hk4\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129768 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xknhk\" (UniqueName: \"kubernetes.io/projected/f769fe9e-e5a5-4954-9d27-6786c130674d-kube-api-access-xknhk\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129780 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tbpjr\" (UniqueName: \"kubernetes.io/projected/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3-kube-api-access-tbpjr\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.129792 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qnk85\" (UniqueName: \"kubernetes.io/projected/73a1d48f-8d98-4b78-bac7-00e1ffa04b82-kube-api-access-qnk85\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.138149 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.156042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5244ed83-c201-493d-9c35-20102cd07696-kube-api-access-7xf6k" (OuterVolumeSpecName: "kube-api-access-7xf6k") pod "5244ed83-c201-493d-9c35-20102cd07696" (UID: "5244ed83-c201-493d-9c35-20102cd07696"). InnerVolumeSpecName "kube-api-access-7xf6k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.157633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4f2848-d13a-4646-bd9c-cf691f1c1099-kube-api-access-wv48n" (OuterVolumeSpecName: "kube-api-access-wv48n") pod "3c4f2848-d13a-4646-bd9c-cf691f1c1099" (UID: "3c4f2848-d13a-4646-bd9c-cf691f1c1099"). InnerVolumeSpecName "kube-api-access-wv48n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.159084 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf991ab-cf17-4dfe-89ca-364c2361278d-kube-api-access-mh7hz" (OuterVolumeSpecName: "kube-api-access-mh7hz") pod "bcf991ab-cf17-4dfe-89ca-364c2361278d" (UID: "bcf991ab-cf17-4dfe-89ca-364c2361278d"). InnerVolumeSpecName "kube-api-access-mh7hz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.164521 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ba6f52-4d8e-4337-bff6-83de22056bf2-kube-api-access-xvlmj" (OuterVolumeSpecName: "kube-api-access-xvlmj") pod "e4ba6f52-4d8e-4337-bff6-83de22056bf2" (UID: "e4ba6f52-4d8e-4337-bff6-83de22056bf2"). InnerVolumeSpecName "kube-api-access-xvlmj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.165046 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884af2cd-b59a-4583-818e-f6ff7b8b4fc7-kube-api-access-7nv49" (OuterVolumeSpecName: "kube-api-access-7nv49") pod "884af2cd-b59a-4583-818e-f6ff7b8b4fc7" (UID: "884af2cd-b59a-4583-818e-f6ff7b8b4fc7"). InnerVolumeSpecName "kube-api-access-7nv49". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.166969 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.177562 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.197795 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.210552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.230650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rwtz\" (UniqueName: \"kubernetes.io/projected/b1424001-64e8-4892-b403-4284096261ba-kube-api-access-2rwtz\") pod \"b1424001-64e8-4892-b403-4284096261ba\" (UID: \"b1424001-64e8-4892-b403-4284096261ba\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.230955 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qf69\" (UniqueName: \"kubernetes.io/projected/5f0da7e0-0d50-4ec6-8320-a1994e79e38c-kube-api-access-6qf69\") pod \"5f0da7e0-0d50-4ec6-8320-a1994e79e38c\" (UID: \"5f0da7e0-0d50-4ec6-8320-a1994e79e38c\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert\") pod \"3d74755b-a923-42e2-b1cb-f68b956325f8\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231152 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf8x8\" (UniqueName: \"kubernetes.io/projected/ebaca59c-611f-4c55-85df-3a788dab93d2-kube-api-access-lf8x8\") pod \"ebaca59c-611f-4c55-85df-3a788dab93d2\" (UID: \"ebaca59c-611f-4c55-85df-3a788dab93d2\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231330 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gw42\" (UniqueName: \"kubernetes.io/projected/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f-kube-api-access-5gw42\") pod \"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f\" (UID: \"d4b794f9-ecfe-4fa8-b810-d2d17c9e039f\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf7sj\" (UniqueName: \"kubernetes.io/projected/3d74755b-a923-42e2-b1cb-f68b956325f8-kube-api-access-mf7sj\") pod \"3d74755b-a923-42e2-b1cb-f68b956325f8\" (UID: \"3d74755b-a923-42e2-b1cb-f68b956325f8\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231742 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wv48n\" (UniqueName: \"kubernetes.io/projected/3c4f2848-d13a-4646-bd9c-cf691f1c1099-kube-api-access-wv48n\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231805 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mh7hz\" (UniqueName: \"kubernetes.io/projected/bcf991ab-cf17-4dfe-89ca-364c2361278d-kube-api-access-mh7hz\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231869 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7xf6k\" (UniqueName: \"kubernetes.io/projected/5244ed83-c201-493d-9c35-20102cd07696-kube-api-access-7xf6k\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231926 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xvlmj\" (UniqueName: \"kubernetes.io/projected/e4ba6f52-4d8e-4337-bff6-83de22056bf2-kube-api-access-xvlmj\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.231988 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7nv49\" (UniqueName: \"kubernetes.io/projected/884af2cd-b59a-4583-818e-f6ff7b8b4fc7-kube-api-access-7nv49\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.254457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0da7e0-0d50-4ec6-8320-a1994e79e38c-kube-api-access-6qf69" (OuterVolumeSpecName: "kube-api-access-6qf69") pod "5f0da7e0-0d50-4ec6-8320-a1994e79e38c" (UID: "5f0da7e0-0d50-4ec6-8320-a1994e79e38c"). InnerVolumeSpecName "kube-api-access-6qf69". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.254649 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert" (OuterVolumeSpecName: "cert") pod "3d74755b-a923-42e2-b1cb-f68b956325f8" (UID: "3d74755b-a923-42e2-b1cb-f68b956325f8"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.254877 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.254975 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d74755b-a923-42e2-b1cb-f68b956325f8-kube-api-access-mf7sj" (OuterVolumeSpecName: "kube-api-access-mf7sj") pod "3d74755b-a923-42e2-b1cb-f68b956325f8" (UID: "3d74755b-a923-42e2-b1cb-f68b956325f8"). InnerVolumeSpecName "kube-api-access-mf7sj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.256963 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1424001-64e8-4892-b403-4284096261ba-kube-api-access-2rwtz" (OuterVolumeSpecName: "kube-api-access-2rwtz") pod "b1424001-64e8-4892-b403-4284096261ba" (UID: "b1424001-64e8-4892-b403-4284096261ba"). InnerVolumeSpecName "kube-api-access-2rwtz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.283976 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f-kube-api-access-5gw42" (OuterVolumeSpecName: "kube-api-access-5gw42") pod "d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" (UID: "d4b794f9-ecfe-4fa8-b810-d2d17c9e039f"). InnerVolumeSpecName "kube-api-access-5gw42". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.286766 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebaca59c-611f-4c55-85df-3a788dab93d2-kube-api-access-lf8x8" (OuterVolumeSpecName: "kube-api-access-lf8x8") pod "ebaca59c-611f-4c55-85df-3a788dab93d2" (UID: "ebaca59c-611f-4c55-85df-3a788dab93d2"). InnerVolumeSpecName "kube-api-access-lf8x8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.332613 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8t79\" (UniqueName: \"kubernetes.io/projected/cad6c628-2097-4624-838e-1ebc9683235e-kube-api-access-n8t79\") pod \"cad6c628-2097-4624-838e-1ebc9683235e\" (UID: \"cad6c628-2097-4624-838e-1ebc9683235e\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.332786 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqd8n\" (UniqueName: \"kubernetes.io/projected/848e8062-b068-4fc7-9b2b-092937683caa-kube-api-access-jqd8n\") pod \"848e8062-b068-4fc7-9b2b-092937683caa\" (UID: \"848e8062-b068-4fc7-9b2b-092937683caa\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.332900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64zxg\" (UniqueName: \"kubernetes.io/projected/300d1793-527a-4e93-8753-460f9390a9f0-kube-api-access-64zxg\") pod \"300d1793-527a-4e93-8753-460f9390a9f0\" (UID: \"300d1793-527a-4e93-8753-460f9390a9f0\") " Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.333255 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5gw42\" (UniqueName: \"kubernetes.io/projected/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f-kube-api-access-5gw42\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.333283 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mf7sj\" (UniqueName: \"kubernetes.io/projected/3d74755b-a923-42e2-b1cb-f68b956325f8-kube-api-access-mf7sj\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.333297 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2rwtz\" (UniqueName: \"kubernetes.io/projected/b1424001-64e8-4892-b403-4284096261ba-kube-api-access-2rwtz\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.333311 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6qf69\" (UniqueName: \"kubernetes.io/projected/5f0da7e0-0d50-4ec6-8320-a1994e79e38c-kube-api-access-6qf69\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.333325 4769 reconciler_common.go:293] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d74755b-a923-42e2-b1cb-f68b956325f8-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.333338 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lf8x8\" (UniqueName: \"kubernetes.io/projected/ebaca59c-611f-4c55-85df-3a788dab93d2-kube-api-access-lf8x8\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.335602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad6c628-2097-4624-838e-1ebc9683235e-kube-api-access-n8t79" (OuterVolumeSpecName: "kube-api-access-n8t79") pod "cad6c628-2097-4624-838e-1ebc9683235e" (UID: "cad6c628-2097-4624-838e-1ebc9683235e"). InnerVolumeSpecName "kube-api-access-n8t79". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.337187 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/300d1793-527a-4e93-8753-460f9390a9f0-kube-api-access-64zxg" (OuterVolumeSpecName: "kube-api-access-64zxg") pod "300d1793-527a-4e93-8753-460f9390a9f0" (UID: "300d1793-527a-4e93-8753-460f9390a9f0"). InnerVolumeSpecName "kube-api-access-64zxg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.338028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/848e8062-b068-4fc7-9b2b-092937683caa-kube-api-access-jqd8n" (OuterVolumeSpecName: "kube-api-access-jqd8n") pod "848e8062-b068-4fc7-9b2b-092937683caa" (UID: "848e8062-b068-4fc7-9b2b-092937683caa"). InnerVolumeSpecName "kube-api-access-jqd8n". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.434582 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jqd8n\" (UniqueName: \"kubernetes.io/projected/848e8062-b068-4fc7-9b2b-092937683caa-kube-api-access-jqd8n\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.435059 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-64zxg\" (UniqueName: \"kubernetes.io/projected/300d1793-527a-4e93-8753-460f9390a9f0-kube-api-access-64zxg\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.435138 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n8t79\" (UniqueName: \"kubernetes.io/projected/cad6c628-2097-4624-838e-1ebc9683235e-kube-api-access-n8t79\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.835702 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ttf49" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.837341 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.837515 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.837691 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.838765 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.842966 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.844037 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.846173 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.847054 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.854600 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.856500 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-8464cf66df-rlz94" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.856548 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.856578 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.857899 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.857984 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858116 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858212 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858234 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858233 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858270 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858298 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858321 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858421 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.858500 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh" Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.978773 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz"] Nov 21 13:45:10 crc kubenswrapper[4769]: I1121 13:45:10.992668 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-7755d5f8cc-sk7hz"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.000614 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.007878 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-7768f8c84f-mmfz8"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.033691 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.040340 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-5bdf4f7f7f-frhh2"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.046072 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.061639 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-6d8fd67bf7-8zh6g"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.074674 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.083300 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5d86b44686-v4gqp"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.091770 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.099840 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7798859c74-c99pr"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.110146 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.117301 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/swift-operator-controller-manager-799cb6ffd6-kshc8"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.123788 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.129815 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6c655cdc6cc9pmk"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.136539 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.145258 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/designate-operator-controller-manager-56dfb6b67f-6628r"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.149293 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.159434 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/glance-operator-controller-manager-8667fbf6f6-hrl62"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.166391 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.176731 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-769d9c7585-q5j8k"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.186512 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.192907 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-77c7f689f5-xczwb"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.199050 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.204910 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/placement-operator-controller-manager-6dc664666c-2cmz5"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.210981 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.219685 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-7879fb76fd-2lpxb"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.225334 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.232831 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7bb88cb858-nf9vh"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.241845 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.247488 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/nova-operator-controller-manager-86d796d84d-chvl5"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.262444 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.283219 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" path="/var/lib/kubelet/pods/0bc3144e-ffee-4056-960b-c0144d0f0a14/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.284386 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="300d1793-527a-4e93-8753-460f9390a9f0" path="/var/lib/kubelet/pods/300d1793-527a-4e93-8753-460f9390a9f0/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.285061 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" path="/var/lib/kubelet/pods/3d74755b-a923-42e2-b1cb-f68b956325f8/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.286407 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" path="/var/lib/kubelet/pods/48bcc67d-6c8c-49c5-8b60-1ed8a583c885/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.286993 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c4b5619-0a5f-4363-985d-99182730024d" path="/var/lib/kubelet/pods/5c4b5619-0a5f-4363-985d-99182730024d/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.287568 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" path="/var/lib/kubelet/pods/62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.288794 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" path="/var/lib/kubelet/pods/6bbca42b-c781-4106-851f-ab9bb4fac793/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.289309 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" path="/var/lib/kubelet/pods/73a1d48f-8d98-4b78-bac7-00e1ffa04b82/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.289778 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" path="/var/lib/kubelet/pods/884af2cd-b59a-4583-818e-f6ff7b8b4fc7/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.290779 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" path="/var/lib/kubelet/pods/b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.291344 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" path="/var/lib/kubelet/pods/bcf991ab-cf17-4dfe-89ca-364c2361278d/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.292578 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c947192b-fa60-475c-8485-d5b89b68db04" path="/var/lib/kubelet/pods/c947192b-fa60-475c-8485-d5b89b68db04/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.294078 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" path="/var/lib/kubelet/pods/ca12a419-f80c-4f1c-8f23-1f72e4e07121/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.296509 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad6c628-2097-4624-838e-1ebc9683235e" path="/var/lib/kubelet/pods/cad6c628-2097-4624-838e-1ebc9683235e/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.297986 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" path="/var/lib/kubelet/pods/e4ba6f52-4d8e-4337-bff6-83de22056bf2/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.298912 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" path="/var/lib/kubelet/pods/ebaca59c-611f-4c55-85df-3a788dab93d2/volumes" Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.299455 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-7cd4fb6f79-9j2qz"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.299489 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-ttf49"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.299503 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-index-ttf49"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.300649 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.305314 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/heat-operator-controller-manager-bf4c6585d-2j628"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.309527 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.313227 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-5f97d8c699-gvfgw"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.317519 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.321428 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-6fdc856c5d-rp8zk"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.325816 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.330009 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-6f8c5b86cb-29xtg"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.334333 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.338774 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-5c75d7c94b-qkslz"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.344070 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/test-operator-controller-manager-8464cf66df-rlz94"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.347955 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/test-operator-controller-manager-8464cf66df-rlz94"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.352520 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh"] Nov 21 13:45:11 crc kubenswrapper[4769]: I1121 13:45:11.356428 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-66b7d6f598-b2ggh"] Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.327450 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" path="/var/lib/kubelet/pods/3c4f2848-d13a-4646-bd9c-cf691f1c1099/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.414967 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5244ed83-c201-493d-9c35-20102cd07696" path="/var/lib/kubelet/pods/5244ed83-c201-493d-9c35-20102cd07696/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.415717 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" path="/var/lib/kubelet/pods/5f0da7e0-0d50-4ec6-8320-a1994e79e38c/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.416303 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" path="/var/lib/kubelet/pods/7da40971-cf3f-40a1-b8ca-cccc0b21c801/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.421085 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="848e8062-b068-4fc7-9b2b-092937683caa" path="/var/lib/kubelet/pods/848e8062-b068-4fc7-9b2b-092937683caa/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.423987 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1424001-64e8-4892-b403-4284096261ba" path="/var/lib/kubelet/pods/b1424001-64e8-4892-b403-4284096261ba/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.424936 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" path="/var/lib/kubelet/pods/d4b794f9-ecfe-4fa8-b810-d2d17c9e039f/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.426696 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" path="/var/lib/kubelet/pods/f769fe9e-e5a5-4954-9d27-6786c130674d/volumes" Nov 21 13:45:13 crc kubenswrapper[4769]: I1121 13:45:13.428005 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" path="/var/lib/kubelet/pods/fec807b0-ab6b-4c9d-9c06-efb27c7c75dd/volumes" Nov 21 13:45:14 crc kubenswrapper[4769]: I1121 13:45:14.811405 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-84b9f45d47-2dnff" Nov 21 13:45:14 crc kubenswrapper[4769]: I1121 13:45:14.889886 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv"] Nov 21 13:45:14 crc kubenswrapper[4769]: I1121 13:45:14.890292 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="dnsmasq-dns" containerID="cri-o://7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad" gracePeriod=10 Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.346812 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.1.157:5353: connect: connection refused" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.806126 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.893372 4769 generic.go:334] "Generic (PLEG): container finished" podID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerID="7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad" exitCode=0 Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.893411 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" event={"ID":"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc","Type":"ContainerDied","Data":"7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad"} Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.893455 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" event={"ID":"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc","Type":"ContainerDied","Data":"64aa420d5bbcc1fffd9464223fe0e3458955d50a316d790ab1f5f08ec99fcab1"} Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.893452 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.893481 4769 scope.go:117] "RemoveContainer" containerID="7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.922857 4769 scope.go:117] "RemoveContainer" containerID="432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.943172 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-dnsmasq-svc\") pod \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.943261 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-config\") pod \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.943310 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kbrv\" (UniqueName: \"kubernetes.io/projected/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-kube-api-access-6kbrv\") pod \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.943348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-edpm-compute-no-nodes\") pod \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\" (UID: \"af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc\") " Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.944515 4769 scope.go:117] "RemoveContainer" containerID="7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad" Nov 21 13:45:15 crc kubenswrapper[4769]: E1121 13:45:15.945683 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad\": container with ID starting with 7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad not found: ID does not exist" containerID="7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.945977 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad"} err="failed to get container status \"7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad\": rpc error: code = NotFound desc = could not find container \"7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad\": container with ID starting with 7c22359bb68f79846dad07d3bde3fb06c62358364d21e5e28d6ab1a234bf5bad not found: ID does not exist" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.946009 4769 scope.go:117] "RemoveContainer" containerID="432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214" Nov 21 13:45:15 crc kubenswrapper[4769]: E1121 13:45:15.946555 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214\": container with ID starting with 432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214 not found: ID does not exist" containerID="432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.946681 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214"} err="failed to get container status \"432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214\": rpc error: code = NotFound desc = could not find container \"432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214\": container with ID starting with 432291bd26a1d6ad4fd71ede86a0f17677a2d6c8b2910e7e874c23ab0f4ff214 not found: ID does not exist" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.950042 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-kube-api-access-6kbrv" (OuterVolumeSpecName: "kube-api-access-6kbrv") pod "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" (UID: "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc"). InnerVolumeSpecName "kube-api-access-6kbrv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.979587 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" (UID: "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.980569 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-edpm-compute-no-nodes" (OuterVolumeSpecName: "edpm-compute-no-nodes") pod "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" (UID: "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc"). InnerVolumeSpecName "edpm-compute-no-nodes". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:45:15 crc kubenswrapper[4769]: I1121 13:45:15.981519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-config" (OuterVolumeSpecName: "config") pod "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" (UID: "af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:45:16 crc kubenswrapper[4769]: I1121 13:45:16.045018 4769 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:16 crc kubenswrapper[4769]: I1121 13:45:16.045049 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6kbrv\" (UniqueName: \"kubernetes.io/projected/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-kube-api-access-6kbrv\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:16 crc kubenswrapper[4769]: I1121 13:45:16.045085 4769 reconciler_common.go:293] "Volume detached for volume \"edpm-compute-no-nodes\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-edpm-compute-no-nodes\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:16 crc kubenswrapper[4769]: I1121 13:45:16.045096 4769 reconciler_common.go:293] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Nov 21 13:45:16 crc kubenswrapper[4769]: I1121 13:45:16.225336 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv"] Nov 21 13:45:16 crc kubenswrapper[4769]: I1121 13:45:16.229856 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-64864b6d57-wtswv"] Nov 21 13:45:17 crc kubenswrapper[4769]: I1121 13:45:17.286326 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" path="/var/lib/kubelet/pods/af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc/volumes" Nov 21 13:45:21 crc kubenswrapper[4769]: I1121 13:45:21.274327 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:45:21 crc kubenswrapper[4769]: I1121 13:45:21.954690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"3a4944a5b108a6b600ce3284d1598d1895a4b0c39681f6da153127371aede959"} Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.311783 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-bd4pn"] Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.312965 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.312990 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313005 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313016 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313032 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313042 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313070 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313080 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313090 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313100 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313116 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313125 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313142 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313151 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313167 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313178 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313216 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313227 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313243 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313253 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313264 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="operator" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313274 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="operator" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313291 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313300 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313314 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313325 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313341 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313351 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313368 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313377 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313390 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313401 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313420 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313428 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313440 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313449 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313475 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313493 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313503 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313516 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313553 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313571 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313581 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313596 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313605 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313619 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313629 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313647 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="dnsmasq-dns" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313658 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="dnsmasq-dns" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313673 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313684 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313697 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313706 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313723 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313733 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313753 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313763 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313777 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313787 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313800 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313809 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313825 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313836 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313847 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313856 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313871 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313881 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313900 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313909 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313926 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" containerName="operator" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313936 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" containerName="operator" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313948 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313958 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.313974 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.313985 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314004 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314014 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314030 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314040 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314057 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314079 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314089 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314102 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314112 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314131 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314141 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314337 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="848e8062-b068-4fc7-9b2b-092937683caa" containerName="registry-server" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314350 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="848e8062-b068-4fc7-9b2b-092937683caa" containerName="registry-server" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314363 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314373 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314392 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="init" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314403 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="init" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314422 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314432 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314447 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314457 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: E1121 13:45:56.314472 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314483 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314686 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314719 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314737 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314756 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314772 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f769fe9e-e5a5-4954-9d27-6786c130674d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314786 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314800 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314812 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314828 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="operator" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314839 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314863 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="848e8062-b068-4fc7-9b2b-092937683caa" containerName="registry-server" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314877 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314891 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314906 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314919 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314936 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b84b1683-d3d6-4b0a-b4c2-232b8ba54bf3" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314950 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314966 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314977 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.314994 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315009 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315019 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="884af2cd-b59a-4583-818e-f6ff7b8b4fc7" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315029 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315039 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315049 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ebaca59c-611f-4c55-85df-3a788dab93d2" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315064 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3c4f2848-d13a-4646-bd9c-cf691f1c1099" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315078 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315090 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="300d1793-527a-4e93-8753-460f9390a9f0" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315100 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5c4b5619-0a5f-4363-985d-99182730024d" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315115 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0bc3144e-ffee-4056-960b-c0144d0f0a14" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315125 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5244ed83-c201-493d-9c35-20102cd07696" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315135 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="af51ccc0-e3a4-4223-aaf7-60e5ca8a5bfc" containerName="dnsmasq-dns" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315151 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315163 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315179 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3d74755b-a923-42e2-b1cb-f68b956325f8" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315219 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="62c2d3e9-b33b-4bb0-b5b3-31b0c0bb5b58" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315236 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4ba6f52-4d8e-4337-bff6-83de22056bf2" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315252 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bcf991ab-cf17-4dfe-89ca-364c2361278d" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315266 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6bbca42b-c781-4106-851f-ab9bb4fac793" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315282 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c947192b-fa60-475c-8485-d5b89b68db04" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315295 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7da40971-cf3f-40a1-b8ca-cccc0b21c801" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315308 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fec807b0-ab6b-4c9d-9c06-efb27c7c75dd" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315320 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d4b794f9-ecfe-4fa8-b810-d2d17c9e039f" containerName="manager" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315335 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="48bcc67d-6c8c-49c5-8b60-1ed8a583c885" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315346 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b1424001-64e8-4892-b403-4284096261ba" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315360 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="73a1d48f-8d98-4b78-bac7-00e1ffa04b82" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315372 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5f0da7e0-0d50-4ec6-8320-a1994e79e38c" containerName="operator" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315389 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cad6c628-2097-4624-838e-1ebc9683235e" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.315401 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ca12a419-f80c-4f1c-8f23-1f72e4e07121" containerName="kube-rbac-proxy" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.316119 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.318512 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-index-dockercfg-rcmlp" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.319590 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.327976 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.354873 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-bd4pn"] Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.371122 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnpbb\" (UniqueName: \"kubernetes.io/projected/f635ca6c-5255-4398-af8b-a93e3bb68d30-kube-api-access-mnpbb\") pod \"mariadb-operator-index-bd4pn\" (UID: \"f635ca6c-5255-4398-af8b-a93e3bb68d30\") " pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.473328 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mnpbb\" (UniqueName: \"kubernetes.io/projected/f635ca6c-5255-4398-af8b-a93e3bb68d30-kube-api-access-mnpbb\") pod \"mariadb-operator-index-bd4pn\" (UID: \"f635ca6c-5255-4398-af8b-a93e3bb68d30\") " pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.500687 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnpbb\" (UniqueName: \"kubernetes.io/projected/f635ca6c-5255-4398-af8b-a93e3bb68d30-kube-api-access-mnpbb\") pod \"mariadb-operator-index-bd4pn\" (UID: \"f635ca6c-5255-4398-af8b-a93e3bb68d30\") " pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.652885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.680322 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-bd4pn"] Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.887426 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-j7nnj"] Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.888598 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.911866 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-j7nnj"] Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.947776 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-bd4pn"] Nov 21 13:45:56 crc kubenswrapper[4769]: I1121 13:45:56.984132 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc82\" (UniqueName: \"kubernetes.io/projected/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181-kube-api-access-dvc82\") pod \"mariadb-operator-index-j7nnj\" (UID: \"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181\") " pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:45:57 crc kubenswrapper[4769]: I1121 13:45:57.085785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc82\" (UniqueName: \"kubernetes.io/projected/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181-kube-api-access-dvc82\") pod \"mariadb-operator-index-j7nnj\" (UID: \"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181\") " pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:45:57 crc kubenswrapper[4769]: I1121 13:45:57.106822 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc82\" (UniqueName: \"kubernetes.io/projected/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181-kube-api-access-dvc82\") pod \"mariadb-operator-index-j7nnj\" (UID: \"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181\") " pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:45:57 crc kubenswrapper[4769]: I1121 13:45:57.212959 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:45:57 crc kubenswrapper[4769]: I1121 13:45:57.322453 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-bd4pn" event={"ID":"f635ca6c-5255-4398-af8b-a93e3bb68d30","Type":"ContainerStarted","Data":"edbf0d671fd6c60706395bcdf0e84cacd02aec79d6e7f281279d3915ee16105b"} Nov 21 13:45:57 crc kubenswrapper[4769]: I1121 13:45:57.676444 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-j7nnj"] Nov 21 13:45:57 crc kubenswrapper[4769]: W1121 13:45:57.681496 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0521bd9_f2e0_479e_9a4b_0d7c7b2a3181.slice/crio-3c8fb040f2ccc2bbcd637606bdc4266e58756d0cc5c03c3bddbf4024c94f43c1 WatchSource:0}: Error finding container 3c8fb040f2ccc2bbcd637606bdc4266e58756d0cc5c03c3bddbf4024c94f43c1: Status 404 returned error can't find the container with id 3c8fb040f2ccc2bbcd637606bdc4266e58756d0cc5c03c3bddbf4024c94f43c1 Nov 21 13:45:58 crc kubenswrapper[4769]: I1121 13:45:58.343871 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-j7nnj" event={"ID":"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181","Type":"ContainerStarted","Data":"3c8fb040f2ccc2bbcd637606bdc4266e58756d0cc5c03c3bddbf4024c94f43c1"} Nov 21 13:46:04 crc kubenswrapper[4769]: I1121 13:46:04.400448 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-j7nnj" event={"ID":"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181","Type":"ContainerStarted","Data":"efcda5ddf7223620b769fad29f0bea66ec3cc754b5c2ec69674e15b25cadefbd"} Nov 21 13:46:04 crc kubenswrapper[4769]: I1121 13:46:04.402304 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-bd4pn" event={"ID":"f635ca6c-5255-4398-af8b-a93e3bb68d30","Type":"ContainerStarted","Data":"0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f"} Nov 21 13:46:04 crc kubenswrapper[4769]: I1121 13:46:04.402437 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-bd4pn" podUID="f635ca6c-5255-4398-af8b-a93e3bb68d30" containerName="registry-server" containerID="cri-o://0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f" gracePeriod=2 Nov 21 13:46:04 crc kubenswrapper[4769]: I1121 13:46:04.424233 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-j7nnj" podStartSLOduration=2.911970216 podStartE2EDuration="8.424186076s" podCreationTimestamp="2025-11-21 13:45:56 +0000 UTC" firstStartedPulling="2025-11-21 13:45:57.687320239 +0000 UTC m=+6916.387982087" lastFinishedPulling="2025-11-21 13:46:03.199536109 +0000 UTC m=+6921.900197947" observedRunningTime="2025-11-21 13:46:04.419942213 +0000 UTC m=+6923.120604101" watchObservedRunningTime="2025-11-21 13:46:04.424186076 +0000 UTC m=+6923.124847904" Nov 21 13:46:04 crc kubenswrapper[4769]: I1121 13:46:04.447529 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-bd4pn" podStartSLOduration=2.207336622 podStartE2EDuration="8.447492724s" podCreationTimestamp="2025-11-21 13:45:56 +0000 UTC" firstStartedPulling="2025-11-21 13:45:56.957873097 +0000 UTC m=+6915.658534915" lastFinishedPulling="2025-11-21 13:46:03.198029179 +0000 UTC m=+6921.898691017" observedRunningTime="2025-11-21 13:46:04.439335828 +0000 UTC m=+6923.139997706" watchObservedRunningTime="2025-11-21 13:46:04.447492724 +0000 UTC m=+6923.148154582" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.359793 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.410536 4769 generic.go:334] "Generic (PLEG): container finished" podID="f635ca6c-5255-4398-af8b-a93e3bb68d30" containerID="0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f" exitCode=0 Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.410608 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-bd4pn" event={"ID":"f635ca6c-5255-4398-af8b-a93e3bb68d30","Type":"ContainerDied","Data":"0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f"} Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.410669 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-bd4pn" event={"ID":"f635ca6c-5255-4398-af8b-a93e3bb68d30","Type":"ContainerDied","Data":"edbf0d671fd6c60706395bcdf0e84cacd02aec79d6e7f281279d3915ee16105b"} Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.410688 4769 scope.go:117] "RemoveContainer" containerID="0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.411831 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-bd4pn" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.429034 4769 scope.go:117] "RemoveContainer" containerID="0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f" Nov 21 13:46:05 crc kubenswrapper[4769]: E1121 13:46:05.429576 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f\": container with ID starting with 0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f not found: ID does not exist" containerID="0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.429679 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f"} err="failed to get container status \"0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f\": rpc error: code = NotFound desc = could not find container \"0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f\": container with ID starting with 0a0643fc34638f13933e24f77ea29c03ed4dbf8a76a9ebe26d7e74f629b4ce0f not found: ID does not exist" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.449616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnpbb\" (UniqueName: \"kubernetes.io/projected/f635ca6c-5255-4398-af8b-a93e3bb68d30-kube-api-access-mnpbb\") pod \"f635ca6c-5255-4398-af8b-a93e3bb68d30\" (UID: \"f635ca6c-5255-4398-af8b-a93e3bb68d30\") " Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.454165 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f635ca6c-5255-4398-af8b-a93e3bb68d30-kube-api-access-mnpbb" (OuterVolumeSpecName: "kube-api-access-mnpbb") pod "f635ca6c-5255-4398-af8b-a93e3bb68d30" (UID: "f635ca6c-5255-4398-af8b-a93e3bb68d30"). InnerVolumeSpecName "kube-api-access-mnpbb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.551863 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mnpbb\" (UniqueName: \"kubernetes.io/projected/f635ca6c-5255-4398-af8b-a93e3bb68d30-kube-api-access-mnpbb\") on node \"crc\" DevicePath \"\"" Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.762572 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-bd4pn"] Nov 21 13:46:05 crc kubenswrapper[4769]: I1121 13:46:05.765769 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-bd4pn"] Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.213582 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.213800 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.281776 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f635ca6c-5255-4398-af8b-a93e3bb68d30" path="/var/lib/kubelet/pods/f635ca6c-5255-4398-af8b-a93e3bb68d30/volumes" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.283317 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.672097 4769 scope.go:117] "RemoveContainer" containerID="cba58951ed8f97777242e8f4f3065a904368ca8ff449e950a599427bc8738eb9" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.725236 4769 scope.go:117] "RemoveContainer" containerID="7bbd995fe48422294a34544184d6dff7dcb9cb328b3addf52269afa18a42a330" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.781756 4769 scope.go:117] "RemoveContainer" containerID="ecac01db0828cac6541f262c83e55c1e7a591f42926cc3ec8ebef9b8b227faa5" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.810042 4769 scope.go:117] "RemoveContainer" containerID="4302ed47c9a6350e7222fbd12311f7b707b9713cd07f2dc2f854b1fb08478cc9" Nov 21 13:46:07 crc kubenswrapper[4769]: I1121 13:46:07.939347 4769 scope.go:117] "RemoveContainer" containerID="7fbc88a3b3c1936b9597119e2724b5f6bc70cc4472a304dfb9f35650fd3611df" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.307468 4769 scope.go:117] "RemoveContainer" containerID="2d21a86b29e5a5840ad6672cdfbe3372a8f44459294614805ddb7933616b8c0b" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.331639 4769 scope.go:117] "RemoveContainer" containerID="a521933d00da2ecf0a7d7df2dbf6c8982eb4d2672a060bd2efc800d8bedd39c2" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.435846 4769 scope.go:117] "RemoveContainer" containerID="7ab81a190f7145ab19be918722a255c3e182600639baf55f41cb667365a8162a" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.481125 4769 scope.go:117] "RemoveContainer" containerID="5c8347a693dfa211efed9bbe4b780160870ba4380606caa9ce739f6bb65e1b03" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.498790 4769 scope.go:117] "RemoveContainer" containerID="9c02c139770ec2d26051b4aa5f27e890cd157c667ac3935ab804dd292a5deae9" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.536029 4769 scope.go:117] "RemoveContainer" containerID="e346bbc29cbe0559ebb51dd5a671c10b450ece5a9b11c62a20934e8159facf50" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.579744 4769 scope.go:117] "RemoveContainer" containerID="c3bd0e428c0efbb264a317c62d1f2b9b26e235d1f3658b2cd045af505d8561a5" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.623100 4769 scope.go:117] "RemoveContainer" containerID="1316aab7df7fc6324fcd638c3657cb8a3cec872ebf05bdccec83727bb411875d" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.681516 4769 scope.go:117] "RemoveContainer" containerID="ee6015ca258ee6b5ce1301776f76cd081fabad0d139968bc670160748d442344" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.706865 4769 scope.go:117] "RemoveContainer" containerID="664f44399e6c5308e54048bd384ad3d2f66fb021e2fe3a72d410af31bdc50a4e" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.755027 4769 scope.go:117] "RemoveContainer" containerID="1fcf24f5868eed5ff067fccc6161f7f04dd567bed3715094de7e6394c181ce6c" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.825752 4769 scope.go:117] "RemoveContainer" containerID="bbe0e4466cfd8b3bdd075f4f164368b6a29c6dda6a76ee68499d29adcc3d7a27" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.871845 4769 scope.go:117] "RemoveContainer" containerID="4eac292042724ce058ecf3b3134ad96463fdebf3203317509bf46fcd779646a3" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.916009 4769 scope.go:117] "RemoveContainer" containerID="9b538ada4b5e7656a174202cd35d4e50b7aad3730cbd8213daffe1d65d635877" Nov 21 13:46:08 crc kubenswrapper[4769]: I1121 13:46:08.950688 4769 scope.go:117] "RemoveContainer" containerID="9c3cc17a5c6e3a2e9193f2093c15f4de540b0b1cd9ea2087e6c8eb886ba175c3" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.009956 4769 scope.go:117] "RemoveContainer" containerID="149bcf102175b79f59006c0a114f30b2078eeba9534f17f7826903ff09f663e3" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.060658 4769 scope.go:117] "RemoveContainer" containerID="d9fd678815071ac1384473e06fe9926758e3f035627a5575e93a09b4890a131e" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.141151 4769 scope.go:117] "RemoveContainer" containerID="d850fe2c311f1f361d33b997795c74fa5d0773520e4c2dc6c1fd0f1b18d0e9fa" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.282561 4769 scope.go:117] "RemoveContainer" containerID="06b5f8feb10ca3bf8bd2a181969175eaf41d91f92af43d2fc479258a8cfc1e4e" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.321265 4769 scope.go:117] "RemoveContainer" containerID="495665c86c27acc6143afe39073e804f682726439e71e688495d915ce8911500" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.344737 4769 scope.go:117] "RemoveContainer" containerID="b6aff44fb28d02f6fc1817970a17b9ded2f2579fbd8c4fca71b7fb1357cc4255" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.366872 4769 scope.go:117] "RemoveContainer" containerID="db28119909fa7b28c44812d7184901321e739f42d3230070a418722047a5bdf3" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.405502 4769 scope.go:117] "RemoveContainer" containerID="2cf033c69500dfbcfb5b9cbab0acb3e0f4718409f87cf757654b7991228fcc62" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.444305 4769 scope.go:117] "RemoveContainer" containerID="77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.467499 4769 scope.go:117] "RemoveContainer" containerID="bc53fca0eca528cea270c1e119736ca93e18ca8fd4227514f717fd0de44d1f58" Nov 21 13:46:09 crc kubenswrapper[4769]: E1121 13:46:09.468145 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e\": container with ID starting with 77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e not found: ID does not exist" containerID="77d168aa32c12ec72e289e05a8febb59666ed8d67185a0afc253a332d0a8b97e" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.524270 4769 scope.go:117] "RemoveContainer" containerID="3620ff9f616e0a12fef6dc00e7e0cc4df886f9ed2c4fff0f46cb8954dc0feb81" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.543165 4769 scope.go:117] "RemoveContainer" containerID="f2dbcb14c12b7accf91b48561ca8d566c4da820850500a6f32c49f10164df00f" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.571434 4769 scope.go:117] "RemoveContainer" containerID="bf29ee92d59dd39d5692b2f21c812db3f86b966c2fcb5b007de6ea3da2fbb791" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.617528 4769 scope.go:117] "RemoveContainer" containerID="478fb18fc3332ba4f29b0d6b5fcd459e36b484739473c376efd5a28b520e4044" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.652907 4769 scope.go:117] "RemoveContainer" containerID="3353f3ca5067e66ae8c7e135b13d35d7063b3d87d8570f1c6013a02ef0de7774" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.692276 4769 scope.go:117] "RemoveContainer" containerID="5facb6143fa98ce5583569e3b26176ecbbfe8467c6dee1738d0b29b8dd1b7b32" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.711694 4769 scope.go:117] "RemoveContainer" containerID="8073ebd1c6b07e27a697d597db234cfc37862d83735a37077713855ed3811e0a" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.729616 4769 scope.go:117] "RemoveContainer" containerID="8d868e6a04fc23686196f3767dd9ad9ef9a278e8d8f934e18f5d16b1d5cc06f3" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.770231 4769 scope.go:117] "RemoveContainer" containerID="c3dccda292760178da96b95423da3f0986bed4c9b7cc165579e3b87ea035c99c" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.796817 4769 scope.go:117] "RemoveContainer" containerID="bd46dd8c9731a36be3f0e9694dbe037636ce2ea5c0d064b7f4c047b06f2d416c" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.832809 4769 scope.go:117] "RemoveContainer" containerID="f3b9261a14c0c306233cca1c21257862ceabd1789ed170ed4f8d708155596af6" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.868514 4769 scope.go:117] "RemoveContainer" containerID="d4f8428dd5414db367dbc67de16d8be669be1224a6cac81927bb2bca0fffddf4" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.904200 4769 scope.go:117] "RemoveContainer" containerID="1217b335749f9401e86fb4f1c162afd849feaa1f8e55cb7cab3479bab48fe16d" Nov 21 13:46:09 crc kubenswrapper[4769]: I1121 13:46:09.980259 4769 scope.go:117] "RemoveContainer" containerID="a61b429862ef2a8daa1141a25b2ea4b51ff4c0daf48fdc7fa3fc2c8c4da6810c" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.005511 4769 scope.go:117] "RemoveContainer" containerID="4b114220ba0545356eaa9a13c0edb71659c8e15882b54908dc0352ea4310508e" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.033789 4769 scope.go:117] "RemoveContainer" containerID="bf5a6c30d09e75eb03f2720daf0cbda1be4c561977c7b3cdfe4809428a9b34de" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.081098 4769 scope.go:117] "RemoveContainer" containerID="8aafeae1041add0e486c419c7fd17c32af98840183d02cc9979704f665626ead" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.108944 4769 scope.go:117] "RemoveContainer" containerID="0e06f8a29ffe2d8596643312ae610a1cf815694f75382219618ad21413838164" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.148973 4769 scope.go:117] "RemoveContainer" containerID="05e828f53e4434f6884067d1fc85e9d9f85822183babf29cc9f029da2e568e8c" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.180771 4769 scope.go:117] "RemoveContainer" containerID="21da28b118326d5395e720618736da04fed81b4879e718b60cfe4709588e759f" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.202485 4769 scope.go:117] "RemoveContainer" containerID="465af80035a015eb6e543fbd5be14d8295a5281dc24073b5fd78db8705568160" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.232258 4769 scope.go:117] "RemoveContainer" containerID="e0e9cea61b7b998373f3b4bb0e0d47e3eb867d8e2daeca55ef6edf1eeff4a124" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.250166 4769 scope.go:117] "RemoveContainer" containerID="42f881e43dc736f6bf238d9cfa131e449db41847556c165bb59a9f0e9a1e875e" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.278910 4769 scope.go:117] "RemoveContainer" containerID="9754745f9a00287fa86e89b74e0e2566fa28c15d4fbe9ffbb4ff59569b381ed7" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.296537 4769 scope.go:117] "RemoveContainer" containerID="c26f7c9aa2914a8f6801fd98ac42edb8bbc0471d7738942c92027ebbb3ff6c98" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.324213 4769 scope.go:117] "RemoveContainer" containerID="eb14ad2835742688f894fb0a17e31ae5f38570c0b37d544867c47e03a0f2e5fa" Nov 21 13:46:10 crc kubenswrapper[4769]: I1121 13:46:10.362452 4769 scope.go:117] "RemoveContainer" containerID="ab258edd23bf216a2fc7fcc8078a71a0af84e7f1c6cffb58c44b4f1bcc8cdbaf" Nov 21 13:46:17 crc kubenswrapper[4769]: I1121 13:46:17.257860 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.535069 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg"] Nov 21 13:46:20 crc kubenswrapper[4769]: E1121 13:46:20.535946 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f635ca6c-5255-4398-af8b-a93e3bb68d30" containerName="registry-server" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.535969 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f635ca6c-5255-4398-af8b-a93e3bb68d30" containerName="registry-server" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.536273 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f635ca6c-5255-4398-af8b-a93e3bb68d30" containerName="registry-server" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.537924 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.540281 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.551701 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg"] Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.699460 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.699745 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnl99\" (UniqueName: \"kubernetes.io/projected/9c28be51-621e-4ef1-ab7f-38c79287cee9-kube-api-access-tnl99\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.699862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.801915 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.802109 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tnl99\" (UniqueName: \"kubernetes.io/projected/9c28be51-621e-4ef1-ab7f-38c79287cee9-kube-api-access-tnl99\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.802224 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.802890 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.802938 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.844848 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnl99\" (UniqueName: \"kubernetes.io/projected/9c28be51-621e-4ef1-ab7f-38c79287cee9-kube-api-access-tnl99\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:20 crc kubenswrapper[4769]: I1121 13:46:20.860526 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:21 crc kubenswrapper[4769]: I1121 13:46:21.335825 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg"] Nov 21 13:46:21 crc kubenswrapper[4769]: W1121 13:46:21.344074 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c28be51_621e_4ef1_ab7f_38c79287cee9.slice/crio-e6e46e7c37fc7b628718507ca0e5f4b934bdc29a0b3aecb686869680022e38ba WatchSource:0}: Error finding container e6e46e7c37fc7b628718507ca0e5f4b934bdc29a0b3aecb686869680022e38ba: Status 404 returned error can't find the container with id e6e46e7c37fc7b628718507ca0e5f4b934bdc29a0b3aecb686869680022e38ba Nov 21 13:46:21 crc kubenswrapper[4769]: I1121 13:46:21.623479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" event={"ID":"9c28be51-621e-4ef1-ab7f-38c79287cee9","Type":"ContainerStarted","Data":"e6e46e7c37fc7b628718507ca0e5f4b934bdc29a0b3aecb686869680022e38ba"} Nov 21 13:46:22 crc kubenswrapper[4769]: I1121 13:46:22.631891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" event={"ID":"9c28be51-621e-4ef1-ab7f-38c79287cee9","Type":"ContainerStarted","Data":"9ff5de99dd85272baf725d217148fce1ed71e5f59673c090d10e83fde6386e98"} Nov 21 13:46:23 crc kubenswrapper[4769]: I1121 13:46:23.639164 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerID="9ff5de99dd85272baf725d217148fce1ed71e5f59673c090d10e83fde6386e98" exitCode=0 Nov 21 13:46:23 crc kubenswrapper[4769]: I1121 13:46:23.639216 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" event={"ID":"9c28be51-621e-4ef1-ab7f-38c79287cee9","Type":"ContainerDied","Data":"9ff5de99dd85272baf725d217148fce1ed71e5f59673c090d10e83fde6386e98"} Nov 21 13:46:29 crc kubenswrapper[4769]: I1121 13:46:29.687508 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerID="a249fca7fc9d5a27076588224cf2e1966bf0bd096db84b8a911bff50a9ec25e9" exitCode=0 Nov 21 13:46:29 crc kubenswrapper[4769]: I1121 13:46:29.687791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" event={"ID":"9c28be51-621e-4ef1-ab7f-38c79287cee9","Type":"ContainerDied","Data":"a249fca7fc9d5a27076588224cf2e1966bf0bd096db84b8a911bff50a9ec25e9"} Nov 21 13:46:30 crc kubenswrapper[4769]: I1121 13:46:30.702888 4769 generic.go:334] "Generic (PLEG): container finished" podID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerID="29537eb34302fca68816db789d0e694aabbe1954272b14d615bcdb2d8b59a928" exitCode=0 Nov 21 13:46:30 crc kubenswrapper[4769]: I1121 13:46:30.702941 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" event={"ID":"9c28be51-621e-4ef1-ab7f-38c79287cee9","Type":"ContainerDied","Data":"29537eb34302fca68816db789d0e694aabbe1954272b14d615bcdb2d8b59a928"} Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.073272 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.188653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnl99\" (UniqueName: \"kubernetes.io/projected/9c28be51-621e-4ef1-ab7f-38c79287cee9-kube-api-access-tnl99\") pod \"9c28be51-621e-4ef1-ab7f-38c79287cee9\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.188714 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-util\") pod \"9c28be51-621e-4ef1-ab7f-38c79287cee9\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.188912 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-bundle\") pod \"9c28be51-621e-4ef1-ab7f-38c79287cee9\" (UID: \"9c28be51-621e-4ef1-ab7f-38c79287cee9\") " Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.189572 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-bundle" (OuterVolumeSpecName: "bundle") pod "9c28be51-621e-4ef1-ab7f-38c79287cee9" (UID: "9c28be51-621e-4ef1-ab7f-38c79287cee9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.189830 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.193029 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c28be51-621e-4ef1-ab7f-38c79287cee9-kube-api-access-tnl99" (OuterVolumeSpecName: "kube-api-access-tnl99") pod "9c28be51-621e-4ef1-ab7f-38c79287cee9" (UID: "9c28be51-621e-4ef1-ab7f-38c79287cee9"). InnerVolumeSpecName "kube-api-access-tnl99". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.203844 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-util" (OuterVolumeSpecName: "util") pod "9c28be51-621e-4ef1-ab7f-38c79287cee9" (UID: "9c28be51-621e-4ef1-ab7f-38c79287cee9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.290737 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tnl99\" (UniqueName: \"kubernetes.io/projected/9c28be51-621e-4ef1-ab7f-38c79287cee9-kube-api-access-tnl99\") on node \"crc\" DevicePath \"\"" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.290773 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c28be51-621e-4ef1-ab7f-38c79287cee9-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.725926 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" event={"ID":"9c28be51-621e-4ef1-ab7f-38c79287cee9","Type":"ContainerDied","Data":"e6e46e7c37fc7b628718507ca0e5f4b934bdc29a0b3aecb686869680022e38ba"} Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.725996 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6e46e7c37fc7b628718507ca0e5f4b934bdc29a0b3aecb686869680022e38ba" Nov 21 13:46:32 crc kubenswrapper[4769]: I1121 13:46:32.726960 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.396825 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp"] Nov 21 13:46:39 crc kubenswrapper[4769]: E1121 13:46:39.398007 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="util" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.398023 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="util" Nov 21 13:46:39 crc kubenswrapper[4769]: E1121 13:46:39.398036 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="extract" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.398043 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="extract" Nov 21 13:46:39 crc kubenswrapper[4769]: E1121 13:46:39.398060 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="pull" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.398067 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="pull" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.398288 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" containerName="extract" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.399072 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.401276 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-dockercfg-7wpph" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.401164 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-service-cert" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.401521 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"webhook-server-cert" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.425284 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp"] Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.507285 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjp47\" (UniqueName: \"kubernetes.io/projected/7311aada-952e-463a-83ec-096997995f86-kube-api-access-wjp47\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.507347 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-webhook-cert\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.507393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-apiservice-cert\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.609117 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjp47\" (UniqueName: \"kubernetes.io/projected/7311aada-952e-463a-83ec-096997995f86-kube-api-access-wjp47\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.609218 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-webhook-cert\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.609285 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-apiservice-cert\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.615500 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-apiservice-cert\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.615589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-webhook-cert\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.629948 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjp47\" (UniqueName: \"kubernetes.io/projected/7311aada-952e-463a-83ec-096997995f86-kube-api-access-wjp47\") pod \"mariadb-operator-controller-manager-79b79744f5-zdrqp\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.720566 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:39 crc kubenswrapper[4769]: I1121 13:46:39.960898 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp"] Nov 21 13:46:40 crc kubenswrapper[4769]: I1121 13:46:40.806938 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" event={"ID":"7311aada-952e-463a-83ec-096997995f86","Type":"ContainerStarted","Data":"06f68bc619407e3520397d5894d3ee341a26b324bb77cc573f6be1eb8d7c0522"} Nov 21 13:46:44 crc kubenswrapper[4769]: I1121 13:46:44.840078 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" event={"ID":"7311aada-952e-463a-83ec-096997995f86","Type":"ContainerStarted","Data":"8dfc38976561d30395f660bd99989ed6723b296af5fb1a8de89273ca422c774f"} Nov 21 13:46:45 crc kubenswrapper[4769]: I1121 13:46:45.847329 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" event={"ID":"7311aada-952e-463a-83ec-096997995f86","Type":"ContainerStarted","Data":"0960e9159e13c18a7f74aa5f82da081f606897f24118a3ea4217ba1f98b9838c"} Nov 21 13:46:45 crc kubenswrapper[4769]: I1121 13:46:45.847524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:45 crc kubenswrapper[4769]: I1121 13:46:45.870603 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" podStartSLOduration=2.520065149 podStartE2EDuration="6.870585529s" podCreationTimestamp="2025-11-21 13:46:39 +0000 UTC" firstStartedPulling="2025-11-21 13:46:39.969920901 +0000 UTC m=+6958.670582709" lastFinishedPulling="2025-11-21 13:46:44.320441271 +0000 UTC m=+6963.021103089" observedRunningTime="2025-11-21 13:46:45.869665414 +0000 UTC m=+6964.570327252" watchObservedRunningTime="2025-11-21 13:46:45.870585529 +0000 UTC m=+6964.571247347" Nov 21 13:46:49 crc kubenswrapper[4769]: I1121 13:46:49.726360 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.422421 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-lhbp4"] Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.424420 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.426783 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-index-dockercfg-8qls6" Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.431426 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-lhbp4"] Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.499787 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hw6\" (UniqueName: \"kubernetes.io/projected/ea5acf56-1421-40a0-b359-7a7e7febef3f-kube-api-access-68hw6\") pod \"infra-operator-index-lhbp4\" (UID: \"ea5acf56-1421-40a0-b359-7a7e7febef3f\") " pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.601713 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68hw6\" (UniqueName: \"kubernetes.io/projected/ea5acf56-1421-40a0-b359-7a7e7febef3f-kube-api-access-68hw6\") pod \"infra-operator-index-lhbp4\" (UID: \"ea5acf56-1421-40a0-b359-7a7e7febef3f\") " pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.644958 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hw6\" (UniqueName: \"kubernetes.io/projected/ea5acf56-1421-40a0-b359-7a7e7febef3f-kube-api-access-68hw6\") pod \"infra-operator-index-lhbp4\" (UID: \"ea5acf56-1421-40a0-b359-7a7e7febef3f\") " pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:46:52 crc kubenswrapper[4769]: I1121 13:46:52.752708 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:46:53 crc kubenswrapper[4769]: I1121 13:46:53.205215 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-lhbp4"] Nov 21 13:46:53 crc kubenswrapper[4769]: W1121 13:46:53.213112 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5acf56_1421_40a0_b359_7a7e7febef3f.slice/crio-3c78481907b36babfcd22abd41e06f83f188e7784c11d76326b906ab1dcdf507 WatchSource:0}: Error finding container 3c78481907b36babfcd22abd41e06f83f188e7784c11d76326b906ab1dcdf507: Status 404 returned error can't find the container with id 3c78481907b36babfcd22abd41e06f83f188e7784c11d76326b906ab1dcdf507 Nov 21 13:46:53 crc kubenswrapper[4769]: I1121 13:46:53.909955 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-lhbp4" event={"ID":"ea5acf56-1421-40a0-b359-7a7e7febef3f","Type":"ContainerStarted","Data":"3c78481907b36babfcd22abd41e06f83f188e7784c11d76326b906ab1dcdf507"} Nov 21 13:46:56 crc kubenswrapper[4769]: I1121 13:46:56.815073 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-lhbp4"] Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.428648 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-gm2nn"] Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.432989 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.445005 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-gm2nn"] Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.485281 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kl7d\" (UniqueName: \"kubernetes.io/projected/e10ce26a-37b5-4d89-a90c-653b7f4c03b2-kube-api-access-2kl7d\") pod \"infra-operator-index-gm2nn\" (UID: \"e10ce26a-37b5-4d89-a90c-653b7f4c03b2\") " pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.587533 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2kl7d\" (UniqueName: \"kubernetes.io/projected/e10ce26a-37b5-4d89-a90c-653b7f4c03b2-kube-api-access-2kl7d\") pod \"infra-operator-index-gm2nn\" (UID: \"e10ce26a-37b5-4d89-a90c-653b7f4c03b2\") " pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.617547 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kl7d\" (UniqueName: \"kubernetes.io/projected/e10ce26a-37b5-4d89-a90c-653b7f4c03b2-kube-api-access-2kl7d\") pod \"infra-operator-index-gm2nn\" (UID: \"e10ce26a-37b5-4d89-a90c-653b7f4c03b2\") " pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:46:57 crc kubenswrapper[4769]: I1121 13:46:57.781797 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:46:58 crc kubenswrapper[4769]: I1121 13:46:58.249378 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-gm2nn"] Nov 21 13:46:58 crc kubenswrapper[4769]: W1121 13:46:58.257207 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10ce26a_37b5_4d89_a90c_653b7f4c03b2.slice/crio-9375cc4f0041ed752fdb2859b4525f85b37a240bc9b9d2caf4f2cca0c5ad7919 WatchSource:0}: Error finding container 9375cc4f0041ed752fdb2859b4525f85b37a240bc9b9d2caf4f2cca0c5ad7919: Status 404 returned error can't find the container with id 9375cc4f0041ed752fdb2859b4525f85b37a240bc9b9d2caf4f2cca0c5ad7919 Nov 21 13:46:58 crc kubenswrapper[4769]: I1121 13:46:58.964145 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gm2nn" event={"ID":"e10ce26a-37b5-4d89-a90c-653b7f4c03b2","Type":"ContainerStarted","Data":"9375cc4f0041ed752fdb2859b4525f85b37a240bc9b9d2caf4f2cca0c5ad7919"} Nov 21 13:47:00 crc kubenswrapper[4769]: I1121 13:47:00.978319 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-lhbp4" event={"ID":"ea5acf56-1421-40a0-b359-7a7e7febef3f","Type":"ContainerStarted","Data":"6cf2e2c2d9f542407e28abea2d0ff8525b748633786175f43903adb62b22528f"} Nov 21 13:47:00 crc kubenswrapper[4769]: I1121 13:47:00.978509 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-lhbp4" podUID="ea5acf56-1421-40a0-b359-7a7e7febef3f" containerName="registry-server" containerID="cri-o://6cf2e2c2d9f542407e28abea2d0ff8525b748633786175f43903adb62b22528f" gracePeriod=2 Nov 21 13:47:00 crc kubenswrapper[4769]: I1121 13:47:00.979973 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gm2nn" event={"ID":"e10ce26a-37b5-4d89-a90c-653b7f4c03b2","Type":"ContainerStarted","Data":"e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e"} Nov 21 13:47:01 crc kubenswrapper[4769]: I1121 13:47:01.003720 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-lhbp4" podStartSLOduration=2.47050011 podStartE2EDuration="9.00369545s" podCreationTimestamp="2025-11-21 13:46:52 +0000 UTC" firstStartedPulling="2025-11-21 13:46:53.21566311 +0000 UTC m=+6971.916324948" lastFinishedPulling="2025-11-21 13:46:59.74885847 +0000 UTC m=+6978.449520288" observedRunningTime="2025-11-21 13:47:01.000932457 +0000 UTC m=+6979.701594325" watchObservedRunningTime="2025-11-21 13:47:01.00369545 +0000 UTC m=+6979.704357268" Nov 21 13:47:01 crc kubenswrapper[4769]: I1121 13:47:01.028180 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-gm2nn" podStartSLOduration=2.530177696 podStartE2EDuration="4.028155189s" podCreationTimestamp="2025-11-21 13:46:57 +0000 UTC" firstStartedPulling="2025-11-21 13:46:58.260300957 +0000 UTC m=+6976.960962785" lastFinishedPulling="2025-11-21 13:46:59.75827846 +0000 UTC m=+6978.458940278" observedRunningTime="2025-11-21 13:47:01.027892512 +0000 UTC m=+6979.728554360" watchObservedRunningTime="2025-11-21 13:47:01.028155189 +0000 UTC m=+6979.728817007" Nov 21 13:47:01 crc kubenswrapper[4769]: I1121 13:47:01.992673 4769 generic.go:334] "Generic (PLEG): container finished" podID="ea5acf56-1421-40a0-b359-7a7e7febef3f" containerID="6cf2e2c2d9f542407e28abea2d0ff8525b748633786175f43903adb62b22528f" exitCode=0 Nov 21 13:47:01 crc kubenswrapper[4769]: I1121 13:47:01.992890 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-lhbp4" event={"ID":"ea5acf56-1421-40a0-b359-7a7e7febef3f","Type":"ContainerDied","Data":"6cf2e2c2d9f542407e28abea2d0ff8525b748633786175f43903adb62b22528f"} Nov 21 13:47:02 crc kubenswrapper[4769]: I1121 13:47:02.136906 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:47:02 crc kubenswrapper[4769]: I1121 13:47:02.324575 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68hw6\" (UniqueName: \"kubernetes.io/projected/ea5acf56-1421-40a0-b359-7a7e7febef3f-kube-api-access-68hw6\") pod \"ea5acf56-1421-40a0-b359-7a7e7febef3f\" (UID: \"ea5acf56-1421-40a0-b359-7a7e7febef3f\") " Nov 21 13:47:02 crc kubenswrapper[4769]: I1121 13:47:02.330828 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5acf56-1421-40a0-b359-7a7e7febef3f-kube-api-access-68hw6" (OuterVolumeSpecName: "kube-api-access-68hw6") pod "ea5acf56-1421-40a0-b359-7a7e7febef3f" (UID: "ea5acf56-1421-40a0-b359-7a7e7febef3f"). InnerVolumeSpecName "kube-api-access-68hw6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:47:02 crc kubenswrapper[4769]: I1121 13:47:02.428539 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68hw6\" (UniqueName: \"kubernetes.io/projected/ea5acf56-1421-40a0-b359-7a7e7febef3f-kube-api-access-68hw6\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:03 crc kubenswrapper[4769]: I1121 13:47:03.001431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-lhbp4" event={"ID":"ea5acf56-1421-40a0-b359-7a7e7febef3f","Type":"ContainerDied","Data":"3c78481907b36babfcd22abd41e06f83f188e7784c11d76326b906ab1dcdf507"} Nov 21 13:47:03 crc kubenswrapper[4769]: I1121 13:47:03.001487 4769 scope.go:117] "RemoveContainer" containerID="6cf2e2c2d9f542407e28abea2d0ff8525b748633786175f43903adb62b22528f" Nov 21 13:47:03 crc kubenswrapper[4769]: I1121 13:47:03.001506 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-lhbp4" Nov 21 13:47:03 crc kubenswrapper[4769]: I1121 13:47:03.037884 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-lhbp4"] Nov 21 13:47:03 crc kubenswrapper[4769]: I1121 13:47:03.046366 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-lhbp4"] Nov 21 13:47:03 crc kubenswrapper[4769]: I1121 13:47:03.283407 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea5acf56-1421-40a0-b359-7a7e7febef3f" path="/var/lib/kubelet/pods/ea5acf56-1421-40a0-b359-7a7e7febef3f/volumes" Nov 21 13:47:07 crc kubenswrapper[4769]: I1121 13:47:07.782136 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:47:07 crc kubenswrapper[4769]: I1121 13:47:07.782636 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:47:07 crc kubenswrapper[4769]: I1121 13:47:07.817030 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:47:08 crc kubenswrapper[4769]: I1121 13:47:08.083200 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:47:09 crc kubenswrapper[4769]: I1121 13:47:09.861137 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7"] Nov 21 13:47:09 crc kubenswrapper[4769]: E1121 13:47:09.861702 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ea5acf56-1421-40a0-b359-7a7e7febef3f" containerName="registry-server" Nov 21 13:47:09 crc kubenswrapper[4769]: I1121 13:47:09.861715 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5acf56-1421-40a0-b359-7a7e7febef3f" containerName="registry-server" Nov 21 13:47:09 crc kubenswrapper[4769]: I1121 13:47:09.861843 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ea5acf56-1421-40a0-b359-7a7e7febef3f" containerName="registry-server" Nov 21 13:47:09 crc kubenswrapper[4769]: I1121 13:47:09.862709 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:09 crc kubenswrapper[4769]: I1121 13:47:09.864277 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:47:09 crc kubenswrapper[4769]: I1121 13:47:09.904755 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7"] Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.042038 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.042172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtww9\" (UniqueName: \"kubernetes.io/projected/6c71584b-78d9-4bd2-8929-7687d1c23342-kube-api-access-xtww9\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.042246 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.143970 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xtww9\" (UniqueName: \"kubernetes.io/projected/6c71584b-78d9-4bd2-8929-7687d1c23342-kube-api-access-xtww9\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.144031 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.144072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.144766 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.145172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.164779 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtww9\" (UniqueName: \"kubernetes.io/projected/6c71584b-78d9-4bd2-8929-7687d1c23342-kube-api-access-xtww9\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.205012 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.622438 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7"] Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.898563 4769 scope.go:117] "RemoveContainer" containerID="a6f75551f03a2f3dc133679e52d60943aa90aacaceed5f9d0bf97e932fc398b7" Nov 21 13:47:10 crc kubenswrapper[4769]: I1121 13:47:10.924728 4769 scope.go:117] "RemoveContainer" containerID="a9e7081a46f9def16167fe9602facf26e208570c8f054429e4582862dbc7ed04" Nov 21 13:47:11 crc kubenswrapper[4769]: I1121 13:47:11.064012 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" event={"ID":"6c71584b-78d9-4bd2-8929-7687d1c23342","Type":"ContainerStarted","Data":"8620d3ff53052b6670c89850f48f73417253a2c817489b677ccce3d45e744e90"} Nov 21 13:47:12 crc kubenswrapper[4769]: I1121 13:47:12.074076 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerID="aeba9e09314922ccb3045a5b9261923a9e0761dddd82274061f292d28d4df3e4" exitCode=0 Nov 21 13:47:12 crc kubenswrapper[4769]: I1121 13:47:12.074171 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" event={"ID":"6c71584b-78d9-4bd2-8929-7687d1c23342","Type":"ContainerDied","Data":"aeba9e09314922ccb3045a5b9261923a9e0761dddd82274061f292d28d4df3e4"} Nov 21 13:47:12 crc kubenswrapper[4769]: I1121 13:47:12.076064 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.129897 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerID="ab056df1be4e03aba5057c0b0dbfbaa702823431a0872111e7646961d993c15a" exitCode=0 Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.129968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" event={"ID":"6c71584b-78d9-4bd2-8929-7687d1c23342","Type":"ContainerDied","Data":"ab056df1be4e03aba5057c0b0dbfbaa702823431a0872111e7646961d993c15a"} Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.204143 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.206333 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.209132 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"galera-openstack-dockercfg-t8nrb" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.209323 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"kube-root-ca.crt" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.209485 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"openstack-scripts" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.209510 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"openshift-service-ca.crt" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.209501 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"openstack-config-data" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.216552 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.217881 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.221239 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.222306 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.225178 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.255360 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.302611 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365540 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-default\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-kolla-config\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365650 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kolla-config\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365826 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f56zt\" (UniqueName: \"kubernetes.io/projected/26598e29-5cf4-4491-bd0a-29b0398e233b-kube-api-access-f56zt\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-default\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.365949 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-kolla-config\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366007 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366088 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-generated\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366129 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-operator-scripts\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366160 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366214 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-default\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366244 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-operator-scripts\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsm5p\" (UniqueName: \"kubernetes.io/projected/d16b01be-7f06-41df-b88c-5c318414ce0f-kube-api-access-vsm5p\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366296 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww65s\" (UniqueName: \"kubernetes.io/projected/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kube-api-access-ww65s\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-generated\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.366393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.467957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-operator-scripts\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vsm5p\" (UniqueName: \"kubernetes.io/projected/d16b01be-7f06-41df-b88c-5c318414ce0f-kube-api-access-vsm5p\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468103 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ww65s\" (UniqueName: \"kubernetes.io/projected/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kube-api-access-ww65s\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468156 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-generated\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468227 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468362 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-default\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-kolla-config\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468400 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468443 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kolla-config\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468465 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-default\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468503 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f56zt\" (UniqueName: \"kubernetes.io/projected/26598e29-5cf4-4491-bd0a-29b0398e233b-kube-api-access-f56zt\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468529 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-kolla-config\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-generated\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468626 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-operator-scripts\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468711 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-default\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.468846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.469280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-generated\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.469601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-default\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.469604 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") device mount path \"/mnt/openstack/pv01\"" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.469745 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") device mount path \"/mnt/openstack/pv16\"" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.470063 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-kolla-config\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.470673 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-operator-scripts\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.471346 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kolla-config\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.471689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.471920 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-default\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.472622 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-default\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.472829 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") device mount path \"/mnt/openstack/pv05\"" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.472889 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-kolla-config\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.473339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-generated\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.482676 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-operator-scripts\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.489068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww65s\" (UniqueName: \"kubernetes.io/projected/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kube-api-access-ww65s\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.489388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsm5p\" (UniqueName: \"kubernetes.io/projected/d16b01be-7f06-41df-b88c-5c318414ce0f-kube-api-access-vsm5p\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.491739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.493280 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f56zt\" (UniqueName: \"kubernetes.io/projected/26598e29-5cf4-4491-bd0a-29b0398e233b-kube-api-access-f56zt\") pod \"openstack-galera-2\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.504255 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.535739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-galera-1\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.580828 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.592233 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.608559 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.835698 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Nov 21 13:47:18 crc kubenswrapper[4769]: W1121 13:47:18.844089 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26598e29_5cf4_4491_bd0a_29b0398e233b.slice/crio-af49ef0c75462817176a2c36a13f914c0777c5d26c6871b90d668236b3e4a0c7 WatchSource:0}: Error finding container af49ef0c75462817176a2c36a13f914c0777c5d26c6871b90d668236b3e4a0c7: Status 404 returned error can't find the container with id af49ef0c75462817176a2c36a13f914c0777c5d26c6871b90d668236b3e4a0c7 Nov 21 13:47:18 crc kubenswrapper[4769]: I1121 13:47:18.883314 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Nov 21 13:47:18 crc kubenswrapper[4769]: W1121 13:47:18.885348 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410e07d7_e067_461d_8b05_9ae39cb5d5ad.slice/crio-a3249f194fed0becec1efb2b67e178cde7e4f53c4fad4deaab1794f7ea2d86a6 WatchSource:0}: Error finding container a3249f194fed0becec1efb2b67e178cde7e4f53c4fad4deaab1794f7ea2d86a6: Status 404 returned error can't find the container with id a3249f194fed0becec1efb2b67e178cde7e4f53c4fad4deaab1794f7ea2d86a6 Nov 21 13:47:19 crc kubenswrapper[4769]: I1121 13:47:19.129450 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Nov 21 13:47:19 crc kubenswrapper[4769]: W1121 13:47:19.132381 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd16b01be_7f06_41df_b88c_5c318414ce0f.slice/crio-7d254d4a1ff8bdab71fb5d69619142c700da28b8016eb3f69b230808d2b38879 WatchSource:0}: Error finding container 7d254d4a1ff8bdab71fb5d69619142c700da28b8016eb3f69b230808d2b38879: Status 404 returned error can't find the container with id 7d254d4a1ff8bdab71fb5d69619142c700da28b8016eb3f69b230808d2b38879 Nov 21 13:47:19 crc kubenswrapper[4769]: I1121 13:47:19.147721 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" event={"ID":"6c71584b-78d9-4bd2-8929-7687d1c23342","Type":"ContainerStarted","Data":"38934b8e502b17c0f338baccad0231490c3fb3b467f090b93beb8e98bd832ce6"} Nov 21 13:47:19 crc kubenswrapper[4769]: I1121 13:47:19.152799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"410e07d7-e067-461d-8b05-9ae39cb5d5ad","Type":"ContainerStarted","Data":"a3249f194fed0becec1efb2b67e178cde7e4f53c4fad4deaab1794f7ea2d86a6"} Nov 21 13:47:19 crc kubenswrapper[4769]: I1121 13:47:19.154648 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"26598e29-5cf4-4491-bd0a-29b0398e233b","Type":"ContainerStarted","Data":"af49ef0c75462817176a2c36a13f914c0777c5d26c6871b90d668236b3e4a0c7"} Nov 21 13:47:19 crc kubenswrapper[4769]: I1121 13:47:19.171562 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" podStartSLOduration=6.161514094 podStartE2EDuration="10.171483346s" podCreationTimestamp="2025-11-21 13:47:09 +0000 UTC" firstStartedPulling="2025-11-21 13:47:12.075755042 +0000 UTC m=+6990.776416860" lastFinishedPulling="2025-11-21 13:47:16.085724294 +0000 UTC m=+6994.786386112" observedRunningTime="2025-11-21 13:47:19.165728013 +0000 UTC m=+6997.866389851" watchObservedRunningTime="2025-11-21 13:47:19.171483346 +0000 UTC m=+6997.872145204" Nov 21 13:47:20 crc kubenswrapper[4769]: I1121 13:47:20.165265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"d16b01be-7f06-41df-b88c-5c318414ce0f","Type":"ContainerStarted","Data":"7d254d4a1ff8bdab71fb5d69619142c700da28b8016eb3f69b230808d2b38879"} Nov 21 13:47:20 crc kubenswrapper[4769]: I1121 13:47:20.172265 4769 generic.go:334] "Generic (PLEG): container finished" podID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerID="38934b8e502b17c0f338baccad0231490c3fb3b467f090b93beb8e98bd832ce6" exitCode=0 Nov 21 13:47:20 crc kubenswrapper[4769]: I1121 13:47:20.172318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" event={"ID":"6c71584b-78d9-4bd2-8929-7687d1c23342","Type":"ContainerDied","Data":"38934b8e502b17c0f338baccad0231490c3fb3b467f090b93beb8e98bd832ce6"} Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.374785 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.431155 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-qsmzz"] Nov 21 13:47:22 crc kubenswrapper[4769]: E1121 13:47:22.431459 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="util" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.431470 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="util" Nov 21 13:47:22 crc kubenswrapper[4769]: E1121 13:47:22.431477 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="pull" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.431482 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="pull" Nov 21 13:47:22 crc kubenswrapper[4769]: E1121 13:47:22.431495 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="extract" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.431501 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="extract" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.431614 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" containerName="extract" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.432443 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.446175 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-qsmzz"] Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.524909 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-util\") pod \"6c71584b-78d9-4bd2-8929-7687d1c23342\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.524967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-bundle\") pod \"6c71584b-78d9-4bd2-8929-7687d1c23342\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.525090 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtww9\" (UniqueName: \"kubernetes.io/projected/6c71584b-78d9-4bd2-8929-7687d1c23342-kube-api-access-xtww9\") pod \"6c71584b-78d9-4bd2-8929-7687d1c23342\" (UID: \"6c71584b-78d9-4bd2-8929-7687d1c23342\") " Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.525263 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-catalog-content\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.525308 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bct8\" (UniqueName: \"kubernetes.io/projected/d18d3abe-3006-4b88-8f67-aef21e355ff9-kube-api-access-4bct8\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.525381 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-utilities\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.526133 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-bundle" (OuterVolumeSpecName: "bundle") pod "6c71584b-78d9-4bd2-8929-7687d1c23342" (UID: "6c71584b-78d9-4bd2-8929-7687d1c23342"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.531793 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c71584b-78d9-4bd2-8929-7687d1c23342-kube-api-access-xtww9" (OuterVolumeSpecName: "kube-api-access-xtww9") pod "6c71584b-78d9-4bd2-8929-7687d1c23342" (UID: "6c71584b-78d9-4bd2-8929-7687d1c23342"). InnerVolumeSpecName "kube-api-access-xtww9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.540257 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-util" (OuterVolumeSpecName: "util") pod "6c71584b-78d9-4bd2-8929-7687d1c23342" (UID: "6c71584b-78d9-4bd2-8929-7687d1c23342"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.626929 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4bct8\" (UniqueName: \"kubernetes.io/projected/d18d3abe-3006-4b88-8f67-aef21e355ff9-kube-api-access-4bct8\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.627055 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-utilities\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.627090 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-catalog-content\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.627207 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.627228 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c71584b-78d9-4bd2-8929-7687d1c23342-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.627242 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xtww9\" (UniqueName: \"kubernetes.io/projected/6c71584b-78d9-4bd2-8929-7687d1c23342-kube-api-access-xtww9\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.628174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-catalog-content\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.628288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-utilities\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.647160 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bct8\" (UniqueName: \"kubernetes.io/projected/d18d3abe-3006-4b88-8f67-aef21e355ff9-kube-api-access-4bct8\") pod \"community-operators-qsmzz\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:22 crc kubenswrapper[4769]: I1121 13:47:22.771665 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:23 crc kubenswrapper[4769]: I1121 13:47:23.077070 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-qsmzz"] Nov 21 13:47:23 crc kubenswrapper[4769]: W1121 13:47:23.127037 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18d3abe_3006_4b88_8f67_aef21e355ff9.slice/crio-fa07971813f74da12748eeb7a013cace4e80ed6c2f6a9b0f5ae3df275b51b68f WatchSource:0}: Error finding container fa07971813f74da12748eeb7a013cace4e80ed6c2f6a9b0f5ae3df275b51b68f: Status 404 returned error can't find the container with id fa07971813f74da12748eeb7a013cace4e80ed6c2f6a9b0f5ae3df275b51b68f Nov 21 13:47:23 crc kubenswrapper[4769]: I1121 13:47:23.200286 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerStarted","Data":"fa07971813f74da12748eeb7a013cace4e80ed6c2f6a9b0f5ae3df275b51b68f"} Nov 21 13:47:23 crc kubenswrapper[4769]: I1121 13:47:23.202989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" event={"ID":"6c71584b-78d9-4bd2-8929-7687d1c23342","Type":"ContainerDied","Data":"8620d3ff53052b6670c89850f48f73417253a2c817489b677ccce3d45e744e90"} Nov 21 13:47:23 crc kubenswrapper[4769]: I1121 13:47:23.203036 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8620d3ff53052b6670c89850f48f73417253a2c817489b677ccce3d45e744e90" Nov 21 13:47:23 crc kubenswrapper[4769]: I1121 13:47:23.203083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7" Nov 21 13:47:25 crc kubenswrapper[4769]: I1121 13:47:25.227237 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerStarted","Data":"cecc8ffbf0fc7e09b058fbffb45d3271b500ef69b637b9cc698f8cbc8b0792d6"} Nov 21 13:47:26 crc kubenswrapper[4769]: I1121 13:47:26.237034 4769 generic.go:334] "Generic (PLEG): container finished" podID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerID="cecc8ffbf0fc7e09b058fbffb45d3271b500ef69b637b9cc698f8cbc8b0792d6" exitCode=0 Nov 21 13:47:26 crc kubenswrapper[4769]: I1121 13:47:26.237096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerDied","Data":"cecc8ffbf0fc7e09b058fbffb45d3271b500ef69b637b9cc698f8cbc8b0792d6"} Nov 21 13:47:30 crc kubenswrapper[4769]: I1121 13:47:30.269424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"d16b01be-7f06-41df-b88c-5c318414ce0f","Type":"ContainerStarted","Data":"f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631"} Nov 21 13:47:31 crc kubenswrapper[4769]: E1121 13:47:31.483160 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-mariadb@sha256:10452e2144368e2f128c8fb8ef9e54880b06ef1d71d9f084a0217dcb099c51ce" Nov 21 13:47:31 crc kubenswrapper[4769]: E1121 13:47:31.483634 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:mysql-bootstrap,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:10452e2144368e2f128c8fb8ef9e54880b06ef1d71d9f084a0217dcb099c51ce,Command:[bash /var/lib/operator-scripts/mysql_bootstrap.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:True,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:mysql-db,ReadOnly:false,MountPath:/var/lib/mysql,SubPath:mysql,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data-default,ReadOnly:true,MountPath:/var/lib/config-data/default,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:config-data-generated,ReadOnly:false,MountPath:/var/lib/config-data/generated,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:operator-scripts,ReadOnly:true,MountPath:/var/lib/operator-scripts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kolla-config,ReadOnly:true,MountPath:/var/lib/kolla/config_files,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-f56zt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod openstack-galera-2_barbican-kuttl-tests(26598e29-5cf4-4491-bd0a-29b0398e233b): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 13:47:31 crc kubenswrapper[4769]: E1121 13:47:31.484842 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mysql-bootstrap\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="barbican-kuttl-tests/openstack-galera-2" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.285088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"410e07d7-e067-461d-8b05-9ae39cb5d5ad","Type":"ContainerStarted","Data":"c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37"} Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.404070 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4"] Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.405228 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.407128 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-dockercfg-k9kwc" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.407343 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-service-cert" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.431755 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4"] Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.592170 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-apiservice-cert\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.592261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smvtv\" (UniqueName: \"kubernetes.io/projected/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-kube-api-access-smvtv\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.592392 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-webhook-cert\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.696061 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-webhook-cert\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.696126 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-apiservice-cert\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.696169 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-smvtv\" (UniqueName: \"kubernetes.io/projected/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-kube-api-access-smvtv\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.711773 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-webhook-cert\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.723836 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-apiservice-cert\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:32 crc kubenswrapper[4769]: I1121 13:47:32.750569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-smvtv\" (UniqueName: \"kubernetes.io/projected/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-kube-api-access-smvtv\") pod \"infra-operator-controller-manager-84d5567896-8x8p4\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:33 crc kubenswrapper[4769]: I1121 13:47:33.020969 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:33 crc kubenswrapper[4769]: I1121 13:47:33.719045 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4"] Nov 21 13:47:34 crc kubenswrapper[4769]: I1121 13:47:34.306777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" event={"ID":"e4304eb4-35c7-4b0c-ad68-a28e2fec84de","Type":"ContainerStarted","Data":"0961b4c51d17b498fde45a2611bc780e0bc0ccbbfe262210c4bae36efe49cb58"} Nov 21 13:47:34 crc kubenswrapper[4769]: I1121 13:47:34.309114 4769 generic.go:334] "Generic (PLEG): container finished" podID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerID="5e23196c225274ead4630979473681bd96d853f75c5199eaf066a4ca30ad0a79" exitCode=0 Nov 21 13:47:34 crc kubenswrapper[4769]: I1121 13:47:34.309248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerDied","Data":"5e23196c225274ead4630979473681bd96d853f75c5199eaf066a4ca30ad0a79"} Nov 21 13:47:34 crc kubenswrapper[4769]: I1121 13:47:34.310667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"26598e29-5cf4-4491-bd0a-29b0398e233b","Type":"ContainerStarted","Data":"fb10c0577e58a3ca3d0d64bf8cab932a62862d049eb260c69e19242c45f55e70"} Nov 21 13:47:36 crc kubenswrapper[4769]: I1121 13:47:36.337992 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerStarted","Data":"458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4"} Nov 21 13:47:37 crc kubenswrapper[4769]: I1121 13:47:37.348814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" event={"ID":"e4304eb4-35c7-4b0c-ad68-a28e2fec84de","Type":"ContainerStarted","Data":"4a2d03740a12b799bde759dfcf27d1c0d438f17f9f439f27af58741521319ee4"} Nov 21 13:47:38 crc kubenswrapper[4769]: I1121 13:47:38.359819 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" event={"ID":"e4304eb4-35c7-4b0c-ad68-a28e2fec84de","Type":"ContainerStarted","Data":"bc6594335936abaa7cb28a954178d3c72070bd8918fb1832c6c17833db31870d"} Nov 21 13:47:38 crc kubenswrapper[4769]: I1121 13:47:38.360341 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:38 crc kubenswrapper[4769]: I1121 13:47:38.388222 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-qsmzz" podStartSLOduration=9.592754049 podStartE2EDuration="16.38817346s" podCreationTimestamp="2025-11-21 13:47:22 +0000 UTC" firstStartedPulling="2025-11-21 13:47:28.432512692 +0000 UTC m=+7007.133174520" lastFinishedPulling="2025-11-21 13:47:35.227932113 +0000 UTC m=+7013.928593931" observedRunningTime="2025-11-21 13:47:36.35988582 +0000 UTC m=+7015.060547638" watchObservedRunningTime="2025-11-21 13:47:38.38817346 +0000 UTC m=+7017.088835288" Nov 21 13:47:38 crc kubenswrapper[4769]: I1121 13:47:38.389960 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" podStartSLOduration=3.05152032 podStartE2EDuration="6.389945947s" podCreationTimestamp="2025-11-21 13:47:32 +0000 UTC" firstStartedPulling="2025-11-21 13:47:33.726202861 +0000 UTC m=+7012.426864679" lastFinishedPulling="2025-11-21 13:47:37.064628488 +0000 UTC m=+7015.765290306" observedRunningTime="2025-11-21 13:47:38.382943791 +0000 UTC m=+7017.083605619" watchObservedRunningTime="2025-11-21 13:47:38.389945947 +0000 UTC m=+7017.090607785" Nov 21 13:47:41 crc kubenswrapper[4769]: I1121 13:47:41.325283 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:47:41 crc kubenswrapper[4769]: I1121 13:47:41.325604 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.390379 4769 generic.go:334] "Generic (PLEG): container finished" podID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerID="f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631" exitCode=0 Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.390510 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"d16b01be-7f06-41df-b88c-5c318414ce0f","Type":"ContainerDied","Data":"f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631"} Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.392683 4769 generic.go:334] "Generic (PLEG): container finished" podID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerID="c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37" exitCode=0 Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.392759 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"410e07d7-e067-461d-8b05-9ae39cb5d5ad","Type":"ContainerDied","Data":"c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37"} Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.397095 4769 generic.go:334] "Generic (PLEG): container finished" podID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerID="fb10c0577e58a3ca3d0d64bf8cab932a62862d049eb260c69e19242c45f55e70" exitCode=0 Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.397140 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"26598e29-5cf4-4491-bd0a-29b0398e233b","Type":"ContainerDied","Data":"fb10c0577e58a3ca3d0d64bf8cab932a62862d049eb260c69e19242c45f55e70"} Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.772218 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.772286 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:42 crc kubenswrapper[4769]: I1121 13:47:42.813043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.026804 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.407347 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"d16b01be-7f06-41df-b88c-5c318414ce0f","Type":"ContainerStarted","Data":"4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9"} Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.410097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"410e07d7-e067-461d-8b05-9ae39cb5d5ad","Type":"ContainerStarted","Data":"1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3"} Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.413235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"26598e29-5cf4-4491-bd0a-29b0398e233b","Type":"ContainerStarted","Data":"fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936"} Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.453318 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/openstack-galera-0" podStartSLOduration=16.132166136 podStartE2EDuration="26.453298352s" podCreationTimestamp="2025-11-21 13:47:17 +0000 UTC" firstStartedPulling="2025-11-21 13:47:19.134691579 +0000 UTC m=+6997.835353407" lastFinishedPulling="2025-11-21 13:47:29.455823805 +0000 UTC m=+7008.156485623" observedRunningTime="2025-11-21 13:47:43.43439865 +0000 UTC m=+7022.135060488" watchObservedRunningTime="2025-11-21 13:47:43.453298352 +0000 UTC m=+7022.153960170" Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.456523 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/openstack-galera-1" podStartSLOduration=13.667909943 podStartE2EDuration="26.456512877s" podCreationTimestamp="2025-11-21 13:47:17 +0000 UTC" firstStartedPulling="2025-11-21 13:47:18.888296298 +0000 UTC m=+6997.588958116" lastFinishedPulling="2025-11-21 13:47:31.676899222 +0000 UTC m=+7010.377561050" observedRunningTime="2025-11-21 13:47:43.450479297 +0000 UTC m=+7022.151141115" watchObservedRunningTime="2025-11-21 13:47:43.456512877 +0000 UTC m=+7022.157174695" Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.477258 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:43 crc kubenswrapper[4769]: I1121 13:47:43.491822 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/openstack-galera-2" podStartSLOduration=-9223372010.362972 podStartE2EDuration="26.491803094s" podCreationTimestamp="2025-11-21 13:47:17 +0000 UTC" firstStartedPulling="2025-11-21 13:47:18.846031936 +0000 UTC m=+6997.546693754" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:47:43.47696789 +0000 UTC m=+7022.177629718" watchObservedRunningTime="2025-11-21 13:47:43.491803094 +0000 UTC m=+7022.192464912" Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.210270 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-qsmzz"] Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.210905 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-qsmzz" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="registry-server" containerID="cri-o://458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4" gracePeriod=2 Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.421854 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-vv5f6"] Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.422992 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.425147 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-index-dockercfg-fmznm" Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.446809 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-vv5f6"] Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.457002 4769 generic.go:334] "Generic (PLEG): container finished" podID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerID="458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4" exitCode=0 Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.457041 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerDied","Data":"458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4"} Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.558810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxl4b\" (UniqueName: \"kubernetes.io/projected/d81fbc0f-e8bf-4b34-927a-eca7c41601f6-kube-api-access-zxl4b\") pod \"rabbitmq-cluster-operator-index-vv5f6\" (UID: \"d81fbc0f-e8bf-4b34-927a-eca7c41601f6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.660721 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zxl4b\" (UniqueName: \"kubernetes.io/projected/d81fbc0f-e8bf-4b34-927a-eca7c41601f6-kube-api-access-zxl4b\") pod \"rabbitmq-cluster-operator-index-vv5f6\" (UID: \"d81fbc0f-e8bf-4b34-927a-eca7c41601f6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.678516 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxl4b\" (UniqueName: \"kubernetes.io/projected/d81fbc0f-e8bf-4b34-927a-eca7c41601f6-kube-api-access-zxl4b\") pod \"rabbitmq-cluster-operator-index-vv5f6\" (UID: \"d81fbc0f-e8bf-4b34-927a-eca7c41601f6\") " pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:47:47 crc kubenswrapper[4769]: I1121 13:47:47.740854 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:47:48 crc kubenswrapper[4769]: I1121 13:47:48.582505 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:48 crc kubenswrapper[4769]: I1121 13:47:48.582848 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:47:48 crc kubenswrapper[4769]: I1121 13:47:48.593363 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:48 crc kubenswrapper[4769]: I1121 13:47:48.593398 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:47:48 crc kubenswrapper[4769]: I1121 13:47:48.609127 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:48 crc kubenswrapper[4769]: I1121 13:47:48.609231 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:47:52 crc kubenswrapper[4769]: E1121 13:47:52.772939 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4 is running failed: container process not found" containerID="458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 13:47:52 crc kubenswrapper[4769]: E1121 13:47:52.773688 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4 is running failed: container process not found" containerID="458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 13:47:52 crc kubenswrapper[4769]: E1121 13:47:52.773987 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4 is running failed: container process not found" containerID="458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4" cmd=["grpc_health_probe","-addr=:50051"] Nov 21 13:47:52 crc kubenswrapper[4769]: E1121 13:47:52.774032 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4 is running failed: container process not found" probeType="Readiness" pod="openshift-marketplace/community-operators-qsmzz" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="registry-server" Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.011620 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-vv5f6"] Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.283468 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-vv5f6"] Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.507686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" event={"ID":"d81fbc0f-e8bf-4b34-927a-eca7c41601f6","Type":"ContainerStarted","Data":"3f6e8a186cca87ef6c8443d1b98dc2dfe906f13a376877fdaf6b6c228ef6f983"} Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.626131 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-4gnlr"] Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.627359 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.636165 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-4gnlr"] Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.751253 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg4mg\" (UniqueName: \"kubernetes.io/projected/8901532d-8a43-4089-ab38-2cf0c96845d7-kube-api-access-dg4mg\") pod \"rabbitmq-cluster-operator-index-4gnlr\" (UID: \"8901532d-8a43-4089-ab38-2cf0c96845d7\") " pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.852502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dg4mg\" (UniqueName: \"kubernetes.io/projected/8901532d-8a43-4089-ab38-2cf0c96845d7-kube-api-access-dg4mg\") pod \"rabbitmq-cluster-operator-index-4gnlr\" (UID: \"8901532d-8a43-4089-ab38-2cf0c96845d7\") " pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.884366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg4mg\" (UniqueName: \"kubernetes.io/projected/8901532d-8a43-4089-ab38-2cf0c96845d7-kube-api-access-dg4mg\") pod \"rabbitmq-cluster-operator-index-4gnlr\" (UID: \"8901532d-8a43-4089-ab38-2cf0c96845d7\") " pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:47:53 crc kubenswrapper[4769]: I1121 13:47:53.945458 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:47:54 crc kubenswrapper[4769]: I1121 13:47:54.355406 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-4gnlr"] Nov 21 13:47:54 crc kubenswrapper[4769]: W1121 13:47:54.366318 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8901532d_8a43_4089_ab38_2cf0c96845d7.slice/crio-79eee4d828c0962f14f08998c1d2fe484b3f2cfcf5ddbc2afa548e40cd9bf339 WatchSource:0}: Error finding container 79eee4d828c0962f14f08998c1d2fe484b3f2cfcf5ddbc2afa548e40cd9bf339: Status 404 returned error can't find the container with id 79eee4d828c0962f14f08998c1d2fe484b3f2cfcf5ddbc2afa548e40cd9bf339 Nov 21 13:47:54 crc kubenswrapper[4769]: I1121 13:47:54.515744 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" event={"ID":"8901532d-8a43-4089-ab38-2cf0c96845d7","Type":"ContainerStarted","Data":"79eee4d828c0962f14f08998c1d2fe484b3f2cfcf5ddbc2afa548e40cd9bf339"} Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.106033 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.229572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-utilities\") pod \"d18d3abe-3006-4b88-8f67-aef21e355ff9\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.229813 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-catalog-content\") pod \"d18d3abe-3006-4b88-8f67-aef21e355ff9\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.229855 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bct8\" (UniqueName: \"kubernetes.io/projected/d18d3abe-3006-4b88-8f67-aef21e355ff9-kube-api-access-4bct8\") pod \"d18d3abe-3006-4b88-8f67-aef21e355ff9\" (UID: \"d18d3abe-3006-4b88-8f67-aef21e355ff9\") " Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.230939 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-utilities" (OuterVolumeSpecName: "utilities") pod "d18d3abe-3006-4b88-8f67-aef21e355ff9" (UID: "d18d3abe-3006-4b88-8f67-aef21e355ff9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.237891 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18d3abe-3006-4b88-8f67-aef21e355ff9-kube-api-access-4bct8" (OuterVolumeSpecName: "kube-api-access-4bct8") pod "d18d3abe-3006-4b88-8f67-aef21e355ff9" (UID: "d18d3abe-3006-4b88-8f67-aef21e355ff9"). InnerVolumeSpecName "kube-api-access-4bct8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.323409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d18d3abe-3006-4b88-8f67-aef21e355ff9" (UID: "d18d3abe-3006-4b88-8f67-aef21e355ff9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.331737 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.331790 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4bct8\" (UniqueName: \"kubernetes.io/projected/d18d3abe-3006-4b88-8f67-aef21e355ff9-kube-api-access-4bct8\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.331814 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d18d3abe-3006-4b88-8f67-aef21e355ff9-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.547408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-qsmzz" event={"ID":"d18d3abe-3006-4b88-8f67-aef21e355ff9","Type":"ContainerDied","Data":"fa07971813f74da12748eeb7a013cace4e80ed6c2f6a9b0f5ae3df275b51b68f"} Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.547518 4769 scope.go:117] "RemoveContainer" containerID="458d72b1f93ba1b1a7c1bc7f0ad91b52ca308a6c35d8866359abb40d08aeced4" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.547573 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-qsmzz" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.572078 4769 scope.go:117] "RemoveContainer" containerID="5e23196c225274ead4630979473681bd96d853f75c5199eaf066a4ca30ad0a79" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.605921 4769 scope.go:117] "RemoveContainer" containerID="cecc8ffbf0fc7e09b058fbffb45d3271b500ef69b637b9cc698f8cbc8b0792d6" Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.606545 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-qsmzz"] Nov 21 13:47:57 crc kubenswrapper[4769]: I1121 13:47:57.614636 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-qsmzz"] Nov 21 13:47:59 crc kubenswrapper[4769]: I1121 13:47:59.283089 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" path="/var/lib/kubelet/pods/d18d3abe-3006-4b88-8f67-aef21e355ff9/volumes" Nov 21 13:48:04 crc kubenswrapper[4769]: I1121 13:48:04.314995 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:48:04 crc kubenswrapper[4769]: I1121 13:48:04.409798 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:48:04 crc kubenswrapper[4769]: E1121 13:48:04.672456 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:59680->38.102.83.227:40411: write tcp 38.102.83.227:59680->38.102.83.227:40411: write: broken pipe Nov 21 13:48:07 crc kubenswrapper[4769]: I1121 13:48:07.654469 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" event={"ID":"d81fbc0f-e8bf-4b34-927a-eca7c41601f6","Type":"ContainerStarted","Data":"53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c"} Nov 21 13:48:07 crc kubenswrapper[4769]: I1121 13:48:07.654782 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" podUID="d81fbc0f-e8bf-4b34-927a-eca7c41601f6" containerName="registry-server" containerID="cri-o://53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c" gracePeriod=2 Nov 21 13:48:07 crc kubenswrapper[4769]: I1121 13:48:07.658426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" event={"ID":"8901532d-8a43-4089-ab38-2cf0c96845d7","Type":"ContainerStarted","Data":"a42ec1bf33ea826e0a230c117ebce2d3e3e9b500615675966e67a619d464d773"} Nov 21 13:48:07 crc kubenswrapper[4769]: I1121 13:48:07.675540 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" podStartSLOduration=7.115997408 podStartE2EDuration="20.675520558s" podCreationTimestamp="2025-11-21 13:47:47 +0000 UTC" firstStartedPulling="2025-11-21 13:47:53.293063964 +0000 UTC m=+7031.993725782" lastFinishedPulling="2025-11-21 13:48:06.852587114 +0000 UTC m=+7045.553248932" observedRunningTime="2025-11-21 13:48:07.674505982 +0000 UTC m=+7046.375167870" watchObservedRunningTime="2025-11-21 13:48:07.675520558 +0000 UTC m=+7046.376182376" Nov 21 13:48:07 crc kubenswrapper[4769]: I1121 13:48:07.693510 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" podStartSLOduration=2.184467771 podStartE2EDuration="14.693490575s" podCreationTimestamp="2025-11-21 13:47:53 +0000 UTC" firstStartedPulling="2025-11-21 13:47:54.367838494 +0000 UTC m=+7033.068500312" lastFinishedPulling="2025-11-21 13:48:06.876861288 +0000 UTC m=+7045.577523116" observedRunningTime="2025-11-21 13:48:07.693425824 +0000 UTC m=+7046.394087662" watchObservedRunningTime="2025-11-21 13:48:07.693490575 +0000 UTC m=+7046.394152403" Nov 21 13:48:07 crc kubenswrapper[4769]: I1121 13:48:07.741143 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.082016 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.242435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxl4b\" (UniqueName: \"kubernetes.io/projected/d81fbc0f-e8bf-4b34-927a-eca7c41601f6-kube-api-access-zxl4b\") pod \"d81fbc0f-e8bf-4b34-927a-eca7c41601f6\" (UID: \"d81fbc0f-e8bf-4b34-927a-eca7c41601f6\") " Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.252607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d81fbc0f-e8bf-4b34-927a-eca7c41601f6-kube-api-access-zxl4b" (OuterVolumeSpecName: "kube-api-access-zxl4b") pod "d81fbc0f-e8bf-4b34-927a-eca7c41601f6" (UID: "d81fbc0f-e8bf-4b34-927a-eca7c41601f6"). InnerVolumeSpecName "kube-api-access-zxl4b". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.344522 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zxl4b\" (UniqueName: \"kubernetes.io/projected/d81fbc0f-e8bf-4b34-927a-eca7c41601f6-kube-api-access-zxl4b\") on node \"crc\" DevicePath \"\"" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.668422 4769 generic.go:334] "Generic (PLEG): container finished" podID="d81fbc0f-e8bf-4b34-927a-eca7c41601f6" containerID="53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c" exitCode=0 Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.668517 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.668535 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" event={"ID":"d81fbc0f-e8bf-4b34-927a-eca7c41601f6","Type":"ContainerDied","Data":"53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c"} Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.669090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-vv5f6" event={"ID":"d81fbc0f-e8bf-4b34-927a-eca7c41601f6","Type":"ContainerDied","Data":"3f6e8a186cca87ef6c8443d1b98dc2dfe906f13a376877fdaf6b6c228ef6f983"} Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.669114 4769 scope.go:117] "RemoveContainer" containerID="53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.693558 4769 scope.go:117] "RemoveContainer" containerID="53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c" Nov 21 13:48:08 crc kubenswrapper[4769]: E1121 13:48:08.694002 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c\": container with ID starting with 53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c not found: ID does not exist" containerID="53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.694040 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c"} err="failed to get container status \"53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c\": rpc error: code = NotFound desc = could not find container \"53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c\": container with ID starting with 53080d85632e0336d245fe9719906b0c7164f887106d570d9e2addfbfee5c64c not found: ID does not exist" Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.706952 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-vv5f6"] Nov 21 13:48:08 crc kubenswrapper[4769]: I1121 13:48:08.713679 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-vv5f6"] Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.283823 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d81fbc0f-e8bf-4b34-927a-eca7c41601f6" path="/var/lib/kubelet/pods/d81fbc0f-e8bf-4b34-927a-eca7c41601f6/volumes" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697314 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/memcached-0"] Nov 21 13:48:09 crc kubenswrapper[4769]: E1121 13:48:09.697611 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d81fbc0f-e8bf-4b34-927a-eca7c41601f6" containerName="registry-server" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697627 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d81fbc0f-e8bf-4b34-927a-eca7c41601f6" containerName="registry-server" Nov 21 13:48:09 crc kubenswrapper[4769]: E1121 13:48:09.697646 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="extract-content" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697654 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="extract-content" Nov 21 13:48:09 crc kubenswrapper[4769]: E1121 13:48:09.697668 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="registry-server" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697676 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="registry-server" Nov 21 13:48:09 crc kubenswrapper[4769]: E1121 13:48:09.697708 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="extract-utilities" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697716 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="extract-utilities" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697887 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d18d3abe-3006-4b88-8f67-aef21e355ff9" containerName="registry-server" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.697921 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d81fbc0f-e8bf-4b34-927a-eca7c41601f6" containerName="registry-server" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.698500 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.701180 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"memcached-config-data" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.701523 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"memcached-memcached-dockercfg-q9nqg" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.703706 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.867824 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-kolla-config\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.868256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72x4v\" (UniqueName: \"kubernetes.io/projected/065760bf-10d3-42cc-837e-ab6732b7d938-kube-api-access-72x4v\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.868316 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-config-data\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.969948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-kolla-config\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.970047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-72x4v\" (UniqueName: \"kubernetes.io/projected/065760bf-10d3-42cc-837e-ab6732b7d938-kube-api-access-72x4v\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.970113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-config-data\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.970797 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-kolla-config\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:09 crc kubenswrapper[4769]: I1121 13:48:09.971261 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-config-data\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:10 crc kubenswrapper[4769]: I1121 13:48:10.024554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-72x4v\" (UniqueName: \"kubernetes.io/projected/065760bf-10d3-42cc-837e-ab6732b7d938-kube-api-access-72x4v\") pod \"memcached-0\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:10 crc kubenswrapper[4769]: I1121 13:48:10.314201 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:11 crc kubenswrapper[4769]: I1121 13:48:11.017762 4769 scope.go:117] "RemoveContainer" containerID="e3ace4e7912a6b9aa0755c57e9357239fd76b1f83287cabdcd0878e6a79ea0f8" Nov 21 13:48:11 crc kubenswrapper[4769]: I1121 13:48:11.177031 4769 scope.go:117] "RemoveContainer" containerID="cf1ecfcf99abdc9673f90a91e5bc569fd27e23770860c284184ee52df49ff1ac" Nov 21 13:48:11 crc kubenswrapper[4769]: I1121 13:48:11.325056 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:48:11 crc kubenswrapper[4769]: I1121 13:48:11.325119 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:48:11 crc kubenswrapper[4769]: I1121 13:48:11.650480 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Nov 21 13:48:11 crc kubenswrapper[4769]: I1121 13:48:11.694757 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"065760bf-10d3-42cc-837e-ab6732b7d938","Type":"ContainerStarted","Data":"294c17c2c586a7194df534cea3b22d23f73f37572d217da99b91c2f1e9ea06bf"} Nov 21 13:48:12 crc kubenswrapper[4769]: E1121 13:48:12.548714 4769 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 38.102.83.227:52094->38.102.83.227:40411: read tcp 38.102.83.227:52094->38.102.83.227:40411: read: connection reset by peer Nov 21 13:48:13 crc kubenswrapper[4769]: I1121 13:48:13.945608 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:48:13 crc kubenswrapper[4769]: I1121 13:48:13.945918 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:48:13 crc kubenswrapper[4769]: I1121 13:48:13.975969 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:48:14 crc kubenswrapper[4769]: I1121 13:48:14.752855 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:48:18 crc kubenswrapper[4769]: I1121 13:48:18.677687 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="barbican-kuttl-tests/openstack-galera-2" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="galera" probeResult="failure" output=< Nov 21 13:48:18 crc kubenswrapper[4769]: wsrep_local_state_comment (Donor/Desynced) differs from Synced Nov 21 13:48:18 crc kubenswrapper[4769]: > Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.287798 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586"] Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.290534 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.292546 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586"] Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.294255 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.450072 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.450342 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.450477 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpn5j\" (UniqueName: \"kubernetes.io/projected/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-kube-api-access-gpn5j\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.552065 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.552119 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.552182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gpn5j\" (UniqueName: \"kubernetes.io/projected/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-kube-api-access-gpn5j\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.553116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.553369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.579743 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpn5j\" (UniqueName: \"kubernetes.io/projected/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-kube-api-access-gpn5j\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:19 crc kubenswrapper[4769]: I1121 13:48:19.613035 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:21 crc kubenswrapper[4769]: I1121 13:48:21.500972 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586"] Nov 21 13:48:21 crc kubenswrapper[4769]: I1121 13:48:21.733133 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:48:21 crc kubenswrapper[4769]: I1121 13:48:21.770840 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" event={"ID":"ab8fefee-d72c-4dfe-9a27-f451df6fe0be","Type":"ContainerStarted","Data":"e6769a2d7ee15b61cde66b71643ba974667ff2fa5bb55e8e39debcd791968a10"} Nov 21 13:48:21 crc kubenswrapper[4769]: I1121 13:48:21.770920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" event={"ID":"ab8fefee-d72c-4dfe-9a27-f451df6fe0be","Type":"ContainerStarted","Data":"73bd49e0c9bcbf9eaef0fb1488c68fa7cce9649be8c701728834231562863fb0"} Nov 21 13:48:21 crc kubenswrapper[4769]: I1121 13:48:21.775663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"065760bf-10d3-42cc-837e-ab6732b7d938","Type":"ContainerStarted","Data":"a9bf6cac3edd596c0152e20652b65be75c012b22e0f2d9ac819aef000324a461"} Nov 21 13:48:21 crc kubenswrapper[4769]: I1121 13:48:21.810483 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:48:22 crc kubenswrapper[4769]: I1121 13:48:22.787921 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerID="e6769a2d7ee15b61cde66b71643ba974667ff2fa5bb55e8e39debcd791968a10" exitCode=0 Nov 21 13:48:22 crc kubenswrapper[4769]: I1121 13:48:22.788002 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" event={"ID":"ab8fefee-d72c-4dfe-9a27-f451df6fe0be","Type":"ContainerDied","Data":"e6769a2d7ee15b61cde66b71643ba974667ff2fa5bb55e8e39debcd791968a10"} Nov 21 13:48:22 crc kubenswrapper[4769]: I1121 13:48:22.788451 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:22 crc kubenswrapper[4769]: I1121 13:48:22.811538 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/memcached-0" podStartSLOduration=4.030864355 podStartE2EDuration="13.811515408s" podCreationTimestamp="2025-11-21 13:48:09 +0000 UTC" firstStartedPulling="2025-11-21 13:48:11.658419253 +0000 UTC m=+7050.359081101" lastFinishedPulling="2025-11-21 13:48:21.439070336 +0000 UTC m=+7060.139732154" observedRunningTime="2025-11-21 13:48:22.806375981 +0000 UTC m=+7061.507037819" watchObservedRunningTime="2025-11-21 13:48:22.811515408 +0000 UTC m=+7061.512177226" Nov 21 13:48:25 crc kubenswrapper[4769]: I1121 13:48:25.814061 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerID="b5ae42361a36ce0ab1ae6c28bc3e6ffba175db903166f0eecc3f3f172b75a97e" exitCode=0 Nov 21 13:48:25 crc kubenswrapper[4769]: I1121 13:48:25.814100 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" event={"ID":"ab8fefee-d72c-4dfe-9a27-f451df6fe0be","Type":"ContainerDied","Data":"b5ae42361a36ce0ab1ae6c28bc3e6ffba175db903166f0eecc3f3f172b75a97e"} Nov 21 13:48:26 crc kubenswrapper[4769]: I1121 13:48:26.827343 4769 generic.go:334] "Generic (PLEG): container finished" podID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerID="c95d225a053ff320a584beaba4f27aad94b814661521f32cf2b0f2d2a673daab" exitCode=0 Nov 21 13:48:26 crc kubenswrapper[4769]: I1121 13:48:26.827426 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" event={"ID":"ab8fefee-d72c-4dfe-9a27-f451df6fe0be","Type":"ContainerDied","Data":"c95d225a053ff320a584beaba4f27aad94b814661521f32cf2b0f2d2a673daab"} Nov 21 13:48:26 crc kubenswrapper[4769]: I1121 13:48:26.898604 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:48:26 crc kubenswrapper[4769]: I1121 13:48:26.990007 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.161093 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.212947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-bundle\") pod \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.213033 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpn5j\" (UniqueName: \"kubernetes.io/projected/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-kube-api-access-gpn5j\") pod \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.213078 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-util\") pod \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\" (UID: \"ab8fefee-d72c-4dfe-9a27-f451df6fe0be\") " Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.215997 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-bundle" (OuterVolumeSpecName: "bundle") pod "ab8fefee-d72c-4dfe-9a27-f451df6fe0be" (UID: "ab8fefee-d72c-4dfe-9a27-f451df6fe0be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.222047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-kube-api-access-gpn5j" (OuterVolumeSpecName: "kube-api-access-gpn5j") pod "ab8fefee-d72c-4dfe-9a27-f451df6fe0be" (UID: "ab8fefee-d72c-4dfe-9a27-f451df6fe0be"). InnerVolumeSpecName "kube-api-access-gpn5j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.314969 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.315232 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gpn5j\" (UniqueName: \"kubernetes.io/projected/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-kube-api-access-gpn5j\") on node \"crc\" DevicePath \"\"" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.602667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-util" (OuterVolumeSpecName: "util") pod "ab8fefee-d72c-4dfe-9a27-f451df6fe0be" (UID: "ab8fefee-d72c-4dfe-9a27-f451df6fe0be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.620503 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab8fefee-d72c-4dfe-9a27-f451df6fe0be-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.849338 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" event={"ID":"ab8fefee-d72c-4dfe-9a27-f451df6fe0be","Type":"ContainerDied","Data":"73bd49e0c9bcbf9eaef0fb1488c68fa7cce9649be8c701728834231562863fb0"} Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.849392 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73bd49e0c9bcbf9eaef0fb1488c68fa7cce9649be8c701728834231562863fb0" Nov 21 13:48:28 crc kubenswrapper[4769]: I1121 13:48:28.849432 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586" Nov 21 13:48:30 crc kubenswrapper[4769]: I1121 13:48:30.316638 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/memcached-0" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.270604 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw"] Nov 21 13:48:35 crc kubenswrapper[4769]: E1121 13:48:35.273774 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="pull" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.273882 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="pull" Nov 21 13:48:35 crc kubenswrapper[4769]: E1121 13:48:35.273966 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="util" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.274022 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="util" Nov 21 13:48:35 crc kubenswrapper[4769]: E1121 13:48:35.274086 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="extract" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.274175 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="extract" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.274446 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" containerName="extract" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.275371 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.278660 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-dockercfg-czsbc" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.332124 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw"] Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.430436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckl7\" (UniqueName: \"kubernetes.io/projected/fc6e1f79-332b-44a0-a2d2-a847683f7c8a-kube-api-access-6ckl7\") pod \"rabbitmq-cluster-operator-779fc9694b-n6zcw\" (UID: \"fc6e1f79-332b-44a0-a2d2-a847683f7c8a\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.533586 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6ckl7\" (UniqueName: \"kubernetes.io/projected/fc6e1f79-332b-44a0-a2d2-a847683f7c8a-kube-api-access-6ckl7\") pod \"rabbitmq-cluster-operator-779fc9694b-n6zcw\" (UID: \"fc6e1f79-332b-44a0-a2d2-a847683f7c8a\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.572826 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ckl7\" (UniqueName: \"kubernetes.io/projected/fc6e1f79-332b-44a0-a2d2-a847683f7c8a-kube-api-access-6ckl7\") pod \"rabbitmq-cluster-operator-779fc9694b-n6zcw\" (UID: \"fc6e1f79-332b-44a0-a2d2-a847683f7c8a\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:48:35 crc kubenswrapper[4769]: I1121 13:48:35.646575 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:48:36 crc kubenswrapper[4769]: I1121 13:48:36.100433 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw"] Nov 21 13:48:36 crc kubenswrapper[4769]: W1121 13:48:36.113364 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc6e1f79_332b_44a0_a2d2_a847683f7c8a.slice/crio-d2eed6510a4dbf3a7e3b6d1b3aaf202dc98853acb919251f58cc0bd8b6bbb409 WatchSource:0}: Error finding container d2eed6510a4dbf3a7e3b6d1b3aaf202dc98853acb919251f58cc0bd8b6bbb409: Status 404 returned error can't find the container with id d2eed6510a4dbf3a7e3b6d1b3aaf202dc98853acb919251f58cc0bd8b6bbb409 Nov 21 13:48:36 crc kubenswrapper[4769]: I1121 13:48:36.924402 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" event={"ID":"fc6e1f79-332b-44a0-a2d2-a847683f7c8a","Type":"ContainerStarted","Data":"1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f"} Nov 21 13:48:36 crc kubenswrapper[4769]: I1121 13:48:36.924764 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" event={"ID":"fc6e1f79-332b-44a0-a2d2-a847683f7c8a","Type":"ContainerStarted","Data":"d2eed6510a4dbf3a7e3b6d1b3aaf202dc98853acb919251f58cc0bd8b6bbb409"} Nov 21 13:48:37 crc kubenswrapper[4769]: I1121 13:48:37.948665 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" podStartSLOduration=2.948638345 podStartE2EDuration="2.948638345s" podCreationTimestamp="2025-11-21 13:48:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:48:37.942650076 +0000 UTC m=+7076.643311914" watchObservedRunningTime="2025-11-21 13:48:37.948638345 +0000 UTC m=+7076.649300173" Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.325413 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.325849 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.325912 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.326699 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"3a4944a5b108a6b600ce3284d1598d1895a4b0c39681f6da153127371aede959"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.326768 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://3a4944a5b108a6b600ce3284d1598d1895a4b0c39681f6da153127371aede959" gracePeriod=600 Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.963288 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="3a4944a5b108a6b600ce3284d1598d1895a4b0c39681f6da153127371aede959" exitCode=0 Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.963364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"3a4944a5b108a6b600ce3284d1598d1895a4b0c39681f6da153127371aede959"} Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.964035 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367"} Nov 21 13:48:41 crc kubenswrapper[4769]: I1121 13:48:41.964076 4769 scope.go:117] "RemoveContainer" containerID="b0b32bff02d6401a09c30420f792135b734147308a469b2900922c27082c7ff0" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.223482 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-zjpht"] Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.225325 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.233669 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-index-dockercfg-8csqp" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.235144 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-zjpht"] Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.289686 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjl4\" (UniqueName: \"kubernetes.io/projected/976e5de9-b732-4f46-b3f3-604f42f1dab4-kube-api-access-5kjl4\") pod \"keystone-operator-index-zjpht\" (UID: \"976e5de9-b732-4f46-b3f3-604f42f1dab4\") " pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.391020 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjl4\" (UniqueName: \"kubernetes.io/projected/976e5de9-b732-4f46-b3f3-604f42f1dab4-kube-api-access-5kjl4\") pod \"keystone-operator-index-zjpht\" (UID: \"976e5de9-b732-4f46-b3f3-604f42f1dab4\") " pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.415627 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjl4\" (UniqueName: \"kubernetes.io/projected/976e5de9-b732-4f46-b3f3-604f42f1dab4-kube-api-access-5kjl4\") pod \"keystone-operator-index-zjpht\" (UID: \"976e5de9-b732-4f46-b3f3-604f42f1dab4\") " pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.547449 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:45 crc kubenswrapper[4769]: I1121 13:48:45.985420 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-zjpht"] Nov 21 13:48:46 crc kubenswrapper[4769]: I1121 13:48:46.001270 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-zjpht" event={"ID":"976e5de9-b732-4f46-b3f3-604f42f1dab4","Type":"ContainerStarted","Data":"c103f812ac18bbc41841d7f34c22bafe20c3b01b6c0a4ebb67658a708ab67270"} Nov 21 13:48:48 crc kubenswrapper[4769]: I1121 13:48:48.017795 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-zjpht" event={"ID":"976e5de9-b732-4f46-b3f3-604f42f1dab4","Type":"ContainerStarted","Data":"37ea4cbe0f3ca50eec3c521561891a94055171f4ec9af33fedfe7b04781491aa"} Nov 21 13:48:48 crc kubenswrapper[4769]: I1121 13:48:48.039462 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-zjpht" podStartSLOduration=1.313141827 podStartE2EDuration="3.03943096s" podCreationTimestamp="2025-11-21 13:48:45 +0000 UTC" firstStartedPulling="2025-11-21 13:48:45.995939406 +0000 UTC m=+7084.696601224" lastFinishedPulling="2025-11-21 13:48:47.722228539 +0000 UTC m=+7086.422890357" observedRunningTime="2025-11-21 13:48:48.037869758 +0000 UTC m=+7086.738531586" watchObservedRunningTime="2025-11-21 13:48:48.03943096 +0000 UTC m=+7086.740092778" Nov 21 13:48:55 crc kubenswrapper[4769]: I1121 13:48:55.547903 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:55 crc kubenswrapper[4769]: I1121 13:48:55.548532 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:55 crc kubenswrapper[4769]: I1121 13:48:55.581020 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:56 crc kubenswrapper[4769]: I1121 13:48:56.122535 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.287026 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp"] Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.288991 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.293728 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.298334 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp"] Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.403901 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75t7q\" (UniqueName: \"kubernetes.io/projected/528496b1-fdee-4c06-88f5-d394d03521ad-kube-api-access-75t7q\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.404274 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.404524 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.508079 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.508161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-75t7q\" (UniqueName: \"kubernetes.io/projected/528496b1-fdee-4c06-88f5-d394d03521ad-kube-api-access-75t7q\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.508182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.508606 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.508650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.527897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-75t7q\" (UniqueName: \"kubernetes.io/projected/528496b1-fdee-4c06-88f5-d394d03521ad-kube-api-access-75t7q\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:48:59 crc kubenswrapper[4769]: I1121 13:48:59.613341 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:49:00 crc kubenswrapper[4769]: I1121 13:49:00.067714 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp"] Nov 21 13:49:00 crc kubenswrapper[4769]: I1121 13:49:00.122023 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" event={"ID":"528496b1-fdee-4c06-88f5-d394d03521ad","Type":"ContainerStarted","Data":"de6e27de98314aa402345c345d668419e75697d801c9601abd29f9fb94ba252b"} Nov 21 13:49:01 crc kubenswrapper[4769]: I1121 13:49:01.149398 4769 generic.go:334] "Generic (PLEG): container finished" podID="528496b1-fdee-4c06-88f5-d394d03521ad" containerID="6f2014cd65e3354bf4108432d8b8044b2494c6d824d8b57fa8f2df063efcfe8a" exitCode=0 Nov 21 13:49:01 crc kubenswrapper[4769]: I1121 13:49:01.149513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" event={"ID":"528496b1-fdee-4c06-88f5-d394d03521ad","Type":"ContainerDied","Data":"6f2014cd65e3354bf4108432d8b8044b2494c6d824d8b57fa8f2df063efcfe8a"} Nov 21 13:49:02 crc kubenswrapper[4769]: I1121 13:49:02.160487 4769 generic.go:334] "Generic (PLEG): container finished" podID="528496b1-fdee-4c06-88f5-d394d03521ad" containerID="33f276e25b4fbc174707cce16354770d8f8d799783c6a0281258d839fb34ee4b" exitCode=0 Nov 21 13:49:02 crc kubenswrapper[4769]: I1121 13:49:02.160718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" event={"ID":"528496b1-fdee-4c06-88f5-d394d03521ad","Type":"ContainerDied","Data":"33f276e25b4fbc174707cce16354770d8f8d799783c6a0281258d839fb34ee4b"} Nov 21 13:49:03 crc kubenswrapper[4769]: I1121 13:49:03.172781 4769 generic.go:334] "Generic (PLEG): container finished" podID="528496b1-fdee-4c06-88f5-d394d03521ad" containerID="fcc7ef1438cbb8fe6cdcf5735c2c220a8956a878a914b699eba4ed4a77c8fdc7" exitCode=0 Nov 21 13:49:03 crc kubenswrapper[4769]: I1121 13:49:03.172875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" event={"ID":"528496b1-fdee-4c06-88f5-d394d03521ad","Type":"ContainerDied","Data":"fcc7ef1438cbb8fe6cdcf5735c2c220a8956a878a914b699eba4ed4a77c8fdc7"} Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.477213 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.598463 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75t7q\" (UniqueName: \"kubernetes.io/projected/528496b1-fdee-4c06-88f5-d394d03521ad-kube-api-access-75t7q\") pod \"528496b1-fdee-4c06-88f5-d394d03521ad\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.598527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-util\") pod \"528496b1-fdee-4c06-88f5-d394d03521ad\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.598560 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-bundle\") pod \"528496b1-fdee-4c06-88f5-d394d03521ad\" (UID: \"528496b1-fdee-4c06-88f5-d394d03521ad\") " Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.599582 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-bundle" (OuterVolumeSpecName: "bundle") pod "528496b1-fdee-4c06-88f5-d394d03521ad" (UID: "528496b1-fdee-4c06-88f5-d394d03521ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.604507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528496b1-fdee-4c06-88f5-d394d03521ad-kube-api-access-75t7q" (OuterVolumeSpecName: "kube-api-access-75t7q") pod "528496b1-fdee-4c06-88f5-d394d03521ad" (UID: "528496b1-fdee-4c06-88f5-d394d03521ad"). InnerVolumeSpecName "kube-api-access-75t7q". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.613880 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-util" (OuterVolumeSpecName: "util") pod "528496b1-fdee-4c06-88f5-d394d03521ad" (UID: "528496b1-fdee-4c06-88f5-d394d03521ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.701429 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-75t7q\" (UniqueName: \"kubernetes.io/projected/528496b1-fdee-4c06-88f5-d394d03521ad-kube-api-access-75t7q\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.701489 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:04 crc kubenswrapper[4769]: I1121 13:49:04.701504 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/528496b1-fdee-4c06-88f5-d394d03521ad-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:05 crc kubenswrapper[4769]: I1121 13:49:05.194729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" event={"ID":"528496b1-fdee-4c06-88f5-d394d03521ad","Type":"ContainerDied","Data":"de6e27de98314aa402345c345d668419e75697d801c9601abd29f9fb94ba252b"} Nov 21 13:49:05 crc kubenswrapper[4769]: I1121 13:49:05.194772 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de6e27de98314aa402345c345d668419e75697d801c9601abd29f9fb94ba252b" Nov 21 13:49:05 crc kubenswrapper[4769]: I1121 13:49:05.195171 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.330278 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:49:09 crc kubenswrapper[4769]: E1121 13:49:09.330963 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="pull" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.330978 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="pull" Nov 21 13:49:09 crc kubenswrapper[4769]: E1121 13:49:09.331008 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="extract" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.331017 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="extract" Nov 21 13:49:09 crc kubenswrapper[4769]: E1121 13:49:09.331037 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="util" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.331046 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="util" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.331244 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" containerName="extract" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.332109 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.334353 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.334618 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"rabbitmq-server-dockercfg-m2qtt" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.336641 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"rabbitmq-server-conf" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.336643 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"barbican-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.338834 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"rabbitmq-default-user" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.347965 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.475995 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-1459829a-def5-42a4-832a-01483dc98f71\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476119 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476179 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8d7de4cd-1112-4aa9-846a-c897a398f042-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476504 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8d7de4cd-1112-4aa9-846a-c897a398f042-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476739 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476802 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkgm\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-kube-api-access-dfkgm\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.476868 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8d7de4cd-1112-4aa9-846a-c897a398f042-pod-info\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579099 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-1459829a-def5-42a4-832a-01483dc98f71\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579186 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579275 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8d7de4cd-1112-4aa9-846a-c897a398f042-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8d7de4cd-1112-4aa9-846a-c897a398f042-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579471 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579505 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkgm\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-kube-api-access-dfkgm\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.579550 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8d7de4cd-1112-4aa9-846a-c897a398f042-pod-info\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.580323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.580799 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8d7de4cd-1112-4aa9-846a-c897a398f042-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.581643 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.583223 4769 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.583269 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-1459829a-def5-42a4-832a-01483dc98f71\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/3a638d3988c9fa02d166d9aa0b29230edf0af1ab3cd514497e7f9c1d7c93e701/globalmount\"" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.587846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8d7de4cd-1112-4aa9-846a-c897a398f042-pod-info\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.590371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.595618 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8d7de4cd-1112-4aa9-846a-c897a398f042-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.601288 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkgm\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-kube-api-access-dfkgm\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.627852 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-1459829a-def5-42a4-832a-01483dc98f71\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") pod \"rabbitmq-server-0\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:09 crc kubenswrapper[4769]: I1121 13:49:09.651542 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:49:10 crc kubenswrapper[4769]: I1121 13:49:10.114420 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:49:10 crc kubenswrapper[4769]: I1121 13:49:10.247631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"8d7de4cd-1112-4aa9-846a-c897a398f042","Type":"ContainerStarted","Data":"da7575ebfb6ae288147959d58e06254f2ad69291149e3bad421bafdc11bca389"} Nov 21 13:49:11 crc kubenswrapper[4769]: I1121 13:49:11.382608 4769 scope.go:117] "RemoveContainer" containerID="509e20be4681508f6eaa30ae04a716764534423a793c0f09c20fa98d2eb8797f" Nov 21 13:49:11 crc kubenswrapper[4769]: I1121 13:49:11.410472 4769 scope.go:117] "RemoveContainer" containerID="f1ff236f82e9d8478c37b9c48ad8e27de6d8c54c5ad9ca7eacb4ea1d70d1bcae" Nov 21 13:49:11 crc kubenswrapper[4769]: I1121 13:49:11.445335 4769 scope.go:117] "RemoveContainer" containerID="b47fee9ff00af9729d546649347a0b65420d04c5d14e4a0fc48a7268444caf77" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.295466 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk"] Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.297171 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.301116 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-service-cert" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.305907 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-dockercfg-txnh2" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.319112 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk"] Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.380514 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw2ct\" (UniqueName: \"kubernetes.io/projected/9d445e12-547d-4a0f-a460-b5d1ee139569-kube-api-access-rw2ct\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.380579 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-webhook-cert\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.380618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-apiservice-cert\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.482393 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rw2ct\" (UniqueName: \"kubernetes.io/projected/9d445e12-547d-4a0f-a460-b5d1ee139569-kube-api-access-rw2ct\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.482435 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-webhook-cert\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.482466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-apiservice-cert\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.487611 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-webhook-cert\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.490631 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-apiservice-cert\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.502765 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw2ct\" (UniqueName: \"kubernetes.io/projected/9d445e12-547d-4a0f-a460-b5d1ee139569-kube-api-access-rw2ct\") pod \"keystone-operator-controller-manager-64d8648f76-b6pwk\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:15 crc kubenswrapper[4769]: I1121 13:49:15.620588 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:17 crc kubenswrapper[4769]: I1121 13:49:17.466382 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk"] Nov 21 13:49:18 crc kubenswrapper[4769]: I1121 13:49:18.322234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" event={"ID":"9d445e12-547d-4a0f-a460-b5d1ee139569","Type":"ContainerStarted","Data":"323d12cc6172976a0a0a825fa699b47d93fb32f02ca89f88b2d7681ef22402e0"} Nov 21 13:49:18 crc kubenswrapper[4769]: I1121 13:49:18.322566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" event={"ID":"9d445e12-547d-4a0f-a460-b5d1ee139569","Type":"ContainerStarted","Data":"d99f82f49dddb9af075ebb47c9164253dc1fd976f702dc64281e42419e89a6bc"} Nov 21 13:49:26 crc kubenswrapper[4769]: I1121 13:49:26.389488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" event={"ID":"9d445e12-547d-4a0f-a460-b5d1ee139569","Type":"ContainerStarted","Data":"cbe5309d7b11c2d8b6565451ac632ffcf502765b2f253ad1d004bfd44db7e127"} Nov 21 13:49:26 crc kubenswrapper[4769]: I1121 13:49:26.390304 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:26 crc kubenswrapper[4769]: I1121 13:49:26.396473 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:49:26 crc kubenswrapper[4769]: I1121 13:49:26.414104 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" podStartSLOduration=11.414085876 podStartE2EDuration="11.414085876s" podCreationTimestamp="2025-11-21 13:49:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:49:26.41007603 +0000 UTC m=+7125.110737868" watchObservedRunningTime="2025-11-21 13:49:26.414085876 +0000 UTC m=+7125.114747684" Nov 21 13:49:29 crc kubenswrapper[4769]: I1121 13:49:29.416817 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"8d7de4cd-1112-4aa9-846a-c897a398f042","Type":"ContainerStarted","Data":"e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f"} Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.426294 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-index-qj9kz"] Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.427719 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.430132 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"barbican-operator-index-dockercfg-8lsj6" Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.440634 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-index-qj9kz"] Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.499221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrzx\" (UniqueName: \"kubernetes.io/projected/305a3a88-e259-43af-92ba-b106f36a71af-kube-api-access-2wrzx\") pod \"barbican-operator-index-qj9kz\" (UID: \"305a3a88-e259-43af-92ba-b106f36a71af\") " pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.601046 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrzx\" (UniqueName: \"kubernetes.io/projected/305a3a88-e259-43af-92ba-b106f36a71af-kube-api-access-2wrzx\") pod \"barbican-operator-index-qj9kz\" (UID: \"305a3a88-e259-43af-92ba-b106f36a71af\") " pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.621136 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrzx\" (UniqueName: \"kubernetes.io/projected/305a3a88-e259-43af-92ba-b106f36a71af-kube-api-access-2wrzx\") pod \"barbican-operator-index-qj9kz\" (UID: \"305a3a88-e259-43af-92ba-b106f36a71af\") " pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:34 crc kubenswrapper[4769]: I1121 13:49:34.748758 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:35 crc kubenswrapper[4769]: I1121 13:49:35.154683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-index-qj9kz"] Nov 21 13:49:35 crc kubenswrapper[4769]: I1121 13:49:35.466244 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-qj9kz" event={"ID":"305a3a88-e259-43af-92ba-b106f36a71af","Type":"ContainerStarted","Data":"3edbc24aa0acdca677fb938cc1a991da07114e9b546c38ef1ac5ff7774ad4f49"} Nov 21 13:49:37 crc kubenswrapper[4769]: I1121 13:49:37.490921 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-qj9kz" event={"ID":"305a3a88-e259-43af-92ba-b106f36a71af","Type":"ContainerStarted","Data":"53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b"} Nov 21 13:49:37 crc kubenswrapper[4769]: I1121 13:49:37.508884 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-index-qj9kz" podStartSLOduration=2.338861186 podStartE2EDuration="3.50879184s" podCreationTimestamp="2025-11-21 13:49:34 +0000 UTC" firstStartedPulling="2025-11-21 13:49:35.159478779 +0000 UTC m=+7133.860140597" lastFinishedPulling="2025-11-21 13:49:36.329409433 +0000 UTC m=+7135.030071251" observedRunningTime="2025-11-21 13:49:37.506878679 +0000 UTC m=+7136.207540517" watchObservedRunningTime="2025-11-21 13:49:37.50879184 +0000 UTC m=+7136.209453658" Nov 21 13:49:44 crc kubenswrapper[4769]: I1121 13:49:44.749676 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:44 crc kubenswrapper[4769]: I1121 13:49:44.751575 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:44 crc kubenswrapper[4769]: I1121 13:49:44.815611 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:45 crc kubenswrapper[4769]: I1121 13:49:45.596705 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.970628 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-db-create-2dvtr"] Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.972828 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.981921 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c"] Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.983496 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.988031 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-db-secret" Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.995448 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-2dvtr"] Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.997840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a14d76f-741e-4625-8617-8ee7c91e6f4a-operator-scripts\") pod \"keystone-db-create-2dvtr\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:51 crc kubenswrapper[4769]: I1121 13:49:51.997903 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmp5p\" (UniqueName: \"kubernetes.io/projected/3a14d76f-741e-4625-8617-8ee7c91e6f4a-kube-api-access-kmp5p\") pod \"keystone-db-create-2dvtr\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.009979 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c"] Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.099506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a14d76f-741e-4625-8617-8ee7c91e6f4a-operator-scripts\") pod \"keystone-db-create-2dvtr\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.099589 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzv89\" (UniqueName: \"kubernetes.io/projected/c217e581-49a4-4d08-a281-7c00e4f635f7-kube-api-access-vzv89\") pod \"keystone-9b40-account-create-update-2xr9c\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.099615 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kmp5p\" (UniqueName: \"kubernetes.io/projected/3a14d76f-741e-4625-8617-8ee7c91e6f4a-kube-api-access-kmp5p\") pod \"keystone-db-create-2dvtr\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.099693 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c217e581-49a4-4d08-a281-7c00e4f635f7-operator-scripts\") pod \"keystone-9b40-account-create-update-2xr9c\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.100468 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a14d76f-741e-4625-8617-8ee7c91e6f4a-operator-scripts\") pod \"keystone-db-create-2dvtr\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.120506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmp5p\" (UniqueName: \"kubernetes.io/projected/3a14d76f-741e-4625-8617-8ee7c91e6f4a-kube-api-access-kmp5p\") pod \"keystone-db-create-2dvtr\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.201739 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vzv89\" (UniqueName: \"kubernetes.io/projected/c217e581-49a4-4d08-a281-7c00e4f635f7-kube-api-access-vzv89\") pod \"keystone-9b40-account-create-update-2xr9c\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.202132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c217e581-49a4-4d08-a281-7c00e4f635f7-operator-scripts\") pod \"keystone-9b40-account-create-update-2xr9c\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.202972 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c217e581-49a4-4d08-a281-7c00e4f635f7-operator-scripts\") pod \"keystone-9b40-account-create-update-2xr9c\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.220863 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzv89\" (UniqueName: \"kubernetes.io/projected/c217e581-49a4-4d08-a281-7c00e4f635f7-kube-api-access-vzv89\") pod \"keystone-9b40-account-create-update-2xr9c\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.293674 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:52 crc kubenswrapper[4769]: I1121 13:49:52.307731 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:53 crc kubenswrapper[4769]: I1121 13:49:53.835953 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c"] Nov 21 13:49:53 crc kubenswrapper[4769]: W1121 13:49:53.838996 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc217e581_49a4_4d08_a281_7c00e4f635f7.slice/crio-192b8e50501873dd33bca2f30df2bf2a9f15d5e06c0cc9d221a2a8d44559dd55 WatchSource:0}: Error finding container 192b8e50501873dd33bca2f30df2bf2a9f15d5e06c0cc9d221a2a8d44559dd55: Status 404 returned error can't find the container with id 192b8e50501873dd33bca2f30df2bf2a9f15d5e06c0cc9d221a2a8d44559dd55 Nov 21 13:49:53 crc kubenswrapper[4769]: I1121 13:49:53.895077 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-2dvtr"] Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.652969 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" event={"ID":"c217e581-49a4-4d08-a281-7c00e4f635f7","Type":"ContainerStarted","Data":"8f5271f387acdc3e7388c87a96df494ec548f5a11b16b111c786a71afe4ddaa7"} Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.653444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" event={"ID":"c217e581-49a4-4d08-a281-7c00e4f635f7","Type":"ContainerStarted","Data":"192b8e50501873dd33bca2f30df2bf2a9f15d5e06c0cc9d221a2a8d44559dd55"} Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.655175 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" event={"ID":"3a14d76f-741e-4625-8617-8ee7c91e6f4a","Type":"ContainerStarted","Data":"27ed39fbe1dbc2732a48e5ee284f0de0ff1a0cfc22164ffc1203b7eaa3c9c828"} Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.655388 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" event={"ID":"3a14d76f-741e-4625-8617-8ee7c91e6f4a","Type":"ContainerStarted","Data":"96598f7e9be77094b84a4a5f8f2cc601805ad6a213b9d5d4292171adeef3b59e"} Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.676341 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" podStartSLOduration=3.676323183 podStartE2EDuration="3.676323183s" podCreationTimestamp="2025-11-21 13:49:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:49:54.672315227 +0000 UTC m=+7153.372977055" watchObservedRunningTime="2025-11-21 13:49:54.676323183 +0000 UTC m=+7153.376985001" Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.689473 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" podStartSLOduration=3.689451001 podStartE2EDuration="3.689451001s" podCreationTimestamp="2025-11-21 13:49:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:49:54.688307891 +0000 UTC m=+7153.388969719" watchObservedRunningTime="2025-11-21 13:49:54.689451001 +0000 UTC m=+7153.390112829" Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.871419 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926"] Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.872842 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.875056 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.885963 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926"] Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.946118 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-bundle\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.946229 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l7gg\" (UniqueName: \"kubernetes.io/projected/b291660e-de64-4f84-a8f8-021cca643c54-kube-api-access-2l7gg\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:54 crc kubenswrapper[4769]: I1121 13:49:54.946304 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-util\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.048518 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2l7gg\" (UniqueName: \"kubernetes.io/projected/b291660e-de64-4f84-a8f8-021cca643c54-kube-api-access-2l7gg\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.048570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-util\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.048678 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-bundle\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.049182 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-bundle\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.049406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-util\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.072700 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l7gg\" (UniqueName: \"kubernetes.io/projected/b291660e-de64-4f84-a8f8-021cca643c54-kube-api-access-2l7gg\") pod \"70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.190485 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.603947 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926"] Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.664654 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" event={"ID":"b291660e-de64-4f84-a8f8-021cca643c54","Type":"ContainerStarted","Data":"ba913eae322e38e8be47cb6122df157195eb05614c25247d4f6d960d19f59422"} Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.667654 4769 generic.go:334] "Generic (PLEG): container finished" podID="c217e581-49a4-4d08-a281-7c00e4f635f7" containerID="8f5271f387acdc3e7388c87a96df494ec548f5a11b16b111c786a71afe4ddaa7" exitCode=0 Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.667836 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" event={"ID":"c217e581-49a4-4d08-a281-7c00e4f635f7","Type":"ContainerDied","Data":"8f5271f387acdc3e7388c87a96df494ec548f5a11b16b111c786a71afe4ddaa7"} Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.674074 4769 generic.go:334] "Generic (PLEG): container finished" podID="3a14d76f-741e-4625-8617-8ee7c91e6f4a" containerID="27ed39fbe1dbc2732a48e5ee284f0de0ff1a0cfc22164ffc1203b7eaa3c9c828" exitCode=0 Nov 21 13:49:55 crc kubenswrapper[4769]: I1121 13:49:55.674144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" event={"ID":"3a14d76f-741e-4625-8617-8ee7c91e6f4a","Type":"ContainerDied","Data":"27ed39fbe1dbc2732a48e5ee284f0de0ff1a0cfc22164ffc1203b7eaa3c9c828"} Nov 21 13:49:56 crc kubenswrapper[4769]: I1121 13:49:56.687955 4769 generic.go:334] "Generic (PLEG): container finished" podID="b291660e-de64-4f84-a8f8-021cca643c54" containerID="72f4c15309c134a01b653c56c5244a6427672d0065823782933622f03bc194b6" exitCode=0 Nov 21 13:49:56 crc kubenswrapper[4769]: I1121 13:49:56.688072 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" event={"ID":"b291660e-de64-4f84-a8f8-021cca643c54","Type":"ContainerDied","Data":"72f4c15309c134a01b653c56c5244a6427672d0065823782933622f03bc194b6"} Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.061522 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.068668 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.179816 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzv89\" (UniqueName: \"kubernetes.io/projected/c217e581-49a4-4d08-a281-7c00e4f635f7-kube-api-access-vzv89\") pod \"c217e581-49a4-4d08-a281-7c00e4f635f7\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.179877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c217e581-49a4-4d08-a281-7c00e4f635f7-operator-scripts\") pod \"c217e581-49a4-4d08-a281-7c00e4f635f7\" (UID: \"c217e581-49a4-4d08-a281-7c00e4f635f7\") " Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.181256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a14d76f-741e-4625-8617-8ee7c91e6f4a-operator-scripts\") pod \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.181419 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmp5p\" (UniqueName: \"kubernetes.io/projected/3a14d76f-741e-4625-8617-8ee7c91e6f4a-kube-api-access-kmp5p\") pod \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\" (UID: \"3a14d76f-741e-4625-8617-8ee7c91e6f4a\") " Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.181745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c217e581-49a4-4d08-a281-7c00e4f635f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c217e581-49a4-4d08-a281-7c00e4f635f7" (UID: "c217e581-49a4-4d08-a281-7c00e4f635f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.182292 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a14d76f-741e-4625-8617-8ee7c91e6f4a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3a14d76f-741e-4625-8617-8ee7c91e6f4a" (UID: "3a14d76f-741e-4625-8617-8ee7c91e6f4a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.186102 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a14d76f-741e-4625-8617-8ee7c91e6f4a-kube-api-access-kmp5p" (OuterVolumeSpecName: "kube-api-access-kmp5p") pod "3a14d76f-741e-4625-8617-8ee7c91e6f4a" (UID: "3a14d76f-741e-4625-8617-8ee7c91e6f4a"). InnerVolumeSpecName "kube-api-access-kmp5p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.187242 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c217e581-49a4-4d08-a281-7c00e4f635f7-kube-api-access-vzv89" (OuterVolumeSpecName: "kube-api-access-vzv89") pod "c217e581-49a4-4d08-a281-7c00e4f635f7" (UID: "c217e581-49a4-4d08-a281-7c00e4f635f7"). InnerVolumeSpecName "kube-api-access-vzv89". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.283355 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vzv89\" (UniqueName: \"kubernetes.io/projected/c217e581-49a4-4d08-a281-7c00e4f635f7-kube-api-access-vzv89\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.283458 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c217e581-49a4-4d08-a281-7c00e4f635f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.283487 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3a14d76f-741e-4625-8617-8ee7c91e6f4a-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.283509 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kmp5p\" (UniqueName: \"kubernetes.io/projected/3a14d76f-741e-4625-8617-8ee7c91e6f4a-kube-api-access-kmp5p\") on node \"crc\" DevicePath \"\"" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.699927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" event={"ID":"3a14d76f-741e-4625-8617-8ee7c91e6f4a","Type":"ContainerDied","Data":"96598f7e9be77094b84a4a5f8f2cc601805ad6a213b9d5d4292171adeef3b59e"} Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.699997 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96598f7e9be77094b84a4a5f8f2cc601805ad6a213b9d5d4292171adeef3b59e" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.699942 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-create-2dvtr" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.702482 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" event={"ID":"c217e581-49a4-4d08-a281-7c00e4f635f7","Type":"ContainerDied","Data":"192b8e50501873dd33bca2f30df2bf2a9f15d5e06c0cc9d221a2a8d44559dd55"} Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.702529 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="192b8e50501873dd33bca2f30df2bf2a9f15d5e06c0cc9d221a2a8d44559dd55" Nov 21 13:49:57 crc kubenswrapper[4769]: I1121 13:49:57.702542 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c" Nov 21 13:50:00 crc kubenswrapper[4769]: I1121 13:50:00.728306 4769 generic.go:334] "Generic (PLEG): container finished" podID="b291660e-de64-4f84-a8f8-021cca643c54" containerID="b57a9f8820257c6504fa78af2041e440951e0372fc6fd44b3fa76e8a77433135" exitCode=0 Nov 21 13:50:00 crc kubenswrapper[4769]: I1121 13:50:00.728413 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" event={"ID":"b291660e-de64-4f84-a8f8-021cca643c54","Type":"ContainerDied","Data":"b57a9f8820257c6504fa78af2041e440951e0372fc6fd44b3fa76e8a77433135"} Nov 21 13:50:01 crc kubenswrapper[4769]: I1121 13:50:01.742897 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerID="e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f" exitCode=0 Nov 21 13:50:01 crc kubenswrapper[4769]: I1121 13:50:01.743037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"8d7de4cd-1112-4aa9-846a-c897a398f042","Type":"ContainerDied","Data":"e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f"} Nov 21 13:50:03 crc kubenswrapper[4769]: I1121 13:50:03.768252 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" event={"ID":"b291660e-de64-4f84-a8f8-021cca643c54","Type":"ContainerStarted","Data":"3e84783e32e57ca138eeddd0854372af74432f420ce654ae264a27c72eaa256d"} Nov 21 13:50:03 crc kubenswrapper[4769]: I1121 13:50:03.806644 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" podStartSLOduration=6.807716118 podStartE2EDuration="9.806623043s" podCreationTimestamp="2025-11-21 13:49:54 +0000 UTC" firstStartedPulling="2025-11-21 13:49:56.691442594 +0000 UTC m=+7155.392104432" lastFinishedPulling="2025-11-21 13:49:59.690349529 +0000 UTC m=+7158.391011357" observedRunningTime="2025-11-21 13:50:03.793464804 +0000 UTC m=+7162.494126662" watchObservedRunningTime="2025-11-21 13:50:03.806623043 +0000 UTC m=+7162.507284871" Nov 21 13:50:04 crc kubenswrapper[4769]: I1121 13:50:04.780050 4769 generic.go:334] "Generic (PLEG): container finished" podID="b291660e-de64-4f84-a8f8-021cca643c54" containerID="3e84783e32e57ca138eeddd0854372af74432f420ce654ae264a27c72eaa256d" exitCode=0 Nov 21 13:50:04 crc kubenswrapper[4769]: I1121 13:50:04.780090 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" event={"ID":"b291660e-de64-4f84-a8f8-021cca643c54","Type":"ContainerDied","Data":"3e84783e32e57ca138eeddd0854372af74432f420ce654ae264a27c72eaa256d"} Nov 21 13:50:04 crc kubenswrapper[4769]: I1121 13:50:04.784156 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"8d7de4cd-1112-4aa9-846a-c897a398f042","Type":"ContainerStarted","Data":"1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b"} Nov 21 13:50:04 crc kubenswrapper[4769]: I1121 13:50:04.784696 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:50:04 crc kubenswrapper[4769]: I1121 13:50:04.831343 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/rabbitmq-server-0" podStartSLOduration=38.997952696 podStartE2EDuration="56.831312733s" podCreationTimestamp="2025-11-21 13:49:08 +0000 UTC" firstStartedPulling="2025-11-21 13:49:10.124122058 +0000 UTC m=+7108.824783886" lastFinishedPulling="2025-11-21 13:49:27.957482105 +0000 UTC m=+7126.658143923" observedRunningTime="2025-11-21 13:50:04.824937423 +0000 UTC m=+7163.525599271" watchObservedRunningTime="2025-11-21 13:50:04.831312733 +0000 UTC m=+7163.531974551" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.071352 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.137071 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-bundle\") pod \"b291660e-de64-4f84-a8f8-021cca643c54\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.137175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l7gg\" (UniqueName: \"kubernetes.io/projected/b291660e-de64-4f84-a8f8-021cca643c54-kube-api-access-2l7gg\") pod \"b291660e-de64-4f84-a8f8-021cca643c54\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.137236 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-util\") pod \"b291660e-de64-4f84-a8f8-021cca643c54\" (UID: \"b291660e-de64-4f84-a8f8-021cca643c54\") " Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.138665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-bundle" (OuterVolumeSpecName: "bundle") pod "b291660e-de64-4f84-a8f8-021cca643c54" (UID: "b291660e-de64-4f84-a8f8-021cca643c54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.142588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b291660e-de64-4f84-a8f8-021cca643c54-kube-api-access-2l7gg" (OuterVolumeSpecName: "kube-api-access-2l7gg") pod "b291660e-de64-4f84-a8f8-021cca643c54" (UID: "b291660e-de64-4f84-a8f8-021cca643c54"). InnerVolumeSpecName "kube-api-access-2l7gg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.153559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-util" (OuterVolumeSpecName: "util") pod "b291660e-de64-4f84-a8f8-021cca643c54" (UID: "b291660e-de64-4f84-a8f8-021cca643c54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.239755 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.239820 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2l7gg\" (UniqueName: \"kubernetes.io/projected/b291660e-de64-4f84-a8f8-021cca643c54-kube-api-access-2l7gg\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.239848 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b291660e-de64-4f84-a8f8-021cca643c54-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.802685 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" event={"ID":"b291660e-de64-4f84-a8f8-021cca643c54","Type":"ContainerDied","Data":"ba913eae322e38e8be47cb6122df157195eb05614c25247d4f6d960d19f59422"} Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.802729 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba913eae322e38e8be47cb6122df157195eb05614c25247d4f6d960d19f59422" Nov 21 13:50:06 crc kubenswrapper[4769]: I1121 13:50:06.802769 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926" Nov 21 13:50:11 crc kubenswrapper[4769]: I1121 13:50:11.530315 4769 scope.go:117] "RemoveContainer" containerID="0f6623dfefece359106fbf641769abc2d8289ed56c5120c53d35944560bd2c13" Nov 21 13:50:11 crc kubenswrapper[4769]: I1121 13:50:11.568822 4769 scope.go:117] "RemoveContainer" containerID="dc68ee95d1d98dda34a64be72afa825eb0e0d7097c5a810dc10c460630c47b23" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.802343 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6"] Nov 21 13:50:13 crc kubenswrapper[4769]: E1121 13:50:13.803003 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="extract" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803019 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="extract" Nov 21 13:50:13 crc kubenswrapper[4769]: E1121 13:50:13.803032 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="util" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803040 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="util" Nov 21 13:50:13 crc kubenswrapper[4769]: E1121 13:50:13.803054 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c217e581-49a4-4d08-a281-7c00e4f635f7" containerName="mariadb-account-create-update" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803062 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c217e581-49a4-4d08-a281-7c00e4f635f7" containerName="mariadb-account-create-update" Nov 21 13:50:13 crc kubenswrapper[4769]: E1121 13:50:13.803071 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a14d76f-741e-4625-8617-8ee7c91e6f4a" containerName="mariadb-database-create" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803078 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14d76f-741e-4625-8617-8ee7c91e6f4a" containerName="mariadb-database-create" Nov 21 13:50:13 crc kubenswrapper[4769]: E1121 13:50:13.803096 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="pull" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803105 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="pull" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803275 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b291660e-de64-4f84-a8f8-021cca643c54" containerName="extract" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803298 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a14d76f-741e-4625-8617-8ee7c91e6f4a" containerName="mariadb-database-create" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.803316 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c217e581-49a4-4d08-a281-7c00e4f635f7" containerName="mariadb-account-create-update" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.804343 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.806643 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"barbican-operator-controller-manager-dockercfg-2lwgf" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.807823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"barbican-operator-controller-manager-service-cert" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.821921 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6"] Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.860850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9hjf\" (UniqueName: \"kubernetes.io/projected/22171770-4f23-4b88-b09b-2a0a117cc35f-kube-api-access-s9hjf\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.860918 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-apiservice-cert\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.860989 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-webhook-cert\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.962295 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-apiservice-cert\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.962366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-webhook-cert\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.962438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s9hjf\" (UniqueName: \"kubernetes.io/projected/22171770-4f23-4b88-b09b-2a0a117cc35f-kube-api-access-s9hjf\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.971997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-webhook-cert\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.993226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-apiservice-cert\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:13 crc kubenswrapper[4769]: I1121 13:50:13.998427 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9hjf\" (UniqueName: \"kubernetes.io/projected/22171770-4f23-4b88-b09b-2a0a117cc35f-kube-api-access-s9hjf\") pod \"barbican-operator-controller-manager-98dd7f7c9-lt6j6\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:14 crc kubenswrapper[4769]: I1121 13:50:14.120505 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:14 crc kubenswrapper[4769]: I1121 13:50:14.530572 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6"] Nov 21 13:50:14 crc kubenswrapper[4769]: I1121 13:50:14.867064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" event={"ID":"22171770-4f23-4b88-b09b-2a0a117cc35f","Type":"ContainerStarted","Data":"d8c6ef82bca33a316b472cf0f2971aa47ad054a8c174e93a11a880bb077702d0"} Nov 21 13:50:15 crc kubenswrapper[4769]: I1121 13:50:15.876859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" event={"ID":"22171770-4f23-4b88-b09b-2a0a117cc35f","Type":"ContainerStarted","Data":"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff"} Nov 21 13:50:15 crc kubenswrapper[4769]: I1121 13:50:15.877348 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:15 crc kubenswrapper[4769]: I1121 13:50:15.877367 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" event={"ID":"22171770-4f23-4b88-b09b-2a0a117cc35f","Type":"ContainerStarted","Data":"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f"} Nov 21 13:50:15 crc kubenswrapper[4769]: I1121 13:50:15.897790 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" podStartSLOduration=2.8977693970000002 podStartE2EDuration="2.897769397s" podCreationTimestamp="2025-11-21 13:50:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:50:15.894170302 +0000 UTC m=+7174.594832130" watchObservedRunningTime="2025-11-21 13:50:15.897769397 +0000 UTC m=+7174.598431215" Nov 21 13:50:19 crc kubenswrapper[4769]: I1121 13:50:19.656454 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.155770 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-dx5cc"] Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.157116 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.164706 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-config-data" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.164802 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-scripts" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.164706 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.165118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-keystone-dockercfg-dbbhj" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.165435 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-dx5cc"] Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.269784 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/955fa701-2aed-4848-a394-bcc4e0a03703-config-data\") pod \"keystone-db-sync-dx5cc\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.270377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54kq\" (UniqueName: \"kubernetes.io/projected/955fa701-2aed-4848-a394-bcc4e0a03703-kube-api-access-n54kq\") pod \"keystone-db-sync-dx5cc\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.371653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/955fa701-2aed-4848-a394-bcc4e0a03703-config-data\") pod \"keystone-db-sync-dx5cc\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.371761 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n54kq\" (UniqueName: \"kubernetes.io/projected/955fa701-2aed-4848-a394-bcc4e0a03703-kube-api-access-n54kq\") pod \"keystone-db-sync-dx5cc\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.381432 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/955fa701-2aed-4848-a394-bcc4e0a03703-config-data\") pod \"keystone-db-sync-dx5cc\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.388579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54kq\" (UniqueName: \"kubernetes.io/projected/955fa701-2aed-4848-a394-bcc4e0a03703-kube-api-access-n54kq\") pod \"keystone-db-sync-dx5cc\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.477855 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.734172 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-dx5cc"] Nov 21 13:50:20 crc kubenswrapper[4769]: W1121 13:50:20.739540 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod955fa701_2aed_4848_a394_bcc4e0a03703.slice/crio-0c6154f1cdd20a46cbb65973bd91331724d5213684280f29d5164c300802c782 WatchSource:0}: Error finding container 0c6154f1cdd20a46cbb65973bd91331724d5213684280f29d5164c300802c782: Status 404 returned error can't find the container with id 0c6154f1cdd20a46cbb65973bd91331724d5213684280f29d5164c300802c782 Nov 21 13:50:20 crc kubenswrapper[4769]: I1121 13:50:20.913545 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" event={"ID":"955fa701-2aed-4848-a394-bcc4e0a03703","Type":"ContainerStarted","Data":"0c6154f1cdd20a46cbb65973bd91331724d5213684280f29d5164c300802c782"} Nov 21 13:50:24 crc kubenswrapper[4769]: I1121 13:50:24.123460 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:50:33 crc kubenswrapper[4769]: I1121 13:50:33.039767 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" event={"ID":"955fa701-2aed-4848-a394-bcc4e0a03703","Type":"ContainerStarted","Data":"6e0c5729b7a2f2bba7010f0ca139f467293c5a2b59dd233d427f963fad6d2937"} Nov 21 13:50:33 crc kubenswrapper[4769]: I1121 13:50:33.058027 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" podStartSLOduration=1.706467746 podStartE2EDuration="13.057993525s" podCreationTimestamp="2025-11-21 13:50:20 +0000 UTC" firstStartedPulling="2025-11-21 13:50:20.742087078 +0000 UTC m=+7179.442748896" lastFinishedPulling="2025-11-21 13:50:32.093612817 +0000 UTC m=+7190.794274675" observedRunningTime="2025-11-21 13:50:33.050712192 +0000 UTC m=+7191.751374040" watchObservedRunningTime="2025-11-21 13:50:33.057993525 +0000 UTC m=+7191.758655373" Nov 21 13:50:41 crc kubenswrapper[4769]: I1121 13:50:41.325227 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:50:41 crc kubenswrapper[4769]: I1121 13:50:41.325806 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.034544 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-create-h9z6j"] Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.036091 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.047341 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-h9z6j"] Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.129547 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq"] Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.130604 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.132855 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-db-secret" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.144366 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq"] Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.174799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4148acc-a147-4b8f-ae62-0c82e33edcb5-operator-scripts\") pod \"barbican-db-create-h9z6j\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.174901 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx8hj\" (UniqueName: \"kubernetes.io/projected/a4148acc-a147-4b8f-ae62-0c82e33edcb5-kube-api-access-kx8hj\") pod \"barbican-db-create-h9z6j\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.276742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbd9s\" (UniqueName: \"kubernetes.io/projected/4a9283ea-39fd-4703-9ed9-40759ff0cd16-kube-api-access-mbd9s\") pod \"barbican-fbaf-account-create-update-dpjbq\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.276850 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4148acc-a147-4b8f-ae62-0c82e33edcb5-operator-scripts\") pod \"barbican-db-create-h9z6j\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.276920 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8hj\" (UniqueName: \"kubernetes.io/projected/a4148acc-a147-4b8f-ae62-0c82e33edcb5-kube-api-access-kx8hj\") pod \"barbican-db-create-h9z6j\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.277039 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a9283ea-39fd-4703-9ed9-40759ff0cd16-operator-scripts\") pod \"barbican-fbaf-account-create-update-dpjbq\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.278155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4148acc-a147-4b8f-ae62-0c82e33edcb5-operator-scripts\") pod \"barbican-db-create-h9z6j\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.297375 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8hj\" (UniqueName: \"kubernetes.io/projected/a4148acc-a147-4b8f-ae62-0c82e33edcb5-kube-api-access-kx8hj\") pod \"barbican-db-create-h9z6j\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.365910 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.378728 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a9283ea-39fd-4703-9ed9-40759ff0cd16-operator-scripts\") pod \"barbican-fbaf-account-create-update-dpjbq\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.378846 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mbd9s\" (UniqueName: \"kubernetes.io/projected/4a9283ea-39fd-4703-9ed9-40759ff0cd16-kube-api-access-mbd9s\") pod \"barbican-fbaf-account-create-update-dpjbq\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.379987 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a9283ea-39fd-4703-9ed9-40759ff0cd16-operator-scripts\") pod \"barbican-fbaf-account-create-update-dpjbq\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.395934 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbd9s\" (UniqueName: \"kubernetes.io/projected/4a9283ea-39fd-4703-9ed9-40759ff0cd16-kube-api-access-mbd9s\") pod \"barbican-fbaf-account-create-update-dpjbq\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.452400 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.803982 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-h9z6j"] Nov 21 13:50:49 crc kubenswrapper[4769]: I1121 13:50:49.884798 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq"] Nov 21 13:50:50 crc kubenswrapper[4769]: I1121 13:50:50.195436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" event={"ID":"a4148acc-a147-4b8f-ae62-0c82e33edcb5","Type":"ContainerStarted","Data":"6cc78cd6fa8ea4d03fb7a2f779ec48943b0180d2d3d2a31812e15df2bf3ac5a1"} Nov 21 13:50:50 crc kubenswrapper[4769]: I1121 13:50:50.197082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" event={"ID":"4a9283ea-39fd-4703-9ed9-40759ff0cd16","Type":"ContainerStarted","Data":"010a81b18222977990331fa29a680289849e5835eb8f8eb9d720442f86c816ef"} Nov 21 13:50:51 crc kubenswrapper[4769]: I1121 13:50:51.209687 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" event={"ID":"a4148acc-a147-4b8f-ae62-0c82e33edcb5","Type":"ContainerStarted","Data":"789e1701260cad407033b73f12ab8b3171ae8598b35a4bef6f1a761c7285fa85"} Nov 21 13:50:51 crc kubenswrapper[4769]: I1121 13:50:51.212435 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" event={"ID":"4a9283ea-39fd-4703-9ed9-40759ff0cd16","Type":"ContainerStarted","Data":"49600efbecb51392638ccc2a2f2dfd763476f07eb8509dc6f8a0d8933e78deab"} Nov 21 13:50:51 crc kubenswrapper[4769]: I1121 13:50:51.237059 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" podStartSLOduration=2.237040827 podStartE2EDuration="2.237040827s" podCreationTimestamp="2025-11-21 13:50:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:50:51.230174145 +0000 UTC m=+7209.930835963" watchObservedRunningTime="2025-11-21 13:50:51.237040827 +0000 UTC m=+7209.937702645" Nov 21 13:50:51 crc kubenswrapper[4769]: I1121 13:50:51.256997 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" podStartSLOduration=2.256966746 podStartE2EDuration="2.256966746s" podCreationTimestamp="2025-11-21 13:50:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:50:51.252090486 +0000 UTC m=+7209.952752314" watchObservedRunningTime="2025-11-21 13:50:51.256966746 +0000 UTC m=+7209.957628584" Nov 21 13:50:53 crc kubenswrapper[4769]: I1121 13:50:53.229056 4769 generic.go:334] "Generic (PLEG): container finished" podID="a4148acc-a147-4b8f-ae62-0c82e33edcb5" containerID="789e1701260cad407033b73f12ab8b3171ae8598b35a4bef6f1a761c7285fa85" exitCode=0 Nov 21 13:50:53 crc kubenswrapper[4769]: I1121 13:50:53.229162 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" event={"ID":"a4148acc-a147-4b8f-ae62-0c82e33edcb5","Type":"ContainerDied","Data":"789e1701260cad407033b73f12ab8b3171ae8598b35a4bef6f1a761c7285fa85"} Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.538290 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.661576 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx8hj\" (UniqueName: \"kubernetes.io/projected/a4148acc-a147-4b8f-ae62-0c82e33edcb5-kube-api-access-kx8hj\") pod \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.661698 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4148acc-a147-4b8f-ae62-0c82e33edcb5-operator-scripts\") pod \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\" (UID: \"a4148acc-a147-4b8f-ae62-0c82e33edcb5\") " Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.662559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4148acc-a147-4b8f-ae62-0c82e33edcb5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a4148acc-a147-4b8f-ae62-0c82e33edcb5" (UID: "a4148acc-a147-4b8f-ae62-0c82e33edcb5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.668829 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4148acc-a147-4b8f-ae62-0c82e33edcb5-kube-api-access-kx8hj" (OuterVolumeSpecName: "kube-api-access-kx8hj") pod "a4148acc-a147-4b8f-ae62-0c82e33edcb5" (UID: "a4148acc-a147-4b8f-ae62-0c82e33edcb5"). InnerVolumeSpecName "kube-api-access-kx8hj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.766797 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kx8hj\" (UniqueName: \"kubernetes.io/projected/a4148acc-a147-4b8f-ae62-0c82e33edcb5-kube-api-access-kx8hj\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:54 crc kubenswrapper[4769]: I1121 13:50:54.766870 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4148acc-a147-4b8f-ae62-0c82e33edcb5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:55 crc kubenswrapper[4769]: I1121 13:50:55.246739 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" Nov 21 13:50:55 crc kubenswrapper[4769]: I1121 13:50:55.246761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-h9z6j" event={"ID":"a4148acc-a147-4b8f-ae62-0c82e33edcb5","Type":"ContainerDied","Data":"6cc78cd6fa8ea4d03fb7a2f779ec48943b0180d2d3d2a31812e15df2bf3ac5a1"} Nov 21 13:50:55 crc kubenswrapper[4769]: I1121 13:50:55.247124 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cc78cd6fa8ea4d03fb7a2f779ec48943b0180d2d3d2a31812e15df2bf3ac5a1" Nov 21 13:50:55 crc kubenswrapper[4769]: I1121 13:50:55.248254 4769 generic.go:334] "Generic (PLEG): container finished" podID="4a9283ea-39fd-4703-9ed9-40759ff0cd16" containerID="49600efbecb51392638ccc2a2f2dfd763476f07eb8509dc6f8a0d8933e78deab" exitCode=0 Nov 21 13:50:55 crc kubenswrapper[4769]: I1121 13:50:55.248287 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" event={"ID":"4a9283ea-39fd-4703-9ed9-40759ff0cd16","Type":"ContainerDied","Data":"49600efbecb51392638ccc2a2f2dfd763476f07eb8509dc6f8a0d8933e78deab"} Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.538321 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.694020 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a9283ea-39fd-4703-9ed9-40759ff0cd16-operator-scripts\") pod \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.694092 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbd9s\" (UniqueName: \"kubernetes.io/projected/4a9283ea-39fd-4703-9ed9-40759ff0cd16-kube-api-access-mbd9s\") pod \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\" (UID: \"4a9283ea-39fd-4703-9ed9-40759ff0cd16\") " Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.695362 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a9283ea-39fd-4703-9ed9-40759ff0cd16-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4a9283ea-39fd-4703-9ed9-40759ff0cd16" (UID: "4a9283ea-39fd-4703-9ed9-40759ff0cd16"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.703035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a9283ea-39fd-4703-9ed9-40759ff0cd16-kube-api-access-mbd9s" (OuterVolumeSpecName: "kube-api-access-mbd9s") pod "4a9283ea-39fd-4703-9ed9-40759ff0cd16" (UID: "4a9283ea-39fd-4703-9ed9-40759ff0cd16"). InnerVolumeSpecName "kube-api-access-mbd9s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.796333 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4a9283ea-39fd-4703-9ed9-40759ff0cd16-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:56 crc kubenswrapper[4769]: I1121 13:50:56.796386 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mbd9s\" (UniqueName: \"kubernetes.io/projected/4a9283ea-39fd-4703-9ed9-40759ff0cd16-kube-api-access-mbd9s\") on node \"crc\" DevicePath \"\"" Nov 21 13:50:57 crc kubenswrapper[4769]: I1121 13:50:57.268434 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" event={"ID":"4a9283ea-39fd-4703-9ed9-40759ff0cd16","Type":"ContainerDied","Data":"010a81b18222977990331fa29a680289849e5835eb8f8eb9d720442f86c816ef"} Nov 21 13:50:57 crc kubenswrapper[4769]: I1121 13:50:57.268554 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="010a81b18222977990331fa29a680289849e5835eb8f8eb9d720442f86c816ef" Nov 21 13:50:57 crc kubenswrapper[4769]: I1121 13:50:57.268513 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq" Nov 21 13:51:10 crc kubenswrapper[4769]: I1121 13:51:10.389334 4769 generic.go:334] "Generic (PLEG): container finished" podID="955fa701-2aed-4848-a394-bcc4e0a03703" containerID="6e0c5729b7a2f2bba7010f0ca139f467293c5a2b59dd233d427f963fad6d2937" exitCode=0 Nov 21 13:51:10 crc kubenswrapper[4769]: I1121 13:51:10.389436 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" event={"ID":"955fa701-2aed-4848-a394-bcc4e0a03703","Type":"ContainerDied","Data":"6e0c5729b7a2f2bba7010f0ca139f467293c5a2b59dd233d427f963fad6d2937"} Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.325268 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.325334 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.634353 4769 scope.go:117] "RemoveContainer" containerID="8c0919c60fe418dd0f70504b11b570af0c3b161e7e987b99cef44f0b2a89fc3e" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.698917 4769 scope.go:117] "RemoveContainer" containerID="db13f3833c0b12f3b36698e1a8d6c047ac34e9c11d679d143a923e151168e00a" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.716117 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.863877 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/955fa701-2aed-4848-a394-bcc4e0a03703-config-data\") pod \"955fa701-2aed-4848-a394-bcc4e0a03703\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.864012 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n54kq\" (UniqueName: \"kubernetes.io/projected/955fa701-2aed-4848-a394-bcc4e0a03703-kube-api-access-n54kq\") pod \"955fa701-2aed-4848-a394-bcc4e0a03703\" (UID: \"955fa701-2aed-4848-a394-bcc4e0a03703\") " Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.870456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955fa701-2aed-4848-a394-bcc4e0a03703-kube-api-access-n54kq" (OuterVolumeSpecName: "kube-api-access-n54kq") pod "955fa701-2aed-4848-a394-bcc4e0a03703" (UID: "955fa701-2aed-4848-a394-bcc4e0a03703"). InnerVolumeSpecName "kube-api-access-n54kq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.903973 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955fa701-2aed-4848-a394-bcc4e0a03703-config-data" (OuterVolumeSpecName: "config-data") pod "955fa701-2aed-4848-a394-bcc4e0a03703" (UID: "955fa701-2aed-4848-a394-bcc4e0a03703"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.965958 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n54kq\" (UniqueName: \"kubernetes.io/projected/955fa701-2aed-4848-a394-bcc4e0a03703-kube-api-access-n54kq\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:11 crc kubenswrapper[4769]: I1121 13:51:11.966009 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/955fa701-2aed-4848-a394-bcc4e0a03703-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.093595 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-kfczm"] Nov 21 13:51:12 crc kubenswrapper[4769]: E1121 13:51:12.093928 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a4148acc-a147-4b8f-ae62-0c82e33edcb5" containerName="mariadb-database-create" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.093949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4148acc-a147-4b8f-ae62-0c82e33edcb5" containerName="mariadb-database-create" Nov 21 13:51:12 crc kubenswrapper[4769]: E1121 13:51:12.093991 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4a9283ea-39fd-4703-9ed9-40759ff0cd16" containerName="mariadb-account-create-update" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.094013 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a9283ea-39fd-4703-9ed9-40759ff0cd16" containerName="mariadb-account-create-update" Nov 21 13:51:12 crc kubenswrapper[4769]: E1121 13:51:12.094028 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="955fa701-2aed-4848-a394-bcc4e0a03703" containerName="keystone-db-sync" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.094038 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="955fa701-2aed-4848-a394-bcc4e0a03703" containerName="keystone-db-sync" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.094204 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="955fa701-2aed-4848-a394-bcc4e0a03703" containerName="keystone-db-sync" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.094245 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a4148acc-a147-4b8f-ae62-0c82e33edcb5" containerName="mariadb-database-create" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.094261 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4a9283ea-39fd-4703-9ed9-40759ff0cd16" containerName="mariadb-account-create-update" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.094856 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.098032 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"osp-secret" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.102903 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-kfczm"] Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.269697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-fernet-keys\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.269793 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlx52\" (UniqueName: \"kubernetes.io/projected/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-kube-api-access-wlx52\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.269827 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-scripts\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.269861 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-config-data\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.269896 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-credential-keys\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.300119 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-jhp5m"] Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.301094 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.303750 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-config-data" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.303771 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-barbican-dockercfg-llr59" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.315692 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-jhp5m"] Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.372161 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-fernet-keys\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.372262 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wlx52\" (UniqueName: \"kubernetes.io/projected/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-kube-api-access-wlx52\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.372466 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-scripts\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.372757 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-config-data\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.372918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-credential-keys\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.374998 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.375600 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-scripts" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.377574 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-config-data\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.385781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-credential-keys\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.385919 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-fernet-keys\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.386534 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-scripts\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.387930 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlx52\" (UniqueName: \"kubernetes.io/projected/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-kube-api-access-wlx52\") pod \"keystone-bootstrap-kfczm\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.405590 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" event={"ID":"955fa701-2aed-4848-a394-bcc4e0a03703","Type":"ContainerDied","Data":"0c6154f1cdd20a46cbb65973bd91331724d5213684280f29d5164c300802c782"} Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.405945 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c6154f1cdd20a46cbb65973bd91331724d5213684280f29d5164c300802c782" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.405651 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-db-sync-dx5cc" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.413803 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.474578 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b3f52a91-5971-47c9-a314-f0a74b8284f8-db-sync-config-data\") pod \"barbican-db-sync-jhp5m\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.474700 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prpbj\" (UniqueName: \"kubernetes.io/projected/b3f52a91-5971-47c9-a314-f0a74b8284f8-kube-api-access-prpbj\") pod \"barbican-db-sync-jhp5m\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.575725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b3f52a91-5971-47c9-a314-f0a74b8284f8-db-sync-config-data\") pod \"barbican-db-sync-jhp5m\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.576900 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-prpbj\" (UniqueName: \"kubernetes.io/projected/b3f52a91-5971-47c9-a314-f0a74b8284f8-kube-api-access-prpbj\") pod \"barbican-db-sync-jhp5m\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.582344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b3f52a91-5971-47c9-a314-f0a74b8284f8-db-sync-config-data\") pod \"barbican-db-sync-jhp5m\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.598296 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-prpbj\" (UniqueName: \"kubernetes.io/projected/b3f52a91-5971-47c9-a314-f0a74b8284f8-kube-api-access-prpbj\") pod \"barbican-db-sync-jhp5m\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.615079 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:12 crc kubenswrapper[4769]: I1121 13:51:12.852917 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-kfczm"] Nov 21 13:51:12 crc kubenswrapper[4769]: W1121 13:51:12.867025 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5ffe70f_19c7_41ea_a663_5b57f66a5f6b.slice/crio-5b5273b1a4950b538a243f24a38bb2427a899ad0fb4508a6016c8af0e7d21402 WatchSource:0}: Error finding container 5b5273b1a4950b538a243f24a38bb2427a899ad0fb4508a6016c8af0e7d21402: Status 404 returned error can't find the container with id 5b5273b1a4950b538a243f24a38bb2427a899ad0fb4508a6016c8af0e7d21402 Nov 21 13:51:13 crc kubenswrapper[4769]: I1121 13:51:13.035645 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-jhp5m"] Nov 21 13:51:13 crc kubenswrapper[4769]: W1121 13:51:13.042159 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3f52a91_5971_47c9_a314_f0a74b8284f8.slice/crio-ab43505db619193e2fe945abded5539f132138643a5329de79998e7cf4121aeb WatchSource:0}: Error finding container ab43505db619193e2fe945abded5539f132138643a5329de79998e7cf4121aeb: Status 404 returned error can't find the container with id ab43505db619193e2fe945abded5539f132138643a5329de79998e7cf4121aeb Nov 21 13:51:13 crc kubenswrapper[4769]: I1121 13:51:13.413209 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" event={"ID":"b3f52a91-5971-47c9-a314-f0a74b8284f8","Type":"ContainerStarted","Data":"ab43505db619193e2fe945abded5539f132138643a5329de79998e7cf4121aeb"} Nov 21 13:51:13 crc kubenswrapper[4769]: I1121 13:51:13.415232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" event={"ID":"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b","Type":"ContainerStarted","Data":"87633adf6ad6ceb5158194e6367315b7111f4b8d82323f10d55854d47f6c7f05"} Nov 21 13:51:13 crc kubenswrapper[4769]: I1121 13:51:13.415266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" event={"ID":"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b","Type":"ContainerStarted","Data":"5b5273b1a4950b538a243f24a38bb2427a899ad0fb4508a6016c8af0e7d21402"} Nov 21 13:51:13 crc kubenswrapper[4769]: I1121 13:51:13.433550 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" podStartSLOduration=1.43353339 podStartE2EDuration="1.43353339s" podCreationTimestamp="2025-11-21 13:51:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:51:13.430940481 +0000 UTC m=+7232.131602309" watchObservedRunningTime="2025-11-21 13:51:13.43353339 +0000 UTC m=+7232.134195218" Nov 21 13:51:18 crc kubenswrapper[4769]: I1121 13:51:18.473216 4769 generic.go:334] "Generic (PLEG): container finished" podID="a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" containerID="87633adf6ad6ceb5158194e6367315b7111f4b8d82323f10d55854d47f6c7f05" exitCode=0 Nov 21 13:51:18 crc kubenswrapper[4769]: I1121 13:51:18.473229 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" event={"ID":"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b","Type":"ContainerDied","Data":"87633adf6ad6ceb5158194e6367315b7111f4b8d82323f10d55854d47f6c7f05"} Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.847067 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.976967 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-credential-keys\") pod \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.977055 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-scripts\") pod \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.977129 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-fernet-keys\") pod \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.977166 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlx52\" (UniqueName: \"kubernetes.io/projected/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-kube-api-access-wlx52\") pod \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.977257 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-config-data\") pod \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\" (UID: \"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b\") " Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.985052 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" (UID: "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.985093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-scripts" (OuterVolumeSpecName: "scripts") pod "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" (UID: "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.985801 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" (UID: "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:51:29 crc kubenswrapper[4769]: I1121 13:51:29.985868 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-kube-api-access-wlx52" (OuterVolumeSpecName: "kube-api-access-wlx52") pod "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" (UID: "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b"). InnerVolumeSpecName "kube-api-access-wlx52". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.018037 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-config-data" (OuterVolumeSpecName: "config-data") pod "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" (UID: "a5ffe70f-19c7-41ea-a663-5b57f66a5f6b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.079409 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.079466 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wlx52\" (UniqueName: \"kubernetes.io/projected/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-kube-api-access-wlx52\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.079481 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.079492 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.079504 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:30 crc kubenswrapper[4769]: E1121 13:51:30.187168 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:a9d5018120cea6bb820f4ebf7bd6750236861dc57345067f4b3e964f69033b8e" Nov 21 13:51:30 crc kubenswrapper[4769]: E1121 13:51:30.187463 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:barbican-db-sync,Image:quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:a9d5018120cea6bb820f4ebf7bd6750236861dc57345067f4b3e964f69033b8e,Command:[/bin/bash],Args:[-c barbican-manage db upgrade],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KOLLA_BOOTSTRAP,Value:TRUE,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:db-sync-config-data,ReadOnly:true,MountPath:/etc/barbican/barbican.conf.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-prpbj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*42403,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:*42403,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod barbican-db-sync-jhp5m_barbican-kuttl-tests(b3f52a91-5971-47c9-a314-f0a74b8284f8): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 13:51:30 crc kubenswrapper[4769]: E1121 13:51:30.188992 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"barbican-db-sync\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" podUID="b3f52a91-5971-47c9-a314-f0a74b8284f8" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.583540 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.583546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-bootstrap-kfczm" event={"ID":"a5ffe70f-19c7-41ea-a663-5b57f66a5f6b","Type":"ContainerDied","Data":"5b5273b1a4950b538a243f24a38bb2427a899ad0fb4508a6016c8af0e7d21402"} Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.584094 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b5273b1a4950b538a243f24a38bb2427a899ad0fb4508a6016c8af0e7d21402" Nov 21 13:51:30 crc kubenswrapper[4769]: E1121 13:51:30.585603 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"barbican-db-sync\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/podified-antelope-centos9/openstack-barbican-api@sha256:a9d5018120cea6bb820f4ebf7bd6750236861dc57345067f4b3e964f69033b8e\\\"\"" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" podUID="b3f52a91-5971-47c9-a314-f0a74b8284f8" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.931134 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone-66b5b8678f-psqjw"] Nov 21 13:51:30 crc kubenswrapper[4769]: E1121 13:51:30.931450 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" containerName="keystone-bootstrap" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.931463 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" containerName="keystone-bootstrap" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.931610 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" containerName="keystone-bootstrap" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.932122 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.933858 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-keystone-dockercfg-dbbhj" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.934725 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-config-data" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.934814 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.934871 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"keystone-scripts" Nov 21 13:51:30 crc kubenswrapper[4769]: I1121 13:51:30.944458 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-66b5b8678f-psqjw"] Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.096235 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-config-data\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.096339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqmh\" (UniqueName: \"kubernetes.io/projected/dea91dc4-5738-41f8-8a55-d65000071b1d-kube-api-access-xzqmh\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.096755 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-scripts\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.096822 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-fernet-keys\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.097054 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-credential-keys\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.198616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-config-data\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.198710 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqmh\" (UniqueName: \"kubernetes.io/projected/dea91dc4-5738-41f8-8a55-d65000071b1d-kube-api-access-xzqmh\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.198848 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-scripts\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.198879 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-fernet-keys\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.198944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-credential-keys\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.202824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-scripts\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.202960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-fernet-keys\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.203116 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-config-data\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.204124 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-credential-keys\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.219975 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqmh\" (UniqueName: \"kubernetes.io/projected/dea91dc4-5738-41f8-8a55-d65000071b1d-kube-api-access-xzqmh\") pod \"keystone-66b5b8678f-psqjw\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.250673 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:31 crc kubenswrapper[4769]: I1121 13:51:31.735499 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone-66b5b8678f-psqjw"] Nov 21 13:51:32 crc kubenswrapper[4769]: I1121 13:51:32.601667 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" event={"ID":"dea91dc4-5738-41f8-8a55-d65000071b1d","Type":"ContainerStarted","Data":"21697dce040f1abfab0ad9a1afc66a7a3ce80ff888818894b212c96496c3d032"} Nov 21 13:51:32 crc kubenswrapper[4769]: I1121 13:51:32.602052 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:51:32 crc kubenswrapper[4769]: I1121 13:51:32.602066 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" event={"ID":"dea91dc4-5738-41f8-8a55-d65000071b1d","Type":"ContainerStarted","Data":"d25b8f318d714c51e9d0fea5d8c9913c9c31ebf7317849171402f495bf7f01a9"} Nov 21 13:51:32 crc kubenswrapper[4769]: I1121 13:51:32.621234 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" podStartSLOduration=2.621210929 podStartE2EDuration="2.621210929s" podCreationTimestamp="2025-11-21 13:51:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:51:32.615759584 +0000 UTC m=+7251.316421422" watchObservedRunningTime="2025-11-21 13:51:32.621210929 +0000 UTC m=+7251.321872747" Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.325593 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.326177 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.326248 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.327066 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.327133 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" gracePeriod=600 Nov 21 13:51:41 crc kubenswrapper[4769]: E1121 13:51:41.457963 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.687341 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" exitCode=0 Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.687399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367"} Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.687442 4769 scope.go:117] "RemoveContainer" containerID="3a4944a5b108a6b600ce3284d1598d1895a4b0c39681f6da153127371aede959" Nov 21 13:51:41 crc kubenswrapper[4769]: I1121 13:51:41.688513 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:51:41 crc kubenswrapper[4769]: E1121 13:51:41.688836 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:51:46 crc kubenswrapper[4769]: I1121 13:51:46.730364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" event={"ID":"b3f52a91-5971-47c9-a314-f0a74b8284f8","Type":"ContainerStarted","Data":"bd4a535c3d5c636642201dbdaea6519f0550e893765cfc839f38a9097a1bd02a"} Nov 21 13:51:46 crc kubenswrapper[4769]: I1121 13:51:46.758826 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" podStartSLOduration=1.852919713 podStartE2EDuration="34.758807404s" podCreationTimestamp="2025-11-21 13:51:12 +0000 UTC" firstStartedPulling="2025-11-21 13:51:13.045313605 +0000 UTC m=+7231.745975413" lastFinishedPulling="2025-11-21 13:51:45.951201286 +0000 UTC m=+7264.651863104" observedRunningTime="2025-11-21 13:51:46.756728229 +0000 UTC m=+7265.457390047" watchObservedRunningTime="2025-11-21 13:51:46.758807404 +0000 UTC m=+7265.459469222" Nov 21 13:51:55 crc kubenswrapper[4769]: I1121 13:51:55.274320 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:51:55 crc kubenswrapper[4769]: E1121 13:51:55.275252 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:51:55 crc kubenswrapper[4769]: I1121 13:51:55.793666 4769 generic.go:334] "Generic (PLEG): container finished" podID="b3f52a91-5971-47c9-a314-f0a74b8284f8" containerID="bd4a535c3d5c636642201dbdaea6519f0550e893765cfc839f38a9097a1bd02a" exitCode=0 Nov 21 13:51:55 crc kubenswrapper[4769]: I1121 13:51:55.793739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" event={"ID":"b3f52a91-5971-47c9-a314-f0a74b8284f8","Type":"ContainerDied","Data":"bd4a535c3d5c636642201dbdaea6519f0550e893765cfc839f38a9097a1bd02a"} Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.089606 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.226992 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b3f52a91-5971-47c9-a314-f0a74b8284f8-db-sync-config-data\") pod \"b3f52a91-5971-47c9-a314-f0a74b8284f8\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.227110 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prpbj\" (UniqueName: \"kubernetes.io/projected/b3f52a91-5971-47c9-a314-f0a74b8284f8-kube-api-access-prpbj\") pod \"b3f52a91-5971-47c9-a314-f0a74b8284f8\" (UID: \"b3f52a91-5971-47c9-a314-f0a74b8284f8\") " Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.232787 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f52a91-5971-47c9-a314-f0a74b8284f8-kube-api-access-prpbj" (OuterVolumeSpecName: "kube-api-access-prpbj") pod "b3f52a91-5971-47c9-a314-f0a74b8284f8" (UID: "b3f52a91-5971-47c9-a314-f0a74b8284f8"). InnerVolumeSpecName "kube-api-access-prpbj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.233134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3f52a91-5971-47c9-a314-f0a74b8284f8-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "b3f52a91-5971-47c9-a314-f0a74b8284f8" (UID: "b3f52a91-5971-47c9-a314-f0a74b8284f8"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.329347 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/b3f52a91-5971-47c9-a314-f0a74b8284f8-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.329402 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-prpbj\" (UniqueName: \"kubernetes.io/projected/b3f52a91-5971-47c9-a314-f0a74b8284f8-kube-api-access-prpbj\") on node \"crc\" DevicePath \"\"" Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.816661 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" event={"ID":"b3f52a91-5971-47c9-a314-f0a74b8284f8","Type":"ContainerDied","Data":"ab43505db619193e2fe945abded5539f132138643a5329de79998e7cf4121aeb"} Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.816714 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-jhp5m" Nov 21 13:51:57 crc kubenswrapper[4769]: I1121 13:51:57.816734 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab43505db619193e2fe945abded5539f132138643a5329de79998e7cf4121aeb" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.070563 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2"] Nov 21 13:51:58 crc kubenswrapper[4769]: E1121 13:51:58.070925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b3f52a91-5971-47c9-a314-f0a74b8284f8" containerName="barbican-db-sync" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.070949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f52a91-5971-47c9-a314-f0a74b8284f8" containerName="barbican-db-sync" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.071100 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b3f52a91-5971-47c9-a314-f0a74b8284f8" containerName="barbican-db-sync" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.071933 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.075602 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-barbican-dockercfg-llr59" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.075797 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-worker-config-data" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.075931 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-config-data" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.082660 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.083826 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.092642 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-keystone-listener-config-data" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.099602 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.103957 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.139882 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2b9t\" (UniqueName: \"kubernetes.io/projected/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-kube-api-access-s2b9t\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140156 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqp5j\" (UniqueName: \"kubernetes.io/projected/8a7aee35-3f3b-4aff-b634-8677e6360c25-kube-api-access-lqp5j\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140356 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-logs\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data-custom\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data-custom\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140724 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140830 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.140955 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a7aee35-3f3b-4aff-b634-8677e6360c25-logs\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.171303 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-f9xmg"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.175245 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.177710 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-api-config-data" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.191971 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-f9xmg"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242617 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d447d347-330c-413a-a9ad-e2cb53f163b4-logs\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242681 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data-custom\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242702 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data-custom\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242893 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7qd\" (UniqueName: \"kubernetes.io/projected/d447d347-330c-413a-a9ad-e2cb53f163b4-kube-api-access-rj7qd\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.242965 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a7aee35-3f3b-4aff-b634-8677e6360c25-logs\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.243009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data-custom\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.243111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.243146 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-s2b9t\" (UniqueName: \"kubernetes.io/projected/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-kube-api-access-s2b9t\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.243175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lqp5j\" (UniqueName: \"kubernetes.io/projected/8a7aee35-3f3b-4aff-b634-8677e6360c25-kube-api-access-lqp5j\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.243234 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-logs\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.244029 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-logs\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.244170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a7aee35-3f3b-4aff-b634-8677e6360c25-logs\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.247873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data-custom\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.248304 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.253662 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.256901 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data-custom\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.259332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqp5j\" (UniqueName: \"kubernetes.io/projected/8a7aee35-3f3b-4aff-b634-8677e6360c25-kube-api-access-lqp5j\") pod \"barbican-worker-6b4cc4456c-cqqg2\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.264140 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2b9t\" (UniqueName: \"kubernetes.io/projected/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-kube-api-access-s2b9t\") pod \"barbican-keystone-listener-6d765d5d6-v4tlf\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.345128 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d447d347-330c-413a-a9ad-e2cb53f163b4-logs\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.345221 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7qd\" (UniqueName: \"kubernetes.io/projected/d447d347-330c-413a-a9ad-e2cb53f163b4-kube-api-access-rj7qd\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.345268 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data-custom\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.345313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.345579 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d447d347-330c-413a-a9ad-e2cb53f163b4-logs\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.349001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data-custom\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.350105 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.365843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7qd\" (UniqueName: \"kubernetes.io/projected/d447d347-330c-413a-a9ad-e2cb53f163b4-kube-api-access-rj7qd\") pod \"barbican-api-654b99d576-f9xmg\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.399956 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.410260 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.497099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.576097 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-6tftf"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.577357 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.594820 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-6tftf"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.649373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nbv\" (UniqueName: \"kubernetes.io/projected/94ed83be-61a2-4370-b29e-4c562cc13051-kube-api-access-w2nbv\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.649407 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.649447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data-custom\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.649472 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94ed83be-61a2-4370-b29e-4c562cc13051-logs\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.750862 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data-custom\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.750910 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94ed83be-61a2-4370-b29e-4c562cc13051-logs\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.751011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nbv\" (UniqueName: \"kubernetes.io/projected/94ed83be-61a2-4370-b29e-4c562cc13051-kube-api-access-w2nbv\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.751033 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.752764 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94ed83be-61a2-4370-b29e-4c562cc13051-logs\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.755826 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data-custom\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.756595 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.770245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nbv\" (UniqueName: \"kubernetes.io/projected/94ed83be-61a2-4370-b29e-4c562cc13051-kube-api-access-w2nbv\") pod \"barbican-api-654b99d576-6tftf\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.773022 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.774973 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.788446 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.852043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrhs\" (UniqueName: \"kubernetes.io/projected/3dd1cbb5-d40a-4352-8767-b39413648f8e-kube-api-access-pqrhs\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.852092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.852158 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data-custom\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.852256 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd1cbb5-d40a-4352-8767-b39413648f8e-logs\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: W1121 13:51:58.876623 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cd6f0fd_7664_48b0_bcaf_185c6e603cad.slice/crio-12a0c03e62b11459e802bf86c0f9f2c893db9080536382a4ea0e9d65ef1a6bd5 WatchSource:0}: Error finding container 12a0c03e62b11459e802bf86c0f9f2c893db9080536382a4ea0e9d65ef1a6bd5: Status 404 returned error can't find the container with id 12a0c03e62b11459e802bf86c0f9f2c893db9080536382a4ea0e9d65ef1a6bd5 Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.876742 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.913289 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.946472 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2"] Nov 21 13:51:58 crc kubenswrapper[4769]: W1121 13:51:58.952490 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a7aee35_3f3b_4aff_b634_8677e6360c25.slice/crio-6ff54f38de5449dbdc783e3ffd6252137faf6c9f0beafc8040b43461a003576c WatchSource:0}: Error finding container 6ff54f38de5449dbdc783e3ffd6252137faf6c9f0beafc8040b43461a003576c: Status 404 returned error can't find the container with id 6ff54f38de5449dbdc783e3ffd6252137faf6c9f0beafc8040b43461a003576c Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.953255 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrhs\" (UniqueName: \"kubernetes.io/projected/3dd1cbb5-d40a-4352-8767-b39413648f8e-kube-api-access-pqrhs\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.953303 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.953366 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data-custom\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.953420 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd1cbb5-d40a-4352-8767-b39413648f8e-logs\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.953802 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd1cbb5-d40a-4352-8767-b39413648f8e-logs\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.958966 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data-custom\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.974011 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.974530 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrhs\" (UniqueName: \"kubernetes.io/projected/3dd1cbb5-d40a-4352-8767-b39413648f8e-kube-api-access-pqrhs\") pod \"barbican-keystone-listener-6d765d5d6-ssgn2\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.979115 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6"] Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.980429 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:58 crc kubenswrapper[4769]: I1121 13:51:58.996084 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6"] Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.028373 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-f9xmg"] Nov 21 13:51:59 crc kubenswrapper[4769]: W1121 13:51:59.030061 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd447d347_330c_413a_a9ad_e2cb53f163b4.slice/crio-709792b90c741e396623e55bc1e8cd344b51aab5e223f1a6fce3b8e8973e3da9 WatchSource:0}: Error finding container 709792b90c741e396623e55bc1e8cd344b51aab5e223f1a6fce3b8e8973e3da9: Status 404 returned error can't find the container with id 709792b90c741e396623e55bc1e8cd344b51aab5e223f1a6fce3b8e8973e3da9 Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.054607 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.054654 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0941e750-ce38-4542-a5ba-27f366e0129c-logs\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.054679 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data-custom\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.054760 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdzd\" (UniqueName: \"kubernetes.io/projected/0941e750-ce38-4542-a5ba-27f366e0129c-kube-api-access-zvdzd\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.103885 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.157116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdzd\" (UniqueName: \"kubernetes.io/projected/0941e750-ce38-4542-a5ba-27f366e0129c-kube-api-access-zvdzd\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.157197 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.157238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0941e750-ce38-4542-a5ba-27f366e0129c-logs\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.157269 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data-custom\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.158125 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0941e750-ce38-4542-a5ba-27f366e0129c-logs\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.161729 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data-custom\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.162869 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.173747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdzd\" (UniqueName: \"kubernetes.io/projected/0941e750-ce38-4542-a5ba-27f366e0129c-kube-api-access-zvdzd\") pod \"barbican-worker-6b4cc4456c-lq8k6\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.319874 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.362440 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-6tftf"] Nov 21 13:51:59 crc kubenswrapper[4769]: W1121 13:51:59.373701 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ed83be_61a2_4370_b29e_4c562cc13051.slice/crio-931848ca122b6bed99353cd94d9c8fa8e5fbed0fb191e126d1cb9d2606fd4efe WatchSource:0}: Error finding container 931848ca122b6bed99353cd94d9c8fa8e5fbed0fb191e126d1cb9d2606fd4efe: Status 404 returned error can't find the container with id 931848ca122b6bed99353cd94d9c8fa8e5fbed0fb191e126d1cb9d2606fd4efe Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.513027 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2"] Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.826269 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6"] Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.846536 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" event={"ID":"3dd1cbb5-d40a-4352-8767-b39413648f8e","Type":"ContainerStarted","Data":"3c651889bece11ccea5b770fbae5b3cc880825cddb87be3d2aad7c7fe71911d9"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.849646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" event={"ID":"94ed83be-61a2-4370-b29e-4c562cc13051","Type":"ContainerStarted","Data":"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.849696 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" event={"ID":"94ed83be-61a2-4370-b29e-4c562cc13051","Type":"ContainerStarted","Data":"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.849709 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" event={"ID":"94ed83be-61a2-4370-b29e-4c562cc13051","Type":"ContainerStarted","Data":"931848ca122b6bed99353cd94d9c8fa8e5fbed0fb191e126d1cb9d2606fd4efe"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.849947 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.850004 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.851991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" event={"ID":"d447d347-330c-413a-a9ad-e2cb53f163b4","Type":"ContainerStarted","Data":"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.852027 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" event={"ID":"d447d347-330c-413a-a9ad-e2cb53f163b4","Type":"ContainerStarted","Data":"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.852037 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" event={"ID":"d447d347-330c-413a-a9ad-e2cb53f163b4","Type":"ContainerStarted","Data":"709792b90c741e396623e55bc1e8cd344b51aab5e223f1a6fce3b8e8973e3da9"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.852466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.852546 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.854001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" event={"ID":"8a7aee35-3f3b-4aff-b634-8677e6360c25","Type":"ContainerStarted","Data":"6ff54f38de5449dbdc783e3ffd6252137faf6c9f0beafc8040b43461a003576c"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.855751 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" event={"ID":"0941e750-ce38-4542-a5ba-27f366e0129c","Type":"ContainerStarted","Data":"b786d822070d6c4d2f9d0b86dcf62046bbd3d34804ae40f3df7bf6d8a57707d2"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.856726 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" event={"ID":"6cd6f0fd-7664-48b0-bcaf-185c6e603cad","Type":"ContainerStarted","Data":"12a0c03e62b11459e802bf86c0f9f2c893db9080536382a4ea0e9d65ef1a6bd5"} Nov 21 13:51:59 crc kubenswrapper[4769]: I1121 13:51:59.876317 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" podStartSLOduration=1.87626526 podStartE2EDuration="1.87626526s" podCreationTimestamp="2025-11-21 13:51:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:51:59.865824003 +0000 UTC m=+7278.566485821" watchObservedRunningTime="2025-11-21 13:51:59.87626526 +0000 UTC m=+7278.576927088" Nov 21 13:52:00 crc kubenswrapper[4769]: I1121 13:52:00.097249 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" podStartSLOduration=2.097224525 podStartE2EDuration="2.097224525s" podCreationTimestamp="2025-11-21 13:51:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:51:59.901716596 +0000 UTC m=+7278.602378404" watchObservedRunningTime="2025-11-21 13:52:00.097224525 +0000 UTC m=+7278.797886343" Nov 21 13:52:00 crc kubenswrapper[4769]: I1121 13:52:00.103279 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-f9xmg"] Nov 21 13:52:00 crc kubenswrapper[4769]: I1121 13:52:00.288608 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf"] Nov 21 13:52:00 crc kubenswrapper[4769]: I1121 13:52:00.422081 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6"] Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.624585 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-6tftf"] Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.837826 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2"] Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.874882 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" event={"ID":"8a7aee35-3f3b-4aff-b634-8677e6360c25","Type":"ContainerStarted","Data":"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.874925 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" event={"ID":"8a7aee35-3f3b-4aff-b634-8677e6360c25","Type":"ContainerStarted","Data":"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.878748 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker-log" containerID="cri-o://5f821d0431528bc2b048e6cac8f25fb3a8a5607260b55223fd1cd2a46ecccd99" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.878827 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker" containerID="cri-o://760bbba636cf07e0696298f679ef93bd6e262363693ed5d6eae37594da5405c9" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.878936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" event={"ID":"0941e750-ce38-4542-a5ba-27f366e0129c","Type":"ContainerStarted","Data":"760bbba636cf07e0696298f679ef93bd6e262363693ed5d6eae37594da5405c9"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.880251 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" event={"ID":"0941e750-ce38-4542-a5ba-27f366e0129c","Type":"ContainerStarted","Data":"5f821d0431528bc2b048e6cac8f25fb3a8a5607260b55223fd1cd2a46ecccd99"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.885958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" event={"ID":"6cd6f0fd-7664-48b0-bcaf-185c6e603cad","Type":"ContainerStarted","Data":"1d159eca90332030ff1f3dec3216329ebad59c661b2c949af41f6b21efb9fbec"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.886007 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" event={"ID":"6cd6f0fd-7664-48b0-bcaf-185c6e603cad","Type":"ContainerStarted","Data":"4e2dc774927a32a0772a254328ad44d6b4d64839a7a75402f3be834e1eab7cca"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.886021 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener-log" containerID="cri-o://4e2dc774927a32a0772a254328ad44d6b4d64839a7a75402f3be834e1eab7cca" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.886038 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener" containerID="cri-o://1d159eca90332030ff1f3dec3216329ebad59c661b2c949af41f6b21efb9fbec" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.888364 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api-log" containerID="cri-o://65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.889083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" event={"ID":"3dd1cbb5-d40a-4352-8767-b39413648f8e","Type":"ContainerStarted","Data":"225bc42d496db4b37acbe77be59a8a9c31179c6ae1fb9d7695dbee9efc800c94"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.889118 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" event={"ID":"3dd1cbb5-d40a-4352-8767-b39413648f8e","Type":"ContainerStarted","Data":"1989ab3f1cff17038e31ec640fa12565591f00dfad6f0c1f241778c5d469c751"} Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.889281 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api-log" containerID="cri-o://5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.889384 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api" containerID="cri-o://93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.889462 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api" containerID="cri-o://21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335" gracePeriod=30 Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.906664 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" podStartSLOduration=2.182940961 podStartE2EDuration="3.906646266s" podCreationTimestamp="2025-11-21 13:51:58 +0000 UTC" firstStartedPulling="2025-11-21 13:51:58.957773039 +0000 UTC m=+7277.658434857" lastFinishedPulling="2025-11-21 13:52:00.681478344 +0000 UTC m=+7279.382140162" observedRunningTime="2025-11-21 13:52:01.903908863 +0000 UTC m=+7280.604570671" watchObservedRunningTime="2025-11-21 13:52:01.906646266 +0000 UTC m=+7280.607308074" Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.936539 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" podStartSLOduration=2.89835151 podStartE2EDuration="3.936524619s" podCreationTimestamp="2025-11-21 13:51:58 +0000 UTC" firstStartedPulling="2025-11-21 13:51:59.836798642 +0000 UTC m=+7278.537460460" lastFinishedPulling="2025-11-21 13:52:00.874971751 +0000 UTC m=+7279.575633569" observedRunningTime="2025-11-21 13:52:01.934524686 +0000 UTC m=+7280.635186514" watchObservedRunningTime="2025-11-21 13:52:01.936524619 +0000 UTC m=+7280.637186437" Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.951527 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" podStartSLOduration=2.006719383 podStartE2EDuration="3.951510117s" podCreationTimestamp="2025-11-21 13:51:58 +0000 UTC" firstStartedPulling="2025-11-21 13:51:58.878578827 +0000 UTC m=+7277.579240645" lastFinishedPulling="2025-11-21 13:52:00.823369561 +0000 UTC m=+7279.524031379" observedRunningTime="2025-11-21 13:52:01.950260624 +0000 UTC m=+7280.650922442" watchObservedRunningTime="2025-11-21 13:52:01.951510117 +0000 UTC m=+7280.652171935" Nov 21 13:52:01 crc kubenswrapper[4769]: I1121 13:52:01.970686 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" podStartSLOduration=2.618512703 podStartE2EDuration="3.970667946s" podCreationTimestamp="2025-11-21 13:51:58 +0000 UTC" firstStartedPulling="2025-11-21 13:51:59.519259173 +0000 UTC m=+7278.219920991" lastFinishedPulling="2025-11-21 13:52:00.871414416 +0000 UTC m=+7279.572076234" observedRunningTime="2025-11-21 13:52:01.965385095 +0000 UTC m=+7280.666046933" watchObservedRunningTime="2025-11-21 13:52:01.970667946 +0000 UTC m=+7280.671329764" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.019628 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2"] Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.571788 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.619184 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data\") pod \"94ed83be-61a2-4370-b29e-4c562cc13051\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.619283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94ed83be-61a2-4370-b29e-4c562cc13051-logs\") pod \"94ed83be-61a2-4370-b29e-4c562cc13051\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.619347 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2nbv\" (UniqueName: \"kubernetes.io/projected/94ed83be-61a2-4370-b29e-4c562cc13051-kube-api-access-w2nbv\") pod \"94ed83be-61a2-4370-b29e-4c562cc13051\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.619383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data-custom\") pod \"94ed83be-61a2-4370-b29e-4c562cc13051\" (UID: \"94ed83be-61a2-4370-b29e-4c562cc13051\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.620206 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ed83be-61a2-4370-b29e-4c562cc13051-logs" (OuterVolumeSpecName: "logs") pod "94ed83be-61a2-4370-b29e-4c562cc13051" (UID: "94ed83be-61a2-4370-b29e-4c562cc13051"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.626315 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ed83be-61a2-4370-b29e-4c562cc13051-kube-api-access-w2nbv" (OuterVolumeSpecName: "kube-api-access-w2nbv") pod "94ed83be-61a2-4370-b29e-4c562cc13051" (UID: "94ed83be-61a2-4370-b29e-4c562cc13051"). InnerVolumeSpecName "kube-api-access-w2nbv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.629245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "94ed83be-61a2-4370-b29e-4c562cc13051" (UID: "94ed83be-61a2-4370-b29e-4c562cc13051"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.657517 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data" (OuterVolumeSpecName: "config-data") pod "94ed83be-61a2-4370-b29e-4c562cc13051" (UID: "94ed83be-61a2-4370-b29e-4c562cc13051"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.668174 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723024 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data\") pod \"d447d347-330c-413a-a9ad-e2cb53f163b4\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data-custom\") pod \"d447d347-330c-413a-a9ad-e2cb53f163b4\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723229 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d447d347-330c-413a-a9ad-e2cb53f163b4-logs\") pod \"d447d347-330c-413a-a9ad-e2cb53f163b4\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj7qd\" (UniqueName: \"kubernetes.io/projected/d447d347-330c-413a-a9ad-e2cb53f163b4-kube-api-access-rj7qd\") pod \"d447d347-330c-413a-a9ad-e2cb53f163b4\" (UID: \"d447d347-330c-413a-a9ad-e2cb53f163b4\") " Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723748 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723777 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/94ed83be-61a2-4370-b29e-4c562cc13051-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723793 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w2nbv\" (UniqueName: \"kubernetes.io/projected/94ed83be-61a2-4370-b29e-4c562cc13051-kube-api-access-w2nbv\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.723807 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/94ed83be-61a2-4370-b29e-4c562cc13051-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.724338 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d447d347-330c-413a-a9ad-e2cb53f163b4-logs" (OuterVolumeSpecName: "logs") pod "d447d347-330c-413a-a9ad-e2cb53f163b4" (UID: "d447d347-330c-413a-a9ad-e2cb53f163b4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.730320 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d447d347-330c-413a-a9ad-e2cb53f163b4" (UID: "d447d347-330c-413a-a9ad-e2cb53f163b4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.730420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d447d347-330c-413a-a9ad-e2cb53f163b4-kube-api-access-rj7qd" (OuterVolumeSpecName: "kube-api-access-rj7qd") pod "d447d347-330c-413a-a9ad-e2cb53f163b4" (UID: "d447d347-330c-413a-a9ad-e2cb53f163b4"). InnerVolumeSpecName "kube-api-access-rj7qd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.763448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data" (OuterVolumeSpecName: "config-data") pod "d447d347-330c-413a-a9ad-e2cb53f163b4" (UID: "d447d347-330c-413a-a9ad-e2cb53f163b4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.763678 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.824797 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rj7qd\" (UniqueName: \"kubernetes.io/projected/d447d347-330c-413a-a9ad-e2cb53f163b4-kube-api-access-rj7qd\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.824833 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.824843 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d447d347-330c-413a-a9ad-e2cb53f163b4-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.824851 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d447d347-330c-413a-a9ad-e2cb53f163b4-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.897367 4769 generic.go:334] "Generic (PLEG): container finished" podID="94ed83be-61a2-4370-b29e-4c562cc13051" containerID="93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb" exitCode=0 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.897642 4769 generic.go:334] "Generic (PLEG): container finished" podID="94ed83be-61a2-4370-b29e-4c562cc13051" containerID="65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713" exitCode=143 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.897615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" event={"ID":"94ed83be-61a2-4370-b29e-4c562cc13051","Type":"ContainerDied","Data":"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.898004 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" event={"ID":"94ed83be-61a2-4370-b29e-4c562cc13051","Type":"ContainerDied","Data":"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.898206 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" event={"ID":"94ed83be-61a2-4370-b29e-4c562cc13051","Type":"ContainerDied","Data":"931848ca122b6bed99353cd94d9c8fa8e5fbed0fb191e126d1cb9d2606fd4efe"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.898127 4769 scope.go:117] "RemoveContainer" containerID="93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.897699 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-6tftf" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.900127 4769 generic.go:334] "Generic (PLEG): container finished" podID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerID="21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335" exitCode=0 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.900160 4769 generic.go:334] "Generic (PLEG): container finished" podID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerID="5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925" exitCode=143 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.900219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" event={"ID":"d447d347-330c-413a-a9ad-e2cb53f163b4","Type":"ContainerDied","Data":"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.900242 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" event={"ID":"d447d347-330c-413a-a9ad-e2cb53f163b4","Type":"ContainerDied","Data":"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.900255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" event={"ID":"d447d347-330c-413a-a9ad-e2cb53f163b4","Type":"ContainerDied","Data":"709792b90c741e396623e55bc1e8cd344b51aab5e223f1a6fce3b8e8973e3da9"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.900329 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-654b99d576-f9xmg" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.914433 4769 generic.go:334] "Generic (PLEG): container finished" podID="0941e750-ce38-4542-a5ba-27f366e0129c" containerID="5f821d0431528bc2b048e6cac8f25fb3a8a5607260b55223fd1cd2a46ecccd99" exitCode=143 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.914496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" event={"ID":"0941e750-ce38-4542-a5ba-27f366e0129c","Type":"ContainerDied","Data":"5f821d0431528bc2b048e6cac8f25fb3a8a5607260b55223fd1cd2a46ecccd99"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.917106 4769 generic.go:334] "Generic (PLEG): container finished" podID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerID="4e2dc774927a32a0772a254328ad44d6b4d64839a7a75402f3be834e1eab7cca" exitCode=143 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.918225 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" event={"ID":"6cd6f0fd-7664-48b0-bcaf-185c6e603cad","Type":"ContainerDied","Data":"4e2dc774927a32a0772a254328ad44d6b4d64839a7a75402f3be834e1eab7cca"} Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.918432 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener-log" containerID="cri-o://1989ab3f1cff17038e31ec640fa12565591f00dfad6f0c1f241778c5d469c751" gracePeriod=30 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.918712 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener" containerID="cri-o://225bc42d496db4b37acbe77be59a8a9c31179c6ae1fb9d7695dbee9efc800c94" gracePeriod=30 Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.940387 4769 scope.go:117] "RemoveContainer" containerID="65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.953865 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-6tftf"] Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.963538 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-6tftf"] Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.969880 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-f9xmg"] Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.974927 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-api-654b99d576-f9xmg"] Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.975551 4769 scope.go:117] "RemoveContainer" containerID="93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb" Nov 21 13:52:02 crc kubenswrapper[4769]: E1121 13:52:02.975935 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb\": container with ID starting with 93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb not found: ID does not exist" containerID="93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.975959 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb"} err="failed to get container status \"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb\": rpc error: code = NotFound desc = could not find container \"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb\": container with ID starting with 93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb not found: ID does not exist" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.975977 4769 scope.go:117] "RemoveContainer" containerID="65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713" Nov 21 13:52:02 crc kubenswrapper[4769]: E1121 13:52:02.976424 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713\": container with ID starting with 65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713 not found: ID does not exist" containerID="65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.976447 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713"} err="failed to get container status \"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713\": rpc error: code = NotFound desc = could not find container \"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713\": container with ID starting with 65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713 not found: ID does not exist" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.976460 4769 scope.go:117] "RemoveContainer" containerID="93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.977758 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb"} err="failed to get container status \"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb\": rpc error: code = NotFound desc = could not find container \"93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb\": container with ID starting with 93f6418fb0f363166f3d1d5ad84c1be27e037c9eff17b5c3cf62ab09d2015edb not found: ID does not exist" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.977811 4769 scope.go:117] "RemoveContainer" containerID="65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.978166 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713"} err="failed to get container status \"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713\": rpc error: code = NotFound desc = could not find container \"65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713\": container with ID starting with 65b96f2a3d32cff0cdf1605e63a3901ffa358279db01b1af1d2a5e7c706a0713 not found: ID does not exist" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.978200 4769 scope.go:117] "RemoveContainer" containerID="21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335" Nov 21 13:52:02 crc kubenswrapper[4769]: I1121 13:52:02.996328 4769 scope.go:117] "RemoveContainer" containerID="5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.012932 4769 scope.go:117] "RemoveContainer" containerID="21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335" Nov 21 13:52:03 crc kubenswrapper[4769]: E1121 13:52:03.013421 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335\": container with ID starting with 21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335 not found: ID does not exist" containerID="21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.013478 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335"} err="failed to get container status \"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335\": rpc error: code = NotFound desc = could not find container \"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335\": container with ID starting with 21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335 not found: ID does not exist" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.013510 4769 scope.go:117] "RemoveContainer" containerID="5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925" Nov 21 13:52:03 crc kubenswrapper[4769]: E1121 13:52:03.014070 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925\": container with ID starting with 5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925 not found: ID does not exist" containerID="5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.014100 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925"} err="failed to get container status \"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925\": rpc error: code = NotFound desc = could not find container \"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925\": container with ID starting with 5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925 not found: ID does not exist" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.014115 4769 scope.go:117] "RemoveContainer" containerID="21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.014402 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335"} err="failed to get container status \"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335\": rpc error: code = NotFound desc = could not find container \"21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335\": container with ID starting with 21e66e45848713e1cc915c90536579e8a4b8cfb765a01af74884cdd19f26e335 not found: ID does not exist" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.014442 4769 scope.go:117] "RemoveContainer" containerID="5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.014721 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925"} err="failed to get container status \"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925\": rpc error: code = NotFound desc = could not find container \"5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925\": container with ID starting with 5c3db15b65a7a4833141e6742001e1c4354aeef613cc3ea81451bd95964ce925 not found: ID does not exist" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.265267 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-jhp5m"] Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.282657 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" path="/var/lib/kubelet/pods/94ed83be-61a2-4370-b29e-4c562cc13051/volumes" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.283276 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" path="/var/lib/kubelet/pods/d447d347-330c-413a-a9ad-e2cb53f163b4/volumes" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.283777 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-jhp5m"] Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371349 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9"] Nov 21 13:52:03 crc kubenswrapper[4769]: E1121 13:52:03.371659 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api-log" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371675 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api-log" Nov 21 13:52:03 crc kubenswrapper[4769]: E1121 13:52:03.371688 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371695 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api" Nov 21 13:52:03 crc kubenswrapper[4769]: E1121 13:52:03.371705 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371713 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api" Nov 21 13:52:03 crc kubenswrapper[4769]: E1121 13:52:03.371724 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api-log" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371729 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api-log" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371860 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api-log" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371877 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api-log" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371886 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d447d347-330c-413a-a9ad-e2cb53f163b4" containerName="barbican-api" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.371893 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="94ed83be-61a2-4370-b29e-4c562cc13051" containerName="barbican-api" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.386755 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.391208 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9"] Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.437180 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a77e8476-8ace-476d-8ccb-590f1a9b36dc-operator-scripts\") pod \"barbicanfbaf-account-delete-ktln9\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.437343 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8gqx\" (UniqueName: \"kubernetes.io/projected/a77e8476-8ace-476d-8ccb-590f1a9b36dc-kube-api-access-j8gqx\") pod \"barbicanfbaf-account-delete-ktln9\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.538569 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a77e8476-8ace-476d-8ccb-590f1a9b36dc-operator-scripts\") pod \"barbicanfbaf-account-delete-ktln9\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.539011 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j8gqx\" (UniqueName: \"kubernetes.io/projected/a77e8476-8ace-476d-8ccb-590f1a9b36dc-kube-api-access-j8gqx\") pod \"barbicanfbaf-account-delete-ktln9\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.539491 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a77e8476-8ace-476d-8ccb-590f1a9b36dc-operator-scripts\") pod \"barbicanfbaf-account-delete-ktln9\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.556060 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8gqx\" (UniqueName: \"kubernetes.io/projected/a77e8476-8ace-476d-8ccb-590f1a9b36dc-kube-api-access-j8gqx\") pod \"barbicanfbaf-account-delete-ktln9\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.711574 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.927851 4769 generic.go:334] "Generic (PLEG): container finished" podID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerID="1989ab3f1cff17038e31ec640fa12565591f00dfad6f0c1f241778c5d469c751" exitCode=143 Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.927943 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" event={"ID":"3dd1cbb5-d40a-4352-8767-b39413648f8e","Type":"ContainerDied","Data":"1989ab3f1cff17038e31ec640fa12565591f00dfad6f0c1f241778c5d469c751"} Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.931800 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker-log" containerID="cri-o://805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110" gracePeriod=30 Nov 21 13:52:03 crc kubenswrapper[4769]: I1121 13:52:03.931846 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker" containerID="cri-o://e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8" gracePeriod=30 Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.146216 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9"] Nov 21 13:52:04 crc kubenswrapper[4769]: W1121 13:52:04.157242 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda77e8476_8ace_476d_8ccb_590f1a9b36dc.slice/crio-b34f50f216b28f477077bb77b4f844cdad89876f028693c14ce635fc86340e91 WatchSource:0}: Error finding container b34f50f216b28f477077bb77b4f844cdad89876f028693c14ce635fc86340e91: Status 404 returned error can't find the container with id b34f50f216b28f477077bb77b4f844cdad89876f028693c14ce635fc86340e91 Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.696779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.759309 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a7aee35-3f3b-4aff-b634-8677e6360c25-logs\") pod \"8a7aee35-3f3b-4aff-b634-8677e6360c25\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.759439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data\") pod \"8a7aee35-3f3b-4aff-b634-8677e6360c25\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.759499 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data-custom\") pod \"8a7aee35-3f3b-4aff-b634-8677e6360c25\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.759527 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqp5j\" (UniqueName: \"kubernetes.io/projected/8a7aee35-3f3b-4aff-b634-8677e6360c25-kube-api-access-lqp5j\") pod \"8a7aee35-3f3b-4aff-b634-8677e6360c25\" (UID: \"8a7aee35-3f3b-4aff-b634-8677e6360c25\") " Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.759914 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7aee35-3f3b-4aff-b634-8677e6360c25-logs" (OuterVolumeSpecName: "logs") pod "8a7aee35-3f3b-4aff-b634-8677e6360c25" (UID: "8a7aee35-3f3b-4aff-b634-8677e6360c25"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.765627 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7aee35-3f3b-4aff-b634-8677e6360c25-kube-api-access-lqp5j" (OuterVolumeSpecName: "kube-api-access-lqp5j") pod "8a7aee35-3f3b-4aff-b634-8677e6360c25" (UID: "8a7aee35-3f3b-4aff-b634-8677e6360c25"). InnerVolumeSpecName "kube-api-access-lqp5j". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.776880 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8a7aee35-3f3b-4aff-b634-8677e6360c25" (UID: "8a7aee35-3f3b-4aff-b634-8677e6360c25"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.804414 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data" (OuterVolumeSpecName: "config-data") pod "8a7aee35-3f3b-4aff-b634-8677e6360c25" (UID: "8a7aee35-3f3b-4aff-b634-8677e6360c25"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.861661 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.861708 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8a7aee35-3f3b-4aff-b634-8677e6360c25-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.861725 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lqp5j\" (UniqueName: \"kubernetes.io/projected/8a7aee35-3f3b-4aff-b634-8677e6360c25-kube-api-access-lqp5j\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.861738 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a7aee35-3f3b-4aff-b634-8677e6360c25-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.939800 4769 generic.go:334] "Generic (PLEG): container finished" podID="a77e8476-8ace-476d-8ccb-590f1a9b36dc" containerID="f0d2756aa56310e9a481612d0dfdff3df78669ca2140f82142666994b43b4e65" exitCode=0 Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.939886 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" event={"ID":"a77e8476-8ace-476d-8ccb-590f1a9b36dc","Type":"ContainerDied","Data":"f0d2756aa56310e9a481612d0dfdff3df78669ca2140f82142666994b43b4e65"} Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.939923 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" event={"ID":"a77e8476-8ace-476d-8ccb-590f1a9b36dc","Type":"ContainerStarted","Data":"b34f50f216b28f477077bb77b4f844cdad89876f028693c14ce635fc86340e91"} Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.941925 4769 generic.go:334] "Generic (PLEG): container finished" podID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerID="e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8" exitCode=0 Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.941953 4769 generic.go:334] "Generic (PLEG): container finished" podID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerID="805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110" exitCode=143 Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.942008 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.942013 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" event={"ID":"8a7aee35-3f3b-4aff-b634-8677e6360c25","Type":"ContainerDied","Data":"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8"} Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.942920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" event={"ID":"8a7aee35-3f3b-4aff-b634-8677e6360c25","Type":"ContainerDied","Data":"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110"} Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.942935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2" event={"ID":"8a7aee35-3f3b-4aff-b634-8677e6360c25","Type":"ContainerDied","Data":"6ff54f38de5449dbdc783e3ffd6252137faf6c9f0beafc8040b43461a003576c"} Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.942953 4769 scope.go:117] "RemoveContainer" containerID="e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.974425 4769 scope.go:117] "RemoveContainer" containerID="805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110" Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.983032 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2"] Nov 21 13:52:04 crc kubenswrapper[4769]: I1121 13:52:04.991404 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-cqqg2"] Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.013366 4769 scope.go:117] "RemoveContainer" containerID="e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8" Nov 21 13:52:05 crc kubenswrapper[4769]: E1121 13:52:05.020371 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8\": container with ID starting with e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8 not found: ID does not exist" containerID="e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.020444 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8"} err="failed to get container status \"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8\": rpc error: code = NotFound desc = could not find container \"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8\": container with ID starting with e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8 not found: ID does not exist" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.020478 4769 scope.go:117] "RemoveContainer" containerID="805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110" Nov 21 13:52:05 crc kubenswrapper[4769]: E1121 13:52:05.025979 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110\": container with ID starting with 805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110 not found: ID does not exist" containerID="805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.026039 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110"} err="failed to get container status \"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110\": rpc error: code = NotFound desc = could not find container \"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110\": container with ID starting with 805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110 not found: ID does not exist" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.026073 4769 scope.go:117] "RemoveContainer" containerID="e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.031359 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8"} err="failed to get container status \"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8\": rpc error: code = NotFound desc = could not find container \"e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8\": container with ID starting with e7b0290b81f3925a80ea4d94489c577158c9bff815cc4f037a27a23398f7daf8 not found: ID does not exist" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.031422 4769 scope.go:117] "RemoveContainer" containerID="805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.035327 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110"} err="failed to get container status \"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110\": rpc error: code = NotFound desc = could not find container \"805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110\": container with ID starting with 805f0eead31538778263bc00171295359dd6794ad191a000f2d654f255acb110 not found: ID does not exist" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.295148 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" path="/var/lib/kubelet/pods/8a7aee35-3f3b-4aff-b634-8677e6360c25/volumes" Nov 21 13:52:05 crc kubenswrapper[4769]: I1121 13:52:05.296835 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3f52a91-5971-47c9-a314-f0a74b8284f8" path="/var/lib/kubelet/pods/b3f52a91-5971-47c9-a314-f0a74b8284f8/volumes" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.285121 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.384974 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a77e8476-8ace-476d-8ccb-590f1a9b36dc-operator-scripts\") pod \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.385221 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8gqx\" (UniqueName: \"kubernetes.io/projected/a77e8476-8ace-476d-8ccb-590f1a9b36dc-kube-api-access-j8gqx\") pod \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\" (UID: \"a77e8476-8ace-476d-8ccb-590f1a9b36dc\") " Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.385667 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77e8476-8ace-476d-8ccb-590f1a9b36dc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a77e8476-8ace-476d-8ccb-590f1a9b36dc" (UID: "a77e8476-8ace-476d-8ccb-590f1a9b36dc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.390127 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77e8476-8ace-476d-8ccb-590f1a9b36dc-kube-api-access-j8gqx" (OuterVolumeSpecName: "kube-api-access-j8gqx") pod "a77e8476-8ace-476d-8ccb-590f1a9b36dc" (UID: "a77e8476-8ace-476d-8ccb-590f1a9b36dc"). InnerVolumeSpecName "kube-api-access-j8gqx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.487701 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j8gqx\" (UniqueName: \"kubernetes.io/projected/a77e8476-8ace-476d-8ccb-590f1a9b36dc-kube-api-access-j8gqx\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.487749 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a77e8476-8ace-476d-8ccb-590f1a9b36dc-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.959531 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" event={"ID":"a77e8476-8ace-476d-8ccb-590f1a9b36dc","Type":"ContainerDied","Data":"b34f50f216b28f477077bb77b4f844cdad89876f028693c14ce635fc86340e91"} Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.959799 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b34f50f216b28f477077bb77b4f844cdad89876f028693c14ce635fc86340e91" Nov 21 13:52:06 crc kubenswrapper[4769]: I1121 13:52:06.959587 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9" Nov 21 13:52:07 crc kubenswrapper[4769]: I1121 13:52:07.274900 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:52:07 crc kubenswrapper[4769]: E1121 13:52:07.275444 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.414161 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-h9z6j"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.425880 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-h9z6j"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.433799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.440743 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.449277 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-fbaf-account-create-update-dpjbq"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.455486 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbicanfbaf-account-delete-ktln9"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.495566 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-create-kvm7d"] Nov 21 13:52:08 crc kubenswrapper[4769]: E1121 13:52:08.495886 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.495898 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker" Nov 21 13:52:08 crc kubenswrapper[4769]: E1121 13:52:08.495908 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker-log" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.495914 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker-log" Nov 21 13:52:08 crc kubenswrapper[4769]: E1121 13:52:08.495930 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a77e8476-8ace-476d-8ccb-590f1a9b36dc" containerName="mariadb-account-delete" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.495936 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77e8476-8ace-476d-8ccb-590f1a9b36dc" containerName="mariadb-account-delete" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.496060 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.496080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a77e8476-8ace-476d-8ccb-590f1a9b36dc" containerName="mariadb-account-delete" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.496092 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8a7aee35-3f3b-4aff-b634-8677e6360c25" containerName="barbican-worker-log" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.496598 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.505160 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-kvm7d"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.604236 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.605288 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.607014 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-db-secret" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.621223 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8g7\" (UniqueName: \"kubernetes.io/projected/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-kube-api-access-7d8g7\") pod \"barbican-db-create-kvm7d\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.621317 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-operator-scripts\") pod \"barbican-db-create-kvm7d\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.622025 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8"] Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.722870 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8g7\" (UniqueName: \"kubernetes.io/projected/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-kube-api-access-7d8g7\") pod \"barbican-db-create-kvm7d\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.722962 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-operator-scripts\") pod \"barbican-db-create-kvm7d\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.723024 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-operator-scripts\") pod \"barbican-2cec-account-create-update-bpwf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.723078 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb2gk\" (UniqueName: \"kubernetes.io/projected/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-kube-api-access-jb2gk\") pod \"barbican-2cec-account-create-update-bpwf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.723843 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-operator-scripts\") pod \"barbican-db-create-kvm7d\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.741274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8g7\" (UniqueName: \"kubernetes.io/projected/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-kube-api-access-7d8g7\") pod \"barbican-db-create-kvm7d\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.813990 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.824853 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-operator-scripts\") pod \"barbican-2cec-account-create-update-bpwf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.824932 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jb2gk\" (UniqueName: \"kubernetes.io/projected/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-kube-api-access-jb2gk\") pod \"barbican-2cec-account-create-update-bpwf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.826177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-operator-scripts\") pod \"barbican-2cec-account-create-update-bpwf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.849601 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb2gk\" (UniqueName: \"kubernetes.io/projected/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-kube-api-access-jb2gk\") pod \"barbican-2cec-account-create-update-bpwf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:08 crc kubenswrapper[4769]: I1121 13:52:08.936704 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.284564 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a9283ea-39fd-4703-9ed9-40759ff0cd16" path="/var/lib/kubelet/pods/4a9283ea-39fd-4703-9ed9-40759ff0cd16/volumes" Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.285241 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4148acc-a147-4b8f-ae62-0c82e33edcb5" path="/var/lib/kubelet/pods/a4148acc-a147-4b8f-ae62-0c82e33edcb5/volumes" Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.285760 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77e8476-8ace-476d-8ccb-590f1a9b36dc" path="/var/lib/kubelet/pods/a77e8476-8ace-476d-8ccb-590f1a9b36dc/volumes" Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.307684 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-kvm7d"] Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.415954 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8"] Nov 21 13:52:09 crc kubenswrapper[4769]: W1121 13:52:09.419130 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod597bc815_b7e8_4ee5_903a_d66df0e3bdf8.slice/crio-47cc91e872c8fa73014aedf007a5114eca75502fc7176006a27a5371c27a5134 WatchSource:0}: Error finding container 47cc91e872c8fa73014aedf007a5114eca75502fc7176006a27a5371c27a5134: Status 404 returned error can't find the container with id 47cc91e872c8fa73014aedf007a5114eca75502fc7176006a27a5371c27a5134 Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.997765 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" event={"ID":"597bc815-b7e8-4ee5-903a-d66df0e3bdf8","Type":"ContainerStarted","Data":"f08861aaee95378e08712ce6b45704526ad1664c91f5d5e2e0a0ede14ca63363"} Nov 21 13:52:09 crc kubenswrapper[4769]: I1121 13:52:09.998105 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" event={"ID":"597bc815-b7e8-4ee5-903a-d66df0e3bdf8","Type":"ContainerStarted","Data":"47cc91e872c8fa73014aedf007a5114eca75502fc7176006a27a5371c27a5134"} Nov 21 13:52:10 crc kubenswrapper[4769]: I1121 13:52:10.001155 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" event={"ID":"f3936213-ed22-4c4f-ab64-60c8f9af9bdf","Type":"ContainerStarted","Data":"f3e1c1530c4fc06f9dfd840a8f9b0de966dda3aa74e6f5af997da0aefced9817"} Nov 21 13:52:10 crc kubenswrapper[4769]: I1121 13:52:10.001289 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" event={"ID":"f3936213-ed22-4c4f-ab64-60c8f9af9bdf","Type":"ContainerStarted","Data":"ac5eddc94bf40463620671af2a625fd78b517e07675b4e1f4d6d5e096b8f4516"} Nov 21 13:52:10 crc kubenswrapper[4769]: I1121 13:52:10.013337 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" podStartSLOduration=2.013319963 podStartE2EDuration="2.013319963s" podCreationTimestamp="2025-11-21 13:52:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:10.012111841 +0000 UTC m=+7288.712773659" watchObservedRunningTime="2025-11-21 13:52:10.013319963 +0000 UTC m=+7288.713981781" Nov 21 13:52:10 crc kubenswrapper[4769]: I1121 13:52:10.030275 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" podStartSLOduration=2.030250133 podStartE2EDuration="2.030250133s" podCreationTimestamp="2025-11-21 13:52:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:10.025813095 +0000 UTC m=+7288.726474913" watchObservedRunningTime="2025-11-21 13:52:10.030250133 +0000 UTC m=+7288.730911961" Nov 21 13:52:11 crc kubenswrapper[4769]: I1121 13:52:11.012488 4769 generic.go:334] "Generic (PLEG): container finished" podID="f3936213-ed22-4c4f-ab64-60c8f9af9bdf" containerID="f3e1c1530c4fc06f9dfd840a8f9b0de966dda3aa74e6f5af997da0aefced9817" exitCode=0 Nov 21 13:52:11 crc kubenswrapper[4769]: I1121 13:52:11.012546 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" event={"ID":"f3936213-ed22-4c4f-ab64-60c8f9af9bdf","Type":"ContainerDied","Data":"f3e1c1530c4fc06f9dfd840a8f9b0de966dda3aa74e6f5af997da0aefced9817"} Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.509687 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.601973 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-operator-scripts\") pod \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.602108 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8g7\" (UniqueName: \"kubernetes.io/projected/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-kube-api-access-7d8g7\") pod \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\" (UID: \"f3936213-ed22-4c4f-ab64-60c8f9af9bdf\") " Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.602707 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f3936213-ed22-4c4f-ab64-60c8f9af9bdf" (UID: "f3936213-ed22-4c4f-ab64-60c8f9af9bdf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.610538 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-kube-api-access-7d8g7" (OuterVolumeSpecName: "kube-api-access-7d8g7") pod "f3936213-ed22-4c4f-ab64-60c8f9af9bdf" (UID: "f3936213-ed22-4c4f-ab64-60c8f9af9bdf"). InnerVolumeSpecName "kube-api-access-7d8g7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.705257 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:12 crc kubenswrapper[4769]: I1121 13:52:12.705335 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7d8g7\" (UniqueName: \"kubernetes.io/projected/f3936213-ed22-4c4f-ab64-60c8f9af9bdf-kube-api-access-7d8g7\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:13 crc kubenswrapper[4769]: I1121 13:52:13.034171 4769 generic.go:334] "Generic (PLEG): container finished" podID="597bc815-b7e8-4ee5-903a-d66df0e3bdf8" containerID="f08861aaee95378e08712ce6b45704526ad1664c91f5d5e2e0a0ede14ca63363" exitCode=0 Nov 21 13:52:13 crc kubenswrapper[4769]: I1121 13:52:13.034299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" event={"ID":"597bc815-b7e8-4ee5-903a-d66df0e3bdf8","Type":"ContainerDied","Data":"f08861aaee95378e08712ce6b45704526ad1664c91f5d5e2e0a0ede14ca63363"} Nov 21 13:52:13 crc kubenswrapper[4769]: I1121 13:52:13.038958 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" event={"ID":"f3936213-ed22-4c4f-ab64-60c8f9af9bdf","Type":"ContainerDied","Data":"ac5eddc94bf40463620671af2a625fd78b517e07675b4e1f4d6d5e096b8f4516"} Nov 21 13:52:13 crc kubenswrapper[4769]: I1121 13:52:13.039015 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac5eddc94bf40463620671af2a625fd78b517e07675b4e1f4d6d5e096b8f4516" Nov 21 13:52:13 crc kubenswrapper[4769]: I1121 13:52:13.039021 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-create-kvm7d" Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.372766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.463179 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb2gk\" (UniqueName: \"kubernetes.io/projected/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-kube-api-access-jb2gk\") pod \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.463436 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-operator-scripts\") pod \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\" (UID: \"597bc815-b7e8-4ee5-903a-d66df0e3bdf8\") " Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.465134 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "597bc815-b7e8-4ee5-903a-d66df0e3bdf8" (UID: "597bc815-b7e8-4ee5-903a-d66df0e3bdf8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.473344 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-kube-api-access-jb2gk" (OuterVolumeSpecName: "kube-api-access-jb2gk") pod "597bc815-b7e8-4ee5-903a-d66df0e3bdf8" (UID: "597bc815-b7e8-4ee5-903a-d66df0e3bdf8"). InnerVolumeSpecName "kube-api-access-jb2gk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.565636 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:14 crc kubenswrapper[4769]: I1121 13:52:14.565694 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jb2gk\" (UniqueName: \"kubernetes.io/projected/597bc815-b7e8-4ee5-903a-d66df0e3bdf8-kube-api-access-jb2gk\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:15 crc kubenswrapper[4769]: I1121 13:52:15.062861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" event={"ID":"597bc815-b7e8-4ee5-903a-d66df0e3bdf8","Type":"ContainerDied","Data":"47cc91e872c8fa73014aedf007a5114eca75502fc7176006a27a5371c27a5134"} Nov 21 13:52:15 crc kubenswrapper[4769]: I1121 13:52:15.063519 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47cc91e872c8fa73014aedf007a5114eca75502fc7176006a27a5371c27a5134" Nov 21 13:52:15 crc kubenswrapper[4769]: I1121 13:52:15.062949 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.919508 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-sml8t"] Nov 21 13:52:18 crc kubenswrapper[4769]: E1121 13:52:18.921432 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f3936213-ed22-4c4f-ab64-60c8f9af9bdf" containerName="mariadb-database-create" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.921512 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3936213-ed22-4c4f-ab64-60c8f9af9bdf" containerName="mariadb-database-create" Nov 21 13:52:18 crc kubenswrapper[4769]: E1121 13:52:18.921584 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="597bc815-b7e8-4ee5-903a-d66df0e3bdf8" containerName="mariadb-account-create-update" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.921637 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="597bc815-b7e8-4ee5-903a-d66df0e3bdf8" containerName="mariadb-account-create-update" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.921889 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="597bc815-b7e8-4ee5-903a-d66df0e3bdf8" containerName="mariadb-account-create-update" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.921973 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f3936213-ed22-4c4f-ab64-60c8f9af9bdf" containerName="mariadb-database-create" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.922596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.924967 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"combined-ca-bundle" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.925261 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-barbican-dockercfg-hg5r8" Nov 21 13:52:18 crc kubenswrapper[4769]: I1121 13:52:18.932671 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-sml8t"] Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.040368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-combined-ca-bundle\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.040480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrng\" (UniqueName: \"kubernetes.io/projected/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-kube-api-access-7lrng\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.040519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-db-sync-config-data\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.142568 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-combined-ca-bundle\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.142685 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrng\" (UniqueName: \"kubernetes.io/projected/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-kube-api-access-7lrng\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.142717 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-db-sync-config-data\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.150497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-db-sync-config-data\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.161759 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-combined-ca-bundle\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.176908 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrng\" (UniqueName: \"kubernetes.io/projected/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-kube-api-access-7lrng\") pod \"barbican-db-sync-sml8t\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.255239 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:19 crc kubenswrapper[4769]: I1121 13:52:19.478260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-sml8t"] Nov 21 13:52:20 crc kubenswrapper[4769]: I1121 13:52:20.105283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" event={"ID":"66baf91d-0d1e-49d6-8ce5-fefdb63dee20","Type":"ContainerStarted","Data":"3af7d7cb2b124f8d715ee682a34cadb49ba88d24f95c5790135968cd1a7a1a85"} Nov 21 13:52:20 crc kubenswrapper[4769]: I1121 13:52:20.105672 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" event={"ID":"66baf91d-0d1e-49d6-8ce5-fefdb63dee20","Type":"ContainerStarted","Data":"84ab9e6c0b762e99f1ccd01addf63aa643bce53632b599ec0d465dde5b0218e8"} Nov 21 13:52:20 crc kubenswrapper[4769]: I1121 13:52:20.128630 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" podStartSLOduration=2.1286049 podStartE2EDuration="2.1286049s" podCreationTimestamp="2025-11-21 13:52:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:20.122005694 +0000 UTC m=+7298.822667522" watchObservedRunningTime="2025-11-21 13:52:20.1286049 +0000 UTC m=+7298.829266728" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.114924 4769 generic.go:334] "Generic (PLEG): container finished" podID="66baf91d-0d1e-49d6-8ce5-fefdb63dee20" containerID="3af7d7cb2b124f8d715ee682a34cadb49ba88d24f95c5790135968cd1a7a1a85" exitCode=0 Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.114970 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" event={"ID":"66baf91d-0d1e-49d6-8ce5-fefdb63dee20","Type":"ContainerDied","Data":"3af7d7cb2b124f8d715ee682a34cadb49ba88d24f95c5790135968cd1a7a1a85"} Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.203478 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-pctx2"] Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.205690 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.221028 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-pctx2"] Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.273892 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:52:21 crc kubenswrapper[4769]: E1121 13:52:21.274264 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.279864 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9vdn\" (UniqueName: \"kubernetes.io/projected/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-kube-api-access-f9vdn\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.279980 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-utilities\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.280022 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-catalog-content\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.381948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f9vdn\" (UniqueName: \"kubernetes.io/projected/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-kube-api-access-f9vdn\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.382079 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-utilities\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.382123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-catalog-content\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.382860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-catalog-content\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.382940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-utilities\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.409668 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9vdn\" (UniqueName: \"kubernetes.io/projected/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-kube-api-access-f9vdn\") pod \"redhat-operators-pctx2\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.525144 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:21 crc kubenswrapper[4769]: I1121 13:52:21.802290 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-pctx2"] Nov 21 13:52:21 crc kubenswrapper[4769]: W1121 13:52:21.814550 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd2b67a_30a6_49c9_9ff9_641dd864f0f4.slice/crio-fad4f89f26f24d96533b4f952acae1a96649f1ecacbb824ee30efcaa98376892 WatchSource:0}: Error finding container fad4f89f26f24d96533b4f952acae1a96649f1ecacbb824ee30efcaa98376892: Status 404 returned error can't find the container with id fad4f89f26f24d96533b4f952acae1a96649f1ecacbb824ee30efcaa98376892 Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.127370 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerID="fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff" exitCode=0 Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.127450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerDied","Data":"fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff"} Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.127526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerStarted","Data":"fad4f89f26f24d96533b4f952acae1a96649f1ecacbb824ee30efcaa98376892"} Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.130727 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.385924 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.500003 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lrng\" (UniqueName: \"kubernetes.io/projected/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-kube-api-access-7lrng\") pod \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.500551 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-db-sync-config-data\") pod \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.500604 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-combined-ca-bundle\") pod \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\" (UID: \"66baf91d-0d1e-49d6-8ce5-fefdb63dee20\") " Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.513015 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "66baf91d-0d1e-49d6-8ce5-fefdb63dee20" (UID: "66baf91d-0d1e-49d6-8ce5-fefdb63dee20"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.526420 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-kube-api-access-7lrng" (OuterVolumeSpecName: "kube-api-access-7lrng") pod "66baf91d-0d1e-49d6-8ce5-fefdb63dee20" (UID: "66baf91d-0d1e-49d6-8ce5-fefdb63dee20"). InnerVolumeSpecName "kube-api-access-7lrng". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.536876 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66baf91d-0d1e-49d6-8ce5-fefdb63dee20" (UID: "66baf91d-0d1e-49d6-8ce5-fefdb63dee20"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.602386 4769 reconciler_common.go:293] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.602634 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:22 crc kubenswrapper[4769]: I1121 13:52:22.602709 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7lrng\" (UniqueName: \"kubernetes.io/projected/66baf91d-0d1e-49d6-8ce5-fefdb63dee20-kube-api-access-7lrng\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.136968 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" event={"ID":"66baf91d-0d1e-49d6-8ce5-fefdb63dee20","Type":"ContainerDied","Data":"84ab9e6c0b762e99f1ccd01addf63aa643bce53632b599ec0d465dde5b0218e8"} Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.137012 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84ab9e6c0b762e99f1ccd01addf63aa643bce53632b599ec0d465dde5b0218e8" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.137033 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-db-sync-sml8t" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.373628 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh"] Nov 21 13:52:23 crc kubenswrapper[4769]: E1121 13:52:23.374172 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="66baf91d-0d1e-49d6-8ce5-fefdb63dee20" containerName="barbican-db-sync" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.374232 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="66baf91d-0d1e-49d6-8ce5-fefdb63dee20" containerName="barbican-db-sync" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.374476 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="66baf91d-0d1e-49d6-8ce5-fefdb63dee20" containerName="barbican-db-sync" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.376268 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.383752 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"combined-ca-bundle" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.383758 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-barbican-dockercfg-hg5r8" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.401387 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz"] Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.403126 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.415609 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh"] Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.429637 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz"] Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.472276 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican-api-66f6566756-wf468"] Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.482874 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.490813 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"cert-barbican-public-svc" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.491012 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"barbican-api-config-data" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.491117 4769 reflector.go:368] Caches populated for *v1.Secret from object-"barbican-kuttl-tests"/"cert-barbican-internal-svc" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.502264 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-66f6566756-wf468"] Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520691 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-combined-ca-bundle\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520808 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-combined-ca-bundle\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520835 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520859 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fln96\" (UniqueName: \"kubernetes.io/projected/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-kube-api-access-fln96\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520902 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgqx\" (UniqueName: \"kubernetes.io/projected/c55a53c2-3930-4aab-851f-332e033d29db-kube-api-access-7jgqx\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.520962 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data-custom\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.521037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c55a53c2-3930-4aab-851f-332e033d29db-logs\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.521062 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-logs\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.521099 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data-custom\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622552 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-logs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-combined-ca-bundle\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622687 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622712 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fln96\" (UniqueName: \"kubernetes.io/projected/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-kube-api-access-fln96\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622759 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgqx\" (UniqueName: \"kubernetes.io/projected/c55a53c2-3930-4aab-851f-332e033d29db-kube-api-access-7jgqx\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622790 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-internal-tls-certs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622815 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data-custom\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622860 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data-custom\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622892 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-combined-ca-bundle\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622944 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c55a53c2-3930-4aab-851f-332e033d29db-logs\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.622972 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-logs\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-public-tls-certs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdt79\" (UniqueName: \"kubernetes.io/projected/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-kube-api-access-qdt79\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623052 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data-custom\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623094 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-combined-ca-bundle\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623116 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623402 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c55a53c2-3930-4aab-851f-332e033d29db-logs\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.623933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-logs\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.629599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-combined-ca-bundle\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.629716 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.632707 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-combined-ca-bundle\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.633414 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data-custom\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.640218 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data-custom\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.640515 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.645810 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgqx\" (UniqueName: \"kubernetes.io/projected/c55a53c2-3930-4aab-851f-332e033d29db-kube-api-access-7jgqx\") pod \"barbican-keystone-listener-87c6d864b-fd6kz\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.648163 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fln96\" (UniqueName: \"kubernetes.io/projected/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-kube-api-access-fln96\") pod \"barbican-worker-b75f7fb95-b5zwh\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.700733 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.723177 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724450 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-logs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724496 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-internal-tls-certs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data-custom\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724600 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-combined-ca-bundle\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724632 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-public-tls-certs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.724663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qdt79\" (UniqueName: \"kubernetes.io/projected/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-kube-api-access-qdt79\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.725348 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-logs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.728827 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data-custom\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.729087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.729993 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-combined-ca-bundle\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.730636 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-public-tls-certs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.732174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-internal-tls-certs\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.746117 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdt79\" (UniqueName: \"kubernetes.io/projected/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-kube-api-access-qdt79\") pod \"barbican-api-66f6566756-wf468\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:23 crc kubenswrapper[4769]: I1121 13:52:23.835582 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.085928 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.165254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerStarted","Data":"508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c"} Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.183378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" event={"ID":"c55a53c2-3930-4aab-851f-332e033d29db","Type":"ContainerStarted","Data":"62cb6e1bfb94a8669c2210ade01097880de853100a993662bb85ed01f3962a6b"} Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.262789 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.294084 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican-api-66f6566756-wf468"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.477363 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-sml8t"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.484112 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-sync-sml8t"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.498718 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/barbican2cec-account-delete-2dgsc"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.500463 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.547251 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican2cec-account-delete-2dgsc"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.558443 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.566271 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.592349 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-66f6566756-wf468"] Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.641248 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jlz\" (UniqueName: \"kubernetes.io/projected/ef8c82cb-dec3-47a5-a126-28479c858c26-kube-api-access-r2jlz\") pod \"barbican2cec-account-delete-2dgsc\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.641469 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef8c82cb-dec3-47a5-a126-28479c858c26-operator-scripts\") pod \"barbican2cec-account-delete-2dgsc\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.742976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef8c82cb-dec3-47a5-a126-28479c858c26-operator-scripts\") pod \"barbican2cec-account-delete-2dgsc\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.743816 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef8c82cb-dec3-47a5-a126-28479c858c26-operator-scripts\") pod \"barbican2cec-account-delete-2dgsc\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.744032 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jlz\" (UniqueName: \"kubernetes.io/projected/ef8c82cb-dec3-47a5-a126-28479c858c26-kube-api-access-r2jlz\") pod \"barbican2cec-account-delete-2dgsc\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.764882 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jlz\" (UniqueName: \"kubernetes.io/projected/ef8c82cb-dec3-47a5-a126-28479c858c26-kube-api-access-r2jlz\") pod \"barbican2cec-account-delete-2dgsc\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:24 crc kubenswrapper[4769]: I1121 13:52:24.768997 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.233059 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerID="508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c" exitCode=0 Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.234280 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerDied","Data":"508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c"} Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.240125 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/barbican2cec-account-delete-2dgsc"] Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.243680 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" event={"ID":"8c9c0a91-30f5-455d-a7c2-ed0cddba362d","Type":"ContainerStarted","Data":"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207"} Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.243746 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" event={"ID":"8c9c0a91-30f5-455d-a7c2-ed0cddba362d","Type":"ContainerStarted","Data":"182676cd6f95a7ba8861a21eaf90a5b338a4a52fa4dc1b0d8f8315ad0752cb74"} Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.247438 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" event={"ID":"c55a53c2-3930-4aab-851f-332e033d29db","Type":"ContainerStarted","Data":"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3"} Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.260933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" event={"ID":"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf","Type":"ContainerStarted","Data":"d27c08041bf099d393e072a836977d8eded69da0ddb2b46d4afb1f55c9d6dbaa"} Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.260991 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" event={"ID":"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf","Type":"ContainerStarted","Data":"ba17c80c8e6ff6ed49a837ce56e6237eb9e20e25c050e399e070742db57197da"} Nov 21 13:52:25 crc kubenswrapper[4769]: I1121 13:52:25.290353 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66baf91d-0d1e-49d6-8ce5-fefdb63dee20" path="/var/lib/kubelet/pods/66baf91d-0d1e-49d6-8ce5-fefdb63dee20/volumes" Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.271588 4769 generic.go:334] "Generic (PLEG): container finished" podID="ef8c82cb-dec3-47a5-a126-28479c858c26" containerID="b21c52c4ed075aa300e965c904732331817ffcbaa63220141d36f02a2d4d0eb9" exitCode=0 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.271718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" event={"ID":"ef8c82cb-dec3-47a5-a126-28479c858c26","Type":"ContainerDied","Data":"b21c52c4ed075aa300e965c904732331817ffcbaa63220141d36f02a2d4d0eb9"} Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.272026 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" event={"ID":"ef8c82cb-dec3-47a5-a126-28479c858c26","Type":"ContainerStarted","Data":"eacaea6392a0722f4059b995fbb62a39f106936af5b6add97a59be6adf3655e3"} Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.276017 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" event={"ID":"8c9c0a91-30f5-455d-a7c2-ed0cddba362d","Type":"ContainerStarted","Data":"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750"} Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.276162 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api" containerID="cri-o://a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750" gracePeriod=30 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.276230 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.276267 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.276119 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api-log" containerID="cri-o://17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207" gracePeriod=30 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.284617 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" event={"ID":"c55a53c2-3930-4aab-851f-332e033d29db","Type":"ContainerStarted","Data":"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2"} Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.284788 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener-log" containerID="cri-o://8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3" gracePeriod=30 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.284800 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener" containerID="cri-o://fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2" gracePeriod=30 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.292292 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" event={"ID":"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf","Type":"ContainerStarted","Data":"957c822a2db2d466e7a57fa7ba53feb16c4223cb346ab3ed286abd62509e04f9"} Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.292431 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker-log" containerID="cri-o://d27c08041bf099d393e072a836977d8eded69da0ddb2b46d4afb1f55c9d6dbaa" gracePeriod=30 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.292529 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker" containerID="cri-o://957c822a2db2d466e7a57fa7ba53feb16c4223cb346ab3ed286abd62509e04f9" gracePeriod=30 Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.303297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerStarted","Data":"4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d"} Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.340702 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" podStartSLOduration=3.340679953 podStartE2EDuration="3.340679953s" podCreationTimestamp="2025-11-21 13:52:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:26.337399296 +0000 UTC m=+7305.038061114" watchObservedRunningTime="2025-11-21 13:52:26.340679953 +0000 UTC m=+7305.041341771" Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.384573 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" podStartSLOduration=3.384542257 podStartE2EDuration="3.384542257s" podCreationTimestamp="2025-11-21 13:52:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:26.375343683 +0000 UTC m=+7305.076005501" watchObservedRunningTime="2025-11-21 13:52:26.384542257 +0000 UTC m=+7305.085204075" Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.391731 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" podStartSLOduration=3.391707598 podStartE2EDuration="3.391707598s" podCreationTimestamp="2025-11-21 13:52:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:26.35976315 +0000 UTC m=+7305.060424968" watchObservedRunningTime="2025-11-21 13:52:26.391707598 +0000 UTC m=+7305.092369416" Nov 21 13:52:26 crc kubenswrapper[4769]: I1121 13:52:26.419735 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-pctx2" podStartSLOduration=1.867176192 podStartE2EDuration="5.419697881s" podCreationTimestamp="2025-11-21 13:52:21 +0000 UTC" firstStartedPulling="2025-11-21 13:52:22.130307771 +0000 UTC m=+7300.830969589" lastFinishedPulling="2025-11-21 13:52:25.68282946 +0000 UTC m=+7304.383491278" observedRunningTime="2025-11-21 13:52:26.41854125 +0000 UTC m=+7305.119203068" watchObservedRunningTime="2025-11-21 13:52:26.419697881 +0000 UTC m=+7305.120359699" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.067924 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.161753 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204132 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c55a53c2-3930-4aab-851f-332e033d29db-logs\") pod \"c55a53c2-3930-4aab-851f-332e033d29db\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204205 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-combined-ca-bundle\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204260 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204283 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jgqx\" (UniqueName: \"kubernetes.io/projected/c55a53c2-3930-4aab-851f-332e033d29db-kube-api-access-7jgqx\") pod \"c55a53c2-3930-4aab-851f-332e033d29db\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204322 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data-custom\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data-custom\") pod \"c55a53c2-3930-4aab-851f-332e033d29db\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204365 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-combined-ca-bundle\") pod \"c55a53c2-3930-4aab-851f-332e033d29db\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-internal-tls-certs\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204439 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-public-tls-certs\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204472 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data\") pod \"c55a53c2-3930-4aab-851f-332e033d29db\" (UID: \"c55a53c2-3930-4aab-851f-332e033d29db\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204522 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-logs\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204577 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdt79\" (UniqueName: \"kubernetes.io/projected/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-kube-api-access-qdt79\") pod \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\" (UID: \"8c9c0a91-30f5-455d-a7c2-ed0cddba362d\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.204823 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55a53c2-3930-4aab-851f-332e033d29db-logs" (OuterVolumeSpecName: "logs") pod "c55a53c2-3930-4aab-851f-332e033d29db" (UID: "c55a53c2-3930-4aab-851f-332e033d29db"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.207138 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-logs" (OuterVolumeSpecName: "logs") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.209453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.210355 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c55a53c2-3930-4aab-851f-332e033d29db" (UID: "c55a53c2-3930-4aab-851f-332e033d29db"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.214907 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-kube-api-access-qdt79" (OuterVolumeSpecName: "kube-api-access-qdt79") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "kube-api-access-qdt79". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.215254 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55a53c2-3930-4aab-851f-332e033d29db-kube-api-access-7jgqx" (OuterVolumeSpecName: "kube-api-access-7jgqx") pod "c55a53c2-3930-4aab-851f-332e033d29db" (UID: "c55a53c2-3930-4aab-851f-332e033d29db"). InnerVolumeSpecName "kube-api-access-7jgqx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.260730 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c55a53c2-3930-4aab-851f-332e033d29db" (UID: "c55a53c2-3930-4aab-851f-332e033d29db"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.263231 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.264337 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data" (OuterVolumeSpecName: "config-data") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.290764 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.295960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data" (OuterVolumeSpecName: "config-data") pod "c55a53c2-3930-4aab-851f-332e033d29db" (UID: "c55a53c2-3930-4aab-851f-332e033d29db"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.297359 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8c9c0a91-30f5-455d-a7c2-ed0cddba362d" (UID: "8c9c0a91-30f5-455d-a7c2-ed0cddba362d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308043 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308084 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qdt79\" (UniqueName: \"kubernetes.io/projected/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-kube-api-access-qdt79\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308098 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c55a53c2-3930-4aab-851f-332e033d29db-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308110 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308124 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308138 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7jgqx\" (UniqueName: \"kubernetes.io/projected/c55a53c2-3930-4aab-851f-332e033d29db-kube-api-access-7jgqx\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308149 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308160 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308171 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308182 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308266 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c9c0a91-30f5-455d-a7c2-ed0cddba362d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.308278 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c55a53c2-3930-4aab-851f-332e033d29db-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318785 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerID="a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750" exitCode=0 Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318818 4769 generic.go:334] "Generic (PLEG): container finished" podID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerID="17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207" exitCode=143 Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318820 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" event={"ID":"8c9c0a91-30f5-455d-a7c2-ed0cddba362d","Type":"ContainerDied","Data":"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318861 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318886 4769 scope.go:117] "RemoveContainer" containerID="a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318871 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" event={"ID":"8c9c0a91-30f5-455d-a7c2-ed0cddba362d","Type":"ContainerDied","Data":"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.318984 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-api-66f6566756-wf468" event={"ID":"8c9c0a91-30f5-455d-a7c2-ed0cddba362d","Type":"ContainerDied","Data":"182676cd6f95a7ba8861a21eaf90a5b338a4a52fa4dc1b0d8f8315ad0752cb74"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.321614 4769 generic.go:334] "Generic (PLEG): container finished" podID="c55a53c2-3930-4aab-851f-332e033d29db" containerID="fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2" exitCode=1 Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.321645 4769 generic.go:334] "Generic (PLEG): container finished" podID="c55a53c2-3930-4aab-851f-332e033d29db" containerID="8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3" exitCode=143 Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.321690 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" event={"ID":"c55a53c2-3930-4aab-851f-332e033d29db","Type":"ContainerDied","Data":"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.321717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" event={"ID":"c55a53c2-3930-4aab-851f-332e033d29db","Type":"ContainerDied","Data":"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.321728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" event={"ID":"c55a53c2-3930-4aab-851f-332e033d29db","Type":"ContainerDied","Data":"62cb6e1bfb94a8669c2210ade01097880de853100a993662bb85ed01f3962a6b"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.321787 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.340740 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerID="957c822a2db2d466e7a57fa7ba53feb16c4223cb346ab3ed286abd62509e04f9" exitCode=1 Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.340777 4769 generic.go:334] "Generic (PLEG): container finished" podID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerID="d27c08041bf099d393e072a836977d8eded69da0ddb2b46d4afb1f55c9d6dbaa" exitCode=143 Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.340786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" event={"ID":"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf","Type":"ContainerDied","Data":"957c822a2db2d466e7a57fa7ba53feb16c4223cb346ab3ed286abd62509e04f9"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.340833 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" event={"ID":"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf","Type":"ContainerDied","Data":"d27c08041bf099d393e072a836977d8eded69da0ddb2b46d4afb1f55c9d6dbaa"} Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.344621 4769 scope.go:117] "RemoveContainer" containerID="17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.367584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz"] Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.368204 4769 scope.go:117] "RemoveContainer" containerID="a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750" Nov 21 13:52:27 crc kubenswrapper[4769]: E1121 13:52:27.375130 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750\": container with ID starting with a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750 not found: ID does not exist" containerID="a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.375201 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750"} err="failed to get container status \"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750\": rpc error: code = NotFound desc = could not find container \"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750\": container with ID starting with a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.375235 4769 scope.go:117] "RemoveContainer" containerID="17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.375629 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-87c6d864b-fd6kz"] Nov 21 13:52:27 crc kubenswrapper[4769]: E1121 13:52:27.375967 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207\": container with ID starting with 17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207 not found: ID does not exist" containerID="17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.376008 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207"} err="failed to get container status \"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207\": rpc error: code = NotFound desc = could not find container \"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207\": container with ID starting with 17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.376032 4769 scope.go:117] "RemoveContainer" containerID="a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.376928 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750"} err="failed to get container status \"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750\": rpc error: code = NotFound desc = could not find container \"a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750\": container with ID starting with a9296dfbd00451191db5c5fd3db65e204a1f62f5171436830d2984f29e2f1750 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.376958 4769 scope.go:117] "RemoveContainer" containerID="17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.377303 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207"} err="failed to get container status \"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207\": rpc error: code = NotFound desc = could not find container \"17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207\": container with ID starting with 17ac68580829a8979808def1bcbce2155a27420cd85f882e2d6336654c4b7207 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.377324 4769 scope.go:117] "RemoveContainer" containerID="fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.377826 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.386248 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-api-66f6566756-wf468"] Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.391214 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-api-66f6566756-wf468"] Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.421930 4769 scope.go:117] "RemoveContainer" containerID="8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.449302 4769 scope.go:117] "RemoveContainer" containerID="fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2" Nov 21 13:52:27 crc kubenswrapper[4769]: E1121 13:52:27.449755 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2\": container with ID starting with fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2 not found: ID does not exist" containerID="fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.449780 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2"} err="failed to get container status \"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2\": rpc error: code = NotFound desc = could not find container \"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2\": container with ID starting with fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.449801 4769 scope.go:117] "RemoveContainer" containerID="8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3" Nov 21 13:52:27 crc kubenswrapper[4769]: E1121 13:52:27.450238 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3\": container with ID starting with 8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3 not found: ID does not exist" containerID="8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.450292 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3"} err="failed to get container status \"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3\": rpc error: code = NotFound desc = could not find container \"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3\": container with ID starting with 8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.450333 4769 scope.go:117] "RemoveContainer" containerID="fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.450656 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2"} err="failed to get container status \"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2\": rpc error: code = NotFound desc = could not find container \"fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2\": container with ID starting with fcda3ee97af4d3d2f25a0287caf3ce34438bbac6a3b6f758ffdcc77bb1048fe2 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.450678 4769 scope.go:117] "RemoveContainer" containerID="8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.450873 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3"} err="failed to get container status \"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3\": rpc error: code = NotFound desc = could not find container \"8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3\": container with ID starting with 8608b799a0300911e5e8285dab07857e9ebc07b9c4400a88b0772a1c3e02abd3 not found: ID does not exist" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.510887 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data-custom\") pod \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.510942 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data\") pod \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.511037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-combined-ca-bundle\") pod \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.511139 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fln96\" (UniqueName: \"kubernetes.io/projected/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-kube-api-access-fln96\") pod \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.511169 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-logs\") pod \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\" (UID: \"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.511744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-logs" (OuterVolumeSpecName: "logs") pod "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" (UID: "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.515357 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" (UID: "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.515383 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-kube-api-access-fln96" (OuterVolumeSpecName: "kube-api-access-fln96") pod "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" (UID: "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf"). InnerVolumeSpecName "kube-api-access-fln96". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.535345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" (UID: "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.554376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data" (OuterVolumeSpecName: "config-data") pod "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" (UID: "f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.612574 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.612630 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-fln96\" (UniqueName: \"kubernetes.io/projected/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-kube-api-access-fln96\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.612641 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.612651 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.612660 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.706606 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.815929 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jlz\" (UniqueName: \"kubernetes.io/projected/ef8c82cb-dec3-47a5-a126-28479c858c26-kube-api-access-r2jlz\") pod \"ef8c82cb-dec3-47a5-a126-28479c858c26\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.816046 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef8c82cb-dec3-47a5-a126-28479c858c26-operator-scripts\") pod \"ef8c82cb-dec3-47a5-a126-28479c858c26\" (UID: \"ef8c82cb-dec3-47a5-a126-28479c858c26\") " Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.816903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8c82cb-dec3-47a5-a126-28479c858c26-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ef8c82cb-dec3-47a5-a126-28479c858c26" (UID: "ef8c82cb-dec3-47a5-a126-28479c858c26"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.819704 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8c82cb-dec3-47a5-a126-28479c858c26-kube-api-access-r2jlz" (OuterVolumeSpecName: "kube-api-access-r2jlz") pod "ef8c82cb-dec3-47a5-a126-28479c858c26" (UID: "ef8c82cb-dec3-47a5-a126-28479c858c26"). InnerVolumeSpecName "kube-api-access-r2jlz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.918262 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-r2jlz\" (UniqueName: \"kubernetes.io/projected/ef8c82cb-dec3-47a5-a126-28479c858c26-kube-api-access-r2jlz\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:27 crc kubenswrapper[4769]: I1121 13:52:27.918311 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ef8c82cb-dec3-47a5-a126-28479c858c26-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.352938 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.353306 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh" event={"ID":"f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf","Type":"ContainerDied","Data":"ba17c80c8e6ff6ed49a837ce56e6237eb9e20e25c050e399e070742db57197da"} Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.353773 4769 scope.go:117] "RemoveContainer" containerID="957c822a2db2d466e7a57fa7ba53feb16c4223cb346ab3ed286abd62509e04f9" Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.355761 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" event={"ID":"ef8c82cb-dec3-47a5-a126-28479c858c26","Type":"ContainerDied","Data":"eacaea6392a0722f4059b995fbb62a39f106936af5b6add97a59be6adf3655e3"} Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.355871 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eacaea6392a0722f4059b995fbb62a39f106936af5b6add97a59be6adf3655e3" Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.356098 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican2cec-account-delete-2dgsc" Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.374456 4769 scope.go:117] "RemoveContainer" containerID="d27c08041bf099d393e072a836977d8eded69da0ddb2b46d4afb1f55c9d6dbaa" Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.409650 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh"] Nov 21 13:52:28 crc kubenswrapper[4769]: I1121 13:52:28.409716 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-worker-b75f7fb95-b5zwh"] Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.284090 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" path="/var/lib/kubelet/pods/8c9c0a91-30f5-455d-a7c2-ed0cddba362d/volumes" Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.285045 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c55a53c2-3930-4aab-851f-332e033d29db" path="/var/lib/kubelet/pods/c55a53c2-3930-4aab-851f-332e033d29db/volumes" Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.286132 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" path="/var/lib/kubelet/pods/f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf/volumes" Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.529997 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-kvm7d"] Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.536925 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-db-create-kvm7d"] Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.548709 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8"] Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.555429 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican2cec-account-delete-2dgsc"] Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.561480 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-2cec-account-create-update-bpwf8"] Nov 21 13:52:29 crc kubenswrapper[4769]: I1121 13:52:29.567968 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican2cec-account-delete-2dgsc"] Nov 21 13:52:31 crc kubenswrapper[4769]: I1121 13:52:31.285171 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="597bc815-b7e8-4ee5-903a-d66df0e3bdf8" path="/var/lib/kubelet/pods/597bc815-b7e8-4ee5-903a-d66df0e3bdf8/volumes" Nov 21 13:52:31 crc kubenswrapper[4769]: I1121 13:52:31.286128 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8c82cb-dec3-47a5-a126-28479c858c26" path="/var/lib/kubelet/pods/ef8c82cb-dec3-47a5-a126-28479c858c26/volumes" Nov 21 13:52:31 crc kubenswrapper[4769]: I1121 13:52:31.286597 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3936213-ed22-4c4f-ab64-60c8f9af9bdf" path="/var/lib/kubelet/pods/f3936213-ed22-4c4f-ab64-60c8f9af9bdf/volumes" Nov 21 13:52:31 crc kubenswrapper[4769]: I1121 13:52:31.526243 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:31 crc kubenswrapper[4769]: I1121 13:52:31.526291 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:31.568994 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:32.438535 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:32.477068 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-pctx2"] Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:33.419215 4769 generic.go:334] "Generic (PLEG): container finished" podID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerID="225bc42d496db4b37acbe77be59a8a9c31179c6ae1fb9d7695dbee9efc800c94" exitCode=137 Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:33.419281 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" event={"ID":"3dd1cbb5-d40a-4352-8767-b39413648f8e","Type":"ContainerDied","Data":"225bc42d496db4b37acbe77be59a8a9c31179c6ae1fb9d7695dbee9efc800c94"} Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:33.420612 4769 generic.go:334] "Generic (PLEG): container finished" podID="0941e750-ce38-4542-a5ba-27f366e0129c" containerID="760bbba636cf07e0696298f679ef93bd6e262363693ed5d6eae37594da5405c9" exitCode=137 Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:33.420646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" event={"ID":"0941e750-ce38-4542-a5ba-27f366e0129c","Type":"ContainerDied","Data":"760bbba636cf07e0696298f679ef93bd6e262363693ed5d6eae37594da5405c9"} Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:33.422305 4769 generic.go:334] "Generic (PLEG): container finished" podID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerID="1d159eca90332030ff1f3dec3216329ebad59c661b2c949af41f6b21efb9fbec" exitCode=137 Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:33.422351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" event={"ID":"6cd6f0fd-7664-48b0-bcaf-185c6e603cad","Type":"ContainerDied","Data":"1d159eca90332030ff1f3dec3216329ebad59c661b2c949af41f6b21efb9fbec"} Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.276594 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:52:34 crc kubenswrapper[4769]: E1121 13:52:34.277231 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.431948 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-pctx2" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="registry-server" containerID="cri-o://4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d" gracePeriod=2 Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.817943 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.927432 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvdzd\" (UniqueName: \"kubernetes.io/projected/0941e750-ce38-4542-a5ba-27f366e0129c-kube-api-access-zvdzd\") pod \"0941e750-ce38-4542-a5ba-27f366e0129c\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.927495 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0941e750-ce38-4542-a5ba-27f366e0129c-logs\") pod \"0941e750-ce38-4542-a5ba-27f366e0129c\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.927561 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data\") pod \"0941e750-ce38-4542-a5ba-27f366e0129c\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.927619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data-custom\") pod \"0941e750-ce38-4542-a5ba-27f366e0129c\" (UID: \"0941e750-ce38-4542-a5ba-27f366e0129c\") " Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.929510 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0941e750-ce38-4542-a5ba-27f366e0129c-logs" (OuterVolumeSpecName: "logs") pod "0941e750-ce38-4542-a5ba-27f366e0129c" (UID: "0941e750-ce38-4542-a5ba-27f366e0129c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.932800 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0941e750-ce38-4542-a5ba-27f366e0129c-kube-api-access-zvdzd" (OuterVolumeSpecName: "kube-api-access-zvdzd") pod "0941e750-ce38-4542-a5ba-27f366e0129c" (UID: "0941e750-ce38-4542-a5ba-27f366e0129c"). InnerVolumeSpecName "kube-api-access-zvdzd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.933430 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0941e750-ce38-4542-a5ba-27f366e0129c" (UID: "0941e750-ce38-4542-a5ba-27f366e0129c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.937650 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.938471 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.967555 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:34 crc kubenswrapper[4769]: I1121 13:52:34.998756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data" (OuterVolumeSpecName: "config-data") pod "0941e750-ce38-4542-a5ba-27f366e0129c" (UID: "0941e750-ce38-4542-a5ba-27f366e0129c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-utilities\") pod \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029391 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data-custom\") pod \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029412 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-logs\") pod \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029466 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqrhs\" (UniqueName: \"kubernetes.io/projected/3dd1cbb5-d40a-4352-8767-b39413648f8e-kube-api-access-pqrhs\") pod \"3dd1cbb5-d40a-4352-8767-b39413648f8e\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029488 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data\") pod \"3dd1cbb5-d40a-4352-8767-b39413648f8e\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029552 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd1cbb5-d40a-4352-8767-b39413648f8e-logs\") pod \"3dd1cbb5-d40a-4352-8767-b39413648f8e\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029583 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data\") pod \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.029930 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-logs" (OuterVolumeSpecName: "logs") pod "6cd6f0fd-7664-48b0-bcaf-185c6e603cad" (UID: "6cd6f0fd-7664-48b0-bcaf-185c6e603cad"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030035 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd1cbb5-d40a-4352-8767-b39413648f8e-logs" (OuterVolumeSpecName: "logs") pod "3dd1cbb5-d40a-4352-8767-b39413648f8e" (UID: "3dd1cbb5-d40a-4352-8767-b39413648f8e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030390 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data-custom\") pod \"3dd1cbb5-d40a-4352-8767-b39413648f8e\" (UID: \"3dd1cbb5-d40a-4352-8767-b39413648f8e\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9vdn\" (UniqueName: \"kubernetes.io/projected/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-kube-api-access-f9vdn\") pod \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030458 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-catalog-content\") pod \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\" (UID: \"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030489 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2b9t\" (UniqueName: \"kubernetes.io/projected/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-kube-api-access-s2b9t\") pod \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\" (UID: \"6cd6f0fd-7664-48b0-bcaf-185c6e603cad\") " Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030827 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zvdzd\" (UniqueName: \"kubernetes.io/projected/0941e750-ce38-4542-a5ba-27f366e0129c-kube-api-access-zvdzd\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030846 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0941e750-ce38-4542-a5ba-27f366e0129c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030857 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030867 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030880 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0941e750-ce38-4542-a5ba-27f366e0129c-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.030891 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3dd1cbb5-d40a-4352-8767-b39413648f8e-logs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.031008 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-utilities" (OuterVolumeSpecName: "utilities") pod "cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" (UID: "cfd2b67a-30a6-49c9-9ff9-641dd864f0f4"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.033756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6cd6f0fd-7664-48b0-bcaf-185c6e603cad" (UID: "6cd6f0fd-7664-48b0-bcaf-185c6e603cad"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.033783 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd1cbb5-d40a-4352-8767-b39413648f8e-kube-api-access-pqrhs" (OuterVolumeSpecName: "kube-api-access-pqrhs") pod "3dd1cbb5-d40a-4352-8767-b39413648f8e" (UID: "3dd1cbb5-d40a-4352-8767-b39413648f8e"). InnerVolumeSpecName "kube-api-access-pqrhs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.033842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-kube-api-access-s2b9t" (OuterVolumeSpecName: "kube-api-access-s2b9t") pod "6cd6f0fd-7664-48b0-bcaf-185c6e603cad" (UID: "6cd6f0fd-7664-48b0-bcaf-185c6e603cad"). InnerVolumeSpecName "kube-api-access-s2b9t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.035295 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-kube-api-access-f9vdn" (OuterVolumeSpecName: "kube-api-access-f9vdn") pod "cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" (UID: "cfd2b67a-30a6-49c9-9ff9-641dd864f0f4"). InnerVolumeSpecName "kube-api-access-f9vdn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.035529 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3dd1cbb5-d40a-4352-8767-b39413648f8e" (UID: "3dd1cbb5-d40a-4352-8767-b39413648f8e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.069832 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data" (OuterVolumeSpecName: "config-data") pod "3dd1cbb5-d40a-4352-8767-b39413648f8e" (UID: "3dd1cbb5-d40a-4352-8767-b39413648f8e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.070110 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data" (OuterVolumeSpecName: "config-data") pod "6cd6f0fd-7664-48b0-bcaf-185c6e603cad" (UID: "6cd6f0fd-7664-48b0-bcaf-185c6e603cad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.130949 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" (UID: "cfd2b67a-30a6-49c9-9ff9-641dd864f0f4"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132735 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132771 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f9vdn\" (UniqueName: \"kubernetes.io/projected/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-kube-api-access-f9vdn\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132798 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132810 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s2b9t\" (UniqueName: \"kubernetes.io/projected/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-kube-api-access-s2b9t\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132821 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132833 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data-custom\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132843 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pqrhs\" (UniqueName: \"kubernetes.io/projected/3dd1cbb5-d40a-4352-8767-b39413648f8e-kube-api-access-pqrhs\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132853 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3dd1cbb5-d40a-4352-8767-b39413648f8e-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.132868 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cd6f0fd-7664-48b0-bcaf-185c6e603cad-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:35 crc kubenswrapper[4769]: E1121 13:52:35.402296 4769 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0941e750_ce38_4542_a5ba_27f366e0129c.slice/crio-b786d822070d6c4d2f9d0b86dcf62046bbd3d34804ae40f3df7bf6d8a57707d2\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cd6f0fd_7664_48b0_bcaf_185c6e603cad.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dd1cbb5_d40a_4352_8767_b39413648f8e.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0941e750_ce38_4542_a5ba_27f366e0129c.slice\": RecentStats: unable to find data in memory cache]" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.442533 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerID="4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d" exitCode=0 Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.442576 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerDied","Data":"4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d"} Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.442622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-pctx2" event={"ID":"cfd2b67a-30a6-49c9-9ff9-641dd864f0f4","Type":"ContainerDied","Data":"fad4f89f26f24d96533b4f952acae1a96649f1ecacbb824ee30efcaa98376892"} Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.442620 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-pctx2" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.442638 4769 scope.go:117] "RemoveContainer" containerID="4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.447935 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.448631 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6" event={"ID":"0941e750-ce38-4542-a5ba-27f366e0129c","Type":"ContainerDied","Data":"b786d822070d6c4d2f9d0b86dcf62046bbd3d34804ae40f3df7bf6d8a57707d2"} Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.452056 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" event={"ID":"6cd6f0fd-7664-48b0-bcaf-185c6e603cad","Type":"ContainerDied","Data":"12a0c03e62b11459e802bf86c0f9f2c893db9080536382a4ea0e9d65ef1a6bd5"} Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.452298 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.457618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" event={"ID":"3dd1cbb5-d40a-4352-8767-b39413648f8e","Type":"ContainerDied","Data":"3c651889bece11ccea5b770fbae5b3cc880825cddb87be3d2aad7c7fe71911d9"} Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.457691 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.464942 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-pctx2"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.466105 4769 scope.go:117] "RemoveContainer" containerID="508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.478854 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-pctx2"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.488774 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.492271 4769 scope.go:117] "RemoveContainer" containerID="fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.502272 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-worker-6b4cc4456c-lq8k6"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.513032 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.519260 4769 scope.go:117] "RemoveContainer" containerID="4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d" Nov 21 13:52:35 crc kubenswrapper[4769]: E1121 13:52:35.519836 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d\": container with ID starting with 4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d not found: ID does not exist" containerID="4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.519885 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d"} err="failed to get container status \"4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d\": rpc error: code = NotFound desc = could not find container \"4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d\": container with ID starting with 4bd2f39a32a262a549ad13b036ddc2351ff2eda398c4fa30cbed54a6dd6ea35d not found: ID does not exist" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.519916 4769 scope.go:117] "RemoveContainer" containerID="508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c" Nov 21 13:52:35 crc kubenswrapper[4769]: E1121 13:52:35.520504 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c\": container with ID starting with 508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c not found: ID does not exist" containerID="508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.520560 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c"} err="failed to get container status \"508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c\": rpc error: code = NotFound desc = could not find container \"508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c\": container with ID starting with 508425fe4154cc6d536823e4804f5998ca33a2c6254e238492e45a7ab66d734c not found: ID does not exist" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.520587 4769 scope.go:117] "RemoveContainer" containerID="fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff" Nov 21 13:52:35 crc kubenswrapper[4769]: E1121 13:52:35.521351 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff\": container with ID starting with fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff not found: ID does not exist" containerID="fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.521380 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff"} err="failed to get container status \"fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff\": rpc error: code = NotFound desc = could not find container \"fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff\": container with ID starting with fe00e2b1f8487a538dbd159bf2bc801ce8e1d6c6453b21dfc132a7ca523200ff not found: ID does not exist" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.521396 4769 scope.go:117] "RemoveContainer" containerID="760bbba636cf07e0696298f679ef93bd6e262363693ed5d6eae37594da5405c9" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.521742 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-ssgn2"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.529368 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.533945 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/barbican-keystone-listener-6d765d5d6-v4tlf"] Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.541096 4769 scope.go:117] "RemoveContainer" containerID="5f821d0431528bc2b048e6cac8f25fb3a8a5607260b55223fd1cd2a46ecccd99" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.562172 4769 scope.go:117] "RemoveContainer" containerID="1d159eca90332030ff1f3dec3216329ebad59c661b2c949af41f6b21efb9fbec" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.586112 4769 scope.go:117] "RemoveContainer" containerID="4e2dc774927a32a0772a254328ad44d6b4d64839a7a75402f3be834e1eab7cca" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.604478 4769 scope.go:117] "RemoveContainer" containerID="225bc42d496db4b37acbe77be59a8a9c31179c6ae1fb9d7695dbee9efc800c94" Nov 21 13:52:35 crc kubenswrapper[4769]: I1121 13:52:35.624045 4769 scope.go:117] "RemoveContainer" containerID="1989ab3f1cff17038e31ec640fa12565591f00dfad6f0c1f241778c5d469c751" Nov 21 13:52:37 crc kubenswrapper[4769]: I1121 13:52:37.283292 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" path="/var/lib/kubelet/pods/0941e750-ce38-4542-a5ba-27f366e0129c/volumes" Nov 21 13:52:37 crc kubenswrapper[4769]: I1121 13:52:37.284453 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" path="/var/lib/kubelet/pods/3dd1cbb5-d40a-4352-8767-b39413648f8e/volumes" Nov 21 13:52:37 crc kubenswrapper[4769]: I1121 13:52:37.284997 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" path="/var/lib/kubelet/pods/6cd6f0fd-7664-48b0-bcaf-185c6e603cad/volumes" Nov 21 13:52:37 crc kubenswrapper[4769]: I1121 13:52:37.285979 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" path="/var/lib/kubelet/pods/cfd2b67a-30a6-49c9-9ff9-641dd864f0f4/volumes" Nov 21 13:52:47 crc kubenswrapper[4769]: I1121 13:52:47.274596 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:52:47 crc kubenswrapper[4769]: E1121 13:52:47.275315 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.567299 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-dx5cc"] Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.583883 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-kfczm"] Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.591652 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-db-sync-dx5cc"] Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.599131 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-bootstrap-kfczm"] Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.605674 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-66b5b8678f-psqjw"] Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.605973 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" podUID="dea91dc4-5738-41f8-8a55-d65000071b1d" containerName="keystone-api" containerID="cri-o://21697dce040f1abfab0ad9a1afc66a7a3ce80ff888818894b212c96496c3d032" gracePeriod=30 Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617115 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["barbican-kuttl-tests/keystone9b40-account-delete-kvhvb"] Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617472 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="registry-server" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617496 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="registry-server" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617509 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617518 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker-log" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617532 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617541 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617557 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617565 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617577 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ef8c82cb-dec3-47a5-a126-28479c858c26" containerName="mariadb-account-delete" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617585 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8c82cb-dec3-47a5-a126-28479c858c26" containerName="mariadb-account-delete" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617601 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617610 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api-log" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617632 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617641 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617654 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617662 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617674 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617682 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617694 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="extract-utilities" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617702 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="extract-utilities" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617718 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617726 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617736 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="extract-content" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617745 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="extract-content" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617754 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617761 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617779 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617787 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617805 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617812 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: E1121 13:52:52.617826 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617834 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.617988 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618000 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f4ce2eda-14b9-452a-a2bd-5c6a98fbadbf" containerName="barbican-worker-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618018 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618034 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618046 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3dd1cbb5-d40a-4352-8767-b39413648f8e" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618065 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ef8c82cb-dec3-47a5-a126-28479c858c26" containerName="mariadb-account-delete" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618079 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618087 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8c9c0a91-30f5-455d-a7c2-ed0cddba362d" containerName="barbican-api-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618098 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618111 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c55a53c2-3930-4aab-851f-332e033d29db" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618132 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener-log" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618146 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6cd6f0fd-7664-48b0-bcaf-185c6e603cad" containerName="barbican-keystone-listener" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618167 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0941e750-ce38-4542-a5ba-27f366e0129c" containerName="barbican-worker" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618180 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfd2b67a-30a6-49c9-9ff9-641dd864f0f4" containerName="registry-server" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.618843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.623775 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone9b40-account-delete-kvhvb"] Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.716848 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6182d6df-5aee-4eef-a2f6-a9f5d504a125-operator-scripts\") pod \"keystone9b40-account-delete-kvhvb\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.716922 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2vzm\" (UniqueName: \"kubernetes.io/projected/6182d6df-5aee-4eef-a2f6-a9f5d504a125-kube-api-access-m2vzm\") pod \"keystone9b40-account-delete-kvhvb\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.818663 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6182d6df-5aee-4eef-a2f6-a9f5d504a125-operator-scripts\") pod \"keystone9b40-account-delete-kvhvb\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.818734 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m2vzm\" (UniqueName: \"kubernetes.io/projected/6182d6df-5aee-4eef-a2f6-a9f5d504a125-kube-api-access-m2vzm\") pod \"keystone9b40-account-delete-kvhvb\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.819476 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6182d6df-5aee-4eef-a2f6-a9f5d504a125-operator-scripts\") pod \"keystone9b40-account-delete-kvhvb\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.836666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2vzm\" (UniqueName: \"kubernetes.io/projected/6182d6df-5aee-4eef-a2f6-a9f5d504a125-kube-api-access-m2vzm\") pod \"keystone9b40-account-delete-kvhvb\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:52 crc kubenswrapper[4769]: I1121 13:52:52.939029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:52:53 crc kubenswrapper[4769]: I1121 13:52:53.282507 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="955fa701-2aed-4848-a394-bcc4e0a03703" path="/var/lib/kubelet/pods/955fa701-2aed-4848-a394-bcc4e0a03703/volumes" Nov 21 13:52:53 crc kubenswrapper[4769]: I1121 13:52:53.283414 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ffe70f-19c7-41ea-a663-5b57f66a5f6b" path="/var/lib/kubelet/pods/a5ffe70f-19c7-41ea-a663-5b57f66a5f6b/volumes" Nov 21 13:52:53 crc kubenswrapper[4769]: I1121 13:52:53.359100 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/keystone9b40-account-delete-kvhvb"] Nov 21 13:52:53 crc kubenswrapper[4769]: I1121 13:52:53.616148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" event={"ID":"6182d6df-5aee-4eef-a2f6-a9f5d504a125","Type":"ContainerStarted","Data":"bbd309e242d9721def81d0856fa568adece4fc6349325608076c700cf0a5b3c7"} Nov 21 13:52:54 crc kubenswrapper[4769]: I1121 13:52:54.626045 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" event={"ID":"6182d6df-5aee-4eef-a2f6-a9f5d504a125","Type":"ContainerStarted","Data":"a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced"} Nov 21 13:52:54 crc kubenswrapper[4769]: I1121 13:52:54.645533 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" podStartSLOduration=2.6455050890000003 podStartE2EDuration="2.645505089s" podCreationTimestamp="2025-11-21 13:52:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:52:54.639260734 +0000 UTC m=+7333.339922552" watchObservedRunningTime="2025-11-21 13:52:54.645505089 +0000 UTC m=+7333.346166907" Nov 21 13:52:56 crc kubenswrapper[4769]: I1121 13:52:56.644959 4769 generic.go:334] "Generic (PLEG): container finished" podID="dea91dc4-5738-41f8-8a55-d65000071b1d" containerID="21697dce040f1abfab0ad9a1afc66a7a3ce80ff888818894b212c96496c3d032" exitCode=0 Nov 21 13:52:56 crc kubenswrapper[4769]: I1121 13:52:56.645009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" event={"ID":"dea91dc4-5738-41f8-8a55-d65000071b1d","Type":"ContainerDied","Data":"21697dce040f1abfab0ad9a1afc66a7a3ce80ff888818894b212c96496c3d032"} Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.363977 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.392665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-credential-keys\") pod \"dea91dc4-5738-41f8-8a55-d65000071b1d\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.392743 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-scripts\") pod \"dea91dc4-5738-41f8-8a55-d65000071b1d\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.392767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-fernet-keys\") pod \"dea91dc4-5738-41f8-8a55-d65000071b1d\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.392925 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-config-data\") pod \"dea91dc4-5738-41f8-8a55-d65000071b1d\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.392983 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzqmh\" (UniqueName: \"kubernetes.io/projected/dea91dc4-5738-41f8-8a55-d65000071b1d-kube-api-access-xzqmh\") pod \"dea91dc4-5738-41f8-8a55-d65000071b1d\" (UID: \"dea91dc4-5738-41f8-8a55-d65000071b1d\") " Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.399862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-scripts" (OuterVolumeSpecName: "scripts") pod "dea91dc4-5738-41f8-8a55-d65000071b1d" (UID: "dea91dc4-5738-41f8-8a55-d65000071b1d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.401326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "dea91dc4-5738-41f8-8a55-d65000071b1d" (UID: "dea91dc4-5738-41f8-8a55-d65000071b1d"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.401360 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "dea91dc4-5738-41f8-8a55-d65000071b1d" (UID: "dea91dc4-5738-41f8-8a55-d65000071b1d"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.401588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea91dc4-5738-41f8-8a55-d65000071b1d-kube-api-access-xzqmh" (OuterVolumeSpecName: "kube-api-access-xzqmh") pod "dea91dc4-5738-41f8-8a55-d65000071b1d" (UID: "dea91dc4-5738-41f8-8a55-d65000071b1d"). InnerVolumeSpecName "kube-api-access-xzqmh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.435608 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-config-data" (OuterVolumeSpecName: "config-data") pod "dea91dc4-5738-41f8-8a55-d65000071b1d" (UID: "dea91dc4-5738-41f8-8a55-d65000071b1d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.500798 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.501676 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xzqmh\" (UniqueName: \"kubernetes.io/projected/dea91dc4-5738-41f8-8a55-d65000071b1d-kube-api-access-xzqmh\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.501746 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.501768 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.501829 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/dea91dc4-5738-41f8-8a55-d65000071b1d-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.656047 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" event={"ID":"dea91dc4-5738-41f8-8a55-d65000071b1d","Type":"ContainerDied","Data":"d25b8f318d714c51e9d0fea5d8c9913c9c31ebf7317849171402f495bf7f01a9"} Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.656105 4769 scope.go:117] "RemoveContainer" containerID="21697dce040f1abfab0ad9a1afc66a7a3ce80ff888818894b212c96496c3d032" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.656283 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone-66b5b8678f-psqjw" Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.691806 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-66b5b8678f-psqjw"] Nov 21 13:52:57 crc kubenswrapper[4769]: I1121 13:52:57.698668 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-66b5b8678f-psqjw"] Nov 21 13:52:59 crc kubenswrapper[4769]: I1121 13:52:59.274081 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:52:59 crc kubenswrapper[4769]: E1121 13:52:59.274554 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:52:59 crc kubenswrapper[4769]: I1121 13:52:59.284120 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dea91dc4-5738-41f8-8a55-d65000071b1d" path="/var/lib/kubelet/pods/dea91dc4-5738-41f8-8a55-d65000071b1d/volumes" Nov 21 13:53:05 crc kubenswrapper[4769]: I1121 13:53:05.372692 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Nov 21 13:53:05 crc kubenswrapper[4769]: I1121 13:53:05.382137 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Nov 21 13:53:05 crc kubenswrapper[4769]: I1121 13:53:05.391669 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Nov 21 13:53:05 crc kubenswrapper[4769]: I1121 13:53:05.519844 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/openstack-galera-2" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="galera" containerID="cri-o://fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936" gracePeriod=30 Nov 21 13:53:06 crc kubenswrapper[4769]: I1121 13:53:06.803408 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Nov 21 13:53:06 crc kubenswrapper[4769]: I1121 13:53:06.804082 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/memcached-0" podUID="065760bf-10d3-42cc-837e-ab6732b7d938" containerName="memcached" containerID="cri-o://a9bf6cac3edd596c0152e20652b65be75c012b22e0f2d9ac819aef000324a461" gracePeriod=30 Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.309709 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.559502 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/openstack-galera-1" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="galera" containerID="cri-o://1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" gracePeriod=28 Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.657634 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-2dvtr"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.664074 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-db-create-2dvtr"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.678547 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.683816 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone9b40-account-delete-kvhvb"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.684111 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" podUID="6182d6df-5aee-4eef-a2f6-a9f5d504a125" containerName="mariadb-account-delete" containerID="cri-o://a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced" gracePeriod=30 Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.688662 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone-9b40-account-create-update-2xr9c"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.758637 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:53:07 crc kubenswrapper[4769]: I1121 13:53:07.795876 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/rabbitmq-server-0" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerName="rabbitmq" containerID="cri-o://1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b" gracePeriod=604800 Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.592851 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936 is running failed: container process not found" containerID="fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.593529 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936 is running failed: container process not found" containerID="fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.598693 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936 is running failed: container process not found" containerID="fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.599155 4769 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936 is running failed: container process not found" probeType="Readiness" pod="barbican-kuttl-tests/openstack-galera-2" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="galera" Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.620665 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.624929 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.628506 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 13:53:08 crc kubenswrapper[4769]: E1121 13:53:08.628573 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="barbican-kuttl-tests/openstack-galera-1" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="galera" Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.700591 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6"] Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.700909 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="manager" containerID="cri-o://90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f" gracePeriod=10 Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.701333 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="kube-rbac-proxy" containerID="cri-o://d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff" gracePeriod=10 Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.775578 4769 generic.go:334] "Generic (PLEG): container finished" podID="065760bf-10d3-42cc-837e-ab6732b7d938" containerID="a9bf6cac3edd596c0152e20652b65be75c012b22e0f2d9ac819aef000324a461" exitCode=0 Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.775689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"065760bf-10d3-42cc-837e-ab6732b7d938","Type":"ContainerDied","Data":"a9bf6cac3edd596c0152e20652b65be75c012b22e0f2d9ac819aef000324a461"} Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.797815 4769 generic.go:334] "Generic (PLEG): container finished" podID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerID="fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936" exitCode=0 Nov 21 13:53:08 crc kubenswrapper[4769]: I1121 13:53:08.797859 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"26598e29-5cf4-4491-bd0a-29b0398e233b","Type":"ContainerDied","Data":"fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.031268 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-index-qj9kz"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.031513 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/barbican-operator-index-qj9kz" podUID="305a3a88-e259-43af-92ba-b106f36a71af" containerName="registry-server" containerID="cri-o://53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b" gracePeriod=30 Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.079309 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.085131 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/70ca35c0620df0a54cfb8a7ee6e83850f666a185669727ea5eeda53ab364926"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.291637 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a14d76f-741e-4625-8617-8ee7c91e6f4a" path="/var/lib/kubelet/pods/3a14d76f-741e-4625-8617-8ee7c91e6f4a/volumes" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.293214 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b291660e-de64-4f84-a8f8-021cca643c54" path="/var/lib/kubelet/pods/b291660e-de64-4f84-a8f8-021cca643c54/volumes" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.294294 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c217e581-49a4-4d08-a281-7c00e4f635f7" path="/var/lib/kubelet/pods/c217e581-49a4-4d08-a281-7c00e4f635f7/volumes" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.367871 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.478905 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.497844 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-kolla-config\") pod \"26598e29-5cf4-4491-bd0a-29b0398e233b\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.497902 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f56zt\" (UniqueName: \"kubernetes.io/projected/26598e29-5cf4-4491-bd0a-29b0398e233b-kube-api-access-f56zt\") pod \"26598e29-5cf4-4491-bd0a-29b0398e233b\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.497948 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-generated\") pod \"26598e29-5cf4-4491-bd0a-29b0398e233b\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.497989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"26598e29-5cf4-4491-bd0a-29b0398e233b\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.498023 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-default\") pod \"26598e29-5cf4-4491-bd0a-29b0398e233b\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.498093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-operator-scripts\") pod \"26598e29-5cf4-4491-bd0a-29b0398e233b\" (UID: \"26598e29-5cf4-4491-bd0a-29b0398e233b\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.499661 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "26598e29-5cf4-4491-bd0a-29b0398e233b" (UID: "26598e29-5cf4-4491-bd0a-29b0398e233b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.500241 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "26598e29-5cf4-4491-bd0a-29b0398e233b" (UID: "26598e29-5cf4-4491-bd0a-29b0398e233b"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.501585 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.502326 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "26598e29-5cf4-4491-bd0a-29b0398e233b" (UID: "26598e29-5cf4-4491-bd0a-29b0398e233b"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.504277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "26598e29-5cf4-4491-bd0a-29b0398e233b" (UID: "26598e29-5cf4-4491-bd0a-29b0398e233b"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.511571 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26598e29-5cf4-4491-bd0a-29b0398e233b-kube-api-access-f56zt" (OuterVolumeSpecName: "kube-api-access-f56zt") pod "26598e29-5cf4-4491-bd0a-29b0398e233b" (UID: "26598e29-5cf4-4491-bd0a-29b0398e233b"). InnerVolumeSpecName "kube-api-access-f56zt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.526577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "mysql-db") pod "26598e29-5cf4-4491-bd0a-29b0398e233b" (UID: "26598e29-5cf4-4491-bd0a-29b0398e233b"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.597787 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="barbican-kuttl-tests/openstack-galera-0" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerName="galera" containerID="cri-o://4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9" gracePeriod=26 Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.608302 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9hjf\" (UniqueName: \"kubernetes.io/projected/22171770-4f23-4b88-b09b-2a0a117cc35f-kube-api-access-s9hjf\") pod \"22171770-4f23-4b88-b09b-2a0a117cc35f\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wrzx\" (UniqueName: \"kubernetes.io/projected/305a3a88-e259-43af-92ba-b106f36a71af-kube-api-access-2wrzx\") pod \"305a3a88-e259-43af-92ba-b106f36a71af\" (UID: \"305a3a88-e259-43af-92ba-b106f36a71af\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613207 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-kolla-config\") pod \"065760bf-10d3-42cc-837e-ab6732b7d938\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613242 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-webhook-cert\") pod \"22171770-4f23-4b88-b09b-2a0a117cc35f\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613265 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-config-data\") pod \"065760bf-10d3-42cc-837e-ab6732b7d938\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613290 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-apiservice-cert\") pod \"22171770-4f23-4b88-b09b-2a0a117cc35f\" (UID: \"22171770-4f23-4b88-b09b-2a0a117cc35f\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613315 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72x4v\" (UniqueName: \"kubernetes.io/projected/065760bf-10d3-42cc-837e-ab6732b7d938-kube-api-access-72x4v\") pod \"065760bf-10d3-42cc-837e-ab6732b7d938\" (UID: \"065760bf-10d3-42cc-837e-ab6732b7d938\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613488 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613517 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613528 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613539 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613551 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/26598e29-5cf4-4491-bd0a-29b0398e233b-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.613559 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f56zt\" (UniqueName: \"kubernetes.io/projected/26598e29-5cf4-4491-bd0a-29b0398e233b-kube-api-access-f56zt\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.617596 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "065760bf-10d3-42cc-837e-ab6732b7d938" (UID: "065760bf-10d3-42cc-837e-ab6732b7d938"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.617743 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22171770-4f23-4b88-b09b-2a0a117cc35f" (UID: "22171770-4f23-4b88-b09b-2a0a117cc35f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.618316 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-config-data" (OuterVolumeSpecName: "config-data") pod "065760bf-10d3-42cc-837e-ab6732b7d938" (UID: "065760bf-10d3-42cc-837e-ab6732b7d938"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.619534 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305a3a88-e259-43af-92ba-b106f36a71af-kube-api-access-2wrzx" (OuterVolumeSpecName: "kube-api-access-2wrzx") pod "305a3a88-e259-43af-92ba-b106f36a71af" (UID: "305a3a88-e259-43af-92ba-b106f36a71af"). InnerVolumeSpecName "kube-api-access-2wrzx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.619712 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.620604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22171770-4f23-4b88-b09b-2a0a117cc35f-kube-api-access-s9hjf" (OuterVolumeSpecName: "kube-api-access-s9hjf") pod "22171770-4f23-4b88-b09b-2a0a117cc35f" (UID: "22171770-4f23-4b88-b09b-2a0a117cc35f"). InnerVolumeSpecName "kube-api-access-s9hjf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.621620 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065760bf-10d3-42cc-837e-ab6732b7d938-kube-api-access-72x4v" (OuterVolumeSpecName: "kube-api-access-72x4v") pod "065760bf-10d3-42cc-837e-ab6732b7d938" (UID: "065760bf-10d3-42cc-837e-ab6732b7d938"). InnerVolumeSpecName "kube-api-access-72x4v". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.622048 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "22171770-4f23-4b88-b09b-2a0a117cc35f" (UID: "22171770-4f23-4b88-b09b-2a0a117cc35f"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.631224 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715553 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715605 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715622 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/065760bf-10d3-42cc-837e-ab6732b7d938-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715635 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22171770-4f23-4b88-b09b-2a0a117cc35f-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715652 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-72x4v\" (UniqueName: \"kubernetes.io/projected/065760bf-10d3-42cc-837e-ab6732b7d938-kube-api-access-72x4v\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715669 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715682 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-s9hjf\" (UniqueName: \"kubernetes.io/projected/22171770-4f23-4b88-b09b-2a0a117cc35f-kube-api-access-s9hjf\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.715695 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2wrzx\" (UniqueName: \"kubernetes.io/projected/305a3a88-e259-43af-92ba-b106f36a71af-kube-api-access-2wrzx\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.806498 4769 generic.go:334] "Generic (PLEG): container finished" podID="305a3a88-e259-43af-92ba-b106f36a71af" containerID="53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b" exitCode=0 Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.806539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-qj9kz" event={"ID":"305a3a88-e259-43af-92ba-b106f36a71af","Type":"ContainerDied","Data":"53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.806599 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-index-qj9kz" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.806656 4769 scope.go:117] "RemoveContainer" containerID="53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.807018 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-index-qj9kz" event={"ID":"305a3a88-e259-43af-92ba-b106f36a71af","Type":"ContainerDied","Data":"3edbc24aa0acdca677fb938cc1a991da07114e9b546c38ef1ac5ff7774ad4f49"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.811090 4769 generic.go:334] "Generic (PLEG): container finished" podID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerID="d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff" exitCode=0 Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.811133 4769 generic.go:334] "Generic (PLEG): container finished" podID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerID="90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f" exitCode=0 Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.811132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" event={"ID":"22171770-4f23-4b88-b09b-2a0a117cc35f","Type":"ContainerDied","Data":"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.811203 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" event={"ID":"22171770-4f23-4b88-b09b-2a0a117cc35f","Type":"ContainerDied","Data":"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.811228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" event={"ID":"22171770-4f23-4b88-b09b-2a0a117cc35f","Type":"ContainerDied","Data":"d8c6ef82bca33a316b472cf0f2971aa47ad054a8c174e93a11a880bb077702d0"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.811179 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.813704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-2" event={"ID":"26598e29-5cf4-4491-bd0a-29b0398e233b","Type":"ContainerDied","Data":"af49ef0c75462817176a2c36a13f914c0777c5d26c6871b90d668236b3e4a0c7"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.813766 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-2" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.815575 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/memcached-0" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.815613 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/memcached-0" event={"ID":"065760bf-10d3-42cc-837e-ab6732b7d938","Type":"ContainerDied","Data":"294c17c2c586a7194df534cea3b22d23f73f37572d217da99b91c2f1e9ea06bf"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816503 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8d7de4cd-1112-4aa9-846a-c897a398f042-pod-info\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8d7de4cd-1112-4aa9-846a-c897a398f042-erlang-cookie-secret\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816594 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-plugins\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816631 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8d7de4cd-1112-4aa9-846a-c897a398f042-plugins-conf\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816658 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-erlang-cookie\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816756 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkgm\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-kube-api-access-dfkgm\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.816846 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-confd\") pod \"8d7de4cd-1112-4aa9-846a-c897a398f042\" (UID: \"8d7de4cd-1112-4aa9-846a-c897a398f042\") " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.818467 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d7de4cd-1112-4aa9-846a-c897a398f042-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.821519 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d7de4cd-1112-4aa9-846a-c897a398f042-pod-info" (OuterVolumeSpecName: "pod-info") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.821653 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7de4cd-1112-4aa9-846a-c897a398f042-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.821999 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.822284 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.823338 4769 generic.go:334] "Generic (PLEG): container finished" podID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerID="1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b" exitCode=0 Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.823409 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"8d7de4cd-1112-4aa9-846a-c897a398f042","Type":"ContainerDied","Data":"1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.823439 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/rabbitmq-server-0" event={"ID":"8d7de4cd-1112-4aa9-846a-c897a398f042","Type":"ContainerDied","Data":"da7575ebfb6ae288147959d58e06254f2ad69291149e3bad421bafdc11bca389"} Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.823517 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/rabbitmq-server-0" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.825251 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-kube-api-access-dfkgm" (OuterVolumeSpecName: "kube-api-access-dfkgm") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "kube-api-access-dfkgm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.840045 4769 scope.go:117] "RemoveContainer" containerID="53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b" Nov 21 13:53:09 crc kubenswrapper[4769]: E1121 13:53:09.841073 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b\": container with ID starting with 53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b not found: ID does not exist" containerID="53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.841161 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b"} err="failed to get container status \"53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b\": rpc error: code = NotFound desc = could not find container \"53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b\": container with ID starting with 53b443ecffde3870368b9a43b09c922809180b6595d2f8d9090a4d639969171b not found: ID does not exist" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.841219 4769 scope.go:117] "RemoveContainer" containerID="d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.855622 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71" (OuterVolumeSpecName: "persistence") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "pvc-1459829a-def5-42a4-832a-01483dc98f71". PluginName "kubernetes.io/csi", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.874227 4769 scope.go:117] "RemoveContainer" containerID="90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.882180 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.899370 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/memcached-0"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.900327 4769 scope.go:117] "RemoveContainer" containerID="d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff" Nov 21 13:53:09 crc kubenswrapper[4769]: E1121 13:53:09.900790 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff\": container with ID starting with d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff not found: ID does not exist" containerID="d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.900829 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff"} err="failed to get container status \"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff\": rpc error: code = NotFound desc = could not find container \"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff\": container with ID starting with d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff not found: ID does not exist" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.900856 4769 scope.go:117] "RemoveContainer" containerID="90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f" Nov 21 13:53:09 crc kubenswrapper[4769]: E1121 13:53:09.901269 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f\": container with ID starting with 90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f not found: ID does not exist" containerID="90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.901294 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f"} err="failed to get container status \"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f\": rpc error: code = NotFound desc = could not find container \"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f\": container with ID starting with 90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f not found: ID does not exist" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.901307 4769 scope.go:117] "RemoveContainer" containerID="d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.901517 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff"} err="failed to get container status \"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff\": rpc error: code = NotFound desc = could not find container \"d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff\": container with ID starting with d88538e1e127216cc3b7c031c3b3b04f5684a04861295addd02401c165fe86ff not found: ID does not exist" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.901543 4769 scope.go:117] "RemoveContainer" containerID="90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.901826 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f"} err="failed to get container status \"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f\": rpc error: code = NotFound desc = could not find container \"90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f\": container with ID starting with 90ad39550dc5ae24490f72c29082623733a2a5b59925469c5ca8fba9bb5e774f not found: ID does not exist" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.901843 4769 scope.go:117] "RemoveContainer" containerID="fc56b0352244defad5fc3e098d1a33ad61af74d6eacb85ed5dfdc94d3ad96936" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.907846 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-index-qj9kz"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.915508 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-index-qj9kz"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.917956 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8d7de4cd-1112-4aa9-846a-c897a398f042-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.917988 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8d7de4cd-1112-4aa9-846a-c897a398f042-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.918000 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.918009 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8d7de4cd-1112-4aa9-846a-c897a398f042-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.918018 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.918051 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-1459829a-def5-42a4-832a-01483dc98f71\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") on node \"crc\" " Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.918066 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dfkgm\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-kube-api-access-dfkgm\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.921296 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.927095 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-98dd7f7c9-lt6j6"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.930450 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "8d7de4cd-1112-4aa9-846a-c897a398f042" (UID: "8d7de4cd-1112-4aa9-846a-c897a398f042"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.932092 4769 scope.go:117] "RemoveContainer" containerID="fb10c0577e58a3ca3d0d64bf8cab932a62862d049eb260c69e19242c45f55e70" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.932154 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.933269 4769 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.933429 4769 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-1459829a-def5-42a4-832a-01483dc98f71" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71") on node "crc" Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.938340 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/openstack-galera-2"] Nov 21 13:53:09 crc kubenswrapper[4769]: I1121 13:53:09.978806 4769 scope.go:117] "RemoveContainer" containerID="a9bf6cac3edd596c0152e20652b65be75c012b22e0f2d9ac819aef000324a461" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.005649 4769 scope.go:117] "RemoveContainer" containerID="1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.018816 4769 reconciler_common.go:293] "Volume detached for volume \"pvc-1459829a-def5-42a4-832a-01483dc98f71\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-1459829a-def5-42a4-832a-01483dc98f71\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.018853 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8d7de4cd-1112-4aa9-846a-c897a398f042-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.041896 4769 scope.go:117] "RemoveContainer" containerID="e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.061246 4769 scope.go:117] "RemoveContainer" containerID="1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b" Nov 21 13:53:10 crc kubenswrapper[4769]: E1121 13:53:10.061795 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b\": container with ID starting with 1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b not found: ID does not exist" containerID="1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.061855 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b"} err="failed to get container status \"1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b\": rpc error: code = NotFound desc = could not find container \"1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b\": container with ID starting with 1f9588dbd798e36367fba066d03368608f725fa982f1b95caf0e59b36fb5063b not found: ID does not exist" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.061885 4769 scope.go:117] "RemoveContainer" containerID="e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f" Nov 21 13:53:10 crc kubenswrapper[4769]: E1121 13:53:10.062314 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f\": container with ID starting with e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f not found: ID does not exist" containerID="e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.062336 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f"} err="failed to get container status \"e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f\": rpc error: code = NotFound desc = could not find container \"e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f\": container with ID starting with e72cfd90265e1d094dc0d3acddcccccebec0972ab94a8f50b07b9015d460f96f not found: ID does not exist" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.162879 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.168205 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/rabbitmq-server-0"] Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.789483 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.794850 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.842608 4769 generic.go:334] "Generic (PLEG): container finished" podID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" exitCode=0 Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.842686 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"410e07d7-e067-461d-8b05-9ae39cb5d5ad","Type":"ContainerDied","Data":"1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3"} Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.842717 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-1" event={"ID":"410e07d7-e067-461d-8b05-9ae39cb5d5ad","Type":"ContainerDied","Data":"a3249f194fed0becec1efb2b67e178cde7e4f53c4fad4deaab1794f7ea2d86a6"} Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.842741 4769 scope.go:117] "RemoveContainer" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.842866 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-1" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.849474 4769 generic.go:334] "Generic (PLEG): container finished" podID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerID="4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9" exitCode=0 Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.849511 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"d16b01be-7f06-41df-b88c-5c318414ce0f","Type":"ContainerDied","Data":"4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9"} Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.849534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/openstack-galera-0" event={"ID":"d16b01be-7f06-41df-b88c-5c318414ce0f","Type":"ContainerDied","Data":"7d254d4a1ff8bdab71fb5d69619142c700da28b8016eb3f69b230808d2b38879"} Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.849598 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/openstack-galera-0" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.930936 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-kolla-config\") pod \"d16b01be-7f06-41df-b88c-5c318414ce0f\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.930995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-default\") pod \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931073 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kolla-config\") pod \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931119 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-generated\") pod \"d16b01be-7f06-41df-b88c-5c318414ce0f\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931147 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww65s\" (UniqueName: \"kubernetes.io/projected/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kube-api-access-ww65s\") pod \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931175 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"d16b01be-7f06-41df-b88c-5c318414ce0f\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931209 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-operator-scripts\") pod \"d16b01be-7f06-41df-b88c-5c318414ce0f\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931226 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsm5p\" (UniqueName: \"kubernetes.io/projected/d16b01be-7f06-41df-b88c-5c318414ce0f-kube-api-access-vsm5p\") pod \"d16b01be-7f06-41df-b88c-5c318414ce0f\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931247 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-generated\") pod \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931282 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-operator-scripts\") pod \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931317 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-default\") pod \"d16b01be-7f06-41df-b88c-5c318414ce0f\" (UID: \"d16b01be-7f06-41df-b88c-5c318414ce0f\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.931340 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\" (UID: \"410e07d7-e067-461d-8b05-9ae39cb5d5ad\") " Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.932222 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "d16b01be-7f06-41df-b88c-5c318414ce0f" (UID: "d16b01be-7f06-41df-b88c-5c318414ce0f"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.932330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "410e07d7-e067-461d-8b05-9ae39cb5d5ad" (UID: "410e07d7-e067-461d-8b05-9ae39cb5d5ad"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.933080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "d16b01be-7f06-41df-b88c-5c318414ce0f" (UID: "d16b01be-7f06-41df-b88c-5c318414ce0f"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.933166 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "410e07d7-e067-461d-8b05-9ae39cb5d5ad" (UID: "410e07d7-e067-461d-8b05-9ae39cb5d5ad"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.933288 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "410e07d7-e067-461d-8b05-9ae39cb5d5ad" (UID: "410e07d7-e067-461d-8b05-9ae39cb5d5ad"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.933312 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d16b01be-7f06-41df-b88c-5c318414ce0f" (UID: "d16b01be-7f06-41df-b88c-5c318414ce0f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.936763 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "410e07d7-e067-461d-8b05-9ae39cb5d5ad" (UID: "410e07d7-e067-461d-8b05-9ae39cb5d5ad"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.938567 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "d16b01be-7f06-41df-b88c-5c318414ce0f" (UID: "d16b01be-7f06-41df-b88c-5c318414ce0f"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.943178 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16b01be-7f06-41df-b88c-5c318414ce0f-kube-api-access-vsm5p" (OuterVolumeSpecName: "kube-api-access-vsm5p") pod "d16b01be-7f06-41df-b88c-5c318414ce0f" (UID: "d16b01be-7f06-41df-b88c-5c318414ce0f"). InnerVolumeSpecName "kube-api-access-vsm5p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.947573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kube-api-access-ww65s" (OuterVolumeSpecName: "kube-api-access-ww65s") pod "410e07d7-e067-461d-8b05-9ae39cb5d5ad" (UID: "410e07d7-e067-461d-8b05-9ae39cb5d5ad"). InnerVolumeSpecName "kube-api-access-ww65s". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.949530 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "d16b01be-7f06-41df-b88c-5c318414ce0f" (UID: "d16b01be-7f06-41df-b88c-5c318414ce0f"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.955390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "mysql-db") pod "410e07d7-e067-461d-8b05-9ae39cb5d5ad" (UID: "410e07d7-e067-461d-8b05-9ae39cb5d5ad"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 13:53:10 crc kubenswrapper[4769]: I1121 13:53:10.969602 4769 scope.go:117] "RemoveContainer" containerID="c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.009569 4769 scope.go:117] "RemoveContainer" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" Nov 21 13:53:11 crc kubenswrapper[4769]: E1121 13:53:11.010090 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3\": container with ID starting with 1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3 not found: ID does not exist" containerID="1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.010148 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3"} err="failed to get container status \"1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3\": rpc error: code = NotFound desc = could not find container \"1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3\": container with ID starting with 1c3d9223bd4c115d7d3dcb3e3434f29f203515043a33c697f42ca5092d519ff3 not found: ID does not exist" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.010183 4769 scope.go:117] "RemoveContainer" containerID="c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37" Nov 21 13:53:11 crc kubenswrapper[4769]: E1121 13:53:11.010683 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37\": container with ID starting with c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37 not found: ID does not exist" containerID="c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.010729 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37"} err="failed to get container status \"c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37\": rpc error: code = NotFound desc = could not find container \"c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37\": container with ID starting with c19243cf3e6705c77a6b4716c103f0fb20682998ef8b5d2e0b31c35f44022e37 not found: ID does not exist" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.010748 4769 scope.go:117] "RemoveContainer" containerID="4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.031151 4769 scope.go:117] "RemoveContainer" containerID="f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032598 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032629 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032648 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ww65s\" (UniqueName: \"kubernetes.io/projected/410e07d7-e067-461d-8b05-9ae39cb5d5ad-kube-api-access-ww65s\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032695 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032709 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032719 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vsm5p\" (UniqueName: \"kubernetes.io/projected/d16b01be-7f06-41df-b88c-5c318414ce0f-kube-api-access-vsm5p\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032728 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032740 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032748 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032762 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032771 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/d16b01be-7f06-41df-b88c-5c318414ce0f-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.032781 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/410e07d7-e067-461d-8b05-9ae39cb5d5ad-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.067907 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.083129 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.083955 4769 scope.go:117] "RemoveContainer" containerID="4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9" Nov 21 13:53:11 crc kubenswrapper[4769]: E1121 13:53:11.085894 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9\": container with ID starting with 4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9 not found: ID does not exist" containerID="4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.085936 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9"} err="failed to get container status \"4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9\": rpc error: code = NotFound desc = could not find container \"4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9\": container with ID starting with 4e2b44db40f0f63d61d16b5accd687c961fec5a34861d42d13c008ad18fe1fc9 not found: ID does not exist" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.085980 4769 scope.go:117] "RemoveContainer" containerID="f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631" Nov 21 13:53:11 crc kubenswrapper[4769]: E1121 13:53:11.088641 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631\": container with ID starting with f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631 not found: ID does not exist" containerID="f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.088680 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631"} err="failed to get container status \"f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631\": rpc error: code = NotFound desc = could not find container \"f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631\": container with ID starting with f60bbeba92b16e85ea485845520e9f931af501f8adb81ede94710e45ff334631 not found: ID does not exist" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.133982 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.134027 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.234987 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.246312 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/openstack-galera-1"] Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.253643 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.261183 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/openstack-galera-0"] Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.277144 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:53:11 crc kubenswrapper[4769]: E1121 13:53:11.277383 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.287469 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="065760bf-10d3-42cc-837e-ab6732b7d938" path="/var/lib/kubelet/pods/065760bf-10d3-42cc-837e-ab6732b7d938/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.288359 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" path="/var/lib/kubelet/pods/22171770-4f23-4b88-b09b-2a0a117cc35f/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.289790 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" path="/var/lib/kubelet/pods/26598e29-5cf4-4491-bd0a-29b0398e233b/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.291170 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305a3a88-e259-43af-92ba-b106f36a71af" path="/var/lib/kubelet/pods/305a3a88-e259-43af-92ba-b106f36a71af/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.291939 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" path="/var/lib/kubelet/pods/410e07d7-e067-461d-8b05-9ae39cb5d5ad/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.292967 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" path="/var/lib/kubelet/pods/8d7de4cd-1112-4aa9-846a-c897a398f042/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.295177 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" path="/var/lib/kubelet/pods/d16b01be-7f06-41df-b88c-5c318414ce0f/volumes" Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.873264 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk"] Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.873774 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="manager" containerID="cri-o://323d12cc6172976a0a0a825fa699b47d93fb32f02ca89f88b2d7681ef22402e0" gracePeriod=10 Nov 21 13:53:11 crc kubenswrapper[4769]: I1121 13:53:11.873937 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="kube-rbac-proxy" containerID="cri-o://cbe5309d7b11c2d8b6565451ac632ffcf502765b2f253ad1d004bfd44db7e127" gracePeriod=10 Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.155088 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-zjpht"] Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.155355 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-index-zjpht" podUID="976e5de9-b732-4f46-b3f3-604f42f1dab4" containerName="registry-server" containerID="cri-o://37ea4cbe0f3ca50eec3c521561891a94055171f4ec9af33fedfe7b04781491aa" gracePeriod=30 Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.259786 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp"] Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.270363 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcnhrxp"] Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.874512 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerID="cbe5309d7b11c2d8b6565451ac632ffcf502765b2f253ad1d004bfd44db7e127" exitCode=0 Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.874549 4769 generic.go:334] "Generic (PLEG): container finished" podID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerID="323d12cc6172976a0a0a825fa699b47d93fb32f02ca89f88b2d7681ef22402e0" exitCode=0 Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.874598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" event={"ID":"9d445e12-547d-4a0f-a460-b5d1ee139569","Type":"ContainerDied","Data":"cbe5309d7b11c2d8b6565451ac632ffcf502765b2f253ad1d004bfd44db7e127"} Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.874638 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" event={"ID":"9d445e12-547d-4a0f-a460-b5d1ee139569","Type":"ContainerDied","Data":"323d12cc6172976a0a0a825fa699b47d93fb32f02ca89f88b2d7681ef22402e0"} Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.875982 4769 generic.go:334] "Generic (PLEG): container finished" podID="976e5de9-b732-4f46-b3f3-604f42f1dab4" containerID="37ea4cbe0f3ca50eec3c521561891a94055171f4ec9af33fedfe7b04781491aa" exitCode=0 Nov 21 13:53:12 crc kubenswrapper[4769]: I1121 13:53:12.876011 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-zjpht" event={"ID":"976e5de9-b732-4f46-b3f3-604f42f1dab4","Type":"ContainerDied","Data":"37ea4cbe0f3ca50eec3c521561891a94055171f4ec9af33fedfe7b04781491aa"} Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.012990 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.155581 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.160548 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-apiservice-cert\") pod \"9d445e12-547d-4a0f-a460-b5d1ee139569\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.160868 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-webhook-cert\") pod \"9d445e12-547d-4a0f-a460-b5d1ee139569\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.161138 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw2ct\" (UniqueName: \"kubernetes.io/projected/9d445e12-547d-4a0f-a460-b5d1ee139569-kube-api-access-rw2ct\") pod \"9d445e12-547d-4a0f-a460-b5d1ee139569\" (UID: \"9d445e12-547d-4a0f-a460-b5d1ee139569\") " Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.168817 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9d445e12-547d-4a0f-a460-b5d1ee139569" (UID: "9d445e12-547d-4a0f-a460-b5d1ee139569"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.168911 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "9d445e12-547d-4a0f-a460-b5d1ee139569" (UID: "9d445e12-547d-4a0f-a460-b5d1ee139569"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.169354 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d445e12-547d-4a0f-a460-b5d1ee139569-kube-api-access-rw2ct" (OuterVolumeSpecName: "kube-api-access-rw2ct") pod "9d445e12-547d-4a0f-a460-b5d1ee139569" (UID: "9d445e12-547d-4a0f-a460-b5d1ee139569"). InnerVolumeSpecName "kube-api-access-rw2ct". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.263047 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kjl4\" (UniqueName: \"kubernetes.io/projected/976e5de9-b732-4f46-b3f3-604f42f1dab4-kube-api-access-5kjl4\") pod \"976e5de9-b732-4f46-b3f3-604f42f1dab4\" (UID: \"976e5de9-b732-4f46-b3f3-604f42f1dab4\") " Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.263669 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rw2ct\" (UniqueName: \"kubernetes.io/projected/9d445e12-547d-4a0f-a460-b5d1ee139569-kube-api-access-rw2ct\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.263735 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.263756 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d445e12-547d-4a0f-a460-b5d1ee139569-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.268352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976e5de9-b732-4f46-b3f3-604f42f1dab4-kube-api-access-5kjl4" (OuterVolumeSpecName: "kube-api-access-5kjl4") pod "976e5de9-b732-4f46-b3f3-604f42f1dab4" (UID: "976e5de9-b732-4f46-b3f3-604f42f1dab4"). InnerVolumeSpecName "kube-api-access-5kjl4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.292323 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528496b1-fdee-4c06-88f5-d394d03521ad" path="/var/lib/kubelet/pods/528496b1-fdee-4c06-88f5-d394d03521ad/volumes" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.365677 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kjl4\" (UniqueName: \"kubernetes.io/projected/976e5de9-b732-4f46-b3f3-604f42f1dab4-kube-api-access-5kjl4\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.885490 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-zjpht" event={"ID":"976e5de9-b732-4f46-b3f3-604f42f1dab4","Type":"ContainerDied","Data":"c103f812ac18bbc41841d7f34c22bafe20c3b01b6c0a4ebb67658a708ab67270"} Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.885546 4769 scope.go:117] "RemoveContainer" containerID="37ea4cbe0f3ca50eec3c521561891a94055171f4ec9af33fedfe7b04781491aa" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.885546 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-zjpht" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.892561 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" event={"ID":"9d445e12-547d-4a0f-a460-b5d1ee139569","Type":"ContainerDied","Data":"d99f82f49dddb9af075ebb47c9164253dc1fd976f702dc64281e42419e89a6bc"} Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.892609 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.919524 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-zjpht"] Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.927981 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-index-zjpht"] Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.929645 4769 scope.go:117] "RemoveContainer" containerID="cbe5309d7b11c2d8b6565451ac632ffcf502765b2f253ad1d004bfd44db7e127" Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.940356 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk"] Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.945729 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-64d8648f76-b6pwk"] Nov 21 13:53:13 crc kubenswrapper[4769]: I1121 13:53:13.951127 4769 scope.go:117] "RemoveContainer" containerID="323d12cc6172976a0a0a825fa699b47d93fb32f02ca89f88b2d7681ef22402e0" Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.376992 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw"] Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.639722 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-4gnlr"] Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.640291 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" podUID="8901532d-8a43-4089-ab38-2cf0c96845d7" containerName="registry-server" containerID="cri-o://a42ec1bf33ea826e0a230c117ebce2d3e3e9b500615675966e67a619d464d773" gracePeriod=30 Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.676136 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586"] Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.680611 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590zf586"] Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.913354 4769 generic.go:334] "Generic (PLEG): container finished" podID="8901532d-8a43-4089-ab38-2cf0c96845d7" containerID="a42ec1bf33ea826e0a230c117ebce2d3e3e9b500615675966e67a619d464d773" exitCode=0 Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.913429 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" event={"ID":"8901532d-8a43-4089-ab38-2cf0c96845d7","Type":"ContainerDied","Data":"a42ec1bf33ea826e0a230c117ebce2d3e3e9b500615675966e67a619d464d773"} Nov 21 13:53:14 crc kubenswrapper[4769]: I1121 13:53:14.915739 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" podUID="fc6e1f79-332b-44a0-a2d2-a847683f7c8a" containerName="operator" containerID="cri-o://1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f" gracePeriod=10 Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.211978 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.283080 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="976e5de9-b732-4f46-b3f3-604f42f1dab4" path="/var/lib/kubelet/pods/976e5de9-b732-4f46-b3f3-604f42f1dab4/volumes" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.283896 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" path="/var/lib/kubelet/pods/9d445e12-547d-4a0f-a460-b5d1ee139569/volumes" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.285477 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8fefee-d72c-4dfe-9a27-f451df6fe0be" path="/var/lib/kubelet/pods/ab8fefee-d72c-4dfe-9a27-f451df6fe0be/volumes" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.291348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg4mg\" (UniqueName: \"kubernetes.io/projected/8901532d-8a43-4089-ab38-2cf0c96845d7-kube-api-access-dg4mg\") pod \"8901532d-8a43-4089-ab38-2cf0c96845d7\" (UID: \"8901532d-8a43-4089-ab38-2cf0c96845d7\") " Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.299601 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8901532d-8a43-4089-ab38-2cf0c96845d7-kube-api-access-dg4mg" (OuterVolumeSpecName: "kube-api-access-dg4mg") pod "8901532d-8a43-4089-ab38-2cf0c96845d7" (UID: "8901532d-8a43-4089-ab38-2cf0c96845d7"). InnerVolumeSpecName "kube-api-access-dg4mg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.359260 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.392845 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dg4mg\" (UniqueName: \"kubernetes.io/projected/8901532d-8a43-4089-ab38-2cf0c96845d7-kube-api-access-dg4mg\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.495231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ckl7\" (UniqueName: \"kubernetes.io/projected/fc6e1f79-332b-44a0-a2d2-a847683f7c8a-kube-api-access-6ckl7\") pod \"fc6e1f79-332b-44a0-a2d2-a847683f7c8a\" (UID: \"fc6e1f79-332b-44a0-a2d2-a847683f7c8a\") " Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.498755 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6e1f79-332b-44a0-a2d2-a847683f7c8a-kube-api-access-6ckl7" (OuterVolumeSpecName: "kube-api-access-6ckl7") pod "fc6e1f79-332b-44a0-a2d2-a847683f7c8a" (UID: "fc6e1f79-332b-44a0-a2d2-a847683f7c8a"). InnerVolumeSpecName "kube-api-access-6ckl7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.596629 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6ckl7\" (UniqueName: \"kubernetes.io/projected/fc6e1f79-332b-44a0-a2d2-a847683f7c8a-kube-api-access-6ckl7\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.925285 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" event={"ID":"8901532d-8a43-4089-ab38-2cf0c96845d7","Type":"ContainerDied","Data":"79eee4d828c0962f14f08998c1d2fe484b3f2cfcf5ddbc2afa548e40cd9bf339"} Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.925368 4769 scope.go:117] "RemoveContainer" containerID="a42ec1bf33ea826e0a230c117ebce2d3e3e9b500615675966e67a619d464d773" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.925299 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-4gnlr" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.928255 4769 generic.go:334] "Generic (PLEG): container finished" podID="fc6e1f79-332b-44a0-a2d2-a847683f7c8a" containerID="1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f" exitCode=0 Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.928296 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" event={"ID":"fc6e1f79-332b-44a0-a2d2-a847683f7c8a","Type":"ContainerDied","Data":"1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f"} Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.928325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" event={"ID":"fc6e1f79-332b-44a0-a2d2-a847683f7c8a","Type":"ContainerDied","Data":"d2eed6510a4dbf3a7e3b6d1b3aaf202dc98853acb919251f58cc0bd8b6bbb409"} Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.928382 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.947783 4769 scope.go:117] "RemoveContainer" containerID="1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.958128 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-4gnlr"] Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.962854 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-4gnlr"] Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.970870 4769 scope.go:117] "RemoveContainer" containerID="1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f" Nov 21 13:53:15 crc kubenswrapper[4769]: E1121 13:53:15.971555 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f\": container with ID starting with 1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f not found: ID does not exist" containerID="1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.971596 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f"} err="failed to get container status \"1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f\": rpc error: code = NotFound desc = could not find container \"1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f\": container with ID starting with 1a9315edc68d70d986c9a6685bfd00d82696c397613db2a6f7121a043329bf6f not found: ID does not exist" Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.972282 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw"] Nov 21 13:53:15 crc kubenswrapper[4769]: I1121 13:53:15.976145 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-n6zcw"] Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.693366 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4"] Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.694077 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="manager" containerID="cri-o://4a2d03740a12b799bde759dfcf27d1c0d438f17f9f439f27af58741521319ee4" gracePeriod=10 Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.694140 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="kube-rbac-proxy" containerID="cri-o://bc6594335936abaa7cb28a954178d3c72070bd8918fb1832c6c17833db31870d" gracePeriod=10 Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.938615 4769 generic.go:334] "Generic (PLEG): container finished" podID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerID="bc6594335936abaa7cb28a954178d3c72070bd8918fb1832c6c17833db31870d" exitCode=0 Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.939282 4769 generic.go:334] "Generic (PLEG): container finished" podID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerID="4a2d03740a12b799bde759dfcf27d1c0d438f17f9f439f27af58741521319ee4" exitCode=0 Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.938781 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" event={"ID":"e4304eb4-35c7-4b0c-ad68-a28e2fec84de","Type":"ContainerDied","Data":"bc6594335936abaa7cb28a954178d3c72070bd8918fb1832c6c17833db31870d"} Nov 21 13:53:16 crc kubenswrapper[4769]: I1121 13:53:16.939470 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" event={"ID":"e4304eb4-35c7-4b0c-ad68-a28e2fec84de","Type":"ContainerDied","Data":"4a2d03740a12b799bde759dfcf27d1c0d438f17f9f439f27af58741521319ee4"} Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.069855 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-gm2nn"] Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.070109 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-gm2nn" podUID="e10ce26a-37b5-4d89-a90c-653b7f4c03b2" containerName="registry-server" containerID="cri-o://e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e" gracePeriod=30 Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.097428 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7"] Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.103952 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8edgvx7"] Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.280818 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c71584b-78d9-4bd2-8929-7687d1c23342" path="/var/lib/kubelet/pods/6c71584b-78d9-4bd2-8929-7687d1c23342/volumes" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.281738 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8901532d-8a43-4089-ab38-2cf0c96845d7" path="/var/lib/kubelet/pods/8901532d-8a43-4089-ab38-2cf0c96845d7/volumes" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.282202 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6e1f79-332b-44a0-a2d2-a847683f7c8a" path="/var/lib/kubelet/pods/fc6e1f79-332b-44a0-a2d2-a847683f7c8a/volumes" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.531127 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.599931 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.636745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kl7d\" (UniqueName: \"kubernetes.io/projected/e10ce26a-37b5-4d89-a90c-653b7f4c03b2-kube-api-access-2kl7d\") pod \"e10ce26a-37b5-4d89-a90c-653b7f4c03b2\" (UID: \"e10ce26a-37b5-4d89-a90c-653b7f4c03b2\") " Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.643747 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10ce26a-37b5-4d89-a90c-653b7f4c03b2-kube-api-access-2kl7d" (OuterVolumeSpecName: "kube-api-access-2kl7d") pod "e10ce26a-37b5-4d89-a90c-653b7f4c03b2" (UID: "e10ce26a-37b5-4d89-a90c-653b7f4c03b2"). InnerVolumeSpecName "kube-api-access-2kl7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.738006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-apiservice-cert\") pod \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.738058 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smvtv\" (UniqueName: \"kubernetes.io/projected/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-kube-api-access-smvtv\") pod \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.738135 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-webhook-cert\") pod \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\" (UID: \"e4304eb4-35c7-4b0c-ad68-a28e2fec84de\") " Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.738490 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2kl7d\" (UniqueName: \"kubernetes.io/projected/e10ce26a-37b5-4d89-a90c-653b7f4c03b2-kube-api-access-2kl7d\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.740987 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-kube-api-access-smvtv" (OuterVolumeSpecName: "kube-api-access-smvtv") pod "e4304eb4-35c7-4b0c-ad68-a28e2fec84de" (UID: "e4304eb4-35c7-4b0c-ad68-a28e2fec84de"). InnerVolumeSpecName "kube-api-access-smvtv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.741350 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "e4304eb4-35c7-4b0c-ad68-a28e2fec84de" (UID: "e4304eb4-35c7-4b0c-ad68-a28e2fec84de"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.742118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e4304eb4-35c7-4b0c-ad68-a28e2fec84de" (UID: "e4304eb4-35c7-4b0c-ad68-a28e2fec84de"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.840418 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.840456 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-smvtv\" (UniqueName: \"kubernetes.io/projected/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-kube-api-access-smvtv\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.840467 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e4304eb4-35c7-4b0c-ad68-a28e2fec84de-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.951804 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.951858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4" event={"ID":"e4304eb4-35c7-4b0c-ad68-a28e2fec84de","Type":"ContainerDied","Data":"0961b4c51d17b498fde45a2611bc780e0bc0ccbbfe262210c4bae36efe49cb58"} Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.951930 4769 scope.go:117] "RemoveContainer" containerID="bc6594335936abaa7cb28a954178d3c72070bd8918fb1832c6c17833db31870d" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.953740 4769 generic.go:334] "Generic (PLEG): container finished" podID="e10ce26a-37b5-4d89-a90c-653b7f4c03b2" containerID="e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e" exitCode=0 Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.953777 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gm2nn" event={"ID":"e10ce26a-37b5-4d89-a90c-653b7f4c03b2","Type":"ContainerDied","Data":"e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e"} Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.953802 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-gm2nn" event={"ID":"e10ce26a-37b5-4d89-a90c-653b7f4c03b2","Type":"ContainerDied","Data":"9375cc4f0041ed752fdb2859b4525f85b37a240bc9b9d2caf4f2cca0c5ad7919"} Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.953810 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-gm2nn" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.977393 4769 scope.go:117] "RemoveContainer" containerID="4a2d03740a12b799bde759dfcf27d1c0d438f17f9f439f27af58741521319ee4" Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.982137 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4"] Nov 21 13:53:17 crc kubenswrapper[4769]: I1121 13:53:17.995243 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-84d5567896-8x8p4"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.002266 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-gm2nn"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.006917 4769 scope.go:117] "RemoveContainer" containerID="e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e" Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.010026 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-gm2nn"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.030526 4769 scope.go:117] "RemoveContainer" containerID="e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e" Nov 21 13:53:18 crc kubenswrapper[4769]: E1121 13:53:18.035838 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e\": container with ID starting with e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e not found: ID does not exist" containerID="e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e" Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.035879 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e"} err="failed to get container status \"e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e\": rpc error: code = NotFound desc = could not find container \"e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e\": container with ID starting with e0299b35fd784c0cf7281ae37f9e21100c0d89447533831c222abe0296152f4e not found: ID does not exist" Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.504544 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.504819 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="manager" containerID="cri-o://8dfc38976561d30395f660bd99989ed6723b296af5fb1a8de89273ca422c774f" gracePeriod=10 Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.504950 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="kube-rbac-proxy" containerID="cri-o://0960e9159e13c18a7f74aa5f82da081f606897f24118a3ea4217ba1f98b9838c" gracePeriod=10 Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.828666 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-j7nnj"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.828872 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-j7nnj" podUID="e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" containerName="registry-server" containerID="cri-o://efcda5ddf7223620b769fad29f0bea66ec3cc754b5c2ec69674e15b25cadefbd" gracePeriod=30 Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.873675 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.878680 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27crk4rg"] Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.961746 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" containerID="efcda5ddf7223620b769fad29f0bea66ec3cc754b5c2ec69674e15b25cadefbd" exitCode=0 Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.961827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-j7nnj" event={"ID":"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181","Type":"ContainerDied","Data":"efcda5ddf7223620b769fad29f0bea66ec3cc754b5c2ec69674e15b25cadefbd"} Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.966014 4769 generic.go:334] "Generic (PLEG): container finished" podID="7311aada-952e-463a-83ec-096997995f86" containerID="0960e9159e13c18a7f74aa5f82da081f606897f24118a3ea4217ba1f98b9838c" exitCode=0 Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.966046 4769 generic.go:334] "Generic (PLEG): container finished" podID="7311aada-952e-463a-83ec-096997995f86" containerID="8dfc38976561d30395f660bd99989ed6723b296af5fb1a8de89273ca422c774f" exitCode=0 Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.966070 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" event={"ID":"7311aada-952e-463a-83ec-096997995f86","Type":"ContainerDied","Data":"0960e9159e13c18a7f74aa5f82da081f606897f24118a3ea4217ba1f98b9838c"} Nov 21 13:53:18 crc kubenswrapper[4769]: I1121 13:53:18.966099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" event={"ID":"7311aada-952e-463a-83ec-096997995f86","Type":"ContainerDied","Data":"8dfc38976561d30395f660bd99989ed6723b296af5fb1a8de89273ca422c774f"} Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.298050 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c28be51-621e-4ef1-ab7f-38c79287cee9" path="/var/lib/kubelet/pods/9c28be51-621e-4ef1-ab7f-38c79287cee9/volumes" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.298808 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10ce26a-37b5-4d89-a90c-653b7f4c03b2" path="/var/lib/kubelet/pods/e10ce26a-37b5-4d89-a90c-653b7f4c03b2/volumes" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.300421 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" path="/var/lib/kubelet/pods/e4304eb4-35c7-4b0c-ad68-a28e2fec84de/volumes" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.426836 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.549779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.565443 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvc82\" (UniqueName: \"kubernetes.io/projected/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181-kube-api-access-dvc82\") pod \"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181\" (UID: \"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181\") " Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.610277 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181-kube-api-access-dvc82" (OuterVolumeSpecName: "kube-api-access-dvc82") pod "e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" (UID: "e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181"). InnerVolumeSpecName "kube-api-access-dvc82". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.667159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-webhook-cert\") pod \"7311aada-952e-463a-83ec-096997995f86\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.667268 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-apiservice-cert\") pod \"7311aada-952e-463a-83ec-096997995f86\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.667362 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjp47\" (UniqueName: \"kubernetes.io/projected/7311aada-952e-463a-83ec-096997995f86-kube-api-access-wjp47\") pod \"7311aada-952e-463a-83ec-096997995f86\" (UID: \"7311aada-952e-463a-83ec-096997995f86\") " Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.667654 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dvc82\" (UniqueName: \"kubernetes.io/projected/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181-kube-api-access-dvc82\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.669745 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "7311aada-952e-463a-83ec-096997995f86" (UID: "7311aada-952e-463a-83ec-096997995f86"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.670427 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7311aada-952e-463a-83ec-096997995f86-kube-api-access-wjp47" (OuterVolumeSpecName: "kube-api-access-wjp47") pod "7311aada-952e-463a-83ec-096997995f86" (UID: "7311aada-952e-463a-83ec-096997995f86"). InnerVolumeSpecName "kube-api-access-wjp47". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.670615 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7311aada-952e-463a-83ec-096997995f86" (UID: "7311aada-952e-463a-83ec-096997995f86"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.769098 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjp47\" (UniqueName: \"kubernetes.io/projected/7311aada-952e-463a-83ec-096997995f86-kube-api-access-wjp47\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.769143 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.769154 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7311aada-952e-463a-83ec-096997995f86-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.975891 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.975912 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp" event={"ID":"7311aada-952e-463a-83ec-096997995f86","Type":"ContainerDied","Data":"06f68bc619407e3520397d5894d3ee341a26b324bb77cc573f6be1eb8d7c0522"} Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.975959 4769 scope.go:117] "RemoveContainer" containerID="0960e9159e13c18a7f74aa5f82da081f606897f24118a3ea4217ba1f98b9838c" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.978827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-j7nnj" event={"ID":"e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181","Type":"ContainerDied","Data":"3c8fb040f2ccc2bbcd637606bdc4266e58756d0cc5c03c3bddbf4024c94f43c1"} Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.978954 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-j7nnj" Nov 21 13:53:19 crc kubenswrapper[4769]: I1121 13:53:19.996079 4769 scope.go:117] "RemoveContainer" containerID="8dfc38976561d30395f660bd99989ed6723b296af5fb1a8de89273ca422c774f" Nov 21 13:53:20 crc kubenswrapper[4769]: I1121 13:53:20.008850 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp"] Nov 21 13:53:20 crc kubenswrapper[4769]: I1121 13:53:20.014494 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-79b79744f5-zdrqp"] Nov 21 13:53:20 crc kubenswrapper[4769]: I1121 13:53:20.017258 4769 scope.go:117] "RemoveContainer" containerID="efcda5ddf7223620b769fad29f0bea66ec3cc754b5c2ec69674e15b25cadefbd" Nov 21 13:53:20 crc kubenswrapper[4769]: I1121 13:53:20.020753 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-j7nnj"] Nov 21 13:53:20 crc kubenswrapper[4769]: I1121 13:53:20.026510 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-j7nnj"] Nov 21 13:53:21 crc kubenswrapper[4769]: I1121 13:53:21.281747 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7311aada-952e-463a-83ec-096997995f86" path="/var/lib/kubelet/pods/7311aada-952e-463a-83ec-096997995f86/volumes" Nov 21 13:53:21 crc kubenswrapper[4769]: I1121 13:53:21.282941 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" path="/var/lib/kubelet/pods/e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181/volumes" Nov 21 13:53:22 crc kubenswrapper[4769]: I1121 13:53:22.274744 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:53:22 crc kubenswrapper[4769]: E1121 13:53:22.275058 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:53:33 crc kubenswrapper[4769]: I1121 13:53:33.279052 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:53:33 crc kubenswrapper[4769]: E1121 13:53:33.279584 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.023083 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.130968 4769 generic.go:334] "Generic (PLEG): container finished" podID="6182d6df-5aee-4eef-a2f6-a9f5d504a125" containerID="a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced" exitCode=137 Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.131090 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.131283 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" event={"ID":"6182d6df-5aee-4eef-a2f6-a9f5d504a125","Type":"ContainerDied","Data":"a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced"} Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.133327 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="barbican-kuttl-tests/keystone9b40-account-delete-kvhvb" event={"ID":"6182d6df-5aee-4eef-a2f6-a9f5d504a125","Type":"ContainerDied","Data":"bbd309e242d9721def81d0856fa568adece4fc6349325608076c700cf0a5b3c7"} Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.133376 4769 scope.go:117] "RemoveContainer" containerID="a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.160003 4769 scope.go:117] "RemoveContainer" containerID="a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced" Nov 21 13:53:38 crc kubenswrapper[4769]: E1121 13:53:38.161068 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced\": container with ID starting with a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced not found: ID does not exist" containerID="a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.161105 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced"} err="failed to get container status \"a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced\": rpc error: code = NotFound desc = could not find container \"a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced\": container with ID starting with a4968909a639a20da9e4307a0028d8513a78bd0ad9f1635b2f10c1d18fbc9ced not found: ID does not exist" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.189143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2vzm\" (UniqueName: \"kubernetes.io/projected/6182d6df-5aee-4eef-a2f6-a9f5d504a125-kube-api-access-m2vzm\") pod \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.189301 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6182d6df-5aee-4eef-a2f6-a9f5d504a125-operator-scripts\") pod \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\" (UID: \"6182d6df-5aee-4eef-a2f6-a9f5d504a125\") " Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.190662 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6182d6df-5aee-4eef-a2f6-a9f5d504a125-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6182d6df-5aee-4eef-a2f6-a9f5d504a125" (UID: "6182d6df-5aee-4eef-a2f6-a9f5d504a125"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.196579 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6182d6df-5aee-4eef-a2f6-a9f5d504a125-kube-api-access-m2vzm" (OuterVolumeSpecName: "kube-api-access-m2vzm") pod "6182d6df-5aee-4eef-a2f6-a9f5d504a125" (UID: "6182d6df-5aee-4eef-a2f6-a9f5d504a125"). InnerVolumeSpecName "kube-api-access-m2vzm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.291333 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-m2vzm\" (UniqueName: \"kubernetes.io/projected/6182d6df-5aee-4eef-a2f6-a9f5d504a125-kube-api-access-m2vzm\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.291378 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6182d6df-5aee-4eef-a2f6-a9f5d504a125-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.459825 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["barbican-kuttl-tests/keystone9b40-account-delete-kvhvb"] Nov 21 13:53:38 crc kubenswrapper[4769]: I1121 13:53:38.465775 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["barbican-kuttl-tests/keystone9b40-account-delete-kvhvb"] Nov 21 13:53:39 crc kubenswrapper[4769]: I1121 13:53:39.282664 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6182d6df-5aee-4eef-a2f6-a9f5d504a125" path="/var/lib/kubelet/pods/6182d6df-5aee-4eef-a2f6-a9f5d504a125/volumes" Nov 21 13:53:45 crc kubenswrapper[4769]: I1121 13:53:45.275318 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:53:45 crc kubenswrapper[4769]: E1121 13:53:45.276351 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:53:59 crc kubenswrapper[4769]: I1121 13:53:59.275085 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:53:59 crc kubenswrapper[4769]: E1121 13:53:59.276897 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.273945 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.276037 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941172 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-l6762"] Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941734 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941752 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941770 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941778 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941788 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="mysql-bootstrap" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941796 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="mysql-bootstrap" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941806 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941824 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941832 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941842 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941849 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941858 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941865 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941882 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerName="rabbitmq" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941890 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerName="rabbitmq" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941903 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941910 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="305a3a88-e259-43af-92ba-b106f36a71af" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941933 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="305a3a88-e259-43af-92ba-b106f36a71af" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941942 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="065760bf-10d3-42cc-837e-ab6732b7d938" containerName="memcached" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941949 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="065760bf-10d3-42cc-837e-ab6732b7d938" containerName="memcached" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941961 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941968 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.941980 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerName="mysql-bootstrap" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.941989 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerName="mysql-bootstrap" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942006 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="mysql-bootstrap" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942015 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="mysql-bootstrap" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942025 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerName="setup-container" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942032 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerName="setup-container" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942048 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942056 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942065 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942072 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942084 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="976e5de9-b732-4f46-b3f3-604f42f1dab4" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942091 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="976e5de9-b732-4f46-b3f3-604f42f1dab4" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942103 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942110 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942123 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8901532d-8a43-4089-ab38-2cf0c96845d7" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942130 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8901532d-8a43-4089-ab38-2cf0c96845d7" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942140 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fc6e1f79-332b-44a0-a2d2-a847683f7c8a" containerName="operator" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942149 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6e1f79-332b-44a0-a2d2-a847683f7c8a" containerName="operator" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942159 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6182d6df-5aee-4eef-a2f6-a9f5d504a125" containerName="mariadb-account-delete" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942166 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6182d6df-5aee-4eef-a2f6-a9f5d504a125" containerName="mariadb-account-delete" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942174 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="dea91dc4-5738-41f8-8a55-d65000071b1d" containerName="keystone-api" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942181 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="dea91dc4-5738-41f8-8a55-d65000071b1d" containerName="keystone-api" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942215 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e10ce26a-37b5-4d89-a90c-653b7f4c03b2" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942225 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10ce26a-37b5-4d89-a90c-653b7f4c03b2" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: E1121 13:54:11.942241 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942249 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942373 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6182d6df-5aee-4eef-a2f6-a9f5d504a125" containerName="mariadb-account-delete" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942391 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fc6e1f79-332b-44a0-a2d2-a847683f7c8a" containerName="operator" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942401 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942415 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e10ce26a-37b5-4d89-a90c-653b7f4c03b2" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942424 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942438 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942450 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="d16b01be-7f06-41df-b88c-5c318414ce0f" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942458 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0521bd9-f2e0-479e-9a4b-0d7c7b2a3181" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942470 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4304eb4-35c7-4b0c-ad68-a28e2fec84de" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942479 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="065760bf-10d3-42cc-837e-ab6732b7d938" containerName="memcached" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942487 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9d445e12-547d-4a0f-a460-b5d1ee139569" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942498 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="22171770-4f23-4b88-b09b-2a0a117cc35f" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942508 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8d7de4cd-1112-4aa9-846a-c897a398f042" containerName="rabbitmq" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942517 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="manager" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942525 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="26598e29-5cf4-4491-bd0a-29b0398e233b" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942533 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8901532d-8a43-4089-ab38-2cf0c96845d7" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942542 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="976e5de9-b732-4f46-b3f3-604f42f1dab4" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942552 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="dea91dc4-5738-41f8-8a55-d65000071b1d" containerName="keystone-api" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942563 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="305a3a88-e259-43af-92ba-b106f36a71af" containerName="registry-server" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942575 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="410e07d7-e067-461d-8b05-9ae39cb5d5ad" containerName="galera" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.942585 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7311aada-952e-463a-83ec-096997995f86" containerName="kube-rbac-proxy" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.943145 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.946322 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.946771 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.947455 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-index-dockercfg-8k7d4" Nov 21 13:54:11 crc kubenswrapper[4769]: I1121 13:54:11.967997 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-l6762"] Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.078028 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vftp2\" (UniqueName: \"kubernetes.io/projected/29b7c8b9-280e-494c-9a9f-61d6966a25c0-kube-api-access-vftp2\") pod \"mariadb-operator-index-l6762\" (UID: \"29b7c8b9-280e-494c-9a9f-61d6966a25c0\") " pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.128052 4769 scope.go:117] "RemoveContainer" containerID="ab056df1be4e03aba5057c0b0dbfbaa702823431a0872111e7646961d993c15a" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.162181 4769 scope.go:117] "RemoveContainer" containerID="38934b8e502b17c0f338baccad0231490c3fb3b467f090b93beb8e98bd832ce6" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.184735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vftp2\" (UniqueName: \"kubernetes.io/projected/29b7c8b9-280e-494c-9a9f-61d6966a25c0-kube-api-access-vftp2\") pod \"mariadb-operator-index-l6762\" (UID: \"29b7c8b9-280e-494c-9a9f-61d6966a25c0\") " pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.190518 4769 scope.go:117] "RemoveContainer" containerID="29537eb34302fca68816db789d0e694aabbe1954272b14d615bcdb2d8b59a928" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.207091 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vftp2\" (UniqueName: \"kubernetes.io/projected/29b7c8b9-280e-494c-9a9f-61d6966a25c0-kube-api-access-vftp2\") pod \"mariadb-operator-index-l6762\" (UID: \"29b7c8b9-280e-494c-9a9f-61d6966a25c0\") " pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.219229 4769 scope.go:117] "RemoveContainer" containerID="a249fca7fc9d5a27076588224cf2e1966bf0bd096db84b8a911bff50a9ec25e9" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.257670 4769 scope.go:117] "RemoveContainer" containerID="9ff5de99dd85272baf725d217148fce1ed71e5f59673c090d10e83fde6386e98" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.282789 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.284047 4769 scope.go:117] "RemoveContainer" containerID="aeba9e09314922ccb3045a5b9261923a9e0761dddd82274061f292d28d4df3e4" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.313775 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-l6762"] Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.523178 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-lfjfp"] Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.524241 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.533357 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-lfjfp"] Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.691261 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whctw\" (UniqueName: \"kubernetes.io/projected/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7-kube-api-access-whctw\") pod \"mariadb-operator-index-lfjfp\" (UID: \"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7\") " pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.733925 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-l6762"] Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.796083 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-whctw\" (UniqueName: \"kubernetes.io/projected/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7-kube-api-access-whctw\") pod \"mariadb-operator-index-lfjfp\" (UID: \"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7\") " pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.813950 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-whctw\" (UniqueName: \"kubernetes.io/projected/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7-kube-api-access-whctw\") pod \"mariadb-operator-index-lfjfp\" (UID: \"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7\") " pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:12 crc kubenswrapper[4769]: I1121 13:54:12.856218 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:13 crc kubenswrapper[4769]: I1121 13:54:13.101098 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-lfjfp"] Nov 21 13:54:13 crc kubenswrapper[4769]: W1121 13:54:13.112484 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcf3b8a_976d_43c3_a6c9_a1498621f4e7.slice/crio-a143b93de741ca60111443fc9af37d71988a27fb37eca33269bd9512e6369dc6 WatchSource:0}: Error finding container a143b93de741ca60111443fc9af37d71988a27fb37eca33269bd9512e6369dc6: Status 404 returned error can't find the container with id a143b93de741ca60111443fc9af37d71988a27fb37eca33269bd9512e6369dc6 Nov 21 13:54:13 crc kubenswrapper[4769]: I1121 13:54:13.426825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-l6762" event={"ID":"29b7c8b9-280e-494c-9a9f-61d6966a25c0","Type":"ContainerStarted","Data":"ca996f393c9317d917090434e6147fb76a6fcbf24eab5bf6026c7570780628ee"} Nov 21 13:54:13 crc kubenswrapper[4769]: I1121 13:54:13.428597 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lfjfp" event={"ID":"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7","Type":"ContainerStarted","Data":"a143b93de741ca60111443fc9af37d71988a27fb37eca33269bd9512e6369dc6"} Nov 21 13:54:15 crc kubenswrapper[4769]: I1121 13:54:15.446977 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-l6762" event={"ID":"29b7c8b9-280e-494c-9a9f-61d6966a25c0","Type":"ContainerStarted","Data":"92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee"} Nov 21 13:54:15 crc kubenswrapper[4769]: I1121 13:54:15.447120 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-l6762" podUID="29b7c8b9-280e-494c-9a9f-61d6966a25c0" containerName="registry-server" containerID="cri-o://92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee" gracePeriod=2 Nov 21 13:54:15 crc kubenswrapper[4769]: I1121 13:54:15.484840 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-l6762" podStartSLOduration=2.19959278 podStartE2EDuration="4.484815578s" podCreationTimestamp="2025-11-21 13:54:11 +0000 UTC" firstStartedPulling="2025-11-21 13:54:12.748999271 +0000 UTC m=+7411.449661099" lastFinishedPulling="2025-11-21 13:54:15.034222079 +0000 UTC m=+7413.734883897" observedRunningTime="2025-11-21 13:54:15.483322848 +0000 UTC m=+7414.183984706" watchObservedRunningTime="2025-11-21 13:54:15.484815578 +0000 UTC m=+7414.185477406" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.177206 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.359393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vftp2\" (UniqueName: \"kubernetes.io/projected/29b7c8b9-280e-494c-9a9f-61d6966a25c0-kube-api-access-vftp2\") pod \"29b7c8b9-280e-494c-9a9f-61d6966a25c0\" (UID: \"29b7c8b9-280e-494c-9a9f-61d6966a25c0\") " Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.365612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b7c8b9-280e-494c-9a9f-61d6966a25c0-kube-api-access-vftp2" (OuterVolumeSpecName: "kube-api-access-vftp2") pod "29b7c8b9-280e-494c-9a9f-61d6966a25c0" (UID: "29b7c8b9-280e-494c-9a9f-61d6966a25c0"). InnerVolumeSpecName "kube-api-access-vftp2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.455406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lfjfp" event={"ID":"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7","Type":"ContainerStarted","Data":"14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20"} Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.457701 4769 generic.go:334] "Generic (PLEG): container finished" podID="29b7c8b9-280e-494c-9a9f-61d6966a25c0" containerID="92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee" exitCode=0 Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.457751 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-l6762" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.457739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-l6762" event={"ID":"29b7c8b9-280e-494c-9a9f-61d6966a25c0","Type":"ContainerDied","Data":"92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee"} Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.457814 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-l6762" event={"ID":"29b7c8b9-280e-494c-9a9f-61d6966a25c0","Type":"ContainerDied","Data":"ca996f393c9317d917090434e6147fb76a6fcbf24eab5bf6026c7570780628ee"} Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.457839 4769 scope.go:117] "RemoveContainer" containerID="92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.460956 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vftp2\" (UniqueName: \"kubernetes.io/projected/29b7c8b9-280e-494c-9a9f-61d6966a25c0-kube-api-access-vftp2\") on node \"crc\" DevicePath \"\"" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.483949 4769 scope.go:117] "RemoveContainer" containerID="92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee" Nov 21 13:54:16 crc kubenswrapper[4769]: E1121 13:54:16.484762 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee\": container with ID starting with 92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee not found: ID does not exist" containerID="92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.484792 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee"} err="failed to get container status \"92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee\": rpc error: code = NotFound desc = could not find container \"92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee\": container with ID starting with 92d80e90a6fed331d772d83abc45767a4814a192c76cb96a1b7a219de68e98ee not found: ID does not exist" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.487149 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-lfjfp" podStartSLOduration=1.647409123 podStartE2EDuration="4.486142651s" podCreationTimestamp="2025-11-21 13:54:12 +0000 UTC" firstStartedPulling="2025-11-21 13:54:13.114365979 +0000 UTC m=+7411.815027797" lastFinishedPulling="2025-11-21 13:54:15.953099497 +0000 UTC m=+7414.653761325" observedRunningTime="2025-11-21 13:54:16.478009094 +0000 UTC m=+7415.178670922" watchObservedRunningTime="2025-11-21 13:54:16.486142651 +0000 UTC m=+7415.186804489" Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.500894 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-l6762"] Nov 21 13:54:16 crc kubenswrapper[4769]: I1121 13:54:16.504758 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-l6762"] Nov 21 13:54:17 crc kubenswrapper[4769]: I1121 13:54:17.281472 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b7c8b9-280e-494c-9a9f-61d6966a25c0" path="/var/lib/kubelet/pods/29b7c8b9-280e-494c-9a9f-61d6966a25c0/volumes" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.355991 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp"] Nov 21 13:54:19 crc kubenswrapper[4769]: E1121 13:54:19.356700 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="29b7c8b9-280e-494c-9a9f-61d6966a25c0" containerName="registry-server" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.356722 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b7c8b9-280e-494c-9a9f-61d6966a25c0" containerName="registry-server" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.356866 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="29b7c8b9-280e-494c-9a9f-61d6966a25c0" containerName="registry-server" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.357967 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.359932 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.369971 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp"] Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.507976 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.508831 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgxk\" (UniqueName: \"kubernetes.io/projected/02e930af-577e-43b7-8ae6-f5e4b0b12b94-kube-api-access-ccgxk\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.508999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.610392 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.610507 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgxk\" (UniqueName: \"kubernetes.io/projected/02e930af-577e-43b7-8ae6-f5e4b0b12b94-kube-api-access-ccgxk\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.610578 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.611027 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.611107 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.634555 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgxk\" (UniqueName: \"kubernetes.io/projected/02e930af-577e-43b7-8ae6-f5e4b0b12b94-kube-api-access-ccgxk\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.681545 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:19 crc kubenswrapper[4769]: I1121 13:54:19.892402 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp"] Nov 21 13:54:20 crc kubenswrapper[4769]: I1121 13:54:20.489618 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerStarted","Data":"aff0972c125f81171ed2e0c9cc9ffe89e72bfd3c66bd8a13d941d5d590d75292"} Nov 21 13:54:20 crc kubenswrapper[4769]: I1121 13:54:20.489663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerStarted","Data":"aef8f3c596b05c5bab0414bf70998220ed0905cef690a1865236109520c93246"} Nov 21 13:54:21 crc kubenswrapper[4769]: I1121 13:54:21.502025 4769 generic.go:334] "Generic (PLEG): container finished" podID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerID="aff0972c125f81171ed2e0c9cc9ffe89e72bfd3c66bd8a13d941d5d590d75292" exitCode=0 Nov 21 13:54:21 crc kubenswrapper[4769]: I1121 13:54:21.502101 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerDied","Data":"aff0972c125f81171ed2e0c9cc9ffe89e72bfd3c66bd8a13d941d5d590d75292"} Nov 21 13:54:22 crc kubenswrapper[4769]: I1121 13:54:22.856415 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:22 crc kubenswrapper[4769]: I1121 13:54:22.856504 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:22 crc kubenswrapper[4769]: I1121 13:54:22.893925 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:23 crc kubenswrapper[4769]: I1121 13:54:23.522184 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerStarted","Data":"75c404eeb3577fb62b1c0c13dfeb5ea7561711aa0bfbc3daaf54126de43bc396"} Nov 21 13:54:23 crc kubenswrapper[4769]: I1121 13:54:23.554034 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 13:54:24 crc kubenswrapper[4769]: I1121 13:54:24.536691 4769 generic.go:334] "Generic (PLEG): container finished" podID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerID="75c404eeb3577fb62b1c0c13dfeb5ea7561711aa0bfbc3daaf54126de43bc396" exitCode=0 Nov 21 13:54:24 crc kubenswrapper[4769]: I1121 13:54:24.536790 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerDied","Data":"75c404eeb3577fb62b1c0c13dfeb5ea7561711aa0bfbc3daaf54126de43bc396"} Nov 21 13:54:25 crc kubenswrapper[4769]: I1121 13:54:25.274825 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:54:25 crc kubenswrapper[4769]: E1121 13:54:25.275344 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:54:25 crc kubenswrapper[4769]: I1121 13:54:25.565565 4769 generic.go:334] "Generic (PLEG): container finished" podID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerID="0e6318fdbb49abf620cf6d02190f86f2bfb3aa49e8079c77e3e202cd67dd9d8c" exitCode=0 Nov 21 13:54:25 crc kubenswrapper[4769]: I1121 13:54:25.565664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerDied","Data":"0e6318fdbb49abf620cf6d02190f86f2bfb3aa49e8079c77e3e202cd67dd9d8c"} Nov 21 13:54:26 crc kubenswrapper[4769]: I1121 13:54:26.995779 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.034045 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-util\") pod \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.034231 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccgxk\" (UniqueName: \"kubernetes.io/projected/02e930af-577e-43b7-8ae6-f5e4b0b12b94-kube-api-access-ccgxk\") pod \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.034300 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-bundle\") pod \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\" (UID: \"02e930af-577e-43b7-8ae6-f5e4b0b12b94\") " Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.035456 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-bundle" (OuterVolumeSpecName: "bundle") pod "02e930af-577e-43b7-8ae6-f5e4b0b12b94" (UID: "02e930af-577e-43b7-8ae6-f5e4b0b12b94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.056526 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e930af-577e-43b7-8ae6-f5e4b0b12b94-kube-api-access-ccgxk" (OuterVolumeSpecName: "kube-api-access-ccgxk") pod "02e930af-577e-43b7-8ae6-f5e4b0b12b94" (UID: "02e930af-577e-43b7-8ae6-f5e4b0b12b94"). InnerVolumeSpecName "kube-api-access-ccgxk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.135923 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ccgxk\" (UniqueName: \"kubernetes.io/projected/02e930af-577e-43b7-8ae6-f5e4b0b12b94-kube-api-access-ccgxk\") on node \"crc\" DevicePath \"\"" Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.135968 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.585054 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" event={"ID":"02e930af-577e-43b7-8ae6-f5e4b0b12b94","Type":"ContainerDied","Data":"aef8f3c596b05c5bab0414bf70998220ed0905cef690a1865236109520c93246"} Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.585603 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aef8f3c596b05c5bab0414bf70998220ed0905cef690a1865236109520c93246" Nov 21 13:54:27 crc kubenswrapper[4769]: I1121 13:54:27.585360 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.777839 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn"] Nov 21 13:54:30 crc kubenswrapper[4769]: E1121 13:54:30.778387 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="util" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.778400 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="util" Nov 21 13:54:30 crc kubenswrapper[4769]: E1121 13:54:30.778437 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="pull" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.778445 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="pull" Nov 21 13:54:30 crc kubenswrapper[4769]: E1121 13:54:30.778458 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="extract" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.778465 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="extract" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.778607 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" containerName="extract" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.779375 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.781314 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"webhook-server-cert" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.781505 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-dockercfg-mv8w2" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.782515 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-service-cert" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.789375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-webhook-cert\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.789429 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-apiservice-cert\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.789459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b574m\" (UniqueName: \"kubernetes.io/projected/4e6cd448-bb7a-42a8-8d9b-fde328121f50-kube-api-access-b574m\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.789930 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn"] Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.890604 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-webhook-cert\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.890866 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-apiservice-cert\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.890947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b574m\" (UniqueName: \"kubernetes.io/projected/4e6cd448-bb7a-42a8-8d9b-fde328121f50-kube-api-access-b574m\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.899946 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-webhook-cert\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.903553 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-apiservice-cert\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:30 crc kubenswrapper[4769]: I1121 13:54:30.908389 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b574m\" (UniqueName: \"kubernetes.io/projected/4e6cd448-bb7a-42a8-8d9b-fde328121f50-kube-api-access-b574m\") pod \"mariadb-operator-controller-manager-ccdc8969c-dvkwn\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:31 crc kubenswrapper[4769]: I1121 13:54:31.097322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:31 crc kubenswrapper[4769]: I1121 13:54:31.543298 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn"] Nov 21 13:54:31 crc kubenswrapper[4769]: I1121 13:54:31.614935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" event={"ID":"4e6cd448-bb7a-42a8-8d9b-fde328121f50","Type":"ContainerStarted","Data":"300b804f7a01af34609ba1ca3b03bf4af65506c33b45bcf6369fea1bc214886d"} Nov 21 13:54:34 crc kubenswrapper[4769]: I1121 13:54:34.637982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" event={"ID":"4e6cd448-bb7a-42a8-8d9b-fde328121f50","Type":"ContainerStarted","Data":"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229"} Nov 21 13:54:35 crc kubenswrapper[4769]: I1121 13:54:35.647532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" event={"ID":"4e6cd448-bb7a-42a8-8d9b-fde328121f50","Type":"ContainerStarted","Data":"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d"} Nov 21 13:54:35 crc kubenswrapper[4769]: I1121 13:54:35.898483 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-util" (OuterVolumeSpecName: "util") pod "02e930af-577e-43b7-8ae6-f5e4b0b12b94" (UID: "02e930af-577e-43b7-8ae6-f5e4b0b12b94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:54:35 crc kubenswrapper[4769]: I1121 13:54:35.999460 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e930af-577e-43b7-8ae6-f5e4b0b12b94-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:54:36 crc kubenswrapper[4769]: I1121 13:54:36.654231 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:36 crc kubenswrapper[4769]: I1121 13:54:36.675037 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" podStartSLOduration=6.675016616 podStartE2EDuration="6.675016616s" podCreationTimestamp="2025-11-21 13:54:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:54:36.66949907 +0000 UTC m=+7435.370160888" watchObservedRunningTime="2025-11-21 13:54:36.675016616 +0000 UTC m=+7435.375678434" Nov 21 13:54:39 crc kubenswrapper[4769]: I1121 13:54:39.275388 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:54:39 crc kubenswrapper[4769]: E1121 13:54:39.277455 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:54:41 crc kubenswrapper[4769]: I1121 13:54:41.104112 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.725737 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-f9zgt"] Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.730459 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.732587 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-index-dockercfg-m7mfw" Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.735063 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-f9zgt"] Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.785327 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8gcw\" (UniqueName: \"kubernetes.io/projected/98bbc633-5f13-477d-bf2e-f570cc47dd2c-kube-api-access-d8gcw\") pod \"infra-operator-index-f9zgt\" (UID: \"98bbc633-5f13-477d-bf2e-f570cc47dd2c\") " pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.886798 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d8gcw\" (UniqueName: \"kubernetes.io/projected/98bbc633-5f13-477d-bf2e-f570cc47dd2c-kube-api-access-d8gcw\") pod \"infra-operator-index-f9zgt\" (UID: \"98bbc633-5f13-477d-bf2e-f570cc47dd2c\") " pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:47 crc kubenswrapper[4769]: I1121 13:54:47.922281 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8gcw\" (UniqueName: \"kubernetes.io/projected/98bbc633-5f13-477d-bf2e-f570cc47dd2c-kube-api-access-d8gcw\") pod \"infra-operator-index-f9zgt\" (UID: \"98bbc633-5f13-477d-bf2e-f570cc47dd2c\") " pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:48 crc kubenswrapper[4769]: I1121 13:54:48.061266 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:48 crc kubenswrapper[4769]: I1121 13:54:48.647152 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-f9zgt"] Nov 21 13:54:48 crc kubenswrapper[4769]: W1121 13:54:48.660550 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bbc633_5f13_477d_bf2e_f570cc47dd2c.slice/crio-47ce084575d720edfe1d14dba8e629c0517849111989502aded747f66f3db675 WatchSource:0}: Error finding container 47ce084575d720edfe1d14dba8e629c0517849111989502aded747f66f3db675: Status 404 returned error can't find the container with id 47ce084575d720edfe1d14dba8e629c0517849111989502aded747f66f3db675 Nov 21 13:54:48 crc kubenswrapper[4769]: I1121 13:54:48.765096 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f9zgt" event={"ID":"98bbc633-5f13-477d-bf2e-f570cc47dd2c","Type":"ContainerStarted","Data":"47ce084575d720edfe1d14dba8e629c0517849111989502aded747f66f3db675"} Nov 21 13:54:51 crc kubenswrapper[4769]: I1121 13:54:51.815754 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f9zgt" event={"ID":"98bbc633-5f13-477d-bf2e-f570cc47dd2c","Type":"ContainerStarted","Data":"65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63"} Nov 21 13:54:51 crc kubenswrapper[4769]: I1121 13:54:51.838398 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-f9zgt" podStartSLOduration=2.399723377 podStartE2EDuration="4.838378071s" podCreationTimestamp="2025-11-21 13:54:47 +0000 UTC" firstStartedPulling="2025-11-21 13:54:48.666591495 +0000 UTC m=+7447.367253323" lastFinishedPulling="2025-11-21 13:54:51.105246189 +0000 UTC m=+7449.805908017" observedRunningTime="2025-11-21 13:54:51.83532621 +0000 UTC m=+7450.535988038" watchObservedRunningTime="2025-11-21 13:54:51.838378071 +0000 UTC m=+7450.539039889" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.146005 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.147427 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.149390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.161468 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.248738 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.248809 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.248840 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kch6\" (UniqueName: \"kubernetes.io/projected/1b45bbcc-d90e-4ef8-82de-5a1346896a65-kube-api-access-5kch6\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.350147 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.350215 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.350247 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kch6\" (UniqueName: \"kubernetes.io/projected/1b45bbcc-d90e-4ef8-82de-5a1346896a65-kube-api-access-5kch6\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.350767 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.350783 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.373562 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kch6\" (UniqueName: \"kubernetes.io/projected/1b45bbcc-d90e-4ef8-82de-5a1346896a65-kube-api-access-5kch6\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.516956 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.875331 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.878001 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.880135 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"galera-openstack-dockercfg-zschc" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.881845 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"openstack-config-data" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.888897 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"openshift-service-ca.crt" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.890599 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"kube-root-ca.crt" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.892445 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"openstack-scripts" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.902026 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.906423 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.910384 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.912100 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.915457 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.920523 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.926048 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.958619 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-operator-scripts\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.959368 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-generated\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.959775 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlpjn\" (UniqueName: \"kubernetes.io/projected/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kube-api-access-wlpjn\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.960051 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.960300 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kolla-config\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.960439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-default\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:52 crc kubenswrapper[4769]: I1121 13:54:52.978627 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn"] Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061677 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-operator-scripts\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061761 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-default\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061792 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-generated\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061821 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kolla-config\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061840 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-default\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061895 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.061919 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775n9\" (UniqueName: \"kubernetes.io/projected/9190629b-7fad-49f0-98aa-fcb76d135b26-kube-api-access-775n9\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062045 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-operator-scripts\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062138 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-default\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062159 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062198 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-generated\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062249 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tltcp\" (UniqueName: \"kubernetes.io/projected/c06ed331-7617-4e78-9973-84e0c6edead2-kube-api-access-tltcp\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wlpjn\" (UniqueName: \"kubernetes.io/projected/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kube-api-access-wlpjn\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062312 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-kolla-config\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062340 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062401 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-kolla-config\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062715 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kolla-config\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.062755 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") device mount path \"/mnt/openstack/pv04\"" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.063385 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-default\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.065517 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-operator-scripts\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.068658 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-generated\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.081147 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlpjn\" (UniqueName: \"kubernetes.io/projected/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kube-api-access-wlpjn\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.082062 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"openstack-galera-2\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163333 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-kolla-config\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163412 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-operator-scripts\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-default\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163467 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-generated\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163502 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163521 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-775n9\" (UniqueName: \"kubernetes.io/projected/9190629b-7fad-49f0-98aa-fcb76d135b26-kube-api-access-775n9\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163549 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-default\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163588 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163607 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tltcp\" (UniqueName: \"kubernetes.io/projected/c06ed331-7617-4e78-9973-84e0c6edead2-kube-api-access-tltcp\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163630 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-kolla-config\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.163649 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.164174 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-kolla-config\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.165307 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.165657 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.165774 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-operator-scripts\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.165916 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") device mount path \"/mnt/openstack/pv12\"" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.166095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-generated\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.166247 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-default\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.166335 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") device mount path \"/mnt/openstack/pv10\"" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.166721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-default\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.167569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-kolla-config\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.180245 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-775n9\" (UniqueName: \"kubernetes.io/projected/9190629b-7fad-49f0-98aa-fcb76d135b26-kube-api-access-775n9\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.185235 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"openstack-galera-0\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.189856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.192740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltcp\" (UniqueName: \"kubernetes.io/projected/c06ed331-7617-4e78-9973-84e0c6edead2-kube-api-access-tltcp\") pod \"openstack-galera-1\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.205566 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.233626 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.246080 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.476145 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.714804 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Nov 21 13:54:53 crc kubenswrapper[4769]: W1121 13:54:53.717193 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc06ed331_7617_4e78_9973_84e0c6edead2.slice/crio-f939d19ab1b8fa725dc54987c03c9e6d678f3214fc520d45f92e613e902879ba WatchSource:0}: Error finding container f939d19ab1b8fa725dc54987c03c9e6d678f3214fc520d45f92e613e902879ba: Status 404 returned error can't find the container with id f939d19ab1b8fa725dc54987c03c9e6d678f3214fc520d45f92e613e902879ba Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.778703 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.834097 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"c06ed331-7617-4e78-9973-84e0c6edead2","Type":"ContainerStarted","Data":"f939d19ab1b8fa725dc54987c03c9e6d678f3214fc520d45f92e613e902879ba"} Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.838168 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerID="63297e3cb05292fd04a0f35f3b765da200e632ad4001133a737caa2ee2b3f824" exitCode=0 Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.838266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" event={"ID":"1b45bbcc-d90e-4ef8-82de-5a1346896a65","Type":"ContainerDied","Data":"63297e3cb05292fd04a0f35f3b765da200e632ad4001133a737caa2ee2b3f824"} Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.838319 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" event={"ID":"1b45bbcc-d90e-4ef8-82de-5a1346896a65","Type":"ContainerStarted","Data":"b78b93f34844e554d07724d49e41b50d5c4eeb58ed9306d0893797463f524f21"} Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.841273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"a07bb3ef-555a-4a18-a263-a0aca7beaa72","Type":"ContainerStarted","Data":"45a81e3632f92c766bed1c49eb40e46004b30c0147ce4e10d7e48ab93076ccda"} Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.845584 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"9190629b-7fad-49f0-98aa-fcb76d135b26","Type":"ContainerStarted","Data":"1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6"} Nov 21 13:54:53 crc kubenswrapper[4769]: I1121 13:54:53.845635 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"9190629b-7fad-49f0-98aa-fcb76d135b26","Type":"ContainerStarted","Data":"27b13751e2e0df28254426195a41e1389fddf964c58f7f95cba5d6fcd8902eaa"} Nov 21 13:54:54 crc kubenswrapper[4769]: I1121 13:54:54.274076 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:54:54 crc kubenswrapper[4769]: E1121 13:54:54.274622 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:54:54 crc kubenswrapper[4769]: I1121 13:54:54.853452 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"c06ed331-7617-4e78-9973-84e0c6edead2","Type":"ContainerStarted","Data":"99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3"} Nov 21 13:54:54 crc kubenswrapper[4769]: I1121 13:54:54.855539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"a07bb3ef-555a-4a18-a263-a0aca7beaa72","Type":"ContainerStarted","Data":"d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27"} Nov 21 13:54:55 crc kubenswrapper[4769]: I1121 13:54:55.865700 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerID="5071080adb290d5b8a0413a95dac95c99ca1eecbe2b55012599bf38e435e4d56" exitCode=0 Nov 21 13:54:55 crc kubenswrapper[4769]: I1121 13:54:55.865793 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" event={"ID":"1b45bbcc-d90e-4ef8-82de-5a1346896a65","Type":"ContainerDied","Data":"5071080adb290d5b8a0413a95dac95c99ca1eecbe2b55012599bf38e435e4d56"} Nov 21 13:54:56 crc kubenswrapper[4769]: I1121 13:54:56.876520 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" event={"ID":"1b45bbcc-d90e-4ef8-82de-5a1346896a65","Type":"ContainerStarted","Data":"ad8c684ae3d6ffa83080ca4d5decb275e2c8cc3e2e37a196453d0dcc9d1904b1"} Nov 21 13:54:57 crc kubenswrapper[4769]: I1121 13:54:57.885711 4769 generic.go:334] "Generic (PLEG): container finished" podID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerID="ad8c684ae3d6ffa83080ca4d5decb275e2c8cc3e2e37a196453d0dcc9d1904b1" exitCode=0 Nov 21 13:54:57 crc kubenswrapper[4769]: I1121 13:54:57.886789 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" event={"ID":"1b45bbcc-d90e-4ef8-82de-5a1346896a65","Type":"ContainerDied","Data":"ad8c684ae3d6ffa83080ca4d5decb275e2c8cc3e2e37a196453d0dcc9d1904b1"} Nov 21 13:54:58 crc kubenswrapper[4769]: I1121 13:54:58.061512 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:58 crc kubenswrapper[4769]: I1121 13:54:58.061940 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:58 crc kubenswrapper[4769]: I1121 13:54:58.093377 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:54:58 crc kubenswrapper[4769]: I1121 13:54:58.941618 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.219649 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.375861 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-util\") pod \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.376001 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kch6\" (UniqueName: \"kubernetes.io/projected/1b45bbcc-d90e-4ef8-82de-5a1346896a65-kube-api-access-5kch6\") pod \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.376066 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-bundle\") pod \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\" (UID: \"1b45bbcc-d90e-4ef8-82de-5a1346896a65\") " Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.377243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-bundle" (OuterVolumeSpecName: "bundle") pod "1b45bbcc-d90e-4ef8-82de-5a1346896a65" (UID: "1b45bbcc-d90e-4ef8-82de-5a1346896a65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.385426 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b45bbcc-d90e-4ef8-82de-5a1346896a65-kube-api-access-5kch6" (OuterVolumeSpecName: "kube-api-access-5kch6") pod "1b45bbcc-d90e-4ef8-82de-5a1346896a65" (UID: "1b45bbcc-d90e-4ef8-82de-5a1346896a65"). InnerVolumeSpecName "kube-api-access-5kch6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.479337 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kch6\" (UniqueName: \"kubernetes.io/projected/1b45bbcc-d90e-4ef8-82de-5a1346896a65-kube-api-access-5kch6\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.479388 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.757253 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-util" (OuterVolumeSpecName: "util") pod "1b45bbcc-d90e-4ef8-82de-5a1346896a65" (UID: "1b45bbcc-d90e-4ef8-82de-5a1346896a65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.782429 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b45bbcc-d90e-4ef8-82de-5a1346896a65-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.925978 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" event={"ID":"1b45bbcc-d90e-4ef8-82de-5a1346896a65","Type":"ContainerDied","Data":"b78b93f34844e554d07724d49e41b50d5c4eeb58ed9306d0893797463f524f21"} Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.926507 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b78b93f34844e554d07724d49e41b50d5c4eeb58ed9306d0893797463f524f21" Nov 21 13:55:03 crc kubenswrapper[4769]: I1121 13:54:59.926004 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.274420 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:55:08 crc kubenswrapper[4769]: E1121 13:55:08.275209 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.301991 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86"] Nov 21 13:55:08 crc kubenswrapper[4769]: E1121 13:55:08.302261 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="extract" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.302285 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="extract" Nov 21 13:55:08 crc kubenswrapper[4769]: E1121 13:55:08.302311 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="pull" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.302317 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="pull" Nov 21 13:55:08 crc kubenswrapper[4769]: E1121 13:55:08.302338 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="util" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.302351 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="util" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.302489 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" containerName="extract" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.303131 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.308816 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-service-cert" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.308822 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-dockercfg-ltmmx" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.314341 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86"] Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.414669 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-webhook-cert\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.414733 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-apiservice-cert\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.414836 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhz2t\" (UniqueName: \"kubernetes.io/projected/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-kube-api-access-vhz2t\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.516935 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-webhook-cert\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.517006 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-apiservice-cert\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.517105 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vhz2t\" (UniqueName: \"kubernetes.io/projected/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-kube-api-access-vhz2t\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.526695 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-webhook-cert\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.539569 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-apiservice-cert\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.540781 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhz2t\" (UniqueName: \"kubernetes.io/projected/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-kube-api-access-vhz2t\") pod \"infra-operator-controller-manager-5497c88f7c-8fd86\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:08 crc kubenswrapper[4769]: I1121 13:55:08.623279 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:09 crc kubenswrapper[4769]: I1121 13:55:09.070016 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86"] Nov 21 13:55:09 crc kubenswrapper[4769]: W1121 13:55:09.075876 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1191c0e_93c8_4dc2_8e86_733cbc6976cc.slice/crio-319c48d27c2c4d4e48c8b6f5688bdb0ca192600dd2eb511f63d1a91d42900b89 WatchSource:0}: Error finding container 319c48d27c2c4d4e48c8b6f5688bdb0ca192600dd2eb511f63d1a91d42900b89: Status 404 returned error can't find the container with id 319c48d27c2c4d4e48c8b6f5688bdb0ca192600dd2eb511f63d1a91d42900b89 Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.000581 4769 generic.go:334] "Generic (PLEG): container finished" podID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerID="1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6" exitCode=0 Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.000875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"9190629b-7fad-49f0-98aa-fcb76d135b26","Type":"ContainerDied","Data":"1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6"} Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.004652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" event={"ID":"f1191c0e-93c8-4dc2-8e86-733cbc6976cc","Type":"ContainerStarted","Data":"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230"} Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.004702 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" event={"ID":"f1191c0e-93c8-4dc2-8e86-733cbc6976cc","Type":"ContainerStarted","Data":"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e"} Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.004712 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" event={"ID":"f1191c0e-93c8-4dc2-8e86-733cbc6976cc","Type":"ContainerStarted","Data":"319c48d27c2c4d4e48c8b6f5688bdb0ca192600dd2eb511f63d1a91d42900b89"} Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.004928 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:10 crc kubenswrapper[4769]: I1121 13:55:10.055753 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" podStartSLOduration=2.055729212 podStartE2EDuration="2.055729212s" podCreationTimestamp="2025-11-21 13:55:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:55:10.055246359 +0000 UTC m=+7468.755908177" watchObservedRunningTime="2025-11-21 13:55:10.055729212 +0000 UTC m=+7468.756391030" Nov 21 13:55:11 crc kubenswrapper[4769]: I1121 13:55:11.013289 4769 generic.go:334] "Generic (PLEG): container finished" podID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerID="d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27" exitCode=0 Nov 21 13:55:11 crc kubenswrapper[4769]: I1121 13:55:11.013483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"a07bb3ef-555a-4a18-a263-a0aca7beaa72","Type":"ContainerDied","Data":"d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27"} Nov 21 13:55:11 crc kubenswrapper[4769]: I1121 13:55:11.016417 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"9190629b-7fad-49f0-98aa-fcb76d135b26","Type":"ContainerStarted","Data":"e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce"} Nov 21 13:55:11 crc kubenswrapper[4769]: I1121 13:55:11.018151 4769 generic.go:334] "Generic (PLEG): container finished" podID="c06ed331-7617-4e78-9973-84e0c6edead2" containerID="99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3" exitCode=0 Nov 21 13:55:11 crc kubenswrapper[4769]: I1121 13:55:11.018236 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"c06ed331-7617-4e78-9973-84e0c6edead2","Type":"ContainerDied","Data":"99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3"} Nov 21 13:55:11 crc kubenswrapper[4769]: I1121 13:55:11.064344 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstack-galera-0" podStartSLOduration=20.064324098 podStartE2EDuration="20.064324098s" podCreationTimestamp="2025-11-21 13:54:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:55:11.063108166 +0000 UTC m=+7469.763769994" watchObservedRunningTime="2025-11-21 13:55:11.064324098 +0000 UTC m=+7469.764985916" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.026632 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"c06ed331-7617-4e78-9973-84e0c6edead2","Type":"ContainerStarted","Data":"2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4"} Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.029620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"a07bb3ef-555a-4a18-a263-a0aca7beaa72","Type":"ContainerStarted","Data":"26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5"} Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.050250 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstack-galera-1" podStartSLOduration=21.05022861 podStartE2EDuration="21.05022861s" podCreationTimestamp="2025-11-21 13:54:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:55:12.047396124 +0000 UTC m=+7470.748057942" watchObservedRunningTime="2025-11-21 13:55:12.05022861 +0000 UTC m=+7470.750890428" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.066975 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstack-galera-2" podStartSLOduration=21.066946345 podStartE2EDuration="21.066946345s" podCreationTimestamp="2025-11-21 13:54:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:55:12.06677299 +0000 UTC m=+7470.767434808" watchObservedRunningTime="2025-11-21 13:55:12.066946345 +0000 UTC m=+7470.767608193" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.479456 4769 scope.go:117] "RemoveContainer" containerID="fcc7ef1438cbb8fe6cdcf5735c2c220a8956a878a914b699eba4ed4a77c8fdc7" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.502204 4769 scope.go:117] "RemoveContainer" containerID="c95d225a053ff320a584beaba4f27aad94b814661521f32cf2b0f2d2a673daab" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.522182 4769 scope.go:117] "RemoveContainer" containerID="33f276e25b4fbc174707cce16354770d8f8d799783c6a0281258d839fb34ee4b" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.552334 4769 scope.go:117] "RemoveContainer" containerID="6f2014cd65e3354bf4108432d8b8044b2494c6d824d8b57fa8f2df063efcfe8a" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.571256 4769 scope.go:117] "RemoveContainer" containerID="b5ae42361a36ce0ab1ae6c28bc3e6ffba175db903166f0eecc3f3f172b75a97e" Nov 21 13:55:12 crc kubenswrapper[4769]: I1121 13:55:12.602084 4769 scope.go:117] "RemoveContainer" containerID="e6769a2d7ee15b61cde66b71643ba974667ff2fa5bb55e8e39debcd791968a10" Nov 21 13:55:13 crc kubenswrapper[4769]: I1121 13:55:13.206610 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:55:13 crc kubenswrapper[4769]: I1121 13:55:13.206907 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:55:13 crc kubenswrapper[4769]: I1121 13:55:13.234641 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:55:13 crc kubenswrapper[4769]: I1121 13:55:13.234707 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:55:13 crc kubenswrapper[4769]: I1121 13:55:13.248363 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:55:13 crc kubenswrapper[4769]: I1121 13:55:13.248412 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:55:18 crc kubenswrapper[4769]: I1121 13:55:18.638921 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.120101 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-2gfxq"] Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.121991 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.132763 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-2gfxq"] Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.189971 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-catalog-content\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.190083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ppl\" (UniqueName: \"kubernetes.io/projected/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-kube-api-access-j2ppl\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.190152 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-utilities\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.292481 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-utilities\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.292614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-catalog-content\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.292735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ppl\" (UniqueName: \"kubernetes.io/projected/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-kube-api-access-j2ppl\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.293285 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-utilities\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.293624 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-catalog-content\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.322897 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ppl\" (UniqueName: \"kubernetes.io/projected/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-kube-api-access-j2ppl\") pod \"redhat-marketplace-2gfxq\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.460599 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:20 crc kubenswrapper[4769]: I1121 13:55:20.942601 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-2gfxq"] Nov 21 13:55:20 crc kubenswrapper[4769]: W1121 13:55:20.946533 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e80ba94_6b5d_4afd_ab97_a52dd6b3f7b5.slice/crio-fcdb2ecbaee8c490352221fcf0363d68b8849b271b62406fb64026eee2fedb6b WatchSource:0}: Error finding container fcdb2ecbaee8c490352221fcf0363d68b8849b271b62406fb64026eee2fedb6b: Status 404 returned error can't find the container with id fcdb2ecbaee8c490352221fcf0363d68b8849b271b62406fb64026eee2fedb6b Nov 21 13:55:21 crc kubenswrapper[4769]: I1121 13:55:21.108564 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2gfxq" event={"ID":"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5","Type":"ContainerStarted","Data":"fcdb2ecbaee8c490352221fcf0363d68b8849b271b62406fb64026eee2fedb6b"} Nov 21 13:55:22 crc kubenswrapper[4769]: I1121 13:55:22.116790 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerID="8abad080b5db539e664b0a6c25f04510a538bdc5fe83e13f216809524d4a552c" exitCode=0 Nov 21 13:55:22 crc kubenswrapper[4769]: I1121 13:55:22.116866 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2gfxq" event={"ID":"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5","Type":"ContainerDied","Data":"8abad080b5db539e664b0a6c25f04510a538bdc5fe83e13f216809524d4a552c"} Nov 21 13:55:22 crc kubenswrapper[4769]: I1121 13:55:22.273750 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:55:22 crc kubenswrapper[4769]: E1121 13:55:22.274413 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:55:23 crc kubenswrapper[4769]: I1121 13:55:23.368061 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:55:23 crc kubenswrapper[4769]: I1121 13:55:23.457774 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.131517 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerID="74c0f017ab1e3e3c4a293be24afeff6a9b203e8054e66743c0656432538990c2" exitCode=0 Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.131578 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2gfxq" event={"ID":"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5","Type":"ContainerDied","Data":"74c0f017ab1e3e3c4a293be24afeff6a9b203e8054e66743c0656432538990c2"} Nov 21 13:55:24 crc kubenswrapper[4769]: E1121 13:55:24.304842 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:54890->38.102.83.227:40411: write tcp 38.102.83.227:54890->38.102.83.227:40411: write: connection reset by peer Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.710875 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-njng6"] Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.712029 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.714177 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-index-dockercfg-xsbhb" Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.719896 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-njng6"] Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.854695 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsl4l\" (UniqueName: \"kubernetes.io/projected/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0-kube-api-access-jsl4l\") pod \"rabbitmq-cluster-operator-index-njng6\" (UID: \"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0\") " pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.956314 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jsl4l\" (UniqueName: \"kubernetes.io/projected/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0-kube-api-access-jsl4l\") pod \"rabbitmq-cluster-operator-index-njng6\" (UID: \"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0\") " pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:24 crc kubenswrapper[4769]: I1121 13:55:24.976226 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsl4l\" (UniqueName: \"kubernetes.io/projected/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0-kube-api-access-jsl4l\") pod \"rabbitmq-cluster-operator-index-njng6\" (UID: \"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0\") " pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:25 crc kubenswrapper[4769]: I1121 13:55:25.034300 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:25 crc kubenswrapper[4769]: I1121 13:55:25.165263 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2gfxq" event={"ID":"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5","Type":"ContainerStarted","Data":"82db650b0ac94b227ee16f93a63d22b1183a2d5782ff1df3cd9dbaa99089964b"} Nov 21 13:55:25 crc kubenswrapper[4769]: I1121 13:55:25.197109 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-2gfxq" podStartSLOduration=2.574781927 podStartE2EDuration="5.197093s" podCreationTimestamp="2025-11-21 13:55:20 +0000 UTC" firstStartedPulling="2025-11-21 13:55:22.118575949 +0000 UTC m=+7480.819237767" lastFinishedPulling="2025-11-21 13:55:24.740887022 +0000 UTC m=+7483.441548840" observedRunningTime="2025-11-21 13:55:25.194269904 +0000 UTC m=+7483.894931722" watchObservedRunningTime="2025-11-21 13:55:25.197093 +0000 UTC m=+7483.897754818" Nov 21 13:55:25 crc kubenswrapper[4769]: I1121 13:55:25.620221 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-njng6"] Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.172556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" event={"ID":"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0","Type":"ContainerStarted","Data":"d5cc66947fce024684a549b0d83e23de7f27b0be3c6f3eb1b416e0e7c3e10f1e"} Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.670046 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/memcached-0"] Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.671036 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.674676 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"memcached-memcached-dockercfg-n27mf" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.674701 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"memcached-config-data" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.688441 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.781875 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-kolla-config\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.781935 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4f8\" (UniqueName: \"kubernetes.io/projected/205da75e-a431-4a06-9ead-aa1edb28adec-kube-api-access-nk4f8\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.782181 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-config-data\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.883552 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-config-data\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.883659 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-kolla-config\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.883692 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4f8\" (UniqueName: \"kubernetes.io/projected/205da75e-a431-4a06-9ead-aa1edb28adec-kube-api-access-nk4f8\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.884488 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-kolla-config\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.884506 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-config-data\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.912939 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4f8\" (UniqueName: \"kubernetes.io/projected/205da75e-a431-4a06-9ead-aa1edb28adec-kube-api-access-nk4f8\") pod \"memcached-0\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:26 crc kubenswrapper[4769]: I1121 13:55:26.988840 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:27 crc kubenswrapper[4769]: I1121 13:55:27.179425 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" event={"ID":"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0","Type":"ContainerStarted","Data":"db9e6c27cbc83060984125de96005adef8fd9405f51465c2687bf8dc43a394c8"} Nov 21 13:55:27 crc kubenswrapper[4769]: I1121 13:55:27.258708 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" podStartSLOduration=1.98423676 podStartE2EDuration="3.258687783s" podCreationTimestamp="2025-11-21 13:55:24 +0000 UTC" firstStartedPulling="2025-11-21 13:55:25.638671348 +0000 UTC m=+7484.339333166" lastFinishedPulling="2025-11-21 13:55:26.913122371 +0000 UTC m=+7485.613784189" observedRunningTime="2025-11-21 13:55:27.194479483 +0000 UTC m=+7485.895141301" watchObservedRunningTime="2025-11-21 13:55:27.258687783 +0000 UTC m=+7485.959349611" Nov 21 13:55:27 crc kubenswrapper[4769]: I1121 13:55:27.263527 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Nov 21 13:55:27 crc kubenswrapper[4769]: W1121 13:55:27.272635 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod205da75e_a431_4a06_9ead_aa1edb28adec.slice/crio-808e0d73ed42b3283bc5070bb219f0817db38bebc6176cac621ed2a7b1c8bc14 WatchSource:0}: Error finding container 808e0d73ed42b3283bc5070bb219f0817db38bebc6176cac621ed2a7b1c8bc14: Status 404 returned error can't find the container with id 808e0d73ed42b3283bc5070bb219f0817db38bebc6176cac621ed2a7b1c8bc14 Nov 21 13:55:28 crc kubenswrapper[4769]: I1121 13:55:28.189317 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"205da75e-a431-4a06-9ead-aa1edb28adec","Type":"ContainerStarted","Data":"fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca"} Nov 21 13:55:28 crc kubenswrapper[4769]: I1121 13:55:28.190378 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"205da75e-a431-4a06-9ead-aa1edb28adec","Type":"ContainerStarted","Data":"808e0d73ed42b3283bc5070bb219f0817db38bebc6176cac621ed2a7b1c8bc14"} Nov 21 13:55:29 crc kubenswrapper[4769]: I1121 13:55:29.195755 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:29 crc kubenswrapper[4769]: I1121 13:55:29.221188 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/memcached-0" podStartSLOduration=3.221154309 podStartE2EDuration="3.221154309s" podCreationTimestamp="2025-11-21 13:55:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:55:29.217165873 +0000 UTC m=+7487.917827701" watchObservedRunningTime="2025-11-21 13:55:29.221154309 +0000 UTC m=+7487.921816137" Nov 21 13:55:30 crc kubenswrapper[4769]: I1121 13:55:30.461451 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:30 crc kubenswrapper[4769]: I1121 13:55:30.461958 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:30 crc kubenswrapper[4769]: I1121 13:55:30.516888 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:30 crc kubenswrapper[4769]: I1121 13:55:30.705405 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-njng6"] Nov 21 13:55:30 crc kubenswrapper[4769]: I1121 13:55:30.705622 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" podUID="ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" containerName="registry-server" containerID="cri-o://db9e6c27cbc83060984125de96005adef8fd9405f51465c2687bf8dc43a394c8" gracePeriod=2 Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.212273 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" containerID="db9e6c27cbc83060984125de96005adef8fd9405f51465c2687bf8dc43a394c8" exitCode=0 Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.212464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" event={"ID":"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0","Type":"ContainerDied","Data":"db9e6c27cbc83060984125de96005adef8fd9405f51465c2687bf8dc43a394c8"} Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.253778 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.550474 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-b2fcv"] Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.553536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.566957 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.569306 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pddq4\" (UniqueName: \"kubernetes.io/projected/f228d7fc-351a-4ecf-b21a-6728a6a61e55-kube-api-access-pddq4\") pod \"rabbitmq-cluster-operator-index-b2fcv\" (UID: \"f228d7fc-351a-4ecf-b21a-6728a6a61e55\") " pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.573078 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-b2fcv"] Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.651862 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.670176 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pddq4\" (UniqueName: \"kubernetes.io/projected/f228d7fc-351a-4ecf-b21a-6728a6a61e55-kube-api-access-pddq4\") pod \"rabbitmq-cluster-operator-index-b2fcv\" (UID: \"f228d7fc-351a-4ecf-b21a-6728a6a61e55\") " pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.686313 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.694215 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pddq4\" (UniqueName: \"kubernetes.io/projected/f228d7fc-351a-4ecf-b21a-6728a6a61e55-kube-api-access-pddq4\") pod \"rabbitmq-cluster-operator-index-b2fcv\" (UID: \"f228d7fc-351a-4ecf-b21a-6728a6a61e55\") " pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.875037 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsl4l\" (UniqueName: \"kubernetes.io/projected/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0-kube-api-access-jsl4l\") pod \"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0\" (UID: \"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0\") " Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.891149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0-kube-api-access-jsl4l" (OuterVolumeSpecName: "kube-api-access-jsl4l") pod "ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" (UID: "ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0"). InnerVolumeSpecName "kube-api-access-jsl4l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.894514 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:31 crc kubenswrapper[4769]: I1121 13:55:31.977299 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-jsl4l\" (UniqueName: \"kubernetes.io/projected/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0-kube-api-access-jsl4l\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.224496 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" event={"ID":"ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0","Type":"ContainerDied","Data":"d5cc66947fce024684a549b0d83e23de7f27b0be3c6f3eb1b416e0e7c3e10f1e"} Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.224769 4769 scope.go:117] "RemoveContainer" containerID="db9e6c27cbc83060984125de96005adef8fd9405f51465c2687bf8dc43a394c8" Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.224769 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-njng6" Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.257462 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-njng6"] Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.262350 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-njng6"] Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.328861 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-b2fcv"] Nov 21 13:55:32 crc kubenswrapper[4769]: W1121 13:55:32.338791 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf228d7fc_351a_4ecf_b21a_6728a6a61e55.slice/crio-08e7a25bbacee5d4a2b23d941336dee2c66c71a95173aeb06445c2c0860dbd57 WatchSource:0}: Error finding container 08e7a25bbacee5d4a2b23d941336dee2c66c71a95173aeb06445c2c0860dbd57: Status 404 returned error can't find the container with id 08e7a25bbacee5d4a2b23d941336dee2c66c71a95173aeb06445c2c0860dbd57 Nov 21 13:55:32 crc kubenswrapper[4769]: I1121 13:55:32.907293 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-2gfxq"] Nov 21 13:55:33 crc kubenswrapper[4769]: I1121 13:55:33.232626 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" event={"ID":"f228d7fc-351a-4ecf-b21a-6728a6a61e55","Type":"ContainerStarted","Data":"08e7a25bbacee5d4a2b23d941336dee2c66c71a95173aeb06445c2c0860dbd57"} Nov 21 13:55:33 crc kubenswrapper[4769]: I1121 13:55:33.283891 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" path="/var/lib/kubelet/pods/ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0/volumes" Nov 21 13:55:33 crc kubenswrapper[4769]: E1121 13:55:33.673472 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:54982->38.102.83.227:40411: write tcp 38.102.83.227:54982->38.102.83.227:40411: write: broken pipe Nov 21 13:55:34 crc kubenswrapper[4769]: I1121 13:55:34.242771 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" event={"ID":"f228d7fc-351a-4ecf-b21a-6728a6a61e55","Type":"ContainerStarted","Data":"10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de"} Nov 21 13:55:34 crc kubenswrapper[4769]: I1121 13:55:34.242944 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-2gfxq" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="registry-server" containerID="cri-o://82db650b0ac94b227ee16f93a63d22b1183a2d5782ff1df3cd9dbaa99089964b" gracePeriod=2 Nov 21 13:55:34 crc kubenswrapper[4769]: I1121 13:55:34.271379 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" podStartSLOduration=2.5734873179999997 podStartE2EDuration="3.27135918s" podCreationTimestamp="2025-11-21 13:55:31 +0000 UTC" firstStartedPulling="2025-11-21 13:55:32.341555397 +0000 UTC m=+7491.042217215" lastFinishedPulling="2025-11-21 13:55:33.039427259 +0000 UTC m=+7491.740089077" observedRunningTime="2025-11-21 13:55:34.264821546 +0000 UTC m=+7492.965483374" watchObservedRunningTime="2025-11-21 13:55:34.27135918 +0000 UTC m=+7492.972021008" Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.252810 4769 generic.go:334] "Generic (PLEG): container finished" podID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerID="82db650b0ac94b227ee16f93a63d22b1183a2d5782ff1df3cd9dbaa99089964b" exitCode=0 Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.252899 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2gfxq" event={"ID":"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5","Type":"ContainerDied","Data":"82db650b0ac94b227ee16f93a63d22b1183a2d5782ff1df3cd9dbaa99089964b"} Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.749388 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.942526 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2ppl\" (UniqueName: \"kubernetes.io/projected/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-kube-api-access-j2ppl\") pod \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.942848 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-utilities\") pod \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.943087 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-catalog-content\") pod \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\" (UID: \"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5\") " Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.944119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-utilities" (OuterVolumeSpecName: "utilities") pod "0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" (UID: "0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.952880 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-kube-api-access-j2ppl" (OuterVolumeSpecName: "kube-api-access-j2ppl") pod "0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" (UID: "0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5"). InnerVolumeSpecName "kube-api-access-j2ppl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:55:35 crc kubenswrapper[4769]: I1121 13:55:35.961410 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" (UID: "0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.044596 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.044648 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j2ppl\" (UniqueName: \"kubernetes.io/projected/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-kube-api-access-j2ppl\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.044665 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.263940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-2gfxq" event={"ID":"0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5","Type":"ContainerDied","Data":"fcdb2ecbaee8c490352221fcf0363d68b8849b271b62406fb64026eee2fedb6b"} Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.264002 4769 scope.go:117] "RemoveContainer" containerID="82db650b0ac94b227ee16f93a63d22b1183a2d5782ff1df3cd9dbaa99089964b" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.264068 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-2gfxq" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.292309 4769 scope.go:117] "RemoveContainer" containerID="74c0f017ab1e3e3c4a293be24afeff6a9b203e8054e66743c0656432538990c2" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.312466 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-2gfxq"] Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.319745 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-2gfxq"] Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.344942 4769 scope.go:117] "RemoveContainer" containerID="8abad080b5db539e664b0a6c25f04510a538bdc5fe83e13f216809524d4a552c" Nov 21 13:55:36 crc kubenswrapper[4769]: I1121 13:55:36.990370 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/memcached-0" Nov 21 13:55:37 crc kubenswrapper[4769]: I1121 13:55:37.219151 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:55:37 crc kubenswrapper[4769]: I1121 13:55:37.273613 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:55:37 crc kubenswrapper[4769]: E1121 13:55:37.273868 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:55:37 crc kubenswrapper[4769]: I1121 13:55:37.280554 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" path="/var/lib/kubelet/pods/0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5/volumes" Nov 21 13:55:37 crc kubenswrapper[4769]: I1121 13:55:37.299311 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 13:55:41 crc kubenswrapper[4769]: I1121 13:55:41.895345 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:41 crc kubenswrapper[4769]: I1121 13:55:41.895927 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:41 crc kubenswrapper[4769]: I1121 13:55:41.923014 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:42 crc kubenswrapper[4769]: I1121 13:55:42.341523 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 13:55:49 crc kubenswrapper[4769]: I1121 13:55:49.273657 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:55:49 crc kubenswrapper[4769]: E1121 13:55:49.274115 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.099855 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-9xskm"] Nov 21 13:55:53 crc kubenswrapper[4769]: E1121 13:55:53.101111 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="extract-utilities" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.101136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="extract-utilities" Nov 21 13:55:53 crc kubenswrapper[4769]: E1121 13:55:53.101156 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" containerName="registry-server" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.101168 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" containerName="registry-server" Nov 21 13:55:53 crc kubenswrapper[4769]: E1121 13:55:53.101232 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="extract-content" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.101241 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="extract-content" Nov 21 13:55:53 crc kubenswrapper[4769]: E1121 13:55:53.101262 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="registry-server" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.101270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="registry-server" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.101475 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0e80ba94-6b5d-4afd-ab97-a52dd6b3f7b5" containerName="registry-server" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.101500 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad77cbc0-7ca1-4d87-b451-68dc4d5ffeb0" containerName="registry-server" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.102785 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.115397 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-9xskm"] Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.207449 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-utilities\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.207519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmtp\" (UniqueName: \"kubernetes.io/projected/261b9f8c-d9c5-46dd-92ba-f41c8140a733-kube-api-access-tfmtp\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.207905 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-catalog-content\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.309402 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-catalog-content\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.309475 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-utilities\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.309516 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmtp\" (UniqueName: \"kubernetes.io/projected/261b9f8c-d9c5-46dd-92ba-f41c8140a733-kube-api-access-tfmtp\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.310087 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-catalog-content\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.310256 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-utilities\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.335148 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmtp\" (UniqueName: \"kubernetes.io/projected/261b9f8c-d9c5-46dd-92ba-f41c8140a733-kube-api-access-tfmtp\") pod \"certified-operators-9xskm\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.426360 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:55:53 crc kubenswrapper[4769]: I1121 13:55:53.928554 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-9xskm"] Nov 21 13:55:54 crc kubenswrapper[4769]: I1121 13:55:54.393541 4769 generic.go:334] "Generic (PLEG): container finished" podID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerID="f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b" exitCode=0 Nov 21 13:55:54 crc kubenswrapper[4769]: I1121 13:55:54.393861 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9xskm" event={"ID":"261b9f8c-d9c5-46dd-92ba-f41c8140a733","Type":"ContainerDied","Data":"f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b"} Nov 21 13:55:54 crc kubenswrapper[4769]: I1121 13:55:54.393891 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9xskm" event={"ID":"261b9f8c-d9c5-46dd-92ba-f41c8140a733","Type":"ContainerStarted","Data":"676d1581ea951e0c8a697a27cece13ade16e7189798c6b296c2a4a26e93bca21"} Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.115823 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22"] Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.117510 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.119925 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.129980 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22"] Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.255242 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.255339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdzb7\" (UniqueName: \"kubernetes.io/projected/291f2275-608b-4bf9-b27f-1726bd790e66-kube-api-access-sdzb7\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.255452 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.356843 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.356924 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sdzb7\" (UniqueName: \"kubernetes.io/projected/291f2275-608b-4bf9-b27f-1726bd790e66-kube-api-access-sdzb7\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.356963 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.357647 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.357740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.384559 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdzb7\" (UniqueName: \"kubernetes.io/projected/291f2275-608b-4bf9-b27f-1726bd790e66-kube-api-access-sdzb7\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.436632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:55:58 crc kubenswrapper[4769]: I1121 13:55:58.862721 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22"] Nov 21 13:55:58 crc kubenswrapper[4769]: W1121 13:55:58.867633 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291f2275_608b_4bf9_b27f_1726bd790e66.slice/crio-4cd2656474a5b7b803f0b1d92db290a44e96c1c330ad8f57ab90a8b59f3f5e62 WatchSource:0}: Error finding container 4cd2656474a5b7b803f0b1d92db290a44e96c1c330ad8f57ab90a8b59f3f5e62: Status 404 returned error can't find the container with id 4cd2656474a5b7b803f0b1d92db290a44e96c1c330ad8f57ab90a8b59f3f5e62 Nov 21 13:55:59 crc kubenswrapper[4769]: I1121 13:55:59.435314 4769 generic.go:334] "Generic (PLEG): container finished" podID="291f2275-608b-4bf9-b27f-1726bd790e66" containerID="b57031a21f523e830cf90b59c4372ed328d3b2edae5c28903a77490d7bc957e7" exitCode=0 Nov 21 13:55:59 crc kubenswrapper[4769]: I1121 13:55:59.435364 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" event={"ID":"291f2275-608b-4bf9-b27f-1726bd790e66","Type":"ContainerDied","Data":"b57031a21f523e830cf90b59c4372ed328d3b2edae5c28903a77490d7bc957e7"} Nov 21 13:55:59 crc kubenswrapper[4769]: I1121 13:55:59.435395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" event={"ID":"291f2275-608b-4bf9-b27f-1726bd790e66","Type":"ContainerStarted","Data":"4cd2656474a5b7b803f0b1d92db290a44e96c1c330ad8f57ab90a8b59f3f5e62"} Nov 21 13:56:01 crc kubenswrapper[4769]: I1121 13:56:01.452848 4769 generic.go:334] "Generic (PLEG): container finished" podID="291f2275-608b-4bf9-b27f-1726bd790e66" containerID="37ffcd01ad1d2c3497630a50efc364bb43a62489f64cbb2b987ed22138ca93e6" exitCode=0 Nov 21 13:56:01 crc kubenswrapper[4769]: I1121 13:56:01.452949 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" event={"ID":"291f2275-608b-4bf9-b27f-1726bd790e66","Type":"ContainerDied","Data":"37ffcd01ad1d2c3497630a50efc364bb43a62489f64cbb2b987ed22138ca93e6"} Nov 21 13:56:02 crc kubenswrapper[4769]: I1121 13:56:02.464565 4769 generic.go:334] "Generic (PLEG): container finished" podID="291f2275-608b-4bf9-b27f-1726bd790e66" containerID="0665530dd94e6f4eb211e465b9a80bc847a8cef6853a73b73265dee7598811d5" exitCode=0 Nov 21 13:56:02 crc kubenswrapper[4769]: I1121 13:56:02.464615 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" event={"ID":"291f2275-608b-4bf9-b27f-1726bd790e66","Type":"ContainerDied","Data":"0665530dd94e6f4eb211e465b9a80bc847a8cef6853a73b73265dee7598811d5"} Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.780128 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.938492 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdzb7\" (UniqueName: \"kubernetes.io/projected/291f2275-608b-4bf9-b27f-1726bd790e66-kube-api-access-sdzb7\") pod \"291f2275-608b-4bf9-b27f-1726bd790e66\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.938579 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-util\") pod \"291f2275-608b-4bf9-b27f-1726bd790e66\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.938654 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-bundle\") pod \"291f2275-608b-4bf9-b27f-1726bd790e66\" (UID: \"291f2275-608b-4bf9-b27f-1726bd790e66\") " Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.939322 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-bundle" (OuterVolumeSpecName: "bundle") pod "291f2275-608b-4bf9-b27f-1726bd790e66" (UID: "291f2275-608b-4bf9-b27f-1726bd790e66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.945498 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291f2275-608b-4bf9-b27f-1726bd790e66-kube-api-access-sdzb7" (OuterVolumeSpecName: "kube-api-access-sdzb7") pod "291f2275-608b-4bf9-b27f-1726bd790e66" (UID: "291f2275-608b-4bf9-b27f-1726bd790e66"). InnerVolumeSpecName "kube-api-access-sdzb7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:56:03 crc kubenswrapper[4769]: I1121 13:56:03.977868 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-util" (OuterVolumeSpecName: "util") pod "291f2275-608b-4bf9-b27f-1726bd790e66" (UID: "291f2275-608b-4bf9-b27f-1726bd790e66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.040554 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sdzb7\" (UniqueName: \"kubernetes.io/projected/291f2275-608b-4bf9-b27f-1726bd790e66-kube-api-access-sdzb7\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.040589 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.040600 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/291f2275-608b-4bf9-b27f-1726bd790e66-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.275044 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:56:04 crc kubenswrapper[4769]: E1121 13:56:04.275329 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.481061 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" event={"ID":"291f2275-608b-4bf9-b27f-1726bd790e66","Type":"ContainerDied","Data":"4cd2656474a5b7b803f0b1d92db290a44e96c1c330ad8f57ab90a8b59f3f5e62"} Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.481105 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cd2656474a5b7b803f0b1d92db290a44e96c1c330ad8f57ab90a8b59f3f5e62" Nov 21 13:56:04 crc kubenswrapper[4769]: I1121 13:56:04.481117 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22" Nov 21 13:56:04 crc kubenswrapper[4769]: E1121 13:56:04.570571 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = initializing source docker://registry.redhat.io/redhat/certified-operator-index:v4.18: reading manifest v4.18 in registry.redhat.io/redhat/certified-operator-index: received unexpected HTTP status: 504 Gateway Timeout" image="registry.redhat.io/redhat/certified-operator-index:v4.18" Nov 21 13:56:04 crc kubenswrapper[4769]: E1121 13:56:04.570779 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="init container &Container{Name:extract-content,Image:registry.redhat.io/redhat/certified-operator-index:v4.18,Command:[/utilities/copy-content],Args:[--catalog.from=/configs --catalog.to=/extracted-catalog/catalog --cache.from=/tmp/cache --cache.to=/extracted-catalog/cache],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:utilities,ReadOnly:false,MountPath:/utilities,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:catalog-content,ReadOnly:false,MountPath:/extracted-catalog,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-tfmtp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000170000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod certified-operators-9xskm_openshift-marketplace(261b9f8c-d9c5-46dd-92ba-f41c8140a733): ErrImagePull: initializing source docker://registry.redhat.io/redhat/certified-operator-index:v4.18: reading manifest v4.18 in registry.redhat.io/redhat/certified-operator-index: received unexpected HTTP status: 504 Gateway Timeout" logger="UnhandledError" Nov 21 13:56:04 crc kubenswrapper[4769]: E1121 13:56:04.572069 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ErrImagePull: \"initializing source docker://registry.redhat.io/redhat/certified-operator-index:v4.18: reading manifest v4.18 in registry.redhat.io/redhat/certified-operator-index: received unexpected HTTP status: 504 Gateway Timeout\"" pod="openshift-marketplace/certified-operators-9xskm" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" Nov 21 13:56:05 crc kubenswrapper[4769]: E1121 13:56:05.490773 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"extract-content\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/redhat/certified-operator-index:v4.18\\\"\"" pod="openshift-marketplace/certified-operators-9xskm" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.676620 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x"] Nov 21 13:56:12 crc kubenswrapper[4769]: E1121 13:56:12.677562 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="util" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.677578 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="util" Nov 21 13:56:12 crc kubenswrapper[4769]: E1121 13:56:12.677597 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="pull" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.677605 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="pull" Nov 21 13:56:12 crc kubenswrapper[4769]: E1121 13:56:12.677628 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="extract" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.677637 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="extract" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.677798 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" containerName="extract" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.678433 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.681610 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-dockercfg-8v22m" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.694851 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x"] Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.696277 4769 scope.go:117] "RemoveContainer" containerID="27ed39fbe1dbc2732a48e5ee284f0de0ff1a0cfc22164ffc1203b7eaa3c9c828" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.731656 4769 scope.go:117] "RemoveContainer" containerID="b57a9f8820257c6504fa78af2041e440951e0372fc6fd44b3fa76e8a77433135" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.755886 4769 scope.go:117] "RemoveContainer" containerID="72f4c15309c134a01b653c56c5244a6427672d0065823782933622f03bc194b6" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.776897 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jf2\" (UniqueName: \"kubernetes.io/projected/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe-kube-api-access-88jf2\") pod \"rabbitmq-cluster-operator-779fc9694b-nqw6x\" (UID: \"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.778880 4769 scope.go:117] "RemoveContainer" containerID="3e84783e32e57ca138eeddd0854372af74432f420ce654ae264a27c72eaa256d" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.843959 4769 scope.go:117] "RemoveContainer" containerID="8f5271f387acdc3e7388c87a96df494ec548f5a11b16b111c786a71afe4ddaa7" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.878814 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-88jf2\" (UniqueName: \"kubernetes.io/projected/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe-kube-api-access-88jf2\") pod \"rabbitmq-cluster-operator-779fc9694b-nqw6x\" (UID: \"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 13:56:12 crc kubenswrapper[4769]: I1121 13:56:12.903623 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jf2\" (UniqueName: \"kubernetes.io/projected/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe-kube-api-access-88jf2\") pod \"rabbitmq-cluster-operator-779fc9694b-nqw6x\" (UID: \"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 13:56:13 crc kubenswrapper[4769]: I1121 13:56:13.007774 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 13:56:13 crc kubenswrapper[4769]: I1121 13:56:13.422300 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x"] Nov 21 13:56:13 crc kubenswrapper[4769]: W1121 13:56:13.427913 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb5b9d1e1_ee4c_4a6d_b0fa_d37ff6392ebe.slice/crio-f89f721f14e7c1201ff5c4f14aa882f635105db395c97602ccfb9c1a8109d335 WatchSource:0}: Error finding container f89f721f14e7c1201ff5c4f14aa882f635105db395c97602ccfb9c1a8109d335: Status 404 returned error can't find the container with id f89f721f14e7c1201ff5c4f14aa882f635105db395c97602ccfb9c1a8109d335 Nov 21 13:56:13 crc kubenswrapper[4769]: I1121 13:56:13.553052 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" event={"ID":"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe","Type":"ContainerStarted","Data":"f89f721f14e7c1201ff5c4f14aa882f635105db395c97602ccfb9c1a8109d335"} Nov 21 13:56:14 crc kubenswrapper[4769]: I1121 13:56:14.562081 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" event={"ID":"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe","Type":"ContainerStarted","Data":"043cc7886fa5a7458bd508b7eb71bbb8401a3dbf22d766f358b8556071195fff"} Nov 21 13:56:14 crc kubenswrapper[4769]: I1121 13:56:14.582352 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" podStartSLOduration=2.582333979 podStartE2EDuration="2.582333979s" podCreationTimestamp="2025-11-21 13:56:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:56:14.580024588 +0000 UTC m=+7533.280686406" watchObservedRunningTime="2025-11-21 13:56:14.582333979 +0000 UTC m=+7533.282995807" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.277580 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:56:19 crc kubenswrapper[4769]: E1121 13:56:19.278502 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.291907 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-mtjh4"] Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.293543 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.296652 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-index-dockercfg-ggkx8" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.298260 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-mtjh4"] Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.481766 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjh7\" (UniqueName: \"kubernetes.io/projected/fe484179-2b98-449e-8814-79bb6c355580-kube-api-access-txjh7\") pod \"keystone-operator-index-mtjh4\" (UID: \"fe484179-2b98-449e-8814-79bb6c355580\") " pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.583177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-txjh7\" (UniqueName: \"kubernetes.io/projected/fe484179-2b98-449e-8814-79bb6c355580-kube-api-access-txjh7\") pod \"keystone-operator-index-mtjh4\" (UID: \"fe484179-2b98-449e-8814-79bb6c355580\") " pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.609548 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjh7\" (UniqueName: \"kubernetes.io/projected/fe484179-2b98-449e-8814-79bb6c355580-kube-api-access-txjh7\") pod \"keystone-operator-index-mtjh4\" (UID: \"fe484179-2b98-449e-8814-79bb6c355580\") " pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.622464 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:19 crc kubenswrapper[4769]: I1121 13:56:19.872692 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-mtjh4"] Nov 21 13:56:20 crc kubenswrapper[4769]: I1121 13:56:20.605914 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-mtjh4" event={"ID":"fe484179-2b98-449e-8814-79bb6c355580","Type":"ContainerStarted","Data":"601ee86d80c7cf9f4686e9af6b0b241b323b7cffe4e6ea4001349169cb830ec6"} Nov 21 13:56:20 crc kubenswrapper[4769]: I1121 13:56:20.606228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-mtjh4" event={"ID":"fe484179-2b98-449e-8814-79bb6c355580","Type":"ContainerStarted","Data":"a50753799b17a7f61d186d3e4a5bb30f808665444d32f3c2fa30a2fea20b2b9c"} Nov 21 13:56:20 crc kubenswrapper[4769]: I1121 13:56:20.622934 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-mtjh4" podStartSLOduration=1.102663619 podStartE2EDuration="1.622919591s" podCreationTimestamp="2025-11-21 13:56:19 +0000 UTC" firstStartedPulling="2025-11-21 13:56:19.8983886 +0000 UTC m=+7538.599050418" lastFinishedPulling="2025-11-21 13:56:20.418644572 +0000 UTC m=+7539.119306390" observedRunningTime="2025-11-21 13:56:20.61726318 +0000 UTC m=+7539.317924988" watchObservedRunningTime="2025-11-21 13:56:20.622919591 +0000 UTC m=+7539.323581409" Nov 21 13:56:21 crc kubenswrapper[4769]: I1121 13:56:21.615359 4769 generic.go:334] "Generic (PLEG): container finished" podID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerID="6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec" exitCode=0 Nov 21 13:56:21 crc kubenswrapper[4769]: I1121 13:56:21.615459 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9xskm" event={"ID":"261b9f8c-d9c5-46dd-92ba-f41c8140a733","Type":"ContainerDied","Data":"6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec"} Nov 21 13:56:23 crc kubenswrapper[4769]: I1121 13:56:23.630558 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9xskm" event={"ID":"261b9f8c-d9c5-46dd-92ba-f41c8140a733","Type":"ContainerStarted","Data":"87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878"} Nov 21 13:56:23 crc kubenswrapper[4769]: I1121 13:56:23.651937 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-9xskm" podStartSLOduration=1.98833295 podStartE2EDuration="30.651919634s" podCreationTimestamp="2025-11-21 13:55:53 +0000 UTC" firstStartedPulling="2025-11-21 13:55:54.396514962 +0000 UTC m=+7513.097176780" lastFinishedPulling="2025-11-21 13:56:23.060101646 +0000 UTC m=+7541.760763464" observedRunningTime="2025-11-21 13:56:23.648710188 +0000 UTC m=+7542.349372046" watchObservedRunningTime="2025-11-21 13:56:23.651919634 +0000 UTC m=+7542.352581452" Nov 21 13:56:29 crc kubenswrapper[4769]: I1121 13:56:29.622961 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:29 crc kubenswrapper[4769]: I1121 13:56:29.623676 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:29 crc kubenswrapper[4769]: I1121 13:56:29.659762 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:29 crc kubenswrapper[4769]: I1121 13:56:29.706497 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 13:56:31 crc kubenswrapper[4769]: I1121 13:56:31.938306 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws"] Nov 21 13:56:31 crc kubenswrapper[4769]: I1121 13:56:31.940339 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:31 crc kubenswrapper[4769]: I1121 13:56:31.942802 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 13:56:31 crc kubenswrapper[4769]: I1121 13:56:31.950378 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws"] Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.072983 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.073037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.073067 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfzh\" (UniqueName: \"kubernetes.io/projected/c46bc628-cdec-4f0a-88df-26f9381b3cfb-kube-api-access-ftfzh\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.174966 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.175023 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.175053 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfzh\" (UniqueName: \"kubernetes.io/projected/c46bc628-cdec-4f0a-88df-26f9381b3cfb-kube-api-access-ftfzh\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.175650 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.175722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.199369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfzh\" (UniqueName: \"kubernetes.io/projected/c46bc628-cdec-4f0a-88df-26f9381b3cfb-kube-api-access-ftfzh\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.274654 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:56:32 crc kubenswrapper[4769]: E1121 13:56:32.274875 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.275063 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:32 crc kubenswrapper[4769]: I1121 13:56:32.947870 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws"] Nov 21 13:56:32 crc kubenswrapper[4769]: W1121 13:56:32.959280 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46bc628_cdec_4f0a_88df_26f9381b3cfb.slice/crio-6df5e3dd913771e853addbf6f2f552f86b266fd8d18215100c168be22c4535cd WatchSource:0}: Error finding container 6df5e3dd913771e853addbf6f2f552f86b266fd8d18215100c168be22c4535cd: Status 404 returned error can't find the container with id 6df5e3dd913771e853addbf6f2f552f86b266fd8d18215100c168be22c4535cd Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.426477 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.426865 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.470625 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.510028 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.511130 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.513760 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.513785 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"rabbitmq-server-conf" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.514353 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"rabbitmq-default-user" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.514420 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.514640 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"rabbitmq-server-dockercfg-zcfc5" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.524900 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599069 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599339 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65zn\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-kube-api-access-n65zn\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599563 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599618 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/34682385-33d5-43f5-a2e8-c37c79018563-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599666 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599797 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/34682385-33d5-43f5-a2e8-c37c79018563-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.599862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/34682385-33d5-43f5-a2e8-c37c79018563-pod-info\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.701554 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n65zn\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-kube-api-access-n65zn\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.701842 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.701912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/34682385-33d5-43f5-a2e8-c37c79018563-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.701992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.702181 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/34682385-33d5-43f5-a2e8-c37c79018563-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.702311 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/34682385-33d5-43f5-a2e8-c37c79018563-pod-info\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.702419 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.702525 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.703078 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.703098 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.703430 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/34682385-33d5-43f5-a2e8-c37c79018563-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.706207 4769 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.706435 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/3147e31381ed1771126e57891c7a06cd2a2ca006713086765227a02da9abf09e/globalmount\"" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.708045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/34682385-33d5-43f5-a2e8-c37c79018563-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.708161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.712323 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/34682385-33d5-43f5-a2e8-c37c79018563-pod-info\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.720538 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65zn\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-kube-api-access-n65zn\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.728810 4769 generic.go:334] "Generic (PLEG): container finished" podID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerID="5a4dd514a56e1160d042ab4b3d4577bf339d2e8b791e3164b623a5367ab6804d" exitCode=0 Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.728872 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" event={"ID":"c46bc628-cdec-4f0a-88df-26f9381b3cfb","Type":"ContainerDied","Data":"5a4dd514a56e1160d042ab4b3d4577bf339d2e8b791e3164b623a5367ab6804d"} Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.728935 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" event={"ID":"c46bc628-cdec-4f0a-88df-26f9381b3cfb","Type":"ContainerStarted","Data":"6df5e3dd913771e853addbf6f2f552f86b266fd8d18215100c168be22c4535cd"} Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.740696 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") pod \"rabbitmq-server-0\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.794472 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:56:33 crc kubenswrapper[4769]: I1121 13:56:33.826843 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:56:34 crc kubenswrapper[4769]: I1121 13:56:34.253995 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 13:56:34 crc kubenswrapper[4769]: W1121 13:56:34.264941 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34682385_33d5_43f5_a2e8_c37c79018563.slice/crio-98fb8ccf21c035c14c815cc7e4018f1e2fbd85911834cc0a82757eaa993cfa37 WatchSource:0}: Error finding container 98fb8ccf21c035c14c815cc7e4018f1e2fbd85911834cc0a82757eaa993cfa37: Status 404 returned error can't find the container with id 98fb8ccf21c035c14c815cc7e4018f1e2fbd85911834cc0a82757eaa993cfa37 Nov 21 13:56:34 crc kubenswrapper[4769]: I1121 13:56:34.739123 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"34682385-33d5-43f5-a2e8-c37c79018563","Type":"ContainerStarted","Data":"98fb8ccf21c035c14c815cc7e4018f1e2fbd85911834cc0a82757eaa993cfa37"} Nov 21 13:56:34 crc kubenswrapper[4769]: I1121 13:56:34.741946 4769 generic.go:334] "Generic (PLEG): container finished" podID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerID="acac31dff436092e8b3375f4dddf14b212db5da1e53ec81b741be53516839e13" exitCode=0 Nov 21 13:56:34 crc kubenswrapper[4769]: I1121 13:56:34.742009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" event={"ID":"c46bc628-cdec-4f0a-88df-26f9381b3cfb","Type":"ContainerDied","Data":"acac31dff436092e8b3375f4dddf14b212db5da1e53ec81b741be53516839e13"} Nov 21 13:56:35 crc kubenswrapper[4769]: I1121 13:56:35.752834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"34682385-33d5-43f5-a2e8-c37c79018563","Type":"ContainerStarted","Data":"77fcdd676de9b94441ddeca909a48d607c32050ca3a590ef362ede1117a85ce6"} Nov 21 13:56:35 crc kubenswrapper[4769]: I1121 13:56:35.757513 4769 generic.go:334] "Generic (PLEG): container finished" podID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerID="1eb38863406eba488c1240082acea9e6a766b4307213db4366ef2c5b38914922" exitCode=0 Nov 21 13:56:35 crc kubenswrapper[4769]: I1121 13:56:35.757562 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" event={"ID":"c46bc628-cdec-4f0a-88df-26f9381b3cfb","Type":"ContainerDied","Data":"1eb38863406eba488c1240082acea9e6a766b4307213db4366ef2c5b38914922"} Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.063944 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.158398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-util\") pod \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.158470 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftfzh\" (UniqueName: \"kubernetes.io/projected/c46bc628-cdec-4f0a-88df-26f9381b3cfb-kube-api-access-ftfzh\") pod \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.158619 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-bundle\") pod \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\" (UID: \"c46bc628-cdec-4f0a-88df-26f9381b3cfb\") " Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.160593 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-bundle" (OuterVolumeSpecName: "bundle") pod "c46bc628-cdec-4f0a-88df-26f9381b3cfb" (UID: "c46bc628-cdec-4f0a-88df-26f9381b3cfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.164439 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46bc628-cdec-4f0a-88df-26f9381b3cfb-kube-api-access-ftfzh" (OuterVolumeSpecName: "kube-api-access-ftfzh") pod "c46bc628-cdec-4f0a-88df-26f9381b3cfb" (UID: "c46bc628-cdec-4f0a-88df-26f9381b3cfb"). InnerVolumeSpecName "kube-api-access-ftfzh". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.172296 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-util" (OuterVolumeSpecName: "util") pod "c46bc628-cdec-4f0a-88df-26f9381b3cfb" (UID: "c46bc628-cdec-4f0a-88df-26f9381b3cfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.260656 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.260694 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46bc628-cdec-4f0a-88df-26f9381b3cfb-util\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.260705 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ftfzh\" (UniqueName: \"kubernetes.io/projected/c46bc628-cdec-4f0a-88df-26f9381b3cfb-kube-api-access-ftfzh\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.285369 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-9xskm"] Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.285711 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-9xskm" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="registry-server" containerID="cri-o://87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878" gracePeriod=2 Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.767554 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.784165 4769 generic.go:334] "Generic (PLEG): container finished" podID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerID="87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878" exitCode=0 Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.784269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9xskm" event={"ID":"261b9f8c-d9c5-46dd-92ba-f41c8140a733","Type":"ContainerDied","Data":"87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878"} Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.784310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-9xskm" event={"ID":"261b9f8c-d9c5-46dd-92ba-f41c8140a733","Type":"ContainerDied","Data":"676d1581ea951e0c8a697a27cece13ade16e7189798c6b296c2a4a26e93bca21"} Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.784335 4769 scope.go:117] "RemoveContainer" containerID="87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.784509 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-9xskm" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.795228 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" event={"ID":"c46bc628-cdec-4f0a-88df-26f9381b3cfb","Type":"ContainerDied","Data":"6df5e3dd913771e853addbf6f2f552f86b266fd8d18215100c168be22c4535cd"} Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.795306 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6df5e3dd913771e853addbf6f2f552f86b266fd8d18215100c168be22c4535cd" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.795314 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.812416 4769 scope.go:117] "RemoveContainer" containerID="6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.831934 4769 scope.go:117] "RemoveContainer" containerID="f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.851531 4769 scope.go:117] "RemoveContainer" containerID="87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878" Nov 21 13:56:37 crc kubenswrapper[4769]: E1121 13:56:37.852311 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878\": container with ID starting with 87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878 not found: ID does not exist" containerID="87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.852392 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878"} err="failed to get container status \"87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878\": rpc error: code = NotFound desc = could not find container \"87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878\": container with ID starting with 87f64a618634fdfce20e5cb14a0d461852aa2ee4abd2fef4c9d64943890c2878 not found: ID does not exist" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.852450 4769 scope.go:117] "RemoveContainer" containerID="6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec" Nov 21 13:56:37 crc kubenswrapper[4769]: E1121 13:56:37.853106 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec\": container with ID starting with 6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec not found: ID does not exist" containerID="6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.853212 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec"} err="failed to get container status \"6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec\": rpc error: code = NotFound desc = could not find container \"6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec\": container with ID starting with 6bbc381f079a3bdbfdfcabfb0ea81460f5f7fddb2a673139541f904c3eecedec not found: ID does not exist" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.853271 4769 scope.go:117] "RemoveContainer" containerID="f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b" Nov 21 13:56:37 crc kubenswrapper[4769]: E1121 13:56:37.853709 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b\": container with ID starting with f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b not found: ID does not exist" containerID="f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.853765 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b"} err="failed to get container status \"f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b\": rpc error: code = NotFound desc = could not find container \"f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b\": container with ID starting with f3de66905080c752091279bafa7e59da162abd299fab5f8256e323eb8006341b not found: ID does not exist" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.869745 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-utilities\") pod \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.869896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfmtp\" (UniqueName: \"kubernetes.io/projected/261b9f8c-d9c5-46dd-92ba-f41c8140a733-kube-api-access-tfmtp\") pod \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.870131 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-catalog-content\") pod \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\" (UID: \"261b9f8c-d9c5-46dd-92ba-f41c8140a733\") " Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.871271 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-utilities" (OuterVolumeSpecName: "utilities") pod "261b9f8c-d9c5-46dd-92ba-f41c8140a733" (UID: "261b9f8c-d9c5-46dd-92ba-f41c8140a733"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.877614 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261b9f8c-d9c5-46dd-92ba-f41c8140a733-kube-api-access-tfmtp" (OuterVolumeSpecName: "kube-api-access-tfmtp") pod "261b9f8c-d9c5-46dd-92ba-f41c8140a733" (UID: "261b9f8c-d9c5-46dd-92ba-f41c8140a733"). InnerVolumeSpecName "kube-api-access-tfmtp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.929767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "261b9f8c-d9c5-46dd-92ba-f41c8140a733" (UID: "261b9f8c-d9c5-46dd-92ba-f41c8140a733"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.971867 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tfmtp\" (UniqueName: \"kubernetes.io/projected/261b9f8c-d9c5-46dd-92ba-f41c8140a733-kube-api-access-tfmtp\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.971922 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:37 crc kubenswrapper[4769]: I1121 13:56:37.971940 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/261b9f8c-d9c5-46dd-92ba-f41c8140a733-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:56:38 crc kubenswrapper[4769]: I1121 13:56:38.126629 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-9xskm"] Nov 21 13:56:38 crc kubenswrapper[4769]: I1121 13:56:38.131551 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-9xskm"] Nov 21 13:56:39 crc kubenswrapper[4769]: I1121 13:56:39.307779 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" path="/var/lib/kubelet/pods/261b9f8c-d9c5-46dd-92ba-f41c8140a733/volumes" Nov 21 13:56:47 crc kubenswrapper[4769]: I1121 13:56:47.274776 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 13:56:47 crc kubenswrapper[4769]: I1121 13:56:47.886741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"4b281e3968dd00ac10667b2de968f283cd017ecc4962a2f4341cb0a9daf93504"} Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184259 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r"] Nov 21 13:56:49 crc kubenswrapper[4769]: E1121 13:56:49.184772 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="extract" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184784 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="extract" Nov 21 13:56:49 crc kubenswrapper[4769]: E1121 13:56:49.184798 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="registry-server" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184804 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="registry-server" Nov 21 13:56:49 crc kubenswrapper[4769]: E1121 13:56:49.184817 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="extract-utilities" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184823 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="extract-utilities" Nov 21 13:56:49 crc kubenswrapper[4769]: E1121 13:56:49.184833 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="util" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184839 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="util" Nov 21 13:56:49 crc kubenswrapper[4769]: E1121 13:56:49.184850 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="extract-content" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184855 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="extract-content" Nov 21 13:56:49 crc kubenswrapper[4769]: E1121 13:56:49.184880 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="pull" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184885 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="pull" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.184989 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="261b9f8c-d9c5-46dd-92ba-f41c8140a733" containerName="registry-server" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.185006 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" containerName="extract" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.185743 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.187665 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-service-cert" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.188768 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-dockercfg-2k4dt" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.199031 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r"] Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.244435 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-apiservice-cert\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.244531 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgc54\" (UniqueName: \"kubernetes.io/projected/6d071296-47be-4154-b14c-95b3441b36fc-kube-api-access-sgc54\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.244615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-webhook-cert\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.345996 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sgc54\" (UniqueName: \"kubernetes.io/projected/6d071296-47be-4154-b14c-95b3441b36fc-kube-api-access-sgc54\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.346225 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-webhook-cert\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.346438 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-apiservice-cert\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.353694 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-webhook-cert\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.356853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-apiservice-cert\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.369073 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgc54\" (UniqueName: \"kubernetes.io/projected/6d071296-47be-4154-b14c-95b3441b36fc-kube-api-access-sgc54\") pod \"keystone-operator-controller-manager-8596b9d554-dst8r\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:49 crc kubenswrapper[4769]: I1121 13:56:49.509608 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:50 crc kubenswrapper[4769]: I1121 13:56:50.008365 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r"] Nov 21 13:56:50 crc kubenswrapper[4769]: I1121 13:56:50.912936 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" event={"ID":"6d071296-47be-4154-b14c-95b3441b36fc","Type":"ContainerStarted","Data":"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65"} Nov 21 13:56:50 crc kubenswrapper[4769]: I1121 13:56:50.913398 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:56:50 crc kubenswrapper[4769]: I1121 13:56:50.913414 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" event={"ID":"6d071296-47be-4154-b14c-95b3441b36fc","Type":"ContainerStarted","Data":"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9"} Nov 21 13:56:50 crc kubenswrapper[4769]: I1121 13:56:50.913424 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" event={"ID":"6d071296-47be-4154-b14c-95b3441b36fc","Type":"ContainerStarted","Data":"02ae528345f10b4bd847bba66899442ddcfa084f028fd7e5722788a384c3d4e8"} Nov 21 13:56:50 crc kubenswrapper[4769]: I1121 13:56:50.935999 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" podStartSLOduration=1.9359766029999999 podStartE2EDuration="1.935976603s" podCreationTimestamp="2025-11-21 13:56:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:56:50.93398661 +0000 UTC m=+7569.634648428" watchObservedRunningTime="2025-11-21 13:56:50.935976603 +0000 UTC m=+7569.636638431" Nov 21 13:56:59 crc kubenswrapper[4769]: I1121 13:56:59.515879 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.486538 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-9b80-account-create-update-htr25"] Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.489043 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.491036 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-db-secret" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.494368 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-fmjct"] Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.495636 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.500379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-9b80-account-create-update-htr25"] Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.524524 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-fmjct"] Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.554375 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78fqx\" (UniqueName: \"kubernetes.io/projected/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-kube-api-access-78fqx\") pod \"keystone-9b80-account-create-update-htr25\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.554439 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39f00d99-4f44-48e5-a946-0b44676fb8bd-operator-scripts\") pod \"keystone-db-create-fmjct\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.554481 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ddg5\" (UniqueName: \"kubernetes.io/projected/39f00d99-4f44-48e5-a946-0b44676fb8bd-kube-api-access-8ddg5\") pod \"keystone-db-create-fmjct\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.554501 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-operator-scripts\") pod \"keystone-9b80-account-create-update-htr25\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.655982 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39f00d99-4f44-48e5-a946-0b44676fb8bd-operator-scripts\") pod \"keystone-db-create-fmjct\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.656062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8ddg5\" (UniqueName: \"kubernetes.io/projected/39f00d99-4f44-48e5-a946-0b44676fb8bd-kube-api-access-8ddg5\") pod \"keystone-db-create-fmjct\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.656089 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-operator-scripts\") pod \"keystone-9b80-account-create-update-htr25\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.656196 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-78fqx\" (UniqueName: \"kubernetes.io/projected/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-kube-api-access-78fqx\") pod \"keystone-9b80-account-create-update-htr25\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.657152 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39f00d99-4f44-48e5-a946-0b44676fb8bd-operator-scripts\") pod \"keystone-db-create-fmjct\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.657332 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-operator-scripts\") pod \"keystone-9b80-account-create-update-htr25\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.684278 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-78fqx\" (UniqueName: \"kubernetes.io/projected/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-kube-api-access-78fqx\") pod \"keystone-9b80-account-create-update-htr25\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.698001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ddg5\" (UniqueName: \"kubernetes.io/projected/39f00d99-4f44-48e5-a946-0b44676fb8bd-kube-api-access-8ddg5\") pod \"keystone-db-create-fmjct\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.814500 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:07 crc kubenswrapper[4769]: I1121 13:57:07.825596 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:08 crc kubenswrapper[4769]: I1121 13:57:08.090989 4769 generic.go:334] "Generic (PLEG): container finished" podID="34682385-33d5-43f5-a2e8-c37c79018563" containerID="77fcdd676de9b94441ddeca909a48d607c32050ca3a590ef362ede1117a85ce6" exitCode=0 Nov 21 13:57:08 crc kubenswrapper[4769]: I1121 13:57:08.091032 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"34682385-33d5-43f5-a2e8-c37c79018563","Type":"ContainerDied","Data":"77fcdd676de9b94441ddeca909a48d607c32050ca3a590ef362ede1117a85ce6"} Nov 21 13:57:08 crc kubenswrapper[4769]: I1121 13:57:08.135090 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-9b80-account-create-update-htr25"] Nov 21 13:57:08 crc kubenswrapper[4769]: I1121 13:57:08.272375 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-fmjct"] Nov 21 13:57:08 crc kubenswrapper[4769]: W1121 13:57:08.281100 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39f00d99_4f44_48e5_a946_0b44676fb8bd.slice/crio-4f932bbb24de127adbca38fe5ab178e749f5e9fcd36b8d28ded5bc0a1c3483d7 WatchSource:0}: Error finding container 4f932bbb24de127adbca38fe5ab178e749f5e9fcd36b8d28ded5bc0a1c3483d7: Status 404 returned error can't find the container with id 4f932bbb24de127adbca38fe5ab178e749f5e9fcd36b8d28ded5bc0a1c3483d7 Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.103248 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"34682385-33d5-43f5-a2e8-c37c79018563","Type":"ContainerStarted","Data":"6ab5b66fd1a04bf5b9d09a2df30e837ce7bf988d43ef6d4f2d1cb0b3ed68352d"} Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.103958 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.105538 4769 generic.go:334] "Generic (PLEG): container finished" podID="39f00d99-4f44-48e5-a946-0b44676fb8bd" containerID="c8c3450781c5009982fc76bcc84b5d492e2e4b5f00b1e530ddeac0888a2804fd" exitCode=0 Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.105629 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-fmjct" event={"ID":"39f00d99-4f44-48e5-a946-0b44676fb8bd","Type":"ContainerDied","Data":"c8c3450781c5009982fc76bcc84b5d492e2e4b5f00b1e530ddeac0888a2804fd"} Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.105728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-fmjct" event={"ID":"39f00d99-4f44-48e5-a946-0b44676fb8bd","Type":"ContainerStarted","Data":"4f932bbb24de127adbca38fe5ab178e749f5e9fcd36b8d28ded5bc0a1c3483d7"} Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.107900 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" event={"ID":"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9","Type":"ContainerStarted","Data":"fe62d25330499026905b794bba253fcf544dbbf4a44e41a1e1010ab1f185a693"} Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.107956 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" event={"ID":"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9","Type":"ContainerStarted","Data":"a262cbda90f69a42c909022f261e86f79e1f7b2d227e3f0a13a58a477b730202"} Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.126069 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.126042798 podStartE2EDuration="37.126042798s" podCreationTimestamp="2025-11-21 13:56:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:57:09.122664698 +0000 UTC m=+7587.823326516" watchObservedRunningTime="2025-11-21 13:57:09.126042798 +0000 UTC m=+7587.826704616" Nov 21 13:57:09 crc kubenswrapper[4769]: I1121 13:57:09.144377 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" podStartSLOduration=2.144352256 podStartE2EDuration="2.144352256s" podCreationTimestamp="2025-11-21 13:57:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:57:09.137825652 +0000 UTC m=+7587.838487470" watchObservedRunningTime="2025-11-21 13:57:09.144352256 +0000 UTC m=+7587.845014074" Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.117377 4769 generic.go:334] "Generic (PLEG): container finished" podID="8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" containerID="fe62d25330499026905b794bba253fcf544dbbf4a44e41a1e1010ab1f185a693" exitCode=0 Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.117430 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" event={"ID":"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9","Type":"ContainerDied","Data":"fe62d25330499026905b794bba253fcf544dbbf4a44e41a1e1010ab1f185a693"} Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.393301 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.502812 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39f00d99-4f44-48e5-a946-0b44676fb8bd-operator-scripts\") pod \"39f00d99-4f44-48e5-a946-0b44676fb8bd\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.502897 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ddg5\" (UniqueName: \"kubernetes.io/projected/39f00d99-4f44-48e5-a946-0b44676fb8bd-kube-api-access-8ddg5\") pod \"39f00d99-4f44-48e5-a946-0b44676fb8bd\" (UID: \"39f00d99-4f44-48e5-a946-0b44676fb8bd\") " Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.503607 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f00d99-4f44-48e5-a946-0b44676fb8bd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "39f00d99-4f44-48e5-a946-0b44676fb8bd" (UID: "39f00d99-4f44-48e5-a946-0b44676fb8bd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.508825 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f00d99-4f44-48e5-a946-0b44676fb8bd-kube-api-access-8ddg5" (OuterVolumeSpecName: "kube-api-access-8ddg5") pod "39f00d99-4f44-48e5-a946-0b44676fb8bd" (UID: "39f00d99-4f44-48e5-a946-0b44676fb8bd"). InnerVolumeSpecName "kube-api-access-8ddg5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.605072 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/39f00d99-4f44-48e5-a946-0b44676fb8bd-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:10 crc kubenswrapper[4769]: I1121 13:57:10.605109 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8ddg5\" (UniqueName: \"kubernetes.io/projected/39f00d99-4f44-48e5-a946-0b44676fb8bd-kube-api-access-8ddg5\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.126226 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-fmjct" event={"ID":"39f00d99-4f44-48e5-a946-0b44676fb8bd","Type":"ContainerDied","Data":"4f932bbb24de127adbca38fe5ab178e749f5e9fcd36b8d28ded5bc0a1c3483d7"} Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.126266 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-fmjct" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.126275 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f932bbb24de127adbca38fe5ab178e749f5e9fcd36b8d28ded5bc0a1c3483d7" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.405020 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.514737 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-operator-scripts\") pod \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.514830 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78fqx\" (UniqueName: \"kubernetes.io/projected/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-kube-api-access-78fqx\") pod \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\" (UID: \"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9\") " Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.515451 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" (UID: "8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.526647 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-kube-api-access-78fqx" (OuterVolumeSpecName: "kube-api-access-78fqx") pod "8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" (UID: "8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9"). InnerVolumeSpecName "kube-api-access-78fqx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.616810 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:11 crc kubenswrapper[4769]: I1121 13:57:11.617174 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-78fqx\" (UniqueName: \"kubernetes.io/projected/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9-kube-api-access-78fqx\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:12 crc kubenswrapper[4769]: I1121 13:57:12.134827 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" event={"ID":"8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9","Type":"ContainerDied","Data":"a262cbda90f69a42c909022f261e86f79e1f7b2d227e3f0a13a58a477b730202"} Nov 21 13:57:12 crc kubenswrapper[4769]: I1121 13:57:12.135530 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a262cbda90f69a42c909022f261e86f79e1f7b2d227e3f0a13a58a477b730202" Nov 21 13:57:12 crc kubenswrapper[4769]: I1121 13:57:12.134892 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-9b80-account-create-update-htr25" Nov 21 13:57:12 crc kubenswrapper[4769]: I1121 13:57:12.950468 4769 scope.go:117] "RemoveContainer" containerID="6e0c5729b7a2f2bba7010f0ca139f467293c5a2b59dd233d427f963fad6d2937" Nov 21 13:57:12 crc kubenswrapper[4769]: I1121 13:57:12.991011 4769 scope.go:117] "RemoveContainer" containerID="87633adf6ad6ceb5158194e6367315b7111f4b8d82323f10d55854d47f6c7f05" Nov 21 13:57:13 crc kubenswrapper[4769]: I1121 13:57:13.084546 4769 scope.go:117] "RemoveContainer" containerID="49600efbecb51392638ccc2a2f2dfd763476f07eb8509dc6f8a0d8933e78deab" Nov 21 13:57:13 crc kubenswrapper[4769]: I1121 13:57:13.110957 4769 scope.go:117] "RemoveContainer" containerID="789e1701260cad407033b73f12ab8b3171ae8598b35a4bef6f1a761c7285fa85" Nov 21 13:57:23 crc kubenswrapper[4769]: I1121 13:57:23.830449 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.284118 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hfhhz"] Nov 21 13:57:24 crc kubenswrapper[4769]: E1121 13:57:24.285137 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="39f00d99-4f44-48e5-a946-0b44676fb8bd" containerName="mariadb-database-create" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.285270 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f00d99-4f44-48e5-a946-0b44676fb8bd" containerName="mariadb-database-create" Nov 21 13:57:24 crc kubenswrapper[4769]: E1121 13:57:24.285378 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" containerName="mariadb-account-create-update" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.285460 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" containerName="mariadb-account-create-update" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.285719 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="39f00d99-4f44-48e5-a946-0b44676fb8bd" containerName="mariadb-database-create" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.285840 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" containerName="mariadb-account-create-update" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.286824 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.292340 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-5xfck" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.292759 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hfhhz"] Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.294907 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.294958 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.295011 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.437459 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rs7d\" (UniqueName: \"kubernetes.io/projected/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-kube-api-access-5rs7d\") pod \"keystone-db-sync-hfhhz\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.437944 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-config-data\") pod \"keystone-db-sync-hfhhz\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.539916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5rs7d\" (UniqueName: \"kubernetes.io/projected/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-kube-api-access-5rs7d\") pod \"keystone-db-sync-hfhhz\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.540013 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-config-data\") pod \"keystone-db-sync-hfhhz\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.547175 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-config-data\") pod \"keystone-db-sync-hfhhz\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.564599 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rs7d\" (UniqueName: \"kubernetes.io/projected/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-kube-api-access-5rs7d\") pod \"keystone-db-sync-hfhhz\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:24 crc kubenswrapper[4769]: I1121 13:57:24.644636 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:25 crc kubenswrapper[4769]: I1121 13:57:25.109158 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hfhhz"] Nov 21 13:57:25 crc kubenswrapper[4769]: W1121 13:57:25.116888 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1be0feb7_2168_4bc5_8b64_d1008e9ab97d.slice/crio-f187bd6575bbefbccb2948d1acc14872e0c95953ea22d401825637a29e9fd5bc WatchSource:0}: Error finding container f187bd6575bbefbccb2948d1acc14872e0c95953ea22d401825637a29e9fd5bc: Status 404 returned error can't find the container with id f187bd6575bbefbccb2948d1acc14872e0c95953ea22d401825637a29e9fd5bc Nov 21 13:57:25 crc kubenswrapper[4769]: I1121 13:57:25.257428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" event={"ID":"1be0feb7-2168-4bc5-8b64-d1008e9ab97d","Type":"ContainerStarted","Data":"f187bd6575bbefbccb2948d1acc14872e0c95953ea22d401825637a29e9fd5bc"} Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.079644 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-79w5m"] Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.081742 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.090838 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-79w5m"] Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.262744 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-utilities\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.262901 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-catalog-content\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.262958 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47xvj\" (UniqueName: \"kubernetes.io/projected/2093c879-5cd4-43db-8dc0-336497867c8e-kube-api-access-47xvj\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.266966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" event={"ID":"1be0feb7-2168-4bc5-8b64-d1008e9ab97d","Type":"ContainerStarted","Data":"83587f4950c216082e265e2e164f06525c31e315dfd81af9eda7549a307ea0d3"} Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.286101 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" podStartSLOduration=2.286073988 podStartE2EDuration="2.286073988s" podCreationTimestamp="2025-11-21 13:57:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:57:26.284306341 +0000 UTC m=+7604.984968159" watchObservedRunningTime="2025-11-21 13:57:26.286073988 +0000 UTC m=+7604.986735806" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.364416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-utilities\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.364824 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-catalog-content\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.364980 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-47xvj\" (UniqueName: \"kubernetes.io/projected/2093c879-5cd4-43db-8dc0-336497867c8e-kube-api-access-47xvj\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.365717 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-utilities\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.365782 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-catalog-content\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.394208 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-47xvj\" (UniqueName: \"kubernetes.io/projected/2093c879-5cd4-43db-8dc0-336497867c8e-kube-api-access-47xvj\") pod \"community-operators-79w5m\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.412182 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:26 crc kubenswrapper[4769]: I1121 13:57:26.909282 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-79w5m"] Nov 21 13:57:27 crc kubenswrapper[4769]: W1121 13:57:27.109843 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2093c879_5cd4_43db_8dc0_336497867c8e.slice/crio-8a673e4f56a4ff004609b3325eb2d4b5f4a63a1435795505754274f4aad02b5a WatchSource:0}: Error finding container 8a673e4f56a4ff004609b3325eb2d4b5f4a63a1435795505754274f4aad02b5a: Status 404 returned error can't find the container with id 8a673e4f56a4ff004609b3325eb2d4b5f4a63a1435795505754274f4aad02b5a Nov 21 13:57:27 crc kubenswrapper[4769]: I1121 13:57:27.285947 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerStarted","Data":"8a673e4f56a4ff004609b3325eb2d4b5f4a63a1435795505754274f4aad02b5a"} Nov 21 13:57:28 crc kubenswrapper[4769]: I1121 13:57:28.286684 4769 generic.go:334] "Generic (PLEG): container finished" podID="2093c879-5cd4-43db-8dc0-336497867c8e" containerID="d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b" exitCode=0 Nov 21 13:57:28 crc kubenswrapper[4769]: I1121 13:57:28.286728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerDied","Data":"d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b"} Nov 21 13:57:28 crc kubenswrapper[4769]: I1121 13:57:28.288680 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 13:57:29 crc kubenswrapper[4769]: I1121 13:57:29.299065 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerStarted","Data":"00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6"} Nov 21 13:57:30 crc kubenswrapper[4769]: I1121 13:57:30.311214 4769 generic.go:334] "Generic (PLEG): container finished" podID="2093c879-5cd4-43db-8dc0-336497867c8e" containerID="00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6" exitCode=0 Nov 21 13:57:30 crc kubenswrapper[4769]: I1121 13:57:30.311348 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerDied","Data":"00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6"} Nov 21 13:57:31 crc kubenswrapper[4769]: I1121 13:57:31.320030 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerStarted","Data":"537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac"} Nov 21 13:57:31 crc kubenswrapper[4769]: I1121 13:57:31.322072 4769 generic.go:334] "Generic (PLEG): container finished" podID="1be0feb7-2168-4bc5-8b64-d1008e9ab97d" containerID="83587f4950c216082e265e2e164f06525c31e315dfd81af9eda7549a307ea0d3" exitCode=0 Nov 21 13:57:31 crc kubenswrapper[4769]: I1121 13:57:31.322129 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" event={"ID":"1be0feb7-2168-4bc5-8b64-d1008e9ab97d","Type":"ContainerDied","Data":"83587f4950c216082e265e2e164f06525c31e315dfd81af9eda7549a307ea0d3"} Nov 21 13:57:31 crc kubenswrapper[4769]: I1121 13:57:31.343303 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-79w5m" podStartSLOduration=2.815267422 podStartE2EDuration="5.343282136s" podCreationTimestamp="2025-11-21 13:57:26 +0000 UTC" firstStartedPulling="2025-11-21 13:57:28.288460265 +0000 UTC m=+7606.989122083" lastFinishedPulling="2025-11-21 13:57:30.816474979 +0000 UTC m=+7609.517136797" observedRunningTime="2025-11-21 13:57:31.336360272 +0000 UTC m=+7610.037022140" watchObservedRunningTime="2025-11-21 13:57:31.343282136 +0000 UTC m=+7610.043943954" Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.608718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.758276 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-config-data\") pod \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.758388 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rs7d\" (UniqueName: \"kubernetes.io/projected/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-kube-api-access-5rs7d\") pod \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\" (UID: \"1be0feb7-2168-4bc5-8b64-d1008e9ab97d\") " Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.766547 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-kube-api-access-5rs7d" (OuterVolumeSpecName: "kube-api-access-5rs7d") pod "1be0feb7-2168-4bc5-8b64-d1008e9ab97d" (UID: "1be0feb7-2168-4bc5-8b64-d1008e9ab97d"). InnerVolumeSpecName "kube-api-access-5rs7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.794772 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-config-data" (OuterVolumeSpecName: "config-data") pod "1be0feb7-2168-4bc5-8b64-d1008e9ab97d" (UID: "1be0feb7-2168-4bc5-8b64-d1008e9ab97d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.861605 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:32 crc kubenswrapper[4769]: I1121 13:57:32.861658 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5rs7d\" (UniqueName: \"kubernetes.io/projected/1be0feb7-2168-4bc5-8b64-d1008e9ab97d-kube-api-access-5rs7d\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.341219 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" event={"ID":"1be0feb7-2168-4bc5-8b64-d1008e9ab97d","Type":"ContainerDied","Data":"f187bd6575bbefbccb2948d1acc14872e0c95953ea22d401825637a29e9fd5bc"} Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.341290 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f187bd6575bbefbccb2948d1acc14872e0c95953ea22d401825637a29e9fd5bc" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.341399 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-hfhhz" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.554952 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-ndkg7"] Nov 21 13:57:33 crc kubenswrapper[4769]: E1121 13:57:33.555453 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1be0feb7-2168-4bc5-8b64-d1008e9ab97d" containerName="keystone-db-sync" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.555534 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="1be0feb7-2168-4bc5-8b64-d1008e9ab97d" containerName="keystone-db-sync" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.555722 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="1be0feb7-2168-4bc5-8b64-d1008e9ab97d" containerName="keystone-db-sync" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.556413 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.558799 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.558873 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.559038 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"osp-secret" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.558862 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.560686 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-5xfck" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.568290 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-ndkg7"] Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.676554 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8fjs\" (UniqueName: \"kubernetes.io/projected/c13614ba-189a-4a2a-ae2f-50a331747a36-kube-api-access-d8fjs\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.676630 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-scripts\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.676670 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-config-data\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.676707 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-credential-keys\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.676730 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-fernet-keys\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.778132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d8fjs\" (UniqueName: \"kubernetes.io/projected/c13614ba-189a-4a2a-ae2f-50a331747a36-kube-api-access-d8fjs\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.778206 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-scripts\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.778259 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-config-data\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.778335 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-credential-keys\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.778371 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-fernet-keys\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.782265 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-scripts\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.782772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-fernet-keys\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.783277 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-config-data\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.784354 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-credential-keys\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.800149 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8fjs\" (UniqueName: \"kubernetes.io/projected/c13614ba-189a-4a2a-ae2f-50a331747a36-kube-api-access-d8fjs\") pod \"keystone-bootstrap-ndkg7\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:33 crc kubenswrapper[4769]: I1121 13:57:33.875792 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:34 crc kubenswrapper[4769]: I1121 13:57:34.295536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-ndkg7"] Nov 21 13:57:34 crc kubenswrapper[4769]: I1121 13:57:34.351144 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" event={"ID":"c13614ba-189a-4a2a-ae2f-50a331747a36","Type":"ContainerStarted","Data":"12518b6ab999b11abbfce6aaab7223eef6b2226b76b9f93bddd82ea969765925"} Nov 21 13:57:35 crc kubenswrapper[4769]: I1121 13:57:35.359499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" event={"ID":"c13614ba-189a-4a2a-ae2f-50a331747a36","Type":"ContainerStarted","Data":"0bc67d52644a65b7c292ae842c62afae6268544c938fa70484f1f36738bd0d19"} Nov 21 13:57:35 crc kubenswrapper[4769]: I1121 13:57:35.390184 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" podStartSLOduration=2.390160591 podStartE2EDuration="2.390160591s" podCreationTimestamp="2025-11-21 13:57:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:57:35.374647318 +0000 UTC m=+7614.075309146" watchObservedRunningTime="2025-11-21 13:57:35.390160591 +0000 UTC m=+7614.090822429" Nov 21 13:57:36 crc kubenswrapper[4769]: I1121 13:57:36.413072 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:36 crc kubenswrapper[4769]: I1121 13:57:36.413590 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:36 crc kubenswrapper[4769]: I1121 13:57:36.454321 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:37 crc kubenswrapper[4769]: I1121 13:57:37.381450 4769 generic.go:334] "Generic (PLEG): container finished" podID="c13614ba-189a-4a2a-ae2f-50a331747a36" containerID="0bc67d52644a65b7c292ae842c62afae6268544c938fa70484f1f36738bd0d19" exitCode=0 Nov 21 13:57:37 crc kubenswrapper[4769]: I1121 13:57:37.381534 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" event={"ID":"c13614ba-189a-4a2a-ae2f-50a331747a36","Type":"ContainerDied","Data":"0bc67d52644a65b7c292ae842c62afae6268544c938fa70484f1f36738bd0d19"} Nov 21 13:57:37 crc kubenswrapper[4769]: I1121 13:57:37.425197 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.669325 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.754668 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-fernet-keys\") pod \"c13614ba-189a-4a2a-ae2f-50a331747a36\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.754733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-config-data\") pod \"c13614ba-189a-4a2a-ae2f-50a331747a36\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.754765 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-scripts\") pod \"c13614ba-189a-4a2a-ae2f-50a331747a36\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.754833 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-credential-keys\") pod \"c13614ba-189a-4a2a-ae2f-50a331747a36\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.754947 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8fjs\" (UniqueName: \"kubernetes.io/projected/c13614ba-189a-4a2a-ae2f-50a331747a36-kube-api-access-d8fjs\") pod \"c13614ba-189a-4a2a-ae2f-50a331747a36\" (UID: \"c13614ba-189a-4a2a-ae2f-50a331747a36\") " Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.760991 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-scripts" (OuterVolumeSpecName: "scripts") pod "c13614ba-189a-4a2a-ae2f-50a331747a36" (UID: "c13614ba-189a-4a2a-ae2f-50a331747a36"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.761135 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c13614ba-189a-4a2a-ae2f-50a331747a36-kube-api-access-d8fjs" (OuterVolumeSpecName: "kube-api-access-d8fjs") pod "c13614ba-189a-4a2a-ae2f-50a331747a36" (UID: "c13614ba-189a-4a2a-ae2f-50a331747a36"). InnerVolumeSpecName "kube-api-access-d8fjs". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.761769 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c13614ba-189a-4a2a-ae2f-50a331747a36" (UID: "c13614ba-189a-4a2a-ae2f-50a331747a36"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.762674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c13614ba-189a-4a2a-ae2f-50a331747a36" (UID: "c13614ba-189a-4a2a-ae2f-50a331747a36"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.777612 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-config-data" (OuterVolumeSpecName: "config-data") pod "c13614ba-189a-4a2a-ae2f-50a331747a36" (UID: "c13614ba-189a-4a2a-ae2f-50a331747a36"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.856820 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.856880 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.856901 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.856980 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c13614ba-189a-4a2a-ae2f-50a331747a36-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.857006 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d8fjs\" (UniqueName: \"kubernetes.io/projected/c13614ba-189a-4a2a-ae2f-50a331747a36-kube-api-access-d8fjs\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:38 crc kubenswrapper[4769]: I1121 13:57:38.873736 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-79w5m"] Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.397414 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-79w5m" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="registry-server" containerID="cri-o://537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac" gracePeriod=2 Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.397780 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.398456 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-ndkg7" event={"ID":"c13614ba-189a-4a2a-ae2f-50a331747a36","Type":"ContainerDied","Data":"12518b6ab999b11abbfce6aaab7223eef6b2226b76b9f93bddd82ea969765925"} Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.398483 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12518b6ab999b11abbfce6aaab7223eef6b2226b76b9f93bddd82ea969765925" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.581467 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm"] Nov 21 13:57:39 crc kubenswrapper[4769]: E1121 13:57:39.581866 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c13614ba-189a-4a2a-ae2f-50a331747a36" containerName="keystone-bootstrap" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.581887 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c13614ba-189a-4a2a-ae2f-50a331747a36" containerName="keystone-bootstrap" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.582096 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c13614ba-189a-4a2a-ae2f-50a331747a36" containerName="keystone-bootstrap" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.582721 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.585376 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.585619 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.586994 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.587118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-5xfck" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.600738 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm"] Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.669109 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5qkt\" (UniqueName: \"kubernetes.io/projected/be519567-6b74-4e68-bbdc-d76dc878b9f3-kube-api-access-f5qkt\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.669505 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-credential-keys\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.669536 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-fernet-keys\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.669594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-scripts\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.669620 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-config-data\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.770501 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-config-data\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.770584 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f5qkt\" (UniqueName: \"kubernetes.io/projected/be519567-6b74-4e68-bbdc-d76dc878b9f3-kube-api-access-f5qkt\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.770618 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-credential-keys\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.770643 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-fernet-keys\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.770719 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-scripts\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.774366 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-scripts\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.774526 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-credential-keys\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.774749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-fernet-keys\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.775954 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-config-data\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.790007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5qkt\" (UniqueName: \"kubernetes.io/projected/be519567-6b74-4e68-bbdc-d76dc878b9f3-kube-api-access-f5qkt\") pod \"keystone-7b556d4cc7-v2bcm\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.838680 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.901417 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.972686 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47xvj\" (UniqueName: \"kubernetes.io/projected/2093c879-5cd4-43db-8dc0-336497867c8e-kube-api-access-47xvj\") pod \"2093c879-5cd4-43db-8dc0-336497867c8e\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.972789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-catalog-content\") pod \"2093c879-5cd4-43db-8dc0-336497867c8e\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.972862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-utilities\") pod \"2093c879-5cd4-43db-8dc0-336497867c8e\" (UID: \"2093c879-5cd4-43db-8dc0-336497867c8e\") " Nov 21 13:57:39 crc kubenswrapper[4769]: I1121 13:57:39.973835 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-utilities" (OuterVolumeSpecName: "utilities") pod "2093c879-5cd4-43db-8dc0-336497867c8e" (UID: "2093c879-5cd4-43db-8dc0-336497867c8e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.000452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2093c879-5cd4-43db-8dc0-336497867c8e-kube-api-access-47xvj" (OuterVolumeSpecName: "kube-api-access-47xvj") pod "2093c879-5cd4-43db-8dc0-336497867c8e" (UID: "2093c879-5cd4-43db-8dc0-336497867c8e"). InnerVolumeSpecName "kube-api-access-47xvj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.058234 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2093c879-5cd4-43db-8dc0-336497867c8e" (UID: "2093c879-5cd4-43db-8dc0-336497867c8e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.074528 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.074575 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-47xvj\" (UniqueName: \"kubernetes.io/projected/2093c879-5cd4-43db-8dc0-336497867c8e-kube-api-access-47xvj\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.074590 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2093c879-5cd4-43db-8dc0-336497867c8e-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.319747 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm"] Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.412705 4769 generic.go:334] "Generic (PLEG): container finished" podID="2093c879-5cd4-43db-8dc0-336497867c8e" containerID="537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac" exitCode=0 Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.412764 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-79w5m" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.412772 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerDied","Data":"537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac"} Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.412825 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-79w5m" event={"ID":"2093c879-5cd4-43db-8dc0-336497867c8e","Type":"ContainerDied","Data":"8a673e4f56a4ff004609b3325eb2d4b5f4a63a1435795505754274f4aad02b5a"} Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.412845 4769 scope.go:117] "RemoveContainer" containerID="537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.414852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" event={"ID":"be519567-6b74-4e68-bbdc-d76dc878b9f3","Type":"ContainerStarted","Data":"e6b4b20c8fcae9b756ed1803c5bca0d4a3f57b0dac0ad0cfd01f535e43f51f56"} Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.446604 4769 scope.go:117] "RemoveContainer" containerID="00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.459182 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-79w5m"] Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.465407 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-79w5m"] Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.494785 4769 scope.go:117] "RemoveContainer" containerID="d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.513653 4769 scope.go:117] "RemoveContainer" containerID="537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac" Nov 21 13:57:40 crc kubenswrapper[4769]: E1121 13:57:40.514367 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac\": container with ID starting with 537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac not found: ID does not exist" containerID="537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.514490 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac"} err="failed to get container status \"537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac\": rpc error: code = NotFound desc = could not find container \"537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac\": container with ID starting with 537ee5a46b02b85588c8616fd4557daa420834ab7899c501c761a8ff2b5769ac not found: ID does not exist" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.514547 4769 scope.go:117] "RemoveContainer" containerID="00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6" Nov 21 13:57:40 crc kubenswrapper[4769]: E1121 13:57:40.514981 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6\": container with ID starting with 00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6 not found: ID does not exist" containerID="00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.515045 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6"} err="failed to get container status \"00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6\": rpc error: code = NotFound desc = could not find container \"00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6\": container with ID starting with 00605b6f8cc03d34b579c22b59c7efe2ac10c52b8d3fb1ed5a786f80aed4eab6 not found: ID does not exist" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.515087 4769 scope.go:117] "RemoveContainer" containerID="d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b" Nov 21 13:57:40 crc kubenswrapper[4769]: E1121 13:57:40.515571 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b\": container with ID starting with d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b not found: ID does not exist" containerID="d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b" Nov 21 13:57:40 crc kubenswrapper[4769]: I1121 13:57:40.515619 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b"} err="failed to get container status \"d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b\": rpc error: code = NotFound desc = could not find container \"d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b\": container with ID starting with d00eb5e794a7d4700977cd4d0c665af495e30c1909c6e36cfc65d2bcb8cad52b not found: ID does not exist" Nov 21 13:57:41 crc kubenswrapper[4769]: I1121 13:57:41.298024 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" path="/var/lib/kubelet/pods/2093c879-5cd4-43db-8dc0-336497867c8e/volumes" Nov 21 13:57:41 crc kubenswrapper[4769]: I1121 13:57:41.427797 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" event={"ID":"be519567-6b74-4e68-bbdc-d76dc878b9f3","Type":"ContainerStarted","Data":"9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6"} Nov 21 13:57:41 crc kubenswrapper[4769]: I1121 13:57:41.428022 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:57:41 crc kubenswrapper[4769]: I1121 13:57:41.453950 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" podStartSLOduration=2.453921191 podStartE2EDuration="2.453921191s" podCreationTimestamp="2025-11-21 13:57:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:57:41.452057551 +0000 UTC m=+7620.152719379" watchObservedRunningTime="2025-11-21 13:57:41.453921191 +0000 UTC m=+7620.154583049" Nov 21 13:58:11 crc kubenswrapper[4769]: I1121 13:58:11.372095 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:58:12 crc kubenswrapper[4769]: E1121 13:58:12.428873 4769 log.go:32] "Failed when writing line to log file" err="http2: stream closed" path="/var/log/pods/keystone-kuttl-tests_keystone-7b556d4cc7-v2bcm_be519567-6b74-4e68-bbdc-d76dc878b9f3/keystone-api/0.log" line={} Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.786694 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-c67b85d56-82gjk"] Nov 21 13:58:12 crc kubenswrapper[4769]: E1121 13:58:12.787290 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="registry-server" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.787337 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="registry-server" Nov 21 13:58:12 crc kubenswrapper[4769]: E1121 13:58:12.787397 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="extract-utilities" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.787417 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="extract-utilities" Nov 21 13:58:12 crc kubenswrapper[4769]: E1121 13:58:12.787455 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="extract-content" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.787472 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="extract-content" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.787858 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2093c879-5cd4-43db-8dc0-336497867c8e" containerName="registry-server" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.788776 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.795919 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-c67b85d56-82gjk"] Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.796887 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.796999 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.797042 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b75rk\" (UniqueName: \"kubernetes.io/projected/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-kube-api-access-b75rk\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.797106 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.797237 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.897725 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.897785 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.897847 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.897875 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b75rk\" (UniqueName: \"kubernetes.io/projected/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-kube-api-access-b75rk\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.897918 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: E1121 13:58:12.900531 4769 log.go:32] "Failed when writing line to log file" err="http2: stream closed" path="/var/log/pods/keystone-kuttl-tests_keystone-7b556d4cc7-v2bcm_be519567-6b74-4e68-bbdc-d76dc878b9f3/keystone-api/0.log" line={} Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.907873 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.908127 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.908311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.909447 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:12 crc kubenswrapper[4769]: I1121 13:58:12.914887 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b75rk\" (UniqueName: \"kubernetes.io/projected/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-kube-api-access-b75rk\") pod \"keystone-c67b85d56-82gjk\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.114316 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.208137 4769 scope.go:117] "RemoveContainer" containerID="f0d2756aa56310e9a481612d0dfdff3df78669ca2140f82142666994b43b4e65" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.227141 4769 scope.go:117] "RemoveContainer" containerID="f08861aaee95378e08712ce6b45704526ad1664c91f5d5e2e0a0ede14ca63363" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.260977 4769 scope.go:117] "RemoveContainer" containerID="bd4a535c3d5c636642201dbdaea6519f0550e893765cfc839f38a9097a1bd02a" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.306236 4769 scope.go:117] "RemoveContainer" containerID="f3e1c1530c4fc06f9dfd840a8f9b0de966dda3aa74e6f5af997da0aefced9817" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.548290 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-c67b85d56-82gjk"] Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.871847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" event={"ID":"43d73e3e-3fcd-4c24-9736-563f8e6fdef8","Type":"ContainerStarted","Data":"306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6"} Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.871895 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" event={"ID":"43d73e3e-3fcd-4c24-9736-563f8e6fdef8","Type":"ContainerStarted","Data":"afd7e8b0f02aa442a49e41b4b78b652f49342003b48b15fc625a7541220f9544"} Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.871937 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:13 crc kubenswrapper[4769]: I1121 13:58:13.886158 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" podStartSLOduration=1.886136213 podStartE2EDuration="1.886136213s" podCreationTimestamp="2025-11-21 13:58:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:58:13.884818228 +0000 UTC m=+7652.585480046" watchObservedRunningTime="2025-11-21 13:58:13.886136213 +0000 UTC m=+7652.586798031" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.295993 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-ndkg7"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.305816 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-ndkg7"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.315550 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hfhhz"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.325461 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-hfhhz"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.331670 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.331928 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" podUID="be519567-6b74-4e68-bbdc-d76dc878b9f3" containerName="keystone-api" containerID="cri-o://9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6" gracePeriod=30 Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.338155 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-c67b85d56-82gjk"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.361792 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone9b80-account-delete-bpbp5"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.364988 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.368382 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone9b80-account-delete-bpbp5"] Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.423364 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhv4m\" (UniqueName: \"kubernetes.io/projected/3b64085c-4e50-4977-b95c-564bbf402ce8-kube-api-access-vhv4m\") pod \"keystone9b80-account-delete-bpbp5\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.423447 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b64085c-4e50-4977-b95c-564bbf402ce8-operator-scripts\") pod \"keystone9b80-account-delete-bpbp5\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.525047 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vhv4m\" (UniqueName: \"kubernetes.io/projected/3b64085c-4e50-4977-b95c-564bbf402ce8-kube-api-access-vhv4m\") pod \"keystone9b80-account-delete-bpbp5\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.525168 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b64085c-4e50-4977-b95c-564bbf402ce8-operator-scripts\") pod \"keystone9b80-account-delete-bpbp5\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.525871 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b64085c-4e50-4977-b95c-564bbf402ce8-operator-scripts\") pod \"keystone9b80-account-delete-bpbp5\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.542120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhv4m\" (UniqueName: \"kubernetes.io/projected/3b64085c-4e50-4977-b95c-564bbf402ce8-kube-api-access-vhv4m\") pod \"keystone9b80-account-delete-bpbp5\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.681450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.885007 4769 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" secret="" err="secret \"keystone-keystone-dockercfg-5xfck\" not found" Nov 21 13:58:14 crc kubenswrapper[4769]: I1121 13:58:14.899460 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone9b80-account-delete-bpbp5"] Nov 21 13:58:14 crc kubenswrapper[4769]: W1121 13:58:14.901358 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b64085c_4e50_4977_b95c_564bbf402ce8.slice/crio-da16ab671b37d532a4d8c1da4b977702680623a181efca98767cdd357a35aec6 WatchSource:0}: Error finding container da16ab671b37d532a4d8c1da4b977702680623a181efca98767cdd357a35aec6: Status 404 returned error can't find the container with id da16ab671b37d532a4d8c1da4b977702680623a181efca98767cdd357a35aec6 Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930513 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone-scripts: secret "keystone-scripts" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930539 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone: secret "keystone" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930552 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone: secret "keystone" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930600 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:15.430582423 +0000 UTC m=+7654.131244241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "fernet-keys" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930615 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:15.430609203 +0000 UTC m=+7654.131271021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone-scripts" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930539 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone-config-data: secret "keystone-config-data" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930628 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:15.430621684 +0000 UTC m=+7654.131283502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "credential-keys" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone" not found Nov 21 13:58:14 crc kubenswrapper[4769]: E1121 13:58:14.930659 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:15.430640304 +0000 UTC m=+7654.131302122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone-config-data" not found Nov 21 13:58:15 crc kubenswrapper[4769]: I1121 13:58:15.285920 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1be0feb7-2168-4bc5-8b64-d1008e9ab97d" path="/var/lib/kubelet/pods/1be0feb7-2168-4bc5-8b64-d1008e9ab97d/volumes" Nov 21 13:58:15 crc kubenswrapper[4769]: I1121 13:58:15.286979 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c13614ba-189a-4a2a-ae2f-50a331747a36" path="/var/lib/kubelet/pods/c13614ba-189a-4a2a-ae2f-50a331747a36/volumes" Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.436860 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone: secret "keystone" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.436903 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone: secret "keystone" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.436942 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:16.436927345 +0000 UTC m=+7655.137589163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "fernet-keys" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.437005 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone-config-data: secret "keystone-config-data" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.437059 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:16.437017258 +0000 UTC m=+7655.137679096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "credential-keys" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.437092 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:16.437080119 +0000 UTC m=+7655.137742057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone-config-data" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.437881 4769 secret.go:188] Couldn't get secret keystone-kuttl-tests/keystone-scripts: secret "keystone-scripts" not found Nov 21 13:58:15 crc kubenswrapper[4769]: E1121 13:58:15.438066 4769 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts podName:43d73e3e-3fcd-4c24-9736-563f8e6fdef8 nodeName:}" failed. No retries permitted until 2025-11-21 13:58:16.438043125 +0000 UTC m=+7655.138704983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts") pod "keystone-c67b85d56-82gjk" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8") : secret "keystone-scripts" not found Nov 21 13:58:15 crc kubenswrapper[4769]: I1121 13:58:15.894480 4769 generic.go:334] "Generic (PLEG): container finished" podID="3b64085c-4e50-4977-b95c-564bbf402ce8" containerID="649c39b807424d5c2aa863630e438a670d814c9bd2d2e916c06f7dbbf49ea788" exitCode=0 Nov 21 13:58:15 crc kubenswrapper[4769]: I1121 13:58:15.894532 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" event={"ID":"3b64085c-4e50-4977-b95c-564bbf402ce8","Type":"ContainerDied","Data":"649c39b807424d5c2aa863630e438a670d814c9bd2d2e916c06f7dbbf49ea788"} Nov 21 13:58:15 crc kubenswrapper[4769]: I1121 13:58:15.894577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" event={"ID":"3b64085c-4e50-4977-b95c-564bbf402ce8","Type":"ContainerStarted","Data":"da16ab671b37d532a4d8c1da4b977702680623a181efca98767cdd357a35aec6"} Nov 21 13:58:15 crc kubenswrapper[4769]: I1121 13:58:15.894794 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" podUID="43d73e3e-3fcd-4c24-9736-563f8e6fdef8" containerName="keystone-api" containerID="cri-o://306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6" gracePeriod=30 Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.425664 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.455115 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys\") pod \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.455181 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data\") pod \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.455273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys\") pod \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.455314 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts\") pod \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.455398 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b75rk\" (UniqueName: \"kubernetes.io/projected/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-kube-api-access-b75rk\") pod \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\" (UID: \"43d73e3e-3fcd-4c24-9736-563f8e6fdef8\") " Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.460496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "43d73e3e-3fcd-4c24-9736-563f8e6fdef8" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.460513 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts" (OuterVolumeSpecName: "scripts") pod "43d73e3e-3fcd-4c24-9736-563f8e6fdef8" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.461392 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "43d73e3e-3fcd-4c24-9736-563f8e6fdef8" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.462588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-kube-api-access-b75rk" (OuterVolumeSpecName: "kube-api-access-b75rk") pod "43d73e3e-3fcd-4c24-9736-563f8e6fdef8" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8"). InnerVolumeSpecName "kube-api-access-b75rk". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.477481 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data" (OuterVolumeSpecName: "config-data") pod "43d73e3e-3fcd-4c24-9736-563f8e6fdef8" (UID: "43d73e3e-3fcd-4c24-9736-563f8e6fdef8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.556885 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.556938 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.556951 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b75rk\" (UniqueName: \"kubernetes.io/projected/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-kube-api-access-b75rk\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.556964 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.556975 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43d73e3e-3fcd-4c24-9736-563f8e6fdef8-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.904109 4769 generic.go:334] "Generic (PLEG): container finished" podID="43d73e3e-3fcd-4c24-9736-563f8e6fdef8" containerID="306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6" exitCode=0 Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.904220 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.904253 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" event={"ID":"43d73e3e-3fcd-4c24-9736-563f8e6fdef8","Type":"ContainerDied","Data":"306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6"} Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.904339 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c67b85d56-82gjk" event={"ID":"43d73e3e-3fcd-4c24-9736-563f8e6fdef8","Type":"ContainerDied","Data":"afd7e8b0f02aa442a49e41b4b78b652f49342003b48b15fc625a7541220f9544"} Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.904363 4769 scope.go:117] "RemoveContainer" containerID="306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.940653 4769 scope.go:117] "RemoveContainer" containerID="306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6" Nov 21 13:58:16 crc kubenswrapper[4769]: E1121 13:58:16.943455 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6\": container with ID starting with 306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6 not found: ID does not exist" containerID="306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.943520 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6"} err="failed to get container status \"306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6\": rpc error: code = NotFound desc = could not find container \"306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6\": container with ID starting with 306eaee4e3d855f6ad280092818d1001b4c74d96005b310f02f0d269353cd6c6 not found: ID does not exist" Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.956825 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-c67b85d56-82gjk"] Nov 21 13:58:16 crc kubenswrapper[4769]: I1121 13:58:16.961820 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-c67b85d56-82gjk"] Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.174255 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.269093 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhv4m\" (UniqueName: \"kubernetes.io/projected/3b64085c-4e50-4977-b95c-564bbf402ce8-kube-api-access-vhv4m\") pod \"3b64085c-4e50-4977-b95c-564bbf402ce8\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.269140 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b64085c-4e50-4977-b95c-564bbf402ce8-operator-scripts\") pod \"3b64085c-4e50-4977-b95c-564bbf402ce8\" (UID: \"3b64085c-4e50-4977-b95c-564bbf402ce8\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.269872 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b64085c-4e50-4977-b95c-564bbf402ce8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3b64085c-4e50-4977-b95c-564bbf402ce8" (UID: "3b64085c-4e50-4977-b95c-564bbf402ce8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.275376 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b64085c-4e50-4977-b95c-564bbf402ce8-kube-api-access-vhv4m" (OuterVolumeSpecName: "kube-api-access-vhv4m") pod "3b64085c-4e50-4977-b95c-564bbf402ce8" (UID: "3b64085c-4e50-4977-b95c-564bbf402ce8"). InnerVolumeSpecName "kube-api-access-vhv4m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.282859 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43d73e3e-3fcd-4c24-9736-563f8e6fdef8" path="/var/lib/kubelet/pods/43d73e3e-3fcd-4c24-9736-563f8e6fdef8/volumes" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.370661 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vhv4m\" (UniqueName: \"kubernetes.io/projected/3b64085c-4e50-4977-b95c-564bbf402ce8-kube-api-access-vhv4m\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.370698 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3b64085c-4e50-4977-b95c-564bbf402ce8-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.675126 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.777343 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-scripts\") pod \"be519567-6b74-4e68-bbdc-d76dc878b9f3\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.777610 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-config-data\") pod \"be519567-6b74-4e68-bbdc-d76dc878b9f3\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.777650 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-fernet-keys\") pod \"be519567-6b74-4e68-bbdc-d76dc878b9f3\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.777712 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5qkt\" (UniqueName: \"kubernetes.io/projected/be519567-6b74-4e68-bbdc-d76dc878b9f3-kube-api-access-f5qkt\") pod \"be519567-6b74-4e68-bbdc-d76dc878b9f3\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.777764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-credential-keys\") pod \"be519567-6b74-4e68-bbdc-d76dc878b9f3\" (UID: \"be519567-6b74-4e68-bbdc-d76dc878b9f3\") " Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.782080 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-scripts" (OuterVolumeSpecName: "scripts") pod "be519567-6b74-4e68-bbdc-d76dc878b9f3" (UID: "be519567-6b74-4e68-bbdc-d76dc878b9f3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.782248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "be519567-6b74-4e68-bbdc-d76dc878b9f3" (UID: "be519567-6b74-4e68-bbdc-d76dc878b9f3"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.782335 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "be519567-6b74-4e68-bbdc-d76dc878b9f3" (UID: "be519567-6b74-4e68-bbdc-d76dc878b9f3"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.782463 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be519567-6b74-4e68-bbdc-d76dc878b9f3-kube-api-access-f5qkt" (OuterVolumeSpecName: "kube-api-access-f5qkt") pod "be519567-6b74-4e68-bbdc-d76dc878b9f3" (UID: "be519567-6b74-4e68-bbdc-d76dc878b9f3"). InnerVolumeSpecName "kube-api-access-f5qkt". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.800602 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-config-data" (OuterVolumeSpecName: "config-data") pod "be519567-6b74-4e68-bbdc-d76dc878b9f3" (UID: "be519567-6b74-4e68-bbdc-d76dc878b9f3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.879081 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-f5qkt\" (UniqueName: \"kubernetes.io/projected/be519567-6b74-4e68-bbdc-d76dc878b9f3-kube-api-access-f5qkt\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.879119 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.879132 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.879140 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.879149 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be519567-6b74-4e68-bbdc-d76dc878b9f3-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.911013 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.911010 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone9b80-account-delete-bpbp5" event={"ID":"3b64085c-4e50-4977-b95c-564bbf402ce8","Type":"ContainerDied","Data":"da16ab671b37d532a4d8c1da4b977702680623a181efca98767cdd357a35aec6"} Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.911154 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da16ab671b37d532a4d8c1da4b977702680623a181efca98767cdd357a35aec6" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.916731 4769 generic.go:334] "Generic (PLEG): container finished" podID="be519567-6b74-4e68-bbdc-d76dc878b9f3" containerID="9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6" exitCode=0 Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.916782 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" event={"ID":"be519567-6b74-4e68-bbdc-d76dc878b9f3","Type":"ContainerDied","Data":"9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6"} Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.916808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" event={"ID":"be519567-6b74-4e68-bbdc-d76dc878b9f3","Type":"ContainerDied","Data":"e6b4b20c8fcae9b756ed1803c5bca0d4a3f57b0dac0ad0cfd01f535e43f51f56"} Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.916816 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.916826 4769 scope.go:117] "RemoveContainer" containerID="9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.940646 4769 scope.go:117] "RemoveContainer" containerID="9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6" Nov 21 13:58:17 crc kubenswrapper[4769]: E1121 13:58:17.941231 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6\": container with ID starting with 9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6 not found: ID does not exist" containerID="9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.943437 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6"} err="failed to get container status \"9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6\": rpc error: code = NotFound desc = could not find container \"9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6\": container with ID starting with 9d3c2c38ef0710ad6e08f6a4152f5b206b06ada6fa523dd30f7953f9098beda6 not found: ID does not exist" Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.954208 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm"] Nov 21 13:58:17 crc kubenswrapper[4769]: I1121 13:58:17.959030 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-7b556d4cc7-v2bcm"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.284341 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be519567-6b74-4e68-bbdc-d76dc878b9f3" path="/var/lib/kubelet/pods/be519567-6b74-4e68-bbdc-d76dc878b9f3/volumes" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.392799 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-fmjct"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.397847 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-fmjct"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.405266 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone9b80-account-delete-bpbp5"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.412591 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-9b80-account-create-update-htr25"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.419945 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone9b80-account-delete-bpbp5"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.426361 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-9b80-account-create-update-htr25"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488278 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-w696f"] Nov 21 13:58:19 crc kubenswrapper[4769]: E1121 13:58:19.488640 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="43d73e3e-3fcd-4c24-9736-563f8e6fdef8" containerName="keystone-api" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488662 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d73e3e-3fcd-4c24-9736-563f8e6fdef8" containerName="keystone-api" Nov 21 13:58:19 crc kubenswrapper[4769]: E1121 13:58:19.488684 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="be519567-6b74-4e68-bbdc-d76dc878b9f3" containerName="keystone-api" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488694 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="be519567-6b74-4e68-bbdc-d76dc878b9f3" containerName="keystone-api" Nov 21 13:58:19 crc kubenswrapper[4769]: E1121 13:58:19.488709 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3b64085c-4e50-4977-b95c-564bbf402ce8" containerName="mariadb-account-delete" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488719 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b64085c-4e50-4977-b95c-564bbf402ce8" containerName="mariadb-account-delete" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488910 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="3b64085c-4e50-4977-b95c-564bbf402ce8" containerName="mariadb-account-delete" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488931 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="43d73e3e-3fcd-4c24-9736-563f8e6fdef8" containerName="keystone-api" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.488941 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="be519567-6b74-4e68-bbdc-d76dc878b9f3" containerName="keystone-api" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.489491 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.503012 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-w696f"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.503117 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsmml\" (UniqueName: \"kubernetes.io/projected/c54f7338-a769-4d6c-b96f-fbb2fa2982be-kube-api-access-qsmml\") pod \"keystone-db-create-w696f\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.503276 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c54f7338-a769-4d6c-b96f-fbb2fa2982be-operator-scripts\") pod \"keystone-db-create-w696f\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.588027 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.589041 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.590806 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-db-secret" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.599112 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg"] Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.604177 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c54f7338-a769-4d6c-b96f-fbb2fa2982be-operator-scripts\") pod \"keystone-db-create-w696f\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.604284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtd9l\" (UniqueName: \"kubernetes.io/projected/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-kube-api-access-qtd9l\") pod \"keystone-75f5-account-create-update-x58sg\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.604337 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-operator-scripts\") pod \"keystone-75f5-account-create-update-x58sg\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.604384 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qsmml\" (UniqueName: \"kubernetes.io/projected/c54f7338-a769-4d6c-b96f-fbb2fa2982be-kube-api-access-qsmml\") pod \"keystone-db-create-w696f\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.605050 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c54f7338-a769-4d6c-b96f-fbb2fa2982be-operator-scripts\") pod \"keystone-db-create-w696f\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.625959 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsmml\" (UniqueName: \"kubernetes.io/projected/c54f7338-a769-4d6c-b96f-fbb2fa2982be-kube-api-access-qsmml\") pod \"keystone-db-create-w696f\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.706106 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qtd9l\" (UniqueName: \"kubernetes.io/projected/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-kube-api-access-qtd9l\") pod \"keystone-75f5-account-create-update-x58sg\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.706175 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-operator-scripts\") pod \"keystone-75f5-account-create-update-x58sg\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.706968 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-operator-scripts\") pod \"keystone-75f5-account-create-update-x58sg\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.722847 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtd9l\" (UniqueName: \"kubernetes.io/projected/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-kube-api-access-qtd9l\") pod \"keystone-75f5-account-create-update-x58sg\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.812425 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:19 crc kubenswrapper[4769]: I1121 13:58:19.908283 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.256288 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-w696f"] Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.326771 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg"] Nov 21 13:58:20 crc kubenswrapper[4769]: W1121 13:58:20.335025 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7ef7cb5_4fb3_449f_b4d1_3c3fb565d36f.slice/crio-30522ad292eab3e4b18201c2e50c28bbbad1493469cb7310956b50fdcc60073e WatchSource:0}: Error finding container 30522ad292eab3e4b18201c2e50c28bbbad1493469cb7310956b50fdcc60073e: Status 404 returned error can't find the container with id 30522ad292eab3e4b18201c2e50c28bbbad1493469cb7310956b50fdcc60073e Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.942408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" event={"ID":"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f","Type":"ContainerStarted","Data":"da0cf401961b39e1222e6aba684e17553a4259aa4b957e3166c95bbf9bc2e7b1"} Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.942475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" event={"ID":"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f","Type":"ContainerStarted","Data":"30522ad292eab3e4b18201c2e50c28bbbad1493469cb7310956b50fdcc60073e"} Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.944165 4769 generic.go:334] "Generic (PLEG): container finished" podID="c54f7338-a769-4d6c-b96f-fbb2fa2982be" containerID="56c4cf059d6a9304ed2a6c88b12b794fc42a975d697f93ec03f9790f63659021" exitCode=0 Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.944383 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-w696f" event={"ID":"c54f7338-a769-4d6c-b96f-fbb2fa2982be","Type":"ContainerDied","Data":"56c4cf059d6a9304ed2a6c88b12b794fc42a975d697f93ec03f9790f63659021"} Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.945657 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-w696f" event={"ID":"c54f7338-a769-4d6c-b96f-fbb2fa2982be","Type":"ContainerStarted","Data":"c55d0d4899691e6d982b22bdaa39776cefa2c4895798027079046de9376a3093"} Nov 21 13:58:20 crc kubenswrapper[4769]: I1121 13:58:20.970228 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" podStartSLOduration=1.970170919 podStartE2EDuration="1.970170919s" podCreationTimestamp="2025-11-21 13:58:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:58:20.959445993 +0000 UTC m=+7659.660107851" watchObservedRunningTime="2025-11-21 13:58:20.970170919 +0000 UTC m=+7659.670832767" Nov 21 13:58:21 crc kubenswrapper[4769]: I1121 13:58:21.287265 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f00d99-4f44-48e5-a946-0b44676fb8bd" path="/var/lib/kubelet/pods/39f00d99-4f44-48e5-a946-0b44676fb8bd/volumes" Nov 21 13:58:21 crc kubenswrapper[4769]: I1121 13:58:21.288014 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b64085c-4e50-4977-b95c-564bbf402ce8" path="/var/lib/kubelet/pods/3b64085c-4e50-4977-b95c-564bbf402ce8/volumes" Nov 21 13:58:21 crc kubenswrapper[4769]: I1121 13:58:21.288510 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9" path="/var/lib/kubelet/pods/8fbe6b99-3cec-4cea-9bfc-d863e5c88ad9/volumes" Nov 21 13:58:21 crc kubenswrapper[4769]: I1121 13:58:21.955869 4769 generic.go:334] "Generic (PLEG): container finished" podID="f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" containerID="da0cf401961b39e1222e6aba684e17553a4259aa4b957e3166c95bbf9bc2e7b1" exitCode=0 Nov 21 13:58:21 crc kubenswrapper[4769]: I1121 13:58:21.956015 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" event={"ID":"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f","Type":"ContainerDied","Data":"da0cf401961b39e1222e6aba684e17553a4259aa4b957e3166c95bbf9bc2e7b1"} Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.227757 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.244217 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c54f7338-a769-4d6c-b96f-fbb2fa2982be-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c54f7338-a769-4d6c-b96f-fbb2fa2982be" (UID: "c54f7338-a769-4d6c-b96f-fbb2fa2982be"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.244280 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c54f7338-a769-4d6c-b96f-fbb2fa2982be-operator-scripts\") pod \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.244383 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsmml\" (UniqueName: \"kubernetes.io/projected/c54f7338-a769-4d6c-b96f-fbb2fa2982be-kube-api-access-qsmml\") pod \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\" (UID: \"c54f7338-a769-4d6c-b96f-fbb2fa2982be\") " Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.244827 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c54f7338-a769-4d6c-b96f-fbb2fa2982be-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.256682 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54f7338-a769-4d6c-b96f-fbb2fa2982be-kube-api-access-qsmml" (OuterVolumeSpecName: "kube-api-access-qsmml") pod "c54f7338-a769-4d6c-b96f-fbb2fa2982be" (UID: "c54f7338-a769-4d6c-b96f-fbb2fa2982be"). InnerVolumeSpecName "kube-api-access-qsmml". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.346369 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qsmml\" (UniqueName: \"kubernetes.io/projected/c54f7338-a769-4d6c-b96f-fbb2fa2982be-kube-api-access-qsmml\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.966099 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-w696f" event={"ID":"c54f7338-a769-4d6c-b96f-fbb2fa2982be","Type":"ContainerDied","Data":"c55d0d4899691e6d982b22bdaa39776cefa2c4895798027079046de9376a3093"} Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.966130 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-w696f" Nov 21 13:58:22 crc kubenswrapper[4769]: I1121 13:58:22.966149 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c55d0d4899691e6d982b22bdaa39776cefa2c4895798027079046de9376a3093" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.221813 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.268100 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-operator-scripts\") pod \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.268163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtd9l\" (UniqueName: \"kubernetes.io/projected/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-kube-api-access-qtd9l\") pod \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\" (UID: \"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f\") " Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.270377 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" (UID: "f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.286892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-kube-api-access-qtd9l" (OuterVolumeSpecName: "kube-api-access-qtd9l") pod "f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" (UID: "f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f"). InnerVolumeSpecName "kube-api-access-qtd9l". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.370630 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.370670 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qtd9l\" (UniqueName: \"kubernetes.io/projected/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f-kube-api-access-qtd9l\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.980024 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" event={"ID":"f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f","Type":"ContainerDied","Data":"30522ad292eab3e4b18201c2e50c28bbbad1493469cb7310956b50fdcc60073e"} Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.980113 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30522ad292eab3e4b18201c2e50c28bbbad1493469cb7310956b50fdcc60073e" Nov 21 13:58:23 crc kubenswrapper[4769]: I1121 13:58:23.980119 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.159435 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-kptzb"] Nov 21 13:58:25 crc kubenswrapper[4769]: E1121 13:58:25.160094 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" containerName="mariadb-account-create-update" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.160116 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" containerName="mariadb-account-create-update" Nov 21 13:58:25 crc kubenswrapper[4769]: E1121 13:58:25.160128 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c54f7338-a769-4d6c-b96f-fbb2fa2982be" containerName="mariadb-database-create" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.160136 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54f7338-a769-4d6c-b96f-fbb2fa2982be" containerName="mariadb-database-create" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.160355 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c54f7338-a769-4d6c-b96f-fbb2fa2982be" containerName="mariadb-database-create" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.160373 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" containerName="mariadb-account-create-update" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.161045 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.163408 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.163878 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.164209 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-cnstt" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.166428 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-kptzb"] Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.166690 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.201813 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-config-data\") pod \"keystone-db-sync-kptzb\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.201886 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbhw\" (UniqueName: \"kubernetes.io/projected/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-kube-api-access-2lbhw\") pod \"keystone-db-sync-kptzb\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.304081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-config-data\") pod \"keystone-db-sync-kptzb\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.304236 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbhw\" (UniqueName: \"kubernetes.io/projected/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-kube-api-access-2lbhw\") pod \"keystone-db-sync-kptzb\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.309065 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-config-data\") pod \"keystone-db-sync-kptzb\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.321744 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbhw\" (UniqueName: \"kubernetes.io/projected/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-kube-api-access-2lbhw\") pod \"keystone-db-sync-kptzb\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.482688 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:25 crc kubenswrapper[4769]: I1121 13:58:25.899426 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-kptzb"] Nov 21 13:58:26 crc kubenswrapper[4769]: I1121 13:58:25.999875 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" event={"ID":"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75","Type":"ContainerStarted","Data":"7815dd0a2c3aeaadb2ca11f3bb691b8d45df706e0727b2763dd4f04ab7781805"} Nov 21 13:58:27 crc kubenswrapper[4769]: I1121 13:58:27.007898 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" event={"ID":"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75","Type":"ContainerStarted","Data":"d4fb53901a7bf2aaf1bfbd09ad74aae90260b6244aa49f80e5192e7ca0e798bb"} Nov 21 13:58:28 crc kubenswrapper[4769]: I1121 13:58:28.021045 4769 generic.go:334] "Generic (PLEG): container finished" podID="7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" containerID="d4fb53901a7bf2aaf1bfbd09ad74aae90260b6244aa49f80e5192e7ca0e798bb" exitCode=0 Nov 21 13:58:28 crc kubenswrapper[4769]: I1121 13:58:28.021180 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" event={"ID":"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75","Type":"ContainerDied","Data":"d4fb53901a7bf2aaf1bfbd09ad74aae90260b6244aa49f80e5192e7ca0e798bb"} Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.359332 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.474097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lbhw\" (UniqueName: \"kubernetes.io/projected/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-kube-api-access-2lbhw\") pod \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.474562 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-config-data\") pod \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\" (UID: \"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75\") " Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.483213 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-kube-api-access-2lbhw" (OuterVolumeSpecName: "kube-api-access-2lbhw") pod "7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" (UID: "7e2c4b3a-756f-4b56-aa09-5ca99a6dea75"). InnerVolumeSpecName "kube-api-access-2lbhw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.534050 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-config-data" (OuterVolumeSpecName: "config-data") pod "7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" (UID: "7e2c4b3a-756f-4b56-aa09-5ca99a6dea75"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.576200 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:29 crc kubenswrapper[4769]: I1121 13:58:29.576235 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2lbhw\" (UniqueName: \"kubernetes.io/projected/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75-kube-api-access-2lbhw\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.058330 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" event={"ID":"7e2c4b3a-756f-4b56-aa09-5ca99a6dea75","Type":"ContainerDied","Data":"7815dd0a2c3aeaadb2ca11f3bb691b8d45df706e0727b2763dd4f04ab7781805"} Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.058385 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7815dd0a2c3aeaadb2ca11f3bb691b8d45df706e0727b2763dd4f04ab7781805" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.058450 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-kptzb" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.227371 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-vd256"] Nov 21 13:58:30 crc kubenswrapper[4769]: E1121 13:58:30.227766 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" containerName="keystone-db-sync" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.227783 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" containerName="keystone-db-sync" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.227963 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" containerName="keystone-db-sync" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.228911 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.232837 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.233326 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-cnstt" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.233531 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"osp-secret" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.237571 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.237608 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.244479 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-vd256"] Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.287698 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-config-data\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.288398 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-scripts\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.288470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-credential-keys\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.288791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzg7\" (UniqueName: \"kubernetes.io/projected/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-kube-api-access-sbzg7\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.288946 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-fernet-keys\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.391419 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzg7\" (UniqueName: \"kubernetes.io/projected/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-kube-api-access-sbzg7\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.391526 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-fernet-keys\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.391609 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-config-data\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.391648 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-scripts\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.391687 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-credential-keys\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.396495 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-config-data\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.396501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-fernet-keys\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.396558 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-credential-keys\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.396856 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-scripts\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.408763 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzg7\" (UniqueName: \"kubernetes.io/projected/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-kube-api-access-sbzg7\") pod \"keystone-bootstrap-vd256\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:30 crc kubenswrapper[4769]: I1121 13:58:30.552466 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:31 crc kubenswrapper[4769]: I1121 13:58:31.043516 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-vd256"] Nov 21 13:58:31 crc kubenswrapper[4769]: I1121 13:58:31.069867 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" event={"ID":"fdef1a11-e522-4b65-b3a1-5d45955ce7e2","Type":"ContainerStarted","Data":"daf1b6a0137d6ef653411dbcd65fe7eb752382871af0065406540a64b7cc64a0"} Nov 21 13:58:32 crc kubenswrapper[4769]: I1121 13:58:32.079610 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" event={"ID":"fdef1a11-e522-4b65-b3a1-5d45955ce7e2","Type":"ContainerStarted","Data":"e477462c51425fc436adcd23db5069e7d228e379dddaabd44a8acb7c3fca49c7"} Nov 21 13:58:32 crc kubenswrapper[4769]: I1121 13:58:32.101296 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" podStartSLOduration=2.101272576 podStartE2EDuration="2.101272576s" podCreationTimestamp="2025-11-21 13:58:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:58:32.097627649 +0000 UTC m=+7670.798289477" watchObservedRunningTime="2025-11-21 13:58:32.101272576 +0000 UTC m=+7670.801934384" Nov 21 13:58:34 crc kubenswrapper[4769]: I1121 13:58:34.126222 4769 generic.go:334] "Generic (PLEG): container finished" podID="fdef1a11-e522-4b65-b3a1-5d45955ce7e2" containerID="e477462c51425fc436adcd23db5069e7d228e379dddaabd44a8acb7c3fca49c7" exitCode=0 Nov 21 13:58:34 crc kubenswrapper[4769]: I1121 13:58:34.126334 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" event={"ID":"fdef1a11-e522-4b65-b3a1-5d45955ce7e2","Type":"ContainerDied","Data":"e477462c51425fc436adcd23db5069e7d228e379dddaabd44a8acb7c3fca49c7"} Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.505868 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.675505 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbzg7\" (UniqueName: \"kubernetes.io/projected/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-kube-api-access-sbzg7\") pod \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.676204 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-credential-keys\") pod \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.676336 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-fernet-keys\") pod \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.677584 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-config-data\") pod \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.677637 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-scripts\") pod \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\" (UID: \"fdef1a11-e522-4b65-b3a1-5d45955ce7e2\") " Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.683588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-kube-api-access-sbzg7" (OuterVolumeSpecName: "kube-api-access-sbzg7") pod "fdef1a11-e522-4b65-b3a1-5d45955ce7e2" (UID: "fdef1a11-e522-4b65-b3a1-5d45955ce7e2"). InnerVolumeSpecName "kube-api-access-sbzg7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.684011 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-scripts" (OuterVolumeSpecName: "scripts") pod "fdef1a11-e522-4b65-b3a1-5d45955ce7e2" (UID: "fdef1a11-e522-4b65-b3a1-5d45955ce7e2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.684090 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "fdef1a11-e522-4b65-b3a1-5d45955ce7e2" (UID: "fdef1a11-e522-4b65-b3a1-5d45955ce7e2"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.684276 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "fdef1a11-e522-4b65-b3a1-5d45955ce7e2" (UID: "fdef1a11-e522-4b65-b3a1-5d45955ce7e2"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.700813 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-config-data" (OuterVolumeSpecName: "config-data") pod "fdef1a11-e522-4b65-b3a1-5d45955ce7e2" (UID: "fdef1a11-e522-4b65-b3a1-5d45955ce7e2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.779716 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sbzg7\" (UniqueName: \"kubernetes.io/projected/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-kube-api-access-sbzg7\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.779832 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.779897 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.779920 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:35 crc kubenswrapper[4769]: I1121 13:58:35.779978 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fdef1a11-e522-4b65-b3a1-5d45955ce7e2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.148945 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" event={"ID":"fdef1a11-e522-4b65-b3a1-5d45955ce7e2","Type":"ContainerDied","Data":"daf1b6a0137d6ef653411dbcd65fe7eb752382871af0065406540a64b7cc64a0"} Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.149698 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daf1b6a0137d6ef653411dbcd65fe7eb752382871af0065406540a64b7cc64a0" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.149232 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-vd256" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.238238 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd"] Nov 21 13:58:36 crc kubenswrapper[4769]: E1121 13:58:36.238550 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fdef1a11-e522-4b65-b3a1-5d45955ce7e2" containerName="keystone-bootstrap" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.238567 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdef1a11-e522-4b65-b3a1-5d45955ce7e2" containerName="keystone-bootstrap" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.238685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fdef1a11-e522-4b65-b3a1-5d45955ce7e2" containerName="keystone-bootstrap" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.239180 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.241043 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.241556 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-cnstt" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.241679 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.242083 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.254988 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd"] Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.289043 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-config-data\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.289111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqdc9\" (UniqueName: \"kubernetes.io/projected/e4fe765e-bdd9-41d7-a6bb-7336497224ac-kube-api-access-cqdc9\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.289162 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-fernet-keys\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.289383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-scripts\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.289640 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-credential-keys\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.393427 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-scripts\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.393616 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-credential-keys\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.394312 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-config-data\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.394351 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cqdc9\" (UniqueName: \"kubernetes.io/projected/e4fe765e-bdd9-41d7-a6bb-7336497224ac-kube-api-access-cqdc9\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.394390 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-fernet-keys\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.400818 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-scripts\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.401009 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-credential-keys\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.401284 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-config-data\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.401376 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-fernet-keys\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.415415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqdc9\" (UniqueName: \"kubernetes.io/projected/e4fe765e-bdd9-41d7-a6bb-7336497224ac-kube-api-access-cqdc9\") pod \"keystone-68c4cd4f89-ztfnd\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.566899 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:36 crc kubenswrapper[4769]: I1121 13:58:36.967601 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd"] Nov 21 13:58:37 crc kubenswrapper[4769]: I1121 13:58:37.158484 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" event={"ID":"e4fe765e-bdd9-41d7-a6bb-7336497224ac","Type":"ContainerStarted","Data":"8c5dfa289a3fb31826b7dad7d54e62542ac97db76e1f81a5a6f7cbeb6b967cfe"} Nov 21 13:58:38 crc kubenswrapper[4769]: I1121 13:58:38.167227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" event={"ID":"e4fe765e-bdd9-41d7-a6bb-7336497224ac","Type":"ContainerStarted","Data":"3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e"} Nov 21 13:58:38 crc kubenswrapper[4769]: I1121 13:58:38.167713 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:58:38 crc kubenswrapper[4769]: I1121 13:58:38.191634 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" podStartSLOduration=2.191601493 podStartE2EDuration="2.191601493s" podCreationTimestamp="2025-11-21 13:58:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:58:38.186710142 +0000 UTC m=+7676.887371970" watchObservedRunningTime="2025-11-21 13:58:38.191601493 +0000 UTC m=+7676.892263331" Nov 21 13:59:08 crc kubenswrapper[4769]: I1121 13:59:08.072914 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.556060 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-xntgh"] Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.557522 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.569533 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-rw67g"] Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.571099 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.583910 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-xntgh"] Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.604096 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-rw67g"] Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.628580 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htz9r\" (UniqueName: \"kubernetes.io/projected/2e6d012e-e745-4c59-ba09-0dcd973f2de2-kube-api-access-htz9r\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.628634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-fernet-keys\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.628680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-credential-keys\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.628829 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-scripts\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.628890 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-config-data\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.628971 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-config-data\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.629016 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-fernet-keys\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.629057 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-credential-keys\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.629123 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-scripts\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.629269 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmp75\" (UniqueName: \"kubernetes.io/projected/51c10906-bd59-45d3-96b3-18d2bb97c96f-kube-api-access-dmp75\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-scripts\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730241 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-config-data\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730270 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-config-data\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730291 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-fernet-keys\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730313 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-credential-keys\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-scripts\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730383 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dmp75\" (UniqueName: \"kubernetes.io/projected/51c10906-bd59-45d3-96b3-18d2bb97c96f-kube-api-access-dmp75\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730418 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-htz9r\" (UniqueName: \"kubernetes.io/projected/2e6d012e-e745-4c59-ba09-0dcd973f2de2-kube-api-access-htz9r\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730479 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-fernet-keys\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.730498 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-credential-keys\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.736164 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-scripts\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.736644 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-fernet-keys\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.736683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-credential-keys\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.737053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-fernet-keys\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.738120 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-credential-keys\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.739068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-config-data\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.739642 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-config-data\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.739912 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-scripts\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.747406 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmp75\" (UniqueName: \"kubernetes.io/projected/51c10906-bd59-45d3-96b3-18d2bb97c96f-kube-api-access-dmp75\") pod \"keystone-68c4cd4f89-xntgh\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.747629 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-htz9r\" (UniqueName: \"kubernetes.io/projected/2e6d012e-e745-4c59-ba09-0dcd973f2de2-kube-api-access-htz9r\") pod \"keystone-68c4cd4f89-rw67g\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.891479 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:09 crc kubenswrapper[4769]: I1121 13:59:09.905237 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.167491 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-xntgh"] Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.216845 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-rw67g"] Nov 21 13:59:10 crc kubenswrapper[4769]: W1121 13:59:10.225587 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6d012e_e745_4c59_ba09_0dcd973f2de2.slice/crio-1219f38f11334337d725521abf6c593622f8aedd4c9c953cc9ea3b595e29e357 WatchSource:0}: Error finding container 1219f38f11334337d725521abf6c593622f8aedd4c9c953cc9ea3b595e29e357: Status 404 returned error can't find the container with id 1219f38f11334337d725521abf6c593622f8aedd4c9c953cc9ea3b595e29e357 Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.636442 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" event={"ID":"51c10906-bd59-45d3-96b3-18d2bb97c96f","Type":"ContainerStarted","Data":"b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5"} Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.637848 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" event={"ID":"51c10906-bd59-45d3-96b3-18d2bb97c96f","Type":"ContainerStarted","Data":"318af30f59f0c5dea6af63af270bd730b4af2726fec9cbcbaecc8a03032f6deb"} Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.639340 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.641146 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" event={"ID":"2e6d012e-e745-4c59-ba09-0dcd973f2de2","Type":"ContainerStarted","Data":"caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb"} Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.641303 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" event={"ID":"2e6d012e-e745-4c59-ba09-0dcd973f2de2","Type":"ContainerStarted","Data":"1219f38f11334337d725521abf6c593622f8aedd4c9c953cc9ea3b595e29e357"} Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.641969 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:10 crc kubenswrapper[4769]: I1121 13:59:10.664948 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" podStartSLOduration=1.664934168 podStartE2EDuration="1.664934168s" podCreationTimestamp="2025-11-21 13:59:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:59:10.66314699 +0000 UTC m=+7709.363808808" watchObservedRunningTime="2025-11-21 13:59:10.664934168 +0000 UTC m=+7709.365595986" Nov 21 13:59:11 crc kubenswrapper[4769]: I1121 13:59:11.325670 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:59:11 crc kubenswrapper[4769]: I1121 13:59:11.326030 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:59:13 crc kubenswrapper[4769]: I1121 13:59:13.397719 4769 scope.go:117] "RemoveContainer" containerID="3af7d7cb2b124f8d715ee682a34cadb49ba88d24f95c5790135968cd1a7a1a85" Nov 21 13:59:13 crc kubenswrapper[4769]: I1121 13:59:13.426314 4769 scope.go:117] "RemoveContainer" containerID="b21c52c4ed075aa300e965c904732331817ffcbaa63220141d36f02a2d4d0eb9" Nov 21 13:59:41 crc kubenswrapper[4769]: I1121 13:59:41.325144 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 13:59:41 crc kubenswrapper[4769]: I1121 13:59:41.325751 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 13:59:41 crc kubenswrapper[4769]: I1121 13:59:41.343680 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:41 crc kubenswrapper[4769]: I1121 13:59:41.372332 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" podStartSLOduration=32.372311332 podStartE2EDuration="32.372311332s" podCreationTimestamp="2025-11-21 13:59:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 13:59:10.750919628 +0000 UTC m=+7709.451581466" watchObservedRunningTime="2025-11-21 13:59:41.372311332 +0000 UTC m=+7740.072973150" Nov 21 13:59:41 crc kubenswrapper[4769]: I1121 13:59:41.504426 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:42 crc kubenswrapper[4769]: I1121 13:59:42.684754 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-xntgh"] Nov 21 13:59:42 crc kubenswrapper[4769]: I1121 13:59:42.684939 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" podUID="51c10906-bd59-45d3-96b3-18d2bb97c96f" containerName="keystone-api" containerID="cri-o://b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5" gracePeriod=30 Nov 21 13:59:42 crc kubenswrapper[4769]: I1121 13:59:42.699813 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-rw67g"] Nov 21 13:59:42 crc kubenswrapper[4769]: I1121 13:59:42.700343 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" podUID="2e6d012e-e745-4c59-ba09-0dcd973f2de2" containerName="keystone-api" containerID="cri-o://caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb" gracePeriod=30 Nov 21 13:59:43 crc kubenswrapper[4769]: I1121 13:59:43.925167 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd"] Nov 21 13:59:43 crc kubenswrapper[4769]: I1121 13:59:43.926920 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" podUID="e4fe765e-bdd9-41d7-a6bb-7336497224ac" containerName="keystone-api" containerID="cri-o://3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e" gracePeriod=30 Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.786392 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.792476 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.893640 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-config-data\") pod \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.893731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-credential-keys\") pod \"51c10906-bd59-45d3-96b3-18d2bb97c96f\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.893847 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-fernet-keys\") pod \"51c10906-bd59-45d3-96b3-18d2bb97c96f\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.893881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htz9r\" (UniqueName: \"kubernetes.io/projected/2e6d012e-e745-4c59-ba09-0dcd973f2de2-kube-api-access-htz9r\") pod \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.893906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-config-data\") pod \"51c10906-bd59-45d3-96b3-18d2bb97c96f\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.894000 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-scripts\") pod \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.894070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmp75\" (UniqueName: \"kubernetes.io/projected/51c10906-bd59-45d3-96b3-18d2bb97c96f-kube-api-access-dmp75\") pod \"51c10906-bd59-45d3-96b3-18d2bb97c96f\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.894097 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-credential-keys\") pod \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.894137 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-scripts\") pod \"51c10906-bd59-45d3-96b3-18d2bb97c96f\" (UID: \"51c10906-bd59-45d3-96b3-18d2bb97c96f\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.894163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-fernet-keys\") pod \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\" (UID: \"2e6d012e-e745-4c59-ba09-0dcd973f2de2\") " Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.900750 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-scripts" (OuterVolumeSpecName: "scripts") pod "51c10906-bd59-45d3-96b3-18d2bb97c96f" (UID: "51c10906-bd59-45d3-96b3-18d2bb97c96f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.901867 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "2e6d012e-e745-4c59-ba09-0dcd973f2de2" (UID: "2e6d012e-e745-4c59-ba09-0dcd973f2de2"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.906767 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "51c10906-bd59-45d3-96b3-18d2bb97c96f" (UID: "51c10906-bd59-45d3-96b3-18d2bb97c96f"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.906882 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6d012e-e745-4c59-ba09-0dcd973f2de2-kube-api-access-htz9r" (OuterVolumeSpecName: "kube-api-access-htz9r") pod "2e6d012e-e745-4c59-ba09-0dcd973f2de2" (UID: "2e6d012e-e745-4c59-ba09-0dcd973f2de2"). InnerVolumeSpecName "kube-api-access-htz9r". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.907007 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c10906-bd59-45d3-96b3-18d2bb97c96f-kube-api-access-dmp75" (OuterVolumeSpecName: "kube-api-access-dmp75") pod "51c10906-bd59-45d3-96b3-18d2bb97c96f" (UID: "51c10906-bd59-45d3-96b3-18d2bb97c96f"). InnerVolumeSpecName "kube-api-access-dmp75". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.907051 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-scripts" (OuterVolumeSpecName: "scripts") pod "2e6d012e-e745-4c59-ba09-0dcd973f2de2" (UID: "2e6d012e-e745-4c59-ba09-0dcd973f2de2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.909958 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "2e6d012e-e745-4c59-ba09-0dcd973f2de2" (UID: "2e6d012e-e745-4c59-ba09-0dcd973f2de2"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.910149 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "51c10906-bd59-45d3-96b3-18d2bb97c96f" (UID: "51c10906-bd59-45d3-96b3-18d2bb97c96f"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.923156 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-config-data" (OuterVolumeSpecName: "config-data") pod "51c10906-bd59-45d3-96b3-18d2bb97c96f" (UID: "51c10906-bd59-45d3-96b3-18d2bb97c96f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.928570 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-config-data" (OuterVolumeSpecName: "config-data") pod "2e6d012e-e745-4c59-ba09-0dcd973f2de2" (UID: "2e6d012e-e745-4c59-ba09-0dcd973f2de2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.950396 4769 generic.go:334] "Generic (PLEG): container finished" podID="51c10906-bd59-45d3-96b3-18d2bb97c96f" containerID="b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5" exitCode=0 Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.950488 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.950445 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" event={"ID":"51c10906-bd59-45d3-96b3-18d2bb97c96f","Type":"ContainerDied","Data":"b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5"} Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.951135 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-xntgh" event={"ID":"51c10906-bd59-45d3-96b3-18d2bb97c96f","Type":"ContainerDied","Data":"318af30f59f0c5dea6af63af270bd730b4af2726fec9cbcbaecc8a03032f6deb"} Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.951156 4769 scope.go:117] "RemoveContainer" containerID="b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.955308 4769 generic.go:334] "Generic (PLEG): container finished" podID="2e6d012e-e745-4c59-ba09-0dcd973f2de2" containerID="caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb" exitCode=0 Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.955355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" event={"ID":"2e6d012e-e745-4c59-ba09-0dcd973f2de2","Type":"ContainerDied","Data":"caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb"} Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.955593 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" event={"ID":"2e6d012e-e745-4c59-ba09-0dcd973f2de2","Type":"ContainerDied","Data":"1219f38f11334337d725521abf6c593622f8aedd4c9c953cc9ea3b595e29e357"} Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.955376 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-rw67g" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.989929 4769 scope.go:117] "RemoveContainer" containerID="b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5" Nov 21 13:59:46 crc kubenswrapper[4769]: E1121 13:59:46.990770 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5\": container with ID starting with b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5 not found: ID does not exist" containerID="b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.991810 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5"} err="failed to get container status \"b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5\": rpc error: code = NotFound desc = could not find container \"b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5\": container with ID starting with b4a55e5dbd7cf514e04dd6997697b9c4071431deb205e710529fb19b19b4c1c5 not found: ID does not exist" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.991870 4769 scope.go:117] "RemoveContainer" containerID="caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb" Nov 21 13:59:46 crc kubenswrapper[4769]: I1121 13:59:46.994808 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-xntgh"] Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001664 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001717 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-htz9r\" (UniqueName: \"kubernetes.io/projected/2e6d012e-e745-4c59-ba09-0dcd973f2de2-kube-api-access-htz9r\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001732 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001744 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001756 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dmp75\" (UniqueName: \"kubernetes.io/projected/51c10906-bd59-45d3-96b3-18d2bb97c96f-kube-api-access-dmp75\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001767 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001777 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001788 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001800 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e6d012e-e745-4c59-ba09-0dcd973f2de2-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.001811 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/51c10906-bd59-45d3-96b3-18d2bb97c96f-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.003286 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-xntgh"] Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.010396 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-rw67g"] Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.018176 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-rw67g"] Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.018760 4769 scope.go:117] "RemoveContainer" containerID="caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb" Nov 21 13:59:47 crc kubenswrapper[4769]: E1121 13:59:47.019324 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb\": container with ID starting with caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb not found: ID does not exist" containerID="caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.019454 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb"} err="failed to get container status \"caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb\": rpc error: code = NotFound desc = could not find container \"caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb\": container with ID starting with caca78c37bc29dd4d35bbdcee65e42621e924e9d512573fa5b5acb920130a2eb not found: ID does not exist" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.288536 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e6d012e-e745-4c59-ba09-0dcd973f2de2" path="/var/lib/kubelet/pods/2e6d012e-e745-4c59-ba09-0dcd973f2de2/volumes" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.289231 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c10906-bd59-45d3-96b3-18d2bb97c96f" path="/var/lib/kubelet/pods/51c10906-bd59-45d3-96b3-18d2bb97c96f/volumes" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.421838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.508665 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-credential-keys\") pod \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.508794 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-config-data\") pod \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.508862 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqdc9\" (UniqueName: \"kubernetes.io/projected/e4fe765e-bdd9-41d7-a6bb-7336497224ac-kube-api-access-cqdc9\") pod \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.508906 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-fernet-keys\") pod \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.508928 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-scripts\") pod \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\" (UID: \"e4fe765e-bdd9-41d7-a6bb-7336497224ac\") " Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.516466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "e4fe765e-bdd9-41d7-a6bb-7336497224ac" (UID: "e4fe765e-bdd9-41d7-a6bb-7336497224ac"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.516507 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-scripts" (OuterVolumeSpecName: "scripts") pod "e4fe765e-bdd9-41d7-a6bb-7336497224ac" (UID: "e4fe765e-bdd9-41d7-a6bb-7336497224ac"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.520749 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4fe765e-bdd9-41d7-a6bb-7336497224ac-kube-api-access-cqdc9" (OuterVolumeSpecName: "kube-api-access-cqdc9") pod "e4fe765e-bdd9-41d7-a6bb-7336497224ac" (UID: "e4fe765e-bdd9-41d7-a6bb-7336497224ac"). InnerVolumeSpecName "kube-api-access-cqdc9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.523861 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "e4fe765e-bdd9-41d7-a6bb-7336497224ac" (UID: "e4fe765e-bdd9-41d7-a6bb-7336497224ac"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.543022 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-config-data" (OuterVolumeSpecName: "config-data") pod "e4fe765e-bdd9-41d7-a6bb-7336497224ac" (UID: "e4fe765e-bdd9-41d7-a6bb-7336497224ac"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.610799 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.610847 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.610864 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cqdc9\" (UniqueName: \"kubernetes.io/projected/e4fe765e-bdd9-41d7-a6bb-7336497224ac-kube-api-access-cqdc9\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.610879 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.610891 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e4fe765e-bdd9-41d7-a6bb-7336497224ac-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.979209 4769 generic.go:334] "Generic (PLEG): container finished" podID="e4fe765e-bdd9-41d7-a6bb-7336497224ac" containerID="3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e" exitCode=0 Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.979472 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" event={"ID":"e4fe765e-bdd9-41d7-a6bb-7336497224ac","Type":"ContainerDied","Data":"3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e"} Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.979566 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" event={"ID":"e4fe765e-bdd9-41d7-a6bb-7336497224ac","Type":"ContainerDied","Data":"8c5dfa289a3fb31826b7dad7d54e62542ac97db76e1f81a5a6f7cbeb6b967cfe"} Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.979585 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd" Nov 21 13:59:47 crc kubenswrapper[4769]: I1121 13:59:47.979596 4769 scope.go:117] "RemoveContainer" containerID="3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e" Nov 21 13:59:48 crc kubenswrapper[4769]: I1121 13:59:48.003537 4769 scope.go:117] "RemoveContainer" containerID="3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e" Nov 21 13:59:48 crc kubenswrapper[4769]: E1121 13:59:48.006318 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e\": container with ID starting with 3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e not found: ID does not exist" containerID="3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e" Nov 21 13:59:48 crc kubenswrapper[4769]: I1121 13:59:48.006392 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e"} err="failed to get container status \"3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e\": rpc error: code = NotFound desc = could not find container \"3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e\": container with ID starting with 3cf05c6b19760c3fcca90146a29b5d0ca57eca2e7caf9da900fda2081378fa6e not found: ID does not exist" Nov 21 13:59:48 crc kubenswrapper[4769]: I1121 13:59:48.015320 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd"] Nov 21 13:59:48 crc kubenswrapper[4769]: I1121 13:59:48.024201 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-68c4cd4f89-ztfnd"] Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.113218 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-kptzb"] Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.122567 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-kptzb"] Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.130504 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-vd256"] Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.136448 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-vd256"] Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161038 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone75f5-account-delete-vfznh"] Nov 21 13:59:49 crc kubenswrapper[4769]: E1121 13:59:49.161325 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51c10906-bd59-45d3-96b3-18d2bb97c96f" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161336 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c10906-bd59-45d3-96b3-18d2bb97c96f" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: E1121 13:59:49.161356 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e6d012e-e745-4c59-ba09-0dcd973f2de2" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161362 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6d012e-e745-4c59-ba09-0dcd973f2de2" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: E1121 13:59:49.161386 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e4fe765e-bdd9-41d7-a6bb-7336497224ac" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161392 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4fe765e-bdd9-41d7-a6bb-7336497224ac" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161538 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="51c10906-bd59-45d3-96b3-18d2bb97c96f" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161551 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e6d012e-e745-4c59-ba09-0dcd973f2de2" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.161566 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e4fe765e-bdd9-41d7-a6bb-7336497224ac" containerName="keystone-api" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.162028 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.209401 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone75f5-account-delete-vfznh"] Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.255876 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmc8w\" (UniqueName: \"kubernetes.io/projected/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-kube-api-access-cmc8w\") pod \"keystone75f5-account-delete-vfznh\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.255970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-operator-scripts\") pod \"keystone75f5-account-delete-vfznh\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.283567 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e2c4b3a-756f-4b56-aa09-5ca99a6dea75" path="/var/lib/kubelet/pods/7e2c4b3a-756f-4b56-aa09-5ca99a6dea75/volumes" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.284692 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4fe765e-bdd9-41d7-a6bb-7336497224ac" path="/var/lib/kubelet/pods/e4fe765e-bdd9-41d7-a6bb-7336497224ac/volumes" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.285394 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdef1a11-e522-4b65-b3a1-5d45955ce7e2" path="/var/lib/kubelet/pods/fdef1a11-e522-4b65-b3a1-5d45955ce7e2/volumes" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.357714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cmc8w\" (UniqueName: \"kubernetes.io/projected/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-kube-api-access-cmc8w\") pod \"keystone75f5-account-delete-vfznh\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.358010 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-operator-scripts\") pod \"keystone75f5-account-delete-vfznh\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.359038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-operator-scripts\") pod \"keystone75f5-account-delete-vfznh\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.393935 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmc8w\" (UniqueName: \"kubernetes.io/projected/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-kube-api-access-cmc8w\") pod \"keystone75f5-account-delete-vfznh\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.485113 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:49 crc kubenswrapper[4769]: I1121 13:59:49.963506 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone75f5-account-delete-vfznh"] Nov 21 13:59:50 crc kubenswrapper[4769]: I1121 13:59:50.003663 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" event={"ID":"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7","Type":"ContainerStarted","Data":"05d7ec00cb8896cc580e7e1357afada290f6bfcbbbc69e2bb079ab2e78b79972"} Nov 21 13:59:51 crc kubenswrapper[4769]: I1121 13:59:51.014756 4769 generic.go:334] "Generic (PLEG): container finished" podID="7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" containerID="5a73d0e8357533ae74f000e4261bb6dd6b81160fad723d4b3327f42e8fdf5b93" exitCode=0 Nov 21 13:59:51 crc kubenswrapper[4769]: I1121 13:59:51.014844 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" event={"ID":"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7","Type":"ContainerDied","Data":"5a73d0e8357533ae74f000e4261bb6dd6b81160fad723d4b3327f42e8fdf5b93"} Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.344263 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.504302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-operator-scripts\") pod \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.504454 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmc8w\" (UniqueName: \"kubernetes.io/projected/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-kube-api-access-cmc8w\") pod \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\" (UID: \"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7\") " Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.504932 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" (UID: "7f5febbd-1e1a-442b-ac11-9ad245b2a9f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.514018 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-kube-api-access-cmc8w" (OuterVolumeSpecName: "kube-api-access-cmc8w") pod "7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" (UID: "7f5febbd-1e1a-442b-ac11-9ad245b2a9f7"). InnerVolumeSpecName "kube-api-access-cmc8w". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.605773 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cmc8w\" (UniqueName: \"kubernetes.io/projected/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-kube-api-access-cmc8w\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:52 crc kubenswrapper[4769]: I1121 13:59:52.605831 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:53 crc kubenswrapper[4769]: I1121 13:59:53.032371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" event={"ID":"7f5febbd-1e1a-442b-ac11-9ad245b2a9f7","Type":"ContainerDied","Data":"05d7ec00cb8896cc580e7e1357afada290f6bfcbbbc69e2bb079ab2e78b79972"} Nov 21 13:59:53 crc kubenswrapper[4769]: I1121 13:59:53.032416 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05d7ec00cb8896cc580e7e1357afada290f6bfcbbbc69e2bb079ab2e78b79972" Nov 21 13:59:53 crc kubenswrapper[4769]: I1121 13:59:53.032428 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone75f5-account-delete-vfznh" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.181503 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-w696f"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.188214 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-w696f"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.202706 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.207151 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone75f5-account-delete-vfznh"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.212382 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone75f5-account-delete-vfznh"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.218216 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-75f5-account-create-update-x58sg"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.277061 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-tdr28"] Nov 21 13:59:54 crc kubenswrapper[4769]: E1121 13:59:54.277382 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" containerName="mariadb-account-delete" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.277406 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" containerName="mariadb-account-delete" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.277621 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" containerName="mariadb-account-delete" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.278254 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.284781 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-tdr28"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.380471 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-c275-account-create-update-75hml"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.381668 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.384553 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-db-secret" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.388574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-c275-account-create-update-75hml"] Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.450353 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6d5k\" (UniqueName: \"kubernetes.io/projected/0237a154-8fe9-48b9-b392-162f438e50e3-kube-api-access-x6d5k\") pod \"keystone-db-create-tdr28\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.450794 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0237a154-8fe9-48b9-b392-162f438e50e3-operator-scripts\") pod \"keystone-db-create-tdr28\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.551838 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9jvp\" (UniqueName: \"kubernetes.io/projected/bb021f5e-4271-460f-b386-cf35a82fbce5-kube-api-access-b9jvp\") pod \"keystone-c275-account-create-update-75hml\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.551927 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb021f5e-4271-460f-b386-cf35a82fbce5-operator-scripts\") pod \"keystone-c275-account-create-update-75hml\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.551974 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0237a154-8fe9-48b9-b392-162f438e50e3-operator-scripts\") pod \"keystone-db-create-tdr28\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.551990 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x6d5k\" (UniqueName: \"kubernetes.io/projected/0237a154-8fe9-48b9-b392-162f438e50e3-kube-api-access-x6d5k\") pod \"keystone-db-create-tdr28\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.552997 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0237a154-8fe9-48b9-b392-162f438e50e3-operator-scripts\") pod \"keystone-db-create-tdr28\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.575777 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6d5k\" (UniqueName: \"kubernetes.io/projected/0237a154-8fe9-48b9-b392-162f438e50e3-kube-api-access-x6d5k\") pod \"keystone-db-create-tdr28\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.621753 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.653895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b9jvp\" (UniqueName: \"kubernetes.io/projected/bb021f5e-4271-460f-b386-cf35a82fbce5-kube-api-access-b9jvp\") pod \"keystone-c275-account-create-update-75hml\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.654172 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb021f5e-4271-460f-b386-cf35a82fbce5-operator-scripts\") pod \"keystone-c275-account-create-update-75hml\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.656177 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb021f5e-4271-460f-b386-cf35a82fbce5-operator-scripts\") pod \"keystone-c275-account-create-update-75hml\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.675256 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9jvp\" (UniqueName: \"kubernetes.io/projected/bb021f5e-4271-460f-b386-cf35a82fbce5-kube-api-access-b9jvp\") pod \"keystone-c275-account-create-update-75hml\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:54 crc kubenswrapper[4769]: I1121 13:59:54.705539 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:55 crc kubenswrapper[4769]: I1121 13:59:55.041530 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-tdr28"] Nov 21 13:59:55 crc kubenswrapper[4769]: I1121 13:59:55.134613 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-c275-account-create-update-75hml"] Nov 21 13:59:55 crc kubenswrapper[4769]: I1121 13:59:55.282603 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5febbd-1e1a-442b-ac11-9ad245b2a9f7" path="/var/lib/kubelet/pods/7f5febbd-1e1a-442b-ac11-9ad245b2a9f7/volumes" Nov 21 13:59:55 crc kubenswrapper[4769]: I1121 13:59:55.283262 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c54f7338-a769-4d6c-b96f-fbb2fa2982be" path="/var/lib/kubelet/pods/c54f7338-a769-4d6c-b96f-fbb2fa2982be/volumes" Nov 21 13:59:55 crc kubenswrapper[4769]: I1121 13:59:55.283732 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f" path="/var/lib/kubelet/pods/f7ef7cb5-4fb3-449f-b4d1-3c3fb565d36f/volumes" Nov 21 13:59:56 crc kubenswrapper[4769]: I1121 13:59:56.055947 4769 generic.go:334] "Generic (PLEG): container finished" podID="0237a154-8fe9-48b9-b392-162f438e50e3" containerID="2f6f7f66972cfb411dc2a7e745466e948ab7835ff3ef604dce007c39b7a2fb34" exitCode=0 Nov 21 13:59:56 crc kubenswrapper[4769]: I1121 13:59:56.056019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-tdr28" event={"ID":"0237a154-8fe9-48b9-b392-162f438e50e3","Type":"ContainerDied","Data":"2f6f7f66972cfb411dc2a7e745466e948ab7835ff3ef604dce007c39b7a2fb34"} Nov 21 13:59:56 crc kubenswrapper[4769]: I1121 13:59:56.056373 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-tdr28" event={"ID":"0237a154-8fe9-48b9-b392-162f438e50e3","Type":"ContainerStarted","Data":"6d2b4aa8c4e14e8be8d7bd3bb83a2e589d4ee26a722d176157d222ae74f06f55"} Nov 21 13:59:56 crc kubenswrapper[4769]: I1121 13:59:56.058457 4769 generic.go:334] "Generic (PLEG): container finished" podID="bb021f5e-4271-460f-b386-cf35a82fbce5" containerID="a366ab7c58b4c65e1bf658075dce7614aedad99458f5b1a7e87692b630603d1b" exitCode=0 Nov 21 13:59:56 crc kubenswrapper[4769]: I1121 13:59:56.058488 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" event={"ID":"bb021f5e-4271-460f-b386-cf35a82fbce5","Type":"ContainerDied","Data":"a366ab7c58b4c65e1bf658075dce7614aedad99458f5b1a7e87692b630603d1b"} Nov 21 13:59:56 crc kubenswrapper[4769]: I1121 13:59:56.058505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" event={"ID":"bb021f5e-4271-460f-b386-cf35a82fbce5","Type":"ContainerStarted","Data":"a4759c386cc7cdeca20106065ff994e5401da562b2b9b4f9eb1a3c4ffe60475f"} Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.449907 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.458082 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.597590 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9jvp\" (UniqueName: \"kubernetes.io/projected/bb021f5e-4271-460f-b386-cf35a82fbce5-kube-api-access-b9jvp\") pod \"bb021f5e-4271-460f-b386-cf35a82fbce5\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.597739 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb021f5e-4271-460f-b386-cf35a82fbce5-operator-scripts\") pod \"bb021f5e-4271-460f-b386-cf35a82fbce5\" (UID: \"bb021f5e-4271-460f-b386-cf35a82fbce5\") " Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.597771 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6d5k\" (UniqueName: \"kubernetes.io/projected/0237a154-8fe9-48b9-b392-162f438e50e3-kube-api-access-x6d5k\") pod \"0237a154-8fe9-48b9-b392-162f438e50e3\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.597793 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0237a154-8fe9-48b9-b392-162f438e50e3-operator-scripts\") pod \"0237a154-8fe9-48b9-b392-162f438e50e3\" (UID: \"0237a154-8fe9-48b9-b392-162f438e50e3\") " Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.598301 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb021f5e-4271-460f-b386-cf35a82fbce5-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bb021f5e-4271-460f-b386-cf35a82fbce5" (UID: "bb021f5e-4271-460f-b386-cf35a82fbce5"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.598431 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0237a154-8fe9-48b9-b392-162f438e50e3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0237a154-8fe9-48b9-b392-162f438e50e3" (UID: "0237a154-8fe9-48b9-b392-162f438e50e3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.604892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0237a154-8fe9-48b9-b392-162f438e50e3-kube-api-access-x6d5k" (OuterVolumeSpecName: "kube-api-access-x6d5k") pod "0237a154-8fe9-48b9-b392-162f438e50e3" (UID: "0237a154-8fe9-48b9-b392-162f438e50e3"). InnerVolumeSpecName "kube-api-access-x6d5k". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.606658 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb021f5e-4271-460f-b386-cf35a82fbce5-kube-api-access-b9jvp" (OuterVolumeSpecName: "kube-api-access-b9jvp") pod "bb021f5e-4271-460f-b386-cf35a82fbce5" (UID: "bb021f5e-4271-460f-b386-cf35a82fbce5"). InnerVolumeSpecName "kube-api-access-b9jvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.699223 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bb021f5e-4271-460f-b386-cf35a82fbce5-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.699260 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x6d5k\" (UniqueName: \"kubernetes.io/projected/0237a154-8fe9-48b9-b392-162f438e50e3-kube-api-access-x6d5k\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.699272 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0237a154-8fe9-48b9-b392-162f438e50e3-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:57 crc kubenswrapper[4769]: I1121 13:59:57.699282 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b9jvp\" (UniqueName: \"kubernetes.io/projected/bb021f5e-4271-460f-b386-cf35a82fbce5-kube-api-access-b9jvp\") on node \"crc\" DevicePath \"\"" Nov 21 13:59:58 crc kubenswrapper[4769]: I1121 13:59:58.072718 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-tdr28" Nov 21 13:59:58 crc kubenswrapper[4769]: I1121 13:59:58.072718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-tdr28" event={"ID":"0237a154-8fe9-48b9-b392-162f438e50e3","Type":"ContainerDied","Data":"6d2b4aa8c4e14e8be8d7bd3bb83a2e589d4ee26a722d176157d222ae74f06f55"} Nov 21 13:59:58 crc kubenswrapper[4769]: I1121 13:59:58.072858 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d2b4aa8c4e14e8be8d7bd3bb83a2e589d4ee26a722d176157d222ae74f06f55" Nov 21 13:59:58 crc kubenswrapper[4769]: I1121 13:59:58.074497 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" event={"ID":"bb021f5e-4271-460f-b386-cf35a82fbce5","Type":"ContainerDied","Data":"a4759c386cc7cdeca20106065ff994e5401da562b2b9b4f9eb1a3c4ffe60475f"} Nov 21 13:59:58 crc kubenswrapper[4769]: I1121 13:59:58.074533 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4759c386cc7cdeca20106065ff994e5401da562b2b9b4f9eb1a3c4ffe60475f" Nov 21 13:59:58 crc kubenswrapper[4769]: I1121 13:59:58.074560 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-c275-account-create-update-75hml" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.942046 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-xz88w"] Nov 21 13:59:59 crc kubenswrapper[4769]: E1121 13:59:59.943129 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0237a154-8fe9-48b9-b392-162f438e50e3" containerName="mariadb-database-create" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.943150 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0237a154-8fe9-48b9-b392-162f438e50e3" containerName="mariadb-database-create" Nov 21 13:59:59 crc kubenswrapper[4769]: E1121 13:59:59.943202 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bb021f5e-4271-460f-b386-cf35a82fbce5" containerName="mariadb-account-create-update" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.943215 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb021f5e-4271-460f-b386-cf35a82fbce5" containerName="mariadb-account-create-update" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.943453 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bb021f5e-4271-460f-b386-cf35a82fbce5" containerName="mariadb-account-create-update" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.943469 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0237a154-8fe9-48b9-b392-162f438e50e3" containerName="mariadb-database-create" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.944349 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.946291 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-2hrkp" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.946682 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.946797 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.947715 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.952237 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-xz88w"] Nov 21 13:59:59 crc kubenswrapper[4769]: I1121 13:59:59.953037 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"combined-ca-bundle" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.135383 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-combined-ca-bundle\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.135573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-config-data\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.135676 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hvp\" (UniqueName: \"kubernetes.io/projected/96d655ce-e289-46d7-bdea-92342c6bc9cb-kube-api-access-99hvp\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.146402 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q"] Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.147996 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.151269 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.154659 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.161465 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q"] Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.237490 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-config-data\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.237912 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-99hvp\" (UniqueName: \"kubernetes.io/projected/96d655ce-e289-46d7-bdea-92342c6bc9cb-kube-api-access-99hvp\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.238021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-combined-ca-bundle\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.247330 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-combined-ca-bundle\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.247628 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-config-data\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.289001 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hvp\" (UniqueName: \"kubernetes.io/projected/96d655ce-e289-46d7-bdea-92342c6bc9cb-kube-api-access-99hvp\") pod \"keystone-db-sync-xz88w\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.340111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-secret-volume\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.340564 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkxl\" (UniqueName: \"kubernetes.io/projected/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-kube-api-access-hkkxl\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.340605 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-config-volume\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.441976 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-secret-volume\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.442072 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkxl\" (UniqueName: \"kubernetes.io/projected/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-kube-api-access-hkkxl\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.442113 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-config-volume\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.443806 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-config-volume\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.445950 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-secret-volume\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.464309 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkxl\" (UniqueName: \"kubernetes.io/projected/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-kube-api-access-hkkxl\") pod \"collect-profiles-29395560-n7c4q\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.467123 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.568684 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:00 crc kubenswrapper[4769]: I1121 14:00:00.943588 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q"] Nov 21 14:00:01 crc kubenswrapper[4769]: I1121 14:00:01.007591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-xz88w"] Nov 21 14:00:01 crc kubenswrapper[4769]: I1121 14:00:01.104331 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" event={"ID":"96d655ce-e289-46d7-bdea-92342c6bc9cb","Type":"ContainerStarted","Data":"45cd85675d2eaa4b7535c223025dcbfbedd73ed78dbf3cf5f4409f95e44e9a48"} Nov 21 14:00:01 crc kubenswrapper[4769]: I1121 14:00:01.107415 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" event={"ID":"6e5c052b-798f-4b1b-99fa-0c3aec050ce1","Type":"ContainerStarted","Data":"0517e1ff72963b832c9902ed8034baf8d3eb04cd4a5a7156a077955265cfa9a6"} Nov 21 14:00:02 crc kubenswrapper[4769]: I1121 14:00:02.119071 4769 generic.go:334] "Generic (PLEG): container finished" podID="6e5c052b-798f-4b1b-99fa-0c3aec050ce1" containerID="01fbd2d678601644387c6bad4da454d944da7eea842194ed1f5cc6a42d8d7b8a" exitCode=0 Nov 21 14:00:02 crc kubenswrapper[4769]: I1121 14:00:02.119274 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" event={"ID":"6e5c052b-798f-4b1b-99fa-0c3aec050ce1","Type":"ContainerDied","Data":"01fbd2d678601644387c6bad4da454d944da7eea842194ed1f5cc6a42d8d7b8a"} Nov 21 14:00:02 crc kubenswrapper[4769]: I1121 14:00:02.122399 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" event={"ID":"96d655ce-e289-46d7-bdea-92342c6bc9cb","Type":"ContainerStarted","Data":"ff9899fc7bb4ea0840df52da2ec96d9acbf3a9065045ecc2b9797a2d1b3b4272"} Nov 21 14:00:02 crc kubenswrapper[4769]: I1121 14:00:02.154929 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" podStartSLOduration=3.154903379 podStartE2EDuration="3.154903379s" podCreationTimestamp="2025-11-21 13:59:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:02.149069373 +0000 UTC m=+7760.849731191" watchObservedRunningTime="2025-11-21 14:00:02.154903379 +0000 UTC m=+7760.855565207" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.131276 4769 generic.go:334] "Generic (PLEG): container finished" podID="96d655ce-e289-46d7-bdea-92342c6bc9cb" containerID="ff9899fc7bb4ea0840df52da2ec96d9acbf3a9065045ecc2b9797a2d1b3b4272" exitCode=0 Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.131382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" event={"ID":"96d655ce-e289-46d7-bdea-92342c6bc9cb","Type":"ContainerDied","Data":"ff9899fc7bb4ea0840df52da2ec96d9acbf3a9065045ecc2b9797a2d1b3b4272"} Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.414325 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.592529 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-secret-volume\") pod \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.592690 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkkxl\" (UniqueName: \"kubernetes.io/projected/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-kube-api-access-hkkxl\") pod \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.592733 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-config-volume\") pod \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\" (UID: \"6e5c052b-798f-4b1b-99fa-0c3aec050ce1\") " Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.593482 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-config-volume" (OuterVolumeSpecName: "config-volume") pod "6e5c052b-798f-4b1b-99fa-0c3aec050ce1" (UID: "6e5c052b-798f-4b1b-99fa-0c3aec050ce1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.598057 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-kube-api-access-hkkxl" (OuterVolumeSpecName: "kube-api-access-hkkxl") pod "6e5c052b-798f-4b1b-99fa-0c3aec050ce1" (UID: "6e5c052b-798f-4b1b-99fa-0c3aec050ce1"). InnerVolumeSpecName "kube-api-access-hkkxl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.598349 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "6e5c052b-798f-4b1b-99fa-0c3aec050ce1" (UID: "6e5c052b-798f-4b1b-99fa-0c3aec050ce1"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.693968 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.694014 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hkkxl\" (UniqueName: \"kubernetes.io/projected/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-kube-api-access-hkkxl\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:03 crc kubenswrapper[4769]: I1121 14:00:03.694024 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c052b-798f-4b1b-99fa-0c3aec050ce1-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.142562 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.142551 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395560-n7c4q" event={"ID":"6e5c052b-798f-4b1b-99fa-0c3aec050ce1","Type":"ContainerDied","Data":"0517e1ff72963b832c9902ed8034baf8d3eb04cd4a5a7156a077955265cfa9a6"} Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.142733 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0517e1ff72963b832c9902ed8034baf8d3eb04cd4a5a7156a077955265cfa9a6" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.429700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.471163 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5"] Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.478508 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395515-886c5"] Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.605505 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-combined-ca-bundle\") pod \"96d655ce-e289-46d7-bdea-92342c6bc9cb\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.605616 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99hvp\" (UniqueName: \"kubernetes.io/projected/96d655ce-e289-46d7-bdea-92342c6bc9cb-kube-api-access-99hvp\") pod \"96d655ce-e289-46d7-bdea-92342c6bc9cb\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.605710 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-config-data\") pod \"96d655ce-e289-46d7-bdea-92342c6bc9cb\" (UID: \"96d655ce-e289-46d7-bdea-92342c6bc9cb\") " Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.613651 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d655ce-e289-46d7-bdea-92342c6bc9cb-kube-api-access-99hvp" (OuterVolumeSpecName: "kube-api-access-99hvp") pod "96d655ce-e289-46d7-bdea-92342c6bc9cb" (UID: "96d655ce-e289-46d7-bdea-92342c6bc9cb"). InnerVolumeSpecName "kube-api-access-99hvp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.635201 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96d655ce-e289-46d7-bdea-92342c6bc9cb" (UID: "96d655ce-e289-46d7-bdea-92342c6bc9cb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.651094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-config-data" (OuterVolumeSpecName: "config-data") pod "96d655ce-e289-46d7-bdea-92342c6bc9cb" (UID: "96d655ce-e289-46d7-bdea-92342c6bc9cb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.707982 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.708038 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-99hvp\" (UniqueName: \"kubernetes.io/projected/96d655ce-e289-46d7-bdea-92342c6bc9cb-kube-api-access-99hvp\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:04 crc kubenswrapper[4769]: I1121 14:00:04.708051 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96d655ce-e289-46d7-bdea-92342c6bc9cb-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.150506 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" event={"ID":"96d655ce-e289-46d7-bdea-92342c6bc9cb","Type":"ContainerDied","Data":"45cd85675d2eaa4b7535c223025dcbfbedd73ed78dbf3cf5f4409f95e44e9a48"} Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.150546 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45cd85675d2eaa4b7535c223025dcbfbedd73ed78dbf3cf5f4409f95e44e9a48" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.150552 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-xz88w" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.286368 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccb155bb-8ed3-4650-bc55-ad73c7733a51" path="/var/lib/kubelet/pods/ccb155bb-8ed3-4650-bc55-ad73c7733a51/volumes" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.633297 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-mpm4b"] Nov 21 14:00:05 crc kubenswrapper[4769]: E1121 14:00:05.633557 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6e5c052b-798f-4b1b-99fa-0c3aec050ce1" containerName="collect-profiles" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.633581 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5c052b-798f-4b1b-99fa-0c3aec050ce1" containerName="collect-profiles" Nov 21 14:00:05 crc kubenswrapper[4769]: E1121 14:00:05.633610 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="96d655ce-e289-46d7-bdea-92342c6bc9cb" containerName="keystone-db-sync" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.633616 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d655ce-e289-46d7-bdea-92342c6bc9cb" containerName="keystone-db-sync" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.633759 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="96d655ce-e289-46d7-bdea-92342c6bc9cb" containerName="keystone-db-sync" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.633792 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6e5c052b-798f-4b1b-99fa-0c3aec050ce1" containerName="collect-profiles" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.634248 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.636228 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.636391 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-2hrkp" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.636532 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.638262 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"osp-secret" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.638436 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.640340 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"combined-ca-bundle" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.654003 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-mpm4b"] Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.826939 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-fernet-keys\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.827369 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-config-data\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.827425 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w47pv\" (UniqueName: \"kubernetes.io/projected/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-kube-api-access-w47pv\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.827478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-scripts\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.827513 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-credential-keys\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.827594 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-combined-ca-bundle\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.929018 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w47pv\" (UniqueName: \"kubernetes.io/projected/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-kube-api-access-w47pv\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.929078 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-scripts\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.929112 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-credential-keys\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.929164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-combined-ca-bundle\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.929208 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-fernet-keys\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.929238 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-config-data\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.933722 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-credential-keys\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.934237 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-fernet-keys\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.934723 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-scripts\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.935395 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-config-data\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.935582 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-combined-ca-bundle\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.952805 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w47pv\" (UniqueName: \"kubernetes.io/projected/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-kube-api-access-w47pv\") pod \"keystone-bootstrap-mpm4b\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:05 crc kubenswrapper[4769]: I1121 14:00:05.961829 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:06 crc kubenswrapper[4769]: I1121 14:00:06.387571 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-mpm4b"] Nov 21 14:00:07 crc kubenswrapper[4769]: I1121 14:00:07.167336 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" event={"ID":"5a5cfc47-2d64-458f-9447-b65fabd8d4f6","Type":"ContainerStarted","Data":"fe2334b3f23bdcb9c9738cfe7b833a8b1f11a72f79d01115018cd5890a7670a3"} Nov 21 14:00:07 crc kubenswrapper[4769]: I1121 14:00:07.168805 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" event={"ID":"5a5cfc47-2d64-458f-9447-b65fabd8d4f6","Type":"ContainerStarted","Data":"ecbe4cd0bf707ce9f9a4d4ca7d3125b34ecedc542420b12466f1c7d729a65618"} Nov 21 14:00:07 crc kubenswrapper[4769]: I1121 14:00:07.187925 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" podStartSLOduration=2.187901723 podStartE2EDuration="2.187901723s" podCreationTimestamp="2025-11-21 14:00:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:07.186256939 +0000 UTC m=+7765.886918757" watchObservedRunningTime="2025-11-21 14:00:07.187901723 +0000 UTC m=+7765.888563541" Nov 21 14:00:10 crc kubenswrapper[4769]: I1121 14:00:10.189995 4769 generic.go:334] "Generic (PLEG): container finished" podID="5a5cfc47-2d64-458f-9447-b65fabd8d4f6" containerID="fe2334b3f23bdcb9c9738cfe7b833a8b1f11a72f79d01115018cd5890a7670a3" exitCode=0 Nov 21 14:00:10 crc kubenswrapper[4769]: I1121 14:00:10.190082 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" event={"ID":"5a5cfc47-2d64-458f-9447-b65fabd8d4f6","Type":"ContainerDied","Data":"fe2334b3f23bdcb9c9738cfe7b833a8b1f11a72f79d01115018cd5890a7670a3"} Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.324803 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.324849 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.324888 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.325478 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"4b281e3968dd00ac10667b2de968f283cd017ecc4962a2f4341cb0a9daf93504"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.325522 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://4b281e3968dd00ac10667b2de968f283cd017ecc4962a2f4341cb0a9daf93504" gracePeriod=600 Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.474890 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.612834 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-credential-keys\") pod \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.612878 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-fernet-keys\") pod \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.612905 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-combined-ca-bundle\") pod \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.612970 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-config-data\") pod \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.612989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-scripts\") pod \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.613099 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w47pv\" (UniqueName: \"kubernetes.io/projected/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-kube-api-access-w47pv\") pod \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\" (UID: \"5a5cfc47-2d64-458f-9447-b65fabd8d4f6\") " Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.619815 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-scripts" (OuterVolumeSpecName: "scripts") pod "5a5cfc47-2d64-458f-9447-b65fabd8d4f6" (UID: "5a5cfc47-2d64-458f-9447-b65fabd8d4f6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.619862 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-kube-api-access-w47pv" (OuterVolumeSpecName: "kube-api-access-w47pv") pod "5a5cfc47-2d64-458f-9447-b65fabd8d4f6" (UID: "5a5cfc47-2d64-458f-9447-b65fabd8d4f6"). InnerVolumeSpecName "kube-api-access-w47pv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.619890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "5a5cfc47-2d64-458f-9447-b65fabd8d4f6" (UID: "5a5cfc47-2d64-458f-9447-b65fabd8d4f6"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.628415 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "5a5cfc47-2d64-458f-9447-b65fabd8d4f6" (UID: "5a5cfc47-2d64-458f-9447-b65fabd8d4f6"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.635850 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5a5cfc47-2d64-458f-9447-b65fabd8d4f6" (UID: "5a5cfc47-2d64-458f-9447-b65fabd8d4f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.638522 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-config-data" (OuterVolumeSpecName: "config-data") pod "5a5cfc47-2d64-458f-9447-b65fabd8d4f6" (UID: "5a5cfc47-2d64-458f-9447-b65fabd8d4f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.716987 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-w47pv\" (UniqueName: \"kubernetes.io/projected/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-kube-api-access-w47pv\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.717041 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.717053 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.717065 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.717076 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:11 crc kubenswrapper[4769]: I1121 14:00:11.717084 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5a5cfc47-2d64-458f-9447-b65fabd8d4f6-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.207304 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="4b281e3968dd00ac10667b2de968f283cd017ecc4962a2f4341cb0a9daf93504" exitCode=0 Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.207355 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"4b281e3968dd00ac10667b2de968f283cd017ecc4962a2f4341cb0a9daf93504"} Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.207427 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3"} Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.207450 4769 scope.go:117] "RemoveContainer" containerID="d597f0893382c043ec91099a20f4422f038d440fe2c2aee07a11be860527c367" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.210647 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" event={"ID":"5a5cfc47-2d64-458f-9447-b65fabd8d4f6","Type":"ContainerDied","Data":"ecbe4cd0bf707ce9f9a4d4ca7d3125b34ecedc542420b12466f1c7d729a65618"} Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.210904 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecbe4cd0bf707ce9f9a4d4ca7d3125b34ecedc542420b12466f1c7d729a65618" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.210995 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-mpm4b" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.282718 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-7df9dd47fc-spp2z"] Nov 21 14:00:12 crc kubenswrapper[4769]: E1121 14:00:12.282996 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="5a5cfc47-2d64-458f-9447-b65fabd8d4f6" containerName="keystone-bootstrap" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.283011 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a5cfc47-2d64-458f-9447-b65fabd8d4f6" containerName="keystone-bootstrap" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.283150 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="5a5cfc47-2d64-458f-9447-b65fabd8d4f6" containerName="keystone-bootstrap" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.283632 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.285449 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.285676 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"combined-ca-bundle" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.285841 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.285983 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"cert-keystone-public-svc" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.286104 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.286244 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-2hrkp" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.286344 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"cert-keystone-internal-svc" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.295698 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-7df9dd47fc-spp2z"] Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.428917 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-combined-ca-bundle\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.428970 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-fernet-keys\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.429039 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-scripts\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.429096 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-internal-tls-certs\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.429126 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-public-tls-certs\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.429163 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98n5p\" (UniqueName: \"kubernetes.io/projected/e0ec8b07-3891-447a-a2ac-a0626150bc23-kube-api-access-98n5p\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.429287 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-config-data\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.429377 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-credential-keys\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530577 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-config-data\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530653 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-credential-keys\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530709 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-combined-ca-bundle\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-fernet-keys\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530777 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-scripts\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-internal-tls-certs\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-public-tls-certs\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.530891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-98n5p\" (UniqueName: \"kubernetes.io/projected/e0ec8b07-3891-447a-a2ac-a0626150bc23-kube-api-access-98n5p\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.535809 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-fernet-keys\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.536077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-combined-ca-bundle\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.536095 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-credential-keys\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.536260 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-internal-tls-certs\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.536274 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-public-tls-certs\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.536853 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-config-data\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.537007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-scripts\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.546961 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-98n5p\" (UniqueName: \"kubernetes.io/projected/e0ec8b07-3891-447a-a2ac-a0626150bc23-kube-api-access-98n5p\") pod \"keystone-7df9dd47fc-spp2z\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:12 crc kubenswrapper[4769]: I1121 14:00:12.608039 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:13 crc kubenswrapper[4769]: I1121 14:00:13.083767 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-7df9dd47fc-spp2z"] Nov 21 14:00:13 crc kubenswrapper[4769]: I1121 14:00:13.229060 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" event={"ID":"e0ec8b07-3891-447a-a2ac-a0626150bc23","Type":"ContainerStarted","Data":"41ccdfaea7402802af5d998d6b535a067f0f3c0209a2f991c038266e533f60fc"} Nov 21 14:00:13 crc kubenswrapper[4769]: I1121 14:00:13.520762 4769 scope.go:117] "RemoveContainer" containerID="b01afb18e9dcd7e74a693a6cb6a65ad72d853dcd30baf5d9d4419888a34a01fa" Nov 21 14:00:14 crc kubenswrapper[4769]: I1121 14:00:14.238963 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" event={"ID":"e0ec8b07-3891-447a-a2ac-a0626150bc23","Type":"ContainerStarted","Data":"7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6"} Nov 21 14:00:14 crc kubenswrapper[4769]: I1121 14:00:14.239136 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.164749 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.209294 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" podStartSLOduration=32.209261602 podStartE2EDuration="32.209261602s" podCreationTimestamp="2025-11-21 14:00:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:14.273816389 +0000 UTC m=+7772.974478217" watchObservedRunningTime="2025-11-21 14:00:44.209261602 +0000 UTC m=+7802.909923450" Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.852418 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-xz88w"] Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.862615 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-xz88w"] Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.871259 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-mpm4b"] Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.883516 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-mpm4b"] Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.893584 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-7df9dd47fc-spp2z"] Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.893882 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" podUID="e0ec8b07-3891-447a-a2ac-a0626150bc23" containerName="keystone-api" containerID="cri-o://7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6" gracePeriod=30 Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.917314 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystonec275-account-delete-qjp7k"] Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.918483 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:44 crc kubenswrapper[4769]: I1121 14:00:44.929803 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystonec275-account-delete-qjp7k"] Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.096610 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfe306b2-3a79-4760-811d-0ddaa15920f1-operator-scripts\") pod \"keystonec275-account-delete-qjp7k\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.096713 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzhvm\" (UniqueName: \"kubernetes.io/projected/cfe306b2-3a79-4760-811d-0ddaa15920f1-kube-api-access-bzhvm\") pod \"keystonec275-account-delete-qjp7k\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.198028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bzhvm\" (UniqueName: \"kubernetes.io/projected/cfe306b2-3a79-4760-811d-0ddaa15920f1-kube-api-access-bzhvm\") pod \"keystonec275-account-delete-qjp7k\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.198164 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfe306b2-3a79-4760-811d-0ddaa15920f1-operator-scripts\") pod \"keystonec275-account-delete-qjp7k\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.199056 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfe306b2-3a79-4760-811d-0ddaa15920f1-operator-scripts\") pod \"keystonec275-account-delete-qjp7k\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.221371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzhvm\" (UniqueName: \"kubernetes.io/projected/cfe306b2-3a79-4760-811d-0ddaa15920f1-kube-api-access-bzhvm\") pod \"keystonec275-account-delete-qjp7k\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.236981 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.284001 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a5cfc47-2d64-458f-9447-b65fabd8d4f6" path="/var/lib/kubelet/pods/5a5cfc47-2d64-458f-9447-b65fabd8d4f6/volumes" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.284769 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d655ce-e289-46d7-bdea-92342c6bc9cb" path="/var/lib/kubelet/pods/96d655ce-e289-46d7-bdea-92342c6bc9cb/volumes" Nov 21 14:00:45 crc kubenswrapper[4769]: I1121 14:00:45.651544 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystonec275-account-delete-qjp7k"] Nov 21 14:00:46 crc kubenswrapper[4769]: I1121 14:00:46.549573 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" event={"ID":"cfe306b2-3a79-4760-811d-0ddaa15920f1","Type":"ContainerStarted","Data":"9ff291327fb435771cacf6022ba9fc7bfb9d618fc7aebc2e0a80ba2a5a22adae"} Nov 21 14:00:46 crc kubenswrapper[4769]: I1121 14:00:46.550235 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" event={"ID":"cfe306b2-3a79-4760-811d-0ddaa15920f1","Type":"ContainerStarted","Data":"b230ba66d6206a5556feddec012606381ff9670b52e9ad5bf1e80b3104745340"} Nov 21 14:00:46 crc kubenswrapper[4769]: I1121 14:00:46.568186 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" podStartSLOduration=2.568156211 podStartE2EDuration="2.568156211s" podCreationTimestamp="2025-11-21 14:00:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:46.564138754 +0000 UTC m=+7805.264800572" watchObservedRunningTime="2025-11-21 14:00:46.568156211 +0000 UTC m=+7805.268818029" Nov 21 14:00:47 crc kubenswrapper[4769]: I1121 14:00:47.562485 4769 generic.go:334] "Generic (PLEG): container finished" podID="cfe306b2-3a79-4760-811d-0ddaa15920f1" containerID="9ff291327fb435771cacf6022ba9fc7bfb9d618fc7aebc2e0a80ba2a5a22adae" exitCode=0 Nov 21 14:00:47 crc kubenswrapper[4769]: I1121 14:00:47.562541 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" event={"ID":"cfe306b2-3a79-4760-811d-0ddaa15920f1","Type":"ContainerDied","Data":"9ff291327fb435771cacf6022ba9fc7bfb9d618fc7aebc2e0a80ba2a5a22adae"} Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.445806 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.552278 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98n5p\" (UniqueName: \"kubernetes.io/projected/e0ec8b07-3891-447a-a2ac-a0626150bc23-kube-api-access-98n5p\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.552408 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-fernet-keys\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.552459 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-credential-keys\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.552504 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-combined-ca-bundle\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.553473 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-scripts\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.553568 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-internal-tls-certs\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.553653 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-config-data\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.553751 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-public-tls-certs\") pod \"e0ec8b07-3891-447a-a2ac-a0626150bc23\" (UID: \"e0ec8b07-3891-447a-a2ac-a0626150bc23\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.558574 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.558762 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-scripts" (OuterVolumeSpecName: "scripts") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.561409 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.565245 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ec8b07-3891-447a-a2ac-a0626150bc23-kube-api-access-98n5p" (OuterVolumeSpecName: "kube-api-access-98n5p") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "kube-api-access-98n5p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.575553 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0ec8b07-3891-447a-a2ac-a0626150bc23" containerID="7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6" exitCode=0 Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.575816 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.575792 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" event={"ID":"e0ec8b07-3891-447a-a2ac-a0626150bc23","Type":"ContainerDied","Data":"7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6"} Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.575983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-7df9dd47fc-spp2z" event={"ID":"e0ec8b07-3891-447a-a2ac-a0626150bc23","Type":"ContainerDied","Data":"41ccdfaea7402802af5d998d6b535a067f0f3c0209a2f991c038266e533f60fc"} Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.576105 4769 scope.go:117] "RemoveContainer" containerID="7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.579928 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.602047 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.607060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.614352 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-config-data" (OuterVolumeSpecName: "config-data") pod "e0ec8b07-3891-447a-a2ac-a0626150bc23" (UID: "e0ec8b07-3891-447a-a2ac-a0626150bc23"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.657223 4769 scope.go:117] "RemoveContainer" containerID="7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6" Nov 21 14:00:48 crc kubenswrapper[4769]: E1121 14:00:48.657911 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6\": container with ID starting with 7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6 not found: ID does not exist" containerID="7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.657956 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6"} err="failed to get container status \"7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6\": rpc error: code = NotFound desc = could not find container \"7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6\": container with ID starting with 7b2ea53a23a593113f3f64ca31088df477ded1c7c4df25d98860bcea135bbaf6 not found: ID does not exist" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658640 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658675 4769 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658688 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658699 4769 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658712 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658722 4769 reconciler_common.go:293] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-public-tls-certs\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658736 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-98n5p\" (UniqueName: \"kubernetes.io/projected/e0ec8b07-3891-447a-a2ac-a0626150bc23-kube-api-access-98n5p\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.658751 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e0ec8b07-3891-447a-a2ac-a0626150bc23-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.791560 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.907069 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-7df9dd47fc-spp2z"] Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.914408 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-7df9dd47fc-spp2z"] Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.982953 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzhvm\" (UniqueName: \"kubernetes.io/projected/cfe306b2-3a79-4760-811d-0ddaa15920f1-kube-api-access-bzhvm\") pod \"cfe306b2-3a79-4760-811d-0ddaa15920f1\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.983164 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfe306b2-3a79-4760-811d-0ddaa15920f1-operator-scripts\") pod \"cfe306b2-3a79-4760-811d-0ddaa15920f1\" (UID: \"cfe306b2-3a79-4760-811d-0ddaa15920f1\") " Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.984060 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe306b2-3a79-4760-811d-0ddaa15920f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cfe306b2-3a79-4760-811d-0ddaa15920f1" (UID: "cfe306b2-3a79-4760-811d-0ddaa15920f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:00:48 crc kubenswrapper[4769]: I1121 14:00:48.988473 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe306b2-3a79-4760-811d-0ddaa15920f1-kube-api-access-bzhvm" (OuterVolumeSpecName: "kube-api-access-bzhvm") pod "cfe306b2-3a79-4760-811d-0ddaa15920f1" (UID: "cfe306b2-3a79-4760-811d-0ddaa15920f1"). InnerVolumeSpecName "kube-api-access-bzhvm". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.084500 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cfe306b2-3a79-4760-811d-0ddaa15920f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.084531 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bzhvm\" (UniqueName: \"kubernetes.io/projected/cfe306b2-3a79-4760-811d-0ddaa15920f1-kube-api-access-bzhvm\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.281956 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ec8b07-3891-447a-a2ac-a0626150bc23" path="/var/lib/kubelet/pods/e0ec8b07-3891-447a-a2ac-a0626150bc23/volumes" Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.591675 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" event={"ID":"cfe306b2-3a79-4760-811d-0ddaa15920f1","Type":"ContainerDied","Data":"b230ba66d6206a5556feddec012606381ff9670b52e9ad5bf1e80b3104745340"} Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.591726 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b230ba66d6206a5556feddec012606381ff9670b52e9ad5bf1e80b3104745340" Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.591800 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystonec275-account-delete-qjp7k" Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.946449 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-tdr28"] Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.951587 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-tdr28"] Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.968350 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystonec275-account-delete-qjp7k"] Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.974364 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystonec275-account-delete-qjp7k"] Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.980157 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-c275-account-create-update-75hml"] Nov 21 14:00:49 crc kubenswrapper[4769]: I1121 14:00:49.986106 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-c275-account-create-update-75hml"] Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.035647 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-2bjjs"] Nov 21 14:00:50 crc kubenswrapper[4769]: E1121 14:00:50.035921 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0ec8b07-3891-447a-a2ac-a0626150bc23" containerName="keystone-api" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.035934 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ec8b07-3891-447a-a2ac-a0626150bc23" containerName="keystone-api" Nov 21 14:00:50 crc kubenswrapper[4769]: E1121 14:00:50.035969 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cfe306b2-3a79-4760-811d-0ddaa15920f1" containerName="mariadb-account-delete" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.035976 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe306b2-3a79-4760-811d-0ddaa15920f1" containerName="mariadb-account-delete" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.036088 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cfe306b2-3a79-4760-811d-0ddaa15920f1" containerName="mariadb-account-delete" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.036108 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0ec8b07-3891-447a-a2ac-a0626150bc23" containerName="keystone-api" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.036680 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.043816 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-2bjjs"] Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.097682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad4c7c78-51dc-4932-b819-31e365b91604-operator-scripts\") pod \"keystone-db-create-2bjjs\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.097852 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db674\" (UniqueName: \"kubernetes.io/projected/ad4c7c78-51dc-4932-b819-31e365b91604-kube-api-access-db674\") pod \"keystone-db-create-2bjjs\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.131319 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf"] Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.133867 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.135827 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-db-secret" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.138492 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf"] Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.199751 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-db674\" (UniqueName: \"kubernetes.io/projected/ad4c7c78-51dc-4932-b819-31e365b91604-kube-api-access-db674\") pod \"keystone-db-create-2bjjs\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.200182 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad4c7c78-51dc-4932-b819-31e365b91604-operator-scripts\") pod \"keystone-db-create-2bjjs\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.200868 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad4c7c78-51dc-4932-b819-31e365b91604-operator-scripts\") pod \"keystone-db-create-2bjjs\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.217139 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-db674\" (UniqueName: \"kubernetes.io/projected/ad4c7c78-51dc-4932-b819-31e365b91604-kube-api-access-db674\") pod \"keystone-db-create-2bjjs\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.302112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9k9\" (UniqueName: \"kubernetes.io/projected/75bd4712-b533-4178-85a4-56be923965f7-kube-api-access-2t9k9\") pod \"keystone-061d-account-create-update-f8zsf\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.302284 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75bd4712-b533-4178-85a4-56be923965f7-operator-scripts\") pod \"keystone-061d-account-create-update-f8zsf\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.350002 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.402740 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75bd4712-b533-4178-85a4-56be923965f7-operator-scripts\") pod \"keystone-061d-account-create-update-f8zsf\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.403410 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75bd4712-b533-4178-85a4-56be923965f7-operator-scripts\") pod \"keystone-061d-account-create-update-f8zsf\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.403595 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9k9\" (UniqueName: \"kubernetes.io/projected/75bd4712-b533-4178-85a4-56be923965f7-kube-api-access-2t9k9\") pod \"keystone-061d-account-create-update-f8zsf\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.429400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9k9\" (UniqueName: \"kubernetes.io/projected/75bd4712-b533-4178-85a4-56be923965f7-kube-api-access-2t9k9\") pod \"keystone-061d-account-create-update-f8zsf\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.448393 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.771588 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-2bjjs"] Nov 21 14:00:50 crc kubenswrapper[4769]: I1121 14:00:50.892379 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf"] Nov 21 14:00:50 crc kubenswrapper[4769]: W1121 14:00:50.901228 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75bd4712_b533_4178_85a4_56be923965f7.slice/crio-2e8a19720c82828160235e9c3928df28b1fbfb15db882797f40c9e26c4529833 WatchSource:0}: Error finding container 2e8a19720c82828160235e9c3928df28b1fbfb15db882797f40c9e26c4529833: Status 404 returned error can't find the container with id 2e8a19720c82828160235e9c3928df28b1fbfb15db882797f40c9e26c4529833 Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.289050 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0237a154-8fe9-48b9-b392-162f438e50e3" path="/var/lib/kubelet/pods/0237a154-8fe9-48b9-b392-162f438e50e3/volumes" Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.290382 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb021f5e-4271-460f-b386-cf35a82fbce5" path="/var/lib/kubelet/pods/bb021f5e-4271-460f-b386-cf35a82fbce5/volumes" Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.291301 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe306b2-3a79-4760-811d-0ddaa15920f1" path="/var/lib/kubelet/pods/cfe306b2-3a79-4760-811d-0ddaa15920f1/volumes" Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.613050 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" event={"ID":"ad4c7c78-51dc-4932-b819-31e365b91604","Type":"ContainerStarted","Data":"8e80128b4ac7cb5c603a5e1a22ea90e59cdd78f37fe47998d3d0c445c12d7b82"} Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.613665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" event={"ID":"ad4c7c78-51dc-4932-b819-31e365b91604","Type":"ContainerStarted","Data":"da1502d1365364e8c553280e39bb469d76a8e1a3a29b59eaa3dede3c9c690e83"} Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.615683 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" event={"ID":"75bd4712-b533-4178-85a4-56be923965f7","Type":"ContainerStarted","Data":"f076105a9d93a689e2117e0d4e99101a5d71037386b67e3cffa055f1767d0db7"} Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.615755 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" event={"ID":"75bd4712-b533-4178-85a4-56be923965f7","Type":"ContainerStarted","Data":"2e8a19720c82828160235e9c3928df28b1fbfb15db882797f40c9e26c4529833"} Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.635322 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" podStartSLOduration=1.635292174 podStartE2EDuration="1.635292174s" podCreationTimestamp="2025-11-21 14:00:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:51.632469059 +0000 UTC m=+7810.333130907" watchObservedRunningTime="2025-11-21 14:00:51.635292174 +0000 UTC m=+7810.335954032" Nov 21 14:00:51 crc kubenswrapper[4769]: I1121 14:00:51.663949 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" podStartSLOduration=1.663900086 podStartE2EDuration="1.663900086s" podCreationTimestamp="2025-11-21 14:00:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:51.653959121 +0000 UTC m=+7810.354620939" watchObservedRunningTime="2025-11-21 14:00:51.663900086 +0000 UTC m=+7810.364561924" Nov 21 14:00:52 crc kubenswrapper[4769]: I1121 14:00:52.626017 4769 generic.go:334] "Generic (PLEG): container finished" podID="75bd4712-b533-4178-85a4-56be923965f7" containerID="f076105a9d93a689e2117e0d4e99101a5d71037386b67e3cffa055f1767d0db7" exitCode=0 Nov 21 14:00:52 crc kubenswrapper[4769]: I1121 14:00:52.626092 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" event={"ID":"75bd4712-b533-4178-85a4-56be923965f7","Type":"ContainerDied","Data":"f076105a9d93a689e2117e0d4e99101a5d71037386b67e3cffa055f1767d0db7"} Nov 21 14:00:52 crc kubenswrapper[4769]: I1121 14:00:52.628909 4769 generic.go:334] "Generic (PLEG): container finished" podID="ad4c7c78-51dc-4932-b819-31e365b91604" containerID="8e80128b4ac7cb5c603a5e1a22ea90e59cdd78f37fe47998d3d0c445c12d7b82" exitCode=0 Nov 21 14:00:52 crc kubenswrapper[4769]: I1121 14:00:52.628951 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" event={"ID":"ad4c7c78-51dc-4932-b819-31e365b91604","Type":"ContainerDied","Data":"8e80128b4ac7cb5c603a5e1a22ea90e59cdd78f37fe47998d3d0c445c12d7b82"} Nov 21 14:00:53 crc kubenswrapper[4769]: I1121 14:00:53.892113 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:53 crc kubenswrapper[4769]: I1121 14:00:53.966670 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.065827 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t9k9\" (UniqueName: \"kubernetes.io/projected/75bd4712-b533-4178-85a4-56be923965f7-kube-api-access-2t9k9\") pod \"75bd4712-b533-4178-85a4-56be923965f7\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.065900 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75bd4712-b533-4178-85a4-56be923965f7-operator-scripts\") pod \"75bd4712-b533-4178-85a4-56be923965f7\" (UID: \"75bd4712-b533-4178-85a4-56be923965f7\") " Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.066102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad4c7c78-51dc-4932-b819-31e365b91604-operator-scripts\") pod \"ad4c7c78-51dc-4932-b819-31e365b91604\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.066161 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db674\" (UniqueName: \"kubernetes.io/projected/ad4c7c78-51dc-4932-b819-31e365b91604-kube-api-access-db674\") pod \"ad4c7c78-51dc-4932-b819-31e365b91604\" (UID: \"ad4c7c78-51dc-4932-b819-31e365b91604\") " Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.066820 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75bd4712-b533-4178-85a4-56be923965f7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "75bd4712-b533-4178-85a4-56be923965f7" (UID: "75bd4712-b533-4178-85a4-56be923965f7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.066843 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad4c7c78-51dc-4932-b819-31e365b91604-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ad4c7c78-51dc-4932-b819-31e365b91604" (UID: "ad4c7c78-51dc-4932-b819-31e365b91604"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.071076 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4c7c78-51dc-4932-b819-31e365b91604-kube-api-access-db674" (OuterVolumeSpecName: "kube-api-access-db674") pod "ad4c7c78-51dc-4932-b819-31e365b91604" (UID: "ad4c7c78-51dc-4932-b819-31e365b91604"). InnerVolumeSpecName "kube-api-access-db674". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.071477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75bd4712-b533-4178-85a4-56be923965f7-kube-api-access-2t9k9" (OuterVolumeSpecName: "kube-api-access-2t9k9") pod "75bd4712-b533-4178-85a4-56be923965f7" (UID: "75bd4712-b533-4178-85a4-56be923965f7"). InnerVolumeSpecName "kube-api-access-2t9k9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.167444 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ad4c7c78-51dc-4932-b819-31e365b91604-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.167494 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-db674\" (UniqueName: \"kubernetes.io/projected/ad4c7c78-51dc-4932-b819-31e365b91604-kube-api-access-db674\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.167511 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2t9k9\" (UniqueName: \"kubernetes.io/projected/75bd4712-b533-4178-85a4-56be923965f7-kube-api-access-2t9k9\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.167525 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75bd4712-b533-4178-85a4-56be923965f7-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.647811 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" event={"ID":"ad4c7c78-51dc-4932-b819-31e365b91604","Type":"ContainerDied","Data":"da1502d1365364e8c553280e39bb469d76a8e1a3a29b59eaa3dede3c9c690e83"} Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.647870 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da1502d1365364e8c553280e39bb469d76a8e1a3a29b59eaa3dede3c9c690e83" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.647828 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-2bjjs" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.649341 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" event={"ID":"75bd4712-b533-4178-85a4-56be923965f7","Type":"ContainerDied","Data":"2e8a19720c82828160235e9c3928df28b1fbfb15db882797f40c9e26c4529833"} Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.649381 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e8a19720c82828160235e9c3928df28b1fbfb15db882797f40c9e26c4529833" Nov 21 14:00:54 crc kubenswrapper[4769]: I1121 14:00:54.649381 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.708222 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-vt96z"] Nov 21 14:00:55 crc kubenswrapper[4769]: E1121 14:00:55.708844 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ad4c7c78-51dc-4932-b819-31e365b91604" containerName="mariadb-database-create" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.708858 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4c7c78-51dc-4932-b819-31e365b91604" containerName="mariadb-database-create" Nov 21 14:00:55 crc kubenswrapper[4769]: E1121 14:00:55.708881 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="75bd4712-b533-4178-85a4-56be923965f7" containerName="mariadb-account-create-update" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.708889 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="75bd4712-b533-4178-85a4-56be923965f7" containerName="mariadb-account-create-update" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.709037 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="75bd4712-b533-4178-85a4-56be923965f7" containerName="mariadb-account-create-update" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.709047 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ad4c7c78-51dc-4932-b819-31e365b91604" containerName="mariadb-database-create" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.709562 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.712805 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-m6g7l" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.713093 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.715674 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.722709 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.724756 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-vt96z"] Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.793087 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhf2\" (UniqueName: \"kubernetes.io/projected/73a71151-ef8c-4127-a150-bc408d456656-kube-api-access-9jhf2\") pod \"keystone-db-sync-vt96z\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.793162 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a71151-ef8c-4127-a150-bc408d456656-config-data\") pod \"keystone-db-sync-vt96z\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.894548 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a71151-ef8c-4127-a150-bc408d456656-config-data\") pod \"keystone-db-sync-vt96z\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.894714 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhf2\" (UniqueName: \"kubernetes.io/projected/73a71151-ef8c-4127-a150-bc408d456656-kube-api-access-9jhf2\") pod \"keystone-db-sync-vt96z\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.903392 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a71151-ef8c-4127-a150-bc408d456656-config-data\") pod \"keystone-db-sync-vt96z\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:55 crc kubenswrapper[4769]: I1121 14:00:55.913388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhf2\" (UniqueName: \"kubernetes.io/projected/73a71151-ef8c-4127-a150-bc408d456656-kube-api-access-9jhf2\") pod \"keystone-db-sync-vt96z\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:56 crc kubenswrapper[4769]: I1121 14:00:56.036470 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:00:56 crc kubenswrapper[4769]: I1121 14:00:56.257073 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-vt96z"] Nov 21 14:00:56 crc kubenswrapper[4769]: I1121 14:00:56.671893 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" event={"ID":"73a71151-ef8c-4127-a150-bc408d456656","Type":"ContainerStarted","Data":"f9cbb8ca34c3dbdefdbca4a257f8b1b36ccedc159ed8a2623c5beab1fc5c640f"} Nov 21 14:00:56 crc kubenswrapper[4769]: I1121 14:00:56.672254 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" event={"ID":"73a71151-ef8c-4127-a150-bc408d456656","Type":"ContainerStarted","Data":"001bdad6499bc52dbbb3a2a24e6251907d78a76599b83b7c20fe3959698a4dc3"} Nov 21 14:00:56 crc kubenswrapper[4769]: I1121 14:00:56.690473 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" podStartSLOduration=1.690448416 podStartE2EDuration="1.690448416s" podCreationTimestamp="2025-11-21 14:00:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:00:56.689304896 +0000 UTC m=+7815.389966714" watchObservedRunningTime="2025-11-21 14:00:56.690448416 +0000 UTC m=+7815.391110224" Nov 21 14:00:58 crc kubenswrapper[4769]: I1121 14:00:58.697201 4769 generic.go:334] "Generic (PLEG): container finished" podID="73a71151-ef8c-4127-a150-bc408d456656" containerID="f9cbb8ca34c3dbdefdbca4a257f8b1b36ccedc159ed8a2623c5beab1fc5c640f" exitCode=0 Nov 21 14:00:58 crc kubenswrapper[4769]: I1121 14:00:58.697297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" event={"ID":"73a71151-ef8c-4127-a150-bc408d456656","Type":"ContainerDied","Data":"f9cbb8ca34c3dbdefdbca4a257f8b1b36ccedc159ed8a2623c5beab1fc5c640f"} Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.005373 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.163344 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jhf2\" (UniqueName: \"kubernetes.io/projected/73a71151-ef8c-4127-a150-bc408d456656-kube-api-access-9jhf2\") pod \"73a71151-ef8c-4127-a150-bc408d456656\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.163457 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a71151-ef8c-4127-a150-bc408d456656-config-data\") pod \"73a71151-ef8c-4127-a150-bc408d456656\" (UID: \"73a71151-ef8c-4127-a150-bc408d456656\") " Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.169492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a71151-ef8c-4127-a150-bc408d456656-kube-api-access-9jhf2" (OuterVolumeSpecName: "kube-api-access-9jhf2") pod "73a71151-ef8c-4127-a150-bc408d456656" (UID: "73a71151-ef8c-4127-a150-bc408d456656"). InnerVolumeSpecName "kube-api-access-9jhf2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.207892 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a71151-ef8c-4127-a150-bc408d456656-config-data" (OuterVolumeSpecName: "config-data") pod "73a71151-ef8c-4127-a150-bc408d456656" (UID: "73a71151-ef8c-4127-a150-bc408d456656"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.265359 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9jhf2\" (UniqueName: \"kubernetes.io/projected/73a71151-ef8c-4127-a150-bc408d456656-kube-api-access-9jhf2\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.265393 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a71151-ef8c-4127-a150-bc408d456656-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.715544 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" event={"ID":"73a71151-ef8c-4127-a150-bc408d456656","Type":"ContainerDied","Data":"001bdad6499bc52dbbb3a2a24e6251907d78a76599b83b7c20fe3959698a4dc3"} Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.715601 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="001bdad6499bc52dbbb3a2a24e6251907d78a76599b83b7c20fe3959698a4dc3" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.715623 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-vt96z" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.847707 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-fd97c"] Nov 21 14:01:00 crc kubenswrapper[4769]: E1121 14:01:00.848018 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="73a71151-ef8c-4127-a150-bc408d456656" containerName="keystone-db-sync" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.848039 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a71151-ef8c-4127-a150-bc408d456656" containerName="keystone-db-sync" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.848172 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="73a71151-ef8c-4127-a150-bc408d456656" containerName="keystone-db-sync" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.848691 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.866172 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-m6g7l" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.866623 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.866823 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.866950 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"osp-secret" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.867118 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.869953 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-fd97c"] Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.875346 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-scripts\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.875558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-config-data\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.875673 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm2xw\" (UniqueName: \"kubernetes.io/projected/2705a12d-2a44-4764-850e-d04d862a5f40-kube-api-access-cm2xw\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.875786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-fernet-keys\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.875874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-credential-keys\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.976506 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-scripts\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.976645 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-config-data\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.976684 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cm2xw\" (UniqueName: \"kubernetes.io/projected/2705a12d-2a44-4764-850e-d04d862a5f40-kube-api-access-cm2xw\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.976782 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-fernet-keys\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.977040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-credential-keys\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.981072 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-fernet-keys\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.981356 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-config-data\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.981497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-scripts\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.988007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-credential-keys\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:00 crc kubenswrapper[4769]: I1121 14:01:00.998683 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm2xw\" (UniqueName: \"kubernetes.io/projected/2705a12d-2a44-4764-850e-d04d862a5f40-kube-api-access-cm2xw\") pod \"keystone-bootstrap-fd97c\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:01 crc kubenswrapper[4769]: I1121 14:01:01.182342 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:01 crc kubenswrapper[4769]: I1121 14:01:01.675520 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-fd97c"] Nov 21 14:01:01 crc kubenswrapper[4769]: I1121 14:01:01.729731 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" event={"ID":"2705a12d-2a44-4764-850e-d04d862a5f40","Type":"ContainerStarted","Data":"c0cc60e400f59579ef472d5d4b391654aae89ba719d8f1341fe0802babd222fb"} Nov 21 14:01:02 crc kubenswrapper[4769]: I1121 14:01:02.741408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" event={"ID":"2705a12d-2a44-4764-850e-d04d862a5f40","Type":"ContainerStarted","Data":"d0fb537efc1cc9fcb3f1b037b2eba283ed274a97e8d0cd3bc4650affbe99eec2"} Nov 21 14:01:02 crc kubenswrapper[4769]: I1121 14:01:02.764027 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" podStartSLOduration=2.764007377 podStartE2EDuration="2.764007377s" podCreationTimestamp="2025-11-21 14:01:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:01:02.757837253 +0000 UTC m=+7821.458499071" watchObservedRunningTime="2025-11-21 14:01:02.764007377 +0000 UTC m=+7821.464669185" Nov 21 14:01:05 crc kubenswrapper[4769]: I1121 14:01:05.767878 4769 generic.go:334] "Generic (PLEG): container finished" podID="2705a12d-2a44-4764-850e-d04d862a5f40" containerID="d0fb537efc1cc9fcb3f1b037b2eba283ed274a97e8d0cd3bc4650affbe99eec2" exitCode=0 Nov 21 14:01:05 crc kubenswrapper[4769]: I1121 14:01:05.767987 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" event={"ID":"2705a12d-2a44-4764-850e-d04d862a5f40","Type":"ContainerDied","Data":"d0fb537efc1cc9fcb3f1b037b2eba283ed274a97e8d0cd3bc4650affbe99eec2"} Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.031862 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.177393 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-fernet-keys\") pod \"2705a12d-2a44-4764-850e-d04d862a5f40\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.177438 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-scripts\") pod \"2705a12d-2a44-4764-850e-d04d862a5f40\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.177490 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-credential-keys\") pod \"2705a12d-2a44-4764-850e-d04d862a5f40\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.177542 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm2xw\" (UniqueName: \"kubernetes.io/projected/2705a12d-2a44-4764-850e-d04d862a5f40-kube-api-access-cm2xw\") pod \"2705a12d-2a44-4764-850e-d04d862a5f40\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.177634 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-config-data\") pod \"2705a12d-2a44-4764-850e-d04d862a5f40\" (UID: \"2705a12d-2a44-4764-850e-d04d862a5f40\") " Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.183309 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-scripts" (OuterVolumeSpecName: "scripts") pod "2705a12d-2a44-4764-850e-d04d862a5f40" (UID: "2705a12d-2a44-4764-850e-d04d862a5f40"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.183310 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "2705a12d-2a44-4764-850e-d04d862a5f40" (UID: "2705a12d-2a44-4764-850e-d04d862a5f40"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.183440 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "2705a12d-2a44-4764-850e-d04d862a5f40" (UID: "2705a12d-2a44-4764-850e-d04d862a5f40"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.184656 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2705a12d-2a44-4764-850e-d04d862a5f40-kube-api-access-cm2xw" (OuterVolumeSpecName: "kube-api-access-cm2xw") pod "2705a12d-2a44-4764-850e-d04d862a5f40" (UID: "2705a12d-2a44-4764-850e-d04d862a5f40"). InnerVolumeSpecName "kube-api-access-cm2xw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.197094 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-config-data" (OuterVolumeSpecName: "config-data") pod "2705a12d-2a44-4764-850e-d04d862a5f40" (UID: "2705a12d-2a44-4764-850e-d04d862a5f40"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.279753 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.279785 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.279795 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.279804 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2705a12d-2a44-4764-850e-d04d862a5f40-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.279817 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cm2xw\" (UniqueName: \"kubernetes.io/projected/2705a12d-2a44-4764-850e-d04d862a5f40-kube-api-access-cm2xw\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.790808 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" event={"ID":"2705a12d-2a44-4764-850e-d04d862a5f40","Type":"ContainerDied","Data":"c0cc60e400f59579ef472d5d4b391654aae89ba719d8f1341fe0802babd222fb"} Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.790893 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0cc60e400f59579ef472d5d4b391654aae89ba719d8f1341fe0802babd222fb" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.790852 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-fd97c" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.890817 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-b469584fd-7td2j"] Nov 21 14:01:07 crc kubenswrapper[4769]: E1121 14:01:07.891157 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2705a12d-2a44-4764-850e-d04d862a5f40" containerName="keystone-bootstrap" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.891179 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2705a12d-2a44-4764-850e-d04d862a5f40" containerName="keystone-bootstrap" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.891457 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2705a12d-2a44-4764-850e-d04d862a5f40" containerName="keystone-bootstrap" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.892169 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.894547 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.894766 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.894986 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-m6g7l" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.895724 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.897904 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-b469584fd-7td2j"] Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.989044 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-config-data\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.989108 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-scripts\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.989162 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-credential-keys\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.989286 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-fernet-keys\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:07 crc kubenswrapper[4769]: I1121 14:01:07.989363 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj84m\" (UniqueName: \"kubernetes.io/projected/bd69b170-12e8-4601-a472-2f169681e5ad-kube-api-access-lj84m\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.090733 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lj84m\" (UniqueName: \"kubernetes.io/projected/bd69b170-12e8-4601-a472-2f169681e5ad-kube-api-access-lj84m\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.090794 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-config-data\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.090828 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-scripts\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.090858 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-credential-keys\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.090916 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-fernet-keys\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.094747 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-scripts\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.094945 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-fernet-keys\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.094992 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-credential-keys\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.106155 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-config-data\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.108038 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj84m\" (UniqueName: \"kubernetes.io/projected/bd69b170-12e8-4601-a472-2f169681e5ad-kube-api-access-lj84m\") pod \"keystone-b469584fd-7td2j\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.211630 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.642156 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-b469584fd-7td2j"] Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.800014 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" event={"ID":"bd69b170-12e8-4601-a472-2f169681e5ad","Type":"ContainerStarted","Data":"2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7"} Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.800392 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.800406 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" event={"ID":"bd69b170-12e8-4601-a472-2f169681e5ad","Type":"ContainerStarted","Data":"aac1b15e9bef6f54629078d44b957225424c03c8abf32b502ba1eb4ab945e7ab"} Nov 21 14:01:08 crc kubenswrapper[4769]: I1121 14:01:08.825627 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" podStartSLOduration=1.825603819 podStartE2EDuration="1.825603819s" podCreationTimestamp="2025-11-21 14:01:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:01:08.818445428 +0000 UTC m=+7827.519107266" watchObservedRunningTime="2025-11-21 14:01:08.825603819 +0000 UTC m=+7827.526265657" Nov 21 14:01:39 crc kubenswrapper[4769]: I1121 14:01:39.728505 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.035729 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-fd97c"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.052346 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-fd97c"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.061241 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-vt96z"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.066251 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-vt96z"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.073916 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-b469584fd-7td2j"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.074136 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" podUID="bd69b170-12e8-4601-a472-2f169681e5ad" containerName="keystone-api" containerID="cri-o://2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7" gracePeriod=30 Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.106796 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone061d-account-delete-b45v9"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.107675 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.140839 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone061d-account-delete-b45v9"] Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.284061 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2705a12d-2a44-4764-850e-d04d862a5f40" path="/var/lib/kubelet/pods/2705a12d-2a44-4764-850e-d04d862a5f40/volumes" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.284773 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a71151-ef8c-4127-a150-bc408d456656" path="/var/lib/kubelet/pods/73a71151-ef8c-4127-a150-bc408d456656/volumes" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.292938 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gt2p\" (UniqueName: \"kubernetes.io/projected/56c94205-898f-44d0-86e0-fd1ccb449137-kube-api-access-6gt2p\") pod \"keystone061d-account-delete-b45v9\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.293071 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/56c94205-898f-44d0-86e0-fd1ccb449137-operator-scripts\") pod \"keystone061d-account-delete-b45v9\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.394865 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6gt2p\" (UniqueName: \"kubernetes.io/projected/56c94205-898f-44d0-86e0-fd1ccb449137-kube-api-access-6gt2p\") pod \"keystone061d-account-delete-b45v9\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.395251 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/56c94205-898f-44d0-86e0-fd1ccb449137-operator-scripts\") pod \"keystone061d-account-delete-b45v9\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.396684 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/56c94205-898f-44d0-86e0-fd1ccb449137-operator-scripts\") pod \"keystone061d-account-delete-b45v9\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.415544 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gt2p\" (UniqueName: \"kubernetes.io/projected/56c94205-898f-44d0-86e0-fd1ccb449137-kube-api-access-6gt2p\") pod \"keystone061d-account-delete-b45v9\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.440172 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:55 crc kubenswrapper[4769]: I1121 14:01:55.934384 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone061d-account-delete-b45v9"] Nov 21 14:01:56 crc kubenswrapper[4769]: I1121 14:01:56.219624 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" event={"ID":"56c94205-898f-44d0-86e0-fd1ccb449137","Type":"ContainerStarted","Data":"501baa70588173e2e1d0997e2f673dfa3e4ff3c89a5e7f31308624e2ff1d735e"} Nov 21 14:01:56 crc kubenswrapper[4769]: I1121 14:01:56.219883 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" event={"ID":"56c94205-898f-44d0-86e0-fd1ccb449137","Type":"ContainerStarted","Data":"9e9b9ca64cc55551d29a558ebf25720ce1c4bd69ede2b76217581eb977b41569"} Nov 21 14:01:56 crc kubenswrapper[4769]: I1121 14:01:56.234415 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" podStartSLOduration=1.234397674 podStartE2EDuration="1.234397674s" podCreationTimestamp="2025-11-21 14:01:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:01:56.231867506 +0000 UTC m=+7874.932529344" watchObservedRunningTime="2025-11-21 14:01:56.234397674 +0000 UTC m=+7874.935059492" Nov 21 14:01:57 crc kubenswrapper[4769]: I1121 14:01:57.231400 4769 generic.go:334] "Generic (PLEG): container finished" podID="56c94205-898f-44d0-86e0-fd1ccb449137" containerID="501baa70588173e2e1d0997e2f673dfa3e4ff3c89a5e7f31308624e2ff1d735e" exitCode=0 Nov 21 14:01:57 crc kubenswrapper[4769]: I1121 14:01:57.231478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" event={"ID":"56c94205-898f-44d0-86e0-fd1ccb449137","Type":"ContainerDied","Data":"501baa70588173e2e1d0997e2f673dfa3e4ff3c89a5e7f31308624e2ff1d735e"} Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.783773 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.789821 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.959509 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-config-data\") pod \"bd69b170-12e8-4601-a472-2f169681e5ad\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.960007 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/56c94205-898f-44d0-86e0-fd1ccb449137-operator-scripts\") pod \"56c94205-898f-44d0-86e0-fd1ccb449137\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.960083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj84m\" (UniqueName: \"kubernetes.io/projected/bd69b170-12e8-4601-a472-2f169681e5ad-kube-api-access-lj84m\") pod \"bd69b170-12e8-4601-a472-2f169681e5ad\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.960210 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-credential-keys\") pod \"bd69b170-12e8-4601-a472-2f169681e5ad\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.960291 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-scripts\") pod \"bd69b170-12e8-4601-a472-2f169681e5ad\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.960348 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gt2p\" (UniqueName: \"kubernetes.io/projected/56c94205-898f-44d0-86e0-fd1ccb449137-kube-api-access-6gt2p\") pod \"56c94205-898f-44d0-86e0-fd1ccb449137\" (UID: \"56c94205-898f-44d0-86e0-fd1ccb449137\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.960389 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-fernet-keys\") pod \"bd69b170-12e8-4601-a472-2f169681e5ad\" (UID: \"bd69b170-12e8-4601-a472-2f169681e5ad\") " Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.961562 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56c94205-898f-44d0-86e0-fd1ccb449137-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "56c94205-898f-44d0-86e0-fd1ccb449137" (UID: "56c94205-898f-44d0-86e0-fd1ccb449137"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.966401 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bd69b170-12e8-4601-a472-2f169681e5ad" (UID: "bd69b170-12e8-4601-a472-2f169681e5ad"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.966452 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bd69b170-12e8-4601-a472-2f169681e5ad" (UID: "bd69b170-12e8-4601-a472-2f169681e5ad"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.966575 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-scripts" (OuterVolumeSpecName: "scripts") pod "bd69b170-12e8-4601-a472-2f169681e5ad" (UID: "bd69b170-12e8-4601-a472-2f169681e5ad"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.966634 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c94205-898f-44d0-86e0-fd1ccb449137-kube-api-access-6gt2p" (OuterVolumeSpecName: "kube-api-access-6gt2p") pod "56c94205-898f-44d0-86e0-fd1ccb449137" (UID: "56c94205-898f-44d0-86e0-fd1ccb449137"). InnerVolumeSpecName "kube-api-access-6gt2p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.966859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd69b170-12e8-4601-a472-2f169681e5ad-kube-api-access-lj84m" (OuterVolumeSpecName: "kube-api-access-lj84m") pod "bd69b170-12e8-4601-a472-2f169681e5ad" (UID: "bd69b170-12e8-4601-a472-2f169681e5ad"). InnerVolumeSpecName "kube-api-access-lj84m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:01:58 crc kubenswrapper[4769]: I1121 14:01:58.981086 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-config-data" (OuterVolumeSpecName: "config-data") pod "bd69b170-12e8-4601-a472-2f169681e5ad" (UID: "bd69b170-12e8-4601-a472-2f169681e5ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063469 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063523 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063550 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6gt2p\" (UniqueName: \"kubernetes.io/projected/56c94205-898f-44d0-86e0-fd1ccb449137-kube-api-access-6gt2p\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063571 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063590 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd69b170-12e8-4601-a472-2f169681e5ad-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063610 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/56c94205-898f-44d0-86e0-fd1ccb449137-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.063629 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lj84m\" (UniqueName: \"kubernetes.io/projected/bd69b170-12e8-4601-a472-2f169681e5ad-kube-api-access-lj84m\") on node \"crc\" DevicePath \"\"" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.252763 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.252910 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone061d-account-delete-b45v9" event={"ID":"56c94205-898f-44d0-86e0-fd1ccb449137","Type":"ContainerDied","Data":"9e9b9ca64cc55551d29a558ebf25720ce1c4bd69ede2b76217581eb977b41569"} Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.253075 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e9b9ca64cc55551d29a558ebf25720ce1c4bd69ede2b76217581eb977b41569" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.255406 4769 generic.go:334] "Generic (PLEG): container finished" podID="bd69b170-12e8-4601-a472-2f169681e5ad" containerID="2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7" exitCode=0 Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.255468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" event={"ID":"bd69b170-12e8-4601-a472-2f169681e5ad","Type":"ContainerDied","Data":"2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7"} Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.255493 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.255525 4769 scope.go:117] "RemoveContainer" containerID="2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.255505 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-b469584fd-7td2j" event={"ID":"bd69b170-12e8-4601-a472-2f169681e5ad","Type":"ContainerDied","Data":"aac1b15e9bef6f54629078d44b957225424c03c8abf32b502ba1eb4ab945e7ab"} Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.316563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-b469584fd-7td2j"] Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.316608 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-b469584fd-7td2j"] Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.393207 4769 scope.go:117] "RemoveContainer" containerID="2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7" Nov 21 14:01:59 crc kubenswrapper[4769]: E1121 14:01:59.393692 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7\": container with ID starting with 2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7 not found: ID does not exist" containerID="2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7" Nov 21 14:01:59 crc kubenswrapper[4769]: I1121 14:01:59.393734 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7"} err="failed to get container status \"2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7\": rpc error: code = NotFound desc = could not find container \"2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7\": container with ID starting with 2246b6a834ce43a9bec2a0c730b24cb9b5c728c67639d8b6bf8cde08f063a5f7 not found: ID does not exist" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.136938 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-2bjjs"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.141657 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-2bjjs"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.149995 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone061d-account-delete-b45v9"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.157469 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.165504 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone061d-account-delete-b45v9"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.171081 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-061d-account-create-update-f8zsf"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.347814 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-create-wc2ht"] Nov 21 14:02:00 crc kubenswrapper[4769]: E1121 14:02:00.348589 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="bd69b170-12e8-4601-a472-2f169681e5ad" containerName="keystone-api" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.348611 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd69b170-12e8-4601-a472-2f169681e5ad" containerName="keystone-api" Nov 21 14:02:00 crc kubenswrapper[4769]: E1121 14:02:00.348622 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="56c94205-898f-44d0-86e0-fd1ccb449137" containerName="mariadb-account-delete" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.348630 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c94205-898f-44d0-86e0-fd1ccb449137" containerName="mariadb-account-delete" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.348787 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="56c94205-898f-44d0-86e0-fd1ccb449137" containerName="mariadb-account-delete" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.348813 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="bd69b170-12e8-4601-a472-2f169681e5ad" containerName="keystone-api" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.349517 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.353410 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.354738 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.356431 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-db-secret" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.369087 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-wc2ht"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.383629 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl"] Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.386295 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-operator-scripts\") pod \"keystone-399f-account-create-update-gbjfl\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.386628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac4bdc52-4627-494b-b0a1-a2b17a925f00-operator-scripts\") pod \"keystone-db-create-wc2ht\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.386783 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhrc5\" (UniqueName: \"kubernetes.io/projected/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-kube-api-access-xhrc5\") pod \"keystone-399f-account-create-update-gbjfl\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.386906 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chqth\" (UniqueName: \"kubernetes.io/projected/ac4bdc52-4627-494b-b0a1-a2b17a925f00-kube-api-access-chqth\") pod \"keystone-db-create-wc2ht\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.488040 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac4bdc52-4627-494b-b0a1-a2b17a925f00-operator-scripts\") pod \"keystone-db-create-wc2ht\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.488430 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xhrc5\" (UniqueName: \"kubernetes.io/projected/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-kube-api-access-xhrc5\") pod \"keystone-399f-account-create-update-gbjfl\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.488599 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-chqth\" (UniqueName: \"kubernetes.io/projected/ac4bdc52-4627-494b-b0a1-a2b17a925f00-kube-api-access-chqth\") pod \"keystone-db-create-wc2ht\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.488948 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-operator-scripts\") pod \"keystone-399f-account-create-update-gbjfl\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.489408 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac4bdc52-4627-494b-b0a1-a2b17a925f00-operator-scripts\") pod \"keystone-db-create-wc2ht\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.489602 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-operator-scripts\") pod \"keystone-399f-account-create-update-gbjfl\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.503772 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhrc5\" (UniqueName: \"kubernetes.io/projected/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-kube-api-access-xhrc5\") pod \"keystone-399f-account-create-update-gbjfl\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.504254 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-chqth\" (UniqueName: \"kubernetes.io/projected/ac4bdc52-4627-494b-b0a1-a2b17a925f00-kube-api-access-chqth\") pod \"keystone-db-create-wc2ht\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.666616 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:00 crc kubenswrapper[4769]: I1121 14:02:00.681563 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.141739 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl"] Nov 21 14:02:01 crc kubenswrapper[4769]: W1121 14:02:01.154628 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f96c7c1_3f17_4901_95f2_65dbb1f9e0ac.slice/crio-065c1cf74b668b454a0c8f45a7065da517b1af1bab6b8e645a9f71f5de3d4a4e WatchSource:0}: Error finding container 065c1cf74b668b454a0c8f45a7065da517b1af1bab6b8e645a9f71f5de3d4a4e: Status 404 returned error can't find the container with id 065c1cf74b668b454a0c8f45a7065da517b1af1bab6b8e645a9f71f5de3d4a4e Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.297859 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56c94205-898f-44d0-86e0-fd1ccb449137" path="/var/lib/kubelet/pods/56c94205-898f-44d0-86e0-fd1ccb449137/volumes" Nov 21 14:02:01 crc kubenswrapper[4769]: W1121 14:02:01.299035 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac4bdc52_4627_494b_b0a1_a2b17a925f00.slice/crio-44800b04d8142f64b2efdcca4618aa593e00940b743fc4794d7ebb669ceebc76 WatchSource:0}: Error finding container 44800b04d8142f64b2efdcca4618aa593e00940b743fc4794d7ebb669ceebc76: Status 404 returned error can't find the container with id 44800b04d8142f64b2efdcca4618aa593e00940b743fc4794d7ebb669ceebc76 Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.299452 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75bd4712-b533-4178-85a4-56be923965f7" path="/var/lib/kubelet/pods/75bd4712-b533-4178-85a4-56be923965f7/volumes" Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.299975 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4c7c78-51dc-4932-b819-31e365b91604" path="/var/lib/kubelet/pods/ad4c7c78-51dc-4932-b819-31e365b91604/volumes" Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.300575 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd69b170-12e8-4601-a472-2f169681e5ad" path="/var/lib/kubelet/pods/bd69b170-12e8-4601-a472-2f169681e5ad/volumes" Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.302394 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" event={"ID":"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac","Type":"ContainerStarted","Data":"065c1cf74b668b454a0c8f45a7065da517b1af1bab6b8e645a9f71f5de3d4a4e"} Nov 21 14:02:01 crc kubenswrapper[4769]: I1121 14:02:01.302429 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-wc2ht"] Nov 21 14:02:02 crc kubenswrapper[4769]: I1121 14:02:02.288703 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac4bdc52-4627-494b-b0a1-a2b17a925f00" containerID="e5bd5e3c9d9fe8992174e3d81e3289026f35359e790dbf827a14b78c378e9155" exitCode=0 Nov 21 14:02:02 crc kubenswrapper[4769]: I1121 14:02:02.288766 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" event={"ID":"ac4bdc52-4627-494b-b0a1-a2b17a925f00","Type":"ContainerDied","Data":"e5bd5e3c9d9fe8992174e3d81e3289026f35359e790dbf827a14b78c378e9155"} Nov 21 14:02:02 crc kubenswrapper[4769]: I1121 14:02:02.289021 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" event={"ID":"ac4bdc52-4627-494b-b0a1-a2b17a925f00","Type":"ContainerStarted","Data":"44800b04d8142f64b2efdcca4618aa593e00940b743fc4794d7ebb669ceebc76"} Nov 21 14:02:02 crc kubenswrapper[4769]: I1121 14:02:02.292230 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" containerID="0542aff6248328263e364bfa62dcef23cbe29280cf5c9dea0ffd3b37976be6b2" exitCode=0 Nov 21 14:02:02 crc kubenswrapper[4769]: I1121 14:02:02.292302 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" event={"ID":"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac","Type":"ContainerDied","Data":"0542aff6248328263e364bfa62dcef23cbe29280cf5c9dea0ffd3b37976be6b2"} Nov 21 14:02:03 crc kubenswrapper[4769]: I1121 14:02:03.749220 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:03 crc kubenswrapper[4769]: I1121 14:02:03.865260 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:03 crc kubenswrapper[4769]: I1121 14:02:03.938515 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chqth\" (UniqueName: \"kubernetes.io/projected/ac4bdc52-4627-494b-b0a1-a2b17a925f00-kube-api-access-chqth\") pod \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " Nov 21 14:02:03 crc kubenswrapper[4769]: I1121 14:02:03.938767 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac4bdc52-4627-494b-b0a1-a2b17a925f00-operator-scripts\") pod \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\" (UID: \"ac4bdc52-4627-494b-b0a1-a2b17a925f00\") " Nov 21 14:02:03 crc kubenswrapper[4769]: I1121 14:02:03.939497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac4bdc52-4627-494b-b0a1-a2b17a925f00-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ac4bdc52-4627-494b-b0a1-a2b17a925f00" (UID: "ac4bdc52-4627-494b-b0a1-a2b17a925f00"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:02:03 crc kubenswrapper[4769]: I1121 14:02:03.943802 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac4bdc52-4627-494b-b0a1-a2b17a925f00-kube-api-access-chqth" (OuterVolumeSpecName: "kube-api-access-chqth") pod "ac4bdc52-4627-494b-b0a1-a2b17a925f00" (UID: "ac4bdc52-4627-494b-b0a1-a2b17a925f00"). InnerVolumeSpecName "kube-api-access-chqth". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.040801 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-operator-scripts\") pod \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.040858 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhrc5\" (UniqueName: \"kubernetes.io/projected/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-kube-api-access-xhrc5\") pod \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\" (UID: \"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac\") " Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.041265 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" (UID: "8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.041346 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.041362 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac4bdc52-4627-494b-b0a1-a2b17a925f00-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.041372 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-chqth\" (UniqueName: \"kubernetes.io/projected/ac4bdc52-4627-494b-b0a1-a2b17a925f00-kube-api-access-chqth\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.044243 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-kube-api-access-xhrc5" (OuterVolumeSpecName: "kube-api-access-xhrc5") pod "8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" (UID: "8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac"). InnerVolumeSpecName "kube-api-access-xhrc5". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.142342 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xhrc5\" (UniqueName: \"kubernetes.io/projected/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac-kube-api-access-xhrc5\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.307689 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" event={"ID":"ac4bdc52-4627-494b-b0a1-a2b17a925f00","Type":"ContainerDied","Data":"44800b04d8142f64b2efdcca4618aa593e00940b743fc4794d7ebb669ceebc76"} Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.307749 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44800b04d8142f64b2efdcca4618aa593e00940b743fc4794d7ebb669ceebc76" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.307783 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-create-wc2ht" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.309665 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" event={"ID":"8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac","Type":"ContainerDied","Data":"065c1cf74b668b454a0c8f45a7065da517b1af1bab6b8e645a9f71f5de3d4a4e"} Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.309702 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl" Nov 21 14:02:04 crc kubenswrapper[4769]: I1121 14:02:04.309719 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="065c1cf74b668b454a0c8f45a7065da517b1af1bab6b8e645a9f71f5de3d4a4e" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.816408 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-2qhn2"] Nov 21 14:02:05 crc kubenswrapper[4769]: E1121 14:02:05.816905 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac4bdc52-4627-494b-b0a1-a2b17a925f00" containerName="mariadb-database-create" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.816919 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4bdc52-4627-494b-b0a1-a2b17a925f00" containerName="mariadb-database-create" Nov 21 14:02:05 crc kubenswrapper[4769]: E1121 14:02:05.816940 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" containerName="mariadb-account-create-update" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.816946 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" containerName="mariadb-account-create-update" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.817066 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" containerName="mariadb-account-create-update" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.817080 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac4bdc52-4627-494b-b0a1-a2b17a925f00" containerName="mariadb-database-create" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.817536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.819399 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.819467 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.819957 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.820777 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-dlnd6" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.838217 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-2qhn2"] Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.867455 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kvkl\" (UniqueName: \"kubernetes.io/projected/42f0ed74-6764-44cf-b5ed-e956bc74221c-kube-api-access-5kvkl\") pod \"keystone-db-sync-2qhn2\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.867518 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f0ed74-6764-44cf-b5ed-e956bc74221c-config-data\") pod \"keystone-db-sync-2qhn2\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.969736 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kvkl\" (UniqueName: \"kubernetes.io/projected/42f0ed74-6764-44cf-b5ed-e956bc74221c-kube-api-access-5kvkl\") pod \"keystone-db-sync-2qhn2\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.969796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f0ed74-6764-44cf-b5ed-e956bc74221c-config-data\") pod \"keystone-db-sync-2qhn2\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.979108 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f0ed74-6764-44cf-b5ed-e956bc74221c-config-data\") pod \"keystone-db-sync-2qhn2\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:05 crc kubenswrapper[4769]: I1121 14:02:05.987279 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kvkl\" (UniqueName: \"kubernetes.io/projected/42f0ed74-6764-44cf-b5ed-e956bc74221c-kube-api-access-5kvkl\") pod \"keystone-db-sync-2qhn2\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:06 crc kubenswrapper[4769]: I1121 14:02:06.136450 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:06 crc kubenswrapper[4769]: I1121 14:02:06.603568 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-2qhn2"] Nov 21 14:02:07 crc kubenswrapper[4769]: I1121 14:02:07.342465 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" event={"ID":"42f0ed74-6764-44cf-b5ed-e956bc74221c","Type":"ContainerStarted","Data":"f541af002a34d9c8ca2c2d7bda568ff024dc68d989af035fca457b5ee040a668"} Nov 21 14:02:07 crc kubenswrapper[4769]: I1121 14:02:07.342729 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" event={"ID":"42f0ed74-6764-44cf-b5ed-e956bc74221c","Type":"ContainerStarted","Data":"23de3e2b5e03a3606190607bd7ddc69de7f25c4b6782ef7840c7ba5eb54c06ea"} Nov 21 14:02:07 crc kubenswrapper[4769]: I1121 14:02:07.359053 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" podStartSLOduration=2.359032756 podStartE2EDuration="2.359032756s" podCreationTimestamp="2025-11-21 14:02:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:02:07.354430534 +0000 UTC m=+7886.055092362" watchObservedRunningTime="2025-11-21 14:02:07.359032756 +0000 UTC m=+7886.059694574" Nov 21 14:02:09 crc kubenswrapper[4769]: I1121 14:02:09.365379 4769 generic.go:334] "Generic (PLEG): container finished" podID="42f0ed74-6764-44cf-b5ed-e956bc74221c" containerID="f541af002a34d9c8ca2c2d7bda568ff024dc68d989af035fca457b5ee040a668" exitCode=0 Nov 21 14:02:09 crc kubenswrapper[4769]: I1121 14:02:09.365463 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" event={"ID":"42f0ed74-6764-44cf-b5ed-e956bc74221c","Type":"ContainerDied","Data":"f541af002a34d9c8ca2c2d7bda568ff024dc68d989af035fca457b5ee040a668"} Nov 21 14:02:10 crc kubenswrapper[4769]: I1121 14:02:10.851782 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:10 crc kubenswrapper[4769]: I1121 14:02:10.978080 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kvkl\" (UniqueName: \"kubernetes.io/projected/42f0ed74-6764-44cf-b5ed-e956bc74221c-kube-api-access-5kvkl\") pod \"42f0ed74-6764-44cf-b5ed-e956bc74221c\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " Nov 21 14:02:10 crc kubenswrapper[4769]: I1121 14:02:10.978273 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f0ed74-6764-44cf-b5ed-e956bc74221c-config-data\") pod \"42f0ed74-6764-44cf-b5ed-e956bc74221c\" (UID: \"42f0ed74-6764-44cf-b5ed-e956bc74221c\") " Nov 21 14:02:10 crc kubenswrapper[4769]: I1121 14:02:10.982982 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f0ed74-6764-44cf-b5ed-e956bc74221c-kube-api-access-5kvkl" (OuterVolumeSpecName: "kube-api-access-5kvkl") pod "42f0ed74-6764-44cf-b5ed-e956bc74221c" (UID: "42f0ed74-6764-44cf-b5ed-e956bc74221c"). InnerVolumeSpecName "kube-api-access-5kvkl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.025374 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42f0ed74-6764-44cf-b5ed-e956bc74221c-config-data" (OuterVolumeSpecName: "config-data") pod "42f0ed74-6764-44cf-b5ed-e956bc74221c" (UID: "42f0ed74-6764-44cf-b5ed-e956bc74221c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.080729 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kvkl\" (UniqueName: \"kubernetes.io/projected/42f0ed74-6764-44cf-b5ed-e956bc74221c-kube-api-access-5kvkl\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.080776 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42f0ed74-6764-44cf-b5ed-e956bc74221c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.324765 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.324837 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.390234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" event={"ID":"42f0ed74-6764-44cf-b5ed-e956bc74221c","Type":"ContainerDied","Data":"23de3e2b5e03a3606190607bd7ddc69de7f25c4b6782ef7840c7ba5eb54c06ea"} Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.390282 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23de3e2b5e03a3606190607bd7ddc69de7f25c4b6782ef7840c7ba5eb54c06ea" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.390619 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-db-sync-2qhn2" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.557972 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-lvmb6"] Nov 21 14:02:11 crc kubenswrapper[4769]: E1121 14:02:11.558406 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="42f0ed74-6764-44cf-b5ed-e956bc74221c" containerName="keystone-db-sync" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.558430 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f0ed74-6764-44cf-b5ed-e956bc74221c" containerName="keystone-db-sync" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.558617 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="42f0ed74-6764-44cf-b5ed-e956bc74221c" containerName="keystone-db-sync" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.559254 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.562350 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"osp-secret" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.563040 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-dlnd6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.563325 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.564370 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.565997 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.568464 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-lvmb6"] Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.691453 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcsn4\" (UniqueName: \"kubernetes.io/projected/7d426e72-02f5-4009-a4ec-fc596845bafc-kube-api-access-kcsn4\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.691560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-credential-keys\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.691588 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-config-data\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.691675 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-scripts\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.691725 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-fernet-keys\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.794124 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-credential-keys\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.794449 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsn4\" (UniqueName: \"kubernetes.io/projected/7d426e72-02f5-4009-a4ec-fc596845bafc-kube-api-access-kcsn4\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.794514 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-config-data\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.794625 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-scripts\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.794670 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-fernet-keys\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.798740 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-scripts\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.799400 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-fernet-keys\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.800106 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-credential-keys\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.800413 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-config-data\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.823161 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcsn4\" (UniqueName: \"kubernetes.io/projected/7d426e72-02f5-4009-a4ec-fc596845bafc-kube-api-access-kcsn4\") pod \"keystone-bootstrap-lvmb6\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:11 crc kubenswrapper[4769]: I1121 14:02:11.875448 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:12 crc kubenswrapper[4769]: I1121 14:02:12.365683 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-lvmb6"] Nov 21 14:02:12 crc kubenswrapper[4769]: W1121 14:02:12.375076 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d426e72_02f5_4009_a4ec_fc596845bafc.slice/crio-1d99d41d323c5af0431db0ff71bb51ab18ef928f8a850c3cbb6452bcd1c60db2 WatchSource:0}: Error finding container 1d99d41d323c5af0431db0ff71bb51ab18ef928f8a850c3cbb6452bcd1c60db2: Status 404 returned error can't find the container with id 1d99d41d323c5af0431db0ff71bb51ab18ef928f8a850c3cbb6452bcd1c60db2 Nov 21 14:02:12 crc kubenswrapper[4769]: I1121 14:02:12.402299 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" event={"ID":"7d426e72-02f5-4009-a4ec-fc596845bafc","Type":"ContainerStarted","Data":"1d99d41d323c5af0431db0ff71bb51ab18ef928f8a850c3cbb6452bcd1c60db2"} Nov 21 14:02:13 crc kubenswrapper[4769]: I1121 14:02:13.411598 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" event={"ID":"7d426e72-02f5-4009-a4ec-fc596845bafc","Type":"ContainerStarted","Data":"14278cec779328aca68bbb98e9b6ea75b924df1246fa89ec949831beb1a8ce44"} Nov 21 14:02:13 crc kubenswrapper[4769]: I1121 14:02:13.430820 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" podStartSLOduration=2.430800571 podStartE2EDuration="2.430800571s" podCreationTimestamp="2025-11-21 14:02:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:02:13.429673391 +0000 UTC m=+7892.130335229" watchObservedRunningTime="2025-11-21 14:02:13.430800571 +0000 UTC m=+7892.131462389" Nov 21 14:02:15 crc kubenswrapper[4769]: I1121 14:02:15.432895 4769 generic.go:334] "Generic (PLEG): container finished" podID="7d426e72-02f5-4009-a4ec-fc596845bafc" containerID="14278cec779328aca68bbb98e9b6ea75b924df1246fa89ec949831beb1a8ce44" exitCode=0 Nov 21 14:02:15 crc kubenswrapper[4769]: I1121 14:02:15.433042 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" event={"ID":"7d426e72-02f5-4009-a4ec-fc596845bafc","Type":"ContainerDied","Data":"14278cec779328aca68bbb98e9b6ea75b924df1246fa89ec949831beb1a8ce44"} Nov 21 14:02:16 crc kubenswrapper[4769]: I1121 14:02:16.926679 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.091507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-scripts\") pod \"7d426e72-02f5-4009-a4ec-fc596845bafc\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.091567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-config-data\") pod \"7d426e72-02f5-4009-a4ec-fc596845bafc\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.091605 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-fernet-keys\") pod \"7d426e72-02f5-4009-a4ec-fc596845bafc\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.091670 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcsn4\" (UniqueName: \"kubernetes.io/projected/7d426e72-02f5-4009-a4ec-fc596845bafc-kube-api-access-kcsn4\") pod \"7d426e72-02f5-4009-a4ec-fc596845bafc\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.091715 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-credential-keys\") pod \"7d426e72-02f5-4009-a4ec-fc596845bafc\" (UID: \"7d426e72-02f5-4009-a4ec-fc596845bafc\") " Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.099064 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-scripts" (OuterVolumeSpecName: "scripts") pod "7d426e72-02f5-4009-a4ec-fc596845bafc" (UID: "7d426e72-02f5-4009-a4ec-fc596845bafc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.099072 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d426e72-02f5-4009-a4ec-fc596845bafc-kube-api-access-kcsn4" (OuterVolumeSpecName: "kube-api-access-kcsn4") pod "7d426e72-02f5-4009-a4ec-fc596845bafc" (UID: "7d426e72-02f5-4009-a4ec-fc596845bafc"). InnerVolumeSpecName "kube-api-access-kcsn4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.099079 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "7d426e72-02f5-4009-a4ec-fc596845bafc" (UID: "7d426e72-02f5-4009-a4ec-fc596845bafc"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.099178 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "7d426e72-02f5-4009-a4ec-fc596845bafc" (UID: "7d426e72-02f5-4009-a4ec-fc596845bafc"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.119459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-config-data" (OuterVolumeSpecName: "config-data") pod "7d426e72-02f5-4009-a4ec-fc596845bafc" (UID: "7d426e72-02f5-4009-a4ec-fc596845bafc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.194172 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.194222 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.194234 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.194248 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kcsn4\" (UniqueName: \"kubernetes.io/projected/7d426e72-02f5-4009-a4ec-fc596845bafc-kube-api-access-kcsn4\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.194259 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7d426e72-02f5-4009-a4ec-fc596845bafc-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.452447 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" event={"ID":"7d426e72-02f5-4009-a4ec-fc596845bafc","Type":"ContainerDied","Data":"1d99d41d323c5af0431db0ff71bb51ab18ef928f8a850c3cbb6452bcd1c60db2"} Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.452700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-bootstrap-lvmb6" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.453096 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d99d41d323c5af0431db0ff71bb51ab18ef928f8a850c3cbb6452bcd1c60db2" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.558131 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone-678f7bd944-drs24"] Nov 21 14:02:17 crc kubenswrapper[4769]: E1121 14:02:17.559270 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7d426e72-02f5-4009-a4ec-fc596845bafc" containerName="keystone-bootstrap" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.559298 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d426e72-02f5-4009-a4ec-fc596845bafc" containerName="keystone-bootstrap" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.559485 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="7d426e72-02f5-4009-a4ec-fc596845bafc" containerName="keystone-bootstrap" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.560042 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.561857 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.562588 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-scripts" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.564326 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-config-data" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.585226 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-678f7bd944-drs24"] Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.587840 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"keystone-keystone-dockercfg-dlnd6" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.707913 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-config-data\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.707982 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-credential-keys\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.708059 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mszf\" (UniqueName: \"kubernetes.io/projected/ac408e3a-fd62-40f9-831b-03a452f1643b-kube-api-access-6mszf\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.708083 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-fernet-keys\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.708145 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-scripts\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.810451 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-config-data\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.810572 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-credential-keys\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.810718 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6mszf\" (UniqueName: \"kubernetes.io/projected/ac408e3a-fd62-40f9-831b-03a452f1643b-kube-api-access-6mszf\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.810753 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-fernet-keys\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.810800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-scripts\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.814104 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-credential-keys\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.814710 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-config-data\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.814933 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-fernet-keys\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.815180 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-scripts\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.827714 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mszf\" (UniqueName: \"kubernetes.io/projected/ac408e3a-fd62-40f9-831b-03a452f1643b-kube-api-access-6mszf\") pod \"keystone-678f7bd944-drs24\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:17 crc kubenswrapper[4769]: I1121 14:02:17.942326 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:18 crc kubenswrapper[4769]: I1121 14:02:18.336574 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone-678f7bd944-drs24"] Nov 21 14:02:18 crc kubenswrapper[4769]: W1121 14:02:18.341247 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac408e3a_fd62_40f9_831b_03a452f1643b.slice/crio-fc942cc89019922b2dee34bf12c93e38acca31e8febe0a64f75afd26b42dcdf5 WatchSource:0}: Error finding container fc942cc89019922b2dee34bf12c93e38acca31e8febe0a64f75afd26b42dcdf5: Status 404 returned error can't find the container with id fc942cc89019922b2dee34bf12c93e38acca31e8febe0a64f75afd26b42dcdf5 Nov 21 14:02:18 crc kubenswrapper[4769]: I1121 14:02:18.462418 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" event={"ID":"ac408e3a-fd62-40f9-831b-03a452f1643b","Type":"ContainerStarted","Data":"fc942cc89019922b2dee34bf12c93e38acca31e8febe0a64f75afd26b42dcdf5"} Nov 21 14:02:19 crc kubenswrapper[4769]: I1121 14:02:19.477982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" event={"ID":"ac408e3a-fd62-40f9-831b-03a452f1643b","Type":"ContainerStarted","Data":"b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7"} Nov 21 14:02:19 crc kubenswrapper[4769]: I1121 14:02:19.478251 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:19 crc kubenswrapper[4769]: I1121 14:02:19.511691 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" podStartSLOduration=2.511667855 podStartE2EDuration="2.511667855s" podCreationTimestamp="2025-11-21 14:02:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:02:19.504770802 +0000 UTC m=+7898.205432610" watchObservedRunningTime="2025-11-21 14:02:19.511667855 +0000 UTC m=+7898.212329683" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.203714 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-swjkv"] Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.206394 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.219933 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-swjkv"] Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.241137 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-catalog-content\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.241355 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrs6x\" (UniqueName: \"kubernetes.io/projected/78f0588e-5485-4e37-93a5-e6bcfdf9974a-kube-api-access-mrs6x\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.241529 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-utilities\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.343284 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mrs6x\" (UniqueName: \"kubernetes.io/projected/78f0588e-5485-4e37-93a5-e6bcfdf9974a-kube-api-access-mrs6x\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.343654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-utilities\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.343876 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-catalog-content\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.344170 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-utilities\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.344570 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-catalog-content\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.375339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrs6x\" (UniqueName: \"kubernetes.io/projected/78f0588e-5485-4e37-93a5-e6bcfdf9974a-kube-api-access-mrs6x\") pod \"redhat-operators-swjkv\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.556056 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:30 crc kubenswrapper[4769]: I1121 14:02:30.981881 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-swjkv"] Nov 21 14:02:30 crc kubenswrapper[4769]: W1121 14:02:30.989694 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f0588e_5485_4e37_93a5_e6bcfdf9974a.slice/crio-a0dfabef51b44361ee4708702f86bcb121087f3d9f42cbfee5c495e126117a8b WatchSource:0}: Error finding container a0dfabef51b44361ee4708702f86bcb121087f3d9f42cbfee5c495e126117a8b: Status 404 returned error can't find the container with id a0dfabef51b44361ee4708702f86bcb121087f3d9f42cbfee5c495e126117a8b Nov 21 14:02:31 crc kubenswrapper[4769]: I1121 14:02:31.598989 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-swjkv" event={"ID":"78f0588e-5485-4e37-93a5-e6bcfdf9974a","Type":"ContainerDied","Data":"d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d"} Nov 21 14:02:31 crc kubenswrapper[4769]: I1121 14:02:31.598805 4769 generic.go:334] "Generic (PLEG): container finished" podID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerID="d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d" exitCode=0 Nov 21 14:02:31 crc kubenswrapper[4769]: I1121 14:02:31.599466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-swjkv" event={"ID":"78f0588e-5485-4e37-93a5-e6bcfdf9974a","Type":"ContainerStarted","Data":"a0dfabef51b44361ee4708702f86bcb121087f3d9f42cbfee5c495e126117a8b"} Nov 21 14:02:31 crc kubenswrapper[4769]: I1121 14:02:31.600758 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 14:02:33 crc kubenswrapper[4769]: I1121 14:02:33.622237 4769 generic.go:334] "Generic (PLEG): container finished" podID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerID="ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0" exitCode=0 Nov 21 14:02:33 crc kubenswrapper[4769]: I1121 14:02:33.622321 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-swjkv" event={"ID":"78f0588e-5485-4e37-93a5-e6bcfdf9974a","Type":"ContainerDied","Data":"ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0"} Nov 21 14:02:34 crc kubenswrapper[4769]: I1121 14:02:34.636606 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-swjkv" event={"ID":"78f0588e-5485-4e37-93a5-e6bcfdf9974a","Type":"ContainerStarted","Data":"249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57"} Nov 21 14:02:34 crc kubenswrapper[4769]: I1121 14:02:34.658984 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-swjkv" podStartSLOduration=2.240922121 podStartE2EDuration="4.65896744s" podCreationTimestamp="2025-11-21 14:02:30 +0000 UTC" firstStartedPulling="2025-11-21 14:02:31.600513713 +0000 UTC m=+7910.301175531" lastFinishedPulling="2025-11-21 14:02:34.018559012 +0000 UTC m=+7912.719220850" observedRunningTime="2025-11-21 14:02:34.653625608 +0000 UTC m=+7913.354287426" watchObservedRunningTime="2025-11-21 14:02:34.65896744 +0000 UTC m=+7913.359629258" Nov 21 14:02:40 crc kubenswrapper[4769]: I1121 14:02:40.557043 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:40 crc kubenswrapper[4769]: I1121 14:02:40.557608 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:40 crc kubenswrapper[4769]: I1121 14:02:40.638479 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:40 crc kubenswrapper[4769]: I1121 14:02:40.737466 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:40 crc kubenswrapper[4769]: I1121 14:02:40.874309 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-swjkv"] Nov 21 14:02:41 crc kubenswrapper[4769]: I1121 14:02:41.325146 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:02:41 crc kubenswrapper[4769]: I1121 14:02:41.325235 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:02:42 crc kubenswrapper[4769]: I1121 14:02:42.708074 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-swjkv" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="registry-server" containerID="cri-o://249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57" gracePeriod=2 Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.222379 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.392731 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrs6x\" (UniqueName: \"kubernetes.io/projected/78f0588e-5485-4e37-93a5-e6bcfdf9974a-kube-api-access-mrs6x\") pod \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.392853 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-utilities\") pod \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.392950 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-catalog-content\") pod \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\" (UID: \"78f0588e-5485-4e37-93a5-e6bcfdf9974a\") " Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.397345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-utilities" (OuterVolumeSpecName: "utilities") pod "78f0588e-5485-4e37-93a5-e6bcfdf9974a" (UID: "78f0588e-5485-4e37-93a5-e6bcfdf9974a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.416384 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f0588e-5485-4e37-93a5-e6bcfdf9974a-kube-api-access-mrs6x" (OuterVolumeSpecName: "kube-api-access-mrs6x") pod "78f0588e-5485-4e37-93a5-e6bcfdf9974a" (UID: "78f0588e-5485-4e37-93a5-e6bcfdf9974a"). InnerVolumeSpecName "kube-api-access-mrs6x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.494885 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mrs6x\" (UniqueName: \"kubernetes.io/projected/78f0588e-5485-4e37-93a5-e6bcfdf9974a-kube-api-access-mrs6x\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.494917 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.717769 4769 generic.go:334] "Generic (PLEG): container finished" podID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerID="249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57" exitCode=0 Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.717838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-swjkv" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.717913 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-swjkv" event={"ID":"78f0588e-5485-4e37-93a5-e6bcfdf9974a","Type":"ContainerDied","Data":"249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57"} Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.719029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-swjkv" event={"ID":"78f0588e-5485-4e37-93a5-e6bcfdf9974a","Type":"ContainerDied","Data":"a0dfabef51b44361ee4708702f86bcb121087f3d9f42cbfee5c495e126117a8b"} Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.719051 4769 scope.go:117] "RemoveContainer" containerID="249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.735840 4769 scope.go:117] "RemoveContainer" containerID="ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.751919 4769 scope.go:117] "RemoveContainer" containerID="d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.780078 4769 scope.go:117] "RemoveContainer" containerID="249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57" Nov 21 14:02:43 crc kubenswrapper[4769]: E1121 14:02:43.780595 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57\": container with ID starting with 249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57 not found: ID does not exist" containerID="249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.780633 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57"} err="failed to get container status \"249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57\": rpc error: code = NotFound desc = could not find container \"249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57\": container with ID starting with 249847316ba5a0d03c5ab5d1fb3398ee528cad6100945d0112510d17ef27da57 not found: ID does not exist" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.780658 4769 scope.go:117] "RemoveContainer" containerID="ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0" Nov 21 14:02:43 crc kubenswrapper[4769]: E1121 14:02:43.781113 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0\": container with ID starting with ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0 not found: ID does not exist" containerID="ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.781136 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0"} err="failed to get container status \"ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0\": rpc error: code = NotFound desc = could not find container \"ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0\": container with ID starting with ec0f3033631a52ada76f0e3bfeb89111e8a208437fcf2db25a08e80377e0cba0 not found: ID does not exist" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.781151 4769 scope.go:117] "RemoveContainer" containerID="d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d" Nov 21 14:02:43 crc kubenswrapper[4769]: E1121 14:02:43.781582 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d\": container with ID starting with d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d not found: ID does not exist" containerID="d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d" Nov 21 14:02:43 crc kubenswrapper[4769]: I1121 14:02:43.781640 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d"} err="failed to get container status \"d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d\": rpc error: code = NotFound desc = could not find container \"d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d\": container with ID starting with d49d2dcaa19b9e5c58c50943e002a98047792449eaa80feda1e5def019075e2d not found: ID does not exist" Nov 21 14:02:44 crc kubenswrapper[4769]: I1121 14:02:44.076621 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "78f0588e-5485-4e37-93a5-e6bcfdf9974a" (UID: "78f0588e-5485-4e37-93a5-e6bcfdf9974a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:02:44 crc kubenswrapper[4769]: I1121 14:02:44.104733 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/78f0588e-5485-4e37-93a5-e6bcfdf9974a-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:02:44 crc kubenswrapper[4769]: I1121 14:02:44.371300 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-swjkv"] Nov 21 14:02:44 crc kubenswrapper[4769]: I1121 14:02:44.380741 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-swjkv"] Nov 21 14:02:45 crc kubenswrapper[4769]: I1121 14:02:45.287276 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" path="/var/lib/kubelet/pods/78f0588e-5485-4e37-93a5-e6bcfdf9974a/volumes" Nov 21 14:02:49 crc kubenswrapper[4769]: I1121 14:02:49.441469 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.043809 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/openstackclient"] Nov 21 14:02:50 crc kubenswrapper[4769]: E1121 14:02:50.044551 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="registry-server" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.044592 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="registry-server" Nov 21 14:02:50 crc kubenswrapper[4769]: E1121 14:02:50.044638 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="extract-content" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.044652 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="extract-content" Nov 21 14:02:50 crc kubenswrapper[4769]: E1121 14:02:50.044683 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="extract-utilities" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.044698 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="extract-utilities" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.045087 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="78f0588e-5485-4e37-93a5-e6bcfdf9974a" containerName="registry-server" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.046335 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.049956 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"default-dockercfg-bsqsw" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.050067 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"keystone-kuttl-tests"/"openstack-config" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.050266 4769 reflector.go:368] Caches populated for *v1.Secret from object-"keystone-kuttl-tests"/"openstack-config-secret" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.052265 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.208111 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.208150 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config-secret\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.208210 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68c77\" (UniqueName: \"kubernetes.io/projected/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-kube-api-access-68c77\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.309424 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-68c77\" (UniqueName: \"kubernetes.io/projected/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-kube-api-access-68c77\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.309540 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.309560 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config-secret\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.311081 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.323369 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config-secret\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.329791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-68c77\" (UniqueName: \"kubernetes.io/projected/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-kube-api-access-68c77\") pod \"openstackclient\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.374169 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Nov 21 14:02:50 crc kubenswrapper[4769]: I1121 14:02:50.867231 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Nov 21 14:02:51 crc kubenswrapper[4769]: I1121 14:02:51.799266 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"8f57d616-f936-4bc3-97c0-b71c4a1e8eda","Type":"ContainerStarted","Data":"26704c9ca0e700a916291341249d9bca89551353d8c9dda45b01c14ecfb9760e"} Nov 21 14:02:58 crc kubenswrapper[4769]: I1121 14:02:58.850582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"8f57d616-f936-4bc3-97c0-b71c4a1e8eda","Type":"ContainerStarted","Data":"8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388"} Nov 21 14:02:58 crc kubenswrapper[4769]: I1121 14:02:58.872987 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keystone-kuttl-tests/openstackclient" podStartSLOduration=1.954362892 podStartE2EDuration="8.87296712s" podCreationTimestamp="2025-11-21 14:02:50 +0000 UTC" firstStartedPulling="2025-11-21 14:02:50.882535511 +0000 UTC m=+7929.583197329" lastFinishedPulling="2025-11-21 14:02:57.801139729 +0000 UTC m=+7936.501801557" observedRunningTime="2025-11-21 14:02:58.869671162 +0000 UTC m=+7937.570332990" watchObservedRunningTime="2025-11-21 14:02:58.87296712 +0000 UTC m=+7937.573628948" Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.325073 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.325882 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.325952 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.326918 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.327066 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" gracePeriod=600 Nov 21 14:03:11 crc kubenswrapper[4769]: E1121 14:03:11.473347 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.962889 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" exitCode=0 Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.962932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3"} Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.962984 4769 scope.go:117] "RemoveContainer" containerID="4b281e3968dd00ac10667b2de968f283cd017ecc4962a2f4341cb0a9daf93504" Nov 21 14:03:11 crc kubenswrapper[4769]: I1121 14:03:11.963594 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:03:11 crc kubenswrapper[4769]: E1121 14:03:11.963982 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:03:13 crc kubenswrapper[4769]: I1121 14:03:13.702291 4769 scope.go:117] "RemoveContainer" containerID="fe62d25330499026905b794bba253fcf544dbbf4a44e41a1e1010ab1f185a693" Nov 21 14:03:13 crc kubenswrapper[4769]: I1121 14:03:13.728021 4769 scope.go:117] "RemoveContainer" containerID="c8c3450781c5009982fc76bcc84b5d492e2e4b5f00b1e530ddeac0888a2804fd" Nov 21 14:03:27 crc kubenswrapper[4769]: I1121 14:03:27.274529 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:03:27 crc kubenswrapper[4769]: E1121 14:03:27.275157 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:03:40 crc kubenswrapper[4769]: I1121 14:03:40.274421 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:03:40 crc kubenswrapper[4769]: E1121 14:03:40.275219 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:03:51 crc kubenswrapper[4769]: I1121 14:03:51.275018 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:03:51 crc kubenswrapper[4769]: E1121 14:03:51.276472 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:04:03 crc kubenswrapper[4769]: I1121 14:04:03.281937 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:04:03 crc kubenswrapper[4769]: E1121 14:04:03.284300 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:04:13 crc kubenswrapper[4769]: I1121 14:04:13.817367 4769 scope.go:117] "RemoveContainer" containerID="83587f4950c216082e265e2e164f06525c31e315dfd81af9eda7549a307ea0d3" Nov 21 14:04:13 crc kubenswrapper[4769]: I1121 14:04:13.851961 4769 scope.go:117] "RemoveContainer" containerID="0bc67d52644a65b7c292ae842c62afae6268544c938fa70484f1f36738bd0d19" Nov 21 14:04:14 crc kubenswrapper[4769]: I1121 14:04:14.274373 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:04:14 crc kubenswrapper[4769]: E1121 14:04:14.274835 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:04:26 crc kubenswrapper[4769]: I1121 14:04:26.274922 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:04:26 crc kubenswrapper[4769]: E1121 14:04:26.275834 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:04:40 crc kubenswrapper[4769]: I1121 14:04:40.274721 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:04:40 crc kubenswrapper[4769]: E1121 14:04:40.276153 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:04:52 crc kubenswrapper[4769]: I1121 14:04:52.275345 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:04:52 crc kubenswrapper[4769]: E1121 14:04:52.276053 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:05:04 crc kubenswrapper[4769]: I1121 14:05:04.273968 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:05:04 crc kubenswrapper[4769]: E1121 14:05:04.274836 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:05:13 crc kubenswrapper[4769]: I1121 14:05:13.935832 4769 scope.go:117] "RemoveContainer" containerID="da0cf401961b39e1222e6aba684e17553a4259aa4b957e3166c95bbf9bc2e7b1" Nov 21 14:05:13 crc kubenswrapper[4769]: I1121 14:05:13.962116 4769 scope.go:117] "RemoveContainer" containerID="649c39b807424d5c2aa863630e438a670d814c9bd2d2e916c06f7dbbf49ea788" Nov 21 14:05:13 crc kubenswrapper[4769]: I1121 14:05:13.995125 4769 scope.go:117] "RemoveContainer" containerID="56c4cf059d6a9304ed2a6c88b12b794fc42a975d697f93ec03f9790f63659021" Nov 21 14:05:14 crc kubenswrapper[4769]: I1121 14:05:14.018596 4769 scope.go:117] "RemoveContainer" containerID="d4fb53901a7bf2aaf1bfbd09ad74aae90260b6244aa49f80e5192e7ca0e798bb" Nov 21 14:05:14 crc kubenswrapper[4769]: I1121 14:05:14.049083 4769 scope.go:117] "RemoveContainer" containerID="e477462c51425fc436adcd23db5069e7d228e379dddaabd44a8acb7c3fca49c7" Nov 21 14:05:15 crc kubenswrapper[4769]: I1121 14:05:15.275141 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:05:15 crc kubenswrapper[4769]: E1121 14:05:15.276004 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:05:28 crc kubenswrapper[4769]: I1121 14:05:28.275269 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:05:28 crc kubenswrapper[4769]: E1121 14:05:28.276743 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:05:39 crc kubenswrapper[4769]: I1121 14:05:39.278328 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:05:39 crc kubenswrapper[4769]: E1121 14:05:39.279036 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.388663 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-zp87l"] Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.392363 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.455131 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zp87l"] Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.491116 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-catalog-content\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.492004 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-utilities\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.492045 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mw7d\" (UniqueName: \"kubernetes.io/projected/50d91fab-a2ae-46e1-a67c-a7333eb118f7-kube-api-access-4mw7d\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.593082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-catalog-content\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.593416 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-utilities\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.593504 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4mw7d\" (UniqueName: \"kubernetes.io/projected/50d91fab-a2ae-46e1-a67c-a7333eb118f7-kube-api-access-4mw7d\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.593630 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-catalog-content\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.594371 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-utilities\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.616849 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mw7d\" (UniqueName: \"kubernetes.io/projected/50d91fab-a2ae-46e1-a67c-a7333eb118f7-kube-api-access-4mw7d\") pod \"redhat-marketplace-zp87l\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:42 crc kubenswrapper[4769]: I1121 14:05:42.728432 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:43 crc kubenswrapper[4769]: I1121 14:05:43.246127 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-zp87l"] Nov 21 14:05:43 crc kubenswrapper[4769]: W1121 14:05:43.248314 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d91fab_a2ae_46e1_a67c_a7333eb118f7.slice/crio-42d0e8ae599c91150116746befd3ba7d263f7d364edd9e8e6e246eeaa59659c4 WatchSource:0}: Error finding container 42d0e8ae599c91150116746befd3ba7d263f7d364edd9e8e6e246eeaa59659c4: Status 404 returned error can't find the container with id 42d0e8ae599c91150116746befd3ba7d263f7d364edd9e8e6e246eeaa59659c4 Nov 21 14:05:43 crc kubenswrapper[4769]: I1121 14:05:43.392291 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zp87l" event={"ID":"50d91fab-a2ae-46e1-a67c-a7333eb118f7","Type":"ContainerStarted","Data":"42d0e8ae599c91150116746befd3ba7d263f7d364edd9e8e6e246eeaa59659c4"} Nov 21 14:05:44 crc kubenswrapper[4769]: I1121 14:05:44.407655 4769 generic.go:334] "Generic (PLEG): container finished" podID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerID="c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb" exitCode=0 Nov 21 14:05:44 crc kubenswrapper[4769]: I1121 14:05:44.407950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zp87l" event={"ID":"50d91fab-a2ae-46e1-a67c-a7333eb118f7","Type":"ContainerDied","Data":"c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb"} Nov 21 14:05:45 crc kubenswrapper[4769]: I1121 14:05:45.421855 4769 generic.go:334] "Generic (PLEG): container finished" podID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerID="3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a" exitCode=0 Nov 21 14:05:45 crc kubenswrapper[4769]: I1121 14:05:45.421878 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zp87l" event={"ID":"50d91fab-a2ae-46e1-a67c-a7333eb118f7","Type":"ContainerDied","Data":"3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a"} Nov 21 14:05:46 crc kubenswrapper[4769]: I1121 14:05:46.434616 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zp87l" event={"ID":"50d91fab-a2ae-46e1-a67c-a7333eb118f7","Type":"ContainerStarted","Data":"670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72"} Nov 21 14:05:46 crc kubenswrapper[4769]: I1121 14:05:46.461567 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-zp87l" podStartSLOduration=3.008759537 podStartE2EDuration="4.461550184s" podCreationTimestamp="2025-11-21 14:05:42 +0000 UTC" firstStartedPulling="2025-11-21 14:05:44.410527502 +0000 UTC m=+8103.111189330" lastFinishedPulling="2025-11-21 14:05:45.863318169 +0000 UTC m=+8104.563979977" observedRunningTime="2025-11-21 14:05:46.458451642 +0000 UTC m=+8105.159113460" watchObservedRunningTime="2025-11-21 14:05:46.461550184 +0000 UTC m=+8105.162212002" Nov 21 14:05:52 crc kubenswrapper[4769]: I1121 14:05:52.273797 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:05:52 crc kubenswrapper[4769]: E1121 14:05:52.274769 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:05:52 crc kubenswrapper[4769]: I1121 14:05:52.728778 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:52 crc kubenswrapper[4769]: I1121 14:05:52.728841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:52 crc kubenswrapper[4769]: I1121 14:05:52.798902 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:53 crc kubenswrapper[4769]: I1121 14:05:53.530788 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:53 crc kubenswrapper[4769]: I1121 14:05:53.574788 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-zp87l"] Nov 21 14:05:55 crc kubenswrapper[4769]: I1121 14:05:55.497653 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-zp87l" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="registry-server" containerID="cri-o://670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72" gracePeriod=2 Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.419016 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.506674 4769 generic.go:334] "Generic (PLEG): container finished" podID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerID="670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72" exitCode=0 Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.506715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zp87l" event={"ID":"50d91fab-a2ae-46e1-a67c-a7333eb118f7","Type":"ContainerDied","Data":"670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72"} Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.506741 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-zp87l" event={"ID":"50d91fab-a2ae-46e1-a67c-a7333eb118f7","Type":"ContainerDied","Data":"42d0e8ae599c91150116746befd3ba7d263f7d364edd9e8e6e246eeaa59659c4"} Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.506757 4769 scope.go:117] "RemoveContainer" containerID="670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.506760 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-zp87l" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.522244 4769 scope.go:117] "RemoveContainer" containerID="3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.530752 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-utilities\") pod \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.530989 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-catalog-content\") pod \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.531102 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mw7d\" (UniqueName: \"kubernetes.io/projected/50d91fab-a2ae-46e1-a67c-a7333eb118f7-kube-api-access-4mw7d\") pod \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\" (UID: \"50d91fab-a2ae-46e1-a67c-a7333eb118f7\") " Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.531798 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-utilities" (OuterVolumeSpecName: "utilities") pod "50d91fab-a2ae-46e1-a67c-a7333eb118f7" (UID: "50d91fab-a2ae-46e1-a67c-a7333eb118f7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.548262 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "50d91fab-a2ae-46e1-a67c-a7333eb118f7" (UID: "50d91fab-a2ae-46e1-a67c-a7333eb118f7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.632865 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.632910 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/50d91fab-a2ae-46e1-a67c-a7333eb118f7-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.653221 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d91fab-a2ae-46e1-a67c-a7333eb118f7-kube-api-access-4mw7d" (OuterVolumeSpecName: "kube-api-access-4mw7d") pod "50d91fab-a2ae-46e1-a67c-a7333eb118f7" (UID: "50d91fab-a2ae-46e1-a67c-a7333eb118f7"). InnerVolumeSpecName "kube-api-access-4mw7d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.663126 4769 scope.go:117] "RemoveContainer" containerID="c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.693114 4769 scope.go:117] "RemoveContainer" containerID="670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72" Nov 21 14:05:56 crc kubenswrapper[4769]: E1121 14:05:56.693669 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72\": container with ID starting with 670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72 not found: ID does not exist" containerID="670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.693695 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72"} err="failed to get container status \"670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72\": rpc error: code = NotFound desc = could not find container \"670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72\": container with ID starting with 670af7c73ab7e0cc78ddbe6913cd9c3d42856dbe981d1032ba0d5ea88f307f72 not found: ID does not exist" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.693714 4769 scope.go:117] "RemoveContainer" containerID="3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a" Nov 21 14:05:56 crc kubenswrapper[4769]: E1121 14:05:56.694135 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a\": container with ID starting with 3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a not found: ID does not exist" containerID="3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.694152 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a"} err="failed to get container status \"3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a\": rpc error: code = NotFound desc = could not find container \"3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a\": container with ID starting with 3849736ae42503f8063708c759553d8bb89686f638752af96f4faabb892ac75a not found: ID does not exist" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.694163 4769 scope.go:117] "RemoveContainer" containerID="c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb" Nov 21 14:05:56 crc kubenswrapper[4769]: E1121 14:05:56.694460 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb\": container with ID starting with c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb not found: ID does not exist" containerID="c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.694479 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb"} err="failed to get container status \"c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb\": rpc error: code = NotFound desc = could not find container \"c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb\": container with ID starting with c2d14b70fd582298f4ae80b011dd81c406478bf6c4847a86c4411e5b04bc4afb not found: ID does not exist" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.734766 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4mw7d\" (UniqueName: \"kubernetes.io/projected/50d91fab-a2ae-46e1-a67c-a7333eb118f7-kube-api-access-4mw7d\") on node \"crc\" DevicePath \"\"" Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.847960 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-zp87l"] Nov 21 14:05:56 crc kubenswrapper[4769]: I1121 14:05:56.853067 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-zp87l"] Nov 21 14:05:57 crc kubenswrapper[4769]: I1121 14:05:57.284674 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" path="/var/lib/kubelet/pods/50d91fab-a2ae-46e1-a67c-a7333eb118f7/volumes" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.944758 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-t5dzc"] Nov 21 14:06:02 crc kubenswrapper[4769]: E1121 14:06:02.945624 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="extract-content" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.945640 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="extract-content" Nov 21 14:06:02 crc kubenswrapper[4769]: E1121 14:06:02.945665 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="extract-utilities" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.945673 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="extract-utilities" Nov 21 14:06:02 crc kubenswrapper[4769]: E1121 14:06:02.945691 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="registry-server" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.945699 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="registry-server" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.945868 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="50d91fab-a2ae-46e1-a67c-a7333eb118f7" containerName="registry-server" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.951565 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:02 crc kubenswrapper[4769]: I1121 14:06:02.971043 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-t5dzc"] Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.049470 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-utilities\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.049732 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-catalog-content\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.049869 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvqz7\" (UniqueName: \"kubernetes.io/projected/b80019e6-0816-45a2-9861-628aabb6892a-kube-api-access-qvqz7\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.152003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qvqz7\" (UniqueName: \"kubernetes.io/projected/b80019e6-0816-45a2-9861-628aabb6892a-kube-api-access-qvqz7\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.152123 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-utilities\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.152145 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-catalog-content\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.152519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-catalog-content\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.152813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-utilities\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.179396 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvqz7\" (UniqueName: \"kubernetes.io/projected/b80019e6-0816-45a2-9861-628aabb6892a-kube-api-access-qvqz7\") pod \"certified-operators-t5dzc\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.270336 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.553754 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-t5dzc"] Nov 21 14:06:03 crc kubenswrapper[4769]: W1121 14:06:03.560287 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80019e6_0816_45a2_9861_628aabb6892a.slice/crio-32a5325e0e150934f09081bca3e8c7f335696c2d922355e8a5b8271543753538 WatchSource:0}: Error finding container 32a5325e0e150934f09081bca3e8c7f335696c2d922355e8a5b8271543753538: Status 404 returned error can't find the container with id 32a5325e0e150934f09081bca3e8c7f335696c2d922355e8a5b8271543753538 Nov 21 14:06:03 crc kubenswrapper[4769]: I1121 14:06:03.577227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerStarted","Data":"32a5325e0e150934f09081bca3e8c7f335696c2d922355e8a5b8271543753538"} Nov 21 14:06:04 crc kubenswrapper[4769]: I1121 14:06:04.585492 4769 generic.go:334] "Generic (PLEG): container finished" podID="b80019e6-0816-45a2-9861-628aabb6892a" containerID="a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751" exitCode=0 Nov 21 14:06:04 crc kubenswrapper[4769]: I1121 14:06:04.585539 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerDied","Data":"a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751"} Nov 21 14:06:05 crc kubenswrapper[4769]: I1121 14:06:05.596478 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerStarted","Data":"3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f"} Nov 21 14:06:06 crc kubenswrapper[4769]: I1121 14:06:06.607165 4769 generic.go:334] "Generic (PLEG): container finished" podID="b80019e6-0816-45a2-9861-628aabb6892a" containerID="3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f" exitCode=0 Nov 21 14:06:06 crc kubenswrapper[4769]: I1121 14:06:06.607234 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerDied","Data":"3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f"} Nov 21 14:06:07 crc kubenswrapper[4769]: I1121 14:06:07.274626 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:06:07 crc kubenswrapper[4769]: E1121 14:06:07.275483 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:06:07 crc kubenswrapper[4769]: I1121 14:06:07.637849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerStarted","Data":"66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db"} Nov 21 14:06:07 crc kubenswrapper[4769]: I1121 14:06:07.708772 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-t5dzc" podStartSLOduration=3.296092923 podStartE2EDuration="5.708749s" podCreationTimestamp="2025-11-21 14:06:02 +0000 UTC" firstStartedPulling="2025-11-21 14:06:04.587402427 +0000 UTC m=+8123.288064245" lastFinishedPulling="2025-11-21 14:06:07.000058474 +0000 UTC m=+8125.700720322" observedRunningTime="2025-11-21 14:06:07.702502124 +0000 UTC m=+8126.403163952" watchObservedRunningTime="2025-11-21 14:06:07.708749 +0000 UTC m=+8126.409410818" Nov 21 14:06:13 crc kubenswrapper[4769]: I1121 14:06:13.271034 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:13 crc kubenswrapper[4769]: I1121 14:06:13.271997 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:13 crc kubenswrapper[4769]: I1121 14:06:13.326585 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:13 crc kubenswrapper[4769]: I1121 14:06:13.760300 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:13 crc kubenswrapper[4769]: I1121 14:06:13.820277 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-t5dzc"] Nov 21 14:06:14 crc kubenswrapper[4769]: I1121 14:06:14.183610 4769 scope.go:117] "RemoveContainer" containerID="5a73d0e8357533ae74f000e4261bb6dd6b81160fad723d4b3327f42e8fdf5b93" Nov 21 14:06:14 crc kubenswrapper[4769]: I1121 14:06:14.208505 4769 scope.go:117] "RemoveContainer" containerID="fe2334b3f23bdcb9c9738cfe7b833a8b1f11a72f79d01115018cd5890a7670a3" Nov 21 14:06:14 crc kubenswrapper[4769]: I1121 14:06:14.260238 4769 scope.go:117] "RemoveContainer" containerID="2f6f7f66972cfb411dc2a7e745466e948ab7835ff3ef604dce007c39b7a2fb34" Nov 21 14:06:14 crc kubenswrapper[4769]: I1121 14:06:14.282831 4769 scope.go:117] "RemoveContainer" containerID="ff9899fc7bb4ea0840df52da2ec96d9acbf3a9065045ecc2b9797a2d1b3b4272" Nov 21 14:06:14 crc kubenswrapper[4769]: I1121 14:06:14.323025 4769 scope.go:117] "RemoveContainer" containerID="a366ab7c58b4c65e1bf658075dce7614aedad99458f5b1a7e87692b630603d1b" Nov 21 14:06:15 crc kubenswrapper[4769]: I1121 14:06:15.713419 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-t5dzc" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="registry-server" containerID="cri-o://66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db" gracePeriod=2 Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.110011 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.177407 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-catalog-content\") pod \"b80019e6-0816-45a2-9861-628aabb6892a\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.177485 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-utilities\") pod \"b80019e6-0816-45a2-9861-628aabb6892a\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.177572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvqz7\" (UniqueName: \"kubernetes.io/projected/b80019e6-0816-45a2-9861-628aabb6892a-kube-api-access-qvqz7\") pod \"b80019e6-0816-45a2-9861-628aabb6892a\" (UID: \"b80019e6-0816-45a2-9861-628aabb6892a\") " Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.178577 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-utilities" (OuterVolumeSpecName: "utilities") pod "b80019e6-0816-45a2-9861-628aabb6892a" (UID: "b80019e6-0816-45a2-9861-628aabb6892a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.185842 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80019e6-0816-45a2-9861-628aabb6892a-kube-api-access-qvqz7" (OuterVolumeSpecName: "kube-api-access-qvqz7") pod "b80019e6-0816-45a2-9861-628aabb6892a" (UID: "b80019e6-0816-45a2-9861-628aabb6892a"). InnerVolumeSpecName "kube-api-access-qvqz7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.235887 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b80019e6-0816-45a2-9861-628aabb6892a" (UID: "b80019e6-0816-45a2-9861-628aabb6892a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.278430 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.278464 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b80019e6-0816-45a2-9861-628aabb6892a-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.278477 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-qvqz7\" (UniqueName: \"kubernetes.io/projected/b80019e6-0816-45a2-9861-628aabb6892a-kube-api-access-qvqz7\") on node \"crc\" DevicePath \"\"" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.726113 4769 generic.go:334] "Generic (PLEG): container finished" podID="b80019e6-0816-45a2-9861-628aabb6892a" containerID="66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db" exitCode=0 Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.726187 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerDied","Data":"66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db"} Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.726468 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-t5dzc" event={"ID":"b80019e6-0816-45a2-9861-628aabb6892a","Type":"ContainerDied","Data":"32a5325e0e150934f09081bca3e8c7f335696c2d922355e8a5b8271543753538"} Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.726487 4769 scope.go:117] "RemoveContainer" containerID="66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.726400 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-t5dzc" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.754979 4769 scope.go:117] "RemoveContainer" containerID="3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.759110 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-t5dzc"] Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.766114 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-t5dzc"] Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.785322 4769 scope.go:117] "RemoveContainer" containerID="a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.817962 4769 scope.go:117] "RemoveContainer" containerID="66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db" Nov 21 14:06:16 crc kubenswrapper[4769]: E1121 14:06:16.818491 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db\": container with ID starting with 66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db not found: ID does not exist" containerID="66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.818532 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db"} err="failed to get container status \"66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db\": rpc error: code = NotFound desc = could not find container \"66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db\": container with ID starting with 66214cd9f809b5ddec0b11aab1c95832fc494da850f05470bf98a038b5a177db not found: ID does not exist" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.818562 4769 scope.go:117] "RemoveContainer" containerID="3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f" Nov 21 14:06:16 crc kubenswrapper[4769]: E1121 14:06:16.818897 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f\": container with ID starting with 3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f not found: ID does not exist" containerID="3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.818926 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f"} err="failed to get container status \"3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f\": rpc error: code = NotFound desc = could not find container \"3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f\": container with ID starting with 3f231dda14abdf42b3dda37ed065e0eadd3051c071bc286d0ce5cb4c3f9ea92f not found: ID does not exist" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.818948 4769 scope.go:117] "RemoveContainer" containerID="a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751" Nov 21 14:06:16 crc kubenswrapper[4769]: E1121 14:06:16.819257 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751\": container with ID starting with a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751 not found: ID does not exist" containerID="a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751" Nov 21 14:06:16 crc kubenswrapper[4769]: I1121 14:06:16.819301 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751"} err="failed to get container status \"a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751\": rpc error: code = NotFound desc = could not find container \"a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751\": container with ID starting with a8cef7b4a9c0c78e7cead4c0e7b60d3747c645e6844b3e4313f34951c98f7751 not found: ID does not exist" Nov 21 14:06:17 crc kubenswrapper[4769]: I1121 14:06:17.286558 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80019e6-0816-45a2-9861-628aabb6892a" path="/var/lib/kubelet/pods/b80019e6-0816-45a2-9861-628aabb6892a/volumes" Nov 21 14:06:19 crc kubenswrapper[4769]: I1121 14:06:19.274093 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:06:19 crc kubenswrapper[4769]: E1121 14:06:19.274365 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:06:34 crc kubenswrapper[4769]: I1121 14:06:34.275092 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:06:34 crc kubenswrapper[4769]: E1121 14:06:34.276099 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:06:49 crc kubenswrapper[4769]: I1121 14:06:49.274536 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:06:49 crc kubenswrapper[4769]: E1121 14:06:49.275362 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:07:01 crc kubenswrapper[4769]: I1121 14:07:01.274775 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:07:01 crc kubenswrapper[4769]: E1121 14:07:01.275919 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:07:14 crc kubenswrapper[4769]: I1121 14:07:14.423165 4769 scope.go:117] "RemoveContainer" containerID="8e80128b4ac7cb5c603a5e1a22ea90e59cdd78f37fe47998d3d0c445c12d7b82" Nov 21 14:07:14 crc kubenswrapper[4769]: I1121 14:07:14.454009 4769 scope.go:117] "RemoveContainer" containerID="9ff291327fb435771cacf6022ba9fc7bfb9d618fc7aebc2e0a80ba2a5a22adae" Nov 21 14:07:14 crc kubenswrapper[4769]: I1121 14:07:14.487288 4769 scope.go:117] "RemoveContainer" containerID="f076105a9d93a689e2117e0d4e99101a5d71037386b67e3cffa055f1767d0db7" Nov 21 14:07:14 crc kubenswrapper[4769]: I1121 14:07:14.512794 4769 scope.go:117] "RemoveContainer" containerID="f9cbb8ca34c3dbdefdbca4a257f8b1b36ccedc159ed8a2623c5beab1fc5c640f" Nov 21 14:07:14 crc kubenswrapper[4769]: I1121 14:07:14.561753 4769 scope.go:117] "RemoveContainer" containerID="d0fb537efc1cc9fcb3f1b037b2eba283ed274a97e8d0cd3bc4650affbe99eec2" Nov 21 14:07:16 crc kubenswrapper[4769]: I1121 14:07:16.274670 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:07:16 crc kubenswrapper[4769]: E1121 14:07:16.275456 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:07:28 crc kubenswrapper[4769]: I1121 14:07:28.274996 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:07:28 crc kubenswrapper[4769]: E1121 14:07:28.276263 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:07:43 crc kubenswrapper[4769]: I1121 14:07:43.309480 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:07:43 crc kubenswrapper[4769]: E1121 14:07:43.310502 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:07:57 crc kubenswrapper[4769]: I1121 14:07:57.275036 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:07:57 crc kubenswrapper[4769]: E1121 14:07:57.276375 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:08:10 crc kubenswrapper[4769]: I1121 14:08:10.274874 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:08:10 crc kubenswrapper[4769]: E1121 14:08:10.276118 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.741793 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-x9dbn"] Nov 21 14:08:11 crc kubenswrapper[4769]: E1121 14:08:11.742252 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="registry-server" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.742272 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="registry-server" Nov 21 14:08:11 crc kubenswrapper[4769]: E1121 14:08:11.742312 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="extract-content" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.742326 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="extract-content" Nov 21 14:08:11 crc kubenswrapper[4769]: E1121 14:08:11.742359 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="extract-utilities" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.742397 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="extract-utilities" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.742691 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b80019e6-0816-45a2-9861-628aabb6892a" containerName="registry-server" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.744502 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.756336 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-x9dbn"] Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.817778 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fd80709e-cee3-411e-8be9-8237aac40b69-catalog-content\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.818112 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fd80709e-cee3-411e-8be9-8237aac40b69-utilities\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.818372 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqsb\" (UniqueName: \"kubernetes.io/projected/fd80709e-cee3-411e-8be9-8237aac40b69-kube-api-access-clqsb\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.918979 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fd80709e-cee3-411e-8be9-8237aac40b69-utilities\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.919430 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/fd80709e-cee3-411e-8be9-8237aac40b69-utilities\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.919570 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-clqsb\" (UniqueName: \"kubernetes.io/projected/fd80709e-cee3-411e-8be9-8237aac40b69-kube-api-access-clqsb\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.919629 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fd80709e-cee3-411e-8be9-8237aac40b69-catalog-content\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.919900 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/fd80709e-cee3-411e-8be9-8237aac40b69-catalog-content\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:11 crc kubenswrapper[4769]: I1121 14:08:11.948047 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqsb\" (UniqueName: \"kubernetes.io/projected/fd80709e-cee3-411e-8be9-8237aac40b69-kube-api-access-clqsb\") pod \"community-operators-x9dbn\" (UID: \"fd80709e-cee3-411e-8be9-8237aac40b69\") " pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:12 crc kubenswrapper[4769]: I1121 14:08:12.079825 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:12 crc kubenswrapper[4769]: I1121 14:08:12.446102 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-x9dbn"] Nov 21 14:08:12 crc kubenswrapper[4769]: I1121 14:08:12.837276 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd80709e-cee3-411e-8be9-8237aac40b69" containerID="e11827afa8c2d1a2ffdc04247fdd4d8e31fe286ebf0d9c9eb2fe6130a4687069" exitCode=0 Nov 21 14:08:12 crc kubenswrapper[4769]: I1121 14:08:12.837371 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-x9dbn" event={"ID":"fd80709e-cee3-411e-8be9-8237aac40b69","Type":"ContainerDied","Data":"e11827afa8c2d1a2ffdc04247fdd4d8e31fe286ebf0d9c9eb2fe6130a4687069"} Nov 21 14:08:12 crc kubenswrapper[4769]: I1121 14:08:12.837464 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-x9dbn" event={"ID":"fd80709e-cee3-411e-8be9-8237aac40b69","Type":"ContainerStarted","Data":"f011bdf77a576a19e3e070cc292843bacf1c972df8b5af79e4e05f231bd1f0d2"} Nov 21 14:08:12 crc kubenswrapper[4769]: I1121 14:08:12.840147 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 14:08:14 crc kubenswrapper[4769]: I1121 14:08:14.663036 4769 scope.go:117] "RemoveContainer" containerID="501baa70588173e2e1d0997e2f673dfa3e4ff3c89a5e7f31308624e2ff1d735e" Nov 21 14:08:16 crc kubenswrapper[4769]: I1121 14:08:16.886849 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-x9dbn" event={"ID":"fd80709e-cee3-411e-8be9-8237aac40b69","Type":"ContainerStarted","Data":"a625a0ab5b84d428f5e368bdd26ba59b7c8c5d809a988dc2c888d910472297ff"} Nov 21 14:08:17 crc kubenswrapper[4769]: I1121 14:08:17.902259 4769 generic.go:334] "Generic (PLEG): container finished" podID="fd80709e-cee3-411e-8be9-8237aac40b69" containerID="a625a0ab5b84d428f5e368bdd26ba59b7c8c5d809a988dc2c888d910472297ff" exitCode=0 Nov 21 14:08:17 crc kubenswrapper[4769]: I1121 14:08:17.902526 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-x9dbn" event={"ID":"fd80709e-cee3-411e-8be9-8237aac40b69","Type":"ContainerDied","Data":"a625a0ab5b84d428f5e368bdd26ba59b7c8c5d809a988dc2c888d910472297ff"} Nov 21 14:08:18 crc kubenswrapper[4769]: I1121 14:08:18.913019 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-x9dbn" event={"ID":"fd80709e-cee3-411e-8be9-8237aac40b69","Type":"ContainerStarted","Data":"d7b32d11b1464643ea821d3488f3af5e2b0aff6509270db132a7e87528d9024b"} Nov 21 14:08:21 crc kubenswrapper[4769]: I1121 14:08:21.274440 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:08:21 crc kubenswrapper[4769]: I1121 14:08:21.945723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"8a3c12edaef58dbb0baec2cd2e286860462f129cfe3eba87192f0930a8f703a2"} Nov 21 14:08:21 crc kubenswrapper[4769]: I1121 14:08:21.968683 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-x9dbn" podStartSLOduration=5.318994868 podStartE2EDuration="10.968664027s" podCreationTimestamp="2025-11-21 14:08:11 +0000 UTC" firstStartedPulling="2025-11-21 14:08:12.839791154 +0000 UTC m=+8251.540452982" lastFinishedPulling="2025-11-21 14:08:18.489460293 +0000 UTC m=+8257.190122141" observedRunningTime="2025-11-21 14:08:18.936302095 +0000 UTC m=+8257.636963913" watchObservedRunningTime="2025-11-21 14:08:21.968664027 +0000 UTC m=+8260.669325845" Nov 21 14:08:22 crc kubenswrapper[4769]: I1121 14:08:22.080679 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:22 crc kubenswrapper[4769]: I1121 14:08:22.080732 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:22 crc kubenswrapper[4769]: I1121 14:08:22.136333 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.143874 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-x9dbn" Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.233915 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-x9dbn"] Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.284126 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-jljwh"] Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.284458 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-jljwh" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="registry-server" containerID="cri-o://5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b" gracePeriod=2 Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.713061 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jljwh" Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.897014 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjhrg\" (UniqueName: \"kubernetes.io/projected/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-kube-api-access-xjhrg\") pod \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.897163 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-catalog-content\") pod \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.897295 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-utilities\") pod \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\" (UID: \"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf\") " Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.898588 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-utilities" (OuterVolumeSpecName: "utilities") pod "a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" (UID: "a90a4f95-d023-4f03-b7d6-e58fc5d67bcf"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.911448 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-kube-api-access-xjhrg" (OuterVolumeSpecName: "kube-api-access-xjhrg") pod "a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" (UID: "a90a4f95-d023-4f03-b7d6-e58fc5d67bcf"). InnerVolumeSpecName "kube-api-access-xjhrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.999302 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:08:32 crc kubenswrapper[4769]: I1121 14:08:32.999337 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xjhrg\" (UniqueName: \"kubernetes.io/projected/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-kube-api-access-xjhrg\") on node \"crc\" DevicePath \"\"" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.066769 4769 generic.go:334] "Generic (PLEG): container finished" podID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerID="5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b" exitCode=0 Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.067335 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jljwh" event={"ID":"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf","Type":"ContainerDied","Data":"5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b"} Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.067398 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-jljwh" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.067525 4769 scope.go:117] "RemoveContainer" containerID="5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.067499 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-jljwh" event={"ID":"a90a4f95-d023-4f03-b7d6-e58fc5d67bcf","Type":"ContainerDied","Data":"db56f6f7b0e36d7eb6f2bd523d81679bb8904b72faf680048a32a283d93b08b4"} Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.103513 4769 scope.go:117] "RemoveContainer" containerID="cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.203085 4769 scope.go:117] "RemoveContainer" containerID="3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.238230 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" (UID: "a90a4f95-d023-4f03-b7d6-e58fc5d67bcf"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.285234 4769 scope.go:117] "RemoveContainer" containerID="5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b" Nov 21 14:08:33 crc kubenswrapper[4769]: E1121 14:08:33.286201 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b\": container with ID starting with 5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b not found: ID does not exist" containerID="5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.286248 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b"} err="failed to get container status \"5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b\": rpc error: code = NotFound desc = could not find container \"5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b\": container with ID starting with 5aa30d945c49110f2afa6e4260aa0f53e9f8c02d05bae1d1b1fa54f10af2480b not found: ID does not exist" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.286274 4769 scope.go:117] "RemoveContainer" containerID="cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b" Nov 21 14:08:33 crc kubenswrapper[4769]: E1121 14:08:33.286777 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b\": container with ID starting with cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b not found: ID does not exist" containerID="cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.286811 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b"} err="failed to get container status \"cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b\": rpc error: code = NotFound desc = could not find container \"cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b\": container with ID starting with cd618a18e3a46ba41619d4d581100f1382ae6846185e36ac1140a3a4178f9b0b not found: ID does not exist" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.286835 4769 scope.go:117] "RemoveContainer" containerID="3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f" Nov 21 14:08:33 crc kubenswrapper[4769]: E1121 14:08:33.287100 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f\": container with ID starting with 3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f not found: ID does not exist" containerID="3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.287124 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f"} err="failed to get container status \"3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f\": rpc error: code = NotFound desc = could not find container \"3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f\": container with ID starting with 3f808471cf7c471621e1b94398293eaa85781d30e0f73d9b34e77383d5e1f19f not found: ID does not exist" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.308357 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.386875 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-jljwh"] Nov 21 14:08:33 crc kubenswrapper[4769]: I1121 14:08:33.394095 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-jljwh"] Nov 21 14:08:35 crc kubenswrapper[4769]: I1121 14:08:35.289751 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" path="/var/lib/kubelet/pods/a90a4f95-d023-4f03-b7d6-e58fc5d67bcf/volumes" Nov 21 14:10:41 crc kubenswrapper[4769]: I1121 14:10:41.326146 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:10:41 crc kubenswrapper[4769]: I1121 14:10:41.327274 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:11:11 crc kubenswrapper[4769]: I1121 14:11:11.325331 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:11:11 crc kubenswrapper[4769]: I1121 14:11:11.325954 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:11:41 crc kubenswrapper[4769]: I1121 14:11:41.325310 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:11:41 crc kubenswrapper[4769]: I1121 14:11:41.326175 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:11:41 crc kubenswrapper[4769]: I1121 14:11:41.326429 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 14:11:41 crc kubenswrapper[4769]: I1121 14:11:41.327658 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"8a3c12edaef58dbb0baec2cd2e286860462f129cfe3eba87192f0930a8f703a2"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 14:11:41 crc kubenswrapper[4769]: I1121 14:11:41.327798 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://8a3c12edaef58dbb0baec2cd2e286860462f129cfe3eba87192f0930a8f703a2" gracePeriod=600 Nov 21 14:11:42 crc kubenswrapper[4769]: I1121 14:11:42.026054 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="8a3c12edaef58dbb0baec2cd2e286860462f129cfe3eba87192f0930a8f703a2" exitCode=0 Nov 21 14:11:42 crc kubenswrapper[4769]: I1121 14:11:42.026157 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"8a3c12edaef58dbb0baec2cd2e286860462f129cfe3eba87192f0930a8f703a2"} Nov 21 14:11:42 crc kubenswrapper[4769]: I1121 14:11:42.026533 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20"} Nov 21 14:11:42 crc kubenswrapper[4769]: I1121 14:11:42.026557 4769 scope.go:117] "RemoveContainer" containerID="e975dadc26063057ee9cd749c2feb92d159f60d21e733aa8fd41c7fa90adf6f3" Nov 21 14:12:04 crc kubenswrapper[4769]: I1121 14:12:04.075461 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl"] Nov 21 14:12:04 crc kubenswrapper[4769]: I1121 14:12:04.083991 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-wc2ht"] Nov 21 14:12:04 crc kubenswrapper[4769]: I1121 14:12:04.091752 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-create-wc2ht"] Nov 21 14:12:04 crc kubenswrapper[4769]: I1121 14:12:04.098467 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-399f-account-create-update-gbjfl"] Nov 21 14:12:05 crc kubenswrapper[4769]: I1121 14:12:05.283966 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac" path="/var/lib/kubelet/pods/8f96c7c1-3f17-4901-95f2-65dbb1f9e0ac/volumes" Nov 21 14:12:05 crc kubenswrapper[4769]: I1121 14:12:05.285359 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac4bdc52-4627-494b-b0a1-a2b17a925f00" path="/var/lib/kubelet/pods/ac4bdc52-4627-494b-b0a1-a2b17a925f00/volumes" Nov 21 14:12:11 crc kubenswrapper[4769]: I1121 14:12:11.051155 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-2qhn2"] Nov 21 14:12:11 crc kubenswrapper[4769]: I1121 14:12:11.058653 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-db-sync-2qhn2"] Nov 21 14:12:11 crc kubenswrapper[4769]: I1121 14:12:11.282814 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f0ed74-6764-44cf-b5ed-e956bc74221c" path="/var/lib/kubelet/pods/42f0ed74-6764-44cf-b5ed-e956bc74221c/volumes" Nov 21 14:12:14 crc kubenswrapper[4769]: I1121 14:12:14.816023 4769 scope.go:117] "RemoveContainer" containerID="0542aff6248328263e364bfa62dcef23cbe29280cf5c9dea0ffd3b37976be6b2" Nov 21 14:12:14 crc kubenswrapper[4769]: I1121 14:12:14.858522 4769 scope.go:117] "RemoveContainer" containerID="e5bd5e3c9d9fe8992174e3d81e3289026f35359e790dbf827a14b78c378e9155" Nov 21 14:12:14 crc kubenswrapper[4769]: I1121 14:12:14.906109 4769 scope.go:117] "RemoveContainer" containerID="f541af002a34d9c8ca2c2d7bda568ff024dc68d989af035fca457b5ee040a668" Nov 21 14:12:17 crc kubenswrapper[4769]: I1121 14:12:17.033598 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-lvmb6"] Nov 21 14:12:17 crc kubenswrapper[4769]: I1121 14:12:17.042700 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-bootstrap-lvmb6"] Nov 21 14:12:17 crc kubenswrapper[4769]: I1121 14:12:17.290097 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d426e72-02f5-4009-a4ec-fc596845bafc" path="/var/lib/kubelet/pods/7d426e72-02f5-4009-a4ec-fc596845bafc/volumes" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.783358 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-66skw"] Nov 21 14:12:51 crc kubenswrapper[4769]: E1121 14:12:51.784126 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="extract-content" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.784142 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="extract-content" Nov 21 14:12:51 crc kubenswrapper[4769]: E1121 14:12:51.784532 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="extract-utilities" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.784548 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="extract-utilities" Nov 21 14:12:51 crc kubenswrapper[4769]: E1121 14:12:51.784567 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="registry-server" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.784575 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="registry-server" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.784740 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a90a4f95-d023-4f03-b7d6-e58fc5d67bcf" containerName="registry-server" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.786768 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.798641 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-66skw"] Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.888750 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-catalog-content\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.888850 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-utilities\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.889171 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n95d\" (UniqueName: \"kubernetes.io/projected/0db533af-bc36-4291-b534-fb527a971069-kube-api-access-8n95d\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.991160 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-catalog-content\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.991342 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-utilities\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.991547 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8n95d\" (UniqueName: \"kubernetes.io/projected/0db533af-bc36-4291-b534-fb527a971069-kube-api-access-8n95d\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.991769 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-catalog-content\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:51 crc kubenswrapper[4769]: I1121 14:12:51.991833 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-utilities\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:52 crc kubenswrapper[4769]: I1121 14:12:52.024227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n95d\" (UniqueName: \"kubernetes.io/projected/0db533af-bc36-4291-b534-fb527a971069-kube-api-access-8n95d\") pod \"redhat-operators-66skw\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:52 crc kubenswrapper[4769]: I1121 14:12:52.106055 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:12:52 crc kubenswrapper[4769]: I1121 14:12:52.411951 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-66skw"] Nov 21 14:12:52 crc kubenswrapper[4769]: I1121 14:12:52.726458 4769 generic.go:334] "Generic (PLEG): container finished" podID="0db533af-bc36-4291-b534-fb527a971069" containerID="96f1173bea6cbbfc9f80c31dc87b68e3e8f1e126b189f63dc1fd35edaf50499f" exitCode=0 Nov 21 14:12:52 crc kubenswrapper[4769]: I1121 14:12:52.726572 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerDied","Data":"96f1173bea6cbbfc9f80c31dc87b68e3e8f1e126b189f63dc1fd35edaf50499f"} Nov 21 14:12:52 crc kubenswrapper[4769]: I1121 14:12:52.726905 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerStarted","Data":"1c72b48513dc555d530a99f500e5e467c41a6187498e2e70bc598ad9f4eb7856"} Nov 21 14:12:53 crc kubenswrapper[4769]: I1121 14:12:53.735735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerStarted","Data":"13c5b587c5bd4aeea8ecd251b1d78fc7f36532a17aa4a5e8406905383da65f73"} Nov 21 14:12:54 crc kubenswrapper[4769]: I1121 14:12:54.748844 4769 generic.go:334] "Generic (PLEG): container finished" podID="0db533af-bc36-4291-b534-fb527a971069" containerID="13c5b587c5bd4aeea8ecd251b1d78fc7f36532a17aa4a5e8406905383da65f73" exitCode=0 Nov 21 14:12:54 crc kubenswrapper[4769]: I1121 14:12:54.748983 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerDied","Data":"13c5b587c5bd4aeea8ecd251b1d78fc7f36532a17aa4a5e8406905383da65f73"} Nov 21 14:12:55 crc kubenswrapper[4769]: I1121 14:12:55.800449 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerStarted","Data":"9d396772263ada29e3450bc485fb0282357cfb805db46762c13a9b520baf1c53"} Nov 21 14:12:55 crc kubenswrapper[4769]: I1121 14:12:55.828433 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-66skw" podStartSLOduration=2.395730898 podStartE2EDuration="4.828405303s" podCreationTimestamp="2025-11-21 14:12:51 +0000 UTC" firstStartedPulling="2025-11-21 14:12:52.72832649 +0000 UTC m=+8531.428988298" lastFinishedPulling="2025-11-21 14:12:55.161000845 +0000 UTC m=+8533.861662703" observedRunningTime="2025-11-21 14:12:55.823601164 +0000 UTC m=+8534.524263002" watchObservedRunningTime="2025-11-21 14:12:55.828405303 +0000 UTC m=+8534.529067131" Nov 21 14:13:02 crc kubenswrapper[4769]: I1121 14:13:02.107267 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:13:02 crc kubenswrapper[4769]: I1121 14:13:02.107826 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:13:03 crc kubenswrapper[4769]: I1121 14:13:03.180609 4769 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-marketplace/redhat-operators-66skw" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="registry-server" probeResult="failure" output=< Nov 21 14:13:03 crc kubenswrapper[4769]: timeout: failed to connect service ":50051" within 1s Nov 21 14:13:03 crc kubenswrapper[4769]: > Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.012289 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.013052 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/openstackclient" podUID="8f57d616-f936-4bc3-97c0-b71c4a1e8eda" containerName="openstackclient" containerID="cri-o://8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388" gracePeriod=30 Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.456087 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.601763 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68c77\" (UniqueName: \"kubernetes.io/projected/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-kube-api-access-68c77\") pod \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.602249 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config-secret\") pod \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.603006 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config\") pod \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\" (UID: \"8f57d616-f936-4bc3-97c0-b71c4a1e8eda\") " Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.608757 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-kube-api-access-68c77" (OuterVolumeSpecName: "kube-api-access-68c77") pod "8f57d616-f936-4bc3-97c0-b71c4a1e8eda" (UID: "8f57d616-f936-4bc3-97c0-b71c4a1e8eda"). InnerVolumeSpecName "kube-api-access-68c77". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.628822 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "8f57d616-f936-4bc3-97c0-b71c4a1e8eda" (UID: "8f57d616-f936-4bc3-97c0-b71c4a1e8eda"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.637559 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "8f57d616-f936-4bc3-97c0-b71c4a1e8eda" (UID: "8f57d616-f936-4bc3-97c0-b71c4a1e8eda"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.704434 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.704683 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-68c77\" (UniqueName: \"kubernetes.io/projected/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-kube-api-access-68c77\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.704760 4769 reconciler_common.go:293] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/8f57d616-f936-4bc3-97c0-b71c4a1e8eda-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.901548 4769 generic.go:334] "Generic (PLEG): container finished" podID="8f57d616-f936-4bc3-97c0-b71c4a1e8eda" containerID="8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388" exitCode=143 Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.901732 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstackclient" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.901723 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"8f57d616-f936-4bc3-97c0-b71c4a1e8eda","Type":"ContainerDied","Data":"8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388"} Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.902170 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstackclient" event={"ID":"8f57d616-f936-4bc3-97c0-b71c4a1e8eda","Type":"ContainerDied","Data":"26704c9ca0e700a916291341249d9bca89551353d8c9dda45b01c14ecfb9760e"} Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.902241 4769 scope.go:117] "RemoveContainer" containerID="8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.938599 4769 scope.go:117] "RemoveContainer" containerID="8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388" Nov 21 14:13:06 crc kubenswrapper[4769]: E1121 14:13:06.939647 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388\": container with ID starting with 8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388 not found: ID does not exist" containerID="8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.939698 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388"} err="failed to get container status \"8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388\": rpc error: code = NotFound desc = could not find container \"8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388\": container with ID starting with 8931dac6e7d247aea7271ed78c9f46a8a79aa7ee15411e2c02803ed0ee9ac388 not found: ID does not exist" Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.956900 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Nov 21 14:13:06 crc kubenswrapper[4769]: I1121 14:13:06.966808 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstackclient"] Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.208952 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-678f7bd944-drs24"] Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.209250 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" podUID="ac408e3a-fd62-40f9-831b-03a452f1643b" containerName="keystone-api" containerID="cri-o://b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7" gracePeriod=30 Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.228092 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["keystone-kuttl-tests/keystone399f-account-delete-bmw8w"] Nov 21 14:13:07 crc kubenswrapper[4769]: E1121 14:13:07.228489 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8f57d616-f936-4bc3-97c0-b71c4a1e8eda" containerName="openstackclient" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.228510 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f57d616-f936-4bc3-97c0-b71c4a1e8eda" containerName="openstackclient" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.228692 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8f57d616-f936-4bc3-97c0-b71c4a1e8eda" containerName="openstackclient" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.229364 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.238857 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone399f-account-delete-bmw8w"] Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.291692 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f57d616-f936-4bc3-97c0-b71c4a1e8eda" path="/var/lib/kubelet/pods/8f57d616-f936-4bc3-97c0-b71c4a1e8eda/volumes" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.316314 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/212cd945-e227-48e4-8603-d94516cc64bb-operator-scripts\") pod \"keystone399f-account-delete-bmw8w\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.316603 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhgc\" (UniqueName: \"kubernetes.io/projected/212cd945-e227-48e4-8603-d94516cc64bb-kube-api-access-srhgc\") pod \"keystone399f-account-delete-bmw8w\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.417797 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/212cd945-e227-48e4-8603-d94516cc64bb-operator-scripts\") pod \"keystone399f-account-delete-bmw8w\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.417873 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srhgc\" (UniqueName: \"kubernetes.io/projected/212cd945-e227-48e4-8603-d94516cc64bb-kube-api-access-srhgc\") pod \"keystone399f-account-delete-bmw8w\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.420214 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/212cd945-e227-48e4-8603-d94516cc64bb-operator-scripts\") pod \"keystone399f-account-delete-bmw8w\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.438708 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhgc\" (UniqueName: \"kubernetes.io/projected/212cd945-e227-48e4-8603-d94516cc64bb-kube-api-access-srhgc\") pod \"keystone399f-account-delete-bmw8w\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:07 crc kubenswrapper[4769]: I1121 14:13:07.545082 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:08 crc kubenswrapper[4769]: I1121 14:13:08.044758 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/keystone399f-account-delete-bmw8w"] Nov 21 14:13:08 crc kubenswrapper[4769]: I1121 14:13:08.925314 4769 generic.go:334] "Generic (PLEG): container finished" podID="212cd945-e227-48e4-8603-d94516cc64bb" containerID="380e69c7e4ca3f9c4058c041ab228b404237f3802eff3ca7aea29a8ea246f3bb" exitCode=0 Nov 21 14:13:08 crc kubenswrapper[4769]: I1121 14:13:08.925483 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" event={"ID":"212cd945-e227-48e4-8603-d94516cc64bb","Type":"ContainerDied","Data":"380e69c7e4ca3f9c4058c041ab228b404237f3802eff3ca7aea29a8ea246f3bb"} Nov 21 14:13:08 crc kubenswrapper[4769]: I1121 14:13:08.925940 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" event={"ID":"212cd945-e227-48e4-8603-d94516cc64bb","Type":"ContainerStarted","Data":"b05056c6da7832ec8ce148594c0b48f31ed0be87c6c490c6227d4001369dfdab"} Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.302375 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.383567 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srhgc\" (UniqueName: \"kubernetes.io/projected/212cd945-e227-48e4-8603-d94516cc64bb-kube-api-access-srhgc\") pod \"212cd945-e227-48e4-8603-d94516cc64bb\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.383799 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/212cd945-e227-48e4-8603-d94516cc64bb-operator-scripts\") pod \"212cd945-e227-48e4-8603-d94516cc64bb\" (UID: \"212cd945-e227-48e4-8603-d94516cc64bb\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.384665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/212cd945-e227-48e4-8603-d94516cc64bb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "212cd945-e227-48e4-8603-d94516cc64bb" (UID: "212cd945-e227-48e4-8603-d94516cc64bb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.395028 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212cd945-e227-48e4-8603-d94516cc64bb-kube-api-access-srhgc" (OuterVolumeSpecName: "kube-api-access-srhgc") pod "212cd945-e227-48e4-8603-d94516cc64bb" (UID: "212cd945-e227-48e4-8603-d94516cc64bb"). InnerVolumeSpecName "kube-api-access-srhgc". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.485429 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/212cd945-e227-48e4-8603-d94516cc64bb-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.485481 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srhgc\" (UniqueName: \"kubernetes.io/projected/212cd945-e227-48e4-8603-d94516cc64bb-kube-api-access-srhgc\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.724838 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.791572 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-scripts\") pod \"ac408e3a-fd62-40f9-831b-03a452f1643b\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.791628 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mszf\" (UniqueName: \"kubernetes.io/projected/ac408e3a-fd62-40f9-831b-03a452f1643b-kube-api-access-6mszf\") pod \"ac408e3a-fd62-40f9-831b-03a452f1643b\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.791732 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-fernet-keys\") pod \"ac408e3a-fd62-40f9-831b-03a452f1643b\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.791753 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-credential-keys\") pod \"ac408e3a-fd62-40f9-831b-03a452f1643b\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.791872 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-config-data\") pod \"ac408e3a-fd62-40f9-831b-03a452f1643b\" (UID: \"ac408e3a-fd62-40f9-831b-03a452f1643b\") " Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.795981 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "ac408e3a-fd62-40f9-831b-03a452f1643b" (UID: "ac408e3a-fd62-40f9-831b-03a452f1643b"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.796670 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "ac408e3a-fd62-40f9-831b-03a452f1643b" (UID: "ac408e3a-fd62-40f9-831b-03a452f1643b"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.796744 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac408e3a-fd62-40f9-831b-03a452f1643b-kube-api-access-6mszf" (OuterVolumeSpecName: "kube-api-access-6mszf") pod "ac408e3a-fd62-40f9-831b-03a452f1643b" (UID: "ac408e3a-fd62-40f9-831b-03a452f1643b"). InnerVolumeSpecName "kube-api-access-6mszf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.797283 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-scripts" (OuterVolumeSpecName: "scripts") pod "ac408e3a-fd62-40f9-831b-03a452f1643b" (UID: "ac408e3a-fd62-40f9-831b-03a452f1643b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.809986 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-config-data" (OuterVolumeSpecName: "config-data") pod "ac408e3a-fd62-40f9-831b-03a452f1643b" (UID: "ac408e3a-fd62-40f9-831b-03a452f1643b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.894063 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.894104 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.894113 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.894126 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-6mszf\" (UniqueName: \"kubernetes.io/projected/ac408e3a-fd62-40f9-831b-03a452f1643b-kube-api-access-6mszf\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.894144 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac408e3a-fd62-40f9-831b-03a452f1643b-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.945621 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac408e3a-fd62-40f9-831b-03a452f1643b" containerID="b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7" exitCode=0 Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.945704 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" event={"ID":"ac408e3a-fd62-40f9-831b-03a452f1643b","Type":"ContainerDied","Data":"b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7"} Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.945734 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" event={"ID":"ac408e3a-fd62-40f9-831b-03a452f1643b","Type":"ContainerDied","Data":"fc942cc89019922b2dee34bf12c93e38acca31e8febe0a64f75afd26b42dcdf5"} Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.945740 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone-678f7bd944-drs24" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.945753 4769 scope.go:117] "RemoveContainer" containerID="b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.946980 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" event={"ID":"212cd945-e227-48e4-8603-d94516cc64bb","Type":"ContainerDied","Data":"b05056c6da7832ec8ce148594c0b48f31ed0be87c6c490c6227d4001369dfdab"} Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.947005 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b05056c6da7832ec8ce148594c0b48f31ed0be87c6c490c6227d4001369dfdab" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.947312 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/keystone399f-account-delete-bmw8w" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.973077 4769 scope.go:117] "RemoveContainer" containerID="b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7" Nov 21 14:13:10 crc kubenswrapper[4769]: E1121 14:13:10.973950 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7\": container with ID starting with b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7 not found: ID does not exist" containerID="b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.974001 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7"} err="failed to get container status \"b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7\": rpc error: code = NotFound desc = could not find container \"b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7\": container with ID starting with b12a7a611fe5f5702496ef6648480a6769057bc9b632762cfa513b240d4695a7 not found: ID does not exist" Nov 21 14:13:10 crc kubenswrapper[4769]: I1121 14:13:10.993163 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone-678f7bd944-drs24"] Nov 21 14:13:11 crc kubenswrapper[4769]: I1121 14:13:11.001846 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone-678f7bd944-drs24"] Nov 21 14:13:11 crc kubenswrapper[4769]: I1121 14:13:11.300831 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac408e3a-fd62-40f9-831b-03a452f1643b" path="/var/lib/kubelet/pods/ac408e3a-fd62-40f9-831b-03a452f1643b/volumes" Nov 21 14:13:12 crc kubenswrapper[4769]: I1121 14:13:12.158878 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:13:12 crc kubenswrapper[4769]: I1121 14:13:12.218385 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:13:12 crc kubenswrapper[4769]: I1121 14:13:12.280074 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/keystone399f-account-delete-bmw8w"] Nov 21 14:13:12 crc kubenswrapper[4769]: I1121 14:13:12.296867 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/keystone399f-account-delete-bmw8w"] Nov 21 14:13:13 crc kubenswrapper[4769]: I1121 14:13:13.290433 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="212cd945-e227-48e4-8603-d94516cc64bb" path="/var/lib/kubelet/pods/212cd945-e227-48e4-8603-d94516cc64bb/volumes" Nov 21 14:13:13 crc kubenswrapper[4769]: E1121 14:13:13.335162 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:35394->38.102.83.227:40411: write tcp 38.102.83.227:35394->38.102.83.227:40411: write: broken pipe Nov 21 14:13:15 crc kubenswrapper[4769]: I1121 14:13:15.028171 4769 scope.go:117] "RemoveContainer" containerID="14278cec779328aca68bbb98e9b6ea75b924df1246fa89ec949831beb1a8ce44" Nov 21 14:13:15 crc kubenswrapper[4769]: I1121 14:13:15.779114 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-66skw"] Nov 21 14:13:15 crc kubenswrapper[4769]: I1121 14:13:15.780905 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-66skw" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="registry-server" containerID="cri-o://9d396772263ada29e3450bc485fb0282357cfb805db46762c13a9b520baf1c53" gracePeriod=2 Nov 21 14:13:15 crc kubenswrapper[4769]: E1121 14:13:15.803489 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:35484->38.102.83.227:40411: write tcp 38.102.83.227:35484->38.102.83.227:40411: write: broken pipe Nov 21 14:13:15 crc kubenswrapper[4769]: I1121 14:13:15.990276 4769 generic.go:334] "Generic (PLEG): container finished" podID="0db533af-bc36-4291-b534-fb527a971069" containerID="9d396772263ada29e3450bc485fb0282357cfb805db46762c13a9b520baf1c53" exitCode=0 Nov 21 14:13:15 crc kubenswrapper[4769]: I1121 14:13:15.990337 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerDied","Data":"9d396772263ada29e3450bc485fb0282357cfb805db46762c13a9b520baf1c53"} Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.221777 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.318535 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n95d\" (UniqueName: \"kubernetes.io/projected/0db533af-bc36-4291-b534-fb527a971069-kube-api-access-8n95d\") pod \"0db533af-bc36-4291-b534-fb527a971069\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.318603 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-utilities\") pod \"0db533af-bc36-4291-b534-fb527a971069\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.318693 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-catalog-content\") pod \"0db533af-bc36-4291-b534-fb527a971069\" (UID: \"0db533af-bc36-4291-b534-fb527a971069\") " Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.320544 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-utilities" (OuterVolumeSpecName: "utilities") pod "0db533af-bc36-4291-b534-fb527a971069" (UID: "0db533af-bc36-4291-b534-fb527a971069"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.330712 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db533af-bc36-4291-b534-fb527a971069-kube-api-access-8n95d" (OuterVolumeSpecName: "kube-api-access-8n95d") pod "0db533af-bc36-4291-b534-fb527a971069" (UID: "0db533af-bc36-4291-b534-fb527a971069"). InnerVolumeSpecName "kube-api-access-8n95d". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.421180 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-8n95d\" (UniqueName: \"kubernetes.io/projected/0db533af-bc36-4291-b534-fb527a971069-kube-api-access-8n95d\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.421230 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.433330 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0db533af-bc36-4291-b534-fb527a971069" (UID: "0db533af-bc36-4291-b534-fb527a971069"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:16 crc kubenswrapper[4769]: I1121 14:13:16.523140 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0db533af-bc36-4291-b534-fb527a971069-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.005295 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-66skw" event={"ID":"0db533af-bc36-4291-b534-fb527a971069","Type":"ContainerDied","Data":"1c72b48513dc555d530a99f500e5e467c41a6187498e2e70bc598ad9f4eb7856"} Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.005388 4769 scope.go:117] "RemoveContainer" containerID="9d396772263ada29e3450bc485fb0282357cfb805db46762c13a9b520baf1c53" Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.005405 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-66skw" Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.039379 4769 scope.go:117] "RemoveContainer" containerID="13c5b587c5bd4aeea8ecd251b1d78fc7f36532a17aa4a5e8406905383da65f73" Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.059909 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-66skw"] Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.065919 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-66skw"] Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.076238 4769 scope.go:117] "RemoveContainer" containerID="96f1173bea6cbbfc9f80c31dc87b68e3e8f1e126b189f63dc1fd35edaf50499f" Nov 21 14:13:17 crc kubenswrapper[4769]: I1121 14:13:17.287670 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db533af-bc36-4291-b534-fb527a971069" path="/var/lib/kubelet/pods/0db533af-bc36-4291-b534-fb527a971069/volumes" Nov 21 14:13:18 crc kubenswrapper[4769]: I1121 14:13:18.681965 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Nov 21 14:13:18 crc kubenswrapper[4769]: I1121 14:13:18.695874 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Nov 21 14:13:18 crc kubenswrapper[4769]: I1121 14:13:18.702911 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Nov 21 14:13:18 crc kubenswrapper[4769]: I1121 14:13:18.854859 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/openstack-galera-2" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerName="galera" containerID="cri-o://26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5" gracePeriod=30 Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.319785 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.320001 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/memcached-0" podUID="205da75e-a431-4a06-9ead-aa1edb28adec" containerName="memcached" containerID="cri-o://fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca" gracePeriod=30 Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.669147 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.783124 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-generated\") pod \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.783184 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-default\") pod \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.783349 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kolla-config\") pod \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.783378 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.783402 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-operator-scripts\") pod \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.783451 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlpjn\" (UniqueName: \"kubernetes.io/projected/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kube-api-access-wlpjn\") pod \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\" (UID: \"a07bb3ef-555a-4a18-a263-a0aca7beaa72\") " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.784002 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "a07bb3ef-555a-4a18-a263-a0aca7beaa72" (UID: "a07bb3ef-555a-4a18-a263-a0aca7beaa72"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.784020 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "a07bb3ef-555a-4a18-a263-a0aca7beaa72" (UID: "a07bb3ef-555a-4a18-a263-a0aca7beaa72"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.784118 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a07bb3ef-555a-4a18-a263-a0aca7beaa72" (UID: "a07bb3ef-555a-4a18-a263-a0aca7beaa72"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.784719 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a07bb3ef-555a-4a18-a263-a0aca7beaa72" (UID: "a07bb3ef-555a-4a18-a263-a0aca7beaa72"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.789470 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kube-api-access-wlpjn" (OuterVolumeSpecName: "kube-api-access-wlpjn") pod "a07bb3ef-555a-4a18-a263-a0aca7beaa72" (UID: "a07bb3ef-555a-4a18-a263-a0aca7beaa72"). InnerVolumeSpecName "kube-api-access-wlpjn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.799364 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "mysql-db") pod "a07bb3ef-555a-4a18-a263-a0aca7beaa72" (UID: "a07bb3ef-555a-4a18-a263-a0aca7beaa72"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.884988 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.885068 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.885093 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.885115 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wlpjn\" (UniqueName: \"kubernetes.io/projected/a07bb3ef-555a-4a18-a263-a0aca7beaa72-kube-api-access-wlpjn\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.885137 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.885155 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/a07bb3ef-555a-4a18-a263-a0aca7beaa72-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.902591 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.951517 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 14:13:19 crc kubenswrapper[4769]: I1121 14:13:19.986409 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.033365 4769 generic.go:334] "Generic (PLEG): container finished" podID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerID="26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5" exitCode=0 Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.033408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"a07bb3ef-555a-4a18-a263-a0aca7beaa72","Type":"ContainerDied","Data":"26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5"} Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.033432 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-2" event={"ID":"a07bb3ef-555a-4a18-a263-a0aca7beaa72","Type":"ContainerDied","Data":"45a81e3632f92c766bed1c49eb40e46004b30c0147ce4e10d7e48ab93076ccda"} Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.033448 4769 scope.go:117] "RemoveContainer" containerID="26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.033570 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-2" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.065008 4769 scope.go:117] "RemoveContainer" containerID="d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.065047 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.072393 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstack-galera-2"] Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.089987 4769 scope.go:117] "RemoveContainer" containerID="26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5" Nov 21 14:13:20 crc kubenswrapper[4769]: E1121 14:13:20.091429 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5\": container with ID starting with 26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5 not found: ID does not exist" containerID="26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.091511 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5"} err="failed to get container status \"26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5\": rpc error: code = NotFound desc = could not find container \"26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5\": container with ID starting with 26cead59af3940b71ccbe113af41e5b8d5ee4e5d233c709d5b35663c357a32c5 not found: ID does not exist" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.091567 4769 scope.go:117] "RemoveContainer" containerID="d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27" Nov 21 14:13:20 crc kubenswrapper[4769]: E1121 14:13:20.092256 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27\": container with ID starting with d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27 not found: ID does not exist" containerID="d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.092361 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27"} err="failed to get container status \"d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27\": rpc error: code = NotFound desc = could not find container \"d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27\": container with ID starting with d2016a617aa054efc47a055aa974a4dd27968c715762f0b6d1dfd782fff7cc27 not found: ID does not exist" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.346363 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.389610 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.393944 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-kolla-config\") pod \"205da75e-a431-4a06-9ead-aa1edb28adec\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.393987 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-config-data\") pod \"205da75e-a431-4a06-9ead-aa1edb28adec\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.394052 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk4f8\" (UniqueName: \"kubernetes.io/projected/205da75e-a431-4a06-9ead-aa1edb28adec-kube-api-access-nk4f8\") pod \"205da75e-a431-4a06-9ead-aa1edb28adec\" (UID: \"205da75e-a431-4a06-9ead-aa1edb28adec\") " Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.397659 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "205da75e-a431-4a06-9ead-aa1edb28adec" (UID: "205da75e-a431-4a06-9ead-aa1edb28adec"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.398171 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-config-data" (OuterVolumeSpecName: "config-data") pod "205da75e-a431-4a06-9ead-aa1edb28adec" (UID: "205da75e-a431-4a06-9ead-aa1edb28adec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.400353 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205da75e-a431-4a06-9ead-aa1edb28adec-kube-api-access-nk4f8" (OuterVolumeSpecName: "kube-api-access-nk4f8") pod "205da75e-a431-4a06-9ead-aa1edb28adec" (UID: "205da75e-a431-4a06-9ead-aa1edb28adec"). InnerVolumeSpecName "kube-api-access-nk4f8". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.433374 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/rabbitmq-server-0" podUID="34682385-33d5-43f5-a2e8-c37c79018563" containerName="rabbitmq" containerID="cri-o://6ab5b66fd1a04bf5b9d09a2df30e837ce7bf988d43ef6d4f2d1cb0b3ed68352d" gracePeriod=604800 Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.495449 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.495478 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/205da75e-a431-4a06-9ead-aa1edb28adec-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.495493 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nk4f8\" (UniqueName: \"kubernetes.io/projected/205da75e-a431-4a06-9ead-aa1edb28adec-kube-api-access-nk4f8\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:20 crc kubenswrapper[4769]: I1121 14:13:20.909802 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/openstack-galera-1" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" containerName="galera" containerID="cri-o://2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4" gracePeriod=28 Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.043874 4769 generic.go:334] "Generic (PLEG): container finished" podID="205da75e-a431-4a06-9ead-aa1edb28adec" containerID="fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca" exitCode=0 Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.043946 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"205da75e-a431-4a06-9ead-aa1edb28adec","Type":"ContainerDied","Data":"fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca"} Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.043984 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/memcached-0" Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.044025 4769 scope.go:117] "RemoveContainer" containerID="fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca" Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.044009 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/memcached-0" event={"ID":"205da75e-a431-4a06-9ead-aa1edb28adec","Type":"ContainerDied","Data":"808e0d73ed42b3283bc5070bb219f0817db38bebc6176cac621ed2a7b1c8bc14"} Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.077509 4769 scope.go:117] "RemoveContainer" containerID="fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca" Nov 21 14:13:21 crc kubenswrapper[4769]: E1121 14:13:21.081266 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca\": container with ID starting with fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca not found: ID does not exist" containerID="fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca" Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.081343 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca"} err="failed to get container status \"fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca\": rpc error: code = NotFound desc = could not find container \"fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca\": container with ID starting with fc3a75a8c35478b53a2f0ad2f8033f548beec5d8cbbd8cbbe9a1bfb58dacffca not found: ID does not exist" Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.096331 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.103506 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/memcached-0"] Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.282004 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205da75e-a431-4a06-9ead-aa1edb28adec" path="/var/lib/kubelet/pods/205da75e-a431-4a06-9ead-aa1edb28adec/volumes" Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.282809 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" path="/var/lib/kubelet/pods/a07bb3ef-555a-4a18-a263-a0aca7beaa72/volumes" Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.400795 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r"] Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.401115 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="manager" containerID="cri-o://64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9" gracePeriod=10 Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.401750 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="kube-rbac-proxy" containerID="cri-o://c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65" gracePeriod=10 Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.698498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-mtjh4"] Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.698693 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/keystone-operator-index-mtjh4" podUID="fe484179-2b98-449e-8814-79bb6c355580" containerName="registry-server" containerID="cri-o://601ee86d80c7cf9f4686e9af6b0b241b323b7cffe4e6ea4001349169cb830ec6" gracePeriod=30 Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.745253 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws"] Nov 21 14:13:21 crc kubenswrapper[4769]: I1121 14:13:21.749615 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcmrhws"] Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.037597 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.071846 4769 generic.go:334] "Generic (PLEG): container finished" podID="34682385-33d5-43f5-a2e8-c37c79018563" containerID="6ab5b66fd1a04bf5b9d09a2df30e837ce7bf988d43ef6d4f2d1cb0b3ed68352d" exitCode=0 Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.071915 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"34682385-33d5-43f5-a2e8-c37c79018563","Type":"ContainerDied","Data":"6ab5b66fd1a04bf5b9d09a2df30e837ce7bf988d43ef6d4f2d1cb0b3ed68352d"} Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075054 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d071296-47be-4154-b14c-95b3441b36fc" containerID="c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65" exitCode=0 Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075075 4769 generic.go:334] "Generic (PLEG): container finished" podID="6d071296-47be-4154-b14c-95b3441b36fc" containerID="64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9" exitCode=0 Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075111 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" event={"ID":"6d071296-47be-4154-b14c-95b3441b36fc","Type":"ContainerDied","Data":"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65"} Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" event={"ID":"6d071296-47be-4154-b14c-95b3441b36fc","Type":"ContainerDied","Data":"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9"} Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075138 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" event={"ID":"6d071296-47be-4154-b14c-95b3441b36fc","Type":"ContainerDied","Data":"02ae528345f10b4bd847bba66899442ddcfa084f028fd7e5722788a384c3d4e8"} Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075154 4769 scope.go:117] "RemoveContainer" containerID="c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.075318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.095597 4769 generic.go:334] "Generic (PLEG): container finished" podID="fe484179-2b98-449e-8814-79bb6c355580" containerID="601ee86d80c7cf9f4686e9af6b0b241b323b7cffe4e6ea4001349169cb830ec6" exitCode=0 Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.095652 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-mtjh4" event={"ID":"fe484179-2b98-449e-8814-79bb6c355580","Type":"ContainerDied","Data":"601ee86d80c7cf9f4686e9af6b0b241b323b7cffe4e6ea4001349169cb830ec6"} Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.105746 4769 scope.go:117] "RemoveContainer" containerID="64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.148829 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgc54\" (UniqueName: \"kubernetes.io/projected/6d071296-47be-4154-b14c-95b3441b36fc-kube-api-access-sgc54\") pod \"6d071296-47be-4154-b14c-95b3441b36fc\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.148930 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-webhook-cert\") pod \"6d071296-47be-4154-b14c-95b3441b36fc\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.149039 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-apiservice-cert\") pod \"6d071296-47be-4154-b14c-95b3441b36fc\" (UID: \"6d071296-47be-4154-b14c-95b3441b36fc\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.158390 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d071296-47be-4154-b14c-95b3441b36fc" (UID: "6d071296-47be-4154-b14c-95b3441b36fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.170144 4769 scope.go:117] "RemoveContainer" containerID="c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65" Nov 21 14:13:22 crc kubenswrapper[4769]: E1121 14:13:22.170747 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65\": container with ID starting with c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65 not found: ID does not exist" containerID="c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.170775 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65"} err="failed to get container status \"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65\": rpc error: code = NotFound desc = could not find container \"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65\": container with ID starting with c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65 not found: ID does not exist" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.170795 4769 scope.go:117] "RemoveContainer" containerID="64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9" Nov 21 14:13:22 crc kubenswrapper[4769]: E1121 14:13:22.171078 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9\": container with ID starting with 64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9 not found: ID does not exist" containerID="64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171102 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9"} err="failed to get container status \"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9\": rpc error: code = NotFound desc = could not find container \"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9\": container with ID starting with 64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9 not found: ID does not exist" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171119 4769 scope.go:117] "RemoveContainer" containerID="c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171406 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "6d071296-47be-4154-b14c-95b3441b36fc" (UID: "6d071296-47be-4154-b14c-95b3441b36fc"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171629 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d071296-47be-4154-b14c-95b3441b36fc-kube-api-access-sgc54" (OuterVolumeSpecName: "kube-api-access-sgc54") pod "6d071296-47be-4154-b14c-95b3441b36fc" (UID: "6d071296-47be-4154-b14c-95b3441b36fc"). InnerVolumeSpecName "kube-api-access-sgc54". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171824 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65"} err="failed to get container status \"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65\": rpc error: code = NotFound desc = could not find container \"c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65\": container with ID starting with c7575a40b6013a80a22eafb38693610a4deb4d9626c5f60e71dafefc01b82f65 not found: ID does not exist" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171847 4769 scope.go:117] "RemoveContainer" containerID="64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.171915 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.172288 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9"} err="failed to get container status \"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9\": rpc error: code = NotFound desc = could not find container \"64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9\": container with ID starting with 64c8507f41e26d48fe58a559454f0e431eb95628c21b34e881948e933c45d0c9 not found: ID does not exist" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.240252 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.251134 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txjh7\" (UniqueName: \"kubernetes.io/projected/fe484179-2b98-449e-8814-79bb6c355580-kube-api-access-txjh7\") pod \"fe484179-2b98-449e-8814-79bb6c355580\" (UID: \"fe484179-2b98-449e-8814-79bb6c355580\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.251724 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.251752 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sgc54\" (UniqueName: \"kubernetes.io/projected/6d071296-47be-4154-b14c-95b3441b36fc-kube-api-access-sgc54\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.251768 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d071296-47be-4154-b14c-95b3441b36fc-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.256336 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe484179-2b98-449e-8814-79bb6c355580-kube-api-access-txjh7" (OuterVolumeSpecName: "kube-api-access-txjh7") pod "fe484179-2b98-449e-8814-79bb6c355580" (UID: "fe484179-2b98-449e-8814-79bb6c355580"). InnerVolumeSpecName "kube-api-access-txjh7". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353130 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-erlang-cookie\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353256 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n65zn\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-kube-api-access-n65zn\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-confd\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353410 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/34682385-33d5-43f5-a2e8-c37c79018563-erlang-cookie-secret\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353627 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353657 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-plugins\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353689 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/34682385-33d5-43f5-a2e8-c37c79018563-pod-info\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353773 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/34682385-33d5-43f5-a2e8-c37c79018563-plugins-conf\") pod \"34682385-33d5-43f5-a2e8-c37c79018563\" (UID: \"34682385-33d5-43f5-a2e8-c37c79018563\") " Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.353917 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.354119 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.354359 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.354400 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-txjh7\" (UniqueName: \"kubernetes.io/projected/fe484179-2b98-449e-8814-79bb6c355580-kube-api-access-txjh7\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.354422 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.354906 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34682385-33d5-43f5-a2e8-c37c79018563-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.360859 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-kube-api-access-n65zn" (OuterVolumeSpecName: "kube-api-access-n65zn") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "kube-api-access-n65zn". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.360909 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34682385-33d5-43f5-a2e8-c37c79018563-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.361093 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34682385-33d5-43f5-a2e8-c37c79018563-pod-info" (OuterVolumeSpecName: "pod-info") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGidValue "" Nov 21 14:13:22 crc kubenswrapper[4769]: I1121 14:13:22.373960 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef" (OuterVolumeSpecName: "persistence") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef". PluginName "kubernetes.io/csi", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.405656 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.414064 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-8596b9d554-dst8r"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.437063 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "34682385-33d5-43f5-a2e8-c37c79018563" (UID: "34682385-33d5-43f5-a2e8-c37c79018563"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.455940 4769 reconciler_common.go:293] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/34682385-33d5-43f5-a2e8-c37c79018563-plugins-conf\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.455971 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n65zn\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-kube-api-access-n65zn\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.455981 4769 reconciler_common.go:293] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/34682385-33d5-43f5-a2e8-c37c79018563-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.455993 4769 reconciler_common.go:293] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/34682385-33d5-43f5-a2e8-c37c79018563-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.456035 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") on node \"crc\" " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.456048 4769 reconciler_common.go:293] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/34682385-33d5-43f5-a2e8-c37c79018563-pod-info\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.481207 4769 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.481360 4769 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef") on node "crc" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.557113 4769 reconciler_common.go:293] "Volume detached for volume \"pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-f272eadd-6dba-407a-bcbc-5f3fa7de10ef\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.850034 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.916311 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="keystone-kuttl-tests/openstack-galera-0" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="galera" containerID="cri-o://e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" gracePeriod=26 Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.963159 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"c06ed331-7617-4e78-9973-84e0c6edead2\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.963306 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-generated\") pod \"c06ed331-7617-4e78-9973-84e0c6edead2\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.963346 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-kolla-config\") pod \"c06ed331-7617-4e78-9973-84e0c6edead2\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.963483 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tltcp\" (UniqueName: \"kubernetes.io/projected/c06ed331-7617-4e78-9973-84e0c6edead2-kube-api-access-tltcp\") pod \"c06ed331-7617-4e78-9973-84e0c6edead2\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.963555 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-operator-scripts\") pod \"c06ed331-7617-4e78-9973-84e0c6edead2\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.963656 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-default\") pod \"c06ed331-7617-4e78-9973-84e0c6edead2\" (UID: \"c06ed331-7617-4e78-9973-84e0c6edead2\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.966453 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "c06ed331-7617-4e78-9973-84e0c6edead2" (UID: "c06ed331-7617-4e78-9973-84e0c6edead2"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.967885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "c06ed331-7617-4e78-9973-84e0c6edead2" (UID: "c06ed331-7617-4e78-9973-84e0c6edead2"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.967903 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "c06ed331-7617-4e78-9973-84e0c6edead2" (UID: "c06ed331-7617-4e78-9973-84e0c6edead2"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.968150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c06ed331-7617-4e78-9973-84e0c6edead2" (UID: "c06ed331-7617-4e78-9973-84e0c6edead2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.975774 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06ed331-7617-4e78-9973-84e0c6edead2-kube-api-access-tltcp" (OuterVolumeSpecName: "kube-api-access-tltcp") pod "c06ed331-7617-4e78-9973-84e0c6edead2" (UID: "c06ed331-7617-4e78-9973-84e0c6edead2"). InnerVolumeSpecName "kube-api-access-tltcp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:22.984494 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "mysql-db") pod "c06ed331-7617-4e78-9973-84e0c6edead2" (UID: "c06ed331-7617-4e78-9973-84e0c6edead2"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.066091 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.066664 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tltcp\" (UniqueName: \"kubernetes.io/projected/c06ed331-7617-4e78-9973-84e0c6edead2-kube-api-access-tltcp\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.066687 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.066703 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.066765 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.066780 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/c06ed331-7617-4e78-9973-84e0c6edead2-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.090433 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.126705 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/rabbitmq-server-0" event={"ID":"34682385-33d5-43f5-a2e8-c37c79018563","Type":"ContainerDied","Data":"98fb8ccf21c035c14c815cc7e4018f1e2fbd85911834cc0a82757eaa993cfa37"} Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.126816 4769 scope.go:117] "RemoveContainer" containerID="6ab5b66fd1a04bf5b9d09a2df30e837ce7bf988d43ef6d4f2d1cb0b3ed68352d" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.126746 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/rabbitmq-server-0" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.142645 4769 generic.go:334] "Generic (PLEG): container finished" podID="c06ed331-7617-4e78-9973-84e0c6edead2" containerID="2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4" exitCode=0 Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.142706 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"c06ed331-7617-4e78-9973-84e0c6edead2","Type":"ContainerDied","Data":"2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4"} Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.142736 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-1" event={"ID":"c06ed331-7617-4e78-9973-84e0c6edead2","Type":"ContainerDied","Data":"f939d19ab1b8fa725dc54987c03c9e6d678f3214fc520d45f92e613e902879ba"} Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.142798 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-1" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.148151 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-mtjh4" event={"ID":"fe484179-2b98-449e-8814-79bb6c355580","Type":"ContainerDied","Data":"a50753799b17a7f61d186d3e4a5bb30f808665444d32f3c2fa30a2fea20b2b9c"} Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.148260 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-mtjh4" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.170850 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.184857 4769 scope.go:117] "RemoveContainer" containerID="77fcdd676de9b94441ddeca909a48d607c32050ca3a590ef362ede1117a85ce6" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.204784 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.212633 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/rabbitmq-server-0"] Nov 21 14:13:23 crc kubenswrapper[4769]: E1121 14:13:23.216823 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 14:13:23 crc kubenswrapper[4769]: E1121 14:13:23.219419 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.219461 4769 scope.go:117] "RemoveContainer" containerID="2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4" Nov 21 14:13:23 crc kubenswrapper[4769]: E1121 14:13:23.222103 4769 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Nov 21 14:13:23 crc kubenswrapper[4769]: E1121 14:13:23.222174 4769 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="keystone-kuttl-tests/openstack-galera-0" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="galera" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.224695 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.229654 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstack-galera-1"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.238001 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/keystone-operator-index-mtjh4"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.242582 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/keystone-operator-index-mtjh4"] Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.247487 4769 scope.go:117] "RemoveContainer" containerID="99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.274644 4769 scope.go:117] "RemoveContainer" containerID="2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4" Nov 21 14:13:23 crc kubenswrapper[4769]: E1121 14:13:23.275222 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4\": container with ID starting with 2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4 not found: ID does not exist" containerID="2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.275259 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4"} err="failed to get container status \"2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4\": rpc error: code = NotFound desc = could not find container \"2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4\": container with ID starting with 2d4c268d0031b87a0ae0de50a0b6b1ba0cb1d49f959968689fbb57d0d26755c4 not found: ID does not exist" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.275287 4769 scope.go:117] "RemoveContainer" containerID="99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3" Nov 21 14:13:23 crc kubenswrapper[4769]: E1121 14:13:23.275754 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3\": container with ID starting with 99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3 not found: ID does not exist" containerID="99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.275846 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3"} err="failed to get container status \"99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3\": rpc error: code = NotFound desc = could not find container \"99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3\": container with ID starting with 99ce6e137062d5b22fb25408ea26edb37da07e73402a4c45946b5ee8b3f6dee3 not found: ID does not exist" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.275890 4769 scope.go:117] "RemoveContainer" containerID="601ee86d80c7cf9f4686e9af6b0b241b323b7cffe4e6ea4001349169cb830ec6" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.283432 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34682385-33d5-43f5-a2e8-c37c79018563" path="/var/lib/kubelet/pods/34682385-33d5-43f5-a2e8-c37c79018563/volumes" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.284562 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d071296-47be-4154-b14c-95b3441b36fc" path="/var/lib/kubelet/pods/6d071296-47be-4154-b14c-95b3441b36fc/volumes" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.285563 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" path="/var/lib/kubelet/pods/c06ed331-7617-4e78-9973-84e0c6edead2/volumes" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.287043 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46bc628-cdec-4f0a-88df-26f9381b3cfb" path="/var/lib/kubelet/pods/c46bc628-cdec-4f0a-88df-26f9381b3cfb/volumes" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.287776 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe484179-2b98-449e-8814-79bb6c355580" path="/var/lib/kubelet/pods/fe484179-2b98-449e-8814-79bb6c355580/volumes" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.650963 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.780896 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-operator-scripts\") pod \"9190629b-7fad-49f0-98aa-fcb76d135b26\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.781083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-kolla-config\") pod \"9190629b-7fad-49f0-98aa-fcb76d135b26\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.781122 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-generated\") pod \"9190629b-7fad-49f0-98aa-fcb76d135b26\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.781224 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") pod \"9190629b-7fad-49f0-98aa-fcb76d135b26\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.781258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-default\") pod \"9190629b-7fad-49f0-98aa-fcb76d135b26\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.781302 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-775n9\" (UniqueName: \"kubernetes.io/projected/9190629b-7fad-49f0-98aa-fcb76d135b26-kube-api-access-775n9\") pod \"9190629b-7fad-49f0-98aa-fcb76d135b26\" (UID: \"9190629b-7fad-49f0-98aa-fcb76d135b26\") " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.781799 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9190629b-7fad-49f0-98aa-fcb76d135b26" (UID: "9190629b-7fad-49f0-98aa-fcb76d135b26"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.782418 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9190629b-7fad-49f0-98aa-fcb76d135b26" (UID: "9190629b-7fad-49f0-98aa-fcb76d135b26"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.782468 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "9190629b-7fad-49f0-98aa-fcb76d135b26" (UID: "9190629b-7fad-49f0-98aa-fcb76d135b26"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.782645 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "9190629b-7fad-49f0-98aa-fcb76d135b26" (UID: "9190629b-7fad-49f0-98aa-fcb76d135b26"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.785794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9190629b-7fad-49f0-98aa-fcb76d135b26-kube-api-access-775n9" (OuterVolumeSpecName: "kube-api-access-775n9") pod "9190629b-7fad-49f0-98aa-fcb76d135b26" (UID: "9190629b-7fad-49f0-98aa-fcb76d135b26"). InnerVolumeSpecName "kube-api-access-775n9". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.789161 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage10-crc" (OuterVolumeSpecName: "mysql-db") pod "9190629b-7fad-49f0-98aa-fcb76d135b26" (UID: "9190629b-7fad-49f0-98aa-fcb76d135b26"). InnerVolumeSpecName "local-storage10-crc". PluginName "kubernetes.io/local-volume", VolumeGidValue "" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.883158 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.883222 4769 reconciler_common.go:293] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-kolla-config\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.883239 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-generated\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.883286 4769 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" " Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.883311 4769 reconciler_common.go:293] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9190629b-7fad-49f0-98aa-fcb76d135b26-config-data-default\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.883324 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-775n9\" (UniqueName: \"kubernetes.io/projected/9190629b-7fad-49f0-98aa-fcb76d135b26-kube-api-access-775n9\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.896922 4769 operation_generator.go:917] UnmountDevice succeeded for volume "local-storage10-crc" (UniqueName: "kubernetes.io/local-volume/local-storage10-crc") on node "crc" Nov 21 14:13:23 crc kubenswrapper[4769]: I1121 14:13:23.985122 4769 reconciler_common.go:293] "Volume detached for volume \"local-storage10-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage10-crc\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.159005 4769 generic.go:334] "Generic (PLEG): container finished" podID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" exitCode=0 Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.159073 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keystone-kuttl-tests/openstack-galera-0" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.159120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"9190629b-7fad-49f0-98aa-fcb76d135b26","Type":"ContainerDied","Data":"e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce"} Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.159215 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="keystone-kuttl-tests/openstack-galera-0" event={"ID":"9190629b-7fad-49f0-98aa-fcb76d135b26","Type":"ContainerDied","Data":"27b13751e2e0df28254426195a41e1389fddf964c58f7f95cba5d6fcd8902eaa"} Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.159232 4769 scope.go:117] "RemoveContainer" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.196532 4769 scope.go:117] "RemoveContainer" containerID="1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.203102 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.207777 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["keystone-kuttl-tests/openstack-galera-0"] Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.217793 4769 scope.go:117] "RemoveContainer" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" Nov 21 14:13:24 crc kubenswrapper[4769]: E1121 14:13:24.219439 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce\": container with ID starting with e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce not found: ID does not exist" containerID="e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.219495 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce"} err="failed to get container status \"e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce\": rpc error: code = NotFound desc = could not find container \"e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce\": container with ID starting with e1c690be56a353f723f9fdfa56d7ba1bfe167098afdc3fb15a3f8e0c094501ce not found: ID does not exist" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.219530 4769 scope.go:117] "RemoveContainer" containerID="1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6" Nov 21 14:13:24 crc kubenswrapper[4769]: E1121 14:13:24.219871 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6\": container with ID starting with 1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6 not found: ID does not exist" containerID="1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.219899 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6"} err="failed to get container status \"1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6\": rpc error: code = NotFound desc = could not find container \"1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6\": container with ID starting with 1eb8b6f643c32b035e0d95e0f2d1e5ed95706143c9404a3d1ea52f919628ded6 not found: ID does not exist" Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.500124 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86"] Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.501604 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="kube-rbac-proxy" containerID="cri-o://67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230" gracePeriod=10 Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.502008 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="manager" containerID="cri-o://99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e" gracePeriod=10 Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.726642 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-f9zgt"] Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.727298 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-f9zgt" podUID="98bbc633-5f13-477d-bf2e-f570cc47dd2c" containerName="registry-server" containerID="cri-o://65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63" gracePeriod=30 Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.761950 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn"] Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.773523 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ezhnhn"] Nov 21 14:13:24 crc kubenswrapper[4769]: I1121 14:13:24.925987 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.004865 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhz2t\" (UniqueName: \"kubernetes.io/projected/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-kube-api-access-vhz2t\") pod \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.005041 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-webhook-cert\") pod \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.005086 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-apiservice-cert\") pod \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\" (UID: \"f1191c0e-93c8-4dc2-8e86-733cbc6976cc\") " Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.009459 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "f1191c0e-93c8-4dc2-8e86-733cbc6976cc" (UID: "f1191c0e-93c8-4dc2-8e86-733cbc6976cc"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.009477 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-kube-api-access-vhz2t" (OuterVolumeSpecName: "kube-api-access-vhz2t") pod "f1191c0e-93c8-4dc2-8e86-733cbc6976cc" (UID: "f1191c0e-93c8-4dc2-8e86-733cbc6976cc"). InnerVolumeSpecName "kube-api-access-vhz2t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.009604 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f1191c0e-93c8-4dc2-8e86-733cbc6976cc" (UID: "f1191c0e-93c8-4dc2-8e86-733cbc6976cc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.082639 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.106291 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.106314 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.106327 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vhz2t\" (UniqueName: \"kubernetes.io/projected/f1191c0e-93c8-4dc2-8e86-733cbc6976cc-kube-api-access-vhz2t\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.173624 4769 generic.go:334] "Generic (PLEG): container finished" podID="98bbc633-5f13-477d-bf2e-f570cc47dd2c" containerID="65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63" exitCode=0 Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.173676 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-f9zgt" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.173728 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f9zgt" event={"ID":"98bbc633-5f13-477d-bf2e-f570cc47dd2c","Type":"ContainerDied","Data":"65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63"} Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.173788 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-f9zgt" event={"ID":"98bbc633-5f13-477d-bf2e-f570cc47dd2c","Type":"ContainerDied","Data":"47ce084575d720edfe1d14dba8e629c0517849111989502aded747f66f3db675"} Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.173811 4769 scope.go:117] "RemoveContainer" containerID="65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.176776 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerID="67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230" exitCode=0 Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.176811 4769 generic.go:334] "Generic (PLEG): container finished" podID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerID="99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e" exitCode=0 Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.176835 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" event={"ID":"f1191c0e-93c8-4dc2-8e86-733cbc6976cc","Type":"ContainerDied","Data":"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230"} Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.176864 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" event={"ID":"f1191c0e-93c8-4dc2-8e86-733cbc6976cc","Type":"ContainerDied","Data":"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e"} Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.176876 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" event={"ID":"f1191c0e-93c8-4dc2-8e86-733cbc6976cc","Type":"ContainerDied","Data":"319c48d27c2c4d4e48c8b6f5688bdb0ca192600dd2eb511f63d1a91d42900b89"} Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.176931 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.201382 4769 scope.go:117] "RemoveContainer" containerID="65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63" Nov 21 14:13:25 crc kubenswrapper[4769]: E1121 14:13:25.201899 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63\": container with ID starting with 65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63 not found: ID does not exist" containerID="65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.201963 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63"} err="failed to get container status \"65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63\": rpc error: code = NotFound desc = could not find container \"65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63\": container with ID starting with 65a37e95c87e85d50312c2fa530d1c18dedb1a2a833386ce9226059b1361ca63 not found: ID does not exist" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.202011 4769 scope.go:117] "RemoveContainer" containerID="67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.206738 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86"] Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.207435 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8gcw\" (UniqueName: \"kubernetes.io/projected/98bbc633-5f13-477d-bf2e-f570cc47dd2c-kube-api-access-d8gcw\") pod \"98bbc633-5f13-477d-bf2e-f570cc47dd2c\" (UID: \"98bbc633-5f13-477d-bf2e-f570cc47dd2c\") " Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.211905 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98bbc633-5f13-477d-bf2e-f570cc47dd2c-kube-api-access-d8gcw" (OuterVolumeSpecName: "kube-api-access-d8gcw") pod "98bbc633-5f13-477d-bf2e-f570cc47dd2c" (UID: "98bbc633-5f13-477d-bf2e-f570cc47dd2c"). InnerVolumeSpecName "kube-api-access-d8gcw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.227481 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-controller-manager-5497c88f7c-8fd86"] Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.232519 4769 scope.go:117] "RemoveContainer" containerID="99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.246702 4769 scope.go:117] "RemoveContainer" containerID="67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230" Nov 21 14:13:25 crc kubenswrapper[4769]: E1121 14:13:25.248609 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230\": container with ID starting with 67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230 not found: ID does not exist" containerID="67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.248657 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230"} err="failed to get container status \"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230\": rpc error: code = NotFound desc = could not find container \"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230\": container with ID starting with 67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230 not found: ID does not exist" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.248689 4769 scope.go:117] "RemoveContainer" containerID="99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e" Nov 21 14:13:25 crc kubenswrapper[4769]: E1121 14:13:25.249002 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e\": container with ID starting with 99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e not found: ID does not exist" containerID="99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.249122 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e"} err="failed to get container status \"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e\": rpc error: code = NotFound desc = could not find container \"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e\": container with ID starting with 99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e not found: ID does not exist" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.249234 4769 scope.go:117] "RemoveContainer" containerID="67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.249539 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230"} err="failed to get container status \"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230\": rpc error: code = NotFound desc = could not find container \"67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230\": container with ID starting with 67334377f88a8168774ce5908710dba2a91848ab8feee5f344367be93cee4230 not found: ID does not exist" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.249560 4769 scope.go:117] "RemoveContainer" containerID="99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.249755 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e"} err="failed to get container status \"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e\": rpc error: code = NotFound desc = could not find container \"99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e\": container with ID starting with 99079e91b48e392769f0a4524f9e2de5dc4b08a72aa9fd1b1fbff828a375eb8e not found: ID does not exist" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.280582 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b45bbcc-d90e-4ef8-82de-5a1346896a65" path="/var/lib/kubelet/pods/1b45bbcc-d90e-4ef8-82de-5a1346896a65/volumes" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.281331 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" path="/var/lib/kubelet/pods/9190629b-7fad-49f0-98aa-fcb76d135b26/volumes" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.282145 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" path="/var/lib/kubelet/pods/f1191c0e-93c8-4dc2-8e86-733cbc6976cc/volumes" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.309794 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d8gcw\" (UniqueName: \"kubernetes.io/projected/98bbc633-5f13-477d-bf2e-f570cc47dd2c-kube-api-access-d8gcw\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.491182 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-f9zgt"] Nov 21 14:13:25 crc kubenswrapper[4769]: I1121 14:13:25.498717 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-f9zgt"] Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.200046 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn"] Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.201312 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="manager" containerID="cri-o://3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229" gracePeriod=10 Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.201539 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="kube-rbac-proxy" containerID="cri-o://532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d" gracePeriod=10 Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.465866 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-lfjfp"] Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.466377 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-lfjfp" podUID="fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" containerName="registry-server" containerID="cri-o://14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20" gracePeriod=30 Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.504883 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp"] Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.517487 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27c2jslp"] Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.817258 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.949266 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-webhook-cert\") pod \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.949418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b574m\" (UniqueName: \"kubernetes.io/projected/4e6cd448-bb7a-42a8-8d9b-fde328121f50-kube-api-access-b574m\") pod \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.949704 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-apiservice-cert\") pod \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\" (UID: \"4e6cd448-bb7a-42a8-8d9b-fde328121f50\") " Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.959664 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4e6cd448-bb7a-42a8-8d9b-fde328121f50" (UID: "4e6cd448-bb7a-42a8-8d9b-fde328121f50"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.960540 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6cd448-bb7a-42a8-8d9b-fde328121f50-kube-api-access-b574m" (OuterVolumeSpecName: "kube-api-access-b574m") pod "4e6cd448-bb7a-42a8-8d9b-fde328121f50" (UID: "4e6cd448-bb7a-42a8-8d9b-fde328121f50"). InnerVolumeSpecName "kube-api-access-b574m". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:26 crc kubenswrapper[4769]: I1121 14:13:26.970345 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "4e6cd448-bb7a-42a8-8d9b-fde328121f50" (UID: "4e6cd448-bb7a-42a8-8d9b-fde328121f50"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.002571 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.053107 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b574m\" (UniqueName: \"kubernetes.io/projected/4e6cd448-bb7a-42a8-8d9b-fde328121f50-kube-api-access-b574m\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.053171 4769 reconciler_common.go:293] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-apiservice-cert\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.053223 4769 reconciler_common.go:293] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cd448-bb7a-42a8-8d9b-fde328121f50-webhook-cert\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.155992 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whctw\" (UniqueName: \"kubernetes.io/projected/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7-kube-api-access-whctw\") pod \"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7\" (UID: \"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7\") " Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.161890 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7-kube-api-access-whctw" (OuterVolumeSpecName: "kube-api-access-whctw") pod "fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" (UID: "fdcf3b8a-976d-43c3-a6c9-a1498621f4e7"). InnerVolumeSpecName "kube-api-access-whctw". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.231248 4769 generic.go:334] "Generic (PLEG): container finished" podID="fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" containerID="14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20" exitCode=0 Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.231298 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lfjfp" event={"ID":"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7","Type":"ContainerDied","Data":"14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20"} Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.231359 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-lfjfp" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.231932 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-lfjfp" event={"ID":"fdcf3b8a-976d-43c3-a6c9-a1498621f4e7","Type":"ContainerDied","Data":"a143b93de741ca60111443fc9af37d71988a27fb37eca33269bd9512e6369dc6"} Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.232078 4769 scope.go:117] "RemoveContainer" containerID="14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.234217 4769 generic.go:334] "Generic (PLEG): container finished" podID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerID="532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d" exitCode=0 Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.234276 4769 generic.go:334] "Generic (PLEG): container finished" podID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerID="3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229" exitCode=0 Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.234312 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" event={"ID":"4e6cd448-bb7a-42a8-8d9b-fde328121f50","Type":"ContainerDied","Data":"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d"} Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.234360 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" event={"ID":"4e6cd448-bb7a-42a8-8d9b-fde328121f50","Type":"ContainerDied","Data":"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229"} Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.234376 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" event={"ID":"4e6cd448-bb7a-42a8-8d9b-fde328121f50","Type":"ContainerDied","Data":"300b804f7a01af34609ba1ca3b03bf4af65506c33b45bcf6369fea1bc214886d"} Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.234318 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.251647 4769 scope.go:117] "RemoveContainer" containerID="14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20" Nov 21 14:13:27 crc kubenswrapper[4769]: E1121 14:13:27.254275 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20\": container with ID starting with 14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20 not found: ID does not exist" containerID="14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.254324 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20"} err="failed to get container status \"14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20\": rpc error: code = NotFound desc = could not find container \"14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20\": container with ID starting with 14ad5d03edbf74c9f3527d2e3a77741b44db9de3a3795f6e07da84f9b95c4b20 not found: ID does not exist" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.254361 4769 scope.go:117] "RemoveContainer" containerID="532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.257641 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-whctw\" (UniqueName: \"kubernetes.io/projected/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7-kube-api-access-whctw\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.269993 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-lfjfp"] Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.276654 4769 scope.go:117] "RemoveContainer" containerID="3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.288148 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e930af-577e-43b7-8ae6-f5e4b0b12b94" path="/var/lib/kubelet/pods/02e930af-577e-43b7-8ae6-f5e4b0b12b94/volumes" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.289214 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98bbc633-5f13-477d-bf2e-f570cc47dd2c" path="/var/lib/kubelet/pods/98bbc633-5f13-477d-bf2e-f570cc47dd2c/volumes" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.289788 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-lfjfp"] Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.289834 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn"] Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.291754 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-ccdc8969c-dvkwn"] Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.300890 4769 scope.go:117] "RemoveContainer" containerID="532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d" Nov 21 14:13:27 crc kubenswrapper[4769]: E1121 14:13:27.301376 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d\": container with ID starting with 532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d not found: ID does not exist" containerID="532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.301404 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d"} err="failed to get container status \"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d\": rpc error: code = NotFound desc = could not find container \"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d\": container with ID starting with 532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d not found: ID does not exist" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.301427 4769 scope.go:117] "RemoveContainer" containerID="3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229" Nov 21 14:13:27 crc kubenswrapper[4769]: E1121 14:13:27.301832 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229\": container with ID starting with 3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229 not found: ID does not exist" containerID="3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.301858 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229"} err="failed to get container status \"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229\": rpc error: code = NotFound desc = could not find container \"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229\": container with ID starting with 3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229 not found: ID does not exist" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.301876 4769 scope.go:117] "RemoveContainer" containerID="532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.302171 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d"} err="failed to get container status \"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d\": rpc error: code = NotFound desc = could not find container \"532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d\": container with ID starting with 532e45cf14f55aa3aae8f8cdfc0c657cb8975a2d4299a91d07f63df3297e4c3d not found: ID does not exist" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.302252 4769 scope.go:117] "RemoveContainer" containerID="3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229" Nov 21 14:13:27 crc kubenswrapper[4769]: I1121 14:13:27.302589 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229"} err="failed to get container status \"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229\": rpc error: code = NotFound desc = could not find container \"3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229\": container with ID starting with 3a5806895a615ea5ee4768d8f972c9dd82387d2c503499091b56a1d75f4dd229 not found: ID does not exist" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.023498 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x"] Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.024097 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" podUID="b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" containerName="operator" containerID="cri-o://043cc7886fa5a7458bd508b7eb71bbb8401a3dbf22d766f358b8556071195fff" gracePeriod=10 Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.289715 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" path="/var/lib/kubelet/pods/4e6cd448-bb7a-42a8-8d9b-fde328121f50/volumes" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.290248 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" path="/var/lib/kubelet/pods/fdcf3b8a-976d-43c3-a6c9-a1498621f4e7/volumes" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.292803 4769 generic.go:334] "Generic (PLEG): container finished" podID="b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" containerID="043cc7886fa5a7458bd508b7eb71bbb8401a3dbf22d766f358b8556071195fff" exitCode=0 Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.292852 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" event={"ID":"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe","Type":"ContainerDied","Data":"043cc7886fa5a7458bd508b7eb71bbb8401a3dbf22d766f358b8556071195fff"} Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.357874 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-b2fcv"] Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.376656 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" podUID="f228d7fc-351a-4ecf-b21a-6728a6a61e55" containerName="registry-server" containerID="cri-o://10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de" gracePeriod=30 Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.474403 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22"] Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.481317 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e59076n22"] Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.613721 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.698926 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jf2\" (UniqueName: \"kubernetes.io/projected/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe-kube-api-access-88jf2\") pod \"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe\" (UID: \"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe\") " Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.705633 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe-kube-api-access-88jf2" (OuterVolumeSpecName: "kube-api-access-88jf2") pod "b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" (UID: "b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe"). InnerVolumeSpecName "kube-api-access-88jf2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.743576 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.800474 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-88jf2\" (UniqueName: \"kubernetes.io/projected/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe-kube-api-access-88jf2\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.902128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pddq4\" (UniqueName: \"kubernetes.io/projected/f228d7fc-351a-4ecf-b21a-6728a6a61e55-kube-api-access-pddq4\") pod \"f228d7fc-351a-4ecf-b21a-6728a6a61e55\" (UID: \"f228d7fc-351a-4ecf-b21a-6728a6a61e55\") " Nov 21 14:13:29 crc kubenswrapper[4769]: I1121 14:13:29.908586 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f228d7fc-351a-4ecf-b21a-6728a6a61e55-kube-api-access-pddq4" (OuterVolumeSpecName: "kube-api-access-pddq4") pod "f228d7fc-351a-4ecf-b21a-6728a6a61e55" (UID: "f228d7fc-351a-4ecf-b21a-6728a6a61e55"). InnerVolumeSpecName "kube-api-access-pddq4". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.004170 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pddq4\" (UniqueName: \"kubernetes.io/projected/f228d7fc-351a-4ecf-b21a-6728a6a61e55-kube-api-access-pddq4\") on node \"crc\" DevicePath \"\"" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.303421 4769 generic.go:334] "Generic (PLEG): container finished" podID="f228d7fc-351a-4ecf-b21a-6728a6a61e55" containerID="10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de" exitCode=0 Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.303556 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.303577 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" event={"ID":"f228d7fc-351a-4ecf-b21a-6728a6a61e55","Type":"ContainerDied","Data":"10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de"} Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.303674 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-b2fcv" event={"ID":"f228d7fc-351a-4ecf-b21a-6728a6a61e55","Type":"ContainerDied","Data":"08e7a25bbacee5d4a2b23d941336dee2c66c71a95173aeb06445c2c0860dbd57"} Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.303710 4769 scope.go:117] "RemoveContainer" containerID="10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.306313 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" event={"ID":"b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe","Type":"ContainerDied","Data":"f89f721f14e7c1201ff5c4f14aa882f635105db395c97602ccfb9c1a8109d335"} Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.306400 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.326776 4769 scope.go:117] "RemoveContainer" containerID="10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de" Nov 21 14:13:30 crc kubenswrapper[4769]: E1121 14:13:30.327297 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de\": container with ID starting with 10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de not found: ID does not exist" containerID="10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.327328 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de"} err="failed to get container status \"10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de\": rpc error: code = NotFound desc = could not find container \"10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de\": container with ID starting with 10961accd7ce1fb3716e83bfd2307dec2f2ff5b1e68836421921e734ba6851de not found: ID does not exist" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.327348 4769 scope.go:117] "RemoveContainer" containerID="043cc7886fa5a7458bd508b7eb71bbb8401a3dbf22d766f358b8556071195fff" Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.337096 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-b2fcv"] Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.350891 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-b2fcv"] Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.361364 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x"] Nov 21 14:13:30 crc kubenswrapper[4769]: I1121 14:13:30.370921 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-nqw6x"] Nov 21 14:13:31 crc kubenswrapper[4769]: I1121 14:13:31.293346 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="291f2275-608b-4bf9-b27f-1726bd790e66" path="/var/lib/kubelet/pods/291f2275-608b-4bf9-b27f-1726bd790e66/volumes" Nov 21 14:13:31 crc kubenswrapper[4769]: I1121 14:13:31.294734 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" path="/var/lib/kubelet/pods/b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe/volumes" Nov 21 14:13:31 crc kubenswrapper[4769]: I1121 14:13:31.295767 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f228d7fc-351a-4ecf-b21a-6728a6a61e55" path="/var/lib/kubelet/pods/f228d7fc-351a-4ecf-b21a-6728a6a61e55/volumes" Nov 21 14:13:41 crc kubenswrapper[4769]: I1121 14:13:41.326846 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:13:41 crc kubenswrapper[4769]: I1121 14:13:41.327573 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:14:11 crc kubenswrapper[4769]: I1121 14:14:11.325542 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:14:11 crc kubenswrapper[4769]: I1121 14:14:11.326505 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.131704 4769 scope.go:117] "RemoveContainer" containerID="63297e3cb05292fd04a0f35f3b765da200e632ad4001133a737caa2ee2b3f824" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.165826 4769 scope.go:117] "RemoveContainer" containerID="0e6318fdbb49abf620cf6d02190f86f2bfb3aa49e8079c77e3e202cd67dd9d8c" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.187974 4769 scope.go:117] "RemoveContainer" containerID="75c404eeb3577fb62b1c0c13dfeb5ea7561711aa0bfbc3daaf54126de43bc396" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.207358 4769 scope.go:117] "RemoveContainer" containerID="b57031a21f523e830cf90b59c4372ed328d3b2edae5c28903a77490d7bc957e7" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.225270 4769 scope.go:117] "RemoveContainer" containerID="5071080adb290d5b8a0413a95dac95c99ca1eecbe2b55012599bf38e435e4d56" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.256864 4769 scope.go:117] "RemoveContainer" containerID="0665530dd94e6f4eb211e465b9a80bc847a8cef6853a73b73265dee7598811d5" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.289870 4769 scope.go:117] "RemoveContainer" containerID="37ffcd01ad1d2c3497630a50efc364bb43a62489f64cbb2b987ed22138ca93e6" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.310985 4769 scope.go:117] "RemoveContainer" containerID="acac31dff436092e8b3375f4dddf14b212db5da1e53ec81b741be53516839e13" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.332629 4769 scope.go:117] "RemoveContainer" containerID="5a4dd514a56e1160d042ab4b3d4577bf339d2e8b791e3164b623a5367ab6804d" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.354888 4769 scope.go:117] "RemoveContainer" containerID="aff0972c125f81171ed2e0c9cc9ffe89e72bfd3c66bd8a13d941d5d590d75292" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.369951 4769 scope.go:117] "RemoveContainer" containerID="ad8c684ae3d6ffa83080ca4d5decb275e2c8cc3e2e37a196453d0dcc9d1904b1" Nov 21 14:14:15 crc kubenswrapper[4769]: I1121 14:14:15.384095 4769 scope.go:117] "RemoveContainer" containerID="1eb38863406eba488c1240082acea9e6a766b4307213db4366ef2c5b38914922" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.910772 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-spl6n"] Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912441 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912470 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912515 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34682385-33d5-43f5-a2e8-c37c79018563" containerName="setup-container" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912529 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34682385-33d5-43f5-a2e8-c37c79018563" containerName="setup-container" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912560 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912574 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912591 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="extract-content" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912603 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="extract-content" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912620 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f228d7fc-351a-4ecf-b21a-6728a6a61e55" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912637 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f228d7fc-351a-4ecf-b21a-6728a6a61e55" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912659 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912671 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912687 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912703 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.912729 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.912743 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919251 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919302 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919365 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="212cd945-e227-48e4-8603-d94516cc64bb" containerName="mariadb-account-delete" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919381 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="212cd945-e227-48e4-8603-d94516cc64bb" containerName="mariadb-account-delete" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919413 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" containerName="mysql-bootstrap" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919430 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" containerName="mysql-bootstrap" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919464 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ac408e3a-fd62-40f9-831b-03a452f1643b" containerName="keystone-api" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919479 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac408e3a-fd62-40f9-831b-03a452f1643b" containerName="keystone-api" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919527 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerName="mysql-bootstrap" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919544 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerName="mysql-bootstrap" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919573 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919591 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919630 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="mysql-bootstrap" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919668 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="mysql-bootstrap" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919699 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919717 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919737 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34682385-33d5-43f5-a2e8-c37c79018563" containerName="rabbitmq" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919751 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34682385-33d5-43f5-a2e8-c37c79018563" containerName="rabbitmq" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919780 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="extract-utilities" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919796 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="extract-utilities" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919816 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="205da75e-a431-4a06-9ead-aa1edb28adec" containerName="memcached" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919829 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="205da75e-a431-4a06-9ead-aa1edb28adec" containerName="memcached" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919849 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919863 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919884 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919899 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919925 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="98bbc633-5f13-477d-bf2e-f570cc47dd2c" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919940 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="98bbc633-5f13-477d-bf2e-f570cc47dd2c" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.919969 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" containerName="operator" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.919985 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" containerName="operator" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.920015 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920032 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: E1121 14:14:28.920051 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe484179-2b98-449e-8814-79bb6c355580" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920063 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe484179-2b98-449e-8814-79bb6c355580" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920488 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="98bbc633-5f13-477d-bf2e-f570cc47dd2c" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920552 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920579 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe484179-2b98-449e-8814-79bb6c355580" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920599 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0db533af-bc36-4291-b534-fb527a971069" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920626 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34682385-33d5-43f5-a2e8-c37c79018563" containerName="rabbitmq" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920646 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="fdcf3b8a-976d-43c3-a6c9-a1498621f4e7" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920666 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920685 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c06ed331-7617-4e78-9973-84e0c6edead2" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920704 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="ac408e3a-fd62-40f9-831b-03a452f1643b" containerName="keystone-api" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920717 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920735 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="9190629b-7fad-49f0-98aa-fcb76d135b26" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920750 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6d071296-47be-4154-b14c-95b3441b36fc" containerName="manager" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920766 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f1191c0e-93c8-4dc2-8e86-733cbc6976cc" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920788 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="212cd945-e227-48e4-8603-d94516cc64bb" containerName="mariadb-account-delete" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920813 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="f228d7fc-351a-4ecf-b21a-6728a6a61e55" containerName="registry-server" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920838 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b5b9d1e1-ee4c-4a6d-b0fa-d37ff6392ebe" containerName="operator" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920856 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4e6cd448-bb7a-42a8-8d9b-fde328121f50" containerName="kube-rbac-proxy" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920872 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a07bb3ef-555a-4a18-a263-a0aca7beaa72" containerName="galera" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.920890 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="205da75e-a431-4a06-9ead-aa1edb28adec" containerName="memcached" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.921743 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-spl6n"] Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.921940 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.926173 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-index-dockercfg-5tgr8" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.926263 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Nov 21 14:14:28 crc kubenswrapper[4769]: I1121 14:14:28.926617 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.091362 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ph2\" (UniqueName: \"kubernetes.io/projected/b7bbc302-feef-49ce-8821-39e28428f073-kube-api-access-92ph2\") pod \"mariadb-operator-index-spl6n\" (UID: \"b7bbc302-feef-49ce-8821-39e28428f073\") " pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.193022 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-92ph2\" (UniqueName: \"kubernetes.io/projected/b7bbc302-feef-49ce-8821-39e28428f073-kube-api-access-92ph2\") pod \"mariadb-operator-index-spl6n\" (UID: \"b7bbc302-feef-49ce-8821-39e28428f073\") " pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.217266 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ph2\" (UniqueName: \"kubernetes.io/projected/b7bbc302-feef-49ce-8821-39e28428f073-kube-api-access-92ph2\") pod \"mariadb-operator-index-spl6n\" (UID: \"b7bbc302-feef-49ce-8821-39e28428f073\") " pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.255704 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.316579 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-spl6n"] Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.485638 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-index-fcqk6"] Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.486574 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.496806 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-fcqk6"] Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.601006 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wd9q\" (UniqueName: \"kubernetes.io/projected/d5b00e86-28c2-4430-8d7d-3c475c4a2c05-kube-api-access-5wd9q\") pod \"mariadb-operator-index-fcqk6\" (UID: \"d5b00e86-28c2-4430-8d7d-3c475c4a2c05\") " pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.702309 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5wd9q\" (UniqueName: \"kubernetes.io/projected/d5b00e86-28c2-4430-8d7d-3c475c4a2c05-kube-api-access-5wd9q\") pod \"mariadb-operator-index-fcqk6\" (UID: \"d5b00e86-28c2-4430-8d7d-3c475c4a2c05\") " pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.723947 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wd9q\" (UniqueName: \"kubernetes.io/projected/d5b00e86-28c2-4430-8d7d-3c475c4a2c05-kube-api-access-5wd9q\") pod \"mariadb-operator-index-fcqk6\" (UID: \"d5b00e86-28c2-4430-8d7d-3c475c4a2c05\") " pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.797955 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-spl6n"] Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.811583 4769 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.811805 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:29 crc kubenswrapper[4769]: I1121 14:14:29.890064 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-spl6n" event={"ID":"b7bbc302-feef-49ce-8821-39e28428f073","Type":"ContainerStarted","Data":"4c259ec51e1adcdac1d593e4173c2d062e17442a13d8ebfbb711a3466a0acad3"} Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.116973 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-index-fcqk6"] Nov 21 14:14:30 crc kubenswrapper[4769]: W1121 14:14:30.123749 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b00e86_28c2_4430_8d7d_3c475c4a2c05.slice/crio-9e1b46fa23a1ab267b7afceb9f4fce3d854134d0eb7a2a6815e43c803ee53b06 WatchSource:0}: Error finding container 9e1b46fa23a1ab267b7afceb9f4fce3d854134d0eb7a2a6815e43c803ee53b06: Status 404 returned error can't find the container with id 9e1b46fa23a1ab267b7afceb9f4fce3d854134d0eb7a2a6815e43c803ee53b06 Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.904382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-fcqk6" event={"ID":"d5b00e86-28c2-4430-8d7d-3c475c4a2c05","Type":"ContainerStarted","Data":"f25ea84aa913ac8a06f9a8bb5ef66e3dfbfd135c092433a131826d50d704fc36"} Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.905102 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-fcqk6" event={"ID":"d5b00e86-28c2-4430-8d7d-3c475c4a2c05","Type":"ContainerStarted","Data":"9e1b46fa23a1ab267b7afceb9f4fce3d854134d0eb7a2a6815e43c803ee53b06"} Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.907620 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-spl6n" event={"ID":"b7bbc302-feef-49ce-8821-39e28428f073","Type":"ContainerStarted","Data":"ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477"} Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.907898 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/mariadb-operator-index-spl6n" podUID="b7bbc302-feef-49ce-8821-39e28428f073" containerName="registry-server" containerID="cri-o://ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477" gracePeriod=2 Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.943929 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-fcqk6" podStartSLOduration=1.511851537 podStartE2EDuration="1.943904931s" podCreationTimestamp="2025-11-21 14:14:29 +0000 UTC" firstStartedPulling="2025-11-21 14:14:30.126598217 +0000 UTC m=+8628.827260035" lastFinishedPulling="2025-11-21 14:14:30.558651581 +0000 UTC m=+8629.259313429" observedRunningTime="2025-11-21 14:14:30.941285971 +0000 UTC m=+8629.641947799" watchObservedRunningTime="2025-11-21 14:14:30.943904931 +0000 UTC m=+8629.644566769" Nov 21 14:14:30 crc kubenswrapper[4769]: I1121 14:14:30.969286 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-index-spl6n" podStartSLOduration=2.490265919 podStartE2EDuration="2.96926136s" podCreationTimestamp="2025-11-21 14:14:28 +0000 UTC" firstStartedPulling="2025-11-21 14:14:29.811121856 +0000 UTC m=+8628.511783714" lastFinishedPulling="2025-11-21 14:14:30.290117327 +0000 UTC m=+8628.990779155" observedRunningTime="2025-11-21 14:14:30.958610965 +0000 UTC m=+8629.659272813" watchObservedRunningTime="2025-11-21 14:14:30.96926136 +0000 UTC m=+8629.669923188" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.413311 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.542849 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92ph2\" (UniqueName: \"kubernetes.io/projected/b7bbc302-feef-49ce-8821-39e28428f073-kube-api-access-92ph2\") pod \"b7bbc302-feef-49ce-8821-39e28428f073\" (UID: \"b7bbc302-feef-49ce-8821-39e28428f073\") " Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.550840 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7bbc302-feef-49ce-8821-39e28428f073-kube-api-access-92ph2" (OuterVolumeSpecName: "kube-api-access-92ph2") pod "b7bbc302-feef-49ce-8821-39e28428f073" (UID: "b7bbc302-feef-49ce-8821-39e28428f073"). InnerVolumeSpecName "kube-api-access-92ph2". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.647357 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-92ph2\" (UniqueName: \"kubernetes.io/projected/b7bbc302-feef-49ce-8821-39e28428f073-kube-api-access-92ph2\") on node \"crc\" DevicePath \"\"" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.924467 4769 generic.go:334] "Generic (PLEG): container finished" podID="b7bbc302-feef-49ce-8821-39e28428f073" containerID="ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477" exitCode=0 Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.924598 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-index-spl6n" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.924570 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-spl6n" event={"ID":"b7bbc302-feef-49ce-8821-39e28428f073","Type":"ContainerDied","Data":"ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477"} Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.925083 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-index-spl6n" event={"ID":"b7bbc302-feef-49ce-8821-39e28428f073","Type":"ContainerDied","Data":"4c259ec51e1adcdac1d593e4173c2d062e17442a13d8ebfbb711a3466a0acad3"} Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.925130 4769 scope.go:117] "RemoveContainer" containerID="ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.975005 4769 scope.go:117] "RemoveContainer" containerID="ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477" Nov 21 14:14:31 crc kubenswrapper[4769]: E1121 14:14:31.975874 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477\": container with ID starting with ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477 not found: ID does not exist" containerID="ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.975963 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477"} err="failed to get container status \"ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477\": rpc error: code = NotFound desc = could not find container \"ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477\": container with ID starting with ee6e6a1b365906e3eb2f86942c8c5ef5e7b7820a20bcb4fc55fdaf81fe7bc477 not found: ID does not exist" Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.984160 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/mariadb-operator-index-spl6n"] Nov 21 14:14:31 crc kubenswrapper[4769]: I1121 14:14:31.993225 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/mariadb-operator-index-spl6n"] Nov 21 14:14:33 crc kubenswrapper[4769]: I1121 14:14:33.292019 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7bbc302-feef-49ce-8821-39e28428f073" path="/var/lib/kubelet/pods/b7bbc302-feef-49ce-8821-39e28428f073/volumes" Nov 21 14:14:35 crc kubenswrapper[4769]: I1121 14:14:35.943121 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457"] Nov 21 14:14:35 crc kubenswrapper[4769]: E1121 14:14:35.944045 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b7bbc302-feef-49ce-8821-39e28428f073" containerName="registry-server" Nov 21 14:14:35 crc kubenswrapper[4769]: I1121 14:14:35.944068 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bbc302-feef-49ce-8821-39e28428f073" containerName="registry-server" Nov 21 14:14:35 crc kubenswrapper[4769]: I1121 14:14:35.944327 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="b7bbc302-feef-49ce-8821-39e28428f073" containerName="registry-server" Nov 21 14:14:35 crc kubenswrapper[4769]: I1121 14:14:35.945725 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:35 crc kubenswrapper[4769]: I1121 14:14:35.954301 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 14:14:35 crc kubenswrapper[4769]: I1121 14:14:35.968499 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457"] Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.030240 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.030370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.030437 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gn44\" (UniqueName: \"kubernetes.io/projected/820b4de3-05e9-4edf-9fc3-06383f08d8ac-kube-api-access-7gn44\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.132904 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.133470 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.133703 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7gn44\" (UniqueName: \"kubernetes.io/projected/820b4de3-05e9-4edf-9fc3-06383f08d8ac-kube-api-access-7gn44\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.133603 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-util\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.134490 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-bundle\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.158239 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gn44\" (UniqueName: \"kubernetes.io/projected/820b4de3-05e9-4edf-9fc3-06383f08d8ac-kube-api-access-7gn44\") pod \"7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.286876 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.546853 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457"] Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.973387 4769 generic.go:334] "Generic (PLEG): container finished" podID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerID="b5108ba6d01d7f04b2b41c104e2e1c1094fb91a65d7fdf56316d5225be79faac" exitCode=0 Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.973458 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" event={"ID":"820b4de3-05e9-4edf-9fc3-06383f08d8ac","Type":"ContainerDied","Data":"b5108ba6d01d7f04b2b41c104e2e1c1094fb91a65d7fdf56316d5225be79faac"} Nov 21 14:14:36 crc kubenswrapper[4769]: I1121 14:14:36.973791 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" event={"ID":"820b4de3-05e9-4edf-9fc3-06383f08d8ac","Type":"ContainerStarted","Data":"01824b19e37e8b9c4099abb80c34160f0ee8b08b01a076e606b0532e8104a961"} Nov 21 14:14:37 crc kubenswrapper[4769]: I1121 14:14:37.983640 4769 generic.go:334] "Generic (PLEG): container finished" podID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerID="f5eba6e91bdc20fd9630bfb87e272214b86260670fc5f64461b536d6d3d72c47" exitCode=0 Nov 21 14:14:37 crc kubenswrapper[4769]: I1121 14:14:37.983743 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" event={"ID":"820b4de3-05e9-4edf-9fc3-06383f08d8ac","Type":"ContainerDied","Data":"f5eba6e91bdc20fd9630bfb87e272214b86260670fc5f64461b536d6d3d72c47"} Nov 21 14:14:38 crc kubenswrapper[4769]: I1121 14:14:38.996747 4769 generic.go:334] "Generic (PLEG): container finished" podID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerID="875c11deeb695cedfd5531efaa12c0d78aa8d3f385ab1b5299f1b88a20be2e9c" exitCode=0 Nov 21 14:14:38 crc kubenswrapper[4769]: I1121 14:14:38.996824 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" event={"ID":"820b4de3-05e9-4edf-9fc3-06383f08d8ac","Type":"ContainerDied","Data":"875c11deeb695cedfd5531efaa12c0d78aa8d3f385ab1b5299f1b88a20be2e9c"} Nov 21 14:14:39 crc kubenswrapper[4769]: I1121 14:14:39.812721 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:39 crc kubenswrapper[4769]: I1121 14:14:39.813050 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:39 crc kubenswrapper[4769]: I1121 14:14:39.836550 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.045054 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-index-fcqk6" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.363675 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.509070 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gn44\" (UniqueName: \"kubernetes.io/projected/820b4de3-05e9-4edf-9fc3-06383f08d8ac-kube-api-access-7gn44\") pod \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.509128 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-util\") pod \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.509174 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-bundle\") pod \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\" (UID: \"820b4de3-05e9-4edf-9fc3-06383f08d8ac\") " Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.510573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-bundle" (OuterVolumeSpecName: "bundle") pod "820b4de3-05e9-4edf-9fc3-06383f08d8ac" (UID: "820b4de3-05e9-4edf-9fc3-06383f08d8ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.515248 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820b4de3-05e9-4edf-9fc3-06383f08d8ac-kube-api-access-7gn44" (OuterVolumeSpecName: "kube-api-access-7gn44") pod "820b4de3-05e9-4edf-9fc3-06383f08d8ac" (UID: "820b4de3-05e9-4edf-9fc3-06383f08d8ac"). InnerVolumeSpecName "kube-api-access-7gn44". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.539685 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-util" (OuterVolumeSpecName: "util") pod "820b4de3-05e9-4edf-9fc3-06383f08d8ac" (UID: "820b4de3-05e9-4edf-9fc3-06383f08d8ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.610554 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7gn44\" (UniqueName: \"kubernetes.io/projected/820b4de3-05e9-4edf-9fc3-06383f08d8ac-kube-api-access-7gn44\") on node \"crc\" DevicePath \"\"" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.610595 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-util\") on node \"crc\" DevicePath \"\"" Nov 21 14:14:40 crc kubenswrapper[4769]: I1121 14:14:40.610607 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/820b4de3-05e9-4edf-9fc3-06383f08d8ac-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.013834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" event={"ID":"820b4de3-05e9-4edf-9fc3-06383f08d8ac","Type":"ContainerDied","Data":"01824b19e37e8b9c4099abb80c34160f0ee8b08b01a076e606b0532e8104a961"} Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.013887 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01824b19e37e8b9c4099abb80c34160f0ee8b08b01a076e606b0532e8104a961" Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.013854 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/7abe4676e9c7174a0976b528ff13527e30f787694a732dea185c78a27ctz457" Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.325798 4769 patch_prober.go:28] interesting pod/machine-config-daemon-fm7pk container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.325885 4769 prober.go:107] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.325941 4769 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.326558 4769 kuberuntime_manager.go:1027] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20"} pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Nov 21 14:14:41 crc kubenswrapper[4769]: I1121 14:14:41.326629 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerName="machine-config-daemon" containerID="cri-o://51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" gracePeriod=600 Nov 21 14:14:41 crc kubenswrapper[4769]: E1121 14:14:41.451449 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:14:42 crc kubenswrapper[4769]: I1121 14:14:42.023402 4769 generic.go:334] "Generic (PLEG): container finished" podID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" exitCode=0 Nov 21 14:14:42 crc kubenswrapper[4769]: I1121 14:14:42.023451 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerDied","Data":"51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20"} Nov 21 14:14:42 crc kubenswrapper[4769]: I1121 14:14:42.023502 4769 scope.go:117] "RemoveContainer" containerID="8a3c12edaef58dbb0baec2cd2e286860462f129cfe3eba87192f0930a8f703a2" Nov 21 14:14:42 crc kubenswrapper[4769]: I1121 14:14:42.024179 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:14:42 crc kubenswrapper[4769]: E1121 14:14:42.024749 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.455858 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t"] Nov 21 14:14:46 crc kubenswrapper[4769]: E1121 14:14:46.456537 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="util" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.456549 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="util" Nov 21 14:14:46 crc kubenswrapper[4769]: E1121 14:14:46.456564 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="pull" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.456571 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="pull" Nov 21 14:14:46 crc kubenswrapper[4769]: E1121 14:14:46.456588 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="extract" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.456593 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="extract" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.456716 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="820b4de3-05e9-4edf-9fc3-06383f08d8ac" containerName="extract" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.457369 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.460774 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-service-cert" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.461145 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"mariadb-operator-controller-manager-dockercfg-8pb8b" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.461398 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"webhook-server-cert" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.468919 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t"] Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.629264 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41947576-b047-4f6a-b475-032859b8f52f-webhook-cert\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.629338 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bssv9\" (UniqueName: \"kubernetes.io/projected/41947576-b047-4f6a-b475-032859b8f52f-kube-api-access-bssv9\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.629370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41947576-b047-4f6a-b475-032859b8f52f-apiservice-cert\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.731426 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41947576-b047-4f6a-b475-032859b8f52f-webhook-cert\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.731654 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bssv9\" (UniqueName: \"kubernetes.io/projected/41947576-b047-4f6a-b475-032859b8f52f-kube-api-access-bssv9\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.732452 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41947576-b047-4f6a-b475-032859b8f52f-apiservice-cert\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.738169 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41947576-b047-4f6a-b475-032859b8f52f-webhook-cert\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.738461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41947576-b047-4f6a-b475-032859b8f52f-apiservice-cert\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.753552 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bssv9\" (UniqueName: \"kubernetes.io/projected/41947576-b047-4f6a-b475-032859b8f52f-kube-api-access-bssv9\") pod \"mariadb-operator-controller-manager-5bc5b745f9-tl64t\" (UID: \"41947576-b047-4f6a-b475-032859b8f52f\") " pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:46 crc kubenswrapper[4769]: I1121 14:14:46.774332 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:47 crc kubenswrapper[4769]: I1121 14:14:47.042849 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t"] Nov 21 14:14:47 crc kubenswrapper[4769]: W1121 14:14:47.060671 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41947576_b047_4f6a_b475_032859b8f52f.slice/crio-a733b85e1b6f16dfd43700f04c70841d4e8b86ef4c006cec26649bc1c3c7e35f WatchSource:0}: Error finding container a733b85e1b6f16dfd43700f04c70841d4e8b86ef4c006cec26649bc1c3c7e35f: Status 404 returned error can't find the container with id a733b85e1b6f16dfd43700f04c70841d4e8b86ef4c006cec26649bc1c3c7e35f Nov 21 14:14:48 crc kubenswrapper[4769]: I1121 14:14:48.067127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" event={"ID":"41947576-b047-4f6a-b475-032859b8f52f","Type":"ContainerStarted","Data":"17f1b1a60059b64f715dbee1ee04f75c25c0db84b39b039b86c4dcd2e071d8b7"} Nov 21 14:14:48 crc kubenswrapper[4769]: I1121 14:14:48.067739 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" event={"ID":"41947576-b047-4f6a-b475-032859b8f52f","Type":"ContainerStarted","Data":"b9fd4d9dab72d472d11a22581289b79772816e323754d9a918de1baab3fbe8fd"} Nov 21 14:14:48 crc kubenswrapper[4769]: I1121 14:14:48.067764 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:48 crc kubenswrapper[4769]: I1121 14:14:48.067776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" event={"ID":"41947576-b047-4f6a-b475-032859b8f52f","Type":"ContainerStarted","Data":"a733b85e1b6f16dfd43700f04c70841d4e8b86ef4c006cec26649bc1c3c7e35f"} Nov 21 14:14:48 crc kubenswrapper[4769]: I1121 14:14:48.090502 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" podStartSLOduration=2.090473284 podStartE2EDuration="2.090473284s" podCreationTimestamp="2025-11-21 14:14:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:14:48.086839037 +0000 UTC m=+8646.787500865" watchObservedRunningTime="2025-11-21 14:14:48.090473284 +0000 UTC m=+8646.791135112" Nov 21 14:14:56 crc kubenswrapper[4769]: I1121 14:14:56.781276 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-5bc5b745f9-tl64t" Nov 21 14:14:57 crc kubenswrapper[4769]: I1121 14:14:57.274641 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:14:57 crc kubenswrapper[4769]: E1121 14:14:57.275151 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.136351 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz"] Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.138578 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.142576 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operator-lifecycle-manager"/"collect-profiles-dockercfg-kzf4t" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.144431 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operator-lifecycle-manager"/"collect-profiles-config" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.146835 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz"] Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.189037 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8cb61875-aa65-4c3a-8b17-a42825b8e87b-secret-volume\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.189136 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkjgb\" (UniqueName: \"kubernetes.io/projected/8cb61875-aa65-4c3a-8b17-a42825b8e87b-kube-api-access-dkjgb\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.189207 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb61875-aa65-4c3a-8b17-a42825b8e87b-config-volume\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.290686 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dkjgb\" (UniqueName: \"kubernetes.io/projected/8cb61875-aa65-4c3a-8b17-a42825b8e87b-kube-api-access-dkjgb\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.290741 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb61875-aa65-4c3a-8b17-a42825b8e87b-config-volume\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.290836 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8cb61875-aa65-4c3a-8b17-a42825b8e87b-secret-volume\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.291789 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb61875-aa65-4c3a-8b17-a42825b8e87b-config-volume\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.296994 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8cb61875-aa65-4c3a-8b17-a42825b8e87b-secret-volume\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.316212 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkjgb\" (UniqueName: \"kubernetes.io/projected/8cb61875-aa65-4c3a-8b17-a42825b8e87b-kube-api-access-dkjgb\") pod \"collect-profiles-29395575-btbsz\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.504983 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:00 crc kubenswrapper[4769]: I1121 14:15:00.958660 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz"] Nov 21 14:15:01 crc kubenswrapper[4769]: I1121 14:15:01.208718 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" event={"ID":"8cb61875-aa65-4c3a-8b17-a42825b8e87b","Type":"ContainerStarted","Data":"c2045499b812355ef5c4518a2371670b6031db9282801f84cfe0e7271e62f08f"} Nov 21 14:15:01 crc kubenswrapper[4769]: I1121 14:15:01.208786 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" event={"ID":"8cb61875-aa65-4c3a-8b17-a42825b8e87b","Type":"ContainerStarted","Data":"c35b11ffbc09d7628b59fa34c12df71adcee4a3aca80ff1f968faa4b84cb7277"} Nov 21 14:15:01 crc kubenswrapper[4769]: I1121 14:15:01.224667 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" podStartSLOduration=1.224639872 podStartE2EDuration="1.224639872s" podCreationTimestamp="2025-11-21 14:15:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:01.222949147 +0000 UTC m=+8659.923610985" watchObservedRunningTime="2025-11-21 14:15:01.224639872 +0000 UTC m=+8659.925301700" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.173800 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-bsmfg"] Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.174914 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.178290 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-index-dockercfg-n6z8z" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.194015 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-bsmfg"] Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.224255 4769 generic.go:334] "Generic (PLEG): container finished" podID="8cb61875-aa65-4c3a-8b17-a42825b8e87b" containerID="c2045499b812355ef5c4518a2371670b6031db9282801f84cfe0e7271e62f08f" exitCode=0 Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.224323 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" event={"ID":"8cb61875-aa65-4c3a-8b17-a42825b8e87b","Type":"ContainerDied","Data":"c2045499b812355ef5c4518a2371670b6031db9282801f84cfe0e7271e62f08f"} Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.226079 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5g48\" (UniqueName: \"kubernetes.io/projected/4330167a-ce8f-4e98-9c3e-4734910962cf-kube-api-access-h5g48\") pod \"infra-operator-index-bsmfg\" (UID: \"4330167a-ce8f-4e98-9c3e-4734910962cf\") " pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.328296 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h5g48\" (UniqueName: \"kubernetes.io/projected/4330167a-ce8f-4e98-9c3e-4734910962cf-kube-api-access-h5g48\") pod \"infra-operator-index-bsmfg\" (UID: \"4330167a-ce8f-4e98-9c3e-4734910962cf\") " pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.361179 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5g48\" (UniqueName: \"kubernetes.io/projected/4330167a-ce8f-4e98-9c3e-4734910962cf-kube-api-access-h5g48\") pod \"infra-operator-index-bsmfg\" (UID: \"4330167a-ce8f-4e98-9c3e-4734910962cf\") " pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.510965 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:02 crc kubenswrapper[4769]: I1121 14:15:02.998331 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-bsmfg"] Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.247325 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-bsmfg" event={"ID":"4330167a-ce8f-4e98-9c3e-4734910962cf","Type":"ContainerStarted","Data":"c0b6ec1d34a6ffd6ffc18e25285ceedc3132aca263ebff45f7139d63ece00a17"} Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.596593 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.652238 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb61875-aa65-4c3a-8b17-a42825b8e87b-config-volume\") pod \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.652384 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8cb61875-aa65-4c3a-8b17-a42825b8e87b-secret-volume\") pod \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.652507 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkjgb\" (UniqueName: \"kubernetes.io/projected/8cb61875-aa65-4c3a-8b17-a42825b8e87b-kube-api-access-dkjgb\") pod \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\" (UID: \"8cb61875-aa65-4c3a-8b17-a42825b8e87b\") " Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.653541 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cb61875-aa65-4c3a-8b17-a42825b8e87b-config-volume" (OuterVolumeSpecName: "config-volume") pod "8cb61875-aa65-4c3a-8b17-a42825b8e87b" (UID: "8cb61875-aa65-4c3a-8b17-a42825b8e87b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.660497 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb61875-aa65-4c3a-8b17-a42825b8e87b-kube-api-access-dkjgb" (OuterVolumeSpecName: "kube-api-access-dkjgb") pod "8cb61875-aa65-4c3a-8b17-a42825b8e87b" (UID: "8cb61875-aa65-4c3a-8b17-a42825b8e87b"). InnerVolumeSpecName "kube-api-access-dkjgb". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.663433 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cb61875-aa65-4c3a-8b17-a42825b8e87b-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "8cb61875-aa65-4c3a-8b17-a42825b8e87b" (UID: "8cb61875-aa65-4c3a-8b17-a42825b8e87b"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.754322 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dkjgb\" (UniqueName: \"kubernetes.io/projected/8cb61875-aa65-4c3a-8b17-a42825b8e87b-kube-api-access-dkjgb\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.754376 4769 reconciler_common.go:293] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb61875-aa65-4c3a-8b17-a42825b8e87b-config-volume\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:03 crc kubenswrapper[4769]: I1121 14:15:03.754387 4769 reconciler_common.go:293] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/8cb61875-aa65-4c3a-8b17-a42825b8e87b-secret-volume\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.279466 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.280454 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29395575-btbsz" event={"ID":"8cb61875-aa65-4c3a-8b17-a42825b8e87b","Type":"ContainerDied","Data":"c35b11ffbc09d7628b59fa34c12df71adcee4a3aca80ff1f968faa4b84cb7277"} Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.280527 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c35b11ffbc09d7628b59fa34c12df71adcee4a3aca80ff1f968faa4b84cb7277" Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.285950 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-bsmfg" event={"ID":"4330167a-ce8f-4e98-9c3e-4734910962cf","Type":"ContainerStarted","Data":"8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16"} Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.318957 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-bsmfg" podStartSLOduration=1.8461383649999998 podStartE2EDuration="2.31893238s" podCreationTimestamp="2025-11-21 14:15:02 +0000 UTC" firstStartedPulling="2025-11-21 14:15:03.007535942 +0000 UTC m=+8661.708197760" lastFinishedPulling="2025-11-21 14:15:03.480329957 +0000 UTC m=+8662.180991775" observedRunningTime="2025-11-21 14:15:04.317995665 +0000 UTC m=+8663.018657493" watchObservedRunningTime="2025-11-21 14:15:04.31893238 +0000 UTC m=+8663.019594208" Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.333542 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r"] Nov 21 14:15:04 crc kubenswrapper[4769]: I1121 14:15:04.338003 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29395530-kr89r"] Nov 21 14:15:05 crc kubenswrapper[4769]: I1121 14:15:05.285891 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86515347-cf8b-47ee-b0b5-8f3cef8812bc" path="/var/lib/kubelet/pods/86515347-cf8b-47ee-b0b5-8f3cef8812bc/volumes" Nov 21 14:15:05 crc kubenswrapper[4769]: I1121 14:15:05.962831 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-bsmfg"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.299018 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/infra-operator-index-bsmfg" podUID="4330167a-ce8f-4e98-9c3e-4734910962cf" containerName="registry-server" containerID="cri-o://8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16" gracePeriod=2 Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.495223 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Nov 21 14:15:06 crc kubenswrapper[4769]: E1121 14:15:06.495554 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8cb61875-aa65-4c3a-8b17-a42825b8e87b" containerName="collect-profiles" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.495576 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb61875-aa65-4c3a-8b17-a42825b8e87b" containerName="collect-profiles" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.495756 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="8cb61875-aa65-4c3a-8b17-a42825b8e87b" containerName="collect-profiles" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.496525 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.499018 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"galera-openstack-dockercfg-jblnq" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.499258 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"kube-root-ca.crt" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.501753 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"openshift-service-ca.crt" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.521294 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"openstack-config-data" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.536156 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"openstack-scripts" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.544410 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.582322 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.585148 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.590767 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.594627 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.599544 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qgt\" (UniqueName: \"kubernetes.io/projected/37759c44-ad63-4746-b791-5eb32cd3f36f-kube-api-access-54qgt\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.599615 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/37759c44-ad63-4746-b791-5eb32cd3f36f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.599656 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.599863 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-config-data-default\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.600093 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.610786 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-kolla-config\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.610862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.624291 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.654969 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.656923 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.661145 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.661355 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712327 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-config-data-default\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712387 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712415 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0562d204-6213-47b0-8580-0f785bc7c9e0-config-data-generated\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712437 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-kolla-config\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712458 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712480 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-operator-scripts\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712497 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brxph\" (UniqueName: \"kubernetes.io/projected/0562d204-6213-47b0-8580-0f785bc7c9e0-kube-api-access-brxph\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712519 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2hvv\" (UniqueName: \"kubernetes.io/projected/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-kube-api-access-b2hvv\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712541 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712560 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/de98a8bc-229a-4720-88c3-fa70402cf66a-config-data-generated\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712575 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-config-data-default\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712593 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7wtv\" (UniqueName: \"kubernetes.io/projected/de98a8bc-229a-4720-88c3-fa70402cf66a-kube-api-access-z7wtv\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712614 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-config-data-default\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712634 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712656 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-54qgt\" (UniqueName: \"kubernetes.io/projected/37759c44-ad63-4746-b791-5eb32cd3f36f-kube-api-access-54qgt\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712680 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712716 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-operator-scripts\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712735 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/37759c44-ad63-4746-b791-5eb32cd3f36f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712759 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-kolla-config\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.712781 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-kolla-config\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.713513 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") device mount path \"/mnt/openstack/pv08\"" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.714172 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/37759c44-ad63-4746-b791-5eb32cd3f36f-config-data-generated\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.714501 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-kolla-config\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.715497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-operator-scripts\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.723932 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/37759c44-ad63-4746-b791-5eb32cd3f36f-config-data-default\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.732749 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qgt\" (UniqueName: \"kubernetes.io/projected/37759c44-ad63-4746-b791-5eb32cd3f36f-kube-api-access-54qgt\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.735315 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"openstack-galera-0\" (UID: \"37759c44-ad63-4746-b791-5eb32cd3f36f\") " pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.767672 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-index-whdr6"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.769954 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.779781 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-whdr6"] Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.806930 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-kolla-config\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814424 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjqc\" (UniqueName: \"kubernetes.io/projected/ef6806eb-bda2-47c4-abc5-5fc9def4d615-kube-api-access-wdjqc\") pod \"infra-operator-index-whdr6\" (UID: \"ef6806eb-bda2-47c4-abc5-5fc9def4d615\") " pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814477 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0562d204-6213-47b0-8580-0f785bc7c9e0-config-data-generated\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814509 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-operator-scripts\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814530 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-brxph\" (UniqueName: \"kubernetes.io/projected/0562d204-6213-47b0-8580-0f785bc7c9e0-kube-api-access-brxph\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814755 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hvv\" (UniqueName: \"kubernetes.io/projected/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-kube-api-access-b2hvv\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814852 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814895 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/de98a8bc-229a-4720-88c3-fa70402cf66a-config-data-generated\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-config-data-default\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.814951 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z7wtv\" (UniqueName: \"kubernetes.io/projected/de98a8bc-229a-4720-88c3-fa70402cf66a-kube-api-access-z7wtv\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815008 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-config-data-default\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815042 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815100 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815140 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815178 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-operator-scripts\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815310 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-kolla-config\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815563 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") device mount path \"/mnt/openstack/pv11\"" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.815993 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/de98a8bc-229a-4720-88c3-fa70402cf66a-config-data-generated\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.816437 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-kolla-config\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.817099 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-operator-scripts\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.817311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-kolla-config\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.817407 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") device mount path \"/mnt/openstack/pv15\"" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.829045 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-config-data-default\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.830860 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-util\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.832251 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/de98a8bc-229a-4720-88c3-fa70402cf66a-operator-scripts\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.833290 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/0562d204-6213-47b0-8580-0f785bc7c9e0-config-data-default\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.833373 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-bundle\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.834497 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/0562d204-6213-47b0-8580-0f785bc7c9e0-config-data-generated\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.838387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-brxph\" (UniqueName: \"kubernetes.io/projected/0562d204-6213-47b0-8580-0f785bc7c9e0-kube-api-access-brxph\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.841986 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7wtv\" (UniqueName: \"kubernetes.io/projected/de98a8bc-229a-4720-88c3-fa70402cf66a-kube-api-access-z7wtv\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.842589 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2hvv\" (UniqueName: \"kubernetes.io/projected/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-kube-api-access-b2hvv\") pod \"ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.844859 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"openstack-galera-1\" (UID: \"0562d204-6213-47b0-8580-0f785bc7c9e0\") " pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.847514 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.863586 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"openstack-galera-2\" (UID: \"de98a8bc-229a-4720-88c3-fa70402cf66a\") " pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.917325 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5g48\" (UniqueName: \"kubernetes.io/projected/4330167a-ce8f-4e98-9c3e-4734910962cf-kube-api-access-h5g48\") pod \"4330167a-ce8f-4e98-9c3e-4734910962cf\" (UID: \"4330167a-ce8f-4e98-9c3e-4734910962cf\") " Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.917715 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjqc\" (UniqueName: \"kubernetes.io/projected/ef6806eb-bda2-47c4-abc5-5fc9def4d615-kube-api-access-wdjqc\") pod \"infra-operator-index-whdr6\" (UID: \"ef6806eb-bda2-47c4-abc5-5fc9def4d615\") " pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.920067 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.925686 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4330167a-ce8f-4e98-9c3e-4734910962cf-kube-api-access-h5g48" (OuterVolumeSpecName: "kube-api-access-h5g48") pod "4330167a-ce8f-4e98-9c3e-4734910962cf" (UID: "4330167a-ce8f-4e98-9c3e-4734910962cf"). InnerVolumeSpecName "kube-api-access-h5g48". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.933922 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.938273 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjqc\" (UniqueName: \"kubernetes.io/projected/ef6806eb-bda2-47c4-abc5-5fc9def4d615-kube-api-access-wdjqc\") pod \"infra-operator-index-whdr6\" (UID: \"ef6806eb-bda2-47c4-abc5-5fc9def4d615\") " pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:06 crc kubenswrapper[4769]: I1121 14:15:06.987289 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.019727 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h5g48\" (UniqueName: \"kubernetes.io/projected/4330167a-ce8f-4e98-9c3e-4734910962cf-kube-api-access-h5g48\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.116156 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.293483 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-1"] Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.317118 4769 generic.go:334] "Generic (PLEG): container finished" podID="4330167a-ce8f-4e98-9c3e-4734910962cf" containerID="8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16" exitCode=0 Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.317402 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-index-bsmfg" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.317714 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-bsmfg" event={"ID":"4330167a-ce8f-4e98-9c3e-4734910962cf","Type":"ContainerDied","Data":"8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16"} Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.317799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-bsmfg" event={"ID":"4330167a-ce8f-4e98-9c3e-4734910962cf","Type":"ContainerDied","Data":"c0b6ec1d34a6ffd6ffc18e25285ceedc3132aca263ebff45f7139d63ece00a17"} Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.317821 4769 scope.go:117] "RemoveContainer" containerID="8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.328029 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"0562d204-6213-47b0-8580-0f785bc7c9e0","Type":"ContainerStarted","Data":"771295b20273b5805ab50b10ddc1c17883a1ed6805316a889024052fbf6f9bd8"} Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.334490 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-0"] Nov 21 14:15:07 crc kubenswrapper[4769]: W1121 14:15:07.337513 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37759c44_ad63_4746_b791_5eb32cd3f36f.slice/crio-fd52d5d7c0e1e7c31bbaeefde7bb50e40fdde1c2f43310c264bc3ea265bb965a WatchSource:0}: Error finding container fd52d5d7c0e1e7c31bbaeefde7bb50e40fdde1c2f43310c264bc3ea265bb965a: Status 404 returned error can't find the container with id fd52d5d7c0e1e7c31bbaeefde7bb50e40fdde1c2f43310c264bc3ea265bb965a Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.349054 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/infra-operator-index-bsmfg"] Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.352459 4769 scope.go:117] "RemoveContainer" containerID="8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16" Nov 21 14:15:07 crc kubenswrapper[4769]: E1121 14:15:07.353459 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16\": container with ID starting with 8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16 not found: ID does not exist" containerID="8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.353519 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16"} err="failed to get container status \"8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16\": rpc error: code = NotFound desc = could not find container \"8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16\": container with ID starting with 8a482a9478fce48f5b81324f0f64d4bdd4cbc03eb0451cad37aed195819d1a16 not found: ID does not exist" Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.353947 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/infra-operator-index-bsmfg"] Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.417728 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-index-whdr6"] Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.421516 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/openstack-galera-2"] Nov 21 14:15:07 crc kubenswrapper[4769]: W1121 14:15:07.426477 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde98a8bc_229a_4720_88c3_fa70402cf66a.slice/crio-77fc7ef8518e943c07d76116d4ed6b4336b7f54ce06fa2ad5cd9fd632da2a038 WatchSource:0}: Error finding container 77fc7ef8518e943c07d76116d4ed6b4336b7f54ce06fa2ad5cd9fd632da2a038: Status 404 returned error can't find the container with id 77fc7ef8518e943c07d76116d4ed6b4336b7f54ce06fa2ad5cd9fd632da2a038 Nov 21 14:15:07 crc kubenswrapper[4769]: W1121 14:15:07.429687 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6806eb_bda2_47c4_abc5_5fc9def4d615.slice/crio-66617c1b756871cf8d7e66015748a2605cee578144836c8938bc20a4bdc0e0ff WatchSource:0}: Error finding container 66617c1b756871cf8d7e66015748a2605cee578144836c8938bc20a4bdc0e0ff: Status 404 returned error can't find the container with id 66617c1b756871cf8d7e66015748a2605cee578144836c8938bc20a4bdc0e0ff Nov 21 14:15:07 crc kubenswrapper[4769]: I1121 14:15:07.515849 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd"] Nov 21 14:15:07 crc kubenswrapper[4769]: W1121 14:15:07.530864 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfae3b6_dcee_424d_87ce_7aaf1c9d59de.slice/crio-1e36acdcf07b190e44be52a254117203314aa04a0d9e182f6502c6f52bb9d74a WatchSource:0}: Error finding container 1e36acdcf07b190e44be52a254117203314aa04a0d9e182f6502c6f52bb9d74a: Status 404 returned error can't find the container with id 1e36acdcf07b190e44be52a254117203314aa04a0d9e182f6502c6f52bb9d74a Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.344556 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"0562d204-6213-47b0-8580-0f785bc7c9e0","Type":"ContainerStarted","Data":"ed49eef1c0761bf23ce67bbb43bb7e07d60bd99a36b5d860128f5cec795a10f8"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.347868 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"37759c44-ad63-4746-b791-5eb32cd3f36f","Type":"ContainerStarted","Data":"41e2a911b8b388401d174c55fd9c962c757d5f8466db54062f8121311331e624"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.347897 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"37759c44-ad63-4746-b791-5eb32cd3f36f","Type":"ContainerStarted","Data":"fd52d5d7c0e1e7c31bbaeefde7bb50e40fdde1c2f43310c264bc3ea265bb965a"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.351513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-whdr6" event={"ID":"ef6806eb-bda2-47c4-abc5-5fc9def4d615","Type":"ContainerStarted","Data":"e28c08985da6cc9aa71e09c9c33e98ce2b8a07fee200e72fbdbfc385f4c57dc5"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.351604 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-index-whdr6" event={"ID":"ef6806eb-bda2-47c4-abc5-5fc9def4d615","Type":"ContainerStarted","Data":"66617c1b756871cf8d7e66015748a2605cee578144836c8938bc20a4bdc0e0ff"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.359333 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerID="554014f1195d19844b22b5180c1b3e0ccd6ee7489f6c3cb234313d78c8482d8d" exitCode=0 Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.359847 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" event={"ID":"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de","Type":"ContainerDied","Data":"554014f1195d19844b22b5180c1b3e0ccd6ee7489f6c3cb234313d78c8482d8d"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.359944 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" event={"ID":"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de","Type":"ContainerStarted","Data":"1e36acdcf07b190e44be52a254117203314aa04a0d9e182f6502c6f52bb9d74a"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.362927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"de98a8bc-229a-4720-88c3-fa70402cf66a","Type":"ContainerStarted","Data":"790e3feb445a08ebf058dea70258c5f1135d2df48b935d3a30259fb507ab8b0d"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.363003 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"de98a8bc-229a-4720-88c3-fa70402cf66a","Type":"ContainerStarted","Data":"77fc7ef8518e943c07d76116d4ed6b4336b7f54ce06fa2ad5cd9fd632da2a038"} Nov 21 14:15:08 crc kubenswrapper[4769]: I1121 14:15:08.511819 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-index-whdr6" podStartSLOduration=1.893415943 podStartE2EDuration="2.511767636s" podCreationTimestamp="2025-11-21 14:15:06 +0000 UTC" firstStartedPulling="2025-11-21 14:15:07.434290024 +0000 UTC m=+8666.134951842" lastFinishedPulling="2025-11-21 14:15:08.052641697 +0000 UTC m=+8666.753303535" observedRunningTime="2025-11-21 14:15:08.503788072 +0000 UTC m=+8667.204449890" watchObservedRunningTime="2025-11-21 14:15:08.511767636 +0000 UTC m=+8667.212429464" Nov 21 14:15:09 crc kubenswrapper[4769]: I1121 14:15:09.273704 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:15:09 crc kubenswrapper[4769]: E1121 14:15:09.274024 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:15:09 crc kubenswrapper[4769]: I1121 14:15:09.282464 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4330167a-ce8f-4e98-9c3e-4734910962cf" path="/var/lib/kubelet/pods/4330167a-ce8f-4e98-9c3e-4734910962cf/volumes" Nov 21 14:15:09 crc kubenswrapper[4769]: I1121 14:15:09.372985 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerID="aea5f9349bc6954da93937838a44e7a7f71fc5b5cc4bc53deb8583d7b5142b4a" exitCode=0 Nov 21 14:15:09 crc kubenswrapper[4769]: I1121 14:15:09.373057 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" event={"ID":"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de","Type":"ContainerDied","Data":"aea5f9349bc6954da93937838a44e7a7f71fc5b5cc4bc53deb8583d7b5142b4a"} Nov 21 14:15:10 crc kubenswrapper[4769]: I1121 14:15:10.392677 4769 generic.go:334] "Generic (PLEG): container finished" podID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerID="6edfecab6ffcf711cda8eee6527795058c73a5c58325844a6296741f2c52e64b" exitCode=0 Nov 21 14:15:10 crc kubenswrapper[4769]: I1121 14:15:10.392760 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" event={"ID":"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de","Type":"ContainerDied","Data":"6edfecab6ffcf711cda8eee6527795058c73a5c58325844a6296741f2c52e64b"} Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.747055 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.817918 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-bundle\") pod \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.817975 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2hvv\" (UniqueName: \"kubernetes.io/projected/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-kube-api-access-b2hvv\") pod \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.819019 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-bundle" (OuterVolumeSpecName: "bundle") pod "2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" (UID: "2cfae3b6-dcee-424d-87ce-7aaf1c9d59de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.819263 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-util\") pod \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\" (UID: \"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de\") " Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.819627 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.823674 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-kube-api-access-b2hvv" (OuterVolumeSpecName: "kube-api-access-b2hvv") pod "2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" (UID: "2cfae3b6-dcee-424d-87ce-7aaf1c9d59de"). InnerVolumeSpecName "kube-api-access-b2hvv". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.843388 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-util" (OuterVolumeSpecName: "util") pod "2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" (UID: "2cfae3b6-dcee-424d-87ce-7aaf1c9d59de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.921143 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-b2hvv\" (UniqueName: \"kubernetes.io/projected/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-kube-api-access-b2hvv\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:11 crc kubenswrapper[4769]: I1121 14:15:11.921223 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cfae3b6-dcee-424d-87ce-7aaf1c9d59de-util\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.410734 4769 generic.go:334] "Generic (PLEG): container finished" podID="37759c44-ad63-4746-b791-5eb32cd3f36f" containerID="41e2a911b8b388401d174c55fd9c962c757d5f8466db54062f8121311331e624" exitCode=0 Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.410834 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"37759c44-ad63-4746-b791-5eb32cd3f36f","Type":"ContainerDied","Data":"41e2a911b8b388401d174c55fd9c962c757d5f8466db54062f8121311331e624"} Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.414036 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" event={"ID":"2cfae3b6-dcee-424d-87ce-7aaf1c9d59de","Type":"ContainerDied","Data":"1e36acdcf07b190e44be52a254117203314aa04a0d9e182f6502c6f52bb9d74a"} Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.414070 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e36acdcf07b190e44be52a254117203314aa04a0d9e182f6502c6f52bb9d74a" Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.414138 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ab83952fd3ab379d0f5a55f30eeab7d10e010bcd327dbcc65a9d017a8ehkczd" Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.429390 4769 generic.go:334] "Generic (PLEG): container finished" podID="de98a8bc-229a-4720-88c3-fa70402cf66a" containerID="790e3feb445a08ebf058dea70258c5f1135d2df48b935d3a30259fb507ab8b0d" exitCode=0 Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.429466 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"de98a8bc-229a-4720-88c3-fa70402cf66a","Type":"ContainerDied","Data":"790e3feb445a08ebf058dea70258c5f1135d2df48b935d3a30259fb507ab8b0d"} Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.431645 4769 generic.go:334] "Generic (PLEG): container finished" podID="0562d204-6213-47b0-8580-0f785bc7c9e0" containerID="ed49eef1c0761bf23ce67bbb43bb7e07d60bd99a36b5d860128f5cec795a10f8" exitCode=0 Nov 21 14:15:12 crc kubenswrapper[4769]: I1121 14:15:12.431740 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"0562d204-6213-47b0-8580-0f785bc7c9e0","Type":"ContainerDied","Data":"ed49eef1c0761bf23ce67bbb43bb7e07d60bd99a36b5d860128f5cec795a10f8"} Nov 21 14:15:13 crc kubenswrapper[4769]: I1121 14:15:13.440277 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-2" event={"ID":"de98a8bc-229a-4720-88c3-fa70402cf66a","Type":"ContainerStarted","Data":"dc87ab7cdef5217143b682168ccc5b3b14c728ca18ab394abafd8b95c1921713"} Nov 21 14:15:13 crc kubenswrapper[4769]: I1121 14:15:13.442040 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-1" event={"ID":"0562d204-6213-47b0-8580-0f785bc7c9e0","Type":"ContainerStarted","Data":"a5610a79823e8bef2d7441c30108ee8cc979b4f4104fec7b5cabcebabb4895ce"} Nov 21 14:15:13 crc kubenswrapper[4769]: I1121 14:15:13.445324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/openstack-galera-0" event={"ID":"37759c44-ad63-4746-b791-5eb32cd3f36f","Type":"ContainerStarted","Data":"f5e7e86ef4be15adf9a06b1b4c274cf4a30d3fc3aa4da2d1eae6036d72c6b0e5"} Nov 21 14:15:13 crc kubenswrapper[4769]: I1121 14:15:13.467877 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/openstack-galera-2" podStartSLOduration=8.467843498 podStartE2EDuration="8.467843498s" podCreationTimestamp="2025-11-21 14:15:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:13.460905702 +0000 UTC m=+8672.161567520" watchObservedRunningTime="2025-11-21 14:15:13.467843498 +0000 UTC m=+8672.168505356" Nov 21 14:15:13 crc kubenswrapper[4769]: I1121 14:15:13.486614 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/openstack-galera-1" podStartSLOduration=8.48659036 podStartE2EDuration="8.48659036s" podCreationTimestamp="2025-11-21 14:15:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:13.48212946 +0000 UTC m=+8672.182791278" watchObservedRunningTime="2025-11-21 14:15:13.48659036 +0000 UTC m=+8672.187252168" Nov 21 14:15:13 crc kubenswrapper[4769]: I1121 14:15:13.507573 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/openstack-galera-0" podStartSLOduration=8.507560291 podStartE2EDuration="8.507560291s" podCreationTimestamp="2025-11-21 14:15:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:13.50564963 +0000 UTC m=+8672.206311488" watchObservedRunningTime="2025-11-21 14:15:13.507560291 +0000 UTC m=+8672.208222109" Nov 21 14:15:14 crc kubenswrapper[4769]: E1121 14:15:14.697909 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:39098->38.102.83.227:40411: write tcp 38.102.83.227:39098->38.102.83.227:40411: write: broken pipe Nov 21 14:15:15 crc kubenswrapper[4769]: I1121 14:15:15.617769 4769 scope.go:117] "RemoveContainer" containerID="f9d8ba5644cf0e2defe684b71260a5d1616605197bf6b0502c4724644a35e263" Nov 21 14:15:16 crc kubenswrapper[4769]: I1121 14:15:16.849006 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:16 crc kubenswrapper[4769]: I1121 14:15:16.849325 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:16 crc kubenswrapper[4769]: I1121 14:15:16.920654 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:16 crc kubenswrapper[4769]: I1121 14:15:16.920711 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:16 crc kubenswrapper[4769]: I1121 14:15:16.934268 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:16 crc kubenswrapper[4769]: I1121 14:15:16.934324 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:17 crc kubenswrapper[4769]: I1121 14:15:17.116737 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:17 crc kubenswrapper[4769]: I1121 14:15:17.116845 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:17 crc kubenswrapper[4769]: I1121 14:15:17.166119 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:17 crc kubenswrapper[4769]: I1121 14:15:17.510307 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-index-whdr6" Nov 21 14:15:21 crc kubenswrapper[4769]: I1121 14:15:21.022524 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:21 crc kubenswrapper[4769]: I1121 14:15:21.133167 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/openstack-galera-2" Nov 21 14:15:21 crc kubenswrapper[4769]: I1121 14:15:21.275245 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:15:21 crc kubenswrapper[4769]: E1121 14:15:21.275772 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.734845 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-7875d887b-wvr89"] Nov 21 14:15:22 crc kubenswrapper[4769]: E1121 14:15:22.735772 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4330167a-ce8f-4e98-9c3e-4734910962cf" containerName="registry-server" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.735788 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="4330167a-ce8f-4e98-9c3e-4734910962cf" containerName="registry-server" Nov 21 14:15:22 crc kubenswrapper[4769]: E1121 14:15:22.735806 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="util" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.735814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="util" Nov 21 14:15:22 crc kubenswrapper[4769]: E1121 14:15:22.735823 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="extract" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.735830 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="extract" Nov 21 14:15:22 crc kubenswrapper[4769]: E1121 14:15:22.735844 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="pull" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.735850 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="pull" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.735984 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="2cfae3b6-dcee-424d-87ce-7aaf1c9d59de" containerName="extract" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.735999 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="4330167a-ce8f-4e98-9c3e-4734910962cf" containerName="registry-server" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.736926 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.739403 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-dockercfg-vlb4f" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.739447 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"infra-operator-controller-manager-service-cert" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.783049 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-7875d887b-wvr89"] Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.830478 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvkqx\" (UniqueName: \"kubernetes.io/projected/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-kube-api-access-lvkqx\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.830549 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-apiservice-cert\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.830583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-webhook-cert\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.933121 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lvkqx\" (UniqueName: \"kubernetes.io/projected/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-kube-api-access-lvkqx\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.933326 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-apiservice-cert\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.933360 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-webhook-cert\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.940484 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-webhook-cert\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.941739 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-apiservice-cert\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:22 crc kubenswrapper[4769]: I1121 14:15:22.961940 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvkqx\" (UniqueName: \"kubernetes.io/projected/b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e-kube-api-access-lvkqx\") pod \"infra-operator-controller-manager-7875d887b-wvr89\" (UID: \"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e\") " pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:23 crc kubenswrapper[4769]: I1121 14:15:23.057245 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:23 crc kubenswrapper[4769]: I1121 14:15:23.542088 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-7875d887b-wvr89"] Nov 21 14:15:23 crc kubenswrapper[4769]: W1121 14:15:23.549683 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f9ccb7_dc8c_4efd_8ea8_2f5397c1dc5e.slice/crio-b72dce65ca64e6f468d5dc4417fa09b21efaca74beef08d8956d2e45199fb99a WatchSource:0}: Error finding container b72dce65ca64e6f468d5dc4417fa09b21efaca74beef08d8956d2e45199fb99a: Status 404 returned error can't find the container with id b72dce65ca64e6f468d5dc4417fa09b21efaca74beef08d8956d2e45199fb99a Nov 21 14:15:24 crc kubenswrapper[4769]: I1121 14:15:24.538917 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" event={"ID":"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e","Type":"ContainerStarted","Data":"6c59a4e763fbf4fd74347cda2022a7fb41b7f53d7f65c3116dc477803947e468"} Nov 21 14:15:24 crc kubenswrapper[4769]: I1121 14:15:24.539377 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:24 crc kubenswrapper[4769]: I1121 14:15:24.539401 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" event={"ID":"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e","Type":"ContainerStarted","Data":"ba859ab2ad7f4db226b92967ff01e3fce3d35fa9d006ba4ca52a23c5ff2efb31"} Nov 21 14:15:24 crc kubenswrapper[4769]: I1121 14:15:24.539420 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" event={"ID":"b4f9ccb7-dc8c-4efd-8ea8-2f5397c1dc5e","Type":"ContainerStarted","Data":"b72dce65ca64e6f468d5dc4417fa09b21efaca74beef08d8956d2e45199fb99a"} Nov 21 14:15:24 crc kubenswrapper[4769]: I1121 14:15:24.562724 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" podStartSLOduration=2.5626942809999997 podStartE2EDuration="2.562694281s" podCreationTimestamp="2025-11-21 14:15:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:24.560556354 +0000 UTC m=+8683.261218182" watchObservedRunningTime="2025-11-21 14:15:24.562694281 +0000 UTC m=+8683.263356129" Nov 21 14:15:27 crc kubenswrapper[4769]: I1121 14:15:27.018905 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/openstack-galera-2" podUID="de98a8bc-229a-4720-88c3-fa70402cf66a" containerName="galera" probeResult="failure" output=< Nov 21 14:15:27 crc kubenswrapper[4769]: wsrep_local_state_comment (Donor/Desynced) differs from Synced Nov 21 14:15:27 crc kubenswrapper[4769]: > Nov 21 14:15:30 crc kubenswrapper[4769]: I1121 14:15:30.914682 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:31 crc kubenswrapper[4769]: I1121 14:15:31.010565 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/openstack-galera-0" Nov 21 14:15:33 crc kubenswrapper[4769]: I1121 14:15:33.064024 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-7875d887b-wvr89" Nov 21 14:15:34 crc kubenswrapper[4769]: I1121 14:15:34.776859 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:34 crc kubenswrapper[4769]: E1121 14:15:34.822394 4769 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 38.102.83.227:48688->38.102.83.227:40411: write tcp 38.102.83.227:48688->38.102.83.227:40411: write: broken pipe Nov 21 14:15:34 crc kubenswrapper[4769]: I1121 14:15:34.866123 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/openstack-galera-1" Nov 21 14:15:35 crc kubenswrapper[4769]: I1121 14:15:35.275045 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:15:35 crc kubenswrapper[4769]: E1121 14:15:35.275667 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.835690 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm"] Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.839081 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.842368 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.855479 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm"] Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.993573 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.994046 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:37 crc kubenswrapper[4769]: I1121 14:15:37.994400 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvb5x\" (UniqueName: \"kubernetes.io/projected/cd11cd33-03c9-44a1-b190-42e2a6de3d83-kube-api-access-cvb5x\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.096614 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cvb5x\" (UniqueName: \"kubernetes.io/projected/cd11cd33-03c9-44a1-b190-42e2a6de3d83-kube-api-access-cvb5x\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.096762 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.096799 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.097554 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-bundle\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.097813 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-util\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.123227 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvb5x\" (UniqueName: \"kubernetes.io/projected/cd11cd33-03c9-44a1-b190-42e2a6de3d83-kube-api-access-cvb5x\") pod \"9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.225332 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.568986 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ps98r"] Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.571322 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.573444 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-index-dockercfg-v79wc" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.584238 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ps98r"] Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.691103 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm"] Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.707215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhz2t\" (UniqueName: \"kubernetes.io/projected/64006e6a-9ecb-4a34-b8c7-e9423566f35c-kube-api-access-dhz2t\") pod \"rabbitmq-cluster-operator-index-ps98r\" (UID: \"64006e6a-9ecb-4a34-b8c7-e9423566f35c\") " pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.808818 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dhz2t\" (UniqueName: \"kubernetes.io/projected/64006e6a-9ecb-4a34-b8c7-e9423566f35c-kube-api-access-dhz2t\") pod \"rabbitmq-cluster-operator-index-ps98r\" (UID: \"64006e6a-9ecb-4a34-b8c7-e9423566f35c\") " pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.849638 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhz2t\" (UniqueName: \"kubernetes.io/projected/64006e6a-9ecb-4a34-b8c7-e9423566f35c-kube-api-access-dhz2t\") pod \"rabbitmq-cluster-operator-index-ps98r\" (UID: \"64006e6a-9ecb-4a34-b8c7-e9423566f35c\") " pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:38 crc kubenswrapper[4769]: I1121 14:15:38.901654 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:39 crc kubenswrapper[4769]: I1121 14:15:39.460894 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ps98r"] Nov 21 14:15:39 crc kubenswrapper[4769]: I1121 14:15:39.662601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" event={"ID":"64006e6a-9ecb-4a34-b8c7-e9423566f35c","Type":"ContainerStarted","Data":"c43af62fdbf5a4999e891d8d8600a193f4b676a412baed8571b5535a72e66fd2"} Nov 21 14:15:39 crc kubenswrapper[4769]: I1121 14:15:39.666092 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerID="024aba177f4b3d2dacb7c86ff2bbf2796cf0432de777ed43395d8030addd6fe5" exitCode=0 Nov 21 14:15:39 crc kubenswrapper[4769]: I1121 14:15:39.666310 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" event={"ID":"cd11cd33-03c9-44a1-b190-42e2a6de3d83","Type":"ContainerDied","Data":"024aba177f4b3d2dacb7c86ff2bbf2796cf0432de777ed43395d8030addd6fe5"} Nov 21 14:15:39 crc kubenswrapper[4769]: I1121 14:15:39.666428 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" event={"ID":"cd11cd33-03c9-44a1-b190-42e2a6de3d83","Type":"ContainerStarted","Data":"4857cd9d048ec9ae61f33d9f32bc0bd4659ce06a8e2765a63dcb2445fa3d6acd"} Nov 21 14:15:40 crc kubenswrapper[4769]: I1121 14:15:40.716869 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" event={"ID":"64006e6a-9ecb-4a34-b8c7-e9423566f35c","Type":"ContainerStarted","Data":"37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52"} Nov 21 14:15:40 crc kubenswrapper[4769]: I1121 14:15:40.721263 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerID="f9ef4a0707f65d5927f3305e86f4c8b7992843cd8ac2af303ad868359eec6183" exitCode=0 Nov 21 14:15:40 crc kubenswrapper[4769]: I1121 14:15:40.721324 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" event={"ID":"cd11cd33-03c9-44a1-b190-42e2a6de3d83","Type":"ContainerDied","Data":"f9ef4a0707f65d5927f3305e86f4c8b7992843cd8ac2af303ad868359eec6183"} Nov 21 14:15:40 crc kubenswrapper[4769]: I1121 14:15:40.752325 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" podStartSLOduration=2.157007452 podStartE2EDuration="2.752282907s" podCreationTimestamp="2025-11-21 14:15:38 +0000 UTC" firstStartedPulling="2025-11-21 14:15:39.481856817 +0000 UTC m=+8698.182518635" lastFinishedPulling="2025-11-21 14:15:40.077132242 +0000 UTC m=+8698.777794090" observedRunningTime="2025-11-21 14:15:40.740349988 +0000 UTC m=+8699.441011846" watchObservedRunningTime="2025-11-21 14:15:40.752282907 +0000 UTC m=+8699.452944765" Nov 21 14:15:41 crc kubenswrapper[4769]: I1121 14:15:41.732976 4769 generic.go:334] "Generic (PLEG): container finished" podID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerID="7e8aef0caf902eeec8615f4d17d724ff89e30b85d2ae84d5fbb6829894c34ebe" exitCode=0 Nov 21 14:15:41 crc kubenswrapper[4769]: I1121 14:15:41.733103 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" event={"ID":"cd11cd33-03c9-44a1-b190-42e2a6de3d83","Type":"ContainerDied","Data":"7e8aef0caf902eeec8615f4d17d724ff89e30b85d2ae84d5fbb6829894c34ebe"} Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.062904 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/memcached-0"] Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.063805 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.066952 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"memcached-config-data" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.067423 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"memcached-memcached-dockercfg-kdwtt" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.090891 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.171584 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-config-data\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.171661 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprfr\" (UniqueName: \"kubernetes.io/projected/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-kube-api-access-hprfr\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.171854 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-kolla-config\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.273455 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-config-data\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.273527 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hprfr\" (UniqueName: \"kubernetes.io/projected/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-kube-api-access-hprfr\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.273567 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-kolla-config\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.274415 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-kolla-config\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.275509 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-config-data\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.318334 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprfr\" (UniqueName: \"kubernetes.io/projected/c1180b3a-b6b4-44e2-9b18-81e13fc118b9-kube-api-access-hprfr\") pod \"memcached-0\" (UID: \"c1180b3a-b6b4-44e2-9b18-81e13fc118b9\") " pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.399018 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.772829 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ps98r"] Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.773831 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" podUID="64006e6a-9ecb-4a34-b8c7-e9423566f35c" containerName="registry-server" containerID="cri-o://37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52" gracePeriod=2 Nov 21 14:15:42 crc kubenswrapper[4769]: I1121 14:15:42.866922 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/memcached-0"] Nov 21 14:15:42 crc kubenswrapper[4769]: W1121 14:15:42.879847 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1180b3a_b6b4_44e2_9b18_81e13fc118b9.slice/crio-300bce1c85dd6b483f777bf98e290ad5562594034a8d0019c4660bbf3656decd WatchSource:0}: Error finding container 300bce1c85dd6b483f777bf98e290ad5562594034a8d0019c4660bbf3656decd: Status 404 returned error can't find the container with id 300bce1c85dd6b483f777bf98e290ad5562594034a8d0019c4660bbf3656decd Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.096139 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.190691 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvb5x\" (UniqueName: \"kubernetes.io/projected/cd11cd33-03c9-44a1-b190-42e2a6de3d83-kube-api-access-cvb5x\") pod \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.190789 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-bundle\") pod \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.190899 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-util\") pod \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\" (UID: \"cd11cd33-03c9-44a1-b190-42e2a6de3d83\") " Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.192150 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-bundle" (OuterVolumeSpecName: "bundle") pod "cd11cd33-03c9-44a1-b190-42e2a6de3d83" (UID: "cd11cd33-03c9-44a1-b190-42e2a6de3d83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.200496 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd11cd33-03c9-44a1-b190-42e2a6de3d83-kube-api-access-cvb5x" (OuterVolumeSpecName: "kube-api-access-cvb5x") pod "cd11cd33-03c9-44a1-b190-42e2a6de3d83" (UID: "cd11cd33-03c9-44a1-b190-42e2a6de3d83"). InnerVolumeSpecName "kube-api-access-cvb5x". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.208097 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-util" (OuterVolumeSpecName: "util") pod "cd11cd33-03c9-44a1-b190-42e2a6de3d83" (UID: "cd11cd33-03c9-44a1-b190-42e2a6de3d83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.217535 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.292824 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhz2t\" (UniqueName: \"kubernetes.io/projected/64006e6a-9ecb-4a34-b8c7-e9423566f35c-kube-api-access-dhz2t\") pod \"64006e6a-9ecb-4a34-b8c7-e9423566f35c\" (UID: \"64006e6a-9ecb-4a34-b8c7-e9423566f35c\") " Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.293767 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-cvb5x\" (UniqueName: \"kubernetes.io/projected/cd11cd33-03c9-44a1-b190-42e2a6de3d83-kube-api-access-cvb5x\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.293806 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.293824 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd11cd33-03c9-44a1-b190-42e2a6de3d83-util\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.296363 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64006e6a-9ecb-4a34-b8c7-e9423566f35c-kube-api-access-dhz2t" (OuterVolumeSpecName: "kube-api-access-dhz2t") pod "64006e6a-9ecb-4a34-b8c7-e9423566f35c" (UID: "64006e6a-9ecb-4a34-b8c7-e9423566f35c"). InnerVolumeSpecName "kube-api-access-dhz2t". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.367475 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ddqzb"] Nov 21 14:15:43 crc kubenswrapper[4769]: E1121 14:15:43.367797 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="extract" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.367814 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="extract" Nov 21 14:15:43 crc kubenswrapper[4769]: E1121 14:15:43.367832 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="util" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.367839 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="util" Nov 21 14:15:43 crc kubenswrapper[4769]: E1121 14:15:43.367850 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="pull" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.367856 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="pull" Nov 21 14:15:43 crc kubenswrapper[4769]: E1121 14:15:43.367868 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="64006e6a-9ecb-4a34-b8c7-e9423566f35c" containerName="registry-server" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.367875 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="64006e6a-9ecb-4a34-b8c7-e9423566f35c" containerName="registry-server" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.367997 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="cd11cd33-03c9-44a1-b190-42e2a6de3d83" containerName="extract" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.368012 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="64006e6a-9ecb-4a34-b8c7-e9423566f35c" containerName="registry-server" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.368512 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.380315 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ddqzb"] Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.394947 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhfd\" (UniqueName: \"kubernetes.io/projected/f533a52b-8d61-411f-80dd-8d9b59489764-kube-api-access-mlhfd\") pod \"rabbitmq-cluster-operator-index-ddqzb\" (UID: \"f533a52b-8d61-411f-80dd-8d9b59489764\") " pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.395571 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dhz2t\" (UniqueName: \"kubernetes.io/projected/64006e6a-9ecb-4a34-b8c7-e9423566f35c-kube-api-access-dhz2t\") on node \"crc\" DevicePath \"\"" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.497223 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhfd\" (UniqueName: \"kubernetes.io/projected/f533a52b-8d61-411f-80dd-8d9b59489764-kube-api-access-mlhfd\") pod \"rabbitmq-cluster-operator-index-ddqzb\" (UID: \"f533a52b-8d61-411f-80dd-8d9b59489764\") " pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.533452 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhfd\" (UniqueName: \"kubernetes.io/projected/f533a52b-8d61-411f-80dd-8d9b59489764-kube-api-access-mlhfd\") pod \"rabbitmq-cluster-operator-index-ddqzb\" (UID: \"f533a52b-8d61-411f-80dd-8d9b59489764\") " pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.695270 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.771099 4769 generic.go:334] "Generic (PLEG): container finished" podID="64006e6a-9ecb-4a34-b8c7-e9423566f35c" containerID="37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52" exitCode=0 Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.771297 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" event={"ID":"64006e6a-9ecb-4a34-b8c7-e9423566f35c","Type":"ContainerDied","Data":"37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52"} Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.772232 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" event={"ID":"64006e6a-9ecb-4a34-b8c7-e9423566f35c","Type":"ContainerDied","Data":"c43af62fdbf5a4999e891d8d8600a193f4b676a412baed8571b5535a72e66fd2"} Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.772271 4769 scope.go:117] "RemoveContainer" containerID="37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.771412 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-index-ps98r" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.783627 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/memcached-0" event={"ID":"c1180b3a-b6b4-44e2-9b18-81e13fc118b9","Type":"ContainerStarted","Data":"cb42fe20d6c52444830d56a318b5e6d3a1a6f2fd742752863061448ddfdb9c49"} Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.784112 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.784132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/memcached-0" event={"ID":"c1180b3a-b6b4-44e2-9b18-81e13fc118b9","Type":"ContainerStarted","Data":"300bce1c85dd6b483f777bf98e290ad5562594034a8d0019c4660bbf3656decd"} Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.787012 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" event={"ID":"cd11cd33-03c9-44a1-b190-42e2a6de3d83","Type":"ContainerDied","Data":"4857cd9d048ec9ae61f33d9f32bc0bd4659ce06a8e2765a63dcb2445fa3d6acd"} Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.787052 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4857cd9d048ec9ae61f33d9f32bc0bd4659ce06a8e2765a63dcb2445fa3d6acd" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.787123 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/9704761d240e56fb98655ffd81084895b33a73ec711f4dcdef0450e590dzzpm" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.812442 4769 scope.go:117] "RemoveContainer" containerID="37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.814858 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/memcached-0" podStartSLOduration=1.814836765 podStartE2EDuration="1.814836765s" podCreationTimestamp="2025-11-21 14:15:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:43.806980985 +0000 UTC m=+8702.507642833" watchObservedRunningTime="2025-11-21 14:15:43.814836765 +0000 UTC m=+8702.515498573" Nov 21 14:15:43 crc kubenswrapper[4769]: E1121 14:15:43.820589 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52\": container with ID starting with 37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52 not found: ID does not exist" containerID="37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.820647 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52"} err="failed to get container status \"37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52\": rpc error: code = NotFound desc = could not find container \"37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52\": container with ID starting with 37b8810de000a76c5319a031559aa75e8f96e2253aa7a20bbd75a7e2ea6c8b52 not found: ID does not exist" Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.842563 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ps98r"] Nov 21 14:15:43 crc kubenswrapper[4769]: I1121 14:15:43.846599 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ps98r"] Nov 21 14:15:44 crc kubenswrapper[4769]: I1121 14:15:44.194126 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-index-ddqzb"] Nov 21 14:15:44 crc kubenswrapper[4769]: W1121 14:15:44.205823 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf533a52b_8d61_411f_80dd_8d9b59489764.slice/crio-114e34387ea3ffa3b7873cebf72bbb1ddf4995694ceb1654f967eb187e31d81c WatchSource:0}: Error finding container 114e34387ea3ffa3b7873cebf72bbb1ddf4995694ceb1654f967eb187e31d81c: Status 404 returned error can't find the container with id 114e34387ea3ffa3b7873cebf72bbb1ddf4995694ceb1654f967eb187e31d81c Nov 21 14:15:44 crc kubenswrapper[4769]: I1121 14:15:44.800408 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" event={"ID":"f533a52b-8d61-411f-80dd-8d9b59489764","Type":"ContainerStarted","Data":"114e34387ea3ffa3b7873cebf72bbb1ddf4995694ceb1654f967eb187e31d81c"} Nov 21 14:15:45 crc kubenswrapper[4769]: I1121 14:15:45.286592 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64006e6a-9ecb-4a34-b8c7-e9423566f35c" path="/var/lib/kubelet/pods/64006e6a-9ecb-4a34-b8c7-e9423566f35c/volumes" Nov 21 14:15:45 crc kubenswrapper[4769]: I1121 14:15:45.807357 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" event={"ID":"f533a52b-8d61-411f-80dd-8d9b59489764","Type":"ContainerStarted","Data":"2c8281ef85ef04e74459c973aa0a6ef2b9a08831055a8188fcf2d8458f69b9bf"} Nov 21 14:15:48 crc kubenswrapper[4769]: I1121 14:15:48.274376 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:15:48 crc kubenswrapper[4769]: E1121 14:15:48.275179 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.403280 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/memcached-0" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.432432 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" podStartSLOduration=8.968743847 podStartE2EDuration="9.432401728s" podCreationTimestamp="2025-11-21 14:15:43 +0000 UTC" firstStartedPulling="2025-11-21 14:15:44.21781408 +0000 UTC m=+8702.918475938" lastFinishedPulling="2025-11-21 14:15:44.681471991 +0000 UTC m=+8703.382133819" observedRunningTime="2025-11-21 14:15:45.824315595 +0000 UTC m=+8704.524977413" watchObservedRunningTime="2025-11-21 14:15:52.432401728 +0000 UTC m=+8711.133063566" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.804559 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q"] Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.806157 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.811105 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"rabbitmq-cluster-operator-dockercfg-j6m5p" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.819802 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q"] Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.857321 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgrx\" (UniqueName: \"kubernetes.io/projected/cef9f105-5598-4dc9-a71c-169e0f90220a-kube-api-access-2sgrx\") pod \"rabbitmq-cluster-operator-779fc9694b-8l78q\" (UID: \"cef9f105-5598-4dc9-a71c-169e0f90220a\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.957957 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgrx\" (UniqueName: \"kubernetes.io/projected/cef9f105-5598-4dc9-a71c-169e0f90220a-kube-api-access-2sgrx\") pod \"rabbitmq-cluster-operator-779fc9694b-8l78q\" (UID: \"cef9f105-5598-4dc9-a71c-169e0f90220a\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" Nov 21 14:15:52 crc kubenswrapper[4769]: I1121 14:15:52.980721 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgrx\" (UniqueName: \"kubernetes.io/projected/cef9f105-5598-4dc9-a71c-169e0f90220a-kube-api-access-2sgrx\") pod \"rabbitmq-cluster-operator-779fc9694b-8l78q\" (UID: \"cef9f105-5598-4dc9-a71c-169e0f90220a\") " pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.137719 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.644351 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q"] Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.695637 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.695728 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.750944 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.899646 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" event={"ID":"cef9f105-5598-4dc9-a71c-169e0f90220a","Type":"ContainerStarted","Data":"bb5ac5d8160b2795aace7a5d0d5a7182ef14416c39f0b3fe17bfa061529e3435"} Nov 21 14:15:53 crc kubenswrapper[4769]: I1121 14:15:53.930881 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/rabbitmq-cluster-operator-index-ddqzb" Nov 21 14:15:54 crc kubenswrapper[4769]: I1121 14:15:54.909920 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" event={"ID":"cef9f105-5598-4dc9-a71c-169e0f90220a","Type":"ContainerStarted","Data":"09183b529b3f42666349de3e1b3ef741bd282285cd472fa8651d4cf0bfdc0356"} Nov 21 14:15:54 crc kubenswrapper[4769]: I1121 14:15:54.931537 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-779fc9694b-8l78q" podStartSLOduration=2.9315081530000002 podStartE2EDuration="2.931508153s" podCreationTimestamp="2025-11-21 14:15:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:15:54.92654302 +0000 UTC m=+8713.627204838" watchObservedRunningTime="2025-11-21 14:15:54.931508153 +0000 UTC m=+8713.632169981" Nov 21 14:16:01 crc kubenswrapper[4769]: I1121 14:16:01.274223 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:16:01 crc kubenswrapper[4769]: E1121 14:16:01.274975 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.176728 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-index-l7c8s"] Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.178889 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.181829 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-index-dockercfg-zf5n5" Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.193536 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-l7c8s"] Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.277706 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85z7f\" (UniqueName: \"kubernetes.io/projected/8bb9610d-41dc-4854-b38d-022f562e7506-kube-api-access-85z7f\") pod \"keystone-operator-index-l7c8s\" (UID: \"8bb9610d-41dc-4854-b38d-022f562e7506\") " pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.379081 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-85z7f\" (UniqueName: \"kubernetes.io/projected/8bb9610d-41dc-4854-b38d-022f562e7506-kube-api-access-85z7f\") pod \"keystone-operator-index-l7c8s\" (UID: \"8bb9610d-41dc-4854-b38d-022f562e7506\") " pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.405339 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-85z7f\" (UniqueName: \"kubernetes.io/projected/8bb9610d-41dc-4854-b38d-022f562e7506-kube-api-access-85z7f\") pod \"keystone-operator-index-l7c8s\" (UID: \"8bb9610d-41dc-4854-b38d-022f562e7506\") " pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:03 crc kubenswrapper[4769]: I1121 14:16:03.521371 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:04 crc kubenswrapper[4769]: I1121 14:16:04.037585 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-index-l7c8s"] Nov 21 14:16:04 crc kubenswrapper[4769]: W1121 14:16:04.042395 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb9610d_41dc_4854_b38d_022f562e7506.slice/crio-85dc920a795f1beeefa10388c706e60359a16a09adc8eb459f16e6067834635b WatchSource:0}: Error finding container 85dc920a795f1beeefa10388c706e60359a16a09adc8eb459f16e6067834635b: Status 404 returned error can't find the container with id 85dc920a795f1beeefa10388c706e60359a16a09adc8eb459f16e6067834635b Nov 21 14:16:04 crc kubenswrapper[4769]: I1121 14:16:04.247404 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-l7c8s" event={"ID":"8bb9610d-41dc-4854-b38d-022f562e7506","Type":"ContainerStarted","Data":"85dc920a795f1beeefa10388c706e60359a16a09adc8eb459f16e6067834635b"} Nov 21 14:16:05 crc kubenswrapper[4769]: I1121 14:16:05.258863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-index-l7c8s" event={"ID":"8bb9610d-41dc-4854-b38d-022f562e7506","Type":"ContainerStarted","Data":"10c864033641b80a64ac29622f3e95c3de5dae3b2f0384d7176d56a72fa4a609"} Nov 21 14:16:05 crc kubenswrapper[4769]: I1121 14:16:05.288095 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-index-l7c8s" podStartSLOduration=1.777932813 podStartE2EDuration="2.288065369s" podCreationTimestamp="2025-11-21 14:16:03 +0000 UTC" firstStartedPulling="2025-11-21 14:16:04.044148228 +0000 UTC m=+8722.744810056" lastFinishedPulling="2025-11-21 14:16:04.554280784 +0000 UTC m=+8723.254942612" observedRunningTime="2025-11-21 14:16:05.285739577 +0000 UTC m=+8723.986401395" watchObservedRunningTime="2025-11-21 14:16:05.288065369 +0000 UTC m=+8723.988727217" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.563174 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.565051 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.568748 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"rabbitmq-erlang-cookie" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.569447 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"rabbitmq-server-conf" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.570355 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"rabbitmq-server-dockercfg-tqb62" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.570556 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"rabbitmq-plugins-conf" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.571781 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"rabbitmq-default-user" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.572385 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.669507 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.669709 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.669742 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bf73fb9-ee94-472e-8781-13d12dd130bd-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.669799 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.670002 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bf73fb9-ee94-472e-8781-13d12dd130bd-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.670092 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rb47\" (UniqueName: \"kubernetes.io/projected/7bf73fb9-ee94-472e-8781-13d12dd130bd-kube-api-access-8rb47\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.670153 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.670272 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bf73fb9-ee94-472e-8781-13d12dd130bd-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.771819 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8rb47\" (UniqueName: \"kubernetes.io/projected/7bf73fb9-ee94-472e-8781-13d12dd130bd-kube-api-access-8rb47\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.771891 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.771942 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bf73fb9-ee94-472e-8781-13d12dd130bd-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.771992 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.772021 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.772048 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bf73fb9-ee94-472e-8781-13d12dd130bd-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.772098 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.772148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bf73fb9-ee94-472e-8781-13d12dd130bd-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.772689 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.772798 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.773159 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bf73fb9-ee94-472e-8781-13d12dd130bd-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.777448 4769 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.777975 4769 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/16a961cace6796625ee9e3527f050ef5b9118790d91e02e5d2440f1d534f861f/globalmount\"" pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.781132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bf73fb9-ee94-472e-8781-13d12dd130bd-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.781596 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bf73fb9-ee94-472e-8781-13d12dd130bd-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.788615 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bf73fb9-ee94-472e-8781-13d12dd130bd-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.796311 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rb47\" (UniqueName: \"kubernetes.io/projected/7bf73fb9-ee94-472e-8781-13d12dd130bd-kube-api-access-8rb47\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.822055 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-baa2d864-dfda-4444-ac3c-15eb154779d7\") pod \"rabbitmq-server-0\" (UID: \"7bf73fb9-ee94-472e-8781-13d12dd130bd\") " pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:12 crc kubenswrapper[4769]: I1121 14:16:12.889070 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:13 crc kubenswrapper[4769]: I1121 14:16:13.282897 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:16:13 crc kubenswrapper[4769]: E1121 14:16:13.283759 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:16:13 crc kubenswrapper[4769]: I1121 14:16:13.386173 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/rabbitmq-server-0"] Nov 21 14:16:13 crc kubenswrapper[4769]: I1121 14:16:13.521832 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:13 crc kubenswrapper[4769]: I1121 14:16:13.521906 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:13 crc kubenswrapper[4769]: I1121 14:16:13.560798 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:14 crc kubenswrapper[4769]: I1121 14:16:14.346592 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7bf73fb9-ee94-472e-8781-13d12dd130bd","Type":"ContainerStarted","Data":"8546a1381281fa21071940d76263a756f4caf851ec47e026accb51563dec7059"} Nov 21 14:16:14 crc kubenswrapper[4769]: I1121 14:16:14.376385 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-index-l7c8s" Nov 21 14:16:15 crc kubenswrapper[4769]: I1121 14:16:15.374776 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7bf73fb9-ee94-472e-8781-13d12dd130bd","Type":"ContainerStarted","Data":"367d33acca5538732443a25995badf580447325c9fbeff8d1f86d31b2b8d117f"} Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.051364 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9"] Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.055057 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.062350 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9"] Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.065305 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.126215 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.126370 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8jj\" (UniqueName: \"kubernetes.io/projected/6a99b510-1908-430b-93a1-8774f4e5ce65-kube-api-access-sv8jj\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.126582 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.227676 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8jj\" (UniqueName: \"kubernetes.io/projected/6a99b510-1908-430b-93a1-8774f4e5ce65-kube-api-access-sv8jj\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.227800 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.227889 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.228519 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-util\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.228593 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-bundle\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.248820 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8jj\" (UniqueName: \"kubernetes.io/projected/6a99b510-1908-430b-93a1-8774f4e5ce65-kube-api-access-sv8jj\") pod \"e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.387536 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:16 crc kubenswrapper[4769]: I1121 14:16:16.884151 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9"] Nov 21 14:16:16 crc kubenswrapper[4769]: W1121 14:16:16.889380 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a99b510_1908_430b_93a1_8774f4e5ce65.slice/crio-8cba44d6b513d419428edc18a31a6a1d8cd7207c7a08dc1516a05efef4a6b4c9 WatchSource:0}: Error finding container 8cba44d6b513d419428edc18a31a6a1d8cd7207c7a08dc1516a05efef4a6b4c9: Status 404 returned error can't find the container with id 8cba44d6b513d419428edc18a31a6a1d8cd7207c7a08dc1516a05efef4a6b4c9 Nov 21 14:16:17 crc kubenswrapper[4769]: I1121 14:16:17.393903 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerID="c1e201cb7dd2b65ea5e3605073f2a2a4a09a6219b95adcb67b57617f0ed155e1" exitCode=0 Nov 21 14:16:17 crc kubenswrapper[4769]: I1121 14:16:17.393982 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" event={"ID":"6a99b510-1908-430b-93a1-8774f4e5ce65","Type":"ContainerDied","Data":"c1e201cb7dd2b65ea5e3605073f2a2a4a09a6219b95adcb67b57617f0ed155e1"} Nov 21 14:16:17 crc kubenswrapper[4769]: I1121 14:16:17.394386 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" event={"ID":"6a99b510-1908-430b-93a1-8774f4e5ce65","Type":"ContainerStarted","Data":"8cba44d6b513d419428edc18a31a6a1d8cd7207c7a08dc1516a05efef4a6b4c9"} Nov 21 14:16:19 crc kubenswrapper[4769]: I1121 14:16:19.414576 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerID="9567fed9c1f7c5c99fd2ae78393bc4dc355475d8d3b6e406c14458cb8d5d7766" exitCode=0 Nov 21 14:16:19 crc kubenswrapper[4769]: I1121 14:16:19.415290 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" event={"ID":"6a99b510-1908-430b-93a1-8774f4e5ce65","Type":"ContainerDied","Data":"9567fed9c1f7c5c99fd2ae78393bc4dc355475d8d3b6e406c14458cb8d5d7766"} Nov 21 14:16:20 crc kubenswrapper[4769]: I1121 14:16:20.426805 4769 generic.go:334] "Generic (PLEG): container finished" podID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerID="29062d4f107c2ca7819e571036e795b75a1be3d5f41c7d84a2ab72b923eb124d" exitCode=0 Nov 21 14:16:20 crc kubenswrapper[4769]: I1121 14:16:20.426858 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" event={"ID":"6a99b510-1908-430b-93a1-8774f4e5ce65","Type":"ContainerDied","Data":"29062d4f107c2ca7819e571036e795b75a1be3d5f41c7d84a2ab72b923eb124d"} Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.792845 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.930621 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv8jj\" (UniqueName: \"kubernetes.io/projected/6a99b510-1908-430b-93a1-8774f4e5ce65-kube-api-access-sv8jj\") pod \"6a99b510-1908-430b-93a1-8774f4e5ce65\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.930760 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-util\") pod \"6a99b510-1908-430b-93a1-8774f4e5ce65\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.930795 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-bundle\") pod \"6a99b510-1908-430b-93a1-8774f4e5ce65\" (UID: \"6a99b510-1908-430b-93a1-8774f4e5ce65\") " Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.932466 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-bundle" (OuterVolumeSpecName: "bundle") pod "6a99b510-1908-430b-93a1-8774f4e5ce65" (UID: "6a99b510-1908-430b-93a1-8774f4e5ce65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.938701 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a99b510-1908-430b-93a1-8774f4e5ce65-kube-api-access-sv8jj" (OuterVolumeSpecName: "kube-api-access-sv8jj") pod "6a99b510-1908-430b-93a1-8774f4e5ce65" (UID: "6a99b510-1908-430b-93a1-8774f4e5ce65"). InnerVolumeSpecName "kube-api-access-sv8jj". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:16:21 crc kubenswrapper[4769]: I1121 14:16:21.959366 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-util" (OuterVolumeSpecName: "util") pod "6a99b510-1908-430b-93a1-8774f4e5ce65" (UID: "6a99b510-1908-430b-93a1-8774f4e5ce65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:16:22 crc kubenswrapper[4769]: I1121 14:16:22.032334 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sv8jj\" (UniqueName: \"kubernetes.io/projected/6a99b510-1908-430b-93a1-8774f4e5ce65-kube-api-access-sv8jj\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:22 crc kubenswrapper[4769]: I1121 14:16:22.032360 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-util\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:22 crc kubenswrapper[4769]: I1121 14:16:22.032370 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99b510-1908-430b-93a1-8774f4e5ce65-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:22 crc kubenswrapper[4769]: I1121 14:16:22.447726 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" event={"ID":"6a99b510-1908-430b-93a1-8774f4e5ce65","Type":"ContainerDied","Data":"8cba44d6b513d419428edc18a31a6a1d8cd7207c7a08dc1516a05efef4a6b4c9"} Nov 21 14:16:22 crc kubenswrapper[4769]: I1121 14:16:22.448113 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cba44d6b513d419428edc18a31a6a1d8cd7207c7a08dc1516a05efef4a6b4c9" Nov 21 14:16:22 crc kubenswrapper[4769]: I1121 14:16:22.447860 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/e7d7e4671d7d05874436e844b5cf6d94e49a6a946d772a1ed2117581bcxk9r9" Nov 21 14:16:28 crc kubenswrapper[4769]: I1121 14:16:28.274571 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:16:28 crc kubenswrapper[4769]: E1121 14:16:28.275811 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.389581 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr"] Nov 21 14:16:32 crc kubenswrapper[4769]: E1121 14:16:32.390522 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="util" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.390538 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="util" Nov 21 14:16:32 crc kubenswrapper[4769]: E1121 14:16:32.390549 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="pull" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.390555 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="pull" Nov 21 14:16:32 crc kubenswrapper[4769]: E1121 14:16:32.390575 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="extract" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.390582 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="extract" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.390753 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a99b510-1908-430b-93a1-8774f4e5ce65" containerName="extract" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.391721 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.395248 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-service-cert" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.395470 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"keystone-operator-controller-manager-dockercfg-dh4tp" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.411711 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr"] Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.511720 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98827a8f-1285-4a9b-94ef-d43c9c0b2099-webhook-cert\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.511810 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89gzb\" (UniqueName: \"kubernetes.io/projected/98827a8f-1285-4a9b-94ef-d43c9c0b2099-kube-api-access-89gzb\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.511834 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98827a8f-1285-4a9b-94ef-d43c9c0b2099-apiservice-cert\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.613671 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98827a8f-1285-4a9b-94ef-d43c9c0b2099-webhook-cert\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.613769 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-89gzb\" (UniqueName: \"kubernetes.io/projected/98827a8f-1285-4a9b-94ef-d43c9c0b2099-kube-api-access-89gzb\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.613796 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98827a8f-1285-4a9b-94ef-d43c9c0b2099-apiservice-cert\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.622053 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98827a8f-1285-4a9b-94ef-d43c9c0b2099-apiservice-cert\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.622132 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98827a8f-1285-4a9b-94ef-d43c9c0b2099-webhook-cert\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.635955 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-89gzb\" (UniqueName: \"kubernetes.io/projected/98827a8f-1285-4a9b-94ef-d43c9c0b2099-kube-api-access-89gzb\") pod \"keystone-operator-controller-manager-749cf9c458-thfqr\" (UID: \"98827a8f-1285-4a9b-94ef-d43c9c0b2099\") " pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:32 crc kubenswrapper[4769]: I1121 14:16:32.715421 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:33 crc kubenswrapper[4769]: I1121 14:16:33.249387 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr"] Nov 21 14:16:33 crc kubenswrapper[4769]: W1121 14:16:33.263650 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98827a8f_1285_4a9b_94ef_d43c9c0b2099.slice/crio-3cbc9e92a74e55d773485290b1a1732927182ecb23d514286ad1cb1deed75720 WatchSource:0}: Error finding container 3cbc9e92a74e55d773485290b1a1732927182ecb23d514286ad1cb1deed75720: Status 404 returned error can't find the container with id 3cbc9e92a74e55d773485290b1a1732927182ecb23d514286ad1cb1deed75720 Nov 21 14:16:33 crc kubenswrapper[4769]: I1121 14:16:33.535269 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" event={"ID":"98827a8f-1285-4a9b-94ef-d43c9c0b2099","Type":"ContainerStarted","Data":"783ab4cc2046af1e0d8b4033a6eb11fcfde1ebadfe2d62d4e824950c91317abe"} Nov 21 14:16:33 crc kubenswrapper[4769]: I1121 14:16:33.535318 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" event={"ID":"98827a8f-1285-4a9b-94ef-d43c9c0b2099","Type":"ContainerStarted","Data":"3cbc9e92a74e55d773485290b1a1732927182ecb23d514286ad1cb1deed75720"} Nov 21 14:16:34 crc kubenswrapper[4769]: I1121 14:16:34.551829 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" event={"ID":"98827a8f-1285-4a9b-94ef-d43c9c0b2099","Type":"ContainerStarted","Data":"c1057cd4a819f702b5c8bacc1708559d1cac8d2861af29af7997dee5049bc66f"} Nov 21 14:16:35 crc kubenswrapper[4769]: I1121 14:16:35.565787 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:42 crc kubenswrapper[4769]: I1121 14:16:42.721567 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" Nov 21 14:16:42 crc kubenswrapper[4769]: I1121 14:16:42.740507 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-749cf9c458-thfqr" podStartSLOduration=10.740484975 podStartE2EDuration="10.740484975s" podCreationTimestamp="2025-11-21 14:16:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:16:34.583026837 +0000 UTC m=+8753.283688675" watchObservedRunningTime="2025-11-21 14:16:42.740484975 +0000 UTC m=+8761.441146803" Nov 21 14:16:43 crc kubenswrapper[4769]: I1121 14:16:43.279907 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:16:43 crc kubenswrapper[4769]: E1121 14:16:43.280373 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.661588 4769 generic.go:334] "Generic (PLEG): container finished" podID="7bf73fb9-ee94-472e-8781-13d12dd130bd" containerID="367d33acca5538732443a25995badf580447325c9fbeff8d1f86d31b2b8d117f" exitCode=0 Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.661697 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7bf73fb9-ee94-472e-8781-13d12dd130bd","Type":"ContainerDied","Data":"367d33acca5538732443a25995badf580447325c9fbeff8d1f86d31b2b8d117f"} Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.770247 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-index-lqrwr"] Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.783013 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.786927 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"horizon-operator-index-dockercfg-rlwzs" Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.811064 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-lqrwr"] Nov 21 14:16:46 crc kubenswrapper[4769]: I1121 14:16:46.935880 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrw49\" (UniqueName: \"kubernetes.io/projected/e9dbda0a-60c4-4122-a738-d1a22b002168-kube-api-access-xrw49\") pod \"horizon-operator-index-lqrwr\" (UID: \"e9dbda0a-60c4-4122-a738-d1a22b002168\") " pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.038283 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xrw49\" (UniqueName: \"kubernetes.io/projected/e9dbda0a-60c4-4122-a738-d1a22b002168-kube-api-access-xrw49\") pod \"horizon-operator-index-lqrwr\" (UID: \"e9dbda0a-60c4-4122-a738-d1a22b002168\") " pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.056077 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrw49\" (UniqueName: \"kubernetes.io/projected/e9dbda0a-60c4-4122-a738-d1a22b002168-kube-api-access-xrw49\") pod \"horizon-operator-index-lqrwr\" (UID: \"e9dbda0a-60c4-4122-a738-d1a22b002168\") " pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.124936 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.622624 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-lqrwr"] Nov 21 14:16:47 crc kubenswrapper[4769]: W1121 14:16:47.629117 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dbda0a_60c4_4122_a738_d1a22b002168.slice/crio-5e7eccfeefaf2d62e13120ec0a90a998a2092d931d82d79a344cda2ea5195e9f WatchSource:0}: Error finding container 5e7eccfeefaf2d62e13120ec0a90a998a2092d931d82d79a344cda2ea5195e9f: Status 404 returned error can't find the container with id 5e7eccfeefaf2d62e13120ec0a90a998a2092d931d82d79a344cda2ea5195e9f Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.669132 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-lqrwr" event={"ID":"e9dbda0a-60c4-4122-a738-d1a22b002168","Type":"ContainerStarted","Data":"5e7eccfeefaf2d62e13120ec0a90a998a2092d931d82d79a344cda2ea5195e9f"} Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.671582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/rabbitmq-server-0" event={"ID":"7bf73fb9-ee94-472e-8781-13d12dd130bd","Type":"ContainerStarted","Data":"16f0b5a0303a72a457eeee66b3ab392264c804d82bc45c700334196a9106c1bb"} Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.671854 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:16:47 crc kubenswrapper[4769]: I1121 14:16:47.704949 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.704928417 podStartE2EDuration="36.704928417s" podCreationTimestamp="2025-11-21 14:16:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:16:47.703284093 +0000 UTC m=+8766.403945931" watchObservedRunningTime="2025-11-21 14:16:47.704928417 +0000 UTC m=+8766.405590235" Nov 21 14:16:49 crc kubenswrapper[4769]: I1121 14:16:49.689727 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-lqrwr" event={"ID":"e9dbda0a-60c4-4122-a738-d1a22b002168","Type":"ContainerStarted","Data":"0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950"} Nov 21 14:16:49 crc kubenswrapper[4769]: I1121 14:16:49.755582 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-index-lqrwr" podStartSLOduration=2.409928714 podStartE2EDuration="3.755556839s" podCreationTimestamp="2025-11-21 14:16:46 +0000 UTC" firstStartedPulling="2025-11-21 14:16:47.632001865 +0000 UTC m=+8766.332663683" lastFinishedPulling="2025-11-21 14:16:48.97762999 +0000 UTC m=+8767.678291808" observedRunningTime="2025-11-21 14:16:49.748817199 +0000 UTC m=+8768.449479057" watchObservedRunningTime="2025-11-21 14:16:49.755556839 +0000 UTC m=+8768.456218677" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.085771 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz"] Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.086732 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.093364 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-db-secret" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.094678 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz"] Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.129533 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-db-create-lbqqk"] Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.130444 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.137523 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-create-lbqqk"] Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.195791 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-operator-scripts\") pod \"keystone-5d8a-account-create-update-8r4mz\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.195874 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6gz\" (UniqueName: \"kubernetes.io/projected/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-kube-api-access-sz6gz\") pod \"keystone-5d8a-account-create-update-8r4mz\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.296926 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t77fp\" (UniqueName: \"kubernetes.io/projected/357ae9e4-ce1d-4832-bea2-9b7867465393-kube-api-access-t77fp\") pod \"keystone-db-create-lbqqk\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.297030 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-operator-scripts\") pod \"keystone-5d8a-account-create-update-8r4mz\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.297082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6gz\" (UniqueName: \"kubernetes.io/projected/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-kube-api-access-sz6gz\") pod \"keystone-5d8a-account-create-update-8r4mz\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.297151 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/357ae9e4-ce1d-4832-bea2-9b7867465393-operator-scripts\") pod \"keystone-db-create-lbqqk\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.298608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-operator-scripts\") pod \"keystone-5d8a-account-create-update-8r4mz\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.322793 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6gz\" (UniqueName: \"kubernetes.io/projected/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-kube-api-access-sz6gz\") pod \"keystone-5d8a-account-create-update-8r4mz\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.399300 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t77fp\" (UniqueName: \"kubernetes.io/projected/357ae9e4-ce1d-4832-bea2-9b7867465393-kube-api-access-t77fp\") pod \"keystone-db-create-lbqqk\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.399683 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/357ae9e4-ce1d-4832-bea2-9b7867465393-operator-scripts\") pod \"keystone-db-create-lbqqk\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.401388 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/357ae9e4-ce1d-4832-bea2-9b7867465393-operator-scripts\") pod \"keystone-db-create-lbqqk\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.419777 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.428846 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t77fp\" (UniqueName: \"kubernetes.io/projected/357ae9e4-ce1d-4832-bea2-9b7867465393-kube-api-access-t77fp\") pod \"keystone-db-create-lbqqk\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.446335 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.786356 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz"] Nov 21 14:16:50 crc kubenswrapper[4769]: W1121 14:16:50.789494 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeae4dc1c_b06a_4cfe_9955_cc72fb68b984.slice/crio-0671e61331230f53c4fdf15ec0d4dd783a3adde1e8f253e988cf13fbfeecbd7a WatchSource:0}: Error finding container 0671e61331230f53c4fdf15ec0d4dd783a3adde1e8f253e988cf13fbfeecbd7a: Status 404 returned error can't find the container with id 0671e61331230f53c4fdf15ec0d4dd783a3adde1e8f253e988cf13fbfeecbd7a Nov 21 14:16:50 crc kubenswrapper[4769]: I1121 14:16:50.957166 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-create-lbqqk"] Nov 21 14:16:50 crc kubenswrapper[4769]: W1121 14:16:50.965305 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod357ae9e4_ce1d_4832_bea2_9b7867465393.slice/crio-ac85d606c82e7ad0fb29591b6ce78010cebb91a1f2284c3489618208e66fbd9f WatchSource:0}: Error finding container ac85d606c82e7ad0fb29591b6ce78010cebb91a1f2284c3489618208e66fbd9f: Status 404 returned error can't find the container with id ac85d606c82e7ad0fb29591b6ce78010cebb91a1f2284c3489618208e66fbd9f Nov 21 14:16:51 crc kubenswrapper[4769]: I1121 14:16:51.710716 4769 generic.go:334] "Generic (PLEG): container finished" podID="357ae9e4-ce1d-4832-bea2-9b7867465393" containerID="7cac77a124d74fd3748a8c2128da1ab66d0d1f893ae6bce9ef08e0bb4c1a758b" exitCode=0 Nov 21 14:16:51 crc kubenswrapper[4769]: I1121 14:16:51.710856 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" event={"ID":"357ae9e4-ce1d-4832-bea2-9b7867465393","Type":"ContainerDied","Data":"7cac77a124d74fd3748a8c2128da1ab66d0d1f893ae6bce9ef08e0bb4c1a758b"} Nov 21 14:16:51 crc kubenswrapper[4769]: I1121 14:16:51.711257 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" event={"ID":"357ae9e4-ce1d-4832-bea2-9b7867465393","Type":"ContainerStarted","Data":"ac85d606c82e7ad0fb29591b6ce78010cebb91a1f2284c3489618208e66fbd9f"} Nov 21 14:16:51 crc kubenswrapper[4769]: I1121 14:16:51.714791 4769 generic.go:334] "Generic (PLEG): container finished" podID="eae4dc1c-b06a-4cfe-9955-cc72fb68b984" containerID="0a671c4017cd9e9878cdc80a4daf9854f78af3779961a86884684e1fc0da104f" exitCode=0 Nov 21 14:16:51 crc kubenswrapper[4769]: I1121 14:16:51.714853 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" event={"ID":"eae4dc1c-b06a-4cfe-9955-cc72fb68b984","Type":"ContainerDied","Data":"0a671c4017cd9e9878cdc80a4daf9854f78af3779961a86884684e1fc0da104f"} Nov 21 14:16:51 crc kubenswrapper[4769]: I1121 14:16:51.714888 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" event={"ID":"eae4dc1c-b06a-4cfe-9955-cc72fb68b984","Type":"ContainerStarted","Data":"0671e61331230f53c4fdf15ec0d4dd783a3adde1e8f253e988cf13fbfeecbd7a"} Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.157875 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-index-lqrwr"] Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.158089 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/horizon-operator-index-lqrwr" podUID="e9dbda0a-60c4-4122-a738-d1a22b002168" containerName="registry-server" containerID="cri-o://0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950" gracePeriod=2 Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.580178 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.727082 4769 generic.go:334] "Generic (PLEG): container finished" podID="e9dbda0a-60c4-4122-a738-d1a22b002168" containerID="0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950" exitCode=0 Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.727148 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-lqrwr" event={"ID":"e9dbda0a-60c4-4122-a738-d1a22b002168","Type":"ContainerDied","Data":"0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950"} Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.727224 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-lqrwr" event={"ID":"e9dbda0a-60c4-4122-a738-d1a22b002168","Type":"ContainerDied","Data":"5e7eccfeefaf2d62e13120ec0a90a998a2092d931d82d79a344cda2ea5195e9f"} Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.727243 4769 scope.go:117] "RemoveContainer" containerID="0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.727154 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-lqrwr" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.735297 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrw49\" (UniqueName: \"kubernetes.io/projected/e9dbda0a-60c4-4122-a738-d1a22b002168-kube-api-access-xrw49\") pod \"e9dbda0a-60c4-4122-a738-d1a22b002168\" (UID: \"e9dbda0a-60c4-4122-a738-d1a22b002168\") " Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.762208 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9dbda0a-60c4-4122-a738-d1a22b002168-kube-api-access-xrw49" (OuterVolumeSpecName: "kube-api-access-xrw49") pod "e9dbda0a-60c4-4122-a738-d1a22b002168" (UID: "e9dbda0a-60c4-4122-a738-d1a22b002168"). InnerVolumeSpecName "kube-api-access-xrw49". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.783367 4769 scope.go:117] "RemoveContainer" containerID="0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950" Nov 21 14:16:52 crc kubenswrapper[4769]: E1121 14:16:52.784796 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950\": container with ID starting with 0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950 not found: ID does not exist" containerID="0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.784843 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950"} err="failed to get container status \"0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950\": rpc error: code = NotFound desc = could not find container \"0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950\": container with ID starting with 0bc1983c4a100a82e9c286b29dfda41c1f55fa83740e0f86d518f71a95e0a950 not found: ID does not exist" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.787041 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-index-8jx7s"] Nov 21 14:16:52 crc kubenswrapper[4769]: E1121 14:16:52.787405 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e9dbda0a-60c4-4122-a738-d1a22b002168" containerName="registry-server" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.787417 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dbda0a-60c4-4122-a738-d1a22b002168" containerName="registry-server" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.787564 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e9dbda0a-60c4-4122-a738-d1a22b002168" containerName="registry-server" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.788048 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.791821 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-8jx7s"] Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.837146 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xrw49\" (UniqueName: \"kubernetes.io/projected/e9dbda0a-60c4-4122-a738-d1a22b002168-kube-api-access-xrw49\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:52 crc kubenswrapper[4769]: I1121 14:16:52.939570 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8gqp\" (UniqueName: \"kubernetes.io/projected/e91edf08-90d7-40a6-a778-03dc665128ad-kube-api-access-m8gqp\") pod \"horizon-operator-index-8jx7s\" (UID: \"e91edf08-90d7-40a6-a778-03dc665128ad\") " pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.040871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-m8gqp\" (UniqueName: \"kubernetes.io/projected/e91edf08-90d7-40a6-a778-03dc665128ad-kube-api-access-m8gqp\") pod \"horizon-operator-index-8jx7s\" (UID: \"e91edf08-90d7-40a6-a778-03dc665128ad\") " pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.067880 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8gqp\" (UniqueName: \"kubernetes.io/projected/e91edf08-90d7-40a6-a778-03dc665128ad-kube-api-access-m8gqp\") pod \"horizon-operator-index-8jx7s\" (UID: \"e91edf08-90d7-40a6-a778-03dc665128ad\") " pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.118365 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.122299 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.131273 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/horizon-operator-index-lqrwr"] Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.140564 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.147182 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/horizon-operator-index-lqrwr"] Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.243995 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-operator-scripts\") pod \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.244083 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/357ae9e4-ce1d-4832-bea2-9b7867465393-operator-scripts\") pod \"357ae9e4-ce1d-4832-bea2-9b7867465393\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.244143 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t77fp\" (UniqueName: \"kubernetes.io/projected/357ae9e4-ce1d-4832-bea2-9b7867465393-kube-api-access-t77fp\") pod \"357ae9e4-ce1d-4832-bea2-9b7867465393\" (UID: \"357ae9e4-ce1d-4832-bea2-9b7867465393\") " Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.244170 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz6gz\" (UniqueName: \"kubernetes.io/projected/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-kube-api-access-sz6gz\") pod \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\" (UID: \"eae4dc1c-b06a-4cfe-9955-cc72fb68b984\") " Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.245124 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "eae4dc1c-b06a-4cfe-9955-cc72fb68b984" (UID: "eae4dc1c-b06a-4cfe-9955-cc72fb68b984"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.245226 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357ae9e4-ce1d-4832-bea2-9b7867465393-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "357ae9e4-ce1d-4832-bea2-9b7867465393" (UID: "357ae9e4-ce1d-4832-bea2-9b7867465393"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.251654 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357ae9e4-ce1d-4832-bea2-9b7867465393-kube-api-access-t77fp" (OuterVolumeSpecName: "kube-api-access-t77fp") pod "357ae9e4-ce1d-4832-bea2-9b7867465393" (UID: "357ae9e4-ce1d-4832-bea2-9b7867465393"). InnerVolumeSpecName "kube-api-access-t77fp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.252853 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-kube-api-access-sz6gz" (OuterVolumeSpecName: "kube-api-access-sz6gz") pod "eae4dc1c-b06a-4cfe-9955-cc72fb68b984" (UID: "eae4dc1c-b06a-4cfe-9955-cc72fb68b984"). InnerVolumeSpecName "kube-api-access-sz6gz". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.291431 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9dbda0a-60c4-4122-a738-d1a22b002168" path="/var/lib/kubelet/pods/e9dbda0a-60c4-4122-a738-d1a22b002168/volumes" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.345705 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.345744 4769 reconciler_common.go:293] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/357ae9e4-ce1d-4832-bea2-9b7867465393-operator-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.345756 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-t77fp\" (UniqueName: \"kubernetes.io/projected/357ae9e4-ce1d-4832-bea2-9b7867465393-kube-api-access-t77fp\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.345769 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sz6gz\" (UniqueName: \"kubernetes.io/projected/eae4dc1c-b06a-4cfe-9955-cc72fb68b984-kube-api-access-sz6gz\") on node \"crc\" DevicePath \"\"" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.691410 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-index-8jx7s"] Nov 21 14:16:53 crc kubenswrapper[4769]: W1121 14:16:53.708685 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91edf08_90d7_40a6_a778_03dc665128ad.slice/crio-4de7d61754f41d56e8d529167fe4e168f53317f79cc1814c1362d9d3a40e6f75 WatchSource:0}: Error finding container 4de7d61754f41d56e8d529167fe4e168f53317f79cc1814c1362d9d3a40e6f75: Status 404 returned error can't find the container with id 4de7d61754f41d56e8d529167fe4e168f53317f79cc1814c1362d9d3a40e6f75 Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.737966 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-8jx7s" event={"ID":"e91edf08-90d7-40a6-a778-03dc665128ad","Type":"ContainerStarted","Data":"4de7d61754f41d56e8d529167fe4e168f53317f79cc1814c1362d9d3a40e6f75"} Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.741671 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" event={"ID":"eae4dc1c-b06a-4cfe-9955-cc72fb68b984","Type":"ContainerDied","Data":"0671e61331230f53c4fdf15ec0d4dd783a3adde1e8f253e988cf13fbfeecbd7a"} Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.741703 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0671e61331230f53c4fdf15ec0d4dd783a3adde1e8f253e988cf13fbfeecbd7a" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.741700 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-5d8a-account-create-update-8r4mz" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.744265 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" event={"ID":"357ae9e4-ce1d-4832-bea2-9b7867465393","Type":"ContainerDied","Data":"ac85d606c82e7ad0fb29591b6ce78010cebb91a1f2284c3489618208e66fbd9f"} Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.744311 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-create-lbqqk" Nov 21 14:16:53 crc kubenswrapper[4769]: I1121 14:16:53.744318 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac85d606c82e7ad0fb29591b6ce78010cebb91a1f2284c3489618208e66fbd9f" Nov 21 14:16:54 crc kubenswrapper[4769]: I1121 14:16:54.758509 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-index-8jx7s" event={"ID":"e91edf08-90d7-40a6-a778-03dc665128ad","Type":"ContainerStarted","Data":"14462857bfaad8c9e3236c667849e7aba854aeceb0a0c2f333c4faa959770d3e"} Nov 21 14:16:54 crc kubenswrapper[4769]: I1121 14:16:54.784999 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-index-8jx7s" podStartSLOduration=2.329248048 podStartE2EDuration="2.784967885s" podCreationTimestamp="2025-11-21 14:16:52 +0000 UTC" firstStartedPulling="2025-11-21 14:16:53.714773497 +0000 UTC m=+8772.415435355" lastFinishedPulling="2025-11-21 14:16:54.170493374 +0000 UTC m=+8772.871155192" observedRunningTime="2025-11-21 14:16:54.778904592 +0000 UTC m=+8773.479566440" watchObservedRunningTime="2025-11-21 14:16:54.784967885 +0000 UTC m=+8773.485629743" Nov 21 14:16:55 crc kubenswrapper[4769]: I1121 14:16:55.274556 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:16:55 crc kubenswrapper[4769]: E1121 14:16:55.275052 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.168684 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-6bq58"] Nov 21 14:17:02 crc kubenswrapper[4769]: E1121 14:17:02.169618 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eae4dc1c-b06a-4cfe-9955-cc72fb68b984" containerName="mariadb-account-create-update" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.169634 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae4dc1c-b06a-4cfe-9955-cc72fb68b984" containerName="mariadb-account-create-update" Nov 21 14:17:02 crc kubenswrapper[4769]: E1121 14:17:02.169664 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="357ae9e4-ce1d-4832-bea2-9b7867465393" containerName="mariadb-database-create" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.169675 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="357ae9e4-ce1d-4832-bea2-9b7867465393" containerName="mariadb-database-create" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.169877 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="eae4dc1c-b06a-4cfe-9955-cc72fb68b984" containerName="mariadb-account-create-update" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.169915 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="357ae9e4-ce1d-4832-bea2-9b7867465393" containerName="mariadb-database-create" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.171646 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.179591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6bq58"] Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.224393 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjfl\" (UniqueName: \"kubernetes.io/projected/e0c9cea5-f0d4-4984-9813-b49df355a73e-kube-api-access-zpjfl\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.224583 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-catalog-content\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.224657 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-utilities\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.326002 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-catalog-content\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.326316 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-utilities\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.326356 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjfl\" (UniqueName: \"kubernetes.io/projected/e0c9cea5-f0d4-4984-9813-b49df355a73e-kube-api-access-zpjfl\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.326881 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-catalog-content\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.327007 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-utilities\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.346461 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjfl\" (UniqueName: \"kubernetes.io/projected/e0c9cea5-f0d4-4984-9813-b49df355a73e-kube-api-access-zpjfl\") pod \"redhat-marketplace-6bq58\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.539146 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:02 crc kubenswrapper[4769]: I1121 14:17:02.892361 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/rabbitmq-server-0" Nov 21 14:17:03 crc kubenswrapper[4769]: W1121 14:17:03.001838 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c9cea5_f0d4_4984_9813_b49df355a73e.slice/crio-a9261c7124437ac2c20fc9d1c64a5ca2d8ce5483e085175e5f9f5267b4b274f6 WatchSource:0}: Error finding container a9261c7124437ac2c20fc9d1c64a5ca2d8ce5483e085175e5f9f5267b4b274f6: Status 404 returned error can't find the container with id a9261c7124437ac2c20fc9d1c64a5ca2d8ce5483e085175e5f9f5267b4b274f6 Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.005788 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6bq58"] Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.119146 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.119205 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.182148 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.467156 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-f2t26"] Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.468251 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.470770 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.470899 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-keystone-dockercfg-v84dt" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.471261 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-config-data" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.474694 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-scripts" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.508152 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-f2t26"] Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.545090 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxkx\" (UniqueName: \"kubernetes.io/projected/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-kube-api-access-hqxkx\") pod \"keystone-db-sync-f2t26\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.545172 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-config-data\") pod \"keystone-db-sync-f2t26\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.646789 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxkx\" (UniqueName: \"kubernetes.io/projected/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-kube-api-access-hqxkx\") pod \"keystone-db-sync-f2t26\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.646871 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-config-data\") pod \"keystone-db-sync-f2t26\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.664685 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-config-data\") pod \"keystone-db-sync-f2t26\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.668329 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxkx\" (UniqueName: \"kubernetes.io/projected/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-kube-api-access-hqxkx\") pod \"keystone-db-sync-f2t26\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.790540 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.844697 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerID="4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d" exitCode=0 Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.844763 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerDied","Data":"4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d"} Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.844799 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerStarted","Data":"a9261c7124437ac2c20fc9d1c64a5ca2d8ce5483e085175e5f9f5267b4b274f6"} Nov 21 14:17:03 crc kubenswrapper[4769]: I1121 14:17:03.906657 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-index-8jx7s" Nov 21 14:17:04 crc kubenswrapper[4769]: I1121 14:17:04.261635 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-db-sync-f2t26"] Nov 21 14:17:04 crc kubenswrapper[4769]: W1121 14:17:04.273686 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34edcfa3_3d2f_43c9_9a36_837e44d89a6b.slice/crio-a516aaa70897fbe91d9550ed417532b11f1f5209e786f912ec1cbfe992442ed0 WatchSource:0}: Error finding container a516aaa70897fbe91d9550ed417532b11f1f5209e786f912ec1cbfe992442ed0: Status 404 returned error can't find the container with id a516aaa70897fbe91d9550ed417532b11f1f5209e786f912ec1cbfe992442ed0 Nov 21 14:17:04 crc kubenswrapper[4769]: I1121 14:17:04.851735 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" event={"ID":"34edcfa3-3d2f-43c9-9a36-837e44d89a6b","Type":"ContainerStarted","Data":"656471bf03fa7036587180fe33c3fcf5e97a32b33adf773bd51e88f2358c39d2"} Nov 21 14:17:04 crc kubenswrapper[4769]: I1121 14:17:04.852143 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" event={"ID":"34edcfa3-3d2f-43c9-9a36-837e44d89a6b","Type":"ContainerStarted","Data":"a516aaa70897fbe91d9550ed417532b11f1f5209e786f912ec1cbfe992442ed0"} Nov 21 14:17:04 crc kubenswrapper[4769]: I1121 14:17:04.854664 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerStarted","Data":"de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef"} Nov 21 14:17:04 crc kubenswrapper[4769]: I1121 14:17:04.879660 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" podStartSLOduration=1.879619775 podStartE2EDuration="1.879619775s" podCreationTimestamp="2025-11-21 14:17:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:17:04.871044885 +0000 UTC m=+8783.571706703" watchObservedRunningTime="2025-11-21 14:17:04.879619775 +0000 UTC m=+8783.580281613" Nov 21 14:17:05 crc kubenswrapper[4769]: I1121 14:17:05.865439 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerID="de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef" exitCode=0 Nov 21 14:17:05 crc kubenswrapper[4769]: I1121 14:17:05.865494 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerDied","Data":"de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef"} Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.614213 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb"] Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.617021 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.620124 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"default-dockercfg-tr946" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.637176 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb"] Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.701221 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwk8p\" (UniqueName: \"kubernetes.io/projected/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-kube-api-access-gwk8p\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.701319 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-bundle\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.701532 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-util\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.804921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-util\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.805063 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-gwk8p\" (UniqueName: \"kubernetes.io/projected/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-kube-api-access-gwk8p\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.805179 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-bundle\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.805608 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-util\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.806041 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-bundle\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.828365 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwk8p\" (UniqueName: \"kubernetes.io/projected/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-kube-api-access-gwk8p\") pod \"440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.886587 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerStarted","Data":"1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371"} Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.926798 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-6bq58" podStartSLOduration=2.461300489 podStartE2EDuration="4.926765142s" podCreationTimestamp="2025-11-21 14:17:02 +0000 UTC" firstStartedPulling="2025-11-21 14:17:03.846788218 +0000 UTC m=+8782.547450036" lastFinishedPulling="2025-11-21 14:17:06.312252871 +0000 UTC m=+8785.012914689" observedRunningTime="2025-11-21 14:17:06.92255906 +0000 UTC m=+8785.623220888" watchObservedRunningTime="2025-11-21 14:17:06.926765142 +0000 UTC m=+8785.627426970" Nov 21 14:17:06 crc kubenswrapper[4769]: I1121 14:17:06.939326 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:07 crc kubenswrapper[4769]: I1121 14:17:07.274579 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:17:07 crc kubenswrapper[4769]: E1121 14:17:07.275257 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:17:07 crc kubenswrapper[4769]: I1121 14:17:07.419638 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb"] Nov 21 14:17:07 crc kubenswrapper[4769]: W1121 14:17:07.429246 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc749c823_fb0e_4eda_93ea_9ca3ad6fcd5e.slice/crio-d52f0b0a781d13862ad6fc8f8c8bbe27aab47f512abcdf5613c03d9d8e58e157 WatchSource:0}: Error finding container d52f0b0a781d13862ad6fc8f8c8bbe27aab47f512abcdf5613c03d9d8e58e157: Status 404 returned error can't find the container with id d52f0b0a781d13862ad6fc8f8c8bbe27aab47f512abcdf5613c03d9d8e58e157 Nov 21 14:17:07 crc kubenswrapper[4769]: I1121 14:17:07.899384 4769 generic.go:334] "Generic (PLEG): container finished" podID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerID="31350a213deab4c77a12eee238f380a55ad02af88fd2a147c0d3e3cc3b584e9d" exitCode=0 Nov 21 14:17:07 crc kubenswrapper[4769]: I1121 14:17:07.899475 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" event={"ID":"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e","Type":"ContainerDied","Data":"31350a213deab4c77a12eee238f380a55ad02af88fd2a147c0d3e3cc3b584e9d"} Nov 21 14:17:07 crc kubenswrapper[4769]: I1121 14:17:07.899974 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" event={"ID":"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e","Type":"ContainerStarted","Data":"d52f0b0a781d13862ad6fc8f8c8bbe27aab47f512abcdf5613c03d9d8e58e157"} Nov 21 14:17:09 crc kubenswrapper[4769]: I1121 14:17:09.918484 4769 generic.go:334] "Generic (PLEG): container finished" podID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerID="7d3c2805ec7bcfabc68c4938e6208ab358a6d1daeec9008625bf4af5b0b857c6" exitCode=0 Nov 21 14:17:09 crc kubenswrapper[4769]: I1121 14:17:09.918622 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" event={"ID":"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e","Type":"ContainerDied","Data":"7d3c2805ec7bcfabc68c4938e6208ab358a6d1daeec9008625bf4af5b0b857c6"} Nov 21 14:17:10 crc kubenswrapper[4769]: I1121 14:17:10.935048 4769 generic.go:334] "Generic (PLEG): container finished" podID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerID="8966c1b4d3de2f7cc2b2357e68bae0022c35160d45ea5946b1ca57af9795e575" exitCode=0 Nov 21 14:17:10 crc kubenswrapper[4769]: I1121 14:17:10.935134 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" event={"ID":"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e","Type":"ContainerDied","Data":"8966c1b4d3de2f7cc2b2357e68bae0022c35160d45ea5946b1ca57af9795e575"} Nov 21 14:17:11 crc kubenswrapper[4769]: I1121 14:17:11.951453 4769 generic.go:334] "Generic (PLEG): container finished" podID="34edcfa3-3d2f-43c9-9a36-837e44d89a6b" containerID="656471bf03fa7036587180fe33c3fcf5e97a32b33adf773bd51e88f2358c39d2" exitCode=0 Nov 21 14:17:11 crc kubenswrapper[4769]: I1121 14:17:11.951633 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" event={"ID":"34edcfa3-3d2f-43c9-9a36-837e44d89a6b","Type":"ContainerDied","Data":"656471bf03fa7036587180fe33c3fcf5e97a32b33adf773bd51e88f2358c39d2"} Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.388397 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.405558 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwk8p\" (UniqueName: \"kubernetes.io/projected/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-kube-api-access-gwk8p\") pod \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.405924 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-util\") pod \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.406040 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-bundle\") pod \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\" (UID: \"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e\") " Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.407962 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-bundle" (OuterVolumeSpecName: "bundle") pod "c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" (UID: "c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.418573 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-kube-api-access-gwk8p" (OuterVolumeSpecName: "kube-api-access-gwk8p") pod "c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" (UID: "c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e"). InnerVolumeSpecName "kube-api-access-gwk8p". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.434885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-util" (OuterVolumeSpecName: "util") pod "c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" (UID: "c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.510246 4769 reconciler_common.go:293] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-util\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.510365 4769 reconciler_common.go:293] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-bundle\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.510395 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-gwk8p\" (UniqueName: \"kubernetes.io/projected/c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e-kube-api-access-gwk8p\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.540236 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.540323 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.572909 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-5skwg"] Nov 21 14:17:12 crc kubenswrapper[4769]: E1121 14:17:12.573276 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="extract" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.573296 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="extract" Nov 21 14:17:12 crc kubenswrapper[4769]: E1121 14:17:12.573320 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="util" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.573328 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="util" Nov 21 14:17:12 crc kubenswrapper[4769]: E1121 14:17:12.573354 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="pull" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.573360 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="pull" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.573492 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e" containerName="extract" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.581377 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.613591 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-5skwg"] Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.617009 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-utilities\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.617101 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvrq\" (UniqueName: \"kubernetes.io/projected/a515cddd-0670-4790-b2f9-af89f19b2d7b-kube-api-access-chvrq\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.617148 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-catalog-content\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.638508 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.718003 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-utilities\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.718095 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-chvrq\" (UniqueName: \"kubernetes.io/projected/a515cddd-0670-4790-b2f9-af89f19b2d7b-kube-api-access-chvrq\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.718132 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-catalog-content\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.718575 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-utilities\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.718648 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-catalog-content\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.742482 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvrq\" (UniqueName: \"kubernetes.io/projected/a515cddd-0670-4790-b2f9-af89f19b2d7b-kube-api-access-chvrq\") pod \"certified-operators-5skwg\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.923071 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.975473 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.975653 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/440bfe09fdefc314a717f31a57d7ebfa5bfc58c8ed9bd7a4e0a57fadb4xvqqb" event={"ID":"c749c823-fb0e-4eda-93ea-9ca3ad6fcd5e","Type":"ContainerDied","Data":"d52f0b0a781d13862ad6fc8f8c8bbe27aab47f512abcdf5613c03d9d8e58e157"} Nov 21 14:17:12 crc kubenswrapper[4769]: I1121 14:17:12.978455 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d52f0b0a781d13862ad6fc8f8c8bbe27aab47f512abcdf5613c03d9d8e58e157" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.057470 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.251935 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-5skwg"] Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.483038 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.536157 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqxkx\" (UniqueName: \"kubernetes.io/projected/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-kube-api-access-hqxkx\") pod \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.536237 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-config-data\") pod \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\" (UID: \"34edcfa3-3d2f-43c9-9a36-837e44d89a6b\") " Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.543794 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-kube-api-access-hqxkx" (OuterVolumeSpecName: "kube-api-access-hqxkx") pod "34edcfa3-3d2f-43c9-9a36-837e44d89a6b" (UID: "34edcfa3-3d2f-43c9-9a36-837e44d89a6b"). InnerVolumeSpecName "kube-api-access-hqxkx". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.574773 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-config-data" (OuterVolumeSpecName: "config-data") pod "34edcfa3-3d2f-43c9-9a36-837e44d89a6b" (UID: "34edcfa3-3d2f-43c9-9a36-837e44d89a6b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.638611 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-hqxkx\" (UniqueName: \"kubernetes.io/projected/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-kube-api-access-hqxkx\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.638703 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34edcfa3-3d2f-43c9-9a36-837e44d89a6b-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.983459 4769 generic.go:334] "Generic (PLEG): container finished" podID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerID="18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d" exitCode=0 Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.983582 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5skwg" event={"ID":"a515cddd-0670-4790-b2f9-af89f19b2d7b","Type":"ContainerDied","Data":"18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d"} Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.984715 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5skwg" event={"ID":"a515cddd-0670-4790-b2f9-af89f19b2d7b","Type":"ContainerStarted","Data":"dd92033463cb98dd817e9392b89bdb4a68d381fa95b322be65e4e8068dbbff21"} Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.987273 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" event={"ID":"34edcfa3-3d2f-43c9-9a36-837e44d89a6b","Type":"ContainerDied","Data":"a516aaa70897fbe91d9550ed417532b11f1f5209e786f912ec1cbfe992442ed0"} Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.987313 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a516aaa70897fbe91d9550ed417532b11f1f5209e786f912ec1cbfe992442ed0" Nov 21 14:17:13 crc kubenswrapper[4769]: I1121 14:17:13.987363 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-db-sync-f2t26" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.220704 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-p9gqv"] Nov 21 14:17:14 crc kubenswrapper[4769]: E1121 14:17:14.221897 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34edcfa3-3d2f-43c9-9a36-837e44d89a6b" containerName="keystone-db-sync" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.222140 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="34edcfa3-3d2f-43c9-9a36-837e44d89a6b" containerName="keystone-db-sync" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.222698 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="34edcfa3-3d2f-43c9-9a36-837e44d89a6b" containerName="keystone-db-sync" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.224418 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.229622 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-scripts" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.229842 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-config-data" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.229855 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-keystone-dockercfg-v84dt" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.230019 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.230168 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"osp-secret" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.247711 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-p9gqv"] Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.252027 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gks6\" (UniqueName: \"kubernetes.io/projected/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-kube-api-access-4gks6\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.254436 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-fernet-keys\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.254524 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-credential-keys\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.254611 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-config-data\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.254684 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-scripts\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.356286 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4gks6\" (UniqueName: \"kubernetes.io/projected/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-kube-api-access-4gks6\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.356340 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-fernet-keys\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.356373 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-credential-keys\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.356409 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-config-data\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.356434 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-scripts\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.363546 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-credential-keys\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.363824 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-fernet-keys\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.364893 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-scripts\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.367448 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-config-data\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.377302 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gks6\" (UniqueName: \"kubernetes.io/projected/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-kube-api-access-4gks6\") pod \"keystone-bootstrap-p9gqv\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:14 crc kubenswrapper[4769]: I1121 14:17:14.561407 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:15 crc kubenswrapper[4769]: I1121 14:17:15.063533 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-bootstrap-p9gqv"] Nov 21 14:17:15 crc kubenswrapper[4769]: W1121 14:17:15.067366 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f7d2c22_08fb_4bcb_b542_b83e1c8ff051.slice/crio-cdc9856626e24d276e6a6c64ae3b21d8ebee541bc8157c1effaef5daa829528e WatchSource:0}: Error finding container cdc9856626e24d276e6a6c64ae3b21d8ebee541bc8157c1effaef5daa829528e: Status 404 returned error can't find the container with id cdc9856626e24d276e6a6c64ae3b21d8ebee541bc8157c1effaef5daa829528e Nov 21 14:17:15 crc kubenswrapper[4769]: I1121 14:17:15.957430 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6bq58"] Nov 21 14:17:15 crc kubenswrapper[4769]: I1121 14:17:15.958128 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-6bq58" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="registry-server" containerID="cri-o://1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371" gracePeriod=2 Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.016037 4769 generic.go:334] "Generic (PLEG): container finished" podID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerID="586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d" exitCode=0 Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.016174 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5skwg" event={"ID":"a515cddd-0670-4790-b2f9-af89f19b2d7b","Type":"ContainerDied","Data":"586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d"} Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.020261 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" event={"ID":"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051","Type":"ContainerStarted","Data":"00f16034ba0b6b555809846f4a273b43989f46749351a1fe12e917d7c8e12334"} Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.020346 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" event={"ID":"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051","Type":"ContainerStarted","Data":"cdc9856626e24d276e6a6c64ae3b21d8ebee541bc8157c1effaef5daa829528e"} Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.071088 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" podStartSLOduration=2.071061776 podStartE2EDuration="2.071061776s" podCreationTimestamp="2025-11-21 14:17:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:17:16.061852329 +0000 UTC m=+8794.762514187" watchObservedRunningTime="2025-11-21 14:17:16.071061776 +0000 UTC m=+8794.771723604" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.442380 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.498526 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpjfl\" (UniqueName: \"kubernetes.io/projected/e0c9cea5-f0d4-4984-9813-b49df355a73e-kube-api-access-zpjfl\") pod \"e0c9cea5-f0d4-4984-9813-b49df355a73e\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.498587 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-catalog-content\") pod \"e0c9cea5-f0d4-4984-9813-b49df355a73e\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.498755 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-utilities\") pod \"e0c9cea5-f0d4-4984-9813-b49df355a73e\" (UID: \"e0c9cea5-f0d4-4984-9813-b49df355a73e\") " Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.499846 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-utilities" (OuterVolumeSpecName: "utilities") pod "e0c9cea5-f0d4-4984-9813-b49df355a73e" (UID: "e0c9cea5-f0d4-4984-9813-b49df355a73e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.515756 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c9cea5-f0d4-4984-9813-b49df355a73e-kube-api-access-zpjfl" (OuterVolumeSpecName: "kube-api-access-zpjfl") pod "e0c9cea5-f0d4-4984-9813-b49df355a73e" (UID: "e0c9cea5-f0d4-4984-9813-b49df355a73e"). InnerVolumeSpecName "kube-api-access-zpjfl". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.541942 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e0c9cea5-f0d4-4984-9813-b49df355a73e" (UID: "e0c9cea5-f0d4-4984-9813-b49df355a73e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.600050 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.600107 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zpjfl\" (UniqueName: \"kubernetes.io/projected/e0c9cea5-f0d4-4984-9813-b49df355a73e-kube-api-access-zpjfl\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:16 crc kubenswrapper[4769]: I1121 14:17:16.600130 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e0c9cea5-f0d4-4984-9813-b49df355a73e-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.031883 4769 generic.go:334] "Generic (PLEG): container finished" podID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerID="1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371" exitCode=0 Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.031937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerDied","Data":"1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371"} Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.032001 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6bq58" event={"ID":"e0c9cea5-f0d4-4984-9813-b49df355a73e","Type":"ContainerDied","Data":"a9261c7124437ac2c20fc9d1c64a5ca2d8ce5483e085175e5f9f5267b4b274f6"} Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.032029 4769 scope.go:117] "RemoveContainer" containerID="1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.032368 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6bq58" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.054966 4769 scope.go:117] "RemoveContainer" containerID="de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.066505 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6bq58"] Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.075702 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-6bq58"] Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.094436 4769 scope.go:117] "RemoveContainer" containerID="4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.118768 4769 scope.go:117] "RemoveContainer" containerID="1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371" Nov 21 14:17:17 crc kubenswrapper[4769]: E1121 14:17:17.120326 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371\": container with ID starting with 1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371 not found: ID does not exist" containerID="1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.120379 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371"} err="failed to get container status \"1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371\": rpc error: code = NotFound desc = could not find container \"1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371\": container with ID starting with 1190b13b8e943cae74a8c8251659046113febeadeabd2b3b09ab582e2edda371 not found: ID does not exist" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.120413 4769 scope.go:117] "RemoveContainer" containerID="de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef" Nov 21 14:17:17 crc kubenswrapper[4769]: E1121 14:17:17.120953 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef\": container with ID starting with de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef not found: ID does not exist" containerID="de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.120978 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef"} err="failed to get container status \"de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef\": rpc error: code = NotFound desc = could not find container \"de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef\": container with ID starting with de93759f35bb1455a8b86d07ced316f6ff4259ca44c5c3f3f599996e203592ef not found: ID does not exist" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.120994 4769 scope.go:117] "RemoveContainer" containerID="4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d" Nov 21 14:17:17 crc kubenswrapper[4769]: E1121 14:17:17.121504 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d\": container with ID starting with 4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d not found: ID does not exist" containerID="4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.121526 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d"} err="failed to get container status \"4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d\": rpc error: code = NotFound desc = could not find container \"4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d\": container with ID starting with 4922c5b25737ad650846e31d23e8bf3c615a195a675dd462f29195123d49f58d not found: ID does not exist" Nov 21 14:17:17 crc kubenswrapper[4769]: I1121 14:17:17.284503 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" path="/var/lib/kubelet/pods/e0c9cea5-f0d4-4984-9813-b49df355a73e/volumes" Nov 21 14:17:18 crc kubenswrapper[4769]: I1121 14:17:18.044227 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5skwg" event={"ID":"a515cddd-0670-4790-b2f9-af89f19b2d7b","Type":"ContainerStarted","Data":"e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30"} Nov 21 14:17:18 crc kubenswrapper[4769]: I1121 14:17:18.064273 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-5skwg" podStartSLOduration=3.399304031 podStartE2EDuration="6.064253488s" podCreationTimestamp="2025-11-21 14:17:12 +0000 UTC" firstStartedPulling="2025-11-21 14:17:13.985642152 +0000 UTC m=+8792.686303970" lastFinishedPulling="2025-11-21 14:17:16.650591599 +0000 UTC m=+8795.351253427" observedRunningTime="2025-11-21 14:17:18.059722007 +0000 UTC m=+8796.760383835" watchObservedRunningTime="2025-11-21 14:17:18.064253488 +0000 UTC m=+8796.764915306" Nov 21 14:17:19 crc kubenswrapper[4769]: I1121 14:17:19.060802 4769 generic.go:334] "Generic (PLEG): container finished" podID="0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" containerID="00f16034ba0b6b555809846f4a273b43989f46749351a1fe12e917d7c8e12334" exitCode=0 Nov 21 14:17:19 crc kubenswrapper[4769]: I1121 14:17:19.060933 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" event={"ID":"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051","Type":"ContainerDied","Data":"00f16034ba0b6b555809846f4a273b43989f46749351a1fe12e917d7c8e12334"} Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.680804 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.776881 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-config-data\") pod \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.776990 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-credential-keys\") pod \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.777036 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-scripts\") pod \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.777068 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-fernet-keys\") pod \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.777106 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gks6\" (UniqueName: \"kubernetes.io/projected/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-kube-api-access-4gks6\") pod \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\" (UID: \"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051\") " Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.782259 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" (UID: "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.782298 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-scripts" (OuterVolumeSpecName: "scripts") pod "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" (UID: "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.782329 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-kube-api-access-4gks6" (OuterVolumeSpecName: "kube-api-access-4gks6") pod "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" (UID: "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051"). InnerVolumeSpecName "kube-api-access-4gks6". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.782706 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" (UID: "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.799492 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-config-data" (OuterVolumeSpecName: "config-data") pod "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" (UID: "0f7d2c22-08fb-4bcb-b542-b83e1c8ff051"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.879341 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.879384 4769 reconciler_common.go:293] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-credential-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.879398 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.879410 4769 reconciler_common.go:293] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-fernet-keys\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:20 crc kubenswrapper[4769]: I1121 14:17:20.879427 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4gks6\" (UniqueName: \"kubernetes.io/projected/0f7d2c22-08fb-4bcb-b542-b83e1c8ff051-kube-api-access-4gks6\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.082954 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" event={"ID":"0f7d2c22-08fb-4bcb-b542-b83e1c8ff051","Type":"ContainerDied","Data":"cdc9856626e24d276e6a6c64ae3b21d8ebee541bc8157c1effaef5daa829528e"} Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.083000 4769 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdc9856626e24d276e6a6c64ae3b21d8ebee541bc8157c1effaef5daa829528e" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.083066 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-bootstrap-p9gqv" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.174770 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/keystone-67bb759f75-dks22"] Nov 21 14:17:21 crc kubenswrapper[4769]: E1121 14:17:21.175045 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" containerName="keystone-bootstrap" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175058 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" containerName="keystone-bootstrap" Nov 21 14:17:21 crc kubenswrapper[4769]: E1121 14:17:21.175074 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="registry-server" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175080 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="registry-server" Nov 21 14:17:21 crc kubenswrapper[4769]: E1121 14:17:21.175097 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="extract-utilities" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175104 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="extract-utilities" Nov 21 14:17:21 crc kubenswrapper[4769]: E1121 14:17:21.175119 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="extract-content" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175127 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="extract-content" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175266 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="e0c9cea5-f0d4-4984-9813-b49df355a73e" containerName="registry-server" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175283 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="0f7d2c22-08fb-4bcb-b542-b83e1c8ff051" containerName="keystone-bootstrap" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.175766 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.178390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.178456 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-config-data" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.178390 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-scripts" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.178557 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"keystone-keystone-dockercfg-v84dt" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.190593 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-67bb759f75-dks22"] Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.273937 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:17:21 crc kubenswrapper[4769]: E1121 14:17:21.274338 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.284419 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-scripts\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.284491 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-config-data\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.284520 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-fernet-keys\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.284605 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-credential-keys\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.284655 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjn62\" (UniqueName: \"kubernetes.io/projected/92bae0fe-5fbc-4e73-a303-01d3c647212c-kube-api-access-hjn62\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.385774 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hjn62\" (UniqueName: \"kubernetes.io/projected/92bae0fe-5fbc-4e73-a303-01d3c647212c-kube-api-access-hjn62\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.385952 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-scripts\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.386009 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-config-data\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.386034 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-fernet-keys\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.386082 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-credential-keys\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.389905 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-fernet-keys\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.390068 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-credential-keys\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.390550 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-config-data\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.398539 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/92bae0fe-5fbc-4e73-a303-01d3c647212c-scripts\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.401344 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjn62\" (UniqueName: \"kubernetes.io/projected/92bae0fe-5fbc-4e73-a303-01d3c647212c-kube-api-access-hjn62\") pod \"keystone-67bb759f75-dks22\" (UID: \"92bae0fe-5fbc-4e73-a303-01d3c647212c\") " pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.503812 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:21 crc kubenswrapper[4769]: I1121 14:17:21.994263 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/keystone-67bb759f75-dks22"] Nov 21 14:17:22 crc kubenswrapper[4769]: I1121 14:17:22.112863 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" event={"ID":"92bae0fe-5fbc-4e73-a303-01d3c647212c","Type":"ContainerStarted","Data":"2721ef07b16ba0611c7936f7ef41548fc00eeec501a5f8b3c2a9a38f9470e695"} Nov 21 14:17:22 crc kubenswrapper[4769]: I1121 14:17:22.923784 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:22 crc kubenswrapper[4769]: I1121 14:17:22.924174 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:23 crc kubenswrapper[4769]: I1121 14:17:23.001526 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:23 crc kubenswrapper[4769]: I1121 14:17:23.124351 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" event={"ID":"92bae0fe-5fbc-4e73-a303-01d3c647212c","Type":"ContainerStarted","Data":"06f8e363e9f18b645cdbc98f73856402aa1eb280a7a75dc69ce2fbf20b604ef6"} Nov 21 14:17:23 crc kubenswrapper[4769]: I1121 14:17:23.124402 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:23 crc kubenswrapper[4769]: I1121 14:17:23.187241 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:23 crc kubenswrapper[4769]: I1121 14:17:23.226135 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" podStartSLOduration=2.22610614 podStartE2EDuration="2.22610614s" podCreationTimestamp="2025-11-21 14:17:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:17:23.151941263 +0000 UTC m=+8801.852603081" watchObservedRunningTime="2025-11-21 14:17:23.22610614 +0000 UTC m=+8801.926768008" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.230851 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl"] Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.232353 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.234874 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"horizon-operator-controller-manager-service-cert" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.234978 4769 reflector.go:368] Caches populated for *v1.Secret from object-"openstack-operators"/"horizon-operator-controller-manager-dockercfg-gkvfq" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.246386 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl"] Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.337697 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/599cbbca-45e7-4380-87a7-b9fa2485de4e-apiservice-cert\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.337807 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/599cbbca-45e7-4380-87a7-b9fa2485de4e-webhook-cert\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.337862 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskzz\" (UniqueName: \"kubernetes.io/projected/599cbbca-45e7-4380-87a7-b9fa2485de4e-kube-api-access-cskzz\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.439911 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/599cbbca-45e7-4380-87a7-b9fa2485de4e-apiservice-cert\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.440028 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/599cbbca-45e7-4380-87a7-b9fa2485de4e-webhook-cert\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.440080 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cskzz\" (UniqueName: \"kubernetes.io/projected/599cbbca-45e7-4380-87a7-b9fa2485de4e-kube-api-access-cskzz\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.446666 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/599cbbca-45e7-4380-87a7-b9fa2485de4e-apiservice-cert\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.446699 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/599cbbca-45e7-4380-87a7-b9fa2485de4e-webhook-cert\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.457640 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskzz\" (UniqueName: \"kubernetes.io/projected/599cbbca-45e7-4380-87a7-b9fa2485de4e-kube-api-access-cskzz\") pod \"horizon-operator-controller-manager-7b94c4ddc7-jlbwl\" (UID: \"599cbbca-45e7-4380-87a7-b9fa2485de4e\") " pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.554677 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:24 crc kubenswrapper[4769]: I1121 14:17:24.805170 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl"] Nov 21 14:17:24 crc kubenswrapper[4769]: W1121 14:17:24.808840 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599cbbca_45e7_4380_87a7_b9fa2485de4e.slice/crio-0828e55e367813dc3faab62df8ffaeebaf910c153f9ba774726442229e1d4e38 WatchSource:0}: Error finding container 0828e55e367813dc3faab62df8ffaeebaf910c153f9ba774726442229e1d4e38: Status 404 returned error can't find the container with id 0828e55e367813dc3faab62df8ffaeebaf910c153f9ba774726442229e1d4e38 Nov 21 14:17:25 crc kubenswrapper[4769]: I1121 14:17:25.138127 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" event={"ID":"599cbbca-45e7-4380-87a7-b9fa2485de4e","Type":"ContainerStarted","Data":"47558e398de9b70b65c1c175eddd43ef0ec54ad0074f8f6c2a6308ad9eada916"} Nov 21 14:17:25 crc kubenswrapper[4769]: I1121 14:17:25.138431 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" event={"ID":"599cbbca-45e7-4380-87a7-b9fa2485de4e","Type":"ContainerStarted","Data":"a11fcc68f8e44522046586e3180e0aa9e1cff9dd54f3ed025d574f51f83b952d"} Nov 21 14:17:25 crc kubenswrapper[4769]: I1121 14:17:25.138444 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" event={"ID":"599cbbca-45e7-4380-87a7-b9fa2485de4e","Type":"ContainerStarted","Data":"0828e55e367813dc3faab62df8ffaeebaf910c153f9ba774726442229e1d4e38"} Nov 21 14:17:25 crc kubenswrapper[4769]: I1121 14:17:25.160888 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" podStartSLOduration=1.160869007 podStartE2EDuration="1.160869007s" podCreationTimestamp="2025-11-21 14:17:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:17:25.157274691 +0000 UTC m=+8803.857936519" watchObservedRunningTime="2025-11-21 14:17:25.160869007 +0000 UTC m=+8803.861530835" Nov 21 14:17:26 crc kubenswrapper[4769]: I1121 14:17:26.145133 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:26 crc kubenswrapper[4769]: I1121 14:17:26.558818 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-5skwg"] Nov 21 14:17:26 crc kubenswrapper[4769]: I1121 14:17:26.559079 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-5skwg" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="registry-server" containerID="cri-o://e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30" gracePeriod=2 Nov 21 14:17:26 crc kubenswrapper[4769]: I1121 14:17:26.987744 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.084727 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-catalog-content\") pod \"a515cddd-0670-4790-b2f9-af89f19b2d7b\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.085258 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-utilities\") pod \"a515cddd-0670-4790-b2f9-af89f19b2d7b\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.085326 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chvrq\" (UniqueName: \"kubernetes.io/projected/a515cddd-0670-4790-b2f9-af89f19b2d7b-kube-api-access-chvrq\") pod \"a515cddd-0670-4790-b2f9-af89f19b2d7b\" (UID: \"a515cddd-0670-4790-b2f9-af89f19b2d7b\") " Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.086885 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-utilities" (OuterVolumeSpecName: "utilities") pod "a515cddd-0670-4790-b2f9-af89f19b2d7b" (UID: "a515cddd-0670-4790-b2f9-af89f19b2d7b"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.091665 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a515cddd-0670-4790-b2f9-af89f19b2d7b-kube-api-access-chvrq" (OuterVolumeSpecName: "kube-api-access-chvrq") pod "a515cddd-0670-4790-b2f9-af89f19b2d7b" (UID: "a515cddd-0670-4790-b2f9-af89f19b2d7b"). InnerVolumeSpecName "kube-api-access-chvrq". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.137347 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "a515cddd-0670-4790-b2f9-af89f19b2d7b" (UID: "a515cddd-0670-4790-b2f9-af89f19b2d7b"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.155630 4769 generic.go:334] "Generic (PLEG): container finished" podID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerID="e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30" exitCode=0 Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.155697 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5skwg" event={"ID":"a515cddd-0670-4790-b2f9-af89f19b2d7b","Type":"ContainerDied","Data":"e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30"} Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.155758 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-5skwg" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.155778 4769 scope.go:117] "RemoveContainer" containerID="e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.155762 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-5skwg" event={"ID":"a515cddd-0670-4790-b2f9-af89f19b2d7b","Type":"ContainerDied","Data":"dd92033463cb98dd817e9392b89bdb4a68d381fa95b322be65e4e8068dbbff21"} Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.181503 4769 scope.go:117] "RemoveContainer" containerID="586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.190280 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-5skwg"] Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.192784 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.192828 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-chvrq\" (UniqueName: \"kubernetes.io/projected/a515cddd-0670-4790-b2f9-af89f19b2d7b-kube-api-access-chvrq\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.192860 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/a515cddd-0670-4790-b2f9-af89f19b2d7b-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.210995 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-5skwg"] Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.213169 4769 scope.go:117] "RemoveContainer" containerID="18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.243762 4769 scope.go:117] "RemoveContainer" containerID="e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30" Nov 21 14:17:27 crc kubenswrapper[4769]: E1121 14:17:27.244353 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30\": container with ID starting with e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30 not found: ID does not exist" containerID="e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.244385 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30"} err="failed to get container status \"e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30\": rpc error: code = NotFound desc = could not find container \"e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30\": container with ID starting with e6180e1404bb2b2cd424aba7653b29cda761f048151b8378627dac39546c6e30 not found: ID does not exist" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.244407 4769 scope.go:117] "RemoveContainer" containerID="586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d" Nov 21 14:17:27 crc kubenswrapper[4769]: E1121 14:17:27.244810 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d\": container with ID starting with 586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d not found: ID does not exist" containerID="586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.244838 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d"} err="failed to get container status \"586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d\": rpc error: code = NotFound desc = could not find container \"586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d\": container with ID starting with 586b8752c38ea858b6ad81392bc713e6155f07357a2857d064719088ffc67b2d not found: ID does not exist" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.244851 4769 scope.go:117] "RemoveContainer" containerID="18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d" Nov 21 14:17:27 crc kubenswrapper[4769]: E1121 14:17:27.245270 4769 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d\": container with ID starting with 18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d not found: ID does not exist" containerID="18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.245319 4769 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d"} err="failed to get container status \"18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d\": rpc error: code = NotFound desc = could not find container \"18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d\": container with ID starting with 18328c8e25e5063ff4f27a5f5de02ea210c556c5ad7dbac5d2fce767fa96c93d not found: ID does not exist" Nov 21 14:17:27 crc kubenswrapper[4769]: I1121 14:17:27.284434 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" path="/var/lib/kubelet/pods/a515cddd-0670-4790-b2f9-af89f19b2d7b/volumes" Nov 21 14:17:32 crc kubenswrapper[4769]: I1121 14:17:32.275036 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:17:32 crc kubenswrapper[4769]: E1121 14:17:32.276294 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:17:34 crc kubenswrapper[4769]: I1121 14:17:34.559899 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-7b94c4ddc7-jlbwl" Nov 21 14:17:43 crc kubenswrapper[4769]: I1121 14:17:43.280615 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:17:43 crc kubenswrapper[4769]: E1121 14:17:43.281771 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:17:53 crc kubenswrapper[4769]: I1121 14:17:53.017004 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/keystone-67bb759f75-dks22" Nov 21 14:17:57 crc kubenswrapper[4769]: I1121 14:17:57.273764 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:17:57 crc kubenswrapper[4769]: E1121 14:17:57.274622 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.946382 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t8cg8/must-gather-zwwjf"] Nov 21 14:17:58 crc kubenswrapper[4769]: E1121 14:17:58.946904 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="extract-utilities" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.946916 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="extract-utilities" Nov 21 14:17:58 crc kubenswrapper[4769]: E1121 14:17:58.946939 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="extract-content" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.946945 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="extract-content" Nov 21 14:17:58 crc kubenswrapper[4769]: E1121 14:17:58.946967 4769 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="registry-server" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.946974 4769 state_mem.go:107] "Deleted CPUSet assignment" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="registry-server" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.947106 4769 memory_manager.go:354] "RemoveStaleState removing state" podUID="a515cddd-0670-4790-b2f9-af89f19b2d7b" containerName="registry-server" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.947844 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.952560 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-t8cg8"/"kube-root-ca.crt" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.952685 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-t8cg8"/"openshift-service-ca.crt" Nov 21 14:17:58 crc kubenswrapper[4769]: I1121 14:17:58.966940 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t8cg8/must-gather-zwwjf"] Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.078924 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvljf\" (UniqueName: \"kubernetes.io/projected/b016dd3e-ee0a-4913-869e-30b677d31602-kube-api-access-mvljf\") pod \"must-gather-zwwjf\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.078986 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b016dd3e-ee0a-4913-869e-30b677d31602-must-gather-output\") pod \"must-gather-zwwjf\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.181148 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mvljf\" (UniqueName: \"kubernetes.io/projected/b016dd3e-ee0a-4913-869e-30b677d31602-kube-api-access-mvljf\") pod \"must-gather-zwwjf\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.181444 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b016dd3e-ee0a-4913-869e-30b677d31602-must-gather-output\") pod \"must-gather-zwwjf\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.182097 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b016dd3e-ee0a-4913-869e-30b677d31602-must-gather-output\") pod \"must-gather-zwwjf\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.197284 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-79d54dc4fc-wkh42"] Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.198541 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.201129 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"horizon-scripts" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.201579 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"horizon" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.201733 4769 reflector.go:368] Caches populated for *v1.ConfigMap from object-"horizon-kuttl-tests"/"horizon-config-data" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.201908 4769 reflector.go:368] Caches populated for *v1.Secret from object-"horizon-kuttl-tests"/"horizon-horizon-dockercfg-glwxv" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.207271 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvljf\" (UniqueName: \"kubernetes.io/projected/b016dd3e-ee0a-4913-869e-30b677d31602-kube-api-access-mvljf\") pod \"must-gather-zwwjf\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.222990 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-79d54dc4fc-wkh42"] Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.266846 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.287298 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-config-data\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.287373 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1598cacf-7980-4068-af18-e627dbfc476c-logs\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.287417 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-scripts\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.287450 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zdsp\" (UniqueName: \"kubernetes.io/projected/1598cacf-7980-4068-af18-e627dbfc476c-kube-api-access-4zdsp\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.287525 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/1598cacf-7980-4068-af18-e627dbfc476c-horizon-secret-key\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.352283 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5"] Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.354003 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.369770 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5"] Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.389062 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1598cacf-7980-4068-af18-e627dbfc476c-logs\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.389118 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-scripts\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.389142 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4zdsp\" (UniqueName: \"kubernetes.io/projected/1598cacf-7980-4068-af18-e627dbfc476c-kube-api-access-4zdsp\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.389212 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/1598cacf-7980-4068-af18-e627dbfc476c-horizon-secret-key\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.389266 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-config-data\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.390397 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-config-data\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.390791 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1598cacf-7980-4068-af18-e627dbfc476c-logs\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.390842 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-scripts\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.407878 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/1598cacf-7980-4068-af18-e627dbfc476c-horizon-secret-key\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.410567 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zdsp\" (UniqueName: \"kubernetes.io/projected/1598cacf-7980-4068-af18-e627dbfc476c-kube-api-access-4zdsp\") pod \"horizon-79d54dc4fc-wkh42\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.492558 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbvll\" (UniqueName: \"kubernetes.io/projected/22458148-2be2-488d-9833-8ae590282c4a-kube-api-access-kbvll\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.492598 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22458148-2be2-488d-9833-8ae590282c4a-config-data\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.492628 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22458148-2be2-488d-9833-8ae590282c4a-scripts\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.492682 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22458148-2be2-488d-9833-8ae590282c4a-horizon-secret-key\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.492736 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22458148-2be2-488d-9833-8ae590282c4a-logs\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.538313 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.593791 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22458148-2be2-488d-9833-8ae590282c4a-horizon-secret-key\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.593826 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22458148-2be2-488d-9833-8ae590282c4a-logs\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.593905 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kbvll\" (UniqueName: \"kubernetes.io/projected/22458148-2be2-488d-9833-8ae590282c4a-kube-api-access-kbvll\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.593921 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22458148-2be2-488d-9833-8ae590282c4a-config-data\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.593947 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22458148-2be2-488d-9833-8ae590282c4a-scripts\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.594550 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22458148-2be2-488d-9833-8ae590282c4a-scripts\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.595387 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/22458148-2be2-488d-9833-8ae590282c4a-logs\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.596470 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/22458148-2be2-488d-9833-8ae590282c4a-config-data\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.598819 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/22458148-2be2-488d-9833-8ae590282c4a-horizon-secret-key\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.610617 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbvll\" (UniqueName: \"kubernetes.io/projected/22458148-2be2-488d-9833-8ae590282c4a-kube-api-access-kbvll\") pod \"horizon-5d8c8475b5-4pcn5\" (UID: \"22458148-2be2-488d-9833-8ae590282c4a\") " pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.701700 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:17:59 crc kubenswrapper[4769]: I1121 14:17:59.776568 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t8cg8/must-gather-zwwjf"] Nov 21 14:17:59 crc kubenswrapper[4769]: W1121 14:17:59.785490 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb016dd3e_ee0a_4913_869e_30b677d31602.slice/crio-fcc850af2eedcf072fba2f2ec8409698918b44f0995d282cc46bfdb6b682197f WatchSource:0}: Error finding container fcc850af2eedcf072fba2f2ec8409698918b44f0995d282cc46bfdb6b682197f: Status 404 returned error can't find the container with id fcc850af2eedcf072fba2f2ec8409698918b44f0995d282cc46bfdb6b682197f Nov 21 14:18:00 crc kubenswrapper[4769]: I1121 14:18:00.036650 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-79d54dc4fc-wkh42"] Nov 21 14:18:00 crc kubenswrapper[4769]: W1121 14:18:00.040311 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1598cacf_7980_4068_af18_e627dbfc476c.slice/crio-c82024b414acb2e157e21dc7576fc37baf0ab34f3c7ea70c63c58ead2cf15bf1 WatchSource:0}: Error finding container c82024b414acb2e157e21dc7576fc37baf0ab34f3c7ea70c63c58ead2cf15bf1: Status 404 returned error can't find the container with id c82024b414acb2e157e21dc7576fc37baf0ab34f3c7ea70c63c58ead2cf15bf1 Nov 21 14:18:00 crc kubenswrapper[4769]: I1121 14:18:00.165624 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5"] Nov 21 14:18:00 crc kubenswrapper[4769]: W1121 14:18:00.173869 4769 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22458148_2be2_488d_9833_8ae590282c4a.slice/crio-2f638a04a62a2c6d4f063be1c610a5476e8bc8a40dbbf1f37bab4406d50a6e58 WatchSource:0}: Error finding container 2f638a04a62a2c6d4f063be1c610a5476e8bc8a40dbbf1f37bab4406d50a6e58: Status 404 returned error can't find the container with id 2f638a04a62a2c6d4f063be1c610a5476e8bc8a40dbbf1f37bab4406d50a6e58 Nov 21 14:18:00 crc kubenswrapper[4769]: I1121 14:18:00.448362 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" event={"ID":"22458148-2be2-488d-9833-8ae590282c4a","Type":"ContainerStarted","Data":"2f638a04a62a2c6d4f063be1c610a5476e8bc8a40dbbf1f37bab4406d50a6e58"} Nov 21 14:18:00 crc kubenswrapper[4769]: I1121 14:18:00.451088 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" event={"ID":"1598cacf-7980-4068-af18-e627dbfc476c","Type":"ContainerStarted","Data":"c82024b414acb2e157e21dc7576fc37baf0ab34f3c7ea70c63c58ead2cf15bf1"} Nov 21 14:18:00 crc kubenswrapper[4769]: I1121 14:18:00.452567 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" event={"ID":"b016dd3e-ee0a-4913-869e-30b677d31602","Type":"ContainerStarted","Data":"fcc850af2eedcf072fba2f2ec8409698918b44f0995d282cc46bfdb6b682197f"} Nov 21 14:18:09 crc kubenswrapper[4769]: I1121 14:18:09.273951 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:18:09 crc kubenswrapper[4769]: E1121 14:18:09.275899 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:18:15 crc kubenswrapper[4769]: E1121 14:18:15.945561 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/podified-antelope-centos9/openstack-horizon@sha256:f25dedbe7da86bde633171e44e0d310b9bf175b52436197194f7a43fb406e694" Nov 21 14:18:15 crc kubenswrapper[4769]: E1121 14:18:15.949365 4769 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:horizon-log,Image:quay.io/podified-antelope-centos9/openstack-horizon@sha256:f25dedbe7da86bde633171e44e0d310b9bf175b52436197194f7a43fb406e694,Command:[/bin/bash],Args:[-c tail -n+1 -F /var/log/horizon/horizon.log],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:n84h588h685hf5h57fh58ch5c4h57hdh68bh699h99h666hbfh64fh547hdfh559h698h677h65bh75h5cdh8dh74h669h67ch586h59h5f4h5cfh6bq,ValueFrom:nil,},EnvVar{Name:ENABLE_DESIGNATE,Value:yes,ValueFrom:nil,},EnvVar{Name:ENABLE_HEAT,Value:yes,ValueFrom:nil,},EnvVar{Name:ENABLE_IRONIC,Value:yes,ValueFrom:nil,},EnvVar{Name:ENABLE_MANILA,Value:yes,ValueFrom:nil,},EnvVar{Name:ENABLE_OCTAVIA,Value:yes,ValueFrom:nil,},EnvVar{Name:ENABLE_WATCHER,Value:no,ValueFrom:nil,},EnvVar{Name:KOLLA_CONFIG_STRATEGY,Value:COPY_ALWAYS,ValueFrom:nil,},EnvVar{Name:UNPACK_THEME,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:logs,ReadOnly:false,MountPath:/var/log/horizon,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-kbvll,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*48,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*42400,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod horizon-5d8c8475b5-4pcn5_horizon-kuttl-tests(22458148-2be2-488d-9833-8ae590282c4a): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled" logger="UnhandledError" Nov 21 14:18:15 crc kubenswrapper[4769]: E1121 14:18:15.956891 4769 log.go:32] "PullImage from image service failed" err="rpc error: code = Canceled desc = copying config: context canceled" image="quay.io/openstack-k8s-operators/openstack-must-gather:latest" Nov 21 14:18:15 crc kubenswrapper[4769]: E1121 14:18:15.957250 4769 kuberuntime_manager.go:1274] "Unhandled Error" err=< Nov 21 14:18:15 crc kubenswrapper[4769]: container &Container{Name:gather,Image:quay.io/openstack-k8s-operators/openstack-must-gather:latest,Command:[/bin/bash -c Nov 21 14:18:15 crc kubenswrapper[4769]: echo "[disk usage checker] Started" Nov 21 14:18:15 crc kubenswrapper[4769]: target_dir="/must-gather" Nov 21 14:18:15 crc kubenswrapper[4769]: usage_percentage_limit="30" Nov 21 14:18:15 crc kubenswrapper[4769]: while true; do Nov 21 14:18:15 crc kubenswrapper[4769]: disk_usage=$(du -s "$target_dir" | awk '{print $1}') Nov 21 14:18:15 crc kubenswrapper[4769]: disk_space=$(df -P "$target_dir" | awk 'NR==2 {print $2}') Nov 21 14:18:15 crc kubenswrapper[4769]: usage_percentage=$(( (disk_usage * 100) / disk_space )) Nov 21 14:18:15 crc kubenswrapper[4769]: echo "[disk usage checker] Volume usage percentage: current = ${usage_percentage} ; allowed = ${usage_percentage_limit}" Nov 21 14:18:15 crc kubenswrapper[4769]: if [ "$usage_percentage" -gt "$usage_percentage_limit" ]; then Nov 21 14:18:15 crc kubenswrapper[4769]: echo "[disk usage checker] Disk usage exceeds the volume percentage of ${usage_percentage_limit} for mounted directory, terminating..." Nov 21 14:18:15 crc kubenswrapper[4769]: pkill --signal SIGKILL gather Nov 21 14:18:15 crc kubenswrapper[4769]: exit 1 Nov 21 14:18:15 crc kubenswrapper[4769]: fi Nov 21 14:18:15 crc kubenswrapper[4769]: sleep 5 Nov 21 14:18:15 crc kubenswrapper[4769]: done & ADDITIONAL_NAMESPACES=kuttl,openshift-storage,openshift-marketplace,openshift-operators,sushy-emulator,tobiko OPENSTACK_DATABASES=ALL SOS_EDPM=all SOS_DECOMPRESS=0 gather; sync && echo 'Caches written to disk'],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:must-gather-output,ReadOnly:false,MountPath:/must-gather,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mvljf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod must-gather-zwwjf_openshift-must-gather-t8cg8(b016dd3e-ee0a-4913-869e-30b677d31602): ErrImagePull: rpc error: code = Canceled desc = copying config: context canceled Nov 21 14:18:15 crc kubenswrapper[4769]: > logger="UnhandledError" Nov 21 14:18:15 crc kubenswrapper[4769]: E1121 14:18:15.970292 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"gather\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\", failed to \"StartContainer\" for \"copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/openstack-must-gather:latest\\\"\"]" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" podUID="b016dd3e-ee0a-4913-869e-30b677d31602" Nov 21 14:18:16 crc kubenswrapper[4769]: E1121 14:18:16.235131 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"horizon-log\" with ErrImagePull: \"rpc error: code = Canceled desc = copying config: context canceled\"" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" podUID="22458148-2be2-488d-9833-8ae590282c4a" Nov 21 14:18:16 crc kubenswrapper[4769]: I1121 14:18:16.613301 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" event={"ID":"22458148-2be2-488d-9833-8ae590282c4a","Type":"ContainerStarted","Data":"15e05726816fd25caee143ce6d91b0a209135472d920aa95e359e3b1850ca1c4"} Nov 21 14:18:16 crc kubenswrapper[4769]: I1121 14:18:16.616450 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" event={"ID":"1598cacf-7980-4068-af18-e627dbfc476c","Type":"ContainerStarted","Data":"ffe17e3136b3f4cac972bea636dd16a3a2715395c3c3da95f0d0e531c85eadfe"} Nov 21 14:18:16 crc kubenswrapper[4769]: I1121 14:18:16.616513 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" event={"ID":"1598cacf-7980-4068-af18-e627dbfc476c","Type":"ContainerStarted","Data":"09d210aa53daa6d25e3c67345ca3867e76d14b63a6d4fe63a7372a2abce48dc2"} Nov 21 14:18:16 crc kubenswrapper[4769]: E1121 14:18:16.618561 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"gather\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/openstack-must-gather:latest\\\"\", failed to \"StartContainer\" for \"copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/openstack-must-gather:latest\\\"\"]" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" podUID="b016dd3e-ee0a-4913-869e-30b677d31602" Nov 21 14:18:16 crc kubenswrapper[4769]: I1121 14:18:16.662628 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podStartSLOduration=1.7322861550000002 podStartE2EDuration="17.662601699s" podCreationTimestamp="2025-11-21 14:17:59 +0000 UTC" firstStartedPulling="2025-11-21 14:18:00.042900918 +0000 UTC m=+8838.743562786" lastFinishedPulling="2025-11-21 14:18:15.973216502 +0000 UTC m=+8854.673878330" observedRunningTime="2025-11-21 14:18:16.662472825 +0000 UTC m=+8855.363134723" watchObservedRunningTime="2025-11-21 14:18:16.662601699 +0000 UTC m=+8855.363263517" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.376978 4769 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-8qv8k"] Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.380351 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.395009 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-8qv8k"] Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.447978 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-utilities\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.448486 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmlp\" (UniqueName: \"kubernetes.io/projected/faf82f96-1495-4058-8aae-abf22f7f45cd-kube-api-access-mdmlp\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.448626 4769 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-catalog-content\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.549271 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-catalog-content\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.549468 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-utilities\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.549536 4769 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmlp\" (UniqueName: \"kubernetes.io/projected/faf82f96-1495-4058-8aae-abf22f7f45cd-kube-api-access-mdmlp\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.549825 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-catalog-content\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.549960 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-utilities\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.568971 4769 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmlp\" (UniqueName: \"kubernetes.io/projected/faf82f96-1495-4058-8aae-abf22f7f45cd-kube-api-access-mdmlp\") pod \"community-operators-8qv8k\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.629443 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" event={"ID":"22458148-2be2-488d-9833-8ae590282c4a","Type":"ContainerStarted","Data":"6c859fa07e655407c967d89a3f5d4287e89455c6df1c2ea90df4260cdaae9274"} Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.650926 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" podStartSLOduration=-9223372018.203873 podStartE2EDuration="18.650903242s" podCreationTimestamp="2025-11-21 14:17:59 +0000 UTC" firstStartedPulling="2025-11-21 14:18:00.177540355 +0000 UTC m=+8838.878202163" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-21 14:18:17.648265841 +0000 UTC m=+8856.348927659" watchObservedRunningTime="2025-11-21 14:18:17.650903242 +0000 UTC m=+8856.351565060" Nov 21 14:18:17 crc kubenswrapper[4769]: I1121 14:18:17.701854 4769 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:18 crc kubenswrapper[4769]: I1121 14:18:18.232927 4769 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-8qv8k"] Nov 21 14:18:18 crc kubenswrapper[4769]: I1121 14:18:18.642809 4769 generic.go:334] "Generic (PLEG): container finished" podID="faf82f96-1495-4058-8aae-abf22f7f45cd" containerID="7fa1a833344ec62bdba450acdb0ab6b8fe0f22a95ff82789234bff5fbde4e37b" exitCode=0 Nov 21 14:18:18 crc kubenswrapper[4769]: I1121 14:18:18.642894 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerDied","Data":"7fa1a833344ec62bdba450acdb0ab6b8fe0f22a95ff82789234bff5fbde4e37b"} Nov 21 14:18:18 crc kubenswrapper[4769]: I1121 14:18:18.642976 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerStarted","Data":"7a69faeb73b628d4ca3f4c3990a2d9a666817b35a8ea66b03d5921189ed99f82"} Nov 21 14:18:19 crc kubenswrapper[4769]: I1121 14:18:19.541457 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:18:19 crc kubenswrapper[4769]: I1121 14:18:19.541841 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:18:19 crc kubenswrapper[4769]: I1121 14:18:19.654120 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerStarted","Data":"ad704dcd1fdc18635aa3ef17e1f7deac3f10dd30a4e170f3d9be57c188928843"} Nov 21 14:18:19 crc kubenswrapper[4769]: I1121 14:18:19.702544 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:18:19 crc kubenswrapper[4769]: I1121 14:18:19.702892 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:18:20 crc kubenswrapper[4769]: I1121 14:18:20.664362 4769 generic.go:334] "Generic (PLEG): container finished" podID="faf82f96-1495-4058-8aae-abf22f7f45cd" containerID="ad704dcd1fdc18635aa3ef17e1f7deac3f10dd30a4e170f3d9be57c188928843" exitCode=0 Nov 21 14:18:20 crc kubenswrapper[4769]: I1121 14:18:20.665395 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerDied","Data":"ad704dcd1fdc18635aa3ef17e1f7deac3f10dd30a4e170f3d9be57c188928843"} Nov 21 14:18:21 crc kubenswrapper[4769]: I1121 14:18:21.676087 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerStarted","Data":"17efc9e14ed440faee1d7a44879e8ff37afb1677f35818d9303daded4879781f"} Nov 21 14:18:21 crc kubenswrapper[4769]: I1121 14:18:21.698847 4769 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-8qv8k" podStartSLOduration=2.223006465 podStartE2EDuration="4.698824346s" podCreationTimestamp="2025-11-21 14:18:17 +0000 UTC" firstStartedPulling="2025-11-21 14:18:18.645540646 +0000 UTC m=+8857.346202514" lastFinishedPulling="2025-11-21 14:18:21.121358577 +0000 UTC m=+8859.822020395" observedRunningTime="2025-11-21 14:18:21.694080179 +0000 UTC m=+8860.394742017" watchObservedRunningTime="2025-11-21 14:18:21.698824346 +0000 UTC m=+8860.399486164" Nov 21 14:18:23 crc kubenswrapper[4769]: I1121 14:18:23.278944 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:18:23 crc kubenswrapper[4769]: E1121 14:18:23.279658 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:18:24 crc kubenswrapper[4769]: I1121 14:18:24.670735 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-t8cg8/must-gather-zwwjf"] Nov 21 14:18:24 crc kubenswrapper[4769]: I1121 14:18:24.682971 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-t8cg8/must-gather-zwwjf"] Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.012656 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.085614 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b016dd3e-ee0a-4913-869e-30b677d31602-must-gather-output\") pod \"b016dd3e-ee0a-4913-869e-30b677d31602\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.085744 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvljf\" (UniqueName: \"kubernetes.io/projected/b016dd3e-ee0a-4913-869e-30b677d31602-kube-api-access-mvljf\") pod \"b016dd3e-ee0a-4913-869e-30b677d31602\" (UID: \"b016dd3e-ee0a-4913-869e-30b677d31602\") " Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.087044 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b016dd3e-ee0a-4913-869e-30b677d31602-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b016dd3e-ee0a-4913-869e-30b677d31602" (UID: "b016dd3e-ee0a-4913-869e-30b677d31602"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.092021 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b016dd3e-ee0a-4913-869e-30b677d31602-kube-api-access-mvljf" (OuterVolumeSpecName: "kube-api-access-mvljf") pod "b016dd3e-ee0a-4913-869e-30b677d31602" (UID: "b016dd3e-ee0a-4913-869e-30b677d31602"). InnerVolumeSpecName "kube-api-access-mvljf". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.187740 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mvljf\" (UniqueName: \"kubernetes.io/projected/b016dd3e-ee0a-4913-869e-30b677d31602-kube-api-access-mvljf\") on node \"crc\" DevicePath \"\"" Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.187795 4769 reconciler_common.go:293] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b016dd3e-ee0a-4913-869e-30b677d31602-must-gather-output\") on node \"crc\" DevicePath \"\"" Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.284895 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b016dd3e-ee0a-4913-869e-30b677d31602" path="/var/lib/kubelet/pods/b016dd3e-ee0a-4913-869e-30b677d31602/volumes" Nov 21 14:18:25 crc kubenswrapper[4769]: I1121 14:18:25.711269 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t8cg8/must-gather-zwwjf" Nov 21 14:18:27 crc kubenswrapper[4769]: I1121 14:18:27.702028 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:27 crc kubenswrapper[4769]: I1121 14:18:27.702422 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:27 crc kubenswrapper[4769]: I1121 14:18:27.809234 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:27 crc kubenswrapper[4769]: I1121 14:18:27.909455 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:29 crc kubenswrapper[4769]: I1121 14:18:29.541532 4769 prober.go:107] "Probe failed" probeType="Startup" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podUID="1598cacf-7980-4068-af18-e627dbfc476c" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.120:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.120:8080: connect: connection refused" Nov 21 14:18:29 crc kubenswrapper[4769]: I1121 14:18:29.707930 4769 prober.go:107] "Probe failed" probeType="Startup" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" podUID="22458148-2be2-488d-9833-8ae590282c4a" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.121:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.121:8080: connect: connection refused" Nov 21 14:18:31 crc kubenswrapper[4769]: I1121 14:18:31.367882 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-8qv8k"] Nov 21 14:18:31 crc kubenswrapper[4769]: I1121 14:18:31.368445 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-marketplace/community-operators-8qv8k" podUID="faf82f96-1495-4058-8aae-abf22f7f45cd" containerName="registry-server" containerID="cri-o://17efc9e14ed440faee1d7a44879e8ff37afb1677f35818d9303daded4879781f" gracePeriod=2 Nov 21 14:18:32 crc kubenswrapper[4769]: I1121 14:18:32.804654 4769 generic.go:334] "Generic (PLEG): container finished" podID="faf82f96-1495-4058-8aae-abf22f7f45cd" containerID="17efc9e14ed440faee1d7a44879e8ff37afb1677f35818d9303daded4879781f" exitCode=0 Nov 21 14:18:32 crc kubenswrapper[4769]: I1121 14:18:32.807479 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerDied","Data":"17efc9e14ed440faee1d7a44879e8ff37afb1677f35818d9303daded4879781f"} Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.297927 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.464335 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-utilities\") pod \"faf82f96-1495-4058-8aae-abf22f7f45cd\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.464418 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-catalog-content\") pod \"faf82f96-1495-4058-8aae-abf22f7f45cd\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.464494 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdmlp\" (UniqueName: \"kubernetes.io/projected/faf82f96-1495-4058-8aae-abf22f7f45cd-kube-api-access-mdmlp\") pod \"faf82f96-1495-4058-8aae-abf22f7f45cd\" (UID: \"faf82f96-1495-4058-8aae-abf22f7f45cd\") " Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.467457 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-utilities" (OuterVolumeSpecName: "utilities") pod "faf82f96-1495-4058-8aae-abf22f7f45cd" (UID: "faf82f96-1495-4058-8aae-abf22f7f45cd"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.476910 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf82f96-1495-4058-8aae-abf22f7f45cd-kube-api-access-mdmlp" (OuterVolumeSpecName: "kube-api-access-mdmlp") pod "faf82f96-1495-4058-8aae-abf22f7f45cd" (UID: "faf82f96-1495-4058-8aae-abf22f7f45cd"). InnerVolumeSpecName "kube-api-access-mdmlp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.527117 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "faf82f96-1495-4058-8aae-abf22f7f45cd" (UID: "faf82f96-1495-4058-8aae-abf22f7f45cd"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.566132 4769 reconciler_common.go:293] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-utilities\") on node \"crc\" DevicePath \"\"" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.566174 4769 reconciler_common.go:293] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/faf82f96-1495-4058-8aae-abf22f7f45cd-catalog-content\") on node \"crc\" DevicePath \"\"" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.566198 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mdmlp\" (UniqueName: \"kubernetes.io/projected/faf82f96-1495-4058-8aae-abf22f7f45cd-kube-api-access-mdmlp\") on node \"crc\" DevicePath \"\"" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.842601 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-8qv8k" event={"ID":"faf82f96-1495-4058-8aae-abf22f7f45cd","Type":"ContainerDied","Data":"7a69faeb73b628d4ca3f4c3990a2d9a666817b35a8ea66b03d5921189ed99f82"} Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.842890 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-8qv8k" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.843024 4769 scope.go:117] "RemoveContainer" containerID="17efc9e14ed440faee1d7a44879e8ff37afb1677f35818d9303daded4879781f" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.878278 4769 scope.go:117] "RemoveContainer" containerID="ad704dcd1fdc18635aa3ef17e1f7deac3f10dd30a4e170f3d9be57c188928843" Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.883247 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-8qv8k"] Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.899985 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-8qv8k"] Nov 21 14:18:33 crc kubenswrapper[4769]: I1121 14:18:33.909505 4769 scope.go:117] "RemoveContainer" containerID="7fa1a833344ec62bdba450acdb0ab6b8fe0f22a95ff82789234bff5fbde4e37b" Nov 21 14:18:35 crc kubenswrapper[4769]: I1121 14:18:35.297504 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf82f96-1495-4058-8aae-abf22f7f45cd" path="/var/lib/kubelet/pods/faf82f96-1495-4058-8aae-abf22f7f45cd/volumes" Nov 21 14:18:38 crc kubenswrapper[4769]: I1121 14:18:38.274750 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:18:38 crc kubenswrapper[4769]: E1121 14:18:38.275976 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:18:41 crc kubenswrapper[4769]: I1121 14:18:41.323745 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:18:41 crc kubenswrapper[4769]: I1121 14:18:41.650026 4769 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:18:42 crc kubenswrapper[4769]: I1121 14:18:42.895347 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:18:43 crc kubenswrapper[4769]: I1121 14:18:43.378176 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="horizon-kuttl-tests/horizon-5d8c8475b5-4pcn5" Nov 21 14:18:43 crc kubenswrapper[4769]: I1121 14:18:43.461475 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-79d54dc4fc-wkh42"] Nov 21 14:18:43 crc kubenswrapper[4769]: I1121 14:18:43.462260 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podUID="1598cacf-7980-4068-af18-e627dbfc476c" containerName="horizon-log" containerID="cri-o://09d210aa53daa6d25e3c67345ca3867e76d14b63a6d4fe63a7372a2abce48dc2" gracePeriod=30 Nov 21 14:18:43 crc kubenswrapper[4769]: I1121 14:18:43.462448 4769 kuberuntime_container.go:808] "Killing container with a grace period" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podUID="1598cacf-7980-4068-af18-e627dbfc476c" containerName="horizon" containerID="cri-o://ffe17e3136b3f4cac972bea636dd16a3a2715395c3c3da95f0d0e531c85eadfe" gracePeriod=30 Nov 21 14:18:46 crc kubenswrapper[4769]: I1121 14:18:46.961844 4769 generic.go:334] "Generic (PLEG): container finished" podID="1598cacf-7980-4068-af18-e627dbfc476c" containerID="ffe17e3136b3f4cac972bea636dd16a3a2715395c3c3da95f0d0e531c85eadfe" exitCode=0 Nov 21 14:18:46 crc kubenswrapper[4769]: I1121 14:18:46.961937 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" event={"ID":"1598cacf-7980-4068-af18-e627dbfc476c","Type":"ContainerDied","Data":"ffe17e3136b3f4cac972bea636dd16a3a2715395c3c3da95f0d0e531c85eadfe"} Nov 21 14:18:49 crc kubenswrapper[4769]: I1121 14:18:49.540073 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podUID="1598cacf-7980-4068-af18-e627dbfc476c" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.120:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.120:8080: connect: connection refused" Nov 21 14:18:50 crc kubenswrapper[4769]: I1121 14:18:50.274621 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:18:50 crc kubenswrapper[4769]: E1121 14:18:50.275323 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:18:59 crc kubenswrapper[4769]: I1121 14:18:59.539968 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podUID="1598cacf-7980-4068-af18-e627dbfc476c" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.120:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.120:8080: connect: connection refused" Nov 21 14:19:04 crc kubenswrapper[4769]: I1121 14:19:04.276548 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:19:04 crc kubenswrapper[4769]: E1121 14:19:04.278383 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:19:09 crc kubenswrapper[4769]: I1121 14:19:09.540116 4769 prober.go:107] "Probe failed" probeType="Readiness" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" podUID="1598cacf-7980-4068-af18-e627dbfc476c" containerName="horizon" probeResult="failure" output="Get \"http://10.217.0.120:8080/dashboard/auth/login/?next=/dashboard/\": dial tcp 10.217.0.120:8080: connect: connection refused" Nov 21 14:19:09 crc kubenswrapper[4769]: I1121 14:19:09.541030 4769 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.225126 4769 generic.go:334] "Generic (PLEG): container finished" podID="1598cacf-7980-4068-af18-e627dbfc476c" containerID="09d210aa53daa6d25e3c67345ca3867e76d14b63a6d4fe63a7372a2abce48dc2" exitCode=137 Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.225255 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" event={"ID":"1598cacf-7980-4068-af18-e627dbfc476c","Type":"ContainerDied","Data":"09d210aa53daa6d25e3c67345ca3867e76d14b63a6d4fe63a7372a2abce48dc2"} Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.437687 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.538591 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-config-data\") pod \"1598cacf-7980-4068-af18-e627dbfc476c\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.538661 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-scripts\") pod \"1598cacf-7980-4068-af18-e627dbfc476c\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.538705 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zdsp\" (UniqueName: \"kubernetes.io/projected/1598cacf-7980-4068-af18-e627dbfc476c-kube-api-access-4zdsp\") pod \"1598cacf-7980-4068-af18-e627dbfc476c\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.538764 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/1598cacf-7980-4068-af18-e627dbfc476c-horizon-secret-key\") pod \"1598cacf-7980-4068-af18-e627dbfc476c\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.538843 4769 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1598cacf-7980-4068-af18-e627dbfc476c-logs\") pod \"1598cacf-7980-4068-af18-e627dbfc476c\" (UID: \"1598cacf-7980-4068-af18-e627dbfc476c\") " Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.539943 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598cacf-7980-4068-af18-e627dbfc476c-logs" (OuterVolumeSpecName: "logs") pod "1598cacf-7980-4068-af18-e627dbfc476c" (UID: "1598cacf-7980-4068-af18-e627dbfc476c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.544532 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1598cacf-7980-4068-af18-e627dbfc476c-horizon-secret-key" (OuterVolumeSpecName: "horizon-secret-key") pod "1598cacf-7980-4068-af18-e627dbfc476c" (UID: "1598cacf-7980-4068-af18-e627dbfc476c"). InnerVolumeSpecName "horizon-secret-key". PluginName "kubernetes.io/secret", VolumeGidValue "" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.545319 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1598cacf-7980-4068-af18-e627dbfc476c-kube-api-access-4zdsp" (OuterVolumeSpecName: "kube-api-access-4zdsp") pod "1598cacf-7980-4068-af18-e627dbfc476c" (UID: "1598cacf-7980-4068-af18-e627dbfc476c"). InnerVolumeSpecName "kube-api-access-4zdsp". PluginName "kubernetes.io/projected", VolumeGidValue "" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.556940 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-config-data" (OuterVolumeSpecName: "config-data") pod "1598cacf-7980-4068-af18-e627dbfc476c" (UID: "1598cacf-7980-4068-af18-e627dbfc476c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.559845 4769 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-scripts" (OuterVolumeSpecName: "scripts") pod "1598cacf-7980-4068-af18-e627dbfc476c" (UID: "1598cacf-7980-4068-af18-e627dbfc476c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.640903 4769 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-config-data\") on node \"crc\" DevicePath \"\"" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.641146 4769 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1598cacf-7980-4068-af18-e627dbfc476c-scripts\") on node \"crc\" DevicePath \"\"" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.641160 4769 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-4zdsp\" (UniqueName: \"kubernetes.io/projected/1598cacf-7980-4068-af18-e627dbfc476c-kube-api-access-4zdsp\") on node \"crc\" DevicePath \"\"" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.641172 4769 reconciler_common.go:293] "Volume detached for volume \"horizon-secret-key\" (UniqueName: \"kubernetes.io/secret/1598cacf-7980-4068-af18-e627dbfc476c-horizon-secret-key\") on node \"crc\" DevicePath \"\"" Nov 21 14:19:14 crc kubenswrapper[4769]: I1121 14:19:14.641181 4769 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1598cacf-7980-4068-af18-e627dbfc476c-logs\") on node \"crc\" DevicePath \"\"" Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.243927 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" event={"ID":"1598cacf-7980-4068-af18-e627dbfc476c","Type":"ContainerDied","Data":"c82024b414acb2e157e21dc7576fc37baf0ab34f3c7ea70c63c58ead2cf15bf1"} Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.244084 4769 scope.go:117] "RemoveContainer" containerID="ffe17e3136b3f4cac972bea636dd16a3a2715395c3c3da95f0d0e531c85eadfe" Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.244082 4769 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="horizon-kuttl-tests/horizon-79d54dc4fc-wkh42" Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.322170 4769 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["horizon-kuttl-tests/horizon-79d54dc4fc-wkh42"] Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.331779 4769 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["horizon-kuttl-tests/horizon-79d54dc4fc-wkh42"] Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.490482 4769 scope.go:117] "RemoveContainer" containerID="09d210aa53daa6d25e3c67345ca3867e76d14b63a6d4fe63a7372a2abce48dc2" Nov 21 14:19:15 crc kubenswrapper[4769]: I1121 14:19:15.982523 4769 scope.go:117] "RemoveContainer" containerID="380e69c7e4ca3f9c4058c041ab228b404237f3802eff3ca7aea29a8ea246f3bb" Nov 21 14:19:17 crc kubenswrapper[4769]: I1121 14:19:17.291707 4769 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1598cacf-7980-4068-af18-e627dbfc476c" path="/var/lib/kubelet/pods/1598cacf-7980-4068-af18-e627dbfc476c/volumes" Nov 21 14:19:18 crc kubenswrapper[4769]: I1121 14:19:18.273949 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:19:18 crc kubenswrapper[4769]: E1121 14:19:18.274447 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:19:33 crc kubenswrapper[4769]: I1121 14:19:33.283662 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:19:33 crc kubenswrapper[4769]: E1121 14:19:33.285104 4769 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-fm7pk_openshift-machine-config-operator(ac6c170d-36f7-482f-816d-9bc6b2a6bca0)\"" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" podUID="ac6c170d-36f7-482f-816d-9bc6b2a6bca0" Nov 21 14:19:47 crc kubenswrapper[4769]: I1121 14:19:47.275441 4769 scope.go:117] "RemoveContainer" containerID="51508a84e416ac8d5f023d9f442814ae9b3234fe245fa857a5c12cd95796ee20" Nov 21 14:19:47 crc kubenswrapper[4769]: I1121 14:19:47.594382 4769 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-fm7pk" event={"ID":"ac6c170d-36f7-482f-816d-9bc6b2a6bca0","Type":"ContainerStarted","Data":"6fcd0aae8d1379f555b30c58a500a39439e1012b5896050ff0cc490eecba1ee6"}